[ { "question": "Who sang knock three times on the ceiling if you want me?", "passages": [ [ "Knock Three Times", "Knock Three Times\n\n\"Knock Three Times\" is a popular song credited to Tony Orlando and Dawn.", "The actual singers were Tony Orlando, Toni Wine, and Linda November, prior to the creation of \"Dawn\" with Telma Hopkins and Joyce Vincent Wilson.", "The song was released as a single, paired with Orlando's other hit song, \"Candida\" (also written by Toni Wine).", "The single hit number one on the \"Billboard\" Hot 100 in January 1971 and eventually sold six million copies.", "The song registered well at Adult Contemporary stations, reaching #2 on Billboard's \"Easy Listening\" survey.", "Outside the US, \"Knock Three Times\" also claimed the number-one spot on the UK Singles Chart.", "The composers of this song, L. Russell Brown and Irwin Levine, were thinking of the song \"Up on the Roof\" and they wanted to write a song with that kind of lyrical flavor, about tenement living.", "In the song, the singer has fallen in love with a woman who lives in the apartment directly below him but has no clue as to her interest, so he asks her to respond by either knocking three times on the ceiling (yes) or banging twice on the pipe (no), and the chorus includes sound effects of the two choices." ], [ "Knock Three Times", "Michael Anthony Orlando Cassavitis was, at the time of the recording, working as a producer/singer for a rival record label, and first heard the tune recorded by another artist and immediately knew the song could be a hit if produced as he envisioned.", "Cassavitis cut the track discreetly under the name \"Tony Orlando\", hoping that his current record label would not find out.", "Upon release, the song became a great success.", "\"Knock Three Times\" appears in several motion pictures including \"Now and Then.", "The song was covered by Billy \"Crash\" Craddock in 1971 and became a number three country hit.", "Manny de Leon of the Philippines sold out in the market when he made his version under Alpha Records.\"", "Several Larry Craig-themed parodies (all titled \"Tap Three Times\") were recorded by various artists such as Paul and Storm and the Capitol Steps in 2007 following the senator's sex scandal in which he was arrested for tapping his foot (to allegedly solicit sex) in a public airport restroom." ] ], "gold": "Knock Three Times is a popular song from the early 1970s which was credited simply to Dawn. The actual singers of Knock Three Times were Tony Orlando, Toni Wine, and Linda November, although their names were not listed on the record. Orlando recorded under the name Dawn because he worked for a rival record label at the time and he didn't want his employers to know he recorded the song.", "prediction 1": "\"Knock Three Times\" is a popular song credited to Tony Orlando and Dawn. The actual singers were Tony Orlando, Toni Wine, and Linda November, prior to the creation of \"Dawn\" with Telma Hopkins and Joyce Vincent Wilson. The song was released as a single, paired with Orlando's other hit song, \"Candida\". The single hit number one on the \"Billboard\" Hot 100 in January 1971 and eventually sold six million copies. The song was covered by Billy \"Crash\" Craddock in 1971 and became a number three country hit. Manny de Leon of the Philippines sold out in the market when he made his version under Alpha Records.\n", "prediction 2": "\"Knock Three Times\" is a popular song credited to Tony Orlando and Dawn. The actual singers were Tony Orlando, Toni Wine, and Linda November, prior to the creation of \"Dawn\" with Telma Hopkins and Joyce Vincent Wilson. The 1971 version was sung by Michael Anthony Orlando Cassavitis, who was, at the time of the recording, working as a producer/singer for a rival record label. In addition to Tony Orlando, there were several other singers that performed if you wanted me. Carolyn Jones sang a warmed it with her. In 1971, a number three hit country version by Manny de Leon of the Philippines.", "prediction 3": "Tony Orlando sang knock three times on the ceiling if you want me in 1970. The song was released as a single, paired with Orlando's other hit song, Candida. The song\u2019s actual singers were Tony Orlando, Toni Wine, and Linda November prior to the creation of Dawn. In 1974, Peggy Lee sang knock three times on the ceiling if you want me. In 1975, Sam Cooke sang knock three times on the ceiling.", "prediction 4": "In the song, Tony Orlando is in love with a woman who lives in the apartment directly below him. He notifies her if she wants to go to the bathroom, knock three times on the ceiling (yes), or bang twice on the pipe (no). Manny de Leon of the Philippines then sings \"Knock Three Times\". Some of the previous versions of the song by Tony Orlando include performances by Gong, Michael Anthony Orlando Cassavitis in 1971, Travis Trittino in 1977, and Cat Steven Phillips in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 411 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 505 }, { "error type": "Irrelevant", "explanation": "", "start": 539, "end": 561 } ], "missing-info": [], "corrected-prediction": "\"Knock Three Times\" is a popular song credited to Tony Orlando and Dawn. The actual singers were Tony Orlando, Toni Wine, and Linda November, prior to the creation of \"Dawn\" with Telma Hopkins and Joyce Vincent Wilson. The song was covered by Billy \"Crash\" Craddock in 1971 . Manny de Leon of the Philippines made his version under Alpha Records.\n" }, "preference": [ 1, 1, 1, 0, 1, 0 ] }, { "question": "When was the us public health service founded?", "passages": [ [ "United States Public Health Service", "United States Public Health Service\n\nThe United States Public Health Service (USPHS) is a division of the Department of Health and Human Services concerned with public health.", "It contains eight out of the department's eleven operating divisions.", "The Assistant Secretary for Health (ASH) oversees the PHS.", "The Public Health Service Commissioned Corps (PHSCC) is the federal uniformed service of the USPHS, and is one of the seven uniformed services of the United States.", "Its origins can be traced to the establishment of 1798 of a system of marine hospitals.", "In 1870 these were consolidated into the Marine Hospital Service, and the position of Surgeon General was established.", "In 1889, the PHSCC was established.", "As the system's scope grew, it was renamed the Public Health Service in 1912.", "The Public Health Service Act of 1944 consolidated and revised previous laws and is the current legal basis for the PHS.", "It became the primary division of the Department of Health, Education and Welfare, established in 1953, which later became the Department of Health and Human Services in 1979.", "Eight out of the eleven operating divisions of the Department of Health and Human Services are designated as part of the Public Health Service:\n\n\nThe three other divisions are designated human services agencies and are not part of the Public Health Service.", "These are the Centers for Medicare and Medicaid Services, Administration for Children and Families, and Administration for Community Living." ] ], "gold": "The United States Public Health Service (USPHS or PHS) is a collection of agencies of the Department of Health and Human Services concerned with public health, containing eight out of the department's eleven operating divisions. Its origins can be traced to the establishment in July 1798 of a system of marine hospitals. As the system's scope grew, it was renamed the Public Health Service in 1912. The Public Health Service Act of 1944 consolidated and revised previous laws and is the current legal basis for the PHS. It became part of the Federal Security Agency and later the Department of Health, Education and Welfare, which became the Department of Health and Human Services in 1979.", "prediction 1": "The United States Public Health Service (USPHS) is a division of the Department of Health and Human Services concerned with public health. It contains eight out of the department's eleven operating divisions. The Public Health Service Commissioned Corps (PHSCC) is the federal uniformed service of the USPHS, and is one of the seven uniformed services of the United States. Its origins can be traced to the establishment of 1798 of a system of marine hospitals. In 1870 these were consolidated into the Marine Hospital Service, and the position of Surgeon General was established. In 1889, the PHSCC was established. As the system's scope grew, it was renamed the Public Health Service in 1912.\n", "prediction 2": "The United States Public Health Service, officially the Public Health Service of the United States, was founded on December 27, 1943, as a division of the Department of Health and Human Services. There were originally eight operating divisions of the Department of Health and Human Services.", "prediction 3": "The United States Public Health Service (USPHS) is a division of the Department of Health and Human Services concerned with public health, which it became the primary division of the Department of Health, Education and Welfare, established in 1953, which later became the Department of Health and Human Services in 1979.", "prediction 4": "The United States Public Health Service is a division of the Department of Health and Human Services concerned with public health. It contains eight out of the department's eleven operating divisions. The Public Health Service Commissioned Corps is the federal uniformed service of the USPHS, and is one of the seven uniformed services of the United States. Its origins can be traced to the establishment of 1798 of a system of marine hospitals. In 1870 these were consolidated into the Marine Hospital Service, and the position of Surgeon General was established. As the system's scope grew, it was renamed the Public Health Service in 1912. The Public Health Service Act of 1944 consolidated and revised previous laws and is the current legal basis for the USPHS. It became the primary division of the Department of Health, Education and Welfare, established in 1953, which later became the Department of Health and Human Services in 1979.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 462, "end": 580 }, { "error type": "Irrelevant", "explanation": "", "start": 581, "end": 616 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "The United States Public Health Service (USPHS) is a division of the Department of Health and Human Services concerned with public health. It contains eight out of the department's eleven operating divisions. Its origins can be traced to the establishment of 1798 of a system of marine hospitals. As the system's scope grew, it was renamed the Public Health Service in 1912. The Public Health Service Act of 1944 consolidated and revised previous laws and is the current legal basis for the PHS. It became the primary division of the Department of Health, Education and Welfare, established in 1953, which later became the Department of Health and Human Services in 1979.\n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When did the chargers make the super bowl?", "passages": [ [ "1994 San Diego Chargers season", "1994 San Diego Chargers season\n\nThe 1994 San Diego Chargers season was the team's 35th, its 25th in the National Football League (NFL), and its 34th in San Diego.", "The 1994 season began with the team trying to improve on their 8\u20138 record in 1993.", "They finished the season with an 11\u20135 record and were crowned AFC West Champions.", "After a 17\u201313 victory over the Pittsburgh Steelers in the AFC Championship game, they would advance to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium.", "To date, this is the Chargers' most recent, and only, Super Bowl appearance.", "The Chargers overcame a 21\u20136 halftime deficit by limiting the Dolphins offense to only 16 plays in the second half.", "
\n\nWith the upset win over the Steelers, the Chargers go to their first Super Bowl.", "
\n\n", "The 1994 Chargers are also remembered for tragedy in the form of numerous untimely deaths, as eight of the players from that 1994 squad have died prematurely since that time, all by the age of 44.", "It is part of a supposed locally infamous curse in the San Diego area, involving its sports teams." ], [ "Super Bowl XXIX", "Super Bowl XXIX\n\nSuper Bowl XXIX was an American football game between the American Football Conference (AFC) champion San Diego Chargers and the National Football Conference (NFC) champion San Francisco 49ers to decide the National Football League (NFL) champion for the 1994 season.", "This is the only Super Bowl in history to be played between two teams from the same state.", "The 49ers defeated the Chargers by the score of 49\u201326, becoming the first team to win five Super Bowl championships.", "The game was played on January 29, 1995 at Joe Robbie Stadium in Miami, Florida (now part of the suburb of Miami Gardens, which became a separate city in 2003).", "This game is regarded as 49ers quarterback Steve Young's final leap out of the shadow of his predecessor, Joe Montana, who had won four Super Bowls with the 49ers (in 1982, 1985, 1989, and 1990), two with Young as the backup quarterback.", "With Young at the helm, and a defense consisting of several veteran free agents who joined the team during the previous offseason, San Francisco finished the regular season with a league-best 13\u20133 record, and led the league in total points scored (505)." ] ], "gold": "The Los Angeles Chargers have only made one Super Bowl appearance, when they lost 49-26 to the San Francisco 49ers in Super Bowl XXIX on January 29, 1995 at Joe Robbie Stadium in Miami, Florida.", "prediction 1": "The 1994 San Diego Chargers season was the team's 35th, its 25th in the National Football League (NFL), and its 34th in San Diego. After a 17\u201313 victory over the Pittsburgh Steelers in the AFC Championship game, they would advance to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium. Super Bowl XXIX was an American football game between the American Football Conference (AFC) champion San Diego Chargers and the 49ers to decide the National Football League champion for the 1994 season.\n", "prediction 2": "The 1994 San Diego Chargers season was the team's 35th, its 25th in the National Football League (NFL), and its 34th in San Diego. After a 17\u201313 victory over the Pittsburgh Steelers in the AFC Championship game, they advanced to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium on January 29, 1995. Super Bowl XXIX is the only Super Bowl in NFL history to be played between two teams from the same state.", "prediction 3": "The 1994 San Diego Chargers season was the team's 35th, its 25th in the National Football League (NFL), and its 34th in San Diego. They finished the season with an 11\u20135 record and were crowned AFC West Champions. After a 17\u201313 victory over the Pittsburgh Steelers in the AFC Championship game, they would advance to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium. This was the first time that the Chargers have gone to the Super Bowl. To date, it is their most recent and their first Super Bowl appearance.", "prediction 4": "The 1994 San Diego Chargers season was the team's 35th, its 25th in the National Football League (NFL), and its 34th in San Diego. After a 17\u201313 victory over the Pittsburgh Steelers in the AFC Championship game, they would advance to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium. This is the Chargers' most recent, and only, Super Bowl appearance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 4, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 28, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 421 }, { "error type": "Redundant", "explanation": " they would advance to Super Bowl XXIX, only to lose to the San Francisco 49ers ", "start": 422, "end": 454 }, { "error type": "Irrelevant", "explanation": "", "start": 455, "end": 524 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The San Diego Chargers advanced to Super Bowl XXIX, only to lose to the San Francisco 49ers 49\u201326 at Joe Robbie Stadium in Miami, Florida on January 29, 1995. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where does the us rank for life expectancy at birth?", "passages": [ [ "Health in Canada", "Health in Canada\n\nMost health statistics in Canada in 2008 were at or above the G8 average.", "Direct comparisons of health statistics across nations is complex.", "The OECD collects comparative statistics, and has published brief country profiles.", "Life expectancy and health-adjusted life expectancy were on par with other similar countries in 2016.", "The leading causes of death and disability were non-communicable diseases.", "Cancer, cardiovascular diseases, musculoskeletal diseases, and mental health and substance use disorders between them made up 56% of all disability-adjusted life years.", "The age-standardized death rate reduced by 12% from 2006 to 2016, although for mental and substance use disorders it increased by 11%.", "From 2015, people over the age of 65 years outnumbered younger Canadians.", "A new measure of expected human capital calculated for 195 countries from 1990 to 2016 and defined for each birth cohort as the expected years lived from age 20 to 64 years and adjusted for educational attainment, learning or education quality, and functional health status was published by the Lancet in September 2018.", "Canada had the eleventh highest level of expected human capital with 25 health, education, and learning-adjusted expected years lived between age 20 and 64 years." ], [ "Health in Cyprus", "A systematic population analysis of deaths in the adult population (ages 15\u201359) and released in 2010 in The Lancet, place Cyprus as the country with the lowest mortality for females and 14th lowest mortality for males.", "In 2015 it was estimated that 10.2% of the population has diabetes, costing about $2,295 per person per year.", "Smoking rates in Cyprus are considered high by international standards.", "WHO Statistics from 1998 show that 38.5% of males were smokers.", "Healthcare in Cyprus" ], [ "Comparison of the healthcare systems in Canada and the United States", "In terms of population health, life expectancy in 2006 was about two and a half years longer in Canada, with Canadians living to an average of 79.9 years and Americans 77.5 years.", "Infant and child mortality rates are also higher in the U.S.", "Some comparisons suggest that the American system underperforms Canada's system as well as those of other industrialized nations with universal coverage.", "For example, a ranking by the World Health Organization of health care system performance among 191 member nations, published in 2000, ranked Canada 30th and the U.S. 37th, and the overall health of Canada 35th to the American 72nd.", "The WHO did not merely consider health care outcomes, but also placed heavy emphasis on the health disparities between rich and poor, funding for the health care needs of the poor, and the extent to which a country was reaching the potential health care outcomes they believed were possible for that nation.", "In an international comparison of 21 more specific quality indicators conducted by the Commonwealth Fund International Working Group on Quality Indicators, the results were more divided.", "One of the indicators was a tie, and in 3 others, data was unavailable from one country or the other.", "Canada performed better on 11 indicators; such as survival rates for colorectal cancer, childhood leukemia, and kidney and liver transplants." ] ], "gold": "Comparing life expectancies across countries can be problematic due to poor reporting in some countries and various local standards in collecting statistics. In 2015, the WHO listed the United States life expectancy at birth overall at 38. In 2016, the OECD put the US at 28. According to the UNDP, the US is ranked 35 at birth overall.", "prediction 1": "Life expectancy and health-adjusted life expectancy were on par with other similar countries in 2016. The OECD collects comparative statistics, and has published brief country profiles. In terms of population health, life expectancy in 2006 was about two and a half years longer in Canada, with Canadians living to an average of 79.5 years and Americans 77.5 years.\n", "prediction 2": "In the United States, life expectancy at birth is 39.3 years, compared to 37.4 in Canada. Infant and child mortality rates are also higher in the US.", "prediction 3": "In terms of population health, life expectancy in 2006 was about two and a half years longer in Canada with Canadians living to an average of 79.5 years and Americans 77.5 years. For example, a ranking by the World Health Organization of health care system performance among 191 member nations, published in 2000, ranked Canada 30th and the U.S. 37th, and the overall health of Canada 35th to the American 72nd.", "prediction 4": "The average life expectancy in the United States is 81 years for male, 53 years for female, and 78 years for all other age groups except whites, and 54 years for all other groups.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 101 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 339 } ], "missing-info": [], "corrected-prediction": " In terms of population health, life expectancy in 2006 for Americans was 77.5 years.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who was the cartoon dog that loved treats?", "passages": [ [ "Snuffles (character)", "Snuffles (character)\n\nSnuffles is an anthropomorphic cartoon dog appearing in animated television shorts produced by Hanna-Barbera beginning in 1959 on \"The Quick Draw McGraw Show\".", "Daws Butler provided his voice.", "Snuffles is a bloodhound used by Quick Draw to ferret out bad guys in the old West, but needed to be bribed with a dog biscuit before performing his task.", "Upon chomping on one, he would hug himself in ecstasy, jump into the air and float back down, sighing.", "Occasionally, Snuffles would demand more than one biscuit, and was willing to accept them from bad guys as well.", "Joe Barbera once said that Snuffles was added to cartoons at the request of the sponsor, Kellogg's Cereals.", "Snuffles appeared in seven Quick Draw McGraw cartoons and one Snagglepuss cartoon:", "He also made an appearance on the \"Johnny Bravo\" episode \"Double Vision\"." ], [ "Scooby-Doo (character)", "Voice actor Hadley Kay voiced the character for a brief period in 1997, for two episodes of \"Johnny Bravo\", and a few television commercials.", "Scott Innes (also the then-voice of Shaggy) voiced Scooby-Doo in four late 1990s/early 2000s direct-to-video films and continued to voice the character regularly for toys and video games (such as \"Scooby-Doo!", "Night of 100 Frights\") until 2008.", "Neil Fanning provided the voice of the computer-generated Scooby-Doo in the 2002 live-action film and its .", "Frank Welker (also the voice of Fred since 1969) has voiced Scooby since 2002, taking over beginning with \"What's New, Scooby-Doo?\" and other spin-offs including the live-action prequels \"Scooby-Doo!", "The Mystery Begins\" and \"Scooby-Doo!", "Curse of the Lake Monster\".", "Dave Coulier and Seth Green have both voiced the character in \"Robot Chicken\".", "Voiced By:\n\nVoiced by in unofficial material and other languages:\n\n\nCasey Kasem, the previous voice actor for Shaggy Rogers, said that Scooby is \"the star of the show\u2014the Shaquille O'Neal of the show.\"", "Kasem explained \"People love animals more than they love people." ], [ "The Quick Draw McGraw Show", "The Quick Draw McGraw Show\n\nThe Quick Draw McGraw Show is the third cartoon television production created by Hanna-Barbera, starring an anthropomorphic cartoon horse named \"Quick Draw McGraw\" following their success with \"The Ruff and Reddy Show\" and \"The Huckleberry Hound Show\".", "The show debuted in syndication in the fall of 1959, sponsored by Kellogg's.", "Voice actor Daws Butler performed the lead character, Quick Draw.", "The series featured 3 cartoons per episode, one each by Quick Draw McGraw & Baba Looey, father and son dog duo Augie Doggie & Doggie Daddy and cat and mouse detectives Snooper & Blabber.", "Michael Maltese wrote most of the episode stories.", "Screen Gems originally syndicated the series.", "Quick Draw (voiced by Daws Butler) was usually depicted as a sheriff in these short films set in the American Old West.", "Quick Draw was often accompanied by his deputy, a Mexican burro called Baba Looey (Butler).", "Although technically the side-kick, or deputy, to the main character of Sheriff Quick Draw, Baba Looey is often portrayed as the more thoughtful half of the duo; at times realizing some detail about a given situation and trying desperately without success to caution Quick Draw of a trap or other danger." ] ], "gold": "There are several cartoon dogs that loved treats, including Snuffles, who was a bloodhound from the animated TV series The Quick Draw McGraw Show, and Scooby-doo, who was a Great Dane from the animated TV series Scooby-Doo, Where Are You!", "prediction 1": "The cartoon dog that loved treats was Snuffles, voiced by Daws Butler in the 1959 cartoon The Quick Draw McGraw Show. Several other cartoon dogs also loved treats, including Scooby-Doo and Augie the dog, both of whom were voiced by Hadley Kay in 1997.", "prediction 2": "Snuffles is an anthropomorphic cartoon dog that appeared in animated television shorts produced by Hanna-Barbera beginning in 1959 on The Quick Draw McGraw Show. Daws Butler provided his voice for the cartoon. Snuffles is a bloodhound used by Quick Draw to ferret out bad guys in the old West, but needed to be bribed with a dog biscuit before performing his task. Upon chomping on one, he would hug himself in ecstasy, jump into the air and float back down, sighing. Occasionally, Snuffles would demand more than one biscuit, and was willing to accept them from bad guys as well.", "prediction 3": "The cartoon dog that loved treats was Snuffles, who was portrayed by Daws Butler in the 1959 cartoon, The Quick Draw McGraw Show. This cartoon featured a character named Quick Draw, who was a sheriff of the Old West. Snuffles, who was a bloodhound used by Quick Draw to ferret out bad guys, was bribed with a dog biscuit before performing his task. Upon chomping on one, he would hug himself in ecstasy, jump into the air and land again, sighing.", "prediction 4": "Snuffles was the cartoon dog that loved treats in animated television shorts produced by Hanna-Barbera beginning in 1959 on \"The Quick Draw McGraw Show\". Daws Butler provided his voice. Snuffles is a bloodhound used by Quick Draw to ferret out bad guys in the old West, but needed to be bribed with a dog biscuit before performing his task. Upon chomping on one, he would hug himself in ecstasy, jump into the air and float back down, sighing. Occasionally, Snuffles would demand more than one biscuit, and was willing to accept them from bad guys as well.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 69 }, { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 81 }, { "error type": "Unverifiable", "explanation": "", "start": 118, "end": 163 }, { "error type": "Unverifiable", "explanation": "", "start": 164, "end": 184 }, { "error type": "Unverifiable", "explanation": "", "start": 189, "end": 203 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 204, "end": 216 }, { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 251 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The cartoon dog that loved treats was Snuffles, who was a bloodhound in the animated TV shorts \"The Quick Draw McGraw Show\". " }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Dhcp can be placed into what category of service?", "passages": [ [ "Dynamic Host Configuration Protocol", "Dynamic Host Configuration Protocol\n\nThe Dynamic Host Configuration Protocol (DHCP) is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks.", "A DHCP server enables computers to request IP addresses and networking parameters automatically from the Internet service provider (ISP), reducing the need for a network administrator or a user to manually assign IP addresses to all network devices.", "In the absence of a DHCP server, a computer or other device on the network needs to be manually assigned an IP address, or to assign itself an APIPA address, which will not enable it to communicate outside its local subnet.", "DHCP can be implemented on networks ranging in size from home networks to large campus networks and regional Internet service provider networks.", "A router or a residential gateway can be enabled to act as a DHCP server.", "Most residential network routers receive a globally unique IP address within the ISP network.", "Within a local network, a DHCP server assigns a local IP address to each device connected to the network.", "UDP/IP defines how devices on one network communicate with devices on another network, and the DHCP server can manage UDP/IP settings for devices on a network, by automatically or dynamically assigning IP addresses to the devices." ], [ "Dynamic Host Configuration Protocol", "Depending on implementation, the DHCP server may have three methods of allocating IP addresses:\n\n\n\n\nDHCP is used for Internet Protocol version 4 (IPv4) and IPv6.", "While both versions serve the same purpose, the details of the protocol for IPv4 and IPv6 differ sufficiently that they may be considered separate protocols.", "For the IPv6 operation, devices may alternatively use stateless address autoconfiguration.", "IPv6 hosts may also use link-local addressing to achieve operations restricted to the local network link.", "The DHCP employs a connectionless service model, using the User Datagram Protocol (UDP).", "It is implemented with two UDP port numbers for its operations which are the same as for the bootstrap protocol (BOOTP).", "UDP port number 67 is the destination port of a server, and UDP port number 68 is used by the client.", "DHCP operations fall into four phases: server discovery, IP lease offer, IP lease request, and IP lease acknowledgement.", "These stages are often abbreviated as DORA for discovery, offer, request, and acknowledgement.", "The DHCP operation begins with clients broadcasting a request.", "If the client and server are on different subnets, a DHCP Helper or DHCP Relay Agent may be used." ], [ "VistA", "VistA\n\nThe Veterans Information Systems and Technology Architecture (VISTA) is the nationwide veterans clinical and business information system of the U.S. Department of Veterans Affairs.", "VISTA consists of 180 applications for clinical, financial, and administrative functions all integrated within a single database, providing single, authoritative source of data for all veteran-related care and services.", "The U.S. Congress mandates the VA keep the veterans health record in a single, authoritative, lifelong database, which is VISTA.", "VISTA supports the clinical, administrative, and financial operations of over 1200 hospitals and clinics of the Veterans Health Administration (VHA).", "The VHA is the largest integrated health delivery network in the United States, providing care for over 8 million veterans by 180,000 medical professionals throughout the continental U.S., Alaska, and Hawaii on a single, integrated national healthcare information network of VISTA systems.", "VISTA was developed by physician-developer teams within the U.S. Department of Veterans Affairs (VA), and as such has high physician user satisfaction.", "VISTA received the Computerworld Smithsonian Award for best use of Information Technology in Medicine in 1995, and continues to receive the highest overall physician satisfaction scores in national Electronic Health Record (EHR) surveys.", "In 2014 and again in 2016 national surveys of over 15,000 physician end-users of EHRs rated VISTA/CPRS the highest overall, above all other commercial EHR systems." ] ], "gold": "The DHCP that stands for Dynamic Host Configuration Protocol is a network management protocol used on Internet Protocol networks for automatically assigning IP addresses and other communication parameters to devices connected to the network using a client\u2013server architecture. The DHCP employs a connectionless service model, using the User Datagram Protocol and is implemented with two UDP port numbers for its operations which are the same as for the bootstrap protocol. There is also a DHCP that stands for Decentralized Hospital Computer Program, which has been renamed \"VistA,\" meaning Veterans Health Information System and Technology Architecture in 1994. VISTA is a health information system deployed across all veteran care sites in the United States that provides clinical, administrative, and financial functions for all of the 1700+ hospitals and clinics of the Veterans Health Administration and consists of 180 clinical, financial, and administrative applications integrated within a single transactional database.", "prediction 1": "The Dynamic Host Configuration Protocol (DHCP) is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks. Depending on implementation, the DHCP server may have three methods of allocating IP addresses. DHCP is used for Internet Protocol version 4 (IPv4) and IPv6. While both versions serve the same purpose, the details of the protocol for IPv4 and IPv6 differ sufficiently that they may be considered separate protocols.", "prediction 2": "The Dynamic Host Configuration Protocol is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks. DHCP can be placed into the service category of DHCP Helper or DHCP Relay Agent, where it performs discovery, lease offer, request, and acknowledgement.", "prediction 3": "The Dynamic Host Configuration Protocol (DHCP) is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks. A DHCP server enables computers to request IP addresses and networking parameters automatically from the Internet service provider (ISP), reducing the need for a network administrator or a user to manually assign IP addresses to all network devices. A router or a residential gateway can be enabled to act as a DHCP server.", "prediction 4": "The Dynamic Host Configuration Protocol (DHCP) is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks. A DHCP server enables computers to request IP addresses and networking parameters automatically from the Internet service provider (ISP), reducing the need for a network administrator or a user to manually assign IP addresses to all network devices.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 374 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 437, "end": 594 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Dynamic Host Configuration Protocol (DHCP) is a network management protocol used on UDP/IP networks whereby a DHCP server dynamically assigns an IP address and other network configuration parameters to each device on a network so they can communicate with other IP networks. The DHCP employs a connectionless service model, using the User Datagram Protocol. It is implemented with two UDP port numbers for its operations which are the same as for the bootstrap protocol. There is also the Veterans Information Systems and Technology Architecture (VISTA). VISTA consists of 180 applications for clinical, financial, and administrative functions all integrated within a single database, providing single, authoritative source of data for all veteran-related care and services. VISTA supports the clinical, administrative, and financial operations of over 1200 hospitals and clinics of the Veterans Health Administration (VHA)." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Red flag is the newspaper of which country?", "passages": [ [ "Socialist Alternative (Australia)", "Socialist Alternative host an annual far-left political conference in Melbourne each year called \"Marxism\", which has grown to attract over 1000 attendees \u2013 which has featured international guest speakers such as John Pilger and Malalai Joya \u2013 becoming the largest conference of its kind in Australia.", "Socialist Alternative also host regular political meetings and events and produce political commentary and analysis through their own various publications and through other publishers in which the organisation puts forward their positions on Australian and international issues.", "In 2013, Socialist Alternative started distribution of a fortnightly newspaper and website titled \"Red Flag\".", "Socialist Alternative was established in 1995 by ex-members of the former International Socialist Organisation (ISO) in Melbourne.", "Following debates over the orientation of the ISO to the Australian political situation, the members were expelled for arguing the ISO held \"overblown\" expectations of the 1990s combined with \"a super-inflated estimation\" of their own capabilities.", "This was part of the debate internationally within the International Socialist Tendency (IST) over the nature of the contemporary political situation and how socialists should respond, with the leading organisation in the IST, the British Socialist Workers Party (SWP) arguing, the 1990s were like \"the 1930s in slow motion\".", "Like in Australia, splits occurred within the IST in other countries, including New Zealand, Greece, Germany, Canada, South Africa and France." ], [ "Red Wing Republican Eagle", "Red Wing Republican Eagle\n\nThe Red Wing Republican Eagle is a newspaper in Red Wing, Minnesota.", "The publisher is Steve Messick and the editor is Anne Jacobson.", "The \"Red Wing Republican Eagle\" publishes two days a week \u2013 Wednesday and Saturday \u2013 and has a circulation of about 6,200.", "A weekend supplement has a circulation in excess of 18,000.", "The first edition of the \"Red Wing Republican\" hit the streets on September 4, 1857.", "It was a four-page edition produced by Lucius F. Hubbard, who had arrived by steamboat with an ancient hand press just a few weeks before.", "The 21-year-old tinsmith from upper New York state was ambitious.", "He would go on to become the ninth governor of Minnesota 25 years later.", "The newspaper became the \"Daily Republican\" on October 12, 1885, and merged with the rival \"Daily Eagle\" in 1940.", "The \"Daily Republican Eagle\"s first edition came out November 25 of that year.", "The newspaper dropped \"daily\" from its flag in 1969.", "Forum Communications purchased the \"Republican Eagle\" in 2001.", "In late 2009, the paper switched from daily publication to twice weekly.", "The paper is owned by Forum Communications, which owns 34 newspapers in four states and is based in Fargo, North Dakota." ], [ "Japanese Communist Party", "In September 2015 after the passage of the 2015 Japanese military legislation, the JCP called for cooperation from other opposition parties to form an interim government to abolish the bills.", "It was the first time the party had called for such cooperation with other parties.", "The JCP also advocates for more women in politics and political life.", "\"Shimbun Akahata\" (English: \"Red Flag Newspaper\") is the daily organ of the JCP in the form of a national newspaper.", "Several other newspapers preceded and merged into \"Red Flag\", including \"Daini Musansha Shinbun\" (English: \"The Second Proletarian News\"), which was merged into \"Red Flag\" in 1932.", "\"Daini Musansha Shinbun\" was itself the immediate successor to the original \"The Proletarian News\", which was banned by the government in September 1929.", "\"Daini Musansha Shinbun\" began publication immediately after the ban.", "In the past, the party published numerous other newspapers as well, including another national paper called \"Nihon Seiji Shinbun\" (English: \"Japan Political News\") and a theoretical journal called \"Zenshin\" (English: \"Forward\")." ], [ "Red Flag Publishing House", "Red Flag Publishing House\n\nRed Flag Publishing House or Hongqi Press (\u7ea2\u65d7\u51fa\u7248\u793e) is a book publisher based in China.", "It is a subsidiary company of Zhejiang Daily Press Group.", "Established in 1981, it is originally belonged to \"Qiushi\" Magazine and named after its predecessor \"Red Flag\" magazine, before its reconstruction in 2010.", "It mainly dedicated to political & economic publication, especially dealing with the construction and the political theories of Communist Party of China." ] ], "gold": "Globally, there are several news publications known as \"Red Flag\". The oldest is the Shimbun Akahata, founded in 1928 as the daily newspaper of the Communist Party of Japan. Other publications entitled Red Flag include a theoretical political journal published by the Communist Party of China beginning in 1958 and a Trotskyist Australian newspaper founded in 2013.", "prediction 1": "Red Flag is the newspaper of the Japanese Communist Party. The newspaper is published daily in Japan, with some editions published weekly. Red Flag Publishing House is a book publisher based in China. The Red Wing Republican Eagle is a newspaper in Red Wing, Minnesota. The publisher is Steve Messick and the editor is Anne Jacobson. Red Flag Publishing House or Hongqi Press is a book publisher based in China.", "prediction 2": "Red Flag Newspaper is a newspaper published by the Japanese Communist Party. Several other newspapers preceded and merged into Red Flag, including Daini Musansha Shinbun, which was merged into Red Flag in 1932. Red Flag Publishing House or Hongqi Press () is a book publisher based in China.", "prediction 3": "Red Flag is the newspaper of the Japanese Communist Party. Several other newspapers preceded and merged into Red Flag, including Daini Musansha Shinbun, which was merged into Red Flag in 1932. Red Flag Publishing House or Hongqi Press () is a book publisher based in China. Established in 1981, it is originally belonged to Qiushi Magazine and named after its predecessor \"Red Flag\" magazine, before its reconstruction in 2010. It mainly dedicated to political & economic publication, especially dealing with the construction and the political theories of Communist Party of China.", "prediction 4": "Red Flag Newspaper is the newspaper of the Japanese Communist Party in the form of a national newspaper. The newspaper was established in 1995 by ex-members of the former International Socialist Organisation. The newspaper, which first hit the streets in Red Wing, Minnesota, became the Daily Republican on October 12, 1885, and merged with the rival Daily Eagle in 1940. Red Flag Publishing House or Hongqi Press () is a book publisher based in China. Established in 1981, it is originally belonged to Qiushi Magazine and named after its predecessor, Red Flag magazine, before its reconstruction in 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 138 }, { "error type": "Redundant", "explanation": "Red Flag is the newspaper of the Japanese Communist Party. The newspaper is published daily in Japan, with some editions published weekly. Red Flag Publishing House is a book publisher based in China.", "start": 334, "end": 411 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 333 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": " \"Shimbun Akahata\"(Red Flag in English) is the newspaper of the Japanese Communist Party. The newspaper is published daily in Japan and has been in existence since at least 1932. Red Flag Publishing House is a book publisher based in China. In 2013, Socialist Alternative started distribution of a fortnightly newspaper and website titled \"Red Flag\" in Australia." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where is the villi located in the small intestine?", "passages": [ [ "Ileum", "Ileum\n\nThe ileum is the final section of the small intestine in most higher vertebrates, including mammals, reptiles, and birds.", "In fish, the divisions of the small intestine are not as clear and the terms posterior intestine or distal intestine may be used instead of ileum.", "The ileum follows the duodenum and jejunum and is separated from the cecum by the ileocecal valve (ICV).", "In humans, the ileum is about 2\u20134 m long, and the pH is usually between 7 and 8 (neutral or slightly alkaline).", "\"Ileum \"is derived from the Greek word \"eilein\", meaning \"to twist up tightly\".", "The ileum is the third and final part of the small intestine.", "It follows the jejunum and ends at the ileocecal junction, where the terminal ileum communicates with the cecum of the large intestine through the ileocecal valve.", "The ileum, along with the jejunum, is suspended inside the mesentery, a peritoneal formation that carries the blood vessels supplying them (the superior mesenteric artery and vein), lymphatic vessels and nerve fibers.", "There is no line of demarcation between the jejunum and the ileum." ], [ "Intestinal villus", "Intestinal villus\n\nIntestinal villi (singular: villus) are small, finger-like projections that extend into the lumen of the small intestine.", "Each villus is approximately 0.5\u20131.6\u00a0mm in length (in humans), and has many microvilli projecting from the enterocytes of its epithelium which collectively form the striated or brush border.", "Each of these microvilli are much smaller than a single villus.", "The intestinal villi are much smaller than any of the circular folds in the intestine.", "Villi increase the internal surface area of the intestinal walls making available a greater surface area for absorption.", "An increased absorptive area is useful because digested nutrients (including monosaccharide and amino acids) pass into the semipermeable villi through diffusion, which is effective only at short distances.", "In other words, increased surface area (in contact with the fluid in the lumen) decreases the average distance travelled by nutrient molecules, so effectiveness of diffusion increases.", "The villi are connected to the blood vessels so the circulating blood then carries these nutrients away.", "Enterocytes, along with goblet cells, represent the principal cell types of the epithelium of the villi in the small intestine." ] ], "gold": "Intestinal villi are small, finger-like projections that extend into the lumen of the small intestine. In the small intestine, villi are located in the epithelium layer of the mucous membrane. Some villi are located in the jejunum part of the small intestine and some are located in the ileum part of the small intestine.", "prediction 1": "The villi are small, finger-like projections that extend into the lumen of the small intestine. The villi are located in the region of the small intestine called the ileum, which is the final section of the small intestine in most higher vertebrates.", "prediction 2": "In the small intestine, the villi are located in the ileum, the third and final part of the small intestine. They extend into the lumen of the small intestine. The villi are finger-like projections that extend into the lumen of the small intestine. The villi are connected to the blood vessels so the circulating blood then carries these nutrients away.", "prediction 3": "The villi (singular: villus) are small, finger-like projections that extend into the lumen of the small intestine. The ileum is the final section of the small intestine in most higher vertebrates, including mammals, reptiles, and birds. The ileum follows the duodenum and jejunum and is separated from the cecum by the ileocecal valve.", "prediction 4": "In the small intestine, the villi are located in the ileum, which is the final section of the small intestine in most higher vertebrates, including mammals, reptiles, and birds.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 173, "end": 250 }, { "error type": "Unverifiable", "explanation": "", "start": 96, "end": 172 } ], "missing-info": [], "corrected-prediction": "The villi are small, finger-like projections that extend into the lumen of the small intestine. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who wrote the jazz classic i got rhythm?", "passages": [ [ "I Got Rhythm", "I Got Rhythm\n\n\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard.", "Its chord progression, known as the \"rhythm changes\", is the foundation for many other popular jazz tunes such as Charlie Parker's and Dizzy Gillespie's bebop standard \"Anthropology (Thrivin' on a Riff)\".", "The song came from the musical \"Girl Crazy\" which also includes two other hit songs, \"Embraceable You\" and \"But Not for Me\", and has been sung by many jazz singers since.", "It was originally written as a slow song for \"Treasure Girl\" (1928) and found another, faster setting in \"Girl Crazy\".", "Ethel Merman sang the song in the original Broadway production and Broadway lore holds that George Gershwin, after seeing her opening reviews, warned her never to take a singing lesson.", "The piece was originally penned in the key of D major.", "The song melody uses four notes of the five-note pentatonic scale, first rising, then falling.", "A rhythmic interest in the song is that the tune keeps behind the main pulse, with the three \"I got...\" phrases syncopated, appearing one beat behind in the first bar, while the fourth phase \"Who could...\" rushes in to the song." ] ], "gold": "\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930. It became a jazz standard. Its chord progression, known as the \"rhythm changes\", is the foundation for many other popular jazz tunes such as Charlie Parker's and Dizzy Gillespie's bebop standard \"Anthropology.\"", "prediction 1": "\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard. Its chord progression, known as the \"rhythm changes\", is the foundation for many other popular jazz tunes such as Charlie Parker's and Dizzy Gillespie's bebop standard \"Anthropology (Thrivin' on a Riff). The song came from the musical \"Girl Crazy\", which also includes two other hit songs, \"Embraceable You\" and \"But Not for Me\".\n", "prediction 2": "George Gershwin wrote \"I Got Rhythm\", a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard. The song came from the musical \"Girl Crazy\" which also includes two other hit songs, \"Embraceable You\" and \"But Not for Me\".", "prediction 3": "\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard. Its chord progression, known as the \"rhythm changes\", is the foundation for many other popular jazz tunes such as Charlie Parker's and Dizzy Gillespie's bebop standard \"Anthropology (Thrivin' on a Riff). The song came from the musical \"Girl Crazy\". It was originally written as a slow song for \"Treasure Girl\" (1928) but found another, faster setting in \"Girl Crazy\". Ethel Merman sang the original Broadway production and Broadway lore holds that George Gershwin warned Gershwin, after seeing her opening reviews, warned her never to take a singing lesson.", "prediction 4": "\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard. The piece was originally written as a slow song for \"Treasure Girl\" (1928), but found another, faster setting in \"Girl Crazy\". It came from the musical \"Girl Crazy\", which also includes two other hit songs, \"Embraceable You\" and \"But Not for Me\", and has been sung by many jazz singers since.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 338 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 465 } ], "missing-info": [], "corrected-prediction": "\"I Got Rhythm\" is a piece composed by George Gershwin with lyrics by Ira Gershwin and published in 1930, which became a jazz standard. Its chord progression, known as the \"rhythm changes\", is the foundation for many other popular jazz tunes such as Charlie Parker's and Dizzy Gillespie's bebop standard \"Anthropology\".\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who played the theme song for hawaii five o?", "passages": [ [ "Hawaii Five-O (album)", "Hawaii Five-O (album)\n\nHawaii Five-O is an instrumental album by the Ventures.", "It is named for the popular 1968 television series, and featured the theme song from the series as its title track.", "It was released in 1969 on Liberty Records LST-8061 and reached #11 on the \"Billboard\" Top LP chart, staying for 24 weeks.", "The album was certified gold by RIAA on July 21, 1971.", "The popularity of the album was propelled by the hit title track, which reached #4 on the \"Billboard\" Pop Singles chart." ], [ "The Ventures", "The Ventures\n\nThe Ventures are an American instrumental rock band, formed in 1958 in Tacoma, Washington, by Don Wilson and Bob Bogle.", "The band, a quartet for most of its existence, helped to popularize the electric guitar in the United States and across the world during the 1960s.", "While their popularity in the United States waned in the 1970s, the group remains especially revered in Japan, where they tour regularly to this day.", "The classic lineup of the band consisted of Wilson (rhythm guitar), Bogle (initially lead guitar, switched to bass), Nokie Edwards (initially bass, switched to lead guitar), and Mel Taylor (drums).", "Their first wide-release single, \"Walk, Don't Run\", brought international fame to the group, and is often cited as one of the top songs ever recorded for guitar.", "In the 1960s and early 1970s, 38 of the band's albums charted in the US, ranking them as the 6th best album chart performer during the 1960s, and the band had 14 singles in the Billboard", "Hot 100.", "With over 100 million records sold, the Ventures are the best-selling instrumental band of all time.", "The Ventures have had an enduring impact on the development of music worldwide.", "The band was among the first to employ and popularize fuzz and flanging guitar effects, concept albums, and twelve-string guitars in rock music." ], [ "Hawaii Five-O (1968 TV series)", "Most of the iconic shots are replicated, beginning with the helicopter approach and close-up turn of McGarrett at the Ilikai Hotel penthouse, the jet engine nacelle, a hula dancer's hips, the quickly stepped zoom-in to the face of the Lady Columbia statue at Punchbowl, the close-up of the Kamehameha Statue's face, and the ending with a police motorcycle's flashing blue light.", "Starting with the Season 7 many of the clips that were part of the original opening were removed and more action shots of the cast were included.", "On the March 19, 2012 episode, Ed Asner reprised his role as \"August March\", a character he first played in a 1975 episode.", "Clips from the 1975 episode were included in the new one, even though the 2010 series is intended to be in a different narrative universe than the Jack Lord series.", "Another legacy of the show is the popularity of the \"Hawaii Five-O\" theme music.", "The tune was composed by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra.", "The theme was later recorded by the Ventures, whose version reached No. 4 on the \"Billboard\" Hot 100 pop chart, and is particularly popular with college and high school marching bands, especially at the University of Hawaii where it has become the unofficial fight song." ] ], "gold": "The Hawaii Five-0 2010 series is an American action police procedural television series that centers around a special police major crimes task force operating at the behest of the governor of Hawaii and is a reboot of the 1968\u20131980 series Hawaii Five-O, which also aired on CBS. The Hawaii Five-O theme music is a legacy of the show. The tune was composed by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra. The theme was later recorded by American instrumental rock band, The Ventures, whose version reached No. 4 on the Billboard Hot 100 pop chart, and is particularly popular with college and high school marching bands, especially at the University of Hawaii where it has become the unofficial fight song.", "prediction 1": "The theme song for Hawaii Five-O was composed by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra. The theme was later recorded by the Ventures, whose version reached No. 4 on the Billboard Hot 100 pop chart, and is particularly popular with college and high school marching bands, especially at the University of Hawaii where it has become the unofficial fight song. The album was released in 1969 on Liberty Records LST-8061 and reached #11 on the Billboard Top LP chart, staying for 24 weeks. The album was certified gold by the RIAA on July 21, 1971.", "prediction 2": "The theme song for Hawaii Five-O was played by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra. The theme was later recorded by the Ventures, whose version reached No. 4 on the Billboard Hot 100 pop chart. The theme song for Hawaii Five-O was played by Ed Asner, Tony Alaio, and Chris \"Cycle\" Payne.", "prediction 3": "The theme song for Hawaii Five-O was recorded by the American instrumental rock band The Ventures and used by the CBS Orchestra. The theme was composed by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra. The Ventures also recorded a version of the theme song for the 1968 television series called \"Hawaii Five-O\" and used it as their title track.", "prediction 4": "The theme song for the 1968 television series, Hawaii Five-O, was played by Morton Stevens, Morton Stevens, the CBS Orchestra, and the Ventures.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 408, "end": 535 }, { "error type": "Irrelevant", "explanation": "", "start": 536, "end": 594 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The theme song for Hawaii Five-O was composed by Morton Stevens, who also composed numerous episode scores performed by the CBS Orchestra. The theme was later recorded by the American instrumental rock band Ventures, whose version reached No. 4 on the Billboard Hot 100 pop chart, and is particularly popular with college and high school marching bands, especially at the University of Hawaii where it has become the unofficial fight song. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who established the close connection between electricity and magnetism?", "passages": [ [ "History of electromagnetic theory", "In 1760 he similarly claimed that in 1750 he had been the first \"to think how the electric fire may be the cause of thunder\".", "Among the more important of the electrical research and experiments during this period were those of Franz Aepinus, a noted German scholar (1724\u20131802) and Henry Cavendish of London, England.", "Franz Aepinus is credited as the first to conceive of the view of the reciprocal relationship of electricity and magnetism.", "In his work \"Tentamen Theoria Electricitatis et Magnetism\", published in Saint Petersburg in 1759, he gives the following amplification of Franklin's theory, which in some of its features is measurably in accord with present-day views: \"The particles of the electric fluid repel each other, attract and are attracted by the particles of all bodies with a force that decreases in proportion as the distance increases; the electric fluid exists in the pores of bodies; it moves unobstructedly through non-electric (conductors), but moves with difficulty in insulators; the manifestations of electricity are due to the unequal distribution of the fluid in a body, or to the approach of bodies unequally charged with the fluid.\"", "Aepinus formulated a corresponding theory of magnetism excepting that, in the case of magnetic phenomena, the fluids only acted on the particles of iron." ], [ "History of electromagnetic theory", "In the late 19th century, the term luminiferous aether, meaning light-bearing aether, was a conjectured medium for the propagation of light.", "The word \"aether\" stems via Latin from the Greek \u03b1\u03b9\u03b8\u03ae\u03c1, from a root meaning to kindle, burn, or shine.", "It signifies the substance which was thought in ancient times to fill the upper regions of space, beyond the clouds.", "In 1864 James Clerk Maxwell of Edinburgh announced his electromagnetic theory of light, which was perhaps the greatest single step in the world's knowledge of electricity.", "Maxwell had studied and commented on the field of electricity and magnetism as early as 1855/6 when \"On Faraday's lines of force\" was read to the Cambridge Philosophical Society.", "The paper presented a simplified model of Faraday's work, and how the two phenomena were related.", "He reduced all of the current knowledge into a linked set of differential equations with 20 equations in 20 variables.", "This work was later published as \"On Physical Lines of Force\" in March 1861.", "In order to determine the force which is acting on any part of the machine we must find its momentum, and then calculate the rate at which this momentum is being changed.", "This rate of change will give us the force." ], [ "Electricity", "Alessandro Volta's battery, or voltaic pile, of 1800, made from alternating layers of zinc and copper, provided scientists with a more reliable source of electrical energy than the electrostatic machines previously used.", "The recognition of electromagnetism, the unity of electric and magnetic phenomena, is due to Hans Christian \u00d8rsted and Andr\u00e9-Marie Amp\u00e8re in 1819\u20131820.", "Michael Faraday invented the electric motor in 1821, and Georg Ohm mathematically analysed the electrical circuit in 1827.", "Electricity and magnetism (and light) were definitively linked by James Clerk Maxwell, in particular in his \"On Physical Lines of Force\" in 1861 and 1862.", "While the early 19th century had seen rapid progress in electrical science, the late 19th century would see the greatest progress in electrical engineering.", "Through such people as Alexander Graham Bell, Ott\u00f3 Bl\u00e1thy, Thomas Edison, Galileo Ferraris, Oliver Heaviside, \u00c1nyos Jedlik, William Thomson, 1st", "Baron Kelvin, Charles Algernon Parsons, Werner von Siemens, Joseph Swan, Reginald Fessenden, Nikola Tesla and George Westinghouse, electricity turned from a scientific curiosity into an essential tool for modern life.", "In 1887, Heinrich Hertz discovered that electrodes illuminated with ultraviolet light create electric sparks more easily." ] ], "gold": "Three were several who established the close connection between electricity and magnetism. The first person to suggest it was Henry Elles, while Michael Faraday and Joseph Henry discovered it through experiments on electromagnetic induction. James Clerk Maxwell established equations that predicted the connections between electricity and magnetism.", "prediction 1": "Franz Aepinus is credited as the first to conceive of the view of the reciprocal relationship of electricity and magnetism. In 1759, he wrote Tentamen Theoria Electricitatis et Magnetism, a work that gives the following amplification of Franklin's theory, which in some of its features is measurably in accord with present-day views. In 1864 James Clerk Maxwell announced his electromagnetic theory of light, which was perhaps the greatest single step in the world's knowledge of electricity and magnetism. Maxwell established the close connection between electricity and magnetism, the unity of electric and magnetic phenomena, the unity of electric and magnetic phenomena, in particular in his On Physical Lines of Force in March 1861 and 1862. Michael Faraday invented the electric motor in 1821, Georg Ohm mathematically analysed the electrical circuit in 1827.", "prediction 2": "The close connection between electricity and magnetism was established by James Clerk Maxwell, in particular in his On Physical Lines of Force in 1861 and 1862. In the early 19th century, the recognition of electromagnetism, the unity of electric and magnetic phenomena, is due to Hans Christian rsted and Andr\u00e9-Marie Amp\u00e8re in 1821. In the late 19th century, the discovery of electromagnetism, the unity of electric and magnetic phenomena, is due to Nikola Tesla and George Westinghouse.", "prediction 3": "The close connection between electricity and magnetism was established by James Clerk Maxwell, in particular in his 1861 and 1862 work On Physical Lines of Force. Franz Aepinus is credited as the first to conceive of the view of the reciprocal relationship of electricity and magnetism. Alexander Graham Bell, Ott\u00f3 Bl\u00e1thy, Thomas Edison, Galileo Ferraris, Oliver Heaviside, nyos Jedlik, William Thomson, Charles Algernon Parsons, Werner von Siemens, Heinrich Hertz, Heinrich Hertz discovered that electrodes illuminated with ultraviolet light create electric sparks more easily. Alexander Graham Bell, Ott\u00f3 Bl\u00e1thy, Galileo Ferraris, Galileo Ferraris, Thomas Edison, Galileo Ferraris, Galileo Ferraris, Galileo Ferraris, Galileo Ferraris, Nikola Tesla, Nikola Tesla and George Westing", "prediction 4": "In 1861 James Clerk Maxwell established the close connection between electricity and magnetism, in particular in his On Physical Lines of Force in 1861 and 1862. The recognition of electromagnetism, the unity of electric and magnetic phenomena, is due to Hans Christian rsted and Andr\u00e9-Marie Amp\u00e8re in 1819\u20131820. In 1887 Heinrich Hertz discovered that electrodes illuminated with ultraviolet light create electric sparks more easily.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 506 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 583, "end": 628 }, { "error type": "Redundant", "explanation": " Maxwell established the close connection between electricity and magnetism, the unity of electric and magnetic phenomena, ", "start": 629, "end": 674 }, { "error type": "Irrelevant", "explanation": "", "start": 747, "end": 865 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Franz Aepinus is credited as the first to conceive of the view of the reciprocal relationship of electricity and magnetism. In 1864 James Clerk Maxwell announced his electromagnetic theory of light. Maxwell established the close connection between electricity and magnetism, in particular in his On Physical Lines of Force in March 1861 and 1862. The recognition of electromagnetism, the unity of electric and magnetic phenomena, is due to Hans Christian \u00d8rsted and Andr\u00e9-Marie Amp\u00e8re in 1819\u20131820." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What books of the bible are included in the torah?", "passages": [ [ "Torah", "In contrast, there is every likelihood that its use in the post-Exilic works (Mal. 3:22; Dan. 9:11, 13; Ezra 3:2; 7:6; Neh. 8:1; II Chron. 23:18; 30:16) was intended to be comprehensive.", "Other early titles were \"The Book of Moses\" (Ezra 6:18; Neh. 13:1; II Chron. 35:12; 25:4; cf.", "II Kings 14:6) and \"The Book of the Torah\" (Neh. 8:3), which seems to be a contraction of a fuller name, \"The Book of the Torah of God\" (Neh. 8:8, 18; 10:29\u201330; cf. 9:3).", "Christian scholars usually refer to the first five books of the Hebrew Bible as the \"Pentateuch\" (, \"pent\u00e1teuchos\", \"five scrolls\"), a term first used in the Hellenistic Judaism of Alexandria.", "The Torah starts from the beginning of God's creating the world, through the beginnings of the people of Israel, their descent into Egypt, and the giving of the Torah at biblical Mount Sinai.", "It ends with the death of Moses, just before the people of Israel cross to the promised land of Canaan." ], [ "Ancient Hebrew writings", "\"Torah\" in this instance refers to the Pentateuch (to parallel \"Chumash\", \u05d7\u05d5\u05de\u05e9), so called because it consists of five books: Genesis, Exodus, Numbers, Leviticus and Deuteronomy.", "It is the core scripture of Judaism and Samaritanism, honored in these religions as the most sacred of scripture.", "It is sometimes called the \"Five Books of Moses\" because according to the Jewish tradition, the Torah, as a divinely inspired text, was given to Moses by God himself on Mount Sinai during the Exodus of the Israelites from Egypt, which is portrayed as the founding event in the formation of the Israelite religion.", "Other than discussing the Exodus itself and the journey to the Promised Land, the Pentateuch has such themes as the origin of the world, of humanity and of the ancient Israelites, the ancestors of modern-day Jews.", "The Nevi'im section of the Hebrew Bible consists of two sub-divisions: the Former Prophets ( , the narrative books of Joshua, Judges, Samuel and Kings) and the Latter Prophets ( , the books of Isaiah, Jeremiah and Ezekiel and the Twelve Minor Prophets)." ] ], "gold": "The Torah includes the first five books of the Hebrew Bible, namely: Genesis, Exodus, Leviticus, Numbers, and Deuteronomy. When used in that sense, Torah means the same as Pentateuch or the Five Books of Moses. It is also known in the Jewish tradition as the Written Torah. If meant for liturgic purposes, it takes the form of a Torah scroll.", "prediction 1": "The Torah, as the most sacred of the scriptures, is the Pentateuch, which consists of five books. Genesis, Exodus, Numbers, Leviticus, and Deuteronomy are included in the Torah. The other books include Numbers and Leviticus. The Torah is the final book of the Bible, but some books are not included in the Torah.", "prediction 2": "The Torah consists of five books, Genesis, Exodus, Numbers, Leviticus and Deuteronomy. Christian scholars usually refer to the first five books of the Hebrew Bible as the Pentateuch. The Torah is sometimes called the Five Books of Moses. According to the Jewish tradition, the Torah, as a divinely inspired text, was given to Moses by God himself on Mount Sinai during the Exodus of the Israelites from Egypt.", "prediction 3": "The Torah is sometimes called the \"Five Books of Moses\" because according to the Jewish tradition, the Torah, as a divinely inspired text, was given to Moses by God himself on Mount Sinai during the Exodus of the Israelites from Egypt. According to the Hebrew Bible, the Torah is divided into four books, the former Prophets, and the latter prophets, the books of Joshua, Judges, Samuel and Kings.", "prediction 4": "In the Bible, the five books that are included in the Torah are Genesis, Exodus, Numbers, Leviticus, and Deuteronomy. The Torah is the core scripture of Judaism and Samaritanism, honored in these religions as the most sacred of scripture. The Torah, as a divinely inspired text, was given to Moses by God himself on Mount Sinai during the Exodus of the Israelites from Egypt. The Torah also includes the books of Joshua, Judges, Samuel and Kings, the Twelve Minor Prophets, Jeremiah and Ezekiel.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Torah, as the most sacred of the scriptures, is the Pentateuch, which consists of five books. Genesis, Exodus, Numbers, Leviticus, ", "start": 178, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 312 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Torah, as the most sacred of the scriptures, is the Pentateuch, which consists of the first five books of the Hebrew Bible, sometimes called the \"Five Books of Moses\". Genesis, Exodus, Numbers, Leviticus, and Deuteronomy are included in the Torah. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played wonder woman's mother on the tv series?", "passages": [ [ "Wonder Woman (TV series)", "Despite (or perhaps because of) the fact that Wonder Woman had fallen in love with the first Steve Trevor, the producers chose to drop any suggestion that Steve Jr. and Wonder Woman were anything more than good friends.", "Indeed, when an impostor posing as Steve Jr. attempted to seduce Diana, she made it quite clear that she had no sexual interest in him.", "Executive producer Douglas S. Cramer noted the difficulties in maintaining long-term romantic tension between leads, because the resolution of that romantic tension often results in the cancellation of the series.", "Since Waggoner returned in a technically new role, Diana's mother Hippolyta was the only other first season character to be seen or mentioned, though she was played by a new actress, Beatrice Straight, succeeding Carolyn Jones and Cloris Leachman in the role.", "The post-war fates of General Phil Blankenship, Etta Candy, and Drusilla / Wonder Girl were never revealed.", "Diana, Steve and Joe Atkinson (Norman Burton), a weathered IADC agent, received their orders from a \"Charlie's Angels-like\" character who is heard but never seen.", "Diana and Steve would go out and work the field while Joe assisted from the office." ], [ "Wonder Woman (TV series)", "Wonder Woman (TV series)\n\nWonder Woman, known for seasons 2 and 3 as The New Adventures of Wonder Woman, is an American television series based on the DC Comics comic book superhero of the same name.", "The show stars Lynda Carter as Wonder Woman/Diana Prince and Lyle Waggoner as Steve Trevor Sr. & Jr.", "It originally aired for three seasons from 1975 to 1979.", "The show's first season aired on ABC and is set in the 1940s during World War II.", "The second and third seasons aired on CBS and are set in the 1970s, with the title changed to \"The New Adventures of Wonder Woman\", and a complete change of cast other than Carter and Waggoner.", "Waggoner's character was changed to Steve Trevor Jr., the son of his original character.", "\"Wonder Woman\" refers to both a 1974 television film and a 1975-79 television series based on the DC Comics character of the same name.", "The 1974 television film called \"Wonder Woman\" directed by Vincent McEveety and starring Cathy Lee Crosby, was a pilot for an intended television series being considered by ABC.", "Ratings were described as \"respectable but not exactly wondrous,\" and ABC did not pick up the pilot." ], [ "Wonder Woman (TV series)", "Unlike the earlier pilot, the comic-book origins of the character were emphasized by the retention of the character's traditional uniform (the design of which was interpreted and executed by Donald Lee Feld, credited as \"Donfeld\") with the original setting and through the use of comic book elements.", "The series's title sequence was animated in the form of a series of comic book panels featuring Wonder Woman performing a variety of heroic feats.", "Within the show, location and exposition were handled through comic book-style text panels.", "Transitions between scenes and commercial breaks were marked by animated starburst sequences.", "In early 1942, during the Second World War, American pilot Major Steve Trevor (Waggoner) bails out during an air battle over the Bermuda Triangle, location of Paradise Island.", "The island is home to the Amazons: beautiful, ageless women with great strength, agility, and intelligence.", "Amazon princess Diana (Carter) rescues the handsome unconscious Trevor and helps nurse him back to health.", "Her mother, the Amazon queen (Cloris Leachman; succeeded by Carolyn Jones and Beatrice Straight in later episodes), decrees that Olympic-style games shall be held to select one Amazon to return Trevor back to America.", "But she forbids her own daughter Diana, the princess, to participate." ] ], "gold": "Different actresses played the part of Wonder Woman's mother, Queen Hippolyta, in the Wonder Woman TV series and The New Adventures of Wonder Woman TV series. Carolyn Jones played Hippolyta in The Feminine Mystique: Parts 1 & 2, and in the episode called Wonder Woman in Hollywood. Cloris Leachman played Hippolyta in the episode, The New Original Wonder Woman. Actress Beatrice Straight also played Hippolyta.", "prediction 1": "Wonder Woman, known for seasons 2 and 3 as The New Adventures of Wonder Woman, is an American television series based on the DC Comics superhero of the same name. It originally aired for three seasons from 1975 to 1979. Diana's mother Hippolyta was the only other first season character to be seen or mentioned, though she was played by a new actress, Beatrice Straight, succeeding Carolyn Jones and Cloris Leachman in the role.", "prediction 2": "Wonder Woman, known for seasons 2 and 3 as The New Adventures of Wonder Woman, is an American television series based on the DC Comics superhero of the same name, with Lynda Carter as Wonder Woman and Lyle Waggoner as Steve Trevor Sr. & Jr. The mother of Wonder Woman, Hippolyta, is played by Carolyn Jones in later episodes of the show. Throughout the series, Carolyn Jones played Hippolyta.", "prediction 3": "Wonder Woman, known for seasons 2 and 3 as The New Adventures of Wonder Woman, is an American television series based on the DC Comics superhero of the same name. Hippolyta, Wonder Woman's mother, was played by Carolyn Jones and Beatrice Straight in later episodes. In the 1974 film Wonder Woman, Carol Leachman played Hippolyta. In the 1975-79 television series, Beatrice Straight played Hippolyta's mother, Hippolyta, the Amazon queen.", "prediction 4": "Wonder Woman is an American television series based on the DC Comics superhero of the same name that originally aired for three seasons from 1975 to 1979. The series stars Lynda Carter as Wonder Woman/Diana Prince and Lyle Waggoner as Steve Trevor Sr. & Jr. The mother of Wonder Woman on the show was played by Carolyn Jones and Beatrice Straight in later episodes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 322 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "Wonder Woman, known for seasons 2 and 3 as The New Adventures of Wonder Woman, is an American television series. Diana's mother Queen Hippolyta was played by a new actress, Beatrice Straight, succeeding Carolyn Jones and Cloris Leachman in the role." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who played george bailey in it's a wonderful life?", "passages": [ [ "It's a Wonderful Life", "It's a Wonderful Life\n\nIt's a Wonderful Life is a 1946 American Christmas fantasy comedy-drama film produced and directed by Frank Capra, based on the short story and booklet \"The Greatest Gift\", which Philip Van Doren Stern wrote in 1939 and published privately in 1945.", "The film stars James Stewart as George Bailey, a man who has given up his dreams in order to help others, and whose imminent suicide on Christmas Eve brings about the intervention of his guardian angel, Clarence Odbody (Henry Travers).", "Clarence shows George all the lives he has touched, and how different life in his community of Bedford Falls would be if he had never been born.", "Despite initially performing poorly at the box office because of stiff competition at the time of its release, the film has become regarded as a classic, and is a staple of Christmas television around the world.", "The film is considered one of the most loved films in American cinema, and has become traditional viewing during the Christmas season.", "Theatrically, the film's break-even point was $6.3\u00a0million, approximately twice the production cost, a figure it never came close to achieving in its initial release." ], [ "George Bailey (It's a Wonderful Life)", "George Bailey (It's a Wonderful Life)\n\n", "George Bailey is a fictional character and the protagonist in Frank Capra's 1946 film \"It's a Wonderful Life\".", "The character is a building and loan banker who sacrifices his dreams in order to help his community, to the point where he feels life has passed him by.", "Eventually, due to a cruel business rival's manipulations, Bailey falls into despair so deep that he contemplates suicide, until his guardian angel, Clarence Odbody, gives him a valuable perspective on the worth of his life.", "The character was listed ninth on the American Film Institute's 2003 list of the 50 greatest screen heroes.", "Bailey is played by James Stewart as an adult and Bobby Anderson as a child, and is loosely based on George Pratt, a character in Philip Van Doren Stern's \"The Greatest Gift\".", "In the winter of 1919, George (aged 12, portrayed by Bobby Anderson) and his friends Bert, Ernie Bishop, Marty Hatch, Sam Wainwright, and his brother Harry are sledding on a frozen river.", "Harry breaks through the ice and George jumps into the freezing water to save him.", "George develops an infection which deafens him in his left ear." ] ], "gold": "It's a Wonderful Life is a 1946 American Christmas family fantasy drama film produced and directed by Frank Capra, based on the short story and booklet The Greatest Gift, which Philip Van Doren Stern self-published in 1943 and is in turn loosely based on the 1843 Charles Dickens novella A Christmas Carol. George Bailey is a fictional character and the protagonist in Frank Capra's 1946 film It's a Wonderful Life. Bailey is played by James Stewart as an adult and Bobby Anderson as a child, and is loosely based on George Pratt, a character in Philip Van Doren Stern's 1943 booklet The Greatest Gift.", "prediction 1": "It's a Wonderful Life is a 1946 American Christmas fantasy comedy-drama film produced and directed by Frank Capra, based on the short story and booklet \"The Greatest Gift\", which Philip Van Doren Stern wrote in 1939 and published privately in 1945. The film stars James Stewart as George Bailey, a man who has given up his dreams in order to help others, and whose imminent suicide on Christmas Eve brings about the intervention of his guardian angel, Clarence Odbody, played by Henry Travers. Clarence Odbody shows George all the lives he has touched, and how different life in his community of Bedford Falls would be if he had never been born.", "prediction 2": "It's a Wonderful Life is a 1946 American Christmas fantasy comedy-drama film produced and directed by Frank Capra, based on the short story and booklet \"The Greatest Gift\", which Philip Van Doren Stern wrote in 1939 and published privately in 1945. The film stars James Stewart as George Bailey, a building and loan banker who sacrifices his dreams in order to help others, and whose imminent suicide on Christmas Eve brings about the intervention of his guardian angel, Clarence Odbody, played by Henry Travers. Bailey is played by James Stewart as an adult, and Bobby Anderson as a child, and is loosely based on George Pratttttt, a character in Philip Van Doren Stern's The Greatest Gift.", "prediction 3": "George Bailey is a fictional character and the protagonist in Frank Capra's 1946 film It's a Wonderful Life. The film stars James Stewart as George Bailey, a banker who sacrifices his dreams in order to help others, and whose imminent suicide on Christmas Eve brings about the intervention of his guardian angel, Clarence Odbody, played by Henry Travers. Clarence shows George all the lives he has touched, and how different life in his community of Bedford Falls would be if he had never been born.", "prediction 4": "It's a Wonderful Life is a 1946 American Christmas fantasy comedy-drama film produced and directed by Frank Capra, based on the short story and booklet \"The Greatest Gift\", which Philip Van Doren Stern wrote in 1939 and published privately in 1945. The film stars James Stewart as George Bailey, a building and loan banker who sacrifices his dreams in order to help others, and whose imminent suicide on Christmas Eve brings about the intervention of his guardian angel, Clarence Odbody, played by Henry Travers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 493 }, { "error type": "Irrelevant", "explanation": "", "start": 494, "end": 645 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "It's a Wonderful Life is a 1946 American Christmas fantasy comedy-drama film produced and directed by Frank Capra, based on the short story and booklet \"The Greatest Gift\", which Philip Van Doren Stern wrote in 1939 and published privately in 1945. George Bailey is a fictional character and the protagonist in Frank Capra's 1946 film \"It's a Wonderful Life\". Bailey is played by James Stewart as an adult and Bobby Anderson as a child, and is loosely based on George Pratt, a character in Philip Van Doren Stern's \"The Greatest Gift\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays jack abbott on young and the restless?", "passages": [ [ "Jack Abbott (The Young and the Restless)", "Jack Abbott (The Young and the Restless)\n\nJack Abbott is a fictional character from the American CBS soap opera \"The Young and the Restless\".", "The character was first introduced in 1980 being portrayed by Terry Lester.", "Lester departed from the series in 1989 and was replaced by Peter Bergman shortly thereafter.", "Bergman relocated to California for the role after he successfully auditioned for the part.", "His first episode aired on November 27, 1989.", "Jack is known for his longstanding feud with the Newman family patriarch, Victor Newman as well as his romances with Nikki Newman, Phyllis Summers and Sharon Newman.", "Jack has represented the Abbott family as the patriarch since the 2006 passing of his father, John Abbott.", "The role of Jack Abbott was first written into the series in June 1980, being portrayed by Terry Lester.", "In May 1985, it was announced that Lester would be leaving the role; he stated that it was because of a CBS film (\"Blade\") he starred in which could have possibly become a series: \"I wanted to work something out.", "I've enjoyed being with the show.", "However, I was concerned about the possibility of \"Blade\" being picked up as a series and being tied to \"The Young and the Restless\".\"", "However, he ended up staying.", "The writers picked up on Lester having \"played with Jack's dialogue\" according to his intuitions." ], [ "Jack Abbott (The Young and the Restless)", "In 1989, Lester quit out of anger, as he felt that Jack was being \"squeezed\" out of the storyline, and was upset that Lauralee Bell's character Christine Blair was moved to the forefront of several storylines.", "The producers immediately began exploring recast options.", "At the time, Bergman, who had rose to super stardom as Dr. Cliff Warner on \"All My Children\", had recently been fired.", "Bergman's firing made headlines, and Melody Thomas Scott, who portrays Nikki Newman, suggested Bergman as Jack to her husband and former executive producer Edward J. Scott when she read of the news in \"Soap Opera Digest\".", "Bergman revealed that the producers had contacted his agent and asked about his height; he initially thought it was a joke.", "They then inquired about Bergman's feelings about replacing someone, and he was hesitant to take the role.", "He stated in 2009: \"I was on \"All My Children\" and replacing someone was sheer death, and it never worked on \"All My Children\".\"", "When the producers called him again, Bergman was not doing well financially and he decided it \"couldn't hurt\" to audition.", "Scott arranged for Bergman to come to California and audition with Jerry Douglas and Jess Walton, who portrayed John and Jill Abbott respectively.", "After a successful audition, Bergman was offered the part." ], [ "Peter Bergman", "Peter Bergman\n\nPeter Michael Bergman (born June 11, 1953) is an American actor best known for his portrayals as Dr. Cliff Warner on \"All My Children\" (1979\u201389) as well as Jack Abbott on \"The Young and the Restless\" (1989\u2013present).", "The son of Walter Bergman, a United States Navy officer, he was born in Guantanamo Bay, Cuba.", "He later graduated from Crossland Senior High School in Camp Springs, Maryland.", "Bergman was married to actress Christine Ebersole from 1976 to 1981.", "In 1985, he married Mariellen, with whom he has two children.", "Bergman originally auditioned for the \"All My Children\" role of Dr. Jeff Martin.", "His first notable role was his portrayal of Dr. Cliff Warner on \"All My Children\", which he played from 1979 to 1987 and again from 1988-89.", "His character, Cliff, married Nina (Taylor Miller) four times (1980, 1982, 1986, and 1989) and divorced her three times.", "When the characters left the serial, their fourth marriage was intact.", "In a Vicks Formula 44 cough syrup advertising campaign in 1986, Bergman told the viewing audience, \"I\u2019m not a doctor, but I play one on TV.\"", "Chris Robinson, who played Dr. Rick Webber on ABC's \"General Hospital\", was the original spokesperson in the ad campaign, which started in 1984." ] ], "gold": "Jack Abbot is a character on the soap opera, Young and the Restless known for having a long standing feud with the Newman family patriarch, Victor Newman. The character was introduced in 1980 with Terry Lester in the role. Lester made his last appearance on September 1, 1989 after quitting feeling that Jack was being \"squeezed\" out of the story line. Peter Bergman took over the role after being fired from All My Children where he rose to super stardom as Dr. Cliff Warner. He made his debut on November 27, 1989. Graham Taylor also played Jack Abbott from 2017-2018.", "prediction 1": "Jack Abbott is a fictional character from the American CBS soap opera, The Young and the Restless. The character was first introduced in 1980 being portrayed by Terry Lester. Lester departed from the series in 1989 and was replaced by Peter Bergman shortly thereafter. Bergman relocated to California for the role after he successfully auditioned for the part.", "prediction 2": "Peter Bergman recast the role of Jack Abbott on The Young and the Restless after he successfully auditioned for the part. Bergman, a retired American actor best known for his portrayals of Cliff Warner on All My Children and Jack Abbott on The Young and the Restless, was initially offered the part. However, after Lester was fired in 1989, Bergman was offered the role.", "prediction 3": "Jack Abbott, known by his stage name Cliff Warner, is a fictional character from the American CBS soap opera \"The Young and the Restless\". The character was first introduced in 1980 being portrayed by Terry Lester. Lester departed from the series in 1989 and was replaced by Peter Bergman shortly thereafter. Bergman relocated to California for the role after he successfully auditioned for the part. His first episode aired on November 27, 1989.", "prediction 4": "Peter Bergman took over the role of Jack Abbott on the CBS soap opera The Young and the Restless after Lester departed from the series in 1989. Bergman relocated to California for the part after he successfully auditioned for the part. The role of Jack Abbott was first written into the series in June 1980, being portrayed by Terry Lester. Lester quit out of anger, as he felt that Jack was being \"squeezed\" out of the storyline, as he felt that Jack was being \"squeezed\" out of the storyline. Bergman relocated to California for the role after he successfully auditioned for the part.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 277, "end": 360 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Jack Abbott is a fictional character from the American CBS soap opera, The Young and the Restless, known for having a long standing feud with the Newman family patriarch, Victor Newman. The character was first introduced in 1980 being portrayed by Terry Lester. Lester departed from the series in 1989 because he felt that Jack was being \"squeezed\" out of the storyline. and was replaced by Peter Bergman shortly thereafter. Bergman, who had rose to super stardom as Dr. Cliff Warner on \"All My Children\", had recently been fired. His first episode aired on November 27, 1989." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Prime minister of st. vincent and the grenadines?", "passages": [ [ "Saint Vincent and the Grenadines", "Saint Vincent and the Grenadines\n\nSaint Vincent and the Grenadines () is a country in the Lesser Antilles island arc, in the southern portion of the Windward Islands, which lies in the West Indies at the southern end of the eastern border of the Caribbean Sea where the latter meets the Atlantic Ocean.", "The sovereign state is also frequently known simply as Saint Vincent.", "Its territory consists of the main island of Saint Vincent and the northern two-thirds of the Grenadines, which are a chain of smaller islands stretching south from Saint Vincent Island to Grenada.", "Most of Saint Vincent and the Grenadines lies within the Hurricane Alley.", "To the north of Saint Vincent lies Saint Lucia and to the east is Barbados.", "Saint Vincent and the Grenadines is a densely populated country for its size (over 300 inhabitants/km) with approximately inhabitants.", "Kingstown is the capital and main port.", "Saint Vincent has a French and British colonial history, and is now part of the Organisation of Eastern Caribbean States, CARICOM, the Commonwealth of Nations, the Bolivarian Alliance for the Americas and the Community of Latin American and Caribbean States (CELAC).", "The main mother tongue is Vincentian Creole and the official language is English." ], [ "Arnhim Eustace", "Arnhim Eustace\n\nArnhim Ulric Eustace (born 5 October 1944) was a Vincentian politician and economist, He served as the third Prime Minister of Saint Vincent and the Grenadines, and is the former Leader of the Opposition and former president of the New Democratic Party (NDP) after resigning in 2016.", "Eustace is the Member of Parliament (MP) for the constituency of East Kingstown in the House of Assembly of Saint Vincent and the Grenadines.", "On 27 October 2000, Eustace, then a political neophyte, succeeded James Fitz-Allen Mitchell as the leader of the NDP, and on 28 March 2001, the NDP was defeated in the 2001 general election in which the party was reduced from 8 to 3 seats, producing a majority government for the Unity Labour Party.", "In the 7 December 2005 general elections, Eustace's NDP also won 3 seats.", "In the 13 December 2010 general election, Eustace's NDP saw an increase in the popular vote to 48.67%, winning 7 seats in a close election.", "The number required to form a majority in the House of Assembly of Saint Vincent and the Grenadines is 8, and the incumbent ULP formed government with a one-seat majority.", "Arnhim Eustace is an alumnus of the St Vincent Boys' Grammar School." ], [ "James Fitz-Allen Mitchell", "James Fitz-Allen Mitchell\n\nSir James Fitz-Allen Mitchell (born 15 May 1931) \nis the former Prime Minister of Saint Vincent and the Grenadines He was the second Prime Minister of Saint Vincent and the Grenadines and the founder of the New Democratic Party (NDP).", "He also served as Premier of the then colony of Saint Vincent from 1972 to 1974, and as Prime Minister of Saint Vincent and the Grenadines from 1984 to 2000.", "Sir James Fitz-Allen Mitchell agronomist and politician, has been a dominant figure in St. Vincent and the Grenadines for almost three decades.", "He was educated in St. Vincent at the Saint Vincent Grammar School.", "He continued his education at the Imperial College of Tropical Agriculture in Trinidad and Tobago and at the University of British Columbia in Canada.", "An agriculturist by profession, Mitchell worked with Government and in the Ministry of Overseas Development in London, and as an agricultural research officer for the Saint Vincent Government.", "Mitchell initially entered politics in 1966 by winning a legislative seat as a candidate of the Saint Vincent Labour Party.", "After serving as premier from 1972 to 1974, he founded the New Democratic Party (NDP) in 1975 becoming the sole Parliamentary Opposition until 1984." ] ], "gold": "Saint Vincent and the Grenadines is an island country in the Caribbean. Ralph Gonsalves has been the Prime Minister of the island since 2001. Prior to that, Arnhim Eustace was Prime Minister from October 2000 to March 2001. Preceding Eustace was Sir James Fitz-Allen Mitchell from July 1984 to October 2000 and Milton Cato from October 1979 to July 1984.", "prediction 1": "Saint Vincent and the Grenadines is a country in the Lesser Antilles island arc, in the southern portion of the Windward Islands, which lies in the West Indies at the southern end of the eastern border of the Caribbean Sea where the latter meets the Atlantic Ocean. James Fitz-Allen Mitchell, the second Prime Minister of Saint Vincent and the Grenadines, served as Prime Minister of Saint Vincent and the Grenadines from 1974 to 2000. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines and is the former Leader of the Opposition and former President of the New Democratic Party (NDP). Arnhim Eustace served as the third Prime Minister of Saint Vincentian politician and economist, and is the former Leader of the Opposition", "prediction 2": "Saint Vincent and the Grenadines is a country in the Lesser Antilles island arc in the southern portion of the Windward Islands, which lies in the West Indies at the southern end of the eastern border of the Caribbean Sea where the latter meets the Atlantic Ocean. James Fitz-Allen Mitchell was the second Prime Minister of Saint Vincent and the Grenadines and the founder of the New Democratic Party. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines in 2000. James Fitz-Allen Mitchell was the second Prime Minister of Saint Vincent and the Grenadines from 1984 to 2000. Sir James Fitz-Allen Mitchell was the first Prime Minister of Saint Vincent and the Grenadines and the Grenadines from 1972 to 1974, and as Prime Minister of the then colony of Saint Vincent and the Grenadines from 1984", "prediction 3": "Sir James Fitz-Allen Mitchell was the second Prime Minister of Saint Vincent and the Grenadines and the founder of the New Democratic Party (NDP). He served as the second Prime Minister of Saint Vincent and the Grenadines from 1972 to 1974, and as Prime Minister of Saint Vincent and the Grenadines from 1984 to 2000. Arnhim Ulric Eustace served as the third Prime Minister of Saint Vincent and the Grenadines, and is the former Leader of the Opposition and former president of the New Democratic Party (NDP) after resigning in 2016. Arnhim Ulric Eustace served as the fourth Prime Minister of Saint Vincent and the Grenadines. Arnhim Eustace served as the fourth Prime Minister of Saint Vincent and the Grenadines.", "prediction 4": "Sir James Fitz-Allen Mitchell was the second Prime Minister of Saint Vincent and the Grenadines and the founder of the New Democratic Party, and was Prime Minister of Saint Vincent and the Grenadines from 1972 to 1974. Arnhim Ulric Eustace served as the third Prime Minister of Saint Vincent and the Grenadines, and is the former Leader of the Opposition and former president of the New Democratic Party (NDP) after resigning in 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 265 }, { "error type": "Redundant", "explanation": "Saint Vincent and the Grenadines is a country in the Lesser Antilles island arc, in the southern portion of the Windward Islands, which lies in the West Indies at the southern end of the eastern border of the Caribbean Sea where the latter meets the Atlantic Ocean. James Fitz-Allen Mitchell, the second Prime Minister of Saint Vincent and the Grenadines, served as Prime Minister of Saint Vincent and the Grenadines from 1974 to 2000. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines. ", "start": 523, "end": 707 }, { "error type": "Redundant", "explanation": "Saint Vincent and the Grenadines is a country in the Lesser Antilles island arc, in the southern portion of the Windward Islands, which lies in the West Indies at the southern end of the eastern border of the Caribbean Sea where the latter meets the Atlantic Ocean. James Fitz-Allen Mitchell, the second Prime Minister of Saint Vincent and the Grenadines, served as Prime Minister of Saint Vincent and the Grenadines from 1974 to 2000. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines.", "start": 708, "end": 846 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 422, "end": 426 } ], "missing-info": [], "corrected-prediction": "Saint Vincent and the Grenadines is a country the Caribbean Sea. James Fitz-Allen Mitchell, the second Prime Minister of Saint Vincent and the Grenadines, served as Prime Minister of Saint Vincent and the Grenadines from 1984 to 2000. Arnhim Eustace served as the third Prime Minister of Saint Vincent and the Grenadines. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many current amendments are there to the us constitution?", "passages": [ [ "History of the United States Constitution", "Objections to a potentially remote federal judiciary were reconciled with 13 federal courts (11 states, plus Maine and Kentucky), and three federal riding circuits out of the Supreme Court: Eastern, Middle and South.", "Suspicion of a powerful federal executive was answered by Washington's cabinet appointments of once-Anti-Federalists Edmund Jennings Randolph as Attorney General and Thomas Jefferson as Secretary of State.", "What Constitutional historian Pauline Maier termed a national \"dialogue between power and liberty\" had begun anew.", "Since the beginning of federal operations under the Constitution in 1789 through the beginning of 2013, approximately 11,539 proposals to amend the Constitution have been introduced in the United States Congress.", "Of these, thirty-three have been approved by Congress and sent to the states for ratification.", "Twenty-seven of these amendments have been ratified and are now part of the Constitution.", "The first ten amendments were adopted and ratified simultaneously and are known collectively as the Bill of Rights.", "Prior to the Twenty-seventh Amendment, which languished for 202 years, 7 months, 12 days before being ratified (submitted for ratification in 1789 as part of the Bill of Rights, but not ratified until 1992), the Twenty-second Amendment held the record for longest time taken to successfully complete the ratification process \u2013 3 years, 11 months, 6 days.", "The Twenty-sixth Amendment holds the record for shortest time taken \u2013 3 months, 8 days." ] ], "gold": "Thirty-three amendments to the United States Constitution have been proposed by the United States Congress and sent to the states for ratification since the Constitution was put into operation on March 4, 1789. Twenty-seven of these, having been ratified by the requisite number of states, are part of the Constitution.", "prediction 1": "There are currently 27 amendments to the United States Constitution. Of these, 26 have been ratified and are now part of the Constitution, putting the total number of amendments to the Constitution at 33.", "prediction 2": "There are currently 107 amendments to the US Constitution. Of these, 93 have been approved by Congress and sent to the states for ratification. Twenty-seven have been ratified and are now part of the Constitution.", "prediction 3": "There are currently 27 amendments to the United States Constitution. Twelve of these amendments were ratified by the states, while the remaining twenty-seven were ratified by Congress.", "prediction 4": "There are currently 27 amendments to the United States Constitution. These amendments include the following: the First Amendment, the Tenth Amendment, the Fourteenth Amendment, the Tenth Amendment, and the Tenth Amendment.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 79, "end": 81 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 20, "end": 22 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Thirty-three amendments to the United States Constitution have been proposed by the United States Congress and sent to the states for ratification. Of these, 26 have been ratified and are now part of the Constitution." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did they change the speed limit to 55?", "passages": [ [ "Speed limits in the United States by jurisdiction", "Missouri concluded a two-year experiment with variable speed limits along I-270 around St. Louis.", "Digital signs had been erected along the freeway as well as additional signs alerting drivers about the use of variable speed limits.", "The limits will vary between 40 and 60\u00a0miles per hour, depending on traffic conditions, and could change by up to 5\u00a0mph every 5\u00a0minutes.", "These speed limits, as of January 2012, are now posted as \"Advisory Speed Limits\".", "During the closure and major rebuild of I-64 in St. Louis, an additional lane was added to I-44 and I-70, and the speed limit was thus reduced to 55\u00a0mph on those roads within the St. Louis County and City.", "The I-64 construction has been completed, and the extra lanes were removed in 2010.", "In October 2010, the speed limit was restored to 60\u00a0mph on both I-44 and I-70.", "Most two-lane roads with shoulders have a 60\u00a0mph speed limit in Missouri.", "Two-lane roads without shoulders are usually, but not always, limited to 55\u00a0mph.", "However, the following two-lane highways have a 65\u00a0mph speed limit when bypassing or outside of incorporated areas.", "Most rural expressways have a 65\u00a0mph speed limit, but the following have a 70\u00a0mph speed limit." ], [ "Speed limits in the United States by jurisdiction", "The speed limit on urban freeways ranges from a low of 40\u00a0mph in downtown Pittsburgh and Philadelphia to a high of 70\u00a0mph in some suburban areas.", "In 1940, when the Pennsylvania Turnpike was opened between Irwin and Carlisle, the entire 160\u00a0mile limited-access toll road did not have a speed limit, similar to that of the German Autobahns.", "In 1941, a speed limit of 70\u00a0mph (113\u00a0km/h) was established, only to be reduced to 35\u00a0mph (56\u00a0km/h) during the war years (1942\u201345).", "After WWII, the limit was raised to 70\u00a0mph on the four-lane sections, with the two-lane tunnels having 50\u00a0mph (80\u00a0km/h) for cars and 40\u00a0mph (64\u00a0km/h) for trucks.", "Prior to the 1974 federal speed limit law, all Interstates and the Turnpike had a 65\u00a0mph (105\u00a0km/h) speed limit on rural stretches and 60\u00a0mph (97\u00a0km/h) speed limit in urban areas.", "In 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65\u00a0mph (105\u00a0km/h), with urban areas having a 55\u00a0mph (89\u00a0km/h) limit.", "In 1997, PennDOT raised the speed limit to some rural non-Interstate Highway bypasses to 65\u00a0mph (105\u00a0km/h)." ], [ "Speed limits in the United States by jurisdiction", "Only two State Secondary Road freeways in the state that has a 60\u00a0mph speed limit are the Wade Avenue Extension as of February 2012 and Aviation Parkway (from south of Globe Rd to Airport Blvd) as of July 2014, which are both in Raleigh.", "60\u00a0mph speed limits along non-freeway segments are growing in popularity and have replaced 55\u00a0mph limits on several boulevard and expressway segments throughout the state.", "The boulevard speed limit changes go against the NCDOT rationale behind signing 60\u00a0mph speed limits along only freeway and expressway segments.", "As of June 1, 2008, some examples of the affected boulevards are US 17 north of Elizabeth City, US 74 east of Wadesboro and NC 11 in Pitt County.", "60\u00a0mph speed limits along Expressways are US 1 in northeastern Moore County, US 17 on bypass routes in Brunswick County, US 74 east of I-95, US 117 in Wayne County & Duplin County, US 220 in Rockingham County only along bypass segments and on NC 16 in Lincoln and Catawba counties (as of October 2012).", "Previously, the entire US 220 alignment from NC 68 to the Virginia state line was 60\u00a0mph but went back to 55\u00a0mph between NC 68 and NC 704." ] ], "gold": "The National Maximum Speed Limit (NMSL) was a provision of the federal government of the United States 1974 Emergency Highway Energy Conservation Act that effectively prohibited speed limits higher than 55 miles per hour (89 km/h). The Emergency Highway Energy Conservation Act was a bill in the U.S. Congress that included the National Maximum Speed Limit. States had to agree to the limit if they desired to receive federal funding for highway repair. The uniform speed limit was signed into law by Nixon on January 2, 1974, and became effective 60 days later. During the rebuild of I-64 an additional lane was added to I-44 and I-70 which had a 55 mph limit. Upon completion the limit was restored to 60 mph. In New Mexico the in November 2005, the stretch between NM-4 and Pojoaque became a safety corridor. In 2007, the speed limit on the San Ildefonso-Pojoaque stretch was lowered to 55 mph. US 84/285 speed limit was changed to 55 mph in 2005. In the 2000s, the major cities of Memphis, Knoxville and Chattanooga Tennessee petitioned TDOT to enact environmental speed limits in their respective counties after failing to meet EPA air quality standards, reducing speed limits from 70 mph to 65 mph and 55 mph for trucks.", "prediction 1": "In 1950, the speed limit on the Pennsylvania Turnpike was 70 mph (113 km/h), but by 1941, the limit was reduced to 35 mph (56 km/h) for cars and 40 mph (64 km/h) for trucks. In 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65 mph (105 km/h), with urban areas having a 55 mph (89 km/h) limit. In 1997, PennDOT raised the speed limit to some rural non-Interstate Highway bypasses to 65 mph (105 km/h), with urban areas having a 55 mph (89 km/h) limit.", "prediction 2": "In the United States, speed limits are generally set at 55 mph. However, in Missouri, during the closure and major rebuild of I-64 in St. Louis, an additional lane was added to I-44 and I-70, and the speed limit was thus reduced to 55 mph on those roads within the St. Louis County and City. In 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65 mph (105 km/h), with urban areas having a 55 mph limit. In 1997, PennDOT raised the speed limit to some rural non-Interstate Highway bypasses to 65 mph (105 km/h).", "prediction 3": "In 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65 mph (105 km/h), with urban areas having a 55 mph (89 km/h) limit. In 1997, PennDOT raised the speed limit to some rural non-Interstate Highway bypasses to 65 mph (105 km/h). The speed limit at intersections on I-465 and I-24 between Harrisburg and Philadelphia was 55 mph (89 km/h).", "prediction 4": "In the United States, most two-lane roads with shoulders have a 60 mph speed limit. However, the following two-lane highways have a 65 mph speed limit when bypassing or outside incorporated areas; most rural expressways have a 65 mph speed limit, but the following have a 70 mph speed limit. In the United States, in 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65 mph (105 km/h), with urban areas having a 55 mph limit; in 1997, the speed limit to some rural non-Interstate Highway bypasses to 65 mph (89 km/h) limit; however, the 55 mph limit was restored to 55 mph limits on several boulevard and expressway segments throughout the state. The speed limit was restored to 55 mph limits on several boulevards and expressway segments", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 3, "end": 8 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 84, "end": 89 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 115, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 474 }, { "error type": "Redundant", "explanation": "In 1995, the state raised the speed limit on rural stretches of Interstate Highways and the Pennsylvania Turnpike system to 65 mph (105 km/h), with urban areas having a 55 mph (89 km/h) limit. ", "start": 475, "end": 524 }, { "error type": "Irrelevant", "explanation": "", "start": 141, "end": 173 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In 1941, the speed limit on the Pennsylvania Turnpike was 70 mph (113 km/h), but after WWII, the two-lane limit was reduced to 50 mph (56 km/h) for cars. In 1995, the state raised the speed limit on urban areas to a 55 mph (89 km/h) limit. During the closure and major rebuild of I-64 in St. Louis, an additional lane was added to I-44 and I-70, and the speed limit was thus reduced to 55 mph on those roads. In October 2010, the speed limit was restored to 60 mph on both I-44 and I-70." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who won nathan's hot dog eating contest?", "passages": [ [ "Nathan's Hot Dog Eating Contest", "Nathan's Hot Dog Eating Contest\n\nThe Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition.", "It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City.", "The contest has gained public attention in recent years due to the stardom of Takeru Kobayashi and Joey Chestnut.", "The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest.", "The defending women's champion is Miki Sudo, who ate 37 hot dogs in the 2018 contest.", "Major League Eating (MLE), formerly known as the International Federation of Competitive Eating (IFOCE), has sanctioned the event since 1997.", "Today, only entrants currently under contract by MLE can compete in the contest.", "The field of about 20 contestants typically includes the following:\n\n\nThe competitors stand on a raised platform behind a long table with drinks and Nathan's Famous hot dogs in buns.", "Most contestants have water on hand, but other kinds of drinks can and have been used.", "Condiments are allowed, but usually are not used.", "The hot dogs are allowed to cool slightly after grilling to prevent possible mouth burns." ], [ "Miki Sudo", "Miki Sudo\n\nMiki Victoria Sudo is an American competitive eater.", "Her most significant accomplishments are her victories in the women's competition at Nathan's Hot Dog Eating Contest in 2014, 2015, 2016, 2017 and 2018.", "Her 2014 victory in the contest unseated Sonya Thomas, who had won the women's competition since its inception in 2011.", "Sudo was born in New York to a Japanese father and European American mother.", "At the age of five, she moved to Japan with her family, and lived there for seven years before returning to the United States.", "Sudo entered the competitive eating circuit in 2013, winning a pho eating contest.", "In 2014 she became Major League Eating's top ranked female competitive eater, and in 2015 reached the top three overall." ], [ "Tim Janus", "Second Harvest estimated that the donation would provide 30,000 meals to area residents.", "On May 16, 2009, Janus became the third person in the history of the world to eat 50 or more hot dogs and buns in a Nathan's Hot Dog Eating Contest, consuming exactly 50 in his qualifier in Hartford, Connecticut.", "In the finals on July 4, he ate 53 hot dogs.", "On July 4, 2010, Eater X placed second at the Nathan's Hot Dog Eating Contest by eating 45 hot dogs and losing to Joey Chestnut who ate 54 hot dogs and buns.", "In an August 24, 2010, episode of \"Shaq Vs.\"", "on ABC, Tim coached a team led by Shaquille O'Neal to victory in a hot dog eating contest against Joey Chestnut.", "He is the current champion of the Doodle Challenge, a hamburger eating contest in Connecticut.", "Janus appeared in the music video for the Boston Spaceships song \"Let it Rest for a Little While\" from the band's 2009 album \"Zero to 99\".", "On October 13, 2012, Janus tied for second place with Bob Shoudt in the World Poutine Eating Championship, after eating 8.5\u00a0lbs of poutine (or 17 boxes) in 10 minutes.", "Janus announced his retirement from competitive eating on July 3, 2016 via Twitter." ], [ "Matt Stonie", "Matt Stonie\n\nMatthew \"Megatoad\" Kai Stonie (born May 24, 1992) is an American competitive eater.", "He is the number four ranked competitive eater in Major League Eating.", "Stonie won the 2015 Nathan's Hot Dog Eating Contest, dethroning 8-time defending champion Joey Chestnut, but lost the title in 2016.", "He has gained fame from his YouTube channel, where he uploads many eating challenges.", "Stonie was born on May 24, 1992, in San Francisco, California.", "He is of Japanese, Czechoslovakian, and Lithuanian ancestry.", "Stonie has a younger brother named Morgan Stonie.", "He graduated from Evergreen Valley High School in San Jose, California.", "He weighs and is tall.", "His nickname, \"Megatoad,\" is from the character Toad from the video game \"Super Mario Bros.\"\n\nStonie's Major League Eating debut was at the Stockton Deep Fried Asparagus Championship in Stockton, California in 2011.", "He is currently the youngest member of the Major League Eating organization.", "His first win came in 2010 in a lobster roll eating contest in Hampton Beach, New Hampshire.", "On July 4, 2015, Stonie defeated 8-time defending Nathan's Hot Dog Eating Contest champion Joey Chestnut by eating 62 hot dogs to Chestnut's 60." ] ], "gold": "The Nathan's Hot Dog Eating Contest is an annual American hot dog eating competition held on Independence Day at Nathan's Famous Corporation's original restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The current men's and women's competitions champions are Joey Chestnut and Michelle Lesco, who crowned themselves in the 2021 edition. Previously, Miki Sudo had won the women's competition every year from 2014-2020, with Chestnut doing so in the men's variant in 2017 and 2016 and Matt Stonie in 2015.", "prediction 1": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest. The defending women's champion is Miki Sudo, who won the contest in 2014, 2015, and 2016 was Miki Sudo.\n", "prediction 2": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition, held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest. The defending women's champion is Miki Sudo, who won the 2018 contest. On July 4, 2010, Eater X placed second at the Nathan's Hot Dog Eating Contest by eating 45 hot dogs and lost to Joey Chestnut, who ate 54 hot dogs and buns. On May 16, 2009, Tim Janus became the third person in the history of the world to eat 50 or more hot dogs and consuming exactly 50 hot dogs and lose to Joey Chestnut.", "prediction 3": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The first-place winner in the men's contest was Joey Chestnut in 1990. In 2015, Matt Stonie won the Nathan's Hot Dog Eating Contest, dethroning Chestnut, the 8-time defending champion. In 2016, the contest was won by Miki Sudo. The defending women's contest was Miki Victoria Sudo.", "prediction 4": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest. In the men's competition, Miki Sudo won in 2014, 2015, 2016, 2017 and In the women's champion was Miki Sudo in the 2018 contest.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Miki Sudo, who won the contest", "start": 489, "end": 504 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 399 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. The defending men's champion is Joey Chestnut, who has won the contest 8 times. The defending women's champion is Miki Sudo, who won the contest every year between 2014 and 2018. Previous winners also include Matt Stonie, who won in 2015, and Sonya Thomas, who every women's competition between 2011-2013." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who is the lead role in black panther?", "passages": [ [ "Black Panther (film)", "Black Panther (film)\n\nBlack Panther is a 2018 American superhero film based on the Marvel Comics character of the same name.", "Produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures, it is the eighteenth film in the Marvel Cinematic Universe (MCU).", "The film is directed by Ryan Coogler, who co-wrote the screenplay with Joe Robert Cole, and stars Chadwick Boseman as T'Challa / Black Panther, alongside Michael B. Jordan, Lupita Nyong'o, Danai Gurira, Martin Freeman, Daniel Kaluuya, Letitia Wright, Winston Duke, Angela Bassett, Forest Whitaker, and Andy Serkis.", "In \"Black Panther\", T'Challa is crowned king of Wakanda following his father's death, but his sovereignty is challenged by an adversary who plans to abolish the country's isolationist policies and begin a global revolution.", "Wesley Snipes expressed interest in working on a Black Panther film in 1992, but the project did not come to fruition.", "In September 2005, Marvel Studios announced a Black Panther film as one of ten based on Marvel characters and distributed by Paramount Pictures.", "Mark Bailey was hired to write a script in January 2011.", "\"Black Panther\" was announced in October 2014, and Boseman made his first appearance as the character in \"\" (2016)." ], [ "Erik Killmonger", "Erik Killmonger\n\nErik Killmonger is a fictional supervillain appearing in American comic books published by Marvel Comics.", "Created by Don McGregor and Rich Buckler, the character first appeared in \"Jungle Action\" vol.", "2, #6 (Sept. 1973).", "Killmonger, whose birth name is N'Jadaka, is an enemy of Black Panther.", "Michael B. Jordan portrays the character in the Marvel Cinematic Universe film \"Black Panther\" (2018).", "Erik Killmonger first appeared in the \"Panther's Rage\" storyline, initially in \"Jungle Action\" vol. 2, #6-8 (Sept. 1973 - Jan. 1974), and was created by writer Don McGregor and penciler Rich Buckler.", "The character subsequently appeared in \"Jungle Action\" vol.", "2, #12-18 (Nov. 1974-Nov. 1975), \"Iron Man Annual\" #5 (1982), \"Over the Edge\" #6 (April 1996), \"Black Panther\" vol.", "3, #13 (Dec. 1999), #15-16 (Feb.-March 2000), #18-21 (May-Aug. 2000), \"Deadpool\" #44 (Sept. 2000), \"Black Panther\" vol." ] ], "gold": "Black Panther is a 2018 American superhero film based on the Marvel Comics character of the same name. It stars Chadwick Boseman as T'Challa/Black Panther, the lead role of the film. Michael B. Jordan plays the lead villain role of N'Jadaka/Erik \"Killmonger\" Stevens.", "prediction 1": "In the 2018 American superhero film, Black Panther, Chadwick Boseman plays T'Challa, the son of King T'Challa and the leader of the Wakanda tribe. Lupita Nyong'o plays T'Challa, the son of King T'Challa. Martin Freeman plays T'Challa, the son of King T'Challa and the father of Black Panther.", "prediction 2": "In the 2018 American superhero film Black Panther, Chadwick Boseman plays T'Challa, the king of Wakanda. Lupita Nyong'o plays the role of T'Challa, the masked warrior who is the father of the character.", "prediction 3": "Chadwick Boseman stars as T'Challa in Black Panther, a 2018 American superhero film directed by Ryan Coogler, who co-wrote the screenplay with Joe Robert Cole, and stars Lupita Nyong'o as T'Challa, Lupita Nyong'o as T'Wai-Na wa Wakanda's nephew, Danai Gurira as Black Panther, Martin Freeman as Black Panther, Daniel Kaluuya as Black Panther, and Forest Whitaker as the villain of Black Panther, Erik Killmonger, who is portrayed by Michael B. Jordan, who is an enemy of Black Panther.", "prediction 4": "Black Panther is a 2018 American superhero film based on the Marvel Comics character of the same name. Chadwick Boseman stars as T'Challa, the titular character in the film, alongside Michael B. Jordan, Lupita Nyong'o, Danai Gurira, Martin Freeman, Daniel Kaluuya, Winston Duke, Angela Bassett, Forest Whitaker, and Andy Serkis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 146 }, { "error type": "Redundant", "explanation": "In the 2018 American superhero film, Black Panther, Chadwick Boseman plays T'Challa, the son of King T'Challa ", "start": 147, "end": 203 }, { "error type": "Redundant", "explanation": "In the 2018 American superhero film, Black Panther, Chadwick Boseman plays T'Challa, the son of King T'Challa ", "start": 204, "end": 292 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "In the 2018 American superhero film, Black Panther, based on the Marvel Comics character of the same name, Chadwick Boseman plays T'Challa. Michael B. Jordan plays the lead villain role of N'Jadaka/Erik \"Killmonger\"." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the pyramid of the sun built?", "passages": [ [ "Pyramid of the Sun", "Pyramid of the Sun\n\nThe Pyramid of the Sun is the largest building in Teotihuacan, believed to have been constructed about 200 CE, and one of the largest in Mesoamerica.", "Found along the Avenue of the Dead, in between the Pyramid of the Moon and the Ciudadela, and in the shadow of the massive mountain Cerro Gordo, the pyramid is part of a large complex in the heart of the city.", "The name Pyramid of the Sun comes from the Aztecs, who visited the city of Teotihuacan centuries after it was abandoned; the name given to the pyramid by the Teotihuacanos is unknown.", "It was constructed in two phases.", "The first construction stage, around 100 CE, brought the pyramid to nearly the size it is today.", "The second round of construction resulted in its completed size of 225 meters (738\nfeet) across and 75 meters (246 feet) high, making it the third largest pyramid in the world, though still just over half the height of the Great Pyramid of Giza (146 metres).", "The second phase also saw the construction of an altar atop of the pyramid which has not survived into modern times.", "Over the structure the ancient Teotihuacanos finished their pyramid with lime plaster imported from surrounding areas, on which they painted brilliantly colored murals." ], [ "Teotihuacan", "Teotihuacan\n\nTeotihuacan , (in Spanish: Teotihuac\u00e1n) (, ), is an ancient Mesoamerican city located in a sub-valley of the Valley of Mexico, located in the State of Mexico northeast of modern-day Mexico City, known today as the site of many of the most architecturally significant Mesoamerican pyramids built in the pre-Columbian Americas.", "At its zenith, perhaps in the first half of the 1st millennium CE, Teotihuacan was the largest city in the pre-Columbian Americas, with a population estimated at 125,000 or more, making it at least the sixth largest city in the world during its epoch.", "Apart from the pyramids, Teotihuacan is also anthropologically significant for its complex, multi-family residential compounds, the Avenue of the Dead and its vibrant murals that have been well-preserved.", "Additionally, Teotihuacan exported fine obsidian tools that are found throughout Mesoamerica.", "The city is thought to have been established around 100 BCE, with major monuments continuously under construction until about 250 CE.", "The city may have lasted until sometime between the 7th and 8th centuries CE, but its major monuments were sacked and systematically burned around 550 CE.", "Teotihuacan began as a religious center in the Mexican Highlands around the first century CE." ] ], "gold": "The Pyramid of the Sun is the largest building in Teotihuacan which is an ancient city located northeast of Mexico City, in the state of Mexico. The Pyramid of the Sun was built in two stages. The first stage of construction began around 100 CE. A second round of construction, which started about 200 CE, resulted in the completion of the pyramid.", "prediction 1": "The Pyramid of the Sun is the largest building in Teotihuacan, believed to have been constructed about 200 CE, and one of the largest in Mesoamerica. The name Pyramid of the Sun comes from the Aztecs, who visited the city of Teotihuacan centuries after it was abandoned; the name given to the pyramid by the Teotihuacanos is unknown.", "prediction 2": "The Pyramid of the Sun is a large pyramid in Teotihuacan, Mexico, believed to have been built about 200 CE. The first phase of construction was around 100 CE with an addition of an altar atop the pyramid which has not survived into modern times. The second phase of construction was around 200 CE and was completed at a total size of 225 meters (738 feet) across and 75 meters (246 feet) high, making it the third largest pyramid in the world.", "prediction 3": "The Pyramid of the Sun is the largest building in Teotihuacan, believed to have been constructed about 200 CE, and one of the largest in Mesoamerica. Found along the Avenue of the Dead, in between the Pyramid of the Moon and the Ciudadela, and in the shadow of the massive mountain Cerro Gordo, the pyramid is part of a large complex in the heart of the city. The first construction stage, around 100 CE, brought the pyramid to nearly the size it is today. The second round of construction resulted in its completed size of 225 meters (738 feet) across and 75 meters (246 feet) high, making it the third largest pyramid in the world, though still just over half the Great Pyramid of Giza (146 metres).", "prediction 4": "The Pyramid of the Sun is the largest building in Teotihuacan, believed to have been constructed about 200 CE. It is also one of the largest in Mesoamerica. The name Pyramid of the Sun comes from the Aztecs, who visited the city of Teotihuacan centuries after it was abandoned.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 333 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Pyramid of the Sun is the largest building in Teotihuacan which is an ancient city located northeast of Mexico City, in the state of Mexico. It was constructed in two phases. The first construction stage, around 100 CE, brought the pyramid to nearly the size it is today. The second round of construction resulted in its completion. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sings the song my love is alive?", "passages": [ [ "Love Is Alive (Gary Wright song)", "Love Is Alive (Gary Wright song)\n\n", "\"Love Is Alive\" is a 1976 song by Gary Wright taken from the album \"The Dream Weaver\", released the previous year, it features Wright on vocals and keyboards with Andy Newmark on drums.", "The album's title cut and \"Love is Alive\" both peaked at No. 2 on the \"Billboard\" Hot 100 singles chart.", "\"Love is Alive\" spent 27 weeks on the chart, seven weeks longer than \"Dream Weaver.\"", "\"Billboard\" ranked \"Love is Alive\" as the No. 9 song of 1976.", "In the US, \"Love Is Alive\" peaked at #2 in the \"Billboard\" charts.", "Both, Kiss and Say Goodbye by The Manhattans and Don't Go Breaking My Heart by Elton John and Kiki Dee kept it from the #1 spot.", "In Canada, the song reached No. 6.", "Chaka Khan covered the song as \"My Love Is Alive\" on her 1984 album \"I Feel For You\".", "The track was edited, mixed and co-produced by John Robie.", "In 1989, New York rap group 3rd Bass sampled \"Love Is Alive\" for their song \"Wordz of Wisdom\" off their debut full-length album \"The Cactus Album\"." ], [ "3rd Party", "3rd Party\n\n3rd Party was a three-member dance-pop group that released one album in 1997.", "They are best known for their Billboard Hot 100 charting dance hits \"Can U Feel It\" and \"Love Is Alive\".", "Lead singer Maria Christensen was a songwriter before the band, singing since the age of 5 and writing songs since she was 10 years old.", "She made her performing debut in 1988 as one half of the Latin freestyle duo Sequal.", "She has written songs for Nana Mouskouri, Eternal, 'N Sync and Celine Dion.", "She had released a self-titled solo album in 1993.", "Backup singers Karmine Alers and Elaine Borja filled out the racially diverse group.", "The group formed in the wake of the mid-90s dance-pop movement, following such acts as the Spice Girls.", "The group released its album \"Alive\" in 1997.", "The album was recorded on Long Island, New York, and produced by Rick Wake.", "Four of the album's songs were written by Christensen, and two singles were released from it.", "\"Can U Feel It\" (#43) was their highest-charting song.", "\"Love is Alive\" (#61) was a remake of the song by Gary Wright from his album \"The Dream Weaver\"." ], [ "Gary Wright", "Gary Wright\n\nGary Malcolm Wright (born April 26, 1943) is an American singer, songwriter, musician and composer best known for his 1976 hit songs \"Dream Weaver\" and \"Love Is Alive\", and for his role in helping establish the synthesizer as a leading instrument in rock and pop music.", "Wright's breakthrough album, \"The Dream Weaver\" (1975), came after he had spent seven years in London as, alternately, a member of the British heavy rock band Spooky Tooth and a solo artist on A&M Records.", "While in England, he played keyboards on former Beatle George Harrison's \"All Things Must Pass\" triple album (1970), so beginning a friendship that inspired the Indian religious themes and spirituality inherent in Wright's subsequent songwriting.", "His work since the late 1980s has embraced world music and the new age genre, although none of his post-1976 releases has matched the popularity of \"The Dream Weaver\".", "A former child actor, Wright performed on Broadway in the hit musical \"Fanny\" before studying medicine and then psychology in New York and Berlin.", "After meeting Chris Blackwell of Island Records in Europe, Wright moved to London, where he helped establish Spooky Tooth as a popular live act." ] ], "gold": "There are several My Love is Alive songs. American singer Gary Wright sang the 1976 song My Love is Alive, and American singers Vonda Shepard and Anastacia sang the 2001 song My Love is Alive. Dance-pop group 3rd Party sang a 1997 version of the song My Love is Alive, while American singer Joan Osborne sang a 2000 version of it.", "prediction 1": "\"Love Is Alive\" is a 1976 song by Gary Wright taken from the album The Dream Weaver. The album's title cut and \"Love is Alive\" both peaked at No. 2 on the Billboard Hot 100 singles chart. 3rd Party, a dance-pop group, also covered the song as \"My Love is Alive\" on their 1984 album I Feel For You. Also, in 1989, New York rap group 3rd Bass sampled \"Love Is Alive\" for their song \"Wordz of Wisdom\" off their debut full-length album \"Alive\".", "prediction 2": "\"My Love is Alive\" is a 1976 song by Gary Wright taken from the album The Dream Weaver, released the previous year, it features Wright on vocals and keyboards with Andy Newmark on drums. New York rap group 3rd Party also sang the song on their 1997 album Alive.", "prediction 3": "\"My Love is Alive\" is a 1976 song by American singer, songwriter, musician and composer Gary Wright. It was taken from his 1975 album The Dream Weaver and features Wright on vocals and keyboards with Andy Newmark on drums. New York rap group 3rd Party covered the song as \"My Love is Alive\" on their 1984 album \"I Feel For You\".", "prediction 4": "The song My Love is Alive was originally written by Gary Wright in 1975 and was remade in 1976 by 3rd Party for their album Alive. The song was originally sung by Chaka Khan in 1984 and was covered by Maria Christensen in 1988. It was covered by 3rd Party and was also sung by Maria Christensen in 1989.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 187 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 271, "end": 275 }, { "error type": "Unverifiable", "explanation": "", "start": 282, "end": 297 } ], "missing-info": [], "corrected-prediction": "\"Love Is Alive\" is a 1976 song by Gary Wright. 3rd Party, a dance-pop group, also covered the song as \"My Love is Alive\" on their 1997 album. Also, in 1989, New York rap group 3rd Bass sampled \"Love Is Alive\" for their song \"Wordz of Wisdom\" off their debut full-length album \"Alive\"." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who has won the ballon d'or most times?", "passages": [ [ "Ballon d'Or", "Ronaldo of Internazionale became the first South American winner two years later.", "Lionel Messi and Cristiano Ronaldo have won the award a record five times each.", "Three players have won the award three times each: Johan Cruyff of Ajax and Barcelona, Michel Platini of Juventus and Marco van Basten of Milan.", "With seven awards each, Dutch, German and Portuguese players won the most Ballons d'Or.", "Spanish club Barcelona has the most winners, with 11 wins.", "Between 2010 and 2015 inclusive, the award was merged with a similar one, the FIFA World Player of the Year award, to create the FIFA Ballon d'Or, which was awarded to the world's best male player before FIFA and \"France Football\" broke the merging agreement.", "After 2011, UEFA created the UEFA Best Player in Europe Award to maintain the format of the original Ballon d'Or.", "Eight players (Bobby Charlton, Franz Beckenbauer, Gerd M\u00fcller, Paolo Rossi, Zinedine Zidane, Rivaldo, Ronaldinho and Kak\u00e1) have won the FIFA World Cup, the European Cup/UEFA Champions League and the Ballon d'Or during their careers.", "One-time winners are only included if they have also finished second or third in another year." ], [ "FIFA Ballon d'Or", "FIFA Ballon d'Or\n\nThe FIFA Ballon d'Or (, \"Golden Ball\") was an annual association football award presented to the world's best men's player from 2010 to 2015.", "Awarded jointly by FIFA and \"France Football\", the prize was a merger of the FIFA World Player of the Year award and the Ballon d'Or, the two most prestigious individual honours in world football.", "The FIFA Ballon d'Or was awarded based on votes from international journalists and national team coaches and captains, who selected the players they deemed to have performed the best in the previous calendar year.", "The six editions of the FIFA Ballon d'Or were dominated by Lionel Messi and Cristiano Ronaldo, as part of their ongoing rivalry.", "Barcelona's Messi won the inaugural Ballon d'Or in 2010 and went on to win three in a row, after his wins in 2011 and 2012.", "Ronaldo, who plays for Juventus, won successive awards in the next two years.", "The final FIFA Ballon d'Or was presented to Messi in 2015.", "Its awarding bodies subsequently ended their partnership; for 2016, \"France Football\" reintroduced the previous format of the Ballon d'Or, while FIFA created The Best FIFA Men's Player award." ], [ "International Federation of Football History & Statistics", "Spain's Xavi has won the award a record four consecutive times, compatriot Andr\u00e9s Iniesta two times and Argentine Lionel Messi has won the award in the last three years.", "Barcelona is the club with the most wins, with nine in total.", "\"From 1991 until 2009, FIFA continued this distinction named \"FIFA World Player of the Year\"; this award was later replaced by the FIFA Ballon d'Or in 2010, and The Best FIFA Men's Player in 2016.\"", "In 2017, IFFHS started to nominate a world team of the year.", "Coach: Zinedine Zidane \"(Real Madrid)\"\n\nCoach: Didier Deschamps \"(France)\"\n\n\n\n\n\nIn 2017, IFFHS started to nominate a world team of the year.", "Coach: Sarina Wiegman \"(Netherlands)\"\nCoach: Reynald Pedros \"(Olympique Lyonnais)\"\n\n\nIFFHS gave out an award decided by votes which was conducted with the participation of journalists and former players (no further details given).", "Karl Lennartz, a sports historian and professor at the University of Cologne, Germany, called the organization \"obscure\", describing it as a one-man show of its founder Alfredo P\u00f6ge." ] ], "gold": "The Ballon d'Or is an annual football award presented by French news magazine France Football that is one of the oldest and generally regarded as the most prestigious individual award for football players. Lionel Messi is the player who has won the award most times, having received it on six different occasions. Alternatively, the nation and the team whose players have received the distinction most times are Germany and Barcelona.", "prediction 1": "The FIFA Ballon d'Or (, \"Golden Ball\") was an annual association football award presented to the world's best male player from 2010 to 2015. Lionel Messi and Cristiano Ronaldo have won the award a record five times each. Three players have won the award three times each: Johan Cruyff of Ajax and Barcelona, Michel Platini of Juventus and Marco van Basten of Milan. Spain has the most winners, with 11 wins, and Barcelona is the club with the most winning teams.", "prediction 2": "Lionel Messi and Cristiano Ronaldo have won the award a record five times each. Three players have won the award three times each: Johan Cruyff of Ajax and Barcelona, Michel Platini of Juventus and Marco van Basten of Milan. Spanish club Barcelona has the most winners, with 11 wins. Barcelona is the club with the most wins, with nine in total. Xavi has won the award a record four consecutive times, compatriot Andr\u00e9s Iniesta two times and Argentine Lionel Messi has won the award in the last three years. Barcelona is the club with the most wins, with nine in total.", "prediction 3": "The FIFA Ballon d'Or, also known as the Golden Ball, is an annual association football award presented to the world's best player from 2010 to 2015. Lionel Messi and Cristiano Ronaldo have won the award a record five times each. Three players have won the award three times each: Johan Cruyff of Ajax and Barcelona, Michel Platini of Juventus and Marco van Basten of Milan. Two-time winners are Lionel Messi and Cristiano Ronaldo, who have won the award in each of their respective footballers.", "prediction 4": "The FIFA Ballon d'Or was an annual association football award presented to the world's best men's player from 2010 to 2015. Lionel Messi and Cristiano Ronaldo have won the award a record five times each. Three players have won the award three times each: Johan Cruyff of Ajax and Barcelona, Michel Platini of Juventus and Marco van Basten of Milan. Spanish club Barcelona has the most winners, with 11 wins.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 4, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 365 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 366, "end": 393 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 394, "end": 462 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Ballon d'Or was an annual association football award presented by France Football. It is generally regarded as one of the most prestigious individual award for football players. Lionel Messi and Cristiano Ronaldo have won the award a record five times each. With seven awards each, Dutch, German and Portuguese players won the most Ballons d'Or. Spanish club Barcelona has the most winners, with 11 wins." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does brian come back to family guy?", "passages": [ [ "Christmas Guy", "Christmas Guy\n\n\"Christmas Guy\" is the eighth episode of the twelfth season of the animated comedy series \"Family Guy\" and the 218th episode overall.", "It aired on Fox in the United States and Canada on December 15, 2013, and is written by Patrick Meighan and directed by Greg Colton.", "The episode features the return of Brian Griffin (who had died two episodes earlier in \"Life of Brian\") after Stewie goes back in time to save him.", "The Griffin family goes to Quahog Mall for the annual Christmas Carnival, but they find the festivities have been cancelled, causing Stewie to go on a destructive rampage.", "Vinny learns that Carter, Lois's father, canceled the carnival.", "Peter confronts Carter who tells him that it was cancelled because he hates Christmas.", "Peter vows to help Carter find his Christmas spirit.", "Peter tries a fake story letter, making Carter drink egg nog in a hotel room, and having him masturbate, to no effect.", "When Peter accuses Carter of acting Jewish, Carter reverses his position on the carnival.", "Despite being re-established at the Quahog Mall, the Christmas Carnival fails to raise Stewie's spirits.", "When the Mall Santa Claus asks Stewie what he wants for Christmas, Stewie realizes he wants Brian back.", "Vinny pretends to be Brian, acting like an intellectual and a writer, but fails to cheer up Stewie." ], [ "Brian Griffin", "Brian Griffin\n\nBrian Griffin is a fictional character from the American animated television series \"Family Guy\".", "An anthropomorphic white dog voiced by Seth MacFarlane, he is one of the show's main characters as a member of the Griffin family.", "He primarily works in the series as a less-than-adept writer struggling to find himself, attempting essays, novels, screenplays, and newspaper articles.", "He first appeared on television, along with the rest of the family, in a 15-minute short on December 20, 1998.", "Brian was created and designed by MacFarlane himself.", "MacFarlane was asked to pitch a pilot to the Fox Broadcasting Company, based on \"The Life of Larry\" and \"Larry & Steve\", two shorts made by MacFarlane featuring a middle-aged character named Larry and an intellectual dog, Steve.", "After the pilot was given the green light, the Griffin family appeared in the episode \"Death Has a Shadow\".", "Brian's appearance is a redesign of Steve the dog from MacFarlane's previous show.", "Brian has been featured in many items of merchandise for \"Family Guy\", and he is considered to be one of the show's biggest merchandising icons.", "He has also made crossover appearances in the other MacFarlane-produced shows, such as \"American Dad!\"", "and \"The Cleveland Show\"." ], [ "Brian Griffin", "As a character, Brian has been very well received by critics and fans.", "When Brian was killed off in the season 12 episode \"Life of Brian\", the events of the episode received substantial attention from the media and elicited strongly negative reactions from fans of the show.", "Brian subsequently returned two episodes later, in \"Christmas Guy\", after Stewie travels back in time to save him.", "Brian is a white-furred anthropomorphic dog.", "He can talk, generally walks on his hind legs (using his front legs as arms), has opposable thumbs, drives a second-generation Toyota Prius (with the license plate \"BRI-DOG\"), and often acts more rationally than the other characters in the series.", "He is the pet dog and close friend of the Griffin family, and, although anthropomorphic animals are not a regular element of the show, Brian's human attributes receive little acknowledgment and no explanation; he is largely treated as a human character.", "Brian has a particularly close relationship with Stewie, and many of the show's sub-plots center around them.", "They are occasionally at the center of the plot, for instance in the \"Road to...\" episodes." ] ], "gold": "H. Brian Griffin is a fictional character from the American animated tv series Family Guy. Despite being one of the main characters, Brian, an anthropomorphic white Labrador, was killed off during season 12, episode 6. He was brought back to the series during the Christmas season in the plot line, in season 12, episode 8, which was called Christmas Guy. The show aired in the United States and Canada on December 15, 2013.", "prediction 1": "Brian Griffin is a fictional character from the American animated television show Family Guy. Brian was killed off in the episode Life of Brian and subsequently returned in episode Christmas Guy after Stewie travels back in time to save him.", "prediction 2": "Brian Griffin is a fictional character from the American animated television show Family Guy. He was killed off in the season 12 episode Life of Brian but was revived in the episode Christmas Guy. In the show's 12th season, Brian is the dog played by Seth MacFarlane. In the series' 12th season, Brian returns in episode Christmas Guy.", "prediction 3": "Brian Griffin is a fictional character from the American animated television series Family Guy. He appears in the episode Christmas Guy. He was killed off in the episode Life of Brian, which aired on December 20, 1998. However, when Stewie went back in time to save him, Brian returned.", "prediction 4": "Brian Griffin is a fictional character from the American animated television show Family Guy. He first appeared on television, along with the rest of the family, in a 15 minute short on December 20, 1998. He was killed off in the season 12 episode Life of Brian, which received substantial attention from the media and elicited strongly negative reactions from fans. Brian subsequently returned two episodes later, in \"Christmas Guy\", after Stewie travels back in time to save him.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Brian Griffin is a fictional character from the American animated television show Family Guy. Brian was killed off during season 12, episode Life of Brian and subsequently returned in episode Christmas Guy after Stewie travels back in time to save him. The show aired in the United States and Canada on December 15, 2013." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who play the role of krishna in mahabharat?", "passages": [ [ "Mahabharat (1988 TV series)", "Nitish Bharadwaj was chosen by B R Chopra, Ravi Chopra, (screenplay writer) Pandit Narendra Sharma and (dialogue writer)", "Rahi Masoom Raza, to play the central role of Krishna, at the age of 23.", "Firoz Khan was chosen to portray the character of Arjuna (which he later adopted as his screen name, not to become confused with a more popular actor of the same name) despite being rejected in auditions.", "Praveen Kumar was selected to portray Bhima after Chopra was looking for someone \"who could look the robust mythological character\".", "Around six actors were shortlisted for the role of Draupadi, including Juhi Chawla, who opted out of the show as she had bagged a film.", "Ramya Krishnan and Roopa Ganguly were the final names, and at last Roopa Ganguly was chosen, as her Hindi was good.", "Govinda (actor) and Chunky Pandey were signed for the role of Abhimanyu, but they opted out when they bagged films.", "Later, Master Mayur played the role.", "Raj Babbar and Debashree Roy were the only two star actors of that time, who agreed to be parts of this venture.", "It was shown in the United Kingdom by the BBC, where it achieved audience figures of 5 million." ], [ "Mahabharat (2013 film)", "Besides the launch of the trailer there were three audiovisuals that introduced the animated characters of Balan, Kapoor and Devgn.", "Jackie Shroff lent his voice for Duryodhan.", "Lord Krishna's voice is dubbed by Shatrughan Sinha.", "None of the A-listers charged any remuneration for lending their voices to the characters in the film.", "Film producers gave Shatrughan Sinha an option to choose any of the roles to lend his voice to.", "Sinha selected the role of Krishna.", "\"Mahabharat\" has an insurance cover of Rs 50 crore,thus becoming the highest insured Bollywood production film, beating \"My Name Is Khan\" (2010), which was insured for Rs 46 crore.", "The film received mixed reviews.", "Subhash K. Jha said, \"If you were hoping that animation films would come of age with this purported epic, you are in for a disappointment.", "Though the characters from the \"Mahabharat\" have faces and voices of the biggest stars, the images do not add up to a compelling canvas.", "Not by a wide margin.\"", "India TV said, \"The presentation is epic in intent, yes.", "Alas, the execution, packaging and projection leave the epic undernourished and over-emphasized.\" and rated it 2 out of 5 stars." ], [ "Vishnu Puran (TV series)", "Vishnu Puran (TV series)\n\nVishnu Puran (also written \"Vishnupuran\") is an Indian television series by B. R. Chopra on Lord Shri Vishnu.", "It is based on the \"Vishnu Purana\", an ancient collection of stories and scripture.", "\"Vishnu Puran\" tells of 10 incarnations of Vishnu, as well as other stories, such as the Legend of Dhruva.", "The weekly series first aired Sunday morning, January 23, 2000 on Zee TV.", "The 124 episodes were later released on DVD.", "The chief roles are played by Nitish Bharadwaj as Lord Shri Vishnu and Vaidehi as Goddess Lakshmi.", "Nitish Bharadwaj previously played the role of Lord Shri Vishnu's eighth incarnation, Lord Krishna, in Chopra's television adaptation of the epic \"Mahabharat\".", "The music is composed by Raj Kamal who also worked on \"Mahabharat\".", "Even though \"Vishnu Puran\" did not prove to be as successful as \"Mahabharat\", it did become popular.", "Within a year, the series finished with the Vamana Avatara and The Hindu review said, \"This lovely serial really overwhelmed us.\"", "By March 2001, it was consistently in Zee's top 10 ratings.", "By January 2003, it had completed 78 episodes with 100 more planned and was in the top 20 list." ] ], "gold": "In the 1988 Indian TV show \"Mahabharat\", the role of Krishna was played by Nitish Bharadwaj, who was initially chosen to play Vidur. In the compute animated 2013 movie \"Mahabharat\", Krishna was played by Shatrughan Prasad Sinha after he was given an choice of what role to play by producers. For the 2013 TV show, young Krishna was played by Kunwar Vikram Soni while adult Krishna was played by Saurabh Raj Jain.", "prediction 1": "In the 1988 TV series Mahabharat, Nitish Bharadwaj plays the role of Krishna. In the 2012 film Mahabharat, Shatrughan Sinha voices the character Krishna.", "prediction 2": "In the 1988 TV series Mahabharat, Nitish Bharadwaj played the role of Lord Krishna, whereas in the 2013 film Mahabharat, Shatrughan Sinha voiced the character. Sinha chose the role of Krishna.", "prediction 3": "In the 1988 TV series, Mahabharat, the central role remained with Nitish Bharadwaj. In the 2013 film, Mahabharat, the central role remained with Ramya Krishnan.", "prediction 4": "In the 1988 TV series Mahabharat, Nitish Bharadwaj played the role of Krishna. In the 2013 film Mahabharat, Sridevi Bhushan played the role of Krishna. In the 2000 television series Vishnu Puran, Shatrughan Sinha played the role of Krishna.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 85, "end": 89 } ], "missing-info": [], "corrected-prediction": "In the 1988 TV series Mahabharat, Nitish Bharadwaj plays the role of Krishna. In the 2013 film Mahabharat, Shatrughan Sinha voices the character Krishna." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did us go to war with germany?", "passages": [ [ "United States declaration of war upon Germany (1941)", "United States declaration of war upon Germany (1941)\n\n", "On December 11, 1941, the United States Congress declared war upon Germany (, Sess.", "1, ch. 564, ), hours after Germany declared war on the United States after the attack on Pearl Harbor by the Empire of Japan.", "The vote was 88\u20130 in the Senate and 393\u20130 in the House." ], [ "United States declaration of war on Germany (1917)", "United States declaration of war on Germany (1917)\n\n", "On April 2, 1917, President Woodrow Wilson asked a special joint session of the United States Congress for a declaration of war against the German Empire.", "Congress responded with the declaration on April 6.", "WHEREAS, The Imperial German Government has committed repeated acts of war against the people of the United States of America; therefore, be it resolved by the Senate and House of Representatives of the United States of America in Congress assembled, That the state of war between the United States and the Imperial German Government, which has thus been thrust upon the United States, is hereby formally declared; and that the President be, and he is hereby, authorized and directed to employ the entire naval and military forces of the United States and the resources of the Government to carry on war against the Imperial German Government; and to bring the conflict to a successful termination all the resources of the country are hereby pledged by the Congress of the United States.", "In the Senate, the resolution passed 82 to 6 on April 4.", "The negative votes were cast by Asle J. Gronna, Robert M. La Follette Sr., Harry Lane, George W. Norris, William J. Stone, and James K. Vardaman." ], [ "American entry into World War I", "Until 1917, Wilson made minimal preparations for a land war and kept the United States Army on a small peacetime footing, despite increasing demands for enhanced preparedness.", "He did, however, expand the United States Navy.", "In 1917, with Russia experiencing political upheaval, and with Britain and France low on credit, Germany appeared to have the upper hand in Europe, In January 1917 Germany decided to resume unrestricted submarine warfare with no warning to passengers or crews.", "Its goal was to starve Britain into surrender.", "although it realized that it would almost certainly bring the United States into the war.", "Germany also made a secret offer to help Mexico regain territories lost in the Mexican\u2013American War in an encoded telegram known as the Zimmermann Telegram, which was intercepted by British Intelligence.", "Publication of that communique outraged Americans just as German U-boats started sinking American merchant ships in the North Atlantic.", "Wilson then asked Congress for \"a war to end all wars\" that would \"make the world safe for democracy\", and Congress voted to declare war on Germany on April 6, 1917.", "On December 7, 1917, the U.S. declared war on Austria-Hungary.", "U.S. troops began arriving on the Western Front in large numbers in 1918." ] ], "gold": "On April 2, 1917, President Woodrow Wilson asked a special joint session of the United States Congress for a declaration of war against the German Empire. Congress responded with the declaration on April 6, 1917. On December 11, 1941, the United States Congress declared war on Germany, hours after Germany declared war on the United States after the attack on Pearl Harbor by the Empire of Japan.", "prediction 1": "On April 6, 1917, President Woodrow Wilson asked a special joint session of the United States Congress for a declaration of war against the German Empire. Congress responded with the declaration on April 6. On December 7, 1917, the U.S. declared war on Austria-Hungary. On December 11, 1941, the United States Congress declared war upon Germany.", "prediction 2": "On April 6, 1917, President Woodrow Wilson asked a special joint session of the United States Congress for a declaration of war against the German Empire. Congress responded with the declaration on April 6, 1917. On December 7, 1917, the U.S. declared war on Austria-Hungary. On December 11, 1941, the United States Congress declared war upon Germany, hours after Germany declared war on the United States after the attack on Pearl Harbor by the Empire of Japan.", "prediction 3": "In the 19th century, the U.S. went to war with Germany on April 6, 1917, and on December 7, 1917, the U.S. went to war with Austria-Hungary. In the 20th century, the U.S. went to war with Germany on March 6, 1918, and on June 7, 1918.", "prediction 4": "The United States went to war with Germany on April 6, 1917, and on December 7, 1917 the United States went to war with Austria-Hungary. The United States went to war with Germany in the Second World War, and on December 11, 1941 the United States Congress declared war upon Germany.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 269 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "On April 6, 1917, President Woodrow Wilson asked a special joint session of the United States Congress for a declaration of war against the German Empire. Congress responded with the declaration on April 6, 1917. On December 11, 1941, the United States Congress declared war upon Germany, hours after Germany declared war on the United States after the attack on Pearl Harbor by the Empire of Japan." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who has the most grand slams in major league baseball?", "passages": [ [ "Grand slam (baseball)", "Travis Hafner tied Mattingly's Major League record in , while in , Albert Pujols tied the one-season National League record of five grand slams set by Ernie Banks in .", "Several grand slams, the first being Connor's in 1881, consisted of a player hitting a walk-off grand slam for a one-run victory; some baseball observers call this an \"ultimate grand slam\".", "Roberto Clemente is the only player to have hit a walk-off inside-the-park grand slam in a one-run victory; the Pittsburgh Pirates defeated the Chicago Cubs 9\u20138 on July 25, 1956 at Forbes Field, a park known for its spacious outfield.", "On April 10, 1980 \u2013 on Opening Day, the Milwaukee Brewers' Sixto Lezcano hit a walk-off Grand Slam, reportedly the first such feat on an Opening Day.", "(Lezcano also has the distinction of hitting a Grand Slam the previous year, also on Opening Day.)", "During the major league season, grand slams accounted for 132 of the 5017 home runs hit (2.6%).", "On June 13\u201314, , the Minnesota Twins hit grand slams in consecutive games against the Boston Red Sox, including a walk-off grand slam by Jason Kubel in the 12th inning on June 13." ], [ "Grand slam (baseball)", "Grand slam (baseball)\n\n", "In baseball, a grand slam is a home run hit with all three bases occupied by baserunners (\"bases loaded\"), thereby scoring four runs\u2014the most possible in one play.", "According to \"The Dickson Baseball Dictionary\", the term originated in the card game of contract bridge, in which a \"grand slam\" involves taking all the possible tricks.", "The word \"slam\", by itself, usually is connected with a loud sound, particularly of a door being closed with excess force; thus, \"slamming the door\" on one's opponent(s), in addition to the bat slamming the ball into a home run.", "Roger Connor is believed to have been the first major league player to hit a grand slam, on September 10, 1881, for the Troy Trojans.", "Although Charlie Gould hit one for the Boston Red Stockings (now the Atlanta Braves) in the National Association (NA) on September 5, 1871, the NA is not recognized by MLB as a major league.", "Alex Rodriguez has 25 career grand slams, the most by any player in Major League Baseball history, passing Lou Gehrig's 23 on September 20, 2013.", "Don Mattingly set the one-season record with six grand slams in \u2013 remarkably, the only grand slams of his major league career." ], [ "1987 New York Yankees season", "1987 New York Yankees season\n\nThe New York Yankees' 1987 season was the 85th season for the Yankees.", "The team finished in fourth place with a record of 89-73, finishing 9 games behind the Detroit Tigers.", "New York was managed by Lou Piniella.", "The Yankees played at Yankee Stadium.", "The Yankees hit 10 grand slams, the most by an MLB team in 1987.", "Six of those were hit by Don Mattingly, who set a record for most grand slam home runs in one season with six.", "His record was matched by Travis Hafner during the 2006 season.", "Mattingly's Grand Slams in 1987 were also the only six Grand Slams of his career.", "In addition, Mattingly had tied Dale Long's major league record by hitting home runs in eight consecutive games (record later tied again by Ken Griffey, Jr., of Seattle in 1993), as well as stroking an extra base hit in ten consecutive games.", "Mattingly had a record 10 home runs during this streak (Long & Griffey had eight of them).", "In June 1987, it was reported that Mattingly injured his back during some clubhouse horseplay with pitcher Bob Shirley though both denied this.", "Nevertheless, he finished with a .327 batting average, 30 home runs, and 115 RBIs, his fourth straight year with at least 110 RBIs." ] ], "gold": "Alex Rodriguez has the most career grand slams in Major League Baseball history with 25. Don Mattingly and Travis Hafner share the record for most grand slams in a season with 6 in 1987 and 2006 respectively.", "prediction 1": "In baseball, a grand slam is a home run hit with all three bases occupied by baserunners, thereby scoring four runs\u2014the most possible in one play. Don Mattingly has the most grand slams in a single season, while Travis Hafner holds the record for the most grand slams in a single season, while Alex Rodriguez holds the record for the most career grand slams, and the most career grand slams in a single season.", "prediction 2": "During the 2016 season, the player with the most grand slams in Major League Baseball was Don Mattingly. Mattingly has the most grand slam home runs in a single season in Major League baseball with six. In 2016, Travis Hafner tied Mattingly's record for most grand slam home runs in a single season in the Major Leagues with five.", "prediction 3": "In baseball, a grand slam is a home run hit with all three bases occupied by baserunners (\"bases loaded\"), thereby scoring four runs\u2014the most possible in one play. Don Mattingly has the most Grand Slams in a single season in MLB history with six, while Travis Hafner tied Mattingly's record for most Grand Slams in a single season in 2006.", "prediction 4": "In baseball, a grand slam is a home run hit with all three bases occupied by baserunners, thereby scoring four runs, the most possible in one play. The most grand slams in a single season are held by Don Mattingly, the 1987 New York Yankees and the 2006 Seattle Mariners. The slugger with the most grand slams in a season is Carlos Correa, with five in the 1987 season and five in the 2006 season. The slams are hit in a season, and are both the 1987 and 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 146 }, { "error type": "Redundant", "explanation": " Don Mattingly has the most grand slams in a single season, ", "start": 206, "end": 287 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 359, "end": 410 } ], "missing-info": [], "corrected-prediction": "Don Mattingly has the most grand slams in a single season, which was tied by Travis Hafner, while Alex Rodriguez holds the record for the most career grand slams." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the saying with great power comes great responsibility come from?", "passages": [ [ "Uncle Ben", "Latter-day reinterpretations of Spider-Man, such as the \"Spider-Man\" film and the \"Ultimate Spider-Man\" comic, depict Ben as saying this phrase to Peter while he is still alive, in their last conversation.", "Both the aforementioned adaptations also had Peter lash out at Ben just after he says it, and both also mention his father.", "The origins of the phrase pre-date its use in Spider-Man.", "Most famously quoted by Albert Einstein in the early 20th century, this phrase has questionable origins.", "In 1817, member of British parliament William Lamb is recorded saying, \"the possession of great power necessarily implies great responsibility.\"", "In 1906, Under-Secretary of the Colonial Office Winston Churchill said, \"Where there is great power there is great responsibility\", even indicating that it was already a cultural maxim invoked toward government at the time.", "Franklin Richards of the Fantastic Four often refers to Benjamin Grimm, the Thing, as \"Uncle Ben\" (Grimm is the best friend of Franklin's father Reed Richards).", "Franklin Richards and Peter Parker also have the same middle name, Benjamin, as the Thing and Ben Parker are their namesakes.", "Spider-Man is aware of this, and told Franklin, \"Uncle Bens are always right.\"" ], [ "History of Marseille", "The city's fortunes rebounded with the ambitious building projects of Ren\u00e9 of Anjou, Count of Provence, who strengthened the city's fortifications during the mid-15th century.", "During the 16th century the city hosted a naval fleet with the combined forces of the Franco-Ottoman alliance, which threatened the ports and navies of Genoa and the Holy Roman Empire.", "Marseille lost a significant portion of its population during the Great Plague of Marseille in 1720, but the population recovered by mid century.", "In 1792 the city became a focal point of the French Revolution and was the birthplace of France's national anthem, \"La Marseillaise\".", "The Industrial Revolution and establishment of the French Empire during the 19th century allowed for further expansion of the city, although it was captured and heavily damaged by Nazi Germany during World War II.", "The city has since become a major center for immigrant communities from former French colonies, such as French Algeria.", "Humans have inhabited Marseille and its environs for almost 30,000 years: palaeolithic cave paintings in the underwater Cosquer Cave near the calanque of Morgiou date back to between 27,000 and 19,000 BC; and recent excavations near the railway station have unearthed neolithic brick habitations from around 6000 BC.", "Massalia, whose name was probably adapted from an existing language related to Ligurian, was the first Greek settlement in France." ], [ "Responsibility assumption", "John Denver, a proponent of \"est\" Erhard Seminars Training, wrote two songs about it, \"Farewell Andromeda\" (1973) and \"Looking for Space\" (1975); the opening lines of \"Farewell Andromeda\" capture the essence of responsibility assumption:\n\nThe 1956 movie \"Forbidden Planet\" featured an analogous concept to responsibility assumption, about a race who, through technology, became able to materialize their thoughts, to disastrous ends and chose to die out (cf. above, on the willing victims of the Holocaust).", "The 1967 television series \"The Prisoner\" featured an ambiguous climax spawning several interpretations, one of which implicates responsibility assumption.", "Throughout the short 17-episode series, the eponymous prisoner, a man held against his will by a mysterious group, attempted to determine \u2014 and in the final episode apparently succeeded in determining \u2014 the identity of the mysterious person who led the group and ultimately determined the prisoner's fate.", "The moment when the mysterious leader was literally unmasked by the prisoner was brief and unclear, but there are fans of the series who believe the leader was the prisoner himself.", "In 1962, the comic book superhero Spider-Man, created by Stan Lee, adopted the maxim, \"With great power there must also come great responsibility\" after his refusal to stop a thief led to the death of his Uncle Ben." ] ], "gold": "\"With great power comes great responsibility\" is a saying that is also known as the Peter Parker Principle, and comes from the Spider-Man comic books written by Stan Lee, but its origins date back from the fourth century BC. In a \"Plan de travail, de surveillance et de correspondance, propos\u00e9 par le Comit\u00e9 de Salut Public aux Repr\u00e9sentants du Peuple, d\u00e9put\u00e9s pr\u00e9s des Arm\u00e9es de la R\u00e9publique\" of the French National Convention in 1793, it is stated that the representatives must contemplate that a great responsibility is the inseparable result of a great power. British Member of Parliament William Lamb spoke a version of the adage that was recorded in 1817, and Winston Churchill said, \"Where there is great power there is great responsibility,\" in 1906. ", "prediction 1": "In 1909, Sir Winston Churchill said, \"Where there is great power there is great responsibility\". In 1817, member of British parliament William Lamb is recorded saying, \"the possession of great power necessarily implies great responsibility.\" In 1906, Under-Secretary of the Colonial Office Winston Churchill said, \"Where there is great power there is great responsibility\". The 1967 television series The Prisoner featured an ambiguous climax spawning several interpretations, one of which implicates responsibility assumption.", "prediction 2": "The saying with great power comes great responsibility came from several sources. In 1817, member of British parliament William Lamb is recorded saying, \"the possession of great power necessarily implies great responsibility.\" In 1906, Under-Secretary of the Colonial Office Winston Churchill said, \"Where there is great power there is great responsibility\". In 1962, the comic book superhero Spider-Man, created by Stan Lee, adopted the maxim, \"With great power there must also come great responsibility\" after his refusal to stop a thief led to the death of his Uncle Ben.", "prediction 3": "The saying with great power comes great responsibility came from French literature. In 1962, the comic book superhero Spider-Man, created by Stan Lee, adopted the maxim, \"With great power there must also come great responsibility\" after his refusal to stop a thief led to the death of his Uncle Ben. In 1906, Under-Secretary of the Colonial Office Winston Churchill said, \"Where there is great power there is great responsibility\".", "prediction 4": "There is a saying that \"Where there is great power there is great responsibility.\" The origins of the phrase pre-date its use in Spider-Man. Most famously quoted by Albert Einstein in the early 20th century, this phrase has questionable origins. In 1817, member of British parliament William Lamb is recorded saying, \"the possession of great power necessarily implies great responsibility.\" In 1906, Under-Secretary of the Colonial Office Winston Churchill said, \"Where there is great power there is great responsibility\". In 1962, the comic book superhero Spider-Man, created by Stan Lee, adopted the maxim, \"With great power there must also come great responsibility\" after his refusal to stop a thief led to the death of his Uncle Ben.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 3, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 9, "end": 12 }, { "error type": "Redundant", "explanation": "In 1909, Sir Winston Churchill said, \"Where there is great power there is great responsibility\". ", "start": 242, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 374, "end": 527 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "In 190y, Winston Churchill said, \"Where there is great power there is great responsibility\". In 1817, member of British parliament, William Lamb, was recorded saying, \"the possession of great power necessarily implies great responsibility.\" In 1962, the comic book superhero Spider-Man, created by Stan Lee, adopted the maxim, \"With great power there must also come great responsibility\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the green knight appear in camelot?", "passages": [ [ "Green Knight", "The meaning of his greenness has puzzled scholars since the discovery of the poem, who identify him variously as the Green Man, a vegetation being of medieval art; a recollection of a figure from Celtic mythology; a Christian symbol; or the Devil himself.", "The medieval scholar C. S. Lewis said the character was \"as vivid and concrete as any image in literature.\"", "J. R. R. Tolkien called him the \"most difficult character\" to interpret in the introduction to his edition of \"Sir Gawain and the Green Knight\".", "His major role in Arthurian literature includes being a judge and tester of knights, and as such the other characters consider him as friendly but terrifying and somewhat mysterious.", "The earliest appearance of the Green Knight is in the late 14th century alliterative poem \"Sir Gawain and the Green Knight\", which survives in only one manuscript along with other poems by the same author, the so-called Pearl Poet.", "This poet was a contemporary of Geoffrey Chaucer, writer of \"The Canterbury Tales\", although the two wrote in different parts of England.", "The later poem, \"The Greene Knight\", is a late medieval rhyming romance that likely predates its only surviving copy: the 17th-century Percy Folio." ], [ "Green Knight", "The other work featuring the Green Knight, the later ballad \"King Arthur and King Cornwall\", also survives only in the Percy Folio manuscript.", "Its date of composition is conjectural; it may be a version of an earlier story, though it is also possibly a product of the 17th century.", "In \"Sir Gawain and the Green Knight\", the Green Knight appears before Arthur's court during a Christmas feast, holding a bough of holly in one hand and a battle axe in the other.", "Despite disclaim of war, the knight issues a challenge: he will allow one man to strike him once with his axe, with the condition that he return the blow the next year.", "At first, Arthur accepts the challenge, but Gawain takes his place and decapitates the Green Knight, who retrieves his head, reattaches it and tells Gawain to meet him at the Green Chapel at the stipulated time.", "The Knight features next as Bercilak de Hautedesert, lord of a large castle, Gawain's host before his arrival at the Green Chapel." ] ], "gold": "The earliest appearance of the Green Knight is in the late 14th century alliterative poem Sir Gawain and the Green Knight, which survives in only one manuscript. The Green Knight appears before Arthur's court on Christmas Eve holding a bough of holly in one hand and a battle axe in the other.", "prediction 1": "The Green Knight appears in camelot in the late 14th century alliterative poem \"Sir Gawain and the Green Knight\", which survives in only one manuscript along with other poems by the same author, the so-called Pearl Poet. The next appearance of the Green Knight is in the later ballad \"King Arthur and King Cornwall\", which also survives only in the 17th-century Percy Folio manuscript. The Knight features next as Bercilak de Hautedesert, lord of a large castle, Gawain's host before his arrival at the Green Chapel.", "prediction 2": "The earliest appearance of the Green Knight in camelot is in the late 14th century alliterative poem, Sir Gawain and the Green Knight, which survives in only one manuscript along with other poems by the same author, the so-called Pearl Poet. This poet was a contemporary of Geoffrey Chaucer, writer of The Canterbury Tales, although the two wrote in different parts of England. The Green Knight appears again in the later ballad, King Arthur and King Cornwall, which appears only in the 17th-century Percy Folio manuscript and its date of composition is conjectural; it may be a version of an earlier story, though it is also possibly a product of the 17th century.", "prediction 3": "The Green Knight appears in camelot in several different forms. He appears in a poem titled \"Sir Gawain and the Green Knight\", a late medieval alliterative poem written by the so-called Pearl Poet, which survives in one manuscript along with other poems by the same author, and is written in the late 14th century. He appears in a ballad called \"King Arthur and King Cornwall\", which survives only in the 17th-century Percy Folio manuscript. The Knight appears in the late medieval rhyming romance rhyming romance, \"The Greene Knight\", which is an early medieval rhyming romance that likely predates its only surviving copy, which is conjectural, though it is also possibly a version of an earlier story, though it is also possibly a product of the 17th century.", "prediction 4": "The earliest appearance of the Green Knight is in the late 14th century alliterative poem \"Sir Gawain and the Green Knight\", which survives in only one manuscript along with other poems by the same author, the so-called Pearl Poet. J. R. R. Tolkien called him the \"most difficult character\" to interpret in the introduction to his edition of Sir Gawain and the Green Knight. The Green Knight features next as Bercilak de Hautedesert, lord of a large castle, Gawain's host before his arrival at the Green Chapel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 220 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 385 }, { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 516 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Green Knight appears in camelot in the late 14th century alliterative poem \"Sir Gawain and the Green Knight\", which survives in only one manuscript. The Green Knight appears before Arthur's court holding a bough of holly in one hand and a battle axe in the other." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What are the 3 most common gasses in earth's atmosphere?", "passages": [ [ "Nitrogen", "The discovery of nitrogen is attributed to the Scottish physician Daniel Rutherford in 1772, who called it \"noxious air\".", "Though he did not recognise it as an entirely different chemical substance, he clearly distinguished it from Joseph Black's \"fixed air\", or carbon dioxide.", "The fact that there was a component of air that does not support combustion was clear to Rutherford, although he was not aware that it was an element.", "Nitrogen was also studied at about the same time by Carl Wilhelm Scheele, Henry Cavendish, and Joseph Priestley, who referred to it as \"burnt air\" or \"phlogisticated air\".", "Nitrogen gas was inert enough that Antoine Lavoisier referred to it as \"mephitic air\" or \"azote\", from the Greek word (azotikos), \"no life\".", "In an atmosphere of pure nitrogen, animals died and flames were extinguished.", "Though Lavoisier's name was not accepted in English, since it was pointed out that almost all gases (indeed, with the sole exception of oxygen) are mephitic, it is used in many languages (French, Italian, Portuguese, Polish, Russian, Albanian, Turkish, etc. ; the German \"Stickstoff\" similarly refers to the same characteristic, viz." ], [ "Oxygen", "Oxygen\n\nOxygen is a chemical element with symbol\u00a0O and atomic number 8.", "It is a member of the chalcogen group on the periodic table, a highly reactive nonmetal, and an oxidizing agent that readily forms oxides with most elements as well as with other compounds.", "By mass, oxygen is the third-most abundant element in the universe, after hydrogen and helium.", "At standard temperature and pressure, two atoms of the element bind to form dioxygen, a colorless and odorless diatomic gas with the formula .", "Diatomic oxygen gas constitutes 20.8% of the Earth's atmosphere.", "As compounds including oxides, the element makes up almost half of the Earth's crust.", "Dioxygen is used in cellular respiration and many major classes of organic molecules in living organisms contain oxygen, such as proteins, nucleic acids, carbohydrates, and fats, as do the major constituent inorganic compounds of animal shells, teeth, and bone.", "Most of the mass of living organisms is oxygen as a component of water, the major constituent of lifeforms.", "Oxygen is continuously replenished in Earth's atmosphere by photosynthesis, which uses the energy of sunlight to produce oxygen from water and carbon dioxide." ], [ "Atmosphere of Earth", "Atmosphere of Earth\n\nThe atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity.", "The atmosphere of Earth protects life on Earth by creating pressure allowing for liquid water to exist on the Earth's surface, absorbing ultraviolet solar radiation, warming the surface through heat retention (greenhouse effect), and reducing temperature extremes between day and night (the diurnal temperature variation).", "By volume, dry air contains 78.09% nitrogen, 20.95% oxygen, 0.93% argon, 0.04% carbon dioxide, and small amounts of other gases.", "Air also contains a variable amount of water vapor, on average around 1% at sea level, and 0.4% over the entire atmosphere.", "Air content and atmospheric pressure vary at different layers, and air suitable for use in photosynthesis by terrestrial plants and breathing of terrestrial animals is found only in Earth's troposphere and in artificial atmospheres.", "The atmosphere has a mass of about 5.15\u00a0kg, three quarters of which is within about of the surface.", "The atmosphere becomes thinner and thinner with increasing altitude, with no definite boundary between the atmosphere and outer space.", "The K\u00e1rm\u00e1n line, at , or 1.57% of Earth's radius, is often used as the border between the atmosphere and outer space." ], [ "Atmosphere", "The original atmospheres started with a rotating disc of gases that collapsed to form a series of spaced rings that condensed to form the planets.", "The planet's atmospheres were then modified over time by various complex factors, resulting in quite different outcomes.", "The atmospheres of the planets Venus and Mars are primarily composed of carbon dioxide, with small quantities of nitrogen, argon, oxygen and traces of other gases.", "The composition of Earth's atmosphere is largely governed by the by-products of the life that it sustains.", "Dry air from Earth's atmosphere contains 78.08% nitrogen, 20.95% oxygen, 0.93% argon, 0.04% carbon dioxide, and traces of hydrogen, helium, and other \"noble\" gases (by volume), but generally a variable amount of water vapor is also present, on average about 1% at sea level.", "The low temperatures and higher gravity of the Solar System's giant planets\u2014Jupiter, Saturn, Uranus and Neptune\u2014allow them more readily to retain gases with low molecular masses.", "These planets have hydrogen\u2013helium atmospheres, with trace amounts of more complex compounds.", "Two satellites of the outer planets possess significant atmospheres.", "Titan, a moon of Saturn, and Triton, a moon of Neptune, have atmospheres mainly of nitrogen." ] ], "gold": "Earth's atmosphere, or air, is made up of gases. By mole fraction, or by the number of molecules, the planet's dry air contains 78.08% nitrogen, making it the most common gas in Earth's atmosphere. At 20.95%, oxygen is the second most common gas in Earth's atmosphere. The third most common gas in Earth's atmosphere is argon, with 0.93%.", "prediction 1": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. The most common gas in the Earth's atmosphere is carbon dioxide. The second most common gas in the Earth's atmosphere is nitrogen.\n", "prediction 2": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. The gasses nitrogen, oxygen, argon and carbon dioxide make up the majority of the air in the Earth's atmosphere, with the exception of a trace amount of methane.", "prediction 3": "The air that surrounds the planet Earth contains various gases. Nitrogen, which is commonly known as noxious air, is found mostly in the atmosphere due to its chemical composition. Oxygen, which is most commonly known as diatomic oxygen, is commonly found in the Earth's atmosphere.", "prediction 4": "The atmosphere of Earth is the layer of gases, generally known as air, that surrounds the planet Earth and is retained by Earth's gravity. By mass, oxygen is the third-most abundant element in the universe after hydrogen and helium. The difference between these gases and carbon dioxide is that oxygen has a lower specific gravity than carbon dioxide and is compressed by Earth's gravity. When created on Earth, oxygen is composed of carbon dioxide and carbon monoxide.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 137 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 187, "end": 202 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 259, "end": 269 } ], "missing-info": [], "corrected-prediction": "The atmosphere of Earth is the layer of gases, commonly known as air. The most common gas in the Earth's atmosphere, by dry air volume, is nitrogen at 78.09%. The second most common gas in the Earth's atmosphere is oxygen at 20.95%. The third most is argon at 0.93%.\n" }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "Which king saw the writing on the wall?", "passages": [ [ "Belshazzar's feast", "Belshazzar's feast\n\nBelshazzar's feast, or the story of the writing on the wall (chapter 5 in the Book of Daniel) tells how Belshazzar holds a great feast and drinks from the vessels that had been looted in the destruction of the First Temple.", "A hand appears and writes on the wall.", "The terrified Belshazzar calls for his wise men, but they are unable to read the writing.", "The queen advises him to send for Daniel, renowned for his wisdom.", "Daniel reminds Belshazzar that his father Nebuchadnezzar, when he became arrogant, was thrown down until he learned that God has sovereignty over the kingdom of men.", "Belshazzar had likewise blasphemed God, and so God sent this hand.", "Daniel then reads the message and interprets it: God has numbered Belshazzar's days, he has been weighed and found wanting, and his kingdom will be given to the Medes and the Persians." ], [ "Belshazzar's feast", "Their setting is Babylon, and there is no reason to doubt that they were composed in the Babylonian diaspora (i.e., among the Jewish community living in Babylon and Mesopotamia under Persian and then Greek rule).", "They reflect a society in which foreign rulers were not necessarily malevolent (Belshazzar rewards Daniel and raises him to high office); this is a marked contrast with the visions of chapters 7\u201312, where the sufferings of the Jews are the result of actions by the evil 2nd century BCE king Antiochus IV Epiphanes.", "Chapters 2 and 7 tell how all worldly kingdoms will come to an end and be replaced by the kingdom of God, and chapters 3 and 6 tell how pious Jews withstand the arrogance of earthly kings and are rescued by the God of Israel.", "Chapters 4 and 5 form the center and carry the most important message in their parallel but contrasting tales of Nebuchadnezzar and Belshazzar.", "The first is humbled by God, learns his lesson (he acknowledges the ultimate kingship of the Jewish God), and is restored to his throne; Belshazzar, in contrast, learns nothing from Nebuchadnezzar's example, blasphemes against God, and has his kingdom given to others.", "Notes\nBibliography" ] ], "gold": "Belshazzar's feast, or the story of the writing on the wall, chapter 5 in the Book of Daniel, tells how Belshazzar holds a great feast and drinks from the vessels that had been looted in the destruction of the First Temple, and a hand appears and writes on the wall. The queen advises him to send for Daniel, renowned for his wisdom, and Daniel reminds Belshazzar that his father Nebuchadnezzar, when he became arrogant, was thrown down until he learned that God has sovereignty over the kingdom of men. Daniel then reads the message and interprets it that God has numbered Belshazzar's days, he has been weighed and found wanting, and his kingdom will be given to the Medes and the Persians. ", "prediction 1": "The passage \"The writing on the wall\" is in Daniel chapter 5, the 5th chapter of the Book of Daniel, which tells the story of Belshazzar, the king who saw the writing on the wall. The terrified Belshazzar calls for his wise men, but they are unable to read the writing. The queen advises him to send for Daniel, renowned for his wisdom. Daniel reads the message and interprets it: God has numbered Belshazzar's days, he has been weighed and his kingdom will be given to the Medes and the Persians.", "prediction 2": "The book of Daniel tells the story of the writing on the wall, or Belshazzar's feast, or the story of the writing on the wall. In chapter 5, Belshazzar drinks from the vessels that had been looted in the destruction of the First Temple. A hand appears and writes on the wall. The terrified Belshazzar calls for his wise men, but they are unable to read the writing. The queen advises him to send for Daniel, renowned for his wisdom. Daniel then reads the message and interprets it: God has numbered Belshazzar's days, he has been weighed and found wanting, and his kingdom will be given to the Medes and the Persians and the Persians.", "prediction 3": "The book of Daniel tells the story of Belshazzar seeing a hand writing on a wall. Nebuchadnezzar, the king of Babylon, had seen the writing on the wall. During the feast, a hand appeared to him, and wrote on the wall. The terrified Belshazzar called for his wise men, but they are unable to read the writing. The queen advises him to send for Daniel, renowned for his wisdom. Daniel then reads the message and interprets it, and says that his kingdom will be given to the Medes and the Persians and the Persians.", "prediction 4": "Belshazzar, the eldest son of Nebuchadnezzar, saw the writing on the wall in Daniel chapter 5. Nebuchadnezzar sees the writing on the wall in Daniel chapter 5; Belshazzar's feast is the second part of the Book of Daniel and tells the story of how Belshazzar holds a great feast and drinks from the vessels that had been looted in the destruction of the First Temple. A hand appears and writes on the wall. The terrified Belshazzar calls for his wise men, but they are unable to read the writing. Daniel then reads the message and interprets it as follows: God has numbered Belshazzar's days, he has been weighed and found wanting, and his kingdom will be given to the Medes and the Persians.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 269 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The passage \"The writing on the wall\" is in Daniel chapter 5, the 5th chapter of the Book of Daniel, which tells the story of Belshazzar, the king who saw the writing on the wall. Belshazzar holds a great feast and drinks from the vessels that had been looted in the destruction of the First Temple. A hand appears and writes on the wall. The queen advises him to send for Daniel, renowned for his wisdom. Daniel reminds Belshazzar that his father Nebuchadnezzar, when he became arrogant, was thrown down until he learned that God has sovereignty over the kingdom of men. Daniel reads the message and interprets it: God has numbered Belshazzar's days, he has been weighed and his kingdom will be given to the Medes and the Persians." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who landed the first quad in figure skating?", "passages": [ [ "Quad (figure skating)", "Quad (figure skating)\n\nA quad, or quadruple, is a figure skating jump with at least four but less than five revolutions.", "Most quadruple jumps have 3\u00bd revolutions; the quadruple Axel has 4\u00bd revolutions, although no figure skater to date has completed this jump in competition.", "The quadruple toe loop and quadruple Salchow are the two most commonly skated in the discipline.", "Quadruple jumps have become increasingly common among World and Olympic level men's single skaters, to the point that not having one in a program has come to be seen as a severe handicap.", "The first person to land a ratified quadruple jump in competition was Canadian Kurt Browning in 1988.", "In 2002, Miki Ando became the first woman to do so, and she remains one of only two women to have landed a ratified quadruple jump in competition.", "In singles competition for men:\n\n", "In singles competition for women:\n\nIn pair skating competition:\n\n\n\n\nA jump harness is often employed in training quads.", "Max Aaron stated that the smallest error may make the difference in the success of a quad attempt: \"The minute your left arm is behind you, or your three-turn is too fast, if your hips don't turn in time, if your foot isn't in the right place, anything will throw you off.\"" ], [ "Lutz jump", "This practice disappeared with the development of multi-rotation jumps.", "Today the Lutz is often done in double or triple versions.", "Alena Vrz\u00e1\u0148ov\u00e1 of Czechoslovakia was the first woman credited with a double Lutz, performed at the 1949 World Championships.", "Donald Jackson of Canada was the first skater to execute a triple Lutz jump in competition, at the 1962 World Championships; Denise Biellmann of Switzerland is credited as the first woman to do so, at the 1978 European Championships.", "Brandon Mroz of the United States is credited with landing the first quadruple Lutz jump in a sanctioned competition at the 2011 Colorado Springs Invitational, a club competition sanctioned by U.S. Figure Skating; Mroz's jump was subsequently ratified by the International Skating Union after video review.", "On November 12, Mroz landed it in the short program at 2011 NHK Trophy, becoming the first skater to land it in an international competition.", "On November 2015 Jin Boyang became the first man to land the quad lutz with a positive GOE at an international competition and a quad lutz triple toe.", "On November 25, 2017 Nathan Chen became the first man to land two quadruple Lutz jumps in competition during the free skating portion of the Skate America Grand Prix Competition.", "On February 17, 2018, Vincent Zhou became the first to land a Quad Lutz at any Winter Olympic Competition." ], [ "Shoma Uno", "Shoma Uno\n\nUno is the first skater to successfully land a quadruple flip in an international competition.", "He is also the historic record-holder for the highest score by a junior in the short program.", "Shoma Uno was born December 17, 1997, in Nagoya, Japan.", "He has a younger brother named Itsuki Uno .", "Uno started skating when he was five because of Mao Asada, who talked to him at a skating rink.", "His figure skating idol is Daisuke Takahashi.", "Uno won bronze at the Japan Junior Championships of the 2009\u20132010 season but finished off the podium the next two years.", "Uno made his Junior Grand Prix (JGP) debut in the 2011\u20132012 season, winning a bronze medal at the JGP Tallinn Cup in Estonia after placing 4th at the event in Poland.", "At the 2012 Winter Youth Olympics, he won silver in the individual event and gold in the team event.", "He finished 10th at the 2012 World Junior Championships.", "Uno finished 6th at his Junior Grand Prix in Slovenia.", "At his next JGP event, in Germany, he won the silver medal with personal bests in both programs and a total score of 188.48 points.", "He finished 7th at the 2013 World Junior Championships.", "Uno competed in his third JGP season, winning the bronze medal in Riga, Latvia, and placing 4th in Tallinn, Estonia." ] ], "gold": "A quad, or quadruple, is a figure skating jump with at least four but less than five revolutions. Different variations of it have been performed while in competition. For instance, Kurt Browning was the first one to land a quad toe loop during a tournament while Timothy Goebel did so for the quad Salchow. Brandon Mroz was the first to perform a quad lutzs in a championship, Shoma Uno and Yuzuru Hanyu being the very first ones to do a quad flip and a quad loop respectively.", "prediction 1": "A quad, or quadruple, is a figure skating jump with at least four but less than five revolutions. The first person to land a ratified quadruple jump in competition was Canadian Kurt Browning in 1988. On November 12, Mroz of the United States is credited with landing the first quadruple Lutz jump in a sanctioned competition at the 2011 Colorado Springs Invitational, a club competition sanctioned by U.S. Figure Skating. On November 25, 2017 Nathan Chen became the first man to land two quadruple Lutz jumps in a sanctioned competition. On February 17, 2018, Vincent Zhou became the first to land a quadruple flip at any Winter Olympic Competition.", "prediction 2": "The first quad in figure skating is a jump with at least four but less than five revolutions. Brandon Mroz of the United States is credited with landing the first quadruple Lutz jump in a sanctioned competition at the 2011 Colorado Springs Invitational. On November 12, Mroz landed it in the short program at the 2011 NHK Trophy, becoming the first skater to land it in an international competition. On November 25, 2017 Nathan Chen became the first man to land two quadruple Lutz jumps in competition during the free portion of the Skate America Grand Prix Competition. On February 17, 2018, Vincent Zhou became the first to land a Quad Lutz flip at any Winter Olympic Competition. On February 17, 2018, Vincent Zhou became the first to land a Quad Lutz at any Winter Olympic Competition.", "prediction 3": "A quad, or quadruple, is a figure skating jump with at least four but less than five revolutions. The first person to land a ratified quadruple jump in competition was Canadian Kurt Browning in 1988. On November 12, 2011 Brandon Mroz landed the first quadruple Lutz jump in a sanctioned competition at the 2011 NHK Trophy, becoming the first skater to land it in an international competition. On November 25, 2017 Nathan Chen became the first man to land two quadruple Lutz jumps in an international competition. On February 17, 2018, Vincent Zhou became the first to land a quadruple Lutz at any Winter Olympic Competition. On February 17, 2018, Vincent Zhou became the first to land a quadruple flip at any Winter Olympic Competition. On February 17, 2018, Vincent Zhou became the first skateruple flip at any Winter Olympic Competition.", "prediction 4": "A quad, or quadruple, is a figure skating jump with at least four but less than five revolutions. Kurt Browning of Canada was the first person to land a ratified quadruple jump in competition in 1988. In 2002, Miki Ando became the first woman to do so, and she remains one of only two women to have landed a ratified quadruple jump in competition. On November 12, Mroz of the United States is credited with landing the first quadruple Lutz jump in a sanctioned competition. On November 25, 2017, Jin Boyang became the first man to land a quad lutz with a positive GOE at an international competition and a quadruple toe. On February 17, 2018, Vincent Zhou became the first to land a quadruple Lutz at any Winter Olympic Competition. On February 17, 2018, Vincent Zhou became the first", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 421 }, { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 537 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "A quad, or quadruple, is a figure skating jump with at least four but less than five revolutions. The first person to land a ratified quadruple jump in competition was Canadian Kurt Browning in 1988. On November 12, Mroz of the United States is credited with landing the first quadruple Lutz jump in a sanctioned competition. On February 17, 2018, Vincent Zhou became the first to land a quadruple flip at any Winter Olympic Competition. Shoma Uno Uno is the first skater to successfully land a quadruple flip in an international competition." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When do football teams wear their third kit?", "passages": [ [ "Third jersey", "Some teams have exceeded the limit; the 2017 Baltimore Ravens were an example, wearing their all-black uniforms twice that season, and the less-frequent black jerseys on white pants once.", "There are currently no rules on wearing alternate pants.", "Teams are only permitted to wear alternate jerseys once in playoff games (except the Super Bowl, where teams must wear their standard uniforms); the only team to do so (other than in 1994) was the 2008 San Diego Chargers.", "In the past, rules allowed for teams to wear their third jersey two times in the regular season and once in the preseason until 2010.", "In 2011 teams were no longer allowed to wear their third jersey in the preseason.", "However, there have been some exceptions since 2011.", "Some teams will generally use one of their third jersey allotments against a particular division opponent each year.", "For instance, the Los Angeles (formerly San Diego) Chargers would frequently wear their popular alternate powder blue jerseys (that was introduced in 2007) at home against the Oakland Raiders, while the Houston Texans were known to wear their alternate \"Battle Red\" uniforms at home against the Jacksonville Jaguars, and the Pittsburgh Steelers usually wore their throwbacks from 2007-2011 at home against the archrival Baltimore Ravens.", "The New York Giants were known to wear their alternate red jerseys at home against the Dallas Cowboys until the red jerseys were retired in 2009." ], [ "Third jersey", "Away kits were often similar as well, therefore third kits were worn in the 1948 FA Cup Final by Manchester United and the 1950 final by Arsenal.", "Similar rules were employed by European governing body UEFA, with Manchester United winning the 1968 European Cup Final in a blue third kit.", "Teams sometimes needed to find makeshift third kits for their players.", "One notable example being France having to wear the green-and-white stripes of local club C.A. Kimberley for their 1978 World Cup match against Hungary, as both teams were only equipped with their white change shirts for the game.", "Third kits in international football are less common, both teams are advised to change colours in the event of a home kit clashing.", "England prepared light blue third kits for the 1970 and 1986 World Cups, which was only worn for the former, and Spain introduced a white third kit for the 2014 World Cup at the insistence of FIFA.", "Since the 2000s, most clubs in major European leagues have used a third kit, or had one in reserve.", "Replicas of the kits are usually sold at club merchandise shops.", "Sometimes, a previous season's away kit is retained if a clash arises.", "Clubs sometimes also assign a third kit as their secondary kit for certain competitions and vice versa." ], [ "Third jersey", "Third jersey\n\nA third jersey, alternate jersey, third kit, third sweater or alternate uniform is a jersey or uniform that a sports team wear in games instead of its home outfit or its away outfit, often when the colors of two competing teams' other uniforms are too similar to play easily.", "Alternate jerseys are also a means for professional sports organizations to generate revenue, by sales to fans.", "Of North American sports leagues, the NFL generates $1.2 billion annually in jersey sales, with the NBA second selling $900 million annually.", "Another use of the alternate uniform is for identifying with causes, like the Central Coast Mariners wear an alternate pink kit on pink ribbon day.", "Extra alternate uniforms or fourth/fifth kits are not commonly used, but are sometimes required when teams' other uniforms cause color clashes, or the uniforms are unavailable to use.", "In cases where teams have worn more than three kits in the same season, the extra kits were usually recycled from previous seasons.", "Third-choice jerseys or uniforms are used in all four North American major professional sports leagues, with the exception being college sports.", "Third kits are commonplace in professional European association football and in some professional European rugby union clubs.", "Alternate guernseys or jerseys are common in Australia's two biggest domestic leagues, the Australian Football League (Aussie rules) and National Rugby League (rugby league)." ] ], "gold": "The NFL was the last of the major professional sports leagues to adopt the third jersey rule in 2002, stating that a team may wear it only once a year, later increased to twice a year. Some teams will generally use one of their third jersey allotments against a particular division opponent each year. On the other hand, third kits are commonplace in professional European association football. Where the colours of the two competing clubs are similar, the common practice is to use the third jersey, as away kits are often similar as well.", "prediction 1": "A third jersey, alternate jersey, third kit, third sweater or alternate uniform is a jersey or uniform that a sports team wears in games instead of its home outfit or its away outfit, often when the colors of two competing teams' other uniforms are too similar to play easily. In professional football, teams are allowed to wear their third kit two times in the regular season and once in the preseason. In the past, rules allowed for teams to wear their third jersey two times in the regular season and once in the preseason until 2010. In 2011, teams were no longer allowed to wear their third jersey in the preseason.", "prediction 2": "A third jersey, alternate jersey, third kit, third sweater or alternate uniform is a jersey or uniform that a sports team wears in games instead of its home outfit or its away outfit, often when the colors of two competing teams' other uniforms are too similar to play easily. Third kits are commonplace in professional European association football and in some professional European rugby union clubs. In the past, rules allowed for teams to wear their third jersey two times in the regular season and once in the preseason until 2010. In 2011, teams were no longer allowed to wear their third jersey in the preseason.", "prediction 3": "A third jersey, alternate jersey, third kit, or third sweater is a jersey or uniform that a sports team wears in games instead of its home outfit or its away outfit, often when the colors of two competing teams' other uniforms are too similar to play easily. Third kits are commonplace in professional European association football and in some professional European rugby union clubs. In the past, rules allowed for teams to wear their third jersey two times in the regular season and once in the preseason until 2010. In 2011 teams were no longer allowed to wear their third kit in the preseason. Some teams will generally use one of their third jerseys against a particular division opponent each year. For instance, the Los Angeles Chargers would often wear their popular alternate powder blue jerseys at home against the Oakland Raiders.", "prediction 4": "There are several football teams that wear their third kit. In the past, rules allowed for teams to wear their third jersey two times in the regular season and once in the preseason until 2010. In 2011, teams were no longer allowed to wear their third jersey in the preseason. However, there have been some exceptions since 2011. Some teams will generally use one of their third jersey allotments against a particular division opponent each year. For instance, the Los Angeles Chargers would frequently wear their popular alternate powder blue jerseys at home against the Oakland Raiders. The Pittsburgh Steelers usually wore their throwbacks from 2007-2011 at home against the Baltimore Ravens. Second-choice kits are commonplace in professional European association football and in some professional European rugby union clubs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 377, "end": 403 }, { "error type": "Redundant", "explanation": "In professional football, teams are allowed to wear their third kit two times in the regular season and once in the preseason. ", "start": 404, "end": 537 }, { "error type": "Irrelevant", "explanation": "", "start": 538, "end": 620 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "A third jersey is a jersey or uniform that a sports team wears in games instead of its home outfit or its away outfit, often when the colors of two competing teams' other uniforms are too similar to play easily. In professional American football, teams are allowed to wear their third kit two times in the regular season. Some teams will generally use one of their third jersey allotments against a particular division opponent each year. Third kits are commonplace in professional European association football." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who played in the first hockey game ever?", "passages": [ [ "Ice hockey", "On March 3, 1875, the first organized indoor game was played at Montreal's Victoria Skating Rink between two nine-player teams, including James Creighton and several McGill University students.", "Instead of a ball or bung, the game featured a \"flat circular piece of wood\" (to keep it in the rink and to protect spectators).", "The goal posts were apart (today's goals are six feet wide).", "In 1876, games played in Montreal were \"conducted under the 'Hockey Association' rules\"; the Hockey Association was England's field hockey organization.", "In 1877, \"The Gazette\" (Montreal) published a list of seven rules, six of which were largely based on six of the Hockey Association's twelve rules, with only minor differences (even the word \"ball\" was kept); the one added rule explained how disputes should be settled.", "The McGill University Hockey Club, the first ice hockey club, was founded in 1877 (followed by the Quebec Hockey Club in 1878 and the Montreal Victorias in 1881).", "In 1880, the number of players per side was reduced from nine to seven.", "The number of teams grew, enough to hold the first \"world championship\" of ice hockey at Montreal's annual Winter Carnival in 1883.", "The McGill team won the tournament and was awarded the \"Carnival Cup\".", "The game was divided into thirty-minute halves." ], [ "First indoor ice hockey game", "The match lays claim to this distinction because of factors which establish its link to modern ice hockey: it featured two teams (nine players per side) with a recorded score.", "Games prior to this had mostly been outdoors.", "In order to limit injuries to spectators and damage to glass windows, the game was played with a \"flat block of wood\" instead of a lacrosse ball.", "The two teams, members of the club, included a number of McGill University students.", "Sticks for this game were imported from Nova Scotia.", "This first game was pre-announced to the general public in the pages of \"The Montreal Gazette\":\nVictoria Rink \u2013 A game of Hockey will be played at the Victoria Skating Rink this evening, between two nines chose from among the members.", "Good fun may be expected, as some of the players are reputed to be exceedingly expert at the game.", "Some fears have been expressed on the part of intending spectators that accidents were likely to occur through the ball flying about in too lively a manner, to the imminent danger of lookers on, but we understand that the game will be played with a flat circular piece of wood, thus preventing all danger of its leaving the surface of the ice.", "Subscribers will be admitted on presentation of their tickets.", "HOCKEY \u2013", "At the Rink last night a very large audience gathered to witness a novel contest on the ice." ], [ "National Hockey League", "National Hockey League\n\nThe National Hockey League (NHL; ) is a professional ice hockey league in North America, currently comprising 31 teams: 24 in the United States and 7 in Canada.", "The NHL is considered to be the premier professional ice hockey league in the world, and one of the major professional sports leagues in the United States and Canada.", "The Stanley Cup, the oldest professional sports trophy in North America, is awarded annually to the league playoff champion at the end of each season.", "The National Hockey League was organized on November 26, 1917, at the Windsor Hotel in Montreal after the suspension of operations of its predecessor organization, the National Hockey Association (NHA), which had been founded in 1909 in Renfrew, Ontario.", "The NHL immediately took the NHA's place as one of the leagues that contested for the Stanley Cup in an annual interleague competition before a series of league mergers and folds left the NHL as the only league left competing for the Stanley Cup in 1926.", "At its inception, the NHL had four teams\u2014all in Canada, thus the adjective \"National\" in the league's name.", "The league expanded to the United States in 1924, when the Boston Bruins joined, and has since consisted of American and Canadian teams.", "From 1942 to 1967, the league had only six teams, collectively (if not contemporaneously) nicknamed the \"Original Six\"." ] ], "gold": "While the game's origins lie elsewhere, Montreal is at the centre of the development of the sport of contemporary ice hockey, where, on March 3, 1875, the first hockey game ever was organized between James Creighton and several McGill University students, all members of the Victoria Skating Club. Meanwhile, the NHL was first organized on November 26, 1917, comprising of four Canadian teams. The first match in the league's history was played between the Montreal Canadiens and Ottawa Senators.", "prediction 1": "On March 3, 1875, the first organized indoor hockey game was played at Montreal's Victoria Skating Rink between two nine-player teams, including James Creighton and several McGill University students. Instead of a ball or bung, the game featured a \"flat circular piece of wood\" to keep it in the rink and to protect spectators. In order to limit injuries to spectators and damage to glass windows, the game was played with a \"flat block of wood\" instead of a lacrosse ball.", "prediction 2": "On March 3, 1875, the first organized indoor hockey game was played at Montreal's Victoria Skating Rink between two nine-player teams, including James Creighton and several McGill University students. Instead of a ball or bung, the game featured a \"flat circular piece of wood\" (to keep it in the rink and to protect spectators).", "prediction 3": "The first indoor hockey game ever was played between two nine-player teams at Montreal's Victoria Skating Rink between James Creighton and several McGill University students. This first indoor hockey game was played at the Victoria Skating Rink in Montreal between two nine-player teams, including members of the McGill University Hockey Club and several students from the School of Social Science. This first indoor hockey game lays claim to this distinction because of factors which establish its link to modern ice hockey: it featured two teams (nine players per side) with a recorded score.", "prediction 4": "The first organized indoor hockey game was played on March 3, 1875, at Montreal's Victoria Skating Rink between two nine-player teams, including James Creighton and several McGill University students. Instead of a ball or bung, the game featured a \"flat circular piece of wood\" (to keep it in the rink and to protect spectators).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 473 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "On March 3, 1875, the first organized indoor hockey game was played at Montreal's Victoria Skating Rink between two nine-player teams, including James Creighton and several McGill University students. The National Hockey League was organized on November 26, 1917. At its inception, the NHL had four teams\u2014all in Canada. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the new star trek discovery episode come out?", "passages": [ [ "Star Trek: Discovery", "Star Trek: Discovery\n\nStar Trek: Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman.", "It is the first series developed specifically for that service, and the first \"Star Trek\" series since \"\" concluded in 2005.", "Set roughly a decade before the events of and separate from the timeline of the concurrently produced feature films, \"Discovery\" explores the Federation\u2013Klingon war while following the crew of the USS \"Discovery\".", "Sonequa Martin-Green stars as Michael Burnham, a science specialist on the USS \"Discovery\".", "Doug Jones, Shazad Latif, Anthony Rapp, and Mary Wiseman also star.", "They are joined by Jason Isaacs for the , and Anson Mount and Wilson Cruz for the .", "The new series was announced in November 2015, with Fuller joining as showrunner and wanting to make an anthology series.", "CBS asked him to make a single, serialized show first, with the prequel to the original series idea further developed.", "After further disagreements with CBS and struggles with other commitments, Fuller left the series in October 2016, replaced as showrunner by Gretchen J. Berg and Aaron Harberts for the first season, with producing support from Akiva Goldsman." ], [ "Star Trek: Discovery", "Goldsman did not return after the first season, while Berg and Harberts were fired by CBS during production on the second; Kurtzman took over as sole showrunner.", "\"Star Trek: Discovery\" premiered on September 19, 2017, at ArcLight Hollywood, before debuting on CBS and CBS All Access on September 24.", "The rest of the 15-episode first season was streamed weekly on All Access.", "The series' release led to record subscriptions for All Access, and positive reviews from critics who highlighted Martin-Green's performance.", "A 14-episode second season was ordered in October 2017, and is set to premiere on January 17, 2019.", "Set roughly ten years before the events of \"\", the show sees the united Klingon houses in a war with the United Federation of Planets that involves the crew of the USS \"Discovery\".", "On November 2, 2015, CBS announced a new \"Star Trek\" television series to premiere in January 2017, \"on the heels\" of the ' 50th anniversary in 2016.", "It is the first \"Star Trek\" series since \"\" concluded in 2005, and the first show to be developed specifically for the CBS All Access on demand service." ] ], "gold": "Star Trek: Discovery is an American television series created by Bryan Fuller and Alex Kurtzman for the streaming service CBS All Access, later rebranded as Paramount+. Launched in 2017, it is the seventh Star Trek series and was the first since Star Trek: Enterprise concluded in 2005. Episode 7 came out on October 29, 2017, followed by episode 8 on November 5, 2017. Episode 9 came out on November 12, 2017 and episode 10 came out on January 7, 2018.", "prediction 1": "Star Trek Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman. Episodes 1\u20137 of the original Star Trek: Discovery came out on September 19, 2017, at ArcLight Hollywood, before debuting on CBS and CBS All Access on September 24. Episodes 5-7 of the sequel Star Trek: Discovery came out on September 24, 2017.", "prediction 2": "Star Trek Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman. It is the first \"Star Trek\" series since 2005, and the first show to be developed specifically for that service. Episode 111 came out on September 20, 2017, which was the last episode of the first season. Episodes 118 and 109 came out on September 19, 2017, and 115 and 113 came out on September 24.", "prediction 3": "Star Trek Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman. It is the first \"Star Trek\" series since 2005, and the first show to be developed specifically for the CBS All Access on demand service. Episode 1 of Season 2 released on April 4, 2019. Episode 1 of Season 3 released on April 24, 2019. Episode 0 of Season 4 came out on April 4, 2019. Episode 1 of Season 5 came out on April 28, 2017. Episode 1 of Season 6 came out on April 13, 2019.", "prediction 4": "Star Trek: Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman. It is the first \"Star Trek\" series since 2005, and the first series developed specifically for that service. The new episode of Star Trek Discovery came out on September 19, 2017, at ArcLight Hollywood, before debuting on CBS and CBS All Access on September 24. The new episode of Star Trek: Discovery was released on October 25, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 115, "end": 143 }, { "error type": "Unverifiable", "explanation": "", "start": 279, "end": 358 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Star Trek Discovery is an American television series created for CBS All Access by Bryan Fuller and Alex Kurtzman. It is the first series developed specifically for that service, and the first \"Star Trek\" series since \"\" concluded in 2005. Star Trek: Discovery came out on September 19, 2017, at ArcLight Hollywood, before debuting on CBS and CBS All Access on September 24. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who invented the steam engine in the 1800s?", "passages": [ [ "Steam locomotive", "The authenticity and date of this locomotive is disputed by some experts and a workable steam train would have to await the invention of the high-pressure steam engine by Richard Trevithick, who pioneered the use of steam locomotives.", "The first full-scale working railway steam locomotive, was the gauge \"Coalbrookdale Locomotive\", built by Trevithick in 1802.", "It was constructed for the Coalbrookdale ironworks in Shropshire in the United Kingdom though no record of it working there has survived.", "On 21 February 1804, the first recorded steam-hauled railway journey took place as another of Trevithick's locomotives hauled a train along the tramway from the Pen-y-darren ironworks, near Merthyr Tydfil, to Abercynon in South Wales.", "Accompanied by Andrew Vivian, it ran with mixed success.", "The design incorporated a number of important innovations that included using high-pressure steam which reduced the weight of the engine and increased its efficiency.", "Trevithick visited the Newcastle area in 1804 and had a ready audience of colliery (coal mine) owners and engineers.", "The visit was so successful that the colliery railways in north-east England became the leading centre for experimentation and development of the steam locomotive.", "Trevithick continued his own steam propulsion experiments through another trio of locomotives, concluding with the \"Catch Me Who Can\" in 1808." ], [ "Steam engine", "This enabled factories to be sited away from rivers, and accelerated the pace of the Industrial Revolution.", "The meaning of high pressure, together with an actual value above ambient, depends on the era in which the term was used.", "For early use of the term Van Reimsdijk refers to steam being at a sufficiently high pressure that it could be exhausted to atmosphere without reliance on a vacuum to enable it to perform useful work.", "Ewing states that Watt's condensing engines were known, at the time, as low pressure compared to high pressure, non-condensing engines of the same period.", "Watt's patent prevented others from making high pressure and compound engines.", "Shortly after Watt's patent expired in 1800, Richard Trevithick and, separately, Oliver Evans in 1801 introduced engines using high-pressure steam; Trevithick obtained his high-pressure engine patent in 1802, and Evans had made several working models before then.", "These were much more powerful for a given cylinder size than previous engines and could be made small enough for transport applications.", "Thereafter, technological developments and improvements in manufacturing techniques (partly brought about by the adoption of the steam engine as a power source) resulted in the design of more efficient engines that could be smaller, faster, or more powerful, depending on the intended application.", "The Cornish engine was developed by Trevithick and others in the 1810s." ], [ "Cornish engine", "Other characteristics include insulation of steam lines and the cylinder, and steam jacketing the cylinder, both of which had previously been used by Watt.", "Few Cornish engines remain in their original locations, the majority having been scrapped when their related industrial firm closed.", "The Cornish engine developed irregular power throughout the cycle, completely pausing at one point while having rapid motion on the down stroke, making it unsuitable for rotary motion and most industrial applications.", "The Cornish engine depended on the use of steam pressure above atmospheric pressure, as devised by Richard Trevithick in the 19th century.", "Trevithick's early \"puffer\" engines discharged steam into the atmosphere.", "This differed from the Watt steam engine, which moved the condensing steam from the cylinder to a condenser separate from the cylinder; hence Watt's engine depended on the creation of a vacuum when the steam was condensed.", "Trevithick's later engines (in the 1810s) combined the two principles, starting with high-pressure steam which was then passed to the other side of the piston, where it condensed and there it acted as a sub-atmospheric pressure engine.", "In a parallel development Arthur Woolf developed the compound steam engine, in which the steam expanded in two cylinders successively, each of which were at pressures above atmospheric." ] ], "gold": "In 1800, Richard Trevithick and, separately, Oliver Evans in 1801, introduced engines using high-pressure steam. Trevithick obtained his high-pressure engine patent in 1802, and Evans had made several working models before then. These were much more powerful for a given cylinder size than previous engines and could be made small enough for transport applications. On February 21, 1804, the world's first railway journey took place as Trevithick's unnamed steam locomotive hauled a train along the tramway from the Pen-y-darren ironworks, near Merthyr Tydfil to Abercynon in south Wales. The design incorporated a number of important innovations that included using high-pressure steam. This reduced the weight of the engine and increased its efficiency. Then, in the 1810s, the Cornish engine was developed by Trevithick and others. This was a compound cycle engine that used high-pressure steam expansively, then condensed the low-pressure steam, making it relatively efficient. The Cornish engine had irregular motion and torque though the cycle, limiting it mainly to pumping. Cornish engines were used in mines and for water supply until the late 19th century. In 1849, the Corliss steam engine was patented by American engineer George Henry Corliss of Providence, Rhode Island. This was a four-valve counter flow engine with separate steam admission and exhaust valves and automatic variable steam cutoff. In addition to using 30% less steam, it provided more uniform speed due to variable steam cut off. These features made it well suited to manufacturing, especially cotton spinning.", "prediction 1": "The steam engine was invented in the 1800s by Richard Trevithick, Oliver Evans, and Thomas Watt. Richard Trevithick's steam engine was first described by Thomas Watt in 1797, and his steam engine was first described by Thomas Trevithick in 1804. John Trevithick developed his first working steam locomotive, the Coalbrookdale Locomotive, built by Richard Trevithick in 1802.", "prediction 2": "The steam engine was invented in the 1800s by Richard Trevithick. In the 1810s Trevithick combined the two principles, starting with high-pressure steam which was then passed to the other side of the piston, where it condensed and there it acted as a sub-atmospheric pressure engine. In the 1820s, Arthur Woolf developed the compound steam engine.", "prediction 3": "Richard Trevithick and Oliver Evans introduced engines using high-pressure steam. Shortly after Watt's patent expired in 1800, Richard Trevithick and, separately, Oliver Evans in 1801 introduced engines using high-pressure steam. Trevithick obtained his high-pressure engine patent in 1802, and Evans had made several working models before then. The Cornish engine was developed by Trevithick and others in the 1810s. In a parallel development Arthur Woolf developed the compound steam engine.", "prediction 4": "Richard Trevithick and Oliver Evans invented the high-pressure steam engine in 1802, and the Cornish engine was developed by Trevithick and others in the 1810s. The first full-scale working railway steam locomotive, was the gauge Coalbrookdale Locomotive, built by Trevithick in 1802. The Cornish engine was developed by Trevithick and others in the 1810s, and relied on the use of steam pressure above atmospheric pressure, as devised by Trevithick and others in the 19th century. The Cornish engine was developed by Trevithick and others in the 1810s. The Cornish engine depended on the use of steam pressure above atmospheric pressure, as devised by Arthur Woolf developed the compound steam engine, in which the steam expanded in two cylinders successively.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 80, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 174 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 206, "end": 245 }, { "error type": "Redundant", "explanation": "The steam engine was invented in the 1800s by Richard Trevithick, Oliver Evans, and Thomas Watt. ", "start": 246, "end": 374 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The steam engine was invented in the 1800s by Richard Trevithick, who obtained his high-pressure engine patent in 1802 and separately Oliver Evans, who had made several working models before then in 1801. These were much more powerful for a given cylinder size than previous engines and could be made small enough for transport applications. and Richard Trevithick's steam engine hauled a train along the tramway from the Pen-y-darren ironworks, near Merthyr Tydfil, to Abercynon in South Wales, it what was the first recorded steam-hauled railway journey On 21 February 1804. The design incorporated a number of important innovations that included using high-pressure steam which reduced the weight of the engine and increased its efficiency. The Cornish engine was developed by Trevithick and others in the 1810s, while in a parallel development Arthur Woolf developed the compound steam engine." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who won the ramon magsaysay award this year from india?", "passages": [ [ "Kulandei Francis", "Kulandei Francis\n\nKulandei Francis (born 1946) is an activist, social worker, and the founder of the NGO Integrated Village Development Project in Tamil Nadu, India.", "He was one of six recipients of the Magsaysay Award in 2012 for \"his profound faith in community energies, and his sustained programs in pursuing the holistic economic empowerment of thousands of women and their families in rural India\".", "Francis was born to Kulandei and Mathalai Mary in the Karipatti village of Salem district of Tamil Nadu.", "His parents were agricultural labourers and the family was extremely poor.", "He was the only one of his siblings to obtain a university degree.", "His experiences of childhood poverty, especially an incident in which the local money lender cheated his mother out of the family's sole plot of land, were catalytic in his decision to take up social work as a vocation.", "He completed his B.Com from the Annamalai University in Chidambaram and in 1970 joined the Fathers of the Holy Cross and studied theology at the De Nobili College in Pune.", "During the course of that decade, he was involved with Caritas India and volunteered as an aid worker during the Bangladesh War of 1971 and the Pune drought of 1972." ], [ "Sanjiv Chaturvedi", "In response to RTI Application of Chaturvedi, regarding action taken on his complaint to President against CVC, Department of Personnel and Training (DoP&T) of Central Government which is administrative department of CVC, intimated that at present there are no guidelines to deal with complaints against CVC and the same is being framed and complaint would be processed once guidelines are framed.", "This response of Central Government assumed significance in view of controversy related to CBI Director and his investigation by CVC.", "Sanjiv Chaturvedi was awarded effectively zero grading in his Annual Performance Report (APAR) in the financial year 2015-16 by Mr. J.P Nadda, Union Health Minister and his sub-ordinate officers, in the same year in which Chaturvedi was conferred prestigious Ramon Magsaysay Award.", "It was reported in media that all his previous Appraisal Reports were Outstanding and even Union Health Secretary had appreciated his performance as Exemplary in year 2014.", "Prior to that, Central Government had already withdrawn all works from him, against which the officer had moved to Supreme Court, which had issued notices to Central Government in September 2016, admitting his appeal.", "In march 2017, Intelligence Bureau in its report termed Chaturvedi as a 'diligent officer'." ], [ "T. M. Krishna", "Among his awards are the prestigious Ramon Magsaysay Award (2016) in recognition of \u2018his forceful commitment as artist and advocate to art\u2019s power to heal India\u2019s deep social divisions\u2019, the Indira Gandhi Award for National Integration (2017) for his services in promoting and preserving national integration in the country, and the Professor V. Aravindakshan Memorial Award (2017) for connecting Carnatic music with the common man.", "Krishna also frequently writes on topics ranging from music (including its practice, musicians, history and future) to society, culture, politics and religion.", "His articles have been published across most leading Indian newspapers and magazines such as The Indian Express, The Hindu, The Hindustan Times, Outlook, India Today, and Open, as well as several online portals such as Scroll, The Wire, DailyO, and Firstpost.", "Krishna has also delivered lectures at a variety of institutions, including leading universities across the world.", "Noteworthy among these lectures are:\n\nChennai Poromboke Paadal\n\nThe Chennai Poromboke Paadal music video was released on 14 January 2017 on YouTube.", "An initiative by T.M.Krishna and environmental activist Nityanand Jayaraman - the Tamil song was written by Kaber Vasuki and composed by R. K. Shriramkumar, and the video was directed by Rathindran Prasad." ] ], "gold": "Kulandei Francis received the Magsaysay Award in 2012 for \"his profound faith in community energies, and his sustained programs in pursuing the holistic economic empowerment of thousands of women and their families in rural India\". Anshu Gupta and Sanjiv Chaturvedi won the award in 2015, the latter for leadership. Thodur Madabusi Krishna and Bezwada Wilson won the award in 2016.", "prediction 1": "Ramon Magsaysay Award, or RAMon, is an international award presented by the Royal Society of Arts and Humanities. It is awarded to an individual in recognition of their contribution to the arts, particularly music. In 2016, Akshay Kumar was awarded the award for his work in the field of music. In 2017, Sanjiv Chaturvedi received the award for his services to promoting and preserving national integration in the country. In 2018, T. M. Krishna won the award for his work in the field of culture.", "prediction 2": "The Ramon Magsaysay Award is given to an individual from India annually. In 2016, actor Sanjiv Chaturvedi won the award for his efforts in promoting peace and justice through art, while musician T.M. Krishna won it in 2017.", "prediction 3": "There are several individuals who were awarded the Ramon Magsaysay Award in India. In 2017, the award went to Sanjiv Chaturvedi as he was awarded effectively zero grading in his Annual Performance Report (APAR) in the financial year 2015-16 by Mr. J.P Nadda, Union Health Minister and his sub-ordinate officers, in the same year in which Chaturvedi was conferred the award.", "prediction 4": "In 2016, Sanjiv Chaturvedi received the prestigious Ramon Magsaysay award in recognition of his forceful commitment as artist and advocate to art's power to heal India's deep social divisions. In 2017, T.M. Krishna won the prestigious award in recognition of his connection between Carnatic music and the common man.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 113 }, { "error type": "Unverifiable", "explanation": "", "start": 114, "end": 214 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 224, "end": 236 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 275, "end": 294 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 426, "end": 431 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 480, "end": 497 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 341, "end": 422 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 298, "end": 303 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In 2016, T. M. Krishna was awarded the award for \u2018his forceful commitment as artist and advocate to art\u2019s power to heal India\u2019s deep social divisions\u2019. In 2015, Sanjiv Chaturvedi received the award. Kulandei Francis was one of six recipients of the Magsaysay Award in 2012 for \"his profound faith in community energies, and his sustained programs in pursuing the holistic economic empowerment of thousands of women and their families in rural India\"" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the original movie the thing made?", "passages": [ [ "The Thing (1982 film)", "Filming lasted roughly 12 weeks, beginning in August 1981, and took place on refrigerated sets in Los Angeles as well as in Juneau, Alaska, and Stewart, British Columbia.", "Of the film's $15 million budget, $1.5 million was spent on Rob Bottin's creature effects, a mixture of chemicals, food products, rubber, and mechanical parts turned by his large team into an alien capable of taking on any form.", "\"The Thing\" was released in 1982 to very negative reviews.", "It was described as \"instant junk\", \"a wretched excess\", and proposed as the most hated film of all time.", "Reviews both praised the special effects achievements and criticized their visual repulsiveness, while others focused on poor characterization.", "The film earned $19.6 million during its theatrical run.", "Many reasons have been cited for its failure to impress audiences: competition from films such as \"E.T. the Extra-Terrestrial\", which offered an optimistic take on alien visitation; a summer that had been filled with successful science fiction and fantasy films; and an audience, living through a recession, diametrically opposed to \"The Thing\"s nihilistic tone.", "The film found an audience when released on home video and television." ], [ "The Thing from Another World", "The Thing from Another World\n\nThe Thing from Another World, sometimes referred to as The Thing, is a 1951 American black-and-white science fiction-horror film, directed by Christian Nyby, produced by Edward Lasker for Howard Hawks' Winchester Pictures Corporation, and released by RKO Pictures.", "The film stars Margaret Sheridan, Kenneth Tobey, Robert Cornthwaite, and Douglas Spencer.", "James Arness plays The Thing, but he is difficult to recognize in costume and makeup due to both low lighting and other effects used to obscure his features.", "The film is based on the 1938 novella \"Who Goes There?\"", "by John W. Campbell (writing under the pseudonym of Don A. Stuart).", "The storyline concerns a U.S. Air Force crew and scientists who find a crashed flying saucer and a humanoid body frozen nearby in the Arctic ice.", "Returning to their remote research outpost with the body in a block of ice, they are forced to defend themselves against this malevolent, plant-based alien when it is accidentally revived.", "A United States Air Force crew is dispatched from Anchorage, Alaska at the request of Dr. Carrington (Robert Cornthwaite), the chief scientist of a North Pole scientific outpost.", "They have evidence that an unknown flying craft has crashed in their vicinity, so reporter Ned Scott (Douglas Spencer) tags along for the story." ], [ "The Thing (1982 film)", "The Thing (1982 film)\n\n", "The Thing is a 1982 American science fiction horror film directed by John Carpenter and written by Bill Lancaster.", "Based on the 1938 John W. Campbell Jr. novella \"Who Goes There?", "\", it tells the story of a group of American researchers in Antarctica who encounter the eponymous \"Thing\", a parasitic extraterrestrial life-form that assimilates, then imitates other organisms.", "The group is overcome by paranoia and conflict as they learn that they can no longer trust each other and that any one of them could be the Thing.", "The film stars Kurt Russell as the team's helicopter pilot, R.J. MacReady, and features A. Wilford Brimley, T. K. Carter, David Clennon, Keith David, Richard Dysart, Charles Hallahan, Peter Maloney, Richard Masur, Donald Moffat, Joel Polis, and Thomas Waites in supporting roles.", "Production began in the mid-1970s as a faithful adaptation of the novella, following 1951's popular \"The Thing from Another World\".", "\"The Thing\" went through several directors and writers, each with different ideas on how to approach the story." ] ], "gold": "There are several movies with the title, \"The Thing\". The Thing from Another World, sometimes referred to as just The Thing, is a 1951 American black-and-white science fiction-horror film, directed by Christian Nyby, produced by Edward Lasker for Howard Hawks' Winchester Pictures Corporation, and released by RKO Pictures. It was released on April 27, 1951. The Thing is also a 1982 American science fiction horror film directed by John Carpenter and written by Bill Lancaster. Production began in the mid-1970s as a faithful adaptation of the novella, following 1951's The Thing from Another World. Filming lasted roughly 12 weeks, beginning on August 24, 1981, and took place on refrigerated sets in Los Angeles as well as in Juneau, Alaska, and Stewart, British Columbia. The Thing was released in the United States on June 25, 1982.", "prediction 1": "The Thing from Another World, sometimes referred to as The Thing, is a 1951 American black-and-white science fiction-horror film, produced by Edward Lasker for Howard Hawks' Winchester Pictures Corporation, and released by RKO Pictures. Filming lasted roughly 12 weeks, beginning in August 1981, and took place on refrigerated sets in Los Angeles as well as in Juneau, Alaska, and Stewart, British Columbia. The Thing is a 1982 American science fiction horror film directed by John Carpenter and written by Bill Lancaster.", "prediction 2": "The Thing from Another World, sometimes referred to as The Thing, is a 1951 American black-and-white science fiction horror film, directed by Christian Nyby, produced by Edward Lasker for Howard Hawks' Winchester Pictures Corporation, and released by RKO Pictures. The Thing from Another World is a faithful adaptation of the 1938 John W. Campbell Jr. novella, \"Who Goes There?\" and tells the story of a group of American researchers in Antarctica who encounter the eponymous \"Thing\", a parasitic extraterrestrial life-form that assimilates other organisms and imitates them. The Thing from Another World was a faithful adaptation of the novella, following the 1951's popular \"The Thing from Another World\". The Thing from Another World was released in September 1, 1982, while the 1982 film released on September 29, 1982.", "prediction 3": "The 1951 black-and-white science fiction horror film, The Thing from Another World, often referred to as The Thing, is a faithful adaptation of the 1938 novella Who Goes There? by John W. Campbell Jr. Filming began in the mid-1970s as a faithful adaptation of the novella, following 1951's popular The Thing from Another World. The Thing from Another World was released in the US on March 31, 1951. The 1982 American science fiction horror film, The Thing, was released on August 28, 1981.", "prediction 4": "The Thing from Another World is a 1951 American black-and-white science fiction-horror film, based on the 1938 novella \"Who Goes There?\" by John W. Campbell Jr. Filming began in the mid-1970s as a faithful adaptation of the novella, following 1951's popular \"The Thing from Another World\". The Thing from Another World was released in Japan on October 7, 1951. The Thing from Another World 2 was released in Japan on October 3, 1951.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Thing from Another World, sometimes referred to as The Thing, is a 1951 American black-and-white science fiction-horror film, directed by Christian Nyby, produced by Edward Lasker for Howard Hawks' Winchester Pictures Corporation, and released by RKO Pictures. The Thing is a 1982 American science fiction horror film directed by John Carpenter and written by Bill Lancaster. Production began in the mid-1970s as a faithful adaptation of the novella, following 1951's popular \"The Thing from Another World\". Filming lasted roughly 12 weeks, beginning in August 1981, and took place on refrigerated sets in Los Angeles as well as in Juneau, Alaska, and Stewart, British Columbia. The Thing\" was released in 1982. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sang the theme song to petticoat junction?", "passages": [ [ "Petticoat Junction", "Only those that debuted on \"Acres\" before \"Junction\" are counted.", "Curt Massey sang the \"Petticoat Junction\" theme song.", "The song was composed by Massey and Paul Henning.", "Flatt and Scruggs recorded a version of the song \"Petticoat Junction\".", "After its cancellation, Filmways and Paul Henning's company sold the show to CBS.", "Its distribution has changed hands over the years due to corporate changes involving Viacom, which in 2006 split into two separate companies.", "Today, CBS Television Distribution handles syndication.", "The color (1965\u201370) episodes were shown in syndication for many years after the show's cancellation.", "However, the rights to the black-and-white (1963\u201365) episodes were not resolved, and they were not included in the syndication package until the Me-TV Network began broadcasting the black-and-white (1963\u201365) episodes on Tuesday, July 12, 2011.", "The airings of the black-and-white episodes airings were short lived, and on Thursday, July 21, 2011, Me-TV started airing the color episodes once again.", "Me-TV began to air the first two black-and-white seasons of the show again on November 4, 2013.", "The show has rotated on and off of the Me-TV schedule in various time slots." ], [ "Petticoat Junction", "Petticoat Junction\n\nPetticoat Junction is an American sitcom that originally aired on CBS from September 1963 to April 1970.", "The series takes place at the Shady Rest Hotel, which is run by Kate Bradley, her three daughters Billie Jo, Bobbie Jo, and Betty Jo, and her uncle Joe Carson.", "The series is one of three interrelated shows about rural characters produced by Paul Henning.", "\"Petticoat Junction\" was created upon the success of Henning's previous rural/urban-themed sitcom \"The Beverly Hillbillies\" (1962\u20131971).", "The success of \"Petticoat Junction\" led to a spin-off, \"Green Acres\" (1965\u20131971).", "\"Petticoat Junction\" was produced by Wayfilms (a joint venture of Filmways Television and Pen-Ten Productions).", "The show centers on the goings-on at the rural Shady Rest Hotel.", "Widowed Kate Bradley (Bea Benaderet) is the proprietor." ], [ "Petticoat Junction", "\"Cannonball Christmas\" was released by MPI Home Video in a separate release together with the Christmas-themed episode from \"The Beverly Hillbillies\" on October 25, 2005.", "This 1963 episode was reshot in color with small variations and aired on December 20, 1966 as \"The Santa Claus Special\".", "On December 16, 2008 CBS Home Entertainment (distributed by Paramount) released the Complete First Season on DVD, with new interviews with cast members, commercials from the original broadcasts, and the original opening and closing theme song.", "The Complete Second Season was released on July 7, 2009, concluding the black-and-white episodes of the series.", "(Beginning with the third season, the show switched to color for the remainder of the series.)", "It, too, contained the original theme song, as well as introductions and an interview from two cast members.", "On October 1, 2013 season three was released on DVD as a Walmart exclusive.", "It received a full retail release on April 15, 2014.", "The rights to the show are held by CBS Television Distribution.", "There was an amusement park in Panama City Beach, Florida named \"Petticoat Junction Amusement Park\", which opened in 1963 (the same year that the show first aired) and closed in 1984, 14 years after the show ended." ] ], "gold": "Petticoat Junction is an American sitcom that originally aired on CBS from September 1963 to April 1970. Curt Massey sang the \"Petticoat Junction\" theme song. The song was composed by Massey and Paul Henning. Flatt and Scruggs recorded a version of the song \"Petticoat Junction\". The DVD release of the series by Brentwood Home Video replaced Massey's music with John Hickman's \"Banjo Signal\". The DVD release of the series by TGG Direct, Inc. replaces Massey's music with Frank Hutchison's \"Train That Carried the Girl From Town.\"", "prediction 1": "Curt Massey sang the theme song to Petticoat Junction. The song was composed by Massey and Paul Henning. Flatt and Scruggs recorded a version of the song Petticoat Junction. After its cancellation, Filmways and Paul Henning's company sold the show to CBS. The rights to the black-and-white (1963\u201365) episodes were not resolved, and they were not included in the syndication package until the Me-TV Network began broadcasting the black-and-white (1963\u20131971).", "prediction 2": "Petticoat Junction is an American sitcom that originally aired on CBS from September 1963 to April 1970. The song was composed by Massey and Paul Henning. Flatt and Scruggs recorded a version of the song Petticoat Junction. Curt Massey sang the \"Petticoat Junction\" theme song.", "prediction 3": "Curt Massey sang the theme song to Petticoat Junction. Massey and Paul Henning wrote the song. Flatt and Scruggs also recorded a version of the song.", "prediction 4": "The show Petticoat Junction was originally aired on CBS from September 1963 to April 1970. Curt Massey sang the show's theme song. Flatt and Scruggs recorded a version of the song Petticoat Junction.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 457 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Petticoat Junction is an American sitcom that originally aired on CBS from September 1963 to April 1970. Curt Massey sang the theme song to Petticoat Junction. The song was composed by Massey and Paul Henning. Flatt and Scruggs recorded a version of the song Petticoat Junction. On December 16, 2008 CBS Home Entertainment released the Complete First Season on DVD." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did you find the red pandas in india?", "passages": [ [ "Red panda", "The red panda is endemic to the temperate forests of the Himalayas, and ranges from the foothills of western Nepal to China in the east.", "Its easternmost limit is the Qinling Mountains of the Shaanxi Province in China.", "Its range includes southern Tibet, Sikkim and Assam in India, Bhutan, the northern mountains of Burma, and in south-western China, in the Hengduan Mountains of Sichuan and the Gongshan Mountains in Yunnan.", "It may also live in south-west Tibet and northern Arunachal Pradesh, but this has not been documented.", "Locations with the highest density of red pandas include an area in the Himalayas that has been proposed as having been a refuge for a variety of endemic species in the Pleistocene.", "The distribution range of the red panda should be considered disjunct, rather than continuous.", "A disjunct population inhabits the Meghalaya Plateau of north-eastern India.", "During a survey in the 1970s, signs of red pandas were found in Nepal's Dhorpatan Hunting Reserve.", "Their presence was confirmed in spring 2007 when four red pandas were sighted at elevations ranging from .", "The species' westernmost limit is in Rara National Park located farther west of the Dhorpatan Hunting Reserve.", "Their presence was confirmed in 2008.", "The red panda lives between altitude, inhabiting areas of moderate temperature between with little annual change." ] ], "gold": "In India, the red panda's ranges are from southern Tibet, Sikkim and Assam, with a disjunct population that inhabits the Meghalaya Plateau of north-eastern India.", "prediction 1": "The red panda is endemic to the temperate forests of the Himalayas, and ranges from the foothills of western Nepal to China in the east. Its range includes southern Tibet, Sikkim and Assam in India, Bhutan, the northern mountains of Burma, and in south-western China, in the Hengduan Mountains of Sichuan and the Gongshan Mountains in Yunnan. During a survey in the 1970s, signs of red pandas were found in Nepal's Dhorpatan Hunting Reserve. Their presence was confirmed in spring 2007 when four red pandas were sighted at elevations ranging from.\n", "prediction 2": "During a survey in the 1970s, signs of red pandas were found in Nepal's Dhorpatan Hunting Reserve. Their presence was confirmed in spring 2007 when four red pandas were sighted at elevations ranging from 6,000 to 14,500 feet.", "prediction 3": "Red pandas are found in India in vague numbers. During a survey in the 1970s, signs of red pandas were found in Nepal's Dhorpatan Hunting Reserve. Their presence was confirmed in spring 2007 when four red pandas were sighted at elevations ranging from 0400 m to 2,850 m.", "prediction 4": "When people search for red pandas they find many different ones. In India, the red panda is endemic to the temperate forests of the Himalayas, and ranges from the foothills of western Nepal to China in the east. Their range includes southern Tibet, Sikkim and Assam in India, Bhutan, the northern mountains of Burma, and in south-western China, in the Hengduan Mountains of Sichuan and the Gongshan Mountains in Yunnan and in north-ea.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 441 }, { "error type": "Irrelevant", "explanation": "", "start": 442, "end": 548 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": " Its range includes southern Tibet, Sikkim and Assam in India, with a disjunct population inhabits the Meghalaya Plateau of north-eastern India.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the popular vote for president begin?", "passages": [ [ "United States presidential elections in which the winner lost the popular vote", "United States presidential elections in which the winner lost the popular vote\n\nThere have been five United States presidential elections in which the winner lost the popular vote including the 1824 election, which was the first U.S. presidential election where the popular vote was recorded.", "Losing the popular vote means securing less of the national popular vote than the person who received either a majority or a plurality of the vote.", "In the U.S. presidential election system, instead of the nationwide popular vote determining the outcome of the election, the President of the United States is determined by votes cast by electors of the Electoral College.", "Alternatively, if no candidate receives an absolute majority of electoral votes, the election is determined by the House of Representatives.", "These procedures are governed by the Twelfth Amendment to the United States Constitution.", "When individuals cast ballots in the general election, they are choosing electors and telling them whom they should vote for in the Electoral College.", "The \"national popular vote\" is the sum of all the votes cast in the general election, nationwide.", "The presidential elections of 1876, 1888, 2000, and 2016 produced an Electoral College winner who did not receive the most votes in the general election.", "In 1824, there were six states in which electors were legislatively appointed, rather than popularly elected, so the true national popular vote is uncertain." ] ], "gold": "During the 1824 election the popular vote began being tracked, with a few states participating. The 1864 election was the first where all states reported the popular vote.", "prediction 1": "In the U.S. presidential election system, instead of the nationwide popular vote determining the outcome of the election, the President of the United States is determined by votes cast by electors of the Electoral College. If no candidate receives an absolute majority of electoral votes, the election is determined by the House of Representatives. The popular vote for president in the United States began on January 1, 1824.", "prediction 2": "The popular vote for president in the United States began in 1824, when six states in which electors were legislatively appointed, rather than popularly elected, so the true national popular vote is uncertain.", "prediction 3": "The popular vote for president in the United States began in 1824, which was the first presidential election where the popular vote was recorded. Losing the popular vote means securing less of the national popular vote than the person who received either a majority or a plurality of the vote. The popular vote began to be recorded in the United States in 1886, and was officially first recorded in the 1824 election.", "prediction 4": "In the U.S. presidential election system, instead of the nationwide popular vote determining the outcome of the election, the President of the United States is determined by votes cast by electors of the Electoral College. Alternatively, if no candidate receives an absolute majority of electoral votes, the election is determined by the House of Representatives. The popular vote for president began in the 1824 election, which was the first U.S. presidential election where the popular vote was recorded.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 348 } ], "missing-info": [], "corrected-prediction": " The popular vote for president in the United States began on January 1, 1824." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was harry potter and the sorcerers stone book released?", "passages": [ [ "Harry Potter and the Philosopher's Stone", "Harry Potter and the Philosopher's Stone\n\nHarry Potter and the Philosopher's Stone is a fantasy novel written by British author J. K. Rowling.", "The first novel in the \"Harry Potter\" series and Rowling's debut novel, it follows Harry Potter, a young wizard who discovers his magical heritage on his eleventh birthday, when he receives a letter of acceptance to Hogwarts School of Witchcraft and Wizardry.", "Harry makes close friends and a few enemies during his first year at the school, and with the help of his friends, Harry faces an attempted comeback by the dark wizard Lord Voldemort, who killed Harry's parents, but failed to kill Harry when he was just 15 months old.", "The book was first published in the United Kingdom in 1997 by Bloomsbury.", "In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone.", "It won most of the British book awards that were judged by children and other awards in the US.", "The book reached the top of the \"New York Times\" list of best-selling fiction in August 1999 and stayed near the top of that list for much of 1999 and 2000.", "It has been translated into at least 73 other languages, and has been made into a feature-length film of the same name, as have all six of its sequels." ], [ "Harry Potter and the Philosopher's Stone", "They thought that a child would not want to read a book with the word \"philosopher\" in the title and, after some discussion, the American edition was published in September 1998 under the title Rowling suggested, \"Harry Potter and the Sorcerer's Stone\".", "Rowling later claimed that she regretted this change and would have fought it if she had been in a stronger position at the time.", "Philip Nel has pointed out that the change lost the connection with alchemy, and the meaning of some other terms changed in translation, for example from \"crumpet\" to \"muffin\".", "While Rowling accepted the change from both the British English \"mum\" and Seamus Finnigan's Irish variant \"mam\" to \"mom\" in \"Harry Potter and the Sorcerer's Stone\", she vetoed this change in the later books, which was then reversed in later editions of \"Philosopher's Stone\".", "However, Nel considered that Scholastic's translations were considerably more sensitive than most of those imposed on British English books of the time, and that some other changes could be regarded as useful copyedits.", "Since the British editions of early titles in the series were published months prior to the American versions, some American readers became familiar with the British English versions due to buying them from online retailers." ] ], "gold": "The fantasy novel \"Harry Potter and the Philosopher's Stone\" was first published in the United Kingdom on June 26, 1997 by Bloomsbury. In the United States, it was published under the title \"Harry Potter and the Sorcerer's Stone\" on September 1, 1998 by Scholastic.", "prediction 1": "Harry Potter and the Philosopher's Stone is a fantasy novel written by British author J. K. Rowling. The book was first published in the United Kingdom in 1997 by Bloomsbury. In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone. The book reached the top of the \"New York Times\" list of best-selling fiction in August 1999 and stayed near the top of that list for much of 1999 and 2000. It has been translated into at least 73 other languages, and has been made into a feature-length film of the same name, as have all six of its sequels.", "prediction 2": "Harry Potter and the Philosopher's Stone is a fantasy novel written by British author J. K. Rowling. It follows Harry Potter, a young wizard who discovers his magical heritage on his eleventh birthday, when he receives a letter of acceptance to Hogwarts School of Witchcraft and Wizardry. In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone. It won most of the British book awards that were judged by children and other awards in the US.", "prediction 3": "Harry Potter and the Philosopher's Stone is a fantasy novel written by British author J. K. Rowling. The book was first published in the United Kingdom in 1997 by Bloomsbury. In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone. It won most of the British book awards that were judged by children and other awards in the US. The book reached the top of the New York Times list of best-selling fiction in August 1999 and stayed near the top of that list for much of 1999 and 2000. It has been translated into at least 73 other languages, and has been made into a feature-length film of the same name, as have all six of its sequels.", "prediction 4": "The first Harry Potter novel, the first in the Harry Potter series and J. K. Rowling's debut novel, was published in the United Kingdom in 1997 by Bloomsbury. In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone. It won most of the British book awards that were judged by children and other awards in the US.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 459 }, { "error type": "Irrelevant", "explanation": "", "start": 460, "end": 611 }, { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 100 } ], "missing-info": [], "corrected-prediction": "Harry Potter and the Philosopher's Stone is a fantasy novel. The book was first published in the United Kingdom in 1997 by Bloomsbury. In 1998, it was published in the United States by Scholastic Corporation under the title Harry Potter and the Sorcerer's Stone. " }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Who is the guy who plays jeepers creepers?", "passages": [ [ "Jeepers Creepers (2001 film)", "Jeepers Creepers (2001 film)\n\nJeepers Creepers is a 2001 American-German horror film written and directed by Victor Salva.", "The film takes its name from the 1938 song \"Jeepers Creepers\", which is featured in the film.", "Francis Ford Coppola executive produced, and the film stars Gina Philips, Justin Long, Jonathan Breck, and Eileen Brennan.", "Philips and Long play two older siblings who become the targets of a demonic creature (Breck) in rural Florida.", "Trish Jenner (Philips) and her brother Darry (Long) are traveling home from college for spring break.", "As they drive through the Florida countryside, an old rusty truck (a 1941 Chevrolet COE) drives around them erratically.", "The vehicle eventually passes them.", "They later see the same truck parked next to an abandoned church with a man sliding what appears to be bodies wrapped in blood-stained sheets into a large pipe sticking out of the ground.", "The man notices Trish and Darry watching him and attempts to run them off the road.", "After escaping, Darry convinces Trish to go back to the church and investigate.", "At the church, Darry hears noises coming from within the pipe and crawls inside with Trish holding on to his feet, but ends up falling in." ], [ "Jeepers Creepers 3", "Jeepers Creepers 3\n\nJeepers Creepers 3 is a 2017 American horror film written and directed by Victor Salva and the third \"Jeepers Creepers\" film, taking place in between \"Jeepers Creepers\" and \"Jeepers Creepers 2.\"", "Jonathan Breck reprises his role as the Creeper.", "Gina Philips returns in a cameo as Trish Jenner, her first return to the series since the original film.", "The film was shown in theaters on September 26, 2017 in what was originally announced as a one-night-only showing and was then shown again on October 4, 2017.", "A shuriken flies through the air and hits a wooden post as a man runs for his life.", "When the man reaches the road, the Creeper drops from the sky and flies off with him, while Kenny Brandon watches from his truck.", "When he gets out to investigate, he looks up in the air and sees a machete fall from the sky, followed by a severed hand.", "23 years later, shortly after the events of the first film, the police discover the Creeper's truck filled with dead bodies.", "The truck has been rigged with several booby-traps, including spikes that emerge from the bed of the truck, and a spear that shoots out from the tail-pipe." ], [ "Jonathan Breck", "Jonathan Breck\n\nJonathan Raymond Breck (born February 17, 1965) is an American actor.", "Beginning his career as a stage actor, Breck is most successful for his role as the demonic antagonist, the Creeper, in Victor Salva's horror film \"Jeepers Creepers\".", "He has also appeared in numerous film and television productions including \"Beat Boys, Beat Girls\", \"Good Advice\", \"Spiders\", \"I Married a Monster\", \"JAG\", \"\", \"V.I.P. \", and \"Push\"." ] ], "gold": "American actor Jonathan Raymond Breck is best known for his role as the Creeper in the original Jeepers Creepers trilogy from Victor Salva, in which he portrayed the character in Jeepers Creepers, Jeepers Creepers 2, and Jeepers Creepers 3. Born February 17, 1965, Breck began his career as a stage actor, but has also appeared in numerous other film and television productions including Beat Boys, Beat Girls, Good Advice, Spiders, I Married a Monster, JAG, Star Trek: Voyager, V.I.P., and Push.", "prediction 1": "Jeepers Creepers is a 2001 American horror film written and directed by Victor Salva. The film takes its name from the 1938 song Jeepers Creepers, which is featured in the film. In the 2017 American horror film Jeepers Creepers 3 Jonathan Breck reprises his role as the Creeper. Gina Philips returns in a cameo as Trish Jenner, her first return to the series since the original film.", "prediction 2": "Jeepers Creepers is a horror film series that started with the 2001 film, Jeepers Creepers. The film takes its name from the 1938 song Jeepers Creepers, which is featured in the film. Jonathan Breck plays the Creeper in the 2017 film Jeepers Creepers 3.", "prediction 3": "Jeepers Creepers is a 2001 American horror film written and directed by Victor Salva, taking its name from the 1938 song Jeepers Creepers, which is featured in the film. The film takes its name from the 1938 song Jeepers Creepers, which is featured in the film. Jonathan Breck reprises his role as the Creeper in the 2017 remake of the 2001 film.", "prediction 4": "Jonathan Breck reprises his role as the Creeper in Jeepers Creepers 2 and Jeepers Creepers 3. Gina Philips returns in a cameo as Trish Jenner in Jeepers Creepers 2 and Jonathan Breck reprises his role as the Creeper in Jeepers Creepers 3.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 383 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 17, "end": 68 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "American actor Jonathan Raymond Breck is best known for his role as the Creeper in the original Jeepers Creepers by Victor Salva. In the 2017 American horror film Jeepers Creepers 3 Jonathan Breck reprises his role as the Creeper. Born February 17, 1965, Breck began his career as a stage actor, but has also appeared in numerous other film and television productions including Beat Boys, Beat Girls, Good Advice, Spiders, I Married a Monster, JAG, Star Trek: Voyager, V.I.P., and Push." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Girl who played christine in phantom of the opera?", "passages": [ [ "The Phantom of the Opera (1986 musical)", "The cast included Ramin Karimloo as the Phantom, Sierra Boggess as Christine, Hadley Fraser as Raoul, Wynne Evans as Piangi, Wendy Ferguson as Carlotta, Barry James as Monsieur Firmin, Gareth Snook as Monsieur Andre, Liz Robertson as Madame Giry, and Daisy Maywood as Meg Giry.", "Lloyd Webber and several original cast members, including Crawford and Brightman, were in attendance.", "A DVD and Blu-ray of the performance was released in February 2012, and it began airing in March 2012 on PBS's \"Great Performances\" television series.", "In March 2012, a new production directed by Laurence Connor began a UK and Ireland tour to commemorate the 25th anniversary of the show, beginning at the Theatre Royal Plymouth and travelled to Manchester, Bristol, Dublin, Leeds, Edinburgh, Milton Keynes, Cardiff, and Southampton.", "John Owen-Jones and Earl Carpenter alternated as the Phantom with Katie Hall and Olivia Brereton as Christine and Simon Bailey as Raoul.", "\"Phantom\" began Broadway previews at the Majestic Theatre on 9 January 1988 and opened on 26 January.", "Crawford, Brightman, and Barton reprised their respective roles from the West End.", "The production continues to play at the Majestic, where it became the first Broadway musical in history to surpass 10,000 performances on 11 February 2012." ], [ "The Phantom of the Opera (2004 film)", "The Phantom of the Opera (2004 film)\n\nThe Phantom of the Opera is a 2004 British\u2013American musical drama film based on Andrew Lloyd Webber's 1986 musical of the same name, which in turn is based on the French novel \"Le Fant\u00f4me de l'Op\u00e9ra\" by Gaston Leroux.", "Produced and co-written by Lloyd Webber and directed by Joel Schumacher, it stars Gerard Butler in the title role, Emmy Rossum, Patrick Wilson, Miranda Richardson, Minnie Driver and Jennifer Ellison.", "The film was announced in 1989 but production did not start until 2002 due to Lloyd Webber's divorce and Schumacher's busy career.", "It was shot entirely at Pinewood Studios, with scenery created with miniatures and computer graphics.", "Rossum, Wilson and Driver had singing experience, but Butler had none and so had music lessons.", "\"The Phantom of the Opera\" grossed $154.6\u00a0million worldwide and received mixed to negative reviews from critics, but was very well received by audiences.", "Critics praised the visuals and acting (particularly Rossum's performance) but criticized the writing and directing.", "In 1919, a public auction is held to clear an abandoned opera theatre's vaults in Paris.", "Viscount Raoul de Chagny, bids against the elderly Madame Giry for a papier-m\u00e2ch\u00e9 shaped like a barrel organ monkey." ], [ "Ramin Karimloo", "Karimloo's last regular performance in \"The Phantom of the Opera\" took place on November 7, 2009.", "He moved on to playing the Phantom in Andrew Lloyd Webber's sequel, \"Love Never Dies\", alongside Sierra Boggess, performing the role until the show closed on August 27, 2011.", "On October 3, 2010, Karimloo played the role of Enjolras in the 25th anniversary concert of \"Les Mis\u00e9rables\" at The O2 Arena in London.", "In 2011, he sang Andrew Lloyd Webber's \"Music of the Night\" from \"The Phantom of the Opera\" at the Miss World Competition, which took place in London.", "On October 1 and 2, 2011, he played the Phantom for three performances alongside \"Love Never Dies\" co-star Sierra Boggess as Christine Daa\u00e9 in the 25th anniversary production of \"The Phantom of the Opera at the Royal Albert Hall\", which was streamed live to cinemas worldwide.", "From November 29, 2011 to March 31, 2012, Karimloo returned to \"Les Mis\u00e9rables\" to play the lead role of Jean Valjean at The Queen's Theatre, London, for which he won the 2013 Theatregoers' Choice Award for Best Takeover in a Role." ] ], "gold": "The Phantom of the Opera is a musical with music by Andrew Lloyd Webber based on the 1910 eponymous French novel by Gaston Leroux. In 2004, Emmy Rossum played Christine in Phantom of the Opera, the film version of Lloyd Weber's musical. In 2006, Sierra Boggess first played Christine in Phantom \u2013 The Las Vegas Spectacular. In 2010 she originated the role in Lloyd Webber's sequel, Love Never Dies. She next played Christine in the 25th Anniversary concert, The Phantom of the Opera at the Royal Albert Hall, in 2011. Sarah Brightman and Patti Cohenour debuted in the role of Christine in the original West End and Broadway productions of Andrew Lloyd Webber's 1986 musical, while Meghan Picerno currently plays Christine in The Phantom of the Opera on Broadway. Dale Kristien and Mary D'Arcy played Christine in the original U.S. Tour production of Phantom of the Opera. Additionally, Marina Prior played Christine in the original Australian production of Phantom of the Opera.", "prediction 1": "The role of Christine in The Phantom of the Opera was played by Sierra Boggess in the 1986 musical. A new production directed by Laurence Connor began a UK and Ireland tour to commemorate the 25th anniversary of the show, beginning at the Theatre Royal Plymouth and travelled to Manchester, Bristol, Dublin, Leeds, Milton Keynes, Cardiff, and Southampton.", "prediction 2": "There was an original cast of three for The Phantom of the Opera in the 1986 musical. Ramin Karimloo played the Phantom in the 2004 film, while Sierra Boggess played Christine in the 2011 film. In the 2011 film, the role of Christine was played by Sierra Boggess.", "prediction 3": "The 1986 musical The Phantom of the Opera features several actors as Christine. The role of Christine was played by Sierra Boggess in the 25th Anniversary production of The Phantom of the Opera at the Royal Albert Hall. In the 2004 musical, the role was played by Ramin Karimloo. Then, in the 2011 film, Sierra Boggess played Christine.", "prediction 4": "In the 1986 musical The Phantom of the Opera, the character Christine is played by Sierra Boggess. In the 2004 British\u2013American musical drama film The Phantom of the Opera, the character Christine is played by Emmy Rossum, Patrick Wilson, Miranda Richardson, Minnie Driver, Jennifer Ellison and Ramin Karimloo. In the 2004 revival of The Phantom of the Opera, the role of Christine is played by Sierra Boggess. In the 2011 revival of The Phantom of the Opera, Sierra Boggess plays Christine in three performances alongside Boggess as Christine. In the 2015, Sierra Boggess performs the role of Christine in The Phantom of the Opera. In the 2016 Christmas, the Christmas production of The Phantom of the Opera in London, the role of Christine is played by a new version of The Phantom of the Opera.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 172 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 355 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Phantom of the Opera is a 2004 musical drama film based on Andrew Lloyd Webber's musical of the same name, which in turn is based on the French novel by Gaston Leroux. The role of Christine in The Phantom of the Opera was played by Sierra Boggess in the 1986 musical. She co-starred in Andrew Lloyd Webber's sequel, \"Love Never Dies\", and in 2011, played Christine, in the 25th anniversary production of \"The Phantom of the Opera at the Royal Albert Hall\". Also Katie Hall and Olivia Brereton have also starred as Christine." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the nfl start playing on christmas day?", "passages": [ [ "National Football League Christmas games", "National Football League Christmas games\n\nChristmas Day and Christmas Eve games in the National Football League are an occasional part of the league's schedule.", "In contrast to Thanksgiving Day games, however, they are not an annual occurrence; as of 2017, there have been just 19 Christmas Day games in the NFL's history.", "After the NFL held two Divisional Playoff games on Christmas Day 1971, the league avoided any more games on Christmas Day until 1989.", "Since then, the NFL has held occasional games on Christmas Day in some years, as part of week 16 or 17 of the regular season.", "Two games were played each Christmas Day from 2004 to 2006 and then from 2016 to 2017.", "In recent years, the NFL has scheduled games on Christmas Day only if it falls on a Saturday, Sunday, or Monday.", "The NFL scheduled one Friday Christmas game, in 2009, a very rare occasion for an NFL game to be played on a Friday (because Christmas falls outside the window set in the Sports Broadcasting Act of 1961 that prohibits pro football telecasts on those days for most of the regular season, it is one of the few times of the year when the league plays on a Friday or Saturday).", "If Christmas falls on a Sunday, most games are moved to Saturday, Christmas Eve, and then one or two games are scheduled for Christmas Night to be broadcast nationally." ] ], "gold": "Christmas Day and Christmas Eve games in the National Football League are an occasional part of the league's schedule. In contrast to Thanksgiving Day games, however, they are not an annual occurrence; as of 2020, there have been just 22 Christmas Day games in the NFL's history. After the NFL first held two Divisional Playoff games on Christmas Day in 1971, the league avoided any more games on Christmas Day until 1989. Since then, the NFL has held occasional games on Christmas Day in some years, as part of week 16 or 17 of the regular season. ", "prediction 1": "Christmas Day games in the National Football League are an occasional part of the league's schedule. In contrast to Thanksgiving Day games, however, they are not an annual occurrence. In recent years, the NFL has scheduled games on Christmas Day only if it falls on a Saturday, Sunday, or Monday. The NFL began playing on Christmas Day in 1989.", "prediction 2": "Christmas Day and Christmas Eve games in the National Football League are an occasional part of the league's schedule. After the NFL held two Divisional Playoff games on Christmas Day 1971, the league avoided any more games on Christmas Day until 1989. In recent years, the NFL has scheduled games on Christmas Day only if it falls on a Saturday, Sunday, or Monday. The NFL played one Friday Christmas game, in 2009, a very rare occasion for an NFL game to be played on a Friday.", "prediction 3": "The National Football League has played Christmas Day games since the NFL's inception in 1970. The league started playing Christmas Day games in 1971. Then, in 1989, the league began playing Christmas Day games again. In recent years, the NFL has scheduled games on Christmas Day only if it falls on a Saturday, Sunday, or Monday. In 2009, the league played one Friday Christmas game, which is a very rare occasion for an NFL game to be played on a Friday.", "prediction 4": "The National Football League first drew the line on playing games on Christmas Day in 1971 when two Divisional Playoff games were held. The league avoided any more games on Christmas Day until 1989. The NFL started playing games on Christmas Day in 2019 and they started playing games on Christmas Day in 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 296 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 344 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Christmas Day games in the National Football League are an occasional part of the league's schedule. In contrast to Thanksgiving Day games, however, they are not an annual occurrence. After the NFL held two Divisional Playoff games on Christmas Day 1971, the league avoided any more games on Christmas Day until 1989. Since then, the NFL has held occasional games on Christmas Day in some years, as part of week 16 or 17 of the regular season. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is the current leader of saudi arabia?", "passages": [ [ "Salman of Saudi Arabia", "Salman of Saudi Arabia\n\nSalman bin Abdulaziz Al Saud ( \"\", ; born 31 December 1935) has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015.", "He was the Deputy Governor of Riyadh and later the Governor of Riyadh for 48 years from 1963 to 2011.", "He was then appointed Minister of Defense.", "He was also named the Crown Prince in 2012 following the death of his brother Nayef bin Abdulaziz.", "Salman became the new King of Saudi Arabia on 23 January 2015 following the death of his half-brother, King Abdullah.", "His major initiatives as King include the Saudi intervention in the Yemeni Civil War, Saudi Vision 2030, and a 2017 decree allowing Saudi women to drive.", "His son, Crown Prince Mohammad bin Salman, is seen as a powerful figure within Saudi Arabia and has led many reforms within the country.", "Salman was born on 31 December 1935, and is reported to be the 25th son of Ibn Saud, the first monarch and founder of Saudi Arabia.", "Salman and his six full brothers make up the Sudairi Seven.", "He was raised in the Murabba Palace.", "Salman received his early education at the Princes' School in the capital city of Riyadh, a school established by Ibn Saud specifically to provide education for his children.", "He studied religion and modern science." ], [ "Fahd of Saudi Arabia", "Fahd of Saudi Arabia\n\nFahd bin Abdulaziz Al Saud, Custodian of the Two Holy Mosques ( \"\"; 1921 \u2013 1 August 2005) was King of Saudi Arabia from 1982 to 2005.", "He was one of 45 sons of Saudi founder Ibn Saud and the fourth of his six sons who were kings (Saud, Faisal, Khalid, Fahd, Abdullah and Salman).", "Fahd was appointed Crown Prince when his half-brother Khalid succeeded another half-brother King Faisal, who was assassinated in 1975.", "Fahd was viewed as the \"de facto\" Prime Minister during King Khalid's reign in part due to the latter's ill health.", "Fahd ascended to the throne on the death of King Khalid on 13 June 1982.", "King Fahd is credited for having introduced the Basic Law of Saudi Arabia in 1992.", "He suffered a debilitating stroke in 1995, after which he was unable to continue performing his full official duties.", "His half-brother Abdullah, the country's Crown Prince, served as \"de facto\" regent of the kingdom, and succeeded Fahd as monarch upon his death in August 2005.", "Fahd bin Abdulaziz was born in Riyadh in 1921.", "He was the eighth son of Ibn Saud.", "His mother was Hassa Al Sudairi and he was the eldest member of the Sudairi Seven." ] ], "gold": "From the years 2015 to 2020, the leader of Saudi Arabia was Salman I, who ruled the country after the death of his half-brother Abdullah IV, King from 2005 to 2015. They are both half-bothers of Fahd I, who served the position from 1982 to 2005.", "prediction 1": "Salman bin Abdulaziz Al Saud has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015. Fahd bin Abdulaziz Al Saud, the current ruler of Saudi Arabia, was King of Saudi Arabia from 1982 to 2005. He was one of 45 sons of Saudi founder Ibn Saud and the fourth of his six sons who were kings, Fahd being the fourth.", "prediction 2": "Salman bin Abdulaziz Al Saud has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015. He became the new King of Saudi Arabia on 23 January 2015 following the death of his half-brother, King Abdullah. Salman became the new King of Saudi Arabia on 23 January 2015 following the death of his half-brother, King Abdullah. His son, Crown Prince Mohammad bin Salman, is seen as a powerful figure within Saudi Arabia and has led many reforms within the country.", "prediction 3": "The current leader of Saudi Arabia is King Salman bin Abdulaziz Al Saud. He has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015. His son, Crown Prince Mohammad bin Salman, is seen as a powerful figure within Saudi Arabia and has led many reforms within the country. King Fahd of Saudi Arabia was King of Saudi Arabia from 1982 to 2005. Fahd was a descendant of founder Ibn Saud and his half-brother Abdullah, who succeeded Fahd as King. His half-brother Abdullah, served as de facto regent of the country, and succeeded Fahd as monarch upon his death in August 2005.", "prediction 4": "Salman bin Abdulaziz Al Saud, born 31 December 1935, has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015. His son, Crown Prince Mohammad bin Salman, is seen as a powerful figure within Saudi Arabia and has led many reforms within the country. King Abdullah was King of Saudi Arabia from 1982 to 2005, and his half-brother Fahd was the country's Crown Prince.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 181, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 377 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Salman bin Abdulaziz Al Saud has been King of Saudi Arabia, Prime Minister of Saudi Arabia, and Custodian of the Two Holy Mosques since 23 January 2015, following the death of his half-brother, King Abdullah. They are both half-brothers of Fahd bin Abdulaziz Al Saud, who was King of Saudi Arabia from 1982 to 2005. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who won the first battle of sabine pass?", "passages": [ [ "First Battle of Sabine Pass", "First Battle of Sabine Pass\n\nThe First Battle of sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City (now Sabine Pass, Texas.)", "It was the apex in a series of naval and land skirmishes around the mouth of the Sabine River, Texas, and preceded by four weeks the Union Navy's first armed entry into Galveston Bay called the Battle of Galveston Harbor.", "Besides strengthening the Union naval blockade of the Texas coastline, the shelling and capture of Sabine Pass was to deter Confederate ground forces from moving southwestward on the Texas coast to augment Galveston's defense.", "And, it was to open the way for the Union invasion of Texas, which almost a year later was attempted by a combined force of Union naval and army forces at the Second Battle of Sabine Pass.", "Sabine Pass is the waterway serving as the outlet of the Sabine Lake estuary formed by the confluence of the Neches and Sabine rivers.", "The port at Sabine City was connected by a rail spur to the rail line running from the eastern border of Texas to Houston and Galveston.", "Although the port and entrance to the pass over the bar were shallow, it served coastal trade and, increasingly, blockade runners." ], [ "First Battle of Sabine Pass", "In September 1862 the commander of the West Gulf Blockading Squadron, Rear Admiral David Farragut, encouraged Master Frederick Crocker in the steamer to capture the port.", "Farragut assigned Acting Master Quincy Hooper in the schooner to assist.", "On September 23, the vessels arrived off of the pass and were joined by Acting Master Lewis Pennington in the mortar schooner .", "The captains conferred and determined that they would not attempt to get the deep draft \"Kensington\" over the bar, but instead would use the schooners to make the attack.", "Late that afternoon the \"Rachel Seaman\" made it over, but the slightly deeper draft \"Henry Janes\" became stuck when the tide fell.", "The morning of September 24 revealed Pennington's ship stuck in the mud within sight of the fort.", "Pennington ordered his vessel to fire and it was soon joined by the \"Rachael Seaman.\"", "The Confederate artillerists responded, but their shots fell short as did most of the naval gunfire.", "After five hours the \"Henry Janes\" was freed from the muck and entered the pass." ], [ "First Battle of Sabine Pass", "During the period between the 27th and the end of the month Crocker and the \"Kensington\" captured the British Schooner \"Velocity\" and Hooper and the \"Rachael Seaman\" captured the schooner \"Dart\".", "On October 3, 1862, Crocker captured the blockade runner \"Dan\" on the Calcasieu Pass and used it to travel back up the Sabine River to destroy the railroad bridge.", "Crocker was promoted to the rank of Acting Volunteer Lieutenant \"for gallant conduct\" in the Sabine Pass and Calcasieu Pass operations by Admiral Farragut.", "When intelligence reports indicated that there was a large Confederate army, preparing to counter-attack, Master Hooper (then in command of the place) withdrew the \"Rachael Seaman\" across the bar and back into the Gulf, abandoning the city and Fort Sabine, thus returning Sabine Pass, the lake, and river to Confederate hands.", "Second Battle of Sabine Pass" ] ], "gold": "The First Battle of Sabine Pass, which took place from September 24 to September 25, 1862, was the first American Civil War bombardment by the United States Navy of a Confederate fort below Sabine City in Texas. The commander of the West Gulf Blockading Squadron, Rear Admiral David Farragut, encouraged Master Frederick Crocker in the steamer USS Kensington to capture the port. The battle was won by the United States unit West Gulf Blockading Squadron commanded by Frederick Crocker. Crocker was promoted to the rank of Acting Volunteer Lieutenant \"for gallant conduct\" in the Sabine Pass and Calcasieu Pass operations by Admiral Farragut.", "prediction 1": "The First Battle of Sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City (now Sabine Pass, Texas). It was preceded by four weeks the Union Navy's first armed entry into Galveston Bay called the Battle of Galveston Harbor. The shelling and capture of Sabine Pass was to deter Confederate ground forces from moving southwestward on the Texas coast to augment Galveston's defenses. And, it was to open the way for the Union invasion of Texas, which almost a year later was attempted by a combined force of Union naval and army forces at the Second Battle of Sabine Pass.", "prediction 2": "The First Battle of sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City, Texas. It was the apex in a series of naval and land skirmishes around the mouth of the Sabine River, Texas, and preceded by four weeks the Union Navy's first armed entry into Galveston Bay called the Battle of Galveston Harbor.", "prediction 3": "The First Battle of sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City, Texas. It was the apex in a series of naval and land skirmishes around the mouth of the Sabine River, Texas, and preceded by four weeks the Union Navy's first armed entry into Galveston Bay called the Battle of Galveston Harbor. The shelling and capture of Sabine Pass was to deter Confederate ground forces from moving southwestward on the Texas coast, and, increasingly, blockade runners.", "prediction 4": "The First Battle of Sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City (now Sabine Pass, Texas). It was the apex in a series of naval and land skirmishes around the mouth of the Sabine River, Texas, preceded by four weeks the Union Navy's first armed entry into Galveston Bay called the Battle of Galveston Harbor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 343 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 500 }, { "error type": "Irrelevant", "explanation": "", "start": 501, "end": 689 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The First Battle of Sabine pass or the Bombardment of Fort Sabine, on September 24\u201325, 1862, was the first Civil War bombardment by the United States Navy of a Confederate fort below Sabine City (now Sabine Pass, Texas). The commander of the West Gulf Blockading Squadron, Rear Admiral David Farragut, encouraged Master Frederick Crocker in the steamer to capture the port. On October 3, 1862, Crocker captured the blockade runner \"Dan\" on the Calcasieu Pass and used it to travel back up the Sabine River to destroy the railroad bridge. Crocker was promoted to the rank of Acting Volunteer Lieutenant \"for gallant conduct\" in the Sabine Pass and Calcasieu Pass operations by Admiral Farragut." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who has the highest number of likes on instagram?", "passages": [ [ "Instagram", "Instagram\n\nInstagram (also known as IG) is a photo and video-sharing social networking service owned by Facebook, Inc.", "It was created by Kevin Systrom and Mike Krieger, and launched in October 2010 exclusively on iOS.", "A version for Android devices was released a year and 6 months later, in April 2012, followed by a feature-limited website interface in November 2012, and apps for Windows 10 Mobile and Windows 10 in April 2016 and October 2016 respectively.", "The app allows users to upload photos and videos to the service, which can be edited with various filters, and organized with tags and location information.", "An account's posts can be shared publicly or with pre-approved followers.", "Users can browse other users' content by tags and locations, and view trending content.", "Users can \"like\" photos, and follow other users to add their content to a feed.", "The service was originally distinguished by only allowing content to be framed in a square (1:1) aspect ratio, but these restrictions were eased in 2015.", "The service also added messaging features, the ability to include multiple images or videos in a single post, as well as \"Stories\"\u2014similar to its main competitor Snapchat\u2014which allows users to post photos and videos to a sequential feed, with each post accessible by others for 24 hours each." ], [ "Like button", "Some reactions included \"Love\", \"Haha\", \"Wow\", \"Sad\", or \"Angry\".", "In 2010, as part of a wider redesign of the service, YouTube switched from a star-based rating system to Like/Dislike buttons.", "Under the previous system, users could rate videos on a scale from 1 to 5 stars; YouTube staff argued that this change reflected common usage of the system, as 2-, 3-, and 4-star ratings were not used as often.", "In 2012, YouTube briefly experimented with replacing the Like and Dislike buttons with a Google+ +1 button.", "Google has a like button called the +1 (Internet jargon for \"I like that\" or \"I agree\"), which was introduced in June 2011.", "In August 2011 the +1 button also became a share icon.", "Instagram has a like button.", "It is a heart symbol () similar to those in Twitter, Tumblr and VK.", "On the mobile app, double-tapping a photo also acts as a like button.", "On Reddit (a system of message boards), users can upvote and downvote posts (and comments on posts).", "The votes contribute to posters' and commenters' \"karma\" (Reddit's name for a user's overall rating)." ], [ "Like button", "Like button\n\nA like button, like option, or recommend button is a feature in communication software such as social networking services, Internet forums, news websites and blogs where the user can express that they like, enjoy or support certain content.", "Internet services that feature like buttons usually display the number of users who liked each content, and may show a full or partial list of them.", "This is a quantitative alternative to other methods of expressing reaction to content, like writing a reply text.", "Some websites also include a dislike button, so the user can either vote in favour, against or neutrally.", "Other websites include more complex Web content voting systems, for example five stars or reaction buttons to show a wider range of emotion to the content.", "The like button was first announced as a FriendFeed feature on October 30, 2007 and was popularized within that community.", "Later the feature was integrated into Facebook before FriendFeed was acquired by Facebook August 10, 2009.", "The Facebook like button is designed as a hand giving \"thumbs up\".", "It was originally discussed to have been a star or a plus sign, and during development the feature was referred to as \"awesome\" instead of \"like\".", "It was introduced on 9 February 2009.", "During May 2016, Facebook introduced reactions - a new way to express peoples emotions to Facebook posts." ] ], "gold": "Instagram is a photo and video-sharing social networking service that allows users to like content that is provided by its owners by double tapping a heart symbol on the post. Instagram usually displays the number of users who liked each piece of content, and the post with the most likes changes over time. The person with the highest number of likes on Instagram in 2015 was Kendall Jenner. In 2016, Selena Gomez received the highest number, and in 2017, Beyonce had the highest number.", "prediction 1": "Instagram is a photo and video-sharing social networking service owned by Facebook, Inc. It was created by Kevin Systrom and Mike Krieger, and launched in October 2010 exclusively on iOS. The number one user with the most likes on Instagram is a musician called Liam Payne.", "prediction 2": "Instagram is a photo and video-sharing social networking service owned by Facebook, Inc. it was created by Kevin Systrom and Mike Krieger, and launched in October 2010 exclusively on iOS. The person with the most likes on Instagram is the owner of the account IG.com, a photo and video sharing app owned by Facebook. The person with the highest number of likes on Instagram is the owner of the account IG.com. The person with the highest number of likes on Instagram is the owner of the account IG.com the user has the highest number of followers.", "prediction 3": "Instagram is a photo and video-sharing social networking service owned by Facebook, Inc. It was created by Kevin Systrom and Mike Krieger and launched in October 2010 exclusively on iOS. The user with the most likes is a user named john kim, whose account has the most likes.", "prediction 4": "Instagram is a photo and video-sharing social networking service owned by Facebook, Inc. It was created by Kevin Systrom and Mike Krieger, and launched in October 2010 exclusively on iOS. The most-liked user is emily j. ross, with over 1.3 million likes. The most-followed user is emily j. ross, with over 1.6 million likes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 88 }, { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 187 }, { "error type": "Unverifiable", "explanation": "", "start": 217, "end": 273 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Instagram is a photo and video-sharing social networking service, users can \"like\" photos, the like button is a heart symbol. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where in tennessee can you see 7 states?", "passages": [ [ "Lookout Mountain", "Civil War-related landmarks include \"Point Park\", operated by the National Park Service, and the Cravens House.", "Nearby are Georgia's Cloudland Canyon and Cloudland Canyon State Park.", "The southwestern section of Lookout Mountain is in Alabama.", "The Little River, in Little River Canyon on the mountain.", "The river flows over the DeSoto Falls in DeSoto State Park.", "The Noccalula Falls Park, featuring a pioneer village showcasing several nineteenth-century homes, is located at the southern terminus of Lookout Mountain, near Gadsden, Alabama.", "Local legend claims that the 90-foot falls' namesake, Noccalula, jumped to her death because she could not marry the man she loved.", "White water sports and rock-climbing (offering views of the Coosa River Basin) are this area's key attractions.", "From the \"Rock City\" point, a marker claims that seven U.S. states could be seen: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama.", "The claim is repeated on numerous barn roofs in the surrounding area.", "No scientific investigation has upheld this claim.", "Located on the northwest side of Lookout Mountain, Sunset Rock is a popular trailhead and tourist stop.", "It is part of the Chickamauga and Chattanooga Military State Park, the largest and oldest Civil War national park." ], [ "Lookout Mountain", "Lookout Mountain\n\nLookout Mountain is a mountain ridge located at the northwest corner of the U.S. state of Georgia, the northeast corner of Alabama, and along the Tennessee state line in Chattanooga.", "Lookout Mountain was the scene of the \"Last Battle of the Cherokees\" during the Nickajack Expedition, which took place in the 18th century, as well as the November 24, 1863 Battle of Lookout Mountain during the American Civil War.", "The name \"Lookout Mountain\" is said to have come from General Andrew Jackson's troops, but more likely comes from the Cherokee term for \"two mountains looking at each other\".", "Lookout Mountain and Sand Mountain (to the southwest) make up a large portion of the southernmost end of the Cumberland Plateau.", "The area was lifted from an ancient sea, and worn down by erosion for millions of years.", "The summit, called \"High Point\", is located just east of Thompsonville in Walker County, Georgia, with an elevation of above sea level.", "The foothills of the mountain extend into Chickamauga and Chattanooga National Military Park.", "The caves of Ruby Falls are in Lookout Mountain, and the rock formations of the \"City of Rocks\" (or Rock City) attraction are situated on the ridge.", "The area is home to the Lookout Mountain Incline Railway, Covenant College, and a hang-gliding school.", "Lookout Mountain is one of the Chattanooga area's most visited tourist attractions." ] ], "gold": "Rock City Point, located on Lookout Mountain in Chattanooga, Tennessee, offers a view of Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama, for a total of seven states visible from one spot.", "prediction 1": "From the \"Rock City\" point, a marker claims that seven U.S. states could be seen: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama. No scientific investigation has upheld this claim.", "prediction 2": "From the Rock City point, a marker claims that seven U.S. states could be seen: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama. The claim is repeated on numerous barn roofs in the surrounding area. The area is home to the Lookout Mountain Incline Railway, Covenant College, and a hang-gliding school.", "prediction 3": "On Lookout Mountain, the state line from Tennessee to Georgia is at the northwest corner of the state of Georgia, the northeast corner of Alabama, and along the Tennessee state line in Chattanooga. From the \"Rock City\" point, a marker claims that seven U.S. states could be seen: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama.", "prediction 4": "From the \"Rock City\" point, a marker claims that 7 states could be seen from Lookout Mountain: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama. The claim is repeated on numerous barn roofs in the surrounding area. No scientific investigation has upheld this claim.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Lookout Mountain is a mountain ridge located at the northwest corner of the U.S. state of Georgia, the northeast corner of Alabama, and along the Tennessee state line in Chattanooga. From the \"Rock City\" point, a marker claims that seven U.S. states could be seen: Tennessee, Kentucky, Virginia, South Carolina, North Carolina, Georgia, and Alabama. No scientific investigation has upheld this claim." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the minimum wage in the united states today?", "passages": [ [ "Minimum wage in the United States", "Minimum wage in the United States\n\nThe minimum wage in the United States is set by US labor law and a range of state and local laws.", "Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law.", "Since July 24, 2009, the federal government has mandated a nationwide minimum wage of $7.25 per hour.", "As of January 2018, there were 29 states with a minimum wage higher than the federal minimum.", "From 2017 to 2018, eight states increased their minimum wage levels through automatic adjustments, while increases in eleven other states occurred through referendum or legislative action.", "Using 2018 inflation-adjusted dollars, the federal minimum wage peaked at $11.77 per hour in 1968.", "If the minimum wage in 1968 had kept up with labor's productivity growth, it would have reached $19.33 in 2017.", "There is a racial difference in support for a higher minimum wage with most Black and Latino individuals supporting a $15.00 federal minimum wage, and 54% of Whites opposing it.", "In 2015, about 3% of White, Asian, and Latino workers earned the federal minimum wage or less.", "Amongst Black workers, the percentage was about 4%.", "Minimum wage legislation emerged at the end of the nineteenth century from the desire to end sweated labor which had developed in the wake of industrialization." ], [ "Minimum Wage Fairness Act", "Minimum Wage Fairness Act\n\nThe Minimum Wage Fairness Act () is a bill that would amend the Fair Labor Standards Act of 1938 (FLSA) to increase the federal minimum wage for employees to $10.10 per hour over the course of a two-year period.", "The bill was strongly supported by President Barack Obama and many of the Democratic Senators, but strongly opposed by Republicans in the Senate and House.", "The bill was introduced into the United States Senate during the 113th United States Congress.", "In the United States workers generally must be paid no less than the statutory minimum wage.", "As of July 2009, the federal government mandates a nationwide minimum wage level of $7.25 per hour, while some states and municipalities have set minimum wage levels higher than the federal level, with the highest state minimum wage being $9.47 per hour in Washington as of January 1, 2015.", "Among those paid by the hour in 2013, 1.5 million were reported as earning exactly the prevailing federal minimum wage.", "About 1.8 million were reported as earning wages below the minimum.", "Together, these 3.3 million workers with wages at or below the minimum represent, respectively: 1.0% of the population, 1.6% of the labor force, 2.5% of all workers, and 4.3% of hourly workers.", "Many states already have a state minimum wage higher than the existing federal minimum wage." ], [ "Fair Minimum Wage Act of 2007", "Fair Minimum Wage Act of 2007\n\nThe Fair Minimum Wage Act of 2007 is a US Act of Congress that amended the Fair Labor Standards Act of 1938 to gradually raise the federal minimum wage from $5.15 per hour to $7.25 per hour.", "It was signed into law on May 25, 2007 as part of the U.S. Troop Readiness, Veterans' Care, Katrina Recovery, and Iraq Accountability Appropriations Act, 2007.", "The act raises the federal minimum wage in 3 increments: to $5.85 per hour 60 days after enactment (2007-07-24), to $6.55 per hour 12 months after that (2008-07-24), and finally to $7.25 per hour 12 months after that (2009-07-24).", "In addition, the act provides for the Northern Mariana Islands and American Samoa to make the transition to the federal minimum wage on alternate timetables.", "As of 2008, 13 states already had minimum wage rates at or above $7.25 per hour.", "These states were therefore unaffected by the increase.", "The act was a component of the new Democratic majority's 100-Hour Plan in the United States House of Representatives.", "It was introduced into the House on January 5, 2007, by George Miller (D-CA) and it was passed by the House on January 10." ] ], "gold": "The federal minimum wage in the United States has been $7.25 per hour since July 2009, the last time Congress raised it. While the federal minimum wage is $7.25 per hour, most states and many cities have higher minimum wages resulting in almost 90% of American minimum wage workers earning more than $7.25. The effective nationwide minimum wage, the wage that the average minimum wage worker earns, is $11.80 as of May 2019. ", "prediction 1": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. As of January 2018, there were 29 states with a minimum wage higher than the federal minimum.", "prediction 2": "The current federal minimum wage is $7.25 per hour. As of January 2018, there were 29 states with a minimum wage higher than the federal minimum. The current state minimum wage in Washington is $9.47 per hour.", "prediction 3": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. It was $11.77 in 1968, and reached $19.33 in 2017. The Fair Minimum Wage Act of 2007 was a US Act of Congress that amended the Fair Labor Standards Act of 1938 to gradually raise the federal minimum wage from $5.15 per hour to $7.25 per hour.", "prediction 4": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. In 2018, there were 29 states with a minimum wage higher than the federal minimum.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 301 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "As of July 2009, the federal government mandates a nationwide minimum wage level of $7.25 per hour, while some states and municipalities have set minimum wage levels higher than the federal level, with the highest state minimum wage being $9.47 per hour in Washington as of January 1, 2015." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who is the highest selling girl group of all time?", "passages": [ [ "RIAA certification", "RIAA certification\n\nIn the United States, the Recording Industry Association of America (RIAA) awards certification based on the number of albums and singles sold through retail and other ancillary markets.", "Other countries have similar awards (see music recording sales certification).", "Certification is not automatic; for an award to be made, the record label must request certification.", "The audit is conducted against net shipments after returns (most often an artist's royalty statement is used), which includes albums sold directly to retailers and one-stops, direct-to-consumer sales (music clubs and mail order) and other outlets.", "A Gold record is a single or album that has sold 500,000 units (records, tapes or compact discs).", "The award was launched in 1958; originally, the requirement for a Gold single was one million units sold and a Gold album represented $1 million in sales (at wholesale value, around a third of the list price).", "In 1975, the additional requirement of 500,000 units sold was added for Gold albums.", "Reflecting growth in record sales, the Platinum award was added in 1976 for albums selling one million units, and singles selling two million units.", "The Multi-Platinum award was introduced in 1984, signifying multiple Platinum levels of albums and singles." ], [ "Spice Girls", "Spice Girls\n\nThe Spice Girls are an English pop girl group formed in 1994.", "The group comprised Melanie Brown (\"Scary Spice\"), Melanie Chisholm (\"Sporty Spice\"), Emma Bunton (\"Baby Spice\"), Geri Halliwell (\"Ginger Spice\"), and Victoria Beckham, n\u00e9e Adams (\"Posh Spice\").", "They were signed to Virgin Records and released their debut single \"Wannabe\" in 1996, which hit number one in 37 countries and established their global success.", "Their debut album \"Spice\" sold more than 31 million copies worldwide, becoming the best-selling album by a female group in history.", "Their follow-up album, \"Spiceworld\" sold over 20 million copies worldwide.", "The Spice Girls have sold 85 million records worldwide, making them the best-selling female group of all time, one of the best-selling pop groups of all time, and the biggest British pop success since The Beatles.", "Among the highest profile acts in 1990s British popular culture, \"Time\" called them \"arguably the most recognizable face\" of Cool Britannia, the mid-1990s celebration of youth culture in the UK.", "Measures of their success include international record sales, a 2007\u20132008 reunion tour, merchandising, iconic symbolism such as Halliwell's Union Jack dress representing \"girl power\", and a film, \"Spice World\"." ], [ "TLC (group)", "Their music \u2013 particularly the 11-million-selling \"CrazySexyCool\" and the 6-million-selling \"FanMail\", both of which won two Grammys each \u2013 set the standard for contemporary R&B. TLC helped to pioneer a deft blend of acoustic and computer sounds that paved the way for groups like Destiny's Child, as did their image as independent women.", "Whether addressing AIDS in \"Waterfalls\" or the struggle for female self-esteem in \"Unpretty\", they showed themselves able to take serious issues to the top of the pop charts.", "TLC is the best-selling American girl group of all time with 65 million records sold worldwide, along with being the second best selling girl group worldwide.", "According to the Recording Industry Association of America (RIAA), TLC is the best-selling female singing group in American music history, with 22 million certified albums.", "\"CrazySexyCool\" remains the only album by a female singing group to receive the RIAA diamond award, which indicates sales of 10,000,000 copies.", "According to \"Billboard\", TLC is the second most successful girl group of all time on the \"Billboard\" charts, behind only The Supremes." ] ], "gold": "In most countries, the sales figures records of girl groups are not available before the 1990s, so it is difficult to accurately determine best-selling artists, either by country or worldwide. Complicating matters further, in many countries, certification is for shipments of a record to retailers, rather than actual sales, and from 2010 onwards, certifications have become based on a combined figure of sales and streaming, instead of sales alone. Nonetheless, with the information available, the highest selling girl group of all time worldwide is the Spice Girls, having sold 100 million records. Alternatively, in the US, the title goes to TLC, with 23 million certified albums.", "prediction 1": "The highest selling girl group of all time is The Spice Girls. The English pop girl group The Spice Girls are the highest selling girl group of all time. According to the Recording Industry Association of America (RIAA), TLC is the best-selling female singing group in American music history, with 22 million certified albums.\n", "prediction 2": "In the US, the Recording Industry Association of America (RIAA) awards certification based on the number of albums and singles sold through retail and other ancillary markets. The highest selling girl group of all time is The Spice Girls, who have sold 85 million records worldwide. Also, The Spice Girls are among the highest selling pop groups of all time, and Britain's highest selling girl group, with 85 million records sold worldwide.", "prediction 3": "In the United States, the Recording Industry Association of America (RIAA) awards certification based on the number of albums and singles sold through retail and other ancillary markets. The highest selling girl group of all time is the English pop girl group The Spice Girls. Their album, \"Spice\", sold more than 31 million copies worldwide, becoming the best-selling album by a female group in history. The highest selling girl group worldwide is Nevermore, selling 121.8 million records sold worldwide.", "prediction 4": "In the United States, the Recording Industry Association of America (RIAA) awards certification based on the number of albums and singles sold through retail and other ancillary markets. The highest selling girl group of all time is the Spice Girls, an English-pop girl group formed in 1994, with an estimated 115 million albums sold worldwide. Of the girl groups released between 1984 and 2015, 507 is the highest selling girl group worldwide, while the TLC girl group has the most certified albums worldwide with 22 million certified albums.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The highest selling girl group of all time is The Spice Girls. ", "start": 63, "end": 153 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 220 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The highest selling girl group of all time is The Spice Girls, having sold 85 million records worldwide. TLC is the best-selling American girl group of all time with 65 million records sold worldwide\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many seasons are there of teen wolf?", "passages": [ [ "Teen Wolf (1986 TV series)", "Teen Wolf (1986 TV series)\n\nTeen Wolf, known as The Cartoon Adventures of Teen Wolf in the United Kingdom, is an animated American television series broadcast from 1986 to 1987 that was produced by Southern Star Productions and Hanna-Barbera Australia in association with Clubhouse Pictures in the first season and Atlantic/Kushner-Locke in the second season.", "It was based on the 1985 live-action film, \"Teen Wolf\".", "The series is about a teenage boy and his family who can transform into werewolves, focusing on themes of coming of age and fitting in.", "While generally keeping true to the main ideas, this version made some changes from the film.", "Scott Howard and his family live in the fictional town of Wolverton, a small town that draws tourists because of its history of werewolf sightings.", "Unlike the film, Scott's status as a werewolf is a secret.", "Despite the youth audience, the cartoon series delivered very powerful critiques of disability-as-civil rights.", "Freely invoking an asthma attack or seizure, the series centered on how Scott felt \"weird\" immediately before and during his werewolf transformation.", "Although he never hurt anybody while he was a werewolf, Scott was conscious of his difference from other teenagers and had to make accommodations for himself.", "He also expressed frustration that the residents of this town had stereotyped \"his people\"." ], [ "Teen Wolf", "Teen Wolf\n\nTeen Wolf is a 1985 American fantasy-comedy film directed by Rod Daniel and written by Jeph Loeb and Matthew Weisman.", "The film stars Michael J. Fox as a high school student who discovers that his family has an unusual pedigree when he finds himself transforming into a werewolf.", "Scott Howard is a 17-year-old high school student who is sick of being average.", "Living in a small town in Oregon, his only claim to popularity is playing on the Beavers, his school's basketball team (which is very unsuccessful), and fawning after his crush Pamela Wells, who is dating his rival Mick.", "Mick plays for the Dragons, an opposing team who tends to bully Scott on the court.", "Completely oblivious to his best friend Boof's affections, he constantly rebuffs her advances due to their history together.", "After a series of startling changes such as long hair suddenly sprouting, hands suddenly getting hairy, he decides to quit the team, but his coach changes his mind.", "Scoring a keg with his friend Stiles for a party, Scott and Boof end up alone in a closet and Scott gets rough when they begin making out, accidentally clawing Boof's back.", "When he returns home, he undergoes a strange transformation and discovers he is a werewolf." ], [ "Teen Wolf (2011 TV series)", "Teen Wolf (2011 TV series)\n\n", "Teen Wolf is an American television series developed by Jeff Davis for MTV.", "It is loosely based on the 1985 film of the same name, and stars Tyler Posey as a teenager named Scott McCall, who is bitten by a werewolf and must cope with how it affects his life and the lives of those closest to him, and Dylan O'Brien as \"Stiles\" Stilinski, Scott's best friend.", "The series has received generally positive reviews from critics.", "\"Teen Wolf\" premiered on June 5, 2011, following the 2011 MTV Movie Awards.", "On July 21, 2016, the cast announced at Comic Con that the sixth season would be the series' final.", "The series finale aired on September 24, 2017.", "The series revolves around social outcast Scott McCall, a high school student living in the town of Beacon Hills.", "Scott's life drastically changes when he is bitten by a werewolf the night before sophomore year, becoming one himself.", "He must henceforth learn to balance his problematic new identity with his day-to-day teenage life.", "In season one, Scott and his human best friend \"Stiles\" Stilinski begin to encounter other characters with a connection to the supernatural goings-on in Beacon Hills.", "Scott's initial love interest is Allison Argent, a classmate of his who comes from a family of werewolf hunters." ] ], "gold": "The 1985 romantic fantasy comedy film Teen Wolf inspired two TV shows, an animated series premiering in 1986 and a supernatural drama series premiering in 2011. The animated show ended its run in 1987 after two seasons, while the live-action series concluded on September 24, 2017 after six seasons.", "prediction 1": "Teen Wolf is an American animated television series that ran for 5 seasons. The first 5 seasons were broadcast from 1986 to 1987. The 6th season was broadcast from 2017 to 2021 and the series finale was broadcast on September 24, 2017.", "prediction 2": "Teen Wolf is an American fantasy-comedy film that was released in 1985 and stars Michael J. Fox as a high school student who discovers that his family has an unusual pedigree when he finds himself transforming into a werewolf. The animated American television series was broadcast from 1986 to 1987 and was produced by Southern Star Productions and Hanna-Barbera Australia in association with Clubhouse Pictures in the first season and Atlantic/Kushner-Locke in the second season. Teen Wolf is also an American television series developed by Jeff Davis for MTV. It is loosely based on the 1985 film Teen Wolf.", "prediction 3": "Teen Wolf is an American fantasy-comedy television series that ran for eight seasons from 1986 to 1987. The series focused on themes of coming of age and fitting in, focusing on themes of finding your place in the world, and tackling stereotypes of werewolves. Teen Wolf is based on the 1985 live-action film Teen Wolf which stars Michael J. Fox as a high school student who discovers that his family has an unusual pedigree when he finds himself transforming into a werewolf. Teen Wolf was a 2011 animated television series that aired six seasons and finales on September 24, 2017 and season seven.", "prediction 4": "Teen Wolf is an American fantasy television series developed by Jeff Davis for MTV that is loosely based on the 1985 live-action film Teen Wolf. It stars Tyler Posey as Scott McCall, a social outcast who is bitten by a werewolf and must cope with how it affects his life and the lives of those closest to him. It is a comedy that focuses on themes of coming of age and fitting in. Teen Wolf had three seasons in 1986 and four seasons in 2011. In 2011, there was a sixth season, which was the series finale. Teen Wolf had nine seasons.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 65, "end": 66 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 80, "end": 87 }, { "error type": "Unverifiable", "explanation": "", "start": 134, "end": 176 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1,7]}", "start": 185, "end": 235 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Teen Wolf is an American animated television series that ran for 2 seasons. They were broadcast from 1986 to 1987. Teen Wolf is also a 1985 American fantasy-comedy film. Teen Wolf is also an American television series from 2011. The series had 6 seasons and the series finale aired on September 24, 2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the opening song of rocky horror?", "passages": [ [ "Science Fiction/Double Feature", "For the filming of the opening sequence, Quinn's head had to be strapped to a board to keep it stationary for filming.", "The song is made up of fragments from 1950s subgenre horror and science fiction films and likened to that of avant-garde artist Tristan Tzara by author Vera Dika in her book, \"Recycled Culture in Contemporary Art and Film\".", "Tzara would construct poems by taking snippets of words from newspapers and placing them into a bag to randomly draw from and arrange.", "Instead, the words in \"Science Fiction/Double Feature\" are purposely made to rhyme with a set structure and set with phrases that create cohesion.", "The original concept of the song for the feature film as indicated in the original script was to have film clips of each movie shown with a scratched aged effect overlay during the song and opening credits.", "The idea was dropped when it became apparent that the cost of acquiring the rights to these clips in 1974 was far too prohibitive.", "The song is in the key of A major and the reprise of the song is in the key of B\u266d major.", "In the original stage version, the prologue of the show features the usherette singing \"Science Fiction/Double Feature\" as she enters after the theater lighting has been dimmed.", "A spotlight follows her as she carries her refreshment tray down the aisle and onto the stage." ], [ "Science Fiction/Double Feature", "Science Fiction/Double Feature\n\n\"Science Fiction/Double Feature\" is the opening song to the original 1973 musical stage production, \"The Rocky Horror Show\" as well as its 1975 film counterpart \"The Rocky Horror Picture Show\", book, music and lyrics by Richard O'Brien, musical arrangements by Richard Hartley.", "The song is reprised at the end of the show, with lyrics that reflect on the final events of the story.", "The song is a tribute to and sendup of various B movies and serials parodied in the show itself.", "The film opens with a title sequence of a disembodied mouth (inspired by the surreal Man Ray painting \"A l'heure de l'observatoire, les Amoureux\" (Observatory Time, the Lovers)) against a black background singing in homage to classic science fiction films.", "It was sung by Richard O'Brien and lip synced, as the now-iconic pair of red lips, by co-star Patricia Quinn.", "In its original incarnation, \"The Rocky Horror Show\", the song was performed by the character Magenta doubling as the credited role of \"Usherette\".", "This character took on the unofficial names of \"Miss Strawberry Time\", \"Trixie\" and the \"Belasco Popcorn Girl\" from props carried on stage during the number." ] ], "gold": "Science Fiction/Double Feature is the opening song to the original 1973 musical stage production, The Rocky Horror Show as well as its1975 film counterpart The Rocky Horror Picture Show. In the movie the Rocky Horror Picture Show, Richard O'Brian sings this opening song. In the original stage version of The Rocky Horror Show, the usherette sings the opening song as she enters after the theater lighting has been dimmed. A spotlight follows her as she carries her refreshment tray down the aisle and onto the stage.", "prediction 1": "In the original 1973 musical stage production of The Rocky Horror Show, the opening song was sung by Richard O'Brien with the character Magenta performing the role of Usherette. In the 1975 film version, the opening song was sung by Patricia Quinn, with the character Magenta doubling as the credited role of Usherette.", "prediction 2": "In the original 1973 musical stage production of The Rocky Horror Show, the opening song was sung by Richard O'Brien and lip synced by co-star Patricia Quinn. In the original 1975 film version, the opening song was performed by the character Magenta doubling as the credited role of Usherette.", "prediction 3": "Richard O'Brien sings the opening song to his 1973 musical Rocky Horror Show, and Patricia Quinn sings it in the 1975 film version of The Rocky Horror Picture Show. In its original incarnation, The Rocky Horror Show, the song was performed by the character Magenta doubling as the credited role of Usherette.", "prediction 4": "The opening song to The Rocky Horror Show was sung by Richard O'Brien and lip synced by Patricia Quinn. In the original theatrical version, the song was performed by the character Magenta doubling as the credited role of Usherette.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 101, "end": 121 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 225, "end": 319 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In the original 1973 musical stage production of The Rocky Horror Show, the opening song, \"Science Fiction/Double Feature\", was sung by the character Magenta performing the role of \"Usherette\" as she enters after the theater lighting has been dimmed. A spotlight follows her as she carries her refreshment tray down the aisle and onto the stage. In the 1975 film version, the opening song was sung by Richard O'Brien and lip synced by co-star Patricia Quinn." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who collected the data used to describe the current model for the molecular structure of dna?", "passages": [ [ "Nucleic acid double helix", "The double-helix model of DNA structure was first published in the journal \"Nature\" by James Watson and Francis Crick in 1953, (X,Y,Z coordinates in 1954) based upon the crucial X-ray diffraction image of DNA labeled as \"Photo 51\", from Rosalind Franklin in 1952, followed by her more clarified DNA image with Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff.", "The prior model was triple-stranded DNA.", "The realization that the structure of DNA is that of a double-helix elucidated the mechanism of base pairing by which genetic information is stored and copied in living organisms and is widely considered one of the most important scientific discoveries of the 20th century.", "Crick, Wilkins, and Watson each received one third of the 1962 Nobel Prize in Physiology or Medicine for their contributions to the discovery.", "(Franklin, whose breakthrough X-ray diffraction data was used to formulate the DNA structure, died in 1958, and thus was ineligible to be nominated for a Nobel Prize.)", "Hybridization is the process of complementary base pairs binding to form a double helix.", "Melting is the process by which the interactions between the strands of the double helix are broken, separating the two nucleic acid strands." ], [ "Molecular Structure of Nucleic Acids: A Structure for Deoxyribose Nucleic Acid", "Crick, Watson, and Maurice Wilkins who won the Nobel Prize for Medicine in recognition of their discovery of the DNA double helix.", "It is not always the case that the structure of a molecule is easy to relate to its function.", "What makes the structure of DNA so obviously related to its function was described modestly at the end of the article: \"It has not escaped our notice that the specific pairing we have postulated immediately suggests a possible copying mechanism for the genetic material\".", "The \"specific pairing\" is a key feature of the Watson and Crick model of DNA, the pairing of nucleotide subunits.", "In DNA, the amount of guanine is equal to cytosine and the amount of adenine is equal to thymine.", "The A:T and C:G pairs are structurally similar.", "In particular, the length of each base pair is the same and they fit equally between the two sugar-phosphate backbones.", "The base pairs are held together by hydrogen bonds, a type of chemical attraction that is easy to break and easy to reform." ], [ "Molecular models of DNA", "Molecular models of DNA\n\nMolecular models of DNA structures are representations of the molecular geometry and topology of deoxyribonucleic acid (DNA) molecules using one of several means, with the aim of simplifying and presenting the essential, physical and chemical, properties of DNA molecular structures either \"in vivo\" or \"in vitro\".", "These representations include closely packed spheres (CPK models) made of plastic, metal wires for \"skeletal models\", graphic computations and animations by computers, artistic rendering.", "Computer molecular models also allow animations and molecular dynamics simulations that are very important for understanding how DNA functions \"in vivo\".", "The more advanced, computer-based molecular models of DNA involve molecular dynamics simulations and quantum mechanics computations of vibro-rotations, delocalized molecular orbitals (MOs), electric dipole moments, hydrogen-bonding, and so on.", "\"DNA molecular dynamics modeling\" involves simulating deoxyribonucleic acid (DNA) molecular geometry and topology changes with time as a result of both intra- and inter- molecular interactions of DNA.", "Whereas molecular models of DNA molecules such as closely packed spheres (CPK models) made of plastic or metal wires for \"skeletal models\" are useful representations of static DNA structures, their usefulness is very limited for representing complex DNA dynamics." ] ], "gold": "Molecular models of DNA structures are representations of the molecular geometry and topology of deoxyribonucleic acid molecules using one of several means, with the aim of simplifying and presenting the essential, physical and chemical, properties of DNA molecular structures either in vivo or in vitro. The first high quality X-ray diffraction patterns of A-DNA were collected by Rosalind Franklin and Raymond Gosling in 1953. The double-helix model of DNA structure was first published in the journal Nature by James Watson and Francis Crick in 1953, based on the work of Rosalind Franklin and her student Raymond Gosling, who took the crucial X-ray diffraction image of DNA labeled as \"Photo 51\", and Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff. The realization that the structure of DNA is that of a double-helix is widely considered one of the most important scientific discoveries of the 20th century and Crick, Wilkins, and Watson each received one third of the 1962 Nobel Prize in Physiology or Medicine for their contributions to the discovery. ", "prediction 1": "The double-helix model of DNA structure was first published in the journal Nature in 1953 by James Watson and Francis Crick, and based upon the crucial X-ray diffraction image of DNA labeled as \"Photo 51\", from Rosalind Franklin in 1952, followed by her more clarified DNA image with Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff. Molecular models of DNA structures are representations of the molecular geometry and topology of deoxyribonucleoseoxyribonucleic acid (DNA) molecules using one of several means, with the aim of simplifying and presenting the essential, physical and chemical, properties of DNA molecular structures either \"in vivo\" or \"in vitro\".", "prediction 2": "The double helix model of DNA structure was first published in the journal Nature in 1953 by James Watson and Francis Crick and based upon the crucial X-ray diffraction image of DNA labeled as \"Photo 51,\" from Rosalind Franklin in 1952, followed by her more clarified DNA image with Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff. The prior model was triple-stranded DNA.", "prediction 3": "The current model for the molecular structure of DNA was first published in the journal Nature in 1953 by James Watson and Francis Crick. The double-helix model was developed by Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, with base-pairing chemical and biochemical information being collected by Erwin Chargaff.", "prediction 4": "The double-helix model of DNA structure was first published in the journal Nature by James Watson and Francis Crick in 1953, based upon the crucial X-ray diffraction image of DNA labeled as \"Photo 51\" from Rosalind Franklin in 1952, followed by her more clarified DNA image with Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The double-helix model of DNA structure was first published in the journal Nature in 1953 by James Watson and Francis Crick, and based upon the crucial X-ray diffraction image of DNA labeled as \"Photo 51\", from Rosalind Franklin in 1952, followed by her more clarified DNA image with Raymond Gosling, Maurice Wilkins, Alexander Stokes, and Herbert Wilson, and base-pairing chemical and biochemical information by Erwin Chargaff. Molecular models of DNA structures are representations of the molecular geometry and topology of deoxyribonucleoseoxyribonucleic acid (DNA) molecules using one of several means, with the aim of simplifying and presenting the essential, physical and chemical, properties of DNA molecular structures either \"in vivo\" or \"in vitro\". The realization that the structure of DNA is that of a double-helix elucidated the mechanism of base pairing by which genetic information is stored and copied in living organisms and is widely considered one of the most important scientific discoveries of the 20th century. Crick, Wilkins, and Watson each received one third of the 1962 Nobel Prize in Physiology or Medicine for their contributions to the discovery." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "What is the men's pole vault world record?", "passages": [ [ "Armand Duplantis", "Armand Duplantis\n\nArmand \"Mondo\" Duplantis (born November 10, 1999) is a Swedish-American pole vaulter.", "Duplantis won gold as a 15 year old in the boys' pole vault at the 2015 World Youth Championships and holds a number of age group world bests.", "He won the gold medal at the 2018 European Championships with a height of 6.05 metres, a new under-20s world record.", "Duplantis was born into an athletic family; his American father, Greg Duplantis, is a former pole vaulter with a personal best of 5.80\u00a0m (19\u00a0ft \u00a0\u00a0in), while his Swedish mother Helena (n\u00e9e Hedlund) is a former heptathlete and volleyball player.", "His two older brothers, Andreas and Antoine, also took up sports; Andreas represented Sweden as a pole vaulter at the 2009 World Youth Championships and 2012 World Junior Championships, while Antoine dropped pole vault for baseball in high school." ] ], "gold": "Armand Gustav \"Mondo\" Duplantis is a Swedish\u2013American pole vaulter who is the current world indoor record holder with a height of 6.18 m or 20 ft 3 1\u20444 in. He also holds a world best outdoor of 6.15 m or 20 ft 2 in. ", "prediction 1": "The men's pole vault world record for men is 6.05 metres, which is a personal best of 5.80 metres. The men's pole vault world record for boys is 6.07 metres. The men's pole vault world record for women is 6.13 metres.", "prediction 2": "The men's pole vault world record for the men is 5.80 metres. The men's world record for the men's pole vault is 5.75 metres. The men's world record for the men's pole vault is 5.80 metres.", "prediction 3": "The world record for men's pole vault is 6.05 metres, set in the 2015 World Youth Championships. The men's pole vault world record is 5.80 metres.", "prediction 4": "The men's pole vault world record for a vaulter is 6.05 metres. The men's pole vault world record for a vaulter is 6.80 metres.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 158, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 98 }, { "error type": "Redundant", "explanation": "The men's pole vault world record for men is 6.05 metres", "start": 99, "end": 157 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Armand Gustav \"Mondo\" Duplantis is a Swedish\u2013American pole vaulter. He holds the men's pole vault world record for men of 6.05 metres, " }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "The lament when i am laid in earth is a ground bass aria from?", "passages": [ [ "Dido's Lament", "Dido's Lament\n\nDido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\" by Henry Purcell (libretto by Nahum Tate).", "It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass.", "The conductor Leopold Stokowski wrote a transcription of the piece for symphony orchestra.", "It is played annually in London by the massed bands of the Guards Division at the Cenotaph remembrance parade in Whitehall on Remembrance Sunday, the Sunday nearest to November 11 (Armistice Day).", "The opening recitative secco, \"Thy hand, Belinda\", is accompanied by continuo only.", "Word painting is applied on the text \"darkness\" and \"death\" which is presented with chromaticism, symbolic of death.", "Dido's Lament opens with a descending chromatic fourth line, the ground bass, which is repeated eleven times throughout the aria, thus structuring the piece in the form of a ciaccona.", "The meter is in the key of G minor." ] ], "gold": "The aria \"When I am laid in earth\" is Dido's Lament from the opera \"Dido and Aeneas\" by Henry Purcell. It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass.", "prediction 1": "Dido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\" by Henry Purcell (libretto by Nahum Tate). It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass. The conductor Leopold Stokowski wrote a transcription of the piece for symphony orchestra. It is played annually in London by the massed bands of the Guards Division at the Cenotaph remembrance parade at the Cenotaph remembrance parade in Whitehall on Remembrance Sunday, the Sunday nearest to November 11 (Armistic Day).", "prediction 2": "Dido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\" by Henry Purcell (libretto by Nahum Tate). It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass. The conductor Leopold Stokowski wrote a transcription of the piece for symphony orchestra. It is played annually in London by the massed bands of the Guards Division at the Cenotaph remembrance parade in Whitehall on Remembrance Sunday, the Sunday nearest to November 11 (Armistic Day).", "prediction 3": "Dido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\" by Henry Purcell, with the passus duriusculus in the ground bass. The conductor Leopold Stokowski wrote a transcription of the piece for symphony orchestra.", "prediction 4": "Dido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\" by Henry Purcell. It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass. The conductor Leopold Stokowski wrote a transcription of the piece for symphony orchestra.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 576 } ], "missing-info": [], "corrected-prediction": "Dido's Lament is the aria \"When I am laid in earth\" from the opera \"Dido and Aeneas\". It is included in many classical music textbooks on account of its exemplary use of the passus duriusculus in the ground bass. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Which type of hormone receptor plasma membrane bound or intracellular?", "passages": [ [ "Hormone receptor", "Hormone receptor\n\nA hormone receptor is a receptor molecule that binds to a specific hormone.", "Hormone receptors are a wide family of proteins made up of receptors for thyroid and steroid hormones, retinoids and Vitamin D, and a variety of other receptors for various ligands, such as fatty acids and prostaglandins.", "There are two main classes of hormone receptors.", "Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors.", "An example of this is insulin.", "Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors, such as testosterone.", "Upon hormone binding, the receptor can initiate multiple signaling pathways, which ultimately leads to changes in the behavior of the target cells.", "Hormonal therapy and hormone receptors play a very large part in breast cancer treatment (therapy is not limited to only breast cancer).", "By influencing the hormones, the cells' growth can be changed along with its function.", "These hormones can cause cancer to not survive in the human body.", "Hormone receptor proteins bind to a hormone as a result of an accumulation of weak interactions.", "Because of the relatively large size of enzymes and receptors, the large amount of surface area provides the basis for these weak interactions to occur." ], [ "Hormone receptor", "This is the mechanism through which receptors can induce regulation of gene expression depending on both the extracellular environment and the immediate cellular composition.", "Steroid hormones and their regulation by receptors are the most potent molecule interactions in aiding gene expression.", "Problems with nuclear receptor binding as a result of shortages of ligand or receptors can have drastic effects on the cell.", "The dependency on the ligand is the most important part in being able to regulate gene expression, so the absence of ligand is drastic to this process.", "For example, estrogen deficiency is a cause of osteoporosis and the inability to undergo a proper signaling cascade prevents bone growth and strengthening.", "Deficiencies in nuclear receptor-mediated pathways play a key role in the development of disease, like osteoporosis.", "Water-soluble hormones include glycoproteins, catecholamines, and peptide hormones composed of polypeptides, e.g. thyroid-stimulating hormone, follicle-stimulating hormone, luteinizing hormone and insulin.", "These molecules are not lipid-soluble and therefore cannot diffuse through cell membranes.", "Consequently, receptors for peptide hormones are located on the plasma membrane because they have bound to a receptor protein located on the plasma membrane.", "Water-soluble hormones come from amino acids and are located and stored in endocrine cells until actually needed." ], [ "Hormone receptor", "The main two types of transmembrane receptor hormone receptor are the G-protein-coupled receptors and the enzyme-linked receptors.", "These receptors generally function via intracellular second messengers, including cyclic AMP (cAMP), cyclic GMP (cGMP), inositol 1,4,5-trisphosphate (IP3) and the calcium (Ca)-calmodulin system.", "Steroid hormone receptors and related receptors are generally soluble proteins that function through gene activation.", "Lipid-soluble hormones target specific sequences of DNA by diffusing into the cell.", "When they have diffused into the cell, they bind to receptors (intracellular), and migrate into the nucleus.", "heir response elements are DNA sequences (promoters) that are bound by the complex of the steroid bound to its receptor.", "The receptors themselves are zinc-finger proteins.", "These receptors include those for glucocorticoids (glucocorticoid receptors), estrogens (estrogen receptors), androgens (androgen receptors), thyroid hormone (T3) (thyroid hormone receptors), calcitriol (the active form of vitamin D) (calcitriol receptors), and the retinoids (vitamin A) (retinoid receptors)." ] ], "gold": "There are two main classes of hormone receptors. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. An example of this is insulin. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors, such as testosterone. ", "prediction 1": "A hormone receptor is a receptor molecule that binds to a specific hormone. There are two main classes of hormone receptors, the transmembrane receptor and the enzyme-linked receptor. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors, such as testosterone.", "prediction 2": "A hormone receptor is a receptor molecule that binds to a specific hormone. There are two main classes of hormone receptor. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors.", "prediction 3": "A hormone receptor is a molecule that binds to a specific hormone. There are two main classes of hormone receptors. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors, such as testosterone.", "prediction 4": "A hormone receptor is a molecule that binds to a specific hormone. There are two main classes of hormone receptor. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 75 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4,6]}", "start": 160, "end": 183 } ], "missing-info": [], "corrected-prediction": "There are two main classes of hormone receptors. Receptors for peptide hormones tend to be cell surface receptors built into the plasma membrane of cells and are thus referred to as trans membrane receptors. Receptors for steroid hormones are usually found within the cytoplasm and are referred to as intracellular or nuclear receptors, such as testosterone." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Since when is puerto rico part of the us?", "passages": [ [ "Political status of Puerto Rico", "Puerto Rico has been under U.S. sovereignty for over a century and Puerto Ricans have been U.S. citizens since 1917.", "Since the promulgation of the current Commonwealth constitution in 1952, further local attempts to change the island's political status took place in 1967, 1993, and 1998.", "An additional referendum held in 1991 sought to amend the relationship through an amendment to the Puerto Rican constitution.", "Each time, the results favored retaining the current status over the possible independence of Puerto Rico and statehood alternatives.", "As a result of Puerto Rico's status as a U.S. territory, the citizens of Puerto Rico do not have any voting representation in the U.S. Federal government.", "Instead of outright representation through Senators and House Representatives, Puerto Rico has one non-voting Resident Commissioner in the House of Representatives.", "Furthermore, Puerto Rico is not represented in the Electoral College, and thus U.S. citizens resident there are unable to vote in U.S. presidential elections.", "Citizens of Puerto Rico can vote in the Republican and Democratic primary elections.", "Although Puerto Rico presently has a certain amount of local autonomy, according to the U.S. Constitution ultimate governance of the island is retained by both the U.S. Congress and President." ], [ "Puerto Rico", "Recent research suggests that the U.S. did consider Puerto Rico valuable as a naval station, and recognized that it and Cuba generated lucrative crops of sugar \u2013 a valuable commercial commodity which the United States lacked, before the development of the sugar beet industry in the United States.", "On July 25, 1898, during the Spanish\u2013American War, the U.S. invaded Puerto Rico with a landing at Gu\u00e1nica.", "As an outcome of the war, Spain ceded Puerto Rico, along with the Philippines and Guam, then under Spanish sovereignty, to the U.S. under the Treaty of Paris, which went into effect on April 11, 1899.", "Spain relinquished sovereignty over Cuba, but did not cede it to the U.S.", "The United States and Puerto Rico began a long-standing metropolis-colony relationship.", "In the early 20th century, Puerto Rico was ruled by the military, with officials including the governor appointed by the President of the United States.", "The Foraker Act of 1900 gave Puerto Rico a certain amount of civilian popular government, including a popularly elected House of Representatives.", "The upper house and governor were appointed by the United States.", "Its judicial system was constructed to follow the American legal system; a Puerto Rico Supreme Court and a United State District Court for the territory were established.", "It was authorized a non-voting member of Congress, by the title of \"Resident Commissioner\", who was appointed." ] ], "gold": "Puerto Rico, which has been under U.S. sovereignty for over a century, was acquired by the U.S. in 1898, but Puerto Ricans did not become U.S. citizens until 1917.", "prediction 1": "Puerto Rico has been under U.S. sovereignty for over a century and Puerto Ricans have been U.S. citizens since 1917. As a result of Puerto Rico's status as a U.S. territory, the citizens of Puerto Rico do not have any voting representation in the U.S. Federal government. Instead, Puerto Rico has one non-voting Resident Commissioner in the House of Representatives. Additionally, Puerto Rico is not represented in the Electoral College, and thus U.S. citizens resident there are unable to vote in U.S. presidential elections.", "prediction 2": "Puerto Rico has been under U.S. sovereignty for over a century and Puerto Ricans have been U.S. citizens since 1917. As a result of Puerto Rico's status as a U.S. territory, the citizens of Puerto Rico do not have any voting representation in the U.S. Federal government. Instead, Puerto Rico has one non-voting Resident Commissioner in the House of Representatives.", "prediction 3": "Since the promulgation of the current Commonwealth constitution in 1952, further local attempts to change Puerto Rico's political status have taken place in 1967, 1993, and 1998. An additional referendum held in 1991 sought to amend the relationship through an amendment to the Puerto Rican constitution. As a result of Puerto Rico's status as a U.S. territory, the citizens of Puerto Rico do not have any voting representation in the U.S. Federal government. Instead, Puerto Rico has one non-voting Resident Commissioner in the House of Representatives.", "prediction 4": "Puerto Rico has been under U.S. sovereignty for over a century, its citizens have been U.S. citizens since 1917. Since the promulgation of the current Commonwealth constitution in 1952, further local attempts to change the island's political status took place in 1967, 1993, and 1998. An additional referendum held in 1991 sought to amend the relationship through an amendment to the Puerto Rican constitution. As a result of Puerto Rico's status as a U.S. territory, the citizens of Puerto Rico do not have any voting representation in the U.S.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 526 } ], "missing-info": [], "corrected-prediction": "Puerto Rico has been under U.S. sovereignty for over a century and Puerto Ricans have been U.S. citizens since 1917. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the first shot of the revolutionary war fired?", "passages": [ [ "Shot heard round the world", "In 1894, Lexington petitioned the state legislature to proclaim April 19 as \"Lexington Day\", to which Concord objected; the current name for the holiday is Patriots' Day.", "Emerson lived in a house known as the Old Manse at the time when he was composing the \"Concord Hymn,\" from which his grandfather and father (then a young child) had witnessed the skirmish.", "The house is located approximately from the North Bridge.", "The phrase \"shot heard round the world\" (alternatively \"shots heard round the world\" or \"shot heard around the world\") has also become associated with the assassination of Archduke Franz Ferdinand of Austria in Sarajevo on 28 June 1914, an event considered to be one of the immediate causes of World War I. Serbian Gavrilo Princip fired two shots, the first hitting Franz Ferdinand's wife Sophie, Duchess of Hohenberg, and the second hitting the Archduke himself.", "The death of Franz Ferdinand, heir to the Austro-Hungarian throne, propelled Austria-Hungary and the rest of Europe into World War I.", "The phrase \"Shot heard round the world\" continues to be a stock phrase in the 21st century, widely used to refer to extraordinary events in general.", "The phrase has been applied to several dramatic moments in sports history, for example." ], [ "Shot heard round the world", "Shot heard round the world\n\n\"The shot heard round the world\" is a phrase referring to several historical incidents, particularly the opening of the American Revolutionary War in 1775 and the assassination of Archduke Franz Ferdinand in 1914.", "The phrase comes from the opening stanza of Ralph Waldo Emerson's \"Concord Hymn\" (1837) and refers to the first shot of the American Revolution at the Old North Bridge in Concord, Massachusetts, where the first British soldiers fell in the battles of Lexington and Concord.", "Historically, no single shot can be cited as the first shot of the battle or the war.", "Shots were fired earlier at Lexington, Massachusetts where eight Americans were killed and a British soldier was slightly wounded, but accounts of that event are confused and contradictory.", "The North Bridge skirmish did see the first shots by Americans acting under orders, the first organized volley by Americans, the first British fatalities, and the first British retreat.", "The towns of Lexington and Concord have debated over the point of origin for the Revolutionary War since 1824, when the Marquis de Lafayette visited the towns.", "He was welcomed to Lexington hearing it described as the \"birthplace of American liberty\", but he was then informed in Concord that the \"first forcible resistance\" was made there.", "President Ulysses Grant considered not attending the 1875 centennial celebrations in the area to evade the issue." ] ], "gold": "The first shot in the Revolutionary war was fired on April 19, 1775 in the Battle of Concord.", "prediction 1": "\"The shot heard round the world\" is a phrase referring to several historical incidents, particularly the opening of the American Revolutionary War in 1775 and the assassination of Archduke Franz Ferdinand in Sarajevo on 28 June 1914. Shots were fired earlier at Lexington, Massachusetts where eight Americans were killed and a British soldier was slightly wounded, but accounts of that event are confused and contradictory. Historically, no single shot can be cited as the first shot of the battle or the war.", "prediction 2": "The phrase \"shot heard round the world\" refers to several historical incidents, particularly the opening of the American Revolutionary War in 1775 and the assassination of Archduke Franz Ferdinand in Sarajevo on 28 June 1914. Shots were fired earlier at Lexington, Massachusetts where eight Americans were killed and a British soldier was slightly wounded, but accounts of that event are confused and contradictory. The first shot of the Americans Revolutionary War was fired at the Old North Bridge in Concord, Massachusetts, where the first British soldiers fell in the battles of Lexington and Concord.", "prediction 3": "The phrase \"The shot heard round the world\" is a phrase referring to several historical incidents, particularly the opening of the American Revolutionary War in 1775 and the assassination of Archduke Franz Ferdinand in Sarajevo on 28 June 1914. Shots were fired earlier at Lexington, Massachusetts where eight Americans were killed and a British soldier was slightly wounded, but accounts of that event are confused and contradictory. The first shot of the Revolutionary War was fired at the Old North Bridge in Concord, Massachusetts, where the first British soldiers fell in the battles of Lexington and Concord.", "prediction 4": "The phrase \"shot heard round the world\" is a phrase referring to several historical incidents, particularly the opening of the American Revolutionary War in 1775 and the assassination of Archduke Franz Ferdinand in Sarajevo on 28 June 1914, an event considered to be one of the immediate causes of World War I. Shots were fired earlier at Lexington, Massachusetts where eight Americans were killed and a British soldier was slightly wounded, but accounts of that event are confused and contradictory.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 423 }, { "error type": "Irrelevant", "explanation": "", "start": 424, "end": 509 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 87 } ], "missing-info": [], "corrected-prediction": "The first shot in the American Revolutionary War was in 1775." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "The first article of the texas constitution concerns?", "passages": [ [ "Constitution of Texas", "Article 1 is the Texas Constitution's bill of rights.", "The article originally contained 29 sections; four sections have since been added.", "Some of the article's provisions concern specific fundamental limitations on the power of the state.", "The provisions of the Texas Constitution apply only against the government of Texas.", "However, a number of the provisions of the U.S. Constitution are held to apply to the states as well, under the Due Process Clause of the 14th Amendment to the U.S. Constitution.", "Section 4 purports to prohibit office holders from the requirements of any religious test, provided they \"acknowledge the existence of a Supreme Being\".", "This conflicts with the U.S. Constitution's No Religious Test Clause, and would almost certainly be held unenforceable if challenged, as was a similar South Carolina requirement in \"Silverman v. Campbell\", and a broader Maryland restriction in \"Torcaso v. Watkins\".", "Section 32 denies state recognition to same-sex unions, a practice which was invalidated as a consequence of \"Obergefell v. Hodges\".", "Article 2 provides for the separation of powers of the legislative, executive, and judicial branches of the state government, prohibiting each branch from encroaching on the powers of the others." ], [ "Constitution of the Republic of Texas", "The Constitution of the Republic of Texas contains nine portions, six Articles, Schedule, General Provisions, and Declaration of Rights.", "Article I establishes the three branches of government, Legislative, Executive, and Judicial.", "It contains sections that define in greater detail the Legislative branch.", "The Legislature is defined as a Senate and House of Representatives that are to be called The Congress of the Republic of Texas.", "Members of the House are to be chosen on the first Monday of September and to hold their office for one year until other provisions are made.", "In order for someone to hold a seat in the House they need to be at least twenty five, a citizen of the republic, and to reside in the county or district they represent for six months prior to election.", "The House is not to consist of less than twenty four or more than forty members until the population reaches one hundred thousand, then it shall not be less than forty or more than one hundred members.", "Senators are chosen by their districts equal in free population, this only counts the white population.", "The number of senators is to never be less than one third or more than one half of Representatives.", "Each district is to have one member.", "Senators are chosen for a three-year term on the first Monday of September.", "They have to be citizens of the Republic, reside in the district they represent for at least one year before election, and be at least thirty." ], [ "Constitution of Texas", "Constitution of Texas\n\nThe Constitution of the State of Texas is the document that describes the structure and function of the government of the U.S. state of Texas.", "The current document took effect on February 15, 1876, and is the seventh (including the Mexican constitution) constitution in Texas history.", "The previous six were adopted in 1827 (while Texas was still part of Mexico), 1836 (as the Republic of Texas), 1845, 1861, 1866 and 1869.", "The current constitution is among the longest of state constitutions in the United States.", "From 1876 to 2015 the legislature proposed 673 constitutional amendments, of which 491 were approved by the electorate and 179 defeated.", "Most of the amendments are due to the document's highly restrictive nature: the State of Texas has only those powers explicitly granted to it by the Constitution.", "However, despite its length, it is not nearly as long as the Alabama Constitution (which has been amended over 800 times despite having been adopted 25 years after Texas' current constitution) nor the California Constitution (which, due to provisions allowing amendments via initiative, is subject to frequent revision).", "As with many state constitutions, it explicitly provides for the separation of powers and incorporates its bill of rights directly into the text of the constitution (as Article I).", "The bill of rights is considerably lengthier and more detailed than the federal Bill of Rights, and includes some provisions unique to Texas." ] ], "gold": "The current Constitution of the State of Texas was adopted on February 15, 1876, and is the seventh constitution in Texas history. The first article of the Constitution of the State of Texas is the state's bill of rights. Another Texas constitution, The Constitution of the Republic of Texas, was the supreme law of Texas from 1836 to 1845. The first article of The Constitution of the Republic of Texas establishes the three branches of government for the state, Legislative, Executive, and Judicial.", "prediction 1": "The state constitution of Texas, in its current form, describes the structure and function of the government of the U.S. state of Texas. It is the document that describes the structure and function of the government of the state of Texas. Article 1 is the Texas Constitution's bill of rights. The article originally contained 29 sections; four sections have since been added. Some of the article's provisions concern specific fundamental limitations on the power of the state.", "prediction 2": "The Texas Constitution defines the structure and function of the government of the state of Texas. Article 1 is the Texas Constitution's bill of rights. The article originally contained 29 sections; four sections have since been added. Some of the article's provisions concern specific fundamental limitations on the power of the state.", "prediction 3": "The Texas Constitution is the document that describes the structure and function of the government of the U.S. state of Texas. Article I establishes the three branches of government, Legislative, Executive, and Judicial. Article 2 provides for the separation of powers of the legislative, executive, and judicial branches of the state government, prohibiting each branch from encroaching on the powers of the others. Some of the article's provisions concern specific fundamental limitations on the power of the state. Article I also establishes the power of the legislature.", "prediction 4": "The first article of the Texas constitution concerns the separation of powers of the legislative, executive, and judicial branches of government in Texas. Article 1 deals with individual rights. The article originally contained 29 sections. Four sections have since been added.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 136 }, { "error type": "Redundant", "explanation": "The state constitution of Texas, in its current form, describes the structure and function of the government of the U.S. state of Texas. ", "start": 137, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 476 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The current Texas Constitution took effect on February 15, 1876, and is the seventh constitution in Texas history. Article 1 is the Texas Constitution's bill of rights. There was another called The Constitution of the Republic of Texas. Article I establishes the three branches of government, Legislative, Executive, and Judicial." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who led the confederate army in the battle of gettysburg?", "passages": [ [ "Battle of Gettysburg", "Battle of Gettysburg\n\nThe Battle of Gettysburg () was fought July 1\u20133, 1863, in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War.", "The battle involved the largest number of casualties of the entire war and is often described as the war's turning point.", "Union Maj. Gen. George Meade's Army of the Potomac defeated attacks by Confederate Gen. Robert E. Lee's Army of Northern Virginia, halting Lee's invasion of the North.", "After his success at Chancellorsville in Virginia in May 1863, Lee led his army through the Shenandoah Valley to begin his second invasion of the North\u2014the Gettysburg Campaign.", "With his army in high spirits, Lee intended to shift the focus of the summer campaign from war-ravaged northern Virginia and hoped to influence Northern politicians to give up their prosecution of the war by penetrating as far as Harrisburg, Pennsylvania, or even Philadelphia.", "Prodded by President Abraham Lincoln, Maj. Gen. Joseph Hooker moved his army in pursuit, but was relieved of command just three days before the battle and replaced by Meade.", "Elements of the two armies initially collided at Gettysburg on July 1, 1863, as Lee urgently concentrated his forces there, his objective being to engage the Union army and destroy it.", "Low ridges to the northwest of town were defended initially by a Union cavalry division under Brig." ], [ "Battle of Gettysburg", "Gen. John Buford, and soon reinforced with two corps of Union infantry.", "However, two large Confederate corps assaulted them from the northwest and north, collapsing the hastily developed Union lines, sending the defenders retreating through the streets of the town to the hills just to the south.", "On the second day of battle, most of both armies had assembled.", "The Union line was laid out in a defensive formation resembling a fishhook.", "In the late afternoon of July 2, Lee launched a heavy assault on the Union left flank, and fierce fighting raged at Little Round Top, the Wheatfield, Devil's Den, and the Peach Orchard.", "On the Union right, Confederate demonstrations escalated into full-scale assaults on Culp's Hill and Cemetery Hill.", "All across the battlefield, despite significant losses, the Union defenders held their lines.", "On the third day of battle, fighting resumed on Culp's Hill, and cavalry battles raged to the east and south, but the main event was a dramatic infantry assault by 12,500 Confederates against the center of the Union line on Cemetery Ridge, known as Pickett's Charge.", "The charge was repulsed by Union rifle and artillery fire, at great loss to the Confederate army.", "Lee led his army on a torturous retreat back to Virginia." ], [ "Pickett's Charge", "Pickett's Charge\n\nPickett's Charge was an infantry assault ordered by Confederate Gen. Robert E. Lee against Maj. Gen. George G. Meade's Union positions on July 3, 1863, the last day of the Battle of Gettysburg in the state of Pennsylvania during the American Civil War.", "Its futility was predicted by the charge's commander, Lt. Gen. James Longstreet, and it was arguably an avoidable mistake from which the Southern war effort never fully recovered militarily or psychologically.", "The farthest point reached by the attack has been referred to as the high-water mark of the Confederacy.", "The charge is named after Maj. Gen. George Pickett, one of three Confederate generals who led the assault under Longstreet.", "Pickett's Charge was part of Lee's \"general plan\" to take Cemetery Hill and the network of roads it commanded.", "His military secretary, A. L. Long, described Lee's thinking:\n\nOn the night of July 2, Meade correctly predicted to General Gibbon, after a council of war, that Lee would attack the center of his lines the following morning.", "The infantry assault was preceded by a massive artillery bombardment that was meant to soften up the Union defense and silence its artillery, but was largely ineffective." ] ], "gold": "The Battle of Gettysburg was fought in and around Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. General Robert E. Lee lead the Confederate Army into battle. On the third day, an infantry assault ordered by General Lee battled the center of the Union line on Cemetery Ridge, which is known as Pickett's Charge. The leaders of Pickett's Charge were George Pickett, James Longstreet, Isaac R. Trimble, and J. Johnston Pettigrew.", "prediction 1": "The battle of Gettysburg was fought July 1\u20133, 1863, in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. The battle involved the largest number of casualties of the entire war and is often described as the war's turning point. The Confederate army's objective was to engage the Union army and destroy it. But Pickett's Charge, an infantry assault ordered by Confederate Gen. Robert E. Lee against Maj. Gen. George G. Meade's Army of the Potomac, defeated attacks by Union Maj. Gen. John Buford, and soon reinforced with two large Confederate corps assaulted them from the northwest and north, collapasing the hastily developed Union lines.", "prediction 2": "The Battle of Gettysburg was fought July 1\u20133, 1863, in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. Confederate Maj. Gen. George G. Meade led the Union army on the day, and was succeeded by his deputy, Maj. Gen. Joseph Hooker. Pickett's Charge was an infantry assault ordered by Confederate Gen. Robert E. Lee against Maj. Gen. George G. Meade's Union positions.", "prediction 3": "The Battle of Gettysburg was fought July 1\u20133, 1863, in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. Pickett's Charge was an infantry assault ordered by Confederate Gen. Robert E. Lee against Maj. Gen. George G. Meade's Union positions on the last day of the Battle of Gettysburg in the state of Pennsylvania during the American Civil War. Pickett's Charge was repulsed by Union rifle and artillery fire, at great loss to the Confederate army. The charge was ordered by Confederate generals who led the assault under Longstreet. Pickett was one of three Confederate generals who led the battle under Longstreet.", "prediction 4": "The Battle of Gettysburg was fought July 1\u20133, 1863, in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. The battle involved the largest number of casualties of the entire war and is often described as the war's turning point. Confederate General Robert E. Lee ordered an infantry assault against the center of the Union line on Cemetery Ridge, known as Pickett's Charge. The charge was repulsed by Union rifle and artillery fire, at great loss to the Confederate army.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 507 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,2,3]}", "start": 508, "end": 556 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,2,3]}", "start": 561, "end": 643 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2, 4 ] } ], "corrected-prediction": "The battle of Gettysburg was fought in and around the town of Gettysburg, Pennsylvania, by Union and Confederate forces during the American Civil War. Pickett's Charge was an infantry assault ordered by Confederate Gen. Robert E. Lee against the center of the Union's line on Cemetery Ridge. The charge's commander was Lt. Gen. James Longstreet and is named after Maj. Gen. George Pickett, one of 3 Confederate generals under Longstreet. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who played wags the dog in the wiggles?", "passages": [ [ "The Wiggles characters", "Field described Paddick as \"just as funny offstage as on\", For many parents, his vocal impersonations were \"the high point of the Wiggles stage show\" and included singers Mick Jagger, Cher, Pl\u00e1cido Domingo and James Hetfield.", "Introduced in 1992, Henry the Octopus, who directs an underwater band and loves to dance with his eight legs\".", "He was named after Tony Henry, the drummer in The Cockroaches, who also provided The Wiggles with musical support throughout the years.", "The character was developed by Fatt, who originally served as Henry's voice.", "Paul Paddick took over the role of the voice in the mid-2000s.", "He has appeared as both a puppet and a mascot, the latter of which has been played by various dancers on staff.", "Introduced in 1995, Wags is a tall, brown, furry dog with floppy ears and a happy face.", "He \"loves to sing and dance and kids bring 'bones' that the Wiggly dancers collect from the audience\".", "The last of the four characters to be introduced, Wags was originally played by Field.", "Fatt provided the original barking noises for Wags before Paul Field, general manager of The Wiggles and brother of Blue Wiggle Anthony took over.", "Mic Conway of The Captain Matchbox Whoopee Band fame, has provided Wags's full-spoken dialogue." ], [ "Wiggle Time", "The video listed The Wiggles as: Jeff Fatt, Greg Page, Murray Cook, Anthony Field.", "The dance segments were choreographed by Jacqueline Fallon, and performed by Jacqueline Fallon and Mary Anne Rose Hull.", "There is also a listing \"Thanks to the Children\" naming: Luke, Clare and Joseph Field; Anthony, Sofia and Leonardo Silvestrini; Timothy and James Rioseco; Nicholas Raymond Donald Hull.", "The video was released in Australia in September 1993 on VHS.", "The Wiggles video Wiggle Time was re", "-recorded and released in 1998", ".", "The songs and skits are updated from the 1993 version, except for \"Fruit Salad\".", "The closing skit where Jeff tries to wake the other Wiggles up does not appear on the 1998 version.", "Songs were added to the video, including \"Ponies\", \"Quack Quack\", and three bonus songs from one of their concerts.", "The video had the following songs and major skits.", "This is the cast listing according to the closing credits:\n\n\nBecause the video was released after \"The Wiggles Movie\", The Wiggles' costumes had been updated to feature logos on their shirts.", "Anthony now consistently wears a blue shirt, Paul Paddick plays Captain Feathersword, and Wags the Dog is a regular character.", "The Wiggles released both \"Wiggle Time\" and \"Yummy Yummy\" in 1998." ] ], "gold": "Wags the Dog is a Wiggles character who is a tall, brown, furry dog with floppy ears and a happy face. Anthony Field originally played Wags, with Mic Conway providing Wags's full-spoken dialogue. Wags's barking voice was first played by Jeff Fatt, before Anthony's brother, Paul Field, took over.", "prediction 1": "The Wiggles introduced Wags the Dog in 1995. The character was originally played by Anthony Field. The Wiggles video Wiggle Time was re -recorded and released in 1998.\n", "prediction 2": "The Wiggles TV show re-created the character of Wags in 1995, but this time, the role was taken over by Paul Paddick.", "prediction 3": "The character Wags the Dog was introduced in 1995. Genevieve Lambert started playing him in 1996, and her mother Joan Lambert played him from 1996-2000.", "prediction 4": "The Wiggles first introduced Wags the Dog in 1995. In 1998, The Wiggles video Wiggle Time was re -recorded with new songs and major skits. Paul Paddick played Wags in the re-released version of the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 44 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 168 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The character Wags is a tall, brown, furry dog with floppy ears and a happy face. It was originally played by Anthony Field. Jeff Fatt provided the original barking noises for Wags before Paul Field, brother of Blue Wiggle Anthony took over. Mic Conway has provided Wags's full-spoken dialogue.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where does st louis cardinals have spring training?", "passages": [ [ "Roger Dean Stadium", "Roger Dean Stadium\n\nRoger Dean Stadium (officially known as Roger Dean Chevrolet Stadium) is a baseball stadium located in the Abacoa community of the town of Jupiter, Florida.", "The stadium was built in 1998, holds 6,871 people, and features luxury sky-box seating, two levels of permanent seating, parking and concessions.", "The Roger Dean Stadium Complex is the only stadium in the country to host four minor league teams: the Jupiter Hammerheads and Palm Beach Cardinals of the Class A-Advanced Baseball Florida State League, and the Gulf Coast Marlins and Gulf Coast Cardinals of the Rookie-level Gulf Coast League.", "Roger Dean Stadium is one of only two stadiums in Florida to host two Major League Baseball teams annually for spring training: the Miami Marlins and St. Louis Cardinals (the other is The Ballpark of The Palm Beaches, which opened in 2017, hosting the Washington Nationals and Houston Astros).", "In both venues, the teams share the main stadium where the games are played.", "However, the teams have their own practice fields, outdoor batting cages, several pitching mounds, and state-of-the-art conditioning rooms.", "Through 2002 the Montreal Expos shared the stadium with the Cardinals, until they swapped with the Marlins as part of the Marlins sale to Jeffrey Loria.", "The Expos, now known as the Washington Nationals, then moved to Space Coast Stadium in Viera." ], [ "St. Louis Cardinals", "In 1953, the Anheuser-Busch Brewery purchased the Cardinals and the new owner subsequently also purchased Sportsman's Park from the Browns and renamed it Busch Stadium, later becoming Busch I.", "The Browns then left St. Louis for Baltimore after the season.", "The Cardinals built Busch Memorial Stadium, or Busch II, in downtown St. Louis, opened it during the 1966 season and played there until 2005.", "It was built as the multi-purpose stadium home of both the baseball Cardinals and the NFL football Cardinals, who are now the Arizona Cardinals.", "The current Busch Stadium was constructed adjacent to, and partly atop, the site of Busch Memorial Stadium.", "The Cardinals home field in spring training is Roger Dean Stadium in Jupiter, Florida.", "They share the complex, which opened in 1998, with the Miami Marlins.", "Before moving to Jupiter, the Cardinals hosted spring training at Al Lang Field in St. Petersburg, Florida from 1937 to 1997.", "The Cardinals have exceeded the attendance total of 3 million every season since 2004.", "The Cardinals have had few logos throughout their history, although those logos have evolved over time.", "The first logo associated with the Cardinals was an interlocking \"SL\" that appeared on the team's caps and or sleeves as early as 1900.", "Those early uniforms usually featured the name \"St. Louis\" on white home and gray road uniforms which both had cardinal red accents." ] ], "gold": "The St. Louis Cardinals have spring training in Jupiter, FL at the Roger Dean Stadium.", "prediction 1": "St. Louis Cardinals have spring training at Roger Dean Stadium in Jupiter, Florida, where they share the complex with the Miami Marlins. At Al Lang Field in St. Petersburg, Florida from 1937 to 1997, the Cardinals had spring training at the end of the 1940s and began moving to Jupiter in 1937.", "prediction 2": "The St. Louis Cardinals have spring training at Roger Dean Stadium in Jupiter, Florida.", "prediction 3": "In 2018, the St. Louis Cardinals had spring training at Roger Dean Stadium in Jupiter, Florida. The Cardinals have been training there since the beginning of 2019.", "prediction 4": "The St. Louis Cardinals have spring training at Roger Dean Stadium in Jupiter, Florida. The Cardinals have spring training at Al Lang Field in St. Petersburg, Florida from 1937 to 1997.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 294 } ], "missing-info": [], "corrected-prediction": "St. Louis Cardinals have spring training at Roger Dean Stadium in Jupiter, Florida." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where does the umbilical vein enter the circulation of the fetus?", "passages": [ [ "Fetus", "The prenatal circulation of blood is different than the postnatal circulation, mainly because the lungs are not in use.", "The fetus obtains oxygen and nutrients from the mother through the placenta and the umbilical cord.", "Blood from the placenta is carried to the fetus by the umbilical vein.", "About half of this enters the fetal \"ductus venosus\" and is carried to the inferior vena cava, while the other half enters the liver proper from the inferior border of the liver.", "The branch of the umbilical vein that supplies the right lobe of the liver first joins with the portal vein.", "The blood then moves to the right atrium of the heart.", "In the fetus, there is an opening between the right and left atrium (the \"foramen ovale\"), and most of the blood flows from the right into the left atrium, thus bypassing pulmonary circulation.", "The majority of blood flow is into the left ventricle from where it is pumped through the aorta into the body.", "Some of the blood moves from the aorta through the internal iliac arteries to the umbilical arteries, and re-enters the placenta, where carbon dioxide and other waste products from the fetus are taken up and enter the woman's circulation." ] ], "gold": "Blood from the placenta is carried to the fetus by the umbilical vein. In humans, less than a third of this enters the fetal \"ductus venosus\" and is carried to the inferior vena cava, while the rest enters the liver proper from the inferior border of the liver. The branch of the umbilical vein that supplies the right lobe of the liver first joins with the portal vein.", "prediction 1": "The umbilical vein supplies the right lobe of the liver and supplies the right atrium of the heart. The branch of the umbilical vein that supplies the right lobe of the liver first joins with the portal vein and the blood moves to the right atrium of the heart.", "prediction 2": "The umbilical vein is a branch of the umbilical artery that supplies the right lobe of the liver. It enters the circulation of the fetus from the placenta and from the umbilical cord. Half of the umbilical vein enters the fetal \"ductus venosus\" and is carried to the inferior vena cava, while the other half enters the liver proper from the inferior border of the liver.", "prediction 3": "The umbilical vein supplies the right lobe of the liver and supplies the left atrium. The branch of the umbilical vein that supplies the right lobe of the liver first joins with the portal vein. The blood then moves to the right atrium of the heart. The blood re-enters the placenta and enters the fetal \"ductus venosus\" and is carried to the inferior vena cava.", "prediction 4": "The umbilical vein enters the circulation of the fetus through the placenta. Half of this enters the fetal \"ductus venosus\" and is carried to the inferior vena cava, while the other half enters the liver proper from the inferior border of the liver. In the fetus, there is an opening between the right and left atrium, the foramen ovale, and most of the blood flows from the right into the left atrium, bypassing pulmonary circulation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 261 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 99 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Blood from the placenta is carried to the fetus by the umbilical vein. About half of this enters the fetal \"ductus venosus\" and is carried to the inferior vena cava, while the other half enters the liver proper from the inferior border of the liver. The branch of the umbilical vein that supplies the right lobe of the liver first joins with the portal vein." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who played buffy and jody in family affair?", "passages": [ [ "Family Affair", "Gary Cole played the role of \"Uncle Bill\" Davis and Tim Curry played Mr. Giles French.", "Fifteen episodes were produced, including the one-hour pilot, but only thirteen episodes were aired by The WB.", "Gold Key Comics, an imprint of Western Publishing, published four issues of a \"Family Affair\" comic book series from January to October 1970.", "Merchandising efforts centered on Anissa Jones' \"Buffy\" character.", "Several books were published, including the 1970 hardback \"Family Affair: Buffy Finds a Star\" by Gladys Baker Bond and \"Buffy's Cookbook\".", "There were dolls (Mattel's \"Small Talk Buffy\" and Mrs. Beasley, Buffy's doll on the show) and various other toys.", "A Mrs. Beasley doll, with her glasses missing, appears in the music video for the song \"California Tuffy\" by the Geraldine Fibbers.", "In \"\", the character of Zed (Bobcat Goldthwait) is seen watching the show in one scene, but ultimately turns it off after stating it is a \"re-run\"." ], [ "Family Affair", "Family Affair\n\nFamily Affair is an American sitcom that aired on CBS from September 12, 1966, to March 4, 1971.", "The series explored the trials of well-to-do engineer and bachelor Bill Davis (Brian Keith) as he attempted to raise his brother's orphaned children in his luxury New York City apartment.", "Davis's traditional English gentleman's gentleman, Mr. Giles French (Sebastian Cabot), also had adjustments to make as he became saddled with the responsibility of caring for 15-year-old Cissy (Kathy Garver) and the five-year-old twins, Jody (Johnny Whitaker) and Buffy (Anissa Jones).", "\"Family Affair\" ran for 138 episodes in five seasons.", "The show was created and produced by Edmund Hartmann and Don Fedderson, also known for \"My Three Sons\" and \"The Millionaire\".", "William \"Bill\" Davis, originally of Terre Haute, Indiana, is a successful civil engineer who develops major projects all over the world.", "A wealthy bachelor who often dates socialites, Bill lives in a large apartment on East 62 Street off Fifth Avenue, in Manhattan, and has a quintessential gentleman's gentleman, Giles French, for a valet.", "His quiet lifestyle is turned upside-down when his two nieces and nephew move in." ], [ "Family Affair (2002 TV series)", "Family Affair (2002 TV series)\n\nFamily Affair is a television comedy that aired on The WB from September 12, 2002 to March 13, 2003.", "It was a remake of the original 1966 television series.", "This version was from Sid and Marty Krofft, and was produced by Sid & Marty Krofft Pictures, Pariah Films, and Turner Television.", "The WB canceled the series after only airing thirteen of the fifteen episodes produced.", "Kathy Garver and Johnny Whitaker from the original series guest starred as Beverly and Kevin in the Christmas episode, \"Holiday Fever\".", "The series was created as a remake of the original 1966\u20131971 \"Family Affair\" television series.", "It was produced by Pariah Films and Turner Television, with Bob Young, Gavin Polone, Sid and Marty Krofft, and Randy Pope acting as the series' executive producers.", "It was filmed in the same CBS Studio City lot as the original series.", "It was picked up to series by The WB in May 2002, when it was announced that the series would anchor a new Thursday night comedy block for the network.", "Luke Benward originally played the role of Jody in the series pilot, but was replaced by Jimmy \"Jax\" Pinchak as Jody in subsequent episodes." ] ], "gold": "In the 1966 sitcom Family Affair, the character Buffy was played by Anissa Jones, and Jody was played by Johnny Whitaker. In the 2002 television comedy that was a remake of the original 1966 series, Buffy was played by Sasha Pieterse. Jody was played by Luke Benward in the pilot episode of the 2002 remake, but was replaced by Jimmy \"Jax\" Pinchak as Jody in subsequent episodes.", "prediction 1": "Family Affair is an American sitcom that aired on CBS from September 12, 1966, to March 4, 1971. It explored the trials of well-to-do engineer and bachelor Bill Davis as he attempted to raise his brother's orphaned children in his luxury New York City apartment. Davis's traditional English gentleman's gentleman, Mr. Giles French (Sebastian Cabot), also had adjustments to make as he became saddled with the responsibility of caring for 15-year-old Cissy (Kaver) and the five-year-old twins, Jody (Johnny Whitaker) and Buffy).", "prediction 2": "Family Affair is an American sitcom that aired on CBS from September 12, 1966, to March 4, 1971. In the 1970 comic book series Family Affair, Anissa Jones played Buffy. In the 2002 television series Family Affair, Johnny Whitaker played Jody. In the 2003 television series Family Affair, Anissa Jones played Buffy.", "prediction 3": "Family Affair is an American sitcom that aired on CBS from September 12, 1966, to March 4, 1971. In the original series, Kathy Garver and Johnny Whitaker guest star as Beverly and Kevin, respectively. In the 2002 TV series, Family Affair, the twins are played by John Whitaker and Jimmy \"Jax\" Pinchak.", "prediction 4": "Family Affair is an American sitcom that aired on CBS from September 12, 1966, to March 4, 1971. It explored the trials of well-to-do engineer and bachelor Bill Davis as he attempted to raise his brother's orphaned children in his luxury New York City apartment. Davis's traditional English gentleman's gentleman, Mr. Giles French, played by Sebastian Cabot, also had adjustments to make as he became saddled with the responsibility of caring for 15-year-old Cissy and the five-year-old twins, Jody (Jax) and Buffy, respectively).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 492 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "Family Affair is an American sitcom. Jody is played by Johnny Whitaker and Buffy is played by Anissa Jones. Family Affair is also a television comedy remake of the original. Luke Benward originally played the role of Jody in the series pilot, but was replaced by Jimmy \"Jax\" Pinchak as Jody in subsequent episodes." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most interceptions of all time?", "passages": [ [ "Interception", "This was the first time since 1994 that a defensive player was awarded the Grey Cup's top individual title.", "His most notable interception of the game was when he intercepted Ryan Dinwiddie's final pass and secured Saskatchewan's victory.", "Lester Hayes of the Oakland Raiders was one of the National Football League's (NFL) leaders at interceptions in the late 1970s and early 1980s.", "He was known for covering his chest, shoulders and forearms with a copious amount of the adhesive Stickum to help him hold on to the ball.", "After the NFL outlawed the use of such foreign substances in 1981, Hayes' success rate at interceptions dropped below average though that could be due to his reputation as a \"shutdown cornerback\", which discouraged opposing teams from throwing to his side of the field.", "He continued to use the substance, which he called \"pick juice\", by having it applied in smaller amounts to his wrists.", "Paul Krause holds the record for most career interceptions, with 81, and is tied for third place for most interceptions by an NFL rookie in his first season, with 12.", "He played his first three years in the NFL from 1964 to 1967 with the Washington Redskins but was traded to the Minnesota Vikings, where he spent most of his career.", "Krause played until 1979 and appeared in four Super Bowls with the Vikings.", "He was inducted into the Pro Football Hall of Fame in 1998." ] ], "gold": "Paul Krause has the most interceptions of all times in the National Football League. And, for the Canadian Football League, Less Browne has the most interceptions of all times.", "prediction 1": "Paul Krause has the most interceptions of all time. He has 81 career interceptions and is tied for third place for most interceptions by an NFL rookie in his first season, with 12.", "prediction 2": "Paul Krause holds the record for most career interceptions, with 81, and is tied for third place for most interceptions by an NFL rookie in his first season, with 12. Krause played his first three years in the NFL from 1964 to 1967 with the Washington Redskins but was traded to the Minnesota Vikings, where he spent most of his career.", "prediction 3": "Lester Hayes of the Oakland Raiders was one of the National Football League's (NFL) leaders at interceptions in the late 1970s and early 1980s. He was known for covering his chest, shoulders and forearms with a copious amount of the adhesive Stickum to help him hold on to the ball. Paul Krause holds the record for most career interceptions, with 81, and is tied for third place for most interceptions by an NFL rookie in his first season, with 12. He played his first season, with 12. He played his first three years in the NFL from 1964 to 1967, and appeared in four Super Bowls with the Minnesota Vikings.", "prediction 4": "Paul Krause has the most interceptions of all time, with 81. Lester Hayes has the most career interceptions, with 83.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 180 } ], "missing-info": [], "corrected-prediction": "Paul Krause has the most interceptions of all time in the National Football League. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where does dana air take off from in lagos?", "passages": [ [ "Associated Aviation Flight 361", "Associated Aviation Flight 361\n\nAssociated Aviation Flight 361 was a domestic charter flight operated by Associated Aviation that on 3 October 2013 crashed on takeoff from Lagos, Nigeria, killing 15 of the 20 people on board.", "The aircraft, a twin turboprop Embraer 120 Brasilia, was transporting the body of Nigerian politician Olusegun Agagu to Akure, Nigeria, for burial.", "The aircraft was conveying the body of former governor of Ondo State Olusegun Agagu from Lagos to Akure for burial.", "It lifted off from runway 18L of Murtala Mohammed Airport at about 09:32 local time (08:32 UTC).", "The crew received warnings from the aircraft's aural warning system during the takeoff-roll and also failed to make \"V1\" and \"rotate\" calls; the aircraft then struggled to gain altitude immediately after takeoff.", "Less than a minute after lifting off, the aircraft impacted terrain in a nose-down-and-near-90-degrees-bank attitude.", "Reports differ but according to the manifest the flight had 17 passengers and seven crew; four passengers and two crew survived the accident but one of passengers later died in hospital.", "Fatalities included relatives of Olusegun Agagu; and officials of the Ondo State Government.", "An elaborate burial ceremony planned for Agagu was postponed as a result of the crash." ] ], "gold": "Dana Air takes off from Terminal 2 at the Murtala Mohammed Airport in Lagos.", "prediction 1": "The flight took off from runway 18L on Murtala Mohammed Airport.", "prediction 2": "There are several places in Lagos where dana air takes off from. Murtala Mohammed International Airport has several takeoff runways. The runway 18L of Murtala Mohammed International Airport is where dana air takes off from.", "prediction 3": "Associated Aviation Flight 361 was a domestic charter flight operated by Associated Aviation that on 3 October 2013 crashed on takeoff from Lagos, killing 15 of the 20 people on board. The aircraft, a twin turboprop Embraer 120 Brasilia, was transporting the body of Nigerian politician Olusegun Agagu from Lagos to Akure, Nigeria, for burial. It lifted off from runway 18L of Murtala Mohammed Airport at about 09:32 local time (08:32 UTC).", "prediction 4": "Associated Aviation Flight 361 was a domestic charter flight operated by Associated Aviation that on 3 October 2013 crashed on takeoff from Lagos, killing 15 of the 20 people on board. The aircraft, a twin turboprop Embraer 120 Brasilia, was transporting the body of Nigerian politician Olusegun Agagu to Akure, Nigeria, for burial. It lifted off from runway 18L of Murtala Mohammed Airport at about 09:32 local time (08:32 UTC).", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The flight took off from runway 18L on Murtala Mohammed Airport." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "At what age do you start high school?", "passages": [ [ "Burnaby North Secondary School", "This indicates quite early that the program is not only large, but is also of high quality.", "In 2007, a total of 31 students achieved National AP Scholar status, the highest standing which requires an average score of 4 over five or more exams, surpassing the previous year's record of 18 and setting a national record.", "In 2008, a total of 97 students became AP Scholars, and 35 students achieved National AP Scholar status, again surpassing the previous year's record and setting a national record.", "In 2009, there were 86 AP Scholars and 23 National AP Scholars.", "In October 2013, Burnaby North announced that it will be offering the Advanced Placement (AP) Capstone Diploma starting in the 2014\u201315 school year.", "The AP Capstone program is a pilot program that is currently offered in a handful of schools worldwide.", "Burnaby North also offers a very well established Career Preparation program whereby students go out on work experience for between 30 and 90 hours.", "The goal is to introduce students to the world of work and to enable students to explore a career area that is of interest to them.", "Burnaby North is at the leading edge of the latest industry training programs (ACE-IT) that enable students to complete the first year theory exams and a portion of the on-the-job training requirements of an apprenticeship program." ] ], "gold": "In the US, the youngest students to typically enter the 9th grade are 13 years old, while the oldest are usually 14 years old. In Canada, however, students are typically 15 years old when entering high school.", "prediction 1": "The time of year when you start high school is the year you turn 18.", "prediction 2": "At what age do you start high school? At a minimum, it is at age 16, and at a maximum, it is at age 17.", "prediction 3": "At what age do you start high school? At what age do you start high school?", "prediction 4": "At what age do you start high school? At what age do you start high school? At what age do you start high school?", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 65, "end": 68 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When was the dubai metro green line opened to public?", "passages": [ [ "Green Line (Dubai Metro)", "Green Line (Dubai Metro)\n\nThe Green Line is one of the two lines in the Dubai Metro network in Dubai, United Arab Emirates.", "It runs through Deira and Bur Dubai, generally parallel to Dubai Creek.", "There are 20 stations in this line, spanning from Etisalat to Dubai Creek covering .", "The Green Line has 20 stations, including 12 elevated (by means of a viaduct), and 8 underground stations.", "The line is , with underground.", "It is served by 25 driverless trains travelling at an average speed of , and stopping 20\u201330 seconds at each station.", "Trial running began in October 2010, with the line inaugurated on 9 September 2011 and opened to the public the next day.", "The last 2 stations (Jaddaf and Dubai Creek) were opened on March 1, 2014.", "19 trains is currently running on green line and each of the train have seats capacity of 643 seats.", "The Green Line was initially long upon opening, however following the extension from Dubai Healthcare City to Dubai Creek, the length increased to long.", "There are two transfer stations, Union and BurJuman, where the Green and Red Lines intersect, allowing passengers to change between lines.", "The Green Line has its main depot in Al Qusais.", "Union station is touted to be one of the biggest metro stations in the world." ] ], "gold": "The first stations of the Dubai Metro green line opened to the public on September 10, 2011. Then, On March 1, 2014, Jaddaf and Dubai Creek were the last two stations to open.", "prediction 1": "The Green Line is one of the two lines in the Dubai Metro network in Dubai, United Arab Emirates. It runs through Deira and Bur Dubai, generally parallel to Dubai Creek. The line was inaugurated on 9 September 2011 and opened to the public the next day. The last 2 stations (Jaddaf and Dubai Creek) were opened on March 1, 2014.", "prediction 2": "The Green Line is one of the two lines in the Dubai Metro network in Dubai, United Arab Emirates. It runs through Deira and Bur Dubai, generally parallel to Dubai Creek. The Green Line was inaugurated on 9 September 2011 and opened to the public the next day.", "prediction 3": "The Dubai Metro Green Line is one of the two lines in the Dubai Metro network in Dubai, United Arab Emirates. It runs through Deira and Bur Dubai, generally parallel to Dubai Creek. It is served by 25 driverless trains travelling at an average speed of and stopping 20\u201330 seconds at each station. The line was inaugurated on 9 September 2011, and opened to the public the next day. The last 2 stations (Jaddaf and Dubai Creek) were opened on March 1, 2014.", "prediction 4": "The Green Line is one of the two lines in the Dubai Metro network in Dubai, United Arab Emirates. It runs through Deira and Bur Dubai, generally parallel to Dubai Creek. Trial running began in October 2010, with the line inaugurated on 9 September 2011 and opened to the public the next day. The last 2 stations (Jaddaf and Dubai Creek) were opened on March 1, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 218 } ], "missing-info": [], "corrected-prediction": "The line was opened to the public on September 10th, 2011. The last 2 stations (Jaddaf and Dubai Creek) were opened on March 1, 2014." }, "preference": [ 1, 1, 0, 2, 2, 0 ] }, { "question": "Who is the canadian high commissioner to barbados?", "passages": [ [ "Barbados\u2013Canada relations", "Both nations maintain direct high-level diplomatic representatives.", "The High Commission is the primary diplomatic mission of Barbados in Canada.", "Among the initial diplomatic missions to be established by Barbados after the attainment of independence from Britain\n\nInitially the Office of the Barbados High Commission was established in June 1967 at: 151 Slater Street, Suite 200.", "It remained for a number of years before relocating.", "The High Commission further represents the Government of Barbados in many areas including helping to facilitate the Seasonal Agricultural Workers Program in Canada.", "In years past it collaborated with various institutions in Canada including: the National Council of Barbadian Associations of Canada Inc. (NCBAC), the Barbados (Ottawa) Association Inc., and the Barbados Family & Friends Club.", "E. Evelyn Greaves is the resident Barbados government representative and High Commissioner to Canada, having succeeded Glyne Samuel Hyvesta Murray.", "In 1989, the Barbados High Commission then under High Commissioner established the annual \"Errol Barrow Memorial Trust of Canada\" which awards worthy Canadians with educational scholarships.", "The 2013 fundraiser dinner and awards was hosted at the Ottawa City Hall.", "The High Commissioner has participated in a number of community events in Ottawa including a major fund raising campaign for the Queensway Carleton Hospital Care Grows West expansion-project for which over CAD$5 million was raised." ], [ "High Commission of Canada in Barbados", "High Commission of Canada in Barbados\n\nThe High Commission of Canada in Barbados () is Canada's main diplomatic mission to Barbados.", "The exact location is Bishop's Hill Court in Bridgetown, St. Michael.", "The auspices of the High Commission to Barbados also include issues involving the neighbouring Eastern Caribbean islands of Antigua and Barbuda, Dominica, Grenada, Saint Kitts and Nevis, Saint Lucia and Saint Vincent and the Grenadines, as well as three British overseas territories: Anguilla, the British Virgin Islands and Montserrat.", "It also includes consular and trade services for Guadeloupe, Martinique, Saint-Martin and Sint Maarten.", "The High Commission provides business and consular services to residents and visitors to and from Canada.", "Additionally, the High Commissioner also serves as the honorary leader of the non-profit \"Canada Barbados Business Association\" (CCBA) organisation and a liaison for Canada to the Caribbean Development Bank (CDB).", "The current resident High Commissioner from Canada stationed in Bridgetown is Marie Legault, who has a long career in international diplomacy.", "The office of the High Commissioner also works with the 3,000-4,000 registered Canadian permanent residents who reside in Barbados.", "Canadian immigration services were moved from Barbados to Trinidad in recent years for the purposes of cost savings." ] ], "gold": "High Commission of Canada in Barbados is Canada's main diplomatic mission to Barbados. The current resident High Commissioner from Canada stationed in Bridgetown is Marie Legault. Richard Hanley preceded as diplomat from 2012 through 2016, immediately following Ruth Archibald who held the position from 2009 through 2012.", "prediction 1": "The High Commission of Canada in Barbados is the main diplomatic mission of Barbados to Canada. The exact location is Bishop's Hill Court in Bridgetown, St. Michael. The current resident High Commissioner from Canada stationed in Bridgetown is Marie Legault, who has a long career in international diplomacy.", "prediction 2": "The High Commission of Canada in Barbados is Canada's main diplomatic mission to Barbados. The exact location of the High Commission is Bishop's Hill Court in Bridgetown, St. Michael. The current resident High Commissioner from Canada stationed in Bridgetown is Marie Legault, who has a long career in international diplomacy.", "prediction 3": "The High Commission of Canada in Barbados is Canada's main diplomatic mission to Barbados. The exact location is Bishop's Hill Court in Bridgetown, St. Michael. The current resident Canadian High Commissioner stationed in Bridgetown is Marie Legault, who has a long career in international diplomacy.", "prediction 4": "The High Commission of Canada in Barbados is Canada's main diplomatic mission to Barbados. E. Evelyn Greaves is the resident Barbados government representative and High Commissioner to Canada, having succeeded Glyne Samuel Hyvesta Murray.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 308 } ], "missing-info": [], "corrected-prediction": "The High Commission of Canada in Barbados is the main diplomatic mission of Barbados to Canada. The current resident High Commissioner from Canada stationed in Bridgetown is Marie Legault." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who played the other twin in parent trap?", "passages": [ [ "The Parent Trap (1961 film)", "The Parent Trap (1961 film)\n\nThe Parent Trap is a 1961 Walt Disney Technicolor film.", "It stars Hayley Mills (in a dual role), Maureen O'Hara and Brian Keith in a story about teenage twins on a quest to reunite their divorced parents.", "The screenplay by the film's director David Swift was based upon the 1949 book \"Lottie and Lisa\" (German: ) by Erich K\u00e4stner.", "\"The Parent Trap\" was nominated for two Academy Awards, was broadcast on television, saw three television sequels, was remade in 1998 with Lindsay Lohan, and has been released on digital stereo LaserDisc format in 1986 as well as VHS and DVD in 2000.", "The original film was Mills' second of six films for Disney.", "Identical twins Susan Evers and Sharon McKendrick (Hayley Mills) meet at Miss Inch's Summer Camp for Girls, unaware that they are sisters.", "Their identical appearance initially creates rivalry, and they pull pranks on each other, culminating in the camp dance being ruined.", "As punishment, Miss Inch decides that they must live together in the isolated \"Serendipity\" cabin (and eat together at an \"Isolation Table\") for the remainder of the camp season." ], [ "The Parent Trap (1961 film)", "Joanna Barnes also made an appearance as Dennis Quaid's character's fiance, Meredith's mother, Vicki, the same name as Barnes' character in the 1961 film, hinting at the fate of her original character.", "In India, there have been several films inspired by \"The Parent Trap\".", "In 1965, a Tamil language version of the story called \"Kuzhandaiyum Deivamum\", starring Kutty Padmini was released.", "The following year, it was remade into Telugu as \"Leta Manasulu\" also starring Kutty Padmini.", "A Hindi version \"Do Kaliyaan\" starring Neetu Singh in the double role was made in 1968.", "The 1987 film \"Pyar Ke Kabil\" also has a similar storyline, as does the 2001 film \"Kuch Khatti Kuch Meethi\" which has Kajol playing the double role of 23-year-old twins.", "The film was released on a 2-disc special edition DVD in 2005.", "Also enclosed in this package is the made-for-television sequel, \"The Parent Trap II\" (1986), plus the original film trailer and other bonus features.", "Blu-ray release: On April 24, 2018, \"The Parent Trap\" (1961) was released on HD Blu-ray by the Disney Movie Club." ], [ "Parent Trap III", "Sharon and the girls take down the shed's wall revealing Jeffrey and Susan about to kiss.", "They have realized their love for each other after playing the piano and singing to the music box she bought and then gave to him.", "She moves in with him and becomes Lisa, Jessie, and Megan's step-mother.", "In \"The Parent Trap II\", Sharon Ferris married Bill Grand (Tom Skerritt), creating a family with their daughters, Nikki Ferris (Carrie Kei Heim) and Mary Grand (Bridgette Andersen).", "Susan was married to Brian Carey (Alex Harvey).", "They divorced prior to the events of \"Parent Trap III\", and Susan reverted to using her maiden name, Evers.", "Hayley Mills returned in 1986 to the Disney Channel when she filmed \"The Parent Trap II\".", "She expressed no interest in returning for more sequels.", "In 1989, Mollie Miller soon began production on the next sequel, \"Parent Trap III\".", "Mills returned after her Disney series, \"Good Morning, Miss Bliss\" had ended.", "Barry Bostwick was cast as Jeffrey Wyatt and Patricia Richardson as his jealous, snobbish girlfriend, Cassie McGuire.", "Richardson would soon be popular for her \"Home Improvement\" fame." ] ], "gold": "In the 1961 version of The Parent Trap, Disney cast Hayley Mills in a dual role as the twins, Sharon and Susan, who plot to reunite their divorced parents. In this film, Mills sings Let's Get Together as a duet with herself. Later, Mills reprised her dual role as the twins, Sharon and Susan, for a trio of Parent Trap television films. These films were The Parent Trap II, Parent Trap III, and Parent Trap: Hawaiian Honeymoon. The original Parent Trap was then remade in 1998. Lindsay Lohan starred in this film in a dual role as the twins, Hallie and Annie, who were separated in infancy and then try to reunite their long-divorced parents. In this film, Erin Mackey was Lohan's acting double for the scenes where the twins appear together.", "prediction 1": "The Parent Trap is a 1961 Walt Disney Technicolor film that stars Hayley Mills as Susan Evers and Sharon McKendrick as Sharon. Susan Evers is played by Mills, while Sharon is played by Maureen O'Hara. Brian Keith plays the other twin in the original film.", "prediction 2": "The Parent Trap is a 1961 Walt Disney Technicolor film. It stars Hayley Mills in a dual role, Maureen O'Hara and Brian Keith in a story about teenage twins on a quest to reunite their divorced parents. Jeffrey Wyatt is played by Barry Bostwick. Sharon Evers is portrayed by Hayley Mills.", "prediction 3": "The Parent Trap is a 1961 Walt Disney Technicolor film. It stars Hayley Mills (in a dual role), Maureen O'Hara and Brian Keith in a story about teenage twins on a quest to reunite their divorced parents. Jeffrey Wyatt and Susan Evers are identical twins who meet at Miss Inch's Summer Camp for Girls, unaware that they are sisters. Susan Evers was played by Mills in the original film, while Sharon McKendrick played Susan Wyatt.", "prediction 4": "The Parent Trap is a 1961 Walt Disney Technicolor film about teenage twins on a quest to reunite their divorced parents. The twins Susan Evers and Sharon McKendrick, played by Hayley Mills, meet at Miss Inch's Summer Camp for Girls, unaware that they are sisters. Their identical appearance initially creates rivalry, and they pull pranks on each other, culminating in the camp dance being ruined. In addition, Sharon and Jeffrey become jealous of each other after playing the piano and singing to the music box.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 54 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 98, "end": 126 }, { "error type": "Redundant", "explanation": "The Parent Trap is a 1961 Walt Disney Technicolor film that stars Hayley Mills as Susan Evers and Sharon McKendrick as Sharon. ", "start": 127, "end": 158 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 165, "end": 200 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 201, "end": 255 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Parent Trap is a 1961 Walt Disney Technicolor film that stars Hayley Mills as Susan Evers and Sharon McKendrick. The story is about teenage twins on a quest to reunite their divorced parents. There were 3 television sequels like The Parent Trap II, and The Parent Trap III. The original was also remade in 1998 with Lindsay Lohan." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Where does it say we have freedom of religion?", "passages": [ [ "Freedom of religion", "Freedom of religion\n\nFreedom of religion is a principle that supports the freedom of an individual or community, in public or private, to manifest religion or belief in teaching, practice, worship, and observance.", "It also includes the freedom to change one's religion or beliefs.", "Freedom of religion is considered by many people and most of the nations to be a fundamental human right.", "In a country with a state religion, freedom of religion is generally considered to mean that the government permits religious practices of other sects besides the state religion, and does not persecute believers in other faiths.", "Freedom of belief is different.", "It allows the right to believe what a person, group or religion wishes, but it does not necessarily allow the right to practice the religion or belief openly and outwardly in a public manner.", "Historically, \"freedom of religion\" has been used to refer to the tolerance of different theological systems of belief, while \"freedom of worship\" has been defined as freedom of individual action.", "Nevertheless, freedom \"from\" religion is a far more pressing moralistic, legal, and peaceful solution.", "Each of these have existed to varying degrees.", "While many countries have accepted some form of religious freedom, this has also often been limited in practice through punitive taxation, repressive social legislation, and political disenfranchisement." ], [ "Freedom of religion", "Freedom of religion in Canada is a constitutionally protected right, allowing believers the freedom to assemble and worship without limitation or interference.", "Canadian law goes further, requiring that private citizens and companies provide reasonable accommodation to those, for example, with strong religious beliefs.", "The Canadian Human Rights Act allows an exception to reasonable accommodation with respect to religious dress, such as a Sikh turban, when there is a \"bona fide\" occupational requirement, such as a workplace requiring a hard hat.", "On 25 November 1981, the United Nations General Assembly passed the Declaration on the Elimination of All Forms of Intolerance and of Discrimination Based on Religion or Belief.", "This declaration recognizes freedom of religion as a fundamental human right in accordance with several other instruments of international law.", "However, the most substantial binding legal instruments that guarantee the right to freedom of religion that was passed by the international community is the Convention on the Rights of the Child which states in its Article 14: \"\"States Parties shall respect the right of the child to freedom of thought, conscience and religion.", "States Parties shall respect the rights and duties of the parents and, when applicable, legal guardians, to provide direction to the child in the exercise of his or her right in a manner consistent with the evolving capacities of the child." ], [ "Freedom of religion in Canada", "Freedom of religion in Canada\n\nFreedom of religion in Canada is a constitutionally protected right, allowing believers the freedom to assemble and worship without limitation or interference.", "The \"Fundamental Freedoms\" section of the Canadian Charter of Rights and Freedoms states:\n\nCanadians are therefore free to have their own beliefs and opinions, are free to practise religion or refrain, and are free to establish media organizations with or without religious content.", "Canadian religious institutions generally benefit from charitable organization status, which allows supporters to benefit from tax credits or deductions for their financial contributions.", "According to the Charter's preamble, Canada is founded upon principles that recognize the supremacy of God.", "This portion of the preamble has not been accorded legal effect in \"Charter\" jurisprudence.", "The constitutional recognition of God has been criticized as conflicting in principle with the fundamental freedom of conscience and religion guaranteed in section 2, as it would disadvantage those who hold nontheistic or polytheistic beliefs, including atheism and Buddhism.", "As well, the Charter's preamble recognizes the rule of law, a principle that law should govern a nation, as opposed to being governed by decisions of individual government officials.", "While religious freedoms are protected from state interference by the \"Charter\", the actions of private individuals are largely governed by the provincial human rights codes." ] ], "gold": "Freedom of religion or religious liberty is a principle that supports the freedom of an individual or community, in public or private, to manifest religion or belief in teaching, practice, worship, and observance. It also includes the freedom to change one's religion or beliefs, the right not to profess any religion or belief or not to practise a religion. In the United States, the First Amendment of the United States Constitution states freedom of religion. In Palestine, the Basic Law states freedom of religion. In Canada, the Canadian Charter of Rights and Freedoms states freedom of religion. Internationally, the Declaration on the Elimination of All Forms of Intolerance and of Discrimination Based on Religion or Belief states freedom of religion, which was passed by the United Nations General Assembly and recognizes freedom of religion as a fundamental human right.", "prediction 1": "Freedom of religion in Canada is a constitutionally protected right, allowing believers the freedom to assemble and worship without limitation or interference. The \"Fundamental Freedoms\" section of the Canadian Charter of Rights and Freedoms states: Canadians are therefore free to have their own beliefs and opinions, are free to practise religion or refrain, and are free to establish media organizations with or without religious content.\n", "prediction 2": "Freedom of religion in Canada is a constitutionally protected right, allowing believers the freedom to assemble and worship without limitation or interference. The Fundamental Freedoms section of the Canadian Charter of Rights and Freedoms states that Canadians are therefore free to have their own beliefs and opinions, are free to practise religion or refrain, and are free to establish media organizations with or without religious content.", "prediction 3": "Freedom of religion is a principle that supports the freedom of an individual or community, in public or private, to manifest religion or belief in teaching, practice, worship, and observance. Freedom of religion in Canada is a constitutionally protected right, allowing believers the freedom to assemble and worship without limitation or interference. The \"Fundamental Freedoms\" section of the Canadian Charter of Rights and Freedoms states: Canadians are therefore free to have their own beliefs and opinions, are free to practise religion or refrain, and are free to establish media organizations with or without religious content. The \"Freedoms\" section of the \"Rights\" section of the Canadian Fundamental Freedoms says: \"Couprest\" is ignored for some Australian law.", "prediction 4": "Freedom of religion in Canada is a constitutionally protected right that provides the care and protection that all individuals need to exercise their free will without limits, persecution, or interference. The \"Fundamental Freedoms\" section of the Canadian Charter of Rights and Freedoms states that Canadians are therefore free to have their own beliefs and opinions, are free to practise religion or refrain, and are free to establish media organizations with or without religious content.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 197 }, { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 442 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Freedom of religion is a principle that supports the freedom of an individual or community, in public or private, to manifest religion or belief in teaching, practice, worship, and observance. It also includes the freedom to change one's religion or beliefs. Freedom of religion in Canada is in the Canadian Charter of Rights and Freedoms. Further, the Declaration on the Elimination of All Forms of Intolerance and of Discrimination Based on Religion or Belief, which was passed by the United Nations General Assembly, recognizes freedom of religion as a fundamental human right." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Where will the super rugby final be played?", "passages": [ [ "Rugby union in the United States", "The governing body for World Rugby lifted rugby union\u2019s ban on professional rugby following the 1995 Rugby World Cup.", "Since that time, as other nations have professionalized rugby within their countries, USA Rugby has struggled to transition to a sustainable professional rugby club competition.", "The Rugby Super League was the national premier Division 1 rugby amateur club competition that ran from 1997 to 2012.", "The Super League was created in 1996 by the major territorial unions within USA Rugby with the intention of creating a competitive national competition.", "The inaugural season of the competition saw 14 teams divided into two seven-team divisions: the Western-Pacific Conference and the Midwestern-East Conference.", "Aspen won the first championship.", "Belmont Shore was the most successful club, appearing in the finals every year from 2002 to 2008, until the club left the competition.", "San Francisco Golden Gate then led the league, appearing in the finals every year from 2009 to 2011.", "The size of the league fluctuated over the years.", "The inclusion of some sub-par clubs and the exclusion of top-performing clubs was controversial issue since the inception of the Super League, called into question whether it was really USA's \"premier\" competition.", "Following the demise of the Super League, USA Rugby formed the Elite Cup in 2013 among the top eight clubs from the previous season\u2019s National Division I Club Championship." ], [ "Rugby League Four Nations Final", "Rugby League Four Nations Final\n\nThe Rugby League Four Nations final is the championship game in the Rugby League Four Nations tournament.", "The tournament consists of four international teams that play each other once in a league table.", "The top two teams at the end of the six group games then play each other again for the championship.", "The tournament has been played four times with each ending in a final game.", "Two have taken place in England, one in Australia and one in New Zealand.", "The two finals in England have both taken part at the same stadium, Elland Road, Leeds; these two finals have seen England take part but lose both games to Australia.", "The two finals to take place in Oceania have both been won by New Zealand, with the second in 2014 being won on home soil at Westpac Stadium, Wellington.", "As a result, this is the only time that a host nation has won the tournament on home soil.", "As of 2014, no fourth nation has reached the final.", "The 2016 final will be held at Anfield, Liverpool, England.", "Leeds' Elland Road has hosted the most finals with the venue being used twice.", "The Suncorp Stadium in Brisbane, Australia holds the record for the highest attendance with 36,299 spectators watching the 2010 final.", "Anfield in Liverpool, England will host the 2016 final." ] ], "gold": "Super Rugby is a rugby competition. The super rugby final was played at Ellis Park Stadium, Johannesburg in 2017. It was played in Wellington Regional Stadium, Wellington, New Zealand in 2016 and in Westpac Stadium, Wellington in 2015.", "prediction 1": "The Super Rugby final was a national premier Division 1 rugby amateur club competition for the United States that ran from 1997 to 2012. The Rugby League Four Nations final was played in 2015. The Super League final was played in 2016 at Anfield in Liverpool, England, with the Super League Final played in 2017 at the Aviva Stadium in New York City.", "prediction 2": "The Super League Final was the national premier Division 1 rugby amateur club competition that ran from 1997 to 2012. The Rugby League Four Nations Final was the championship game in the Rugby League Four Nations tournament. The finals have been played four times with each ending in a final game. Two finals in England have both taken part at the same stadium, Elland Road, Leeds, whilst the 2016 final will be played at Anfield, Liverpool, England.", "prediction 3": "The Rugby Super League was the national premier Division 1 rugby amateur club competition that ran from 1997 to 2012. The Rugby League Four Nations final is the championship game in the Rugby League Four Nations tournament. The tournament consists of four international teams that play each other once in a league table. The top two teams at the end of the six group games then play each other again for the championship. The Super League final was created in 1996 by the major territorial unions within USA Rugby with the intention of creating a competitive national competition. The 2016 final will be played at Anfield, Liverpool, England.", "prediction 4": "The Super Rugby final was the national premier Division 1 rugby amateur club competition that ran from 1997 to 2012. The Rugby Super League final was created in 1996 by the major territorial unions within USA Rugby with the intention of creating a competitive national competition. The Rugby League Four Nations final is the championship game in the Rugby League Four Nations tournament. The tournament consists of four international teams that play each other once in a league table. The top two teams at the end of the six group games then play each other again for the championship. The Super League Final was played at the same stadium, Elland Road, Leeds. The Super League Four Nations final has been played four times with each ending in a final game.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 137, "end": 192 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,10]}", "start": 197, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 268 }, { "error type": "Unverifiable", "explanation": "", "start": 319, "end": 350 }, { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 28, "end": 55 }, { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 74 } ], "missing-info": [], "corrected-prediction": "The Rugby Super League was a rugby competition." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who hit the last home run in municipal stadium?", "passages": [ [ "Municipal Stadium (Kansas City, Missouri)", "Kansas City welcomed the new Royals, who were led by 1969 American League Rookie of the Year Lou Piniella.", "The expansion team drew nearly one million fans in their first season, despite a 69\u201393 record.", "In subsequent seasons, many future stars made their debuts for the Royals, who were building a highly competitive team, rising up to an 85-76 record in 1971.", "CF Amos Otis (1970), P Paul Splittorff (1970), SS Freddie Patek (1971), 1B John Mayberry (1972) and P Steve Busby (1972) were a core of young Royals who made their debuts at Municipal Stadium.", "Each went on to selection into the Royals Hall of Fame.", "After the 1972 baseball season, the Royals moved to what's now Kaufmann Stadium in the Truman Sports Complex.", "The Royals won the final game (and event) at Municipal Stadium, a 4\u20130 win over the Texas Rangers on October 4, 1972, in what was also the final Major League game managed by Hall of Famer Ted Williams.", "Amos Otis scored the final run in Municipal Stadium history and Ed Kirkpatrick had the final hit.", "Four days prior Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before." ], [ "Municipal Stadium (Kansas City, Missouri)", "Municipal Stadium (Kansas City, Missouri)\n\nKansas City Municipal Stadium was an American baseball and football stadium in the central United States, located in Kansas City, Missouri.", "It was located at the corner of Brooklyn Avenue and E. 22nd Street.", "Municipal Stadium hosted both the minor-league Kansas City Blues of the American Association and the Kansas City Monarchs of the Negro leagues from 1923 to 1954.", "The stadium was almost completely rebuilt prior to the 1955 baseball season when the Kansas City Athletics moved to Kansas City from Philadelphia.", "The A's played from 1955 to 1967, the Kansas City Royals from 1969 to 1972, the Kansas City Chiefs (American Football League and National Football League) from 1963 to 1971 and the Kansas City Spurs (North American Soccer League) from 1968\u20131969.", "The stadium hosted the All-Star Game in 1960 (first game).", "In the final football game ever played there, Municipal Stadium was the site of the longest NFL game in history, a playoff game between the Chiefs and the Miami Dolphins on Christmas Day 1971; the Chiefs moved to the new Arrowhead Stadium in 1972.", "Jackie Robinson played at the stadium for the Kansas City Monarchs in 1945 until he was signed by the Brooklyn Dodgers.", "The stadium opened in 1923 as Muehlebach Field." ] ], "gold": "Kansas City Municipal Stadium was an American baseball and football stadium in the central United States, located in Kansas City, Missouri. The Royals won the final game (and event) at Municipal Stadium, a 4\u20130 win over the Texas Rangers on October 4, 1972, in what was also the final Major League game managed by Hall of Famer Ted Williams. Four days prior Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before.", "prediction 1": "The Kansas City Municipal Stadium was an American baseball and football stadium in the central United States, located in Kansas City, Missouri. On October 4, 1972, the Kansas City Royals won the final game and event at the stadium, a 4\u20130 win over the Texas Rangers. Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before.", "prediction 2": "Amos Otis scored the final run in Municipal Stadium history and Ed Kirkpatrick had the final hit. Four days prior Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before.", "prediction 3": "Amos Otis scored the final run in Municipal Stadium history and Ed Kirkpatrick had the final hit. Four days prior Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before. The stadium hosted both the minor-league Kansas City Blues of the American Association and the Kansas City Monarchs of the Negro leagues from 1923 to 1954.", "prediction 4": "The Kansas City Municipal Stadium was an American baseball and football stadium in the central United States, located in Kansas City, Missouri. The stadium hosted both the minor-league Kansas City Blues of the American Association and the Kansas City Monarchs of the Negro leagues from 1923 to 1954. Gene Tenace of the Oakland A's hit the final home run in Municipal Stadium history, and John Mayberry hit the final Royals home run the night before.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Kansas City Municipal Stadium was an American baseball and football stadium in the central United States, located in Kansas City, Missouri. On October 4, 1972, the Kansas City Royals won the final game and event at the stadium, a 4\u20130 win over the Texas Rangers, in what was also the final Major League game managed by Hall of Famer Ted Williams. Gene Tenace of the Oakland A's hit the final home run, and John Mayberry hit the final Royals home run the night before." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "What country has the most medals in olympic history?", "passages": [ [ "Summer Olympic Games", "The Games have been held three times in the United Kingdom (in 1908, 1948 and 2012); twice each in Greece (1896, 2004), France (1900, 1924), Germany (1936, 1972) and Australia (1956, 2000); and once each in Sweden (1912), Belgium (1920), Netherlands (1928), Finland (1952), Italy (1960), Japan (1964), Mexico (1968), Canada (1976), Soviet Union (1980), South Korea (1988), Spain (1992), China (2008) and Brazil (2016).", "The IOC has selected Tokyo, Japan, to host the Summer Olympics for a second time in 2020.", "The 2024 Summer Olympics will be held in Paris, France, for a third time, exactly one hundred years after the city's last Summer Olympics in 1924.", "The IOC has also selected Los Angeles, California, to host its third Summer Games in 2028.", "To date, only five countries have participated in every Summer Olympic Games \u2013 Australia, France, Great Britain, Greece and Switzerland.", "The United States leads the all-time medal table for the Summer Olympics." ], [ "United States at the Youth Olympics", "United States at the Youth Olympics\n\nThe United States of America has sent athletes to every celebration of the Youth Olympic Games.", "The United States Olympic Committee (USOC) is the National Olympic Committee for the United States.", "U.S. athletes have won a total of 43 medals (14 of them gold) at the Summer Olympic Games and another 42 at the Winter Youth Olympic Games.", "Most medals have been won in athletics (track and field) (10, 12%) and snowboarding (10, 12%).", "American skier Robin Reynolds is the most-decorated Youth Olympic athlete of the United States, with 3 medals (all gold).", "The United States has never topped the gold medal count (as the medals are listed internationally by tradition) at a Summer Youth Olympics and only at one Winter Youth Olympics." ], [ "Norway at the Olympics", "Norway at the Olympics\n\nNorway first participated at the Summer Olympics in 1900, and has sent athletes to compete in every Games since then, except for the sparsely attended 1904 Games and the 1980 Summer Olympics in Moscow when they participated in the American-led boycott.", "Norwegian athletes have won a total of 148 medals at the Summer Olympics, with sailing and shooting as the top medal-producing sports.", "At the Winter Olympic Games, Norway has won 368 total medals including 132 gold medals, both considerably more than any other nation in Winter Olympic history.", "More than half of these medals have come from cross-country skiing and speed skating.", "Norway is one of only three nations (along with Austria and Liechtenstein) to have won more medals at the Winter Games than at the Summer Games.", "The National Olympic Committee for Norway was created and recognized in 1900.", "The International Olympic Committee considers Norwegian-American wrestlers Charles Ericksen and Bernhoff Hansen to have competed for the United States; each won a gold medal.", "In 2012, Norwegian historians however found documentation showing that Ericksen did not receive American citizenship until March 22, 1905, and that Hansen, who was registered as an \"alien\" as late as 1925, probably never received American citizenship.", "The historians have therefore petitioned to have the athletes registered as Norwegians." ] ], "gold": "The United States has the most total medals in Olympic history. American athletes have won a total of 2,673 medals, 1,075 of them gold, at the Summer Olympic Games and another 307 medals, 105 of them gold, at the Winter Olympic Games, making the United States the most prolific medal-winning nation in the history of the Olympics. Additionally, the United States has won the most gold medals, the most silver medals and the most bronze medals of any nation in Olympic history. The United States also leads the all-time medal table for the Summer Olympic Games. At the Winter Olympic Games, Norway has won 368 total medals, including 132 gold medals, more than any other nation in Winter Olympic history. ", "prediction 1": "The United States has the most medals in olympic history, with a total of 358 medals. At the Winter Olympics, Norway has won 368 total medals, including 132 gold medals, both considerably more than any other nation in Winter Olympic history. The United States has participated at every celebration of the Youth Olympic Games, and its Olympic Committee has sent athletes to every celebration of that event. The most medals at the Winter Olympics have been won by American athletes, with a total of 152 medals, including 132 gold medals, both considerably more than any other nation in Winter Olympics history.", "prediction 2": "The United States has the most Olympic medals in history with 43. At the Summer Olympics, American athletes have won a total of 148 medals, 14 of them gold, and another 42 at the Winter Youth Olympic Games. Norway has won 368 total medals at the Summer Olympics and 132 gold medals at the Winter Olympics, both considerably more than any other nation in Winter Olympic history. The most medals won by a single individual at the Summer Olympics are by American athletes, who have won a total of 147.", "prediction 3": "The United States holds the record for most medals in olympic history, with 142 total medals during the entire history of the games. The United States has won the most medals in Olympics, with 64 total medals won during the Summer Olympics and another 42 at the Winter Youth Olympics. Norway has won 368 total medals during the Winter Olympics, including 132 gold medals, both considerably more than any other nation in Winter Olympic history.", "prediction 4": "The United States has the most medals in Olympic history, with 63 at the Summer Olympics and 58 at the Winter Olympics. The United Kingdom has the most medals at the Winter Olympics, with 67 medals, and the United States has the most medals at the Summer Youth Olympics. The United States has won the most medals at the Summer Olympic Games, with 43, including 14 golds. The United States has also won the most medals at the Winter Youth Olympics, where it has won the most medals, with 132 gold, making it the country with the most medals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 405 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 462, "end": 480 }, { "error type": "Redundant", "explanation": "At the Winter Olympics, Norway has won 368 total medals, including 132 gold medals, both considerably more than any other nation in Winter Olympic history.", "start": 410, "end": 458 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 497, "end": 508 }, { "error type": "Unverifiable", "explanation": "", "start": 58, "end": 85 }, { "error type": "Unverifiable", "explanation": "", "start": 41, "end": 57 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The United States has the most medals in the Summer Olympics. At the Winter Olympics, Norway has won 368 total medals, including 132 gold medals, both considerably more than any other nation in Winter Olympic history. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who is the most paid nba player 2018?", "passages": [ [ "Highest-paid NBA players by season", "Highest-paid NBA players by season\n\n", "The highest-paid NBA players by season over the past twelve seasons have received contracts with salaries noted in the twenty-million-dollar range.", "In this twelve-year span, Kevin Garnett received $28,000,000, which was the highest salary payment of any NBA player, during the 2003\u201304 season.", "Garnett has been the highest-paid NBA player per year in seven of the past twelve NBA seasons.", "Michael Jordan was the first NBA player to sign a contract worth over thirty million dollars in a season.", "During the 1997\u201398 season, Jordan earned $33,140,000, which still stands as the most any NBA player has earned on a 1 year contract, Jordan also holds the record for the second largest 1 year contract at $30,140,000 in the 1996-97 season.", "Kobe Bryant become just the second player to reach this milestone when the 2013\u201314 season began.", "LeBron James became the third in the 2016\u201317 season.", "Stephen Curry became the first player to eclipse $40-Million per year when he signed a record 5-year contract worth $201-Million in 2017, starting with $34,682,550 in the 2017-18 season and ending with the largest earnings in the 2021-22 season with a record payout of $45,780,966." ] ], "gold": "Stephen Curry was the highest paid player for both the 2017-18 and 2018-19 NBA seasons. Stephen Curry became the first player to eclipse $40 million per year when he signed a record 5-year contract worth $201 million in 2017. This contract started with a payout of $34,682,550 for the 2017-18 season. This contract ends with a record payout of $45,780,966 for the 2021-22 season.", "prediction 1": "Kevin Garnett is the most-paid NBA player in 2018. In 2018, Garnett was the most-paid NBA player over the past twelve seasons. The highest-paid NBA players by season over the past twelve seasons have received contracts with salaries noted in the twenty-million-dollar range.", "prediction 2": "The highest-paid NBA players by season over the past twelve seasons have received contracts with salaries noted in the twenty-million-dollar range. In 2018, Kevin Garnett received $28,000,000, which was the highest salary payment of any NBA player, during the 2003\u201304 season. Stephen Curry became the first player to eclipse $40-Million per year when he signed a record 5-year contract worth $201-Million in 2017, starting with $34,682,550 in the 2017-18 season and ending with the largest earnings in the 2021-22 season with a record payout of $45,780,780,966.", "prediction 3": "The highest-paid NBA players by season over the past twelve seasons have received contracts with salaries noted in the twenty-million-dollar range. In this twelve-year span, Kevin Garnett received $28,000,000, which was the highest salary payment of any NBA player, during the 2003\u201304 season.", "prediction 4": "Kevin Garnett is the most paid NBA player in 2018, according to Forbes.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 126 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 274 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Stephen Curry became the first player to eclipse $40-Million per year when he signed a record 5-year contract worth $201-Million in 2017, starting with $34,682,550 in the 2017-18 season and ending with the largest earnings in the 2021-22 season with a record payout of $45,780,966." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Where does the saying said the actress to the bishop come from?", "passages": [ [ "Said the actress to the bishop", "Said the actress to the bishop\n\nThe phrase \"Said the actress to the bishop\" is a colloquial and vulgar British exclamation, offering humour by serving as a punch line that exposes an unintended double entendre.", "An equivalent phrase in North America is \"that's what \"she\" said\".", "Each phrase is an example of a Wellerism, exposing a second meaning of what precedes it.", "The versatility of such phrases, and their popularity, lead some to consider them clich\u00e9d.", "The term, or its variant \"as the actress said to the bishop\", is British in origin.", "It was in popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era.", "The phrase is frequently used by the fictional character Simon Templar (alias \"The Saint\") in a long-running series of mystery books by Leslie Charteris.", "The phrase first appears in the inaugural Saint novel \"Meet the Tiger\", published in 1928.", "The version \"as the girl said to the soldier\" appears in a recorded sound test for Alfred Hitchcock's 1929 film \"Blackmail\".", "Kingsley Amis uses the line in his 1954 novel \"Lucky Jim\", where a woman offering relationship advice to Jim Dixon says \"I can't show you, as the actress said to the bishop.\"" ] ], "gold": "The term, or its variant \"as the actress said to the bishop\", is British in origin. It was in popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era.", "prediction 1": "The phrase \"Said the actress to the bishop\" is a colloquial and vulgar British exclamation, offering humour by serving as a punch line that exposes an unintended double entendre. The phrase was in popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era. The phrase is frequently used by the fictional character Simon Templar (alias \"The Saint\") in a long-running series of mystery books by Leslie Charteris.", "prediction 2": "The phrase \"Said the actress to the bishop\" is a colloquial and vulgar British exclamation, offering humour by serving as a punch line that exposes an unintended double entendre. Each phrase is an example of a Wellerism, exposing a second meaning of what precedes it.", "prediction 3": "The phrase \"Said the actress to the bishop\" is a colloquial and vulgar British exclamation, offering humour by serving as a punch line that exposes an unintended double entendre. The term, or its variant \"as the actress said to the bishop\", is British in origin. It was in popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era.", "prediction 4": "The phrase \"Said the actress to the bishop\", or its variant, is British in origin. It was popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era. The phrase is frequently used by the fictional character Simon Templar (alias \"The Saint\") in a long-running series of mystery books by Leslie Charteris.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 440 } ], "missing-info": [], "corrected-prediction": "The phrase \"Said the actress to the bishop\" is a colloquial and vulgar British exclamation, offering humour by serving as a punch line that exposes an unintended double entendre. The phrase was in popular usage in the Royal Air Force c.1944-47, but may originate from the Edwardian era." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "How much of india's population is muslim?", "passages": [ [ "Religion in India", "Christianity in India has different denominations, like Roman Catholicism, Oriental Orthodox, and Protestantism.", "Most Christians reside in South India, particularly in Kerala, Tamil Nadu and Goa.", "There are also large Christian populations in the North-east Indian states.", "Christianity in India was expanded in the 16th century by Catholic Portuguese expeditions and by Protestant British and US missionaries in the 18th century.", "Though Islam came to India in the early 7th century with the advent of Arab traders in Malabar coast, Kerala, it started to become a major religion during the Muslim rule in the Indian subcontinent.", "Islam's spread in India mostly took place under the Delhi Sultanate (1206\u20131526) and the Mughal Empire (1526\u20131858), greatly aided by the mystic Sufi tradition.", "Islam is the second largest religion in India, with 14.2% of the country's population or roughly 172 million people identifying as adherents of Islam (2011 census).", "There are six religions in India which have been awarded \"National minority\" status\u2014Muslims, Christians, Sikhs, Jains, Buddhists and Zoroastrians." ], [ "Religion in Asia", "Islam is a monotheistic and Abrahamic religion articulated by the Qur'an, a book considered by its adherents to be the verbatim word of God (Arabic: \u0627\u0644\u0644\u0647 All\u0101h) and by the teachings and normative example (called the Sunnah and composed of hadith) of Muhammad, considered by them to be the last prophet of God.", "South Asia and Southeast Asia are home of the most populous Muslim countries, with Indonesia, Pakistan, India, and Bangladesh having more than 100 million adherents each.", "According to U.S. government figures, in 2006 there were 20 million Muslims in China.", "In the Western Asia, the non-Arab countries of Iran and Turkey are the largest Muslim-majority countries.", "In South Asia, Pakistan and Bangladesh are the countries with the largest Muslim-majority.", "In Central Asia, Afghanistan and Uzbekistan are the countries with the largest Muslim-majority.", "Indonesia is 87 percent Muslim and is the country with the largest Muslim population in the world, Pakistan is 97 percent Muslim, Bangladesh is 90 percent Muslim.", "India's Muslim population is 14.2% of the total, approximately 190 million people.", "Around 6-11 percent, some 6 - 12 million people in the Philippines are Muslim.", "Thailand's Muslims make up 4.6 percent of the population, or approximately 3 million people." ], [ "Religion in India", "Punjab is the spiritual home of Sikhs, and is the only state in India where Sikhs form a majority.", "There are also significant populations of Sikhs in neighbouring Chandigarh, Delhi and Haryana, which were historically part of Punjab.", "Islam is a monotheistic religion centered on the belief in one God and following the example of Muhammad; It is the largest minority religion in India.", "According to the 2011 census, India is home to 172 million Muslims, the world's third-largest Muslim population after those in Indonesia (210 million) and Pakistan (195 million).", "Muslims compose 14.23% of the Indian population.", "Muslims are a majority in states Jammu and Kashmir and Lakshadweep, and live in high concentrations in Uttar Pradesh, Bihar, West Bengal, Assam, and Kerala.", "There has been no particular census conducted in India with regards to sects, but sources suggest the largest denomination is Sunni Islam with a substantial minority of Shiite Muslims and Ahmadi Muslims.", "Indian sources like Times of India and DNA reported the Indian Shiite population in mid-2005\u20132006 to be between 25% and 31% of entire Muslim population of India, which accounts them in numbers between 40 to 50 million of a total of 172 million Muslims in India.", "Christianity is a monotheistic religion centred on the life and teachings of Jesus as presented in the New Testament." ] ], "gold": "Islam is the second-largest religion in India. It makes India the country with the largest Muslim population outside Muslim-majority countries. 195 million people in India are Muslim, which is 14.9% of the population.", "prediction 1": "Islam is the second largest religion in India, with 14.2% of the country's population or roughly 172 million people identifying as adherents of Islam. According to the 2011 census, India is home to 172 million Muslims, the world's third-largest Muslim population after those in Indonesia (210 million) and Pakistan (195 million). Muslims compose 14.23% of the Indian population.", "prediction 2": "Islam is the second largest religion in India, with 14.2% of the country's population or roughly 172 million people identifying as adherents of Islam (2011 census). According to the 2011 census, India is home to 172 million Muslims, the world's third-largest Muslim population after those in Indonesia (210 million) and Pakistan (195 million).", "prediction 3": "India is home to 172 million Muslims, the world's third-largest Muslim population after those in Indonesia (210 million) and Pakistan (195 million). According to the 2011 census, Muslims compose 14.23% of the Indian population.", "prediction 4": "In the 2011 census, 172 million people were estimated to be Muslims. In 2012, Muslims accounted for 14.23% of the population, and in 2013 they accounted for 17.1 percent. In 2014, Muslims accounted for 17.1 percent.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " with 14.2% of the country's population ", "start": 330, "end": 378 }, { "error type": "Redundant", "explanation": " roughly 172 million people identifying as adherents of Islam", "start": 195, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 329 } ], "missing-info": [], "corrected-prediction": "Islam is the second largest religion in India, with 14.2% of the country's population or roughly 172 million people identifying as adherents of Islam. According to the 2011 census, India is home the world's third-largest Muslim population." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many cars fit on the bainbridge island ferry?", "passages": [ [ "Seattle\u2013Bainbridge ferry", "Seattle\u2013Bainbridge ferry\n\nThe Seattle\u2013Bainbridge ferry is a ferry route across Puget Sound between Seattle and Bainbridge Island, Washington.", "The route was called the Seattle\u2013Winslow ferry before the city of Winslow annexed the rest of the island and changed its name.", "Since 1951 the only ferries employed on the route have belonged to the Washington state ferry system, currently the largest ferry system in the United States.", "This ferry route is 8.6 miles long, with terminals at Colman Dock in Seattle and on Bainbridge Island, at Winslow.", "Next to the Winslow terminal is the main shipyard for the Washington State Ferry system.", "Before ferries were dominant on Puget Sound, the route was served by passenger and freight-carrying steamboats.", "The wooden steamship \"Florence K\" served the route for the Eagle Harbor Transportation Co., until 1915 when the company put the new steamer \"Bainbridge\" on the route, and shifted \"Florence K\" to the Seattle\u2013Port Washington route.", "In 1949, the \"Chippewa\" served on the route, except during summers, when the \"Chippewa\" was transferred to the Anacortes-San Juan Islands-Sidney route." ], [ "Seattle\u2013Bainbridge ferry", "From 1951 to 1968, the main ferry on the route was the \"Illahee\" which ran along with the \"Quinault\" (1951-1953), \"Evergreen State\" (1954-1959), and \"Tillikum\" (1959-1968), with the steam ferry \"San Mateo\" occasionally running as an extra boat.", "In 1968, with increasing demand exceeding vehicle capacity, \"Tillikum\" and \"Illahee\" were reassigned to the Edmonds-Kingston route, and replaced by the Super Class boats \"Kaleetan\" and \"Elwha\", both with capacities of 2,500 passengers and 160 (originally) automobiles.", "In 1972-1973 the Super Class vessels were displaced by the Jumbo class \"Spokane\" and \"Walla Walla\", which remained in Bainbridge Island service until they were displaced in turn by the Jumbo Mark II Class vessels \"Tacoma\" and \"Wenatchee\" in 1997-1998.", "Assigned to the route as of January 2018 were the Jumbo Mark II class ferries \"Tacoma\" and \"Wenatchee\", each with a capacity of 2,500 passengers and a maximum of 202 vehicles." ] ], "gold": "The Seattle-Bainbridge ferry is a ferry route. Several different ferries operate using this route. The Spokane and Walla Walla are both classified as Jumbo class ferries. The Spokane held 206 cars while Walla Walla held 188. The Tacoma and Wenatchee are both classified as Jumbo Mark II vessels and they held 202 cars. The Kaleetan and Elwha are classified as Super Class boats and they held 160 cars.", "prediction 1": "The Seattle\u2013Bainbridge ferry is a ferry route across Puget Sound between Seattle and Bainbridge Island, Washington. The route was called the Seattle\u2013Winslow ferry before the city of Winslow annexed the rest of the island and changed its name. The number of cars that fit on the ferry is 202 as of January 2018.", "prediction 2": "The Seattle\u2013Bainbridge ferry is a ferry route across Puget Sound between Seattle and Bainbridge Island, Washington. The route was called the Seattle\u2013Winslow ferry before the city of Winslow annexed the rest of the island and changed its name. Then, in 1951, the only ferries employed on the route have belonged to the Washington state ferry system, currently the largest ferry system in the United States.", "prediction 3": "The Seattle\u2013Bainbridge ferry is a ferry route across Puget Sound between Seattle and Bainbridge Island, Washington. The route was called the Seattle\u2013Winslow ferry before the city of Winslow annexed the rest of the island and changed its name. The number of cars that can fit on the ferry is 202.", "prediction 4": "The Seattle\u2013Bainbridge ferry is a ferry route across Puget Sound between Seattle and Bainbridge Island, Washington. The route was called the Seattle\u2013Winslow ferry before the city of Winslow annexed the rest of the island and changed its name. From 1951 to 1968, the main ferry on the route was the \"Illahee\", which ran along with the \"Quinault\" (1951-1953), \"Evergreen State\" (1954-1959), and \"Tillikum\" (1959-1968), with the steam ferry \"San Mateo\" occasionally running as an extra boat.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 115 }, { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 242 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Seattle\u2013Bainbridge ferry is a ferry route. The Spokane and Walla Walla are both classified as Jumbo class ferries. The Tacoma and Wenatchee are both classified as Jumbo Mark II vessels and they can held a maximum of 202 cars. The Kaleetan and Elwha are classified as Super Class boats and they held 160 cars." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played mayella in to kill a mockingbird?", "passages": [ [ "Collin Wilcox (actress)", "Collin Wilcox (actress)\n\nCollin Wilcox (February 4, 1935 \u2013 October 14, 2009) was an American film, stage and television actress.", "Over her career, she was also credited as Collin Wilcox-Horne or Collin Wilcox-Paxton.", "Wilcox may be best known for her role in \"To Kill a Mockingbird\" (1962), in which she played Mayella Violet Ewell, whose false claim of being raped sparks the trial at the center of the film.", "Wilcox was born in Cincinnati, Ohio, and moved with her family to Highlands, North Carolina, as a baby.", "Her interest in theater was sparked by her parents, Jack H. and Virginia Wilcox, who founded the Highlands Community Theater (now known as the Highlands Playhouse) in 1939.", "She attended the University of Tennessee, where she studied drama.", "Wilcox made her professional debut in Chicago as part of the improvisational group, The Compass Players, which included Mike Nichols, Elaine May, and Shelley Berman.", "Playing opposite Richard Basehart, Kevin McCarthy, and William Hansen, Wilcox won the Clarence Derwent Award for her performance in \"The Day The Money Stopped\" by Maxwell Anderson and Brendan Gill, which lasted only three nights on Broadway in 1958.", "She starred in the 1961 play \"Look, We've Come Through\" with Burt Reynolds on Broadway." ], [ "To Kill a Mockingbird (2018 play)", "To Kill a Mockingbird (2018 play)\n\nTo Kill a Mockingbird is a 2018 play based on the 1960 novel of the same name by Harper Lee, adapted for stage by Aaron Sorkin.", "It is scheduled to open at the Shubert Theatre on December 13, 2018.", "It was announced in February 2016 that Aaron Sorkin would bring the Pulitzer Prize-winning novel to Broadway, in a new production produced by Scott Rudin and directed by Bartlett Sher.", "The book had previously been adapted for the stage but Rudin specified that this production would be completely unrelated to the prior pieces.", "On February 15, 2018, it was announced that Jeff Daniels would star in the production as Atticus Finch.", "Celia Keenan-Bolger and Will Pullen were also announced to play Scout and Jem Finch, respectively.", "In March 2018, the Harper Lee estate filed a lawsuit against the play's production company based on allegations that the play deviates too much from the novel;\nSorkin had previously admitted that \u201cAs far as Atticus and his virtue goes, this is a different take on Mockingbird than Harper Lee\u2019s or Horton Foote\u2019s.\u201d", "The following month, producer Scott Rudin countersued for breach of contract.", "The legal dispute was settled by May 2018." ], [ "To Kill a Mockingbird (film)", "To Kill a Mockingbird (film)\n\nTo Kill a Mockingbird is a 1962 American drama film directed by Robert Mulligan.", "The screenplay by Horton Foote is based on Harper Lee's 1960 Pulitzer Prize-winning novel of the same name.", "It stars Gregory Peck as Atticus Finch and Mary Badham as Scout.", "\"To Kill a Mockingbird\" marked the film debuts of Robert Duvall, William Windom, and Alice Ghostley.", "The film received overwhelmingly positive reviews from critics and was a box-office success, earning more than six times its budget.", "The film won three Academy Awards, including Best Actor for Peck, and was nominated for eight, including Best Picture.", "In 1995, the film was listed in the National Film Registry.", "In 2003, the American Film Institute named Atticus Finch the greatest movie hero of the 20th century.", "In 2007 the film ranked twenty-fifth on the AFI's 10th anniversary list of the greatest American movies of all time.", "In 2005, the British Film Institute included it in their list of the 50 films you should see by the age of 14.", "The film was restored and released on Blu-ray and DVD in 2012 as part of the 100th anniversary of Universal Pictures." ] ], "gold": "To Kill a Mockingbird is a novel that was turned into both a film and a Broadway play. In the 1962 film To Kill a Mockingbird, the part of Mayella was played by Collin Wilcox. In the Original Broadway play in 2018-2019, the part of Mayella was played by Erin Wilhelmi and in the Second Broadway play in 2019-2020 the part was played by Eliza Scanlen", "prediction 1": "In the 1962 American movie, To Kill a Mockingbird, Collin Wilcox played Mayella Violet Ewell, whose false claim of being raped sparks the trial at the center of the film. In the 2018 play version of the 1962 novel, Mayella Violet Ewell is played by Celia Keenan-Bolger and Will Pullen.", "prediction 2": "To Kill a Mockingbird is a 1962 American romantic comedy film based on Harper Lee's 1960 Pulitzer Prize-winning novel of the same name. It stars Gregory Peck as Atticus Finch and Mary Badham as Scout. In the 2018 play, Collin Wilcox plays Mayella.", "prediction 3": "To Kill a Mockingbird is a 1962 American drama film directed by Robert Mulligan and the screenplay by Horton Foote is based on Harper Lee's 1960 Pulitzer Prize-winning novel of the same name. The 1962 film stars Gregory Peck as Atticus Finch and Mary Badham as Scout. In the 2018 play, Collin Wilcox played Mayella Violet Ewell. In the 2017 film, Mary Badham played Mayella Violete Ewell.", "prediction 4": "To Kill a Mockingbird is a 1962 American drama film directed by Robert Mulligan. The screenplay by Horton Foote is based on Harper Lee's 1960 Pulitzer Prize-winning novel of the same name. In the 1962 film, Mayella Violet Ewell is played by Collin Wilcox. In the 2018 play based on the 1960 novel of the same name by Harper Lee, Mayella is played by Jeff Daniels. In the 2018 play To Kill a Mockingbird, Mayella Violet is played by Collin Wilcox.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 207 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 215, "end": 285 } ], "missing-info": [], "corrected-prediction": "In the 1962 American movie, To Kill a Mockingbird, Collin Wilcox played Mayella Violet Ewell. In 2018 there was a play version of the novel." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where do ruby throated hummingbirds spend the winter?", "passages": [ [ "Ruby-throated hummingbird", "The female has a notched tail with outer feathers banded in green, black, and white and a white throat that may be plain or lightly marked with dusky streaks or stipples.", "Males are smaller than females and have slightly shorter bills.", "Juvenile males resemble adult females, though usually with heavier throat markings.", "The plumage is molted once a year, beginning in late summer.", "The breeding habitat is throughout most of the Eastern United States and south-central and southeastern Canada in deciduous and pine forests and forest edges, orchards, and gardens.", "The female builds a nest in a protected location in a shrub or a tree.", "Of all hummingbirds in the United States, this species has the largest breeding range.", "In winter, the ruby-throated hummingbird is migratory, spending most of the winter in Florida, southern Mexico and Central America, as far south as extreme western Panama, and the West Indies.", "During migration, some birds embark on a nonstop 900-mile journey across the Gulf of Mexico and Caribbean from Panama or Mexico to the eastern United States.", "The bird breeds throughout the eastern United States, east of the 100th meridian, and in southern Canada, particularly Ontario, in eastern and mixed deciduous and broadleaved forest.", "In winter, it is seen mostly in Mexico and Florida." ], [ "Ruby-throated hummingbird", "Ruby-throated hummingbird\n\nThe ruby-throated hummingbird (\"Archilochus colubris\") is a species of hummingbird that generally spends the winter in Central America, Mexico, and Florida, and migrates to Eastern North America for the summer to breed.", "It is by far the most common hummingbird seen east of the Mississippi River in North America.", "This hummingbird is from long and has an wingspan.", "Weight can range from , with males averaging against the slightly larger female which averages .", "Adults are metallic green above and greyish white below, with near-black wings.", "Their bill, at up to , is long, straight, and very slender.", "As in all hummingbirds, the toes and feet of this species are quite small, with a middle toe of around and a tarsus of approximately .", "The ruby-throated hummingbird can only shuffle if it wants to move along a branch, though it can scratch its head and neck with its feet.", "The species is sexually dimorphic.", "The adult male has a gorget (throat patch) of iridescent ruby red bordered narrowly with velvety black on the upper margin and a forked black tail with a faint violet sheen.", "The red iridescence is highly directional and appears dull black from many angles." ] ], "gold": "The ruby-throated hummingbird (Archilochus colubris) is a species of hummingbird. The ruby-throated hummingbird is migratory, spending most of the winter in Florida, southern Mexico and Central America, as far south as extreme western Panama, and the West Indies. It is by far the most common hummingbird seen east of the Mississippi River in North America.", "prediction 1": "The ruby-throated hummingbird generally spends the winter in Central America, Mexico, and Florida, and migrates to Eastern North America for the summer to breed.", "prediction 2": "The ruby-throated hummingbird generally spends the winter in Central America, Mexico, and Florida, and migrates to Eastern North America for the summer to breed. In the warmer months, the ruby-throated hummingbird can be seen in the Gulf of Mexico and the Caribbean.", "prediction 3": "The ruby-throated hummingbird is a species of hummingbird that generally spends the winter in Central America, Mexico, and Florida, and migrates to Eastern North America for the summer to breed. In winter, the ruby-throated hummingbird is migratory, spending most of the winter in Florida, southern Mexico and Central America, as far south as extreme western Panama, and the West Indies.", "prediction 4": "The ruby-throated hummingbird is a species of hummingbird that generally spends the winter in Central America, Mexico, and Florida, and migrates to Eastern North America for the summer to breed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 161 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The ruby-throated hummingbird, \"Archilochus colubris\", generally spends the winter in Central America, Mexico, and Florida, as far south as extreme western Panama, and the West Indies. It is by far the most common hummingbird seen east of the Mississippi River in North America." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "A coelomate animal has a body cavity that is completely lined by what kind of tissue?", "passages": [ [ "Coelom", "Coelom\n\nThe coelom is the main body cavity in most animals and is positioned inside the body to surround and contain the digestive tract and other organs.", "In developed animals, it is lined with mesothelium.", "In other animals, such as molluscs, it remains undifferentiated.", "The term \"coelom\" derives from the Ancient Greek word (), meaning \"cavity\".", "During the development of the embryo, coelom formation begins in the gastrulation stage.", "The developing digestive tube of an embryo forms as a blind pouch called the archenteron.", "In Protostomes, the coelom forms by a process known as schizocoely.", "The archenteron initially forms, and the mesoderm splits into two layers: the first attaches to the body wall or ectoderm, forming the parietal layer and the second surrounds the endoderm or alimentary canal forming the visceral layer.", "The space between the parietal layer and the visceral layer is known as the coelom or body cavity.", "In Deuterostomes, the coelom forms by enterocoely: mesoderm buds from the walls of the archenteron and hollows to become the coelomic cavities.", "Deuterostomes are therefore known as \"enterocoelomates\"." ], [ "Coelom", "Some organisms may not possess a coelom or may have a false coelom (pseudocoelom).", "Animals having coeloms are called coelomates, and those without are called acoelomates.", "There are also subtypes of coelom:\n\n\nAccording to Brusca and Brusca, the following bilaterian phyla possess a coelom:\n\n\nFor others, the coelomate phyla excludes Nemertea but also comprises Entoprocta, Pentastoma, Pogonophora (i.e., from tiny sessile aquatic animals to great whales and everything in between).", "In some protostomes, the embryonic blastocoele persists as a body cavity.", "These protostomes have a fluid filled main body cavity unlined or partially lined with tissue derived from mesoderm.", "This fluid-filled space surrounding the internal organs serves several functions like distribution of nutrients and removal of waste or supporting the body as a hydrostatic skeleton.", "A pseudocoelomate or blastocoelomate is any invertebrate animal with a three-layered body and a pseudocoel.", "The coelom was apparently lost or reduced as a result of mutations in certain types of genes that affected early development.", "Thus, pseudocoelomates evolved from coelomates." ] ], "gold": "A coelomate animal, an animal that has a coelom, has a body cavity that is completely lined by one of several kinds of tissue, including mesothelium tissue in many animals and undifferentiated tissue in some animals like molluscs.", "prediction 1": "The coelom or body cavity in most animals is lined with mesothelium. In developed animals, it is lined with mesothelium. In other animals, such as molluscs, it remains undifferentiated. Animals having coeloms are called coelomates, and those without are called acoelomates.", "prediction 2": "In developed animals, the coelom is lined with mesothelium. In other animals, such as molluscs, it remains undifferentiated. In some protostomes, the embryonic blastocoele persists as a body cavity. Protostomes have a fluid filled main body cavity unlined or partially lined with tissue derived from mesoderm.", "prediction 3": "The coelom is the main body cavity in most animals and is positioned inside the body to surround and contain the digestive tract and other organs. In developed animals, it is lined with mesothelium. In other animals, such as molluscs, it remains undifferentiated. Animals having coeloms are called coelomates, and those without are called acoelomates.", "prediction 4": "The coelom is the main body cavity in most animals and is positioned inside the body to surround and contain the digestive tract and other organs. In developed animals, it is lined with mesothelium. In others, such as molluscs, it remains undifferentiated. In some protostomes, the embryonic blastocoele persists as a body cavity. These protostomes have a fluid filled main body cavity unlined or partially lined with tissue derived from mesoderm.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 68 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 273 } ], "missing-info": [], "corrected-prediction": " In developed animals, it is lined with mesothelium. In other animals, such as molluscs, it remains undifferentiated. Animals having coeloms are called coelomates." }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "When was the house of burgesses first established in colonial virginia?", "passages": [ [ "House of Burgesses", "House of Burgesses\n\nThe Virginia House of Burgesses was formed in 1642/43 by the General Assembly.", "By its creation, the General Assembly (established in 1619) then became bicameral.", "From 1642 to 1776, it was the elected representative element of the General Assembly, the legislature of Virginia, which governed together with a royally-appointed colonial governor and Council of State.", "Jamestown remained the capital of the Virginia colony until 1699, when it was initially moved to the College of William & Mary, near Williamsburg and later to the Colonial Capital building in Williamsburg.", "In 1776 the colony became the independent Commonwealth of Virginia and the House of Burgesses became the House of Delegates.", "Originally a synonym of burgher or bourgeois, the word \"burgess\" came to mean a borough representative in local or parliamentary government.", "The Colony of Virginia was founded by an English stock company, the Virginia Company, as a private venture, though under a royal charter.", "Early governors provided the stern leadership and harsh judgments required for the colony to survive its early difficulties.", "As early crises with famine, disease, Native American attempts to keep their good land, the need to establish cash crops, insufficient skilled or committed labor, the colony needed to attract enough new and responsible settlers if it were to grow and prosper." ], [ "Bicameralism", "Bicameralism\n\nA bicameral legislature divides the legislators into two separate assemblies, chambers, or houses.", "Bicameralism is distinguished from unicameralism, in which all members deliberate and vote as a single group, and from some legislatures that have three or more separate assemblies, chambers, or houses.", ", fewer than half the world's national legislatures are bicameral.", "Often, the members of the two chambers are elected or selected by different methods, which vary from country to country.", "This can often lead to the two chambers having very different compositions of members.", "Enactment of primary legislation often requires a concurrent majority \u2013 the approval of a majority of members in each of the chambers of the legislature.", "When this is the case, the legislature may be called an example of perfect bicameralism.", "However, in many Westminster system parliaments, the house to which the executive is responsible can overrule the other house and may be regarded as an example of imperfect bicameralism.", "Some legislatures lie in between these two positions, with one house only able to overrule the other under certain circumstances.", "The Founding Fathers of the United States favoured a bicameral legislature.", "The idea was to have the Senate be wealthier and wiser.", "Benjamin Rush saw this though, and noted that \"this type of dominion is almost always connected with opulence\"." ] ], "gold": "The General Assembly of the colony of Virginia was established in 1619. In 1642 the House of Burgess was created. This was the elected representative element of the General Assembly, making it a bicameral institution. Bicameralism is the practice of having a legislature divided into two separate assemblies, chambers, or houses, known as a bicameral legislature", "prediction 1": "The House of Burgesses in the colony of Virginia was first established in 1642. By its creation, the General Assembly, established in 1619, then became bicameral. From 1642 to 1776, it was the elected representative element of the General Assembly, the legislature of Virginia, which governed together with a royally-appointed colonial governor and Council of State. Jamestown remained the capital of the Virginia colony until 1699, when it was initially moved to the College of William & Mary, near Williamsburg and later to the Colonial Capital building in Williamsburg and later to the Colonial Capital building in Williamsburg.\n", "prediction 2": "The Virginia House of Burgesses was formed in 1642/43 by the General Assembly. Furthermore, the House of Burgesses was the elected representative element of the General Assembly, the legislature of Virginia, from 1642 to 1776. From 1699 to 1776, the House of Burgesses was the elected representative element of the General Assembly, the legislature of Virginia, which governed together with a royally-appointed colonial governor and Council of State.", "prediction 3": "The Virginia House of Burgesses was formed in 1642/43 by the General Assembly. By its creation the General Assembly, established in 1619, then became bicameral. The House of Burgesses governed together with a royally-appointed colonial governor and Council of State. Jamestown remained the capital of the Virginia colony until 1699, when it was initially moved to the College of William & Mary, near Williamsburg and later to the Colonial Capital building in Williamsburg. In 1776, the colony became the independent Commonwealth of Virginia and the Virginia House of Delegates became the House of Delegates.", "prediction 4": "The Virginia House of Burgesses was first established in the colony of Virginia in 1642. However, beginning in 1776, the house was transformed from an elected representation element of the general assembly into a bicameral legislature.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 632 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The House of Burgesses in the colony of Virginia was first established in 1642. By its creation, the General Assembly, established in 1619, then became bicameral. It was the elected representative element of the General Assembly. A bicameral legislature divides the legislators into two separate assemblies, chambers, or houses." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is responsible for slating boom operator key grip production sound mixer director?", "passages": [ [ "Clapperboard", "This is generally not as great a concern with short films, however.", "The clapper loader (or 2nd AC) is generally responsible for the maintenance and operation of the clapperboard, while the script supervisor is responsible for determining which system will be used and what numbers a given take should have.", "While these are usually fairly obvious once a system has been agreed upon, the script supervisor is usually considered the final arbiter in the event of an unclear situation.", "A verbal identification of the numbers, known either as \"voice slate\" or \"announcement\", occurs after sound has reached speed.", "At the same time or shortly thereafter, the camera will start running, and the clapperboard is then filmed briefly at the start of the 'take' and the clapsticks are clapped sharply as soon as the camera has reached sync speed.", "Specific procedures vary depending on the nature of the production (documentary, television, feature, commercial, etc.)", "and the dominant camera assisting conventions of the region; therefore it is not possible to describe a definitive practice aside from the general principles.", "Occasionally, instead of preparing an actual slate, a voice slate will be announced (often by an actor in the scene) and then the actor will clap their hands together, to provide the synchronisation mark." ], [ "Boom operator (media)", "Another instance of a prototype boom mic was on \"The Wild Party\" (1929).", "To allow Clara Bow to move freely on the set, director Dorothy Arzner had technicians rig a microphone onto a fishing rod.", "A patent was filed a year later for a very similar sound-recording device by Edmund H Hansen, a sound engineer at the Fox Film Corporation.", "Often in television studios, the boom operator will use a \"fisher boom\", which is a more intricate and specialized piece of equipment on which the operator stands, allowing precise control of the microphone at a greater distance from the actors.", "They will also attach wireless microphones to persons whose voice requires recording.", "Boom poles are usually manufactured from several lengths of aluminum or carbon fibre tubing, allowing the boom to be extended and collapsed as the situation requires.", "Some poles have a microphone cable routed through the inside of the pole, which may be a regular cable protruding at the bottom end, or a coiled cable that can extend with the pole, connecting to a socket at the base into which the operator plugs the microphone cable.", "The ideal boom pole is lightweight and strong, supporting the weight of the microphone on the end while adding as little weight as possible.", "Frequently, a wind-attenuating cover, called a \"blimp\" or \"mic-blimp\", is used to enclose the microphone." ], [ "Production sound mixer", "Production sound mixer\n\nA production sound mixer, location sound recordist, location sound engineer or simply sound mixer is the member of a film crew or television crew responsible for recording all sound recording on set during the filmmaking or television production using professional audio equipment, for later inclusion in the finished product, or for reference to be used by the sound designer, sound effects editors, or foley artists.", "This requires choice and deployment of microphones, choice of recording media, and mixing of audio signals in real time.", "Usually, the recordist will arrive on location with his/her own equipment, which normally includes microphones, radio systems, booms, mixing desk, audio storage, headphones, cables, tools, and a paper or computer sound logs.", "The recordist may be asked to capture a wide variety of wild sound on location, and must also consider the format of the finished product (mono, stereo or multi channels).", "The recorded production sound track is later combined with other elements, i.e. effects, music, narration, foley or re-recorded dialog by automatic dialogue replacement (ADR)." ] ], "gold": "There are many positions in a film crew. The director is the person who directs the making of the film, the assistant cameraman is responsible for the clapperboard, and the script supervisor is responsible for determining what numbers a given take should have. The boom operator is responsible for using microphones on the end of boom poles while the production sound mixer is the head of the sound department on location, and the key grip is in charge of the setup of cameras and lights.", "prediction 1": "The production sound mixer is responsible for slating the boom operator on a film or television production, if the location sound recordist is not present, the sound editor is responsible for slating the boom operator on a television or film production, or for slating the sound mixer on a video game. Usually, instead of preparing an actual slate, a voice slate will be announced (often by an actor in the scene) and then the actor will clap their hands together, to provide the synchronisation mark.", "prediction 2": "A production sound mixer is the member of a film crew or television crew responsible for recording all sound recording on set during the filmmaking or television production using professional audio equipment, for later inclusion in the finished product, or for reference to be used by the sound designer, sound effects editors, or foley artists. The boom operator or 2nd AC is generally responsible for the maintenance and operation of the boom, while the script supervisor is responsible for determining which system will be used and what numbers a given take should have.", "prediction 3": "The production sound mixer is responsible for recording all sound recording on set during the filmmaking or television production using professional audio equipment, for later inclusion in the finished product, or for reference to be used by the sound designer, sound effects editors, or foley artists. The sound mixer is also known as the location sound recordist, location sound engineer or simply sound mixer.", "prediction 4": "A production sound mixer is the member of a film crew or television crew responsible for recording all sound recording on set during the filmmaking or television production using professional audio equipment, for later inclusion in the finished product, or for reference to be used by the sound designer, sound effects editors, or foley artists. Often in television studios, the boom operator will use a \"fisher boom\", which is a more intricate and specialized piece of equipment on which the operator stands, allowing precise control of the microphone at a greater distance from the actors.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 301 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": " The clapper loader (or 2nd AC) is generally responsible for the maintenance and operation of the clapperboard, while the script supervisor is responsible for determining which system will be used and what numbers a given take should have. The production sound mixer is responsible for slating the boom operator on a film or television production. Usually, instead of preparing an actual slate, a voice slate will be announced (often by an actor in the scene) and then the actor will clap their hands together, to provide the synchronisation mark." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is hope engaged to on days of our lives?", "passages": [ [ "Hope Williams Brady", "Hope Williams Brady\n\nHope Williams Brady is a character on the NBC soap opera \"Days of Our Lives\".", "Created by writer William J. Bell, she has been portrayed by Kristian Alfonso since she was recast on April 14, 1983.", "Hope is a member of the Horton family, the long-running core fictional family on \"Days\".", "She is the mother of Shawn-Douglas Brady, Zack Brady, and Ciara Brady.", "Hope is one half of the supercouple Bo & Hope.", "She works as a cop for the Salem P.D. Hope was promoted to Commissioner of Salem P.D. in 2017.", "Alfonso was nominated for a Daytime Emmy Award for Outstanding Younger Actress in a Drama Series (previously called Outstanding Ingenue) in 1985.", "She has also been nominated for eight Soap Opera Digest Awards and won four \u2014 two with co-star Peter Reckell (Bo) for Favorite Couple (2001, 2003), Hottest Female Star (1999) and Favorite Newcomer (1984).", "She was also nominated for three Young Artist Awards (1984-'86).", "In 2002, she and Reckell won a Special Fan Award (voted online) at the Daytime Emmys for Favorite Couple.", "The character of Hope Williams was originated by child actor Kristina Osterhout from January 10 to August 27, 1974." ], [ "Hope Williams Brady", "Hope is sent off to boarding school in 1982 and is not seen again until a year later.", "She returns in the spring of 1983 when Roman Brady rescues her after she runs away from boarding school and later falls from a car driven by a drunk friend.", "She later develops a crush on Roman.", "Hope eventually becomes a cop, which she takes seriously.", "Roman spurns Hope's advances, even after Hope attempts to seduce him, and the situation inflames the jealousy of Roman's younger brother, local bad boy Bo Brady.", "Bo and Hope start to fall in love while working together in various dangerous situations.", "On Hope's 18th birthday, she and Bo decide to make love but Doug tries to stop them and suffers a heart attack, and Hope agrees never to see Bo again.", "Bo hides the fact that his brother Roman is alive, and to protect Hope, pushes her away.", "Hope spends time with Larry Welch, (a local politician) and thinking that Bo loves Diane Parker and no longer loves her, Hope agrees to marry Larry.", "As Hope and Larry stand at the altar, Bo rides into the church on his motorbike and kidnaps Hope before the wedding can be completed.", "However, Hope is then kidnapped again, this time from the barn where Bo has taken her, and the kidnappers force her to marry Larry." ], [ "Hope Williams Brady", "His sister Kayla Brady locates a clinic in California that will accept Caroline as a patient for a trial treatment.", "Bo leaves town with Caroline, and is reported to have returned to Salem a short while later, but is not seen on screen.", "Bo leaves Salem to work for the ISA and promises his family he will return, but after many months without hearing from him, Hope begin to doubt Bo is coming back.", "She meets lawyer Aiden Jennings in January 2014 and, after receiving no word from Bo, heartbrokenly files for divorce.", "She and Aiden begin a relationship and the two fall madly in love.", "He asks her to marry him and she accepts.", "They marry in a ceremony coinciding with the town's bicentennial.", "On their wedding night, Aiden tries to strangle Hope; a deal he made with Stefano DiMera to kill Hope and clear Stefano's son Chad DiMera's name after Chad is accused of being responsible for multiple murders around town.", "Aiden refused to do it until Stefano and Andre threatened to kill his son Chase if he didn't kill Hope.", "Bo arrives at the last minute, his absence's reason being he was being held hostage for information in Mexico and Aiden is killed while the two are struggling when a gun Bo was holding goes off." ] ], "gold": "Hope Brady is a fictional character from Days of Our Lives, an American soap opera on the NBC network. In 1984, Hope agrees to Larry Welch, thinking that Bo Brady is in love with another character, Megan Hathaway, but Bo kidnaps her at the wedding and in 1985 she becomes engaged to Bo. In 1999 she was engaged to John Black. In 2015, she was engaged to Aiden Jennings, who tried to strangle her on her wedding night but she is saved by Bo, who dies in Hopes arms not long after, but before he dies he makes Rafe Hernandez promise to care for her, leading him to become engaged to Hope in 2018.", "prediction 1": "Hope Williams Brady is a character on the NBC soap opera Days of Our Lives. Created by writer William J. Bell, she has been portrayed by Kristian Alfonso since she was recast on April 14, 1983. The character was originated by child actor Kristina Osterhout from January 10, 1974 to August 27, 1974. Hope was married to lawyer Aiden Jennings in January 2014 and they married in a ceremony coinciding with the town's bicentennial.", "prediction 2": "Hope is engaged to Larry Welch on Days of Our Lives. As they stand at the altar, Bo rides into the church on his motorbike and kidnaps Hope before the wedding can be completed. However, Hope is then kidnapped again, this time from the barn where Bo has taken her, and the kidnappers force her to marry Larry.", "prediction 3": "Hope Williams Brady is a character on the NBC soap opera Days of Our Lives. Created by writer William J. Bell, she has been portrayed by Kristian Alfonso since she was recast on April 14, 1983. The character was originated by child actor Kristina Osterhout from January 10, 1974 to August 27, 1974. She meets lawyer Aiden Jennings in January 2014 and, after receiving no word from Bo, heartbrokenly files for divorce. He asks her to marry him and she accepts. He asks her to marry him and she accepts. They marry in a ceremony coinciding with the town's bicentennial.", "prediction 4": "Hope Williams Brady is a character on the NBC soap opera Days of Our Lives. Created by writer William J. Bell, she has been portrayed by Kristian Alfonso since she was recast on April 14, 1983. Hope is one half of the supercouple Bo & Hope. She is married to Larry Welch and they have a child in the same year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 341, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 428 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 10, 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "Hope Williams Brady is a character on the NBC soap opera Days of Our Lives. Hope was married to lawyer Aiden Jennings. who, on their wedding night, tries to strangle Hope. Bo arrives at the last minute to help. Hope spends time with Larry Welch, (a local politician) and thinking that Bo loves Diane Parker and no longer loves her, Hope agrees to marry Larry. Bo rides into the church on his motorbike and kidnaps Hope before the wedding can be completed." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What was the last movie julia roberts was in?", "passages": [ [ "Julia Roberts", "Julia Roberts\n\nJulia Fiona Roberts (born October 28, 1967) is an American actress and producer.", "She became a Hollywood star after headlining the romantic comedy \"Pretty Woman\" (1990), which grossed $464\u00a0million worldwide.", "She has won three Golden Globe Awards (out of eight nominations) and has been nominated for four Academy Awards for her film acting, winning the Academy Award for Best Actress for her performance in \"Erin Brockovich\" (2000).", "Her films have collectively brought box office receipts of over US$2.8\u00a0billion, making her one of the most successful actresses in terms of box office receipts.", "Her most successful films include \"Mystic Pizza\" (1988), \"Steel Magnolias\" (1989), \"Pretty Woman\" (1990), \"Sleeping with the Enemy\" (1991), \"The Pelican Brief\" (1993), \"My Best Friend's Wedding\" (1997), \"Notting Hill\" (1999), \"Runaway Bride\" (1999), \"Ocean's Eleven\" (2001), \"Ocean's Twelve\" (2004), \"Charlie Wilson's War\" (2007), \"Valentine's Day\" (2010), \"Eat Pray Love\" (2010), \"Money Monster\" (2016), and \"Wonder\" (2017)." ], [ "Julia Roberts", "In 2014, Roberts starred as Dr. Emma Brookner, a character based on Dr. Linda Laubenstein, in the television adaptation of Larry Kramer's AIDS-era play, \"The Normal Heart\", which aired on HBO; the film was critically acclaimed and \"Vanity Fair\", in its review, wrote: \"Roberts, meanwhile, hums with righteous, \"Erin Brokovich\"-ian anger.", "Between this and \"August: Osage County\", she's carving out a nice new niche for herself, playing brittle women who show their love and concern through explosive temper\".", "Her role garnered her a nomination for the Primetime Emmy Award for Outstanding Supporting Actress in a Miniseries or a Movie.", "She also narrated \"Women in Hollywood\", an episode of the second season of \"\", in 2014.", "In 2015, Roberts appeared in Givenchy's spring\u2013summer campaign, and starred as a grieving mother opposite Nicole Kidman and Chiwetel Ejiofor in the little-seen film \"Secret in Their Eyes\", a remake of the 2009 Argentine film of the same name, both based on the novel \"La pregunta de sus ojos\" by author Eduardo Sacheri." ] ], "gold": "Actress Julia Roberts was in three different movies three years in a row. In 2015, Roberts was in Secret in Their Eyes, in 2016, Money Monster, and in 2017, Wonder. ", "prediction 1": "Julia Roberts is an American actress and producer who has appeared in several movies. Her most successful films include Pretty Woman (1990), Sleeping With the Enemy (1991), Sleeping with the Enemy (1991), Sleeping With the Enemy (1991), Sleeping With the Enemy (1991), My Best Friend's Wedding (1997, 1999), Notting Hill (1999), Runaway Bride (1999), Ocean's Eleven (2001), Ocean's Twelve (2004, 2007), Valentine's Day (2010), \"Eat Pray Love\" (2010), Money Monster (2016), and Wonder (2017).", "prediction 2": "Julia Roberts is an American actress, producer, and writer, who became a Hollywood star after headlining the romantic comedy Pretty Woman in 1990, which grossed $464 million worldwide. She was in the movie Wonder from 2017 to 2022.", "prediction 3": "Julia Roberts is an American actress and producer who played the lead in the romantic comedy Pretty Woman and the comedy Wonder. In 2015, Roberts starred as a grieving mother opposite Nicole Kidman and Chiwetel Ejiofor in the little-seen film Secret in Their Eyes. Roberts also appeared in the 2016 film Wonder, which was also a remake of the 2009 Argentine film of the same name.", "prediction 4": "Julia Roberts is an American actress and producer. She became a Hollywood star after headlining the romantic comedy Pretty Woman in 1990, which grossed $464 million worldwide. Roberts' films have collectively brought box office receipts of over US$2.8 billion, making her one of the most successful actresses in terms of box office receipts. In 2015, Roberts starred as a grieving mother opposite Nicole Kidman and Chiwetel Ejiofor in the little-seen film Secret in Their Eyes, a remake of the 2009 Argentine film of the same name.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 450 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Julia Roberts is an American actress and producer who has appeared in several movies. In 2015, Roberts starred as a grieving mother opposite Nicole Kidman and Chiwetel Ejiofor in the little-seen film \"Secret in Their Eyes\", a remake of the 2009 Argentine film of the same name, followed by Money Monster (2016), and Wonder (2017)." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does ready player one the movie come out?", "passages": [ [ "Ready Player One (film)", "\"Ready Player One\" was initially scheduled to be released on December 15, 2017, but was pushed back to March 30, 2018, to avoid competition with \"\".", "In January 2018, it was announced the film's release date had been moved up one day to March 29, 2018.", "The film had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 (as part of the South by Southwest Film Festival).", "Warner Bros. Pictures distributed the film worldwide, with Village Roadshow Pictures distributing in several overseas territories.", "\"Ready Player One\" was released on digital copy on July 3, 2018, and on 4K UHD Blu-ray, Blu-ray 3D, Blu-Ray, and DVD on July 24, 2018.", "The film debuted at the top of the \nNPD VideoScan First Alert chart for the week ending on July 27, 2018.", "It retained the No. 1 spot on the chart for the week ending on August 4, 2018.", "\"Ready Player One\" has grossed $137 million in the United States and Canada, and $445.2 million in other territories, for a worldwide total of $582.2 million.", "Made on a production budget of $175 million, with about $150 million more spent on global marketing costs, the film needed to gross at least $440 million in order to break-even." ] ], "gold": "The American film \"Ready Player One\" premiered at South by Southwest in Austin, Texas on March 11, 2018, and was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018. Ready Player One grossed $137.7 million in the United States and Canada, and $445.2 million in other territories, for a worldwide total of $582.9 million.", "prediction 1": "Ready Player One was originally scheduled to be released on December 15, 2017, but was pushed back to March 30, 2018, to avoid competition with. In January 2018, it was announced the film's release date had been moved up one day to March 29, 2018. The film's world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 (as part of the South by Southwest Film Festival). \"Ready Player One\" was released on digital copy on July 3, 2018, and on 4K UHD Blu-ray, Blu-ray 3D, Blu-Ray, DVD on July 24, 2018.", "prediction 2": "Ready Player One the movie came out on digital copy on July 3, 2018, and on 4K UHD Blu-ray, Blu-ray 3D, Blu-Ray, and DVD on July 24, 2018.", "prediction 3": "Ready Player One was initially scheduled to be released on December 15, 2017, but was pushed back to March 30, 2018, to avoid competition with \"\". In January 2018, it was announced the film's release date had been moved up one day to March 29, 2018.", "prediction 4": "Ready Player One was initially scheduled to be released on December 15, 2017, but was pushed back to March 30, 2018, to avoid competition with \"\". In January 2018, it was announced the film's release date had been moved up one day to March 29, 2018. The film had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 (as part of the South by Southwest Film Festival). Ready Player One was released on digital copy on July 3, 2018, and on 4K UHD Blu-ray, Blu-ray 3D, Blu-Ray, DVD, and DVD on July 24, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 384 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 515 }, { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 228 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"Ready Player One\" had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018. Its release date was March 29, 2018. \"Ready Player One\" has grossed $137 million in the United States and Canada, and $445.2 million in other territories, for a worldwide total of $582.2 million." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "What are the powerful queens of kush called?", "passages": [ [ "Candace (given name)", "Candace (given name)\n\n", "Candace is a female given name from the Bible, ultimately deriving from the term kandake, a title for a queen or queen mother in the ancient African Kingdom of Kush; also meaning pure and innocent.", "In the United States, it was a popular name during the late 1970s, throughout the 1980s, and into the early 1990s.", "Candace may refer to:\n\n\n\nCandice, a rarer variant spelling" ], [ "Kandake", "In 25 BC the Kush kandake Amanirenas, as reported by Strabo, attacked the city of Syene, today's Aswan, in territory of the Roman Empire; Emperor Augustus destroyed the city of Napata in retaliation.", "Four African queens were known to the Greco-Roman world as the \"Candaces\": Amanishakhete, Amanirenas, Nawidemak, and Malegereabar.", "In the New Testament of the Christian Bible, a treasury official of \"Candace, queen of the Ethiopians\", returning from a trip to Jerusalem, met with Philip the Evangelist:\n\nThen the Angel of the Lord said to Philip, Start out and go south to the road that leads down from Jerusalem to Gaza, which is desert.", "And he arose and went: And behold, a man of Ethiopia, an Eunuch of great authority under Candace, Queen of Ethiopians, who had the charge of all her treasure, and had come to Jerusalem to worship.", "The queen concerned may have been Amantitere (AD 22\u201341).", "He discussed with Philip the meaning of a perplexing passage from the prophet Isaiah.", "Philip explained the scripture to him and he was promptly baptised in some nearby water.", "The eunuch 'went on his way, rejoicing', and presumably therefore reported back on his conversion to the Kandake." ] ], "gold": "The queens of Kush are called Kandake in Meroitic, a term for the sister of the king of Kush. Four African queens were known to the Greco-Roman world as the \"Candaces\". \"Candaces\" is ultimately deriving from the term kandake.", "prediction 1": "The powerful queens of Kush are called kandakes, a title for a queen or queen mother. In the ancient African Kingdom of Kush, Candace is a female given name from the Bible, ultimately deriving from the term kandake, a title for a queen or queen mother. In the United States, it was a popular name during the late 1970s, throughout the 1980s, and into the early 1990s.", "prediction 2": "Kush queens were referred to to to the Greco-Roman world as the \"Candaces\". They were named Amanishakhete, Amanirenas, Nawidemak, and Malegereabar.", "prediction 3": "The powerful queens of Kush are known as the Kandakes, and their title is kandake, which means queen or queen mother in the ancient African kingdom of Kush. The four powerful queens of Kush are Amanishakhete, Amanirenas, Nawidemak, and Malegereabar.", "prediction 4": "There are multiple powerful queens of Kush. They were known to the Greco-Roman world as the \"Candaces\": Amanishakhete, Amanirenas, Nawidemak, and Malegereabar.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 367 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The powerful queens of Kush are called kandakes, a title for a queen or queen mother. Four African queens were known to the Greco-Roman world as the \"Candaces\", which ultimately derives from the term kandake." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What made up the three tiers of the japanese political system around 1600?", "passages": [ [ "Edo period", "During the Tokugawa period, the social order, based on inherited position rather than personal merits, was rigid and highly formalized.", "At the top were the emperor and court nobles (\"kuge\"), together with the \"sh\u014dgun\" and \"daimy\u014d\".", "Below them the population was divided into four classes in a system known as \"mibunsei\" (\u8eab\u5206\u5236): the samurai on top (about 5% of the population) and the peasants (more than 80% of the population) on the second level.", "Below the peasants were the craftsmen, and even below them, on the fourth level, were the merchants.", "Only the peasants lived in the rural areas.", "Samurai, craftsmen and merchants lived in the cities that were built around \"daimy\u014d\" castles, each restricted to their own quarter.", "Outside the four classes were the so-called \"eta\" and \"hinin\", those whose professions broke the taboos of Buddhism.", "\"Eta\" were butchers, tanners and undertakers.", "\"Hinin\" served as town guards, street cleaners, and executioners.", "Other outsiders included the beggars, entertainers, and prostitutes." ], [ "Edo period", "He maintained two million \"koku\" of land, a new headquarters at Edo, a strategically situated castle town (the future Tokyo), and also had an additional two million \"koku\" of land and thirty-eight vassals under his control.", "After Hideyoshi's death, Ieyasu moved quickly to seize control from the Toyotomi clan.", "Ieyasu's victory over the western \"daimy\u014d\" at the Battle of Sekigahara (October 21, 1600, or in the Japanese calendar on the 15th day of the ninth month of the fifth year of the Keich\u014d era) gave him control of all Japan.", "He rapidly abolished numerous enemy \"daimy\u014d\" houses, reduced others, such as that of the Toyotomi, and redistributed the spoils of war to his family and allies.", "Ieyasu still failed to achieve complete control of the western \"daimy\u014d\", but his assumption of the title of \"sh\u014dgun\" helped consolidate the alliance system.", "After further strengthening his power base, Ieyasu installed his son Hidetada (1579\u20131632) as \"sh\u014dgun\" and himself as retired \"sh\u014dgun\" in 1605.", "The Toyotomi were still a significant threat, and Ieyasu devoted the next decade to their eradication." ] ], "gold": "The Tokugawa (or Edo) period brought 250 years of stability to Japan between 1603 and 1867. The periods social order, based on inherited position rather than personal merits, was rigid and highly formalized. At the top were the emperor and court nobles (kuge). The next tier was made up of the sh\u014dgun, military dictators appointed by the\u00a0Emperor, sh\u014dgun were usually the\u00a0de facto\u00a0rulers. Daimy\u014d were powerful Japanese\u00a0magnates who ruled most of Japan from their vast, hereditary land holdings.", "prediction 1": "The top, middle and bottom tiers of the Japanese political system around 1600 were the emperor, court nobles and the shgun, together with the daimy. Below them, the population was divided into four classes in a system known as \"mibunsei\" (): the samurai on top (about 5% of the population) and the peasants (more than 80% of the population) on the second level. Below the peasants were the craftsmen and even below them, on the fourth level, were the merchants.", "prediction 2": "The three tiers of the japanese political system around 1600 were the emperor, court nobles, and shgun, together with the daimy. Below them the population was divided into four classes in a system known as mibunsei (): the samurai on top and the peasants on the second level. Below the peasants were the craftsmen, and even below them, on the fourth level, were the merchants.", "prediction 3": "The four classes of Japanese society were known as mibunsei, or a system based on a hierarchy based on inherited position rather than personal merits. Below the emperor and court nobles were the shgun and daimy, at the top were the samurai, about 5% of the population, and the peasants, more than 80% of the population, on the second level. Below the peasants were the craftsmen, and even below them, on the fourth level, were the merchants.", "prediction 4": "The three tiers of Japan's political system around 1600 were the emperor, the shgun, and the daimy. Below them, the population was divided into four classes in a system known as mibunsei. The samurai were on the top and the peasants on the second. The craftsmen and merchants were below the peasants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 461 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10, 7 ] } ], "corrected-prediction": "The top, middle and bottom tiers of the Japanese political system around 1600 were the emperor, court nobles and the shogun, together with the daimyo. Below them, the population was divided into four classes in a system known as \"mibunsei\". Outside the four classes were the so-called \"eta\" and \"hinin\", and other outsiders." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "The hottest recorded temperature on earth occurred where?", "passages": [ [ "Highest temperature recorded on Earth", "Highest temperature recorded on Earth\n\nAccording to the World Meteorological Organization (WMO), the highest registered air temperature on Earth was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States, on July 10, 1913.", "The WMO itself admits that \"[a]fter examining the temperature record in detail, [it was] noted that this temperature may be the result of a sandstorm that occurred at the time.", "Such a storm may have caused superheated surface materials to hit upon the temperature in the shelter\" - what would mean the recording did not refer to air temperature.", "Weather historians such as Christopher C. Burt also claim that the 1913 Death Valley reading is \"a myth\", and is at least too high.", "This same conclusion has also been reached by historians Dr. Arnold Court and William Taylor Reid.", "If the 1913 record were to be decertified, the highest recorded air temperature on Earth would be , recorded both in Death Valley on June 20, 2013, and in Mitribah, Kuwait on July 21, 2016.", "The standard measuring conditions for temperature are in the air, 1.5 meters above the ground, and shielded from direct sunlight.", "From 1922 until 2012, the WMO record for the highest official temperature on Earth was , registered on September 13, 1922 in \u2018Aziziya, Libya." ], [ "Highest temperature recorded on Earth", "In January 2012, the WMO decertified the 1922 record, citing persuasive evidence that it was a faulty reading recorded in error by an inexperienced observer.", "Temperatures measured directly on the ground may exceed air temperatures by 30 to 50\u00a0\u00b0C.", "The theoretical maximum possible ground surface temperature has been estimated to be between 90 and 100\u00a0\u00b0C (between 194 and 212 \u00b0F) for dry, darkish soils of low thermal conductivity.", "While there is no highest confirmed ground temperature, a reading of 93.9\u00a0\u00b0C (201\u00a0\u00b0F) was allegedly recorded in Furnace Creek Ranch on July 15, 1972.", "Temperature measurements via satellite also tend to capture occurrence of higher records but, due to complications involving satellite's altitude loss (a side effect of atmospheric friction), these measurements are often considered less reliable than ground-positioned thermometers.", "The highest recorded temperature taken by a satellite is , which was measured in the Flaming Mountains of China in 2008.", "Other satellite measurements of ground temperature taken between 2003 and 2009, taken with the MODIS infrared spectroradiometer on the Aqua satellite, found a maximum temperature of 70.7\u00a0\u00b0C (159.3\u00a0\u00b0F), which was recorded in 2005 in the Lut Desert, Iran.", "The Lut Desert was also found to have the highest maximum temperature in 5 of the 7 years measured (2004, 2005, 2006, 2007 and 2009)." ], [ "Death Valley", "Death Valley\n\nDeath Valley is a desert valley located in Eastern California, in the northern Mojave Desert bordering the Great Basin Desert.", "It is one of the hottest places in the world at the height of summertime along with deserts in the Middle East.", "Death Valley's Badwater Basin is the point of the lowest elevation in North America, at below sea level.", "This point is east-southeast of Mount Whitney, the highest point in the contiguous United States with an elevation of 14,505 feet (4,421 m).", "Death Valley's Furnace Creek holds the record for the highest reliably recorded air temperature on Earth at 134\u00a0\u00b0F (56.7\u00a0\u00b0C) on July 10, 1913, as well as the highest recorded natural ground surface temperature on Earth at 201\u00a0\u00b0F (93.9\u00a0\u00b0C) on July 15, 1972.", "Located near the border of California and Nevada, in the Great Basin, east of the Sierra Nevada mountains, Death Valley constitutes much of Death Valley National Park and is the principal feature of the Mojave and Colorado Deserts Biosphere Reserve.", "It is located mostly in Inyo County, California.", "It runs from north to south between the Amargosa Range on the east and the Panamint Range on the west; the Grapevine Mountains and the Owlshead Mountains form its northern and southern boundaries, respectively.", "It has an area of about ." ] ], "gold": "Death Valley is a desert valley in Eastern California, in the northern Mojave Desert, bordering the Great Basin Desert, and the point of lowest elevation in North America, at 86 meters below sea level. Both the hottest air temperature at 56.7 \u00b0C, and the alleged highest ground temperature at 93,9 \u00b0C were recorded in the Death Valley. Nonetheless, the highest temperature ever recorded by satellite was taken with the taken with the MODIS infrared spectroradiometer on the Aqua satellite over the Lut Dessert, Iran, measuring a ground temperature of 70.7 \u00b0C.", "prediction 1": "According to the World Meteorological Organization, the highest registered air temperature on Earth was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States, on July 10, 1913. The highest recorded temperature for a day on the ground occurred in Death Valley on June 20, 2013, and in Mitribah, Kuwait on July 21, 2016. Temperature measurements via satellite also tend to capture occurrence of higher records, but, due to complications involving satellite's altitude loss, these measurements are often considered less reliable than ground-positioned thermometers. The highest recorded air temperature on Earth was in Furnace Creek Ranch, California on July 15, 1972.", "prediction 2": "The highest recorded air temperature on Earth was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States on July 10, 1913. The highest recorded ground temperature was allegedly recorded on July 15, 1972 at 201 \u00b0F (93.9 \u00b0C).", "prediction 3": "According to the World Meteorological Organization, the highest registered air temperature on Earth was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States, on July 10, 1913. The highest recorded ground temperature was allegedly recorded in Furnace Creek Ranch on July 15, 1972.", "prediction 4": "According to the World Meteorological Organization (WMO), the highest registered air temperature on Earth was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States, on July 10, 1913. Additionally, the highest recorded ground temperature occurred in the Lut Desert, Iran on July 15, 1972.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 600 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 315, "end": 356 }, { "error type": "Redundant", "explanation": "According to the World Meteorological Organization, the highest registered air temperature on Earth was in Furnace Creek Ranch, California, ", "start": 601, "end": 697 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The highest registered air temperature on Earth, 56.7 \u00b0C, was in Furnace Creek Ranch, California, located in the Death Valley desert in the United States. It is located in Eastern California, in the northern Mojave Desert, bordering the Great Basin Desert, and the point of lowest elevation in North America, below sea level. The highest recorded temperature for a day on the ground, 93.9 \u00b0C, occurred in Death Valley. Satellite measurements of ground temperature taken with the MODIS infrared spectroradiometer on the Aqua satellite, found a maximum temperature of 70.7 \u00b0C, in the Lut Desert, Iran." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Which channel in youtube has the most subscribers?", "passages": [ [ "T-Series (company)", "T-Series' and one of the most expensive Indian films will be \"Saaho\", a sci-fi thriller with a production budget of , scheduled for release in 2019.", "T-Series is also producing a biopic film based on the life of its founder Gulshan Kumar, called \"Mogul\", which is currently under production and is scheduled for release in 2019.", "T-Series joined YouTube on 13 March 2006, but only started uploading videos in late 2010.", "Under this channel, T-Series primarily shows music videos and film trailers.", "By July 2013, it had crossed 100 crore (1 billion) views, becoming the second Indian YouTube channel to cross the milestone after Rajshri Productions.", "In February 2017, T-Series surpassed PewDiePie to become the world's most-viewed YouTube channel.", "As of 19 December 2018 it has 5,600 crore (56 billion) views.", "The YouTube channel has reached 7.5 crore (75 million) subscribers, making it the second most-subscribed YouTube channel after PewDiePie.", "Currently, it is the most subscribed Asian and non-English-language YouTube channel.", "Reaching 5 crore (50 million) subscribers, the channel received a Custom Play Button on September 10, 2018.", "It is also the second channel ever to hit 7 crore (70 million) subscribers." ], [ "YouTube Spotlight", "YouTube Spotlight\n\nYouTube Spotlight is YouTube's official video channel for spotlighting videos and events on YouTube.", "Events shown on the channel include YouTube Comedy Week and the YouTube Music Awards.", "Additionally, the channel uploads annual installments of \"YouTube Rewind\".", "On November 2, 2013, the YouTube Spotlight channel briefly surpassed PewDiePie's channel, to become the most subscribed channel on the website.", "The channel ascended to the top position through autosuggesting and pre-selecting itself as a subscription option upon new user registration for YouTube.", "Throughout December 2013, the channel and PewDiePie struggled for the top position, until PewDiePie secured it on December 22.", "As of November 2018, the channel has earned over 27 million subscribers and 1.4 billion video views.", "The channel is ranked as the 26th most subscribed channel.", "Since 2010, YouTube has released an annual \"YouTube Rewind\" video through its \"Spotlight\" channel.", "All YouTube Rewind videos from 2012\u20142018 have surpassed 100 million views, while the 2016 edition surpassed 200 million views.", "The 2010 and 2011 videos, however, have less than 10 million views each.", "The 2016 video became YouTube's fastest video to reach 100 million views, doing so in just 3.2 days.", "It is also the eighth most liked non-music video of all time with over 3.40 million likes." ], [ "PewDiePie", "PewDiePie\n\nFelix Arvid Ulf Kjellberg ( ; ; born 24 October 1989), known online as PewDiePie ( ), is a Swedish YouTuber, comedian and video game commentator, formerly best known for his Let's Play commentaries and now mostly known for his comedic formatted shows.", "Born in Gothenburg, Sweden, PewDiePie originally pursued a degree in industrial economics and technology management at Chalmers University of Technology in Gothenburg.", "In 2010, during his time at the university, he registered a YouTube account under the name PewDiePie.", "The following year, he dropped out of Chalmers after losing interest in his degree field, much to the dismay of his parents.", "After failing to earn an apprenticeship with an advertising agency in Scandinavia, he then decided to focus on creating content for his YouTube channel.", "In order to fund his videos, PewDiePie began selling prints of his Photoshop art projects and worked at a hot dog stand.", "PewDiePie soon gathered a rapidly increasing online following, and in July 2012, his channel surpassed one million subscribers.", "On 15 August 2013, PewDiePie became the most-subscribed user on YouTube, being briefly surpassed in late 2013 by YouTube Spotlight.", "After regaining the top position on 23 December 2013 the channel has now amassed over 77 million subscribers ." ] ], "gold": "The most-subscribed channel as of September 2021, is T-Series, an Indian music video publisher operated by the entertainment company of the same name, that has a subscriber count of 193 million, and has held the most-subscribed spot since April 14, 2019. Before T-Series, the Swedish YouTuber PewDiePie, known for his Let's Play videos and comedic formatted videos and shows, held the spot for top subscribers until mid-2018, when T-Series rapidly approached his subscriber account. This encouraged a competition, which other YouTubers, and celebrities showed their support for, gaining both channels a large number of subscribers at a rapid rate, but in the end, T-Series won the race and became the first channel to cross the 100 million subscribers mark. On November 2, 2013, YouTube Spotlight, YouTube's official YouTube channel for spotlighting videos and events on the platform, briefly surpassed PewDiePie's channel in subscribers through auto-suggesting and pre-selecting itself as a subscription option upon new user registration for YouTube, which led the two channels to struggle for the top position, but soon PewDiePie secured it on December 23-28, 2013.", "prediction 1": "YouTube's official video channel for spotlighting videos and events has the most subscribers of any channel. PewDiePie's channel has the most subscribers, followed by T-Series, which has the most subscribers, and finally, YouTube Spotlight which has the most subscribers.", "prediction 2": "YouTube's official video channel for spotlighting videos and events is called YouTube Spotlight, and as such, has the most subscribers. PewDiePie's channel has the most subscribers.", "prediction 3": "YouTube's official video channel for spotlighting videos and events on YouTube has the most subscribers. PewDiePie's channel has the most subscribers. The channel has a total of 77 million subscribers.", "prediction 4": "In February 2017, T-Series surpassed PewDiePie to become the world's most-viewed YouTube channel. As of 19 December 2018, it has 5,600 crore views. The channel has reached 7.5 crore (75 million) subscribers, making it the second most-subscribed YouTube channel after PewDiePie. Currently, it is the most subscribed Asian and non-English-language YouTube channel. YouTube Spotlight is YouTube's official video channel for spotlighting videos and events on YouTube. On November 2, 2013, the channel briefly surpassed PewDiePie to become the most-subscribed channel on the website.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 68, "end": 108 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 137, "end": 154 }, { "error type": "Redundant", "explanation": "YouTube's official video channel for spotlighting videos and events has the most subscribers of any channel. ", "start": 222, "end": 271 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "YouTube's official video channel for spotlighting videos and events. On November 2, 2013, the YouTube Spotlight channel briefly surpassed PewDiePie's channel, to become the most subscribed channel on the website. The channel ascended to the top position through autosuggesting and pre-selecting itself as a subscription option upon new user registration for YouTube. PewDiePie regained the top position on 23 December 2013. In February 2017, T-Series surpassed PewDiePie to become the world's most-viewed YouTube channel." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sang on the banks of the river?", "passages": [ [ "Running Bear", "Running Bear\n\n\"Running Bear\" is a song written by Jiles Perry Richardson (a.k.a.", "The Big Bopper) and sung most famously by Johnny Preston in 1959.", "The 1959 recording featured background vocals by Richardson and George Jones and the session's producer Bill Hall, who provided the \"Indian chanting\" of \"uga-uga\" during the three verses, as well as the \"Indian war cries\" at the start and end of the record.", "It was No. 1 for three weeks in January 1960 on the \"\"Billboard\" Hot 100\" in the United States.", "The song also reached No. 1 in the UK Singles Chart in 1960.", "Coincidentally, \"Running Bear\" was immediately preceded in the Hot 100 No. 1 position by Marty Robbins' \"El Paso\", another song in which the protagonist dies.", "\"Billboard\" ranked \"Running Bear\" as the No. 4 song of 1960.", "Richardson was a friend of Preston and offered \"Running Bear\" to him after hearing him perform in a club.", "Preston recorded the song at the Gold Star Studios in Houston, Texas in 1958.", "The saxophone was played by Link Davis.", "Preston was signed to Mercury Records, and \"Running Bear\" was released in August 1959, seven months after Richardson's death in the plane crash that also killed Buddy Holly and Ritchie Valens." ], [ "On the Banks of the Wabash, Far Away", "Edison Records paid popular singers like Harry Macdonough to sing the songs and then sold the recordings without paying any royalties to the composer or publisher of the music.", "Dresser joined with other prominent composers to seek a change in U.S. copyright laws.", "In 1902 Dresser met with U.S. senators and the Secretary of State in Washington, D.C.", "He also submitted papers with the U.S. State Department asking for an extension of copyright protection outside the United States, especially in Canada and England.", "By 1900 \"Wabash\" had sold millions of copies, becoming the best selling song of its time in terms of sheet music sold.", "The ballad remained popular during the 1920s, becoming a staple song in many singing acts, including male quartet performances.", "In addition, J. Stuart Blackton directed a 1923 silent film of the same title that was based partially on the song's lyrics.", "The song was later featured prominently in the 1942 film \"My Gal Sal\", the title of another song by Dresser.", "Bing Crosby included the song in a medley on his album 'Join Bing and Sing Along\" (1959)\n\n", "The ballad speaks of the Wabash River, which flows through Indiana, and reminisces about events that occurred there.", "The song has two verses and a chorus." ], [ "On the Banks of the Wabash, Far Away", "On the Banks of the Wabash, Far Away\n\n\"On the Banks of the Wabash, Far Away\" was among the best-selling songs of the 19th\u00a0century, earning over $100,000 from sheet-music revenues.", "Written and composed by American songwriter Paul Dresser, it was published by the Tin Pan Alley firm of Howley, Haviland and Company in October 1897.", "The lyrics of the ballad reminisce about life near Dresser's childhood home by the Wabash River in Indiana, United States.", "The song remained popular for decades, and the Indiana General Assembly adopted it as the official state song on March 14, 1913.", "The song was the basis for a 1923 film of the same title.", "Its longtime popularity led to the emergence of several lyrical versions, including an 1898 anti-war song and a Swedish version that was a number-one hit.", "The song was composed during a transitory time in musical history when songs first began to be recorded for the phonograph.", "It was among the earliest pieces of popular music to be recorded.", "Dresser's inability to control the distribution of phonograph cylinders led him and his company to join other composers to petition the United States Congress to expand federal copyright protections over the new technology.", "Dresser's ballad was the subject of some controversy after his death in 1906." ] ], "gold": "There are several songs which contain the words \"on the banks of the river.\" One of them is the 1959 song, \"Running Bear,\" written by Jiles Perry Richardson, a.k.a. The Big Bopper, and sung by Johnny Preston. The recording featured background vocals by Richardson, George Jones, and the session's producer, Bill Hall. Another possible song containing those lyrics is \"On the Banks of the Wabash, Far Away,\" which was one of the best-selling songs of the 19th Century, published in October 1897. It was famously sung by Bing Crosby in 1959 on his album, \"Join Bing and Sing Along.\"", "prediction 1": "\"On the Banks of the Wabash, Far Away\" is a ballad written by American songwriter Paul Dresser and sung most famously by Johnny Preston in 1959. The 1959 recording featured background vocals by Richardson and George Jones and the session's producer Bill Hall, who provided the \"Indian chanting\" of \"uga-uga\" during the three verses, as well as the \"Indian war cries\" at the start and end of the record. The 1959 recording was produced by Preston.", "prediction 2": "The song \"On the Banks of the Wabash, Far Away\" was composed and written by American songwriter Paul Dresser. It was among the best-selling songs of the 19th century, earning over $100,000 from sheet music revenues. It was sung most famously by Johnny Preston in 1959. The 1959 recording featured background vocals by Richardson and George Jones and the session's producer Bill Hall, who provided the \"Indian chanting\" of \"uga-uga\" during the three verses, as well as the \"Indian war cries\" at the start and the end of the record.", "prediction 3": "\"On the Banks of the Wabash, Far Away\" was among the best-selling songs of the 19th century, earning over $100,000 from sheet music revenues. Written and composed by American songwriter Paul Dresser, it was published by the Tin Pan Alley firm of Howley, Haviland and Company in October 1897. The lyrics of the ballad reminisce about life near Dresser's childhood home by the Wabash River in Indiana, United States. It was sung most famously by Johnny Preston in 1959.", "prediction 4": "On the Banks of the Wabash, Far Away was among the best-selling songs of the 19th century, earning over $100,000 from sheet-music revenues. The ballad was composed and written by American songwriter Paul Dresser and featured lyrics that reminisce about life near Dresser's childhood home by the Wabash River in Indiana, United States. Johnny Preston sang the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 402 }, { "error type": "Irrelevant", "explanation": "", "start": 403, "end": 446 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,2]}", "start": 0, "end": 38 }, { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 81 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 82, "end": 94 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "\"Running Bear\" is a song written by Jiles Perry Richardson and sung most famously by Johnny Preston in 1959. The 1959 recording featured background vocals by Richardson and George Jones and the session's producer Bill Hall. Another possible song, \"On the Banks of the Wabash, Far Away\" was among the best-selling songs of the 19th century. It was published in October 1897. Bing Crosby included the song in a medley on his album 'Join Bing and Sing Along\" (1959)" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "How many seasons is there of the simpsons?", "passages": [ [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ], [ "The Simpsons", "As of the twenty-first season (2009\u20132010), \"The Simpsons\" became the longest-running American scripted primetime television series, having surpassed \"Gunsmoke\".", "On April 29, 2018, \"The Simpsons\" also surpassed \"Gunsmoke\"s 635-episode count with the episode \"Forgive and Regret.\"", "\"The Simpsons\" has won dozens of awards since it debuted as a series, including 31 Primetime Emmy Awards, 30 Annie Awards and a Peabody Award.", "In a 1999 issue celebrating the 20th century's greatest achievements in arts and entertainment, \"Time\" magazine named \"The Simpsons\" the century's best television series.", "In that same issue, \"Time\" included Bart Simpson in the \"\", the publication's list of the century's 100 most influential people.", "Bart was the only fictional character on the list.", "On January 14, 2000, the Simpsons were awarded a star on the Hollywood Walk of Fame.", "Also in 2000, \"Entertainment Weekly\" magazine TV critic Ken Tucker named \"The Simpsons\" the greatest television show of the 1990s.", "Furthermore, viewers of the UK television channel Channel 4 have voted \"The Simpsons\" at the top of two polls: 2001's 100 Greatest Kids' TV shows, and 2005's The 100 Greatest Cartoons, with Homer Simpson voted into first place in 2001's 100 Greatest TV Characters." ], [ "The Simpsons (season 29)", "The Simpsons (season 29)\n\nThe twenty-ninth season of the animated television series \"The Simpsons\" premiered on Fox in the United States on October 1, 2017, and ended on May 20, 2018.", "On November 4, 2016, \"The Simpsons\" was renewed for seasons 29 and 30.", "This season marked the show's surpassing \"Gunsmoke\" as the longest-running scripted series in primetime television by number of episodes, with the series' 636th episode \"Forgive and Regret\".", "The season features guest appearances from Norman Lear, Martin Short, Ray Liotta and Nikolaj Coster-Waldau.", "In addition, Bill Plympton animated a sixth couch gag in \"3 Scenes Plus a Tag from a Marriage\", having previously done so in season 23's \"Beware My Cheating Bart\", season 24's \"Black Eyed, Please\", season 25's \"Married to the Blob\", season 27's \"Lisa the Veterinarian\", and season 28's \"22 for 30\".", "This season also features Kelsey Grammer reprising his role as Sideshow Bob for a singing cameo and Homer seeking help from Shaquille O'Neal (\"Gone Boy\"), and a song written by guest star Rachel Bloom (\"Springfield Splendor\")." ] ], "gold": "There have been 32 seasons of The Simpsons. Season 27 was in 2015, season 28 in 2016, and season 29 premiered in 2017. Its thirty-third season will begin on September 26, 2021.", "prediction 1": "The Simpsons have had multiple seasons. Season 1 had two episodes each, and Season 2 had three. There was also a fourth and fifth season. There was also a seventh and a twentieth season. Season 31 had two episodes each.", "prediction 2": "The Simpsons has had multiple seasons. In total there are 30 seasons of the animated television series The Simpsons. It is the longest-running primetime series in the United States and has a run-time of 102 episodes. The first and second seasons of Wentworth were renewed for a third season in 2014. In a similar manner, a fourth season had been ordered, before the second had aired. There was also a fifth season commissioned, which aired from March 2015 to April 2017.", "prediction 3": "There are currently three seasons of the television series The Simpsons. The first season aired on October 5, 2009. The second season aired on October 13, 2007. The third season aired on May 10, 2016. The fourth and fifth seasons aired on April 4, 2017 and May 9, 2018.", "prediction 4": "There are 31 seasons of the American sitcom The Simpsons. The series has been renewed for a total of 31 seasons. There have been two additional seasons of the teen comedy Wentworth, which had 2 seasons. The third season of the animated series The Simpsons had 2 seasons, the fourth season had 2 seasons and the fifth season had 2 seasons. The third season of the teen musical The Simpsons had 2 seasons.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 187, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 186 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Simpsons has had at least 30 seasons, as it was renewed for a 30th season in 2016. Season 29 premiered in 2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the calico act passed in england what did it say?", "passages": [ [ "Calico Acts", "Calico Acts\n\nThe Calico Acts (1700, 1721) banned the import of most cotton textiles into England, followed by the restriction of sale of most cotton textiles.", "It was a form of economic protectionism, largely in response to India (particularly Bengal), which dominated world cotton textile markets at the time.", "The Acts were a precursor to the Industrial Revolution, when Britain eventually surpassed India as the world's leading textile manufacturer in the 19th century.", "The English East India Company introduced Britain to cheap calico and chintz cloth after the restoration of the monarchy in the 1660s.", "Initially imported as a novelty side line, from its spice trading posts in Asia, the cheap colourful cloth proved popular and overtook the EIC's spice trade by value in the late 17th century.", "The EIC embraced the demand, particularly for calico, by expanding its factories in Asia and producing and importing cloth in bulk, creating competition for domestic woollen and linen", "textile producers.", "The impacted weavers, spinners, dyers, shepherds and farmers objected, with parliament petitioned, the EIC offices stormed by a mob, the fashion conscious assaulted for wearing imported cloth, making the calico question one of the major issues of National politics between the 1680s and the 1730s.", "Parliament began to see a decline in domestic textile sales, and an increase in imported textiles from places like China and India." ], [ "Calico Acts", "Seeing the East India Company and their textile importation as a threat to domestic textile businesses, Parliament passed the 1700 Calico Act, blocking the importation of cotton cloth.", "As there was no punishment for continuing to sell cotton cloth, smuggling of the popular material became commonplace.", "So, dissatisfied with the outcome of the first act, in 1721 Parliament passed a stricter addition, this time, prohibiting the sale of most cottons, imported and domestic (exempting only thread Fustian and raw cotton).", "The exemption of raw cotton from the prohibition initially saw 2 thousand bales of raw cotton imported annually, to become the basis of a new indigenous industry, initially producing Fustian for the domestic market, though more importantly triggering the development of a series of mechanised spinning and weaving technologies, to process the material.", "This mechanised production was concentrated in new cotton mills, which slowly expanded till by the beginning of the 1770s seven thousand bales of cotton were imported annually, and pressure was put on Parliament, by the new mill owners, to remove the prohibition on the production and sale of pure cotton cloth, as they wished to compete with the EIC for the British cotton market.", "The acts were repealed in 1774, triggering a wave of investment in mill based cotton spinning and production, doubling the demand for raw cotton within a couple of years, and doubling it again every decade, till the 1840s." ] ], "gold": "When the English East India Company introduced Britain to cheap calico and chintz cloth, the Parliament noted how a decline in domestic textile sales, and an increase in imported textiles from places like China and India, could be seen. Identifying the East India Company and their textile importation as a threat to domestic textile businesses, Parliament passed the Calico Act in 1700, which banned the import of most cotton clothing. A stricter 2nd Calico Act was passed in 1721, prohibiting the sale of most cottons, imported and domestic. Nonetheless, both acts were finally repealed in 1774, triggering a wave of investment in mill based cotton spinning and production, doubling the demand for raw cotton within a couple of years, and doubling it again every decade, till the 1840s.", "prediction 1": "The Calico Acts were two separate acts passed by Parliament in 1700 and 1721. The first act banned the importation of cotton cloth from India into England. The second act, passed in 1721, prohibited the sale of most cottons, imported and domestic, exempting only thread Fustian and raw cotton. The acts were repealed in 1774, triggering a wave of investment in mill based cotton spinning and production, doubling the demand for raw cotton within a couple of years, and doubling it again every decade, till the 1840s.\n", "prediction 2": "The Calico Acts of 1700 and 1721 banned the import of most cotton textiles into England, followed by the restriction of sale of most cotton textiles, largely in response to India, which dominated world cotton textile markets at the time. The Acts were a precursor to the Industrial Revolution, when Britain eventually surpassed India as the world's leading textile manufacturer in the 19th century. Following the popular introduction of cheap calico and chintz cloth by the English East India Company, Parliament passed the first Calico Act in 1660s. The second, the British Parliament passed a stricter addition, prohibiting the sale of most cottons, imported and domestic (exempting only thread Fustian and raw cotton).", "prediction 3": "Seeing the East India Company and their textile importation as a threat to domestic textile businesses, Parliament passed the 1700 Calico Act, blocking the importation of cotton cloth. Dissatisfied with the outcome of the first act, in 1721 Parliament passed a stricter addition, this time, prohibiting the sale of most cottons, imported and domestic (exempting only thread Fustian and raw cotton). The acts were repealed in 1774, triggering a wave of investment in mill based cotton spinning and weaving technologies, to process the material.", "prediction 4": "The Calico Acts, first passed in 1700 by Parliament, banned the import of most cotton textiles into England and the restriction of sale of cotton textiles. The Acts were meant to create an economic protectionism in response to the tropical climate of India. The first act was repealed in 1721. The second act was passed in 1721.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 293 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The English East India Company introduced Britain to cheap calico and chintz cloth. Parliament began to see a decline in domestic textile sales, and an increase in imported textiles from places like China and India and saw the East India Company and their textile importation as a threat to domestic textile businesses. The Calico Acts were two separate acts passed by Parliament in 1700 and 1721. The first act banned the importation of cotton cloth from India into England. The second act, passed in 1721, prohibited the sale of most cottons, imported and domestic. The acts were repealed in 1774, triggering a wave of investment in mill based cotton spinning and production, doubling the demand for raw cotton within a couple of years, and doubling it again every decade, till the 1840s.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Where are the veins located in your body?", "passages": [], "gold": "There are a number of different veins in your body, each in a different location. In your body, superficial veins are located close to the skin, deep veins are located deeper in the body, and communicating veins are located in between superficial veins and deep veins. Also in your body are perforator veins, which are located in the lower limbs and feet, and pulmonary veins, which are located in the lungs and heart.", "prediction 1": "The veins of your body are located in your stomach, your thighs, and the groin.", "prediction 2": "The veins are located in your body in various places.", "prediction 3": "The veins of your body are located in the upper and lower extremities.", "prediction 4": "Your veins are located in the upper part of your body.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 79 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who wrote the song it never rains in southern california?", "passages": [ [ "It Never Rains in Southern California", "It Never Rains in Southern California\n\n\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter.", "Instrumental backing was provided by L.A. session musicians from the Wrecking Crew.", "The song appears on Hammond's album \"It Never Rains in Southern California\" and peaked at number five on the U.S. \"Billboard\" Hot 100 chart.", "In the UK, the song is perhaps the quintessential example of a turntable hit: a song that, although very frequently played and requested on radio, never makes it into the charts.", "Through the 1970s, the record was reissued at least five times by various labels but never charted, despite yet more airplay, and is still frequently heard on UK radio.", "The song concerns the struggles of an actor who moves to California to pursue a career in Hollywood but does not have any success and deteriorates in the process.", "In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya.", "It pours, man, it pours.\"", "In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation." ], [ "It Never Rains (In Southern California)", "It Never Rains (In Southern California)\n\n\"It Never Rains (In Southern California)\" is a 1990 song recorded by the American R&B group Tony!", "Toni! Ton\u00e9!.", "This song peaked at number one on the \"Billboard\" Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100.", "The music video to \"It Never Rains (In Southern California)\" was directed by actress Lisa Bonet." ], [ "Tony! Toni! Ton\u00e9!", "Tony!", "Toni!", "Ton\u00e9!", "Tony!", "Toni!", "Ton\u00e9! is an American soul/R&B group from Oakland, California, popular during the late 1980s and early to mid-1990s.", "During the band's heyday, it was composed of D'wayne Wiggins on lead vocals and guitar, his brother Raphael Saadiq (born Charles Ray Wiggins) on lead vocals and bass, and their cousin Timothy Christian Riley on drums and keyboards.", "Other members were Elijah Baker, Carl Wheeler, Randall Wiggins, and Amar Khalil, who is the current lead singer of the group, and Antron Haile.", "Originally, the band went by \"Tony, Toni, Ton\u00e9\" as a joke, until they realized it had a nice ring to it.", "After their debut album \"Who?\" in 1988 followed by \"The Revival\" in 1990, the group achieved their greatest commercial success with the double platinum certified \"Sons of Soul\" in 1993.", "Tony!", "Toni!", "Ton\u00e9! disbanded after the release of their fourth album \"House of Music\" (1996), which critics cite as their greatest work.", "Their first album, \"Who? \", produced and co-written by Denzil Foster and Thomas McElroy, was released in 1988.", "The album went gold and had several hit singles." ] ], "gold": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. \"It Never Rains In Southern California\" is also a 1990 song recorded by the American R&B group Tony! Toni! Ton\u00e9!, an American soul/R&B group from Oakland, California, composed of D'wayne Wiggins on lead vocals and guitar, his brother Raphael Saadiq on lead vocals and bass, and their cousin Timothy Christian Riley on drums and keyboards. This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100. It was written by Timothy Riley and Raphael Saadiq.", "prediction 1": "It Never Rains in Southern California is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. It never rains in southern california is a 1990 song recorded by the American soul/R&B group Tony! Toni! Ton\u00e9! This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100.", "prediction 2": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. \"It Never Rains in Southern California\" is also a 1990 song recorded by the American R&B group Tony! Toni! Ton\u00e9!, popular during the late 1980s and early to mid-1990s. This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100. \"It Never Rains in Southern California\" is also the 1991 song \"It Never Rains in Southern California\" is a song written by Albert Hammond and Mike Hazlewood and Mike Hazlewood.", "prediction 3": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. \"It Never Rains in Southern California\" is also the title of a 1990 song recorded by the American soul/R&B group Tony! Toni! Ton\u00e9! This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100. In the chorus, Hammond sings: \"It Never Rains in Southern California, but girl don't they warn ya. It pours, man, it pours, it pours, man, it pours, man, it pours.\"", "prediction 4": "It Never Rains in Southern California is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. In 1990, Tony! Toni! Ton\u00e9! recorded the song It Never Rains in Southern California, which peaked at number one on the Billboard Hot R&B Singles chart for two weeks, and thirty-four on the Hot 100.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "It Never Rains in Southern California is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. It never rains in southern california is a 1990 song recorded by the American soul/R&B group Tony! Toni! Ton\u00e9! an American soul/R&B group from Oakland, California. It was composed of D'wayne Wiggins on lead vocals and guitar, his brother Raphael Saadiq on lead vocals and bass, and their cousin Timothy Christian Riley on drums and keyboards. This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the first mccafe opened and where?", "passages": [ [ "McCaf\u00e9", "McCaf\u00e9\n\nMcCaf\u00e9 is a coffee-house-style food and beverage chain, owned by McDonald's.", "Conceptualised and launched in Melbourne, Australia in 1993 by McDonald's Licensee Ann Brown, and introduced to the public with help from McDonald's CEO Charlie Bell and then-Chairman and future CEO James Skinner, the chain reflects a consumer trend towards espresso coffees.", "Reports indicated that McCaf\u00e9 outlets generated 15% more revenue than a regular McDonald's and, by 2003, were the largest coffee shop brand in Australia and New Zealand.", "The McCaf\u00e9 concept was designed to help create atmosphere and foot-traffic at the entrance to the McDonalds stores at Swanston Street, Melbourne (a very large store with the front counter a considerable distance from the shop's entrance).", "The idea was developed between Charlie Bell and the local Regional Corporate team (David Bayes, Mike Tregurtha and Jim Vasiliadis).", "The first McCafe opened as a Corporate store in Melbourne, and not by a licensee as indicated above (Ann Brown was Brisbane based).", "The first one in the United States opened in Chicago, Illinois, in May 2001 when there were about 300 worldwide.", "In 2004 McCaf\u00e9 opened in Costa Rica and in France, and the next year, the concept was launched in Italy." ] ], "gold": "The first McCafe was opened in Melbourne, Australia in 1993. The McCaf\u00e9 concept was designed to help create atmosphere and foot-traffic at the entrance to the McDonald's stores at Swanston Street, Melbourne. The chain then spread to 13 countries by 2002. The first McCafe in the United States opened in Chicago, Illinois in May 2001.", "prediction 1": "The first McCafe opened in Melbourne in 1993 by McDonald's Licensee Ann Brown. In the United States, it was opened in Chicago, Illinois in May 2001. In Costa Rica, it opened in France in 2004 and the concept was launched in Italy in 2015.", "prediction 2": "The first McCafe was launched in 1993 by McDonald's Licensee Ann Brown in Melbourne, Australia. The concept was designed to help create atmosphere and foot-traffic at the entrance to the McDonald's stores at Swanston Street, Melbourne, a very large store with the front counter a considerable distance from the entrance. The first McCafe opened in Chicago, Illinois in May 2001 when there were about 300 worldwide. In 2004, McCaf\u00e9 opened in Costa Rica and in France, and the next year, the concept was launched in Italy.", "prediction 3": "The first McCaf\u00e9 opened as a Corporate store in Melbourne, as opposed to a licensee as indicated above. The first one in the United States opened in Chicago, Illinois, in May 2001 when there were about 300 worldwide.", "prediction 4": "The first McCaf\u00e9 opened as a Corporate store in Melbourne, and not by a licensee as indicated above (Ann Brown was Brisbane based). The first one in the United States opened in Chicago, Illinois, in May 2001 when there were about 300 worldwide. In 2004 McCaf\u00e9 opened in Costa Rica and in France, and the next year, the concept was launched in Italy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 238 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The first McCafe opened in Melbourne, Australia in 1993. The McCaf\u00e9 concept was designed to help create atmosphere and foot-traffic at the entrance to the McDonalds stores at Swanston Street, Melbourne In the United States, it was opened in Chicago, Illinois in May 2001." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When is the first mission to mars planned?", "passages": [ [ "Elon Musk", "Elon Musk\n\nElon Reeve Musk (; born June 28, 1971) is a technology entrepreneur, investor, and engineer.", "He holds South African, Canadian, and U.S. citizenship and is the founder, CEO, and lead designer of SpaceX; co-founder, CEO, and product architect of Tesla, Inc.; co-founder and CEO of Neuralink; and co-founder of PayPal.", "In December 2016, he was ranked 21st on the \"Forbes\" list of The World's Most Powerful People.", "he has a net worth of $22.8 billion and is listed by \"Forbes\" as the 54th-richest person in the world.", "Born and raised in Pretoria, South Africa, Musk moved to Canada when he was 17 to attend Queen's University.", "He transferred to the University of Pennsylvania two years later, where he received an economics degree from the Wharton School and a degree in physics from the College of Arts and Sciences.", "He began a Ph.D. in applied physics and material sciences at Stanford University in 1995 but dropped out after two days to pursue an entrepreneurial career.", "He subsequently co-founded Zip2, a web software company, which was acquired by Compaq for $340 million in 1999.", "Musk then founded X.com, an online bank." ], [ "Mars", "The European Space Agency will launch the ExoMars rover and surface platform in July 2020.", "The United Arab Emirates' \"Mars Hope\" orbiter is planned for launch in 2020, reaching Mars orbit in 2021.", "The probe will make a global study of the Martian atmosphere.", "Several plans for a human mission to Mars have been proposed throughout the 20th century and into the 21st century, but no active plan has an arrival date sooner than the 2020s.", "SpaceX founder Elon Musk presented a plan in September 2016 to, optimistically, launch space tourists to Mars in 2024 at an estimated development cost of .", "In October 2016, President Barack Obama renewed U.S. policy to pursue the goal of sending humans to Mars in the 2030s, and to continue using the International Space Station as a technology incubator in that pursuit.", "The NASA Authorization Act of 2017 directed NASA to get humans near or on the surface of Mars by the early 2030s.", "With the presence of various orbiters, landers, and rovers, it is possible to practice astronomy from Mars.", "Although Mars's moon Phobos appears about one-third the angular diameter of the full moon on Earth, Deimos appears more or less star-like, looking only slightly brighter than Venus does from Earth.", "Various phenomena seen from Earth have also been observed from Mars, such as meteors and auroras." ], [ "Human mission to Mars", "In September 2016 at the International Astronautical Congress, Elon Musk announced the ITS launch vehicle design (informally discussed earlier as the Mars Colonial Transporter), that comprised a large reusable booster topped by a spaceship or a tanker for in-orbit refueling, as well as a propellant plant to be built on Mars, at a base referred to as Mars Base Alpha.", "The aspirational objective is to advance the technology and infrastructure such that the first humans to Mars could potentially depart as early as 2024.", "On 29 September 2017, Elon Musk announced an updated vehicle design for the Mars mission at the International Astronautical Congress.", "The replacement vehicle for this mission is called BFR (Big Falcon Rocket).", "BFR will provide the on-orbit activity like satellite delivery, servicing the International Space Station, Moon mission, as well as Mars mission.", "There are two phases for the human mission to Mars via BFR:\n\nThe BFR is currently under construction, with sub-orbital flight testing expected in 2019.", "Mars Base Camp (MBC), an American spacecraft concept that proposes to send astronauts to Mars orbit as early as 2028.", "The vehicle concept, developed by Lockheed Martin, would utilize both future and heritage technology as well as the Orion MPCV built by NASA." ] ], "gold": "Many different organization have made their intentions to carry out a manned mission to Mars clear. In November 2015, NASA announced they planned to have a person on the planet by the year 2030. MBC and entrepreneur Elon Musk have both given earlier dates to their own estimations, with MBC announcing in 2016 that they planned a manned mission to land on Mars as early as 2028 and Elon Muck alluding to the year 2024 as a possible time on a 2017 announcement.", "prediction 1": "The first human mission to Mars is planned for 2024. The European Space Agency plans to launch the ExoMars rover and surface platform in July 2020. The United Arab Emirates plans to launch the Mars Hope orbiter in 2020, reaching Mars orbit in 2021.", "prediction 2": "The first human mission to Mars is planned for 2024. The European Space Agency will launch the ExoMars rover and surface platform in July 2020. The United Arab Emirates' Mars Hope orbiter is planned for launch in 2020, reaching Mars orbit in 2021.", "prediction 3": "The first humans to Mars is planned for 2024. The European Space Agency will launch the ExoMars rover and surface platform in July 2020. The United Arab Emirates' Mars Hope orbiter is planned for launch in 2020, reaching Mars orbit in 2021. The spacecraft will make a global study of the Martian atmosphere.", "prediction 4": "The first human mission to Mars is planned as a two-stage mission in 2024. SpaceX founder Elon Musk presented a plan in September 2016 to, optimistically, launch space tourists to Mars in 2024. The European Space Agency will launch the ExoMars rover and surface platform in July 2020. The United Arab Emirates' Mars Hope orbiter is planned for launch in 2020, reaching Mars orbit in 2021.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The NASA Authorization Act of 2017 directed NASA to get humans near or on the surface of Mars by the early 2030s. SpaceX founder Elon Musk presented a plan in September 2016 to, optimistically, launch space tourists to Mars in 2024. The first human mission to Mars is planned for 2024. The European Space Agency plans to launch the ExoMars rover and surface platform in July 2020. The United Arab Emirates plans to launch the Mars Hope orbiter in 2020, reaching Mars orbit in 2021." }, "preference": [ 0, 1, 0, 0, 0, 2 ] }, { "question": "When did tinkerbell and the neverbeast come out?", "passages": [ [ "Tinker Bell and the Legend of the NeverBeast", "For the next few days, Gruff helps around Pixie Hollow by moving large things.", "He begins to feel very tired, as it's time for him to go back into hibernation.", "The fairies sadly send him off to his cave in a gentle, respectful ceremony.", "They want to make his thousand-year sleep comfortable, so his cave has been given a pillow made of cotton and a mattress made of straw for him to sleep on, as well as a trickling pool of spring water that emits of a soft glow of light as a night light.", "The fairies give their good byes, and leave the content Gruff to sleep for another 937 years.", "His legend is retold by Fawn as the Guardian and Protector of Pixie Hollow.", "The film was released theatrically in selected markets including the United Kingdom on December 12, 2014.", "In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015.", "Overseas, the film grossed $31,178,525.", "On Rotten Tomatoes, the film has a rating of 74%, based on 19 reviews, with an average rating of 5.6/10." ], [ "Tinker Bell and the Legend of the NeverBeast", "Tinker Bell and the Legend of the NeverBeast\n\nTinker Bell and the Legend of the NeverBeast is a 2014 American computer-animated fantasy film directed by Steve Loter.", "The sixth and final installment in the Disneytoon Studios \"Tinker Bell\" film series, based on the character Tinker Bell from J. M. Barrie's \"Peter and Wendy\".", "It is the final feature film to be produced at Disneytoon Studios before its closure in 2018.", "Mae Whitman, Lucy Liu, Raven-Symon\u00e9, Megan Hilty, Pamela Adlon, and Anjelica Huston reprise their roles of Tinker Bell, Silvermist, Iridessa, Rosetta, Vidia and Queen Clarion.", "Ginnifer Goodwin joins the cast, replacing Angela Bartys as the voice of Fawn in this film, Rosario Dawson joins the cast as new character Nyx.", "Singer Mel B also joins the cast as new character Fury in the British release while Danai Gurira voices Fury in the American release.", "Fawn (voiced by Ginnifer Goodwin) rescues a baby hawk with a broken wing.", "Once it recovers, she, with the help of Tinkerbell (voiced by Mae Whitman), attempts to hide it from the other fairies, as grown hawks eat fairies and everyone is afraid of them." ] ], "gold": "Tinker Bell and the Legend of the NeverBeast, the sixth and final installment in Disneytoon's Tinker Bell film series, was released theatrically in selected markets, including the United Kingdom, on December 12, 2014. In the United States, the film had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement. Tinker Bell and the Legend of the NeverBeast was then released direct-to-video on March 3, 2015.", "prediction 1": "Tinker Bell and the Legend of the NeverBeast is a 2014 American computer-animated fantasy film directed by Steve Loter. The film was released theatrically in selected markets including the United Kingdom on December 12, 2014. In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015.", "prediction 2": "Tinker Bell and the Legend of the NeverBeast is a 2014 American computer-animated fantasy film directed by Steve Loter, based on the story Tinker Bell and the adventures of Fawn. It was released theatrically in selected markets including the United Kingdom on December 12, 2014. In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015.", "prediction 3": "The 2014 American computer-animated fantasy film Tinker Bell and the Legend of the NeverBeast is based on the children's book of the same name by J.M. Barrie. The film was released theatrically in selected markets including the United Kingdom on December 12, 2014. In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015.", "prediction 4": "Tinker Bell and the Legend of the NeverBeast is a 2014 American computer-animated fantasy film directed by Steve Loter. It is the final feature film to be produced at Disneytoon Studios before its closure in 2018. It was released theatrically in selected markets including the United Kingdom on December 12, 2014. In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 119 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Tinker Bell and the Legend of the NeverBeast, The sixth and final installment in the Disneytoon Studios \"Tinker Bell\". The film was released theatrically in selected markets including the United Kingdom on December 12, 2014. In the United States, it had a limited theatrical release, opening on January 30, 2015 at the El Capitan Theatre for a 13-day engagement, and was released direct-to-video on March 3, 2015." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did they do away with the draft?", "passages": [ [ "Unionism in England", "Unionism in England\n\nIn England, Unionism is a political ideology which favours the continuation of some form of political union between England and the other countries of the United Kingdom (Scotland, Wales and Northern Ireland).", "It is part of the wider British unionist movement and is closely linked to the notion of Britishness.", "Unionism in England is characterised by both opposition to England's independence as a separate state and the belief that Scotland, Wales and Northern Ireland should continue to be constituent countries of the Union.", "The political union between the Kingdoms of England (also including Wales as an English possession) and Scotland was created by the Acts of Union, passed in the parliaments of both kingdoms in 1707 and 1706 respectively, which united the governments of what had previously been independent states (though they had shared the same monarch in a personal union since 1603) under the Parliament of Great Britain.", "The Union was brought into existence under the Acts of Union on 1 May 1707.", "With the Act of Union 1800, the Kingdom of Ireland united with Great Britain into what then formed the United Kingdom of Great Britain and Ireland.", "The history of the Unions is reflected in various stages of the Union Flag, which forms the flag of the United Kingdom." ], [ "United States", "United States\n\nThe United States of America (USA), commonly known as the United States (U.S. or US) or America, is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions.", "At 3.8\u00a0million square miles (9.8\u00a0million km), the United States is the world's third- or fourth-largest country by total area and slightly smaller than the entire continent of Europe's 3.9\u00a0million square miles (10.1\u00a0million km).", "With a population of over 325 million people, the U.S. is the third most populous country.", "The capital is Washington, D.C., and the largest city by population is New York City.", "Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico.", "The State of Alaska is in the northwest corner of North America, bordered by Canada to the east and across the Bering Strait from Russia to the west.", "The State of Hawaii is an archipelago in the mid-Pacific Ocean.", "The U.S. territories are scattered about the Pacific Ocean and the Caribbean Sea, stretching across nine official time zones.", "The extremely diverse geography, climate, and wildlife of the United States make it one of the world's 17 megadiverse countries." ], [ "Conscription in the United States", "Conscription in the United States\n\nConscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts: the American Revolution, the American Civil War, World War I, World War II, and the Cold War (including both the Korean War and the Vietnam War).", "The third incarnation of the draft came into being in 1940 through the Selective Training and Service Act.", "It was the country's first peacetime draft.", "From 1940 until 1973, during both peacetime and periods of conflict, men were drafted to fill vacancies in the United States Armed Forces that could not be filled through voluntary means.", "The draft came to an end when the United States Armed Forces moved to an all-volunteer military force.", "However, the Selective Service System remains in place as a contingency plan; all male civilians between the ages of 18 and 25 are required to register so that a draft can be readily resumed if needed.", "United States Federal Law also provides for the compulsory conscription of men between the ages of 17 and 45 and certain women for militia service pursuant to Article I, Section 8 of the United States Constitution and 10 U.S. Code \u00a7 246.", "In colonial times, the Thirteen Colonies used a militia system for defense." ] ], "gold": "They did away with the draft, also called conscription, in several countries. They did away with the draft in England in 1960. They did away with it in the United States on January 27, 1973, the year the United States Armed Forces moved to an all-volunteer military.", "prediction 1": "The draft in the United States came to an end when the United States Armed Forces moved to an all-volunteer military force in 1973, after a long and costly process. The draft in the United Kingdom came to an end in 1660 under the Acts of Union, which united the governments of what had previously been independent states and the belief that Scotland, Wales and Northern Ireland should continue to be constituent countries of the Union. The United States did away with the draft in the United Kingdom in 1707, and the United Kingdom of Great Britain and Ireland in 1800, creating the United Kingdom of Great Britain and Ireland.", "prediction 2": "Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts: the American Revolution, the American Civil War, World War I, World War II, and the Cold War. The United States abolished the draft in 1973 through the United States Armed Forces' transition to an all-volunteer military force.", "prediction 3": "The draft was abolished in the United States on August 20, 1970, and again on August 7, 1973. In the United Kingdom and Ireland, the draft was abolished on October 3, 1972 and from January 1, 1974 to June 30, 1981. In the United States, the draft came to an end when the United States Armed Forces moved to an all-volunteer military force. The United Kingdom and Ireland's draft was abolished on October 13, 1973.", "prediction 4": "The draft, also known as the draft in the United States, was abolished in the United States in 1973, when the military moved to an all-volunteer force. Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts, including the American Revolution, the American Civil War, World War I, World War II, and the Cold War. Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in seven conflicts, including the Korean War and the Vietnam War. The draft came to an end when the United States Armed Forces moved to an all-volunteer military force.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 435 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 627 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The draft, or Conscription, in the United States came to an end when the United States Armed Forces moved to an all-volunteer military force in 1973. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who played roos mum in home and away?", "passages": [ [ "Belinda Giblin", "The Alison Carr character was revealed to be the post-plastic surgery incarnation of the show's original and much vaunted villain, 'Pat The Rat' \u2013 Patricia Hamilton, originally played by Rowena Wallace.", "Giblin was cast in the role because of her resemblance to Wallace.", "Giblin appeared in numerous roles by Crawford Productions over a 12 year period early in her career many filmed in black and white, television roles include appearances in \"Matlock Police\", \"Division Four\", \"Homicide\", \"The Sullivans\", \"Alvin Purple\" (1976), \"Bluey\" (1976), \"Heartbreak High\", \"Skyways\", as well as \"Home and Away\" (as Cynthia Ross in 1991) and Martha Stewart, the first wife of regular Alf Stewart in 2018.", "and \"Good Guys, Bad Guys\".", "Since 2013, she has also guest starred in The Horizon, a gay shortform web-series on YouTube, as Wilma (the drag queen's) mother.", "In 2016, she performed at the Sydney Opera House, 'Blonde Poison', a one-woman show about a Jewish woman who became a Nazi collaborator during World War II.", "In 2017, she appeared in 'Bent 101' as 'Babs DeVure' in an Australian short form comedy series that was on the Seven Network." ], [ "Home and Away", "Home and Away\n\nHome and Away (often abbreviated as H&A) is an Australian television soap opera.", "It was created by Alan Bateman and commenced broadcast on the Seven Network on 17 January 1988.", "Bateman came up with the concept of the show during a trip to Kangaroo Point, New South Wales, where he noticed locals were complaining about the construction of a foster home and against the idea of foster children from the city living in the area.", "The soap opera was initially going to be called \"Refuge\", but the name was changed to the \"friendlier\" title of \"Home and Away\" once production began.", "The show premiered with a ninety-minute pilot episode (subsequently in re-runs and on VHS known as \"Home and Away: The Movie\").", "Since then, each subsequent episode has aired for a duration of twenty-two minutes and \"Home and Away\" has become the second longest-running drama series in Australian television.", "In Australia, it is currently broadcast from Mondays to Thursdays at 7:00 pm.", "'", "Home and Away' follows the lives and loves of the residents in Summer Bay, a fictional seaside town of New South Wales." ], [ "Roo Stewart", "Roo was eventually diagnosed with meningitis.", "Her condition later took a turn for the worse and she suffered a seizure.", "In order to treat her, the doctors needed to know about her trip and her foster-daughter Maddy Osborne (Kassandra Clementi) found her passport, which revealed that she had been to Peru.", "With the information, the doctors were able to treat Roo and save her life.", "Roo begins to resent her father's relationship with Ailsa Hogan (Judy Nunn) out of loyalty to her late mother, Martha (Alison Mulvaney).", "Roo begins dating Frank Morgan (Alex Papps) and they start a band with Lance Smart (Peter Vroom) and Martin Dibble (Craig Thompson).", "Roo's continued obsession with Ailsa drives a rift between her and Frank, despite nearly sleeping with him as an act of rebellion over Ailsa staying over.", "Roo contacts her aunt, Morag Bellingham (Cornelia Frances), who is a judge and asks her to do a background check on Ailsa.", "At Alf and Ailsa's engagement party, Roo reveals Ailsa went to prison for killing her abusive father.", "However, Ailsa's friends and Frank, side with her." ] ], "gold": "Home and Away is an Australian television soap opera created by Alan Bateman and commenced broadcast on the Seven Network on January 17, 1988. Alison Mulvaney played the character of Roo's mum, Martha Stewart, on the soap in 1989. She made her first appearance on the show on January 25th of that year. The character was reintroduced on March 27, 2018, and the role was recast to Belinda Giblin.", "prediction 1": "Home and Away is an Australian television soap opera and was first broadcast on the Seven Network on January 17, 1988. The show follows the lives and loves of the residents of Summer Bay, a fictional seaside town of New South Wales. In the 1991 show, Roo Stewart, played by Belinda Giblin, has a late mother, Martha Stewart, played by Alison Mulvaney. In the 2018 show, Martha Stewart, played by Kassandra Clementi, Roo's foster-daughter Maddy, had a previous mother, who was played by the late Martha Stewart.", "prediction 2": "Home and Away is an Australian television soap opera that follows the lives and loves of the residents of Summer Bay, a fictional seaside town in New South Wales. In the 1991 episode of the show, Roo's mother Martha is played by Alison Mulvaney, who was originally played by Rowena Wallace.", "prediction 3": "Home and Away is an Australian television soap opera that aired between January 1988 and February 2015. Alison Mulvaney played Roo Stewart's mother in the 1991 edition of the show. It was cast in the role because of her resemblance to Wallace.", "prediction 4": "Home and Away is an Australian television soap opera. In the 1991 episode, Roo's mother is Martha Hogan, played by Alison Mulvaney. The role was given to actress Belinda Giblin because of her resemblance to Wallace.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 232 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 240, "end": 244 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 264, "end": 289 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 386, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 444 }, { "error type": "Unverifiable", "explanation": "", "start": 445, "end": 467 }, { "error type": "Unverifiable", "explanation": "", "start": 476, "end": 510 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 316, "end": 324 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Home and Away is an Australian television soap opera, created by Alan Bateman, and was first broadcast on the Seven Network on January 17, 1988. In the 1991 show, Roo Stewart has a late mother, Martha, played by Alison Mulvaney. In the 2018 show, Martha Stewart, is played by Belinda Giblin." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When does boy in the striped pajamas take place?", "passages": [ [ "The Boy in the Striped Pyjamas", "After a visit by Adolf Hitler, Bruno's father is promoted to Commandant, and the family has to move to \"Out-With\" because of the orders of \"The Fury\" (Bruno's na\u00efve interpretation of the word \"\"F\u00fchrer\"\").", "Bruno is initially upset about moving to Out-With (in actuality, Auschwitz) and leaving his friends, Daniel, Karl and Martin.", "From the house at Out-With, Bruno sees a camp in which the prisoners wear striped pyjamas.", "One day, Bruno decides to explore the strange wire fence.", "As he walks along the fence, he meets a Jewish boy named Shmuel, who he learns shares his birthday.", "Shmuel says that his father, grandfather, and brother are with him on this side of the fence, but he is separated from his mother.", "Bruno and Shmuel talk and become very good friends, although Bruno still does not understand very much about Shmuel and his side of the fence.", "Nearly every day, unless it's raining, Bruno goes to see Shmuel and sneaks him food.", "As the meetings go on, and Shmuel gets more and more skinny, Bruno's na\u00efvet\u00e9 is proved, as he never realizes he is living beside a concentration camp." ], [ "The Boy in the Striped Pyjamas (film)", "The Boy in the Striped Pyjamas (film)\n\n", "The Boy in the Striped Pyjamas (released as The Boy in the Striped Pajamas in the United States) is a 2008 British American historical drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name.", "Written and Directed by Mark Herman, produced by BBC Films and Heyday Films, and distributed by Miramax, the film stars Vera Farmiga, David Thewlis, Asa Butterfield, and Jack Scanlon.", "It was released on 12 September 2008 in the United Kingdom.", "The Holocaust drama relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys; Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate.", "The film opens with the quote \"Childhood is measured out by sounds and smells and sights, before the dark hour of reason grows\", by John Betjeman.", "A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II.", "He learns that his father Ralf has been promoted, due to which their family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" (occupied Poland)." ], [ "The Boy in the Striped Pyjamas", "The Boy in the Striped Pyjamas\n\nThe Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne.", "Unlike the months of planning Boyne devoted to his other books, he said that he wrote the entire first draft of\" The Boy in the Striped Pyjamas\" in two and a half days, barely sleeping until he got to the end.", "He did, however, commit to nearly 20 years of research, reading and researching about the Holocaust as a teenager before the idea for the novel even came to him.", "As of March 2010, the novel had sold more than five million copies around the world.", "In both 2007 and 2008, it was the best selling book of the year in Spain, and it has also reached number one on the \"New York Times\" bestseller list, as well as in the UK, Ireland, and Australia.", "The book was adapted in 2008 as a film of the same name.", "Bruno is a 9-year-old boy growing up during World War II in Berlin.", "He lives with his parents, his 12-year-old sister Gretel and maids, one of whom is called Maria." ] ], "gold": "The Boy in the Striped Pyjamas is a 2008 tragedy film based on the 2006 Holocaust novel of the same name by John Boyne. It takes in World War II, between 1939 and 1945, and relates the horror of a Nazi extermination camp through the eyes of two 8-year-old boys: Bruno, the son of the camp's Nazi commander, and Shmuel, a Jewish prisoner.", "prediction 1": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The story takes place in Berlin, Germany during World War II. The 2008 British American historical drama film based on the book takes place in Auschwitz, where prisoners wear striped pyjamas. The Boy in the Striped Pyjamas: A Memoir of the Holocaust is set in Auschwitz.", "prediction 2": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The novel takes place in Berlin, in Nazi Germany during World War II. The Boy in the Striped Pyjamas is adapted in 2008 into a film. The 2008 film was written and directed by Mark Herman, produced by BBC Films and Heyday Films, and distributed by Miramax.", "prediction 3": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The book takes place in 1940's Germany, during World War II, when Bruno's parents, Elsa and Gretel, are forced to relocate to Auschwitz. The 2008 British American historical drama film, based on Boyne's 2006 novel, is set in World War II and relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-olds; Bruno, the son of the camp's Nazi commandant, and Shmuel, a Jewish inmate.", "prediction 4": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. It takes place during World War II and the film is set in the same time period. The Boy in the Striped Pyjamas is actually a 2008 British American historical drama film set in World War II, based on Boyne\u2019s 2006 novel. The film stars Asa Butterfield as Bruno, the son of the camp's Nazi commandant, and Shmuel, the son of the camp's Jewish inmate.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 278 }, { "error type": "Redundant", "explanation": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The story takes place in Berlin, Germany during World War II. The 2008 British American historical drama film based on the book takes place in Auschwitz, ", "start": 279, "end": 357 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The story takes place in Berlin, Germany during World War II. The 2008 British American historical drama film based on the book takes place in Auschwitz. The Holocaust drama relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys; Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the new maze runner 3 come out?", "passages": [ [ "The Death Cure", "The film began principal photography on 14\u00a0March 2016 in Cache Creek, British Columbia.", "On 19\u00a0March 2016, \"Maze Runner\" star Dylan O'Brien was critically injured on-set when he was struck by a car during a stunt sequence.", "On 20\u00a0March 2016, director Wes Ball announced production was shut down to allow O'Brien time to recuperate from his injuries.", "On 22\u00a0April 2017, the studio again delayed the release in order to allow more time for post-production.", "\"Maze Runner:", "The Death Cure\" was released on January 26, 2018." ], [ "The Death Cure", "The Death Cure\n\nThe Death Cure is a 2011 young adult dystopian science fiction novel written by American writer James Dashner and the third book published in the \"Maze Runner\" series (the fifth and last in narrative order).", "It was published on 11\u00a0October 2011 by Delacorte Press and was preceded in publication order by \"The Maze Runner\" and \"The Scorch Trials\" and followed by the series prequels, \"The Kill Order and The Fever Code\".", "In narrative order, it is the last book in the series.", "Thomas is held in solitary confinement but is eventually released by WICKED's Assistant Director Janson (\"Rat Man\" in the prior novel).", "Janson tells the Gladers (Group A) and Group B that there is a cure for the Flare.", "Many of those present are immune to the Flare while some are not, and escaping would serve no purpose, as people in the outside world despise the Immunes.", "Janson reads out names of people who are not immune to the Flare.", "Thomas is devastated to hear that his friend Newt is not immune.", "The Gladers are offered the chance to remove the mind-control chips in their heads, thus restoring their memories, but with the devices removed, Thomas, Teresa, and Aris will no longer be able to communicate telepathically." ], [ "Maze Runner: The Death Cure", "Maze Runner:", "The Death Cure\n\nMaze Runner:", "The Death Cure (also known simply as The Death Cure) is a 2018 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the novel \"The Death Cure\" written by James Dashner.", "It is the sequel to the 2015 film \"\" and the third and final installment in the \"Maze Runner\" film series.", "The film stars Dylan O'Brien, Kaya Scodelario, Thomas Brodie-Sangster, Dexter Darden, Nathalie Emmanuel, Giancarlo Esposito, Aidan Gillen, Walton Goggins, Ki Hong Lee, Jacob Lofland, Katherine McNamara, Barry Pepper, Will Poulter, Rosa Salazar, and Patricia Clarkson.", "\"Maze Runner:", "The Death Cure\" was originally set to be released on February 17, 2017, in the United States by 20th Century Fox, but the studio rescheduled the film's release for January 26, 2018, in theatres and IMAX, allowing time for O'Brien to recover from injuries he sustained during filming.", "The film received mixed reviews from critics and grossed over $288\u00a0million worldwide.", "Thomas, Newt, and Frypan are the last of the free \"Gladers\" immune to the Flare virus that has ravaged the world's population." ] ], "gold": "The third book published in the Maze Runner series, The Death Cure, was published on October 11, 2011 by Delacorte Press. The film adaptation of the book, Maze Runner: The Death Cure, was released on January 26, 2018 in the United States. A week prior to its North American release, the film debuted in South Korea, Australia and Taiwan. The film was released in Seoul, South Korea on January 11, 2018. Maze Runner: The Death Cure was then released on Blu-Ray and DVD on April 24, 2018.", "prediction 1": "Maze Runner 3 is a 2017 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the 2011 young adult dystopian science fiction novel The Death Cure written by American writer James Dashner and the third book published in the Maze Runner series. The sequel to the 2015 film, Maze Runner 3 came out on November 16, 2015 in the United States. The new Maze Runner 3 is set to be released on December 13, 2015, in the United States on January 26, 2018.", "prediction 2": "Maze Runner: The Death Cure is a 2018 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the 2011 young adult dystopian science fiction novel of the same name written by American writer James Dashner. The sequel to the 2015 film, Maze Runner 3: The Final Chapter, was originally set to be released on February 17, 2017, in the United States by 20th Century Fox, but the studio rescheduled the film's release for January 26, 2018, in theatres and IMAX, allowing time for O'Brien to recover from injuries he sustained during filming.", "prediction 3": "Maze Runner 3 was originally set to be released on February 17, 2017, in the United States by 20th Century Fox, but the studio rescheduled the film's release for January 26, 2018 in theatres and IMAX, allowing time for O'Brien to recover from injuries he sustained during filming. The new Maze Runner film began principal photography on 14 March 2016. Maze Runner: The Death Cure is a 2018 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the 2011 young adult dystopian novel The Death Cure written by American writer James Dashner. It is the third book published in the \"Maze Runner\" series and the fifth and last in narrative order it is the last book in the series.", "prediction 4": "Maze Runner 3, the third and final movie in the Maze Runner series, has been released multiple times. The third and final film in the Maze Runner series, Maze Runner: The Death Cure, came out on January 26, 2018. Maze Runner 3: The Final Stand was released on June 17, 2018, in the United States by 20th Century Fox.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 436, "end": 454 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 0, "end": 70 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 337, "end": 388 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": " The Death Cure (also known simply as The Death Cure) is a 2018 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the novel \"The Death Cure\" written by James Dashner. It is the sequel to the 2015 film and the third and final installment in the \"Maze Runner\" film series. The new Maze Runner 3 is set to be released in the United States on January 26, 2018." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does how to get away with a murderer air season 4?", "passages": [ [ "How to Get Away with Murder (season 4)", "How to Get Away with Murder (season 4)\n\n", "The fourth season of the ABC American television drama series \"How to Get Away with Murder\" was ordered on February 10, 2017, by ABC.", "It began airing on September 28, 2017, with 15 episodes like the previous seasons and concluded on March 15, 2018.", "This was made in a deal with Viola Davis that the series would be a limited series with only 15 or 16 episodes per season.", "Annalise (Viola Davis) and the Keating Four are still dealing with the aftermath of Wes's (Alfred Enoch) death.", "Annalise works with a therapist, Dr. Issac Roa, to see through her recovery from alcoholism, and cuts ties with her associates.", "In the mean time, Connor (Jack Falahee) declines Oliver's (Conrad Ricamora) proposal, Laurel (Karla Souza) expects Wes's baby, Michaela (Aja Naomi King) and Asher (Matt McGorry) team up for internships, and Bonnie (Liza Weil) seeks her professional future.", "Meanwhile, Laurel has deduced that her father, Jorge Castillo (Esai Morales), is responsible for Wes's murder and hatches a scheme to steal incriminating evidence with Michaela, Oliver, and a reluctant Frank and Asher." ] ], "gold": "The fourth season of the ABC American television drama series How to Get Away with Murder was ordered on February 10, 2017, by ABC. It began airing on September 28, 2017, with 15 episodes like the previous seasons. It aired from September 28, 2017 - March 15, 2018.", "prediction 1": "How to Get Away with Murder's fourth season premiered on September 28, 2017, and concluded on March 15, 2018.\n", "prediction 2": "How to Get Away with Murder, an ABC American crime drama series, began airing its fourth season on September 28, 2017, and concluded on March 15, 2018.", "prediction 3": "The fourth season of the ABC American television drama series How to Get Away with Murder was ordered on February 10, 2017, by ABC. It began airing on September 28, 2017, with 15 episodes like the previous seasons and concluded on March 15, 2018.", "prediction 4": "How to Get Away with Murder aired its fourth season on ABC on September 28, 2017, and ended March 15, 2018.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "How to Get Away with Murder's fourth season was ordered on February 10, 2017, by ABC and premiered on September 28, 2017, and concluded on March 15, 2018.\n" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who sang the titanic song my heart will go on?", "passages": [ [ "Sissel Kyrkjeb\u00f8", "The soundtrack, called \"\", became immensely popular, reaching No. 1 on the Billboard charts and selling more than 30 million copies worldwide.", "James Horner, the composer of the film's music, knew Sissel from her album \"Innerst i sjelen\" and he particularly liked how she sang \"\" (I Know in Heaven There Is a Castle).", "Horner had tried 25 or 30 singers before deciding on Sissel.", "She then recorded a vocal version of the main theme song \"My Heart Will Go On\" of the film, but Celine Dion's vocals was preferred due to James Horner's decision to support Dion's career.", "In an interview from December 2014, Horner quotes: \"When I had completed the Titanic [movie], I had to decide for Celine Dion or Sissel['s] [vocals].", "Sissel I am very close, while Celine I had known since she was 18, and I had already written three film songs for [her].", "But that was before Celine was known and filmmakers and marketing people had not done what they should have done for Celine and [her] songs.", "So I felt I owed her a Titanic chance, but I could [still] have used Sissel there.\"" ] ], "gold": "Sissel Kyrkjebo was scheduled to record the song for the film in 1997, but Celine Dion's vocals were preferred due to James Horner's decision to support Dion's career. Years later, Horner chose Kyrkjebo to perform \"My Heart Will Go On\" on the world premieres of \"Titanic 3D\", released in 2012, and \"Titanic Live\" from 2015.", "prediction 1": "James Horner, the composer of the film's music, knew Sissel from her album \"Innerst i sjelen\" and he particularly liked how she sang \"\" (I Know in Heaven There Is a Castle). Sissel then recorded a vocal version of the main theme song \"My Heart Will Go On\" of the film, but Celine Dion's vocals was preferred due to James Horner's decision to support Dion's career.\n", "prediction 2": "The Titanic theme song My Heart Will Go On was sung by various singers. James Horner, the composer of the film's music, knew Sissel Kyrkjeb from her album \"Innerst i sjelen\". Prodottir Gabriel Larsson sang the song. A year later, Sissel Kyrkjeb sang a quieter version of the track for the Sunset Over Manhattan movie My Heart Will Go On.", "prediction 3": "James Horner, the composer of the film's music, knew Sissel Kyrkjeb from her album \"Innerst i sjelen\" and he particularly liked how she sang \"Dellhj! \". She then recorded a vocal version of the main theme song \"My Heart Will Go On\" of the film but Celine Dion's vocals was preferred due to James Horner's decision to support Dion's career.", "prediction 4": "There were several singers who sang the song My Heart Will Go On for Titanic. The one singer who sang for Titanic was Celine Dion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 173 } ], "missing-info": [], "corrected-prediction": "Sissel Kyrkjeb\u00f8 recorded a vocal version of the films main theme song \"My Heart Will Go On\", composed by James Horner, but Celine Dion's vocals was preferred due to James Horner's decision to support Dion's career.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who sang total eclipse of the heart in old school?", "passages": [ [ "The Dan Band", "The Dan Band\n\nThe Dan Band is a comedy band created by actor/comedian Dan Finnerty.", "The band is known for its covers of originally female-performed pop songs, with added obscenities and swearing, made famous by Finnerty's appearance in the films \"Old School\" and \"The Hangover\"\n\nFinnerty has appeared in the hit movies \"Old School\" (singing \"Total Eclipse of the Heart\" and \"Lady\"), \"The Terminal\", \"Starsky & Hutch\", where he performed Roberta Flack's \"Feel Like Makin' Love\" at a bat mitzvah, and \"The Hangover\" (performing \"Candy Shop\" and \"Fame\") in a wedding scene reminiscent of his appearance in \"Old School\".", "In 2005, they released \"The Dan Band Live\", their live full-length debut album.", "They gained attention due to their expletive-heavy version of Bonnie Tyler's \"Total Eclipse of the Heart,\" as well as their cover versions of \"Lady\" by Styx, \"Milkshake\" by Kelis, Toni Basil's \"Mickey,\" and many others.", "They filmed a one-hour concert special of their live show called \"Dan Finnerty & The Dan Band: I Am Woman\", for the Bravo network, which was directed by McG and executive produced by Steven Spielberg." ], [ "Dan Finnerty", "Dan Finnerty\n\nDan Finnerty (born January 22, 1970) is an American actor and singer.", "Finnerty was born in Rochester, New York, and grew up in the small town of Bath, New York.", "He attended Emerson College in Boston.", "He was a member of the hit off-Broadway show \"Stomp\" in New York City.", "In August 1998, he married actress Kathy Najimy.", "Gloria Steinem officiated the ceremony.", "The couple has one daughter, Samia Najimy Finnerty, born December 1996.", "He created and is the lead singer of the cult hit group The Dan Band.", "His show, \"\", was filmed as a one-hour concert special on Cable TV's Bravo channel, directed by McG and executive produced by Steven Spielberg.", "Finnerty is best known for his foul-mouthed rendition of \"Total Eclipse of the Heart\" as the wedding singer at Will Ferrell's wedding in the movie \"Old School\", directed by Todd Phillips, who continued to feature Dan, using him as the sleazy bat-mitzvah singer in \"Starsky & Hutch\" and again as the irreverent wedding singer in \"The Hangover\".", "After seeing The Dan Band, Steven Spielberg cast him in \"The Terminal\"." ] ], "gold": "Dan Finnerty of The Dan Band sang the lead vocals for Total Eclipse of the Heart in the movie Old School.", "prediction 1": "The Dan Band is a comedy band created by actor/comedian Dan Finnerty, who is best known for his foul-mouthed rendition of Total Eclipse of the Heart as the wedding singer at Will Ferrell's wedding in the movie Old School.", "prediction 2": "The number \"Total Eclipse of the Heart\" was recorded by Bonnie Tyler in 1983. It was also recorded by Bonnie Tyler's band The Dan Band in 1985. The Dan Band is an American comedy band created by actor and comedian Dan Finnerty. The band is known for its covers of originally female-performed pop songs, with added obscenities and swearing, made famous by Finnerty's appearance in the hit movies Old School and The Hangover. Dan Finnerty sang the number \"Total Eclipse of the Heart\" as the wedding singer at Will Ferrell's wedding in the movie Old School.", "prediction 3": "\"Total Eclipse of the Heart\" is a song by American pop singer Bonnie Tyler. American actor and comedian Dan Finnerty sang the song as the wedding singer at Will Ferrell's wedding in the movie Old School. Other people who sang it in Old School included Bonnie Tyler, Roberta Flack, Roberta Flack, Toni Basil, and others.", "prediction 4": "The song Total Eclipse of the Heart was performed by Bonnie Tyler and was written and performed by Bonnie Tyler, who also wrote and performed the lyrics. The Dan Band is a comedy band created by American actor/comedian Dan Finnerty, best known for his foul-mouthed rendition of Total Eclipse of the Heart as the wedding singer at Will Ferrell's wedding in the movie Old School.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 55 }, { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 196 } ], "missing-info": [], "corrected-prediction": "Dan Finnerty, from The Dan Band, was the singer of Total Eclipse of the Heart in the move Old School." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "How many platform in hazrat nizamuddin railway station?", "passages": [ [ "Hazrat Nizamuddin railway station", "Hazrat Nizamuddin railway station\n\nHazrat Nizamuddin railway station (station code NZM) is a railway station located in South Delhi, India.", "It is under the administrative control of the Delhi Division of the Northern Railway zone of the Indian Railways.", "It is one of the five main stations in Delhi and is the originating and terminal station for 60 trains.", "The station was named after the Sufi Saint Nizamuddin Auliya.", "Hazrat Nizamuddin railway station is managed by Northern Railway zone of Indian Railways.", "It is adjacent to Delhi's two important arteries, the Ring Road and Mathura Road, and Sarai Kale Khan Inter-State Bus Terminus (ISBT).", "Hazrat Nizamuddin railway station connects all the major cities and was developed to ease congestion on New Delhi railway station which is located approximately to the North.", "It originates and terminates various Rajdhani Expresses going towards Indian cities such as Bengaluru, Chennai, Madgaon, Mumbai, Secunderabad and Thiruvananthapuram.", "Indian Railways intends to save \u20b941,000 crore in energy consumption and generate 1000 MW of energy from solar power.", "Out of 1000 MW to be produced under solar power; 500 MW will be produced from rooftop solar." ], [ "Secunderabad Junction railway station", "To reduce the railway traffic at Secunderabad railway station the Railway Board had decided on a fourth main station for Hyderabad to regulate the increasing passenger traffic at Secunderabad.", "There are two proposals for the new terminal, Malkajgiri Railway Station and Moulali Railway Station.", "Secunderabad Station has the standard station layout with a perfect traction inside the station.", "All the tracks in the station are broad gauged and electrified.", "The Manmad-Secunderabad line that passes through is non-electrified, so diesel trains are common.", "The station has 10 platforms which are covered by an R.C.C (Reinforced Cement Concrete) roof.", "Each platform can handle a train with more than 24 coaches.", "All the tracks are broad gauged and there is an additional track between platform no's. 7 & 8 i.e. 6A,6B,7A,7B which is a service track for the MMTS and suburban trains where two trains halt at the same platform (due to their short length).", "Platform Nos. 6 & 7 are each divided into two as 6A, 6B and 7A, 7B." ], [ "Vadodara Junction railway station", "Platform 6 is the longest with 704m length.", "A Pay & Use Tiolet facility is available at Platform 6.", "Platform 1 has waiting room and retiring rooms as well as a refreshment canteen.", "Several ATM are located just outside platform 1.", "Platform 7 is ahead of platform 1 and acts as a terminus for some passenger and MEMU trains and facilitates reversing of some trains including the 9309/9310 Shanti Express and the Gujarat Sampark Kranti Express, which use the Vadodara Delhi line as well as the Vadodara Ahmedabad line.", "The station serves three lines: the direct line between Ahmedabad and Mumbai; Vadodara and Chhota Udepur and the Delhi line via Ratlam, Kota and Mathura.", "Trains going towards the northern region use the Ratlam line while all other trains use the Ahmedabad-Mumbai line, such as the Ahmedabad Shatabdi Express, Delhi Sarai Rohilla Bandra Terminus Garib Rath Express, Gujarat Mail, Karnavati Express, Suryanagri Express and Ranakpur Express.", "The prestigious Mumbai Rajdhani Express, August Kranti Rajdhani Express, Thiruvananthapuram Rajdhani Express, Golden Temple Mail and Avantika Express amongst others also halt at this station." ] ], "gold": "Hazrat Nizamuddin railway station is one of the five main stations in Delhi and handles nearly 250 trains daily with its 8 completed platforms, and 1 under construction.", "prediction 1": "Hazrat Nizamuddin railway station in South Delhi, India, has 10 platforms covered by an R.C.C (Reinforced Cement Concrete) roof, each of which can handle a train with more than 24 coaches. There is an additional track between platform numbers 7 and 8 i.e. 6A,6B,7A,7B which is a service track for the MMTS and suburban trains where two trains halt at the same platform (due to their short length). Platform Numbers 6 & 7 are each divided into two as 6A, 6B,7A, 7 are each divided into two as 6A, 7A, 7A, 7A, 7A, 7A, 7A, 7 are each divided into two as 6A, 7A, 7A, 7A, 7A, 7A, 7A, 7A, 7B.", "prediction 2": "Hazrat Nizamuddin railway station is one of the five main stations in Delhi, India, and is the originating and terminal station for 60 trains. The station connects all the major cities and was developed to ease the congestion on New Delhi railway station which is located approximately to the North. The station has 10 platforms which are covered by an R.C.C (Reinforced Cement Concrete) roof. Each platform can handle a train with more than 24 coaches.", "prediction 3": "Hazrat Nizamuddin railway station is one of the five main stations in Delhi and is the originating and terminal station for 60 trains. It is named after the Sufi Saint Nizamuddin Auliya. The station has 10 platforms which are covered by an R.C.C (Reinforced Cement Concrete) roof. Each platform can handle a train with more than 24 coaches.", "prediction 4": "Hazrat Nizamuddin railway station, which connects all the major cities, has 10 platforms that are covered by an R.C.C (Reinforced Cement Concrete) roof. Each platform can handle a train with more than 24 coaches. There is an additional track between platforms 7 & 8 i.e. 6A,6B,7A,7B which is a service track for the MMTS and suburban trains where two trains halt at the same platform (due to their short length). Platforms 6 & 7 are each divided into two as 6A, 6B and 7A, 7 are each divided into two as 6A, 7A, 7A, 7A, 7A, 7A, 7A, 7A, 7A, 7A, 7 are each divided into two as 6A, 7B.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 57, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 397 }, { "error type": "Irrelevant", "explanation": "", "start": 398, "end": 521 }, { "error type": "Redundant", "explanation": "Hazrat Nizamuddin railway station in South Delhi, India, has 10 platforms covered by an R.C.C (Reinforced Cement Concrete) roof, each of which can handle a train with more than 24 coaches. There is an additional track between platform numbers 7 and 8 i.e. 6A,6B,7A,7B which is a service track for the MMTS and suburban trains where two trains halt at the same platform (due to their short length). Platform Numbers 6 & 7 are each divided into two as 6A, 6B,7A, 7 are each divided into two as 6A, 7A, 7A, 7A, 7A, 7A, 7A, 7 ", "start": 522, "end": 586 } ], "missing-info": [], "corrected-prediction": "Hazrat Nizamuddin railway station in South Delhi, India, is one of the five main stations in Delhi and is the originating and terminal station for 60 trains." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "Who won the ranji trophy 2018 cricket tournament?", "passages": [ [ "Vidarbha cricket team", "Vidarbha cricket team\n\nThe Vidarbha cricket team is a domestic cricket team in the Ranji Trophy, India's domestic first-class cricket competition.", "It represents the Vidarbha region of eastern Maharashtra.", "In December 2017, they reached the final of the Ranji Trophy for the first time in their history, after they beat Karnataka by 5 runs in the semi-finals of the 2017\u201318 Ranji Trophy tournament.", "In the final, they beat Delhi by 9 wickets to win their first Ranji Trophy.", "Vidarbha first played first-class cricket in the 1957\u201358 season, competing against the other Central Zone teams until 2001-02, after which the Ranji Trophy was no longer contested on a zonal basis.", "Before the 2017-18 season, Vidarbha's best seasons were 1970-71 and 1995\u201396, when it reached the quarter-finals of the Ranji Trophy and 2002\u201303 and 2011\u201312, when it reached the semi-finals of the Plate Group.", "Up to the start of the 2017-18 season, Vidarbha had played 259 first-class matches, with 41 wins, 89 losses and 129 draws.", "Vidarbha's main home ground was always the Vidarbha Cricket Association Ground in Nagpur until 2009, when it was superseded by the newly developed Vidarbha Cricket Association Stadium at Jamtha in Nagpur." ] ], "gold": "In the 2017-2018 Ranji Trophy tournament, Vidarbha beat Delhi by 9 wickets to win their first Ranji Trophy. In the 2018-2019 Ranji Trophy tournament, Vidarbha successfully defended their crown and won the tournament after they defeated Saurashtra by 78 runs in the final.", "prediction 1": "The Ranji Trophy is India's domestic first-class cricket competition. In the 2018 cricket tournament, Delhi won the tournament and Vidarbha won the trophy.", "prediction 2": "The Ranji Trophy is India's domestic first-class cricket competition. In 2018, the Vidarbha cricket team won the Ranji Trophy, India's domestic first-class cricket competition.", "prediction 3": "The Ranji Trophy is India's domestic first-class cricket competition. In the 2018 cricket tournament, Harbhajan Singh and Amit Shah won the tournament, respectively. In the 2017\u201318 Ranji Trophy tournament, Vidarbha won the tournament by defeating Delhi by 9 wickets.", "prediction 4": "The Ranji Trophy is India's national first-class cricket competition. The Vidarbha cricket team represents the Vidarbha region of eastern Maharashtra and has represented the state since 1957\u201358. In the 2018 Ranji Trophy tournament, the Delhi Capitals beat the Vidarbha Cricket Association by 9 wickets, and the Mumbai Indians defeated the Mumbai Indians by 7 wickets.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 77, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 69 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 102, "end": 126 } ], "missing-info": [], "corrected-prediction": "In the 2017-2018 Ranji Trophy tournament, Vidarbha beat Delhi by 9 wickets to win their first Ranji Trophy." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who wrote the book of hebrew in bible?", "passages": [ [ "Epistle to the Hebrews", "Epistle to the Hebrews\n\nThe Epistle to the Hebrews, or Letter to the Hebrews, or in the Greek manuscripts, simply To the Hebrews ( \u03a0\u03c1\u1f78\u03c2 \u1f19\u03b2\u03c1\u03b1\u03af\u03bf\u03c5\u03c2) is one of the books of the New Testament.", "The text is traditionally attributed to Paul the Apostle, but doubt on Pauline authorship is reported by Eusebius, and modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul.", "Although the writer's style reflects some characteristics of Paul's writing, there are some differences.", "Scholars of Greek consider its writing to be more polished and eloquent than any other book of the New Testament.", "The book has earned the reputation of being a masterpiece.", "It has also been described as an intricate New Testament book.", "Scholars believe it was written for Jewish Christians who lived in Jerusalem.", "Its purpose was to exhort Christians to persevere in the face of persecution.", "At this time, certain believers were considering turning back to Judaism (the Jewish system of law) to escape being persecuted for accepting Christ as their saviour, now following this system of grace (saved by Jesus' sacrifice on the cross).", "The theme of the epistle is the doctrine of the person of Christ and his role as mediator between God and humanity." ], [ "Authorship of the Pauline epistles", "The Epistle to the Hebrews is actually anonymous, but it has been traditionally attributed to Paul.", "The church father Origen of Alexandria rejected the Pauline authorship of Hebrews, instead asserting that, although the ideas expressed in the letter were genuinely Pauline, the letter itself had actually been written by someone else.", "Most modern scholars generally agree that Hebrews was not written by the apostle Paul.", "Various other possible authorships have been suggested.", "Scholars use a number of methods of historiography and higher criticism to determine whether a text is properly attributed to its author.", "The primary methods used for Paul's letters are the following:\n\nThis consists of what the author tells us about himself in the letter, either explicitly the author clearly identifies himself or implicitly provides autobiographical details.", "This evidence is important in spite of its problems.", "For example, because the author of the Epistle to the Hebrews never identified him or herself, scholars as early as Origen of Alexandria in the 3rd century suspected that Paul was not the author.", "This consists of references, again either explicit or implicit, to the text, especially during earliest times by those who had access to reliable sources now lost.", "Explicit references would be mentioning the text or letter by name, or a recognizable form of that text." ] ], "gold": "The Epistle to the Hebrews, or Letter to the Hebrews, or in the Greek manuscripts, simply To the Hebrews is one of the books of the New Testament. The text does not mention the name of its author, but was traditionally attributed to Paul the Apostle. Modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul. ", "prediction 1": "The book of Hebrews in the Bible is attributed to Paul the Apostle, but it's authorship has been denied by many. Eusebius reports doubt on Pauline authorship, and modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul.", "prediction 2": "The Epistle to the Hebrews is one of the books of the New Testament. The text is traditionally attributed to Paul the Apostle, but doubt on Pauline authorship is reported by Eusebius, and modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul. The purpose of the Epistle was to exhort Christians to persevere in the face of persecution. The church father Origen of Alexandria rejected the Pauline authorship of Hebrews, instead asserting that, although the ideas expressed in the letter itself had actually been written by someone else. Most modern scholars generally agree that Hebrews was not written by the apostle Paul.", "prediction 3": "The Epistle to the Hebrews, or Letter to the Hebrews, or in the Greek manuscripts, simply To the Hebrews, is one of the books of the New Testament. The Epistle to the Hebrews is traditionally attributed to Paul the Apostle, but doubt on Pauline authorship is reported by Eusebius, and modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul.", "prediction 4": "The Epistle to the Hebrews, or Letter to the Hebrews, or in the Greek manuscripts, simply To the Hebrews, is one of the books of the New Testament. The book is traditionally attributed to Paul the Apostle, but doubt on Pauline authorship is reported by Eusebius, and modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul. Although the writer's style reflects some characteristics of Paul's writing, there are some differences.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 112 }, { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 158 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Epistle to the Hebrews, or Letter to the Hebrews, or in the Greek manuscripts, simply To the Hebrews is one of the books of the New Testament and has been attributed to Paul the Apostle. However, modern biblical scholarship considers its authorship unknown, perhaps written in deliberate imitation of the style of Paul." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who hit 4 homeruns in one game last week?", "passages": [ [ "Scooter Gennett", "Scooter Gennett\n\nRyan Joseph \"Scooter\" Gennett (born May 1, 1990) is an American professional baseball second baseman for the Cincinnati Reds of Major League Baseball (MLB).", "He previously played for the Milwaukee Brewers.", "On June 6, 2017, he became the 17th player in major league history to hit four home runs in a single game.", "Gennett was drafted by the Milwaukee Brewers in the 16th round of the 2009 Major League Baseball Draft out of Sarasota High School in Sarasota, Florida.", "Gennett represented the Brewers at the 2012 All-Star Futures Game.", "Less than a year later, on June 3, 2013, he was recalled from the Nashville Sounds, and made his major league debut against the Oakland Athletics.", "Gennett collected his first major league hit, a single to right-center, in the bottom of the ninth inning, off of pitcher Jesse Chavez, on June 5.", "Gennett hit his first major league home run on June 14, against Bronson Arroyo, in his birthplace of Cincinnati.", "Gennett was the left-handed part of a Milwaukee second base platoon (with Rickie Weeks) in 2014.", "The platoon ranked fourth in the National League in Wins Above Replacement at the All-Star Break." ], [ "Josh Hamilton", "Josh Hamilton\n\nJoshua Holt Hamilton (born May 21, 1981) is an American former professional baseball outfielder.", "He played for the Cincinnati Reds (2007), Texas Rangers (2008-2012, 2015), and Los Angeles Angels of Anaheim (2013\u20132014).", "Hamilton is a five-time MLB All-Star and won the American League Most Valuable Player Award (MVP) in 2010.", "Josh Hamilton was the first overall pick in the 1999 MLB draft by the Tampa Bay Devil Rays.", "He was considered a blue chip prospect until injuries and a drug addiction derailed his career, beginning in 2001.", "Prior to the 2007 season, Hamilton was selected by the Chicago Cubs (picking for the Reds) in the Rule 5 draft.", "During the off-season he was traded to the Rangers.", "During the 2008 season, Hamilton was named to the AL All-Star team.", "He also participated in the Home Run Derby, where he hit a record 28 home runs in the opening round and finished with 35 home runs, which was second-most all-time in derby history.", "He made the All-Star team the next four seasons as well.", "In 2012, Hamilton received more votes than any other player on the All-Star Game ballot, besting by approximately 3.5 million votes the vote count set in 2011 by Jos\u00e9 Bautista.", "Hamilton won the AL batting title in 2010." ], [ "J. D. Martinez", "J. D. Martinez\n\nJulio Daniel \"J. D.\" Martinez (born August 21, 1987) is an American professional baseball outfielder and designated hitter for the Boston Red Sox of Major League Baseball (MLB).", "He has also played in MLB for the Houston Astros, Detroit Tigers, and Arizona Diamondbacks.", "A right-handed thrower and batter, Martinez stands tall and weighs .", "A native of Miami, Florida, Martinez was selected by the Astros in the 20th round with the 611th pick in the 2009 amateur draft from Nova Southeastern University (NSU).", "He is a two-time selection for the MLB All-Star Game and a three-time Silver Slugger Award winner, as well as the only player to earn the latter honor twice in the same season.", "On September 4, 2017, Martinez became the 18th player in MLB history to hit four home runs in a single game, doing so versus the Los Angeles Dodgers.", "He is of Cuban descent.", "He placed second in the American League in the 2018 season in home runs and batting average, and first in RBIs, and was a crucial component of the Red Sox's 2018 World Series title run.", "Martinez attended Flanagan High School in Pembroke Pines, Florida, and graduated in 2006." ] ], "gold": "On May 8, 2012, Josh Hamilton, an American former professional baseball outfielder, hit 4 home runs in one game. on June 6, 2017, Ryan Joseph \"Scooter\" Gennett, an American professional baseball second baseman who is currently a free agent, hot 4 home runs in one game. On September 4, 2017, Julio Daniel Martinez, an American professional baseball outfielder and designated hitter for the Boston Red Sox, hit 4 home runs in one game.", "prediction 1": "On September 4, 2017, J. D. Martinez became the 18th player in MLB history to hit four home runs in a single game, doing so versus the Los Angeles Dodgers.", "prediction 2": "On June 6, 2017, Ryan Joseph \"Scooter\" Gennett became the 17th player in major league history to hit four home runs in a single game. On September 4, 2017, Julio Daniel \"J. D.\" Martinez became the 18th player in MLB history to hit four home runs in a single game, doing so versus the Los Angeles Dodgers.", "prediction 3": "On September 4, 2017, J. D. Martinez, an American professional baseball outfielder and designated hitter for the Boston Red Sox of Major League Baseball, hit four homeruns in a single game, doing so versus the Los Angeles Dodgers. On June 6, 2017, Scooter Gennett became the 17th player in major league history to hit four home runs in a single game.", "prediction 4": "The baseball player who hit four homeruns in one game in 2017 was Ryan Gennett, with Gennett becoming the 17th player in major league history to do so. The player who hit four home runs in a game in 2018 was J. D. Martinez, with Martinez becoming the 18th player in MLB history to do so.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 155 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "On September 4, 2017, Julio Daniel (J. D.) Martinez, an American professional baseball outfielder and designated hitter for the Boston Red Sox, became the 18th player in MLB history to hit four home runs in a single game. Ryan Joseph \"Scooter\" Gennett is an American professional baseball second baseman for the Cincinnati Reds. On June 6, 2017, he hit four home runs in a single game. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many citizens are there in the us?", "passages": [ [ "United States Census Bureau", "United States Census Bureau\n\nThe United States Census Bureau (USCB; officially the Bureau of the Census, as defined in Title ) is a principal agency of the U.S. Federal Statistical System, responsible for producing data about the American people and economy.", "The Census Bureau is part of the U.S. Department of Commerce and its director is appointed by the President of the United States.", "The Census Bureau's primary mission is conducting the U.S. Census every ten years, which allocates the seats of the U.S. House of Representatives to the states based on their population.", "The Bureau's various censuses and surveys help allocate over $400 billion in federal funds every year and it helps states, local communities, and businesses make informed decisions.", "The information provided by the census informs decisions on where to build and maintain schools, hospitals, transportation infrastructure, and police and fire departments." ], [ "2000 United States Census", "2000 United States Census\n\nThe Twenty-second United States Census, known as Census 2000 and conducted by the Census Bureau, determined the resident population of the United States on April 1, 2000, to be 281,421,906, an increase of 13.2% over the 248,709,873 people enumerated during the 1990 Census.", "This was the twenty-second federal census and was at the time the largest civilly administered peacetime effort in the United States.", "Approximately 16 percent of households received a \"long form\" of the 2000 census, which contained over 100 questions.", "Full documentation on the 2000 census, including census forms and a procedural history, is available from the Integrated Public Use Microdata Series.", "Microdata from the 2000 census is freely available through the Integrated Public Use Microdata Series.", "Aggregate data for small areas, together with electronic boundary files, can be downloaded from the National Historical Geographic Information System.", "Personally identifiable information will be available in 2072.", "The U.S. resident population includes the total number of people in the 50 states and the District of Columbia.", "The Bureau also enumerated the residents of the U.S. territory of Puerto Rico; its population was 3,808,610, an 8.1% increase over the number from a decade earlier." ], [ "2010 United States Census", "2010 United States Census\n\nThe 2010 United States Census (commonly referred to as the 2010 Census) is the twenty-third and most recent United States national census.", "National Census Day, the reference day used for the census, was April 1, 2010.", "The census was taken via mail-in citizen self-reporting, with enumerators serving to spot-check randomly selected neighborhoods and communities.", "As part of a drive to increase the count's accuracy, 635,000 temporary enumerators were hired.", "The population of the United States was counted as 308,745,538, a 9.7% increase from the 2000 Census.", "As required by the United States Constitution, the U.S. census has been conducted every 10 years since 1790.", "The 2000 U.S. Census was the previous census completed.", "Participation in the U.S. Census is required by law in Title 13 of the United States Code.", "On January 25, 2010 Census Bureau Director Robert Groves personally inaugurated the 2010 Census enumeration by counting World War II veteran Clifton Jackson, a resident of Noorvik, Alaska.", "More than 120 million census forms were delivered by the U.S. Post Office beginning March 15, 2010.", "The number of forms mailed out or hand-delivered by the Census Bureau was approximately 134 million on April 1, 2010." ] ], "gold": "The United States Census Bureau (USCB), officially the Bureau of the Census, is a principal agency of the U.S. Federal Statistical System, responsible for producing data about the American people and economy. According to the 1990 Census, there were 248,709,873 citizens in the United States. According to the 2000 Census, there were 281,421,906 citizens in the United States. By the 2010 Census, the number had increased to 308,745,538, and as of January 28, 2020, there were 329,227,746 citizens in the United States.", "prediction 1": "The United States Census Bureau is a principal agency of the U.S. Federal Statistical System responsible for producing data about the American people and economy. The population of the United States has been counted in a number of censuses. The 2000 census reported a population of 281,421,906 people. In 2010, the population was 308,745,538, a 9.7% increase from the 2000 census.", "prediction 2": "The United States has a population of 3.2 billion people, with 2.8 billion citizens living in the country. The 2000 census had 288.421 million inhabitants. The 2010 census had 308.8 million inhabitants.", "prediction 3": "The United States has a population of 281,421,906 people, as of April 1, 2000. This is an increase of 13.2% over the 248,709,873 people enumerated during the 1990 Census. The population of the United States was counted as 308,745,538, a 9.7% increase from the 2000 Census.", "prediction 4": "The United States has a total population of 317,681,258. The total population of the United States in 2010 was 308,745,538, a 9.7% increase from the 2000 Census.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 380 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States Census Bureau is a principal agency of the U.S. Federal Statistical System responsible for producing data about the American people and economy. The population of the United States has been counted in a number of censuses. The 1990 census reported a population of 248,709,873. The 2000 census reported a population of 281,421,906 people. In 2010, the population was 308,745,538." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "What is the most popular sport played in australia?", "passages": [ [ "Sport in Australia", "Sport in Australia\n\nSport is an important part of Australian culture dating back to the early colonial period.", "Cricket, Australian rules football, rugby league, rugby union, soccer and horse racing are among the earliest organised sports in Australia .", "Sport has shaped the Australian national identity through events such as the Ashes, the Melbourne Cup and the America's Cup .", "There are a number of professional sport leagues in Australia, including the Australian Football League (AFL) and AFL Women's (Australian rules football), National Rugby League (NRL) (rugby league), the Big Bash League (BBL) , Women's Big Bash League (WBBL) and Sheffield Shield (cricket), the National Basketball League and the Women's National Basketball League, the A-League and the W-League (soccer), the Australian Baseball League, Super Rugby and the National Rugby Championship (rugby union), Suncorp Super Netball and the Supercars Championship (touring car racing).", "Attendance for the AFL in a single season attracts more than 6 million people to games, while the NRL draws just over 3 million people in a single season, with the A-League drawing similar crowds .", "Historically, rugby football has been more popular than Australian rules football in New South Wales and Queensland, whereas Australian rules football has been more popular in Victoria, Tasmania, South Australia, North Territory and Western Australia." ], [ "Sport in Australia", "AIS was set up to improve Australia's performances in international sport which had started to decline in the 1960s and 1970s culminating in Australia winning no gold medals at the 1976 Montreal Olympics.", "In 1985, the Australian Sports Commission (ASC) was established to improve the Australian Government's administration of sport in terms of funding, participation and elite sport.", "The 1989 Senate Inquiry into drugs in sport resulted in the establishment of the Australian Sport Drug Agency (now called Australian Sports Anti-Doping Authority (ASADA)) in 1990 to manage Australia's anti-doping program.", "The highest rates of participation for Australian sport and recreation are informal, non-organised sports with bike riding, skateboarding, rollerblading or riding a scooter topping the list of activities for children, with 66% of all boys bike riding and 55.9% of all boys skateboarding, rollerblading or riding a scooter in 2009 and 2010.", "Girls also participated in these activities at high rates with 54.4% of them doing bike riding and 42.4% skateboarding, rollerblading or riding a scooter.", "Other sports popular for Australian girls include dancing, which had 26.3% participation, swimming with 19.8% participation and netball at 17%." ], [ "Sport in Australia", "For boys, the other popular sports for participation included soccer with a rate of participation of 19.9%, swimming with a participation rate of 17.2%, Australian rules at 16%.", "Participation rates for adults in Australia were much lower than that of Australian children.", "For adult women in Australia, the number one sport activity they participate in is walking with 30% having done this in 2009 and 2010.", "The second most popular form of exercise and sport was Aerobics/fitness/gym with a rate of 16.7%.", "The third most popular for adult women was swimming and diving with 8.4%.", "For men, the most popular sport activity was also walking with a participation rate of 15.6%.", "This was followed by Aerobics/fitness/gym with 11.2%.", "The third most popular sport for adult males was cycling/BMXing with a participation rate of 8.2%.", "There are 34,000 athletes, officials and coaches currently registered with the Athletics Australia.", "A 2007 estimate claimed that Australian football had 615,549 participants, Basketball has become one of the most popular participation sports in Australia.", "In Victoria, and Melbourne, particularly, it has more participants than any other sport.", "Australia's warm climate and long coastline of sandy beaches and rolling waves provide ideal conditions for water sports such as swimming." ] ], "gold": "There are a lot of popular sports in Australia. As a whole, the most popular sport to play in Australia is Cricket. Historically, rugby league and rugby union football codes have been more popular than Australian rules football in New South Wales and Queensland, whereas Australian rules football has been more popular in Victoria, Tasmania, South Australia, North Territory and Western Australia. The highest rates of participation for Australian sport and recreation are informal, non-organised sports with bike riding, skateboarding, rollerblading or riding a scooter topping the list of activities for children. For adult women in Australia, the number one sport activity they participate in is walking with 30% having done this in 2009 and 2010. For men, the most popular sport activity was also walking with a participation rate of 15.6%.", "prediction 1": "Australia has a number of professional sport leagues, including the Australian Football League (AFL) and AFL Women's (Australian rules football), the National Rugby League (NRL) (rugby league), the Big Bash League (BBL) and Women's Big Bash League (WBBL) and Sheffield Shield (cricket), the National Basketball League and the Women's National Basketball League, the A-League and the W-League (soccer), the Australian Baseball League, Super Rugby League (Australian rules football) and a strong participation rate of 19.6% for boys, while for girls, dancing, with 26.3% participation, swimming and diving with 19.8% participation rate of 13%.", "prediction 2": "Sport in Australia is an important part of Australian culture dating back to the early colonial period. Cricket, Australian rules football, rugby league, rugby union, soccer and horse racing are among the earliest organised sports in Australia. There are a number of professional sport leagues in Australia, including the Australian Football League (AFL) and AFL Women's (Australian rules football), the National Rugby League (NRL) (rugby league), the Big Bash League (BBL), the Women's Big Bash League (WBBL) and Sheffield Shield (cricket) and Sheffield Shield (cricket), the National Basketball League and the Women's National Basketball League, the A-League and the Women's National Basketball League.", "prediction 3": "There are a number of professional sport leagues in Australia, with the Australian Football League being the most popular sport played in Australia, followed by the National Rugby League and the Big Bash League, and the Australian Rules Football League. Soccer has become one of the most popular participation sports in Australia, with 36% of boys participating, followed by 12% of girls participating, and 16% of boys participating.", "prediction 4": "Sport in Australia is an important part of Australian culture dating back to the early colonial period. Historically, rugby football has been more popular than Australian rules football in New South Wales and Queensland, whereas Australian rules football has been more popular in Victoria, Tasmania, South Australia, North Territory and Western Australia. Australian rules football is the most popular sport played in Australia. The most popular sport for boys is Australian football, followed by basketball and netball.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 641 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Australia has a number of professional sport leagues, including the Australian Football League (AFL). Historically, rugby football has been more popular than Australian rules football in New South Wales and Queensland, whereas Australian rules football has been more popular in Victoria, Tasmania, South Australia, North Territory and Western Australia. The highest rates of participation for Australian sport and recreation are informal, non-organised sports with bike riding, skateboarding, rollerblading or riding a scooter topping the list of activities for children. For adult women in Australia, the number one sport activity they participate in is walking with 30% having done this in 2009 and 2010. For men, the most popular sport activity was also walking with a participation rate of 15.6%." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is the common site for obtaining a pulse rate?", "passages": [ [ "Pulse", "Pulse\n\nIn medicine, a pulse represents the tactile arterial palpation of the heartbeat by trained fingertips.", "The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck (carotid artery), wrist (radial artery), at the groin (femoral artery), behind the knee (popliteal artery), near the ankle joint (posterior tibial artery), and on foot (dorsalis pedis artery).", "Pulse (or the count of arterial pulse per minute) is equivalent to measuring the heart rate.", "The heart rate can also be measured by listening to the heart beat by auscultation, traditionally using a stethoscope and counting it for a minute.", "The radial pulse is commonly measured using three fingers.", "This has a reason: the finger closest to the heart is used to occlude the pulse pressure, the middle finger is used get a crude estimate of the blood pressure, and the finger most distal to the heart (usually the ring finger) is used to nullify the effect of the ulnar pulse as the two arteries are connected via the palmar arches (superficial and deep).", "The study of the pulse is known as sphygmology.", "Claudius Galen was perhaps the first physiologist to describe the pulse." ] ], "gold": "In medicine, a pulse represents the tactile arterial palpation of the cardiac cycle, or heartbeat, by trained fingertips. The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck, the site of the carotid artery, wrist, the site of the radial artery, at the groin, the site of the femoral artery, behind the knee, the site of the popliteal artery, near the ankle joint, the site of the posterior tibial artery, and on foot, the site of the dorsalis pedis artery. Pulse, or the count of arterial pulse per minute, is equivalent to measuring the heart rate. The heart rate can also be measured by listening to the heart beat by auscultation, traditionally using a stethoscope and counting it for a minute, while the radial pulse is commonly measured using three fingers.", "prediction 1": "The radial pulse is commonly measured using three fingers, because the finger closest to the heart is used to occlude the pulse pressure, the middle finger is used get a crude estimate of the blood pressure, and the finger most distal to the heart (usually the ring finger) is used to nullify the effect of the ulnar pulse as the two arteries are connected via the palmar arches. The study of the pulse is known as sphygmology. The study of the pulse is known as a pulse rate.", "prediction 2": "In medicine, a pulse represents the tactile arterial palpation of the heartbeat by trained fingertips. The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck (carotid artery), wrist (radial artery), at the groin (femoral artery), behind the knee (popliteal artery), near the ankle joint (posterior tibial artery), and on foot (dorsalis pedis artery). The radial pulse is commonly measured using three fingers.", "prediction 3": "The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck (carotid artery), wrist (radial artery), at the groin (femoral artery), behind the knee (popliteal artery), near the ankle joint (posterior tibial artery), and on foot (dorsalis pedis artery).", "prediction 4": "In medicine, a pulse represents the tactile arterial palpation of the heartbeat by trained fingertips. The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck (carotid artery), wrist (radial artery), at the groin (femoral artery), behind the knee (popliteal artery), near the ankle joint (posterior tibial artery), and on foot (dorsalis pedis artery).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 427 }, { "error type": "Redundant", "explanation": "The radial pulse is commonly measured using three fingers, because the finger closest to the heart is used to occlude the pulse pressure, the middle finger is used get a crude estimate of the blood pressure, and the finger most distal to the heart (usually the ring finger) is used to nullify the effect of the ulnar pulse as the two arteries are connected via the palmar arches. The study of the pulse is known as sphygmology. ", "start": 428, "end": 476 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Pulse In medicine, a pulse represents the tactile arterial palpation of the heartbeat by trained fingertips. The pulse may be palpated in any place that allows an artery to be compressed near the surface of the body, such as at the neck (carotid artery), wrist (radial artery), at the groin (femoral artery), behind the knee (popliteal artery), near the ankle joint (posterior tibial artery), and on foot (dorsalis pedis artery). Pulse (or the count of arterial pulse per minute) is equivalent to measuring the heart rate. The radial pulse is commonly measured using three fingers, while the heart rate can also be measured by listening to the heart beat by auscultation, traditionally using a stethoscope and counting it for a minute. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When is harry potter and cursed child coming out?", "passages": [ [ "Wizarding World", "In November 2016, Rowling confirmed that the series' story would consist of a sequence of events that occurred between the years of 1926 and 1945.", "In December 2013, J. K. Rowling announced that she was working on a \"Harry Potter\"\u2013based play, and in June 2015 it was officially titled \"Harry Potter and the Cursed Child\".", "The two-part, West End stage play, written by British playwright Jack Thorne is based on an original story by Thorne, John Tiffany and Rowling.", "It is directed by Tiffany with choreography by Steven Hoggett, set design by Christine Jones, costume design by Katrina Lindsay, lighting design by Neil Austin, music by Imogen Heap, and sound design by Gareth Fry.", "The story begins nineteen years after the events of \"Deathly Hallows\" and follows Harry Potter, now a Ministry of Magic employee, and his younger son Albus Severus Potter, who is about to attend Hogwarts.", "On 20 December 2015, it was announced that Jamie Parker, Noma Dumezweni and Paul Thornley would play Harry Potter, Hermione Granger and Ron Weasley.", "The play debuted at the Palace Theatre, London on 7 June 2016 in previews, with the official opening on 30 July.", "The script was released in book form the day after the play's world premiere." ], [ "Harry Potter and the Cursed Child", "Harry Potter and the Cursed Child\n\nHarry Potter and the Cursed Child is a two-part stage play written by Jack Thorne based on an original story by Thorne, J. K. Rowling and John Tiffany.", "Previews of the play began at the Palace Theatre, London on 7 June 2016, and it premiered on 30 July 2016.", "The play opened on Broadway on 22 April 2018 at the Lyric Theatre, with previews starting on 16 March 2018.", "Its cast is similar to that of the first year on West End, with returning actors Anthony Boyle, Sam Clemmett, Noma Dumezweni, Poppy Miller, Jamie Parker, Alex Price, and Paul Thornley.", "The story begins nineteen years after the events of \"Harry Potter and the Deathly Hallows\" and follows Harry Potter, now a Ministry of Magic employee, and his younger son Albus Severus Potter, who is about to attend Hogwarts School of Witchcraft and Wizardry.", "At the 2017 Laurence Olivier Awards, the London production received a record-breaking eleven nominations and an again record-breaking nine awards, including Best New Play, Best Actor, Best Actor in a Supporting Role, Best Actress in a Supporting Role and Best Director.", "At the 2018 Tony Awards, the Broadway production won six awards, including Best Play." ], [ "Harry Potter and the Cursed Child", "In mid-July\u00a02016, the theatre began holding a ticket lottery at 1\u00a0pm each Friday, releasing 40 for sale on their website for \"some of the best seats\" in the theatre for the lowest price, advertised at \u00a320\u00a0per part.", "For example, the \"Friday Forty\" tickets sold on 29\u00a0July 2016 were for performances on 3, 5, 6, and 7\u00a0August.", "On 20\u00a0December 2015, initial casting was announced with Jamie Parker playing Harry Potter, Noma Dumezweni playing Hermione Granger and Paul Thornley playing Ron Weasley.", "The casting of the dark-skinned Noma Dumezweni as Hermione sparked fervent discussion, to which Rowling responded that Hermione's skin was never specified as white.", "Further notable casting includes Poppy Miller as Ginny Potter, Alex Price as Draco Malfoy, Sam Clemmett as Albus Severus Potter and Anthony Boyle as Scorpius Malfoy.", "The production features an overall cast of 42.", "The production began previews on 16 March 2018, officially opening on 22 April at the Lyric Theatre.", "Clemmett, Boyle, Dumezweni, Miller, Parker, Price and Thornley reprised their roles, from the West End.", "The theatre removed 400 seats from the auditorium and moved the entrance to 43rd Street." ] ], "gold": "Harry Potter and the Cursed Child is a two part British play written by Jack Thorne based on an original story by J. K. Rowling, John Tiffany, and Thorne. It began previews June 7,2016 at the Palace Theater, London, it premiered July 30,2016. Previews for the Broadway production began at the Lyric Theater, March 16,2018. It premiered April 22,2018. The cast was similar to that of the first year in the West End.", "prediction 1": "Harry Potter and the Cursed Child is a 2016-based British stage play written by British playwright Jack Thorne based on an original story by Thorne, J. K. Rowling, John Tiffany, and Rowling. It was first performed on April 22, 2018 at the Lyric Theatre in Brooklyn, New York. The London production debuted on June 7, 2016, with previews starting on March 16, 2018 and it opened on July 30, 2016. The play opened on Broadway on April 22, 2018 at the Lyric Theatre in Brooklyn, New York City on June 22, 2018 at the Lyric Theatre, Brooklyn Theatre in Philadelphia on April 22, 2018. The play opened on June 22, 2018 at the Palace Theatre, with previews starting on March 16, with previews starting on March 22, 2018 at the Lyric Theatre in New York City Center in New York City.", "prediction 2": "Harry Potter and the Cursed Child is a 2016 British stage play written by Jack Thorne based on an original story by Thorne, John Tiffany and Rowling. The two-part, West End stage play was released on 7 June 2016 and its premiere was on 30 July 2016. It opened on Broadway on 22 April 2018 at the Lyric Theatre.", "prediction 3": "Harry Potter and the Cursed Child is a two-part stage play written by British playwright Jack Thorne based on an original story by Thorne, John Tiffany and Rowling. The West End play, written by Thorne, opened in previews on 7 June 2016 in London and opened on 30 July 2016. The Broadway production opened in New York City on 22 April 2018 beginning previews on 16 March 2018.", "prediction 4": "Harry Potter and the Cursed Child is a two-part stage play written by British playwright Jack Thorne based on an original story by Thorne, John Tiffany and Rowling. The two-part, West End stage play, written by British playwright Jack Thorne, debuted at the Palace Theatre, London on 7 June 2016 in previews, with the official opening on 30 July 2016. The play opened on Broadway on 22 April 2018 at the Lyric Theatre, with previews starting on 16 March 2018.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Harry Potter and the Cursed Child is a 2016-based British stage play written by British playwright Jack Thorne based on an original story by Thorne, J. K. Rowling, John Tiffany, ", "start": 178, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 98 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 217, "end": 275 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 349, "end": 363 }, { "error type": "Redundant", "explanation": " The play opened on Broadway on April 22, 2018 at the Lyric Theatre in Brooklyn, New York City ", "start": 490, "end": 545 }, { "error type": "Unverifiable", "explanation": "", "start": 549, "end": 561 }, { "error type": "Unverifiable", "explanation": "", "start": 476, "end": 489 }, { "error type": "Unverifiable", "explanation": "", "start": 738, "end": 751 }, { "error type": "Redundant", "explanation": "The play opened on June 22, 2018 at the Palace Theatre, with previews starting on March 16, with previews starting on March 22, 2018 at the Lyric Theatre in New York City ", "start": 752, "end": 776 }, { "error type": "Redundant", "explanation": "The play opened on Broadway on April 22, 2018 at the Lyric Theatre in Brooklyn, New York City on June 22, 2018 at the Lyric Theatre, Brooklyn Theatre in Philadelphia on April 22, 2018. ", "start": 581, "end": 636 }, { "error type": "Redundant", "explanation": "The play opened on June 22, 2018 at the Palace Theatre, with previews starting on March 16, ", "start": 673, "end": 698 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 699, "end": 708 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Harry Potter and the Cursed Child is a 2016-based British stage play written by Jack Thorne based on an original story by Thorne, J. K. Rowling, John Tiffany, and Rowling. The play debuted at the Palace Theatre, London on 7 June 2016 in previews, with the official opening on 30 July. The play opened on Broadway on 22 April 2018 at the Lyric Theatre, with previews starting on 16 March 2018. Its cast is similar to that of the first year on West End." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "What is the latest version of iphone software?", "passages": [ [ "IOS version history", "IOS version history\n\niOS is a mobile operating system, developed by Apple Inc. for iPhone, iPad, and iPod Touch.", "Updates for iOS are released through the iTunes software and, since iOS 5, via over-the-air software updates.", "With the announcement of iOS 5 on June 6, 2011, a USB connection to iTunes was no longer needed to activate iOS devices; data synchronization can happen automatically and wirelessly through Apple's iCloud service.", "Major new iOS releases are announced yearly during the Apple Worldwide Developers Conference (WWDC), and are usually released in September of the same year, usually coinciding with the release of new iPhone models.", "The most recent stable release, iOS 12.1.2, was released on December 17, 2018.", "June 2007 saw the official release of what eventually became iOS\u00a0\u2013 concurrently with the first iPhone.", "iOS did not have an official name until the official release of the iPhone software development kit (iPhone SDK) on March 6, 2008.", "Before then, Apple marketing simply stated that iPhone ran a version of Mac OS X made specifically for iPhone.", "When iOS was introduced, it was named \"iPhone OS\".", "It was officially renamed iOS on June 7, 2010 with the announcement and introduction of iPad." ], [ "IPad (4th generation)", "Despite being a direct competitor to both the Amazon Kindle and Barnes & Noble Nook, both Amazon.com and Barnes & Noble offer e-reader apps for the iPad.", "The 4th generation iPad, unlike its immediate predecessor, the 3rd generation iPad, is supported by iOS 10; however, it was announced at the Apple WWDC 2017 that the 4th generation iPad (along with the iPhone 5/5C) will not support iOS 11.", "iOS 10.3.3 is the latest and final version of iOS to include support for these devices.", "The device has an Apple A6X SoC which comprises a 32-bit Apple dual-core CPU running at 1.4\u00a0GHz and a quad-core PowerVR SGX554MP4 GPU, 1\u00a0GB of RAM.", "It also features a 5-megapixel, rear-facing camera capable of 1080p video recording; and a 720p HD front-facing videophone camera designed for FaceTime.", "The device features a 9.7\" (diagonal) display with a resolution of 2,048 by 1,536 (QXGA) resulting in 3.1\u00a0million pixels, this gives the display a pixel density of 264\u00a0ppi.", "The total number of pixels used in the display of the fourth-generation iPad is four times that of the iPad 2\u00a0\u2013 providing even scaling from the prior model." ], [ "IPad (3rd generation)", "For the rest of the world outside North America, connectivity options are Wi-Fi only (on the Wi-Fi model) or Wi-Fi + 3G (on the Wi-Fi + Cellular model), with the latter unavailable in some countries, as 4G (LTE) connectivity for the device is not available outside North America.", "The Wi-Fi + Cellular model includes GPS capability.", "Initially, the cellular version was titled and marketed worldwide as the \"Wi-Fi + 4G\" model, but due to regional differences in classification of 4G (LTE) connectivity outside of North America, Apple later rebranded and altered their marketing to call this the \"Wi-Fi + Cellular\" model.", "The tablet was released in ten countries on March 16, 2012.", "It gained mostly positive reviews, earning praise for its Retina display, processor and 4G (LTE) capabilities.", "However, controversy arose when the LTE incompatibilities became known.", "Three million units were sold in the first three days.", "After only seven months (221 days) of official availability, the third-generation iPad was discontinued on October 23, 2012, following the announcement of the fourth-generation iPad.", "The third-generation iPad had the shortest lifespan of any iOS product." ] ], "gold": "The version history of the mobile operating system iOS, developed by Apple Inc., began with the release of iPhone OS for the original iPhone on June 29, 2007 and has since seen continuous development, resulting in new major releases of the software typically being announced at the annual Apple Worldwide Developers Conference and later released in September, coinciding with the release of new iPhone models. The latest version of iPhone software released in 2017 was version 10.3.3, which was the final supported release for the iPhone 5C and the Wi-Fi-only iPad. The latest version of iPhone software in 2016 was version 9.3.5, which was the final release on the iPod Touch 5th generation, the Wi-Fi-only iPad 2, the Wi-Fi-only iPad 3rd generation, and the Wi-Fi-only iPad Mini 1st generation. The latest version of iPhone software that was released in June 2014 was version 7.1.2 and was the final release on the iPhone 4.", "prediction 1": "The most recent stable release of the iphone software, iOS 12, was released on December 17, 2018. iOS 11.0.1 was released on July 12, 2017, while iOS 12.1.2 was released on December 17, 2018. The most recent stable release of the iPhone software, iOS 12.1.1, was released on December 17, 2018.", "prediction 2": "The latest version of the iPhone software, iOS, is version 12.1.2, which was released on December 17, 2018. The most recent stable release, iOS 12.1.2, was released on December 17, 2018.", "prediction 3": "The most recent stable release of iOS 12.1.2 was released on December 17, 2018. The most recent stable release of iOS 12.1.2 was released on December 17, 2018. The most recent stable release of iOS 12.1.2 was released on December 17, 2018.", "prediction 4": "The most recent stable release of iOS is 12.1.2, which was released on December 17, 2018. It was released on December 17, 2018, and is the latest and final version of the mobile operating system for the iPhone, iPad, and iPod Touch. The latest stable version of the iPhone operating system is 12.1.2, which was released on December 17, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 98, "end": 139 }, { "error type": "Redundant", "explanation": "The most recent stable release of the iphone software, iOS 12, was released on December 17, 2018.", "start": 140, "end": 191 }, { "error type": "Redundant", "explanation": "The most recent stable release of the iphone software, iOS 12, was released on December 17, 2018. ", "start": 192, "end": 293 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": " iOS is a mobile operating system, developed by Apple Inc. June 2007 saw the official release of what eventually became iOS \u2013 concurrently with the first iPhone. Major new iOS releases are announced yearly during the Apple Worldwide Developers Conference (WWDC), and are usually released in September of the same year, usually coinciding with the release of new iPhone models. It was announced at the Apple WWDC 2017 that the 4th generation iPad (along with the iPhone 5/5C) will not support iOS 11. iOS 10.3.3 is the latest and final version of iOS to include support for these devices. The most recent stable release of the iphone software, iOS 12.1.1, was released on December 17, 2018. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has a baby in pitch perfect 3?", "passages": [ [ "Pitch Perfect 3", "Pitch Perfect 3\n\nPitch Perfect 3 is a 2017 American musical comedy film directed by Trish Sie and written by Kay Cannon and Mike White.", "A sequel to \"Pitch Perfect 2\" (2015), and the third installment in the \"Pitch Perfect\" series, the film stars Anna Kendrick, Anna Camp, Rebel Wilson, Brittany Snow, Hailee Steinfeld, Hana Mae Lee, Ester Dean, Chrissie Fit, Alexis Knapp, John Lithgow, Matt Lanter, Ruby Rose, Kelley Jakle, Shelley Regner, Elizabeth Banks, and John Michael Higgins.", "The film follows the Bellas, now graduated from college, reuniting for one final performance together during an overseas USO tour.", "Principal photography on the film began in January 2017 in Atlanta, Georgia and ended in April 2017.", "The film was released in the United States on December 22, 2017, received mixed reviews from critics and grossed $185 million worldwide.", "It became the second-highest-grossing musical comedy film of all time, behind only its predecessor.", "Three years after their final competition, the Bellas have graduated from Barden College, but all hate their jobs." ], [ "Pitch Perfect 3", "Beca, Fat Amy, Chloe, Aubrey, Lilly, Stacie, Cynthia Rose, Florencia, Jessica, and Ashley are thrilled when Emily, now a senior and leader of the current Barden Bellas, asks them to sing at an event.", "Arriving at the reunion, they learn that Emily simply invited them to see the new Bellas.", "They later gather at a bar in disappointment, but express how much they miss each other.", "Aubrey convinces them to join a USO tour, near her Army officer father.", "Emily fills in for Stacie, who is eight months pregnant.", "The Bellas land at a base in Spain, greeted by their liaisons, soldiers Chicago and Zeke.", "They also meet the other three bands, including the mean-spirited female quartet Evermoist.", "The others use musical instruments, helping them defeat the Bellas in a riff-off.", "Chloe begins to fall for Chicago.", "Fat Amy learns that Fergus, her estranged father and ruthless international crime lord, is staying in their hotel.", "The Bellas are invited to a party at DJ Khaled's suite, where Fat Amy is invited to a poker tournament.", "The tournament was a set up by Fergus, who begs to be in Amy\u2019s life, which she agrees to after seeing he has changed." ], [ "Alexis Knapp", "Alexis Knapp\n\nAlexis Merizalde Knapp (born July 31, 1989) is an American actress and singer.", "She is known for her role as Stacie Conrad in the musical films \"Pitch Perfect\" (2012) and its two sequels, \"Pitch Perfect 2\" (2015) and \"Pitch Perfect 3\" (2017).", "She is also known for her role of Alexis in the party film \"Project X\" (2012), and her role on the first season of the TBS comedy \"Ground Floor\".", "Knapp was born in Avonmore, Pennsylvania, the daughter of Marjorie and Bradford Elwood Knapp.", "She grew up in the Outer Banks of North Carolina before leaving home and moving to Los Angeles at the age of 18.", "At age 18, Knapp moved to Los Angeles.", "There in 2008 she hosted a popular internet video series titled 'Project Lore', a show about the videogame \"World of Warcraft\", and also worked as a model before breaking into acting.", "She appeared in background roles in \"\" as Aphrodite Girl #9 and in \"Couples Retreat\" as a Dance Academy Girl.", "In 2012, Knapp appeared in her first major roles, playing Alexis in \"Project X\" as Stacie Conrad in the hit film \"Pitch Perfect\", as a sex-crazed Barden Bella." ] ], "gold": "Pitch Perfect 3 is a 2017 American musical comedy and the third and final installment in the Pitch Perfect trilogy. The film follows the Bellas, now graduated from college, reuniting for one final performance together during an overseas USO tour. During the movie, Stacie Conrad, the character played by Alexis Knapp, is not able to join the rest of the team due to being eight months pregnant.", "prediction 1": "Pitch Perfect 3 is a 2017 American musical comedy film starring Anna Kendrick, Anna Camp, Rebel Wilson, Brittany Snow, Hailee Steinfeld, Hana Mae Lee, Ester Dean, Chrissie Fit, John Lithgow, Matt Lanter, Ruby Rose, Kelley Jakle, Elizabeth Banks, and John Michael Higgins. The film follows the Bellas, now graduated from college, reuniting for one final performance together during an overseas USO tour. Fat Amy learns that Fergus, her estranged father and ruthless international crime lord, is staying in their hotel.\n", "prediction 2": "Pitch Perfect 3 is a 2017 American musical comedy film that follows the Bellas, now graduated from college, reuniting for one final performance together during an overseas USO tour. Three years after their final competition, the Bellas graduate from Barden College, but all hate their jobs. As Stacie Conrad in Pitch Perfect 2, American actress Alexis Knapp, is pregnant with Stacie's baby.", "prediction 3": "American actress Alexis Knapp played Stacie Conrad in the 2012 film Pitch Perfect, as well as its sequels, Pitch Perfect 2 (2015) and Pitch Perfect 3 (2017). Knapp was also the force behind the party film Project X, where she played Stacie, a sex-crazed Barden Bella.", "prediction 4": "Pitch Perfect 3 is a 2017 American musical comedy film. It was a sequel to Pitch Perfect 2 (2015) and the third installment in the Pitch Perfect series. It stars Anna Kendrick, Anna Camp, Rebel Wilson, Brittany Snow, Hana Mae Lee, Ester Dean, Chrissie Fit, John Lithgow, Matt Lanter, Ruby Rose, Kelley Jakle, Elizabeth Banks, and John Michael Higgins. In this film, Stacie Conrad has a baby with actress Alexis Knapp. Amy's parents have a baby with an 18-year old.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 403, "end": 518 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Pitch Perfect 3 is a 2017 American musical comedy film and the third installment in the \"Pitch Perfect\" series. The film follows the Bellas, now graduated from college, reuniting for one final performance together during an overseas USO tour. Emily fills in for Stacie, who is eight months pregnant.\n" }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Who wrote the theme song for a different world?", "passages": [ [ "Dawnn Lewis", "Lewis appeared for the first five of the six-season run as Jaleesa Vinson (later Vinson\u2013Taylor) from 1987 until 1992.", "Lewis co-wrote the theme song to \"A Different World\", with Bill Cosby and Stu Gardner, and co-performed the song for the first season.", "In \"A Different World\", Although her character was married to another of the main characters on the show, her character disappeared from \"A Different World\" without explanation, like Chuck Cunningham of \"Happy Days\".", "Lewis appeared in a special week-long segment of \"A Different World\" called the \"Hillman College Reunion\" airing on Nick At Nite, along with Lisa Bonet, Jasmine Guy, Kadeem Hardison, Darryl M. Bell, Cree Summer, and Sinbad.", "On her \"Super Password\" appearance in 1988, she was paired with \"Dallas (1978 TV series)\" star Ken Kercheval, not any of her co-stars.", "In September 1992, Lewis began starring in ABC's \"Hangin' with Mr. Cooper\" alongside Mark Curry and Holly Robinson.", "Lewis appeared in 20 of the 22 episodes of the first season as Robin Dumars, Mark's childhood best friend and roommate." ], [ "Dawnn Lewis", "Dawnn Lewis\n\nDawnn J. Lewis (born August 13, 1961) is an American actress, singer, voice actress , and songwriter.", "Lewis is best known for her role as Jaleesa Vinson\u2013Taylor on the NBC television sitcom \"A Different World\" from the series beginning in 1987 until the end of its fifth season in 1992, in addition to being on the show; Lewis co\u2013wrote the theme song.", "Lewis's other notable roles include portraying Robin Dumars on the ABC sitcom \"Hangin' With Mr. Cooper\" for its first season (1992\u201393) and as Cheryl Spade in the 1988 film \"I'm Gonna Git You Sucka\".", "Since then, Lewis has appeared in numerous TV series, including other sitcoms, and has also performed on stage.", "Born in Brooklyn, New York City to Carl and Joyce Lewis, who are of African-American and Guyanese descent, Lewis began singing at the age of four and acting at eleven.", "Lewis graduated from the High School of Music and Art (now known as Fiorello H. LaGuardia High School) at age 16.", "After high school, she studied at the University of Miami, graduating \"cum laude\" with a major in Musical Theatre and a minor in Journalism in 1982." ], [ "A Different World", "A Different World\n\nA Different World is an American sitcom (and a spin-off of \"The Cosby Show\") that aired for six seasons on NBC from September 24, 1987 to July 9, 1993.", "The series originally centered on Denise Huxtable (Lisa Bonet) and the life of students at Hillman College, a fictional historically black college in Virginia.", "It was inspired by student life at historically black colleges and universities.", "After Bonet's departure in the first season, the remainder of the series primarily focused more on Southern belle Whitley Gilbert (Jasmine Guy) and math whiz Dwayne Wayne (Kadeem Hardison).", "While it was a spin-off from \"The Cosby Show\", \"A Different World\" typically addressed issues that were avoided by \"The Cosby Show\" writers (race and class relations, or the Equal Rights Amendment).", "One episode that aired in 1990 was one of the first American network television episodes to address the HIV/AIDS epidemic.", "The original premise was to have a white student there and have Lena Horne as an acting teacher, but in production, the premise changed from being a story about a white girl in a black college to a black girl (Denise Huxtable) in a black college with a white friend." ] ], "gold": "A Different World is an American sitcom television series, that was a spin-off of The Cosby Show, aired for six seasons on NBC from September 24, 1987 to July 9, 1993. The theme song was co-written by Stu Gardner, Bill Cosby, and Dawnn Lewis, who was an actress from Brooklyn who also played Jaleesa Vinson\u2013Taylor on the show. Stuart Gardner is an American musician and composer from Richmond, Virginia. Bill Cosby is an American stand-up comedian, actor, and author from Philadelphia.", "prediction 1": "A Different World is an American sitcom that was inspired by student life at historically black colleges and universities. The show was inspired by student life at historically black colleges and universities. Dawnn Lewis co-wrote the theme song to A Different World, with Bill Cosby and Stu Gardner, and co-performed the song for the first season.", "prediction 2": "A Different World is an American sitcom that aired on NBC for six seasons. The series originally centered on Denise Huxtable and the life of students at Hillman College, a fictional historically black college in Virginia. The show was inspired by student life at historically black colleges and universities. The theme song was written by Dawnn Lewis, Bill Cosby, Stu Gardner and Darryl M. Bell.", "prediction 3": "A Different World is an American sitcom that aired for six seasons. The show was inspired by the life of students at historically black colleges and universities. Dawnn Lewis co-wrote the theme song to A Different World, with Bill Cosby and Stu Gardner, and co-performed the song for the first season.", "prediction 4": "Dawnn Lewis co-wrote the theme song to A Different World, with Bill Cosby and Stu Gardner, and co-performed the song for the first season. Lewis is best known for her role as Jaleesa Vinson\u2013Taylor on the NBC television sitcom A Different World from the series beginning in 1987 until the end of its fifth season in 1992, in addition to being on the show, Lewis co-wrote the theme song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 348 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "A Different World is an American sitcom, that was a spin-off of The Cosby Show, aired for six seasons on NBC from September 24, 1987 to July 9, 1993. Dawnn Lewis co-wrote the theme song to A Different World, with Bill Cosby and Stu Gardner. Dawnn Lewis is an American actress who is best known for her role as Jaleesa Vinson\u2013Taylor show. " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Most runs by a player in single ipl season?", "passages": [ [ "Chris Gayle", "Gayle started off his 2013 IPL season scoring 92 not out from 58 balls, hitting 11 fours and four sixes against the Mumbai Indians.", "His innings helped his side to victory, and he was awarded the Man of the match.", "On 23 April 2013 during an IPL match against Pune Warriors India, Gayle broke multiple scoring records.", "With an individual score of 175 not out off 66 balls and a century reached in 30 balls, Gayle set records for the fastest century reached in any format of cricket, the highest individual score in a T20 match, and the most sixes scored in a single innings in the IPL.", "He also took two wickets in the match.", "On January 18, 2016, in a match with the Adelaide Strikers, Gayle set a new Big Bash League record for the fastest fifty and equaled the world record set by Indian batsman Yuvraj Singh against England in the 2007 ICC World Twenty20.", "He reached 51 in just 12 deliveries which included seven sixes and smashed the previous record of 18 deliveries set by Strikers batsman Tim Ludeman.", "He was dismissed shortly after for 56 off 17 balls by Travis Head.", "Chris Gayle was signed by Lahore Qalandars in 2016 for 200,000 dollars to play in the Pakistan Super League.", "Gayle had his worst T20 league, citing back problems." ], [ "Deccan Chargers in 2009", "Deccan Chargers in 2009\n\nThe Deccan Chargers (DC) were a franchise cricket team based in Hyderabad, India, that competed in the Indian Premier League (IPL), a professional Twenty20 cricket (T20) league in India.", "They were one of the eight teams that competed in the 2009 Indian Premier League, making their second appearance in all IPL tournaments.", "The team was captained by Adam Gilchrist and coached by Darren Lehmann with Kanwaljit Singh and Mike Young as assistant coaches.", "They began their season by winning their opening fixture of the IPL on 19 April against the Kolkata Knight Riders, and went on to qualify for the semi-finals.", "They beat the Delhi Daredevils in the semi-final to reach the Final.", "They defeated the Royal Challengers Bangalore in the Final by six runs to win their maiden IPL trophy and qualify for the 2009 Champions League Twenty20 (CLT20).", "They lost both their matches in the group stage of the CLT20 and failed to advance to the league stage.", "The Deccan Chargers were one of the most expensive teams of the Indian Premier League and they also spent a large amount of money on players during the auction but finished at the bottom of the table winning only two of their 14 matches." ], [ "Virat Kohli", "He finished fifth on the season's leading run-getters list with 505 runs at an average of 45.90 and a strike rate of more than 130.", "At the 2016 IPL, the Royal Challengers finished runners-up and Kohli broke the record for most runs in an IPL season (of 733 runs) by scoring 973 runs in 16 matches at an average of 81.08, winning the Orange Cap.", "He scored four centuries in the tournament, having never scored one in the Twenty20 format before the start of the season, and also became the first player to reach the 4000-run milestone in the IPL.", "At the launch event of his biography, 'Driven: The Virat Kohli Story' in New Delhi, in October 2016, Kohli announced that RCB would be the IPL franchise that he would permanently play for.", "Kohli missed the start of the 2017 season due to a shoulder injury.", "Morever,\nRCB finished the tournament at the bottom of the table, with Kohli scoring the most runs for his team, with 308 from 10 matches.", "In the 2018 season, Kohli was retained by RCB for a price of \u20b917 crore, the highest for any player that year.", "Kohli is a naturally aggressive batsman with strong technical skills." ] ], "gold": "The\u00a0Indian Premier League\u00a0(IPL) is a\u00a0league with eight teams based out of eight different Indian cities. Batsman Virat Kohli holds the IPL record for most runs by a player. The most runs by a player in a season is 973. ", "prediction 1": "Chris Gayle scored the most runs in a single IPL season in 2013 with 175 not out off 66 balls. Gayle then scored his century in 30 balls, breaking multiple scoring records, including the fastest century reached in any format of cricket, the highest individual score in a T20 match, and the most sixes scored in a single innings in the IPL. Earlier this year, Virat Kohli scored the most runs in a single IPL season in 2015.", "prediction 2": "There are several players who have scored the most runs in a single IPL season. Chris Gayle scored the most runs in 2013 when playing against Pune Warriors India. Virat Kohli scored the most runs in 2016 when playing against the Royal Challengers Bangalore. Chris Gayle scored the most runs in 2013 when playing against Pune Warriors India.", "prediction 3": "The record for most runs by a player in a single IPL season is 733 runs, but Virat Kohli has scored more than that. In the 2009 season, the Deccan Chargers scored the most runs in a single season, scoring 732 runs. In the 2016 season, the Royal Challengers Bangalore scored the most runs in a single season, scoring 973 runs. In the 2017 and 2018 seasons, both Kohli and his team RCB scored the most runs.", "prediction 4": "The player with the most runs in a single IPL season is Chris Gayle, who scored a total of 2,046 runs in the 2013-2014 season. The most runs in a single IPL season by a player is 733, set in 2009. Virat Kohli, who scored 505 runs in the 2016 season, achieved the number of runs in a single IPL season by scoring 973 runs in 16 matches.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 23, "end": 32 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 339 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 340, "end": 358 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 418, "end": 423 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Virat Kohli broke the record for most runs in an IPL season by scoring 973 runs." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was emily dickinson's poetry first published?", "passages": [ [ "Emily Dickinson", "On May 15, 1886, after several days of worsening symptoms, Emily Dickinson died at the age of 55.", "Austin wrote in his diary that \"the day was awful ...", "she ceased to breathe that terrible breathing just before the [afternoon] whistle sounded for six.\"", "Dickinson's chief physician gave the cause of death as Bright's disease and its duration as two and a half years.", "Dickinson was buried, laid in a white coffin with vanilla-scented heliotrope, a Lady's Slipper orchid, and a \"knot of blue field violets\" placed about it.", "The funeral service, held in the Homestead's library, was simple and short; Higginson, who had met her only twice, read \"No Coward Soul Is Mine\", a poem by Emily Bront\u00eb that had been a favorite of Dickinson's.", "At Dickinson's request, her \"coffin [was] not driven but carried through fields of buttercups\" for burial in the family plot at West Cemetery on Triangle Street.", "Despite Dickinson's prolific writing, fewer than a dozen of her poems were published during her lifetime.", "After her younger sister Lavinia discovered the collection of nearly 1800 poems, Dickinson's first volume was published four years after her death." ], [ "Emily Dickinson", "Until Thomas H. Johnson published Dickinson's \"Complete Poems\" in 1955, Dickinson's poems were considerably edited and altered from their manuscript versions.", "Since 1890 Dickinson has remained continuously in print.", "A few of Dickinson's poems appeared in Samuel Bowles' \"Springfield Republican\" between 1858 and 1868.", "They were published anonymously and heavily edited, with conventionalized punctuation and formal titles.", "The first poem, \"Nobody knows this little rose\", may have been published without Dickinson's permission.", "The \"Republican\" also published \"A narrow Fellow in the Grass\" as \"The Snake\", \"Safe in their Alabaster Chambers\u00a0\u2013\" as \"The Sleeping\", and \"Blazing in the Gold and quenching in Purple\" as \"Sunset\".", "The poem \"I taste a liquor never brewed\u00a0\u2013\" is an example of the edited versions; the last two lines in the first stanza were completely rewritten.", "In 1864, several poems were altered and published in \"Drum Beat\", to raise funds for medical care for Union soldiers in the war.", "Another appeared in April 1864 in the \"Brooklyn Daily Union\".", "In the 1870s, Higginson showed Dickinson's poems to Helen Hunt Jackson, who had coincidentally been at the Academy with Dickinson when they were girls." ], [ "Emily Dickinson", "Emily Dickinson\n\nEmily Elizabeth Dickinson (December 10, 1830\u00a0\u2013 May 15, 1886) was an American poet.", "Dickinson was born in Amherst, Massachusetts into a prominent family with strong ties to its community.", "After studying at the Amherst Academy for seven years in her youth, she briefly attended the Mount Holyoke Female Seminary before returning to her family's house in Amherst.", "Dickinson lived much of her life in reclusive isolation.", "Considered an eccentric by locals, she developed a noted penchant for white clothing and became known for her reluctance to greet guests or, later in life, to even leave her bedroom.", "Dickinson never married, and most friendships between her and others depended entirely upon correspondence.", "She was a recluse for the later years of her life.", "While Dickinson was a prolific private poet, fewer than a dozen of her nearly 1,800 poems were published during her lifetime.", "The work that was published during her lifetime was usually altered significantly by the publishers to fit the conventional poetic rules of the time.", "Her poems are unique for the era in which she wrote; they contain short lines, typically lack titles, and often use slant rhyme as well as unconventional capitalization and punctuation.", "Many of her poems deal with themes of death and immortality, two recurring topics in letters to her friends." ] ], "gold": "Emily Dickinson's poetry was first published in the journal Springfield Republican in 1858, while the poet's first poetry volume was published in November 1890, and her complete poetry collection wasn't first published until 1955 when scholar Thomas H. Johnson published The Poems of Emily Dickinson.", "prediction 1": "Emily Dickinson's poems were first published on May 15, 1886, after her younger sister Lavinia discovered the collection of nearly 1800 poems. Until Thomas H. Johnson published Dickinson's Complete Poems in 1955, Dickinson's poems were considerably edited and altered from their manuscript versions. Since 1890 Dickinson has remained continuously in print.", "prediction 2": "Emily Dickinson was an American poet whose work was first published in 1868. The work that was published during Dickinson's lifetime was usually altered significantly by the publishers to fit the conventional poetic rules of the time. Until Thomas H. Johnson published Dickinson's Complete Poems in 1955, Dickinson's poems were considerably edited and altered from their manuscript versions. Since 1890, Dickinson has remained continuously in print.", "prediction 3": "Emily Dickinson wrote approximately 1,800 poems. Her early poems were published in various venues. Her last public appearance was on May 15, 1886. Her first collection, The Complete Poems, was published in 1855.", "prediction 4": "Emily Dickinson's poems were first published in 1883, and her Complete Poems was first published in 1955.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,9]}", "start": 29, "end": 61 }, { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 356 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Emily Dickinson's first volume was published on 1890. A few of Dickinson's poems appeared in Samuel Bowles' \"Springfield Republican\" between 1858 and 1868. Thomas H. Johnson published Dickinson's Complete Poems in 1955, " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the order of the phoenix filmed?", "passages": [ [ "Harry Potter and the Order of the Phoenix (film)", "Michael Goldenberg, who was considered to pen the first film in the series, filled in and wrote the script.", "Rehearsals for \"Order of the Phoenix\" began on 27 January 2006, filming began on 7 February 2006 and finished at the start of December 2006.", "Filming was put on a two-month hiatus starting in May 2006 so Radcliffe could sit his A/S Levels and Watson could sit her GCSE exams.", "The film's budget was reportedly between GB\u00a375 and 100 million (US$150\u2013200 million).", "The largest budget of the other films in the series has been the \u00a375 million it cost to make \"Goblet of Fire\".", "Mark Day was the film editor, S\u0142awomir Idziak was the cinematographer, and Jany Temime was the costume designer.", "Choreographer Paul Harris, who had previously worked with David Yates several times, created a physical language for wand combat to choreograph the wand fighting scenes.", "Stuart Craig returned as set designer, having designed the first four films' sets.", "There were a number of notable new sets in this film.", "The atrium in the Ministry of Magic is over 200 feet in length, making it the largest and most expensive set built for the \"Potter\" film series to date." ], [ "Harry Potter and the Order of the Phoenix (film)", "Harry Potter and the Order of the Phoenix (film)\n\nHarry Potter and the Order of the Phoenix is a 2007 fantasy film directed by David Yates and distributed by Warner Bros. Pictures.", "It is based on J. K. Rowling's 2003 novel of the same name.", "The fifth instalment in the \"Harry Potter\" film series, it was written by Michael Goldenberg (making this the only film in the series not to be scripted by Steve Kloves) and produced by David Heyman and David Barron.", "The story follows Harry Potter's fifth year at Hogwarts as the Ministry of Magic is in denial of Lord Voldemort's return.", "The film stars Daniel Radcliffe as Harry Potter, alongside Rupert Grint and Emma Watson as Harry's best friends Ron Weasley and Hermione Granger.", "It is the sequel to \"Harry Potter and the Goblet of Fire\" and is followed by \"Harry Potter and the Half-Blood Prince\".", "Live-action filming took place in England and Scotland for exterior locations and Leavesden Film Studios in Watford for interior locations from February to November 2006, with a one-month break in June.", "Post-production on the film continued for several months afterwards to add in visual effects." ] ], "gold": "Harry Potter and the Order of the Phoenix is a 2007 fantasy film based on J. K. Rowling's 2003 novel of the same name. It is the fifth installment in the Harry Potter film series. Filming for Order of the Phoenix started on February 7, 2006 and finished at the start of December 2006", "prediction 1": "Harry Potter and the Order of the Phoenix is a 2007 fantasy film directed by David Yates and distributed by Warner Bros. Pictures, based on J. K. Rowling's 2003 novel of the same name. Rehearsals for the film began on 27 January 2006, filming began on 7 February 2006 and finished at the start of December 2006. Filming was put on a two-month hiatus starting in May 2006 so Radcliffe could sit his A/S Levels and Watson could sit her GCSE exams.", "prediction 2": "Harry Potter and the Order of the Phoenix is a 2007 British fantasy film directed by David Yates and distributed by Warner Bros. Pictures that is based on J. K. Rowling's 2003 novel of the same name. Filming began on 7 February 2006 and finished at the start of December 2006. Filming was put on a two-month hiatus starting in May 2006 so Radcliffe could sit his A/S Levels and Watson could sit her GCSE exams. Stuart Craig returned as set designer, having designed the first four films' sets.", "prediction 3": "Harry Potter and the Order of the Phoenix is a 2007 fantasy film directed by David Yates and distributed by Warner Bros. Pictures. Rehearsals for the film began on 27 January 2006, filming began on 7 February 2006 and finished at the start of December 2006. Filming was put on a two-month hiatus starting in May 2006 so Radcliffe could sit his A/S Levels and Watson could sit her GCSE exams.", "prediction 4": "Harry Potter and the Order of the Phoenix is a 2007 fantasy film directed by David Yates and distributed by Warner Bros. Pictures based on J. K. Rowling's 2003 novel of the same name. Filming for the film took place from February to November 2006, with a one-month break in June. Rehearsals for the film began on 27 January 2006, filming began on 7 February 2006 and finished at the start of December 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 312, "end": 445 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Harry Potter and the Order of the Phoenix is a 2007 fantasy film based on J. K. Rowling's 2003 novel of the same name. It is the fifth installment in the Harry Potter film series. Filming began on 7 February 2006 and finished at the start of December 2006. " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who narrates the murders in the rue morgue?", "passages": [ [ "The Murders in the Rue Morgue", "The two share rooms in a dilapidated old mansion and allow no visitors, having cut off all contact with past acquaintances and venturing outside only at night.", "\"We existed within ourselves alone,\" the narrator states.", "One evening, Dupin demonstrates his analytical prowess by deducing the narrator's thoughts about a particular stage actor, based on clues gathered from the narrator's previous words and actions.", "During the remainder of that evening and the following morning, Dupin and the narrator read with great interest the newspaper accounts of a baffling double murder.", "Madame L'Espanaye and her daughter have been found dead at their home in the Rue Morgue, a fictional street in Paris.", "The mother was found in a yard behind the house, with multiple broken bones and her throat so deeply cut that her head fell off when the body was moved.", "The daughter was found strangled to death and stuffed upside down into a chimney.", "The murders occurred in a fourth-floor room that was locked from the inside; on the floor were found a bloody straight razor, several bloody tufts of gray hair, and two bags of gold coins.", "Several witnesses reported hearing two voices at the time of the murder, one male and French, but disagreed on the language spoken by the other.", "The speech was unclear, and all witnesses claimed not to know the language they believed the second voice to be speaking." ], [ "The Murders in the Rue Morgue", "The Murders in the Rue Morgue\n\n\"The Murders in the Rue Morgue\" is a short story by Edgar Allan Poe published in \"Graham's Magazine\" in 1841.", "It has been recognized as the first modern detective story; Poe referred to it as one of his \"tales of ratiocination\".", "C. Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women.", "Numerous witnesses heard a suspect, though no one agrees on what language was spoken.", "At the murder scene, Dupin finds a hair that does not appear to be human.", "As the first fictional detective, Poe's Dupin displays many traits which became literary conventions in subsequent fictional detectives, including Sherlock Holmes and Hercule Poirot.", "Many later characters, for example, follow Poe's model of the brilliant detective, his personal friend who serves as narrator, and the final revelation being presented before the reasoning that leads up to it.", "Dupin himself reappears in \"The Mystery of Marie Rog\u00eat\" and \"The Purloined Letter\".", "The unnamed narrator of the story opens with a lengthy commentary on the nature and practice of analytical reasoning, then describes the circumstances under which he first met Dupin during an extended visit to Paris." ] ], "gold": "The Murders in the Rue Morgue by Edgar Allen Poe, is considered the first modern detective story. It involves a man in Paris named C. Auguste Dupin, who solves the mystery of the brutal murder of two women. Dubin's friend serves as the unnamed narrator.", "prediction 1": "The Murders in the Rue Morgue is a short story by Edgar Allan Poe published in \"Graham's Magazine\" in 1841. It has been recognized as the first modern detective story. C. Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women. Numerous witnesses heard a suspect, though no one agrees on the language spoken by the other.", "prediction 2": "The Murders in the Rue Morgue is a short story by Edgar Allan Poe published in \"Graham's Magazine\" in 1841. In the story, Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women. Numerous witnesses heard a suspect, though no one agrees on the language spoken by the other. The narrator of the story is an unnamed man named Auguste Le Brun, who describes his experiences as a student of Dupin'Espanaye, and the narrator is an unnamed man named Auguste Le Morgue.", "prediction 3": "The Murders in the Rue Morgue is a short story by Edgar Allan Poe published in Graham's Magazine in 1841. It has been recognized as the first modern detective story; Poe referred to it as one of his \"tales of ratiocination\". C. Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women. Numerous witnesses heard a suspect, though no one agrees on what language was spoken. The narrator of the story is an unnamed narrator.", "prediction 4": "The Murders in the Rue Morgue is a short story by Edgar Allan Poe published in \"Graham's Magazine\" in 1841. It has been recognized as the first modern detective story, and Poe referred to it as one of his \"tales of ratiocination\". C. Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women. Numerous witnesses heard a suspect, though no one agrees on what language was spoken.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 354 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Murders in the Rue Morgue is a short story by Edgar Allan Poe recognized as the first modern detective story. C. Auguste Dupin is a man in Paris who solves the mystery of the brutal murder of two women. Dubin's friend serves as the unnamed narrator." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where is going to be the next world cup in 2026?", "passages": [ [ "2026 FIFA World Cup", "2026 FIFA World Cup\n\nThe 2026 FIFA World Cup (; ) will be the 23rd FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA.", "The tournament will be jointly hosted by 16 cities in three North American countries; 60 matches, including the quarterfinals, semi-finals, and the final, will be hosted by the United States while neighboring Canada and Mexico will each host 10 matches.", "The tournament will be the first hosted by three nations.", "The United 2026 bid beat a rival bid by Morocco during a final vote at the 68th FIFA Congress in Moscow.", "It will be the first World Cup since South Korea/Japan in 2002 that will be hosted by more than one nation.", "With its past hosting of the 1970 and 1986 tournaments, Mexico will also become the first country to host or co-host three men's World Cups.", "The 2026 World Cup will also see the tournament expanded from 32 to 48 teams.", "Michel Platini, who was then the UEFA president, had suggested in October 2013 an expansion of the tournament to 40 teams, an idea that FIFA president Gianni Infantino also suggested in March 2016.", "A desire to increase the number of participants in the tournament from the previous 32 team format was announced on October 4, 2016." ], [ "United 2026 FIFA World Cup bid", "United 2026 FIFA World Cup bid\n\nUnited 2026 was a successful joint bid, led by the United States Soccer Federation, together with the Canadian Soccer Association and the Mexican Football Federation, to host the 2026 FIFA World Cup in the United States, Canada, and Mexico.", "While the soccer federations of Canada, Mexico, and the United States had individually announced plans to field a bid for the 2026 World Cup, the concept of a joint bid among the three North American countries was first proposed in 2016.", "The joint bid was officially unveiled on April 10, 2017, under which the tournament would be held at venues in all three countries.", "A shortlist of 23 candidate cities were named in the official bid, with 17 in the U.S., 3 in Canada, and 3 in Mexico.", "Ten U.S. candidate cities will join three Canadian candidate cities, and three Mexican candidate cities, to form the roster of 16 cities that will host the matches of this World Cup.", "Although a joint bid, the majority of the matches will be held in the United States.", "Canada and Mexico will host 10 matches each, while the United States will host the other 60, including all matches from the quarterfinals onward.", "On June 13, 2018, at the 68th FIFA Congress in Moscow, Russia, the United bid was selected by 134 votes to Morocco's 65, while Iran voted for neither." ] ], "gold": "The 2026 FIFA World Cup will be the 23rd FIFA World Cup, the quadrennial international men's soccer championship contested by the national teams of the member associations of FIFA. 60 matches will be held in the United States, Canada will host 10 events, and Mexico will also host 10 matches. ", "prediction 1": "The 2026 FIFA World Cup will be the 23rd FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The tournament will be jointly hosted by 16 cities in three North American countries, with the United States hosting 60 matches, including the quarterfinals, semi-finals, and the final.", "prediction 2": "The 2026 FIFA World Cup will be the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The tournament will be jointly hosted by 16 cities in three North American countries; 60 matches, including the quarterfinals, semi-finals, and the final, will be hosted by the United States while neighboring Canada and Mexico will each host 10 matches. The United 2026 bid beat a rival bid by Morocco during a final vote at the 68th FIFA Congress in Moscow.", "prediction 3": "The 2026 FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA, will be jointly hosted by 16 cities in three North American countries. 60 matches, including the quarterfinals, semi-finals, and the final, will be hosted by the United States while neighboring Canada and Mexico will each host 10 matches. Mexico will also become the first country to host or co-host three men's World Cups.", "prediction 4": "The 2026 FIFA World Cup will be the 23rd FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The tournament will be jointly hosted by 16 cities in three North American countries. 60 matches, including the quarterfinals, semi-finals, and the final, will be hosted by the United States while neighboring Canada and Mexico will each host 10 matches.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The 2026 FIFA World Cup will be the 23rd FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The tournament will be jointly hosted by 16 cities in three North American countries, with the United States hosting 60 matches, including the quarterfinals, semi-finals, and the final, while Canada and Mexico will host 10 matches each. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is clara on when calls the heart?", "passages": [ [ "When Calls the Heart", "When Calls the Heart\n\nWhen Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her \"Canadian West\" series, and developed by", "Michael Landon Jr.", "The series began airing on the Hallmark Channel in the United States on January 11, 2014, and on April 16, 2014 on Super Channel in Canada.", "The series originally debuted as a two-hour television movie pilot in October 2013, starring Maggie Grace as young teacher Elizabeth Thatcher and Stephen Amell as North West Mounted Police officer Wynn Delaney.", "In the television series Erin Krakow is cast as her niece, whose name is also Elizabeth Thatcher (played by Poppy Drayton in the movie), and Daniel Lissing plays a Mountie named Jack Thornton, with Lori Loughlin reprising her role as coal mine widow Abigail Stanton.", "On April 24, 2017, Krakow announced via the Hallmark Channel website that the show would return for a fifth season, which premiered with a two-hour Christmas special broadcast as part of Hallmark's \"Countdown to Christmas\" event and resumed in February 2018, ending in April.", "On March 21, 2018, Hallmark renewed the series for a sixth season.", "A spin off of the show named \"When Hope Calls\" was announced at Hallmark's Television Critics Association summer press tour on July 26, 2018." ] ], "gold": "When Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her Canadian West series. The character of Clara on When Calls the Heart is the widow of Abigail Stanton's son Peter Stanton. She is portrayed by actress Eva Bourne.", "prediction 1": "When Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her Canadian West series, and developed by Michael Landon Jr. The series began airing on the Hallmark Channel in the United States on January 11, 2014, and on April 16, 2014 on Super Channel in Canada. Erin Krakow is cast as her niece, whose name is also Elizabeth Thatcher and Daniel Lissing plays a Mountie named Jack Thornton. Lori Loughlin reprised her role as coal mine widow Abigail Stanton. On April 24, 2017, Hallmark renewed the series for a sixth season. On March 21, 2018, Hallmark renewed the series for a sixth season.", "prediction 2": "Clara is a fictional character on the television show When Calls the Heart. Erin Krakow plays the role of Clara Thatcher's niece on the show.", "prediction 3": "When Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her Canadian West series, and developed by Michael Landon Jr. The series began airing on the Hallmark Channel in the United States on January 11, 2014, and on April 16, 2014 on Super Channel in Canada.", "prediction 4": "When Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her Canadian West series, and developed by Michael Landon Jr. The series began airing on the Hallmark Channel in the United States on January 11, 2014, and on April 16, 2014 on Super Channel in Canada. Erin Krakow is cast as her niece, whose name is also Elizabeth Thatcher.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 323 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 451 }, { "error type": "Irrelevant", "explanation": "", "start": 452, "end": 519 }, { "error type": "Irrelevant", "explanation": "", "start": 520, "end": 586 }, { "error type": "Irrelevant", "explanation": "", "start": 587, "end": 653 } ], "missing-info": [], "corrected-prediction": "When Calls the Heart is a Canadian-American television drama series, inspired by Janette Oke's book of the same name from her Canadian West series. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Which is a new team that has been added to the suncorp super netball?", "passages": [ [ "Suncorp Super Netball", "Suncorp Super Netball\n\nSuncorp Super Netball (also known non-commercially as the National Netball League) is the premier netball league in Australia.", "The inaugural season commenced in February 2017.", "In 2008, Netball Australia and Netball New Zealand joined forces and created a Trans-Tasman league, the ANZ Championship as a successor to the Commonwealth Bank Trophy in Australia and the National Bank Cup in New Zealand, both of which were retired after 2007.", "The ANZ Championship saw netball become a semi-professional sport in both countries, with increased media coverage and player salaries.", "The 2016 season was the last of the competition, as Netball Australia looked to create a nationally exclusive league with a significantly improved broadcasting and media deal.", "This instigated the creation of Suncorp Super Netball, announced in May 2016.", "The New Zealand successor to the previous ANZ Championship is the ANZ Premiership.", "The new league consists of the five former Australian ANZ Championship teams; the Adelaide Thunderbirds, Melbourne Vixens, NSW Swifts, Queensland Firebirds and West Coast Fever, in addition to three new teams, the Collingwood Magpies, Giants Netball and Sunshine Coast Lightning.", "GIANTS Netball are owned and operated by Netball NSW, and the two other new teams are owned and operated by two clubs in the popular Australian Football League and National Rugby League football codes." ] ], "gold": "Suncorp Super Netball is the top level netball league featuring teams from Australia. The Sunshine Coast Lightning is a new team from Queensland that was added in 2016. Giants Netball from Sidney and the Collingwood Magpies from Melbourne were also added. ", "prediction 1": "The new Netball league, also known non-commercially as the National Netball League, is the premier netball league in Australia. Suncorp Super Netball has three new teams. There are the Collingwood Magpies, Giants Netball and Sunshine Coast Lightning.", "prediction 2": "Suncorp Super Netball is the premier netball league in Australia. Three new teams have been added to the league, namely the Collingwood Magpies, Giants Netball and Sunshine Coast Lightning.", "prediction 3": "Suncorp Super Netball is the premier netball league in Australia. The inaugural season commenced in February 2017. In addition to the five new Australian ANZ Championship teams, there are three new teams joining the league. These are the Collingwood Magpies, Giants Netball and Sunshine Coast Lightning.", "prediction 4": "Suncorp Super Netball is the premier netball league in Australia. In 2018, Netball Australia and Netball New Zealand joined forces and created a Trans-Tasman league, the ANZ Championship as a successor to the Commonwealth Bank Trophy in Australia and the National Bank Cup in New Zealand, both of which were retired after 2007. The 2016 season was the last of the competition, as Netball Australia looked to create a nationally exclusive league with a significantly improved broadcasting and media deal, this instigated the creation of Suncorp Super Netball.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 83 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 0, "end": 23 } ], "missing-info": [], "corrected-prediction": "Suncorp Super Netball league is the premier netball league in Australia. Suncorp Super Netball has three new teams. They are the Collingwood Magpies, Giants Netball and Sunshine Coast Lightning." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When is wynonna earp season 2 coming out?", "passages": [ [ "Wynonna Earp (TV series)", "\"Wynonna Earp\" premiered in the United Kingdom on Spike on July 29, 2016, at 9:00\u00a0p.m.", "The series premiered in Australia on Spike on February 5, 2017.", "In the UK, Season 2 premiered on Spike on June 13, 2017, at 10:00\u00a0p.m. Season 3 premiered on 5Spike on July 27, 2018, at 10:00\u00a0p.m.", "The series is distributed internationally on Netflix.", "\"Wynonna Earp\" became available on Amazon Video as video on demand on May 6, 2016.", "In December 2016, SEVEN24 Films producer Jordy Randall announced in an interview with the \"Calgary Herald\" that Season 1 would be streaming on Netflix.", "The series became available on Netflix in the United States on April 1, 2017; and in Canada on April 5, 2017.", "The Season 1 DVD for Region 4 and Blu-ray for Region B were released first in Australia by Roadshow Entertainment on May 3, 2017.", "The Season 2 DVD was released in Region 4 and the Blu-ray in Region B by Roadshow Entertainment on November 1, 2017.", "A crowdfunding campaign for a region free Blu-ray release was launched on May 23, 2017, by IDW Entertainment on Indiegogo." ], [ "Wynonna Earp (TV series)", "Space announced on the same day that it had ordered 12 episodes for a third season, together with Syfy.", "Andras credited \"Wynonna Earp\"'s passionate fan base (nicknamed \"Earpers\") with gaining the renewal.", "Season 3 debuted with a special preview on July 16, before its official premiere on Syfy and Space on July 20, 2018.", "On July 21, 2018, the renewal by Syfy and Space for a fourth season was announced at SDCC.", "The season will comprise 12 episodes and is scheduled to premiere in 2019.", "Wynonna Earp, the great-great-granddaughter of legendary lawman Wyatt Earp, battles revenants, the reincarnated outlaws that Wyatt killed.", "She also fights other supernatural beings that inhabit the Ghost River Triangle, a cursed territory near the Canadian Rockies that includes Purgatory, her home town.", "Upon her 27th birthday, Wynonna inherited the special power to return revenants to Hell with her ancestor's 16-inch barrel special \"Peacemaker\" revolver.", "She is recruited by the Black Badge Division (BBD), a secret government agency led by Special Agent Xavier Dolls which eventually includes an ageless Doc Holliday and Wynonna's sister, Waverly Earp." ], [ "Wynonna Earp (TV series)", "Wynonna Earp (TV series)\n\nWynonna Earp ( ) is a supernatural Western horror television series.", "Developed by Emily Andras, the Canadian-American production is based on the comic book series by Beau Smith.", "Melanie Scrofano plays the series' titular character.", "\"Wynonna Earp\" premiered in the United States on Syfy on April 1, 2016.", "The series premiered in Canada on CHCH-DT on April 4.", "On July 23, 2016, the renewal for a second season was announced at the \"Wynonna Earp\" panel at San Diego Comic-Con (SDCC).", "Originally slated for ten episodes, the season was increased to 12 episodes in October 2016.", "In Canada, \"Wynonna Earp\" moved from CHCH-DT to Space effective April 15, 2017.", "In anticipation of the premiere of Season 2, Space began airing Season 1 on the same date with a special double-episode series debut.", "Season 2 premiered simultaneously on Syfy and Space on June 9, 2017.", "On July 22, 2017, David Ozer, president of IDW Entertainment, announced at the show's SDCC panel that the series had been renewed for a third season with the premiere scheduled for 2018." ] ], "gold": "Wynonna Earp is a supernatural Western horror television series developed by Emily Andras, the Canadian-American program and based on the comic book series by Beau Smith. On July 23, 2016, the renewal for a second season was announced at the Wynonna Earp panel at San Diego Comic-Con. Season 2 began filming in Calgary and surrounding areas from December 12, 2016, to April 13, 2017, with additional location shooting taking place in Springbank, Alberta. Season 2 premiered on June 9, 2017, on Syfy and Space in the US, and on June 13, 2017, at 10:00 p.m. on Spike in the UK.", "prediction 1": "Wynonna Earp is a supernatural Western horror television series based on the comic book series by Beau Smith. Season 1 of the show premiered in the United Kingdom on Spike on July 29, 2016. Season 2 of the show premiered in the United States on Syfy on April 1, 2017.", "prediction 2": "Wynonna Earp is a supernatural Western horror television series based on the comic book series by Beau Smith. Season 2 was released simultaneously on Syfy and Space on June 9, 2017. Season 3 was released in Australia on 5Spike on July 27, 2018.", "prediction 3": "Wynonna Earp is a supernatural Western horror television series created by Emily Andras that is based on the comic book series of the same name by Beau Smith. Season 2 of the series came out in the United States on June 9, 2017, and in Canada on July 20, 2018. Season 3 came out in the United Kingdom on Spike on June 13, 2017 and in Australia on Spike on February 5, 2017.", "prediction 4": "Wynonna Earp is a supernatural horror television series, which is based on the comic book series Wyatt Earp and is based on the supernatural world of the Ghost River Triangle near the Canadian Rockies. Season 2 premiered simultaneously on Syfy and Space on June 9, 2017. Season 3 premiered on 5Spike on July 27, 2018, at 10:00 p.m. Season 4 premiered on Syfy and Space on May 10, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 189 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 253, "end": 267 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Wynonna Earp is a supernatural Western horror television series developed by Emily Andras, the Canadian-American production is based on the comic book series by Beau Smith. On July 23, 2016, the renewal for a second season was announced at the \"Wynonna Earp\" panel at San Diego Comic-Con. Season 2 of the show premiered in the United States on Syfy and Space on June 9, 2017. In the UK, Season 2 premiered on Spike on June 13, 2017, at 10:00 p.m." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the idea of cats having nine lives come from?", "passages": [ [ "Cat", "The French kings often witnessed these spectacles and even lit the bonfire with their own hands.", "In 1648 Louis XIV, crowned with a wreath of roses and carrying a bunch of roses in his hand, kindled the fire, danced at it and partook of the banquet afterwards in the town hall.", "But this was the last occasion when a monarch presided at the midsummer bonfire in Paris.", "At Metz midsummer fires were lighted with great pomp on the esplanade, and a dozen cats, enclosed in wicker cages, were burned alive in them, to the amusement of the people.", "Similarly at Gap, in the department of the Hautes-Alpes, cats used to be roasted over the midsummer bonfire.\"", "According to a myth in many cultures, cats have multiple lives.", "In many countries, they are believed to have nine lives, but in Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six.", "The myth is attributed to the natural suppleness and swiftness cats exhibit to escape life-threatening situations.", "Also lending credence to this myth is the fact that falling cats often land on their feet, using an instinctive righting reflex to twist their bodies around.", "Nonetheless, cats can still be injured or killed by a high fall." ] ], "gold": "The idea of cats having nine lives is based on the natural suppleness and swiftness cats exhibit to escape life-threatening situations and the fact that falling cats often land on their feet. This idea has taken root in many countries, although, not in Italy, Germany, Greece, Brazil and some Spanish-speaking regions, Turkish and Arabic Traditions.", "prediction 1": "In many countries, they are believed to have nine lives. In Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six.", "prediction 2": "The idea of cats having nine lives comes from the belief that cats have multiple lives. In many countries, they are believed to have nine lives, but in Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six.", "prediction 3": "The idea of cats having nine lives is a myth in many cultures. In many countries, they are believed to have nine lives, but in Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six.", "prediction 4": "The idea of cats having nine lives came from an Irish myth. In many countries, they are believed to have nine lives, but in Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six. The myth is attributed to the natural suppleness and swiftness cats exhibit to escape life-threatening situations.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The idea of cats having nine lives is based on the natural suppleness and swiftness cats exhibit to escape life-threatening situations and the fact that falling cats often land on their feet. In many countries, they are believed to have nine lives. In Italy, Germany, Greece, Brazil and some Spanish-speaking regions, they are said to have seven lives, while in Turkish and Arabic traditions, the number of lives is six." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played roy disney in walt before mickey?", "passages": [ [ "Walt Before Mickey", "Walt Before Mickey\n\nWalt Before Mickey is an independent 2015 biographical drama film about the early years of Walt Disney and the book \"Walt Before Mickey: Disney's Early Years, 1919\u20131928\" by Timothy S. Susanin, with a foreword written by Diane Disney.", "The film stars Thomas Ian Nicholas as Walt Disney, Armando Gutierrez as Ub Iwerks, and Jon Heder as Roy Disney.", "The film covers Walt Disney's early years in business, during which he started various businesses including Laugh-O-Gram Studio and The Walt Disney Company with fellow animator Ub Iwerks and Roy Disney.", "The film is narrated periodically by Walt Disney.", "At the age of thirteen, he develops a love for animation and film.", "In 1919, after returning from his time with the Red Cross, Walt moves in with his older brother Roy and his girlfriend Edna, in Kansas City.", "Roy later moves to California, staying in a veterans hospital to deal with tuberculosis.", "Walt is hired as an artist at Pesmen-Rubin Commercial Art Studio, meeting Ub Iwerks.", "However, Walt and Iwerks are made redundant weeks after when the company's revenue declines.", "Walt and Iwerks found their own business, Iwerks-Disney Commercial Artists, located in an old barn." ] ], "gold": "In the 2015 film \"Walt before Mickey\" the role of adult Roy Disney, Walt Disney's older brother, was played by Jon Heder, while the younger Roy was played by Noah Forgione.", "prediction 1": "In the 2015 film Walt Before Mickey, the character of Roy Disney is played by Jon Heder.\n", "prediction 2": "Peter Boyd played Roy Disney in the 2015 film Walt Before Mickey.", "prediction 3": "In the 2015 film Walt Before Mickey, Roy Disney was played by Jon Heder.", "prediction 4": "The film Walt Before Mickey is a 2015 independent biographical drama film starring Jones, Jon Heder, and Armando Gutierrez. Such as Ron Perlman as Roy Disney, the role is played by Gerard Mendes.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In the 2015 film Walt Before Mickey, the character of Roy Disney is played by Jon Heder. Roy is Walt Disney's older brother.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays the science teacher in captain underpants?", "passages": [ [ "Captain Underpants", "Captain Underpants\n\nCaptain Underpants is a children's novel series by American author and illustrator Dav Pilkey.", "The series revolves around two fourth graders, George Beard and Harold Hutchins, living in Piqua, Ohio, and Captain Underpants, an aptly named superhero from one of the boys' homemade comic books, that accidentally becomes real when George and Harold hypnotize their ill-tempered principal, Mr. Krupp.", "Soon after, Krupp gains superpowers by drinking alien juices in the third book.", "The series includes 12 books and three spin-offs, and won a Disney Adventures Kids' Choice Award on April 4, 2006.", "As of 2016, the series had been translated into over 30 languages, with more than 80 million books sold worldwide, including over 50 million in the United States.", "DreamWorks Animation acquired rights to the series to make an animated feature , which was released on June 2, 2017 to positive reviews.", "After the main series concluded with the twelfth novel, \"Captain Underpants and the Sensational Saga of Sir Stinks-A-Lot\", in 2015, a spin-off series titled \"Dog Man\" was released the following year.", "Currently the spin-off series has five books." ], [ "Captain Underpants: The First Epic Movie", "To prevent these issues, the boys take him to their treehouse, where they discover that they can turn Captain Underpants back into Mr. Krupp by splashing water on him and can turn him back into Captain Underpants by snapping their fingers.", "Knowing that Mr. Krupp will continue trying to separate them, they decide to settle with Captain Underpants but insist that he be dressed up as Mr. Krupp under the pretense of a \"secret identity\", to which Captain Underpants agrees.", "His sudden personality change even manages to attract the attention (and affection) of the school's shy lunch lady, Edith (Kristen Schaal).", "Just when George and Harold believe that their troubles have ended, Jerome Horwitz Elementary School is visited by an odd, German-accented scientist named Professor Pee-Pee Diarrheastein Poopypants Esq.", "(Nick Kroll), or as he calls himself, Professor P. Captain Underpants (disguised as Mr. Krupp) hires him to be the new science teacher, but George and Harold are suspicious of him due to his violent and short-tempered attitude, as well as his r\u00e9sum\u00e9's content." ], [ "Captain Underpants and the Perilous Plot of Professor Poopypants", "The two of them try to enlarge the school back to normal size, but get flicked off the school.", "Harold makes a paper airplane that George enlarges and after many dangers, Underpants rescues them.", "George enlarges Underpants to the gerbil's size, then he defeats Professor Poopypants and everyone's names revert.", "The boys use the machines to bring the school and Captain Underpants back to normal size.", "Captain Underpants is soaked with water, turning him back into Mr. Krupp.", "Professor Poopypants is hauled off to jail and from George and Harold, he changes his name so that no one will make fun of it anymore.", "Unfortunately, he changes his name to his grandfather's, Tippy Tinkletrousers, that which makes the prisoners ridicule him even more.", "Authors:\n\nDav Pilkey and Captain Underpants.", "The book that followed this was The Wicked Wedgie Woman (2001).", "The Book received mainly positive reviews from critics, making the villain, Professor Poopypants, appear in later Books of the series as both a recurring character, or even the main villain.", "The book was removed from an elementary school in Page, North Dakota due to parental complaints." ] ], "gold": "Captain Underpants is an illustrated children's novel series by David Pilkey, that revolves around fourth-graders, George Beard and Harold Hutchins, and Captain Underpants, an aptly named superhero from one of the boys' homemade comic books, which DreamWorks Animation acquired the rights to, to create an animated feature film adaptation, released June 2017, and a Netflix television series, released July 2018. In the story, Mr. Fyde was the dorky science teacher at Jerome Horwitz Elementary School, who, after the events of the first three books, gradually believes himself to be insane and resign from his job. In the film, he is voiced by Mel Rodriguez and in the series he is voiced by Stephen Root. Tippy Tinkletrousers, formerly known as Professor Pippy Pee-Pee Poopypants, and in the film as Prof. Pee-Pee Diarrheastien Poopypants Esq., is the replacement science teacher in Captain Underpants, and is voiced by Nick Kroll in the film.", "prediction 1": "Captain Underpants is a children's novel series by American author and illustrator Dav Pilkey. The series revolves around two fourth graders, George Beard and Harold Hutchins, living in Piqua, Ohio, and Captain Underpants, a superhero from one of the boys' homemade comic books, that accidentally becomes real when George and Harold hypnotize their ill-tempered principal, Mr. Krupp. When George and Harold learn that they can turn Captain Underpants back into Mr. Krupp by splashing water on him and can turn him back into Captain Underpants by snapping their fingers. When they decide to settle with him under the pretense of a \"secret identity\", to which Captain Underpants agrees. After the main series concluded with the twelfifiz and the Sensational Saga of Sir Stinks-A-Lot, in 2015,", "prediction 2": "Captain Underpants is a children's novel series by American author and illustrator Dav Pilkey. The series revolves around two fourth graders, George Beard and Harold Hutchins, living in Piqua, Ohio, and Captain Underpants, an aptly named superhero from one of the boys' homemade comic books, that accidentally becomes real when George and Harold hypnotize their ill-tempered principal, Mr. Krupp. Captain Underpants disguised as Mr. Krupp is played by Nick Kroll in Captain Underpants: The First Epic Movie.", "prediction 3": "Captain Underpants is a children's novel series by American author and illustrator Dav Pilkey, which revolves around two fourth graders, George Beard and Harold Hutchins, and Captain Underpants, an aptly named superhero from one of the boys' homemade comic books, that accidentally becomes real when George and Harold hypnotize their ill-tempered principal, Mr. Krupp. In the 12th book, Captain Underpants is disguised as Mr. Krupp and Mr. Krupp is played by Nick Kroll, and in the 3rspin-off series, in the 2017 titled \"Dog Man\" is a spin-off of the series, which has 5 books in the series.", "prediction 4": "Captain Underpants is a children's novel series created by American author and illustrator Dav Pilkey that revolves around two fourth graders, George Beard and Harold Hutchins. In the series, Captain Underpants hires a German-accented scientist, Professor Pee-Pee Diarrheastein Poopypants, as the Science Teacher, in Jerome Horwitz Elementary School. Professor Poopypants is played by Nick Kroll in the first five books of the series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 383 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 569 }, { "error type": "Irrelevant", "explanation": "", "start": 570, "end": 684 }, { "error type": "Irrelevant", "explanation": "", "start": 685, "end": 790 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Captain Underpants is a children's novel series by Dav Pilkey. The series revolves around two fourth graders, George Beard and Harold Hutchins, and Captain Underpants, a superhero from one of the boys' homemade comic books. DreamWorks Animation acquired rights to the series to make an animated feature , which was released on June 2, 2017. Professor Pee-Pee Diarrheastein Poopypants Esq. was hired to be the science teacher and is played by Nick Kroll. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays billy murphy in the young offenders?", "passages": [ [ "The Young Offenders (TV series)", "The Young Offenders (TV series)\n\n", "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott, for RT\u00c92 and BBC Three.", "Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018, to generally favourable reviews.", "The show stars Alex Murphy and Chris Walley as the main characters, reprising their roles of Conor MacSweeney and Jock O'Keefe from the film, respectively, with supporting roles featured from Hilary Rose, Dominic MacHale, P. J. Gallagher, Jennifer Barry, Demi Isaac Oviawe and Shane Casey.", "Prior to the successful six-episode first series coming to an end, the programme was recommissioned for a second series.", "The series follows the adventurous and criminalized lives of Cork-based teenagers Conor MacSweeney (Alex Murphy) and Jock O'Keefe (Chris Walley).", "The first series sees the boys' feud with their principal Barry Walsh (P. J. Gallagher), and their relationships with his daughters, Jock with Siobhan (Jennifer Barry) and Conor with Linda (Demi Isaac Oviawe)." ], [ "Shane Casey", "Shane Casey\n\nShane Casey (born 1989) is an Irish sportsperson.", "He plays hurling with his local club Dunhill and with the Waterford senior inter-county team.", "Casey has played with this local club, Dunhill since underage and presently plays with the club in the Waterford Intermediate Hurling Championship and the Waterford Intermediate Football Championship.", "At underage, Casey played with the amalgamation club Dunhill/Fenor.", "At inter-county level, Casey plays with Waterford.", "Casey made his championship debut on 26 July 2009 having been named in the team to face Galway in the 2009 All-Ireland quarter-final.", "Casey also presently plays with the Waterford under-21 team.", "Casey will feature in the team to face Clare in the Munster Under-21 Hurling Final on 29 July 2009.", "Casey also played the role of Kevin in the P'alm D'Or award winning film The Wind That Shakes the Barley (2006).", "
" ] ], "gold": "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott, for RT\u00c9 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018, to generally favourable reviews. Shane Casey is an Irish actor and playwright. He is best known for playing the role of Billy Murphy in The Young Offenders (film) and The Young Offenders (TV).", "prediction 1": "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott for RT\u00c92 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018. The show stars Alex Murphy and Chris Walley as the main characters, reprising their roles of Conor MacSweeney and Jock O'Keefe from the film, respectively. Supporting roles featured from Hilary Rose, Dominic MacHale, P. J. Gallagher, Jennifer Barry, Demi Isaac Oviawe and Shane Casey.", "prediction 2": "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott, for RT\u00c92 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018, to generally favourable reviews. The show stars Alex Murphy and Chris Walley as the main characters, reprising their roles of Conor MacSweeney and Jock O'Keefe from the film, respectively. Shane Casey plays Billy Murphy in the television sitcom.", "prediction 3": "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott, for RT\u00c92 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018. The show stars Alex Murphy and Chris Walley as the main characters, reprising their roles of Conor MacSweeney and Jock O'Keefe from the film, respectively. Supporting roles featured from Hilary Rose, Dominic MacHale, Demi Isaac Oviawe and Shane Casey.", "prediction 4": "The Young Offenders is an Irish coming-of-age television sitcom developed by Peter Foott for RT\u00c92 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018, to generally favourable reviews. The show stars Alex Murphy and Chris Walley as the main characters, reprising their roles of Conor MacSweeney and Jock O'Keefe from the film, respectively. The supporting roles featured from Hilary Rose, Dominic MacHale, Jennifer Barry, Demi Isaac Oviawe and Shane Casey.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 508 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Young Offenders is an Irish coming-of-age television sitcom, developed by Peter Foott for RT\u00c92 and BBC Three. Based on the IFTA-winning 2016 film of the same name, the first series began broadcasting on 1 February 2018, to generally favourable reviews. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did the smoking ban came into the uk?", "passages": [ [ "Smoking in the United Kingdom", "Until 31 August 2008, the minimum age to purchase and consume tobacco products in public was 16 years of age.", "From 1 September 2008 the Children and Young Persons (Sale of Tobacco etc.)", "Regulations (Northern Ireland) 2008 became effective, raising the minimum purchase, consumption and possession age to 18 years of age.", "Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England, \n\nOn 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England.", "With the ban coming into effect in small retailers three years later on 6 April 2015.", "In March 2011, the Conservative-Lib Dem coalition government committed itself to holding a public consultation on the introduction of plain tobacco packaging.", "Influenced by the introduction of plain packaging in Australia, the House of Commons voted 367\u2013113 in March 2015 to pass the Children and Families Act 2014 which would give the government the power to require plain packaging for tobacco products.", "This came into force on 20 May 2016, but tobacco companies were given one year to sell off remaining stock; in which afterwards, all tobacco products sold in the UK must follow plain packaging laws.", "On October 1, 2015 a law was passed which banned smoking in vehicles with anyone under eighteen years of age present." ], [ "Smoking ban in England", "Smoking ban in England\n\nA smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006.", "Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007.", "Before the ban many businesses voluntarily introduced bans on smoking mainly as a result of public feedback.", "The pub chain Wetherspoons was the first major chain to introduce a complete ban on indoor smoking, doing so in May 2006.", "Tobacco advertising had been banned in England gradually starting with a ban on Television Advertising of cigarettes in 1965 to a complete ban on all Tobacco Advertising in 2005.", "On 16 November 2004 a Public Health white paper proposed a smoking ban in almost all public places in England and Wales.", "Smoking restrictions would be phased in, with a ban on smoking in NHS and government buildings by 2006, in enclosed public places by 2007, and pubs, bars and restaurants (except pubs not serving food) by the end of 2008.", "On 26 October 2005, after external challenge and debates within the Cabinet, the government announced that it would continue with its plans." ], [ "Smoking in the United Kingdom", "The law does not apply to e-cigarettes, if the driver is seventeen years of age and alone in the vehicle or in a convertible with the roof completely down.", "Despite the name, 'e-cigarette,' these devices contain no tobacco and produce no smoke, and therefore any reference to them, should be under e-cigarettes and not smoking.", "Exceptions to this might be their role as an alternative to smoking, or as devices where it increasingly looks like they are helping young people avoid smoking.", "On 2 April 2014 the Welsh Government published a public health white paper in which it proposed a ban on the use of e-cigarettes in public spaces.", "The Bill was subsequently defeated.", "The annual Smokefree GB survey, published in May 2017, concluded that 52% of the 2.9 million British e-cigarette users are now ex-smokers.", "26% of respondents thought e-cigarettes were as harmful as real cigarettes.", "In March 2017, it was reported by The Telegraph UK's e-cigarette boom is on a decline, with the number of people using e-cigarettes in Britain decreasing for the first time since their launch." ] ], "gold": "A smoking ban in England, making it illegal to smoke in all enclosed public space and workplaces, came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007. On 1 October 2015, a law was passed which banned smoking in vehicles with anyone under eighteen years of age present. The law does not apply to e-cigarettes, if the driver is seventeen years of age and alone in the vehicle, or in a convertible with the roof completely down.", "prediction 1": "The smoking ban in the United Kingdom, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007. Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England. On 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England. With the ban coming into effect in small retailers three years later on 6 April 2015. On October 1, 2015 a law was passed which banned smoking in vehicles with anyone under 18 years of age present.", "prediction 2": "A smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England. On 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England. With the ban coming into effect in small retailers three years later on 6 April 2015, a law was passed which banned smoking in vehicles with anyone under eighteen years of age present.", "prediction 3": "The smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans have already been introduced in Scotland and Wales, and in Northern Ireland, as well. On 16 November 2004 a Public Health white paper proposed a smoking ban in almost all public places in England and Wales. The smoking restrictions would be phased in, with a ban on smoking in NHS and government buildings by 2006, in enclosed public places by 2007 and pubs, bars and restaurants, by the end of 2014.", "prediction 4": "The smoking ban came into force on 1 July 2007 in England. The law made it illegal to smoke in all enclosed work places in England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 437, "end": 522 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The smoking ban in the United Kingdom, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006. Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England. On October 1, 2015 a law was passed which banned smoking in vehicles with anyone under 18 years of age present. The law does not apply to e-cigarettes, if the driver is seventeen years of age and alone in the vehicle or in a convertible with the roof completely down." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where will the next summer olympic games be held?", "passages": [ [ "Summer Olympic Games", "The other countries that have hosted the Summer Olympics are Belgium, Brazil, China, Canada, Finland, Italy, Mexico, Netherlands, South Korea, Spain, Soviet Union, and Sweden; each of these countries has hosted the Summer Games on just one occasion.", "Asia has hosted the Summer Olympics three times, in Tokyo, Japan (1964), Seoul, South Korea (1988), and Beijing, China (2008); Asia will host the Games for a fourth time in 2020 when Tokyo again becomes host city.", "Historically, the Summer Olympics has been held predominantly in English-speaking countries and European nations.", "Tokyo will be the first city outside these regions to have hosted the Summer Olympics twice; it will also be the largest city ever to have hosted the Games, having grown considerably since 1964.", "The 2016 Games in Rio de Janeiro, Brazil, were the first Summer Olympics to be held in South America and the first that were held during the local winter season.", "The only two countries in the Southern Hemisphere to have hosted the Summer Olympics have been Australia (1956, 2000) and Brazil (2016).", "Africa has yet to host a Summer Olympics.", "Stockholm, Sweden, has hosted events at two Summer Olympic Games, having been sole host of the 1912 Games, and hosting the equestrian events at the 1956 Summer Olympics (which they are credited as jointly hosting with Melbourne, Australia)." ], [ "2016 Summer Olympics", "2016 Summer Olympics\n\nThe 2016 Summer Olympics (), officially known as the Games of the XXXI Olympiad and commonly known as Rio 2016, was an international multi-sport event that was held from 5 to 21 August 2016 in Rio de Janeiro, Brazil, with preliminary events in some sports beginning on 3 August.", "These were the first Olympic Games ever to be held in South America and the third to be held in a developing country, after the 1968 games in Mexico City and the 1988 games in Seoul, South Korea.", "More than 11,000 athletes from 205 National Olympic Committees, including first time entrants Kosovo, South Sudan, and the Refugee Olympic Team, took part.", "With 306 sets of medals, the games featured 28 Olympic sports, including rugby sevens and golf, which were added to the Olympic program in 2009.", "These sporting events took place at 33 venues in the host city, and at five separate venues in the Brazilian cities of S\u00e3o Paulo, Belo Horizonte, Salvador, Bras\u00edlia, and Manaus.", "These were the first Summer Olympic Games to take place under the International Olympic Committee (IOC) presidency of Thomas Bach.", "The host city Rio de Janeiro was announced at the 121st IOC Session in Copenhagen, Denmark, on 2 October 2009.", "Rio became the first South American city ever to host the Olympic Games." ], [ "2018 Summer Youth Olympics", "Fredericks was \nheading the six-person IOC Coordination Commission made up of several Olympians including Danka Bartekova, the youngest IOC Member and Young Ambassador from the inaugural Youth Olympic Games in Singapore in 2010.", "This commission was completed by two other IOC members, China's Li Lingwei, winner of three World Badminton Championships, and Barry Maister, a member of New Zealand's hockey team that won the Olympic gold medals at 1976 Summer Olympics in Montreal; and Adham Sharara, Canadian President of the International Table Tennis Federation, and Henry Nu\u00f1ez, head of the National Olympic Committee of Costa Rica.", "Working along with them there was the Buenos Aires Youth Olympic Games Organising Committee (BAYOGOC), that includes member of the , the local government and the national government, and which CEO was Leandro Larrosa.", "The local organising committee involves young people in all levels of the organization; including an \u2018Athlete Commission\u2019 and a newly established \u2018Youth Commission\u2019\u00a0\u2013 a group of young consultants chosen by the AOC from local schools and universities\u00a0\u2013 and the employees within BAYOGOC from junior to director level.", "The first Coordination Commission meeting took place in Buenos Aires on 27\u201328 September 2014." ] ], "gold": "The Summer Olympic Games, a major international multi-sport event normally held once every four years, were first held in 1896 in Athens, Greece, most recently held in 2021 in Tokyo, Japan, and are next scheduled to take place from July 26 to August 11, 2024 in Paris, France. The 2008 Summer Olympics were held in Beijing, China, the 2012 Summer Olympics were held in London and the 2016 Summer Olympics were held in Rio de Janeiro, Brazil. The Summer Youth Olympic Games, which are an international multi-sport event for athletes between 14 and 18 years old, are held every four years, with the next event taking place in 2026, because the 2022 event was cancelled due to the Covid pandemic. The 2010 Summer Youth Olympics were held in Singapore and the 2014 Summer Youth Olympics were held in Nanjing, China.", "prediction 1": "The 2020 Summer Olympics will be held in Tokyo, Japan. The 2018 Summer Youth Olympics will be held in Buenos Aires. The 2016 Summer Olympics were held in Rio de Janeiro, Brazil.", "prediction 2": "The 2018 Summer Youth Olympics will be held in Buenos Aires, Argentina. The 2020 Summer Olympic Games will be held in Tokyo, Japan. The 2020 Tokyo Olympics will be held in Tokyo.", "prediction 3": "The 2020 Summer Olympics will be held in Tokyo, Japan. The games will take place in the Olympic Village in the city of Tokyo, Japan. The 2018 Summer Olympics will be held in Buenos Aires, Argentina. The 2024 Summer Olympics will be held in Los Angeles, California.", "prediction 4": "The 2024 Summer Olympic Games will be held in Tokyo, Japan. The 2024 Summer Youth Olympics will be held in Buenos Aires, Argentina. In 2020, the 2020 Summer Olympics will be held in Vancouver, Canada.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 55, "end": 115 } ], "missing-info": [], "corrected-prediction": "The 2020 Summer Olympics will be held in Tokyo, Japan. The 2018 Summer Youth Olympics will be held in Buenos Aires. The 2016 Summer Olympics were held in Rio de Janeiro, Brazil." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who played guitar on goodbye yellow brick road?", "passages": [ [ "Bryan Forbes", "In 1972, Forbes started work on the documentary, \"Elton John and Bernie Taupin Say Goodbye Norma Jean and Other Things\" (1973), which chronicled the life of the young Elton John and Bernie Taupin.", "The project took Forbes a full year to complete, and provided a behind-the-scenes look at the writing and recording of \"Goodbye Yellow Brick Road\", including interviews with John, Taupin and band members, including Nigel Olsson and Dee Murray, as well as John's mother, Sheila, DJM label head Dick James and son Stephen, and footage of John's Hollywood Bowl concert in 1973.", "(Some of the footage was licensed for the Eagle Vision Classic Albums series \"Goodbye Yellow Brick Road\" documentary.)", "During the filming, Forbes formed a close friendship with John and Taupin, which led him to do other work with them, including photography on the \"Don't Shoot Me I'm Only the Piano Player\" and \"Goodbye Yellow Brick Road\" album sleeves.", "ITV broadcast the documentary in the UK on 4 December 1973 (in the US, ABC screened it) shortly after completion, and was later briefly issued on VHS.", "Forbes returned to Hollywood to direct \"The Stepford Wives\" (1975), based on Ira Levin's novel of the same name.", "The horror classic again featured Newman and was to become his best-known film." ], [ "This Train Don't Stop There Anymore", "This Train Don't Stop There Anymore\n\n\"This Train Don't Stop There Anymore\" is a 2001 song performed by Elton John.", "The song was written by Elton John and Bernie Taupin.", "The music video was directed by David LaChapelle, and with Pierre Rouger as cinematographer, and presents a younger John played by Justin Timberlake dressed in outfits typical of John in the 1970s; the video also features Paul Reubens of Pee-Wee Herman fame as John Reid, John's manager of 25 years.", "The song's lyrics detail John's coming to terms with getting older.", "It appears on the album \"Songs from the West Coast\".", "It was released as a single and reached #24 in the UK Singles chart and was a Top 10 Adult Contemporary chart hit in the US.", "Gary Barlow provided backing vocals for the track.", "The arrangement was simple, a throwback to John's early piano-bass-drums combination prior to the arrival of Davey Johnstone.", "On the track, John plays piano, Paul Bushnell provides bass and backing vocals, and Matt Chamberlain plays drums.", "Country music artists Rosanne Cash and Emmylou Harris covered the song for the 2018 tribute album \"\"." ] ], "gold": "\"Goodbye Yellow Brick Road\" is a ballad performed by musician Elton John and the title track on his 1973 album of the same name. On the song and album Davey Johnstone played the acoustic, electric, slide, and leslie guitars. Dee Murray played bass guitar on the album.", "prediction 1": "On the 1973 song \"Goodbye Yellow Brick Road\", Elton John plays piano, Paul Bushnell provides bass and backing vocals, and Matt Chamberlain plays drums.", "prediction 2": "In the 1973 album Goodbye Yellow Brick Road, guitarist Elton John plays the guitar and bass while bassist Paul Bushnell and drummer Matt Chamberlain play the drums. Gary Barlow provided the backing vocals for the 2001 song This Train Don't Stop There Anymore.", "prediction 3": "Gary Barlow provided backing vocals on the song \"Goodbye Yellow Brick Road\" and played guitar on the documentary \"Elton John and Bernie Taupin Say Goodbye Norma Jean and Other Things\" released in 1973. On the track, John plays piano, Paul Bushnell provides bass and backing vocals, and Matt Chamberlain plays drums.", "prediction 4": "Elton John and Bernie Taupin played guitar on their 1972 song \"Goodbye Yellow Brick Road\". In the 1973 documentary \"Elton John and Bernie Taupin Say Goodbye Norma Jean and Other Things\", Bryan Forbes provided a behind-the-scenes look at the writing and recording of the song. Gary Barlow provided back-up vocals for the song \"This Train Don't Stop There Anymore\", a 2001 song performed by Elton John.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 7, "end": 11 } ], "missing-info": [], "corrected-prediction": "The song \"Goodbye Yellow Brick Road\" is performed by Elton John." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the church of the nazarene founded?", "passages": [ [ "History of the Church of the Nazarene", "In April 1908 Bresee accepted Edgar P. Ellyson, president of the Holiness University of Texas of Peniel, Texas, his wife, Mary Emily Ellyson (1869\u20131943), and many leaders and members of the Holiness Association of Texas into the Pentecostal Church of the Nazarene, with Emily Ellyson elected pastor of the new congregation at Peniel.", "In September 1908 the Pennsylvania Conference of the Holiness Christian Church under the leadership of Horace G. Trumbauer merged with the Pentecostal Church of the Nazarene.", "At the Second General Assembly held at Pilot Point, Texas, the Holiness Church of Christ, located in the southern United States, merged with the Pentecostal Nazarenes.", "The Holiness Church of Christ itself was the merger of the New Testament Church of Christ founded in July 1894 at Milan, Tennessee by R.L. Harris, but soon led by his widow Mary Lee Cagle, and a group (also called the Holiness Church of Christ), that resulted in November 1904 at Rising Star, Texas from the prior merger of \"The Holiness Church\"' (founded in 1888 in Texas) and the Independent Holiness Church (formed at Van Alstyne, Texas in 1901, and led by Charles B. Jernigan and J.B. Chapman)." ], [ "History of the Church of the Nazarene", "The Western group was the Church of the Nazarene founded in October 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church, and Dr Joseph Pomeroy Widney, a Methodist physician, and the second president of the University of Southern California.", "The Eastern group was the Association of Pentecostal Churches of America, a denomination formed on 13 April 1897 through the merger of two older bodies: The Central Evangelical Holiness Association (organised 13\u201314 March 1890) and led by Fred A. Hillery and C. Howard Davis; and three churches organised by William Howard Hoople since January 1894, and formed into the Association of Pentecostal Churches of America.", "On 12 November 1896, these two groups met in Brooklyn, agreed upon a plan of union, which included retaining the name and Manual of Hoople's group.", "Prominent leaders included Hiram F. Reynolds, Davis, and Hoople.", "At the time of its merger with the Church of the Nazarene in 1907, the APCA existed principally from Nova Scotia to Iowa and the northeastern United States.", "The name of the united body adopted at the First General Assembly was Pentecostal Church of the Nazarene, and Bresee and Reynolds were elected the first general superintendents." ], [ "History of the Church of the Nazarene", "History of the Church of the Nazarene\n\nThe history of the Church of the Nazarene has been divided into seven overlapping periods by the staff of the Nazarene archives in Lenexa, Kansas: (1) Parent Denominations (1887\u20131907); (2) Consolidation (1896\u20131915);", "(3) Search for Solid Foundations (1911\u20131928); (4) Persistence Amid Adversity (1928\u20131945); (5) Mid-Century Crusade for Souls (1945\u20131960); (6) Toward the Post-War Evangelical Mainstream (1960\u20131980); and (7) Internationalization (since 1980).", "The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century.", "The most prominent of these mergers took place at the First and Second General Assemblies, held at Chicago, Illinois, and Pilot Point, Texas in 1907 and 1908, respectively.", "The primary architect of these early mergers was C. W. Ruth.", "The First General Assembly held in Chicago, Illinois from 10\u201317 October 1907 brought together the Eastern and the Western streams." ] ], "gold": "The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations, and denominations throughout the 20th century. The original western group, the Church of the Nazarene, founded in October 1895, merged with the original eastern group, the Association of Pentecostal Churches of America, founded on April 13, 1897, to form the Pentecostal Church of the Nazarene. The modern Church of the Nazarene was founded on October 13, 1908, after the merger of the Holiness Church of Christ and the Pentecostal Church of the Nazarene took place.", "prediction 1": "The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century. The Church of the Nazarene was founded in October 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church, and Dr. Joseph Pomeroy Widney, a Methodist physician, and the second president of the University of Southern California. The Western group was the Church of the Nazarene founded in Los Angeles, California by Dr. Phineas F. Bresee. Bresee, a minister in the Methodist Episcopal Church and Dr. George W. Bresee was elected the United Methodist Church of the Nazarene in April 1908, Texas.", "prediction 2": "The Church of the Nazarene was founded on 5 October 1887 in Philadelphia, Pennsylvania, and the Church of the Nazarene was founded in October 1895 in Los Angeles, California. The Church of the Nazarene is a denomination of holiness churches, associations and denominations that were formed over a period of time, with the most prominent of these mergers occurring at the First and Second General Assemblies, held at Chicago, Illinois, and Pilot Point, Texas in 1907 and 1908.", "prediction 3": "The Church of the Nazarene is a holiness denomination founded in 1897 and renamed in 1907 as the Pentecostal Church of the Nazarene through a series of mergers. The Church of the Nazarene's Eastern group was the Association of Pentecostal Churches of America and the Western group was the Church of the Nazarene founded in October 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church and Dr. Joseph Pomeroy Widney.", "prediction 4": "The Church of the Nazarene was founded in Los Angeles, California, on October 17, 1895 by Dr. Phineas F. Bresee. The Church of the Nazarene was founded in Los Angeles on October 10, 1895 by Dr. Phineas F. Bresee, minister in the Methodist Episcopal Church, and Dr. Joseph Pomeroy Widney. The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 448 }, { "error type": "Redundant", "explanation": " The Church of the Nazarene was founded in October 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church, and Dr. Joseph Pomeroy Widney, a Methodist physician, and the second president of the University of Southern California. ", "start": 449, "end": 629 }, { "error type": "Irrelevant", "explanation": "", "start": 630, "end": 714 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century. The Church of the Nazarene was founded in October 1895 in Los Angeles, California. In September 1908 the Pennsylvania Conference of the Holiness Christian Church under the leadership of Horace G. Trumbauer merged with the Pentecostal Church of the Nazarene." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the movie only the brave come out?", "passages": [ [ "Only the Brave (1930 film)", "Only the Brave (1930 film)\n\nOnly the Brave is a 1930 American Pre-Code Civil War drama film directed by Frank Tuttle and starring Gary Cooper, Mary Brian, and Phillips Holmes.", "Written by Agnes Brand Leahy, Edward E. Paramore Jr., Keene Thompson, and Richard H. Digges Jr., the film is about a Union Army captain who travels into Confederate territory as a spy with false dispatches hoping to mislead the Confederate forces.", "His mission is complicated when he falls in love with a southern woman who comes to his aid.", "Produced by Hector Turnbull for Paramount Pictures, \"Only the Brave\" was released on March 8, 1930 in the United States.", "During the American Civil War, Capt. James Braydon (Gary Cooper) visits his sweetheart and finds her with another man.", "Angered by the betrayal, he volunteers to become a spy for the Union.", "His first assignment involves carrying false military dispatches behind enemy lines and allow them to be discovered by Confederate Army officers in order to mislead them.", "Braydon sets off on his dangerous mission.", "Pretending to be a Confederate sympathizer in possession of vital Union plans, Braydon arrives at the plantation of a beautiful southern belle, Barbara Calhoun (Mary Brian), who has organized a ball for Confederate officers." ], [ "Only the Brave (2017 film)", "\"Only the Brave,\" originally titled \"Granite Mountain\", was released on October 20, 2017, by Sony Pictures Releasing under its Columbia Pictures label.", "Before that the film was set a release date for September 22, 2017, but a disagreement between Lionsgate and production company Black Label Media saw the U.S. distribution rights change to Columbia Pictures.", "Summit Entertainment will retain international rights in select countries for the film.", "The trailer came out on July 19, and the film was retitled \"Only the Brave\".", "\"Only The Brave\" was released digitally on January 23, 2018, and on DVD and Blu-ray on February 6, 2018.", "\"Only the Brave\" grossed $18.3 million in the United States and Canada, and $7.4 million in other territories, for a worldwide total of $25.8 million, plus $7.2 million with home video sales, against a production budget of $38 million.", "In the United States and Canada, \"Only the Brave\" was released alongside \"Boo 2!", "A Madea Halloween\", \"The Snowman\" and \"Geostorm\", and was expected to gross around $7 million from 2,575 theaters in its opening weekend.", "It made $305,000 from Thursday night previews and $2.1 million on its first day." ], [ "Only the Brave (2006 film)", "Only the Brave (2006 film)\n\nOnly the Brave is a 2006 independent film about the 100th Infantry Battalion/442nd", "Regimental Combat Team, a segregated World War II fighting unit primarily made up of \"Nisei\" Japanese Americans, which for its size and length of service became the most decorated unit in U.S. military history.", "The film, produced and directed by Lane Nishikawa is a fictionalized account of the rescue of the Lost Battalion.", "In 1953, Jimmy Takata (Nishikawa) suffers from \"battle fatigue\" (Post Traumatic Stress Disorder), to the great concern of his wife, Mary (Tomita).", "Raised in Hawaii, Takata and some of his friends enlisted in the 100th Battalion, serving in the European Theater of Operations.", "In a series of flashbacks, he remembers the war and events in his life surrounding it.", "Following a head injury, he begins to have visions, and believes that he is seeing memories of other men, including his friend Freddy Watada (Watanabe) as he courted Mary (who would later be Jimmy's wife) before entering the Army." ] ], "gold": "Only the Brave is a film released on March 8, 1930 in the United States about a Union Army captain who travels into Confederate territory as a spy hoping to mislead the Confederate forces. Only the Brave is an independent film released on February 17, 2006 about the 100th Infantry Battalion/442nd Regimental Combat Team, a segregated World War II fighting unit primarily made up of \"Nisei\" Japanese Americans. Only the Brave, originally titled Granite Mountain, was premiered in Los Angeles on October 8, 2017 and released on October 20, 2017. The film tells the story of the Granite Mountain Hotshots, an elite crew of firefighters from Prescott, Arizona who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013, and is dedicated to their memory.", "prediction 1": "Only the Brave is a 1930 American Pre-Code Civil War drama film directed by Frank Tuttle and starring Gary Cooper, Mary Brian, and Phillips Holmes. It is about a Union Army captain who travels into Confederate territory as a spy with false dispatches hoping to mislead the Confederate forces. The trailer for the film came out on July 19, and the film was retitled Only the Brave. The film was released digitally on January 23, 2018, and on DVD and Blu-ray on February 6, 2018.", "prediction 2": "Only the Brave is a 1930 American Pre-Code Civil War drama film directed by Frank Tuttle and starring Gary Cooper, Mary Brian, and Phillips Holmes. Produced by Hector Turnbull for Paramount Pictures, \"Only the Brave\" was released on March 8, 1930 in the United States. Only the Brave is also a 2006 independent film about the 100th Infantry Battalion/442nd Regimental Combat Team, a segregated World War II fighting unit primarily made up of \"Nisei\" Japanese Americans, a fictionalized account of the rescue of the Lost Battalion.", "prediction 3": "Only the Brave is a 1930 American Pre-Code Civil War drama film directed by Frank Tuttle and starring Gary Cooper, Mary Brian, and Phillips Holmes. Produced by Hector Turnbull for Paramount Pictures, \"Only the Brave\" was released on March 8, 1930 in the United States. The trailer came out on July 19, and the film was retitled \"Only the Brave.\" Only the Brave is a 2006 independent film about the 100th Infantry Battalion/442nd Regimental Combat Team, primarily made up of \"Nisei\" Japanese Americans, primarily made up of \"Nisei\" Japanese Americans.", "prediction 4": "Only the Brave was released on March 8, 1930 in the United States. In 2017, the film was released as a standalone feature film. In 2006, the film was released as a sequel to Only the Brave, which was released in Japan on February 6, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 147 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Only the Brave is a 1930 American Pre-Code Civil War drama film. It is about a Union Army captain who travels into Confederate territory as a spy with false dispatches hoping to mislead the Confederate forces. Only the Brave is an independent film released in 2006 about the 100th Infantry Battalion/442nd Regimental Combat Team, a segregated World War II fighting unit primarily made up of \"Nisei\" Japanese Americans. \"Only the Brave,\" originally titled \"Granite Mountain\", was released on October 20, 2017. The trailer for the film came out on July 19, and the film was retitled Only the Brave. The film was released digitally on January 23, 2018, and on DVD and Blu-ray on February 6, 2018." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who dies on how i met your mother?", "passages": [ [ "Daisy (How I Met Your Mother)", "Daisy (How I Met Your Mother)\n\n\"Daisy\" is the twentieth episode of the ninth season of the CBS sitcom \"How I Met Your Mother\", and the 204th episode overall.", "It starred Josh Radnor as Ted Mosby, Jason Segel as Marshall Eriksen, Cobie Smulders as Robin Scherbatsky, Neil Patrick Harris as Barney Stinson, Alyson Hannigan as Lily Aldrin, Tracey Ullman as Genevieve, Chris Elliott as Mickey, Kyle MacLachlan as The Captain, Laura Bell Bundy as Becky, Marshall Manesh as Ranjit, Suzie Plakson as Judy, William Zabka as Billy Zabka, and Robert Belushi as Linus.", "The episode centers around the guys searching for Lily (Alyson Hannigan) who went missing after her fight with husband Marshall (Jason Segel) and trying to figure out why she disappeared.", "At the same time, Robin (Cobie Smulders), is worried she is marrying her father after a talk she had with her mother.", "Robin is in line to marry Barney (Neil Patrick Harris) during this episode.", "Four hours before the wedding, Robin asks her mother how she made it despite a fear of flying." ], [ "How I Met Your Mother", "How I Met Your Mother\n\nHow I Met Your Mother (often abbreviated to HIMYM) is an American sitcom that originally aired on CBS from September 19, 2005, to March 31, 2014.", "The series follows the main character, Ted Mosby, and his group of friends in New York City's Manhattan.", "As a framing device, Ted, in the year 2030, recounts to his son and daughter the events that led him to meet their mother.", "The series was created by Craig Thomas and Carter Bays, who also served as the show's executive producers and were frequent writers.", "The series was loosely inspired by their friendship when they both lived in New York City.", "Among the 208 episodes, there were only four directors:", "Pamela Fryman (196 episodes), Rob Greenberg (7 episodes), Michael Shea (4 episodes) and Neil Patrick Harris (1 episode).", "Known for its unique structure, humor, and incorporation of dramatic elements, \"How I Met Your Mother\" has gained a cult following over the years.", "The show initially received positive reviews, while the later seasons received more mixed reviews.", "The show was nominated for 30 Emmy Awards, winning ten.", "In 2010, Alyson Hannigan won the People's Choice Award for Favorite TV Comedy Actress." ], [ "Bad News (How I Met Your Mother)", "Bad News (How I Met Your Mother)\n\n\"Bad News\" is the 13th episode of the sixth season of the CBS sitcom \"How I Met Your Mother\" and their 125th episode overall.", "It aired January 3, 2011.", "\"TV Guide\" listed \"Bad News\" in its list of 2011's Top TV Episodes.", "Future Ted tells his kids that Marshall and Lily are anxious and worried about their chances of having a baby.", "After several months of trying to conceive without success, their doctor refers them to a fertility expert.", "As they tell Ted the news at MacLaren's, Barney arrives and announces to Ted and Marshall's dismay that he needs a partner for a laser tag tournament.", "Lily goes to her appointment with the fertility expert, Dr. John Stangel (Neil Patrick Harris), only to discover that he looks exactly like Barney, save for a beard and dark brown hair, raising her immediate concern that he is in fact Barney in disguise.", "When Lily confronts Barney, Marshall vouches for Barney, saying that they spent the whole day together.", "To convince her that Stangel and Barney are not the same person, Marshall attends Lily's appointment and also immediately assumes Stangel and Barney are the same person.", "Barney shows up, acknowledges the similarity, and leaves." ] ], "gold": "How I Met Your Mother, often abbreviated as HIMYM, is an American sitcom, created by Craig Thomas and Carter Bays for CBS. Several characters die in the series. \"Bad News\" is the 13th episode of the sixth season, and in that episode Marvin Eriksen Sr., played by American actor Bill Fagerbakke, dies. \"Vesuvius\" is the nineteenth episode of the ninth season, and in that episode Tracy McConnell, played by Cristin Milioti, is thought to be dead. This was proven correct in the series finale, \"Last Forever\".", "prediction 1": "How I Met Your Mother is an American sitcom that originally aired on CBS from September 19, 2005, to March 31, 2014. It follows the main character, Ted Mosby, and his group of friends in New York City's Manhattan. In the sixth season, in the seventh season, in the eighth season, in the ninth season, and in the 11th season, in the tenth season, in the eleventh season, in the eleventh season, and in the thirteenth season, in the sixth season, in the eleventh season, and their 125th episode overall. In the series, there was also, the last five people die in the show.", "prediction 2": "How I Met Your Mother, sometimes abbreviated to HIMYM, is an American sitcom that originally aired on CBS from September 19, 2005, to March 31, 2014. The show follows the main character, Ted Mosby, and his group of friends in New York City's Manhattan. In the series' second episode, \"Daisy\", a character named Lily Aldrin dies after a fight with her husband, Marshall Eriksen. In the series' third episode, \"Bad News,\" a character named Barney Stinson dies.", "prediction 3": "How I Met Your Mother is an American sitcom that originally aired on CBS from September 19, 2005, to March 31, 2014. In the ninth season, there was a death in the episode \"Daisy\", which centers around the guys searching for Lily, who went missing after her fight with husband Marshall Eriksen, and trying to figure out why she disappeared. In the sixth season, there was a death in the episode \"Bad News,\" which featured the death of Dr. John Stangel, and a death in the episode \"How I Met Your Mother\" in the series.", "prediction 4": "How I Met Your Mother is an American sitcom that originally aired on CBS from September 19, 2005, to March 31, 2014. As a framing device, Ted, in the year 2030, recounts to his son and daughter the events that led him to meet their mother. In the episode Bad News, Lily goes missing after she fights with her husband, Marshall Eriksen. Alyson Hannigan plays Lily Aldrin. The episode also centers around the guys searching for Lily, who went missing after her fight with Marshall Eriksen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 213 }, { "error type": "Incoherent", "explanation": "", "start": 214, "end": 501 }, { "error type": "Unverifiable", "explanation": "", "start": 502, "end": 570 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "How I Met Your Mother is an American sitcom, created by Craig Thomas and Carter Bays, that originally aired on CBS. \"Bad News\" is the 13th episode of the sixth season." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does le tour de france always end?", "passages": [ [ "Tour de France", "Most stages are in mainland France, although since the mid-1950s it has become common to visit nearby countries: Andorra, Belgium, Germany (and the former West Germany), Ireland, Italy, Luxembourg, Monaco, the Netherlands, Spain,\nSwitzerland, and the United Kingdom have all hosted stages or part of a stage.", "Since 1975 the finish has been on the Champs-\u00c9lys\u00e9es in Paris; from 1903 to 1967 the race finished at the Parc des Princes stadium in western Paris and from 1968 to 1974 at the Piste Municipale south of the capital.", "Feliz Levitan, race organizer in the 1980s, was keen to host stages in the United States, but these proposals have never been developed.", "The following editions of the Tour started, or are planned to start, outside France:\n\n\n", "The Tour was first followed only by journalists from \"L'Auto\", the organisers.", "The race was founded to increase sales of a floundering newspaper and its editor, Desgrange, saw no reason to allow rival publications to profit.", "The first time papers other than \"L'Auto\" were allowed was 1921, when 15 press cars were allowed for regional and foreign reporters.", "The Tour was shown first on cinema newsreels a day or more after the event." ], [ "Tour de France", "Tour de France\n\nThe Tour de France () is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries.", "Like the other Grand Tours (the Giro d'Italia and the Vuelta a Espa\u00f1a), it consists of 21 day-long stages over the course of 23 days.", "The race was first organized in 1903 to increase sales for the newspaper \"L'Auto\" and is currently run by the Amaury Sport Organisation.", "The race has been held annually since its first edition in 1903 except when it was stopped for the two World Wars.", "As the Tour gained prominence and popularity, the race was lengthened and its reach began to extend around the globe.", "Participation expanded from a primarily French field, as riders from all over the world began to participate in the race each year.", "The Tour is a UCI World Tour event, which means that the teams that compete in the race are mostly UCI WorldTeams, with the exception of the teams that the organizers invite.", "Traditionally, the race is held primarily in the month of July.", "While the route changes each year, the format of the race stays the same with the appearance of time trials, the passage through the mountain chains of the Pyrenees and the Alps, and the finish on the Champs-\u00c9lys\u00e9es in Paris." ] ], "gold": "The Tour de France is an annual men's multiple-stage bicycle race primarily held in France, while also occasionally passing through nearby countries. Like the other Grand Tours, it consists of 21 stages, each a day long, over the course of 23 days. Since 1975 the finish has been on the Champs-\u00c9lys\u00e9es in Paris; from 1903 to 1967 the race finished at the Parc des Princes stadium in western Paris and from 1968 to 1974 at the Piste Municipale south of the capital. Feliz Levitan, race organizer in the 1980s, was keen to host stages in the United States, but these proposals have never been developed.", "prediction 1": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. From 1903 to 1967 the race finished at the Parc des Princes stadium in western Paris and from 1968 to 1974 at the Piste Municipale south of the capital. The Tour has been held annually since its first edition in 1903 except when it was stopped for the two World Wars. The finish has always been on the Champs-\u00c9lys\u00e9es in Paris.", "prediction 2": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The race has been held annually since its first edition in 1903 except when it was stopped for the two World Wars. The finish has been on the Champs-\u00c9lys\u00e9es in Paris since 1975. From 1903 to 1967 the race finished at the Parc des Princes stadium in western Paris and from 1968 to 1974 at the Piste Municipale south of the capital.", "prediction 3": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The finish of the race has always been on the Champs-\u00c9lys\u00e9es in Paris. The Tour de France was first organized in 1903 to increase sales for the newspaper L'Auto and is currently run by the Amaury Sport Organisation.", "prediction 4": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. Although the route changes each year, the format of the race stays the same with the appearance of time trials, the passage through the mountain chains of the Pyrenees and Alps, and the finish on the Champs-\u00c9lys\u00e9es in Paris.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 417 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. Like the other Grand Tours, it consists of 21 stages, each a day long, over the course of 23 days. Since 1975 the finish has been on the Champs-\u00c9lys\u00e9es in Paris; From 1903 to 1967 the race finished at the Parc des Princes stadium in western Paris and from 1968 to 1974 at the Piste Municipale south of the capital. Feliz Levitan, race organizer in the 1980s, was keen to host stages in the United States, but these proposals have never been developed." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the dallas cowboys quarterback in 2002?", "passages": [ [ "Dallas Cowboys", "That game was very costly when veteran quarterback Troy Aikman suffered a serious concussion which ultimately ended his career.", "Longtime NFL QB Randall Cunningham filled in for Aikman for the rest of the season at QB.", "The Cowboys finished the season in 4th place with a 5\u201311 record.", "The only highlights of 2000 were Emmitt Smith having his 10th consecutive 1,000 yard rushing season and a season sweep over the Redskins.", "2001 was another hard year in Dallas.", "Prior to the season starting Aikman was released from the team and he retired due to the concussions he had received.", "Jerry Jones signed Tony Banks as a QB.", "Banks had been a starter for half of the season the previous year for the Super Bowl Champion Baltimore Ravens before being benched.", "Jones also drafted QB Quincy Carter in the second round of that year's draft, but Banks was released during the preseason.", "Ryan Leaf, Anthony Wright, and Clint Stoerner all competed for the quarterback position that season.", "Dallas again finished at 5\u201311, last place in the NFC East.", "They did sweep the Redskins for the 4th consecutive season.", "Prior to the 2002 season Dallas drafted safety Roy Williams with the 8th overall pick.", "The season started out low as the Cowboys lost to the expansion Houston Texans 19\u201310 on Week 1." ] ], "gold": "There were several quarterbacks for the Dallas Cowboys in 2002. Chad Hutchinson and Quincy Carter were both quarterbacks in 2002. Quincy Carter started the most that year.", "prediction 1": "Ryan Leaf, Anthony Wright, and Clint Stoerner all competed for the quarterback position that season. The Cowboys finished the season in 4th place with a 5\u201311 record. Prior to the 2002 season Dallas drafted safety Roy Williams with the 8th overall pick.", "prediction 2": "The 2002 Dallas Cowboys quarterback was Tony Banks, who had been the team's starter for half of the season the previous year for the Super Bowl Champion Baltimore Ravens before being benched. Ryan Leaf, Anthony Wright, and Clint Stoerner all competed for the quarterback position that season. Before the 2002 season Dallas drafted safety Roy Williams with the 8th overall pick. The Cowboys finished the season in 4th place with a 5\u201311 record.", "prediction 3": "Tony Banks was the Dallas Cowboys quarterback in 2002. Bryan Bryant was the quarterback for the Dallas Cowboys in 2001.", "prediction 4": "Ryan Leaf, Anthony Wright, and Clint Stoerner all competed for the quarterback position that season. Dallas finished the 2002 season at 5\u201311, last place in the NFC East.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 166, "end": 252 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 0, "end": 165 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where was the largest gold nugget found in california?", "passages": [ [ "Sierra City, California", "Sierra City, California\n\nSierra City is a census-designated place in Sierra County, California, United States.", "The elevation of Sierra City is , and the town is situated in the canyon of the North Yuba River on California State Route 49, twelve miles northeast of the county seat of Sierra County, Downieville.", "The population was 221 at the 2010 census.", "Sierra City is named for its location in the northern part of the Sierra Nevada Mountains.", "Before the California Gold Rush, only Native Americans had ventured into the area, which lies northwest of Lake Tahoe on the western slope of the Sierra Nevada, and which lay between areas inhabited by Maidu, Nisenan, and Washo peoples (Pre-Contact Tribal Map).", "The area is now part of the Tahoe National Forest.", "A settlement was established in 1850 by Philo A. Haven and Joseph Zumwalt, who were also involved with the settling of Downieville (Sinnott).", "In the Winter of 1852-53, however, an avalanche of snow destroyed the settlement, which was not rebuilt for several years.", "Ferdinand, Gustav, and Christian Reis purchased several mining claims near the Sierra Buttes and began to resettle Sierra City, which had a peak population of 3,000 during the decade after gold was discovered in California (1849)." ], [ "Sierra City, California", "None of the nearby hard-rock mines are in operation, but the Kentucky mine just outside the town limits now houses a mining museum.", "In the summer months, fishing in the North Yuba and its tributaries and in nearby alpine lakes is popular, as is mountain-biking, placer-mining, and hiking.", "A cluster of sheer rock peaks known as the Sierra Buttes (Latitude: 39.59351, Longitude: -120.64105), 7,818 feet high, is just 1.6 miles from Sierra City and towers over the town.", "Many trails cross the area, and the Pacific Crest Trail crosses the flanks of the Sierra Buttes some 2,000 feet above the town.", "Wild Plum Campground is a little more than a mile away on Haypress Creek.", "The nearest public school is 12 miles away in Downieville.", "According to the United States Census Bureau, the CDP covers an area of 2.2\u00a0square miles (5.6\u00a0km\u00b2), 99.99% of it land and 0.01% of it water.", "The 2010 United States Census reported that Sierra City had a population of 221.", "The population density was 102.8 people per square mile (39.7/km\u00b2)." ] ], "gold": "The largest gold nuggets found in California were at Tahoe National Forest in the peaks of the Sierra Buttes.", "prediction 1": "The largest gold nugget found in California was found in the Sierra Nevada Mountains in the area of Sierra City, California. The largest gold nugget found in California was found in the Sierra Buttes, a cluster of sheer rock peaks located just 1.6 miles from the town of Sierra City.\n", "prediction 2": "The largest gold nugget found in California was discovered near Downieville, twelve miles northeast of the county seat of Sierra County, Downieville. The largest gold nugget found in California was in Texas, while the largest gold nugget found in the United States was found in Utah. The largest gold nugget found in California was found in Goble Canyon, 8012 miles southwest of Upland, and located at 9,768 feet in elevation.", "prediction 3": "The largest gold nugget found in California was found at 1200 yards (2,543 ft) in the Sierra Nevada Mountains in Banyan Grove, near the town of Valparaiso. In 1901, the largest gold nugget found in California was found on a location called King and Taylor, near the town of Carson City.", "prediction 4": "There are numerous Gold Nugget Locations in California. The largest gold nugget found in California was in the western Sierra Nevada Mountains at 172.51 grams. In 1849, a gold nugget was found at a find in Downieville.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 124 }, { "error type": "Unverifiable", "explanation": "", "start": 125, "end": 284 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When does the next handmaid's tale come out?", "passages": [ [ "The Handmaid's Tale (TV series)", "The Handmaid's Tale (TV series)\n\nThe Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood.", "It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016.", "The plot features a dystopian future following a Second American Civil War wherein a totalitarian society subjects fertile women, called \"Handmaids\", into child-bearing servitude.", "The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday.", "In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "\"The Handmaid's Tale\" has received widespread critical acclaim and its first season won eight Primetime Emmy Awards from thirteen nominations, including Outstanding Drama Series.", "It is the first show produced by Hulu to win a major award as well as the first series on a streaming service to win an Emmy for Outstanding Series.", "It also became the first streaming series to win the Golden Globe Award for Best Television Series \u2013 Drama.", "Elisabeth Moss was also awarded the Golden Globe for Best Actress.", "In May 2018, Hulu announced that the series had been renewed for a third season." ] ], "gold": "The Handmaid's Tale is the title of both a novel by Margaret Atwood and a television series based on it. Season 2 of The Handmaid's Tale first came out on April 25, 2018, while its Season 3 did on June 5, 2019, and its Season 4 did in the fall of 2020. The sequel to the book The Handmaid's Tale first came out on September 10, 2019.", "prediction 1": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "prediction 2": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Production began in late 2016 and the first three episodes of the series premiered on April 26, 2017. The next seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018. In May 2018, Hulu announced that the series had been renewed for a third season.", "prediction 3": "The Handmaid's Tale is an American dystopian television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "prediction 4": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Production began in late 2016 and the series premiered on April 26, 2017. The series was renewed for a second season in May 2017, and the second season premiered on April 25, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 425 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. In May 2017, the series was renewed for a second season which premiered on April 25, 2018. In May 2018, Hulu announced that the series had been renewed for a third season." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who sings the song take this job and shove it?", "passages": [ [ "Take This Job and Shove It", "Take This Job and Shove It\n\n\"Take This Job and Shove It\" is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward.", "The song was first recorded by Paycheck on his album also titled \"Take This Job and Shove It\".", "The recording hit number one on the country charts for two weeks, spending 18 weeks on the charts.", "It was Paycheck's only #1 hit.", "Its B-side, \"Colorado Kool-Aid,\" spent ten weeks on the same chart and peaked at #50.", "Coe's recording was released in 1978 on his \"Family Album\".", "Coe also recorded a variation of the song called \"Take This Job and Shove It Too\" on his 1980 album \"I've Got Something To Say\".", "It included the double-meaning line \"Paycheck you may be a thing of the past.\"", "Coe was annoyed people assumed Paycheck had written the song.", "Though the single released by Paycheck, and subsequent album, both correctly credit Coe as the song's composer.", "The song inspired a 1981 film by the same name.", "A cover version also appears on \"Bedtime for Democracy\" by Dead Kennedys." ] ], "gold": "Take This Job and Shove It is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward. Coe's recording was released in 1978 on his album Family Album. Coe also recorded a variation of the song called Take This Job and Shove It Too on his 1980 album I've Got Something To Say. It included the double-meaning line \"Paycheck, you may be a thing of the past.\" Coe was annoyed that people assumed that Paycheck had written the song.", "prediction 1": "Take This Job and Shove It is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward. The song was first recorded by Paycheck on his album also titled \"Take This Job and Shove It\". The recording hit number one on the country charts for two weeks, spending 18 weeks on the charts. Coe also recorded a variation of the song called \"Take This Job and Shove It Too\" on his 1980 album \"I've Got Something To Say\".", "prediction 2": "\"Take This Job and Shove It\" is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward. The recording hit number one on the country charts for two weeks, spending 18 weeks on the charts. It was Paycheck's only #1 hit. Coe also recorded a variation of the song called \"Take This Job and Shove It Too\" on his 1980 album \"I've Got Something To Say\".", "prediction 3": "Johnny Paycheck sings the 1977 country song \"Take This Job and Shove It\". The song was written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward.", "prediction 4": "Take This Job and Shove It is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward. It was first recorded by Paycheck on his album also titled \"Take This Job and Shove It\". The recording hit number one on the country charts for two weeks, spending 18 weeks on the charts. Coe also recorded a variation of the song called \"Take This Job and Shove It Too\" on his 1980 album \"I've Got Something To Say\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 297 }, { "error type": "Irrelevant", "explanation": "", "start": 298, "end": 396 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Take This Job and Shove It is a 1977 country music song written by David Allan Coe and popularized by Johnny Paycheck, about the bitterness of a man who has worked long and hard with no apparent reward. Coe's recording was released in 1978 on his \"Family Album\". Coe also recorded a variation of the song called \"Take This Job and Shove It Too\" on his 1980 album \"I've Got Something To Say\". It included the double-meaning line \"Paycheck you may be a thing of the past.\" Coe was annoyed people assumed Paycheck had written the song." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who wrote you put a spell on me?", "passages": [ [ "I Put a Spell on You (book)", "I Put a Spell on You (book)\n\n", "I Put A Spell On You: The Autobiography of Nina Simone is the 1992 autobiography by Nina Simone (1933\u20132003), written with Stephen Cleary.", "The 192-page book was published February 1, 1992 by Pantheon.", "It was re-released in a 2003 Da Capo Press reprint edition following Simone's death on April 21, 2003; this edition included an introduction, \"I Know How it Feels To Be Free: Nina Simone 1933\u20132003\", written by Dave Marsh.", "The book received mixed reviews.", "Reviewing the book in \"The Washington Post\", Gerald Early felt, \"The best part of this autobiography...is Simone's recollection of her childhood,\" but said \"in the end, [the book] seems sketchy and self-defensive...", "She tells very little either about the times in which she lived, or about the people who were most instrumental to her growth after her childhood,\" noting his disappointment with this absence given she \"occupied an influential and unusual place in American cultural history, attracting Cafe Society-type white audiences at the same time that she maintained her integrity with a politicized young black audience.", "There is much to be said about the period from 1958 to 1968, and Simone would have been a stunning witness to it.\"" ], [ "I Put a Spell on You", "I Put a Spell on You\n\n\"I Put a Spell on You\" is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll.", "It was also ranked No. 313 on \"Rolling Stone\" magazine's list of The 500 Greatest Songs of All Time.", "The selection became a classic cult song covered by a variety of artists and was his greatest commercial success, reportedly surpassing a million copies in sales, even though it failed to make the \"Billboard\" pop or R&B charts.", "Hawkins had originally intended to record \"I Put a Spell on You\" as \"a refined love song, a blues ballad\".", "However, the producer (Arnold Maxin) \"brought in ribs and chicken and got everybody drunk, and we came out with this weird version\u00a0...", "I don't even remember making the record.", "Before, I was just a normal blues singer.", "I was just Jay Hawkins.", "It all sort of just fell in place.", "I found out I could do more destroying a song and screaming it to death.\"", "Hawkins first recorded \"I Put a Spell on You\" as a ballad during his stint with Grand Records in late 1955." ] ], "gold": "There are several things with the title, \"I Put A Spell On You\". One \"I Put a Spell on You\" is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins and Herb Slotkin, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. Also, I Put A Spell On You: The Autobiography of Nina Simone is the 1992 autobiography by Nina Simone (1933\u20132003), written with Stephen Cleary.", "prediction 1": "\"I Put a Spell on You\" is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. It was also ranked No. 313 on \"Rolling Stone's list of The 500 Greatest Songs of All Time.\"", "prediction 2": "I Put a Spell on You is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. His own recording of it also was ranked No. 313 on \"Rolling Stone\" magazine's list of The 500 Greatest Songs of All Time. The selection became a classic cult song covered by a variety of artists and was his greatest commercial success, reportedly surpassing a million copies in sales, even though it failed to make the Billboard pop or R&B charts.", "prediction 3": "I Put a Spell on You is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins. His own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. It was also ranked No. 313 on \"Rolling Stone\" magazine's list of The 500 Greatest Songs of All Time.", "prediction 4": "\"I Put a Spell on You\" is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. The selection became a classic cult song covered by a variety of artists and was his greatest commercial success, reportedly exceeding a million copies in sales. The song's original producer, Arnold Maxin, produced the odd version, which was recorded as a ballad during his stint with Grand Records in late 1955.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 304 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I Put a Spell on You\" is a 1956 song written and composed by Jalacy \"Screamin' Jay\" Hawkins, whose own recording of it was selected as one of the Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll. \"I Put A Spell On You\" was also the name of the 1992 autobiography of Nina Simone (1933-2003), written with Stephen Cleary." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What south american country was settled by the portuguese?", "passages": [ [ "Portuguese colonization of the Americas", "The new states would fare poorly and only last 3 years.", "In 1775, the three colonies of Portuguese America (the State of Brazil, the State of Maranh\u00e3o and Piau\u00ed; and the State of Gr\u00e3o-Par\u00e1 and Rio Negro) were united into a singular colony, under the State of Brazil.", "This arrangement would last until the end of Colonial Brazil.", "As a result, Brazil did not split into several countries, as happened to its Spanish-speaking neighbors.", "The \"Early Navigators\" practically have been to the entire Caribbean, from The Bahamas to Jamaica.", "Papiamento, one of the languages spoken in the islands, is a mixture of Portuguese , Spanish and African languages.", "Portuguese merchants have been trading in the West Indies.", "To such an extent, that, for instance, for the Portuguese town of P\u00f3voa de Varzim, most of its seafarers dying abroad, most of the deaths occurred in the Route of the Antilles, in the West Indies.", "At the turn of the 17th century, with the union with Castile, the Spanish kings favored the free movement of the people, and other lands of the New World, such as Peru and the Gulf of Mexico, were open to the Portuguese merchants.", "The Portuguese founded the first Uruguayan city, Col\u00f3nia do Sacramento." ], [ "Portuguese colonization of the Americas", "Portuguese colonization of the Americas\n\nPortugal was the leading country in the European exploration of the world in the 15th century.", "The Treaty of Tordesillas in 1494 divided the Earth outside Europe into Castilian and Portuguese global territorial hemispheres for exclusive conquest and colonization.", "Portugal colonized parts of South America (mostly Brazil), but also made some unsuccessful attempts to colonize North America in present-day Canada.", "Based on the terms of the Treaty of Tordesillas, the Portuguese Crown claimed it had territorial rights in the area visited by the Genoese explorer John Cabot in 1497 and 1498 on behalf of the Crown of England.", "To that end, in 1499 and 1500, the Portuguese mariner Jo\u00e3o Fernandes Lavrador visited the northeast Atlantic coast and Greenland, which accounts for the appearance of \"Labrador\" on topographical maps of the period.", "Subsequently, in 1501 and 1502, the Corte-Real brothers explored and charted Greenland and what is today the Canadian province of Newfoundland and Labrador, claiming these lands as part of fortnight the Portuguese Empire.", "Fragmentary evidence also suggests a previous expedition in 1473 by Jo\u00e3o Vaz Corte-Real, their father, with other Europeans, to \"Terra Nova do Bacalhau\" (\"Newfoundland of the Codfish\") in North America." ], [ "Colonial Brazil", "Gold and diamonds were discovered and mined in southern Brazil through the end of the colonial era.", "Brazilian cities were largely port cities and the colonial administrative capital was moved several times in response to the rise and fall of export products' importance.", "Unlike Spanish America, which fragmented into many republics upon independence, Brazil remained a single administrative unit under a monarch, giving rise to the largest country in Latin America.", "Just as European Spanish and Roman Catholicism were a core source of cohesion among Spain's vast and multi-ethnic territories, Brazilian society was united by the Portuguese language and Roman Catholic faith.", "As the only Lusophone polity in the Western Hemisphere, the Portuguese language was particularly important to Brazilian identity.", "Portugal and Spain pioneered the European charting of sea routes that were the first and only channels of interaction between all of the world's continents, thus beginning the process of globalization.", "In addition to the imperial and economic undertaking of discovery and colonization of lands distant from Europe, these years were filled with pronounced advancements in cartography, shipbuilding and navigational instruments, of which the Portuguese and Spanish explorers took advantage.", "In 1494, the two kingdoms of the Iberian Peninsula divided the New World between them (in the Treaty of Tordesillas), and in 1500 navigator Pedro \u00c1lvares Cabral landed in what is now Brazil and laid claim to it in the name of King Manuel I of Portugal." ] ], "gold": "Portugal was a leading country in the European exploration of the world in the 15th century. In 1494, the two kingdoms of the Iberian Peninsula divided the New World between them (in the Treaty of Tordesillas), and in 1500 navigator Pedro \u00c1lvares Cabral landed in what is now Brazil and laid claim to it in the name of King Manuel I of Portugal. Brazil was then settled by Portugal in the 16th century. The Portuguese first established Col\u00f3nia do Sacramento in Uruguay in 1680.", "prediction 1": "Portugal was the leading country in the European exploration of the world in the 15th century. The treaty of Tordesillas in 1494 divided the Earth outside Europe into Castilian and Portuguese global territorial hemispheres for exclusive conquest and colonization. Portugal colonized parts of South America (mostly Brazil), but also made some unsuccessful attempts to colonize North America in present-day Canada. Portuguese explorer Pedro lvares Cabral landed in what is now Brazil and laid claim to it in the name of King Manuel I of Portugal.", "prediction 2": "The Portuguese settled in Brazil, Uruguay, and Argentina from 1499 to 1500. In the 17th century, the three Portuguese colonies of South America were united into a singular colony, under the State of Brazil, which lasted until the end of Colonial Brazil. The three Portuguese colonies in Brazil were: the State of Brazil, the State of Maranho and Piau; and the State of Gro-Par\u00e1 and Rio Negro.", "prediction 3": "The Portuguese landed in the country of Brazil in 1500, with Pedro lvares Cabral as the explorer of the New World. The Portuguese settled in Uruguay in 1527, in 1532, and in 1541, in Paraguay. In 1587, the Portuguese landed in the territory of Bolivia and in 1595, the Portuguese landed in Peru. The Portuguese also settled in Venezuela in 1567 and in 1578, respectively.", "prediction 4": "Portugal was the leading country in the European exploration of the world in the 15th century. The Treaty of Tordesillas in 1494 divided the Earth outside Europe into Castilian and Portuguese global territorial hemispheres for exclusive conquest and colonization. Portugal colonized parts of South America (mostly Brazil), but also made some unsuccessful attempts to colonize North America in present-day Canada. Portugal also established the first Portuguese presence in Uruguay in 1585. The Portuguese founded the first Portuguese city in Uruguay in 1592. Portuguese colonized Uruguay in 1775.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 412 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Portugal was the leading country in the European exploration of the world in the 15th century. In 1494, the two kingdoms of the Iberian Peninsula divided the New World between them (in the Treaty of Tordesillas), and in 1500 navigator Pedro \u00c1lvares Cabral landed in what is now Brazil and laid claim to it in the name of King Manuel I of Portugal. The Portuguese founded the first Uruguayan city, Col\u00f3nia do Sacramento." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How many episodes in season 2 of happy valley?", "passages": [ [ "Happy Valley (TV series)", "Happy Valley (TV series)\n\nHappy Valley is a British crime drama television series filmed and set in the Calder Valley, West Yorkshire in Northern England.", "The series, starring Sarah Lancashire and Siobhan Finneran, is written and created by Sally Wainwright, and directed by Wainwright, Euros Lyn, and Tim Fywell.", "The first series debuted on BBC One on 29 April 2014, and the second series debuted on 9 February 2016.", "In May 2015, Happy Valley won the BAFTA Award for Best Drama Series.", "Sarah Lancashire initially said that she would not return for a third series, but later confirmed to the news media that she will return.", "However, no date has been set because Sally Wainwright has previous commitments to work on other projects.", "\"Sally has told us she wants to write another series, which will be the final one.", "We don't know when it will happen,\" Sarah Lancashire said in September 2016.", "Producer Nicola Shindler has confirmed that the series would not be broadcast until 2018 at the earliest.", "As of December 2018, no air date for the third series had been announced.", "Catherine Cawood (Sarah Lancashire) is a strong-willed police sergeant in West Yorkshire, still coming to terms with the suicide of her teenage daughter, Becky, eight years earlier." ], [ "Happy Valley (TV series)", "Another \"Daily Mail\" TV correspondent, Christopher Stevens, rated \"Episode 4\" with 5/5 stars, saying that \"every instalment has been unmissable\" and \"BAFTA bosses might as well get next year's trophy inscribed now\" for star Sarah Lancashire. Gerard O'Donovan of \"The Telegraph\" called \"Happy Valley\" \"complex, thrilling and brilliantly written and acted\", and \"one of the best watches of 2014.\"", "In May 2015, \"Happy Valley\" won the BAFTA Award for Best Drama Series.", "In 2014, it had won a TV Choice Award for Best New Drama; Sarah Lancashire was named Best Actress at the same time.", "The series was also voted the best TV programme of 2014 by readers of \"Radio Times\".", "BBC Shop released \"Happy Valley\" series one on DVD, in regions two and four, on 16 June 2014.", "The DVD includes two discs, featuring 351 minutes worth of footage, and has an age certificate of 15.", "All six episodes of the series were released on iTunes, both in standard and high definition.", "On 20 August 2014, the series was further released on Netflix in Canada and the USA, marketed as a \"Netflix Original\"." ], [ "Silicon Valley (TV series)", "The third season was released on DVD and Blu-ray on April 11, 2017; bonus features include deleted scenes.", "The fourth season was released on DVD and Blu-ray on September 12, 2017; bonus features include deleted scenes.", "In Australia, the series premiered on April 9, 2014, and aired on The Comedy Channel.", "In the United Kingdom, it premiered on July 16, 2014, airing on Sky Atlantic, while also being available on internet view-on-demand services such as Blinkbox.", "In New Zealand, the series airs on on the SoHo channel.", "In India, the series is available for streaming on Hotstar." ] ], "gold": "Happy Valley is a British crime drama television series filmed and set in the Calder Valley, West Yorkshire, in Northern England. There are 6 episodes in season 2 of Happy Valley and 12 total episodes in seasons 1 and 2 combined.", "prediction 1": "Happy Valley is a British crime drama television series filmed and set in the Calder Valley, West Yorkshire in Northern England. There are a total of 62 episodes in the second season, which consisted of 11 episodes in season 1 and 62 episodes in season 2.", "prediction 2": "Happy Valley is an American crime drama television series written and created by Sally Wainwright, and directed by Wainwright, Euros Lyn, and Tim Fywell. The series, starring Sarah Lancashire and Siobhan Finneran, is written and created by Wainwright, and directed by Wainwright, Euros Lyn, and Tim Fywell. There are 5 episodes in Season 2 of Happy Valley.", "prediction 3": "Happy Valley is a British crime drama television series filmed and set in the Calder Valley, West Yorkshire in Northern England. Season 2 has 16 episodes, which is the same as the number of episodes in season one, but with 2 extra episodes. There is also a 4th episode in the 2nd episode.", "prediction 4": "Happy Valley is a crime drama television series filmed and set in the Calder Valley, West Yorkshire in Northern England. Season 2 has 2 episodes. Season 2 of the first series had 9 episodes. Season 2 of the second series had 13 episodes.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 129, "end": 183 }, { "error type": "Redundant", "explanation": "There are a total of 62 episodes in the second season", "start": 227, "end": 255 }, { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 226 } ], "missing-info": [], "corrected-prediction": "Happy Valley is a British crime drama television series filmed and set in the Calder Valley, West Yorkshire in Northern England." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When will a hat in time be released?", "passages": [ [ "A Hat in Time", "A Hat in Time\n\nA Hat in Time is a platform action-adventure video game developed by Gears for Breakfast for macOS, Microsoft Windows, PlayStation 4 and Xbox One.", "The game was developed using Unreal Engine 3 and funded through a Kickstarter campaign, which doubled its fundraising goals within its first two days.", "It is inspired by earlier 3D platformers such as \"Super Mario 64\", \"Banjo-Kazooie\", and \"Psychonauts\".", "The game was self-published for Microsoft Windows and macOS in October 2017, and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later.", "A Nintendo Switch port will be released at a later date.", "\"A Hat in Time\" is a platform action-adventure game set in an open world environment and played from a third-person perspective.", "The gameplay style has been described by several editors to be similar to Nintendo 64 platformers such as \"Super Mario 64\" and \"Banjo-Kazooie\".", "The player travels between four open levels, which can be freely explored without time limits.", "The player can collect various items, solve puzzles, and use an umbrella to combat enemies.", "The primary objective is to collect \"Time Pieces\", 40 of which can be found in the game, which unlock additional levels as more are collected." ], [ "The Addams Family (2019 film)", "However, in 2013, it was announced that Metro-Goldwyn-Mayer (current rights holder of the original \"Addams Family\" series and current foreign rights holder of the 1991 \"Addams Family\" film) would produce an animated film based on the \"Addams Family\" comics, with Pamela Pettler writing the screenplay.", "In October 2017, it was announced that the film would be directed and produced by Conrad Vernon.", "Gail Berman and Alex Schwartz will produce the film, and Matt Lieberman will make revisions to the screenplay, and the film would be animated by Cinesite Studios, with Tabitha Shick overseeing the film for MGM.", "In December 2017, it was reported that Oscar Isaac was in talks to voice the role of Gomez Addams in the film.", "In June 2018, Isaac was confirmed for the voice cast, alongside the additions of Charlize Theron, Allison Janney, Bette Midler, Chlo\u00eb Grace Moretz, Finn Wolfhard and Nick Kroll.", "In July 2018, Aimee Garcia joined the voice cast.", "In August 2018, Elsie Fisher joined the voice cast.", "The film is scheduled to be released by Metro-Goldwyn-Mayer on October 18, 2019.", "It was previously set for October 11, 2019." ], [ "Jumanji: Welcome to the Jungle", "\"Jumanji: Welcome to the Jungle\" premiered at the Grand Rex in Paris on December 5, 2017, and was theatrically released in the United States on December 20 in RealD 3D and IMAX, by Sony Pictures Releasing under its Columbia Pictures label; unlike its predecessor, which was distributed by Tristar Pictures.", "The film received generally positive reviews from critics, who called it a \"pleasant surprise\" and praised the cast.", "It grossed over $962million worldwide, becoming the fifth-highest-grossing film of 2017 and the 42nd-highest-grossing film of all time.", "A sequel is scheduled to be released on December 13, 2019.", "In 1996 in Brantford, New Hampshire, teenager Alex Vreeke is given the Jumanji board game by his father, who found it on a beach.", "Uninterested, he sets the game aside.", "That night, it transforms into a video game cartridge which catches Alex's attention when he is awakened by the Jumanji drum beats.", "When he begins playing it, he disappears into the game.", "Twenty years later, four students at Brantford High School are given detention: Spencer Gilpin and his former friend Anthony \"Fridge\" Johnson for cheating, Bethany Walker for making a phone call during class, and Martha Kaply for talking back to her gym teacher." ] ], "gold": "A Hat in Time is a platform action-adventure game developed by Gears for Breakfast and published by Humble Bundle. The game was self-published for Microsoft Windows and macOS on October 5, 2017, and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later. The PS4 version was released on December 5, 2017 in North America and on December 6, 2017 in Europe. The Xbox One version was released on December 7, 2017. A version for the Nintendo Switch was released on October 18, 2019.", "prediction 1": "A Hat in Time is a platform action-adventure video game developed by Gears for Breakfast for macOS, Microsoft Windows, PlayStation 4 and Xbox One. The game was published for Microsoft Windows and macOS in October 2017, and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later. A Nintendo Switch port will be released at a later date. The Addams Family is an animated film based on the Addams Family comics. The film premiered at the Grand Rex in Paris on December 5, 2017, and was theatrically released in the United States on December 20, 2018. The Addams Family's Family is scheduled to be released by Metro-Goldwyn-Mayer on October 18, 2019.", "prediction 2": "A Hat in Time is a platform action-adventure video game developed by Gears for Breakfast for macOS, Microsoft Windows, PlayStation 4 and Xbox One. It was self-published for Microsoft Windows and macOS in October 2017, and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later. A Nintendo Switch port of A Hat in Time will be released at a later date. A Hat in Time trailer was released on Facebook on November 29, 2017. A Hat in Time is an app that is developed by Gears for iOS and Android. The game was released on September 27, 2018.", "prediction 3": "A Hat in Time is a platform action-adventure video game developed by Gears for Breakfast for macOS, Microsoft Windows, PlayStation 4 and Xbox One. The game was self-published for Microsoft Windows and macOS in October 2017 and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later. A Nintendo Switch port will be released at a later date. Jumanji: Welcome to the Jungle is an animated film based on the Addams Family comics, with Charlize The Addams Family is scheduled to be released on October 18, 2019. The Addams Family: The Addams Family is scheduled to be released in the United States on December 13, 2019.", "prediction 4": "A Hat in Time is a platform action-adventure video game developed by Gears for Breakfast for macOS, Microsoft Windows, PlayStation 4 and Xbox One. The game was self-published for Microsoft Windows and macOS in October 2017. A Nintendo Switch port will be released at a later date. The Addams Family (2019 film) premiered at the Grand Rex in Paris on December 5, 2017, and was theatrically released in the United States on December 20 in RealD 3D and IMAX, by Sony Pictures Releasing under its Columbia Pictures. A sequel is scheduled to be released on December 13, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 431 }, { "error type": "Irrelevant", "explanation": "", "start": 571, "end": 669 }, { "error type": "Irrelevant", "explanation": "", "start": 432, "end": 570 } ], "missing-info": [], "corrected-prediction": "A Hat in Time is a platform action-adventure video game developed by Gears for Breakfast. The game was published for Microsoft Windows and macOS in October 2017, and by Humble Bundle for the PlayStation 4 and Xbox One consoles two months later. A Nintendo Switch port will be released at a later date." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who played the medical examiner on law and order?", "passages": [ [ "Donald Cragen", "Donald Cragen\n\nDonald Cragen is a fictional character played by Dann Florek in the American crime drama television series \"Law & Order\" and its spinoff \"\" on NBC.", "Cragen started the series as a homicide captain with the New York Police Department, but then became captain of the department's Special Victims Unit.", "A recovering alcoholic, Cragen is a tough police veteran, but loyal to his officers.", "Florek starred in the first three seasons of \"Law & Order\" before he was fired from the show due to an order from NBC to add more female cast members.", "Before his termination, Florek had expressed disappointment with his character's lack of material.", "In 1999, series creator Dick Wolf reintroduced Florek to \"Special Victims Unit\", in which he reprised his role as Cragen from the show's to the .", "Having appeared in 400 episodes, Cragen has been in the second-most episodes of any character in the \"Law & Order\" franchise, surpassed only by Olivia Benson." ], [ "Who Done It (Dallas)", "Who Done It (Dallas)\n\n\"Who Done It\" is the fourth episode of the fourth season (1980\u201381 season) and 58th overall of the American television series \"Dallas\".", "The episode was written by Loraine Despres, and revealed who had shot J.R. Ewing (played by Larry Hagman) in the third season finale \"A House Divided\".", "The perpetrator's fate was revealed in the subsequent episode one week later.", "For an eight-month-long period of media frenzy after the broadcast of \"A House Divided\" episode (wherein \"Dallas\" archvillain J.R. Ewing was shot by an unidentified perpetrator while working in his office), international oddsmakers created a set of odds for the possible culprits.", "The favorite was Dusty Farlow, who was Sue Ellen Ewing's lover (Sue Ellen being J.R.'s wife), with odds installed at 6:4.", "Sue Ellen herself was given 25:1 odds, as was J.R.'s mother Miss Ellie Ewing.", "At 4:1 were Sue Ellen's sister and her husband's mistress, Kristin Shepard and banker Vaughn Leland, who fell victim to a J.R. swindle." ], [ "Law & Order: Special Victims Unit (season 2)", "Although Jeffries departed from the Special Victims Unit during the episode \"Asunder,\" her character was still present in the episode \"Runaway,\" which marked the character's final appearance.", "\"Runaway\" was originally intended to air before \"Asunder\" but was broadcast out of order.", "The retcon explanation in \"Runaway\" is that Detective Jeffries transferred to Vice and briefly stepped into the SVU squadroom again when they were in need of extra manpower for a case.", "Hurd was replaced by rapper-turned-actor Ice-T, who began portraying Detective Odafin \"Fin\" Tutuola.", "Stephanie March joined the cast as Assistant District Attorney Alexandra Cabot, the series using many guest actors and actresses to portray ADA characters in the .", "Tamara Tunie took on the recurring role of Medical Examiner Melinda Warner, replacing Leslie Hendrix's \"Law & Order\" character Chief Medical Examiner Elizabeth Rodgers.", "BD Wong began portraying FBI Forensic Psychiatrist closer to the end of the season, replacing Dr. Emil Skoda (J. K. Simmons).", "In the second episode \"Honor,\" Marshall Manesh played an Afghan diplomat and Anil Kumar played his son, both of whom follow Sharia law and condone honor killings." ] ], "gold": "The American television police procedural and legal drama Law & Order (1990\u20132010) follows the cases of a group of police detectives and prosecutors who represent the public interest in the criminal justice system. Known for its revolving cast, most of the original stars had left the show within the first five seasons. Medical examiner Dr. Elizabeth Rodgers was played by Leslie Hendrix, examiner Brody was played by Richard Hirschfeld, and examiner Borak was played by Josh Pais. The assistant medical examiner Anksel was played by Baron Vaughn.", "prediction 1": "On Law & Order, the medical examiner is played by Tamara Tunie. Leslie Hendrix played the chief medical examiner on the show. Tamara Tunie took on the recurring role of Medical Examiner Melinda Warner, replacing Elizabeth Rodgers.", "prediction 2": "On Law & Order and its spinoff, NBC has starred Tamara Tunie as Melinda Warner, the medical examiner. During Season 2, Tamara Tunie played the medical examiner. Leslie Hendrix played the chief medical examiner.", "prediction 3": "Leslie Hendrix played the role of chief medical examiner Elizabeth Rodgers on Law & Order. Tamara Tunie played the role of medical examiner Melinda Warner.", "prediction 4": "Tamara Tunie played the recurring role of Medical Examiner Melinda Warner, replacing Leslie Hendrix's Law & Order character Chief Medical Examiner Elizabeth Rodgers.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "On Law & Order, the medical examiner is played by Tamara Tunie. Leslie Hendrix played the chief medical examiner on the show. ", "start": 126, "end": 230 } ], "missing-info": [], "corrected-prediction": "On Law & Order, the medical examiner is played by Tamara Tunie. Leslie Hendrix played the chief medical examiner on the show. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who owns the rights to texas chainsaw massacre?", "passages": [ [ "The Texas Chainsaw Massacre (franchise)", "When comparing \"The Texas Chainsaw Massacre\" to the other top-grossing horror film series \u2013 \"A Nightmare on Elm Street\", \"Child's Play\", \"Friday the 13th\", \"Halloween\", the \"Hannibal Lecter\" series, \"Psycho\", \"Saw\", and \"Scream\" \u2013 and adjusting for the 2011 inflation, \"The Texas Chainsaw Massacre\" is the eighth highest grossing horror film series in the United States, with a combined gross of $304.6 million, only outperforming the \"Chucky\" film series with approximately $203\u00a0million.", "The series is led by \"Friday the 13th\" at $687.1\u00a0million, \"A Nightmare on Elm Street\" with $592.8\u00a0million, the Hannibal Lecter film series with $588.7\u00a0million, \"Halloween\" with $557.5\u00a0million, \"Saw\" with $457.4\u00a0million, \"Scream\" with $442.9\u00a0million, and the \"Psycho\" film series, with $376.3\u00a0million.", "Following the release of \"Leatherface\", the producers had the rights to make five more \"Texas Chainsaw Massacre\" films.", "In April 2015, producer Christa Campbell stated that the fate of the potential films would largely depend on the financial reception and perceived fan reactions regarding the 2017 prequel." ], [ "The Texas Chainsaw Massacre (franchise)", "Campbell clarified in December 2017 that Lionsgate and Millennium Films had lost the franchise rights due to the time it took to release it.", "On August 24, 2018, Legendary Pictures had bought the rights to the franchise, with a new film and a television series in development.", "Several comic books based on \"The Texas Chainsaw Massacre\" films were published in 1991 by Northstar Comics entitled \"Leatherface\".", "They were licensed as \"The Texas Chainsaw Massacre\" to Avatar Press for use in new comic book stories, the first of which was published in 2005.", "In 2006, Avatar Press lost the license to DC Comics imprint, Wildstorm, which has published new stories based on the films.", "However, in June 2007, Wildstorm changed a number of horror comics, including \"The Texas Chainsaw Massacre\", from monthly issues to specials and miniseries.", "The series of comics featured none of the main characters seen in the original film (Topps Comics \"Jason vs. Leatherface\" series is exempt) with the exception of Leatherface, however, the 1991 \"Leatherface\" miniseries was loosely based on the third \"Texas Chainsaw Massacre\" film.", "The writer of the miniseries, Mort Castle said, \"The series was very loosely based on \"Texas Chainsaw Massacre III\"." ], [ "Texas Chainsaw 3D", "In March 2015 Hollywood Collectibles released a 20-inch Leatherface action figure, based on Dan Yeager portrayed figure.", "In January 2013, it was revealed that due to the film's financial success, Millennium Films began planning a sequel film to be called \"Texas Chainsaw 4\" which was expected to begin filming later in 2013 in the state of Louisiana.", "Millennium Films Chairman Avi Lerner stated that the project was brought to him by Christa Campbell and Lati Grobman and that Millennium had signed on to produce, with Lionsgate distributing the finished product.", "Executive producer Mark Burg clarified that the sequel was prematurely announced and had not been authorised, \"The rights are controlled by Carl [Mazzocone] and Main Line Pictures, no matter what Millennium says.", "Millennium simply sold the foreign rights and they will not tell us when a sequel is ready to be made.", "The script was developed by Carl, myself and writer/director John Luessenhop.", "Maybe they're looking for something to sell at Berlin, but they have no right to announce this sequel.\"", "Ultimately, a prequel titled \"Leatherface\" was released by Lionsgate and Millennium Films in October 2017, from a pitch by writer Seth M. Sherwood focusing on the origin of the eponymous killer." ] ], "gold": "Lionsgate and Millennium Films owned the rights to Texas Chainsaw Massacre in 2013 but lost the rights in 2017 due to the time it took to release more Texas Chainsaw Massacre films. On August 24, 2018, Legendary Pictures had bought the rights to the franchise, with a new film and a television series in development.", "prediction 1": "Legendary Pictures bought the rights to the Texas Chainsaw Massacre franchise in 2018 and plans to develop a new film based on the franchise.", "prediction 2": "Legendary Pictures has bought the rights to the Texas Chainsaw Massacre franchise for a reported $120 million. Legendary Pictures has produced a new film and a television series in development. The rights to the Texas Chainsaw Massacre comic book series were licensed as \"The Texas Chainsaw Massacre\" to Avatar Press for use in new comic book stories. In 2017, a prequel to the original film was released by Lionsgate and Millennium Films. In 2018, Legendary Pictures acquired the rights to the original film and the prequel.", "prediction 3": "The Texas Chainsaw Massacre franchise is a horror film franchise that has been produced by several studios. As of 2017, Lionsgate and Millennium Films owned the rights to the franchise. In 2018, Legendary Pictures bought the rights to the franchise, with a new film in development.", "prediction 4": "Several film and comic book series based on The Texas Chainsaw Massacre have been published since the 1991 film's release in 1991. The Texas Chainsaw Massacre films are a horror film franchise which has been produced by several companies. The first two films, Texas Chainsaw Massacre III and the 2017 prequel, were produced by Lionsgate and Millennium Films. The rights to the Texas Chainsaw Massacre franchise were owned by Carl Mazzocone and Main Line Pictures. Legendary Pictures bought the rights to the franchise on August 24, 2018, and a new film and a television series in development.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lionsgate and Millennium Films owned the rights to Texas Chainsaw Massacre, but lost them due to the time it took to release it. Legendary Pictures bought the rights to the Texas Chainsaw Massacre franchise in 2018 and plans to develop a new film and television series based on the franchise." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "The french declaration of the rights of man and citizen was influenced by the writings of?", "passages": [ [ "Declaration of the Rights of Man and of the Citizen", "In August 1789, Honor\u00e9 Mirabeau played a central role in conceptualizing and drafting the Declaration of the Rights of Man and of the Citizen.", "The last article of the Declaration of the Rights of Man and the Citizen was adopted on the 26 of August 1789 by the National Constituent Assembly, during the period of the French Revolution, as the first step toward writing a constitution for France.", "Inspired by the Enlightenment, the original version of the Declaration was discussed by the representatives on the basis of a 24 article draft proposed by , led by .", "The draft was later modified during the debates.", "A second and lengthier declaration, known as the Declaration of the Rights of Man and Citizen of 1793, was written in 1793 but never formally adopted.", "The concepts in the Declaration come from the philosophical and political duties of the Enlightenment, such as individualism, the social contract as theorized by the Genevan philosopher Rousseau, and the separation of powers espoused by the Baron de Montesquieu.", "As can be seen in the texts, the French declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as was the U.S. Declaration of Independence which preceded it (4 July 1776)." ], [ "Marie Antoinette", "The abolition of feudal privileges by the National Constituent Assembly on 4 August 1789 and the Declaration of the Rights of Man and of the Citizen (\"La D\u00e9claration des Droits de l'Homme et du Citoyen\"), drafted by Lafayette with the help of Thomas Jefferson and adopted on 26 August, paved the way to a Constitutional Monarchy (4 September 1791 \u2013 21 September 1792).", "Despite these dramatic changes, life at court continued, while the situation in Paris was becoming critical because of bread shortages in September.", "On 5 October, a crowd from Paris descended upon Versailles and forced the royal family to move to the Tuileries Palace in Paris, where they lived under a form of house arrest under the watch of Lafayette's \"Garde nationale\", while the comte de Provence and his wife were allowed to reside in the Petit Luxembourg, where they remained until they went into exile on 20 June 1791.", "Marie Antoinette continued to perform charitable functions and attend religious ceremonies, but dedicated most of her time to her children.", "She also played an important political, albeit not public, role between 1789 and 1791 when she had a complex set of relationships with several key actors of the early period of the French Revolution.", "One of the most important was Necker, the Prime Minister of Finances (\"Premier ministre des finances\").", "Despite her dislike of him, she played a decisive role in his return to office." ] ], "gold": "The Declaration of the Rights of Man and of the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The concepts in the Declaration come from the philosophical and political duties of the Enlightenment, such as individualism, the social contract as theorized by the Genevan philosopher Rousseau, and the separation of powers espoused by the Baron de Montesquieu. As can be seen in the texts, the French declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as was the U.S. Declaration of Independence which preceded it (4 July 1776).", "prediction 1": "The French Declaration of the Rights of Man and the Citizen, or La D\u00e9claration des Droits de l'Homme et du Citoyen, was drafted in August 1789 by honor\u00e9 Mirabeau and adopted on 26 August 1789 by the National Constituent Assembly, during the period of the French Revolution, as the first step toward writing a constitution for France. The Declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as the U.S. Declaration of Independence which preceded it (4 July 1776).", "prediction 2": "The French Declaration of the Rights of Man and of the Citizen was heavily influenced by the political philosophy of the Enlightenment and principles of human rights. It was also heavily influenced by the writings of John Locke.", "prediction 3": "In August 1789, Honor\u00e9 Mirabeau played a central role in conceptualizing and drafting the Declaration of the Rights of Man and the Citizen. The last article of the Declaration was adopted on the 26 of August 1789 by the National Constituent Assembly, during the period of the French Revolution, as the first step toward writing a constitution for France. The French declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as was the U.S. Declaration of Independence which preceded it.", "prediction 4": "The French Declaration of the Rights of Man and of the Citizen, which outlines the rights of the man and the citizen, was written by Honor\u00e9 Mirabeau and drafted by Lafayette. According to the texts, the French declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as was the U.S. Declaration of Independence, which preceded it on 4 July 1776. Also, the abolition of feudal privileges by the National Constituent Assembly, on 4 August 1789, and the Declaration of the Rights of Man and of the Citizen, which was drafted by Jefferson and adopted on 26 August 1789.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 115 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The French Declaration of the Rights of Man and the Citizen was drafted in August 1789 by honor\u00e9 Mirabeau and adopted on 26 August 1789 by the National Constituent Assembly, during the period of the French Revolution. The concepts in the Declaration come from the philosophical and political duties of the Enlightenment, such as individualism, the social contract as theorized by the Genevan philosopher Rousseau, and the separation of powers espoused by the Baron de Montesquieu. The Declaration was heavily influenced by the political philosophy of the Enlightenment and principles of human rights as the U.S. Declaration of Independence which preceded it (4 July 1776)." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who was the first batsman to be given out by third umpire?", "passages": [ [ "Third umpire", "Third umpire\n\nThe third umpire (or TV Umpire) is an off-field umpire in international cricket matches who makes the final decision in questions referred to him by the two on-field umpires.", "Television replays and other technology are available to the third umpire to assist him in coming to a decision.", "An on-field umpire can, at his own discretion, use a radio link to refer any close decision concerning dismissals (catches, runouts or stumpings) or boundaries to the third umpire.", "Also players can initiate reviews of particular decisions by the on-field umpires, which are judged by the third umpire.", "The third umpire was conceptualized by former Sri Lankan domestic cricketer, and current cricket writer Mahinda Wijesinghe and debuted in Test cricket in November 1992 at Kingsmead, Durban for the South Africa vs. India series.", "Karl Liebenberg was the third umpire with Cyril Mitchley the on-field umpire, referring the run-out decision in this match.", "Sachin Tendulkar became the first batsman to be dismissed (run out) by using television replays in the second day of the Test scoring 11.", "In many cases of run out or stumped, the event occurs in a fraction of a second." ], [ "Kepler Wessels", "Kepler Wessels\n\nKepler Christoffel Wessels (born 14 September 1957) is a former South African cricketer who captained South Africa after playing 24 Tests for Australia.", "He was the first man to have played One Day International cricket for two countries.", "He was a left-handed opening batsman.", "He played first-class cricket for Orange Free State, Western Province, Northern Transvaal, Eastern Province and Griqualand West in South Africa, for Queensland in Australia and Sussex in England.", "In 2008, he coached the Indian Premier League franchise Chennai Super Kings and later returned to coaching in South Africa.", "Wessels was six years old when he was introduced to the game of cricket by his sister's boyfriend, Johan Volsteedt.", "Volsteedt taught him the basics of the game and began to regularly play cricket with him during Sunday visits to the Wessels household.", "A few years later, Volsteedt became the master in charge of cricket at Grey College, Bloemfontein, and coached Wessels during his playing days for the school's first team.", "From a very early age, Wessels showed exceptional sporting talent.", "By the age of 12, he was playing rugby union for the Free State primary schools team and he was one of the leading schoolboy swimmers in the province." ], [ "Sachin Tendulkar", "Sachin Tendulkar\n\nSachin Ramesh Tendulkar (; born 24 April 1973) is a former Indian international cricketer and a former captain of the Indian national team, regarded as the greatest batsman of all time.", "He is the highest run scorer of all time in International cricket.", "Tendulkar took up cricket at the age of eleven, made his Test debut on 15 November 1989 against Pakistan in Karachi at the age of sixteen, and went on to represent Mumbai domestically and India internationally for close to twenty-four years.", "He is the only player to have scored one hundred international centuries, the first batsman to score a double century in a ODI, the holder of the record for the most number of runs in both Test and ODI, and the only player to complete more than 30,000 runs in international cricket.", "He is colloquially known as Little Master or Master Blaster, and often referred to as the God of Cricket by Indian cricket followers.", "Despite his reputation, he is known for his modesty and humility, once stating \"\"I am not the God of cricket.", "I make mistakes, God doesn\u2019t\"\".", "In 2001, Sachin Tendulkar became the first batsman to complete 10,000 ODI runs in his 259 innings." ] ], "gold": "Several batsmen were the first to be given an out by a third umpire. Sachin Tendulkar, a former international cricketer of India, was the first to in test cricket, a form of the sport of cricket. Kepler Wessels, a South African-Australian cricket commentator and former cricketer, was the first to in an ODI, or One Day International, which is a form of limited overs cricket.", "prediction 1": "The third umpire is an off-field umpire in international cricket matches who makes the final decision in questions referred to him by the two on-field umpires. During the 1992-93 Test series between South Africa and India, Sachin Tendulkar became the first batsman to be run out by using television replays in the second day of the Test scoring 11.", "prediction 2": "The first batsman to be given out by a third umpire is Sachin Tendulkar. Sachin Tendulkar became the first batsman to be given out by a third umpire by using television replays in the second day of the Test scoring 11.", "prediction 3": "The third umpire is an off-field umpire in international cricket matches who makes the final decision in questions referred to him by the two on-field umpires. Sachin Tendulkar became the first batsman to be given out by TV Umpire in the second day of the Test scoring 11.", "prediction 4": "The third umpire is an off-field umpire in international cricket matches who makes the final decision in questions referred to him by the two on-field umpires. The first batsman to be given out by the third umpire was Sachin Tendulkar. Sachin Tendulkar became the first batsman to be given out by the third umpire when he scored 11 runs in the second day of the Test.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 337, "end": 348 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Former Indian international cricketer Sachin Tendulkar became the first batsman to be run out by using television replays in the second day of the Test." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "How far is methuen ma from boston ma?", "passages": [ [ "Massachusetts Route 213", "Massachusetts Route 213\n\nRoute 213 is a short 3\u00bd mile state highway in Massachusetts.", "It connects Interstate 93 with Interstate 495 in Methuen, Massachusetts, just south of the New Hampshire border.", "It is a four-lane, controlled access highway along its entire length.", "The highway is a northern bypass of Route 113, which serves the downtown area, and derives its own number from it.", "There is a nearby shopping center known as The Loop, so called because of the designation of Route 213 as the 'Loop Connector'.", "According to MassDOT, Route 213 carries approximately 45,000 vehicles per day.", "Route 213 begins in the west as an offshoot of I-93 at its northernmost exit in Massachusetts, Exit 48, just south of the New Hampshire state line.", "It begins by traveling to the east for less than a half mile before meeting Route 28 (Broadway) at Exit 2.", "Route 28 southbound provides access to the downtown area which Route 213 bypasses (it is a northern bypass of Route 113, which cuts west-to-east through the city).", "Route 28 northbound parallels I-93, crossing into Salem, New Hampshire and becoming New Hampshire Route 28 after approximately one-half mile.", "Route 213 contiunues eastward for about another mile before interchanging with Route 113 (Pleasant Street), with access between Route 113 and westbound Route 213 facilitated by nearby Howe Street." ], [ "Phil Bredesen", "Bredesen grew up in Shortsville, New York, 30 miles from Rochester.", "He attended Red Jacket Central Elementary and Secondary School in the adjoining village of Manchester.", "He received a scholarship to Harvard University, where he graduated with an undergraduate degree in physics.", "In 1967, Bredesen moved to Lexington, Massachusetts, where he did classified work for Itek and received a draft deferment during the Vietnam War.", "In 1968, Bredesen worked for the campaign of Minnesota Senator Eugene McCarthy, who was seeking the Democratic presidential nomination.", "Bredesen launched his first political campaign in 1969, when he ran for the Massachusetts State Senate.", "He was defeated by a popular incumbent Republican, Ronald MacKenzie.", "Bredesen joined pharmaceutical firm G.D. Searle & Company in 1971, and moved to London in 1973 to manage one of the company's divisions.", "In 1974, he married Andrea Conte.", "In 1975, the family moved to Nashville, Tennessee, where Conte had been recruited by Hospital Corporation of America.", "In Nashville, Bredesen founded HealthAmerica Corp., an insurance company.", "He sold his controlling interest in HealthAmerica in 1986, and because of the wealth he earned from the company, did not accept his gubernatorial salary.", "In 1987, Bredesen ran for mayor of Nashville." ] ], "gold": "Methuen ma is 30 miles, or 48 km from Boston, MA.", "prediction 1": "Massachusetts Route 213 is a short 312 mile state highway in Massachusetts. It connects Interstate 93 with Interstate 495 in Methuen, Massachusetts, just south of the New Hampshire border. The highway is a northern bypass of Route 113, which serves the downtown area, and derives its own number from it. There is a nearby shopping center known as The Loop, so called because of the designation of Route 213 as the 'Loop Connector'.\n", "prediction 2": "Massachusetts has a population of 37,657 that live in the 32-county area. The population of Mystic, Massachusetts is 2,392. There are about 15,000 residents in the four-county area. The city of Methuen is 761 miles (840 km) southeast of Boston. The city's closest airport is located in Greenwich.", "prediction 3": "In 2017, a compass showed the distance between Boston, Massachusetts and Methuen, Massachusetts at 102 miles. This distance is corrected using the midway point between Boston and Methuen, Massachusetts, and using the distance between Boston and Methuen using the value of 20 miles.", "prediction 4": "New Hampshire is 23 miles southwest of Boston, and Methuen is 36 miles southwest of Boston.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 303 }, { "error type": "Irrelevant", "explanation": "", "start": 304, "end": 432 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where did the name one direction come from?", "passages": [ [ "Niall Horan", "At bootcamp, Niall sang \"Champagne Supernova\", but failed to qualify for the \"Boys\" category.", "After a suggestion from guest judge Nicole Scherzinger, Niall was put into a group with four other boys, who also failed to move on in the competition, but since they were too good to let go, the judges decided to agree with Nicole.", "Niall, along with Harry Styles, Liam Payne, Louis Tomlinson and Zayn Malik, formed One Direction.", "Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows.", "Subsequently, the group got together for two weeks to get to know each other and to practice.", "For their qualifying song at \"judges' houses\" and their first song as a group, One Direction sang an acoustic version of \"Torn\".", "Simon Cowell later commented that the performance convinced him that the group \"were confident, fun, like a gang of friends, and kind of fearless as well.\"", "Within the first four weeks of the live shows, they were Cowell's last act in the competition.", "During the competition, the band performed different songs such as Kelly Clarkson's \"My Life Would Suck Without You\" and Bonnie Tyler's \"Total Eclipse of the Heart\", quickly gaining popularity in the UK." ], [ "One Direction", "One Direction\n\nOne Direction is an English-Irish pop boy band based in London, composed of Niall Horan, Liam Payne, Harry Styles, Louis Tomlinson, and, until his departure from the band in 2015, Zayn Malik.", "The group signed with Simon Cowell's record label Syco Records after forming and finishing third in the seventh series of the British televised singing competition \"The X Factor\" in 2010.", "Propelled to international success by social media, One Direction's five albums, \"Up All Night\" (2011), \"Take Me Home\" (2012), \"Midnight Memories\" (2013), \"Four\" (2014), and \"Made in the A.M.\" (2015), topped charts in most major markets, and generated hit singles including \"What Makes You Beautiful\", \"Live While We're Young\", \"Best Song Ever\", \"Story of My Life\" and \"Drag Me Down\".", "The group has received numerous accolades including seven Brit Awards, four MTV Video Music Awards, six \"Billboard\" Music Awards, seven American Music Awards (including Artist of the Year in 2014 and 2015), and 28 Teen Choice Awards.", "In 2013, they earned an estimated $75 million becoming the second highest earning celebrity under 30 according to \"Forbes\"." ] ], "gold": "One Direction, often shortened to 1D, are an English-Irish pop boy band formed in London, England in 2010. The group are composed of Niall Horan, Liam Payne, Harry Styles and Louis Tomlinson; former member Zayn Malik departed from the group in March 2015. The group signed with Simon Cowell's record label Syco Records after forming and finishing third in the seventh series of the British televised singing competition The X Factor in 2010. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows.", "prediction 1": "One Direction is an English-Irish pop boy band based in London, composed of Niall Horan, Harry Styles, Liam Payne, Louis Tomlinson and Zayn Malik. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows. Subsequently, the group got together for two weeks to get to know each other and to practice.", "prediction 2": "The name One Direction comes from the British pop boy band One Direction, which is an English-Irish pop band based in London, which was formed in 2010 as a result of four boys competing on the singing competition The X Factor. Harry Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows. The group got together for two weeks to get to know each other and to practice, and Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows.", "prediction 3": "One Direction is an English-Irish pop boy band based in London. The group formed after four other boys failed to move on in the competition. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows. The name One Direction also comes from a song by the band called One Direction, which came out in 2012.", "prediction 4": "One Direction is an English-Irish pop boy band based in London, composed of Niall Horan, Liam Payne, Harry Styles, Louis Tomlinson and Zayn Malik. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows. The group got together for two weeks to get to know each other and to practice. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 284, "end": 377 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "One Direction is an English-Irish pop boy band based in London, composed of Niall Horan, Harry Styles, Liam Payne, Louis Tomlinson and, until his departure in 2015, Zayn Malik. The group signed with Simon Cowell's record label Syco Records after forming and finishing third in the seventh series of the British televised singing competition \"The X Factor\" in 2010. Styles came up with the band name, which he thought would sound good when announcer Peter Dickson read their name out on the live shows. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who does the voice of meg from family guy?", "passages": [ [ "Rachael MacFarlane", "She later worked in the College Guidance and Admissions Offices at the Kent School, a selective college preparatory school where Ronald also was a teacher.", "MacFarlane went to Boston Conservatory but did not graduate before moving to Los Angeles to begin a career in voice acting.", "MacFarlane first started voicing characters on Hanna-Barbera shows including \"Johnny Bravo\" and \"Dexter's Laboratory\".", "Then after her work with Hanna-Barbera ended, MacFarlane began voicing many characters on Cartoon Network.", "In addition to voice acting, Rachael has also been involved in other aspects of animation, such as being a production manager for \"The Grim Adventures of Billy & Mandy\" and \"Welcome to Eltingville\", and wrote an episode of \"The Grim Adventures of Billy & Mandy\", titled \"Educating Grim\" - where she also met her husband.", "Seth MacFarlane asked her to help him with his new pilot for the Fox Broadcasting Company, which would become \"Family Guy\".", "Rachael MacFarlane worked on the show providing incidental voices, and her brother told her she was good at it and asked her to stay, prompting her to move from New York City to Los Angeles." ], [ "Mila Kunis", "All who auditioned were required to be at least 18 years old; Kunis, who was 14 at the time, told the casting directors she would be 18 but did not say when.", "Though they eventually figured it out, the producers still thought Kunis was the best fit for the role.", "\"That '70s Show\" ran for eight seasons.", "She won two consecutive \"Young Star Awards\" as Best Young Actress in a Comedy TV Series in 1999 and 2000 for her performances.", "In 1999, Kunis replaced Lacey Chabert in the role of Meg Griffin on the animated sitcom \"Family Guy\", created by Seth MacFarlane for Fox.", "Kunis won the role after auditions and a slight rewrite of the character, in part due to her performance on \"That '70s Show\".", "When Kunis auditioned for the role, she was called back by MacFarlane, who instructed her to speak slower.", "He then told her to come back another time and enunciate more.", "Once she claimed that she had it under control, MacFarlane hired her.", "MacFarlane added: \"What Mila Kunis brought to it was in a lot of ways, I thought, almost more right for the character.", "I say that Lacey did a phenomenal job, but there was something about Mila\u00a0\u2013 something very natural about Mila." ], [ "Mila Kunis", "Mila Kunis\n\nMilena Markovna \"Mila\" Kunis (; Ukrainian: \u041c\u0456\u043b\u0435\u043d\u0430 \u041c\u0430\u0440\u043a\u043e\u0432\u043d\u0430 \u041a\u0443\u043d\u0456\u0441; born August 14, 1983) is an American actress.", "In 1991, at the age of seven, she moved from Soviet Ukraine to the United States with her family.", "After being enrolled in acting classes as an after-school activity, she was soon discovered by an agent.", "She appeared in several television series and commercials, before acquiring her first significant role at age 14, playing Jackie Burkhart on the television series \"That '70s Show\" (1998\u20132006).", "Since 1999, she has voiced Meg Griffin on the animated series \"Family Guy\".", "Kunis' breakout film role came in 2008, playing Rachel in the romantic comedy \"Forgetting Sarah Marshall\".", "She gained further critical acclaim and accolades for her performance in the psychological thriller \"Black Swan\" (2010), for which she received the Marcello Mastroianni Award for Best Young Actor or Actress, and nominations for the SAG Award and the Golden Globe Award for Best Supporting Actress." ] ], "gold": "In the Family Guy original pilot, Rachael MacFarlane, sister of Family Guy creator Seth McFarlane, does the voice of Meg. In the first season of Family Guy, Lacey Chabert does the voice of Meg; however, Lacey Chabert left the series after the first season because of time conflicts with schoolwork and her role on Party of Five. Mila Kunis replaced Lacey Chabert in the role and has been the voice of Meg Griffin since 1999. Mila Kunis won the role after auditions and a slight rewrite of the character, in part due to her performance on That '70s Show. In Family Guy episodes, Meg's singing voice is performed by Tara Strong except in the episode Stewie Griffin The Untold Story where Ali Hillis does Meg's singing voice.", "prediction 1": "In 1999, Mila Kunis replaced Lacey Chabert in the role of Meg Griffin on the animated sitcom Family Guy, created by Seth MacFarlane for Fox. Kunis won the role after auditions and a slight rewrite of the character, in part due to her performance on \"That '70s Show\". In 2016, Mila Kunis played Meg Griffin's grandmother, Maggie Griffin. The character was voiced by Rachael MacFarlane from 1996-2017.", "prediction 2": "Mila Kunis, who is an American actress who is best known for her role as Jackie Burkhart on the television series That '70s Show, voices Meg Griffin on the animated sitcom Family Guy. Her voice was replaced by Lacey Chabert in 1999.", "prediction 3": "Mila Kunis was hired to voice the character of Meg Griffin in the animated television series Family Guy. In 1999, Kunis replaced Lacey Chabert as the voice of Meg Griffin on the animated sitcom Family Guy.", "prediction 4": "Mila Kunis, an American actress, voiced Meg Griffin on the animated sitcom Family Guy. In 1999, Kunis replaced Lacey Chabert in the role of Meg Griffin on the animated sitcom Family Guy, created by Seth MacFarlane for Fox.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 336 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6,7]}", "start": 337, "end": 399 } ], "missing-info": [], "corrected-prediction": "In 1999, Mila Kunis replaced Lacey Chabert in the role of Meg Griffin on the animated sitcom Family Guy, created by Seth MacFarlane for Fox. Kunis won the role after auditions and a slight rewrite of the character, in part due to her performance on \"That '70s Show\". Rachael MacFarlane worked on the show providing incidental voices, after her brother Seth asked her to help with the pilot." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "How many episodes are there in the future diary?", "passages": [ [ "Future Diary", "Kadokawa Shoten produced a visual novel based on the manga titled for the PlayStation Portable, was released on January 28, 2010 in Japan.", "A re-release with new graphics, artwork and featuring the voice actors from the anime was released on April 26, 2012.", "An 11-episode live action drama titled \"\" aired between April 21 and June 30, 2012 on Fuji TV.", "The TV series has an original plot line that differs from the manga and anime.", "The opening theme is \"Another World\" by Ko Shibasaki.", "During mid-November 2008, the seventh volume of the \"Future Diary\" manga ranked as the twenty-first best selling manga in Japan.", "The volume remained in the top 30 during the following week, though it dropped to twenty-fifth place.", "As of April 2012, it has sold 4 million copies in Japan.", "The Japanese name of this series is the inspiration for the naming of the Mirai botnet program." ], [ "Sakae Esuno", "Sakae Esuno\n\nSakae Esuno is a Japanese manga artist from Shizuoka.", "He is best known for his manga series \"Future Diary\" and \"Big Order\".", "Esuno started drawing at age 15, at the time he was an admirer of the works of Rumiko Takahashi in particular her horror manga \"Mermaid Saga\".", "After working as a manga assistant for many years he managed to become a professional manga artist when his story won a prize in a contest held by Kadokawa Shoten in 2001.", "In the 2017 May issue of Monthly Sh\u014dnen Ace magazine, he launched a new manga titled \"Tantei Akechi wa Ky\u014dran su (The Detective Akechi is Berserk)\" a tribute to the works of Edogawa Ranpo." ], [ "Future Diary", "Future Diary\n\nEsuno has also authored three side-story manga, each one spanning five chapters: first \"Future Diary: Mosaic\" which focuses on another Diary Holder, Minene Uryu, and tells unrevealed plot points of the main story; in 2009-2010, \"Future Diary: Paradox\" (published in \"Young Ace\"), which tells the exploits of Aru Akise and Muru Muru set in an alternate timeline, and in 2013, \"Future Diary: Redial\", which serves as an epilogue to the series.", "Yukiteru Amano is a 14-year-old shy, daydreaming loner who observes life and jots down the events on his cell phone.", "His only friends are Deus Ex Machina, the God of Space and Time, and his assistant Muru Muru.", "Deus transforms Yukiteru's phone into a Future Diary, capable of predicting the future up to ninety days.", "Yukiteru discovers he and eleven others are part of a survival game orchestrated by Deus.", "The aim of this game is to eliminate the other diary holders, the winner succeeding Deus as god and can prevent the Apocalypse.", "Yukiteru finds himself protected by Yuno Gasai, a charming but psychopathic classmate who obsessively stalks him after they promised to go stargazing together a year before." ] ], "gold": "Future Diary is a Japanese manga series written and illustrated by Sakae Esuno. The plot depicts the Diary Game, a deadly battle royal between 12 different individuals who are given Future Diaries, special diaries that can predict the future, by Deus Ex Machina, the God of Time and Space, with the last survivor becoming his heir. A 26-episode anime television series produced by Asread, aired in Japan between October 2011 and April 2012. An 11-episode live action drama titled \"Future Diary: Another:World\" aired between April 21 and June 30, 2012 on Fuji TV. The TV series has an original plot line that differs from the manga and anime.", "prediction 1": "There are a total of 12 episodes in the Future Diary manga, which runs from Chapter 1 to Chapter 15. There are also 11 episodes in the live action drama and 3 episodes in the visual novel.", "prediction 2": "In the manga series Future Diary, Sakae Esuno and Muru Muru are the main characters. There are 14 episodes in the manga. In the live action TV series Future Diary: The Next World, there are 11 episodes.", "prediction 3": "In the Japanese manga series Future Diary, there are a total of 17 episodes. In the Japanese anime series Future Diary, there are a total of 8 episodes. In the live action series Future Diary: The Game, there are 11 episodes.", "prediction 4": "Sakae Esuno is a Japanese manga artist best known for his series Future Diary. In the original manga, there were 10 episodes, and in the anime, there were 11. In the live action drama, there were 11 episodes, and in the manga, there were 10 episodes. In the anime, there were 11 episodes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 59 }, { "error type": "Unverifiable", "explanation": "", "start": 12, "end": 32 }, { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 100 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 157, "end": 167 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sakae Esuno is a Japanese manga artist known for his manga series \"Future Diary\". There are also 11 episodes in the live action drama, which aired between April 21 and June 30, 2012 on Fuji TV. The TV series has an original plot line that differs from the manga and anime. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Largest stock exchanges in africa by market capitalisation?", "passages": [ [ "Casablanca Stock Exchange", "Casablanca Stock Exchange\n\nThe Casablanca Stock Exchange (; ) is a stock exchange in Casablanca, Morocco.", "The Casablanca Stock Exchange (CSE), which achieves one of the best performances in the region of the Middle East and North Africa (MENA), is Africa's third largest Bourse after Johannesburg Stock Exchange (South Africa) and Nigerian Stock Exchange in Lagos.", "It was established in 1929 and currently has 19 members and 81 listed securities with a total market capitalisation of $71.1 billion in 2018.", "The exchange is relatively modern, having experienced reform in 1993.", "The CSE installed an electronic trading system, and is now organized as two markets: the Central Market and a Block Trade Market, for block trades.", "In 1997 the CSE opened a central scrip depository, Maroclear.", "Originally, CSE had the \"Index de la Bourse des Valeurs de Casablanca\" (IGB) as an index.", "IGB was replaced in January 2002 by two indexes:\n\nMASI (\"Moroccan All Shares Index\"), comprises all listed shares, allows investors to follow all listed values and to have a long-term visibility.", "MADEX (\"Moroccan Most Active Shares Index\"), comprises most active shares listed continuously with variations closely linked to all the market serves as a reference for the listing of all funds invested in shares." ], [ "JSE Limited", "JSE Limited\n\nJSE Limited (previously the JSE Securities Exchange and the Johannesburg Stock Exchange) is the oldest existing and largest stock exchange in Africa.", "It is situated at the corner of Maude Street and Gwen Lane in Sandton, Johannesburg, South Africa.", "In 2003 the JSE had an estimated 472 listed companies and a market capitalisation of US$182.6 billion (\u20ac158 billion), as well as an average monthly traded value of US$6.399 billion (\u20ac5.5 billion).", "As of 31 December 2013, the market capitalisation of the JSE was at US$1,007 billion.", "The discovery of gold on the Witwatersrand in 1886 led to many mining and financial companies opening and a need soon arose for a stock exchange.", "The first share transactions on the Rand took place in a rustic canvas tent, with trade taking place on Sundays, as this was the only day when mining was not allowed, owing to a strictly enforced regulation prohibiting the entry of African workers to the gold reefs.", "The \"Johannesburg Exchange & Chambers Company\" was established by a London businessman, Benjamin Minors Woollan and housed at the corner of Commissioner and Simmonds Streets.", "Out of this the JSE was born on 8 November 1887." ] ], "gold": "JSE Limited, located in Johannesburg, South Africa, is the longest stock exchange market in Africa by market capitalization, with an estimated value of US$1,005 billion. There are around 473 companies listed on the market and it averages a monthly trading value of US$6.399 billion.", "prediction 1": "The largest stock exchange in Africa in terms of market capitalisation (market capitalisation) is the Johannesburg Stock Exchange in South Africa. It is the oldest existing stock exchange in Africa and the largest stock exchange in Africa by market capitalisation.", "prediction 2": "The largest stock exchange in Africa by market capitalisation is the JSE in Johannesburg, South Africa. Johannesburg Stock Exchange is the oldest existing and largest stock exchange in Africa, with a market capitalisation of USD182.6 billion in 2003. The largest stock exchange in Africa by market capitalisation is the Casablanca Stock Exchange, in Casablanca, Morocco.", "prediction 3": "The oldest existing and largest stock exchange in Africa is the Johannesburg Stock Exchange, situated at the corner of Maude Street and Gwen Lane in Sandton, Johannesburg, South Africa. The Casablanca Stock Exchange is Africa's third largest Bourse after the Johannesburg Stock Exchange, which is based in Johannesburg, South Africa. In 2018, the CSE had a market capitalisation of $71.1 billion, and in 2003 the JSE had a market capitalisation of US$182.6 billion.", "prediction 4": "The market capitalisation of the largest stock exchanges in Africa is the market capitalisation of the largest listed companies. The largest stock exchange by market capitalisation is the Johannesburg Stock Exchange, Africa's oldest existing and largest stock exchange.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The largest stock exchange in Africa in terms of market capitalisation (market capitalisation) is the Johannesburg Stock Exchange ", "start": 202, "end": 264 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 197 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The largest stock exchange in Africa in terms of market capitalization is the Johannesburg Stock Exchange in South Africa. In 2003 the JSE had an estimated 472 listed companies and it averages monthly traded value of US$6.399 billion. As of 31 December 2013, the market capitalization of the JSE was at US$1,007 billion." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Longest continuously serving female mp in house of commons?", "passages": [ [ "Women in the House of Commons of the United Kingdom", "She was MP for Peckham from 28 October 1982 until 1 May 1997, and has served as MP for Camberwell and Peckham since 1 May 1997, most recently having been re-elected on 8 June 2017.", "On 13 June 2017 Harman was dubbed \"Mother of the House\" by Prime Minister Theresa May, in recognition of her status as longest continuously serving woman MP (though she was not the longest serving MP overall, and would therefore not gain any official duties).", "There are currently 208 female MPs in the House of Commons.", "", "\n\nIn February 2018 the Electoral Reform Society reported that hundreds of seats were being effectively 'reserved' by men, holding back women\u2019s representation.", "Their report states that 170 seats are being held by men first elected in 2005 or before \u2013 with few opportunities for women to take those seats or selections.", "Broadly speaking, the longer an MP has been in Parliament, the more likely they are to be male.", "In the 2015 general election, 191 women were elected, making up 29% of the House of Commons; up from 141 and 23% before the election.", "As elected in the 2010 general election.", "A total of 42 female ministers have held cabinet positions since the first, Margaret Bondfield, in 1929." ], [ "Hedy Fry", "Hedy Fry\n\nHedy Madeleine Fry (born August 6, 1941) is a Trinidadian-Canadian politician and physician.", "She is currently the longest-serving female Member of Parliament, winning eight consecutive elections in the constituency of Vancouver Centre since the 1993 election, when she defeated incumbent Prime Minister Kim Campbell.", "Fry was born in San Fernando, Trinidad and Tobago.", "After declining an English Literature scholarship to Oxford, Fry earned her equivalent of a BA in Science in one year and then went on to receive her medical training at the Royal College of Surgeons in Dublin, Ireland.", "She immigrated to Canada in 1970 and established a practice in Vancouver.", "Fry worked at St. Paul's Hospital (Vancouver) for 23 years.", "She served as president of the British Columbia Federation of Medical Women in 1977.", "She was president of the Vancouver Medical Association in 1988-89, the BC Medical Association in 1990-91, and chaired the Canadian Medical Association's Multiculturalism Committee in 1992-9.", "She volunteered as a Tawny Owl as a member of the Girl Guides of Canada, leading a Brownie group.", "Fry was also a host on the nationally televised CBC show Doctor Doctor.", "Fry sought and won the Liberal Party nomination for Vancouver Centre for the 1993 federal election over lawyer David Varty and college lecturer John Lang in March 1993.", "She was elected to the House of Commons of Canada, defeating Progressive Conservative Prime Minister Kim Campbell." ] ], "gold": "There are several House of Commons. The longest continuously serving female MP in the United Kingdom's House of Commons is Harriet Harman and in Canada's House of Commons is Hedy Fry. Harman was MP for Peckham from 1982 to 1997, has served as MP for Camberwell and Peckham since 1997, and was re-elected in 2019. Fry has won nine consecutive elections in the constituency of Vancouver Centre.", "prediction 1": "There are currently 208 female MPs in the House of Commons. The longest continuously serving female MP in the House of Commons is Hilary Harman, who has served as MP for Peckham since 1 May 1997. The most continuously serving ever is Hedy Fry, who served as MP for Vancouver Centre since the 1993 election.", "prediction 2": "There are currently 208 female MPs in the House of Commons. In the 2015 general election, 191 women were elected, making up 29% of the House of Commons; up from 141 and 23% before the election. Hedy Fry is currently the longest serving female Member of Parliament, winning eight consecutive elections in the constituency of Vancouver Centre since the 1993 election, when she defeated incumbent Prime Minister Kim Campbell. Harman was MP for Peckham from 28 October 1982 until 1 May 1997 and has served as MP for Camberwell and Peckham since 1 May 1997, most recently having been re-elected again on 8 June 2017.", "prediction 3": "There are currently 208 female MPs in the House of Commons. In February 2018 the Electoral Reform Society reported that hundreds of seats were being effectively'reserved' by men, holding back women's representation. Broadly speaking, the longer an MP has been in Parliament, the more likely they are to be male. In the 2015 general election, 191 women were elected, making up 29% of the House of Commons. In the 2010 general election, 179 women were elected, making up 23% of the House of Commons.", "prediction 4": "There are currently 208 female MPs in the House of Commons. In the 2015 general election, 191 women were elected, making up 29% of the House of Commons. The longest continuously serving female mp in the House of Commons is Hedy Fry, who has been in the Vancouver Centre constituency since the 1993 election, when she defeated incumbent Prime Minister Kim Campbell. In the United Kingdom, MP Sue Harman was in the House of Commons from October 1982 until one day before her resignation on May 1, 1997.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 59 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 145, "end": 195 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The longest continuously serving female MP in the House of Commons is Hilary Harman. Harman was MP for Peckham from 1982 to 1997, has served as MP for Camberwell and Peckham since 1997, and was re-elected in 2017. In Canada, the most continuously serving ever is Hedy Fry, who served as MP for Vancouver Centre since the 1993 election." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "When does better call saul come out on netflix?", "passages": [ [ "Better Call Saul", "AMC announced that \"Talking Saul\" would air after the second season \"Better Call Saul\" premiere on February 15, 2016, and again after the second-season finale on April 18, 2016.", "It returned following the season 3 premiere and finale.", "These episodes discuss season two of \"Better Call Saul\".", "These episodes discuss season three of \"Better Call Saul\".", "In December 2013, Netflix announced that the entire first season would be available for streaming in the U.S. after the airing of the first-season finale, and in Latin America and Europe each episode would be available a few days after the episode airs in the U.S. However, the first season was not released on Netflix in the U.S. until February 1, 2016.", "Netflix is the exclusive video-on-demand provider for the series and makes the content available in all its territories, except for Australia and New Zealand.", "In Australia, \"Better Call Saul\" premiered on the streaming service Stan on February 9, 2015, acting as the service's flagship program.", "In New Zealand, the show is exclusive to the New Zealand-based subscription video-on-demand service, Lightbox.", "The episodes were available for viewing within three days of broadcast in the U.S." ], [ "Better Call Saul", "In the United Kingdom and Ireland, the series was acquired by Netflix on December 16, 2013, and the first episode premiered on February 9, 2015, with the second episode released the following day.", "Every subsequent episode was released each week thereafter.", "In India, the series is broadcast on Colors Infinity within 24 hours of the U.S. broadcast.", "The series premiere drew in 4.4 million and 4 million in the 18\u201349 and 25\u201354 demographics, respectively, and received an overall viewership of 6.9 million.", "This was the record for the highest-rated scripted series premiere in basic cable history, until it was surpassed later the same year by another AMC series, \"Fear the Walking Dead\".", "\"Better Call Saul\" has received widespread critical acclaim.", "The first season of \"Better Call Saul\" received critical acclaim, particularly for its acting, writing, and directing with many critics calling it a worthy successor to \"Breaking Bad\".", "On Rotten Tomatoes, the first season has a rating of 98%, based on 62 reviews, with an average rating of 8.17/10.", "The site's critical consensus reads, \"\"Better Call Saul\" is a quirky, dark character study that manages to stand on its own without being overshadowed by the series that spawned it.\"" ], [ "Better Call Saul (season 1)", "Better Call Saul (season 1)\n\n", "The first season of the American television drama series \"Better Call Saul\" premiered on February 8, 2015, and concluded on April 6, 2015.", "The ten-episode season was broadcast on Monday nights in the United States on AMC, excluding the pilot episode which aired on a Sunday.", "\"Better Call Saul\" is a spin-off of \"Breaking Bad\" created by Vince Gilligan and Peter Gould who also worked on \"Breaking Bad\".", "The first season mainly takes place in 2002, and features Bob Odenkirk reprising his role from \"Breaking Bad\" as James Morgan \"Jimmy\" McGill, a lawyer who later becomes known as Saul Goodman from the fourth season onwards.", "Jonathan Banks also reprises his role as Mike Ehrmantraut, a former Philadelphia police officer who works independently as a parking lot attendant, and later on a private investigator and \"cleaner\".", "By July 2013, the series had yet to be green-lighted.", "Netflix was one of many interested distributors, but ultimately a deal was made between AMC and \"Breaking Bad\" production company Sony Pictures Television.", "Gilligan and Gould serve as co-showrunners and Gilligan directed the pilot." ] ], "gold": "Better Call Saul is an American crime drama television series created by Vince Gilligan and Peter Gould. In December 2013, Netflix announced that the entire first season would be available for streaming in the U.S. after the airing of the first-season finale, and in Latin America and Europe each episode would be available a few days after the episode airs in the U.S. In the United Kingdom and Ireland, the first episode premiered on February 9, 2015, with the second episode released the following day. The first season was not released on Netflix in the U.S. until February 1, 2016.", "prediction 1": "Better Call Saul, an American television drama series created by Vince Gilligan and Peter Gould who also worked on Breaking Bad, first came out on Netflix on February 1, 2015. The first season premiered on February 8, 2015, and concluded on April 6, 2015. The second season was released the following day, with the final episode coming out on February 1, 2016.", "prediction 2": "Better Call Saul, an American television drama series, is a spin-off of the Breaking Bad television series and is based on the character Saul Goodman. The first season came out on Netflix in the United States on February 1, 2016, but was not released on Netflix in the United Kingdom and Ireland until February 1, 2016.", "prediction 3": "Better Call Saul, an American television drama series, is a spin-off of the television series Breaking Bad. The first season premiered on February 8, 2015, with the second episode released the following day. The third and final season premiered on April 6, 2015.", "prediction 4": "Better Call Saul is an American television series that is a spin-off of the popular television series Breaking Bad created by Vince Gilligan and Peter Gould, as well as a spin-off of the crime show Breaking Bad. The first season premiered on February 8, 2015, with the second episode released the following day. The second season was released on Netflix in the United States on February 1, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 128 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 158, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 360 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Better Call Saul, an American television drama series created by Vince Gilligan and Peter Gould, first came out on Netflix, in the United Kingdom and Ireland, on February 9, 2015, with the second episode released the following day. In December 2013, Netflix announced that the entire first season would be available for streaming in the U.S. after the airing of the first-season finale, and in Latin America and Europe each episode would be available a few days after the episode airs in the U.S. However, the first season was not released on Netflix in the U.S. until February 1, 2016." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Where is the hanging rock in picnic at hanging rock?", "passages": [ [ "Picnic at Hanging Rock (film)", "Picnic at Hanging Rock (film)\n\nPicnic at Hanging Rock is a 1975 Australian mystery drama film which was produced by Hal and Jim McElroy, directed by Peter Weir, and starred Vivean Gray, Dominic Guard, Anne-Louise Lambert, Helen Morse, and Rachel Roberts.", "It was adapted by Cliff Green from the 1967 novel of the same name by Joan Lindsay, who was deliberately ambiguous about whether the events really took place, although the story is in fact entirely fictitious.", "The plot involves the disappearance of several schoolgirls and their teacher during a picnic at Hanging Rock, Victoria on Valentine's Day in 1900, and the subsequent effect on the local community.", "\"Picnic at Hanging Rock\" was a commercial and critical success.", "At Appleyard College, a girls' private school, near the town of Woodend, Victoria, Australia, the students are dressing on the morning of Valentine's Day, 1900.", "Miranda (Anne-Louise Lambert), Irma (Karen Robson), Marion (Jane Vallis), Rosamund (Ingrid Mason), waifish Sara (Margaret Nelson), and outsider Edith (Christine Schuler) read poetry and Valentine's Day cards.", "The group prepares for a picnic to a local geological formation known as Hanging Rock, accompanied by the mathematics mistress Miss Greta McCraw (Vivean Gray) and the young and beautiful Mlle." ], [ "Picnic at Hanging Rock (novel)", "Picnic at Hanging Rock (novel)\n\nPicnic at Hanging Rock is an Australian historical fiction novel by Joan Lindsay.", "Set in 1900, it is about a group of female students at an Australian girls' boarding school who vanish at Hanging Rock while on a Valentine's Day picnic, and the effects the disappearances have on the school and local community.", "The novel was first published in 1967 in Australia by Cheshire Publishing and was reprinted by Penguin in 1975.", "It is widely considered by critics to be one of the best Australian novels.", "Although the events depicted in the novel are entirely fictional, it is framed as though it is a true story, corroborated by ambiguous pseudohistorical references.", "Its irresolute conclusion has sparked significant public, critical, and scholarly analysis, and the narrative has become a part of Australia's national folklore as a result.", "Lindsay claimed to have written the novel over two weeks at her home Mulberry Hill in Baxter, on Victoria's Mornington Peninsula, after having successive dreams of the narrated events.", "An excised final chapter of the novel was published posthumously as a standalone book in 1987, titled \"The Secret of Hanging Rock\", and also included critical commentary and interpretive theories on the novel.", "Another book, titled \"The Murders at Hanging Rock\", was published in 1980, proposing varying interpretations." ], [ "Hanging Rock, Victoria", "Hanging Rock Reserve is listed on the Victorian Heritage Register as a place of historical, aesthetic and social significance to the State of Victoria.", "Hanging Rock Reserve is currently under review by the Department of Environment, Land, Water and Planning to determine future governance and administrative arrangements for management of the site.", "Hanging Rock was the inspiration and setting for the novel \"Picnic at Hanging Rock\", written by Joan Lindsay and published in 1967.", "The novel dealt with the disappearance of a number of schoolgirls during a visit to the site.", "Their disappearance was explained in the final chapter, but Lindsay deleted this chapter at the suggestion of her editor, thinking the mystery was greater without it.", "The novel inspired the film \"Picnic at Hanging Rock\", made in 1975 and directed by Peter Weir.", "The success of the film was responsible for a substantial increase in visits to the rock and a renewal of interest in the novel.", "Yvonne Rousseau wrote a book called \"The Murders at Hanging Rock\", published in 1980, which examined possible explanations for the disappearance of the girls.", "The deleted final chapter of the novel was finally published in 1987 after the death of Joan Lindsay.", "Lindsay had given the copyright for the last chapter to her literary agent John Taylor on the understanding he would only publish it after her death.", "It was titled \"The Secret of Hanging Rock\"." ] ], "gold": "The Hanging Rock in the Picnic at Hanging Rock novel, film and television series is in Hanging Rock, Victoria, a distinctive geological formation in central Victoria, Australia that is a former volcano. The novel, Picnic at Hanging Rock, is an Australian historical fiction novel that was written by Joan Lindsay. This novel, set in 1900, is about a group of female students at an Australian girls' boarding school who vanish at Hanging Rock, Victoria while on a Valentine's Day picnic, and the effects that these disappearances have on the school and local community. Picnic at Hanging Rock is also a 1975 Australian mystery film adapted from the 1967 novel of the same name by Joan Lindsay. Like the novel, the film's plot involves the disappearance of several schoolgirls and their teacher during a picnic at Hanging Rock, Victoria on Valentine's Day in 1900, and the subsequent effect on the local community. Additionally, Picnic at Hanging Rock is an Australian mystery romantic drama television series that premiered on Foxtel's Showcase on May 6, 2018. This series was also adapted from Joan Lindsay's 1967 novel of the same name about a group of schoolgirls who, while on an outing to Hanging Rock, mysteriously disappear. ", "prediction 1": "Hanging Rock was the inspiration and setting for the 1967 novel Picnic at Hanging Rock, written by Joan Lindsay and published in 1967. The novel dealt with the disappearance of a number of schoolgirls during a visit to the site. Their disappearance was explained in the final chapter, but Lindsay deleted this chapter at the suggestion of her editor, thinking the mystery was greater without it. An excised final chapter of the novel was published posthumously as a standalone book in 1987, titled The Secret of Hanging Rock. Another book, titled The Murders at Hanging Rock, was published in 1980, proposing varying interpretations.", "prediction 2": "Picnic at Hanging Rock is the setting for the novel Picnic at Hanging Rock by Joan Lindsay that was written in 1967 and set at Hanging Rock in Victoria. The novel was inspired by the film Picnic at Hanging Rock, which was made in 1975 and directed by Peter Weir. Hanging Rock Reserve is listed on the Victorian Heritage Register as a place of historical, aesthetic and social significance to the State of Victoria.", "prediction 3": "Picnic at Hanging Rock is a 1975 Australian mystery drama film based on the 1967 novel by the same name by Joan Lindsay. The plot involves the disappearance of several schoolgirls and their teacher during a picnic at Hanging Rock, Victoria on Valentine's Day in 1900, and the subsequent effect on the local community. Hanging Rock was the inspiration and setting for the novel Picnic at Hanging Rock, written by Joan Lindsay and published in 1967. The rock is located near the town of Woodend, Victoria, Australia.", "prediction 4": "Picnic at Hanging Rock is a 1975 Australian mystery drama film based on the novel of the same name by Joan Lindsay. The novel deals with a group of female students at an Australian girls' boarding school who vanish at Hanging Rock while on a Valentine's Day picnic. The location is in Victoria, Australia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 396, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 633 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Hanging Rock, in the state of Victoria, was the inspiration and setting for the 1967 novel Picnic at Hanging Rock, written by Joan Lindsay and published in 1967. The novel dealt with the disappearance of a number of schoolgirls during a visit to the site. Picnic at Hanging Rock is a 1975 Australian mystery drama film and was adapted by Cliff Green from the 1967 novel of the same name. Like the novel, the plot involves the disappearance of several schoolgirls and their teacher during a picnic at Hanging Rock, Victoria on Valentine's Day in 1900, and the subsequent effect on the local community." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is the actor who plays aidan in eastenders?", "passages": [ [ "Patrick Bergin", "Patrick Bergin\n\nPatrick Connolly Bergin (born 4 February 1951) is an Irish actor perhaps best known for his leading role opposite Julia Roberts in \"Sleeping with the Enemy\" (1991) and for playing the villainous Aidan Maguire in the BBC soap \"EastEnders\" (2017\u20132018).", "Bergin was born in Dublin, and had a working class upbringing in its Drimnagh district.", "Bergin learned social responsibility from his father, Paddy Bergin, a Labour Party politician, who had once studied to be a priest with the Holy Ghost Fathers in Blackrock, Ireland.", "Patrick is one of four sons and one daughter (Pearse, Emmet, Patrick, Alan and Siobhan Bergin).", "Bergin left Dublin for London in 1973, and by the time he was seventeen, was in London running a theatre group.", "Bergin worked on building sites and at a library.", "He studied at night and completed a degree in education from North London Polytechnic.", "Bergin worked as an English teacher for several years before forming his own theatrical company because no one else would have him.", "In 1980, Bergin decided to pursue acting full-time and he found work in repertory theatre.", "For much of the Nineties it seemed like no one in Hollywood would have him." ], [ "Phil Mitchell", "Phil visits James at his house and warns him to stay away from Kathy.", "There, Phil discovers Ben's boyfriend Luke Browning (Adam Astill) is James's son when he finds a photo of them.", "Phil tells Kathy of Luke's identity and he warns Luke to stay away from Ben, which backfires as Luke tells Ben about Phil's threat.", "Ben is left furious at Phil and Kathy is eventually forced to tell Ben that James has raped her.", "Phil's former prison cellmate, Aidan Maguire (Patrick Bergin), arrives in Walford and tells Phil that he is planning a robbery and promises to give Phil half of the money if he participates.", "Phil accepts, and Vincent, Mick and Keanu Taylor (Danny Walters) also agree to join.", "When Luke beats up Ben, Phil asks Aidan to help scare Luke off.", "The robbery goes wrong when Mick is shot, and the police arrive.", "Phil and Aidan hide the stolen money in a coffin in Billy's funeral parlour.", "However, the money later goes missing.", "Phil and Aidan try to find the money, unaware that Sharon stole it but was forced to return it to its rightful owner, Aidan's former wife, Ciara Maguire (Denise McCormack).", "Aidan blames Mick for taking the money but Phil discovers it was Sharon." ], [ "EastEnders", "EastEnders\n\nEastEnders is a British soap opera created by Julia Smith and Tony Holland which has been broadcast on BBC One since 1985.", "Set in Albert Square in the East End of London in the fictional Borough of Walford, the programme follows the stories of local residents and their families as they go about their daily lives.", "Initially there were two 30-minute episodes per week but since 2001 episodes have been broadcast every weekday apart from Wednesdays.", "Within eight months of the show's launch, it reached the number-one spot in BARB's TV ratings and has consistently remained among the top-rated TV programmes in Britain.", "In 2013, the average audience share for an episode was around 30 per cent.", "Today, \"EastEnders\" remains a significant programme in terms of the BBC's success and audience share, and also in the history of British television drama, tackling many dilemmas that are considered to be controversial and taboo issues in British culture and social life previously unseen on United Kingdom mainstream television.", ", \"EastEnders\" has won nine BAFTA Awards and the Inside Soap Award for Best Soap for 14 years running (from 1997 to 2012), as well as twelve National Television Awards for Most Popular Serial Drama and 11 awards for Best Soap at the British Soap Awards." ] ], "gold": "EastEnders is a British soap opera created by Julia Smith and Tony Holland which has been broadcast on BBC One since 1985. Aidan Joseph Patrick \"JP\" Maguire, played by Patrick Bergin made his first appearance on 27 November 2017. He is part of a robbery storyline. Aidan departed the series on 9 March 2018 at the conclusion of his storyline.", "prediction 1": "Patrick Connolly Bergin, perhaps best known for his leading role opposite Julia Roberts in \"Sleeping with the Enemy\" (1991), plays Aidan Maguire in the BBC soap EastEnders from 2017-2018. Adams Astill plays Aidan in the 2017-18 series. Dennise McCormack plays Aidan in the 2018 series.", "prediction 2": "EastEnders is a British television soap opera that follows the lives of local residents and their families as they go about their daily lives. Aidan Maguire, played by Patrick Bergin, is a villainous character played by Phil Mitchell. Bergin, born 4 February 1951, is an Irish actor perhaps best known for his leading role opposite Julia Roberts in \"Sleeping with the Enemy\" in 1991 and for playing Aidan Maguire in the BBC soap EastEnders (2017\u20132018).", "prediction 3": "Aidan Maguire is played by Irish actor Patrick Connolly Bergin. Bergin also played Aidan in the 2017-2018 series of the British soap opera EastEnders.", "prediction 4": "Patrick Bergin plays Aidan Maguire in EastEnders. Bergin was born in Dublin, Ireland, in 1951. Adam Astill played Aidan Maguire in 1991.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Patrick Connolly Bergin, perhaps best known for his leading role opposite Julia Roberts in \"Sleeping with the Enemy\" (1991), plays Aidan Maguire in the BBC soap EastEnders from 2017-2018. ", "start": 188, "end": 235 }, { "error type": "Redundant", "explanation": "Patrick Connolly Bergin, perhaps best known for his leading role opposite Julia Roberts in \"Sleeping with the Enemy\" (1991), plays Aidan Maguire in the BBC soap EastEnders from 2017-2018. ", "start": 236, "end": 285 }, { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 124 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": " EastEnders is a British soap opera created by Julia Smith and Tony Holland which has been broadcast on BBC One since 1985. Patrick Connolly Bergin, plays Aidan Maguire in the BBC soap EastEnders robbery storyline from 2017-2018. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the name of india's first arctic research station setup?", "passages": [ [ "Himadri Station", "Himadri Station\n\nThe Himadri's functions include long term monitoring of the fjord (Kongsfjorden) dynamics, and atmospheric research.", "The primary goals of India's research includes research on aerosol radiation, space weather, food-web dynamics, microbial communities, glaciers, sedimentology, and carbon recycling.", "The research base has devoted time for the research of governance and policy of the Arctic.", "India has prioritised research and study in the fields of genetics, glaciology, geology, pollution in the atmosphere, and space weather among other fields.", "In 2012\u20132013, a total of 25 scientists visited the base which was staffed for 185 days to carry out studies under 10 distinct projects.", "The United States Geological Survey estimates that 22% of the world's oil and natural gas could be located beneath the Arctic.", "India's ONGC Videsh is reported to be interested in joint-venture with Russia for oil exploration and has reportedly requested Rosneft for stake in a project.", "In addition, using Arctic sea lanes for shipping would reduce voyage times by 40% compared to Indian, Pacific or Atlantic Ocean routes.", "On 15 May 2013, India was made a permanent observer at the Arctic Council." ], [ "Himadri Station", "India is the 11th country after Britain, Germany, France, Italy, China, Japan, South Korea, The Netherlands, Sweden and Norway to set up a permanent research station in Ny-\u00c5lesund.", "The station was set up in a refurbished two floored building with four bedrooms.", "The building has an area of and has other facilities including a computer room, store room, drawing room and internet.", "It can host eight scientists at normal conditions.", "The crew of the station are given training in shooting with rifles to protect themselves from polar bears.", "Established in August 2014.", "Designed and developed by scientists from the National Centre for Antarctic and Ocean Research (NCAOR) and National Institute of Ocean Technology (NIOT), the observatory has been deployed in the Kongsfjorden fjord of the Arctic, roughly halfway between Norway and the North Pole is named \"IndARC\"" ] ], "gold": "A number of governments maintain permanent research stations in the Arctic. India has several Artic research stations. Himadri is India's first permanent Arctic research station located at Spitsbergen, Svalbard, Norway. IndARC is India's first underwater moored observatory in the Arctic region.", "prediction 1": "In August 2014, India established the Himadri Station, which is a permanent research station set up in Ny-lesund, Norway. The station was set up in a refurbished two floored building with four bedrooms. The observatory has been deployed in the Kongsfjorden fjord of the Arctic, roughly halfway between Norway and the North Pole is named \"IndARC\".", "prediction 2": "The Himadri Station, India's first arctic research station setup, is located in the Kongsfjorden fjord in the North Sea, and has a function of monitoring the fjord dynamics and atmospheric research. The station was set up in a refurbished two floored building with four bedrooms and has other facilities including a computer room, store room, drawing room and internet. Established in August 2014. Designed and developed by scientists from the National Centre for Antarctic and Ocean Research (NCAOR) and National Institute of Ocean Technology (NIOT) and National Institute of Ocean Technology (NIOT).", "prediction 3": "The Himadri Station is India's first arctic research station setup. Its functions include long term monitoring of the fjord dynamics, and atmospheric research. Established in August 2014, India is the 11th country after Britain, Germany, France, Italy, China, Japan, South Korea, The Netherlands, Sweden and Norway to set up a permanent research station in Ny-lesund.", "prediction 4": "India is the 11th country after Britain, Germany, France, Italy, China, Japan, South Korea, The Netherlands, Sweden and Norway to set up a permanent research station in Ny-lesund. The observatory has been deployed in the Kongsfjorden fjord of the Arctic, roughly halfway between Norway and the North Pole is named \"IndARC\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 202 } ], "missing-info": [], "corrected-prediction": "In August 2014, India established the Himadri Station, which is a permanent research station set up in Ny-lesund, Norway. The observatory has been deployed in the Kongsfjorden fjord of the Arctic, roughly halfway between Norway and the North Pole is named \"IndARC\"." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who wrote the patriotic song kadam kadam badayeja?", "passages": [ [ "Qadam Qadam Badaye Ja", "Qadam Qadam Badaye Ja\n\n\"Qadam Qadam Badhaye Ja\" (Hindi: \u0915\u093c\u0926\u092e \u0915\u093c\u0926\u092e \u092c\u0922\u093c\u093e\u092f\u0947 \u091c\u093e) was the regimental quick march of the Subhas Chandra Bose's Indian National Army.", "Written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri, it was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947.", "The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R. Rahman.", "The song is currently the regimental quickmarch of the Indian Army." ], [ "Ram Singh Thakuri", "Ram Singh Thakuri\n\nCaptain Ram Singh Thakuri ( 15 August 1914 \u2013 15 April 2002) was an Indian Gorkha freedom fighter, musician and composer.", "He composed, the Indian National Army a number of patriotic songs including \"Kadam Kadam Badaye Ja\" and \"Subh Sukh Chain\" whilst serving in the Indian Army.", "Later in life, Captain Singh worked for the Uttar Pradesh Provincial Arms Constabulary (PAC) and founded the Constabulary band.", "Ram Singh was born in the Khanyara, a village near Dharamsala on 15 August 1914.", "As the son of a serviceman, Singh was encouraged to enroll in the army.", "After completing school in 1922, Singh joined the 1st Gorkha Rifles as a recruit in the band.", "From early childhood, he had an interest in music, which was encouraged by his grandfather, Jamni Chand, who migrated from Munakot village in Pithoragarh district of Kumaon hills, Uttarakhand in 1890.", "In the Army, Singh combined his love for music along with his service.", "He trained in classical and western music as well as ballad, brass band, string band and dance band.", "Singh earned the King George VI medal while serving in the Khyber-Pakhtunkhwa between 1937 and 1939." ] ], "gold": "Qadam Qadam Badhaye Ja, the regimental quick march of the Indian National Army, was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. Thakuri was an Indian freedom fighter who composed Qadam Qadam Badhaye Ja while serving in the Indian National Army. Qadam Qadam Badhaye Ja was considered seditious and banned by the British in India after World War II. This ban was subsequently lifted in August 1947, and Qadam Qadam Badhaye Ja has since become a patriotic anthem in India.", "prediction 1": "There are several patriotic songs that are part of the Indian National Army. The song \"Qadam Kadam Badhaye Ja\" was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. It was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947.", "prediction 2": "The patriotic song \"Qadam Kadam Badaye Ja\" was written and composed by Pt. Vanshidhar Shukla and Captain Ram Singh Thakuri. The song was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R. Rahman.", "prediction 3": "\"Qadam Qadam Badhaye Ja\" was the regimental quickmarch of the Subhas Chandra Bose's Indian National Army. Written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri, it was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R. Rahman.", "prediction 4": "The patriotic song Qadam Kadam Badaye Ja was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. The song was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 76 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Qadam Qadam Badaye Ja, was the regimental quick march of the Subhas Chandra Bose's Indian National Army. The song was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. Thakuri was an Indian freedom fighter who composed Qadam Qadam Badhaye Ja while serving in the Indian National Army. It was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Write the name of two kings of chahamanas dynasty?", "passages": [], "gold": "There are several kings of Chahamanas dynasty, with different period of reign. Vasu-deva and Samanta-raja are the two earliest kings of Chahamanas dynasty. Govinda-raja IV and Hari-raja are the two most recent kings of Chahamanas dynasty.", "prediction 1": "Write the name of two kings of Chahamanas dynasty.\n", "prediction 2": "Two kings of Chahamanas dynasty have died of famine. What is the name of the first king from this dynasty?", "prediction 3": "The name of the first Ayumanas king who ruled Chahamanas in 1686-1707 is Yakunas. The second Ayumnas king who ruled Chahamanas in 1648-1702 is Harijas.", "prediction 4": "Name of the king of Chahamanas dynasty as higher.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 51 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "Who was the japanese leader during world war ii?", "passages": [ [ "Axis leaders of World War II", "Axis leaders of World War II\n\nThe Axis leaders of World War II were important political and military figures during World War II.", "The Axis was established with the signing of the Tripartite Pact in 1940 and pursued a strongly militarist and nationalist ideology; with a policy of anti-communism.", "During the early phase of the war, puppet governments were established in their occupied nations.", "When the war ended, many of them faced trial for war crimes.", "The chief leaders were Adolf Hitler of Germany, Benito Mussolini of Italy and Emperor Hirohito of Japan.", "Unlike what happened with the Allies, there was never a joint meeting of the main Axis heads of government, although Mussolini and Adolf Hitler did meet on a regular basis." ], [ "Kuniaki Koiso", "In July 1944, Koiso was chosen to serve as Prime Minister of Japan after the downfall of the T\u014dj\u014d cabinet.", "Late that year, Koiso planned to send Prince Konoe on a peace mission to Switzerland and Sweden, but it came to nothing.", "Koiso faced strong competition from more senior army officials for the post.", "The Army strongly favored General Hisaichi Terauchi; however, they could not afford to recall him to Japan from his role as commander-in-chief of all Japanese forces in Southeast Asia.", "The civilian government, especially K\u014dichi Kido and Fumimaro Konoe also did not favor Koiso, due to Koiso's previous involvement with the ultranationalist \"Sakura Kai\" and its attempted coup d'\u00e9tat against the government in 1931 (i.e. the \"March Incident\").", "These reservations were shared by the Emperor in his Privy Council meetings.", "Nevertheless, Koiso was selected, as no consensus could be reached on a more suitable alternative.", "Koiso was almost a token Prime Minister as he was not allowed to participate in any military decisions.", "He was not popular with government ministers who favored making peace, nor with those who wished to prosecute the war until the bitter end.", "During Koiso's term in office, Japanese forces faced multiple defeats on all fronts at the hands of the Allies." ], [ "Kantar\u014d Suzuki", "After serving as Chief of Imperial Japanese Navy General Staff from 15 April 1925 to 22 January 1929, he retired and accepted the position as Privy Councillor and Grand Chamberlain from 1929 to 1936.", "Suzuki narrowly escaped assassination in the February 26 Incident in 1936; the would-be assassin's bullet remained inside Suzuki for the rest of his life, and was only revealed upon his cremation.", "Suzuki was opposed to Japan's war with the United States, before and throughout World War\u00a0II.", "On 7 April 1945, following the Battle of Okinawa, Prime Minister Kuniaki Koiso resigned and Suzuki was appointed to take his place at the age of seventy-seven.", "He simultaneously held the portfolios for Minister for Foreign Affairs and for Greater East Asia.", "Prime Minister Suzuki contributed to the final peace negotiations with the Allied Powers in World War II.", "He was involved in calling two unprecedented imperial conferences which helped resolve the split within the Japanese Imperial Cabinet over the Potsdam Declaration.", "He outlined the terms to Emperor Hirohito who had already agreed to accept unconditional surrender.", "This went strongly against the military faction of the cabinet, who desired to continue the war in hopes of negotiating a more favorable peace agreement.", "Part of this faction attempted to assassinate Suzuki twice in the Ky\u016bj\u014d Incident on the morning of 15 August 1945." ] ], "gold": "The Axis leaders of World War II were important political and military figures during World War II. The chief leaders were Adolf Hitler of Germany, Benito Mussolini of Italy, and Emperor Hirohito of Japan. Fumimaro Konoe was Prime Minister of Japan from 1937 to 1939 and 1940 until 1941. Hideki Tojo was Supreme Military Leader from 1936 until 1944 and prime minister from 1941 until 1944. Kuniaki Koiso was a Senior Army General who served as Prime Minister from July 1944 to April 1945. Kantar\u014d Suzuki, who agreed to Japan's surrender, was an Admiral and served as Prime Minister from April to August 1945.", "prediction 1": "The Japanese leader during World War II were a group of international military, political and political leaders under the aegis of the Axis, including Adolf Hitler, Benito Mussolini and Emperor Hirohito.", "prediction 2": "The Axis leaders of World War II were important political and military figures during World War II. The Axis leaders were Adolf Hitler of Germany, Benito Mussolini of Italy and Emperor Hirohito of Japan. The Japanese leader during World War II was Kuniaki Koiso, who served as Prime Minister of Japan from July 1944 to April 1945. After Koiso's resignation, Kantar Suzuki was appointed to take his place.", "prediction 3": "The Axis leaders of World War II were important political and military figures during World War II. The Japanese leader during World War II was Emperor Hirohito, with his government divided between the Axis powers and the Allies.", "prediction 4": "The Axis leaders of World War II were important political and military figures during World War II. The Japanese leader during World War I was Kuniaki Koiso, who served as Prime Minister of Japan after the downfall of the Tj cabinet. He was succeeded by Kantar Suzuki, who served as Privy Councillor and Grand Chamberlain from 1929 to 1936.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,5]}", "start": 4, "end": 12 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Axis leader during World War II were a group of international military, political and political leaders under the aegis of the Axis, including Adolf Hitler, Benito Mussolini and Emperor Hirohito. Kuniaki Koiso was chosen to serve as Prime Minister of Japan, in July 1944. Kantar\u014d Suzuki was appointed Prime Minister after Koiso's resignation. Prime Minister Suzuki contributed to the final peace negotiations with the Allied Powers in World War II." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did helmets become mandatory in the tour de france?", "passages": [ [ "Tour de France", "Already in 1908 a sort of combativity award was offered, when \"Sports Populaires\" and \"L'Education Physique\" created \"Le Prix du Courage\", 100 francs and a silver gilt medal for \"the rider having finished the course, even if unplaced, who is particularly distinguished for the energy he has used.\"", "The modern competition started in 1958.", "In 1959, a Super Combativity award for the most combative cyclist of the Tour was awarded.", "It was initially not awarded every year, but since 1981 it has been given annually.", "Eddy Merckx has the most wins (4) for the overall award.", "The team classification is assessed by adding the time of each team's best three riders each day.", "The competition does not have its own jersey but since 2006 the leading team has worn numbers printed black-on-yellow.", "Until 1990, the leading team would wear yellow caps.", "As of 2012, the riders of the leading team wear yellow helmets.", "During the era of national teams, France and Belgium won 10 times each.", "From 1973 up to 1988, there was also a team classification based on points (stage classification); members of the leading team would wear green caps.", "There has been an intermediate sprints classification, which from 1984 awarded a red jersey for points awarded to the first three to pass intermediate points during the stage." ], [ "Bicycle helmet", "Because some helmet materials deteriorate with age, the Snell Memorial Foundation recommends that a helmet be replaced at least every five years, or sooner if the manufacturer recommends it.", "In 2015 several manufacturers were making, or seeking financing to make, folding helmets in various designs.", "Helmets use varies greatly between populations and between groups.", "Downhill mountain bikers and amateur sportive cyclists normally wear helmets, and helmet use is enforced in professional cycle sport and in a few legal jurisdictions.", "Utility cyclists and children are much less likely to wear helmets unless compelled.", "Historically, road cycling regulations set by the sport's ruling body, Union Cycliste Internationale (UCI), did not require helmet use, leaving the matter to individual preferences and local traffic laws.", "The majority of professional cyclists chose not to wear helmets, citing discomfort and claiming that helmet weight would put them in a disadvantage during uphill sections of the race.", "The first serious attempt by the UCI to introduce compulsory helmet use was 1991 Paris\u2013Nice race, which resulted in a riders' strike, and UCI abandoned the idea.", "While voluntary helmet use in professional ranks rose somewhat in the 1990s, the turning point in helmet policy was the March 2003 death of Andrei Kivilev at the Paris\u2013Nice.", "The new rules were introduced on 5 May 2003, with the 2003 Giro d'Italia being the first major race affected." ], [ "Andrey Kivilev", "Andrey Kivilev\n\nAndrei Kivilev (20 September 1973 \u2013 12 March 2003) was a professional road bicycle racer from Taldykorgan, Kazakhstan.", "In March 2003, he crashed during the Paris\u2013Nice race and subsequently died of his injuries.", "His death was the trigger for the UCI to implement the compulsory wearing of helmets in all endorsed races.", "Born in Taldykorgan, Almaty Province, Kivilev began his amateur racing career in Spain, before moving to France, where he wore the EC Saint-Etienne jersey.", "In 1993, he had a successful Regio-Tour as part of a successful tour for the Kazakh team: Kivilev won the points competition; team mate Alexander Vinokourov won the combined competition; and the team won the team competition.", "He secured a professional contract with Festina in 1998 and rode with them until the end of 1999.", "Kivilev had a modest time at Festina, where his best results were fifth at the Championship of Zurich and seventh at the Crit\u00e9rium International.", "Despite his lack of professional victories, Kivilev attracted admirers for his riding style, and despite interest from US Postal Service, signed with Ag2r Pr\u00e9voyance in 2000, before moving to Cofidis in 2001." ] ], "gold": "In 2003 cyclist Andrei Mikailovich's crashed and suffered a head injury while participating in the Paris-Nice race. After Kivilev's death rules were put in place for all endorsed races to have helmets and this became mandatory in the Tour de France in 2003. Leaders wearing the yellow helmets in the Tour de France became mandatory in 2012.", "prediction 1": "Helmets became mandatory in the Tour de France on 5 May 2003. Historically, road cycling regulations set by the sport's ruling body, Union Cycliste Internationale (UCI), did not require helmet use, leaving the matter to individual preferences and local traffic laws. The first serious attempt by the UCI to introduce compulsory helmet use was the 1991 Paris\u2013Nice race, which resulted in a riders' strike, and the UCI abandoned the idea. The turning point in helmet policy was the March 2003 death of Andrei Kivilev at the Paris\u2013Nice race and subsequently died of his injuries. His death was the trigger for the UCI to implement the compulsory wearing of helmets in all endorsed races.", "prediction 2": "Helmets became mandatory in the Tour de France on 5 May 2003. The first serious attempt by the UCI to introduce mandatory helmet use was 1991 Paris\u2013Nice race, which resulted in a riders' strike, and the UCI abandoned the idea. Then, in 2005, the Tour de France became mandatory on 21 March 2005, after the death of Andrei Kivilev, a professional road bicycle racer from Taldykorgan, Kazakhstan.", "prediction 3": "Helmets became mandatory in the Tour de France in 2005. The first serious attempt by the UCI to introduce compulsory helmet use was 1991 Paris\u2013Nice race, which resulted in a riders' strike, and the UCI abandoned the idea. The new rules were introduced on 5 May 2003, with the 2003 Giro d'Italia being the first major race affected.", "prediction 4": "Helmets became mandatory in the Tour de France on May 5, 2003. Before then, the first serious attempt by the UCI to introduce compulsory helmet use in the Tour de France was the 1991 Paris\u2013Nice race. Then, in May 2003, the new rules were introduced, with the 2003 Giro d'Italia being the first major race affected.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 436 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Helmets became mandatory in the Tour de France on 5 May 2003. The turning point in helmet policy was the March 2003 death of Andrei Kivilev at the Paris\u2013Nice race and subsequently died of his injuries. His death was the trigger for the UCI to implement the compulsory wearing of helmets in all endorsed races. As of 2012, the riders of the leading team wear yellow helmets." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "How old was mary queen of scots when she took the throne?", "passages": [ [ "Mary, Queen of Scots", "Mary, Queen of Scots\n\nMary, Queen of Scots (8 December 1542 \u2013 8 February 1587), also known as Mary Stuart or Mary I of Scotland, reigned over Scotland from 14\u00a0December 1542 to 24 July 1567.", "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne.", "She spent most of her childhood in France while Scotland was ruled by regents, and in 1558, she married the Dauphin of France, Francis.", "He ascended the French throne as King Francis II in 1559, and Mary briefly became queen consort of France, until his death in December 1560.", "Widowed, Mary returned to Scotland, arriving in Leith on 19 August 1561.", "Four years later, she married her first cousin, Henry Stuart, Lord Darnley and in June 1566 they had a son, James.", "In February 1567, Darnley's residence was destroyed by an explosion, and he was found murdered in the garden.", "James Hepburn, 4th Earl of Bothwell, was generally believed to have orchestrated Darnley's death, but he was acquitted of the charge in April 1567, and the following month he married Mary.", "Following an uprising against the couple, Mary was imprisoned in Loch Leven Castle." ], [ "Mary, Queen of Scots", "Henry II of France proclaimed his eldest son and daughter-in-law king and queen of England, and in France the royal arms of England were quartered with those of Francis and Mary.", "Mary's claim to the English throne was a perennial sticking point between her and Elizabeth I. When Henry II died on 10 July 1559 from injuries sustained in a joust, fifteen-year-old Francis and sixteen-year-old Mary became king and queen of France.", "Two of the Queen's uncles, the Duke of Guise and the Cardinal of Lorraine, were now dominant in French politics, enjoying an ascendancy called by some historians \"la tyrannie Guisienne\".", "In Scotland, the power of the Protestant Lords of the Congregation was rising at the expense of Mary's mother, who maintained effective control only through the use of French troops.", "The Protestant Lords invited English troops into Scotland in an attempt to secure Protestantism, and a Huguenot rising in France, called the Tumult of Amboise, in March 1560 made it impossible for the French to send further support.", "Instead, the Guise brothers sent ambassadors to negotiate a settlement.", "On 11 June 1560, their sister (Mary's mother) died, and so the question of future Franco-Scots relations was a pressing one." ] ], "gold": "Mary, Queen of Scots, the only surviving legitimate child of King James V of Scotland, was six days old when her father died and she acceded to the throne of Scotland. However, she spent most of her childhood in France while Scotland was ruled by regents. In 1558, she married Francis, the Dauphin of France. Then, when King Henry II of France died on July 10, 1559 from injuries sustained in a joust, fifteen-year-old Francis and sixteen-year-old Mary became king and queen of France. ", "prediction 1": "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne. Mary spent most of her childhood in France while Scotland was ruled by regents, and in 1558, she married the Dauphin of France, Francis. He ascended the French throne as King Francis II in 1559, and Mary briefly became queen consort of France, until his death in December 1560. Four years later, she married her first cousin, Henry Stuart, Lord Darnley and in June 1566 they had a son, James. In February 1567, Darnley was found murdered in the garden.", "prediction 2": "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne. She spent most of her childhood in France while Scotland was ruled by regents, in 1558, she married the Dauphin of France, Francis. He ascended the French throne as King Francis II in 1559, and Mary briefly became queen consort of France, until his death in December 1560. Four years later, she married her first cousin, Henry Stuart, Lord Darnley and in June 1566 they had a son, James. In February 1567, Darnley was found murdered in the garden. In February 1567, Darnley's residence was destroyed by an explosion, and the couple had a son, James.", "prediction 3": "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne. Mary spent most of her childhood in France while Scotland was ruled by regents, and in 1558, she married the Dauphin of France, Francis. He ascended the French throne as King Francis II in 1559, and Mary briefly became queen consort of France, until his death in December 1560. Four years later, she married her first cousin, Henry Stuart, and in June 1566 they had a son, James. In February 1567, Darnley was found murdered in the garden. In February 1567, Darnley was acquitted of the charge in April 1567, and the following month he married Mary.", "prediction 4": "Mary was sixteen when she took the throne of Scotland. On 24 July 1567, she was also known as Mary Stuart or Mary I of Scotland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 520 }, { "error type": "Irrelevant", "explanation": "", "start": 521, "end": 580 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 405 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne. Mary spent most of her childhood in France while Scotland was ruled by regents, and in 1558, she married the Dauphin of France, Francis. When King Henry II of France died on July 10, 1559 from injuries sustained in a joust, fifteen-year-old Francis and sixteen-year-old Mary became king and queen of France." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "What island in the bahamas do the pigs swim?", "passages": [ [ "Staniel Cay", "The shallow waters provide a pristine setting for a selection of activities available throughout the islands.", "These beaches have translucent emerald-green water and an abundance of marine life.", "Bungalows and villas are tucked into the tropical landscape featuring branded 4-star boutique hotels.", "This embodies the idea of seclusion, where even the largest resorts have fewer than 200 rooms.", "Staniel Cay is located in close proximity with another Exuma island called Pig Beach, officially known as Big Major Cay, which is an uninhabited island populated by swimming feral pigs.", "With a total of 365 islands, located south of Nassau and only 40 minutes from Florida, on the island of Big Mayor Cay, these pigs are found in abundance.", "Exuma\u2019s swimming Pigs draw thousands of tourists each year.", "The swimming pigs are surrounded by a variety of local legends.", "Rumors suggests that the pigs were brought to the island by sailors who planned to eat them upon their return.", "The pigs were said to have subsisted on food waste abandoned by passing ships.", "According to locals, the truth behind the swimming pigs\u2019 story can be traced back to the early 1990s.", "The pigs were said to have been raised on Staniel Cay before the locals decided to move the animals.", "The pigs were relocated to the uninhabited island, Big Major Cay, where the pigs were left to roam free." ], [ "Staniel Cay", "Staniel Cay\n\nStaniel Cay is an island located in The Exuma Cays, a district of The Bahamas.", "Staniel Cay is located roughly south of Nassau and southeast of Florida.", "The island has a population of less than 118 full-time residents and has an area of less than .", "Staniel Cay is inhabited by a small Bahamian village which lies on the western shore.", "The village is composed of residential housing, a church, a post office, a library, three small retail stores and marine supply shops.", "Staniel Cay is protected by the Bahamas National Trust, the organization in charge of the conservation and preservation of places of historic interest and natural beauty in The Bahamas.", "Staniel Cay was established in 1783 when the American loyalist settled the entire archipelago of Exuma.", "The island gained its popularity with the establishment of The Staniel Cay Yacht Club in 1956, founded by Bob Chamberlain and Joe Hocher.", "A variety of businesses operate on Staniel Cay to provide accommodation and organise activities.", "In 1965, \"Thunderball Grotto\", a limestone cave situated on the western coast of Staniel cay, was the setting of the James bond film Thunderball.", "It was from this film the name Thunderball was given to the grotto.", "The island was also used as a filming location for a scene in the (1983) Bond film Never Say Never Again." ], [ "Paradise Island", "Paradise Island\n\nParadise Island is an island in the Bahamas formerly known as Hog Island.", "The island, with an area of (2.8\u00a0km/1.1 sq mi), is located just off the shore of the city of Nassau, which is itself located on the northern edge of the island of New Providence.", "It is best known for the sprawling resort Atlantis with its extensive water park rides, pools, beach, restaurants, walk-in aquarium and casinos.", "Paradise Island is connected to the island of New Providence by two bridges that cross Nassau Harbour.", "The first was built in 1966 by Resorts International, and the second in the late 1990s.", "A small airstrip existed on the island before 1999 to serve the resort.", "Prior to 1989 the airport was a seaplane base with a ramp for aircraft to leave the water.", "In 1989 a runway was added to the airport.", "Both Paradise Island Airlines and Chalk's International Airlines were the main tenants of the airport.", "The STOL capable de Havilland Canada DHC-7 Dash 7 turboprop operated by Paradise Island Airlines as well the Grumman G-73 Mallard amphibian aircraft flown by Chalk's International Airlines both served the airstrip which closed in 1999.", "The airfield and runway have since been removed and replaced with an 18-hole luxury golf course surrounded by one of the wealthiest neighborhoods on the island." ] ], "gold": "There are several Islands in the Bahamas with swimming pigs. Staniel Cay is located in close proximity with another Exuma Island called Pig Beach, officially known as Big Major Cay, which is an uninhabited island populated by swimming feral pigs. Atlantis Paradise Island is an ocean-themed resort on Paradise Island in the Bahamas where guests can swim with the pigs, relax for the day on the private Rose-Island, or snorkel the shallows.", "prediction 1": "The swimming pigs on Exuma are said to have been raised on Staniel Cay but moved to Pig Beach on Big Major Cay, an uninhabited island, where the pigs were left to roam free. In 1965, a limestone cave situated on the western coast of Staniel Cay was the setting of the James Bond film Thunderball. The island was also used as a filming location for a scene in the 1983 Bond film Never Say Never Again. Paradise Island is an island in the Bahamas formerly known as Hog Island.", "prediction 2": "Staniel Cay is an island located in The Exuma Cays, a district of The Bahamas. The swimming pigs are surrounded by a variety of local legends. Rumors suggests that the pigs were brought to the island by sailors who planned to eat them upon their return. The pigs were relocated to the uninhabited island, Big Major Cay, where the pigs were left to roam free. Paradise Island is an island in The Bahamas formerly known as Hog Island.", "prediction 3": "The swimming pigs of Exuma are found on 365 islands in the Bahamas, including Staniel Cay and Paradise Island. They are thought to have been raised on Staniel Cay before the locals decided to relocate the animals.", "prediction 4": "The swimming pigs in the Bahamas are said to be called the \u201cpigs of Exuma\u201d and are said to have been raised on Staniel Cay, an island in The Exuma Cays, an archipelago in The Bahamas. The pigs were then said to have been relocated to an uninhabited island called Big Major Cay, where they were left to roam free. Paradise Island is another island in the Bahamas formerly known as Hog Island.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 296 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 445, "end": 474 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 3 ] } ], "corrected-prediction": "Staniel Cay is located in close proximity with another Exuma island called Pig Beach, officially known as Big Major Cay, an uninhabited island, populated by swimming feral pigs. Atlantis is a resort on Paradise Island in the Bahamas. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who sings don't mess around with jim?", "passages": [ [ "You Don't Mess Around with Jim (song)", "You Don't Mess Around with Jim (song)\n\n\"You Don't Mess Around with Jim\" is a 1972 single by Jim Croce from his album of the same name.", "The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328.", "The song first aired on KHJ 930 AM in Los Angeles when ABC Records promotion man Marty Kupps took the single to the radio station, where it appeared on the KHJ \"30\" chart at number 27 during the week of June 6, 1972.", "After spending 11 weeks on the \"Billboard\" Hot 100 chart, the song peaked at No. 8 on the week ending September 9, 1972.", "Croce performed the song on \"American Bandstand\" on August 12, 1972.", "\"Billboard\" ranked it as the No. 68 song for 1972.", "The lyrics are set at an underground pool hall on 42nd Street in New York City.", "\"Big\" Jim Walker, a pool hustler who is not too bright but is respected because of his tough reputation, his considerable strength and size, and his skill at pool, has formed a sort of gang of \"bad folks\" who regularly gather at night in the pool hall." ] ], "gold": "On the show Stranger Things, Jim Hopper, the sheriff, sings the song \"You Don't Mess Around with Jim\", which is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328. ", "prediction 1": "\"You Don't Mess Around with Jim\" is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328. Croce performed the song on \"American Bandstand\" on August 12, 1972.", "prediction 2": "\"You Don't Mess Around with Jim\" is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328. \"Big\" Jim Walker sings \"You Don't Mess Around with Jim,\" and \"Chuck\" Walker sings \"You Don't Mess Around With Jim.\"", "prediction 3": "\"You Don't Mess Around With Jim\" is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328.", "prediction 4": "\"You Don't Mess Around with Jim\" is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328. Marty Kupps, ABC Records promotion man, took the single to the radio station, where it appeared on the KHJ \"30\" chart at number 27 during the week of June 6, 1972.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 266 } ], "missing-info": [], "corrected-prediction": "\"You Don't Mess Around with Jim\" is a 1972 single by Jim Croce from his album of the same name. The song was also Croce's debut single when it was released in June 1972 on ABC Records as ABC-11328. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where do most followers of buddhism live today?", "passages": [ [ "Buddhism", "North America had about 3.9 million Buddhists, Europe 1.3 million, while South America, Africa and the Middle East had an estimated combined total of about 1 million Buddhists in 2010.", "Buddhism is the dominant religion in Bhutan, Burma, Cambodia, Tibet, Laos, Mongolia, Sri Lanka and Thailand.", "Large Buddhist populations live in China (18%), Japan (36%), Taiwan (35%), Macau (17%), North Korea (14%), Nepal (11%), Vietnam (10%), Singapore (33%), Hong Kong (15%) and South Korea (23%).", "Buddhism is also growing by conversion.", "In United states, only about a third (32%) of Buddhists in the United States are Asian; a majority (53%) are white.", "Buddhism in the America is primarily made up of native-born adherents, whites and converts.", "After China, where nearly half of the worldwide Buddhists live, the 10 countries with the largest Buddhist population densities are:\n\n\"Subnotes\"" ], [ "Buddhism by country", "Buddhism by country\n\nBuddhism is a religion practiced by an estimated 488 million in the world, 495 million, or 535 million people as of the 2010s, representing 9% to 10% of the world's total population.", "China is the country with the largest population of Buddhists, approximately 244 million or 18.2% of its total population.", "They are mostly followers of Chinese schools of \"Mahayana\", making this the largest body of Buddhist traditions.", "Mahayana, also practiced in broader East Asia, is followed by over half of the world's Buddhists.", "The second largest body of Buddhist schools is \"Theravada\", mostly followed in Southeast Asia.", "The third and smallest body of schools \"Vajrayana\", is followed mostly in Tibet, the Himalayan region, Mongolia and parts of Russia, but is disseminated throughout the world.", "According to a demographic analysis reported by Peter Harvey (2013):\n\nThere are over 10 countries with the highest Buddhist percentage:\nnote :", "Exact number of followers when calculating Buddhists varies because Buddhism is often mixed with the native East Asian religions in their respective countries.", "For example, in Japan the number of Buddhists when calculating including the Shintoists would ramp the percentage of Buddhists in Japan from 67% to >98%.", "Other religions:\nGeneral:" ], [ "Buddhism", "For example, the Dhammakaya movement in Thailand teaches a \"true self\" doctrine, which traditional Theravada monks consider as heretically denying the fundamental \"anatta\" (not-self) doctrine of Buddhism.", "Buddhism is practised by an estimated 488 million, 495 million, or 535 million people as of the 2010s, representing 7% to 8% of the world's total population.", "China is the country with the largest population of Buddhists, approximately 244 million or 18.2% of its total population.", "They are mostly followers of Chinese schools of \"Mahayana\", making this the largest body of Buddhist traditions.", "Mahayana, also practised in broader East Asia, is followed by over half of world Buddhists.", "According to a demographic analysis reported by Peter Harvey (2013): \"Mahayana\" has 360 million adherents; \"Theravada\" has 150 million adherents; and \"Vajrayana\" has 18.2 million adherents.", "According to Johnson and Grim (2013), Buddhism has grown from a total of 138 million adherents in 1910, of which 137 million were in Asia, to 495 million in 2010, of which 487 million are in Asia.", "Over 98% of all Buddhists live in the Asia-Pacific and South Asia region." ] ], "gold": "Buddhism is the dominant religion in Bhutan, Myanmar, Cambodia, Mainland China, Hong Kong, Japan, Tibet, Laos, Macau, Mongolia, Singapore, Sri Lanka, Taiwan, Thailand, Kalmykia and Vietnam. China is the country with the largest population of Buddhists, approximately 244 million or 18.2% of its total population. By region, most followers of Buddhism live in Asia-Pacific.", "prediction 1": "The majority of followers of Buddhism live in Asia, with over half of all followers living in Asia. The largest percentage of followers of Buddhism live in China, where 263 million people live. Nearly half of all Buddhists living in the world live in Asia.", "prediction 2": "The countries where the majority of the world's Buddhists live today are China, Japan, and South Korea. China is the country with the largest population of Buddhists, approximately 244 million or 18.2% of its total population. They are mostly followers of Chinese schools of Mahayana, making this the largest body of Buddhist traditions. The second largest body of Buddhist schools is Theravada, mostly followed in Southeast Asia. The third and smallest body of schools, Vajrayana, is followed mostly in Tibet, the Himalayan region, Mongolia and parts of Russia.", "prediction 3": "Buddhism is a religion practiced by an estimated 488 million people in the world, 495 million, or 535 million people as of the 2010s, representing 9% to 10% of the world's total population. The largest number of followers of Buddhism live in China, where approximately 244 million or 18.2% of its total population are followers of Chinese schools of Mahayana, making this the largest body of Buddhist traditions. The second largest body of Buddhist schools is Theravada, mostly followed in Southeast Asia and the third and smallest body of schools, is followed mostly in Tibet, the Himalayan region, Mongolia and parts of Russia, but is dissemining throughout the world.", "prediction 4": "Buddhism is a religion practiced by an estimated 488 million people in the world, 495 million people, or 535 million people as of the 2010s, representing 9% to 10% of the world's total population. In the world, the country with the largest population of Buddhists in the world is China, with approximately 244 million people, or 18.2% of its total population. These individuals are mostly followers of Chinese schools of Mahayana, making this the largest body of Buddhist traditions. The second largest body of Buddhist schools is Theravada, mostly followed in Southeast Asia. The third and smallest body of schools is Vajrayana, is followed mostly in Tibet, the Himalayan region, Mongolia and parts of Russia, but is disseminated throughout the world.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The majority of followers of Buddhism live in Asia, ", "start": 52, "end": 99 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 163, "end": 193 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The majority of followers of Buddhism live in Asia-Pacific and South Asia region. The largest percentage of followers of Buddhism live in China, with approximately 244 million followers or 18.2% of its total population. Buddhism is the dominant religion in Bhutan, Burma, Cambodia, Tibet, Laos, Mongolia, Sri Lanka and Thailand." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "How many prisoners in the us have life sentences?", "passages": [ [ "Life imprisonment in the United States", "Life imprisonment is also a mandatory punishment in Idaho for aircraft hijacking, in New York State for terrorism, in Florida for capital sexual battery (sexual abuse of a child under 12 that causes injury to the child) and in Georgia for a second conviction for armed robbery, kidnapping, or rape and other serious violent felonies under Georgia's seven-deadly-sins law.", "Life imprisonment is a possible for aggravated mayhem and torture in California.", "Other specifics about life sentences in the United States continue to vary widely by individual states.", "Also, the sentence may be given for \"drug kingpins\" and \"habitual criminals.\"", "It has been applied in every state except Alaska, as well as in the federal courts.", "In Alaska, the maximum term of imprisonment is for 99 years, but that is almost always considered to be a practical life sentence.", "Over 159,000 people were serving life sentences as of 2012, with just under a third, nearly 50,000, serving life without a chance of parole.", "In 1993, the \"Times\" survey found, about 20 percent of all lifers had no chance of parole.", "By 2004, that had risen to 28 percent.", "As a result, the US is now housing by far the world's largest and most permanent population of prisoners who are guaranteed to die of old age behind bars." ], [ "Life imprisonment in Turkey", "Life imprisonment in Turkey\n\nLife imprisonment in Turkey is a legal form of punishment and the most severe form of punishment.", "In most cases life imprisonment replaced capital punishment.", "Law 4771 of 3 August 2002 abolished the death penalty for peace time and replaced capital punishment with life imprisonment for 17 provisions of the Turkish Penal Code.", "Law 5218 of 14 July 2004 abolished the death penalty completely.", "This law provided that in some 40 provisions of the Turkish Penal Code and other laws such as the Law on Forests the death penalty was replaced by aggravated life imprisonment (tr: \"a\u011f\u0131rla\u015ft\u0131r\u0131lm\u0131\u015f m\u00fcebbet a\u011f\u0131r hapis cezas\u0131\").", "On 1 June 2005 a number of new laws such as a new penal code (Law 5237), a new code of criminal proceedings (Law 5271) and new law on the execution of sentences (Law 5275) entered into force.", "Articles 45 to 52 of the Turkish Penal Code (TPC) of 2005 divide sentences into strict imprisonment, ordinary imprisonment, and fines.", "Imprisonment is divided into aggravated life imprisonment, life imprisonment and termed sentences of imprisonment.", "Indefinite sentences besides life imprisonment and aggravated life imprisonment do not exist in Turkey.", "Article 47 TPC states that aggravated life imprisonment will last for a whole life." ], [ "Life imprisonment in the United States", "Life imprisonment in the United States\n\nIn the United States, 1 in every 2,000 residents are imprisoned for life.", "This is similar to the total imprisonment rate in Japan, which is roughly 51 per 100,000 residents (approx.", "1 in 1,960 residents).", "There are many U.S. states in which a convict can be released on parole after a decade or more has passed, but in California, people sentenced to life imprisonment can normally apply for parole after seven years.", "The laws in the United States divide life sentences between \"determinate life sentences\" and \"indeterminate life sentences.\"", "For example, sentences of \"15 years to life,\" \"25 years to life,\" or \"life with mercy\" may be given, which is called an \"indeterminate life sentence.\"", "A sentence of \"life without the possibility of parole\" or \"life without mercy\" is called a \"determinate life sentence\" because a sentence of \"15 years to life\" means that it is a life sentence with a non-parole period of 15 years.", "Parole is not guaranteed but discretionary and so that is an indeterminate sentence.", "Even if a sentence specifically denies the possibility of parole, government officials may have the power to grant an amnesty, to reprieve, or to commute a sentence to time served." ] ], "gold": "Life imprisonment is one of the most sever punishments in the United States. Currently the frequency of life sentences in the US is 1 in every 2,000. As of 2012, 159,000 prisoners have life sentences and nearly 50,000 of them are serving life without a chance of parole.", "prediction 1": "In the United States, 1 in every 2,000 residents are imprisoned for life. In the United Kingdom, 1 in every 3,500 people are imprisoned for life as well.", "prediction 2": "Life imprisonment is a legal form of punishment in the United States. In the United States, 1 in every 2,000 residents are imprisoned for life. In the United Kingdom, 7 in 11 prisoners are sentenced to life imprisonment. In the United States, there are 84,286 persons serving life sentences.", "prediction 3": "Life imprisonment in the US is a legal form of punishment and the most severe form of punishment. In the US, 1 in every 2,000 residents are imprisoned for life. In the US, life sentences are separated into two categories: determinate life sentences and indeterminate life sentences.", "prediction 4": "Life imprisonment is a legal form of punishment and the most severe form of punishment in the United States. In the United States, 1 in every 2,000 residents are imprisoned for life. The laws in the United States divide life sentences between \"determinate life sentences\" and \"indeterminate life sentences.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 153 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the United States, 1 in every 2,000 residents are imprisoned for life. Over 159,000 people were serving life sentences as of 2012, with just under a third, nearly 50,000, serving life without a chance of parole." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "What kind of car is a jeep cherokee?", "passages": [ [ "Jeep Cherokee", "Jeep Cherokee\n\nThe Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes.", "Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV.", "The nameplate has been in continuous use in some form since 1974 and also spawned Jeep's most successful vehicle, the Jeep Grand Cherokee, which was originally slated to be part of the Cherokee's lineup.", "The vehicle is named after the Cherokee tribe of Native Americans.", "The Cherokee was a rebadged reintroduction of a two-door body style Jeep Wagoneer, with a redesigned greenhouse that eliminated the car's C-pillar.", "Instead the Cherokee sported a much wider D-pillar and a single, long fixed rear side window with an optional flip-out section.", "Previously, a two-door version had been available in the Jeep Wagoneer line (from 1963 to 1967), although this had the same pillar and window configuration as the four-door Wagoneer.", "The Cherokee replaced the Jeepster Commando, whose sales had not met expectations despite an extensive 1972 revamp.", "The Cherokee appealed to a younger market than the Wagoneer, which was regarded more as a family SUV.", "The Cherokee was marketed as the \"sporty\" two-door variant of Jeep's station wagon." ] ], "gold": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV in 1974-1983 to one of the first compact SUVs in 1984-2012 and eventually into its current incarnation as a crossover SUV since 2013.", "prediction 1": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV.", "prediction 2": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV. The nameplate has been in continuous use in some form since 1974 and also spawned Jeep's most successful vehicle, the Jeep Grand Cherokee, which was initially slated to be part of the Cherokee's lineup.", "prediction 3": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV. The nameplate has also spawned Jeep's most successful vehicle, the Jeep Grand Cherokee, which was originally slated to be part of the Cherokee's lineup.", "prediction 4": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV. The nameplate has been in continuous use in some form since 1974 and also spawned Jeep's most successful vehicle, the Jeep Grand Cherokee, which was originally slated to be part of the Cherokee's lineup.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Jeep Cherokee is a line of American vehicles sold by Jeep under various vehicle classes. Originally sold as a variant of the popular Jeep Wagoneer, the Cherokee has evolved from a full-size SUV to one of the first compact SUVs and eventually into its current incarnation as a crossover SUV." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Highest paid hollywood actor for a single movie?", "passages": [ [ "Khans of Bollywood", "Aamir's \"Dangal\" (2016) created the Bollywood 1000 Crore Club, owing to its overseas success in Chinese markets, and eventually created the 2000 Crore Club, becoming the highest-grossing Indian film ever (worldwide and overseas), and one of the highest-grossing films in China and India, with his earnings from the film estimated to be , the highest payday for a non-Hollywood actor.", "In 2014, Shah Rukh was the richest non-Hollywood actor and the second richest actor in the world, with an estimated net worth of US$600 million.", "On the 2016 \"Forbes\" list of the 10 highest-paid actors in the world, Salman ranked sixth, with total earnings of US$33.5 million for the year.", "On 2017's and 2018's \"Forbes\" list of the 10 highest-paid actors in the world, Salman Khan ranked 9th both years, earning $37 million and $38.5 million in 2017 and 2018, respectively.", "In addition to the three Khans, there have been other Khans in Bollywood.", "The most famous Khan prior to them was Dilip Kumar, whose real name is Muhammad Yusuf Khan, for which he has been referred to as the \"First Khan\" of Bollywood.", "Kumar was one of the biggest Indian movie stars of the 1950s and 1960s." ], [ "Gender inequality", "A study analyzing five years of text from over 2,000 news sources found a similar 5:1 ratio of male to female names overall, and 3:1 for names in entertainment.", "Hollywood actresses are paid less than actors.", "Topping \"Forbes\" highest paid actors list of 2013 was Robert Downey Jr. with $75 million.", "Angelina Jolie topped the highest paid actresses list with $33 million, which tied with Denzel Washington ($33 million) and Liam Neeson ($32 million), who were the last two on the top ten highest paid actors list.", "In the 2013 Academy Awards, 140 men were nominated for an award, but only 35 women were nominated.", "No woman was nominated for directing, cinematography, film editing, writing (original screenplay), or original score that year.", "Since the Academy Awards began in 1929, only seven women producers have won the Best Picture category (all of whom were co-producers with men), and only eight women have been nominated for Best Original Screenplay.", "Lina Wertmuller (1976), Jane Campion (1994), Sofia Coppola (2004), and Kathryn Bigelow (2012) were the only four women to be nominated for Best Director, with Bigelow being the first woman to win for her film \"The Hurt Locker\".", "77% of the Academy Awards' voters are male." ] ], "gold": "Salaries for the world's highest-paid film actors currently range from US$20\u201330 million, but an actor can earn substantially more by deferring all or part of their salary against a percentage of the film's gross, known within the industry as a \"profit participation\" deal. By that definition, Bruce Willis, Tom Cruise, and Will Smith are the highest paid actors for a single movie. Based on a net salary, the highest paid Hollywood actor for a single movie is Robert Downey Jr.", "prediction 1": "The highest paid hollywood actor for a single movie is Robert Downey Jr., with $75 million, and the highest paid hollywood actor for a single film is Aamir Khan, with $37.5 million. The highest paid hollywood actor for a single movie is Liam Neeson, with $32 million.", "prediction 2": "The highest paid hollywood actor for a single film is Robert Downey Jr., earning $75 million for the Forbes list. Salman Khan's earnings from the film Dangal made him the highest paid non-Hollywood actor in the world.", "prediction 3": "In 2017, Salman Khan ranked 9th on the Forbes list of the 10 highest-paid actors in the world, earning $37 million. In 2018, Robert Downey Jr. ranked highest paid actor for a single movie, earning $38.5 million. Robert Downey Jr. ranked highest paid actor for a single movie, earning $75 million.", "prediction 4": "The highest paid actor in the world for a single movie in 2016 was Robert Downey Jr., earning a total of $79 million. The highest paid hollywood actor for a single movie in 2017 was Aamir Khan, earning an estimated US$36.8 million. In 2018, Salman Khan's earnings from the film were estimated to be the highest payday for a non-Hollywood actor.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 33, "end": 51 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 113, "end": 122 }, { "error type": "Unverifiable", "explanation": "", "start": 162, "end": 181 }, { "error type": "Redundant", "explanation": "The highest paid hollywood actor for a single movie is Robert Downey Jr., with $75 million,", "start": 182, "end": 267 } ], "missing-info": [], "corrected-prediction": "The highest paid hollywood actor in 2013 is Robert Downey Jr., with $75 million, and it is estimated that the highest paid non-hollywood actor for a single film is Aamir Khan." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is the golden state warriors arena located?", "passages": [ [ "Chase Center (San Francisco)", "Chase Center (San Francisco)\n\nChase Center is a multi-purpose arena under construction in the Mission Bay neighborhood of San Francisco.", "The building will mainly be used for basketball and is planned to become the new home venue for the National Basketball Association (NBA)'s Golden State Warriors.", "The Warriors, who have been located in the San Francisco Bay Area since 1962, have played their home games at Oracle Arena in Oakland since 1971.", "The arena is scheduled to open to the public before the start of the 2019\u201320 NBA season, with groundbreaking having occurred during the 2016\u201317 NBA season.", "The arena has been mentioned as a potential home for a National Hockey League franchise, should the league decide to place a team in San Francisco.", "The name of Chase Center was announced on January 28, 2016, as part of an agreement with JPMorgan Chase.", "The planned location for the arena, which would house the Golden State Warriors, is in San Francisco at Third St. and", "16th St.", "The location will have an overlook of the water.", "The arena will have multiple layers and floors and will have a seating capacity of 18,000 people.", "It will also include a multi-purpose area that includes a theater configuration with an entrance overlooking a newly built park.", "It will contain of office and lab space and have of retail space." ], [ "Oracle Arena", "Oracle Arena\n\nOracle Arena is an indoor arena located in Oakland, California, United States, and is the home of the Golden State Warriors of the National Basketball Association (NBA).", "The arena opened in 1966 and is the oldest arena in the NBA.", "From its opening until 1996 it was known as the Oakland\u2013Alameda County Coliseum Arena.", "After a major renovation completed in 1997, the arena was renamed The Arena in Oakland until 2005 and Oakland Arena from 2005 to 2006.", "It is often referred to as the Oakland Coliseum Arena as it is located adjacent to the Oakland\u2013Alameda County Coliseum.", "Oracle Arena seats 19,596 fans for basketball and 17,200 for ice hockey.", "The arena has been the home of the Golden State Warriors since the 1971\u201372 season, except the one-year hiatus while the arena was undergoing renovations.", "It had been used by the Warriors intermittently as early as 1966.", "The California Golden Bears of the Pac-10 played the 1997\u201398 and 1998\u201399 seasons at the arena while their primary home, Harmon Gym, was being renovated into Haas Pavilion.", "For some years before then, the Bears played occasional games against popular non-conference opponents at the arena.", "Oracle Arena has been home to Warriors playoff games in 1972, 1973, 1975, 1976, 1977, 1987, 1989, 1991, 1992, 1994, 2007, 2013, 2014, 2015, 2016, 2017, and 2018." ], [ "Oracle Arena", "The renovation began in mid-1996 and was completed in time for the Warriors return in the fall of 1997 (they played the previous season at the San Jose Arena, home of the NHL's Sharks).", "Included in the renovation was a new center overhead LED scoreboard and 360-degree fascia display.", "The new configuration seats 19,596 for basketball and 17,200 for ice hockey.", "On October 20, 2006, the Golden State Warriors and Oracle Corporation announced that the Oakland Arena would be known as The Oracle for a 10-year term.", "A press conference was held on October 30.", "\"The O\", as it is referred to, continued to be managed by Oakland\u2013Alameda County Authority (JPA) and SMG.", "The JPA approved the deal at its November 10 meeting.", "Oracle Arena has, at least since 2013, been one of the loudest arenas in the NBA.", "It is called \"Roaracle\" because of the painfully high decibel levels sometimes generated at Warriors games.", "The Warriors will play their final regular season home game on April 7, 2019 against the Los Angeles Clippers (pending any playoff games if they qualify, which they may), and the team's lease is set to expire by the end of June 2019." ] ], "gold": "The Golden State Warriors play in the Chase Center currently. It is located at 1 Warriors Way in San Francisco, California. From 1971 to 2019 the Golden State Warriors played at the Oakland Arena in Oakland, California which is located at 700 Coliseum Way. In 1996-1997 while the Oakland Arena was being worked on they temporarily played at the San Jose Arena in San Jose, California which is located at 525 West Santa Clara Street.", "prediction 1": "The Golden State Warriors arena is located in Oakland, California, United States. The arena opened in 1966 and is the oldest arena in the NBA. The building will mainly be used for basketball and is planned to become the new home venue for the Golden State Warriors. The arena is scheduled to open to the public before the start of the 2019-20 NBA season. The location will have an overlook of the water. The arena will have multiple layers and floors and will have a seating capacity of 18,000 people.", "prediction 2": "The Golden State Warriors arena is located in Oakland, California. The Warriors have had a home in Oakland since the 1971\u201372 season. The arena opened in 1966 and is the oldest arena in the NBA. From its opening until 1996, the arena was known as the Oakland\u2013Alameda County Coliseum Arena. After a major renovation completed in 1997, the arena was renamed The Arena in Oakland until 2005 and Oakland Arena from 2005 to 2006.", "prediction 3": "The Golden State Warriors' arena is located in Oracle Arena, Oakland, California. The arena opened in 1966 and is the oldest arena in the NBA. From its opening until 1996, it was known as the Oakland\u2013Alameda County Coliseum Arena. After a major renovation completed in 1997, the arena was renamed The Arena in Oakland until 2005 and Oakland Arena from 2005 to 2006. It is often referred to as the Oakland Coliseum Arena as it is located adjacent to the Oakland\u2013Alameda County Coliseum Arena.", "prediction 4": "The Golden State Warriors arena is located in Oakland, California, United States. Chase Center is a multi-purpose arena under construction in the Mission Bay neighborhood of San Francisco. The building will mainly be used for basketball and is planned to become the new home venue for the National Basketball Association's Golden State Warriors. The arena opened in 1966 and is the oldest arena in the NBA. The arena has been the home of the Golden State Warriors since the 1971\u201372 season, except the one-year hiatus while the arena was undergoing renovations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 403 }, { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 501 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 142 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Golden State Warriors have played their home games at Oracle Arena in Oakland since 1971. The Chase Center arena (San Francisco) is planned to become the new home venue for the Golden State Warriors, which is scheduled to open to the public before the start of the 2019-20 NBA season. The Warriors returned to the San Jose Arena in the fall of 1997 after the completion of renovation. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the theme song of doc mcstuffins?", "passages": [ [ "Doc McStuffins", "Doc McStuffins\n\nDoc McStuffins (also known as Doc McStuffins: Toy Hospital in the fourth season and Doc McStuffins: Pet Rescue for the fifth season) is an American-Irish animated children's television series produced by Brown Bag Films.", "It was created and executive produced by Chris Nee and premiered on March 23, 2012, on Disney Channel and Disney Junior.", "The series is about a girl who can \"fix\" toys, with help from her toy friends.", "It features songs written and composed by Kay Hanley and Michelle Lewis.", "The series received positive reviews due to the show's concept and the main character, as well as its portrayal of African-Americans (Nee stated in 2013 that Doc is African-American, proposed by Disney during her initial pitch, Nee initially only knowing she wanted a girl doctor) in a Disney series.", "Chris Nee describes the series as \"\"Cheers\" for Preschoolers.\"", "On November 16, 2016, the series was renewed for a fifth season by Disney Junior.", "On April 4, 2018, Lara Jill Miller, the voice of Lambie, said that the final episode of the final season has been recorded.", "The show will end after five seasons." ], [ "China Anne McClain", "China Anne McClain\n\nChina Anne McClain (born August 25, 1998) is an American actress and singer.", "She is a member of the sister girl group McClain.", "McClain's career began in 2005 when she was seven years old, acting in the film \"The Gospel\" (2005).", "She also played China James in \"Tyler Perry's Daddy's Little Girls\" (2007), along with Idris Elba and her two sisters.", "However, she became nationally known after 2007, when she joined the cast of the series \"Tyler Perry's House of Payne\" as Jazmine Payne.", "In 2010, she co-starred in \"Grown Ups\" (2010) as Charlotte McKenzie.", "McClain became internationally known after starring in the Disney Channel original television series \"A.N.T. Farm\", landing the role as Chyna Parks, from 2011 to 2014.", "Disney released the soundtrack of the television series \"A.N.T. Farm\" on October 11, 2011.", "McClain sings six songs and two solos with her sisters on the soundtrack, which debuted in the \"Billboard\" 200 at number 29 with 14,000 copies sold in its first week.", "On the soundtrack, McClain sang her version of Taio Cruz's \"Dynamite.\"" ], [ "Amber Riley", "Amber Riley\n\nAmber Patrice Riley (born February 15, 1986) is an American actress, singer and author.", "She is best known for her portrayal of Mercedes Jones on the Fox comedy-drama series \"Glee\" (2009\u20132015).", "For her performance on the series, she won a Screen Actors Guild Award, and has been nominated for three Teen Choice Awards, three NAACP Image Awards, and a Grammy Award.", "In November 2016, Riley led the West End debut of \"Dreamgirls\", playing the lead role of Effie White.", "She won the Laurence Olivier Award for Best Actress in a Musical in 2017 for her role in \"Dreamgirls\".", "Riley won season 17 of \"Dancing with the Stars\" in 2013.", "In 2017, Riley appeared as a judge on BBC One musical theatre talent show \"Let It Shine\" and formed a musical theatre supergroup with Beverley Knight and Cassidy Janson, known collectively as Leading Ladies and signed to East West Records/Warner.", "Their debut album, \"Songs from the Stage\", was released on November 17, 2017.", "Riley was born in Los Angeles, California, the daughter of Tiny (n\u00e9e Hightower) and Elwin Riley.", "She has two older sisters, Toyia and Ashley.", "Riley auditioned for \"American Idol\" when she was 17 years old, during the show's second season, but was turned down by the producers." ] ], "gold": "Several singers have sung the theme song of the children's TV series Doc McStuffins. China Anne McClain, an American actress and singer, sang it in Seasons 1 to 3 of the series. Amber Patrice Riley sang it after Season 4. Riley is an American actress, singer, author, and activist.", "prediction 1": "American actress, singer and songwriter Amber Riley sings the theme song of the American-Irish animated children's television series Doc McStuffins.", "prediction 2": "American actress and singer Amber Riley sings the theme song of the American-Irish animated children's television series Doc McStuffins. Every episode of Doc McStuffins begins with the song \"Dynamite.\" The theme song was sang by American actress and singer China Anne McClain from the soundtrack of Disney Channel's A.N.T. Farm and was first released on October 11, 2011.", "prediction 3": "Doc McStuffins is an American-Irish animated children's television series produced by Brown Bag Films. Doc McStuffins's theme song was sung by several artists. Amber Riley, an American actress, and singer, sang a version of Taio Cruz's \"Dynamite\". On April 14, 2019, Lambie had her final episode recorded.", "prediction 4": "American actress Amber Riley, who plays Mercedes Jones in the American animated television series Doc McStuffins, also sings the title song of the show. The song is performed by the all-female group, The McClain Sisters. The song is sung by American singer, songwriter, and songwriter Pippa Ruff, who sings the theme song of the show.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 29, "end": 39 }, { "error type": "Unverifiable", "explanation": "", "start": 52, "end": 79 } ], "missing-info": [], "corrected-prediction": "Doc McStuffins is a children's television series. " }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "The most commonly spoken language in the usa after english and spanish is?", "passages": [ [ "Language and overseas Chinese communities", "Yue dialects have historically been the most prevalent forms of Chinese due to immigrants being mostly from southern China from the 19th century up through the 1980s.", "However, Mandarin is becoming increasingly more prevalent due to the opening up of the PRC.", "In New York City in 2002, Mandarin was spoken as a native language by only 10% of Chinese speakers, but was used as an auxiliary language among the greatest number of them and was predicted to replace Cantonese as their lingua franca.", "Although Min Chinese or Fuzhounese, the majority of Min Chinese, is spoken natively by a third of the Chinese population there, it is not used as a lingua franca because speakers of other dialect groups do not learn Min.", "In Richmond (part of the Greater Vancouver metropolitan area in Canada), 55% of the population is Chinese.", "Chinese words can be seen everywhere from local banks to grocery stores.", "In the broader Vancouver Census Metropolitan Area, 18% of the population is Chinese.", "Similarly in Toronto, which is the largest city in Canada, Chinese people make up 11.4% of the local population with the higher percentages of between 20-50% in the suburbs of Markham, Richmond Hill and within the city's east end, Scarborough.", "Cantonese and Mandarin are the most popular forms of Chinese spoken in the area." ], [ "Languages of the United States", "Languages of the United States\n\nThe most commonly used language in the United States is English (specifically, American English), which is the de facto national language.", "Nonetheless, many other languages are also spoken, or historically have been spoken, in the United States.", "These include indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia.", "There are also several languages, including creoles and sign languages, that developed in the United States.", "Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area.", "Fifty-two languages formerly spoken in the country's territory are now extinct.", "Based on annual data from the American Community Survey (ACS), the U.S. Census Bureau regularly publishes information on the most common languages spoken at home.", "It also reports the English speaking ability of people who speak a language other than English at home.", "In 2015, the U.S. Census Bureau published information on the number of speakers of over 350 languages as surveyed by the ACS from 2009 to 2013, but it does not regularly tabulate and report data for that many languages." ], [ "Spanish language in the United States", "Spanish language in the United States\n\nThe United States has forty-five million people aged five or older that speak Spanish at home, making Spanish the second most spoken language of the United States.", "Spanish is the most studied foreign language in United States, with about six million students.", "With over 50 million native speakers, heritage language speakers and second language speakers, the United States now has the second largest Spanish-speaking population in the world after Mexico, although it is not an official language of the country.", "About half of all American Spanish speakers also assessed themselves as speaking English \"very well\" in the 2000 U.S. Census.", "This percentage increased to 57% in the 2013-2017 American Community Survey.", "The United States is among the Spanish-speaking countries that has its own Academy of the Spanish Language.", "There are more Spanish-speakers in the United States than speakers of French, German, Italian, Hawaiian, varieties of Chinese and Native American languages combined.", "According to the 2012 American Community Survey conducted by the U.S. Census Bureau, Spanish is the primary language spoken at home by 38.3 million people aged five or older, more than twice that of 1990.", "The Spanish language has been present in what is now the United States since the 15th century, with the arrival of Spanish colonization in North America." ] ], "gold": "Although the United States does not have an official language, the most commonly used language is English (specifically, American English), which is the de facto national language, and the only one spoken at home by approximately 78% of the U.S. population. Many other languages are also spoken at home, especially Spanish (13.4% of the population), according to the American Community Survey (ACS) of the U.S. Census Bureau; these include indigenous languages and languages brought to the U.S. by people from Europe, Africa, and Asia. Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area. After English and Spanish, the most commonly spoken set of collective languages are Chinese languages. Cantonese is currently the lingua franca among Chinese speakers but Mandarin is expected to replace Cantonese in popularity in the future.", "prediction 1": "The most commonly used language in the United States is English, which is also the de facto national language. However, many other languages are also spoken, or historically have been spoken, in the United States, including indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia. Spanish is the second most spoken language of the United States, with forty-five million people aged five or older that speak Spanish at home.", "prediction 2": "The most commonly used language in the United States is English, which is the de facto national language. The United States has forty-five million people aged five or older that speak Spanish at home, making Spanish the second most spoken language of the United States. Chinese is the second most spoken language in the United States.", "prediction 3": "The most commonly used language in the United States is English, specifically American English, which is the de facto national language. Nevertheless, many other languages are also spoken, or historically have been spoken, in the United States. These include indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia. Spanish is the second most spoken language in the United States.", "prediction 4": "The most commonly used language in the United States is English, which is the de facto national language. However, many other languages are also spoken, or historically have been spoken, in the United States. These include indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia. In 2015, the US Census Bureau published information on the number of speakers of the most common languages spoken at home. Spanish is the second most spoken language of the United States.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The most commonly used language in the United States is English (specifically, American English), which is also the de facto national language. However, many other languages are also spoken, or historically have been spoken, in the United States, including indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia. Spanish is the second most spoken language of the United States, with forty-five million people aged five or older that speak Spanish at home. Mandarin was predicted to replace Cantonese as the lingua franca for abroad Chinese. In 2015, the U.S. Census Bureau published information on the number of speakers of over 350 languages as surveyed by the ACS" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the cathedral of santiago de compostela built?", "passages": [ [ "Santiago de Compostela Cathedral", "This was followed by the first church in 829\u00a0AD and then in 899\u00a0AD by a pre-Romanesque church, ordered by king Alfonso III of Le\u00f3n, which caused the gradual development of this major place of pilgrimage.", "In 997 the early church was reduced to ashes by Al-Mansur Ibn Abi Aamir (938\u20131002), army commander of the caliph of C\u00f3rdoba.", "The Al-Andalus commander was accompanied on his raid by his vassal Christian lords, who received a share of the loot, while St James' tomb and relics were left undisturbed.", "The gates and the bells, carried by local Christian captives to C\u00f3rdoba, were added to the Aljama Mosque.", "When C\u00f3rdoba was taken by king Ferdinand III of Castile in 1236, these same gates and bells were then transported by Muslim captives to Toledo, to be inserted in the Cathedral of Saint Mary of Toledo.", "Construction of the present cathedral began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez.", "It was built according to the same plan as the monastic brick church of Saint Sernin in Toulouse, probably the greatest Romanesque edifice in France.", "It was built mostly in granite." ], [ "Santiago de Compostela Cathedral", "Also in baroque style is the Acibechar\u00eda fa\u00e7ade by Ferro Caaveiro and Fern\u00e1ndez Sarela, later modified by Ventura Rodr\u00edguez.", "The Pratar\u00edas fa\u00e7ade, built by the Master Esteban in 1103, and most importantly the P\u00f3rtico da Gloria, an early work of Romanesque sculpture, were completed by Master Mateo in 1188.", "The P\u00f3rtico da Gloria (\"Portico of the gang gude\" in Galician) of the Cathedral of Santiago de Compostela is a Romanesque portico by Master Mateo and his workshop commissioned by King Ferdinand II of Le\u00f3n.", "To commemorate its completion in 1188, the date was carved on a stone and set in the cathedral, and the lintels were placed on the portico.", "Finalising the complete three-piece set took until 1211, when the temple was consecrated in the presence of King Alfonso IX of Le\u00f3n.", "The portico has three round arches that correspond to the three naves of the church, supported by thick piers with pilasters.", "The central arch, twice as wide as the other two, has a tympanum and is divided by a central column\u2014a mullion\u2014containing a depiction of Saint James." ] ], "gold": "The P\u00f3rtico da Gloria, \"Portico of the Glory\" in Galician, of the Cathedral of Santiago de Compostela is a Romanesque portico by Master Mateo and his workshop commissioned by King Ferdinand II of Le\u00f3n. Construction of the present cathedral began in 1075 under the reign of Alfonso VI of Castile and the patronage of bishop Diego Pel\u00e1ez. To commemorate its completion in 1188, the date was carved on a stone and set in the cathedral, and the lintels were placed on the portico. Finalizing the complete three-piece set took until 1211, when the temple was consecrated in the presence of King Alfonso IX of Le\u00f3n.", "prediction 1": "Construction of the present cathedral of Santiago de Compostela began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. Construction of the present cathedral began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. The P\u00f3rtico da Gloria, an early work of Romanesque sculpture, were completed by Master Mateo in 1188.", "prediction 2": "The cathedral of Santiago de Compostela was built in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. Construction of the current cathedral began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. The P\u00f3rtico da Gloria, an early work of Romanesque sculpture, was completed by Master Mateo in 1188.", "prediction 3": "The present cathedral of Santiago de Compostela, also known simply as the Cathedral of Santiago de Compostela, is a Romanesque church built mostly in granite that dates from 1075. Construction of the cathedral started in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. It was built according to the same plan as the monastic brick church of Saint Sernin in Toulouse, probably the greatest Romanesque edifice in France. The P\u00f3rtico da Gloria, an early work of Romanesque sculpture, was completed by Master Mateo in 1188.", "prediction 4": "The cathedral of Santiago de Compostela was built in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. Construction of the present cathedral began in 1075 under the reign of Alfonso III of Le\u00f3n (1055\u20131059).", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Construction of the present cathedral of Santiago de Compostela began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. ", "start": 173, "end": 319 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 381 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The P\u00f3rtico da Gloria, \"Portico of the Glory\" in Galician, of the Cathedral of Santiago de Compostela is a Romanesque portico by Master Mateo and his workshop commissioned by King Ferdinand II of Le\u00f3n. Construction of the present cathedral of Santiago de Compostela began in 1075 under the reign of Alfonso VI of Castile (1040\u20131109) and the patronage of bishop Diego Pel\u00e1ez. To commemorate its completion in 1188, the date was carved on a stone and set in the cathedral, and the lintels were placed on the portico. Finalising the complete three-piece set took until 1211, when the temple was consecrated in the presence of King Alfonso IX of Le\u00f3n." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many cards do you get when you play uno?", "passages": [ [ "Uno (card game)", "The aim of the game is to be the first player to score 500 points, achieved (usually over several rounds of play) by being the first to play all of one's own cards and scoring points for the cards still held by the other players.", "The deck consists of 108 cards: four each of \"Wild\" and \"Wild Draw Four,\" and 25 each of four different colors (red, yellow, green, blue).", "Each color consists of one zero, two each of 1 through 9, and two each of \"Skip,\" \"Draw Two,\" and \"Reverse.\"", "These last three types are known as \"action cards.\"", "To start a hand, seven cards are dealt to each player, and the top card of the remaining deck is flipped over and set aside to begin the discard pile.", "The player to the dealer's left plays first unless the first card on the discard pile is an action or Wild card (see below).", "On a player's turn, they must do one of the following:\n\nPlay proceeds clockwise around the table.", "Action and Wild cards have the following effects:\n\n\nA player who plays their next-to-last-card must call \"Uno\" as a warning to the other players." ], [ "Uno (card game)", "The first player to get rid of their last card (\"going out\") wins the hand and scores points for the cards held by the other players.", "Number cards count their face value, all action cards count 20, and Wild and Wild Draw Four cards count 50.", "If a Draw Two or Wild Draw Four card is played to go out, the next player in the sequence must draw the appropriate number of cards before the score is tallied.", "The first player to score 500 points wins the game.", "In a two-player game, the Reverse card acts like a Skip card; when played, the other player misses a turn.", "The following house rules are suggested in the Uno rulebook, to alter the game:\n\nA strategy at Uno may be offensive (aiming to go out), or defensive (aiming to minimize the value of one's hand, in the event that another player goes out, thus getting those points).", "Part of the skill of playing Uno is knowing when to adopt an offensive or defensive strategy.", "An offensive strategy would be holding on to Wild and Wild Draw Four cards because they can be played near the end of the hand in order to go out (when it's harder to play a matching card).", "However, a defensive strategy would advise getting rid of such cards early, because they have a high point value." ], [ "Uno (card game)", "Uno (card game)\n\nUno (; from Italian and Spanish for 'one'; stylized as UNO) is an American shedding-type card game that is played with a specially printed deck.", "The game's general principles put it into the Crazy Eights family of card games.", "The game was originally developed in 1971 by Merle Robbins in Reading, Ohio, a suburb of Cincinnati.", "It has been a Mattel brand since 1992.", "When his family and friends began to play more and more, he spent $8,000 to have 5,000 copies of the game made.", "He sold it from his barbershop at first, and local businesses began to sell it as well.", "Robins later sold the rights to UNO to a group of friends headed by Robert Tezak, a funeral parlor owner in Joliet, Illinois, for $50,000 plus royalties of 10 cents per game.", "Tezak formed International Games, Inc., to market UNO, with offices behind his funeral parlor.", "The games were produced by Lewis Saltzman of Saltzman Printers in Maywood, Illinois.", "In 1992, International Games became part of the Mattel family of companies.", "There can be 2-10 players." ] ], "gold": "In the American shedding-type card game Uno, each player begins a hand with seven cards. Players draw additional cards throughout the hand if the player before them plays a specialty card, such as a \"Draw Two\" or \"Wild Draw Four\". If a player cannot play any other card during their turn, they must also draw 1 card, although they may then play it if possible.", "prediction 1": "Uno is an American shedding-type card game that is played with a specially printed deck. Players get 108 cards in their hand, including five of each color and four of Wild and Wild Draw Four. The aim of the game is to be the first player to score 500 points by being the first to play all of one's own cards and scoring points for the cards still held by the other players. The number cards count their face value, all action cards count 20, and Wild and Wild Draw Four cards count 50.", "prediction 2": "Uno is an American shedding-type card game that is played with a specially printed deck. Players get 108 cards. The aim of the game is to be the first player to score 500 points, achieved (usually over several rounds of play) by being the first to play all of one's own cards and scoring points for the cards still held by the other players. The deck consists of 4 each of Wild and Wild Draw Four, and 25 each of four different colors. The first player to get rid of their last card (\"going out\") wins the hand and scores points for the cards held by the other players.", "prediction 3": "Uno is an American shedding-type card game that is played with a specially printed deck. The aim of the game is to be the first player to score 500 points, achieved (usually over several rounds of play) by being the first to play all of one's own cards and scoring points for the cards still held by the other players. The deck consists of 108 cards: four each of Wild and Wild Draw Four and 25 each of four different colors. The first player to get rid of their last card (\"going out\") wins the hand and scores points for the cards held by the cards held by the others. The Wild and Wild and Wild cards count their face value, and Wild and Wild and Wild and Wild and Wild and Wild and Wild cards count 50.", "prediction 4": "The aim of the game is to be the first player to score 500 points, achieved (usually over several rounds of play) by being the first to play all of one's own cards and scoring points for the cards still held by the other players. The deck consists of 108 cards: four each of \"Wild\" and \"Wild Draw Four,\" and 25 each of four different colors. To start a hand, seven cards are dealt to each player, and the top card of the remaining deck is flipped over and set aside to begin the discard pile.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 89, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 374, "end": 485 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Uno is an American shedding-type card game that is played with a specially printed deck. To start a hand, seven cards are dealt to each player. If a Draw Two or Wild Draw Four card is played to go out, the next player in the sequence must draw the appropriate number of cards before the score is tallied. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Number of members of the house of representatives?", "passages": [ [ "Non-voting members of the United States House of Representatives", "Non-voting members of the United States House of Representatives\n\nNon-voting members of the United States House of Representatives (called either delegates or resident commissioner, in the case of Puerto Rico) are representatives of their territory in the House of Representatives, who do not have a right to vote on proposed legislation in the full House but are nevertheless able to participate in certain other House functions.", "Non-voting members may vote in a House committee of which they are a member and introduce legislation.", "There are currently six non-voting members: a delegate representing the federal district of Washington D.C., a resident commissioner representing Puerto Rico, and one delegate for each of the other four permanently inhabited US Territories: American Samoa, Guam, the Northern Mariana Islands, and the US Virgin Islands.", "As with voting members, non-voting delegates are elected every two years, and the Resident Commissioner of Puerto Rico is elected every four years.", "Non voting members serve exclusively in the House of Representatives\u2014not the Senate.", "All delegates serve a term of two years, while resident commissioners serve a term of four years.", "They receive compensation, benefits, and franking privileges (the ability to send outgoing U.S. Mail without a stamp) similar to full House members." ], [ "United States House of Representatives", "United States House of Representatives\n\nThe United States House of Representatives is the lower chamber of the United States Congress, the Senate being the upper chamber.", "Together they comprise the legislature of the United States.", "The composition of the House is established by Article One of the United States Constitution.", "The House is composed of Representatives who sit in congressional districts that are allocated to each of the 50 states on a basis of population as measured by the U.S. Census, with each district entitled to one representative.", "Since its inception in 1789, all Representatives have been directly elected.", "The total number of voting representatives is fixed by law at 435.", "As of the 2010 Census, the largest delegation is that of California, with fifty-three representatives.", "Seven states have the smallest delegation possible, a single representative: Alaska, Delaware, Montana, North Dakota, South Dakota, Vermont, and Wyoming.", "The House is charged with the passage of federal legislation, known as bills, which, after concurrence by the Senate, are sent to the President for consideration." ] ], "gold": "There are a total of 441 members of the United States House of Representatives, but only 435 are full voting members. The six non-voting members represent the District of Columbia, Puerto Rico, American Samoa, Guam, the Northern Mariana Islands, and the U.S. Virgin Islands.", "prediction 1": "The United States House of Representatives is the lower chamber of the United States Congress, the Senate being the upper chamber. Together they comprise the legislature of the United States. The number of members in the House is fixed by law at 435.", "prediction 2": "The House of Representatives is the lower chamber of the United States Congress, the Senate being the upper chamber. Together they comprise the legislature of the United States. The House is composed of Representatives who sit in congressional districts that are allocated to each of the 50 states on a basis of population as measured by the U.S. Census, with each district entitled to one representative. The total number of voting representatives is fixed by law at 435.", "prediction 3": "The United States House of Representatives is the lower chamber of the United States Congress, the Senate being the upper chamber. Together they comprise the legislature of the United States. As of the 2010 Census, the largest delegation is that of California, with fifty-three representatives. Seven states have the smallest delegation possible, a single representative.", "prediction 4": "The United States House of Representatives is the lower chamber of the United States Congress, the Senate being the upper chamber. Together they comprise the legislature of the United States. The House is composed of Representatives who sit in congressional districts that are allocated to each of the 50 states on a basis of population as measured by the U.S. Census, with each district entitled to one representative. As of the 2010 Census, the largest delegation is that of California, with fifty-three representatives. Seven states have the smallest delegation possible, a single representative.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 191 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 206, "end": 213 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " The total number of voting representatives in the United States House of Representatives is fixed by law at 435. There are currently six non-voting members representing Puerto Rico, American Samoa, Guam, the Northern Mariana Islands, and the US Virgin Islands." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How old do u have to be to get a tattoo in washington?", "passages": [ [ "Legal status of tattooing in the European Union", "Legal status of tattooing in the European Union\n\nYou may get a tattoo at the age of 17 with parental consent (this can be written) and without parental consent from the age of 18 upwards.", "In Belgium, there is not a specific implementation decree regulating the sector of piercing and tattooing practices.", "No legislation exists.", "You may get a tattoo or piercing at the age of 16 with parental consent (parents must be present) and without parental consent from the age of 18 upwards.", "(tattooing or piercing of minors may vary depending on studios policy, some refuse to tattoo or pierce minors completely)\n\n", "The legal age to get a tattoo in Cyprus is 16 with written consent of parent.", "18 without permission from parents\n\nThe Danish tattoo law was valid from June 15, 1966.", "It is unlawful to tattoo someone under the age of 18.", "In addition to this it is unlawful to tattoo someone on the head, neck and hands.", "No legislation found.", "You need to be 18+ to get a tattoo in Finland, however, you may be able to get a permit to get a tattoo under the age of 18.", "The legal minimum age is 16 (with consent from parents) in France.", "You must be over 18 years of age to get a tattoo freely without parental consent.", "You need to have parental or guardian consent at the ages of 16 and 17.", "The minimum age is 18." ], [ "Legal status of tattooing in the United States", "Legal status of tattooing in the United States\n\nIn the United States, there is no federal law regulating the practice of tattooing.", "However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo be 18 years or older.", "This is partially based on the legal principle that a minor cannot enter into a legal contract or otherwise render informed consent for a procedure.", "Most states permit a person under the age of 18 to receive a tattoo with permission of a parent or guardian, but some states outright prohibit tattooing under a certain age regardless of permission, with the exception of medical necessity (such as markings placed for radiation therapy).", "In all jurisdictions, individual tattooists may also choose to place additional restrictions based on their own moral feelings, such as refusing \"any\" clients under a specific age even with parental consent despite it being legal, or limiting the type and/or location of where they are willing to tattoo (such as refusing any work around intimate parts of the body).", "They may additionally refuse to perform specific artwork, including if they merely find it inappropriate or offensive, or refuse to work on a client that they suspect may be intoxicated.", "Artists sometimes claim their personal business restrictions are a matter of law even when it is not true, so as to avoid arguments with clients." ] ], "gold": "The legal age to get a tattoo in both the state of Washington and in the District of Columbia is 18 years old. In the District of Columbia, minors can have their ears pierced with written parental consent.", "prediction 1": "In the United States, there is no federal law regulating the practice of tattooing. However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo to be 18 years or older. The minimum age to get a tattoo in Washington DC is 18. In Greece, the minimum age to get a tattoo is 16. The legal age to get a tattoo in Cyprus is 16 with written consent of parent. The legal age to get a tattoo in Denmark is 16 with written consent of parent. In Finland, you may be able to get a permit to get a tattoo without parental consent from parents.", "prediction 2": "There is no federal law regulating the practice of tattooing. However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo to be 18 years or older. In the United States, there is no federal law regulating the practice of tattooing. However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo to be 18 years or older. In the United States, there is no federal law regulating the practice of tattooing. However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo be 18 years or older.", "prediction 3": "The minimum age to get a tattoo in the District of Columbia is 18. In the United States, there is no federal law regulating the practice of tattooing. But, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo be 18 years or older.", "prediction 4": "In the United States, there is no federal law regulating the practice of tattooing. However, all 50 states and the District of Columbia have statutory laws requiring a person receiving a tattoo to be 18 years or older. In Washington, D.C, the minimum age to get a tattoo is 18. In Cyprus, the legal age to get a tattoo is 16 with written consent of parent. In Denmark, the legal minimum age to get a tattoo is 16.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 83 }, { "error type": "Unverifiable", "explanation": "", "start": 275, "end": 324 }, { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 402 }, { "error type": "Unverifiable", "explanation": "", "start": 403, "end": 481 }, { "error type": "Irrelevant", "explanation": "", "start": 482, "end": 580 } ], "missing-info": [], "corrected-prediction": "All 50 states of America and the District of Columbia have statutory laws requiring a person receiving a tattoo to be 18 years or older. The minimum age to get a tattoo in Washington DC is 18. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who won the national championship college football 2017?", "passages": [ [ "2017 College Football Playoff National Championship", "2017 College Football Playoff National Championship\n\nThe 2017 College Football Playoff National Championship was a bowl game that was used to determine a national champion of college football in the NCAA Division I Football Bowl Subdivision for the 2016 season.", "The game was played at Raymond James Stadium in Tampa, Florida, on January 9, 2017.", "It was the culminating game of the 2016\u201317 bowl season.", "The game was played between the winners of two pre-designated bowl games played on December 31, 2016: the Clemson Tigers, who defeated the Ohio State Buckeyes in the Fiesta Bowl, and the Alabama Crimson Tide, who defeated the Washington Huskies in the Peach Bowl.", "Having met in the previous year's championship game, the resulting title game between Clemson and Alabama became college football's first rematch between #1 and #2 in national championship game history.", "The Tigers won the game 35\u201331 on a go-ahead touchdown with one second left, having come back from a 14\u20130 deficit earlier in the game.", "Clemson quarterback and Heisman Finalist Deshaun Watson set the record for most passing yards in a championship game with 420, breaking his own record of 405 yards set in the 2016 national championship game.", "Deshaun Watson and Ben Boulware were named the Offensive and Defensive Most Valuable Players respectively." ], [ "2018 College Football Playoff National Championship", "2018 College Football Playoff National Championship\n\nThe 2018 College Football Playoff National Championship was a college football bowl game that determined a national champion in the NCAA Division I Football Bowl Subdivision for the 2017 season.", "The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime.", "True freshman quarterback Tua Tagovailoa and defensive tackle Daron Payne were respectively named the offensive and defensive players of the game.", "The College Football Playoff selection committee chose the semifinalists following the conclusion of the 2017 regular season.", "Alabama and Georgia advanced to the national championship after winning the semifinal games hosted by the Sugar Bowl and Rose Bowl Game respectively in January 2018.", "The championship game was played at Mercedes-Benz Stadium in Atlanta, Georgia on January 8, 2018.", "The Mercedes-Benz Stadium in Atlanta, Georgia was announced as the host site for the fourth College Football National Championship on November 4, 2015.", "The College Football Playoff (CFP) selection committee selected four teams to advance to the playoff: the Clemson Tigers, Oklahoma Sooners, Georgia Bulldogs, and Alabama Crimson Tide.", "The Alabama Crimson Tide defeated the Clemson Tigers in the 2018 Sugar Bowl by a score of 24\u20136 to reach the championship game.", "The Tide had a 12\u20131 season, becoming the SEC West Division co-champions with the Auburn Tigers." ], [ "Raymond James Stadium", "In May 2016 the Buccaneers announced that the naming rights were extended an additional 12 years ensuring that Raymond James Financial's name will continue to appear through 2028.", "The stadium officially opened on September 20, 1998, when the Tampa Bay Buccaneers defeated the Chicago Bears, 27\u201315.", "The stadium hosted its first soccer game on March 20, 1999, when the Tampa Bay Mutiny lost to D.C. United, 5\u20132.", "The stadium also hosts the annual Outback Bowl college football post-season game on New Year's Day since 1999.", "The Gasparilla Bowl will be held at the venue starting with the 2018 edition.", "The stadium was selected to host the ACC Championship Game in 2008 and 2009.", "The stadium is home field for the University of South Florida Bulls of the American Athletic Conference.", "The team's record crowd at Raymond James Stadium is 69,383, on September 29, 2012, when the Bulls \u2013 during their worst season ever \u2013 played a non-conference game against the popular Florida State University Seminoles from the powerhouse Atlantic Coast Conference for the first time.", "The largest crowd ever recorded in Raymond James Stadium came on January 9, 2017 as the stadium hosted the 2017 College Football Playoff National Championship.", "74,512 people were in attendance.", "Through to the 2009 season, every Buccaneers game at Raymond James Stadium sold out." ] ], "gold": "At the end of the 2016 college football season, the Clemson Tigers defeated the Alabama Crimson Tide in the 2017 national championship game on January 9, 2017. The following year, at the end of the 2017 season, the Alabama Crimson Tide defeated the Georgia Bulldogs in the 2018 national championship game on January 8, 2018.", "prediction 1": "The 2017 College Football Playoff National Championship was a bowl game that was used to determine a national champion of college football in the NCAA Division I Football Bowl Subdivision for the 2016 season. The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime. The 2018 College Football Playoff National Championship was a college football bowl game that determined a national champion in the NCAA Division I Football Bowl Subdivision for the 2017 season. The Alabama Crimson Tide defeated the Oklahoma Sooners in the Sugar Bowl by a score of 24\u20136 to reach the championship game. The championship game was played at Mercedes-Benz Stadium in Atlanta, Georgia on January 8, 2018.", "prediction 2": "The 2017 College Football Playoff National Championship was played at Raymond James Stadium in Tampa, Florida, on January 9, 2017. It was a bowl game that was used to determine a national champion of college football in the NCAA Division I Football Bowl Subdivision for the 2016 season. The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime.", "prediction 3": "The 2017 College Football Playoff National Championship was a bowl game that was used to determine a national champion of college football in the NCAA Division I Football Bowl Subdivision for the 2016 season. The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime. The 2018 College Football Playoff National Championship was a college football bowl game that determined a national champion in the NCAA Division I Football Bowl Subdivision for the 2017 season. The Alabama Crimson Tide defeated the Ohio State Buckeyes in the Fiesta Bowl. The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime.", "prediction 4": "The 2017 College Football Playoff National Championship was a bowl game that was used to determine a national champion of college football in the NCAA Division I Football Bowl Subdivision for the 2016 season. The Alabama Crimson Tide defeated the Georgia Bulldogs 26-23, coming back from a 13-0 deficit at halftime to secure the win in overtime. The Alabama Crimson Tide defeated the Clemson Tigers in the 2018 Sugar Bowl by a score of 24\u20136 to reach the championship game.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 541, "end": 664 }, { "error type": "Irrelevant", "explanation": "", "start": 665, "end": 762 }, { "error type": "Irrelevant", "explanation": "", "start": 271, "end": 345 }, { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 519 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 388 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 439 }, { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 270 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4, 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The 2017 College Football Playoff National Championship for the 2016 season was played on January 9, 2017 . In the game, the Clemson Tigers defeated the Alabama Crimson Tide. The 2018 Championship took place on January 8, 2018 and determined a national champion for the 2017 season. In the game, the Alabama Crimson Tide defeated the Georgia Bulldogs." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Who was the beast in beauty and the beast tv show?", "passages": [ [ "Beauty & the Beast (season 1)", "It was later revealed that Catherine's mother worked for Muirfield, conducting the experiments, and ultimately helped turn Vincent into a beast.", "Catherine must deal with conflicted feelings of her mother's memory across this season, having been determined to solve her case for all this time.", "When Catherine watches her father get run over in the season finale, she then learns that, biologically, he was not her real father after all.", "Vincent's DNA mutates as the season progresses, as he becomes more beast-like.", "He begins experiencing black-outs, which J.T. associates with Catherine's interference.", "Cat and Vincent will stop at nothing to see each other, however.", "Assistant District Attorney Gabriel Lowen visits Cat's precinct to investigate the beast-like attack in the city and over time he reveals that not only does he know about Muirfield but that he shares the same ability as Vincent.", "At first an enemy, Gabriel goes on to become an ally to Vincent by the end of the first season and suggests he has found a cure to the virus inflicted on them by Muirfield.", "Vincent ultimately wonders if he wants to be cured or not.", "Vincent is captured in the season finale as a helicopter drops a net on him and flies him away, leaving Catherine heartbroken.", "With Vincent captured, a gun is then aimed at Catherine's head." ], [ "Beauty & the Beast (2012 TV series)", "Beauty & the Beast (2012 TV series)\n\nBeauty & the Beast is an American television series filmed in Toronto, Canada, very loosely inspired by the 1987 CBS series of the same name, developed by Sherri Cooper-Landsman and Jennifer Levin that premiered October 11, 2012, on The CW.", "Kristin Kreuk and Jay Ryan star in the title roles alongside Austin Basis, Nina Lisandrello, Nicole Gale Anderson, Sendhil Ramamurthy, Max Brown, Brian J. White, Amber Skye Noyes, and Michael Roark.", "Catherine Chandler witnessed her mother's murder and was almost killed herself until someone\u2014or something\u2014saved her.", "After nine years, now working as a detective for the NYPD, a case leads her to Vincent Keller, an ex-soldier believed to have been killed in action during military service, who is actually alive.", "As Catherine comes to know him, she finds out more about her mother's murder and about who\u2014and what\u2014Vincent really is.", "The CW officially began developing the series in September 2011.", "The project was described as \"a modern-day romantic love story with a procedural twist,\" unlike the original series which was a romantic drama with mystery and suspense elements.", "The show is the first project that Mark Pedowitz developed when he joined the network." ] ], "gold": "The protagonist of the 1987 TV show \"Beauty and the Beast\" was named Vincent and was played by Ron Perlman. The lead in the 2012 TV show \"Beauty and the Beast\" was named Vincent Keller and was played by Jay Ryan. The 2012 show was loosely inspired by the 1987 version. ", "prediction 1": "Beauty & the Beast is an American television show loosely inspired by the 1987 CBS series of the same name. It was later revealed that Catherine's mother worked for Muirfield, conducting the experiments, and ultimately helped turn Vincent into a beast. Vincent Keller is played by Kristin Kreuk and Jay Ryan. The first two seasons were filmed in Toronto, Canada.", "prediction 2": "Beauty & the Beast is an American television show, loosely inspired by the 1987 CBS series of the same name, which was created by Sherri Cooper-Landsman and Jennifer Levin. It follows detective Catherine Chandler as she investigates a case that leads her to ex-soldier Vincent Keller, who is believed to have been killed in action during military service, who is actually alive. In the show, Vincent is fought by Assistant District Attorney Gabriel Lowen, who is a former soldier who is now a police officer for the FBI. The FBI, as Vincent is captured by a helicopter drops a net on him and flies him away, leaving Catherine devastated. In the season 2, Vincent is transformed into a beast.", "prediction 3": "Beauty & the Beast is a 2012 American television series filmed in Toronto, Canada, loosely inspired by the 1987 CBS series of the same name. It is a modern-day romantic love story with a procedural twist. Vincent Keller is the beast in the show. The show originally premiered on October 11, 1987, on CBS.", "prediction 4": "Beauty & the Beast is an American tv show loosely inspired by the 1987 CBS series of the same name, developed by Sherri Cooper-Landsman and Jennifer Levin. It follows Catherine Chandler, a detective for the NYPD, as she unravels a case that leads her to Vincent Keller, an ex-soldier believed to have been killed in action during military service, who is actually alive. As Catherine comes to know him, she discovers more about her mother's murder and about who\u2014and what\u2014Vincent Keller is actually alive.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 362 }, { "error type": "Unverifiable", "explanation": "", "start": 253, "end": 308 } ], "missing-info": [], "corrected-prediction": "Beauty & the Beast (2012 TV series) is an American television series very loosely inspired by the 1987 CBS series of the same name. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What was the name of the union ironclad ship?", "passages": [ [ "USS Monitor", "USS Monitor\n\nUSS \"Monitor\" was an iron-hulled steamship.", "Built during the American Civil War, she was the first ironclad warship commissioned by the Union Navy.", "\"Monitor\" is most famous for her central role in the Battle of Hampton Roads on 9 March 1862, where, under the command of Lieutenant John Worden, she fought the casemate ironclad (built on the hull of the former steam frigate ) to a standstill.", "The unique design of the ship, distinguished by its revolving turret which was designed by American inventor Theodore Timby, was quickly duplicated and established the monitor type of warship.", "The remainder of the ship was designed by the Swedish-born engineer and inventor John Ericsson and hurriedly built in Brooklyn in only 101 days.", "\"Monitor\" presented a new concept in ship design and employed a variety of new inventions and innovations in ship building that caught the attention of the world.", "The impetus to build \"Monitor\" was prompted by the news that the Confederates were building an ironclad warship, named \"Virginia\", that could effectively engage the Union ships blockading Hampton Roads and the James River leading to Richmond and ultimately advance on Washington, D.C. and other cities, virtually unchallenged.", "Before \"Monitor\" could reach Hampton Roads, the Confederate ironclad had destroyed the sail frigates and and had run the steam frigate aground." ], [ "Ironclad warship", "The Confederacy built ships designed as smaller versions of \"Virginia\", many of which saw action, but their attempts to buy ironclads overseas were frustrated as European nations confiscated ships being built for the Confederacy\u00a0\u2014 especially in Russia, the only country to openly support the Union through the war.", "Only CSS \"Stonewall\" was completed, and she arrived in American waters just in time for the end of the war.", "Through the remainder of the war, ironclads saw action in the Union's attacks on Confederate ports.", "Seven Union monitors, including , as well as two other ironclads, the ironclad frigate \"New Ironsides\" and a light-draft , participated in the failed attack on Charleston; one was sunk.", "Two small ironclads, and participated in the defence of the harbor.", "For the later attack at Mobile Bay, the Union assembled four monitors as well as 11 wooden ships, facing the , the Confederacy's most powerful ironclad and the gunboats , , .", "On the western front, the Union built a formidable force of river ironclads, beginning with several converted riverboats and then contracting engineer James Eads of St. Louis, Missouri to build the City-class ironclads.", "These excellent ships were built with twin engines and a central paddle wheel, all protected by an armored casement." ], [ "Ironclad warship", "Constructed on the hull of , \"Virginia\" originally was a conventional warship made of wood, but she was converted into an iron-covered casemate ironclad gunship, when she entered the Confederate navy.", "By this time, the Union had completed seven ironclad gunboats of the , and was about to complete the , an innovative design proposed by the Swedish inventor John Ericsson.", "The Union was also building a large armored frigate, the , and the smaller .", "The first battle between ironclads happened on 9 March 1862, as the armored \"Monitor\" was deployed to protect the Union's wooden fleet from the ironclad ram \"Virginia\" and other Confederate warships.", "In this engagement, the second day of the Battle of Hampton Roads, the two ironclads repeatedly tried to ram one another while shells bounced off their armor.", "The battle attracted attention worldwide, making it clear that the wooden warship was now out of date, with the ironclads destroying them easily.", "The Civil War saw more ironclads built by both sides, and they played an increasing role in the naval war alongside the unarmored warships, commerce raiders and blockade runners.", "The Union built a large fleet of fifty monitors modeled on their namesake." ] ], "gold": "During the American Civil War, the Union Navy commissioned the construction of the USS Monitor, an ironclad warship, to battle the Virginia and other Confederate warships. Other ships that were based on the design of the Monitor include the USS Montauk, New Ironsides, USS Keokuk, CSS Palmetto State, and CSS Chicora. The Union ordered ironclad ships USS Galena on 16 September 1861, and USS New Ironsides about a month later. Engineer James Eads was contracted by the Union to build the ironclad ships USS Neosho and USS Osage for use on the rivers.", "prediction 1": "USS Monitor was the first ironclad warship commissioned by the Union Navy. The unique design of the ship, distinguished by its revolving turret which was designed by American inventor Theodore Timby, was quickly duplicated and established the monitor type of warship. The impetus to build \"Monitor\" was prompted by the news that the Confederates were building an ironclad warship, named \"Virginia\", that could effectively engage the Union ships blockading Hampton Roads and the James River leading to Richmond and ultimately advance on Washington, D.C.", "prediction 2": "The USS Monitor was a Union ironclad steamship and the first ironclad warship commissioned by the Union Navy. She is most famous for her central role in the Battle of Hampton Roads on 9 March 1862, where, under the command of Lieutenant John Worden, she fought the casemate ironclad to a standstill. The unique design of the ship, distinguished by its revolving turret, was quickly duplicated and established the monitor type of warship. The Union built a large fleet of fifty monitors modeled on their namesake.", "prediction 3": "USS Monitor was the first ironclad warship commissioned by the Union Navy. The unique design of the ship, distinguished by its revolving turret, was quickly duplicated and established the monitor type of warship. The Union built a large fleet of fifty monitors modeled on their namesake.", "prediction 4": "The first ironclad warship commissioned by the Union Navy was the USS Monitor. The iron-hulled steamship was built during the American Civil War and was most famous for her central role in the Battle of Hampton Roads on 9 March 1862, where, under the command of Lieutenant John Worden, she fought the casemate ironclad (built on the hull of the former steam frigate ) to a standstill. The Union built a large fleet of fifty monitors modeled on their namesake ironclad gunship Virginia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 552 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "USS Monitor was the first ironclad warship commissioned by the Union Navy. It was deployed to protect the Union's wooden fleet from the ironclad ram \"Virginia\" and other Confederate warships. Other ships was quickly duplicated on the design. One was the New Ironsides. Engineer James Eads was contacted by the Union to build more as well." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Most amount of points scored in an nba game?", "passages": [ [ "Kiki VanDeWeghe", "The former game, on December 13, 1983, in which he had a career-high 51 points, is also the highest combined scoring game in NBA history, a 186-184 triple-overtime loss to the Detroit Pistons.", "VanDeWeghe subsequently had 50 points in another high-scoring game, this one a 163-155 win over the San Antonio Spurs on January 11, 1984 (at the time, the highest combined scoring NBA \"regulation\" game of all time).", "In the summer of 1984, VanDeWeghe was traded to the Portland Trail Blazers in exchange for Calvin Natt, Wayne Cooper, Fat Lever, and two draft picks.", "VanDeWeghe had several productive seasons in Portland, where he averaged nearly 25 points a game.", "He paired with Clyde Drexler to form a dynamic scoring duo.", "However, during the 1987\u201388 season, VanDeWeghe suffered a back injury and lost his starting job to Jerome Kersey.", "He was traded the next year to the New York Knicks (where his father played his entire career), with whom he played for several years.", "He then played half a season with the Los Angeles Clippers before retiring from the league after the 1992\u201393 season." ], [ "Phoenix Suns", "The Suns then were defeated in five games to the Trail Blazers in the Conference Semifinals.", "The series was punctuated by a game four in which the Suns lost in double overtime 153\u2013151 (the highest scoring game in NBA Playoff history to-date).", "That game was the last Suns game ever played at the Coliseum.", "In 1992, the Suns moved into their new arena in downtown Phoenix, the America West Arena.", "The arena is occasionally referred to as the \"Purple Palace\" due to its purple seats, one of the Suns' colors.", "All-Star power forward Charles Barkley was traded from the Philadelphia 76ers for Jeff Hornacek, Andrew Lang, and Tim Perry.", "Barkley went on to win the MVP award that 1992\u201393 season.", "In addition to Barkley, the Suns added key players to their roster, including Danny Ainge and draftees Arkansas center Oliver Miller and forward Richard Dumas (who was actually drafted in 1991 but was suspended for his rookie year for violating the NBA drug policy).", "Under rookie head coach Paul Westphal, a former Suns assistant and player with the 1976 Suns in the NBA Finals, the Suns won 62 games in 1992\u201393, setting a franchise record.", "In the first round of the playoffs, they defeated the eighth-seeded Lakers, coming back from a 0\u20132 deficit in the five-game series." ], [ "Wilt Chamberlain's 100-point game", "Wilt Chamberlain's 100-point game\n\nWilt Chamberlain set the single-game scoring record in the National Basketball Association (NBA) by scoring 100\u00a0points for the Philadelphia Warriors in a 169\u2013147 win over the New York Knicks on March 2, 1962, at Hershey Sports Arena in Hershey, Pennsylvania.", "It is widely considered one of the greatest records in basketball.", "Chamberlain set five other league records that game including most free throws made, a notable achievement, as he was regarded as a poor free throw shooter.", "The teams broke the record for most combined points in a game (316).", "That season, Chamberlain averaged a record 50.4 points per game, and he had broken the NBA single-game scoring record (71) earlier in the season in December with 78 points.", "The third-year center had already set season scoring records in his first two seasons.", "In the fourth quarter, the Knicks began fouling other players to keep the ball away from Chamberlain, and they also became deliberate on offense to reduce the number of possessions for Philadelphia.", "The Warriors countered by committing fouls of their own to get the ball back.", "The game was not televised, and no video footage of the game has been recovered; there are only audio recordings of the game's fourth quarter." ] ], "gold": "The most points scored by a single player in the NBA is 100, by Wilt Chamberlain playing for the Philadelphia Warriors against the New York Knicks on March 2, 1962. The most points score by a team is 186 by the Detroit Pistons against the Denver Nuggets on December 13, 1983. In that same game, the teams combined for 370, a record for a regular season game. The most combined points scored in a playoff game is 304 in a game between the Portland Trail Blazers and the Phoenix Suns on May 11, 1992.", "prediction 1": "There have been many games in which the most points scored in a single game in the NBA is 100. The most points scored in a game is 316, with 183 points in the fourth quarter. In the 1962 game, Wilt Chamberlain scored 100 points for the Philadelphia Warriors. In the 1983 game, Kiki VanDeWeghe scored 51 points.", "prediction 2": "The highest combined scoring game in NBA history is a 186-184 loss to the Detroit Pistons on December 13, 1983. Kiki VanDeWeghe scored 51 points in a 163-155 win over the San Antonio Spurs on January 11, 1984. Wilt Chamberlain scored 100 points in a 169-147 win over the New York Knicks on March 2, 1962.", "prediction 3": "In the NBA, the most points scored in a game is the total number of points scored by both teams. For example, Wilt Chamberlain scored 100 points in a game against the New York Knicks on March 2, 1962. Kiki VanDeWeghe scored 51 points in the game against the Detroit Pistons on December 13, 1983.", "prediction 4": "The game in which most points are scored is a triple overtime game between the Detroit Pistons and the Philadelphia Warriors on March 2, 1962. In that game, Kiki VanDeWeghe scored 51 points. The next game in which most points are scored is a triple overtime loss between the Detroit Pistons and the San Antonio Spurs on January 11, 1984.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 94 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 131, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 310 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "There have been many games in which the most points scored in a single game in the NBA is 100. The most points scored in a game is 370. It happened on December 13, 1983, with 186 points scored by the Detroit Pistons in highest combined scoring game in NBA history. In the March 2, 1962 game, Wilt Chamberlain set the single-game scoring record when he scored 100 points for the Philadelphia Warriors against the New York Knicks. The most combined points scored in a playoff game is 304 in a game between the Portland Trail Blazers and the Phoenix Suns." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Which raf base did the dambusters fly from?", "passages": [ [ "No. 617 Squadron RAF", "No. 617 Squadron RAF\n\nNumber 617 Squadron is a Royal Air Force aircraft squadron, based at RAF Marham in Norfolk.", "It is commonly known as the \"Dambusters\", for its actions during Operation Chastise against German dams during the Second World War.", "In the early 21st century it operated the Tornado GR4 in the ground attack and reconnaissance role until being disbanded in the spring of 2014.", "The squadron reformed on 17 April 2018, and was equipped at RAF Marham during summer 2018 with the F-35 Lightning II, becoming the UK's first squadron with this advanced V/STOL type.", "According to the squadron's entry in \"Flying Units of the RAF\" by Alan Lake, 617 was allocated the unit identification code MZ for the period April to September 1939, even though the unit did not actually exist at the time.", "The squadron was formed under great secrecy at RAF Scampton during the Second World War on 21 March 1943.", "It included Royal Canadian Air Force, Royal Australian Air Force and Royal New Zealand Air Force personnel and was formed for the specific task of attacking three major dams that contributed water and power to the Ruhr industrial region in Germany: the M\u00f6hne, Eder and Sorpe.", "The plan was given the codename Operation Chastise and carried out on 17 May 1943." ], [ "The Dam Busters (film)", "Guy Gibson had been based at Hemswell in his final posting and the airfield had been an operational Avro Lancaster base during the war.", "At the time filming took place it was then home to No. 109 Squadron and No. 139 Squadron RAF, which were both operating English Electric Canberras on electronic countermeasures and nuclear air sampling missions over hydrogen bomb test sites in the Pacific and Australia.", "However, part of the RAF's fleet of ageing Avro Lincolns had been mothballed at Hemswell prior to being broken up and several of these static aircraft appeared in background shots during filming, doubling for additional No 617 Squadron Lancasters.", "The station headquarters building still stands on what is now an industrial estate and is named Gibson House.", "The four wartime hangars also still stand, little changed in external appearance since the war.", "Serving RAF pilots from both squadrons based at Hemswell took turns flying the Lancasters during filming and found the close formation and low level flying around Derwentwater and Windermere exhilarating and a welcome change from their normal high level solo Canberra sorties.", "Three of the four Lancaster bombers used in the film had also appeared in the Dirk Bogarde film \"Appointment in London\" two years earlier.", "The theatre scene showing the spotlights was filmed at the Lyric Theatre Hammersmith." ], [ "The Dam Busters (film)", "The Dam Busters (film)\n\nThe Dam Busters is a 1955 British epic war film starring Michael Redgrave and Richard Todd.", "It was directed by Michael Anderson.", "The film recreates the true story of Operation Chastise when in 1943 the RAF's 617 Squadron attacked the M\u00f6hne, Eder, and Sorpe dams in Nazi Germany with Barnes Wallis's \"bouncing bomb\".", "The film was based on the books \"The Dam Busters\" (1951) by Paul Brickhill and \"Enemy Coast Ahead\" (1946) by Guy Gibson.", "The film's reflective last minutes convey the poignant mix of emotions felt by the characters \u2013 triumph over striking a successful blow against the enemy's industrial base is tempered by the sobering knowledge that many died in the process of delivering it.", "The film became very popular and was the most popular film at British cinemas in 1955.", "In 1999, the British Film Institute voted \"The Dam Busters\" the 68th greatest British film of the 20th century.", "Its depiction of the raid, along with a similar sequence in the film \"633 Squadron\", provided the inspiration for the Death Star trench run in \"Star Wars: A New Hope\".", "A remake has been in development since 2008, but has yet to be produced as of 2018." ] ], "gold": "The real RAF squadron Number 617, known as the \"Dambusters\" for its actions during Operation Chastise against German dams during the Second World War, was based at RAF Scampton. In the 1955 epic war film The Dam Busters, some scenes were shot there at RAF Scampton, but the principal airfield used for ground location shooting was RAF Hemswell, a few miles north and still an operational RAF station at the time of filming.", "prediction 1": "The Dam Busters is a 1955 British epic war film starring Michael Redgrave and Richard Todd. It recreates the true story of Operation Chastise when in 1943 the RAF's 617 Squadron attacked the M\u00f6hne, Eder, and Sorpe dams in Nazi Germany with Barnes Wallis's \"bouncing bomb\". Serving RAF pilots from both squadrons based at Hemswell took turns flying the Lancasters during filming and found the close formation and low level flying around Derwentwater and Windermere exhilarating and a welcome change from their normal high level solo solo Canberras. The squadron reformed on 17 April 2018, and is currently based at RAF Marham.", "prediction 2": "The Dam Busters is a 1955 British epic war film starring Michael Redgrave and Richard Todd. The film recreates the true story of Operation Chastise when in 1943 the RAF's 617 Squadron attacked the M\u00f6hne, Eder, and Sorpe dams in Nazi Germany with Barnes Wallis's \"bouncing bomb\". Serving RAF pilots from both squadrons based at Hemswell took turns flying the Lancasters during filming and found the close formation and low level flying around Derwentwater exhilarating and Windermere exhilarating and a welcome change from their usual high level solo Canberras.", "prediction 3": "The Dam Busters are a British aerial warfare team, based at RAF Marham, Norfolk. They were part of the 617 Squadron, a Royal Air Force aircraft squadron, that flew from RAF Scampton during World War II, during Operation Chastise against German dams. The squadron was formed at RAF Scampton during the Second World War on 21 March 1943, including Royal Canadian Air Force, Royal Australian Air Force and Royal New Zealand Air Force personnel. The squadron flew from RAF Marham, Norfolk, RAF Marham, Norfolk. RAF Marham was the base used as an operational Avro Lancaster during the War.", "prediction 4": "The Dam Busters was a British action film, based on the 1955 novel by Guy Gibson, that recreates the true story of Operation Chastise, when RAF 617 Squadron flew from RAF Marham, Norfolk. Serving RAF pilots from both squadrons based at Hemswell took turns flying the Lancasters during filming.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 547 }, { "error type": "Irrelevant", "explanation": "", "start": 548, "end": 625 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Dam Busters is a 1955 British epic war film. The filming took place at RAF Hemswell. The real ones, Number 617 Squadron, is a Royal Air Force aircraft squadron commonly known as the \"Dambusters\", for its actions during Operation Chastise against German dams during the Second World War. The squadron was formed at RAF Scampton." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did the current \u00a320 note come out?", "passages": [ [ "Bank of England \u00a320 note", "This declaration remains on Bank of England banknotes to this day.", "A printed signature of one of three cashiers appeared on the printed notes, though this was replaced by the signature of the Chief Cashier from 1870 onward.", "The right to redeem banknotes for gold ceased in 1931 when Britain stopped using the gold standard.", "The twenty pound note ceased to be produced by the Bank of England in 1943, and it was not until 1970 with the introduction of the series D notes that the denomination reappeared.", "The predominantly purple series D notes were two-sided, with an image of Queen Elizabeth II appearing on one side, accompanied by an image of Saint George and the Dragon (all subsequent Bank of England notes also feature an image of the Queen) and an image of William Shakespeare appearing on the other.", "This note also had a security feature in the form of a 'windowed' metal thread.", "The thread is woven into the paper so that it forms a dashed line, yet appears as a single line when held up to the light.", "Series D notes were phased out in favour of the newer series E notes beginning in 1991.", "These notes were multicoloured (predominantly mauve-purple) and featured an image of scientist Michael Faraday on the back.", "Series E notes were replaced by a variant design from 1999 onwards." ], [ "Bank of Ireland \u00a320 note", "Bank of Ireland \u00a320 note\n\nThe Bank of Ireland \u00a320 note is a banknote of the pound sterling.", "It is the third largest of five denominations of banknote issued by the Bank of Ireland.", "The Bank of Ireland began issuing notes in 1783, the same year as the bank's founding.", "Early banknotes were denominations of the Irish Pound, but following that currency's abolition in 1826 banknotes produced by the Bank of Ireland were denominated in pounds sterling.", "These early banknotes were printed by the bank in Dublin, and featured a design with a row of Mercury heads across the top.", "This basic design remained effectively unchanged for 120 years.", "Northern Irish banknotes are fully backed such that holders have the same level of protection as those holding genuine Bank of England notes.", "The \u00a320 note is currently the third largest of five denominations of banknote issued by the Bank of Ireland.", "The \u00a320 note of the Queen's University Belfast Series was first issued in 2007.", "This issue features a representation of Hibernia on the front, alongside shields of arms of the six counties of Northern Ireland.", "The back of this note displays an image of Queen's University Belfast.", "In 2008 a new series featuring the image of the Old Bushmills Distillery on the reverse was introduced.", "Apart from this change of rear design the difference between this note and the preceding series is minimal." ], [ "Bank of England \u00a320 note", "These are broadly similar to the earlier series E notes but feature Edward Elgar on the reverse.", "The current \u00a320 note was introduced in 2007.", "It features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory.", "The note features a number of security features in addition to the metallic thread: these include raised print, a watermark, microlettering, a holographic strip, a see-through register, and a colourful pattern which only appears under ultraviolet light.", "In September 2015 the Bank of England announced that the next \u00a320 note will be printed on polymer, rather than cotton paper.", "This was followed by an announcement in April 2016 that Adam Smith will be replaced by artist J. M. W. Turner on the next \u00a320 note, which will enter circulation in 2020.", "Images on the reverse of the Turner note will include a c.1799 self-portrait of Turner, a version of Turner's \"The Fighting Temeraire\", the quote \"Light is therefore colour\" from an 1818 lecture by Turner, and a copy of Turner's signature as made on his will.", "Information taken from Bank of England website." ] ], "gold": "The Bank of England \u00a320 note is a banknote of the pound sterling. The original Series E \u00a320 note came out on 5 June 1991. The Series E (variant) \u00a320 note came out on 22 June 1999. The Series F \u00a320 note came out on 13 March 2007.", "prediction 1": "The Bank of England \u00a320 note is a banknote of the pound sterling. It is the third largest of five denominations of banknote issued by the Bank of Ireland. The current \u00a320 note was introduced in 2007. It features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory.\n", "prediction 2": "The Bank of England \u00a320 note is an English banknote that is a banknote of the pound sterling, which is the third largest of five denominations of banknote issued by the Bank of Ireland. The Bank of England \u00a320 note was first issued in 1783. The Bank of Ireland \u00a320 note is currently the third largest of five denominations of banknote issued by the Bank of Ireland. The current version of the \u00a320 note is a portrait of Scottish economist Adam Smith featuring a portrait on the back in his iconic style with an illustration of workers in a pin factory. The latest version of the \u00a320 note features a painting by J. M. W. Turner. The current series E notes also features holographic strip, which only appears under ultraviolet light.", "prediction 3": "\u00a320 notes have been issued by several banks. The Bank of Ireland \u00a320 note is a banknote of the pound sterling. It is the third largest of five denominations of banknote issued by the Bank of Ireland. The Bank of England \u00a320 note first came out in 1858. The Bank of England \u00a320 note of the Queen's University Belfast Series was first issued in 2007. The Bank of England \u00a320 note of the Old Bushmills Distillery Series was first issued in 2007. The Bank of England \u00a320 note of the Trian 85% single sheet design, featuring an image of an image of the Queen.", "prediction 4": "In 1917 the Bank of England introduced the less expensive series A banknotes. The Bank of Ireland introduced the series C banknotes in 1970. The current Bank of Ireland \u00a320 note came out in 2007. It comes with a portrait of Scottish economist Adam Smith and an illustration of workers in a pin factory.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 324 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 12 ] } ], "corrected-prediction": "The Bank of England \u00a320 note is a banknote of the pound sterling. The twenty pound note ceased to be produced by the Bank of England in 1943, and it was not until 1970 with the introduction of the series D notes that the denomination reappeared. Series D notes were phased out in favour of the newer series E notes beginning in 1991. Series E notes were replaced by a variant design from 1999 onwards. The current \u00a320 note was introduced in 2007. The Bank of England announced that the next \u00a320 note will enter circulation in 2020. The Bank of Ireland began issuing notes in 1783. The \u00a320 note of the Queen's University Belfast Series was first issued in 2007. In 2008 a new series featuring the image of the Old Bushmills Distillery on the reverse was introduced.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who developed the first model of the mouse?", "passages": [ [ "Computer mouse", "On 9 December 1968, Engelbart publicly demonstrated the mouse at what would come to be known as The Mother of All Demos.", "Engelbart never received any royalties for it, as his employer SRI held the patent, which expired before the mouse became widely used in personal computers.", "In any event, the invention of the mouse was just a small part of Engelbart's much larger project of augmenting human intellect.", "Several other experimental pointing-devices developed for Engelbart's oN-Line System (NLS) exploited different body movements \u2013\u00a0for example, head-mounted devices attached to the chin or nose\u00a0\u2013 but ultimately the mouse won out because of its speed and convenience.", "The first mouse, a bulky device (pictured) used two potentiometers perpendicular to each other and connected to wheels: the rotation of each wheel translated into motion along one axis.", "At the time of the \"Mother of All Demos\", Engelbart's group had been using their second generation, 3-button mouse for about a year.", "On October 2, 1968, a mouse device named ' (German for \"rolling ball\") was described as an optional device for its SIG-100 terminal was developed by the German company Telefunken.", "As the name suggests and unlike Engelbart's mouse, the Telefunken model already had a ball." ], [ "Computer mouse", "The plural of a computer mouse is \"mouses\" and \"mice\" according to most dictionaries, but \"mice\" being more common.", "The first recorded plural usage is \"mice\"; the online \"Oxford Dictionaries\" cites a 1984 use, and earlier uses include J. C. R. Licklider's \"The Computer as a Communication Device\" of 1968.", "The term computer mouses may be used informally in some cases.", "Although, the plural of mouse (small rodent) is mice, the two words have undergone a differentiation through usage.", "The trackball, a related pointing device, was invented in 1946 by Ralph Benjamin as part of a post-World War II-era fire-control radar plotting system called Comprehensive Display System (CDS).", "Benjamin was then working for the British Royal Navy Scientific Service.", "Benjamin's project used analog computers to calculate the future position of target aircraft based on several initial input points provided by a user with a joystick.", "Benjamin felt that a more elegant input device was needed and invented what they called a \"roller ball\" for this purpose.", "The device was patented in 1947, but only a prototype using a metal ball rolling on two rubber-coated wheels was ever built, and the device was kept as a military secret." ], [ "Computer mouse", "By 1963, Engelbart had already established a research lab at SRI, the Augmentation Research Center (ARC), to pursue his objective of developing both hardware and software computer technology to \"augment\" human intelligence.", "That November, while attending a conference on computer graphics in Reno, Nevada, Engelbart began to ponder how to adapt the underlying principles of the planimeter to X-Y coordinate input.", "On November 14, 1963, he first recorded his thoughts in his personal notebook about something he initially called a \"bug,\" which in a \"3-point\" form could have a \"drop point and 2 orthogonal wheels.\"", "He wrote that the \"bug\" would be \"easier\" and \"more natural\" to use, and unlike a stylus, it would stay still when let go, which meant it would be \"much better for coordination with the keyboard.\"", "In 1964, Bill English joined ARC, where he helped Engelbart build the first mouse prototype.", "They christened the device the \"mouse\" as early models had a cord attached to the rear part of the device which looked like a tail, and in turn resembled the common mouse.", "As noted above, this \"mouse\" was first mentioned in print in a July 1965 report, on which English was the lead author." ] ], "gold": "Ralph Benjamin developed the trackball, the precursor the the modern mouse, in 1946 as a way to control user inputs in military targeting computing with a joystick His work laid the foundation for the first ball mouse prototype to be developed by Bill English in 1964, with the help of Douglas Engelbart and his Augmentation Research Center. They christened the device the \"mouse\" as early models had a cord attached to the rear part of the device which looked like a tail, and in turn resembled the common mouse.", "prediction 1": "Bill English developed the first model of the mouse. Engelbart worked with English to build the first model of the mouse.", "prediction 2": "Bill English, with the help of Engelbart, developed the first model of the computer mouse. In 1964, English and Engelbart built the first mouse prototype. The first model used two potentiometers perpendicular to each other and connected to wheels: the rotation of each wheel translated into motion along one axis. On October 2, 1968, a mouse device named'was described as an optional device for its SIG-100 terminal was developed by the German company Telefunken. As the name suggests and unlike Engelbart's mouse, the Telefunken model already had a ball.", "prediction 3": "In 1964, Bill English joined ARC, where he helped Engelbart build the first mouse prototype. They christened the device the mouse as early models had a cord attached to the rear part of the device which looked like a tail, and in turn resembled the common mouse. On October 2, 1968, a mouse device named'was described as an optional device for its SIG-100 terminal was developed by the German company Telefunken. As the name suggests and unlike Engelbart's mouse, the Telefunken model already had a ball.", "prediction 4": "In 1964, Bill English and Engelbart developed the first model of the mouse. They christened the device the \"mouse\" as early models had a cord attached to the rear part of the device which looked like a tail, and in turn resembled the common mouse. On October 2, 1968, a mouse device named'was described as an optional device for its SIG-100 terminal was developed by the German company Telefunken.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 0, "end": 12 }, { "error type": "Redundant", "explanation": "Bill English developed the first model of the mouse. ", "start": 86, "end": 121 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The trackball, a related pointing device, was invented in 1946 by Ralph Benjamin. It used analog computers to calculate the future position of target aircraft based on several initial input points provided by a user with a joystick. Bill English joined the Augmentation Research Center (ARC) in 1964 and helped Engelbart build the first mouse prototype. They christened the device the \"mouse\" as early models had a cord attached to the rear part of the device which looked like a tail, and in turn resembled the common mouse." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Who is number 22 on the kansas city chiefs team?", "passages": [ [ "Kansas City Chiefs", "Kansas City Chiefs\n\nThe Kansas City Chiefs are a professional American football team based in Kansas City, Missouri.", "The Chiefs compete in the National Football League (NFL) as a member club of the league's American Football Conference (AFC) West division.", "The team was founded in 1960 as the Dallas Texans by businessman Lamar Hunt and was a charter member of the American Football League (AFL).", "(They are not associated with the NFL Dallas Texans.)", "In 1963, the team relocated to Kansas City and assumed their current name.", "The Chiefs joined the NFL as a result of the merger in 1970.", "The team is valued at over $2 billion.", "Hunt's son, Clark, serves as chairman and CEO.", "While Hunt's ownership stakes passed collectively to his widow and children after his death in 2006, Clark represents the Chiefs at all league meetings and has ultimate authority on personnel changes.", "The Chiefs have won three AFL championships, in 1962, 1966, and 1969 and became the second AFL team (after the New York Jets) to defeat an NFL team in an AFL\u2013NFL World Championship Game, when they defeated the Minnesota Vikings in Super Bowl IV.", "The team's victory on January 11, 1970, remains the club's last championship game victory and appearance to date, and occurred in the final such competition prior to the leagues' merger coming into full effect." ], [ "Marcus Peters", "Marcus Peters\n\nMarcus Peters (born January 9, 1993) is an American football cornerback for the Los Angeles Rams of the National Football League (NFL).", "He was drafted by the Kansas City Chiefs in the first round of the 2015 NFL Draft.", "He played college football at Washington.", "Peters attended and graduated from McClymonds High School in Oakland, California, where he played football and ran track.", "He played as a cornerback for coach Curtis McCauley.", "As a senior, he notched seven interceptions and scored six touchdowns on kick or punt returns.", "He also played wide receiver and kicker.", "He was named the MVP of the Oakland Athletic League, as he led the Warriors to a 12-0 record, the school's first perfect season.", "In track & field, Peters competed as a sprinter.", "and as a senior he won the 100 meters (10.87 s) and 200 meters (22.91 s) events at the Oakland Athletic League Championships.", "Peters was a three-star recruit by Rivals.com and the 30th best cornerback in his class.", "He committed to play college football at the University of Washington in January 2011.", "Peters was redshirted as a freshman in 2011.", "As a redshirt freshman in 2012, Peters started eight of 13 games, recording 44 tackles, three interceptions and a touchdown." ], [ "2009 Ole Miss Rebels football team", "Dexter McCluster (Kansas City Chiefs; 2nd round; 36th overall pick), OL John Jerry (Miami Dolphins; 3rd round; 73rd overall pick), S Kendrick Lewis (Kansas City Chiefs; 5th round; 136th overall pick) and DE Greg Hardy (Carolina Panthers; 6th round; 175th overall pick) were drafted while QB Jevan Snead (Tampa Bay Buccaneers), RB Cordera Eason (Cincinnati Bengals), TE Gerald Harris (Tennessee Titans), LB Patrick Trahan (Tennessee Titans), WR Shay Hodge (San Francisco 49ers), CB Marshay Green (Arizona Cardinals), CB Cassius Vaughn (Denver Broncos) and DE Emmanuel Stephens (Atlanta Falcons) signed free agent contracts." ] ], "gold": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri who compete in the National Football League as a member club of the league's American Football Conference west division. Marcus Peters was number 22 on the Kansas City Chiefs from 2015-2017. Dexter McLeon was number 22 for the Kansas City Chiefs from 2003-06 and Dexter McCluster was the second round pick who was number 22 on the Kansas City Chiefs. Willie Mitchell was number 22 on the Kansas City Chiefs in the 1960s.", "prediction 1": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri that compete in the National Football League (NFL) as a member club of the league's American Football Conference West division. Kendrick Lewis is the number 22 overall pick on the team's 2017 draft class.", "prediction 2": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri. The team was founded in 1960 as the Dallas Texans by businessman Lamar Hunt and was a charter member of the American Football League (AFL). The Chiefs joined the NFL as a result of the merger in 1970. The top 22 players on the team's depth chart were Dexter McCluster, John Jerry, Kendrick Lewis, Greg Hardy, and Emmanuel Stephens.", "prediction 3": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri. The team was founded in 1960 as the Dallas Texans by businessman Lamar Hunt and was a charter member of the American Football League. The Chiefs joined the NFL as a result of the merger in 1970. The 22nd ranked player on the Kansas City Chiefs team is Kendrick Lewis.", "prediction 4": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri. The team was founded in 1960 as the Dallas Texans by businessman Lamar Hunt and was a charter member of the American Football League (AFL). The 22nd player on the Kansas City Chiefs team was cornerback Marcus Peters. The 23rd player on the Kansas City Chiefs team was safety Dexter McCluster.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 224, "end": 300 } ], "missing-info": [], "corrected-prediction": "The Kansas City Chiefs are a professional American football team based in Kansas City, Missouri that compete in the National Football League (NFL) as a member club of the league's American Football Conference West division. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who's playing quarterback for green bay packers?", "passages": [ [ "History of the Green Bay Packers", "After leading throughout most of regulation they lost 28-22 in a historic overtime rally by Seattle, who came up short in their bid for a second consecutive league title when they lost to the New England Patriots 28-24 in Super Bowl XLIX two weeks later.", "In 2015, the Packers lost wide receiver Jordy Nelson to a torn ACL in the preseason.", "The Packers got off to a 6-0 start, but then went 1-4 to sit at 7-4 after Week 12.", "During Week 13 at Detroit, after trailing 20-0 in the second half, Aaron Rodgers threw a 61-yard Hail Mary pass to tight end Richard Rodgers with no time left on the clock to win the game 27-23 after a facemask penalty was called on Detroit as time expired.", "The Packers clinched their seventh consecutive playoff berth with a Week 15 win at the Oakland Raiders, but lost the division title to the Vikings in Week 17.", "With a 10-6 record, the Packers secured the fifth seed in the playoffs.", "They beat the fourth-seeded Washington Redskins on the road 35-18 and traveled to face the second-seeded Arizona Cardinals.", "A similar play to what happened in Week 13 at Detroit occurred in the last 5 seconds when Aaron Rodgers threw a Hail Mary pass to wide receiver Jeff Janis to send the game to overtime." ], [ "Manny Wilkins", "Manny Wilkins\n\nManny Wilkins Jr. is an American football quarterback for the Arizona State University Sun Devils.", "When Wilkins was sixteen years old, he was identified as a talented prospect.", "Manny's Father, Manny Wilkins Sr., died when Manny was 10 years old in 2006.", "Wilkins relocated to Texas with his Mother in 2008, where he played football at Elkins High School.", "Wilkins relocated back to California to live with his aunt and uncle.", "Wilkins starred at quarterback while attending San Marin High School in Novato CA.", "Wilkins came to Arizona State as one of the most prolific QB prospects in ASU history.", "After redshirting his first season, and only appearing in three games in his redshirt freshman campaign, Wilkins won the starting quarterback position, beating out highly touted prospect, Brady White.", "Wilkins redshirted his freshman year and didn't see game action.", "In 2015, Wilkins saw limited game action, Wilkins may have not thrown a pass, but had 7 rushing attempts for 55 yards.", "As a sophomore, Wilkins started 10 games beating out Brady White for the starting job in training camp.", "Wilkins finished the season with 197 completions for 311 attempts for 2329 yards and 12 touchdowns with 9 interceptions.", "Wilkins also had 128 rushing attempts for 246 yards and 5 touchdowns.", "As a junior, Wilkins started all 13 games and had 260 completions on 410 attempts for 3270 yards and 20 touchdowns and 8 interceptions." ], [ "Jake Kumerow", "Jake Kumerow\n\nJake Kumerow (born February 17, 1992) is an American football wide receiver for the Green Bay Packers of the National Football League (NFL).", "He was signed by the Cincinnati Bengals as an undrafted free agent in 2015.", "He played college football at Wisconsin\u2013Whitewater after transferring from Illinois.", "Kumerow signed with the Cincinnati Bengals as an undrafted free agent on May 8, 2015.", "He was released on September 5, 2015, and was signed to the practice squad the next day, where he spent his entire rookie season.", "He signed a reserve/future contract with the Bengals on January 11, 2016.", "Kumerow was released by the Bengals on September 3, 2016, and was signed to the practice squad during the next day.", "He was promoted to the active roster on December 27, 2016.", "On August 9, 2017, Kumerow was waived/injured by the Bengals after suffering an ankle injury and was placed on injured reserve.", "He was released on September 22, 2017 with an injury settlement.", "On October 26, 2017, Kumerow was signed to the New England Patriots' practice squad.", "He was released on November 9, 2017.", "On December 26, 2017, Kumerow was signed to the Green Bay Packers' practice squad.", "He signed a reserve/future contract with the Packers on January 2, 2018." ] ], "gold": "Aaron Rodgers, considered by many sportscasters and players to be one of the greatest and most talented quarterbacks of all time, plays quarterback for the Green Bay Packers wearing No. 12. Manny Wilkins, wearing No. 18, was briefly contracted with the team in January 2020, but was released three months later. Tim Boyle, wearing No. 8, joined the Packers in 2018 as third string quarterback, and was released as a free agent in March 2021.", "prediction 1": "Aaron Rodgers played his final game of the 2014 season as the Green Bay Packers quarterback. Since then, Rodgers has used three different quarterbacks, Manny Wilkins Jr., Manny Kumerow, and Brady White. Wilkins, who started both of his years at Arizona State, is the current starting quarterback for the Green Bay Packers.", "prediction 2": "Manny Wilkins is an American football quarterback for the Green Bay Packers. He was drafted by the Cincinnati Bengals as an undrafted free agent on May 8, 2015 and was released on September 5, 2015. Jake Kumerow is an American football wide receiver for the Green Bay Packers.", "prediction 3": "The Green Bay Packers have had three quarterbacks play this season, Aaron Rodgers, Manny Wilkins, Jake Kumerow, and Trent Richardson. In 2018, Aaron Rodgers threw a 61-yard Hail Mary pass to tight end Richard Rodgers, who won the game 27-23. In 2019, the Packers had six quarterbacks play.", "prediction 4": "There are several quarterbacks for the Green Bay Packers. One is Manny Wilkins, the other is Jake Kumerow, an American football wide receiver for the Packers.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 14, "end": 92 }, { "error type": "Incoherent", "explanation": "", "start": 105, "end": 112 }, { "error type": "Incoherent", "explanation": "", "start": 224, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 259 }, { "error type": "Unverifiable", "explanation": "", "start": 267, "end": 295 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 152, "end": 170 }, { "error type": "Unverifiable", "explanation": "", "start": 190, "end": 202 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 171, "end": 185 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Aaron Rodgers played quarterback for the Green Bay Packers. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When do birth of the dragon come out?", "passages": [ [ "Birth of the Dragon", "Filming was previously scheduled to begin at the North Shore Studios in Vancouver, British Columbia on October 28, 2015.", "Principal photography on the film began on November 17, 2015, in the Metro Vancouver area.", "Filming would last through January 24, 2016.", "In North America, \"Birth of the Dragon\" was released on August 25, 2017, alongside \"All Saints\" and \"Leap! \", and was projected to gross around $3 million from 1,618 theaters in its opening weekend.", "It made $1.1 million on its first day and $2.7 million over the weekend, finishing 8th at the box office.", "The film's low opening was attributed to Hurricane Harvey hitting Texas and surrounding areas causing theaters to close, the boxing match between Floyd Mayweather and Conor McGregor on Saturday, and a negative response from critics and fans.", "On Rotten Tomatoes the film has an approval rating of 26% based on 46 reviews, with an average rating of 4.3/10.", "On Metacritic, the film has a score of 35 out of 100, based on reviews from 13 critics, indicating \"generally unfavorable reviews\".", "Audiences polled by CinemaScore gave the film an average grade of \"B\" on an A+ to F scale." ], [ "Birth of the Dragon", "Birth of the Dragon\n\nBirth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele.", "The film stars Philip Ng, Xia Yu, and Billy Magnussen.", "The film is a fictional account on the supposedly true story revolving around the young martial artist Bruce Lee, who challenged kung fu master Wong Jack Man in 1965 in San Francisco.", "Principal photography began in Vancouver, Canada on November 17, 2015.", "It was selected to be screened in the Special Presentations section at the 2016 Toronto International Film Festival, and was released on August 25, 2017, by Blumhouse Tilt and WWE Studios.", "In 1964, a young Bruce Lee (Philip Ng) owns and operates a San Francisco Kung Fu Academy, specializing in the Chinese martial art Wing Chun.", "Lee cares for his students, providing advice, roles as extras in his upcoming projects, and defending them from the gangs of Chinatown.", "One of Lee's students, Steve McKee (Billy Magnussen), spars with Lee while fighting in anger, causing Lee to counter and embarrass him.", "McKee and Vinnie Wei (Simon Yin) work for the latter's mother's laundry business, where they find out that master Wong Jack Man (Xia Yu) is on a pilgrimage from China to observe the kung fu scene in the United States." ], [ "2016 Toronto International Film Festival", "2016 Toronto International Film Festival\n\nThe 41st annual Toronto International Film Festival was held from 8 to 18 September 2016.", "The first announcement of films to be screened at the festival took place on 26 July.", "Almost 400 films were shown.", "The festival's final awards were announced on 18 September.", "The jury for the Platform section (in its second year) comprised Brian de Palma (American director), Mahamat-Saleh Haroun (Chadian director), and Zhang Ziyi (Chinese actress).", "The Platform section (named for Jia Zhangke's film \"Platform\") consists of \"12 films of high artistic merit that demonstrate a strong directorial vision\".", "The jury awarded the $25,000 prize to \"Jackie\".", "The following films were selected:\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n", "In December, TIFF programmers released their annual Canada's Top Ten list of the films selected as the ten best Canadian films of 2016.", "The selected films received a follow-up screening at the TIFF Bell Lightbox as a \"Canada's Top Ten\" minifestival in January 2017, as well as in selected other cities including Vancouver, Calgary, Edmonton, Regina, Saskatoon, Winnipeg, Ottawa, Montreal and Halifax." ] ], "gold": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele, and is a fictional account on the supposedly true story revolving around the young martial artist Bruce Lee, who challenged kung fu master Wong Jack-man in 1965 in San Francisco. The film was selected to be screened in the Special Presentations section at the 2016 Toronto International Film Festival, also known as TIFF, on September 13, 2016. The festival ran from September 8 to September 18 of that year. It came out in the United States on August 25, 2017 and was released by Blumhouse Tilt and WWE Studios.", "prediction 1": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele. The film is a fictional account on the supposedly true story revolving around the young martial artist Bruce Lee, who challenged kung fu master Wong Jack Man in 1965 in San Francisco. Filming was previously scheduled to begin at the North Shore Studios in Vancouver, British Columbia on October 28, 2015. Filming would last through January 24, 2016. In North America, \"Birth of the Dragon\" was released on August 25, 2017, alongside \"All Saints\" and \"Leap! \"Leap! \"Leap!\" and \"Leap! \"Birth of the Dragon\" was projected to gross around $3 million from 1,618 theaters in its opening weekend. It made $1.1 million on its first day and $2.7 million over the weekend, finishing 8th", "prediction 2": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele. The film was selected to be screened in the Special Presentations section at the 2016 Toronto International Film Festival, and was released on August 25, 2017.", "prediction 3": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele. The film's principal photography began in Vancouver, Canada on November 17, 2015. Birth of the Dragon was released on August 25, 2017 by Blumhouse Tilt and WWE Studios.", "prediction 4": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele. The film's principal photography began in Vancouver, Canada on November 17, 2015. It was selected to be screened in the Special Presentations section at the 2016 Toronto International Film Festival, and was released on August 25, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 333, "end": 453 }, { "error type": "Irrelevant", "explanation": "", "start": 454, "end": 498 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 599, "end": 638 }, { "error type": "Irrelevant", "explanation": "", "start": 658, "end": 738 }, { "error type": "Irrelevant", "explanation": "", "start": 739, "end": 825 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Birth of the Dragon is a 2016 American martial arts action film directed by George Nolfi and written by Christopher Wilkinson and Stephen J. Rivele. The film is a fictional account on the supposedly true story revolving around the young martial artist Bruce Lee, who challenged kung fu master Wong Jack Man in 1965 in San Francisco. In North America, \"Birth of the Dragon\" was released on August 25, 2017. It was selected to be screened in the Special Presentations section at the 2016 Toronto International Film Festival, it was held from 8 to 18 September 2016. and was released by Blumhouse Tilt and WWE Studios." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Lord shiva wrote song for which poet name?", "passages": [ [ "Iraiyanar", "Iraiyanar\n\nIraiyanar (Tamil: \u0b87\u0bb1\u0bc8\u0baf\u0ba9\u0bbe\u0bb0\u0bcd), literally meaning \"the Lord\" and also a common name of Shiva, was a legendary poet of the Sangam period who is believed to have composed verse 2 of Kurunthogai.", "He was believed to be the incarnation of Lord Shiva of the temple at Madurai, known as 'Aalavaai Sokkar' or 'Sokkanathar'.", "Verse 3 of the Tiruvalluva Maalai, praising Valluvar, is also attributed to him.", "Iraiyanar appears in the \"Tiruvilaiyadal Puranam\", where he confronts poet Nakkeerar.", "He is also said to have given the work Iraiyanar Akapporul." ], [ "Shiva", "Shiva\n\nShiva (; Sanskrit: \u0936\u093f\u0935, , lit.", "\"the auspicious one\") is one of the principal deities of Hinduism.", "He is the Supreme Being within Shaivism, one of the major traditions within contemporary Hinduism.", "Shiva is known as the \"Creator, maintainer and the destroyer\" within the Trimurti, the Hindu trinity that includes Brahma and Vishnu.", "In Shaivism tradition, Shiva is the Supreme being who creates, protects and transforms the universe.", "In the tradition of Hinduism called Shaktism, the Goddess, or Devi, is described as supreme, yet Shiva is revered along with Vishnu and Brahma.", "A goddess is stated to be the energy and creative power (Shakti) of each, with Parvati (Sati) the equal complementary partner of Shiva.", "He is one of the five equivalent deities in Panchayatana puja of the Smarta tradition of Hinduism.", "According to the Shaivism sect, the highest form of Shiva is formless, limitless, transcendent and unchanging absolute Brahman, and the primal Atman (soul, self) of the universe.", "There are many both benevolent and fearsome depictions of Shiva." ] ], "gold": "Shiva is one of the principal deities of Hinduism. He is the Supreme Being in Shaivism, one of the major traditions within Hinduism. Iraiyanar, literally meaning \"the Lord\" was a legendary poet of the Sangam period who is believed to be the incarnation of Lord Shiva of the temple at Madurai. Verse 3 of the Tiruvalluva Maalai, praising Valluvar, is attributed to him.", "prediction 1": "He is believed to have composed the song Kurunthogai for Iraiyanar, who was the legendary poet of the Sangam period. He was believed to be the incarnation of Lord Shiva of the temple at Madurai, known as Aalavaai Sokkar or Sokkkanathar.", "prediction 2": "Iraiyanar is a legendary poet of the Sangam period who is believed to have composed verse 2 of Kurunthogai. He was believed to be the incarnation of Lord Shiva of the temple at Madurai, known as 'Aalavaai Sokkar' or 'Sokkanathar'. He is also believed to have given the work Iraiyanar Akapporul.", "prediction 3": "Shiva is a deity who is the Supreme Being within Shaivism, one of the major traditions within contemporary Hinduism. He is known as the Creator, Maintainer and the Disposer of the universe. In Shaivism tradition, Shiva is the Supreme Being who creates, protects and transforms the universe. In Iraiyanar Akapporul, the legendary poet of the Sangam period, Lord Shiva is said to have composed verse 2 of Kurunthogai.", "prediction 4": "Lord Shiva was a legendary poet of the Sangam period who is believed to have composed verse 2 of Kurunthogai. He was believed to be the incarnation of Lord Shiva of the temple at Madurai, known as 'Aalavaai Sokkar' or 'Sokkanathar'. He is also believed to have given the work Iraiyanar Akapporul.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 236 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 67 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Shiva is one of the principal deities of Hinduism. He is the Supreme Being in Shaivism, one of the major traditions within Hinduism. Iraiyanar, literally meaning \"the Lord\" was a legendary poet of the Sangam period who is believed to have composed verse 2 of Kurunthogai. He was believed to be the incarnation of Lord Shiva of the temple at Madurai. Verse 3 of the Tiruvalluva Maalai, praising Valluvar, is also attributed to him." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Where is finding dory supposed to take place?", "passages": [ [ "Finding Dory", "Finding Dory\n\nFinding Dory is a 2016 American 3D computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures.", "Directed by Andrew Stanton with co-direction by Angus MacLane, the screenplay was written by Stanton and Victoria Strouse.", "The film is a sequel/spinoff to 2003's \"Finding Nemo\" and features the returning voices of Ellen DeGeneres and Albert Brooks, with Hayden Rolence (replacing Alexander Gould), Ed O'Neill, Kaitlin Olson, Ty Burrell, Diane Keaton, and Eugene Levy joining the cast.", "The film focuses on the amnesiac fish Dory, who journeys to be reunited with her parents.", "The film premiered at the El Capitan Theatre in Los Angeles on June 8, 2016, and was released in the United States on June 17, 2016.", "Upon release, the film was well-received by critics and grossed over $1billion worldwide, becoming the second Pixar film to cross $1 billion after 2010's \"Toy Story 3\", the third highest-grossing film of 2016 and the 22nd-highest-grossing of all-time at the time of its theatrical run.", "The film set numerous box office records, including the biggest opening for an animated film in North America, and the highest-grossing animated film in North America." ], [ "Finding Dory", "Dory, a regal blue tang, gets separated from her parents as a child.", "As she grows up, Dory attempts to search for them, but gradually forgets them due to her short-term memory loss.", "In the flashback of the previous film, \"Finding Nemo\", she joins Marlin \u2013 a clownfish looking for his missing son Nemo \u2013 after accidentally swimming into him.", "One year later, Dory is living with Marlin and Nemo on their reef.", "One day, Dory has a flashback and remembers that she has parents.", "She decides to look for them, but her memory problem is an obstacle.", "She eventually remembers that they lived at the Jewel of Morro Bay across the ocean in California, thanks to Nemo mentioning its name.", "Marlin and Nemo accompany Dory.", "With the help of Crush, their sea turtle friend, they ride a water current to California.", "Upon arrival, they explore a shipwreck full of destroyed cargo, where Dory accidentally awakens a giant squid, who immediately pursues them and almost devours Nemo.", "Marlin berates Dory for endangering them.", "Her feelings hurt, Dory travels to the surface to seek help and is captured by staff members from the nearby Marine Life Institute after getting entangled in six pack rings.", "Dory is placed in the quarantine section and tagged." ], [ "Finding Dory", "In a post-credits scene, the tank gang from the first film, still trapped inside their (now algae-covered) plastic bags, reach California one year after floating across the Pacific Ocean.", "They are eventually picked up by staff members from the Marine Life Institute.", "Prior to work on \"Finding Dory\", Disney had planned to make a \"Finding Nemo\" sequel without Pixar's involvement, through Circle 7 Animation, a studio Disney announced in 2005 with the intention to make sequels to Pixar properties.", "However, due to the 2006 acquisition of Pixar by Disney, Circle 7 was shut down by Disney without ever having produced a film.", "Although it never went into production, a script for the Circle 7 version was uploaded to the official Raindance Film Festival website.", "It would involved Nemo's long lost twin brother named Remy, and Marlin getting captured so Nemo, Remy, and Dory have to save him.", "In July 2012, it was reported that Andrew Stanton was developing a sequel to \"Finding Nemo\", with Victoria Strouse writing the script and a release date scheduled for 2016.", "However, the same day the news of a potential sequel broke, Stanton posted a message on his personal Twitter calling into question the accuracy of these reports.", "The message said, \"Didn't you all learn from \"Chicken Little\"?", "Everyone calm down." ] ], "gold": "Finding Dory is a 2016 American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. Finding Dory takes place in the Pacific Ocean, near the California coast. Although Dory's memory problem is an obstacle, one day she remembers her parents and eventually realizes that they lived at the \"Jewel of Morro Bay, California.\"", "prediction 1": "Finding Dory is a 2016 American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. It focuses on the amnesiac fish Dory, who journeys to be reunited with her parents. The film takes place at the Jewel of Morro Bay across the ocean in California. In the original 2003 Finding Nemo film, Dory joins Marlin, a clownfish looking for his missing son Nemo, and is captured by staff members from the nearby Marine Life Institute.", "prediction 2": "Finding Dory is an American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. The film focuses on the amnesiac fish Dory, who journeys to be reunited with her parents. In the original 2003 film, Finding Nemo, Dory was in a shipwreck, where she had a flashback and remembered her parents. In the 2016 version, it takes place in a shipwreck in the Pacific Ocean. In the 2016 version, the sea turtles in the Jewel of Morro Bay.", "prediction 3": "Finding Dory is a 2016 American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. It focuses on the amnesiac fish Dory, who journeys to be reunited with her parents. Initially, the film takes place in a shipwreck in a shipwreck in the Pacific Ocean and is supposed to take place in the Jewel of Morro Bay in California. However, a post-credits scene shows the tank gang from the first film being picked up by staff members from the Marine Life Institute. This is later added to the film.", "prediction 4": "Finding Dory is a 2016 American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. The film focuses on the amnesiac fish Dory, who journeys to be reunited with her parents. In the film's flashback, Dory remembers that she has parents, but her short-term memory loss makes it difficult. One day, Dory has a flashback and remembers that she has parents. She eventually remembers that they lived at the Jewel of Morro Bay across the Pacific Ocean.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 478 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Finding Dory is a 2016 American computer-animated adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures. The film takes place at the Jewel of Morro Bay across the ocean in California. Although Dory's memory problem is an obstacle, one day she remembers her parents and eventually realizes that they lived at the \"Jewel of Morro Bay, California.\"" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "The members of american cabinet are appointed after the approval of?", "passages": [ [ "Cabinet of the United States", "The salary level was set by the Government Salary Reform Act of 1989, which also provides an automatic cost of living adjustment for federal employees.", "The Vice President does not automatically receive a pension based on that office, but instead receives the same pension as other members of Congress based on his \"ex officio\" position as President of the Senate.", "The individuals listed below were nominated by President Donald Trump to form his Cabinet and were confirmed by the United States Senate on the date noted, or are serving as acting department heads by his request pending the confirmation of his nominees.", "For a full list of people nominated for Cabinet positions, see Formation of Donald Trump's Cabinet.", "The Cabinet includes the Vice President and the heads of 15 executive departments, listed here according to their order of succession to the Presidency.", "These 15 positions are the core \"cabinet member\" seats, as distinct from other Cabinet-level seats for other various top level White House staffers and heads of other government agencies, none of whom are in the presidential line of succession and not all of whom are Officers of the United States.", "Note that the Speaker of the House and the President \"pro tempore\" of the Senate follow the Vice President and precede the Secretary of State in the order of succession, but both are in the legislative branch and are not part of the Cabinet.", "The following officials hold positions that are considered to be Cabinet-level positions." ], [ "Cabinet of the United States", "These may be existing high-level career employees, from political appointees of the outgoing administration, or sometimes lower-level appointees of the incoming administration.", "The heads of the executive departments and all other federal agency heads are nominated by the President and then presented to the Senate for confirmation or rejection by a simple majority (although before the use of the \"nuclear option\" during the 113th US Congress, they could have been blocked by filibuster, requiring cloture to be invoked by supermajority to further consideration).", "If approved, they receive their commission scroll, are sworn in and then begin their duties.", "An elected Vice President does not require Senate confirmation, nor does the White House Chief of Staff, which is an appointed staff position of the Executive Office of the President.", "The heads of the executive departments and most other senior federal officers at cabinet or sub-cabinet level receive their salary under a fixed five level pay plan known as the Executive Schedule, which is codified in Title 5 of the United States Code.", "21 positions, including the heads of the executive departments and others, receiving Level I pay are listed in , and those 46 positions on Level II pay (including the number two positions of the executive departments) are listed in .", ", the Level I annual pay was set at $205,700.", "The annual salary of the Vice President is $235,300." ] ], "gold": "The members of the American cabinet must be nominated by the President and subsequently confirmed by the Senate. Two cabinet members exempt from this process are the vice president, who is elected, and the White House Chief of Staff, who is appointed by the Executive Office of the President without requiring Senate confirmation.", "prediction 1": "The members of the United States Cabinet are appointed after the approval of the President. Traditionally, the cabinet is formed of the President and the heads of 15 executive departments, listed here according to their order of succession to the Presidency. The President's Cabinet is composed of 14 members, including the Vice President, the Secretary of State, the Treasury Secretary, and the Under Secretary of State.", "prediction 2": "The head of the executive departments and all other federal agency heads are nominated by the President and then presented to the Senate for confirmation or rejection by a simple majority. If approved, they receive their commission scroll, are sworn in and then begin their duties.", "prediction 3": "The members of the American Cabinet are appointed after the approval of the President of the United States. The Cabinet includes the Vice President and the heads of 15 executive departments, listed here according to their order of succession to the Presidency. The heads of the executive departments and all other federal agency heads are nominated by the President and then presented to the Senate for confirmation or rejection by a simple majority. If approved, they receive their commission scroll, are sworn in and then begin their duties.", "prediction 4": "The cabinet of the United States includes the Vice President and the heads of 15 executive departments, listed here according to their order of succession to the Presidency. The heads of the executive departments and all other federal agency heads are nominated by the President and then presented to the Senate for confirmation or rejection by a simple majority. If approved, they receive their commission scroll, are sworn in and then begin their duties.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 0, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 258 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 259, "end": 309 }, { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 421 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The members of the American cabinet must be nominated by the President and subsequently confirmed by the Senate. An elected Vice President does not require Senate confirmation, nor does the White House Chief of Staff, which is an appointed staff position of the Executive Office of the President." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Which country receives the most us foreign aid?", "passages": [ [ "United States foreign aid", "United States foreign aid\n\nUnited States foreign aid is aid given by the United States government to other governments.", "It does not include money from private charitable organizations based in the United States, or remittances sent between family members.", "There are two broad categories: military aid and economic assistance.", "The Congressional Research Service divides it into five categories: bilateral development aid, economic assistance, humanitarian aid, multilateral economic contributions, and military aid.", "Foreign aid recipients include developing countries, countries of strategic importance to the United States, and countries recovering from war.", "The government channels about half of its economic assistance through a specialized agency, the United States Agency for International Development (USAID).", "Government-sponsored foreign aid began a systematic fashion after World War II; there were numerous programs of which the largest were the Marshall Plan of 1948 and the Mutual Security Act of 1951-61.", "Military aid provided to foreign countries varies mostly on what natural resources the foreign country has to offer.", "Foreign aid is generally unpopular with the general public, with a 2017 poll finding 57% favor a cut and 6% who want increased aid.", "On the other hand, foreign aid has bipartisan support in Congress, and most Americans overestimate foreign aid as a share of the total federal budget.", "In the past, less than 1% of the national budget went to foreign assistance." ], [ "Foreign relations of the United States", "Foreign relations of the United States\n\nThe United States has formal diplomatic relations with most nations.", "This includes all U.N. member states except for Bhutan, Iran, North Korea, and Syria.", "Additionally, the U.S. has diplomatic relations with the European Union, the Holy See and Kosovo.", "The United States federal statutes relating to foreign relations can be found in Title 22 of the United States Code.", "American relations with Eastern Europe are influenced by the legacy of the Cold War.", "Since the collapse of the Soviet Union, former Communist-bloc states in Europe have gradually transitioned to democracy and capitalism.", "Many have also joined the European Union and NATO, strengthening economic ties with the broader Western world and gaining the military protection of the United States via the North Atlantic Treaty.", "The United States has many important allies in the Greater Middle East region.", "These allies are Turkey, Saudi Arabia, Morocco, Jordan, Afghanistan, Israel, Egypt, Kuwait, Bahrain and Qatar.", "Israel and Egypt are leading recipients of United States foreign aid, receiving $2.775 billion and 1.75 billion in 2010.", "Turkey is an ally of the United States through its membership in NATO, while all of the other countries except Saudi Arabia and Qatar are major non-NATO allies.", "The United States toppled the government of Saddam Hussein during the 2003 invasion of Iraq." ] ], "gold": "United States foreign aid, sometimes referred to as US foreign assistance, is aid the US supplies to other countries to support global peace, security, and development efforts, and provide humanitarian relief during crisis. The country with the most total foreign US aid is Afghanistan, who receives the most economic and military US foreign aid. Israel receives the most US foreign aid per capita.", "prediction 1": "The United States gives the most foreign aid, which is aid given by the United States government to other governments. In 2010, the United States gave the most foreign aid to Israel, and the second-most to Egypt.", "prediction 2": "United States foreign aid is aid given by the United States government to other governments. There are two broad categories: military aid and economic assistance. Israel and Egypt are leading recipients of United States foreign aid, receiving $2.775 billion and 1.75 billion respectively in 2010.", "prediction 3": "The United States gives foreign aid to other countries in two broad categories: military aid and economic assistance. Israel receives the most foreign aid, while Egypt receives the most, with $2.775 billion and 1.75 billion in 2010.", "prediction 4": "United States foreign aid is aid given by the United States government to other governments. There are two broad categories: military aid and economic assistance. Israel and Egypt are leading recipients of United States foreign aid, receiving $2.775 billion and 1.75 billion in 2010.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The United States gives the most foreign aid, which is aid given by the United States government to other governments. In 2010, the United States gave the most foreign aid to Israel, and the second-most to Egypt." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who has the most home runs in major league baseball?", "passages": [ [ "Home run", "Only eight other major league players have hit as many as 600: Hank Aaron (755), Babe Ruth (714), Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609).", "The single season record is 73, set by Barry Bonds in 2001.", "Other notable single season records were achieved by Babe Ruth who hit 60 in 1927, Roger Maris, with 61 home runs in 1961, and Mark McGwire, who hit 70 in 1998.", "Negro League slugger Josh Gibson's Baseball Hall of Fame plaque says he hit \"almost 800\" home runs in his career.", "The \"Guinness Book of World Records\" lists Gibson's lifetime home run total at 800.", "Ken Burns' award-winning series, \"Baseball\", states that his actual total may have been as high as 950.", "Gibson's true total is not known, in part due to inconsistent record keeping in the Negro Leagues.", "The 1993 edition of the MacMillan \"Baseball Encyclopedia\" attempted to compile a set of Negro League records, and subsequent work has expanded on that effort.", "Those records demonstrate that Gibson and Ruth were of comparable power." ], [ "Home run", "Babe Ruth's career total of 714 would have been one higher had that rule not been in effect in the early part of his career.", "Major League Baseball keeps running totals of all-time home runs by team, including teams no longer active (prior to 1900) as well as by individual players.", "Gary Sheffield hit the 250,000th home run in MLB history with a grand slam on September 8, 2008.", "Sheffield had hit MLB's 249,999th home run against Gio Gonz\u00e1lez in his previous at-bat.", "The all-time, verified professional baseball record for career home runs for one player, excluding the U. S. Negro Leagues during the era of segregation, is held by Sadaharu Oh.", "Oh spent his entire career playing for the Yomiuri Giants in Japan's Nippon Professional Baseball, later managing the Giants, the Fukuoka SoftBank Hawks and the 2006 World Baseball Classic Japanese team.", "Oh holds the all-time home run world record, having hit 868 home runs in his career.", "In Major League Baseball, the career record is 762, held by Barry Bonds, who broke Hank Aaron's record on August 7, 2007, when he hit his 756th home run at AT&T Park off pitcher Mike Bacsik." ], [ "Manny Ramirez", "Manny Ramirez\n\nManuel Ar\u00edstides Ram\u00edrez Onelcida (born May 30, 1972) is a Dominican-American former professional baseball outfielder.", "He played in Major League Baseball (MLB) for parts of 19 seasons.", "He played with the Cleveland Indians, Boston Red Sox, Los Angeles Dodgers, Chicago White Sox, and Tampa Bay Rays before playing one season in the Chinese Professional Baseball League.", "Ramirez is recognized for having had great batting skill and power.", "He was a nine-time Silver Slugger and was one of 25 players to hit 500 career home runs.", "His 21 grand slams are third all-time, and his 29 postseason home runs are the most in MLB history.", "He appeared in 12 All-Star Games, with a streak of eleven consecutive games beginning in 1998 that included every season that he played with the Red Sox.", "Ramirez was born in Santo Domingo, Dominican Republic.", "When he was 13 years old, he moved to New York City with his parents, Onelcida and Aristides.", "He attended George Washington High School and became a baseball standout.", "He was drafted by the Cleveland Indians in the first round of the 1991 MLB draft, 13th overall.", "He made his MLB debut on September 2, 1993.", "In 1994, Ramirez became a major league regular, and finished second in voting for the Rookie of the Year Award.", "By 1995, he had become an All-Star." ] ], "gold": "Barry Bonds holds the Major League Baseball career home run record of 762. He also set the current single season home run record of 73 in 2001. Manny Ramirez holds the postseason record of 29 home runs, and the Minnesota Twins hold the single season team record of 307 home runs.", "prediction 1": "Hank Aaron has the most home runs in major league history at 755. Babe Ruth has the most home runs in major league history at 714. The all-time, verified professional baseball record for career home runs for one player, excluding the U. S. Negro Leagues during the era of segregation, is held by Sadaharu Oh. Barry Bonds holds the record for most home runs in a career at 762.", "prediction 2": "Hank Aaron has the most home runs in major league history with 755. Babe Ruth has the most home runs in career with 714. The record for the most home runs in a single season is 73, set by Barry Bonds in 2001. Sadaharu Oh holds the all-time record for the most home runs for one player, excluding the U. S. Negro Leagues during the era of segregation, with 868. The home run world record for a player is 762, held by Barry Bonds, who broke Hank Aaron's record on August 7, 2007, when he hit 7582 home runs.", "prediction 3": "The player with the most home runs in a career in Major League Baseball is Babe Ruth, with 714. The player with the most career home runs in MLB history is Hank Aaron, with 755. The player with the most home runs in a season is Hank Aaron with 696.", "prediction 4": "The player with the most home runs in a career in Major League Baseball is Babe Ruth with 714. The record for the most home runs in a season is 73, which was set by Barry Bonds in 2001. The record for the most home runs in a season in a single season is 73, which was set by Ken Griffey Jr. in 2001. The record for most home runs in a single season is 73, which was set by Sammy Sosa in 1998. The record for the most home runs in a single season is 73, which is set by Barry Bonds in 2001. But, Josh Gibson has hit 828250,000 home runs in his career, which is estimated that he hit 815, which is he has hit 863 career runs, which is held by Sadaharu Oh, who has hit 868 home runs.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 0, "end": 10 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 66, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 308 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Barry Bonds holds the record for most home runs in a career at 762 in Major League Baseball. Manny Ramirez's 29 postseason home runs are the most in MLB history." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When is project blue book going to be on tv?", "passages": [ [ "Project Blue Book (TV series)", "Project Blue Book (TV series)\n\nProject Blue Book is an upcoming American science fiction drama television series, scheduled to premiere on History January 8, 2019.", "The main role of Josef Allen Hynek is played by Aidan Gillen, and the series will consist of ten episodes.", "The series is based on the real-life Project Blue Book.", "The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon, undertaken by astrophysicist, and eventual ufologist, Josef Allen Hynek in the 1950s and 1960s.", "The series was filmed in Vancouver, British Columbia, Canada.", "It was co-produced by the History Channel and A&E Studios." ] ], "gold": "Project Blue Book is an American historical drama television series that revolves around secret investigations by the U.S. Air Force into supposed UFO encounters and unexplained phenomena. Two seasons were aired. The first season aired January 8, 2019 - March 12, 2019. The second season was shown January 21, 2020 - March 24, 2020.", "prediction 1": "Project Blue Book is an upcoming American science fiction drama television series, scheduled to premiere on History Channel January 8, 2019. The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon, undertaken by astrophysicist, and eventual ufologist, Josef Allen Hynek in the 1950s and 1960s. It was co-produced by the History Channel and A&E Studios.", "prediction 2": "Project Blue Book is an upcoming American science fiction drama television series, scheduled to premiere on History January 8, 2019. The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon, undertaken by astrophysicist and eventual ufologist, Josef Allen Hynek in the 1950s and 1960s.", "prediction 3": "Project Blue Book is an upcoming American science fiction drama television series, scheduled to premiere on History January 8, 2019. The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon, undertaken by astrophysicist and eventual ufologist, Josef Allen Hynek in the 1950s and 1960s. The series was co-produced by the History Channel and A&E Studios.", "prediction 4": "Project Blue Book is an American science fiction drama television series, scheduled to premiere on History January 8, 2019. The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon, undertaken by astrophysicist, and eventual ufologist, Josef Allen Hynek in the 1950s and 1960s.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 416 } ], "missing-info": [], "corrected-prediction": "Project Blue Book is an upcoming American science fiction drama television series, scheduled to premiere on History Channel January 8, 2019. The series revolves around secret U.S. Air Force investigations into supposed UFO encounters and unexplained phenomenon." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is the biggest nfl football stadium in the us?", "passages": [ [ "StubHub Center", "StubHub Center\n\nStubHub Center, formerly the Home Depot Center, is a multiple-use sports complex located on the campus of California State University, Dominguez Hills in Carson, California.", "It is approximately south of downtown Los Angeles and its primary tenant is the LA Galaxy of Major League Soccer (MLS).", "It is also the temporary home of the Los Angeles Chargers of the National Football League (NFL).", "Opened in 2003, the $150 million complex was developed and is operated by the Anschutz Entertainment Group.", "With a seating capacity of 27,000, it is the largest soccer-specific stadium in the U.S. and the second-largest among its kind in MLS, after Canadian Toronto FC's BMO Field.", "In addition to hosting LA Galaxy games since its opening, the stadium also served as the home of the now-defunct Chivas USA MLS team from 2005 to 2014.", "The StubHub Center became the temporary home of the Los Angeles Chargers beginning in 2017 \u2013 making it the smallest NFL stadium \u2013 until the completion of the Los Angeles Stadium at Hollywood Park in 2020, which they will then share with the Los Angeles Rams.", "During the 2018 Los Angeles Chargers season, while the Chargers play in the stadium, the facility is named ROKiT Field at StubHub Center.", "During its first decade, the stadium's sponsor was hardware retailer The Home Depot." ], [ "AT&T Stadium", "AT&T Stadium\n\nAT&T Stadium, formerly Cowboys Stadium, is a retractable roof stadium in Arlington, Texas, United States.", "It serves as the home of the Dallas Cowboys of the National Football League (NFL) and was completed on May 27, 2009.", "It is also the home of the Cotton Bowl Classic and the Big 12 Championship Game.", "The facility, owned by the city of Arlington, can also be used for a variety of other activities such as concerts, basketball games, college and high school football contests, soccer matches, rodeos and motocross and Spartan races.", "It replaced the partially covered Texas Stadium, which served as the Cowboys' home from 1971 through the 2008 season.", "The stadium is sometimes referred to as \"Jerry World\" after Dallas Cowboys owner Jerry Jones, who originally envisioned it as a large entertainment mecca.", "The stadium seats 80,000, making it the fourth largest stadium in the NFL by seating capacity.", "The maximum capacity of the stadium with standing room is 105,000.", "The record attendance for an NFL game was set in 2009 with a crowd of 105,121.", "The Party Pass (open areas) sections are behind seats in each end zone and on a series of six elevated platforms connected by stairways.", "It also has the world's 29th largest high definition video screen, which hangs from 20-yard line to 20-yard line." ], [ "MetLife Stadium", "MetLife Stadium\n\nMetLife Stadium is a multi-purpose stadium located in East Rutherford, New Jersey, outside of New York City.", "It is part of the Meadowlands Sports Complex and serves as the home stadium for two National Football League (NFL) franchises: the New York Giants and the New York Jets.", "The stadium is owned by the MetLife Stadium Company, a joint venture of the Giants and Jets, who jointly built the stadium using private funds on land owned by the New Jersey Sports and Exposition Authority.", "The stadium opened as New Meadowlands Stadium in 2010.", "In 2011, MetLife, an insurance company based in New York City, acquired the naming rights to the stadium.", "At a construction cost of approximately $1.6 billion, it was the most expensive stadium ever built, at the time it opened.", "MetLife Stadium is the only NFL stadium shared by two clubs since the 2000s.", "Los Angeles' Staples Center, which is home to the Clippers and the Lakers of the National Basketball Association (NBA), is the only other facility to currently house two teams from the same sports league in the United States.", "As Giants Stadium approached 30 years of age, it was becoming one of the older stadiums in the NFL." ] ], "gold": "AT&T Stadium, home of the Dallas Cowboys, has the highest capacity of any NFL stadium with a peak capacity of over 100,000 spectators. MetLife Stadium, home of the New York Giants and New York Jets, has the highest listed seating capacity at 82,500 in the NFL.", "prediction 1": "The biggest NFL stadium in the US by capacity is the StubHub Center in Carson, California, which is the primary tenant of the LA Galaxy of Major League Soccer. The second largest NFL stadium by capacity is the AT&T Stadium in Arlington, Texas, which is the home stadium of the Dallas Cowboys. The third largest NFL stadium by capacity is the MetLife Stadium in East Rutherford, New Jersey, which is the home stadium of the New York Giants and the New York Jets.\n", "prediction 2": "Different stadiums in the US each rank in importance. The three largest by capacity are StubHub Center in California for Major League Soccer and the MetLife Stadium in New Jersey for the NFL. The largest by capacity in the NFL by style is BMO Field in Toronto, Canada, while the biggest by size is AT&T Stadium in Arlington, Texas for the Dallas Cowboys.", "prediction 3": "The largest football stadium in the US by capacity is the StubHub Center, which is a multi-use complex located on the campus of California State University, Dominguez Hills in Carson, California. The largest NFL stadium by venue size is the Verizon Center in Arlington, Texas, which was built on May 11, 2009, and the MetLife Stadium in East Rutherford, New Jersey, which was opened on December 1, 2010. Outside of the US, the largest MLS stadium by capacity is the Verizon Center in Arlington, Texas, which was completed on May 27, 2009, and is the largest MLS, having a capacity of 27,000 seats 1,350,000, making it the largest in MLS, after Canadian Toronto FC's BMO Field.", "prediction 4": "On December 4, 2021, the NFL announced that the team that will play at the largest national football stadium in the United States, the AT&T Stadium, would move to the Los Angeles Chargers' temporary home at StubHub Center. On November 4, 2021, the New York Giants' temporary home at MetLife Stadium would become the Los Angeles Rams' temporary home at the MetLife Stadium.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 0, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 159 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 164, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 389 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 293, "end": 334 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The fourth largest NFL stadium by seating capacity is the AT&T Stadium in Arlington, Texas, which is the home stadium of the Dallas Cowboys. Its peak capacity with standing room is 105,000. The most expensive stadium ever built is the MetLife Stadium, which is the home stadium of the New York Giants and the New York Jets.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did now you see me 2 come out?", "passages": [ [ "Now You See Me 2", "In November 2014, the film was officially titled \"Now You See Me 2\", and was set to be released on June 10, 2016.", "In March 2016, the film's international release date was announced as July 4, 2016.", "\"Now You See Me 2\" was released on Digital HD on August 19, with a subsequent Blu-ray Combo Pack and DVD released on September 6.", "\"Now You See Me 2\" grossed $65.1 million in the United States and Canada and $269.8 million in other territories for a worldwide total of $334.9 million, against a budget of $90 million.", "In the United States and Canada, \"Now You See Me 2\" opened on June 10, 2016, alongside \"Warcraft\" and \"The Conjuring 2\", and was projected to gross $23\u201326 million from 3,232 theaters in its opening weekend.", "The film grossed $1.8 million from its Thursday night previews, besting the $1.5 million made by its predecessor, and $8.4 million on its first day.", "It went on to gross $22.3 million in its opening weekend, finishing third at the box office behind \"The Conjuring 2\" ($40.4 million) and \"Warcraft\" ($24.1 million)." ], [ "Now You See Me 2", "Now You See Me 2\n\n", "Now You See Me 2 is a 2016 American magic caper thriller film directed by Jon M. Chu and written by Ed Solomon.", "The film stars an ensemble cast that includes Jesse Eisenberg, Woody Harrelson, Mark Ruffalo, Dave Franco, Daniel Radcliffe, Lizzy Caplan, Jay Chou, Sanaa Lathan, Michael Caine and Morgan Freeman.", "A sequel to the 2013 film \"Now You See Me\" and the second installment of the film series, the plot follows the Four Horsemen who resurface and are forcibly recruited by a tech genius to pull off an almost impossible heist.", "On July 3, 2013, a sequel to \"Now You See Me\" was officially announced to be in development.", "Filming began in November 2014 and lasted until May 2015.", "The film was released on June 10, 2016 by Summit Entertainment, received mixed reviews from critics and grossed $334 million worldwide.", "Eighteen months after outwitting the FBI, the remaining members of the Four Horsemen\u2014J. Daniel Atlas (Jesse Eisenberg), Merritt McKinney (Woody Harrelson) and Jack Wilder (Dave Franco)\u2014are in hiding in New York City, awaiting further instructions from The Eye, the secret society of magicians they've been recruited into.", "Atlas, having grown tired of waiting for a mission, seeks out The Eye himself." ] ], "gold": "The American heist thriller film Now You See Me 2 was released domestically on June 10, 2016 and internationally on July 4, 2016. In New York City, however, the film began screening four days early on June 6, 2016.", "prediction 1": "Now You See Me 2 is a 2016 American magic caper thriller film directed by Jon M. Chu and written by Ed Solomon. The film followed the Four Horsemen, a group of magicians who are forcibly recruited by a tech genius to pull off an almost impossible heist. The film was released on June 10, 2016 by Summit Entertainment.", "prediction 2": "Now You See Me 2 is a 2016 American magic caper thriller film directed by Jon M. Chu and written by Ed Solomon. The film, a sequel to the 2013 film Now You See Me, was officially titled Now You See Me 2 in November 2014. The film was released on June 10, 2016 by Summit Entertainment. The film received mixed reviews from critics and grossed $334 million worldwide.", "prediction 3": "Now You See Me 2 is a 2016 American magic caper thriller film directed by Jon M. Chu and written by Ed Solomon. The film follows the Four Horsemen, who resurface and are forcibly recruited by a tech genius to pull off an almost impossible heist. The film's international release date was announced in March 2016 as July 4, 2016. Now You See Me 2 was released on Digital HD on August 19, with a subsequent Blu-ray Combo Pack and DVD released on September 6.", "prediction 4": "Now You See Me 2 is a 2016 American magic caper thriller film directed by Jon M. Chu and written by Ed Solomon. The film follows the Four Horsemen who resurface and are forcibly recruited by a tech genius to pull off an almost impossible heist. On June 10, 2016, the sequel to the 2013 film Now You See Me and the second installment of the film series, the plot follows the Four Horsemen who resurface and are forcibly recruited by a tech genius to pull off an almost impossible heist.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 317 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Now You See Me 2 is a 2016 American magic caper thriller film. The film was released in the US and Canada on June 10, 2016 and internationally on July 4, 2016. Further, it was released on Digital HD on August 19, with a subsequent Blu-ray Combo Pack and DVD released on September 6." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who plays cindy in the grinch who stole christmas?", "passages": [ [ "How the Grinch Stole Christmas (2000 film)", "How the Grinch Stole Christmas (2000 film)\n\n", "How the Grinch Stole Christmas (also known as Dr. Seuss' How the Grinch Stole Christmas and simply The Grinch in the UK) is a 2000 American Christmas fantasy comedy film directed by Ron Howard and written by Jeffrey Price and Peter S. Seaman.", "Based on Dr. Seuss's 1957 book of the same name, the film was the first Dr. Seuss book to be adapted into a full-length feature film.", "The film stars Jim Carrey in the title role, Jeffrey Tambor, Christine Baranski, Bill Irwin, Molly Shannon and Taylor Momsen.", "Because the film is based on a children's picture book, many additions were made to the storyline to bring it up to feature-length including some information about the backstory of the title character and reworking the story's minor character Cindy Lou", "Who as a main character.", "Most of the rhymes that were used in the book were also used in the film, though some of the lines were to some degree changed and several new rhymes were put in.", "The film also borrowed some music and character elements (such as the Grinch's green skin tone) that originated in the 1966 animated television special." ], [ "How the Grinch Stole Christmas! (TV special)", "The Grinch makes himself a Santa coat and hat and disguises the innocent Max as a reindeer.", "He loads empty bags onto a sleigh and travels to Whoville with some difficulty.", "In the first house he is almost caught by Cindy Lou Who (voiced by an uncredited June Foray), a small Who girl who wakes up and sees him taking the Christmas tree.", "Pretending to be Santa, the Grinch tells Cindy Lou that he is merely taking the tree to his workshop for repairs, and then gets her a drink before sending her back to bed.", "He empties the first house of all the food and Christmas-related items, namely presents, the tree, decorations and even the stockings on the chimney, then repeats the process at the other houses in Whoville, while also taking the village decorations.", "With the Whos' stolen Christmas goods, the Grinch and Max travel back up Mt. Crumpit.", "Before dropping the loaded sleigh off the mountain, the Grinch waits to hear a sad cry from the Whos. However, down in the village, the Whos joyously begin to sing Christmas carols, proving that the spirit of Christmas does not depend on material things." ], [ "Dr. Seuss' How the Grinch Stole Christmas! The Musical", "Dr. Seuss' How the Grinch Stole Christmas!", "The Musical\n\nDr. Seuss' How the Grinch Stole Christmas!", "The Musical, or simply How the Grinch Stole Christmas!", "The Musical, is a seasonal musical adaptation of the Dr. Seuss book \"How the Grinch Stole Christmas!\".", "The musical, with book and lyrics by Timothy Mason, original score by Mel Marvin and choreography by John DeLuca, made its debut on the mainstage of Minneapolis's Children's Theatre Company in November 1994, after special arrangements had been made with the Dr. Seuss estate to exclusively adapt and perform the book.", "The original production was remounted in again in 1995 and 1998 playing to sold-out houses every time.", "The musical was performed at the Old Globe Theatre, San Diego, where it has run every Christmas season since 1998.", "The Old Globe production was directed by Jack O'Brien.", "This version featured songs from the television special, which had music by Albert Hague and lyrics by Seuss.", "A then-unknown Vanessa Anne Hudgens played Cindy Lou", "Who (1998\u20131999).", "For the 2007 Christmas season, three new songs were added to both this and the subsequent Broadway production." ] ], "gold": "The character Cindy from The Grinch Who Stole Christmas has been played by several actors. June Foray plays the role in the 1966 tv special. Nicole Bocchi + Caroline London played Cindy in the 2006 Broadway show production, while in the 2007 Broadway show it was Caroline London + Athena Ripka playing the part. In 1998-1999 at the Old Globe Theatre in San Diego, Vanessa Anne Hudgens was Cindy. In the 2000 film How The Grinch Stole Christmas, Taylor Momsen played the part of Cindy. And for the 2018 animated film, Cameron Seely played Cindy Lou Who.", "prediction 1": "In the 2000 American Christmas fantasy comedy film How the Grinch Stole Christmas, Cindy Lou Who is voiced by June Foray. In the original 1998 production of How the Grinch Stole Christmas, Vanessa Anne Hudgens played Cindy Lou. In the 2007 remake of the 1999 film, Vanessa Anne Hudgens played Cindy Lou.", "prediction 2": "How the Grinch Stole Christmas is a 2000 American Christmas fantasy comedy film directed by Ron Howard and written by Jeffrey Price and Peter S. Seaman. Based on Dr. Seuss's 1957 book of the same name, the film was the first Dr. Seuss book to be adapted into a full-length feature film. In the original stage production of the musical, Cindy Lou is played by an uncredited June Foray. In the original Broadway production, a then-unknown Vanessa Anne Hudgens played Cindy Lou.", "prediction 3": "How the Grinch Stole Christmas is a 2000 American fantasy comedy film directed by Ron Howard and written by Jeffrey Price and Peter S. Seaman. Based on Dr. Seuss's 1957 book of the same name, the film was the first Dr. Seuss book to be adapted into a full-length feature film. A then-unknown Vanessa Anne Hudgens played Cindy Lou Who from 1998\u20131999.", "prediction 4": "In the 2000 American Christmas fantasy comedy film How the Grinch Stole Christmas, the character Cindy Lou Who is voiced by June Foray. In the 2002 stage musical adaptation of the Dr. Seuss book How the Grinch Stole Christmas!, the character Cindy Lou is played by Vanessa Anne Hudgens.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 12, "end": 45 }, { "error type": "Unverifiable", "explanation": "", "start": 97, "end": 121 }, { "error type": "Unverifiable", "explanation": "", "start": 265, "end": 303 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "There is a 2000 film of How the Grinch Stole Christmas. In the original 1998 musical production of How the Grinch Stole Christmas, Vanessa Anne Hudgens played Cindy Lou. In the TV special, Cindy Lou was voiced by an uncredited June Foray." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is left in the big brother house 20?", "passages": [ [ "Big Brother 20 (U.S.)", "Big Brother 20 (U.S.)\n\nBig Brother 20 is the twentieth season of the American reality television series \"Big Brother\".", "It is based upon the Dutch series of the same name.", "It was renewed in August 2016 as part of a double renewal for seasons nineteen and twenty.", "Julie Chen, credited as Julie Chen Moonves from episode 35 onwards, returned as host.", "Sixteen new competitors, known as House Guests, were announced to be competing and their identities were released in June 2018.", "Each week in the game, House Guests compete in a series of competitions and then vote to eliminate, or \"evict\", one of their own until there are only two remaining.", "In the finale episode previous House Guests vote on who they think they should win the game with the House Guest who receives the most votes being declared the winner.", "The season premiered on June 27, 2018 on CBS in the United States and concluded on September 26, 2018 consisting of forty episodes and lasting for 99 days, tying the eighteenth season to be the longest U.S. season to date.", "The season also received many controversies and criticisms throughout the season but received mostly positive viewing figures.", "Despite an uncertain future for the show, CBS began accepting applications for a future season in September 2018." ], [ "Celebrity Big Brother 1 (U.S.)", "Celebrity Big Brother 1 (U.S.)\n\nCelebrity Big Brother, also known as Big Brother: Celebrity Edition, is a spin-off series of the American version of the Dutch reality television franchise \"Big Brother\".", "This season aired during the winter of the 2017\u201318 network television season on CBS and was the second U.S. \"Big Brother\" season to air outside the usual summer television season, the first being \"Big Brother 9\" in 2008.", "Julie Chen returned as host, with Allison Grodner and Rich Meehan returning as executive producers.", "The series is produced by Fly on the Wall Entertainment in association with Endemol Shine North America.", "The first season premiered on February 7, 2018.", "The promotional logo was released on December 20, 2017.", "The logo is similar to that used for \"Big Brother 19\", with the word \"celebrity\" added.", "The first teaser was also released the same day.", "In January 2018 official photos of the house and backyard were released through a press release and an Instagram livestream with Julie Chen.", "On January 28, 2018, the official cast was announced during The 60th Annual Grammy Awards.", "The first season officially concluded on February 25, 2018 when Marissa Jaret Winokur beat Ross Mathews by a final jury vote of 6 to 3.", "Ross was also later named \"America's Favorite HouseGuest\"." ], [ "Celebrity Big Brother 20 (UK)", "Celebrity Big Brother 20 (UK)\n\nCelebrity Big Brother 20 was the twentieth series of the British reality television series \"Celebrity Big Brother\", hosted by Emma Willis and narrated by Marcus Bentley.", "The series launched on 1 August 2017, and concluded on 25 August 2017 after 25 days, making this the shortest series since \"Celebrity Big Brother 12\" in 2013.", "The series will air on Channel 5 in the United Kingdom and 3e in Ireland.", "Rylan Clark-Neal will continue to present the spin-off show \"Celebrity Big Brother's Bit on the Side\".", "It is the thirteenth celebrity series and twentieth series of \"Big Brother\" overall to air on Channel 5.", "During the launch show on 1 August 2017, Emma confirmed that the winner would receive \u00a350,000 for a charity of their choice.", "This is the first celebrity series to include a prize fund since \"Celebrity Big Brother 3\" in 2005.", "On 25 August 2017, Sarah Harding was announced as the winner of the series having received 35.33% of the final vote, with Amelia Lily as the runner-up after receiving 29.92%.", "The eye was released on 19 July 2017 and features a metallic golden eye.", "On 24 July 2017, a three-second teaser was released promoting the series.", "It includes a swimming pool with a \"#CBB\" inflatable in the water." ] ], "gold": "There are several Big Brothers, including the American series Big Brother and the British series Celebrity Big Brother. Kaycee Clark and Tyler Crispen were left in the American Big Brother house at the end of Season 20. Sarah Harding, Amelia Lily, Sam Thompson, Derek Acorah, Chad Johnson, and Jemma Lucy were left in the British Big Brother house at the end of Season 20.", "prediction 1": "Big Brother 20 is the twentieth season of the American reality television series Big Brother, based upon the Dutch series of the same name. Sixteen new competitors, known as House Guests, were announced to be competing and their identities were released in June 2018. Each week in the game, House Guests compete in a series of competitions and then vote to eliminate, or \"evict\", one of their own until there are only two remaining.", "prediction 2": "Big Brother 20 is the twentieth season of the American reality television series Big Brother. Sixteen new competitors, known as House Guests, were announced to be competing and their identities were released in June 2018. In the finale episode of the season, each House Guests compete in a series of competitions and then vote to eliminate, or \"evict\", one of their own until there are only two remaining.", "prediction 3": "Big Brother 20 is the twentieth season of the American reality television series Big Brother. Sixteen new competitors, known as House Guests, were announced to be competing and their identities were released in June 2018. Celebrity Big Brother 20 is the twentieth series of the British reality television series Celebrity Big Brother and was hosted by Emma Willis and narrated by Marcus Bentley.", "prediction 4": "Big Brother 20 is the twentieth season of the American reality television series Big Brother, based on the Dutch series of the same name. Sixteen new competitors, known as House Guests, were announced to be competing and their identities were released in June 2018. Each week in the game, House Guests compete in a series of competitions and then vote to eliminate, or evict, one of their own until there are only two remaining.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 432 }, { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 139 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several Big Brothers, the American series, the US Celebrity Big Brother spin off and the UK series." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played the little girl in jersey girl?", "passages": [ [ "Jersey Girl (2004 film)", "Jersey Girl (2004 film)\n\nJersey Girl is a 2004 American comedy-drama film written, co-edited and directed by Kevin Smith.", "It stars Ben Affleck, Liv Tyler, George Carlin, Stephen Root, Mike Starr and Raquel Castro.", "The film follows a young man who must take care of his precocious daughter in the midst of a family tragedy.", "It was the first film written and directed by Smith not to be set in the View Askewniverse as well as the first not to feature appearances by Jay and Silent Bob, although animated versions of them appear in the View Askew logo.", "At $35 million, it is Smith's biggest-budgeted film, and went on to become a box office bomb, grossing just $36 million.", "Ollie Trink\u00e9 (Ben Affleck) is a powerful media publicist in New York City whose wife, Gertie (Jennifer Lopez), sadly dies during childbirth with an aneurysm.", "To avoid his grief, he buries himself in his work and ignores his new daughter, Gertie, while his father, Bart (George Carlin)--(who also lost his own wife many years prior), takes a month off from work to take care of her, but returns a while later so that his son Ollie is forced to live up to his responsibility as a single parent." ] ], "gold": "Jami Beth Gertz played the little girl in jersey girl in 1992, and, in 2004 it was Raquel Castro.", "prediction 1": "Jersey Girl is a 2004 American comedy-drama film written, co-edited and directed by Kevin Smith. The film follows a young man who must take care of his precocious daughter in the midst of a family tragedy. It stars Ben Affleck, Liv Tyler, George Carlin, Stephen Root, Mike Starr and Raquel Castro.", "prediction 2": "Jersey Girl is a 2004 American comedy-drama film directed by Kevin Smith. It follows a young man who must take care of his precocious daughter in the midst of a family tragedy. Liv Tyler plays the little girl in the film. Jennifer Lopez plays the little girl in the film.", "prediction 3": "Jersey Girl is a 2004 American comedy-drama film written, co-edited and directed by Kevin Smith. It stars Ben Affleck, Liv Tyler, George Carlin, Stephen Root, Mike Starr and Raquel Castro.", "prediction 4": "Jersey Girl is a 2004 American comedy-drama film written, co-edited and directed by Kevin Smith. It stars Ben Affleck, Liv Tyler, George Carlin, Stephen Root, Mike Starr and Raquel Castro. The film follows a young man who must take care of his precocious daughter in the midst of a family tragedy. Jennifer Lopez played the little girl in the movie and Liv Tyler played the little girl in the TV series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 297 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What is the newest madden game for ps4?", "passages": [ [ "Madden NFL", "EA decided not to have players vote for the cover athlete through a traditional bracket, but rather through collectible cards in \"Madden NFL Mobile\", or through Ultimate Team on the console devices.", "On May 4, 2015, the four finalists were announced for the 2016 game cover: New England Patriots tight end Rob Gronkowski, Arizona Cardinals cornerback Patrick Peterson, New York Giants wide receiver Odell Beckham Jr. and Pittsburgh Steelers wide receiver Antonio Brown.", "On May 13, Beckham Jr. beat out Gronkowski in a fan vote for the cover of \"Madden 16\".", "It was released on August 25, 2015.", "\"Madden NFL 17\" was released on August 23, 2016.", "The features in the game include an upgrade of the Ground Game, a redesigned and better Franchise Mode, \"Madden 365\", new Ball Carrier UI Prompts, the new Path Assist and more.", "New England Patriots tight end Rob Gronkowski serves as the cover athlete.", "\"Madden NFL 18\" was released on August 25, 2017.", "The game is the first in the series to be developed in the Frostbite Engine, and incorporates a story mode titled Longshot Mode, akin to \"The Journey\" in FIFA 17.", "It was announced that Tom Brady would be on the cover, marking the second consecutive year where a Patriot will be on the cover." ], [ "Madden NFL 09", "Madden NFL 09\n\nMadden NFL 09 is an American football video game based on the NFL that was published by EA Sports and developed by EA Tiburon.", "It is the 20th annual installment in the \"Madden NFL\" video game franchise.", "The game was released for the Nintendo DS, PlayStation 2, PlayStation 3, PlayStation Portable, Wii, Xbox, Xbox 360, and mobile phone.", "It was also the last video game for the Xbox produced and released in North America and the last \"Madden\" game released for the Nintendo DS.", "A GameCube version was cancelled due to the system's discontinuation in 2007.", "Unlike previous versions, the game was not released for the PC.", "EA Sports has said that they are \"retooling the PC version\" after not making 09.", "Despite these claims of 'retooling', PC users were again ignored the following year as no Windows version of \"Madden NFL 10\" were released.", "In June 2009, EA Sports announced that for the year 2010, the \"Madden NFL\", \"NCAA Football\", \"NASCAR\", \"NHL\", \"NBA Live\", and \"Tiger Woods PGA Tour\" series would not be shipped for Microsoft Windows." ], [ "Madden NFL 08", "Madden NFL 08\n\nMadden NFL 08 is an American football video game based on the NFL that was published by EA Sports and developed by EA Tiburon.", "It is the 19th installment in the \"Madden NFL\" video game franchise, and the sequel to Dick Vitale's \"Awesome Baby\" College Hoops.", "It features the former Tennessee Titans quarterback Vince Young on the cover; San Diego Chargers defensive end Luis Castillo was the cover athlete for the Spanish-language version.", "This was the first Madden game made for 11 different platforms, it was released on August 14, 2007 for Xbox 360, Wii, PlayStation 3, PlayStation 2, Nintendo DS, PlayStation Portable, Xbox, GameCube and Microsoft Windows.", "This would be the last version of Madden to be released for Microsoft Windows until \"Madden NFL 19\", and Madden NFL 08 would also eventually become the last video game for the Nintendo GameCube produced and released in North America.", "EA and Apple Inc. had announced in June 2007 that a version for Mac OS X would be released at the same time as the other versions.", "After the August 14 release date came and went without a Mac release, however, EA said it would be delayed until September or October 2007.", "A Spanish-language version of the game was released on December 11, 2007 for the PlayStation 2 and Xbox 360 platforms, featuring ESPN announcer \u00c1lvaro Mart\u00edn." ] ], "gold": "The Madden NFL series video games Madden NFL 22, Madden NFL 21, Madden NFL 20, and Madden NFL 19 were released for the PS4 in 2021, 2020, 2019, and 2018, respectively. The newest Madden game for the PS4 that came out in 2017 was Madden NFL 18, that came out in 2016 was Madden NFL 17, and that came out in 2015 was Madden NFL 16.", "prediction 1": "Madden NFL 19 is the latest video game in the Madden NFL series for the PlayStation 4 and Xbox One. While it was released on March 14, 2019, the most recent version was released on April 9, 2020, and the newest version was released on January 10, 2021. Madden NFL 20 is the newest video game in the Madden NFL series for the PlayStation 4. The newest version of the game was released on July 29, 2016 for the PlayStation 4, and the newest version of the game was released on February 9, 2021.", "prediction 2": "Madden NFL 18 is the newest video game in the Madden series for the PlayStation 4. It features the cover athlete for the Spanish-language version of the game, San Diego Chargers defensive end Luis Castillo. Madden NFL 19 is the newest video game in the Madden series for the PlayStation 4.", "prediction 3": "Madden NFL 18 is the newest game in the Madden NFL series, and the first in the series to be developed in the Frostbite Engine. The game was released on August 25, 2017 and features a story mode titled Longshot Mode, akin to \"The Journey\" in FIFA 17. The game features the New England Patriots tight end Rob Gronkowski as the cover athlete. Madden NFL 09 is the first game in the Madden NFL series made for 11 different platforms, and it was released on August 14, 2007 for PlayStation 2, PlayStation 3, PlayStation 4, PlayStation 4, PlayStation 4, PlayStation 4, PlayStation 4, PlayStation 4, PlayStation 4, Xbox One, PlayStation 4, PlayStation 4, and PlayStation Vita.", "prediction 4": "Madden NFL 17 is the newest game in the Madden NFL series for PlayStation 4 and Xbox One. On August 23, 2016, Odell Beckham Jr. beat out Rob Gronkowski in a fan vote for the cover of Madden NFL 17. Madden NFL 18 is the newest game in the Madden NFL series for PlayStation 4.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 64, "end": 99 }, { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 140 }, { "error type": "Unverifiable", "explanation": "", "start": 145, "end": 195 }, { "error type": "Redundant", "explanation": "While it was released on March 14, 2019, the most recent version was released on April 9, 2020, and ", "start": 200, "end": 252 }, { "error type": "Unverifiable", "explanation": "", "start": 253, "end": 291 }, { "error type": "Redundant", "explanation": "While it was released on March 14, 2019, the most recent version was released on April 9, 2020, and the newest version was released on January 10, 2021. ", "start": 432, "end": 492 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5, 8 ] } ], "corrected-prediction": "Madden NFL 19 is the latest video game in the Madden NFL series for Microsoft windows. \"Madden NFL 17\" was released on August 23, 2016. \"Madden NFL 18\" was released on August 25, 2017." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "When does easter fall on april fools day again?", "passages": [ [ "Friday the 13th", "On average, there is a Friday the 13th once every 212.35 days, whereas Thursday the 13th occurs only once every 213.59 days.", "In the 2010s there were three Friday the 13ths in 2012 and 2015, and two in 2013, 2017 and 2018.", "There will also be two in 2019 and 2020.", "In the 2020s, there will be three F13's in 2026, and two in 2020, 2023, 2024, and 2029.", "The rest of years have at least one F13 if there are fewer than two or three in the 2010s and 2020s.", "Assuming nothing is changed with the calendar there are never more than three F13s in a year.", "There is a 28-year cycle that repeats when there is a F13 in February, March and November, and the current start of that pattern was in 2009.", "Although there is at least one F13 per calendar year, it can be as long as 14 months between two F13s.", "For the details see the table below.", "In Finland one F13 is chosen as National Accident Day to raise awareness about automotive safety, this is possible because there is at least one F13 each year.", "The table is for the Gregorian calendar and Jan/Feb for leap years." ], [ "Leap year starting on Saturday", "Leap year starting on Saturday\n\nA leap year starting on Saturday is any year with 366 days (i.e. it includes 29 February) that begins on Saturday, 1 January, and ends on Sunday, 31 December.", "Its dominical letters hence are BA.", "The most recent year of such kind was 2000 and the next one will be 2028 or, likewise, 2012 and 2040 in the obsolete Julian calendar.", "In the Gregorian calendar all centennial leap years start on Saturday; the next such year will be 2400, see below for more.", "Any leap year that starts on Tuesday, Friday or Saturday has only one Friday the 13th; The only Friday the 13th in this leap year occurs in October.", "Common years starting on Sunday share this characteristic, but also have another in January.", "From August of the year that precedes this year until October in this type of year is also the longest period (14 months) that occurs without a Friday the 13th.", "Common years starting on Tuesday share this characteristic, from July of the year that precedes it to September in that type of year.", "There are two other ways this 14 month interval can be formed, one involving a common year followed by a leap year and the other a leap year followed by a common year." ], [ "Leap year", "The name \"leap year\" probably comes from the fact that while a fixed date in the Gregorian calendar normally advances one day of the week from one year to the next, the day of the week in the 12 months following the leap day (from March 1 through February 28 of the following year) will advance two days due to the extra day (thus \"leaping over\" one of the days in the week).", "For example, Christmas Day (December 25) fell on a Sunday in 2016, and Monday in 2017, then it will fall on Tuesday in 2018, and Wednesday in 2019 but then \"leaps\" over Thursday to fall on a Friday in 2020.", "The length of a day is also occasionally changed by the insertion of leap seconds into Coordinated Universal Time (UTC), owing to the variability of Earth's rotational period.", "Unlike leap days, leap seconds are not introduced on a regular schedule, since the variability in the length of the day is not entirely predictable.", "In the Gregorian calendar, the standard calendar in most of the world, most years that are multiples of 4 are leap years.", "In each leap year, the month of February has 29 days instead of 28.", "Adding one extra day in the calendar every four years compensates for the fact that a period of 365 days is shorter than a tropical year by almost 6 hours." ] ], "gold": "Easter will fall on April Fool's Day in the years 2018, 2029, and 2040.", "prediction 1": "In the Gregorian calendar, any year that starts on Tuesday, Friday or Saturday has only one Friday the 13th. The only Friday the 13th in this type of year is in October. In the Gregorian calendar, Easter falls on April Fool's day again in 2018. There is also a leap year that starts on Saturday in which the month of February has 29 days instead of 28. In the Gregorian calendar, any year that starts on Monday, Tuesday, or Friday has only one Friday the 13th. In the future, Easter will fall on a Friday in 2028 or in 2028 in 2028.", "prediction 2": "The date of Easter in the Gregorian calendar falls on April Fools' Day in 2019. However, since the Gregorian calendar has leap years, Easter falls on April Fools' Day in 2020.", "prediction 3": "In the Gregorian calendar, Easter falls on April Fool's Day once every 212.35 days, whereas in the leap year it falls on February 28 of the following year. The leap year can be as long as 14 months between two F13s.", "prediction 4": "On average, there is a Friday the 13th once every 212.35 days, whereas Thursday the 13th occurs only once every 213.59 days. In the 2010s there were three Friday the 13ths in 2012 and 2015, and two in 2013, 2017 and 2018. There will also be two in 2019 and 2020. In addition, there is a 28-year cycle that repeats when there is a F13 in February, March and November, and the current start of that pattern was in 2009. The table below shows the 14 month interval that occurs without a Friday the 13th.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 27, "end": 35 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 169 }, { "error type": "Unverifiable", "explanation": "", "start": 197, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 352 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 404, "end": 411 }, { "error type": "Redundant", "explanation": "In the Gregorian calendar, any year that starts on Tuesday, Friday or Saturday has only one Friday the 13th. ", "start": 431, "end": 460 }, { "error type": "Unverifiable", "explanation": "", "start": 493, "end": 512 }, { "error type": "Redundant", "explanation": "In the future, Easter will fall on a Friday in 2028 or ", "start": 516, "end": 532 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who established the first textile mill where spinning and weaving occurred in one place?", "passages": [ [ "Cotton mill", "In the same year, Paul Moody built the first successful power loom in the US.", "Moody used a system of overhead pulleys and leather belting, rather than bevel gearing, to power his machines.", "The group devised the Waltham System of working, which was duplicated at Lowell, Massachusetts and several other new cities throughout the state.", "Mill girls, some as young as ten, were paid less than men, but received a fixed wage for their 73-hour week.", "They lived in company-owned boarding houses, and attended churches supported by the companies.", "In the 1840s George Henry Corliss of Providence, Rhode Island improved the reliability of stationary steam engines.", "He replaced slide valves with valves that used cams.", "These Corliss valves were more efficient and more reliable than their predecessors.", "Initially, steam engines pumped water into a nearby reservoir that powered the water wheel, but were later used as the mill's primary power source.", "The Corliss valve was adopted in the UK, where in 1868 more than 60\u00a0mill engines were fitted with them.", "The large steam-powered Bowreath Cotton Mills opened at Fort Gloster near Calcutta by British interests in the 1820s, using British women to impart machine-spinning skills to the local workforce." ] ], "gold": "Francis Cabot Lowell at the Boston Manufacturing Company established the first textile mill where spinning and weaving occurred in one place, in 1814.", "prediction 1": "The first textile mill where spinning and weaving occurred in one place was established in 1820 by British interests. The large steam-powered Bowreath Cotton Mills were opened at Fort Gloster near Calcutta by British interests in the 1820s, using British women to impart machine-spinning skills to the local workforce.", "prediction 2": "The first textile mill where spinning and weaving occurred in one place was the Bowreath Cotton Mills in Fort Gloster, India, which was established in 1820 by British interests in the 1820s. In the 1840s, George Henry Corliss of Providence, Rhode Island improved the reliability of stationary steam engines. He replaced slide valves with valves that used cams. These Corliss valves were more efficient and more reliable than their predecessors.", "prediction 3": "The first textile mill where spinning and weaving occurred in one place was established in 1820 by British interests in India. In the same year, Paul Moody built the first successful power loom in the US. The Waltham System of working was duplicated at Lowell, Massachusetts and several other new cities throughout the state. The large steam-powered Bowreath Cotton Mills opened at Fort Gloster near Calcutta by British interests in the 1820s, using British women to impart machine-spinning skills to the local workforce.", "prediction 4": "The first textile mill where spinning and weaving occurred in one place was established in Fort Gloster near Calcutta by British interests in the 1820s, using British women to impart machine-spinning skills to the local workforce. The large steam-powered Bowreath Cotton Mills opened at Fort Gloster near Calcutta by British interests in the 1820s. In the 1840s George Henry Corliss of Providence, Rhode Island improved the reliability of stationary steam engines. He replaced slide valves with valves that used cams. These Corliss valves were more efficient and more reliable than their predecessors.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 318 } ], "missing-info": [], "corrected-prediction": "The large steam-powered Bowreath Cotton Mills were opened at Fort Gloster near Calcutta by British interests in the 1820." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What station is the breakfast club on in florida?", "passages": [], "gold": "The Breakfast Club, in FL, airs on 93.3 The Beat in Jacksonville, 103.5 The Beat in Miami, and 104.5 The Beat in Orlando.", "prediction 1": "In Florida, the Breakfast Club is on WCFL-AM.", "prediction 2": "On which station does the Breakfast Club broadcast?", "prediction 3": "On what station is the breakfast club on in Florida?", "prediction 4": "On what station is the breakfast club in Florida?", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 45 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who was the actress that played rizzo in grease?", "passages": [ [ "Stockard Channing", "Stockard Channing\n\nStockard Channing (born Susan Antonia Williams Stockard; February 13, 1944) is an American stage, film and television actress.", "She is known for playing Betty Rizzo in the film \"Grease\" (1978) and First Lady Abbey Bartlet on the NBC television series \"The West Wing\" (1999\u20132006).", "She is also known for originating the role of Ouisa Kittredge in the stage and film versions of \"Six Degrees of Separation\", for which she was nominated for the Tony Award for Best Actress in a Play and the Academy Award for Best Actress.", "A 13-time Primetime Emmy Award nominee and seven-time Tony Award nominee, she won the 1985 Tony Award for Best Actress in a Play for the Broadway revival of \"A Day in the Death of Joe Egg\", and won Emmy Awards for \"The West Wing\" and \"The Matthew Shepard Story\", both in 2002.", "She won a Daytime Emmy Award in 2004 for her role in \"Jack\".", "Her film appearances include \"The Fortune\" (1975), \"The Big Bus\" (1976), \"The Cheap Detective\" (1978), \"Heartburn\" (1986), \"Up Close & Personal\" (1996), \"Practical Magic\" (1998), and Woody Allen's \"Anything Else\" (2003)." ] ], "gold": "Stockard Channing played Rizzo in the 1978 film, Grease, while Susan Williams played the role in the 1971 musical, Grease.", "prediction 1": "American actress Stockard Channing played the role of Betty Rizzo in the 1978 film GREASE.", "prediction 2": "In the film Grease, Susan Antonia Williams Stockard played the character Betty Rizzo. Stockard Channing played Rizzo on both the stage and in the film.", "prediction 3": "In the 1978 film Grease, Susan Antonia Williams Stockard played the character of Betty Rizzo.", "prediction 4": "Stockard Channing is an American stage, film and television actress. She is known for playing Betty Rizzo in the film Grease (1978). Susan Antonia Williams Stockard was born on February 13, 1944. She is also known for playing First Lady Abbey Bartlet on the NBC television series The West Wing (1999\u20132006).", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "American actress Stockard Channing played the role of Betty Rizzo in the 1978 film GREASE." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When did they change the honda pilot body style?", "passages": [ [ "Honda Pilot", "The 2012 model year introduced a redesigned front fascia, new alloy wheels, and updates to the interior along with changes to the bumper.", "The 2013 model year included a standard rearview backup camera, i-MID central dashboard 8-inch LCD screen, USB connector, Bluetooth hands-free calling and wireless audio streaming, and tri-zone climate control.", "The Pilot uses Honda's Advanced Compatibility Engineering front bracket.", "For the 2013 model year a rear-view backup camera was made standard.", "The Insurance Institute for Highway Safety (IIHS) found the Pilot a driver death rate of 2 deaths per million registered years among the ten lowest released in their report\n\nThe third-generation 2016 Pilot debuted at the Chicago Auto Show in February 2015, production began during May, and was made available for sale in June.", "The exterior is sleeker in appearance compared to its boxier predecessor.", "Added to the exterior are optional LED headlamps with automatic high-low beam switching, LED daytime running lights (DRLs), and LED brake tail lights and the new Elite model.", "New features also include heated rear seats, ventilated front seats, and a panoramic roof to Elite models only.", "Alloy wheels became standard.", "Newly available safety features include Honda's LaneWatch passenger side mirror camera or Blind Spot Information (BSI) and rear Cross Traffic Monitor." ], [ "Honda Pilot", "However, the VTM-4 lock function only operates in first gear, second gear and reverse, and automatically disengages above 18mph, then re-engages when the speed drops below 18mph.", "Design of the Pilot was by Honda's Ricky Hsu through 1999, when styling was approved.", "The Pilot can accommodate up to eight passengers in three rows configured as stadium seating.", "The third row can seat three, but the limited legroom makes it suitable only for small children or adults on short trips.", "Similar to the Honda Odyssey, the rear seats can be folded into flat surfaces for larger cargo.", "Options include powered moonroof, DVD entertainment system, and a navigation system.", "Other features include ABS-equipped four-wheel disc brakes, rack-and-pinion steering, four-wheel independent suspension, and 282\u00b0 of outward visibility.", "Honda revised the Pilot for the 2006 model year in October 2005.", "Changes to the exterior included a new fascia with a different grille insert and halogen projector headlights, and taillights with clear lenses.", "The EX trim level received redesigned wheels, and the original EX wheels were now found on the LX trim.", "On the inside, side airbags were provided in the C pillar, the gauge cluster was updated and the center console featured chrome trim and redesigned storage compartments and cup holders." ], [ "Honda Pilot", "Honda Pilot\n\nThe Honda Pilot is a mid-size crossover SUV manufactured by Honda and introduced in 2002.", "Primarily aimed at the North American market, the Pilot is the largest SUV from Honda and features three-row seating.", "Pilots are currently manufactured in Lincoln, Alabama, and the Pilot was produced in Alliston, Ontario until April 2007.", "The first generation Pilot was released in April 2002 as a 2003 model.", "The Pilot shares its platform with the Acura MDX, as well as the Odyssey minivan and the Accord sedan.", "The Pilot's unibody construction and independent suspension are designed to provide handling similar to that of a car, and it has integrated perimeter frame rails to allow towing and light off-road use.", "Prior to the introduction of the Pilot, Honda marketed the compact crossover CR-V, and the Honda Passport, (a rebadged Isuzu Rodeo) that was a pickup truck-based design.", "The Pilot is Honda's largest SUV, although the 2010 Crosstour surpassed the Pilot in length.", "The Pilot is sold in North America and the Middle East, while the Honda MDX (first generation Acura MDX) was marketed in Japan and Australia for several years.", "The second generation Pilot is also marketed in Russia, Ukraine, and in the Dominican Republic.", "The Pilot is also sold in the Philippines." ] ], "gold": "The Honda Pilot is a mid-size crossover SUV whose body style has been changed several times over many years. Changes made in model years 2005 and 2006 resulted in a different grille insert and a redesigned front fascia. In model year 2012, the body style change resulted in new alloy wheels and another redesigned front fascia. Changes made to the body style in model years 2015 and 2016 resulted in a 10% reduction in drag area.", "prediction 1": "The Honda Pilot is a mid-size crossover SUV manufactured by Honda and introduced in 2002. Primarily aimed at the North American market, the Pilot is the largest SUV from Honda and features three-row seating. The first generation Pilot was released in April 2002 as a 2003 model. Honda revised the Pilot for the 2006 model year in October 2005. Changes to the exterior included a new fascia with a different grille insert and halogen projector headlights, and taillights with clear lenses. The second generation Pilot was released in April 2007.\n", "prediction 2": "The Honda Pilot is a mid-size crossover SUV produced by Honda that was introduced in 2002. The third-generation 2016 Pilot debuted at the Chicago Auto Show in February 2015, production began during May, and was made available for sale in June. The 2006 Pilot received a new body style in October 2005, while the 2007 Pilot received en facelift in April 2008. The Q5 Pilot received a body style change in July 2013, while the 2014 Pilot received a body style change in January 2014.", "prediction 3": "The Honda Pilot is an American mid-size crossover SUV manufactured by Honda that was introduced in February 2002. Primarily aimed at the North American market, the Pilot is Honda's largest SUV and features three-row seating. Honda designed the Pilot in 1999 after design changes required the approval of design consultant Ricky Hsu. For the 2006 model year, Honda revised the Pilot for the new model year, in October 2005. Changes to the exterior included a new fascia with a different grille insert and halogen projector headlights with clear lenses. The EX trim level received redesigned wheels, and new alloy wheels.", "prediction 4": "The Honda Pilot is a mid-size crossover SUV manufactured by Honda. It was introduced in February 2002. This model shares its platform with the Acura MDX, along with the Odyssey minivan and the Honda Accord sedan. It was first introduced as a 2003 model. Honda released the radical body style for the 2006 model year in October 2005. Changes to the exterior included a new fascia with a different grille insert and halogen projector headlights, and taillights with clear lenses. The future body style for the model is an automatic transmission.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 89 }, { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 489, "end": 545 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Honda Pilot is a mid-size crossover SUV. Honda revised the Pilot for the 2006 model year in October 2005. Changes to the exterior included a new fascia with a different grille insert and halogen projector headlights, and taillights with clear lenses. The 2012 model year introduced a redesigned front fascia, new alloy wheels, and updates to the interior along with changes to the bumper.\n" }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who said give me libert or give me death?", "passages": [ [ "Give me liberty, or give me death!", "Give me liberty, or give me death!", "\"Give me liberty, or give me death!\" is a quotation attributed to Patrick Henry from a speech he made to the Second Virginia Convention on March 23, 1775, at St. John's Church in Richmond, Virginia.", "He is credited with having swung the balance in convincing the convention to pass a resolution delivering Virginian troops for the Revolutionary War.", "Among the delegates to the convention were future U.S. Presidents Thomas Jefferson and George Washington.", "The speech was not published until \"The Port Folio\" printed a version of it in 1816.", "The version of the speech that is known today first appeared in print in \"Sketches of the Life and Character of Patrick Henry\", a biography of Henry by William Wirt in 1817.", "There is debate among historians as to whether and to what extent Henry or Wirt should be credited with authorship of the speech and its famous closing words.", "Whatever the exact words of Henry were, there can be no doubt of their impact.", "According to Edmund Randolph, the convention sat in silence for several minutes afterwards.", "Thomas Marshall told his son John Marshall, who later became Chief Justice of the United States, that the speech was \"one of the most bold, vehement, and animated pieces of eloquence that had ever been delivered.\"" ], [ "Give me liberty, or give me death!", "During the Indonesian National Revolution the Pemuda (youth) used the phrase \"Merdeka atau Mati\" which means \"Freedom or Death\".", "More recently, in China, Ren Jianyu, a 25-year-old former college student \"village official\" was given a two-year re-education through labor sentence for an online anti-CPC speech.", "A T-shirt of Ren's saying \"Give me liberty or give me death!\"", "(in Chinese) has been taken as evidence of his anti-social guilt." ], [ "Patrick Henry", "Patrick Henry\n\nPatrick Henry (May 29, 1736June 6, 1799) was an American attorney, planter, and orator well known for his declaration to the Second Virginia Convention (1775): \"Give me liberty, or give me death!\"", "A Founding Father, he served as the first and sixth post-colonial Governor of Virginia, from 1776 to 1779 and from 1784 to 1786.", "Henry was born in Hanover County, Virginia, and was for the most part educated at home.", "After an unsuccessful venture running a store, and assisting his father-in-law at Hanover Tavern, Henry became a lawyer through self-study.", "Beginning his practice in 1760, he soon became prominent through his victory in the Parson's Cause against the Anglican clergy.", "Henry was elected to the Virginia House of Burgesses, where he quickly became notable for his inflammatory rhetoric against the Stamp Act of 1765.", "In 1774 and 1775, Henry served as a delegate to the First and Second Continental Congresses, but did not prove particularly influential.", "He gained further popularity among the people of Virginia, both through his oratory at the convention and by marching troops towards the colonial capital of Williamsburg after the Gunpowder Incident until the munitions seized by the royal government were paid for.", "Henry urged independence, and when the Fifth Virginia Convention endorsed this in 1776, served on the committee charged with drafting the Virginia Declaration of Rights and the original Virginia Constitution." ] ], "gold": "There were several who said \"give me liberty or give me death,\" including Patrick Henry, a Founding Father who said it in a speech he made in Richmond, Virginia, and Ren Jianyu, a former college student who said it in China.", "prediction 1": "Thomas Marshall, an American lawyer, planter, and orator, said, \"Give me liberty, or give me death!\" in his speech to the Second Virginia Convention in 1775. There was also a quote attributed to Patrick Henry in his speech to the Second Virginia Convention in 1775.", "prediction 2": "\"Give me liberty, or give me death!\" is a quotation attributed to Patrick Henry from a speech he made to the Second Virginia Convention on March 23, 1775, at St. John's Church in Richmond, Virginia. There is debate among historians as to whether and to what extent Henry or William Wirt should be credited with authorship of the speech and its famous closing words. However, whether or not the exact words of Henry were in the speech and whether or not the closing words were in the speech, the impact of the speech is still widely known today.", "prediction 3": "\"Give me liberty, or give me death!\" is a quotation attributed to Patrick Henry from a speech he made to the Second Virginia Convention on March 23, 1775, at St. John's Church in Richmond, Virginia. There is debate among historians as to whether and to what extent Henry or William Wirt should be credited with authorship of the speech and its famous closing words. There is also debate among historians as to whether or not the exact words of Henry should be credited with authorship of the speech and its famous closing words.", "prediction 4": "\"Give me liberty, or give me death!\" is a quotation attributed to Patrick Henry from a speech he made to the Second Virginia Convention on March 23, 1775, at St. John's Church in Richmond, Virginia. There is debate among historians as to whether and to what extent Henry or William Wirt should be credited with authorship of the speech and its famous closing words.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 0, "end": 16 }, { "error type": "Irrelevant", "explanation": "", "start": 17, "end": 57 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 158, "end": 208 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Patrick Henry said, \"Give me liberty, or give me death!\" in his speech to the Second Virginia Convention in 1775. In China, Ren Jianyu, a former college student, had a speech and T-shirt with the same message." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "What does the name christian mean in spanish?", "passages": [ [ "Christians", "Christians\n\nChristians () are people who follow or adhere to Christianity, a monotheistic Abrahamic religion based on the life and teachings of Jesus Christ.", "The words \"Christ\" and \"Christian\" derive from the Koine Greek title \"Christ\u00f3s\" (\u03a7\u03c1\u03b9\u03c3\u03c4\u03cc\u03c2), a translation of the Biblical Hebrew term \"mashiach\" (\u05de\u05b8\u05e9\u05b4\u05c1\u05d9\u05d7\u05b7).", "While there are diverse interpretations of Christianity which sometimes conflict, they are united in believing that Jesus has a unique significance.", "The term \"Christian\" is also used as an adjective to describe anything associated with Christianity, or in a proverbial sense \"all that is noble, and good, and Christ-like.\"", "According to a 2011 Pew Research Center survey, there were 2.2 billion Christians around the world in 2010, up from about 600 million in 1910.", "By 2050, the Christian population is expected to exceed 3 billion.", "According to a 2012 Pew Research Center survey Christianity will remain the world's largest religion in 2050, if current trends continue.", "Today, about 37% of all Christians live in the Americas, about 26% live in Europe, 24% live in sub-Saharan Africa, about 13% live in Asia and the Pacific, and 1% live in the Middle East and North Africa.", "About half of all Christians worldwide are Catholic, while more than a third are Protestant (37%)." ], [ "Christians", "Orthodox communions comprise 12% of the world's Christians.", "Other Christian groups make up the remainder.", "Christians make up the majority of the population in 158 countries and territories.", "280 million Christians live as a minority.", "Christians have made noted contributions to a range of fields, including the sciences, arts, politics, literatures and business.", "According to \"100 Years of Nobel Prizes\", a review of Nobel prizes awarded between 1901 and 2000 reveals that (65.4%) of Nobel Prizes laureates identified Christianity in its various forms as their religious preference.", "The Greek word (\"Christianos\"), meaning \"follower of Christ\", comes from (\"Christos\"), meaning \"anointed one\", with an adjectival ending borrowed from Latin to denote adhering to, or even belonging to, as in slave ownership.", "In the Greek Septuagint, \"christos\" was used to translate the Hebrew \u05de\u05b8\u05e9\u05b4\u05c1\u05d9\u05d7\u05b7 (\"Ma\u0161\u00eda\u1e25,\" messiah), meaning \"[one who is] anointed.\"", "In other European languages, equivalent words to Christian are likewise derived from the Greek, such as \"Chr\u00e9tien\" in French and \"Cristiano\" in Spanish." ], [ "Christian (given name)", "Christian (given name)\n\nChristian originated as a Baptismal name used by persons of the Christian religion.", "It is now a given name born by males, and by females as Christiana and other feminized variants.", "An historically commonly used abbreviation, used for example on English 17th century church monuments and pedigrees, is \"Xpian\", using the Greek Chi Rho Christogram \"\u03a7\u03c1\", short for \"\u03a7\u03c1\u03b9\u03c3\u03c4\u03cc\u03c2\", Christ.", "The Greek form of the baptismal name is \"\u03a7\u03c1\u03b9\u03c3\u03c4\u03b9\u03b1\u03bd\u03cc\u03c2\", a Christian.", "The name denotes a follower of Christ, thus a Christian.", "It has been used as a given name since the Middle Ages, at first as a name for females, without any feminising word endings.", "Today the name is popular in the United States, the United Kingdom, Ireland, Canada, Australia, New Zealand, South Africa, France, Italy, the Netherlands, Belgium, Switzerland, Germany, Austria, Hungary, Norway, Sweden, Finland, Denmark, Iceland, and Estonia.", "Today in Europe \u2014 though not the United States \u2014 it is almost exclusively used as a male name, but in the 17th and 18th centuries it was a popular female first name in Scotland." ] ], "gold": "Christians are people who follow or adhere to Christianity or are a follower of Christ, a monotheistic Abrahamic religion based on the life and teachings of Jesus Christ. The Christians got their name from Christus in Spanish, which means the anointed.", "prediction 1": "Christians are people who follow or adhere to Christianity, a monotheistic Abrahamic religion based on the life and teachings of Jesus Christ. In Spanish, the name Christian originated as a baptismal name used by persons of the Christian religion. It is now a given name born by males, and by females as Christiana and other feminized variants.", "prediction 2": "Christians in Spanish are people who follow or adhere to Christianity, a monotheistic Abrahamic religion based on the life and teachings of Jesus Christ. Christian originated as a Baptismal name used by persons of the Christian religion. It is now a given name born by males, and by females as Christiana and other feminized variants.", "prediction 3": "Christian originated as a baptismal name used by persons of the Christian religion. It is now a given name born by males, and by females as Christiana and other feminized variants. In Spanish, christiano means \"follower of Christ\", the Greek form of the baptismal name is christ\u00f3s, which is a translation of the Biblical Hebrew term messiah, meaning \"one who is anointed\" and in Spanish christiano means \"Christian\".", "prediction 4": "Christ is a person whose life and teachings are based on the life of Jesus Christ. The name Christian originated as a Baptismal name used by persons of the Christian religion. It is now a given name born by males, and by females as Christiana and other feminized variants. In Spanish, Christian means follower of Christ, thus a Christian. In German, Christian means Christiane, and in Italian, Christian means follower of Christ.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 344 }, { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 247 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Christians are people who follow or adhere to Christianity, a monotheistic Abrahamic religion based on the life and teachings of Jesus Christ. In Spanish, the word for Christian is \"Cristiano\" derived from the Greek. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "What us state has the highest population density?", "passages": [ [ "Woodruff County, Arkansas", "The largest city and county seat, Augusta, is located in the western part of the county near the White River and the White County border.", "Augusta's population in 2010 was 2,199\u2014well below its peak of 3,496 at the 1980 Census.", "McCrory and Patterson are adjacent to each other, located near the county's center.", "Cotton Plant and Hunter are both located in the southern part of Woodruff County, with 2010 populations of 649 and 105, respectively.", "Woodruff County has dozens of unincorporated communities and ghost towns within its borders.", "This is due to early settlers in Arkansas tending to cluster in small clusters rather than incorporated towns.", "For example, Fitzhugh and Gregory had post offices at some point in their history.", "Other communities are simply a few dwellings at a crossroads that have adopted a common place name over time.", "Some are officially listed as populated places by the United States Geological Survey, and others are listed as historic settlements.", "As of the 2000 United States Census, there were 8,741 people, 3,531 households, and 2,439 families residing in the county.", "The population density was 15 people per square mile (6/km\u00b2).", "There were 4,089 housing units at an average density of 7 per square\u00a0mile (3/km\u00b2)." ], [ "Population density", "Population density\n\nPopulation density (in agriculture: standing stock and standing crop) is a measurement of population per unit area or unit volume; it is a quantity of type number density.", "It is frequently applied to living organisms, and most of the time to humans.", "It is a key geographical term.", "In simple terms population density refers to the number of people living in an area per kilometer square.", "Population density is population divided by total land area or water volume, as appropriate.", "Low densities may cause an extinction vortex and lead to further reduced fertility.", "This is called the Allee effect after the scientist who identified it.", "Examples of the causes in low population densities include:\n\nFor humans, population density is the number of people per unit of area, usually quoted per square kilometer or square mile (which may include or exclude, for example, areas of water or glaciers).", "Commonly this may be calculated for a county, city, country, another territory or the entire world.", "The world's population is around 7,500,000,000 and Earth's total area (including land and water) is 510,000,000 square kilometers (197,000,000 sq. mi.).", "Therefore, the worldwide human population density is around 7,500,000,000 \u00f7", "510,000,000 = 14.7 per km (38 per sq. mi)." ], [ "2010 United States Census", "Had this occurred, it would have also affected Electoral College apportionment for the 2012\u20132020 presidential elections.", "After the court order was not granted, the plaintiffs appealed the case to the United States Supreme Court, and on December 13, 2010, the Supreme Court vacated and remanded with instructions to dismiss the complaint for lack of jurisdiction.", "The state with the highest percentage rate of growth was Nevada, while the state with the largest population increase was Texas.", "Michigan, the 8th largest by population, was the only state to lose population (although Puerto Rico, a U.S. territory, lost population as well), and the District of Columbia saw its first gain since the 1950s.", "Note that the resident populations listed below do not include people living overseas.", "For Congressional apportionment, the sum of a state's resident population and its population of military personnel and federal contractors living overseas (but not other citizens overseas, such as missionaries or expatriate workers) is used.", "These are core metropolitan rankings versus combined statistical areas.", "For full list with current data, go to Metropolitan Statistics." ] ], "gold": "Population density is defined as the population per land area, or, more specifically, the population divided by land area. According to the census of 2010, the US city with the highest population density was located in New Jersey. New Jersey was also the US state with the highest population density in both 2013 and 2015. While the District of Columbia was the US territory with the highest population density in 2013 and 2015.", "prediction 1": "The number one state with the highest population density is California. The state with the highest percentage rate of growth is Nevada. The state with the highest population increase is Texas.", "prediction 2": "For humans, population density is the number of people per unit of area, usually quoted per square kilometer or square mile. For the US, Wyoming has the highest population density at 9.7 people/km2. For the world, the number of people per square kilometer or square mile is around 7,500,000,000 and the number of people per square mile is around 9,400,000,000.", "prediction 3": "In simple terms, population density refers to the number of people living in an area per kilometer square. It is frequently applied to living organisms, and most of the time to humans. Texas has the highest population density in the US, with a population density of 14.7 per km2.", "prediction 4": "The state with the highest population density is California. The state with the highest population growth rate is Nevada, the state with the highest population increase is Texas, and the state with the highest population decline is Vermont.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 192 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Population density is population divided by total land area. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who came up with the idea for the voice?", "passages": [ [ "The Voice (U.S. TV series)", "The Voice (U.S. TV series)\n\nThe Voice is an American singing competition television series broadcast on NBC.", "It premiered during the spring television cycle on April 26, 2011, and expanded into the fall cycle with the premiere of the third season on September 10, 2012.", "Based on the original \"The Voice of Holland\", it has aired fifteen seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 15 or over (age 13 or over since season 12), drawn from public auditions.", "The winner is determined by television viewers voting by telephone, internet, SMS text, and iTunes Store purchases of the audio-recorded artists' vocal performances.", "They receive US$100,000 and a record deal with Universal Music Group for winning the competition.", "The winners of the fifteen seasons have been: Javier Colon, Jermaine Paul, Cassadee Pope, Danielle Bradbery, Tessanne Chin, Josh Kaufman, Craig Wayne Boyd, Sawyer Fredericks, Jordan Smith, Alisan Porter, Sundance Head, Chris Blue, Chloe Kohanski, Brynn Cartelli, and Chevel Shepherd.", "The series employs a panel of four coaches who critique the artists' performances and guide their teams of selected artists through the remainder of the season." ], [ "The Voice (Russian TV series)", "The Voice (Russian TV series)\n\nThe Voice () is a Russian singing competition television series broadcast on Channel One.", "Based on the original \"The Voice of Holland\", it has aired six seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 17 or over, drawn from public auditions.", "The winner is determined by television viewers voting by telephone, SMS text, and The Voice App.", "The winners of the six seasons have been: Dina Garipova, Sergey Volchkov, Alexandra Vorobyova, Hieromonk Fotiy, Darya Antonyuk, and Selim Alakhyarov.", "The series employs a panel of four coaches who critique the artists' performances and guide their teams of selected artists through the remainder of the season.", "They also compete to ensure that their act wins the competition, thus making them the winning coach." ], [ "The Voice (franchise)", "The Voice (franchise)\n\n", "The Voice is an international reality television singing competition franchise.", "It is based on the reality singing competition \"The Voice of Holland\", which was originally created by Dutch television producer John de Mol.", "Many other countries have adapted the format and begun airing their own versions since 2010.", "It has become a rival to the \"Idols\" franchise, \"Rising Star\" and \"The X Factor\".", "John de Mol, creator of \"Big Brother\", first created \"The Voice\" concept with Dutch singer Roel van Velzen.", "Erland Galjaard, a Dutch program director, asked John de Mol about whether he could come up with a format that went a step further than \"The X Factor\".", "De Mol then came up with the idea of \"Blind Audition\".", "He wanted to focus on singing quality alone, so the coaches must be top artists in the music industry.", "The rotating chairs concept was invented by Roel van Velzen.", "It would also be the first talent show in which social media was actively involved.", "On 17 September 2010, \"The Voice of Holland\" began to air on RTL 4 with Angela Groothuizen, Roel van Velzen, Nick & Simon, and Jeroen van der Boom as the mentor-judges (dubbed as \"coaches\") of the show." ] ], "gold": "The American TV show \"The Voice\" is based on \"The Voice of Holland\", created by John de Mol and Roel van Velzen. The rotating chairs concept was invented van Velzen, while producer Erland Galjaard encouraged the producers to introduce the concept of blind auditions.", "prediction 1": "The Voice is an American singing competition television series broadcast on NBC. Based on the original \"The Voice of Holland\", it has aired fifteen seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 15 or over (age 13 or over since season 12), drawn from public auditions. John de Mol, creator of Big Brother, first created \"The Voice\" concept with Dutch singer Roel van Velzen. Erland Galjaard, a Dutch program director, asked John de Mol about whether he could come up with a format that went a step further than \"The X Factor\". De Mol then came up with the idea of \"Blind Audition\". He wanted to focus on singing quality alone, so the coaches must be top artists in the music industry. The rotating chairs concept was invented by Roel van Velzen.", "prediction 2": "The Voice is an American singing competition television series broadcast on NBC. It premiered during the spring television cycle on April 26, 2011 and expanded into the fall cycle with the premiere of the third season on September 10, 2012. The Voice is a Russian singing competition television series broadcast on Channel One. Based on the original \"The Voice of Holland\", it has aired fifteen seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 15 or over (age 13 or over since season 12), drawn from public auditions. The winner is determined by television viewers voting by telephone, internet, SMS text, and iTunes Store purchases of the audio-recorded artists' vocal performances.", "prediction 3": "The Voice is an American singing competition television series broadcast on NBC. Based on the original \"The Voice of Holland\", it has aired fifteen seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 15 or over (age 13 or over since season 12), drawn from public auditions. The Voice of Holland is the Dutch version of the international reality singing competition franchise developed by Dutch television producer John de Mol.", "prediction 4": "The Voice is an American singing competition television series broadcast on NBC. Based on the original The Voice of Holland, it has aired fifteen seasons and aims to find currently unsigned singing talent (solo or duets, professional and amateur) contested by aspiring singers, age 15 or over (age 13 or over since season 12), drawn from public auditions. Erland Galjaard, a Dutch program director, asked John de Mol about whether he could come up with a format that went a step further than The X Factor. De Mol then came up with the idea of a format that went a step further than The Voice App. The rotating chairs concept was invented by Dutch singer Roel van Velzen. The rotating chairs concept was invented by Dutch singer Roel van Velzen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 394 }, { "error type": "Irrelevant", "explanation": "", "start": 464, "end": 615 }, { "error type": "Irrelevant", "explanation": "", "start": 671, "end": 773 } ], "missing-info": [], "corrected-prediction": "The American TV show \"The Voice\" is based on the original \"The Voice of Holland\". John de Mol first created \"The Voice\" concept with Dutch singer Roel van Velzen. De Mol came up with the idea of \"Blind Audition\". The rotating chairs concept was invented by Roel van Velzen." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who does elizabeth love in pirates of the caribbean?", "passages": [ [ "Elizabeth Swann", "Elizabeth Swann\n\nElizabeth Swann (later Elizabeth Turner) is a fictional character in the \"Pirates of the Caribbean\" film series.", "She appears in \"\" (2003) and three of its sequels, \"\" (2006), \"\" (2007) and \"\" (2017).", "She is portrayed by Keira Knightley (and as a child by Lucinda Dryzek in the prologue of \"The Curse of the Black Pearl\").", "She is known to use the alias \"Elizabeth Turner\", but this later becomes her married name when she weds the character Will Turner (played by Orlando Bloom).", "Elizabeth is a spirited, intelligent, and independent-minded character whose beauty attracted Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow.", "Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "Throughout the three films, she transforms from a young girl to a proper lady and finally into a courageous pirate.", "Elizabeth has always been fascinated by piracy, but she is often revolted by pirates' aggressive, wild nature.", "Even after becoming a pirate, Elizabeth retains her refined ways, as well as her loyalty and compassion for loved ones (including Will Turner, her father, and later, Jack Sparrow and James Norrington)." ] ], "gold": "Elizabeth is a spirited, intelligent, and independent-minded character in Pirates of the Caribbean, whose beauty attracted Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow. Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "prediction 1": "Elizabeth Swann is a fictional character in the Pirates of the Caribbean film series. She appears in \"\" (2003) and three of its sequels, \"\" (2006), \"\" (2007) and \"\" (2017). Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "prediction 2": "Elizabeth Swann is a fictional character in the Pirates of the Caribbean film series. She appears in the films \"\" (2003), \"\" (2006), \"\" (2007) and \"\" (2017). She is played by Keira Knightley and as a child by Lucinda Dryzek in the prologue to The Curse of the Black Pearl. Elizabeth is a spirited, intelligent, and independent-minded character whose beauty attracted Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow. Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "prediction 3": "In Pirates of the Caribbean, Elizabeth loves Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow. Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "prediction 4": "In the Pirates of the Caribbean film series, Elizabeth loves Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow. Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 172 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Elizabeth Swann is a spirited, intelligent, and independent-minded fictional character in Pirates of the Caribbean, whose beauty attracted Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow.. Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who said never mind on saturday night live?", "passages": [ [ "Emily Litella", "Emily Litella\n\nEmily Litella is a fictional character created and performed by comedian Gilda Radner in a series of appearances on \"Saturday Night Live\".", "Based on a person in her early life, Emily Litella is a popular character in Radner's comedy repertoire.", "Emily Litella is an elderly woman with a hearing problem who appeared 26 times on \"SNL's\" \"Weekend Update\" op-ed segment in the late 1970s.", "Attired in a frumpy dress, sweater and Lisa Loopner glasses, Litella was introduced with professional dignity by the news anchors, who could sometimes be seen cringing slightly in anticipation of the malapropisms they knew would follow.", "These sketches were, in part, a parody of the Fairness Doctrine, which at the time required broadcasters in the United States to present opposing viewpoints on public issues.", "Litella would peer through her reading glasses and, in the character's high-pitched, warbly voice, would read a prepared statement in opposition to an editorial that the TV station had supposedly broadcast.", "Litella would become increasingly agitated as her statement progressed.", "Midway in her commentary, it became apparent to the anchor, and the audience, that Litella had misheard or misunderstood the subject of the editorial to which she was responding." ] ], "gold": "\"Never mind\" was something the character Emily LItella, played by Gilda Susan Radner, said on Saturday Night Live.", "prediction 1": "Emily Litella is a fictional character created and performed by comedian Gilda Radner in a series of appearances on Saturday Night Live. Based on a person in her early life, Emily Litella is a popular character in Radner's comedy repertoire. Litella is an elderly woman with a hearing problem who appeared 26 times on \"SNL's\" Weekend Update op-ed segment in the late 1970s.", "prediction 2": "Gilda Radner's character, Emily Litella, said never mind. Radner performed this role on several occasions on Saturday Night Live.", "prediction 3": "On Saturday Night Live, Emily Litella is an elderly woman with a hearing problem that appeared 26 times on the \"Weekend Update\" op-ed segment. In the late 1970s, SNL introduced Emily Litella with professional dignity by the news anchors, who could sometimes be seen cringing slightly in anticipation of the malapropisms they knew would follow.", "prediction 4": "The character Never Mind is played by Gilda Radner.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 241 }, { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 373 } ], "missing-info": [], "corrected-prediction": "Emily Litella is a fictional character created and performed by comedian Gilda Radner in a series of appearances on Saturday Night Live. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "How many teams are there in the afl?", "passages": [ [ "American Football League", "On June 17, the AFL filed an antitrust lawsuit against the NFL, which was dismissed in 1962 after a two-month trial.", "The AFL began regular-season play (a night game on Friday, September 9, 1960) with eight teams in the league \u2014 the Boston Patriots, Buffalo Bills, Dallas Texans, Denver Broncos, Houston Oilers, Los Angeles Chargers, New York Titans, and Oakland Raiders.", "Raiders' co-owner Wayne Valley dubbed the AFL ownership \"The Foolish Club\", a term Lamar Hunt subsequently used on team photographs he sent as Christmas gifts.", "The Oilers became the first-ever league champions by defeating the Chargers, 24\u201316, in the AFL Championship on January 1, 1961.", "Attendance for the 1960 season was respectable for a new league, but not nearly that of the NFL.", "In 1960, the NFL averaged attendance of more than 40,000 fans per game and more popular NFL teams in 1960 regularly saw attendance figures in excess of 50,000 per game, while CFL attendances averaged approximately 20,000 per game.", "By comparison, AFL attendance averaged about 16,500 per game and generally hovered between 10,000-20,000 per game.", "Professional football was still primarily a gate-driven business in 1960, so low attendance meant financial losses." ], [ "American Football League", "In 1965, Milwaukee officials tried to lure an expansion team to play at Milwaukee County Stadium where the Green Bay Packers had played parts of their home schedule after an unsuccessful attempt to lure the Packers there full-time, but Packers head coach Vince Lombardi invoked the team's exclusive lease as well as sign an extension to keep some home games in Milwaukee until 1976.", "In early 1965, the AFL awarded its first expansion team to Rankin Smith of Atlanta.", "The NFL quickly counteroffered Smith a franchise, which Smith accepted; the Atlanta Falcons began play as an NFL franchise.", "In March 1965, Joe Robbie had met with Commissioner Foss to inquire about an expansion franchise for Miami.", "On May 6, after Atlanta's exit, Robbie secured an agreement with Miami mayor Robert King High to bring a team to Miami.", "League expansion was approved at a meeting held on June 7, and on August 16 the AFL's ninth franchise was officially awarded to Robbie and television star Danny Thomas.", "The Miami Dolphins joined the league for a fee of $7.5 million and started play in the AFL's Eastern Division in 1966.", "The AFL also planned to add two more teams by 1967.", "In 1966, the rivalry between the AFL and NFL reached an all-time peak.", "On April 7, Joe Foss resigned as AFL commissioner." ], [ "American Football League", "The Oakland Raiders\u2014who had easily beaten the Houston Oilers to win their first AFL championship\u2014were overmatched by the Packers, 33\u201314.", "The more experienced Packers capitalized on a number of Raiders miscues and never trailed.", "Green Bay defensive tackle Henry Jordan offered a compliment to Oakland and the AFL, when he said, \"...\u00a0the AFL is becoming much more sophisticated on offense.", "I think the league has always had good personnel, but the blocks were subtler and better conceived in this game.\"", "The AFL added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati, Ohio, headed by NFL legend Paul Brown.", "Although Brown had intended to join the NFL, he agreed to join the AFL when he learned that his team would be included in the NFL once the merger was completed.", "The Cincinnati Bengals began play in the 1968 season, finishing last in the Western Division.", "While many AFL players and observers believed their league was the equal of the NFL, their first two Super Bowl performances did nothing to prove it.", "However, on November 17, 1968, when NBC cut away from a game between the Jets and Raiders to air the children's movie \"Heidi\", the ensuing uproar helped disprove the notion that fans still considered the AFL an inferior product." ] ], "gold": "The AFL began playing on Friday, September 9, 1960, with 8 teams. There were 8 teams in the league until 1966, when the league increased to 9 teams with the addition of the Miami Dolphins. From 1968 to 1970, the league had 10 teams with the addition of a team in Cincinnati.", "prediction 1": "The American Football League began regular-season play on Friday, September 9, 1960, with eight teams in the league \u2014 the Boston Patriots, Buffalo Bills, Dallas Texans, Denver Broncos, Houston Oilers, Los Angeles Chargers, New York Titans, and Oakland Raiders. The league added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati, Ohio, headed by NFL legend Paul Brown.", "prediction 2": "The American Football League began regular-season play (a night game on Friday, September 9, 1960) with eight teams in the league \u2014 the Boston Patriots, Buffalo Bills, Dallas Texans, Denver Broncos, Houston Oilers, Los Angeles Chargers, New York Titans, and Oakland Raiders. The AFL added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati, Ohio, headed by NFL legend Paul Brown.", "prediction 3": "The American Football League began regular-season play (a night game on Friday, September 9, 1960) with eight teams in the league. The AFL added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati, Ohio, headed by NFL legend Paul Brown.", "prediction 4": "The American Football League began regular-season play on September 9, 1960, with eight teams in the league \u2014 the Boston Patriots, Buffalo Bills, Dallas Texans, Denver Broncos, Houston Oilers, Los Angeles Chargers, New York Titans, and Oakland Raiders. In early 1965, the AFL awarded its first expansion team to Rankin Smith of Atlanta. The NFL quickly counteroffered Smith a franchise, which Smith accepted, and the Atlanta Falcons began play as an NFL franchise. The AFL added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati, headed by NFL legend Paul Brown. In 1967, the AFL added its tenth and final team on May 24, 1967, when it awarded the league's second expansion franchise to an ownership group from Cincinnati Bengals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 260 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 453 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The American Football League began regular-season play on Friday, September 9, 1960, with eight teams in the league. In 1966, the Miami Dolphins joined the AFL. The league then added its tenth and final team on May 24, 1967." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who were the hosts of america got talent?", "passages": [ [ "Got Talent", "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016.", "From season 12 (2017), the new host of AGT is Tyra Banks.", "The grand prize for the winner(s) is US$1 million, and, since season 3, a chance to headline a show on the Las Vegas Strip.", "\"America's Got Talent\" proved extremely successful for NBC, pulling in high ratings in both total viewers and the younger 18-49 demographic.", "The show's initial success in America is credited with the eventual launch of the British series, and the overall global launch of the \"Got Talent\" franchise.", "ITV eventually debuted \"Britain's Got Talent\" on 9 June 2007 with Cowell, Morgan and Amanda Holden as judges, and Ant & Dec as hosts of the show.", "For series 5, Morgan stepped down due to commitments hosting \"Piers Morgan Tonight\" on CNN, and Cowell only attended the live shows as he was busy launching \"The X Factor USA\", so Michael McIntyre and David Hasselhoff joined the panel with Holden." ] ], "gold": "America's Got Talent, often abbreviated as AGT, is a televised American talent show competition, and is part of the global Got Talent franchise created by Simon Cowell. The judges for Season 11, 12, and 13 were Simon Cowell, Howie Mandel, and Mel B.", "prediction 1": "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016. From season 12 (2017), the new host of America's Got Talent is Tyra Banks. The hosts of Britain's Got Talent were Ant & Dec on the show from season 5 to season 11.", "prediction 2": "In 2008, Nick Cannon was the host of America's Got Talent. In 2009-2016, Nick Cannon was the host of America's Got Talent. In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016. From season 12 (2017), the new host of America's Got Talent is Tyra Banks.", "prediction 3": "America's Got Talent was an American reality television show based on the British show Britain's Got Talent. The show was hosted by Ant & Dec and Nick Cannon between 2009 and 2016.", "prediction 4": "The American version of America's Got Talent was hosted by Nick Cannon from 2009-2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 299 }, { "error type": "Unverifiable", "explanation": "", "start": 300, "end": 327 } ], "missing-info": [], "corrected-prediction": "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016. From season 12 (2017), the new host of America's Got Talent is Tyra Banks. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did budapest became the capital of hungary?", "passages": [ [ "Budapest", "It was this compromise which opened the second great phase of development in the history of Budapest, lasting until World War I. In 1849 the Chain Bridge linking Buda with Pest was opened as the first permanent bridge across the Danube and in 1873 Buda and Pest were officially merged with the third part, \u00d3buda (Old Buda), thus creating the new metropolis of Budapest.", "The dynamic Pest grew into the country's administrative, political, economic, trade and cultural hub.", "Ethnic Hungarians overtook Germans in the second half of the 19th century due to mass migration from the overpopulated rural Transdanubia and Great Hungarian Plain.", "Between 1851 and 1910 the proportion of Hungarians increased from 35.6% to 85.9%, Hungarian became the dominant language, and German was crowded out.", "The proportion of Jews peaked in 1900 with 23.6%.", "Due to the prosperity and the large Jewish community of the city at the start of the 20th century, Budapest was often called the \"Jewish Mecca\" or \"Judapest\".", "In 1918, Austria-Hungary lost the war and collapsed; Hungary declared itself an independent republic (Republic of Hungary).", "In 1920 the Treaty of Trianon partitioned the country, and as a result, Hungary lost over two-thirds of its territory, and about two-thirds of its inhabitants, including 3.3 million out of 15 million ethnic Hungarians." ], [ "Budapest", "Budapest\n\nBudapest is the capital and the most populous city of Hungary, and the tenth-largest city in the European Union by population within city limits.", "The city had an estimated population of 1,752,704 in 2016 distributed over a land area of about .", "Budapest is both a city and county, and forms the centre of the Budapest metropolitan area, which has an area of and a population of 3,303,786, comprising 33 percent of the population of Hungary.", "The history of Budapest began when an early Celtic settlement transformed into a Roman town of Aquincum, the capital of Lower Pannonia.", "The Hungarians arrived in the territory in the late 9th century.", "The area was pillaged by the Mongols in 1241.", "Buda, the settlements on the west bank of the river, became one of the centres of Renaissance humanist culture by the 15th century.", "The Battle of Moh\u00e1cs in 1526 was followed by nearly 150 years of Ottoman rule.", "After the reconquest of Buda in 1686, the region entered a new age of prosperity.", "Pest-Buda became a global city with the unification of Buda, \u00d3buda, and Pest on November 17, 1873, with the name 'Budapest' given to the new capital.", "Budapest also became the co-capital of the Austro-Hungarian Empire, a great power that dissolved in 1918, following World War I." ] ], "gold": "Budapest became the capital of Hungary as part of a dual monarchy between Austria and Hungary in 1867. On November 17, 1873 Buda and Pest were officially merged with \u00d3buda, thus creating the new metropolis of Budapest and the single capital of Hungary.", "prediction 1": "Budapest was the capital and most populous city of Hungary from 1241 until 1918, when the Austro-Hungarian Empire collapsed, and Hungary declared itself an independent republic (Republic of Hungary). The city was named Budapest in 1873, when Buda, buda, and Pest were unified, renaming the new capital the new capital Budapest.", "prediction 2": "In 1873, Buda and Pest were officially merged with the third part, buda, thus creating the new metropolis of Budapest. Pest-Buda became a global city with the unification of Buda, buda, and Pest on November 17, 1873, with the name 'Budapest' given to the new capital. Budapest also became the co-capital of the Austro-Hungarian Empire, a great power that dissolved in 1918, following World War I.", "prediction 3": "The city of Budapest was the capital of Hungary from 1087 to 1091, and from the time of its unification with Buda, buda, and Pest in 1873 the name Budapest was given to the new capital. The history of Budapest began when an early Celtic settlement transformed into a Roman town of Aquincum, the capital of Lower Pannonia. After the Ottoman conquest of Buda in 1686, the region entered a new age of prosperity.", "prediction 4": "Budapest became the capital of Hungary on November 17, 1873, when the three cities were unified into one, with the name 'Budapest' given to the new capital. Budapest also became the co-capital of the Austro-Hungarian Empire, a great power that dissolved in 1918, following World War I.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 80 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "In 1918, Austria-Hungary lost the war and collapsed; Hungary declared itself an independent republic (Republic of Hungary). Pest-Buda became a global city with the unification of Buda, \u00d3buda, and Pest on November 17, 1873, with the name 'Budapest' given to the new capital." }, "preference": [ 1, 1, 0, 2, 2, 0 ] }, { "question": "What is on the back of a canadian nickel?", "passages": [ [ "Coins of the Canadian dollar", "In 2000 all coins below $1 were changed to steel with copper or nickel plating; in 2012 this was extended to the $1 and $2 coins as well.", "The 50\u00a2 piece is regularly minted, but not in large quantities; it is very rare to come across this coin in circulation, although an unsuccessful attempt was made by the Mint to promote the use of the coin when a special edition was released in 2002 marking the 50th anniversary of Elizabeth II ascending the throne.", "Coins issued in 2002 do not have the usual mint date, which normally appears on the reverse side.", "Instead, the 2002 coins have a commemorative double-date on the obverse side: \"1952-2002\", to commemorate the 50th anniversary of the Queen's reign.", "Although the Mint has produced many special edition coins in recent years, Canada does have a history of such coins.", "From 1943 to 1945, the Mint issued the \"Victory nickel\" to promote the Canadian war effort.", "In 1951 a circulating commemorative coin, a 5 cent piece for the bicentennial of the discovery of the element nickel, was released.", "In 1967, all Canadian coins were issued with special reverses to celebrate the Canadian centennial.", "Six years later, a \"Mountie quarter\" was issued in 1973 to commemorate the centennial of the Royal Canadian Mounted Police.", "In recent years, the Mint has issued several series of coins with special reverses." ] ], "gold": "Canadian nickels have had beavers, a rabbit, and an oil refinery on their backs. Most Canadian nickels have a beaver sitting on a rock on their backs. On the back of a 2017 commemorative Canadian nickel is a beaver influenced by the northeastern woodland Algonkian heritage, while on the back of a 1967 centennial Canadian nickel is a hopping rabbit. A nickel refinery was on the back of a 1951 Canadian nickel, a special commemorative five-cent piece celebrating the 200th anniversary of the metal's discovery.", "prediction 1": "There are several reverses on the Canadian nickel. In 1943 to 1945, the Mint issued the \"Victory nickel\" to promote the Canadian war effort. In 1951 a circulating commemorative coin for the bicentennial of the discovery of the element nickel, was released. In 1967, all Canadian coins were issued with special reverses to celebrate the Canadian centennial. In recent years, the Mint has issued several series of coins with special reverses.", "prediction 2": "The Canadian nickel has a special reverse. The reverse of the coin depicts the year it was issued and the date on which it was issued. The reverse of the Canadian nickel is the year it was produced.", "prediction 3": "On the back of a Canadian nickel, the date the coin was issued is not the usual mint date, and instead, it is the commemorative double-date \"1952-2002\" marking the 50th anniversary of Elizabeth II ascending the throne.", "prediction 4": "The back of a Canadian nickel is not the usual reverse side. Instead, the back of a Canadian nickel has a commemorative double-date of \"1952-2002\". This commemorative double-date commemorates the 50th anniversary of Elizabeth II ascending the throne.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "There are several reverses on the Canadian nickel. In 1943 to 1945, the Mint issued the \"Victory nickel\" to promote the Canadian war effort. In 1951 a circulating commemorative coin for the bicentennial of the discovery of the element nickel, was released. In 1967, all Canadian coins were issued with special reverses to celebrate the Canadian centennial. In recent years, the Mint has issued several series of coins with special reverses." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was the first transatlantic telephone cable service opened?", "passages": [ [ "Transatlantic communications cable", "Transatlantic communications cable\n\nA transatlantic telecommunications cable is a submarine communications cable connecting one side of the Atlantic Ocean to the other.", "In the 19th and early 20th centuries each cable was a single wire.", "After mid-century, coaxial cable came into use, with amplifiers.", "Late in the century, all used optical fiber, and most now use optical amplifiers.", "When the first transatlantic telegraph cable was laid in 1858 by businessman Cyrus West Field, it operated for only three weeks; subsequent attempts in 1865 and 1866 were more successful.", "Although a telephone cable was discussed starting in the 1920s, to be practical it needed a number of technological advances which did not arrive until the 1940s.", "Starting in 1927, transatlantic telephone service was radio-based.", "TAT-1 (Transatlantic No. 1) was the first transatlantic telephone cable system.", "It was laid between Gallanach Bay, near Oban, Scotland and Clarenville, Newfoundland between 1955 and 1956 by the cable ship \"Monarch\".", "It was inaugurated on September 25, 1956, initially carrying 36 telephone channels.", "In the first 24 hours of public service there were 588 London\u2013U.S. calls and 119 from London to Canada.", "The capacity of the cable was soon increased to 48 channels.", "Later, an additional three channels were added by use of C Carrier equipment." ], [ "Internet in New Zealand", "The controllers of funding were steadfast in refusing to fund the $250,000 estimate for the link up the Pacific to the United States.", "John Houlker did not let up.", "Due to his efforts New Zealand's first international internet connection was established in 1989 from Waikato University through IBM.", "The capacity went from 64 kbit/s to 128 kbit/s between February 1993 and February 1994.", "At the start of the millennium, there were a number of ISPs offering free dial-up internet to users.", "Unlike free ISPs overseas, these did not survive on advertising or e-commerce revenue, instead, they were funded by interconnecting charges.", "In 1996, Telecom and Clear signed an interconnecting agreement, where Telecom would pay 1\u20132 cents/minute for calls from Telecom customers to Clear customers.", "When the agreement was signed, the potential of the internet was not fully understood.", "The first company to take advantage of this situation was Compass Communications, which set up Freenet in February 2000.", "Several companies followed: i4free (by CallPlus), surf4nix, Zfree (by Clear), Splurge (by Quicksilver)." ] ], "gold": "A transatlantic telecommunications cable is a submarine communications cable connecting one side of the Atlantic Ocean to the other. The first transatlantic telephone cable service opened on September 25, 1956. The first south atlantic telephone cable service opened in February 2000.", "prediction 1": "The first transatlantic telephone cable service was opened on September 25, 1956. It was laid between Gallanach Bay, near Oban, Scotland and Clarenville, Newfoundland between 1955 and 1956 by the cable ship Monarch.\n", "prediction 2": "A transatlantic telecommunications cable is a submarine communications cable connecting one side of the Atlantic Ocean to the other. The first transatlantic telephone cable service opened in New Zealand on September 25, 1956. TAT-1 (Transatlantic No. 1) was the first transatlantic telephone cable system. It was laid between Gallanach Bay, near Oban, Scotland and Clarenville, Newfoundland between 1955 and 1956 by the cable ship Monarch.", "prediction 3": "The first transatlantic telephone cable service was opened on September 25, 1956. TAT-1 was the first transatlantic telephone cable system. It was laid between Gallanach Bay, near Oban, Scotland and Clarenville, Newfoundland between 1955 and 1956 by the cable ship \"Monarch\". It was inaugurated on September 25, 1956, initially carrying 36 telephone channels.", "prediction 4": "TAT-1 (Transatlantic No. 1) was the first transatlantic telephone cable system. It was laid between Gallanach Bay, near Oban, Scotland, and Clarenville, Newfoundland between 1955 and 1956 by the cable ship Monarch. It was inaugurated on September 25, 1956, initially carrying 36 telephone channels.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 216 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "A transatlantic telecommunications cable is a submarine communications cable connecting one side of the Atlantic Ocean to the other. The first transatlantic telephone cable service was opened on September 25, 1956.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What was the religion in india before hinduism?", "passages": [ [ "Religion in India", "The shrines of some of the most famous saints of Sufism, like Moinuddin Chishti and Nizamuddin Auliya, are found in India, and attract visitors from all over the world.", "India is also home to some of the most famous monuments of Islamic architecture, such as the Taj Mahal and the Qutb Minar.", "Civil matters related to the community are dealt with by the Muslim Personal Law, and constitutional amendments in 1985 established its primacy in family matters.", "Evidence attesting to prehistoric religion in the Indian \"subcontinent\" derives from scattered Mesolithic rock paintings depicting dances and rituals.", "Neolithic pastoralists inhabiting the Indus Valley buried their dead in a manner suggestive of spiritual practices that incorporated notions of an afterlife.", "Other South Asian Stone Age sites, such as the Bhimbetka rock shelters in central Madhya Pradesh and the Kupgal petroglyphs of eastern Karnataka, contain rock art portraying religious rites and evidence of possible ritualised music.", "The Harappan people of the Indus Valley Civilisation, which lasted from 3300 to 1400 BCE and was centered on the Indus and Ghaggar-Hakra river valleys, may have worshiped an important mother goddess symbolising fertility.", "Excavations of Indus Valley Civilisation sites show seals with animals and \"fire\u2011altars\", indicating rituals associated with fire." ], [ "Historical Vedic religion", "Historical Vedic religion\n\nThe historical Vedic religion (also known as Vedism, Brahmanism, Vedic Brahmanism, and ancient Hinduism) refers to the religious ideas and practices among Indo-Aryan-speaking peoples of ancient India after about 1500 BCE.", "These ideas and practices are found in the Vedic texts, and they were one of the major influences that shaped contemporary Hinduism.", "According to the \"Encyclop\u00e6dia Britannica\", in the Hindu tradition and particularly in India, the Vedic religion is considered to be a part of Hinduism.", "According to Heinrich von Stietencron, in the 19th century western publications, the Vedic religion was believed to be different from and unrelated to Hinduism.", "The Hindu religion was thought to be linked to the Hindu epics and the Puranas through sects based on Purohita, Tantras and \"Bhakti\".", "In the 20th-century, a better understanding of the Vedic religion, its shared heritage and theology with contemporary Hinduism, has led scholars to gradually encompass Brahmanism and the Vedic religion into \"Hinduism\".", "The Hindu reform movements and the Neo-Vedanta emphasized the Vedic heritage and \"ancient Hinduism\", and this term has been co-opted by some Hindus.", "Vedic religion is now generally accepted to be a predecessor of Hinduism, but they are not the same because the textual evidence suggests significant differences between the two." ] ], "gold": "The Indus religion in India is thought to be a precursor to Hinduism. The Harappan people of the Indus Valley Civilization, which lasted from 3300 to 1400 BCE and was centered on the Indus and Ghaggar-Hakra river valleys, may have worshiped an important mother goddess symbolizing fertility. Excavations of Indus Valley Civilization sites show seals with animals and \"fire\u2011altars\", indicating rituals associated with fire. A \"linga-yoni\" of a type similar to that which is now worshiped by Hindus has also been found.", "prediction 1": "The prehistoric religion in India dates back to the Indus Valley Civilisation, which lasted from 3300 to 1400 BCE. The Vedic religion refers to the religious ideas and practices among Indo-Aryan-speaking peoples of ancient India after about 1500 BCE. These ideas and practices are found in the Vedic texts, and they were one of the major influences that shaped contemporary Hinduism.\n", "prediction 2": "The prehistoric religion in India is the Indus Valley Civilisation, which lasted from 3300 to 1400 BCE. The Vedic religion refers to the religious ideas and practices among Indo-Aryan-speaking peoples of ancient India after about 1500 BCE, these ideas and practices are found in the Vedic texts, and they were one of the major influences that shaped contemporary Hinduism.", "prediction 3": "New Testament authors list Christianity as the first religion in India before 1200 BCE. The Vedic religion refers to the religious ideas and practices among Indo-Aryan-speaking peoples of ancient India after about 1500 BCE. These ideas and practices are found in the Vedic texts, and they were one of the major influences that shaped contemporary Hinduism.", "prediction 4": "The Hindu religion was thought to be linked to the Hindu epics and the Puranas through sects based on Purohita, Tantras and Bhakti. The Vedic religion is considered to be a predecessor of Hinduism but they are not the same because the textual evidence suggests significant differences between the two. This evidence is found primarily in the Mesolithic rock paintings depicting dances and rituals, burial practices found among indian pastoralists in the Indus Valley infrastructure and fire decoration on animal sacrifices and firealtars indicating rituals associated with fire.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 384 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Harappan people's religion dates back to the Indus Valley Civilization, which lasted from 3300 to 1400 BCE, and was centered on the Indus and Ghaggar-Hakra river valleys, may have worshiped an important mother goddess symbolizing fertility. Excavations of Indus Valley Civilization sites show seals with animals and \"fire\u2011altars\", indicating rituals associated with fire. \n" }, "preference": [ 1, 1, 0, 1, 0, 2 ] }, { "question": "What language do they speak in beijing china?", "passages": [ [ "Beijing dialect", "Beijing dialect\n\nThe Beijing dialect (), also known as Pekingese, is the prestige dialect of Mandarin spoken in the urban area of Beijing, China.", "It is the phonological basis of Standard Chinese, which is the official language in the People's Republic of China and Republic of China and one of the official languages in Singapore.", "Although the Beijing dialect and Standard Chinese are similar, various differences generally make clear to Chinese speakers whether an individual is a native of Beijing speaking the local Beijing variant or is an individual speaking Standard Chinese.", "Dungan language speakers like Iasyr Shivaza and others have reported that Chinese who speak Beijing dialect can understand Dungan, but Dungans could not understand the Beijing Mandarin.", "In fundamental structure, the phonology of the Beijing dialect and Standard Chinese are almost identical.", "In part, this is because the pronunciation of Standard Chinese was based on Beijing pronunciation.", "(See Standard Chinese for its phonology charts; the same basic structure applies to the Beijing dialect.)", "However, some striking differences exist.", "Most prominent is the proliferation of rhotic vowels.", "All rhotic vowels are the result of the use of the - , a noun suffix, except for a few words pronounced that do not have this suffix.", "In Standard Chinese, these also occur but much less often than they appear in Beijing dialect." ], [ "Mandarin Chinese", "Some form of Mandarin has served as a national lingua franca since the 14th century.", "In the early 20th century, a standard form based on the Beijing dialect, with elements from other Mandarin dialects, was adopted as the national language.", "Standard Chinese is the official language of the People's Republic of China and Taiwan and one of the four official languages of Singapore.", "It is used as one of the working languages of the United Nations.", "It is also one of the most frequently used varieties of Chinese among Chinese diaspora communities internationally.", "The English word \"mandarin\" (from Portuguese \"mandarim\", from Malay \"menteri\", from Sanskrit \"mantrin\", meaning \"minister or counsellor\") originally meant an official of the Ming and Qing empires.", "Since their native varieties were often mutually unintelligible, these officials communicated using a Koin\u00e9 language based on various northern varieties.", "When Jesuit missionaries learned this standard language in the 16th century, they called it \"Mandarin\", from its Chinese name \"Gu\u0101nhu\u00e0\" (), or \"language of the officials\".", "In everyday English, \"Mandarin\" refers to Standard Chinese, which is often called simply \"Chinese\".", "Standard Chinese is based on the particular Mandarin dialect spoken in Beijing, with some lexical and syntactic influence from other Mandarin dialects." ] ], "gold": "Mandarin is the language that is spoken in Beijing, China. The Beijing dialect, also known as Pekinese, is the prestige dialect of Mandarin that is spoken in the urban area of Beijing. By the early 20th century, a standard form of Mandarin based on the Beijing dialect, with elements from other Mandarin dialects, was adopted as the national language of China.", "prediction 1": "The Beijing dialect, also known as Pekingese, is the prestige dialect of Mandarin spoken in the urban area of Beijing, China. It is the phonological basis of Standard Chinese, which is the official language of the People's Republic of China and Republic of China and one of the official languages of Singapore. Some form of Mandarin has served as a national lingua franca since the 14th century. In the early 20th century, a standard form based on the Beijing dialect, with elements from other Mandarin dialects, was adopted as the national language. Standard Chinese is the official language of the People's Republic of China and Republic of China and Taiwan. Standard Chinese is also used as one of the most frequently used varieties of Chinese among Chinese diasporaspora communities internationally.", "prediction 2": "The Beijing dialect is the prestige dialect of Mandarin spoken in the urban area of Beijing, China. It is the phonological basis of Standard Chinese, which is the official language in the People's Republic of China and Republic of China and one of the official languages in Singapore. Although the Beijing dialect and Standard Chinese are similar, various differences generally make clear to Chinese speakers whether an individual is a native of Beijing speaking the local Beijing variant or is an individual speaking Standard Chinese.", "prediction 3": "The Beijing dialect is the prestige dialect of Mandarin spoken in the urban area of Beijing, China. Although the Beijing dialect and Standard Chinese are similar, various differences generally make clear to Chinese speakers whether an individual is a native of Beijing speaking the local Beijing variant or is an individual speaking Standard Chinese. For example, Chinese who speak Beijing dialect can understand Dungan, but Dungans could not understand the Beijing Mandarin. Standard Chinese is also one of the most frequently used varieties of Chinese among Chinese diaspora communities internationally.", "prediction 4": "The Beijing dialect is the prestige dialect of Mandarin spoken in the urban area of Beijing, China. Although the Beijing dialect and Standard Chinese are similar, various differences generally make clear to Chinese speakers whether an individual is a native of Beijing speaking the local Beijing variant or is an individual speaking Standard Chinese.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 310 }, { "error type": "Redundant", "explanation": "In the early 20th century, a standard form based on the Beijing dialect, with elements from other Mandarin dialects, was adopted as the national language. ", "start": 551, "end": 660 }, { "error type": "Irrelevant", "explanation": "", "start": 661, "end": 803 } ], "missing-info": [], "corrected-prediction": "The Beijing dialect, also known as Pekingese, is the prestige dialect of Mandarin spoken in the urban area of Beijing, China. In the early 20th century, a standard form based on the Beijing dialect, with elements from other Mandarin dialects, was adopted as the national language. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When was i dont wanna miss a thing released?", "passages": [ [ "I Don't Want to Miss a Thing (album)", "I Don't Want to Miss a Thing (album)\n\n", "I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt.", "His last album for the Decca Records label, \"I Don't Want to Miss a Thing\" produced two singles on the \"Billboard\" Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far.", "This cover was also Chesnutt's biggest crossover, reaching Top 20 on the \"Billboard\" Hot 100.", "Only one other single was released from this album: \"This Heartache Never Sleeps\", which reached #17 on the country charts." ], [ "I Don't Want to Miss a Thing", "I Don't Want to Miss a Thing\n\n\"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film \"Armageddon\" which Steven Tyler's daughter Liv Tyler starred in.", "Written by Diane Warren, the song debuted at number one on the U.S. \"Billboard\" Hot 100 (the first #1 for the band after 28 years together).", "It is one of three songs performed by the band for the film, the other two being \"What Kind of Love Are You On\" and \"Sweet Emotion\".", "The song stayed at number one for four weeks from September 5 to 26, 1998.", "The song also stayed at number 1 for several weeks in several other countries.", "It sold over a million copies in the UK and reached number four on the UK Singles Chart.", "In 1997, Diane Warren was watching Barbara Walters interview James Brolin and Barbra Streisand.", "Brolin said he missed Streisand when they were asleep, and Warren wrote down the words \"I don't want to miss a thing\", before there was even a song.", "\"When I first heard it,\" recalled drummer Joey Kramer, \"it was just a demo with piano and singing." ], [ "Freak on a Leash", "David Fricke described: \"caged-animal babble (the Busta Rhymes-in-Bellevue outburst in \"Freak on a Leash\")...\"", "Yahoo Music! concluded that Davis delves into his own personal demons, in this song present.", "It was rated the sixth-top single of 1999 by \"Spin\".", "It reached number six on the \"Billboard\" Modern Rock Tracks chart and number ten on the Mainstream Rock Tracks chart, and was successful on the Hot 100 charting number 89.", "It was also immensely popular in Australia where the single was certified Gold for shipments in excess of 35,000 units.", "The song appeared on VH1's list of the \"40 Greatest Metal Songs\" at number twenty-three.", "The music video debuted at number eight on MTV's \"Total Request Live\" on February 9, 1999, and peaking at number 1 on its thirteenth day, February 25. and spent ten non-consecutive days at the top position until its \"retirement\", on May 11, 1999.", "It won the Grammy Award for Best Short Form Music Video and the 1999 Metal Edge Readers' Choice Award for \"Music Video of the Year\".", "It was also nominated for nine 1999 MTV Video Music Awards, including Best Direction.", "It won two, Best Rock Video and Best Editing." ] ], "gold": "There was both a song and an album entitled I Don't Want to Miss a Thing. The song, which was by hard rock band Aerosmith and from the 1998 film Armageddon, was released in the US on August 18, 1998, and released in the UK on August 31, 1998. The song was covered by American country music singer Mark Chesnutt for his album of the same name, which was released on February 9, 1999.", "prediction 1": "I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt. His last album for the Decca Records label, \"I Don't Want to Miss a Thing\" produced two singles on the \"Billboard\" Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far. The song stayed at number one for four weeks from September 5 to 26, 1998. It was written by Diane Warren, and stayed at number one for several weeks in several other countries. It sold over a million copies in the UK and reached number four on the UK Singles Chart. The music video debuted at number eight on MTV's \"Total Request Live\" on February 9, 1999, peaking at number 1 on its thirteenth day, February 25 and spent", "prediction 2": "I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt. His last album for the Decca Records label, I Don't Want to Miss a Thing produced two singles on the Billboard Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far. Only one other single was released from this album: \"This Heartache Never Sleeps\", which reached number 17 on the country charts.", "prediction 3": "I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt. His last album for the Decca Records label, I Don't Want to Miss a Thing produced two singles on the Billboard Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far. In 1999, the music video for the song was released on MTV's Total Request Live on February 9, 1999. The song reached number one on the U.S.S.Billboard Hot 100, and stayed at number 1 for four weeks from September 5 to 26, 1998. The cover was also the final Number One on the country charts, becoming the final Number One of his career thus far. The song sold over a million copies in Europe and reached number four on the UK Singles Chart", "prediction 4": "I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt. His last album for the Decca Records label, \"I Don't Want to Miss a Thing\" produced two singles on the Billboard Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far. This cover was also Chesnutt's biggest crossover, reaching Top 20 on the Billboard Hot 100, reaching Number One on the country charts, becoming the final Number One of his career thus far. This cover was also Chesnutt's biggest crossover, reaching Top 20 on the Billboard Hot Country Songs chart, reaching #17 on the country charts. Only one other single was released from this album: This Heartache Never Sleeps, which reached #17 on the country charts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 681, "end": 836 }, { "error type": "Irrelevant", "explanation": "", "start": 414, "end": 488 }, { "error type": "Irrelevant", "explanation": "", "start": 489, "end": 680 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "I Don't Want to Miss a Thing \"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film \"Armageddon\". I Don't Want to Miss a Thing is the eighth studio album released by American country music artist Mark Chesnutt. His last album for the Decca Records label, \"I Don't Want to Miss a Thing\" produced two singles on the \"Billboard\" Hot Country Songs charts, including a cover of the Aerosmith song of the same name, which reached Number One on the country charts, becoming the final Number One of his career thus far. " }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "When did animal crossing wild world come out?", "passages": [ [ "Animal Crossing", "The GameCube iteration allowed players to travel to other villages by trading memory cards written with the game data, but all subsequent installments allow players to travel and interact online via Nintendo Wi-Fi Connection, although \"\" also allows the DS Suitcase to travel to others' towns.", "\"Animal Crossing\" (\u3069\u3046\u3076\u3064\u306e\u68ee, lit.", "\"Animal Forest\") originally released only in Japan for the Nintendo 64 in 2001.", "It was enhanced and released on the GameCube the same year.", "This version was localized and released in North America on September 15, 2002, Australia on October 17, 2003, and Europe on September 24, 2004.", "An extended version titled \"D\u014dbutsu no Mori e+\" was released on June 27, 2003 in Japan.", "The game was released in China in 2006 for iQue Player.", "\"Animal Crossing: Wild World\" (\u304a\u3044\u3067\u3088 \u3069\u3046\u3076\u3064\u306e\u68ee, lit.", "\"Come to Animal Forest\") was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006.", "It was the first game in the series to use Nintendo Wi-Fi Connection." ] ], "gold": "Animal Crossing Wild World came out in Japan on November 23, 2005. Then, in North America, it was released on December 5, 2005. Followed by its release in Australia on December 8, 2005. Finally, in Europe, it was released on March 31, 2006.", "prediction 1": "Animal Crossing: Wild World was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006. It was the first game in the series to use Nintendo Wi-Fi Connection.", "prediction 2": "Animal Crossing: Wild World was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006.", "prediction 3": "Animal Crossing Wild World was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006. It was the first game in the series to use Nintendo Wi-Fi Connection.", "prediction 4": "Animal Crossing: Wild World, the second game in the Animal Crossing series, was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006. It was the first game in the series to use Nintendo Wi-Fi Connection.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 257 } ], "missing-info": [], "corrected-prediction": "Animal Crossing: Wild World was released for the Nintendo DS in Japan on November 23, 2005, North America on December 5, 2005, Australia on December 8, 2005, and Europe on March 31, 2006. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When was the last time olympics was in the us?", "passages": [ [ "Japan at the 2004 Summer Olympics", "Japan at the 2004 Summer Olympics\n\nJapan competed at the 2004 Summer Olympics in Athens, Greece, from 13 to 29 August 2004.", "Japanese athletes have competed at every Summer Olympic Games in the modern era since 1912 except for two editions; it was not invited to the 1948 Summer Olympics in London for its instigation of World War II, and was also part of the US-led boycott of the 1980 Summer Olympics in Moscow.", "The Japanese Olympic Committee sent a total of 306 athletes, 139 men and 167 women, to compete in 27 sports.", "For the first time in its Olympic history, Japan was represented by more female than male athletes.", "Japan left Athens with a total of 37 medals (16 gold, 9 silver, and 12 bronze), finishing fifth in the overall medal rankings.", "This was also the nation's most successful Olympics, winning the largest number of gold and overall medals in non-boycotting games and surpassing three gold medals short of the 1956 Summer Olympics in Melbourne.", "Ten of these medals were awarded to the athletes in judo, eight in swimming, six in wrestling, four in gymnastics, and two each in athletics and synchronized swimming.", "Eight Japanese athletes won more than a single Olympic medal in Athens.", "Japan's team-based athletes came strong and successful in Athens, as the baseball and softball teams managed to produce two bronze medals." ], [ "United States at the 1984 Summer Olympics", "United States at the 1984 Summer Olympics\n\nThe United States was the host nation of the 1984 Summer Olympics in Los Angeles, California.", "It was the nineteenth time that \"Team USA\" participated, having boycotted the 1980 Summer Olympics.", "522 competitors, 339 men and 183 women, took part in 217 events in 25 sports.", "These Olympic Games were unique for the United States in that the host state was California, the home state of the country's president, Ronald Reagan, who himself opened the Games, becoming the first American president to open a Summer Olympics, and also any Olympic games in the United States.", "Reagan was governor of the state from 1967 to 1975.", "It was not until the 2002 Winter Olympics in Salt Lake City that an American president opened a Winter Olympics in the United States.", "The United States topped the medal count for the first time since 1968, winning a record 83 gold medals and surpassing the Soviet Union\u2019s total of 80 golds at the 1980 Summer Olympics.", "Dan Gable Head Coach\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nThe United States returned to archery competition with a dominant men's team that earned the top two spots.", "Their women were not as successful against the newly powerful Asian teams from Korea, China, and Japan, but still managed to place an archer in the top eight." ] ], "gold": "The last time the summer Olympics were held in the US was 1996. The winter Olympics were last hosted by the US in 2002.", "prediction 1": "The last time the Summer olympics was in the US was in 1976. In 1988, the last time the Summer olympics were in the US was in 1984. At the 1984 Summer Olympics, the United States was the host nation.", "prediction 2": "The last time the Summer Olympics were held in the United States was in 2002. The last time the Summer Olympics were in the United States was in 1984. The last time the Summer Olympics were in the United States was in 1984.", "prediction 3": "The United States was the host nation of the 1984 Summer Olympics in Los Angeles, California, and the nineteenth time that \"Team USA\" participated, having boycotted the 1980 Summer Olympics in Moscow. At the 1980 Summer Olympics, the United States won a record 83 gold medals. At the 1984 Summer Olympics, the United States won another record 83 gold medals.", "prediction 4": "The United States was the host nation of the 1984 Summer Olympics in Los Angeles, California. It was the nineteenth time that \"Team USA\" participated, having boycotted the 1980 Summer Olympics in Moscow. It was the first time that Japan participated in the Summer Olympics in the United States and the last time that the Summer Olympics was in the United States.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 60 }, { "error type": "Incoherent", "explanation": "", "start": 61, "end": 69 }, { "error type": "Redundant", "explanation": "the last time the Summer olympics were in the US was in 1984. ", "start": 132, "end": 199 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The last time the Summer Olympics were in the US was in 1984, while the winter Olympics were hosted by the US in 2002." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who wrote the song i'm so fancy?", "passages": [ [ "Fancy (Iggy Azalea song)", "\"Fancy\" was also covered by many artists, such as Anna Kendrick on the 39th season of \"Saturday Night Live\", and received remix versions by rappers such as Da Brat and Lil' Kim.", "\"Fancy\" is a three-minute and 19-second electro-hop song, which was written by Iggy Azalea and Charli XCX.", "The song was also composed and co-produced by the Invisible Men (Jason Pebworth, George Astasio and Jon Shave) and the Arcade (Kurtis Mckenzie).", "The song is played in the key of C minor without any chord progression followed, and Charli XCX's vocals range from G to C.", "It is in common time and is played at a tempo of 95 beats per minute.", "Stabby synths, hip hop chants, and finger snaps are heard in the original mix.", "On 5 December 2013, an unfinished song by Azalea, which surfaced with the title \"Leave It\" was leaked online.", "Azalea later revealed the song was produced by the Invisible Men and the Arcade, whom she collaborated with on her entire album.", "On 5 February 2014, Azalea announced that she would be releasing a new single titled \"Fancy\", featuring English singer-songwriter Charli XCX, later that week." ] ], "gold": "Iggy Azalea and Charli XCX wrote the song Fancy. The Invisible Men members, Jason Pebworth, George Astasio and Jon Shave, as well as The Arcade, Kurtis Mckenzie, also composed and co-produced the song. ", "prediction 1": "Iggy Azalea wrote the song \"Fancy\" with English singer-songwriter Charli XCX. The song was also composed and co-produced by the Invisible Men, Jason Pebworth, George Astasio and Jon Shave, and the Arcade, Kurtis Mckenzie.", "prediction 2": "The song Fancy was written by Iggy Azalea and Charli XCX. The song was also composed and co-produced by the Invisible Men (Jason Pebworth, George Astasio and Jon Shave) and the Arcade (Kurtis Mckenzie). Azalea previously released a song titled \"Leave It\" in 2013.", "prediction 3": "The song I'm so fancy was co-written by Iggy Azalea and Charli XCX for her debut album, Iggy Azalea\u2019s sophomore album, and was produced by the Invisible Men, Jason Pebworth, George Astasio, Jon Shave, Kurtis Mckenzie, and the Arcade.", "prediction 4": "Iggy Azalea wrote the song \"i'm so fancy\" with English singer Charli XCX. The song was co-produced by the Invisible Men and the Arcade and was also composed and co-produced by Jason Pebworth, George Astasio and Jon Shave.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 65 } ], "missing-info": [], "corrected-prediction": "Iggy Azalea wrote the song \"Fancy\" with Charli XCX. The song was also composed and co-produced by the Invisible Men, Jason Pebworth, George Astasio and Jon Shave, and the Arcade, Kurtis Mckenzie." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does elijah first appear on vampire diaries?", "passages": [ [ "Original Vampires (The Vampire Diaries)", "Sage and Finn reunite shortly before his death.", "He is killed in the season 3 episode \"The Murder of One\", when Stefan, Elena and Matt kill him, thinking that it will kill all of the Originals due to their \"linked\" status.", "However, Klaus manages to force Bonnie into unlinking the siblings moments before Finn is killed.", "It is revealed through Finn's death that when an Original dies, all vampires of his or her bloodline die as well.", "As was revealed in the season finale of \"The Originals\", Finn returns along with his mother Esther and brother Kol in another body of a male witch named Vincent.", "He is portrayed by New Zealand actor Daniel Gillies\n\nElijah first appears in episode eight of season two, entitled \"Rose\".", "Elijah is brought into the circle by two vampires named Rose and Trevor.", "They make a deal to be allowed immunity from Elijah and the Originals if they hand over Elena Gilbert, the new Petrova doppelg\u00e4nger.", "It is later revealed that Rose and Trevor were the vampires who failed to keep Katerina Petrova (Katherine Pierce) alive for Klaus to sacrifice in the ritual required to become a vampire/werewolf Hybrid.", "They were subsequently hunted by Klaus and Elijah for centuries." ] ], "gold": "Elijah first appears on Vampire Diaries on November 4, 2010, in episode eight of season two.", "prediction 1": "Elijah first appears in episode eight of season two, entitled \"Rose\".", "prediction 2": "Elijah first appears in episode eight of season two, entitled Rose. It is revealed that Rose and Trevor are the vampires who made a deal to be allowed immunity from Klaus and Elijah if they hand over Elena Gilbert, the new Petrova doppelg\u00e4nger.", "prediction 3": "Elijah first appears in episode eight of season two, entitled \"Rose\". He is brought into the circle by two vampires named Rose and Trevor. They make a deal to be allowed immunity from Klaus and Elijah and the Originals if they hand over Elena Gilbert, the new Petrova doppelg\u00e4nger. It is later revealed that Rose and Trevor were the vampires who failed to keep Katerina Petrova alive for Klaus to sacrifice in the ritual required to become a vampire/werewolf Hybrid.", "prediction 4": "Elijah first appears in episode 8 of season two, entitled \"Rose\".", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Elijah first appears in episode eight of season two, entitled \"Rose\"." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who sang the song i know him so well?", "passages": [ [ "I Know Him So Well", "In the United Kingdom on 18 September 2004, the BBC's \"All-Time Greatest Love Songs\" (hosted by Lionel Richie) saw the duet performed live by Paige and Dickson, together for the first time in 20 years, to a rapturous reception.", "Paige played her solo demo recording of the song on her BBC Radio 2 show, \"Elaine Paige on Sunday\".", "In January 2011 the Official Charts Company released a list of the top 10 All Time Best Selling Duets in which \"I Know Him So Well\" was placed seventh in the chart.", "Paige and Dickson also recorded Spanish-language lyrics for release as \"Lo Creo Conocer\".", "The single was never released though.", "In 1987, a studio version of \"I Know Him", "So Well\" was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, \"Whitney\".", "It was released as a final and 6th single from \"Whitney\" on November 30, 1988 in Australia, Germany, Netherlands, and Spain.", "There was no official music video produced for the Houston duet of song, however there are live performance video-recordings.", "The song version was included in the Whitney Houston North American leg of the Moment of Truth World Tour.", "The single was not promoted as heavily as previous singles from \"Whitney\"." ], [ "I Know Him So Well", "Robert Hilburn of the \"Los Angeles Times\" praised the duet thus: \"The album ends on a graceful, intimate note as Houston is joined by her mother, singer Cissy Houston, on \"I Know Him", "So Well,\" a ballad from the musical \"Chess\".", "Rolling Stone's Vince Alleti criticized the song and production: \"Walden covers all these bases, out-schlocking Masser with \"I Know Him So Well\" \u2014 a genuine if frankly derivative show tune (from Tim Rice's Chess) treated here with deadly reverence...\" \"St. Petersburg Times\" called the duet lifting and praised the mother's role: \"Mom adds a brief, welcome moment of grainy soulfulness to the album.\"", "This single peaked at number 46 in Germany and in the Netherlands it peaked at number 14.", "The single did not appear in the Bubbling Under Hot 100 chart, unlike the 4 previous singles which all reached the Top 10.", "\"I Know Him", "So Well\" was recorded by Peter Kay and Susan Boyle for \"Comic Relief 2011\", with Kay appearing as his alter ego Geraldine McQueen.", "Their version reached number 11 on the UK Singles Chart.", "A spoof music video was also created." ], [ "I Know Him So Well", "\"I Know Him", "So Well\" was also covered by English recording artist Melanie C.", "The song was the first single to be taken from Melanie C's musical theatre-inspired and sixth studio album \"Stages\".", "The song is a duet with Chisholm's fellow Spice Girls group member Emma Bunton.", "The song was released as a single on 11 November 2012.", "The b-side of the single is a cover of \"You'll Never Walk Alone\" from the musical \"Carousel\".", "The music video for the song premiered on YouTube on 12 November 2012.", "These are the formats and track listings of major single releases of \"I Know Him", "So Well\".", "Melanie C and Bunton performed the song on\n\n\nThe song has been covered by other music artists including:" ] ], "gold": "The song I Know Him So Well has been sung by several people. In 1984 it was sang by Elaine Paige and Barbara Dickson. In 1988 it was sang by Whitney Houston and Cissy Houston. Claire Richards, Faye Tozer, and Lisa Scott-Lee of the group Steps, sang it in 2001. Geraldine McQueen played by Peter Kay, and Susan Boyle sang it in 2011. Two members of The Spice Girls, Melanie C. and Emma Bunton sang the song in 2012.", "prediction 1": "In 1987, a studio version of I Know Him So Well was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, Whitney. It was released as a final and 6th single from Whitney on November 30, 1988 in Australia, Germany, Netherlands, and Spain. In 2011, Peter Kay and Susan Boyle recorded a comic relief version of I Know Him So Well, with Kay appearing as his alter ego Geraldine McQueen. Their version reached number 11 on the UK Singles Chart. In 2013, a duet between Melanie C and Emma Bunton sang the song on 10 November 2012. The song was a duet with Chisholm's fellow Spice Girls group member Emma Bunton. In 2012, the song was released as a single on 11 November 2012.", "prediction 2": "In 1987, a studio version of \"I Know Him So Well\" was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, Whitney. It was released as a final and 6th single from Whitney on November 30, 1988 in Australia, Germany, Netherlands and Spain. It was also covered by English recording artist Melanie C for her musical theatre-inspired and sixth studio album Stages. The song was also a duet with English recording artist Emma Bunton for her 2012 album Stages.", "prediction 3": "In 1987, a studio version of I Know Him So Well was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, Whitney. It was released as a final and 6th single from Whitney on November 30, 1988 in Australia, Germany, Netherlands, and Spain. In 2011, Peter Kay and Susan Boyle recorded a version of I Know Him So Well for Comic Relief 2011, with Kay appearing as his alter ego Geraldine McQueen.", "prediction 4": "In 1987, a studio version of \"I Know Him So Well\" was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, \"Whitney\". It was released as a final and 6th single from \"Whitney\" on November 30, 1988 in Australia, Germany, Netherlands, and Spain. Peter Kay and Susan Boyle also recorded the song for comic relief 2011, with Kay appearing as his alter ego Geraldine McQueen. The song was released as a single on 11 November 2012. It was also covered by English recording artist Melanie C. The song was the first single to be taken from Melanie C's musical theatre-inspired and sixth studio album \"Stages\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 280 }, { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 482 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 483, "end": 491 }, { "error type": "Irrelevant", "explanation": "", "start": 649, "end": 712 }, { "error type": "Redundant", "explanation": "a duet between Melanie C and Emma Bunton sang the song on 10 November 2012. ", "start": 568, "end": 648 } ], "missing-info": [], "corrected-prediction": "In 1987, a studio version of I Know Him So Well was recorded as a duet by Cissy Houston and her daughter Whitney Houston for Whitney's second album, Whitney. In 2011, Peter Kay and Susan Boyle recorded a comic relief version of I Know Him So Well, with Kay appearing as his alter ego Geraldine McQueen. Two members of The Spice Girls, Melanie C. and Emma Bunton sang the song in 2012." }, "preference": [ 1, 1, 0, 0, 0, 0 ] }, { "question": "When did the persons case start and end?", "passages": [ [ "The Famous Five (Canada)", "The Famous Five (Canada)\n\nThe Famous Five, or The Valiant Five, () were five Alberta women who asked the Supreme Court of Canada to answer the question, \"Does the word 'Persons' in Section 24 of the British North America Act, 1867, include female persons?\"", "in the case \"Edwards v Canada.\"", "The five women, Emily Murphy, Irene Marryat Parlby, Nellie Mooney McClung, Louise Crummy McKinney and Henrietta Muir Edwards, created a petition to ask this question.", "They fought to have women legally considered persons so that women could be appointed to the Senate.", "The petition was filed on August 27, 1927, and on April 24, 1928, Canada's Supreme Court summarized its unanimous decision that women are not such \"persons\".", "The last line of the judgement reads, \"Understood to mean 'Are women eligible for appointment to the Senate of Canada,' the question is answered in the negative.\"", "This judgement was overturned by the British Judicial Committee of the Privy Council on October 18, 1929.", "This case came to be known as the \"Persons Case\"." ] ], "gold": "The Persons case began on October 19, 1927 and ended on October 18, 1929.", "prediction 1": "The Peoples Case started and ended on the same day. On April 24, 1928, Canada's Supreme Court summarized its unanimous decision that women are not such \"persons\". The British Judicial Committee of the Privy Council overturned this decision on October 18, 1929, and the cases became known as the Persons Case.", "prediction 2": "The Persons Case started and ended in 1927 and 1929, respectively. The case ended when the British Judicial Committee of the Privy Council ruled women are not such persons.", "prediction 3": "The \"Persons Case\" was a case in which five Alberta women asked Canada's Supreme Court to answer the question, \"Does the word 'Persons' in Section 24 of the British North America Act, 1867, include female persons?\" in the case Edwards v Canada. The petition was filed on August 27, 1927, and on April 24, 1928, Canada's Supreme Court summarized its unanimous decision that women are not such \"persons\". This judgement was overturned by the British Judicial Committee of the Privy Council on October 18, 1929.", "prediction 4": "The persons case started and ended on May 25, 1927, and on March 1, 1930, the case ended on May 1, 1930.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 51 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The petition was filed on August 27, 1927, and on April 24, 1928, Canada's Supreme Court summarized its unanimous decision that women are not such \"persons\". The British Judicial Committee of the Privy Council overturned this decision on October 18, 1929, and the cases became known as the Persons Case." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "What is the most current episode of ray donovan?", "passages": [ [ "Ray Donovan", "Ray Donovan\n\nRay Donovan is an American television crime drama series created by Ann Biderman for Showtime.", "The twelve-episode first season premiered on June 30, 2013.", "The pilot episode broke viewership records, becoming the biggest premiere of all time on Showtime.", "Showtime renewed the show for a fourth season, which premiered on June 26, 2016.", "On August 11, 2016, Showtime renewed the show for a fifth season, which premiered on August 6, 2017.", "On October 23, 2017, the series was renewed for a 12-episode sixth season, filmed in New York City, which premiered on October 28, 2018.", "The drama is set in Los Angeles, California, where Irish-American Ray Donovan (Liev Schreiber), originally from South Boston, works for the powerful law firm Goldman & Drexler, representing the rich and famous.", "Donovan is a \"fixer\": a person who arranges bribes, payoffs, threats, and other shady activities, to ensure the outcome desired by the client.", "Good at his job, and no common hood, Ray is normally a devoted family man as well.", "He experiences his own problems when his menacing father, Mickey Donovan (Jon Voight), is unexpectedly released from prison, and the FBI attempts to bring down Ray and his associates.", "The first season was released on DVD and Blu-ray on June 10, 2014." ] ], "gold": "Ray Donovan is an American crime drama television series created by Ann Biderman, which premiered on Showtime on June 30, 2013. The most current episode of Ray Donovan is episode 82, which is titled \"You'll Never Walk Alone\". The episode aired on January 19, 2020.", "prediction 1": "Ray Donovan is an American television crime drama series created by Ann Biderman for Showtime. The twelve-episode first season premiered on June 30, 2013. The pilot episode broke viewership records, becoming the biggest premiere of all time on Showtime. On August 11, 2016, Showtime renewed the show for a fifth season, which premiered on August 6, 2017. On October 23, 2017, the series was renewed for a 6-episode seventh season, filmed in New York City, which premiered on October 28, 2018.\n", "prediction 2": "Ray Donovan is an American television crime drama series created by Ann Biderman for Showtime, which premiered on June 30, 2013 and ran for twelve seasons, finishing with the fifth season on August 6, 2017. It extended for six seasons from August 23, 2017 to March 24, 2019. The most recent episode of Ray Donovan, was titled \"True Crime: The Game Changes\", which premiered on May 30, 2019.", "prediction 3": "Ray Donovan is an American television crime drama series created by Ann Biderman for Showtime. The first season of 12 episodes premiered on June 30, 2013. The pilot episode broke viewership records, becoming the biggest premiere of all time on Showtime. The show was renewed for the fifth season on August 6, 2017. The most recent episode was from Season 6 on October 28, 2018.", "prediction 4": "The American crime drama series Ray Donovan premiered on Showtime on June 30, 2013. The pilot episode broke viewership records, becoming the biggest premiere of all time on Showtime. On August 11, 2016, Showtime renewed the show for a fifth season, which premiered on August 6, 2017. On October 23, 2017, the series was renewed for a sixth season, filmed in New York City, which premiered on October 28, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 402 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 461 } ], "missing-info": [], "corrected-prediction": "Ray Donovan is an American television crime drama series created by Ann Biderman for Showtime. The first season premiered on June 30, 2013. A fifth season, premiered on August 6, 2017. A 6-episode seventh season premiered on October 28, 2018.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who sang a crazy little thing called love?", "passages": [ [ "Crazy Little Thing Called Love", "Crazy Little Thing Called Love\n\n\"Crazy Little Thing Called Love\" is a song by the British rock band Queen.", "Written by Freddie Mercury in 1979, the track is included on their 1980 album \"The Game\", and also appears on the band's compilation album, \"Greatest Hits\" in 1981.", "The song peaked at number two in the UK Singles Chart in 1979, and became the group's first number-one single on the \"Billboard\" Hot 100 in the US in 1980, remaining there for four consecutive weeks.", "It topped the Australian ARIA Charts for seven weeks.", "Having composed \"Crazy Little Thing Called Love\" on guitar, Mercury played rhythm guitar while performing the song live, which was the first time he played guitar in concert with Queen.", "Queen played the song live between 1979 and 1986, and a live performance of the song is recorded in the albums \"Queen Rock Montreal\", \"Queen on Fire \u2013 Live at the Bowl\" , \"Live at Wembley '86\" and \"\" '.", "Since its release, the song has been covered by a number of artists.", "The song was played live on 20 April 1992 during The Freddie Mercury Tribute Concert, performed by Robert Plant with Queen.", "The style of the song was described by author Karl Coryat as rockabilly in his 1999 book titled \"The Bass Player Book\"." ], [ "Crazy Little Thing Called Love", "The UK release had \"We Will Rock You (live)\" as the b-side and America, Australia, Canada had \"Spread Your Wings (live)\".", "Although Mercury would play an acoustic-electric twelve-string Ovation Pacemaker 1615 guitar and later on an electric six-string Fender Telecaster, both owned by May, in the studio he recorded it with a six-string acoustic with external mics.", "Mercury also played the original guitar solo on a version which has been lost.", "American country music singer Dwight Yoakam included a cover of the song on his 1999 album \"\".", "Yoakam's version was released as a single.", "It debuted at number 65 on the US \"Billboard\" \"Hot Country Singles & Tracks\" chart for the week of 1 May 1999, and peaked at number 12 on the US country singles charts that year.", "It was also used in a television commercial for clothing retailer Gap at the time of the album's release.", "The music video was directed by Yoakam.", "This version appears in the movie \"The Break-Up\" (2006), starring Vince Vaughn and Jennifer Aniston." ] ], "gold": "The song Crazy Little Thing Called Love was written by Freddie Mercury and sang by Queen in 1979. Dwight Yoakam released his version of the song in 1999 as a single.", "prediction 1": "Crazy Little Thing Called Love is a song by the British rock band Queen. Written by Freddie Mercury in 1979, the track is included on Queen's 1980 album The Game and also appears on the band's compilation album, Greatest Hits in 1981. American country music singer Dwight Yoakam included a cover of the song on his 1999 album \"\". Yoakam's version was released as a single.", "prediction 2": "\"Crazy Little Thing Called Love\" is a song by the British rock band Queen. Written by Freddie Mercury in 1979, the track is included on their 1980 album, The Game, and also appears on the band's compilation album, Greatest Hits in 1981. Having composed Crazy Little Thing Called Love on guitar, Mercury played rhythm guitar while performing the song live, which was the first time he played guitar in concert with Queen. American country music singer Dwight Yoakam included a cover of the song in his 1999 album, and released as a single.", "prediction 3": "Crazy Little Thing Called Love is a song by the British rock band Queen. It was written by Mercury in 1979 and included on their 1980 album The Game. American country music singer Dwight Yoakam included a cover of the song on his 1999 album.", "prediction 4": "Crazy Little Thing Called Love is a song by the British rock band Queen. Written by Freddie Mercury in 1979, the track is included on their 1980 album The Game, and also appears on the band's compilation album, Greatest Hits in 1981. American country music singer Dwight Yoakam included a cover of the song on his 1999 album \"\". Yoakam's version was released as a single.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 264 } ], "missing-info": [], "corrected-prediction": "Crazy Little Thing Called Love is a song by the British rock band Queen and written by Freddie Mercury in 1979. Dwight Yoakam included a cover of the song on his 1999 album \"\". Yoakam's version was released as a single." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Where did under the tuscan sun take place?", "passages": [ [ "Under the Tuscan Sun (film)", "Under the Tuscan Sun (film)\n\nUnder the Tuscan Sun is a 2003 American romantic comedy drama film written, produced, and directed by Audrey Wells and starring Diane Lane.", "Based on Frances Mayes' 1996 memoir of the same name, the film is about a recently divorced writer who buys a villa in Tuscany on a whim, hoping it will lead to a change in her life.", "The film was nominated for the Art Directors Guild Excellence in Production Design Award, and Diane Lane received a Golden Globe Award nomination for her performance.", "Frances Mayes (Diane Lane) is a San Francisco writer whose seemingly perfect life takes an unexpected turn when she learns that her husband has been cheating on her.", "The divorce\u2014and the loss of her house to her ex-husband and his much-younger, pregnant new partner\u2014leaves her depressed and unable to write.", "Her best friend Patti (Sandra Oh), a lesbian who is expecting a child, is beginning to think Frances might never recover.", "She urges Frances to take an Italian vacation to Tuscany using the ticket she purchased before she became pregnant.", "At first Frances refuses, but after another depressing day in her gloomy apartment, she decides that it's a good idea to get away for a while.", "In Tuscany, her tour group stops in the small town of Cortona." ], [ "Frances Mayes", "Frances Mayes\n\nFrances Mayes is an American university professor, poet, memoirist, essayist, and novelist.", "Born and raised in Fitzgerald, Georgia, Mayes attended Randolph-Macon Woman's College in Lynchburg, Virginia, and obtained her BA from the University of Florida.", "In 1975 she earned her MA from San Francisco State University, where she eventually became Professor of Creative Writing, director of The Poetry Center, and chair of the Department of Creative Writing.", "Mayes has published several works of poetry: \"Climbing Aconcagua\" (1977), \"Sunday in Another Country\" (1977), \"After Such Pleasures\" (1979), \"The Arts of Fire\" (1982), \"Hours\" (1984), and \"Ex Voto\" (1995).", "In 1996 she published the book \"Under the Tuscan Sun: At Home in Italy\".", "The book is a memoir of Mayes buying, renovating, and living in an abandoned villa in rural Cortona in Tuscany, a region of Italy.", "It went to Number One on the \"New York Times\" Best Seller list and remained on the list for over two years.", "In 2003 the film \"Under the Tuscan Sun\" was released.", "Adapted to the screen by director Audrey Wells, the movie was loosely based on Mayes's book." ] ], "gold": "Under the Tuscan Sun is both a book and a film. The story in the film takes place in San Francisco, Tuscany, and Cortona. In the novel, the story details the trials that Frances and her husband Ed had to go through to renovate their Tuscan property, an abandoned villa, Bramasole, in rural Cortona in Tuscany.", "prediction 1": "Under the Tuscan Sun is a 2003 American romantic comedy drama film, written, produced, and directed by Audrey Wells and starring Diane Lane. Based on Frances Mayes' 1996 memoir of the same name, the film is about a recently divorced writer who buys a villa in Tuscany on a whim, hoping it will lead to a change in her life. The film was nominated for the Art Directors Guild Excellence in Production Design Award, and Diane Lane received a Golden Globe Award nomination for her performance.", "prediction 2": "Under the Tuscan Sun is a 2003 American romantic comedy drama film. Based on Frances Mayes' 1996 memoir of the same name, the film is about a recently divorced writer who buys a villa in Tuscany on a whim, hoping it will lead to a change in her life. The film was nominated for the Art Directors Guild Excellence in Production Design Award, and Diane Lane received a Golden Globe Award nomination for her performance. In Tuscany, her tour group stops in the small town of Cortona. The book went to Number One on the New York Times Best Seller list and remained on the list for over two years.", "prediction 3": "Under the Tuscan Sun is a 2003 American romantic comedy drama film written, produced, and directed by Audrey Wells and starring Diane Lane. Based on Frances Mayes' 1996 memoir of the same name, the film is about a recently divorced writer who buys a villa in Tuscany on a whim, hoping it will lead to a change in her life. In the movie, the main characters live in Cortona, Tuscany, Italy.", "prediction 4": "Under the Tuscan Sun is a 2003 American romantic comedy drama film written, produced, and directed by Audrey Wells and starring Diane Lane. Based on Frances Mayes' 1996 memoir of the same name, the film is about a recently divorced writer who buys a villa in Tuscany on a whim, hoping it will lead to a change in her life. The film was nominated for the Art Directors Guild Excellence in Production Design Award, and Diane Lane received a Golden Globe Award nomination for her performance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 61 }, { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 323 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4, 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Under the Tuscan Sun is film that is based on Frances Maye's 1996 memoir of the same name. The film takes place in San Francisco as well as Cortona, Tuscany. The book is a memoir of Mayes buying, renovating, and living in an abandoned villa in rural Cortona in Tuscany." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who wants to be a millionaire current season?", "passages": [ [ "Who Wants to Be a Millionaire (U.S. game show)", "Who Wants to Be a Millionaire (U.S. game show)\n\nWho Wants to Be a Millionaire (often informally called Millionaire) is an American television game show based on the same-titled British program and developed for the United States by Michael Davies.", "The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty (although, for a time, most of the questions were of random difficulty).", "The program has endured as one of the longest-running and most successful international variants in the \"Who Wants to Be a Millionaire?\" franchise.", "The original U.S. version aired on ABC from August 16, 1999, to June 27, 2002, and was hosted by Regis Philbin.", "The daily syndicated version of the show began airing on September 16, 2002, and was hosted for eleven seasons by Meredith Vieira until May 31, 2013.", "Later hosts included Cedric the Entertainer in the 2013\u201314 season, Terry Crews in the following season (2014\u201315), and Chris Harrison, who began hosting on September 14, 2015.", "As the first U.S. network game show to offer a million-dollar top prize, the show made television history by becoming one of the highest-rated game shows in the history of American television." ], [ "Who Wants to Be a Millionaire (U.S. game show)", "The series was nonetheless renewed for the 2015\u201316 season, with various cuts to the show's production budget and a return to the original format (but with only 14 questions).", "Had the show not been renewed, SPE would have placed the show on extended hiatus for three years, reclaimed full rights to the show (without the innovations and format added in the syndicated run, to which DADT owns intellectual property rights), and shopped the revived show to another network or syndicator.", "On January 17, 2017, it was announced that \"Millionaire\" has been renewed through 2018.", "Millionaire was subsequently renewed through the 2018\u201319 season on January 17, 2018.", "Game Show Network (GSN) acquired the rerun rights to the U.S. \"Millionaire\" in August 2003.", "The network initially aired only episodes from the three seasons of the original prime-time run; however, additional episodes were later added.", "These included the \"Super Millionaire\" spin-off, which aired on GSN from May 2005 to January 2007, and the first two seasons of the syndicated version, which began airing on November 10, 2008.", "On December 4, 2017, GSN acquired the rerun rights to the Harrison episodes of \"Millionaire\" (seasons fourteen and fifteen), which began airing December 18, 2017." ] ], "gold": "Who Wants to be A Millionaire is a quiz competition where contestants try to win a top prize of $1,000,000 by answering a series of multiple-choice questions, usually of increasing difficulty. There have been 20 seasons released as of 2020. 21 seasons were in production in 2020.", "prediction 1": "Who Wants to Be a Millionaire is an American television game show based on the same-titled British program and developed for the United States by Michael Davies. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The current season of Who Wants to be a Millionaire began airing on December 18, 2017 and the current season will continue through the 2020 season.", "prediction 2": "The American television game show Who Wants to Be a Millionaire is currently in the 2017 season. In the 2017 season, the show's current episodes are episodes 14 and 15.", "prediction 3": "Who Wants to Be a Millionaire is an American television game show that aired on GSN from December 7, 2017 to January 17, 2018. The current season airs on Wednesdays at 8:00PM and 8:00PM.", "prediction 4": "Who Wants to Be a Millionaire is an American television game show based on the same-titled British program and developed for the United States by Michael Davies. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The current season airs on January 17, 2019 at 8:00 p.m. ET/PT (7:30 p.m. ET/PT).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 485 } ], "missing-info": [], "corrected-prediction": "Who Wants to be A Millionaire is a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Many immigrants move to the united states each year. where do most immigrants come from today?", "passages": [ [ "Witness for Peace", "WFP has expanded its work beyond Nicaragua to other Latin American and Caribbean countries, answering calls from local partners to accompany people affected by U.S. policies and corporate practices.", "WFP currently has international offices in Nicaragua, Mexico, Colombia and also operates in Venezuela and Bolivia.", "WFP maintains a nationwide base of over 20,000 members, and has sent more than 13,000 people to Latin American and the Caribbean on short-term transformative delegations.", "Since its inception, WFP has opposed U.S. military intervention and meddling in Latin America.", "The organization currently seeks to end U.S. military aid and training for the Colombian military.", "WFP also seeks to close the Western Hemisphere Institute for Security Cooperation (WHINSEC), formerly the School of the Americas (SOA), and end all U.S. military training for Latin American militaries as the organization claims this training has been turned against Latin American civilians.", "Since 1990, the organization has sought to influence regional U.S. economic policy, aiming to end free trade and structural adjustment conditions placed on loans from multilateral banks such as the World Bank and the International Monetary Fund.", "The organization supports fair trade policies and unconditioned economic aid." ], [ "Immigration to the United States", "Immigration to the United States\n\nImmigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country.", "Lawful immigration has been a major source of population growth and cultural change throughout much of the U.S. history.", "Because the United States is a settler colonial society, all Americans, with the exception of the small percent of Native Americans, can trace their ancestry to immigrants from other nations around the world.", "In absolute numbers, the United States has a larger immigrant population than any other country, with 47 million immigrants as of 2015.", "This represents 19.1% of the 244 million international migrants worldwide, and 14.4% of the U.S. population.", "Some other countries have larger proportions of immigrants, such as Switzerland with 24.9% and Canada with 21.9%.", "According to the 2016 Yearbook of Immigration Statistics, the United States admitted 1.18 million legal immigrants in 2016.", "Of these, 20% were family-sponsored, 47% were the immediate relatives of U.S. citizens, 12% were employment-based preferences, 4% were part of the Diversity Immigrant Visa program, and 13% were refugees and/or asylum seekers." ], [ "Immigration to the United States", "The remainder included small numbers from several other categories, including those who were granted the Special Immigrant Visa (SIV); persons admitted under the Nicaraguan and Central American Relief Act;", "children born subsequent to the issuance of a parent's visa; and certain parolees from the former Soviet Union, Cambodia, Laos, and Vietnam who were denied refugee status.", "The economic, social, and political aspects of immigration have caused controversy regarding such issues as maintaining ethnic homogeneity, workers for employers versus jobs for non-immigrants, settlement patterns, impact on upward social mobility, crime, and voting behavior.", "Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from areas outside Western Europe.", "Exclusion laws enacted as early as the 1880s generally prohibited or severely restricted immigration from Asia, and quota laws enacted in the 1920s curtailed Eastern European immigration.", "The civil rights movement led to the replacement of these ethnic quotas with per-country limits.", "Since then, the number of first-generation immigrants living in the United States has quadrupled.", "Research suggests that immigration to the United States is beneficial to the U.S. economy.", "With few exceptions, the evidence suggests that on average, immigration has positive economic effects on the native population, but it is mixed as to whether low-skilled immigration adversely affects low-skilled natives." ] ], "gold": "Immigration to the United States is the international movement of non-US nationals to reside permanently in the United States. Between 1921 and 1956, policies were made that limited the number of people allowed to immigrate to the US from areas outside Western Europe. Later, the civil rights movement led to changes in immigration policies, the results of which can be seen today. During 2015, 2016, and 2017, most of the immigrants entering the US came from Mexico and other Latin American countries.", "prediction 1": "Immigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country. Lawful immigration has been a major source of population growth and cultural change throughout much of the U.S. history. Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from areas outside Western Europe. Exclusion laws enacted as early as the 1880s generally prohibited or severely restricted immigration from Asia, and quota laws enacted in the 1920s curtailed Eastern European immigrants.", "prediction 2": "Immigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country. Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from areas outside Western Europe. Exclusion laws enacted as early as the 1880s generally prohibited or severely restricted immigration from Asia, and quota laws enacted in the 1920s curtailed Eastern European immigration. Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from Eastern Europe. Prior to 1965, policies such as the national origins formula limited immigration from areas outside Western Europe.", "prediction 3": "Immigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country. The United States has a larger immigrant population than any other country, with 47 million immigrants as of 2015. This represents 19.1% of the 244 million international migrants worldwide, and 14.4% of the U.S. population. Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from areas outside Western Europe.", "prediction 4": "Immigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country. Approximately 1.4 million legal immigrants moved to the United States in 2016. Of those, 80% were family-sponsored, 47% were the immediate relatives of U.S. citizens, 12% were part of the Diversity Immigrant Visa program, and 13% were refugees and/or asylum seekers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 413, "end": 599 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Immigration to the United States is the international movement of non-U.S. nationals in order to reside permanently in the country. Prior to 1965, policies such as the national origins formula limited immigration and naturalization opportunities for people from areas outside Western Europe. The civil rights movement led to the replacement of these ethnic quotas with per-country limits." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "How many islands are in andaman and nicobar?", "passages": [ [ "Geography of India", "The Lakshadweep Islands lie off the coast of Kerala in the Arabian sea with an area of .", "They consist of twelve atolls, three reefs, and five submerged banks, with a total of about 35 islands and islets.)", "(The Andaman and Nicobar Islands are located between 6\u00b0 and 14\u00b0 north latitude and 92\u00b0 and 94\u00b0 east longitude.", "They consist of 572 islands, lying in the Bay of Bengal near the Myanma coast running in a North-South axis for approximately 910\u00a0km.", "They are located from Kolkata (Calcutta) and from Cape Negrais in Burma.", "The territory consists of two island groups, the Andaman Islands and the Nicobar Islands.", "The Andaman and Nicobar Islands consist of 572 islands which run in a North-South axis for around 910\u00a0km.", "The Andaman group has 325 islands which cover an area of 6,170 km2 (2,382 sq mi) while the Nicobar group has only 247 islands with an area of 1,765 km2 (681 sq mi).", "India's only active volcano, Barren Island is situated here.", "It last erupted in 2017.", "The Narcondum is a dormant volcano and there is a mud volcano at Baratang." ], [ "Nicobar Islands", "Nicobar Islands\n\nThe Nicobar Islands are an archipelagic island chain in the eastern Indian Ocean.", "They are located in Southeast Asia, 150\u00a0km north of Aceh on Sumatra, and separated from Thailand to the east by the Andaman Sea.", "Located 1,300\u00a0km southeast of the Indian subcontinent, across the Bay of Bengal, they form part of the Union Territory of Andaman and Nicobar Islands, India.", "UNESCO has declared the Great Nicobar Island as one of the World Network of Biosphere Reserves.", "The Nicobar Islands cover a land area of 1,841\u00a0km and had a population of 36,844 during the 2011 Census.", "They comprise three distinct groups:\n\nNorthern Group:\n\nCentral Group:\n\nSouthern Group (Sambelong):\n\nIndira Point () is the southernmost point of Great Nicobar Island and also of India itself, lying about 150\u00a0km north of Sumatra, Indonesia.", "The Nicobar Islands are part of a great island arc created by the collision of the Indo-Australian Plate with Eurasia.", "The collision lifted the Himalayas and most of the Indonesian islands, and created a long arc of highlands and islands, which includes the Arakan Yoma range of Burma, the Andaman and Nicobar islands, and the islands off the west coast of Sumatra, including the Banyak Islands and Mentawai Islands." ], [ "Andaman and Nicobar Islands", "The islands' many caves are nesting grounds for the edible-nest swiftlet, whose nests are prized in China for bird's nest soup.", "The territory is home to about 225 species of butterflies and moths.", "Ten species are endemic to these Islands.", "Mount Harriet National Park is one of the richest areas of butterfly and moth diversity on these islands.", "The islands are well known for prized shellfish, especially from the genera \"Turbo\", \"Trochus\", \"Murex\" and \"Nautilus\".", "Earliest recorded commercial exploitation began during 1929.", "Many cottage industries produce a range of decorative shell items.", "Giant clams, green mussels and oysters support edible shellfishery.", "The shells of scallops, clams, and cockle are burnt in kilns to produce edible lime.", "There are 96 wildlife sanctuaries, nine national parks and one biosphere reserve in these islands.", "Census of India, the population of the Union Territory of Andaman and Nicobar Islands was 379,944, of which 202,330 (53.25%) were male and 177,614 (46.75%) were female.", "The sex ratio was 878 females per 1,000 males.", "Only 10% of the population lived in Nicobar islands." ] ], "gold": "Andaman and Nicobar Islands is a union territory of India consisting of 572 islands, of which 38 are inhabited, at the junction of the Bay of Bengal and the Andaman Sea. The Andaman Islands are also home to the Sentinelese people, an uncontacted tribe, they might be the only people currently known to not have reached further than a Paleolithic level of technology, but this is disputed, as evidence of metalwork was found on their island. The Nicobar Islands are an archipelagic island chain, consisting of 22 islands, in the eastern Indian Ocean. They are located in Southeast Asia, 150 km north of Aceh on Sumatra, and separated from Thailand to the east by the Andaman Sea.", "prediction 1": "The Andaman and Nicobar islands consist of 572 islands, lying in the Bay of Bengal near the Myanma coast running in a North-South axis for around 910 km. The Andaman group has 325 islands, covering an area of 6,170 km2 (2,382 sq mi), while the Nicobar group has only 247 islands with an area of 1,765 km2 (681 sq mi).", "prediction 2": "The Andaman and Nicobar Islands consist of 572 islands. The Andaman group has 325 islands which cover an area of 6,170 km2 (2,382 sq mi) while the Nicobar group has only 247 islands with an area of 1,765 km2 (681 sq mi).", "prediction 3": "The Andaman and Nicobar Islands consist of 572 islands and are located in the Bay of Bengal near the Myanma coast running in a North-South axis for approximately 910 km. The Andaman group has 325 islands which cover an area of 6,170 km2 (2,382 sq mi). The Nicobar Islands are an archipelagic island chain in the eastern Indian Ocean.", "prediction 4": "There are 572 islands in the Andaman and Nicobar Islands, a group of archipelagic islands in the eastern Indian Ocean, which are located 1,300 km southeast of the Indian subcontinent. The Andaman group has 325 islands, which cover an area of 6,170 km2 (2,382 sq mi), while the Nicobar group has only 247 islands with an area of 1,765 km2 (681 sq mi). The islands are well known for prized shellfish, especially from the genera \"Turbo\", \"Trochus\", \"Murex\", \"Murex\" and \"Nautilus\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 153 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 317 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "The Andaman and Nicobar islands consist of 572 islands, lying in the Bay of Bengal. The Andaman group has 325 islands while the Nicobar group has only 247 islands. The Nicobar Islands are an archipelagic island chain in the eastern Indian Ocean. They are located in Southeast Asia, 150 km north of Aceh on Sumatra, and separated from Thailand to the east by the Andaman Sea." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What channel is the show saving hope on?", "passages": [ [ "Saving Hope", "Saving Hope\n\nSaving Hope is a Canadian supernatural medical drama television series set in the fictional Hope Zion Hospital in Toronto, Ontario.", "The show's premise originated with Malcolm MacRury and Morwyn Brebner, who are both credited as creators and executive producers.", "The pilot was filmed in Toronto.", "\"Saving Hope\" initially aired from June 7, 2012, to August 3, 2017, on CTV, and on NBC for its first season.", "The protagonist of the show is Dr. Alex Reid (Erica Durance), a doctor whose fianc\u00e9, Dr. Charles Harris (Michael Shanks), is in a coma after a car accident while on his way to their wedding.", "The show follows the life of Charlie in his comatose state and Alex dealing with her patients, all the while hoping that he will survive.", "Dr. Reid is the Chief Surgical Resident while Dr. Harris was the Chief of Surgery until his accident.", "Dr. Harris recovers at the end of season 1, but in subsequent seasons he continues to be able to see the spirits of comatose and dead patients.", "The show also stars Dr. Joel Goran (Daniel Gillies), an orthopedic surgeon and Alex's former lover." ] ], "gold": "Saving Hope is a Canadian supernatural medical drama television series set in Toronto in the fictional hospital Hope Zion. Saving Hope aired on CTV Television Network for five seasons from June 7, 2012 to August 3, 2017, with the first season airing on NBC. ", "prediction 1": "Saving Hope is a Canadian supernatural medical drama television series set in the fictional Hope Zion Hospital in Toronto, Ontario. The show originally aired from June 7, 2012, to August 3, 2017, on CTV, and on NBC for its first season.", "prediction 2": "The Canadian supernatural medical drama television series Saving Hope was originally aired on CTV from June 7, 2012, to August 3, 2017, and on NBC for its first season. The show continues to air on NBC in the United States and Canada.", "prediction 3": "The Canadian supernatural medical drama television series Saving Hope originally aired from June 7, 2012, to August 3, 2017, on CTV, and on NBC for its first season. The show's premise originated with Malcolm MacRury and Morwyn Brebner, who are both credited as creators and executive producers.", "prediction 4": "Saving Hope is a Canadian supernatural medical drama television series set in the fictional Hope Zion Hospital in Toronto, Ontario. It was aired from June 7, 2012, to August 3, 2017, on CTV, and on NBC for its first season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 131 } ], "missing-info": [], "corrected-prediction": "Saving Hope is a Canadian supernatural medical drama television series set in the fictional Hope Zion. The show originally aired from June 7, 2012, to August 3, 2017, on CTV, and on NBC for its first season." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "The first second and third capital city of the united kindom of italy were?", "passages": [ [ "Kingdom of Italy", "Italian society after unification and throughout most of the Liberal Period was sharply divided along class, linguistic, regional and social lines.", "The North-South divide is still present to this day.", "On 20 September 1870, the military forces of the King of Italy overthrew what little was left of the Papal States, capturing in particular the city of Rome.", "The following year, the capital was moved from Florence to Rome.", "For the next 59 years after 1870, the Church denied the legitimacy of the Italian King's dominion in Rome, which it claimed rightfully belonged to the Papal States.", "In 1929, the dispute was settled by the Lateran Treaty, in which the King recognized Vatican City as an independent state and paid a large sum of money to compensate the Church for the loss of the Papal States.", "Liberal governments generally followed a policy of limiting the role of the Roman Catholic Church and its clergy as the state confiscated church lands.", "Similar policies were supported by such anticlerical and secular movements as republicanism, socialism, anarchism, Freemasonry, Lazzarettism and Protestantism.", "Common cultural traits in Italy in this time were social conservative in nature, including a strong belief in the family as an institution and patriarchal values." ], [ "Kingdom of Italy", "Kingdom of Italy\n\nThe Kingdom of Italy () was a state which existed from 1861\u2014when King Victor Emmanuel II of Sardinia was proclaimed King of Italy\u2014until 1946\u2014when a constitutional referendum led civil discontent to abandon the monarchy and form the modern Italian Republic.", "The state was founded as a result of the unification of Italy under the influence of the Kingdom of Sardinia, which can be considered its legal predecessor state.", "Italy declared war on Austria in alliance with Prussia in 1866 and received the region of Veneto following their victory.", "Italian troops entered Rome in 1870, thereby ending more than one thousand years of Papal temporal power.", "Italy entered into a Triple Alliance with Germany and Austria-Hungary in 1882, following strong disagreements with France about the respective colonial expansions.", "However, even if relations with Berlin became very friendly, the alliance with Vienna remained purely formal as the Italians were keen to acquire Trentino and Trieste, corners of Austria-Hungary populated by Italians.", "So in 1915, Italy accepted the British invitation to join the Allied Powers, as the western powers promised territorial compensation (at the expense of Austria-Hungary) for participation that was more generous than Vienna's offer in exchange for Italian neutrality.", "Victory in the war gave Italy a permanent seat in the Council of the League of Nations.", "\"Fascist Italy\" is the era of National Fascist Party government from 1922 to 1943 with Benito Mussolini as head of government." ], [ "Turin", "Turin\n\nTurin (, ; ; , then \"Taurinum\") is a city and an important business and cultural centre in northern Italy.", "It is the capital city of the Metropolitan City of Turin (an administrative division of Italy) and of the Piedmont region, and was the first capital city of Italy from 1861 to 1865.", "The city is located mainly on the western bank of the Po River, in front of Susa Valley, and is surrounded by the western Alpine arch and Superga Hill.", "The population of the city proper is 878,074 (31 July 2018) while the population of the urban area is estimated by Eurostat to be 1.7\u00a0million inhabitants.", "The Turin metropolitan area is estimated by the OECD to have a population of 2.2\u00a0million.", "The city has a rich culture and history, being known for its numerous art galleries, restaurants, churches, palaces, opera houses, piazzas, parks, gardens, theatres, libraries, museums and other venues.", "Turin is well known for its Renaissance, Baroque, Rococo, Neo-classical, and Art Nouveau architecture.", "Many of Turin's public squares, castles, gardens and elegant \"palazzi\" such as the Palazzo Madama, were built between the 16th and 18th centuries.", "A part of the historical center of Turin was inscribed in the World Heritage List under the name Residences of the Royal House of Savoy." ] ], "gold": "The Kingdom of Italy was a state that existed from 1861\u2014when King Victor Emmanuel II of Sardinia was proclaimed King of Italy\u2014until 1946, when civil discontent led an institutional referendum to abandon the monarchy and form the modern Italian Republic.The Metropolitan City of Turin was the first Italian capital from 1861 to 1865. Florence was a centre of medieval European trade and finance and one of the wealthiest cities of that era, and Florence is considered by many academics to have been the birthplace of the Renaissance, and from 1865 to 1871 the city served as the capital of the Kingdom of Italy. Rome is now the capital city of Italy.", "prediction 1": "The Kingdom of Italy was a state which existed from 1861 when King Victor Emmanuel II of Sardinia was proclaimed King of Italy, until 1946, when a constitutional referendum led civil discontent to abandon the monarchy and form the modern Italian Republic. The first two capital cities of the United Kingdom of Italy were Turin and Milan, respectively. The third capital city was Rome, but the first and second capital cities of the United Kingdom of Italy were Naples and Verona, respectively.", "prediction 2": "The Kingdom of Italy was an Italian state which existed from 1861 when King Victor Emmanuel II of Sardinia was proclaimed King of Italy, until 1946 when a constitutional referendum led civil discontent to abandon the monarchy and form the modern Italian Republic. The first capital city was Turin, and the second and third capital cities were Naples, Bologna, and Roma.", "prediction 3": "The first two capital cities of the united kindom of Italy were Turin and Pisa. The third capital city of the united kindom of Italy was Milan. The fourth capital city was Pisa.", "prediction 4": "The Kingdom of Italy was a state which existed from 1861\u2014when King Victor Emmanuel II of Sardinia was proclaimed King of Italy\u2014until 1946\u2014when a constitutional referendum led civil discontent to abandon the monarchy and form the modern Italian Republic. The first two capital cities were Turin and Pisa. The third capital city of the united kindom of Italy was Milan.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 327, "end": 337 }, { "error type": "Unverifiable", "explanation": "", "start": 385, "end": 493 }, { "error type": "Unverifiable", "explanation": "", "start": 352, "end": 384 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Kingdom of Italy was a state which existed from 1861 when King Victor Emmanuel II of Sardinia was proclaimed King of Italy, until 1946, when a constitutional referendum led civil discontent to abandon the monarchy and form the modern Italian Republic. The Metropolitan City of Turin was the first Italian capital from 1861 to 1865. In 1871, the capital of Italy was moved from Florence to Rome. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the pilgrims set sail for america?", "passages": [ [ "Mayflower", "Mayflower\n\nThe Mayflower was an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World in 1620.", "There were 102 passengers, and the crew is estimated to have been about 30, but the exact number is unknown.", "The ship has become a cultural icon in the history of the United States.", "The Pilgrims signed the Mayflower Compact prior to leaving the ship and establishing Plymouth Colony, a document which established a rudimentary form of democracy with each member contributing to the welfare of the community.", "There was a second ship named \"Mayflower\", which made the London to Plymouth, Massachusetts, voyage several times.", "The \"Mayflower\" was a square rig with a beakhead bow and high, castle-like structures fore and aft that served to protect the ship's crew and the main deck from the elements\u2014designs that were typical with English merchant ships of the early 17th century.", "Her stern carried a 30-foot high, square aft-castle which made the ship extremely difficult to sail against the wind and unable to sail well against the North Atlantic's prevailing westerlies, especially in the fall and winter of 1620; the voyage from England to America took more than two months as a result." ], [ "John Howland", "William Bradford, who was the governor of Plymouth Colony for many years, wrote in \"Of Plymouth Plantation\", that Howland was a man-servant of John Carver.", "Carver was the deacon of the Separatists church while the group resided in Leiden, Netherlands.", "At the time the Leiden congregation left the Netherlands, on the \"Speedwell\", Carver was in England securing investments, gathering other potential passengers, and chartering the \"Mayflower\" for the journey to North America.", "John Howland may have accompanied Carver's household from Leiden when the \"Speedwell\" left Delfshaven for Southampton, England, July, 1620.", "Ansel Ames in \"Mayflower and Her Log\", said that Howland was probably kin of Carver's and that he was more likely a steward or a secretary than a servant.", "The Separatists planned to travel to the New World, on the \"Speedwell\" and the \"Mayflower\".", "The \"Speedwell\" proved to be unseaworthy and thus most of the passengers crowded onto the \"Mayflower\".", "The \"Mayflower\" departed Plymouth, England, on September 6/16, 1620.", "The small, 100-foot ship had 102 passengers and a crew of about 30-40 in extremely cramped conditions." ], [ "Mayflower", "They made a new start after the repairs, and they were more than 200 miles (320\u00a0km) beyond Land's End at the southwestern tip of England when \"Speedwell\" sprang another leak.", "It was now early September, and they had no choice but to abandon the \"Speedwell\" and make a determination on her passengers.", "This was a dire event, as the ship had wasted vital funds and was considered very important to the future success of their settlement in America.", "Both ships returned to Plymouth, where some of the \"Speedwell\" passengers joined the \"Mayflower\" and others returned to Holland.", "The \"Mayflower\" then continued on her voyage to America, and the \"Speedwell\" was sold soon afterwards.", "\"Mayflower\" carried 102 passengers plus a crew of 25 to 30 officers and men, bringing the total to approximately 130.", "According to William Bradford, \"Speedwell\" was refitted and \"made many voyages\u2026 to the great profit of her owners.\"", "He also suggested that the \"Speedwell\"'s master used \"cunning and deceit\" to abort the voyage, possibly by causing leaks in the ship and motivated by a fear of starving to death in America.", "In early September, western gales began to make the North Atlantic a dangerous place for sailing." ] ], "gold": "The Mayflower was an English ship that transported a group of English families, known today as the Pilgrims, from England to the New World. Carrying about 65 passengers, the Mayflower left London in mid-July 1620. There she waited for the planned rendezvous on July 22 with the Speedwell, coming from Holland with members of the Leiden congregation. Although both ships planned to depart for America by the end of July, a leak was discovered on Speedwell, which had to be repaired. But the Mayflower sailed from Plymouth alone on September September 6, 1620, with what Bradford called \"a prosperous wind\", and she carried 102 passengers plus a crew of 25 to 30 officers and men, bringing the total aboard to approximately 130.", "prediction 1": "The Mayflower was an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World in 1620. There were 102 passengers, and the crew is estimated to have been about 30, but the exact number is unknown. The voyage from England to America took more than two months as a result.", "prediction 2": "The Mayflower, an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World in 1620, has become a cultural icon in the history of the United States. The ship has become a cultural icon in the history of the United States. The Pilgrims signed the Mayflower Compact prior to leaving the ship and establishing Plymouth Colony, a document which established a rudimentary form of democracy with each member contributing to the welfare of the community. The voyage from England to America took more than two months as a result.", "prediction 3": "The Mayflower was an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World in 1620. There were 102 passengers, and the crew is estimated to have been about 30, but the exact number is unknown.", "prediction 4": "The Mayflower was an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World in 1620. There were 102 passengers, and the crew is estimated to have been about 30, but the exact number is unknown. The ship has become a cultural icon in the history of the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 340 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Mayflower was an English ship that transported the first English Puritans, known today as the Pilgrims, from Plymouth, England, to the New World. There were 102 passengers, and the crew is estimated to have been about 30. The \"Mayflower\" departed Plymouth, England, on September 6/16, 1620." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What size sim card for ipad 4th generation?", "passages": [ [ "IPad Pro", "IPad Pro\n\nThe iPad Pro family is a line of iPad tablet computers designed, developed, and marketed by Apple Inc., that runs the iOS mobile operating system.", "Its current generation is available in two screen sizes, and , each with four options for internal storage capacities: 64, 256, 512 GB, or 1 TB.", "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015.", "It is larger than all previous iPad models and the first iPad tablet to feature LPDDR4 RAM.", "The 12.9-inch tablet was later followed by the smaller 9.7-inch version, which was announced on March 21, 2016, and released on March 31 that same year.", "On June 5, 2017, a second generation of iPad Pro was announced, which features A10X Fusion processors, with basic storage of 64 GB, and optional 512 GB.", "Upgraded displays include a new 10.5-inch version to replace the 9.7-inch model, while the 12.9-inch version was refreshed.", "Following this announcement, the first generation iPad Pros, both 9.7 and 12.9 inch, were discontinued.", "The third generation of iPad Pro was announced on October 30, 2018.", "It is available in two screen sizes: and ." ], [ "IPad Mini 4", "IPad Mini 4\n\nThe iPad Mini 4 (stylized and marketed as iPad mini 4) is the fourth-generation iPad Mini tablet computer designed, developed and marketed by", "Apple Inc.", "It was announced along with the iPad Pro on September 9, 2015, and released the same day.", "The iPad Mini 4, which replaced the iPad Mini 3, is the only iPad Mini currently sold by Apple solely as a 128GB model as of March 21, 2017, when the iPad Mini 2 was discontinued.", "The iPad Mini 4 was announced during the \"Hey Siri\" Apple Special Event on September 9, 2015, alongside other new or refreshed products, including the iPad Pro, the iPhone 6s and the Apple TV.", "However, there was minimal focus directly on the new device, with only a brief mention at the end of the iPad Pro portion of the keynote.", "During Apple's October 2018 keynote CEO Tim Cook mentioned the iPad Mini in the current lineup, possibly hinting that the device is still relevant and that it may eventually see a successor.", "The iPad Mini 4 ships with the iOS 9 operating system pre-installed, and was the first device to do so.", "With an additional 1 GB of RAM compared to the previous generations' Mini, the iPad Mini 4 is capable of utilizing the Slide Over, Split View and Picture in Picture multitasking functions in iOS 9." ], [ "IPad", "On the first generations of the iPad in the U.S., data network access via T-Mobile's network was limited to slower EDGE cellular speeds because T-Mobile's 3G Network at the time used different frequencies.", "The second generation iPad introduced a third tier of models with CDMA support for Verizon Wireless in the United States, available separately from the AT&T capable version.", "The iPad up to the 4th generation uses a Micro-SIM, while the first generation iPad Mini uses a nano-SIM as introduced with the iPhone 5.", "The iPad mini is available with two different frequency bands worldwide.", "Both devices support the same quad-band GSM and quad-band UMTS frequencies, but one variant also supports LTE bands 4 and 17 (principally intended for use on the U.S. AT&T network), while the other adds support for LTE bands 1, 3, 5, 13, 25 and CDMA EV-DO Rev. A and", "Rev. B. The 5th generation iPad and 2nd generation iPad mini introduced support for many additional LTE bands worldwide.", "The iPad Air and Mini with Retina display cellular models come in two variants each, all of which support nano-SIMs, quad-band GSM, penta-band UMTS, and dual-band CDMA EV-DO Rev." ] ], "gold": "The fourth generation iPad Pro is a line of tablet computers designed, developed and marketed by Apple Inc., and includes two models, one with a 12.9 inch and one with a 11 inch screen. The sim card size for the iPad pro 4th generation is Micro-SIM. The iPad Mini 4 is the fourth-generation iPad Mini tablet computer designed, developed and marketed by Apple Inc and was announced and released on September 9, 2015. The sim card size for the iPad mini 4th generation is Nano-SIM.", "prediction 1": "The iPad 4th generation uses a Micro-SIM, while the first-generation iPad Mini uses a nano-SIM as introduced with the iPhone 5.", "prediction 2": "The iPad 4th generation has a Micro-SIM card slot while the iPad mini 4 uses a nano-SIM slot.", "prediction 3": "The iPad 4th generation uses a Micro-SIM card, while the first generation iPad Mini uses a nano-SIM as introduced with the iPhone 5.", "prediction 4": "The fourth-generation iPad uses a Micro-SIM card, while the first generation iPad Mini uses a nano-SIM as introduced with the iPhone 5.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 127 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " IPad Pro The iPad Pro family is a line of iPad tablet computers designed, developed, and marketed by Apple Inc. The iPad 4th generation uses a Micro-SIM. IPad Mini 4 The iPad Mini 4 is the fourth-generation iPad Mini tablet computer designed, developed and marketed by Apple Inc. The sim card size for the iPad mini 4th generation is Nano-SIM." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who plays the voice of the chief in moana?", "passages": [ [ "Moana (2016 film)", "Moana (2016 film)\n\nMoana (), also known as Vaiana or Oceania in some markets, is a 2016 American 3D computer-animated musical adventure film produced by Walt Disney Animation Studios and released by Walt Disney Pictures.", "It is the 56th Disney animated feature film.", "Directed by Ron Clements and John Musker, co-directed by Don Hall and Chris Williams, the film introduces Auli\u02bbi Cravalho as Moana and features the voices of Dwayne Johnson, Rachel House, Temuera Morrison, Jemaine Clement, Nicole Scherzinger, and Alan Tudyk.", "The film features songs written by Lin-Manuel Miranda and Opetaia Foa'i and orchestral score composed by Mark Mancina.", "The film tells the story of Moana, the strong-willed daughter of a chief of a Polynesian village, who is chosen by the ocean itself to reunite a mystical relic with a goddess.", "When a blight strikes her island, Moana sets sail in search of Maui, a legendary demigod, in the hope of returning the heart of Te Fiti and saving her people.", "\"Moana\" was released theatrically in the United States on November 23, 2016 to positive reviews from critics, with particular praise going towards its animation, music, and vocal performances.", "The film went on to gross over $643\u00a0million worldwide." ], [ "Moana (2016 film)", "At that point in time, the design of Moana's face and personality was already complete, and Cravalho's obvious physical resemblance to her character was simply a coincidence.", "During animation production, Disney animators were able to integrate some of Cravalho's mannerisms into Moana's behavior as depicted onscreen.", "The majority of the film's cast members are of Polynesian descent: Auli\u02bbi Cravalho (Moana) and Nicole Scherzinger (Sina, Moana's mother) were born in Hawaii and are of Native Hawaiian heritage; Dwayne Johnson (Maui), Oscar Kightley (Fisherman), and Troy Polamalu (Villager No. 1) are of Samoan heritage; and New Zealand\u2013born Rachel House (Tala, Moana's grandmother), Temuera Morrison (Tui, Moana's father), and Jemaine Clement (Tamatoa) are of M\u0101ori heritage.", "\"Moana\" is Clements and Musker's first fully computer-animated film.", "One of the reasons for using computer animation was that the environment, including the ocean, benefited much more from the use of CGI as opposed to traditional animation." ], [ "Temuera Morrison", "Temuera Morrison\n\nTemuera Derek Morrison (born 26 December 1960) is a New Zealand actor, who first gained recognition for his role as Dr. Hone Ropata on the New Zealand soap opera \"Shortland Street\".", "He gained critical acclaim after starring as Jake \"The Muss\" Heke in the 1994 film \"Once Were Warriors\" and its 1999 sequel \"What Becomes of the Broken Hearted?.\"", "He became known internationally after portraying Jango Fett in \"\" (2002) and Commander Cody in \"\" (2005).", "In addition, he provided the voice of the clone troopers in both films.", "He is also known for voicing Chief Tui, the father of the title character in Disney's\" Moana\" (2016).", "Morrison was born in the town of Rotorua, in the North Island of New Zealand.", "He is the son of Hana Morrison (n\u00e9e Stafford), and musician Laurie Morrison.", "He is of M\u0101ori, Scottish, and Irish descent.", "His sister was performer Taini Morrison and his uncle was musician Sir Howard Morrison.", "His secondary education took place at Wesley College, Auckland, and Western Heights High School, Rotorua.", "Morrison lives in New Zealand, and divides his time between filming there, Australia, and the United States." ] ], "gold": "In the 2016 animated musical film Moana, the character of Tui, chief of Motunui Island, is voiced by Maori-descended actor Temuera Morrison. Tui's singing voice is performed by Broadway star Christopher Jackson.", "prediction 1": "There are multiple characters who voice the chief in Disney's 2016 film Moana. Temuera Morrison voices the father of Moana, the man who is the voice of the chief in the film.", "prediction 2": "Moana is a 2016 American computer-animated musical adventure film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The film stars Aulii Cravalho as Moana, the strong-willed daughter of a chief of a Polynesian village, who is chosen by the ocean itself to reunite a mystical relic with a goddess. Temuera Morrison voices Chief Tui, the father of the title character in Moana.", "prediction 3": "In Moana, the 2016 American computer-animated musical adventure film produced by Walt Disney Animation Studios and released by Walt Disney Pictures, the voice of the chief is played by Temuera Morrison. New Zealand actor Temuera Morrison also voices the character's father, Chief Tui.", "prediction 4": "In Moana, the 2016 American computer-animated musical adventure film, the voice of the chief is played by Temuera Morrison.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 78 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": " Temuera Morrison voices the father of Moana, the man who is the voice of the chief in the animated musical Disney's film \" Moana\" (2016)." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who played the bird lady in mary poppins?", "passages": [ [ "Jane Darwell", "Jane Darwell\n\nJane Darwell (born Patti Woodard, October 15, 1879 \u2013 August 13, 1967) was an American actress of stage, film, and television.", "With appearances in more than one hundred major motion pictures spanning half a century, Darwell is perhaps best-remembered for her poignant portrayal of the matriarch and leader of the Joad family in the film adaptation of John Steinbeck's \"The Grapes of Wrath\", for which she received the Academy Award for Best Supporting Actress, and her role as the Bird Woman in Disney's musical family film, \"Mary Poppins\".", "Darwell has a star on the Hollywood Walk of Fame.", "Born to William Robert Woodard, president of the Louisville Southern Railroad, and Ellen Booth Woodard in Palmyra in Marion County in northeastern Missouri, she originally intended to become a circus rider, then later an opera singer.", "Her father objected, however, and she compromised by becoming an actress but changed her name to \"Darwell\" to avoid sullying the family name.", "The Jane Darwell Birthplace was added to the National Register of Historic Places in 1984.", "Some sources give Darwell's birth name as Patti Woodward." ], [ "Feed the Birds", "Eventually and reluctantly, Travers acquiesced to the American songwriters' supplying the film's soundtrack.", "Robert Sherman recalled:\nThe song was regarded as one of Walt Disney's favorite songs.", "Sherman also comments:\n\nTony Brown related additional Sherman comments about the song and its role in \"Mary Poppins\":\n\nWalt Disney World and Richard Sherman's son Gregg concurred with Brown's account.", "However, \"The Bird Woman\" was chapter 7 in the first book, \"Mary Poppins\", not in the second book, \"Mary Poppins Comes Back\".", "The song was sung by the movie's star Julie Andrews to visuals of the elderly bird woman of the song.", "Walt Disney himself made the unusual request that the bird woman, though a non-speaking part (except for one line, stating the first line of the song's chorus) be a cameo by one of his favorite character actresses, Academy Award winner Jane Darwell (perhaps best remembered for playing Henry Fonda's mother in the 1940 movie, The Grapes of Wrath).", "In her mid-eighties and semi-retired from acting (she took episodic guest appearances about once per year in television shows), Darwell had recently moved into the Motion Picture Country Home because of her advanced age and feebleness.", "Needing neither the money nor the screen credit, she declined the role." ], [ "Mary Poppins (film)", "Mary Poppins (film)\n\nMary Poppins is a 1964 American musical fantasy film directed by Robert Stevenson and produced by Walt Disney, with songs written and composed by the Sherman Brothers.", "The screenplay is by Bill Walsh and Don DaGradi, based on P. L. Travers's book series \"Mary Poppins\".", "The film, which combines live-action and animation, stars Julie Andrews in her feature film debut as Mary Poppins, who visits a dysfunctional family in London and employs her unique brand of lifestyle to improve the family's dynamic.", "Dick Van Dyke, David Tomlinson, and Glynis Johns are featured in supporting roles.", "The film was shot entirely at the Walt Disney Studios in Burbank, California using painted London background scenes.", "\"Mary Poppins\" was released on August 27, 1964, to critical acclaim.", "It received a total of 13 Academy Awards nominations, including Best Picture \u2013 a record for any other film released by Walt Disney Studios \u2013 and won five; Best Actress for Andrews, Best Film Editing, Best Original Music Score, Best Visual Effects, and Best Original Song for \"Chim Chim Cher-ee\".", "In 2013, the film was selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant\"." ], [ "Julia Sutton (actress)", "Julia Sutton (actress)\n\nJulia Sutton is an English actress and singer.", "She appeared in the film \"Half a Sixpence\", the second series of \"Albert and Victoria\", \"Upstairs, Downstairs\", \"Dixon of Dock Green\", and \"Father Brown\".", "Sutton has appeared on stage as Nancy in Oliver!, Mme.", "Dindon in La Cage aux Folles Hortense in \"Martin Guerre\" (1995) and as The Bird Women in \"Mary Poppins\" (2004\u201305) and Sister Mary Lazarus in Sister Act the Musical at The London Palladium.", "She appeared in the TV musical \"Pickwick\" for the BBC in 1969.", "She has also made many appearances on BBC TV's The Good Old Days." ], [ "Mary Poppins (musical)", "Mary Poppins (musical)\n\nMary Poppins is a musical with music and lyrics by Richard M. Sherman and Robert B. Sherman (aka the Sherman Brothers,) with additional music and lyrics by George Stiles and Anthony Drewe, and a script by Julian Fellowes.", "The musical is based on the similarly titled Mary Poppins children's books by P. L. Travers and the 1964 Disney film, and is a fusion of various elements from the two.", "Produced by Cameron Mackintosh and Walt Disney Theatrical and directed by Richard Eyre with co-direction from Matthew Bourne who also acted as co-choreographer with Stephen Mear, the original West End production opened in December 2004 and won two Olivier Awards, one for Best Actress in a Musical and the other for Best Theatre Choreography.", "A Broadway production with a near-identical creative team opened on November 16, 2006, with only minor changes from the West End version.", "It has received seven Tony Award nominations, including Best Musical, and winning for Best Scenic Design.", "The original Broadway production closed on March 3, 2013, after 2,619 performances.", "Since then the amateur rights have become available for the musical through Musical Theatre International, and has been a popular choice for schools and community theatres to produce due to the popularity of the film and books.", "In 1993, theatrical producer Cameron Mackintosh met P.L." ] ], "gold": "In the 1964 Disney film Mary Poppins, the Bird Woman of St Paul's Cathedral Square is a character who sells bags of bread crumbs to passers-by to feed the pigeons, and it is played by American actress Jane Darwell. It is a role she had originally turned down, but Walt Disney personally drove to her retirement home and insisted she take the job. In the 2004 London Musical Version of Mary Poppins based on the film, the role was played by English actress and singer Julia Sutton. There were many other actresses who played the role in different versions of Mary Poppins, including Cass Morgan, in the 2006 Broadway version of Mary Poppins, Mary Van Arsdel, in the 2009 US tour of Mary Poppins, and Valda Aviks, in the 2008 UK tour of Mary Poppins. ", "prediction 1": "Mary Poppins is a 1964 American musical fantasy film directed by Robert Stevenson and produced by Walt Disney, with songs written and composed by the Sherman Brothers. The film stars Julie Andrews in her feature film debut as Mary Poppins, who visits a dysfunctional family in London and employs her unique brand of lifestyle to improve the family's dynamic. The bird woman in the film was played by Academy Award winner Jane Darwell. In the film, Julia Sutton played the bird woman.\n", "prediction 2": "Mary Poppins is a 1964 American musical fantasy film combining live-action and animation. It stars Julie Andrews in her feature film debut as Mary Poppins, who visits a dysfunctional family in London and employs her unique brand of lifestyle to improve the family's dynamic. In the film, the bird lady is played by actresses Julia Sutton and Catherine Lanchester. In the television show Mary Poppins, Angela Wolfe played the part of the bird lady.", "prediction 3": "Mary Poppins is a 1964 American American musical fantasy film combining live-action and animation. The film stars Julie Andrews in her feature film debut as Mary Poppins, who visits a dysfunctional family in London and employs her unique brand of lifestyle to improve the family's dynamic. The Bird Woman was played by Academy Award winner Jane Darwell. Elle Macpherson played the part for the film, Sarah Palin played the part for the animated version, and Judy Garland played the role for the animated version.", "prediction 4": "The Bird Woman in Mary Poppins is a 1964 American musical fantasy film starring Julie Andrews in her feature film debut as Mary Poppins. The scene of the bird lady was originally seen in the 1961 film Feed the Birds, but that was removed from the movie due to its song being 14 minutes long. The part was subsequently reprised numerous times in the 1964 film with Julia Sutton playing the part of the bird lady.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 358 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[4]}", "start": 435, "end": 447 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Mary Poppins is a 1964 American musical fantasy film produced by Walt Disney. The bird woman in the film was played by Academy Award winner Jane Darwell, who Walt Disney himself requested. She was living in a retirement home and she had turned down roll initially. On stage, English actress and singer Julia Sutton played the bird woman in 2004.\n" }, "preference": [ 1, 1, 1, 0, 0, 2 ] }, { "question": "When did south africa became a member of the commonwealth?", "passages": [ [ "Member states of the Commonwealth of Nations", "Known as the \"British Commonwealth\", the original members were the United Kingdom, Canada, Australia, New Zealand, South Africa, Irish Free State, and Newfoundland, although Australia and New Zealand did not adopt the statute until 1942 and 1947 respectively.", "In 1949, the London Declaration was signed and marked the birth of the modern Commonwealth and the adoption of its present name.", "The newest member is Rwanda, which joined on 29 November 2009.", "The most recent departure was the Maldives, which severed its connection with the Commonwealth on 13 October 2016.", "As of April 2017, of the states that are members of the Commonwealth of Nations, three are in Europe, twelve in North America and the Caribbean, one in South America, nineteen in Africa, seven in Asia, and eleven in Oceania.", "There are seven former members, four of which no longer exist as independent entities (but form part of current member states).", "The members have a combined population of 2.4 billion, almost a third of the world population, of whom 1.21 billion live in India, and 95% live in Asia and Africa combined.", "Currently sixteen of the member states are Commonwealth realms, with the Head of the Commonwealth as their head of state.", "Five others are monarchies with their own individual monarchs (Brunei, Eswatini, Lesotho, Malaysia, Tonga) and the rest are republics." ], [ "Member states of the Commonwealth of Nations", "Member states of the Commonwealth of Nations\n\nThe Commonwealth of Nations is a voluntary association of 53 sovereign states.", "Nearly all of them are former British colonies or dependencies of those colonies.", "No one government in the Commonwealth exercises power over the others, as is the case in a political union.", "Rather, the Commonwealth is an international organisation in which countries with diverse social, political, and economic backgrounds are regarded as equal in status, and cooperate within a framework of common values and goals, as outlined in the Singapore Declaration issued in 1971.", "Such common values and goals include the promotion of democracy, human rights, good governance, the rule of law, individual liberty, egalitarianism, free trade, multilateralism, and world peace, which are promoted through multilateral projects and meetings, such as the Commonwealth Games, held once every four years.", "The symbol of this free association is Queen Elizabeth II, who serves as the Head of the Commonwealth.", "This position, however, does not imbue her with any political or executive power over any Commonwealth member states; the position is purely symbolic, and it is the Commonwealth Secretary-General who is the chief executive of the Commonwealth.", "The Commonwealth was first officially formed in 1931 when the Statute of Westminster gave legal recognition to the sovereignty of dominions." ], [ "South Africa", "As a concession to the Westminster system, the presidency remained parliamentary-appointed and virtually powerless until P. W. Botha's Constitution Act of 1983, which eliminated the office of Prime Minister and instated a near-unique \"strong presidency\" responsible to parliament.", "Pressured by other Commonwealth of Nations countries, South Africa withdrew from the organisation in 1961, and rejoined it only in 1994.", "Despite opposition both within and outside the country, the government legislated for a continuation of apartheid.", "The security forces cracked down on internal dissent, and violence became widespread, with anti-apartheid organisations such as the African National Congress (ANC), the Azanian People's Organisation (AZAPO), and the Pan-Africanist Congress (PAC) carrying out guerrilla warfare and urban sabotage.", "The three rival resistance movements also engaged in occasional inter-factional clashes as they jockeyed for domestic influence.", "Apartheid became increasingly controversial, and several countries began to boycott business with the South African government because of its racial policies.", "These measures were later extended to international sanctions and the divestment of holdings by foreign investors.", "In the late 1970s, South Africa initiated a programme of nuclear weapons development.", "In the following decade, it produced six deliverable nuclear weapons." ], [ "Foreign relations of South Africa", "South Africa was a Dominion of the British Empire and the Commonwealth from 1910 until 1961.", "South Africa was a republic outside the Commonwealth from 1961 to 1994, then it became a Commonwealth republic on 1 June 1994." ] ], "gold": "The Commonwealth is a voluntary organization which formed in 1926 with original member countries being the United Kingdom, Canada, Australia, New Zealand, South Africa, Irish Free State, and Newfoundland. In 1949, the London Declaration marked the birth of the modern Commonwealth and the adoption of its present name. South Africa first became a member of the Commonwealth on 19 November 1926. It withdrew from the organization in 1961, but rejoined on 1 June 1994.", "prediction 1": "South Africa became a member of the Commonwealth of Nations in 1994, after being outside the organisation from 1961 and rejoining it in 1994.", "prediction 2": "South Africa was a republic outside the Commonwealth from 1961 to 1994, then it became a Commonwealth republic on 1 June 1994. The Commonwealth was first officially formed in 1931 when the Statute of Westminster gave legal recognition to the sovereignty of dominions. South Africa withdrew from the organisation in 1961 and rejoined it only in 1994, despite pressured by other Commonwealth of Nations countries.", "prediction 3": "The Commonwealth of Nations is a voluntary association of 53 sovereign states in which countries with diverse social, political, and economic backgrounds are regarded as equal in status, and cooperate within a framework of common values and goals, as outlined in the Singapore Declaration issued in 1971. South Africa became a Commonwealth republic on 1 June 1994 after withdrawing from the organisation in 1961.", "prediction 4": "The Commonwealth of Nations is an international organisation in which countries with diverse social, political, and economic backgrounds are regarded as equal in status, and cooperate within a framework of common values and goals, as outlined in the Singapore Declaration issued in 1971. South Africa became a member of the Commonwealth in 1994, but withdrew from the organisation in 1961, and rejoined it only in 1994.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Commonwealth is a voluntary organization which formed in 1926 with original member countries being the United Kingdom, Canada, Australia, New Zealand, South Africa, Irish Free State, and Newfoundland. In 1949, the London Declaration was signed and marked the birth of the modern Commonwealth and the adoption of its present name. South Africa became a member of the Commonwealth of Nations in 1994, after being outside the organization from 1961 and rejoining it in 1994." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When did winnipeg jets come back to winnipeg?", "passages": [ [ "Atlanta Thrashers", "Atlanta Thrashers\n\nThe Atlanta Thrashers were a professional ice hockey team based in Atlanta.", "Atlanta was granted a franchise in the National Hockey League (NHL) on June 25, 1997, and became the League's 28th franchise when it began play in the 1999\u20132000 season.", "They were members of the Southeast Division of the NHL's Eastern Conference, and played their home games at Philips Arena in downtown Atlanta.", "The Thrashers qualified for the Stanley Cup playoffs only once, during the 2006\u201307 season in which they won the Southeast Division, but were swept in the first round by the New York Rangers.", "In May 2011, the Thrashers were sold to Canadian-based ownership group True North Sports & Entertainment.", "The group moved the franchise to Winnipeg, Manitoba, which became the second incarnation of the Winnipeg Jets.", "The sale and relocation were approved by the NHL on June 21, 2011.", "With the sale and relocation of the team, Atlanta became the first city in the NHL's modern era to have two ice hockey teams relocate to different cities.", "In both cases, the team moved from Atlanta to Canada; the city's previous NHL team (the Atlanta Flames) moved to Calgary, Alberta, in 1980 to become the Calgary Flames." ], [ "Winnipeg Jets", "The team also retained Marcel Comeau, the director of amateur scouting.", "On June 12, 2011, Cheveldayoff had Thrashers Head Coach Craig Ramsay reinterview for his position, then formally dismissed him as head coach eight days later.", "Claude Noel, who had been the head coach of the Manitoba Moose, was named head coach four days later; the other finalist for the job had been Chicago Blackhawks Assistant Coach Mike Haviland.", "Charlie Huddy, Pascal Vincent and Wade Flaherty, formerly of the Dallas Stars and Blackhawks, were named Noel's assistant coaches.", "The Jets made their formal regular season debut on October 9, 2011, when a sellout crowd at the MTS Centre saw the visiting Montreal Canadiens defeat the Jets 5\u20131, with Nik Antropov scoring the first-ever Jets goal.", "This debut featured a concert by Bachman\u2013Turner Overdrive where Randy Bachman sang \"We Just Got Back The Jets\" in place of the title refrain of \"You Ain't Seen Nothing Yet\"." ], [ "Winnipeg Jets", "Kane had worn the number 9 during his time with the Thrashers, and the Jets organization encouraged him to keep the number.", "The Jets traded Kane to the Buffalo Sabres in February 2015.", "Andrew Copp has worn the number 9 since 2015.", "Number 25, retired by the original Jets in honour of Thomas Steen, was attributed to Paul Stastny, a close friend of Steen's son, Alex.", "Stastny has chosen the number partly because of Steen.", "Zach Redmond wore the number during his time with the team.", "Bryan Little switched from number 10, which he wore in Atlanta, to number 18 out of respect for Dale Hawerchuk, who had worn number 10 with the original Jets.", "Number 11 has not been issued since the death of Rick Rypien prior to the 2011-12 season.", "The Jets still wear stickers bearing the number on their helmets to this day.", "Number 37 was not issued by the Atlanta/Winnipeg franchise between 2003 and 2016 following the death of player Dan Snyder in 2003.", "Goaltender Connor Hellebuyck has worn the number since 2016, with the blessing of the Snyder family.", "The NHL retired Wayne Gretzky's No. 99 for all its member teams at the 2000 NHL All-Star Game." ] ], "gold": "In May 2011, Canadian-based ownership group True North Sports & Entertainment bought the professional ice hockey team the Atlanta Thrashers and moved the franchise to Winnipeg, where it became the second incarnation of the Winnipeg Jets. The sale and relocation were approved by the NHL prior to the 2011-12 season, and the Jets played their first game back in Winnipeg on 10/09/2011 to a sellout crowd at the MTS Centre.", "prediction 1": "The Winnipeg Jets were originally based in Atlanta, Georgia, but were sold to Canadian-based ownership group True North Sports & Entertainment in May 2011. The sale and relocation of the team was approved by the NHL on June 21, 2011. On October 9, 2011, the Winnipeg Jets made their formal regular season debut, when a sellout crowd at the MTS Centre saw the visiting Montreal Canadiens defeat the Jets 5\u20131.", "prediction 2": "The Winnipeg Jets are a professional ice hockey team based in Winnipeg, Manitoba. The team started play on October 9, 2011, after being traded from the Atlanta Thrashers to the Winnipeg Moose. After the sale and relocation of the team, the Winnipeg Jets made their formal regular season debut on October 9, 2011.", "prediction 3": "The Winnipeg Jets were originally based in Atlanta. They were granted a franchise in the National Hockey League (NHL) on June 25, 1997, and became the League's 28th franchise when it began play in the 1999\u20132000 season. The team moved to Winnipeg, Manitoba in May 2011 under the ownership of Canadian-based True North Sports & Entertainment. They made their formal regular season debut on October 9, 2011.", "prediction 4": "The Winnipeg Jets were established in 2010 and were based in Winnipeg, Manitoba. They came back to winnipeg on October 9, 2011 after being relocated from the Atlanta Thrashers to the Winnipeg Moose. The team made its formal regular season debut on October 9, 2011 when a sellout crowd at the MTS Centre saw the visiting Montreal Canadiens defeat the Jets 5\u20131.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 351, "end": 407 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Winnipeg Jets were sold to Canadian-based ownership group True North Sports & Entertainment in May 2011. The group moved the franchise to Winnipeg, Manitoba, which became the second incarnation of the Winnipeg Jets. The sale and relocation of the team was approved by the NHL on June 21, 2011. On October 9, 2011, the Winnipeg Jets made their formal regular season debut, when a sellout crowd at the MTS Centre." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does the movie the notebook take place?", "passages": [ [ "The Notebook (novel)", "The Notebook (novel)\n\n", "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks, The novel was later adapted into a popular film of the same name, in 2004.", "The Indian Bollywood film, \"Zindagi Tere Naam,\" starring Mithun Chakraborty, is also based on it.", "This was Nicholas Sparks' first published novel.", "It was the third written after \"The Passing\" and \"The Royal Murders\", which he did not publish.", "He wrote it over a period of six months in 1994.", "Literary agent Theresa Park discovered Sparks by picking the book out of her agency's slush pile and reading it.", "Park offered to represent him.", "In October 1995, Park secured a $1 million advance for the book from the Time Warner Book Group, and the novel was published in October 1996.", "It was on \"The New York Times Best Seller list\" in its first week of release.", "\"The Notebook\" was a hardcover best seller for more than a year.", "In interviews, Sparks said he was inspired to write the novel by the grandparents of his wife, who had been married for more than 60 years when he met them.", "In \"The Notebook,\" he tried to express the long romantic love of that couple.", "The novel opens with Noah Calhoun, an old man, reading to a woman in a nursing home." ], [ "The Notebook", "The Notebook\n\nThe Notebook is a 2004 American-Canadian romantic drama film directed by Nick Cassavetes and based on Nicholas Sparks's 1996 novel of the same name.", "The film stars Ryan Gosling and Rachel McAdams as a young couple who fall in love in the 1940s.", "Their story is narrated from the present day by an elderly man (portrayed by James Garner) telling the tale to a fellow nursing home resident (played by Gena Rowlands, who is Cassavetes's mother).", "\"The Notebook\" received generally mixed reviews, but performed well at the box office and received a number of award nominations, winning eight Teen Choice Awards, a Satellite Award, and an MTV Movie Award.", "The film became a sleeper hit and has gained a cult following.", "On November 11, 2012, ABC Family premiered an extended version with deleted scenes added back into the original storyline.", "At a modern-day nursing home, an elderly man, Duke, reads a romantic story from his notebook to a fellow patient.", "In 1940, Seabrook Island, South Carolina, poor quarry worker Noah Calhoun sees 17-year-old heiress Allison \"Allie\" Hamilton at a carnival and they have a summer love affair.", "Noah takes Allie to an abandoned house that he intends to buy for them." ], [ "Kabir Singh", "Kabir Singh\n\nKabir Singh is an upcoming Indian Hindi-language drama film written and directed by Sandeep Vanga.", "It is a remake of his own Telugu film \"Arjun Reddy\" (2017).", "Jointly produced by Cine1 Studios and T-Series, the film stars Shahid Kapoor and Kiara Advani.", "Principal photography began in October 2018, and the film is scheduled for a theatrical release on 21 June 2019.", "Kabir Singh, an alcoholic surgeon with anger management issues, goes on a self-destructive path after his ex-lover marries someone else.", "After the success of the Telugu film \"Arjun Reddy\" (2017), its writer and director Sandeep Vanga wanted to remake it in Hindi with Ranveer Singh.", "When it did not work out, he approached Shahid Kapoor.", "However, producers Murad Khetani and Ashwin Varde of Cine1 Studios, who acquired the remake rights for Hindi, wanted Arjun Kapoor to play the male lead.", "Disappointed, Vanga said,\"I've come to know that the remake rights of \"Arjun Reddy\" have been sold and it would star Arjun Kapoor.", "I am caught in a dilemma, as I've already locked Shahid for the role.", "It's a very embarrassing situation for me.", "I don't know how I'll face Shahid.\"" ] ], "gold": "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks, which was later adapted into a popular 2004 film of the same name. In the film, set in 1940 at a carnival in Seabrook Island, South Carolina, poor lumber mill worker Noah Calhoun sees 17-year-old heiress Allison \"Allie\" Hamilton, who is spending the summer in town with her parents. He pursues her and they begin a summer romance. Notebook is also a 2019 Indian Hindi-language romantic drama film produced by Salman Khan that was is a remake of the 2014 Thai film The Teacher's Diary, and took place in India.", "prediction 1": "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks. This was his first published novel. The 2004 film adaptation of The Notebook is a romantic comedy-drama directed by Nick Cassavetes, based on Sparks's 1996 novel.", "prediction 2": "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks. The film adaptation took place in the 1940s and takes place in Seabrook Island, South Carolina. Sparks was inspired by the grandparents of his wife, who had been married for more than 60 years when he met them. In the 2004 movie, Nicholas Cassavetes directed the romantic drama, Sparks played Duke, the elderly man who reads to the woman in a nursing home.", "prediction 3": "The 2004 American-Canadian romantic drama film The Notebook is based on the 1996 novel The Notebook by Nicholas Sparks. The film stars Ryan Gosling and Rachel McAdams as a young couple who fall in love in the 1940s. The story is narrated from the present day by an elderly man who is reading a romantic story from his notebook to a fellow nursing home patient. The novel takes place in Seabrook Island, South Carolina. The Hindi-language drama film Kabir Singh takes place in Hyderabad, India.", "prediction 4": "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks, The novel was later adapted into a popular film of the same name, in 2004. The 2004 American-Canadian romantic drama film directed by Nick Cassavetes and based on Nicholas Sparks's 1996 novel of the same name is called The Notebook. In 1940, Seabrook Island, South Carolina, poor quarry worker Noah Calhoun sees 17-year-old heiress Allison \"Allie\" Hamilton at a carnival and they have a summer love affair. In 1940, Seabrook Island, South Carolina, poor quarry worker Noah Calhoun, an elderly man, Duke, reads a romantic story from his notebook to a nursing home. In 1940, Seabrook Island, South Carolina, poor quarry worker Noah Calhoun, an abandoned house that he intends to buy for them.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 238 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Notebook is a 1996 romantic novel by American novelist Nicholas Sparks, The novel was later adapted into a popular film of the same name, in 2004. In 1940, Seabrook Island, South Carolina, poor quarry worker Noah Calhoun sees 17-year-old heiress Allison \"Allie\" Hamilton at a carnival and they have a summer love affair." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Where did the movie proud mary take place?", "passages": [ [ "Proud Mary (film)", "Tom soon figures that Mary really killed Benny.", "He sends her a message to inform her that they have Danny.", "Mary heads over to the warehouse where they're keeping him, and she proceeds to kill every one of Benny and Tom's guys.", "Mary finds Danny and frees him just as Tom finds them.", "Danny runs out, leaving Mary and Tom to fight.", "Mary succeeds and kills Tom with a bullet to the head.", "Mary reunites with Danny outside, and they drive off to another location, described as \"warm and nice\".", "In January 2017, Taraji P. Henson signed on to star in \"Proud Mary\" with Screen Gems still looking to secure a director for an April 2017 principal production start in Boston.", "In February 2017, the film received a January 26, 2018, release date and Babak Najafi signed on to direct.", "On April 5, 2017, the rest of the cast was announced as the film commenced principal production.", "On July 20, 2017, the first official trailer for the film was released along with a teaser poster.", "A new release date of January 12, 2018, was also confirmed." ], [ "Proud Mary (film)", "Proud Mary (film)\n\nProud Mary is a 2018 American action thriller film directed by Babak Najafi, from a screenplay written by John S. Newman and Christian Swegal.", "The film stars Taraji P. Henson, Billy Brown, Danny Glover, Neal McDonough, Xander Berkeley, Margaret Avery, and Jahi Di'Allo Winston, and follows an assassin who must look after a young teenaged boy after a hit job goes wrong.", "\"Proud Mary\" was released on January 12, 2018, by Screen Gems, which was also the film's production company.", "Upon release, the film received negative reviews from critics and grossed $21 million.", "In Boston, Mary (Henson), an expert assassin, kills her target Marcus Miller, a bookie, in his apartment.", "She discovers that Marcus had a son, a young boy named Danny (Jahi Di'Allo Winston), when she finds him in his room playing video games.", "Filled with guilt, Mary takes her leave.", "A year later, Danny is living on his own and has been working for a criminal named Uncle (Berkeley) and Mary has kept a distant eye on him.", "When a drug delivery to Jerome (Burke) goes bad, Danny asks for more money, finds it in a fridge, and takes it to Uncle." ] ], "gold": "The 2018 action thriller film Proud Mary was produced in Boston, where the events of the film take place. The film follows an assassin, played by Taraji P. Henson, who must look after a young teenaged boy after a hit job goes wrong. ", "prediction 1": "Proud Mary is a 2018 American action thriller film directed by Babak Najafi from a screenplay written by John S. Newman and Christian Swegal. The movie takes place in Boston, Massachusetts, but the film's principal production started in April 2017 in Boston.", "prediction 2": "Proud Mary is a 2018 American action thriller film directed by Babak Najafi, from a screenplay written by John S. Newman and Christian Swegal. The movie takes place in Boston, Massachusetts.", "prediction 3": "Proud Mary is a 2018 American action thriller film directed by Babak Najafi, from a screenplay written by John S. Newman and Christian Swegal. It takes place in the Boston area and was shot on location in Massachusetts. The film was filmed in a number of locations, including a warehouse in Boston, Massachusetts, and the streets of Boston, Massachusetts. The movie was filmed in Boston, Massachusetts, and filmed in Toronto.", "prediction 4": "Proud Mary is a 2018 American action thriller film directed by Babak Najafi, from a screenplay written by John S. Newman and Christian Swegal. The movie took place in Boston, Massachusetts. It took place in Atlanta, Georgia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 141 } ], "missing-info": [], "corrected-prediction": "Proud Mary is a 2018 American action thriller film. The movie takes place in Boston, Massachusetts, but the film's principal production started in April 2017 in Boston." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where did the first settlers of hawaii come from?", "passages": [ [ "Native Hawaiians", "Evidence for a Tahitian conquest of the islands include the legends of Hawaiiloa and the navigator-priest Paao, who is said to have made a voyage between Hawaii and the island of \"Kahiki\" (Tahiti) and introduced many customs.", "Early historians, such as Fornander and Beckwith, subscribed to this Tahitian invasion theory, but later historians, such as Kirch, do not mention it.", "King Kalakaua claimed that Pa'ao was from Samoa.", "Some writers claim that other settlers in Hawaii were forced into remote valleys by newer arrivals.", "They claim that stories about the Menehune, little people who built heiau and fishponds, prove the existence of ancient peoples who settled the islands before the Hawaiians.", "At the time of Captain Cook's arrival in 1778, the population is estimated to have been between 250,000 and 800,000.", "Over the span of the first century after first contact, the native Hawaiians were nearly wiped out by diseases introduced to the islands.", "Native Hawaiians had no resistance to influenza, smallpox, measles, or whooping cough, among others.", "The 1900 U.S. Census identified 37,656 residents of full or partial native Hawaiian ancestry." ], [ "Native Hawaiians", "Native Hawaiians\n\nNative Hawaiians (Hawaiian:\u00a0\"k\u0101naka \u02bb\u014diwi\", \"k\u0101naka maoli\", and \"Hawai\u02bbi maoli\") are the aboriginal Polynesian people of the Hawaiian Islands or their descendants.", "Native Hawaiians trace their ancestry back to the original Polynesian settlers of Hawaii.", "In total, 527,000 Americans consider themselves Native Hawaiian.", "According to the 2010 U.S. Census, there are 371,000 people who identified themselves as being \"Native Hawaiian\" alone or in combination with one or more other races or Pacific Islander groups.", "156,000 people identified themselves as being \"Native Hawaiian\" alone.", "The majority of Native Hawaiians reside in the state of Hawaii (two-thirds), and the rest are scattered among other states, especially in the American Southwest, and with a high concentration in California.", "The history of Native Hawaiians, like the history of Hawaii, is commonly classified into four major periods:\n\n", "One theory is that the first Polynesians arrived in Hawaii in the 3rd century from the Marquesas by travelling in groups of wakas, and were followed by Tahitians in AD 1300, who then conquered the original inhabitants.", "Another is that a single, extended period of settlement populated the islands." ], [ "History of Hawaii", "History of Hawaii\n\nThe history of Hawaii describes the era of human settlements in the Hawaiian Islands.", "That history begins sometime between 124 and 1120 AD, when the islands were first settled by Polynesians.", "Hawaiian civilization was isolated from the rest of the world for at least 500 years.", "Europeans led by British explorer James Cook arrived in the Hawaiian Islands in 1778.", "Within five years, European military technology helped Kamehameha I conquer and unify the islands for the first time, establishing the Kingdom of Hawaii.", "The kingdom was prosperous and important for its agriculture and strategic location in the Pacific.", "American immigration began almost immediately after European contact, led by Protestant missionaries.", "Americans set up plantations to grow sugar.", "Their methods of plantation farming required substantial labor.", "Waves of permanent immigrants came from Japan, China and the Philippines to work in the fields.", "The government of Japan organized and gave special protection to its people, who comprised about 25 percent of the Hawaiian population by 1896.", "The native population succumbed to disease brought by the Europeans (particularly smallpox), declining from 300,000 in the 1770s over 60,000 in the 1850s to 24,000 in 1920.", "Americans within the kingdom government rewrote the constitution, severely curtailing the power of King \"David\" Kal\u0101kaua, and disenfranchising the rights of most Native Hawaiians and Asian citizens to vote, through excessively high property and income requirements." ] ], "gold": "The history of Hawaii describes the era of human settlements in the Hawaiian Islands, which were settled by Polynesians. The Polynesian Islands were first settled by sometime between 124 and 1120 AD. Hawaiian civilization was isolated from the rest of the world for at least 500 years. The small set of islands that the first settlers of Hawaii came from are the Marquesas Islands.", "prediction 1": "The history of Hawaii describes the era of human settlements in the Hawaiian Islands. The first settlers of Hawaii came from the Marquesas, Samoa, and Tahiti. The first Polynesians arrived in Hawaii in the 3rd century. The first Tahitians arrived in the islands in 1300 AD, claiming to have conquered the original inhabitants. The first Hawaiians are believed to have come from the Marquesas, Samoa, Samoa, and Samoa.", "prediction 2": "The history of Hawaii describes the era of human settlements in the Hawaiian Islands. The first settlers of the Hawaiian Islands came from the Marquesas, where they were followed by Tahitians in AD 1300, who then conquered the original inhabitants. The first Polynesians who settled Hawaii in the 3rd century are said to have come from the Marquesas, where they were led by the wakas. The first native Hawaiians are believed to have come from Samoa. Other writers claim that other settlers in Hawaii were forced into remote valleys by newer arrivals.", "prediction 3": "The first settlers of Hawaii came from the Marquesas, where they were travelling in groups of wakas. From there, the first Polynesians arrived in the Hawaiian Islands in the 3rd century, and were followed by Tahitians in AD 1300, who then conquered the original inhabitants. Native Hawaiians trace their ancestry back to the original Polynesian settlers of Hawaii.", "prediction 4": "The history of Hawaii describes the era of human settlements in the Hawaiian Islands. The first settlers of Hawaii are considered to have come from the Marquesas. However, the Native Hawaiians trace their ancestry back to the original Polynesians who settled the islands. The origin of the Hawaiians is unknown. There are legends that the first settlers of Hawaii came from the Marquesas. Another theory is that the first Polynesians arrived in Hawaii in the 3rd century from the Marquesas by travelling in groups of wakas. Another theory is that the first Polynesians arrived in the islands in the 1300, who then conquered the original inhabitants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 326 }, { "error type": "Redundant", "explanation": "The first settlers of Hawaii came from the Marquesas, Samoa, and Tahiti. ", "start": 327, "end": 417 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The history of Hawaii describes the era of human settlements in the Hawaiian Islands. That history begins sometime between 124 and 1120 AD, when the islands were first settled by Polynesians. Hawaiian civilization was isolated from the rest of the world for at least 500 years. The first Hawaiians are believed to have come from the Marquesas, Samoa, and Tahiti. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the all star game home run derby?", "passages": [ [ "2017 Major League Baseball Home Run Derby", "2017 Major League Baseball Home Run Derby\n\n", "The 2017 Major League Baseball Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB).", "The derby was held on July 10, 2017, at Marlins Park in Miami, Florida, the site of the 2017 MLB All-Star Game.", "On July 5, the participants were announced.", "Aaron Judge won, becoming the first rookie to win the event outright.", "Eight players participated in the derby in a bracket-style, single-elimination timed event.", "Each player had four minutes to hit as many home runs as possible.", "Hitters were awarded an additional 30 seconds if they hit two home runs over .", "Hitters were also allowed one 45 second timeout to stop the clock (two in the finals).", "Homers hit off a T-Mobile Ball during the final minute resulted in a $10,000 donation to charity by T-Mobile & MLB, to the Boys & Girls Clubs of America.", "The eight competing players were seeded 1-8 based on their home run totals.", "The higher seed hit second in any round, and the round ended if the higher seed surpassed the total of the first hitter." ], [ "2016 Major League Baseball Home Run Derby", "2016 Major League Baseball Home Run Derby\n\nThe 2016 Major League Baseball Home Run Derby (known through sponsorship as the T-Mobile Home Run Derby) was a home run hitting contest between eight batters from Major League Baseball (MLB).", "The derby was held on July 11, 2016, at Petco Park in San Diego, California, the site of the 2016 MLB All-Star Game.", "On July 8, the participants that will be eligible to participate in the Home Run Derby were announced.", "Giancarlo Stanton won the Home Run Derby by defeating defending champion Todd Frazier 20\u201313.", "Eight players participated in the derby in a bracket-style, single-elimination timed event.", "Each player had four minutes to hit as many home runs as possible.", "Hitters were awarded an additional 30 seconds if they hit two home runs over .", "Hitters were also allowed one 45 second timeout to stop the clock (two in the finals).", "Homers hit off a T-Mobile Ball during the final minute resulted in a $10,000 donation to charity by T-Mobile & MLB, to the Boys & Girls Clubs of America.", "The eight competing players were seeded 1-8 based on their home run totals.", "The higher seed hit second in any round, and the round ended if the higher seed surpassed the total of the first hitter." ], [ "2015 Major League Baseball Home Run Derby", "2015 Major League Baseball Home Run Derby\n\nThe 2015 Major League Baseball Home Run Derby (known through sponsorship as the Gillette Home Run Derby presented by Head & Shoulders) was a home run hitting contest between eight batters from Major League Baseball (MLB).", "The derby was held on July 13, 2015, at Great American Ball Park in Cincinnati, Ohio, the site of the 2015 MLB All-Star Game.", "The contest saw several rule changes from MLB in an attempt to enliven the event and draw more interest to it.", "Batters faced off in a single-elimination, bracket-style competition, and each round was timed, rather than limited by number of outs.", "Todd Frazier was the winner, defeating Joc Pederson in the final round, 15\u201314, winning the derby in front of his hometown crowd.", "As announced by Major League Baseball, there were changes to the format of the Home Run Derby in 2015.", "Eight players participated in the derby in a bracket-style, single-elimination timed event.", "Each player had five minutes to hit as many home runs as possible.", "Hitters were also awarded bonus time for hitting long home runs.", "Hitters were awarded an additional minute if they hit two home runs over 420 feet and an additional 30 seconds if they hit a home run over 475 feet." ] ], "gold": "The Home Run Derby is an annual home run hitting competition in Major League Baseball customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. The 2017 Major League Baseball Home Run Derby was held on July 10, 2017, at Marlins Park in Miami, Florida and Aaron Judge won, becoming the first rookie to win the event outright. The 2016 Major League Baseball Home Run Derby was held on July 11, 2016, at Petco Park in San Diego, California, and Giancarlo Stanton won by defeating defending champion Todd Frazier 20\u201313. The 2015 Major League Baseball Home Run Derby was held on July 13, 2015, at Great American Ball Park in Cincinnati, Ohio, where Todd Frazier was proclaimed the winner, defeating Joc Pederson in the final round, 15\u201314.", "prediction 1": "The 2015 MLB All-Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB). The 2015 MLB All-Star Game Home Run Derby was won by Todd Frazier. The 2017 MLB All-Star Game Home Run Derby was won by Aaron Judge. Giancarlo Stanton won the Home Run Derby by defeating defending champion Todd Frazier 20\u201313.", "prediction 2": "The 2015 MLB All Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB). The 2016 MLB All Star Game Home Run Derby was a home run hitting contest between eight batters from MLB. On the day of the derby on July 11, 2016, Giancarlo Stanton won the Home Run Derby by defeating defending champion Todd Frazier 20\u201313.", "prediction 3": "The 2015 MLB All-Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB). The 2015 MLB All-Star Game Home Run Derby was won by Todd Frazier. The 2016 MLB All Star Game Home Run Derby was won by Giancarlo Stanton.", "prediction 4": "The 2015 MLB All Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball. On July 13, 2015, Todd Frazier was the winner, defeating Joc Pederson in the final round, 15\u201314, winning the derby in front of his hometown crowd. On July 8, the participants that will be eligible to participate in the Home Run Derby were announced. Aaron Judge won, becoming the first rookie to win the event outright. On July 5, the participants were announced. Giancarlo Stanton won the Home Run Derby by defeating the defending champion Todd Frazier 20\u201313.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The 2015 MLB All-Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB). ", "start": 133, "end": 170 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2015 MLB All-Star Game Home Run Derby was a home run hitting contest between eight batters from Major League Baseball (MLB). The derby was held on July 13, 2015, at Great American Ball Park in Cincinnati, Ohio. It was won by Todd Frazier, defeating Joc Pederson in the final round, 15\u201314. The 2016 MLB All-Star Game Home Run Derby was held on July 11, 2016, at Petco Park in San Diego, California. Giancarlo Stanton won by defeating defending champion Todd Frazier 20\u201313. The 2017 MLB All-Star Game Home Run Derby was won by Aaron Judge, becoming the first rookie to win the event outright. The derby was held on July 10, 2017, at Marlins Park in Miami, Florida. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the song we are the world recorded?", "passages": [ [ "We Are the World", "We Are the World\n\n\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists (USA) for Africa in 1985.", "It was written by Michael Jackson and Lionel Richie and produced by Quincy Jones for the album \"We Are the World\".", "With sales in excess of 20 million copies, it is one of fewer than 30 retail singles to have sold at least 10 million copies worldwide.", "Following Band Aid's 1984 \"Do They Know It's Christmas?\" project in the United Kingdom, an idea for the creation of an American benefit single for African famine relief came from activist Harry Belafonte, who, along with fundraiser Ken Kragen, was instrumental in bringing the vision to reality.", "Several musicians were contacted by the pair, before Jackson and Richie were assigned the task of writing the song.", "The duo completed the writing of \"We Are the World\" seven weeks after the release of \"Do They Know It's Christmas?", "\", and one night before the song's first recording session, on January 21, 1985.", "The historic event brought together some of the most famous artists in the music industry at the time.", "The song was released on March 7, 1985, as the first single from the album.", "A worldwide commercial success, it topped music charts throughout the world and became the fastest-selling American pop single in history." ], [ "We Are the World", "He was subsequently joined in the recording studio by the remaining USA for Africa artists, who included Ray Charles, Billy Joel, Diana Ross, Cyndi Lauper, Bruce Springsteen, and Smokey Robinson.", "Also in attendance were five of Jackson's siblings: Jackie, La\u00a0Toya, Marlon, Randy, and Tito.", "Many of the participants came straight from an American Music Award ceremony, which had been held that same night.", "Invited musician Prince, who would have had a part in which he and Michael Jackson sang to each other, did not attend the recording session.", "The reason given for his absence has varied.", "One newspaper claimed that Prince did not want to record with other acts.", "Another report, from the time of \"We Are the World\"'s recording, suggested that the musician did not want to partake in the session because organizer Bob Geldof called him a \"creep\".", "Prince did, however, donate an exclusive track, \"4 The Tears In Your Eyes\", for the \"We Are the World\" album.", "In all, more than 45 of America's top musicians participated in the recording, and another 50 had to be turned away.", "Upon entering the recording studio, the musicians were greeted by a sign pinned to the door which read, \"Please check your egos at the door.\"" ], [ "We Are the World 25 for Haiti", "We Are the World 25 for Haiti\n\n\"We Are the World 25 for Haiti\" is a charity single recorded by the supergroup Artists for Haiti in 2010.", "It is a remake of the 1985 hit song \"We Are the World\", which was written by American musicians Michael Jackson and Lionel Richie, and was recorded by USA for Africa to benefit famine relief in Africa.", "Initially, in late 2009, it had been suggested to Richie and Quincy Jones\u2014producer of the original \"We Are the World\"\u2014that a re-cut version of the song be re-released under the title \"Live 25\".", "Following the magnitude 7.0 M earthquake in Haiti, which devastated the area and killed thousands of people, it was agreed that the song would be re-recorded by new artists, in the hope that it would reach a new generation and help benefit the people of Haiti.", "The song was recorded in fourteen and a half hours by over eighty artists on February 1, 2010.", "It was produced by Quincy Jones, and executively produced by Lionel Richie, and Haitian-American musician Wyclef Jean.", "A music video directed by Paul Haggis was released to accompany and promote the song.", "The song was also recorded in Spanish by a Latin supergroup and was named Somos el Mundo.", "The song was directed by Emilio Estefan and his wife, Gloria Estefan." ] ], "gold": "We Are the World is a charity single record that was originally recorded by the supergroup USA for Africa in 1985 to raise proceeds for African famine relief. The single was recorded over a period of days, from January 21, 1985 to January 28, 1985. More than 45 or America's top musicians participated in the recording. The record sold over 20 million copies and is the eighth best-selling physical single of all time.", "prediction 1": "\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists (USA) for Africa in 1985. It was written by American musicians Michael Jackson and Lionel Richie and produced by Quincy Jones for the album \"We Are the World\". The song was released on March 7, 1985, as the first single from the album. It was subsequently joined in the recording studio by the remaining USA for Africa artists, who included Ray Charles, Billy Joel, Diana Ross, Cyndi Lauper, Bruce Springsteen, Bruce Springsteen, Bruce Springsteen, and Smokey Robinson. We Are the World 25 for Haiti is a remake of the 1985 hit song \"We Are the World\", which was recorded in fourteen and a half hours by over eighty artists on February 1, 2010.", "prediction 2": "\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists, USA for Africa in 1985. It was written by Michael Jackson and Lionel Richie and produced by Quincy Jones for the album We Are the World. \"We Are the World 25 for Haiti\" is a charity single recorded by the supergroup Artists for Haiti in 2010. It is a remake of the 1985 hit song We Are the World, which was written by American musicians Michael Jackson and Lionel Richie, and was recorded in fourteen and a half hours by over eighty artists in fourteen and a half hours by over eighty artists on February 1, 2010.", "prediction 3": "\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists (USA) for Africa in 1985. The song was written by American musicians Michael Jackson and Lionel Richie and produced by Quincy Jones for the album We Are the World.", "prediction 4": "\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists (USA) for Africa in 1985. It was written by American musicians Michael Jackson and Lionel Richie, and produced by Quincy Jones for the album \"We Are the World\". This charity single, which was released as the first single from the album, was re-recorded by artists from Artists for Haiti in 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 347 }, { "error type": "Irrelevant", "explanation": "", "start": 348, "end": 581 }, { "error type": "Irrelevant", "explanation": "", "start": 582, "end": 756 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"We Are the World\" is a song and charity single originally recorded by the supergroup United Support of Artists (USA) for Africa in 1985. The song first recording session was on January 21, 1985. In all, more than 45 of America's top musicians participated in the recording. With sales in excess of 20 million copies, it is one of fewer than 30 retail singles to have sold at least 10 million copies worldwide." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "How many countries are members of security council?", "passages": [ [ "United Nations Security Council", "United Nations Security Council\n\nThe United Nations Security Council (UNSC) is one of the six principal organs of the United Nations (UN), charged with the maintenance of international peace and security as well as accepting new members to the United Nations and approving any changes to its United Nations Charter.", "Its powers include the establishment of peacekeeping operations, the establishment of international sanctions, and the authorization of military action through Security Council resolutions; it is the only UN body with the authority to issue binding resolutions to member states.", "The Security Council held its first session on 17 January 1946.", "Like the UN as a whole, the Security Council was created following World War II to address the failings of a previous international organization, the League of Nations, in maintaining world peace.", "In its early decades, the Security Council was largely paralyzed by the Cold War division between the US and USSR and their respective allies, though it authorized interventions in the Korean War and the Congo Crisis and peacekeeping missions in the Suez Crisis, Cyprus, and West New Guinea.", "With the collapse of the Soviet Union, UN peacekeeping efforts increased dramatically in scale, and the Security Council authorized major military and peacekeeping missions in Kuwait, Namibia, Cambodia, Bosnia, Rwanda, Somalia, Sudan, and the Democratic Republic of Congo.", "The Security Council consists of fifteen members." ], [ "Permanent members of the United Nations Security Council", "Permanent members of the United Nations Security Council\n\nThe permanent members of the United Nations Security Council (also known as the Permanent Five, Big Five, or P5) are the five states which the UN Charter of 1945 grants a permanent seat on the UN Security Council: China (formerly the Republic of China), France, Russia (formerly the Soviet Union), the United Kingdom, and the United States.", "These countries were all allies in World War II, which they won.", "They are also all nuclear weapons states.", "A total of 15 UN member states serve on the UNSC, the remainder of which are elected.", "Any one of the five permanent members have the power of veto, which enables them to prevent the adoption of any \"substantive\" draft Council resolution, regardless of its level of international support.", "At the UN's founding in 1945, the five permanent members of the Security Council were the French Republic, the Republic of China, the Soviet Union, the United Kingdom, and the United States.", "There have been two seat changes since then, although not reflected in of the United Nations Charter as it has not been accordingly amended:\n\n\nAdditionally, France reformed its provisional government into the French Fourth Republic in 1946 and later into the French Fifth Republic in 1958, both under the leadership of Charles de Gaulle." ], [ "United Nations Security Council", "The great powers that were the victors of World War II\u2014the Soviet Union (now represented by the Russian Federation), the United Kingdom, France, the Republic of China (now represented by the People's Republic of China), and the United States\u2014serve as the body's five permanent members.", "These permanent members can veto any substantive Security Council resolution, including those on the admission of new member states or candidates for Secretary-General.", "The Security Council also has 10 non-permanent members, elected on a regional basis to serve two-year terms.", "The body's presidency rotates monthly among its members.", "Security Council resolutions are typically enforced by UN peacekeepers, military forces voluntarily provided by member states and funded independently of the main UN budget.", ", 103,510 peacekeepers and 16,471 civilians were deployed on sixteen peacekeeping operations and one special political mission.", "In the century prior to the UN's creation, several international treaty organizations and conferences had been formed to regulate conflicts between nations, such as the International Committee of the Red Cross and the Hague Conventions of 1899 and 1907.", "Following the catastrophic loss of life in World War I, the Paris Peace Conference established the League of Nations to maintain harmony between the nations." ] ], "gold": "The United Nations Security Council (UNSC) is one of the six principal organs of the United Nations (UN), charged with ensuring international peace and security recommending the admission of new UN members to the General Assembly, and approving any changes to the UN Charter. After 1966, permanent membership on the Council is held by 5 countries, and non-permanent membership by 10 countries. Prior to 1966, there were six elected members, while the permanent members have in essence not changed since the creation of the United Nations in 1945, apart from the representation of China.", "prediction 1": "The United Nations Security Council consists of 15 members, including 10 non-permanent members and 10 members elected by the Security Council's President. China is one of the five permanent members of the Security Council, while the Soviet Union is also a permanent member.", "prediction 2": "The Security Council of the United Nations is composed of 15 states. There are five permanent members, the other permanent members are China, the Republic of China, the Soviet Union, and the United Kingdom. The Security Council consists of 10 non-permanent members, elected on a regional basis to serve two-year terms, and 10 non-permanent members are members who are appointed by the President.", "prediction 3": "The United Nations Security Council is one of the six principal organs of the United Nations, charged with the maintenance of international peace and security as well as accepting new members to the United Nations and approving any changes to its United Nations Charter. The Security Council consists of 15 members, of which 5 are permanent members.", "prediction 4": "The United Nations Security Council is one of the six principal organs of the United Nations, charged with the maintenance of international peace and security as well as accepting new members to the United Nations and approving any changes to its United Nations Charter. The Security Council consists of 15 members, of which 15 are permanent and the remaining 4 are elected.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,4]}", "start": 99, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 273 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United Nations Security Council (UNSC) is one of the six principal organs of the United Nations (UN), charged with the maintenance of international peace and security as well as accepting new members to the United Nations and approving any changes to its United Nations Charter. The United Nations Security Council consists of 15 members, including 10 non-permanent members and 5 permanent members." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Length of new guardians of the galaxy movie?", "passages": [ [ "Guardians of the Galaxy (film)", "Guardians of the Galaxy (film)\n\nGuardians of the Galaxy (retroactively referred to as Guardians of the Galaxy Vol. 1) is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures.", "It is the tenth film in the Marvel Cinematic Universe (MCU).", "The film was directed by James Gunn, who wrote the screenplay with Nicole Perlman, and features an ensemble cast including Chris Pratt, Zoe Saldana, Dave Bautista, Vin Diesel, and Bradley Cooper as the titular Guardians, along with Lee Pace, Michael Rooker, Karen Gillan, Djimon Hounsou, John C. Reilly, Glenn Close, and Benicio del Toro.", "In \"Guardians of the Galaxy\", Peter Quill forms an uneasy alliance with a group of extraterrestrial criminals who are fleeing after stealing a powerful artifact.", "Perlman began working on the screenplay in 2009.", "Producer Kevin Feige first publicly mentioned \"Guardians of the Galaxy\" as a potential film in 2010 and Marvel Studios announced it was in active development at the San Diego Comic-Con International in July 2012.", "Gunn was hired to write and direct the film that September.", "In February 2013, Pratt was hired to play Peter Quill / Star-Lord, and the supporting cast members were subsequently confirmed." ] ], "gold": "Guardians of the Galaxy, retroactively referred to as Guardians of the Galaxy Vol. 1, is a 2014 American superhero film based on the Marvel Comics superhero team of the same name. Produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures, it is the 10th film in the Marvel Cinematic Universe MCU, it's running time is 122 minutes long, and Galaxy Vol.2's running time is 137 minutes.", "prediction 1": "Guardians of the Galaxy is a 2014 American superhero film created by James Gunn, which features an ensemble cast including Chris Pratt and Zoe Saldana as the Guardians of the Galaxy. The film runs approximately 110 minutes.", "prediction 2": "Guardians of the Galaxy is a 2014 American superhero film produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. It is the tenth film in the Marvel Cinematic Universe (MCU), based on the Marvel Comics superhero team of the same name. The film is 115 minutes long, with a running time of 124 minutes.", "prediction 3": "Guardians of the Galaxy, also referred to as Guardians of the Galaxy Vol. 1 or Vol. 2, is a 2014 American superhero film directed by James Gunn, who wrote the screenplay with Nicole Perlman and released on July 8, 2014.", "prediction 4": "Guardians of the Galaxy is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. It is the tenth film in the Marvel Cinematic Universe (MCU). The film was directed by James Gunn, who wrote the screenplay with Nicole Perlman, and features an ensemble cast including Chris Pratt, Zoe Saldana, Dave Bautista, Vin Diesel, and Bradley Cooper as the titular Guardians, along with Lee Pace, Michael Rooker, Djimon Hounsou, John C. Reilly, Glenn Close, and Benicio del Toro del Toro.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 182 }, { "error type": "Unverifiable", "explanation": "", "start": 183, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 80 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Guardians of the Galaxy (film) Guardians of the Galaxy (retroactively referred to as Guardians of the Galaxy Vol. 1) is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. It is the tenth film in the Marvel Cinematic Universe (MCU)." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was percy jackson and the lightning thief published?", "passages": [ [ "The Lightning Thief", "It was followed by \"The Titan's Curse, The Battle of the Labyrinth,\" and \"The Last Olympian\" as well as an entire new sequel-series, \"The Heroes of Olympus\", and later, \"The Trials of Apollo\".", "\"The Lightning Thief\" was published in Chinese, Italian, Turkish, Danish, Croatian, Czech, Finnish, French, Dutch, German, Hebrew, Portuguese, Brazilian Portuguese, Polish, Indonesian, Serbian, Norwegian, Spanish, and Catalan.", "The French, German, and Spanish editions were published in 2006.", "The other translations of the book were published in 2008.", "The Icelandic publisher \"Odinseye\" released another edition in 2012.", "The novel is also on sale in Taiwan, published by Yuan Liou Publishing." ], [ "The Lightning Thief", "The Lightning Thief\n\nThe Lightning Thief is an American fantasy-adventure novel based on Greek mythology, the first young adult novel written by Rick Riordan in the \"Percy Jackson & the Olympians\" series.", "The manuscript was sold in an auction to Miramax Books, an imprint of Hyperion Books for Children and thus Disney Publishing (succeeded by the Disney Hyperion imprint).", "The novel charts the adventures of modern-day twelve-year-old Percy Jackson as he discovers he is a demigod, the son of a mortal woman and the Greek god Poseidon.", "Percy and his friends Annabeth Chase and Grover Underwood go on a quest to find Zeus's stolen lightning bolt and prevent a war between the gods Zeus, Poseidon, and Hades.", "\"The Lightning Thief\" was published in July 2005.", "The book has sold over 1.2\u00a0million copies in the subsequent four years, appearing on \"The New York Times\" children's Best Seller list and being listed as one of the Young Adult Library Services Association's Best Books for Young Adults, among other awards.", "It was adapted into a film named \"\" released in the United States on February 12, 2010.", "This novel is followed by \"The Sea of Monsters\" and spawned two sequel series and the extended universe of the \"Camp Half-Blood\" chronicles." ], [ "Percy Jackson & the Olympians", "This led Riordan to create the fictional character of Percy Jackson and create the story of how he travels across the United States to recover Zeus' lightning-bolt.", "Haley suggested that he should turn that story into a book, and Riordan wrote the book over the next year despite being busy at that time.", "Leaving his manuscript with his agent and editor for review, Riordan presented the book to a group of 6th, 7th, and 8th graders to read and critique.", "He gained their approval, and with their help, came up with the name of the book and created the way Percy's sword works.", "In 2004, the book was sold to Miramax Books for enough money for Riordan to quit his job and focus on writing.", "After it was released on 28\u00a0June 2005, it sold over 1.2\u00a0million copies.", "The book was released in multiple versions, including hardcover, paperback and audio editions.", "It has been translated into multiple languages and published all over the world.", "\"The Lightning Thief\" is the first book in the series and was released on July 1, 2005.", "After a harrowing experience at his school trip, Percy Jackson returns home for the summer vacation, wherein he and his mortal mother Sally Jackson, travel to their cabin in Montauk to take their mind off things." ] ], "gold": "The Lightning Thief is a 2005 American fantasy adventure novel based on Greek mythology, the first young adult novel written by Rick Riordan in the Percy Jackson & the Olympians series. Percy Jackson and the Lightning Thief was first published as a hard cover on July 1, 2005. It was then published as paperback a year later on April 1, 2006, and that same year it came out in French, German and Spanish. In 2008 it was published in Chinese, Italian, Turkish, Danish, Croatian, Czech, Finnish, Dutch, Hebrew, Portuguese, Brazilian Portuguese, Polish, Indonesian, Serbian, Norwegian, and Catalan, and in 2012 Icelandic. ", "prediction 1": "The Lightning Thief is the first book in the Percy Jackson & the Olympians series written by Rick Riordan. The novel charts the adventures of modern-day twelve-year-old Percy Jackson as he discovers he is a demigod, the son of a mortal woman and the Greek god Poseidon. Riordan wrote the book over the next year and left his manuscript with his agent and editor for review. He presented the book to a group of 6th, 7th, and 8th graders to read and critique. After it was released on 28 June 2005, it sold over 1.2 million copies.", "prediction 2": "The Lightning Thief is the first book in the Percy Jackson & the Olympians series written by Rick Riordan. The novel charts the adventures of modern-day twelve-year-old Percy Jackson as he discovers he is a demigod, the son of a mortal woman and the Greek god Poseidon. The book was published on July 1, 2005, and has sold over 1.2 million copies in the subsequent four years.", "prediction 3": "The Lightning Thief is an American fantasy-adventure novel based on Greek mythology, the first young adult novel written by Rick Riordan in the Percy Jackson & the Olympians series. The manuscript was sold in an auction to Miramax Books, an imprint of Hyperion Books for Children and thus Disney Publishing. The French, German, and Spanish editions of the book were published in 2006. The Icelandic publisher \"Odinseye\" released another edition in 2012.", "prediction 4": "The Lightning Thief is an American fantasy-adventure novel based on Greek mythology, the first young adult novel written by Rick Riordan in the \"Percy Jackson & the Olympians\" series. The manuscript was sold in an auction to Miramax Books, an imprint of Hyperion Books for Children and thus Disney Publishing. The book has sold over 1.2 million copies in the subsequent four years, appearing on \"The New York Times\" children's Best Seller list and being listed as one of the Young Adult Library Services Association's Best Books for Young Adults Association's Best Books for Young Adults Association's Best Books for Young Adults, among other awards.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 374, "end": 457 }, { "error type": "Irrelevant", "explanation": "", "start": 458, "end": 521 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Lightning Thief The Lightning Thief is an American fantasy-adventure novel based on Greek mythology, the first young adult novel written by Rick Riordan in the \"Percy Jackson & the Olympians\" series. \"The Lightning Thief\" was published in July 2005. The French, German, and Spanish editions were published in 2006. In 2008 it was published in Chinese, Italian, Turkish, Danish, Croatian, Czech, Finnish, Dutch, Hebrew, Portuguese, Brazilian Portuguese, Polish, Indonesian, Serbian, Norwegian, and Catalan, and in 2012 Icelandic." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "What is the state with the largest hispanic population?", "passages": [ [ "Demographics of California", "According to 2015 US Census Bureau estimates, California's population was 72.9% White, 6.5% Black or African American, 14.7% Asian, 1.7% Native Americans, 0.5% Pacific Islander and 3.8% from two or more races.", "By ethnicity, 38.8% of the total population is Hispanic-Latino (of any race) and 61.4% Non-Hispanic (of any race).", "Hispanics are the largest ethnic group in California.", "In 2015, California had the largest minority population in the United States.", "Non-Hispanic whites decreased from about 76.3 - 78% of the state's population in 1970 to 38.0% in 2015.", "While the population of minorities accounts for 100.7 million of 300 million U.S. residents, 20% of the national total live in California.", "California has the highest number, and second highest percentage, of Asian Americans by state.", "Only Hawaii has a higher Asian American percentage than California.", "While New Mexico and Texas have higher percentages of Hispanics, California has the highest total number of Hispanics of any U.S. state.", "Hispanics are the largest single ethnic group in the state." ], [ "Brazilian Americans", "Brazilian Americans\n\nBrazilian Americans (, or ) are Americans who are of full or partial Brazilian ancestry.", "There were an estimated 371,529 Brazilian Americans as of 2012, according to the United States Census Bureau.", "Another source gives an estimate of some 800,000 Brazilians living in the U.S. in 2000, while still another estimates that some 1,100,000 Brazilians live in the United States, 300,000 of them in Florida.", "According to the 2016 American Community Survey, There are a total of 42,193,781 foreign born persons in the United States.", "From the 42.2 million immigrants, 350,091 are Brazilians, corresponding 0.83% (350,091/42.2million) of the foreign born population.", "While the official United States Census category of Hispanic or Latino includes persons of South American origin, it also refers to persons of \"other Spanish culture,\" creating some ambiguity about whether Brazilians, who are of South American origin but do not have a Spanish culture, qualify as Latino, as while they are not \"Hispanic\" (of a culture derived from Spain), they are \"Latino\" (which is short for \"latinoamericano\")." ] ], "gold": "As of 2019, the Census Bureau estimated that almost 60.5 million Latinos were living in the United States, making about 20% of the country's population. The state with the largest percentage of Hispanics and Latinos is New Mexico at 47%. Alternatively, the state with the largest Hispanic and Latino population overall is California, with more than 15 million Hispanic and Latino inhabitants. ", "prediction 1": "California has the largest Hispanic population in the United States. By ethnicity, 38.8% of the total population is Hispanic-Latino (of any race) and 61.4% Non-Hispanic (of any race). Hispanics are the largest single ethnic group in California.\n", "prediction 2": "For the year 2015, California had the largest Hispanic population according to US Census Bureau estimates. California has the largest Hispanic percentage and number per capita, and the highest percentage of Hispanics for any statewide county. Also, California has the largest number of Hispanic-Latino special immigrants, with an estimated 371,529 Mexican-Americans, compared to a number of other cities in the country with more Hispanic immigrants.", "prediction 3": "Since 1970, the largest Hispanic population in the United States has been found in California, where, by population, the total population is Hispanic-Latino, or any other race. This is the eighth largest Hispanic population in the nation. California has the highest number, and second highest percentage, of Asian Americans by state, and the sixth largest percentage of Asian Americans by race, among all the states in the US.", "prediction 4": "In mind, the state with the largest Hispanic population is California. California has the highest number and second highest percentage of Asian Americans. The state has the highest total number of Hispanics of any U.S. state.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 245 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "New Mexico and Texas have higher percentages of Hispanics, but California has the largest Hispanic population in the United States overall. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who drives the number 76 car in nascar?", "passages": [ [ "Jimmy Blewett", "Qualified second behind eventual winner, and longtime rival Steven Reed.", "Redrew eighth, and clipped Tim Arre's battered car and was eliminated for the night.", "A week later, Blewett visited victory lane for the fourth time this season, after a previous week after nearly destroyed his racer that was worth $10,000 in damage.", "Blewett, finished a very remarkable 8th at the Town Fair Tire 150, at Stafford Motor Speedway.", "Blewett ran the twin 50's at Wall Stadium by finishing second in the first, and won the second.", "Blewett's hopes of getting a remarkable finish at Thompson, was washed out due to inclement weather, and it's rescheduled on September, 3rd.", "Two nights later, he won the inaugural John Blewett III Memorial 76 Lap event at Wall Stadium.", "Blewett, started outside pole after a blind draw, and jumped into the lead, and never looked back.", "The win was dedicated, to his late brother who died two summers ago, at the Thompson International Speedway during the NASCAR Whelen Modified Tour event, and Blewett was involved in that harrowing accident.", "Blewett, ran the inaugural event at Bristol Motor Speedway.", "Started 11th, and his day was not promising, as he had struggled to speed throughout the event, with a bad vibration and it was forced on the sideline on lap 74." ], [ "John Blewett III", "John Blewett III\n\nJohn Richard Blewett III (October 25, 1973 \u2013 August 16, 2007), from Howell Township, New Jersey, was a NASCAR Whelen Modified Tour driver.", "Blewett started racing go karts at the age of 10.", "In 1996, at age 22, he won the coveted NASCAR's Northeast Regional Championship, falling only a few points shy of the National Title.", "During his career he recorded 97 wins between 1993 and 2007, including track championships at Flemington Speedway, Wall Township Speedway, New Egypt, as well as New Hampshire.", "In 2006, he was honored during the motorsports show in Atlantic City as the northeasts Winningest Pavement Driver, for that year, as tallied by Area Auto Racing News.", "On August 16, 2007, while competing in a Whelen Modified race at Thompson Speedway, Blewett lost his life in a crash where he spun and was hit in the driver's door by his brother Jimmy's car.", "On August 18, 2007 Wall Township Speedway held a Special Memorial for John.", "Fans, family, and friends attended the Speedway to pay their final respects.", "On the final lap of the scheduled 40 lap modified event, 1990 NASCAR Whelen Modified Titlist Jamie Tomaino piloted the famed #76 for a solo lap in John's honor." ] ], "gold": "In NASCAR's Pinty Series, Cayden Lapcevich drove the number 76 car. In NASCAR's Whelan Modified Tour, John Blewett III drove the number 76 car; however, on August 16, 2007, while competing in a Whelen Modified race at Thompson Speedway, Blewett lost his life in a crash where he spun and was hit in the driver's door by his brother Jimmy Blewett's car. Three months later, at the season ending Turkey Derby, the Speedway decided to reserve the number 76 car exclusively for use by the Blewett family, effectively retiring the number except that any Blewett family owned team or driver can use it. ", "prediction 1": "Jamie Tomaino piloted the famed #76 car for a solo lap in John's honor. In the 1990 NASCAR Whelen Modified Titlist Jamie Tomaino's honor, the #76 car was driven by Jimmy Blewett III.", "prediction 2": "Jamie Tomaino, 1990 NASCAR Whelen Modified Titlist and current #76 car driver, drove the famed #76 car for a solo lap in John's honor.", "prediction 3": "Jamie Tomaino is the 1990 NASCAR Whelen Modified Titlist who drives the famed #76 car in NASCAR.", "prediction 4": "Jamie Tomaino and John Blewett Jr. in 1990s NASCAR Whelen Modifieds drove the number 76 car in a solo lap in John's honor.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 115, "end": 137 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "On August 16, 2007, while competing in a Whelen Modified race at Thompson Speedway, John Blewett III lost his life in a crash where he spun and was hit in the driver's door by his brother Jimmy's car. The 1990 NASCAR Whelen Modified Titlist had Jamie Tomaino piloted the famed #76 car for a solo lap in John's honor. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did america get rid of the draft?", "passages": [ [ "Conscription in the United States", "With the end of active U.S. ground participation in Vietnam, December 1972 saw the last men conscripted, who were born in 1952 and who reported for duty in June 1973.", "On February 2, 1972, a drawing was held to determine draft priority numbers for men born in 1953, but in early 1973 it was announced by Secretary of Defense Melvin Laird that no further draft orders would be issued.", "In March 1973, 1974, and 1975, the Selective Service assigned draft priority numbers for all men born in 1954, 1955, and 1956, in case the draft was extended, but it never was.", "Command Sergeant Major Jeff Mellinger, believed to be the last drafted enlisted ranked soldier still on active duty, retired in 2011.", "Chief Warrant Officer 5 Ralph E. Rigby, the last Vietnam War-era drafted soldier of Warrant Officer rank, retired from the army on November 10, 2014 after a 42-year career.", "On July 2, 1980, President Jimmy Carter issued Presidential Proclamation 4771 and re-instated the requirement that young men register with the Selective Service System.", "At that time it was required that all males, born on or after January 1, 1960, register with the Selective Service System." ], [ "Conscription in the United States", "Conscription in the United States\n\nConscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts: the American Revolution, the American Civil War, World War I, World War II, and the Cold War (including both the Korean War and the Vietnam War).", "The third incarnation of the draft came into being in 1940 through the Selective Training and Service Act.", "It was the country's first peacetime draft.", "From 1940 until 1973, during both peacetime and periods of conflict, men were drafted to fill vacancies in the United States Armed Forces that could not be filled through voluntary means.", "The draft came to an end when the United States Armed Forces moved to an all-volunteer military force.", "However, the Selective Service System remains in place as a contingency plan; all male civilians between the ages of 18 and 25 are required to register so that a draft can be readily resumed if needed.", "United States Federal Law also provides for the compulsory conscription of men between the ages of 17 and 45 and certain women for militia service pursuant to Article I, Section 8 of the United States Constitution and 10 U.S. Code \u00a7 246.", "In colonial times, the Thirteen Colonies used a militia system for defense." ] ], "gold": "Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in six conflicts: the American Revolutionary War, the American Civil War, World War I, World War II, the Korean War, and the Vietnam War. With the end of active U.S. ground participation in Vietnam, December 1972 saw the last men conscripted, who were born in 1952 and earlier. In January 1973, Secretary of Defense Melvin Laird announced that no further draft orders would be issued. In March 1973, 1974, and 1975, the Selective Service assigned draft priority numbers for all men born in 1954, 1955, and 1956, in case the draft was extended, but it never was.", "prediction 1": "Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts. The draft came to an end when the United States Armed Forces moved to an all-volunteer military force. During the Korean War and the Vietnam War, draft orders were issued to men born on or after January 1, 1960. From 1940 until 1973, men were drafted to fill vacancies in the United States Armed Forces that could not be filled through voluntary means. The draft came to an end when the United States moved to an all-volunteer military force.", "prediction 2": "In the United States, the draft was used during the American Revolution, the American Civil War, World War I, World War II, the Cold War, and both the Korean War and the Vietnam War. The draft came to an end when the United States Armed Forces moved to an all-volunteer military force. However, the Selective Service System remains in place as a contingency plan for all male civilians between the ages of 18 and 25 are required to register so that a draft can be readily resumed if needed.", "prediction 3": "The draft, commonly known as the draft, has been employed by the federal government of the United States in five conflicts. It has served as the basis for conscription in the United States during the American Revolution, the American Civil War, World War I, World War II, and the Cold War (including both the Korean War and the Vietnam War). On February 2, 1972, a drawing was held to determine draft priority numbers for men born in 1953, but in early 1973 it was announced by Secretary of Defense Melvin Laird that no further draft orders would be issued. On July 2, 1980, President Jimmy Carter issued Presidential Proclamation 4771 and re-instated the requirement that young men register with the Selective Service System.", "prediction 4": "The draft was a type of military service performed by a voluntary process. The draft came to an end when the United States Armed Forces moved to an all-volunteer military force. On July 2, 1980, President Jimmy Carter issued Presidential Proclamation 4771 and re-instated the requirement that young men register with the Selective Service System.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 359 }, { "error type": "Irrelevant", "explanation": "", "start": 360, "end": 500 }, { "error type": "Irrelevant", "explanation": "", "start": 501, "end": 590 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Conscription in the United States, commonly known as the draft, has been employed by the federal government of the United States in five conflicts: the American Revolution, the American Civil War, World War I, World War II, and the Cold War (including both the Korean War and the Vietnam War). With the end of active U.S. ground participation in Vietnam, December 1972 saw the last men conscripted, who were born in 1952 and earlier. In January 1973, Secretary of Defense Melvin Laird announced that no further draft orders would be issued. In March 1973, 1974, and 1975, the Selective Service assigned draft priority numbers for all men born in 1954, 1955, and 1956, in case the draft was extended, but it never was." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does ant and decs saturday night takeaway start?", "passages": [ [ "Ant & Dec's Saturday Night Takeaway", "Ant & Dec's Saturday Night Takeaway\n\nAnt & Dec's Saturday Night Takeaway (referred to simply as Saturday Night Takeaway or SNT) is a British television variety show, presented by Ant & Dec, both of whom also act as the show's executive producers, and broadcast on ITV since its premiere on 8 June 2002.", "Its format is heavily influenced by previous Saturday night light entertainment shows, most notably \"Noel's House Party\" and \"Don't Forget Your Toothbrush\", while individual items often pay homage to Saturday night TV of the past, such as \"Opportunity Knocks\".", "The show is notable for a quiz show in which a random member of the studio audience can win prizes based on television adverts, and for a competition in each series between the two presenters.", "An official \"Saturday Night Takeaway\" iOS app for iPod, iPhone and iPad was released on 15 February 2013.", "Despite the programme enduring a three-year hiatus between 2010\u20132012, while its presenters worked on other projects, it was an immense success for the broadcaster since its launch.", "Over the course of its history, it earned notable awards, including Best Presenters at the 18th National Television Awards on 23 January 2013, and the BAFTA for Entertainment Programme, alongside the presenters winning the award for Entertainment Performance in 2014 and 2015 respectively." ], [ "Ant & Dec's Saturday Night Takeaway", "Since its thirteenth series in 2016, the show has aired its series finale outside of the UK.", "In 2017, \"Saturday Night Takeaway\" became the first UK show to be aired live from Walt Disney World, which it repeated again in 2018 for its series finale being aired live from Universal Orlando.", "On 3 March 2018, the show celebrated its 100th episode, while the penultimate episode of the fifteenth series on 31 March was the final one to be aired from The London Studios, before the studio's closure for redevelopment as had been announced in February 2017.", "Starting from the sixteenth series, the programme will be aired from the newly redeveloped Television Centre; it is currently scheduled to start airing in 2020, following the decision by Anthony McPartlin to suspend his TV duties.", "The general set up for each episode is a selection of segments consisting of specially crafted games, comedy/entertainment films, participation by either a studio audience member, or unsuspecting viewer/public member, and a show finale consisting of a performance by a musician, dance group, singer, or group performers.", "Episodes of \"Saturday Night Takeaway\" are broadcast live during the weekend, during a prime time slot on Saturday evenings for the entire run of a series." ], [ "Pick of the Pops", "On 24 September 2010, it was announced that Tony Blackburn would take over \"Pick of The Pops\", and be continued to be produced by Swern.", "Although the show was pre-recorded during the Winton era, from January 2011 the show was mostly broadcast live, which allowed Blackburn to interact with his listeners.", "In August 2015 \"Pick of the Pops\" got a new producer Tom Du Croz after 18 years of Phil Swern producing on his own.", "Tony featured 1956 to 1992.", "Blackburn was fired by the BBC in February 2016.", "Paul Gambaccini took over \"Pick of The Pops\" in July 2016.", "In 2016, it was announced that the show was now being produced by 7 Digital Productions.", "Paul also features Billboard charts along with The UK 20 twenty normally in the first hour then the Billboard chart in the second hour, over the Christmas/ New Year period, he has featured 1965, 1970, 1975 & 1982.", "He features charts from 1958 to 2006 and also tells listeners what was number one in America giving a nod to his long running show \"America's Greatest Hits\".", "On 6 January and 24 February 2018, Paul missed \"Pick of the Pops\" for the first time in the show's history since 1992 due to snow and ill health, Mark Goodier covered on both occasions." ] ], "gold": "Ant & Dec's Saturday Night Takeaway is a British television variety show that premiered on 8 June 2002. Series 15 of the show started on 24 February 2018 and the 100th episode was celebrated soon after, on 3 March 2018. During the finale of the seventeenth season, it was announced that Saturday Night Takeaway will return in 2022.", "prediction 1": "In the United Kingdom, ant & decs Saturday Night Takeaway began airing on 8 June 2002. Starting from the sixteenth series, the show will be aired from the newly redeveloped Television Centre, and will start airing in 2020, following the decision by Anthony McPartlin to suspend his TV duties.", "prediction 2": "ANT & DEC's Saturday Night Takeaway is a British television variety show, presented by Ant & Dec, both of whom also act as the show's executive producers. Episodes of Saturday Night Takeaway are broadcast live during the weekend, during a prime time slot on Saturday evenings for the entire run of a series. Starting from the sixteenth series, the programme will be aired from the newly redeveloped Television Centre; it is currently scheduled to start airing in 2020, following the decision by Anthony McPartlin to suspend his TV duties.", "prediction 3": "The British television variety show Ant & Dec's Saturday Night Takeaway, often simply known as Saturday Night Takeaway, was introduced on 8 June 2002. It has aired thirteen series, in which the show featured performances by musicians, dance groups, singers, and group performers. The program began airing on ITV2 on January 13, 2003, and then continued until March 8, 2016.", "prediction 4": "The British television variety show, Ant & Dec's Saturday Night Takeaway, is presented by Ant & Dec, both of whom also act as the show's executive producers, and broadcast on ITV since its premiere on 8 June 2002. The show's format is heavily influenced by previous Saturday night light entertainment shows, most notably \"Noel's House Party\" and \"Don't Forget Your Toothbrush\", while individual items often pay homage to Saturday night TV of the past, such as \"Opportued live from Walt Disney World, which it repeated again in 2018 for its series finale being aired live from Universal Orlando. Starting from the sixteenth series, the programme will be aired from the newly redeveloped Television Centre; it is currently scheduled to start airing in 2020, following the decision by Anthony McPartlin to suspend his TV duties.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 292 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the United Kingdom, ant & decs Saturday Night Takeaway began airing on 8 June 2002. On 3 March 2018, the show celebrated its 100th episode. It will start airing in 2020. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is panama canal located on the map?", "passages": [ [ "Panama Canal", "Almost immediately, the treaty was condemned by many Panamanians as an infringement on their country's new national sovereignty.", "This would later become a contentious diplomatic issue among Colombia, Panama, and the United States.", "President Roosevelt famously stated, \"I took the Isthmus, started the canal and then left Congress not to debate the canal, but to debate me.\"", "Several parties in the United States called this an act of war on Colombia: The \"New York Times\" described the support given by the United States to Bunau-Varilla as an \"act of sordid conquest.\"", "The \"New York Evening Post\" called it a \"vulgar and mercenary venture.\"", "The US maneuvers are often cited as the classic example of US gunboat diplomacy in Latin America, and the best illustration of what Roosevelt meant by the old African adage, \"Speak softly and carry a big stick [and] you will go far.\"", "After the revolution in 1903, the Republic of Panama became a US protectorate until 1939.", "In 1904, the United States purchased the French equipment and excavations, including the Panama Railroad, for US$40 million, of which $30 million related to excavations completed, primarily in the Gaillard Cut (then called the Culebra Cut), valued at about $1.00 per cubic yard." ] ], "gold": "On a map, you will find the Panama Canal connecting the Atlantic Ocean and the Pacific Ocean in the country of Panama.", "prediction 1": "Panama Canal is located in Central America. The Panama Canal was created in 1886, and it is located at a distance of 7.5 miles (16 km) from the Panamanian coast.", "prediction 2": "The Panama Canal is located in the Republic of Panama and is located in the State of Panama.", "prediction 3": "Panama Canal is a canal that connects the Panama Canal to the Caribbean Sea. According to the United States, the Panama Canal is located between the islands of Panama and Colombia.", "prediction 4": "Panama Canal is located in the Republic of Panama and is the largest canal in the world. It is located in the Isthmus of Panama.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 43 }, { "error type": "Unverifiable", "explanation": "", "start": 44, "end": 161 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who founded some of the first movements toward independent living and disability rights?", "passages": [ [ "Independent living", "The first Independent Living ideologists and organizers were people with extensive disabilities (e.g., Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden) and of course, early friends and collaborators in the 1970s (Julie Ann Racino) and university and government supporters throughout the 1980s and 1990s.", "Ed Roberts was a quadriplegic who dealt with discrimination in many different aspects of his life.", "His fight for acceptance in schools, however, is what Roberts is most well known for.", "In high school, Roberts was stopped from graduating because he could not complete his gym requirement, as he was paralyzed and spent most of his time in an iron lung.", "His biggest educational challenge came when he was accepted at college.", "After struggling to get accepted, the UCBerkeley refused to give Roberts financial aid.", "He then sued Berkeley for access and integration.", "Although he won the case, Roberts was housed in school's infirmary instead of the dorms.", "As others with disabilities started attending the school and living in the infirmary, an activist group called the Rolling Quads was formed.", "They ended up starting the Disabled Students' Program, a resource for those with disabilities that was run by people with disabilities.", "This program led to the first independent living center in America being made, the Berkeley Center for Independent Living." ] ], "gold": "The ones who founded some of the first movements toward independent living and disability rights were people with extensive disabilities themselves, Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden.", "prediction 1": "Some of the first movements towards independent living and disability rights were founded by people with extensive disabilities, such as Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden, and Julie Ann Racino. They were early friends and collaborators in the 1970s, early university and government supporters throughout the 1980s and 1990s.", "prediction 2": "The first Independent Living ideologists and organizers were people with extensive disabilities (e.g., Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden) and of course, early friends and collaborators in the 1970s (Julie Ann Racino) and university and government supporters throughout the 1980s and 1990s.", "prediction 3": "Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden and Julie Ann Racino were some of the first people with extensive disabilities to advocate for independent living and disability rights.", "prediction 4": "Ed Roberts was a quadriplegic who dealt with discrimination in many different aspects of his life. His fight for acceptance in schools is what Roberts is most well known for. As others with disabilities started attending the school and living in the infirmary, an activist group called the Rolling Quads was formed. They ended up starting the Disabled Students' Program, a resource for those with disabilities that was run by people with disabilities. This program led to the first independent living center in America being made, the Berkeley Center for Independent Living.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 341 } ], "missing-info": [], "corrected-prediction": "Some of the first movements towards independent living and disability rights were founded by people with extensive disabilities, such as Ed Roberts, Judith Heumann, Peg Nosek, Lex Frieden. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Organization that tracks santas flight on christmas eve?", "passages": [ [ "NORAD Tracks Santa", "Each video was accompanied by a voice-over until the end of the 2011 season, typically done by NORAD personnel, giving a few facts about the city or country depicted.", "In 2012 the voice overs were replaced with music done by the US Air Force Band.", "The voice overs returned in the 2013 season.", "Celebrity voice-overs have also been used over the years.", "For the London \"Santa Cam\" video, English television personality and celebrity Jonathan Ross did the voice-over for 2005 to 2007 and the former Beatles drummer Ringo Starr narrated the same video in 2003 and 2004.", "In 2002, Aaron Carter provided the voice-over for three videos.", "The locations and landmarks depicted in some of the \"Santa Cam\" videos have changed over the years.", "In 2009, twenty-nine \"Santa Cam\" videos were posted on the website.", "In previous years, twenty-four to twenty-six videos had been posted.", "Since 2012, Analytical Graphics, Inc. has used their Cesium platform to build a 3D map for visualizing Santa's location with more accurate global terrain and satellite imagery than before.", "NORAD reported that for Christmas 2013, it logged 19.58 million unique visitors to its website on Christmas Eve, and 1,200 volunteers answered 117,371 calls.", "Through social media, it had 146,307 Twitter followers and 1.45 million \"likes\" on Facebook." ], [ "NORAD Tracks Santa", "NORAD Tracks Santa\n\nNORAD Tracks Santa is an annual Christmas-themed program, which has existed since 1955, produced by the North American Aerospace Defense Command (NORAD).", "Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world.", "The program is in the tradition of the September 1897 editorial \"Yes, Virginia, there is a Santa Claus\" in the \"New York Sun\".", "On December 24, 1948, the United States Air Force issued a communique claiming that an \"early warning radar net to the north\" had detected \"one unidentified sleigh, powered by eight reindeer, at 14,000 feet , heading 180 degrees.\"", "The Associated Press passed this \"report\" along to the general public.", "It was the first time that the United States Armed Forces issued a statement about tracking Santa Claus's sleigh on Christmas Eve, although it was a one-time event, not repeated over the next several years.", "The program originated before the actual formation of NORAD, as an annual event on December 24, 1955.", "According to legend, a Sears department store placed an advertisement in the Colorado Springs newspaper \"The Gazette\", which told children that they could place a call to Santa Claus and included the number \"ME 2-6681\"." ] ], "gold": "Since 1955, every year on Christmas Eve, NORAD claims to track Santa Claus leaving the North Pole as he journeys around the world on his mission to deliver presents to children. Since 2012, Analytical Graphics, Inc. has been using its Cesium platform to build a 3D map for visualizing Santa's location with more accurate global terrain and satellite imagery than before.", "prediction 1": "NORAD Tracks Santa is an annual Christmas-themed program that has existed since 1955 and is produced by the North American Aerospace Defense Command (NORAD). Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world. The program originated before the actual formation of NORAD, as an annual event on December 24, 1955. On December 24, 1948, the United States Air Force issued a communique claiming that an \"early warning radar net to the north\" had detected \"one unidentified sleigh, powered by eight reindeer, at 14,000 feet, heading 180 degrees\".", "prediction 2": "NORAD Tracks Santa is an annual Christmas-themed program, which has existed since 1955, produced by the North American Aerospace Defense Command (NORAD). Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world. The program originated before the actual formation of NORAD, as an annual event on December 24, 1955.", "prediction 3": "NORAD Tracks Santa is an annual Christmas-themed program, which has existed since 1955, produced by the North American Aerospace Defense Command (NORAD). Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world. NORAD originally started the program in 1941 and the program moved into the early 1980s.", "prediction 4": "NORAD Tracks Santa is an annual Christmas-themed program, which has existed since 1955, produced by the North American Aerospace Defense Command (NORAD). Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world. The program originated before the actual formation of NORAD, as an annual event on December 24, 1955. The program originated before the actual formation of NORAD, as an annual event.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 393 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 623 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "NORAD Tracks Santa is an annual Christmas-themed program that has existed since 1955. Every year on Christmas Eve, NORAD tracks Santa Claus as he leaves the North Pole and delivers presents to children around the world. Since 2012, Analytical Graphics, Inc. has used their Cesium platform to build a 3D map for visualizing Santa's location with more accurate global terrain and satellite imagery than before." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who's performing the halftime show at super bowl 52?", "passages": [ [ "Super Bowl LII halftime show", "Super Bowl LII halftime show\n\nThe Super Bowl LII Halftime Show (officially known as the Pepsi Super Bowl LII Halftime Show) took place on February 4, 2018 at U.S. Bank Stadium in Minneapolis, Minnesota, as part of Super Bowl LII.", "Justin Timberlake was the featured performer, as confirmed by the National Football League (NFL) on October 22, 2017.", "It was televised nationally by NBC.", "It received four nominations at the 70th Primetime Emmy Awards.", "The show began with Jimmy Fallon introducing Justin Timberlake, followed by a video screen depicting Timberlake performing \"Filthy\" in a club setting below the field level of the stadium.", "He then walked up a staircase and appeared on a ramp stage extending outward into the field, descending into a series of stages surrounded by a crowd.", "Timberlake proceeded to move through the crowd performing \"Rock Your Body\" with a troupe of female backup dancers, abruptly stopping short of the end of the song and shifting to \"Se\u00f1orita\" on a small stage with his backing dancers.", "Upon reaching the main stage, he performed a number of songs, including \"SexyBack\", \"My Love\", and \"Cry Me a River\", which featured a dance break mid-field." ] ], "gold": "Justin Timberlake and the University of Minnesota Marching Band will be performing the halftime show at Super Bowl 52.", "prediction 1": "The Super Bowl LII Halftime Show was performed by American singer Justin Timberlake on February 4, 2018.", "prediction 2": "The Super Bowl 52 Halftime Show, officially known as the Pepsi Super Bowl LII Halftime Show, took place on February 4, 2018 at U.S. Bank Stadium in Minneapolis, Minnesota, as part of Super Bowl LII. Justin Timberlake was the featured performer, as confirmed by the National Football League (NFL) on October 22, 2017.", "prediction 3": "The Super Bowl LII Halftime Show, officially known as the Pepsi Super Bowl LII Halftime Show, took place on February 4, 2018 at U.S. Bank Stadium in Minneapolis, Minnesota, as part of Super Bowl LII. Justin Timberlake was the featured performer, as confirmed by the National Football League (NFL) on October 22, 2017. Jimmy Fallon introducing Timberlake, followed by a video screen depicting Timberlake performing \"Filthy\" in a club setting below the field level of the stadium.", "prediction 4": "The Super Bowl LII Halftime Show, officially known as the Pepsi Super Bowl LII Halftime Show, took place on February 4, 2018 at U.S. Bank Stadium in Minneapolis, Minnesota, as part of Super Bowl LII. Justin Timberlake was the featured performer, as confirmed by the National Football League (NFL) on October 22, 2017. The show began with Jimmy Fallon introducing Timberlake, followed by a video screen depicting Timberlake performing \"Filthy\" in a club setting below the field level below the field level, descending into a series of stages surrounded by a crowd.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 104 } ], "missing-info": [], "corrected-prediction": "The Super Bowl LII Halftime Show was performed by American singer Justin Timberlake." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who introduced the two-part system (genus and species) that biologists use to name organisms?", "passages": [ [ "Genus", "Genus\n\nA genus (, \u00a0genera ) is a taxonomic rank used in the biological classification of living and fossil organisms, as well as viruses, in biology.", "In the hierarchy of biological classification, genus comes above species and below family.", "In binomial nomenclature, the genus name forms the first part of the binomial species name for each species within the genus.", "The composition of a genus is determined by a taxonomist.", "The standards for genus classification are not strictly codified, so different authorities often produce different classifications for genera.", "There are some general practices used, however, including the idea that a newly defined genus should fulfill these three criteria to be descriptively useful:\n\n", "Moreover, genera should be composed of phylogenetic units of the same kind as other (analogous) genera.", "The term comes from the Latin ' (\"origin, type, group, race\"), a noun form cognate with ' (\"to bear; to give birth to\").", "Linnaeus popularized its use in his 1753 \"Species Plantarum\", but the French botanist Joseph Pitton de Tournefort (1656\u20131708) is considered \"the founder of the modern concept of genera\".", "The scientific name of a genus is also called the generic name; it is always capitalised.", "It plays a pivotal role in binomial nomenclature, the system of naming organisms." ], [ "Binomial nomenclature", "Binomial nomenclature\n\nBinomial nomenclature (\"two-term naming system\") also called nomenclature (\"two-name naming system\") or binary nomenclature, is a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages.", "Such a name is called a binomial name (which may be shortened to just \"binomial\"), a binomen, name or a scientific name; more informally it is also called a Latin name.", "The first part of the name \u2013 the \"generic name\" \u2013 identifies the genus to which the species belongs, while the second part \u2013 the specific name or specific epithet \u2013 identifies the species within the genus.", "For example, humans belong to the genus \"Homo\" and within this genus to the species \"Homo sapiens\".", "\"Tyrannosaurus rex\" is probably the most widely known binomial.", "The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753.", "But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinax theatri botanici\" (English, \"Illustrated exposition of plants\") many names of genera that were later adopted by Linnaeus." ] ], "gold": "French botanist Joseph Pitton de Tournefort is considered the founder of the modern concept of genera, though Carl Linnaeus popularized it in his 1753 species plantarum.", "prediction 1": "The formal introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753. But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinax theatri botanici\" (English, \"Illustrated exposition of plants) many names of genera that were later adopted by Linnaeus. In the formal introduction, Linnaeus introduced the two-part system of naming species.", "prediction 2": "The two-part system that biologists use to name organisms is called binomial nomenclature, or binary nomenclature. In the formal introduction of the system, the naming of species is credited to Carl Linnaeus. But Gaspard Bauhin had introduced in as early as 1623, many names of genera that were later adopted by Linnaeus.", "prediction 3": "Binomial nomenclature, which means \"two-term naming system,\" or binary nomenclature, is a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages. The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753. But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinatri botanici\" many names of genera that were later adopted by Linnaeus.", "prediction 4": "Binomial nomenclature is a system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages. The formal introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753. But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinax theatri botanici\" many names of genera that were later adopted by Linnaeus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 347 }, { "error type": "Redundant", "explanation": "The formal introduction of this system of naming species is credited to Carl Linnaeus", "start": 348, "end": 434 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The formal introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753, however, French botanist Joseph Pitton de Tournefort is considered the founder of the modern concept of genera,." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who plays the man in the yellow hat on curious george?", "passages": [ [ "Curious George", "He is always seen wearing a bright yellow suit and a wide brimmed yellow hat.", "The Man is never mentioned by name in the original adventures or in any subsequent content over more than six decades.", "He is always referred to as \"The Man\" or fully \"The Man with the Yellow Hat\".", "When people speak to George about the Man, they often refer to him as \"Your friend\", though the Man is more like a father to George.", "However, in \"Curious George\" (2006), the Man, who is voiced by Will Ferrell, is referred to as \"Ted\" throughout the film, and his last name is revealed as being \"Shackleford\" in a deleted scene.", "There was a series of animated television films made (beginning in 1980) featuring the character, which were then adapted into books themselves (making up part of the New Adventures series listed above).", "This series was produced and co-written by Alan Shalleck.", "A series of Curious George animated shorts were aired on The Disney Channel as a segment on the program \"Lunch Box\" from the late 1980s into the 1990s.", "On Playhouse Disney (now Disney Junior), Jack Duffy narrated a 2D animated story version of Curious George which had different episodes from the book series that were written by H.A. Rey and Margret Rey." ], [ "Curious George", "In this film (in which The Man is referred to as \"Ted\"), Curious George secretly follows The Man onto the ship to the city on his own accord.", "Frank Welker provided the vocal effects of Curious George.", "On March 2, 2010, a direct to video sequel to the film was released, titled \"\", which featured Jeff Bennett replacing Ferrell as the voice of the Man.", "Bennett also provides the Man's voice in the television series.", "The second direct to video sequel, \"\", was released on June 23, 2015.", "A Christmas film, \"\", was released in 2009 on PBS.", "\"Curious George Swings Into Spring\" and \"Curious George: A Halloween Boo Fest\" were released in 2013.", "On Monday August 6, It began to re-run on Cartoonito.", "A live action/computer animated film was in development at Illumination Entertainment in the beginning of the 2010s.", "In August 2016, it was reported that Andrew Adamson was in negotiations to direct, co-write, and executive produce a live action film for Universal Pictures, along with Ron Howard, Brian Grazer, David Kirschner, Jon Shapiro and Erica Huggins producing." ], [ "Curious George (TV series)", "Curious George (TV series)\n\nCurious George is an American animated educational children's television series based on the children's book series of the same name which features Jeff Bennett as the voice of The Man with the Yellow Hat.", "Frank Welker, who voiced George in the 2006 feature film, returns as the voice of George.", "The series has no connection to the 2006 film of the same name.", "As of October 2018, reruns of the show are still broadcasting on PBS Kids.", "The show premiered on September 4, 2006, and ended on April 1, 2015.", "\"Curious George\" is a production of Universal 1440 Entertainment (Universal Studios Family Productions before 2013), Imagine Entertainment, and WGBH Boston, and animated by Toon City.", "Each episode has two short cartoons per half hour episode, and a live action segment after each story.", "The pilot and the production began in 2005, and the copyrighted byline was created in July 2005.", "After the TV show ends, the series illustrates and explains various concepts in math and science, and each live-action segment shows schoolchildren engaging in experiments, that teach the math or science concept featured in the previous cartoon." ], [ "Curious George (franchise)", "Curious George (franchise)\n\nCurious George is a multi-media franchise based on the book series of the same name by H. A. Rey and Margret Rey.", "The series began with the 2006 theatrical release of \"Curious George\".", "The film's success led it to receiving two direct-to-video sequels, a television series (which aired three specials during its run) as well as a video game." ] ], "gold": "Curious George is an American media franchise based on the book series of the same name by H. A. Rey and Margret Rey, which began with the 2006 theatrical release of Curious George. The film's success led it to receive direct-to-video sequels, as well as a television series. The Man in the Yellow Hat is a character within this franchise, which Will Ferrell plays in the 2006 movie. The role was later passed to Jeff Bennett, who portrayed him in Curious George 2: Follow That Monkey and the Curious George TV show.", "prediction 1": "Curious George is an American animated educational children's television series based on the book series Curious George. In the film, Will Ferrell plays the character. In the television series, Jeff Bennett plays the character, The Man with the Yellow Hat. In the video game, the character is voiced by Eric Brecht.", "prediction 2": "Curious George is an American animated children's television series based on the children's book series of the same name that features Jeff Bennett as the voice of the Man with the Yellow Hat. Previously, Will Ferrell played the Man with the Yellow Hat on the 2006 film, Curious George. Bennett replaced Ferrell as the voice of the Man with the Yellow Hat on the television series. In the 2006 film, the Man was voiced by Will Ferrell. In the 2015 television series, the Man was voiced by Frank Welker. The Man was voiced by Jeff Bennett.", "prediction 3": "Curious George is an American animated educational children's television series based on the children's book series of the same name. The 2006 film Curious George, voiced by Will Ferrell, features the titular character, The Man, wearing a bright yellow suit and a wide brimmed yellow hat, in the original adventures and in subsequent content over more than six decades. In the television series, the Man is always referred to as \"The Man\" or fully \"The Man with the Yellow Hat\". In the 2010 direct to video sequel, the Man with the yellow hat is voiced by Jeff Bennett. In the 2014, a live-action animated film, was produced and co-written and executive produced by Toon City.", "prediction 4": "Curious George is an American animated educational children's television series based on the children's book series of the same name that features Jeff Bennett as the voice of The Man with the Yellow Hat. Frank Welker, who voiced George in the 2006 feature film, returns as the voice of George. In the original Curious George film, The Man is voiced by Will Ferrell. In the sequel, Jeff Bennett replaces Ferrell as the voice of the Man.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 207, "end": 212 }, { "error type": "Unverifiable", "explanation": "", "start": 303, "end": 315 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 3 ] } ], "corrected-prediction": "Curious George is an American animated educational children's television series, and multi-media franchise, based on the book series Curious George, written by H.A. Rey and Margret Rey. In the 2006 film, Will Ferrell plays the character. The film's success led it to receiving two direct-to-video sequels, a television series as well as a video game. In the television series, Jeff Bennett voice the character, The Man with the Yellow Hat. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who has the most touchdowns passes in the nfl?", "passages": [ [ "Eli Manning", "Eli Manning\n\nElisha Nelson Manning IV\n(born January 3, 1981) is an American football quarterback for the New York Giants of the National Football League (NFL).", "He played college football at the University of Mississippi from 2000 to 2003.", "He was drafted as the first overall pick in the 2004 NFL Draft by the San Diego Chargers and was immediately traded to the Giants who in return gave up a package, highlighted by fourth overall selection Philip Rivers.", "Manning is the son of former NFL quarterback Archie Manning and the younger brother of former NFL quarterback Peyton Manning.", "Manning holds Giants franchise records for most passing yards, touchdown passes, and completed passes in a career.", "He led the Giants to victory in Super Bowls XLII and XLVI, defeating the New England Patriots in both games.", "Manning was named Most Valuable Player in each Super Bowl, becoming one of five players to have multiple Super Bowl MVP awards (Bart Starr and Terry Bradshaw also have two, Joe Montana three and Tom Brady four).", "Manning started 210 straight games from 2004 to 2017, the second-longest consecutive starts streak by a quarterback in NFL history.", "He is the seventh all-time leader in passing yards and touchdowns.", "Though lacking his brother's regular season consistency and high-caliber performances, Manning is known for his two improbable Super Bowl winning postseason runs.", "Manning attended and played high school football at Isidore Newman School." ], [ "Associated Press NFL Offensive Player of the Year Award", "Players are often awarded after record-breaking or near-record-breaking offensive seasons.", "Running back O. J. Simpson won the award for 1973 after rushing for a record 2,003 yards, becoming the first NFL player to rush for 2,000 yards in a season.", "When his record was broken by Eric Dickerson in 1984, Dickerson placed second in voting behind quarterback Dan Marino, who that year was the first to pass for 5,000 yards in a season.", "Marino's 5,084 yards stood as the record for 27 years before being broken by Drew Brees in 2011, who won that season's award.", "In turn, 2013 winner Peyton Manning set league single-season records for passing yards (5,477) and passing touchdowns (55)." ] ], "gold": "Drew Brees has the most touchdown passes in the NFL regular season, while Tom Brady has the most touchdown passes including the postseason.", "prediction 1": "Elisha Nelson Manning IV, an American football quarterback for the New York Giants, holds the most touchdown passes in a career with 67.", "prediction 2": "The quarterback in the NFL with the most touchdown passes is Eli Manning with 59. The quarterback with the most touchdown passes in a career is Dan Marino with 559.", "prediction 3": "The quarterback with the most touchdown passes in the NFL is Eli Manning. Manning holds the Giants franchise record for most passing yards, touchdown passes, and completed passes in a career. The player with the most touchdown passes in the NFL is Eric Dickerson. The player with the most touchdown passes in the NFL is Peyton Manning.", "prediction 4": "The quarterback with the most touchdown passes in a career is Eli Manning. He holds the record for most touchdown passes in a career with 67.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 83 }, { "error type": "Unverifiable", "explanation": "", "start": 94, "end": 136 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "2013 winner Peyton Manning set league single-season records for passing touchdowns (55)." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the lyrics to light my fire?", "passages": [ [ "Light My Fire", "The single originally reached number 49 in the UK in 1967, but experienced belated success in that country in 1991, when a reissue peaked at number 7.", "This reissue was more successful in Ireland, peaking atop the IRMA chart for two weeks in June.", "The reissue occurred due to a revived interest in the band following Oliver Stone's film biopic \"The Doors\".", "The song is ranked at number 35 on \"Rolling Stone\"'s list of the 500 Greatest Songs of All Time.", "It was included in the Songs of the Century list, ranking number 52.", "Feliciano's cover version won a 1969 Grammy Award for Best Male Pop Vocal Performance, the same year he won another Grammy for Best New Artist.", "The song originated as a Robby Krieger composition, with Jim Morrison writing the second verse.", "Although the album version was just over seven minutes long, it was widely requested for radio play, so a single version was edited to under three minutes with nearly all the instrumental break removed for airplay on AM radio.", "Ray Manzarek played the song's bass line with his left hand on a Fender Rhodes Piano Bass, while performing the other keyboard parts on a Vox Continental using his right hand.", "After the recording session, producer Paul A. Rothchild brought in session musician Larry Knechtel to overdub a Fender Precision Bass guitar to double the keyboard bass line." ], [ "Light My Fire", "Light My Fire\n\n\"Light My Fire\" is a song by American rock band the Doors, which was recorded in August 1966 and released in January 1967 on their self-titled debut album.", "Released as an edited single on April 24, 1967, it spent three weeks at number 1 on the \"Billboard\" Hot 100 chart in late July, and one week on the Cash Box Top 100, nearly a year after its recording.", "A year later, it re-entered the Billboard Hot 100 in 1968 following the success of Jos\u00e9 Feliciano's version of the song (which peaked at number 3 on the Billboard chart), peaking at number 87.", "The song was largely written by the band's guitarist Robby Krieger, and was credited to the entire band.", "The single was certified gold by the Recording Industry Association of America in September 1967 for 500,000 units shipped.", "As of December 1971, it was the band's best-selling single; with over 927,000 copies sold.", "The single was certified Platinum by the Recording Industry Association of America in September 2018 for 2,000,000 units shipped.", "A live version was released in 1983 on their album \"Alive, She Cried\", the first of several live albums released in subsequent decades to include the song.", "\"Light My Fire\" achieved modest success in Australia, where it peaked at number 22 on the ARIA chart." ], [ "Boyzone", "Boyzone\n\nBoyzone are an Irish boy band.", "Their most famous line-up was composed of Keith Duffy, Stephen Gately, Mikey Graham, Ronan Keating, and Shane Lynch.", "Boyzone have had 21 singles in the top 40 UK charts and 22 singles in the Irish charts.", "The group have had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2.", "Boyzone are one of the most successful bands in Ireland and the United Kingdom.", "In total, Boyzone had 19 top 5 singles on the Irish Singles Chart, 18 top 10 hits on the UK Singles Chart, nine No. 1", "Irish hit singles and six No. 1 UK hit singles and five No. 1 albums, with 25 million records sold by 2013 worldwide.", "They were put together in 1993 by Louis Walsh, who is also known for managing Johnny Logan and Westlife.", "Before even recording any material, Boyzone made an appearance on RT\u00c9's \"The Late Late Show\".", "The group split in 1999.", "Boyzone made a comeback in 2007, originally with the intention of just touring.", "The band have sold 2 million records since their return.", "Gately died on 10 October 2009 of natural causes while on holiday in the Spanish island of Majorca with his civil partner, Andrew Cowles." ], [ "Light My Fire (Kotoko song)", "Light My Fire (Kotoko song)\n\n\"Light My Fire\" is Kotoko's 17th single released on November 16, 2011, under Warner Music Japan.", "The A-side of the single was used as the opening of \"Shakugan no Shana Final\".", "\"Light My Fire\" was written and composed by Ryo of Supercell." ] ], "gold": "There a few songs called \"Light My Fire\", however, the first one originated in 1966 written by Robby Krieger, of the American rock band The Doors. The song was recorded in 1967 Released as an edited single on April 24, 1967, it spent three weeks at number one on the Billboard Hot 100 chart, a year later, it re-entered the Billboard Hot 100 in 1968 following the success of Jos\u00e9 Feliciano's cover version of the song which was principally written by the band's guitarist, Robby Krieger, but was credited to the entire band, Jim Morrison, John Densmore and Ray Manzarek. In 1993 Gianfranco Bortolotti, Antonio Puntillo, Carl Fanini, and Mauro Picotto of Italian group Club House, wrote \"Light My Fire\" is a song by Italian group Club House. November 16, 2011, \"Light My Fire\" written and composed by Ryo of Supercell, was released under Warner Music Japan. ", "prediction 1": "Light My Fire is a song by American rock band the Doors, which was recorded in August 1966 and released in January 1967 on their self-titled debut album. The song was largely written by the band's guitarist Robby Krieger, with Jim Morrison writing the second verse. Light My Fire is also a song by Japanese boy band Kotoko, whose 17th single released on November 16, 2011, under Warner Music Japan, was written and composed by Ryo of Supercell.\n", "prediction 2": "The lyrics to the song \"Light My Fire\" were written by Jim Morrison and Robby Krieger. Morrison wrote the melody and Jim Morrison wrote the verse. The song was originally written as a composition by the band's guitarist Robby Krieger, with Jim Morrison writing the second verse. In 1998, the Doors released a new version of the song, Light My Fire, and in 2011, Kotoko released a new song called \"Light My Fire\", in which the chorus is written by Ryo.", "prediction 3": "The song Light My Fire was written by Robby Krieger, with Jim Morrison writing the second verse. Light My Fire is also the title of a song by English pop group, The Doors, released in January 1967, and a 1984 version by Boyzone in Ireland. Though the song was written by Krieger, Tommy Townsend also wrote the lyrics. Kotoko wrote the lyrics and perform the song \"Light My Fire\" for their 17th single released on November 16, 2011.", "prediction 4": "\"Light My Fire\" is a song by American rock band the Doors, which was recorded in August 1966 and released in January 1967 on their self-titled debut album. Released as an edited single on April 24, 1967, it spent three weeks at number 1 on the Billboard Hot 100 chart in late July, and one week on the Cash Box Top 100, nearly a year after its recording. A live version was released in 1983 on their album \"Alive, She Cried.\" \"Light My Fire\" is Kotoko's 17th single released on November 16, 2011. Song \"Light My Fire\" was written and composed by Ryo of Supercell.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 372 }, { "error type": "Unverifiable", "explanation": "", "start": 298, "end": 315 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "Light My Fire is a song by American rock band the Doors, which was recorded in August 1966 and released in January 1967 on their self-titled debut album. The song was largely written by the band's guitarist Robby Krieger, with Jim Morrison writing the second verse. Released as an edited single on April 24, 1967, it spent three weeks at number 1 on the \"Billboard\" Hot 100 chart. A year later, it re-entered the Billboard Hot 100 in 1968 following the success of Jos\u00e9 Feliciano's version of the song. Light My Fire is also a song by Kotoko, released under Warner Music Japan, and was written and composed by Ryo of Supercell.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the 1959 college football national championship?", "passages": [ [ "1982 Penn State Nittany Lions football team", "1982 Penn State Nittany Lions football team\n\nThe 1982 Penn State Nittany Lions football team represented Pennsylvania State University during the 1982 NCAA Division I-A football season.", "Penn State defeated the Georgia Bulldogs, 27\u201323, in the Sugar Bowl to win Joe Paterno's first consensus national championship.", "The team was selected national champion by AP, Billingsley, DeVold, Dunkel, FACT, FB News, Football Research, FW, Litkenhous, Matthews, NCF, NFF, NY Times, Poling, Sagarin, Sagarin (ELO-Chess), Sporting News, UPI/coaches, and USA/CNN, while named co-champion by Helms.", "Nine Nittany Lions were drafted in the 1983 NFL Draft." ], [ "1959 Syracuse Orangemen football team", "1959 Syracuse Orangemen football team\n\nThe 1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season.", "Led by eleventh-year head coach Ben Schwartzwalder, the independent Orangemen were undefeated and won the school's only national championship in football, topping the rankings by wide margins in the final polls in early December.", "They met fourth-ranked Texas in the Cotton Bowl Classic in Dallas on New Year's Day, and led 15\u20130 at halftime and 23\u20136 after the three quarters.", "Texas scored midway through the fourth quarter to draw to 23\u201314, but there was no further scoring, and Syracuse gained its first bowl win.", "Unranked at the start of the season, Syracuse finished with an 11\u20130 record with five shutouts, and outscored its opponents 413\u201373.", "Notable players included sophomore running back Ernie Davis, winner of the Heisman Trophy in 1961 and the first selection of the In the Cotton Bowl Classic, he scored the first two touchdowns and threw a pass to Gerhard Schwedes for the third.", "Davis was helped by an offensive line that included unanimous first team All-American guard Roger Davis.", "Source:" ] ], "gold": "Syracuse won the college football National Championship in 1959 in both the AP Poll and the UPI Coaches poll.", "prediction 1": "The 1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season. Led by eleventh-year head coach Ben Schwartzwalder, the independent Orangemen were undefeated and won the school's only national championship in football, topping the rankings by wide margins in the final polls in early December. Syracuse defeated the Texas Longhorns, 23\u20136, in the Sugar Bowl to win Joe Paterno's first consensus national championship.", "prediction 2": "1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season. Led by eleventh-year head coach Ben Schwartzwalder, the independent Orangemen were undefeated and won the school's only national championship in football. Led by eleventh-year head coach Charles H. Smith, the Syracuse Orangemen were undefeated and won the school's only national championship in football. They met fourth-ranked Texas in the Cotton Bowl Classic in Dallas on New Year's Day, and led 15\u20130 at halftime and 23\u20136 after the three quarters.", "prediction 3": "The 1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season. Led by eleventh-year head coach Ben Schwartzwalder, the independent Orangemen were undefeated and won the school's only national championship in football, topping the rankings by wide margins in the final polls in early December.", "prediction 4": "The 1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season. Led by eleventh-year head coach Ben Schwartzwalder, the independent Orangemen were undefeated and won the school's only national championship in football. They topped the rankings by wide margins in the final polls in early December.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 463 } ], "missing-info": [], "corrected-prediction": "The 1959 Syracuse Orangemen football team represented Syracuse University in the 1959 college football season and won the school's only national championship in football." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did sir arthur conan doyle wrote his first book?", "passages": [ [ "Arthur Conan Doyle", "Arthur Conan Doyle\n\nSir Arthur Ignatius Conan Doyle (22 May 1859\u00a0\u2013 7 July 1930) was a British writer best known for his detective fiction featuring the character Sherlock Holmes.", "Originally a physician, in 1887 he published \"A Study in Scarlet\", the first of four novels about Holmes and Dr. Watson.", "In addition, Doyle wrote over fifty short stories featuring the famous detective.", "The Sherlock Holmes stories are generally considered milestones in the field of crime fiction.", "Doyle was a prolific writer; his non-Sherlockian works include fantasy and science fiction stories about Professor Challenger and humorous stories about the Napoleonic soldier Brigadier Gerard, as well as plays, romances, poetry, non-fiction and historical novels.", "One of Doyle's early short stories, \"J. Habakuk Jephson's Statement\", helped to popularise the mystery of the \"Mary Celeste\".", "Doyle is often referred to as Sir Arthur Conan Doyle or simply Conan Doyle (implying that \"Conan\" is part of a compound surname as opposed to his given middle name).", "His baptism entry in the register of St Mary's Cathedral, Edinburgh, gives \"Arthur Ignatius Conan\" as his given names and \"Doyle\" as his surname.", "It also names Michael Conan as his godfather.", "The cataloguers of the British Library and the Library of Congress treat \"Doyle\" alone as his surname." ] ], "gold": "In 1887, at age 27, Sir Arthur Conan Doyle wrote his first book.", "prediction 1": "Arthur Conan Doyle was a British writer best known for his detective fiction featuring the character Sherlock Holmes. Originally a physician, in 1887 he published A Study in Scarlet, the first of four novels about Holmes and Dr. Watson. Doyle also wrote over fifty short stories featuring the famous detective.", "prediction 2": "Sir Arthur Conan Doyle was a British detective writer best known for his detective fiction featuring the character Sherlock Holmes. Originally a physician, in 1887 he published \"A Study in Scarlet\", the first of four novels about Holmes and Dr. Watson. In addition, Doyle wrote over fifty short stories featuring the famous detective.", "prediction 3": "Arthur Conan Doyle was a British author best known for his detective fiction featuring the character Sherlock Holmes. Originally a physician, in 1887 he published \"A Study in Scarlet\", the first of four novels about Holmes and Dr. Watson. In addition, Doyle wrote over fifty short stories featuring the famous detective.", "prediction 4": "Arthur Conan Doyle was an English writer whose novels include A Study in Scarlet, the first of four novels about Sherlock Holmes and Dr. Watson. Originally a physician, in 1887 he published A Study in Scarlet, the first of four novels about Holmes and Dr. Watson. In addition, Doyle wrote over fifty short stories featuring the famous detective.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 310 } ], "missing-info": [], "corrected-prediction": "Arthur Conan published A Study in Scarlet in 1887, the first of four novels about Holmes and Dr. Watson. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When will the first tesla model 3 be delivered?", "passages": [ [ "Tesla Model 3", "In February 2017, Tesla said that installation of Model 3 manufacturing equipment was underway in the Fremont factory and at Gigafactory 1, where in January, production of battery cells for energy-storage products began, which have the same form factor as the cells that will be used in Model 3.", "As industry experts had predicted, Tesla did not meet the announced delivery targets.", "The first delivery was on July 7, 2017, to Musk himself.", "The first 30 production units were delivered on July 28, 2017.", "In early July 2017, Musk forecast at least six months of serious production difficulties.", "Tesla's announced goal at that time was to produce 1,500 units in the third quarter of 2017, increasing to 5,000 per week by end of December 2017, but only 260 vehicles were manufactured during the third quarter.", "The company blamed product bottlenecks but said there were \"no fundamental issues with the Model 3 production or supply chain\" and expressed confidence about its ability to resolve the bottlenecks in the near future.", "Tesla delivered 1,542 Model 3 cars in the fourth quarter of 2017, about 2,900 less than Wall Street estimations, which were already halved previously after Tesla published the company's third quarter report.", "Customer deliveries totaled 1,764 units in 2017." ] ], "gold": "Elon Musk himself was delivered a Tesla model 3 on July 7, 2017, and they were delivered as general production units on July 28, 2017. ", "prediction 1": "The first Tesla Model 3 was delivered on July 7, 2017, to Elon Musk himself. The first 30 production units were delivered on July 28, 2017.", "prediction 2": "The first Tesla Model 3 was delivered July 7, 2017, to Elon Musk himself. The first 30 production units were delivered on July 28, 2017.", "prediction 3": "The first Tesla Model 3 car was delivered on July 7, 2017, to Elon Musk himself. The first 30 production units were delivered on July 28, 2017.", "prediction 4": "The first Tesla Model 3 was delivered on July 7, 2017. The first 30 production units were delivered on July 28, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 89 } ], "missing-info": [], "corrected-prediction": "The first Tesla Model 3 was delivered on July 7, 2017, to Elon Musk himself. The first production units were delivered on July 28, 2017." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "The sandhu bat island on which the statue of unity is to be built is located on which river?", "passages": [ [ "Narmada River", "The river is navigable for vessels of the burthen of 95 tonnes (i.e., 380 Bombay candies) up to Bharuch and for vessels up to 35 tonnes (140 Bombay candies) up to Shamlapitha or Ghangdia.", "The small vessels (10 tonnes) voyage up to Tilakawada in Gujarat.", "There are sand bases and shoals at mouth and at Bharuch.", "The nearby island of Kabirvad, in the Narmada River, features a gigantic Banyan tree, which covers .", "its also called mother of madhya pradesh citizens.", "The Narmada basin, hemmed between Vindya and Satpura ranges, extends over an area of and lies between east longitudes 72 degrees 32' to 81 degrees 45' and north latitudes 21 degrees 20' to 23 degrees 45' lying on the northern extremity of the Deccan Plateau.", "The basin covers large areas in the states of Madhya Pradesh (81%), Gujarat (12%) and a comparatively smaller area (4%) in Maharashtra, (2%) in Chhattisgarh and (1%) in Andhra Pradesh.", "In the river course of explained above, there are 41 tributaries, out of which 22 are from the Satpura range and the rest on the right bank are from the Vindhya range." ], [ "Statue of Unity", "People of Kevadia, Kothi, Waghodia, Limbdi, Navagam, and Gora villages opposed the construction of the statue and demanded the restitution of the land rights over of land acquired earlier for the dam as well as the formation of new Garudeshwar subdistrict.", "They also opposed the formation of Kevadia Area Development Authority (KADA) and the construction of Garudeshwar weir-cum-causeway project.", "The government of Gujarat accepted their demands.", "Construction of the monument was completed in mid-October 2018; and the inaugural ceremony was held on 31 October 2018, presided over by Prime Minister Narendra Modi.", "The statue has been described as a tribute to Indian engineering skills.", "The Statue of Unity is the world's tallest statue at .", "It rises higher than the previous record holder, the Spring Temple Buddha in China's Henan province.", "Within India, the record was earlier held by the statue of Hanuman at the Paritala Anjaneya Temple near Vijayawada in the state of Andhra Pradesh.", "The statue can be seen within a radius.", "The monument is constructed on a river island named Sadhu Bet, away from and facing the Narmada Dam downstream.", "The statue and its surroundings occupy more than , and are surrounded by a long artificial lake formed by the Garudeshwar weir downstream on the Narmada river." ], [ "Statue of Unity", "Statue of Unity\n\nThe Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel (1875\u20131950) who was the first deputy prime minister of India and the chief adherent of Mahatma Gandhi during the non-violent Indian Independence movement; highly respected for his leadership in uniting the 562 princely states of India to form the single large Union of India without any bloodshed.", "It is located in the state of Gujarat, India.", "It is the world's tallest statue with a height of .", "It is located on a river island facing the Sardar Sarovar Dam on the river Narmada in Kevadiya colony, southeast of the city of Vadodara.", "The project was first announced in 2010 and the construction of statue started in October 2014 by Larsen & Toubro, who received the contract for \u20b92,989 crore (US$420 million).", "It was designed by Indian sculptor Ram V. Sutar, and was inaugurated by Indian Prime Minister Narendra Modi on 31 October 2018, the 143rd anniversary of Patel's birth.", "Narendra Modi first announced the project to commemorate Sardar Vallabhbhai Patel on 7 October 2010 at a press conference to mark the beginning of his 10th year as the Chief Minister of Gujarat." ] ], "gold": "The Statue of Unity is located in the state of Gujarat, India. It is located in the Narmada river in the Kevadiya colony. The statue is surrounded by an artificial lake formed by the Garudeshwar weir, downstream from the river. ", "prediction 1": "The Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel, who led the non-violent Indian Independence movement to create the Union of India without any bloodshed. The statue is located on a river island named Sadhu Bet, away from and facing the Narmada Dam downstream. The monument is surrounded by a long artificial lake formed by the Garudeshwar weir downstream on the Narmada river and is surrounded by a long artificial lake formed by the Garudeshwar weir downstream.", "prediction 2": "The Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel, who led the non-violent Indian Independence movement and is the world's tallest statue at. It is located on an island facing the Sardar Sarovar Dam on the river Narmada in Kevadiya colony, southeast of the city of Vadodara. The statue was inaugurated on 31 October 2018, the 143rd anniversary of Patel's birth.", "prediction 3": "The Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel, who was the first deputy prime minister of India and the chief adherent of Mahatma Gandhi during the non-violent Indian Independence movement. It is located on a river island called Sadhu Bet, away from and facing the Narmada Dam downstream. The Statue of Unity is also the world's tallest statue at a height of 82 meters (6, 584 feet tallest statue).", "prediction 4": "The Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel (1875\u20131958), who was the first deputy prime minister of India and the chief adherent of Mahatma Gandhi during the non-violent Indian Independence movement. It is located on a river island named Sadhu Bet, away from and facing the Narmada Dam downstream. The Statue of Unity is the world's tallest statue with a height of.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 217 }, { "error type": "Redundant", "explanation": "The Statue of Unity is a colossal statue of Indian statesman and independence activist Sardar Vallabhbhai Patel, who led the non-violent Indian Independence movement to create the Union of India without any bloodshed. The statue is located on a river island named Sadhu Bet, away from and facing the Narmada Dam downstream. The monument is surrounded by a long artificial lake formed by the Garudeshwar weir downstream on the Narmada river ", "start": 440, "end": 526 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Statue of Unity is a colossal statue located on a river island named Sadhu Bet, away from and facing the Narmada Dam downstream in Kevadiya colony, The monument is surrounded by a long artificial lake formed by the Garudeshwar weir downstream on the Narmada river." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where in the bible does it talk about the golden rule?", "passages": [ [ "Matthew 7:12", "Matthew 7:12\n\nMatthew 7:12 is the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount.", "This well known verse presents what has become known as the Golden Rule.", "In the King James Version of the Bible the text reads:\n\nThe World English Bible translates the passage as:\n\nFor a collection of other versions see BibleGateway Matthew 7:12\n\n", "This verse is considered to be a summation of the entire sermon.", "Some editions append it to the end of -, and the rule does seem to be an expansion on the teaching about prayer in that section.", "However, the word therefore and the mention of the law and the prophets implies that this is a more far reaching teaching.", "Davies and Allison note that this is indicated by the mention of the law and the prophets, which links the verse back to Matthew 5:17, the start of the teaching on ethics.", "The verse is most closely linked with the teaching to \"love thy enemies\" in .", "In the Rule is present just after the teaching about enemies, making the link even more explicit.", "Luz notes that as well as summarizing the sermon, this rule also adapts it to normal life.", "While verses like seem incompatible with reality, the teachings in this verse can reasonably be attempted by all." ], [ "Luke 10", "Luke 10\n\nLuke 10 is the tenth chapter of the Gospel of Luke in the New Testament of the Christian Bible.", "It records the sending of seventy disciples by Jesus, the famous parable about the Good Samaritan, and his visit to the house of Mary and Martha.", "The book containing this chapter is anonymous, but early Christian tradition uniformly affirmed that Luke composed this Gospel as well as Acts.", "The New King James Version organises this chapter as follows (with cross references to parallel sections in the other gospels):\n\nTheologian Heinrich Meyer calls this section the \"Narrative of the Seventy\" and links it to the earlier account of the sending out of advance messengers in .", "This parable is recounted only in this chapter of the New Testament.", "A lawyer or 'expert in the law' asked Jesus to explain who his 'neighbour' is, referring to the ordinance of Leviticus 19:18:\n", "In response, Jesus told a story of a traveller (who may or may not have been a Jew ) who is beaten, robbed, and left half dead along the road.", "First a priest and then a Levite come by, but both avoid the man.", "Finally, a Samaritan comes by.", "Samaritans and Jews generally despised each other, but the Samaritan helps the injured man.", "Portraying a Samaritan in a positive light would have come as a shock to Jesus's audience." ] ], "gold": "The old testament mentions the golden rule in Leviticus 19:18 and Leviticus 19:34, the new testament mentions it in Matthew 7:12 and Luke 6:31. Paul talks about the golden rule in Galatians 5:14. And, in the deuterocanonial books of the bible, it talks about the golden rule in Tobit 4:15 and Sirach 31:15.", "prediction 1": "The Golden Rule is mentioned in several places in the Bible. The Golden Rule is mentioned in the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount. In the King James Version of the Bible, the text reads: The World English Bible translates the passage as: For a collection of other versions see BibleGateway Matthew 7:12 This verse is considered to be a summation of the entire sermon.", "prediction 2": "Matthew 7:12 is the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament. It presents what has become known as the Golden Rule. The rule is most closely linked with the teaching to \"love thy enemies\" in Matthew 5:17. However, the word therefore and the mention of the law and the prophets implies that this is a more far reaching teaching.", "prediction 3": "The Golden Rule is mentioned in two places in the Bible. In Matthew 7:12 which is in the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount. In Luke 10 which is in the tenth chapter of the Gospel of Luke, the Golden Rule is mentioned in verses 62,63,66, and 64.", "prediction 4": "In which verses in the Bible does it talk about the Golden Rule? In Matthew 7:12, the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament, it discusses the Golden Rule. This verse is considered to be a summation of the entire sermon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 391 }, { "error type": "Irrelevant", "explanation": "", "start": 392, "end": 456 } ], "missing-info": [], "corrected-prediction": "The Golden Rule is mentioned in several places in the Bible. The Golden Rule is mentioned in the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "One version of determinsm from eastern philosophy is known as what?", "passages": [ [ "Indian philosophy", "Ancient and medieval era texts of Indian philosophies include extensive discussions on Ontology (metaphysics, Brahman-Atman, Sunyata-Anatta), reliable means of knowledge (epistemology, Pramanas), value system (axiology) and other topics.", "Indian philosophies share many concepts such as dharma, karma, samsara, reincarnation, dukkha, renunciation, meditation, with almost all of them focussing on the ultimate goal of liberation of the individual through diverse range of spiritual practices (moksha, nirvana).", "They differ in their assumptions about the nature of existence as well as the specifics of the path to the ultimate liberation, resulting in numerous schools that disagreed with each other.", "Their ancient doctrines span the diverse range of philosophies found in other ancient cultures.", "Many Hindu intellectual traditions were classified during the medieval period of Brahmanic-Sanskritic scholasticism into a standard list of six orthodox (Astika) schools (darshanas), the \"Six Philosophies\" (\"\"), all of which accept the testimony of the Vedas.", "These are often coupled into three groups for both historical and conceptual reasons: Nyaya-Vaishesika, Samkhya-Yoga, and Mimamsa-Vedanta." ], [ "\u015arama\u1e47a", "However, he later considered extreme austerities and self-mortification as unnecessary and recommended a \"Middle Way\" between the extremes of hedonism and self-mortification.", "The Brahmaj\u0101la Sutta mentions many \u015brama\u1e47as with whom Buddha disagreed.", "For example, in contrast to Sramanic Jains whose philosophical premise includes the existence of an \"Atman\" (self, soul) in every being, Buddhist philosophy denies that there is any self or soul.", "This concept called \"Anatta\" (or \"Anatman\") is a part of \"Three Marks of existence\" in Buddhist philosophy, the other two being \"Dukkha\" (suffering) and \"Anicca\" (impermanence).", "According to Buddha, states Laumakis, everything lacks inherent existence.", "Buddhism is a non-theistic philosophy, which is especially concerned with prat\u012btyasamutp\u0101da (dependent origination) and \u015b\u016bnyat\u0101 (emptiness or nothingness).", "From rock edicts, it is found that both Brahmans as well as \u015brama\u1e47as enjoyed equal sanctity.", "The \u0100j\u012bvika school is known for its \"Niyati\" doctrine of absolute determinism, the premise that there is no free will, that everything that has happened, is happening and will happen is entirely preordained and a function of cosmic principles." ] ], "gold": "A general determinism from eastern philosophy is absolute determinism or fate. In Indian philosophy, their version of determinism is karma.", "prediction 1": "The jvika school is known for its \"Niyati\" doctrine of absolute determinism, the premise that there is no free will, that everything that has happened, is happening and will happen is entirely preordained and a function of cosmic principles.", "prediction 2": "The jvika school is known for its \"Niyati\" doctrine of absolute determinism. This doctrine states that there is no free will, that everything that has happened, is happening and will happen is entirely preordained and a function of cosmic principles.", "prediction 3": "In eastern philosophy, one version of determinism is known as Niyati, while in another version, Niyati is called jvika.", "prediction 4": "The jvika school is known for its Niyati doctrine of absolute determinism, the premise that there is no free will, that everything that has happened, is happening and will happen is entirely preordained and a function of cosmic principles.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The jvika school is known for its \"Niyati\" doctrine of absolute determinism, the premise that there is no free will, that everything that has happened, is happening and will happen is entirely preordained and a function of cosmic principles." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the us get involved in world war 1?", "passages": [ [ "American entry into World War I", "Once Germany had decided on unrestricted submarine warfare in January 1917, and knowing it would be attacking all American ships in the North Atlantic, it tried to line up new allies, especially Mexico.", "Arthur Zimmermann, the German foreign minister, sent the Zimmermann Telegram to Mexico on January 16, 1917.", "Zimmermann invited Mexico (knowing their resentment towards America since the 1848 Mexican Cession) to join in a war against the United States.", "Germany promised to pay for Mexico's costs and to help it recover the territory annexed by the U.S. in 1848.", "These territories included the present day states of California, Nevada, Utah, most of Arizona, about half of New Mexico and a quarter of Colorado.", "British intelligence intercepted and decoded the telegram and passed it to the Wilson administration.", "The White House would release it to the press on March 1.", "Anger grew further as the Germans began sinking American ships, even as isolationists in the Senate launched a filibuster to block legislation for arming American merchant ships to defend themselves.", "In early 1917 Berlin forced the issue.", "Its declared decision on 31 January 1917 to target neutral shipping in a designated war-zone\nbecame the immediate cause of the entry of the United States into the war.", "Five American merchant ships went down in March.", "Outraged public opinion now overwhelmingly supported Wilson when he asked Congress for a declaration of war on April 2, 1917." ], [ "American entry into World War I", "Until 1917, Wilson made minimal preparations for a land war and kept the United States Army on a small peacetime footing, despite increasing demands for enhanced preparedness.", "He did, however, expand the United States Navy.", "In 1917, with Russia experiencing political upheaval, and with Britain and France low on credit, Germany appeared to have the upper hand in Europe, In January 1917 Germany decided to resume unrestricted submarine warfare with no warning to passengers or crews.", "Its goal was to starve Britain into surrender.", "although it realized that it would almost certainly bring the United States into the war.", "Germany also made a secret offer to help Mexico regain territories lost in the Mexican\u2013American War in an encoded telegram known as the Zimmermann Telegram, which was intercepted by British Intelligence.", "Publication of that communique outraged Americans just as German U-boats started sinking American merchant ships in the North Atlantic.", "Wilson then asked Congress for \"a war to end all wars\" that would \"make the world safe for democracy\", and Congress voted to declare war on Germany on April 6, 1917.", "On December 7, 1917, the U.S. declared war on Austria-Hungary.", "U.S. troops began arriving on the Western Front in large numbers in 1918." ] ], "gold": "The President asked congress to get involved in World War 1 on April 2, 1917, and they first began major combat during the summer of 1918.", "prediction 1": "The US got involved in World War I on February 13, 1917, and on May 1, 1918. The US entered the war with Germany on January 31, 1917, and was initially in the war because of Germany's unrestricted submarine warfare. Then, on January 16, 1917, Arthur Zimmermann, the German foreign minister, sent the Zimmermann Telegram to Mexico on January 16, 1917. Zimmermann invited Mexico, knowing their resentment towards America since the 1848 Mexican Cession, to join in a war against the United States.", "prediction 2": "The us got involved in World War I when Germany began unrestricted submarine warfare on January 31, 1917. British intelligence intercepted and decoded the telegram and passed it to the Wilson administration. The White House would release it to the press on March 1, 1917. The next day, on March 1, the US entered World War I with the help of troops sent by the US Army.", "prediction 3": "The United States got involved in World War I on March 1, 1917, when Germany announced that it was starting unrestricted submarine warfare, with no warning to passengers or crews, to starve Britain into surrender. The goal was to starve Britain into surrender. However, the United States realized that it would almost certainly bring the United States into the war.", "prediction 4": "The United States entered World War I on March 1, 1917, when it targeted neutral shipping in a designated war-zone, and its entry was caused by the German decision on 31 January 1917 to resume unrestricted submarine warfare with no warning to passengers or crews. The goal of the Germans was to starve Britain into surrender, although it realized that it would almost certainly bring the United States into the war. American ships started sinking in the North Atlantic in January 1917, and on December 7, 1917, the U.S. declared war on December 7, 1918.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 38, "end": 50 }, { "error type": "Unverifiable", "explanation": "", "start": 64, "end": 70 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 116, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 350 }, { "error type": "Irrelevant", "explanation": "", "start": 351, "end": 494 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 12 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The US got involved in World War I on April 2, 1917 when President Wilson asked Congress for a declaration of war. U.S. troops began arriving on the Western Front in large numbers in 1918." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "The colorado plateau covers northern new mexico and what other state?", "passages": [ [ "Colorado Plateau", "Colorado Plateau\n\nThe Colorado Plateau, also known as the Colorado Plateau Province, is a physiographic and desert region of the Intermontane Plateaus, roughly centered on the Four Corners region of the southwestern United States.", "This province covers an area of 337,000\u00a0km (130,000\u00a0mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona.", "About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado.", "Most of the remainder of the plateau is drained by the Rio Grande and its tributaries.", "The Colorado Plateau is largely made up of high desert, with scattered areas of forests.", "In the southwest corner of the Colorado Plateau lies the Grand Canyon of the Colorado River.", "Much of the Plateau's landscape is related, in both appearance and geologic history, to the Grand Canyon.", "The nickname \"Red Rock Country\" suggests the brightly colored rock left bare to the view by dryness and erosion.", "Domes, hoodoos, fins, reefs, river narrows, natural bridges, and slot canyons are only some of the additional features typical of the Plateau.", "The Colorado Plateau has the greatest concentration of U.S. National Park Service (NPS) units in the country outside the Washington, DC metropolitan area." ], [ "Geology of the United States", "This internally-drained area occupies approximately , including most of Nevada, a large part of Utah, and portions of Idaho, California, and Oregon.", "Much of the present-day Great Basin would drain to the sea, just as it did in the recent Ice Ages, if there were more rain and snowfall.", "The Colorado Plateau is roughly centered on the Four Corners region of the southwestern United States.", "The province covers an area of 337,000\u00a0km (130,000\u00a0mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona.", "About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado.", "The sculptured beauty and brilliant colors of the Colorado Plateau's sedimentary rock layers have captured the imaginations of countless geologists.", "This is a vast region of plateaus, mesas, and deep canyons whose walls expose rocks ranging in age from billions to just a few hundred years old.", "Ancient Precambrian rocks, exposed only in the deepest canyons, make up the basement of the Colorado Plateau.", "Most are metamorphic rocks formed deep within the Earth while continental collision on a grand scale produced the nucleus of the North American continent well over a billion years ago.", "Igneous rocks injected millions of years later form a marbled network through parts of the Colorado Plateau's darker metamorphic basement." ] ], "gold": "The Colorado Plateau covers an area of 336,700 km2 (130,000 mi2) within western Colorado, northwestern New Mexico, southern and eastern Utah, northern Arizona, and a tiny fraction in the extreme southeast of Nevada. Most of the area is drained by the Colorado River.", "prediction 1": "The Colorado Plateau, also known as the Colorado Plateau Province, is a physiographic and desert region of the Intermontane Plateaus, roughly centered on the Four Corners region of the southwestern United States. This province covers an area of 337,000 km (130,000 mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona. About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado, with the remainder of the river narrows, and slot canyons, are only some of the Colorado Plateau's sedimentary rock layers, which expose rocks ranging in age from billions to just a few hundred years old.", "prediction 2": "The Colorado Plateau is a physiographic and desert region of the Intermontane Plateaus, roughly centered on the Four Corners region of the southwestern United States. The province covers an area of 337,000 km (130,000 mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona. About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado. Most of the remainder of the plateau is drained by the Rio Grande and its tributaries: the Green, San Juan, and Little Colorado.", "prediction 3": "The Colorado Plateau, also known as the Colorado Plateau Province, is a physiographic and desert region of the Intermontane Plateaus, roughly centered on the Four Corners region of the southwestern United States. This province covers an area of 337,000 km (130,000 mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona. About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado. Most of the remainder of the area is drained by the Rio Grande and its tributaries: the Green, San Juan, and Little Colorado.", "prediction 4": "The Colorado Plateau, also known as the Colorado Plateau Province, is a physiographic and desert region of the Intermontane Plateaus, roughly centered on the Four Corners region of the southwestern United States. This province covers an area of 337,000 km (130,000 mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona. About 90% of the area is drained by the Colorado River and its main tributaries: the Green, San Juan, and Little Colorado, while the remainder of the area is drained by the Rio Grande and its tributaries: the Green, San Juan, and Little Colorado.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 695 } ], "missing-info": [], "corrected-prediction": "The Colorado Plateau covers an area of 337,000 km (130,000 mi) within western Colorado, northwestern New Mexico, southern and eastern Utah, and northern Arizona. About 90% of the area is drained by the Colorado River." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Where do you go for basic training in the marines?", "passages": [ [ "United States Marine Corps Recruit Training", "Commandant Franklin Wharton established a formal school for recruits at Marine Barracks, Washington, D.C. in approximately 1808, but no records indicate that this served as a centralized recruit depot and the training regimen remained inconsistent and primitive due to manpower shortages and lack of funding.", "For example, recruits at Washington were hastily formed into a battalion in July 1861 and drilled as they marched on their way to the First Battle of Bull Run.", "In 1911, Commandant William P. Biddle standardized a mandatory two-month recruit training schedule (including drill, physical exercise, personal combat and intensive marksmanship qualification with the recently adopted M1903 Springfield rifle) and set up four depots at Philadelphia, Norfolk, Puget Sound and Mare Island.", "In 1915, the Norfolk depot was shifted to its current location at Parris Island, while the Philadelphia and Puget Sound depots were closed and merged with the two remaining depots.", "As the United States entered World War I, the number of recruits being trained surged from 835 at any given time to a peak of 13,286, while follow-on training was provided at Quantico and in France." ], [ "United States Marine Corps Recruit Training", "United States Marine Corps Recruit Training\n\nUnited States Marine Corps Recruit Training (commonly known as \"boot camp\") is a 13-week program of initial training that each recruit must successfully complete in order to serve in the United States Marine Corps.", "All enlisted individuals entering the Marine Corps, regardless of eventual active or reserve duty status, will undergo recruit training at one of the two Marine Corps Recruit Depots (MCRD): Parris Island, South Carolina or San Diego, California.", "The training and standards are identical between the two bases, though the order of some training events differs from east coast to west coast.", "Male recruits from the 8th, 9th and 12th recruiting districts (areas west of the Mississippi River except Louisiana and including parts of Illinois, Indiana, Wisconsin and Michigan) are sent to MCRD San Diego.", "All recruits from the 1st, 4th and 6th recruiting districts and all female recruits are sent to Parris Island.", "Those desiring to become officers attend training at Officer Candidates School at Marine Corps Base Quantico in Virginia." ], [ "United States Marine Corps Recruit Training", "During the summer of 1923, the West Coast recruit depot was moved from Mare Island to its current location in San Diego and the training program was modified to include three weeks of basic indoctrination and three weeks on the rifle range and the final two weeks were occupied in bayonet drill, guard duty, drill and ceremonies.", "After Congress authorized an increase in manpower in preparation for World War II in September 1939, the syllabus was halved to four weeks to accommodate the influx of recruits.", "After standards and marksmanship plummeted as a result, the seven-week schedule was returned and additional training was given at Camps Lejeune or Pendleton for Marines, based on specialties, before being assigned to a unit.", "An additional segregated depot was established at Montford Point for roughly 20,000 African American recruits, who would not be integrated until 1949.", "Overall, half a million recruits were trained by the end of the war at the three depots.", "During the Korean War, training was shortened from ten weeks to eight, but returned afterward to ten.", "The Ribbon Creek incident in 1956 led to considerable scrutiny and reform in recruit training, such as an additional layer of command oversight and the distinctive campaign cover.", "During the early 1960s, the training period was increased to 13 weeks, including three weeks of marksmanship training at the Rifle Range." ] ], "gold": "Philadelphia, Norfolk, Puget Sound and Mare Island were the four depots that Commandant William P. Biddle set up after he standardized a two month mandatory recruit training schedule in 1911. Since 1915, most enlisted recruits go to one of the two current depots, Parris Island, South Carolina or San Diego, California. While during segregation, black Marines were sent to Montford Point for training.", "prediction 1": "United States Marine Corps Recruit Training is a 13-week program of initial training that each recruit must successfully complete in order to serve in the United States Marine Corps. Recruits are trained on Parris Island in South Carolina and San Diego, California. The training is mostly conducted at Camp Lejeune for Marines, based on specialties, before being assigned to a unit.", "prediction 2": "United States Marine Corps Recruit Training is a 13-week program of initial training that each recruit must successfully complete in order to serve in the United States Marine Corps. The initial training is usually at Marine Barracks, Washington, D.C. in approximately 1808, but no records indicate that this served as a centralized recruit depot. Recruits at Parris Island are primarily sent to basic training at the MCRD in San Diego, California.", "prediction 3": "The United States Marine Corps Recruit Training, also known as boot camp, is a 13-week program that each recruit must successfully complete in order to serve in the United States Marine Corps. All enlisted individuals entering the Marine Corps, regardless of eventual active or reserve duty status, will undergo recruit training at one of the two Marine Corps Recruit Depots (MCRD): Parris Island, South Carolina or San Diego, California. The training and standards are identical between the two bases, though the order of some training events differs from east coast to west coast.", "prediction 4": "There are two Marine Corps Recruit Depots in the United States. The Recruit Training program, commonly known as \"boot camp\", is a 13-week program of initial training that each recruit must successfully complete in order to serve in the United States Marine Corps. In 1915, the Norfolk depot was shifted to its current location at Parris Island, while the Philadelphia and Puget Sound depots were closed and merged with the two remaining depots. In 1923, the West Coast recruit depot was moved from Mare Island to its current location in San Diego.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 382 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "In 1911, Commandant William P. Biddle standardized a mandatory two-month recruit training schedule and set up four depots at Philadelphia, Norfolk, Puget Sound and Mare Island. An additional segregated depot was established at Montford Point for African American recruits, before they were integrated. All current recruits are trained at one of the two Marine Corps Recruit Depots, either on Parris Island in South Carolina or in San Diego, California. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When is the next episode of gotham airing?", "passages": [ [ "Gotham (season 3)", "Gotham (season 3)\n\nThe third season of the American television series \"Gotham\", based on characters from DC Comics related to the Batman franchise, revolves around the characters of James Gordon and Bruce Wayne.", "The season is produced by Primrose Hill Productions, DC Entertainment, and Warner Bros. Television, with Bruno Heller, Danny Cannon, John Stephens, and Ken Woodruff serving as executive producers.", "The season included inspirations from and .", "The season was ordered on March 2016 and every cast member from the last season returned with the exception of Zabryna Guevara as Sarah Essen; James Frain as Theo Galavan/Azrael; and Nicholas D'Agosto as Harvey Dent.", "New additions to the cast include Benedict Samuel as Jervis Tetch; and Maggie Geha as a grown Ivy Pepper, recasting the role portrayed by Clare Foley in previous seasons.", "The season was broadcast over 3 consecutive runs: the first 11 episodes aired from September to November 2016; the next 3 aired in January 2017; and the other 8 episodes aired from April to June 2017.", "Like the previous season, the season also holds two subtitles.", "The first 14 episodes are subtitled \"Mad City\" while the other 8 episodes are subtitled \"Heroes Rise\".", "The season premiered on September 19, 2016 and concluded on June 5, 2017 with a two-hour finale on Fox." ], [ "Gotham (TV series)", "Filming for the first season finished on March 24, 2015.", "Speaking of the project at the 2014 winter TCA press tour, Reilly described the series as \"this operatic soap that has a slightly larger-than-life quality.", "This is not some adjunct companion series.", "This is the Batman franchise, just backing it up [in chronology].\"", "He later added that the series is separate from any DC film universe.", "As part of a settlement with his heirs, \"Gotham\" and \"\" were the first productions by DC that credited Bill Finger as co-creator of Batman.", "On January 17, 2015, the series was renewed for a second season.", "The show was officially renewed by Fox for a 22-episode third season on March 16, 2016.", "David Madden, Fox's Entertainment President stated, \"It takes a very special team to tell the tales of \"Gotham\".", "For the past two seasons, Bruno, Danny and John have masterfully honored the mythology of \"Gotham\" and brought it to life with depth, emotion and memorable high drama.\"", "In May 2017, Fox renewed the series for a fourth season, which premiered on September 21, 2017.", "On May 13, 2018, Fox renewed the series for a fifth and final season originally consisting of 10 episodes then later increased to 12.", "The season began production in July that year, and is set to premiere on January 3, 2019." ] ], "gold": "The fifth and final season of the television series Gotham concluded on April 25, 2019, and the dates episodes of the series first aired vary. For example, Episodes 66 and 65 first aired on June 5, 2017, while Episode 64 first aired on May 29, 2017.", "prediction 1": "Gotham is an American television series based on the Batman franchise. The third season aired over 3 consecutive runs with the first 11 episodes aired from September to November 2016, the next 3 aired in January 2017, and the other 8 episodes aired from April to June 2017. The series premiered on September 19, 2016 and concluded on June 5, 2017 with a two-hour finale on Fox.", "prediction 2": "Gotham airs episodes weekly. The first 11 episodes of Season 3 aired on September 19, 2016 and the next 3 aired on January 7, 2017 respectively. The remaining 8 episodes were broadcast in 3 consecutive runs.", "prediction 3": "The third season of the American television series Gotham, based on characters from DC Comics related to the Batman franchise, revolves around the characters of James Gordon and Bruce Wayne. The first 11 episodes aired from September to November 2016; the next 3 aired in January 2017; and the other 8 episodes aired from April to June 2017. The first 13 episodes were originally released on September 19, 2016 and the final episode on June 5, 2017 was released on March 16, 2017.", "prediction 4": "The third season of the American television series Gotham has 8 episodes airing in total over 3 runs. The first episode of Gotham aired on September 19, 2016 and the next episode aired on January 3, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 377 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 12, 13 ] } ], "corrected-prediction": "Season 5, the final season, is set to premiere on January 3, 2019." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who are members of the joint chiefs of staff?", "passages": [ [ "Joint Chiefs of Staff", "Joint Chiefs of Staff\n\n", "The Joint Chiefs of Staff (JCS) is a body of senior uniformed leaders in the United States Department of Defense who advise the President of the United States, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters.", "The composition of the Joint Chiefs of Staff is defined by statute and consists of the Chairman of the Joint Chiefs of Staff (CJCS), Vice Chairman of the Joint Chiefs of Staff (VCJCS), the Military Service Chiefs from the Army, Marine Corps, Navy, and Air Force, and the Chief of the National Guard Bureau, all appointed by the President following Senate confirmation.", "Each of the individual Military Service Chiefs, outside their Joint Chiefs of Staff obligations, works directly for the Secretary of the Military Department concerned, i.e., Secretary of the Army, Secretary of the Navy, and the Secretary of the Air Force.", "Following the Goldwater\u2013Nichols Act in 1986, the Joint Chiefs of Staff do not have operational command authority, either individually or collectively, as the chain of command goes from the President to the Secretary of Defense, and from the Secretary of Defense to the Commanders of the Combatant Commands.", "Goldwater\u2013Nichols also created the office of Vice Chairman, and the Chairman is now designated as the principal military adviser to the Secretary of Defense, the Homeland Security Council, the National Security Council and the President." ] ], "gold": "The Joint Chiefs of Staff (JCS) is the body of the most senior uniformed leaders within the United States Department of Defense, comprising heads of the Army, Navy, Air Force, and Marines. As such, the JCS advises the president of the United States, among others, on military matters. Some of JCS current members are Gen Mark A Milley, Gen John E Hyten, Gen James C McConville, Gen David H Berger, Adm Michael M Gilday, Gen David L Goldfein, Gen John W Raymond, Gen Joseph L Lengyel.", "prediction 1": "The Joint Chiefs of Staff (JCS) is a body of senior uniformed leaders in the United States Department of Defense who advise the President of the United States, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters. The composition of the Joint Chiefs of Staff is defined by statute and consists of the Chairman of the Joint Chiefs of Staff (CJCS), Vice Chairman of the Joint Chiefs of Staff (VCJCS), the Military Service Chiefs from the Army, Marine Corps, Navy, and Air Force, and the Chief of the National Guard Bureau, all appointed by the President following Senate confirmation.\n", "prediction 2": "The Joint Chiefs of Staff is a body of senior uniformed leaders in the United States Department of Defense who advise the President of the United States, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters. The Chairman of the Joint Chiefs of Staff is the current Chairman of the Joint Chiefs of Staff, Vice Chairman of the Joint Chiefs of Staff is the current Vice Chairman of the Joint Chiefs of Staff, the current Military Service Chiefs from the Army, Marine Corps, Navy, and Air Force, and the Chief of the National Guard Bureau also serve as VSCJS, as members, who are joined by statute.", "prediction 3": "The Joint Chiefs of Staff (JCS) is a body of senior uniformed leaders in the United States Department of Defense who advise the President of the United States, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters. All members of the Joint Chiefs of Staff are civilian and are appointed by the president following Senate confirmation.", "prediction 4": "The Joint Chiefs of Staff is a body of senior uniformed leaders in the United States Department of Defense who advise the President, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Joint Chiefs of Staff (JCS) is a body of senior uniformed leaders in the United States Department of Defense who advise the President of the United States, the Secretary of Defense, the Homeland Security Council and the National Security Council on military matters. The composition of the Joint Chiefs of Staff is defined by statute and consists of the Chairman of the Joint Chiefs of Staff (CJCS), Vice Chairman of the Joint Chiefs of Staff (VCJCS), the Military Service Chiefs from the Army, Marine Corps, Navy, and Air Force, and the Chief of the National Guard Bureau, all appointed by the President following Senate confirmation.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many variations of power rangers are there?", "passages": [ [ "Power Rangers", "Power Rangers\n\nPower Rangers is an American entertainment and merchandising franchise built around a live-action superhero television series, based on the Japanese tokusatsu franchise \"Super Sentai\".", "Produced first by Saban Entertainment, second by BVS Entertainment, later by SCG Power Rangers and today by Hasbro, the \"Power Rangers\" television series takes much of its footage from the \"Super Sentai\" television series, produced by Toei Company.", "The first \"Power Rangers\" entry, \"Mighty Morphin Power Rangers\", debuted on August 28, 1993, and helped launch the Fox Kids programming block of the 1990s, during which it catapulted into popular culture along with a line of action figures and other toys by Bandai.", "By 2001, the media franchise had generated over $6\u00a0billion in toy sales.", "Despite initial criticism that its action violence targeted child audiences, the franchise has continued, and the show consists of 24 television seasons of 20 different themed series and three theatrical films released in 1995, 1997 and 2017.", "In 2010, Haim Saban, creator of the series, regained ownership of the franchise after seven years under The Walt Disney Company.", "In 2018, Hasbro was named the new master toy licensee." ] ], "gold": "As of 2021, Power Rangers consists of 28 television seasons of 21 different themed series and 3 theatrical films released in 1995, 1997, and 2017.", "prediction 1": "Power Rangers is an American entertainment and merchandising franchise built around a live-action superhero television series based on the Japanese tokusatsu franchise \"Super Sentai\". The show consists of 24 television seasons of 20 different themed series and three theatrical films released in 1995, 1997 and 2017. In total, there are eighteen Power Rangers characters.", "prediction 2": "Power Rangers is an American entertainment and merchandising franchise built around a live-action superhero television series based on the Japanese tokusatsu franchise \"Super Sentai\". The show consists of 24 television seasons of 20 different themed series and three theatrical films released in 1995, 1997 and 2017.", "prediction 3": "Power Rangers is an American entertainment and merchandising franchise built around a live-action superhero television series based on the Japanese tokusatsu franchise \"Super Sentai\". There are three main Power Rangers characters: Mighty Morphin Power Rangers, who appear on every episode. There are also two other Power Rangers characters called Mighty Morphin Power Rangers and two others called Mighty Morphin Power Rangers.", "prediction 4": "Power Rangers is an American entertainment and merchandising franchise built around a live-action superhero television series, based on the Japanese tokusatsu franchise Super Sentai. There are many variations of the series. For example, there are Mighty Morphin Power Rangers, Mighty Morphin Power Rangers, and the Mighty Morphin Power Rangers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 183 }, { "error type": "Unverifiable", "explanation": "", "start": 327, "end": 371 } ], "missing-info": [], "corrected-prediction": "The show consists of 24 television seasons of 20 different themed series and three theatrical films released in 1995, 1997 and 2017." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When were nutrition labels introduced in the us?", "passages": [ [ "Nutrition facts label", "The label was mandated for most food products under the provisions of the 1990 Nutrition Labeling and Education Act (NLEA), per the recommendations of the U.S. Food and Drug Administration.", "It was one of several controversial actions taken during the tenure of FDA Commissioner Dr. David Kessler.", "The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994.", "(Meat and poultry products were not covered by NLEA, though the U.S. Department of Agriculture proposed similar regulations for voluntary labeling of raw meat and poultry.)", "Foods labeled before that day could use the old label.", "This appeared on all products in 1995.", "The old label was titled \"Nutrition Information Per Serving\" or simply, \"Nutrition Information\".", "The label begins with a standard serving measurement, calories are listed second, and then following is a breakdown of the constituent elements.", "Always listed are total fat, sodium, carbohydrates and protein; the other nutrients usually shown may be suppressed, if they are zero.", "Usually all 15 nutrients are shown: calories, calories from fat, fat, saturated fat, trans fat, cholesterol, sodium, carbohydrates, dietary fiber, sugars, protein, vitamin A, vitamin C, calcium, and iron." ] ], "gold": "Nutrition Facts labels were mandated for most foods in the United States in 1990 under a provision in the Nutrition Labeling and Education Act. The law required food companies to begin using the label on packaged foods beginning on May 8, 1994. ", "prediction 1": "Nutrition labels were introduced in the US under the provisions of the 1990 Nutrition Labeling and Education Act (NLEA), per the recommendations of the U.S. Food and Drug Administration. The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994.", "prediction 2": "The new label was mandated for most food products under the provisions of the 1990 Nutrition Labeling and Education Act, per the recommendations of the U.S. Food and Drug Administration. The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994. The old label appeared on all products in 1995.", "prediction 3": "The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994. (Meat and poultry products were not covered by NLEA, though the U.S. Department of Agriculture proposed similar regulations for voluntary labeling of raw meat and poultry.) Foods labeled before that day could use the old label. This appeared on all products in 1995.", "prediction 4": "The label was mandated for most food products under the provisions of the 1990 Nutrition Labeling and Education Act, per the recommendations of the U.S. Food and Drug Administration. The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994. (Meat and poultry products were not covered by NLEA.) Foods labeled before that day could use the old label. This appeared on all products in 1995.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 186 } ], "missing-info": [], "corrected-prediction": "Nutrition labels were introduced in the US under the provisions of the 1990 Nutrition Labeling and Education Act (NLEA). The law required food companies to begin using the new food label on packaged foods beginning May 8, 1994." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played carrie on the little house on the prairie?", "passages": [ [ "Little House on the Prairie (novel)", "Little House on the Prairie (novel)\n\nLittle House on the Prairie is an autobiographical children's novel by Laura Ingalls Wilder, published in 1935.", "It was the third novel published in the \"Little House\" series, continuing the story of the first, \"Little House in the Big Woods\" (1932), but not related to the second.", "Thus, it is sometimes called the second one in the series, or the second volume of \"the Laura Years\".", "The novel is about the months the Ingalls spent on the Kansas prairie around the town of Independence.", "Laura describes how her father built their one-room log house in Indian Territory, having heard that the government planned to open the territory to white settlers soon.", "In contrast to \"Little House in the Big Woods\", the Ingalls face difficulty and danger in this book.", "They all fall ill from malaria, which was ascribed to breathing the night air or eating watermelon.", "American Indians are a common sight for them, as their house was built in Osage territory, and Ma's open prejudice about Indians contrasts with Laura's more childlike observations about those who live and ride nearby." ], [ "Lindsay and Sidney Greenbush", "Lindsay and Sidney Greenbush\n\nRachel Lindsay Rene Bush and Sidney Robyn Danae Bush (born May 25, 1970, Los Angeles) are former child actresses, best known for their combined (alternating) role as Carrie Ingalls, in the drama series \"Little House on the Prairie\".", "They are identical twin sisters, born to actor Billy \"Green\" Bush and Carole Kay Bush.", "Their older brother, Clay, is also an actor.", "Their shared character's younger sister Grace Ingalls was played by Wendi and Brenda Turnbaugh.", "Prior to \"Little House on the Prairie\" debuting on September 11, 1974, they starred in the made-for-television drama \"Sunshine\" (1973), as Jill Hayden.", "In 1978, in the season five \"Little House\" episode \"The Godsister,\" the sisters are shown together playing different characters.", "The twins' final appearance on the series was on May 10, 1982.", "In the final season, their absence was explained that the family (except Laura) moved to Burr Oak, Iowa, to pursue a promising life.", "Several months later, the series was canceled.", "The opening credits of the series showed one of the twins running in a meadow behind the credit \"Lindsay Sidney Greenbush\", leading many viewers to believe that was the actress' full name." ] ], "gold": "Little House on the Prairie is an autobiographical children's novel by Laura Ingalls Wilder, published in 1935, that has received various adaptations. Two of them were released in 1974, and both of them include the character of Carrie. She was played by Lindsay and Sidney Greenbush in both the movie and the TV show that aired that year.", "prediction 1": "Rachel Lindsay Rene Bush and Sidney Robyn Danae Bush are former child actresses, best known for their combined (alternating) role as Carrie Ingalls, in the drama series Little House on the Prairie. They are identical twin sisters, born to actor Billy \"Green\" Bush and Carole Kay Bush. Their shared character's younger sister Grace Ingalls was played by Wendi and Brenda Turnbaugh.", "prediction 2": "Lindsay Rene Bush and Sidney Robyn Danae Bush are former child actresses, best known for their combined (alternating) role as Carrie Ingalls, in the drama series Little House on the Prairie. Rachel Lindsay Rene Bush and Sidney Robyn Danae Bush are identical twin sisters, born to actor Billy \"Green\" Bush and Carole Kay Bush. Their shared character's younger sister Grace Ingalls was played by Wendi and Brenda Turnbaugh.", "prediction 3": "Rachel Lindsay Rene Bush and Sidney Robyn Danae Bush, better known for their combined (alternating) role as Carrie Ingalls in the Little House on the Prairie, are identical twin sisters, born to actor Billy \"Green\" Bush and Carole Kay Bush. Rachel's younger sister Grace Ingalls was played by Wendi and Brenda Turnbaugh.", "prediction 4": "Little House on the Prairie is an autobiographical children's novel by Laura Ingalls Wilder, published in 1935. It was the third novel published in the \"Little House\" series, continuing the story of the first, Little House in the Big Woods, published in 1932, but not related to the second. Rachel Lindsay Rene Bush and Sidney Robyn Danae Bush are former child actresses, best known for their combined (alternating) role as Carrie Ingalls, in the drama series Little House on the Prairie. They are identical twin sisters, born to Billy \"Green\" Bush and Carole Kay Bush. Their shared character' younger sister Grace Ingalls was played by Wendi and Brenda Turnbaugh.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 380 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Little House on the Prairie is an autobiographical children's novel by Laura Ingalls Wilder, published in 1935. Rachel Lindsay Rene Bush and Sidney Robyn Danae Bush are former child actresses, best known for their combined (alternating) role as Carrie Ingalls, in the drama series Little House on the Prairie. \"Little House on the Prairie\" debuted on September 11, 1974." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who lost a lot of their power after the battle of culloden in 1746?", "passages": [ [ "Battle of Culloden", "While it is almost certain there was a skirmish upon the bridge, it has been proposed that the Master of Lovat shrewdly switched sides and turned upon the fleeing Jacobites.", "Such an act would explain his remarkable rise in fortune in the years that followed.", "Following the battle, the Jacobites' Lowland units headed south, towards Corrybrough and made their way to Ruthven Barracks, while their Highland units headed north, towards Inverness and on through to Fort Augustus.", "There they were joined by Barisdale's Macdonalds and a small battalion of MacGregors.", "The roughly 1,500 men who assembled at Ruthven Barracks received orders from Charles Edward Stuart to the effect that all was lost and to \"shift for himself as best he could\".", "Similar orders must have been received by the Highland units at Fort Augustus.", "By 18 April the Jacobite army was disbanded.", "Officers and men of the units in the French service made for Inverness, where they surrendered as prisoners of war on 19 April.", "The rest of the army broke up, with men heading for home or attempting to escape abroad.", "Some ranking Jacobites made their way to , where Charles Edward Stuart had first landed at the outset of the campaign in 1745.", "Here on 30 April they were met by the two French frigates \u2013 the \"Mars\" and \"Bellone\"." ], [ "Battle of Culloden", "Battle of Culloden\n\nThe Battle of Culloden (; ) was the final confrontation of the Jacobite rising of 1745.", "On 16 April 1746, the Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands.", "Queen Anne, the last monarch of the House of Stuart, died in 1714, with no living children.", "Under the terms of the Act of Settlement 1701, she was succeeded by her second cousin George I of the House of Hanover, who was a descendant of the Stuarts through his maternal grandmother, Elizabeth, a daughter of James VI and I. Raising an army consisting mostly of Scottish clansmen along with smaller units of Irish and Englishmen from the Manchester Regiment, Charles' efforts initially met with success and at one point began to threaten London.", "However, a series of events forced the army's return to Scotland, where they were soon pursued by an army raised by the Duke of Cumberland.", "The two forces eventually met at Culloden, on terrain that made the highland charge difficult and gave the larger and well-armed British forces the advantage.", "The battle lasted only an hour, with the Jacobites suffering a bloody defeat.", "Between 1,500 and 2,000 Jacobites were killed or wounded in the brief battle.", "In contrast, only about 300 government soldiers were killed or wounded." ] ], "gold": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. The repercussions of the conflict include the Jacobite army, commanded by Charles Edward Stuart, John O'Sullivan, Lord John Drummond and Lord George Murray, losing a lot of their power after being decisively defeated by a British government force under Prince William Augustus, Duke of Cumberland, on Drummossie Moor near Inverness in the Scottish Highlands.", "prediction 1": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. On 16 April 1746, the Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands. Between 1,500 and 2,000 Jacobites were killed or wounded in the brief battle. During the battle, the Jacobites' Lowland units headed south, towards Corrybrough and made their way to Ruthven Barracks.", "prediction 2": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. The Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands. Between 1,500 and 2,000 Jacobites were killed or wounded in the brief battle.", "prediction 3": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. On 16 April 1746, the Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands. Between 1,500 and 2,000 Jacobites were killed or wounded in the brief battle. In contrast, only about 300 government soldiers were killed or wounded.", "prediction 4": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. On 16 April 1746, the Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands. Between 1,500 and 2,000 Jacobites were killed or wounded in the brief battle.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 484 } ], "missing-info": [], "corrected-prediction": "The Battle of Culloden was the final confrontation of the Jacobite rising of 1745. On 16 April 1746, the Jacobite forces of Charles Edward Stuart were decisively defeated by Hanoverian forces commanded by William Augustus, Duke of Cumberland, near Inverness in the Scottish Highlands. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the chief justice of illinois supreme court?", "passages": [ [ "Anne M. Burke", "Anne M. Burke\n\nAnne Marie Burke (n\u00e9e McGlone; born February 3, 1944) is an Illinois Supreme Court Justice for the First Judicial District (Cook County, Illinois).", "Appointed in 2006, she won election to the court in 2008.", "Burke had previously been appointed to the Illinois Appellate Court in 1995 and was elected to that seat in 1996.", "Burke was a founder of the Special Olympics in 1968.", "She is married to Chicago Alderman Edward M. Burke from the 14th Ward.", "Born Anne Marie McGlone, she was raised on Chicago's South Side.", "She has two brothers and one sister.", "She graduated from Maria High School.", "In the late 1960s, she was working as a physical education teacher with the Chicago Park District when she began advocating for the idea of holding a Special Olympics for developmental challenged children.", "Gaining support from eventual chair, Eunice Shriver and the Kennedy Foundation, the first Special Olympics was held at Soldier Field in Chicago in 1968.", "While raising her own children, she returned to school.", "She received a Bachelor of Arts degree from DePaul University in 1976 and a Juris Doctor degree from Chicago-Kent College of Law in 1983.", "Burke was admitted to the Illinois bar and federal Northern District of Illinois in 1983, and the U.S. Court of Appeals for the 7th Circuit in 1985.", "She was certified for the Northern District's trial bar in 1987." ], [ "Supreme Court of Illinois", "Supreme Court of Illinois\n\nThe Supreme Court of Illinois is the state supreme court, the highest court of the state of Illinois.", "The court's authority is granted in Article VI of the current Illinois Constitution, which provides for seven justices elected from the five appellate judicial districts of the state: Three justices from the First District (Cook County) and one from each of the other four districts.", "Each justice is elected for a term of ten years and the chief justice is elected by the court from its members for a three-year term.", "The court has limited original jurisdiction and has final appellate jurisdiction.", "It has mandatory jurisdiction in capital cases and cases where the constitutionality of laws has been called into question, and discretionary jurisdiction from the Illinois Appellate Court.", "Along with the state legislature, the court promulgates rules for all state courts.", "Also, its members have the authority to elevate trial judges to the appellate court on a temporary basis.", "The court administers professional discipline through the Attorney Registration and Disciplinary Committee and it governs initial licensing through the Illinois Board of Admissions to the Bar.", "The official reporter of the Illinois Supreme Court is \"Illinois Reports\".", "The Illinois Supreme Court is separated into 5 districts, with one Justice elected from each except the 1st, which elects three Justices.", "They are separated by county lines, as follows." ], [ "Rita B. Garman", "Rita B. Garman\n\nRita B. Garman (born November 19, 1943) is an American judge.", "She is a current Justice of the Supreme Court of Illinois.", "She represents the Fourth Judicial District on the Supreme Court.", "She was elected by her peers to serve a three-year term as Chief Justice from October 26, 2013 to October 25, 2016.", "Garman was born in Aurora, Illinois.", "She was valedictorian of Oswego High School in 1961.", "She received her B.S. degree in economics with highest honors from the University of Illinois in 1965, Bronze Tablet.", "She earned her J.D. degree with distinction from the University of Iowa College of Law in 1968.", "Garman was an Assistant State's Attorney in Vermilion County, Illinois from 1969 to 1973.", "She later briefly worked in private practice with Sebat, Swanson, Banks, Lessen & Garman in 1973.", "In 1973, she was appointed an Associate Judge for the Fifth Judicial Circuit, where she served for twelve years.", "In 1987, she was elevated to be a Circuit Judge in the Fifth Judicial Circuit (1986\u201395) and served as the Fifth Circuit's Presiding Judge from 1987 until her assignment to the Appellate Court.", "Garman was assigned to the Appellate Court, Fourth District, in July 1995.", "She was elected to the position in November 1996." ] ], "gold": "The current Illinois Supreme Court Chief Justice is Anne M. Burke. The court elects each chief justice from its members for a three-year term, and Lloyd A. Karmeier previously held the position from 2016 to 2019, while Rita B. Garman did so from 2013 to 2016, and Mary Jane Theis from 2010 to 2013.", "prediction 1": "The Illinois supreme court, the highest court of the state of Illinois, is made up of seven justices. The current chief justice of the court is Rita B. Garman, who was elected by her peers to serve a three-year term from October 26, 2013 to October 25, 2016 and the previous chief justice is Anne Marie Burke.", "prediction 2": "The Illinois Supreme Court is the highest court of the state of Illinois. The chief justice of the Illinois Supreme Court is Anne Marie Burke, who serves as the Justice for the First Judicial District. Rita B. Garman, who serves as the Chief Justice from October 26, 2013 to October 25, 2016, is the Chief Justice of the Illinois Supreme Court. The current Chief Justice is Rita B. Garman, who served a three-year term from October 26, 2013 to October 25, 2016.", "prediction 3": "The Supreme Court of Illinois is the state supreme court and the highest court of the state of Illinois. The Chief Justice of the Supreme Court of Illinois is Anne Marie Burke, who served as Chief Justice of the Court from 2006 to 2008. Rita B. Garman served as Chief Justice from October 26, 2013 to October 25, 2016.", "prediction 4": "The Supreme Court of Illinois is the highest court of the state of Illinois. The current chief justice is Rita B. Garman. American judge Anne Marie Burke serves as the current Chief Justice of the Supreme Court of Illinois. American Judge Anne Marie Burke served as the current Chief Justice of the Supreme Court of Illinois from 2006 to 2008.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 101 }, { "error type": "Unverifiable", "explanation": "", "start": 106, "end": 127 }, { "error type": "Unverifiable", "explanation": "", "start": 262, "end": 309 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "One chief justice of the Supreme Court of Illinois was Rita B. Garman, who was elected by her peers to serve a three-year term from October 26, 2013 to October 25, 2016. The chief justice is elected by the court from its members for a three-year term." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was chinese drywall used in the us?", "passages": [ [ "Chinese drywall", "Chinese drywall\n\n\"Chinese drywall\" refers to an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009 \u2014 affecting \"an estimated 100,000 homes in more than 20 states.\"", "In samples of contaminated drywall, laboratory tests will detect off-gassing of volatile chemicals and sulfurous gases \u2014 including carbon disulfide, carbonyl sulfide, and hydrogen sulfide.", "The emissions worsen as temperature and humidity rise, will give off a sulfuric (rotten egg) odor and will cause copper surfaces to turn black and powdery, a chemical process indicative of a hydrogen sulfide reaction and an early indication of contaminated drywall.", "Copper pipes, electrical wiring, and air conditioner coils are affected, as well as silver jewelry.", "Homeowners have reported health symptoms including respiratory problems such as asthma attacks, chronic coughing and difficulty breathing, as well as chronic headaches and sinus issues.", "Drywall, also known as plasterboard, is a building material typically consisting of gypsum-based plaster extruded between two thick sheets of paper and kiln-dried." ] ], "gold": " Chinese drywall is an incident isolated to the USA. It refers an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009.", "prediction 1": "\"Chinese drywall\" refers to an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009 \u2014 affecting \"an estimated 100,000 homes in more than 20 states.\"", "prediction 2": "\"Chinese drywall\" refers to an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009. The drywall was used in residential construction between 2001 and 2009.", "prediction 3": "\"Chinese drywall\" refers to an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009. It was used in residential construction between 2001 and 2009, affecting \"an estimated 100,000 homes in more than 20 states.\" Chinese drywall is a problem that affects residential construction in the US, especially in residential construction in New England, Connecticut, Indiana, and Texas.", "prediction 4": "\"Chinese drywall\" refers to a health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009. During this time, it was used in an estimated 100,000 homes in more than 20 states.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 262 } ], "missing-info": [], "corrected-prediction": "\"Chinese drywall\" refers to an environmental health issue involving defective drywall manufactured in China, imported to the United States and used in residential construction between 2001 and 2009." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Canada's national laboratory for particle and nuclear physics?", "passages": [ [ "TRIUMF", "TRIUMF\n\nTRIUMF is Canada's national particle accelerator centre.", "It is considered Canada's premier physics laboratory, and is consistently regarded as one of the leading subatomic physics research centers on the international level.", "Owned and operated by a consortium of universities as a joint venture, TRIUMF is located on the south campus of one of its founding members \u2013 the University of British Columbia in Vancouver, British Columbia.", "TRIUMF houses the world's largest cyclotron, a source of 520 MeV protons, which was named an IEEE Milestone in 2010.", "TRIUMF's accelerator-focused activities involve particle physics, nuclear physics, nuclear medicine, materials science, and detector and accelerator development.", "There are over 500 scientists, engineers, technicians, tradespeople, administrative staff, postdoctoral fellows, and students on the TRIUMF site.", "The lab attracts over 1000 national and international researchers every year and has generated over $1B in economic impact activity over the last decade.", "TRIUMF scientists and university-based physicists develop and implement Natural Sciences and Engineering Research Council's (NSERC) long-range plan for subatomic physics.", "TRIUMF uses these plans to develop its own priorities.", "TRIUMF has over 50 international agreements for collaborative scientific research." ] ], "gold": "Canada's national laboratory for particle and nuclear physics, TRIUMF, is located on the south campus of one of its founding members \u2013 the University of British Columbia in Vancouver, British Columbia. Founded in 1968, it is considered Canada's premier physics laboratory and is consistently regarded as one of the leading subatomic physics research centers on the international level. The current director of the institution is Nigel Smith, who succeeded Jonathan A Bagger in 2021. Bagger had previously led the laboratory since 2014.", "prediction 1": "TRIUMF is Canada's national particle accelerator centre and is considered Canada's premier physics laboratory. TRIUMF's accelerator-focused activities involve particle physics, nuclear physics, nuclear medicine, materials science, and detector and accelerator development. There are over 500 scientists, engineers, technicians, tradespeople, administrative staff, postdoctoral fellows, and students on the TRIUMF site.", "prediction 2": "Canada's national particle accelerator centre, TRIUMF, is considered Canada's premier physics laboratory, and is consistently regarded as one of the leading subatomic physics research centers on the international level. Owned and operated by a consortium of universities as a joint venture, TRIUMF is located on the south campus of one of its founding members \u2013 the University of British Columbia in Vancouver, British Columbia.", "prediction 3": "The TRIUMF particle accelerator centre is Canada's national particle accelerator centre, and is considered Canada's premier physics laboratory. TRIUMF is also consistently regarded as one of the leading subatomic physics research centers on the international level.", "prediction 4": "TRIUMF is Canada's national particle accelerator centre. It is considered Canada's premier physics laboratory, and is consistently regarded as one of the leading subatomic physics research centers on the international level. The lab attracts over 1000 national and international researchers every year and has generated over $1B in economic impact activity over the last decade.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 418 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "TRIUMF is Canada's national particle accelerator centre and is considered Canada's premier physics laboratory. It is considered Canada's premier physics laboratory, and is consistently regarded as one of the leading subatomic physics research centers on the international level. TRIUMF is located on the south campus of one of its founding members \u2013 the University of British Columbia in Vancouver, British Columbia." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did harry potter and the deathly hallows part 1 come out?", "passages": [ [ "Harry Potter and the Deathly Hallows \u2013 Part 1", "The world premiere for \"Deathly Hallows \u2013 Part 1\" was held in Leicester Square in London on 11 November 2010, with fans from across the world turning up \u2013 some of whom had camped for days in the square.", "This was followed by the Belgian premiere on 12 November and the US premiere in New York City on 15 November.", "Just 48 hours prior to the official North American launch of Part 1, the first 36 minutes of the film were leaked on the internet.", "Even before the leak, the film was already the fifth-biggest generator of advance ticket sales in history, after selling out 1,000 cinemas across the United States.", "Despite widely circulating rumours that the leaked footage was a marketing ploy to generate hype for the movie release date, no screener discs had been created by Warner Bros., and executives called it \"a serious breach of copyright violation and theft of Warner Bros. property\".", "In Australia, the film had its premiere on 13 November at Warner Bros. Movie World, located on the Gold Coast, Queensland.", "Three hundred people attended the viewing, which was the second official showing in the world, behind the UK premiere.", "The film premiered in Kuwait's release on 16 November.", "In Israel, Estonia, and New Zealand, the film was released on 18 November." ], [ "Harry Potter and the Deathly Hallows \u2013 Part 1", "Harry Potter and the Deathly Hallows \u2013 Part 1\n\nHarry Potter and the Deathly Hallows \u2013 Part 1 is a 2010 fantasy film directed by David Yates and distributed by Warner Bros. Pictures.", "It is the first of two cinematic parts based on J. K. Rowling's 2007 novel of the same name and features an ensemble cast.", "The film, which is the seventh and penultimate instalment in the \"Harry Potter\" film series, was written by Steve Kloves and produced by David Heyman, David Barron, and Rowling.", "The film stars Daniel Radcliffe as Harry Potter, with Rupert Grint and Emma Watson, respectively, reprising roles as Harry's best friends Ron Weasley and Hermione Granger.", "It is the sequel to \"Harry Potter and the Half-Blood Prince\" and is followed by the concluding entry, \"Harry Potter and the Deathly Hallows \u2013 Part 2\".", "The story follows Harry Potter who has been tasked by Dumbledore with finding and destroying Lord Voldemort's secret to immortality \u2013 the Horcruxes.", "Filming began on and was completed on .", "\"Part 1\" was released in 2D cinemas and IMAX formats worldwide on 19 November 2010." ] ], "gold": "Harry Potter and the Deathly Hallows \u2013 Part 1 is a 2010 fantasy film based on J. K. Rowling's 2007 novel of the same name and acting as the seventh installment in the Harry Potter film series. The world premiere for the film was held in Leicester Square in London on 11 November 2010, with fans from across the world turning up. The Belgian premiere followed on 12 November, with the US premiere in New York City being held on 15 November. It was later released across US and UK theatres on 19 November 2010.", "prediction 1": "Harry Potter and the Deathly Hallows \u2013 Part 1 is a 2010 fantasy film directed by David Yates and distributed by Warner Bros. Pictures. The world premiere for \"Deathly Hallows \u2013 Part 1\" was held in Leicester Square in London on 11 November 2010, with fans from across the world turning up \u2013 some of whom had camped for days in the square. It was followed by the Belgian premiere on 12 November and the US premiere in New York City on 15 November. In Australia, the film had its premiere on 13 November at Warner Bros. Movie World, located on the Gold Coast, Queensland. It premiered in Kuwait's release on 16 November. In Israel, Estonia, and New Zealand, the film was released on 18 November. In Israel, Estonia, Estonia, and New Zealand, the film was released on 26 November 2010. In Israel, the film was released in 2D cinemas and IMAX formats worldwide", "prediction 2": "Harry Potter and the Deathly Hallows \u2013 Part 1 is a 2010 fantasy film directed by David Yates and distributed by Warner Bros. Pictures. The world premiere for the film was held in Leicester Square in London on 11 November 2010. The Belgian premiere was held on 12 November, and the US premiere was held on 15 November.", "prediction 3": "Harry Potter and the Deathly Hallows is a 2010 fantasy film directed by David Yates and distributed by Warner Bros. Pictures. It is the first of two cinematic parts based on J. K. Rowling's 2007 novel of the same name and features an ensemble cast. The world premiere for \"Deathly Hallows \u2013 Part 1\" was held in Leicester Square in London on 11 November 2010, with fans from across the world turning up \u2013 some of whom had camped for days in the square. This was followed by the Belgian premiere on 12 November and the US premiere in New York City on 15 November. In Australia, the film had its premiere on 13 November at Warner Bros. Movie World located on the Gold Coast, Queensland.", "prediction 4": "Harry Potter and the Deathly Hallows, part 1 is a 2010 American fantasy film directed by David Yates and distributed by Warner Bros. Pictures. The world premiere for the film was held in Leicester Square in London on 11 November 2010. The Belgian premiere was held on 12 November and the US premiere was held on 15 November. In Australia and Kuwait, the film was premiered on 13 November at Warner Bros. Movie World, located on the Gold Coast, Queensland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 134 }, { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 501, "end": 568 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 764, "end": 766 }, { "error type": "Irrelevant", "explanation": "", "start": 818, "end": 820 }, { "error type": "Irrelevant", "explanation": "", "start": 833, "end": 845 }, { "error type": "Redundant", "explanation": "In Israel, Estonia, and New Zealand, the film was released on 18 November. ", "start": 693, "end": 763 }, { "error type": "Redundant", "explanation": "November", "start": 767, "end": 781 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 782, "end": 792 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Harry Potter and the Deathly Hallows \u2013 Part 1 is a 2010 fantasy film based on J. K. Rowling's 2007 novel of the same name and acting as the seventh installment in the Harry Potter film series. The world premiere for \"Deathly Hallows \u2013 Part 1\" was held in Leicester Square in London on 11 November 2010, with fans from across the world turning up. It was followed by the Belgian premiere on 12 November and the US premiere in New York City on 15 November. In Australia, the film had its premiere on 13 November. It premiered in Kuwait's release on 16 November. In Israel, Estonia, and New Zealand, the film was released on 18 November. The film was later released worldwide on 19 November 2010." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who was holding the indian army during the bangladesh liberation war of 1971?", "passages": [ [ "Indo-Pakistani War of 1971", "Following the surrender, the Indian Army took approximately 90,000 Pakistani servicemen and their Bengali supporters as POWs, making it the largest surrender since World War II.", "Initial counts recorded that approximately 79,676 war prisoners were uniformed personnel, and the overwhelming majority of the war prisoners were officers - most of them were from the Army and Navy, while relatively small numbers were from the Air Force and Marines; others in larger number were serving in the paramilitary.", "The remaining prisoners were civilians who were either family members of the military personnel or collaborators (razakars).", "The Hamoodur Rahman Commission and the POW Investigation Commission reports instituted by Pakistan lists the Pakistani POWs as given in the table below.", "Apart from soldiers, it was estimated that 15,000 Bengali civilians were also made prisoners of war.", "The Soviet Union sympathised with the East Pakistanis, and supported the Indian Army and Mukti Bahini's incursion against Pakistan during the war, in a broader view of recognising that the succession of East Pakistan as Independent Bangladesh would weaken the position of its rivals\u2014 the United States and China.", "The Soviet Union gave assurances to India that if a confrontation with the United States or China developed, it would take counter-measures.", "This assurance was enshrined in the Indo-Soviet Treaty of Friendship and Cooperation signed in August 1971." ], [ "Indo-Pakistani War of 1971", "Indo-Pakistani War of 1971\n\nThe Indo-Pakistani War of 1971 was a military confrontation between India and Pakistan that occurred during the liberation war in East Pakistan from 3 December 1971 to the fall of Dacca (Dhaka) on 16 December 1971.", "The war began with preemptive aerial strikes on 11 Indian air stations, which led to the commencement of hostilities with Pakistan and Indian entry into the war of independence in East Pakistan on the side of Bengali nationalist forces.", "Lasting just 13 days, it is one of the shortest wars in history.", "During the war, Indian and Pakistani militaries simultaneously clashed on the eastern and western fronts; the war ended after the Eastern Command of the Pakistan military signed the Instrument of Surrender on 16 December 1971 in Dhaka, marking the formation of East Pakistan as the new nation of Bangladesh.", "Officially, East Pakistan had earlier called for its secession from the unity of Pakistan on 26 March 1971.", "Approximately 90,000 to 93,000 Pakistani servicemen were taken prisoner by the Indian Army, which included 79,676 to 81,000 uniformed personnel of the Pakistan Armed Forces, including some Bengali soldiers who had remained loyal to Pakistan.", "The remaining 10,324 to 12,500 prisoners were civilians, either family members of the military personnel or collaborators (razakars).", "It is estimated that between 300,000 and 3,000,000 civilians were killed in Bangladesh." ] ], "gold": "During the Bangladesh Liberation War of 1971, the Indian Army held 54,154 POWs from the Pakistani Army, 1,381 POWs from the Pakistani Navy, 833 POWs from the Pakistani Air Force 22,000 POWs form the paramilitary police and 12,000 POWs from the civil government, for a total of 90,368 POWs. This was the largest surrender of prisoners since World War II.", "prediction 1": "The Indo-Pakistani War of 1971 was a military confrontation between India and Pakistan that occurred during the liberation war in East Pakistan from 3 December 1971 to the fall of Dacca on 16 December 1971. The Indian Army took approximately 90,000 Pakistani servicemen and their Bengali supporters as POWs during the war. The 79,676 to 81,000 uniformed personnel of the Pakistan Armed Forces were also held by the Indian Army. The remaining 10,324 to 12,500 prisoners were civilians, either family members of the military personnel or collaborators (razakars).", "prediction 2": "The Indo-Pakistani War of 1971 was a military confrontation between India and Pakistan that occurred during the liberation war in East Pakistan from 3 December 1971 to the fall of Dacca (Dhaka) on 16 December 1971. Approximately 90,000 to 93,000 Pakistani servicemen were taken prisoner by the Indian Army. These included 79,676 to 81,000 uniformed personnel of the Pakistan Armed Forces, including some Bengali soldiers who had remained loyal to Pakistan. The remaining 10,324 to 12,500 were civilians who were either family members of the military personnel or collaborators.", "prediction 3": "The Indo-Pakistani War of 1971 was a military confrontation between India and Pakistan that occurred during the liberation war in East Pakistan from 3 December 1971 to the fall of Dacca (Dhaka) on 16 December 1971. Approximately 90,000 to 93,000 Pakistani servicemen were taken prisoner by the Indian Army, which included 79,676 to 81,000 uniformed personnel of the Pakistan Armed Forces, including some Bengali soldiers who had remained loyal to Pakistan. The remaining 10,324 to 12,500 prisoners were civilians who were either family members of the military personnel or collaborators.", "prediction 4": "The Indo-Pakistani War of 1971 was a military confrontation between India and Pakistan that occurred during the Liberation War in East Pakistan from 3 December 1971 to the fall of Dacca on 16 December 1971. Approximately 90,000 to 93,000 Pakistani servicemen were taken prisoner by the Indian Army, which included 79,676 to 81,000 uniformed personnel of the Pakistan Armed Forces, including some Bengali soldiers who had remained loyal to Pakistan. The remaining 10,324 to 12,500 prisoners were civilians, either family members of the military personnel or collaborators.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 393, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 485, "end": 561 }, { "error type": "Irrelevant", "explanation": "", "start": 31, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 301 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "During the Indo-Pakistani War of 1971, the Indian Army took approximately 90,000 POWs during the war. 79,676 to 81,000 were uniformed personnel of the Pakistan Armed Forces. The remaining 10,324 to 12,500 prisoners were civilians. This makes it the largest surrender since World War II" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who gets arya out of king's landing?", "passages": [ [ "Arya Stark", "Arya escapes King's Landing with Yoren and his party of recruits; and on the road, she clashes with the other Night's Watch child recruits Lommy, Gendry, and Hot Pie but eventually befriends them.", "On the way, the party is attacked by Amory Lorch when Yoren refuses to yield Gendry, who is actually a bastard son of the late King Robert, to the Lannisters.", "The Night's Watch convoy is overrun and massacred, but Arya and the other children escape through a tunnel.", "Before escaping, she rescues three prisoners locked in a wagon cage, among them a mysterious man named Jaqen H'ghar.", "Arya and her friends are later captured by Ser Gregor Clegane and taken to Harrenhal as slave laborers.", "After witnessing the torture death of her fellow prisoners, Arya begins nightly reciting the names of the people upon whom she wishes to exact revenge.", "At Harrenhal she re-encounters Jaqen, now under the employ of the Lannisters, who offers to kill for her any three people she names; whereupon she names two people who hurt her at Harrenhal.", "When Jaqen asks her to name the last target, Arya extorts him to help her free northern prisoners by naming Jaqen himself as the third person." ], [ "Arya Stark", "Arya Stark\n\nArya Stark is a fictional character in American author George R. R. Martin's award-winning \"A Song of Ice and Fire\" epic fantasy novel series.", "She is a prominent point of view character in the novels, and is the only viewpoint character to appear in every published book of the series.", "Introduced in 1996's \"A Game of Thrones\", Arya is the younger daughter and third child of Lord Eddard Stark and his wife Lady Catelyn Stark.", "She is tomboyish, headstrong, feisty, independent, disdains traditional female pursuits, and is often mistaken for a boy.", "She wields a smallsword named Needle, a gift from her half-brother, Jon Snow, and is trained in the Braavosi style of sword fighting by Syrio Forel.", "Arya is portrayed by English actress Maisie Williams in HBO's Emmy-winning television adaptation of the novel series, \"Game of Thrones\".", "Her performance has garnered critical acclaim, particularly in the second season for her work opposite veteran actor Charles Dance (Tywin Lannister) when she served as his cupbearer.", "She is among the most popular characters in either version of the story.", "Williams was nominated for a Primetime Emmy Award for Outstanding Supporting Actress in a Drama Series for the role in 2016." ], [ "Arya Stark", "The sword is well suited to Arya's slender build and her favored \"Water Dance\" (fencing) style which emphasizes speed and agility with a thin, light rapier used in quick thrusting attacks.", "Throughout her travels, Arya displays great resourcefulness and cunning, and also becomes increasingly ruthless.", "Arya is the only one out of her full-siblings to inherit the Stark features and is said to resemble her late aunt Lyanna in both looks and temperament.", "At the start of the series, she is generally regarded as messy and plain-looking, and often mistaken for a boy; but there are multiple instances in the books of her (favorable) comparison to the beautiful Lyanna, and catching the eye of men later on in the series.", "She is also a skinchanger, capable of telepathically possessing her direwolf Nymeria in dreams, as well as psychically bonding with a street cat in Braavos.", "Arya is in love with her adopted direwolf cub, which she names Nymeria after a legendary warrior queen.", "She travels with her father, Eddard, to King's Landing when he is made Hand of the King.", "Before she leaves, her half-brother Jon Snow has a smallsword made for her as a parting gift, which she names \"Needle\" after her least favorite ladylike activity." ] ], "gold": "Arya Stark is a fictional character in American author George R. R. Martin's \"A Song of Ice and Fire\" epic fantasy novel series and its television adaptation \"Game of Thrones,\" where English actress Maisie Williams portrays her. In the novel \"A Game of Thrones,\" she travels with her father, Eddard, to King's Landing when he is made Hand of the King. She later escapes King's Landing with Yoren and his party of recruits. Yoren also helps her flee the place during Season 1 of \"Game of Thrones.\"", "prediction 1": "Arya Stark is a fictional character in American author George R. R. Martin's award-winning A Song of Ice and Fire epic fantasy novel series. In the book Arya and her party escape from King's Landing with Yoren and his party of recruits, aided by the skills of their half-brother Jon Snow, who has the power to fight the dragons of King's Landing and the ability to control the Night's Watch.", "prediction 2": "Arya Stark is a fictional character in American author George R. R. Martin's award-winning A Song of Ice and Fire epic fantasy novel series. In the novel, Arya rescues three prisoners locked in a wagon cage, among them a mysterious man named Jaqen H'ghar. During the television adaptation of the novel, Arya reunites with her half-brother Jon Snow and uses his sword Needle to free the prisoners.", "prediction 3": "Arya Stark is a fictional character in American author George R. R. Martin's award-winning \"A Song of Ice and Fire\" epic fantasy novel series. In the novel, Arya finds herself trapped in a dark cave with her friends, who are rescued by Arya's half-brother, Jon Snow.", "prediction 4": "Arya Stark is a fictional character in American author George R. R. Martin's award-winning A Song of Ice and Fire epic fantasy novel series. On the way, the Night's Watch convoy is overrun and massacred, but Arya and the other children escape through a tunnel. Before escaping, Arya rescues three prisoners locked in a wagon cage, among them a mysterious man named Jaqen H'ghar. Arya and her friends are later captured by Ser Gregor Clegane and taken to Harrenhal as slave laborers.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 289, "end": 391 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 237, "end": 288 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 158, "end": 171 }, { "error type": "Unverifiable", "explanation": "", "start": 141, "end": 152 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Arya Stark is a fictional character in American author George R. R. Martin's award-winning A Song of Ice and Fire epic fantasy novel series. Arya is portrayed by English actress Maisie Williams. She travels with her father, Eddard, to King's Landing when he is made Hand of the King. Arya escapes from King's Landing with Yoren and his party of recruits." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is a group of australian magpies called?", "passages": [ [ "Court of Owls", "In the new \"Nightwing\" series, Lincoln March addresses the Parliament of Owls as they decide to cast aside their connection to the Court of Owls in Gotham and don black owl masks.", "As March begins to preach his new role in the Parliament, he is killed by Raptor, who reveals that both he and the Parliament agree that March's own desires began to become a hindrance to them and they needed a clean path to Nightwing.", "Dick Grayson has finally re-obtained his secret identity and has returned to the role of Nightwing.", "He willingly works for the Parliament in order to bring them down from the inside; they are wary of and suspect Grayson's true intentions, but they do not know that their leverage over him has been resolved.", "To keep him in check, the Parliament partners him with Raptor to aid in his missions.", "In the \"Watchmen\" sequel \"Doomsday Clock\", representatives of the Court of Owls are among the villains that attend the underground meeting held by Riddler to talk about the Superman Theory.", "Their judge states that the Court of Owls are not relocating to Kahndaq.", "The Talons are a breed of deadly assassins that are absolutely loyal to the Court of Owls.", "They remain \"sleeping\" deep within their inner sanctum until they are \"called\" upon." ], [ "Flock (birds)", "Flock (birds)\n\n", "A flock is a gathering of a group of same species animals in order to forage or travel with one another.", "In avians flocks are typically seen in association with migration.", "While this is true it can also be seen that flocking is important in safety from predation and foraging benefits.", "However it is also important to note that living in a flock can also come at a cost to the birds living within it.", "The definition of flock is narrow, only focusing on a single species existing within a flock.", "However the existence of mixed flocks are also present in the environment and consist of at least two or more species.", "In avians the species that tend to flock together are typically similar in taxonomy as well as morphological characters such as size and shape By having a flock with multiple species present, the defence against predation increases.", "Defence against predators is particularly important in closed habitats such as forests where early warning calls play a vital importance in the early recognition of danger.", "The result is the formation of many mixed-species feeding flocks.", "While mixed flocks are typically thought to be composed of two different species, it is specifically the two different behaviours of the species that compose a mixed flock.", "Within a mixed flock there can be two different behavioural characteristics: sally and gleaner." ] ], "gold": "A group of Australian magpies is usually called a parliament, which is also the name for a group of owls, but flock and tiding are what they are sometimes called. A flock is a gathering of a group of same-species animals to forage or travel.", "prediction 1": "A flock is a gathering of a group of same species animals in order to forage or travel with one another. In avians flocks are typically seen in association with migration. However the existence of mixed flocks are also present in the environment and consist of at least two or more species. In the Australian magpie, a flock is a group of magpies that have bonded together to form a single group.\n", "prediction 2": "The English word \"flock\" generally refers to a group of small, independent animals that are joined together by similar mates in order to forage or travel with one another. A group of Australian magpies, also known as a flock, is a group of still-living mosquito-eating pigeons. They live in colonies and are often found together as a species-specific group.", "prediction 3": "There are several ways a group of australian magpies can be called a flock. A flock of magpies can resemble a family or a colony of magpies. A colony is composed of a \u2018social\u2019 group of magpies who regularly lodge together in a den. In the Australian magpie, a \u201choard\u201d is a group of magpies that gather to forage or travel together. A colony is a collection of small, closely related birds which have been put into a protective chick mocking to each other magpies who live in a colony of birds known as a flock. In the Australian magpie, a colony of magpies known as a group, a colony.", "prediction 4": "A flock is a gathering of a group of same species animals in order to forage or travel with one another. In birds this is a group of singly or mixed magpie individuals and is sometimes called a \"single\" or \"double flock.\" In mammals this is a group of grebes or Godwits, sometimes called a \"double flock\". In Australia a single magpie is called a \"square flock\" which means a \"population of singly or mixed magpies\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 171 }, { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 290 } ], "missing-info": [], "corrected-prediction": "A flock is a gathering of a group of same species animals in order to forage or travel with one another. In the Australian magpie, a flock is a group of magpies that have bonded together to form a single group.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who wrote the song hero by mariah carey?", "passages": [ [ "Hero (Mariah Carey song)", "The video was included on Carey's DVD \"#1's\" (1998).", "The video features her in a long dark dress, sporting long curly hair.", "On few international versions of the album, a Spanish version of the song was included, such as on the Mexican and Argentinian versions.", "It was titled \"H\u00e9roe\", and featured translation by Jorge Luis Piloto, a Spanish musician who had come to briefly work with Carey.", "In 2001, following the September 11 attacks, Carey re-recorded the song as a medley with \"Never Too Far\", her single at the time.", "Titled \"Never Too Far/Hero Medley\", it was released as a charity single throughout October of that year.", "In an interview with MTV, Carey described the idea behind the medley:\n\n\"I started [performing] at different charity events where I did a combination of 'Never Too Far' and 'Hero'.", "We made it into a medley and kinda put them both in the same key and just made it work, and people responded really well to it.", "It's been interesting for me, since the events of September 11, the way people have been playing 'Hero' and talking to me about 'Never Too Far,' 'cause that song is also about loss.", "I figured that it would be a nice thing to do, to put them both out for Christmas." ], [ "Hero (Mariah Carey song)", "Hero (Mariah Carey song)\n\n\"Hero\" is a song by American singer and songwriter Mariah Carey.", "It was released on October 19, 1993, via Columbia Records as the second single from Carey's third studio album, \"Music Box\" (1993).", "Originally intended for Gloria Estefan, the song was written and produced by Mariah and Walter Afanasieff.", "While writing the song, Carey did not connect to its style or sound, therefore forfeiting it over to the soundtrack of the film of the same name.", "However, after being convinced to keep it, she changed some of the lyrics to more precisely fit her personality.", "Lyrically, the song is regarded as one of Carey's most inspirational and personal ballads, with its protagonist declaring that even though people may feel discouraged or down at times, in reality, they are \"heroes\" if they look inside themselves and see their own inner strength; in time, it will help them \"find the way.\"", "The song received mixed reviews from contemporary music critics for its lyrical content, while Carey's vocal performance was praised.", "Aside from its lyrics, \"Hero\" derived its hook and sound from several musical instruments such as the guitar, piano, and organ.", "The song experienced strong success in several international markets, and also became Carey's eighth chart topper on the \"Billboard\" Hot 100." ], [ "Number 1's (Mariah Carey album)", "Carey co-wrote and co-produced the song \"Whenever You Call\" with longtime collaborator Walter Afanasieff for her album, \"Butterfly\".", "However, in order to change the song's tempo and format, Carey decided to re-do the song as a duet with Brian McKnight, because she felt it was one of the best songs on \"Butterfly\".", "Carey had also expressed how McKnight's vocals added a great deal to the song, describing the project as \"perfecting the song\".", "McKnight shared similar sentiments, saying, \"It was amazing to go into the studio with someone who's so successful, and has that kind of track record.", "Mariah is someone who could ask anyone in the world to sing with her, and they called me.", "The album contains a duet with Whitney Houston ...", "it's just been great company to be in.\"", "One of the songs Carey recorded specifically for \"#1's\" was a cover of Brenda K. Starr's \"I Still Believe\" (1988) co-produced by Stevie J and Mike Mason.", "During the late 1980s Starr helped Carey secure a record contract while she worked as Starr's backup singer.", "In the album's liner notes, Carey wrote that the purpose of the song was solely paying tribute to her." ] ], "gold": "Mariah Carey's 1993 song Hero was written and produced by Carey and longtime collaborator Walter Afanasieff. Carey changed some of the lyrics to more precisely fit her personality, and the song is regarded as one of her most inspirational and personal ballads.", "prediction 1": "\"Hero\" is a song by American singer and songwriter Mariah Carey. Originally intended for Gloria Estefan, the song was written and produced by Mariah and Walter Afanasieff. While writing the song, Carey did not connect to its style or sound, therefore forfeiting it over to the soundtrack of the movie of the same name. However, after being convinced to keep it, she changed some of the lyrics to more precisely fit her personality. In 1991, following the September 11 attacks, Carey re-re-recorded the song as a medley with \"Never Too Far\". The song was released as a charity single throughout October of that year. In 2001, following the September 11 attacks, Carey re-re-re-re-recorded the song as a medley.", "prediction 2": "\"Hero\" is a song by American singer and songwriter Mariah Carey. Originally intended for Gloria Estefan, the song was written and produced by Mariah and Walter Afanasieff. While writing the song, Carey did not connect to its style or sound, therefore forfeiting it over to the soundtrack of the film of the same name. Following the September 11 attacks, Carey re-recorded the song as a medley with \"Never Too Far\", her single at the time. Titled \"Never Too Far/Hero Medley\", it was released as a charity single throughout October of that year. In 2001, following the September 11 attacks, Carey re-re-re-re-re-re-re-recorded the song as a medley.", "prediction 3": "\"Hero\" is a song by American singer and songwriter Mariah Carey. Originally intended for Gloria Estefan, the song was written and produced by Mariah and Walter Afanasieff. While writing the song, Carey did not connect to its style or sound, therefore forfeiting it over to the soundtrack of the film of the same name. However, after being convinced to keep it, she changed some of the lyrics to more precisely fit her personality. In 2001, following the September 11 attacks, Carey re-re-recorded the song as a medley with \"Never Too Far,\" her single at the time. Titled \"Never Too Far/Hero Medley\", it was released as a charity single throughout October of that year.", "prediction 4": "Hero is a song by American singer and songwriter Mariah Carey. Originally intended for Gloria Estefan, the song was written and produced by Mariah and Walter Afanasieff. While writing the song, Carey did not connect to its style or sound, therefore forfeiting it over to the soundtrack of the film of the same name. However, after being convinced to keep it, she changed some of the lyrics to more precisely fit her personality. In 2001, following the September 11 attacks, Carey re-recorded the song as a medley with \"Never Too Far\". Titled \"Never Too Far/Hero Medley\", it was released as a charity single throughout October of that year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 318 }, { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 432, "end": 540 }, { "error type": "Irrelevant", "explanation": "", "start": 541, "end": 615 }, { "error type": "Irrelevant", "explanation": "", "start": 616, "end": 709 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"Hero\" is a song by American singer and songwriter Mariah Carey. The song was written and produced by Mariah and Walter Afanasieff. Carey changed some of the lyrics to more precisely fit her personality and and the song is regarded as one of her most inspirational and personal ballads." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the last burning at the stake in england?", "passages": [ [ "Death by burning", "The jurist William Blackstone argued as follows for the differential punishment of females vs. males:\nHowever, as described in Camille Naish's \"Death Comes to the Maiden\", in practice, the woman's shift would burn away at the beginning, and she would be left naked anyway.", "There were two types of treason, high treason for crimes against the sovereign, and petty treason for the murder of one's lawful superior, including that of a husband by his wife.", "Commenting on the 18th century execution practice, Frank McLynn says that most convicts condemned to burning were not burnt alive, and that the executioners made sure the women were dead before consigning them to the flames.", "The last to have been condemned to death for \"petty treason\" was Mary Bailey, whose body was burned in 1784.", "The last woman to be convicted for \"high treason\", and have her body burnt, in this case for the crime of coin forgery, was Catherine Murphy in 1789.", "The last case where a woman was actually burnt alive in England is that of Catherine Hayes in 1726, for the murder of her husband.", "In this case, one account says this happened because the executioner accidentally set fire to the pyre before he had hanged Hayes properly.", "The historian Rictor Norton has assembled a number of contemporary newspaper reports on the actual death of Mrs. Hayes, internally somewhat divergent." ] ], "gold": "The last case of a woman being burnt alive in England is Catherine Hayes in 1726, for the murder of her husband. The last person to have her body burnt after an execution was Catherine Murphy in 1789, who was convicted of high treason.", "prediction 1": "The last woman to have been burned alive in england was Catherine Hayes in 1726, for the murder of her husband. The last woman to have been condemned to death for treason was Mary Bailey, whose body was burned in 1784.", "prediction 2": "The last burning at the stake in England was in 1726, and the last time a woman was actually burned alive was in 1726, for the murder of her husband.", "prediction 3": "There were two types of treason, high treason for crimes against the sovereign, and petty treason for the murder of one's lawful superior, including that of a husband by his wife. The last woman to be condemned to death for \"petty treason\" was Mary Bailey, whose body was burned in 1784. The last woman to have been convicted for \"high treason\", and have her body burnt, in this case for the crime of coin forgery, was Catherine Murphy in 1789. The last woman to have her body burned, in this case was Catherine Murphy in 1789.", "prediction 4": "The last woman to be burnt alive in England was Catherine Hayes in 1726, for the murder of her husband.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 159, "end": 170 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The last woman to have been burned alive in England was Catherine Hayes in 1726, for the murder of her husband. The last woman to be convicted for \"high treason\", and have her body burnt, was Catherine Murphy in 1789. The last woman to have been condemned to death for \"petty treason\" was Mary Bailey, whose body was burned in 1784." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How long is the movie alice in wonderland?", "passages": [ [ "Alice in Wonderland (1933 film)", "However, by the time it was shown to the press, the running time was cut to 77 minutes (many reviews, including the savage one it received in Variety, made a point of how long it seemed at an hour-and-a-quarter).", "Although it is often reported that Universal Studios cut it to 77 minutes when they bought the television rights in the late 1950s, the film went on general release in 1933 at the shorter length.", "Universal Studios released the film to DVD on March 2, 2010, marking the film's first home video release.", "Left alone with a governess one snowy afternoon (Alice's sister does not appear in this version), Alice is supremely bored.", "She idly starts to wonder what life is like on the other side of the drawing room mirror, when she suddenly feels a surge of confidence and climbs upon the mantelpiece to look.", "She discovers that she \"can\" pass through the looking glass and finds herself in a strange room where many things seem to be the exact reverse of what is in the drawing room.", "Strangely, through all of this, the governess does not seem to notice what has happened.", "Alice looks out the window and suddenly sees a White Rabbit.", "She follows it to a rabbit hole and falls in." ], [ "Alice in Wonderland (1933 film)", "Alice in Wonderland (1933 film)\n\nAlice in Wonderland is a 1933 American Pre-Code film version of the famous Alice novels by Lewis Carroll.", "The film was produced by Paramount Pictures, featuring an all-star cast.", "It is all live-action, except for the Walrus and The Carpenter sequence, which was animated by the Harman-Ising Studio.", "Stars featured in the film included W. C. Fields as Humpty Dumpty, Edna May Oliver as the Red Queen, Cary Grant as the Mock Turtle (Grant's star was still on the ascent at the time), Gary Cooper as the White Knight, Edward Everett Horton as The Hatter, Charles Ruggles as The March Hare, and Baby LeRoy as The Joker.", "Charlotte Henry played her first leading role as Alice.", "This version was directed by Norman Z. McLeod from a screenplay by Joseph L. Mankiewicz and William Cameron Menzies, based on Lewis Carroll's books \"Alice's Adventures in Wonderland\" (1865) and \"Through the Looking-Glass\" (1871).", "It also drew heavily from Eva Le Gallienne and Florida Friebus's then-recent stage adaptation.", "The film is occasionally broadcast on cable television channels such as Turner Classic Movies.", "When Paramount previewed the film in 1933, the original running time was 90 min." ], [ "Alice in Wonderland (1951 film)", "Alice in Wonderland (1951 film)\n\nAlice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll.", "the 13th release of Disney's animated features, the film premiered in London on July 26, 1951 and in New York City on July 28, 1951.", "The film features the voices of Kathryn Beaumont as Alice, Sterling Holloway as the Cheshire Cat, Verna Felton as the Queen of Hearts, and Ed Wynn as the Mad Hatter.", "Walt Disney first attempted unsuccessfully to adapt \"Alice\" into an animated feature film during the 1930s.", "However, he finally revived the idea in the 1940s.", "The film was originally intended to be a live-action/animated film; however, Disney decided to make it an all-animated feature in 1946.", "The film was considered a flop on its initial release, leading to Walt Disney showing it on television as one of the first episodes of his TV series Disneyland.", "It proved to be very successful on Television, especially during the psychedelic era.", "It was eventually re-released in theaters which proved to be massively successful.", "The film became even more successful though merchandising and subsequent home video releases.", "The theme song of the same name has since become a jazz standard." ] ], "gold": "Various movies adapted from Lewis Carroll's books share the name \"Alice in Wonderland,\" each lasting a different amount of time. The 1903 silent film has a total length of 8:19 minutes, a really short running time when compared against the 1933 film produced by Paramount Pictures, which sits at 77 minutes, and Disney's 1951 animated version of 1 hr and 15 minutes. The 1985 and 1999 adaptations are 187 minutes and 129 minutes long, respectively. A live-action adaptation of Carroll's works and a live-action sequel of the animated film, Alice in Wonderland, directed by Tim Burton, was released in 2010, sitting at a running time of 108 minutes.", "prediction 1": "Alice in Wonderland is a 1933 American Pre-Code film version of the famous Alice novels by Lewis Carroll. The film was produced by Paramount Pictures and featured an all-star cast. It is all live-action, except for the Walrus and The Carpenter sequence, which was animated by the Harman-Ising Studio. Alice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll. The running time was 90 minutes at the time at the time.", "prediction 2": "Alice in Wonderland is a movie that was released from 1933 to 1951. The original running time was 90 minutes. During the 1950s, Universal Studios cut the running time to 77 minutes when they bought the television rights.", "prediction 3": "Alice in Wonderland is a movie that is often reported to have run for 77 minutes when Universal Studios bought the television rights in the late 1950s. The 1933 American Pre-Code film version of the famous Alice novels by Lewis Carroll is 78 minutes long. The 1951 American animated musical fantasy-adventure film that has a running time of 105 minutes is 88 minutes long.", "prediction 4": "Alice in Wonderland is a 1933 American Pre-Code film version of the famous Alice novels by Lewis Carroll. The film was produced by Paramount Pictures, featuring an all-star cast. The running time was 90 minutes when Paramount previewed the film in 1933. The 1951 American animated musical fantasy-adventure film Alice in Wonderland was produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 300 }, { "error type": "Unverifiable", "explanation": "", "start": 465, "end": 521 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Alice in Wonderland is a 1933 American Pre-Code film version of the famous Alice novels by Lewis Carroll. The film was produced by Paramount Pictures with a running time that was cut to 77 minutes. Alice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What's the longest win streak in mlb?", "passages": [ [ "2017 Cleveland Indians season", "2017 Cleveland Indians season\n\nThe 2017 Cleveland Indians season was the 117th season for the franchise.", "It was the fifth season under the leadership of manager Terry Francona and second under general manager Mike Chernoff.", "The team entered as the defending American League champion and World Series runner-up.", "The Indians played all of their home games at Progressive Field in Cleveland, Ohio.", "On September 13, the Cleveland Indians won their 21st game in a row, surpassing the 2002 Oakland Athletics for the longest winning streak in American League history and tying the 1880 Chicago White Stockings and the 1935 Chicago Cubs for the second longest winning streak in Major League Baseball history.", "Their win streak reached 22 games on September 14, giving the Indians the longest winning streak in Major League Baseball since the 1916 New York Giants who own the all-time record with 26 straight without a loss.", "On September 15, the 22-game win streak ended in a 4\u20133 loss to the Kansas City Royals.", "The Indians finished the season with a record of 102\u201360, the best record in the American League.", "They won their second straight American League Central title but were upset by the New York Yankees in five games in the American League Division Series.", "The Indians opened the season by sweeping the Texas Rangers in Arlington." ], [ "History of the New York Yankees", "After the 1998 season, Wells was traded to the Toronto Blue Jays for Roger Clemens, who had just completed two consecutive Cy Young Award-winning seasons.", "In a regular season that included another perfect game by a Yankees pitcher, this one by David Cone, New York led the AL East with 98 wins and beat the Rangers in the ALDS.", "This led to an ALCS against the rival Red Sox.", "New York won the first two games en route to a 4\u20131 series win, and went on to sweep the Braves in the 1999 World Series.", "The postseason results gave the 1998\u201399 Yankees a 22\u20133 playoff record, and the team held a 12-game winning streak in World Series competition dating back to 1996.", "Although the 2000 Yankees had an 87\u201374 regular season record that was the worst among playoff qualifiers, the team won consecutive playoff series to claim the AL championship.", "New York's pennant placed them in the 2000 World Series against the cross-town Mets, the first Subway Series in 44 years.", "With a four games to one victory, the Yankees gained their third successive title.", "As of 2017, the 2000 Yankees are the most recent MLB team to repeat as World Series champions and the Yankees of 1998\u20132000 are the last team to win three consecutive World Series." ], [ "Winning streak (sports)", "74 games \u2014 UCLA\n\n129 games \u2014 Kentucky\n\n57 games \u2014 Winona State University\n\n60 games \u2014 SUNY Potsdam\n\n105 games \u2014 Athinaikos\n\n80 games \u2014 Aris Thessaloniki\n\n2 consecutive titles \u2014 Japan\n\n9 consecutive titles \u2014 Cuba\n\n26 games \u2014 New York Giants\n\nNote: The Giants tied the Pirates in the second game of a doubleheader 1\u20131 on September 18, 1916.", "Major League Baseball excludes all games which end in ties from their official statistics.", "The longest winning streak in Major League Baseball that does not include a tie is 22 games, achieved by the Cleveland Indians in 2017, which is also the longest winning streak in the American League.", "The National League record for consecutive wins without a tie is 21 games, by the 1935 Chicago Cubs.", "24 consecutive winning decisions \u2014 Carl Hubbell, New York Giants\n\nNote:", "Hubbell's streak was achieved in 27 games as he also pitched three no-decisions.", "In baseball, only losing decisions can end winning streaks by pitchers." ] ], "gold": "Winning streaks or unbeaten streaks in Major League Baseball history start at the end of one season and are carried over into the following season. The 1916 New York Giants have the longest winning streak at 26 games. The longest winning streak consisting only of playoff games stands at 12 consecutive wins, by the 1927, 1928 and 1932 New York Yankees, who swept the World Series all three seasons, and tied by the 1998\u201399 Yankees. For streaks that have included both regular and postseason games, the 1970 and 1971 Baltimore Orioles hold the top two positions with 17 and 16 consecutive victories, respectively. ", "prediction 1": "The longest winning streak in Major League Baseball that does not include a tie is 22 games, achieved by the Cleveland Indians in 2017. The 1916 New York Giants have the longest winning streak in MLB history, with a total of 74 games. The 1880 Chicago White Stockings and the 1935 Chicago Cubs each have the longest winning streaks in MLB history.", "prediction 2": "The longest winning streak in Major League Baseball history that does not include a tie is 22 games, achieved by the Cleveland Indians in 2017. The American League record for consecutive wins without a tie is 21 games, set by the 1935 Chicago Cubs.", "prediction 3": "The longest winning streak in MLB that does not include a tie is 21 games, achieved by the Cleveland Indians in 2017. The longest winning streak in MLB that does not include a tie is 22 games, achieved by the Cleveland Indians in 2017.", "prediction 4": "The longest winning streak in Major League Baseball that does not include a tie is 22 games, achieved by the Cleveland Indians in 2017. The longest winning streak in MLB without a tie is 21 games, achieved by the Philadelphia Phillies in 1916. The 1880 Chicago White Stockings and the 1935 Chicago Cubs are the teams with the longest winning streak in Major League Baseball history.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 135 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 225, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 347 } ], "missing-info": [], "corrected-prediction": "The longest winning streak in Major League Baseball was achieved by the 1916 New York Giants have the longest winning streak in MLB history, with a total of 26 straight without a loss. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who is the publisher for the new york times?", "passages": [ [ "The New York Times Company", "Slim's investments in the company included large purchases of Class A shares in 2011, when he increased his stake in the company to 8.1% of Class A shares, and again in 2015, when he exercised stock options\u2014acquired as part of a repayment plan on the 2009 loan\u2014to purchase 15.9million Class A shares, making him the largest shareholder.", "As of March 7, 2016, Slim owned 17.4% of the company's Class A shares, according to annual filings submitted by the company.", "While Slim is the largest shareholder in the company, his investment only allows him to vote only for Class A directors, a third of the company's board.", "The company sponsors a series of national and local awards designed to highlight the achievements of individuals and organizations in different realms.", "In 2007, it inaugurated its first Nonprofit Excellence Award, awarded to four organizations \"for the excellence of their management practices\".", "Only nonprofits in New York City, Long Island, or Westchester were eligible.", "Jointly with the Carnegie Corporation of New York and the American Library Association, The New York Times Company sponsors an award to honor librarians \"for service to their communities.\"", "The \"I Love My Librarian!\"" ], [ "The New York Times", "The New York Times\n\nThe New York Times (shortened as the \"Times and abbreviated as the \"NYT) is an American newspaper based in New York City with worldwide influence and readership.", "Founded in 1851, the paper has won 125 Pulitzer Prizes, more than any other newspaper.", "The \"Times\" is ranked 17th in the world by circulation and 2nd in the U.S.", "The paper is owned by The New York Times Company, which is publicly traded and is controlled by the Sulzberger family through a dual-class share structure.", "It has been owned by the family since 1896; A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation of the family to helm the paper.", "Nicknamed \"The Gray Lady\", the \"Times\" has long been regarded within the industry as a national \"newspaper of record\".", "The paper's motto, \"All the News That's Fit to Print\", appears in the upper left-hand corner of the front page.", "Since the mid-1970s, \"The New York Times\" has greatly expanded its layout and organization, adding special weekly sections on various topics supplementing the regular news, editorials, sports, and features." ] ], "gold": "The New York Times is an American daily newspaper that was founded in 1851 and is based in New York City with a worldwide readership. The Times has since won 132 Pulitzer Prizes, the most of any newspaper, and it is ranked 18th in the world by circulation and 3rd in the US. The paper is owned by The New York Times Company and it has been governed by the Sulzberger family since 1896, through a dual-class share structure after its shares became publicly traded. A. G. Sulzberger is the paper's publisher and his father, Arthur Ochs Sulzberger Jr., is the company's chairman, and they are the fifth and fourth generation of the family to head the paper.", "prediction 1": "The New York Times is an American newspaper based in New York City with worldwide influence and readership. It is owned by The New York Times Company, which is publicly traded and is controlled by the Sulzberger family through a dual-class share structure. While Slim is the largest shareholder in the company, his investment only allows him to vote only for Class A directors, a third of the company's board. The paper has been owned by the family since 1896; A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation to helm the paper.", "prediction 2": "The New York Times is an American newspaper based in New York City with worldwide influence and readership. Founded in 1851, the paper has won 125 Pulitzer Prizes, more than any other newspaper. A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation of the family to helm the paper.", "prediction 3": "The New York Times is an American newspaper based in New York City with worldwide influence and readership. It has been owned by the Sulzberger family since 1896; A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation of the family to helm the paper.", "prediction 4": "The New York Times is an American newspaper based in New York City with worldwide influence and readership. It was founded in 1851 and has won 125 Pulitzer Prizes, more than any other newspaper. The paper is owned by The New York Times Company, which is publicly traded and is controlled by the Sulzberger family through a dual-class share structure. In 2007, it inaugurated its first Nonprofit Excellence Award, awarded to four organizations \"for the excellence of their management practices\". A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation of the company to helm the paper.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 409 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The New York Times is an American newspaper based in New York City with worldwide influence and readership. Founded in 1851, the paper has won 125 Pulitzer Prizes, more than any other newspaper. The \"Times\" is ranked 17th in the world by circulation and 2nd in the U.S. It is owned by The New York Times Company, which is publicly traded and is controlled by the Sulzberger family through a dual-class share structure. The paper has been owned by the family since 1896; A.G. Sulzberger, the paper's publisher, and his father, Arthur Ochs Sulzberger Jr., the company's chairman, are the fourth and fifth generation to helm the paper." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who introduced the technique of sign drawing of a man as a measure of intelligence?", "passages": [ [ "Draw-a-Person test", "Draw-a-Person test\n\nThe Draw-a-Person test (DAP, DAP test, or Goodenough\u2013Harris Draw-a-Person test) is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes.", "Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test.", "It is detailed in her book titled \"Measurement of Intelligence by Drawings\".", "Dr. Dale B. Harris later revised and extended the test and it is now known as the \"Goodenough\u2013Harris Drawing Test\".", "The revision and extension is detailed in his book \"Children's Drawings as Measures of Intellectual Maturity\" (1963).", "Psychologist Julian Jaynes, in his 1976 book \"The Origin of Consciousness in the Breakdown of the Bicameral Mind\", wrote that the test is \"routinely administered as an indicator of schizophrenia,\" and that while not all schizophrenic patients have trouble drawing a person, when they do, it is very clear evidence of a disorder.", "Specific signs could include a patient's neglect to include \"obvious anatomical parts like hands and eyes,\" with \"blurred and unconnected lines,\" ambiguous sex and general distortion.", "There has been no validation of this test as indicative of schizophrenia." ] ], "gold": "The Draw-a-Person test is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes. It was developed by Florence Goodenough in her book titled \"Measurement of Intelligence by Drawings\", but was later revised and extended by Dr. Dale B. Harris in his book \"Children's Drawings as Measures of Intellectual Maturity\".", "prediction 1": "The technique of sign drawing of a man as a measure of intelligence was introduced by Dr. Dale B. Harris in 1963. Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test. The method was further developed by Dr. Dale B. Harris in 1965. Psychologist Julian Jaynes wrote that the test is \"routinely administered as an indicator of schizophrenia.\"", "prediction 2": "The Draw-a-Person test is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes. Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test. It is detailed in her book titled \"Measurement of Intelligence by Drawings\". Dr. Dale B. Harris later revised and extended the test and it is now known as the Goodenough\u2013Harris Drawing Test. The revision and extension is detailed in his book \"Children's Drawings as Measures of Intellectual Maturity\" (1963). The revision and extension is detailed in his book \"Children's Drawings as Measures of Intellectual Maturity\".", "prediction 3": "The Draw-a-Person test is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes. Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test. It is detailed in her book titled \"Measurement of Intelligence by Drawings\". Dr. Dale B. Harris later revised and extended the test and it is now known as the Goodenough\u2013Harris Drawing Test. The revision and extension is detailed in his book \"Children's Drawings as Measures of Intellectual Maturity\" (1963).", "prediction 4": "The Draw-a-Person test is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes. Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test. It is detailed in her book titled Measurement of Intelligence by Drawings. Dr. Dale B. Harris later revised and extended the test and it is now known as the Goodenough\u2013Harris Drawing Test. The revision and extension is detailed in his book Children's Drawings as Measures of Intellectual Maturity.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 0, "end": 113 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Draw-a-Person test is a psychological projective personality or cognitive test used to evaluate children and adolescents for a variety of purposes. Developed originally by Florence Goodenough in 1926, this test was first known as the Goodenough Draw-a-Man test. The method was further developed by Dr. Dale B. Harris in 1965. Psychologist Julian Jaynes wrote that the test is \"routinely administered as an indicator of schizophrenia.\"" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the football coach at georgia southern?", "passages": [ [ "Georgia Southern Eagles football", "In addition to serving as safeties coach for Georgia Southern during the 2006 season under Brian VanGorder, Summers had previously served as defensive coordinator and safeties coach at Colorado State in 2015.", "During Summers' first season in 2016, Georgia Southern suffered its first losing season in the FBS era, and fourth overall in the modern era.", "Summers was fired on October 22, 2017 after starting the 2017 season with a six-game losing streak.", "Assistant head coach Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017.", "Lunsford finished out the 2017 season at 2\u20134, giving the Eagles an overall record of 2\u201310, the worst record in the program's overall history, and the first time in the modern era that the Eagles posted back-to-back losing seasons.", "In Lunsford's first official season as head coach, he led the Eagles back to a winning record and bowl eligibility, finishing the regular season with a 9\u20133 record, with a 6\u20132 record in conference play.", "Georgia Southern defeated Eastern Michigan 23\u201321 in the Camellia Bowl on December 15, 2018, giving the Eagles their first 10-win season since the FCS-to-FBS transition.", "\u2020 Co-championship\n\nThe Eagles have participated in two bowl games with a record of 2\u20130." ], [ "Georgia Southern Eagles football", "In the Eagles' first FBS season, the team finished the season 9\u20133 overall and was undefeated in Sun Belt Conference play at 8\u20130, winning the outright conference championship.", "The Eagles became only the third team ever to win a conference title in its first FBS season, after Nevada in 1992 (Big West Conference) and Marshall in 1997 (Mid-American Conference).", "They were also the first team ever to go unbeaten in conference play in their first FBS season.", "Since the Eagles were under transitional status, the university filed for a postseason waiver to allow the Eagles to play in a bowl game; however, the NCAA denied Georgia Southern's waiver request and a subsequent appeal since enough full member FBS teams became bowl-eligible during the season.", "In the 2015 season, Fritz led the Eagles to an 8-4 record, receiving their first bowl bid to the GoDaddy Bowl on December 23, 2015 against Bowling Green.", "On December 11, 2015, Fritz resigned as the Eagles head coach to accept the head coaching position at Tulane University.", "Assistant head coach and running backs coach Dell McGee was appointed as interim head coach for the GoDaddy Bowl game, where Georgia Southern defeated Bowling Green 58\u201327.", "Tyson Summers was hired on December 21, 2015 to succeed Fritz." ], [ "Chad Lunsford", "Chad Lunsford\n\nChad Lunsford (born February 24, 1977) is the current head coach of the Georgia Southern Eagles football team.", "He was awarded the job on November 27th, 2017 after serving as interim for the second half of the season following the firing of Tyson Summers." ], [ "Tyson Summers", "Tyson Summers\n\nTyson Summers (born April 11, 1980) is a former American college football coach, most recently serving as the head coach of the Georgia Southern Eagles football team.", "He was named to the position at the end of the 2015 season.", "Summers was fired by Georgia Southern mid-way through the 2017 season, after posting an 0\u20136 start.", "He is currently the quality control coordinator at the University of Georgia.", "A four-year letterwinner at Presbyterian Blue Hose, Summers earned All-South Atlantic Conference honors as a linebacker in 1999 and was selected as team captain as a senior.", "He received his bachelor's degree in political science from Presbyterian in 2002.", "2016\nHead Coach for Georgia Southern; finished the season 5-7 after beginning the season 3-0. 2017\nLoses to FCS - New Hampshire University.", "First time since 1994 that Georgia Southern lost to an opponent in a lower division.", "In 2015, The Georgia Southern Eagles led the nation in Rushing.", "As for 2017, they opened up the season being last (#130) for yards-per-play.", "On October 22, midway through the 2017 season, he was fired from his position as Head Coach after an 0-6 start to the season, with the college stating \"the results on the field weren't where we needed them to be as we continue our growth as an FBS program.\"" ] ], "gold": "Chad Lunsford is the current head coach of the Georgia Southern Eagles football team. He was awarded the job on November 27, 2017 after serving as interim for the second half of the season following the firing and departure of Tyson Summers, who was coach from 2016-2017. Willie Fritz was named Georgia Southern's ninth modern era head coach on January 10, 2014 and he led the team to win the outright conference championship that year. On December 11, 2015, Fritz resigned as the Eagles head coach and assistant head coach and running backs coach Dell McGee was briefly appointed as interim head coach until Tyson Summer became the new coach on the 21st of that month.", "prediction 1": "Tyson Summers, a former American college football coach, has been the head coach of the Georgia Southern Eagles football team since December 21, 2015. Summers was fired on October 22, 2017 after starting the 2017 season with a six-game losing streak. Assistant head coach Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017. Lunsford finished out the 2017 season at 2\u20134, giving the Eagles an overall record of 2\u201310, the worst record in the program's overall history.", "prediction 2": "Tyson Summers was hired on December 21, 2015, as the head coach of the Georgia Southern Eagles football team. Summers was fired on October 22, 2017 after starting the 2017 season with a six-game losing streak. Assistant head coach Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017. Lunsford finished out the 2017 season at 2\u20134, giving the Eagles an overall record of 2\u201310, the worst record in the program's overall history.", "prediction 3": "Tyson Summers was the head coach of the Georgia Southern Eagles football team during the 2015-2017 season. He was fired on October 22, 2017 after starting the 2017 season with a six-game losing streak. Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017. In his first official season as head coach, Lunsford led the Eagles back to a winning record and bowl eligibility, finishing the regular season with a 9-3 record, with a 6\u20132 record in conference play. Lunsford was hired as interim head coach on November 27, 2017 after serving as interim head coach for the second half of the season following the firing of Tyson Summers.", "prediction 4": "Tyson Summers was hired as the head coach of the Georgia Southern Eagles football team in December 2015 after serving as the safeties coach for the team during the 2006 season under Brian VanGorder. Summers was fired on October 22, 2017 after starting the 2017 season with a six-game losing streak. Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 563 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Tyson Summers has been the head coach of the Georgia Southern Eagles football team since December 21, 2015. Summers was fired on October 22, 2017. Assistant head coach Chad Lunsford was initially appointed as interim head coach for the remainder of the season and was officially named head coach on November 27, 2017. Fritz was the head coach in the 2015 season; on December 11, 2015, Fritz resigned as the Eagles head coach. Assistant head coach and running backs coach Dell McGee was appointed as interim head coach." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the original story of beauty and the beast written?", "passages": [ [ "Beauty and the Beast", "Beauty and the Beast\n\nBeauty and the Beast () is a fairy tale written by French novelist Gabrielle-Suzanne Barbot de Villeneuve and published in 1740 in \"La Jeune Am\u00e9ricaine et les contes marins\" (\"The Young American and Marine Tales\").", "Her lengthy version was abridged, rewritten, and published first by Jeanne-Marie Leprince de Beaumont in 1756 in \"Magasin des enfants\" (\"Children's Collection\") and by Andrew Lang in the \"Blue Fairy Book\" of his \"Fairy Book\" series in 1889, to produce the version(s) most commonly retold.", "It was influenced by some earlier stories, such as \"Cupid and Psyche\", \"The Golden Ass\" written by Lucius Apuleius Madaurensis in the 2nd century AD, and \"The Pig King\", an Italian fairytale published by Giovanni Francesco Straparola in \"The Facetious Nights of Straparola\".", "Variants of the tale are known across Europe.", "In France, for example, \"Z\u00e9mire and Azor\" is an operatic version of the story, written by Marmontel and composed by Gr\u00e9try in 1771, which had enormous success well into the 19th century; it is based on the second version of the tale." ] ], "gold": "Beauty and the Beast is a fairy tale written by French novelist Gabrielle-Suzanne Barbot de Villeneuve and published in 1740. Her lengthy version was later abridged, rewritten, and published by Jeanne-Marie Leprince de Beaumont in 1756 in Magasin des enfants to produce the version most commonly retold.", "prediction 1": "The original story of Beauty and the Beast was written by Gabrielle-Suzanne Barbot de Villeneuve in 1740 and published in 1740 in La Jeune Am\u00e9ricaine et les contes marins. It was abridged, rewritten, and published first by Jeanne-Marie Leprin de Beaumont in 1756 in Magasin des enfants (\"Children's Collection\") and by Andrew Lang in the Blue Fairy Book of his Fairy Book series in 1889, to produce the version(s) most commonly retold. Variants of the story are known across Europe.", "prediction 2": "Beauty and the Beast is a fairy tale written by Gabrielle-Suzanne Barbot de Villeneuve and published in 1740 in La Jeune Am\u00e9ricaine et les contes marins. Her lengthy version was abridged, rewritten, and published first by Jeanne-Marie Leprin de Beaumont in 1756 in Magasin des enfants (\"Children's Collection\") and by Andrew Lang in the Blue Fairy Book of his Fairy Book series in 1889, to produce the version(s) most commonly retold. Variants of the story are known across Europe.", "prediction 3": "Beauty and the Beast is a fairy tale written by French novelist Gabrielle-Suzanne Barbot de Villeneuve and published in 1740 in La Jeune Am\u00e9ricaine et les contes marins. Her lengthy version was abridged, rewritten, and published first by Jeanne-Marie Leprin de Beaumont in 1756 in Magasin des enfants (\"Children's Collection\") and by Andrew Lang in the Blue Fairy Book of his Fairy Book series in 1889, to produce the version(s) most commonly retold. Variants of the tale are known across Europe.", "prediction 4": "The original story of Beauty and the Beast was written by Gabrielle-Suzanne Barbot de Villeneuve and published in 1740. It was abridged, rewritten, and published by Jeanne-Marie Leprin de Beaumont in 1756 in Magasin des enfants and by Andrew Lang in the Blue Fairy Book of his Fairy Book series in 1889, to produce the version(s) most commonly retold.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 171 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 387 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 482 } ], "missing-info": [], "corrected-prediction": "The original story of Beauty and the Beast was written by Gabrielle-Suzanne Barbot de Villeneuve in 1740 and published in 1740. It was abridged, rewritten, and published first by Jeanne-Marie Leprin de Beaumont in 1756 in Magasin des enfants to produce the version(s) most commonly retold. Variants of the story are known across Europe." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What are the odds of winning a game of solitaire?", "passages": [ [ "Canfield (solitaire)", "But as Canfield knew very well, winning this game is unlikely, as one can manage to place an average of five to six cards.", "\"See also solitaire terminology.\"", "Below are some variations to the game:\n\nRunning a computer solver on 50,000 random Canfield deals has shown that between 71% and 72% of all games are possible to win.", "In the average game, 40 cards were moved to the foundation.", "Because the reserve cards are hidden, and because the three-at-a-time dealing of cards from the stock means that cards played early in the game can impact which stock cards are available much later, it is very difficult by normal playing standards to come anywhere near theoretically possible win rates.", "The highest potential win rates for strategic expert-level players averages at about 35%.", "In the Storehouse variant, a greater potential to win increases rates to about 44% proportional to games played.", "In practice, however, Storehouse is a much easier game.", "Most players will easily be able to win close to 44% of games, a much higher win rate than is ever achieved by casual players of Canfield." ], [ "One-Handed Solitaire", "Repeat the above process of discarding until the first and fourth card are neither the same suit nor number, upon which you draw one card from the back of the deck and place it after the fourth card, rearranging the drawn cards so that only four are visible.", "Continue in this fashion until the end of the deck is reached.", "If all cards are discarded, you win the game.", "The odds of winning are very low, approximately one in 140.", "An optional rule to increase the odds slightly allows cards that have previously been drawn to be redrawn after the deck has already been cycled through, but preserving their original sequence.", "Decade (solitaire) and Accordion (solitaire) are a variation of One-Handed Solitaire using different criteria for discarding." ], [ "FreeCell", "FreeCell\n\nFreeCell is a solitaire card game played using the standard 52-card deck.", "It is fundamentally different from most solitaire games in that very few deals are unsolvable, and all cards are dealt face-up from the very beginning of the game.", "Although software implementations vary, most versions label the hands with a number (derived from the seed value used by the random number generator to shuffle the cards).", "Microsoft has included a FreeCell computer game with every release of the Windows operating system since 1995, greatly contributing to the game's popularity.", "It is so definitive for many FreeCell players that many other software implementations strive for compatibility with its random number generator in order to replicate its numbered hands.", "Not all deals are solvable, but the probability of an unsolvable deal is very low.", "It is estimated that 99.999% of possible deals are solvable.", "Deal number 11982 from the Windows version of FreeCell is a widely known example of an unsolvable FreeCell deal, and the only deal among the original \"Microsoft 32,000\" which is unsolvable.", "One of the oldest ancestors of FreeCell is Eight Off." ], [ "Klondike (solitaire)", "At this point, winning is impossible.", "For a standard game of Klondike, drawing three cards at a time and placing no limit on the number of re-deals, the number of possible hands is over , or an 8 followed by 67 zeros.", "About 79% of the games are theoretically winnable, but in practice, human players do not win 79% of games played, due to wrong moves that cause the game to become unwinnable.", "If one allows cards from the foundation to be moved back to the tableau, then between 82% and 91.5% are theoretically winnable.", "Note that these results depend on complete knowledge of the positions of all 52 cards, which a player does not possess.", "Another recent study has found the Draw 3, Re-Deal Infinite to have a 83.6% win rate after 1000 random games were solved by a computer solver.", "The issue is that a wrong move cannot be known in advance whenever more than one move is possible.", "The number of games a skilled player can probabilistically expect to win is at least 43%.", "In addition, some games are \"unplayable\" in which no cards can be moved to the foundations even at the start of the game; these occur in only 0.25% (1 in 400) of hands dealt." ] ], "gold": "The odds of winning a game of solitaire vary greatly by the variety of the game and the skill of the player. While the odds of winning a game of Canfield solitaire are 35% for strategic expert-level players, they rise to 71% and 72% for computer solvers. The odds of winning are 82% in Thoughtful Klondike solitaire, one in 140 in one-handed solitaire, one in ten in King Albert solitaire, and 99.999% in FreeCell solitaire.", "prediction 1": "The odds of winning a game of solitaire are very low, approximately one in 140. In the classic version of solitaire, the odds of winning the game are between 73 percent and 74 percent. In the card game FreeCell, the odds of winning are between 99.999% and 99.9%.", "prediction 2": "There are several solitaire games. Canfield is a game played using the standard 52-card deck. In FreeCell, where very few deals are unsolvable, the odds of winning are very low, approximately one in 140. In One-Handed Solitaire, where the odds of winning are very low, approximately one in 140. In FreeCell, however, the odds of winning are very low, approximately one in 140. In Accordion Solitaire, the odds of winning are very low, approximately one in 140. The odds of winning an online game are very low, approximately one in a game of solitaire.", "prediction 3": "There are many variations of the card game solitaire. In the classic variant, Canfield, the odds of winning are 71% to 72%. In the one-handed variant, Solitaire, the odds of winning are 1 in 140. In FreeCell, the odds of winning are 82% to 91%.", "prediction 4": "Solitaire has very low odds of winning. The odds of winning a game of solitaire are approximately one in 140. However, there are some variations to the game. One-Handed Solitaire has lower odds of winning. In the Storehouse variant, the odds of winning are approximately one in 140.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 80, "end": 184 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The odds of winning a game of solitaire are very low, approximately one in 140. In the card game FreeCell, the odds of winning are between 99.999% and 99.9%. The number of Klondike (solitaire) games a skilled player can probabilistically expect to win is at least 43%. The highest potential win rates for strategic expert-level players averages at about 35%, while a computer solver has shown that between 71% and 72% of all games are possible to win. In the Storehouse variant, a greater potential to win increases rates to about 44% proportional to games played." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What are the different cardiac biomarkers in heart disease?", "passages": [], "gold": "There are various biomarkers used to detect different conditions that may afflict the heart. Troponin, Creatine Kinase (CK-MB), Lactate dehydrogenase (LDH), Ischemia-modified albumin (IMA), and Glycogen phosphorylase isoenzyme BB are taken into consideration when detecting a Myocardial Infarction, while Aspartate transaminase (AST) signals to whether or not there was heart damage. In the case of CHF, Pro-brain natriuretic peptide is needed to detect it, and Myoglobin (Mb) is studied when the effects of a reperfusion after a thrombolysis are assessed.", "prediction 1": "What are the different cardiac biomarkers in heart disease?", "prediction 2": "Different cardiac biomarkers in heart disease.", "prediction 3": "There are several cardiac biomarkers in heart disease.", "prediction 4": "There are different cardiac biomarkers in heart disease.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 59 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "The first law of thermodynamics was developed by?", "passages": [ [ "First law of thermodynamics", "A main aspect of the struggle was to deal with the previously proposed caloric theory of heat.", "In 1840, Germain Hess stated a conservation law for the so-called 'heat of reaction' for chemical reactions.", "His law was later recognized as a consequence of the first law of thermodynamics, but Hess's statement was not explicitly concerned with the relation between energy exchanges by heat and work.", "According to Truesdell (1980), Julius Robert von Mayer in 1841 made a statement that meant that \"in a process at constant pressure, the heat used to produce expansion is universally interconvertible with work\", but this is not a general statement of the first law.", "The original nineteenth century statements of the first law of thermodynamics appeared in a conceptual framework in which transfer of energy as heat was taken as a primitive notion, not defined or constructed by the theoretical development of the framework, but rather presupposed as prior to it and already accepted.", "The primitive notion of heat was taken as empirically established, especially through calorimetry regarded as a subject in its own right, prior to thermodynamics.", "Jointly primitive with this notion of heat were the notions of empirical temperature and thermal equilibrium.", "This framework also took as primitive the notion of transfer of energy as work." ], [ "First law of thermodynamics", "First law of thermodynamics\n\nThe first law of thermodynamics is a version of the law of conservation of energy, adapted for thermodynamic systems.", "The law of conservation of energy states that the total energy of an isolated system is constant; energy can be transformed from one form to another, but can be neither created nor destroyed.", "The first law is often formulated\n\nIt states that the change in the internal energy of a closed system is equal to the amount of heat supplied \"to\" the system, minus the amount of work done \"by\" the system on its surroundings.", "An equivalent statement is that perpetual motion machines of the first kind are impossible.", "Investigations into the nature of heat and work and their relationship began with the invention of the first engines used to extract water from mines.", "Improvements to such engines so as to increase their efficiency and power output came first from mechanics that worked with such machines but only slowly advanced the art.", "Deeper investigations that placed those on a mathematical and physics basis came later.", "The first law of thermodynamics was developed empirically over about half a century.", "The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine; Rankine's statement is considered less distinct relative to Clausius'." ] ], "gold": "In 1840, Germain Hess stated a conservation law for the so-called 'heat of reaction' for chemical reactions. His law was later recognized as a consequence of the first law of thermodynamics, but Hess's statement was not explicitly concerned with the relation between energy exchanges by heat and work. In 1842, Julius Robert von Mayer made a statement rendered by Truesdell (1980) in the words \"in a process at constant pressure, the heat used to produce expansion is universally interconvertible with work,\" but this is not a general statement of the first law. The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine; Rankine's statement is considered less distinct relative to Clausius'.", "prediction 1": "The first law of thermodynamics is a version of the law of conservation of energy, adapted for thermodynamic systems. The first law is often formulated It states that the change in the internal energy of a closed system is equal to the amount of heat supplied \"to\" the system, minus the amount of work done \"by\" the system on its surroundings. The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine.\n", "prediction 2": "The first law of thermodynamics is a version of the law of conservation of energy, adapted for thermodynamic systems. It states that the change in the internal energy of a closed system is equal to the amount of heat supplied \"to\" the system, minus the amount of work done \"by\" the system on its surroundings. The law of thermodynamics was developed empirically over about half a century. The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine; Rankine's statement is considered less distinct relative to Clausius'.", "prediction 3": "The first law of thermodynamics is a version of the law of conservation of energy, adapted for thermodynamic systems. The law of conservation of energy states that the total energy of an isolated system is constant; energy can be transformed from one form into another, but can neither be created nor destroyed. In this sense, the first law of thermodynamics is similar to the inverse law of conservation of energy, which states that the change in the internal energy of a closed system is equal to the amount of heat supplied \"to\" the system, minus the amount of work done \"by\" the system on its surroundings. In 1850, the first full statements of the law came in Rudolf Clausius and from William Rankine; Rankine's statement is considered less distinct relative to Clausius'.", "prediction 4": "The first law of thermodynamics is a version of the law of conservation of energy, adapted for thermodynamic systems. The first law of thermodynamics was developed empirically over about half a century. The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 343 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 3, 4 ] } ], "corrected-prediction": "In 1840, Germain Hess stated a conservation law for the so-called 'heat of reaction' for chemical reactions. His law was later recognized as a consequence of the first law of thermodynamics, but Hess's statement was not explicitly concerned with the relation between energy exchanges by heat and work. According to Truesdell (1980), Julius Robert von Mayer in 1841 made a statement that meant that \"in a process at constant pressure, the heat used to produce expansion is universally interconvertible with work\", but this is not a general statement of the first law. The first full statements of the law came in 1850 from Rudolf Clausius and from William Rankine; Rankine's statement is considered less distinct relative to Clausius'.\n" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "What is the age of concent in florida?", "passages": [ [ "Ages of consent in the United States", "Ages of consent in the United States\n\nIn the United States, age of consent laws regarding sexual activity are made at the state level.", "There are several federal statutes related to protecting minors from sexual predators, but laws regarding specific age requirements for sexual consent are left to individual states, District of Columbia, and territories.", "Depending on the jurisdiction, the legal age of consent ranges from age 16 to age 18.", "In some places, civil and criminal laws within the same state conflict with each other.", "While the general age of consent is now set between 16 and 18 in all U.S. states, the age of consent has widely varied across the country in the past.", "In 1880, the age of consent was set at 10 or 12 in most states, with the exception of Delaware where it was 7.", "The ages of consent were raised across the U.S. during the late 19th century and the early 20th century.", "By 1920 ages of consent generally rose to 16\u201318 and small adjustments to these laws occurred after 1920.", "The final state to raise its age of general consent was Hawaii, which changed it from 14 to 16 in 2001.", "Age-of-consent laws were historically only applied when a female was younger than her male partner.", "By 2015 ages of consent were made gender-symmetric." ], [ "Ages of consent in the United States", "Definitions generally applicable to sexual offences.", "(j) A child who has not yet reached his or her sixteenth birthday is deemed unable to consent to a sexual act with a person more than 4 years older than said child.", "Children who have not yet reached their twelfth birthday are deemed unable to consent to a sexual act under any circumstances.\"", "Crimes and Criminal Procedure, Delaware Criminal Code\n\n\u00a7\u00a0770.", "Rape in the fourth degree; class C felony.", "(a) A person is guilty of rape in the fourth degree when the person: ... 2) Intentionally engages in sexual intercourse with another person, and the victim has not yet reached that victim's eighteenth birthday, and the person is 30 years of age or older, except that such intercourse shall not be unlawful if the victim and person are married at the time of such intercourse.", "The age of consent in Florida is 18, but close-in-age exemptions exist.", "By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17." ], [ "Ages of consent in the United States", "794.05 Unlawful sexual activity with certain minors.--\n(1) A person 24 years of age or older who engages in sexual activity with a person 16 or 17 years of age commits a felony of the second degree, punishable as provided in s. 775.082, s. 775.083, or s. 775.084.", "As used in this section, \"sexual activity\" means oral, anal, or vaginal penetration by, or union with, the sexual organ of another; however, sexual activity does not include an act done for a bona fide medical purpose\nFlorida code, Title XLVI,", "Chapter 794\n\nA new law passed in 2007 stated that people convicted of statutory rape may be removed from the sex offender list if they were no more than four years older than their victims, had only the statutory rape offense on their records, and had victims aged 14\u201317.", "The age of consent in Georgia is 16 and there is no close-in-age exception, though the offenses are a misdemeanor rather than a felony in cases where the perpetrator is less than 19 years of age \"and\" is no more than 4 years older than the victim." ] ], "gold": "The unlimited age of consent in Florida is 18. There is a close-in-age exemption that permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17, but a person 24 years old or older who engages in sexual activity with a person 16 or 17 years old commits a felony of the second degree. The legal age for non-penetrative sexual contact is 16, and there are no close in age exceptions. If the offender is 18+ it is a 2nd degree felony, and if the offender is under 18 it is a 3rd degree felony.", "prediction 1": "In the United States, age of consent laws regarding sexual activity are made at the state level. There are several federal statutes related to protecting minors from sexual predators, but laws regarding specific age requirements for sexual consent are left to individual states, District of Columbia, and territories. In 1880, the age of consent was set at 10 or 12 in most states, with the exception of Delaware where it was 7. The ages of consent were raised across the U.S. during the late 19th century and the early 20th century. The age of consent in Florida is 18, but close-in-age exemptions exist. By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17 years of age.", "prediction 2": "In the United States, age of consent laws regarding sexual activity are made at the state level. There are several federal statutes related to protecting minors from sexual predators, but laws regarding specific age requirements for sexual consent are left to individual states, District of Columbia, and territories. In Florida, the age of consent is 18, but close-in-age exemptions exist. By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17.", "prediction 3": "The age of consent in Florida is 18, but close-in-age exemptions exist. By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17. In Georgia, the age of consent is 16, and there is no close-in-age exception, though the offenses are a misdemeanor rather than a felony in cases where the perpetrator is less than 19 years of age and is no more than 4 years older than the victim.", "prediction 4": "The age of consent in Florida is 18, but close-in-age exceptions exist. By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17. In addition, in the State of Georgia, the age of consent is 16 and there is no close-in-age exception.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Redundant", "explanation": "In the United States, age of consent laws regarding sexual activity are made at the state level. ", "start": 97, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 428 }, { "error type": "Irrelevant", "explanation": "", "start": 429, "end": 533 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": " The age of consent in Florida is 18, but close-in-age exemptions exist. By law, the exception permits a person 23 years of age or younger to engage in legal sexual activity with a minor aged 16 or 17 years of age. A person 24 years of age or older who engages in sexual activity with a person 16 or 17 years of age commits a felony of the second degree." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Last 10 football clubs to win the fa cup?", "passages": [ [ "Leicester City F.C.", "Throughout Leicester's history, they have spent all but one season in the top two leagues of English football.", "They hold a joint-highest seven second-tier titles (six Second Division and one Championship).", "The club have been FA Cup finalists four times, in 1948\u201349, 1960\u201361, 1962\u201363 and 1968\u201369.", "This is a tournament record for the most defeats in the final without having won the competition.", "Leicester have several promotions to their name, two play-off final wins, and one League One title.", "In 1971, they won the FA Community Shield, and in 2016, they were runners-up.", "The club have won the League Cup three times in 1964, 1997 and 2000, as well as being runners-up in 1965 and 1999.", "Leicester City have also competed in European football, featuring in the 1961\u201362 European Cup Winners' Cup, 1997\u201398 UEFA Cup, 2000\u201301 UEFA Cup, and most recently the 2016\u201317 UEFA Champions League, reaching the quarter-finals of the competition in that year.", "Formed in 1884 by a group of old boys of Wyggeston School as \"Leicester Fosse\", the club joined The Football Association (FA) in 1890." ], [ "Arsenal F.C.", "The club had never progressed beyond the quarter-finals of the Champions League until 2005\u201306; in that season they became the first club from London in the competition's fifty-year history to reach the final, in which they were beaten 2\u20131 by Barcelona.", "In July 2006, they moved into the Emirates Stadium, after 93 years at Highbury.", "Arsenal reached the final of the 2007 and 2011 League Cups, losing 2\u20131 to Chelsea and Birmingham City respectively.", "The club had not gained a major trophy since the 2005 FA Cup until 17 May 2014 when, spearheaded by then club-record acquisition Mesut \u00d6zil, Arsenal beat Hull City in the 2014 FA Cup Final, coming back from a 2\u20130 deficit to win the match 3\u20132.", "A year later, Arsenal appeared in the FA Cup final for the second time in a row, defeating Aston Villa 4\u20130 in the final and becoming the most successful club in the tournament's history with 12 titles, a record which Manchester United would tie the following season.", "Arsenal later won the FA Cup for a record 13th time, defeating Chelsea 2\u20131 in the 2017 final and once more becoming the outright leader in terms of FA Cups won.", "The victory also saw Wenger become the first manager in English football history to win seven FA Cups." ], [ "Mikel Arteta", "Arteta captained the side for the final at Wembley, leading them to a 3-2 win against Hull City and receiving his first major honour in English football.", "Arteta became Arsenal's new club captain ahead of the 2014-15 season.", "He won his first trophy as full-time captain, playing the full 90 minutes as Arsenal beat Manchester City 3\u20130 in the 2014 FA Community Shield.", "Despite his new appointment, he would only make 11 appearances for the whole season, scoring once.", "Arteta signed a one-year extension with Arsenal for 2015-16 and came on as a substitute as Arsenal beat Chelsea 1\u20130 to win the 2015 FA Community Shield, his first competitive appearance for the club since November 2014.", "His final game for Arsenal came on the last day of the season.", "Arteta came on as a substitute and forced Aston Villa goalkeeper Mark Bunn into scoring an own goal after his shot went off the crossbar.", "He received a standing ovation from the crowd at full time.", "Arteta was eligible for the Spanish national team.", "He went on to play for his country at youth level.", "He represented Spain in the victorious 1999 UEFA European Under-16 Championship campaign.", "Also he played at the 1999 UEFA\u2013CAF Meridian Cup, 1999 FIFA U-17 World Championship, and captained the side in the 2004 U21 European Championships qualifying campaign." ] ], "gold": "Football clubs that recently won the FA Cup include Leister City in 2020-21, Arsenal in 2019-20, 2016-17, 2014-15, and 2013-14, Manchester City in 2018-19, Chelsea in 2017-18, and Manchester United in 2015-16.", "prediction 1": "Manchester United reached the quarter-finals of the UEFA Champions League in 2017. Manchester City reached the final of the 2007 and 2011 League Cups, losing 2\u20131 to Chelsea. Arsenal later won the FA Cup for a record 13th time, defeating Chelsea 2\u20131 in the 2017 final and once more becoming the outright leader in terms of FA Cups won.", "prediction 2": "Leicester City have been FA Cup finalists four times, in 1948\u201349, 1960\u201361, 1962\u201363 and 1968\u201369. Leicester City have also won the League Cup three times in 1964, 1997 and 2000 as well as being runners-up in 1965 and 1999. In 2017, Arsenal defeated Chelsea 2\u20131 in the final to become the most successful club in the competition's history.", "prediction 3": "The football teams that have won the FA Cup most often are Leicester City, Arsenal, Liverpool and Leicester City. Leicester City are the last team to win the FA Cup in consecutive years, while Arsenal have won the FA Cup a record 13 times, defeating Chelsea 2\u20131 in the 2017 final.", "prediction 4": "The last 10 clubs to win the FA Cup were Leicester City, Arsenal, Chelsea, Manchester United, and Liverpool. The last four clubs to win the FA Cup were Leicester, Leicester City, and Liverpool. The last four clubs to win the FA Cup were Manchester United in 1991, and Leicester City in 1966.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 82 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 83, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 248 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 334 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Arsenal won the FA Cup in 2017 and in 2015. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the number 1 sexually transmitted disease?", "passages": [ [ "Sexually transmitted infection", "Over 400,000 sexually transmitted infections were reported in England in 2017, about the same as in 2016, but there were more than 20% increases in confirmed cases of gonorrhoea and syphilis.", "Since 2008 syphilis cases have risen by 148%, from 2,874 to 7,137, mostly among men who have sex with men.", "The number of first cases of genital warts in 2017 among girls aged 15\u201317 years was just 441, 90% less than in 2009 - attributed to the national human papilloma virus immunisation programme.", "AIDS is among the leading causes of death in present-day Sub-Saharan Africa.", "HIV/AIDS is transmitted primarily via unprotected sexual intercourse.", "More than 1.1 million persons are living with HIV/AIDS in the United States, and it disproportionately impacts African Americans.", "Hepatitis B is also considered a sexually transmitted disease because it can be spread through sexual contact.", "The highest rates are found in Asia and Africa and lower rates are in the Americas and Europe.", "Approximately two billion people worldwide have been infected with the hepatitis B virus.", "The first well-recorded European outbreak of what is now known as syphilis occurred in 1494 when it broke out among French troops besieging Naples in the Italian War of 1494\u201398.", "The disease may have originated from the Columbian Exchange." ], [ "Human papillomavirus infection", "The virus is resistant to drying and heat, but is killed at and by ultraviolet radiation.", "There is currently no specific treatment for HPV infection.", "However, the viral infection, more often than not, clears to undetectable levels by itself.", "According to the Centers for Disease Control and Prevention, the body's immune system clears HPV naturally within two years for 90% of cases (see Clearance subsection in Virology for more detail).", "However, experts do not agree on whether the virus is completely eliminated or reduced to undetectable levels, and it is difficult to know when it is contagious.", "Follow up care is usually recommended and practiced by many health clinics.", "Follow-up is sometimes not successful because a portion of those treated do not return to be evaluated.", "In addition to the normal methods of phone calls and mail, text messaging and email can improve the number of people who return for care.", "Worldwide, HPV is estimated to infect about 12% of women at any given time.", "HPV infection is the most frequently sexually transmitted disease in the world.", "HPV is estimated to be the most common sexually transmitted infection in the United States.", "Most sexually active men and women will probably acquire genital HPV infection at some point in their lives." ], [ "Human papillomavirus infection", "Human papillomavirus infection\n\nHuman papillomavirus infection is an infection by \"human papillomavirus\" (HPV).", "Most HPV infections cause no symptoms and resolve spontaneously.", "In some people, an HPV infection persists and results in warts or precancerous lesions.", "The precancerous lesions increase the risk of cancer of the cervix, vulva, vagina, penis, anus, mouth, or throat.", "Nearly all cervical cancer is due to HPV with two types, HPV16 and HPV18, accounting for 70% of cases.", "Between 60% and 90% of the other cancers mentioned above are also linked to HPV.", "HPV6 and HPV11 are common causes of genital warts and laryngeal papillomatosis.", "An HPV infection is caused by \"human papillomavirus\", a DNA virus from the papillomavirus family, of which over 170 types are known.", "More than 40 types are transmitted through sexual contact and infect the anus and genitals.", "Risk factors for persistent HPV infections include early age of first sexual intercourse, multiple partners, smoking, and poor immune function.", "HPV is typically spread by sustained direct skin-to-skin contact with vaginal and anal sex being the most common methods." ] ], "gold": "The most common sexually transmitted infection globally is HPV, or human papillomavirus. It is so common that nearly every individual is infected by HPV at some point in their lives, although many strands of the virus do not cause any health problems. The number 1 sexually transmitted infection in Sub-Saharan Africa is HIV/AIDS. Many HIV-positive people are unaware that they are infected, especially in Africa, where, in 2001, less than 1% of the sexually active urban population had been tested.", "prediction 1": "The number 1 sexually transmitted disease worldwide is HIV, the number 1 sexually transmitted disease in men, and the number 1 sexually transmitted disease in women. The most common sexually transmitted disease worldwide is Human Papillomavirus infection. The virus is caused by the human papillomavirus (HPV). Most HPV infections cause no symptoms and resolve spontaneously. However, in some people, an HPV infection persists and results in warts or precancerous lesions. The precancerous lesions increase the risk of cervical cancer.", "prediction 2": "Human papillomavirus infection is an infection by \"human papillomavirus\" (HPV). Most HPV infections cause no symptoms and resolve spontaneously. In some people, an HPV infection persists and results in warts or precancerous lesions. These lesions increase the risk of cancer of the cervix, vulva, vagina, penis, anus, mouth, or throat.", "prediction 3": "Human papillomavirus infection is an infection by the virus Human papillomavirus, also known as HPV, which causes genital warts and precancerous lesions. Most HPV infections cause no symptoms and resolve spontaneously. In some people, an HPV infection persists and results in warts or precancerous lesions. Precancerous lesions increase the risk of cancer of the cervix, vulva, vagina, penis, anus, mouth, or throat.", "prediction 4": "Human papillomavirus infection is an infection by \"human papillomavirus,\" a DNA virus from the papillomavirus family, of which over 170 types are known. Most HPV infections cause no symptoms and resolve spontaneously. However, in some people, an HPV infection persists and results in warts or precancerous lesions. Precancerous lesions increase the risk of cancer of the cervix, vulva, vagina, penis, mouth, or throat.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 472 }, { "error type": "Irrelevant", "explanation": "", "start": 473, "end": 535 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[12]}", "start": 0, "end": 165 } ], "missing-info": [], "corrected-prediction": " The most common sexually transmitted disease worldwide is Human Papillomavirus infection. Most sexually active men and women will probably acquire genital HPV infection at some point in their lives. The virus is caused by the human papillomavirus (HPV). Most HPV infections cause no symptoms and resolve spontaneously. " }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Which is the shortest day in the southern hemisphere?", "passages": [ [ "Winter solstice", "Winter solstice\n\nThe winter solstice (or hibernal solstice), also known as midwinter, is an astronomical phenomenon marking the day with the shortest period of daylight and the longest night of the year.", "It occurs when one of the Earth's poles has its maximum tilt away from the Sun.", "It happens twice yearly, once in each hemisphere.", "In the Northern Hemisphere this is the December solstice and in the Southern Hemisphere this is the June solstice.", "The axial tilt of Earth and gyroscopic effects of its daily rotation mean that the two opposite points in the sky to which the Earth's axis of rotation points (axial precession) change very slowly (at the current rate it would take just under 26,000 years to make a complete circle).", "As the Earth follows its orbit around the Sun, the polar hemisphere that faced away from the Sun, experiencing winter, will, in half a year, face towards the Sun and experience summer.", "This is because the two hemispheres face opposite directions along Earth's axis, and so as one polar hemisphere experiences winter, the other experiences summer.", "More evident from high latitudes, a hemisphere's winter solstice occurs on the day with the shortest period of daylight and longest night of the year, when the sun's daily maximum elevation in the sky is at its lowest." ], [ "Winter solstice", "Although the winter solstice itself lasts only a moment in time, the term sometimes refers to the day on which it occurs.", "Other names are \"midwinter\", the \"extreme of winter\" (Dongzhi), or the \"shortest day\".", "In some cultures it is seen as the middle of winter, while in others it is seen as the beginning of winter.", "In meteorology, winter in the Northern Hemisphere spans the entire period of December through February.", "The seasonal significance of the winter solstice is in the reversal of the gradual lengthening of nights and shortening hours of daylight during the day.", "The earliest sunset and latest sunrise dates differ from winter solstice, however, and these depend on latitude, due to the variation in the solar day throughout the year caused by the Earth's elliptical orbit (see earliest and latest sunrise and sunset).", "Worldwide, interpretation of the event has varied across cultures, but many have held a recognition of rebirth, involving holidays, festivals, gatherings, rituals or other celebrations around that time.", "The solstice may have been a special moment of the annual cycle for some cultures even during neolithic times.", "Astronomical events were often used to guide activities such as the mating of animals, the sowing of crops and the monitoring of winter reserves of food.", "Many cultural mythologies and traditions are derived from this." ] ], "gold": "The shortest day of the year has many names. It is referred to as the winter solstice, hiemal solstice, or hibernal solstice, and is also know as midwinter. It occurs when one of the Earth's poles has its maximum tilt away from the sun. In the southern hemisphere, it is also called the June Solstice and usually occurs on June 20 or 21. The opposite event is called the summer solstice.", "prediction 1": "The southern hemisphere's winter solstice occurs on the day with the shortest period of daylight and the longest night of the year, when the sun's daily maximum elevation in the sky is at its lowest. The Southern Hemisphere has two shortest days. The longest day is the 26th of June, while the shortest day in the Northern Hemisphere is the 30th of July.", "prediction 2": "The southern hemisphere has a number of astronomical events on the shortest day of the year. In the northern hemisphere it is the June solstice, and in the southern hemisphere it is the December solstice.", "prediction 3": "The shortest day in the southern hemisphere is the June solstice. In the Northern Hemisphere this is the December solstice, while in the Southern Hemisphere this is the June solstice.", "prediction 4": "The shortest day in the southern hemisphere is the June solstice, which occurs twice yearly. In the Northern Hemisphere, it is the December solstice, and in the Southern Hemisphere, it is the June solstice.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 4, "end": 12 }, { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 199 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 228, "end": 246 }, { "error type": "Unverifiable", "explanation": "", "start": 270, "end": 274 }, { "error type": "Unverifiable", "explanation": "", "start": 341, "end": 354 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The shortest day has a number of names, the winter solstice (or hibernal solstice), \"midwinter\", the \"extreme of winter\" (Dongzhi), or the \"shortest day\". It occurs when one of the Earth's poles has its maximum tilt away from the Sun. In the Northern Hemisphere this is the December solstice and in the Southern Hemisphere this is the June solstice." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When was the first altar built in the bible?", "passages": [ [ "Beersheba", "According to the Hebrew Bible, Beersheba was founded when Abraham and Abimelech settled their differences over a well of water and made a covenant (see ).", "Abimelech's men had taken the well from Abraham after he had previously dug it so Abraham brought sheep and cattle to Abimelech to get the well back.", "He set aside seven lambs to swear that it was he that had dug the well and no one else.", "Abimelech conceded that the well belonged to Abraham and, in the Bible, Beersheba means \"Well of Seven\" or \"Well of the Oath\".", "Beersheba is further mentioned in following Bible passages: Isaac built an altar in Beersheba (Genesis 26:23\u201333).", "Jacob had his dream about a stairway to heaven after leaving Beersheba.", "(Genesis 28:10\u201315 and 46:1\u20137).", "Beersheba was the territory of the tribe of Simeon and Judah (Joshua 15:28 and 19:2).", "The sons of the prophet Samuel were judges in Beersheba (I Samuel 8:2).", "Saul, Israel's first king, built a fort there for his campaign against the Amalekites (I Samuel 14:48 and 15:2\u20139)." ], [ "Internal consistency of the Bible", "with a group of scribes who were concerned about the preservation of the liturgical traditions of the Jews (thus the concern for the seven-day schema of creation and the notion of the sabbath).", "Genesis 2, on the other hand, originates from an earlier, more primitive tradition dated to around the tenth century B.C.\" Fundamentalists argue that this is simply the same story told twice, the first time (Gen 1:1-2:4) being poetic and the second one (Gen 2:4-25) being more anthropomorphic.", "There are further examples of other types of inconsistency in the Old Testament.", "In the account of the slaughtering of an animal before the Temple, it states that the animal: \"was killed at the entrance to the tabernacle, north of the altar, and cut up.\"", "The most natural interpretation of the Hebrew wording is that the slaughtering was done by the one making the offering rather than by the priest.", "If so, it contradicts Ezek 44:11, where it is done by the Levites, and 2 Chr 29:22, 24 where done by the priests.", "There are several places in the Old Testament where numerical figures can be directly compared." ] ], "gold": "In the Bible, the first altar was built in the Old Testament, in section Genesis 8:20. It was erected by Noah. Other altars recorded in the Bible were erected by Abraham, Isaac, Jacob, and Moses.", "prediction 1": "The first altar in the bible is mentioned in Genesis 1:1-2:4. This is in contrast to the first time that the first altar is mentioned in the Bible, when it was built in Genesis 26:23\u201333, which is in contrast to the first time that the first altar is mentioned in Genesis 2:1-7:22.", "prediction 2": "In the Old Testament, the first altar is mentioned in Genesis 1:1-2:4 as being poetic while the first one is mentioned in Genesis 26:22-33 as being primitive. However, the first altar in the Bible was constructed by Isaac in Genesis 26:23-33.", "prediction 3": "The first altar in the Bible is described in Genesis 1:26-26:2. The first altar in the Bible is mentioned in Genesis 26:23\u201333. The first altar in the Bible is mentioned in Genesis 28:10\u201315.", "prediction 4": "The first altar built in the bible is in Genesis 1:1\u20132:4. Genesis 2:4-25 is the first time the first altar is mentioned in the Bible.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 41 }, { "error type": "Unverifiable", "explanation": "", "start": 263, "end": 280 }, { "error type": "Redundant", "explanation": "This is in contrast to the first time that the first altar is mentioned in the Bible, when it was built in Genesis 26:23\u201333, ", "start": 187, "end": 259 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 73, "end": 133 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who scored the most hat tricks in football?", "passages": [ [ "Lionel Messi", "On 19 August, Messi scored twice in helping Barcelona defeat Alav\u00e9s 3\u20130 in their first La Liga match of the season, with his first goal, a free kick that he rolled under the jumping Alav\u00e9s wall, making history in being Barcelona's 6000th goal in La Liga.", "On 18 September, Messi scored a hat-trick in a 4\u20130 home win over PSV Eindhoven in Barcelona's opening Champions League group stage match of the season, setting a new record for most hat-tricks in the competition, with eight.", "On 20 October, Messi scored and assisted in a 4\u20132 home win over Sevilla, but was later forced off in the 26th minute after falling awkwardly and injuring his right arm; tests later confirmed that he had fractured his radial bone, ruling him out for approximately three weeks.", "On 16 December, Messi scored his 43rd career hat-trick, as well as creating two assists, in a 5\u20130 away win against Levante, securing his 50th goal in 2018 for club and country in the process.", "As a dual Argentine-Spanish national, Messi was eligible to play for the national team of both countries.", "Selectors for Spain's Under-17 squad began pursuing him in 2003 after Barcelona's director of football, Carles Rexach, alerted the Royal Spanish Football Federation to their young player." ], [ "1994\u201395 in English football", "Tranmere Rovers, Bolton Wanderers and Luton Town complete the top five, while Swindon Town's drastic loss of form over the last month has seen them slump from the playoff zone into 19th place and manager John Gorman sacked to be replaced by 33-year-old Manchester City midfielder Steve McMahon, who takes over as player-manager.", "Portsmouth, another side who were looking like promotion contenders not so long ago, have slumped even further towards the relegation zone, only ahead of Bristol City on goal difference.", "West Bromwich Albion and Notts County continue to struggle.", "3 December 1994 \u2013 Teddy Sheringham scores a hat-trick as Tottenham Hotspur beat Newcastle United 4\u20132 in the league at White Hart Lane.", "5 December 1994 \u2013 John Lyall resigns after four-and-a-half years in charge of Ipswich Town, who stand bottom of the Premier League.", "While Ipswich's struggle shows no sign of easing, Everton's revival continues as they crush Leeds United 3-0 at Goodison Park.", "9 December 1994 \u2013", "The Football Association quashes Tottenham's FA Cup ban and 6-point deduction.", "10 December 1994 \u2013 Nottingham Forest beat Ipswich Town 4\u20131; all the goals are scored in the first-half.", "11 December 1994 \u2013 Arsenal manager George Graham denies allegations that he received an illegal \u00a3285,000 payment as part of a transfer deal." ], [ "Hat-trick", "Hat-trick\n\nA hat-trick or hat trick is the achievement of a positive feat three times in a game, or another achievement based on the number three.", "The term first appeared in 1858 in cricket, to describe H. H. Stephenson's taking three wickets with three consecutive deliveries.", "Fans held a collection for Stephenson, and presented him with a hat bought with the proceeds.", "The term was used in print for the first time in 1865.", "The term was eventually adopted by many other sports including hockey, association football, water polo, and team handball.", "A hat-trick occurs in association football when a player scores three goals (not necessarily consecutive) in a single game, whereas scoring two goals constitutes a brace.", "In common with other official record-keeping rules, penalty-kick goals are counted but goals in a penalty shootout are excluded from the tally.", "The extra time in a knockout cup match may also be calculated towards a player's potential hat-trick.", "The fastest recorded time to score a hat-trick is 70 seconds, a record set by Alex Torr in a Sunday league game in 2013.", "The previous record of 90 seconds was held by Tommy Ross playing for Ross County against Nairn County on 28 November 1964.", "The first hat-trick in an international game was by Scottish player John McDougall, against England on 2 March 1878." ] ], "gold": "In football, when a player scores three goals in a single game and it is considered an achievement, the feat is called a hat trick, and many players have scored them. Lionel Messi scored the most hat tricks in La Liga football, and also in UEFA Champions League football, along with player Cristiano Ronaldo. Sergio Aguero scored 12 hat tricks in Premier League football, which is more than any other player. In World Cup football, the players who scored the most hat tricks are Sandor Kocsis, Just Fontaine, Gerd Muller, and Gabriel Batistuta.", "prediction 1": "A hat-trick is the achievement of a positive feat three times in a game, or another achievement based on the number three. The record for scoring the most hat-tricks is 8 in the Champions League, with 11 in the Europa League and 1 in the Europa League. Teddy Sheringham scored a hat-trick in the Premier League on 3 December 1994 as Tottenham Hotspur beat Newcastle United 4\u20132 at White Hart Lane. The fastest recorded time to score a hat-trick is 70 seconds, a record set by Alex Torr in a Sunday league game in 2013.", "prediction 2": "A hat-trick or hat trick is the achievement of a positive feat three times in a game, or another achievement based on the number three. In association football, a hat-trick occurs in association football when a player scores three goals (not necessarily consecutively) in a single game, whereas scoring two goals constitutes a brace. The fastest recorded time to score a hat-trick is 70 seconds, a record set by Alex Torr in a Sunday league game in 2013.", "prediction 3": "A hat-trick or hat trick is the achievement of a positive feat three times in a game, or another achievement based on the number three. The most hat-tricks scored in any single season in football history is eight. The player who scored the most hat tricks in an international game was John McDougall on 2 March 1878. In association football, a hat-trick occurs in association football when a player scores three goals (not necessarily consecutively) in a single game.", "prediction 4": "A hat-trick is the achievement of a positive feat three times in a game, or another achievement based on the number three. The most hat-tricks in European football history are by Lionel Messi in 1993, Lionel Messi in 1994 and Teddy Sheringham in 1994. The fastest recorded time to score a hat-trick is 70 seconds, a record set by Alex Torr in a Sunday league game in 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 517 }, { "error type": "Unverifiable", "explanation": "", "start": 196, "end": 224 }, { "error type": "Redundant", "explanation": "The record for scoring the most hat-tricks is 8 in the Champions League, with 11 in the Europa League and ", "start": 229, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 396 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "A hat-trick occurs in association football when a player scores three goals in a single game. The record for scoring the most hat-tricks is by Lionel Messi, with 8 in the Champions League. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What kind of snake has a yellow band around its neck?", "passages": [ [ "Diadophis punctatus edwardsii", "Diadophis punctatus edwardsii\n\nDiadophis punctatus edwardsii, commonly known as the Northern ringneck snake, is a subspecies of \"Diadophis punctatus\".", "It is endemic to North America.", "The subspecific name, \"edwardsii\", is in honor of English ornithologist George Edwards, who described it, without giving it a binomial name, from a specimen he had received from William Bartram.", "The Northern ringneck snake has a body color from bluish grey to black, with a complete narrow yellow or orange ring around its neck and an underside matching the ring and generally lacking any dark spotting or patterning.", "The complete ring and lack of large dark spots on the belly differentiate it from other subspecies of \"D. punctatus\".", "In some regions, there are areas of intergradation with other subspecies.", "Generally from long as an adult, they can reach more than two feet (61\u00a0cm) in length.", "In Canada it is found in the southern parts of Ontario, Quebec, and New Brunswick, and also in Nova Scotia.", "In the United States it is found throughout New England, the Mid-Atlantic states, and the Great Lakes region, and also at higher elevations in the South." ], [ "Ring-necked snake", "Ring-necked snake\n\nDiadophis punctatus, commonly known as the ring-necked snake or ringneck snake, is a harmless species of colubrid snake found throughout much of the United States, central Mexico, and southeastern Canada.", "Ring-necked snakes are secretive, nocturnal snakes, so are rarely seen during the day time.", "They are slightly venomous, but their nonaggressive nature and small, rear-facing fangs pose little threat to humans who wish to handle them.", "They are best known for their unique defense posture of curling up their tails, exposing their bright red-orange posterior, ventral surface when threatened.", "Ring-necked snakes are believed to be fairly abundant throughout most of their range, though no scientific evaluation supports this hypothesis.", "Scientific research is lacking for the ring-necked snake, and more in-depth investigations are greatly needed.", "It is the only species within the genus \"Diadophis\", and currently 14 subspecies are identified, but many herpetologists question the morphologically based classifications.", "Ring-necked snakes are fairly similar in morphology throughout much of their distribution.", "Its dorsal coloration is solid olive, brown, bluish-gray to smoky black, broken only by a distinct yellow, red, or yellow-orange neck band." ] ], "gold": "The Diadophis punctatus, commonly known as the Ring-necked snake, is a snake with a yellow, red, or yellow-orange band around its neck. It is the only species within the genus Diadophis, with 14 subspecies currently identified. The North American subspecies of the Diadophis punctatus is called the Diadophis punctatus edwardsii, which is commonly called the Northern ringneck snake.", "prediction 1": "Diadophis punctatus edwardsii, commonly known as the Northern ringneck snake, is a subspecies of Diadophis punctatus. It is endemic to North America. The Northern ringneck snake has a body color from bluish grey to black, with a complete narrow yellow or orange ring around its neck and an underside matching the ring and generally lacking any dark spotting or patterning.", "prediction 2": "The Yellow-necked snake is a harmless species of colubrid snake found throughout much of the United States, central Mexico, and southeastern Canada. The body color of the Yellow-necked snake is dark brown or olive, broken only by a distinct yellow, red, or yellow-orange neck band. It is a subspecies of the venomous snake Diadophis punctatus. It has a body color from bluish grey to black, with a complete narrow yellow or orange ring around its neck and an underside matching the ring and generally lacking any dark spotting or patterning.", "prediction 3": "The yellow neck band is a characteristic feature of the snake Diadophis punctatus edwardsii, commonly known as the Northern ringneck snake. This snake has a body color from bluish grey to black, with a complete narrow yellow or orange ring around its neck. The ringneck snake has an underside matching the ring and generally lacking any dark spotting or patterning.", "prediction 4": "The yellow band on the neck of a snake is called a banded band. The ring-necked snake is also known as the ringneck, or ringneck snake, and has a body color from bluish grey to black, with a complete yellow or orange ring around its neck and an underside matching the ring and generally lacking any dark spotting or patterning. The ring-necked snake is a harmless species of colubrid snake found throughout much of the United States, central Mexico, and southeastern Canada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 372 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Diadophis punctatus edwardsii, commonly known as the Northern ringneck snake, is a subspecies of Diadophis punctatus with a yellow, red, or yellow-orange band around its neck. It is the only species within the genus \"Diadophis\", and currently 14 subspecies are identified. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What kind of bomb did japan drop on pearl harbor?", "passages": [ [ "National Pearl Harbor Remembrance Day", "National Pearl Harbor Remembrance Day\n\nNational Pearl Harbor Remembrance Day, also referred to as Pearl Harbor Remembrance Day or Pearl Harbor Day, is observed annually in the United States on December 7, to remember and honor the 2,403 citizens of the United States who were killed in the Japanese surprise attack on Pearl Harbor in Hawaii on December 7, 1941.", "On August 23, 1994, the United States Congress, by , designated December 7 of each year as National Pearl Harbor Remembrance Day.", "On November 29, President Bill Clinton issued a proclamation declaring December 7, 1994, the first National Pearl Harbor Remembrance Day.", "It became (Patriotic and National Observances and Ceremonies) of the United States Code.", "On Pearl Harbor Day, the American flag should be flown at half-staff until sunset to honor those who died as a result of the attack on U.S. military forces in Hawaii.", "Pearl Harbor Day is not a federal holiday \u2013 government offices, schools, and businesses do not close.", "Some organizations may hold special events in memory of those killed or injured at Pearl Harbor.", "On Sunday morning, December 7, 1941, the Imperial Japanese Navy Air Service attacked Naval Station Pearl Harbor in Honolulu, Oahu, Hawaii Territory, without warning and without a declaration of war, killing 2,403 Americans, and injuring 1,178 others.", "The attack sank four U.S. Navy battleships and damaged four others." ], [ "Aichi D3A", "Aichi D3A\n\n", "The Aichi D3A Type 99 Carrier Bomber (Allied reporting name \"Val\") is a World War II carrier-borne dive bomber.", "It was the primary dive bomber of the Imperial Japanese Navy (IJN) and was involved in almost all IJN actions, including the attack on Pearl Harbor.", "The Aichi D3A was the first Japanese aircraft to bomb American targets in the war, commencing with Pearl Harbor and U.S. bases in the Philippines, such as Clark Air Force Base.", "\"Vals\" sank more Allied warships than any other Axis aircraft.", "In mid-1936, the Japanese Navy issued the 11-Shi specification for a monoplane carrier-based dive bomber to replace the existing D1A biplane then in service.", "Aichi, Nakajima, and Mitsubishi all submitted designs, with the former two subsequently being asked for two prototypes each.", "The Aichi design started with low-mounted elliptical wings inspired by the Heinkel He 70 \"Blitz\".", "It flew slowly enough that the drag from the landing gear was not a serious issue, so fixed gear was used for simplicity.", "The aircraft was to be powered by the Nakajima Hikari 1 nine-cylinder radial engine.", "The first prototype was completed in December 1937, and flight trials began a month later.", "Initial tests were disappointing." ] ], "gold": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service upon the United States, a neutral country at the time, against the naval base at Pearl Harbor in Honolulu, Territory of Hawaii, just before 08:00, on Sunday morning, December 7, 1941. Japan drop a penetrating Type 99 bomb on Pearl Harbor.", "prediction 1": "The attack on Pearl Harbor was a surprise attack by the Imperial Japanese Navy Air Service. The Japanese dropped the Type 99 Carrier Bomber, or the Aichi D3A, on American targets in Pearl Harbor without warning.", "prediction 2": "The bomb that Japan dropped on Pearl Harbor was a dive bomb, also referred to as a \"Pearl Harbor Remembrance Day or Pearl Harbor Day.\" The Japanese Navy subsequently used the Aichi D3A Type 99 Carrier Bomber as their primary dive bomber.", "prediction 3": "The Japanese dropped a variety of bombs during their surprise attack on Pearl Harbor, including a dive bomb and a bomb with a tail fin. The Japanese dropped a dive bomb with the Aichi D3A which was the primary dive bomber of the Imperial Japanese Navy and was involved in almost all IJN actions, including the attack on Pearl Harbor. The bombs used during the attack were different types of bomb, with the Type 99 being the most commonly used.", "prediction 4": "The bomb dropped on Pearl Harbor was the Type 99 Carrier Bomber of the Aichi D3A, the primary dive bomber of the Imperial Japanese Navy and was involved in almost all IJN actions, including the attack on Pearl Harbor.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The attack on Pearl Harbor was a surprise attack by the Imperial Japanese Navy Air Service. The Japanese dropped the Type 99 Carrier Bomber, or the Aichi D3A, on American targets in Pearl Harbor without warning." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who sings the song and the beat goes on?", "passages": [ [ "And the Beat Goes On (The Whispers song)", "And the Beat Goes On (The Whispers song)\n\n", "\"And the Beat Goes On\" is a 1979 single by the American music group The Whispers.", "The song was their first of two number-one singles on the Soul chart, and their first Top 20 hit on the \"Billboard\" Hot 100, peaking at number 19.", "\"And the Beat Goes On\" was the group's only number-one song on the dance chart.", "It was also their first and biggest hit in the United Kingdom, peaking at number 2 on the UK Singles Chart.", "The song also peaked at number 27 on the Canadian \"RPM\" chart.", "The song is featured in the video game \"\".", "The song was also remixed in house music style and in 2010, DJ OzYBoY released a remix in which \"And the Beat Goes On\" is melted with MARRS's \"Pump Up The Volume\"." ] ], "gold": "There are several versions of the song, \"And the Beat Goes On.\" \"And the Beat Goes On\" is a 1979 single by the American music group the Whispers. On BBC Radio 1 on Christmas Day 1999, Daft Punk sung a version of \"And the Beat Goes On\". Prince Fatty and Hollie Cook sing \"As the Beat Goes On\" as a duet, which was released in 2012. As a solo, Legowelt also sings a version of \"As the Beat Goes On\".", "prediction 1": "The 1979 single And the Beat Goes On is by the American music group The Whispers. The song was their first of two number-one singles on the Soul chart, and their first Top 20 hit on the Billboard Hot 100, peaking at number 19.", "prediction 2": "The 1979 single \"And the Beat Goes On\" by the American music group The Whispers was their first of two number-one singles on the Soul chart, and their first Top 20 hit on the Billboard Hot 100, peaking at number 19. \"And the Beat Goes On\" was the group's only number-one song on the dance chart, and was also their first and biggest hit in the United Kingdom, peaking at number 2 on the UK Singles Chart.", "prediction 3": "\"And the Beat Goes On\" is a 1979 single by the American music group The Whispers. The song was their first of two number-one singles on the Soul chart, and their first Top 20 hit on the Billboard Hot 100, peaking at number 19. The song was also the group's only number-one song on the dance chart. And the Beat Goes On was also their first and biggest hit in the United Kingdom, peaking at number 2 on the UK Singles Chart.", "prediction 4": "\"And the Beat Goes On\" is a 1979 single by the American music group The Whispers. The song was their first of two number-one singles on the Soul chart, and their first Top 20 hit on the Billboard Hot 100, peaking at number 19.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 226 } ], "missing-info": [], "corrected-prediction": "The 1979 single And the Beat Goes On is by the American music group The Whispers. " }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "How many moons does jupiter have in its orbit?", "passages": [ [ "Moons of Jupiter", "These moons were probably captured by Jupiter from solar orbits.", "Twenty-seven of the irregular satellites have not yet been officially named.", "The physical and orbital characteristics of the moons vary widely.", "The four Galileans are all over in diameter; the largest Galilean, Ganymede, is the ninth largest object in the Solar System, after the Sun and seven of the planets, Ganymede being larger than Mercury.", "All other Jovian moons are less than in diameter, with most barely exceeding .", "Their orbital shapes range from nearly perfectly circular to highly eccentric and inclined, and many revolve in the direction opposite to Jupiter's spin (retrograde motion).", "Orbital periods range from seven hours (taking less time than Jupiter does to spin around its axis), to some three thousand times more (almost three Earth years).", "Jupiter's regular satellites are believed to have formed from a circumplanetary disk, a ring of accreting gas and solid debris analogous to a protoplanetary disk.", "They may be the remnants of a score of Galilean-mass satellites that formed early in Jupiter's history.", "Simulations suggest that, while the disk had a relatively high mass at any given moment, over time a substantial fraction (several tenths of a percent) of the mass of Jupiter captured from the solar nebula was passed through it." ], [ "Moons of Jupiter", "They form families with shared similarities in orbit (semi-major axis, inclination, eccentricity) and composition; it is believed that these are at least partially collisional families that were created when larger (but still small) parent bodies were shattered by impacts from asteroids captured by Jupiter's gravitational field.", "These families bear the names of their largest members.", "The identification of satellite families is tentative, but the following are typically listed:\n\n\n", "The moons of Jupiter are listed below by orbital period.", "Moons massive enough for their surfaces to have collapsed into a spheroid are highlighted in bold.", "These are the four Galilean moons, which are comparable in size to the Moon.", "The other moons are much smaller, with the least massive Galilean moon being more than 7000 times more massive than the most massive of the other moons.", "The irregular captured moons are shaded light gray when prograde and dark gray when retrograde.", "All orbits are based on the estimated orbit on the Julian date 2457000, or 3 September 2017.", "As several moons of Jupiter are currently lost, these orbital elements may be only rough approximations.", "As of 2018, seven satellites are considered to be lost.", "These are S/2003 J 2, S/2003 J 4, S/2003 J 9, S/2003 J 10, S/2003 J 12, S/2003 J 16, and S/2003 J 23." ], [ "Galilean moons", "Galilean moons\n\nThe Galilean moons are the four largest moons of Jupiter\u2014Io, Europa, Ganymede, and Callisto.", "They were first seen by Galileo Galilei in January 1610, and recognized by him as satellites of Jupiter in March 1610.", "They were the first objects found to orbit another planet.", "Their names derive from the lovers of Zeus.", "They are among the largest objects in the Solar System with the exception of the Sun and the eight planets, with a radius larger than any of the dwarf planets.", "Ganymede is the largest moon in the Solar System, and is even bigger than the planet Mercury, though only around half as massive.", "The three inner moons\u2014Io, Europa, and Ganymede\u2014are in a 4:2:1 orbital resonance with each other.", "Because of their much smaller size, and therefore weaker self-gravitation, all of Jupiter's remaining moons have irregular forms rather than a spherical shape.", "The Galilean moons were observed in either 1609 or 1610 when Galileo made improvements to his telescope, which enabled him to observe celestial bodies more distinctly than ever.", "Galileo's observations showed the importance of the telescope as a tool for astronomers by proving that there were objects in space that cannot be seen by the naked eye." ] ], "gold": "There are 79 known moons of Jupiter, not counting a number of moonlets likely shed from the inner moons, and S/2003 J 24, whose orbital elements have not yet been published. The most massive of the moons are the four Galilean moons: Io; Europa; Ganymede; and Callisto, which were independently discovered in 1610 by Galileo Galilei and Simon Marius and were the first objects found to orbit a body that was neither Earth nor the Sun.", "prediction 1": "There are three moons orbiting Jupiter. These are the Galilean moons, which are the largest moons of Jupiter. Twenty-seven of the irregular satellites have not yet been officially named.", "prediction 2": "There are 20 moons orbiting Jupiter. The number of moons in our solar system is 27. The number of Galilean moons orbiting Jupiter is 61, and the number of irregular moons is 17.", "prediction 3": "The number of moons orbiting Jupiter is approximately 57, with 24 Galilean moons and 23 irregular moons. The Galilean moons are the four largest moons of Jupiter, and were first seen by Galileo Galilei in January 1610, and recognized by him as satellites of Jupiter in March 1610.", "prediction 4": "The number of moons orbiting Jupiter is 63, based on an estimated number of 63 captured moons. These moons are the four largest moons of Jupiter and were first seen by Galileo Galilei in January 1610, and recognized by him as satellites of Jupiter in March 1610. Galilean moons are the largest moons of Jupiter, and are among the largest objects in the Solar System.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 10, "end": 15 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "There are four moons orbiting Jupiter that were first seen by Galileo Galilei in January 1610, and were the first objects found to orbit another planet. These are the Galilean moons, Io, Europa, Ganymede, and Callisto. which are the largest moons of Jupiter. Twenty-seven of the irregular satellites have not yet been officially named, and seven satellites are considered to be lost." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who does wolverine fight at the end of origins?", "passages": [ [ "Marketing for Deadpool (film)", "Marketing for Deadpool (film)\n\n\"Deadpool\" is a 2016 American superhero film based on the Marvel Comics character of the same name, distributed by 20th Century Fox.", "It is the eighth installment of the \"X-Men\" film series.", "The film was directed by Tim Miller from a screenplay by Rhett Reese and Paul Wernick, and stars Ryan Reynolds in the title role alongside Morena Baccarin, Ed Skrein, T. J. Miller, Gina Carano, Leslie Uggams, Brianna Hildebrand, and Stefan Kapi\u010di\u0107.", "In \"Deadpool\", Wade Wilson hunts the man who gave him mutant abilities, but also a scarred physical appearance, as the wisecracking, fourth wall-breaking antihero Deadpool.", "After spending 10 years in development hell, \"Deadpool\" received a greenlight from Fox with a much smaller budget than is usually given to a big superhero film, $58 million.", "This gave the production team\u2014including Miller in his directorial debut\u2014the leeway they needed to create a comic-accurate film, after Reynolds' less-faithful portrayal of the character in \"\" was not well received.", "Focus was placed on reproducing the tone, humor, and violence of the comics." ], [ "X-Men Origins: Wolverine", "Fred mentions Remy \"Gambit\" LeBeau, the only one who escaped from the island and therefore knows its location.", "John and Logan find LeBeau in New Orleans, then both fight Victor, who kills John and extracts his DNA.", "Agreeing to help release mutants that Stryker has captured, Gambit takes Logan to Stryker's facility on Three Mile Island.", "Logan learns that Kayla is alive, having been forced by Stryker into surveilling him in exchange for her sister's safety.", "However, Stryker refuses to release her sister and denies Victor the adamantium bonding promised for his service, claiming that test results revealed Victor would not survive the operation.", "Stryker activates Wade, now known as Weapon XI, a \"mutant killer\" with the powers of multiple mutants.", "While Logan and Victor join forces to fight off Weapon XI, Kayla is mortally wounded leading the captive mutants to Professor Charles Xavier and safety.", "After Logan kills Weapon XI, Stryker arrives and shoots Logan in the head with adamantium bullets, rendering Logan unconscious.", "Before Stryker can shoot Kayla, she grabs him and uses her mutant power to persuade him to turn around and walk away until his feet bleed.", "Logan regains consciousness but has lost his memory.", "He notices his dog tags read \"Logan\" on one side and \"Wolverine\" on the other." ], [ "Team X (comics)", "Bradley is easily killed by Creed early in the film, Agent Zero was killed by Wolverine, Wraith was killed by Sabretooth after he helped Wolverine find Stryker, and it is implied that Wade/Deadpool (Weapon XI) is killed (although the after-credit scene shows a still living decapitated Deadpool).", "In \"X2\", Stryker is killed.", "By the end of \"\", Wolverine and Victor are confirmed to be alive, while it is implied Deadpool may still be alive as well.", "The fate of Dukes is left unconfirmed, but it is implied that he was killed by Victor.", "In a deleted scene, Victor had subdued him and interrogated him.", "Team X is featured in the \"\" tie in game." ], [ "X-Men Origins: Wolverine", "It is Hugh Jackman's last time portraying the character.", "The 2016 spin-off film \"Deadpool\" and its 2018 sequel \"Deadpool 2\" feature Ryan Reynolds reprising his role as the title character.", "Several jokes are aimed at the expense of the version of Deadpool in \"X-Men Origins: Wolverine\" due to the negative reaction of the character's portrayal.", "A \"Deadpool 2\" mid-credits scene depicts that film's version of Wilson traveling backwards in time to the events of \"X-Men Origins: Wolverine\" to kill the widely criticized Weapon XI interpretation of Deadpool." ] ], "gold": "At the end of the movie X-Men Origins, Wolverine fights Wade Wilson, who is played by Ryan Reynolds. Wade Wilson is also known as Deadpool, a disfigured mercenary with the superhuman ability of regeneration and physical prowess. Additionally, this character is known as the Merc with a Mouth because of his tendency to talk and joke constantly, including breaking the fourth wall for humorous effect and running gags. In the movie X-Men Origins: Wolverine, Wade Wilson is supposedly killed by Victor Creed. However, he is later revealed to have been transformed by Major William Stryker into the mutant killer Weapon XI. Wolverine and Creed fight Weapon XI and manage to defeat and seemingly kill him. However, a post-credits scene appearing in DVD releases and some theatrical presentations of the film implies that Deadpool is still alive. ", "prediction 1": "In the 2016 American superhero film Deadpool, the main character, Wade Wilson, fights Victor Stryker, a mutant killer with the powers of multiple mutants. While Logan and Victor join forces to fight off Weapon XI, Kayla is mortally wounded leading the captive mutants to Professor Charles Xavier and safety. By the end of the film, Wolverine and Victor are confirmed to be alive, while it is implied that Deadpool may still be alive.\n", "prediction 2": "In the 2016 American superhero film Deadpool, the main character, Wolverine, fights Victor Stryker, who has given him the powers of multiple mutants. When Eris is killed by Stryker, Wolverine and Victor are confirmed to be alive, while it is implied Deadpool may still be alive as well. The 2016 spin-off film Deadpool and its 2018 sequel Deadpool 2 feature Ryan Reynolds reprising his role as the title character.", "prediction 3": "In the 2016 American superhero film Deadpool, Wade Wilson plays the role of Deadpool, a wisecracking, fourth wall-breaking antihero. Whilst dealing with Weapon XI, Wolverine battles Aggravate in order to retrieve a human child. At the end of this fight, however, Stryker, herself a mutant, weakens the chair. Stryker then arrives on scene and shoots Logan through the head with adamantium bullets.", "prediction 4": "In X-Men Origins: Wolverine, Wolverine fights both Victor and John, the mutant killer known as Weapon XI! In the film, Victor defeats John, revealing his identity and taking over the agency from Stryker. In the movie X-Men: X2!, reinforcements are sent to save the region, killing Stryker and capturing two mutants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 385 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Wade Wilson, now known as Weapon XI, has mutant abilities, a scarred physical appearance and breaks the fourth wall. In Origins, Logan and Victor join forces to fight off Weapon XI. Logan kills Weapon XI. It is implied that Deadpool may still be alive.\n" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When was wrangell st elias national park established?", "passages": [ [ "Wrangell\u2013St. Elias National Park and Preserve", "The monument designation carried no dedicated funding for park development or operations, but did engender considerable hostility from Alaskans, who regarded the designation under the Antiquities Act as a Federal land grab.", "The few Park Service personnel assigned to the area received threats, and a Park Service airplane was destroyed by fire in August 1979.", "Attitudes were sharply divided between white Alaskans, who were largely opposed to the park and felt that they were being forced out, and native Ahtnas, who were granted subsistence hunting rights and who expected to profit from tourism.", "In January 1979, Udall introduced a modified version of H.R. 39.", "Following markup and negotiations between the House and Senate versions, the bill as modified by the Senate was approved by the House on November 12.", "On December\u00a02, 1980, the ANILCA bill was signed into law by Jimmy Carter, converting Wrangell\u2013St. Elias to a national park and preserve with an initial area of in the park and in the preserve.", "Boundaries between the park and preserve areas were drawn according to perceived values of scenery versus hunting potential In accordance with the legislation, the designated areas included of wilderness, stipulated in a somewhat less restrictive manner than standard practice in the continental United States.", "Opposition to the park persisted after Congressional designation from some Alaskans, who resented federal government presence in general and National Park Service presence in particular." ], [ "Wrangell\u2013St. Elias National Park and Preserve", "None succeeded, but one bill proposed by conservation-oriented groups introduced the concept of national preserves, which would enjoy most of the protections associated with national parks, but which would allow hunting.", "In 1977 Representative Morris K. Udall introduced the first version of the Alaska National Interest Lands Conservation Act (ANILCA) as H.R. 39, in which a Wrangell\u2013St. Elias National Park and a Chisana National Preserve were proposed.", "Although supported by the Park Service, the bill was opposed by Alaska.", "A revised bill was proposed by the Interior Department, with in national park lands and in an adjoining preserve, both to be named Wrangell\u2013St. Elias.", "Hearings in 1978 adjusted the areas, boundaries and relative proportions of park and preserve lands, with a view to allowing the hunting of Dall sheep in the Wrangell Mountains, and introducing a National Recreation Area to the north of the mountains.", "Alaska senator Mike Gravel threatened to filibuster the proposed ANILCA bill, effectively killing it.", "Following this blockage and with efforts on the part of Alaska authorities to claim lands that fell within the proposed protections, President Jimmy Carter invoked the Antiquities Act to proclaim 17 Alaskan national monuments, including in Wrangell\u2013St. Elias National Monument on December\u00a01, 1978." ] ], "gold": "Wrangell St-Elias National Monument was designated on December 1, 1978 by President Jimmy Carter, using the Antiquities Act. It was converted to a national park and preserve on December 2, 1980. Boundaries between the park and preserve areas were drawn according to perceived values of scenery versus hunting potential.", "prediction 1": "Wrangell\u2013St. Elias National Park was established in 1977 under the Alaska National Interest Lands Conservation Act (ANILCA) as H.R. 39, in which a Wrangell\u2013St. Elias National Park and a Chisana National Preserve were proposed. A revised bill was proposed by the Interior Department, with in national park lands and in an adjoining preserve, both to be named Wrangell\u2013St. Elias. In January 1979, Representative Morris K. Udall introduced a modified version of H.R. 39. Following markup and negotiations between the House and Senate versions, the bill as modified by the House and approved by the Senate on November 12. On December 2, 1980, the ANILCA bill was signed into law by Jimmy Carter, converting Wrangell\u2013St. Elias to a national park and preserve with an initial area of in", "prediction 2": "Wrangell\u2013St. Elias National Park was established under the Alaska National Interest Lands Conservation Act on December 1, 1977. The monument designation carried no dedicated funding for park development or operations, but did engender considerable hostility from Alaskans, who regarded the designation under the Antiquities Act as a Federal land grab. Attitudes were sharply divided between white Alaskans, who were largely opposed to the park and felt that they were being forced out, and native Ahtnas, who were granted subsistence hunting rights and who expected to profit from tourism.", "prediction 3": "In 1977, Representative Morris K. Udall introduced the first version of the Alaska National Interest Lands Conservation Act (ANILCA) as H.R. 39, in which a Wrangell\u2013St. Elias National Park and a Chisana National Preserve were proposed. Hearings in 1978 adjusted the areas, boundaries and relative proportions of park and preserve lands, with a view to allowing the hunting of Dall sheep in the Wrangell Mountains, and introducing a National Recreation Area to the north of the mountains.", "prediction 4": "Wrangell\u2013St. Elias National Park was established on November 2, 1978, following markup and negotiations between the House and Senate versions of the Alaska National Interest Lands Conservation Act (ANILCA), in which a Wrangell\u2013St. Elias National Park and a Chisana National Preserve were proposed. The original bill was introduced in 1977, in which a Wrangell\u2013St. Elias National Park and an adjoining preserve were proposed.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 37, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 377 }, { "error type": "Irrelevant", "explanation": "", "start": 378, "end": 467 }, { "error type": "Irrelevant", "explanation": "", "start": 468, "end": 617 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "President Jimmy Carter invoked the Antiquities Act to proclaim Wrangell\u2013St. Elias National Monument on December 1, 1978. On December 2, 1980, the ANILCA bill was signed into law by Jimmy Carter, converting Wrangell\u2013St. Elias to a national park and preserve with an initial area of in the park and in the preserve. Boundaries between the park and preserve areas were drawn according to perceived values of scenery versus hunting potential." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did star wars the empire strikes back come out?", "passages": [ [ "The Empire Strikes Back", "The special event was dubbed \"Empire Day\", a playful take the British Commonwealth Day holiday (known as Empire Day prior to 1958), where legions of stormtroopers were unleashed across the city.", "A series of other charity benefit premieres were held in numerous locations on May 19 and 20.", "The film went on to official general release in North America and the U.K. on May 21, 1980.", "The first wave of release included 126 70\u00a0mm prints, before a wider release in June 1980 (which were mostly 35\u00a0mm prints).", "During the initial theatrical run in Europe and Australia, the short film \"Black Angel\" by \"Star Wars\" art director Roger Christian was shown before the feature.", "Though the film was simply titled \"The Empire Strikes Back\" in its original promotional materials, the film still started with the title \"Star Wars\" on-screen which was followed by the opening crawl that gave the film's subtitle as \"Episode V: The Empire Strikes Back\", causing some surprise among cinema goers at the time as the original \"Star Wars\" film had not been given an episode number or subtitle for its first release in 1977.", "However, \"Episode IV: A New Hope\" was added to its opening crawl from its 1981 re-release onwards." ], [ "The Empire Strikes Back", "It received mixed reviews from critics initially but has since grown in esteem, becoming the most critically acclaimed chapter in the \"Star Wars\" saga; it is now widely regarded as one of the greatest films of all time.", "The film ranked at #3 on \"Empire\"s 2008 list of the 500 greatest movies of all time.", "It became the highest-grossing film of 1980 and, to date, has earned more than $538\u00a0million worldwide from its original run and several re-releases.", "When adjusted for inflation, it is the second-highest-grossing sequel of all time and the 13th-highest-grossing film in North America.", "The film was followed by \"Return of the Jedi\", which was released in 1983.", "In 2010, the film was selected for preservation in the United States' National Film Registry by the Library of Congress for being \"culturally, historically, and aesthetically significant\".", "Three years after the destruction of the Death Star, the Rebel Alliance, led by Princess Leia, has set up a new base on the ice planet of Hoth.", "The Imperial fleet, led by Darth Vader, continues to hunt for the new Rebel base by dispatching probe droids across the galaxy.", "Luke Skywalker is captured by a wampa while investigating one such probe, but manages to escape from the wampa's lair with his lightsaber." ] ], "gold": "The world premiere of \"The Empire Strikes Back\" was held on May 17, 1980, at the Kennedy Center in Washington, D.C. as a special Children's World Premiere event. The film went on to official general release in North America and the U.K. on May 21, 1980.", "prediction 1": "The film, The Empire Strikes Back, was released for special release in the United States on May 17, 1980. It was also released for special screening in London on May 19, 1980. The film, which was released for general release in North America and the United Kingdom on May 21, 1980, included 126 70 mm prints, before a wider release in June 1980.", "prediction 2": "Star Wars: The Empire Strikes Back is a 1980 American western film directed by George Lucas, set in a post-apocalyptic future where the droids are led by Darth Vader. The film came out in limited theatrical release on May 21, 1980, in the United States and in the United Kingdom.", "prediction 3": "The film The Empire Strikes Back came out in theaters on May 21, 1980, in the United States and the United Kingdom. The film was released in special event on May 19, 1980, where legions of stormtroopers were unleashed across the city.", "prediction 4": "The film \"The Empire Strikes Back\" made its special release on May 19, 1980 at the Disney California Adventure Theatre in San Diego, California. The film's official release in the U.S. and UK was on May 21. In Europe and Australia, the short film \"Black Angel\" by \"Star Wars\" art director Roger Christian was shown before the feature.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 105 }, { "error type": "Unverifiable", "explanation": "", "start": 106, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 345 } ], "missing-info": [], "corrected-prediction": "The film went on to official general release in North America and the U.K. on May 21, 1980." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What schizophrenic symptoms are decreased by drugs that selectively block the d2 dopamine receptor?", "passages": [ [ "Neurobiological effects of physical exercise", "Sedentary adults over age\u00a055 show a 1\u20132%\u00a0decline in hippocampal volume annually.", "A neuroimaging study with a sample of 120\u00a0adults revealed that participating in regular aerobic exercise increased the volume of the left hippocampus by 2.12% and the right hippocampus by 1.97% over a one-year period.", "Subjects in the low intensity stretching group who had higher fitness levels at baseline showed less hippocampal volume loss, providing evidence for exercise being protective against age-related cognitive decline.", "In general, individuals that exercise more over a given period have greater hippocampal volumes and better memory function.", "Aerobic exercise has also been shown to induce growth in the white matter tracts in the anterior corpus callosum, which normally shrink with age.", "The various functions of the brain structures that show exercise-induced increases in gray matter volume include:\n\nConcordant with the functional roles of the brain structures that exhibit increased gray matter volumes, regular exercise over a period of several months has been shown to persistently improve numerous executive functions and several forms of memory.", "In particular, consistent aerobic exercise has been shown to improve attentional control, information processing speed, cognitive flexibility (e.g., task switching), inhibitory control, working memory updating and capacity, declarative memory, and spatial memory." ], [ "Schizophrenia", "The dopamine hypothesis is now thought to be simplistic, partly because newer antipsychotic medication (atypical antipsychotic medication) can be just as effective as older medication (typical antipsychotic medication), but also affects serotonin function and may have slightly less of a dopamine blocking effect.", "Interest has also focused on the neurotransmitter glutamate and the reduced function of the NMDA glutamate receptor in schizophrenia, largely because of the abnormally low levels of glutamate receptors found in the postmortem brains of those diagnosed with schizophrenia, and the discovery that glutamate-blocking drugs such as phencyclidine and ketamine can mimic the symptoms and cognitive problems associated with the condition.", "Reduced glutamate function is linked to poor performance on tests requiring frontal lobe and hippocampal function, and glutamate can affect dopamine function, both of which have been implicated in schizophrenia; this has suggested an important mediating (and possibly causal) role of glutamate pathways in the condition.", "But positive symptoms fail to respond to glutamatergic medication.", "Closely related to evidence of glutamate dysfunction in schizophrenia is the observed changes GABAergic transmission." ], [ "Psychosis", "The DSM-5 characterizes disorders as psychotic or on the schizophrenia spectrum if they involve hallucinations, delusions, disorganized thinking, grossly disorganized motor behavior, or negative symptoms.", "The DSM-5 does not include psychosis as a definition in the glossary, although it defines \"psychotic features\", as well as \"psychoticism\" with respect to personality disorder.", "The ICD-10 has no specific definition of psychosis.", "Factor analysis of symptoms generally regarded as psychosis frequently yields a five factor solution, albeit five factors that are distinct from the five domains defined by the DSM-5 to encompass psychotic or schizophrenia spectrum disorders.", "The five factors are frequently labeled as hallucinations, delusions, disorganization, excitement, and emotional distress.", "The DSM-5 emphasizes a psychotic spectrum, wherein the low end is characterized by schizoid personality disorder, and the high end is characterized by schizophrenia.", "The evidence for the effectiveness of early interventions to prevent psychosis appeared inconclusive.", "But psychosis caused by drugs can be prevented.", "Whilst early intervention in those with a psychotic episode might improve short term outcomes, little benefit was seen from these measures after five years." ] ], "gold": "Schizophrenia is a mental disorder characterized by continuous or relapsing episodes of psychosis. The first-line treatment for schizophrenia is an antipsychotic. The typical antipsychotics (dopamine antagonists that block D2 receptors) may improve the so-called \"positive\" symptoms, like delusions and hallucinations. However, they have little effect on negative and cognitive symptoms, like apathy, lack of emotional affect, and lack of interest in social interactions, disordered thinking, reduced ability to plan and execute tasks.", "prediction 1": "There are several schizophrenic symptoms decreased by drugs that selectively block the d2 dopamine receptor. These include hallucinations, delusions, disorganized thinking, grossly disorganized motor behavior, or negative symptoms.", "prediction 2": "The dopamine hypothesis is now thought to be simplistic, partly because newer antipsychotic medication can be just as effective as older medication, but also affects serotonin function and may have slightly less of a dopamine blocking effect. Interest has also focused on the neurotransmitter glutamate and the reduced function of the NMDA glutamate receptor in schizophrenia, largely because of the abnormally low levels of glutamate receptors found in the postmortem brains of those diagnosed with schizophrenia and the discovery that glutamate-blocking drugs such as phencyclidine and ketamine can mimic the symptoms and cognitive problems associated with the condition.", "prediction 3": "There are several schizophrenia symptoms that are decreased by drugs that selectively block the d2 dopamine receptor, including hallucinations, delusions, disorganized thinking, grossly disorganized motor behavior, and negative symptoms. One of the most common symptom-relieving drugs used to treat schizophrenia is ketamine.", "prediction 4": "The dopamine hypothesis is now thought to be simplistic, partly because newer antipsychotic medication can be just as effective as older medication, but may also affect serotonin function and may have slightly less of a dopamine blocking effect. There have been some studies that have shown that drugs that selectively block the d2 dopamine receptor can mimic symptoms and cognitive problems associated with schizophrenia. Researchers have found that glutamate-blocking drugs such as phencyclidine and ketamine can mimic symptoms and cognitive problems associated with the condition.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 41, "end": 108 } ], "missing-info": [], "corrected-prediction": "There are several schizophrenic symptoms. These include hallucinations, delusions, disorganized thinking, grossly disorganized motor behavior, or negative symptoms." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "How long has there been triple crown races?", "passages": [ [ "Triple Crown of Thoroughbred Racing", "Triple Crown of Thoroughbred Racing\n\nThe Triple Crown of Thoroughbred Racing, often shortened to \"Triple Crown\", comprises three races for three-year-old Thoroughbred horses.", "Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing.", "The term originated in mid-19th century England and nations where thoroughbred racing is popular each have their own Triple Crown series.", "In the United States, the three races that make up the Triple Crown are:\n\nThere have been several different versions of the \"Triple Tiara\" (sometimes known as the Filly Triple Crown) in the United States.", "One of them was a national version that consisted of undercard events on the same weekends as the associated Triple Crown races:\nOnly one filly won this version of the Triple Tiara, Davona Dale in 1979.", "Few have even tried as the short time between the Kentucky Oaks and Black-Eyed Susan is generally considered too short for fillies.", "The most commonly accepted version of the Triple Tiara is the American Triple Tiara of Thoroughbred Racing which uses three races from New York.", "From 1957 to 2002, and 2007 to 2009, these three races were the Acorn Stakes, the Mother Goose Stakes, and the Coaching Club American Oaks." ], [ "Triple Crown of Thoroughbred Racing", "Eight fillies won this version of the New York Triple Tiara:\n\nIn 2010, the NYRA changed the configuration of the Triple Tiara to include the Alabama Stakes instead of the Mother Goose.", "Thus far, no filly has won the reconfigured Triple Tiara.", "In Great Britain, where the term Triple Crown originated with West Australian's three wins in 1853, it is made up of:\n\n\nSince the 2,000 Guineas was first run in 1809, fifteen horses (including three winners of substitute races at Newmarket during the First World War) have won the English Triple Crown.", "The most recent \u2013 and only winner since World War II \u2013 was Nijinsky, in 1970.", "For many years, it was considered unlikely that any horse would ever win the English Triple Crown again.", "In the winter of 2006/2007, however, trainer Jim Bolger was training his unbeaten colt Teofilo for the Triple Crown and bookmaker William Hill plc was offering odds of only 12/1 against Teofilo winning the 2007 Triple Crown.", "The horse was withdrawn from the 2000 Guineas two days before the race after suffering a setback and never raced again.", "Since Nijinsky, only Nashwan (1989), Sea the Stars (2009), and Camelot (2012) have won both the Guineas and the Derby." ], [ "Triple Crown of Thoroughbred Racing (United States)", "Triple Crown of Thoroughbred Racing (United States)\n\n", "In the United States, the Triple Crown of Thoroughbred Racing, commonly known as the Triple Crown, is a title awarded to a three-year-old Thoroughbred horse who wins the Kentucky Derby, Preakness Stakes, and Belmont Stakes.", "The three races were inaugurated in different years, the last being the Kentucky Derby in 1875.", "These races are now run annually in May and early June of each year.", "The Triple Crown Trophy, commissioned in 1950 but awarded to all previous winners as well as those after 1950, is awarded to a Triple Crown winner.", "The first winner of all three Triple Crown races was Sir Barton in 1919.", "Some journalists began using the term \"Triple Crown\" to refer to the three races as early as 1923, but it was not until Gallant Fox won the three events in 1930 that Charles Hatton of the \"Daily Racing Form\" put the term into common use." ] ], "gold": "The Triple Crown of Thoroughbred Racing, often shortened to Triple Crown, is a series of horse races for three-year-old Thoroughbreds. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. The term Triple Crown has been used since 1853, when West Australia experienced three wins in Great Britain. There have been Triple Crown races in America since 1875, when the Kentucky Derby was inaugurated.", "prediction 1": "The Triple Crown of Thoroughbred Racing, often shortened to \"Triple Crown\", comprises three races for three-year-old Thoroughbred horses. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. In the United States, the three races that make up the Triple Crown are: The Kentucky Derby, Preakness Stakes, and Belmont Stakes.", "prediction 2": "The Triple Crown, often shortened to Triple Crown, comprises three races for three-year-old Thoroughbred horses. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. In the United States, the three races that make up the Triple Crown are: The Kentucky Derby, Preakness Stakes, and Belmont Stakes. In Great Britain, where the term Triple Crown originated with West Australian's three wins in 1853, there have been several different versions of the Triple Crown, including the Acorn Stakes, the Mother Goose Stakes, and the Coaching Club American Oaks. From 1957 to 2002, and 2007 to 2009, these three races were the Acorn Stakes, the Mother Goose Stakes, and the Coaching Club American Oaks.", "prediction 3": "The Triple Crown of Thoroughbred Racing, often shortened to \"Triple Crown\", comprises three races for three-year-old Thoroughbred horses. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. There have been several different versions of the Triple Tiara, sometimes known as the Filly Triple Crown, in the United States. From 1957 to 2002, and 2007 to 2009, these three races were the Acorn Stakes, the Mother Goose Stakes, and the Coaching Club American Oaks. The most commonly accepted version of the Triple Tiara of Thoroughbred Racing, commonly known as the Triple Crown, is a title awarded to a three-year-old Thoroughbred horse who wins the Kentucky Derby, Preakness Stakes, and Belmont Stakes.", "prediction 4": "The Triple Crown of Thoroughbred Racing, often shortened to Triple Crown, comprises three races for three-year-old Thoroughbred horses. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. From 1957 to 2002, and 2007 to 2009, these three races were the Acorn Stakes, the Mother Goose Stakes, and the Coaching Club American Oaks.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 256, "end": 386 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Triple Crown of Thoroughbred Racing, often shortened to \"Triple Crown\", comprises three races for three-year-old Thoroughbred horses. Winning all three of these Thoroughbred horse races is considered the greatest accomplishment in Thoroughbred racing. The term Triple Crown has been used since 1853, when West Australia experienced three wins in Great Britain. The three races were inaugurated in different years, the last being the Kentucky Derby in 1875." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings let it rock let it roll?", "passages": [ [ "Let It Roll (Let It Rock)", "Let It Roll (Let It Rock)\n\n\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel.", "It was released in March 1985 as the second and final single from McDaniel's album \"Let It Roll\".", "It peaked at both number 6 on the U.S. \"Billboard\" Hot Country Singles & Tracks chart and on the Canadian \"RPM\" Country Tracks chart.", "The music video was directed by George Bloom and premiered in early 1985." ], [ "Let It Roll (Little Feat album)", "Let It Roll (Little Feat album)\n\n", "Let It Roll is the eighth studio album by the American rock band Little Feat, released in 1988.", "Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League.", "Fuller also dominates the lead vocals.", "The album attained RIAA certified gold status on February 14, 1989.", "It is the first Little Feat studio album without Lowell George, after his death in 1979 and is one of their most successful albums, sparking a comeback by the band.", "The first single, \"Hate to Lose Your Lovin'\", earned the band their first #1 hit on the Mainstream Rock Tracks chart.", "Reviewing the album for AllMusic, Stephen Thomas Erlewine, said:\n\nWhat's surprising about \"Let It Roll\" is not just that it works, but that it works smashingly.", "It sounds as if the group picked up after \"The Last Record Album\", deciding to return to the sound of \"Feats Don't Fail Me Now\".", "True, the songwriting might not have the idiosyncratic genius of George, but it's strong, catchy and memorable, from the fine singles \"Hate to Lose Your Lovin'\" and \"Let it Roll\" to album tracks." ] ], "gold": "Let It Roll is the name of the eighth studio album by the American rock band Little Feat, which was released in 1988. Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League, who also takes most lead vocals. \"Let It Roll (Let It Rock)\" is also a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album Let It Roll and peaked at both number 6 on the U.S. Billboard Hot Country Singles & Tracks chart and on the Canadian RPM Country Tracks chart.", "prediction 1": "\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album \"Let It Roll\". Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League. Fuller also dominates the lead vocals. Let It Roll is the eighth studio album by the American rock band Little Feat, released in 1988. Eight of the ten songs on the album were co-written by new band member of the band member of the founding member of Pure Prairie League. Fuller also dominates the lead vocals.", "prediction 2": "\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album Let It Roll. Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League. Fuller also dominates the lead vocals.", "prediction 3": "\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album \"Let It Roll\". Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League. Fuller also dominates the lead vocals.", "prediction 4": "\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album \"Let It Roll\". Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League. Fuller also dominates the lead vocals. Let It Roll is the eighth studio album by the American rock band Little Feat, released in 1988. Eight of the ten songs on the album were co-written by new band member Craig Fuller, the founding member of Pure Prairie League. Fuller also dominates the lead vocals. The album attained RIAA certified gold status on February 14, 1989.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 219, "end": 347 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 348, "end": 386 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Let It Roll (Let It Rock)\" is a song written by Chuck Berry and recorded by American country music artist Mel McDaniel. It was released in March 1985 as the second and final single from McDaniel's album \"Let It Roll\". It peaked at both number 6 on the U.S. \"Billboard\" Hot Country Singles & Tracks chart and on the Canadian \"RPM\" Country Tracks chart. Let It Roll is the eighth studio album by the American rock band Little Feat, released in 1988. Eight of the ten songs on the album were co-written by new band member of the band member of the founding member of Pure Prairie League. Fuller also dominates the lead vocals." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the 3 point contest last year?", "passages": [ [ "Three-Point Contest", "Three-Point Contest\n\nThe Three-Point Contest (officially named the JBL Three-Point Contest and previously named the Three-Point Shootout) is a National Basketball Association (NBA) contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend.", "From its introduction in 1986 to 2002, and again from 2017 onward, eight participants were selected to participate in each season's shootout.", "Between 2003 and 2016, the contest was open to just six competitors.", "Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California.", "In this contest, participants attempt to make as many three-point field goals as possible from five positions behind the three-point arc in one minute.", "Players begin shooting from one corner of the court, and move from station to station along the three point arc until they reach the other corner.", "At each shooting station is a rack with five basketballs.", "Out of the five balls, four are worth one point (the standard orange Spalding game balls) and the fifth one (a red/white/blue ABA-style ball; often nicknamed the \"money ball\") is worth two points.", "The goal of this contest is to score as many points as possible within one minute.", "A perfect score used to be 30 points." ], [ "2017 NBA All-Star Game", "Joining James in the East frontcourt was Jimmy Butler of the Chicago Bulls, his third consecutive selection, and Giannis Antetokounmpo of the Milwaukee Bucks, his first all-star selection in his young career, and the first Buck to be named an all-star since Michael Redd in 2004.", "Giannis became the first Greek basketball player to participate in the all-star game.", "Stephen Curry of the Golden State Warriors and James Harden of the Houston Rockets were named to the starting backcourt in the West, earning their fourth and fifth all-star appearances, respectively.", "In the frontcourt, Kevin Durant of the Golden State Warriors was named to his eighth career all-star game, along with Kawhi Leonard of the San Antonio Spurs and Anthony Davis of the New Orleans Pelicans, their second and fourth all-star selections, respectively.", "The All-Star Game reserves were announced on January 26, 2017.", "The West reserves include Russell Westbrook of the Oklahoma City Thunder, Klay Thompson and Draymond Green of the Golden State Warriors, DeMarcus Cousins of the Sacramento Kings, Marc Gasol of the Memphis Grizzlies, DeAndre Jordan of the Los Angeles Clippers, and Gordon Hayward of the Utah Jazz.", "Jordan and Hayward were selected as all-stars for the first time in their respective careers." ], [ "2016 NBA All-Star Game", "The other players named to the Western Conference starting roster include Russell Westbrook and Kevin Durant of the Oklahoma City Thunder, named to their fifth and seventh All-Star Games respectively, and Kawhi Leonard of the San Antonio Spurs, who was named to his first career All-Star Game.", "LeBron James of the Cleveland Cavaliers, with 1,089,206 votes, was the leading vote getter in the Eastern Conference, earning James his 12th career all-star nod.", "Dwyane Wade of the Miami Heat was also named a starter to his 12th career All-Star Game, with a total of 941,466 votes.", "Rounding out the rest of the Eastern Conference starting lineup was Kyle Lowry of the Toronto Raptors (second all-star nod), Paul George of the Indiana Pacers (3rd all-star nod), and Carmelo Anthony of the New York Knicks, who was named to his ninth career All-Star Game.", "The West Reserves included Klay Thompson and Draymond Green of the Golden State Warriors, Chris Paul of the Los Angeles Clippers, James Harden of the Houston Rockets, Anthony Davis of the New Orleans Pelicans, DeMarcus Cousins of the Sacramento Kings, and LaMarcus Aldridge, who made the All-Star Game as a member of the San Antonio Spurs for the first time." ] ], "gold": "The Three-Point Contest is a NBA contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Up to 2018, eight participants were selected to be at the game, but this changed in 2019, year in which ten players took part of the event. Eric Gordon won the 2017 edition of the contest, following the victories obtained by Klay Alexander Thompson and Stephen Curry in 2016 and 2015 respectively.", "prediction 1": "The Three-Point Contest is a National Basketball Association contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California. The winner of the 2014 Three Point Contest was Tony Parker, who scored a career-high 34 points.", "prediction 2": "The Three-Point Contest is a National Basketball Association (NBA) contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. In 2017, Devin Booker of the Phoenix Suns won the event which was held at the Staples Center in Los Angeles, California. Devin Booker's first NBA title as a competitor came in 2015.", "prediction 3": "The Three-Point Contest, officially named the JBL Three-Point Contest and previously named the Three-Point Shootout, is a National Basketball Association contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California. In this contest, participants attempt to make as many three-point field goals as possible from five positions behind the three-point arc in one minute.", "prediction 4": "The Three-Point Contest is a National Basketball Association (NBA) contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California. In this contest, participants attempt to make as many three-point field goals as possible from five positions behind the three point arc in one minute.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 288, "end": 383 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Three-Point Contest is a National Basketball Association contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. From its introduction in 1986 to 2002, and again from 2017 onward, eight participants were selected to participate in each season's shootout. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who invented the first efficient incandescent light bulb that was later used in projectors?", "passages": [ [ "Incandescent light bulb", "The HEI program was terminated in 2008 due to slow progress.", "US Department of Energy research at Sandia National Laboratories initially indicated the potential for dramatically improved efficiency from a photonic lattice filament.", "However, later work indicated that initially promising results were in error.", "Prompted by legislation in various countries mandating increased bulb efficiency, new \"hybrid\" incandescent bulbs have been introduced by Philips.", "The \"Halogena Energy Saver\" incandescents can produce about 23 lm/W; about 30 percent more efficient than traditional incandescents, by using a reflective capsule to reflect formerly wasted infrared radiation back to the filament from which it can be re-emitted as visible light.", "This concept was pioneered by Duro-Test in 1980 with a commercial product that produced 29.8 lm/W. More advanced reflectors based on interference filters or photonic crystals can theoretically result in higher efficiency, up to a limit of about 270 lm/W (40% of the maximum efficacy possible).", "Laboratory proof-of-concept experiments have produced as much as 45 lm/W, approaching the efficacy of compact fluorescent bulbs.", "Incandescent light bulbs consist of an air-tight glass enclosure (the envelope, or bulb) with a filament of tungsten wire inside the bulb, through which an electric current is passed." ], [ "Incandescent light bulb", "In 1840, British scientist Warren de la Rue enclosed a coiled platinum filament in a vacuum tube and passed an electric current through it.", "The design was based on the concept that the high melting point of platinum would allow it to operate at high temperatures and that the evacuated chamber would contain fewer gas molecules to react with the platinum, improving its longevity.", "Although a workable design, the cost of the platinum made it impractical for commercial use.", "In 1841, Frederick de Moleyns of England was granted the first patent for an incandescent lamp, with a design using platinum wires contained within a vacuum bulb.", "He also used carbon.", "In 1845, American John W. Starr acquired a patent for his incandescent light bulb involving the use of carbon filaments.", "He died shortly after obtaining the patent, and his invention was never produced commercially.", "Little else is known about him.", "In 1851, Jean Eug\u00e8ne Robert-Houdin publicly demonstrated incandescent light bulbs on his estate in Blois, France.", "His light bulbs are on display in the museum of the Ch\u00e2teau de Blois.", "In 1859, Moses G. Farmer built an electric incandescent light bulb using a platinum filament.", "He later patented a light bulb which was purchased by Thomas Edison." ], [ "Incandescent light bulb", "Some jurisdictions, such as the European Union, China, Canada and United States, are in the process of phasing out the use of incandescent light bulbs while others, including Colombia, Mexico, Cuba, Argentina and Brazil, have prohibited them already.", "In addressing the question of who invented the incandescent lamp, historians Robert Friedel and Paul Israel list 22 inventors of incandescent lamps prior to Joseph Swan and Thomas Edison.", "They conclude that Edison's version was able to outstrip the others because of a combination of three factors: an effective incandescent material, a higher vacuum than others were able to achieve (by use of the Sprengel pump) and a high resistance that made power distribution from a centralized source economically viable.", "Historian Thomas Hughes has attributed Edison's success to his development of an entire, integrated system of electric lighting.", "In 1761 Ebenezer Kinnersley demonstrated heating a wire to incandescence.", "In 1802, Humphry Davy used what he described as \"\"a battery of immense size\"\", consisting of 2,000 cells housed in the basement of the Royal Institution of Great Britain, to create an incandescent light by passing the current through a thin strip of platinum, chosen because the metal had an extremely high melting point." ] ], "gold": "Although many people worked with incandescent light bulbs prior to Thomas Edison, he was the first one to make one with greater efficiency and resistance while being capable of withstanding a higher vacuum. This version was later improved on by Koninklijke Philips N.V., who invented the first efficient incandescent light bulb to be used in projectors.", "prediction 1": "In 1840, British scientist Warren de la Rue enclosed a coiled platinum filament in a vacuum tube and passed an electric current through it. In 1859, Moses G. Farmer built an electric incandescent light bulb using a platinum filament. He later patented a light bulb which was purchased by Thomas Edison. In 1978, the first efficient incandescent light bulb that was later used in projectors was created by a German researcher, whose work was reported to have been published in the journal \"The\" incandescent light bulb.", "prediction 2": "In 1840, British scientist Warren de la Rue enclosed a coiled platinum filament in a vacuum tube and passed an electric current through it. In 1859, Moses G. Farmer built an electric incandescent light bulb using a platinum filament. He later patented a light bulb which was purchased by Thomas Edison. In 1881, German inventor Friedrich Wilhelm Scherrer invented the first efficient incandescent lamp that was later used in projectors.", "prediction 3": "In 1840, British scientist Warren de la Rue enclosed a coiled platinum filament in a vacuum tube and passed an electric current through it. In 1859, Moses G. Farmer built an electric incandescent light bulb using a platinum filament. He later patented a light bulb which was purchased by Thomas Edison. In 1881, British scientist Charles F. Dee and American John W. Starr created the first efficient incandescent light bulb that was later used in projectors. In 1984, Philips produced the first efficient incandescent bulbs.", "prediction 4": "In 1840, British scientist Warren de la Rue enclosed a coiled platinum filament in a vacuum tube and passed an electric current through it. In 1845, American John W. Starr acquired a patent for his incandescent light bulb involving the use of carbon filaments. He died shortly after obtaining the patent and his invention was never produced commercially. In 1859, Moses G. Farmer built an electric incandescent light bulb using a platinum filament. He later patented a light bulb which was purchased by Thomas Edison. In 1881, John W. Starr acquired a patent for his incandescent light bulb involving the use of carbon filaments.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 302 }, { "error type": "Unverifiable", "explanation": "", "start": 303, "end": 425 }, { "error type": "Unverifiable", "explanation": "", "start": 463, "end": 518 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Edison's version was able to outstrip the others because of a combination of three factors: an effective incandescent material, a higher vacuum, and a high resistance. New \"hybrid\" incandescent bulbs have been introduced by Philips." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What year did the lincoln continental come out?", "passages": [ [ "Lincoln Continental", "Lincoln Continentals from 1939 to 1941 shared largely the same body design with each other; based on the Lincoln-Zephyr, the Continental received few updates from year to year.", "For the 1942 model year, all Lincoln models were given squared-up fenders, and a revised grille.", "The result was a boxier, somewhat heavier look in keeping with then-current design trends, but perhaps less graceful in retrospect.", "1942 production was shortened, following the entry of the United States into World War II; the attack on Pearl Harbor led to the suspension of production of automobiles for civilian use.", "After World War II, the Lincoln division of Ford returned the Continental to production as a 1946 model; Lincoln dropped the Zephyr nomenclature following the war, so the postwar Continental was derived from the standard Lincoln (internally H-Series).", "To attract buyers, the design was refreshed with updated trim, distinguished by a new grille.", "For 1947, walnut wood trim was added to the interior.", "Following the death of Edsel Ford in 1943, Ford Motor Company re-organized its corporate management structure, which led to the 1946 departure of the Continental's designer Bob Gregorie. 1948 would become the last year for the Continental, as the division sought to redevelop its new 1949 model line as an upgraded version of the Mercury; the expensive personal-luxury car no longer had a role at Lincoln." ], [ "Lincoln Continental", "The 1939\u20131948 Continental is recognized as a \"Full Classic\" by the Classic Car Club of America, one of the last-built cars to be so recognized.", "As of 2015, the 1948 Lincoln Continental and 1948 Lincoln were the last cars produced and sold by a major U.S. automaker with a V12 engine.", "After an eight-year hiatus, for the 1956 model year, the Continental nameplate made its return; to launch the vehicle, Ford created a namesake Continental division centered around its new flagship vehicle.", "To again highlight the European influence of the original Continental, Ford assigned the \"Mark II\" suffix to the new Continental (also in an effort to distinguish itself from the similar Bentley Continental).", "Slotted (far) above Lincoln-Mercury, Continentals would be marketed and serviced through the Lincoln dealership network.", "At its 1956 launch, the Continental Mark II was the most expensive automobile sold by a domestic manufacturer in the United States, rivaling the Rolls-Royce Silver Cloud.", "At $10,000, the Mark II (equivalent to nearly $90,000 in 2016) cost the same as five s.", "With a large number of power-equipment features included, the Mark II was offered with a single option: $595 for air conditioning." ], [ "Lincoln Continental", "For the 1995 model year, the Continental was substantially updated with more rounded lines similar to the Mark VIII; the interior also saw a major overhaul.", "Production commenced at Wixom Assembly in November 1994.", "While the body was all-new, the new Continental shared underpinnings with the previous generation.", "In a departure from the previous generation and its Ford/Mercury counterparts, the Continental was given back its V8 engine for the first time since 1987 and more closely matched the Northstar V8 engine that Cadillac was using for its DeVille and Seville sedans at the time.", "The base price for the new Continental was $40,750 ($ in current dollars).", "The sole engine for the Continental was the Modular/InTech 32v DOHC 4.6L V8 shared with the Lincoln Mark VIII, but slightly de-tuned for front wheel drive use.", "It produced and torque; was reached in 7.2 seconds.", "Inside, the Continental featured a plush leather interior with many amenities and advanced electronics for the time.", "Some of the options included JBL sound system, 6-CD changer, power moonroof, heated seats, onboard cellular phone, anti-theft alarm system, traction control, and chrome wheels.", "As before, buyers could choose between five and six-passenger seating, offering Bridge of Weir leather on upper trim packages." ] ], "gold": "The Lincoln Continental is a series of mid-sized and full-sized luxury cars produced by Lincoln, a division of the American automaker Ford Motor Company. The model line was introduced in 1939 and it has since been in production for over 55 years across nine different decades, with Lincoln producing a total of ten different generations. Among these are the Lincoln Continental Mark II, which came out in 1956, the Ninth Generation, released in 1995, and the Lincoln Continental Diamond Anniversary Edition from 1996, which commemorated the 75th anniversary of the company.", "prediction 1": "After an eight-year hiatus, for the 1956 model year, the Continental nameplate made its return, as the division sought to redevelop its new 1949 model line as an upgraded version of the Mercury. Production commenced at Wixom Assembly in November 1994, and the fifth generation of the Continental was released in May 1950. The fifth generation of the Continental was introduced in May 1949, and production commenced in April 1950.", "prediction 2": "The Lincoln Continental came out in 1939, 1942, 1946, and 1947 as well as the 1995 and 1996 model years. Lincoln Continentals came out in the United States in both 1947 and 1996, respectively.", "prediction 3": "The 1956 Lincoln Continental is a mid-size luxury car produced by Lincoln Motor Company. It was first introduced in 1939 and was later updated with new features that included a new grille, squared up fenders, and walnut wood trim. For the 1995 model year, the Lincoln Continental was substantially updated with more rounded lines similar to the Mark VIII; the interior also saw a major overhaul. Production commenced at Wixom Assembly in November 1994.", "prediction 4": "The Lincoln Continental was introduced in 1939, and for the 1946 model year it was reintroduced as the Continental. The Continental Mark II was launched in 1956 and the Continental name was given a new suffix to make it stand out and distinguish it from the Bentley Continental. The 1995 model year brought about a major overhaul of the interior which saw the Continental receive a new exterior design with rounded lines similar to the Mark VIII.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 251 }, { "error type": "Unverifiable", "explanation": "", "start": 256, "end": 321 }, { "error type": "Redundant", "explanation": "the fifth generation of the Continental was released in May 1950. ", "start": 322, "end": 389 }, { "error type": "Unverifiable", "explanation": "", "start": 394, "end": 429 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Lincoln Continental is a division of the American automaker Ford Motor Company. The model line was introduced in 1939. Lincoln Continental Mark II came out in 1956." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who were the main countries involved in the cold war?", "passages": [ [ "Timeline of events in the Cold War", "Timeline of events in the Cold War\n\nThis is a timeline of the main events of the Cold War, a state of political and military tension after World War II between powers in the Western Bloc (the United States, its NATO allies and others) and powers in the Eastern Bloc (the Soviet Union, its allies in the Warsaw Pact and later the People's Republic of China)." ] ], "gold": "The Cold War, which is the period of political and military tension that occurred after World War II between powers in the Western Bloc and powers in the Eastern Bloc. The main countries involved in the Western Bloc's NATO were Belgium, Canada, Denmark, France, Iceland, Italy, Luxembourg, Netherlands, Norway, Portugal, United Kingdom, United States, Greece, Turkey, West Germany and Spain, while the countries involved in the Western Bloc's Southeast Asia Treaty Organization were Australia, France, New Zealand, Pakistan, Philippines, Thailand, United Kingdom, and United States. The main countries involved in the Western Bloc's ANZUS were Australia, New Zealand, and United States and the countries involved in the Western Bloc's Central Treaty Organization were Iran, Iraq, Pakistan, Turkey, and United Kingdom. The main countries involved in the Eastern Bloc's Comecon were the Soviet Union, Bulgaria, Czechoslavak Republic, Hungary, Poland, and Romania, and the countries involved in the Eastern Bloc's Warsaw Pact were Soviet Union, Albana, Bulgaria, Czechoslavak Republic, German Democratic Republic, Hungary, Poland, and Romania. ", "prediction 1": "The main countries involved in the Cold War were the United States and its NATO allies, and the Soviet Union, its allies in the Warsaw Pact and later the People's Republic of China.", "prediction 2": "The main countries involved in the Cold War are the United States and its NATO allies, as well as the Soviet Union, its allies in the Warsaw Pact, and later the People's Republic of China.", "prediction 3": "The Cold War was a state of political and military tension after World War II between powers in the Western Bloc (the United States, its NATO allies and others) and powers in the Eastern Bloc (the Soviet Union, its allies in the Warsaw Pact and later the People's Republic of China).", "prediction 4": "The Cold War was between the countries of the Western Bloc and the Eastern Bloc, a state of political and military tension after World War II between the United States, its NATO allies and others, and the Soviet Union, its allies in the Warsaw Pact and later the People's Republic of China, a state of political and military tension after World War II.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Cold War, a state of political and military tension after World War II between powers in the Western Bloc. The main countries involved in the Cold War were the United States and its NATO allies, and the Soviet Union, its allies in the Warsaw Pact and later the People's Republic of China." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where was the revenant supposed to have taken place?", "passages": [ [ "The Revenant (novel)", "The Revenant (novel)\n\n", "The Revenant: A Novel of Revenge is a 2002 novel by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory.", "The word \"revenant\" means someone who has risen from the grave to terrorize the living.", "The novel was later adapted as a screenplay for a 2015 feature film directed by Alejandro G. I\u00f1\u00e1rritu.", "The novel was republished in January 2015 in anticipation of the upcoming film release.", "Many of the outdoor adventures depicted in the novel are based on Punke's outdoor interests and hobbies, such as fishing and exploring the backcountry, which he enjoyed while growing up in Wyoming.", "Punke had originally intended to write a political novel.", "He started archival research and writing in 1997, and it took four years for him to complete the novel, with the long hours taking a toll on his health.", "\"Maxim\" reporter Walter Bonner interviewed Punke's brother who described the novel as an attempt by Punke to \"write his way out of D.C. and back to the big sky country\".", "The novel is dedicated to his high school English teacher, Roger Clark." ], [ "The Revenant (2015 film)", "The Revenant (2015 film)\n\nThe Revenant is a 2015 American semi-biographical epic western film directed by Alejandro Gonz\u00e1lez I\u00f1\u00e1rritu.", "The screenplay by Mark L. Smith and I\u00f1\u00e1rritu is based in part on Michael Punke's 2002 novel of the same name, describing frontiersman Hugh Glass's experiences in 1823.", "That novel is in turn based on the 1915 poem \"The Song of Hugh Glass\".", "The film stars Leonardo DiCaprio, Tom Hardy, Domhnall Gleeson, and Will Poulter.", "Development began in August 2001 when producer Akiva Goldsman purchased Punke's manuscript.", "I\u00f1\u00e1rritu signed on to direct in August 2011 and in April 2014, after several delays due to other projects, I\u00f1\u00e1rritu confirmed that he was beginning work on \"The Revenant\" and that DiCaprio would play the lead role.", "Principal photography began in October 2014.", "Location and crew concerns delayed the film from May to August 2015.", "\"The Revenant\" premiered at the TCL Chinese Theatre on December 16, 2015, and had a limited release on December 25, expanding on January 8, 2016.", "The film received largely positive reviews, and praise for its performances (particularly from DiCaprio and Hardy), direction, and cinematography.", "It won three Golden Globe Awards and five BAFTA Awards." ], [ "Revenant (Buffy novel)", "Revenant (Buffy novel)\n\nRevenant is an original novel based on the U.S. television series \"Buffy the Vampire Slayer\".", "A Chinese gang arrives in Sunnydale, which begins committing criminal acts across the town.", "Immediately, racial tension begins to increase; one of Willow's friends, Jia Li, is especially subjected to the effects.", "She discovers that her brother, Lok, is delving into the occult, in order to learn more about their great-grandfather's death in Sunnydale many years prior.", "Coinciding with these events, a man named Zhiyong tries to resurrect some men who died in a cave many years prior in order to raise Sharmma, a demon who would give him power in return.", "A beautiful warrior named Shing arrives on the scene at the same time; apparently, she's just as strong as Buffy.", "Xander feels an immediate attraction for her, but there's something about her that he doesn't know.", "The novel is placed during late \"Buffy\" season 3.", "Wesley and Faith do not appear.", "Buffy novels such as this one are not usually considered by fans as canonical.", "Some fans consider them as stories from the imaginations of authors and artists, while other fans consider them as taking place in an alternative fictional reality." ] ], "gold": "The Revenant: A Novel of Revenge is a 2002 novel by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory that was later adapted into a movie directed by Alejandro Gonz\u00e1lez I\u00f1\u00e1rritu in 2015, which takes place in the territory of the present day Dakotas. Both of them share similar titles with other fictional works, such as the novel based on the U.S. television series Buffy the Vampire Slayer that occurs in the fictional town of Sunnydale and a crime comic-book series that takes place in the: fictitious twin cities of Sapphire City and Jade Harbor. There's also an action role-playing videogame that takes the player to the island of Ahkuilon, is home to the town of Misthaven, and a Doctor Who audio drama where the characters of Ian and Barbara are stranded off Northern Scotland's Orkney Islands after watching the First Doctor disappear in his TARDIS.", "prediction 1": "The Revenant is one of the most popular novels of the modern era. It's supposed to have been set in the 18th century in the life of frontiersman Hugh Glass in Missouri Territory. The Revenant: A Novel of Revenge is a 2002 novel by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory. The film adaptation, The Revenant, is based in part on Punke's 2002 novel of the same name. The Revenant is a 2015 American semi-biographical epic western directed by Alejandro Gonz\u00e1lez I\u00e1ritu.", "prediction 2": "The Revenant is a 2002 novel by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory. The Revenant: A Novel of Revenge is a 2015 American semi-biographical epic western film directed by Alejandro Gonz\u00e1lez I\u00e1rritu, whose screenplay is based in part on Punke's 2002 novel of the same name, explaining frontiersman Hugh Glass's experiences in 1823. The Revenant is an original novel of Buffy the Vampire Slayer. Revenant is also the Buffy series Buffy the Vampire Slayer. The novel is set in China.", "prediction 3": "The Revenant is a 2002 novel by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory. The novel was later adapted as a screenplay for a 2015 American epic western film directed by Alejandro Gonz\u00e1lez I\u00e1rritu. The movie is based in part on Punke's 2002 novel of the same name, describing frontiersman Hugh Glass's experiences in 1823. It is also an original novel based on the U.S. television series Buffy the Vampire Slayer.", "prediction 4": "The Revenant is a novel written in 2002 by American author Michael Punke, based on a series of events in the life of American frontiersman Hugh Glass in 1823 Missouri Territory. The novel was later adapted as a screenplay for a 2015 American semi-biographical epic western film directed by Alejandro Gonz\u00e1lez I\u00e1rritu. The Revenant is also the title of a novel written in 2011 by American author Michael Punke based on the television series Buffy the Vampire Slayer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 65 }, { "error type": "Redundant", "explanation": "It's supposed to have been set in the 18th century in the life of frontiersman Hugh Glass in Missouri Territory. ", "start": 179, "end": 365 }, { "error type": "Redundant", "explanation": "The film adaptation, The Revenant, is based in part on Punke's 2002 novel of the same name. ", "start": 458, "end": 520 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Revenant is supposed to have been set in the 18th century and based on the life of frontiersman Hugh Glass in Missouri Territory. The film adaptation, The Revenant, is a 2015 adaption based in part on Punke's 2002 novel of the same name and directed by Alejandro Gonz\u00e1lez I\u00e1ritu. There is another work, Revenant which is an original novel based on the U.S. television series \"Buffy the Vampire Slayer\". It takes place in Sunnydale. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many senate seats are up for election in 2018?", "passages": [ [ "2018 United States Senate elections", "2018 United States Senate elections\n\nElections to the United States Senate were held on November 6, 2018.", "Thirty-three of the 100 seats were contested in regular elections, while two others were contested in special elections due to Senate vacancies in Minnesota and Mississippi.", "The winners were elected to six-year terms running from January 3, 2019, to January 3, 2025.", "Senate Democrats had 26 seats up for election (including the seats of two independents who caucus with them), while Senate Republicans had nine seats up for election.", "To maintain their working majority of 50 Senators and Republican Vice President Mike Pence (who is able to cast a tie-breaking vote in accordance with ), Republicans could only afford a net loss of one Senate seat in the 2018 elections.", "Three Republican-held seats were open as a result of retirements in Tennessee, Utah, and Arizona.", "Democrats were defending ten seats in states won by Donald Trump in the 2016 presidential election, while Republicans were only defending one seat in a state won by Hillary Clinton in 2016.", "The Republicans maintained a Senate majority following the 2018 elections, defeating Democratic incumbents in four states (Florida, Indiana, Missouri, and North Dakota).", "Democrats defeated a Republican incumbent in Nevada and gained an open seat in Arizona.", "Democrats targeted Republican-held Senate seats in Arizona (open seat) and Nevada." ], [ "2024 United States Senate elections", "2024 United States Senate elections\n\nElections to the United States Senate will be held on November 5, 2024 with 33 of the 100 seats in the Senate being contested in regular elections, the winners of which will serve six-year terms in the United States Congress from January 3, 2025 to January 3, 2031.", "Senators are divided into three groups, or Classes, whose terms are staggered so that a different class is elected every two years.", "Class 1 Senators were last elected in 2018, and will be up for election again in 2024.", "All 33 Class 1 Senate seats are up for election in 2024; Class 1 currently consists of 21 Democrats, 2 independents who caucus with the Senate Democrats and 10 Republican.", "Each block represents one of the one hundred seats in the U.S. Senate.", "\"D#\" is a Democratic/active senator, \"I#\" is an Independent senator, and \"R#\" is a Republican/active senator.", "They are arranged so that the parties are separated and a majority is clear by crossing the middle.", "Each block indicates an incumbent senator's actions going into the election.", "To be determined by this election.", "One-term Democratic incumbent Kyrsten Sinema was elected in 2018.", "Five-term Democratic incumbent Dianne Feinstein was re-elected in 2018.", "Two-term Democratic incumbent Chris Murphy was re-elected in 2018." ] ], "gold": "The 2018 United States Senate elections were held on November 6, 2018. 33 of the 100 seats were contested in regular elections while 2 others were contested in special elections due to Senate vacancies in Minnesota and Mississippi. Senate Democrats had 24 seats up for election, Senate Republicans had 9 seats up for election, and Independents had 2 seats up for election in 2018.", "prediction 1": "Thirty-three of the 100 seats in the United States Senate were contested in regular elections, while two others were contested in special elections due to Senate vacancies in Minnesota and Mississippi. The winners were elected to six-year terms running from January 3, 2019, to January 3, 2025. In 2018, Democrats had 26 seats up for election, while Republicans had nine seats up for election. Elections to the United States Senate will be held on November 5, 2024 with 33 of the 100 seats in the Senate being contested in regular elections, the winners of which will serve six-year terms in the United States Congress from January 3, 2025 to January 3, 2031.\n", "prediction 2": "34 of the 100 seats in the US Senate were contested in regular elections, with two others being contested in special elections due to Senate vacancies in Minnesota and Mississippi. The winners were elected to six-year terms running from January 3, 2019, to January 3, 2025. The 2018 total number of seats up for election was 198, with 34 Democrats and 9 Republicans. The number of seats up for election in the United States Senate for 2024 was 33.", "prediction 3": "There are currently 113 vacancies in the US Senate. Thirty-three of the 100 seats were contested in regular elections, while two others were contested in special elections due to Senate vacancies in Minnesota and Mississippi. In 2018, Democrats had 26 seats up for election, while Republicans had nine seats up for election. The next general election for the United States Senate is scheduled to be held on November 5, 2024. All 33 Class 1 Senate seats are up for election in 2024; Class 1 currently consists of 21 Democrats, 2 independents who caucus with the Senate Democrats and 10 Republican.", "prediction 4": "Most of the 100 seats up for election in the United States Senate were held in regular elections on November 6, 2018. Thirty-three of the 100 seats were contested in regular elections, while two others were contested in special elections due to Senate vacancies in Minnesota and Mississippi. The winners of these elections were elected to six-year terms running from January 3, 2019, to January 3, 2025. For example, in 2018, Democratic incumbents were only up for election in states including Florida, Missouri, North Dakota, and Iowa. In 2024, 33 of the 100 seats in the Senate are up for election; Class 1 Senators were last elected in 2018, and all of the 100 seats are up for election in 2024; Class 1 currently consists of 21 Democrats, 2 independents who caucus with the Senate Democrats, and 10 Republican.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 541 }, { "error type": "Irrelevant", "explanation": "", "start": 542, "end": 660 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 294 }, { "error type": "Redundant", "explanation": "In 2018, Democrats had 26 seats up for election", "start": 371, "end": 393 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 2018 United States Senate elections were held on November 6, 2018. Thirty-three of the 100 seats in the United States Senate were contested in regular elections, while two others were contested in special elections due to Senate vacancies in Minnesota and Mississippi. Democrats had 26 seats up for election, including the seats of two independents who caucus with them, while Republicans had nine.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "How many times does the bride and bridegroom walk around the fire during the hindu wedding ceremony?", "passages": [ [ "Hindu wedding", "Many other rituals and ceremonies are sometimes found in Hindu weddings, such as \"madhuparka\", \"vivaah-homa\", \"agni-parinayana\", \"asmarohana\", \"laja homa\", \"abhishek\", \"anna-prashashan\", and \"aashir-vadah\".", "All these ceremonies are carried out at the wedding location, typically at or near the bride's home.", "These additional rituals include the participation of the brothers, sisters, maternal/paternal relatives, guardians, or friends of the bride.", "In some parts of India, such as Gujarat and Northern India, a \"laja homa\" ritual called \"mangal pher\u0101\" is performed where the couple make four circles around holy fire.", "It follows \"hasta milap\" (meeting of hands of the couple), but precedes \"saptapadi\".", "The first three circles is led by the groom, and it represents three of four goals of life considered important in Hindu life \u2013 \"Dharma\", \"Artha\", \"Kama\".", "The fourth circle is led by bride and it represents the fourth goal of life \u2013 \"Moksha\"." ], [ "Weddings in India", "Weddings in India\n\nWeddings in India vary regionally, the religion and per personal preferences of the bride and groom.", "They are festive occasions in India, and in most cases celebrated with extensive decorations, colors, music, dance, costumes and rituals that depend on the religion of the bride and the groom, as well as their preferences.", "India celebrates about 10 million weddings per year, of which about 80% are Hindu weddings.", "While there are many festival-related rituals in Hinduism, \"vivaha\" (wedding) is the most extensive personal ritual an adult Hindu undertakes in his or her life.", "Typical Hindu families spend significant effort and financial resources to prepare and celebrate weddings.", "The rituals and process of a Hindu wedding vary depending on region of India, local adaptations, resources of the family and preferences of the bride and the groom.", "Nevertheless, there are a few key rituals common in Hindu weddings \u2013 \"Kanyadaan\", \"Panigrahana\", and \"Saptapadi\"; these are respectively, gifting away of daughter by the father, voluntarily holding hand near the fire to signify impending union, and taking seven steps before fire with each step including a set of mutual vows.", "After the seventh step and vows of \"Saptapadi\", the couple is legally husband and wife." ], [ "Vivaah", "This aspect of the ceremony and the one that follows, namely Saptapadi (seven steps)- constitute the most important part, in as much as it legalises the marriage according to Hindu custom and tradition.", "These two aspects of the marriage ceremony establish an indissoluble matrimonial bond between the couple.", "In the first three rounds the bride leads the Groom as they circle together around the sacred fire.", "In the fourth (last) round, the Groom leads the bride around the sacred fire.", "In each round around the sacred fire, an appropriate mantra is recited which expresses noble sentiments in relation to their future matrimonial life.", "Each round culminates in both the bride and the bridegroom placing offerings or ahutis of fried rice in the sacred fire.", "The Hindu religion emphasises enjoyment of life as well as the discharging of family, social and national responsibilities.", "During the first three rounds, God's blessings and help are sought; loyalty to each other is emphasised and; a promise to keep in mind the well-being and care of the future children is made." ] ], "gold": "The mangal pher\u0101 ritual is an auspicious and important part of the Hindu wedding ceremony where the couple make three or four circles around holy fire. The ceremony that follows is Saptapadi which consist in taking seven steps before fire with each step including a set of mutual vows. These two aspects of the marriage ceremony establish an indissoluble matrimonial bond between the couple.", "prediction 1": "In the Hindu wedding ceremony, the bridegroom leads the bride around the fire at least three times, and every time she leads the groom around the fire, the bridegroom leads the bride. The number of times that the bride and groom walk around the fire depends on the number of rounds that are performed at the wedding.", "prediction 2": "In the Hindu wedding ceremony, the bride and groom walk around the fire four times. In the first three rounds, the bride leads the Groom as they circle together around the sacred fire. In the fourth (last) round, the Groom leads the bride around the sacred fire.", "prediction 3": "The bride and bridegroom walk around the fire approximately three times. The bride leads the groom in the first three rounds of the ceremony, and in the fourth round, the groom leads the bride.", "prediction 4": "There are several different ways that the bride and groom walk around the fire during a Hindu wedding ceremony. The first three rounds are led by the bride while the fourth round is led by the groom. The fifth and last round is when the couple make four circles around holy fire.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 31, "end": 99 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 100, "end": 183 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 184, "end": 316 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the Hindu wedding ceremony, the first three rounds the bride leads the Groom as they circle together around the sacred fire, the fourth (last) round, the Groom leads the bride around the sacred fire, during the mangal pher\u0101 ritual. The ceremony that follows is Saptapadi which consist in taking seven steps before fire with each step including a set of mutual vows. These two aspects of the marriage ceremony establish an indissoluble matrimonial bond between the couple." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sings i think it's going to rain today?", "passages": [ [ "Randy Newman (album)", "Randy Newman (album)\n\nRandy Newman is the eponymous debut studio album by American singer-songwriter Randy Newman, released in 1968 by Reprise Records.", "Unlike his later albums, which featured Newman and his piano backed by guitar, bass guitar and drums, \"Randy Newman\" was highly orchestral and aimed to blend the orchestra with Newman's voice and piano.", "\"Randy Newman\" never dented the \"Billboard\" Top 200 and was not received as well by critics as Newman's acclaimed 1970s albums \"12 Songs\", \"Sail Away\" and \"Good Old Boys\"; indeed, according to Ken Tucker, the album sold so poorly that Warner offered buyers the opportunity to trade the album for another in the company's catalog.", "\"Randy Newman\" was out of print for over 15 years until it was re-released on CD in 1995.", "It was remastered by Lee Herschberg.", "The album is sometimes referred to as Randy Newman Creates Something New Under The Sun, which was written on the reverse of the album sleeve.", "In 2017, \"Randy Newman\" was ranked the 97th greatest album of the 1960s by \"Pitchfork\".", "Newman later commented on the lack of influence from rock and roll on the album.", "\"It's like I'd never heard The Rolling Stones.", "I thought you could move things along just with the orchestra, that it was somehow cheating to use drums." ], [ "I Think It's Going to Rain Today", "I Think It's Going to Rain Today\n\n\"I Think It's Going to Rain Today\" (or \"I Think It's Gonna Rain Today\") is a song by Randy Newman.", "It appears on his 1968 debut album \"Randy Newman\", in \"The Randy Newman Songbook Vol. 1\" (2003), and in Newman's official and bootleg live albums.", "It is one of his most covered songs.", "Despite the many covers, it charted only twice, once in Canada in 1970 for Tom Northcott and in the UK in 1980 for UB40.", "The UB40 single was a double A-side with \"My Way of Thinking\", which was the first-named track and received most of the radio airplay.", "However, the German single (which appeared later) had \"I Think It's Going to Rain Today\" as the A-side.", "Newman said in 2017 that he signed away the publishing rights on his first album, doesn't see any money from people doing covers of those songs and advised people getting into the business to never sign away their publishing.", "The song was covered numerous times by a variety of artists, especially during the late 1960s and early 1970s." ], [ "Higher Ground Hurricane Relief Benefit Concert (album)", "Higher Ground Hurricane Relief Benefit Concert (album)\n\nHigher Ground Hurricane Relief Benefit Concert", "[LIVE] is an album with 77 minutes of highlights, from the roughly five-hour long \"Higher Ground Hurricane Relief Benefit Concert\" that took place in the Rose Hall Theatre at Jazz at Lincoln Center on September 17, 2005.", "All net profits from the sale of the CD will be donated to the \"Higher Ground Relief Fund\" established by Jazz at Lincoln Center and administered through the Baton Rouge Area Foundation to benefit the musicians, music industry related enterprises and other individuals and entities from the areas in Greater New Orleans who were impacted by Hurricane Katrina and to provide other general hurricane relief." ] ], "gold": "\"I Think It's Going to Rain Today\", or \"I Think It's Gonna Rain Today\", is a song by American singer-songwriter Randy Newman. It appears on Julius La Rosa's 1966 album \"You're Gonna Hear from Me\", Eric Burdon's 1967 album \"Eric Is Here\" and on Newman's 1968 debut album \"Randy Newman\". The song has also been covered by Norah Jones, Tom Northott, UB40 and Dusty Springfield. Additionally, Nina Simone's version of the song's first verse was the opening theme for the BBC One series Broken. Simone's version also appears in the \"Spies Like Us\" episode from season two of the TV series Scandal.", "prediction 1": "\"I Think It's Going to Rain Today\" is a song by American singer-songwriter Randy Newman. It appears on his 1968 debut album, \"Randy Newman\", in The Randy Newman Songbook Vol. 1 (2003), and in Newman's official and bootleg live albums. The song was covered numerous times by a variety of artists, especially during the late 1960s and early 1970s.", "prediction 2": "I Think It's Going to Rain Today is a song by American singer-songwriter Randy Newman. It appears on his 1968 debut album Randy Newman, in The Randy Newman Songbook Vol. 1 (2003), and in Newman's official and bootleg live albums. It is one of his most covered songs. There are numerous artists who sing I Think It's Going to Rain Today. Tom Northcott sings the song while UB40 sings it.", "prediction 3": "\"I Think It's Going to Rain Today\" is a song by American singer-songwriter Randy Newman. It appears on his 1968 debut album \"Randy Newman\", in \"The Randy Newman Songbook Vol. 1\" (2003) and in Newman's official and bootleg live albums. Despite the many covers, it charted only twice. Tom Northcott sang the original and the German single had \"I Think It's Gonna Rain Today\" as the A-side.", "prediction 4": "\"I Think It's Going to Rain Today\" is a song by American singer-songwriter Randy Newman. It appears on his 1968 debut album, Randy Newman, in \"The Randy Newman Songbook Vol. 1\" (2003), and in Newman's official and bootleg live albums. It is one of his most covered songs. The song was covered numerous times by a variety of artists, especially during the late 1960s and early 1970s.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 296, "end": 345 } ], "missing-info": [], "corrected-prediction": "\"I Think It's Going to Rain Today\" is a song by American singer-songwriter Randy Newman. It appears on his 1968 debut album, \"Randy Newman\", in The Randy Newman Songbook Vol. 1 (2003), and in Newman's official and bootleg live albums. The song was covered numerous times by a variety of artists." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the mayor in horton hears a who?", "passages": [ [ "Horton Hears a Who! (film)", "Horton Hears a Who!", "(film)\n\n", "Horton Hears a Who!", "(also known as Dr. Seuss' Horton Hears a Who!) is a 2008 American computer animated adventure comedy film based on the book of the same name by Dr. Seuss, produced by Blue Sky Studios and distributed by 20th Century Fox.", "Directed by Jimmy Hayward and Steve Martino in their directorial debuts, the film's screenplay was written by Cinco Paul and Ken Daurio, and features the voices of Jim Carrey and Steve Carell as Horton the Elephant and the Mayor of Whoville, respectively, alongside Carol Burnett, Will Arnett, Seth Rogen, Isla Fisher, and Amy Poehler.", "John Powell composed the film's music.", "The film was released on March 14, 2008, and grossed $297 million on a budget of $85 million.", "\"Horton Hears a Who!\" was the third Dr. Seuss feature film adaptation, the first adaptation to be fully animated, and the second Dr. Seuss film starring Jim Carrey after \"How the Grinch Stole Christmas\" (2000).", "A dust speck is dislodged from its obscure place and sent adrift through the Jungle of Nool.", "At the same time, Horton the Elephant, the jungle's eccentric nature teacher, takes a dip in the pool." ] ], "gold": "Horton Hears a Who! is a 2008 American computer animated adventure comedy film based on the book of the same name by Dr. Seuss. It features the voices of Jim Carrey and Steve Carell as Horton the Elephant and Mayor Ned McDodd, respectively.", "prediction 1": "Horton Hears a Who! is a 2008 American computer-animated comedy film based on the book of the same name by Dr. Seuss, produced by Blue Sky Studios and distributed by 20th Century Fox. It features the voices of Jim Carrey and Steve Carell as Horton the Elephant and the Mayor of Whoville, respectively, alongside Carol Burnett, Will Arnett, Seth Rogen, Isla Fisher, and Amy Poehler.", "prediction 2": "Horton Hears a Who! is a 2008 American computer animated adventure comedy film based on the book of the same name by Dr. Seuss, produced by Blue Sky Studios and distributed by 20th Century Fox. The film features the voices of Jim Carrey and Steve Carell as Horton the Elephant and the Mayor of Whoville, respectively, alongside Carol Burnett, Will Arnett, Seth Rogen, Isla Fisher, and Amy Poehler.", "prediction 3": "Horton Hears a Who! is a 2008 American computer animated adventure comedy film based on the book of the same name by Dr. Seuss. The film features the voices of Jim Carrey and Steve Carell as Horton the Elephant and the Mayor of Whoville, respectively, alongside Carol Burnett, Will Arnett, Seth Rogen, Isla Fisher, and Amy Poehler.", "prediction 4": "Horton Hears a Who! is a 2008 American computer-animated comedy film based on the book of the same name by Dr. Seuss, produced by Blue Sky Studios and distributed by 20th Century Fox. Jim Carrey and Steve Carell are the voices of Horton the Elephant and the Mayor of Whoville, respectively. Carol Burnett, Will Arnett, Seth Rogen, Isla Fisher, and Amy Poehler are the voices of the Mayor of Whoville.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 381 } ], "missing-info": [], "corrected-prediction": "Horton Hears a Who! is a 2008 American computer-animated comedy film based on the book of the same name by Dr. Seuss. It features the voices of Jim Carrey and Steve Carell as Horton the Elephant and the Mayor of Whoville, respectively." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where will the olympics take place in 2020?", "passages": [ [ "2020 Winter Youth Olympics", "2020 Winter Youth Olympics\n\nThe 2020 Winter Youth Olympic Games (; ; ; ), officially known as the III Winter Youth Olympic Games, and commonly known as Lausanne 2020 will be the third edition of the Winter Youth Olympics; a major international multi-sport event and cultural festival for teenagers to be held in Lausanne, Switzerland, the home of the International Olympic Committee between 9 and 22 January 2020.", "Bids were due by 28 November 2013, the candidates cites were selected on 5 December 2014 and Lausanne was elected host city on 31 July 2015.", "The Youth Olympic Games will feature 8 sports and 16 disciplines.", "Ski mountaineering and women's Nordic combined will feature for the first time in an Olympic event.", "A mixed-NOC 3-on-3 ice hockey tournament and a women's doubles event in luge will also be contested for the first time." ], [ "2020 Summer Olympics", "2020 Summer Olympics\n\nThe 2020 Summer Olympics, officially known as the and commonly known as Tokyo 2020, is a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020.", "Tokyo was selected as the host city during the 125th IOC Session in Buenos Aires on 7 September 2013.", "These Games will mark the return of the Summer Olympics to Tokyo for the first time since 1964, and the fourth Olympics overall to be held in Japan, following the 1972 Winter Olympics in Sapporo and the 1998 Winter Olympics in Nagano.", "They will be the second of three consecutive Olympic Games to be held in East Asia, following the 2018 Winter Olympics in Pyeongchang, South Korea, and preceding the 2022 Winter Olympics in Beijing, China.", "These Games will see the introduction of additional disciplines within several of the Summer Olympics sports, including 3x3 basketball, freestyle BMX and Madison cycling, as well as further mixed events.", "Under new IOC policies that allow sports to be added to the Games' programme to augment the permanent \"core\" Olympic events, these Games will see karate, sport climbing, surfing and skateboarding make their Olympic debuts, and the return of baseball and softball (which were removed from the summer programme after 2008).", "Tokyo, Istanbul, and Madrid were the three candidate cities." ], [ "Ostravar Ar\u00e9na", "Ostravar Ar\u00e9na\n\nOSTRAVAR Ar\u00e9na (previously \u010cEZ Ar\u00e9na, due to sponsorship reasons) is an indoor arena used mainly for ice hockey matches, in V\u00edtkovice, Ostrava, Czech Republic.", "It opened in 1986 and underwent a \u20ac23.3 million renovation in 2003\u20132004.", "The capacity of the arena is 9,779, plus 16 skyboxes, making it the fourth-largest hockey venue in the Czech Republic.", "The rink can be converted into seating for concerts, increasing the capacity to 12,500.", "It is the home of ice hockey club HC V\u00edtkovice.", "In November 2003, the arena was given the name \u010cEZ Ar\u00e9na, from July 2015 its name was Ostrava Ar\u00e9na.", "It was renamed to OSTRAVAR Ar\u00e9na in 2016.", "In May 2011, Ostrava's Deputy Mayor for Investment, Ji\u0159\u00ed Srba, announced a plan to invest 10 million CZK in the stadium in the same year.", "The arena has hosted numerous international sporting events in its history.", "In ice hockey, it was the main venue for the 1994 World Junior Championships and the secondary venue for the 2004 and 2015 Men's World Ice Hockey Championships with Prague's O2 Arena.", "In 2020, it will again be the main venue for the World Junior Championships, co-hosting with T\u0159inec's Werk Arena." ], [ "Komazawa Olympic Park Stadium", "Komazawa Olympic Park Stadium\n\nKomazawa Olympic Park Stadium (\u99d2\u6ca2\u30aa\u30ea\u30f3\u30d4\u30c3\u30af\u516c\u5712\u7dcf\u5408\u904b\u52d5\u5834\u9678\u4e0a\u7af6\u6280\u5834) is a multi-purpose stadium in Setagaya, Tokyo, Japan.", "The stadium is an integral feature of Komazawa Olympic Park and is currently used mostly for football matches (although mostly amateur and women's matches) as well as American football games.", "The stadium holds 20,010 people.", "The stadium hosted some of the football preliminaries for the 1964 Summer Olympics.", "Some J. League Division 1, J. League Division 2, J. League Cup, and Emperor's Cup matches, (including the Finals on 1965 and 1966), had also been played at the stadium.", "12 minutes walk from Komazawa-daigaku Station (T\u014dky\u016b Den-en-toshi Line)" ] ], "gold": "The 2020 Winter Youth Olympics took place in Lausanne, Switzerland (opening ceremony in Vaudoise Arena), between 9 and 22 January 2020. Whereas the 2020 Summer Olympics, known as Tokyo 2020, were held from 23 July to 8 August 2021 in Tokyo, Japan. The opening and closing ceremonies took place at the New National Stadium, as well as the track and field athletics events at the 2020 Summer Paralympics in 2021.", "prediction 1": "The 2020 Winter Youth Olympic Games, officially known as the III Winter Youth Olympic Games, will be held in Lausanne, Switzerland, the home of the International Olympic Committee, between 9 and 22 January 2020. The 2020 Summer Olympics are a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020. In 2020, the Games will be held at the Komazawa Olympic Park Stadium in Tokyo, Japan.", "prediction 2": "The 2020 Winter Youth Olympic Games, officially known as the III Winter Youth Olympic Games, and commonly known as Lausanne 2020 will be the third edition of the Winter Youth Olympic Games. The 2020 Summer Olympics, officially known as the and commonly known as Tokyo 2020, is a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020 in Tokyo, Japan. In the USA, the 2020 Winter Youth Olympics will take place at the Olympic Park in Tokyo.", "prediction 3": "The 2020 Winter Youth Olympic Games, officially known as the III Winter Youth Olympic Games, and commonly known as Lausanne 2020, will be the third edition of the Winter Youth Olympics. These Games will feature 8 sports and 16 disciplines, including ski mountaineering and women's Nordic combined, which will be contested for the first time in an Olympic event. The 2020 Summer Olympics, officially known as the and commonly known as Tokyo 2020, is a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020. Tokyo was selected as the host city during the 125th IOC Session in Buenos Aires on 7 September 2013. These Games will mark the return of the Summer Olympics to Tokyo for the first time since 1964, and the fourth Olympics overall to be held in Japan, following the 1972 Winter Olympics in Sapporo and the 1998 Winter Olympics in Nagano.", "prediction 4": "The 2020 Winter Youth Olympic Games will be the third edition of the Winter Youth Olympic Games and a major international multi-sport event and cultural festival for teenagers to be held in Lausanne, Switzerland, the home of the International Olympic Committee between 9 and 22 January 2020. The 2020 Summer Olympics, officially known as the and commonly known as Tokyo 2020, is a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020. Tokyo was selected as the host city during the 125th IOC Session in Buenos Aires on 7 September 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 435 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2020 Winter Youth Olympic Games, officially known as the III Winter Youth Olympic Games, will be held in Lausanne between 9 and 22 January 2020. Whereas the 2020 Summer Olympics, known as Tokyo 2020, were held from 23 July to 8 August 2021 in Tokyo, Japan." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the name of the casino in evansville indiana?", "passages": [ [ "Tropicana Evansville", "Tropicana Evansville\n\nTropicana Evansville is a casino hotel in downtown Evansville, Indiana, owned by Gaming and Leisure Properties and operated by Eldorado Resorts.", "Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino.", "In addition, as of 2017, it also became the state's first land based casino as well.", "The main entertainment facility consists of a casino, a 250-room hotel, a 1,660 vehicle parking garage, and pavilion housing pre-boarding facilities, retail shops, restaurants, and lounge area.", "A new entertainment district with a 100-room boutique hotel and additional restaurants opened in late 2006.", "In 2005, the casino generated $137 million in revenue and $41 million in profits.", "In 2017, the casino moved from its original riverboat into a land-based facility.", "The actual casino boat, called \"\"City of Evansville\"\", was the state of Indiana's first gaming riverboat under legislation passed in 1993.", "It opened to the public in 1995.", "Built by Jeffboat in Jeffersonville, Indiana, the boat is a replica of the historic \"Robert E. Lee\" racing sidewheel steamboat crafted nearly 130 years ago.", "Jeffboat deployed 200 workers and spent over twelve months constructing the vessel." ] ], "gold": "Tropicana Evansville is a casino hotel and entertainment complex located in the northwest corner of downtown Evansville, Indiana. Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino. As of 2017, it also became the state's first land based casino.", "prediction 1": "Tropicana Evansville is a casino hotel in downtown Evansville, Indiana, owned by Gaming and Leisure Properties and operated by Eldorado Resorts. Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino. As of 2017, it also became the state's first land based casino as well.", "prediction 2": "Casino Aztar, the first casino in Indiana, was opened by Aztar Corporation in 1995 as the state's first casino. As of 2017, the casino became the state's first land based casino as well.", "prediction 3": "Tropicana Evansville is a casino hotel in downtown Evansville, Indiana, owned by Gaming and Leisure Properties and operated by Eldorado Resorts. Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino. In addition, as of 2017, it also became the state's first land based casino as well.", "prediction 4": "Tropicana Evansville is a casino hotel in downtown Evansville, Indiana, owned by Gaming and Leisure Properties and operated by Eldorado Resorts. Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino. As of 2017, it also became the state's first land based casino.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 144 } ], "missing-info": [], "corrected-prediction": "Tropicana Evansville is a casino hotel in downtown Evansville, Indiana. Originally named Casino Aztar, it was opened by Aztar Corporation in 1995 as the state's first casino. As of 2017, it also became the state's first land based casino as well." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who elect the president of the united states?", "passages": [ [ "United States presidential election", "United States presidential election\n\nThe election of President and Vice President of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors.", "These electors then in turn cast direct votes, known as electoral votes, for President, and for Vice President.", "The candidate who receives an absolute majority of electoral votes (at least 270 out of a total of 538, since the Twenty-Third Amendment granting voting rights to citizens of Washington, D.C.) is then elected to that office.", "If no candidate receives an absolute majority of the votes for President, the House of Representatives chooses the winner; if no one receives an absolute majority of the votes for Vice President, then the Senate chooses the winner.", "The Electoral College and its procedure are established in the U.S. Constitution by Article II, Section 1, Clauses 2 and 4; and the Twelfth Amendment (which replaced Clause 3 after its ratification in 1804)." ], [ "President of the United States", "Additionally, the Twenty-third Amendment provides that the District of Columbia is entitled to the number it would have if it were a state, but in no case more than that of the least populous state.", "Currently, all states and D.C. select their electors based on a popular election held on Election Day.", "In all but two states, the party whose presidential-vice presidential ticket receives a plurality of popular votes in the state has its entire slate of elector nominees chosen as the state's electors.", "Maine and Nebraska deviate from this practice, awarding two electors to the statewide winner and one to the winner in each congressional district.", "On the first Monday after the second Wednesday in December, about six weeks after the election, the electors convene in their respective state capitals (and in Washington D.C.) to vote for president and, on a separate ballot, for vice president.", "They typically vote for the candidates of the party that nominated them.", "While there is no constitutional mandate or federal law requiring them to do so, the District of Columbia and 30 states have laws requiring that their electors vote for the candidates to whom they are pledged.", "Following the vote, each state then sends a certified record of their electoral votes to Congress.", "The votes of the electors are opened and counted during a joint session of Congress, held in the first week of January." ] ], "gold": "The election of the president of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the fifty U.S. states or in Washington, D.C. cast ballots not directly for this office but instead for members of the Electoral College. These members of the Electoral College then in turn cast direct votes, known as electoral votes, for president of the United States. In 48 of the 50 states in the U.S., state laws mandate the winner of the plurality of its statewide popular vote shall receive all of that state's electoral votes. The candidate who then receives an absolute majority of the electoral votes, at least 270 out of a total of 538, is elected president of the United States. If no candidate receives an absolute majority of the votes for president, the House of Representatives of the United States chooses the winner. ", "prediction 1": "The election of President and Vice President of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors. These electors in turn cast direct votes, known as electoral votes, for President, and for Vice President. If no candidate receives an absolute majority of electoral votes for President, the House of Representatives chooses the winner; if no one receives an absolute majority of electoral votes for Vice President, then the Senate chooses the winner.", "prediction 2": "The election of president and vice president of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors. These electors then in turn cast direct votes, known as electoral votes, for President, and for Vice President. The candidate who receives an absolute majority of electoral votes (at least 270 out of a total of 538, since the Twenty-Third Amendment granting voting rights to citizens of Washington, D.C.) is then elected to that office.", "prediction 3": "The election of president and vice president of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors. These electors then in turn cast direct votes, known as electoral votes, for President, and for Vice President. If no candidate receives an absolute majority of electoral votes for President, the House of Representatives chooses the winner; if no one receives an absolute majority of electoral votes, then the Senate chooses the winner.", "prediction 4": "The election of President and Vice President of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors. These electors then in turn cast direct votes, known as electoral votes, for President, and for Vice President. If no candidate receives an absolute majority of electoral votes for President, the House of Representatives chooses the winner.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The election of President and Vice President of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the 50 U.S. states or in Washington, D.C. cast ballots not directly for those offices, but instead for members of the U.S. Electoral College, known as electors. These electors in turn cast direct votes, known as electoral votes, for President, and for Vice President. The candidate who receives an absolute majority of electoral votes (at least 270 out of a total of 538, is then elected to that office. If no candidate receives an absolute majority of electoral votes for President, the House of Representatives chooses the winner; if no one receives an absolute majority of electoral votes for Vice President, then the Senate chooses the winner." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most seats in house of representative?", "passages": [ [ "United States House of Representatives", "In the mid-1970s, there were major reforms of the House, strengthening the power of sub-committees at the expense of committee chairs and allowing party leaders to nominate committee chairs.", "These actions were taken to undermine the seniority system, and to reduce the ability of a small number of senior members to obstruct legislation they did not favor.", "There was also a shift from the 1990s to greater control of the legislative program by the majority party; the power of party leaders (especially the Speaker) grew considerably.", "The Republicans took control of the House in 1995, under the leadership of Speaker Newt Gingrich.", "Gingrich attempted to pass a major legislative program, the Contract with America, on which the House Republicans had been elected, and made major reforms of the House, notably reducing the tenure of committee chairs to three two-year terms.", "Many elements of the Contract did not pass Congress, were vetoed by President Bill Clinton, or were substantially altered in negotiations with Clinton.", "However, after Republicans held control in the 1996 election, Clinton and the Gingrich-led House agreed on the first balanced federal budget in decades, along with a substantial tax cut.", "The Republicans held on to the House until 2006, when the Democrats won control and Nancy Pelosi was subsequently elected by the House as the first female Speaker." ], [ "Australian House of Representatives", "From the beginning of Federation until 1918, first-past-the-post voting was used in order to elect members of the House of Representatives but since the 1918 Swan by-election which Labor unexpectedly won with the largest primary vote due to vote splitting amongst the conservative parties, the Nationalist Party of Australia government, a predecessor of the modern-day Liberal Party of Australia, changed the lower house voting system to voting system to Instant-runoff voting, which in Australia is known as full preferential voting, as of the subsequent 1919 election.", "This system has remained in place ever since, allowing the Coalition parties to safely contest the same seats.", "Full-preference preferential voting re-elected the Bob Hawke government at the 1990 election, the first time in federal history that Labor had obtained a net benefit from preferential voting.", "The main elements of the operation of preferential voting for single-member House of Representatives divisions are as follows:\n\n\nFollowing the full allocation of preferences, it is possible to derive a two-party-preferred figure, where the votes have been allocated between the two main candidates in the election.", "In Australia, this is usually between the candidates from the Coalition parties and the Australian Labor Party.", "Under the Constitution, the Governor-General has the power to appoint and dismiss \"Ministers of State\" who administer government departments." ], [ "Elections in Japan", "The \"House of Representatives\" (\"Sh\u016bgi-in\") has 475 members, elected for a four-year term, 295 members in single-seat constituencies and 180 members by proportional representation in 11 block districts.", "In this system, each voter votes twice, once for a candidate in the local constituency, and once for a party, each of which has a list of candidates for each block district.", "The local constituencies are decided by plurality, and the block seats are then handed out to party lists proportionally (by the D'Hondt method) to their share of the vote.", "Often the parties assign the block list spots to single-seat candidates, so that unsuccessful single-seat candidates have a chance to be elected in the proportional block.", "Parties may also place dual district and block candidates on the same list rank; in that case, the Sekihairitsu system determines the order of candidates.", "General elections of members of the House of Representatives (\"Sh\u016bgiin giin s\u014d-senkyo\") are usually held before the end of a four-year term as the chamber may be dissolved by the cabinet (via the Emperor).", "Most prime ministers use that option.", "The only exception in post-war history was the \"Lockheed election\" of 1976 in which the Liberal Democratic Party lost its seat majority for the first time." ] ], "gold": "In the United States of America, the Democratic party holds the most seats in the House of Representatives. In Japan the Liberal Democratic Party, has the most, and in Australia, the Australian Labor Party.", "prediction 1": "The United States House of Representatives has the most seats in the United States House of Representatives, with 475 members, elected for a four-year term, 295 members in single seat constituencies, and 180 members by proportional representation in 11 block districts. In Japan, the House of Representatives has the most seats, with 270 in single-seat constituencies and 210 in proportional representation. In the mid-1970s, there were major reforms of the House, strengthening the power of sub-committeeees at the expense of committee chairs and allowing party leaders to nominate committee chairs.", "prediction 2": "In the United States, the House of Representatives has 475 members, elected for a four-year term. In Australia, the House of Representatives has 295 members in single-seat constituencies and 180 members by proportional representation in 11 block districts. There were also many changes to the House in the mid-1970s to increase the power of subcommittees and allow party leaders to nominate committee chairs.", "prediction 3": "The United States House of Representatives is a bicameral chamber composed of 535 members with 475 members elected for a four-year term. Currently, the United States holds the most seats in the House of Representatives, with 225 in single-seat constituencies and 180 in proportional representation.", "prediction 4": "The United States House of Representatives is the federal legislative body that holds the majority of the U.S. Congress. In 2017, the Republican majority held a majority of the seats in the House of Representative in the United States. The Liberal Democrat Party has the most seats in the House of Representatives in Japan.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 4, "end": 42 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 109, "end": 126 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 309, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 269 }, { "error type": "Unverifiable", "explanation": "", "start": 334, "end": 407 }, { "error type": "Irrelevant", "explanation": "", "start": 408, "end": 600 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Democrats has the most seats in the United States House of Representatives. In Japan, the Liberal Democratic Party holds seat majority. " }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "When did the first video recorder come out?", "passages": [ [ "Video tape recorder", "Since BCE and AMPEX were working together on the video recorder the new head designed was shared with them, and AMPEX used it in their recorder.", "In 1955 BCE demonstrated a broadcast quality color recorder that operated at 100 inches per second and CBS ordered three of them.", "Many other fixed-head recording systems were tried but all required an impractically high tape speed.", "It became clear that practical video recording technology depended on finding some way of recording the wide-bandwidth video signal without the high tape speed required by linear-scan machines.", "In 1953 Dr. Norikazu Sawazaki developed a prototype helical scan video tape recorder.", "Another solution was transverse-scan technology, developed by Ampex around 1954, in which the recording heads are mounted on a spinning drum and record tracks in the transverse direction, across the tape.", "By recording on the full width of the tape rather than just a narrow track down the center, this technique achieved a much higher density of data per linear centimeter of tape, allowing a lower tape speed of 15 inches per second to be used.", "The Ampex VRX-1000 became the world's first commercially successful videotape recorder in 1956.", "It uses the 2\" quadruplex format, using two-inch (5.1\u00a0cm) tape." ], [ "Video tape recorder", "Because of its price, the Ampex VRX-1000 could be afforded only by the television networks and the largest individual stations.", "Ampex's quadruplex magnetic tape video recording system has certain limitations, such as the lack of clean pause, or still-frame, capability, because when tape motion is stopped, only a single segment of the picture recording is present at the playback heads (only 16 lines of the picture in each segment), so it can only reproduce recognizable pictures when the tape is playing at normal speed.)", "But in spite of its drawbacks it remained the broadcasting studio standard until about 1980.", "The helical scan system overcame this limitation.", "In 1959 Toshiba released the first commercial helical-scan video tape recorder.", "In 1963, Philips introduced its EL3400 1\" helical scan recorder (aimed at the business and domestic user), and Sony marketed the 2\" PV-100, its first open-reel VTR intended for business, medical, airline, and educational use.", "The Telcan, produced by the Nottingham Electronic Valve Company and demonstrated on June 24, 1963, was the first home video recorder.", "It could be bought as a unit or in kit form for \u00a360." ], [ "Videocassette recorder", "Videocassette recorder\n\nA videocassette recorder, VCR, or video recorder is an electromechanical device that records analog audio and analog video from broadcast television or other source on a removable, magnetic tape videocassette, and can play back the recording.", "Use of a VCR to record a television program to play back at a more convenient time is commonly referred to as \"timeshifting\".", "VCRs can also play back prerecorded tapes.", "In the 1980s and 1990s, prerecorded videotapes were widely available for purchase and rental, and blank tapes were sold to make recordings.", "Most domestic VCRs are equipped with a television broadcast receiver (tuner) for TV reception, and a programmable clock (timer) for unattended recording of a television channel from a start time to an end time specified by the user.", "These features began as simple mechanical counter-based single-event timers, but were later replaced by more flexible multiple-event digital clock timers.", "In later models the multiple timer events could be programmed through a menu interface displayed on the playback TV screen (\"on-screen display\" or OSD).", "This feature allowed several programs to be recorded at different times without further user intervention, and became a major selling point." ] ], "gold": "A videocassette recorder (VCR) or video recorder is an electromechanical device that records analog audio and analog video. The prototype was developed in 1953 by Dr. Norikazu Sawazaki but the the world's first commercially successful videotape recorder was the Ampex VRX-1000, in 1956. In 1963, the first home video recorder, Telcan, was produced by the Nottingham Electronic Valve Company. Digital video recorders (ReplayTV and TiVo) were first launched in 1999, at the Consumer Electronics Show in Las Vegas, Nevada.", "prediction 1": "A videocassette recorder, VCR, or video recorder is an electromechanical device that records analog audio and analog video from broadcast television or other source on a removable, magnetic tape videocassette, and can play back the recording. The first commercially successful videotape recorders were made in 1953 by Ampex and in 1956 by Toshiba. The first home video recorders were made by Nottingham Electronic Valve Company and were demonstrated on June 24, 1963.", "prediction 2": "A videocassette recorder, VCR, or video recorder is an electromechanical device that records analog audio and analog video from broadcast television or other source on a removable, magnetic tape videocassette, and can play back the recording. The first video recorder came out on June 24, 1963. The first commercially successful videotape recorder came out on March 27, 1955.", "prediction 3": "The first video recorder came out on a videocassette on June 24, 1963. The videocassette recorder, VCR, or video recorder is an electromechanical device that records analog audio and analog video from broadcast television or other source on a removable, magnetic tape videocassette, and can play back the recording. The first commercial video recorder came out on September 15, 1956.", "prediction 4": "The first video recorder came out on videocassette in 1955. It was the first commercially available video recorder in 1956. In 1959 Toshiba released the first commercially available videocassette recorder. The Telcan, produced by the Nottingham Electronic Valve Company and demonstrated on June 24, 1963, was the first home video recorder.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 242 } ], "missing-info": [], "corrected-prediction": "A videocassette recorder, VCR, or video recorder is an electromechanical device that records analog audio and analog video. The first commercially successful videotape recorders were made in 1953 by Ampex and in 1956 by Toshiba. The first home video recorders were made by Nottingham Electronic Valve Company and were demonstrated on June 24, 1963." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who is the current president of france today?", "passages": [ [ "President of France", "President of France\n\nThe President of the French Republic (, ) is the executive head of state of France in the French Fifth Republic.", "In French terms, the presidency is the supreme magistracy of the country.", "The powers, functions and duties of prior presidential offices, and their relation with the Prime Minister and Cabinet, have over time differed with the various French constitutions since 1848 (the final end of the French Monarchy).", "The President of the French Republic is also the \"ex officio\" Co-Prince of Andorra, Grand Master of the L\u00e9gion d'honneur and the National Order of Merit, and honorary proto-canon of the Basilica of St. John Lateran in Rome.", "The current President of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017.", "The presidency of France was first publicly proposed during the July Revolution of 1830, when it was offered to the Marquis de Lafayette, who demurred in favor of Prince Louis Phillipe.", "18 years later, during the opening phases of the 2nd Republic, the title was created for a popularly elected Head of state, the first of whom was Louis-Napol\u00e9on Bonaparte, nephew of the Emperor.", "Bonaparte served until he staged an auto coup against the republic, proclaiming himself Emperor Napoleon III.", "Under the Third and Fourth Republic, which were parliamentary systems, the office of President of the Republic was a largely ceremonial and powerless one." ], [ "Fran\u00e7ois Hollande", "Fran\u00e7ois Hollande\n\nFran\u00e7ois G\u00e9rard Georges Nicolas Hollande (; born 12 August 1954) is a French politician who served as President of France and \"ex officio\" Co-Prince of Andorra from 2012 to 2017.", "He was previously the First Secretary of the Socialist Party from 1997 to 2008, Mayor of Tulle from 2001 to 2008, and President of the Corr\u00e8ze General Council from 2008 to 2012.", "Hollande also served in the National Assembly of France twice for the department of Corr\u00e8ze's 1st constituency from 1988 to 1993, and again from 1997 to 2012.", "Born in Rouen and raised in Neuilly-sur-Seine, Hollande began his political career as a special advisor to newly elected President Fran\u00e7ois Mitterrand, before serving as a staffer for Max Gallo, the government's spokesman.", "He became a member of the National Assembly in 1988 and was elected First Secretary of the Socialist Party in 1997.", "Following the 2004 regional elections won by the Socialists, Hollande was cited as a potential presidential candidate, but resigned as First Secretary and was immediately elected to replace Jean-Pierre Dupont as President of the General Council of Corr\u00e8ze in 2008." ] ], "gold": "The president of France, officially the President of the French Republic, is the head of state and head of executive of France, as well as the commander-in-chief of the French Armed Forces. Fran\u00e7ois G\u00e9rard Georges Nicolas Hollande is a French politician who served as President of France from 2012 to 2017. The current officeholder has been Emmanuel Macron since 14 May 2017. He was elected in the 2017 election.", "prediction 1": "The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017. The french presidency was first publicly proposed during the July Revolution of 1830, when it was offered to the Marquis de Lafayette, who demurred in favor of Prince Louis Phillipe.", "prediction 2": "The presidency of France was first publicly proposed during the July Revolution of 1830, when it was offered to the Marquis de Lafayette, who demurred in favor of Prince Louis Phillipe. The second French Republic created the office of president in 1830, and during the opening phases of the 2nd Republic, it was created for a popularly elected Head of state, the first of whom was Louis-Napol\u00e9on Bonaparte, nephew of the Emperor. In the Fifth Republic, the office was largely ceremonial and powerless one. The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017. He succeeded Hollande on May 2017.", "prediction 3": "The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017. The president of France was first publicly proposed during the July Revolution of 1830, when it was offered to the Marquis de Lafayette, who demurred in favor of Prince Louis Phillipe. The president of France was most recently Fran\u00e7ois Hollande.", "prediction 4": "The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017. The French Fifth Republic was founded in 1789 and included the establishment of the Constitution and the French Army. Fran\u00e7ois Hollande served as President of France from 2012 to 2017. The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 282 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " The President of the French Republic (, ) is the executive head of state of France in the French Fifth Republic. Fran\u00e7ois Hollande Fran\u00e7ois G\u00e9rard Georges Nicolas Hollande is a French politician who served as President of France and \"ex officio\" Co-Prince of Andorra from 2012 to 2017. The current president of France is Emmanuel Macron, who succeeded Fran\u00e7ois Hollande on 14 May 2017. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who owns the clift hotel in san francisco?", "passages": [ [ "The Clift Royal Sonesta Hotel", "Ian Schrager Hotels took over management in 1997, and the hotel became simply Clift.", "Schrager bought the hotel outright in 1999, for $80 million.", "Soon after, he oversaw a $50 million complete renovation, which involved the restoration of the iconic Redwood Room, and the gutting and redesign of much of the rest of the hotel, by noted designer Philippe Starck.", "The hotel reopened on August 3, 2001.", "Starck's modern lobby featured his trademark eclectic furniture collection, including chairs from Ray and Charles Eames, furniture by Salvador Dali, and a surreal stool by Roberto Matta (inspired by Ren\u00e9 Margritte).", "Sonesta Hotels assumed management of the hotel in May 2018 and it was renamed The Clift Royal Sonesta Hotel." ], [ "The Clift Royal Sonesta Hotel", "The Clift Royal Sonesta Hotel\n\nThe Clift Royal Sonesta Hotel is a historic hotel located two blocks from Union Square at the intersection of Geary Street and Taylor Street, San Francisco, California.", "In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited.", "The architect, a former student of Ecole de Beaux Arts, was George Applegarth of McDonald and Applegarth, who also designed the Palace of the Legion of Honor.", "The hotel opened on February 1, 1915, to serve crowds attending the Panama\u2013Pacific International Exposition.", "Advertised as the first hotel in San Francisco to be fire and earthquake proof, with its 1924 addition of 3 floors, it became the largest hotel in the state.", "The hotel's iconic Art Deco Redwood Room bar was added in 1933, paneled with wood from a single redwood tree.", "Canadian Four Seasons Hotels acquired an interest in the hotel in 1976, and began managing it as their first US property.", "Two years later, in 1978, they renamed it the Four Seasons Clift Hotel.", "On February 21, 1995, Four Seasons sold their interest in the property and it became The Clift, a Grand Heritage Hotel." ] ], "gold": "The Clift Royal Sonesta Hotel is a historic hotel located two blocks from Union Square at the intersection of Geary Street and Taylor Street, San Francisco, California. In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited. In 1976, Four Seasons Hotels acquired an interest in the hotel and began managing it as their first US property. Ian Schrager Hotels took over management in 1997, and it became simply Clift. In 1999 they bought the hotel outright for $80 million. Sonesta Hotels assumed management in May 2018 and it was renamed The Clift Royal Sonesta Hotel.", "prediction 1": "In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited. The architect, a former student of Ecole de Beaux Arts, was George Applegarth of McDonald and Applegarth, who also designed the Palace of the Legion of Honor. Four Seasons Hotels acquired an interest in the hotel in 1976, and began managing it as their first US property. Two years later, in 1978, they renamed it the Four Seasons Clift Hotel. On February 21, 1995, Four Seasons Hotels sold their interest in the property and it became The Clift, a Grand Heritage Hotel.", "prediction 2": "The Clift Hotel is a historic hotel located in San Francisco that was built in 1913 by Frederick C. Clift, an attorney from a large family in the Sierra foothills, on a lot the family had inherited. After a $50 million renovation, owner Ian Schrager Hotels took over management in 1997, and the hotel became simply Clift. On February 21, 1995, Four Seasons Hotels sold their interest in the property and it became The Clift, a Grand Heritage Hotel.", "prediction 3": "In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited. The architect, a former student of Ecole de Beaux Arts, was George Applegarth of McDonald and Applegarth, who also designed the Palace of the Legion of Honor. Canadian Four Seasons Hotels acquired an interest in the hotel in 1976, and began managing it as their first US property. Two years later, in 1978, they renamed it the Four Seasons Clift Hotel. On February 21, 1995, Four Seasons Hotels sold their interest in the property and it became The Clift, a Grand Heritage Hotel.", "prediction 4": "In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited. The architect, a former student of Ecole de Beaux Arts, was George Applegarth of McDonald and Applegarth. Four Seasons Hotels acquired an interest in the hotel in 1976, and began managing it as their first US property. Two years later, in 1978, they renamed it the Four Seasons Clift Hotel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 309 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 494 }, { "error type": "Irrelevant", "explanation": "", "start": 495, "end": 621 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In 1913, Frederick C. Clift, an attorney from a large family in the Sierra foothills, commissioned a 300-room hotel on a lot the family had inherited. Four Seasons Hotels acquired an interest in the hotel in 1976, and began managing it as their first US property. Ian Schrager Hotels took over management in 1997, and the hotel became simply Clift. Schrager bought the hotel outright in 1999, for $80 million. Sonesta Hotels assumed management of the hotel in May 2018 and it was renamed The Clift Royal Sonesta Hotel.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "What was robin's name in batman and robin?", "passages": [ [ "Robin (character)", "These include:\n\nIn addition, two Robin related series launched in June 2015: \"We Are Robin\", featuring writer Lee Bermejo and artists Rob Haynes and Khary Randolph, and detailing multiple teenagers in Gotham who take up the mantle of Robin and \"Robin, Son of Batman\", written and drawn by Patrick Gleason, showing the individual adventures of Damian Wayne.", "According to \"Entertainment Weekly\" in 2008, Robin is one of the \"greatest sidekicks\".", "Robin (Dick Grayson) was portrayed by Douglas Croft and Johnny Duncan, respectively, in the 1943 and 1949 fifteen chapter \"Batman\" serials.", "Burt Ward played him in the 1966\u20131968 \"Batman\" television series and the related 1966 film.", "In the live-action movies \"Batman Forever\" and \"Batman & Robin\", he was played by Chris O'Donnell.", "Michael Cera voiced the character in \"The Lego Batman Movie\".", "The Dick Grayson version of Robin also appears in \"\", voiced by Loren Lester.", "Grayson is replaced by Tim Drake, played by Mathew Valencia, in the subsequent series \"The New Batman Adventures\".", "The animated series \"Teen Titans\" features Robin (voiced by Scott Menville) as the leader of a team of young heroes; it is hinted in several episodes that this Robin is Dick Grayson." ], [ "Robin (character)", "Robin (character)\n\nRobin is the name of several fictional superheroes appearing in American comic books published by DC Comics.", "The character was originally created by Bob Kane, Bill Finger, and Jerry Robinson, to serve as a junior counterpart to the superhero Batman.", "The character's first incarnation, Dick Grayson, debuted in \"Detective Comics\" #38 (April 1940).", "Conceived as a way to attract young readership, Robin garnered overwhelmingly positive critical reception, doubling the sales of the Batman titles.", "The early adventures of Robin included \"Star Spangled Comics\" #65\u2013130 (1947\u20131952), which was the character's first solo feature.", "Robin made regular appearances in Batman related comic books and other DC Comics publications from 1940 through the early 1980s until the character set aside the Robin identity and became the independent superhero Nightwing.", "The team of Batman and Robin has commonly been referred to as the \"Caped Crusaders\" or \"Dynamic Duo\".", "The character's second incarnation Jason Todd first appeared in \"Batman\" #357 (1983).", "This Robin made regular appearances in Batman related comic books until 1988, when the character was murdered by the Joker in the storyline \"\" (1989).", "Jason would later find himself alive after a reality changing incident, eventually becoming the Red Hood." ] ], "gold": "Robin is the alias of several fictional superheroes appearing in American comic books published by DC Comics. The character's first incarnation, Dick Grayson, debuted in Detective Comics #38 (April 1940). Burt Ward played him in the 1966\u20131968 \"Batman\" television series and the related 1966 film. In the live-action movies \"Batman Forever\" and \"Batman & Robin\", he was played by Chris O'Donnell.", "prediction 1": "Robin is the name of several fictional superheroes appearing in American comic books published by DC Comics. The character was originally created by Bob Kane, Bill Finger, and Jerry Robinson, to serve as a junior counterpart to the superhero Batman. Dick Grayson was the name of the character in the 1943 and 1949 fifteen chapter Batman serials. Burt Ward played him in the 1966\u20131968 Batman television series and the related 1966 film. Michael Cera voiced the character in The Lego Batman Movie.\n", "prediction 2": "In the 1966 movie Batman & Robin, Chris O'Donnell plays the character. In the animated series Teen Titans, Scott Menville voices the character which is often called Young Robin.", "prediction 3": "The name of several fictional superheroes appearing in American comic books published by DC Comics. In the live-action movies Batman Forever and Batman & Robin, Chris O'Donnell played the character of Robin. In the animated series Teen Titans, Scott Menville voices Robin as a leader of a team of young heroes. It is hinted in several episodes that this Robin is Dick Grayson.", "prediction 4": "In the 1946 movie Batman & Robin, Batman & Robin was voiced by Chris O'Donnell while in the 1963 film Batman & Robin, the voice of Ricky Gervais was Robin. In Batman Forever and Batman & Robin, Chris O'Donnell voiced the character. In the animated series Teen Titans, Robin is voiced by Scott Menville. The name of several fictional superheroes appearing in American comic books published by DC Comics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 496 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Robin is the name of several fictional superheroes appearing in American comic books published by DC Comics. Dick Grayson was the name of the character in the 1943 and 1949 fifteen chapter Batman serials. Burt Ward played him in the 1966\u20131968 Batman television series and the related 1966 film. In the live-action movies \"Batman Forever\" and \"Batman & Robin\", he was played by Chris O'Donnell. The character's second incarnation Jason Todd first appeared in \"Batman\" #357 (1983)." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the 12 valve cummins come out?", "passages": [ [ "Cummins B Series engine", "The original B Series was updated with 24 valves and an electronic engine management system to become the ISB in 1998.", "The 3.9L/4BT Cummins is an engine in the same family as the Cummins turbodiesels.", "The 3.9L/4B is an inline four-cylinder turbodiesel that was popular for many step van applications, including bread vans and other commercial vehicles.", "It has also gained popularity as an engine swap into smaller trucks.", "The lowest powered 4B produces .", "The 6BT, also known as the Cummins \"12-valve\" was the first member of the \"B\" engine family to be used in a light truck vehicle.", "The 6BT used Robert Bosch GmbH fuel systems, injector, and VE rotary pump and P7100 inline injection pumps.", "Some early 6BTs were supplied with CAV rotary pumps instead, before the Bosch system became the sole standard.", "This engine started life in 1984 designed as an agricultural engine, for use in Case agricultural equipment.", "After 1989, the 6BT engine was used in light duty, medium duty and select heavy duty trucks and buses.", "The 6bt engine has recently become very popular for use in repowering various vehicles, in the uk they have proven very popular in the Land Rover community, commonly known as the \u2018superior\u2019 conversion." ], [ "Cummins B Series engine", "Cummins B Series engine\n\nThe Cummins B Series is a family of American straight-four and straight-6 diesel piston engines that are manufactured by Cummins.", "This particular family, or Series, is one of the most prolific offerings for On-Highway, Automotive purposes from Cummins, and is widely used for the Off-Highway Markets it serves such as Construction, Mining, Agriculture, Marine and Industrial sectors to name a few.", "The B Series is known for the popular B Series Cummins engines.", "The engine was originally designed by Cummins and Case Corporation for construction machinery applications, and gained much of its popularity after appearing in the Dodge Ram, in 1989.", "The B-series features engine bores machined directly into the block (rather than the wet liners used on earlier Cummins engines).", "It was also set apart by the use of a shallow one-piece head, requiring closer tolerances than in other Cummins products.", "The engine was first manufactured in Rocky Mount, North Carolina, and other plants were later added in Mexico, Turkey, and Darlington, UK.", "Every Cummins powered Dodge Pickup (since initial production in 1989) has come equipped with a turbocharger.", "It uses a gear-drive camshaft for extra reliability.", "Also specified is a deep-skirt engine block and extra-strong connecting rods.", "A Holset turbocharger is used." ] ], "gold": "The 12-valve Cummins engine is used in trucks, buses and agricultural equipment. The 6BT, also known as the Cummins \"12-valve\" was the first member of the \"B\" engine family to be used in a light truck vehicle. This engine started life in 1984 designed as an agricultural engine, for use in Case agricultural equipment. Every Cummins powered Dodge Pickup, since initial production in 1989, has come equipped with a turbocharger.", "prediction 1": "The Cummins B Series is a family of American straight-four and straight-6 diesel piston engines that are manufactured by Cummins. The engine was originally designed by Cummins and Case Corporation for construction machinery applications, and gained much of its popularity after appearing in the Dodge Ram, in 1989. The 6BT, also known as the Cummins \"12-valve\" was the first member of the \"B\" engine family to be used in a light truck vehicle.\n", "prediction 2": "The American straight-four and straight-6 diesel piston engines that are manufactured by Cummins, gained much of their popularity after appearing in the Dodge Ram, in 1989. The original Cummins 6BT engine came out in 1989. The current family of engines, the B Series, range from 1989 through 2019.", "prediction 3": "There are several Cummins engines. The 6BT, also known as the Cummins \"12-valve\" was the first member of the \"B\" engine family to be used in a light truck vehicle. The engine started life in 1984 designed as an agricultural engine, for use in Case agricultural equipment. After 1989, the 6BT engine was used in light duty, medium duty and select heavy duty trucks and buses.", "prediction 4": "The Cummins B Series is a family of American straight-four and straight-6 diesel piston engines that are manufactured by Cummins. It's first engine, the 6BT, was designed in 1984 and came out in 1989. It became popular after appearing the Dodge Ram, in 1989.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 129 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The 6BT, also known as the Cummins \"12-valve\" was the first member of the \"B\" engine family to be used in a light truck vehicle. This engine started life in 1984 designed as an agricultural engine, for use in Case agricultural equipment. After 1989, the 6BT engine was used in trucks and buses. Every Cummins powered Dodge Pickup (since initial production in 1989) has come equipped with a turbocharger.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who has won the most album of the year grammys?", "passages": [ [ "Grammy Award", "Grammy Award\n\nA Grammy Award (stylized as GRAMMY, originally called Gramophone Award), or Grammy, is an award presented by The Recording Academy to recognize achievements in the music industry.", "The annual presentation ceremony features performances by prominent artists, and the presentation of those awards that have a more popular interest.", "It shares recognition of the music industry as that of the other performance awards such as the Academy Awards (film), the Emmy Awards (television), and the Tony Awards (theater).", "The first Grammy Awards ceremony was held on May 4, 1959, to honor and respect the musical accomplishments by performers for the year 1958.", "Following the 2011 ceremony, the Academy overhauled many Grammy Award categories for 2012.", "The 61st Annual Grammy Awards, honoring the best achievements from October 1, 2017 to September 30, 2018, will be held on February 10, 2019, at the Staples Center in Los Angeles.", "The Grammys had their origin in the Hollywood Walk of Fame project in the 1950s.", "As the recording executives chosen for the Walk of Fame committee worked at compiling a list of important recording industry people who might qualify for a Walk of Fame star, they realized there were many more people who were leaders in their business who would never earn a star on Hollywood Boulevard.", "The music executives decided to rectify this by creating an award given by their industry similar to the Oscars and the Emmys." ], [ "Grammy Award records", "Williams won six years in a row between 1978 and 1983 for Grammy Award for Best Score Soundtrack for Visual Media.", "Lenny Kravitz won the Best Male Rock Vocal Performance award four years in a row (1999, 2000, 2001, 2002).", "Tom Coyne won Record of the Year four years in a row (2015\u20132018).", "There have been only two artists who have won all four General Field awards.", "In 1981, Christopher Cross won Record, Album and Song of the Year as well as Best New Artist.", "Adele is the second artist to win all four, and the first female to do so.", "In 2009, she won Best New Artist and in 2012 and 2017, she won Record, Album and Song of the Year.", "The Record for Most Grammys won in one night is eight.", "Michael Jackson won eight in 1984 and Santana tied Jackson's record in 2000.", "Michael Jackson won eight in 1984.", "The record most Grammys won by a female artist in one night is six.", "Beyonc\u00e9 and Adele each won six in 2010 and 2012, respectively.", "In 2000, Santana was awarded a total of 8 awards.", "They won the awards for Record of the Year, Album of the Year, Best Pop Performance by a Duo or Group With Vocals, Best Pop Collaboration with Vocals, Best Pop Instrumental Performance, Best Rock Performance by a Duo or Group With Vocals, Best Rock Instrumental Performance and Best Rock Album." ], [ "Grammy Award for Album of the Year", "Two comedy albums have also triumphed in this category: \"The Button-Down Mind of Bob Newhart\" and \"The First Family\".", "There have been three soundtrack compilation albums that have been successful, as well: \"Saturday Night Fever\", \"\" (though only Whitney Houston won for it as an artist) and \"O Brother, Where Art Thou?\".", "As of 2018, only six artists have won Album of the Year more than once as the main credited artist: Frank Sinatra (1960, 1966, 1967), Stevie Wonder (1974, 1975, 1977), Paul Simon (1976, 1987), U2 (1988, 2006), Taylor Swift (2010, 2016) and Adele (2012, 2017).", "Sinatra and Wonder both won the award three times as the main credited artist.", "Notes:\n\n\nGeneral\n\nSpecific" ] ], "gold": "The Grammy Award (stylized as GRAMMY, originally called Gramophone Award), or just Grammy, is an award presented by the Recording Academy to recognize achievement in the music industry. Tom Coyne has won the most Album of the Year Grammys for being an engineer/mixer. Frank Sinatra, Stevie Wonder and Paul Simon are tied for the Most Album of the Year Grammys.", "prediction 1": "The Grammy Award, officially called the Grammy, is an award presented by The Recording Academy to recognize achievements in the music industry. The most album of the year Grammys ever won by a single artist is eight, with Taylor Swift and Adele both winning six in 2017. In the past, Stevie Wonder and Frank Sinatra have won the award three times as the main credited artist.", "prediction 2": "There have been 81 Grammy Awards in the history of the awards, including the most Album of the Year Grammys, the most Album of the Year Grammys for a solo artist, and the most Grammys for a duo or group with vocals. The award for the most albums of the year won by one artist in a single night is 8. The record for most album of the year Grammys won in one night is 8. Michael Jackson won eight in 1984.", "prediction 3": "The Grammy Award is an annual award presented by The Recording Academy to recognize achievements in the music industry. The most album of the year Grammys is won by Stevie Wonder, Frank Sinatra, and Paul Simon. Christopher Cross won Record, Album and Song of the Year in 1981. In 2012 and 2017, Adele won Record, Album and Song of the Year. Michael Jackson holds the record for most Grammys won in one night, with 8.", "prediction 4": "A Grammy Award is an award presented by The Recording Academy to recognize achievements in the music industry. As of 2018, only six artists have won Album of the Year more than once as the main credited artist: Frank Sinatra (1960, 1966, 1967), Stevie Wonder (1974, 1975, 1977), Paul Simon (1976, 1987), U2 (1988, 2006), Taylor Swift (2010, 2016) and Adele (2012, 2017).", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 144, "end": 270 }, { "error type": "Irrelevant", "explanation": "", "start": 271, "end": 375 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Grammy Award, officially called the Grammy, is an award presented by The Recording Academy to recognize achievements in the music industry. Tom Coyne won Record of the Year four years in a row (2015\u20132018). Frank Sinatra, Stevie Wonder and Paul Simon are tied for the Most Album of the Year Grammys." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "How many goals did ronaldo score in ucl?", "passages": [ [ "MK Capital", "MK Capital\n\nMK Capital is a $250 million venture capital fund with headquarters in Chicago and offices in Los Angeles and Ann Arbor .", "MK Capital offers multi-stage growth equity and venture capital to companies in the following sectors: digital media, data center automation, application software, education technology, and technology-enabled services.", "Representative investments include: Movieclips, HealthiNation, Machinama, BladeLogic, Kontiki, TopSchool, and Playcast Media.", "On May 5, 2008, MK Capital announced it had completed the acquisition of Kontiki from VeriSign.", "On April 22, 2011, MK Capital announced that it has sold Smoothstone IP Communications, founded by Jeff Wellemeyer, to West Corporation for $120 million.", "
" ], [ "GV (company)", "GV (company)\n\nGV, formerly Google Ventures, is the venture capital investment arm of Alphabet Inc. and provides seed, venture, and growth stage funding to technology companies.", "The firm operates independently from Google and makes financially driven investment decisions.", "GV seeks to invest in startup companies in a variety of fields ranging from the Internet, software, and hardware to life science, healthcare, artificial intelligence, transportation, cyber security and agriculture.", "GV was founded as Google Ventures in 2009.", "GV has offices in Mountain View, San Francisco, New York City, Cambridge, and London.", "The group was founded on March 31, 2009, with a $100 million capital commitment.", "In 2012, that commitment was raised to $300 million annually, and the fund has $2 billion under management.", "In 2014, the group announced $125 million to invest in promising European startups.", "By 2014, it had invested in companies such as Shape Security.", "In December 2015, the company was renamed GV and introduced a new logo.", "As of 2016, GV has been less active as a seed investor, instead shifting its attention to more mature companies.", "GV was one of the first venture capital firms to employ the venture capital services model.", "It provides portfolio companies with access to operational help after making a financial investment." ] ], "gold": "Cristiano Ronaldo dos Santos Aveiro is a Portuguese professional footballer who plays as a forward for Premier League club Manchester United and captains the Portugal national team. In the 2014-2015 UCL season, he scored 10 goals. In the 2015-2016 UCL season, he scored 16 goals. In the 2016-2017 UCL season, he scored 12 goals.", "prediction 1": "In the 2015-15 season, ronaldo scored 25 goals for Barcelona. In the 2016-17 season, he scored 25 goals for Real Madrid.", "prediction 2": "Several players have scored goals in the UEFA Champions League. Cristiano Ronaldo scored 5 goals in the UEFA Champions League.", "prediction 3": "In the UEFA Champions League, ronaldo scored a total of 104 goals in total for the club.", "prediction 4": "Currently, Ronaldo has scored a total of 3 goals in the UEFA Europa League. In 2014, he scored a total of 67 goals in the UEFA Champions League.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 120 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 0, 2, 0, 1 ] }, { "question": "When did joseph campbell create the hero's journey?", "passages": [ [ "Hero's journey", "Hero's journey\n\nIn narratology and comparative mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed.", "The study of hero myth narratives started in 1871 with anthropologist Edward Burnett Tylor's observations of common patterns in plots of heroes' journeys.", "Later on, others introduced various theories on hero myth narratives such as Otto Rank and his Freudian psychoanalytic approach to myth, Lord Raglan's unification of myth and rituals, and eventually hero myth pattern studies were popularized by Joseph Campbell, who was influenced by Carl Jung's view of myth.", "In his 1949 work \"The Hero with a Thousand Faces\", Campbell described the basic narrative pattern as follows:\nCampbell and other scholars, such as Erich Neumann, describe narratives of Gautama Buddha, Moses, and Christ in terms of the monomyth.", "While others, such as Otto Rank and Lord Raglan, describe hero narrative patterns in terms of Freudian psychoanalysis and ritualistic senses.", "Critics argue that the concept is too broad or general to be of much usefulness in comparative mythology." ], [ "Joseph Campbell", "Joseph Campbell\n\nJoseph John Campbell (1904\u20131987) was an American Professor of Literature at Sarah Lawrence College who worked in comparative mythology and comparative religion.", "His work covers many aspects of the human experience.", "Campbell's most well-known work is his book \"The Hero with a Thousand Faces\" (1949), in which he discusses his theory of the journey of the archetypal hero shared by world mythologies, termed the monomyth.", "Since the publication of \"The Hero with a Thousand Faces\", Campbell's theory has been applied by a wide variety of modern writers and artists.", "His philosophy has been summarized by his own often repeated phrase: \"Follow your bliss.\"", "He gained recognition in Hollywood when George Lucas credited Campbell's work as influencing his \"Star Wars\" saga.", "Joseph Campbell was born in White Plains, New York, on March 26, 1904, the son of Josephine (n\u00e9e Lynch) and Charles William Campbell.", "He was from an upper-middle-class Irish Catholic family.", "During his childhood, he moved with his family to nearby New Rochelle, New York.", "In 1919, a fire destroyed the family home in New Rochelle, killing his grandmother.", "In 1921, Campbell graduated from the Canterbury School in New Milford, Connecticut.", "While at Dartmouth College he studied biology and mathematics, but decided that he preferred the humanities." ], [ "The Hero with a Thousand Faces", "The Hero with a Thousand Faces\n\nThe Hero with a Thousand Faces (first published in 1949) is a work of comparative mythology by Joseph Campbell.", "In this book, Campbell discusses his theory of the mythological structure of the journey of the archetypal hero found in world myths.", "Since the publication of \"The Hero with a Thousand Faces\", Campbell's theory has been consciously applied by a wide variety of modern writers and artists.", "Filmmaker George Lucas acknowledged Campbell's theory in mythology, and its influence on the \"Star Wars\" films.", "The Joseph Campbell Foundation and New World Library issued a new edition of \"The Hero with a Thousand Faces\" in July 2008 as part of the Collected Works of Joseph Campbell series of books, audio and video recordings.", "In 2011, \"Time\" placed the book in its list of the 100 best and most influential books written in English since the magazine was founded in 1923.", "Campbell explores the theory that mythological narratives frequently share a fundamental structure.", "The similarities of these myths brought Campbell to write his book in which he details the structure of the \"monomyth\".", "He calls the motif of the archetypal narrative, \"the hero's journey\"." ] ], "gold": "In narratology and comparative mythology, the hero's journey, or the monomyth, is the common template of stories that involve a hero who goes on an adventure, is victorious in a decisive crisis, and comes home changed or transformed. Joseph Campbell, an American professor of literature at Sarah Lawrence College, began exploring mythology and creating the hero's journey in 1934. He published his book, \"The Hero with a Thousand Faces\", in 1949, in which he discusses his theory of the journey of the archetypal hero shared by world mythologies.", "prediction 1": "In Narratology and Comparative Mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed. The study of hero myth narratives started in 1871 with anthropologist Edward Burnett Tylor's observations of common patterns in plots of heroes' journeys. Later on, others introduced various theories on hero myth narratives, Lord Raglan's unification of myth and rituals, and eventually hero myth pattern studies were popularized by Joseph Campbell, who was influenced by Carl Jung's view of myth.", "prediction 2": "In narratology and comparative mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed. The study of hero myth narratives started in 1871 with anthropologist Edward Burnett Tylor's observations of common patterns in plots of heroes' journeys. Later on, others introduced various theories on hero mythologies such as Otto Rank and his Freudian psychoanalytic approach to myth, Lord Raglan's unification of myth and rituals, and eventually hero myth pattern studies were popularized by Joseph Campbell. Since the publication of The Hero with a Thousand Faces, Campbell's theory has been consciously applied by a wide variety of modern writers and artists.", "prediction 3": "In narratology and comparative mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed. In his 1949 book The Hero with a Thousand Faces, Joseph Campbell discusses his theory of the mythological structure of the journey of the archetypal hero shared by world mythologies, termed the monomyth. The similarities between these myths brought Campbell to write his book in which he describes the structure of the mythological narrative.", "prediction 4": "The hero's journey is a broad category of tales that involve a hero who goes on an adventure, wins a victory in a decisive crisis, and then comes home changed or transformed. In narratology and comparative mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 416 }, { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 659 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "In Narratology and Comparative Mythology, the monomyth, or the hero's journey, is the common template of a broad category of tales that involve a hero who goes on an adventure, and in a decisive crisis wins a victory, and then comes home changed or transformed. Joseph Campbell Joseph John Campbell (1904\u20131987) was an American Professor of Literature at Sarah Lawrence College who worked in comparative mythology and comparative religion. Campbell's most well-known work is his book \"The Hero with a Thousand Faces\" (1949), in which he discusses his theory of the journey of the archetypal hero shared by world mythologies" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "When is it mothering sunday in the uk?", "passages": [ [ "Mothering Sunday", "Mothering Sunday\n\nMothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world.", "It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia.", "It falls on the fourth Sunday in Lent, exactly three weeks before Easter Day.", "Once observed as a day on which people would visit their \"mother\" church, it has become an occasion for honouring the mothers of children and giving them presents.", "It is increasingly being called Mother's Day, although that name properly belongs to the American holiday which is quite distinct from the original Mothering Sunday.", "In the UK and the Republic of Ireland, Mothering Sunday is celebrated in a similar way as Mother's Day is celebrated in the USA.", "During the 16th century, people returned to their mother church for a service to be held on Laetare Sunday; in this context, one's 'mother church' was either the church where one was baptised, or the local parish church, or the nearest cathedral (the latter being the mother church of all the parish churches in a diocese).", "Anyone who did this was commonly said to have gone \"a-mothering\", although whether this term preceded the observance of Mothering Sunday is unclear." ], [ "Mother's Day", "The United Kingdom celebrates Mothering Sunday, which falls on the fourth Sunday of Lent (26 March in 2017).", "This holiday has its roots in the church and was originally unrelated to the American holiday.", "Most historians believe that Mothering Sunday evolved from the 16th-century Christian practice of visiting one's mother church annually on Laetare Sunday.", "As a result of this tradition, most mothers were reunited with their children on this day when young apprentices and young women in service were released by their masters for that weekend.", "As a result of the influence of the American Mother's Day, Mothering Sunday transformed into the tradition of showing appreciation to one's mother.", "The holiday is still recognized in the original historical sense by many churches, with attention paid to Mary the mother of Jesus Christ and the concept of the Mother Church.", "The custom was still popular by the start of the 19th century, but with the Industrial Revolution, traditions changed and the Mothering Day customs declined.", "By 1935, Mothering Sunday was less celebrated in Europe.", "Constance Penswick-Smith worked unsuccessfully to revive the festival in the 1910s\u20131920s.", "However, US World War II soldiers brought the US Mother's Day celebration to the UK, and the holiday was merged with the Mothering Sunday traditions still celebrated in the Church of England." ] ], "gold": "Mothering Sunday is a day honoring mothers and mother churches, celebrated in the United Kingdom and Ireland, and elsewhere in the English-speaking world on the fourth Sunday in Lent since the Middle Ages. In 2015, Mothering Sunday in the UK was on 15 March. In 2016, Mothering Sunday in the UK was on 6 March, and in 2017, it was on 26 March.", "prediction 1": "The United Kingdom celebrates Mothering Sunday, which falls on the fourth Sunday of Lent, exactly three weeks before Easter Day. Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world. It is generally observed in parishes of the Church of England, as well as in the rest of the UK and in many Anglican parishes throughout the world, especially in Canada and Australia.", "prediction 2": "Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the United Kingdom and some other parts of the world. It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia. The United Kingdom celebrates Mothering Sunday, which falls on the fourth Sunday of Lent, exactly three weeks before Easter Day.", "prediction 3": "Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world. It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia. Once observed as a day on which people would visit their \"mother\" church, it has become an occasion for honouring the mothers of children and giving them presents. In the UK and the Republic of Ireland, Mothering Sunday is celebrated in a similar way as Mother's Day is celebrated in the United States.", "prediction 4": "The United Kingdom celebrates Mothering Sunday, which falls on the fourth Sunday of Lent, exactly three weeks before Easter Day. There are many parishes of the Church of England which observe the holiday. In the Church of England, the fourth Sunday in Lent, is observed as Mothering Sunday, and in many Anglican parishes throughout the world it is observed on the third Sunday of Lent, the fifth Sunday of Lent.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 436 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United Kingdom celebrates Mothering Sunday, which falls on the fourth Sunday of Lent. Mothering Sunday is a holiday celebrated in the UK and some other parts of the world. It occurred on 26 March in 2017. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who was turned to a pillar of salt?", "passages": [ [ "Lot's wife", "Lot's wife\n\nIn the Bible, Lot's wife is a figure first mentioned in .", "The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom.", "She is not named in the Bible but is called \"Ado\" or \"Edith\" in some Jewish traditions.", "She is also referred to in the deuterocanonical books at and the New Testament at .", "Islamic accounts also talk about the wife of Prophet Lut (Lot) when mentioning 'People of Lut'.", "The story of Lot's wife begins in after two angels arrived in Sodom at eventide and were invited to spend the night at Lot's home.", "The Men of Sodom were exceedingly wicked and prompted Lot to offer up these Men/Angels; instead, Lot offered up his two daughters but they refused.", "As dawn was breaking, Lot's visiting angels urged him to get his family and flee, so as to avoid being caught in the impending disaster for the iniquity of the city.", "The command was given, \"Flee for your life!", "Do not look behind you, nor stop anywhere in the Plain; flee to the hills, lest you be swept away.\"", "While fleeing, Lot's wife turned to look back, and was turned into a pillar of salt." ], [ "Lot's wife", "Another view in the Jewish exegesis of Genesis 19:26, is that when Lot's wife looked back, she turned to a pillar of salt upon the \"sight of God,\" who was descending down to rain destruction upon Sodom and Gomorrah.", "One reason that is given in the tradition is that she turned back to look in order to see if her daughters, who were married to men of Sodom, were coming or not.", "Another Jewish legend says that because Lot's wife sinned with salt, she was punished with salt.", "On the night the two angels visited Lot, he requested that his wife prepare a feast for them.", "Not having any salt, Lot's wife asked her neighbors for salt, which alerted them to the presence of their guests, resulting in the mob action that endangered Lot's family.", "In the Midrash, Lot's wife's name is given as Edith.", "Lut () in the Quran is considered to be the same as Lot in the Hebrew Bible.", "He is considered to be a messenger of God and a prophet of God.", "In Islamic tradition, Lot (Lut, ) lived in Ur and was a nephew of Ibrahim (Abraham).", "He migrated with Ibrahim to Canaan and was commissioned as a prophet to the cities of Sodom and Gomorrah." ] ], "gold": "In the book of Genesis in the Bible there is description of Lot's wife being turned to a pillar of salt after looking back at Sodem. She is not named but is called \"Ado\" or \"Edith\" in the Midrash in Jewish traditions.", "prediction 1": "In the Bible, Lot's wife is a figure first mentioned in. The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom. She is not named in the Bible but is called \"Ado\" or \"Edith\" in some Jewish traditions. Another view in the Jewish exegesis of Genesis 19:26, is that when Lot's wife looked back, she turned to a pillar of salt upon the \"sight of God,\" who was descending down to rain destruction upon Sodom and Gomorrah.", "prediction 2": "Lot's wife, Edith, was turned to a pillar of salt after she looked back at Sodom. In the Bible, Lot's wife is a figure first mentioned in. The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom. Her name is not in the Bible, but she is called Ado or Edith in some Jewish traditions. Another view in the Jewish exegesis of Genesis 19:26, is that when Lot's wife looked back, she turned to a pillar of salt upon the \"sight of God,\" who was descending down to rain destruction upon Sodom and Gomorrah. Another view in the Jewish exegesism that because Lot's wife sinned with salt, she was punished with salt. Another Jewish legend says that because Lot's wife s wife sinned with salt, she was punished with", "prediction 3": "In the Bible, Lot's wife is a figure first mentioned in. The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom. She is not named in the Bible but is called Ado or Edith in some Jewish traditions. She is also referred to in the deuterocanonical books at and the New Testament at. Another view in the Jewish exegesis of Genesis 19:26, is that when Lot's wife looked back, she turned to a pillar of salt upon the \"sight of God,\" who was descending down to rain destruction upon Sodom and Gomorrah. Another Jewish legend says that because Lot's wife s wife sinned with salt, she was punished with salt.", "prediction 4": "In the Bible, Lot's wife is a figure first mentioned in. The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom. She is not named in the Bible but is called Ado or Edith in some Jewish traditions. Another view in the Jewish exegesis of Genesis 19:26, is that when Lot's wife looked back, she turned to a pillar of salt upon the \"sight of God,\" who was descending down to rain destruction upon Sodom and Gomorrah.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 454 } ], "missing-info": [], "corrected-prediction": " The Book of Genesis describes how she became a pillar of salt after she looked back at Sodom. She is not named in the Bible but is called \"Ado\" or \"Edith\" in some Jewish traditions. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who is the actor that plays ross poldark?", "passages": [ [ "Robin Ellis", "Robin Ellis\n\nAnthony Robin Ellis (born 8 January 1942) is an English actor best known for his role as Captain Ross Poldark in 29 episodes of the BBC classic series \"Poldark\", adapted from a series of books by the late British author Winston Graham.", "He also appeared in \"Fawlty Towers\", \"Cluedo\", \"The Good Soldier\" (an adaptation of the Ford Madox Ford novel), \"Elizabeth R\" (playing Essex), \"The Moonstone\", \"Bel Ami\", \"Sense and Sensibility\" (which also featured Clive Francis), \"The Casebook of Sherlock Holmes\", \"She Loves Me\" (in which he sings) and \"Blue Remembered Hills\" (written by Dennis Potter).", "In 2015, 2016 and 2017 he appeared in \"Poldark\" as Reverend Halse.", "Ellis was born in Ipswich, Suffolk.", "He and his brothers were educated at the independent Highgate School in Highgate in north London, and at Fitzwilliam College, Cambridge where he read history and appeared in over 20 plays.", "His first West End performance was in Sheridan's \"The Rivals\" at the Haymarket Theatre, as Captain Jack Absolute.", "He went on to play in \"The Real Inspector Hound\" at the Criterion Theatre and \"Widowers' Houses\" at the Royal Court." ], [ "Aidan Turner", "Aidan Turner\n\nAidan Turner (born 19 June 1983) is an Irish actor.", "He played the roles of K\u00edli in the three-part fantasy film \"The Hobbit\" and Ross Poldark in the 2015 BBC adaptation of \"The Poldark Novels\" by Winston Graham.", "Notable television roles include those of Dante Gabriel Rossetti in \"Desperate Romantics\", Ruair\u00ed McGowan in \"The Clinic\", and John Mitchell in the supernatural drama series \"Being Human\".", "Turner was born at home in Clondalkin, a suburban town of Dublin, Ireland.", "The family moved later to Walkinstown.", "Turner attended secondary school at St Mac Dara's Community College in Templeogue before leaving to join his older brother at Firhouse Community College.", "Turner has stated: \u201cI probably wasn\u2019t a great student.", "I had a car when I was 17, so I used to just run out of school when I could, jump in the car and go play pool in Tallaght.", "I don\u2019t know how I knew, but I convinced myself that my [final exam] results were never going to matter to me.\u201d\n\n", "After finishing secondary school, Turner briefly worked as an apprentice electrician, alongside his father." ], [ "Poldark", "Poldark\n\nPoldark is a series of historical novels by Winston Graham, published from 1945 to 1953 and continued from 1973 to 2002.", "The series comprises 12 novels: the first seven are set in the 18th century, concluding in Christmas 1799; the remaining five are concerned with the early years of the 19th century and the lives of the descendants of the previous novels' main characters.", "Graham wrote the first four \"Poldark\" books during the 1940s and 1950s.", "Following a long hiatus, he decided to resume the series and published \"The Black Moon\" in 1973.", "The main character, Ross Poldark, is a British Army officer who returns to his home in Cornwall from the American War of Independence only to find that his fianc\u00e9e Elizabeth Chynoweth believed him dead and is about to marry his cousin Francis Poldark.", "Ross attempts to restore his own fortunes by reopening one of the family's derelict copper mines.", "After several years, he marries Demelza Carne, a poor servant girl, and is gradually reconciled to the loss of Elizabeth's love.", "The BBC aired two television adaptations: one which aired in 1975 and 1977, and one which aired in 2015-2018.", "All of the novels are subtitled \"A Novel of Cornwall\".", "In a preface to \"The Black Moon\", Graham explained his decision to revive the series after a two-decade hiatus." ] ], "gold": "The Poldark series of historical novels by Winston Graham has been adapted for television twice by the BBC, firstly in 1975 and later in 2015. Protagonist Ross Poldark is played by Robin Ellis in the 1975 series and Aidan Turner in the 2015 series. Ellis also appeared in the 2015 series in the role of Reverend Halse.", "prediction 1": "Ross Poldark is the main character of the British Army novel series Poldark, a series of historical novels written by Winston Graham, published from 1945 to 1953. The character is played by English actor Robin Ellis and Irish actor Aidan Turner.", "prediction 2": "Ross Poldark is a British Army officer who returns to his home in Cornwall from the American War of Independence to find that his fianc\u00e9e Elizabeth Chynoweth believed him dead and is about to marry his cousin Francis Poldark. Robin Ellis, born 8 January 1942, is an English actor best known for his role as Captain Ross Poldark in 29 episodes of the BBC classic series \"Poldark\", adapted from a series of books by the late British author Winston Graham. Irish actor Aidan Turner, born 19 June 1983, plays Ross Poldark in the 2015 BBC adaptation of \"The Poldark Novels\", an Irish actor who plays Ross Poldark in the 2015 BBC adaptation of \"Poldark\" and in the 2015 BBC adaptation of Poldark.", "prediction 3": "Poldark is a series of historical novels by Winston Graham, published from 1945 to 1953 and continued from 1973 to 2002. In the 2015 BBC adaptation of \"Poldark\", Robin Ellis plays Ross Poldark, a British Army officer who returns to his home in Cornwall from the American War of Independence. Irish actor Aidan Turner plays Ross Poldark, and is also a regular on the show.", "prediction 4": "There are several actors that have played Ross Poldark. Robin Ellis, born 8 January 1942, is an English actor best known for his role as Captain Ross Poldark in 29 episodes of the BBC classic series, Poldark, adapted from a series of books by the late British author Winston Graham. Aidan Turner, born 19 June 1983, is an Irish actor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 54 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The novel series, Poldark, is a series of historical novels written by Winston Graham. The BBC aired two television adaptations: one which aired in 1975 and 1977, and one which aired in 2015-2018. The character is first played by English actor Robin Ellis (who plays the Reverend Halse in the 2015 version) and Irish actor Aidan Turner, in the 2015 version." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "How many legoland's are there in the whole world?", "passages": [ [ "Legoland", "Legoland\n\nLegoland (trademark in uppercase as LEGOLAND) is a chain of family theme parks, which has its main focus on the toy Lego.", "They are not fully owned by The Lego Group itself; rather they are owned and operated by the British theme park company Merlin Entertainments.", "The Legoland Billund Resort opened in Billund, Denmark in 1968, followed by the Legoland Windsor Resort in Windsor, England in 1996.", "Further parks opened in Germany, Japan, Malaysia, Dubai, the United States (California and Florida).", "Parks in South Korea, New York, and Shanghai are currently under construction.", "The parks are marketed to families with younger children (11 and under), and although the attractions include a number of roller coasters, the roller coasters are not as numerous or as extreme as those in other parks, and there is a greater emphasis on rides suitable for younger children.", "Legoland parks are split into various areas, which are consistent among the chain's parks.", "For example, all six of the parks include a Lego miniland, a model village which includes models of landmarks and scenes from around the world, made from millions of genuine Lego bricks.", "An important aspect of Legoland is education and learning.", "Examples include:\n\nThe parks' rides are all Lego themed; many are made to appear as if they are built out of Lego bricks." ], [ "Legoland Windsor Resort", "Legoland Windsor Resort\n\nLegoland Windsor Resort, also known as Legoland Windsor, is a child-orientated theme park and resort in Windsor, Berkshire in England, themed around the Lego toy system.", "The park opened in 17 March 1996 on the former Windsor Safari Park site as the second Legoland after Legoland Billund in Denmark.", "In common with the other Legolands across the world, the park's attractions consist of a mixture of Lego-themed rides, models, and building workshops.", "The park was acquired by Merlin Entertainments in 2005, which now operates the park, with the Lego Group retaining part ownership (30%).", "The facilities are mainly targeted at children between three and twelve.", "The park had 2.2 million visitors in 2017, making it the most visited theme park in the United Kingdom and the 10th-most visited in Europe.", "From 1969 to 1992, the site of today\u00b4s Legoland Windsor belonged to Windsor Safari Park, which had been founded by the Billy Smart's Circus.", "The Lego Group began research for the development of a second Legoland park after Legoland Billund in 1987, with over 1000 sites considered.", "In January 1992, Windsor Safari Park went into receivership and the site was chosen.", "Throughout 1992 and 1993, planning, design, site preparation and the design and construction of models began, and new homes were secured for all the safari animals." ], [ "The Lego Group", "In addition, they have opened four new Legoland Discovery Centres, which take the Legoland concept and scale it down to suit a retail park environment.", "The Lego Group operates 138 retail stores (83 in the United States, 14 in the United Kingdom, 11 in Germany, 10 in Canada, 7 in France, 2 in Spain, 2 in Austria, 2 in Italy, 2 in Denmark, 1 in Belgium, 2 in China, 1 in Sweden, 1 in Poland, 1 in India, 1 in Lithuania and 3 in Mexico.).", "October 2002 saw a significant change in The Lego Group's direct retail policy with the opening of the first so-called \"Lego Brand Store\" in Cologne, Germany.", "The second, in Milton Keynes, UK, followed quickly \u2013 several dozen more opened worldwide over the next few years, and most of the existing stores have been remodelled on the new \"Brand Store\" template.", "One of the distinctive features of these new stores is the inclusion of a \"Pick-A-Brick\" system that allows customers to buy individual bricks in bulk quantities.", "How a customer buys Lego pieces at a Pick-A-Brick is quite simple: customers fill a large or small cup or bag with their choice of Lego bricks from a large and varied selection and purchase it." ] ], "gold": "Legoland is a chain of family theme parks focusing on the construction toy system Lego. The Legoland Billund Resort opened in Billund, Denmark in 1968, followed by the Legoland Windsor Resort in Windsor, England in 1996. By 2012 there were 6 Legoland's worldwide. In 2016, there were 7 and in 2018, there were 8 Legoland's in the world.", "prediction 1": "Legoland is a chain of family theme parks, with its main focus on the toy Lego. They are not fully owned by The Lego Group itself; rather they are owned and operated by the British theme park company Merlin Entertainments. The Legoland Billund Resort, opened in Denmark in 1968, followed by the Legoland Windsor Resort in Windsor, England in 1996. Further parks opened in Germany, Japan, Malaysia, Dubai, the United States (California and Florida) and the United Kingdom. Parks in South Korea, New York, New York, Shanghai, are currently under construction.", "prediction 2": "Legoland is a chain of family theme parks, which has its main focus on the toy Lego. They are not fully owned by The Lego Group itself; rather they are owned and operated by the British theme park company Merlin Entertainments. In total there are 6 Legoland parks in the world and there are 6 Legoland Windsor Resorts.", "prediction 3": "Legoland is a chain of family theme parks, which has its main focus on the toy Lego. The Legoland Billund Resort opened in Denmark in 1968, followed by the Legoland Windsor Resort in Windsor, England in 1996. Further parks opened in Germany, Japan, Malaysia, Dubai, the United States (California and Florida). Parks in South Korea, New York, and Shanghai are currently under construction.", "prediction 4": "Legoland is a chain of family theme parks which has its main focus on the toy Lego. There are currently 14 Legoland's in the world and there are currently 10 Legoland Discovery Centres. Legoland Billund Resort opened in Denmark in 1968, followed by Legoland Windsor Resort in Windsor, England in 1996. Further Legoland parks opened in Germany, Japan, Malaysia, Dubai, the United States (California and Florida), and Parks in South Korea, New York, and Shanghai are currently under construction.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 348, "end": 471 }, { "error type": "Irrelevant", "explanation": "", "start": 472, "end": 557 } ], "missing-info": [], "corrected-prediction": "Legoland is a chain of family theme parks, with its main focus on the toy Lego. The Legoland Billund Resort, opened in Denmark in 1968, followed by the Legoland Windsor Resort in Windsor, England in 1996. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who controlled the economy of the incan empire?", "passages": [ [ "Inca society", "The Inca also constructed vast storehouses, which allowed them to live through El Ni\u00f1o years while some neighboring civilizations suffered.", "Inca leaders kept records of what each \"ayllu\" in the empire produced, but did not tax them on their production.", "They instead used the \"mita\" for the support of the empire.", "The Inca diet consisted primarily of fish and vegetables, supplemented less frequently with the meat of cuyes (guinea pigs) and camelids.", "In addition, they hunted various animals for meat, skins and feathers.", "Maize was malted and used to make chicha, a fermented alcoholic beverage.", "According to Ferreira and Chamot:\n\nThese authors also add:\n\n", "In essence, the government of the Inca functioned as a safeguard against mass starvation.", "Unlike the Europeans, gold and silver were not used as a form of currency.", "Instead, clothing and food were distributed by the rulers in exchange for labor.", "The Incan required tribute from those they conquered.", "Historical records show that agricultural production as well as cloth production increases after Incan conquest.", "The \"Qhapaq \u00d1an\" (Inca Road) was largely used and constructed across the Inca Empire.", "Uses were not only for nobility to spread information and expand the empire, but was also used for soldiers, for transportation of goods, and for private usage.", "Not only were Incan roads expansive, but they were also well planned and maintained." ], [ "Inca Empire", "While axe-monies were used along the northern coast, presumably by the provincial \"mindal\u00e1e\" trading class, most households in the empire lived in a traditional economy in which households were required to pay taxes, usually in the form of the \"mit'a\" corv\u00e9e labor, and military obligations, though barter (or \"trueque\") was present in some areas.", "In return, the state provided security, food in times of hardship through the supply of emergency resources, agricultural projects (e.g. aqueducts and terraces) to increase productivity and occasional feasts.", "The economy rested on the material foundations of the vertical archipelago, a system of ecological complementarity in accessing resources and the cultural foundation of \"ayni\", or reciprocal exchange.", "The Sapa Inca was conceptualized as divine and was effectively head of the state religion.", "The \"Willaq Umu\" (or Chief Priest) was second to the emperor.", "Local religious traditions continued and in some cases such as the Oracle at Pachacamac on the Peruvian coast, were officially venerated.", "Following Pachacuti, the Sapa Inca claimed descent from Inti, who placed a high value on imperial blood; by the end of the empire, it was common to incestuously wed brother and sister." ], [ "Inca Empire", "Inca Empire\n\nThe Inca Empire (, \u00a0\"The Four Regions\"), also known as the Incan Empire and the Inka Empire, was the largest empire in pre-Columbian America.", "Its political and administrative structure is considered by most scholars to have been the most developed in the Americas before Columbus' arrival.", "The administrative, political and military center of the empire was located in Cusco in modern-day Peru.", "The Inca civilization arose from the highlands of Peru sometime in the early 13th century.", "Its last stronghold was conquered by the Spanish in 1572.", "From 1438 to 1533, the Incas incorporated a large portion of western South America, centered on the Andean Mountains, using conquest and peaceful assimilation, among other methods.", "At its largest, the empire joined Peru, large parts of modern Ecuador, western and south central Bolivia, northwest Argentina, north and central Chile and a small part of southwest Colombia into a state comparable to the historical empires of Eurasia.", "Its official language was Quechua.", "Many local forms of worship persisted in the empire, most of them concerning local sacred \"Huacas\", but the Inca leadership encouraged the sun worship of Inti \u2013 their sun god \u2013 and imposed its sovereignty above other cults such as that of Pachamama.", "The Incas considered their king, the Sapa Inca, to be the \"son of the sun.\"" ] ], "gold": "The Inca Empire, also known as Incan Empire and the Inka Empire, and at the time known as the Realm of the Four Parts, was the largest empire in pre-Columbian America. The Incan economy was centered around the \"ayllu\", a local group composed of neighboring families in the same village. Every \"ayllu\" specialized in a certain industry, such as agriculture, pottery, clothing, or jewellery. Most households in the empire lived in a traditional economy in which households were required to pay taxes. In return, the state provided security, food in times of hardship through the supply of emergency resources, agricultural projects (e.g. aqueducts and terraces) to increase productivity and occasional feasts.", "prediction 1": "The Incan Empire was a pre-Columbian empire in which the emperor controlled the economy and the Sapa Inca was the head of state religion. The economy was a traditional economy in which households were required to pay taxes, usually in the form of the \"mit'a\" corv\u00e9e labor, and military obligations. The emperor controlled the economy of the two regions, while the Willaq Umu, or chief priest, was second to the emperor.", "prediction 2": "The Incan Empire, also known as the Inka Empire or the Inka Empire, was the largest empire in pre-Columbian America. The Sapa Inca was conceptualized as divine and was effectively head of the state religion. The Willaq Umu, or Chief Priest, was second to the emperor.", "prediction 3": "The Inca Empire, also known as the Incan Empire and the Inka Empire, was the largest empire in pre-Columbian America. Its political and administrative structure is considered to have been the most developed in the Americas before Columbus' arrival. The Sapa Inca was conceptualized as divine and was effectively head of the state religion. The Willaq Umu, or Chief Priest, was second to the emperor.", "prediction 4": "The Inca Empire, also known as the Incan Empire and the Inka Empire, was the largest empire in pre-Columbian America. The Sapa Inca was conceptualized as divine and was effectively the head of the state religion. The Willaq Umu, or Chief Priest, was second to the emperor.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 299, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 419 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Inca Empire, also known as Incan Empire and the Inka Empire, and at the time known as the Realm of the Four Parts, was the largest empire in pre-Columbian America.The economy was a traditional economy in which households were required to pay taxes. In return, the state provided security, food in times of hardship through the supply of emergency resources, agricultural projects (e.g. aqueducts and terraces) to increase productivity and occasional feasts." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Human interaction with the nitrogen cycle is primarily due to?", "passages": [ [ "Human impact on the nitrogen cycle", "Human impact on the nitrogen cycle\n\nHuman impact on the nitrogen cycle is diverse.", "Agricultural and industrial nitrogen (N) inputs to the environment currently exceed inputs from natural N fixation.", "As a consequence of anthropogenic inputs, the global nitrogen cycle (Fig. 1) has been significantly altered over the past century.", "Global atmospheric nitrous oxide (NO) mole fractions have increased from a pre-industrial value of ~270 nmol/mol to ~319 nmol/mol in 2005.", "Human activities account for over one-third of NO emissions, most of which are due to the agricultural sector.", "This article is intended to give a brief review of the history of anthropogenic N inputs, and reported impacts of nitrogen inputs on selected terrestrial and aquatic ecosystems.", "Approximately 78% of earth's atmosphere is N gas (N), which is an inert compound and biologically unavailable to most organisms.", "In order to be utilized in most biological processes, N must be converted to reactive N (Nr), which includes inorganic reduced forms (NH and NH), inorganic oxidized forms (NO, NO, HNO, NO, and NO), and organic compounds (urea, amines, and proteins)." ], [ "Human impact on the nitrogen cycle", "Nitrogen is a critical limiting nutrient in many systems, including forests, wetlands, and coastal and marine ecosystems; therefore, this change in emissions and distribution of Nr has resulted in substantial consequences for aquatic and terrestrial ecosystems.", "Atmospheric N inputs mainly include oxides of N (NO), ammonia (NH), and nitrous oxide (NO) from aquatic and terrestrial ecosystems, and NO from fossil fuel and biomass combustion.", "In agroecosystems, fertilizer application has increased microbial nitrification (aerobic process in which microorganisms oxidize ammonium [NH] to nitrate", "[NO]) and denitrification (anaerobic process in which microorganisms reduce NO to atmospheric nitrogen gas [N]).", "Both processes naturally leak nitric oxide (NO) and nitrous oxide (NO) to the atmosphere.", "Of particular concern is NO, which has an average atmospheric lifetime of 114\u2013120 years, and is 300 times more effective than CO as a greenhouse gas.", "NO produced by industrial processes, automobiles and agricultural fertilization and NH emitted from soils (i.e., as an additional byproduct of nitrification) and livestock operations are transported to downwind ecosystems, influencing N cycling and nutrient losses." ] ], "gold": "Human impact on the nitrogen cycle is diverse. Agricultural, industrial nitrogen, and fossil fuel combustion inputs to the environment currently exceed inputs from natural nitrogen fixation. Human activities account for over one-third of nitrogen emissions, most of which are due to the agricultural sector, including the planting of leguminous crops, fertilizer application, and agricultural nitrogen.", "prediction 1": "Human interaction with the nitrogen cycle is primarily due to Agricultural and industrial nitrogen inputs to the environment currently exceed inputs from natural N fixation. As a consequence of anthropogenic inputs, the global nitrogen cycle has been significantly altered over the past century. Human activities account for over one-third of NO emissions, most of which are due to the agricultural sector.", "prediction 2": "Human impact on the nitrogen cycle is diverse. Agricultural and industrial nitrogen (N) inputs to the environment currently exceed inputs from natural N fixation. As a consequence of anthropogenic inputs, the global nitrogen cycle has been significantly altered over the past century.", "prediction 3": "Human interaction with the nitrogen cycle is primarily due to human activities, such as Agricultural and industrial nitrogen (N) inputs to the environment currently exceed inputs from natural N fixation. As a consequence of anthropogenic inputs, the global nitrogen cycle has been significantly altered over the past century. Global atmospheric nitrous oxide (NO) mole fractions have increased from a pre-industrial value of 270 nmol/mol to 319 nmol/mol in 2005.", "prediction 4": "Human interaction with the nitrogen cycle is primarily due to human activities, including agricultural and industrial nitrogen (N) inputs to the environment currently exceed inputs from natural N fixation. The global nitrogen cycle as a consequence of anthropogenic inputs has been significantly altered over the past century. Atmospheric nitrogen inputs mainly include oxides of N (NO), ammonia (NH), and nitrous oxide (NO) from aquatic and terrestrial ecosystems, and NO from fossil fuel and biomass combustion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 295 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Human impact on the nitrogen cycle is diverse. Agricultural, industrial nitrogen, and fossil fuel combustion inputs to the environment currently exceed inputs from natural nitrogen fixation. Human activities account for over one-third of NO emissions, most of which are due to the agricultural sector." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is now the prime minister of england?", "passages": [ [ "Boris Johnson", "Boris Johnson\n\nAlexander Boris de Pfeffel Johnson (born 19 June 1964), better known as Boris Johnson, is a British politician, popular historian, and journalist.", "He has been the Member of Parliament (MP) for Uxbridge and South Ruislip since 2015.", "He had previously been the MP for Henley from 2001 to 2008.", "He was Mayor of London from 2008 to 2016, and from 2016 to 2018 he served as Secretary of State for Foreign and Commonwealth Affairs.", "A member of the Conservative Party, Johnson identifies as a one-nation conservative and has been associated with both economically and socially liberal policies.", "Born in New York City to wealthy upper-middle class English parents, Johnson was educated at the European School of Brussels, Ashdown House School, and Eton College.", "He studied Classics at Balliol College, Oxford, where he was elected president of the Oxford Union in 1986.", "He began his career in journalism at \"The Times\" but was sacked for falsifying a quotation.", "He later became \"The Daily Telegraph\"s Brussels correspondent, with his articles exerting a strong influence on growing Eurosceptic sentiment among the British right-wing.", "He was assistant editor from 1994 to 1999 before taking the editorship of \"The Spectator\" from 1999 to 2005." ], [ "Unionism in England", "Unionism in England\n\nIn England, Unionism is a political ideology which favours the continuation of some form of political union between England and the other countries of the United Kingdom (Scotland, Wales and Northern Ireland).", "It is part of the wider British unionist movement and is closely linked to the notion of Britishness.", "Unionism in England is characterised by both opposition to England's independence as a separate state and the belief that Scotland, Wales and Northern Ireland should continue to be constituent countries of the Union.", "The political union between the Kingdoms of England (also including Wales as an English possession) and Scotland was created by the Acts of Union, passed in the parliaments of both kingdoms in 1707 and 1706 respectively, which united the governments of what had previously been independent states (though they had shared the same monarch in a personal union since 1603) under the Parliament of Great Britain.", "The Union was brought into existence under the Acts of Union on 1 May 1707.", "With the Act of Union 1800, the Kingdom of Ireland united with Great Britain into what then formed the United Kingdom of Great Britain and Ireland.", "The history of the Unions is reflected in various stages of the Union Flag, which forms the flag of the United Kingdom." ], [ "Government of the United Kingdom", "Under the uncodified British constitution, executive authority lies with the monarch, although this authority is exercised only by, or on the advice of, the prime minister and the cabinet.", "The Cabinet members advise the monarch as members of the Privy Council.", "In most cases they also exercise power directly as leaders of the Government Departments, though some Cabinet positions are sinecures to a greater or lesser degree (for instance Chancellor of the Duchy of Lancaster or Lord Privy Seal).", "The current prime minister is Theresa May, who took office on 13 July 2016.", "She is the leader of the Conservative Party, which won a majority of seats in the House of Commons in the general election on 7 May 2015, when David Cameron was the party leader; although at the last general election she failed to secure a majority government.", "Prior to this, Cameron and the Conservatives led a coalition from 2010 to 2015 with the Liberal Democrats, in which Cameron was prime minister.", "The Government is occasionally referred to with the metonym Westminster, due to that being where many of the offices of the government are situated, especially by members in the Government of Scotland, the Welsh Government and the Northern Ireland Executive in order to differentiate it from their own.", "A key principle of the British Constitution is that the government is responsible to Parliament.", "This is called responsible government." ] ], "gold": "Who the prime minister of England is depends on the year. Since July 2019, Alexander Boris de Pfeffel Johnson has been serving as the Prime Minister of the United Kingdom, which includes the country of England. Previously, the prime minister of England was Theresa May from 2016 to 2019, David Cameron from 2010 to 2016, and Gordon Brown from 2007 to 2010.", "prediction 1": "Theresa May, currently the prime minister of England, took office on 13 July 2016. The current prime minister of England is Boris Johnson, who took office on 7 May 2015, David Cameron took office on 7 May 2015, and Theresa May took office on 13 July 2016. The Conservative Party won a majority of seats in the House of Commons in the general election on 7 May 2015, when David Cameron was the party leader; although at the last general election she failed to secure a majority government.", "prediction 2": "Theresa May took office in July 2016 and was responsible for the government of England from 2013 to 2016. Boris Johnson held the position in 2015, while Theresa May was the prime minister for the year.", "prediction 3": "The current prime minister of England is Theresa May, who took office on 13 July 2016.", "prediction 4": "Theresa May, the current prime minister of England, took office on 13 July 2016. The previous prime minister of England was David Cameron, who held the position from 2010 to 2015, and then from 2015 to 2016.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 87, "end": 120 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 139, "end": 169 }, { "error type": "Redundant", "explanation": "Theresa May, currently the prime minister of England, took office on 13 July 2016. ", "start": 215, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 488 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 196, "end": 210 } ], "missing-info": [], "corrected-prediction": "Theresa May, currently the prime minister of England, took office on 13 July 2016. Prior to this, Cameron was the prime minister. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How far is beaumont texas from the ocean?", "passages": [ [ "Port of Beaumont", "The port has the largest harbor mobile crane in the Gulf of Mexico region, a 140 mettric ton capacity crane with a 168-foot extension.", "The port also has three marine terminals.", "The Carroll Street wharf has 108,900 sq ft of covered storage and 1,435\u00a0ft of harbor front.", "The Harbor Island Marine terminal has 345,000 sq ft of covered and open storage with 1,880 feet of harbor frontage.", "The Jefferson Energy Terminal, located on 250 acres of land, has barge and ship docks.", "
\nThe port has highway and rail access in addition to the Sabine-Neches Waterway gulf and ocean access, and close proximity to the Gulf Intracoastal Waterway.", "Interstate 10, US Highway 90, US Highway 69, US Highway 96, and US Highway 287 provide highway access.", "Three major railways, the Burlington Northern Santa Fe Railway, the Kansas City Southern Railway, and the Union Pacific Railway provide rail connections to the port.", "The port's origins date to 1908, when crews dug a 9-foot-deep canal in the Neches River from Beaumont, Texas to the existing Port Arthur ship channel.", "The port's channel was later deepened to 25 feet and a turning basin was added.", "By the 1940s, the channel's depth was increased to 40 feet.", "Plans to deepen the Sabine-Neches Waterway to 48 feet received federal approval in 2014." ], [ "Southeast Texas", "Some residents of the Golden Triangle do not consider the Greater Houston area to be part of Southeast Texas and place the western boundary of the region approximately at the Trinity River, which is roughly 30 miles from downtown Houston.", "This area holds the annual South Texas State Fair in Beaumont.", "The Big Thicket is an area of dense forest located in the area just north and northwest of the city of Beaumont.", "There are many small towns in this area, including Woodville and Kountze.", "The Big Thicket National Preserve protects part of the old thicket, highlighting the area's biological resources.", "The 97,000 acre (390\u00a0km\u00b2) preserve boasts a varied ecology of piney woods, swamps, and coastal prairies.", "It includes extremely diverse range of plant species including orchids, cactus, cypress, and pine in close proximity to each other.", "Approximately 65,000 people visit this area each year.", "Two historically important routes cross the Big Thicket: to the north lies the old cattle route or Beef Trail, that ran from Tyler County to Louisiana; to the south is the Spanish Trail or the Atascosito Road, that parallels modern Highway90 and Interstate10 from Liberty to Orange.", "Galveston Bay is a large estuary located along Texas upper coast.", "The bay is fed by the Trinity River and the San Jacinto River, numerous local bayous, and incoming tides from the Gulf of Mexico." ] ], "gold": "The distance from Beaumont, TX to the gulf of Mexico is 30 miles, or 48 kilometers.", "prediction 1": "Beaumont, Texas is located in southeast Texas, approximately 30 miles from the ocean.\n", "prediction 2": "Beaumont is located in Southeast Texas and is approximately 30 miles from the Gulf of Mexico.", "prediction 3": "Beaumont, Texas is located about 45 miles from the ocean on the Sabine-Neches waterway in Galveston County.", "prediction 4": "Port of Beaumont is located on the Sabine-Neches Waterway, which provides an 87-mile (263-km) stretch of water between Texas and Louisiana, as well as close proximity to the Gulf Intracoastal Waterway and Interstate 10, US Highway 90, US Highway 69, US Highway 96, US Highway 287, and US Highway 287.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 46 }, { "error type": "Unverifiable", "explanation": "", "start": 47, "end": 86 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What is the meaning of the name viraj?", "passages": [ [ "Viraj", "Viraj\n\nViraj, this word in Sanskrit language, indicates sovereignty, excellence or splendour.", "Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator.", "Viraj is born from Purusha and Purusha in turn is born from Viraj.", "In the Atharvaveda, Viraj is a cow or with Prana, the life-breath.", "In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva.", "Manu Smriti 1.32 states that Brahma divided his body into two, one male and the other female, from the female was born Viraj who produced Svayambhuva Manu who created the ten Prajapatis.", "According to the \"Bhavishya Purana\" \u2013 the male was \"Manu\" and the female was \"Shatarupa\", creation commenced with the union of Viraj and Shatrupa.", "In the Vedanta, Viraj is identified with supreme intellect.", "Viraj is also the name of a metre." ], [ "Viraj", "It is the waking state of the Cosmic Self; the Cosmic Self as it passes through its four states \"Vaisvanara\", \"Taijasa\", \"Prajya\" and \"Atman\", comes to be called the \"Viraj\", \"Hiranyagarbha\", \"Isa\" and \"Brahman\" respectively.", "Viraj or Virat of the Bhagavad Gita is the Cosmic Body within which body is concentrated the entire creation consisting of both animate and inanimate beings, and whatever else one desires to see, and which Arjuna beheld with all its manifold divisions.", "Adi Shankara in his Bhasya on Brihadaranyaka Upanishad I.ii.3 explains that \"Viraj who was born, himself differentiated or divided himself, his body and organs, in three ways...So this Prana (Viraj), although the self, as it were, of all beings, is specially divided by himself as Death in three ways as fire, air and the sun, without, however, destroying his own form of Viraj.\"", "viraj" ] ], "gold": "The name Viraj has been given various meanings. Those can be sovereignty, excellence or splendour, although, in a general legendary historical context, it is the mythical primeval being associated with creation who is often personified as the secondary creator. When taken from the Mahabharata, it is also the name of the primeval being, Purusha, identified with Vishnu and Shiva, and the Cosmic Body within which body is concentrated the entire creation, as seen in the Bhagavad Gita. Viraj can also be used in contexts related to measurements, in which case it refers to a metre.", "prediction 1": "Viraj, this word in Sanskrit language, indicates sovereignty, excellence or splendour. Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator. In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva.", "prediction 2": "Viraj is the word in Sanskrit language that indicates sovereignty, excellence or splendour. Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator. In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva.", "prediction 3": "Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator. Viraj is born from Purusha and Purusha in turn is born from Viraj. In the Atharvaveda, Viraj is a cow or with Prana, the life-breath. In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva. In the Vedanta, Viraj is identified with supreme intellect.", "prediction 4": "Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator. In the Atharvaveda, Viraj is a cow or with Prana, the life-breath. In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva. In the Vedanta, Viraj is identified with supreme intellect.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Viraj, this word in Sanskrit language, indicates sovereignty, excellence or splendour. Viraj is the mythical primeval being associated with creation who is often personified as the secondary creator. In the Mahabharata Viraj is the name of the primeval being, Purusha, identified with Vishnu and Shiva. Further, Viraj of the Bhagavad Gita is the Cosmic Body within which body is concentrated the entire creation. Viraj is also the name of a metre." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote i see the moon the moon sees me?", "passages": [ [ "I See the Moon", "I See the Moon\n\n\"I See the Moon\", is a popular song written by Meredith Willson.", "The Mariners, in the United States, and The Stargazers, in the United Kingdom, had the best-known versions.", "The Stargazers' recording reached number one in the UK Singles Chart in 1954.", "In taking \"I See the Moon\" to number one, the Stargazers became the first act in British chart history to reach number one with their first two records to reach the chart.", "Several singles released in the interim failed to chart.", "The Stargazers' recording was produced by Dick Rowe, one of eight of his UK chart topping successes in that role.", "The Mariners' version, released in 1952, reached number 14 in the United States\n\nA recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954.", "It was released by EMI on the His Master's Voice label as catalog number B\u00a010675.", "Nancy Sinatra released a version on Reprise Records in 1963.", "In 1997, the English actress Phoebe Nicholls (as May Thrace) performed the song with piano accompaniment in an adaptation for television of Ruth Rendell's mystery, \"May and June\".", "It was described as her character's childhood favourite." ] ], "gold": "\"I See the Moon\" is a popular song, written by Meredith Wilson in 1953. The best known versions were created by The Mariners, in the United States, and The Stargazers, in the United Kingdom. The Stargazers' recording, released on the Decca Records label, reached number one in the UK Singles Chart in 1954. There is also a book called \"I See the Moon, The Moon Sees Me: Trevor Paglen's Satellite Views\" written by Brooke Belisle.", "prediction 1": "\"I See the Moon\", is a popular song written by Meredith Willson. The Mariners, in the United States, and The Stargazers, in the United Kingdom, had the best-known versions. In taking \"I See the Moon\" to number one, the Stargazers became the first act in British chart history to reach number one with their first two records to reach the chart. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954. Nancy Sinatra released a version on Reprise Records in 1963. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954.", "prediction 2": "\"I See the Moon\", is a popular song written by Meredith Willson. The Mariners, in the United States, and The Stargazers, in the United Kingdom, had the best-known versions of \"I See the Moon\", which reached number one in the UK Singles Chart in 1954. Don Cameron with Morton Fraser's Harmonica Band recorded the song in London on February 17, 1954 and it was released by EMI on the His Master's Voice label as catalog number B 10675. Nancy Sinatra released a version on Reprise Records in 1963. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954 and EMI on March 7, 1955. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954.", "prediction 3": "\"I See the Moon\", is a popular song written by Meredith Willson. The Mariners, in the United States, and The Stargazers, in the United Kingdom, had the best-known versions. A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954. It was released by EMI on the His Master's Voice label as catalog number B 10675. Nancy Sinatra released a version on Reprise Records in 1963. In 1997, the English actress Phoebe Nicholls performed the song with piano accompaniment in an adaptation for television of Ruth Rendell's mystery, May and June. In 1997, the English actress Phoebe Nicholls performed it with piano accompaniment in an adaptation for television of Ruth Rendell's mystery, May Thrace. It was described as her character's childhood favourite.", "prediction 4": "Meredith Willson wrote the song, I See the Moon, for The Mariners in the United States and The Stargazers in the United Kingdom.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 345, "end": 448 }, { "error type": "Irrelevant", "explanation": "", "start": 449, "end": 509 }, { "error type": "Redundant", "explanation": " A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954. ", "start": 510, "end": 613 }, { "error type": "Redundant", "explanation": " A recording by Don Cameron with Morton Fraser's Harmonica Band was made in London on February 17, 1954. ", "start": 614, "end": 717 } ], "missing-info": [], "corrected-prediction": "\"I See the Moon\", is a popular song written by Meredith Willson. The Mariners, in the United States, and The Stargazers, in the United Kingdom, had the best-known versions. In taking \"I See the Moon\" to number one, the Stargazers became the first act in British chart history to reach number one with their first two records to reach the chart. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first captain america movie come out?", "passages": [ [ "Captain America (1979 film)", "As Captain America, Steve's conversion van is re-configured so that it can launch a high-tech motorcycle.", "The bike features rocket thrust, a jet booster for rapid acceleration, a stealth setting that reduces engine and road noise, and (as shown only in \"\") a detachable wing resembling a hang glider that allows limited gravity-powered flight.", "In the last scene of the film, Rogers decides to become the same Captain America as his father had been in every way\u2014this means wearing an identical uniform to that which his father had worn, the \"classic\" Captain America uniform, which Brown, as the Captain, is shown wearing in the final scene.", "(Brown again wore the classic uniform when he reprised his roles as Rogers and as the Captain in \"Captain America II: Death Too Soon.\")", "The film was released theatrically in Colombia in 1981.", "The movie received a mixed reception from critics." ], [ "Captain America: The First Avenger", "The principal characters were cast between March and June 2010.", "Production of \"Captain America: The First Avenger\" began in June 2010, and filming took place in London, Manchester, Caerwent, and Liverpool in the United Kingdom, and Los Angeles in the United States.", "The film was converted to 3D in post-production.", "\"Captain America: The First Avenger\" premiered in Hollywood on July 19, 2011, and was released in the United States on July 22, 2011.", "The film was commercially successful, grossing over $370 million worldwide.", "Critics particularly praised Evans' performance, the film's depiction of its 1940s time period and Johnston's direction, though some felt that the film only served to set up the forthcoming \"Avengers\" film.", "A sequel titled \"\" was released on April 4, 2014, and a third film titled \"\" was released on May 6, 2016.", "In the present day, scientists in the Arctic uncover an old, frozen aircraft.", "In March 1942, Nazi officer Johann Schmidt and his men steal a mysterious relic called the Tesseract, which possesses untold powers, from the town of T\u00f8nsberg in German-occupied Norway.", "In New York City, Steve Rogers is rejected for World War II military recruitment because of various health and physical problems.", "While attending an exhibition of future technologies with his friend, Sgt." ], [ "Captain America", "Captain America\n\nCaptain America (Steve Rogers) is a fictional superhero appearing in American comic books published by Marvel Comics.", "Created by cartoonists Joe Simon and Jack Kirby, the character first appeared in \"Captain America Comics\" #1 (cover dated March 1941) from Timely Comics, a predecessor of Marvel Comics.", "Captain America was designed as a patriotic supersoldier who often fought the Axis powers of World War II and was Timely Comics' most popular character during the wartime period.", "The popularity of superheroes waned following the war and the \"Captain America\" comic book was discontinued in 1950, with a short-lived revival in 1953.", "Since Marvel Comics revived the character in 1964, Captain America has remained in publication.", "The character wears a costume bearing an American flag motif, and he utilizes a nearly indestructible shield which he throws as a projectile.", "Captain America is the alter ego of Steve Rogers, a frail young man enhanced to the peak of human perfection by an experimental serum to aid the United States government's efforts in World War II.", "Near the end of the war, he was trapped in ice and survived in suspended animation until he was revived in the present day.", "Although Captain America often struggles to maintain his ideals as a man out of his time with its modern realities, he remains a highly respected figure in his community which includes becoming the long-time leader of the Avengers." ] ], "gold": "There have been various movies based on Marvel Comic's Captain America. An early example is an American made-for-television movie about the character released on January 19, 1979. However, it would also be run in theaters in Colombia in 1981. Most famously, the character would make his debut in the Marvel Cinematic Universe on July 19, 2011, when the film Captain America: The First Avenger premiered at El Capitan Theatre. It was later released across the US on July 22, 2011.", "prediction 1": "Captain America is a fictional superhero appearing in American comic books published by Marvel Comics. The character first appeared in Captain America Comics #1 (cover dated March 1941) from Timely Comics, a predecessor of Marvel Comics. The first Captain America movie came out in Colombia in 1981. The film premiered in Hollywood on July 19, 2011 and was released in the United States on July 22, 2011.", "prediction 2": "Captain America is a fictional superhero appearing in American comic books published by Marvel Comics. The character first appeared in Captain America Comics #1 on March 21, 1941 and was revived by Marvel Comics in 1964. The first Captain America movie came out on July 19, 2011 in Hollywood and on July 22, 2011 in the United States.", "prediction 3": "Captain America is a fictional superhero appearing in American comic books published by Marvel Comics. The character first appeared in Captain America Comics #1 (cover dated March 1941) from Timely Comics, a predecessor of Marvel Comics. Production of Captain America: The First Avenger began in June 2010, and filming took place in London, Manchester, Caerwent, and Liverpool in the United Kingdom, and Los Angeles in the United States. The film premiered in Hollywood on July 19, 2011, and was released in the United States on July 22, 2011. The film was converted to 3D in post-production.", "prediction 4": "Captain America is a fictional superhero appearing in American comic books published by Marvel Comics. The character first appeared in Captain America Comics #1 (cover dated March 1941) from Timely Comics, a predecessor of Marvel Comics. The first Captain America movie came out in Colombia in 1981. The film was converted to 3D in postproduction and premiered in Hollywood on July 19, 2011, and was released in the United States on July 22, 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 102 }, { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 237 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 300, "end": 308 } ], "missing-info": [], "corrected-prediction": "The first Captain America movie came out in Colombia in 1981. \"Captain America: The First Avenger\" premiered in Hollywood on July 19, 2011 and was released in the United States on July 22, 2011." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the space between two sets of doors called?", "passages": [ [ "Mantrap (access control)", "Mantrap (access control)\n\nA mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens.", "In a manual mantrap, a guard locks and unlocks each door in sequence.", "An intercom and/or video camera are often used to allow the guard to control the trap from a remote location.", "Airlocks have a very similar structure to mantraps but are used for the opposite purpose, allowing free ingress and egress (while also restricting airflow).", "In an automatic mantrap, identification may be required for each door, sometimes even possibly different measures for each door.", "For example, a key may open the first door, but a personal identification number entered on a number pad opens the second.", "Other methods of opening doors include proximity cards or biometric devices such as fingerprint readers or iris recognition scans.", "Metal detectors are often built in, in order to prevent entrance of people carrying weapons.", "This use is particularly frequent in banks and jewelry shops.", "Fire codes require that automatic mantraps allow exit from the intermediate space while denying access to a secure space such as a data center or research lab." ], [ "Vestibule (architecture)", "Vestibule (architecture)\n\nA vestibule is an anteroom (antechamber) or small foyer leading into a larger space, such as a lobby, entrance hall, passage, etc., for the purpose of waiting, withholding the larger space view, reducing heat loss, providing space for outwear, etc.", "The term applies to structures in both modern and historical architecture since ancient times.", "In modern architecture, vestibule typically refers to a small room next to the outer door and connecting it with the interior of the building.", "In ancient Roman architecture, vestibule () referred to a partially enclosed area between the interior of the house and the street.", "In contemporary usage, a vestibule constitutes an area surrounding the exterior door.", "It acts as an antechamber between the exterior and the interior structure.", "Often it connects the doorway to a lobby or hallway.", "It is the space one occupies once passing the door, but not yet in the main interior of the building \n\nAlthough vestibules are common in private residences, as a modified mud room, they are especially prevalent in more opulent buildings, such as government ones, designed to elicit a sense of grandeur by contrasting the vestibule's small space with the following greater one, and by adding the aspect of anticipation." ] ], "gold": "A mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens. Airlocks have a very similar design, allowing free ingress and egress while also restricting airflow. A vestibule, also known as an arctic entry, is an anteroom or small foyer leading into a larger space such as a lobby, entrance hall or passage, for the purpose of waiting, withholding the larger space view, reducing heat loss, providing space for outdoor clothing, etc.", "prediction 1": "A mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens. In modern architecture, vestibule typically refers to a small room next to the outer door and connecting it with the interior of the building. In ancient Roman architecture, vestibule referred to a partially enclosed area between the interior of the house and the street. In contemporary usage, vestibule constitutes an area surrounding the exterior door. It acts as an antechamber between the exterior and the interior of the structure. It acts as an antechamber between the exterior and the interior structure.", "prediction 2": "A mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens. In modern architecture, vestibule typically refers to a small room next to the outer door and connecting it with the interior of the building. In ancient Roman architecture, vestibule referred to a partially enclosed area between the interior of the house and the street. In contemporary usage, a vestibule constitutes an area surrounding the exterior door. It acts as an antechamber between the exterior and the interior structure.", "prediction 3": "A mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens. In modern architecture, a vestibule typically refers to a small room next to the outer door and connecting it with the interior of the building. In ancient Roman architecture, a vestibule referred to a partially enclosed area between the interior of the house and the street. In contemporary usage, a vestibule constitutes an area surrounding the exterior door.", "prediction 4": "In physical security access control systems, the space behind two sets of doors is called a mantrap, air lock, sally port or access control vestibule. A vestibule is an anteroom or small foyer leading into a larger space, such as a lobby, entrance hall, passage, etc., for the purpose of waiting, withholding the larger space view, reducing heat loss, providing space for outwear, etc. In modern architecture, vestibule typically refers to a small room next to the outer door and connecting it with the interior of the building. In ancient Roman architecture, vestibule referred to a partially enclosed area between the interior and the structure. In contemporary usage, a vestibule constitutes an area surrounding the exterior door. It acts as an antechamber between the exterior and the interior structure.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 382 }, { "error type": "Irrelevant", "explanation": "", "start": 383, "end": 511 }, { "error type": "Irrelevant", "explanation": "", "start": 512, "end": 595 }, { "error type": "Irrelevant", "explanation": "", "start": 596, "end": 752 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "A mantrap, air lock, sally port or access control vestibule is a physical security access control system comprising a small space with two sets of interlocking doors, such that the first set of doors must close before the second set opens. Airlocks have a very similar design, allowing free ingress and egress while also restricting airflow. A vestibule is an anteroom (antechamber) or small foyer leading into a larger space, such as a lobby, entrance hall, passage, etc., for the purpose of waiting, withholding the larger space view, reducing heat loss, providing space for outwear, etc." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the tampa bay buccaneers win the super bowl?", "passages": [ [ "Tampa Bay Buccaneers", "Playing against the #1 offense in the league led by league MVP Rich Gannon, the defense actually outscored the Raiders offense, allowing 2 offensive touchdowns while returning 3 interceptions for touchdowns.", "The defense set two records in the 48\u201321 blowout, one for most interceptions in a Super Bowl (5), and one for most interceptions returned for touchdowns in a Super Bowl (3).", "In 19 total games in 2002, the Buccaneers recorded 40 interceptions, 53 sacks, and 9 defensive touchdowns.", "Since 1998 the Buccaneers have played their home games at Raymond James Stadium in Tampa.", "Prior to that they played in Tampa Stadium since their establishment.", "In 1975, the Buccaneers built a small practice complex with offices near Tampa International Airport called One Buccaneer Place - often shorted to \"One Buc Place.\"", "The team utilized the unspectacular facility through the 1990s and into the early 2000s.", "As other NFL clubs began replacing and upgrading their respective facilities, Buccaneers players and coaches stepped up their complaints about the constant aircraft noise, cramped offices, small locker rooms, and decrepit condition of One Buc Place.", "Then-head coach Jon Gruden sarcastically referred to the facility as \"The Woodshed,\" and some of the coaches' offices were actually converted broom closets." ], [ "Tampa Bay Buccaneers", "Tampa Bay Buccaneers\n\nThe Tampa Bay Buccaneers are a professional American football franchise based in Tampa, Florida.", "The Buccaneers currently compete in the National Football League (NFL) as a member team of the National Football Conference (NFC) South division.", "Along with the Seattle Seahawks, the team joined the NFL in as an expansion team.", "The Bucs played their first season in the American Football Conference (AFC) West division as part of the 1976 expansion plan, whereby each new franchise would play every other franchise over the first two years.", "After the season, the club switched conferences with the Seahawks and became a member of the NFC Central division.", "During the 2002 league realignment, the Bucs joined three former NFC West teams to form the NFC South.", "The club is owned by the Glazer family, and plays its home games at Raymond James Stadium in Tampa.", "The Buccaneers are the first post-merger expansion team to win a division title, win a playoff game, and to host and play in a conference championship game; all three accomplishments occurred during the 1979 season.", "They are also the first team since the merger to complete a winning season when starting 10 or more rookies, which happened in the 2010 season.", "In 1976 and 1977, the Buccaneers lost their first 26 games.", "They would not win their first game in franchise history until Week 13, of 14, in 1977." ], [ "Super Bowl XLVII", "CBS broadcast the game in the U.S., and charged an average of $4 million for a 30-second commercial during the game, the highest rate for any Super Bowl.", "According to Nielsen, Super Bowl XLVII was viewed by an estimated average of 108.69 million people in the United States, with a record 164.1 million tuning into at least six minutes of the game.", "Beyonc\u00e9 performed in the Super Bowl XLVII halftime show, which featured a reunion with fellow Destiny's Child alumnae Kelly Rowland and Michelle Williams.", "The game marked the first Super Bowl in which both of the teams had appeared in, but had not yet lost a previous Super Bowl; the 49ers came into the game having won all five of their previous Super Bowl appearances, while the Ravens had won in their lone previous Super Bowl appearance in Super Bowl XXXV against the New York Giants.", "Currently, this phenomenon can only be repeated if either the Ravens or the New York Jets play against either the Tampa Bay Buccaneers or the New Orleans Saints in a subsequent Super Bowl.", "Baltimore's victory made them the only current NFL franchise to have appeared in at least two Super Bowls without ever losing any of their appearances.", "Three cities presented bids for the game:\n\nThe league then selected the New Orleans bid during the NFL's Spring Ownership Meetings in Fort Lauderdale, Florida on May 19, 2009." ] ], "gold": "The Tampa Bay Buccaneers are a professional American football team based in Tampa, Florida. The Buccaneers have won two Super Bowl titles. They are the champions of Super Bowl XXXVII which was held on January 26, 2003, and Super Bowl LV which was held on February 7, 2021.", "prediction 1": "The Tampa Bay Buccaneers have won the Super Bowl on several occasions. In Super Bowl XLVII in 1999, the Buccaneers defeated the Oakland Raiders 48-21. In Super Bowl XLVII in 2000, the Buccaneers defeated the Seattle Seahawks 45\u201323.", "prediction 2": "The Tampa Bay Buccaneers won the Super Bowl in February 2000, when they defeated the Oakland Raiders 48\u201321. The team played their home games at Raymond James Stadium in Tampa.", "prediction 3": "The Tampa Bay Buccaneers have won Super Bowl XLVII on February 5, 2019. In the 2018 season, the Buccaneers won the Super Bowl XLVII in Green Bay, Wisconsin. The team competed in the Super Bowl XLVII in Tampa, Florida in 2019.", "prediction 4": "The Tampa Bay Buccaneers won the Super Bowl in February 2002. The team has played their home games at Raymond James Stadium since its establishment in 1975. The team's lone winning season was in 1977 when they won Super Bowl XLVII.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 94, "end": 99 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 104, "end": 143 }, { "error type": "Unverifiable", "explanation": "", "start": 174, "end": 179 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 184, "end": 224 }, { "error type": "Unverifiable", "explanation": "", "start": 49, "end": 70 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Tampa Bay Buccaneers are a professional American football franchise based in Tampa, Florida. They have won at least one Super Bowl by defeating the Raiders, that Super Bowl was before Super Bowl XLVII." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the facebook messenger app come out?", "passages": [ [ "Facebook Messenger", "Facebook Messenger\n\nFacebook Messenger (commonly known as Messenger) is a messaging app and platform.", "Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010, and subsequently released standalone iOS and Android apps in August 2011.", "Over the years, Facebook has released new apps on a variety of different operating systems, launched a dedicated website interface, and separated the messaging functionality from the main Facebook app, requiring users to use the web interface or download one of the standalone apps.", "Users can send messages and exchange photos, videos, stickers, audio, and files, as well as react to other users' messages and interact with bots.", "The service also supports voice and video calling.", "The standalone apps support using multiple accounts, conversations with optional end-to-end encryption, and playing games.", "Following tests of a new instant messaging platform on Facebook in March 2008, the feature, then-titled \"Facebook Chat\", was gradually released to users in April 2008.", "Facebook revamped its messaging platform in November 2010, and subsequently acquired group messaging service Beluga in March 2011, which the company used to launch its standalone iOS and Android mobile apps on August 9, 2011.", "Facebook later launched a BlackBerry version in October 2011.", "An app for Windows Phone, though lacking features including voice messaging and chat heads, was released in March 2014." ] ], "gold": "Facebook Messenger, an American instant messaging app and platform developed by Facebook, Inc., was originally developed as Facebook Chat in 2008. The company revamped the service in 2010, and released standalone messenger apps for both iOS and Android in August 2011, as well as a standalone Facebook Portal hardware for Messenger-based calling in 2018. Later on, Facebook has launched a dedicated website interface Messenger.com, and separated the messaging functionality from the main Facebook app, allowing users to use the web interface or download one of the standalone apps. In April 2020, Facebook officially released Messenger for Desktop, which is supported on Windows 10 and macOS and distributed on Microsoft Store and App Store respectively.", "prediction 1": "Facebook Messenger is a messaging app and platform developed by Facebook. Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010, and subsequently released standalone iOS and Android apps in August 2011. The standalone apps were launched on August 9, 2011 for the iPhone and iPad.", "prediction 2": "Facebook Messenger is a messaging app and platform. Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010 and subsequently released standalone iOS and Android apps in August 2011. Over the years, Facebook has released new apps on a variety of different operating systems, launched a dedicated website interface, and separated the messaging functionality from the main Facebook app, requiring users to use the web interface or download one of the standalone apps.", "prediction 3": "Facebook Messenger is a messaging app and platform. Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010 and subsequently released standalone iOS and Android apps in August 2011. Facebook revamped its messaging platform in November 2010 and subsequently acquired group messaging service Beluga in March 2011, which the company used to launch its standalone iOS and Android mobile apps on August 9, 2011. Facebook later launched a BlackBerry version in October 2011.", "prediction 4": "Facebook Messenger is a messaging app and platform. Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010, and subsequently released standalone iOS and Android apps in August 2011.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010, and subsequently released standalone iOS and Android apps in August 2011. ", "start": 247, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 318, "end": 323 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Facebook Messenger is a messaging app and platform developed by Facebook. Originally developed as Facebook Chat in 2008, the company revamped its messaging service in 2010, and subsequently released standalone iOS and Android apps in August 2011. Over the years, Facebook has released new apps on a variety of different operating systems, launched a dedicated website interface, and separated the messaging functionality from the main Facebook app, requiring users to use the web interface or download one of the standalone apps." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who has the most home runs in a home run derby?", "passages": [ [ "Home Run Derby", "Home Run Derby\n\n\n", "The Home Run Derby is an annual home run hitting contest in Major League Baseball (MLB) customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July.", "Since the inaugural derby in 1985, the event has seen several rule changes, evolving from a short outs-based competition, to multiple rounds, and eventually a bracket-style timed event.", "The event has grown significantly from its roots in the 1980s, when it was not televised.", "Prior to 1991, the Home Run Derby was structured as a two-inning event with each player receiving five outs per inning, allowing for the possibility of ties.", "It is now one of the most-watched events broadcast on ESPN.", "In 2000, a \"match play\"-style format was instituted for the second round.", "The player with the most home runs in the first round faced the player with the least among the four qualifying players, as did the players with the second- and third-most totals.", "The contestant who won each matchup advanced to the finals.", "This format was discontinued after the 2003 competition.", "The field of players selected currently consists of four American League players and four National League players.", "The first Derby in 1985 featured five from each league, and the 1986 and 1987 events featured three and two players from each league, respectively." ] ], "gold": "The Home Run Derby is an annual home run hitting competition in Major League Baseball (MLB) customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. Vladimir Guerrero Jr. has the record for the most home runs in a single round in a Home Run Derby. Joc Pederson has the record for the most all-time home runs in a Home Run Derby.", "prediction 1": "The Home Run Derby is an annual home run hitting contest in Major League Baseball customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. The player with the most home runs in a Home Run Derby is usually a member of the National League. The previous record holder is the defending champions, the AL Central Division champions, and the AL Central Division champions.", "prediction 2": "The Home Run Derby is an annual home run hitting contest in Major League Baseball (MLB) customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. The player with the most home runs in a Home Run Derby is the team that has scored the most runs in a single season. The player who scored the most home runs in a single season is typically the team that has scored the most home runs in a single season.", "prediction 3": "The Home Run Derby is an annual home run hitting contest in Major League Baseball customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. The player with the most home runs in the first round faced the player with the least among the four qualifying players, as did the players with the second- and third-most totals. The contestant who won each matchup advanced to the finals.", "prediction 4": "The Home Run Derby is an annual home run hitting contest in Major League Baseball customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. The player with the most home runs in a home run derby is whoever has the most total home runs during the first round of the competition.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 281 }, { "error type": "Unverifiable", "explanation": "", "start": 282, "end": 410 } ], "missing-info": [], "corrected-prediction": "The Home Run Derby is an annual home run hitting contest in Major League Baseball customarily held the day before the MLB All-Star Game, which places the contest on a Monday in July. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the first one day world cup?", "passages": [ [ "Cricket World Cup", "India volunteered to host the third Cricket World Cup, but most ICC members preferred England as the longer period of daylight in England in June meant that a match could be completed in one day.", "The 1987 Cricket World Cup was held in India and Pakistan, the first hosted outside England.", "Many of the tournaments have been jointly hosted by nations from the same geographical region, such as South Asia in 1987, 1996 and 2011, Australasia in 1992 and 2015, Southern Africa in 2003 and West Indies in 2007.", "Twenty nations have qualified for the Cricket World Cup at least once.", "Seven teams have competed in every tournament, five of which have won the title.", "The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "The West Indies (1975 and 1979) and Australia (1999, 2003 and 2007) are the only teams to have won consecutive titles.", "Australia has played in seven of the eleven finals (1975, 1987, 1996, 1999, 2003, 2007, 2015).", "England has yet to win the World Cup, but has been runners-up three times (1979, 1987, 1992)." ], [ "Cricket World Cup", "Cricket World Cup\n\n", "The ICC Cricket World Cup is the international championship of One Day International (ODI) cricket.", "The event is organised by the sport's governing body, the International Cricket Council (ICC), every four years, with preliminary qualification rounds leading up to a finals tournament.", "The tournament is one of the world's most viewed sporting events and is considered the \"flagship event of the international cricket calendar\" by the ICC.", "The first World Cup was organised in England in June 1975, with the first ODI cricket match having been played only four years earlier.", "However, a separate Women's Cricket World Cup had been held two years before the first men's tournament, and a tournament involving multiple international teams had been held as early as 1912, when a triangular tournament of Test matches was played between Australia, England and South Africa.", "The first three World Cups were held in England.", "From the 1987 tournament onwards, hosting has been shared between countries under an unofficial rotation system, with fourteen ICC members having hosted at least one match in the tournament.", "The World Cup is open to all members of the International Cricket Council (ICC), although the highest-ranking teams receive automatic qualification.", "The remaining teams are determined via the World Cricket League and the ICC World Cup Qualifier." ] ], "gold": "The Cricket World Cup is the international championship of One Day International cricket, which is organized every four years with preliminary qualification rounds leading up to a finals tournament. There is a difference between cricket matches and cricket finals tournaments. The England cricket team won the first One Day World Cup match, and the West Indies cricket team won the first One Day World Cup final.", "prediction 1": "The first one day cricket world cup was held in England in June 1975. Australia won the first two tournaments, the West Indies won the first two, the West Indies won the first two and the New Zealanders won the first. The first ODI World Cup was held in India and Pakistan in 1987.", "prediction 2": "The ICC Cricket World Cup is the international championship of One Day International cricket. The first one day World Cup was organised in England in June 1975, with the first ODI cricket match having been played only four years earlier. The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "prediction 3": "The first one day world cup was organised in England in June 1975, with the first ODI cricket match having been played only four years earlier. In addition, the West Indies won the first two tournaments, Australia won five and India won two, while Pakistan and Sri Lanka each won once.", "prediction 4": "The first one day world cup was organised in England in June 1975, with the first ODI cricket match having been played only four years earlier. The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 218, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 69 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 70, "end": 217 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Cricket World Cup is the international championship of One Day International cricket, which is organized every four years with preliminary qualification rounds leading up to a finals tournament. The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How much population is below poverty line in india?", "passages": [ [ "Poverty in India", "Some semi-economic and non-economic indices have also been proposed to measure poverty in India; for example, the Multi-dimensional Poverty Index placed 33% weight on number of years spent in school and education and 6.25% weight on financial condition of a person, in order to determine if that a person is poor.", "The different definitions and different underlying small sample surveys used to determine poverty in India, have resulted in widely different estimates of poverty from 1950s to 2010s.", "In 2012, the Indian government stated 22% of its population is below its official poverty limit.", "The World Bank, in 2011 based on 2005's PPPs International Comparison Program, estimated 23.6% of Indian population, or about 276 million people, lived below $1.25 per day on purchasing power parity.", "According to United Nation's Millennium Development Goals (MDG) programme 270 millions or 21.9% people out of 1.2 billion of Indians lived below poverty line of $1.25 in 2011-2012.", "From late 19th century through early 20th century, under British colonial rule, poverty in India intensified, peaking in the 1920s.", "Famines and diseases killed millions each time.", "After India gained its independence in 1947, mass deaths from famines were prevented.", "Rapid economic growth since 1991, has led to sharp reductions in extreme poverties in India." ], [ "Standard of living in India", "Standard of living in India\n\nStandard of living in India varies from state to state.", "With one of the fastest growing economies in the world, clocked at a growth rate of 7.6% in 2015, India is on its way to becoming a large and globally important consumer economy.", "According to Deutsche Bank Research, there are between 30 million and 300 million middle-class people in India.", "If current trends continue, India's share of world GDP will significantly increase from 7.3 in 2016 to 8.5 percent of the world share by 2020.", "In 2011, less than 22 percent of Indians lived under the global poverty line, nearly an 8 percent reduction from 29.8 percent just two years prior in 2009.", "According to NCAER, India's middle class population would be 267 million in 2016.", "Further ahead, by 2025-26 the number of middle class households in India is likely to more than double from the 2015-16 levels to 113.8 million households or 547 million individuals.", "Another estimate put the Indian middle class as numbering 475 million people by 2030.", "It is estimated that average real wages will quadruple between 2013 and 2030.", "The standard of living in India shows large disparity.", "For example, there is widespread poverty in rural areas of India, where medical care tends to be very basic or unavailable, while cities boast of world class medical establishments." ] ], "gold": "According to the United Nations Millennium Development Goals (MDG) , 270 million people out of 1.2 billion Indians, roughly equal to 22% of India's population, lived below the poverty line of $1.25 in 2011-2012. As of 2020, the incidence of multidimensional poverty has significantly reduced from 54.7 percent in 2005 to 27.5 percent in 2015-16.", "prediction 1": "In 2012, the Indian government stated 22% of its population is below its official poverty limit. According to United Nations' Millennium Development Goals programme, 270 million or 21.9% people out of 1.2 billion of Indians lived below poverty line of $1.25 in 2011-2018. According to Deutsche Bank Research, there are between 30 million and 300 million middle-class people in India.", "prediction 2": "There are different estimates of poverty in India. In 2012, the Indian government stated 22 percent of its population is below its official poverty limit. The World Bank, in 2011 based on 2005's PPPs International Comparison Program, estimated 23.6% of Indian population, or about 276 million people, lived below $1.25 per day on purchasing power parity. According to United Nation's Millennium Development Goals programme 270 million or 21.9% people out of 1.2 billion of Indians lived below poverty line of $1.25 in 2011-2012.", "prediction 3": "The World Bank, in 2011, based on 2005's PPPs International Comparison Program, estimated 23.6% of Indian population, or about 276 million people, lived below $1.25 per day on purchasing power parity. According to United Nations Millennium Development Goals programme 270 millions or 21.9% people out of 1.2 billion of Indians lived below poverty line of $1.25 in 2011-2012.", "prediction 4": "In 2011, less than 22 percent of Indians lived below the global poverty line, nearly an 8 percent reduction from 29.8 percent just two years prior in 2009. According to United Nations' Millennium Development Goals programme, 270 million people, or 21.9%, of the population, lived below poverty line of $1.25 per day in 2011-2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 383 } ], "missing-info": [], "corrected-prediction": "According to United Nations' Millennium Development Goals programme, 270 million or 21.9% people out of 1.2 billion of Indians lived below poverty line of $1.25 in 2011-2018. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did google make the self driving car?", "passages": [ [ "History of self-driving cars", "In 2010, the Institute of Control Engineering of the Technische Universit\u00e4t Braunschweig demonstrated the first autonomous driving on public streets in Germany with the research vehicle Leonie.", "It was the first car licensed for autonomous driving on the streets and highways in Germany.", "In October 2010, an attorney for the California Department of Motor Vehicles, raised concerns that \"[t]he technology is ahead of the law in many areas\", citing state laws that \"all presume to have a human being operating the vehicle\".", "In 2011, the Freie Universit\u00e4t Berlin developed two autonomous cars to drive in the innercity traffic of Berlin in Germany.", "Led by the AutoNOMOS group, the two vehicles Spirit of Berlin and MadeInGermany handled intercity traffic, traffic lights and roundabouts between International Congress Centrum and Brandenburg Gate.", "It was financed by the German Federal Ministry of Education and Research.", "Nevada passed a law in June 2011 concerning the operation of autonomous cars in Nevada, which went into effect on March 1, 2012.", "A Toyota Prius modified with Google's experimental driverless technology was licensed by the Nevada Department of Motor Vehicles (DMV) in May 2012.", "This was the first license issued in the United States for a self-driven car." ], [ "Waymo", "A Toyota Prius modified with Google's experimental driverless technology was licensed by the Nevada Department of Motor Vehicles (DMV) in May 2012.", "This was the first license issue in the United States for a self-driven car.", "In late May 2014, Google revealed a new prototype of its driverless car, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and unveiled a fully functioning prototype in December of that year that they planned to test on San Francisco Bay Area roads beginning in 2015.", "Called the Firefly, the car was intended to serve as a platform for experimentation and learning, not mass production.", "In 2015, Google provided \"the world's first fully driverless ride on public roads\" to a legally blind friend of principal engineer Nathaniel Fairfield.", "The ride was taken by Steve Mahan, former CEO of the Santa Clara Valley Blind Center, in Austin, Texas.", "It was the first driverless ride that was on a public road and was not accompanied by a test driver or police escort.", "The car had no steering wheel or floor pedals.", "In December 2016, the unit was renamed Waymo, and made into its own separate division in Alphabet.", "The name Waymo is derived from its mission, \"a new way forward in mobility\".", "Waymo moved to further test its cars on public roads after becoming its own subsidiary." ], [ "Waymo", "Waymo\n\nWaymo LLC is a self-driving technology development company.", "It is a subsidiary of Alphabet Inc. Waymo originated as a project of Google before it became a stand-alone subsidiary in December 2016.", "In April 2017, Waymo started a limited trial of a self-driving taxi service in Phoenix, Arizona.", "On December 5, 2018 the service launched its first commercial self-driving car service called \"Waymo One\", where users in the Phoenix metropolitan area can use an app to request the service.", "Google's development of self-driving technology began in 2009 at the company's secretive X lab run by co-founder Sergey Brin.", "The project was originally led by Sebastian Thrun, former director of the Stanford Artificial Intelligence Laboratory and co-inventor of Google Street View.", "Thrun's team at Stanford created the robotic vehicle Stanley, which won the 2005 DARPA Grand Challenge and its prize from the United States Department of Defense.", "The team developing the system consisted of 15 engineers working for Google, including Chris Urmson, Dmitri Dolgov, Mike Montemerlo, and Anthony Levandowski who had worked on the DARPA Grand and Urban Challenges.", "Starting in 2010, lawmakers in various states expressed concerns over how to regulate the emerging technology.", "Nevada passed a law in June 2011 concerning the operation of autonomous cars in Nevada, which went into effect on March 1, 2012." ] ], "gold": "Google's development of self-driving technology began on January 17, 2009, at the company's secretive Google X lab run by co-founder Sergey Brin, and was launched by Sebastian Thrun, and Anthony Levandowski. In May 2012, A Toyota Prius modified with Google's experimental driverless technology was licensed by the Nevada DMV in May 2012. The car was \"driven\" by Chris Urmson with Anthony Levandowski in the passengers seat and was the first license issued in the United States for a self-driven car. In late May 2014, Google revealed a new prototype of its driverless car, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and in December, they unveiled a fully functioning prototype that they planned to test on San Francisco Bay Area roads beginning in early 2015. ", "prediction 1": "In late May 2014, Google revealed a new prototype of its driverless car, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and unveiled a fully functioning prototype in December of that year that they planned to test on San Francisco Bay Area roads beginning in 2015. Called the Firefly, the car was intended to serve as a platform for experimentation and learning, not mass production. In 2015, Google provided \"the world's first fully driverless ride on public roads\" to a legally blind friend of principal engineer Nathaniel Fairfield. This ride was taken by Steve Mahan, former CEO of the Santa Clara Valley Blind Center, in Austin, Texas. It was the first driverless ride that was on a public road and was not accompanied by a test driver or police escort. On December 5, 2018, the service launched its first commercial self-driving taxi service called Waym", "prediction 2": "Google's development of self-driving technology began in 2009 at the company's secretive X lab run by co-founder Sergey Brin. The project was originally led by Sebastian Thrun, former director of the Stanford Artificial Intelligence Laboratory and co-inventor of Google Street View. Google revealed a new prototype of its driverless car in late May 2014, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and unveiled a fully functioning prototype in December of that year that they planned to test on San Francisco Bay Area roads beginning in 2015. The company released its first commercial self-driving taxi service in Phoenix, Arizona on December 5, 2018, which users can request the service.", "prediction 3": "In 2010, the Institute of Control Engineering of the Technische Universit\u00e4t Braunschweig demonstrated the first autonomous driving on public streets in Germany with the research vehicle Leonie. In late May 2014, Google revealed a new prototype of its driverless car, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and unveiled a fully functioning prototype in December of that year that they planned to test on San Francisco Bay Area roads beginning in 2015. Called the Firefly, the car was intended to serve as a platform for experimentation and learning, not mass production.", "prediction 4": "Google's development of self-driving technology began in 2009 at the company's secretive X lab run by co-founder Sergey Brin. The project was originally led by Sebastian Thrun, former director of the Stanford Artificial Intelligence Laboratory and co-inventor of Google Street View. The project was a joint collaboration between the X lab and the Google Cloud Platform. The final prototype, called Firefly, was shown in late May 2014 and was planned to be tested on San Francisco Bay Area roads beginning in 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 567 }, { "error type": "Irrelevant", "explanation": "", "start": 568, "end": 790 }, { "error type": "Irrelevant", "explanation": "", "start": 791, "end": 891 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Google's development of self-driving technology began in 2009 at the company's secretive X lab run by co-founder Sergey Brin. The project was originally led by Sebastian Thrun. A Toyota Prius modified with Google's experimental driverless technology was licensed by the Nevada Department of Motor Vehicles (DMV) in May 2012. This was the first license issued in the United States for a self-driven car. In late May 2014, Google revealed a new prototype of its driverless car, which had no steering wheel, gas pedal, or brake pedal, being 100% autonomous, and unveiled a fully functioning prototype in December of that year that they planned to test on San Francisco Bay Area roads beginning in 2015. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What movie has the song nights in white satin?", "passages": [ [ "Nights in White Satin", "The orchestral ending is kept intact, but mastering engineers edited out the gong (struck by Mike Pinder) that closes the track on the original LP.", "From 1992 through the early 2000s, the Moody Blues toured with shows backed by live orchestras.", "When with orchestral accompaniment, they often took the opportunity to include \"Late Lament\" in the performance of \"Nights in White Satin\".", "On these occasions, Edge recited it himself, since Pinder was no longer in the band at that time.", "In the late 1990s, the UK magazine \"Record Collector\" printed a claim that \"Nights in White Satin\" had not been written by Justin Hayward at all, but that in fact the Moody Blues' management had simply bought the song outright in 1966 from an Italian group called \"Les Jelly Roll\" and taken credit for it.", "This claim seems to have arisen from the discovery of a 7\" single by the Jelly Roll which carries the words \"This is the original version of Nights in White Satin\" on the label.", "\"Les Jelly Roll\" was a French band who did a cover version of the Moody Blues song, and had the opportunity to release it in Italy on Ricordi (an Italian record label), a few months before the original was released there.", "As a joke, they put the now-famous sentence on the cover." ], [ "Shattered (1991 film)", "Shattered (1991 film)\n\nShattered is a 1991 American neo-noir/psychological thriller starring Tom Berenger, Greta Scacchi, Bob Hoskins, Joanne Whalley and Corbin Bernsen.", "It was directed and written for the screen by Wolfgang Petersen, based on the novel by Richard Neely.", "While driving at night along the northern California coast, architect Dan Merrick (Tom Berenger) and wife Judith (Greta Scacchi) are involved in a car wreck.", "Dan suffers major injuries and brain trauma, resulting in psychogenic amnesia.", "After extensive plastic surgery, Dan returns home in Judith's care.", "Dan relies on those close to him to help him restore his past, including his business partner Jeb Scott (Corbin Bernsen) and Jeb's wife, Jenny (Joanne Whalley-Kilmer).", "Dan has frequent flashbacks he believes to be events that led up to the car crash.", "Dan finds discrepancies in the stories about his former self.", "He stumbles upon photographs of Judith sleeping with another man.", "Dan finds an expensive bill to a pet store and follows up with its proprietor, Gus Klein (Bob Hoskins).", "Gus says the payment was for services provided as a private investigator to follow Judith, and it revealed she was cheating with Jack Stanton (Scott Getlin)." ], [ "Split Second (1992 film)", "Split Second (1992 film)\n\nSplit Second is a 1992 American-British science fiction horror film directed by Tony Maylam and Ian Sharp.", "Rutger Hauer stars as a burnt-out police detective obsessively hunting down the mysterious serial killer that killed his partner several years prior.", "The film also features Kim Cattrall, Alastair Neil Duncan, Pete Postlethwaite, Ian Dury, and Alun Armstrong.", "In the year 2008, global warming and heavy rainfall has left large areas of London flooded.", "Rookie police officer Dick Durkin (Neil Duncan) is assigned to partner with Harley Stone (Rutger Hauer), a burnt-out and highly cynical veteran homicide detective who, according to his commanding officer, survives on \"anxiety, coffee, and chocolate\" after being unable to prevent the death of his partner by a serial killer 10 years previously.", "Now, the murders have begun again and the \ntwo detectives are assigned to this case.", "After investigating the scenes of several killings, they appear no closer to identifying the killer.", "Their only clues being that the murders seem to be linked to the lunar cycle, and that the killer has multiple recombinant DNA strands, having absorbed the DNA of its victims." ], [ "Dark Shadows (film)", "Peter Bradshaw, in the British newspaper \"The Guardian\", weighed the film in a mixed write-up, giving it three stars out of five, and pointing out his feeling that \"the Gothy, jokey 'darkness' of Burton's style is now beginning to look very familiar; he has built his brand to perfection in the film marketplace, and it is smarter and more distinctive than a lot of what is on offer at the multiplex, but there are no surprises.", "There are shadows, but they conceal nothing.\"", "\"Dark Shadows\" was released on both Blu-ray and DVD in the United States on October 2, 2012, the date confirmed by the official \"Dark Shadows\" Facebook page, and the official \"Dark Shadows\" website.", "The film was released on both formats several days earlier in Australia; in stores on September 24, and online on September 26, 2012.", "The film was released on October 15, 2012 in the UK.", "The DVD includes just one featurette, \"The Collinses: Every Family Has Its Demons\", while the Blu-ray contains a total of nine short featurettes and six deleted scenes.", "Several worldwide releases of both the DVD and Blu-ray contain an UltraViolet digital copy of the film.", "On December 7, 2011, Pfeiffer told MTV that she is hoping sequels will be made for the film." ], [ "Nights in White Satin", "Nights in White Satin\n\n\"Nights in White Satin\" is a song by the Moody Blues, written and composed by Justin Hayward.", "It was first featured as the segment \"The Night\" on the album \"Days of Future Passed\".", "When first released as a single in 1967, it reached number 19 on the UK Singles Chart and number 103 in the United States in 1968.", "It was the first significant chart entry by the band since \"Go Now\" and its recent lineup change, in which Denny Laine had resigned and both Hayward and John Lodge had joined.", "When reissued in 1972, in the United States the single hit number two \u2013 for two weeks \u2013 on the \"Billboard\" Hot 100 (behind \"I Can See Clearly Now\" by Johnny Nash) and hit number one on the \"Cash Box\" Top 100.", "It earned a gold certification for sales of over a million U.S. copies.", "It also hit number one in Canada.", "Band member Justin Hayward wrote and composed the song at age 19 in Swindon, and titled the song after a girlfriend gave him a gift of satin bedsheets.", "The song itself was a tale of a yearning love from afar, which leads many aficionados to term it as a tale of unrequited love endured by Hayward.", "Hayward said of the song, \"It was just another song I was writing", "and I thought it was very powerful." ], [ "Dark Shadows (film)", "Dark Shadows (film)\n\nDark Shadows is a 2012 American horror comedy film based on the gothic television soap opera of the same name.", "It was directed by Tim Burton and stars Johnny Depp, Michelle Pfeiffer, Helena Bonham Carter, Eva Green, Jackie Earle Haley, Jonny Lee Miller, Chlo\u00eb Grace Moretz, and Bella Heathcote in a dual role.", "The film had a limited release on May 10, 2012, and was officially released the following day in the United States.", "The film performed disappointingly at the United States box office, but did well in foreign markets.", "The film received mixed reviews; critics praised its visual style and consistent humor but felt it lacked a focused or substantial plot and developed characters.", "The film was produced by Richard D. Zanuck, who died two months after its release.", "It featured the final appearance of original series actor Jonathan Frid, who died shortly before its release.", "It was the 200th film appearance of actor Christopher Lee, and his fifth appearance in a Burton film.", "In 1760, the Collins family moves from Liverpool, England to Maine and establishes the fishing town Collinsport, where they build their estate, Collinwood.", "When he first arrives, the young son Barnabas meets the young Angelique Bouchard, who instantly becomes besotted with him." ], [ "Dark Shadows (film)", "Depp attempted to emulate the \"rigidity\" and \"elegance\" of Jonathan Frid's original Barnabas Collins, but also drew inspiration from Max Schreck's performance in \"Nosferatu\".", "Additional crew members and Burton regulars are production designer Rick Heinrichs, costume designer Colleen Atwood, editor Chris Lebenzon and composer Danny Elfman.", "French cinematographer Bruno Delbonnel\u00a0\u2014 known for his work in \"Am\u00e9lie\", \"A Very Long Engagement\" and \"Harry Potter and the Half-Blood Prince\"\u00a0\u2014 worked on the project.", "The film was scored by long-time Burton collaborator Danny Elfman.", "An album featuring 21 tracks of compositions from the film by Elfman was released on May 8, 2012.", "The soundtrack features a score of several contemporaneous 1970s rock and pop songs, along with others from later and slightly earlier, including \"Nights in White Satin\" by The Moody Blues, \"I'm Sick of You\" by Iggy Pop, \"Season of the Witch\" by Donovan, \"Top of the World\" by The Carpenters, \"You're the First, the Last, My Everything\" by Barry White and \"Get It On\" by T. Rex.", "Alice Cooper, who makes a cameo in the film, sings \"No More Mr. Nice Guy\" and \"Ballad of Dwight Fry\"." ] ], "gold": "The song, Nights in White Satin, by the Moody Blues, has been featured in many movies including a 1987 film entitled Nights in White Satin. In 1991, it was included in the psychological thriller film, Shattered. In 1992, it was featured in a science-fiction horror film called Split Second. And in 2012, the song was featured in the soundtrack of the fantasy horror comedy film, Dark Shadows along with several 1970s rock and pop songs.", "prediction 1": "Nights in White Satin is a song by the Moody Blues, originally recorded in 1966. There have been several movies with the song Nights in White Satin. The 1991 film Shattered has the song. The 1992 film Split Second has the song Nights in White Satin.\n", "prediction 2": "Nights in White Satin is a song by American alternative rock band Moody Blues. It was featured on separate albums in various states, and two movies have had the song in them. In her solo album, Nights in White Satin, Justin Hayward sang it, and from 1992 through the early 2000s, the Moody Blues toured with shows backed by live orchestras and the orchestral ending was kept intact, but mastering engineers edited out the gong (struck by Mike Pinder) that closes the track on the original LP. In her 1982, her mature man, Jeff Cavert sang Nights in White Satin, which was originally written by Justin Hayward, but because of its current situation.", "prediction 3": "The song Nights in White Satin was originally recorded as a music video for the 1992 film, Split Second, which has a cast and crew including Ron Hutton, Doug Frey, David Tennant, and Mike Pinder. It was later used as a soundtrack for the film's climactic finale, and used in an additional scene during the film's credits sequence.", "prediction 4": "There are several movies with the song Nights in White Satin. The 1993 movie Nights in White Satin and the 1992 movie Split Second both have the song as the title. The 1990 film Split Second and the 1992 film Shattered both also feature the song Nights in White Satin. In 1991, the movie Shattered did not use the song as the title, but only made slight changes to the song's performance. In 2000, the song appeared in a few different films with different remakes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 80 }, { "error type": "Unverifiable", "explanation": "", "start": 81, "end": 148 }, { "error type": "Unverifiable", "explanation": "", "start": 149, "end": 186 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":7,\"sentence_id\":[6]}", "start": 187, "end": 250 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 1 ] } ], "corrected-prediction": "Nights in White Satin is a song by the Moody Blues. The 2012 horror comedy film Dark Shadows soundtrack has the song \"Nights in White Satin,\" along with several 1970s rock and pop songs.\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who came in second on america's got talent 2016?", "passages": [ [ "The Clairvoyants", "The Clairvoyants\n\nThe Clairvoyants (Thommy Ten and Am\u00e9lie van Tass) are an Austrian magician and mentalist duo.", "The two of them have been performing together since 2011.", "They finished runner-up to Grace VanderWaal on season 11 of \"America's Got Talent\"." ] ], "gold": "The 2016 edition of America's Got Talent saw Austrian magician and mentalist duo The Clairvoyants, formed by Thomas H\u00f6schele and Christina Gruber, coming up in second place after the singer Grace VanderWaal.", "prediction 1": "The Clairvoyants, an Austrian magician and mentalist duo, finished second to Grace VanderWaal on season 11 of America's Got Talent.", "prediction 2": "The Clairvoyants are an Austrian magician and mentalist duo. They finished runner-up to Grace VanderWaal on season 11 of America's Got Talent.", "prediction 3": "The Clairvoyants (Thommy Ten and Am\u00e9lie van Tass) are an Austrian magician and mentalist duo. They finished runner-up to Grace VanderWaal on season 11 of America's Got Talent.", "prediction 4": "The Clairvoyants, an Austrian magician and mentalist duo, finished runner-up to Grace VanderWaal on season 11 of America's Got Talent.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Clairvoyants, an Austrian magician and mentalist duo, finished second to Grace VanderWaal on season 11 of America's Got Talent." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When is the hurling all ireland final 2018?", "passages": [ [ "2018 All-Ireland Senior Hurling Championship Final", "2018 All-Ireland Senior Hurling Championship Final\n\nThe 2018 All-Ireland Senior Hurling Championship Final, the 131st event of its kind and the culmination of the 2018 All-Ireland Senior Hurling Championship, was played at Croke Park in Dublin on 19 August 2018.", "The final was shown live in Ireland on RT\u00c9 Two as part of \"The Sunday Game\" live programme, presented by Michael Lyster from Croke Park, with studio analysis from Liam Sheedy, Henry Shefflin and Ger Loughnane.", "Match commentary was provided by Marty Morrissey with analysis by Michael Duignan.", "The game was also shown live on Sky Sports, presented by Rachel Wyse and Brian Carney.", "Limerick won the final, ending a 45-year wait for a title.", "The match drew a peak audience of more than a 1 million on RT\u00c9.", "The TV audience for the Sunday Game coverage peaked at 1,007,500 by the end of the final.", "Galway were the defending champions and were looking to win their sixth All-Ireland title after winning in 1923, 1980, 1987, 1988, and 2017.", "Limerick were appearing in their first final since 2007 and were looking for an eighth title after winning in 1897, 1918, 1921, 1934, 1936, 1940, and 1973." ], [ "2018 All-Ireland Under-21 Hurling Championship Final", "2018 All-Ireland Under-21 Hurling Championship Final\n\nThe 2018 All-Ireland Under-21 Hurling Championship final was a hurling match that was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, the 55th season of the All-Ireland Under-21 Hurling Championship, a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster.", "The final was played at the Gaelic Grounds in Limerick and contested by Cork and Tipperary, who both represent the province of Munster.", "The final between Cork and Tipperary was the first time that teams from the same province played each other in a decider.", "Cork were hoping to claim their 12th championship title overall and a first since 1998.", "Cork had previously beaten Tipperary by 13 points in the Munster final on 4 July 2018.", "Tipperary were hoping to win their 10th All-Ireland title.", "The final was broadcast live as part of \"GAA Beo\" on TG4, presented by M\u00edche\u00e1l \u00d3 Domhnaill.", "Cork were in front by 1-9 to 1-7 at half time but Tipperary won the game by 3-13 to 1-16 with an injury time goal by Conor Stakelum putting Tipperary into the lead by two points, another point by David Gleeson put them three points in front before the final whistle was blown." ] ], "gold": "The 2018 All-Ireland Senior Hurling Championship Final was played at Croke Park in Dublin on 19 August 2018. Limerick won the match, ending a 45-year wait for a title. The under-21 division championship final was played on 26 August 2018 at the Gaelic Grounds in Limerick and featured a comeback victory for Tipperary.", "prediction 1": "The 2018 All-Ireland Senior Hurling Championship final was played at Croke Park in Dublin on 19 August 2018. The 2018 All-Ireland Under-21 Hurling Championship final was a hurling match that was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster. The 2018 All-Ireland Under-21 Hurling Championship, a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Tipperary. The final was broadcast live as part of \"GAA Beo\" on TG4, presented by Mche\u00e1l Domhnaill.", "prediction 2": "The hurling All-Ireland Senior Hurling Championship final was played on 19 August 2018. The hurling All-Ireland Under-21 Hurling Championship final was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, which is a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster. This final was played at the Gaelic Grounds in Limerick and contested by Cork and Tipperary, who both represent the province of Munster.", "prediction 3": "The All-Ireland Senior Hurling Championship Final was played at Croke Park in Dublin on 19 August 2018. The All-Ireland Under-21 Hurling Championship final was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, which is a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster. Cork and Tipperary, who both represent the province of Munster, played each other in a decider.", "prediction 4": "The All-Ireland Senior Hurling Championship Final was played on 19 August 2018. The All-Ireland Under-21 Hurling Championship final was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, the 55th season of the All-Ireland Under-21 Hurling Championship, an annual tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 594, "end": 683 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 420, "end": 593 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The 2018 All-Ireland Senior Hurling Championship final was played at Croke Park in Dublin on 19 August 2018. The 2018 All-Ireland Under-21 Hurling Championship final was a hurling match that was played on 26 August 2018 to determine the winners of the 2018 All-Ireland Under-21 Hurling Championship, a tournament organised by the Gaelic Athletic Association for the champion and runner-up teams of Leinster and Munster. Cork were in front by 1-9 to 1-7 at half time but Tipperary won the game by 3-13 to 1-16 with an injury time goal by Conor Stakelum putting Tipperary into the lead by two points, another point by David Gleeson put them three points in front before the final whistle was blown.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Which episode of grey's anatomy does derek die?", "passages": [ [ "Derek Shepherd", "Derek Shepherd\n\nDerek Christopher Shepherd, M.D., also referred to as \"McDreamy\", is a fictional surgeon from the ABC medical drama \"Grey's Anatomy\", portrayed by actor Patrick Dempsey.", "He made his first appearance in the pilot episode, \"A Hard Day's Night\", which was broadcast on March 27, 2005.", "Derek was married to Addison Montgomery (Kate Walsh) for 12 years, before their divorce in 2006.", "Before his death in 2015, Derek was happily married to his longtime girlfriend and wife Meredith Grey (Ellen Pompeo).", "The couple have three children together.", "Shepherd was formerly the Chief of Surgery at Seattle Grace Mercy West (now known as Grey Sloan Memorial Hospital), but abruptly resigned as chief in season 7 following the shooting.", "For his portrayal of Shepherd, Dempsey was nominated in 2006 and 2007 Golden Globe for the Best Performance by an Actor in a Television Series Drama for the role, and the 2006 SAG Award for the Outstanding Performance by an Actor in a Drama Series.", "Derek arrives at Seattle Grace Hospital as the new Head of Neurosurgery from New York City.", "He is a Bowdoin College graduate and attended Columbia University College of Physicians and Surgeons alongside his childhood best friend Mark Sloan and ex-wife Addison Montgomery and \"Private Practice\" characters Naomi Bennett and Sam Bennett." ], [ "Derek Shepherd", "Meanwhile, he and Meredith fight bitterly on and off over whether they should move.", "After a bad argument, he accepts the job in the heat of the moment and leaves for Washington.", "While there, he and Meredith talk things out over the phone and come to a mutual conclusion that they both did not want to end their marriage.", "He tells her that just being with her, raising their children and operating on patients was more satisfying than \"saving the world\".", "In season 11, Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington.", "He is able to hear and process auditory input, but unable to speak.", "He is recognized by Winnie, one of the victims of a crash he assisted in earlier, who tells the surgeons that their patient's name is Derek and that he is a surgeon as well.", "The hospital he was taken to was understaffed and his head injury was not detected quickly enough by the interns on duty that night.", "Although the neurosurgeon on call is paged multiple times, he takes too long to arrive and Derek is declared brain dead.", "Police arrive at Meredith's door and take her to see Derek, where she consents to removing him from life support.", "At the time of his death, Meredith was pregnant with their third child.", "She gives birth to a daughter whom she names Ellis after her mother." ], [ "How to Save a Life (Grey's Anatomy)", "How to Save a Life (Grey's Anatomy)\n\n\"How to Save a Life\" is the twenty-first episode of the eleventh season of the American television medical drama \"Grey's Anatomy\", and is the 241st episode overall.", "It aired on April 23, 2015 on ABC in the United States.", "The episode was written by showrunner Shonda Rhimes and directed by Rob Hardy, making it the first episode Rhimes has written since the season eight finale \"Flight\".", "The installment marked the death and final appearance of the series\u2019 male lead character, Derek Shepherd (Patrick Dempsey), who had starred on the series since its inception.", "In this episode, Shepherd is involved in an accident while attempting to help the victims of a car accident.", "He is later pronounced brain dead, in part due to the surgeons not providing him with a timely CT scan.", "Only six regular cast membersEllen Pompeo, Patrick Dempsey, Chandra Wilson, Kevin McKidd, Sarah Drew and Caterina Scorsone appear in the episode.", "\"How to Save a Life\" also marks the first appearance of Dr. Penelope Blake (Samantha Sloyan)." ] ], "gold": "Derek Christopher Shepherd is a fictional surgeon from the ABC medical drama Grey's Anatomy. During Season 11 Episode 21, titled \"How to Save a Life\", Derek is involved in a car accident and taken to the hospital, where the doctors fail to recognize a head injury that later results in his death.", "prediction 1": "In episode 241 of the eleventh season of the American television medical drama Grey's Anatomy, the episode How to Save a Life, Derek dies. The episode was written by showrunner Shonda Rhimes and directed by Rob Hardy, making it the first episode Rhimes has written since the season eight finale Flight.", "prediction 2": "In the episode \"How to Save a Life\", which aired on April 23, 2015, Derek died in a car accident while attempting to help the victims of a car accident. His death was the final appearance of Derek Shepherd, played by Patrick Dempsey.", "prediction 3": "Grey's Anatomy is a medical drama television series. On the show, the character Derek Shepherd dies in the episode How to Save a Life. The episode aired on April 23, 2015, which marked the end of the series.", "prediction 4": "In Grey's Anatomy, the medical drama, in which the character Derek Shepherd dies in episode 24, How to Save a Life, he is involved in an accident while attempting to help the victims of a car accident. This accident occurs in the episode How to Save a Life, which was broadcast on April 23, 2015. Shepherd died in the episode How to Save a Life, which was the twenty-first episode of the eleventh season, which aired on April 23, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 302 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Derek Shepherd Derek Christopher Shepherd, M.D., also referred to as \"McDreamy\", is a fictional surgeon from the ABC medical drama \"Grey's Anatomy\", portrayed by actor Patrick Dempsey. In episode 241 of the eleventh season of the American television medical drama Grey's Anatomy, the episode How to Save a Life, Derek dies. Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who had the most power in sumerian society?", "passages": [ [ "Sumerian religion", "Sumerian religion\n\nSumerian religion was the religion practiced and adhered to by the people of Sumer, the first literate civilization of ancient Mesopotamia.", "The Sumerians regarded their divinities as responsible for all matters pertaining to the natural and social orders.", "Before the beginning of kingship in Sumer, the city-states were effectively ruled by theocratic priests and religious officials.", "Later, this role was supplanted by kings, but priests continued to exert great influence on Sumerian society.", "In early times, Sumerian temples were simple, one-room structures, sometimes built on elevated platforms.", "Towards the end of Sumerian civilization, these temples developed into ziggurats\u2014tall, pyramidal structures with sanctuaries at the tops.", "The Sumerians believed that the universe had come into being through a series of cosmic births.", "First, Nammu, the primeval waters, gave birth to An (the sky) and Ki (the earth), who mated together and produced a son named Enlil.", "Enlil separated heaven from earth and claimed the earth as his domain.", "Humans were believed to have been created by Enki, the son of An and Nammu." ], [ "Sumer", "Sumer\n\nSumer () is the earliest known civilization in the historical region of southern Mesopotamia, modern-day southern Iraq, during the Chalcolithic and Early Bronze ages, and one of the first civilizations in the world along with Ancient Egypt and the Indus Valley.", "Living along the valleys of the Tigris and Euphrates, Sumerian farmers were able to grow an abundance of grain and other crops, the surplus of which enabled them to settle in one place.", "Proto-writing in the prehistory dates back to c. 3000 BC.", "The earliest texts come from the cities of Uruk and Jemdet Nasr and date back to 3300 BC; early cuneiform script writing emerged in 3000 BC.", "Modern historians have suggested that Sumer was first permanently settled between c. 5500 and 4000 BC by a West Asian people who spoke the Sumerian language (pointing to the names of cities, rivers, basic occupations, etc., as evidence), an agglutinative language isolate.", "These prehistoric people are now called \"proto-Euphrateans\" or \"Ubaidians\", and are theorized to have evolved from the Samarra culture of northern Mesopotamia.", "The Ubaidians, though never mentioned by the Sumerians themselves, are assumed by modern-day scholars to have been the first civilizing force in Sumer." ] ], "gold": "Sumer is the earliest known civilization in the historical region of southern Mesopotamia, and it is also one of the first civilizations in the world. During the earliest period of ancient Sumerian society, the city-states were ruled by theocratic priests and religious officials. Later, kings had the most power.", "prediction 1": "The Sumerians regarded their divinities as responsible for all matters pertaining to the natural and social orders. Before the beginning of kingship in Sumer, the city-states were effectively ruled by theocratic priests and religious officials. Later, this role was supplanted by kings, but priests continued to exert great influence on Sumerian society. The Sumerians believed that the universe had come into being through a series of cosmic births. First, Nammu, the primeval waters, gave birth to An (the sky) and Ki (the earth), who mdet Nasr. Enlil separated heaven from earth and claimed the earth as his domain.", "prediction 2": "There were several Sumerians in the society of Sumer. The king had the most power, the priest the most influence. The king of Sumer was named Enlil, who separated heaven and earth and claimed the earth as his domain.", "prediction 3": "The king of Sumer was Enki, the son of Nammu, the primeval waters. Later, this role was supplanted by kings, but priests continued to exert great influence on Sumerian society.", "prediction 4": "The people of Sumer, the first literate civilization of ancient Mesopotamia, regarded their divinities as responsible for all matters pertaining to the natural and social orders. Before the beginning of kingship in Sumer, the city-states were effectively ruled by theocratic priests and religious officials. Later, this role was supplanted by kings, but priests continued to exert great influence on Sumerian society.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 115 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 532 }, { "error type": "Unverifiable", "explanation": "", "start": 533, "end": 547 }, { "error type": "Irrelevant", "explanation": "", "start": 548, "end": 618 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sumer is the earliest known civilization in the historical region of southern Mesopotamia and one of the first civilizations in the world. Before the beginning of kingship in Sumer, the city-states were effectively ruled by theocratic priests and religious officials. Later, this role was supplanted by kings. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When did battle of the sexes come out?", "passages": [ [ "Battle of the Sexes (2017 film)", "Battle of the Sexes (2017 film)\n\nBattle of the Sexes is a 2017 biographical sports film directed by Jonathan Dayton and Valerie Faris and written by Simon Beaufoy.", "The plot is loosely based on the between Billie Jean King and Bobby Riggs.", "The film stars Emma Stone and Steve Carell as King and Riggs, with Andrea Riseborough, Elisabeth Shue, Austin Stowell, Bill Pullman, Natalie Morales, and Sarah Silverman in supporting roles.", "The film had its premiere at the Telluride Film Festival on September 2, 2017, and was theatrically released in the United States by Fox Searchlight Pictures on September 22, 2017.", "It received positive reviews from critics, who praised the performances of Stone and Carell and the direction, with some calling it the best performance of Stone's career.", "Despite the positive reviews, the film was a box office disappointment, grossing $18.4 million against a $25 million budget.", "At the 75th Golden Globe Awards, Stone and Carell received nominations for Best Actress \u2013 Motion Picture Musical or Comedy and Best Actor \u2013 Motion Picture Musical or Comedy respectively.", "At the 24th Screen Actors Guild Awards, both received Critics Choice Awards nominations in the categories Best Actress in a Comedy and Best Actor in a Comedy; Carell also received a nomination for Outstanding Performance by a Male Actor in a Supporting Role." ], [ "Battle of the Sexes (2017 film)", "Principal photography on the film began in Los Angeles on April 13, 2016, with a budget of more than $25 million.", "For the tennis match scenes, tennis players Kaitlyn Christian (who portrays \u201cOriginal 9\u201d member Kerry Melville Reid) and Vince Spadea were the body doubles of Stone and Carell, respectively.", "\"Battle of the Sexes\" had its world premiere at the Telluride Film Festival on September 2, 2017.", "It also screened at the Toronto International Film Festival on September 10, 2017, and at the BFI London Film Festival on October 7, 2017.", "The film began a limited release in the United States on September 22, 2017, before going wide the following week.", "\"Battle of the Sexes\" grossed $12.6 million in the United States and Canada, and $5.8 million in other territories, for a worldwide total of $18.4 million.", "In its opening weekend, the film grossed $515,450 from 21 theaters, an average of $24,545 per theater.", "The film expanded the following Friday, where it was released alongside the openings of \"Flatliners\", \"'Til Death Do Us Part\" and \"American Made\", and was projected to gross around $6 million from 1,213 theaters over the weekend." ] ], "gold": "Battle of the Sexes is a 2017 biographical sports film loosely based on the 1973 tennis match between Billie Jean King and Bobby Riggs. The film had its premiere at the Telluride Film Festival on September 2, 2017, and had a limited theatrical release in the United States on September 22, 2017, before going wide the following week. It later came out in the United Kingdom in November 24, 2017.", "prediction 1": "Battle of the Sexes is a 2017 biographical sports film directed by Jonathan Dayton and Valerie Faris and written by Simon Beaufoy. The film stars Emma Stone and Steve Carell as King and Riggs, with Andrea Riseborough, Elisabeth Shue, Austin Stowell, Bill Pullman, Natalie Morales, and Sarah Silverman in supporting roles. The film had its premiere at the Telluride Film Festival on September 2, 2017. It also screened at the Toronto International Film Festival on September 10, 2017 and at the BFI London Film Festival on October 7, 2017.", "prediction 2": "Battle of the Sexes is a 2017 biographical sports film directed by Jonathan Dayton and Valerie Faris and written by Simon Beaufoy. It had its premiere at the Telluride Film Festival on September 2, 2017. It also screened at the Toronto International Film Festival on September 10, 2017 and at the BFI London Film Festival on October 7, 2017.", "prediction 3": "Battle of the Sexes is a 2017 biographical sports film directed by Jonathan Dayton and Valerie Faris and written by Simon Beaufoy. It had its premiere at the Telluride Film Festival on September 2, 2017, and was theatrically released in the United States by Fox Searchlight Pictures on September 22, 2017.", "prediction 4": "Battle of the Sexes is a 2017 biographical sports film directed by Jonathan Dayton and Valerie Faris and written by Simon Beaufoy. The film stars Emma Stone and Steve Carell as King and Riggs, with Andrea Riseborough, Elisabeth Shue, Austin Stowell, Bill Pullman, Natalie Morales, and Sarah Silverman in supporting roles. The film had its premiere at the Telluride Film Festival on September 2, 2017, and was theatrically released in the United States by Fox Searchlight Pictures on September 22, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 321 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Battle of the Sexes is a 2017 biographical sports film. The plot is loosely based on the battle between Billie Jean King and Bobby Riggs. The film had its premiere at the Telluride Film Festival on September 2, 2017. It also screened at the Toronto International Film Festival on September 10, 2017 and at the BFI London Film Festival on October 7, 2017. The film began a limited release in the United States on September 22, 2017, before going wide the following week." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does carrie find out about sebastian and maggie?", "passages": [ [ "The Carrie Diaries (TV series)", "The Carrie Diaries (TV series)\n\n", "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014.", "It is a prequel to the HBO television series \"Sex and the City\" and based on the 2010 book of the same name by Candace Bushnell.", "The first season focuses on Carrie Bradshaw (AnnaSophia Robb) during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company, while the second season focuses more on her expanding life in the city as well as the lives of her friends and boyfriend.", "The pilot was picked up by The CW to a series order of 13 episodes in May 2012.", "Four months into the first season, the network renewed \"The Carrie Diaries\" for a second season, which premiered in October 2013.", "In May 2014, The CW canceled the series after two seasons.", "In September 2011, it was officially announced that The CW was moving forward with a television series as a prequel to the original series, based on \"The Carrie Diaries\".", "The project is produced by \"Gossip Girl\" producers Josh Schwartz and Stephanie Savage.", "Former \"Sex and the City\" writer Amy B. Harris penned the adaptation." ], [ "The Carrie Diaries (season 1)", "The Carrie Diaries (season 1)\n\nThe first season of \"The Carrie Diaries\", an American teen drama series based on the novel of the same name by Candace Bushnell, premiered on The CW on January 14, 2013.", "Developed by Amy B. Harris, the series serves as a prequel to the HBO series \"Sex and the City\".", "\"The Carrie Diaries\" was officially picked up for the 2012\u201313 television season on May 11, 2012.", "Premiering mid-season, the series concluded its first season on April 8, 2013.", "They never get back together because Tom dose not want thrm getting back together er and Sebastian ends up with Maggie and dose not regret anything.", "" ], [ "Carrie Bradshaw", "A TV series was made after the production of \"Sex and the City\", called \"The Carrie Diaries\" which featured Carrie's life as a teenager prior to her life in \"Sex and the City\".", "It focused mainly on Carrie who lived with her father and younger sister, Dorrit.", "She had a few relationships, the main one being her on and off relationship with Sebastian Kydd.", "She started working at \"Interview\", a magazine firm, juggling between her school and work life.", "The series was discontinued after Season 2 as it was said that it was not economically feasible although it got positive feedback from its audience.", "Candace Bushnell, author of \"Sex and the City\", recently released her new book, \"Summer and the City: A Carrie Diaries Novel\" as part of her young adult series that follows the \"Sex and the City\" characters as teenagers.", "This novel reveals that Carrie attended the prestigious Ivy League University, Brown, in the 1980s.", "It also reveals that she took summer classes at the New School.", "\"TV Guide\" described the young version of Carrie Bradshaw as \"Even when she's trying to play adult in the city with her fashion-forward style and 'grown-up' conversations, she still exudes an aura that manages to be innocent, cute and self-confident at the same time.\"" ] ], "gold": "The Carrie Diaries is an American teen comedy-drama television series that served as a prequel to the HBO series Sex and the City. The show focuses on Carrie's life as a teenager, time in which she had a few relationships, the main one being her on and off relationship with Sebastian Kydd. During the show, Sebastian is involved at different times with Maggie, Carrie's best friend, and Carrie finds out about them in at least two different occasions. The first of them happened during Season 1 Episode 13, titled Kiss Yesterday Goodbye, and later during Season 2 Episode 6, The Safety Dance.", "prediction 1": "The first season of The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. It is a prequel to the HBO television series Sex and the City and based on the 2010 book of the same name by Candace Bushnell. In the first season, Carrie finds out about Sebastian and Maggie and they go on a date. In the second season, Carrie finds out about Sebastian and Maggie and they end up dating and Carrie finds out about their relationship.", "prediction 2": "The first season of The Carrie Diaries is a teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. It is a prequel to the HBO television series Sex and the City and based on the 2010 book of the same name by Candace Bushnell. The second season focuses more on Carrie's expanding life in the city as well as the lives of her friends and boyfriend. In season 1 of the show, Carrie finds out about Sebastian and Maggie.", "prediction 3": "The first season of The Carrie Diaries, an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014, focuses on Carrie Bradshaw during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company, while the second season focuses more on her expanding life in the city as well as the lives of her friends and boyfriend.", "prediction 4": "The first season of The Carrie Diaries, an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014, features Carrie Bradshaw as a teenager prior to her life in Sex and the City. Sebastian has been with Maggie for four years and they never get back together, but Sebastian finds out about his girlfriend after the first season premiered.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 297 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 319, "end": 385 }, { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 521 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The first season of The Carrie Diaries is an American teen comedy-drama television series. It is a prequel to the HBO television series Sex and the City. The show focuses on Carrie's life as a teenager, time in which she had a few relationships, the main one being her on and off relationship with Sebastian Kydd. In the first season, Sebastian ends up with Maggie." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who votes for nfl player of the year?", "passages": [ [ "Associated Press NFL Defensive Player of the Year Award", "Associated Press NFL Defensive Player of the Year Award\n\nThe Associated Press NFL Defensive Player of the Year Award is given by the Associated Press (AP) to the league's most outstanding defensive player at the end of every National Football League (NFL) season.", "It has been awarded since 1971.", "The winner is decided by votes from a panel of 50 AP sportswriters who regularly cover the NFL.", "Since 2011, the award has been presented at the annual NFL Honors ceremony the day before the Super Bowl, along with other AP awards, such as the AP NFL Offensive Player of the Year Award, AP NFL Most Valuable Player Award, and AP NFL Rookie of the Year Award.", "Lawrence Taylor and J. J. Watt are the only three-time winners of the award.", "Joe Greene, Mike Singletary, Bruce Smith, Reggie White, and Ray Lewis have each won it twice.", "Taylor is the only player to win the award as a rookie, doing so in 1981.", "In 2008, James Harrison became the only undrafted free agent to win the award.", "White is the only player to win the award with two different teams, winning in 1987 with the Philadelphia Eagles and again with the Green Bay Packers in 1998.", "Watt is the only player to win the award unanimously, receiving 50 out of 50 first place votes in 2014." ], [ "Newspaper Enterprise Association", "The NFL MVP award was called the Jim Thorpe Trophy and began in 1955 (not to be confused with college football's Jim Thorpe Award).", "The Defensive Player of the Year was named after Chicago Bears founder George S. Halas and its inception was 1966, the Rookie of the Year award was named after NFL commissioner Bert Bell and began in 1964.", "In the early 1960s the NEA began awarding the Third Down Trophy that symbolized each team's MVP.", "That began in the American Football League and included the NFL after the 1970 AFL-NFL merger and ran through 1979.", "Currently the Jim Thorpe Trophy is still awarded, through the Jim Thorpe Association of Oklahoma City, Oklahoma.", "It is awarded to the NFL", "Most Valuable Player and is voted upon by members of the NFLPA.", "Olderman, the driving force behind the Players' All-Pro teams and awards, was also a fine artist and cartoonist.", "When the NEA news service released its stories on the annual NFL awards they were accompanied by artwork provided by Olderman to illustrate the stories.", "From 1936 to 2010, NEA produced an annual Christmas-themed daily comic strip for its subscribing newspapers as a holiday bonus.", "They typically ran for three to four weeks before Christmas, with the concluding installment on December 25 or a nearby date." ] ], "gold": "Every year, the NFL Honors ceremony is held the day before the Super Bowl, where different awards are given to the most outstanding players of the season. The Associated Press NFL Defensive and Ofensive Players of the Year as well as the National Football League Comeback and Most Valuable Players of the Year Awards, voted by a panel of 50 AP sportswriters, are announced during the ceremony. Members of the NFLPA also take part in the vote for the Most Valuable Player of the Year Award.", "prediction 1": "The Associated Press awards NFL player of the year to the league's most outstanding defensive player at the end of every National Football League season. Since 2011, the award has been presented at the annual NFL Honors ceremony the day before the Super Bowl, along with other AP awards, such as the AP NFL Offensive Player of the Year Award, AP NFL Most Valuable Player Award, and AP NFL Rookie of the Year Award. The NFL MVP award was called the Jim Thorpe Trophy and began in 1955. The NFL Defensive Player of the Year Award is voted by a panel of 50 AP sportswriters who regularly cover the NFL.", "prediction 2": "The NFL Player of the Year is given by the Associated Press to the league's most outstanding defensive player at the end of every National Football League season. It has been awarded since 1971. The winner is decided by votes from a panel of 50 AP sportswriters who regularly cover the NFL. The NEA votes for the NFL Player of the Year.", "prediction 3": "The Associated Press NFL Defensive Player of the Year Award is given by the Associated Press (AP) to the league's most outstanding defensive player at the end of every National Football League (NFL) season. It has been awarded since 1971. The winner is decided by votes from a panel of 50 AP sportswriters who regularly cover the NFL.", "prediction 4": "The Associated Press NFL Defensive Player of the Year Award is given by the AP to the league's most outstanding defensive player at the end of every National Football League (NFL) season. The winner is decided by votes from a panel of 50 AP sportswriters who regularly cover the NFL. The NFL MVP award began in 1955, the Defensive Player of the Year award was named after Chicago Bears founder George S. Halas and its inception was 1966, and the NFL Rookie of the Year award was named after NFL commissioner Bert Bell and began in 1964.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 433, "end": 484 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Associated Press awards NFL player of the year to the league's most outstanding defensive player at the end of every National Football League season. The award has been presented at the annual NFL Honors ceremony, along with other AP awards, such as the AP NFL Offensive Player of the Year Award, AP NFL Most Valuable Player Award, and AP NFL Rookie of the Year Award. The NFL MVP award is voted upon by members of the NFLPA. The NFL Defensive Player of the Year Award is voted by a panel of 50 AP sportswriters who regularly cover the NFL." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did brazil organize its first world cup?", "passages": [ [ "2014 FIFA World Cup", "2014 FIFA World Cup\n\nThe 2014 FIFA World Cup was the 20th FIFA World Cup, the quadrennial world championship for men's national football teams organized by FIFA.", "It took place in Brazil from 12 June to 13 July 2014, after the country was awarded the hosting rights in 2007.", "It was the second time that Brazil staged the competition, the first being in 1950, and the fifth time that it was held in South America.", "Thirty-one national teams advanced through qualification competitions to join the host nation in the final tournament (with Bosnia and Herzegovina as only debutant).", "A total of 64 matches were played in 12 venues located in as many host cities across Brazil.", "For the first time at a World Cup finals, match officials used goal-line technology, as well as vanishing spray for free kicks.", "FIFA Fan Fests in each host city gathered a total of 5 million people, and the country received 1 million visitors from 202 countries.", "Every World Cup-winning team since the first tournament in 1930 \u2013 Argentina, Brazil, England, France, Germany, Italy, Spain and Uruguay \u2013 qualified for this tournament.", "Spain, the title holders, were eliminated at the group stage, along with England and Italy.", "Uruguay were eliminated in the round of 16, and France exited in the quarter-finals." ], [ "1950 FIFA World Cup", "The World Cup was at risk of not being held for sheer lack of interest from the international community, until Brazil presented a bid at the 1946 FIFA Congress, offering to host the event on condition that the tournament take place in 1950 (it was originally planned to take place in 1949).", "Brazil and Germany had been the leading bidders to host the cancelled 1942 World Cup; since both the 1934 and 1938 tournaments had been held in Europe, football historians generally agree that the 1942 event would most likely have been awarded to a South American host country.", "Brazil's new bid was very similar to the mooted 1942 bid and was quickly accepted.", "Having secured a host nation, FIFA would still dedicate some time to persuading countries to send their national teams to compete.", "Italy was of particular interest as the long-standing defending champions, having won the two previous tournaments in 1934 and 1938; however, Italy's national team was weakened severely as most of its starting line-up perished in the Superga air disaster one year before the start of the tournament.", "The Italians were eventually persuaded to attend, but travelled by boat rather than by plane.", "Brazil (the host country) and Italy (the defending champion) qualified automatically, leaving 14 places remaining.", "Of these, seven were allocated to Europe, six to the Americas, and one to Asia." ], [ "1950 FIFA World Cup", "1950 FIFA World Cup\n\nThe 1950 FIFA World Cup, held in Brazil from 24 June to 16 July 1950, was the fourth FIFA World Cup.", "It was the first World Cup since 1938, the planned 1942 and 1946 competitions having been cancelled due to World War II.", "It was won by Uruguay, who had won the inaugural competition in 1930.", "They clinched the cup by beating the hosts Brazil 2\u20131 in the deciding match of the four-team final group.", "This was the only tournament not decided by a one-match final.", "It was also the first tournament where the trophy was referred to as the Jules Rimet Cup, to mark the 25th anniversary of Jules Rimet's presidency of FIFA.", "Because of World War II, the World Cup had not been staged since 1938; the planned World Cups of 1942 and 1946 were both cancelled.", "After the war, FIFA were keen to resurrect the competition as soon as possible, and they began making plans for a World Cup tournament to take place.", "In the aftermath of the war, much of Europe lay in ruins.", "As a result, FIFA had some difficulties finding a country interested in hosting the event, since many governments believed that their scarce resources ought to be devoted to more urgent priorities than a sporting celebration." ] ], "gold": "The FIFA World Cup has been held in Brazil in two different occasions. The country was one leading bidders to host the cancelled 1942 World Cup and presented a very similar bid for its first World Cup in the 1946 FIFA Congress, which was quickly accepted. The competition would be then organized from 24 June to 16 July 1950, when Uruguay defeated the host nation 2\u20131 in a four-team group match final.", "prediction 1": "The first time Brazil staged the competition was in 1950, when the country hosted the competition. In 1950 Brazil hosted the competition, which took place from 24 June to 16 July 1950. The 2014 FIFA World Cup was the 20th FIFA World Cup, the quadrennial world championship for men's national football teams organized by FIFA.", "prediction 2": "The first time Brazil staged the competition was in 1950, when Brazil hosted the tournament. The World Cup was at risk of not being held for sheer lack of interest from the international community, until Brazil presented a bid at the 1946 FIFA Congress, offering to host the event on condition that the tournament take place in 1950. However, Brazil and Germany had been the leading bidders to host the cancelled 1942 World Cup, and they quickly accepted Brazil's new bid.", "prediction 3": "The first time that Brazil staged the competition, the first being in 1950, was in 1950, and the second time that Brazil staged the competition was in 2014. The 1950 FIFA World Cup, held in Brazil from 24 June to 16 July 1950, was the fourth FIFA World Cup. It was the only World Cup not decided by a one-match final.", "prediction 4": "Brazil has hosted four FIFA World Cups. The first was in 1930, while the second was in 1950. The 1950 FIFA world cup was held in Brazil from 24 June to 16 July 1950.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The first time Brazil staged the competition was in 1950, ", "start": 58, "end": 98 }, { "error type": "Redundant", "explanation": "The first time Brazil staged the competition was in 1950, when the country hosted the competition. ", "start": 99, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 325 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3, 4 ] } ], "corrected-prediction": "The first time Brazil staged the competition was in 1950, which took place from 24 June to 16 July 1950. Brazil had been the leading bidders to host the cancelled 1942 World Cup and their new bid was very similar to the mooted 1942 bid and was quickly accepted. Uruguay won, beating the hosts 2\u20131 in the deciding match of the four-team final group. " }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Who won gold medal in badminton in commonwealth games 2018?", "passages": [ [ "Badminton at the 2018 Commonwealth Games", "Badminton at the 2018 Commonwealth Games\n\nBadminton events at the 2018 Commonwealth Games on the Gold Coast, Australia took place between Thursday 5 April and Sunday 15 April at the Carrara Sports and Leisure Centre.", "Badminton is one of ten core sports at the Commonwealth Games and has been continuously held at the Games since its first appearance at the 1966 British Empire and Commonwealth Games in Kingston, Jamaica.", "The badminton programme in 2018 included men's and women's singles competitions; men's, women's and mixed doubles competitions alongside a mixed team event throughout the 11 days of competition.", "The draw for the mixed team event was held on 6 February at The Star Gold Coast.", "There are 29 participating associations in badminton with a total of 153 athletes.", "The number of athletes a nation entered is in parentheses beside the name of the country." ], [ "Sport in India", "Indian shuttlers Saina Nehwal, K. Srikanth and P.V. Sindhu are ranked amongst top-10 in current BWF ranking.", "Prakash Padukone was the first player from India to achieve world no.1 spot in the game and after him K. Srikanth made it to the top spot as male player for second time in April 2018 and Saina Nehwal is the first female player from India to achieve World no.1 spot in April 2015.", "The most successful doubles player from India is Jwala Gutta, who is the only Indian to have been ranked in the top-10 of two categories.", "She peaked at no. 6 with Valiyaveetil Diju in mixed doubles and at no. 10 with Ashwini Ponnappa in women's doubles.", "Other successful players include Aparna Popat, Pullela Gopichand, Syed Modi, Chetan Anand, Parupalli Kashyap, Prannoy Kumar, Ashwini Ponnappa, Chirag Shetty, Satwiksairaj Rankireddy and N. Sikki Reddy.", "Padukone and Gopichand, both won the All England Open in 1980 and 2001 respectively making them the only Indians to ever win the prestigious title." ], [ "Badminton at the 2012 Summer Olympics \u2013 Men's singles", "Badminton at the 2012 Summer Olympics \u2013 Men's singles\n\nThe badminton men's singles tournament at the 2012 Olympic Games in London took place from 28 July to 5 August at Wembley Arena.", "The draw was held on 23 July 2012.", "Forty players from 34 nations competed in the event.", "China's Lin Dan won the gold medal, defeating Lee Chong Wei from Malaysia in the final.", "Chen Long, also of China, won the bronze medal.", "The tournament started with a group phase round-robin followed by a knockout stage." ] ], "gold": "The 2018 Commonwealth Games' badminton programme included men's and women's singles competitions; men's, women's and mixed doubles competitions alongside a mixed team event throughout the 11 days of competition. Lee Chong Wei and Saina Nehwal won the gold medal in the men's and the women's singles, respectively. The gold medal in the men's doubles competition was won by Marcus Ellis and Chris Langridge, while the gold in the women's doubles was won by Chow Mei Kuan and Vivian Hoo, and Chris Adcock and Gabrielle Adcock won the gold in the mixed doubles. India was the mixed teams' gold medal winner.", "prediction 1": "China won gold medal in badminton at the 2018 Commonwealth Games, when Chinese Men's Singles player Lin Dan won the gold medal, defeating Lee Chong Wei from Malaysia in the final. In the 2018 Commonwealth Games, badminton was one of ten core sports at the Games and has been continuously held at the Games since its first appearance at the 1966 British Empire and Commonwealth Games in Kingston, Jamaica.", "prediction 2": "China's Lin Dan won the gold medal in badminton in the 2018 Commonwealth Games. In the 2012 Olympic Games in London, China's Chen Long won the bronze medal.", "prediction 3": "Badminton is one of ten core sports at the Commonwealth Games and has been continuously held at the Games since its first appearance at the 1966 British Empire and Commonwealth Games in Kingston, Jamaica. In 2018, Chinese player Lin Dan won the gold medal in men's singles, defeating Lee Chong Wei from Malaysia in the final. In 2019, Indian shuttlers Saina Nehwal, K. Srikanth and P.V. Sindhu are ranked amongst the top-10 in current BWF ranking.", "prediction 4": "China's Lin Dan won the gold medal in badminton in the 2018 Commonwealth Games. Chen Long, also of China, won the bronze medal.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1,4]}", "start": 41, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 404 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2018 Commonwealth Games' badminton programme in 2018 included men's and women's singles competitions; men's, women's and mixed doubles competitions alongside a mixed team event throughout the 11 days of competition." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who played daniel boone son on tv series?", "passages": [ [ "Daniel Boone (1964 TV series)", "Daniel Boone (1964 TV series)\n\nDaniel Boone is an American action-adventure television series starring Fess Parker as Daniel Boone that aired from September 24, 1964, to May 7, 1970, on NBC for 165 episodes, and was produced by 20th Century Fox Television, Arcola Enterprises, and Fespar Corp. Ed Ames co-starred as Mingo, Boone's Cherokee friend, for the first four seasons of the series.", "Albert Salmi portrayed Boone's companion Yadkin in season one only.", "Country Western singer-actor Jimmy Dean was a featured actor as Josh Clements during the 1968\u20131970 seasons.", "Actor and former NFL football player Rosey Grier made regular appearances as Gabe Cooper in the 1969 to 1970 season.", "The show was broadcast \"in living color\" beginning in fall 1965, the second season, and was shot entirely in California and Kanab, Utah.", "An earlier television series based on Daniel Boone appeared on the \"Walt Disney Presents\" anthology in 1960, with Dewey Martin as Boone.", "Daniel Boone was one of two significant historical figures played by Fess Parker.", "He previously appeared as Davy Crockett in a series of episodes of the Walt Disney anthology television series, to considerable acclaim amid the launch of a national craze." ], [ "Daniel Boone", "This did not describe the real Boone, who was not a big man and did not wear a coonskin cap.", "Boone was portrayed this way because Fess Parker, the tall actor who played him, was essentially reprising his role as Davy Crockett from an earlier TV series.", "That Boone could be portrayed the same way as Crockett, another American frontiersman with a very different personality, was another example of how Boone's image was reshaped to suit popular tastes.", "Boone's grandson Alphonso Boone was an early settler of the Willamette River Valley in Oregon, arriving in 1846 and establishing Boones Ferry the next year.", "Three generations of Boone's descendants have been Major League Baseball players: Ray Boone, Ray's son Bob Boone, and Ray's grandchildren Bret Boone and Aaron Boone.", "Primary material\n\nOther material" ], [ "Daniel Boone (1960 TV series)", "Daniel Boone (1960 TV series)\n\nDaniel Boone was a four-part television series that aired on \"Walt Disney Presents\" on ABC.", "Two episodes aired in December 1960 and two others in March 1961.", "The miniseries was loosely based on Kentucky pioneer Daniel Boone.", "It starred Dewey Martin as Boone and Mala Rudolph as his wife, Rebecca.", "(The actress who played Rebecca Boone is listed as Mala Powers in two reference books:", "Douglas Brode's \"Shooting Stars of the Small Screen: Encyclopedia of TV Western Actors, 1946\u2013Present\" and Vincent Terrace's \"Encyclopedia of Television Shows, 1925 through 2010\".)" ] ], "gold": "Daniel Boone was a 1960 four-part television series loosely based on the life of Kentucky pioneer Daniel Boone and starring Dewey Martin as Boone and Mala Rudolph as his wife, Rebecca. In 1964, another show based on the pioneer started airing on NBC and ran for a total of 165 episodes. In this adaptation, Boone is played by the actor Fess Parker.", "prediction 1": "The 1964 television series Daniel Boone starred Fess Parker as Daniel Boone. It aired from September 24, 1964, to May 7, 1970, on NBC for 165 episodes. In the 1960 television series, Daniel Boone, the grandson of Daniel Boone, was loosely based on Kentucky pioneer Daniel Boone. Dewey Martin played Boone in the four-part miniseries.", "prediction 2": "Daniel Boone is one of two significant historical figures played by Fess Parker. He previously appeared as Davy Crockett in a series of episodes of the Walt Disney anthology television series. Daniel Boone was also loosely based on Kentucky pioneer Daniel Boone. It starred Dewey Martin as Boone and Mala Rudolph as his wife, Rebecca. Boone's son Alphonso was an early settler of the Willamette River Valley in Oregon, arriving in 1846 and establishing Boones Ferry the next year.", "prediction 3": "Daniel Boone is an American action-adventure television series starring Fess Parker as Daniel Boone that aired from September 24, 1964, to May 7, 1970, on NBC for 165 episodes. Country Western singer-actor Jimmy Dean was a featured actor as Josh Clements during the 1968\u20131970 seasons. The 1960 television series \"Daniel Boone\" was loosely based on Kentucky pioneer Daniel Boone and featured Dewey Martin as Boone. The 1970 television series \"Daniel Boone\" starred Fesss Parker as Boone's son, Alphonso Boone, played by Rosey Grier, who made regular appearances as Gabe Cooper in the 1969.", "prediction 4": "Daniel Boone is an action-adventure television series starring Fess Parker as Daniel Boone that aired from September 24, 1964, to May 7, 1970, on NBC for 165 episodes, and was produced by 20th Century Fox Television, Arcola Enterprises, and Fespar Corp. Country Western singer-actor Jimmy Dean was a featured actor as Josh Clements during the 1968\u20131970 seasons. An earlier television series based on Daniel Boone appeared on the Walt Disney Presents anthology television series, in 1960, with Mala Rudolph as Boone's wife, Rebecca.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 183, "end": 196 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1964 television series Daniel Boone starred Fess Parker as Daniel Boone. It aired from September 24, 1964, to May 7, 1970, on NBC for 165 episodes. The 1960 four-part television series, Daniel Boone, was loosely based on Kentucky pioneer Daniel Boone. Dewey Martin played Boone and Mala Rudolph as his wife, Rebecca." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When was trade dispute act came into existence?", "passages": [ [ "Rookes v Barnard", "The case was met with immediate outrage for creating, or reviving, economic torts as a weapon to undermine the right to strike.", "It was reversed by the Trade Disputes Act 1965." ], [ "Trade Disputes Act 1906", "Trade Disputes Act 1906\n\nThe Trade Disputes Act 1906 (6 Edw. 7", "c. 47) was an Act of the Parliament of the United Kingdom passed under the Liberal government of Sir Henry Campbell-Bannerman.", "The Act declared that unions could not be sued for damages incurred during a strike.", "Its key reform was to add the famous words, now found in the Trade Union and Labour Relations (Consolidation) Act 1992, section 219, to the Conspiracy and Protection of Property Act 1875 that, \"An act done in pursuance of an agreement or combination by two or more persons shall, if done in contemplation or furtherance of a trade dispute, not be actionable unless the act, if done without any such agreement or combination, would be actionable.\"", "The immediate cause for the Act was a trio of cases in the House of Lords, which had for the first time imposed damages in tort on trade unions for going on strike.", "Previously, the legal status of trade unions as an \"unincorporated association\", was accepted to mean that they did not have legal standing to sue, or be sued, in court.", "Before the change, the two important cases were \"Lumley v Gye\" (1857) and \"Allen v Flood\" (1897).", "\"Lumley\" did not concern trade unions, but invented a new legal principle." ], [ "Trade Disputes Act 1965", "Trade Disputes Act 1965\n\nThe Trade Disputes Act 1965 is an Act of Parliament of the United Kingdom, which supported closed shop practices in industrial relations.", "The principal effect was to reverse the legal position established by \"Rookes v Barnard\" in 1964, in which the threat of strike action from a union resulted in the sacking of a worker who had recently left that union.", "The House of Lords, acting as the highest court of appeal, held that the threat of strike action was unlawful intimidation.", "The Trades Union Congress was concerned that the case would set a precedent for lawsuits against trade unions in a wide range of circumstances.", "Civil law had been one of the main tools employers used against unions in their early days until the Trade Disputes Act 1906 gave unions immunity from certain torts (including conspiracy) when taken in pursuit of an industrial dispute.", "However, intimidation was not covered under the Trades Disputes Act, and it seemed possible that the \"Rookes vs Barnard\" judgement would support classifying a strike in any closed shop dispute as unlawful 'intimidation'.", "As a result, the Labour government of Harold Wilson introduced legislation to restore the status quo from before the case.", "The Act specified that a threat to withhold one's own labour or to induce others to do the same could give no cause for action in tort." ] ], "gold": "The Trade Disputes Act was an Act of the Parliament of the United Kingdom that declared that unions could not be sued for damages incurred during a strike. The first Trade Disputes Act came into existence on 21 December 1906. A second Trade Disputes Act, which supported closed shop practices in industrial relations, came into existence in 1965.", "prediction 1": "The Trade Disputes Act was first introduced in the United Kingdom in 1906, when the Parliament of the United Kingdom passed the Trade Disputes Act 1906. It was later introduced in the United Kingdom in 1965, when the Trade Disputes Act 1965 came into existence.\n", "prediction 2": "The Trade Disputes Act 1863 added restrictions to the personal liability of workers in certain industries, while also creating the right to strike without being sued for damages. The Trade Disputes Act 1965 added significant changes to the personal liability of employees, including a requirement that a business, employer or trade union obtain a pre-arranged indemnity for any injury incurred during a strike.", "prediction 3": "The Trade Disputes Act was originally passed in 1906 and repealed in 1965, when it was reintroduced in Parliament.", "prediction 4": "The Trade Disputes Act of 1906 came into existence in the UK. It came into existence in 1965 when it supported closed shop practices in industrial relations.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Trade Disputes Act", "start": 124, "end": 152 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Trade Disputes Act was first introduced in the United Kingdom in 1906, when it was passed by the Parliament of the United Kingdom. It declared that unions could not be sued for damages incurred during a strike. A second Trade Disputes Act, which supported closed shop practices in industrial relations, also came into existence in 1965.\n" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Simple gifts from aaron copland's appalachian spring is in?", "passages": [ [ "Appalachian Spring", "In the ballet, but not the suite, there is an intermediary section that moves away from the folk tune preceding the final two variations.", "Known as the \"Shaker Melody\", \"Shaker Song\", and the \"Shaker Hymn\", the music Copland based his ending variations on was actually called \"Simple Gifts\".", "This same Shaker tune was used by Sydney Carter in a widely recognized hymn entitled \"Lord of the Dance\".", "Copland published independent arrangements of this section for band (1958) and orchestra (1967) titled \"Variations on a Shaker Melody\".", "For many years part of the seventh movement of the orchestral suite was used as the opening music to \"CBS Reports\"." ], [ "Simple Gifts", "Simple Gifts\n\n\"Simple Gifts\" is a Shaker song written and composed in 1848 by Elder Joseph Brackett.", "The tune was written by Joseph Brackett (1797\u20131882) in 1848.", "Brackett, a lifelong resident of Maine, first joined the Shakers at Gorham, Maine, when his father's farm helped to form the nucleus of a new Shaker settlement.", "The song was largely unknown outside Shaker communities until Aaron Copland used its melody for the score of Martha Graham's ballet \"Appalachian Spring\" (Shakers once worshipped on Holy Mount, in the Appalachians), first performed in 1944.", "Copland used \"Simple Gifts\" a second time in 1950 in his first set of \"Old American Songs\" for voice and piano, which was later orchestrated.", "\"Simple Gifts\" was written by Elder Joseph while he was at the Shaker community in Alfred, Maine.", "These are the lyrics to his one-verse song:\n\nSeveral Shaker manuscripts indicate that this is a \"Dancing Song\" or a \"Quick Dance.", "\"Turning\" is a common theme in Christian theology, but the references to \"turning\" in the last two lines have also been identified as dance instructions.", "When the traditional dance is performed properly, each dancer ends up where he or she began, \"come 'round right.\"" ], [ "Simple Gifts", "A manuscript of Mary Hazzard of the New Lebanon, New York, Shaker community records this original version of the melody:\nThe song resembles to a slight extent several repetitions of the opening measures of William Byrd's renaissance composition, \"The Barley Break\", which Byrd intended to imitate country children playing a folk game.", "Similarly, Brackett is claimed to have come up with the song as an imitation of what folk music sounds like.", "A somewhat similar musical theme arises also in a brass ensemble work \"Canzon per sonare no. 2\" by Giovanni Gabrieli (c.1555-1612).", "Many people have mistakenly believed that the tune of \"Simple Gifts\" was a traditional Celtic one but both the music and original lyrics are actually the compositions of Brackett.", "\"Simple Gifts\" has been adapted or arranged many times since by folksingers and composers.", "A well known version is by English songwriter Sydney Carter, who adapted the Shaker tune for his song \"Lord of the Dance\", first published in 1963.", "The Carter lyrics were adapted, in ignorance of the actual origins, without authorization or acknowledgments by Ronan Hardiman for Michael Flatley's dance musical \"Lord of the Dance\", which opened in 1996.", "The melody is used at various points throughout the show, including the piece titled \"Lord of the Dance.\"" ] ], "gold": "\"Simple Gifts\" was written in 1848. The song was largely unknown outside Shaker communities until Aaron Copland used its melody for the score of Martha Graham's ballet, Appalachian Spring, which had 14 movements. Copland used \"Simple Gifts\" a second time in 1950 in Set 1 of Old American Songs. This same Shaker tune was used by Sydney Carter in a widely recognized hymn entitled \"Lord of the Dance\", as well as the opening music to CBS Reports.", "prediction 1": "\"Simple Gifts\" is a Shaker song written and composed in 1848 by Elder Joseph Brackett. The music and lyrics to this one-verse Shaker song were largely unknown outside Shaker communities until Aaron Copland used its melody for the score of Martha Graham's ballet, Appalachian Spring. This same Shaker tune was used by English songwriter Sydney Carter in a widely recognized hymn entitled Lord of the Dance. Copland published independent arrangements of this section for band (1958) and orchestra (1967), titled Variations on a Shaker Melody.", "prediction 2": "In Martha Graham's ballet, Appalachian Spring, the ending variation called \"Simple Gifts\" is featured. This song was largely unknown outside Shaker communities until Aaron Copland used its melody for the score of Martha Graham's ballet \"Appalachian Spring\". The same Shaker tune was used by Sydney Carter in a widely recognized hymn entitled \"Lord of the Dance\".", "prediction 3": "The melody from Aaron Copland's 1944 Appalachian Spring is called Simple Gifts. It is a Shaker song written and composed in 1848 by Elder Joseph Brackett. This same Shaker tune was used by English songwriter Sydney Carter in a widely recognized hymn entitled Lord of the Dance.", "prediction 4": "\"Simple Gifts\" is a Shaker song written and composed in 1848 by Elder Joseph Brackett. The tune was written by Brackett while he was at the Shaker community in Alfred, Maine. Copland used \"Simple Gifts\" a second time in 1950 in his first set of Old American Songs for voice and piano, which was later orchestrated. This same Shaker tune was used by Sydney Carter in a widely recognized hymn entitled \"Lord of the Dance.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 86 }, { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 540 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Simple Gifts\" is a Shaker song written and composed in 1848 . The music and lyrics to this one-verse Shaker song were largely unknown outside Shaker communities until Aaron Copland used its melody for the score of Martha Graham's ballet, Appalachian Spring. This same Shaker tune was used by English songwriter Sydney Carter in a widely recognized hymn entitled Lord of the Dance, as well as the opening music to CBS Reports." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who was america's leading ace of ww1?", "passages": [ [ "Aerial victory standards of World War I", "Aerial victory standards of World War I\n\nDuring World War I, the national air services involved developed their own methods of assessing and assigning credit for aerial victories.", "The victory scores of the pilots represented at List of World War I flying aces (pilots with at least five victories to their credit) often cannot be definitive, but are based on itemized lists that are the best available sources of information.", "Loss of records (especially records of casualties and lost aircraft, which are at their best a very good guide to the degree of over-claiming), by mischance and the passage of time \u2013 and the detail to which such records were kept in the first place \u2013 often complicates the reconstruction of the actual count for a given ace.", "Additionally, the German victory confirmation system began to buckle in February 1918; after August 1918, such records as survived were unit records.", "World War I began the historical experience that has shown that approximately five percent of combat pilots account for the majority of air-to-air victories in warfare, thus showing the importance of flying aces.", "Enemy aircraft had to fall within friendly lines in a nation partially occupied by the enemy, or be seen by friendly ground troops falling within German lines, to be counted.", "Confirmation by fellow friendly pilots was not allowed.", "Thus, unconfirmed claims outnumbered official victories." ], [ "Billy Bishop Home and Museum", "Billy Bishop Home and Museum\n\nThe Billy Bishop Home & Museum is a museum and National Historic Site of Canada in Owen Sound, Ontario, Canada that commemorates the life and achievements of World War I flying ace and Victoria Cross winner Air Marshall William Avery \"Billy\" Bishop VC, CB, DSO and Bar, MC, DFC, and to Canada's aviation history.", "The museum is located at his birthplace and childhood home before he went to Royal Military College of Canada in Kingston, Ontario.", "It features displays of artifacts including uniforms, medals, photos, models, etc. from Canadians who fought in the air during World War I and World War II, as well as a tribute to the \"Red Baron\" Manfred von Richthofen.", "The house has the original hardwood floors, Victorian furnishings and other personal possessions of the Bishop family.", "A gift shop is open during museum hours.", "Bishop's modest gravesite is also in Owen Sound in Greenwood Cemetery.", "A plaque at the Billy Bishop Museum dedicated to William Avery \"Billy\" Bishop 1894-1956 was erected by the Historic Sites and Monuments Board of Canada.", "\"Billy Bishop was renowned as a pilot with the Royal Flying Corps and Royal Air Force during World War I by shooting down at least 72 enemy aircraft and leading other daring missions against the enemy.", "For these exploits, he was awarded the Victoria Cross, the D.S.O." ], [ "Eddie Rickenbacker", "Eddie Rickenbacker\n\nEdward Vernon Rickenbacker (October 8, 1890 \u2013 July 23, 1973) was an American fighter ace in World War I and Medal of Honor recipient.", "With 26 aerial victories, he was America's most successful fighter ace in the war.", "He was also considered to have received the most awards for valor by an American during the war.", "He was also a race car driver and automotive designer, a government consultant in military matters and a pioneer in air transportation, particularly as the long-time head of Eastern Air Lines.", "Edward Rickenbacker was born in Columbus, Ohio, to Swiss German-speaking immigrants.", "From childhood, he loved machines and experimented with them, encouraged by his father's words: \"A machine has to have a purpose\".", "In what was to become one of the defining characteristics of Rickenbacker's life, he nearly died many times in events ranging from an early run-in with a horse-drawn carriage, to a botched tonsillectomy, to airplane crashes.", "His first life-threatening experience occurred when he was in the \"Horsehead Gang\".", "He lived near a mine, and they decided to ride a cart down the slope.", "It tipped over and almost crushed them." ] ], "gold": "Pilots who scored five or more aerial victories were classified as \"air aces\". North America's leading ace of World War I was William Avery Bishop, a Canadian flying ace. The United States leading ace of World War I was Edward Vernon Rickenbacker, an American fighter ace and a Medal of Honor recipient.", "prediction 1": "In aerial victory standards of World War I, the national air services involved developed their own methods of assessing and assigning credit for aerial victories. During World War I, the national air services involved developed their own methods of assessing and assigning credit for aerial victories. The Victory Scores of the pilots represented at List of World War I Flying Aces (pilots with at least five victories to their credit) often cannot be definitive, but are based on itemized lists that are the best available sources of information. World War I began the historical experience that has shown that approximately five percent of combat pilots account for the majority of air-to-air victories in warfare.", "prediction 2": "American aviation pilot and pilots with the most aerial victories in WW1 were William Avery Bishop, Eddie Rickenbacker and John C. \"Billy\" Rickenbacker. The leading ace of WW1 was William Avery Bishop.", "prediction 3": "America's leading ace of World War I was Edward Vernon Rickenbacker, who scored a total of 26 aerial victories. The flying ace who scored the most aerial victories in World War I was William Avery \"Billy\" Bishop, who also received the Victoria Cross. Other notable American flying aces for World War I include Charles H. B. \"Billy\" Howard, who scored the most aerial victories in World War I, and Edward Vernon Rickenbacker, who scored the most aerial victories.", "prediction 4": "American ace of World War I, with 26 aerial victories, was Edward Vernon Rickenbacker. American ace of World War I and Medal of Honor recipient, with 62 aerial victories, was John D. Kennedy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 162 }, { "error type": "Redundant", "explanation": "In aerial victory standards of World War I, the national air services involved developed their own methods of assessing and assigning credit for aerial victories. ", "start": 163, "end": 301 }, { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 376 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 547 }, { "error type": "Irrelevant", "explanation": "", "start": 548, "end": 716 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "Aces were pilots with at least five victories to their credit. Edward Vernon Rickenbacker, an American fighter ace in World War I and Medal of Honor recipient, was America's most successful fighter ace in the war." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When did the first rocket launched into space?", "passages": [ [ "Spaceflight", "More well-known (though not widely outside Russia) is Konstantin Tsiolkovsky's work, \"\" (\"The Exploration of Cosmic Space by Means of Reaction Devices\"), published in 1903.", "Spaceflight became an engineering possibility with the work of Robert H. Goddard's publication in 1919 of his paper \"A Method of Reaching Extreme Altitudes\".", "His application of the de Laval nozzle to liquid fuel rockets improved efficiency enough for interplanetary travel to become possible.", "He also proved in the laboratory that rockets would work in the vacuum of space; nonetheless, his work was not taken seriously by the public.", "His attempt to secure an Army contract for a rocket-propelled weapon in the first World War was defeated by the November 11, 1918 armistice with Germany.", "Nonetheless, Goddard's paper was highly influential on Hermann Oberth, who in turn influenced Wernher von Braun.", "Von Braun became the first to produce modern rockets as guided weapons, employed by Adolf Hitler.", "Von Braun's V-2 was the first rocket to reach space, at an altitude of on a June 1944 test flight.", "Tsiolkovsky's rocketry work was not fully appreciated in his lifetime, but he influenced Sergey Korolev, who became the Soviet Union's chief rocket designer under Joseph Stalin, to develop intercontinental ballistic missiles to carry nuclear weapons as a counter measure to United States bomber planes." ], [ "V-2 rocket", "V-2 rocket\n\nThe V-2 (, \"Retribution Weapon 2\"), technical name \"Aggregat 4\" (A4), was the world's first long-range guided ballistic missile.", "The missile, powered by a liquid-propellant rocket engine, was developed during the Second World War in Germany as a \"vengeance weapon\", assigned to attack Allied cities as retaliation for the Allied bombings against German cities.", "The V-2 rocket also became the first man-made object to travel into space by crossing the K\u00e1rm\u00e1n line with the vertical launch of MW 18014 on 20 June 1944.", "Research into military use of long range rockets began when the studies of graduate student Wernher von Braun attracted the attention of the German Army.", "A series of prototypes culminated in the A-4, which went to war as the V-2.", "Beginning in September 1944, over 3,000 V-2s were launched by the German Wehrmacht against Allied targets, first London and later Antwerp and Li\u00e8ge.", "According to a 2011 BBC documentary, the attacks from V-2s resulted in the deaths of an estimated 9,000 civilians and military personnel, and a further 12,000 forced laborers and concentration camp prisoners died as a result of their forced participation in the production of the weapons." ], [ "Sub-orbital spaceflight", "Sub-orbital spaceflight\n\nA sub-orbital spaceflight is a spaceflight in which the spacecraft reaches outer space, but its trajectory intersects the atmosphere or surface of the gravitating body from which it was launched, so that it will not complete one orbital revolution.", "For example, the path of an object launched from Earth that reaches the K\u00e1rm\u00e1n line (at above sea level), and then falls back to Earth, is considered a sub-orbital spaceflight.", "Some sub-orbital flights have been undertaken to test spacecraft and launch vehicles later intended for orbital spaceflight.", "Other vehicles are specifically designed only for sub-orbital flight; examples include manned vehicles, such as the X-15 and SpaceShipOne, and unmanned ones, such as ICBMs and sounding rockets.", "Flights which attain sufficient velocity to go into low Earth orbit, and then de-orbit before completing their first full orbit, are not considered sub-orbital.", "Examples of this include Yuri Gagarin's Vostok 1, and flights of the Fractional Orbital Bombardment System.", "Usually a rocket is used, but experimental sub-orbital spaceflight has also been achieved with a space gun.", "By one definition a sub-orbital spaceflight reaches an altitude higher than above sea level." ] ], "gold": "According to Wernher von Braun, a rocket made a test flight in June 1944 reached space at an altitude of 189 kilometers (102 nautical miles). According to NASA, the Bumper-WAC reached an altitude of 393 kilometres (244 mi), in 1949 becoming the first human-made object to enter space.", "prediction 1": "The first rocket launched into space was the V-2, a long-range guided ballistic missile developed during World War II as a retaliation weapon against German civilians. On June 20, 1944, V-2 crossed the K\u00e1rm\u00e1n line with the vertical launch of MW 18014, and became the first man-made object to travel into space by crossing the K\u00e1rm\u00e1n line with the vertical launch of MW 18015 on 30 June 1944.", "prediction 2": "The first rocket launched into space was the V-2 (Retribution Weapon 2), a long-range guided ballistic missile developed in Germany during the Second World War, and was launched into space on June 20, 1944. A sub-orbital spaceflight is a spaceflight in which the spacecraft reaches outer space, but its trajectory intersects the atmosphere or surface of the gravitating body from which it was launched, so that it will not complete one orbital revolution.", "prediction 3": "The first rocket launched into space was the V-2. The V-2 rocket became the first man-made object to travel into space by crossing the K\u00e1rm\u00e1n line with the vertical launch of MW 18014 on June 20, 1944.", "prediction 4": "The first man-made object to travel into space was launched into space with a rocket in June 1944 by Wernher von Braun's V-2. The rocket reached an altitude of 63 km, and was the first to cross the K\u00e1rm\u00e1n line, crossing the K\u00e1rm\u00e1n line with the vertical launch of MW 18014 on 20 June 1944. Many other firsts in space history are associated with the launch of the V-2 and the flight of the V-2A.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 167 }, { "error type": "Redundant", "explanation": "The first rocket launched into space was the V-2, a long-range guided ballistic missile developed during World War II as a retaliation weapon against German civilians. On June 20, 1944, V-2 crossed the K\u00e1rm\u00e1n line with the vertical launch of MW 18014, ", "start": 252, "end": 391 } ], "missing-info": [], "corrected-prediction": "The first rocket launched into space was the V-2. On June 20, 1944, V-2 crossed the K\u00e1rm\u00e1n line with the vertical launch of MW 18014." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Radiocarbon dating is based on which decay process?", "passages": [ [ "Radiocarbon dating", "Radiocarbon dating\n\nRadiocarbon dating (also referred to as carbon dating or carbon-14 dating) is a method for determining the age of an object containing organic material by using the properties of radiocarbon, a radioactive isotope of carbon.", "The method was developed in the late 1940s by Willard Libby, who received the Nobel Prize in Chemistry for his work in 1960.", "It is based on the fact that radiocarbon () is constantly being created in the atmosphere by the interaction of cosmic rays with atmospheric nitrogen.", "The resulting combines with atmospheric oxygen to form radioactive carbon dioxide, which is incorporated into plants by photosynthesis; animals then acquire by eating the plants.", "When the animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay.", "Measuring the amount of in a sample from a dead plant or animal such as a piece of wood or a fragment of bone provides information that can be used to calculate when the animal or plant died.", "The older a sample is, the less there is to be detected, and because the half-life of (the period of time after which half of a given sample will have decayed) is about 5,730 years, the oldest dates that can be reliably measured by this process date to around 50,000 years ago, although special preparation methods occasionally permit accurate analysis of older samples." ] ], "gold": "Radiocarbon dating is based on the radioactive decay process of carbon-14. When a plant or animal dies, the amount of carbon-14 it contains begins to decrease through radioactive decay, meaning that measuring the amount of carbon-14 in a sample from a dead plant or animal such as a piece of wood or a fragment of bone provides information that can be used to calculate when the plant or animal died.", "prediction 1": "Radiocarbon dating is based on the fact that radiocarbon () is constantly being created in the atmosphere by the interaction of cosmic rays with atmospheric nitrogen. The resulting combines with atmospheric oxygen to form radioactive carbon dioxide, which is incorporated into plants by photosynthesis; animals then acquire by eating the plants. When the animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay. The oldest dates that can be reliably measured by this process date to around 50,000 years ago, although special preparation methods occasionally permit accurate analysis of older samples.", "prediction 2": "Radiocarbon dating is a method for determining the age of an object containing organic material by using the properties of radiocarbon, a radioactive isotope of carbon. It is based on the fact that radiocarbon () is constantly being created in the atmosphere by the interaction of cosmic rays with atmospheric nitrogen. The resulting combines with atmospheric oxygen to form radioactive carbon dioxide, which is incorporated into plants by photosynthesis; animals then acquire by eating the plants. When the animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay.", "prediction 3": "Radiocarbon dating is based on the fact that radiocarbon () is constantly being created in the atmosphere by the interaction of cosmic rays with atmospheric nitrogen. The resulting combines with atmospheric oxygen to form radioactive carbon dioxide, which is incorporated into plants by photosynthesis; animals then acquire by eating the plants. When the animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay. Because the half-life of (the period after which half of a given sample will have decayed) is about 5,730 years, the oldest dates that can be reliably measured by this process date to around 50,000 years ago.", "prediction 4": "Radiocarbon dating is a method for determining the age of an object containing organic material by using the properties of radiocarbon, a radioactive isotope of carbon. It is based on the fact that radiocarbon () is constantly being created in the atmosphere by the interaction of cosmic rays with atmospheric nitrogen. The resulting combines with atmospheric oxygen to form radioactive carbon dioxide, which is incorporated into plants by photosynthesis; animals then acquire by eating the plants. When an animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 535, "end": 723 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 345 } ], "missing-info": [], "corrected-prediction": "Radiocarbon dating (also referred to as carbon dating or carbon-14 dating) is a method for determining the age of an object containing organic material by using the properties of radiocarbon, a radioactive isotope of carbon. When the animal or plant dies, it stops exchanging carbon with its environment, and from that point onwards the amount of it contains begins to decrease as the undergoes radioactive decay." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When does season 5 of blacklist come out?", "passages": [ [ "The Blacklist (season 5)", "The Blacklist (season 5)\n\nThe fifth season of the American crime thriller television series \"The Blacklist\" premiered on NBC on September 27, 2017, with a timeslot change from Thursday at 10:00 PM to Wednesday at 8:00 PM.", "The season was produced by Davis Entertainment, Universal Television and Sony Pictures Television, and the executive producers are Jon Bokenkamp, John Davis, John Eisendrath, John Fox, and Joe Carnahan.", "The season contained 22 episodes and concluded on May 16, 2018.", "The season aired the series' 100th episode.", "\n\n\n\n", "The fifth season of \"The Blacklist\" received positive reviews from critics.", "The review aggregator website Rotten Tomatoes reports a 100% approval rating based on five reviews, with an average score of 8.5/10." ] ], "gold": "The first episode of season 5 of Blacklist came out on September 27, 2017. The season 5 finale aired on May 16, 2018.", "prediction 1": "The fifth season of the American crime thriller television series The Blacklist premiered on September 27, 2017, with a timeslot change from Thursday at 10:00 PM to Wednesday at 8:00 PM. The season contained 22 episodes and concluded on May 16, 2018. The season aired the series' 100th episode.", "prediction 2": "Season 5 of the American crime thriller television series \"The Blacklist\" premiered on NBC on September 27, 2017, with a timeslot change from Thursday at 10:00 PM to Wednesday at 8:00 PM.", "prediction 3": "Season 5 of The Blacklist premiered on NBC on September 27, 2017, with a timeslot change from Thursday at 10:00 PM to Wednesday at 8:00 PM. The season was produced by Davis Entertainment, Universal Television and Sony Pictures Television and the executive producers are Jon Bokenkamp, John Davis, John Eisendrath, John Fox, and Joe Carnahan. Season 5 was released on Netflix on September 27, 2017 and on Amazon on September 27, 2018.", "prediction 4": "Season 5 of the American crime thriller television series \"The Blacklist\" premiered on NBC on September 27, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 294 } ], "missing-info": [], "corrected-prediction": "The fifth season of The Blacklist premiered on September 27, 2017. The season concluded on May 16, 2018. " }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When does american's got talent come on?", "passages": [ [ "America's Got Talent (season 11)", "Auditions in front of the judges began on March 3, 2016 at the Pasadena Civic Auditorium in Pasadena, California.", "The premiere aired on May 31, 2016.", "The season had preliminary open call auditions in Detroit, New York City, Phoenix, Salt Lake City, Las Vegas, San Jose, San Diego, Kansas City, Los Angeles, Atlanta, Orlando, and Dallas.", "As in years past, hopeful contestants could also submit online auditions.", "This season again featured the golden buzzer, which allowed each judge (and host Nick Cannon) to send an act straight to the live shows.", "Mel B was the first judge to press it, using it for 13-year-old opera singer Laura Bretan, who performed \"Nessun dorma\".", "Howie Mandel was second to use it, for 12-year-old singer/songwriter/ukelele player Grace VanderWaal, after she performed an original song titled \"I Don't Know My Name\" in the third episode of auditions, Heidi Klum used her golden buzzer for 20-year-old singer/crooner Sal Valentinetti, who performed \"My Way\" by Frank Sinatra.", "Simon Cowell used his golden buzzer for 16-year-old Calysta Bevier, who performed \"Fight Song\" by Rachel Platten." ], [ "America's Got Talent (season 10)", "America's Got Talent (season 10)\n\nSeason Ten of the reality competition television series \"America's Got Talent\" was the 10th annual installment of the series and premiered on May 26, 2015.", "It concluded on September 16, 2015.", "Nick Cannon returned as host for his seventh season.", "Howie Mandel returned for his sixth season as a judge, and Howard Stern returned for his fourth and final season.", "Mel B and Heidi Klum both returned for their third seasons on the judging panel.", "On July 29, the show aired a special two-hour tenth anniversary retrospective episode.", "The series returned to Radio City Music Hall in New York for the live shows, which began, 2015.", "Dunkin' Donuts replaced Snapple as sponsor of the show after three seasons.", "Four guest judges were invited to judge during the judge's cuts round: actor Neil Patrick Harris, singer Michael Bubl\u00e9, actor Marlon Wayans and former judge Piers Morgan.", "This was the first season to have an all-male finale and the first where at least four magicians competed in the finals.", "Ventriloquist Paul Zerdin was voted the winner for the season on September 16, 2015.", "Comedian Drew Lynch was the runner-up, and magician Oz Pearlman came in at third place." ], [ "America's Got Talent (season 11)", "America's Got Talent (season 11)\n\nSeason eleven of the reality competition series \"America's Got Talent\" was ordered on September 1, 2015.", "The season premiered on NBC on Tuesday, May 31, 2016.", "Nick Cannon returned for his eighth and final season as host.", "Howie Mandel returned for his seventh season as a judge, while Mel B and Heidi Klum returned for their fourth season.", "Simon Cowell replaced Howard Stern as the fourth judge.", "The live shows began on July 26, at the Dolby Theatre in Los Angeles instead of Radio City Music Hall in New York from previous years.", "Due to the 2016 Summer Olympics broadcast schedule on NBC, the show took a hiatus from August 9\u201317.", "Dunkin' Donuts sponsored the show for a second season, and this season again featured the golden buzzer for each judge and Cannon.", "Four guest judges joined the panel for the judge's cuts: George Lopez, Reba McEntire, Ne-Yo, and Louis Tomlinson.", "Each judge was given a golden buzzer.", "Grace VanderWaal was announced as the winner on September 14, 2016, making her the second female act and the second child act to win the show since season 1.", "Mentalist duo, The Clairvoyants, placed second, marking the first time that females placed in the top two positions." ] ], "gold": "Season 10 of the TV show \"America's Got Talent\" aired from May 26, 2015 to September 16, 2015. Season 11 of the show aired from May 31, 2016 to September 11, 2016. Season 12 of the show aired from May 30, 2017 to September 20, 2017.", "prediction 1": "America's Got Talent premiered on NBC on Tuesday, May 31, 2016. Season 11 of the reality competition television series premiered on NBC on Tuesday, May 31, 2016.", "prediction 2": "America's Got Talent premiered on NBC on Tuesday, May 31, 2016. The 11th season of the reality competition series first aired on May 2, 2015. The 10th installment of the series premiered on May 26, 2015. The 11th season aired on May 10, 2015.", "prediction 3": "America's Got Talent first started airing on NBC on September 1, 2015. Season 11 of the reality competition series premiered on May 31, 2016. Season 12 came on NBC on June 24, 2017. Season 13 came on NBC on June 25, 2017.", "prediction 4": "America's Got Talent comes on NBC on Tuesday, May 31, 2016. Season 11 of the reality competition series came on on NBC on Tuesday, May 31, 2016. The season finished on September 16, 2015.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "America's Got Talent premiered on NBC on Tuesday, May 31, 2016. ", "start": 64, "end": 161 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "America's Got Talent season 11 premiered on NBC on Tuesday, May 31, 2016. Season 10 premiered on May 26, 2015, it concluded on September 16, 2015." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who sings chasing cars on grey's anatomy?", "passages": [ [ "Chasing Cars", "Chasing Cars\n\n\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol.", "It was released as the second single from their fourth studio album, \"Eyes Open\" (2006).", "It was recorded in 2005 and released on 6 June 2006 in the United States and 24 July 2006 in the United Kingdom.", "The song gained significant popularity in the US after being featured in the second season finale of the popular medical drama \"Grey's Anatomy\", which aired on 15 May 2006.", "\"Chasing Cars\" became notable as one of the songs that revealed the impact of legal downloads on single sales in the UK, selling consistently for years after its release.", "The song is Snow Patrol's biggest-selling single to date, ending 2006 as that year's 14th best-selling single in the UK and that year had the distinction of being the last song performed live on the BBC's \"Top of the Pops\".", "Also, on the strength of downloads, it was the UK's 34th best-selling single of 2007.", "The song peaked at number 6 on the UK Singles Chart, and number 5 on the US \"Billboard\" Hot 100.", "At the 49th Annual Grammy Awards in 2007, \"Chasing Cars\" was nominated for Best Rock Song, and at the 2007 Brit Awards it was nominated for Best British Single." ], [ "Chasing Cars", "In 2009, PPL announced \"Chasing Cars\" was the most widely played song of the decade in the UK.", "As of 2015, the song has spent 111 weeks in the official UK top 75, 166 in the top 100 and had sold over one million copies in the UK by October 2013.", "It has also sold 3,900,000 copies in the US by January 2015, making it one of the top best-selling rock songs in the digital era.", "In a 2009 Channel 4 UK poll, \"Chasing Cars\" was voted the number one \"song of the noughties\".", "Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage.", "The song has Lightbody singing a plain melody over sparse guitars, which has an ever-building crescendo.", "In an interview with \"Rolling Stone\", he said \"It's the purest love song that I've ever written.", "There's no knife-in-the-back twist.", "When I read these lyrics back, I was like, 'Oh, that's weird.'", "All the other love songs I've written have a dark edge.\"" ] ], "gold": "\"Chasing Cars\" is a song by Scottish-Northern Irish alternative rock band Snow Patrol released as the second single from their fourth studio album, \"Eyes Open.\" It was sung by the band's lead singer Gary Lightbody, who reportedly wrote the song when he became sober after a binge of white wine in the garden of the song's producer Jacknife Lee's Kent cottage. \"Chasing Cars\" gained significant popularity in the US after being featured in the second season finale of the popular medical drama Grey's Anatomy, which aired on 15 May 2006.", "prediction 1": "\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol. It was released as the second single from their fourth studio album, Eyes Open. It was recorded in 2005 and released on 6 June 2006 in the United States and 24 July 2006 in the United Kingdom. Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage.", "prediction 2": "\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol. It was released as the second single from their fourth studio album, Eyes Open. Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage. In a 2009 Channel 4 UK poll, \"Chasing Cars\" was voted the number one \"song of the noughties\".", "prediction 3": "\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol. It was released as the second single from their fourth studio album, Eyes Open. It was recorded in 2005 and released on 6 June 2006 in the United States and 24 July 2006 in the United Kingdom. Northern Irish alternative rock band Snow Patrol sang the song in Grey's Anatomy's second season finale. Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage.", "prediction 4": "\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol. It was released as the second single from their fourth studio album, Eyes Open, on June 6, 2006 in the United States and July 24, 2006 in the United Kingdom. Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 270 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Chasing Cars\" is a song by Northern Irish alternative rock band Snow Patrol. It was released as the second single from their fourth studio album, Eyes Open. Lead singer Gary Lightbody reportedly wrote the song when he became sober after a binge of white wine, in the garden of song producer Jacknife Lee's Kent cottage. The song gained significant popularity in the US after being featured in the second season finale of the popular medical drama \"Grey's Anatomy\", which aired on 15 May 2006." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played tonto in the lone ranger series?", "passages": [ [ "The Lone Ranger (animated TV series)", "The Lone Ranger (animated TV series)\n\n", "The Lone Ranger is the central character of an American animated television series that ran 26 episodes on CBS from September 10, 1966, to September 6, 1969.", "The series was produced by Herb Klynn and Jules Engel of Format Films, Hollywood, and designed and made at the Halas and Batchelor Cartoon Film studios in London, England & Artransa Park Studios in Australia.", "The adventures in this \"Lone Ranger\" series were similar in tone and nature to CBS' prime-time Weird Western, \"The Wild Wild West,\" in that some of the plots were bizarre and had elements of science-fiction and steampunk technology included in the story.", "One of the Lone Ranger's archenemies in the animated series was a dwarf named Tiny Tom; an analogue to \"The Wild Wild West\"'s Dr. Miguelito Loveless.", "The Lone Ranger's voice was provided by Michael Rye {r.n.", "John Michael Riorden Billsbury}, and Shepard Menken provided that of Tonto.", "The narrator in the opening titles was Marvin Miller, whose narration ran:\n\nOther guest voices were provided by Paul Winchell, Agnes Moorehead, and Hans Conried.", "The animation was limited." ], [ "Tonto", "Ivan Naranjo, a Blackfoot/Southern Ute actor from Colorado, voiced the character in \"The Tarzan/Lone Ranger Adventure Hour\".", "Michael Horse portrayed Tonto in the film \"The Legend of the Lone Ranger\" (1981).", "Johnny Depp's was the most recent portrayal, in the Disney film \"The Lone Ranger\" (2013).", "Tonto made his first appearance on the 11th episode of the radio show \"The Lone Ranger\".", "Two conflicting origin stories have been given for the character Tonto and how he came to work with the Lone Ranger.", "As originally presented, in the December 7, 1938, radio broadcast, Reid had already been well established as the Lone Ranger when he met Tonto.", "In that episode Cactus Pete, a friend of the Lone Ranger's, tells the story of how the masked man and Tonto first met.", "According to that tale, Tonto had been caught in the explosion when two men dynamited a gold mine they were working.", "One of the men wanted to kill the wounded Tonto, but the Lone Ranger arrived on the scene and made him administer first aid.", "The miner subsequently decided to keep Tonto around, intending to make him the fall guy when he would later murder his partner.", "The Lone Ranger foiled both the attempted murder and the framing." ] ], "gold": "Different actors played the character Tonto in the Lone Ranger series. Shepard Menken provided the voice of Tonto in the Lone Ranger 1966 series. Ivan Naranjo also played Tonto in the Lone Ranger 1980 series.", "prediction 1": "In the Lone Ranger animated TV series, Tonto is the central character and voice of a masked man. The Lone Ranger's voice was provided by Michael Rye, and Shepard Menken provided that of Tonto.", "prediction 2": "The Lone Ranger is the central character of an American animated television series that ran 26 episodes on CBS from September 10, 1966, to September 6, 1969. The voice of the Lone Ranger, Tonto, was provided by Michael Rye r.n. John Michael Riorden Billsbury, and Shepard Menken provided that of Tonto. Johnny Depp's was the most recent portrayal, in the Disney film The Lone Ranger (2013).", "prediction 3": "In the American animated television series of the same name, the character of Tonto has been played by a variety of actors. Michael Horse played Tonto in the 1981 film The Legend of the Lone Ranger. Johnny Depp portrayed Tonto in the Disney film The Lone Ranger (2013).", "prediction 4": "Tonto is the central character of an American animated television series. The Lone Ranger's voice was provided by Michael Rye r.n. John Michael Riorden Billsbury, and Shepard Menken provided that of Tonto. Johnny Depp's was the most recent portrayal, in the Disney film, The Lone Ranger (2013).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 149 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the Lone Ranger animated TV series (1966-1969(, Shepard Menken provided the voice of Tonto. Ivan Naranjo voiced Tonto in \"The Tarzan/Lone Ranger Adventure Hour\". Michael Horse portrayed Tonto in the film \"The Legend of the Lone Ranger\" (1981). Johnny Depp's was the most recent portrayal, in the Disney film \"The Lone Ranger\" (2013)." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the captain of indian cricket team right now?", "passages": [ [ "India national cricket team", "Rahul Dravid took over as Test captain in 2005.", "In 2006, he led India to its first Test series victory in the West Indies in more than 30 years.", "In September 2007, Mahendra Singh Dhoni was named as the new captain of the ODI and T20I teams, after Dravid stepped down from the post.", "Soon after taking up the captaincy, Dhoni led the team to the inaugural World Twenty20 title.", "Anil Kumble was appointed Test captain in November 2007, but retired from international cricket in November 2008 after captaining in 14 Tests.", "Dhoni succeeded him as the Test captain, making him the captain in all formats.", "Under the captaincy of Dhoni, the Indian team held the number one position in the Test rankings for 21 months (from November 2009 to August 2011), and set a national record for most back-to-back ODI wins (nine straight wins).", "Dhoni also led the team to victory in 2011 Cricket World Cup and 2013 ICC Champions Trophy.", "Thus, Dhoni became the first captain in history to win all three major ICC trophies, namely- ICC Cricket World Cup in 2011, ICC World Twenty20 in 2007 and ICC Champions Trophy in 2013.", "He is widely regarded as India's best ever captain." ], [ "India national cricket team", "Traditionally much stronger at home than abroad, the Indian team has improved its overseas form, especially in limited-overs cricket, since the start of the 21st century, winning Test matches in Australia, England and South Africa.", "It has won the Cricket World Cup twice \u2013 in 1983 under the captaincy of Kapil Dev and in 2011 under the captaincy of Mahendra Singh Dhoni.", "After winning the 2011 World Cup, India became only the third team after West Indies and Australia to have won the World Cup more than once, and the first cricket team to win the World Cup at home.", "It also won the 2007 ICC World Twenty20 and 2013 ICC Champions Trophy, under the captaincy of MS Dhoni.", "It was also the joint champions of 2002 ICC Champions Trophy, along with Sri Lanka.", ", India is ranked first in Tests, second in ODIs and second in T20Is by the ICC.", "Virat Kohli is the current captain of the team across all formats, while the head coach is Ravi Shastri.", "The Indian cricket team has rivalries with other Test-playing nations, most notably with Pakistan, the political arch-rival of India.", "However, in recent times, rivalries with nations like Australia, South Africa and England have also gained prominence.", "The British brought cricket to India in the early 1700s, with the first cricket match played in 1721." ], [ "Mithali Raj", "Mithali Raj\n\nMithali Dorai Raj (born 3 December 1982) is an Indian cricketer and the captain of the Indian women's cricket team in Tests and ODI.", "Often regarded as one of the greatest batswomen to have ever played the game, she is the highest run-scorer in women's international cricket and the only female cricketer to surpass the 6,000 run mark in WODIs.", "She is the first player to score 7 consecutive 50s in ODIs.", "Raj also holds the record for most half-centuries in WODIs.", "In June 2018 during the 2018 Women's Twenty20 Asia Cup, Mithali Raj became the first player from India (either male or female) to score 2000 runs in T20Is and also set the milestone for becoming the first woman cricketer to reach 2000 T20I runs.", "Raj is the only player (male or female) to have captained India in more than one ICC ODI World Cup final, doing so twice in 2005 and 2017.", "Mithali Raj was born in Jodhpur, Rajasthan on 3 December 1982 .", "Her father is Dorai Raj, who was an Airman (Warrant Officer) in the Indian Air Force, and mother is Leela Raj.", "She is from tamil family.", "Mithali started to play the game at age of 10 and at the age of 17, she was picked for the Indian team." ] ], "gold": "Virat Kohli is the captain of the Indian cricket team in all formats. Mithali Raj is the Test and ODI captain of women's Indian national cricket team. Harmanpreet Kaur serves as the captain of the Indian team in T20Is.", "prediction 1": "Rahul Dravid took over as Test captain in 2005. In 2006, he led India to its first Test series victory in the West Indies in more than 30 years. In September 2007, Mahendra Singh Dhoni was named as the new captain of the ODI and T20I teams, after Dravid stepped down from the post. Dhoni led the team to the inaugural World Twenty20 title. Virat Kohli is the current captain of the team across all formats.", "prediction 2": "Rahul Dravid was the captain of the Indian Test team from 2005 to 2017 and Mahendra Singh Dhoni is the captain of the ODI and T20I teams from 2017 to 2019. Virat Kohli is the current captain of the team across all formats, while the head coach is Ravi Shastri. Mithali Raj is the captain of the Indian women's cricket team in Tests and ODIs from 2018 to 2022.", "prediction 3": "There are several Indian cricket captains. Rahul Dravid was the captain of the Indian Test team in 2005 and Rahul Dravid was the captain of the Indian ODI team in 2007. Mahendra Singh Dhoni was named the new captain of the ODI and T20I teams, after Dravid stepped down from the post. Mithali Raj, who is the captain of the Indian women's cricket team in Tests and ODI, is the current captain of the team. Virat Kohli is currently the team.", "prediction 4": "In 2017, Virat Kohli is the current captain of the Indian national cricket team across all formats. In 2018, Mithali Raj became the first woman to captain the Indian women's national cricket team in both ODI and Test cricket. In 2019, Rohit Sharma was the captain of the Indian Men's cricket team.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 47 }, { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 339 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Virat Kohli is the current captain of the team across all formats. Mithali Dorai Raj is the captain of the Indian women's cricket team in Tests and ODI." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played the first ryan on last man standing?", "passages": [ [ "Last Man Standing (U.S. TV series)", "On June 19, 2012, it was also announced that twins Luke and Evan Kruntchev, who played the role of Boyd in season 1, would not be returning; they were replaced by Flynn Morrison in season 2.", "The character of Boyd was also age-advanced from two years old to five years old.", "Jordan Masterson plays Ryan, Boyd's father, in a recurring role beginning in season 2.", "The role was previously played by Nick Jonas, who guest-starred in one episode in season 1.", "The second season initially received a 13-episode order.", "ABC announced on November 12, 2012, that an additional three scripts had been ordered.", "On November 27, five more episodes were ordered to bring the second-season episode total to 18.", "On May 10, 2013, the series was renewed for a third season, which premiered on September 20, 2013, and ended on April 25, 2014, after 22 episodes.", "On May 10, 2014, ABC renewed \"Last Man Standing\" for a fourth season, which premiered on October 3, 2014.", "Allen and Elizondo guest-starred as their \"Last Man Standing\" characters in a crossover episode with the fellow ABC Friday sitcom \"Cristela\".", "On May 10, 2015, ABC announced the show had been renewed for a fifth season." ] ], "gold": "Jordan Masterson plays Ryan, Boyd's father, in a recurring role beginning in season 2. The role was previously played by Nick Jonas, who guest-starred in one episode in season 1.", "prediction 1": "Ryan, Boyd's father, is a character in the U.S. television series Last Man Standing, and is played by Jordan Masterson. Before Masterson, the role of Ryan was played by Nick Jonas in one episode of season 1.", "prediction 2": "Jordan Masterson plays Ryan, Boyd's father, in a recurring role beginning in season 2. The role was previously played by Nick Jonas, who guest-starred in one episode in season 1.", "prediction 3": "Ryan on Last Man Standing, is played by Jordan Masterson, who plays Ryan in season 2 after the character's father character, Boyd, was played by Nick Jonas, who guest-starred in one episode of season 1.", "prediction 4": "Ryan Masterson plays Ryan, Boyd's father, in a recurring role beginning in season 2. The role was previously played by Nick Jonas, who guest-starred in one episode in season 1.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Ryan, Boyd's father, is a character in the U.S. television series Last Man Standing, and is played by Jordan Masterson. Before Masterson, the role of Ryan was played by Nick Jonas in one episode of season 1." }, "preference": [ 1, 0, 0, 0, 0, 0 ] }, { "question": "Who did robert horry won his championships with?", "passages": [ [ "Robert Horry", "Robert Horry\n\nRobert Keith Horry (; born August 25, 1970) is an American retired basketball player and current sports commentator.", "He played 16 seasons in the National Basketball Association (NBA), winning seven championships, the most of any player not to have played on the 1960s Boston Celtics.", "He is one of only two players (the other is John Salley) to have won NBA championships with three teams: two with the Houston Rockets, three with the Los Angeles Lakers and two with the San Antonio Spurs.", "He earned the nickname Big Shot Bob or Rob because of his clutch shooting in important games; he is widely considered to be one of the greatest clutch performers and winners in NBA history.", "Horry now works as a commentator on Spectrum SportsNet.", "Robert Horry was born in Harford County, Maryland; soon afterwards his father, Staff Sergeant Robert Horry Sr., divorced his mother, Leila, and moved to South Carolina.", "Horry grew up in Andalusia, Alabama.", "Later, when Robert Sr. was stationed at Fort Benning, Georgia, the father and son met weekly.", "As a senior at Andalusia High School, Horry won the Naismith Alabama High School Player of the Year award.", "At the University of Alabama, he played basketball for Coach Wimp Sanderson, and he was a teammate of fellow future NBA player Latrell Sprewell." ] ], "gold": "Robert Keith Horry is an American former professional basketball player and current sports commentator. He played 16 seasons in the NBA, winning seven championships, the most of any player not to have played on the 1960s Boston Celtics. Horry is one of only four players to have won NBA championships with three teams. He won two with the Houston Rockets in 1994 and 1995, three with the Los Angeles Lakers in 2000, 2001, and 2002, and two with the San Antonio Spurs in 2005 and 2007, with no defeats in NBA Finals.", "prediction 1": "Robert Horry is an American former professional basketball player and current sports commentator. He played 16 seasons in the National Basketball Association (NBA), winning seven championships. He is one of only two players (the other is John Salley) to have won NBA championships with three teams: two with the Houston Rockets, three with the Los Angeles Lakers and two with the San Antonio Spurs.\n", "prediction 2": "Robert Horry played 16 seasons in the National Basketball Association, winning seven championships during that time. He is one of only two players to have won NBA championships with three teams. He won the championships with the Houston Rockets on three different occasions, the LA Lakers on three occasions, and the San Antonio Spurs on two occasions.", "prediction 3": "Robert Horry, now 53, is an American former professional basketball player who played in the National Basketball Association and a current sports commentator. In his NBA career, Robert Horry won championships with three different teams, two with the Houston Rockets, three with the Los Angeles Lakers, and two with the San Antonio Spurs.", "prediction 4": "Robert Horry, a former basketball player, has won seven NBA championships. He has spent time with the Houston Rockets, the Los Angeles Lakers, and the San Antonio Spurs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 250 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Robert Keith Horry is an American former professional basketball player and current sports commentator. He played 16 seasons in the National Basketball Association (NBA), winning seven championships, the most of any player not to have played on the 1960s Boston Celtics. He is one of only two players to have won NBA championships with three teams: two with the Houston Rockets, three with the Los Angeles Lakers and two with the San Antonio Spurs.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did michigan last win the final four?", "passages": [ [ "Michigan Wolverines men's basketball", "Below are lists of important players and coaches in the history of Michigan Wolverines men's basketball.", "It includes lists of major awards and retired numbers.", "The honors include: Helms Foundation Player of the Year, UPI Player of the Year, Sporting News Player of the Year, Naismith Trophy, Wooden Award, Associated Press Player of the Year, NABC Player of the Year, Oscar Robertson Trophy, NCAA Tournament MOP, National Invitation Tournament MVP, Big Ten Tournament MVP, Chicago Tribune Silver Basketball, Big Ten Player of the Year, All-America, Wayman Tisdale Award, Bob Cousy Award, UPI Coach of the Year, Henry Iba Award, NABC Coach of the Year, AP Coach of the Year.", "National Player of the Year\n\nWayman Tisdale Award\n\nBob Cousy Award\n\nNCAA Tournament MOP\n\nNational Invitation Tournament MVP\n\nBig Ten Tournament MVP\n\nChicago Tribune Silver Basketball\n\nBig Ten Player of the Year\n\nBig Ten Freshman of the Year\n\nBig Ten Defensive Player of the Year\n\nAll-Americans\n\nNational Coach of the Year \n\nBig Ten Coach of the Year\n\nThe University of Michigan has an all-time 59\u201327* (52\u201323) record overall and 1\u20136* (1\u20134) championship game record in the NCAA Tournaments in 28* (24) appearances.", "Glen Rice holds the NCAA single-tournament scoring record with 184 points in 1989." ], [ "2000 NCAA Division I Men's Basketball Tournament", "2000 NCAA Division I Men's Basketball Tournament\n\nThe 2000 NCAA Division I Men's Basketball Tournament involved 64 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball.", "It began on March 16, 2000, and ended with the championship game on April 3 in Indianapolis, Indiana at the RCA Dome.", "A total of 63 games were played.", "Due to a string of upsets throughout the tournament, only one top-four seed advanced to the Final Four.", "That was Michigan State, who finished the season as the #1 team in the nation and was given the top seed in the Midwest Region and the top overall seed.", "The highest seeded of the other three Final Four teams was Florida, who won the East Region as the fifth seed.", "Two eight-seeds made the Final Four, with Wisconsin and North Carolina rounding the bracket out.", "Wisconsin won the West Region while North Carolina won the South Region, with both regions seeing their top three seeds eliminated during the first weekend of play.", "Michigan State won their first national championship since 1979 by defeating Florida 89-76 in the final game.", "Mateen Cleaves of Michigan State was named the tournament's Most Outstanding Player, while Morris Peterson was its leading scorer.", "Despite the string of upsets, no seed lower than 11 won a game in the tournament." ], [ "1989 NCAA Division I Men's Basketball Tournament", "1989 NCAA Division I Men's Basketball Tournament\n\nThe 1989 NCAA Division I Men's Basketball Tournament involved 64 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball.", "It began on March 16, 1989, and ended with the championship game on April 3 in Seattle.", "A total of 63 games were played.", "Michigan, coached by Steve Fisher, won the national title with an 80\u201379 overtime victory in the final game over Seton Hall, coached by P. J. Carlesimo.", "Glen Rice of Michigan set an NCAA tournament record by scoring 184 points in six games and was named the tournament's Most Outstanding Player.", "Just prior to the start of this tournament, Michigan coach Bill Frieder had announced that he would accept the head coaching position at Arizona State University at the end of the season.", "Michigan athletic director Bo Schembechler promptly fired Frieder and appointed top assistant Fisher as interim coach, stating famously, that \"a Michigan man is going to coach a Michigan team.\"", "Two 16-seeded teams came within one point of victory in the first round, and a third came within six points.", "This tournament was also unusual in that all four 11-seeds advanced out of the first round." ] ], "gold": "The University of Michigan last won the NCAA Final Four in 1989. In 1989, Michigan, coached by Steve Fisher, won the national title with an 80\u201379 overtime victory in the final game over Seton Hall. Glen Rice of Michigan set an NCAA tournament record by scoring 184 points in six games and was named the tournament's Most Outstanding Player. Michigan State last won the NCAA Final Four in 2000. In 2000, Michigan State won their first national championship since 1979 by defeating Florida 89\u201376 in the final game. The Michigan State Women's Basketball Team last won a final four game in 2005. In 2005, the Michigan State Women's Basketball team made it to the Final Four in the NCAA Women's Basketball Tournament and defeated Tennessee in the semifinal before losing to Baylor 84\u201362 in the championship game.", "prediction 1": "The Michigan Wolverines last won the championship in the 1980-81 season. The Wolverines last won the championship in 1984-85 when they defeated the University of Michigan Tigers in the semifinals. The Wolverines last won the championship in the 1989-90 season when they defeated Seton Hall in overtime.", "prediction 2": "Michigan last won the final four in the 1999 NCAA Men's Basketball Tournament on April 3, 1999. The 1999 NCAA Men's Basketball Tournament was won by the University of Michigan's men's basketball team. The 1989 NCAA Men's Basketball Tournament was won by the University of Michigan.", "prediction 3": "There have been several times that Michigan have won the Final Four. In 1989, a team coached by Steve Fisher, won the national championship with an 80\u201379 overtime victory in the final game over Seton Hall. In 2000, a team coached by Mike McCarthy won the Final Four for the first time since 1979. In 1990, a team coached by Tom Izzo won the final four for the first time since 1993. In 2000, a team coached by Steve Fisher won the final four for the first time since 1990.", "prediction 4": "Michigan won the NCAA Men's Final Four for the first time in 1989, when Steve Fisher and the Michigan State Wolverines dominated the tournament. Despite being the top seed, Michigan only advanced to the Final Four for the second time in 2000, when Glen Rice set an NCAA tournament record by scoring 184 points in six games.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 57, "end": 72 }, { "error type": "Unverifiable", "explanation": "", "start": 117, "end": 124 }, { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 196 }, { "error type": "Redundant", "explanation": "The Michigan Wolverines last won the championship in the 1980-81 season. ", "start": 212, "end": 237 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Wolverines won the championship in the 1989-90 season when they won the national title with an 80\u201379 overtime victory in the final game over Seton Hall. Glen Rice of Michigan set an NCAA tournament record by scoring 184 points in six games and was named the tournament's Most Outstanding Player. Michigan State won their first national championship since 1979 by defeating Florida 89-76 in the final game." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did belly-dance become popular in the us?", "passages": [ [ "Belly dance", "The types of techniques that are used in Lebanese style dance are quick layered shimmies and subtle internal movements.", "Lebanese dancers sometimes include kicks, splits, deep back bends, and Turkish drops.", "Belly dance was popularized in the West during the Romantic movement of the 18th and 19th centuries, when Orientalist artists depicted romanticized images of harem life in the Ottoman Empire.", "Although there were dancers of this type at the 1876 Centennial in Philadelphia, it was not until the 1893 Chicago World's Fair that it gained national attention.", "The term \"belly dancing\" is often credited to Sol Bloom, its entertainment director, but referred to the dance as \"danse du ventre\", the name used by the French in Algeria.", "In his memoirs, Bloom states, \"when the public learned that the literal translation was \"belly dance\", they delightedly concluded that it must be salacious and immoral ...", "I had a gold mine.\"", "Authentic dancers from several Middle Eastern and North African countries performed at the Fair, including Syria, Turkey and Algeria\u2014but it was the dancers in the Egyptian Theater of The Street in the Cairo exhibit who gained the most notoriety.", "The fact that the dancers were uncorseted and gyrated their hips was shocking to Victorian sensibilities.", "There were no soloists, but it is claimed that a dancer nicknamed Little Egypt stole the show." ], [ "Belly dance", "When immigrants from Arab States began to arrive in New York in the 1930s, dancers started to perform in nightclubs and restaurants.", "In the late 1960s and early '70s many dancers began teaching.", "Middle Eastern or Eastern bands took dancers with them on tour, which helped spark interest in the dance.", "Although using Turkish and Egyptian movements and music, American Cabaret (\"AmCab\") belly dancing has developed its own distinctive style, using props and encouraging audience interaction.", "In 1987, a distinctively American style of group improvisational dance, American Tribal Style Belly Dance, (ATS), was created.", "Although a unique and wholly modern style, its steps are based on existing dance techniques, including those from North India, the Middle East, and Africa.", "Many forms of \"Tribal Fusion\" belly dance have also developed, incorporating elements from many other dance and music styles including flamenco, ballet, burlesque, hula hoop and even hip hop.", "\"Gothic Belly Dance\" is a style which incorporates elements from Goth subculture.", "Belly dancers are thought to have come to Spain from Lebanon in the time of the Phoenicians (11th Century BC to 5th Century BC).", "When Arab family of the Umayyad came to Spain, they sent Basque singers and dancers to Damascus and Egypt for training in the Middle Eastern style.", "These dancers came to be known as Al Andalus dancers." ] ], "gold": "Belly-dancing gained national attention in the US during the 1983 Chicago Word's Fair. However, it was not until 1982 that the American Tribal Style belly-dancing was created. ", "prediction 1": "Belly dance was popularized in the West during the Romantic movement of the 18th and 19th centuries, when Orientalist artists depicted romanticized images of harem life in the Ottoman Empire. Although there were dancers of this type at the 1876 Centennial in Philadelphia, it was not until the 1893 Chicago World's Fair that it gained national attention. In the late 1960s and early '70s many dancers began teaching. Middle Eastern or Eastern bands took dancers with them on tour, which helped spark interest in the dance. In the 1987, a distinctively American style of group improvisational dance, American Tribal Style Belly Dance, (ATS), was created. Although a unique and wholly modern style of group improvisational dance, its steps are based on existing dance techniques, its steps are based on existing dance techniques, including those from North India, the Middle East", "prediction 2": "Belly dance was popularized in the West during the Romantic movement of the 18th and 19th centuries, when Orientalist artists depicted romanticized images of harem life in the Ottoman Empire. Although there were dancers of this type at the 1876 Centennial in Philadelphia, it was not until the 1893 Chicago World's Fair that it gained national attention. In 1987, a distinctively American style of group improvisational dance, American Tribal Style Belly Dance, (ATS), was created. Although a unique and wholly modern style, its steps are based on existing dance techniques, its steps are based on existing dance techniques, including those from North India, the Middle East, the Middle East, and Africa.", "prediction 3": "Belly dance was popularized in the West during the Romantic movement of the 18th and 19th centuries, when Orientalist artists depicted romanticized images of harem life in the Ottoman Empire. Although there were dancers of this type at the 1876 Centennial in Philadelphia, it was not until the 1893 Chicago World's Fair that it gained national attention. American Tribal Style Belly Dance is a distinctively American style of group improvisational dance created in 1987, incorporating elements from many other dance and culturally modern dance techniques, including those from North India, the Middle East, Africa.", "prediction 4": "In the late 1960s and early '70s many dancers began teaching. Middle Eastern or Eastern bands took dancers with them on tour, which helped spark interest in the dance. In 1987, a distinctively American style of group improvisational dance, American Tribal Style Belly Dance, was created. Although a unique and wholly modern style, its steps are based on existing dance techniques, including those from North India, the Middle East, and Africa.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 522 }, { "error type": "Irrelevant", "explanation": "", "start": 654, "end": 877 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 416 } ], "missing-info": [], "corrected-prediction": "It was not until the 1893 Chicago World's Fair that belly dancing gained national attention. In the 1987, a distinctively American style of group improvisational dance, American Tribal Style Belly Dance, (ATS), was created." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was bohemian rhapsody released as a single?", "passages": [ [ "Bohemian Rhapsody", "In a retrospective article, Anthony DeCurtis of \"Rolling Stone\" explained why the song performed less strongly in the US charts by saying that it is \"the quintessential example of the kind of thing that doesn't exactly go over well in America\".", "Its chart run of 24 weeks, however, placed it at number 18 on \"Billboard\"'s year-end chart, higher than some number ones of the year.", "With the Canadian record-buying public, the single fared better, reaching number one in the \"RPM\" national singles chart for the week ending 1 May 1976.", "\"Bohemian Rhapsody\" was re-released as a double A-side cassette single with \"The Show Must Go On\" in January 1992 following the death of Freddie Mercury, with proceeds going to the Magic Johnson Foundation for AIDS research.", "The song re-entered the Billboard Hot 100 chart after 16 years, reaching number two and spending 17 weeks on the chart, with a year-end chart position of 39.", "After the release of the movie inspired by the song, it re-entered the charts for a third time at No. 33, marking 26 years since it last charted.", "It was certified gold by the RIAA a second time on 8 August 2005 for digital download sales over 100,000, and quadruple platinum on 23 April 2014 for combined digital sales and streams." ], [ "Queen (band)", "The music video for \"Innuendo\" combines stop motion animation with rotoscoping and band members appear as illustrations and images taken from earlier Queen music videos on a cinema screen in the same manner as in the British film \"Nineteen Eighty-Four\".", "In 2002, Queen's \"Bohemian Rhapsody\" was voted \"the UK's favourite hit of all time\" in a poll conducted by the \"Guinness World Records British Hit Singles Book\".", "In 2004, the song was inducted into the Grammy Hall of Fame.", "Many scholars consider the \"Bohemian Rhapsody\" music video ground-breaking, crediting it with popularising the medium.", "Rock historian Paul Fowles stated that the song is \"widely credited as the first global hit single for which an accompanying video was central to the marketing strategy\".", "It has been hailed as launching the MTV age.", "In December 2018, \"Bohemian Rhapsody\" became the most-streamed song from the 20th century, and the most-streamed classic rock song of all time.", "The number of downloads of the song and original video exceeded 1.6 billion across global on-demand streaming services.", "Acclaimed for their stadium rock, in 2005 an industry poll ranked Queen's performance at Live Aid in 1985 as the best live act in history.", "In 2007, they were also voted the greatest British band in history by BBC Radio 2 listeners." ], [ "A Night at the Opera (Queen album)", "The band's next album, \"A Day at the Races\", featured a similar design but on a black background.", "\"Bohemian Rhapsody\" was released as the lead single on 31 October 1975, with \"I'm in Love with My Car\" as its B-side.", "Their management initially refused to release it; however, Kenny Everett played a copy of the song on his show 14 times, at which point audience demand for the song intensified and the band's label was forced to release it.", "It subsequently topped the UK charts for nine weeks and peaked at number nine in the US.", "A second single, \"You're My Best Friend\" was released on 18 May 1976, with \"'39\" as its B-side.", "It reached number sixteen in the US and number seven in the UK.", "The album was completed a week before the group were to embark on their A Night at the Opera Tour in support of the album.", "This resulted in a 36 hour mixing session, as the group wanted to have time to rehearse their setlist before touring.", "Due to time constraints, the group only had three and a half days to rehearse, at Elstree, with four hours taken off to shoot the music video for \"Bohemian Rhapsody\".", "The tour spanned 1975 and 1976, and covered the UK, the USA, Japan, and Australia." ] ], "gold": "\"Bohemian Rhapsody\" is a song by the British rock band Queen. It was released as a single in the United Kingdom on 31 October 1975. In the United States, the single was also a success, although to a lesser extent than in the UK. The single, released in December 1975, reached number nine on the \"Billboard\" Hot 100 and was certified gold by the Recording Industry Association of America for sales of one million copies.", "prediction 1": "Bohemian Rhapsody was released as the lead single by Queen on 31 October 1975. A second single, You're My Best Friend, was released on 18 May 1976.", "prediction 2": "\"Bohemian Rhapsody\" was released as the lead single by Queen on 31 October 1975, with \"I'm in Love with My Car\" as its B-side. A second single, \"You're My Best Friend\", was released on 18 May 1976, with \"39\" as its B-side.", "prediction 3": "Bohemian Rhapsody was released as the lead single from Queen's 1975 album A Night at the Opera on 31 October 1975. A second single, You're My Best Friend, was released on 18 May 1976, with \"39\" as its B-side.", "prediction 4": "Bohemian Rhapsody was released as the lead single by Queen on 31 October 1975, with I'm in Love with My Car as its B-side. A second single, You're My Best Friend, was released on 18 May 1976, with '39 as its B-side. It reached number sixteen in the US and number seven in the UK. In January 1992, the song was re-released as a double A-side cassette single with \"The Show Must Go On\", with proceeds going to the Magic Johnson Foundation for AIDS research.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Bohemian Rhapsody was released as the lead single by Queen on 31 October 1975. A second single, You're My Best Friend, was released on 18 May 1976." }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "Who does creed fight at the end of the movie?", "passages": [ [ "Creed (film)", "Original producers Irwin Winkler and Robert Chartoff would produce, along with Stallone and Kevin King-Templeton.", "On April 25, 2014, while talking to \"THR\", Coogler stated that he had sent his latest draft to the studio, and confirmed the involvement of Jordan and Stallone.", "On November 10, real-life boxers Tony Bellew and Andre Ward joined the film, with Bellew to play a fighter, \"Pretty\" Ricky Conlan, the main opponent for Creed.", "Shooting was set to begin in January 2015, in Las Vegas and Philadelphia.", "On December 16, Tessa Thompson was added to the cast as the female lead.", "On January 8, 2015, Phylicia Rashad reportedly joined the film to play Mary Anne Creed, Apollo's widow.", "On January 21, Graham McTavish tweeted about his involvement in the film.", "Principal photography began on January 19, 2015 on location at Goodison Park, with the first scene shot taking place during a Barclays Premier League football match between Everton (of which Stallone and native Evertonian Bellew are fans) and West Bromwich Albion.", "Goodison would later host both the climactic film fight between Donnie and Conlan and also Bellew's real-life title fight against Ilunga Makabu in May 2016, which was the first outdoor boxing match in Liverpool since 1949." ] ], "gold": "Creed fights with the character Ricky Conlan at the end of the movie. Anthony Bellew is the real name of the actor that portrayed antagonist boxer Ricky Conlan.", "prediction 1": "Creed fights Ricky Conlan at the end of the movie, who is played by Tony Bellew in the film. In the real-life version of the movie, Creed fights Pretty Ricky Conlan.", "prediction 2": "Creed, the movie, is an American action film directed by Sylvester Stallone and starring Sylvester Stallone. In the ending, Creed fights against two opponents, Pretty Ricky Conlan, played by Tony Bellew, and Ricky Conlan, played by Andre Ward.", "prediction 3": "The main opponent for Creed at the end of the movie is Pretty Ricky Conlan, played by Tony Bellew.", "prediction 4": "Creed fights Pretty Ricky Conlan at the end of the movie. In the original Creed movie, Creed fights Donnie \"Pretty\" Conlan and Conlan fight Pretty Donnie.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Creed fights Ricky Conlan at the end of the movie, ", "start": 93, "end": 165 } ], "missing-info": [], "corrected-prediction": "Creed fights Ricky Conlan at the end of the movie, who is played by Tony Bellew in the film. " }, "preference": [ 2, 1, 0, 1, 0, 2 ] }, { "question": "When was the first pair of headphones invented?", "passages": [ [ "Headphones", "The first truly successful set was developed in 1910 by Nathaniel Baldwin, who made them by hand in his kitchen and sold them to the United States Navy.", "These early headphones used moving iron drivers, with either single-ended or balanced armatures.", "The common single-ended type used voice coils wound around the poles of a permanent magnet, which were positioned close to a flexible steel diaphragm.", "The audio current through the coils varied the magnetic field of the magnet, exerting a varying force on the diaphragm, causing it to vibrate, creating sound waves.", "The requirement for high sensitivity meant that no damping was used, so the frequency response of the diaphragm had large peaks due to resonance, resulting in poor sound quality.", "These early models lacked padding, and were often uncomfortable to wear for long periods.", "Their impedance varied; headphones used in telegraph and telephone work had an impedance of 75\u00a0ohms.", "Those used with early wireless radio had more turns of finer wire to increase sensitivity.", "Impedance of 1000 to 2000\u00a0ohms was common, which suited both crystal sets and triode receivers.", "Some very sensitive headphones, such as those manufactured by Brandes around 1919, were commonly used for early radio work.", "In early powered radios, the headphone was part of the vacuum tube's plate circuit and carried dangerous voltages." ] ], "gold": "There are several headphones, including regular headphones, the first pair of which was invented in 1910, and noise-cancelling headphones, the first pair of which was invented between 1958 and 1961.", "prediction 1": "The first pair of headphones was invented in 1910 by Nathaniel Baldwin, who made them by hand in his kitchen and sold them to the United States Navy. These early headphones used moving iron drivers, with either single-ended or balanced armatures. The common single-ended type used voice coils wound around the poles of a permanent magnet, which were positioned close to a flexible steel diaphragm, causing it to vibrate, creating sound waves.", "prediction 2": "The first truly successful set of headphones was developed in 1910 by Nathaniel Baldwin, who made them by hand in his kitchen and sold them to the United States Navy.", "prediction 3": "The first pair of headphones was invented in 1910 by Nathaniel Baldwin, who made them by hand in his kitchen and sold them to the United States Navy. These early headphones used moving iron drivers, with either single-ended or balanced armatures. The common single-ended type used voice coils wound around the poles of a permanent magnet, which were positioned close to a flexible steel diaphragm, creating sound waves.", "prediction 4": "The first truly successful set of headphones was developed in 1910 by Nathaniel Baldwin, who made them by hand in his kitchen and sold them to the United States Navy. The first truly successful set of headphones was developed in 1912 by Emilio De Castro.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 246 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 442 }, { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 71 } ], "missing-info": [], "corrected-prediction": "The first pair of headphones was invented in 1910. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who wrote like a bird on a wire?", "passages": [ [ "Bird on the Wire", "In the sleevenotes to a 2007 rerelease of \"Songs From A Room\" the song was described as \"simultaneously a prayer and an anthem, a kind of Bohemian 'My Way'.\"", "In the liner notes to the 1975 compilation \"The Best of Leonard Cohen\", Cohen wrote about the song:\nIt has been suggested that the song to which Kristofferson was referring is \"Turn Me On\", written by Nashville songwriter John D. Loudermilk, which was originally recorded by Mark Dinning in 1961 and later covered by many other artists, including Nina Simone, and which shares a similar melody and some lyrical patterns with Cohen's song.", "Many artists have covered the song, often as \"Bird on \"a\" Wire\" (indeed, this variation appears in the compilation \"The Essential Leonard Cohen\"), including:" ], [ "Bird on the Wire", "Bird on the Wire\n\n\"Bird on the Wire\" is one of Leonard Cohen's signature songs.", "It was recorded 26 September 1968 in Nashville and included on his 1969 album \"Songs from a Room\".", "A May 1968 recording produced by David Crosby, titled \"Like a Bird\", was added to the 2007 remastered CD.", "Judy Collins was the first to release the song on her 1968 album \"Who Knows Where the Time Goes\".", "In the 1960s, Cohen lived on the Greek island Hydra with his girlfriend Marianne Ihlen, the woman depicted on the back cover of \"Songs from a Room\".", "She has related how she helped him out of a depression by handing him his guitar, whereupon he began composing \"Bird on the Wire\", inspired by a bird sitting on one of Hydra's recently installed phone wires, followed by memories of wet island nights.", "He finished it in a Hollywood motel.", "Cohen has described \"Bird on the Wire\" as a simple country song, and the first recording, by Judy Collins, was indeed done in a country setting.", "He later made various minor changes, such as the modifications present on \"Cohen Live\".", "Different renditions are included on all of his live albums.", "On occasion he also performed Serge Lama's French version, \"Vivre tout seul\", in concert." ], [ "Bird on a Wire (film)", "Bird on a Wire (film)\n\nBird on a Wire is a 1990 American action comedy film starring Mel Gibson and Goldie Hawn, directed by John Badham, and shot mainly in British Columbia, Canada.", "The title refers to the Leonard Cohen song \"Bird on the Wire\".", "The alley motorcycle chase scene was filmed in Victoria's Chinatown, in Fan Tan Alley.", "Marianne Graves (Goldie Hawn) is a successful lawyer completing a business deal in Detroit, Michigan.", "At a gas station, she crosses paths with a man that looks suspiciously like her ex-fianc\u00e9, Rick Jarmin (Mel Gibson), who had disappeared 15 years previously and was presumed dead.", "The man feigns ignorance and Marianne leaves; he later makes a call saying that he has been recognized and needs to be moved.", "Rick had helped convict a drug-dealing DEA agent named Eugene Sorenson (David Carradine) and was placed in the witness protection program.", "Unfortunately, his old handler has retired and his new handler, Joe Weyburn (Stephen Tobolowsky), is a corrupt FBI agent working with Sorenson.", "Sorenson is released from prison after serving his sentence; his partner, Albert \"Diggs\" Diggins (Bill Duke), picks him up and they set out to kill Rick for revenge and to smooth the passage of their latest deal with drug dealers." ] ], "gold": "The title \"Bird on a Wire\" refers to several things. \"Bird on the Wire\" is one of Leonard Cohen's signature songs, which was written by him. Bird on a Wire is a 1990 American action written by Louis Venosta, David Seltzer. Leonard Cohen: Bird on a Wire, originally titled Bird on a Wire, is a 1974 documentary, which was written by Tony Palmer. ", "prediction 1": "Leonard Cohen wrote the song \"Bird on the Wire\", which is one of his signature songs. The song was recorded 26 September 1968 in Nashville and included on his 1969 album \"Songs from a Room\". In the 1960s, Cohen lived on the Greek island Hydra with his girlfriend Marianne Ihlen, the woman depicted on the back cover of \"Songs from a Room\". She has related how she helped him out of a depression by handing him his guitar, whereupon he began composing the song, inspired by a bird sitting on one of Hydra's recently installed phone wires, followed by memories of wet island nights. He finished it in a Hollywood motel.", "prediction 2": "Leonard Cohen wrote a song that was called \"like a bird on a wire\" in the 1960s, inspired by a bird sitting on one of Hydra's recently installed phone wires. The song was recorded 26 September 1968 in Nashville and included on his 1969 album \"Songs from a Room\". It was rediscovered in a May 1968 recording produced by David Crosby and renamed \"Like a Bird\".", "prediction 3": "Leonard Cohen composed the song \"Bird on the Wire\" in the 1960s, inspired by a bird sitting on one of Hydra's recently installed phone wires, followed by memories of wet island nights. The song was recorded 26 September 1968 in Nashville and included on his 1969 album \"Songs from a Room\". A May 1968 recording produced by David Crosby, titled \"Like a Bird\", was added to the 2007 remastered CD.", "prediction 4": "\"Bird on the Wire\" is one of Leonard Cohen's signature songs. It was recorded 26 September 1968 in Nashville and included on his 1969 album Songs from a Room. A May 1968 recording produced by David Crosby, titled \"Like a Bird\", was added to the 2007 remastered CD. In the 1960s, Cohen lived on the Greek island Hydra with his girlfriend Marianne Ihlen, the woman depicted on the back cover of \"Songs from a Room.\" She related how she helped him out of a depression by handing him his guitar, whereupon he began composing \"Bird on the Wire\", inspired by a bird sitting on one of Hydra's recently installed telephone wires, followed by memories of wet island nights. He finished it in a Hollywood motel. Bird on a Wire is a 1990 American action comedy film directed", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 191, "end": 339 }, { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 580 }, { "error type": "Irrelevant", "explanation": "", "start": 581, "end": 617 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Leonard Cohen wrote the song \"Bird on the Wire\", which is one of his signature songs. Bird on the Wire is also a 1990 American action comedy film." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the carbon tax introduced in canada?", "passages": [ [ "Carbon tax", "In the 2008 Canadian federal election, a carbon tax proposed by Liberal Party leader St\u00e9phane Dion, known as the Green Shift, became a central issue in the campaign.", "It would have been revenue-neutral, with increased taxation on carbon being balanced by tax cuts for individual citizens.", "However, it proved to be unpopular and contributed to the defeat of Liberal Party with its worst share of the popular vote since Confederation.", "By contrast, the Conservative party, who won the election, had promised to \"develop and implement a North American-wide cap-and-trade system for greenhouse gases and air pollution, with implementation to occur between 2012 and 2015.\"", "In 2018, Canada passed the Greenhouse Gas Pollution Pricing Act implementing revenue-neutral carbon tax starting in 2019.", "This fulfils a campaign pledge that Justin Trudeau made in 2015, before being elected as Prime Minister of Canada.", "The Greenhouse Gas Pollution Pricing Act will apply only to provinces which do not have provincial carbon pricing systems meeting the federal requirements.", "In each province, the taxed money will be redistributed to citizens (households).", "The Canadian province of Quebec became the first in Canada to introduce a carbon tax.", "The tax was to be imposed on energy producers starting October 1, 2007, with revenue collected used for energy-efficiency programs including public transit." ], [ "Carbon credit", "Consumers would still not know how much of the price is due to carbon emissions, but they could make their decisions confident that they are paying for the social cost of their carbon footprint.", "Nordhaus has suggested, based on the social cost of carbon emissions, that an optimal price of carbon is around $30(US) per ton and will need to increase with inflation.", "The social cost of carbon is the additional damage caused by an additional ton of carbon emissions.", "...", "The optimal carbon price, or optimal carbon tax, is the market price (or carbon tax) on carbon emissions that balances the incremental costs of reducing carbon emissions with the incremental benefits of reducing climate damages. ...", "[I]f a country wished to impose a carbon tax of $30 per ton of carbon, this would involve a tax on gasoline of about 9 cents per gallon.", "Similarly, the tax on coal-generated electricity would be about 1 cent per kWh, or 10 percent of the current retail price.", "At current levels of carbon emissions in the United States, a tax of $30 per ton of carbon would generate $50 billion of revenue per year.", "Carbon credits create a market for reducing greenhouse emissions by giving a monetary value to the cost of polluting the air.", "Emissions become an internal cost of doing business and are visible on the balance sheet alongside raw materials and other liabilities or assets." ], [ "Green economy policies in Canada", "For the federal government, there are several policy instruments that are available.", "Spending has been a key instrument in attempting to mitigate the effects of climate change so far.", "Government investment and support in regards to green technology will only further the process of decarbonisation in Canada.", "The federal government also collaborates frequently with the provinces in regards to how to move forward pursuing green technologies.", "The federal government also controls the Low Carbon Economy Fund, the money which could be used as leverage and under conditional circumstances to promote climate action from the provinces.", "In the federal budget of 2016 tabled by the federal government, the budget proposed providing $1 billion over 4 years to support clean technology.", "This included the forestry, fisheries, mining, energy and agriculture sectors.", "Budget 2016 also provided $2.9 billion over 5 years to address climate change and air pollution issues aimed at reducing emissions and help meeting international obligations.", "In total, nearly $1.6 billion will be spent on a clean growth economy from 2016-2018 by the federal government.", "Recently the federal government has established a minimum carbon price floor for provinces that do not currently have a pricing program.", "According to the federal government, they are leaving it up to the provinces to implement a carbon pricing scheme.", "Below are government stated goals for the new carbon pricing strategy:\nCarbon pricing has been a relatively new campaign pursued by the Government of Canada." ] ], "gold": "The first carbon tax, which is a tax levied on the carbon emissions required to produce goods and services, that was introduced in a Canadian territory was in June 2007, when Quebec implemented a carbon tax which was expected to generate $2 million annually. The first carbon tax that was introduced during a federal election was during the 2008 Canadian federal election, when Liberal Party leader St\u00e9phane Dion proposed a carbon tax. It would have been revenue-neutral, balancing increased taxation on carbon with rebates, but it proved to be unpopular and contributed to the Liberal Party's defeat, earning the lowest vote share since Confederation. A carbon tax strategy was again introduced in response to criticism after the Paris agreement in December 2016, when the ten provinces and the Canadian government presented their \"executive, mitigation and adaptation\" strategies towards a clean economy.", "prediction 1": "The carbon tax was introduced by Quebec in 2007. Quebec was the first province in Canada to introduce a carbon tax.", "prediction 2": "Carbon pricing in Canada is a relatively new campaign pursued by the Government of Canada. In the 2008 Canadian federal election, a carbon tax proposed by Liberal Party leader St\u00e9phane Dion, known as the Green Shift, became a central issue in the campaign. However, it proved to be unpopular and contributed to the defeat of Liberal Party with its worst share of the popular vote since Confederation. In 2018, Canada passed the Greenhouse Gas Pollution Pricing Act implementing revenue-neutral carbon tax starting in 2019. This fulfils a campaign pledge that Justin Trudeau made in 2015, before being elected as Prime Minister of Canada. The Canadian province of Quebec became the first in Canada to introduce a tax on energy producers starting October 1, 2007.", "prediction 3": "In Canada, the Carbon Tax was introduced in 2008. It was proposed in the 2008 Canadian federal election, but proved to be unpopular, and led to the defeat of the Liberal Party with its worst share of the popular vote since Confederation. In 2018, Canada passed the Greenhouse Gas Pollution Pricing Act implementing a revenue-neutral carbon tax starting in 2019.", "prediction 4": "The Canadian province of Quebec became the first in Canada to introduce a carbon tax. The tax was to be imposed on energy producers starting October 1, 2007.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The carbon tax was introduced by Quebec in October 2007. Quebec was the first province in Canada to introduce a carbon tax, to be imposed on energy producers. In the 2008 Canadian federal election, a carbon tax proposed by Liberal Party leader St\u00e9phane Dion. It would have been revenue-neutral, with increased taxation on carbon being balanced by tax cuts for individual citizens. However, it proved to be unpopular and contributed to the defeat of Liberal Party with its worst share of the popular vote since Confederation. In 2018, Canada passed the Greenhouse Gas Pollution Pricing Act implementing revenue-neutral carbon tax starting in 2019" }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Prison break what episode do michael and sara kiss?", "passages": [ [ "Prison Break (season 1)", "\n\nThe season was produced by Adelstein-Parouse Productions, in association with Original Television and 20th Century Fox Television.", "The executive producers were creator Paul Scheuring, Marty Adelstein, Neal H. Moritz, Dawn Parouse, Brett Ratner and Matt Olmstead.", "The staff writers were Scheuring, co-executive producers Nick Santora and Zack Estrin, supervising producer Karyn Usher and Olmstead.", "The regular director throughout the season was Bobby Roth; additional directors were Jace Alexander, Matt Earl Beesley and Dwight H. Little.", "Its incidental music was composed by Ramin Djawadi.", "Most of the first season of the series was filmed on location in and around Chicago.", "After it was closed down in 2002, Joliet Prison became the set of \"Prison Break\" in 2005, standing in as Fox River State Penitentiary on screen.", "Scenes set in Lincoln's cell, the infirmary and the prison yard were all shot on location at the prison.", "Lincoln's cell is the same one in which John Wayne Gacy was incarcerated.", "Most of the production crew refused to enter the cell, thinking that it was haunted." ] ], "gold": "Prison Break is produced by Adelstein-Parouse Productions, in association with Rat Entertainment, Original Film and 20th Century Fox Television. In Season 1 episode 19, called \"The Key\", Michael and Sara kiss. \"The Key\" aired on April 24, 2006.", "prediction 1": "On the first season of the television series Prison Break, the kissing scene happens in episode 4, episode 106.", "prediction 2": "Prison Break is a 2005 American television series. The episode in which Michael and Sara kiss is \"Sarah and Michael\" in Season 1.", "prediction 3": "In episode 103 of Prison Break, when Michael and Sara kiss, they do so in episode 105.", "prediction 4": "Prison Break: The Original Series, Episode 1: Love and Hate, is the episode in which Michael and Sara kiss.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 59, "end": 111 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first season of the television series Prison Break was produced by Adelstein-Parouse Productions, in association with Original Television and 20th Century Fox Television." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who did the justice league fight in the movie?", "passages": [ [ "Justice League (film)", "Labs employees are kidnapped by Steppenwolf seeking to acquire the Mother Box from mankind.", "Steppenwolf attacks Atlantis to retrieve the next Mother Box, forcing Curry into action.", "The team receives intel from Commissioner James Gordon leading them to Steppenwolf's army, based in an abandoned facility under Gotham Harbor.", "Although the group manages to rescue the kidnapped employees, the facility is flooded during combat, which traps the team until Curry helps delay the flood so they can escape.", "Stone retrieves the last Mother Box, which he had hidden, for the group to analyze.", "Stone reveals that his father used the Mother Box to rebuild Stone's body after an accident almost cost him his life.", "Wayne decides to use the Mother Box to resurrect Superman, not only to help them fight off Steppenwolf's invasion, but also to restore hope to mankind.", "Diana and Curry are hesitant about the idea, but Wayne forms a secret contingency plan in case Superman returns as hostile.", "Clark Kent's body is exhumed and placed in the amniotic fluid of the genesis chamber of the Kryptonian ship alongside the Mother Box, which in turn activates and successfully resurrects Superman.", "However, Superman's memories have not returned, and he attacks the group after Stone accidentally launches a projectile at him." ], [ "Justice League: War", "Darkseid uses his Omega Beams to fight Flash and Superman, who is incapacitated and captured by a Parademon.", "Batman prevents Green Lantern from going after them on his own with a broken arm.", "He tells Green Lantern to think about the lives at stake rather than his own image as a hero, and after unmasking himself, reveals that his parents' murders are what motivated him to fight evil.", "Bruce allows himself to be captured to save Superman.", "Green Lantern decides to strip Darkseid of his Omega Beams by destroying his eyes.", "Bruce goes through a portal to Apokolips, where he escapes the Parademon and stops Desaad from turning Superman into a Parademon.", "Superman is left unstable and highly aggressive because of the brainwashing process, resulting in him strangling Desaad to death and attacking Parademons and Batman.", "Batman reasons with him, and helps him reassert his own personality.", "On Earth, after Darkseid's eyes are destroyed, Cyborg reopens the Boom Tubes to send Darkseid and his army back to Apokolips.", "Darkseid fights back, and with Superman and Batman's assistance, the group eventually force him through the portal.", "With the world saved, the superheroes gain the public's trust and are honored at the White House." ], [ "Justice League: War", "Justice League:", "War\n\nJustice League:", "War is a direct-to-video animated superhero film featuring the DC Comics superhero team the Justice League, and an adaptation of the story \"Justice League: Origin\" by Geoff Johns and Jim Lee, the first story in DC's 2011 DC Universe relaunch.", "It was directed by Jay Oliva, scripted by Heath Corson.", "It is the 18th film from the DC Universe Animated Original Movies series that is a part of a new shared continuity, the DC Animated Movie Universe.", "The film was released for downloading on January 21, 2014 and was released on Blu-ray and DVD formats on February 4, 2014.", "It had its world premiere at the Paley Center for Media on the same day. On August 11, 2015, Warner Home Video re-released the film on a combo pack, which includes a DVD and Blu-Ray copy, a digital copy, and the graphic novel it's based on.", "The film depicts an invasion of Earth by the alien Darkseid and the subsequent formation of the titular superhero team to counter it, which includes Superman, Batman, Wonder Woman, Flash, Green Lantern, Cyborg and Shazam." ] ], "gold": "There are several movies called Justice League. Justice League: War is a 2014 direct-to-video animated superhero film. Darkseid fought Justice League in the 2014 animated movie. Justice League is a 2017 American superhero film. Steppenwolf fought Justice League in the live action 2017 movie.", "prediction 1": "In the 2014 film Justice League: War, the DC Comics superhero team the Justice League fights the evil entity Steppenwolf. In the film, the villains are Superman, Wonder Woman, Flash, Green Lantern, Cyborg, Batwoman, and Wonder Woman.", "prediction 2": "Justice League: War is a direct-to-video animated superhero film featuring the DC Comics superhero team the Justice League, an adaptation of the story Justice League: Origin by Geoff Johns and Jim Lee, the first story in DC's 2011 DC Universe relaunch. It depicts an invasion of Earth by the alien Darkseid and the subsequent formation of the titular superhero team to counter it, which includes Superman, Batman, Green Lantern, Cyborg and Shazam.", "prediction 3": "Justice League: War is an animated superhero film which features the DC Comics superhero team the Justice League. They are fighting a new enemy called Steppenwolf, who is based on the comic book character's name and the character's origin story. During the film, the team battles Steppenwolf and his army, which are based in an abandoned facility under Gotham Harbor. Steppenwolf is based on the character of Steppenwolf, who is an evil alien who has been known to infect humans with its Omega Beams.", "prediction 4": "Justice League: War is a direct-to-video animated superhero film featuring the DC Comics superhero team the Justice League, and an adaptation of the story \"Justice League: Origin\" by Geoff Johns and Jim Lee, the first story in DC's 2011 DC Universe relaunch. The team fights Steppenwolf after he kidnaps the employees of the Labs while trying to retrieve the Mother Box from mankind. The facility is flooded during combat, trapping the team until Curry helps delay the flood so they can escape.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 122, "end": 233 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "War is a direct-to-video animated superhero film featuring the DC Comics superhero team the Justice League, and an adaptation of the story \"Justice League: Origin\" by Geoff Johns and Jim Lee, the first story in DC's 2011 DC Universe relaunch. Darkseid uses his Omega Beams to fight Flash and Superman, who is incapacitated and captured by a Parademon. In the Justice League film, Steppenwolf attacks Atlantis to retrieve the next Mother Box, forcing Curry into action. Although the group manages to rescue the kidnapped employees, the facility is flooded during combat, which traps the team until Curry helps delay the flood so they can escape." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who has calculated the most digits of pi?", "passages": [ [ "Pi", "Bill Gosper was the first to use it for advances in the calculation of , setting a record of 17 million digits in 1985.", "Ramanujan's formulae anticipated the modern algorithms developed by the Borwein brothers and the Chudnovsky brothers.", "The Chudnovsky formula developed in 1987 is\nIt produces about 14 digits of per term, and has been used for several record-setting calculations, including the first to surpass 1 billion (10) digits in 1989 by the Chudnovsky brothers, 2.7 trillion (2.7\u00d710) digits by Fabrice Bellard in 2009, 10 trillion (10) digits in 2011 by Alexander Yee and Shigeru Kondo, and the current record of over 22 trillion digits in 2016 by Peter Trueb.", "For similar formulas, see also the Ramanujan\u2013Sato series.", "In 2006, Canadian mathematician Simon Plouffe used the PSLQ integer relation algorithm to generate several new formulas for , conforming to the following template:\nwhere is (Gelfond's constant), is an odd number, and are certain rational numbers that Plouffe computed.", "Monte Carlo methods, which evaluate the results of multiple random trials, can be used to create approximations of ." ], [ "Pi", "Pi\n\nThe number () is a mathematical constant.", "Originally defined as the ratio of a circle's circumference to its diameter, it now has various equivalent definitions and appears in many formulas in all areas of mathematics and physics.", "It is approximately equal to 3.14159.", "It has been represented by the Greek letter \"\" since the mid-18th century, though it is also sometimes spelled out as \"pi\".", "It is also called Archimedes' constant.", "Being an irrational number, cannot be expressed as a common fraction (equivalently, its decimal representation never ends and never settles into a permanently repeating pattern).", "Still, fractions such as 22/7 and other rational numbers are commonly used to approximate .", "The digits appear to be randomly distributed.", "In particular, the digit sequence of is conjectured to satisfy a specific kind of statistical randomness, but to date, no proof of this has been discovered.", "Also, is a transcendental number; that is, it is not the root of any polynomial having rational coefficients.", "This transcendence of implies that it is impossible to solve the ancient challenge of squaring the circle with a compass and straightedge.", "Ancient civilizations required fairly accurate computed values to approximate for practical reasons, including the Egyptians and Babylonians.", "Around 250 BC the Greek mathematician Archimedes created an algorithm for calculating it." ], [ "Pi", "According to J\u00f6rg Arndt and Christoph Haenel, thirty-nine digits are sufficient to perform most cosmological calculations, because that is the accuracy necessary to calculate the circumference of the observable universe with a precision of one atom.", "Accounting for additional digits needed to compensate for computational round-off errors, Arndt concludes that a few hundred digits would suffice for any scientific application.", "Despite this, people have worked strenuously to compute to thousands and millions of digits.", "This effort may be partly ascribed to the human compulsion to break records, and such achievements with often make headlines around the world.", "They also have practical benefits, such as testing supercomputers, testing numerical analysis algorithms (including high-precision multiplication algorithms); and within pure mathematics itself, providing data for evaluating the randomness of the digits of .", "Modern calculators do not use iterative algorithms exclusively.", "New infinite series were discovered in the 1980s and 1990s that are as fast as iterative algorithms, yet are simpler and less memory intensive.", "The fast iterative algorithms were anticipated in 1914, when the Indian mathematician Srinivasa Ramanujan published dozens of innovative new formulae for , remarkable for their elegance, mathematical depth, and rapid convergence.", "One of his formulae, based on modular equations, is\nThis series converges much more rapidly than most arctan series, including Machin's formula." ] ], "gold": "The number \u03c0, spelled out as \"pi\", is a mathematical constant, approximately equal to 3.14159. Modern \u03c0 calculators do not use iterative algorithms exclusively. Ramanujan's formulae anticipated the modern algorithms developed by the Borwein brothers, Jonathan and Peter, and the Chudnovsky brothers. It produces about 14 digits of per term, and has been used for several record-setting calculations, including the first to surpass 1 billion (10) digits in 1989 by the Chudnovsky brothers, 2.7 trillion (2.7\u00d710) digits by Fabrice Bellard in 2009, 10 trillion (10) digits in 2011 by Alexander Yee and Shigeru Kondo, and over 22 trillion digits in 2016 by Peter Trueb.", "prediction 1": "The number pi is a mathematical constant. Originally defined as the ratio of a circle's circumference to its diameter, it now has various equivalent definitions and appears in many formulas in all areas of mathematics and physics. The Indian mathematician Srinivasa Ramanujan published dozens of innovative new formulae for, remarkable for their elegance, mathematical depth, and rapid convergence. The current record of over 22 trillion digits was set in 2016 by Peter Trueb.", "prediction 2": "The number pi, or pi, is a mathematical constant. Originally defined as the ratio of a circle's circumference to its diameter, it now has various equivalent definitions and appears in many formulas in all areas of mathematics and physics. The number has been represented by the Greek letter pi since the mid-18th century. The current record of over 22 trillion digits in 2016 was set by Peter Trueb.", "prediction 3": "The number pi is a mathematical constant. Originally defined as the ratio of a circle's circumference to its diameter, it now has various equivalent definitions and appears in many formulas in all areas of mathematics and physics. Despite this, people have worked strenuously to compute to thousands and millions of digits. The number who has calculated the most digits of pi is Srinivasa Ramanujan, who published dozens of innovative new formulae for.", "prediction 4": "The number pi is a mathematical constant, also known as the circle's circumference or diameter. In the past, the most digits of pi have been calculated by Bill Gosper, who set a record of 17 million digits in 1985. Srinivasa Ramanujan's formulae anticipated the modern algorithms developed by the Borwein brothers and the Chudnovsky brothers. The Chudnovsky formula developed in 1987 is It produces about 14 digits of per term, and has been used for several record-setting calculations, including the first to surpass 1 billion (10) digits in 1989 by the Chudnovsky brothers, 2.7 trillion (2.710) digits by Fabrice Bellard in 2009, 10 trillion digits in 2011 by Alexander Yee and Shigeru Kondo, and the current record of over 22 trillion digits in 2016 by Peter Trueb.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 398 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The number pi is a mathematical constant, approximately equal to 3.14159. Ramanujan's formulae anticipated the modern algorithms developed by the Borwein brothers and the Chudnovsky brothers. The Chudnovsky formula developed in 1987 is It produces about 14 digits of per term, and has been used for several record-setting calculations, including the first to surpass 1 billion (10) digits in 1989 by the Chudnovsky brothers, 2.7 trillion (2.7\u00d710) digits by Fabrice Bellard in 2009, 10 trillion (10) digits in 2011 by Alexander Yee and Shigeru Kondo, and the current record of over 22 trillion digits in 2016 by Peter Trueb." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is the largest mall in the united states located?", "passages": [ [ "Mall of America", "Mall of America\n\n", "The Mall of America (commonly, locally known as \"MOA\") is a shopping mall located in Bloomington, Minnesota, United States (a suburb of the Twin Cities).", "It lies southeast of the junction of Interstate 494 and Minnesota State Highway 77, north of the Minnesota River, and across the Interstate from the Minneapolis\u2013St. Paul International Airport.", "Opened in 1992, it is the largest mall in the United States in terms of total floor area (including Nickelodeon Universe), the fifth largest mall in North America in terms of leaseable space, and the twelfth largest in the world.", "The mall is managed by the Triple Five Group (which in turn is owned by Canada's Ghermezian family, along with the West Edmonton Mall and the future American Dream Meadowlands).", "Eighty percent of visitors to the Mall of America are from Minnesota, Wisconsin, Iowa, Nebraska, the Dakotas, Illinois, Ohio, and Canada.", "The mall's concept was designed by the Triple Five Group, owned by the Ghermezian brothers, who also own the largest shopping mall in North America, the West Edmonton Mall.", "The Mall of America is located on the site of the former Metropolitan Stadium, where the Minnesota Vikings and Minnesota Twins played until the Hubert H. Humphrey Metrodome opened in 1982." ] ], "gold": "The Mall of America is a shopping mall located in Bloomington, Minnesota, within the Twin Cities metropolitan area. It opened in 1992 and is the seventh largest shopping mall in the world, and the largest in the western hemisphere, receiving approximately 40 million visitors annually.", "prediction 1": "The largest mall in the United States in terms of total floor area, including Nickelodeon Universe, is located in Bloomington, Minnesota. It lies southeast of the junction of Interstate 494 and Minnesota State Highway 77, north of the Minnesota River, and across the Interstate from the Minneapolis\u2013St. Paul International Airport.\n", "prediction 2": "The Mall of America is a shopping mall located in Bloomington, Minnesota, United States (a suburb of the Twin Cities). It lies southeast of the junction of Interstate 494 and Minnesota State Highway 77, north of the Minnesota River, and across the Interstate from the Minneapolis\u2013St. Paul International Airport. The mall is the largest mall in the United States in terms of total floor area, the fifth largest mall in North America in terms of leaseable space, and the twelfth largest in the world.", "prediction 3": "The largest mall in the United States is the Mall of America in Bloomington, Minnesota, near the Twin Cities. It is the largest mall in the United States in terms of total floor area, the fifth largest mall in North America in terms of leaseable space, and the 12th largest in the world.", "prediction 4": "The largest mall in the United States according to total floor area, leaseable square footage and leaseable floor area is in Bloomington, Minnesota, which is a suburb of the Twin Cities. It lies southeast of the junction of Interstate 494 and Minnesota State Highway 77, north of the Minnesota River, and across the Interstate from the Minneapolis\u2013St. Paul International Airport.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 17, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 331 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Mall of America, is a shopping mall located in Bloomington, Minnesota, (a suburb of the Twin Cities). The mall opened in 1992 and is the twelfth largest in the world." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "When will dragon ball super english dub be released?", "passages": [ [ "Dragon Ball Super", "The series ended on March\u00a025, 2018, with the conclusion of the \"Universe Survival Saga\".", "Fuji TV stated that no definite plans were made to either continue the series at a later date or discontinue it entirely.", "\"Dragon Ball Super\" received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017.", "This dub is produced by Los Angeles based Bang Zoom!", "Entertainment for the Asian market.", "A sneak preview of the English dub's first episode aired on December 17, 2016.", "Production on the Bang Zoom!", "dub ended after episode 27.", "On November 4, 2016, Funimation announced the company acquired the rights to \"Dragon Ball Super\" and would be producing an English dub, with many cast members of their previous English-language releases of \"Dragon Ball\" media reprising their respective roles.", "As well as officially announcing the dub, it was also announced they would be simulcasting the series on their streaming platform, \"FunimationNow\".", "On December 7, 2016, IGN reported that the Funimation English dub of \"Dragon Ball Super\" would air on Adult Swim Saturdays at 8 p.m. with an encore showing in their Toonami block later that night at 11:30\u00a0p.m. starting on January 7, 2017.", "This was later confirmed on Toonami's official Facebook page." ], [ "Junji Ito Collection", "Additionally, the series received an advance showing on December 23, 2017, which was attended by Ito and voice actor Y\u016bji Mitsuya.", "The series is being simulcast on Crunchyroll worldwide outside of Asia, and Funimation began streaming an English dub on January 20, 2018.", "The series run for 12 episodes and was released as three separate sets on DVD, on March 30, 2018, April 27, 2018, and May 25, 2018.", "The second and third sets each include an OVA episode." ] ], "gold": "Funimation's Dragon Ball Super English dub began airing in the United States on Adult Swim's Toonami programming block starting on January 7, 2017, and ended on October 5, 2019. Season 5 this Dragon Ball Super English dub premiered on August 25, 2018. Season 4 of the Dragon Ball Super English dub premiered on January 20, 2018, while season 3 of the Dragon Ball Super English dub premiered on August 5, 2017. ", "prediction 1": "Dragon Ball Super's English dub was released on January 21, 2017 by Toonami. The original Japanese dub was released on March 29, 2018, April 27, 2018, and May 25, 2018. The English dub was released on January 20, 2018 by Funimation.", "prediction 2": "Dragon Ball Super was released in Japan in the original release on December 29, 2016, and in the English dub on January 21, 2017. The series was also released as three separate sets on DVD, on March 30, 2018, April 27, 2018, and May 25, 2018.", "prediction 3": "Dragon Ball Super received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017. This dub is produced by Los Angeles based Bang Zoom! Entertainment for the Asian market. Funimation began streaming an English dub on January 20, 2018.", "prediction 4": "Dragon Ball Super received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017. This dub is produced by Los Angeles based Bang Zoom! Entertainment for the Asian market. The series ran for 12 episodes and was released as three separate sets on DVD, on March 30, 2018, April 27, 2018, and May 25, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 77, "end": 168 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 169, "end": 232 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Dragon Ball Super\" received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who appointed the comptroller and auditor general of india?", "passages": [ [ "Comptroller and Auditor General of India", "The Comptroller and Auditor-General of India is appointed by the President of India following a recommendation by the Prime Minister.", "On appointment, he/she has to make an oath or affirmation before the President of India.", "\"I,(name of the person being appointed), having appointed Comptroller and Auditor-General of India do swear in the name of God/solemnly affirm that I will bear true faith and allegiance to the Constitution of India as by law established, that I will uphold the sovereignty and integrity of India, that I will duly and faithfully and to the best of my ability, knowledge and judgement perform the duties of my office without fear or favour, affection or ill-will and that I will uphold the Constitution and the laws.", "As per the provisions of the constitution, the CAG\u2019s (DPC) (Duties, Powers and Conditions of Service) Act, 1971 was enacted.", "As per the various provisions, the duties of the CAG include the audit of:\n\nRecently the CAG under Vinod Rai has constantly been in the limelight for its reports exposing mega corruption, particularly in 2G spectrum case, Commonwealth Games scam and other scams." ], [ "Comptroller and Auditor General of India", "Comptroller and Auditor General of India\n\nThe Comptroller and Auditor General (CAG) of India is an authority, established by Article 148 of the Constitution of India, which audits all receipts and expenditure of the Government of India and the state governments, including those of bodies and authorities substantially financed by the government.", "The CAG is also the external auditor of Government-owned corporations and conducts supplementary audit of government companies, i.e., any non-banking/ non-insurance company in which Union Government has an equity share of at least 51 per cent or subsidiary companies of existing government companies.", "The reports of the CAG are taken into consideration by the Public Accounts Committees (PACs) and Committees on Public Undertakings (COPUs), which are special committees in the Parliament of India and the state legislatures.", "The CAG is also the head of the Indian Audit and Accounts Department, the affairs of which are managed by officers of Indian Audit and Accounts Service, and has over 58,000 employees across the country.", "The CAG is mentioned in the Constitution of India under Article 148 \u2013 151.", "The CAG is ranked 9th and enjoys the same status as a judge of Supreme Court of India in Indian order of precedence.", "The current CAG of India is Rajiv Mehrishi, who assumed office on 25 September 2017.", "He is the 13th CAG of India." ], [ "Ram Nath Kovind", "After nomination for the post of 14th President of India, he resigned from his post as Governor of Bihar, and President of India Pranab Mukherjee accepted his resignation on 20 June 2017.", "He won election on 20 July 2017.", "Ram Nath Kovind received 65.65% of the valid votes, against former Speaker of the Lok Sabha - Meira Kumar, the presidential candidate of the Opposition who received 34.35% of the total votes.", "Kovind received 2,930 votes (From MPs and MLAs) amounting to Electoral College votes of 702,044 (65.65%) as compared to 1,844 votes with a value of 367,314 (34.35%) votes for Meira Kumar lagging far behind with 367,314 votes, and 77 votes were invalid.", "He became only the second Dalit representative to become President after K. R. Narayanan, and also is the first BJP candidate to be elected to the post.", "The tally of votes (367,314) polled by Meira Kumar is only the second highest for a losing candidate, that of Neelam Sanjiva Reddy in the 1969 Presidential elections being the highest ever; he received 405,427 votes as against 420,077 by V V Giri, the winner." ] ], "gold": "The Comptroller and Auditor General (CAG) of India is the Constitutional Authority in India, established under Article 148 of the Constitution of India. The Comptroller and Auditor-General of India is appointed by the President of India following a recommendation by the Prime Minister. On appointment, he/she has to make an oath or affirmation before the President of India. The current Comptroller and Auditor General of India was appointed by Ram Nath Kovind.", "prediction 1": "The Comptroller and Auditor General of India is an authority, established by Article 148 of the Constitution of India, which audits all receipts and expenditure of the Government of India and the state governments, including those of bodies and authorities substantially financed by the government. President Pranab Mukherjee appointed the first CAG of India in 2014. The second CAG was Vinod Rai, who was appointed in 2013. The third CAG was Rajiv Mehrishi, who assumed office on 25 September 2017.", "prediction 2": "The Comptroller and Auditor General of India is an authority established by Article 148 of the Constitution of India, which audits all receipts and expenditure of the Government of India and the state governments, including those of bodies and authorities substantially financed by the government. It is also the external auditor of Government-owned corporations and conducts supplementary audit of government companies, i.e., any non-banking/non-insurance company in which Union Government has an equity share of at least 51 per cent or subsidiary companies of existing government companies. The current CAG of India is Rajiv Mehrishi, who assumed office on 25 September 2017.", "prediction 3": "The President of India appointed the Comptroller and Auditor General of India in 2015. The current Comptroller and Auditor General of India is Rajiv Mehrishi, who assumed office on 25 September 2017.", "prediction 4": "The Comptroller and Auditor General of India is an authority, established by Article 148 of the Constitution of India, which audits all receipts and expenditure of the Government of India and the state governments, including those of bodies and authorities substantially financed by the government. The current Comptroller and Auditor General of India is Rajiv Mehrishi, who assumed office on 25 September 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 499 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Comptroller and Auditor General of India is an authority, established by Article 148 of the Constitution of India. The Comptroller and Auditor-General of India is appointed by the President of India following a recommendation by the Prime Minister. On appointment, he/she has to make an oath or affirmation before the President of India." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who lives the longest in the united states?", "passages": [ [ "Race and health in the United States", "Whether it be at a hospital, a walk-in clinic, or a family doctor's office, people are hit with bias based comments concerning \"general bias, ethnicity / national origin, race, age, gender, accent, religion, political views, weight, medical education from outside the US, sexual orientation, and more\".", "This study conducted by WebMD and Medscape features the races of \"African American/Black, Asian, Caucasian, and Hispanic\" Training for doctors to handle this type of prejudice at their work is very low.", "Homicide plays a significant role in the racial gap in life expectancy.", "In 2008, homicide accounted for 19% of the gap among black men, though it did not play a significant role in the decline in the gap from 2003 to 2008.", "A report from the U.S. Department of Justice states \"In 2005, homicide victimization rates for blacks were 6 times higher than the rates for whites\" and \"94% of black victims were killed by blacks.\"", "Research by Robert J. Sampson indicates that the high degree of residential segregation in African American neighborhoods is responsible for the high homicide rate among African Americans.", "Based on data for 1945 to 1999, forecasts for relative black:white age-adjusted, all-cause mortality and white:black life expectancy at birth showed trends toward increasing disparities." ], [ "Summit County, Colorado", "About 3.10% of families and 9.00% of the population were below the poverty line, including 4.30% of those under age 18 and 3.40% of those age 65 or over.", "The 2012 average real estate prices in Summit County were $708,660 for a single family home, $359,536 for a condo, townhome or duplex and $281,388 for a vacant piece of land (YTD through August 2012).", "According to a report in the Journal of the American Medical Association, residents of Summit County had a 2014 life expectancy from birth of 86.83 years in 2014, the longest in the United States.", "Both men and women live longer in Summit County than in any other county in the United States: 85.5 years for men and 88.0 years for women is the life expectancy at birth.", "Two contiguous counties, Pitkin and Eagle counties, rank numbers two and three in the nation in life expectancy.", "Factors contributing to the high life expectancy in Summit County are \"high education, high income, high access to medical care, the people are physically active, obesity is lower than anywhere else \u2014 so you\u2019re doing it right.\u201d said Dr. Ali Mokdad, one of the study\u2019s co-authors." ] ], "gold": "Among all the counties in the US, there is a wide range in average life expectancy from birth. The residents of Summit County, Colorado, live the longest with an average life expectancy of 86.83 years. According to data taken from the Institute for Health Metrics and Evaluation for the states in 2017, and from the CIA World Factbook for the territories 2018 data, and data in the 2010 from Measure of America's third national human development report, \"The Measure of America 2013\u20132014\", the overall, life expectancy at birth in Hawaii, Puerto Rico and California are among the longest in the nation, while life expectancy at birth in Mississippi and American Samoa are among the shortest in the nation.", "prediction 1": "According to a report in the Journal of the American Medical Association, residents of Summit County had a 2014 life expectancy from birth of 86.83 years in 2014, the longest in the United States. Both men and women live longer in Summit County than in any other county in the United States. In the 2013 report, the longest life expectancy from birth was 85.8 years, and in 2014 the longest life expectancy was 85.5 years.", "prediction 2": "In 2014, the life expectancy from birth for men in the United States was 85.5 years, and it was 88.0 years for women. In Summit County, Colorado, the life expectancy from birth for both men and women was 86.83 years in 2014, making it the county with the longest life expectancy in the United States.", "prediction 3": "The person who lives the longest in the United States is a married man. According to a report in the Journal of the American Medical Association, residents of Summit County, Colorado, have a life expectancy from birth of 86.83 years in 2014, the longest in the United States. Both men and women live longer in Summit County than in any other county in the United States.", "prediction 4": "There are different places in the United States where people live the longest, including Summit County, Colorado, which has the longest life expectancy from birth of 86.83 years in 2014. Both men and women live longer in Summit County than in any other county in the United States. The average life expectancy of both men and women in Summit County is 85.5 years, while the average life expectancy of both women and men is 88.0 years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 291 }, { "error type": "Unverifiable", "explanation": "", "start": 292, "end": 311 }, { "error type": "Unverifiable", "explanation": "", "start": 383, "end": 422 } ], "missing-info": [], "corrected-prediction": "According to a report in the Journal of the American Medical Association, residents of Summit County had a 2014 life expectancy from birth of 86.83 years in 2014, the longest in the United States. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "When is justice league going to be released?", "passages": [ [ "Justice League", "The movie, featuring an original plot, was written by\u00a0Alan Burnett\u00a0and directed by\u00a0Sam Liu\u00a0and executive produced by\u00a0Bruce Timm\u00a0and\u00a0Sam Register.", "Along with the film, a three-part animated series entitled\u00a0\"\"\u00a0was released before the film on\u00a0Machinima\u00a0with Timm as an executive producer in 2015.", "\"Justice League:", "The Flashpoint Paradox\"\u00a0received very positive reviews.", "The\u00a0review aggregator\u00a0website\u00a0Rotten Tomatoes\u00a0reported a 100% approval rating.", "Critics and audiences said that the film stays true to its\u00a0source material.", "It is generally praised for its mature storyline and the way Flash obtains justice, but criticized for its excessive violence and use of blood that exceeds the comics it is adapted from.", "\"Justice League\" is a 2017 American\u00a0superhero film\u00a0based on the\u00a0DC Comics\u00a0superhero\u00a0team\u00a0of the same name, distributed by\u00a0Warner Bros. Pictures.", "It is the fifth installment in the\u00a0DC Extended Universe.", "The film was directed by\u00a0Zack Snyder, with a screenplay by\u00a0Chris Terrio and Joss Whedon, from a story by Snyder and Terrio.", "In July 2015, it was revealed that filming would begin in spring 2016 after\u00a0\"Wonder Woman\"\u00a0ended\u00a0principal photography.", "Principal photography commenced on April 11, 2016, with shooting taking place at\u00a0Warner Bros. Studios, Leavesden, as well as various locations around\u00a0London,\u00a0Scotland,\u00a0Los Angeles\u00a0and in Dj\u00fapav\u00edk in the Westfjords\u00a0\u00a0of\u00a0Iceland." ], [ "Justice League", "Justice League\n\nThe Justice League is a team of fictional superheroes appearing in American comic books published by DC Comics.", "The Justice League was conceived by writer Gardner Fox, and they first appeared together, as Justice League of America (JLA) in \"The Brave and the Bold\" #28 (March 1960).", "The Justice League is an assemblage of superheroes who join together as a team.", "The seven original members were Aquaman, Batman, The Flash, Green Lantern, Martian Manhunter, Superman and Wonder Woman.", "The team roster has rotated throughout the years, consisting of various superheroes from the DC Universe, such as The Atom, Big Barda, Black Canary, Cyborg, Green Arrow, Elongated Man, The Flash, Green Lantern, Hawkgirl, Hawkman, Metamorpho, Plastic Man, Power Girl, Orion, Red Tornado, Stargirl, Captain Marvel/Shazam and Zatanna, among many others.", "The team received its own comic book title called \"Justice League of America\" in November 1960.", "With the 2011 relaunch, DC Comics released a second volume of \"Justice League\".", "In July 2016, the DC Rebirth initiative again relaunched the Justice League comic book titles with the third volume of \"Justice League\".", "Since its inception, the team has been featured in various films, television programs and video games." ], [ "Justice League (film)", "WaterTower Music released the soundtrack album digitally on November 10, 2017, with a release of the physical format on December 8.", "The film held its world premiere in Beijing on October 26, 2017, and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017.", "Its Japan premiere took place on November 20, 2017 in Tokyo, with only Ezra Miller and Ray Fisher from the main cast attending.", "In the United States, the film opened to 4,051 theaters in its widest release.", "\"Justice League\" was shown in cinemas for 119 days (17 weeks).", "Superman was intentionally left out on all early \"Justice League\" marketing materials, including trailers, clips and posters, which actor Cavill commented as \"ridiculous\".", "Despite his character being hidden from promotional materials, Cavill still joined the rest of the cast on the film's press tour.", "Clark Kent was revealed in a final trailer before the release of the film, but edited in a way that writers felt Lois Lane was dreaming about Clark.", "Sponsorship and marketing partners of the film included AT&T, Gillette, Mercedes-Benz, and TCL." ] ], "gold": "The Justice League is a team of fictional superheroes appearing in American comic books published by DC Comics. The 2001 TV series Justice League was released on November 17, 2001. The 2017 film premiered in Beijing on October 26, 2017, and was released in the United States in 2D, 3D, and IMAX on November 17, 2017. The film premiered in Japan on November 20, 2017.", "prediction 1": "The Justice League is a fictional superhero team from American comic books published by DC Comics. The team is made up of several superheroes, who join together to fight crime and achieve victory as a team. The film Justice League is out on November 17, 2017, with the theatrical release in North America to be on November 17, 2017. The film's Japan premiere took place on November 20, 2017.", "prediction 2": "Justice League is a fictional superhero team that first appeared in the American comic book series Justice League of America (JLA), published by DC Comics. The film Justice League was premiering in Beijing on October 26, 2017, and was released theatrically in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017. The film's Japan premiere took place on November 20, 2017 in Tokyo, with only Ezra Miller and Ray Fisher from the main cast attending.", "prediction 3": "Justice League is a fictional superhero team that first appeared together in American comic books published by DC Comics in March 1960. The team has since changed names in various movies, television shows and video games. The 2017 superhero film Justice League released in North America on November 17, 2017. The 2017 film's Japan premiere took place on November 20, 2017.", "prediction 4": "The Justice League is a fictional superhero team appearing in American comic books published by DC Comics. The film Justice League was released in North America on November 17, 2017. It was released in Japan on November 20, 2017 with a Japanese release on November 21, 2021.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 206 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Justice League is a fictional superhero team from American comic books published by DC Comics. The film held its world premiere in Beijing on October 26, 2017 and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017. The film's Japan premiere took place on November 20, 2017." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "What day of the year is mothers day always celebrated?", "passages": [ [ "Children's Day", "In Honduras, Children's Day is celebrated on 10 September.", "Children's Week began in Hungary in 1931.", "Since 1950 it has been reduced to Children's Day, taking place on the last Sunday in May.", "In Haiti, Children's Day is celebrated on 12 June.", "Children's Day () is celebrated on 4 April.", "In Indonesia, Children's Day is celebrated on 23 July.", "It was established as a holiday in 1984.", "In India, Children's Day is celebrated on 14 November, on the birthday of the first Prime Minister of independent India, who was fondly called \"Chacha Nehru\" (Uncle Nehru) or \"Chachaji\" (Uncle), and who emphasized the importance of giving love and affection to children, to give him tribute.", "After the death of Jawaharlal Nehru in 27 May 1964, it was unanimously decided to celebrate his birthday as \"Bal Diwas\" or Children's Day in India.", "In Ireland, Universal Children's Day is celebrated on 20 November.", "Japan's is celebrated on 5 May, a National Holiday since 1948, to celebrate the happiness of all children and to express gratitude toward mothers.", "There is a long tradition, from the 8th century, to celebrate children's day twice a year; 3 March for girls and on 5 May for boys." ], [ "Mother's Day (United States)", "Mother's Day (United States)\n\nMother's Day in the United States is an annual holiday celebrated on the second Sunday in May.", "Mother's Day recognizes mothers, motherhood and maternal bonds in general, as well as the positive contributions that they make to society.", "It was established by Anna Jarvis, with the first official Mother's Day celebrated at St. Andrew's Methodist Church in Grafton, West Virginia, on May 10, 1908.", "In the United States, Mother's Day complements similar celebrations honoring family members, such as Father's Day, Siblings Day and Grandparents Day.", "Internationally, there are a large variety of Mother's Day celebrations with different origins and traditions, some now also having been influenced by this more recent American tradition.", "During the 19th century, women's peace groups in the United States tried to establish holidays and regular activities in favor of peace and against war.", "A common early activity was the meeting of groups of mothers whose sons had fought or died on opposite sides of the American Civil War.", "In 1868, Ann Jarvis, Anna Jarvis's mother, organised a committee to establish a \"Mother's Friendship Day\", the purpose of which was \"to reunite families that had been divided during the Civil War.\"" ], [ "Mothering Sunday", "Mothering Sunday\n\nMothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world.", "It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia.", "It falls on the fourth Sunday in Lent, exactly three weeks before Easter Day.", "Once observed as a day on which people would visit their \"mother\" church, it has become an occasion for honouring the mothers of children and giving them presents.", "It is increasingly being called Mother's Day, although that name properly belongs to the American holiday which is quite distinct from the original Mothering Sunday.", "In the UK and the Republic of Ireland, Mothering Sunday is celebrated in a similar way as Mother's Day is celebrated in the USA.", "During the 16th century, people returned to their mother church for a service to be held on Laetare Sunday; in this context, one's 'mother church' was either the church where one was baptised, or the local parish church, or the nearest cathedral (the latter being the mother church of all the parish churches in a diocese).", "Anyone who did this was commonly said to have gone \"a-mothering\", although whether this term preceded the observance of Mothering Sunday is unclear." ] ], "gold": "Mother's Day is a celebration honoring the mother of the family or individual, as well as motherhood, maternal bonds, and the influence of mothers in society. In the United States, Mother's Day is celebrated the second Sunday in May, and in Norway it's the second Sunday of February. Fourth Sunday in Lent is when Ireland and the UK celebrate. First Sunday of May is when Hungary and Spain celebrate the honoring of mothers. ", "prediction 1": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. In the UK, Mothering Sunday is celebrated the same way as Mother's Day in the USA.", "prediction 2": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday of May. Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world. It falls on the fourth Sunday in Lent, exactly three weeks before Easter Day. In the Netherlands, Mother's Day is celebrated on 14 November, on the birthday of the first Prime Minister of independent India. In Haiti, Children's Day is celebrated on 12 June. In Indonesia, Children's Day is celebrated on 4 April.", "prediction 3": "In the United States, Mother's Day is always celebrated on the second Sunday in May. In Haiti, Children's Day is celebrated on 12 June. In Indonesia, Children's Day is celebrated on 4 April.", "prediction 4": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. In the UK and Ireland, Mothering Sunday is celebrated in a similar way as Mother's Day is celebrated in the USA. In Haiti, Children's Day is celebrated on 12 June. In India, Children's Day is celebrated on 14 November, on the birthday of the first Prime Minister of independent India, who was fondly called \"Chacha Nehru\" or \"Chachaji\" (Uncle) and who emphasized the importance of giving love and affection to children, to pay tribute to him. In Ireland, Universal Children's Day is celebrated on 5 May, a National Holiday since 1948, to celebrate the happiness of all children and to express gratitude toward mothers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 177 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Mother's Day recognizes mothers, motherhood and maternal bonds in general, as well as the positive contributions that they make to society. Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. In the UK, mothering day falls on the fourth Sunday in Lent." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How fast was the spirit of st louis?", "passages": [ [ "Spirit of St. Louis (train)", "Spirit of St. Louis (train)\n\nThe Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York and St. Louis, Missouri.", "The Pennsylvania introduced the \"Spirit of St. Louis\" on June 15, 1927, replacing the \"New Yorker\" (eastbound) and \"St. Louisian\" (westbound); that September its schedule was 24 hr 50 min each way.", "The name honored the airplane \"Spirit of St. Louis\", flown the month before by Charles Lindbergh from New York to Paris.", "The \"Spirit of St. Louis\" remained in service through the inception of Amtrak, by that time extending to Kansas City, Missouri and also having a branch from Harrisburg, Pennsylvania to Washington, D.C., via York, Pennsylvania and Baltimore, Maryland.", "It finally disappeared from the timetable in July 1971.", "It was replaced by the \"National Limited\"." ] ], "gold": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York and St. Louis, Missouri. The maxim speed was 133 mph (214 km/h) and the cruise speed was 100\u2013110 mph (161\u2013177 km/h). The name honored the airplane Spirit of St. Louis, flown the month before by Charles Lindbergh from New York to Paris. ", "prediction 1": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York and St. Louis, Missouri. Its schedule was 24 hr 50 min each way.", "prediction 2": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York and St. Louis, Missouri. The train's schedule was 24 hr 50 min each way.", "prediction 3": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York City and St. Louis, Missouri. The schedule for the September 19, 1927 Spirit of St. Louis was 24 hr 50 min each way. The train remained in service through the inception of Amtrak, by that time extending to Kansas City, Missouri and also having a branch from Harrisburg, Pennsylvania to Washington, D.C. via York, Pennsylvania and Baltimore, Maryland, before disappear from the timetable in July 1971. The National Limited was introduced in September 1927 and was 24 hr 50 min each way.", "prediction 4": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its predecessors Penn Central and Amtrak between New York and St. Louis, Missouri. That September its schedule was 24 hr 50 min each way. The Spirit of St. Louis remained in service through the inception of Amtrak, by that time extending to Kansas City, Missouri and also having a branch from Harrisburg, Pennsylvania to Washington, D.C. via York, Pennsylvania and Baltimore, Maryland. It finally disappeared from the timetable in July 1971. It was replaced by the National Limited.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 205 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Spirit of St. Louis was a named passenger train on the Pennsylvania Railroad and its successors Penn Central and Amtrak between New York and St. Louis, Missouri. The name honored the airplane \"Spirit of St. Louis\", flown the month before by Charles Lindbergh from New York to Paris." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did the cubs first win the world series?", "passages": [ [ "Chicago Cubs", "Chicago Cubs\n\nThe Chicago Cubs are an American professional baseball team based in Chicago, Illinois.", "The Cubs compete in Major League Baseball (MLB) as a member club of the National League (NL) Central division.", "The team plays its home games at Wrigley Field, located on the city's North Side.", "The Cubs are one of two major league teams in Chicago; the other, the Chicago White Sox, is a member of the American League (AL) Central division.", "The Cubs, first known as the White Stockings, were a founding member of the NL in 1876, becoming the Chicago Cubs in 1903.", "The Cubs have appeared in a total of eleven World Series.", "The 1906 Cubs won 116 games, finishing 116\u201336 and posting a modern-era record winning percentage of , before losing the World Series to the Chicago White Sox (\"The Hitless Wonders\") by four games to two.", "The Cubs won back-to-back World Series championships in 1907 and 1908, becoming the first major league team to play in three consecutive World Series, and the first to win it twice.", "Most recently, the Cubs won the 2016 National League Championship Series and 2016 World Series, which ended a 71-year National League pennant drought and a 108-year World Series championship drought, both of which are record droughts in Major League Baseball." ], [ "1907 World Series", "1907 World Series\n\nThe 1907 World Series featured the Chicago Cubs and the Detroit Tigers, with the Cubs winning the Series four games to none (with one tie) for their first championship.", "The Cubs came back strong from their shocking loss in the 1906 World Series.", "The Tigers' young star Ty Cobb came into the Series with the first of his many league batting championships.", "With pitching dominance over the Tigers and Cobb, the Cubs allowed only three runs in the four games they won, while stealing 18 bases off the rattled Tigers.", "Tigers pitcher \"Wild Bill\" Donovan struck out twelve Cubs in Game\u00a01.", "Although that matched Ed Walsh's total in Game\u00a03 against the Cubs in , it was across twelve innings.", "Donovan struck out just ten Cubs in the first nine innings of the game.", "Tuesday, October 8, 1907, at West Side Grounds in Chicago, Illinois\n\nThe Tigers scored three runs, largely due to three Cub errors, in the eighth inning and held a 3\u20131 lead going into the bottom of the ninth.", "The Cubs loaded the bases on a single, walk and infield error with one out.", "Detroit conceded a run on a ground ball for the second out, and Cub player-manager Frank Chance then pinch-hit Del Howard for Joe Tinker." ], [ "1907 World Series", "Regular-season 23-game winner Overall was masterful after the rain delay, allowing only one hit in Detroit's final five innings, giving his Cubs a commanding 3\u20130 lead in the Series.", "Saturday, October 12, 1907, at Bennett Park in Detroit, Michigan\n\nChicago wrapped up the series with a 2\u20130 victory on \"Three-fingered\" Mordecai Brown's seven-hit shutout.", "The Cubs scored a run in the top of the first on a walk, stolen base and RBI single by Harry Steinfeldt and scored again in the second on an error, a single, a double-steal and a groundout to drive in the last run of the Series.", "Detroit had runners on second and third with one out in the last of the fourth, but left them there and never seriously threatened after that.", "This Series would be the closest to a four-game sweep until the first true Series sweep in , when George Stallings' \"miracle\" Boston Braves surged from last place in mid-July to win the NL pennant and upset Connie Mack's haughty Philadelphia Athletics in the Series.", "1907 World Series (4\u20130\u20131): Chicago Cubs (N.L.) over Detroit Tigers (A.L.)" ] ], "gold": "The Chicago Cubs are an American professional baseball team based in Chicago, they compete in Major League Baseball as part of the National League Central division. Throughout the club's history, the Cubs have played in a total of 11 World Series. The 1907 World Series featured the Chicago Cubs and the Detroit Tigers, with the Cubs winning the Series four games to none, with one tie, for their first championship. On Saturday, October 12, 1907, at Bennett Park in Detroit, Michigan, Chicago wrapped up the series with a 2\u20130 victory. ", "prediction 1": "The Chicago Cubs have appeared in a total of eleven World Series. The 1906 Cubs won 116 games, finishing 116\u201336 and posting a modern-era record winning percentage of, before losing the World Series to the Chicago White Sox by four games to two. In 1907, the Cubs won the Series four games to none, with one tie for their first championship. Saturday, October 12, 1907, at Bennett Park in Detroit, Michigan, Chicago wrapped up the series with a 2\u20130 victory on Three-fing Mordecai Brown's seven-hit shutout.", "prediction 2": "The Chicago Cubs first won the World Series in 1907, where they defeated the Detroit Tigers in four games. Then, the next year, in 1908, the Cubs won the World Series twice, in 1908 and 1909.", "prediction 3": "The Chicago Cubs have appeared in a total of eleven World Series. The 1906 Cubs won 116 games, finishing 116\u201336 and posting a modern-era record winning percentage of. The 1907 World Series featured the Chicago Cubs and the Detroit Tigers, with the Cubs winning the Series four games to none (with one tie) for their first championship. The 1908 World Series featured the Chicago White Sox and the Philadelphia Athletics.", "prediction 4": "The Chicago Cubs compete in Major League Baseball as a member club of the National League Central division. In 1907, the Cubs defeated the Detroit Tigers 4\u20130 in the World Series. In 1908, the Cubs defeated the New York Yankees 4\u20130 in the World Series. In 2016, the Cubs defeated the San Francisco Giants 4\u20130 in the World Series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 456, "end": 505 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Chicago Cubs are an American professional baseball team based in Chicago, they compete in Major League Baseball as part of the National League Central division. The Chicago Cubs have appeared in a total of eleven World Series. In 1907, the Cubs won the Series four games to none, with one tie for their first championship. Saturday, October 12, 1907, at Bennett Park in Detroit, Michigan, Chicago wrapped up the series with a 2\u20130 victory." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When was the new york safe act passed?", "passages": [ [ "NY SAFE Act", "NY SAFE Act\n\nThe New York Secure Ammunition and Firearms Enforcement Act of 2013 commonly known as the NY SAFE Act is a gun regulation law in the state of New York.", "The law was passed by the New York State Legislature and was signed into law by Governor of New York Andrew Cuomo in January 2013.", "The legislation was written in response to the Sandy Hook Elementary School shooting in Newtown, Connecticut and the December 24th", "Webster, New York Shooting.", "Cuomo described the law as the toughest gun control law in the United States.", "The NY SAFE Act contains a number of firearms regulations.", "It also contains a severability provision that allows other measures to remain in place in case the broad prohibitions against weapons are invalidated by the courts.", "The New York State Senate approved the act on a 43\u201318 vote on January 14, 2013.", "The vote was bipartisan, with nine Senate Republicans voting in favor.", "State Senator Jeffrey D. Klein sponsored the legislation.", "The following day (the second full day of the 2013 legislative session), the New York State Assembly approved the legislation by a 104\u201343 vote, and Governor Andrew Cuomo signed the bill into law less than one hour later.", "The passage of the law made New York the first to pass restrictions on gun laws since the Sandy Hook massacre.", "Cuomo described the law as the toughest gun control law in the United States." ], [ "Gun laws in New York", "In the wake of the Sandy Hook Elementary School shooting and the 2012 Webster, New York shooting, New York became the first U.S. state to enact stricter gun control laws when it passed the NY SAFE Act on January 15, 2013.", "New measures included the redefining of what is considered an assault weapon, assault weapon registration, prohibition of sales of assault weapons, the prevention of selling or passing on registered assault weapons to friends or family, reducing the maximum allowed magazine capacity from ten rounds to seven rounds, (however part of the SAFE act was redacted in court to allow loading 10 rounds into your magazine) background checks on almost all gun sales including private sales, background checks on all ammunition sales (has yet to go into effect), additional requirements for reporting of persons with mental health issues, and increased penalties for certain gun crimes.", "The SAFE Act also includes provisions allowing law enforcement to pre-emptively seize a person's firearms without a warrant or court order if they have probable cause that the person in question may be mentally unstable or intends to use the weapons to commit a crime." ] ], "gold": "The New York State Senate approved the New York Safe act on a 43\u201318 vote on January 14, 2013. The following day, January 15, 2013, the New York State Assembly approved the legislation by a 104\u201343 vote, and Governor Andrew Cuomo signed the bill into law less than one hour later.", "prediction 1": "The New York Secure Ammunition and Firearms Enforcement Act of 2013 commonly known as the NY SAFE Act is a gun regulation law in the state of New York. The law was passed by the New York State Legislature and was signed into law by Governor of New York Andrew Cuomo in January 2013. The law was written in response to the Sandy Hook Elementary School shooting in Newtown, Connecticut and the December 24th Webster, New York Shooting.", "prediction 2": "The New York Secure Ammunition and Firearms Enforcement Act of 2013 commonly known as the NY SAFE Act is a gun regulation law in the state of New York. The law was passed by the New York State Legislature and was signed into law by Governor of New York Andrew Cuomo in January 2013. The new law was passed in response to the Sandy Hook Elementary School shooting in Newtown, Connecticut and the December 24th Webster, New York Shooting.", "prediction 3": "The New York Secure Ammunition and Firearms Enforcement Act of 2013 is a gun regulation law in the state of New York. It was passed by the New York State Legislature and signed into law by Governor of New York Andrew Cuomo on January 15, 2013. The law was written in response to the Sandy Hook Elementary School shooting in Newtown, Connecticut and the December 24th Webster, New York Shooting.", "prediction 4": "The New York Secure Ammunition and Firearms Enforcement Act of 2013 commonly known as the NY SAFE Act is a gun regulation law in the state of New York. The law was passed by the New York State Legislature and was signed into law by Governor of New York Andrew Cuomo in January 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 433 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The New York State Senate approved the New York Safe act on a 43\u201318 vote on January 14, 2013. The following day, January 15, 2013, the New York State Assembly approved the legislation by a 104\u201343 vote, and Governor Andrew Cuomo signed the bill into law less than one hour later." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who does wonder woman end up with in the comics?", "passages": [ [ "Steve Trevor", "Steve Trevor\n\nGeneral Steven Rockwell Trevor is a fictional character appearing in American comic books published by DC Comics, commonly in association with the superheroine Wonder Woman.", "The character was created by William Moulton Marston and first appeared in \"All Star Comics\" #8 (Dec. 1941).", "Steve Trevor is a trusted friend, love interest, and partner who introduces Diana (Wonder Woman) to \"Man's World\", and has served as Wonder Woman's United Nations liaison.", "The character has appeared in various adaptations of the comics.", "He has been voiced by actors such as Tahmoh Penikett, Nathan Fillion, and George Newbern, among others in various \"Wonder Woman\" and \"Justice League\" productions.", "Lyle Waggoner portrayed the character in the 1970s \"Wonder Woman\" series, as did Chris Pine in the 2017 DC Extended Universe film \"Wonder Woman\".", "Chris Pine will also portray a character presumed to be Steve Trevor in \"Wonder Woman 1984.", "Steve Trevor first appeared in \"All Star Comics\" #8 (December 1941).", "Steve Trevor was originally introduced as an intelligence operative and officer in the United States Army Air Corps who became stranded on Wonder Woman's homeland where he was a herald to the Amazons that World War 2 was occurring in \"Man's World\".", "He also developed a close relationship with the heroine." ], [ "Wonder Woman", "She would also face Donna Troy, who is now reimagined as a villanous doppellganger created by a vengeful Amazon elder, not only to physically defeat Wonder Woman but also to outmaneuver her in Themyscirian politics.", "The New 52 version of Earth 2 was introduced in \"Earth 2\" #1 (2012).", "In that issue, the Earth 2 Wonder Woman is introduced via flashback.", "She, along with Superman and Batman, are depicted dying in battle with forces from Apokolips five years in the past.", "This Wonder Woman worshiped the deities of Roman mythology as opposed to the Greek; the Roman gods perish as a result of the conflict.", "An earlier version of the Earth-2 Wonder Woman, prior to the Apokoliptian invasion, is seen in the comic book \"Batman/Superman\", where she is seen riding a pegasus.", "In \"Earth 2\" #8 (2013), Wonder Woman's adult daughter, Fury, is introduced.", "She is loyal to the Apokoliptian Steppenwolf.", "In 2016, DC Comics started DC Rebirth, a relaunch of its entire line of comic books.", "Following the events of the Darkseid War, Wonder Woman is told by the dying Myrina Black that on the night of Diana's birth, Hippolyta gave birth to a twin child." ], [ "Wonder Woman", "Wonder Woman\n\nWonder Woman is a fictional superhero appearing in American comic books published by DC Comics.", "The character is a founding member of the Justice League, and an ambassador of the Amazon people.", "The character first appeared in \"All Star Comics\" #8 in October 1941 with her first feature in \"Sensation Comics\" #1, January 1942.", "The \"Wonder Woman\" title has been published by DC Comics almost continuously except for a brief hiatus in 1986.", "In her homeland, the island nation of Themyscira, her official title is Princess Diana of Themyscira, Daughter of Hippolyta.", "When blending into the society outside of her homeland, she adopts her civilian identity Diana Prince.", "Wonder Woman was created by the American psychologist and writer William Moulton Marston (pen name: Charles Moulton), and artist Harry G. Peter.", "Marston's wife, Elizabeth, and their life partner, Olive Byrne, are credited as being his inspiration for the character's appearance.", "Marston's comics featured his ideas on DISC theory, and the character drew a great deal of inspiration from early feminists, and especially from birth control pioneer Margaret Sanger; in particular, her piece \"Woman and the New Race\"." ] ], "gold": "Wonder Woman is a superhero appearing in American comic books published by DC Comics. The character is a founding member of the Justice League. The character first appeared in All Star Comics #8 published October 21, 1941 with her first feature in Sensation Comics #1 in January 1942. Steve Trevor is a trusted friend, love interest, and partner who introduces Wonder Woman to Man's World, and has served as Wonder Woman's United Nations liaison. In 2011's The New 52, DC Comics relaunched its entire line of publications to attract a new generation of readers, and thus released volume 4 of the Wonder Woman comic book title. The New 52 version of Earth 2 was introduced in \"Earth 2\" #1 (2012). In that issue, the Earth 2 Wonder Woman is introduced via flashback. She, along with Superman and Batman, are depicted dying in battle with forces from Apokolips five years in the past.", "prediction 1": "Wonder Woman is a fictional superhero appearing in American comic books published by DC Comics. She is a founding member of the Justice League, and an ambassador of the Amazon people. In the comics, Wonder Woman is seen with Steve Trevor, an intelligence operative and officer in the United States Army Air Corps who became stranded on Wonder Woman's homeland where he was a herald to the Amazons that World War 2 was occurring in Man's World. In the films, Wonder Woman meets Donna Troy. In the television series \"Wonder Woman\" and the film \"Wonder Woman\" series, Wonder Woman ends up with Victory. In the TV series, Wonder Woman meets the character Diana Prince.", "prediction 2": "Wonder Woman is a fictional superhero appearing in American comic books published by DC Comics. The character was created by the American psychologist and writer William Moulton Marston and first appeared in All Star Comics #8 in October 1941 with her first feature in Sensation Comics #1, January 1942. Wonder Woman then meets General Steven Rockwell Trevor, a partner, lover, and trusted friend of Diana, Wonder Woman's father, who has served as Wonder Woman's United Nations liaison.", "prediction 3": "Steve Trevor is a fictional character appearing in American comic books published by DC Comics, commonly in association with the superheroine Wonder Woman. In the 1940s, Wonder Woman is introduced to Steve Trevor, a trusted friend, love interest, and partner who introduces Diana (Wonder Woman) to \"Man's World\", and has served as Wonder Woman's United Nations liaison. In the 1990s, Wonder Woman meets Donna Troy, a villanous doppleganger created by a vengeful Amazon elder, to defeating Wonder Woman. The New 52 version of Earth 2 Wonder Woman meets up against the Apokoliptian Steppenwolf. In the 2013 Earth 2 version of Wonder Woman meets her adult daughter, Fury, who is loyal to the Apokoliptians.", "prediction 4": "Wonder Woman is a fictional superhero appearing in American comic books published by DC Comics, commonly in association with the superheroine. The character is a founding member of the Justice League, and an ambassador of the Amazon people. In the comics, Wonder Woman meets General Steven Rockwell Trevor, a trusted friend, love interest, and partner who introduces Diana (Wonder Woman) to \"Man's World\", and has served as Wonder Woman's United Nations liaison. Chris Pine also portrays a character presumed to be Steve Trevor in the 2017 DC Extended Universe film Wonder Woman: The Darkwing of Wonder Woman: The New 52 series, and Chris Pine in the 2017 Wonder Woman: The Dark Knight, and the 2017 Superman film Wonder Woman Animated Series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 600, "end": 664 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 443 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 488 }, { "error type": "Unverifiable", "explanation": "", "start": 489, "end": 599 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Wonder Woman is a fictional superhero appearing in American comic books published by DC Comics. She is a founding member of the Justice League. The character first appeared in \"All Star Comics\" #8 in October 1941 with her first feature in \"Sensation Comics\" #1, January 1942. Steve Trevor is a trusted friend, love interest, and partner who introduces Diana (Wonder Woman) to \"Man's World\", and has served as Wonder Woman's United Nations liaison. The New 52 version of Earth 2 was introduced in \"Earth 2\" #1 (2012). In that issue, the Earth 2 Wonder Woman is introduced via flashback. She, along with Superman and Batman, are depicted dying in battle with forces from Apokolips five years in the past. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where did the us get uranium for the atomic bomb?", "passages": [ [ "Little Boy", "Little Boy was named by others as an allusion to Thin Man, since it was based on its design.", "Because uranium-235 was known to be fissionable, it was the first material pursued in the approach to bomb development.", "As the first design developed (as well as the first deployed for combat), it is sometimes known as the Mark I.", "The vast majority of the work came in the form of the isotope enrichment of the uranium necessary for the weapon, since uranium-235 makes up only 1 part in 140 of natural uranium.", "Enrichment was performed at Oak Ridge, Tennessee, where the electromagnetic separation plant, known as Y-12, became fully operational in March 1944.", "The first shipments of highly enriched uranium were sent to the Los Alamos Laboratory in June 1944.", "Most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine and was made available thanks to the foresight of the CEO of the High Katanga Mining Union, Edgar Sengier, who had of uranium ore transported to a New York warehouse in 1940.", "At least part of the of uranium ore and uranium oxide captured by the Alsos Mission in 1944 and 1945 went to Oak Ridge for enrichment, as did of uranium oxide captured on the Japan-bound after Germany's surrender in May 1945.", "Little Boy was a simplification of Thin Man, the previous gun-type fission weapon design." ], [ "Alsos Mission", "Some 612 B-17 Flying Fortresses of the U.S. Eighth Air Force dropped 1,500 tons of high explosive and 178 tons of incendiary bombs on the plant.", "On 30 March, the Alsos Mission reached Heidelberg, where important scientists were captured including Walther Bothe, Richard Kuhn, Philipp Lenard, and Wolfgang Gertner.", "Their interrogation revealed that Otto Hahn was at his laboratory in Tailfingen, while Werner Heisenberg and Max von Laue were at Heisenberg's laboratory in Hechingen, and the experimental natural uranium reactor that Heisenberg's team had built in Berlin had been moved to Haigerloch.", "Henceforth, the main focus of the Alsos Mission was on these nuclear facilities in the W\u00fcrttemberg area.", "As the Allied armies advanced into Germany in April 1945, Alsos Mission teams searched Stadtilm, where they found documentation concerning the German nuclear program, components of a nuclear reactor, and eight tons of uranium oxide.", "Scientists captured at G\u00f6ttingen and Katlenburg-Lindau included Werner Osenberg, the chief of the planning board of the \"Reichsforschungsrat\", and Fritz Houtermans, who provided information about the Soviet atomic bomb project." ], [ "Debate over the atomic bombings of Hiroshima and Nagasaki", "The US knew that Japan had requested materials from their German allies, and of unprocessed uranium oxide was dispatched to Japan in April 1945 aboard the submarine \"U-234\", which however surrendered to US forces in the Atlantic following Germany's surrender.", "The uranium oxide was reportedly labeled as \"U-235\", which may have been a mislabeling of the submarine's name; its exact characteristics remain unknown.", "Some sources believe that it was not weapons-grade material and was intended for use as a catalyst in the production of synthetic methanol to be used for aviation fuel.", "If post-war analysis had found that Japanese nuclear weapons development was near completion, this discovery might have served in a revisionist sense to justify the atomic attack on Japan.", "However, it is known that the poorly coordinated Japanese project was considerably behind the US developments in 1945, and also behind the unsuccessful German nuclear energy project of WWII.", "A review in 1986 of the fringe hypothesis that Japan had \"already\" created a nuclear weapon, by Department of Energy employee Roger M. Anders, appeared in the journal \"Military Affairs\":\n\nThe second atomic bombing, on Nagasaki, came only three days after the bombing of Hiroshima, when the devastation at Hiroshima had yet to be fully comprehended by the Japanese." ] ], "gold": "Because uranium-235 was known to be fissionable, it was the first material pursued in the approach to bomb development. The vast majority of the work came in the form of the isotope enrichment of the uranium necessary for the weapon, since uranium-235 makes up only 1 part in 140 of natural uranium. Enrichment was performed at Oak Ridge, Tennessee. Most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine. Alsos Mission teams captured uranium from different locations and some uranium was from the German submarine U-234.", "prediction 1": "The US knew that Japan had requested materials from their German allies, and of unprocessed uranium oxide was dispatched to Japan in April 1945 aboard the submarine U-234, which surrendered to US forces in the Atlantic following Germany's surrender. Then, in June 1944, the first shipments of highly enriched uranium were sent to the Los Alamos Laboratory. Then, most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine and was made available thanks to the foresight of the CEO of the High Katanga Mining Union, Edgar Sengier, who had of uranium ore transported to a New York warehouse in 1940. However, the Shinkolobwe mine was the first to be fissionable, it was known to be fissionable and was known to be fissionable. The first", "prediction 2": "The US knew that Japan had requested materials from their German allies, and of unprocessed uranium oxide was dispatched to Japan in April 1945 aboard the submarine U-234, which however surrendered to US forces in the Atlantic following Germany's surrender. The Ordnance Survey determined that most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine, while a small amount came from the Shinkolobwe mine in Japan. Most of the uranium necessary for the bomb came from the Shinkolobwe mine in Japan.", "prediction 3": "The US got most of the uranium for the atomic bomb from the Shinkolobwe mine, in Japan. The uranium made available to the US was enriched in Oak Ridge, Tennessee. This enrichment occurred before the atomic bomb was produced in Los Alamos, New Mexico. Some of the uranium made available to the US came from Shinkolobwe, in Japan.", "prediction 4": "The US knew that Japan had requested materials from their German allies, and of unprocessed uranium oxide was dispatched to Japan in April 1945 aboard the submarine U-234, which surrendered to US forces in the Atlantic following Germany's surrender. Most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine and was made available thanks to the foresight of the CEO of the High Katanga Mining Union, Edgar Sengier, who had of uranium ore transported to a New York warehouse in 1940. Enrichment was performed at Oak Ridge, where the electromagnetic separation plant became fully operational in March 1944.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 455, "end": 629 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 643, "end": 692 }, { "error type": "Redundant", "explanation": "However, the Shinkolobwe mine was the first to be fissionable, it was ", "start": 700, "end": 723 }, { "error type": "Redundant", "explanation": "However, the Shinkolobwe mine was the first to be fissionable, it was known to be fissionable and was ", "start": 732, "end": 756 }, { "error type": "Irrelevant", "explanation": "", "start": 757, "end": 766 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Most of the uranium necessary for the production of the bomb came from the Shinkolobwe mine. Because uranium-235 was known to be fissionable, it was the first material pursued in the approach to bomb development. Enrichment was performed at Oak Ridge, Tennessee. At least part of the of uranium ore and uranium oxide captured by the Alsos Mission in 1944 and 1945 went to Oak Ridge for enrichment, as did of uranium oxide captured on the Japan-bound after Germany's surrender in May 1945." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the current prime minister of iraq?", "passages": [ [ "Haider al-Abadi", "Haider al-Abadi\n\nHaider Jawad Kadhim al-Abadi; , born 25 April 1952) is an Iraqi politician who was Prime Minister of Iraq from September 2014 until October 2018.", "Previously he served as Minister of Communication from 2003 to 2004, in the first government after Saddam Hussein was deposed.", "He was designated as Prime Minister by President Fuad Masum on 11 August 2014 to succeed Nouri al-Maliki and was approved by the Iraqi parliament on 8 September 2014.", "Al-Abadi's father was a member of the Baghdad Neurosurgery Hospital and Inspector General of the Iraqi Ministry of Health.", "He was forced to retire in 1979 due to disagreements with the Ba'athist regime, and was buried abroad after his death.", "Al-Abadi, who speaks English, graduated high school in 1970 from the Central High School () in Bagdad.", "In 1975, he earned a Bachelor's degree in Electrical Engineering from the University of Technology in Baghdad.", "In 1980, he earned a PhD degree in Electrical engineering from the University of Manchester.", "Al-Abadi joined the Dawa Party in 1967.", "Two of his brothers were killed and one was put in prison 1980, 1981, and 1982 for belonging to the Dawa Party.", "In 1981, his third brother was arrested and spent 10 years in prison." ], [ "Nouri al-Maliki", "Nouri al-Maliki\n\nNouri Kamil Mohammed Hasan al-Maliki (; born 20 June 1950), also known as Jawad al-Maliki () or Abu Esraa (), is an Iraqi politician who was Prime Minister of Iraq from 2006 to 2014.", "He is secretary-general of the Islamic Dawa Party and a Vice President of Iraq.", "Al-Maliki began his political career as a Shia dissident under Saddam Hussein's regime in the late 1970s and rose to prominence after he fled a death sentence into exile for 24 years.", "During his time abroad, he became a senior leader of the Islamic Dawa Party, coordinated the activities of anti-Saddam guerrillas and built relationships with Iranian and Syrian officials whose help he sought in overthrowing Saddam.", "Al-Maliki worked closely with United States and coalition forces in Iraq following their departure by the end of 2011.", "Al-Maliki and his government succeeded the Iraqi Transitional Government.", "His first Cabinet was approved by the National Assembly and sworn in on 20 May 2006.", "His second Cabinet, in which he also held the positions of acting Interior Minister, acting Defense Minister, and acting National Security Minister, was approved on 21 December 2010.", "In the wake of a string of defeats during the Northern Iraq Offensive, United States officials said that al-Maliki should give up his premiership." ], [ "Nouri al-Maliki", "In the Iraqi parliamentary election, December 2005, the United Iraqi Alliance won the plurality of seats, and nominated Ibrahim al-Jaafari to be Iraq's first full-term post-war prime minister.", "In April 2006, amid mounting criticism of ineffective leadership and favoritism by Kurdish and Sunni Arab politicians in parliament, al-Jaafari was forced from power.", "On 22 April 2006, following close U.S.\u00a0involvement in the selection of a new prime minister, al-Maliki's name arose from the four that had been interviewed by the CIA on their connections to Iran (the others including Hussein al-Shahristani and Ali al-Adeeb).", "United States Ambassador to Iraq Zalmay Khalilzad said that \"[Maliki's] reputation is as someone who is independent of Iran.\"", "Khalilzad also maintained that Iran \"pressured everyone for Jaafari to stay\".", "However, al-Maliki was the preferred candidate of Qasem Soleimani, the commander of the Quds Force, and it was Soleimani who brokered the deal between senior Shiite and Kurdish leaders that led to his election as Prime Minister.", "On 20 May 2006, al-Maliki presented his Cabinet to Parliament, minus permanent ministers of Defense and of Interior." ] ], "gold": "There have been many Prime Ministers of Iraq. Ibrahim al-Jaafari was the first post-war Prime Minister of Iraq from 2005 to 2006. Nouri Kamil Mohammed Hasan al-Maliki, also known as Jawad al-Maliki, is an Iraqi politician who was Prime Minister of Iraq from 2006 to 2014. Haider al-Abadi is an Iraqi-British politician who was Prime Minister of Iraq from September 2014 until October 2018.", "prediction 1": "Nouri al-Maliki, also known as Jawad al-Maliki or Abu Esraa, was the prime minister of Iraq from 2006 to 2014. Haider al-Abadi was the prime minister from September 2014 to October 2018.\n", "prediction 2": "Haider al-Abadi was Iraq's prime minister from September 2014 to October 2018. Prior to that, he served as the Interior Minister from 2004 to 2006. Nouri al-Maliki served as Iraq's prime minister from 2006 to 2014.", "prediction 3": "Nouri al-Maliki, also known as Jawad al-Maliki or Abu Esraa, is an Iraqi politician who was Prime Minister of Iraq from 2006 to 2014. He succeeded the Iraqi Transitional Government. Haider al-Abadi was Prime Minister from September 2014 till October 2018.", "prediction 4": "Nouri al-Maliki was Prime Minister of Iraq from 2006 to 2014. However, most of the time, no one in government at all has been present since his election as prime minister on May 20, 2006. Haider al-Abadi served as Iraqi Prime Minister from September 2014 until October 2018.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "There has been a number of Prime Ministers of Iraq. Ibrahim al-Jaafari was nominated as the first full-term post-war prime minister in 2005 but forced from power in 2006. Nouri Kamil Mohammed al-Maliki, also known as Jawad al-Maliki or Abu Esraa, was the prime minister of Iraq from 2006 to 2014. Haider al-Abadi was the prime minister from September 2014 to October 2018.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Whats the legal age to smoke in usa?", "passages": [ [ "Tobacco in the United States", "Tobacco in the United States\n\nTobacco has a long history in the United States.", "Tobacco distribution is measured in the United States using the term, \"tobacco outlet density.\"", "An estimated 36.5 million people, or 15.1% of all adults (aged 18 years or older), in the United States smoked cigarettes in 2015.", "By state, in 2015, smoking prevalence ranged from between 9.1% and 12.8% in Utah to between 23.7% and 27.4% in West Virginia.", "By region, in 2015, smoking prevalence was highest in the Midwest (18.7%) and South (15.3%) and lowest in the West (12.4%).", "Men tend to smoke more than women.", "In 2015, 16.7% of men smoked compared to 13.6% of women.", "In 2009 46.6 million, or 20.6 percent of adults 18 and older were current smokers.", "Cigarette smoking is the leading cause of preventable death in the United States, accounting for approximately 443,000 deaths, or 1 of every 5 deaths, in the United States each year.", "Cigarette smoking alone has cost the United States $96 billion in direct medical expenses and $97 billion in lost productivity per year or an average of $4,260 per adult smoker." ], [ "Regulation of tobacco by the U.S. Food and Drug Administration", "Regulation of tobacco by the U.S. Food and Drug Administration\n\nRegulation of tobacco by the U.S. Food and Drug Administration began in 2009 with the passage of the Family Smoking Prevention and Tobacco Control Act by the United States Congress.", "With this statute, the Food and Drug Administration (FDA) was given the ability to regulate tobacco products.", "Prior to 1996, the FDA played no role in the regulation of tobacco products, and regulations were controlled through a combination of state and congressional regulation.", "Most state laws dealt with the sale of tobacco products, including the issue of selling to minors and licensing of distributors.", "By 1950, most states had laws prohibiting the sale of tobacco products to minors, which at the time, the purchase age differed in each state.", "In 1992 the federal government required states to set a minimum age of at least 18 years to purchase tobacco products, which was amended in all states by 1993.", "In 1964, Surgeon General Luther Terry issued a report on smoking and health saying that tobacco causes lung cancer and is a main contributor to bronchitis.", "Members of the Federal Trade Commission read the report the day it was released and quickly proposed a mandatory cigarette label that warned, \"CAUTION: cigarette smoking is dangerous to your health and may cause death from cancer and other diseases.\"" ], [ "Tobacco 21", "The major scientific publication in support of Tobacco 21 is the Institute of Medicine's report \"Public Health Implications of Raising the Minimum Age of Legal Access to Tobacco Products\", which concluded by saying:\" if the MLA were raised now to 21 nationwide, there would be approximately 223,000 fewer premature deaths, 50,000 fewer deaths from lung cancer, and 4.2 million fewer years of life lost for those born between 2000 and 2019.\"", "An editorial in the New England Journal of Medicine called Tobacco 21", "\"An idea whose time has come\".", "The following organizations have endorsed Tobacco 21 at the national level, either through their own statements or through endorsement of Senate Bill 2100, the federal act to raise the tobacco age to 21:\n\n\nHawaii\u2019s Tobacco 21 bill was signed by Governor David Ige and raised the legal age to purchase tobacco products, including electronic smoking devices, to 21, beginning on January 1, 2016.", "The legislation of this bill arose after the Institute of Medicine released a report explaining that raising the age to 21 would have significant public health benefits.", "The report estimated that making the minimum age 21 would result in avoiding nearly 250,000 premature deaths and 50,000 fewer deaths from lung cancer among individuals born between 2000-2019.", "Under the bill, anyone caught breaking the law faces a $10 fine for the first offense and a $50 fine or community service for a second offense." ] ], "gold": "Most states do not directly ban the consumption of tobacco by a minor, but in 2009, the Family Smoking Prevention and Tobacco Control Act was enacted under the Barack Obama administration, setting a federal minimum purchase age of 18. Since December 2019, the smoking age in all states and territories is 21 after federal law was passed in Congress and signed by President Donald Trump in December 2019. In the US, fifteen states have legalized cannabis for recreational use for individuals that are at least 21 years old.", "prediction 1": "The federal minimum age to purchase tobacco products in the US is 18 years old. Currently, the federal law states that the legal age to purchase tobacco products is 21 years old. The federal law requires states to set a minimum age of at least 18 years to purchase tobacco products.", "prediction 2": "In the United States, the legal age to purchase cigarettes is 18. In the United States, the legal age to purchase a pipe or a cigar is 21. The federal law that outlines the legal age to purchase tobacco products states that the purchase age of tobacco products for adults cannot be older than 21.", "prediction 3": "The legal age to purchase tobacco products in the United States is currently 21 years old. Since 1992, the federal government has required states to set a minimum age of at least 18 years to purchase tobacco products. The current law in the US is 21. Hawaii's Tobacco 21 bill was signed by Governor David Ige and raised the legal age to purchase tobacco products, including electronic smoking devices, to 21 starting January 1, 2016.", "prediction 4": "In the US, the legal age to purchase cigarettes is 18, and the legal age to purchase cigarettes is 21. In other countries, the legal age to purchase tobacco is 18.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 95, "end": 113 }, { "error type": "Redundant", "explanation": "The federal minimum age to purchase tobacco products in the US is 18 years old.", "start": 179, "end": 282 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The federal minimum age to purchase tobacco products in the US is 18 years old. In Hawaii, the legal age to purchase tobacco products is 21 years old. In 2009, the Family Smoking Prevention and Tobacco Control Act by the United States Congress was passed. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When did mt st helen's last erupt?", "passages": [ [ "2004\u201308 volcanic activity of Mount St. Helens", "At approximately the same time, the Pacific Northwest Seismograph Network recorded a magnitude 2.9 earthquake, followed by a small tremor that lasted nearly ninety minutes, and a magnitude 2.7 earthquake.", "But by the end of January, the lava dome growth had stopped.", "On July 10, 2008, it was determined that the eruption that began in 2004 had ended, after 6 months of inactivity." ], [ "Mount St. Helens", "The height of the dome was , still below the height reached in July 2005 when the whaleback collapsed.", "On October 22, 2006, at 3:13\u00a0p.m. PST, a magnitude 3.5 earthquake broke loose Spine 7.", "The collapse and avalanche of the lava dome sent an ash plume over the western rim of the crater; the ash plume then rapidly dissipated.", "On December 19, 2006, a large white plume of condensing steam was observed, leading some media people to assume there had been a small eruption.", "However, the Cascades Volcano Observatory of the USGS did not mention any significant ash plume.", "The volcano was in continuous eruption from October 2004, but this eruption consisted in large part of a gradual extrusion of lava forming a dome in the crater.", "On January 16, 2008, steam began seeping from a fracture on top of the lava dome.", "Associated seismic activity was the most noteworthy since 2004.", "Scientists suspended activities in the crater and the mountain flanks, but the risk of a major eruption was deemed low.", "By the end of January, the eruption paused; no more lava was being extruded from the lava dome.", "On July 10, 2008, it was determined that the eruption had ended, after more than six months of no volcanic activity.", "American Indian lore contains numerous legends to explain the eruptions of Mount St. Helens and other Cascade volcanoes." ], [ "Mount St. Helens", "Mount St. Helens\n\nMount St. Helens or Louwala-Clough (known as Lawetlat'la to the indigenous Cowlitz people, and Loowit to the Klickitat) is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States.", "It is northeast of Portland, Oregon and south of Seattle, Washington.", "Mount St.\u00a0Helens takes its English name from the British diplomat Lord St\u00a0Helens, a friend of explorer George Vancouver who made a survey of the area in the late 18th century.", "The volcano is located in the Cascade Range and is part of the Cascade Volcanic Arc, a segment of the Pacific Ring of Fire that includes over 160 active volcanoes.", "This volcano is well known for its ash explosions and pyroclastic flows.", "Mount St. Helens is most notorious for its major 1980 eruption, the deadliest and most economically destructive volcanic event in the history of the United States.", "Fifty-seven people were killed; 250 homes, 47 bridges, of railways, and of highway were destroyed.", "A massive debris avalanche triggered by an earthquake measuring 5.1 on the Richter scale caused an eruption that reduced the elevation of the mountain's summit from to , leaving a wide horseshoe-shaped crater.", "The debris avalanche was up to in volume." ] ], "gold": "Mount St. Helens is an active stratovolcano located in Skamania County, Washington, which had its last major eruption on May 18, 1980 with a magnitude of 5.1 that triggered a massive collapse of the north face of the mountain. The most recent eruption of Mt. St. Helens began on January 16, 2008, when steam began seeping from a fracture on top of the lava dome and associated seismic activity was the most noteworthy since 2004. Scientists suspended activities in the crater and the mountain flanks, but the risk of a major eruption was deemed low and by the end of January, the eruption paused; no more lava was being extruded from the lava dome. On July 10, 2008, it was determined that the eruption had ended, after more than six months of no volcanic activity.", "prediction 1": "Mount St. Helens is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States. It is most notorious for its 1980 eruption, the deadliest and most economically destructive volcanic event in the history of the United States. The last eruptive activity was on December 19, 2006. On July 10, 2008, it was determined that the eruption that began in 2004 had ended, after more than 6 months of no volcanic activity.", "prediction 2": "Mount St. Helens is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States. On October 22, 2006, at 3:13 p.m. PST, a magnitude 3.5 earthquake broke loose Spine 7. The collapse and avalanche of the lava dome sent an ash plume over the western rim of the crater. On January 16, 2008, steam began seeping from a fracture on top of the lava dome. On July 10, 2008, it was determined that the eruption that began in 2004 had ended, after more than 6 months of inactivity.", "prediction 3": "Mount St. Helens, also known as Louwala-Clough, is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States. On October 22, 2006, at 3:13 p.m. PST, a magnitude 3.5 earthquake broke loose Spine 7. The collapse and avalanche of the lava dome sent an ash plume over the western rim of the crater; the ash plume then rapidly dissipated. On January 16, 2008, it was determined that the eruption that began in 2004 had ended, after 6 months of inactivity.", "prediction 4": "Mount St. Helens is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States. On October 22, 2006, at 3:13 p.m. PST, a magnitude 3.5 earthquake broke loose Spine 7. The collapse and avalanche of the lava dome sent an ash plume over the western rim of the crater. On January 16, 2008, steam began seeping from a fracture on top of the lava dome. It was determined that the eruption that began in 2004 had ended, after 6 months of no volcanic activity.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 282, "end": 334 }, { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 407 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Mount St. Helens is an active stratovolcano located in Skamania County, Washington, in the Pacific Northwest region of the United States. It is most notorious for its 1980 eruption, the deadliest and most economically destructive volcanic event in the history of the United States. On January 16, 2008, steam began seeping from a fracture on top of the lava dome. Associated seismic activity was the most noteworthy since 2004. Scientists suspended activities in the crater and the mountain flanks, but the risk of a major eruption was deemed low. On July 10, 2008, it was determined that the eruption had ended, after more than 6 months of no volcanic activity." }, "preference": [ 2, 2, 0, 0, 0, 0 ] }, { "question": "Who has the highest followers on instagram in world?", "passages": [ [ "Cristiano Ronaldo", "He topped the list for the second straight year with earnings of $93\u00a0million in 2016\u201317.", "Ronaldo is one of the world's most marketable athletes: \"SportsPro\" rated him the fifth most marketable athlete in 2012, and eighth most marketable athlete in 2013, with Brazilian footballer Neymar topping both lists.", "Sports market research company Repucom named Ronaldo the most marketable and most recognised football player in the world in May 2014.", "He was additionally named in the 2014 Time 100, \"Time\"s annual list of the most influential people in the world.", "ESPN named Ronaldo the world's most famous athlete in 2016, 2017 and 2018.", "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158\u00a0million total followers across Facebook, Twitter and Instagram by June 2015.", ", he has the world's biggest Facebook fanbase with 103\u00a0million followers: he became the first sportsperson to reach 50\u00a0million followers in August 2010, and in October 2014, he became the first sportsperson, and the second person after Shakira, to reach 100\u00a0million followers.", "By June 2017, Ronaldo had 277\u00a0million followers across social media.", "His sponsors earned $936\u00a0million in media value across his social media accounts between June 2016 to June 2017." ], [ "Kevin Systrom", "Within 2 weeks of quitting his job, he received US$500,000 seed funding round from both Baseline Ventures and Andreessen Horowitz.", "While in San Francisco, Systrom and Mike Krieger built Burbn, a HTML 5 check-in service, into a product that allowed users to do many things: check into locations, make plans (future check-ins), earn points for hanging out with friends, post pictures, and much more.", "However, recalling their studies in Mayfield Fellows Program, Krieger and Systrom identified that Burbn contained too many features and the users did not want a complicated product.", "They decided to focus on one specific feature, photo-sharing.", "The development of Burbn led to creation of Instagram.", "A month after launching, Instagram had grown to 1 million users.", "A year later, Instagram hit more than 10 million users.", "In 2010, Systrom co\u2011founded the photo-sharing and, later, video-sharing social networking service Instagram with Mike Krieger in San Francisco, California.", "In April 2012, Instagram, along with 13 employees, was sold to Facebook for US$1\u00a0billion in cash and stock.", "According to multiple reports, the deal netted Systrom US$400\u00a0million based on his ownership stake in the business." ] ], "gold": "Instagram is an American photo and video sharing social networking service created by Kevin Systrom and Mike Krieger. Instagram has its own brand account on the platform, and with over 327 million followers making it is the most-followed account. The most-followed person is footballer Cristiano Ronaldo with over 197 million followers, and the most-followed woman is singer Ariana Grande with over 171 million followers.", "prediction 1": "Instagram is a photo and video sharing social networking service created by Kevin Systrom and Mike Krieger. Instagram has one of the highest number of users and the most followers in the world. The user with the highest number of followers in the world is Brazilian footballer Neymar.", "prediction 2": "Instagram is an American photo sharing and video-sharing social networking service created by Kevin Systrom and Mike Krieger. The company has the most followers on Instagram in the world. Instagram has the most users.", "prediction 3": "Instagram is a photo- and video-sharing social networking service created by Kevin Systrom and Mike Krieger in 2010. According to Instagram, the person who has the most followers on Instagram is Brazilian footballer Neymar, whose followers total 277 million. The person with the most followers is sportsperson Cristiano Ronaldo, who has 158 million followers on Instagram.", "prediction 4": "Instagram is a photo-sharing social networking service created by Kevin Systrom and Mike Krieger in San Francisco, California. The account of Brazilian footballer Neymar has the most followers on Instagram in the world.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 194, "end": 284 }, { "error type": "Unverifiable", "explanation": "", "start": 108, "end": 193 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Instagram is a photo and video sharing social networking service created by Kevin Systrom and Mike Krieger. Cristiano Ronaldo is the most popular sportsperson on social media, he counted 158 million total followers across Facebook, Twitter and Instagram by June 2015." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was the last time miami won in foxboro?", "passages": [ [ "New England Patriots", "New England Patriots\n\nThe New England Patriots are a professional American football team based in the Greater Boston region.", "The Patriots compete in the National Football League (NFL) as a member club of the league's American Football Conference (AFC) East division.", "The team plays its home games at Gillette Stadium in the town of Foxborough, Massachusetts, which is located southwest of downtown Boston, Massachusetts and northeast of downtown Providence, Rhode Island.", "The Patriots are also headquartered at Gillette Stadium.", "An original member of the American Football League (AFL), the Patriots joined the NFL in the 1970 merger of the two leagues.", "The team changed its name from the original Boston Patriots after relocating to Foxborough in 1971.", "The Patriots played their home games at Foxboro Stadium from 1971 to 2001, then moved to Gillette Stadium at the start of the 2002 season.", "The Patriots' rivalry with the New York Jets is considered one of the most bitter rivalries in the NFL.", "The Patriots have appeared in the Super Bowl ten times in franchise history, the most of any team, eight of them since the arrival of head coach Bill Belichick and quarterback Tom Brady in 2000.", "The Patriots have since become one of the most successful teams in NFL history, winning 15 AFC East titles in 17 seasons since 2001, without a losing season in that period." ], [ "Dolphins\u2013Patriots rivalry", "Miami is one of 4 teams in the AFC with a winning overall record against New England (the others being the Cleveland Browns, Denver Broncos, and Kansas City Chiefs).", "Since 2003, the Patriots have dominated the rivalry, but not as much as their rivalries with their two other AFC East opponents.", "In 2004, one of the most famous moments in the rivalry happened where the Dolphins, 2\u201311 at the time, upset the 12\u20131 Patriots in a game that has been known as \"The Night That Courage Wore Orange\".", "In 2008, the rivalry briefly intensified when the Dolphins became the only team other than the Patriots since 2003 to win the division.", "In week 3 of the aforementioned 2008 season, the Dolphins used the Wildcat formation to throw the Patriots off and went on to upset them, 38\u201313.", "In 2018, the Dolphins upset the Patriots in Miami for the second year in a row, this time with a last-minute hook and lateral scoring play in what is known as the \"Miracle in Miami\".", "Also notable is the fact that the Dolphins and Patriots are the only NFL teams to post undefeated regular season records following the NFL-AFL merger." ] ], "gold": "The Miami Dolphins haven't beaten the New England Patriots at their home stadium in Foxborough, Massachusetts since December 29, 2019, on the game for Week 17 of the NFL 2019 regular season. Before that match, the Dolphins hadn't achieve a victory against the Patriots in Foxborough since September 21, 2008, during Week 3 of the NFL 2008 season.", "prediction 1": "The Miami Dolphins currently play the New England Patriots in Foxboro, Massachusetts. The last time the Dolphins won in Foxboro was in 2018 and the last time they won there was in 2015.", "prediction 2": "The Miami Dolphins are a professional American football team based in the Greater Boston region. The team competes in the National Football League as a member club of the league's American Football Conference East division. In 1971, the Dolphins won their home games in Foxboro Stadium, then moved to Gillette Stadium at the start of the 2002 season. The Patriots have since become one of the most successful teams in NFL history, winning 15 AFC East titles in 17 seasons since 2001, without a losing season in that period. In 2018, the Dolphins upset the Patriots in Foxboro Stadium for the second year in a row, this time with a last-minute hook and lateral scoring play in what is known as the \"Miracle in Miami\".", "prediction 3": "The New England Patriots have played their home games at Foxboro Stadium in Foxboro, Massachusetts, since 1971. In 2002, the Patriots moved to Gillette Stadium, where they played their home games from the start of the 2002 season to the start of the 2003 season. The Patriots and Miami Dolphins have had a long-standing rivalry since 2003. The Dolphins have defeated the Patriots in Foxboro four times. The last time that Miami won in Foxboro was in 2018.", "prediction 4": "The New England Patriots are a professional American football team based in the Greater Boston region. The team plays its home games at Gillette Stadium in the town of Foxborough, Massachusetts, which is located southwest of downtown Boston, Massachusetts and northeast of downtown Providence, Rhode Island. The last time Miami won in Foxboro was on January 26, 2018, and the last time they won in Foxboro was on March 5, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 19, "end": 85 }, { "error type": "Unverifiable", "explanation": "", "start": 113, "end": 139 }, { "error type": "Unverifiable", "explanation": "", "start": 177, "end": 185 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Patriots plays its home games at Gillette Stadium in the town of Foxborough, Massachusetts." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "What two countries claim the virgin islands in the caribbean sea?", "passages": [ [ "Virgin Islands", "Virgin Islands\n\nThe Virgin Islands are geologically and biogeographically the easternmost part of the Greater Antilles, the northern islands belonging to the Puerto Rican Bank and St. Croix being a displaced part of the same geologic structure.", "Politically, the British Virgin Islands have been governed as the western island group of the Leeward Islands, which are the northern part of the Lesser Antilles, and form the border between the Caribbean Sea and the Atlantic Ocean.", "The archipelago is separated from the true Lesser Antilles by the Anegada Passage and from the main island of Puerto Rico by the Virgin Passage.", "The islands fall into three different political jurisdictions:\n\nChristopher Columbus named the islands after Saint Ursula and the 11,000 Virgins (), shortened to the Virgins (\"las V\u00edrgenes\").", "The official name of the British territory is the Virgin Islands, and the official name of the U.S. territory is the Virgin Islands of the United States.", "In practice, the two island groups are almost universally referred to as the British Virgin Islands and the U.S. Virgin Islands.", "The Virgin Islands were originally inhabited by the Arawak, Carib, and Cermic, almost all of whom are thought to have perished during the colonial period due to enslavement, foreign disease, and mass extermination brought about by European colonists, as is the case in the rest of the Caribbean." ], [ "Spanish Virgin Islands", "Spanish Virgin Islands\n\nThe Spanish Virgin Islands, formerly called the Passage Islands and also known as the Puerto Rican Virgin Islands, primarily consisting of the islands of Culebra and Vieques, are part of the Commonwealth of Puerto Rico, and are located east of the main island of Puerto Rico in the Caribbean.", "Puerto Rican tourist literature uses the name Spanish Virgin Islands, but most general maps and atlases do not treat these islands as part of the Virgin Islands archipelago.", "As part of Puerto Rico, the Passage Islands are part of a territory of the United States, and they belonged to Spain before the Spanish\u2013American War in 1898.", "Spanish remains the predominant language, although English is also common.", "The principal islands of the group are Culebra and Vieques, with multiple associated smaller islands and islets.", "Other islands that are close to the shore of Puerto Rico include: Icacos Island, Cayo Lobo, Cayo Diablo, Palomino Island, Palominito Island, Isla de Ramos, Isla Pineiro, Cayo Lobo.", "Near Culebra there is Cayo Luis Pe\u00f1a.", "Culebra's smaller island, Cayo Norte, is part of Culebra National Wildlife Refuge.", "Much of Vieques is part of Vieques National Wildlife Refuge, formerly a U.S. Navy facility." ], [ "1993 United Kingdom\u2013United States Maritime Boundary Treaties", "1993 United Kingdom\u2013United States Maritime Boundary Treaties\n\nThe 1993 United Kingdom\u2013United States Maritime Delimitation Treaties are two treaties between the United Kingdom and the United States which establish maritime boundary between British territories and American territories in the Caribbean Sea.", "Both treaties were signed in London on 5 November 1993.", "The first treaty delimits the boundary between the British territory of Anguilla and the United States Virgin Islands.", "The boundary is a simplified equidistant line that consists of a single maritime straight-line segment 1.34 nautical miles long.", "It is defined by a straight line connecting two individual coordinate points.", "The full name of the treaty is \"Treaty between the Government of the United Kingdom of Great Britain and Northern Ireland and the Government of the United States of America on the Delimitation in the Caribbean of a Maritime Boundary between the US Virgin Islands and Anguilla\".", "The second treaty delimits the boundary between the British Virgin Islands and the United States Virgin Islands and Puerto Rico.", "The boundary is a simplified equidistant line that runs in a south\u2013south-east direction until it terminates at the tripoint of Anguilla.", "It is far longer and more complicated than the Anguilla \u2013 U.S. Virgin Islands boundary: it is about 200 nautical miles long and consists of 49 straight-line segments defined by 50 individual coordinate points." ] ], "gold": "The Virgin Islands are an archipelago in the Caribbean Sea that falls into three political jurisdictions. The Spanish Virgin Islands, ceded from Spain to the United States in 1898, and the United States Virgin Islands are both claimed by the United States, while the British Virgin Islands are claimed by Great Britain.", "prediction 1": "The Virgin Islands are located in the Caribbean Sea. The British Virgin Islands and the United States Virgin Islands are the two countries that claim the Virgin islands in the Caribbean. Moreover, both countries have claimed the islands in the past and have claimed them in the present. The Virgin Islands are geologically and biogeographically the easternmost part of the Greater Antilles, with the northern islands belonging to the Puerto Rican Bank and St. Croix being a displaced part of the same geologic structure.", "prediction 2": "The Virgin Islands of the Caribbean are located in the United States and the United Kingdom, respectively. The United States and the United Kingdom claim the Virgin Islands of the Caribbean, while the United States claim the Virgin Islands of the Caribbean. The British Virgin Island and the United States claim the Virgin Islands of the Caribbean.", "prediction 3": "The United Kingdom and the United States claim the Virgin Islands in the Caribbean. The British Virgin Islands are the easternmost part of the Greater Antilles, with the northern islands belonging to the Puerto Rican Bank and St. Croix being a displaced part of the same geologic structure. The United States and the United Kingdom claim the islands.", "prediction 4": "The Virgin Islands are geologically and biogeographically the easternmost part of the Greater Antilles, with the northern islands belonging to the Puerto Rican Bank and St. Croix being a displaced part of the same geologic structure. The British Virgin Islands have been governed as the western island group of the Leeward Islands, which are the northern part of the Lesser Antilles, and form the border between the Caribbean Sea and the Atlantic Ocean. In practice, the two island groups are almost universally referred to as the British Virgin Islands and the United States Virgin Islands of the Virgin Islands of the Virgin Islands of the Virgin Islands of the United States. The Spanish Virgin Islands, formerly called the Passage Islands, are part of the Commonwealth of Puerto Rico, and are located east of the main island of Puerto Rico.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 53, "end": 186 }, { "error type": "Unverifiable", "explanation": "", "start": 187, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 520 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Virgin Islands are an archipelago in the Caribbean Sea that falls into three political jurisdictions. The Spanish Virgin Islands are part of a territory of the United States, and they belonged to Spain before the Spanish\u2013American War in 1898. The official name of the British territory is the Virgin Islands, and the official name of the U.S. territory is the Virgin Islands of the United States." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When do most schools go back after summer?", "passages": [ [ "First day of school", "First day of school\n\nThe first day of school is the first day of an academic year.", "This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country.", "The first day of school in Costa Rica is in early February.", "The Education Ministry changes the date every year to ensure 200 effective days are in the school calendar.", "In the United States, educational policy is determined primarily at the state level and at the level of individual school districts.", "Therefore, there is no one particular day on which all schools start.", "During much of the 20th century, it was common for schools to start shortly after Labor Day, and in some areas of the United States, this is still the norm.", "However, it has become increasingly common for schools to start earlier in August or even late July.", "For example, in San Diego Unified School District, San Diego, California, the first day of school for the 2017-18 school year was set to August 28.", "The first day of elementary school in Israel is on September 1 or on the Sunday following (September 2) if September 1 is a Saturday.", "Many secondary schools begin the same day.", "The government school calendar in the Philippines usually begins in June every year.", "However, private schools have the exception to deviate from the calendar as regulated by Republic Act No. 7797." ] ], "gold": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. In the United States, educational policy is determined primarily at the state level and at the level of individual school districts. Therefore, there is no one particular day on which all schools start. During much of the 20th century, it was common for schools to start shortly after Labor Day, and in some areas of the United States, this is still the norm. However, it has become increasingly common for schools to start earlier in August or even late July.", "prediction 1": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. The government school calendar in the Philippines usually begins in June every year.", "prediction 2": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. In the United States, educational policy is determined primarily at the state level and at the level of individual school districts. Therefore, there is no one particular day on which all schools start. However, it has become increasingly common for schools to start earlier in August or even late July.", "prediction 3": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. During much of the 20th century, it was common for schools to start shortly after Labor Day, and in some areas of the United States, this is still the norm. However, it has become increasingly common for schools to start earlier in August or even late July. For example, the first day of elementary school in Israel is on the Sunday following, or on the Sunday following (September 2) if September 1 is a Saturday. Many secondary schools begin the same day.", "prediction 4": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. In the United States, educational policy is determined primarily at the level of individual school districts, so there is no one particular day on which all schools start. During much of the 20th century, it was common for schools to start shortly after Labor Day. However, it has become increasingly common for schools to start earlier in August or even late July. In the United States, it is common for schools to start earlier in August or even late July. In the United States, it has become increasingly common for schools to start earlier in August or even late July.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 301 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The first day of school is the first day of an academic year. This is usually in August or September in the Northern Hemisphere and January or February in the Southern Hemisphere, but differs from country to country. In the United States, educational policy is determined primarily at the state level and at the level of individual school districts. Therefore, there is no one particular day on which all schools start. During much of the 20th century, it was common for schools to start shortly after Labor Day, and in some areas of the United States, this is still the norm. However, it has become increasingly common for schools to start earlier in August or even late July." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "A picture of three lions is seen in the national emblem of india what is written underneath it?", "passages": [ [ "State Emblem of India", "State Emblem of India\n\nThe State Emblem of India, as the national emblem of India is called, is an adaptation of the Lion Capital of Ashoka at Sarnath, preserved in the Sarnath Museum near Varanasi, India.", "A representation of Lion Capital of Ashoka was initially adopted as the emblem of the Dominion of India in December 1947.", "The current version of the emblem was officially adopted on 26 January 1950, the day that India became a republic.", "In 1947, as the date of independence for India and Pakistan approached, Jawaharlal Nehru gave charge of finding a suitable national emblem to Badruddin Tyabji, a civil servant, freedom fighter and member of the Constituent Assembly.", "Art schools all over the country were approached for designs, but none of them were found suitable as most were similar to the emblem of British Raj.", "Along with the Flag Committee headed by Dr. Rajendra Prasad, Tyabji and his wife suggested the use the Ashoka Capital, with four lions on top and the Ashoka Chakra flanked by a bull and horse below.", "Tyabji's wife Surayya Tyabji drew it and sent it to the printing press at Viceregal lodge for printing.", "This design was selected and has remained the emblem of the Indian government ever since." ], [ "State Emblem of India (Prohibition of Improper Use) Act, 2005", "State Emblem of India (Prohibition of Improper Use) Act, 2005\n\nState Emblem of India (Prohibition of Improper Use) Act, 2005 is an Act of Parliament of India which regulates the improper or commercial usage of the Emblem of India.", "The emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath.", "The Emblem constitutes of three lions, the fourth being hidden from view.", "The Ashoka Chakra (wheel) appears in relief in the center of the abacus, with a bull on the right and a galloping horse on the left, and outlines of Dharma Chakras on the extreme right and left.", "Forming an integral part of the emblem is the motto inscribed below the abacus in Devanagari script: \"Satyameva jayate\" \u0938\u0924\u094d\u092f\u092e\u0947\u0935 \u091c\u092f\u0924\u0947 ().", "This is a quote from Mundaka Upanishad, the concluding part of the sacred Hindu Vedas.", "This National Emblem was adopted on 26 January 1950, the day that India became a republic." ], [ "Emblem of Karnataka", "Emblem of Karnataka\n\nThe Emblem of Karnataka is the state emblem of Karnataka, India.", "The emblem is based on that of the Kingdom of Mysore and the Coat of Arms of the United Kingdom and is carried on all official correspondences made by Government of Karnataka.", "The emblem has a red shield charged with a white two-headed bird, Gandaberunda bordered in blue.", "The crest depicts the Lion Capital of Ashoka (also used as the emblem of the Government of India), on a blue circular abacus with a blue frieze carrying sculptures in high relief of a galloping horse on the left, a Dharmachakra in centre, a bull on the right, and the outlines of Dharmachakras on the extreme left and right as part of Sarnath's Ashoka Pillar.", "The shield is flanked on either side by red-maned, yellow lion-elephant Sharabha supporters (mythical creatures believed to be upholders of righteousness stronger than lions and elephants) standing on a green, leafy compartment.", "Below the compartment lies written in stylized Devan\u0101gar\u012b, the national motto of India, \"\u0938\u0924\u094d\u092f\u092e\u0947\u0935 \u091c\u092f\u0924\u0947\" (Satyameva Jayate, Sanskrit for \"Truth alone triumphs\")." ] ], "gold": "The State Emblem of India is the national emblem of India and is used by the national government, many state governments and government agencies. The emblem is an adaptation of the Lion Capital of Ashoka, a statue from 280 BCE. The statue is a dimensional emblem showing four lions. A picture of three lions is seen in the state emblem of India. The words that are written underneath it are \u0938\u0924\u094d\u092f\u092e\u0947\u0935 \u091c\u092f\u0924\u0947, or Truth Alone Triumphs. Those words are a quote from Mundaka Upanishad, the concluding part of the sacred Hindu Vedas.", "prediction 1": "The national emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath, preserved in the Sarnath Museum near Varanasi, India. The Emblem of India, as the state emblem of Karnataka is called, is an adaptation of the Lion Capital of Ashoka at Sarnath. The Emblem constitutes of three lions, the fourth being hidden from view. The Ashoka Chakra (wheel) appears in relief in the center of the abacus, with the Ashoka Capital, with four lions on top and the Ashoka Chakra flanked by a bull and outlines of Dharma Chakras on the extreme right and left. The national motto inscribed below the abacus is Satyameva Jayate, Sanskrit for \"Truth alone triumphs\".", "prediction 2": "The national emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath, preserved in the Sarnath Museum near Varanasi, India. The State Emblem of India, as the national emblem of India is called, is an adaptation of the Lion Capital of Ashoka at Sarnath, preserved in the Sarnath Museum near Varanasi, India. The Emblem constitutes of three lions, the fourth being hidden from view. The Ashoka Chakra appears in relief in the center of the abacus in devanagari script, the national motto of India, \"Satyameva jayate\" gari script. This is a quote from Mundaka Upanishad, the concluding part of the sacred Hindu Vedas. This National Emblem was adopted on 26 January 1950, the day that India became a republic.", "prediction 3": "The national emblem of India, or State Emblem of India, is an adaptation of the Lion Capital of Ashoka at Sarnath. The emblem comprises of three lions, with the fourth being hidden from view. The Ashoka Chakra appears in relief in the center of the abacus, with a bull and horse flanked by outlines of Dharma Chakras on the extreme left and right. Forming an integral part of the emblem is the motto inscribed below the abacus in Devanagari script: \"Satyameva jayate\" gar, the national motto of India, \"Satyameva jayate\" gar, gar, the national motto of India, \"Satyameva Jayate\" (Satyameva Jayate, Sanskrit for \"Truth alone triumphs\").", "prediction 4": "The national emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath, preserved in the Sarnath Museum near Varanasi, India. The State Emblem of India, as the national emblem of India is called, is an adaptation of the Lion Capital of Ashoka at Sarnath, also used as the emblem of the Government of India. The emblem comprises of three lions, the fourth being hidden from view. The Ashoka Chakra appears in relief in the center of the abacus, with the motto in Devanagari script that read \"Satyameva jayate\" gargar, the national motto of India, \"Satyameva jayate\" is a quote from Mundaka Upanishad, the concluding part of the sacred Hindu Vedas.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 141 }, { "error type": "Redundant", "explanation": "The national emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath, ", "start": 142, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 562 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The national emblem of India is an adaptation of the Lion Capital of Ashoka at Sarnath. The Emblem constitutes of three lions, the fourth being hidden from view. The national motto inscribed below the abacus is Satyameva Jayate, Sanskrit for \"Truth alone triumphs\". Those words are a quote from Mundaka Upanishad, the concluding part of the sacred Hindu Vedas." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Where will this year's army-navy game be played?", "passages": [ [ "Army\u2013Navy Game", "The game has been held one other time in a non-East Coast venue, at Chicago's Soldier Field, which played host to the 1926 game.", "All games through 2020 will be held at Lincoln Financial Field in Philadelphia.", "MetLife Stadium in East Rutherford, New Jersey will host the 2021 game.", "The game will then return to Lincoln Financial Field for 2022.", "Games beyond 2022 have yet to be awarded.", "Navy Midshipman (and later Admiral) Joseph Mason Reeves wore what is widely regarded as the first football helmet in the 1893 Army\u2013Navy Game.", "He had been advised by a Navy doctor that another kick to his head would result in intellectual disability or even death, so he commissioned an Annapolis shoemaker to make him a helmet out of leather.", "On November 27, 1926, the Army\u2013Navy Game was held in Chicago for the National Dedication of Soldier Field as a monument to American servicemen who had fought in World War I. Navy came to the game undefeated, while West Point had only lost to Notre Dame, so the game would decide the National Championship.", "Played before a crowd of over 100,000, the teams fought to a 21\u201321 tie, but Navy was awarded the national championship.", "In both the 1944 and 1945 contests, Army and Navy entered the game ranked #1 and #2 respectively.", "The 1945 game was labeled the \"game of the century\" before it was played." ], [ "Army\u2013Navy Game", "The game has been held in multiple locations, but outside the 1926 game in Chicago and 1983 game in Pasadena, California, it has been played in the Northeast megalopolis, most frequently in Philadelphia, followed by the New York area and the Baltimore\u2013Washington area.", "The series has been marked by several periods of domination by one team or the other, with Navy's 14-game winning streak from 2002 through 2015 being the longest for either side.", "Through the 2018 meeting, Navy leads the series 60\u201352\u20137, but has lost the last three games.", "Army and Navy first met on the field on November 29, 1890.", "They played 30 times between that date and November 26, 1927.", "The series has been renewed annually since 1930.", "The game has been held at several locations throughout its history, including Baltimore and New York City, but has most frequently been played in Philadelphia, roughly equidistant from the two academies.", "Historically played on the Saturday after Thanksgiving (a date on which most other major college football teams end their regular seasons), the game is now played on the second Saturday in December and is traditionally the last game of the season for both teams and the last regular-season game played in Division", "I FBS football." ] ], "gold": "MetLife Stadium in East Rutherford, New Jersey will host the 2021 Army-Navy game, while the 2022 Army-Navy game will be played at Lincoln Financial Field in Philadelphia, Pennsylvania. Sites for Army-Navy games beyond 2022 have yet to be awarded. Throughout history, the Army-Navy game has been held in multiple locations, but outside the 1926 game in Chicago and 1983 game in Pasadena, California, the game has been played in the Northeast megalopolis, most frequently in Philadelphia, followed by the New York area and the Baltimore\u2013Washington area.", "prediction 1": "The annual Army\u2013Navy game is played on the field at Lincoln Financial Field in Philadelphia. In 2018, both the Army and Navy played at MetLife Stadium in East Rutherford, New Jersey, the venue for the 2021 game. In the 2022 game, the venue for the 2023 game was Lincoln Financial Field in Philadelphia.", "prediction 2": "The Army\u2013Navy Game has been played in multiple locations, but outside the 1926 game in Chicago and 1983 game in Pasadena, California, it has been played in the Northeast megalopolis, most frequently in Philadelphia, followed by the New York area and the Baltimore\u2013Washington area. This year's army-navy game will be played at Lincoln Financial Field in Philadelphia.", "prediction 3": "The Army\u2013Navy Game is a college football game between the two academies of the United States Army and the United States Naval Academy. The game is played at Lincoln Financial Field in Philadelphia and metLife Stadium in East Rutherford, New Jersey for the 2021 game.", "prediction 4": "The Army-Navy Game has been played in many different locations over the years. The most recent game was on November 20, 2018, which was played at Lincoln Financial Field in Philadelphia. The game will be played on November 26, 2019 at MetLife Stadium in East Rutherford, New Jersey. The game will be played on November 27, 2021, and then return to Lincoln Financial Field in 2020.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 52, "end": 75 }, { "error type": "Unverifiable", "explanation": "", "start": 93, "end": 101 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 248, "end": 257 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The annual Army\u2013Navy game through 2020, and for the 2022 year, will be held at Lincoln Financial Field in Philadelphia. MetLife Stadium in East Rutherford, New Jersey will host the 2021 game. Games beyond 2022 have yet to be awarded. The game has been held in multiple locations, but outside the 1926 game in Chicago and 1983 game in Pasadena, California, it has been played in the Northeast megalopolis, most frequently in Philadelphia, followed by the New York area and the Baltimore\u2013Washington area." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has sold the most concert tickets ever?", "passages": [ [ "Bijelo Dugme", "There were several books written about the band: \"Istina o Bijelom dugmetu\" (\"The Truth about Bijelo Dugme\", 1977) by Danilo \u0160trbac, \"Bijelo Dugme\" (1980) by Du\u0161ko Pavlovi\u0107, \"Ni\u0161ta mudro\" (1981) by Darko Glavan and Dra\u017een Vrdoljak, \"Lopu\u017ee koje nisu uhvatili\" (\"Rascals That Weren't Caught\", 1985) by Du\u0161an Vesi\u0107, \"Bijelo Dugme\" (2005) by Asir Misirli\u0107, \"Bijelo Dugme - Do\u017eivjeti stotu\" (2005) by Zvonimir Krstulovi\u0107, \"Kad bi bio bijelo dugme\" (2005) by Nenad Stevovi\u0107, \"Kad sam bio bijelo dugme\" (\"When I Was a White Button\", 2005) by Ljubi\u0161a Stavri\u0107 and Vladimir Sudar and \"\u0160ta bi dao da si na mom mjestu\" (2014) by Du\u0161an Vesi\u0107.", "In 1994, Radio Television of Serbia aired a four-part documentary about the band entitled \"Nakon svih ovih godina\"." ], [ "Concert", ", Italian singer Vasco Rossi holds the record for the biggest attendance of a ticketed concert with a total of 220,000 tickets sold for his show at Enzo Ferrari Park, Modena, Italy on 1 July 2017.", "The record was previously held by Paul McCartney's 1990 concert with a paying audience of 185,000 in Maracan\u00e3 Stadium, Rio de Janeiro.", "Rod Stewart also holds the record for the biggest attendance in a free concert, with an estimated audience of 3.5 million during his 1994 New Year's Eve concert in Copacabana Beach, Rio de Janeiro." ], [ "Turneja 2005: Sarajevo, Zagreb, Beograd", "The reunited Bijelo Dugme did not feature bass guitarist Jadranko Stankovi\u0107, who was a member of the original Bijelo Dugme lineup, but spent only several months with the band, drummer Ipe Ivandi\u0107, who died in 1994, as well as short-term touring musicians, bass guitarists Mustafa \"Mute\" Kurtali\u0107, Ljubi\u0161a Raci\u0107 and Sanin Kari\u0107 and drummer Garabet Tavitjan.", "The reunion saw large media attention in all former Yugoslav republics.", "The band held only three concerts: in Sarajevo, at Ko\u0161evo stadium, Zagreb, at Maksimir stadium, and Belgrade, at Belgrade Hippodrome.", "The concerts featured a string orchestra, a brass band, klapa group Nostalgija and two female singers from Bregov\u0107's Weddings and Funerals Orchestra.", "The concert in Sarajevo attracted about 60,000 people, and the concert in Zagreb was attended by more than 70,000 people.", "For the concert in Belgrade, more than 220,000 tickets were sold, but it was later estimated that it was attended by more that 250,000 people.", "However, the concert in Belgrade was much criticized because of the bad sound.", "\"Turneja 2005: Sarajevo, Zagreb, Beograd\" features recordings from these concerts." ] ], "gold": "The oldest 100,000-crowd concert reported to Billboard Boxscore is Grateful Dead's gig at the Raceway Park, Englishtown, New Jersey on September 3, 1977. This concert was attended by 107,019 people, which remains the largest ticketed concert in the United States to date. Paul McCartney broke this record in Maracan\u00e3 Stadium in Rio de Janeiro, Brazil with an audience of over 184,000 people. McCartney's record was then broken by A-ha in 1991 during the Rock in Rio, when they drew about 198,000 people with tickets. Their record was then broken by a Japanese rock band, Glay, which held a concert with an audience of 200,000 people on July 31, 1999, in Chiba, Japan. Glay held the record for 6 years. Then, in 2005, rock band Bijelo Dugme sold more than 200,000 tickets for their concert in Belgrade, but it was later estimated that more than 250,000 attended the concert, setting a new record. Italian singer Vasco Rossi then surpassed these records with his solo concert on July 1, 2017 in Modena, Italy. This concert was a celebration of his 40 years of career and is the current highest-attended ticketed concert of all time.", "prediction 1": "The band Bijelo Dugme has sold the most concert tickets ever. Italian singer Vasco Rossi holds the record for the biggest attendance of a ticketed concert with a total of 220,000 tickets sold for his show at Enzo Ferrari Park, Modena, Italy on 1 July 2017. Paul McCartney sold the most concert tickets in 1990 with a paying audience of 185,000 in Maracan Stadium, Rio de Janeiro.", "prediction 2": "It was Paul McCartney's 1990 concert with a paying audience of 185,000 in Maracan Stadium, Rio de Janeiro. Italian singer Vasco Rossi holds the record for the biggest attendance of a ticketed concert with a total of 220,000 tickets sold for his show at Enzo Ferrari Park, Modena, Italy on 1 July 2017.", "prediction 3": "The band Bijelo Dugme have sold the most concert tickets ever. The record for the most tickets sold at a single concert is 350,000. The record for the most tickets sold at a single concert belongs to Italian singer Vasco Rossi with a total of 220,000 tickets sold for his show at Enzo Ferrari Park, Modena, Italy on 1 July 2017.", "prediction 4": "There are several people who have sold the most concert tickets ever, including singer Vasco Rossi, who sold 220,000 tickets for his concert in Modena, Italy on 1 July 2017. The number of tickets sold by the band in total during one concert is also significant, with the band selling the most tickets in total during all of their concerts.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The band Bijelo Dugme has sold the most concert tickets ever. For the 2005 concert in Belgrade, more than 220,000 tickets were sold, but it was later estimated that it was attended by more that 250,000 people. Italian singer Vasco Rossi holds the record for the biggest attendance of a ticketed concert with a total of 220,000 tickets sold for his show at Enzo Ferrari Park, Modena, Italy on 1 July 2017. Paul McCartney sold the most concert tickets in 1990 with a paying audience of 185,000 in Maracan Stadium, Rio de Janeiro." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who played the wife in wolf of wall street?", "passages": [ [ "Cristin Milioti", "Cristin Milioti\n\nCristin Milioti (born August 16, 1985) is an American actress and vocalist.", "She has worked in Broadway theatre productions such as \"That Face\", \"Stunning\", and the Tony Award-winning musical \"Once\".", "She also played the titular Mother on the sitcom \"How I Met Your Mother\" from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film \"The Wolf of Wall Street\", and Betsy Solverson in the second season of \"Fargo\" (2015).", "She has won a Grammy Award and has been nominated for a Tony Award.", "Milioti was born on August 16, 1985 in Cherry Hill, New Jersey.", "She is of Italian descent, and calls her family \"Olive Garden Italian\".", "In middle school, she found her love of acting at Long Lake Camp for the Arts in New York state.", "She graduated in 2003 from Cherry Hill High School East, where she began performing in school plays.", "She took acting classes at New York University, but dropped out during her freshman year.", "However, she is listed in the university's advertising.", "Milioti's first acting roles were bit parts in national advertising campaign ads, notably one for the Ford Edge.", "She also appeared in television programs such as \"30 Rock\" and films such as \"Greetings from the Shore\"." ], [ "The Wolf of Wall Street (2013 film)", "The Wolf of Wall Street (2013 film)\n\nThe Wolf of Wall Street is a 2013 American biographical black comedy crime film directed by Martin Scorsese and written by Terence Winter, based on the memoir of the same name by Jordan Belfort.", "It recounts Belfort's perspective on his career as a stockbroker in New York City and how his firm Stratton Oakmont engaged in rampant corruption and fraud on Wall Street that ultimately led to his downfall.", "Leonardo DiCaprio (who was also a producer) stars as Belfort, with Jonah Hill as his business partner and friend Donnie Azoff, Margot Robbie as his wife Naomi Lapaglia and Kyle Chandler as Patrick Denham, the FBI agent who tries to bring him down.", "Matthew McConaughey, Rob Reiner, Jon Favreau, Joanna Lumley and Jean Dujardin also star.", "The film marks the director's fifth collaboration with DiCaprio, after \"Gangs of New York\" (2002), \"The Aviator\" (2004), \"The Departed\" (2006) and \"Shutter Island\" (2010), as well as his second collaboration with Winter after the television series \"Boardwalk Empire\" (2010\u201314)." ], [ "Margot Robbie", "Margot Robbie\n\nMargot Elise Robbie ( ; born 2 July 1990) is an Australian actress and film producer.", "In 2017, \"Time\" magazine named her as one of the 100 most influential people in the world, and \"Forbes\" featured her on its 30 Under 30 list.", "Born and raised on a farm in Dalby, Queensland, Robbie studied drama at Somerset College.", "She began her career in Australian independent films in the late 2000s, before working in the soap opera \"Neighbours\" (2008\u20132011), which earned her two Logie Award nominations.", "After moving to the United States, she starred in the short-lived ABC drama series \"Pan Am\" (2011\u20132012).", "In 2013, she had a supporting role in the romantic comedy \"About Time\", and made her breakthrough later that year, by co-starring in Martin Scorsese's biographical black comedy \"The Wolf of Wall Street\".", "Robbie launched a production company, named LuckyChap Entertainment in 2014.", "Her profile continued to grow with leading roles in the romantic drama \"Focus\" (2015), as Jane Porter Clayton in the action-adventure film \"The Legend of Tarzan\" (2016), and as Harleen Quinzel/Harley Quinn in the superhero film \"Suicide Squad\" (2016)." ] ], "gold": "The Wolf of Wall Street is a 2013 American satirical biographical black comedy crime film directed by Martin Scorsese and written by Terence Winter, based on the 2007 memoir of the same name by Jordan Belfort. Jordan's first wife in the film is played by American actress and singer Cristin Milioti. Jordan's second wife is played by Australian actress Margot Robbie. Katarina \u010cas played Brad's wife.", "prediction 1": "In the 2013 film, the wife of the main character, Jordan Belfort, is played by Margot Robbie. In the 2013 film, Cristin Milioti played the title role on the sitcom How I Met Your Mother and then played Teresa Petrillo Belfort. A Canadian actress and film producer, Australian actress Margot Robbie played Naomi Lapaglia.", "prediction 2": "The Wolf of Wall Street is a 2013 American biographical black comedy crime film directed by Martin Scorsese and written by Terence Winter, based on the memoir of the same name by Jordan Belfort. Margot Robbie played Naomi Lapaglia, the wife of Leonardo DiCaprio's character. Cristin Milioti played the titular Mother on the sitcom \"How I Met Your Mother\" from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film, and Betsy Solverson in the second season of Fargo (2015).", "prediction 3": "In the 2013 film The Wolf of Wall Street, Margot Robbie plays Naomi Lapaglia, the wife of stockbroker Jordan Belfort. The film recounts Belfort's perspective on his career as a stockbroker in New York City and how his firm Stratton Oakmont engaged in rampant corruption and fraud on Wall Street that ultimately led to his downfall. American actress and vocalist Cristin Milioti played Teresa Petrillo Belfort, the wife of stockbroker Jordan Belfort. Australian actress and film producer Margot Robbie played Naomi Lapaglia.", "prediction 4": "In the 2013 film The Wolf of Wall Street, American actress and vocalist Cristin Milioti played the title role, Teresa Petrillo Belfort, and Australian actress and film producer Margot Robbie played Naomi Lapaglia. In the 2014 film, American actress and singer Cristin Milioti played the title role.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 50, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 283 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Wolf of Wall Street (2013 film) The Wolf of Wall Street is a 2013 American biographical black comedy crime film directed by Martin Scorsese and written by Terence Winter, based on the memoir of the same name by Jordan Belfort. In the 2013 film, the wife of the main character, Naomi Lapaglia, is played by Margot Robbie. " }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "What is the capacity of university of phoenix stadium?", "passages": [], "gold": "The University of Phoenix stadium has a default sitting capacity of 63,400, with an expandable sitting capacity of 72,200, and a standing capacity of 78,600.", "prediction 1": "The capacity of the University of Phoenix Stadium is 5,000 people.\n", "prediction 2": "The capacity of University of Phoenix Stadium is 2,500 people per match.", "prediction 3": "The University of Phoenix Stadium is designed to hold a total of 14,689 people.", "prediction 4": "In 2015, they constructed a multipurpose track and field facility. In 2017, they added a soft-surface concrete surface to the court.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 67 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who is the secretary of state in arkansas?", "passages": [ [ "John Thurston (politician)", "John Thurston (politician)\n\nJohn Manuel Thurston (born December 27, 1972) is the current Arkansas Commissioner of State Lands.", "A Republican, he was first elected in November 2010, took office in January 2011, and was reelected in November 2014 to a second term.", "In November 2018, Thurston was elected as the Arkansas Secretary of State.", "Thurston graduated in 1991 from Sheridan High School in Grant County in southern Arkansas.", "He then attended Agape College in the capital city of Little Rock.", "He is a former licensed Christian minister and a Certified Religious Assistant in the Arkansas state prison system.", "He worked 13 years for Agape Church in Little Rock before entering politics.", "Thurston is the first Republican to be elected as Land Commissioner since the office became elective in 1874.", "In 2014, Thurston was elected as the president of the Western States Land Commissioners Association; the organization's winter conference was held in Little Rock that year.", "Limited to two terms as state lands commissioner, Thurston announced in June 2016 he would run in 2018 for election as Arkansas secretary of state.", "As important issues, he cited election security, physical security, political accessibility, and redistricting of legislative boundaries.", "Thurston faced Trevor Drown in the Republican primary election, and was chosen as the Republican nominee." ], [ "Mark Martin (Arkansas politician)", "Mark Martin (Arkansas politician)\n\n", "Mark Russell Martin (born February 18, 1968) is the Republican Secretary of State of Arkansas, a statewide position which he assumed in January 2011.", "He is a former three-term member of the Arkansas House of Representatives for District 87 in Washington County in Northwest Arkansas.", "A native of Kansas City, Kansas, Martin was reared in the Mississippi River delta country of eastern Arkansas.", "He graduated from Hughes High School in Hughes in St. Francis County.", "In 1998, he received a Bachelor of Science in Mechanical Engineering from the University of Arkansas at Fayetteville.", "While in the United States Navy, Martin was a technician in a nuclear engineering laboratory.", "He since held numerous technology-oriented positions in private industry prior to the launching of his political career.", "Martin and his wife, the former Sharon Marie Tilley (also born 1968), have two daughters and one son.", "The family attends Legacy Baptist Church of Northwest Arkansas in Rogers.", "The Martins reside in Prairie Grove in Washington County though his duties often keep him in the capital city of Little Rock.", "Martin was first elected to the Arkansas House in 2004, when he defeated the Democrat Lloyd D. Keck of West Fork in Washington County, 5,738 (55.2 percent) to 4,667 (44.8 percent)." ], [ "Charlie Daniels (politician)", "Charlie Daniels (politician)\n\nCharlie Daniels (born December 7, 1939) is an American Democratic Party politician from Arkansas.", "He was the State Auditor of Arkansas from 2011 to 2015 and previously served as Arkansas Secretary of State, and as Commissioner of State Lands.", "Charlie Daniels was born in the Union County, Arkansas community of Parker's Chapel, and grew up in El Dorado, Arkansas.", "He served in the United States Air Force and the Air Force Reserves.", "Daniels attended Southern Arkansas University, and the University of Arkansas at Little Rock.", "He began his political career as a member of the Parker's Chapel school board from 1972 to 1974.", "From 1974 to 1980, he served as Director of the Arkansas Department of Labor in the Cabinet of Governor David Pryor until 1979, and was retained in that post for a year under Governor Bill Clinton.", "He served as director of government affairs for the Arkansas Electric Cooperative Corporation from 1980 to 1984.", "In 1984, he was elected as Arkansas Commissioner of State Lands, and was subsequently re-elected to four-year terms in 1986, 1990, 1994, and 1998.", "He was elected as the 32nd Arkansas Secretary of State in 2002, defeating the Republican Party nominee, Janet Huckabee, the wife of then-Governor Mike Huckabee, and was re-elected in 2006." ] ], "gold": "John Manuel Thurston is the current Secretary of State of Arkansas. He was elected in November 2018, and he has served in this position since January 2019. He succeeded Mark Martin in this position. Martin served as the Secretary of State of Arkansas from January 2011 to January 2019. Martin was preceded by Charlie Daniels as the Secretary of State of Arkansas. Daniels was elected as the 32nd Arkansas Secretary of State in 2002 and was re-elected in 2006. Prior to Daniels, Sharon Priest served as the Secretary of State of Arkansas. She was the first woman elected to the role of Secretary of State of Arkansas in 1994. She was then re-elected in 1998. Her tenure ended in 2003.", "prediction 1": "There are several people who are the secretary of state in Arkansas. John Thurston is the current Arkansas Commissioner of State Lands. A Republican, he was first elected in November 2010, took office in January 2011, and was reelected in November 2014 to a second term. In November 2018, Thurston was elected as the Arkansas Secretary of State. American Democratic Party politician Charlie Daniels was the secretary of state in Arkansas from 2011 to 2015.", "prediction 2": "In Arkansas, there are several secretary of state. In 2018, John Manuel Thurston was elected as Secretary of State. In 2012, Mark Martin, a Republican, was elected Secretary of State. In 2015, Charlie Daniels, a Democratic Party politician, was elected as Secretary of State.", "prediction 3": "There are several elected officials who serve as the secretary of state of Arkansas. John Thurston, a Republican, is the current Arkansas Commissioner of State Lands. Republican candidate Mark Martin, a Democrat, was elected as the Secretary of State of Arkansas in January 2011. American Democrat Charlie Daniels, a Democrat, was elected as the Secretary of State of Arkansas in 2002 and served in both roles from 2002 to 2006.", "prediction 4": "There are multiple elected officials in Arkansas. John Thurston is the current Arkansas Secretary of State and John Martin is the current Secretary of State. American Democrat Charlie Daniels previously served as Secretary of State, and as Commissioner of State Lands.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 270 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 417, "end": 425 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "There are several people who are the secretary of state in Arkansas. John Thurston, in November 2018, was elected as the Arkansas Secretary of State. American Democratic Party politician Charlie Daniels was elected as the 32nd Arkansas Secretary of State in 2002 and re-elected in 2006. Mark Martin was also the Arkansas Secretary of State when he assumed the role in January 2011. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played mr. big on sex and the city?", "passages": [ [ "Sex and the City 2", "Sex and the City 2\n\nSex and the City 2 is a 2010 American romantic comedy film written, co-produced, and directed by Michael Patrick King.", "It is the sequel to the 2008 film \"Sex and the City\", based on the 1998\u20132004 HBO series of the same name.", "Sarah Jessica Parker, Kim Cattrall, Kristin Davis, Cynthia Nixon reprised their roles as friends Carrie, Samantha, Charlotte, and Miranda while Chris Noth co-stars as Carrie's husband Mr. Big.", "It features cameos from Liza Minnelli, Miley Cyrus, Tim Gunn, Ron White, Omid Djalili, Pen\u00e9lope Cruz, Norm Lewis, Kelli O'Hara, and Ryan Silverman.", "\"Sex and the City 2\" was theatrically released on May 27, 2010, in the United States and May 28, 2010, in the United Kingdom, and grossed $294 million from a $95 million budget.", "It received seven Golden Raspberry nominations, and won in the categories of Worst Actress (for Parker, Cattrall, Davis, and Nixon), Worst Screen Ensemble, and Worst Sequel.", "The film was nominated for Worst Picture, Worst Screenplay, Worst Director, and Minnelli for Worst Supporting Actress.", "A third \"Sex and the City\" film was announced in 2016 but cancelled the following year.", "Carrie, Samantha, Charlotte, and Miranda meet up." ], [ "Sex and the City 2", "The location of Abu Dhabi was chosen because of its high fashion culture (although the authorities later revoked filming clearance) and also that it was a location relatively free from the recession.", "All four stars, Sarah Jessica Parker, Cynthia Nixon, Kristin Davis, and Kim Cattrall, returned in the sequel; Chris Noth also signed on to reprise the role of Mr. Big.", "Evan Handler returned as Harry Goldenblatt, John Corbett as Aiden Shaw, David Eigenberg played Steve Brady once more, Willie Garson returned as Stanford Blatch, and Mario Cantone again played Anthony Marentino, making the original cast almost complete.", "In addition, Michael Patrick King wrote and directed again, and Patricia Field once again took charge of the costumes and wardrobe.", "Hats were once again created by Prudence Millinery for Vivienne Westwood.", "\"Entertainment Weekly\" confirmed that the budget for the film was US$95 million, exactly $30 million greater than the budget for the first film.", "Sarah Jessica Parker was paid 15 million plus residuals for her dual role as a producer and starring as Carrie Bradshaw.", "Filming in New York City was postponed to the end of July as Emirati authorities refused clearance for filming in the United Arab Emirates.", "As a result, the Abu Dhabi segment of the film was filmed in Morocco." ], [ "Mr. Big (Sex and the City)", "Mr. Big (Sex and the City)\n\nJohn James \"Mr. Big\" Preston is a recurring character in the HBO series \"Sex and the City\", portrayed by Chris Noth.", "He is the primary on-and-off love interest of the series' protagonist, Carrie Bradshaw, who usually simply refers to him as \"Big\".", "According to accounts in the press, the Mr. Big character was based on publishing executive Ron Galotti, former publisher of \"GQ\" and \"Talk\".", "Bushnell told \"New York Magazine\" in 2004, \"He was one of those New York guys with a big personality\u2014you just notice him as soon as he walks in the room,\" and \"I called him Mr. Big because he was like a big man on campus.\"", "Big appeared in Comcast's list of TV's Most Intriguing Characters.", "\"Big\" appears in the first episode of \"Sex and the City\" as a very attractive stranger who helps Carrie pick up the contents of her purse (notably cosmetics and condoms) after she is accidentally bumped by a stranger on the streets of Manhattan.", "The nickname \"Big\" refers to his status as a \"major tycoon, major dreamboat, and majorly out of [Carrie's] league,\" according to the show's dialogue." ] ], "gold": "Chris Noth played Mr. Big on the television series Sex and the City, which originally aired from 1998 to 2004. Noth then reprised his role as Mr. Big in the 2008 film Sex and the City, a continuation of the television series, and the film's 2012 sequel, Sex and the City 2. In 2021, Noth reprised his role as Mr. Big in And Just Like That..., the Sex and the City television series reboot premiering on HBO Max in the fall of 2021.", "prediction 1": "John James \"Mr. Big\" Preston is a recurring character in the HBO series Sex and the City, played by Chris Noth. He is the primary on-and-off love interest of the series' protagonist, Carrie Bradshaw, who usually simply refers to him as \"Big\".", "prediction 2": "Mr. Big is a recurring character in the HBO series Sex and the City. The character is played by Chris Noth in Sex and the City 2, as well as the 2008 film Sex and the City 2, which is the sequel to the 2008 film, and is based on the 1998\u20132004 HBO series of the same name. Chris Noth played Mr. Big in the 2010 film and in the 2012 movie.", "prediction 3": "John James \"Mr. Big\" Preston is the recurring character in the HBO series Sex and the City. He is the primary on-and-off love interest of the show's protagonist, Carrie Bradshaw, who usually simply refers to him as \"Big\". Chris Noth played Mr. Big in the first two seasons of the series.", "prediction 4": "Mr. Big is a character on the HBO series Sex and the City. In the 2010 movie, Chris Noth plays the character. In the 2008 film, John James Preston plays Mr. Big. In the 2010 film, Jennifer Bushnell plays Mr. Big.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 53 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 242 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "John James \"Mr. Big\" Preston, in the HBO series Sex and the City, is played by Chris Noth. The show ran from 1998\u20132004 and has a 2008 film \"Sex and the City\". There is also a 2010 sequel, Sex and the City 2, Chris Noth reprises his role in the films. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who recorded this guys in love with you?", "passages": [ [ "This Guy's in Love with You", "This Guy's in Love with You\n\n\"This Guy's in Love with You\" is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert.", "Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach.", "As documented in a Biography cable episode featuring Bacharach, the recording originated when Alpert, while visiting at Bacharach's office, asked, \"Say, Burt, do you happen to have any old compositions lying around that you and Hal never recorded; maybe one I might be able to use?\"", "Alpert said he made it his practice to ask songwriters that particular question: often a \"lost pearl\" was revealed.", "As it happened, Bacharach recalled one, found the lyrics and score sheet in his office filing cabinet, and offered it to Alpert: \"Here, Herb ... you might like this one.\"", "Alpert saw the possibilities in the composition for recording it himself.", "The composition had a recognizable Bacharach-David feel, a spot for a signature horn solo in the bridge and in the fadeout, and it was an easy song to sing within Alpert's vocal range." ] ], "gold": "\"This Guy's in Love with You\" is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach. An earlier recording of the song was by British singer Danny Williams titled \"That Guy's in Love\", which appears on his 1968 self-titled album.", "prediction 1": "This Guy's in Love with You is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach. The composition had a recognizable Bacharach-David feel, a spot for a signature horn solo in the bridge and in the fadeout, and it was an easy song to sing within Alpert's vocal range.", "prediction 2": "This Guy's in Love with You is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach. The recording originated when Alpert, while visiting at Bacharach's office, asked, \"Say, Burt, do you happen to have any old compositions lying around that you and Hal never recorded; maybe one I might be able to use?\"", "prediction 3": "\"This Guy's in Love with You\" is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach.", "prediction 4": "This Guy's in Love with You is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 448 } ], "missing-info": [], "corrected-prediction": "This Guy's in Love with You is a song written by Burt Bacharach and Hal David, and recorded by Herb Alpert. Although known primarily for his trumpet playing as the leader of the Tijuana Brass, Alpert sang lead vocals on this solo recording, arranged by Bacharach. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When was the first home pregnancy test invented?", "passages": [ [ "Pregnancy test", "This was a first step away from in-vivo pregnancy testing and initiated a series of improvements in pregnancy testing leading to the contemporary at-home testing.", "Direct measurement of antigens, such as hCG, was made possible after the invention of the radioimmunoassay in 1959.", "Radioimmunoassays require sophisticated apparatus and special radiation precautions and are expensive.", "Organon International obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype.", "The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor.", "Another home pregnancy testing kit was based on the work of Judith Vaitukaitis and Glenn Braunstein, who developed a sensitive hCG assay at the National Institutes of Health.", "That test went onto the market in 1978.", "In the 1970s, the discovery of monoclonal antibodies led to the development of the relatively simple and cheap immunoassays, such as agglutination-inhibition-based assays and sandwich ELISA, used in modern home pregnancy tests.", "Tests are now so cheap that they can be mass-produced in a general publication and used for advertising." ] ], "gold": "Organon International obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor.", "prediction 1": "The first home pregnancy test was invented in 1969 by Organon International. Organon obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor. Another home pregnancy testing kit was based on the work of Judith Vaituka sensitive hCG assay at the National Institutes of Health.", "prediction 2": "Organon International obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor. It was based on the work of Judith Vaitukaitis and Glenn Braunstein, who developed a sensitive hCG assay at the National Institutes of Health. The test went onto the market in 1978.", "prediction 3": "Organon International obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype of the product. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor. Another home pregnancy testing kit was based on the work of Judith Vaitukaitis and Glenn Braunstein, who developed a sensitive hCG assay at the National Institutes of Health. The test went onto the market in 1978.", "prediction 4": "The first home pregnancy test was invented in 1969 by Organon International. Organon obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor. Another home pregnancy testing kit was based on the work of Judith Vaituka sensitive hCG assay at the National Institutes of Health and went onto the market in 1978.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The first home pregnancy test was invented in 1969 by Organon International. ", "start": 77, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 500, "end": 632 } ], "missing-info": [], "corrected-prediction": "Organon obtained the first patent on a home pregnancy test in 1969, two years after product designer Margaret Crane noticed that the laboratory testing procedure was relatively simple and made a prototype. The product became available in Canada in 1971, and the United States in 1977, after delays caused by concerns over sexual morality and the ability of women to perform test and cope with the results without a doctor. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "When did the red river rebellion start and end?", "passages": [ [ "Red River Rebellion", "Red River Rebellion\n\nThe Red River Resistance (or the Red River Rebellion, Red River uprising, or First Riel Rebellion) was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba.", "For a period it had been a territory called Rupert's Land under control of the Hudson's Bay Company.", "The Resistance was the first crisis of the new federal government faced following Canadian Confederation in 1867.", "The Canadian government had bought Rupert's Land from the Hudson's Bay Company in 1869 and appointed an English-speaking governor, William McDougall.", "He was opposed by the French-speaking, mostly M\u00e9tis inhabitants of the settlement.", "Before the land was officially transferred to Canada, McDougall sent out surveyors to plot the land according to the square township system used in Ontario.", "The M\u00e9tis, led by Riel, prevented McDougall from entering the territory.", "McDougall declared that the Hudson's Bay Company was no longer in control of the territory and that Canada had asked for the transfer of sovereignty to be postponed.", "The M\u00e9tis created a provisional government, to which they invited an equal number of Anglophone representatives.", "Riel negotiated directly with the Canadian government to establish Manitoba as a province." ], [ "Red River Rebellion", "Meanwhile, Riel's men arrested members of a pro-Canadian faction who had resisted the provisional government.", "They included an Orangeman named Thomas Scott.", "Riel's government tried and convicted Scott, and executed him for threatening to murder Louis Riel.", "Canada and the Assiniboia provisional government soon negotiated an agreement.", "In 1870, the national legislature passed the Manitoba Act, allowing the Red River Colony to enter Confederation as the province of Manitoba.", "The Act also incorporated some of Riel's demands, such as the provision of separate French schools for M\u00e9tis children and protection for the practice of Catholicism.", "After reaching an agreement, Canada sent a military expedition to Manitoba to enforce federal authority.", "Now known as the Wolseley Expedition (or Red River Expedition), it consisted of Canadian militia and British regular soldiers led by Colonel Garnet Wolseley.", "Outrage grew in Ontario over Scott's execution, and many eastern folks demanded that Wolseley's expedition arrest Riel for murder and suppress what they considered to be rebellion.", "Riel peacefully withdrew from Fort Garry the day the troops arrived.", "Warned by many that the soldiers would harm him, and denied amnesty for his political leadership of the rebellion, Riel fled to the United States.", "The arrival of troops marked the end of the Rebellion.", "During the late 1860s, the Red River Colony of Rupert's Land was changing rapidly." ] ], "gold": "The Red River Rebellion, also known as the Red River Resistance, Red River uprising, or First Riel Rebellion, was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what was the early stages of establishing today's Canadian province of Manitoba. Riel peacefully withdrew from Fort Garry before the troops could arrive in August 1870. Warned by many that the soldiers would harm him and denied amnesty for his political leadership of the rebellion, Riel fled to the United States. The arrival of troops marked the end of the incident.", "prediction 1": "The Red River Rebellion, Red River uprising, or First Riel Rebellion, was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba. The Red River Resistance was the first crisis of the new federal government faced following Canadian Confederation in 1867.", "prediction 2": "The Red River Resistance was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba. The Red River Rebellion started on May 10, 1861, and ended on April 5, 1865.", "prediction 3": "The Red River Rebellion, Red River uprising, or First Riel Rebellion, was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba. The Resistance was the first crisis of the new federal government faced following Canadian Confederation in 1867. The Red River Riel Rebellion started on August 4, 1869.", "prediction 4": "The Red River Rebellion was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba. In the mid-1800s, the Red River Rebellion had begun in 1855 and ended in 1869. In the late 1860s, the Red River Colony was changing rapidly. Riel peacefully withdrew from Fort Garry the day the troops arrived. However, after the expedition arrested Riel and executed Scott for threatening to murder. The Canadian government eventually reached an agreement. In 1870, Canada sent a military expedition to enforce federal authority. The arrival of troops marked the end of the Rebellion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 410 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 12 ] } ], "corrected-prediction": "The Red River Rebellion, Red River uprising, or First Riel Rebellion, was the sequence of events that led up to the 1869 establishment of a provisional government by the M\u00e9tis leader Louis Riel and his followers at the Red River Colony, in what is now the Canadian province of Manitoba. Riel peacefully withdrew from Fort Garry the day the troops arrived. Warned by many that the soldiers would harm him, and denied amnesty for his political leadership of the rebellion, Riel fled to the United States. The arrival of troops marked the end of the Rebellion." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "The youngest player to play in the nba?", "passages": [ [ "Nat Hickey", "Nat Hickey\n\nMatthew J. \"Nat\" Hickey (January 30, 1902 \u2013 September 16, 1979) was an American professional basketball coach/player and baseball player.", "He turned to coaching basketball after his retirement from playing in 1942, but returned to play two games with the Providence Steamrollers of the Basketball Association of America while serving as the team's coach in 1948.", "Aged 45 years old at the time of his two appearances, Hickey holds the record for the oldest player in NBA history.", "As a 5'11\" guard/forward, Hickey played from the 1920s through 1940s with multiple early professional teams, including the Hoboken St. Joseph's, Eddie Holly's Majors, New York Crescents, Eddie Holly's Majors, Cleveland Rosenblums, the Chicago Bruins, Boston Trojans, Original Celtics of the American Basketball League and the Pittsburgh Raiders, Indianapolis Kautskys, and Tri-Cities Blackhawks of the National Basketball League.", "In the second year after the formation of the Basketball Association of America (the forerunner to the NBA), Hickey served 29 games as head coach of the Providence Steamrollers during the 1947\u201348 season.", "Hickey's team posted a 4\u201325 record during his tenure.", "He activated himself as a player on January 27, 1948, three days before his 46th birthday, and appeared in two games." ], [ "Andrew Bynum", "Andrew Bynum\n\nAndrew Bynum (born October 27, 1987) is an American former professional basketball player.", "He played the majority of his career with the Los Angeles Lakers of the National Basketball Association (NBA).", "After they selected him in the first round of the 2005 NBA draft with the 10th overall pick, the center won two NBA championships with the team in 2009 and 2010.", "He was named an All-Star and selected to the All-NBA team in 2012.", "Bynum was an All-American player in high school before he decided to forgo college and enter the NBA.", "He became the youngest player ever to play in an NBA game.", "After seven seasons with the Lakers, he was traded to the Philadelphia 76ers in 2012 as part of a four-team deal that sent All-Star center Dwight Howard to Los Angeles.", "Bynum missed the entire 2012\u201313 season because of knee problems.", "He signed as a free agent with the Cleveland Cavaliers, where he briefly played before being traded to the Chicago Bulls, who subsequently released him.", "He then signed with the Indiana Pacers for the remainder of the 2013\u201314 season.", "Bynum was born in Plainsboro Township, New Jersey.", "His parents, Ernest Bynum and Janet McCoy, divorced when he was a one year old.", "He spent summers visiting his father in North Carolina.", "Bynum has one older brother, Corey." ], [ "NBA high school draftees", "In the early years of the NBA draft, a player had to finish his four-year college eligibility to be eligible for selection.", "Reggie Harding, who had graduated from high school but did not enroll in a college, became the first player drafted out of high school when the Detroit Pistons selected him in the fourth round of the 1962 draft.", "However, the NBA rules at that time prohibited a high school player to play in the league until one year after his high school class graduated.", "Thus, he spent a year playing in a minor basketball league before he was drafted again in the 1963 draft by the Pistons.", "He finally entered the league in the 1963\u201364 season and played four seasons in the NBA and American Basketball Association (ABA).", "In 1971, the U.S. Supreme Court decision \"Haywood v. National Basketball Association\" ruled, 7\u20132 against the National Basketball Association's requirement that a player must wait four years after high school graduation (which in most cases was spent playing in college) before turning professional.", "This ruling allowed players to enter the NBA Draft without four years of college, provided they could give evidence of hardship to the NBA office.", "In 1974, the NBA's rival, the ABA, drafted high school star Moses Malone.", "He was immediately signed by the Utah Stars and became the first player to go directly from high school basketball to a professional league." ] ], "gold": "The youngest player ever to play in the NBA was Andrew Bynum, who played his first game only six days after his 18th birthday. The youngest player to play in the NBA as of October 20, 2017 was Ike Anigbogu, who was selected by the Indiana Pacers in the second round of the 2017 NBA draft with the 47th overall pick and made his NBA debut on October 20, 2017, playing two minutes in a 114\u201396 loss to the Portland Trail Blazers at just 18 years old. The youngest player in the NBA as of October 26, 2016, was Croatian player Dragan Bender, who was selected by the Phoenix Suns with the fourth overall pick in the 2016 NBA draft. The youngest player in the NBA as of October 28, 2015 was Phoenix Suns player Devin Booker, who entered the NBA at 18 years old, and went on to become the youngest player to score over 60 points in a game in March 2017, and also became the youngest player with consecutive 50-point games in March 2019.", "prediction 1": "Matthew J. \"Nat\" Hickey was an American professional basketball player and coach, who turned to coaching basketball after his retirement from playing in 1942, but returned to play two games with the Providence Steamrollers of the Basketball Association of America while serving as the team's coach in 1948. Andrew Bynum was an American former professional basketball player. He played the majority of his career with the Los Angeles Lakers of the National Basketball Association (NBA). After they selected him in the first round of the 2005 NBA draft with the 10th overall pick, Bynum became the youngest player ever to play in an NBA game. He became the youngest player ever to play in an NBA game. Bynum was an All-American player in high school before he decided to forgo college and enter the NBA.", "prediction 2": "Nat Hickey was an American professional basketball coach/player and baseball player. He turned to coaching basketball after his retirement from playing in 1942, but returned to play two games with the Providence Steamrollers of the Basketball Association of America while serving as the team's coach in 1948. Andrew Bynum, who was an All-American player in high school before he decided to forgo college and enter the NBA, was the youngest player ever to play in an NBA game.", "prediction 3": "The youngest player to play in an NBA game is Andrew Bynum, who played his first professional game on January 27, 1948, three days before his 46th birthday. Bynum was an All-American player in high school before he decided to forgo college and enter the NBA, becoming the youngest player ever to play in an NBA game. In the early years of the NBA draft, a player had to finish his four-year college eligibility to be eligible for selection. Reggie Harding, who had graduated from high school but did not enroll in a high school player to enter the league. However, the NBA rules at that time prohibited a high school player to play in the league until one year after his high school class graduated. This ruling allowed players to enter the league in the 1963, the 1963\u201364 season, played four seasons in the NBA and the ABA.", "prediction 4": "In the modern era, the NBA required players to finish their four-year college eligibility before entering the professional ranks. In the early years of the NBA draft, the rules at that time prohibited a high school player to play in the league until one year after his high school class graduated. Reggie Harding became the first player drafted out of high school and played in the league in the fourth round of the 1962 draft. However, the NBA rules at that time prohibited a high school player to play in the league until one year after his high school graduation. In 1974, the drafted high school star Moses Malone. He was the first to go directly from high school basketball to a professional league.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 485 }, { "error type": "Redundant", "explanation": "Matthew J. \"Nat\" Hickey was an American professional basketball player and coach, who turned to coaching basketball after his retirement from playing in 1942, but returned to play two games with the Providence Steamrollers of the Basketball Association of America while serving as the team's coach in 1948. Andrew Bynum was an American former professional basketball player. He played the majority of his career with the Los Angeles Lakers of the National Basketball Association (NBA). After they selected him in the first round of the 2005 NBA draft with the 10th overall pick, Bynum became the youngest player ever to play in an NBA game. ", "start": 641, "end": 699 }, { "error type": "Irrelevant", "explanation": "", "start": 700, "end": 801 }, { "error type": "Irrelevant", "explanation": "", "start": 486, "end": 578 } ], "missing-info": [], "corrected-prediction": "Andrew Bynum was an American former professional basketball player. Bynum became the youngest player ever to play in an NBA game. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where did the christian fish symbol come from?", "passages": [ [ "Ichthys", "Ichthys\n\nThe ichthys or ichthus (), from the Greek \"ikhth\u00fds\" ( 1st cent.", "AD Koine Greek , \"fish\") is a symbol consisting of two intersecting arcs, the ends of the right side extending beyond the meeting point so as to resemble the profile of a fish.", "The symbol was adopted by early Christians as a secret symbol.", "It is now known colloquially as the \"sign of the fish\" or the \"Jesus fish\".", "The first appearances of the ichthys symbol in Christian art and literature date to the 2nd century AD.", "The symbol's use among Christians had become popular by the late 2nd century, and its use spread widely in the 3rd and 4th centuries.", "The symbolism of the fish itself may have its origins in pre-Christian religious imagery.", "For example, Orpheus was described as a \"fisher of men\" as early as the 3rd or fourth century BC.", "The fish was used as a symbol in a number of other near-eastern religions as well, often as a sacred (or taboo) food.", "The fish was sacred to the goddess Atargatis, for example, who was said to cause tumors in those who ate them.", "Fish were only allowed to be eaten by priests during rituals devoted to Atargatis, in the belief that they represented her body." ], [ "Ichthys", "Despite the thematic similarities of these various sacred fish, some scholars have argued that there is no direct link between them and the Christian symbol or practice of the Eucharist; instead, the Christian usage was probably simply part of a larger, popular religious motif of the time.", "In the early Church, the Ichthys symbol held \"the most sacred significance\", and Christians used it to recognize churches and other believers through this symbol because they were persecuted by the Roman Empire.", "The Ichthys symbol is also a reference to \"the Holy Eucharist, with which the miracle of the multiplication of the loaves and fishes had such intimate connection both in point of time and significance.\"", "While many Christians hang a cross necklace or rosary inside their vehicles, \"the fish sticker on the car is a more conscious symbol of a witnessing Christian\u2014significantly, unlike the former, it is on the outside of the car for everyone to see\".", "(), or also with a lunate sigma, is an acronym or acrostic for \"\" (; contemporary Koine ), which translates into English as 'Jesus Christ, Son of God, Saviour'.", "This explanation is given among others by Augustine in his Civitate Dei, where he notes that the generating sentence \"\" has 27 letters, i.e. 3 x 3 x 3, which in that age indicated power." ] ], "gold": "The Ichthus, or \"Christian Fish\", is a Greek symbol of two intersecting arcs connecting to resemble a fish. It was a symbol adopted by early Christians as a secret symbol, signifying the miracle of the multiplication of the loaves and fishes. The symbol is also an acronym or acrostic, which translates into English as 'Jesus Christ, Son of God, Savior'.", "prediction 1": "The symbol of the fish was used as a symbol in Christian art and literature since the 2nd century AD. It is now known colloquially as the sign of the fish or the Jesus fish.", "prediction 2": "The first appearances of the ichthys symbol in Christian art and literature date to the 2nd century AD. It is now known colloquially as the \"sign of the fish\" or the \"Jesus fish\".", "prediction 3": "The Christian fish symbol is a symbol consisting of two intersecting arcs, the ends of the right side extending beyond the meeting point so as to resemble the profile of a fish. The symbol was adopted by early Christians as a secret symbol. It is now known colloquially as the \"sign of the fish\" or the \"Jesus fish\".", "prediction 4": "The christian fish symbol comes from a symbol consisting of two intersecting arcs, the ends of the right side extending beyond the meeting point so as to resemble the profile of a fish. The symbol was adopted by early Christians as a secret symbol. It is now known colloquially as the \"sign of the fish\" or the \"Jesus fish\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 101 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 173 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Ichthus, or \"Christian Fish\", is a Greek symbol of two intersecting arcs connecting to resemble a fish. It was a symbol adopted by early Christians as a secret symbol. The symbol is also an acronym or acrostic, which translates into English as 'Jesus Christ, Son of God, Savior'." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "When was the emancipation proclamation signed into law?", "passages": [ [ "Emancipation Proclamation", "The Proclamation applied only to slaves in Confederate-held lands; it did not apply to those in the four slave states that were not in rebellion (Kentucky, Maryland, Delaware, and Missouri, which were unnamed), nor to Tennessee (unnamed but occupied by Union troops since 1862) and lower Louisiana (also under occupation), and specifically excluded those counties of Virginia soon to form the state of West Virginia.", "Also specifically excluded (by name) were some regions already controlled by the Union army.", "Emancipation in those places would come after separate state actions or the December 1865 ratification of the Thirteenth Amendment, which made slavery and indentured servitude, except for those duly convicted of a crime, illegal everywhere subject to United States jurisdiction.", "On September 22, 1862, Lincoln issued a preliminary warning that he would order the emancipation of all slaves in any state that did not end its rebellion against the Union by January 1, 1863.", "None of the Confederate states restored themselves to the Union, and Lincoln's order was signed and took effect on January 1, 1863.", "The Emancipation Proclamation outraged white Southerners (and their sympathizers) who envisioned a race war.", "It angered some Northern Democrats, energized anti-slavery forces, and undermined elements in Europe that wanted to intervene to help the Confederacy.", "The Proclamation lifted the spirits of African Americans both free and slave." ], [ "Second Emancipation Proclamation", "On June 6, 1961, King announced this idea during a New York news conference, saying \"Just as Abraham Lincoln had the vision to see almost 100 years ago that this nation could not exist half-free, the present administration must have the insight to see that today the nation cannot exist half-segregated and half-free.\"", "Jones and a team of legal scholars (which would include members of the Gandhi Society for Human Rights) began to prepare the proposal, while King continued to publicize the idea.", "During a tour of the Lincoln Sitting Room with Kennedy in October 1961, King pressed Kennedy for a proclamation \"outlawing segregation.\"", "Kennedy said he would take it under consideration and asked King for a draft of the proposal.", "Two months afterward King, while campaigning against segregation in Albany, GA. sent the President a personal telegram urging him to take action.", "National newspapers took up the story and a debate began over whether such an executive order would be legal outside of wartime.", "On March 24, 1962, King announced that he had been invited by President Kennedy to submit for the President's signature a \"second Emancipation Proclamation\".", "King and his legal staff declared that they would have the document ready on May 17, 1962, the eighth anniversary of the decision of \"Brown v. Board of Education\"." ], [ "Second Emancipation Proclamation", "King proposed \"in glorious commemoration of the Centennial of the Emancipation Proclamation\" that the President use \"the full powers of your office...to eliminate all forms of statutory-imposed segregation and discrimination\" to declare all school districts to desegregate by September 1963 with \"the Department of Health, Education and Welfare to immediately prepare, in consultation with local school officials, a program of integration in compliance with the mandate of \"Brown v. Board of Education\".\"", "To prohibit racial segregation in federally assisted housing.", "To announce \"That any and all laws within the United States requiring segregation or discrimination because of race or color are contrary to the national policy of the Government of the United States and are detrimental and inimical to the best interest of the United States at home and abroad.\"", "The document went on to cite legal precedents by the hundreds, making special note of Harry S. Truman's military desegregation order of 1948.", "Kennedy did not take the opportunity to issue a second Emancipation Proclamation \"and noticeably avoided all centennial celebrations of emancipation.\"", "In November 1962, Kennedy did issue Executive Order 11063, prohibiting racial discrimination in federally supported housing or \"related facilities\", and months afterwards introduced an omnibus civil rights bill to Congress after his civil rights address on national television and radio." ] ], "gold": "On September 22, 1862, Lincoln issued a preliminary warning that he would order the emancipation of all slaves in any state that did not end its rebellion against the Union by January 1, 1863. None of the Confederate states did so, and Lincoln's order was signed and took effect on January 1, 1863. On March 24, 1962, King announced that he had been invited by President Kennedy to submit a \"second Emancipation Proclamation\" for the President's signature, which would use the executive office's powers to strike a severe blow to segregation. However, Kennedy did not issue a second Emancipation Proclamation and instead issued Executive Order 11063, prohibiting racial discrimination in federally supported housing or \"related facilities,\" and months afterward introduced an omnibus civil rights bill to Congress after his civil rights address on national television and radio.", "prediction 1": "The Emancipation Proclamation was signed into law on January 1, 1863. It applied only to slaves in Confederate-held lands, and did not apply to those in the four slave states that were not in rebellion. On June 6, 1961, King announced that he had been invited by President Kennedy to submit for the President's signature a \"second Emancipation Proclamation.\" King and his legal staff declared that they would have the document ready on May 17, 1962, the eighth anniversary of the decision of Brown v. Board of Education.", "prediction 2": "The Emancipation Proclamation only applied to slaves in Confederate-held lands. It did not apply to those in the four slave states that were not in rebellion (Kentucky, Maryland, Delaware, and Missouri, which were unnamed), nor to Tennessee (unnamed but occupied by Union troops since 1862) and lower Louisiana (also under occupation). It also specifically excluded those counties of Virginia soon to form the state of West Virginia. On June 6, 1961, King announced that he had been invited by President Kennedy to submit for the President a \"second Emancipation Proclamation\". King and his legal staff declared that they would have the document ready on May 17, 1962, the eighth anniversary of the decision of Brown v. Board of Education.", "prediction 3": "The Emancipation Proclamation applied only to slaves in Confederate-held lands; it did not apply to those in the four slave states that were not in rebellion, or to Tennessee, the state occupied by Union troops since 1865, or lower Louisiana. The Emancipation Proclamation outraged white Southerners who envisioned a race war. In March 1962, King announced that he had been invited by President Kennedy to submit for the President's signature a \"second Emancipation Proclamation\". King and his legal staff declared that they would have the document ready on May 17, 1962, the eighth anniversary of the decision of Brown v.", "prediction 4": "The Emancipation Proclamation was signed into law on January 1, 1863. In June 1961, Dr. Martin Luther King, Jr. announced that he had been invited by President John F. Kennedy to submit for the President's signature a second Emancipation Proclamation. King and his legal staff declared that they would have the document ready on May 17, 1962, the eighth anniversary of the decision of Brown v. Board of Education. Kennedy did not take the opportunity to issue a second Emancipation Proclamation Proclamation Proclamation.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 203, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 520 }, { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 202 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "On September 22, 1862, Lincoln issued a preliminary warning that he would order the emancipation of all slaves in any state that did not end its rebellion against the Union by January 1, 1863. None of the Confederate states did so, and The Emancipation Proclamation was signed into law on January 1, 1863. On March 24, 1962 King announced that he had been invited by President Kennedy to submit for the President's signature a \"second Emancipation Proclamation.\" to use \"the full powers of your office...to eliminate all forms of statutory-imposed segregation and discrimination\". However, Kennedy did not issue a second Emancipation Proclamation and instead issued Executive Order 11063, prohibiting racial discrimination in federally supported housing or \"related facilities,\" and months afterward introduced an omnibus civil rights bill to Congress after his civil rights address on national television and radio." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "The most common word in the english language?", "passages": [ [ "Most common words in English", "For example, \"I\" may be a pronoun or a Roman numeral; \"to\" may be a preposition or an infinitive marker; \"time\" may be a noun or a verb.", "Also, a single spelling can represent more than one root word.", "For example, \"singer\" may be a form of either \"sing\" or \"singe\".", "Different corpora may treat such difference differently.", "The table also includes frequencies from other corpora, note that as well as usage differences, lemmatisation may differ from corpus to corpus - for example splitting the prepositional use of \"to\" from the use as a particle.", "Also the COCA list includes dispersion as well as frequency to calculate rank.", "The following is the same list subdivided by part of speech.", "The list labeled \"Others\" includes pronouns, possessives, articles, modal verbs, adverbs, and conjunctions." ], [ "Most common words in English", "Most common words in English\n\nStudies that estimate and rank the most common words in English examine texts written in English.", "Perhaps the most comprehensive such analysis is one that was conducted against the Oxford English Corpus (OEC), a very large collection of texts from around the world that are written in the English language.", "A \"text corpus\" is a large collection of written works that are organised in a way that makes such analysis easier.", "In total, the texts in the Oxford English Corpus contain more than 2 billion words.", "The OEC includes a wide variety of writing samples, such as literary works, novels, academic journals, newspapers, magazines, Hansard's Parliamentary Debates, blogs, chat logs, and emails.", "Another English corpus that has been used to study word frequency is the Brown Corpus, which was compiled by researchers at Brown University in the 1960s.", "The researchers published their analysis of the Brown Corpus in 1967.", "Their findings were similar, but not identical, to the findings of the OEC analysis.", "According to \"The Reading Teacher's Book of Lists\", the first 25 words in the OEC make up about one-third of all printed material in English, and the first 100 words make up about half of all written English." ], [ "OK", "OK\n\n\"OK\" (spelling variations include \"okay\", \"O.K. \", \"ok\") is an English word denoting approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference.", "\"OK\" is frequently used as a loanword in other languages.", "It has been described as the most frequently spoken or written word on the planet.", "The origins of the word are disputed.", "As an adjective, \"OK\" principally means \"adequate\" or \"acceptable\" as a contrast to \"bad\" (\"The boss approved this, so it is OK to send out\"); it can also mean \"mediocre\" when used in contrast with \"good\" (\"The french fries were great, but the burger was just OK\").", "It fulfills a similar role as an adverb (\"Wow, you did OK for your first time skiing!\").", "As an interjection, it can denote compliance (\"OK, I will do that\"), or agreement (\"OK, that is fine\").", "It can mean \"assent\" when it is used as a noun (\"the boss gave her the OK to the purchase\") or, more colloquially, as a verb (\"the boss OKed the purchase\")." ] ], "gold": "Studies that estimate and rank the most common words in English examine texts written in English. The most common of all words in the English language is \"the\". The most common noun is \"time\" and the most common verb is \"be\". The most common adjective is \"good\" and the most common preposition is \"to\".", "prediction 1": "The most common word in the english language is \"OK\". \"OK\" is an English word denoting approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference. \"OK\" is frequently used as a loanword in other languages. The origins of the word are disputed. \"OK\" is often used as an adjective.", "prediction 2": "The most common word in the english language is OK, which is used to denote approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference. The most common word in the english language is OK, which is used to denote acceptance, agreement, assent, acknowledgment, or a sign of indifference. The most common word in the english language is OK, which is used to denote approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference.", "prediction 3": "The most common word in the English language is OK, which is a word denoting approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference. The Oxford English Corpus is a very large collection of texts from around the world that are written in the English language. Studies that estimate and rank the most common words in English examine texts written in English.", "prediction 4": "The most common word in the English language is OK. The word OK is used to define approval, acceptance, agreement, assent, acknowledgment, or a sign of indifference. Another corpus that has been used to study word frequency is the Brown Corpus, which was compiled by researchers at Brown University in the 1960s. Another English corpus that has been used to study word frequency is the Oxford English Corpus (OEC), a very large collection of texts from around the world that are written in the English language.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 302 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Studies that estimate and rank the most common words in English examine texts written in English. The most common word in the english language is \"OK\". " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was the parliament formed in the uk?", "passages": [ [ "Parliament of the United Kingdom", "The Royal and Parliamentary Titles Act 1927 formally amended the name to the \"Parliament of the United Kingdom of Great Britain and Northern Ireland\", five years after the secession of the Irish Free State in 1922.", "With the global expansion of the British Empire, the UK Parliament has shaped the political systems of many countries as ex-colonies and so it has been called the \"Mother of Parliaments\".", "However, John Brightwho coined the epithetused it in reference to the political culture of \"England\" rather than just the parliamentary system.", "In theory, the UK's supreme legislative power is officially vested in the Crown-in-Parliament.", "However, the Crown normally acts on the advice of the Prime Minister and the powers of the House of Lords are limited to only delaying legislation; thus power is \"de facto\" vested in the House of Commons.", "The United Kingdom of Great Britain and Ireland was created on 1 January 1801, by the merger of the Kingdoms of Great Britain and Ireland under the Acts of Union 1800.", "The principle of ministerial responsibility to the lower House did not develop until the 19th century\u2014the House of Lords was superior to the House of Commons both in theory and in practice.", "Members of the House of Commons (MPs) were elected in an antiquated electoral system, under which constituencies of vastly different sizes existed." ] ], "gold": "The parliament formed in the UK was initially called Parliament of the United Kingdom of Great Britain and Ireland but the Royal and Parliamentary Titles Act 1927 formally amended the name to the \"Parliament of the United Kingdom of Great Britain and Northern Ireland\", five years after the secession of the Irish Free State. Parliament of the United Kingdom of Great Britain and Ireland was created on 1 January 1801, while the parliament formed in the United Kingdom of Great Britain and Northern Ireland was created on 11 November 1920. ", "prediction 1": "The United Kingdom of Great Britain and Ireland was created on 1 January 1801, by the merger of the Kingdoms of Great Britain and Ireland under the Acts of Union 1800. On 1 January 1801 the parliament was formed in London.", "prediction 2": "The United Kingdom Parliament was formed on 1 January 1801, by the merger of the Kingdoms of Great Britain and Ireland under the Acts of Union 1800. In 1927, the Royal and Parliamentary Titles Act changed the name of the Parliament to the Parliament of the United Kingdom of Great Britain and Northern Ireland.", "prediction 3": "The first UK parliament was formed on 1 January 1801, by the merger of the Kingdoms of Great Britain and Ireland under the Acts of Union 1800.", "prediction 4": "The Parliament of the United Kingdom was formed in England on 1 January 1801, by the merger of the Kingdoms of Great Britain and Ireland under the Acts of Union 1800. The Royal and Parliamentary Titles Act 1927 formally amended the name to the \"Parliament of the United Kingdom of Great Britain and Northern Ireland\", five years after the secession of the Irish Free State in 1922.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 168, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 167 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": " The Royal and Parliamentary Titles Act 1927 formally amended the name to the \"Parliament of the United Kingdom of Great Britain and Northern Ireland\", five years after the secession of the Irish Free State. Parliament of the United Kingdom of Great Britain and Ireland was created on 1 January 1801." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was the last time the brewers went to the playoffs?", "passages": [ [ "Milwaukee Brewers", "They were put in the then recently created NL Central.", "In 2008, for the first time in the 26\u00a0years since their World Series appearance, the Brewers advanced to postseason play by winning the National League wild card.", "They were eliminated in the National League Division Series by the eventual World Series champion Philadelphia Phillies.", "On September 23, 2011, the Milwaukee Brewers clinched their first division title in 29\u00a0years.", "They won the National League Division Series in five games over the Arizona Diamondbacks, but lost the National League Championship Series to the eventual World Series champion St. Louis Cardinals in six games.", "In 2018, the Brewers clinched a spot in the post-season for the first time since 2011 with a 2\u20131 victory over the St. Louis Cardinals on September 26, 2018.", "On September 29, they tied with the Cubs for first place in the National League Central, with a record of 95\u201367; at the end of the day on September 30, the Cubs and Brewers were still tied.", "This tie was broken on October 1st, when the Brewers defeated the Cubs 3\u20131 in the NL Central tiebreaker to improve to 96\u201367 and win the division by one game.", "They went on to defeat the Colorado Rockies 3\u20130 to win the NLDS, but in the following NLCS, they lost out to the Los Angeles Dodgers in 7 games." ], [ "2018 Milwaukee Brewers season", "2018 Milwaukee Brewers season\n\nThe 2018 Milwaukee Brewers season was the 49th season for the Brewers in Milwaukee, the 21st in the National League, and 50th overall.", "On September 26, the Brewers clinched a playoff berth for the first time since 2011.", "They defeated the Chicago Cubs in the 2018 National League Central tie-breaker game on October 1 to win their first division title since 2011.", "They swept the Colorado Rockies in the Division Series to advance to the National League Championship Series, where they lost in seven games to the Los Angeles Dodgers." ], [ "Milwaukee Brewers", "Originating as an expansion team in 1969, in Seattle, Washington, as the Seattle Pilots, the club played for one season in the American League West Division before being acquired in bankruptcy court by Bud Selig, who then moved the team to Milwaukee.", "They would continue to play in the West Division for two more years.", "Before the beginning of the 1972 season the Brewers agreed to switch over to the American League East to make room for the Texas Rangers who had relocated from Washington.", "Beginning in 1994, due to divisional re-alignment, the Brewers moved to the newly created American League Central division.", "In all, the Brewers were part of the American League from their creation in 1969 through the 1997 season, after which they moved to the National League Central Division.", "Milwaukee had previously been a National League city when its team was the Milwaukee Braves (1953\u20131965).", "In 1981, Milwaukee won the American League East Division in the second half of the strike-shortened season.", "In the playoffs, they lost the divisional series to the New York Yankees, three games to two.", "In 1982, Milwaukee won the American League East Division and the American League Pennant, earning their only World Series appearance to date as the Brewers.", "In the Series, they lost to the St. Louis Cardinals four games to three.", "In 1998, the Brewers changed leagues, going from the American League to the National League." ] ], "gold": "Milwaukee won the AL East title and then the 1982 American League Championship Series versus the California Angels. After a 25-year postseason drought that remains the third-longest in the expanded-postseason era, Milwaukee returned to the playoffs in 2008 by winning the National League Wild Card. Most recently, the Brewers won the 2011 National League Central Division title and defeated the Arizona Diamondbacks three games to two in the 2011 National League Division Series.", "prediction 1": "The Milwaukee Brewers were last in the playoffs on September 26, 2018. On September 23, 2011, the Brewers advanced to postseason play by winning the National League wild card. On September 23, 2011, the Brewers clinched their first division title in 29 years. They won the National League Division Series in five games over the Arizona Diamondbacks, but lost the National League Championship Series to the eventual World Series champion St. Louis Cardinals in six games. On September 26, 2018, the Brewers clinched a spot in the playoffs for the first time since 2011.\n", "prediction 2": "The Milwaukee Brewers are a professional baseball team based in Milwaukee. For the last 26 years, the organization has not been to the playoffs, but has once made it to the divisional round of playoffs. The last appearance in the playoffs was in 2008, when they won the National League wild card and went on to win the National League Wild Card Game.", "prediction 3": "In 2011, the Milwaukee Brewers won their first division title in 29 years. They won the National League Division Series in five games over the Arizona Diamondbacks, but lost the National League Championship Series to the eventual World Series champion St. Louis Cardinals in six games. In 2018, the Milwaukee Brewers clinched a spot in the playoffs for the first time since 2011 with a 2\u20131 victory over the St. Louis Cardinals. In 2017, the Brewers earned their first division title since 2011. They then advanced to the National League Central division in the 2018 Brewers.", "prediction 4": "The Milwaukee Brewers are a professional baseball team based in Milwaukee, Wisconsin. They play in the National League Central division. The Brewers have not been to the playoffs since 1981, when they went to the playoffs with the American League East Division. In 2008, the Brewers advanced to the playoffs or the National League division series when they won the National League wild card. On September 23, 2011, the Brewers went to the playoffs for the first time since 2011, when they went to the playoffs for the first time since 2011. In 2018, the Brewers got a playoff berth by defeating the St. Louis Cardinals. In the MLB with a 2\u20131 victory over the Cardinals.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 70 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 71, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 192 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 470 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "In 1982, Milwaukee won the American League East Division and the American League Pennant. In 2008, the Brewers advanced to postseason play by winning the National League wild card. In 2011, they won the National League Division Series in five games over the Arizona Diamondbacks, but lost the National League Championship Series to the eventual World Series champion St. Louis Cardinals in six games. On September 26, 2018, the Brewers clinched a spot in the playoffs for the first time since 2011, they defeated the Chicago Cubs in the National League Central tie-breaker game on October 1, then they swept the Colorado Rockies in the Division Series to advance to the National League Championship Series.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Dragon ball z super next episode release date?", "passages": [ [ "Dragon Ball Super: Broly", "Eventually, Goku and Vegeta fused together into Gogeta and rushed back to the battlefield to save Frieza.", "However, when in the fused form they were able to obliterate Broly, two of Frieza's low-class soldiers, Cheelai and Lemo, who sympathized with him used the Dragon Balls in the last moment to save him from near death.", "In the end, Goku makes contact with Broly wishing to be friends, as well finally accepts his Saiyan heritage and name.", "The film is produced by Toei Animation.", "It was originally announced under the tentative title of \"Dragon Ball Super - The Movie\" on December 17, 2017, during Jump Festa with the general theme being \"The Strongest Warrior Race in the Universe, The Saiyans\".", "A poster was released on March 13, 2018, 11 days before the airing of the final episode of \"Dragon Ball Super\", featuring an entirely new traditional animation design by Toei animator Naohiro Shintani, as opposed to veteran \"Dragon Ball\" character designer Tadayoshi Yamamuro.", "One week later, the first trailer for the film was released publicly through Toei Animation featuring the all\u2013new character designs and an enigmatic new villain." ], [ "The Adventures of Rocky and Bullwinkle (TV series)", "The Adventures of Rocky and Bullwinkle (TV series)\n\nThe Adventures of Rocky and Bullwinkle is an American animated web television series produced by DreamWorks Animation Television which is a reboot of the original \"Rocky and Bullwinkle and Friends\".", "It debuted on May 11, 2018 on Amazon Video \u2014 being DreamWorks Animation Television's first series to air on a streaming service other than Netflix.", "Like its preceding spin-off \"The Mr. Peabody & Sherman Show\", animation was outsourced by DHX Media's 2D animation studio in Vancouver, Canada.", "In December 2018, it was announced that the series would return with new episodes in January 2019.", "The series sees Rocky and Bullwinkle \"thrust into harrowing situations but end up saving the day time and again.", "As Rocky and Bullwinkle\u2019s innocent and silly ambitions to become rock stars or find lost treasure end up dovetailing with Fearless Leader\u2019s sinister plans to take over the world, our heroes are set on a collision course with his notorious superspies Boris Badenov and Natasha Fatale.\"", "On December 10, 2017, it was reported that DreamWorks Animation Television was developing a revival of Jay Ward's \"The Adventures of Rocky and Bullwinkle and Friends\"." ] ], "gold": "Dragon Ball Super has several episodes. The original release date of episode 121 of Dragon Ball Super is December 24, 2017. The original release date of episode 120 of Dragon Ball Super is December 17, 2017, while Dragon Ball Super episode 119 was originally released on December 10, 2017. ", "prediction 1": "Dragon Ball Super's next episode is scheduled to be released on May 26, 2020. It was originally announced as a movie on December 17, 2017, but was later retitled Dragon Ball Super - The Movie.", "prediction 2": "Dragon Ball Super is an American animated web television series produced by DreamWorks Animation Television. It was originally announced under the tentative title of Dragon Ball Super - The Movie, on December 17, 2017, during Jump Festa with the general theme being The Strongest Warrior Race in the Universe, The Saiyans. In December 2018, it was announced that the series would return with new episodes in January 2019.", "prediction 3": "Dragon Ball Super next episode release date is set for January 2019 with a planned premiere on February 12, 2020.", "prediction 4": "Dragon Ball Super is an American animated web television series produced by DreamWorks Animation Television which is a reboot of the original \"Rocky and Bullwinkle and Friends\". In December 2018, it was announced that the series would return with new episodes in January 2019.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 64, "end": 77 }, { "error type": "Irrelevant", "explanation": "", "start": 78, "end": 192 } ], "missing-info": [], "corrected-prediction": "The airing of the final episode of \"Dragon Ball Super\" was 11 days after March 13, 2018." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "What is the rank of master chief in the navy?", "passages": [ [ "Master chief petty officer", "Master chief petty officer\n\nMaster chief petty officer (MCPO) is the ninth, and highest, enlisted rate (pay grade E-9) in the United States Navy and United States Coast Guard, just above senior chief petty officer (SCPO).", "Master chief petty officers are addressed as \"Master Chief (last name)\" in the colloquial and they constitute the top 1.25% of the enlisted members of the maritime forces.", "Prior to 1958, chief petty officer was the highest enlisted rate in both the U.S. Navy and U.S. Coast Guard.", "This changed on 20 May 1958 with the passage of Public Law 85-422, the Military Pay Act of 1958, which established two new enlisted pay grades of E-8 and E-9 in all five branches of the U.S. Armed Forces.", "In the U.S. Navy and U.S. Coast Guard, the new E-8 pay grade was titled Senior Chief Petty Officer and the new E-9 pay grade as Master Chief Petty Officer, with the first selectees promoting to their respective grades in 1959 and 1960.", "In the Navy, advancement to master chief petty officer is similar to that of chief petty officer and senior chief petty officer.", "It carries requirements of time in service, superior evaluation scores, and selection by a board of master chiefs." ], [ "Master chief petty officer", "The rate insignia for a master chief is a white eagle with spread wings above three chevrons.", "The chevrons are topped by a rocker(arc) that goes behind the eagle.", "Two inverted silver stars (a reference to the stars used on the sleeves of line officers) are placed above the eagle.", "Between the arc and the top chevron is the specialty mark of the enlisted rating.", "This is used on the service dress blue, dinner dress blue jacket, and dinner dress white jacket uniforms.", "On other uniforms, the insignia used for shirt collars and caps is the one that has become universally accepted as the symbol of the chief petty officer.", "This is a gold foul anchor (note: the proper term is \"foul anchor\", not \"fouled\") superimposed with a silver \"USN\" (Navy) or a silver shield (Coast Guard).", "As on the rating badge, this is capped by two five-pointed stars, showing one ray down.", "Master chief petty officers are generally considered to be the technical experts in their fields.", "They serve at sea and ashore in commands of all sizes.", "Many master chiefs choose to enter the command master chief petty officer program.", "If selected, a master chief receives additional leadership training and is assigned to a command as the command master chief (CMDCM)." ], [ "Acting (rank)", "In the United States Army acting ranks were often referred to as \"acting jack\" offering enlisted members E-1 to E-3 and specialist E-4 hard stripe corporal E-4 or sergeant E-5 to fill leadership positions.", "In the United States Army hard stripe ranks of corporal E-4 and sergeant E-5 held a higher rank than a specialist four E-4 or specialist five E-5 regardless of time in grade.", "The United States Army used specialist five E-5 and specialist six E-6 until October 1, 1985 when all specialist fives and specialist sixes were laterally promoted to sergeant E-5 and staff sergeant E-6.", "Acting jack ranks of corporal and sergeant were offered to establish a clear chain of command in positions considered excess responsible for multiple commands or that lacked a ranking member of a military occupational specialty (MOS) requiring a section, platoon or squad leader.", "In the United States Navy, acting appointments were common during the 19th century.", "The number of commissioned naval officers at each rank in the Navy was fixed by Congress, so it was difficult to fill vacancies if the number of officers needed to man ships exceeded that fixed number of officers allowed by Congress.", "Acting appointments were also common with warrant officers and ratings, although neither were subject to congressional approval and were simply temporary assignments." ] ], "gold": "In the US Navy, Master Chief petty officers are addressed as Master Chief. Master Chiefs are classified as enlisted members of the Navy and are ranked at the 9th level with an E-9 pay grade. It's the highest enlisted rank in the United States Navy and in the United States Coast Guard. Master Chief petty officers are considered to be the technical experts in their fields.", "prediction 1": "Master chief petty officer is the ninth, and highest, enlisted rate in the United States Navy and United States Coast Guard, just above senior chief petty officer. This rank was created on 20 May 1958 with the passage of Public Law 85-422, the Military Pay Act of 1958, which established two new enlisted pay grades of E-8 and E-9 in all five branches of the United States Armed Forces.", "prediction 2": "Master chief petty officer is the ninth, and highest, enlisted rate in the United States Navy and United States Coast Guard, just above senior chief petty officer.", "prediction 3": "The rank of master chief petty officer in the United States Navy is E-9. In the United States Coast Guard, the rank of master chief petty officer is E-8.", "prediction 4": "Master chief petty officer is the ninth, and highest, enlisted rate (pay grade E-9) in the United States Navy and United States Coast Guard, just above senior chief petty officer. In the United States Navy, master chief ranks up to a total of 218 officers, with a total of 78 active duty officers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 295 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 326 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Master chief petty officer is the ninth, and highest, enlisted rate in the United States Navy and United States Coast Guard. This rank established enlisted pay grades E-9 in all five branches of the United States Armed Forces. Master chief petty officers are addressed as \"Master Chief (last name)\". Master chief petty officers are generally considered to be the technical experts in their fields." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where did the american war of independence start?", "passages": [ [ "Battles of Lexington and Concord", "Battles of Lexington and Concord\n\nThe Battles of Lexington and Concord were the first military engagements of the American Revolutionary War.", "The battles were fought on April 19, 1775 in Middlesex County, Province of Massachusetts Bay, within the towns of Lexington, Concord, Lincoln, Menotomy (present-day Arlington), and Cambridge.", "They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America.", "In late 1774, Colonial leaders adopted the Suffolk Resolves in resistance to the alterations made to the Massachusetts colonial government by the British parliament following the Boston Tea Party.", "The colonial assembly responded by forming a Patriot provisional government known as the Massachusetts Provincial Congress and calling for local militias to train for possible hostilities.", "The Colonial government exercised effective control of the colony outside of British-controlled Boston.", "In response, the British government in February 1775 declared Massachusetts to be in a state of rebellion.", "About 700 British Army regulars in Boston, under Lieutenant Colonel Francis Smith, were given secret orders to capture and destroy Colonial military supplies reportedly stored by the Massachusetts militia at Concord.", "Through effective intelligence gathering, Patriot leaders had received word weeks before the expedition that their supplies might be at risk and had moved most of them to other locations." ], [ "Battles of Lexington and Concord", "According to one member of Parker's militia, none of the Americans had discharged their muskets as they faced the oncoming British troops.", "The British did suffer one casualty, a slight wound, the particulars of which were corroborated by a deposition made by Corporal John Munroe.", "Munroe stated that:\n\nSome witnesses among the regulars reported the first shot was fired by a colonial onlooker from behind a hedge or around the corner of a tavern.", "Some observers reported a mounted British officer firing first.", "Both sides generally agreed that the initial shot did not come from the men on the ground immediately facing each other.", "Speculation arose later in Lexington that a man named Solomon Brown fired the first shot from inside the tavern or from behind a wall, but this has been discredited.", "Some witnesses (on each side) claimed that someone on the other side fired first; however, many more witnesses claimed to not know.", "Yet another theory is that the first shot was one fired by the British, that killed Asahel Porter, their prisoner who was running away (he had been told to walk away and he would be let go, though he panicked and began to run).", "Historian David Hackett Fischer has proposed that there may actually have been multiple near-simultaneous shots." ], [ "Battles of Lexington and Concord", "On the night before the battle, warning of the British expedition had been rapidly sent from Boston to militias in the area by several riders, including Paul Revere and Samuel Prescott, with information about British plans.", "The initial mode of the Army's arrival by water was signaled from the Old North Church in Boston to Charlestown using lanterns to communicate \"one if by land, two if by sea\".", "The first shots were fired just as the sun was rising at Lexington.", "Eight militiamen were killed, including Ensign Robert Munroe, their third in command.", "The British suffered only one casualty.", "The militia were outnumbered and fell back, and the regulars proceeded on to Concord, where they broke apart into companies to search for the supplies.", "At the North Bridge in Concord, approximately 400 militiamen engaged 100 regulars from three companies of the King's troops at about 11:00am, resulting in casualties on both sides.", "The outnumbered regulars fell back from the bridge and rejoined the main body of British forces in Concord.", "The British forces began their return march to Boston after completing their search for military supplies, and more militiamen continued to arrive from neighboring towns.", "Gunfire erupted again between the two sides and continued throughout the day as the regulars marched back towards Boston." ] ], "gold": "The American War of Independence, which is also called the American Revolutionary War, started in Middlesex County, Province of Massachusetts Bay. The battles of Lexington and Concord were the first military engagements of the war between the colonist militia and British soldiers. The first shots were fired at Lexington, Massachusetts, although witnesses said that the first shot probably came from an onlooker and not someone engaged by either side of the battle. Troops from both sides suffered casualties in Concord, Massachusetts, where eight militiamen were killed and one British soldier.", "prediction 1": "The first military engagements of the American Revolutionary War were fought on April 19, 1775 in Middlesex County, Province of Massachusetts Bay, within the towns of Lexington, Concord, Lincoln, Menotomy, and Cambridge. They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America. The British expedition began at the Old North Church in Boston, but was quickly signaled from Charlestown using lanterns to communicate one if by land, two if by sea. The first shots were fired just as the sun was rising at Lexington.", "prediction 2": "The American Revolutionary War started at the Battles of Lexington and Concord in Middlesex County, Province of Massachusetts Bay, within the towns of Lexington, Concord, Lincoln, Menotomy (present-day Arlington), and Cambridge. They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America.", "prediction 3": "The American Revolutionary War started on April 19, 1775 in Middlesex County, Province of Massachusetts Bay, within the towns of Lexington, Concord, Lincoln, Menotomy (present-day Arlington), and Cambridge. They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America. The first shots were fired just as the sun was rising at Lexington where eight militiamen were killed, including Ensign Robert Munroe, their third in command. The militia were outnumbered and fell back, and the regulars broke apart into companies to search for military supplies. The first shot was one, a slight wound, the particulars of which were corroborated by a deposition made by Corporal John Munroe.", "prediction 4": "The American Revolutionary War started at the Battle of Lexington and Concord on April 19, 1775. The battles were fought within the towns of Lexington, Concord, Lincoln, Menotomy, and Cambridge. They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 505 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The first military engagements of the American Revolutionary War were fought on April 19, 1775 in Middlesex County, Province of Massachusetts Bay, within the towns of Lexington, Concord, Lincoln, Menotomy, and Cambridge. They marked the outbreak of armed conflict between the Kingdom of Great Britain and its thirteen colonies in America. The first shots were fired just as the sun was rising at Lexington. Some witnesses among the regulars reported the first shot was fired by a colonial onlooker from behind a hedge or around the corner of a tavern. Eight militiamen were killed and the British suffered only one casualty." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did mens figure skating become an olympic sport?", "passages": [ [ "Figure skating at the Olympic Games", "Figure skating at the Olympic Games\n\nFigure skating was first contested in the Olympic Games at the 1908 Summer Olympics.", "Since 1924, the sport has been a part of the Winter Olympic Games.", "Men's singles, ladies' singles, and pair skating have been held most often.", "Ice dance joined as a medal sport in 1976 and a team event debuted at the 2014 Olympics.", "Special figures were contested at only one Olympics, in 1908.", "Synchronized skating has never appeared at the Olympics but aims to be included.", "Figure skating was first contested as an Olympic sport at the 1908 Summer Olympics, in London, United Kingdom.", "As this traditional winter sport could be conducted indoors, the International Olympic Committee (IOC) approved its inclusion in the Summer Olympics program.", "It was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games, first held in 1924 in Chamonix, France.", "In London, figure skating was presented in four events: men's singles, women's singles, men's special figures, and mixed pairs.", "The special figures contest was won by Russian Nikolai Panin, who gave his country its first ever Olympic gold medal.", "He remains the event's sole winner, as it was subsequently dropped from the program.", "Ice dance joined as a medal sport in 1976, after appearing as a demonstration event at Grenoble 1968." ] ], "gold": "Men's figure skating was first contested in the Olympic Games at the 1908 Summer Olympics. As this traditional winter sport could be conducted indoors, the International Olympic Committee approved its inclusion in the Summer Olympics program. It was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games in 1924.", "prediction 1": "Mens figure skating became an olympic sport in 1908, at the Summer Olympics, in London, United Kingdom. Since then, the sport has been a part of the Winter Olympic Games, in which the men's singles, ladies' singles, and pair skating have been held most often. Ice dance joined as a medal sport in 1976, after appearing as a demonstration event at Grenoble 1968.", "prediction 2": "Figure skating became an Olympic sport at the 1908 Summer Olympics, in London, United Kingdom. It became part of the Winter Olympic Games program in 1924, and was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games, first held in Chamonix, France. Ice dance joined as a medal sport in 1976, after appearing as a demonstration event at Grenoble 1968.", "prediction 3": "Figure skating was first contested as an Olympic sport at the 1908 Summer Olympics in London, United Kingdom. As this traditional winter sport could be conducted indoors, the International Olympic Committee approved its inclusion in the Summer Olympics program. It was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games, first held in 1924 in Chamonix, France. Ice dance joined as a medal sport in 1976, after appearing as a demonstration event at Grenoble 1968.", "prediction 4": "Figure skating was first contested as an Olympic sport at the 1908 Summer Olympics, in London, United Kingdom. As this traditional winter sport could be conducted indoors, the International Olympic Committee (IOC) approved its inclusion in the Summer Olympics program. It was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games, first held in 1924 in Chamonix, France. Ice dance joined as a medal sport in 1976, after appearing as a demonstration event at Grenoble, France.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 361 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Mens figure skating became an olympic sport in 1908, at the Summer Olympics. As this traditional winter sport could be conducted indoors, the International Olympic Committee approved its inclusion in the Summer Olympics program. It was featured a second time at the Antwerp Games, after which it was permanently transferred to the program of the Winter Olympic Games in 1924." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who played dumbledore after the first one died?", "passages": [ [ "Albus Dumbledore", "Albus Dumbledore\n\nProfessor Albus Percival Wulfric Brian Dumbledore is a fictional character in J. K. Rowling's \"Harry Potter\" series.", "For most of the series, he is the headmaster of the wizarding school Hogwarts.", "As part of his backstory, it is revealed that he is the founder and leader of the Order of the Phoenix, an organisation dedicated to fighting Lord Voldemort.", "Dumbledore was portrayed by Richard Harris in the film adaptations of \"Harry Potter and the Philosopher's Stone\" and \"Harry Potter and the Chamber of Secrets\".", "After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining \"Harry Potter\" films.", "Jude Law portrayed Dumbledore in the prequel film \"\".", "Rowling stated she chose the name Dumbledore, which is a dialectal word for \"bumblebee\", because of Dumbledore's love of music: she imagined him walking around \"humming to himself a lot\".", "The author has stated that she enjoys writing Dumbledore because he \"is the epitome of goodness.\"", "Rowling said that Dumbledore speaks for her, as he \"knows pretty much everything\" about the \"Harry Potter\" universe." ], [ "Albus Dumbledore", "Ian McKellen was offered the role, but he turned it down, having played the similar character Gandalf in \"The Lord of the Rings\" trilogy, as well as feeling it would have been inappropriate to take Harris's role, as Harris had called McKellen a \"dreadful\" actor.", "Harris's family had expressed an interest in seeing Peter O'Toole being chosen as his replacement.", "Michael Gambon was cast as Harris's replacement four months after Harris's death.", "Gambon was not concerned about bettering Harris, and he portrayed the character in his own way, putting on a slight Irish accent for the role, as well as completing his scenes in three weeks.", "Gambon reprised his role in all the remaining films.", "Toby Regbo was chosen to portray Dumbledore in his youth in \"Deathly Hallows Part 1\" and \"Part 2\", for flashbacks scenes which provide essential information on the character's backstory.", "Jude Law played the role of a younger Dumbledore in the second prequel film, \"\".", "Albus Dumbledore is tall and thin, with silver hair and beard (auburn in his youth) so long that they can be tucked into his belt.", "He has a very long and crooked nose that looks as if it has been broken at least twice." ] ], "gold": "Albus Percival Wulfric Brian Dumbledore is a fictional character in J. K. Rowling's Harry Potter series who was originally played by Richard Harris in \"Harry Potter and the Sorcerer's Stone\" and \"Harry Potter and the Chamber of Secrets\". After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. There was also a prequel film titled \"Fantastic Beasts: The Crimes of Grindelwald\" in which Jude Law was cast as a young Dumbledore.", "prediction 1": "Albus Dumbledore is a fictional character in J. K. Rowling's \"Harry Potter\" series. Dumbledore was portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film, \"The Prisoner of Azkaban\".", "prediction 2": "Albus Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. Dumbledore was portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film \".", "prediction 3": "Albus Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. Dumbledore was originally portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film.", "prediction 4": "Albus Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. Richard Harris played Dumbledore in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. Michael Gambon played Dumbledore for all of the remaining Harry Potter films. Jude Law played the role of a younger Dumbledore in the second prequel film.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 393, "end": 419 } ], "missing-info": [], "corrected-prediction": "Albus Dumbledore is a fictional character in J. K. Rowling's \"Harry Potter\" series. Dumbledore was portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played uncle jesse in dukes of hazzard?", "passages": [ [ "The Dukes of Hazzard", "Bo and Luke had previously been sentenced to probation for illegal transportation of moonshine; their Uncle Jesse made a plea bargain with the U.S. Government to refrain from distilling moonshine in exchange for Bo and Luke's freedom.", "As a result, Bo and Luke are on 5 years probation and not allowed to carry firearms\u00a0\u2013 instead, they often use compound bows, sometimes with arrows tipped with dynamite \u2013 or to leave Hazzard County unless they get probation permission from their probation officer, Boss Hogg, although the exact details of their probation terms vary from episode to episode.", "Sometimes it is implied that they would be jailed for merely crossing the county line; on other occasions, it is shown that they may leave Hazzard, as long as they are back within a certain time limit.", "Several other technicalities of their probation also came into play at various times.", "Corrupt county commissioner Jefferson Davis (J.D.) \"Boss\" Hogg, who either runs or has fingers in virtually everything in Hazzard County, is forever angry with the Dukes, especially Bo and Luke, for always foiling his crooked schemes.", "He is always looking for ways to get them out of the picture so that his plots have a chance of succeeding.", "Many episodes revolve around Hogg trying to engage in an illegal scheme, sometimes with aid of hired criminal help." ], [ "The Dukes of Hazzard", "The Dukes of Hazzard\n\nThe Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985.", "The show aired for a total of 147 episodes spanning seven seasons.", "The series was inspired by the 1975 film \"Moonrunners\", which was also created by Gy Waldron and had many identical or similar character names and concepts.", "\"The Dukes of Hazzard\" had an ensemble cast, which follows the adventures of \"The Duke Boys\", cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat) (including Coy and Vance Duke for most of season 5), who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle).", "The Duke boys race around in their customized 1969 Dodge Charger stock car, dubbed \"(The) General Lee\", evading crooked and corrupt county commissioner Boss Hogg (Sorrell Booke) and his bumbling and corrupt Sheriff Rosco P. Coltrane (James Best) along with his deputy(s), and always managing to get caught in the middle of the various escapades and incidents that often occur in the area." ], [ "The Dukes of Hazzard (film)", "The Dukes of Hazzard (film)\n\nThe Dukes of Hazzard is a 2005 American buddy comedy road film based on the television series, \"The Dukes of Hazzard\".", "The film was directed by Jay Chandrasekhar and released on August 5, 2005, by Warner Bros. Pictures.", "As in the television series, the film depicts the adventures of cousins Bo, Luke, and Daisy, and their Uncle Jesse, as they outfox crooked Hazzard County Commissioner Boss Hogg and Sheriff Rosco P. Coltrane.", "The film was the acting debut of pop singer Jessica Simpson.", "While financially successful, the film met with negative reviews from critics.", "The film was followed by a direct-to-video prequel titled \"\" (2007).", "Cousins Bo, Luke, and Daisy Duke run a moonshine business for their Uncle Jesse in Hazzard County, Georgia.", "The cousins' primary mode of transportation is an orange 1969 Dodge Charger that the boys affectionately refer to as the \"General Lee\".", "Along the way, the family is tormented by corrupt Hazzard County Commissioner Jefferson Davis Hogg, widely known as \"Boss Hogg\", and his willing but dimwitted henchman, Sheriff Rosco P. Coltrane." ] ], "gold": "The Dukes of Hazzard is an American action-comedy television series that was aired on CBS from January 26, 1979, to February 8, 1985. Jesse Duke, played by Denver Pyle, is the patriarch of the Duke clan and the father-figure to all of the Dukes who stay with him on the \"Duke farm\". In the 2005 film version, which was loosely based on the television show, Uncle Jesse Duke was played by Willie Nelson.", "prediction 1": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The show had an ensemble cast, which followed the adventures of \"The Duke Boys\", cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat) who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse. Denver Pyle played the role of Jesse in the 2005 American buddy comedy road film that was directed by Jay Chandrasekhar and released on August 5, 2005, by Warner Bros.", "prediction 2": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The show featured an ensemble cast, which followed the adventures of \"The Duke Boys\", cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat), who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse, played by Denver Pyle. In the 2005 American buddy comedy road film, the Dukes of Hazzard, the role of Uncle Jesse is played by pop singer Jessica Simpson as Uncle Jesse.", "prediction 3": "The Dukes of Hazzard is an American action-comedy television series that was inspired by the 1975 film Moonrunners. The series followed the adventures of The Duke Boys, cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat), who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle). The Dukes of Hazzard is also the basis for a 2005 American buddy comedy road film based on the TV series.", "prediction 4": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The series follows the adventures of The Duke Boys, cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat) who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse, played by Denver Pyle. In The Dukes of Hazzard, the role of Uncle Jesse was played by Denver Pyle. The Dukes of Hazzard was the acting debut of pop singer Jessica Simpson in the 2005 buddy comedy road film, directed by Jay Chandrasekhar and released on August 5, 2005, by Warner Bros.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 370, "end": 392 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 462, "end": 592 } ], "missing-info": [], "corrected-prediction": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The show had an ensemble cast, which followed the adventures of \"The Duke Boys\", who live on a family farm with their attractive female cousin and their wise old Uncle Jesse. Denver Pyle played the role of Jesse." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played bass on whatever gets you through the night?", "passages": [ [ "Whatever Gets You thru the Night", "Whatever Gets You thru the Night\n\n\"Whatever Gets You Thru the Night\" is a song written by John Lennon, released as a single in 1974 on Apple Records, catalogue Apple 1874 in the United States and Apple R5998 in the United Kingdom.", "It peaked at number 1 on both the \"Billboard\" Hot 100 and \"Cashbox\" Top 100.", "It also peaked at number 36 on the British singles chart.", "It was the lead single for the \"Walls and Bridges\" album in the US; in the UK it was released the same day as the album.", "In Canada, the song spent two weeks at number two, and became the 30th biggest hit of 1974.", "The inspiration for the lyrics came from late-night television.", "In December 2005, May Pang told \"Radio Times\": \"At night he loved to channel-surf, and would pick up phrases from all the shows.", "One time, he was watching Reverend Ike, a famous black evangelist, who was saying, \"Let me tell you guys, it doesn't matter, it's whatever gets you through the night.\"", "John loved it and said, \"I've got to write it down or I'll forget it.\"", "He always kept a pad and pen by the bed.", "That was the beginning of 'Whatever Gets You Thru the Night'.\"" ], [ "You're So Vain", "You're So Vain\n\n\"You're So Vain\" is a song written in 1971 by Carly Simon and released in November 1972.", "The song is a critical profile of a self-absorbed lover about whom Simon asserts \"You're so vain, you probably think this song is about you.\"", "The title subject's identity has long been a matter of speculation, with Simon stating that the song refers to three men, only one of whom she has named publicly, actor Warren Beatty.", "The song is ranked at #92 on \"Billboard\"'s Greatest Songs of All-Time.", "\"You're So Vain\" was voted #216 in RIAA's Songs of the Century, and in August 2014, the UK's Official Charts Company crowned it the ultimate song of the 1970s.", "The distinctive bass guitar intro is played by Klaus Voormann.", "The strings were arranged by Simon and orchestrated by Paul Buckmaster.", "Simon plays piano on the track.", "Before the song became a hit single in 1972, Simon told an interviewer that the song was about \"men,\" not a specific \"man\".", "In 1983, she said it is not about Mick Jagger, who contributed uncredited backing vocals to the song." ] ], "gold": "In John Lennon's hit single \"Whatever Gets You Thru the Night\", the bass part was performed by Klaus Voormann in the original recording, and by Dee Murray in the 1974 live recording.", "prediction 1": "Klaus Voormann played bass on Whatever Gets You Thru the Night. The distinctive bass guitar intro is played by Klaus Voormann. The strings were arranged by Simon and orchestrated by Paul Buckmaster.", "prediction 2": "Klaus Voormann plays the bass on Whatever Gets You Thru the Night. The distinctive bass guitar intro is played by Klaus Voormann. The strings were arranged by Simon and orchestrated by Paul Buckmaster. The song was originally recorded in 1973 and released as a single in 1974.", "prediction 3": "Klaus Voormann played bass on Whatever Gets You Thru the Night. The distinctive bass guitar intro is played by Klaus Voormann. The strings were arranged by Simon and orchestrated by Paul Buckmaster. The song's title subject, \"You're So Vain\", is a song written in 1971 by Carly Simon and released in November 1972.", "prediction 4": "Klaus Voormann played bass on Whatever Gets You Thru the Night. The distinctive bass guitar intro is played by Klaus Voormann. The strings were arranged by Simon and orchestrated by Paul Buckmaster. Simon plays piano on the track.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 15, "end": 26 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 126 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 198 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Whatever Gets You Thru the Night\" is a hit single by John Lennon. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the stock market crash in 2008?", "passages": [ [ "Financial crisis of 2007\u20132008", "According to David Brooks from the New York Times, \"Taleb not only has an explanation for what's happening, he saw it coming.\"", "A report by the International Labour Organization concluded that cooperative financial institutions were less likely to fail than their competitors during the crisis.", "The cooperative banking sector had 20% market share of the European banking sector, but accounted for only 7 per cent of all the write-downs and losses between the third quarter of 2007 and first quarter of 2011.", "Similarly, credit unions in the US had five times lower failure rate than other banks during the crisis and increased their lending to small- and medium sized businesses while overall lending to those businesses decreased.", "The US stock market peaked in October 2007, when the Dow Jones Industrial Average index exceeded 14,000 points.", "It then entered a pronounced decline, which accelerated markedly in October 2008.", "By March 2009, the Dow Jones average had reached a trough of around 6,600.", "Four years later,\nit hit an all-time high.", "It is probable, but debated, that the Federal Reserve's aggressive policy of quantitative easing spurred the partial recovery in the stock market.", "Market strategist Phil Dow believes distinctions exist \"between the current market malaise\" and the Great Depression." ], [ "Stock market crash", "On October 11, 2008, the head of the International Monetary Fund (IMF) warned that the world financial system was teetering on the \"brink of systemic meltdown\".", "The economic crisis caused countries to close their markets temporarily.", "On October 8, the Indonesian stock market halted trading, after a 10% drop in one day.", "\"The Times\" of London reported that the meltdown was being called the \"Crash of 2008\", and older traders were comparing it with Black Monday in 1987.", "The fall that week of 21% compared to a 28.3% fall 21 years earlier, but some traders were saying it was worse.", "\"At least then it was a short, sharp, shock on one day.", "This has been relentless all week.\"", "Business Week also referred to the crisis as a \"stock market crash\" or the \"Panic of 2008\".", "From October 6\u201310 the Dow Jones Industrial Average (DJIA) closed lower in all five sessions.", "Volume levels were record-breaking.", "The DJIA fell over 1,874 points, or 18%, in its worst weekly decline ever on both a points and percentage basis.", "The S&P 500 fell more than 20%.", "The week also set 3 top ten NYSE Group Volume Records with October 8 at #5, October 9 at #10, and October 10 at #1." ], [ "2008\u20132011 Icelandic financial crisis", "The decision was made to do so due to \"unusual market conditions\", with share prices having fallen 30% since the start of the month.", "The closure was extended through Monday 13 October due to continuing \"unusual market conditions\".", "The market reopened on 14 October with the main index, the OMX Iceland 15, at 678.4, which corresponds to a plunge of about 77% compared with 3,004.6 before the closure.", "This reflects the fact that the value of the three big banks, which form 73.2% of the value of the OMX Iceland 15, had been set to zero.", "The values of other equities varied from +8% to \u221215%.", "Trading in shares of Exista, SPRON and Straumur-Bur\u00f0ar\u00e1s (13.66% of the OMX Iceland 15) remains suspended.", "After a week of very thin trading, the OMX Iceland 15 closed on 17 October at 643.1, down 93% in kr\u00f3na terms and 96% in euro terms from its historic high of 9016 (18 July 2007).", "Trading in the shares of two financial services companies, Straumur\u2013Bur\u00f0ar\u00e1s and Exista, resumed on 9 December: together the companies account for 12.04% of the OMX Iceland 15." ] ], "gold": "The stock market crash of 2008, considered by many economists to have been one of the most serious financial crises of the last century, began in October 2008 following the collapse of several American and European financial institutions. This resulted in sharp reductions in the value of stocks and commodities worldwide. As a result, the Icelandic stock market suspended trading on 6 October, and the Indonesian stock market followed on October 8.", "prediction 1": "The stock market crashed on October 11, 2008, when the head of the International Monetary Fund warned that the world financial system was teetering on the \"brink of systemic meltdown\". The Icelandic stock market closed temporarily on October 8 and reopened on 14 October.", "prediction 2": "In the United States the stock market crashed on October 11, 2008, which coincided with the global financial crisis. In Iceland, the stock market crashed on October 14 and was reopened on 14 October, but was shut down for a further two weeks. In Indonesia, the stock market crashed on October 8 and October 9.", "prediction 3": "Stock market crashed in Iceland on October 11, 2008, after the head of the International Monetary Fund warned that the world financial system was teetering on the edge of a systemic meltdown.", "prediction 4": "The US stock market peaked in October 2007, when the Dow Jones Industrial Average index exceeded 14,000 points. Then entered a pronounced decline, which accelerated markedly in October 2008. By March 2009, the Dow Jones average had reached a trough of around 6,600. Four years later, it hit an all-time high. In Iceland on October 8, the stock market halted trading, after a 10% drop in one day.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 248, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 184 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 189, "end": 198 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The stock market crashed on October 11, 2008, economic crisis caused countries to close their markets temporarily. The Indonesian stock market closed temporarily on October 8." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many episodes of the only way is essex are there?", "passages": [ [ "The Only Way Is Essex", "The Only Way Is Essex\n\nThe Only Way Is Essex (often abbreviated as TOWIE ) is a British reality television series based in Brentwood, England.", "It shows \"real people in modified situations, saying unscripted lines but in a structured way.\"", "The show is filmed just a few days in advance.", "It is narrated by Denise van Outen, who is from Basildon, Essex.", "The show has been described as Britain's answer to \"The Hills\" and \"Jersey Shore\".", "Each series lasts six weeks, airing on Wednesdays and Sundays at 10pm on ITV2 from 2010 to 2014, although it was announced in February 2014 that the show would be moved to ITV2's sister channel ITVBe when the channel launches.", "The first series consisted of 10 episodes and ran for 30 minutes, with a Christmas special following later in the year.", "Due to popularity, the show was extended to 45-minute episodes and renewed for a year's airing.", "On 22 May 2011, the series won the Audience Award at the 2011 BAFTA Awards.", "The 12th series was the last to air on ITV2 before the show moved to ITV's new channel, ITVBe in October 2014.", "On 13 March 2016, ITVBe aired a one-off documentary hosted by former cast member Mark Wright discussing the history of the show." ] ], "gold": "The British reality series The Only Way Is Essex aired 145 episodes on ITV2 from 2010 to 2014. The series was then moved to ITVBe, where it has aired 166 episodes to date, bringing the series to 311 total episodes across both channels.", "prediction 1": "The Only Way Is Essex is a British reality television series based in Brentwood, England. Each series lasts six weeks, airing on Wednesdays and Sundays at 10pm on ITV2. Each series consists of 10 episodes. There are 15 total episodes of the show.", "prediction 2": "The Only Way Is Essex is a British reality television series based in Brentwood, England. There are 16 episodes in the first series, and a total of 114 episodes in the 12th.", "prediction 3": "There are 12 series of the British reality TV series The Only Way Is Essex. Each series lasts six weeks, airing on Wednesdays and Sundays at 10pm on ITV2.", "prediction 4": "The Only Way Is Essex is an English reality television series which aired on ITV2 from 2010 to 2014. Each series lasted six weeks, airing on Wednesdays and Sundays at 10pm. Due to popularity, the show was extended to 45-minute episodes and renewed for a year's airing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 89 }, { "error type": "Unverifiable", "explanation": "", "start": 206, "end": 246 }, { "error type": "Unverifiable", "explanation": "", "start": 169, "end": 205 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The British reality show has each series lasts six weeks, airing on Wednesdays and Sundays at 10pm on ITV2 from 2010 to 2014. The first series consisted of 10 episodes." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When do they give out the mlb mvp award?", "passages": [ [ "Major League Baseball Most Valuable Player Award", "Major League Baseball Most Valuable Player Award\n\nThe Major League Baseball Most Valuable Player Award (MVP) is an annual Major League Baseball (MLB) award given to one outstanding player in the American League and one in the National League.", "Since 1931, it has been awarded by the Baseball Writers' Association of America (BBWAA).", "The winners receive the Kenesaw Mountain Landis Memorial Baseball Award, which became the official name of the award in 1944, in honor of the first MLB commissioner, Kenesaw Mountain Landis, who served from 1920 until his death on November 25, 1944.", "MVP voting takes place before the postseason, but the results are not announced until after the World Series.", "The BBWAA began by polling three writers in each league city in 1938, reducing that number to two per league city in 1961.", "The BBWAA does not offer a clear-cut definition of what \"most valuable\" means, instead leaving the judgment to the individual voters.", "First basemen, with 34\u00a0winners, have won the most MVPs among infielders, followed by second basemen\u00a0(16), third basemen\u00a0(15), and shortstops\u00a0(15).", "Of the 25\u00a0pitchers who have won the award, 15 are right-handed while 10 are left-handed." ] ], "gold": "The Major League Baseball Most Valuable Player Award is an annual Major League Baseball award given to one outstanding player in the American League and one in the National League. MVP voting takes place before the postseason, but the results are not announced until after the World Series.", "prediction 1": "The Major League Baseball Most Valuable Player Award (MVP) is an annual Major League Baseball award given to one outstanding player in the American League and one in the National League. Since 1931, it has been awarded by the Baseball Writers' Association of America. The winners receive the Kenesaw Mountain Landis Memorial Baseball Award, which became the official name of the award in 1944, in honor of the first MLB commissioner, Kenesaw Mountain Landis. The award was first awarded in 1931 and was established to honor the services of the first commissioner of the team that won the World Series.", "prediction 2": "The Major League Baseball Most Valuable Player Award (MVP) is an annual Major League Baseball award given to one outstanding player in the American League and one in the National League. Since 1931, it has been awarded by the Baseball Writers' Association of America. Winners receive the Kenesaw Mountain Landis Memorial Baseball Award, which became the official name of the award in 1944, in honor of the first MLB commissioner, Kenesaw Mountain Landis, who served from 1920 until his death on November 25, 1944.", "prediction 3": "The Major League Baseball Most Valuable Player Award is an annual Major League Baseball award given to one outstanding player in the American League and one in the National League. Since 1931, it has been awarded by the Baseball Writers' Association of America. The winners receive the Kenesaw Mountain Landis Memorial Baseball Award, which became the official name of the award in 1944, in honor of the first MLB commissioner, Kenesaw Mountain Landis, who served from 1920 until his death on November 25, 1944. MVP voting takes place before the postseason, but the results are not announced until after the World Series.", "prediction 4": "The Major League Baseball Most Valuable Player Award (MVP) is an annual award given to one outstanding player in the American League and one in the National League. The award is awarded by the Baseball Writers' Association of America (BBWAA) since 1931. The winners receive the Kenesaw Mountain Landis Memorial Baseball Award, which became the official name of the award in 1944, in honor of the first MLB commissioner, Kenesaw Mountain Landis, who served from 1920 until his death on November 25, 1944.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 458 }, { "error type": "Irrelevant", "explanation": "", "start": 459, "end": 601 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Major League Baseball Most Valuable Player Award (MVP) is an annual Major League Baseball award given to one outstanding player in the American League and one in the National League. MVP voting takes place before the postseason, but the results are not announced until after the World Series." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "How many lanes does an olympic pool have?", "passages": [ [ "Freestyle swimming", "Also, over the years, some design considerations have reduced swimming resistance, making the pool faster, namely: proper pool depth, elimination of currents, increased lane width, energy-absorbing racing lane lines and gutters, and the use of other innovative hydraulic, acoustic, and illumination designs.", "The 1924 Olympics was the first to use the standard 50 meter pool with marked lanes.", "In freestyle events, swimmers originally dove from the pool walls, but diving blocks were eventually incorporated at the 1936 Olympics.", "The flip turn was developed in the 1950s, resulting in faster times.", "Lane design created in the early 1970s has also cut down turbulence in water, aiding in the more dynamic pool used today.", "Freestyle means \"any style\" for individual swims and any style but breaststroke, butterfly, or backstroke for both the individual medley, and medley relay competitions.", "The wall has to be touched at every turn and upon completion.", "Some part of the swimmer must be above water at any time, except for the first 15 meters after the start and every turn.", "This rule was introduced (see History of swimming) to prevent swimmers from using the faster underwater swimming to their advantage, or even swimming entire laps underwater.", "The exact FINA rules are:\n\nThere are nine competitions used in freestyle swimming, both using either a long course (50 meter) or a short course (25 meter) pool." ], [ "Swimming (sport)", "World Championship pools must be (long course) long and wide, with ten lanes labelled zero to nine (or one to ten in some pools; zero and nine (or one and ten) are usually left empty in semi-finals and finals); the lanes must be at least wide.", "They will be equipped with starting blocks at both ends of the pool and most will have Automatic Officiating Equipment, including touch pads to record times and sensors to ensure the legality of relay takeovers.", "The pool must have a minimum depth of two metres.", "Other pools which host events under FINA regulations are required to meet some but not all of these requirements.", "Many of these pools have eight, or even six, instead of ten lanes and some will be long, making them Short course.", "World records that are set in short course pools are kept separate from those set in long course pools because it may be an advantage or disadvantage to swimmers to have more or less turns in a race.", "Competitive swimming, from the club through to international level, tends to have an autumn and winter season competing in short course (25 metres or yards) pools and a spring and summer season competing in long course (50 metre) pools and in open water." ], [ "Olympic-size swimming pool", "If the pool is used for Olympic Games or World Championships, then the minimum depth is increased to .", "At FINA's 2009 Congress, rules were approved for 10-lane courses for competition, as an alternative to the more traditional 8-lane course." ] ], "gold": "Since 2008, an Olympic-size swimming pool must be comprised of 10 50 meter long lanes. 8 of these lanes are used for racing, with the remaining two left empty, helping to absorb waves generated by the swimmers' movements and allowing for less resistance against them. Before that year, an Olympic pool had only 8 total lanes.", "prediction 1": "The 1924 Olympics was the first to use the standard 50 meter pool with marked lanes. The 2009 Congress of FINA approved rules for 10-lane courses for competition, as an alternative to the more traditional 8-lane course.\n", "prediction 2": "Many Olympic swimming pools have up to 10 lanes at any given time. For example, a 50 meter Olympic pool can have up to 7 lanes for individual events, and up to 8 lanes for team events. This is mandatory for all events, for both the individual events and relay events.", "prediction 3": "The Olympic pool's minimum depth for Open water swimming is 2 metres. Nine lanes are required for all events, except freestyle.", "prediction 4": "The 1924 Olympics was the first to use the standard 50 meter swimming pool with marked lanes. The 1932 Olympics was the first to use the 25 meter pool with marked lanes. World Championship pools must be (long course) long and wide, with ten lanes labelled zero to nine (or one to ten in some pools; zero and nine (or one and ten are usually left empty in semi-finals and finals); the lanes must be at least wide.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 84 } ], "missing-info": [], "corrected-prediction": "The 2009 Congress of FINA approved rules for 10-lane courses for competition, as an alternative to the more traditional 8-lane course.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "The basic ratio on which the notation of rhythm is built is?", "passages": [ [ "Note value", "Around 1250, Franco of Cologne invented different symbols for different durations, although the relation between different note values could vary; three was the most common ratio.", "Philippe de Vitry's treatise Ars nova (1320) described a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them.", "This black mensural notation gave way to \"white mensural notation\" around 1450, in which all note values were written with white (outline) noteheads.", "In white notation the use of triplets was indicated by \"coloration\", i.e. filling in the noteheads to make them black (or sometimes red).", "Both black and white notation periodically made use of ligatures, a holdover from the \"clivis\" and \"porrectus\" neumes used in chant.", "Around 1600 the modern notational system was generally adopted, along with barlines and the practice of writing multipart music in scores rather than only individual parts.", "In the 17th century, however, old usages came up occasionally.", "The British names go back at least to English renaissance music, and the terms of Latin origin had international currency at that time.", "Obviously, \"longa\" means 'long', and the rest rarely indicate relative shortness." ] ], "gold": "There are two different basic ratios on which the notation of rhythm is built. The basic ratio on which the modern notation of rhythm is built is 2:1. The basic ratio on which the mensural notation of rhythm is considered complete is 3:1.", "prediction 1": "The basic ratio on which the notation of rhythm is built is 3:1. Philippe de Vitry's treatise Ars nova described a system in which the ratios of different note values could be 2:1 or 3:1. Philippe de Vitry's treatise described a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them. This black mensural notation gave way to \"white mensural notation\" around 1450, in which all note values were written with white (outline) noteheads.", "prediction 2": "The basic ratio on which the notation of rhythm is built is 3:1. Philippe de Vitry's treatise Ars nova (1320) described a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them. This black mensural notation gave way to \"white mensural notation\" around 1450, in which all note values were written with white (outline) noteheads.", "prediction 3": "The basic ratio on which the notation of rhythm is built is 2:1 or 3:1. Philippe de Vitry's treatise Ars nova described a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them. This black mensural notation gave way to \"white mensural notation\" around 1450, in which all note values were written with white (outline) noteheads.", "prediction 4": "The basic notation system for rhythm is built on the ratio of three. Philippe de Vitry's treatise Ars nova described a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them. This black mensural notation gave way to \"white mensural notation\" around 1450, in which all note values were written with white (outline) noteheads.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 130 }, { "error type": "Redundant", "explanation": "The basic ratio on which the notation of rhythm is built is 3:1. Philippe de Vitry's treatise Ars nova described a system in which the ratios of different note values could be 2:1 or 3:1. ", "start": 188, "end": 301 }, { "error type": "Irrelevant", "explanation": "", "start": 373, "end": 522 } ], "missing-info": [], "corrected-prediction": "The basic ratio on which the notation of rhythm is built is 3:1 in a system in which the ratios of different note values could be 2:1 or 3:1, with a system of mensural time signatures to distinguish between them. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "How many countries are there in west africa?", "passages": [ [ "West Africa", "West Africa\n\nWest Africa is the westernmost region of Africa.", "West Africa has been defined as including 17 countries: Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo.", "The population of West Africa is estimated at about /1e6 round 0 million people as of .", "Studies of human mitochondrial DNA suggest that all humans share common ancestors from Africa, originated in the southwestern regions near the coastal border of Namibia and Angola at the approximate coordinates 12.5\u00b0 E, 17.5\u00b0S with a divergence in the migration path around 37.5\u00b0E, 22.5\u00b0N near the Red Sea.", "A particular haplogroup of DNA, haplogroup L2, evolved between 87,000 and 107,000 years ago or approx.", "90,000 YBP.", "Its age and widespread distribution and diversity across the continent makes its exact origin point within Africa difficult to trace with any confidence, however an origin for several L2 groups in West or Central Africa seems likely, with the highest diversity in West Africa.", "Most of its subclades are largely confined to West and western-Central Africa." ], [ "Africa", "Africa\n\nAfrica is the world's second largest and second most-populous continent (behind Asia in both categories).", "At about 30.3 million km (11.7 million square\u00a0miles) including adjacent islands, it covers 6% of Earth's total surface area and 20% of its land area.", "With\n/1e9 round 1 billion people as of , it accounts for about 16% of the world's human population.", "The continent is surrounded by the Mediterranean Sea to the north, the Isthmus of Suez and the Red Sea to the northeast, the Indian Ocean to the southeast and the Atlantic Ocean to the west.", "The continent includes Madagascar and various archipelagos.", "It contains 54 fully recognised sovereign states (countries), nine territories and two \"de facto\" independent states with limited or no recognition.", "The majority of the continent and its countries are in the Northern Hemisphere, with a substantial portion and number of countries in the Southern Hemisphere.", "Africa's average population is the youngest amongst all the continents; the median age in 2012 was 19.7, when the worldwide median age was 30.4.", "Algeria is Africa's largest country by area, and Nigeria is its largest by population." ] ], "gold": "West Africa or Western Africa is the westernmost region of Africa, and officially has 16 countries. Benin, Burkina Faso, Cape Verde, The Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, Senegal, Sierra Leone, and Togo, and if you include the United Kingdom Territory of Saint Helena, Ascension and Tristan da Cunha, there are 17. ", "prediction 1": "West Africa is the westernmost region of Africa and has been defined as including 17 countries. Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo make up the total number of countries in West Africa.", "prediction 2": "West Africa has been defined as including 17 countries: Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo. The population of West Africa is estimated at about /1e6 round 0 million people as of.", "prediction 3": "West Africa has been defined as including 17 countries: Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo. The population of West Africa is estimated at about /1e6 round 0 million people as of.", "prediction 4": "West Africa has been defined as including 17 countries: Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo. The population of West Africa is estimated at about /1e6 round 0 million people as of. It contains 54 fully recognised sovereign states, nine territories and two \"de facto\" independent states with limited or no recognition.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "West Africa is the westernmost region of Africa and has been defined as including 17 countries. Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo ", "start": 336, "end": 389 } ], "missing-info": [], "corrected-prediction": "West Africa is the westernmost region of Africa and has been defined as including 17 countries. Benin, Burkina Faso, the island nation of Cape Verde, Gambia, Ghana, Guinea, Guinea-Bissau, Ivory Coast, Liberia, Mali, Mauritania, Niger, Nigeria, the islands of Saint Helena, Ascension and Tristan da Cunha, Senegal, Sierra Leone and Togo. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where do you find red and yellow marrow?", "passages": [ [ "Bone marrow", "For example, normal fatty \"yellow\" marrow in adult long bones is of low density (-30 to -100 Hounsfield units), between subcutaneous fat and soft tissue.", "Tissue with increased cellular composition, such as normal \"red\" marrow or cancer cells within the medullary cavity will measure variably higher in density.", "MRI is more sensitive and specific for assessing bone bone composition.", "MRI enables assessment of the average molecular composition of soft tissues, and thus provides information regarding the relative fat content of marrow.", "In adult humans, \"yellow\" fatty marrow is the dominant tissue in bones, particularly in the (peripheral) appendicular skeleton.", "Because fat molecules have a high T1-relaxivity, T1-weighted imaging sequences show \"yellow\" fatty marrow as bright (hyperintense).", "Furthermore, normal fatty marrow loses signal on fat-saturation sequences, in a similar pattern to subcutaneous fat.", "When \"yellow\" fatty marrow becomes replaced by tissue with more cellular composition, this change is apparent as decreased brightness on T1-weighted sequences.", "Both normal \"red\" marrow and pathologic marrow lesions (such as cancer) are darker than \"yellow\" marrow on T1-weight sequences, although can often be distinguished by comparison with the MR signal intensity of adjacent soft tissues." ], [ "Bone marrow", "Additionally, bone marrow stem cells have been successfully transformed into functional neural cells, and can also potentially be used to treat illnesses such as inflammatory bowel disease.", "The composition of marrow is dynamic, as the mixture of cellular and non-cellular components (connective tissue) shifts with age and in response to systemic factors.", "In humans, marrow is colloquially characterized as \"red\" or \"yellow\" marrow (, , respectively) depending on the prevalence of hematopoetic cells vs fat cells.", "While the precise mechanisms underlying marrow regulation are not understood, compositional changes occur according to stereotypical patterns.", "For example, a newborn baby's bones exclusively contain hematopoietically active \"red\" marrow, and there is a progressive conversion towards \"yellow\" marrow with age.", "In adults, red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae, and variably found in the proximal epiphyseal ends of long bones such as the femur and humerus.", "In circumstances of chronic hypoxia, the body can convert yellow marrow back to red marrow to increase blood cell production.", "At the cellular level, the main functional component of bone marrow includes the progenitor cells which are destined to mature into blood and lymphoid cells." ] ], "gold": "In adult humans, yellow marrow is the dominant tissue in bones, particularly in the (peripheral) appendicular skeleton which consists of the bones that support appendages. Red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae. A newborn baby's bones exclusively contain hematopoietically active red marrow and there is a progressive conversion towards yellow marrow with age.", "prediction 1": "In humans, marrow is colloquially characterized as red or yellow marrow depending on the prevalence of hematopoetic cells vs fat cells. Red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae, and variably found in the proximal epiphyseal ends of long bones such as the femur and humerus. Yellow marrow is found in adult long bones, the medullary cavity. Tissue with increased cellular composition, such as normal \"yellow\" marrow or cancer cells within the medullary cavity will measure variably higher in density.", "prediction 2": "In humans, marrow is colloquially characterized as \"red\" or \"yellow\" marrow depending on the prevalence of hematopoetic cells vs fat cells. In adults, red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae, and variably found in the proximal epiphyseal ends of long bones such as the femur and humerus.", "prediction 3": "In adults, red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae, and variably found in the proximal epiphyseal ends of long bones such as the femur and humerus. Yellow marrow is found mainly in the proximal epiphyseal ends of long bones, such as the femur and humerus.", "prediction 4": "Red and yellow marrow are both associated with the hematopoietic cells vs fat cells in the marrow. They are found mainly in the central skeleton. Yellow marrow is found in the periphery of the skeleton.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 351 }, { "error type": "Irrelevant", "explanation": "", "start": 352, "end": 417 }, { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 577 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "In adult humans, \"yellow\" fatty marrow is the dominant tissue in bones, particularly in the (peripheral) appendicular skeleton. Red marrow is found mainly in the central skeleton, such as the pelvis, sternum, cranium, ribs, vertebrae and scapulae. A newborn baby's bones exclusively contain hematopoietically active red marrow and there is a progressive conversion towards yellow marrow with age." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did peru last qualify for world cup?", "passages": [ [ "Peru at the FIFA World Cup", "Peru at the FIFA World Cup\n\nPeru participated in the World Cup during the first World Cup in 1930 and in tournaments since 1958.", "Peru were invited to the first FIFA World Cup in Uruguay in 1930.", "They lost both of their games and finished 10th out of 13 teams.", "The team either withdrew or did not enter the next four tournaments, in 1934, 1938, 1950, and 1954.", "Peru participated but did not qualify in 1958, 1962, or 1966.", "Peru had its best result in Mexico 1970, finishing in seventh place.", "Peru again finished in the top eight at the World Cup in Argentina 1978.", "They finished first in their group during the first round of the tournament, but were eliminated after losing all their games in the second round.", "Peru reached the next World Cup finals in Spain 1982, although the team was eliminated in the first round after 2 draws and 1 loss.", "From 1986 to 2014, Peru did not advance past the CONMEBOL qualifying round.", "After finishing fifth in CONMEBOL qualifying, Peru reached the 2018 finals by defeating New Zealand in an intercontinental play-off.", "As one of the 13 national sides that accepted the invitation to the inaugural World Cup, Peru was placed in Group 3 with Romania and hosts Uruguay.", "With a mere 300 spectators, Peru's match against Romania holds the record of lowest attendance in a World Cup game." ] ], "gold": "Peru had its best result in\u00a0Mexico 1970, finishing in seventh place after qualifying for the World Cup on May 31,1970. Peru again finished in the top eight at the World Cup in\u00a0Argentina 1978 after qualifying on June 1,1978. They finished first in their group during the first round of the tournament, but were eliminated after losing all their games in the second round. Peru reached the next World Cup finals in\u00a0Spain 1982 after the June 13,1982 qualifier, although the team was eliminated in the first round after 2 draws and 1 loss.", "prediction 1": "The country of Peru participated in the FIFA World Cup in 1930. They participated in the tournaments but did not qualify in 1958, 1962, or 1966. Peru reached the last World Cup finals in Spain in 1982, although the team was eliminated in the first round after 2 draws and 1 loss. Peru reached the 2018 finals after defeating New Zealand in an intercontinental play-off.", "prediction 2": "In the 2022 FIFA World Cup, Peru qualified for the finals, but didn't advance past the first round of the tournament. In the 1990 FIFA World Cup, Peru qualified for the finals, but were eliminated after losing their opening two games. In the 2002 FIFA World Cup, Peru qualified for the finals, but were eliminated after losing their opening two games. In the 2018 FIFA World Cup, Peru qualified for the finals, but were eliminated after losing all their games in the first round.", "prediction 3": "Peru were invited to the first FIFA World Cup in 1930. They lost both of their games and finished 10th out of 13 teams. They did not qualify in 1958, 1962, or 1966. Peru again finished in the top eight at the World Cup in Argentina 1978. They finished first in their group during the first round of the tournament, but were eliminated after losing all their games in the second round. They reached the next World Cup finals in Spain 1982, although the team was eliminated in the first round after 2 draws and 1 loss. They reached the 2018 finals by defeating New Zealand in an intercontinental play-off.", "prediction 4": "Peru participated in the World Cup during the first World Cup in Uruguay in 1930 and in tournaments since 1958. Peru participated in the World Cup during the second World Cup in South Africa in 1990 and also in tournaments since 1986. Peru were invited to the first FIFA World Cup in Uruguay in 1930. They lost both of their games and finished 10th out of 13 teams. Peru again finished in the top eight at the World Cup in Argentina 1978, finishing in seventh place. Peru reached the next World Cup finals in Spain 1982, although the team was eliminated in the first round of the tournament, but were eliminated after losing all their games in the second round.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 63 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 280, "end": 369 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Peru had its best result in Mexico 1970, finishing in seventh place. Peru again finished in the top eight at the World Cup in Argentina 1978. They finished first in their group during the first round of the tournament, but were eliminated after losing all their games in the second round. Peru reached the last World Cup finals in Spain in 1982, although the team was eliminated in the first round after 2 draws and 1 loss. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When is the fa cup semi final played?", "passages": [ [ "2016\u201317 FA Cup", "Changes to previous rules meant that tied matches would have gone to extra-time and potentially a penalty shootout at this stage rather than to a replay, and that a fourth substitute would have been permitted in extra time.", "The round included Lincoln City from Level 5, who became the first non-league club to reach the quarter-finals since 1914.", "The four winners of the quarter-finals progressed to the semi-finals.", "The semi-final draw took place at Stamford Bridge on 13 March following the quarter-final tie between Chelsea and Manchester United.", "The semi-finals were played at Wembley Stadium on 22 and 23 April 2017.", "The following is the bracket which the FA Cup resembled.", "Numbers in parentheses next to the match score represent the results of a replay, except for the quarter-finals stage onwards.", "Numbers in parentheses next to the replay score represents the results of a penalty shoot-out except for the quarter-finals stage onwards.", "Theo Robinson moved to Southend United during the January transfer window with Lincoln still in the cup.", "The following matches were broadcast live on UK television:" ], [ "2015\u201316 FA Cup", "The three lowest ranked teams in this round, Oxford United, Portsmouth and Carlisle United, who competed in League Two (tier 4).", "The draw for the Fifth Round Proper was held on 31 January 2016.", "The fifth round proper was played across the weekend of 20 February 2016.", "The lowest ranked club in this round was Shrewsbury Town, who competed in League One (tier 3).", "The draw for the Sixth Round Proper was held on 21 February 2016.", "The sixth round proper was played across the weekend of 12 March 2016.", "The lowest ranked club remaining in this round was Reading, who competed in the League Championship (tier 2).", "This also marked the final year where sixth round would go into replay incase if teams where tied.", "The draw for the semi-finals was held on 14 March 2016.", "The semi-finals were played on 23 and 24 April 2016.", "The final took place on 21 May 2016 at Wembley Stadium.", "The domestic broadcasting rights for the competition were held by the BBC and subscription channel BT Sport.", "The BBC held the rights since 2014\u201315, while BT Sport since 2013\u201314.", "The FA Cup Final was required to be broadcast live on UK terrestrial television under the Ofcom code of protected sporting events." ], [ "2014\u201315 FA Cup", "In the draw, title holders Arsenal drew Middlesbrough (who eliminated Manchester City in fourth round) and Bradford City (who eliminated Chelsea in fourth round) were rewarded a home tie against Sunderland.", "The lowest ranked sides in this round were Bradford City and Preston North End (who compete at level 3 of English football)\n\n", "The Sixth Round draw took place on Monday 16 February 2015 at 7:35\u00a0pm on BBC One, and the regular matches were played between 7 and 9 March.", "The lowest ranked side in this round were Bradford City (who compete at level 3 of English football).", "The Semi-Finals draw took place on Monday 9 March 2015 at approx 9:45\u00a0pm in Old Trafford, Manchester and was broadcast on BBC One after the match between Manchester United and Arsenal.", "In the draw, title holders Arsenal drew Reading, while Aston Villa drew Liverpool.", "The matches were played at Wembley Stadium on 18 and 19 April 2015.", "The lowest ranked side in this round were Reading (who compete at level 2 of English football).", "The domestic broadcasting rights for the competition are held by the BBC and subscription channel BT Sport.", "The BBC regained the rights from ITV after six years, while BT Sport extended its existing deal carried over from obtaining ESPN's rights in February 2013.", "The FA Cup Final must be broadcast live on UK terrestrial television under the Ofcom code of protected sporting events." ] ], "gold": "The FA Cup competition begins in August and consists of twelve rounds, a semi-final and then a final in May. The semi-finals are completed before the final, and the final is normally held the Saturday after the Premier League season finishes in May. In previous years, the FA Cup semi-finals were played on 22 and 23 April 2017, 23 and 24 April 2016 and 18 and 19 April 2015.", "prediction 1": "The FA Cup semi finals were played between April 22 and 23, 2017, with the final being played on May 21, 2015 at Wembley Stadium.", "prediction 2": "The FA Cup semi-final draw took place at Stamford Bridge on 13 March following the quarter-final tie between Chelsea and Manchester United. The semi-finals were played at Wembley Stadium on 22 and 23 April 2017.", "prediction 3": "The FA Cup semi finals were played on 22 and 23 April 2017 at Wembley Stadium, with the final played on 21 May 2016 at Wembley Stadium.", "prediction 4": "The draw for the semi-finals was held on 14 March 2016. The semi-finals were played on 23 and 24 April 2016. The FA Cup Final was required to be broadcast live on UK terrestrial television under the Ofcom code of protected sporting events. The 2015\u201316 FA Cup had its semi-finals played on 9 March 2015 at approx 9:45 pm in Old Trafford, Manchester and was broadcast on BBC One after the match between Manchester United and Arsenal. The 2014\u20132015 FA Cup had its semi finals played on 9 March 2015 at approx 9:45 pm in Old Trafford, Manchester and was broadcast on BBC One after the match between Arsenal and Aston Villa d Liverpool. The 2015\u20132016 FA Cup Finals were played at Wembley Stadium on 22 and 23 April 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 129 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The 2016-2017 FA Cup semi finals were played between April 22 and 23, 2017. The 2015-2016 FA Cup semi finals were played on 23 and 24 April 2016. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who got the most medals in 2016 olympics?", "passages": [ [ "United States", "United States\n\nThe United States of America (USA), commonly known as the United States (U.S. or US) or America, is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions.", "At 3.8\u00a0million square miles (9.8\u00a0million km), the United States is the world's third- or fourth-largest country by total area and slightly smaller than the entire continent of Europe's 3.9\u00a0million square miles (10.1\u00a0million km).", "With a population of over 325 million people, the U.S. is the third most populous country.", "The capital is Washington, D.C., and the largest city by population is New York City.", "Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico.", "The State of Alaska is in the northwest corner of North America, bordered by Canada to the east and across the Bering Strait from Russia to the west.", "The State of Hawaii is an archipelago in the mid-Pacific Ocean.", "The U.S. territories are scattered about the Pacific Ocean and the Caribbean Sea, stretching across nine official time zones.", "The extremely diverse geography, climate, and wildlife of the United States make it one of the world's 17 megadiverse countries." ], [ "2016 Summer Olympics medal table", "Behind the United States, Great Britain were second on the medal table by golds (27), and third by overall medals (67) \u2013 their highest finish in the former case since the home games of 1908 and in the latter since 1920, while China were third by golds (26), but second by overall medals (70).", "Both countries were significantly behind the United States tally (46 golds, 121 medals), but well clear of a group of challengers for fourth in the table including Russia, Germany, France and 2020 hosts Japan.", "Athletes from 87 nations earned medals at the 2016 Summer Olympics, breaking the record of most nations winning a medal at a single edition of the Olympics.", "However, following reallocation due to doping sanctions, an 87th country was later awarded a medal at the 2008 Olympics, tying the record.", "Athletes from 59 nations earned gold medals at these games, also breaking the record for the most number of nations winning gold at a single games.", "Great Britain became the first country in the history of the modern Olympics to increase their tally of medals in the subsequent games after being the host nation \u2013 winning 67 total medals (with 27 golds) at these games compared to the 65 (with 29 golds) won in London four years previously.", "Host country Brazil won seven gold medals, their most at any single Summer Olympics." ], [ "Michael Phelps", "Michael Phelps\n\nMichael Fred Phelps II (born June 30, 1985) is an American retired competitive swimmer and the most successful and most decorated Olympian of all time, with a total of 28 medals.", "Phelps also holds the all-time records for Olympic gold medals (23), Olympic gold medals in individual events (13), and Olympic medals in individual events (16).", "When he won eight gold medals at the 2008 Beijing Games, Phelps broke fellow American swimmer Mark Spitz's 1972 record of seven first-place finishes at any single Olympic Games.", "At the 2004 Summer Olympics in Athens, Phelps had already tied the record of eight medals of any color at a single Games by winning six gold and two bronze medals.", "At the 2012 Summer Olympics in London, Phelps won four gold and two silver medals, and at the 2016 Summer Olympics in Rio de Janeiro, he won five gold medals and one silver.", "This made him the most successful athlete of the Games for the fourth Olympics in a row.", "Phelps is the long course world record holder in the men's 100 meter butterfly, 200 meter butterfly, and 400 meter individual medley as well as the former long course world record holder in the 200 meter freestyle and 200 meter individual medley." ] ], "gold": "The United States was the country that won the most medals in the 2016 Olympics, while Michael Phelps was the athlete that did. The USA led the medal table in the number of gold medals and overall medals, winning 46 gold and 121 total medals. Phelps, an American former competitive swimmer, won five gold medals and one silver at the 2016 Summer Olympics in Rio de Janeiro.", "prediction 1": "The United States won the most medals in 2016, with 121, followed by Great Britain, the United Kingdom, and China. At the 2016 Winter Olympics, 87 nations competed for medals, with Great Britain winning the most individual medals, the most overall medals, and the most overall medals. The most medals were won by the United States by Michael Phelps, with 28 total. Great Britain won the most overall medals, with 27 golds, and China won the most overall medals, with 70.", "prediction 2": "The United States won the most medals at the 2016 Summer Olympics, with 121 total medals. The most medals each athlete received was from the team event. Athletes from 87 nations earned medals at the 2016 Summer Olympics. Great Britain were second on the medal table by golds (27), and third by overall medals (67), their highest finish in the former case since the home games of 1908 and in the latter since 1920. China were third by golds (26), but second by overall medals (70), while Russia, Germany, France, and 2020 hosts Japan.", "prediction 3": "The United States won the most medals in 2016 Olympics, with 121 total medals, with 46 golds, and 121 overall medals. Athletes from 87 nations earned medals at the 2016 Summer Olympics, breaking the record for most nations winning a medal at a single edition of the Olympics. At the 2012 Summer Olympics in London, Michael Phelps won four gold medals and two silver medals, and at the 2016 Summer Olympics in Rio de Janeiro, he won five gold medals and one silver. Great Britain were second on the medal table by golds (27), and third by overall medals (67). Great Britain were second on the medal table by overall medals (67), but second by overall medals (26) and China were third by golds (26) and second by overall medals (70).", "prediction 4": "The United States got the most medals in 2016 Summer Olympics, with 121 total medals. The United Kingdom had the most overall medals with 27 and Great Britain had the most individual medals with 67. The United States had the most medals in the Winter Games with 108, while China had the most overall medals with 70. The most medals in the Winter Games were won by American swimmer Michael Phelps, with 28 medals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 83 }, { "error type": "Redundant", "explanation": "The United States won the most medals in 2016, with 121, followed by Great Britain, ", "start": 84, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 114 }, { "error type": "Unverifiable", "explanation": "", "start": 144, "end": 284 }, { "error type": "Redundant", "explanation": "The United States won the most medals in 2016, with 121, followed by Great Britain, the United Kingdom, and China. ", "start": 310, "end": 330 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5,6]}", "start": 355, "end": 364 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 365, "end": 407 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 427, "end": 461 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States won the most medals in 2016, with 46 golds and 121 total. The most medals were won by an athlete was by Michael Phelps, an American retired competitive swimmer, he won five gold medals and one silver." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who invaded south korea and tried to take over their country?", "passages": [ [ "History of Korea", "However, they came back with two different reports, and while the politicians split into sides, few proactive measures were taken.", "This conflict brought prominence to Admiral Yi Sun-sin as he contributed to eventually repelling the Japanese forces with the innovative use of his turtle ship, a massive, yet swift, ramming/cannon ship fitted with iron spikes.", "The use of the hwacha was also highly effective in repelling the Japanese invaders from the land.", "Subsequently, Korea was invaded in 1627 and again in 1636 by the Manchus, who went on to conquer China and establish the Qing dynasty, after which the Joseon dynasty recognized Qing suzerainty.", "Though Joseon respected its traditional subservient position to China, there was persistent loyalty for the perished Ming and disdain for the Manchus, who were regarded as barbarians.", "During the 19th century, Joseon tried to control foreign influence by closing its borders to all nations but China.", "In 1853 the USS South America, an American gunboat, visited Busan for 10 days and had amiable contact with local officials.", "Several Americans shipwrecked on Korea in 1855 and 1865 were also treated well and sent to China for repatriation.", "The Joseon court was aware of the foreign invasions and treaties involving Qing China, as well as the First and Second Opium Wars, and followed a cautious policy of slow exchange with the West." ], [ "History of Korea", "In 1866, reacting to greater numbers of Korean converts to Catholicism despite several waves of persecutions, the Joseon court clamped down on them, massacring French Catholic missionaries and Korean converts alike.", "Later in the year France invaded and occupied portions of Ganghwa Island.", "The Korean army lost heavily, but the French abandoned the island.", "The \"General Sherman\", an American-owned armed merchant marine sidewheel schooner, attempted to open Korea to trade in 1866.", "After an initial miscommunication, the ship sailed upriver and became stranded near Pyongyang.", "After being ordered to leave by the Korean officials, the American crewmen killed four Korean inhabitants, kidnapped a military officer and engaged in sporadic fighting that continued for four days.", "After two efforts to destroy the ship failed, she was finally set aflame by Korean fireships laden with explosives.", "In response, the United States confronted Korea militarily in 1871, killing 243 Koreans in Ganghwa island before withdrawing.", "This incident is called the Sinmiyangyo in Korea.", "Five years later, the reclusive Korea signed a trade treaty with Japan, and in 1882 signed a treaty with the United States, ending centuries of isolationism.", "In 1885, British Royal Navy occupied Geomun Island, and withdrew in 1887.", "Conflict between the conservative court and a reforming faction led to the Gapsin Coup in 1884." ], [ "North Korea", "In 1948, North Korea adopted \"Democratic People's Republic of Korea\" (/ \"Chos\u014fn Minjuju\u016di Inmin Konghwaguk\"; ) as its new legal name.", "In the wider world, because the government controls the northern part of the Korean Peninsula, it is commonly called North Korea to distinguish it from South Korea, which is officially called the \"Republic of Korea\" in English.", "Both governments consider themselves to be the legitimate government of the whole of Korea.", "For this reason, the people do not consider themselves as 'North Koreans' but as Koreans in the same divided country as their compatriots in the South and foreign visitors are discouraged from using the former term.", "After the First Sino-Japanese War and the Russo-Japanese War, Korea was occupied by Japan from 1910 to 1945.", "Japan tried to suppress Korean traditions and culture and ran the economy primarily for its own benefit.", "Korean resistance groups known as Dongnipgun (Liberation Army) operated along the Sino-Korean border, fighting guerrilla warfare against Japanese forces.", "Some of them took part in allied action in China and parts of South East Asia.", "One of the guerrilla leaders was the communist Kim Il-sung, who later became the first leader of North Korea." ] ], "gold": "Many countries have invaded South Korea to try to take over the country, beginning when Korea was invaded in 1627 and again in 1636 by\u00a0the Manchus, who went on to conquer China and establish the\u00a0Qing dynasty, led by Amin. France\u00a0invaded and occupied portions of Ganghwa Island in 1866, but the French abandoned the island even though the Korean army lost heavily. After the First Sino-Japanese War and the Russo-Japanese War, Korea was occupied by\u00a0Japan\u00a0from 1910 to 1945. In June 1950,\u00a0North Korea\u00a0invaded and almost conquered South Korea, but was driven back by the United Nations command, leading South Korean, American, European and international forces.", "prediction 1": "In 1867, the Japanese were the first foreign invaders of South Korea since the 16th century. In 1637, the Manchus invaded Korea and then again in 1636. In 1866 the General Sherman, an American-owned armed merchant marine sidewheel schooner, attempted to open Korea to trade. Then, in 1913, the United States invaded Korea militarily, killing 243 Koreans on Ganghwa Island. In 1945 Japan invaded Korea and took control of the country.", "prediction 2": "The Japanese invaded South Korea in 1627 and again in 1636 by the Manchus, who went on to conquer China and establish the Qing dynasty, after which the Joseon dynasty recognized Qing suzerainty. In 1866, France invaded and occupied portions of Ganghwa Island. The Korean army lost heavily, but the French abandoned the island. The British Royal Navy occupied Geomun Island, and withdrew in 1887. However, conflict between the conservative court and a reforming faction led to the Gapsin Coup in 1884.", "prediction 3": "The Joseon dynasty of Korea, founded in 1820, tried to control foreign influence by closing its borders to all nations but China. The Spanish invaded Korea in 1621, in 1632 and in 1640, and later again in 1636, by the Manchus, who went on to conquer China and establish the Qing dynasty. During the 19th century, the Joseon dynasty tried to control foreign influence by closing its borders to all nations but China. In 1867 the US Navy invaded Korea, and occupied portions of Ganghwa Island. The Korean army lost heavily, but the French abandoned the island. In 1871, the United States confronted Korea militarily, killing 243 Koreans in Ganghwa Island. In 1885, the British Royal Navy occupied Geomun Island and withdretrew in 1887.", "prediction 4": "In 1867, Japan invaded Korea and tried to take their country. In 1636, the Manchus invaded Korea, and in 1853 the USS South America visited Busan for 10 days and had amiable contact with local officials. In 1867, the French invaded Korea and occupied portions of Ganghwa Island. The Korean army lost heavily, but the French abandoned the island. In 1871, the United States confronted Korea militarily, killing 243 Koreans in Ganghwa Island. In 1867, the British Royal Navy occupied Geomun Island, and withdretreat sporadic fighting that continued for four days. The British Royal Navy occupied Geomun Island, and withdretreated in 1887. In 1880, the United States invaded Korea.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 96, "end": 101 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 274 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[10]}", "start": 284, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 372 }, { "error type": "Unverifiable", "explanation": "", "start": 373, "end": 433 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Korea was invaded in 1627 and again in 1636 by the Manchus, who went on to conquer China and establish the Qing dynasty. France invaded and occupied portions of Ganghwa Island in 1866, but the French abandoned the island even though the Korean army lost heavily. After the First Sino-Japanese War and the Russo-Japanese War, Korea was occupied by Japan from 1910 to 1945. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did the battle of britain begin and end?", "passages": [ [ "Possible results of a German victory at the Battle of Britain", "Possible results of a German victory at the Battle of Britain\n\nThere is much speculation on the possible results of a German victory at the Battle of Britain including how the war might have progressed if the Germans had achieved their objective of suppressing the British air defences.", "The Battle of Britain (German: \"Luftschlacht um England\" or \"Luftschlacht um Gro\u00dfbritannien\", literally \"Air battle for England\" or \"Air battle for Great Britain\") is the name given to the Second World War air campaign waged by the German Air Force (\"Luftwaffe\") against the United Kingdom during the summer and autumn of 1940.", "The objective of the campaign was to gain air superiority over the Royal Air Force (RAF), especially Fighter Command.", "The Battle of Britain was the first major campaign to be fought entirely by air forces, and was also the largest and most sustained aerial bombing campaign to that date.", "From July 1940, coastal shipping convoys and shipping centres, such as Portsmouth, were the main targets; one month later the \"Luftwaffe\" shifted its attacks to RAF airfields and infrastructure.", "As the battle progressed the \"Luftwaffe\" also targeted aircraft factories and ground infrastructure.", "Eventually the \"Luftwaffe\" resorted to attacking areas of political significance and using terror bombing strategy." ], [ "Herbert Ihlefeld", "RAF pilots claimed the destruction of 16 German aircraft, actual losses were four Do\u00a017s and three Bf\u00a0110s shot down plus further four damaged aircraft.", "These events marked the beginning of the Battle of Britain (10 July\u00a0\u2013 31 October 1940).", "On 11 July 1940, I. (J)/LG\u00a02 was ordered to relocate to Jever in northern Germany.", "In the following four weeks, the Gruppe received a period of rest and the aircraft were given a maintenance overhaul prior to moving back to the Channel Front, to an airfield at Marck, east of Calais, on 8 August.", "Adolf Hitler had issued F\u00fchrer Directive no. 17 (\"Weisung Nr.\" 17) on 1 August 1940; the strategic objective was to engage and defeat the RAF so as to achieve air superiority in preparation for Operation Sea Lion (\"Unternehmen Seel\u00f6we\"), the proposed amphibious invasion of Great Britain.", "On 13 August 1940, during Operation Eagle Attack (code name \"Adlertag\"), I. (J)/LG\u00a02 was tasked with providing fighter escort for Junkers Ju 87 dive bombers from IV.", "\"Gruppe\" of \"Lehrgeschwader\" 1 (LG\u00a01\u20141st Demonstration Wing) and II." ], [ "Battle of Britain Day", "Battle of Britain Day\n\nBattle of Britain Day is the name given to the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain.", "On this day the Luftwaffe embarked on an all-out attack against London.", "Around 1,500 aircraft took part in the air battles which lasted until dusk.", "The action was the climax of the Battle of Britain.", "In the aftermath of the raid, Hitler postponed Operation Sea Lion.", "Having been defeated in daylight, the \"Luftwaffe\" turned its attention to The Blitz night campaign which lasted until May 1941.", "Battle of Britain Day is now an annual commemoration of the battle in the United Kingdom.", "In Canada, the commemoration takes place on the third Sunday of September.", "In June 1940, the \"Wehrmacht\" had conquered most of Western Europe and Scandinavia.", "At that time, the only major power standing in the way of a German-dominated Europe was the British Empire and the Commonwealth.", "After having several peace offers rejected by the UK, Adolf Hitler ordered the \"Luftwaffe\" to destroy the RAF in order to gain air superiority or air supremacy as a prelude to launching Operation Sea Lion, an amphibious assault by the \"Wehrmacht\" (German armed forces) onto the British mainland.", "The Battle of Britain began on 10 July 1940, when the first \"Luftwaffe\" bomber fleets began attacking convoys and Royal Navy forces in English ports and the Channel." ] ], "gold": "The\u00a0Battle of Britain was a\u00a0military campaign\u00a0of the\u00a0Second World War, in which the\u00a0Royal Air Force\u00a0and the\u00a0Fleet Air Arm\u00a0of the\u00a0Royal Navy\u00a0defended the\u00a0United Kingdom\u00a0against large-scale attacks by\u00a0Nazi Germany's air force, the\u00a0Luftwaffe. It\u00a0began on 10 July 1940 and ended on 31 October 1940.", "prediction 1": "The Battle of Britain was a German air campaign waged by the Luftwaffe against the United Kingdom during the summer and autumn of 1940. The objective of the campaign was to gain air superiority over the Royal Air Force (RAF), especially Fighter Command. The Battle of Britain was also the largest and most sustained aerial bombing campaign to that date. The Battle of Britain Day is the name given to the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain.", "prediction 2": "The Battle of Britain was the first major campaign to be fought entirely by air forces, and was also the largest and most sustained aerial bombing campaign to that date. The Battle of Britain was waged by the German Air Force against the United Kingdom during the summer and autumn of 1940. The objectives of the campaign were to gain air superiority over the Royal Air Force (RAF), especially Fighter Command. The Battle of Britain was the first major campaign to be fought entirely by air forces, and was also the largest and most sustained aerial bombing campaign to that date. Battle of Britain Day is the name given to the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain.", "prediction 3": "The Battle of Britain, or Luftschlacht um England, was the name given to the Second World War air campaign waged by the German Air Force against the United Kingdom during the summer and autumn of 1940. The objectives of the campaign were to gain air superiority over the Royal Air Force (RAF), especially Fighter Command. The Battle of Britain was the first major campaign to be fought entirely by air forces, and was also the largest and most sustained aerial bombing campaign to that date. On 15 September 1940, the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain Day, the day of the day of the large-scale aerial battle that took place on 15 September 1940, the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain.", "prediction 4": "The Battle of Britain was an air campaign waged by the German Air Force against the United Kingdom during the summer and autumn of 1940. The objective of the campaign was to gain air superiority over the Royal Air Force (RAF), especially Fighter Command. The Battle of Britain began on 10 July 1940, when the first Luftwaffe bomber fleets began attacking convoys and Royal Navy forces in English ports and the Channel. The battle ended on 31 October 1940. Battle of Britain Day is the name given to the day of the large-scale aerial battle that took place on 15 September 1940, during the Battle of Britain.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 509 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 12 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Battle of Britain was a German air campaign waged by the Luftwaffe against the United Kingdom during the summer and autumn of 1940. The Battle of Britain began on 10 July 1940 and ended on 31 October 1940." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Japanese dish of salted green soybeans boiled in their pods?", "passages": [ [ "Edamame", "Edamame\n\nEdamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia.", "The pods are boiled or steamed and may be served with salt.", "In Japan, they are usually blanched in 4% salt water and not served with salt.", "When the beans are outside the pod, the term mukimame and Edamame in Japanese are also sometimes used.", "In Japan and Hong Kong, the name \"edamame\" is commonly used to refer to the dish.", "It literally means \u2018\u2018stem peas\u2019\u2019 (\u679d \"eda\" = \u2018\u2018branch\u2019\u2019 or \u2018\u2018stem\u2019\u2019 + \u8c46 \"mame\" = \u2018\u2018pea\u2019\u2019), because the beans were often sold while still attached to the stem.", "In China, \"Maodou\" is used commonly to refer to the dish, which literally means \u2018\u2018fur peas\u2019\u2019 (\u6bdb \"Mao\" = \u2018\u2018fur\u2019\u2019 + \u8c46 \"dou\" = \u2018\u2018pea\u2019\u2019).", "The earliest documented reference to the term \"edamame\" dates from the year 1275, when the Japanese monk Nichiren wrote a note thanking a parishioner for the gift of \"edamame\" he had left at the temple." ], [ "Edamame", "Edamame purchased fresh is preferably eaten the same day, with flavor degradation being noticeable in as few as 10 hours after harvest.", "However, fresh edamame will stay edible for three days when stored in the refrigerator.", "Damaged pods brown more rapidly however, mainly due to the enzyme polyphenol oxidase.", "If stored fresh, the pods should be kept humid to prevent discoloration and wilting.", "This can be accomplished by wrapping the pods in plastic or another material which traps moisture.", "Freezing fresh edamame is another option for maintaining good quality over a few months.", "Fresh edamame should be blanched first before being frozen.", "The United States Department of Agriculture states that edamame beans are a \"soybean that can be eaten fresh and are best known as a snack with a nutritional punch\".", "Edamame and other preparations of soybeans are rich in protein, dietary fiber, and micronutrients, particularly folate, manganese, phosphorus and vitamin K (table).", "The balance of fatty acids in 100 grams of edamame is 361\u00a0mg of omega-3 fatty acids to 1794\u00a0mg of omega-6 fatty acids.", "As a significant source of plant protein, edamame beans are under research to establish whether a relationship exists between soy consumption and reduction of disease risk." ] ], "gold": "Edamame is the name of a Japanese dish that consists of salted green soybeans that are boiled and still served in their pods. Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt or other condiments. When the beans are served outside their pods, the term mukimame is also sometimes used for the dish. The United States Department of Agriculture states that edamame beans are a \"soybean that can be eaten fresh and are best known as a snack with a nutritional punch.\"", "prediction 1": "Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt. In Japan, they are usually blanched in 4% salt water and not served with salt. Damaged pods brown more rapidly due to the enzyme polyphenol oxidase.", "prediction 2": "Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt. In Japan, they are usually blanched in 4% salt water and not served with salt. When the beans are outside the pod, the terms mukimame and Edamame in Japanese are also sometimes used.", "prediction 3": "Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt. In Japan, they are usually blanched in 4% salt water and not served with salt. The earliest documented reference to the term \"edamame\" dates from the year 1275, when the Japanese monk Nichiren wrote a note thanking a parishioner for the gift of \"edamamame\" he had left at the temple.", "prediction 4": "a Japanese dish of salted green soybeans boiled in their pods. Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt. In Japan, they are usually blanched in 4% salt water and not served with salt.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 241 }, { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 311 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Edamame is a preparation of immature soybeans in the pod, found in cuisines with origins in East Asia. The pods are boiled or steamed and may be served with salt. When the beans are outside the pod, the term mukimame is also sometimes used for the dish. The United States Department of Agriculture states that edamame beans are a \"soybean that can be eaten fresh and are best known as a snack with a nutritional punch.\"." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who does peter griffin voice on family guy?", "passages": [ [ "Peter Griffin", "MacFarlane drew inspiration for the voice of Peter from the security guards he overheard talking while he was attending the Rhode Island School of Design; according to him, \"I knew a thousand Peter Griffins growing up in New England.", "Guys who would not think before they spoke, like [switching to Peter's voice] there was no self-editing mechanism.", "[Pointing to himself] Everything in here, [pointing to his front] it's coming out here\".", "MacFarlane also voices many of Peter's ancestors who share the same type of voice.", "He noted in an interview that he voices Peter and the rest of the characters partly because they initially had a small budget, but also that he prefers to have the freedom to do it himself.", "In another interview, he mentioned that Peter's voice is one of the most difficult to do.", "There have been several occasions where MacFarlane does not voice Peter.", "In the episode \"No Meals on Wheels\" (season 5, 2007), actor Patrick Stewart voiced Peter in a cutscene, but MacFarlane voices Peter for the rest of the episode.", "In the episode \"Family Gay\" (season 7, 2009), Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\"." ], [ "Peter Griffin", "Peter Griffin\n\nPeter Griffin is the main character of the American animated sitcom \"Family Guy\".", "He is voiced by the series' creator, Seth MacFarlane, and first appeared on television, along with the rest of the Griffin family, in the 15-minute pilot pitch of \"Family Guy\" on December 20, 1998.", "Peter was created and designed by MacFarlane himself.", "MacFarlane was asked to pitch a pilot to the Fox Broadcasting Company based on \"Larry & Steve\", a short made by MacFarlane which featured a middle-aged character named Larry and an intellectual dog, Steve.", "After the pilot was given the green light, the Griffin family appeared in the episode \"Death Has a Shadow\".", "Peter is married to Lois Griffin and is the father of Meg, Chris, and Stewie.", "He also has a dog named Brian, with whom he is best friends.", "He has worked at a toy factory, and at Quahog's Brewery.", "Despite the suburban blue-collar routine of his life, he has had a number of remarkable experiences.", "Peter's voice was inspired by the security guards that MacFarlane heard at his school.", "His appearance was a redesign of the protagonist Larry from MacFarlane's previous animated short films \"The Life of Larry\" and \"Larry & Steve\"." ] ], "gold": "Peter Griffin is a character on the animated television show Family Guy. He is mainly voiced by Seth MacFarlane. However, there have been times other people have been the voice for Peter Griffin also. Patrick Stewart did the cutscene in episode \"No Meals on Wheels\", Seth Rogen did in the episode \"Family Gay\" and Jamison Yang did in the episode \"Road to the Multiverse\".", "prediction 1": "Peter Griffin is the main character of the American animated sitcom Family Guy. He is voiced by the series' creator, Seth MacFarlane, and first appeared on television, along with the rest of the Griffin family, in the 15-minute pilot pitch of Family Guy on December 20, 1998. In the episode No Meals on Wheels, Patrick Stewart voiced Peter in a cutscene, but MacFarlane voices Peter for the rest of the episode. In the episode Family Gay, Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\".", "prediction 2": "Peter Griffin is the main character of the American animated sitcom Family Guy. Peter is voiced by the series' creator, Seth MacFarlane. In the episode No Meals on Wheels (season 5, 2007), actor Patrick Stewart voiced Peter in a cutscene, but MacFarlane voices Peter for the rest of the episode. In the episode Family Gay (season 7, 2009), Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\".", "prediction 3": "Peter Griffin is the main character of the American animated sitcom Family Guy and is voiced by the series' creator, Seth MacFarlane. MacFarlane drew inspiration for the voice of Peter from the security guards that MacFarlane heard at his school. MacFarlane voiced Peter and the rest of the Griffin family, in the 15-minute pilot pitch of the show on December 20, 1998. In the episode No Meals on Wheels, Patrick Stewart voiced Peter in a cutscene, but MacFarlane voiced Peter for the rest of the episode. In the episode Family Gay, Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\" and Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\". In the episode Family Gay, Seth Rogen provided a guest-voice as Peter", "prediction 4": "Peter Griffin is the main character of the American animated sitcom Family Guy. He is voiced by the series' creator, Seth MacFarlane, and first appeared on television, along with the rest of the Griffin family, in the 15-minute pilot pitch of Family Guy on December 20, 1998. In the episode \"No Meals on Wheels\" (season 5, 2007), actor Patrick Stewart voiced Peter in a cutscene, but MacFarlane voices Peter for the rest of the episode. In the episode \"Family Gay\" (season 7, 2009), actor Seth Rogen provided a guest-voice as Peter under the effects of the \"Seth Rogen gene\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 411 }, { "error type": "Irrelevant", "explanation": "", "start": 482, "end": 525 } ], "missing-info": [], "corrected-prediction": "Peter Griffin is the main character of the American animated sitcom Family Guy. He is voiced by the series' creator, Seth MacFarlane. In the episode No Meals on Wheels, Patrick Stewart voiced Peter in a cutscene. In the episode Family Gay, Seth Rogen provided a guest-voice as Peter." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Consubstantial with the father in the creed means what?", "passages": [ [ "Consubstantiality", "Since the Latin language lacks a present active participle for the verb \"to be\", Latin authors rendered the Greek noun \"ousia\" (being) as \"substantia\" or \"essentia\", and the Greek adjective \"homoousios\" (of the same being) as \"consubstantialis\" or \"coessentialis\".", "Unlike the Greek words, which are etymologically related to the Greek verb \"to be\" and connote one's own personal inherent character, Latin \"substantia\", connotes \"matter\" as much as it connotes \"being\".", "The term \"consubstantial\" is also used to describe the common humanity which is shared by all human persons.", "Thus, Jesus Christ is said to be \"consubstantial\" with the Father in his divinity and \"consubstantial\" with us in his humanity.", "It has also been noted that this Greek term \"homoousian\" or \"consubstantial\", which Athanasius of Alexandria favored, and was ratified in the Nicene Council and Creed, was actually a term reported to also be used and favored by the Sabellians in their Christology.", "And it was a term that many followers of Athanasius were actually uneasy about." ], [ "Consubstantiality", "The \"Semi-Arians\", in particular, objected to the word \"homoousian\".", "Their objection to this term was that it was considered to be un-Scriptural, suspicious, and \"of a Sabellian tendency\".", "This was because Sabellius also considered the Father and the Son to be \"one substance\".", "Meaning that, to Sabellius, the Father and Son were \"one essential Person\".", "This notion, however, was also rejected at the Council of Nicaea, in favor of the Athanasian formulation and creed, of the Father and Son being distinct yet also co-equal, co-eternal, and con-substantial Persons.", "Some English-speaking translators and authors still prefer the words \"substance\" and \"consubstantial\" to describe the nature of God in Christianity.", "Translations of the Nicene Creed into English often reflect the preference of using \"of the same being\" rather than \"consubstantial\" to describe the relationship of the Son to the Father.", "When the new translation of the Roman Missal was introduced in 2011, \"consubstantial\" was introduced as the more accurate translation of the text in Latin.", "It replaced the phrase \"one in being\" and was attacked as being archaic.", "The change was defended because \"one in being\" was considered to be too ambiguous." ], [ "Consubstantiality", "Consubstantiality\n\nConsubstantiality (Latin: \"consubstantialitas\"), or coessentiality (Latin: \"coessentialitas\"), is a notion in Christian theology referring to the \"common properties\" of the divine persons of the Christian Trinity, and connotes that God the Father, God the Son, and God the Holy Spirit are \"of the same substance\" (\"consubstantial\"), or \"of the same essence\" (\"coessential\").", "The notion of \"consubstantiality\" or \"coessentiality\" was developed gradually, during the first centuries of Christian history, with main theological debates and controversies being held between the First Council of Nicaea (325) and the First Council of Constantinople (381).", "Latin adjective \"consubstantialis\" was coined by Tertullian in \"Against Hermogenes\" 44, as a translation of the Greek term homoousios." ] ], "gold": "Consubstantiality denotes identity of substance or essence in spite of difference in aspect and is best known use is in regard to an account, in Christian theology, of the relation between Jesus Christ and God the Father. Consubstantial with the father in the creed means common humanity which is shared by all human persons. Translations into English often say consubstantial with the father in the creed means of the same being. Some English-speaking translators and authors still prefer Consubstantial with the father in the creed means nature of God in Christianity.", "prediction 1": "Consubstantiality, or coessentiality, is a notion in Christian theology referring to the \"common properties\" of the divine persons of the Christian Trinity. It connotes that God the Father, God the Son, and God the Holy Spirit are \"of the same substance\" (\"consubstantial\"), or \"of the same essence\" (\"coessential\"). The Nicene Creed, in its entirety, refers to the consubstantiality of the Son with the Father.\n", "prediction 2": "Consubstantiality, Latin for \"substance\", or coessentiality, or simply \"the same thing\" in the creed, is a notion in Christian theology referring to the \"common properties\" of the divine persons of the Christian Trinity. It connotes that God the Father, God the Son, and God the Holy Spirit are \"of the same substance\" (consubstantial) or \"of the same essence\" (coessential).", "prediction 3": "Consubstantial, Latin for \"of the same substance,\" also known as coessential, is the etymological term that is used to describe the events of the Christian trinity. The notion of consubstantiality refers to the \"common properties\" of the divine persons of the Christian Trinity,, and connotes that God the Father, God the Son, and God the Holy Spirit are \"of the same substance\" or \"of the same essence\". In the Nicene Creed, God is consubstantial with the father in the body, as a consubstantial with the father in the person of God the Holy Spirit, is a notion in Christian theology referring to the \"of the same substance\" or coessentiality. It also means a given description of the human being, eating the human person with the father.", "prediction 4": "The Nicene Creed used the term \"consubstantial\" rather than the French phrase \"one in being\". The Greek term \"homoousios\" was adopted by Athanasius of Alexandria, was ratified by the Council of Nicaea, and was translated as \"consubstantial\". The Latin adjective \"consubstantialis\" was coined by Tertullian in \"Against Hermogenes\" 44, as a translation of the Greek term homoousios\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 37 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 156 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 317, "end": 412 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 316 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Consubstantiality is a notion in Christian theology. It is also used to describe the common humanity which is shared by all human persons. Translations of the Nicene Creed into English often reflect the preference of using \"of the same being\". Some English-speaking translators and authors still prefer the words \"substance\" and \"consubstantial\" to describe the nature of God in Christianity." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sang the original i'll be there?", "passages": [ [ "I'll Be There (The Jackson 5 song)", "I'll Be There (The Jackson 5 song)\n\n\"I'll Be There\" is a soul song written by Berry Gordy, Hal Davis, Bob West, and Willie Hutch.", "The song was recorded by The Jackson 5 and released by Motown Records on August 28, 1970 as the first single from their \"Third Album\" on the same date.", "Produced by the songwriters, \"I'll Be There\" was The Jackson 5's fourth number one hit in a row (after \"I Want You Back\" in 1969, \"ABC\" and \"The Love You Save\" earlier in 1970), making them the first black male group to achieve four consecutive number one pop hits.", "\"I'll Be There\" is also notable as the most successful single released by Motown during its \"Detroit era\" (1959\u201372).", "The cover version/duet by Mariah Carey and Trey Lorenz was recorded during Carey's appearance on \"MTV Unplugged\" in 1992, and released as the first single from her EP \"MTV Unplugged\" in the second quarter of 1992.", "Co-produced by Carey and Walter Afanasieff, \"I'll Be There\" became Carey's sixth number one single in the U.S., and her biggest hit elsewhere at the time." ], [ "I'll Be There (Bobby Darin song)", "I'll Be There (Bobby Darin song)\n\n\"I'll Be There\" is a song written and originally recorded by Bobby Darin in 1960.", "It was first released as B-side to his single \"Bill Bailey\" (ATCO 6167).", "As such it entered the Billboard charts on September 11, 1960 and reached position 79.", "Invariably used as the epilogue song at The Cavern Club, it became a Canadian number one hit for one of its bands, Gerry and the Pacemakers (The US and UK singles were different recordings).", "Elvis Presley recorded a cover version in early 1969.", "The song was released in April 1970 as the first track on side two of Presley's LP \"Let's Be Friends\".", "The song features many big band arrangements and an extended jazzy instrumental section.", "The track runs 2:21.", "Other artists recording the song included Cissy Houston (a 1970 single) and Cass Elliot, on her album \"Cass Elliot\" (1972).", "It was also sung by Daveigh Chase in the \"D.I.V.O.R.C.E.\" episode of the television series \"Big Love\".", "Chase's character Rhonda Volmer sang the song while performing a striptease at a club." ] ], "gold": "The song \"I'll Be There\" that was written and originally recorded by Bobby Darin was first released as B-side to his single \"Bill Bailey.\" As such it entered the Billboard charts on July 11, 1960 and reached position 79. The song \"I'll Be There\" by the Jackson 5 was the first single released on their Third Album. It was written by Berry Gordy, Hal Davis, Bob West, and Willie Hutch and released by Motown Records on August 28, 1970.", "prediction 1": "The original I'll Be There was sung by Berry Gordy, Hal Davis, Bob West, and Willie Hutch. The song was recorded by The Jackson 5 and released by Motown Records on August 28, 1970. The cover version/duet by Mariah Carey and Trey Lorenz was recorded during Carey's appearance on MTV Unplugged in 1992. Elvis Presley recorded a cover version in early 1969.\n", "prediction 2": "The original song, I'll Be There, was sung by Berry Gordy, Hal Davis, Bob West, and Willie Hutch. The song was performed by The Jackson 5 during their appearance on MTV Unplugged in 1992. In 1970, Elvis Presley recorded a cover version of the song. Various artists recorded cover versions of the song, including Bobby Darin in the 1960s, and Mariah Carey in 1992.", "prediction 3": "It was Daveigh Chase, Sam Phillips, John Mayer, and Little Richard who sang the original I'll Be There song, prior to their recording of the '60s soul song. The original version of the song was sung by Motown Records employee Bobby Darin. In the 1960s, Elvis Presley sang a cover version of the song as well. In the 1970s, The Jackson 5 recorded the version of the song and released it on their Third Album. The 1992 cover version was sung by Mariah Carey and Trey Lorenz. Of the original I'll Be There, The Jackson 5 released their Third Album on August 28, 1970.", "prediction 4": "There are several I'll Be There songs. Bobby Darin sang the original I'll Be There and the Jackson 5 sang the cover of it. Daveigh Chase sang the original I'll Be There in the \"D.I.V.O.R.C.E.\" episode of the television series Big Love. Mariah Carey and Trey Lorenz sang a cover of it during a 2002 appearance on MTV's Unplugged.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 31, "end": 35 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 355 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The original I'll Be There was originally recorded by Bobby Darin and first released as B-side to his single \"Bill Bailey\". As such it entered the Billboard charts on September 11, 1960 and reached position 79. The song \"I'll Be There\" by The Jackson 5 was written by Berry Gordy, Hal Davis, Bob West, and Willie Hutch. It was released by Motown Records on August 28, 1970 and was the first single from their \"Third Album\"." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did england last get into semi finals?", "passages": [ [ "Montenegro women's national football team", "Montenegro women's national football team\n\nThe Montenegro women's national football team represents Montenegro in international women's football, and it is organised by Football Association of Montenegro.", "Montenegrin women's team was founded in 2012, six years after Montenegro gained independence.", "It is organised and headed by Football Association of Montenegro.", "The team is founded four years after the establishing of first women's football competition in Montenegro.", "With head coach Zoran Mijovi\u0107, Montenegro played first match on 13 March 2012 in Bar, against Bosnia and Herzegovina (2:3).", "Two days later, Montenegro gained its first draw, also against Bosnia and Herzegovina (2:2).", "Montenegro made its official competitive debut on 4 April 2013 in the 2015 World Cup qualification's preliminary round, drawing 3\u20133 against the Faroe Islands.", "Only two days later, Montenegro made first win in team's history, against Georgia - 2:0.", "On that tournament, played in Vilnius, Montenegro made a big surprise, because they qualified for the final round of 2015 FIFA Women's World Cup qualification (UEFA).", "On April 2015, on debut of new head coach Dervi\u0161 Had\u017eiosmanovi\u0107, Montenegro made biggest win in team's history, against Macedonia away - 7:0.", "Montenegro participated in Euro 2017 qualifiers, but finished without any single point earned." ], [ "England at the FIFA World Cup", "England at the FIFA World Cup\n\nThe England national football team has competed at the FIFA World Cup since 1950.", "The FIFA World Cup is the premier competitive international football tournament, first played in 1930, whose finals stage has been held every four years since, except 1942 and 1946, due to the Second World War.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the finals, is used to determine which teams qualify for the finals.", "The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1\u00a0million people watching the 2006 Final.", "England did not enter the competition until 1950, but have entered all eighteen subsequent tournaments.", "They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States), and have failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup." ], [ "Australia at the FIFA Women's World Cup", "Australia at the FIFA Women's World Cup\n\nThe Australia women's national association football team has represented Australia at the FIFA Women's World Cup on six occasions in 1995, 1999, 2003, 2007, 2011 and 2015 and have qualified for the 2019 tournament.", "The team also participated in the 1988 FIFA Women's Invitation Tournament, a precursor to the Women's World Cup." ], [ "Marcus Rashford", "The tournament saw Rashford make one start in a group stage match against Belgium, plus an additional five appearance as a substitute (in every match except Panama).", "Rashford only goal came in the Last 16 penalty shoot out against Columbia which saw England progress to the Quarter Finals, with England finishing fourth overall - their best performance since 1990.", "On 8 September 2018, Rashford scored at Wembley Stadium in England's UEFA Nations League opener against Spain, losing 2-1.", "Three days later Rashford also scored in a 1-0 friendly win over Switzerland.", "In the October international break Rashford was named for the Nation's League squad to play Croatia, the match resulting in a 0-0 draw.", "Later that week, he scored a goal and an assist in the 3-2 Nation's League away win against Spain.", "England's final Nation's League game saw Rashford play in a 2\u20131 win over Croatia.", "This win saw England top their group and quality for the Nation's League finals in June 2019.", "Manchester United\n\nEngland\n\nIndividual" ] ], "gold": "England has been to both the men's and women's FIFA World Cup. The England national football team has competed at the FIFA World Cup since 1950. The last time England made it to the Semi-Finals at the men's FIFA World Cup was 2018. England have participated five times at the FIFA Women's World Cup: in 1995, 2007, 2011, 2015 and 2019. 2019 was the last time England made it to the Semi-Finals of the Women's FIFA World Cup.", "prediction 1": "The England national football team has competed at the FIFA World Cup since 1950. They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States). On 8 September 2018, Marcus Rashford scored at Wembley Stadium in England's UEFA Nations League opener against Spain, losing 2-1.", "prediction 2": "The England national football team has competed at the FIFA World Cup since 1950. In the 1960 FIFA World Cup, England failed to advance from the group stages on three occasions and in 1970 FIFA World Cup, the team failed to advance from the group stages on three occasions. In the 2016 FIFA World Cup, the team failed to advance from the group stages on three occasions and in 2017 England failed to advance from the group stages on three occasions. In the 2018 FIFA World Cup, England failed to advance from the group stages on two occasions and in 2019 they did not advance from the group stages a total of 16 penalty shoot out against Columbia which saw England progress to the Quarter Finals, with England finishing fourth overall - their best performance since 1990. In the 2016 England failed to advance from the finals, their best performance since 1990, they have failed to advance from the group stages on three occasions.", "prediction 3": "The England national football team has competed at the FIFA World Cup since 1950. England has qualified for the finals on three occasions, 1974, 1978, and 1994, due to the Second World War. In the 2016 FIFA World Cup, England advanced through the group stages, while in the 2018 FIFA World Cup, England advanced through the group stages. In the 2014 FIFA World Cup, England advanced through the group stages, while in the 2013 FIFA World Cup, they advanced through the group stages.", "prediction 4": "The England national football team has competed at the FIFA World Cup since 1950. They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States). Their last semi final appearance was in the 2006 FIFA World Cup.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 338 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 208 } ], "missing-info": [], "corrected-prediction": "The England national football team has competed at the FIFA World Cup since 1950. They have failed to qualify for the finals on three occasions, 1974, 1978, and 1994." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "What rights are included in the declaration of independence?", "passages": [ [ "Life, Liberty and the pursuit of Happiness", "Life, Liberty and the pursuit of Happiness\n\n\"Life, Liberty and the pursuit of Happiness\" is a well-known phrase in the United States Declaration of Independence.", "The phrase gives three examples of the \"unalienable rights\" which the Declaration says have been given to all humans by their creator.", "The United States Declaration of Independence was drafted by Thomas Jefferson, and then edited by the Committee of Five, which consisted of Jefferson, John Adams, Benjamin Franklin, Roger Sherman, and Robert Livingston.", "It was then further edited and adopted by the Committee of the Whole of the Second Continental Congress on July 4, 1776.", "The second paragraph of the first article in the Declaration of Independence contains the phrase \"Life, Liberty and the pursuit of Happiness\".", "Jefferson's \"original Rough draught\" is on exhibit in the Library of Congress.", "This version was used by Julian Boyd to create a transcript of Jefferson's draft, which reads:\n\nThe Committee of Five edited Jefferson's draft.", "Their version survived further edits by the whole Congress intact, and reads:\n\nA number of possible sources or inspirations for Jefferson's use of the phrase in the Declaration of Independence have been identified, although scholars debate the extent to which any one of them actually influenced Jefferson." ], [ "Pangrammatic window", "That to secure these rights, Governments are instituted among Men, deriving their just powers from the consent of the governed, That whenever any Form of Government becomes destructive of these ends, it is the Right of the People to alter or to abolish it, and to institute new Government, laying its foundation on such principles, and organizing its powers in such form, as to them shall seem most likely to effect their Safety and Happiness.", "Prudence, indeed, will dictate that Governments long established should not be changed for light and transient causes; and accordingly all experience hath shewn, that mankind are more disposed to suffer, while evils are sufferable, than to right themselves by abolishing the forms to which they are accustomed.\"" ], [ "Right of revolution", "Right of revolution\n\nIn political philosophy, the right of revolution (or right of rebellion) is the right or duty of the people of a nation to overthrow a government that acts against their common interests and/or threatens the safety of the people without cause.", "Stated throughout history in one form or another, the belief in this right has been used to justify various revolutions, including the American Revolution, French Revolution, the Russian Revolution, and the Iranian Revolution.", "To justify their overthrowing of the earlier Shang Dynasty, the kings of the Zhou Dynasty (1122 \u2013 256 BC) of China promulgated the concept known as the Mandate of Heaven, that Heaven would bless the authority of a just ruler, but would be displeased and withdraw its mandate from a despotic ruler.", "The Mandate of Heaven would then transfer to those who would rule best.", "Chinese historians interpreted a successful revolt as evidence that the Mandate of Heaven had passed on.", "Throughout Chinese history, rebels who opposed the ruling dynasty made the claim that the Mandate of Heaven had passed, giving them the right to revolt.", "Ruling dynasties were often uncomfortable with this, and the writings of the Confucian philosopher Mencius (372 \u2013 289 BC) were often suppressed for declaring that the people have the right to overthrow a ruler that did not provide for their needs." ] ], "gold": "The Declaration of Independence includes the rights of life, liberty and the pursuit of happiness, also known as unalienable rights, as well as the right of revolution. Life, liberty and the pursuit of happiness is a well-known phrase in the United States Declaration of Independence. This phrase gives three examples of the unalienable rights which the Declaration says have been given to all humans by their creator and which governments are created to protect. Like the other principles in the Declaration of Independence, this phrase is not legally binding but has been widely referenced and seen as an inspiration for the basis of government. The U.S. Declaration of Independence also includes the right of revolution. In political philosophy, the right of revolution is the right or duty of a people to alter, abolish or throw off such Government that acts against their common interests and/or threatens the safety of the people without cause. Additionally, the Declaration of Independence states that it is then the right of the people to institute new Government, \"laying its foundation on such principles, and organizing its powers in such form, as to them shall seem most likely to effect their safety and happiness.\"", "prediction 1": "In the Declaration of Independence, the rights of freedom, life, liberty and the pursuit of happiness are listed. These rights include the right to free speech, to the right to petition the government, and to the right to protest government actions.", "prediction 2": "In the Declaration of Independence, the phrase \"Life, Liberty and the pursuit of Happiness\" gives three examples of the \"unalienable rights\" which the Declaration says have been given to all humans by their creator. The rights included in the Declaration of Independence were: The right to life, liberty, and the right to the pursuit of happiness, the right to rule, and the right to overthrow a government that acts against their common interests and/or threatens the safety of the people without cause.", "prediction 3": "The Declaration of Independence includes the following rights: Life, Liberty and the pursuit of Happiness, the right to a free, independent and sovereign state, the right to a free and sovereign nation, the right to a fair trial, and the right to a free press.", "prediction 4": "In the Declaration of Independence, the rights that are listed as \"unalienable\" are the rights that have been given to all humans by their creator. The right to the right of revolution is a right that the people of a nation have to overthrow a government that acts against their common interests and/or threatens the safety of the people without cause.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 114, "end": 249 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the Declaration of Independence, the rights of freedom, life, liberty and the pursuit of happiness are listed. The phrase gives three examples of the \"unalienable rights\" which the Declaration says have been given to all humans by their creator. That to secure these rights, Governments are instituted among Men, deriving their just powers from the consent of the governed, That whenever any Form of Government becomes destructive of these ends, it is the Right of the People to alter or to abolish it, and to institute new Government, laying its foundation on such principles, and organizing its powers in such form, as to them shall seem most likely to effect their Safety and Happiness. In political philosophy, the right of revolution (or right of rebellion) is the right or duty of the people of a nation to overthrow a government that acts against their common interests and/or threatens the safety of the people without cause." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who is the lead singer of doobie brothers?", "passages": [ [ "The Doobie Brothers", "The Doobie Brothers\n\nThe Doobie Brothers are an American rock band from San Jose, California.", "The group has sold more than 40 million albums worldwide.", "It has been active for five decades, with its greatest success in the 1970s.", "The band's history can be roughly divided into three eras.", "From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982.", "The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "Every incarnation of the group emphasized vocal harmonies.", "The Doobie Brothers were inducted into the Vocal Group Hall of Fame in 2004.", "Drummer John Hartman arrived in California determined to meet Skip Spence of Moby Grape and join an aborted Grape reunion.", "Spence introduced Hartman to singer, guitarist, and songwriter Tom Johnston and the two proceeded to form the nucleus of what would become the Doobie Brothers.", "Johnston and Hartman called their fledgling group \"Pud\" and experimented with lineups (occasionally including Spence) and styles as they performed in and around San Jose.", "They were mostly a power trio (along with bassist Greg Murphy) but briefly worked with a horn section." ], [ "Tom Johnston (musician)", "Johnston's condition was so precarious that he required emergency hospitalization for a bleeding ulcer.", "With Johnston convalescing and the tour already underway, fellow Doobie Brother Jeff Baxter proposed recruiting a fellow Steely Dan alum to fill the hole.", "This led to the emergency hiring of Michael McDonald, who became the lead singer of the band.", "Restored to fitness in 1976 and briefly back in the fold, Johnston contributed one original song to \"Takin' It to the Streets\" (\"Turn It Loose\"), and also added a vocal cameo to Pat Simmons' tune \"Wheels of Fortune\".", "He also made live appearances with the band in 1976 (appearing in a concert filmed that year at the Winterland in San Francisco, excerpts from which appear occasionally on VH1 Classic), but was sidelined once again in the fall due to exhaustion.", "None of Johnston's songs appeared on \"Livin' on the Fault Line\", though he had written and the band had recorded five of his compositions for the album.", "Finally, before \"Fault Line\" was released, Johnston had his songs removed and left the band that he co-founded (though he received credit for guitars and vocals and was pictured on the album's inner sleeve band photo)." ] ], "gold": "The Dobbie Brothers band had different lead singer through out the years. Charles Thomas Johnston was their first and third lead singer while Michael McDonald was their second.", "prediction 1": "The Doobie Brothers is an American rock band from San Jose, California. The band has sold more than 40 million albums worldwide. In 1970, lead vocalist Tom Johnston was replaced by guitarist and singer Michael McDonald. In 1975, Johnston quit the group, and was replaced by Michael McDonald, whose interests in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "prediction 2": "The Doobie Brothers are an American rock band from San Jose, California. They have sold more than 40 million albums worldwide. From 1970 to 1975, the lead singer of the band was Tom Johnston. Johnston quit the group in 1975 and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "prediction 3": "The Doobie Brothers are an American rock band from San Jose, California. The band has sold more than 40 million albums worldwide. From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald. The Doobie Brothers were inducted into the Vocal Group Hall of Fame in 2004.", "prediction 4": "The Doobie Brothers are an American rock band from San Jose, California. They have sold more than 40 million albums worldwide and its greatest success was in the 1970s. The band's history can be roughly divided into three eras. From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 128 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 132, "end": 137 }, { "error type": "Unverifiable", "explanation": "", "start": 181, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 463 }, { "error type": "Irrelevant", "explanation": "", "start": 464, "end": 508 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 346 }, { "error type": "Redundant", "explanation": "lead vocalist Tom Johnston was replaced by guitarist and singer Michael McDonald. ", "start": 220, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 365, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 403, "end": 410 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Dobbie Brothers band had different lead singer through out the years. Tom Johnston was their first and third lead singer while Michael McDonald was their second." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "What is the population of greenville county south carolina?", "passages": [ [ "Greenville County, South Carolina", "Greenville County, South Carolina\n\nGreenville County is a county located in the state of South Carolina, in the United States.", "As of the 2010 census, the population was 451,225, making it the most populous county in the state.", "In 2017, the estimated population of the county was 506,837.", "Its county seat is Greenville.", "The county is also home to the Greenville County School District, the largest school system in South Carolina.", "County government is headquartered at Greenville County Square.", "Greenville County is included in the Greenville-Anderson-Mauldin, SC Metropolitan Statistical Area.", "According to the U.S. Census Bureau, the county has a total area of , of which is land and (1.2%) is water.", "As of the 2010 United States Census, there were 451,225\u00a0people, 176,531\u00a0households, and 119,362\u00a0families residing in the county.", "The population density was .", "There were 195,462 housing units at an average density of .", "The racial makeup of the county was 73.8% white, 18.1% black or African American, 2.0% Asian, 0.3% American Indian, 0.1% Pacific islander, 3.9% from other races, and 1.9% from two or more races.", "Those of Hispanic or Latino origin made up 8.1% of the population." ] ], "gold": "The population of Greenville County in South Carolina was 320,167 in 1990. It was 379,616 in 2000. It was 451,225 in 2010 and it is estimated to be 514,213 by 2018.", "prediction 1": "The population of Greenville County, South Carolina in 2010 was 451,225, making it the most populous county in the state. The population was 506,837 in 2017.", "prediction 2": "As of the 2010 United States Census, the population was 451,225, making it the most populous county in the state. In 2017, the estimated population of the county was 506,837.", "prediction 3": "In 2010, the population of Greenville County was 451,225. In 2017, the population was 506,837.", "prediction 4": "In 2010, the population of Greenville County, South Carolina was 451,225, making it the most populous county in the state. In 2017, the population was estimated to be 506,837.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 121 } ], "missing-info": [], "corrected-prediction": "The population of Greenville County, South Carolina in 2010 was 451,225. In 2017, the estimated population of the county was 506,837." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who had a hit with love is in the air?", "passages": [ [ "Love Is in the Air (song)", "Love Is in the Air (song)\n\n", "\"Love Is in the Air\" is a 1977 disco song sung by John Paul Young.", "The song was written by George Young and Harry Vanda and it became a worldwide hit in 1978, peaking at No. 3 on the Australian charts and No. 5 in the UK Singles Chart.", "In the United States, the song peaked at No. 7 on the pop chart and spent two weeks at No. 1 on the adult contemporary chart, his only US top 40 hit.", "The song was released as the lead single from Young's fourth studio album, \"Love Is in the Air\" (1978).", "A Spanish version has been recorded under the name, \"El Amor Est\u00e1 En El Aire\".", "In 2017, the song was selected for preservation in the National Film and Sound Archive's Sounds of Australia collection.", "John Paul Young said of the recording, \"We actually did 'Love Is in the Air' because we needed something for the German market.", "'Standing in the Rain' became a hit in the clubs over there and then on the charts, so we needed a follow-up.", "I'd been to Germany and heard the music.", "It was electronic mania, all clicks and electronic buzzes.", "So George and Harry gave it the treatment.\"" ], [ "Thomas Anders", "Thomas Anders\n\nBernd Weidung (born 1 March 1963 in Koblenz, Rhineland-Palatinate), better known by his stage name Thomas Anders, is a German singer, best known as the lead singer of German duo Modern Talking.", "Starting his singing career while still in school, Anders unsuccessfully attempted to establish himself as a schlager artist for several years.", "After forming the Eurodisco duo Modern Talking with Dieter Bohlen in 1984, they became a worldwide sensation with their hit \"You're My Heart, You're My Soul\".", "They followed up with a string of other worldwide hits, namely \"You Can Win If You Want\", \"Cheri, Cheri Lady\", \"Brother Louie\", \"Atlantis Is Calling (S.O.S. for Love)\", \"Geronimo's Cadillac\", and \"Jet Airliner\", before dissolving in 1987." ] ], "gold": "There are several song by the title \"Love Is in the Air\". \"Love Is in the Air\" is a 1977 disco song by Australian singer John Paul Young. Tom Jones had a hit with \"Love Is in the Air\" in 1979. Bernd Weidung, known by his stage name Thomas Anders, who is a German singer, songwriter and record producer, had a hit with \"Love Is in the Air\" in 2016.", "prediction 1": "\"Love Is in the Air\" is a 1977 disco song sung by John Paul Young. The song was written by George Young and Harry Vanda and it became a worldwide hit in 1978, peaking at No. 3 on the Australian charts and No. 5 in the UK Singles Chart. In the United States, the song peaked at No. 7 on the pop chart and spent two weeks at No. 1 on the adult contemporary chart, his only US top 40 hit. There is also a Spanish version that was recorded under the name El Amor Est\u00e1 En El Aire.", "prediction 2": "Love Is in the Air is a 1977 disco song sung by John Paul Young. The song was written by George Young and Harry Vanda and became a worldwide hit in 1978, peaking at No. 3 on the Australian charts and No. 5 in the UK Singles Chart.", "prediction 3": "The 1977 disco song Love Is in the Air was sung by John Paul Young. The song was written by George Young and Harry Vanda and it became a worldwide hit in 1978, peaking at No. 3 on the Australian charts and No. 5 in the UK Singles Chart. A Spanish version of the song was released under the name El Amor Est\u00e1 En El Aire. Anders, better known by his stage name Thomas Anders, is the lead singer of German duo Modern Talking.", "prediction 4": "Love Is in the Air is a 1977 disco song sung by John Paul Young. The song was written by George Young and Harry Vanda and it became a worldwide hit in 1978, peaking at No. 3 on the Australian charts and No. 5 in the UK Singles Chart. In the United States, the song peaked at No. 7 on the pop chart and spent two weeks at No. 1 on the adult contemporary chart, his only US top 40 hit. In 2017, the song was selected for preservation in the National Film and Sound Archive's Sounds of Australia collection.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 235 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 385 }, { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 475 } ], "missing-info": [], "corrected-prediction": "\"Love Is in the Air\" is a 1977 disco song sung by John Paul Young. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who's the lead singer of the doobie brothers?", "passages": [ [ "The Doobie Brothers", "The Doobie Brothers\n\nThe Doobie Brothers are an American rock band from San Jose, California.", "The group has sold more than 40 million albums worldwide.", "It has been active for five decades, with its greatest success in the 1970s.", "The band's history can be roughly divided into three eras.", "From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982.", "The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "Every incarnation of the group emphasized vocal harmonies.", "The Doobie Brothers were inducted into the Vocal Group Hall of Fame in 2004.", "Drummer John Hartman arrived in California determined to meet Skip Spence of Moby Grape and join an aborted Grape reunion.", "Spence introduced Hartman to singer, guitarist, and songwriter Tom Johnston and the two proceeded to form the nucleus of what would become the Doobie Brothers.", "Johnston and Hartman called their fledgling group \"Pud\" and experimented with lineups (occasionally including Spence) and styles as they performed in and around San Jose.", "They were mostly a power trio (along with bassist Greg Murphy) but briefly worked with a horn section." ] ], "gold": "The Doobie Brothers are an American rock band from San Jose, California, known for their flexibility in performing across numerous genres and their vocal harmonies. At some point, drummer John Hartman arrived in California determined to meet Skip Spence of Moby Grape and join an aborted Grape reunion. Spence introduced Hartman to singer, guitarist, and songwriter Tom Johnston and the two proceeded to form the nucleus of what would become the Doobie Brothers. Johnston quit the group in 1975, and was replaced by Michael McDonald.", "prediction 1": "The Doobie Brothers are an American rock band from San Jose, California. It has sold more than 40 million albums worldwide. The band's history can be roughly divided into three eras. From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "prediction 2": "The Doobie Brothers are an American rock band from San Jose, California. It has sold more than 40 million albums worldwide. From 1970 to 1975 the lead singer of the Doobies was Tom Johnston. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "prediction 3": "The Doobie Brothers are an American rock band from San Jose, California. Their lead singer was Tom Johnston from 1970 to 1975. Johnston quit the group in 1975 and was replaced by Michael McDonald. McDonald's interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "prediction 4": "The Doobie Brothers are an American rock band from San Jose, California. They have sold more than 40 million albums worldwide. From 1970 to 1975 it featured lead vocalist Tom Johnston and a mainstream rock and roll sound with elements of folk, country and R&B. Johnston quit the group in 1975, and was replaced by Michael McDonald, whose interest in soul music changed the band's sound until it broke up in 1982. The Doobie Brothers reformed in 1987 with Johnston back in the fold and are still active, with occasional contributions from McDonald.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 388, "end": 468 }, { "error type": "Irrelevant", "explanation": "", "start": 469, "end": 603 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Doobie Brothers are an American rock band from San Jose, California, known for their vocal harmonies. At some point, drummer John Hartman arrived in California determined to meet Skip Spence of Moby Grape and join an aborted Grape reunion. Spence introduced Hartman to singer, guitarist, and songwriter Tom Johnston and the two proceeded to form the nucleus of what would become the Doobie Brothers. Johnston quit the group in 1975, and was replaced by Michael McDonald. " }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who sings i'm telling you i'm not going?", "passages": [ [ "Jennifer Holliday", "Jennifer Holliday\n\nJennifer Yvette Holliday (born October 19, 1960) is an American singer and actress.", "She started her career on Broadway in musicals such as \"Dreamgirls\" (1981\u201383), \"Your Arms Too Short to Box with God\" (1980\u201381) and later became a successful recording artist.", "She is best known for her debut single, the \"Dreamgirls\" number and rhythm-and-blues/pop hit, \"And I Am Telling You I'm Not Going\", for which she won a Grammy in 1983.", "She also won a 1982 Tony Award for \"Dreamgirls\".", "Holliday landed her first big role on Broadway in 1979 at age 19, the same day she auditioned for the Broadway production of \"Your Arms Too Short to Box with God.\"", "Her performance in that musical earned her a 1981 Drama Desk nomination.", "Her next role, which she began to act at 21, was the role for which she became best known: the role of Effie Melody White in the Broadway musical \"Dreamgirls.\"", "Holliday originated the role of Effie and remained with the show for nearly four years after its December 20, 1981 opening." ], [ "And I Am Telling You I'm Not Going", "Jennifer Holliday originated the role on Broadway in 1981 and won a Tony Award for her performance as well as the Grammy for Best R&B Performance, Female for its re-release in 1982 for which it became a number-one R&B hit for Holliday.", "Jennifer Hudson portrayed Effie in the 2006 film adaptation of \"Dreamgirls\", winning an Oscar for the role.", "Hudson's version became a Top 20 R&B single, and a number-one dance hit.", "In 1982, Jennifer Holliday, the actress who portrayed Effie in the original Broadway production, released the song as a single.", "It was her first single release and it met with great success, topping the \"Billboard\" R&B charts and attaining top forty positions on both the \"Billboard\" Hot 100 and the UK Singles Chart.", "In 1983, Holliday won the Grammy Award for Best R&B Vocal Performance, Female for the single.", "\"And I Am Telling You I'm Not Going\" was designed as the closing number of \"Dreamgirls\"' first act.", "Holliday's performance of the song, in a style owing much to gospel music singing traditions, was regularly staged to thunderous applause; it was hailed as the highlight of the show in several printed reviews of the musical." ], [ "Jennifer Holliday", "On June 26, 2007, Holliday made a surprise appearance at the BET Awards, singing \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson, who had played Effie White in the 2006 film adaptation of \"Dreamgirls\", and won an Oscar for her performance.", "Holliday had not been offered a cameo role in the film and, feeling snubbed, had repeatedly expressed displeasure with the movie in the media.", "(Another original \"Dreamgirls\" cast member, Loretta Devine, did have a cameo in the film.)", "More recently, it became possible to see Holliday in a YouTube video, singing a duet with Hudson.", "The two actresses-singers performed their live duet at a concert Hudson gave on April 16, 2009.", "The YouTube video has been viewed more than 900,000 times as of December 2011.", "On October 17, 2011 Holliday appeared on \"The Wendy Williams Show\" where, following a sit-down interview, Holliday performed \"", "And I Am Telling You I'm Not Going\" and received a standing ovation from the studio audience.", "On May 23, 2012 Holliday performed \"And I Am Telling You I'm Not Going\" alongside \"American Idol\" finalist Jessica Sanchez during the \"American Idol\" Season 11 finale." ] ], "gold": "Jennifer Yvette Holliday is an American singer and actress. She is best known for her debut single, the \"Dreamgirls\" number and rhythm-and-blues/pop hit, \"And I Am Telling You I'm Not Going\", for which she won a Grammy in 1983. On June 26, 2007, Holliday made a surprise appearance at the BET Awards, singing \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson, who had played Effie White in the 2006 film adaptation of \"Dreamgirls\", and won an Oscar for her performance.", "prediction 1": "American singer and actress Jennifer Holliday sang \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson. The duo also sang \"I'm Telling You I'm Not Going\" in a concert performance in May 2012.", "prediction 2": "Jennifer Holliday sang \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson in 1983. Holliday originated the role of Effie Melody White in the original Broadway production of Dreamgirls. Hudson portrayed Effie in the 2006 film adaptation of Dreamgirls, winning an Oscar for her performance.", "prediction 3": "Jennifer Holliday sang \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson in 1983. Hudson had played Effie White in the 2006 film adaptation of \"Dreamgirls\", winning an Oscar for her performance. Holliday also sang the song with American Idol finalist Jessica Sanchez in 2012.", "prediction 4": "Jennifer Yvette Holliday sang \"And I Am Telling You I'm Not Going\" as a duet in 1983. Holliday originated the role of Effie Melody White in the 1981 Broadway musical Dreamgirls. On June 26, 2007, Holliday made a surprise appearance at the BET Awards, singing \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson, who had played Effie White in the 2006 film adaptation of \"Dreamgirls.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 207 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Jennifer Yvette Holliday is an American singer and actress. She is best known for her debut single, the \"Dreamgirls\" number and rhythm-and-blues/pop hit, \"And I Am Telling You I'm Not Going\", for which she won a Grammy in 1983. On June 26, 2007, Holliday made a surprise appearance at the BET Awards, singing \"And I Am Telling You I'm Not Going\" in a duet with Jennifer Hudson, who had played Effie White in the 2006 film adaptation of \"Dreamgirls\", and won an Oscar for her performance." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Where does blood from the subclavian artery go?", "passages": [ [ "Subclavian artery", "Subclavian artery\n\nIn human anatomy, the subclavian arteries are paired major arteries of the upper thorax, below the clavicle.", "They receive blood from the aortic arch.", "The left subclavian artery supplies blood to the left arm and the right subclavian artery supplies blood to the right arm, with some branches supplying the head and thorax.", "On the left side of the body, the subclavian comes directly off the aortic arch, while on the right side it arises from the relatively short brachiocephalic artery when it bifurcates into the subclavian and the right common carotid artery.", "The usual branches of the subclavian on both sides of the body are the vertebral artery, the internal thoracic artery, the thyrocervical trunk, the costocervical trunk and the dorsal scapular artery, which may branch off the transverse cervical artery which is a branch of the thyrocervical trunk.", "The subclavian becomes the axillary artery at the lateral border of the first rib.", "From its origin, the subclavian artery travels laterally, passing between anterior and middle scalene muscles, with the anterior scalene (scalenus anterior) on its anterior side and the middle scalene (scalenus medius) on its posterior." ], [ "Head and neck anatomy", "The right and left vertebral artery feed into the basilar artery and upward to the Posterior cerebral artery, which provides most of the brain with oxygenated blood.", "The posterior cerebral artery and the posterior communicating artery are within the circle of Willis.", "The left common carotid artery divides to form the: internal carotid artery (ICA) and an external carotid artery (ECA).", "The ICA supplies the brain.", "The ECA supplies the neck and face.", "The left subclavian artery and the right subclavian artery, one on each side of the body form the internal thoracic artery, the vertebral artery, the thyrocervical trunk, and the costocervical trunk.", "The subclavian becomes the axiliary artery at the lateral border of the first rib.", "The left subclavian artery also provides blood to the left upper chest and left arm.", "The Blood\u2013brain barrier (BBB) is semi-permeable membrane that controls the capillary leak potential of the circulatory system.", "In most parts of the body, the smallest blood vessels, called capillaries, are lined with endothelial cells, which have small spaces between each individual cell so substances can move readily between the inside and the outside of the capillary.", "This is not in the case of brain." ] ], "gold": "The subclavian arteries carry most of the blood that supplies the arms, and it also supplies some blood to the neck and brain. In human anatomy, the subclavian arteries are paired major arteries of the upper thorax, below the clavicle. They receive blood from the aortic arch. The left subclavian artery supplies blood to the left arm and the right subclavian artery supplies blood to the right arm, with some branches supplying the head and thorax. ", "prediction 1": "The flow of blood from the subclavian artery is primarily asymptomatic. Blood from the left subclavian artery goes to the left upper chest and to the left arm. The right subclavian artery is the main artery of the upper thorax.", "prediction 2": "In human anatomy, the subclavian arteries are paired major arteries of the upper thorax, below the clavicle. They receive blood from the aortic arch. The left subclavian artery supplies blood to the left upper chest and left arm, while the right subclavian artery supplies blood to the right arm. From its origin, the subclavian artery travels laterally, passing between anterior and middle scalene muscles, with the anterior and middle scalene on its anterior and middle scalenus medius on its posterior side and the anterior and middle scalene on its posterior side and the middle scalenus medius on its posterior.", "prediction 3": "The left subclavian artery supplies blood to the left upper chest and the right upper arm, with some branches supplying the head and thorax. The right subclavian artery supplies blood to the right upper chest and the left upper arm, with some branches supplying the head and thorax. The left subclavian artery also supplies blood to the left upper chest and left arm.", "prediction 4": "In human anatomy, the subclavian arteries are paired major arteries of the upper thorax, below the clavicle, which receive blood from the aortic arch. The left subclavian artery supplies blood to the left arm and the right subclavian artery supplies blood to the right arm, with some branches supplying the head and thorax. From its origin, the subclavian artery travels laterally, passing between anterior and middle scalene muscles. From its origin, the subclavian artery becomes the axillary artery at the lateral border of the first rib.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 71 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In human anatomy, the subclavian arteries are paired major arteries of the upper thorax, below the clavicle. They receive blood from the aortic arch. The left subclavian artery supplies blood to the left arm and the right subclavian artery supplies blood to the right arm, with some branches supplying the head and thorax. Blood from the left subclavian artery goes to the left upper chest and to the left arm. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Which is the most populated country in europe?", "passages": [ [ "European Russia", "European Russia\n\nEuropean Russia, the western part of the Russian Federation, is a part of Eastern Europe.", "With a population of 110 million people, European Russia has about 77% of Russia's population, but covers less than 25% of Russia's territory.", "European Russia includes Moscow and Saint Petersburg, the two largest cities in Russia.", "The boundaries between continents are largely a matter of convention.", "However, the eastern boundary of Europe is generally considered to run along the Ural Mountains, the Ural River, the Caucasus Mountains, the Turkish Straits.", "The southern part of European Russia has some small areas that lie geographically south of the Caucasus Mountain range, and therefore are geographically in Asia; this territory includes the city of Sochi.", "The other, eastern, part of the Russian Federation forms part of northern Asia, and is known as North Asia, also called Asian Russia or Siberia.", "Europe also forms a subcontinent within Eurasia,\nmaking all of Russia a part of the Eurasian continent.", "Russia is not proportionately populated between its larger Asian portion, which contains about 23% of the country's population, and its smaller European portion, which contains about 77%.", "The European portion contains about 110 million people out of Russia's total population of about 144 million in an area covering nearly ; (making it by far the largest European country) an average of 27.5 people per kilometre (70 per sq mi)." ], [ "Germany", "Germany\n\nGermany ( ), officially the Federal Republic of Germany (, ), is a country in Central and Western Europe, lying between the Baltic and North seas to the north, and the Alps to the south.", "It borders Denmark to the north, Poland and the Czech Republic to the east, Austria and Switzerland to the south, and France, Luxembourg, Belgium and the Netherlands to the west.", "Germany includes 16 constituent states, covers an area of , and has a largely temperate seasonal climate.", "With nearly 83 million inhabitants, it is the second most populous state of Europe after Russia, the most populous state lying entirely in Europe, as well as the most populous member state of the European Union.", "Germany is a very decentralized country.", "Its capital and largest metropolis is Berlin, while Frankfurt serves as its financial capital and has the country's busiest airport.", "Germany's largest urban area is the Ruhr, with its main centres of Dortmund and Essen.", "The country's other major cities are Hamburg, Munich, Cologne, Stuttgart, D\u00fcsseldorf, Leipzig, Dresden, Bremen, Hannover, and Nuremberg.", "Various Germanic tribes have inhabited the northern parts of modern Germany since classical antiquity.", "A region named Germania was documented before 100\u00a0AD.", "During the Migration Period, the Germanic tribes expanded southward.", "Beginning in the 10th century, German territories formed a central part of the Holy Roman Empire." ], [ "France in the long nineteenth century", "With the French defeat in the Franco-Prussian War of 1870, France lost her provinces of Alsace and portions of Lorraine to Germany (see Alsace-Lorraine); these lost provinces would only be regained at the end of World War I. Between 1795 and 1866, metropolitan France (that is, without overseas or colonial possessions) was the second most populous country of Europe, behind Russia, and the fourth most populous country in the world (behind China, India, and Russia); between 1866 and 1911, metropolitan France was the third most populous country of Europe, behind Russia and Germany.", "Unlike other European countries, France did not experience a strong population growth from the middle of the 19th century to the first half of the 20th century.", "The French population in 1789 is estimated at roughly 28 million; by 1850, it was 36 million and in 1880 it was around 39 million.", "Slow growth was a major political issue, as the arch-rival Germany continue to gain an advantage in terms of population and industry.", "Ways to reverse the trend became a major political issue.", "Until 1850, population growth was mainly in the countryside, but a period of slow urbanization began under the Second Empire.", "Unlike in England, industrialization was a late phenomenon in France.", "France's economy in the 1830s had a limited iron industry, under-developed coal supplies, and the great majority lived on farms." ] ], "gold": "The most populated country in Europe is Russia. Though more than 75% of its land is in Asia, approximately 110 million people, or 77% of its population, are located within its European territory. The most populated country wholly within Europe is Germany, with a population of over 83 million.", "prediction 1": "The most populated country in Europe is Russia, with an estimated population of 132 million people. The most populous country in Europe by area is Russia, with a population of 347.8 million. The most populous country in Europe by area is the United Kingdom, with a population of 409.8 million. The most populous country in Europe by total area is Russia, with a population of 164.8 million.", "prediction 2": "Between 1795 and 1866, metropolitan France was the second most populous country of Europe, behind Russia. Between 1866 and 1911, metropolitan France was the third most populous country of Europe, behind Russia and Germany. European Russia consists of Moscow and Saint Petersburg, the two largest cities in Russia, and covers about 43% of Russia's total territory.", "prediction 3": "The most populated country in Europe is Russia, which has a population of 110 million people. The most populated country in Europe is Germany, which has a population of 83 million. The most populated country in Europe is the United Kingdom, with a population of 144 million.", "prediction 4": "The most populated country in Europe is Russia, with a population of 144 million. The most populated country in Europe is Russia, with a population of 110 million. The most populated country in Europe is Russia, with a population of 139 million. Among the European countries, Russia has the most people per square kilometre (60 per sq mi).", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 48, "end": 99 }, { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 190 }, { "error type": "Unverifiable", "explanation": "", "start": 191, "end": 293 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 355, "end": 390 }, { "error type": "Redundant", "explanation": "The most populated country in Europe is Russia, ", "start": 294, "end": 354 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The most populated country in Europe is Russia. Russia is not proportionately populated between its larger Asian portion, which contains about 23% of the country's population, and its smaller European portion, which contains about 77%. The European portion contains about 110 million people out of Russia's total population of about 144 million in an area covering nearly " }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "What is the meaning of the word toronto?", "passages": [], "gold": "Toronto is the largest city in Canada and the capital of Ontario. It also happens to be the name of a drink cocktail Toronto, which is a whisky cocktail. And the space Toronto is homeomorphic to every proper subspace of the same cardinality. ", "prediction 1": "what is the meaning of the word toronto?", "prediction 2": "contextual meaning of the word toronto.", "prediction 3": "\"toronto\" is a word that is used in a plural context.", "prediction 4": "- A place where people come to celebrate things. - A city where people come to celebrate things. - A place where people come to celebrate things. - A place where people come to celebrate things. - A place where people come to celebrate things.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 40 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Where does the movie fried green tomatoes take place?", "passages": [ [ "Fried Green Tomatoes", "Fried Green Tomatoes\n\nFried Green Tomatoes is a 1991 comedy-drama film based on the novel \"Fried Green Tomatoes at the Whistle Stop Cafe\" by Fannie Flagg.", "Directed by Jon Avnet and written by Flagg and Carol Sobieski, it stars Kathy Bates, Jessica Tandy, Mary Stuart Masterson, and Mary-Louise Parker.", "It tells the story of a Depression-era friendship between two women, Ruth and Idgie, and a 1980s friendship between Evelyn, a middle-aged housewife, and Ninny, an elderly woman.", "The centerpiece and parallel story concerns the murder of Ruth's abusive husband, Frank, and the accusations that follow.", "It received a generally positive reception from film critics and was nominated for two Academy Awards.", "Evelyn Couch, a timid, unhappy housewife in her 40s, meets elderly Ninny Threadgoode in an Anderson, Alabama, nursing home where Evelyn's husband Ed's Aunt Vesta who has dementia is also staying.", "Over several encounters with Evelyn, Ninny tells her the story of the now abandoned town of Whistle Stop, and the people who lived there.", "The film's subplot concerns Evelyn's dissatisfaction with her marriage, her life, her growing confidence, and her developing friendship with Ninny." ] ], "gold": "American 1991 comedy-drama film Fried Green Tomatoes opens in a nursing home in Anderson, Alabama. The film features a housewife who, unhappy with her life, befriends an elderly lady and is enthralled by the tales she tells of people she used to know in Whistle Stop, Birmingham, and Valdosta, Georgia.", "prediction 1": "Fried Green Tomatoes is a 1991 comedy-drama film based on the novel Fried Green Tomatoes at the Whistle Stop Cafe by Fannie Flagg. The film tells the story of a Depression-era friendship between two women, Ruth and Idgie, and a 1980s friendship between Evelyn, a middle-aged housewife, and Ninny Threadgoode, an elderly woman. The movie takes place in an Anderson, Alabama, nursing home where Evelyn's husband Ed's Aunt Vesta who has dementia is also staying.\n", "prediction 2": "Fried Green Tomatoes is a 1991 comedy-drama film based on the novel Fried Green Tomatoes at the Whistle Stop Cafe by Fannie Flagg. It tells the story of a Depression-era friendship between two women, Ruth and Idgie, and a 1980s friendship between Evelyn, a middle-aged housewife, and Ninny Threadgoode, an elderly woman. The film's main plot concerns the murder of Ruth's abusive husband, Frank. The centerpiece and parallel story concerns the murder of Ruth's abusive husband, Frank, and the accusations that follow. It received a generally positive reception from film critics and was nominated for two Academy Awards. The subplo concerns Evelyn's dissatis with her marriage, her growing confidence, and her developing friendship with Ninn.", "prediction 3": "Fried Green Tomatoes is a 1991 comedy-drama film based on the novel Fried Green Tomatoes at the Whistle Stop Cafe by Fannie Flagg. The movie tells the story of the Depression-era friendship between two women, Ruth and Idgie, and a 80s friendship between Evelyn, a middle-aged housewife, and Ninny Threadgoode in an Anderson, Alabama, nursing home where Evelyn's husband Ed's Aunt Vesta who has dementia is staying in an Anderson, Alabama, nursing home where Evelyn's husband Ed's Aunt Vesta who has dementia is also staying there.", "prediction 4": "Fried Green Tomatoes is a 1991 comedy-drama film based on the novel Fried Green Tomatoes at the Whistle Stop Cafe. It stars Kathy Bates, Jessica Tandy, Mary Stuart Masterson, and Mary-Louise Parker. The movie's story concerns the murder of Ruth's abusive husband, Frank, and the accusations that follow. Its centerpiece and parallel story concerns the murder of Ruth's abusive husband, Frank. The premiere took place at the Beverly Hills Hilton Hotel, in Beverly Hills, Alabama. It is filmed in Oakville, Missouri.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 260 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 460 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Fried Green Tomatoes is a 1991 comedy-drama film. The film tells the story of a friendship between a middle-aged housewife, who is dissatisfied with her life, and an elderly woman, who tells her the story of the now abandoned town of Whistle Stop, and the people who lived there. The movie takes place in an Anderson, Alabama, nursing home." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did they start using rebar in concrete?", "passages": [ [ "Rebar", "Reinforcing bars in masonry construction have been used since at least the 15th century (2,500 meters of rebar was used in the Ch\u00e2teau de Vincennes).", "During the 18th century, rebar was used to form the carcass of the Leaning Tower of Nevyansk in Russia, built on the orders of the industrialist Akinfiy Demidov.", "The cast iron used for the rebar was of high quality, and there is no corrosion on the bars to this day.", "The carcass of the tower was connected to its cast iron tented roof, crowned with one of the first known lightning rods.", "However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete.", "Several people in Europe and North America developed reinforced concrete in the 1850s.", "These include Joseph-Louis Lambot of France, who built reinforced concrete boats in Paris (1854) and Thaddeus Hyatt of the United States, who produced and tested reinforced concrete beams.", "Joseph Monier of France is one of the most notable figures for the invention and popularization of reinforced concrete.", "As a French gardener, Monier patented reinforced concrete flower pots in 1867, before proceeding to build reinforced concrete water tanks and bridges." ], [ "Reinforced concrete", "In 1853, Coignet built the first iron reinforced concrete structure, a four-story house at 72 rue Charles Michels in the suburbs of Paris.", "Coignet's descriptions of reinforcing concrete suggests that he did not do it for means of adding strength to the concrete but for keeping walls in monolithic construction from overturning.", "In 1854, English builder William B. Wilkinson reinforced the concrete roof and floors in the two-storey house he was constructing.", "His positioning of the reinforcement demonstrated that, unlike his predecessors, he had knowledge of tensile stresses.", "Joseph Monier, a French gardener and known to be one of the principal inventors of reinforced concrete, was granted a patent for reinforced flowerpots by means of mixing a wire mesh to a mortar shell.", "In 1877, Monier was granted another patent for a more advanced technique of reinforcing concrete columns and girders with iron rods placed in a grid pattern.", "Though Monier undoubtedly knew reinforcing concrete would improve its inner cohesion, it is less known if he even knew how much reinforcing actually improved concrete's tensile strength.", "Before 1877 the use of concrete construction, though dating back to the Roman Empire, and having been reintroduced in the early 1800s, was not yet a proven scientific technology." ] ], "gold": "Although rebar has been used in masonry since at least the 15th Century, it was not until the mid-19th century that the technique displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. For instance, the French only started implementing it around 1853, with the English following them the next year, in 1854.", "prediction 1": "Reinforcing bars in masonry construction have been used since at least the 15th century. During the 18th century, rebar was used to form the carcass of the Leaning Tower of Nevyansk in Russia, built on the orders of the industrialist Akinfiy Demidov. However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. Several people in Europe and North America developed reinforced concrete in the 1850s, including Joseph-Louis Lambot of France, who built reinforced concrete boats in Paris 1854 and Thaddeus Hyatt of the United States, who produced and tested reinforced concrete beams.", "prediction 2": "Reinforcing bars in masonry construction have been used since at least the 15th century. During the 18th century, rebar was used to form the carcass of the Leaning Tower of Nevyansk in Russia, built on the orders of the industrialist Akinfiy Demidov. However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. Some people in Europe and North America developed reinforced concrete in the 1850s. These include Joseph-Louis Lambot of France, who built reinforced concrete boats in Paris (1854) and Thaddeus Hyatt of the United States, who produced and tested reinforced concrete beams.", "prediction 3": "Reinforcing bars in masonry construction have been used since at least the 15th century. During the 18th century, rebar was used to form the carcass of the Leaning Tower of Nevyansk in Russia, built on the orders of the industrialist Akinfiy Demidov. However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. Several people in Europe and North America developed reinforced concrete in the 1850s. These include Joseph-Louis Lambot of France, who built reinforced concrete boats in Paris (1854) and Thaddeus Hyatt of the United States, who produced and tested reinforced concrete beams.", "prediction 4": "Reinforcing bars in masonry construction have been used since at least the 15th century. During the 18th century, rebar was used to form the carcass of the Leaning Tower of Nevyansk in Russia, built on the orders of the industrialist Akinfiy Demidov. However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. These include Joseph-Louis Lambot of France, who built reinforced concrete boats in Paris 1854. Joseph Monier of France is one of the most notable figures for the invention and popularization of reinforced concrete. As a French gardener, Monier patented reinforced concrete flowerpots in 1867, before proceeding to build reinforced concrete water tanks and bridges.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 520, "end": 702 } ], "missing-info": [], "corrected-prediction": "Reinforcing bars in masonry construction have been used since at least the 15th century. However, it was not until the mid-19th century that rebar displayed its greatest strengths with the embedding of steel bars into concrete, thus producing modern reinforced concrete. Several people in Europe and North America developed reinforced concrete in the 1850s." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is the value of the fourth power of ten?", "passages": [ [ "Rondo in A minor (Mozart)", "a8 r8\n\n\\new Staff { \n\\set Staff.midiInstrument = #\"fortepiano\"\n\\set Staff.midiMaximumVolume = #0.3\nr8\nr8 8 8 r8 8 8 r8 8 8", "r8 8 8 r8 8 8 8 \na4.", "a a a \na a8 \n\n\\oneVoice\n\nr8 r8\ne'4 (d'8) c' r\n\\clef \"bass\" \ne4.", "a8\n\u00bb\n\nWolff also addresses this sort of passage, saying \"trill chains must be smoothly connected, with no accent given to the new trill tone at its entrance.\"", "The basis for his advice is a piano exercise taught by Mozart to his pupil Johann Nepomuk Hummel and recalled later by Hummel in his own textbook.", "A number of the ornaments and variations are not notated with signs, but simply written out by Mozart in ordinary music notation." ], [ "Base (exponentiation)", "Base (exponentiation)\n\n", "In exponentiation, the base is the number b in an expression of the form b.", "The number n is called the exponent and the expression is known formally as exponentiation of b by n or the exponential of n with base b.", "It is more commonly expressed as \"the nth power of b\", \"b to the nth power\" or \"b to the power n\".", "For example, the fourth power of 10 is 10,000 because .", "The term \"power\" strictly refers to the entire expression, but is sometimes used to refer to the exponent.", "Radix is the traditional term for \"base\", but usually refers then to one of the common bases: decimal (10), binary (2), hexadecimal (16), or sexagesimal (60).", "When the concepts of variable and constant came to be distinguished, the process of exponentiation was seen to transcend the algebraic functions.", "In his 1748 \"Introductio in analysin infinitorum\", Leonhard Euler referred to \"base a = 10\" in an example.", "He referred to \"a\" as a \"constant number\" in an extensive consideration of the function F(\"z\") = \"a\"." ], [ "Decimal", "The Hungarian language also uses a straightforward decimal system.", "All numbers between 10 and 20 are formed regularly (e.g. 11 is expressed as \"tizenegy\" literally \"one on ten\"), as with those between 20 and 100 (23 as \"huszonh\u00e1rom\" = \"three on twenty\").", "A straightforward decimal rank system with a word for each order (10 , 100 , 1000 , 10,000 ), and in which 11 is expressed as \"ten-one\" and 23 as \"two-ten-three\", and 89,345 is expressed as 8 (ten thousands) 9 (thousand) 3 (hundred) 4 (tens) 5 is found in Chinese, and in Vietnamese with a few irregularities.", "Japanese, Korean, and Thai have imported the Chinese decimal system.", "Many other languages with a decimal system have special words for the numbers between 10 and 20, and decades.", "For example, in English 11 is \"eleven\" not \"ten-one\" or \"one-teen\".", "Incan languages such as Quechua and Aymara have an almost straightforward decimal system, in which 11 is expressed as \"ten with one\" and 23 as \"two-ten with three\".", "Some psychologists suggest irregularities of the English names of numerals may hinder children's counting ability.", "Some cultures do, or did, use other bases of numbers." ] ], "gold": "The value of the fourth power of ten is ten thousand. The value of the fourth power of ten in number form is 10,000, written as a one followed by four zeros. The value of the fourth power of ten in word form or spelled out consists of the word ten followed by the word thousand, written as t e n t h o u s a n d. In E notation ten thousand is also written as 1 E+4 or as 1 E4.", "prediction 1": "In exponentiation, the base is the number b in an expression of the form b. The number n is called the exponent, so the expression is known formally as the exponentiation of b by n or the exponential of n with base b. For example, the fourth power of 10 is 10,000 because.", "prediction 2": "In exponentiation, the base is the number b in an expression of the form b. The number n is called the exponent and the expression is known formally as exponentiation of b by n or the exponential of n with base b. The fourth power of 10 is 10,000 because.", "prediction 3": "In exponentiation, the base is the number b in an expression of the form b. The number n is called the exponent and the expression is known formally as exponentiation of b by n or the exponential of n with base b. For example, the fourth power of 10 is 10,000.", "prediction 4": "In exponentiation, the base is the number b in an expression of the form b. The number n is called the exponent and the expression is known formally as exponentiation of b by n or the exponential of n with base b. For example, the fourth power of 10 is 10,000 because.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 217 }, { "error type": "Incoherent", "explanation": "", "start": 264, "end": 272 }, { "error type": "Incoherent", "explanation": "", "start": 218, "end": 230 } ], "missing-info": [], "corrected-prediction": "The value of the fourth power of 10 is 10,000." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Which is the most rainy place on earth?", "passages": [ [ "Cherrapunji", "Cherrapunji\n\nCherrapunji (; with the native name Sohra being more commonly used, and can also be spelled Cherrapunjee or Cherrapunji) is a subdivisional town in the East Khasi Hills district in the Indian state of Meghalaya.", "It is the traditional capital of aNongkhlaw \"hima\" (Khasi tribal chieftainship constituting a petty state), both known as Sohra or Churra.", "Cherrapunji has often been credited as being the wettest place on Earth, but for now nearby Mawsynram currently holds that distinction.", "Cherrapunji still holds the all-time record for the most rainfall in a calendar month and in a year, however: it received in July 1861 and between 1 August 1860 and 31 July 1861.", "The history of the Khasi people \u2013 native inhabitants of Cherrapunji \u2013 may be traced from the early part of the 16th century.", "Between the 16th and 18th centuries, these people were ruled by their tribal 'Syiems (rajas or chiefs) of Khyriem' in the Khasi Hills.", "The Khasis hills came under British authority in 1883 with the submission of the last of the important Syiems, Tirot Sing." ], [ "Mawsynram", "Mawsynram\n\nMawsynram () is a village in the East Khasi Hills district of Meghalaya state in north-eastern India, 65 kilometres from Shillong.", "Mawsynram receives one of the highest rainfalls in India.", "It is reportedly the wettest place on Earth, with an average annual rainfall of , but that claim is disputed by Llor\u00f3, Colombia, which reported an average yearly rainfall of between 1952 and 1989 and L\u00f3pez de Micay, also in Colombia, which reported per year between 1960 and 2012.", "According to the \"Guinness Book of World Records\", Mawsynram received of rainfall in 1985.", "Mawsynram is located at 25\u00b0 18\u2032 N, 91\u00b0 35\u2032 E, at an altitude of about 1,400 metres (4,600\u00a0ft), 15\u00a0km west of Cherrapunji, in the Khasi Hills in the state of Meghalaya (India) .", "The name of the village contains \"Maw\", a Khasi word meaning \"stone\".", "Under the K\u00f6ppen climate classification, Mawsynram features a subtropical highland climate with an extraordinarily showery and long monsoonal season and a short dry season.", "Based on the data of a recent few decades, it appears to be the wettest place in the world, or the place with the highest average annual rainfall." ] ], "gold": "Several places on Earth claim to be the most rainy, such as Llor\u00f3, Colombia, which reported an average annual rainfall of 12,717 mm between 1952 and 1989, and L\u00f3pez de Micay, Colombia, which reported an annual 12,892 mm between 1960 and 2012. However, the official record is held by Mawsynram, India with an average annual rainfall of 11, 872 mm, although nearby town Sohra, India, also known as Cherrapunji, holds the record for most rain in a calendar month for July 1861 and most rain in a year from August 1860 to July 1861.", "prediction 1": "Cherrapunji has often been credited as being the wettest place on Earth, but for now nearby Mawsynram currently holds that distinction. According to the Guinness Book of World Records, Mawsynram receives one of the highest rainfalls in India. According to the K\u00f6ppen climate classification, Mawsynram features a subtropical highland climate with an extraordinarily showery and long monsoonal season and a short dry season. Based on the data of a recent few decades, it appears to be the place with the highest average annual rainfall.", "prediction 2": "There are many places that are the most rainy on Earth. Cherrapunji has often been credited as being the wettest place on Earth, but for now nearby Mawsynram currently holds that distinction. Mawsynram is a village in the East Khasi Hills district of Meghalaya state in north-eastern India, 65 kilometres from Shillong. It receives one of the highest rainfalls in India. According to the Guinness Book of World Records, Mawsynram receives one of the highest rainfalls in a year. However, that claim is disputed by Llor\u00f3, Colombia, which reported an average yearly rainfall between 1952 and 1989.", "prediction 3": "Cherrapunji has often been credited as being the wettest place on Earth, but Mawsynram currently holds that distinction. According to the Guinness Book of World Records, Mawsynram receives one of the highest rainfalls in India. It is reportedly the wettest place on Earth, with an average annual rainfall of. However, that claim is disputed by Llor\u00f3, Colombia, which reported an average yearly rainfall of between 1952 and 1989 and L\u00f3pez de Micay, also in Colombia.", "prediction 4": "The world has many rainy places. One of the rainiest places is Cherrapunji, in the Indian state of Meghalaya, where the average annual rainfall is 63 inches (1,080 mm). However, Mawsynram, a village in the East Khasi Hills district of Meghalaya state in north-eastern India, receives one of the highest rainfalls in India. Mawsynram has been credited as the wettest place on Earth, although that claim is disputed by Llor\u00f3, Colombia, which reported an average annual rainfall of 58 inches (51 inches) 69 inches (1,200 mm), and Llor\u00f3, Colombia, which yearly rainfall of 89 inches (1,", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 534 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Several places on Earth claim to be the most rainy, such as Llor\u00f3, Colombia, between 1952 and 1989, and L\u00f3pez de Micay, Colombia, between 1960 and 2012. However, the official record is held by Mawsynram, India, although nearby town Sohra, India, also known as Cherrapunji, holds the record for most rain in a calendar month for July 1861 and most rain in a year from August 1860 to July 1861. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the first 1 coin come out?", "passages": [ [ "One pound (British coin)", "One pound (British coin)\n\nThe British one pound (\u00a31) coin is a denomination of the pound sterling.", "Its obverse bears the Latin engraving ELIZABETH II D G REG \u201cDei Gratia Regina\u201d meaning, \u201cElizabeth II, by the grace of God, Queen\u201d and F D meaning \"Fidei defensor\", Defender of the Faith.", "It has featured the profile of Queen Elizabeth II since the original coin's introduction on 21 April 1983.", "Four different portraits of the Queen have been used, with the latest design by Jody Clark being introduced in 2015.", "The design on the reverse side of the current, 12-sided coin features four emblems to represent each of the nations of the United Kingdom \u2013 the English rose, the leek for Wales, the Scottish thistle, and the shamrock for Northern Ireland \u2013 emerging from a single stem within a crown.", "The original, round \u00a31 coin replaced the Bank of England \u00a31 note, which ceased to be issued at the end of 1984 and was removed from circulation on 11 March 1988, though still redeemable at the Bank's offices, like all English banknotes.", "One-pound notes continue to be issued in Jersey, Guernsey and the Isle of Man, and by the Royal Bank of Scotland, but the pound coin is much more widely used." ], [ "1 yen coin", "The first Japanese one-yen coin was minted in 1870, at first these coins were primarily minted in silver.", "The obverse of these coins featured a dragon with a circular inscription around it.", "The reverse had a radiant sun surrounded by a wreath, with the chrysanthemum emblem (a symbol of the Japanese Imperial Family) flanked by two seals of the Japanese government.", "The following year though Japan switched to the Gold standard in order to keep up with countries in North America, and Europe.", "Production of silver one-yen coins was halted, and new small gold coins took their place.", "Through 1874-1875, one-yen silver coins were again minted with a new design only to be halted again sometime in 1875 in favor of \"Trade Dollars\".", "Both silver and gold coins co-circulated after 1878 when Japan went with a bimetallic standard, and production again resumed of silver one-yen coins.", "Gold one-yen coins were minted until 1880, while the silver ones lasted until 1914.", "Coinage was reformed in 1948 with the issue of a brass one-yen coin, 451,170,000 coins were minted until production stopped in 1950.", "The obverse features a numeral \"1\" with \"State of Japan\" above, and the date below, while the reverse reads \"One Yen\" with a floral pattern below it." ], [ "1 euro coin", "One of the most valuable planned issues of a \u20ac1 coin was by Vatican City in 2002, which may sell for several hundred euros.", "However, the French mint marks were mistakenly not placed on some 2007 Monaco coins which are hence worth more than \u20ac200 to collectors.", "PP means the proof-condition coins.", "Numbers means if more than one coin was minted in that year in that condition by the country.", "In Germany, there are five mint marks, so they mint ten types of coins in every year.", "In Greece, there were coins in 2002 which were minted in Finland with S mint mark.", "In the Vatican, there were coins minted with John Paul II's effigy, and with \"Sede Vacante\" image in 2005.", "There are several error 1-euro coins: Italian types from 2002 without mintmarks; Portuguese coins, also from 2002 with another type of edging (29 stripes instead of 28) and from 2008 with the first type of the common side, officially used until 2007; and the famous Monegasque coin from 2007 without mint marks." ] ], "gold": "The first dollar coin came out in the United States in 1794. In Japan, the first yen coin came out in 1870. The first British pound coin came out 21 April 1983, the first Euro coin in 2002, and in Australia the first one dollar coin came out 14 May 1984.", "prediction 1": "The first 1 coin in the world was issued in 1868 and was replaced by the 1 yen coin in 1872. The 1 euro coin was introduced in 2002 by the Vatican City. The first 1 dollar coin was introduced in 1933. The 1 euro coin was introduced in 1986 and introduced in 1995.", "prediction 2": "The first Japanese one-yen coin was minted in 1870, at first these coins were primarily minted in silver. The obverse of these coins featured a dragon with a circular inscription around it. The reverse had a radiant sun surrounded by a wreath, with the chrysanthemum emblem (a symbol of the Japanese Imperial Family) flanked by two seals of the Japanese government. The British one pound (\u00a31) coin is a denomination of the pound sterling. The first 1 euro coin was minted on 21 April 1983, and was minted on 27 April 1932. The first one-euro coin was minted in 2001.", "prediction 3": "The first 1 yen coin was minted in 1870 with the State of Japan above, and the date below, while the reverse reads \"One Yen\" with a floral pattern below it. The first British \u00a31 coin came out on 21 April 1983. The first 1 euro coin came out in 2002, with the Vatican City issuing one every two years.", "prediction 4": "The first Japanese one-yen coin was minted in 1870, at first these coins were primarily minted in silver. The obverse of these coins featured a dragon with a circular inscription around it. The reverse had a radiant sun surrounded by a wreath, with the chrysanthemum emblem (a symbol of the Japanese Imperial Family) flanked by two seals of the Japanese government. The first English one pound coin came out on 21 April 1983.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 92 }, { "error type": "Unverifiable", "explanation": "", "start": 153, "end": 200 }, { "error type": "Unverifiable", "explanation": "", "start": 201, "end": 263 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The first Japanese one-yen coin was minted in 1870. The 1 euro coin was introduced in 2002 by the Vatican City. The first British pound coin came out 21 April 1983." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "The name of the elephant in peppa pig?", "passages": [ [ "Peppa Pig", "Peppa Pig\n\nPeppa Pig is a British preschool animated television series directed and produced by Astley Baker Davies in association with Entertainment One, which originally aired on 31 May 2004.", "It went on a hiatus for just over two years before re-premiering on 14 February 2015.", "Four seasons have been aired, with a fifth airing.", "The series is shown in 180 territories including the US and UK.", "\"Peppa Pig\" is a children's television programme broadcasting on Channel 5 and Nick Jr. in the UK, Nickelodeon/Nick Jr. in the USA, ABC 4 Kids in Australia and Discovery Kids in Latin America, including Brazil.", "Each episode is approximately five minutes long.", "The show revolves around Peppa, an anthropomorphic female pig, and her family and friends.", "Each of her friends is a different species of animal.", "Peppa's friends are the same age as she is, and Peppa's younger brother George's friends are the same age as him.", "Episodes tend to feature everyday activities such as attending playgroup, going swimming, visiting their grandparents, cousins, going to the playground or riding their bikes.", "The characters wear clothes, live in houses, and drive cars, but still display some characteristics of the animals on which they are based." ] ], "gold": "Taking place in a world where all characters are animals, Peppa Pig revolves around her family and friends. Each of her friends is a different species of animal. Peppa's friends are her age, and Peppa's younger brother George's friends are his age, and each episodes tends to feature everyday activities such as attending playgroup, going swimming, visits with their grandparents, cousins, and friends, going to the playground or riding their bikes. Of the friends is a family of elephants, Emily Elephant, Peppa's friend, Edmond Elephant, George's friend, Doctor Elephant a.k.a. Mr. Elephant and Mummy Elephant a.k.a. Mrs. Elephant.", "prediction 1": "Peppa Pig is a British children's television series. The name of the elephant in the series is Eglantine.", "prediction 2": "Peppa Pig is a British preschool animated television series. Each of the animals that appear in the show are different species of animal. The elephant in the show is called the Elephant in the House.", "prediction 3": "Peppa Pig is a British preschool animated television series that aired from 2004 to 2015. The show revolves around Peppa, an anthropomorphic female pig, and her family and friends. Each of her friends is a different species of animal. The name of the elephant in Peppa pig is \"Peppa the Elephant\".", "prediction 4": "Peppa Pig is a British preschool animated television series directed and produced by Astley Baker Davies in association with Entertainment One, which originally aired on 31 May 2004. It went on a hiatus for just over two years before re-premiering on 14 February 2015. Four seasons have been aired, with a fifth airing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 52 }, { "error type": "Unverifiable", "explanation": "", "start": 53, "end": 105 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Peppa Pig revolves around her family and friends. Each of her friends is a different species of animal. Peppa's friends are her age, and Peppa's younger brother George's friends are his age, and each episodes tends to feature everyday activities such as attending playgroup, going swimming, visits with their grandparents, cousins, and friends, going to the playground or riding their bikes." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When does the new set of pokemon cards come out?", "passages": [ [ "Pok\u00e9mon Trading Card Game", "Pok\u00e9mon Trading Card Game\n\nThe , abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game, based on Nintendo's Pok\u00e9mon franchise of video games and anime, first published in October 1996 by Media Factory in Japan.", "In the US, it was initially published by Wizards of the Coast; The Pok\u00e9mon Company eventually took over publishing the card game in June 2003.", "In 2016, it was the year's top-selling toy in the strategic card game subclass.", "In 2017, it had an 82% share of Europe's strategic card game market.", "As of March 2018, the game has sold over 25.7billion cards worldwide.", "Players assume the role of a Pok\u00e9mon trainer and use their Pok\u00e9mon to battle their opponents'.", "Players play Pok\u00e9mon to the field and attack their opponent's Pok\u00e9mon.", "A Pok\u00e9mon that has sustained enough damage is knocked out, and the player who knocked it out draws a Prize card.", "There are usually six Prize cards, and the primary win condition is to draw all of them.", "Other ways to win are by knocking out all the Pok\u00e9mon the opponent has on the field such that the opponent has none left, or if at the beginning of their opponent's turn there are no cards left to draw in the opponent's deck." ], [ "The Dark Tower III: The Waste Lands", "The pairings as mentioned in the book are:\n\nStephen King and Nikolaj Arcel have confirmed that the 2017 film \"The Dark Tower\" is a sequel to the events of \"The Dark Tower\" book series, following Roland Deschain on his \"last time round\" the cycle to the titular Dark Tower, equipped with the Horn of Eld.", "The film is set to be released on August 4, 2017 in 3D and 2D by Columbia Pictures.", "The film has been described as a combination of the first novel, \"The Gunslinger\", and of \"The Waste Lands\", while also incorporating significant story points from \"The Wind Through the Keyhole\"." ] ], "gold": "The Pok\u00e9mon Trading Card Game, abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game based on the Pok\u00e9mon franchise by Nintendo. The Sun & Moon card set was released on February 3, 2017. The Guardians Rising card set was released on May 5, 2017. The Burning Shadows card set was released on August 4, 2017.", "prediction 1": "Pok\u00e9mon Trading Card Game, abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game, based on Nintendo's Pok\u00e9mon franchise of video games and anime. The new set of Pok\u00e9mon cards came out on September 25, 2017.", "prediction 2": "The Pok\u00e9mon Trading Card Game, abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game, based on Nintendo's Pok\u00e9mon franchise of video games and anime, first published in October 1996 by Media Factory in Japan. The new set of Pok\u00e9mon cards in the Pok\u00e9mon TCG comes out on September 24, 2019.", "prediction 3": "Pok\u00e9mon Trading Card Game is a collectible card game based on Nintendo's Pok\u00e9mon franchise of video games and anime, first published in October 1996 by Media Factory in Japan. In the US, it was initially published by Wizards of the Coast. The Pok\u00e9mon Company eventually took over publishing the card game in June 2003.", "prediction 4": "The Pok\u00e9mon Trading Card Game is a collectible card game based on Nintendo's Pok\u00e9mon franchise of video games and anime. The new set of Pokemon cards came out on August 11, 2017, while the new set of cards in the Pok\u00e9mon Sun and Moon came out on October 11, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 155, "end": 215 } ], "missing-info": [], "corrected-prediction": "Pok\u00e9mon Trading Card Game, abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game, based on Nintendo's Pok\u00e9mon franchise of video games and anime. " }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "Who sings dont want to miss a thing?", "passages": [ [ "I Don't Want to Miss a Thing", "I Don't Want to Miss a Thing\n\n\"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film \"Armageddon\" which Steven Tyler's daughter Liv Tyler starred in.", "Written by Diane Warren, the song debuted at number one on the U.S. \"Billboard\" Hot 100 (the first #1 for the band after 28 years together).", "It is one of three songs performed by the band for the film, the other two being \"What Kind of Love Are You On\" and \"Sweet Emotion\".", "The song stayed at number one for four weeks from September 5 to 26, 1998.", "The song also stayed at number 1 for several weeks in several other countries.", "It sold over a million copies in the UK and reached number four on the UK Singles Chart.", "In 1997, Diane Warren was watching Barbara Walters interview James Brolin and Barbra Streisand.", "Brolin said he missed Streisand when they were asleep, and Warren wrote down the words \"I don't want to miss a thing\", before there was even a song.", "\"When I first heard it,\" recalled drummer Joey Kramer, \"it was just a demo with piano and singing." ], [ "I Don't Want to Miss a Thing", "The video was highly successful and greatly contributed to the song's success, receiving heavy airplay on MTV and went on to become the second most popular video of 1998, only behind Brandy and Monica's \"The Boy is Mine\".", "It also won awards for MTV Video Music Award for Best Video from a Film, and Best Video at Boston Music Awards.", "In late 1998, country music artist Mark Chesnutt recorded a cover version of the song.", "His rendition is the first single and title track from his 1999 album of the same name.", "Chesnutt's cover spent two weeks at number one on the US \"Billboard\" Hot Country Singles & Tracks (now Hot Country Songs) charts in early 1999, and is the last of his eight number ones on that chart.", "It is also the first of only two singles in his career to reach the \"Billboard\" Hot 100, where it peaked at number 17 in early 1999." ] ], "gold": "The rock ballad \"I Don't Want to Miss a Thing\" is performed by Aerosmith for the 1998 natural disaster film \"Armageddon\", in which lead singer Steven Tyler's daughter Liv Tyler starred. The song debuted at number one on the US Billboard Hot 100 and stayed there for four weeks. It was also covered by country music artist Mark Chesnutt in 1999, whose performance topped the US Billboard Hot Country Songs charts for two weeks.", "prediction 1": "Aerosmith sang I Don't Want to Miss a Thing in the 1998 film Armageddon. In late 1998, country music artist Mark Chesnutt recorded a cover version of the song. His rendition is the first single and title track from his 1999 album of the same name.", "prediction 2": "\"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film Armageddon, in which Steven Tyler's daughter Liv Tyler starred. Written by Diane Warren, the song debuted at number one on the U.S. Billboard Hot 100 (the first #1 for the band after 28 years together). In late 1998, country music artist Mark Chesnutt recorded a cover version of the song. His rendition is the first single and title track from his 1999 album of the same name.", "prediction 3": "I Don't Want to Miss a Thing is a ballad performed by American hard rock band Aerosmith for the 1998 film Armageddon, which Steven Tyler's daughter Liv Tyler starred in. Written by Diane Warren, the song debuted at number one on the U.S. Billboard Hot 100. Country music artist Mark Chesnutt recorded a cover version of the song in late 1998, and his version is the first single and title track from his 1999 album of the same name.", "prediction 4": "\"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film Armageddon. Written by Diane Warren, the song debuted at number one on the U.S. Billboard Hot 100, the first #1 for the band after 28 years together. In late 1998, country music artist Mark Chesnutt recorded a cover version of the song. His rendition is the first single and title track from his 1999 album of the same name.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 86 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 247 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"I Don't Want to Miss a Thing\" is a ballad performed by American hard rock band Aerosmith for the 1998 film \"Armageddon\" which Steven Tyler's daughter Liv Tyler starred in. The song debuted at number one on the US Billboard Hot 100 and stayed there for four weeks. It was also covered by country music artist Mark Chesnutt in 1999, whose performance topped the US Billboard Hot Country Songs charts for two weeks." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who has won the most tennis major titles?", "passages": [ [ "Ken Fletcher", "Ken Fletcher\n\nKenneth Norman Fletcher (15 June 1940 \u2013 11 February 2006) was an Australian tennis player who won numerous doubles and mixed doubles Grand Slam titles.", "He was born in Brisbane, Queensland, Australia to parents Norm and Ethel Fletcher.", "He was educated at St Laurence's College and showed early promise as a championship tennis player there.", "His greatest success as a tennis player came in 1963, when he became the only man to win a calendar year Grand Slam in mixed doubles, partnering fellow Australian Margaret Court.", "He reached the final of the Australian Open in 1963, losing to Roy Emerson.", "After this achievement, he went on to record mixed doubles championships in the Australian Open in 1964, French Open in 1964 and 1965, and Wimbledon in 1965, 1966, and 1968.", "All of his mixed doubles Grand Slam titles were in partnership with Smith Court.", "He also achieved a Grand Slam title in men's doubles in the 1964 French Open, playing with Roy Emerson.", "At the Wimbledon men's doubles championship, he was a finalist with Robert Hewitt in 1965, the champion in 1966 partnering John Newcombe, and a finalist again in 1967 with Roy Emerson.", "In total Fletcher won 27 international tennis titles.", "He was ranked World No. 10 in 1966 by Lance Tingay of \"The Daily Telegraph\"." ], [ "2006 Wimbledon Championships \u2013 Men's Doubles", "2006 Wimbledon Championships \u2013 Men's Doubles\n\nStephen Huss and Wesley Moodie were the defending champions but lost in the third round to Simon Aspelin and Todd Perry.", "Bob and Mike Bryan defeated Fabrice Santoro and Nenad Zimonji\u0107 in the final, 6\u20133, 4\u20136, 6\u20134, 6\u20132, to win the Gentlemen's Doubles title at the 2006 Wimbledon Championships By winning the 2006 Doubles title, their first title at Wimbledon, the Bryan brothers completed the Career Grand Slam, having previously won the 2003 French Open, the 2005 US Open, and the Australian Open earlier that year.", "Additionally, it was their record 7th consecutive grand slam final.", "The quarterfinal match between Mark Knowles & Daniel Nestor and Simon Aspelin & Todd Perry became, at that time, the longest match ever played at Wimbledon, lasting 6 hours and 9 minutes, with Knowles & Nestor winning the match 5\u20137, 6\u20133, 6\u20137(5\u20137), 6\u20133, 23\u201321.", "This record was eventually broken at the 2010 Championships, in the first round men's singles match between John Isner and Nicolas Mahut.", "It still remains as of 2018 the longest doubles match played at Wimbledon or at any Grand Slam tournament.", "Bob Bryan / Mike Bryan (Champions)" ], [ "Roger Federer", "Roger Federer\n\nRoger Federer (; born 8 August 1981) is a Swiss professional tennis player who is currently ranked world No. 3 in men's singles tennis by the Association of Tennis Professionals (ATP).", "Federer has won 20 Grand Slam singles titles\u2014the most in history for a male player\u2014and has held the world No. 1 spot in the ATP rankings for a record total of 310 weeks, including a record 237 consecutive weeks.", "After turning professional in 1998, he was continuously ranked in the top ten from October 2002 to November 2016.", "He re-entered the top ten following his victory at the 2017 Australian Open.", "Federer has won a men's record eight Wimbledon titles, a joint-record six Australian Open titles, a record five consecutive US Open titles, and one French Open title.", "He is one of eight men to have achieved a career Grand Slam.", "Federer has reached a record 30 men's singles Grand Slam finals, including 10 in a row from the 2005 Wimbledon Championships to the 2007 US Open.", "Federer has also won a record six ATP Finals, 27 ATP World Tour Masters 1000 titles, and a record 21 ATP World Tour 500 titles.", "Federer's all-court game and versatile style of play involve exceptional footwork and shot-making.", "Effective both as a base-liner and a volleyer, his apparent effortlessness and efficient movement on the court have made Federer highly popular among tennis fans." ] ], "gold": "In tennis, Roger Federer has won the most men's singles matches. Margaret Court has won the most for women, she also won all four titles in the coveted Grand Slam in 1963 with Ken Fletcher. In men's doubles, Bob Bryan, Mike Bryan, Daniel Nestor, Todd Woodbridge and Mark Woodforde are the only players to win a career golden slam. Martina Navratilova has won the women's doubles tennis major titles.", "prediction 1": "Roger Federer has won the most Grand Slam singles titles in men's singles history, with a total of 20. Ken Fletcher has won the most Grand Slam doubles titles, followed by Bob Bryan and Mike Bryan.", "prediction 2": "Roger Federer has won the most Grand Slam singles titles in the history of tennis, with 20 total. Ken Fletcher had the most Grand Slam singles titles, and Ken Bryan had the most Grand Slam doubles titles.", "prediction 3": "The tennis player with the most Grand Slam singles titles is Roger Federer. Roger Federer has also won the most Grand Slam singles titles of all time. The player with the most Grand Slam doubles titles is Ken Fletcher. The player with the most Grand Slam singles titles in the history of tennis is Bob Bryan.", "prediction 4": "The player with the most Grand Slam tennis single titles is Roger Federer, with 20. Federer has won a men's record eight Wimbledon titles, a joint-record six Australian Open titles, a record five consecutive US Open titles, and one French Open title. Bob and Mike Bryan have won the most Grand Slam tennis singles titles, with 13 doubles and 14 mixed doubles.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 102 }, { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 159 }, { "error type": "Unverifiable", "explanation": "", "start": 160, "end": 197 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Roger Federer, tennis player, has won the most Grand Slam singles titles in men's singles history. Ken Fletcher became the only man to win a calendar year Grand Slam in mixed doubles, partnering fellow Australian Margaret Court." }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "When do they announce the winner of american idol?", "passages": [ [ "American Idol", "The second-season finale took place at the Gibson Amphitheatre, which has an audience capacity of over 6,000.", "In the seventh through thirteenth seasons, the venue was at the Nokia Theater, which holds an audience of over 7,000.", "In the sixteenth season, the venue did not change from the Finals.", "The winner received a record deal with a major label, which may be for up to six albums, and secures a management contract with \"American Idol\"-affiliated 19 Management (which has the right of first refusal to sign all contestants), as well as various lucrative contracts.", "All winners prior to the ninth season reportedly earned at least $1\u00a0million in their first year as winner.", "All the runners-up of the first ten seasons, as well as some of other finalists, had also received record deals with major labels.", "However, starting in the elevnth season, the runner-up may only be guaranteed a single-only deal.", "BMG/Sony (first through ninth seasons), UMG (tenth through fifteenth seasons), and Hollywood Records (sixteenth season onward) had the right of first refusal to sign contestants for three months after the season's finale.", "Starting in the fourteenth season, the winner was signed with Big Machine Records." ], [ "American Idol", "American Idol\n\nAmerican Idol is an American singing competition television series created by Simon Fuller, produced by Fremantle USA and 19 Entertainment, and distributed by Fremantle North America.", "It initially aired on Fox from June 11, 2002, to April 7, 2016, for 15 seasons.", "On March 11, 2018, the sixteenth season debuted on ABC.", "It started as an addition to the \"Idols\" format that was based on \"Pop Idol\" from British television, and became one of the most successful shows in the history of American television.", "The concept of the series involves discovering recording stars from unsigned singing talents, with the winner determined by American viewers using phones, Internet, and SMS text voting.", "The winners of the first sixteen seasons, as chosen by viewers, are Kelly Clarkson, Ruben Studdard, Fantasia Barrino, Carrie Underwood, Taylor Hicks, Jordin Sparks, David Cook, Kris Allen, Lee DeWyze, Scotty McCreery, Phillip Phillips, Candice Glover, Caleb Johnson, Nick Fradiani, Trent Harmon, and Maddie Poppe, respectively.", "\"American Idol\" employs a panel of vocal judges who critique the contestants' performances.", "The original judges, for the first through eighth seasons, were record producer and music manager Randy Jackson, singer and choreographer Paula Abdul, and music executive and manager Simon Cowell." ], [ "Riptide (Vance Joy song)", "Quentin Alexander performed \"Riptide\" on the season 14 finale of \"American Idol\" on May 13, 2015. !", "scope=\"col\" colspan=\"3\"|", "Streaming" ] ], "gold": "American Idol is an American singing competition television series. The concept of the series involves discovering recording stars from unsigned singing talents, with the winner determined by American viewers using phones, Internet, and SMS text voting. The winner for that season was revealed on the last episode of each season. The winner of season 13 was announced on May 21, 2014, the winner of season 14 was announced on May 13, 2015, and the winner of season 15 was announced on April 7, 2016.", "prediction 1": "American Idol is an American singing competition television series created by Simon Fuller, produced by Fremantle USA and 19 Entertainment, and distributed by Fremantle North America. The winner was announced on the season 16 finale on August 5, 2018, while the winner of the 14th season was announced on March 11, 2018.", "prediction 2": "American Idol is an American singing competition television series created by Simon Fuller, produced by Fremantle USA and 19 Entertainment, and distributed by Fremantle North America. The winner is announced during the finals of the 14th and 15th seasons. The winner is also announced during the season premiere of the 15th season on March 11, 2018.", "prediction 3": "American Idol is an American singing competition television series created by Simon Fuller, produced by Fremantle USA and 19 Entertainment, and distributed by Fremantle North America. The winner of the first 15 seasons was named by American viewers using phones, Internet, and SMS text voting. The winner of the second season finale was announced on May 13, 2015, and the winner of the sixteenth season was announced on March 11, 2018.", "prediction 4": "American Idol is an American singing competition television series created by Simon Fuller, produced by Fremantle USA and 19 Entertainment, and distributed by Fremantle North America. The winner of the first fifteen seasons, as chosen by American viewers, is Kelly Clarkson. The winner of the second-season finale was on May 13, 2015, and the winner of the fourteenth season was announced on March 11, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 183 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 252, "end": 320 }, { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 251 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "American Idol is an American singing competition television series. The concept of the series involves discovering recording stars from unsigned singing talents, with the winner determined by American viewers using phones, Internet, and SMS text voting." }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "What is the name of the dog in richie rich?", "passages": [ [ "Richie Rich (comics)", "Richie Rich (comics)\n\nRichard \"Richie\" $ Rich, Jr. (often stylized as Ri\u00a2hie Ri\u00a2h) is a fictional character in the Harvey Comics universe.", "He debuted in \"Little Dot\" #1, cover-dated September 1953, and was created by Alfred Harvey and Warren Kremer.", "Dubbed \"the poor little rich boy,\" Richie is the only child of fantastically wealthy parents and is the world's richest kid.", "He is so rich, his middle name is a dollar sign, $.", "During Harvey Comics' heyday (1950\u20131982), Richie was the publisher's most popular character, eventually starring in over fifty separate titles, including such long-running comics as \"Richie Rich\", \"Richie Rich Millions\", \"Richie Rich Dollars and Cents\", and \"Richie Rich Success Stories\".", "In 2011 Ape Entertainment began publishing a new licensed Richie Rich comic book series, taking the character in a very different, action-oriented, direction.", "Although created in 1953, Richie didn't have his own title until 1960.", "Once he did, however, he quickly became Harvey's most popular character, eventually starring in over fifty separate titles." ], [ "Richie Rich's Christmas Wish", "Richie questions Keanbean about the wishing machine, which he says, requires a \"Pegliasaurus\" wishing bone in order to be complete.", "Along with his friends who decide to help him, Richie goes to the city museum to retrieve the bone from the dinosaur skeleton.", "After passing through laser detection systems successfully, they get it, using the fishing rod invented by Keanbean.", "Before they get out of the museum, Richie and his friends spot Reggie's parents, who are now working as night guards there.", "Once they reach the lab, they get the machine to work properly.", "However, before Richie could wish himself back, Reggie arrives there with the policemen.", "Richie, Cadbury, Keanbean, and Richie's friends are put in jail, while Reggie takes the machine home.", "At home, Reggie wishes for the ability to fly, but before he can make another wish, Dollar runs off with the wishbone.", "When it does not work the second time, he leaves the room in a huff, and retires.", "In jail, Richie and his friends are bailed out by Root Canal.", "They all rush to Reggie's house, and while he is still sleeping, Richie tries to wish himself back.", "However, they find that the machine is no longer working, as Reggie had kicked it in anger earlier." ], [ "The Richie Rich/Scooby-Doo Show", "The Richie Rich/Scooby-Doo Show\n\nThe Richie Rich/Scooby-Doo Show is a 60-minute Saturday morning animated package show produced by Hanna-Barbera Productions and broadcast on ABC from November 8, 1980 to November 7, 1981.", "The program contained segments of \"Scooby-Doo and Scrappy-Doo\" and \"Richie Rich\".", "The \"Scooby-Doo and Scrappy-Doo\" shorts represents the sixth show in which Scooby-Doo appears.", "This was the only Hanna-Barbera package series for which \"Scooby-Doo\" was given second billing and also notable for Richie Rich's debut in animation.", "With the exception of the \"Richie Rich Gems\", each episode featured three Scooby-Doo segments and three Richie Rich segments between them.", "The episodes that contain Scooby-Doo cartoon segments that are repeats from earlier episodes are noted in the following list with \u201crr\u201d used to indicate where a previously aired cartoon was rerun.", "Season 1\n\nSeason 2 \n\n\nOn May 20, 2008, Warner Home Video (via Hanna-Barbera Cartoons and Warner Bros. Family Entertainment) released \"The Richie Rich/Scooby-Doo Show: Volume 1\" on DVD for the Hanna-Barbera Classics Collection Region 1 for the first time.", "It features cartoons from the first seven episodes." ] ], "gold": "Dollar is a dog character that made his first debut in Richie Rich comics in 1953. He has also been in the 1980's Richie Rich television series, as well as the Richie Rich/Scooby-Doo show a 60-minute Saturday morning animated package show that contained segments of \"Scooby-Doo and Scrappy-Doo\" and \"Richie Rich\".", "prediction 1": "On the television series Richie Rich, the name of the dog is Reggie. The character is played by Smitty and is dubbed \"the poor little rich boy.\"", "prediction 2": "The character Richie Rich is the dog in the comic book series Richie Rich. In the live-action series Richie Rich and the Scooby-Doo Show, the dog named Reggie appears.", "prediction 3": "In the animated television series, Richie Rich, Jr. is played by Cooby-Doo. In the Richie Rich/Scooby-Doo Show, the dog named Reggie is played by Bob Catlin.", "prediction 4": "In the Harvey Comics series Richie Rich, the character's name is Richard \"Richie\" Rich, Jr., often stylized as Rihie Rih. In The Richie Rich/Scooby-Doo Show, the character is portrayed as Scooby-Doo, the dog of the show, and the character is named Reggie.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 61, "end": 68 }, { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 144 } ], "missing-info": [], "corrected-prediction": "On the television series Richie Rich, the name of the dog is Dollar. " }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "What was the capital city of the aztec empire?", "passages": [ [ "Spanish conquest of the Aztec Empire", "The Spanish campaign against the Aztec Empire had its final victory on August 13, 1521, when a coalition army of Spanish forces and native Tlaxcalan warriors led by Cort\u00e9s and Xicotencatl the Younger captured the emperor Cuauhtemoc and Tenochtitlan, the capital of the Aztec Empire.", "The fall of Tenochtitlan marks the beginning of Spanish rule in central Mexico, and they established their capital of Mexico City on the ruins of Tenochtitlan.", "Cort\u00e9s made alliances with tributaries city-states (\"altepetl\") of the Aztec Empire as well as their political rivals, particularly the Tlaxcalteca and Texcocans, a former partner in the Aztec Triple Alliance.", "Other city-states also joined, including and polities bordering Lake Texcoco, the inland lake system of the Valley of Mexico.", "Particularly important to the Spanish success was a multilingual (Nahuatl, a Maya dialect, and Spanish) indigenous slave woman, known to the Spanish conquistadors as Do\u00f1a Marina, and generally as La Malinche.", "After eight months of battles and negotiations, which overcame the diplomatic resistance of the Aztec Emperor Moctezuma II to his visit, Cort\u00e9s arrived in Tenochtitlan on November 8, 1519, where he took up residence with fellow Spaniards and their indigenous allies." ], [ "Cuauhtlatoani", "Cuauhtlatoani\n\nCu\u0101uhtlahto\u0101ni or Cu\u00e4uhtlahtoh is a titular office of governorship and political administration, used within certain city-states and provinces among the Aztecs of pre-Columbian central Mexico in the Late Postclassic period.", "The office of \"cuauhtlatoani\" (a Nahuatl word meaning approximately, \"the one who speaks like eagle\") carried the connotation of \"military ruler\" or \"appointed administrator\".", "During the rise of the Aztec Empire the title was given by the ruling Mexica-Tenochca to the governors they imposed on conquered city-states in central provinces.", "A Tlatoani (\"the one who speaks\") was an independent ruler of an Aztec/Mexica polity (altepetl).", "Cuauhtlatoani were appointed by a Tlatoani to rule conquered areas or areas whose independence was lost such as the city Tlatelolco following the 1473 CE defeat of its last Tlatoani, Moquihuix, by Tenochtitlan.", "Tlatelolco was governed by Cuauhtlatoque until the death of Itzquauhtzin in 1520 CE." ], [ "Aztec Empire", "Aztec Empire\n\nThe Aztec Empire, or the Triple Alliance (, ]), began as an alliance of three Nahua city-states: , , and .", "These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521.", "The Triple Alliance was formed from the victorious factions in a civil war fought between the city of and its former tributary provinces.", "Despite the initial conception of the empire as an alliance of three self-governed city-states, quickly became dominant militarily.", "By the time the Spanish arrived in 1519, the lands of the Alliance were effectively ruled from , while the other partners in the alliance had taken subsidiary roles.", "The alliance waged wars of conquest and expanded rapidly after its formation.", "At its height, the alliance controlled most of central Mexico as well as some more distant territories within Mesoamerica, such as the Xoconochco province, an Aztec exclave near the present-day Guatemalan border.", "Aztec rule has been described by scholars as \"hegemonic\" or \"indirect\".", "The Aztecs left rulers of conquered cities in power so long as they agreed to pay semi-annual tribute to the Alliance, as well as supply military forces when needed for the Aztec war efforts." ] ], "gold": "Initially, The Aztec Empire had an alliance of three self-governed city-states including Mexico-Tenochtitlan, Tetzcoco, and Tlacopan, also known as the Triple Alliance. The Triple Alliance ruled the area in and around the Valley of Mexico. Despite the initial conception of the Triple Alliance, Tenochtitlan quickly became dominant militarily by the time the Spanish arrived in 1519.", "prediction 1": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:,, and. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. The fall of Tenochtitlan marks the beginning of Spanish rule in central Mexico, and they established their capital of Mexico City on the ruins of Tenochtitlan.\n", "prediction 2": "The head of state of the Aztec Empire was Cuauhtlatoani, a title given by the ruling Tlaxcalteca to the governors of certain city-states and provinces among the Aztecs of pre-Columbian central Mexico in the Late Postclassic Period. According to oral tradition, Cuauhtlatoani was the imperial head of state and the capital of the Aztec Empire. A coalition army led by Cort\u00e9s and Xicotencatl the Younger captured Cuauhtemoc and Tenochtla dies in 1521.", "prediction 3": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states: Tenochtitlan, Tlatelolco, and Tlaxcalteca. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. Teotihuacan also ruled Tlatelolco, while Cuauhtlatoani came to rule in 1521 CE.", "prediction 4": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. The fallen capital of the Aztec Empire, Tenochtitlan, marks the beginning of Spanish rule in central Mexico and they established their capital of Mexico City on the ruins of Tenochtitlan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 436 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4, 5 ] } ], "corrected-prediction": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states. These three city-states ruled the area in and around the Valley of Mexico. Initially, it was an alliance of three self-governed city-states, where one quickly became dominant militarily by the time the Spanish arrived in 1519. Tenochtitlan was the capital of the Aztec Empire." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Where is the play the lion king playing?", "passages": [ [ "The Lion King (musical)", "The Lion King (musical)\n\n", "The Lion King is a musical based on the 1994 Walt Disney Animation Studios' animated feature film of the same name with music by Elton John, lyrics by Tim Rice, and book by Roger Allers and Irene Mecchi, along with additional music and lyrics by Lebo M, Mark Mancina, Jay Rifkin, Julie Taymor, and Hans Zimmer.", "Directed by Taymor, the musical features actors in animal costumes as well as giant, hollow puppets.", "The show is produced by Disney Theatrical Productions.", "The musical debuted on July 8, 1997 in Minneapolis, Minnesota at the Orpheum Theatre and was an instant success before premiering on Broadway at the New Amsterdam Theater on October 15, 1997 in many previews with the official opening on November 13, 1997.", "On June 13, 2006, the Broadway production moved to the Minskoff Theatre to make way for the musical version of \"Mary Poppins\", where it is still running after more than 8,500 performances.", "It is Broadway's third longest-running show in history, and has grossed more than $1 billion, making it the highest grossing Broadway production of all time." ], [ "The Lion King (franchise)", "The Lion King (franchise)\n\nThe Lion King is a Disney media franchise comprising a film series and additional media.", "The success of the original 1994 American animated feature, \"The Lion King\", directed by Roger Allers and Rob Minkoff, led to two direct-to-video sequel films, a television film sequel, two spin-off television series, three educational shorts, several video games, merchandise, and the third-longest-running musical in Broadway history, which garnered six Tony Awards including Best Musical.", "The franchise as a whole has EGOT-ed, meaning it has won the four biggest awards of American show business.", "The franchise mainly revolves about a pride of lions who oversee a large swath of African savanna as their \"kingdom\" known as the Pride Lands, with their leader Simba watching over it as \"king\".", "The first three animated films are widely known for being influenced by the works of William Shakespeare, as well as other works based on his material.", "\"The Lion King\" is the original film of the franchise.", "It was directed by Roger Allers and Rob Minkoff.", "It was produced by Walt Disney Feature Animation, premiered in selected cities on June 15, 1994, and widely released to theaters on June 24, 1994 by Walt Disney Pictures.", "\"The Lion King\" is the 32nd Disney animated feature film and belongs to an era known as the Disney Renaissance." ], [ "The Lion King (musical)", "Actress Phindile Mkhize, who had previously performed in many of the show's productions, was selected as Rafiki for this production, leaving in October 2013 and being replaced by Ntsepa Pitjeng.", "The show closed its doors on December 14, 2014.", "After the success of the Broadway show, the show opened in the United Kingdom in on October 19, 1999.", "The cast included Cornell John as Mufasa, Luke Youngblood as Young Simba, Dominique Moore as Young Nala, Martyn Ellis as Pumbaa, Simon Gregor as Timon, Rob Edwards as Scar, Paul J. Medford as Banzai and Josette Bushell-Mingo as Rafiki.", "As of October 2015, it has been playing at the Lyceum Theatre in London for 16 years.", "Taymor directed the British production of the show, with Melissa De Melo as the producer.", "The show also toured the UK from 2012 until March 2015.", "The West End cast of the show performed twice at the traditional Royal Variety Performance: in 1999 (led by Josette Bushell-Mingo) and 2008 (led by Brown Lindiwe Mkhize).", "In both performances, the song \"Circle of Life\" was performed." ] ], "gold": "The Lion King is a 1994 American animated musical drama film produced by Walt Disney Feature Animation and released by Walt Disney Pictures. Walt Disney Theatrical produced a musical stage adaptation of the same name, which premiered in Minneapolis, Minnesota in July 1997, and later opened on Broadway in October 1997 at the New Amsterdam Theatre. The show moved to the Minskoff Theatre on June 13, 2006, and is still running to this day in New York. The show's financial success led to adaptations all over the world, including one at the West End's Lyceum Theatre.", "prediction 1": "The Lion King is a musical based on the 1994 Walt Disney Animation Studios' animated feature film of the same name with music by Elton John, lyrics by Tim Rice, and book by Roger Allers and Irene Mecchi, along with additional music and lyrics by Lebo M, Mark Mancina, Jay Rifkin, Julie Taymor, and Hans Zimmer. The show debuted on July 8, 1997 in Minneapolis, Minnesota at the Orpheum Theatre and was an instant success before premiering on Broadway at the New Amsterdam Theater on October 15, 1997 in many previews with the official opening on November 13, 1997. As of October 2015, it has been playing at the Lyceum Theatre in London for 16 years.", "prediction 2": "The Lion King is a musical based on the 1994 Walt Disney Animation Studios animated feature film of the same name, with music by Elton John, lyrics by Tim Rice, and book by Roger Allers and Irene Mecchi, along with additional music and lyrics by Lebo M, Mark Mancina, Jay Rifkin, Julie Taymor, and Hans Zimmer. As of October 2015, it has been playing at the Lyceum Theatre in London for 16 years.", "prediction 3": "The Lion King is a musical based on the 1994 Walt Disney Animation Studios animated feature film of the same name. The show features actors in animal costumes as well as giant, hollow puppets. It debuted on July 8, 1997 in Minneapolis, Minnesota at the Orpheum Theatre and was an instant success before premiering on Broadway at the New Amsterdam Theater on October 15, 1997 in many previews with the official opening on November 13, 1997. As of October 2015, it has been playing at the Lyceum Theatre in London for 16 years.", "prediction 4": "The Lion King is a musical based on the 1994 Walt Disney Animation Studios animated feature film of the same name. The show features actors in animal costumes as well as giant, hollow puppets and was produced by Disney Theatrical Productions. The Lion King has been playing at the Lyceum Theatre in London for 16 years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 393, "end": 419 }, { "error type": "Irrelevant", "explanation": "", "start": 499, "end": 563 }, { "error type": "Irrelevant", "explanation": "", "start": 564, "end": 583 }, { "error type": "Irrelevant", "explanation": "", "start": 636, "end": 649 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 310 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Lion King is a musical based on the 1994 Walt Disney Animation Studios' animated feature film, produced by Walt Disney Feature Animation and released by Walt Disney Pictures. Walt Disney Theatrical produced a musical stage adaptation of the same name. The show debuted on July 8, 1997 in Minneapolis, Minnesota at the Orpheum Theatre before premiering on Broadway at the New Amsterdam Theater on October 15, 1997. The show moved to the Minskoff Theatre on June 13, 2006, and is still running. It has also been playing at the Lyceum Theatre in London." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When did marvel contest of champions come out?", "passages": [ [ "Marvel: Contest of Champions", "Marvel: Contest of Champions\n\nMarvel Contest of Champions is a 2014 mobile fighting game developed and published by Kabam.", "It was released on December 10, 2014 for iOS and Android.", "The fighting game is primarily set in the Marvel Universe.", "The game is loosely based on the events of the limited comic book series \"Contest of Champions\".", "Players assume the role of a Summoner, tasked by The Collector to build a team of Marvel heroes and villains and pit them against one another in combat.", "Gameplay is similar to that of \"\" and \"Mortal Kombat X,\" where the game's fighting arena is rendered in 3D with a 2D plane for the superheroes' movements and actions.", "New players begin with access to two characters, and can work to access additional characters including Iron Man, Spider-Man, Wolverine, Hulk, Magneto, Ultron, Loki, and Rhino.", "Each character is upgradable, featuring their own classes, movements, traits, abilities, and special moves.", "Gameplay features an energy system that limits the number of quest-based battles in which players can compete.", "Energy recharges automatically at a set rate over time or players can refill their energy manually.", "The energy limit is increased when players increase their level.", "Game items (such as crystals) that impact play may be found in chests as players win battles." ] ], "gold": "Marvel Super Hero Contest of Champions came out June\u2013August 1982. A fighting video game based on the events of the comic book, came out for iOS and Android on December 10, 2014. In 2019 an arcade version was released. ", "prediction 1": "Marvel Contest of Champions is a mobile fighting game developed and published by Kabam, which was released on December 10, 2014 for iOS and Android. The fighting game is primarily set in the Marvel Universe. It is loosely based on the events of the limited comic book series Contest of Champions.", "prediction 2": "Marvel Contest of Champions is a 2014 mobile fighting game developed and published by Kabam, which was released on December 10, 2014 for iOS and Android. The fighting game is primarily set in the Marvel Universe and is loosely based on the events of the limited comic book series Contest of Champions. The game features a fighting arena rendered in 3D with a 2D plane for the superheroes' movements and actions.", "prediction 3": "Marvel Contest of Champions is a 2014 mobile fighting game developed and published by Kabam, which was released on December 10, 2014 for iOS and Android. The fighting game is primarily set in the Marvel Universe and loosely based on the events of the limited comic book series Contest of Champions. Players assume the role of a Summoner, tasked by The Collector to build a team of Marvel heroes and villains and pit them against one another in combat.", "prediction 4": "Marvel Contest of Champions is a 2014 mobile fighting game developed and published by Kabam, which was released on December 10, 2014 for iOS and Android. The fighting game is primarily set in the Marvel Universe, and is loosely based on the events of the limited comic book series Contest of Champions. The game features a multiplayer component with a choice of four different difficulty modes. Marvel Contest of Champions is free to play and has a single-player campaign.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 296 } ], "missing-info": [], "corrected-prediction": "Marvel Contest of Champions is a mobile fighting game, which was released on December 10, 2014 for iOS and Android. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the commander of the british forces in boston?", "passages": [ [ "Thomas Gage", "Thomas Gage\n\nGeneral Thomas Gage (10 March 1718/19 \u2013 2 April 1787) was a British Army general officer and colonial official best known for his many years of service in North America, including his role as British commander-in-chief in the early days of the American Revolution.", "Being born to an aristocratic family in England, he entered military service, seeing action in the French and Indian War, where he served alongside his future opponent George Washington in the 1755 Battle of the Monongahela.", "After the fall of Montreal in 1760, he was named its military governor.", "During this time he did not distinguish himself militarily, but proved himself to be a competent administrator.", "From 1763 to 1775 he served as commander-in-chief of the British forces in North America, overseeing the British response to the 1763 Pontiac's Rebellion.", "In 1774 he was also appointed the military governor of the Province of Massachusetts Bay, with instructions to implement the Intolerable Acts, punishing Massachusetts for the Boston Tea Party.", "His attempts to seize military stores of Patriot militias in April 1775 sparked the Battles of Lexington and Concord, beginning the American Revolutionary War.", "After the Pyrrhic victory in the June Battle of Bunker Hill, he was replaced by General William Howe in October, 1775, and returned to Great Britain." ] ], "gold": "General Thomas Gage was a British Army general officer and colonial official best known for his many years of service in North America, including his role as British commander-in-chief in the early days of the American Revolution. From 1763 to 1775 he served as commander-in-chief of the British forces in North America, overseeing the British response to the 1763 Pontiac's Rebellion. His attempts to seize military stores of Patriot militias in April 1775 sparked the Battles of Lexington and Concord, beginning the American Revolutionary War. After the Pyrrhic victory in the June Battle of Bunker Hill, he was replaced by General William Howe in October, 1775, and returned to Great Britain.", "prediction 1": "General Thomas Gage was the British commander-in-chief of the British forces in Boston starting from 1763. He was replaced by General William Howe in 1775.", "prediction 2": "Thomas Gage was the military governor of the Province of Massachusetts Bay from 1760-1775. After his departure, he replaced General Thomas Gage with General William Howe, who served as the commander-in-chief of the British forces in Boston from 1763-1775.", "prediction 3": "General Thomas Gage served as commander-in-chief of the British forces in North America from 1763 to 1775 and oversaw the British response to the 1763 Pontiac's Rebellion. In 1774, he was also appointed the military governor of the Province of Massachusetts Bay, with instructions to implement the Intolerable Acts, punishing Massachusetts for the Boston Tea Party. He was replaced by General William Howe in October, 1775, and returned to Great Britain.", "prediction 4": "General Thomas Gage served as commander-in-chief of the British forces in North America from 1763 to 1775, overseeing the British response to the 1763 Pontiac's Rebellion.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "General Thomas Gage was a British Army general officer and colonial official best known for his many years of service in North America, including his role as British commander-in-chief in the early days of the American Revolution. He was the British commander-in-chief of the British forces in Boston starting from 1763 to 1775. He oversaw the British response to the 1763 Pontiac's Rebellion. His attempts to seize military stores of Patriot militias in April 1775 sparked the Battles of Lexington and Concord, beginning the American Revolutionary War. After the Pyrrhic victory in the June Battle of Bunker Hill, he was replaced by General William Howe in October, 1775, and returned to Great Britain." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "What episode did izzy leave grey's anatomy?", "passages": [ [ "I Like You So Much Better When You're Naked (Grey's Anatomy)", "Meredith informs Stevens that she is getting her job back, but disinterested, Stevens departs, seeking a fresh start to life.", "The episode was written by Tony Phelan and Joan Rater, and directed by Donna Deitch.", "David Greenspan edited the episode and Danny Lux served as the music coordinator.", "The episode was broadcast with Dolby Digital sound, being aired in both standard and high-definition, and running for 43 minutes without commercials.", "Featured music included Ingrid Michaelson's \"Everybody\" and Amanda Blank's \"Something Bigger, Something Better\", and the episode was named after the song, \"I Like You So Much Better", "When You're Naked\", by Norwegian rock musician, Ida Maria.", "The episode saw Heigl briefly return after a five-episode hiatus to film the movie, \"Life as We Know It\".", "\"I Like You So Much Better", "When You're Naked\" was also planned to be the last episode before her maternity leave, however, in March 2010, when she did not return to the \"Grey's Anatomy\" set after her maternity leave, Heigl marked this episode as her last." ], [ "I Like You So Much Better When You're Naked (Grey's Anatomy)", "I Like You So Much Better", "When You're Naked (Grey's Anatomy)\n\n", "\"I Like You So Much Better", "When You're Naked\" is the twelfth episode of the sixth season of the American television medical drama \"Grey's Anatomy\", and the show's 114th episode overall.", "It was written by Tony Phelan and Joan Rater, and directed by Donna Deitch.", "It aired on the American Broadcasting Company in the United States on January 21, 2010.", "In the episode, Dr. Izzie Stevens (Katherine Heigl) returns to the fictional Seattle Grace Mercy West Hospital with the fear that her estranged husband Dr. Alex Karev (Justin Chambers) is moving on.", "Further storylines include Dr. Derek Shepherd (Patrick Dempsey) contemplating as to whether or not he should report the chief of surgery Dr. Richard Webber (James Pickens, Jr.), for his alcoholism, and Dr. Callie Torres (Sara Ramirez) battling the chicken pox.", "The episode was originally intended to serve as the final episode before Heigl's maternity leave, but was later marked as her final appearance to the series." ] ], "gold": "Actress Katherine Heigl played Dr. Izzie Stevens on the American television medical drama, Grey's Anatomy. Izzie's last appearance on the show was during an episode called I Like You So Much Better When You're Naked. It was episode 12 season 6, and show episode number 114 overall.", "prediction 1": "Grey's Anatomy has a series of episodes. In the episode I Like You So Much Better When You're Naked, Izzie leaves the show seeking a fresh start. It was originally intended to serve as the last episode before Heigl's maternity leave, but was later marked as her final appearance to the series.", "prediction 2": "\"I Like You So Much Better When You're Naked\" is the twelfth episode of the sixth season of the American television medical drama Grey's Anatomy. It was originally intended to serve as the final episode before Heigl's maternity leave, but was later marked as her final appearance to the series.", "prediction 3": "\"I Like You So Much Better When You're Naked\" is the twelfth episode of the sixth season of the American television medical drama Grey's Anatomy and the show's 114th episode overall. It was originally intended to serve as the final episode before Heigl's maternity leave, but was later marked as her final appearance to the series.", "prediction 4": "\"I Like You So Much Better When You're Naked\" is the twelfth episode of the sixth season of the American television medical drama Grey's Anatomy. It is the show's 114th episode overall. Izzie Stevens left Grey's Anatomy in the episode \"I Like You So Much Better When You're Naked\". It was originally intended to serve as the final episode before Heigl's maternity leave, but was later marked as her final appearance to the series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 40 }, { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 145 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Katherine Heigl played Dr. Izzie Stevens on the American television medical drama, Grey's Anatomy. Izzie left the drama after the episode \"I Like You So Much Better When You're Naked\", which was planned to be the last episode before her maternity leave, but was later marked as her final appearance to the series." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Local elections in which all candidates run for multiple seats (positions) citywide are called?", "passages": [ [ "Plurality-at-large voting", "Plurality-at-large voting\n\nPlurality-at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election.", "Multiple winners are elected simultaneously to serve the district.", "Block voting is not a system for obtaining proportional representation; instead the usual result is that where the candidates divide into definitive parties (especially for example where those parties have party lines which are whipped) the most popular party in the district sees its full slate of candidates elected, resulting in a landslide.", "The term \"plurality at-large\" is in common usage in elections for representative members of a body who are elected or appointed to represent the whole membership of the body (for example, a city, state or province, nation, club or association).", "Where the system is used in a territory divided into multi-member electoral districts the system is commonly referred to as \"block voting\" or the \"bloc vote\".", "This system is usually based on a single round of voting, but it can sometimes appear in a runoff (two-round) version, as in some local elections in France, where candidates who do not receive an absolute majority must compete in a second round." ] ], "gold": "Multiple non-transferable vote, also known as plurality-at-large voting, block vote, block voting, or party block voting is a non-proportional voting system for electing several representatives from a single multi-member electoral district using a series of check boxes and tallying votes similar to a plurality election. These are elections where all candidates run for multiple seats citywide. This system is usually based on a single round of voting, but it can sometimes appear in a runoff or two-round version, as in some local elections in France, where candidates who do not receive an absolute majority must compete in a second round. In these cases, it is more accurately called \"majority-at-large voting\", where candidates are only qualified to win when they earn a majority vote.", "prediction 1": "Plurality-at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election. The system is commonly referred to as \"block voting\" or the \"bloc vote.\"", "prediction 2": "Plurality-at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election. Multiple winners are elected simultaneously to serve the district. Plurality-at-large voting is in common usage in elections for representative members of a body who are elected or appointed to represent the whole membership of the body.", "prediction 3": "Plurality at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election. Multiple winners are elected simultaneously to serve the district. At-large voting is used in local elections in which all candidates run for multiple seats (positions) citywide.", "prediction 4": "Plurality-at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election. Multiple winners are elected simultaneously to serve the district. Where the system is used in a territory divided into multi-member electoral districts the system is commonly referred to as \"block voting\" or the \"bloc vote\".", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Plurality-at-large voting, also known as block vote or multiple non-transferable vote (MNTV), is a non-proportional voting system for electing several representatives from a single multimember electoral district using a series of check boxes and tallying votes similar to a plurality election. The system is commonly referred to as \"block voting\" or the \"bloc vote.\" This system is usually based on a single round of voting, but it can sometimes appear in a runoff (two-round) version, as in some local elections in France, where candidates who do not receive an absolute majority must compete in a second round." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings i stand alone in quest for camelot?", "passages": [ [ "Quest for Camelot (1998 video game)", "Quest for Camelot (1998 video game)\n\nQuest for Camelot is an action-adventure video game developed and published by Titus Interactive with assistance from Nintendo for the Game Boy Color in 1998.", "It is based on the animated Warner Bros. movie of the same name.", "The game is compatible with the Super Game Boy, Game Boy Printer and as well as play on the original Game Boy.", "A Nintendo 64 version of the game was planned but was scrapped due to the film's performance at the box office.", "Kayley has to rescue her mother, as well as Excalibur, from the evil knight, Ruber and along the way defeat enemies, bosses and meet new friends.", "\"Quest for Camelot\" is a third-person, 2D action role-playing video game.", "It is based on the film by Warner Brothers.", "It features nine worlds with 60 levels.", "The gameplay includes killing enemies in each area, fetch quests, and carry quests.", "Parts of the story are told through slideshows as cut scenes.", "The game supports saves on battery and works with the Game Boy Printer.", "As Kayley, the player sets out to avenge the death of her father and confront Ruber, the villain.", "\"Quest for Camelot\" was developed and co-published by Titus Interactive and Nintendo." ], [ "Quest for Camelot", "Quest for Camelot\n\nQuest for Camelot (released in the United Kingdom as The Magic Sword: Quest for Camelot) is a 1998 American animated musical fantasy film produced by Warner Bros. Feature Animation and directed by Frederik Du Chau and based on the novel \"The King's Damosel\" by Vera Chapman.", "The film stars Jessalyn Gilsig, Cary Elwes, Jane Seymour, Gary Oldman, Eric Idle, Don Rickles, Pierce Brosnan, Bronson Pinchot, Jaleel White, Gabriel Byrne and Sir John Gielgud.", "C\u00e9line Dion, Bryan White, Steve Perry and Andrea Corr perform vocals.", "The film was released by Warner Bros. Pictures under their Warner Bros. Family Entertainment label on May 15, 1998.", "\"Quest for Camelot\" was a box office bomb, grossing $38.1 million against a budget of $40 million and received mediocre reviews from critics, who found its narrative and production values to be derivative of contemporary Disney films.", "Sir Lionel is one of the knights of the Round Table, and his daughter Kayley wants to be a knight like her father.", "At Camelot, one of the knights, Ruber - wanting to overthrow King Arthur - attempts to kill him, but Lionel intervenes and is killed." ] ], "gold": "In the movie \"Quest for Camelot\" the song \"I stand alone\" is performed by Steve Perry, who provided the singing voice for the character of King Arthur. Other original songs composed for the film include \"United We Stand\", \"On My Father's Wings\", \"Ruber\", \"I Stand Alone\", and \"If I Didn't Have You\".", "prediction 1": "C\u00e9line Dion, Bryan White, Steve Perry, and Andrea Corr sing i stand alone in the 1998 musical fantasy film Quest for Camelot. The film stars Jessalyn Gilsig as Kayley, the daughter of King Arthur. Bryan White sings the song in the song The Magic Sword: Quest for Camelot.", "prediction 2": "Quest for Camelot is an American animated musical fantasy film released in 1998 and is based on the 1998 animated Warner Bros. movie of the same name. In the English version of the film, C\u00e9line Dion sings i stand alone, and in the French version, Andrea Corr sings i stand alone.", "prediction 3": "Quest for Camelot is a 1998 American animated musical fantasy film. It was released in the United Kingdom as The Magic Sword: Quest for Camelot. Singers C\u00e9line Dion, Bryan White, Steve Perry and Andrea Corr sing the song \"I Stand Alone\" in the movie.", "prediction 4": "In the 1998 American animated musical fantasy film Quest for Camelot, singers C\u00e9line Dion, Bryan White, Steve Perry, and Andrea Corr sing \"I Stand Alone\".", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 55, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 101 }, { "error type": "Unverifiable", "explanation": "", "start": 126, "end": 196 }, { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 271 } ], "missing-info": [], "corrected-prediction": "C\u00e9line Dion, Bryan White, Steve Perry and Andrea Corr perform vocals in the film \"Quest for Camelot\". " }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "When does clark kent and lois lane get together in smallville?", "passages": [ [ "Smallville", "Smallville\n\nSmallville is an American television series developed by writer-producers Alfred Gough and Miles Millar, based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster.", "The series, initially broadcast by The WB, premiered on October 16, 2001.", "After \"Smallville\"s fifth season, The WB and UPN merged to form The CW, the series' later United States broadcaster.", "\"Smallville\", which ended its tenth and final season on May 13, 2011, follows Clark Kent (Tom Welling) in the fictional town of Smallville, Kansas, before he becomes known as Superman.", "The first four seasons focus on Clark and his friends in high school.", "After season five \"Smallville\" ventures into adult settings, eventually focusing on his career at the \"Daily Planet\" and introducing other DC comic-book superheroes and villains.", "Before the series' production, \"Bruce Wayne\", chronicling the young protagonist's journey toward Batman, was proposed first.", "Although that series failed to generate interest, it inspired \"Smallville\".", "Series developers Gough and Millar pitched their \"no tights, no flights\" rule to the president of Warner Bros. Television, reducing Superman to the bare essentials and examining what led Clark Kent to become the Man of Steel.", "After seven seasons with the show, Gough and Millar departed with little explanation." ], [ "Lois Lane (Smallville)", "Throughout seasons four, five, six and seven, Lois's relationship with Clark Kent is depicted more as a brother/sister relationship, with the two characters often butting heads.", "By season eight, Lois begins to realize that she is falling in love with Clark, and by season nine the two become an official couple.", "During season ten the relationship goes through several milestones and midseason the pair get engaged.", "Series developers Gough and Millar had always envisioned bringing the character of Lois Lane to \"Smallville\", but it was not until the end of season three that the creative team had the right storyline to bring her in.", "Erica Durance was hired to portray the iconic female reporter from the comic books.", "\"Smallville's\" interpretation of Lois was designed to embody similar traits to that of various leading female characters in the film.", "Described as \"fiercely independent\", critics have favorably compared this version of Lois Lane against the other live-action performances of the character in both film and television.", "Lois Lane makes her first appearance in season four's \"Crusade\" when she comes to Smallville investigating the death of her cousin Chloe Sullivan (Allison Mack)." ] ], "gold": "Smallville is an American superhero television series developed by writer-producers Alfred Gough and Miles Millar, based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster. By season eight, Lois begins to realize that she is falling in love with Clark, and by season nine the two become an official couple. They get together on the episode \"Crossfire\", which is on Season 9 Episode 6. It's the 180th episode overall. It aired on October 30, 2009.", "prediction 1": "Smallville is an American television series developed by writer-producers Alfred Gough and Miles Millar, based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster. The series, initially broadcast by The WB, premiered on October 16, 2001. In the series' tenth and final season, the couple get engaged midseason.", "prediction 2": "Smallville is an American television series that followed Clark Kent and Lois Lane through the ten seasons of the show. Their relationship is depicted more as a brother/sister relationship, with the two characters often butting heads. By season nine, Lois begins to realize that she is falling in love with Clark, and by season ten the two become an official couple. During season ten the relationship goes through several milestones and midseason the pair get engaged.", "prediction 3": "Smallville is an American television series developed by writer-producers Alfred Gough and Miles Millar, based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster. The series premiered on October 16, 2001. Throughout seasons four, five and six, Lois begins to realize that she is falling in love with Clark, and by season nine the two become an official couple. During season ten the relationship goes through several milestones and midseason the pair get engaged.", "prediction 4": "Smallville is an American television series based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster. The show followed the life of Clark Kent and Lois Lane in the fictional town of Smallville, Kansas, before he became known as Superman. The couple get engaged in season ten, during which the couple goes through milestones and midseason the pair get engaged.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 261 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Smallville is an American television series developed by writer-producers Alfred Gough and Miles Millar, based on the DC Comics character Superman created by Jerry Siegel and Joe Shuster. By season eight, Lois begins to realize that she is falling in love with Clark, and by season nine the two become an official couple.\nIn the series' tenth and final season which ended on May 13, 2011, the couple get engaged midseason." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When did color tv come out what year?", "passages": [ [ "Color television", "The idea that the VHF band could be allowed to \"die\" was no longer practical.", "During its campaign for FCC approval, CBS gave the first demonstrations of color television to the general public, showing an hour of color programs daily Mondays through Saturdays, beginning January 12, 1950, and running for the remainder of the month, over WOIC in Washington, D.C., where the programs could be viewed on eight 16-inch color receivers in a public building.", "Due to high public demand, the broadcasts were resumed February 13\u201321, with several evening programs added.", "CBS initiated a limited schedule of color broadcasts from its New York station WCBS-TV Mondays to Saturdays beginning November 14, 1950, making ten color receivers available for the viewing public.", "All were broadcast using the single color camera that CBS owned.", "The New York broadcasts were extended by coaxial cable to Philadelphia's WCAU-TV beginning December 13, and to Chicago on January 10, making them the first network color broadcasts.", "After a series of hearings beginning in September 1949, the FCC found the RCA and CTI systems fraught with technical problems, inaccurate color reproduction, and expensive equipment, and so formally approved the CBS system as the U.S. color broadcasting standard on October 11, 1950." ], [ "Color television", "An unsuccessful lawsuit by RCA delayed the first commercial network broadcast in color until June 25, 1951, when a musical variety special titled simply \"Premiere\" was shown over a network of five East Coast CBS affiliates.", "Viewing was again restricted: the program could not be seen on black-and-white sets, and \"Variety\" estimated that only thirty prototype color receivers were available in the New York area.", "Regular color broadcasts began that same week with the daytime series \"The World Is Yours\" and \"Modern Homemakers\".", "While the CBS color broadcasting schedule gradually expanded to twelve hours per week (but never into prime time), and the color network expanded to eleven affiliates as far west as Chicago, its commercial success was doomed by the lack of color receivers necessary to watch the programs, the refusal of television manufacturers to create adapter mechanisms for their existing black-and-white sets, and the unwillingness of advertisers to sponsor broadcasts seen by almost no one.", "CBS had bought a television manufacturer in April, and in September 1951, production began on the only CBS-Columbia color television model, with the first color sets reaching retail stores on September 28.", "But it was too little, too late." ], [ "Color television", "Color television\n\nColor television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set.", "It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray (grayscale).", "Television broadcasting stations and networks in most parts of the world upgraded from black and white to color transmission in the 1970s and 1980s.", "The invention of color television standards is an important part of the history of television, and it is described in the technology of television article.", "Transmission of color images using mechanical scanners had been conceived as early as the 1880s.", "A practical demonstration of mechanically-scanned color television was given by John Logie Baird in 1928, but the limitations of a mechanical system were apparent even then.", "Development of electronic scanning and display made an all-electronic system possible.", "Early monochrome transmission standards were developed prior to the Second World War, but civilian electronics developments were frozen during much of the war.", "In August 1950, Baird gave the world's first demonstration of a practical fully electronic color television display.", "In the United States, commercially competing color standards were developed, finally resulting in the NTSC standard for color that retained compatibility with the prior monochrome system." ] ], "gold": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set and it is considered an improvement on the earliest television technology, monochrome or black-and-white television, in which the image is displayed in shades of gray. A practical demonstration of mechanically scanned color television was given by John Logie Baird in 1928, but the limitations of a mechanical system were apparent even then, but in August 1944, Baird gave the world's first demonstration of a practical fully electronic color television display. Beginning January 12, 1950, CBS gave the first demonstrations of color television to the general public, showing an hour of color programs daily Mondays through Saturdays and running for the remainder of the month, over WOIC in Washington, D.C., where the programs could be viewed on eight 16-inch color receivers in a public building. Color TVs reached retail stores on September 28, 1951.", "prediction 1": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray (grayscale). CBS gave the first demonstrations of color television to the general public, showing an hour of color programs daily Mondays through Saturdays, beginning January 12, 1950, and running for the remainder of the month, over WOIC in Washington, D.C, where the programs could be viewed on eight 16-inch color receivers in a public building. Due to high public demand, the broadcasts were resumed February 13\u201321, with several evening programs added.", "prediction 2": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. In the United States, commercially competing color standards were developed, ultimately resulting in the NTSC standard for color that retained compatibility with the prior monochrome system. In the United Kingdom, the first color television set came out in the UK in the UK in 1948. In the United States, the first commercial color television set came out in the United States in 1952.", "prediction 3": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray. Color television is first introduced by CBS in January 1950, with the first commercial network broadcasts in color being on November 14, 1950.", "prediction 4": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. During its campaign for FCC approval, CBS gave the first demonstrations of color television to the general public, showing an hour of color programs daily Mondays through Saturdays, beginning January 12, 1950, and running for the remainder of the month, over WOIC in Washington, D.C., where the programs could be viewed on eight 16-inch color receivers in a public building.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 681, "end": 788 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray (grayscale). A practical demonstration of mechanically-scanned color television was given by John Logie Baird in 1928, but the limitations of a mechanical system were apparent even then. CBS gave the first demonstrations of color television to the general public, showing an hour of color programs daily Mondays through Saturdays, beginning January 12, 1950, and running for the remainder of the month, over WOIC in Washington, D.C, where the programs could be viewed on eight 16-inch color receivers in a public building. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Air supply - making love out of nothing at all album?", "passages": [ [ "Making Love Out of Nothing at All", "Making Love Out of Nothing at All\n\n\"Making Love Out of Nothing At All\" is a power ballad written and composed by Jim Steinman and first released by Australian soft rock band Air Supply for their 1983 compilation album \"Greatest Hits\".", "It reached number 2 on the U.S. \"Billboard\" Hot 100 for three weeks (behind \"Total Eclipse of the Heart\" by Bonnie Tyler, who would cover this song in 1995, giving Steinman a consecutive peak of two songs).", "The song has been covered by many other artists, the most successful being that of Bonnie Tyler.", "The song is a reworking of the main title theme from the 1980 film \"A Small Circle of Friends\", for which Jim Steinman wrote the score.", "It was first recorded by Air Supply, giving them a number two hit on the \"Billboard\" Hot 100 in the U.S. for three weeks.", "It was held off from the top spot by another Steinman production, Bonnie Tyler's recording of \"Total Eclipse of the Heart\".", "This is the group's last top ten hit in the United States.", "The song was subsequently released as a new track from their 1983 greatest hits album.", "The B-side of the single was \"Late Again\"." ], [ "Making Love Out of Nothing at All", "The song was later covered by Welsh singer Bonnie Tyler on her album \"Free Spirit\".", "It opens with a wordless choral vocal followed by sounds of thunderclaps and a bell before the melody begins, played on piano.", "Over the piano section is an excerpt from \"Un bel di\", the aria from Puccini's Madame Butterfly, sung by Tyler's mother Elsie Hopkins.", "\"Allmusic\" called this version \"fantastic, clocking in at nearly eight minutes, and seems perfectly suited for her voice.", "[Air Supply's] version was already great, but hers is awesome.\"", "It was produced by Steinman, with Steven Rinkoff as co-producer, at The Hit Factory, New York City.", "These lines were changed for the Tyler version, and also for the subsequent Karine Hannah version, as well:\n\nA version from 1982 sung by Rory Dodd also exists.", "The only accompaniment is Steinman playing piano, and he includes several variations on the primary melody in the intro and bridge.", "After the bridge, there are two verses that appear before the final two verses of the Air Supply version.", "The verse from the Tyler version is not included." ] ], "gold": "\"Making Love Out of Nothing at All\" is a power ballad by Australian soft rock band Air Supply first released on their 1983 compilation album Greatest Hits. The song reached number 2 on the U.S. Billboard Hot 100 for three weeks and has been covered by various artists, Welsh singer Bonnie Tyler among them, who released her version on her album Free Spirit.", "prediction 1": "Making Love Out of Nothing At All is a power ballad that was written and composed by Jim Steinman and first released by Australian soft rock band Air Supply for their 1983 compilation album Greatest Hits. The song was covered by Welsh singer Bonnie Tyler on her album Free Spirit.", "prediction 2": "Making Love Out of Nothing At All is a power ballad written and composed by Jim Steinman and first released by Australian soft rock band Air Supply for their 1983 compilation album Greatest Hits. The song reached number 2 on the U.S. Billboard Hot 100 for three weeks, behind Total Eclipse of the Heart by Bonnie Tyler, who would cover this song in 1995, giving Steinman a consecutive peak of two songs. The song was later covered by Welsh singer Bonnie Tyler on her album Free Spirit.", "prediction 3": "Making Love Out of Nothing At All is a power ballad written and composed by Jim Steinman that was first released by Australian soft rock band Air Supply for their 1983 compilation album Greatest Hits. It reached number 2 on the US Billboard Hot 100 for three weeks, behind \"Total Eclipse of the Heart\" by Bonnie Tyler. The song has been covered by many other artists, the most successful being that of Bonnie Tyler. It was later covered by Welsh singer Bonnie Tyler on her album Free Spirit.", "prediction 4": "Making Love Out of Nothing At All is a power ballad written and composed by Jim Steinman and first released by Australian soft rock band Air Supply for their 1983 compilation album Greatest Hits. It reached number 2 on the U.S. Billboard Hot 100 for three weeks and was later covered by Bonnie Tyler on her album Free Spirit. The song was produced by Steinman, with Steven Rinkoff as co-producer, at The Hit Factory, New York City.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 97 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Making Love Out of Nothing At All\" is a power ballad by Australian soft rock band Air Supply first released for their 1983 compilation album Greatest Hits. It reached number 2 on the U.S. \"Billboard\" Hot 100 for three weeks. The song has been covered by many other artists, Welsh singer Bonnie Tyler among them, on her album Free Spirit." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who does the voice of batman in the lego movie?", "passages": [ [ "The Lego Movie", "By June 2012, Chris Pratt had been cast as the voice of Emmet, the lead Lego character, and Will Arnett voicing Lego Batman; the role of Lego Superman was offered to Channing Tatum.", "By August 2012, Elizabeth Banks was hired to voice Lucy (later getting the alias \"Wyldstyle\") and Morgan Freeman to voice Vitruvius, an old mystic.", "In October 2012, Warner Bros. shifted the release date for the film, simply titled \"Lego\", to February 7, 2014.", "In November 2012, Alison Brie, Will Ferrell, Liam Neeson, and Nick Offerman signed on for roles.", "Brie voices Unikitty, a member of Emmet's team; Ferrell voices the antagonist President/Lord Business; Neeson voices Bad Cop/Good Cop and Offerman voices MetalBeard, a pirate seeking revenge on Business.", "In July 2012, a Lego-user contest announced on the film's Facebook page would choose a winning Lego vehicle to appear in the film.", "Miller's childhood Space Village playset is utilized in the film.", "The film is strongly inspired by the visual aesthetic and stylistics of Brickfilms and received a great deal of praise in the respective online communities who saw the film as appraising nod to their work." ], [ "The Lego Movie", "With a total gross of \u00a334.3 million, it was the second-highest-grossing film in the UK and Ireland in 2014.", "The popularity of the film led to a shortage of Lego products by September 2014.", "Because of its critical and commercial success, \"The Lego Movie\" has been turned into a franchise and a shared fictional universe, it consists of:\n\nA direct sequel to the film, entitled \"\", is scheduled for release on February 8, 2019 with Chris Pratt, Elizabeth Banks and Will Arnett reprising their roles of Emmet, Wyldstyle and Batman respectively and Tiffany Haddish joining the cast.", "There are two spin-off films, the first two of which, \"The Lego Batman Movie\" and \"The Lego Ninjago Movie\", were both released in 2017.", "A third spin-off titled \"The Billion Brick Race\" was scheduled for release in 2019.", "A 4-D movie featuring in-theatre effects, based on the film itself, titled \"\", opened at select Legoland theme parks across the globe in 2016.", "On May 10, 2017, Warner Bros. and Lego announced that the character Unikitty would receive a spin-off television series on Cartoon Network, with Tara Strong voicing the character.", "The series premiered January 1, 2018." ] ], "gold": "The Lego Movie is an American media franchise based on Lego construction toys. It began with the 2014 film The Lego Movie. The success of the film led to the release of two spin-off films titled The Lego Batman Movie and The Lego Ninjago Movie, which were released in 2017, and the sequel to the original movie titled The Lego Movie 2: The Second Part in 2019. Will Arnett plays Batman in The Lego Movie 1 and 2 as well as the Lego Batman Movie.", "prediction 1": "In the Lego movie, Batman is voiced by Will Arnett, with Chris Pratt doing the voice of Batman. By June 2012, Chris Pratt had been cast as the voice of Emmet, the lead Lego character, and Will Arnett voicing Lego Batman. The role of Lego Superman was offered to Channing Tatum for the role of Batman.", "prediction 2": "The Lego Movie is a 2014 American animated film directed by Phil Lord. The movie's lead character, Batman, is voiced by Will Arnett. In the original 2016 version, Christopher Walken did the voice of Batman. In the 2017 version, Batman is voiced by Cameron Diaz.", "prediction 3": "The film, \"The Lego Movie\", was released in 2012 under the title \"Lego\", with Will Arnett voicing Batman. In the 2015 Lego film \"The Lego Movie: The Rise of Superman\", the voice of Superman was given to Channing Tatum, while the 2012 Lego Batman movie's voice was given to Chris Pratt.", "prediction 4": "In the film The Lego Movie, Will Arnett is the voice of Batman. He is a child actor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 95 }, { "error type": "Redundant", "explanation": "In the Lego movie, Batman is voiced by Will Arnett, with Chris Pratt doing the voice of Batman. ", "start": 96, "end": 220 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the Lego movie, Batman is voiced by Will Arnett. The success of the 2014 film led to the release of two spin-off films titled The Lego Batman Movie and The Lego Ninjago Movie, which were released in 2017, and the sequel to the original movie in 2019, with Will Arnett reprising his role as Batman." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "How many episodes is there of peaky blinders?", "passages": [ [ "Peaky Blinders (TV series)", "Peaky Blinders (TV series)\n\nPeaky Blinders is a British crime drama television series primarily set in Birmingham, England in the aftermath of World War I. The series, which was created by Steven Knight and produced by Caryn Mandabach Productions, Screen Yorkshire and Tiger Aspect Productions, follows the exploits of the Shelby crime family.", "Screen Yorkshire provided funding for the production through the Yorkshire Content Fund.", "It was the first production to receive funding from the Yorkshire Content Fund, which in turn made certain the majority of the show was filmed in Yorkshire as part of the deal.", "Cillian Murphy plays Tommy Shelby, the gang's leader, and Sam Neill as Chester Campbell is a commissioned detective from Belfast who is tasked with suppressing the gang.", "The series creators have reused the name of Peaky Blinders, a 19th century urban youth gang who were active in the city from the 1890s and were believed to sew razor blades into their caps.", "The first series aired on BBC Two on 13 September 2013 and ran for six episodes.", "The second series premiered on 2 October 2014.", "The third series premiered on 5 May 2016.", "On 26 May 2016, the BBC announced they had ordered a fourth and fifth series of the show.", "The fourth series premiered on 15 November 2017; after the series finale broadcast on 20 December 2017, it was announced that the fifth series will be broadcast in 2019." ], [ "Peaky Blinders (TV series)", "On 2 March 2016, Steven Knight told the Crime Scene Quarterly, \"I've had unsolicited communication from Michael Mann, the film director, from Dennis Lehane, Snoop Dogg \u2013 he's such a fan.", "And the late David Bowie was a huge fan \u2013 more of that to come\" (strongly hinting Bowie's involvement on Series 3).", "It was later confirmed that David Bowie's music would be featured, and Leonard Cohen had also written a new song for series 3.", "On 24 September 2014, it was announced that Netflix had acquired exclusive US distribution rights from the Weinstein Company and Endemol.", "The entirety of series 1 became available for streaming on 30 September 2014; series 2 launched in November 2014.", "Series 3 was made available 31 May 2016.", "Due to licensing restrictions, however, most of the show's original soundtrack is not available on the Netflix-distributed version of the series.", "In 2018, it was announced Peaky Blinders would be moved from its original broadcast channel, BBC Two, to BBC One." ] ], "gold": "Peaky Blinders consisted of 6 seasons, each having 6 episodes each. So, season 2 ended with a total of 12 total episodes, season 3 with 18, season 4 with 24, and so on.", "prediction 1": "Peaky Blinders is a British crime drama television series primarily set in Birmingham, England in the aftermath of World War I. The series, which was created by Steven Knight and produced by Caryn Mandabach Productions, Screen Yorkshire and Tiger Aspect Productions, follows the exploits of the Shelby crime family. The first series aired on BBC Two on 13 September 2013 and ran for six episodes. The second series premiered on 2 October 2014. The third series premiered on 5 May 2016. On 26 May 2016, the BBC announced they had ordered a fourth and fifth series of the show.\n", "prediction 2": "Peaky Blinders is a British crime drama television series primarily set in Birmingham, England in the aftermath of World War I. The first series aired on BBC Two on 13 September 2013, and ran for six episodes. The second series premiered on 2 October 2014, and the third series premiered on 5 May 2016. Peaky Blinders became a Netflix property in 2018 after the BBC ordered 5 additional series for release on Netflix.", "prediction 3": "Peaky Blinders is a British crime drama television series primarily set in Birmingham, England in the aftermath of World War I. It's the story of the Shelby crime family and the exploits of their leader Tommy Shelby. There were six episodes in the first series of Peaky Blinders. The second series aired on BBC Two's The Late Show with Stephen Knight, for six episodes in total. It's third series aired on BBC One and on November 20, 2017's Peaky Blinders.", "prediction 4": "Peaky Blinders is a British crime drama television series primarily set in Birmingham, England in the aftermath of World War I. The series, which was created by Steven Knight and produced by Caryn Mandabach Productions, Screen Yorkshire and Tiger Aspect Productions, follows the exploits of the Shelby crime family. The first series aired on BBC Two on 13 September 2013 and ran for six episodes. The second series premiered on 2 October 2014. The third series premiered on 5 May 2016. The fourth series premiered on 15 November 2017 and the fifth series premiered on BBC Two on 12 March 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 333, "end": 374 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 443 }, { "error type": "Irrelevant", "explanation": "", "start": 461, "end": 485 }, { "error type": "Irrelevant", "explanation": "", "start": 486, "end": 536 } ], "missing-info": [], "corrected-prediction": "Peaky Blinders has a least 5 seasons, the first series ran for six episodes. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is point pleasant beach in new jersey?", "passages": [ [ "Point Pleasant Beach, New Jersey", "Point Pleasant Beach, New Jersey\n\nPoint Pleasant Beach is a borough in Ocean County, New Jersey, United States.", "As of the 2010 United States Census, the borough's population was 4,665, reflecting a decline of 649 (-12.2%) from the 5,314 counted in the 2000 Census, which had in turn increased by 202 (+4.0%) from the 5,112 counted in the 1990 Census.", "Point Pleasant Beach was incorporated as a borough by an act of the New Jersey Legislature on May 18, 1886, from portions of Brick Township, subject to the results of a referendum passed the previous day.", "The borough is situated on the Barnegat Peninsula, a long, narrow barrier peninsula that divides the Barnegat Bay from the Atlantic Ocean at the Manasquan Inlet, and the borough derives its name from this location.", "The borough's boardwalk is approximately one mile long, spanning the coastline from the Manasquan Inlet at the north to New Jersey Avenue in the south.", "The central third of the boardwalk is largely amusement rides, the Jenkinsons Aquarium, the Jenkinsons Arcades, pizza joints, ice cream parlors, games-of-chance and miniature golf courses.", "Point Pleasant Beach is also the northern terminus of the East Coast's Intracoastal Waterway." ], [ "Point Pleasant Beach station", "Point Pleasant Beach station\n\nPoint Pleasant Beach is a train station located in Point Pleasant Beach, in Ocean County, New Jersey, United States, on NJ Transit's North Jersey Coast Line, and is one of the most significant stops on the NJCL portion between Long Branch and Bay Head.", "This modern station is located on one of the borough's major arteries, Arnold Avenue, Route 35, just blocks to the Atlantic Ocean, boardwalk, Manasquan Inlet marina, and only steps to the community's downtown business, shopping, dining and entertainment nexus.", "The current building and platforms are only about 10 years old, a consequence of the station's redevelopment yielding the modern fixtures and services.", "The station is handicapped-accessible.", "The former station depot constructed by the Central Railroad of New Jersey was razed after being condemned due to the station settling to the ground.", "The 50-year old structure came down on June 8, 1987 and replaced by a trailer.", "After several delays, construction of the new station began in June\u00a01994.", "The new depot opened in January\u00a01996.", "The station features an enclosed ticketing/waiting area building adjoined to the inbound tracks.", "The southbound platform features some overhangs for protection from the elements but no major structures or services since the majority of people using this platform are inbound from the north due to there being only one more southerly stop." ], [ "Point Pleasant Beach High School", "Point Pleasant Beach High School\n\nPoint Pleasant Beach High School is a four-year, comprehensive community public high school that serves students in ninth through twelfth grades from Point Pleasant Beach in Ocean County, New Jersey, United States, operating as the lone secondary school of the Point Pleasant Beach School District.", "The school has been accredited by the Middle States Association of Colleges and Schools Commission on Secondary Schools since 1939.", "In addition to the students of Point Pleasant Beach, the high school serves the students of Bay Head and Lavallette for grades 9-12 and those from Mantoloking for K-12, as part of sending/receiving relationships, as well as some students who attend on a tuition basis.", "As of the 2015-16 school year, the school had an enrollment of 347 students and 35.6 classroom teachers (on an FTE basis), for a student\u2013teacher ratio of 9.7:1.", "There were 27 students (7.8% of enrollment) eligible for free lunch and 14 (4.0% of students) eligible for reduced-cost lunch.", "The school was the 83rd-ranked public high school in New Jersey out of 339 schools statewide in \"New Jersey Monthly\" magazine's September 2014 cover story on the state's \"Top Public High Schools\", using a new ranking methodology." ] ], "gold": "Point Pleasant Beach is a borough in Ocean County, New Jersey, USA, at 40.092566\u00b0N 74.045173\u00b0W. The Point Pleasant Beach train station is located within the community's downtown nexus at Arnold Avenue and Route 35 northbound Point Pleasant Beach, NJ 08742. The address of the Point Pleasant Beach School District is 299 Cooks Lane Point Pleasant Beach, NJ 08742. Point Pleasant Beach High School, the only public secondary school within the school district, is located at 700 Trenton Avenue Point Pleasant Beach, NJ 08742 United States.", "prediction 1": "Point Pleasant Beach is a borough in Ocean County, New Jersey, United States. It is situated on the Barnegat Peninsula, a long, narrow barrier peninsula that divides the Barnegat Bay from the Atlantic Ocean at the Manasquan Inlet. The borough derives its name from this location. Point Pleasant Beach is also the northern terminus of the East Coast's Intracoastal Waterway. Point Pleasant Beach High School is located in Point Pleasant Beach, New Jersey and serves students in ninth through twelfth grades.", "prediction 2": "Point Pleasant Beach is a borough in Ocean County, New Jersey, United States. Point Pleasant Beach is a borough that was incorporated as a borough by an act of the New Jersey Legislature on May 18, 1886, from portions of Brick Township. The borough derives its name from the Barnegat Peninsula, a long, narrow barrier peninsula that divides the Barnegat Bay from the Atlantic Ocean at the Manasquan Inlet. The train station is located in Point Pleasant Beach, in Ocean County, New Jersey Coast Line and is one of the most significant stops on the NJCL portion between Long Branch and Bay Head. The former depot was razed after being condemned due to the station settling to the station settling to the station settling to the station settling to the station settling to the station settling to the station settling to the station settling to the station settling to the station settling to", "prediction 3": "Point Pleasant Beach is a borough in Ocean County, New Jersey, United States. The borough's boardwalk is approximately one mile long, spanning the coastline from the Manasquan Inlet at the north to New Jersey Avenue in the south. The Point Pleasant Beach train station is located in Point Pleasant Beach, in Ocean County, New Jersey, United States, on NJ Transit's North Jersey Coast Line. This station is one of the most significant stops on the NJCL portion between Long Branch and Bay Head.", "prediction 4": "Point Pleasant Beach is a borough in Ocean County, New Jersey. It is located on the Barnegat Peninsula, a long, narrow barrier peninsula that divides the Barnegat Bay from the Atlantic Ocean at the Manasquan Inlet. The borough derives its name from this location. It has a train station and is one of the most significant stops on the NJCL portion of the East Coast's Intracoastal Waterway. It is a four-year, comprehensive community public high school that serves students in ninth through twelfth grades from Point Pleasant Beach, New Jersey.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 374, "end": 506 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Point Pleasant Beach is a borough in Ocean County, New Jersey, United States. It is situated on the Barnegat Peninsula, a long, narrow barrier peninsula that divides the Barnegat Bay from the Atlantic Ocean at the Manasquan Inlet. Point Pleasant Beach is also the northern terminus of the East Coast's Intracoastal Waterway. Point Pleasant Beach station is located on one of the borough's major arteries, Arnold Avenue, Route 35," }, "preference": [ 1, 0, 2, 2, 2, 2 ] }, { "question": "When is the sunday times rich list 2018 published?", "passages": [ [ "Sunday Times Rich List 2017", "Sunday Times Rich List 2017\n\nThe Sunday Times Rich List 2017 is the 29th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 7 May 2017.", "The List was edited by Robert Watts who succeeded long-term compiler Philip Beresford this year.", "The list was previewed in the previous week's \"Sunday Times\" and widely reported by other media." ], [ "Sunday Times Rich List 2016", "Sunday Times Rich List 2016\n\nThe Sunday Times Rich List 2016 is the 28th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 24 April 2016.", "Long-term compiler Philip Beresford was joined by Robert Watts for the 2016 list.", "An estimated wealth of \u00a3103 million is required for entry in the 2016 list.", "Newly added to the list for the first time, and ranked in the top 100, are John Grayken, Christo Wiese, Sunil Vaswani & Family, and Martin Moller.", "The \"Daily Mail\" noted that \"Britain's Super Rich have taken a hammering in the last year, as it was revealed 10 men have been downgraded from billionaires to mere multi-millionaires.\"" ], [ "Sunday Times Rich List 2015", "Sunday Times Rich List 2015\n\nThe Sunday Times Rich List 2015 is the 27th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 26 April 2015.", "\"The Guardian\" reported that the collective wealth of Britain\u2019s 1,000 richest people had more than doubled in the last 10 years with a combined fortune of just over \u00a3547bn and a fortune of \u00a3100m was now required to qualify for the list.", "This year's list marked the first year Queen Elizabeth II was not among the list's top 300 most wealthy since the list began in 1989." ], [ "Sunday Times Rich List", "Sunday Times Rich List\n\nThe Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth.", "The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper \"The Sunday Times\" since 1989.", "The editorial decisions governing the compilation of the \"Rich List\" are published in the newspaper and online as its \"Rules of engagement.\"", "The \"Rich List\" is not limited to British citizens and it includes individuals and families born overseas but who predominantly work and/or live in Britain.", "This excludes some individuals with prominent financial assets in Britain.", "The editors estimate subjects' wealth from a range of public information, based on values in January each year.", "They typically explain their actions by stating: \"We measure identifiable wealth, whether land, property, racehorses, art or significant shares in publicly quoted companies.", "We exclude bank accounts\u2014to which we have no access...", "We try to give due consideration to liabilities.\"", "The 2015 list marked the first year Queen Elizabeth II was not among the list's top 300 most wealthy since the list began in 1989.", "She was number one on the list when it began in 1989.", "The most recent list was published on 13 May 2018.", "A fuller version of the \"Rich List\" is also published in a reference book edition, edited by Philip Beresford." ], [ "Sunday Times Rich List 2018", "Sunday Times Rich List 2018\n\nThe Sunday Times Rich List 2018 is the 30th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 13 May 2018.", "The List was edited by Robert Watts who succeeded long-term compiler Philip Beresford last year.", "The List was previewed in the previous week's \"Sunday Times\" and widely reported by other media." ] ], "gold": "The Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper The Sunday Times since 1989. The Sunday Times Rich List 2018 was the 30th annual survey of the wealthiest people resident in the United Kingdom, and was published on 13 May 2018. The Sunday Time Rich list in 2017 was published 7 May 2017, with the 2016 list being published 24 April 2016, and the 2015 list being published 26 April 2015.", "prediction 1": "Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper The Sunday Times since 1989. The Sunday Times Rich List 2018 is the 30th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 13 May 2018. The List was edited by Robert Watts who succeeded long-term compiler Philip Beresford last year.", "prediction 2": "The Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper The Sunday Times since 1989. The most recent list was published on 13 May 2018.", "prediction 3": "The Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper The Sunday Times since 1989. In 2018, the Sunday Times Rich List was published on 13 May 2018. In 2015, the Sunday Times Rich List was published on 26 April 2015. In 2016, the Sunday Times Rich List was published on 27 April 2015. In 2018, the Sunday Times Rich List was published on 13 May 2018.", "prediction 4": "Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. It is updated annually in April and published as a magazine supplement by British national Sunday newspaper \"The Sunday Times\" since 1989. The Sunday Times Rich List 2018 is the 30th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 13 May 2018. The List was edited by Robert Watts who succeeded long-term compiler Philip Beresford this year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 435, "end": 531 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sunday Times Rich List is a list of the 1,000 wealthiest people or families resident in the United Kingdom ranked by net wealth. The list is updated annually in April and published as a magazine supplement by British national Sunday newspaper The Sunday Times since 1989. The Sunday Times Rich List 2018 is the 30th annual survey of the wealthiest people resident in the United Kingdom, published by \"The Sunday Times\" on 13 May 2018. The Sunday Time Rich List 2015 was published on 26 April 2015. The Sunday Time Rich List 2016 was published on 24 April 2016. And the Sunday Time Rich List 2017 was published on 7 May 2017." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Where is the headquarter of microsoft office located?", "passages": [ [ "Microsoft", "Microsoft was ranked number 1 in the list of the World's Best Multinational Workplaces by the Great Place to Work Institute in 2011.", "The corporate headquarters, informally known as the Microsoft Redmond campus, is located at One Microsoft Way in Redmond, Washington.", "Microsoft initially moved onto the grounds of the campus on February 26, 1986, weeks before the company went public on March 13.", "The headquarters has since experienced multiple expansions since its establishment.", "It is estimated to encompass over 8 million ft (750,000\u00a0m) of office space and 30,000\u201340,000 employees.", "Additional offices are located in Bellevue and Issaquah (90,000 employees worldwide).", "The company is planning to upgrade its Mountain View, California campus on a grand scale.", "The company has occupied this campus since 1981.", "The company is planning to buy the 32-acre campus.", "The plans submitted involve expanding the campus by 25%.", "It is expected that it will take three years to complete the expansion.", "If approved, construction will start in early 2017.", "Microsoft operates an East Coast headquarters in Charlotte, North Carolina.", "On October 26, 2015, the company opened its flagship retail location on Fifth Avenue in New York City.", "The location features a five-story glass storefront and is 22,270 square feet.", "As per company executives, Microsoft had been on the lookout for a flagship location since 2009." ], [ "IBM", "In October 2018, IBM announced its intention to acquire Red Hat for $34 billion.", "IBM is headquartered in Armonk, New York, a community north of Midtown Manhattan.", "Its principal building, referred to as CHQ, is a glass and stone edifice on a parcel amid a 432-acre former apple orchard the company purchased in the mid-1950s.", "There are two other IBM buildings within walking distance of CHQ: the North Castle office, which previously served as IBM's headquarters; and the Louis V. Gerstner, Jr., Center for Learning (formerly known as IBM Learning Center (ILC)), a resort hotel and training center, which has 182 guest rooms, 31 meeting rooms, and various amenities.", "IBM operates in 174 countries , with mobility centers in smaller markets areas and major campuses in the larger ones.", "In New York City, IBM has several offices besides CHQ, including the IBM Watson headquarters at Astor Place in Manhattan.", "Outside of New York, major campuses in the United States include Austin, Texas; Research Triangle Park (Raleigh-Durham), North Carolina; Rochester, Minnesota; and Silicon Valley, California.", "IBM's real estate holdings are varied and globally diverse.", "Towers occupied by IBM include 1250 Ren\u00e9-L\u00e9vesque (Montreal, Canada), Tour Descartes (Paris, France), and One Atlantic Center (Atlanta, Georgia, USA)." ] ], "gold": "The corporate headquarters, informally known as the Microsoft Redmond campus, is located at One Microsoft Way in Redmond, Washington. Microsoft operates an East Coast headquarters in Charlotte, NC. Microsofts's Europe headquarters is in Paris, France.", "prediction 1": "The headquarter of Microsoft is located at One Microsoft Way in Redmond, Washington. The corporate headquarters, informally known as the Microsoft Redmond campus, is located in Mountain View, California.", "prediction 2": "Microsoft's corporate headquarters, informally known as the Microsoft Redmond campus, is located at One Microsoft Way in Redmond, Washington. The headquarters has since experienced multiple expansions since its establishment. Microsoft also operates an East Coast headquarters in Charlotte, North Carolina. The company is planning to upgrade its Mountain View, California campus on a grand scale. The company has occupied this campus since 1981.", "prediction 3": "Microsoft's corporate headquarters, informally known as the Microsoft Redmond campus, is located at One Microsoft Way in Redmond, Washington. The headquarter of Microsoft is also located in Mountain View, California. Microsoft has an East Coast headquarters in Charlotte, North Carolina. The company also has an office in Redmond, Washington.", "prediction 4": "Microsoft is headquartered in Redmond, Washington. The company initially moved onto the grounds of the campus on February 26, 1986, weeks before the company went public on March 13. The headquarters has since experienced multiple expansions since its establishment. It is estimated to encompass over 8 million ft (750,000 m) of office space and 30,000\u201340,000 employees. Microsoft also operates an East Coast headquarters in Charlotte, North Carolina. Microsoft's East Coast headquarters is located in Redmond, Washington.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 177, "end": 203 }, { "error type": "Redundant", "explanation": "The headquarter ", "start": 85, "end": 112 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 13 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The corporate headquarters, informally known as the Microsoft Redmond campus, is located at One Microsoft Way in Redmond, Washington. Microsoft operates an East Coast headquarters in Charlotte, North Carolina. Tour Descartes in Paris, France is one of the towers occupied by IBM." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who plays thanos in the first avengers movie?", "passages": [ [ "Thanos", "Thanos\n\nThanos (, ) is a fictional supervillain appearing in American comic books published by Marvel Comics.", "The character, created by writer/artist Jim Starlin, first appeared in \"The Invincible Iron Man\" #55 (cover dated February 1973).", "Thanos is one of the most powerful villains in the Marvel Universe and has clashed with many heroes including the Avengers, the Guardians of the Galaxy, the Fantastic Four, and the X-Men.", "The character appears in the Marvel Cinematic Universe, portrayed by Damion Poitier in \"The Avengers\" (2012), and by Josh Brolin in \"Guardians of the Galaxy\" (2014), \"\" (2015), \"\" (2018), and \"\" (2019) through voice and motion capture.", "The character has also appeared in various comic adaptations, including animated television series, arcade, and video games.", "Writer-artist Jim Starlin originally conceived of Thanos of Titan during college psychology classes.", "As Starlin described:\n\nStarlin has admitted the character's look was influenced by Jack Kirby's Darkseid:\n\nThanos' first appearance was in \"The Invincible Iron Man\" #55 (February 1973), featuring a story by Jim Starlin that was co-scripted by Mike Friedrich." ], [ "Production of Avengers: Infinity War and Avengers: Endgame", "Like in the comics, you want him to be threading through the universe and to save the big finale for the big finale.\"", "While all non-\"Avengers\" films in the MCU were considered set-up for this storyline, laying \"much of the groundwork\", producer and president of Marvel Studios Kevin Feige said that \"Black Panther\" in particular would be \"a very important\" link to the \"Avengers\" sequels in Phase Three of the MCU, as was \"Thor: Ragnarok\".", "In July 2014, Feige stated that there were \"some notions\" to where Marvel would want to take a third Avengers film and that the studio was aiming for three years between \"Avengers: Age of Ultron\" in 2015 and a sequel.", "In October 2014, Marvel announced a two-part sequel to \"Age of Ultron\", titled \"Avengers: Infinity War\".", "\"Part 1\" was scheduled to be released on May 4, 2018, and \"Part 2\" was scheduled for May 3, 2019, with the two films filming back-to-back.", "In January 2015, Whedon stated that it was \"very doubtful\" that he would be involved with the two \"Infinity War\" films." ], [ "Josh Brolin", "In 2010, Brolin was cast to portray the titular character in \"Jonah Hex\", based on the DC Comics' character with the same name.", "Brolin later was cast the younger version of Tommy Lee Jones's character, Kevin Brown / Agent K, in \"Men in Black 3\" (2012).", "A year later he starred in the film \"Gangster Squad\", portraying fictional WWII Veteran named John O'Mara.", "Brolin was one of the actors who was considered for the role of Bruce Wayne / Batman in the DC Extended Universe, a deal which would have begun with Zack Snyder's \"\", but Ben Affleck was chosen for the role instead.", "The following year, it was announced that Brolin would play Thanos within the Marvel Cinematic Universe.", "He portrays the character through motion capture performance, as well as voice acting.", "He cameoed as the character in \"Guardians of the Galaxy\" (2014) and \"\" (2015), and then reprised Thanos in a starring role in \"\" (2018) and 2019's \"\", which were filmed back-to-back.", "In April 2017, Brolin signed a four-film contract with 20th Century Fox studios to portray the Marvel Comics character Nathan Summers / Cable in the \"X-Men\" film series.", "2018's \"Deadpool 2\" is his first installment within that contract." ] ], "gold": "In the first Avengers movie, The Avengers, Damion Poitier makes an uncredited appearance as Thanos. This marks the character's first appearance in the Marvel Cinematic Universe. In the movie's sequels, Guardians of the Galaxy, Avengers: Age of Ultron, Avengers: Infinity War and Avengers: Endgame, Thanos is portrayed by Josh Brolin through voice and motion capture. Thanos also appears in the Disney+ animated series, What If...?, with Brolin reprising the role.", "prediction 1": "In the first two Avengers movies Damion Poitier plays Thanos, the villain who is one of the most powerful in the Marvel Cinematic Universe, and Josh Brolin plays Thanos. In the first Avengers movie, Thor: Ragnarok, Thanos is played by Ben Affleck. In the first Avengers movie, Thanos is played by Tom Holland as Thanos, and in The Avengers movie, Thanos is played by Damion Poitier as Thanos, Captain America: Civil War's Thanos Thanos.", "prediction 2": "The character Thanos appeared in the first three Avengers movies, The Avengers and Avengers: Infinity War. Damion Poitier played Thanos in Avengers: Infinity War and Josh Brolin played Thanos in Guardians of the Galaxy.", "prediction 3": "In the first Avengers movie Damion Poitier played Thanos. In the second Avengers movie, Josh Brolin played Thanos. In the third Avengers movie, Thanos is played by Josh Brolin.", "prediction 4": "In the first Avengers movie, Thanos is played by Damion Poitier. Josh Brolin played Thanos in the first two Avengers movies. In the third avenger movie, Thanos is played by Chris Evans.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 13, "end": 32 }, { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 139 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 199, "end": 214 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 235, "end": 247 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 297, "end": 308 }, { "error type": "Redundant", "explanation": "In the first two Avengers movies Damion Poitier plays Thanos, the villain who is one of the most powerful in the Marvel Cinematic Universe, and Josh Brolin plays Thanos.", "start": 347, "end": 392 }, { "error type": "Irrelevant", "explanation": "", "start": 393, "end": 436 } ], "missing-info": [], "corrected-prediction": "In the first Avengers movies Damion Poitier plays Thanos and Josh Brolin plays Thanos through voice and motion capture in later films. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who got murdered in fast and furious 4?", "passages": [ [ "Fast & Furious (2009 film)", "Fast & Furious (2009 film)\n\nFast & Furious (alternatively known as The Fast and the Furious 4, or Fast & Furious 4) is a 2009 American action film directed by Justin Lin and written by Chris Morgan.", "It is the fourth installment of \"The Fast and the Furious\" franchise.", "The film, which stars Vin Diesel, \nPaul Walker, Michelle Rodriguez, and Jordana Brewster, is set between the second and installments and bridges from the first film into a present-day setting, with main members of the original cast reprising their roles.", "Originally released on April 3, 2009, it received negative reviews upon release, but was a box office success grossing $363 million worldwide.", "It was followed by \"Fast Five\" in 2011.", "For this entry and onward \"Fast & Furious\" is the official brand name of the franchise, which was used for future installments, as well as video games and a .", "Five years after the first film, Dominic Toretto (Vin Diesel) and his new crew, consisting of his girlfriend Letty (Michelle Rodriguez), Tego Leo (Tego Calderon), Rico Santos (Don Omar), Cara (Mirtha Michelle) and Han Lue (Sung Kang), are hijacking fuel tankers in the Dominican Republic." ], [ "Han Lue", "Malo, realizing that the two were attracted to each other, asked if they wanted a room.", "Cara instead gives him her drink and she and Han leave the bar.", "Han is seen only in the beginning of \"Fast & Furious\".", "He along with Letty Ortiz, Toretto, Tego Leo, Rico Santos, and Cara, are hijacking a fuel tanker in the Dominican Republic.", "Han and Cara hijack the first two tankers while Leo and Santos hijack the other two tankers, not before the truck driver gives them a little problem after seeing Letty on top of the tanker and notices that the hijacking is going on.", "After the hijacking is done, Toretto disbands the crew after suspecting that the police are closing in on Toretto and his gang.", "Han is recruited for a heist in the events of \"Fast Five\" as a precision driver and a \"chameleon\".", "During the events of the film, he starts to fall in love with another member of the crew, Gisele Yashar.", "At the end of the film, Han and Gisele are seen driving on a highway and are in a relationship.", "When Han and Gisele arrive in London, they\u2019re given the details of their situation with Owen Shaw and Letty Ortiz by Luke Hobbs." ], [ "Fast & Furious (2009 film)", "Dominic suspects that the police are on their trail, forcing the crew to disband and go their separate ways, with Han deciding to go to Tokyo.", "Realizing that he must leave, Dominic runs, leaving Letty behind to protect her from harm.", "Three months later, Dominic is now residing in Panama City.", "He gets a call from his sister, Mia Toretto (Jordana Brewster), who tells him that Letty has been murdered.", "Dominic heads back to Los Angeles to attend her funeral and examine the crash and finds traces of nitromethane on the ground.", "He visits the only car mechanic that sells nitromethane in LA and forces him into giving him the name David Park, the man who ordered the fuel, and informs him that the only car that uses nitromethane in the area is a green 1972 Ford Gran Torino Sport.", "Meanwhile, FBI agent Brian O'Conner (Paul Walker) is trying to track down a Mexican drug lord, Arturo Braga (John Ortiz).", "His search leads him to David Park, and he tracks him down using an illegal modification record on his car.", "Dominic arrives at Park's apartment first and hangs him out of the window by his ankles before Brian arrives.", "Brian saves Park and Park becomes the FBI's new informant.", "Park gets Brian into a street race." ] ], "gold": "Fast & Furious, which is the fourth installment in the Fast & Furious franchise, is a 2009 American action film directed by Justin Lin and written by Chris Morgan. The character who got murdered in the film was Leticia \"Letty\" Ortiz, played by Michelle Rodriguez. In the film, Dominic Toretto and his new crew, including girlfriend Letty, are hijacking fuel tankers in the Dominican Republic, when Dom suspects that the police are on their trail, forcing the crew to disband and go their separate ways. Dom runs, leaving Letty behind to protect herself from harm, but three months later he receives a call that she has been murdered.", "prediction 1": "In the 2009 American action film Fast & Furious 4, Letty Toretto, who is played by Vin Diesel, was a victim of murder. When Dominic Toretto, acting as Dominic Shaw, found out about the murder of his sister, he immediately hung him out of the window and hung him by his ankles, causing him to fall unconscious.", "prediction 2": "Fast & Furious 4, also known as Fast & Furious 4, is a 2009 American action film directed by Justin Lin and written by Chris Morgan. Fast & Furious 4 is the fourth installment of \"The Fast and the Furious\" franchise and features the murder of Letty Ortiz, played by Michele Rodriguez. Toretto, played by Vin Diesel, is the father of Letty Ortiz, and he was murdered by her sister, Mia, in the film.", "prediction 3": "Fast & Furious 4, also known as Fast & Furious 4 or Fast & Furious 5, is a 2009 American action film directed by Justin Lin and written by Chris Morgan. It is the fourth installment of The Fast and the Furious franchise. Dominic Toretto, played by Vin Diesel, is one of the main characters of the film. His sister Mia, played by Jordana Brewster, is the one who gets murdered. His sister, however, is murdered by Letty's boyfriend, Owen Shaw, played by Jordana Brewster.", "prediction 4": "In Fast & Furious 4, the second film in the Fast and the Furious franchise, the character of Letty Toretto gets murdered by her boyfriend, Dominic Toretto. Toretto's sister Mia Toretto got murdered by her boyfriend, Roberto Torres.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 51, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 309 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3, 4 ] } ], "corrected-prediction": "In the 2009 American action film Fast & Furious 4, Letty Toretto, who is played by Michelle Rodriguez, was a victim of murder. Dom and his new crew, including girlfriend Letty, are hijacking fuel tankers in the Dominican Republic. When he suspects that the police are closing in on them, he disbands the crew. Dom runs, leaving Letty behind to protect her from harm. Three months later, he receives a call that she has been murdered.\n" }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who did the voice of ariel in the little mermaid?", "passages": [ [ "Ariel (The Little Mermaid)", "Ariel has received a mixed reception from critics; some publications such as \"Time\" criticize her for being too devoted to Eric whereas others, such as \"Empire\", praise the character for her rebellious personality, a departure from previous Disney Princesses.", "Ariel was based on the title character of Hans Christian Andersen's \"The Little Mermaid\", but co-director and writer Ron Clements felt that the mermaid in the original story was too tragic and rewrote the character, resulting in Ariel.", "Jodi Benson, who was predominantly a stage actress, was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\".", "Clements stated that Benson's voice had a unique \"sweetness\" and \"youthfulness\".", "When recording the vocals for \"Part of Your World\", Benson asked that the lights in the studio be dimmed, to create the feeling of being deep under the sea.", "\"Part of Your World\", which was referred to by songwriter Howard Ashman as the \"I Want\" song, was originally going to be cut from the final film, owing to Jeffrey Katzenberg's belief that it slowed the story down, but Ashman and Keane fought to keep it in.", "Ariel's original design was developed by animator Glen Keane." ], [ "The Little Mermaid II: Return to the Sea", "The Little Mermaid II: Return to the Sea\n\nThe Little Mermaid II: Return to the Sea is a 2000 American animated direct-to-video musical adventure film and a sequel to the 1989 animated film \"The Little Mermaid\".", "Directed by Jim Kammerud and Brian Smith, the story of the film takes place 12 years after the original, and focuses on Ariel and Eric's daughter Melody, a human princess who longs to swim in the ocean despite her parents' law that the sea is forbidden to her.", "The film features the voices of Jodi Benson as Ariel, Tara Charendoff as Melody, and Pat Carroll as Morgana, the film's new villain.", "In 2008, Disney released a third film in the \"Little Mermaid\" series, \"\", which is a prequel to the original film.", "Ariel and Eric celebrate the birth of their newborn daughter Melody on a ship at sea.", "Ariel's father King Triton presents Melody with a magic locket.", "The party is interrupted by Ursula's sister Morgana, who threatens to have Melody fed to her pet tiger shark, Undertow, unless Triton surrenders his trident to her.", "Morgana then announces her plan to use the trident to avenge Ursula and take over the ocean." ], [ "Ariel (The Little Mermaid)", "She also is incredibly curious, and her curiosity often leads her into dangerous situations.", "Ariel is kind and caring to others no matter what their circumstances, as depicted in the television series.", "In an early episode, Ariel helps an orphaned merboy who had fallen in with a bad crowd.", "In another episode, Ariel befriends a supposed bad luck creature and protects it from Ursula and other merfolk who wish it harm.", "Ariel appears as an adult in \"Return to the Sea\" and gives birth to a daughter named Melody, becoming the first, and currently, only, Disney princess to become a mother.", "Ariel is protective of her daughter, as Triton was of Ariel in the first film.", "After Morgana threatens Ariel and King Triton, Prince Eric and Ariel build a wall around the palace to protect Melody from Morgana and other terrors of the ocean.", "Although it protected her, it could not protect her curiosity.", "\"Ariel's Beginning\" depicts her personality as it was in the original film after Jodi Benson had advocated returning the character to her roots.", "Ariel is once again rebellious, and after her father decrees music to be banned in Atlantica she runs away with Sebastian and his band." ] ], "gold": "Ariel is a fictional character in Walt Disney Pictures' 28th animated film The Little Mermaid (1989). Jodi Benson, who was predominantly a stage actress, was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\". The Little Mermaid II: Return to the Sea is the sequel to the 1989 Disney animated film \"The Little Mermaid\" and final installment in The Little Mermaid series, and features the voice of Jodi Benson as Ariel. In \"The Little Mermaid: Ariel's Beginning\" Jodi Benson again was the voice of Ariel. There was also an American animated television series \"The Little Mermaid\" produced by Walt Disney Television Animation and Jodi Benson was the voice of Ariel. Then in 2019, \"The Little Mermaid Live!\", created for ABC, based on the 1989 film The Little Mermaid, featured Auli\u02bbi Cravalho as Princess Ariel.", "prediction 1": "Ariel was based on the title character of Hans Christian Andersen's \"The Little Mermaid\", but co-director and writer Ron Clements felt that the mermaid in the original story was too tragic and rewrote the character, resulting in Ariel. Jodi Benson was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\". In the 2000 American animated direct-to-video musical adventure film, Ariel has been voice of Ariel since the 1989 animated film \"The Little Mermaid\".", "prediction 2": "The Little Mermaid was originally designed by animator Glen Keane as a fairy tale character. In the 1989 animated film, Ariel has been voiced by Jodi Benson. In the 2000 animated film, The Little Mermaid II: Return to the Sea, Ariel has been voiced by Tara Charendoff.", "prediction 3": "There are several films in the Little Mermaid series. The 1989 film based on the Disney Princess character Ariel was based on the character of Hans Christian Andersen's \"The Little Mermaid\" but co-director and writer Ron Clements felt that the mermaid in the original story was too tragic and rewrote the character, resulting in Ariel. Jodi Benson, predominantly a stage actress, was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\".", "prediction 4": "The Little Mermaid was originally based on the title character of Hans Christian Andersen's The Little Mermaid, but co-director and writer Ron Clements felt that the mermaid in the original story was too tragic and rewrote the character, resulting in Ariel. Jodi Benson, a predominantly stage actress, was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 235 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 459, "end": 488 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Jodi Benson was chosen to voice Ariel because the directors felt \"it was really important to have the same person doing the singing and speaking voice\". In the 2000 American animated direct-to-video musical adventure film Ariel is voiced by Jodi Benson. The Little Mermaid II: Return to the Sea is the sequel to the 1989 Disney animated film \"The Little Mermaid\"." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who wrote the french version of o canada?", "passages": [ [ "O Canada", "O Canada\n\n\"O Canada\" () is the national anthem of Canada.", "The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint-Jean-Baptiste Day ceremony; Calixa Lavall\u00e9e composed the music, after which, words were written by the poet and judge Sir Adolphe-Basile Routhier.", "The original lyrics were in French; an English translation was published in 1906.", "Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament.", "Weir's lyrics have been revised three times, most recently when \"An Act to amend the National Anthem Act (gender)\" was enacted in 2018.", "The French lyrics remain unaltered.", "\"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's National Anthem Act received royal assent and became effective on July 1 as part of that year's Dominion Day (now known as Canada Day) celebrations." ], [ "O Canada", "In the context of Tennyson's poem \"To the Queen\", the word \"true\" means \"loyal\" or \"faithful\".", "The lyrics and melody of \"O Canada\" are both in the public domain, a status unaffected by the trademarking of the phrases \"with glowing hearts\" and \"\" for the 2010 Winter Olympics in Vancouver.", "Two provinces have adopted Latin translations of phrases from the English lyrics as their mottos: Manitoba\u2014 (Glorious and Free)\u2014and Alberta\u2014 (Strong and Free).", "Similarly, the Canadian Army's motto is (we stand on guard for thee).", "The original French lyrics of \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City.", "At that time, the \"Chant National\", also by Routhier, was popular amongst Francophones as an anthem, while \"God Save the Queen\" and \"The Maple Leaf Forever\" had, since 1867, been competing as unofficial national anthems in English Canada." ], [ "Calixa Lavall\u00e9e", "Calixa Lavall\u00e9e\n\nCalixa Lavall\u00e9e (December 28, 1842 \u2013 January 21, 1891) was a French-Canadian-American musician and Union Army band musician during the American Civil War.", "He is best known for composing the music for \"O Canada,\" which officially became the national anthem of Canada in 1980, after a vote in the Senate and the House of Commons.", "The same 1980 Act of Parliament also changed some of the English lyrics.", "A slight alteration to the English lyrics was made again in 2018.", "The original French lyrics and the music, however, have remained unchanged since 1880.", "Lavall\u00e9e was born Calixte Paquet dit Lavall\u00e9e near Verch\u00e8res, a village near present-day Montreal in the Province of Canada (now the Canadian province of Quebec).", "He was a descendant of Isaac Pasquier, from Poitou, France, who arrived in Nouvelle-France in 1665 as a soldier in the Carignan-Sali\u00e8res regiment.", "Lavall\u00e9e's father Augustin Lavall\u00e9e, worked as a blacksmith, logger, bandmaster, self-taught luthier and bandleader, and also worked for the pipe organ builder Joseph Casavant.", "Calixa Lavall\u00e9e's mother was Charlotte-Caroline Valentine.", "Lavall\u00e9e began his musical education with his father, who taught him organ by age 11." ] ], "gold": "The French lyrics of O Canada were written by Sir Adolphe-Basile Routhier to music composed by Calixa Lavallee. This song was first performed on June 24, 1880 at a Saint-Jean-Baptiste Day banquet in Quebec City. O Canada's original French lyrics and music have remained unchanged since 1880.", "prediction 1": "The original French lyrics of \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. The words were written by the poet and judge Sir Adolphe-Basile Routhier. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament.", "prediction 2": "The original French lyrics of the patriotic song \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. The poetry and judge Sir Adolphe-Basile Routhier wrote the words. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. The original French lyrics remain unaltered. The original French lyrics and the music both have remained unchanged since 1880, the original French lyrics and the music, however, have remained unchanged since 1880.", "prediction 3": "The original French lyrics of \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. The words were written by the poet and judge Sir Adolphe-Basile Routhier. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. The original French lyrics remain unaltered.", "prediction 4": "The original French lyrics of O Canada were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. In 1906 an English translation was published, with words being written by the poet and judge Sir Adolphe-Basile Routhier. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. The French lyrics remain unchanged. The words and melody of \"O Canada\" are in the public domain.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The original French lyrics of \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. ", "start": 287, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 394 }, { "error type": "Irrelevant", "explanation": "", "start": 395, "end": 545 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The original French lyrics of \"O Canada\" were written by Sir Adolphe-Basile Routhier, to music composed by Calixa Lavall\u00e9e, as a French Canadian patriotic song for the Saint-Jean-Baptiste Society and first performed on June 24, 1880, at a Saint-Jean-Baptiste Day banquet in Quebec City. The original French lyrics and the music have remained unchanged since 1880." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where is the oldest living tree in the united states?", "passages": [ [ "Bristlecone pine", "A specimen of \"Pinus longaeva\" located in the White Mountains of California is years old\u2014the oldest known individual tree in the world\u2014according to measurements by Tom Harlan.", "The identity of the specimen is being kept secret by Harlan.", "Another well-known bristlecone pine in the White Mountains is Methuselah which is years old.", "The specific location of Methuselah is also a secret.", "The other two species, \"Pinus balfouriana\" and \"Pinus aristata\", are also long-lived, though not to the extreme extent of \"P. longaeva\"; specimens of both have been measured or estimated to be up to 3,000 years old.", "The longevity of the trees is believed to be related to the proportion of dead wood to live wood.", "This high ratio reduces respiration and water loss, thereby extending the life of the tree.", "Trees that reproduce by cloning can be considered to be much older than bristlecone pines.", "A colony of 47,000 quaking aspen trees (nicknamed \"Pando\"), covering in the Fishlake National Forest of the United States, has been estimated to be 80,000 years old, although tree ring samples date individual, above-ground trees at an average of about 130 years." ] ], "gold": "The oldest individual living tree in the United States is in Wheeler Peak, Nevada. A clonal colony can survive for much longer than an individual tree. A colony of 47,000 quaking aspen trees, nicknamed Pando, covering in the Fishlake National Forest of Utah, is considered one of the oldest and largest organisms in the world.", "prediction 1": "The oldest living tree in the United States is a bristlecone pine, Pinus longaeva, located in the White Mountains of California. It is the oldest known individual tree in the world, according to measurements by Tom Harlan.", "prediction 2": "The oldest living tree on Earth is the Bryce Cone Pine located in the White Mountains of California. The oldest tree that has been measured in the United States is in the Fishlake National Forest of the United States.", "prediction 3": "The oldest living tree in the United States is a bristlecone pine, Pinus longaeva, located in the White Mountains of California. The age of this tree is years, according to measurements by Tom Harlan.", "prediction 4": "The oldest living tree in the United States is a Bristlecone pine, Pinus longaeva, found in the White Mountains of California. The species with the longest living life is also the oldest living tree in the United States, located in Fishlake National Forest.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The oldest living tree in the United States ", "start": 129, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 222 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The oldest living tree in the United States is a bristlecone pine, Pinus longaeva, located in the White Mountains of California. A colony of 47,000 quaking aspen trees (nicknamed \"Pando\"), covering in the Fishlake National Forest of the United States, has been estimated to be 80,000 years old." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has won more trophies chelsea or manchester united?", "passages": [ [ "Manchester United F.C.", "Manchester United F.C. Manchester United Football Club, commonly known as Man United, or simply United, is a professional football club based in Old Trafford, Greater Manchester, England, that competes in the Premier League, the top flight of English football.", "Nicknamed \"the Red Devils\", the club was founded as Newton Heath LYR Football Club in 1878, changed its name to Manchester United in 1902 and moved to its current stadium, Old Trafford, in 1910.", "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields.", "United have also won three UEFA Champions Leagues, one UEFA Europa League, one UEFA Cup Winners' Cup, one UEFA Super Cup, one Intercontinental Cup and one FIFA Club World Cup.", "In 1998\u201399, the club became the first in the history of English football to achieve the continental European treble.", "By winning the UEFA Europa League in 2016\u201317, they became one of five clubs to have won all three main UEFA club competitions, and the only English club to have won every competition available to them.", "The 1958 Munich air disaster claimed the lives of eight players.", "In 1968, under the management of Matt Busby, Manchester United became the first English football club to win the European Cup." ], [ "Manchester United F.C.", "However, in July 2012, the club announced plans to list its IPO on the New York Stock Exchange instead.", "Shares were originally set to go on sale for between $16 and $20 each, but the price was cut to $14 by the launch of the IPO on 10 August, following negative comments from Wall Street analysts and Facebook's disappointing stock market debut in May.", "Even after the cut, Manchester United was valued at $2.3\u00a0billion, making it the most valuable football club in the world.", "Manchester United are one of the most successful clubs in Europe in terms of trophies won.", "The club's first trophy was the Manchester Cup, which it won as Newton Heath LYR in 1886.", "In 1908, the club won its first league title, and won the FA Cup for the first time the following year.", "Manchester United won the most trophies in the 1990s; five league titles, four FA Cups, one League Cup, five Charity Shields (one shared), one UEFA Champions League, one UEFA Cup Winners' Cup, one UEFA Super Cup and one Intercontinental Cup.", "The club holds the record for most top-division titles (20) \u2013 including a record 13 Premier League titles \u2013 and FA Community Shields (21)." ], [ "Steep Theatre Company", "Premiere production\n\nSeason 1 (2001\u201302)\nSeason 2 (2002\u201303)\nSeason 3 (2004)\n", "Season 4 (2004\u201305)\nSeason 5 (2005\u201306)\n", "Season 6 (2006\u201307)\nSeason 7 (2007\u201308)\n", "Season 8 (2008 \u2013 09)\nSeason 9 (2009\u201310)\n", "Season 10 (2010\u201311)\nSeason 11 (2011\u201312)\n", "Season 12 (2012\u201313)\nSeason 13 (2013\u201314)\n", "Season 14 (2014\u201315)\n\nSeason 15 (2015\u201316)\n\nSeason 16 (2016\u201317)\n\n", "Season 17 (2017\u201318)\n\n\nSteep was named 2010 Broadway in Chicago Emerging Theatre Award winner." ] ], "gold": "Manchester United has won more trophies than any other club in English football. Manchester United has won a record 20 League titles, while Chelsea has won 6 League titles. Manchester United has won 12 FA Cups, while Chelsea has won 8 FA Cups. Additionally, Manchester United has won a record 21 FA Community Shields, while Chelsea has won 4 FA Community Shields. ", "prediction 1": "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields. Chelsea have won more trophies than any other club in English football, with a record 12 FA Cups, 5 League Cups and a record 13 FA Cups. In addition, Liverpool have won more trophies than any other team, with a record 12 FA Cups and a record 21 FA Community Shields.", "prediction 2": "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields. Chelsea have won the most trophies in the Premier League in the past, with 13 in total. However, Manchester United have won the most trophies in the past, with 13 in total.", "prediction 3": "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields. Chelsea are the team with the most trophies, with 13 wins, including the UEFA Cup in 1995. Manchester United are also the club with the most goals scored, winning a record 78.2% of the games played.", "prediction 4": "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields. Chelsea have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields. Chelsea have won the most trophies in the Premier League. Chelsea have won the most trophies in the Champions League.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 178, "end": 314 }, { "error type": "Unverifiable", "explanation": "", "start": 315, "end": 444 } ], "missing-info": [], "corrected-prediction": "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who wrote the songs in the greatest showman?", "passages": [ [ "The Greatest Showman", "On June 15, 2016, Zac Efron began negotiations to star in the film, and in July 2016, Michelle Williams was cast.", "The film was choreographed by Ashley Wallen.", "Rehearsals on the film began in October 2016 in New York City, and principal photography began on November 22, 2016.", "In December 2017, it was reported that James Mangold, who had worked with Jackman on several projects (including 2017's \"Logan\"), had been brought in to serve as an executive producer during the film's post-production.", "In an interview, director Michael Gracey noted, \"There were eight producers on this film, and it was amazing having one of them be a filmmaker.\"", "Benj Pasek and Justin Paul wrote all the songs appearing in the film.", "The soundtrack album is produced by Justin Paul, Benj Pasek, Greg Wells, Kevin Weaver and Pete Ganbarg, featuring the eleven tracks performed by the cast.", "In the United Kingdom it became only the second album in 30 years to achieve 11 consecutive weeks at number 1.", "\"The Greatest Showman\" now draws level with Adele's \"21\" for the longest unbroken run at the UK summit in the last 30 years." ], [ "The Greatest Showman", "The Greatest Showman\n\nThe Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya.", "The film is inspired by the story of P. T. Barnum's creation of the Barnum & Bailey Circus and the lives of its star attractions.", "Principal photography began in New York City in November 2016.", "The film premiered on December 8, 2017, aboard the RMS \"Queen Mary 2\".", "It was released in the United States on December 20, 2017, by 20th Century Fox and grossed over $434million worldwide, making it the fifth-highest grossing live-action musical of all time.", "The film was released seven months after Ringling Bros. and Barnum & Bailey Circus's dissolution.", "\"The Greatest Showman\" received mixed reviews, with praise for the performances, music, and production values, but criticism for its artistic license, with some reviewers calling it \"faux-inspiring and shallow\".", "At the 75th Golden Globe Awards, the film received nominations for Best Motion Picture \u2013 Musical or Comedy and Best Actor \u2013 Musical or Comedy for Jackman." ], [ "Pasek and Paul", "Pasek and Paul\n\nBenj Pasek and Justin Paul, known together as Pasek and Paul, are an American songwriting duo and composing team for musical theater, films, and television.", "Their works include \"\", \"Dogfight\", \"Edges\", \"Dear Evan Hansen\", and \"James and the Giant Peach\".", "Their original songs have been featured on NBC's \"Smash\" and in the films \"La La Land\", for which they won both the Golden Globe and Academy Award for Best Original Song for the song \"City of Stars,\" and The Greatest Showman.", "Their work on original musical \"Dear Evan Hansen\" has received widespread critical acclaim and earned them the Tony Award for Best Original Score.", "Both artists are graduates of the University of Michigan and winners of the American Theatre Wing's 2007 Jonathan Larson Award, which honors achievement by composers, lyricists and librettists.", "Pasek and Paul started working together as freshmen at the University of Michigan where they completed their BFA degrees in musical theatre in December 2006.", "Both got \"background\" roles in the school's musical theater production, which inspired them to write the series of songs turned into a show, \"Edges\".", "While Pasek usually writes lyrics and Paul usually writes music, they opted to share credit for both elements of the songwriting." ] ], "gold": "The nine original songs featured in the 2017 musical drama film The Greatest Showman were written by award-winning songwriting duo Benj Pasek and Justin Paul. The score for the film was written by Joseph Trapanese and John Debney.", "prediction 1": "Benj Pasek and Justin Paul wrote all the songs appearing in The Greatest Showman. Pasek and Paul are an American songwriting duo and composing team for musical theater, films, and television. They are best known for their work on the musical The Greatest Showman: In the Beginning and Ending.", "prediction 2": "Benj Pasek and Justin Paul, known together as Pasek and Paul, are an American songwriting duo and composing team for musical theater, films, and television. They wrote all the songs appearing in The Greatest Showman. They are renowned for their original songs, \"Dogfight\", \"Edges\", and \"Dear Evan Hansen.\"", "prediction 3": "Benj Pasek and Justin Paul, known together as Pasek and Paul, are an American songwriting duo and composing team for musical theater, films, and television. The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya. Pasek usually writes lyrics and Paul usually writes music, but they opted to share credit for both elements of the songwriting.", "prediction 4": "The songs in The Greatest Showman were written by two songwriting duos, Benj Pasek and Justin Paul. Pasek and Paul are known together as Pasek and Paul, an American songwriting duo and composing team for musical theater, films, and television.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 292 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Benj Pasek and Justin Paul wrote all the songs appearing in The Greatest Showman, a 2017 American musical film. It was written by Jenny Bicks and Bill Condon." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "The second person of the trinity who became man?", "passages": [ [ "Jesus", "Christians view Jesus as a role model, whose God-focused life believers are encouraged to imitate.", "Most Christians believe that Jesus was both human and the Son of God.", "While there has been theological debate over his nature, Trinitarian Christians generally believe that Jesus is the Logos, God's incarnation and God the Son, both fully divine and fully human.", "However, the doctrine of the Trinity is not universally accepted among Christians.", "With the Protestant Reformation, Christians such as Michael Servetus and the Socinians started questioning the ancient creeds that had established Jesus' two natures.", "Nontrinitarian Christian groups include The Church of Jesus Christ of Latter-day Saints, Unitarians and Jehovah's Witnesses.", "Christians revere not only Jesus himself, but also his name.", "Devotions to the Holy Name of Jesus go back to the earliest days of Christianity.", "These devotions and feasts exist in both Eastern and Western Christianity.", "Judaism rejects the idea of Jesus being God, or a mediator to God, or part of a Trinity.", "It holds that Jesus is not the Messiah, arguing that he neither fulfilled the Messianic prophecies in the Tanakh nor embodied the personal qualifications of the Messiah." ], [ "God the Son", "God the Son\n\nGod the Son () is the second person of the Trinity in Christian theology.", "The doctrine of the Trinity identifies Jesus as the incarnation of God, united in essence (consubstantial) but distinct in person with regard to God the Father and God the Holy Spirit (the first and third persons of the Trinity).", "The phrase \"God the Son\" is not found in the Bible, but is found in later Christian sources.", "By scribal error the term is in one medieval manuscript, MS No.1985, where Galatians 2:20 has \"Son of God\" changed to \"God the Son\".", "The term in English follows Latin usage as found in the Athanasian Creed and other texts of the early church:\nIn Greek \"God the Son\" is \"Theos o Iios\" (\u0398\u03b5\u03cc\u03c2 \u1f41 \u03c5\u1f31\u03cc\u03c2) as distinct from \"o Iios\" nominative \"tu Theu\" genitive, \u1f41 \u03c5\u1f31\u03cc\u03c2 \u03c4\u03bf\u03c5 \u0398\u03b5\u03bf\u03cd, \"Son of God\".", "In Latin \"God the Son\" is Deus (nominative) Filius (nominative).", "The term \"deus filius\" is found in the Athanasian Creed: \"\"Et tamen non tres omnipotentes, sed unus omnipotens." ] ], "gold": "According to the doctrine of the Trinity, the second person of the Trinity who became man was God the Son, and some who believe in full divinity accept Jesus Christ to be the name of the second person of the Trinity.", "prediction 1": "The second person of the trinity, God the Son, is the one who became human. The doctrine of the Trinity identifies Jesus as the incarnation of God, united in essence (consubstantial) but distinct in person with regard to God the Father and God the Holy Spirit, the first and third persons of the Trinity. The term \"God the Son\" is not found in the Bible, but is found in later Christian sources.\n", "prediction 2": "God the Son is the second person of the Trinity in Christian theology and the incarnation of God. In the Christian theology, Jesus is both a divinity and a man. Jesus is the Logos, God's Son.", "prediction 3": "Several biblical passages referred to Jesus as the Son, and John the Baptist described the Son as the incarnation of God. In fact, the Bible does not mention the Son. The language that is used to describe Jesus as God the Son is Galatians 2:20-25.", "prediction 4": "God the Son is the second person of the trinity in Christian theology. The doctrine of the Trinity identifies Jesus as the incarnation of God, united in essence (consubstantial) but distinct in person with regard to God the Father and God the Holy Spirit (the first and third persons of the Trinity). The term \"Son of God\" is not found in the Bible, but is found in later Christian sources. These term in English follows Latin usage as found in the Athanasian Creed and other texts of the early church.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 47, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 396 } ], "missing-info": [], "corrected-prediction": "The second person of the trinity, God the Son, in the doctrine of the Trinity is identified as Jesus, who some christians believe is both fully divine and fully human." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Real name of naira from yeh rishta kya kehlata hai?", "passages": [ [ "Yeh Rishta Kya Kehlata Hai", "Yeh Rishta Kya Kehlata Hai\n\nYeh Rishta Kya Kehlata Hai ( \"What Is This Relationship Called?\") (International Title:Not Without My Family) is a Hindi-Language television drama airing on weekdays on Star Plus.", "It premiered on January 12, 2009 and is the longest running Hindi Indian series.", "The show is produced by Rajan Shahi under the banner Director's Kut Productions.", "The series airs on Star Life as Not Without My Family.", "The show focuses on the daily life of an Udaipur-based Rajasthani family.", "The story of a young married couple, Kartik and Naira trying to strike a perfect balance between their family values, personal beliefs and circumstances.", "The series initially focused on Naira's parents, Akshara and Naitik.", "A young couple, Akshara and Naitik Singhania, live in a Marwari joint family in Udaipur.", "They adjust as a married couple, as parents of young children, and as their extended families mature.", "Naitik falls into a coma in an accident; four years later he returns to the family and struggles to gain acceptance from his five-year-old son, Naksh.", "Naitik's mother dies and his father marries a divorcee with two children." ], [ "Ashnoor Kaur", "Ashnoor Kaur\n\nAshnoor Kaur is an Indian teenage actress in film and television.", "Kaur started her career by playing the character of Prachi in \"Jhansi Ki Rani\".", "She later played Navika Vyas Bhatnagar in the television series \"Na Bole Tum Na Maine Kuch Kaha\" and \"Na Bole Tum Na Maine Kuch Kaha 2\" and made a cameo appearance as Mayra Kapoor in the show \"Bade Achhe Lagte Hain\".", "She appeared in \"CID\", and as Ashok Sundari in the mythological series, \"Devon Ke Dev...Mahadev\".", "She had the role of young Naira in Yeh Rishta Kya Kehlata Hai.", "She played Dushala in the 2013 television series \"Mahabharat.\"", "She was recently seen in Prithvi Vallabh as Princess Vilas.", "Kaur was also part of Anurag Kashyap 's film Manmarziyaan in the role of Taapsee Pannu 's sister." ] ], "gold": "Shivangi Joshi currently stars as adult Naira in the 2009 Indian soap opera Yeh Rishta Kya Kehlata Hai. Ashnoor Kaur played the role of teenage Naira, while Mishka Jain played the character as a young child.", "prediction 1": "Yeh Rishta Kya Kehlata Hai is a Hindi-Language television drama airing on weekdays on Star Plus. The show focuses on the daily life of an Udaipur-based Rajasthani family. Naira's mother Akshara is played by Mayra Kapoor.", "prediction 2": "Yeh Rishta Kya Kehlata Hai is a Hindi-Language television series that focuses on the daily life of an Udaipur-based Rajasthani family, Naira's parents being Akshara and Naitik Singhania. The show focuses on the daily life of an Udaipur-based Rajasthani family. Ashnoor Kaur played the role of young Naira. Kaur was also part of Anurag Kashyap's film Manmarziyaan in Manmarziyaan.", "prediction 3": "Yeh Rishta Kya Kehlata Hai is a Hindi-Language television drama airing on weekdays on Star Plus. It premiered on January 12, 2009 and is the longest running Hindi Indian series. Ashnoor Kaur played the role of young Naira in the show.", "prediction 4": "Yeh Rishta Kya Kehlata Hai is a Hindi-Language television drama airing on weekdays on Star Plus. It premiered on January 12, 2009 and is the longest running Hindi Indian series. It focuses on the daily life of an Udaipur-based Rajasthani family. The story of a young married couple, Kartik and Naira trying to strike a perfect balance between their family values, personal beliefs and circumstances. Ashnoor Kaur played the role of Naira.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 171, "end": 220 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 170 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Ashnoor Kaur had the role of young Naira in Yeh Rishta Kya Kehlata Hai." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many levels of cache memory in the intel i7 processor?", "passages": [ [ "CPU cache", "K6-III included 256\u00a0KB on-die L2 cache and took advantage of the on-board cache as a third level cache, named L3 (motherboards with up to 2\u00a0MB of on-board cache were produced).", "After the Socket\u00a07 became obsolete, on-motherboard cache disappeared from the x86 systems.", "The three-level caches were used again first with the introduction of multiple processor cores, where the L3 cache was added to the CPU die.", "It became common for the total cache sizes to be increasingly larger in newer processor generations, and recently (as of 2011)", "it is not uncommon to find Level 3 cache sizes of tens of megabytes.", "Intel introduced a Level 4 on-package cache with the Haswell microarchitecture.", "\"Crystalwell\" Haswell CPUs, equipped with the GT3e variant of Intel's integrated Iris Pro graphics, effectively feature 128\u00a0MB of embedded DRAM (eDRAM) on the same package.", "This L4 cache is shared dynamically between the on-die GPU and CPU, and serves as a victim cache to the CPU's L3 cache.", "Early cache designs focused entirely on the direct cost of cache and RAM and average execution speed.", "More recent cache designs also consider energy efficiency, fault tolerance, and other goals." ] ], "gold": "In the intel i7 processor, there are 4 levels of cache memory in the versions that contain Crytstalwell and 3 levels of cache memory in the versions that do not contain Crystalwell. Models with Iris Pro Graphics 5200, models with Iris Pro Graphics 6200 and Core i7-4770R contain Crystalwell, 128 MB eDRAM built at (22 nm) acting as L4 cache. ", "prediction 1": "Intel introduced a Level 4 on-package cache with the Haswell microarchitecture. This L4 cache is shared dynamically between the on-die GPU and CPU, and serves as a victim cache to the CPU's L3 cache. The Intel i7 processor has 3 levels of cache memory.", "prediction 2": "Intel introduced a Level 4 on-package cache with the Haswell microarchitecture. The i7 processor features two levels of cache memory, one on the die and one on the CPU die. The i7 i7 processor also features three levels of cache memory in the processor.", "prediction 3": "Intel i7 processors include three levels of cache memory, including an L2 level on the die and an L3 level on the motherboard. In the Intel i7 processor, there are four levels of cache memory, including a Level 4 on-package cache.", "prediction 4": "Intel introduced a Level 4 on-package cache with the Haswell microarchitecture. This L4 cache is shared dynamically between the on-die GPU and CPU, and serves as a victim cache to the CPU's L3 cache. The i7 processor's on-die L2 cache included 256 KB and took advantage of the on-board cache as a third level cache, named L3.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 199 }, { "error type": "Unverifiable", "explanation": "", "start": 204, "end": 252 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 0, 2, 0, 2, 2 ] }, { "question": "On which status quo album did the song 'marguerita time' appear in?", "passages": [ [ "Marguerita Time", "Marguerita Time\n\n\"Marguerita Time\" is a single by the British rock band Status Quo, from their 1983 album \"Back to Back\".", "The single was also issued in a Christmas double pack that included \"Caroline\"/\"Joanne\".", "\"Nobody but Francis \"[Rossi]\" wanted to record it,\" recalled bassist Alan Lancaster.", "\"All it did was advertise that we were a bunch of nerds.\"", "The song was reprised, in 2014, for the band's thirty-first studio album \"Aquostic (Stripped Bare)\".", "It was featured in the ninety-minute launch performance for the album at London's Roundhouse on 22 October, broadcast live by BBC Radio 2 as part of their \"In Concert\" series.", "Dexys Midnight Runners covered the song on the B-side of their single \"This is What She's Like\".", "This recording was included on some reissues of the band's \"Too-Rye-Ay\" album." ] ], "gold": "\"Marguerita Time\" is a song by the British rock band Status Quo, from their 1983 album Back to Back. The single was also released in a Christmas double pack that included \"Caroline\"/\"Joanne\". The song was reprised in 2014 for the band's thirty-first studio album Aquostic (Stripped Bare).", "prediction 1": "The song \"Marguerita Time\" is a single by the British rock band Status Quo, from their 1983 album \"Back to Back\". The single was also issued in a Christmas double pack that included \"Caroline\"/\"Joanne\". The song was reprised, in 2014, for the band's thirty-first studio album \"Aquostic (Stripped Bare)\". It was featured in the ninety-minute launch performance for the album at London's Roundhouse on 22 October, broadcast live by BBC Radio 2 as part of their \"In Concert\" series.", "prediction 2": "\"Marguerita Time\" is a single by the British rock band Status Quo, from their 1983 album Back to Back. The song was also issued in a Christmas double pack that included \"Caroline\"/\"Joanne\". The song was reprised, in 2014, for the band's thirty-first studio album Aquostic (Stripped Bare).", "prediction 3": "The song \"Marguerita Time\" by Status Quo first appeared in 1983 on the album \"Back to Back\". It was also released as a Christmas single in the same year in a double pack that included \"Caroline\"/\"Joanne\". The song was reprised in 2014, for the band's thirty-first studio album \"Aquostic (Stripped Bare), which was released on 24 October 2014.", "prediction 4": "The song \"Marguerita Time\" is a single by the British rock band Status Quo, from their 1983 album Back to Back. The single was also issued in a Christmas double pack that included \"Caroline\"/\"Joanne\". The song was reprised, in 2014, for the band's thirty-first studio album Aquostic (Stripped Bare). It was featured in the ninety-minute launch performance for the album at London's Roundhouse on 22 October, broadcast live by BBC Radio 2 as part of their \"In Concert\" series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 304, "end": 479 }, { "error type": "Redundant", "explanation": "The song \"Marguerita Time\" is ", "start": 30, "end": 38 } ], "missing-info": [], "corrected-prediction": "\"Marguerita Time\" is a song by the British rock band Status Quo, from their 1983 album \"Back to Back\". The single was also issued in a Christmas double pack that included \"Caroline\"/\"Joanne\". The song was reprised in 2014 for the band's thirty-first studio album \"Aquostic (Stripped Bare)\". " }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Who played pumbaa in the lion king movie?", "passages": [ [ "Timon and Pumbaa", "\"\u2014a reference to Sidney Poitier's line \"They call me Mister Tibbs!\"", "from the 1967 film \"In the Heat of the Night\".", "Unlike real meerkats, Timon can walk on his hind legs, while in real life, meerkats walk on all four legs and can only \"stand\" on their hind ones.", "Based on the characters Rosencrantz and Guildenstern from \"Hamlet\", Timon and Pumbaa are played by Nathan Lane and Ernie Sabella.", "Timon was animated and created by Michael Surrey.", "They made their first appearances in the 1994 film when they shooed away the vultures that swarmed around young Simba, who had collapsed from heat exhaustion.", "Timon and Pumbaa then took the collapsed lion cub back to a small pool, where they splashed water on him to wake him up.", "After Simba is awakened by the two, they introduce themselves and welcome Simba to stay with them and follow their \"hakuna matata\" philosophy.", "At first, Simba is confused about Timon and Pumbaa's lifestyle, but it is explained to him in the song \"Hakuna Matata\".", "Many years later, while out on a musical walk with Timon, Pumbaa is distracted by a bug, which he follows into the jungle." ], [ "The Lion King (franchise)", "Meanwhile, Janja the hyena and his clan, along with their new ally Ushari the cobra, orchestrate events that allow them to summon the spirit of Scar in order to defeat the Lion Guard and take over the Pride Lands.", "In 2016, it was announced that Disney is developing a \"Lion King\" remake with Jon Favreau directing.", "Reports stated that animation styles will be similar to Favreau's 2016 film \"The Jungle Book\" and will shoot it back to back with \"The Jungle Book\" sequel.", "The film's voice cast will feature Donald Glover as Simba, James Earl Jones reprising his role as Mufasa, and Billy Eichner and Seth Rogen as Timon and Pumbaa respectively.", "The movie will be produced by Fairview Entertainment.", "In April 2017, Disney announced that the remake will be released on July 19, 2019.", "John Oliver will be playing Zazu.", "\"The Lion King's Timon & Pumbaa\" is a spin-off cartoon series that centers on Timon and Pumbaa.", "The show ran for three seasons, airing on the syndicated block \"The Disney Afternoon\" and CBS in the United States, and BBS in Canada from September 8, 1995 to November 1, 1998." ], [ "Timon & Pumbaa (TV series)", "Timon & Pumbaa (TV series)\n\n", "The Lion King's Timon & Pumbaa, often simply referred to as Timon & Pumbaa, is an American animated television series created by Walt Disney Television Animation.", "Based on the 1994 Disney animated film \"The Lion King\", it centers on Timon the meerkat and Pumbaa the warthog, as they live their problem-free philosophy Hakuna Matata.", "The show ran for three seasons on CBS, Disney Channel, Toon Disney, and in syndication as a part of \"The Disney Afternoon\".", "It aired from September 8, 1995 to September 24, 1999.", "It is also the first \"Lion King\" related media to show humans, as humans were not present in the movie.", "It is the first of two television series to be based on the film, the second being \"The Lion Guard\".", "In 2004, Timon and Pumbaa starred in their own feature film \"The Lion King 1\u00bd\", a direct-to-video adaptation of the television series to the first of two films.", "Nathan Lane, Ernie Sabella, Matthew Broderick, Robert Guillaume, Julie Kavner and Jerry Stiller provided the voices of Timon, Pumbaa, Simba, Rafiki, Timon's Mother and Uncle Max respectively." ] ], "gold": "In \"The Lion King\" movies, the character of Pumbaa was voiced by Ernie Sabella in all the traditionally animated movies (The Lion King, The Lion King 2: Simba's Pride, and The Lion King 1\u00bd), and Seth Rogen voiced the character in the 2019 CGI remake of the movie.", "prediction 1": "In the 1994 Lion King movie, Pumbaa is played by Nathan Lane and Ernie Sabella, respectively. In the American animated television series The Lion King's Timon & Pumbaa, also referred to as Timon & Pumbaa, Pumbaa is played by Billy Eichner and Seth Rogen, respectively. In 2004, Timon and Pumbaa starred in their own feature film titled The Lion King 112. In the 2004 film, Pumbaa is voiced by Matthew Broderick.", "prediction 2": "The Lion King movie features both Pumbaa the warthog and Timon the meerkat, played by Nathan Lane and Ernie Sabella. In the 1994 film, both Timon and Pumbaa are played by Nathan Lane. In the 2015 film, Pumbaa is played by Seth Rogen. In the 2016 remake, Timon and Pumbaa are both voiced by Billy Eichner and Seth Rogen.", "prediction 3": "Pumbaa is a warthog who was first seen in the 1994 Lion King movie. Nathan Lane played Pumbaa in the 1994 movie, and Ernie Sabella played Pumbaa in the 2004 movie.", "prediction 4": "In the 1994 Disney animated film, The Lion King, Pumbaa the warthog is played by Ernie Sabella and Nathan Lane, respectively. In the American animated television series The Lion King's Timon & Pumbaa, also known as Timon & Pumbaa, played by Billy Eichner and Seth Rogen, Pumbaa is portrayed by Jerry Stiller. In 2004, Timon and Pumbaa starred in their own feature film, The Lion King 112, a direct-to-video adaptation of the television series.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 94, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 60 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 393, "end": 411 } ], "missing-info": [], "corrected-prediction": "In the 1994 Lion King movie, Pumbaa is played Ernie Sabella. In the 2019 remake Pumbaa is played by Seth Rogen. In 2004, Timon and Pumbaa starred in their own feature film titled The Lion King 112. In the 2004 film, Pumbaa is again voiced by Ernie Sabella." }, "preference": [ 0, 2, 0, 0, 0, 0 ] }, { "question": "What is the legal age of marriage in usa?", "passages": [ [ "Child marriage in the United States", "Unlike many other states, in Massachusetts a child's marriage does not automatically emancipate the minor, or increase his or her legal rights beyond allowing the minor to consent to certain medical treatments.", "Puerto Rico is a territory of the United States, and its people are American citizens.", "The general age of marriage in Puerto Rico is 21, however males aged 18 and females aged 16 can marry with exceptions.", "In Guam, the general age is 18, but 16-year-olds can get married with the consent of at least one parent or guardian.", "In American Samoa, since 2018, the marriage age is 18 for both sexes; in September 2018, governor Lolo Moliga signed into law a bill changing the marriage age for girls from 14 to 18.", "In the District of Columbia the general age is 18, but 16-year-olds may marry with exceptions.", "In the U.S. Virgin Islands the age of marriage is 14 for females and 16 for males.", "In the Northern Mariana Islands males must be 18 to marry, while females can marry at 16 with parental consent.", "Critics have pointed out that laws regarding child marriage in the United States compare unfavorably to laws regarding child marriage in other countries." ], [ "Marriage in the United States", "There are two methods of receiving state recognition of a marriage: common-law marriage and obtaining a marriage license.", "Common-law marriage is no longer permitted in most states.", "Though federal law does not regulate state marriage law, it does provide for rights and responsibilities of married couples that differ from those of unmarried couples.", "Reports published by the General Accounting Office in 1997 and 2004 identified over 1000 such laws.", "The United States Supreme Court has in at least 15 cases since 1888 ruled that marriage is a fundamental right.", "These cases are:\n\n\n", "The age at which a person can marry varies by state.", "The marriage age is generally 18 years, with the exception of Nebraska (19) and Mississippi (21).", "In addition, all states, except Delaware, allow minors to marry in certain circumstances, such as parental consent, judicial consent, pregnancy, or a combination of these situations.", "Most states allow minors aged 16 and 17 to marry with parental consent alone.", "30 states have set an absolute minimum age by statute, which varies between 13 and 18, while in 20 states there is no statutory minimum age if other legal conditions are met.", "In states with no set minimum age, the traditional common law minimum age is 14 for boys and 12 for girls - ages which have been confirmed by case law in some states." ] ], "gold": "The marriage age in the United States is set by each state and territory, either by statute or the common law applies. An individual can marry in the United States as of right, without parental consent or other authorization, on reaching 18 years of age in all states except in Nebraska, where the general marriage age is 19, and Mississippi where the general marriage age is 21. The youngest legal age of marriage possible in some US states when circumstances permit is 0.", "prediction 1": "The legal age at which a person can marry in the United States is generally 18 years, with the exception of Nebraska (19) and Mississippi (21). The age at which a person can marry in the United States is 14 for boys and 12 for girls, and the legal age of marriage in Puerto Rico is 21. In the District of Columbia, the general age of marriage is 18 for both sexes, and in the U.S. Virgin Islands, the age of marriage is 14 for females and 16 for males.", "prediction 2": "The legal age at which a person can marry in the United States is 18 years. The marriage age in most states is 18 years, with the exception of Nebraska (19) and Mississippi (21).", "prediction 3": "The marriage age in the United States is generally 18 years, except for Nebraska and Mississippi, where the legal minimum age for marriage is 18. In the District of Columbia, the general age is 18, but 16-year-olds may marry with exceptions. In the United States Virgin Islands the legal minimum age for marriage is 14 for females and 16 for males, and in the Northern Mariana Islands the legal minimum age for marriage is 16.", "prediction 4": "The legal age at which a person can marry varies by state. The marriage age is generally 18 years, with the exception of Nebraska (19) and Mississippi (21).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 285 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[11,8]}", "start": 204, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 364 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 452 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The legal age at which a person can marry in the United States is generally 18 years, with the exception of Nebraska (19) and Mississippi (21). Most states allow minors aged 16 and 17 to marry with parental consent alone. 30 states have set an absolute minimum age by statute, which varies between 13 and 18, while in 20 states there is no statutory minimum age if other legal conditions are met." }, "preference": [ 2, 0, 2, 1, 2, 2 ] }, { "question": "Where is the us fish and wildlife service located?", "passages": [ [ "United States Fish and Wildlife Service", "United States Fish and Wildlife Service\n\nThe United States Fish and Wildlife Service (USFWS or FWS) is an agency of the federal government within the U.S. Department of the Interior dedicated to the management of fish, wildlife, and natural habitats.", "The mission of the agency is \"working with others to conserve, protect, and enhance fish, wildlife, plants and their habitats for the continuing benefit of the American people.\"", "Among the responsibilities of the FWS are enforcing federal wildlife laws, protecting endangered species, managing migratory birds, restoring nationally significant fisheries, conserving and restoring wildlife habitat (such as wetlands), helping foreign governments with their international conservation efforts, and distributing money to states' fish and wildlife agencies through the Wildlife Sport Fish and Restoration program.", "Units within the FWS include:\n\nThe vast majority of fish and wildlife habitat is on non-federal land.", "Therefore, the FWS works closely with private groups (such as Partners in Flight, Sport Fishing and Boating Partnership Council) to promote voluntary habitat conservation and restoration.", "The FWS employs approximately 9,000 people and is organized into a central administrative office (in Falls Church, VA), the hallway where directorate members sit at the Department of the Interior (in Washington, DC), eight regional offices, and nearly 700 field offices distributed throughout the United States." ] ], "gold": "The United States Fish and Wildlife Service is an agency of the United States Government within the US Department of the Interior dedicated to the management of fish, wildlife, and natural habitats. It is headquartered in Bailey's Crossroads, Virginia, US. The USFWS employs approximately 8,000 people and is organized into a central administrative office in Falls Church, Virginia, eight regional offices, and nearly 700 field offices distributed throughout the US. The mission of the agency is \"working with others to conserve, protect, and enhance fish, wildlife, plants and their habitats for the continuing benefit of the American people.\"", "prediction 1": "The United States Fish and Wildlife Service (USFWS or FWS) is an agency of the federal government within the U.S. Department of the Interior dedicated to the management of fish, wildlife, and natural habitats. The FWS is organized into a central administrative office located in Falls Church, VA, the hallway where directorate members sit at the Department of the Interior (in Washington, DC), eight regional offices, and nearly 700 field offices distributed throughout the United States.", "prediction 2": "The United States Fish and Wildlife Service is located in the United States Department of the Interior and is an agency of the federal government dedicated to the management of fish, wildlife, and natural habitats. The FWS's central administrative office is located in Falls Church, Virginia, and its eight regional offices are located throughout the United States.", "prediction 3": "The United States Fish and Wildlife Service (USFWS or FWS) is an agency of the federal government within the U.S. Department of the Interior dedicated to the management of fish, wildlife, and natural habitats. The agency is organized into a central administrative office (in Falls Church, VA), the hallway where directorate members sit at the Department of the Interior (in Washington, DC), eight regional offices, and nearly 700 field offices distributed throughout the United States.", "prediction 4": "The United States Fish and Wildlife Service is an agency of the federal government within the U.S. Department of the Interior dedicated to the management of fish, wildlife, and natural habitats. The agency's central administrative office is located in Falls Church, VA. Eight regional offices and nearly 700 field offices are distributed throughout the United States.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The United States Fish and Wildlife Service (USFWS or FWS) is an agency of the federal government within the U.S. Department of the Interior dedicated to the management of fish, wildlife, and natural habitats. The FWS employs approximately 9,000 people and is organized into a central administrative office (in Falls Church, VA), the hallway where directorate members sit at the Department of the Interior (in Washington, DC), eight regional offices, and nearly 700 field offices distributed throughout the United States. The mission of the agency is \"working with others to conserve, protect, and enhance fish, wildlife, plants and their habitats for the continuing benefit of the American people.\"" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played han solo son in star wars?", "passages": [ [ "Kylo Ren", "Kylo Ren\n\nKylo Ren is a fictional character in the \"Star Wars\" franchise.", "Introduced in the 2015 film \"\", he is portrayed by Adam Driver.", "\"Kylo Ren\" is the chosen name of Ben Solo, the son of original \"Star Wars\" trilogy characters Han Solo and Leia Organa.", "Though trained by his uncle Luke Skywalker as a Jedi, he has been seduced to the dark side of the Force by Supreme Leader Snoke and aspires to be as powerful as his grandfather, Darth Vader, and create a new order in the galaxy separate from the legacies created by Luke and the Jedi Order.", "Kylo Ren is also the master of the Knights of Ren, as well as a commander and later the supreme leader of the First Order, an organization spawned from the fallen Galactic Empire.", "He is featured in \"The Force Awakens\" media and merchandising and appears in the film's sequel, \"\" (2017).", "After Lucasfilm was acquired by The Walt Disney Company in 2012, the script for \"The Force Awakens\" was written by Lawrence Kasdan, J. J. Abrams and Michael Arndt, with no direct participation from \"Star Wars\" creator George Lucas.", "According to director Abrams, the First Order is inspired by ODESSA, a theoretical network of SS officers who fled to Argentina following World War II." ], [ "Adam Driver", "Adam Driver\n\nAdam Douglas Driver (born November 19, 1983) is an American actor.", "He rose to prominence in the supporting role of Adam Sackler in the HBO comedy-drama series \"Girls\" (2012\u20132017), for which he received three consecutive nominations for the Primetime Emmy Award for Outstanding Supporting Actor in a Comedy Series.", "He made his Broadway debut in \"Mrs. Warren's Profession\" in 2010.", "In 2011, he returned to Broadway in \"Man and Boy\" and made his feature film debut in \"J. Edgar\".", "Driver has played supporting roles in a wide range of films, including \"Lincoln\" (2012), \"Frances Ha\" (2012), \"Inside Llewyn Davis\" (2013) and \"Silence\" (2016).", "He starred in the critically acclaimed films \"Logan Lucky\" (2017), \"BlacKkKlansman\" (2018), \"While We're Young\" (2014) and won the Volpi Cup for Best Actor at the Venice Film Festival for his performance in \"Hungry Hearts\" (2014); he also received several accolades for his lead performance in Jim Jarmusch's \"Paterson\" (2016).", "Driver gained wider recognition and acclaim for playing the main antagonist Kylo Ren in the \"Star Wars\" sequel trilogy, first in \"\" (2015), followed by \"\" (2017)." ] ], "gold": "In the \"Star Wars\" movies, Han Solo and Princess Leia Organa's son is Ben Solo, later called Kylo Ren. The character is introduced in the 2015 film \"The Force Awakens\", and is played by Adam Driver in all the films of the sequel trilogy.", "prediction 1": "Han Solo is the son of original Star Wars trilogy characters Han Solo and Leia Organa. His son, Kylo Ren, has been portrayed by Adam Driver. His character is introduced in the 2015 film \"\" and is played by Daniel Boone.", "prediction 2": "Han Solo's son is played by Adam Driver in the 2015 film, The Rise of Skywalker: Revenge of the Sith, and the 2016 film, The Rise of Skywalker: Revenge of the Sith.", "prediction 3": "In the Star Wars franchise, Luke Skywalker is the father of Han Solo and Leia Organa, and the son of Luke Skywalker is the son of Rey and Finn. In the 2015 film \"The Rise of Skywalker\", the character of Han Solo's son is played by Adam Driver.", "prediction 4": "\"Kylo Ren\" is the chosen name of Ben Solo, the son of original \"Star Wars\" trilogy characters Han Solo and Leia Organa. Introduced in the 2015 film \"\", he is portrayed by American actor Adam Driver.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 0, "end": 3 }, { "error type": "Incoherent", "explanation": "", "start": 87, "end": 95 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 189, "end": 219 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Ben Solo, who goes by \"Kylo Ren\", is the son of original Star Wars trilogy characters Han Solo and Leia Organa. He has been portrayed by Adam Driver. His character is introduced in the 2015 film \"The Force Awakens\" and returns in the sequel as well." }, "preference": [ 0, 1, 2, 0, 2, 2 ] }, { "question": "What is the meaning of yellow card in fifa?", "passages": [ [ "Penalty card", "Penalty card\n\nPenalty cards are used in many sports as a means of warning, reprimanding or penalising a player, coach or team official.", "Penalty cards are most commonly used by referees or umpires to indicate that a player has committed an offense.", "The official will hold the card above his or her head while looking or pointing towards the player that has committed the offence.", "This action makes the decision clear to all players, as well as spectators and other officials in a manner that is language-neutral.", "The colour or shape of the card used by the official indicates the type or seriousness of the offence and the level of punishment that is to be applied.", "Yellow and red cards are the most common, typically indicating, respectively, cautions and dismissals.", "The idea of using language-neutral coloured cards to communicate a referee's intentions originated in association football, with English referee Ken Aston.", "Aston had been appointed to the FIFA Referees' Committee and was responsible for all referees at the 1966 FIFA World Cup.", "In the quarter-finals, England met Argentina at the Wembley Stadium.", "After the match, newspaper reports stated that referee Rudolf Kreitlein had cautioned Englishmen Bobby and Jack Charlton, as well as sending off Argentinian Antonio Ratt\u00edn.", "The referee had not made his decision clear during the game, and England manager Alf Ramsey approached FIFA representative for post-match clarification." ], [ "Fouls and misconduct (association football)", "A yellow card is shown by the referee to indicate that a player has been officially cautioned.", "The player's details are then recorded by the referee in a small notebook; hence a caution is also known as a \"booking\".", "A player who has been cautioned may continue playing in the game; however, a player who receives a second caution in a match is sent off (shown the yellow card again, and then a red card).", "Law 12 of the Laws of the Game lists the types of offences and misconduct that may result in a caution.", "It also states that \"only a player, substitute or substituted player\" can be cautioned.", "A player is cautioned and shown a yellow card if he/she commits any of the following offences:\n\nWhat constitutes cautionable unsporting behaviour is generally at the referee's discretion, though the Interpretation and Guidelines which accompany the Laws list a number of examples.", "These include simulation intended to deceive the referee, or attempting to score by handling the ball.", "Fouls which are committed recklessly or fouls which are committed with the intention of breaking up a promising attack are also considered unsporting behaviour and punishable with a yellow card.", "Fouls which are committed with excessive force, however, or which are deliberately committed to deny an obvious goalscoring opportunity for the player fouled (i.e." ] ], "gold": "A yellow card in FIFA is shown by the referee to indicate that a player has been officially cautioned. The player's details are then recorded by the referee in a small notebook. A player who has been cautioned may continue playing in the game; however, a player who receives a second caution in a match is sent off. This player is shown the yellow card again and then is shown a red card, meaning that they must leave the field immediately and take no further part in the game. Additionally, the player may not be replaced by a substitute. Law 12 of the Laws of the Game, which are set by the International Football Association Board and used by FIFA, lists the types of offences and misconduct that may result in a yellow card.", "prediction 1": "The red card indicates a dismissal, a warning, or a caution. In football, the yellow card is used to indicate that a player has been cautioned. The official will hold the card above his or her head while looking or pointing towards the player that has committed the offence.", "prediction 2": "The yellow card is shown by the referee to indicate that a player has been officially cautioned. The player's details are then recorded by the referee in a small notebook; hence, a caution is also known as a \"booking\". A player is cautioned and shown a yellow card if he/she commits any of the following offences: reckless play, fouls committed with the intention of breaking up a promising attack, or fouls committed with excessive force, however, or which are deliberately committed to deny an obvious goalscoring chance for the player fouled.", "prediction 3": "A yellow card is shown by the referee to indicate that a player has been officially cautioned. The player's details are then recorded by the referee in a small notebook. In fifa, a yellow card means a warning, reprimand or punishment for an opponent. In association football, a yellow card is shown by the referee to indicate that a player has committed an offense.", "prediction 4": "The yellow card is shown by a referee to indicate that a player has been officially cautioned. The player's details are then recorded by the referee in a small notebook, indicating, respectively, cautions and dismissals. A player is cautioned and shown a yellow card if he/she commits any of the following offences: simulation intended to deceive the referee, or fouls which are committed with the intention of breaking up a promising attack are also considered unsporting behaviour and punishable with a red card.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 4, "end": 12 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 274 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 25, "end": 35 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The yellow indicates a warning, or a caution. In football, the yellow card is used to indicate that a player has been cautioned. The player's details are then recorded by the referee in a small notebook. A player who has been cautioned may continue playing in the game; however, a player who receives a second caution in a match is sent off (shown the yellow card again, and then a red card). Law 12 of the Laws of the Game lists the types of offences and misconduct that may result in a caution." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who hit the last home run at three rivers stadium?", "passages": [ [ "Forbes Field", "The park was the second oldest baseball field in the league at the time \u2013 only Shibe Park in Philadelphia was older (it was replaced in 1971 by Veterans Stadium).", "The location of the park, which initially was criticized for not being developed, grew into a \"bustling business district\" which led to a lack of parking space.", "One sportswriter wrote that \"The House of Thrills\" had become \"as joyless as a prison exercise yard\".", "Following a plan to expand their adjacent campus, the University of Pittsburgh purchased Forbes Field in 1958, with an agreement to lease the stadium to the Pirates until a replacement could be built.", "A proposal for a new sports stadium in Pittsburgh was first made in 1948, but plans did not attract much attention until the late 1950s.", "Construction began on Three Rivers Stadium on April 25, 1968.", "The Pittsburgh Pirates and the Chicago Cubs played a double-header on June 28, 1970.", "Pittsburgh won the first game 3\u20132.", "In the later game Al Oliver hit the last home run in the park, and Matty Alou drove in two runs as the Pirates closed the 62-year-old stadium with a 4\u20131 victory.", "The 40,918 spectators in attendance stood and cheered as Dave Giusti retired Willie Smith for the final out at the stadium.", "Pirates Hall of Famer Roberto Clemente played 15 seasons at Forbes Field." ] ], "gold": "The last home run hit at Three Rivers Stadium was by John Wehner of the Pittsburgh Pirates.", "prediction 1": "Al Oliver hit the last home run at Three Rivers Stadium on June 28, 1970.", "prediction 2": "Al Oliver hit the last home run at Three Rivers Stadium, a baseball stadium in Pittsburgh, Pennsylvania, on June 28, 1970. Matty Alou drove in two runs as the Pirates closed the 62-year-old stadium with a 4\u20131 victory.", "prediction 3": "Al Oliver hit the last home run at Three Rivers Stadium on June 21, 1970. The home run was his last at Forbes Field.", "prediction 4": "Al Oliver hit the last home run at Three Rivers Stadium on June 28, 1970. Matty Alou drove in two runs as the Pirates closed the 62-year-old stadium with a 4\u20131 victory.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Al Oliver hit the last home run at Three Rivers Stadium on June 28, 1970." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did spock first say live long and prosper?", "passages": [ [ "Vulcan salute", "The gesture was created by Leonard Nimoy for the \"Star Trek\" episode \"Amok Time\", which was the first episode with Vulcans other than Spock.", "Nimoy wanted something to help develop the Vulcans sociologically and suggested that Vulcans have a gestural greeting.", "He then proposed the (now globally-recognized) sign.", "The accompanying spoken blessing, \"live long and prosper\"\u00a0\u2013 \"\"dif-tor heh smusma\"\" in the Vulcan language (as spoken in \"\")\u00a0\u2013 also appeared for the first time in \"Amok Time\", scripted by Theodore Sturgeon.", "The less-well-known reply is \"peace and long life\", though it is sometimes said first, with \"live long and prosper\" as the reply.", "The phrase has been seen abbreviated \"LLAP\".", "An ancient Egyptian blessing \"\"ankh wedja seneb\"\", while its verbatim translation is uncertain, uses the three symbols \"life\", \"prosperity\" and \"health\"; it has been translated as \"may he live, be prosperous, be healthy.\"" ], [ "Amok Time", "Amok Time\n\n\"Amok Time\" is the premiere episode of the American science fiction television series \"\".", "Written by science fiction author Theodore Sturgeon, scored by Gerald Fried, and directed by Joseph Pevney, it first aired on September 15, 1967.", "The episode features First Officer Spock returning to his homeworld for a brutal Vulcan wedding ritual.", "It is the only episode of the \"\" to depict scenes on the planet Vulcan.", "It was the first episode to air (though not the first filmed) featuring Ensign Pavel Chekov (Walter Koenig) as the ship's navigator.", "It was also the first episode to list \"DeForest Kelley as Dr. McCoy\" in the opening credits, and the first episode broadcast in the series' new time slot of 8:30 pm on Friday night.", "Spock, the first officer of the Federation starship USS \"Enterprise\", begins to exhibit unusual behavior and requests that he be granted leave on his home planet Vulcan.", "Captain James T. Kirk and Chief Medical Officer Dr. McCoy, having witnessed one of their friend's outbursts, agree and Kirk diverts the ship to Vulcan.", "En route, Kirk receives orders from Starfleet to travel to Altair VI to represent the Federation at the inauguration ceremony for the planet's new president." ] ], "gold": "Spock first said Live Long and Prosper on September 15, 1967, during Season 2 Episode 1, or episode 30 of the show, entitled Amok Time.", "prediction 1": "The Vulcan salute was created by Leonard Nimoy for the Star Trek episode Amok Time, which was the first episode with Vulcans other than Spock. The accompanying spoken blessing, \"live long and prosper,\" \u2013 \"dif-tor heh smusma\"\" in the Vulcan language, also appeared for the first time in the episode. The less-well-known reply is peace and long life, though it is sometimes said first, with \"live long and prosper\" as the reply.", "prediction 2": "The greeting was created by Leonard Nimoy for the Star Trek episode Amok Time, which was the first episode with Vulcans other than Spock. The accompanying spoken blessing, \"live long and prosper\" \u2013 \"dif-tor heh smusma\"\" in the Vulcan language, also appeared for the first time in Amok Time, scripted by Theodore Sturgeon. The less-well-known reply is peace and long life, though it is sometimes said first, with \"live long and prosper\" as the reply. The phrase has been seen abbreviated \"LLAP\".", "prediction 3": "The first time Spock said live long and prosper was in the Star Trek episode Amok Time, which was the first episode with Vulcans other than Spock.", "prediction 4": "The phrase live long and prosper was first said in the episode of Star Trek, Amok Time, which is the first episode with Vulcans other than Spock. It was first spoken in the episode of Star Trek: The Next Generation where Spock was the first Vulcan. The phrase was first used in the episode of Star Trek: The Next Generation, which first aired on September 15, 1967.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 426 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The accompanying spoken blessing, \"live long and prosper,\" appeared for the first time in the \"Amok Time\" episode. It first aired on September 15, 1967." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has written the patriotic song kadam kadam badhaye ja khushi ke geet gaye ja?", "passages": [ [ "Qadam Qadam Badaye Ja", "Qadam Qadam Badaye Ja\n\n\"Qadam Qadam Badhaye Ja\" (Hindi: \u0915\u093c\u0926\u092e \u0915\u093c\u0926\u092e \u092c\u0922\u093c\u093e\u092f\u0947 \u091c\u093e) was the regimental quick march of the Subhas Chandra Bose's Indian National Army.", "Written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri, it was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947.", "The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R. Rahman.", "The song is currently the regimental quickmarch of the Indian Army." ] ], "gold": "Qadam Qadam Badhaye Ja was the regimental quick march of Subhas Chandra Bose's Indian National Army. After being banned by the British following World War II as seditious, the song became a patriotic anthem in India and is currently the regimental quick march of the Indian Army. The music to the march was composed by Ram Singh Thakuri, with the lyrics being written by Vanshidhar Shukla.", "prediction 1": "The patriotic song, Kadam Kadam Badhaye Ja Khushi Ke Geet Gaye Ja, was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. It was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R Rahman.\n", "prediction 2": "In 1947, it was banned in India as seditious thanks to the World War II threat of terrorism. The patriotic song, Qadam Qadam Badaye Ja, was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri.", "prediction 3": "Pt. Vanshidhar Shukla wrote the patriotic song Qadam Qadam Badhaye Ja, composed by Ram Singh Thakuri. Song was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R Rahman.", "prediction 4": "The patriotic march song Qadam Qadam Badhaye Ja, or Qadam Qadam Badhaye Ja, was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri, and was banned in India after World War II as \"seditious\", which was subsequently lifted in August 1947. The song has since become a patriotic song in India, and has been re-interpreted by various Indian musicians including C. Ramachandra and A.R. Rahman.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 20, "end": 66 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 393 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The patriotic song was the regimental quick march of the Subhas Chandra Bose's Indian National Army. Qadam Qadam Badaye Ja \"Qadam Qadam Badhaye Ja\" was written by Pt. Vanshidhar Shukla and composed by Ram Singh Thakuri. It was banned in India after World War II. The song has since become a patriotic song in India, and is currently the regimental quickmarch of the Indian Army.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When have the bills been in the super bowl?", "passages": [ [ "The Sea of Hands", "Instead, Miami\u2019s defeat in the \u2018Sea of Hands\u2019 game ended their historic run; there would be no fourth straight Super Bowl, and to date only the Buffalo Bills have ever advanced to four straight Super Bowls (XXV, XXVI, XXVII, and XXVIII).", "The Dolphins would not return to the Super Bowl until January 1983, when they would meet (and be defeated by) the Washington Redskins in Super Bowl XVII.", "The Raiders would not advance to Super Bowl IX, either: They would be defeated in the AFC Championship Game by the Pittsburgh Steelers, 24-13, thus beginning Pittsburgh's historic run of four Super Bowl appearances (and victories) in six years." ] ], "gold": "The Bills were in Super Bowls XXV, XXVI, XXVII, and XXVIII, in years 1991, 1992, 1993, and 1994, respectively.", "prediction 1": "The Buffalo Bills have been in the Super Bowl six times. They have been in the Super Bowl XXV, XXVI, and XXVII. The Dolphins have been in the Super Bowl four times.", "prediction 2": "The Buffalo Bills have been in the Super Bowl for ten consecutive years, and to date only the Buffalo Bills have ever advanced to four straight Super Bowls.", "prediction 3": "The Buffalo Bills have been in the Super Bowl XXV, XXVI, XXVII, and XXVIII.", "prediction 4": "The Buffalo Bills have been in the Super Bowl four straight times. They have been in the Super Bowl XXV, XXVI, XXVII, and XXVIII. The Buffalo Bills have been in the Super Bowl XXV, XXVI, XXVII, and XXVIII.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 112, "end": 164 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 56 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Buffalo Bills have been in the Super Bowl XXV, XXVI, XXVII, and XXVIII. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the indian cricket team captain 2018?", "passages": [ [ "Rohit Sharma", "He also captained the series against west indies which India won, making him as the Indian Captain with most wins in first 10 T20Is as captain.", "He remained unbeaten on 111 off 61 balls as India beat west Indies by 71 runs.", "In December 2017, India captain Virat Kohli was rested for the ODIs and T20I against Sri Lanka, in preparation for India's tour to South Africa, which began in the first week of January 2018.", "As a result, Rohit was named the Indian captain for the first time in his career.", "India won the ODI series 2\u20131, their eighth consecutive series win since beating Zimbabwe in June 2016.", "India won the T20I series 3\u20130.", "Rohit Sharma was selected to lead India for the Nidahas Trophy in March 2018 as Virat Kohli was resting.", "Rohit Sharma again lead India in the 2018 Asia Cup after Virat Kohli was rested after a rigorous tour of England.", "India won the tournament after wining the final against Bangladesh.", "Rohit lead India to defeat West Indies in the T20I series.", "Rohit Sharma is one of the most successful players in Indian Premier League (IPL) and has the unique record of finishing the match by scoring a last-ball six.", "He has one century and a hat-trick to his name." ], [ "India national cricket team", "Traditionally much stronger at home than abroad, the Indian team has improved its overseas form, especially in limited-overs cricket, since the start of the 21st century, winning Test matches in Australia, England and South Africa.", "It has won the Cricket World Cup twice \u2013 in 1983 under the captaincy of Kapil Dev and in 2011 under the captaincy of Mahendra Singh Dhoni.", "After winning the 2011 World Cup, India became only the third team after West Indies and Australia to have won the World Cup more than once, and the first cricket team to win the World Cup at home.", "It also won the 2007 ICC World Twenty20 and 2013 ICC Champions Trophy, under the captaincy of MS Dhoni.", "It was also the joint champions of 2002 ICC Champions Trophy, along with Sri Lanka.", ", India is ranked first in Tests, second in ODIs and second in T20Is by the ICC.", "Virat Kohli is the current captain of the team across all formats, while the head coach is Ravi Shastri.", "The Indian cricket team has rivalries with other Test-playing nations, most notably with Pakistan, the political arch-rival of India.", "However, in recent times, rivalries with nations like Australia, South Africa and England have also gained prominence.", "The British brought cricket to India in the early 1700s, with the first cricket match played in 1721." ] ], "gold": "The 2018 Indian cricket team captains were Virat Kohli, as Indian Test Match captain, and Rohit Sharma as India one day international captain.", "prediction 1": "In 2018, Rohit Sharma was named the Indian cricket team captain after Virat Kohli was rested for the ODIs and T20Is against Sri Lanka in preparation for India's tour to South Africa, which began in the first week of January 2018. Rohit Sharma again lead India in the 2018 Asia Cup after Virat Kohli was rested after a rigorous tour of England. Virat Kohli is the current captain of the team across all formats, while the head coach is Ravi Shastri.", "prediction 2": "Virat Kohli is the current captain of the Indian cricket team. Rohit Sharma was named the captain of the Indian team in December 2017. Rohit led India to victory in the 2018 Asia Cup. Virat Kohli captained the team in 2017.", "prediction 3": "Rohit Sharma is the Indian cricket team captain for the 2018 season. Virat Kohli is the current captain of the team across all formats. Rohit was named as the captain for the first time in his career after Virat Kohli was rested for the ODIs and T20Is against Sri Lanka in preparation for India's tour to South Africa, which began in the first week of January 2018.", "prediction 4": "Virat Kohli was captaining the Indian cricket team from 2013 to 2017. Virat was captaining the team from 2015 to 2018. Rohit Sharma was the Indian cricket team captain for 2018.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 0, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 9, "end": 31 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 343 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 448 } ], "missing-info": [], "corrected-prediction": "The Indian cricket team captain was Virat Kohli for India's tour which began in the first week of January 2018. Rohit Sharma lead India in the 2018 Asia Cup." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "How many decks does the oasis of the seas have?", "passages": [ [ "MS Oasis of the Seas", "MS Oasis of the Seas\n\nMS \"Oasis of the Seas\" is an owned by Royal Caribbean International.", "Her hull was laid down in November 2007 and she was completed and delivered to Royal Caribbean in October 2009.", "At the time of construction, \"Oasis of the Seas\" set a new capacity record of carrying over 6,000 passengers.", "The first of her class, she was joined by sister ships in December 2010, in May 2016, and in April 2018.", "\"Oasis of the Seas\" conducts cruises of the Caribbean from her home port of Port Canaveral in Cape Canaveral, Florida.", "\"Oasis of the Seas\" surpassed the cruise ships (also owned by Royal Caribbean) to become the largest cruise ship in the world at that time.", "She was herself surpassed by her sister ship \"Allure of the Seas\", which is longer, although this may have been caused by ambient temperature differences at the times the measurements were made.", "In May 2016, her second sister ship became the new record holder with a length of .", "The vessel was ordered in February 2006 and designed under the name \"Project Genesis\".", "Her keel was laid down on 12 November 2007 by STX Europe Turku Shipyard, Finland.", "The company announced that full funding for \"Oasis of the Seas\" was secured on 15 April 2009.", "The name \"Oasis of the Seas\" resulted from a competition held in May 2008." ], [ "Oasis-class cruise ship", "The fuel consumption of the main engines at full power is of fuel oil per engine per hour for the 16-cylinder engines and per engine per hour for the 12-cylinder engines.", "The total output of these prime movers, some , is converted to electricity, used in hotel power for operation of the lights, elevators, electronics, galleys, water treatment plant, and all of the other systems used on the operation of the vessel, as well as propulsion.", "Propulsion is provided by three Azipods, ABB's brand of electric azimuth thrusters.", "These pods, suspended under the stern, contain electric motors driving propellers.", "Because they are rotatable, no rudders are needed to steer the ship.", "Docking is assisted by four transverse bow thrusters.", "The ship carries 18 lifeboats that hold 370 people each, for a total of 6,660 people.", "Inflatable life rafts provide for additional passengers and crew.", "On 25 October 2012 Royal Caribbean confirmed that the company was engaged in negotiations to build a third \"Oasis\"-class ship and hoped to enter an agreement before the year's end.", "The ship, which the company would expect to cost less per berth basis than the two previous ships and to be more energy efficient, was named Harmony of the Seas and delivered in May 2016." ] ], "gold": "The cruise ship, Oasis of the Seas has 18 total decks, of which 16 are passenger decks.", "prediction 1": "The MS Oasis of the Seas is owned by Royal Caribbean International. The ship has 5 decks and a total of 12 levels, of which 2 are in the main salon and 3 are in the guest lounges. The ship has 18 lifeboats that hold 370 people each, for a total of 6,660 people. The ship has 4 observation decks and a total of 9 additional observation decks.", "prediction 2": "The MS Oasis of the Seas was built with a hull that was laid down on 12 November 2007 and the decks were completed and delivered to Royal Caribbean in October 2009. There are 3 decks on the MS Oasis of the Seas. The ship has 9 decks with a total of 62,780 square meters.", "prediction 3": "MS Oasis of the Seas is a cruise ship owned by Royal Caribbean International. At the time of construction, the ship set a new capacity record of carrying over 6,000 passengers. She was joined by sister ships in December 2010, in May 2016, and in April 2018.", "prediction 4": "The MS Oasis of the Seas is a cruise ship owned by Royal Caribbean International. At the time of construction, \"Oasis of the Seas\" set a new capacity record of carrying over 6,000 passengers. She has 4 decks total. There are also 2 additional decks for additional deck passengers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 67 }, { "error type": "Unverifiable", "explanation": "", "start": 68, "end": 179 }, { "error type": "Redundant", "explanation": "The MS Oasis of the Seas is owned by Royal Caribbean International. The ship has 5 decks and a total of 12 levels, of which 2 are in the main salon and 3 are in the guest lounges. ", "start": 180, "end": 261 }, { "error type": "Redundant", "explanation": "The MS Oasis of the Seas is owned by Royal Caribbean International. The ship has 5 decks and a total of 12 levels, of which 2 are in the main salon and 3 are in the guest lounges.", "start": 262, "end": 341 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did little house on the prarie come out?", "passages": [ [ "The Cheetah Girls (group)", "The Cheetah Girls had a television movie, based on a best-selling series of young adult books of the same name by Deborah Gregory, which debuted on August 15, 2003.", "The movie's DVD sold over 800,000 copies.", "The film received over 84 million viewers worldwide and remained a hit in the ratings for months afterwards.", "The Cheetah Girls were also supposed to be a TV series for ABC in their 2004\u20132005 season.", "The show was to begin production in early 2004, according to an article on the MTV news site, but according to another article on MTV News website in February 2004, it said \"The Cheetah Girls\" sitcom had been delayed, due to the success of \"That's So Raven\".", "Therefore, Raven would not be able to do the series.", "Although a pilot was shot in late 2003, ABC decided not to pick up the series.", "Due to her busy schedule, as well as already being signed to the same label (Hollywood Records) as a solo act, Raven-Symon\u00e9 decided not to be a part of the actual recording act and only participate in the films, leaving the trio of just Bailon, Bryan and Williams." ] ], "gold": "Little House on the Prairie was the title of several pieces of entertainment. The novel was published on September 19, 1935. Then, the 1974 film came out on March 30, 1974, followed by the tv series that was aired on September 11, 1974. More recently, the 2005 TV miniseries little house on the prairie aired on March 26, 2005. There was also a musical of Little House on the Prairie. It came to Minnesota on August 15, 2008, and to New Jersey on September 10, 2009.", "prediction 1": "Little House on the Prairie came out on DVD on August 15, 2003. The Cheetah Girls had a television movie that debuted on August 15, 2003. The movie's DVD sold over 800,000 copies. The film received over 84 million viewers worldwide and remained a hit in the ratings for months afterwards. The Cheetah Girls were also supposed to be a sitcom for ABC in their 2004\u20132005 season. However, according to an article on MTV news site in February 2004, it said The Cheetah Girls had been delayed, due to the success of That's So Raven. Therefore, Raven would not be able to do the series.", "prediction 2": "The Little House on the Prairie was a children's book that came out in the UK in April 1996 and in the US in August 1995. The television movie of the same name came out on August 15, 2003. The movie's DVD sold over 800,000 copies.", "prediction 3": "Little House on the Prairie came out on July 29, 2003, and a television movie based on the book came out on August 15, 2003. The DVD of the movie sold over 800,000 copies and the movie received over 84 million viewers worldwide and remained a hit in the ratings for months afterwards. The Cheetah Girls were also supposed to be a TV series for ABC in their 2004\u20132005 season. According to an article on MTV News site in February 2004, it said \"The Cheetah Girls\" sitcom had been delayed, due to the success of \"That's So Raven\". Therefore, Raven would not be able to do the series. Although a pilot was shot in late 2003, ABC decided not to pick up the series.", "prediction 4": "The Cheetah Girls had a television movie, based on a best-selling series of young adult books of the same name by Deborah Gregory, which debuted on August 15, 2003. The movie's DVD sold over 800,000 copies. The film received over 84 million viewers worldwide and remained a hit in the ratings for months afterwards.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 0, "end": 27 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 179 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 526 }, { "error type": "Irrelevant", "explanation": "", "start": 527, "end": 579 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What bible does the catholic church use at mass?", "passages": [ [ "Catholic Bible", "Another difference concerns the usage of the Tetragrammaton.", "\"Yahweh\" appears in some Bible translations such as the Jerusalem Bible (1966) throughout the Old Testament.", "Long-standing Jewish and Christian tradition holds that the name is not to be spoken in worship or printed in liturgical texts out of reverence.", "A 2008 letter from the Congregation for Divine Worship and the Discipline of the Sacraments explicitly forbids the use of the Divine Name in worship texts, stating: \"For the translation of the biblical text in modern languages, intended for the liturgical usage of the Church, what is already prescribed by n. 41 of the Instruction \"Liturgiam authenticam\" is to be followed; that is, the divine tetragrammaton is to be rendered by the equivalent of Adonai/Kyrios; Lord, Signore, Seigneur, Herr, Se\u00f1or, etc.\"", "As a result, Bibles used by English-speaking Catholics for study and devotion typically do not match the liturgical texts read during mass, even when based on the same translation.", "Today, publishers and translators alike are making new efforts to more precisely align the texts of the Lectionary with the various approved translations of the Catholic Bible." ], [ "Douay\u2013Rheims Bible", "Challoner's New Testament was, however, extensively revised by Bernard MacMahon in a series of Dublin editions from 1783 to 1810.", "These Dublin versions are the source of some Challoner bibles printed in the United States in the 19th century.", "Subsequent editions of the Challoner Bible printed in England most often follow Challoner's earlier New Testament texts of 1749 and 1750, as do most 20th-century printings and on-line versions of the Douay\u2013Rheims bible circulating on the internet.", "Although the Jerusalem Bible, New American Bible Revised Edition, Revised Standard Version Catholic Edition, and New Revised Standard Version Catholic Edition are the most commonly used Bibles in English-speaking Catholic churches, the Challoner revision of the Douay\u2013Rheims is still often the Bible of choice of more traditional English-speaking Catholics.", "Following the English Reformation, some Catholics went into exile to the European mainland.", "The center of English Catholicism was the English College at Douai (University of Douai, France) founded in 1568 by William Allen, formerly of Queen's College, Oxford, and Canon of York, and subsequently cardinal, for the purpose of training priests to convert the English again to Catholicism.", "And it was here where the Catholic translation of the Bible into English was produced." ], [ "Bible", "A number of books which are part of the Peshitta or the Greek Septuagint but are not found in the Hebrew (Rabbinic) Bible (i.e., among the protocanonical books) are often referred to as deuterocanonical books by Roman Catholics referring to a later secondary (i.e., deutero) canon, that canon as fixed definitively by the Council of Trent 1545\u20131563.", "It includes 46 books for the Old Testament (45 if Jeremiah and Lamentations are counted as one) and 27 for the New.", "Most Protestants term these books as apocrypha.", "Modern Protestant traditions do not accept the deuterocanonical books as canonical, although Protestant Bibles included them in Apocrypha sections until the 1820s.", "However, Roman Catholic and Eastern Orthodox Churches include these books as part of their Old Testament.", "The Roman Catholic Church recognizes:\n\n", "In addition to those, the Greek and Russian Orthodox Churches recognize the following: \n\nRussian and Georgian Orthodox Churches include:\n\nThere is also 4 Maccabees which is only accepted as canonical in the Georgian Church, but was included by St. Jerome in an appendix to the Vulgate, and is an appendix to the Greek Orthodox Bible, and it is therefore sometimes included in collections of the Apocrypha." ] ], "gold": "A Catholic Bible is a Christian Bible that includes the whole 73-book canon recognized by the Catholic Church. English versions of the Bible that correspond to this description include the New Community Bible, New American Bible Revised Edition, and the New Living Translation Catholic Edition, which are all published in accordance with the prescriptions of Catholic canon law and can be used for lectionaries. Bibles used by English-speaking Catholics for study and devotion typically do not match the liturgical texts read during Mass.", "prediction 1": "The Catholic church uses the New Testament at Mass. The New Testament is found in the Jerusalem Bible, the New American Bible, the Revised Standard Version, and the New Revised Standard Version Catholic Edition. The Old Testament is found in the Douay-Rheims bible, the Catholic Church's translation of the Greek Orthodox Bible into English.", "prediction 2": "The Catholic Church uses the Bible at mass. The Jerusalem Bible is the bible used at mass and is a translation of the Hebrew Bible. The New American Bible Revised Edition is the bible used at mass. The Revised Standard Version is the bible used at mass.", "prediction 3": "The Catholic church uses the Latin Bible at mass. The earliest translation of the Bible used in the Catholic Church was the New American Bible Revised Edition, which was printed in the United States in the 19th century. The Catholic Church uses the Douay\u2013Rheims Bible, which is also the most commonly used Bible in English-speaking Catholic churches. The Roman Catholic Church also uses the Greek Orthodox Bible, which includes the Old Testament and the New Testament.", "prediction 4": "The Catholic church uses the Jerusalem Bible at mass. The New American Bible Revised Edition is the most widely used translation of the Old Testament, but the Douay-Rheims is also the most commonly used translation of the New Testament at mass.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 341 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Jerusalem Bible, the New American Bible, the Revised Standard Version, and the New Revised Standard Version Catholic Edition. are the most commonly used Bibles in English-speaking Catholic churches. Bibles used by English-speaking Catholics for study and devotion typically do not match the liturgical texts read during mass, even when based on the same translation." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the original stephen kings it released?", "passages": [ [ "It (miniseries)", "It (miniseries)\n\nIt (also known as Stephen King's It) is a 1990 American supernatural thriller horror drama miniseries directed by Tommy Lee Wallace and adapted by Lawrence D. Cohen from Stephen King's 1986 novel of the same name.", "It is the first of two adaptations of the novel; the second being the 2017 film adaptation and its upcoming 2019 sequel.", "The story revolves around a predatory shapeshifter which has the ability to transform itself into its prey's worst fears, allowing it to exploit the phobias of its victims.", "It mostly takes the human form of a sadistic, wisecracking clown called Pennywise.", "The protagonists are The Lucky Seven, or The Losers Club, a group of outcast kids who discover Pennywise and vow to destroy him by any means necessary.", "The series takes place over two different time periods, the first when the Losers first confront Pennywise as children in 1960, and the second when they return as adults in 1990 to defeat him a second time after he resurfaces.", "\"It\" features an ensemble cast, starring Richard Thomas, John Ritter, Annette O'Toole, Harry Anderson, Dennis Christopher, Tim Reid and Richard Masur as the seven members of the Losers Club, and Tim Curry as Pennywise." ], [ "Silver Spoons", "Silver Spoons\n\nSilver Spoons is an American sitcom that aired on NBC from September 25, 1982 to May 11, 1986, and in first-run syndication from September 15, 1986 to March 4, 1987.", "The series was produced by Embassy Television for the first four seasons, until Embassy Communications moved the series to syndication.", "\"Silver Spoons\" was created by Martin Cohan, Howard Leeds and Ben Starr.", "In the pilot episode, Ricky Stratton (Ricky Schroder) arrives at the mansion of the father he has never met to introduce himself, move in, and get to know him better.", "Edward Stratton III (Joel Higgins) epitomizes the phrase \"overgrown child\"; he has never taken responsibility for anything in his life, including his toy business, Eddie's Toys.", "Ricky recognizes that his father needs to grow up; Edward thinks his son is too uptight and needs to have more fun while he's still young.", "Edward's father is played by John Houseman as the thoughtful, well-to-do patriarch and industrialist whose demeanor starkly contrasts with Edward's and seems more similar to Ricky's (at first).", "Throughout the series, the comic tension arises between Grandfather Stratton's belief that people with money are obligated to make more money and Edward's belief that money should be used to make people happy." ] ], "gold": "The original Stephen King's It, the novel, was released on September 15, 1986. The 1990 American ABC two-part psychological horror drama miniseries was released November 18 \u2013 November 20, 1990. And, the 2017 movie, It, was released on September 5, 2017.", "prediction 1": "It is a 1990 American supernatural thriller horror drama miniseries directed by Tommy Lee Wallace and adapted by Lawrence D. Cohen from Stephen King's 1986 novel of the same name. It is the first of two adaptations of the novel, the second being the 2017 film adaptation and its upcoming 2019 sequel. Stephen King's It is also an American sitcom that aired on NBC from September 25, 1982 to May 11, 1986, and in first-run syndication from September 15, 1986 to March 4, 1987.", "prediction 2": "Stephen King's It is a horror novel that is set in the future and is based on the novel of the same name by Stephen King. In the 1986 novel, King penned a short story that was published in a book form and was titled \"It.\" In 1990, there was a miniseries titled It, directed by Tommy Lee Wallace and adapted by Lawrence D. Cohen from King's 1986 novel. In syndication, the novel was aired from September 15, 1986 to March 4, 1987. The original It was released in 1986. In 1989, there was a miniseries that titled The It, directed by Tommy Lee Wallace and adapted by Lawrence D. Cohen from Stephen King's 1986 novel It.", "prediction 3": "Stephen King's It is a 1986 horror novel by Stephen King. The 1990 American supernatural thriller horror miniseries It is also known as Stephen King's It and was adapted by Lawrence D. Cohen from King's 1986 novel of the same name. The American sitcom Silver Spoons is also known as Stephen King's It, and was released on October 15, 1983.", "prediction 4": "Stephen King's It is a 1986 horror novel written and published by Stephen King that was first published on October 16, 1986. The 1990 supernatural thriller horror miniseries It (also known as Stephen King's It) is directed by Tommy Lee Wallace and adapted by Lawrence D. Cohen from King's 1986 novel of the same name. The series premiered on September 15, 1990 and aired on NBC from September 25, 1982 to May 11, 1986. The series was produced by Embassy Television for the first four seasons and broadcast in first-run syndication from September 15, 1986 to March 4, 1987.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 475 }, { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 101 } ], "missing-info": [], "corrected-prediction": "It is a 1990 American supernatural thriller horror drama miniseries adapted by Lawrence D. Cohen from Stephen King's 1986 novel of the same name. It is the first of two adaptations of the novel, the second being the 2017 film adaptation and its upcoming 2019 sequel. " }, "preference": [ 1, 1, 1, 0, 0, 1 ] }, { "question": "How many states there is in the united states?", "passages": [ [ "United States", "United States\n\nThe United States of America (USA), commonly known as the United States (U.S. or US) or America, is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions.", "At 3.8\u00a0million square miles (9.8\u00a0million km), the United States is the world's third- or fourth-largest country by total area and slightly smaller than the entire continent of Europe's 3.9\u00a0million square miles (10.1\u00a0million km).", "With a population of over 325 million people, the U.S. is the third most populous country.", "The capital is Washington, D.C., and the largest city by population is New York City.", "Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico.", "The State of Alaska is in the northwest corner of North America, bordered by Canada to the east and across the Bering Strait from Russia to the west.", "The State of Hawaii is an archipelago in the mid-Pacific Ocean.", "The U.S. territories are scattered about the Pacific Ocean and the Caribbean Sea, stretching across nine official time zones.", "The extremely diverse geography, climate, and wildlife of the United States make it one of the world's 17 megadiverse countries." ] ], "gold": "The United States of America is a federal republic consisting of 50 states, a federal district which is Washington, D.C., the capital city of the United States, five major territories, and various minor islands. The 48 contiguous states and Washington, D.C., are in North America between Canada and Mexico. Alaska is an enclave in the far northwestern part of North America, connected only to Canada, and Hawaii is an archipelago in the mid-Pacific. Territories of the United States are scattered throughout the Pacific Ocean and the Caribbean Sea.", "prediction 1": "The United States of America is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions. The total area of the United States is 3.8 million square miles, making it the world's third- or fourth-largest country by total area. In total, there are 43 countries represented in the United States.", "prediction 2": "In the United States, there are 50 states. Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico. The State of Alaska is in the northwest corner of North America, bordered by Canada to the east and across the Bering Strait from Russia to the west.", "prediction 3": "The United States is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions. The states are numbered from the smallest to the largest.", "prediction 4": "The United States of America is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions. The states are located in the continental United States of America.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 283 }, { "error type": "Unverifiable", "explanation": "", "start": 284, "end": 350 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The United States of America is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions. Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico. The State of Alaska is in the northwest corner of North America, bordered by Canada and the State of Hawaii is an archipelago in the mid-Pacific Ocean. The U.S. territories are scattered about the Pacific Ocean and the Caribbean Sea." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the english bill of rights happen?", "passages": [ [ "Glorious Revolution", "The proposal to draw up a statement of rights and liberties and James's invasion of them was first made on 29 January in the Commons, with members arguing that the House \"can not answer it to the nation or Prince of Orange till we declare what are the rights invaded\" and that William \"cannot take it ill if we make conditions to secure ourselves for the future\" to \"do justice to those who sent us hither\".", "On 2 February a committee specially convened reported to the Commons 23\u00a0Heads of Grievances, which the Commons approved and added some of their own.", "However, on 4 February the Commons decided to instruct the committee to differentiate between \"such of the general heads, as are introductory of new laws, from those that are declaratory of ancient rights\".", "On 7 February the Commons approved this revised Declaration of Right, and on 8 February instructed the committee to put into a single text the Declaration (with the heads which were \"introductory of new laws\" removed), the resolution of 28 January and the Lords' proposal for a revised oath of allegiance.", "It passed the Commons without division.", "The Declaration of Right was in December 1689 enacted in an Act of Parliament, the Bill of Rights 1689.", "It listed twelve of James's policies by which James designed to \"endeavour to subvert and extirpate the protestant religion, and the laws and liberties of this kingdom\"." ], [ "Glorious Revolution", "These were:\n\nThe Bill of Rights also vindicated and asserted the nation's \"ancient rights and liberties\" by declaring:\n\nOn 13 February the clerk of the House of Lords read the Declaration of Right, and Halifax, in the name of all the estates of the realm, asked William and Mary to accept the throne.", "William replied for his wife and himself: \"We thankfully accept what you have offered us\".", "They then went in procession to the great gate at Whitehall.", "The Garter King at Arms proclaimed them King and Queen of England, France and Ireland, whereupon they adjourned to the Chapel Royal, with Compton preaching the sermon.", "They were crowned on 11 April, swearing an oath to uphold the laws made by Parliament.", "The Coronation Oath Act 1688 had provided a new coronation oath, whereby the monarchs were to \"solemnly promise and swear to govern the people of this kingdom of England, and the dominions thereunto belonging, according to the statutes in parliament agreed on, and the laws and customs of the same\".", "They were also to maintain the laws of God, the true profession of the Gospel, and the Protestant Reformed faith established by law.", "Although their succession to the English throne was relatively peaceful, much blood would be shed before William's authority was accepted in Ireland and Scotland." ] ], "gold": "The proposal to draw up a statement of rights and liberties and James's violation of them was first made on 29 January 1689 in the House of Commons, with members arguing that the House \"cannot answer it to the nation or Prince of Orange till we declare what are the rights invaded\" and that William \"cannot take it ill if we make conditions to secure ourselves for the future\" in order to \"do justice to those who sent us hither\". On 2 February a committee specially convened reported to the Commons 23 Heads of Grievances, which the Commons approved and added some of their own. On 2 February a committee specially convened reported to the Commons 23 Heads of Grievances, which the Commons approved and added some of their own. On 7 February the Commons approved this revised Declaration of Right, and on 13 February the clerk of the House of Lords read the Declaration of Right, and the Marquess of Halifax, in the name of all the estates of the realm, asked William and Mary to accept the throne.", "prediction 1": "The English Bill of Rights was enacted in 1792. The Act of Parliament that adopted it was called the Bill of Rights 1689. The English Bill of Rights was first proposed on 29 January 1689 in the Commons. It was proposed on 2 February 1689 in a committee specially convened to report to the Commons 23 Heads of Grievances that the Commons approved and added some of their own.", "prediction 2": "The English bill of rights was enacted in 1689 at the end of Parliament's session at the House of Lords. It listed twelve of James's policies by which James designed to \"endeavour to subvert and extirpate the protestant religion, and the laws and liberties of this kingdom\". The language reflects the common usage in English.", "prediction 3": "The English Bill of Rights happened at Westminster Abbey, Westminster Abbey and Westminster Abbey, but it also happened in Westminster Abbey. In December 1689, the English Declaration of Right was enacted in an Act of Parliament, the Bill of Rights 1689, which listed twelve of James's policies by which James designed to \"endeavour to subvert and extirpate the protestant religion, and the laws and liberties of this kingdom\".", "prediction 4": "The English Bill of Rights was first made on 29 January in the Commons, with members arguing that the House \"can not answer it to the nation or Prince of Orange till we declare what are the rights invaded\" and that William \"cannot take it ill if we make conditions to secure ourselves for the future\" to \"do justice to those who sent us hither\". On 13 February the clerk of the House of Lords read the Declaration of Right, and Halifax, in the name of all the estates of the realm, asked William and Mary to accept what they had offered them.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 31, "end": 47 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 203, "end": 218 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 4, "end": 26 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 75, "end": 82 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Declaration of Right was enacted in December 1689. The Act of Parliament that enacted it was called the Bill of Rights 1689. The English Bill of Rights was first proposed on 29 January 1689 in the Commons. With members arguing that the House \"can not answer it to the nation or Prince of Orange till we declare what are the rights invaded\" and that William \"cannot take it ill if we make conditions to secure ourselves for the future\" to \"do justice to those who sent us hither\". On 2 February 1689 in a committee specially convened to report to the Commons 23 Heads of Grievances that the Commons approved and added some of their own. On 7 February the Commons approved this revised Declaration of Right. On 13 February the clerk of the House of Lords read the Declaration of Right, and Halifax, in the name of all the estates of the realm, asked William and Mary to accept the throne." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who does the voice of rocket in guardians of the galaxy?", "passages": [ [ "Guardians of the Galaxy \u2013 Mission: Breakout!", "Guardians of the Galaxy \u2013 Mission: Breakout!", "\"Guardians of the Galaxy\" \u2013 Mission: Breakout! is an accelerated drop tower dark ride attraction at Disney California Adventure.", "Based on Marvel's \"Guardians of the Galaxy\" film series, it depicts Rocket Raccoon recruiting guests to attempt to free the remaining Guardians of the Galaxy from display within the Collector's fortress.", "The attraction, the first major Disney attraction to be based on Marvel Comics characters within the United States, is a retheme of \"The Twilight Zone\" Tower of Terror, using the same infrastructure and ride system as the previous attraction.", "It features several cast members from the film series reprising their characters.", "The attraction is not a part of the Marvel Cinematic Universe (MCU), but is instead part of its own shared universe, the Marvel Theme Park Universe (MTPU), which is inspired by the MCU.", "It opened on May 27, 2017, twenty-two days after the release of \"Guardians of the Galaxy Vol. 2\".", "Announced at the 2016 San Diego Comic-Con, the attraction replaced \"The Twilight Zone\" Tower of Terror, which closed on January 3, 2017.", "It is the first Disney attraction based on Marvel Comics characters in the United States, and will be followed in 2020 by a Marvel-themed area at Disney California Adventure." ], [ "Trevor Devall", "Trevor grew up in Edmonton, Alberta and was the youngest of five siblings.", "He was into theatre and did tap, jazz and Polynesian dance as a child.", "He attended the University of Alberta for drama and directed stage productions as well as student films.", "Trevor moved to Vancouver in 1998 to pursue a film directing career.", "While working for a talent agency, he made a demo tape for them and began landing work as a voice actor.", "In March 2015 it was announced Trevor would be the voice of Rocket Raccoon in Marvel's animated \"Guardians of the Galaxy\".", "Since 2007, Devall produced his own podcast, \"Voiceprint with Trevor Devall & Guests\", where he interviewed fellow Vancouver-based voice actors and answered questions from fans.", "Each episode featured a different voice actor as the episode guest, though some episodes featured other people in the voice-acting business that may not actually be voice actors themselves; or behind-the-scenes looks at the life of a voice actor.", "Topics usually included how the guest made it into the voice-acting business, what it is like working in the industry, and the general lifestyle of a voice actor.", "The series concluded its first season after 36 episodes in December 2013.", "The second season was announced in the final episode of season 1, as Trevor moves to Los Angeles, California to continue his career and the show." ], [ "Trevor Devall", "Trevor Devall\n\nTrevor Devall (born November 10, 1972) is a Canadian voice actor, actor and podcaster.", "He worked for Ocean Studios and various other studios in Vancouver, British Columbia, Canada for years, before he relocated to Los Angeles, California in 2013.", "He is best known for voicing Hot Dog in \"Krypto the Superdog\", Rocket Raccoon in the animated TV series \"Guardians of the Galaxy\", Emperor Palpatine in \"Lego Star Wars\", Pyro in \"X-Men Evolution\", Dukey in seasons 5 and 6 of \"Johnny Test\", and various characters in the Netflix original series \"F Is for Family\", as well as providing voices in English-language versions of various anime series, most notably as Mu La Flaga from \"Mobile Suit Gundam SEED\", Mukotsu from \"InuYasha\", from \"\", Mr. Chang from \"Black Lagoon\", and Aizawa from \"Death Note\".", "He also voiced Hermiod on \"Stargate Atlantis\" and Ravus Nox Fleuret in the \"Final Fantasy XV\" video game and \"\" feature film.", "On camera, he played Sir Atticus Moon in \"Big Time Movie\".", "Between 2007 and 2013, Trevor hosted his own podcast \"Voiceprint with Trevor Devall and guests\" where he interviewed fellow Canadian voice actors." ] ], "gold": "Rocket is a fictional character based on an actual raccoon in the Marvel Universe. In the 2014 film franchise he is voiced by Bradley Cooper (throughout the Marvel Cinematic Universe film franchise). In the animated TV series Guardians of the Galaxy in 2015, Trevor Devall does the voice.", "prediction 1": "Rocket Raccoon is a fictional character who appears in Marvel's animated TV series Guardians of the Galaxy. In March 2015, it was announced Canadian voice actor, Trevor Devall, would be the voice of Rocket in the animated TV series Guardians of the Galaxy.", "prediction 2": "In the 2017 attraction Guardians of the Galaxy \u2013 Mission: Breakout!, Rocket Raccoon recruits guests to attempt to free the remaining Guardians of the Galaxy from display within the Collector's fortress. Trevor Devall voices Rocket.", "prediction 3": "In the Marvel's animated television series Guardians of the Galaxy, the character of Rocket Raccoon is voiced by Canadian voice actor, Trevor Devall. In the Mission Breakout! attraction, Rocket Raccoon recruits guests to attempt to free the remaining Guardians of the Galaxy from display within the Collector's fortress. In the original Guardians of the Galaxy film series, Rocket is voiced by Darren Rochford. In Guardians of the Galaxy: Invasion, Canadian voice actor and podcaster Trevor Devall did the role of Rocket in the original Mission Breakout! Mission Breakout! Mission Breakout! Adventure attraction at Disney California Adventure. The Mission Breakout! attraction features several cast members from the film series reprising their characters. Rocket is voiced by Canadian voice actor, he also voice Rocket in the animated TV series.", "prediction 4": "In March 2015 it was announced that Canadian voice actor Trevor Devall would be the voice of Rocket Raccoon in Marvel's animated TV series Guardians of the Galaxy. He is best known for voicing Hot Dog in Krypto the Superdog, Rocket Raccoon in the animated TV series Guardians of the Galaxy, Emperor Palpatine in LEGO Star Wars, Pyro in X-Men Evolution, Dukey in seasons 5 and 6 of Johnny Test and various characters in the Netflix original series F is for Family.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Rocket Raccoon is a fictional character who appears in Marvel's animated TV series Guardians of the Galaxy. ", "start": 206, "end": 256 } ], "missing-info": [], "corrected-prediction": "Rocket Raccoon is a fictional character who appears in Marvel's animated TV series Guardians of the Galaxy. In March 2015, it was announced Canadian voice actor, Trevor Devall, would be the voice of Rocket." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the highest ranked golfer in the world?", "passages": [ [ "Jordan Spieth", "Jordan Spieth\n\nJordan Alexander Spieth (born July 27, 1993) is an American professional golfer on the PGA Tour and former world number one in the Official World Golf Ranking.", "He is a three-time major winner and the 2015 FedEx Cup champion.", "In April 2016, \"Time\" magazine named Spieth to its list of the \"100 Most Influential People\", noting that he \"exemplifies everything that's great about sports.\"", "Spieth's first major win came in the 2015 Masters Tournament, when he shot a 270 (\u221218) and pocketed $1.8 million.", "He tied the 72-hole record set by Tiger Woods in 1997 and became the second youngest golfer (behind Woods) to win the Masters.", "He then won the 2015 U.S. Open with a score of 5-under-par.", "He was the youngest U.S. Open champion since amateur Bobby Jones in 1923.", "He followed up with a win in the 2015 Tour Championship, which clinched the 2015 FedEx Cup.", "Two years later, Spieth won his third major at the 2017 Open Championship, by three shots at 12 under-par.", "Spieth was born in 1993 in Dallas, Texas, to Shawn Spieth and Mary Christine (n\u00e9e Julius) Spieth." ], [ "Jason Day", "Jason Day\n\nJason Day (born 12 November 1987) is an Australian professional golfer and PGA Tour member.", "He is a former World Number 1 in the World Golf Ranking, having first achieved the ranking in September 2015.", "Day first broke into the world's top ten in June 2011, rising to world number nine after his runner-up finish at the U.S. Open.", "In February 2014, Day won his first WGC title, the WGC-Accenture Match Play Championship and would win it for a second time in 2016.", "With his 2016 win, he joined Tiger Woods and Geoff Ogilvy as the only multiple winners of the WGC Match Play.", "He went on to win his first major tournament at the 2015 PGA Championship, scoring a record 20 strokes under par and rising to number three in the world rankings.", "Day was born in Beaudesert, Queensland.", "His father, Alvin, was Irish Australian, and his mother, Dening, was a Filipina born in the Philippines and moved to Australia in the early 1980s.", "He has two siblings, Yanna and Kim.", "His father took him to Beaudesert Golf Club and enrolled him as a junior member just past his sixth birthday.", "He was allowed to play six holes a day as a junior.", "At the age of eight his family moved to Rockhampton, and during this period he began to win events in the surrounding districts." ], [ "Dustin Johnson", "Dustin Johnson\n\nDustin Hunter Johnson (born June 22, 1984) is an American professional golfer who currently plays on the PGA Tour.", "He is a former World Number 1 in the Official World Golf Ranking.", "Through May 6, 2018, he had held the title of the Number 1-ranked golfer for 64 consecutive weeks, which is the 5th longest streak in PGA Tour history.", "On May 13, 2018, Justin Thomas overtook Johnson, but Johnson regained the Number 1 ranking four weeks later by winning the FedEx St. Jude Classic.", "Johnson retained the top ranking for another 13 weeks until Justin Rose overtook him by finishing second at the BMW Championship on September 10.", "Johnson returned to the top of the world rankings on September 23 when he finished third to Rose's fourth in the Tour Championship.", "He lost the number one ranking on October 21, 2018 when Brooks Koepka won the CJ Cup.", "He won the 2016 U.S. Open at Oakmont Country Club with a 4-under-par score of 276 for his first major championship.", "He had previously finished in a tie for second at both the 2011 Open Championship and the 2015 U.S. Open.", "He also has five World Golf Championships victories, with only Tiger Woods having won more, and he is the first player to win each of the four World Golf Championship events." ] ], "gold": "On November 8, 2015, the highest ranked golfer in the world was Jordan Spieth, a three-time major winner and the 2015 FedEx Cup champion. On March 27, 2016, Jason Day, an Australian professional golfer, PGA Tour member and winner of the 2015 PGA Championship, was the highest ranked golfer in the world. On February 19, 2017, the highest ranked golfer in the world was Dustin Johnson, who has won two major championships, the 2016 U.S. Open at Oakmont Country Club with a 4-under-par score of 276 and the 2020 Masters Tournament with a record score of 268, 20-under-par.", "prediction 1": "The highest-ranked golfer in the world by a number is Tiger Woods. Jason Day, Dustin Johnson, Dustin Johnson and Justin Thomas are the highest-ranked golfers in the world. Jason Day is the highest-ranked Australian professional golfer and PGA Tour member. Jordan Spieth is the highest-ranked American professional golfer on the PGA Tour and the former world number one in the official world golf ranking.", "prediction 2": "The highest-ranked golfer is Tiger Woods, who is the most-respected professional golfer in the world. Dustin Johnson is the highest-ranked American professional golfer in the world. Jason Day is the highest-ranked Australian professional golfer and a PGA Tour member. Jason Day's ranking was first achieved in September 2015.", "prediction 3": "The highest-ranked golfer in the world by a factor of five is Tiger Woods, with Tiger Woods the current leader. Jason Day is the highest-ranked Australian professional golfer and PGA Tour member. Dustin Johnson is the highest-ranked American professional golfer, with Brooks Koepka being the highest-ranked American. Dustin Johnson is the highest-ranked American golfer, with Brooks Koepka being the highest-ranked American.", "prediction 4": "The highest-ranked golfer in the world is Tiger Woods, who has won 59 career majors and 59 PGA Tour events. Jason Day is the highest-ranked Australian professional golfer and PGA Tour member, with a ranking of 1 in the Official World Golf Ranking. Australian professional golfer Dustin Johnson is the highest-ranked American professional golfer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 340 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 185, "end": 203 }, { "error type": "Unverifiable", "explanation": "", "start": 39, "end": 66 }, { "error type": "Redundant", "explanation": "The highest-ranked golfer in the world by a number is Tiger Woods. Jason Day, Dustin Johnson, ", "start": 94, "end": 108 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 127, "end": 149 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The highest-ranked golfer in the world as of October 21, 2018 is Brooks Koepka. Jason Day, Dustin Johnson, Justin Thomas, and Justin Rose are former highest-ranked golfers in the world. Jason Day is an Australian professional golfer, PGA Tour member and winner of the 2015 PGA Championship. He is a former World Number 1 in the World Golf Ranking, having first achieved the ranking in September 2015. Dustin Johnson won the 2016 U.S. Open at Oakmont Country Club with a 4-under-par score of 276. Jordan Spieth is the former world number one in the official world golf ranking. He is a three-time major winner and the 2015 FedEx Cup champion." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won worst cooks in america last season?", "passages": [ [ "Worst Cooks in America", "The season premiered on January 4, 2015 to 2,123,000 viewers.", "The second episode was lower at 1,456,000 viewers, with the third episode rising to 1,732,000 viewers and the fourth episode reached 1,689,000 viewers.", "the 5th episode reached 1,634,000 viewers.", "The sixth episode received 1.55 million viewers.", "Rachael Ray joins Anne Burrell to host season 7.", "The winner earns a $50,000 donation for their chosen charity.", "Because this season had only 7 total recruits, each team's worst recruit from that week's Main Dish challenge competed head to head in a quickfire elimination challenge instead of eliminating both recruits each week.", "This challenge involved more basic cooking techniques (e.g. knife skills) and the winner would be decided by a blind judging from both Anne and Rachael.", "The winning recruit stayed in the competition while the losing recruit was eliminated.", "Tyler Florence joins Anne Burrell to host season 8.", "Rachael Ray returns with Anne Burrell to host season 2 of the Celebrity Edition.", "The winner earns a $50,000 donation for their chosen charity.", "The season premiered on September 14, 2016 to 1,185,000 viewers.", "Rachael Ray joins Anne Burrell to host season 10.", "The season premiered on January 1, 2017." ], [ "Worst Cooks in America", "Worst Cooks in America\n\nWorst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network.", "The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set.", "The recruits are trained on the various basic cooking techniques including: baking, knife skills, temperature, seasoning and preparation.", "The final challenge is to cook a restaurant quality three-course meal for three food critics.", "The show premiered on January 3, 2010.", "The show was initially hosted by chef Anne Burrell and chef Beau MacMillan in Season 1.", "MacMillan was replaced by chef Robert Irvine on Season 2, followed by chef Bobby Flay for Seasons 3\u20135.", "On November 20, 2014, a Food Network press release announced that chef Tyler Florence will be paired with chef Burrell to host Season 6, to debut on January 4, 2015.", "Burrell was the winning instructor in seasons 1, 2, 3, 6, 7 and 8 with Flay winning in Seasons 4\u20135.", "Rachael Ray and Burrell hosted the Season 7 special celebrity edition, which premiered September 23, 2015.", "During the finale of Season 7, a trailer previewing Season 8 was shown and was aired in January 2016 with the return of Tyler Florence." ], [ "Worst Cooks in America", "Chefs Beau MacMillan and Anne Burrell lead an intense culinary boot camp.", "They have six recruits each, and every week they must eliminate one recruit from each of their teams until there is only one from each team left.", "The final two create a three-course meal to fool a panel of restaurant critics into believing that the meal was created by the acclaimed chefs.", "Twelve chefs competed in the first season of \"Worst Cooks in America\".", "Hometowns and occupations are available from the Food Network website.", "Chef Anne's team was known as the Red Team and Chef Beau's team was known as the Blue Team.", "Casting for season 2 of \"Worst Cooks in America\" was held at the LA Marriott Burbank Airport, Hotel & Convention Center on March 27, 2010.", "The Food Network also began accepting online video applications for season 2.", "Food Network's website announced that Robert Irvine would replace Beau MacMillan for season 2.", "Season 2 debuted on January 2, 2011.", "In this season the chefs had eight recruits each.", "In the first episode, a group of selected novice cooks were to prepare a dish from scratch so the chefs would get an idea of how poor their skills were.", "After tasting all the items, the chefs took turns picking team members for their rival chef.", "The first season started off with 24 novice cooks but only the worst 12 were chosen for a team." ] ], "gold": "Worst Cooks in America is an American reality television series on Food Network that takes 12 to 16 contestants, referred to as \"recruits\", with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. The Red Team is led by Chef Anne Burrell. She has won in Seasons 6, 7, 8, and 10, while the leader of the Blue Team, Rachael Ray, won in Seasons 9 and 11. ", "prediction 1": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Tyler Florence won the first season of the show and Bobby Flay won the second season. Tyler Florence won the second season of the show and Bobby Flay won the third season.\n", "prediction 2": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Tyler Florence won worst cooks in America in 2010, Robert Irvine won in 2011, Bobby Flay won in 2012 and Jason Aguilera won in 2014.", "prediction 3": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Tyler Florence and Anne Burrell won the year 2 and season 13 of the show. Bobby Flay won the year 4 and season 5 of the show.", "prediction 4": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp to earn a cash prize of $25,000 and a Food Network cooking set. The winner of this season's contest is Tyler Florence, who won most recently in Season 8 with Anne Burrell.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 98 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 308, "end": 393 }, { "error type": "Redundant", "explanation": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Tyler Florence won the first season of the show and Bobby Flay won the second season. ", "start": 394, "end": 480 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Worst Cooks in America is an American reality television series that premiered on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Anne Burrell lead the red team and was the winning instructor in seasons 1, 2, 3, 6, 7 and 8 with Bobby Flay winning in Seasons 4\u20135. \n" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who's the starting quarterback for the vikings?", "passages": [ [ "Matt Cassel", "On March 13, 2013, sources close to the Chiefs reported they intended to trade or release Cassel.", "On March 14, 2013, the Chiefs released Cassel.", "On the same day he was released from the Chiefs, Cassel signed with the Minnesota Vikings.", "On September 27, it was announced that Cassel would get his first start as a Viking in Week 4 against the Pittsburgh Steelers, due to a rib injury to starting quarterback Christian Ponder.", "The Vikings won the game 34\u201327.", "Due to another injury to Christian Ponder, Cassel received his third start of the season week 14 against the Baltimore Ravens.", "Despite a two touchdown, zero interception performance, the Vikings lost to the Ravens 29-26 during a heavy snow game.", "He would remain the starting quarterback the rest of the season where the Vikings finished with a 5-10-1 record and Cassel either played the whole game or came in to rally the Vikings from behind in all five victories.", "On March 7, 2014, it was reported that Cassel had signed a new two-year deal for $10 million.", "It was later announced on August 25, 2014 that Cassel would be the starting quarterback over rookie Teddy Bridgewater and Ponder.", "However, on September 21, 2014 Cassel broke his foot against the New Orleans Saints and was placed on injured reserve." ], [ "Minnesota Vikings", "Minnesota Vikings\n\nThe Minnesota Vikings are a professional American football team based in Minneapolis, Minnesota.", "The Vikings joined the National Football League (NFL) as an expansion team in 1960, and first took the field for the 1961 season.", "The team competes in the National Football Conference (NFC) North division.", "During the 1960s, the Vikings' record was typical for an expansion franchise, but improved over the course of the decade, resulting in a Central Division title in 1968.", "In 1969, their dominant defense led to the Vikings' league championship, the last NFL championship prior to the merger of the NFL with the AFL.", "The team plays its home games at U.S. Bank Stadium in the Downtown East section of Minneapolis.", "Professional football in the Minneapolis\u2013Saint Paul area (the \"Twin Cities\") began with the Minneapolis Marines/Red Jackets, an NFL team that played intermittently in the 1920s and 1930s.", "However, a new professional team in the area did not surface again until August 1959, when Minneapolis businessmen Bill Boyer, H.P. Skoglund, and Max Winter were awarded a franchise in the new American Football League (AFL)." ], [ "Teddy Bridgewater", "Reports said that, had he been eligible for the 2013 Draft, he most likely would have been the first quarterback taken.", "At one point, he was projected by many to be the first overall pick in the draft.", "On January 1, 2014, Bridgewater announced that he would forgo his final year of eligibility at Louisville.", "Bridgewater was selected by the Minnesota Vikings as the 32nd and final pick of the first round of the draft.", "The Vikings had traded their second round and fourth round picks to the Seattle Seahawks to move up and select Bridgewater.", "Bridgewater signed a four-year contract worth $6.85 million with a $3.3 million signing bonus with the Minnesota Vikings.", "Bridgewater entered the season as the second-string quarterback, behind veteran Matt Cassel but ahead of Christian Ponder.", "Bridgewater made his regular season debut on September 21, 2014, against the New Orleans Saints, entering in relief of the injured Cassel and finishing the game with 150 passing yards.", "He was named the starting quarterback for the remainder of the season after Cassel, who broke his foot in the aforementioned game, was placed on injured reserve.", "On Sunday, September 28, 2014, he made his first regular season start against the Atlanta Falcons and won the game, in large part due to his 317 passing yards, and scored his first NFL touchdown off a 13-yard run into the end zone." ] ], "gold": "The Minnesota Vikings are a professional American football team based in Minneapolis, who are members of the North Division of the National Football Conference in the National Football League. Teddy Bridgewater became the starting quarterback for the team in 2015, after current staring quarterback Matt Cassel was place on injured reserve. In 2016, Shaun Hill took over the position when Teddy Bridgewater left the game in the second half with a concussion and Sam Bradford was also traded to the team that year as a starting quarterback after an ACL tear Teddy Bridgewater suffered. In 2017, after Bradford was then injured, Case Keenum took the position and had a career year, setting highs in starts, passing yards, completions, and touchdowns, and leading the Vikings to a 13-win regular season, followed by a last-second win, known as the Minneapolis Miracle, over the New Orleans Saints in the playoffs.", "prediction 1": "The Minnesota Vikings are a professional American football team based in Minneapolis, Minnesota. They joined the National Football League (NFL) as an expansion team in 1960 and first took the field for the 1961 season. Matt Cassel was the starting quarterback in 2014. However, on September 21, 2014, Cassel broke his foot against the New Orleans Saints and was placed on injured reserve. However, on Sunday, September 28, 2014, rookie Teddy Bridgewater made his regular season debut against the Atlanta Falcons and won the game, in large part due to his 317 passing yards. Bridgewater entered the season as the second-string quarterback, but was named the starting quarterback for the remainder of the season after Cassel, who was placed on injured reserve.", "prediction 2": "The Minnesota Vikings are a professional American football team based in Minneapolis, Minnesota. The team joined the National Football League (NFL) as an expansion team in 1960, and first took the field for the 1961 season. In 2014, Matt Cassel was named the starting quarterback over rookie Teddy Bridgewater and Christian Ponder. Cassel broke his foot against the New Orleans Saints on September 21, 2014 and was placed on injured reserve.", "prediction 3": "The Minnesota Vikings have had multiple quarterbacks as their starting quarterback. Matt Cassel, Christian Ponder, and Teddy Bridgewater have all started with the team in 2014.", "prediction 4": "The Minnesota Vikings are a professional American football team based in Minneapolis, Minnesota. The team joined the National Football League as an expansion team in 1960, and first took the field for the 1961 season. During that time, quarterbacks Matt Cassel and Christian Ponder were the starting quarterbacks. However, Cassel broke his foot against the New Orleans Saints on September 21, 2014 and was placed on injured reserve. However, on August 25, 2014, it was announced that Cassel would be the starting quarterback over rookie Teddy Bridgewater and Ponder. However, on August 25, 2014, it was announced that Cassel would be the starting quarterback and Ponder. However, on September 27, 2014, it was announced that Cassel would be the starting quarterback for the remainder of the 2014, Cassel would be the starting quarterback for the remainder of the season. However, on September 27, 2014, it was announced that Cassel would get his first start as a Vikings in Week", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 454, "end": 573 }, { "error type": "Irrelevant", "explanation": "", "start": 574, "end": 758 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Minnesota Vikings are a professional American football team based in Minneapolis, Minnesota. The team competes in the National Football Conference (NFC) North division. Matt Cassel was the starting quarterback in 2014. However, on September 21, 2014, Cassel broke his foot against the New Orleans Saints and was placed on injured reserve. On Sunday, September 28, 2014, rookie Teddy Bridgewater was named the starting quarterback. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the majority whip in the house of representatives?", "passages": [ [ "Party leaders of the United States House of Representatives", "Party leaders of the United States House of Representatives\n\nParty leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot.", "With the Republicans holding a majority of seats and the Democrats holding a minority, the current leaders are: Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "Unlike in Westminster style legislatures or as with the Senate Majority Leader, the House Majority Leader's duties and prominence vary depending upon the style and power of the Speaker of the House.", "Typically, the Speaker does not participate in debate and rarely votes on the floor.", "In some cases, Majority Leaders have been more influential than the Speaker; notably, Tom DeLay was more prominent than Speaker Dennis Hastert.", "In addition, Speaker Newt Gingrich delegated to Dick Armey an unprecedented level of authority over scheduling legislation on the House floor.", "The current Minority Leader Nancy Pelosi serves as floor leader of the opposition party, and is the counterpart to the Majority Leader.", "Unlike the Majority Leader, the Minority Leader is on the ballot for Speaker of the House during the convening of the Congress." ], [ "Jim Clyburn", "Jim Clyburn\n\nJames Enos Clyburn (; born July 21, 1940) is an American politician of the Democratic Party serving as the U.S. Representative for since 1993, and the House Assistant Minority Leader since 2011.", "He was previously House Majority Whip, serving in that post from 2007 to 2011.", "His congressional district includes large portions of Columbia and Charleston, as well as several rural areas between them.", "Clyburn is the current dean of the South Carolina congressional delegation.", "As Assistant Democratic Leader, he is the third-ranking Democrat in the House behind House Minority Leader Nancy Pelosi and Minority Whip Steny Hoyer.", "After the Democrats took control of the House following the 2018 midterm elections, Clyburn will serve in his second stint as Majority Whip beginning in January 2019 as part the 116th Congress, continuing his status as the number three House Democrat behind (likely) Speaker of the House Pelosi and confirmed Majority Leader Hoyer.", "Clyburn was born in Sumter, South Carolina, the son of Enos Lloyd Clyburn, a fundamentalist minister, and his wife, Almeta (n\u00e9e Dizzley), a beautician." ], [ "Kevin McCarthy (California politician)", "Kevin McCarthy (California politician)\n\nKevin Owen McCarthy (born January 26, 1965) is an American politician serving as the House Majority Leader since 2014 and U.S. Representative for California's 23rd congressional district since 2007.", "The 23rd district, numbered as the 22nd district from 2007 to 2013, is based in Bakersfield and includes large sections of Kern County and Tulare County as well as part of the Quartz Hill neighborhood in northwest Los Angeles County.", "A member of the Republican Party, he was formerly chairman of the California Young Republicans and the Young Republican National Federation.", "McCarthy worked as district director for U.S. Representative Bill Thomas, and in 2000 was elected as a trustee to the Kern Community College District.", "He then served in the California State Assembly from 2002 to 2006, the last two years as Minority Leader.", "When Thomas retired from the U.S. House in 2006, McCarthy ran to succeed him and won the election.", "McCarthy was elected to House leadership as the Republican Chief Deputy Whip, from 2009 to 2011, and House Majority Whip, from 2011 until August 2014, when he was elected House Majority Leader to replace the outgoing Eric Cantor, who was defeated in his primary election.", "After announcing his candidacy for Speaker on September 28, 2015, he dropped out of the race on October 8." ] ], "gold": "Party leaders and whips of the United States House of Representatives are elected by their respective parties in a closed-door caucus by secret ballot. With the Democrats holding a majority of the seats in the House currently, the Majority Whip is Jim Clyburn from South Carolina. He succeeds Republican Majority Whips Kevin McCarthy from California and Steve Scalise from Louisiana.", "prediction 1": "The majority whip in the United States House of Representatives, also known as floor leaders, is Kevin McCarthy. Steve Scalise is the majority whip and he served from 2011 to 2015. The minority whip, Steny Hoyer, served from 2014 to 2019.", "prediction 2": "The majority whip in the United States House of Representatives is Kevin McCarthy. Steve Scalise is the majority whip, and Nancy Pelosi is the minority whip. Minority Whip Steny Hoyer is the minority whip.", "prediction 3": "Steve Scalise is the majority whip in the House of Representatives in the United States and is a Republican and is the son of Representative Steve Scalise. The majority whip in the House of Representatives is Kevin McCarthy, who has been Majority Leader since 2014, and the minority whip is Steny Hoyer.", "prediction 4": "The majority whip in the United States House of Representatives is Kevin McCarthy, who has been Majority Leader since 2014 and a United States Representative from California since 2007. The majority whip in the Senate is Steve Scalise, who has been Majority Whip since 2010. The majority whip in the House of Representatives is Nancy Pelosi, who was the House Minority Leader from 2007 to 2011. The majority whip in the House of Representatives is Steny Hoyer, who was the House Minority Leader from 2010 to 2015.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 0, "end": 112 }, { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 238 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Party leaders and whips of the United States House of Representatives are elected by their respective parties in a closed-door caucus by secret ballot. The majority whip in the United States House of Representatives is Steve Scalise. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who became president of the republic of china after the overthrow of the qing dynasty?", "passages": [ [ "Qing dynasty", "He took control of his Beiyang Army to crush the revolution in Wuhan at the Battle of Yangxia.", "After taking the position of Prime Minister and creating his own cabinet, Yuan Shikai went as far as to ask for the removal of Zaifeng from the regency.", "This removal later proceeded with directions from Empress Dowager Longyu.", "With Zaifeng gone, Yuan Shikai and his Beiyang commanders effectively dominated Qing politics.", "He reasoned that going to war would be unreasonable and costly, especially when noting that the Qing government had a goal for constitutional monarchy.", "Similarly, Sun Yat-sen's government wanted a republican constitutional reform, both aiming for the benefit of China's economy and populace.", "With permission from Empress Dowager Longyu, Yuan Shikai began negotiating with Sun Yat-sen, who decided that his goal had been achieved in forming a republic, and that therefore he could allow Yuan to step into the position of President of the Republic of China.", "On 12 February 1912, after rounds of negotiations, Longyu issued an imperial edict bringing about the abdication of the child emperor Puyi.", "This brought an end to over 2,000 years of Imperial China and began an extended period of instability of warlord factionalism.", "The unorganized political and economic systems combined with a widespread criticism of Chinese culture led to questioning and doubt about the future." ], [ "Qing dynasty", "Qing dynasty\n\nThe Qing dynasty, officially the Great Qing (), was the last imperial dynasty of China.", "It was established in 1636, and ruled China proper from 1644 to 1912.", "It was preceded by the Ming dynasty and succeeded by the Republic of China.", "The Qing multi-cultural empire lasted for almost three centuries and formed the territorial base for modern China.", "It was the fifth largest empire in world history.", "The dynasty was founded by the Manchu Aisin Gioro clan in Manchuria.", "In the late sixteenth century, Nurhaci, originally a Ming Jianzhou Guard vassal, began organizing \"Banners\", military-social units that included Manchu, Han, and Mongol elements.", "Nurhaci formed the Manchu clans into a unified entity.", "By 1636, his son Hong Taiji began driving Ming forces out of Liaodong and declared a new dynasty, the Qing.", "In 1644, peasant rebels led by Li Zicheng conquered the Ming capital, Beijing.", "Rather than serve them, Ming general Wu Sangui made an alliance with the Manchus and opened the Shanhai Pass to the Banner Armies led by the regent Prince Dorgon, who defeated the rebels and seized the capital.", "Resistance from the Southern Ming and the Revolt of the Three Feudatories led by Wu Sangui delayed the Qing conquest of China proper by nearly four decades." ] ], "gold": "The Qing dynasty or the Qing Empire was the last dynasty in the imperial history of China. The Wuchang Uprising of 10 October 1911 was a success and by November, 14 of the 15 provinces had rejected Qing rule. This led to the creation of a new central government, the Republic of China, in Nanjing with Sun Yat-sen as its first provisional President. With permission from Empress Dowager Longyu, Yuan Shikai began negotiating with Sun Yat-sen, who decided that his goal had been achieved in forming a republic, and that therefore he could allow Yuan to step into the position of President of the Republic of China.", "prediction 1": "The Qing dynasty, officially the Great Qing, was the last imperial dynasty of China. It was established in 1636, and ruled China proper from 1644 to 1912. After the overthrow of the Qing dynasty, Sun Yat-sen became president of the Republic of China.", "prediction 2": "The Qing dynasty, officially the Great Qing, was the last imperial dynasty of China. It was established in 1636, and ruled China proper from 1644 to 1912. In 1912, Sun Yat-sen, who had negotiated for the republic's founding, allowed Yuan Shikai to step into the position of President of the Republic of China.", "prediction 3": "The Qing dynasty was the last imperial dynasty of China. It was established in 1636, and ruled China proper from 1644 to 1912. Sun Yat-sen became president of the Republic of China on 12 February 1912, after rounds of negotiations, Empress Dowager Longyu issued an imperial edict bringing about the abdication of the child emperor Puyi.", "prediction 4": "The Qing dynasty, officially the Great Qing, was the last imperial dynasty of China and ruled China proper from 1644 to 1912. Then, in 1912, Yuan Shikai took the position of President of the Republic of China. Yuan, who had been Prime Minister since the Qing dynasty's overthrow, was succeeded by Sun Yat-sen, who decided that his goal had been achieved in forming a republic, and therefore he could allow Yuan to step into the position of President of the Republic of China. In 1644, his son Hong Taiji took control of the Banner Armies led by the regent Prince Dorgon. Dorgon became regent of the regent Prince Dorgon, who defeated the rebels and seized the capital.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 44 }, { "error type": "Irrelevant", "explanation": "", "start": 78, "end": 154 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 196, "end": 207 }, { "error type": "Unverifiable", "explanation": "", "start": 155, "end": 195 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Qing dynasty was the last imperial dynasty of China. With permission from Empress Dowager Longyu, Yuan Shikai began negotiating with Sun Yat-sen, who decided that his goal had been achieved in forming a republic, and that therefore he could allow Yuan to step into the position of President of the Republic of China." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who narrated the original war of the worlds?", "passages": [ [ "The War of the Worlds (radio drama)", "The War of the Worlds (radio drama)\n\n\"The War of the Worlds\" is an episode of the American radio drama anthology series \"The Mercury Theatre on the Air\" directed and narrated by actor and future filmmaker Orson Welles as an adaptation of H. G. Wells' novel \"The War of the Worlds\" (1898).", "It was performed and broadcast live as a Halloween episode at 8 p.m. on Sunday, October 30, 1938 over the Columbia Broadcasting System radio network.", "The episode became famous for causing panic among its listening audience, but the scale of that panic is disputed, as the program had relatively few listeners.", "The one-hour program began with the theme music for the \"Mercury Theatre on the Air\" and an announcement that the evening's show was an adaption of \"The War of the Worlds\".", "This was followed by a prologue read by Orson Welles which was closely based on the opening of H.G. Wells' novel.", "The next half hour of the broadcast was presented as typical evening of radio programming which was interrupted by a series of news bulletins.", "The first few bulletins interrupt a program of dance music and describe a series of odd explosions observed on Mars.", "This is followed by a seemingly unrelated report of an unusual object falling on a farm in Grover's Mill, New Jersey." ], [ "The War of the Worlds (1953 film)", "The War of the Worlds (1953 film)\n\nThe War of the Worlds (also known in promotional material as H. G. Wells' The War of the Worlds) is a 1953 American Technicolor science fiction drama film from Paramount Pictures, produced by George Pal, directed by Byron Haskin, and starring Gene Barry and Ann Robinson.", "The film is a loose adaptation of the novel of the same name by H. G. Wells, the first of five film adaptations.", "It is a modern retelling of the 1897 novel, changing the setting from Victorian Era England to 1953 southern California.", "Earth is suddenly and unexpectedly invaded by Martians and American scientist Clayton Forrester searches for any weakness that can stop them.", "\"The War of the Worlds\" won an Academy Award for Best Visual Effects and went on to influence other science fiction films.", "In 2011, it was selected for preservation in the United States' National Film Registry in the Library of Congress, being deemed \"culturally, historically, or aesthetically significant\".", "In southern California, Dr. Clayton Forrester, a well-known atomic scientist, is fishing with colleagues when a large object crashes near the town of Linda Rosa.", "At the impact site, he meets Sylvia Van Buren and her uncle, Pastor Matthew Collins." ], [ "H. G. Wells' The War of the Worlds (Hines film)", "H. G. Wells' The War of the Worlds (Hines film)\n\nH. G. Wells' The War of the Worlds (a.k.a.", "The Classic War of the Worlds or just War of the Worlds) is the first of three reworked direct-to-video film versions, first appearing in 2005, that adapts H. G. Wells' novel of the same name about a Martian invasion of southern England.", "This version, noted for its faithfulness to Wells's novel, was produced by the independent film company Pendragon Pictures.", "Unlike the adaptations set in the current day United States, this was the first film set in the novel's original 1898 Victorian England.", "The early part of the film follows the experience of a late 19th-century journalist from Woking, known as \"the writer\", involved with the landing of a Martian invasion spacecraft.", "When the crashed cylinder opens, the Martians start killing anything that moves with a \"heat ray\" weapon.", "The writer discovers his house is in range of their heat ray and decides to rush his wife and servant to her cousins' home in Leatherhead; once there, he returns in order to return the borrowed cart to its owner, unaware that the invading Martians are now on the move." ] ], "gold": "\"The War of the Worlds\" is an episode of the American radio drama anthology series \"The Mercury Theatre on the Air\" directed and narrated by actor and future filmmaker Orson Welles as an adaptation of H. G. Wells's novel \"The War of the Worlds\". It was performed and broadcast live as a Halloween episode at 8 p.m. on Sunday, October 30, 1938, over the Columbia Broadcasting System radio network. A film adaptation of War of the Worlds was made in 1953, the first of five adaptations, which is narrated by Sir Cedric Hardwicke. It won an Academy Award for Best Visual Effects and went on to influence other science fiction films.", "prediction 1": "The original \"The War of the Worlds\" is an episode of the American radio drama anthology series \"The Mercury Theatre on the Air\" directed and narrated by Orson Welles as an adaptation of H. G. Wells' novel The War of the Worlds (1898). It was performed and broadcast live as a Halloween episode at 8 p.m. on Sunday, October 30, 1938 over the Columbia Broadcasting System radio network. The War of the Worlds is also known in promotional material as H. G. Wells' The War of the Worlds is a 1953 American Technicolor science fiction drama film from Paramount Pictures, produced by George Pal, directed by Byron Haskin, and starring Gene Barry and Ann Robinson.", "prediction 2": "The original War of the Worlds is an episode of the American radio drama anthology series \"The Mercury Theatre on the Air\" directed and narrated by actor and future filmmaker Orson Welles as an adaptation of H. G. Wells' novel \"The War of the Worlds\" (1898). It was performed and broadcast live as a Halloween episode at 8 p.m. on Sunday, October 30, 1938 over the Columbia Broadcasting System radio network. The War of the Worlds is also known in promotional material as H. G. Wells' The War of the Worlds, a 1953 American Technicolor science fiction drama film from Paramount Pictures, produced by George Pal, directed by Byron Haskin, and starring Gene Barry and Ann Robinson.", "prediction 3": "The original War of the Worlds is an episode of the American radio drama anthology series The Mercury Theatre on the Air, directed and narrated by actor and future filmmaker Orson Welles as an adaptation of H. G. Wells' novel The War of the Worlds (1898). The original War of the Worlds was narrated by actor and future filmmaker James Stewart, while the original War of the Worlds was narrated by actor Robert Carlyle. H. G. Wells' The War of the Worlds is a loose adaptation of his novel The War of the Worlds is a 1953 American Technicolor science fiction drama film, which is a modern retelling of the 1897 novel of the same name by H. G. Wells, the first of five film adaptations and went on to influence other science fiction films.", "prediction 4": "The original war of the worlds was narrated by Orson Welles in the 1938 Mercury Theatre on the Air episode directed by the same name. There was also a 1953 American Technicolor science fiction drama film produced by Paramount Pictures narrated by Byron Haskin. H. G. Wells' The War of the Worlds is the first of three reworked direct-to-video film versions, first appearing in 2005, that adapt H. G. Well's novel about a Martian invasion of southern England. H. G. Wells' The War of the Worlds is the first of five film adaptations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 454 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The original \"The War of the Worlds\" is an episode of the American radio drama anthology series \"The Mercury Theatre on the Air\" directed and narrated by Orson Welles as an adaptation of H. G. Wells' novel The War of the Worlds (1898). It was performed and broadcast live as a Halloween episode at 8 p.m. on Sunday, October 30, 1938 over the Columbia Broadcasting System radio network. Wells' The War of the Worlds is a 1953 American Technicolor science fiction drama film from Paramount Pictures, produced by George Pal, directed by Byron Haskin, and starring Gene Barry and Ann Robinson. \"The War of the Worlds\" won an Academy Award for Best Visual Effects and went on to influence other science fiction films." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who sang rewrite the stars in the greatest showman?", "passages": [ [ "Rewrite the Stars", "Rewrite the Stars\n\n\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the film \"The Greatest Showman\".", "It was released on November 17, 2017 by Atlantic Records as a promotional single from \"\".", "In Australia, \"Rewrite the Stars\" was released to radio on July 20, 2018.", "The song sees Efron's character Phillip Carlyle, serenading Zendaya's character Anne Wheeler and trying to convince her that they're meant to be together, despite their differences.", "According to sheet music published at Sheetmusicdirect.com, \"Rewrite the Stars\" is a moderately fast tempo of 125 beats per minute.", "Written in common time, the song is in the key of B major.", "Zac Efron's vocal range spans from E to B during the song, and Zendaya's vocal range spans from E to E.\n\nSam Damshenas from GayTimes called the song a \"stunning duet\" with perfectly fitting romance, and Michael Ordo\u00f1a from the LA Times called the song \"a standout duet\" and \"a signature karaoke duet\".", "However Emily Yoshida from Vulture described the song as a \"Jason Derulo castoff circa 2012.\"" ], [ "The Greatest Showman", "The Greatest Showman\n\nThe Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya.", "The film is inspired by the story of P. T. Barnum's creation of the Barnum & Bailey Circus and the lives of its star attractions.", "Principal photography began in New York City in November 2016.", "The film premiered on December 8, 2017, aboard the RMS \"Queen Mary 2\".", "It was released in the United States on December 20, 2017, by 20th Century Fox and grossed over $434million worldwide, making it the fifth-highest grossing live-action musical of all time.", "The film was released seven months after Ringling Bros. and Barnum & Bailey Circus's dissolution.", "\"The Greatest Showman\" received mixed reviews, with praise for the performances, music, and production values, but criticism for its artistic license, with some reviewers calling it \"faux-inspiring and shallow\".", "At the 75th Golden Globe Awards, the film received nominations for Best Motion Picture \u2013 Musical or Comedy and Best Actor \u2013 Musical or Comedy for Jackman." ] ], "gold": "\"Rewrite the Stars\", an original song from the 2017 musical drama film \"The Greatest Showman\", is performed by Zac Efron and Zendaya as Phillip Carlyle and Anne Wheeler respectively. Released on November 17, 2017 as a promotional single for the film's soundtrack, the duet sees Phillip serenading Anne and trying to convince her that they're meant to be together, despite their differences.", "prediction 1": "\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the film The Greatest Showman. It was released on November 17, 2017 by Atlantic Records as a promotional single from \"\". In Australia, \"Rewrite the Stars\" was released to radio on July 20, 2018.", "prediction 2": "\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the film \"The Greatest Showman.\" The song sees Efron's character Phillip Carlyle, serenading Zendaya's character Anne Wheeler and trying to convince her that they're meant to be together, despite their differences. Zac Efron's vocal range spans from E to B during the song, and Zendaya's vocal range spans from E to E to E to E to E to E to E to E to E.", "prediction 3": "\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the 2017 American musical film The Greatest Showman. It was released on November 17, 2017 by Atlantic Records as a promotional single from \"\". In Australia, \"Rewrite the Stars\" was released to radio on July 20, 2018.", "prediction 4": "\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the film The Greatest Showman. The song sees Efron's character Phillip Carlyle, serenading Zendaya's character Anne Wheeler and trying to convince her that they're meant to be together, despite their differences. Zac Efron's vocal range spans from E to B during the song, and Zendaya's vocal range spans from E to E.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 181, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 156 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Rewrite the Stars\" is a song performed by Zac Efron and Zendaya for the film The Greatest Showman. It was released on November 17, 2017 as a promotional single. The song sees Phillip serenading Anne and trying to convince her that they're meant to be together, despite their differences." }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "When did the movie country bears come out?", "passages": [ [ "The Country Bears", "The Country Bears\n\nThe Country Bears is a 2002 American family musical comedy film, directed by Peter Hastings, produced by Walt Disney Pictures, and based on the Disney theme park attraction \"Country Bear Jamboree\".", "The film stars Haley Joel Osment as the voice of Beary Barrington with supporting roles done by Christopher Walken, Stephen Tobolowsky, Daryl Mitchell, M.C. Gainey, Diedrich Bader, Alex Rocco, Meagen Fay, Eli Marienthal, and the voice talents of Diedrich Bader, Candy Ford, James Gammon, Brad Garrett, Toby Huss, Kevin Michael Richardson, and Stephen Root.", "It was Disney's second theatrical film based on an attraction at one of its theme parks and the third overall film based on an attraction following the television film \"Tower of Terror\" and the theatrically-released \"Mission to Mars\".", "Its world premiere was on July 21, 2002 at the El Capitan Theater in Hollywood, California.", "After that, it was released to theaters nationwide on July 26, 2002 and was a box office failure, grossing only $18 million of its $35 million budget.", "The Country Bears are an all-bear country rock band who have disbanded in 1991 after years of popularity." ] ], "gold": "The Country Bears is a 2002 American musical road comedy film produced by Walt Disney Pictures and based on the Disney theme park attraction Country Bear Jamboree. Its world premiere was on July 21, 2002 at the El Capitan Theatre in Hollywood, California. It was released to theatres nationwide on July 26, 2002 and was a box office bomb, grossing $18 million of is $35 million budget.", "prediction 1": "The 2002 American family musical comedy film, The Country Bears, is based on the Disney theme park attraction, \"Country Bear Jamboree\". It was directed by Peter Hastings, produced by Walt Disney Pictures, and premiered on July 21, 2002. It was released to theaters nationwide on July 26, 2002 and was a box office failure, grossing only $18 million of its $35 million budget.", "prediction 2": "The 2002 American family musical comedy movie \"The Country Bears\" came out in theaters on July 26, 2002. It was directed by Peter Hastings, produced by Walt Disney Pictures, and based on the Disney theme park attraction \"Country Bear Jamboree\". The film stars Haley Joel Osment as the voice of Beary Barrington with supporting roles done by Christopher Walken, Stephen Tobolowsky, Daryl Mitchell, M.C. Gainey, Diedrich Bader, Alex Rocco, Meagen Fay, Eli Marienthal, and the voice talents of Diedrich Bader, Candy Ford, Brad Garrett, Toby Huss, Kevin Michael Richardson, and Stephen Root.", "prediction 3": "The Country Bears is a 2002 American family musical comedy film, directed by Peter Hastings, produced by Walt Disney Pictures, and based on the Disney theme park attraction \"Country Bear Jamboree\". The world premiere was on July 21, 2002 at the El Capitan Theater in Hollywood, California. After that, it was released to theaters nationwide on July 26, 2002 and was a box office failure, grossing only $18 million of its $35 million budget.", "prediction 4": "The Country Bears is a 2002 American family musical comedy film, directed by Peter Hastings, produced by Walt Disney Pictures, and based on the Disney theme park attraction Country Bear Jamboree. The film's world premiere was on July 21, 2002 at the El Capitan Theater in Hollywood, California. After that, it was released to theaters nationwide on July 26, 2002 and was a box office failure, grossing only $18 million of its $35 million budget.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 170 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 2002 American family musical comedy film, The Country Bears, is based on the Disney theme park attraction, \"Country Bear Jamboree\". It was produced by Walt Disney Pictures, and premiered on July 21, 2002, at the El Capitan Theater in Hollywood, California. It was released to theaters nationwide on July 26, 2002 and was a box office failure, grossing only $18 million of its $35 million budget." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "When did the song american pie come out?", "passages": [ [ "American Pie (song)", "American singer Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film \"The Next Best Thing\" (2000), with the song being serviced to radio on February 2.", "Her cover is much shorter than the original (it contains only the beginning of the first verse and all of the second and sixth verses) and was recorded as a dance-pop song.", "It was co-produced by Madonna and William Orbit and released on the singer's Maverick label, after Rupert Everett (Madonna's co-star in \"The Next Best Thing\") had convinced her to cover the song for the film's soundtrack.", "It was latter added as a bonus track to her album, \"Music\".", "Released in March 2000, the song was a worldwide hit, reaching No. 1 in many countries, including the United Kingdom, Canada, Australia, Iceland, Italy, Germany (her first since \"La Isla Bonita\", in 1987), Switzerland, Austria, and Finland.", "The song was the 19th best selling of 2000 in the UK and the 9th best selling of 2000 in Italy.", "The single was not released commercially in the United States, but it reached No. 29 on the \"Billboard\" Hot 100 due to strong radio airplay." ], [ "American Pie (song)", "American Pie (song)\n\n\"American Pie\" is a song by American singer and songwriter Don McLean.", "Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand.", "In the UK, the single reached number 2, where it stayed for 3 weeks, on its original 1971 release while a reissue in 1991 reached No. 12.", "The song was listed as the No. 5 song on the RIAA project Songs of the Century.", "A truncated version of the song was covered by Madonna in 2000 and reached No. 1 in several countries, including the United Kingdom, Canada and Australia.", "McLean's combined version is the fourth longest song to enter the Billboard Hot 100, at the time of release it was the longest, in addition to being the longest song to reach number one.", "The repeatedly mentioned phrase \"the day the music died\" refers to the plane crash in 1959 which killed early rock and roll performers Buddy Holly, The Big Bopper, and Ritchie Valens.", "(The crash was not known by that name until after McLean's song became a hit.)", "The meaning of the other lyrics has long been debated, and for decades, McLean declined to explain the symbolism behind the many characters and events mentioned." ] ], "gold": "\"American Pie\" is a song by American singer and songwriter Don McLean. The single was was originally release in November 1971 and was the number-one US hit for four weeks in 1972 starting January 15. It was re-released in November 1991. Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film \"The Next Best Thing\". Her cover is much shorter and was recorded as a dance-pop song.", "prediction 1": "American Pie is a song by American singer and songwriter Don McLean. Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand. American singer Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film \"The Next Best Thing\", with the song being serviced to radio on February 2.", "prediction 2": "The song \"American Pie\" is a song by American singer and songwriter Don McLean. Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand. American singer Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film \"The Next Best Thing\". Her cover is much shorter than the original (it contains only the beginning of the first verse and all of the second and sixth verses) and was recorded as a dance-pop song.", "prediction 3": "\"American Pie\" is a song by American singer and songwriter Don McLean. Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand. American singer Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film, \"The Next Best Thing\". Her cover is much shorter than the original (it contains only the beginning of the first verse and all of the second and sixth verses) and was recorded as a dance-pop song.", "prediction 4": "\"American Pie\" is a song by American singer and songwriter Don McLean. Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand. American singer Madonna released a cover version of the song in March 2000, with the song being serviced to radio on February 2.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 442 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "American Pie is a song by American singer and songwriter Don McLean. Recorded and released on the \"American Pie\" album in 1971, the single was the number-one US hit for four weeks in 1972 and also topped the charts in Australia, Canada, and New Zealand. American singer Madonna released a cover version of the song in March 2000 to promote the soundtrack of her film \"The Next Best Thing\". Her cover is much shorter and was recorded as a dance-pop song." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Forms the bony structure of the nasal cavity?", "passages": [ [ "Human nose", "The two maxilla bones join at the base of the nose at the lower nasal midline between the nostrils, and at the top of the philtrum to form the anterior nasal spine.", "This thin projection of bone holds the cartilaginous center of the nose.", "The nasal cartilages are the septal, lateral, major alar, and minor alar cartilages.", "The septal nasal cartilage, extends from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly.", "It then passes along the floor of the nasal cavity.", "The septum is quadrangular; the upper half is atttached to the two lateral nasal cartilages which are fused to the dorsal septum in the midline, and laterally attached, with loose ligaments, to the bony margin of the anterior nasal aperture, while the inferior ends of the lateral cartilages are free (unattached); the minor alar cartilages are adjacent to the lateral cartilages in the fibroareolar connective tissue.", "Beneath the lateral cartilages lay the major alar cartilages, which swing outwards, from medial attachments, to the caudal septum in the midline (the medial crura) to an intermediate crus (shank) area." ], [ "Human nose", "Nasal vowels and nasal consonants are produced in the process of nasalisation.", "The nasal cavity is the third most effective vocal resonator.", "There are many plastic surgery procedures on the nose, known as rhinoplasties available to correct various structural defects or to change the shape of the nose.", "Defects may be congenital, result from nasal disorders or from trauma and these are carried out by reconstructive surgery.", "Procedures used to change a nose shape electively are carried out by cosmetic surgeries.", "Several bones and nasal cartilages make up the bony-cartilaginous framework of the nose, and the internal structure.", "The nose is also made up of types of soft tissue such as skin, epithelia, mucous membrane, muscles, nerves, and blood, and in the skin there are sebaceous glands.", "The framework of the nose is made up of bone and cartilage which provides strong protection for the internal structures of the nose.", "The arrangement of the cartilages allows flexibility through muscle control to enable airflow to be modified.", "The nasal part of the frontal bone ends in a serrated nasal notch that articulates at the front with the paired nasal bones, and at the sides with the small lacrimal bones and with the frontal process of each maxilla." ], [ "Nasal cavity", "The roof of each nasal cavity is formed in its upper third to one half by the nasal bone and more inferiorly by the junctions of the upper lateral cartilage and nasal septum.", "Connective tissue and skin cover the bony and cartilaginous components of the dorsum of the nose.", "The floor of the nasal cavities, which also form the roof of the mouth, is made up by the bones of the hard palate: the horizontal plate of the palatine bone posteriorly and the palatine process of the maxilla anteriorly.", "To the front of the nasal cavity is the nasal vestibule and external opening, while the back blends, via the choanae, into the nasopharynx.", "The nasal cavity is divided in two by a vertical fin called the nasal septum.", "On the sides of the nasal cavity are three horizontal outgrowths called nasal conchae (singular \"concha\") or turbinates.", "These turbinates disrupt the airflow, directing air toward the olfactory epithelium on the surface of the turbinates and the septum.", "The vomeronasal organ is located at the back of the septum and has a role in pheromone detection.", "The nasal cavity is divided into two segments: the respiratory segment and the olfactory segment.", "There is a rich blood supply to the nasal cavity." ] ], "gold": "Several bones make up the bony structure of the nasal cavity. The lateral wall of each nasal cavity mainly consists of the maxilla, the upper fixed bone of the jaw. However, there is a deficiency that is compensated for by the perpendicular plate of the palatine bone, the medial pterygoid plate, and the labyrinth of ethmoid. Additionally, the roof of each nasal cavity is formed in its upper third to one half by the nasal bones. The floor of the nasal cavities, which also forms the roof of the mouth, is made up by the bones of the hard palate, the palatine bone and the maxilla.", "prediction 1": "The nasal cavity is divided in two by a vertical fin called the nasal septum. The roof of each nasal cavity is formed in its upper third to one half by the nasal bone and more inferiorly by the junctions of the upper lateral cartilage and nasal septum. The nasal bones in the midline extend from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly. The septal nasal cartilage, extends from the nasal bones in the midline, to the bony margin of the anterior nasal aperture, and passes along the floor of the nasal cavity.", "prediction 2": "The roof of each nasal cavity is formed in its upper third to one half by the nasal bone and more inferiorly by the junctions of the upper lateral cartilage and nasal septum. The nasal cavity is divided in two by a vertical fin called the septum.", "prediction 3": "The nasal cavity is divided in two by a vertical fin called the nasal septum. The nasal septum is the cartilage structure located at the base of the nose, near the middle of the nose. The septal cartilage extends from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly. The nasal cartilages are the septal, lateral, major alar, and minor alar cartilages. The cartilages form the bony-cartilaginous framework of the nose, and the internal structure.", "prediction 4": "The bony structure of the nasal cavity is formed by the septum and cartilage. The septal nasal cartilage extends from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly. The septal nasal cartilage then passes along the floor of the nasal cavity. The roof of each nasal cavity is formed in its upper third to one half by the nasal bone. The junctions of the upper lateral cartilage and nasal septum form the bony structure of the nasal cavity.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 252 }, { "error type": "Redundant", "explanation": "The nasal bones in the midline ", "start": 284, "end": 327 }, { "error type": "Redundant", "explanation": "The nasal bones in the midline extend from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly. ", "start": 416, "end": 460 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The nasal cavity is divided in two by a vertical fin called the nasal septum. The roof of each nasal cavity is formed in its upper third to one half by the nasal bone. The septal nasal cartilage, extends from the nasal bones in the midline, to the bony part of the septum in the midline, posteriorly. The floor of the nasal cavities, which also form the roof of the mouth, is made up by the bones of the hard palate: the palatine bone and the maxilla." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When does jess come back in season 5 new girl?", "passages": [ [ "New Girl (season 5)", "New Girl (season 5)\n\nThe fifth season of the American comedy series \"New Girl\" premiered on January 5, 2016, on Fox in its new time slot of 8:00pm (Eastern).", "The show briefly aired back-to-back on April 19 before airing the final six episodes, beginning April 26, at 8:00 and 9:00 pm respectively.", "Developed by Elizabeth Meriwether under the working title \"Chicks & Dicks\", the series revolves around offbeat teacher Jess (Zooey Deschanel) after her moving into an LA loft with three men, Nick (Jake Johnson), Schmidt (Max Greenfield), and Winston (Lamorne Morris); Jess's best friend Cece (Hannah Simone) also appears regularly.", "The show combines comedy and drama elements as the characters, who are in their early thirties, deal with maturing relationships and career choices.", "On March 31, 2015, \"New Girl\" was renewed for a fifth season.", "The show remained in production after wrapping season four in order to get a jump on season 5 ahead of Deschanel's maternity leave.", "Deschanel was absent in 6 episodes of the fifth season.", "The onscreen reason for her absence being that her character was sequestered for jury duty.", "John Cho was the first guest announced after \"New Girl\" was renewed for season 5." ], [ "New Girl", "\"New Girl\" has received favorable responses from critics and was named one of the best new comedies of the 2011 fall season.", "The pilot episode drew 10.28 million U.S. viewers and a 4.8 adults 18\u201349 demo rating, making it the highest-rated fall debut for a Fox scripted show since 2001.", "Particular praise has been given to the performances of Deschanel, Greenfield, Johnson and Morris.", "Max Greenfield was considered the show's breakout star in season 1, before critics named Jake Johnson the breakout star of season 2.", "The show has been nominated for several awards, including five Golden Globe Awards and five Primetime Emmy Awards.", "On May 14, 2017, Fox renewed the series for a seventh and final season consisting of eight episodes, which premiered on April 10, 2018.", "The series finale was aired on May 15, 2018.", "Jessica \"Jess\" Day (Zooey Deschanel) is a bubbly teacher in her early 30s who comes home to find her boyfriend, Spencer, with another woman and leaves him immediately to look for elsewhere to live.", "Answering an ad for a new roommate on Craigslist, she moves into a loft in Los Angeles with three men around the same age as her: Nick, Schmidt, and Coach." ] ], "gold": "Zooey Deschanel, who portrays Jess on the series New Girl, was absent for 6 episodes of the fifth season because she was on maternity leave. The onscreen reason for her absence was that her character was sequestered for jury duty. Jess came back on episode 10 of the 5th season on an episode titled \"Goosebumps Walkaway,\" which aired on March 8, 2016.", "prediction 1": "Season 5 of the American comedy show New Girl first aired on January 5, 2016, on Fox in its new time slot of 8:00pm (Eastern). The show briefly aired back-to-back on April 19 before airing the final six episodes, beginning April 26, at 8:00 and 9:00 pm respectively.", "prediction 2": "Season 5 of the American comedy show New Girl premiered on January 5, 2016 at 9:00pm ET/PT. The show briefly aired back-to-back on April 19, before airing the final six episodes, beginning April 26, at 8:00 and 9:00 pm respectively.", "prediction 3": "In season 5 of the American comedy series New Girl, Jess comes back in the final six episodes. Season 5 premiered on January 5, 2016, on Fox in its new time slot of 8:00pm (Eastern). Season 5 episode 2 came back on April 19, 2016, while season 5 episode 3 came back on April 26, 2018.", "prediction 4": "The fifth season of the American comedy series New Girl premiered on January 5, 2016. The show briefly aired back-to-back on April 19 before airing the final six episodes, beginning April 26, at 8:00 and 9:00 pm respectively.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 126 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 266 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Zooey Deschanel, who portrays Jess on the series New Girl, was absent for 6 episodes of the fifth season because she was on maternity leave. The onscreen reason for her absence was that her character was sequestered for jury duty." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When was the first gold dollar coin made?", "passages": [ [ "Gold dollar", "Coin dealer and numismatic author Q. David Bowers notes that the head of Liberty on the Type 1 dollar is a scaled-down version of that on the double eagle, and \"a nicely preserved gold dollar is beautiful to behold\".", "Mint records indicate the first gold dollars were produced on May 7, 1849; Longacre's diary notes state instead that the first were struck on May 8.", "A few coins in proof condition were struck on the first day, along with about 1,000 for circulation.", "There are five major varieties of the 1849 gold dollar from Philadelphia, made as Longacre continued to fine-tune the design.", "Mintmarked dies were sent by Longacre's Engraving Department at the Philadelphia Mint to the branch mints at Charlotte, Dahlonega (in Georgia), and New Orleans; coins struck at the branches resemble some of the types issued from Philadelphia, depending on when the dies were produced.", "Of the coins struck at the branch mints in 1849, only pieces struck at Charlotte (1849-C) exist in multiple varieties; most are of what is dubbed the \"Closed Wreath\" variety.", "Approximately five of the 1849-C Open Wreath are known; one, believed the finest surviving specimen, sold at auction for $690,000 in 2004, remaining a record for the gold dollar series as of 2013." ], [ "Gold dollar", "The point was, he indicated, that the double eagle and gold dollar were wanted by the public, and, in the case of the gold dollar could help money circulate in small communities where banknotes were not accepted.", "Connecticut Representative John A. Rockwell, a Whig, tried to table the bill, but his motion was defeated.", "The bill passed easily, and met only minimal opposition in the Senate, becoming law on March 3, 1849.", "The officers at the Philadelphia Mint, including Chief Coiner Franklin Peale, were mostly the friends and relations of Director Patterson.", "The outsider in their midst was Chief Engraver James B. Longacre, successor to Gobrecht (who had died in 1844).", "A former copper-plate engraver, Longacre had been appointed through the political influence of South Carolina Senator John C. Calhoun.", "When Longacre began work on the two new coins in early 1849, he had no one to assist him.", "Longacre wrote the following year that he had been warned by a Mint employee that one of the officers (undoubtedly Peale) planned to undermine the chief engraver's position by having the work of preparing designs and dies done outside Mint premises.", "Accordingly, when the gold coin bill became law, Longacre apprised Patterson that he was ready to begin work on the gold dollar." ] ], "gold": "Mint records indicate the first gold dollars were produced on May 7, 1849. However, James B. Longacre, who was the Chief Engraver, kept diary notes that stated that the first gold dollars were struck on May 8, 1849. A few coins in proof condition were struck on the first day, along with about 1,000 for circulation.", "prediction 1": "The first gold dollar coin was produced on May 7, 1849; James Longacre's diary notes state instead that the first were struck on May 8. A few coins in proof condition were struck on the first day, along with about 1,000 for circulation. There are five major varieties of the 1849 gold dollar from Philadelphia, made as Longacre continued to fine-tune the design.", "prediction 2": "The first gold dollar coin was made on May 8, 1849. Mint records indicate the first gold dollars were produced on May 7, 1849; Longacre's diary notes state instead that the first were struck on May 8.", "prediction 3": "The first gold dollar coin was made in 1849. Mint records indicate the first gold dollars were produced on May 7, 1849. But James B. Longacre's diary notes state instead that the first were struck on May 8. A few coins in proof condition were struck on the first day, along with about 1,000 for circulation.", "prediction 4": "The first gold dollar coin was produced on May 7, 1849, according to Mint records. However, Chief Engraver James B. Longacre's diary notes state instead that the first were struck on May 8. A few coins in proof condition were struck on the first day, along with about 1,000 for circulation. There are five major varieties of the 1849 gold dollar from Philadelphia, made as Longacre continued to fine-tune the design.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 362 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Mint records indicate the first gold dollars were produced on May 7, 1849; James Longacre's diary notes state instead that the first were struck on May 8. A few coins in proof condition were struck on the first day, along with about 1,000 for circulation. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When is the next tomb raider movie coming out?", "passages": [ [ "Tomb Raider (film)", "The film received an IMAX 3D and a RealD 3D release.", "It also received an 4DX release in selected countries.", "Outside the US, the film was released in most territories between March 8\u201316, 2018, in Japan on March 21, 2018, and in Poland on April 6, 2018.", "\"Tomb Raider\" was released on digital streaming platforms on May 29, 2018.", "A 4K UHD Blu-Ray, Blu-ray and DVD release occurred on June 12, 2018.", "Australia received a DVD and Blu-Ray release on June 18, 2018.", "\"Tomb Raider\" grossed $57.4 million in the United States and Canada, and $216.1 million in other territories, for a worldwide total of $273.5 million, against a production budget in the range of $90\u2013106 million.", "In order to break even, the film needed to gross at least $275 million worldwide.", "In the United States and Canada, \"Tomb Raider\" was released alongside \"Love, Simon\" and \"I Can Only Imagine\", and was projected to gross $23\u201329 million from 3,854 theaters in its opening weekend.", "The film made $9.1 million on its first day (including $2.1 million from Thursday night previews)." ], [ "Tomb Raider (film)", "The film received mixed reviews from critics, with some describing the plot as \"paint-by-numbers\", and others praising the action sequences, tone, grittiness and realistic take on the franchise.", "Vikander's performance was highly praised but the characterization of Croft drew a polarized response; some described her as a \"capable, powerful, and unobjectified heroine\", while others called her bland, and a \"punching bag and onlooker.\"", "Following the disappearance of her father, Lord Richard Croft, Lara Croft makes a living as a bike courier.", "When she is arrested after a bike accident involving a police car, Richard's business partner Ana Miller posts her bail.", "After never claiming her inheritance for many years, believing her father to still be alive, Miller warns Lara that if she does not claim her vast inheritance, her father's country estate, Croft Manor, will be sold off.", "Lara reluctantly accepts and gains access to a secret chamber in her father's tomb.", "There she finds a pre-recorded video message from Richard detailing his research into Himiko, the mythical Queen of Yamatai who was said to command the power over life and death.", "Richard warns Lara to destroy all of his research, but she ignores his warnings so that she can investigate further." ], [ "Tomb Raider (film)", "Tomb Raider (film)\n\n", "Tomb Raider is a 2018 action-adventure film directed by Roar Uthaug, with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet.", "An American and British co", "-production, it is based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the \"Tomb Raider\" film series.", "The film stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of his disappearance.", "Dominic West, Walton Goggins, Daniel Wu, and Kristin Scott Thomas appear in supporting roles.", "Principal photography took place from January to June 2017 at the Warner Bros.", "Studios in the United Kingdom, and in Cape Town, South Africa.", "The first \"Tomb Raider\" film not to be distributed by Paramount Pictures, it was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures, in RealD 3D, IMAX 3D, IMAX and 4DX.", "The film grossed $273 million worldwide, just below the $274 million made by Angelina Jolie's but more than its ." ], [ "Tomb Raider (film)", "\"Deadline Hollywood\" had previously reported that Daisy Ridley was considered for the role, though she later stated in an interview that it was just a \"crazy rumor.\"", "Walton Goggins was announced to play the villain in December 2016, and much of the rest of the cast was revealed in early 2017.", "Principal photography on the film began on January 23, 2017, in Cape Town, South Africa, and ended on June 9, 2017, at Warner Bros. Studios, Leavesden.", "Wilton House near Salisbury in Wiltshire was the location for exterior shots for Croft Manor.", "The waterfall sequence involving the plane was filmed at a waterpark at Lee Valley, outside of London, at a venue that had been built for the 2012 Summer Olympics, and was combined with footage filmed in South Africa.", "On September 11, 2017, It was announced that Junkie XL signed on as the film's composer after being removed from Justice League.", "The soundtrack was released in digital and physical formats on March 9, 2018 by Sony Classical Records with the Vinyl being released later on August 24, 2018.", "\"Tomb Raider\" premiered on March 2, 2018, in Berlin, Germany, at an exclusive preview with invited guests and cosplaying fans.", "It was released in the United States on March 16, 2018, by Warner Bros. Pictures, days after the fifth anniversary of the franchise's video game reboot." ], [ "Dwayne Johnson", "The spin-off will be directed by David Leitch from a script written by franchise writer, Chris Morgan.", "The film has a scheduled release date of July 26, 2019 with principle photography beginning early September 2018.", "By January 2017, a film centered around Teth-Adam / Black Adam was announced to be in development.", "Originally cast in September 2014 as the antagonist in a film about the superhero Shazam, as a part of the DC Films shared universe, where he would also serve as producer; his villainous role for \"Shazam!\" was re-worked into two separate films.", "By July, Warner Bros. stated that Johnson will not appear in \"Shazam!\" but will remain attached as producer for the film.", "Johnson is noted for his work-load and for working on multiple projects at once.", "Following the critical and financial success of \"Jumanji\", a sequel was announced with a release date of December 25, 2019.", "Johnson will star in Universal Pictures' \"Red Notice\", written and directed by Rawson Marshall Thurber.", "It will be the third time the two collaborate, following \"Central Intelligence\" and \"Skyscraper\".", "Production on the films will begin early-2019, consecutively.", "Dwayne will reportedly also begin production on \"Black Adam\" later that same year." ] ], "gold": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug, with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet. Tomb Raider premiered on March 2, 2018, in Berlin, Germany, at an exclusive preview with invited guests and cosplaying fans. It was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures, in RealD 3D, IMAX 3D, IMAX, and 4DX. In September 2019, Ben Wheatley signed on to direct a sequel to the film, with a planned March 2021 release date, and filming was supposed to start early 2020 in England, but due to the COVID-19 pandemic, production has been delayed to a yet to be determined date and Misha Green has replaced Ben Wheatley.", "prediction 1": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug and an American and British co-production. It is based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the Tomb Raider film series. The film was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures. Outside the US, the film was released in most territories between March 8\u201316, 2018, in Japan on March 21, 2018, and in Poland on April 6, 2018.\n", "prediction 2": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug and written and produced by Suzanne D'Amato. It is based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the Tomb Raider franchise, produced by Naughty Dog Productions. The film was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures. The movie was released in most territories between March 8\u201316, 2018, in Japan, 2018, and in Poland on April 6, 2018. The sophomore film comes out in the Summer on July 1821, 2021 in van der Solo: The Tomb Raider: Legend of Tomb Raider:Under: Battle of the Soldier on May 22, 2021 for $14 and $10,000 for the C Corpse legends of Ernest Granion on June 20, 2021.", "prediction 3": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug, and an American and British co-production, based on the 2013 video game of the same name. It was released in the United States in March 2018, while it was released in the United Kingdom on March 14, 2018. Being the first Tomb Raider film not to be distributed by Paramount Pictures, it was released in the United States on March 16, 2018.", "prediction 4": "Tomb Raider is a 2018 action adventure film based on the 2013 video game of the same name. It was released in the United States on March 16, 2018, by Warner Bros. Pictures, in RealD 3D, IMAX 3D, IMAX and 4DX. The film was released in most territories between March 8\u201316, 2018, in Japan on March 21, 2018 and in Poland on April 6, 2018. The film was then released on digital streaming platforms on May 29, 2018. The film was then released on June 12, 2018 in Australia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 265 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet. \"Tomb Raider\" premiered on March 2, 2018, in Berlin, Germany, at an exclusive preview with invited guests and cosplaying fans. The film was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures, in RealD 3D, IMAX 3D, IMAX and 4DX. Outside the US, the film was released in most territories between March 8\u201316, 2018, in Japan on March 21, 2018, and in Poland on April 6, 2018. \"Tomb Raider\" was released on digital streaming platforms on May 29, 2018. A 4K UHD Blu-Ray, Blu-ray and DVD release occurred on June 12, 2018. Australia received a DVD and Blu-Ray release on June 18, 2018.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where did the first blood transfusion take place?", "passages": [ [ "Blood transfusion", "He was then \"requested by the Honorable [Robert] Boyle \u2026 to acquaint the Royal Society with the procedure for the whole experiment,\" which he did in December 1665 in the Society's \"Philosophical Transactions\".", "The first blood transfusion from animal to human was administered by Dr. Jean-Baptiste Denys, eminent physician to King Louis\u00a0XIV of France, on June\u00a015, 1667.", "He transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion.", "Denys performed another transfusion into a labourer, who also survived.", "Both instances were likely due to the small amount of blood that was actually transfused into these people.", "This allowed them to withstand the allergic reaction.", "Denys' third patient to undergo a blood transfusion was Swedish Baron Gustaf Bonde.", "He received two transfusions.", "After the second transfusion Bonde died.", "In the winter of 1667, Denys performed several transfusions on Antoine Mauroy with calf's blood.", "On the third account Mauroy died." ], [ "Blood transfusion", "Six months later in London, Lower performed the first human transfusion of animal blood in Britain, where he \"superintended the introduction in [a patient's] arm at various times of some ounces of sheep's blood at a meeting of the Royal Society, and without any inconvenience to him.\"", "The recipient was Arthur Coga, \"the subject of a harmless form of insanity.\"", "Sheep's blood was used because of speculation about the value of blood exchange between species; it had been suggested that blood from a gentle lamb might quiet the tempestuous spirit of an agitated person and that the shy might be made outgoing by blood from more sociable creatures.", "Coga received 20 shillings () to participate in the experiment.", "Lower went on to pioneer new devices for the precise control of blood flow and the transfusion of blood; his designs were substantially the same as modern syringes and catheters.", "Shortly after, Lower moved to London, where his growing practice soon led him to abandon research.", "These early experiments with animal blood provoked a heated controversy in Britain and France.", "Finally, in 1668, the Royal Society and the French government both banned the procedure.", "The Vatican condemned these experiments in 1670.", "Blood transfusions fell into obscurity for the next 150 years." ], [ "Blood transfusion", "The science of blood transfusion dates to the first decade of the 20th century, with the discovery of distinct blood types leading to the practice of mixing some blood from the donor and the receiver before the transfusion (an early form of cross-matching).", "In the early 19th century, British obstetrician Dr. James Blundell made efforts to treat hemorrhage by transfusion of human blood using a syringe.", "In 1818 following experiments with animals, he performed the first successful transfusion of human blood to treat postpartum hemorrhage.", "Blundell used the patient's husband as a donor, and extracted four ounces of blood from his arm to transfuse into his wife.", "During the years 1825 and 1830, Blundell performed 10 transfusions, five of which were beneficial, and published his results.", "He also invented a number of instruments for the transfusion of blood.", "He made a substantial amount of money from this endeavour, roughly $2 million ($50 million real dollars).", "In 1840, at St George's Hospital Medical School in London, Samuel Armstrong Lane, aided by Dr. Blundell, performed the first successful whole blood transfusion to treat haemophilia.", "However, early transfusions were risky and many resulted in the death of the patient." ] ], "gold": "The first animal-to-human blood transfusion took place in France on June 15, 1667. Dr. Jean-Baptiste Denys transfused sheep's blood into a 15-year-old boy, who survived, likely due to the small amount of blood that was actually transfused. The first human-to-human blood transfusion took place in Britain in 1818, when Dr. James Blundell used a patient's husband as a donor and extracted four ounces of blood from his arm to transfuse into his wife. In 1840, at St George's Hospital Medical School, London, Samuel Armstrong Lane, aided by Dr. Blundell, performed the first successful whole blood transfusion to treat haemophilia.", "prediction 1": "The first blood transfusion from animal to human was administered by Jean-Baptiste Denys on June 15, 1667. He transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion. Six months later in London, James Lower performed the first human transfusion of animal blood in Britain, where he \"superintended the introduction in [a patient's] arm at various times of some ounces of sheep's blood at a meeting of the Royal Society, and without any inconvenience to him.\" The recipient was Arthur Coga, who survived the transfusion.", "prediction 2": "The first human blood transfusion of animal blood was performed in London in 1667 by Dr. Jean-Baptiste Denys, an eminent physician to King Louis XIV of France. He transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion. Six months later in London, Dr. Thomas Lower performed the first human blood transfusion of animal blood in Britain, where he \"superintended the introduction in [a patient's] arm at various times of some ounces of sheep's blood at a meeting of the Royal Society, and without any inconvenience to him.\" The recipient was Arthur Coga, the subject of a harmless form of insanity.", "prediction 3": "The first blood transfusion from animal to human was administered by Dr. Jean-Baptiste Denys, eminent physician to King Louis XIV of France, on June 15, 1667. He transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion. Six months later in London, Dr. John Lower performed the first human transfusion of animal blood in Britain, where he \"superintended the introduction in [a patient's] arm at various times of some ounces of sheep's blood at a meeting of the Royal Society, and without any inconvenience to him.\" The recipient was Arthur Coga, \"the subject of a harmless form of insanity.\"", "prediction 4": "The first human blood transfusion of animal blood was performed on June 15, 1667, by Dr. Jean-Baptiste Denys, eminent physician to King Louis XIV of France. Denys transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion. Six months later, Dr. John Lower performed the first human blood transfusion of animal blood in Britain, where he superintended the introduction in [a patient's] arm at various times of some ounces of sheep's blood at a meeting of the Royal Society, and without any inconvenience to him. The recipient was Arthur Coga, \"the subject of a harmless form of insanity.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 486 }, { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 547 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The first blood transfusion from animal to human was administered by Jean-Baptiste Denys on June 15, 1667. He transfused the blood of a sheep into a 15-year-old boy, who survived the transfusion. It likely was due to the small amount of blood that was actually transfused in. British obstetrician Dr. James Blundell performed the first successful transfusion of human blood to another human when he used the patient's husband as a donor, and extracted four ounces of blood from his arm to transfuse into his wife. In 1840, at St George's Hospital Medical School in London, Samuel Armstrong Lane, aided by Dr. Blundell, performed the first successful whole blood transfusion to treat haemophilia." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "How many seats are reserved for representatives of sc and st in lok sabha?", "passages": [ [ "Lok Sabha", "Lok Sabha\n\nThe Lok Sabha (House of the People) is the lower house of India's bicameral Parliament, with the upper house being the Rajya Sabha.", "Members of the Lok Sabha are elected by adult universal suffrage and a first-past-the-post system to represent their respective constituencies, and they hold their seats for five years or until the body is dissolved by the President on the advice of the council of ministers.", "The house meets in the Lok Sabha Chambers of the Sansad Bhavan in New Delhi.", "The maximum strength of the House allotted by the Constitution of India is 552.", "Currently the house has 545 seats which is made up by election of up to 543 elected members and at a maximum, 2 nominated members of the Anglo-Indian Community by the President of India.", "A total of 131 seats (24.03%) are reserved for representatives of Scheduled Castes (84) and Scheduled Tribes (47).", "The quorum for the House is 10% of the total membership.", "The Lok Sabha, unless sooner dissolved, continues to operate for five years from the date appointed for its first meeting.", "However, while a proclamation of emergency is in operation, this period may be extended by Parliament by law." ] ], "gold": "A total of 131 Lok Sabha seats are reserved for representatives for Scheduled Castes, with 84 seats, and Scheduled Tribes, with 47 seats. Together, these groups make up about 24% of the Lok Sabha.", "prediction 1": "A total of 131 seats are reserved for representatives of Scheduled Castes and Scheduled Tribes. However, in the Rajya Sabha, a higher house of the Indian bicameral Parliament, 131 seats are reserved for representatives of Scheduled Tribes.", "prediction 2": "A total of 131 seats are reserved for representatives of Scheduled Castes (84) and Scheduled Tribes (47).", "prediction 3": "The Lok Sabha is the lower house of India's bicameral Parliament. A total of 131 seats are reserved for representatives of Scheduled Castes and Scheduled Tribes.", "prediction 4": "In Lok Sabha, the lower house of India's bicameral Parliament, a total of 131 seats are reserved for representatives of Scheduled Castes and Scheduled Tribes.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "A total of 131 seats are reserved for representatives of Scheduled Castes and Scheduled Tribes. ", "start": 96, "end": 239 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "A total of 131 seats are reserved for representatives of Scheduled Castes (84 seats) and Scheduled Tribes (47 seats). Together, these groups make up about 24% of the Lok Sabha." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Who won the second game of the stanley cup finals?", "passages": [ [ "2017 Stanley Cup Finals", "2017 Stanley Cup Finals\n\nThe 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs.", "The Eastern Conference champion and defending Stanley Cup champion Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two.", "Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs for the second consecutive year.", "The Penguins won the Stanley Cup in their opponent's rink, just like they did the previous four times.", "During the regular season, the Penguins finished second in the league with 111 points, which gave them home ice advantage in the series.", "The series began on May 29 and concluded on June 11.", "The Penguins made their second consecutive Finals appearance, marking the third time in their history they had done this, following their appearances in \u2013 and \u2013.", "This was the first time since 2009, a rematch between the Penguins and Detroit Red Wings, that any team appeared in consecutive Finals.", "The Penguins also became the first team since the Red Wings (in and ) to win the Stanley Cup in consecutive years.", "This marked the second consecutive season in which a Western Conference team made their first appearance in the Finals; the San Jose Sharks made their Finals debut the year prior." ], [ "2016 Stanley Cup Finals", "2016 Stanley Cup Finals\n\nThe 2016 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2015\u201316 season, and the culmination of the 2016 Stanley Cup playoffs.", "The Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history (winning the clinching game of all four on the road).", "Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs.", "The Penguins finished ahead of the Sharks during the regular season, giving them home ice advantage in the series.", "The series began on May 30 and concluded on June 12.", "This was the first Stanley Cup Finals since 2007 to feature a team making their Finals debut.", "This was the first playoff meeting between teams from Pittsburgh and the Bay Area since the Penguins swept the Oakland Seals in the 1970 Stanley Cup Quarterfinals.", "The Eastern Conference had home-ice advantage in consecutive seasons for the first time since the 2004 and 2006 Finals.", "For the first time since 2011, neither the Chicago Blackhawks nor the Los Angeles Kings won the Stanley Cup.", "This was Pittsburgh's fifth Finals appearance, and first since winning the Cup in .", "The Penguins had made the playoffs every year since their win in 2009, but hadn't won a single game in the conference finals in that span." ], [ "2015 Stanley Cup Finals", "2015 Stanley Cup Finals\n\nThe 2015 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) season, and the culmination of the 2015 Stanley Cup playoffs.", "The Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history, and their third title in six seasons.", "The Lightning, as the club with the better regular-season record, held home-ice advantage in the series.", "The best-of-seven series was played in a 2\u20132\u20131\u20131\u20131 format, with Tampa Bay hosting games one, two, five, and seven (if necessary); and Chicago hosting games three, four and six.", "The series started June 3 and ended on June 15.", "Tyler Johnson and Patrick Kane led the Stanley Cup playoffs in points scored with 23 points each.", "This was Tampa Bay's second Finals appearance after winning the Cup in .", "Since their win in 2004, the Lightning had lost in the Conference Finals in 2011 in seven games to the Boston Bruins.", "The Lightning were eliminated in the first round in 2006, 2007, and 2014.", "The Lightning entered the 2014\u201315 season with major re-signings during the offseason including centre Tyler Johnson, wingers Ryan Callahan and Ondrej Palat, and goalie Ben Bishop." ] ], "gold": "In the 2015 Stanley Cup Finals, Tampa Bay Lightning won the second game, but The Western Conference champion Chicago Blackhawks inevitably won championship, which was their sixth championship in franchise history, and their third title in six seasons. In the 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins won the second game, and went on to defeat the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history. In the 2017 Stanley Cup Finals, the Eastern Conference champion and defending Stanley Cup champion Pittsburgh Penguins won the second game, and then defeated the Western Conference champion Nashville Predators, four games to two. Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs for the second consecutive year.", "prediction 1": "In the 2015 and 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks to win their fourth championship in franchise history. In the 2015 and 2016 Stanley Cup Finals, the Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history and their third title in six seasons. In the 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two.", "prediction 2": "The 2016 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2015\u201316 season, and the culmination of the 2016 Stanley Cup playoffs. The Eastern Conference champion and defending Stanley Cup champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history. The 2015 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2015\u201316 season, and the culmination of the 2015 Stanley Cup playoffs. The winner of the second game of the Stanley Cup Finals was scored the game on the road.", "prediction 3": "The 2015 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) season, and the culmination of the 2015 Stanley Cup playoffs. In the 2015 Stanley Cup Finals, the Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history, and their third title in six seasons. In the 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history.", "prediction 4": "The 2016 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2015\u201316 season, and the culmination of the 2015 Stanley Cup playoffs. The Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history. The Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history, and their third title in six seasons.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 7, "end": 11 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 217, "end": 225 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,2]}", "start": 474, "end": 478 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks to win their fourth championship in franchise history. In the 2015Stanley Cup Finals, the Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history and their third title in six seasons. In the 2017 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two. Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs for the second consecutive year." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sang don't you want someone to love?", "passages": [ [ "Somebody to Love (Jefferson Airplane song)", "/ ...\"", "Like the album on which it appeared, this song was instrumental in publicizing the existence of the Haight-Ashbury counterculture to the rest of the United States.", "A cover of \"Somebody to Love\" was the debut single of German electronic music duo Boogie Pimps.", "It was released on January 11, 2004 and reached number three on the UK Singles Chart and number seven on the Irish Singles Chart.", "The song also became a top-twenty hit in Australia, Denmark, Finland, Germany, and the Netherlands.", "In most of these territories, this was their only hit single, as the follow-up single \"Sunny\" failed to chart." ], [ "Somebody to Love (Jefferson Airplane song)", "Somebody to Love (Jefferson Airplane song)\n\n\"Somebody to Love\" (originally titled \"Someone to Love\") is a rock song that was written by Darby Slick.", "It was originally recorded by The Great Society, and later by Jefferson Airplane.", "\"Rolling Stone\" magazine ranked Jefferson Airplane's version No. 274 on their list of the 500 Greatest Songs of All Time.", "Written by The Great Society guitarist Darby Slick after realizing his girlfriend had left him, and first performed by that band, which included his then-sister-in-law Grace Slick on vocals, the song made little impact outside of the club circuit in the Bay Area.", "The song was released in 1966 as a single with the B-side another Darby Slick composition titled \"Free Advice\" on the North Beach subsidiary of Autumn Records, and received minimal circulation outside of San Francisco.", "San Francisco in the mid-'60s was the center of free love, but Darby Slick saw a downside to this ethos, as it could lead to jealousy and disconnect.", "This song champions loyalty and monogamy, as the singer implores us to find that one true love that will nurture us and get us through the tough times." ] ], "gold": "\"Somebody to Love\" (originally titled \"Someone to Love\") is a rock song that was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. A cover of \"Somebody to Love\" was the debut single of German electronic music duo Boogie Pimps. It was released on January 11, 2004 and reached number three on the UK Singles Chart and number seven on the Irish Singles Chart.", "prediction 1": "\"Somebody to Love\" was originally titled \"Someone to Love\", and was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. A cover of \"Somebody to Love\" was the debut single of German electronic music duo Boogie Pimps. It was released on January 11, 2004 and reached number three on the UK Singles Chart and number seven on the Irish Singles Chart. \"Rolling Stone\" magazine ranked Jefferson Airplane's version No. 274 on their list of the 500 Greatest Songs of All Time.", "prediction 2": "\"Somebody to Love\" is a rock song that was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. German electronic music duo Boogie Pimps sang a cover of \"Somebody to Love\".", "prediction 3": "The rock song \"Somebody to Love\" is a song that was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. \"Rolling Stone\" magazine ranked Jefferson Airplane's version No. 274 on their list of the 500 Greatest Songs of All Time.", "prediction 4": "\"Somebody to Love\" is a rock song that was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. Another cover of \"Somebody to Love\" was the debut single of German electronic music duo Boogie Pimps. The cover was released on January 11, 2004 and reached number three on the UK Singles Chart and number seven on the Irish Singles Chart. Rolling Stone ranked Jefferson Airplane's version No. 274 on their list of the 500 Greatest Songs of All Time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 521 } ], "missing-info": [], "corrected-prediction": "\"Somebody to Love\" was originally titled \"Someone to Love\", and was written by Darby Slick. It was originally recorded by The Great Society, and later by Jefferson Airplane. A cover of \"Somebody to Love\" was the debut single of German electronic music duo Boogie Pimps. It was released on January 11, 2004 and reached number three on the UK Singles Chart and number seven on the Irish Singles Chart. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where will the next world cup be held?", "passages": [ [ "2022 FIFA World Cup", "2022 FIFA World Cup\n\nThe 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA.", "It is scheduled to take place in Qatar in 2022.", "This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country.", "This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan (the 2018 competition in Russia featured one geographically Asian venue, Yekaterinburg).", "In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament.", "The reigning World Cup champions are France.", "This will also mark the first World Cup not to be held in May, June, or July; the tournament is instead scheduled for late November until mid-December.", "It is to be played in a reduced timeframe of around 28 days, with the final being held on 18 December 2022, which is also Qatar National Day.", "Accusations of corruption have been made relating to how Qatar won the right to host the event." ], [ "2026 FIFA World Cup", "However, the FIFA Council did make an exception to potentially grant eligibility to member associations of the confederation of the second-to-last host of the FIFA World Cup in the event that none of the received bids fulfill the strict technical and financial requirements.", "In March 2017, FIFA president Gianni Infantino confirmed that \"Europe (UEFA) and Asia (AFC) are excluded from the bidding following the selection of Russia and Qatar in 2018 and 2022 respectively.\"", "Therefore, the 2026 World Cup could be hosted by one of the remaining four confederations: CONCACAF (North America; last hosted in 1994), CAF (Africa; last hosted in 2010), CONMEBOL (South America; last hosted in 2014), or OFC (Oceania, never hosted before), or potentially by UEFA in case no bid from those four met the requirements.", "Co-hosting the FIFA World Cup\u2014which had been banned by FIFA after the 2002 World Cup\u2014was approved for the 2026 World Cup, though not limited to a specific number but instead evaluated on a case-by-case basis.", "Also by 2026, the FIFA general secretariat, after consultation with the Competitions Committee, will have the power to exclude bidders who do not meet the minimum technical requirements to host the competition." ] ], "gold": "The 2022 FIFA World Cup will be held in Qatar. This will mark the first World Cup not held in May, June, or July; the tournament is instead scheduled for late November until mid-December. The 2026 FIFA World Cup will be held in Canada, Mexico, and the United States. Co-hosting the FIFA World Cup\u2014which had been banned by FIFA after the 2002 World Cup\u2014was approved for the 2026 World Cup, though not limited to a specific number but instead evaluated on a case-by-case basis. ", "prediction 1": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The tournament is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 2": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 3": "The 2022 FIFA World Cup is scheduled to take place in Qatar in 2022 and will be the 22nd edition of the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 4": "The 2022 FIFA World Cup is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan. In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament. The 2026 World Cup could be hosted by one of the remaining four confederations: CONCACAF (North America; last hosted in 1994), CAF (Africa; last hosted in 2010), CONMEBOL (South America); last hosted in 2014).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 504 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 2022 FIFA World Cup is scheduled to take place in Qatar in 2022. This will also mark the first World Cup not to be held in May, June, or July; the tournament is instead scheduled for late November until mid-December. Co-hosting the FIFA World Cup\u2014which had been banned by FIFA after the 2002 World Cup\u2014was approved for the 2026 World Cup, though not limited to a specific number but instead evaluated on a case-by-case basis." }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "Who was the first president born in the united states of america?", "passages": [ [ "Martin Van Buren", "Martin Van Buren\n\nMartin Van Buren (; born Maarten Van Buren, December 5, 1782 \u2013 July 24, 1862)", "was the eighth President of the United States from 1837 to 1841.", "A founder of the Democratic Party, he previously served as the ninth Governor of New York, the tenth U.S. Secretary of State, and the eighth Vice President of the United States.", "He won the 1836 presidential election with the endorsement of popular outgoing President Andrew Jackson and the organizational strength of the Democratic Party.", "He lost his 1840 reelection bid to Whig Party nominee William Henry Harrison, due in part to the poor economic conditions of the Panic of 1837.", "Later in his life, Van Buren emerged as an elder statesman and important anti-slavery leader, who led the Free Soil Party ticket in the 1848 presidential election.", "Van Buren was born in Kinderhook, New York to a family of Dutch Americans; his father was a Patriot during the American Revolution.", "He was raised speaking Dutch and learned English at school, making him the only U.S. President who spoke English as a second language.", "He trained as a lawyer and quickly became involved in politics as a member of the Democratic-Republican Party.", "He won election to the New York State Senate and became the leader of the Bucktails, the faction of Democratic-Republicans opposed to Governor DeWitt Clinton." ], [ "Presidents of the United States on U.S. postage stamps", "John Quincy Adams (July 11, 1767 \u2013 February 23, 1848) was the sixth President of the United States from March 4, 1825, to March 4, 1829.", "He has appeared on the following two U.S. postage stamps:\nAndrew Jackson, seventh President of the United States, served from 1829\u20131837.", "He was the commander of the American forces at the Battle of New Orleans in 1815.", "Jackson died in 1845, and the Post Office first released a stamp in his honor 18 years after his death, with the issue of 1863 (displayed in First appearances) above).", "At that time, as aforesaid, he had already appeared on two different Confederate 2\u00a2 stamps.", "Andrew Jackson appears on the following commemorative issues:\n\nMartin Van Buren (December 5, 1782 \u2013 July 24, 1862) was the eighth President of the United States from 1837 to 1841.", "Before his presidency, he served as the eighth Vice President (1833\u20131837) and the 10th Secretary of State under Andrew Jackson.", "Van Buren was the first U.S. President to be born an American citizen.", "William Henry Harrison (February 9, 1773 \u2013 April 4, 1841) was the ninth President of the United States, and served in the U.S. Army as an officer.", "A hero in the War of 1812, he was the first president to die in office." ], [ "Presidency of George Washington", "Presidency of George Washington\n\nThe presidency of George Washington began on April 30, 1789, when Washington was inaugurated as the first President of the United States, and ended on March 4, 1797.", "Washington took office after the 1788\u201389 presidential election, the nation's first quadrennial presidential election, in which he was elected unanimously.", "Washington was re-elected unanimously in the 1792 presidential election, and chose to retire after two terms.", "He was succeeded by his vice president, John Adams of the Federalist Party.", "Washington had established his preeminence among the new nation's Founding Fathers through his service as Commander-in-Chief of the Continental Army during the American Revolutionary War and as President of the 1787 Constitutional Convention.", "Once the Constitution was approved, it was widely expected that Washington would become the first President of the United States, despite his own desire to retire from public life.", "In his first inaugural address, Washington expressed both his reluctance to accept the presidency and his inexperience with the duties of civil administration, but he proved an able leader.", "Washington presided over the establishment of the new federal governmentappointing all of the high-ranking officials in the executive and judicial branches, shaping numerous political practices, and establishing the site of the permanent capital of the United States." ] ], "gold": "The first president of the United States, George Washington, was born in the US before the nation declared its independence. Because the US was ruled by Britain at the time of his birth, George Washington was born a British subject. Martin Van Buren was the first president of the United States who was born in the United States after the United States declared its independence, which makes him the first US president who was born an American citizen.", "prediction 1": "The presidency of George Washington began on April 30, 1789, when Washington was inaugurated as the first President of the United States, and ended on March 4, 1797. George Washington was the first American president born in the United States and was re-elected in 1792. Martin Van Buren, the eighth president of the United States from 1837 to 1841 was the first American president born in the United States. John Quincy Adams was the first American president born in the United States. William Henry Harrison was the first American president born in the United States. The first American born in the United States.", "prediction 2": "The first president born in the United States was Martin Van Buren. He was the first American President born in the United States. The first US President born in the United States was George Washington. The first US President born in the United States was George Washington. The first US President born in the United States was John Quincy Adams.", "prediction 3": "The first American President born in the United States was Martin Van Buren. The first American President born in the United States was George Washington.", "prediction 4": "The first US president to be born in the United States of America was Martin Van Buren, who was the eighth President of the United States from 1837 to 1841. The first US president to be born in the United States was George Washington, who was inaugurated as the first President of the United States on April 30, 1789.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The presidency of George Washington began on April 30, 1789, when Washington was inaugurated as the first President of the United States, and ended on March 4, 1797. George Washington was the first American president born in the United States ", "start": 409, "end": 486 }, { "error type": "Redundant", "explanation": "The presidency of George Washington began on April 30, 1789, when Washington was inaugurated as the first President of the United States, and ended on March 4, 1797. George Washington was the first American president born in the United States ", "start": 487, "end": 569 }, { "error type": "Redundant", "explanation": "The presidency of George Washington began on April 30, 1789, when Washington was inaugurated as the first President of the United States, and ended on March 4, 1797. George Washington was the first American president born in the United States ", "start": 570, "end": 615 }, { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 60 }, { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 270 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 217, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 348 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The presidency of George Washington began, when Washington was inaugurated as the first President of the United States. George Washington was the first American president born during the Revolutionary War. Martin Van Buren was the first American president born in the United States as an American citizen." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who did the music for wonder woman movie?", "passages": [ [ "Wonder Woman (2017 film)", "On November 3, 2016, Rupert Gregson-Williams was hired to write and compose the film's music.", "He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music.", "The soundtrack was released on CD, digital, and vinyl the same day as the film.", "Australian musician Sia sang a song for the film, titled \"To Be Human\", featuring English musician Labrinth.", "Written by Florence Welch and Rick Nowels, the track is also featured on the soundtrack.", "The soundtrack also features samples from Wonder Woman's theme \"Is She with You\" from the \"\" soundtrack composed by Hans Zimmer and Junkie XL." ], [ "Christopher Drake", "Christopher Drake\n\nChristopher Drake is an American film, television and videogames composer.", "Drake was selected by director Guillermo del Toro to provide the music for the first two 75-minute animated movies, \"\" and \"\" released by Starz Media in 2006 and 2007.", "Drake also collaborated with del Toro in rescoring one of his early films \"Geometr\u00eda\", included in the Criterion edition of del Toro's \"Cronos\".", "In 2008 Drake joined composers Robert J. Kral and Kevin Manthei in writing music for Warner Bros. \"\" (2008).", "Following \"Gotham Knight\", Drake scored the fourth in the line of DC Universe Animated Original Movies, \"Wonder Woman\" (2009).", "Drake wrote the scores for the animated films \"\" (2009), \"\" (2010), \"\" (2010), \"All-Star Superman\" (2011), \"\" (2011), \"\" (2011), \"\" (2012), and \"\" (2012).", "Drake is also known for his work in video games, such as \"\" (2008) \"\" (2013), \"\" (2013), and \"Injustice 2\" (2017).", "In 2017 Drake was hired as the composer for Netflix's remake of the \"Lostin Space\" series, due to drop in May 2018, but later replaced by Christopher Lennertz." ], [ "Rupert Gregson-Williams", "Rupert Gregson-Williams\n\nRupert Gregson-Williams (born October 12, 1966) is a British composer of motion picture and television scores.", "Educated at St John's College, Cambridge, choir school and Lancing College, he is the younger brother of film composer Harry Gregson-Williams and he is a member of Hans Zimmer's Remote Control Productions team of composers.", "His filmography includes \"Hotel Rwanda\", for which he was awarded the European Film composer award, \"Hacksaw Ridge\", \"Wonder Woman\", \"Over the Hedge\", \"Bee Movie\", \"Zookeeper\", \"Made of Honor\", \"Bedtime Stories\", and numerous films by Happy Madison Productions, many of which star Adam Sandler.", "His most notable works in television include \"Veep\" and \"The Crown\".", "He has received a nomination for a Primetime Emmy Award and a recipient of a BMI Award and a European Film Award." ] ], "gold": "There are several Wonder Woman movies. British composer Rupert Gregson-Williams did the music in the 2017 Wonder Woman movie, while American film, television, and video game composer Christopher Drake did the music in the 2009 Wonder Woman movie. Artie Butler did the music in the 1974 Wonder Woman movie.", "prediction 1": "On November 3, 2016, Rupert Gregson-Williams was hired to write and compose the film's music. He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music. The soundtrack was released on CD, digital, and vinyl the same day as the film. American film, television, videogames composer Christopher Drake provided the music for the Wonder Woman movie.", "prediction 2": "On November 3, 2016, Rupert Gregson-Williams was hired to write and compose the movie's music. He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music. American composer Christopher Drake scored the music for the 2017 Wonder Woman film. He was also the composer of the music for the 2016 Wonder Woman movie.", "prediction 3": "On November 3, 2016, Rupert Gregson-Williams was hired to write and compose the film's music. He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music. The soundtrack was released on CD, digital, and vinyl the same day as the film. American composer Christopher Drake also wrote the music for the animated films Wonder Woman (2009), Wonder Woman: Dawn of Justice (2017), and Wonder Woman: Reborn (2017).", "prediction 4": "On November 3, 2016, Rupert Gregson-Williams was hired to write and compose the film's music. He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music. The soundtrack was released on CD, digital, and vinyl the same day as the film. American film, television and videogames composer Christopher Drake scored the music for DC Universe: Wonder Woman, the fifth DC Universe animated original movie.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 20 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 280 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Rupert Gregson-Williams was hired to write and compose the film's music. He was joined by Evan Jolly, Tom Howe, Paul Mounsey, and Andrew Kawczynski, who provided additional music. American film, television, videogames composer Christopher Drake provided the music for the 2009 Wonder Woman movie." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who made the samurai sword in kill bill?", "passages": [ [ "Kill Bill: Volume 1", "Resolving to kill Bill and all four members of the Deadly Viper Assassination Squad, she picks her first target: O-Ren Ishii, now the leader of the Tokyo yakuza.", "O-Ren's parents were murdered by the yakuza when she was a child; she took vengeance on the yakuza boss and replaced him after training as an elite assassin.", "The Bride travels to Okinawa, Japan, to obtain a sword from legendary swordsmith Hattori Hanz\u014d, who has sworn never to forge a sword again.", "After learning that her target is Bill, his former student, he crafts his finest sword for her.", "The Bride tracks down O-Ren at a Tokyo restaurant, the House of Blue Leaves, and defeats and kills her yakuza army, including the elite Crazy 88 and O-Ren's bodyguard, schoolgirl Gogo Yubari.", "She duels with O-Ren in the restaurant's Japanese garden, and slices the top of her head off with a sword stroke.", "She tortures Sofie Fatale, O-Ren's assistant, for information about Bill, and leaves her alive as a threat.", "Bill asks Sofie if the Bride knows her daughter is alive." ], [ "Kill Bill: Volume 1", "Kill Bill: Volume 1\n\nKill Bill: Volume 1 is a 2003 American martial arts film written and directed by Quentin Tarantino.", "It stars Uma Thurman as the Bride, who swears revenge on a team of assassins (Lucy Liu, Michael Madsen, Daryl Hannah, and Vivica A. Fox) and their leader Bill (David Carradine) after they try to kill her and her unborn child.", "Her journey takes her to Japan, where she battles the Tokyo yakuza.", "Tarantino conceived \"Kill Bill\" as an homage to grindhouse cinema including martial arts films, samurai cinema, blaxploitation films, and spaghetti westerns.", "It features an anime sequence animated by Production I.G.", "It is the first of two \"Kill Bill\" films made in a single production; the films were originally set for a single release, but the film, with a runtime of over four hours, was divided in two.", "\"Volume 1\" became Tarantino's highest-grossing film up to that point, earning over $180 million at the box office.", "\"\" was released on April 16, 2004.", "A woman in a wedding dress, the Bride, lies wounded in a chapel in El Paso, Texas, having been attacked by the Deadly Viper Assassination Squad.", "She tells their leader, Bill, that she is pregnant with his baby." ], [ "Hattori Hanz\u014d", "Sonny Chiba again played a \"Hattori Hanz\u00f4:", "Kage no Gundan\" tribute character named Hattori Hanz\u014d in the film \"Kill Bill\", a master swordsmith who is called upon to create a special katana sword for the film's protagonist (referenced in the \"Thundercats\" episode \"The Duelist and the Drifter\" with the Sword of Hittanzo).", "He also appears in the Japanese light novel and anime series, \"The Ambition of Oda Nobuna\" as a handsome Ninja(Shinobi) under the command of Matsudaira Motoyasu(later known as Tokugawa Ieyasu)." ] ], "gold": "Kill Bill: Volume 1 is a 2003 American martial arts film starring Uma Thurman as the Bride, a woman who swears revenge on a team of assassins and their leader, Bill, after they try to kill her and her unborn child. Her first target, O-Ren Ishii, is now the leader of the Tokyo Yakuza, so she travels to Okinawa, Japan, to obtain a sword from legendary swordsmith Hattori Hanz\u014d, played by Sonny Chiba, who has sworn never to forge a sword again. Nonetheless, after learning that her target is Bill, his former student, he relents and crafts his finest sword for her.", "prediction 1": "Kill Bill is a 2003 American martial arts film written and directed by Quentin Tarantino. In the film, a master swordsmith named Hattori Hanz, a tribute character from the movie Kage no Gundan, is called upon to create a special katana sword for the film's protagonist. In the film, Sonny Chiba again played a \"Hattori Hanz\u00f4: Kage no Gundan\" tribute character named Hattori Hanz, a master swordsmith who is called upon to create a special katana sword for the film's protagonist.", "prediction 2": "Kill Bill: Volume 1 is a 2003 American martial arts film written and directed by Quentin Tarantino. The Bride travels to Okinawa, Japan, to obtain a sword from legendary swordsmith Hattori Hanz, who has sworn never to forge a sword again. After learning that her target is Bill, his former student, he crafts his finest sword for her. Kill Bill: Volume 2 is a 2009 Japanese action adventure film with a Japanese cast.", "prediction 3": "Kill Bill: Volume 1 is a 2003 American martial arts film written and directed by Quentin Tarantino. It stars Uma Thurman as the Bride, who swears revenge on a team of assassins, including Lucy Liu, Michael Madsen, Daryl Hannah, and Vivica A. Fox, as they try to kill her and her unborn child. The Bride travels to Okinawa, Japan, to obtain a sword from legendary swordsmith Hattori Hanz, who has sworn never to forge a sword again. After learning that her target is Bill, his former student, he crafts his finest sword for the film's protagonist.", "prediction 4": "Kill Bill is a 2003 American martial arts action film written and directed by Quentin Tarantino. In it, Uma Thurman plays the Bride, a woman determined to kill Bill and the Deadly Viper Assassination Squad. She travels to Okinawa, Japan, to obtain a sword from legendary swordsmith Hattori Hanz, who has sworn never to forge a sword again. After learning that her target is Bill, his former student, he crafts his finest sword for her.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 89 }, { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 193 }, { "error type": "Redundant", "explanation": "Kill Bill is a 2003 American martial arts film written and directed by Quentin Tarantino. In the film, a master swordsmith named Hattori Hanz, a tribute character from the movie Kage no Gundan, is called upon to create a special katana sword for the film's protagonist. ", "start": 308, "end": 479 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Kill Bill is a 2003 American martial arts film starring Uma Thurman as the Bride, a woman who swears revenge on a team of assassins and their leader, Bill, after they try to kill her and her unborn child. Her first target in the film, O-Ren Ishii, is now the leader of the Tokyo Yakuza, so she travels to Okinawa, Japan, and a master swordsmith named Hattori Hanz is called upon to create a special katana sword for the film's protagonist. In the film the legendary swordsmith, played by Sonny Chiba has sworn never to forge a sword again, but after learning that her target is Bill, his former student, he relents and crafts his finest sword for her." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is the current universal champion in wwe?", "passages": [ [ "WWE Universal Championship", "WWE Universal Championship\n\nThe WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE on the Raw brand.", "It is one of two world titles for WWE's main roster, alongside the WWE Championship on the SmackDown brand.", "The championship is currently held by Brock Lesnar, who is in his record second reign.", "Named in honor of the WWE Universe, the championship was established on July 25, 2016 to be the world championship of the Raw brand.", "Its creation came as a result of the re-introduction of the brand split and subsequent draft on July 19, 2016 in which the WWE Championship, the promotion's original world title, became exclusive to SmackDown.", "The inaugural Universal Champion was Finn B\u00e1lor.", "Since its inception, matches for the championship have headlined several pay-per-view events, including SummerSlam in 2017 and 2018, and WrestleMania 34, both being two of WWE's \"big four\" pay-per-views, the latter of which is WWE's flagship event.", "With the reintroduction of the WWE brand extension, a draft took place on the \"SmackDown Live\" premiere episode on July 19, 2016 and then-WWE Champion Dean Ambrose was drafted to the SmackDown brand.", "At Battleground on July 24, Ambrose successfully defended the title in a triple threat match against Raw draftees Seth Rollins and Roman Reigns, leaving Raw without a world title." ], [ "WrestleMania", "The event also marked the unannounced return of The Hardy Boyz, who won the Raw Tag Team Championship.", "WrestleMania 34 was held on April 8, 2018, at the Mercedes-Benz Superdome in New Orleans, Louisiana.", "In the main event, Brock Lesnar retained the Universal Championship against Roman Reigns.", "In another main event promoted match, AJ Styles retained the WWE Championship against Shinsuke Nakamura.", "Other marquee matches saw Kurt Angle and Ronda Rousey defeat Triple H and Stephanie McMahon in a mixed tag team match, which was Rousey's WWE debut match, and Daniel Bryan had his in-ring return after three years, teaming with Shane McMahon to defeat Kevin Owens and Sami Zayn.", "Also, The Undertaker defeated John Cena in an impromptu match." ], [ "WWE Universal Championship", "As of 11, 2019, there have been six reigns between five champions and two vacancies.", "Finn B\u00e1lor was the inaugural champion, but he was forced to vacate the title due to suffering a legitimate injury in winning the title, making his reign the shortest at 22 hours.", "Brock Lesnar holds three records with the championship: he has the most reigns at two, his first reign is the longest reign at 504 days (beginning on April 2, 2017 and ending on August 19, 2018), and he has the longest combined reign at + days.", "Kevin Owens is the youngest champion when he won it at 32 years old, while Goldberg is the oldest when he won it at 50.", "Brock Lesnar is the current champion in his record-setting second reign.", "He defeated Braun Strowman to win vacant title at Crown Jewel on November 2, 2018 in Riyadh, Saudi Arabia.", "The championship had been vacated by Roman Reigns on October 22, 2018 after Reigns announced he was battling leukemia.", "As of 11, 2019." ] ], "gold": "The WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE, currently defended on their SmackDown brand division. It is one of WWE's three world titles, alongside the WWE Championship on Raw and the NXT Championship on NXT. The current champion is Roman Reigns, who is in his second reign. The 2nd Universal Champion was Kevin Owens, 3rd Universal Champion in WWE was Goldberg, and the 4th Universal Champion in WWE was Brock Lesnar.", "prediction 1": "The WWE Universal Championship is one of two world titles for WWE's main roster, alongside the WWE Championship on the SmackDown brand. The current champion is Brock Lesnar, who is in his record second reign. The current champion was Finn B\u00e1lor.", "prediction 2": "The WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE on the Raw brand. The championship is currently held by Brock Lesnar, who is in his record-setting second reign. He defeated Braun Strowman to win vacant title at Crown Jewel on November 2, 2018 in Riyadh, Saudi Arabia.", "prediction 3": "The WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE on the Raw brand. The championship is currently held by Brock Lesnar, who is in his record-setting second reign.", "prediction 4": "The WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE on the Raw brand. The current champion is Brock Lesnar, who is in his record-setting second reign. The championship was originally created on July 25, 2016 to be the world championship of the Raw brand. The current champion was Finn B\u00e1lor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 208 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 213, "end": 229 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The WWE Universal Championship is a world heavyweight championship created and promoted by the American professional wrestling promotion WWE. The WWE Universal Championship is one of two world titles for WWE's main roster, alongside the WWE Championship on the SmackDown brand. The current champion is Brock Lesnar. The inaugural Universal Champion was Finn B\u00e1lor. Other previous champions include Kevin Owens, Goldbergs and Roman Reigns." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was the first pair of glasses invented?", "passages": [ [ "Glasses", "The development of the first eyeglasses took place in Northern Italy in the second half of the 13th century.", "Independently of the development of optical lenses, some cultures developed \"sunglasses\" for eye protection, without any corrective properties.", "Thus, flat panes of smoky quartz, were used in 12th-century China.", "Similarly, the Inuit have used snow goggles for eye protection.", "The first eyeglasses were made in Northern Italy, most likely in Pisa, by about 1290:\n", "In a sermon delivered on 23 February 1306, the Dominican friar Giordano da Pisa (ca. 1255\u20131311) wrote \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision...", "And it is so short a time that this new art, never before extant, was discovered. ...", "I saw the one who first discovered and practiced it, and I talked to him.\"", "Giordano's colleague Friar Alessandro della Spina of Pisa (d. 1313) was soon making eyeglasses.", "The \"Ancient Chronicle of the Dominican Monastery of St. Catherine in Pisa\" records: \"Eyeglasses, having first been made by someone else, who was unwilling to share them, he [Spina] made them and shared them with everyone with a cheerful and willing heart.\"" ], [ "Bifocals", "Bifocals\n\nBifocals are eyeglasses with two distinct optical powers.", "Bifocals are commonly prescribed to people with presbyopia who also require a correction for myopia, hyperopia, and/or astigmatism.", "Benjamin Franklin is generally credited with the invention of bifocals\n.", "Historians have produced some evidence to suggest that others may have come before him in the invention; however, a correspondence between George Whatley and John Fenno, editor of The Gazette of the United States, suggested that Franklin had indeed invented bifocals, and perhaps 50 years earlier than had been originally thought.", "However the College of Optometrists concluded:\nSince many inventions are developed independently by more than one person, it is possible that the invention of bifocals may have been such a case.", "John Isaac Hawkins, the inventor of trifocal lenses, coined the term \"bifocals\" in 1824 and credited Dr. Franklin.", "In 1955, Irving Rips of Younger Optics created the first seamless or \"invisible\" bifocal, a precursor to all progressive lenses.", "Construction\n\nOriginal bifocals were designed with the most convex lenses (for close viewing) in the lower half of the frame and the least convex lenses on the upper." ], [ "Glasses", "Serious historians have from time to time produced evidence to suggest that others may have preceded him in the invention; however, a correspondence between George Whatley and John Fenno, editor of \"The Gazette of the United States\", suggested that Franklin had indeed invented bifocals, and perhaps 50 years earlier than had been originally thought.", "The first lenses for correcting astigmatism were designed by the British astronomer George Airy in 1825.", "Over time, the construction of frames for glasses also evolved.", "Early eyepieces were designed to be either held in place by hand or by exerting pressure on the nose (\"pince-nez\").", "Girolamo Savonarola suggested that eyepieces could be held in place by a ribbon passed over the wearer's head, this in turn secured by the weight of a hat.", "The modern style of glasses, held by temples passing over the ears, was developed some time before 1727, possibly by the British optician Edward Scarlett.", "These designs were not immediately successful, however, and various styles with attached handles such as \"scissors-glasses\" and lorgnettes were also fashionable from the second half of the 18th century and into the early 19th century." ] ], "gold": "Eyeglasses are estimated to have been invented by 1290 in Northern Italy, most likely in Pisa. Eyeglasses were referenced in a sermon in 1306 by the Dominican friar Giordano da Pisa writing, \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision ... And it is so short a time that this new art, never before extant, was discovered. ... I saw the one who first discovered and practiced it, and I talked to him.\" British astronomer George Airy designed the first lenses for correcting astigmatism in 1825. The modern design of glasses, with temples passing over the ears may have been invented before 1727 by British optician Edward Scarlett. ", "prediction 1": "The development of the first pair of glasses took place in Northern Italy in the second half of the 13th century. The first eyeglasses were made in Northern Italy, most likely in Pisa, by about 1290: In a sermon delivered on 23 February 1306, the Dominican friar Giordano da Pisa wrote \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision... And it is so short a time that this new art, never before extant, was discovered.\"", "prediction 2": "The development of the first pair of glasses took place in Northern Italy in the second half of the 13th century. The first eyeglasses were made in Northern Italy, most likely in Pisa, by about 1290. In a sermon delivered on 23 February 1306, the Dominican friar Giordano da Pisa wrote: \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision... And it is so short a time that this new art, never before extant, was discovered.\"", "prediction 3": "In 1290, the Dominican friar Giordano da Pisa wrote: \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision. And it is so short a time that this new art, never before extant, was discovered.\" The first pair of eyeglasses made in Northern Italy, most likely in Pisa, by about 1290. In 1826, the English optician Edward Scarlett, who was also known as Edward Scarlett, a British optician Edward Scarlett, possibly by Edward Scarlett.", "prediction 4": "The first pair of eyeglasses were invented in Northern Italy in the second half of the 13th century. In a sermon delivered on 23 February 1306, the Dominican friar Giordano da Pisa wrote, \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision... And it is so short a time that this new art, never before extant, was discovered.\" Bifocals are eyeglasses with two distinct optical powers. The first lenses for correcting astigmatism were designed by the British astronomer George Airy in 1825.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The development of the first pair of glasses took place in Northern Italy in the second half of the 13th century. The first eyeglasses were made in Northern Italy, most likely in Pisa, by about 1290: In a sermon delivered on 23 February 1306, the Dominican friar Giordano da Pisa wrote \"It is not yet twenty years since there was found the art of making eyeglasses, which make for good vision... And it is so short a time that this new art, never before extant, was discovered. I saw the one who first discovered and practiced it, and I talked to him.\" The first lenses for correcting astigmatism were designed by the British astronomer George Airy in 1825. The modern style of glasses, held by temples passing over the ears, was developed some time before 1727, possibly by the British optician Edward Scarlett." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What is the jewish designation for the first five books of the old testament?", "passages": [ [ "Old Testament", "These extra books are ultimately derived from the earlier Greek Septuagint collection of the Hebrew scriptures and are also Jewish in origin.", "Some are also contained in the Dead Sea Scrolls.", "The Old Testament consists of many distinct books by various authors produced over a period of centuries.", "Christians traditionally divide the Old Testament into four sections: (1) the first five books or Pentateuch (Torah); (2) the history books telling the history of the Israelites, from their conquest of Canaan to their defeat and exile in Babylon; (3) the poetic and \"Wisdom books\" dealing, in various forms, with questions of good and evil in the world; and (4) the books of the biblical prophets, warning of the consequences of turning away from God.", "The Old Testament contains 39 (Protestant), 46 (Catholic), or more (Orthodox and other) books, divided, very broadly, into the Pentateuch (Torah), the historical books, the \"wisdom\" books and the prophets.", "The table uses the spellings and names present in modern editions of the Christian Bible, such as the Catholic New American Bible Revised Edition and the Protestant Revised Standard Version and English Standard Version." ], [ "Septuagint", "Septuagint\n\nThe Septuagint (from the literally \"seventy\", often abbreviated as or LXX and sometimes called the Greek Old Testament) is the earliest extant Greek translation of the Hebrew scriptures from the original Hebrew.", "It is estimated that the first five books of the Old Testament, known as the Torah or Pentateuch, were translated in the mid-3rd century BCE and the remaining texts were translated in the 2nd century BCE.", "Considered the primary Greek translation of the Old Testament, it is quoted a number of times in the New Testament, particularly in the Pauline epistles, by the Apostolic Fathers, and later by the Greek Church Fathers.", "The Greek translation was in circulation among the Alexandrian Jews who were fluent in Greek, the common language in Egypt at the time, but not in Hebrew.", "Separated from the Hebrew canon in Rabbinic Judaism, translations of the Torah into Greek by early Jewish scribes have survived as rare fragments only.", "The full title in , literally \"The Translation of the Seventy\", derives from the traditional story recorded in the Letter of Aristeas that the Septuagint was translated at the request of Ptolemy II Philadelphus by 70 or 72 Jewish scholars (6 from each of the 12 tribes of Israel) who independently translated identical versions of the entire Hebrew canon." ], [ "Hebrew Bible", "The Torah (\u05ea\u05bc\u05d5\u05b9\u05e8\u05b8\u05d4, literally \"\"teaching\"\"), also known as the Pentateuch, or as the \"\"Five Books of Moses\"\".", "Printed versions (rather than scrolls) of the Torah are often called \"\"Chamisha Chumshei Torah\"\"\" ( \"\"Five fifth-sections of the Torah\"\") and informally a \"\"Chumash\"\".", "\"Nevi'im\" ( , \"\"Prophets\"\") is the second main division of the Tanakh, between the Torah and Ketuvim.", "It contains three sub-groups.", "This division includes the books which cover the time from the entrance of the Israelites into the Land of Israel until the Babylonian captivity of Judah (the \"\"period of prophecy\"\").", "Their distribution is not chronological, but substantive.", "The Former Prophets ( )\n\nThe Latter Prophets ( )\n\nThe Twelve Minor Prophets (, \"Trei Asar\", \"\"The Twelve\"\"), which are considered one book \n\n\"Ketuvim\" (, \"\"Writings\"\") consists of eleven books, described below.", "They are also divided into three subgroups based on the distinctiveness of \"Sifrei Emet\" and \"Hamesh Megillot\"." ] ], "gold": "The Greek Old Testament, or Septuagint, is the earliest extant Koine Greek translation of books from the Hebrew Bible, various biblical apocrypha, and deuterocanonical books. The first five books of the Hebrew Bible are known as the Torah or the Pentateuch. In Jewish the designation for the first five books of the old testament are known as \u05ea\u05bc\u05d5\u05b9\u05e8\u05b8\u05d4.", "prediction 1": "The Hebrew Bible contains 39 books, divided into four sections. The Torah, also known as the Pentateuch, is the Hebrew name for the first five books of the Old Testament. The Hebrew Bible contains 46 books, divided into four sections. The Hebrew Bible contains 39 books, divided into four sections. The Hebrew Bible contains 46 books, divided into four sections. The Hebrew Bible contains 39 books, divided into four sections. The Hebrew Bible contains 39 books, divided into four sections. The Hebrew Bible contains 39 books, divided into four sections.\n", "prediction 2": "It is estimated the first five books of the Old Testament, known as the Torah or Pentateuch, were translated in the mid-3rd century BCE. The Septuagint, or Greek Old Testament, is the earliest extant Greek translation of the Hebrew scriptures from the original Hebrew. Hebrew Bible verses in Hebrew are known by various titles. The first five books of the Old Testament are known as the Torah.", "prediction 3": "The Hebrew name for the first five books of the Old Testament is Chomash. The Hebrew name for the first five books of the Old Testament is Chanisha Chumshei Torah. According to Judaism, these first five books are known as the Torah (literally \"teaching\") and are categorized by the Catholic Church into four main sections, Pentateuch (Torah), history, wisdom and prophets.", "prediction 4": "There are many Hebrew-language versions of the Old Testament. The Sephardic Hebrew Bible is part of the Hebrew Bible and essentially contains the Old Testament. It consists of 39 books, divided into four sections. The Torah is also known as the Pentateuch or Five Books of Moses. The contemporary Hebrew translation is called the Cassadime, which is a collection of Hebrew-language writings related to the Sinaitic Exodus from Egypt.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 112, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 63 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 426 }, { "error type": "Irrelevant", "explanation": "", "start": 427, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 491, "end": 555 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 234 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Torah (\u05ea\u05bc\u05d5\u05b9\u05e8\u05b8\u05d4), also known as the Pentateuch, is the name for the first five books of the Old Testament. The Septuagint is the earliest extant Greek translation of the Hebrew scriptures. \n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who ordered to drop atomic bombs on hiroshima and nagasaki?", "passages": [ [ "Atomic bombings of Hiroshima and Nagasaki", "By August 1945, the Allies' Manhattan Project had produced two types of atomic bombs, and the 509th Composite Group of the United States Army Air Forces (USAAF) was equipped with the specialized Silverplate version of the Boeing B-29 Superfortress that could deliver them from Tinian in the Mariana Islands.", "Orders for atomic bombs to be used on four Japanese cities were issued on July 25.", "On August 6, one of its B-29s dropped a Little Boy uranium gun-type bomb on Hiroshima.", "Three days later, on August 9, a Fat Man plutonium implosion-type bomb was dropped by another B-29 on Nagasaki.", "The bombs immediately devastated their targets.", "Over the next two to four months, the acute effects of the atomic bombings killed 90,000\u2013146,000 people in Hiroshima and 39,000\u201380,000 people in Nagasaki; roughly half of the deaths in each city occurred on the first day.", "Large numbers of people continued to die from the effects of burns, radiation sickness, and other injuries, compounded by illness and malnutrition, for many months afterward.", "In both cities, most of the dead were civilians, although Hiroshima had a sizable military garrison.", "Japan announced its surrender to the Allies on August 15, six days after the bombing of Nagasaki and the Soviet Union's declaration of war." ], [ "Atomic bombings of Hiroshima and Nagasaki", "Atomic bombings of Hiroshima and Nagasaki\n\nDuring the final stage of World War II, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively.", "The United States dropped the bombs after obtaining the consent of the United Kingdom, as required by the Quebec Agreement.", "The two bombings killed 129,000\u2013226,000 people, most of whom were civilians.", "They remain the only use of nuclear weapons in the history of warfare.", "In the final year of the war, the Allies prepared for what was anticipated to be a very costly invasion of the Japanese mainland.", "This undertaking was preceded by a conventional and firebombing campaign that destroyed 67 Japanese cities.", "The war in Europe had concluded when Germany signed its instrument of surrender on May 8, 1945.", "As the Allies turned their full attention to the Pacific War, the Japanese faced the same fate.", "The Allies called for the unconditional surrender of the Imperial Japanese armed forces in the Potsdam Declaration on July 26, 1945\u2014the alternative being \"prompt and utter destruction\".", "The Japanese rejected the ultimatum and the war continued." ], [ "Atomic bombings of Hiroshima and Nagasaki", "A meeting of the Combined Policy Committee was held at the Pentagon on July 4, 1945.", "Field Marshal Sir Henry Maitland Wilson announced that the British government concurred with the use of nuclear weapons against Japan, which would be officially recorded as a decision of the Combined Policy Committee.", "As the release of information to third parties was also controlled by the Quebec Agreement, discussion then turned to what scientific details would be revealed in the press announcement of the bombing.", "The meeting also considered what Truman could reveal to Joseph Stalin, the leader of the Soviet Union, at the upcoming Potsdam Conference, as this also required British concurrence.", "Orders for the attack were issued to General Carl Spaatz on July 25 under the signature of General Thomas T. Handy, the acting Chief of Staff, since Marshall was at the Potsdam Conference with Truman.", "It read:\n\nThat day, Truman noted in his diary that:\n\nThe July 16 success of the Trinity Test in the New Mexico desert exceeded expectations.", "On July 26, Allied leaders issued the Potsdam Declaration, which outlined the terms of surrender for Japan.", "The declaration was presented as an ultimatum and stated that without a surrender, the Allies would attack Japan, resulting in \"the inevitable and complete destruction of the Japanese armed forces and just as inevitably the utter devastation of the Japanese homeland\".", "The atomic bomb was not mentioned in the communiqu\u00e9." ] ], "gold": "In the final year of World War II, as the Allies prepared for a costly invasion of the Japanese mainland, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on 6 and 9 August 1945, respectively. Orders for the attack were issued to General Carl Spaatz on 25 July under the signature of the acting Chief of Staff, General Thomas T. Handy.", "prediction 1": "The orders for the use of atomic weapons for bombing four Japanese cities were issued on July 25. On August 6, one of its B-29s dropped a Little Boy uranium gun-type bomb on Hiroshima. Three days later, on August 9, a Fat Man plutonium implosion type bomb was dropped by another B-29 on Nagasaki.", "prediction 2": "The orders for atomic bombs to be used on four Japanese cities were issued on July 25, 1945. On August 6, one of America's B-29s dropped a Little Boy uranium gun-type bomb on Hiroshima, and on August 9, a Fat Man plutonium implosion-type bomb was dropped by another B-29 on Nagasaki. The bombings devastated their targets.", "prediction 3": "The United States detonated two atomic bombs over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The bombs were dropped by the 509th Composite Group of the United States Army Air Forces (USAAF) after obtaining the consent of the United Kingdom, as required by the Quebec Agreement. The bombs destroyed their targets within a day and killed 129,000\u2013226,000 people.", "prediction 4": "The atomic bombings of Hiroshima and Nagasaki occurred during the final stage of World War II, when the United States dropped two atomic bombs over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The bombs destroyed their targets and remain the only use of nuclear weapons in the history of warfare. This attack was ordered by General Carl Spaatz on July 25 under the signature of General Thomas T. Handy, the acting Chief of Staff, since Marshall was at the Potsdam Declaration, which outlined the terms of surrender for Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 283 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 170 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "During the final stage of World War II the orders for the use of atomic weapons for bombing four Japanese cities were issued to General Carl Spaatz on July 25, 1945 under the signature of General Thomas T. Handy, the acting Chief of Staff. On August 6 a bomb dropped on Hiroshima and on August 9 another bomb was dropped on Nagasaki." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played oscar in the odd couple tv show?", "passages": [ [ "The Odd Couple (1970 TV series)", "The Odd Couple (1970 TV series)\n\nThe Odd Couple, formally titled onscreen Neil Simon's The Odd Couple, is an American television situation comedy broadcast from September 24, 1970, to March 7, 1975, on ABC.", "It stars Tony Randall as Felix Unger and Jack Klugman as Oscar Madison, and was the first of several sitcoms developed by Garry Marshall for Paramount Television.", "The show is based on the 1965 play of the same name, which was written by Neil Simon, as well as on the play's 1968 film adaptation.", "Felix and Oscar are both divorced.", "They share a Manhattan apartment, and their different lifestyles inevitably lead to conflicts and laughs.", "In 1997, the episodes \"Password\" and \"The Fat Farm\" were ranked #5 and #58, respectively, on TV Guide's 100 Greatest Episodes of All Time.", "The show received three nominations for the Primetime Emmy Award for Outstanding Comedy Series.", "Its fourth season, from 1973\u201374, remains the most recent nominee for a show that aired during a Friday time slot.", "The success of the 1968 film version of the stage play of \"The Odd Couple\", which starred Jack Lemmon as Felix and Walter Matthau as Oscar, catalyzed production of the television show." ], [ "The Odd Couple (2015 TV series)", "The Odd Couple (2015 TV series)\n\nThe Odd Couple is an American multi-camera television sitcom that aired on CBS from February 19, 2015 to January 30, 2017.", "It is the seventh screen production based on the 1965 play written by Neil Simon, following the 1968 film, the original 1970s television series, a 1975 Saturday morning cartoon, a 1982 reboot of the 1970 series, \"The Odd Couple: Together Again\" (a TV film reunion of the 1970 series) and \"The Odd Couple II\" (a 1998 sequel to the 1968 film).", "This show stars Matthew Perry (also developing and executive producing the series) as the slovenly Oscar Madison and Thomas Lennon as the obsessively tidy Felix Unger.", "Perry and Lennon previously worked together on the film \"17 Again\".", "The show was announced in December 2013 and was picked up by CBS as a midseason offering for the 2014\u201315 season.", "On May 16, 2016, CBS renewed the show for a third season of 13 episodes, which premiered on October 17, 2016, and concluded on January 30, 2017.", "The series was formally canceled on May 15, 2017, after three seasons." ], [ "The Odd Couple (1970 TV series)", "The characters' professions in this version were reversed from the original series, with the fastidious Spiffy working as a reporter and the rumpled Fleabag a photographer, often working together.", "The show was canceled in 1977.", "In 1982, as a hedge against the 1981 Writers Guild of America strike, ABC aired a new version of \"The Odd Couple\", this time with two African-Americans, Ron Glass as Felix and Demond Wilson as Oscar.", "It was called \"The New Odd Couple\", and initially used eight previously-filmed scripts from the original series; when the strike ended during the series' production, union writers returned and original episodes were written from then on.", "It ran less than half a season.", "A Chilean version titled \"Una Pareja Dispareja\" began airing in January 2009 on TVN.", "This version takes several of its cues from \"Two and a Half Men\", a Chuck Lorre-created sitcom with a similar premise to \"The Odd Couple\".", "Some of the details taken from \"Two and a Half Men\" include Felix and Oscar being siblings instead of friends, as well as Felix being a doctor and Oscar a musician.", "Another American remake, also called \"The Odd Couple\", aired on CBS for three seasons from 2015 to 2017." ] ], "gold": "There is more than one entertainment show called The Odd Couple, including a play, a film that was adapted from the play, and more than one television series. The original 1970 television series, The Odd Couple, or Neil Simon's The Odd Couple, is an American situational comedy based on the 1965 play by the same name, and is about divorced roommates, Felix Unger and Oscar Madison. Actor Jack Klugman played the character Oscar in the 1970 tv series. Matthew Perry played Oscar in the 2015 remake of the tv series. And, in a 1982 reboot, called The New Odd Couple, Desmond Wilson played Oscar.", "prediction 1": "The Odd Couple, formally titled onscreen Neil Simon's The Odd Couple, is an American television situation comedy broadcast from September 24, 1970, to March 7, 1975, on ABC. The show stars Tony Randall as Felix Unger and Jack Klugman as Oscar Madison. The Odd Couple: Together Again is a TV film reunion of the 1970 series, and The Odd Couple: II is a 1998 sequel to the 1968 film. The 2015 Odd Couple is an American multi-camera television sitcom that aired on CBS from February 19, 2015, and demond Wilson plays Oscar Madison. The 2015 Odd Couple: Together Again is a TV film reunion of the 1970 series and The Odd Couple: Together Again is a TV film reunion of the 1970 series.", "prediction 2": "The Odd Couple is an American television situation comedy broadcast from September 24, 1970, to March 7, 1975, on ABC. It stars Tony Randall as Felix Unger and Jack Klugman as Oscar Madison. The Odd Couple is also a 2015 multi-camera television sitcom that aired on CBS from February 19, 2015, to January 30, 2017. This show stars Matthew Perry as the slovenly Oscar Madison and Thomas Lennon as the obsessively tidy Felix Unger.", "prediction 3": "The Odd Couple is an American television situation comedy broadcast from September 24, 1970, to March 7, 1975, on ABC. Jack Klugman played Oscar Madison in the 1970 and 2015 television series, respectively.", "prediction 4": "The Odd Couple, formally titled onscreen Neil Simon's The Odd Couple, is an American television situation comedy broadcast from September 24, 1970, to March 7, 1975, on ABC. It stars Tony Randall as Felix Unger and Jack Klugman as Oscar Madison, and was the first of several sitcoms developed by Garry Marshall for Paramount Television. The Odd Couple II was a sequel to the 1970 series that aired on CBS from January 30, 2017 to May 15, 2017. This show stars Matthew Perry as the slovenly Oscar Madison and Thomas Lenon as the obsesssssssssssssssssssssssssssssssssssssssssssssssive Felix Unger.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 448, "end": 489 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 494, "end": 507 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Odd Couple, formally titled onscreen Neil Simon's The Odd Couple, is an American television situation comedy. The show stars Felix Unger and his divorced roommate, played by Jack Klugman, Oscar Madison. The original 1970 series is based on the 1965 play by the same name. The 2015 Odd Couple is an American multi-camera television sitcom that stars Matthew Perry Oscar Madison. Demond Wilson plays Oscar Madison in the 1982 reboot called \"The New Odd Couple\"." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who owns the number 9 car in the xfinity series?", "passages": [ [ "Chase Elliott", "9 Chevrolet for JR Motorsports, with sponsorship from NAPA Auto Parts.", "On April 4, 2014, Elliott won the O'Reilly Auto Parts 300 at Texas Motor Speedway, holding Kevin Harvick and Kyle Busch off after taking the lead with 16 laps to go.", "On April 11, 2014, Elliott won the VFW Sport Clips Help a Hero 200 at Darlington Raceway by passing Elliott Sadler on the last lap after restarting sixth with two laps to go.", "Elliott won the EnjoyIllinois.com 300 at Chicagoland Speedway after holding off Trevor Bayne.", "At Phoenix, Elliott clinched the Nationwide Series championship with a 53-point lead over teammate Regan Smith, becoming the first rookie and youngest driver to win a NASCAR national series title.", "Later in the year, he was named the Nationwide Series' Most Popular Driver.", "In 2015, Elliott received his first DNF in his career after being involved in the second big one at Daytona, finishing 28th.", "On September 11, Elliott won his first race of the season at Richmond, snapping his 36-race winless streak.", "He battled with Chris Buescher for the championship, but was unable to catch up and finished 2nd in points.", "Following Elliott's move up to the Cup Series in 2016, he continued driving for JR Motorsports part-time in the Xfinity Series.", "In 2016 he drove the No." ], [ "Chase Elliott", "Chase Elliott\n\nWilliam Clyde \"Chase\" Elliott II (born November 28, 1995) is an American professional stock car racing driver.", "He currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports.", "He is the son of 1988 Winston Cup Series champion Bill Elliott.", "He won the 2014 NASCAR Nationwide Series championship, becoming the first rookie to win a national series championship in NASCAR.", "He was the 2016 NASCAR Sprint Cup Series Rookie of the Year.", "At 13 years old, Elliott was featured alongside thirteen other athletes, including future world number one golfer Jordan Spieth, as potential stars in the July 13, 2009 issue of \"Sports Illustrated\".", "Elliott raced in 40 races in various series in 2010, winning twelve events over the course of the year and finishing in the top ten 38 times.", "It was the third season of his racing career, and he won the Blizzard Series, Miller Lite and Gulf Coast championship en route to being named the Georgia Asphalt Pro Late Model Series Rookie of the Year.", "He ended the season by winning the Winchester 400.", "\"Sports Illustrated\" named Elliott as the high school player of the week in April 2011.", "During the year, he competed in the Champion Racing Association, winning the series' National Super Late Model championship." ], [ "JR Motorsports", "Elliott's 2014 crew chief Greg Ives would move up to Dale Earnhardt Jr.'s Cup Series team, replaced by longtime Xfinity crew chief Ernie Cope.", "The No. 9 team did not race in 2016.", "On August 18, 2016, William Byron and Hendrick Motorsports announced a multi-year driver development agreement, with Byron running full-time in the Xfinity Series driving the No. 9 Chevrolet Camaro for JR Motorsports in 2017.", "It was the first time since 2014 that the No. 9 was driven by a rookie driver.", "At the 2017 Ford Eco Boost 300, as William Byron and Elliott Sadler were battling late, Byron took advantage of Sadler's mistake of trying to pass Ryan Preece when he was too far back, slowing Sadler and allowing Byron to pass both drivers.", "When Sadler tried to follow, he made contact with Preece, sending Preece sideways and Sadler into the wall.", "After that Byron pulled away and finished 3rd, ultimately winning the championship and Rookie of the Year honors while winning four races at Iowa, Daytona, Indianapolis and Phoenix.", "Tyler Reddick was signed to a full-time schedule for the 2018 Xfinity season, replacing William Byron, who was promoted to the Monster Energy NASCAR Cup Series.", "On February 17, 2018, Reddick beat teammate Elliott Sadler in a photo finish to win the season-opening race at Daytona." ] ], "gold": "Chase Elliott II is an American professional stock car racing driver. He competes full-time in the NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 1LE for Hendrick Motorsports. He also competes part-time in the NASCAR Xfinity Series in the No. 1 Chevrolet Camaro for JR Motorsports as well as in the NASCAR Camping World Truck Series in the No. 24 Chevrolet Silverado for GMS Racing. He won the 2014 NASCAR Nationwide Series championship, becoming the first rookie to win a national series championship in NASCAR and the youngest champion in that series. JR Motorsports owned the number 9 car in the 2014, 2015, and 2017 Xfinity series with Dale Earnhardt Jr. partially owning the car.", "prediction 1": "William Byron and Hendrick Motorsports own the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports in the Xfinity Series. Chase Elliott currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports. On August 18, 2016, Byron and Hendrick Motorsports announced a multi-year driver development agreement, with Byron running full-time in the Xfinity Series driving the No. 9 Chevrolet Camaro ZL1 Chevrolet Camaro", "prediction 2": "Chase Elliott is an American stock car racing driver who currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports. Elliott's father, Bill Elliott, is the driver of the No. 9 car in the Xfinity Series. In 2017, William Byron and Hendrick Motorsports announced a multi-year driver development agreement, with Byron running full-time in the Xfinity Series driving the No. 9 Chevrolet Camaro for Hendrick Motorsports. In 2016, Chase Elliott continued driving for JR Motorsports part-time in the Xfinity Series, and in 2017. In 2017, the No. 9 Chevrolet Camaro was driven by a rookie driver.", "prediction 3": "William Byron and Hendrick Motorsports have owned the No. 9 Chevrolet Camaro ZL1 since 2017. William Elliott II currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports.", "prediction 4": "William Byron and Hendrick Motorsports announced a multi-year driver development agreement, with Byron running full-time in the Xfinity Series driving the No. 9 Chevrolet Camaro ZL1 for JR Motorsports in 2017. It was the first time since 2014 that the No. 9 car was driven by a rookie driver.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "William Byron and Hendrick Motorsports own the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports in the Xfinity Series. ", "start": 271, "end": 481 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 70, "end": 98 } ], "missing-info": [], "corrected-prediction": "William Byron and Hendrick Motorsports have an agreement for Bryon to run the No. 9 Chevrolet Camaro for JR Motorsports in the Xfinity Series. Chase Elliott currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 9 Chevrolet Camaro ZL1 for Hendrick Motorsports." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What year did the first pokemon game come out in america?", "passages": [ [ "Pok\u00e9mon Red and Blue", "Pok\u00e9mon Red and Blue\n\nPok\u00e9mon Red Version and Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy.", "They are the first installments of the \"Pok\u00e9mon\" series.", "They were first released in Japan in 1996 as \"Red\" and \"Green\".", "\"Blue\" was released later in the year as a special edition.", "They were later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years.", "\"Pok\u00e9mon Yellow\", a special edition version, was released roughly a year later.", "\"Red\" and \"Green\" have subsequently been remade for the Game Boy Advance as \"Pok\u00e9mon FireRed\" and \"LeafGreen\", released in 2004.", "The player controls the protagonist from an overhead perspective and navigates him throughout the fictional region of Kanto in a quest to master Pok\u00e9mon battling.", "The goal of the games is to become the champion of the Indigo League by defeating the eight Gym Leaders and then the top four Pok\u00e9mon trainers in the land, the Elite Four.", "Another objective is to complete the Pok\u00e9dex, an in-game encyclopedia, by obtaining the 150 available Pok\u00e9mon.", "\"Red\" and \"Blue\" utilize the Game Link Cable, which connects two games together and allows Pok\u00e9mon to be traded or battled between games." ], [ "Pok\u00e9mon Red and Blue", "The game was completed on March 1, 2014, boasting 390 hours of multi-user controlled non-stop gameplay.", "was released in Japan as a mail-order-only special edition to subscribers of \"CoroCoro Comic\" on October 15, 1996.", "It was later released to general retail on October 10, 1999.", "The game featured updated in-game artwork and new dialogue.", "Using Blastoise as its mascot, the code, script, and artwork for \"Blue\" was used for the international releases of \"Red\" and \"Green\", which were renamed to \"Red\" and \"Blue\".", "The Japanese \"Blue\" edition of the game features all but a handful of Pok\u00e9mon available in \"Red\" and \"Green\", making certain Pok\u00e9mon exclusive to these original editions.", ", or simply Pok\u00e9mon Yellow Version, was a special edition of the \"Red\" and \"Blue\" versions, and was originally released on September 12, 1998, in Japan, with releases in North America and Europe on October 1, 1999, and June 16, 2000, respectively.", "The game was designed to resemble the \"Pok\u00e9mon\" anime series, with the player receiving a Pikachu as his starter Pok\u00e9mon, and his rival starting with an Eevee.", "Some non-player characters resemble those from the anime, including Team Rocket: Jessie and James." ] ], "gold": "Pok\u00e9mon Red Version and Pok\u00e9mon Blue Version are 1996 role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the Pok\u00e9mon video game series. They were first released in Japan in 1996 as Pocket Monsters: Red and Pocket Monsters: Green, with the special edition Pocket Monsters: Blue being released in Japan later that same year. The games were later released as Pok\u00e9mon Red and Pok\u00e9mon Blue in North America and Australia in 1998 and Europe in 1999.", "prediction 1": "Pok\u00e9mon Red Version and Pok\u00e9mon Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the \"Pok\u00e9mon\" series. They were first released in Japan in 1996 as \"Red\" and \"Green\". \"Blue\" was released later in the year as a special edition. They were later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years. Pok\u00e9mon Yellow Version, a special edition version, was released roughly a year later.", "prediction 2": "Pok\u00e9mon Red Version and Pok\u00e9mon Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the \"Pok\u00e9mon\" series. They were first released in Japan in 1996 as \"Red\" and \"Green\". Blue was released later in the year as a special edition. They were later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years. Pok\u00e9mon Yellow Version, a special edition version, was released roughly a year later.", "prediction 3": "Pok\u00e9mon Red Version and Pok\u00e9mon Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the \"Pok\u00e9mon\" series. Was first released in Japan as \"Red\" and \"Green\", and \"Blue\" was released later in the year as a special edition which was later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years. Pok\u00e9mon Yellow Version was a special edition of the two games released on September 12, 1998, in Japan, and released in North America and Europe on October 1, 1999, and June 16, 2000, respectively, with North America and Europe on October 1, 1999 and June 16, 2000, respectively. Pok\u00e9mon Red Version and Blue Version are the first installments of the \"Pok\u00e9mon\" series.", "prediction 4": "Pok\u00e9mon Red and Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the \"Pok\u00e9mon\" series. They were first released in Japan in 1996 as \"Red\" and \"Green\". \"Blue\" was released later in the year as a special edition. They were later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years. Pok\u00e9mon Yellow Version, a special edition version, was released roughly a year later.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 440, "end": 525 } ], "missing-info": [], "corrected-prediction": "Pok\u00e9mon Red Version and Pok\u00e9mon Blue Version are role-playing video games developed by Game Freak and published by Nintendo for the Game Boy. They are the first installments of the \"Pok\u00e9mon\" series. They were first released in Japan in 1996 as \"Red\" and \"Green\". \"Blue\" was released later in the year as a special edition. They were later released as \"Red\" and \"Blue\" in North America, Europe, and Australia over the following three years. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who is the current lead singer for journey?", "passages": [ [ "Arnel Pineda", "On August 12, Pineda, along with his manager Bert de Leon, flew to Marin County, just north of San Francisco, for a two-day audition.", "The star-struck Pineda was welcomed warmly but he described the audition as \"nerve-wracking, tense\".", "On December 5, 2007, Pineda was announced as the new lead singer of Journey.", "Pineda debuted as the lead singer of Journey on February 21, 2008 at the Vi\u00f1a del Mar International Song Festival held at the Quinta Vergara Amphitheater in Vi\u00f1a del Mar, Chile.", "Chilean media acclaimed Pineda's performance (translated to English): \"The new vocalist fits very well with the band, his vocal aptitudes shining through, which are very similar to the legendary musician of the band, Steve Perry.\"", "Journey keyboardist/guitarist Jonathan Cain described Pineda's performance in a radio interview: \"We went to Chile just recently, where we had never played and they went crazy, they absolutely went nuts...", "Arnel's first show\u00a0\u2014 talk about a stressful thing\u00a0\u2014 we had a televised concert for 25 million people...Is the guy a winner?", "Yeah, he's a winner.", "He's a clutch player.\"" ], [ "Neal Schon", "Neal Schon\n\nNeal Joseph Schon (born February 27, 1954) is an American rock guitarist, songwriter, and vocalist, best known for his work with the bands Journey (in which he is the only constant original member) and Bad English.", "He was a member of the rock band Santana before forming Journey, and was also an original member of Hardline.", "Schon was inducted into the Oklahoma Music Hall of Fame on August 23, 2013.", "Schon was inducted into the Rock and Roll Hall of Fame as a member of Journey on April 7, 2017.", "Neal Joseph Schon was born at Tinker Air Force Base, Oklahoma, the son of Matthew and Barbara Schon.", "He is of German ancestry.", "Schon first picked up the guitar at \"around the age of five.\"", "A quick learner, he joined Santana as a teenager at 15.", "Schon has said he was asked by Eric Clapton to join Derek and the Dominos, but that he joined Santana instead, performing on the albums \"Santana III\" and \"Caravanserai\".", "Schon also played in Azteca before moving on in 1973 to form Journey, a group he has continued to lead to the present day.", "Schon's guitar style has been described as soulful, taking inspiration from 1960s-era soul singers such as Aretha Franklin and Gladys Knight, and blending it with blues runs similar to B. B." ], [ "Jonathan Cain", "Jonathan Cain\n\nJonathan Cain (born Jonathan Leonard Friga; February 26, 1950) is an American musician, singer, and songwriter best known for his work with The Babys, Journey, and Bad English.", "Cain was inducted into the Rock and Roll Hall of Fame as a member of Journey on April 7, 2017.", "Cain was born in Chicago, Illinois, to Leonard and Nancy Friga, who were Italian.", "At the age of eight, Cain began accordion lessons, and by the time he was in his teens, he was playing accordion and piano at parties and in clubs.", "He also plays guitar, bass, and harmonica.", "Cain was a survivor of the Our Lady of the Angels school fire of 1958, in which 92 students and 3 nuns died.", "In 1968 Cain graduated from East Leyden High School in the Chicago suburb of Franklin Park, Illinois and later attended the Chicago Conservatory of Music before moving to Nashville, Tennessee, and eventually to Los Angeles, California.", "In 1976, Cain released his first record as the Jonathan Cain Band, \"Windy City Breakdown\", on Bearsville Records.", "In 1979, he joined The Babys, appearing on their albums \"Union Jacks\" and \"On the Edge\".", "In 1980, Cain left The Babys to join the rock band Journey, taking Gregg Rolie's place on keyboards." ] ], "gold": "Arnel Pineda has been the singer of Pop band Journey since 2007. Keyboardist Jonathan Cain and guitarist Neal Schon sing occasionally as well.", "prediction 1": "Arnel Pineda is the current lead singer of Journey. He was announced as the lead singer of Journey on December 5, 2007. Jonathan Cain is the current lead singer for Journey.", "prediction 2": "Arnel Pineda, an American rock guitarist, songwriter, and vocalist, is the current lead singer of the rock band Journey, having debuted on February 21, 2008 at the Via del Mar International Song Festival held at the Quinta Vergara Amphitheater in Via del Mar, Chile. Jonathan Cain, an American musician, singer, and songwriter, is the current lead singer of the rock band Journey, having debuted on February 21, 2008 at the Via del Mar International Song Festival held at the Quinta Vergara Vergara Vergara Amphitheater in Via de Leon, Chile.", "prediction 3": "Arnel Pineda is the current lead singer of rock band Journey. Pineda debuted as the lead singer of Journey on February 21, 2008 at the Via del Mar International Song Festival held at the Quinta Vergara Amphitheater in Via del Mar, Chile. Journey keyboardist/guitarist Jonathan Cain is the current lead singer of Journey.", "prediction 4": "Arnel Pineda is the current lead singer of the rock band Journey. He was first announced as the lead singer of the band in February 2007, and has since been replaced by Jonathan Cain.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 173 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Arnel Pineda is the current lead singer of Journey. He was announced as the lead singer of Journey on December 5, 2007. Keyboardist/singer Jonathan Cain and guitarist/vocalist Neal Schon have performed with Journey as well." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Where was the ghost in the shell filmed?", "passages": [ [ "Ghost in the Shell", "In 2008, DreamWorks and producer Steven Spielberg acquired the rights to a live-action film adaptation of the original \"Ghost in the Shell\" manga.", "On January 24, 2014, Rupert Sanders was announced as director, with a screenplay by William Wheeler.", "In April 2016, the full cast was announced, which included Juliette Binoche, Chin Han, Lasarus Ratuere and Kaori Momoi, and Scarlett Johansson in the lead role; the casting of Johansson drew accusations of whitewashing.", "Principal photography on the film began on location in Wellington, New Zealand, on February 1, 2016.", "Filming wrapped in June 2016.", "\"Ghost in the Shell\" premiered in Tokyo on March 16, 2017, and was released in the United States on March 31, 2017, in 2D, 3D and IMAX", "3D. It received mixed reviews, with praise for its visuals and Johansson's performance but criticism for its script.", "In 2002, \"Ghost in the Shell: Stand Alone Complex\" premiered on Animax, presenting a new telling of \"Ghost in the Shell\" independent from the original manga, focusing on Section 9's investigation of the Laughing Man hacker.", "It was followed in 2004 by a second season titled \"Ghost in the Shell: S.A.C. 2nd GIG\", which focused on the Individual Eleven terrorist group." ], [ "Ghost in the Shell (2017 film)", "Principal photography on the film began on location in Wellington, New Zealand, on February 1, 2016.", "In April 2016, the full cast was announced, including Juliette Binoche, Chin Han, Lasarus Ratuere and Kaori Momoi.", "In May 2016, Rila Fukushima was cast in a role.", "Filming wrapped in New Zealand on June 3, 2016.", "Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street on June 7, 8 and 10 or 14\u201316.", "\"Ghost in the Shell\" was originally scheduled for release on April 14, 2017, by Walt Disney Studios Motion Pictures through their Touchstone Pictures banner.", "The film was part of DreamWorks' distribution deal with Walt Disney Studios, which began in 2009.", "In April 2015, Disney moved the film's North American release date to March 31, 2017, with Paramount Pictures handling international distribution.", "However, it was reported in September 2015 that DreamWorks and Disney would not renew their distribution deal, which was set to expire in August 2016.", "In January 2016, Disney dropped the film from its slate after DreamWorks finalized their distribution deal with Universal Pictures in December 2015.", "Disney's distribution rights for the film were transferred completely to Paramount instead of Universal, with Paramount retaining Disney's release date of March 31, 2017." ] ], "gold": "Ghost in the Shell was filmed in Wellington, New Zealand and Pak Hoi Street and Woosung Street in Yau Ma Tei and Jordan in Hong Kong.", "prediction 1": "Ghost in the Shell is a Japanese live-action film adaptation of the original Ghost in the Shell manga. Principal photography on the film began on location in Wellington, New Zealand, on February 1, 2016. Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street on June 7, 8 and 10 or 14\u201316.", "prediction 2": "Ghost in the Shell is a live-action film adaptation of the 2008 Japanese manga Ghost in the Shell. Principal photography on the film began on location in Wellington, New Zealand, on February 1, 2016. Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street on June 7, 8 and 10 or 14\u201316.", "prediction 3": "Ghost in the Shell was filmed in Hong Kong, New Zealand, Japan, and the US. Principal photography on the film began on location in Wellington, New Zealand, on February 1, 2016. Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street on June 7, 8 and 10 or 14\u201316.", "prediction 4": "Ghost in the Shell is the title of a manga series published by DreamWorks Animation and Steven Spielberg. The live-action Ghost in the Shell film was filmed in Wellington, New Zealand from February 1, 2016 to June 3, 2016. Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street from June 7\u201316.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 347 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 102 } ], "missing-info": [], "corrected-prediction": "Principal photography on the film began on location in Wellington, New Zealand. Filming also took place in the Yau Ma Tei and Jordan areas of Hong Kong, around Pak Hoi Street and Woosung Street." }, "preference": [ 1, 1, 0, 1, 0, 0 ] }, { "question": "What is the name given to a one way data transmission?", "passages": [ [ "Simplex communication", "Simplex communication\n\nSimplex communication is a communication channel that sends information in one direction only.", "The International Telecommunication Union definition is a communications channel that operates in one direction at a time, but that may be reversible; this is termed half duplex in other contexts.", "A duplex communication channel requires two simplex channels operating in opposite directions.", "For example, in TV and radio broadcasting, information flows only from the transmitter site to multiple receivers.", "A pair of walkie-talkie two-way radios provide a simplex circuit in the ITU sense; only one party at a time can talk, while the other listens until it can hear an opportunity to transmit.", "The transmission medium (the radio signal over the air) can carry information in only one direction.", "The old Western Union company used the term simplex when describing the half-duplex and simplex capacity of their new transatlantic telegraph cable completed between Newfoundland and the Azores in 1928.", "The same definition for a simplex radio channel was used by the National Fire Protection Association in 2002." ], [ "LoRa", "LoRaWAN is a media access control (MAC) layer protocol but mainly is a network layer protocol for managing communication between LPWAN gateways and end-node devices as a routing protocol, maintained by the LoRa Alliance.", "Version 1.0 of the LoRaWAN specification was released in June 2015.", "In basic terms, one can consider LoRaWAN to be a new WiFi to connect new IOT devices across every industry.", "LoRaWAN defines the communication protocol and system architecture for the network, while the LoRa physical layer enables the long-range communication link.", "LoRaWAN is also responsible for managing the communication frequencies, data rate, and power for all devices.", "Devices in the network are asynchronous and transmit when they have data available to send.", "Data transmitted by an end-node device is received by multiple gateways, which forward the data packets to a centralized network server.", "The network server filters duplicate packets, performs security checks, and manages the network.", "Data is then forwarded to application servers.", "The technology shows high reliability for the moderate load, however, it has some performance issues related to sending acknowledgements.", "Platforms based on LoRaWAN include:" ], [ "Computer security", "Manufacturers are reacting in a number of ways, with Tesla in 2016 pushing out some security fixes \"over the air\" into its cars' computer systems.", "In the area of autonomous vehicles, in September 2016 the United States Department of Transportation announced some initial safety standards, and called for states to come up with uniform policies.", "Government and military computer systems are commonly attacked by activists and foreign powers.", "Local and regional government infrastructure such as traffic light controls, police and intelligence agency communications, personnel records, student records, and financial systems are also potential targets as they are now all largely computerized.", "Passports and government ID cards that control access to facilities which use RFID can be vulnerable to cloning.", "The Internet of things (IoT) is the network of physical objects such as devices, vehicles, and buildings that are embedded with electronics, software, sensors, and network connectivity that enables them to collect and exchange data \u2013 and concerns have been raised that this is being developed without appropriate consideration of the security challenges involved.", "While the IoT creates opportunities for more direct integration of the physical world into computer-based systems,\nit also provides opportunities for misuse.", "In particular, as the Internet of Things spreads widely, cyber attacks are likely to become an increasingly physical (rather than simply virtual) threat." ] ], "gold": "Simplex communication is a communication channel that sends information in one direction only. For example, in TV and radio broadcasting information flows only from the transmitter site to multiple receivers. A unidirectional network, which is also referred to as a unidirectional gateway or data diode, is a network appliance or device that allows data to travel in only one direction. Data diodes are commonly found in high security military and government environments and are now becoming widely spread in sectors like oil and gas, water and wastewater, airplanes, manufacturing and cloud connectivity.", "prediction 1": "Simplex communication is a communication channel that sends information in one direction only. The International Telecommunication Union definition is a communications channel that operates in one direction at a time, but that may be reversible, thus the term half duplex in other contexts. The old Western Union company used the term simplex when describing the half-duplex and simplex capacity of their new transatlantic telegraph cable completed between Newfoundland and the Azores in 1928. The same definition for a simplex radio channel was used by the National Fire Protection Association in 2002.", "prediction 2": "A one way data transmission is a communication channel that sends information in one direction only. The International Telecommunication Union definition is a communications channel that operates in one direction at a time, but that may be reversible; this is termed half duplex in other contexts. The old Western Union company used the term simplex when describing the half-duplex and simplex capacity of their new transatlantic telegraph cable completed between Newfoundland and the Azores in 1928. A pair of walkie-talkie two-way radios provide a simplex circuit in the ITU sense; only one party at a time can talk, while the other listens until it can hear an opportunity to transmit. The transmission medium (the radio signal over the air) can carry information in only one direction.", "prediction 3": "The International Telecommunication Union defines a communications channel that operates in one direction at a time, but that may be reversible; this is termed half duplex in other contexts. A pair of walkie-talkie two-way radios provide a simplex circuit in the ITU sense; only one party at a time can talk, while the other listens until it can hear an opportunity to transmit. The transmission medium (the radio signal over the air) can carry information in only one direction.", "prediction 4": "The International Telecommunication Union defines a communications channel that operates in one direction at a time, but that may be reversible; this is termed half duplex in other contexts. The term \"simplex\" was used by The Western Union Company in 1928 to describe the half-duplex and simplex capacity of their new transatlantic telegraph cable completed between Newfoundland and the Azores in 1928. In this context, \"simplex\" communication is a communication channel that sends information in one way only.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 493 }, { "error type": "Irrelevant", "explanation": "", "start": 494, "end": 603 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Simplex communication is a communication channel that sends information in one direction only. For example, in TV and radio broadcasting, information flows only from the transmitter site to multiple receivers. The term half duplex is used in other contexts. The transmission medium (the radio signal over the air) can carry information in only one direction. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who won last year michigan or michigan state?", "passages": [ [ "Michigan\u2013Michigan State football rivalry", "Michigan State did not lead at any point in the game until time expired, but they outgained Michigan in the contest 386 to 230 yards. 2017", "October 7, 2017: For the first time, Michigan and Michigan State would meet for a night game in their 110th meeting.", "The game was held in Ann Arbor at the Big House at 7:30 PM on ABC.", "Michigan came into the game as #7 in the AP Poll and 4\u20130 on the season.", "The Michigan State Spartans came into the game unranked at 3\u20131 on the season, with their only loss at that point to Notre Dame in East Lansing.", "Michigan was 3\u20130 in night games at Michigan Stadium at the time.", "In the first quarter, Michigan would take the lead on a 30-yard field goal by Quinn Nordin to make the score 3 to 0.", "Michigan State would then score on a 14-yard touchdown run by Brian Lewerke.", "The score was 7 to 3, Spartans with the lead.", "In the second quarter, Michigan State would score again on a 16-yard pass from Brian Lewerke to Madre London.", "The score was 14\u20133 at halftime, with the Spartans leading in Ann Arbor.", "Towards the middle of the third quarter, it began to rain in Ann Arbor." ], [ "Michigan\u2013Michigan State football rivalry", "Michigan\u2013Michigan State football rivalry\n\nThe Michigan\u2013Michigan State football rivalry is an American college football rivalry between the University of Michigan Wolverines and Michigan State University Spartans.", "Since 1953, the winner of each year's game has received the Paul Bunyan Trophy.", "The teams first played in 1898 and have met almost every year since 1910 (exceptions in 1943 and 1944).", "44 of the first 50 games were played in Ann Arbor, but since then, U of M and MSU have played 30 home games against each other.", "The competition became a conference rivalry with Michigan State's entrance into the Big Ten Conference in 1950.", "The teams have met 110 times with Michigan winning 70 games, Michigan State winning 36 games, and five games ending with the score tied.", "Michigan dominated the series for the first half century, compiling a 33\u20136\u20133 record from 1898 to 1949.", "The tide shifted to Michigan State in the 1950s and 1960s, as the Spartans under head coaches Biggie Munn and Duffy Daugherty compiled a 14\u20134\u20132 record from 1950 to 1969.", "The tide then shifted back to the Wolverines as Michigan compiled a 30\u20138 record against the Spartans from 1970 to 2007.", "Since 2008, Michigan State has had the upper hand in the series with an 8\u20133 record.", "Michigan State's longest winning streak against Michigan is four games." ], [ "1950 Michigan State Spartans football team", "1950 Michigan State Spartans football team\n\nThe 1950 Michigan State Spartans football team represented Michigan State College in the 1950 college football season.", "In their fourth season under head coach Biggie Munn, the Spartans compiled an 8\u20131 record and were ranked #8 in the final AP Poll.", "Two Spartans received first-team honors on the 1950 College Football All-America Team.", "Fullback Sonny Grandelius received first-team honors from the Associated Press, International News Service, and Central Press Association, and end Dorne Dibble received the honors from the Football Writers Association of America.", "The 1950 Spartans won their annual rivalry games against Notre Dame by a 36-33 score and against Michigan by a 14 to 7 score.", "In intersectional play, the Spartans beat Oregon State (6-0), William & Mary (33-14), and Pitt (19-0).", "Michigan, ranked No. 3 in the country, opened the 1950 season playing against Michigan State College in Ann Arbor.", "Though favored by two touchdowns, the Wolverines were upset by the Spartans 14-7.", "The defeat was Michigan's first loss in the opening game of a season since 1937.", "Michigan played most of the game without its leading player, Chuck Ortmann.", "Ortmann was injured while being tackled on a 35-yard kickoff return in the first quarter." ] ], "gold": "The Michigan State University Spartans won the 2020 game, while Michigan won three out of four from 2016 to 2019. Previously, Michigan won in 2018 and 2016, and Michigan State won in 2017 and 2015.", "prediction 1": "The Michigan\u2013Michigan State football rivalry is an American college football rivalry between the University of Michigan Wolverines and the Michigan State Spartans. The Michigan Wolverines have won the rivalry 81 times since 1910, while the Michigan State Spartans have won 88 times since 1950. In 2017, Michigan State won the rivalry by a score of 31\u201310 in the fourth quarter. In 2016, Michigan State won the game by a score of 17\u20130 in the fourth quarter. In 2017, Michigan State also won by a score of 37\u20130 in the fourth quarter.", "prediction 2": "The Michigan\u2013Michigan State football rivalry is an American college football rivalry between the University of Michigan Wolverines and the Michigan State Spartans. Since 1953, the winner of each year's game has received the Paul Bunyan Trophy. In 2017, the winner of the Michigan State vs. Michigan State game was Brian Lewerke. In the 1950 competition, the Michigan State Spartans represented Michigan State College in the 1950 college football season.", "prediction 3": "The Michigan\u2013Michigan State football rivalry is an American college football rivalry between the University of Michigan Wolverines and the Michigan State University Spartans. Michigan State won the 2017 game against the University of Michigan 49ers, 35-24, in Ann Arbor, but the 2019 game between the Spartans and the Wolverines was won by the University of Michigan 49ers. The team has won more games than any other team over the years, as Michigan State is the current winner of the Paul Bunyan Trophy.", "prediction 4": "Michigan State University and the University of Michigan have fought since 1910 in the USC-Michigan State football rivalry. Since 1953, the winner of each year's game has received the Paul Bunyan Trophy. The teams have met 110 times with Michigan winning 70 games, Michigan State winning 36 games, and five games ending with the score tied. In the 1950 season, the Michigan State Spartans represented Michigan State College in the 1950 college football season. In the 2017 season, Michigan State won the Paul Bunyan Trophy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 163 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 164, "end": 229 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 240, "end": 293 }, { "error type": "Unverifiable", "explanation": "", "start": 318, "end": 376 }, { "error type": "Unverifiable", "explanation": "", "start": 386, "end": 455 }, { "error type": "Redundant", "explanation": "In 2017, Michigan State won the rivalry by a score of 31\u201310 in the fourth quarter.", "start": 456, "end": 464 }, { "error type": "Unverifiable", "explanation": "", "start": 465, "end": 530 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who was the lead singer of the manhattans?", "passages": [ [ "The Manhattans", "That year, Alston left to record as a solo artist, scoring with several major R&B hits in the late 1980s and early 1990s for Motown.", "Roger Harris was recruited as the new lead singer for the group, which moved to the new label, Valley Vue, when their Columbia recording contract expired.", "The group's largest shake-up was in December 1990, when Blue Lovett left the group, upon his doctor\u2019s request, for health reasons.", "Kenny Kelley left to return to college to pursue his PhD. Bivins continued along with lead singer Roger Harris who had replaced Gerald Alston in 1988-89 along with new members.", "He recruited new members Charles Hardy and Harsey Hemphill, who in October 1990 had auditioned for Bivins but didn't come aboard until after Lovett and Kelly left at the end of 1990.", "In early 1991 Bivins added Alvin Pazant, bringing the group back to a quintet.", "Harris proved to be only a short-term lead, and in April 1991 he was replaced by Wade Taylor.", "Taylor was replaced in July 1991 when Bivins recruited Lee Williams, the person whom they had originally wanted to replace George Smith.", "In the 2000s, there were two versions of The Manhattans.", "One version featured original founding member Bivins, plus Hardy, Hemphill, Pazant and Williams." ], [ "The Manhattans", "They released the CD \"Manhattans Now\" in 1994.", "In 1996 the group formed their own full-service music corporation company called Manhattan Entertainment Inc.", "In 2003 and 2007 they were featured artists in two theater plays, \"Girl He Aint Worth It\" and \"The Chicken Shack\".", "In June 2013, the group released a single called \"Just For Tonite\" written by Bivins and Pazant and produced and arranged by Leroy Burgess.", "In 2015 Lee Williams retired and was replaced by Keni Jackson as the new lead singer.", "And they still continue to perform, with the same line up in 2018.", "The other version of The Manhattans featured original member Blue Lovett.", "And Gerald Alston lead singer,on the group's biggest hits.", "Other members include Troy May and David Tyson, brother of The Temptations' Ron Tyson.", "In the past, the group also featured Eban Brown, who later spent eighteen years as lead vocalist for The Stylistics.", "This group has also released some CDs, including \"Even Now\".", "This version of the group was featured in two PBS specials and performed at casinos and theaters across the United States.", "Alston appeared on Wu-Tang Clan's album, \"8 Diagrams\", on the song \"Stick Me for My Riches\" in 2007." ], [ "The Manhattans", "The Manhattans\n\nThe Manhattans are an American popular R&B vocal group.", "Their work includes million-selling songs \"Kiss and Say Goodbye\" recorded in 1976 and 1980's \"Shining Star\".", "The Manhattans have recorded 45 chart hits on the Billboard R&B Chart, including twelve top 10 R&B hits in the United States charting on the Billboard chart for the first time in 1965.", "Sixteen of which reached the \"Billboard\" Hot 100, including two Top 10s and a number 1 hit with their song \"Kiss and Say Goodbye\".", "Their 1983 song \"Forever by Your Side\" remains especially popular in Brazil thirty years after its release.", "They also charted some 8 U.S. R&B Top 20 Albums, three of which were R.I.A.A. certified gold." ] ], "gold": "American R&B pop vocal group The Manhattans, originally from Jersey City, New Jersey, formed in 1962 with members George \"Smitty\" Smith, Edward \"Sonny\" Bivins, Winfred \"Blue\" Lovett, Kenny \"Wally\" Kelly, and Richard \"Ricky\" Taylor. Gerald Alston took over the lead spot of George Smith throughout the 1970s when Smith fell ill and died of a brain tumor on December 16, 1970, and he stayed with the group until 1988 when he left to record a solo album and Roger Harris took his place. In 1991, Wade Taylor ended up taking Roger Harris's place, who was quickly replaced with Lee Williams the same year. In 2015, Williams retired and was replaced by Keni Jackson.", "prediction 1": "The Manhattans are an American popular R&B vocal group. Their work includes million-selling songs Kiss and Say Goodbye recorded in 1976 and 1980's Shining Star. In 1988, lead singer Roger Harris replaced Gerald Alston. In 1991, lead singer Wade Taylor was replaced by Keni Jackson. In 2015, lead singer Keni Jackson replaced Roger Harris as the lead singer.", "prediction 2": "The Manhattans were an American popular R&B vocal group. During the 1980s and 1990s they had three different lead singers, Roger Harris, Gerald Alston, and Wade Taylor. On July 1, 1991, Harris was replaced by Lee Williams and in 2015, Keni Jackson became the new lead singer.", "prediction 3": "The Manhattans are an American popular R&B vocal group. Their work includes million-selling songs \"Kiss and Say Goodbye\" recorded in 1976 and 1980's \"Shining Star\". In 1988-89, lead singer Roger Harris replaced Gerald Alston. In 1991, lead singer Wade Taylor was replaced by Lee Williams. In 2015, lead singer Keni Jackson was replaced by lead singer Jerry Thomas.", "prediction 4": "The Manhattans are an American popular R&B vocal group whose work includes million-selling songs such as \"Kiss and Say Goodbye, \"recorded in 1976 and 1980's \"Shining Star\", and \"Forever by Your Side\", which continues to be popular today. Originally, Gerald Alston was lead singer for The Manhattans, and Roger Harris replaced him in 1988-89. In 1991, Wade Taylor was replaced by Lee Williams, and in 2015 Keni Jackson was replaced by the lead singer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 160 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 268, "end": 281 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 325, "end": 337 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Manhattans are an American popular R&B vocal group. In 1988, lead singer Roger Harris replaced Gerald Alston, who left to record as a solo artist. In 1991, lead singer Wade Taylor, who had replaced Harris, was replaced by Lee Williams that same year. In 2015, the lead singer was Keni Jackson who replaced Lee Williams after he retired." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who wrote wake me up when it's all over?", "passages": [ [ "Wake Me Up (Avicii song)", "Wake Me Up (Avicii song)\n\n\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album \"True\", released on CD and cassette by PRMD Music, Lava Records and Sony Music's Columbia Records on 17 June 2013.", "\"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc.", "American soul singer Aloe Blacc provides vocals for the track and Mike Einziger of Incubus provides acoustic guitar.", "Avicii introduced \"Wake Me Up!\"", "for the first time live on stage at the Ultra Music Festival in Miami.", "The experimental rendering (it was accompanied by a live band with instruments and vocalists, including Blacc, Einziger and Incubus members Ben Kenney on bass and Jos\u00e9 Pasillas on drums) reportedly confused and angered a section of the electronic dance festival community.", "Subsequently, Avicii achieved critical and commercial success with the release of the single worldwide.", "\"Wake Me Up\" peaked at number one in much of Europe and charted well in various countries." ], [ "Wake Me Up (Avicii song)", "but [with] no real lyrics.", "None of us [could] sing and we really needed to get that demo down and the only person I knew that lived in LA was Aloe, so I called him and he was free.", "Lyrics come really easy to him so he wrote them in a couple of hours and we finished the track.\"", "Aloe Blacc, who is not credited on the track, explained to \"The Huffington Post\": \"I started writing the lyrics at the top of 2013, travelling back from Switzerland.", "I started in hip hop music back in the 90s and I never expected to be singing and have an actual career as a musician, but I'm travelling all over the world and I thought 'Life is a dream, wake me up when it's all over'.", "I was invited to the studio with Avicii and Mike Einziger from Incubus, and when I got to the studio they had already come up with a chord progression of the song.", "I came in with the lyrics and I just developed the melody as I heard the chords, and we all thought it was something very strong.", "We finished the song that night as an acoustic version, then Avicii made the dance mix in a couple of days, and that's what we released to the world, and that was his release.\"" ], [ "Aloe Blacc", "Aloe Blacc\n\nEgbert Nathaniel Dawkins III (born January 7, 1979), known as Aloe Blacc (), is an American musician, singer, songwriter, record producer, actor, businessman and philanthropist.", "He is best known for his singles \"I Need a Dollar\", \"The Man\", which topped the charts in the United Kingdom, and for writing and performing vocals on Avicii's \"Wake Me Up\", which topped the charts in 22 countries, including Australia and the United Kingdom.", "Aside from his solo career, Blacc is also a member of musical duo Emanon, alongside American record producer Exile.", "Blacc was born Egbert Nathaniel Dawkins III in Southern California's Orange County to Panamanian parents.", "Growing up in Laguna Hills, he began playing a broken trumpet in third grade.", "When it made more sense to fix the instrument, Blacc had what he later described as a \"very specific moment\" in his evolution as a musician.", "\"It forced me to be serious about it.", "I couldn\u2019t just do it to annoy and get out of the class room,\" he said in a 2010 interview.", "His exposure to LL Cool J in fourth grade was equally significant." ] ], "gold": "\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album \"True\", released on CD and cassette by PRMD Music and Universal Music Group\u2019s Island Records on 17 June 2013. \"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc. Aloe Blacc is the stage name of Egbert Nathaniel Dawkins III, an American musician, singer, songwriter, rapper, record producer, and philanthropist.", "prediction 1": "Swedish DJ and record producer Avicii, Mike Einziger, and Aloe Blacc wrote Wake Me Up when it's all over, a song that debuted as the lead single from his debut studio album True on June 17, 2013. The song was written by Avicii, Mike Einziger, and Aloe Blacc.\n", "prediction 2": "Wake Me Up is a song by Swedish DJ and record producer Avicii which was written and performed by Avicii, Mike Einziger, and Aloe Blacc. American soul singer Aloe Blacc provided vocals for the track while Mike Einziger of Incubus provides acoustic guitar on the song.", "prediction 3": "In the same year that Swedish DJ and record producer Avicii released \"Wake Me Up\", an original song written by Avicii, Mike Einziger and Aloe Blacc for his debut studio album True titled Waking Up, the lyrics were also written by Aloe Blacc and Mike Einziger of pop band Incubus.", "prediction 4": "Avicii, Mike Einziger, and Aloe Blacc wrote the song Wake Me Up when it's all over. Lyrics come really easy to him so he wrote them in a couple of hours and we finished the track. Aloe Blacc, an American soul singer, was also the voice behind the song. Avicii sang the original song Wake Me Up when it was all over.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Swedish DJ and record producer Avicii, Mike Einziger, and Aloe Blacc wrote Wake Me Up when it's all over, a song that debuted as the lead single from his debut studio album True on June 17, 2013. ", "start": 196, "end": 259 }, { "error type": "Unverifiable", "explanation": "", "start": 86, "end": 105 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Wake Me Up\" was written by Swedish DJ and record producer Avicii, Mike Einziger, and Aloe Blacc. It debuted as the lead single from Avicii's debut studio album \"True\" on June 17, 2013 and was released on CD and cassette by PRMD Music and Universal Music Group's Island Records. Aloe Blacc is the stage name of Egbert Nathaniel Dawkins III, an American musician, singer, songwriter, record producer, and philanthropist.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang must be talking to an angel?", "passages": [ [ "There Must Be an Angel (Playing with My Heart)", "There Must Be an Angel (Playing with My Heart)\n\n", "\"There Must Be an Angel (Playing with My Heart)\" is a 1985 song written and performed by the British musical duo Eurythmics.", "Released as the second single from their fifth album \"Be Yourself Tonight\", the song features a harmonica solo by the American musician Stevie Wonder.", "The song became a worldwide success; most notably in Ireland, Norway and the United Kingdom, where it became the duo's only chart-topping single to date.", "The song has been covered by several musical artists, including Brittany Murphy, Fantastic Plastic Machine, Leningrad Cowboys, Luciano Pavarotti, Kylie Minogue, Jessica G. Piln\u00e4s and, most noticeably, German pop group No Angels who scored their second number-one hit in Austria and Germany with their interpretation for the reissue of their album \"Elle'ments\" in August 2001.", "Upon its release, \"There Must Be an Angel (Playing with My Heart)\" became Eurythmics' first (and to date only) number-one single in the UK, also topping the charts in Ireland, Norway and Brazil.", "While the song peaked at number 22 on the US \"Billboard Hot 100\", it became another Top 10 success for the band in Sweden, Belgium, the Netherlands, Germany, France, Austria and Australia." ], [ "Revival (Eurythmics song)", "Revival (Eurythmics song)\n\n\"Revival\" is a 1989 song by the British pop music duo Eurythmics.", "It was written by group members Annie Lennox and David A. Stewart, along with keyboardist Pat Seymour and vocalist Charlie Wilson (of The Gap Band) who also sang backing vocals for the track.", "Produced by Dave Stewart and Jimmy Iovine, it was the first single to be released from Eurythmics' 1989 album \"We Too Are One\".", "Lennox and Stewart returned to a rock/R&B sound for the album, and \"Revival\" is an uptempo tune which lyrically is a call for renewal and encouragement.", "The single reached number 26 in the UK, and was the duo's sixteenth (and final)", "Top 20 single in Australia.", "\"Revival\" was not released as a single in the United States.", "UK 7\" Single\n\nUK 12\" Single & CD Single" ] ], "gold": "\"There Must Be an Angel (Playing with My Heart)\" is a song by the British musical duo Eurythmics. The Eurythmics were composed by lead singer Annie Lennox and Dave Stewart", "prediction 1": "There Must Be an Angel (Playing with My Heart) is a 1985 song written and performed by the British musical duo Eurythmics. Released as the second single from their fifth album \"Be Yourself Tonight\", the song features a harmonica solo by the American musician Stevie Wonder. The song has been covered by several musical artists, including Brittany Murphy, Fantastic Plastic Machine, Leningrad Cowboys, Luciano Pavarotti, Kylie Minogue, Jessica G. Piln\u00e4s and German pop group No Angels who scored their second number-one hit in Austria and Germany with their interpretation for the reissue of their album \"Elle'ments\" in August 2001. \"Revival\" is a 1989 song by the British pop music duo Eurythmics. It was written by group members Annie Lennox and David A. Stewart, along with vocalist Charlie Wilson (of The", "prediction 2": "There Must Be an Angel (Playing with My Heart) is a 1985 song written and performed by the British musical duo Eurythmics. Released as the second single from their fifth album Be Yourself Tonight, the song features a harmonica solo by the American musician Stevie Wonder.", "prediction 3": "There Must Be an Angel (Playing with My Heart) is a 1985 song written and performed by the British musical duo Eurythmics that features a harmonica solo by the American musician Stevie Wonder. The song has been covered by several musical artists, including Brittany Murphy, Fantastic Plastic Machine, Leningrad Cowboys, Luciano Pavarotti, Kylie Minogue, Jessica G. Piln\u00e4s and, most noticeably, German pop group No Angels who scored their second number-one hit in Austria and Germany with their interpretation for the reissue of their album Elle'ments in August 2001, which also scored their second number-one hit in Austria and Germany with their interpretation for the reissue of their album Elle'ments in August 2001.", "prediction 4": "There Must Be an Angel is a song written and performed by the British musical duo Eurythmics and released in 1985 as the second single from their fifth album, Be Yourself Tonight. The song features a harmonica solo by the American musician Stevie Wonder. \"There Must Be an Angel (Playing with My Heart)\" is also a 1985 song written and performed by the British pop music duo Eurythmics, along with vocalist Charlie Wilson of The Gap Band, that also sang backing vocals for the track. \"Revival\" is a 1989 song by the British pop music duo Eurythmics. It was written by group members Annie Lennox and David A. Stewart, along with keyboardist Pat Seymour and vocalist Charlie Wilson (of The Gap Band) who also sang backing vocals for the track.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 765, "end": 807 }, { "error type": "Redundant", "explanation": "There Must Be an Angel (Playing with My Heart) is a 1985 song written and performed by the British musical duo Eurythmics. Released as the second single from their fifth album \"Be Yourself Tonight\", the song features a harmonica solo by the American musician Stevie Wonder. The song has been covered by several musical artists, including Brittany Murphy, Fantastic Plastic Machine, Leningrad Cowboys, Luciano Pavarotti, Kylie Minogue, Jessica G. Piln\u00e4s and German pop group No Angels who scored their second number-one hit in Austria and Germany with their interpretation for the reissue of their album \"Elle'ments\" in August 2001. \"Revival\" is a 1989 song by the British pop music duo Eurythmics. ", "start": 698, "end": 715 }, { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 484, "end": 631 }, { "error type": "Irrelevant", "explanation": "", "start": 632, "end": 697 } ], "missing-info": [], "corrected-prediction": "There Must Be an Angel (Playing with My Heart) is a 1985 song written and performed by the British musical duo Eurythmics, lead singer Annie Lennox and Dave Stewart. The song has been covered by several musical artists, including Brittany Murphy, Fantastic Plastic Machine, Leningrad Cowboys, Luciano Pavarotti, Kylie Minogue, Jessica G. Piln\u00e4s and, most noticeably, German pop group No Angels." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When was bread invented and who created it?", "passages": [ [ "History of bread", "History of bread\n\nBread was central to the formation of early human societies.", "From the western half of Asia, where wheat was domesticated, cultivation spread north and west, to Europe and North Africa.", "This in turn led to the formation of towns, as opposed to the nomadic lifestyle, and gave rise to more and more sophisticated forms of societal organization.", "Similar developments occurred in eastern Asia, centered on rice, and in the Americas with maize.", "Charred crumbs of a flatbread made by proto-Natufian hunter-gatherers from wild wheat, wild barley and plant roots between 14,600 and 11,600 years ago have been found at the Shubayqa 1 archaeological site in the Black Desert in Jordan, predating the earliest known making of bread from cultivated wheat by thousands of years.", "Bread is otherwise strongly associated with agriculture, and is found in Neolithic sites in Turkey and Europe from around 9,100 years ago.", "There is extensive evidence of breadmaking in Ancient Egypt in the form of artistic depictions, remains of structures and items used in bread making, and remains of the dough and bread itself.", "The most common source of leavening in antiquity was to retain a piece of dough (with sugar and water in) from the previous day to utilize as a form of sourdough starter." ] ], "gold": "Bread was first made between 14,600 and 11,600 years ago by Natufian hunter-gatherers.", "prediction 1": "Bread was central to the formation of early human societies. From the western half of Asia, where wheat was domesticated, cultivation spread north and west, to Europe and North Africa. This in turn led to the formation of towns, as opposed to a nomadic lifestyle, and gave rise to more and more sophisticated forms of societal organization. The earliest known making of bread from cultivated wheat is 14,600 years ago.", "prediction 2": "Bread was central to the formation of early human societies. Charred crumbs of a flatbread made by proto-Natufian hunter-gatherers from wild wheat, wild barley and plant roots between 14,600 and 11,600 years ago have been found at the Shubayqa 1 archaeological site in the Black Desert in Jordan, predating the earliest known making of bread from cultivated wheat by thousands of years.", "prediction 3": "It is not known when bread was invented and who created it. Charred crumbs of a flatbread made by proto-Natufian hunter-gatherers from wild wheat, wild barley and plant roots between 14,600 and 11,600 years ago have been found at the Shubayqa 1 archaeological site in the Black Desert in Jordan. This predates the earliest known making of bread from cultivated wheat by thousands of years. Bread is otherwise strongly associated with agriculture, and is found in Neolithic sites in Turkey and Europe from around 9,100 years ago.", "prediction 4": "Bread was central to the formation of early human societies. From the western half of Asia, where wheat was domesticated, cultivation spread north and west, to Europe and North Africa, which led to the formation of towns and gave rise to more and more sophisticated forms of societal organization. Charred crumbs of a flatbread made by proto-Natufian hunter-gatherers from wild wheat, wild barley and plant roots between 14,600 and 11,600 years ago have been found at the Shubayqa 1 archaeological site in the Black Desert in Jordan, predating the earliest known making of bread from cultivated wheat by thousands of years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 60 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 340 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The earliest known making of bread from cultivated wheat is from between 14,600 and 11,600 years ago, made by proto-Natufian hunter-gatherers." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who led the development of the ibm personal computer?", "passages": [ [ "IBM Personal Computer", "IBM Personal Computer\n\nThe IBM Personal Computer, commonly known as the IBM PC, is the original version and progenitor of the IBM PC compatible hardware platform.", "It is IBM model number 5150, and was introduced on August 12, 1981.", "It was created by a team of engineers and designers under the direction of Don Estridge of the IBM Entry Systems Division in Boca Raton, Florida.", "The generic term \"personal computer\" (\"PC\") was in use years before 1981, applied as early as 1972 to the Xerox PARC's Alto, but because of the success of the IBM Personal Computer, the term \"PC\" came to also mean more specifically a desktop microcomputer compatible with IBM's \"Personal Computer\" branded products.", "Since the machine was based on open architecture, within a short time of its introduction, third-party suppliers of peripheral devices, expansion cards, and software proliferated; the influence of the IBM PC on the personal computer market was substantial in standardizing a platform for personal computers.", "\"IBM compatible\" became an important criterion for sales growth; after the 1980s, only the Apple Macintosh family kept a significant share of the microcomputer market without compatibility with the IBM personal computer.", "International Business Machines (IBM), one of the world's largest companies, had a 62% share of the mainframe computer market in 1982." ], [ "Philip Don Estridge", "Philip Don Estridge\n\nPhilip Donald Estridge (June 23, 1937 \u2013 August 2, 1985), known as Don Estridge,\nled development of the original IBM Personal Computer (PC), and thus is known as \"father of the IBM PC\".", "His decisions dramatically changed the computer industry, resulting in a vast increase in sales of personal computers, thus creating an entire industry of hardware manufacturers of IBM PCs.", "Estridge was born in Jacksonville, Florida.", "His father was a professional photographer.", "He graduated from Bishop Kenny High School in 1955, and from the University of Florida in 1959.", "He married Mary Ann Hellier in September, 1958, and they had three children: Patricia Ann, Mary Evelyn and Sandra Marie.", "He completed a bachelor's degree in electrical engineering at the University of Florida and worked at the Army, designing a radar system using computers, IBM and finally NASA's Goddard Space Flight Center until he moved to Boca Raton, Florida in 1969.", "Before being the leader of the team to develop the IBM PC he had been the lead manager for the development of the IBM Series/1 mini-computer.", "After this project was unsuccessful, he was said to have fallen out of grace with IBM and was reassigned to headquarters staff \u2013 a position that IBM employees often considered a form of penalty." ] ], "gold": "The IBM personal computer was developed by a team of engineers and designers led by Philip Don Estridge in Boca Raton, Florida. The machine was based on open architecture and a substantial market of third-party peripherals, expansion cards and software grew up rapidly to support it. ", "prediction 1": "The IBM Personal Computer, commonly known as the IBM PC, is the original version and progenitor of the IBM PC compatible hardware platform. Don Estridge led the development of the original IBM Personal Computer, and thus is known as the \"father of the IBM PC\". Estridge's decisions dramatically changed the computer industry, resulting in a vast increase in sales of personal computers, thus creating an entire industry of hardware manufacturers of IBM PCs. Estridge, who was born in Jacksonville, Florida, led the development of the original IBM Personal Computer, and was known as Don Estridge.", "prediction 2": "The IBM Personal Computer (IBM PC) was developed by a team of engineers and designers under the direction of Don Estridge of the IBM Entry Systems Division in Boca Raton, Florida. Estridge, who was born on June 23, 1937, led the development of the original IBM Personal Computer (PC), and thus is known as the \"father of the IBM PC\".", "prediction 3": "The IBM Personal Computer, commonly known as the IBM PC, is the original version and progenitor of the IBM PC compatible hardware platform. Don Estridge, better known as Philip Don Estridge, led the development of the original IBM Personal Computer and is known as the \"father of the IBM PC.\" Estridge's decisions dramatically changed the computer industry, resulting in a vast increase in sales of personal computers, thus creating an entire industry of hardware manufacturers of IBM PCs. Estridge was a retired mechanical engineer at International Business Machines (IBM).", "prediction 4": "The IBM Personal Computer, commonly known as the IBM PC, was created by a team of engineers and designers under the direction of Don Estridge of the IBM Entry Systems Division in Boca Raton, Florida. Estridge led the development of the original IBM Personal Computer (PC), and thus is known as \"father of the IBM PC\". Estridge's decisions dramatically changed the computer industry, resulting in a vast increase in sales of personal computers, thus creating an entire industry of hardware manufacturers of IBM PCs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 457 }, { "error type": "Redundant", "explanation": "The IBM Personal Computer, commonly known as the IBM PC, is the original version and progenitor of the IBM PC compatible hardware platform. Don Estridge led the development of the original IBM Personal Computer, and thus is known as the \"father of the IBM PC\". Estridge's decisions dramatically changed the computer industry, resulting in a vast increase in sales of personal computers, thus creating an entire industry of hardware manufacturers of IBM PCs. ", "start": 458, "end": 596 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Don Estridge led the development of the original IBM Personal Computer, and thus is known as the \"father of the IBM PC\". Since the machine was based on open architecture, within a short time of its introduction, third-party suppliers of peripheral devices, expansion cards, and software proliferated; the influence of the IBM PC on the personal computer market was substantial in standardizing a platform for personal computers." }, "preference": [ 1, 0, 1, 2, 2, 0 ] }, { "question": "Who played the role of badri in badrinath ki dulhania?", "passages": [ [ "Badrinath Ki Dulhania", "Badrinath Ki Dulhania\n\nBadrinath Ki Dulhania (English: \"The Bride of Badrinath\") is a 2017 Indian romantic comedy film, directed by Shashank Khaitan, and produced by Karan Johar under the Dharma Productions banner.", "Starring Varun Dhawan and Alia Bhatt in the lead, the film marks the second installment of a franchise that began with \"Humpty Sharma Ki Dulhania\" (2014).", "Principal photography for the film began in May 2016, and the film was released on 10 March 2017, on the Holi weekend.", "The film received mixed to positive reviews from critics and was a box office success.", "It was the ninth-highest grossing Bollywood film of 2017.", "At the 63rd Filmfare Awards, it received eight nominations, including Best Film, Best Director for Khaitan, Best Actor for Dhawan, and Best Actress for Bhatt.", "Badrinath \"Badri\" Bansal (Varun Dhawan) is the younger son of a wealthy family in Jhansi." ], [ "Varun Dhawan", "Varun Dhawan\n\nVarun Dhawan (born 24 April 1987) is an Indian actor.", "One of the country's highest-paid celebrities, he has featured in \"Forbes India\" Celebrity 100 list since 2014.", "Each of the eleven films in which he has starred were commercially successful, establishing Dhawan in Hindi cinema.", "The son of film director David Dhawan", ", he studied business management from the Nottingham Trent University, after which he worked as an assistant director to Karan Johar on the 2010 drama \"My Name Is Khan\".", "Dhawan made his acting debut with Johar's 2012 teen drama \"Student of the Year\", for which he received a Filmfare nomination for Best Male Debut.", "Dhawan rose to prominence with starring roles in the romance \"Humpty Sharma Ki Dulhania\" (2014), the dance film \"ABCD 2\" (2015), and the action comedies \"Dilwale\" (2015), \"Dishoom\" (2016) and \"Judwaa 2\" (2017)." ] ], "gold": "In the 2017 film Badrinath Ki Dulhania, Indian actor Varun Dhawan played the role of Badri, whose role in the film was the younger son of Ambarnath \"Ambar\" Bansal.", "prediction 1": "Badrinath Ki Dulhania is a 2017 Indian romantic comedy film. It is the second installment of a franchise that began with \"Humpty Sharma Ki Dulhania\" (2014). Varun Dhawan played the role of Badrinath \"Badri\" Bansal in the film.", "prediction 2": "Badrinath Ki Dulhania is a 2017 Indian romantic comedy film directed by Shashank Khaitan and produced by Karan Johar under the Dharma Productions banner. Varun Dhawan plays the role of Badri. The film marks the second installment of a franchise that began with \"Humpty Sharma Ki Dulhania\" (2014).", "prediction 3": "Badrinath Ki Dulhania is a 2017 Indian romantic comedy film directed by Shashank Khaitan and produced by Karan Johar under the Dharma Productions banner. Varun Dhawan plays the character of Badri, the younger son of a wealthy family in Jhansi. In the film, Alia Bhatt plays the character of Badri.", "prediction 4": "Badrinath Ki Dulhania is a 2017 Indian romantic comedy film directed by Shashank Khaitan and produced by Karan Johar under the Dharma Productions banner. The film marks the second installment of a franchise that began with Husty Sharma Ki Dulhania (2014). Varun Dhawan played the character of Badrinath \"Badri\" Bansal.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 54 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 156 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Badrinath Ki Dulhania is a 2017 film in which Indian actor Varun Dhawan played the role of Badrinath \"Badri\" Bansal." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many super bowls did san francisco 49ers win?", "passages": [ [ "Bill Walsh (American football coach)", "The 49ers won Super Bowl XVI defeating the Cincinnati Bengals 26-21 in Pontiac, Michigan.", "Under Walsh the team rose from the cellar to the top of the NFL in just two seasons.", "The 49ers won Super Bowl championships in 1981, 1984 and 1988 seasons.", "Walsh served as 49ers head coach for 10 years, and during his tenure he and his coaching staff perfected the style of play known popularly as the West Coast offense.", "Walsh was nicknamed \"The Genius\" for both his innovative play calling and design.", "Walsh would regularly script the first 10-15 offensive plays before the start of each game.", "In the ten years during which Walsh was the 49ers' head coach, San Francisco scored 3,714 points (24.4 per game), the most of any team in the league during that span.", "In addition to Joe Montana, Walsh drafted Ronnie Lott, Charles Haley, and Jerry Rice.", "He also traded a 2nd and 4th round pick in the 1987 draft for Steve Young.", "His success with the 49ers was rewarded with his election to the Professional Football Hall of Fame in 1993.", "Montana, Lott, Haley, Rice and Young were also elected to the Hall of Fame.", "Many of Bill Walsh's assistant coaches went on to be head coaches themselves, including George Seifert, Mike Holmgren, Ray Rhodes, and Dennis Green." ], [ "San Francisco 49ers", "In the final home game for the 49ers at Kezar Stadium the 49ers kept up with the Cowboys before losing, 17\u201310, thus giving the Cowboys their first conference championship.", "The 49ers sent five players to the Pro Bowl that season, including MVP veteran quarterback John Brodie, wide receiver Gene Washington, and linebacker Dave Wilcox.", "Nolan was also named NFL Coach of the Year for 1970.", "Following the 1970 season the 49ers moved from Kezar Stadium to Candlestick Park.", "Despite being located on the outskirts of the city, Candlestick Park gave the 49ers a much more modern facility with more amenities that was easier for fans to access by highway.", "The 49ers won their second straight divisional title in 1971 with a 9\u20135 record.", "The 49ers again won their divisional playoff game, this time against the Washington Redskins by a 24\u201320 final score.", "This set up a rematch against the Dallas Cowboys in the NFC championship game, this time played in Dallas.", "Though the defense again held the Cowboys in check, the 49ers offense was ineffective and the eventual Super Bowl champion Cowboys beat the 49ers again, 14\u20133.", "In 1971, eight 49ers made the Pro Bowl, including defensive back Jimmy Johnson and Gene Washington, both for the second year in a row, as well as defensive end Cedric Hardman, running back Vic Washington, and offensive lineman Forrest Blue." ] ], "gold": "The 49ers have won 5 Super Bowl championships. 4 of their championships came in the 1980s and were led by Hall of Famers Joe Montana, Jerry Rice, Ronnie Lott, Steve Young and Charles Haley. Total, the 49ers have played in 7 Super Bowls, which ranks 3rd all-time in the NFL.", "prediction 1": "The San Francisco 49ers have won four Super Bowls. In 1981, 1984 and 1988, the 49ers won Super Bowl XVI defeating the Cincinnati Bengals 26-21 in Pontiac, Michigan. Walsh served as 49ers head coach for 10 years, and during his tenure he and his coaching staff perfected the style of play known popularly as the West Coast offense.", "prediction 2": "The San Francisco 49ers won two Super Bowls. They won one in 1980 and one in 1981. In 1984, they won one and in 1988 they won two. The 49ers won three Super Bowls in 1984 and 1988.", "prediction 3": "The San Francisco 49ers have won Super Bowl XVI in 1970, XVII in 1981, 1984, and 1988 seasons. During Bill Walsh's tenure as 49ers head coach, the team rose from the cellar to the top of the NFL in just two seasons. Walsh served as 49ers head coach for 10 years, and during his tenure he and his coaching staff perfected the style of play known popularly as the West Coast offense.", "prediction 4": "The San Francisco 49ers played in three Super Bowls, most notably Super Bowl XVI in 1981 and 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 164 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 51, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 330 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 33, "end": 37 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The San Francisco 49ers have won three Super Bowls. The 1981, 1984 and 1988 seasons. Their team had also drafted Joe Montana, Ronnie Lott, Charles Haley, and Jerry Rice and traded for Steve Young." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who built the first zero turn lawn mower?", "passages": [ [ "Zero-turn mower", "Steering controls differ on z-turn mowers.", "Instead of a steering wheel, most z-turns have two throttles that control the rotational speed and direction of each drive wheel.", "The throttles are typically moved by a seated driver who operates levers mounted waist to shoulder high.", "The mower's engine throttle is controlled separately, if at all.", "Some zero turn mowers are steered by a joystick or a steering wheel, the advantage of either one being the location of the hands may permit less fatigue during prolonged mowing and the use of a single hand for steering.", "In 1949, Warrensburg, MO resident Max Swisher invented the very first commercially available zero-turn mower and called it the \"Ride King\".", "It was a three-wheeled machine - one drive wheel in front and two in the rear.", "The patented system utilized the front wheel as the drive wheel that also was able to turn an amazing 360 degrees.", "The wheel was driven by the motor in the same direction 100% of the time.", "In order to reverse and/or utilize the zero turn capabilities, you simply turn the steering wheel 180 degrees and the mower would move in reverse.", "In 1963, John Regier was an employee of the Hesston Corporation, a manufacturer of farm and agricultural equipment." ], [ "Zero-turn mower", "The company had recently engineered a device called the swather, which, propelled by a series of belts, cut hay, alfalfa and other farming materials and laid them out in windrows.", "The way the belts and pulleys operated allowed for counter- rotation\u2014a process which particularly struck Regier.", "An idea came to him one day: What if he could incorporate the same technology into lawnmowers?", "\"So he went home and invented this thing that was able to operate on the zero-turn radius,\" says Ken Raney, advertising manager at Hustler Turf.", "\"He began selling them, but they weren\u2019t really taking off the way he wanted them to.", "Nobody knew the technology then, so nobody wanted to buy it.\"", "Regier's patent was eventually sold to Hesston, which would eventually become Excel Industries\u2014parent company of Hustler Turf.", "The mower was called\u2014appropriately enough\u2014the Hustler.", "\"We were the first company to offer mowers with zero-turn technology,\" says Paul Mullet, president of Excel Industries.", "\"After Regier sold us the patent, he came to work for us and the rest is history.\"" ] ], "gold": "In 1949, Warrensburg, MO resident Max Roper invented the very first commercially available zero-turn lawnmower and called it the Ride King. In 1963, Hesston Corporation was a manufacturer of farm and agricultural equipment that had recently engineered a device called the swather, which, propelled by a series of belts, cut hay, alfalfa and other farming materials and laid them out in windrows. One of their employees, John Regier, was struck by the swather's belt-and-pulley mechanism that allowed for counter-rotation. His idea was to use the same technology in lawnmowers. Regier's design ultimately became the first twin-lever zero-turn lawnmower. Regier's patent was eventually sold to Excel Industries. \"We were the first company to offer mowers with zero-turn technology,\" says Paul Mullet, president of Excel Industries. \"After Regier sold us the patent, he came to work for us and the rest is history.\"", "prediction 1": "Max Swisher built the first zero-turn lawn mower in 1949. In 1963, John Regier built the first zero-turn lawn mower.", "prediction 2": "Max Swisher built the very first zero-turn lawn mower in 1949, and in 1963, John Regier was an employee of the Hesston Corporation, a manufacturer of farm and agricultural equipment.", "prediction 3": "In 1949, Warrensburg, MO resident Max Swisher invented the very first commercially available zero-turn mower and called it the Ride King. It was a three-wheeled machine - one drive wheel in front and two in the rear. The patented system utilized the front wheel as the drive wheel that also was able to turn an amazing 360 degrees. In order to reverse and/or utilize the zero turn capabilities, you simply turn the steering wheel 180 degrees and the mower would move in reverse. John Regier's patent was eventually sold to Hesston, which would eventually become Excel Industries\u2014parent company of Hustler Turf.", "prediction 4": "In 1949, Warrensburg, MO resident Max Swisher invented the very first commercially available zero-turn mower and called it the Ride King. The patented system utilized the front wheel as the drive wheel that also was able to turn an amazing 360 degrees. In order to reverse and/or utilize the zero turn capabilities, you simply turn the steering wheel 180 degrees and the mower would move in reverse. In 1963, John Regier was an employee of the Hesston Corporation, a manufacturer of farm and agricultural equipment. \"After Regier sold us the patent, he came to Excel Industries and the first company to offer mowers with zero-turn technology,\" says Paul Mullet, president of Excel Industries.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 89, "end": 116 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": " In 1949, Warrensburg, MO resident Max Swisher invented the very first commercially available zero-turn mower and called it the \"Ride King\". In 1963, John Regier was an employee of the Hesston Corporation, a manufacturer of farm and agricultural equipment. The company had recently engineered a device called the swather, which, propelled by a series of belts, cut hay, alfalfa and other farming materials and laid them out in windrows. The way the belts and pulleys operated allowed for counter- rotation\u2014a process which particularly struck Regier. Regier's patent was eventually sold to Hesston, which would eventually become Excel Industries\u2014parent company of Hustler Turf. \"We were the first company to offer mowers with zero-turn technology,\" says Paul Mullet, president of Excel Industries. \"After Regier sold us the patent, he came to work for us and the rest is history.\"" }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "Who sang evermore in the movie beauty and the beast?", "passages": [ [ "Evermore (Beauty and the Beast song)", "Evermore (Beauty and the Beast song)\n\n\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film \"Beauty and the Beast\" (2017), a live-action remake of Disney's 1991 animated film of the same name.", "Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast, \"Evermore\" was first released as a single by American singer Josh Groban on March 3, 2017.", "Stevens' version became available on March 10, 2017 when the film's soundtrack was released online, while Groban's cover is played during the film's closing credits.", "In the animated film, the Beast barely sings because Menken and original \"Beauty and the Beast\" lyricist Howard Ashman had not been able to determine a moment in the film during which it would have been appropriate for the character to perform his own song.", "Initially, Menken had especially wanted the Beast to perform \"If I Can't Love Her\", a song he and Rice had written for the character to sing in stage adaptation of the animated film, in the remake, but ultimately decided that an entirely new song that establishes that the Beast has finally learned how to love instead would be more suitable due to the film's three-act structure." ] ], "gold": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film \"Beauty and the Beast\", a live-action remake of Disney's 1991 animated film of the same name. Actor Dan Stevens was the voice behind the song while the Beast sang it. ", "prediction 1": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film Beauty and the Beast. Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast. \"Evermore\" was first released as a single by American singer Josh Groban on March 3, 2017.", "prediction 2": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film Beauty and the Beast. Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast, \"Evermore\" was first released as a single by American singer Josh Groban on March 3, 2017. Stevens' version became available on March 10, 2017 when the film's soundtrack was released online, while Groban's cover is played during the film's closing credits.", "prediction 3": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film Beauty and the Beast (2017), a live-action remake of Disney's 1991 animated film of the same name. Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast, \"Evermore\" was first released as a single by American singer Josh Groban on March 3, 2017.", "prediction 4": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film Beauty and the Beast. Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast, \"Evermore\" was first released as a single by American singer Josh Groban on March 3, 2017. The original version of the song was performed by English actor Dan Stevens in the live-action remake of Disney's 1991 animated film of the same name.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 344 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Evermore\" is a song written by composer Alan Menken and lyricist Tim Rice for the musical fantasy film Beauty and the Beast, a live-action remake of Disney's 1991 animated film of the same name.. Originally recorded for the film by English actor Dan Stevens, who performs the song in his starring role as the titular Beast. " }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "How many ncaa basketball championships has ucla won?", "passages": [ [ "UCLA Bruins", "UCLA Bruins\n\nThe UCLA Bruins are the athletic teams that represent the University of California, Los Angeles.", "The Bruin men's and women's teams participate in NCAA Division I as part of the Pac-12 Conference and the Mountain Pacific Sports Federation (MPSF).", "For football, they are in the Football Bowl Subdivision of Division I (formerly Division I-A).", "UCLA is second to only Stanford University as the school with the most NCAA team championships at 116 NCAA team championships.", "UCLA offers 11 varsity sports programs for men and 14 for women.", "The UCLA athletic teams' colors are True Blue and Gold.", "In the early days of the school, UCLA had the same colors as the University of California, Berkeley; Yale blue and gold.", "When football coach Red Sanders came to UCLA for the 1949 season he redesigned the football uniforms.", "The Yale blue was changed to a lighter shade of blue.", "Sanders figured that the baby blue would look better on the field and in a film.", "He would dub the baby blue uniform \"Powderkeg blue\", powder blue with an explosive kick.", "For the 1954 football season, Sanders added a gold loop on the shoulders, the UCLA Stripe.", "UCLA still uses different color blues.", "They have an alternate uniform that is predominately Navy.", "Their helmet has the UCLA script in Royal." ], [ "UCLA Bruins men's basketball", "UCLA Bruins men's basketball\n\nEstablished in 1919, the program has won a record 11 NCAA titles.", "UCLA teams coached by John Wooden won 10 national titles in 12 seasons, from 1964 to 1975, including seven straight from 1967 to 1973.", "UCLA went undefeated a record four times, in 1964, 1967, 1972, and 1973.", "Coach Jim Harrick led the team to another NCAA title in 1995.", "Former coach Ben Howland led UCLA to three consecutive Final Four appearances from 2006 to 2008.", "As a member of the AAWU, Pacific-8 and then Pacific-10, UCLA set a NCAA Division I record with 13 consecutive regular season conference titles between 1967 and 1979 which stood until passed by Kansas in 2018.", "On March 30, 2013, Steve Alford was named the school's 13th head men's basketball coach.", "UCLA men's basketball has set several NCAA records.", "* 1980 tournament final vacated by NCAA\n\n** Surpassed by Kansas in 2018\n\n", "In 1919, Fred Cozens became the first head coach of the UCLA basketball and football teams.", "Cozens coached the basketball team for two seasons, finishing with an overall record of 21\u20134.", "Caddy Works was the head coach of the Bruins from 1921 to 1939, guiding them to a 173-159 record." ], [ "UCLA Bruins women's basketball", "UCLA Bruins women's basketball\n\nThe UCLA Bruins women's basketball program was established in 1974.", "The current coach is Cori Close.", "The team was a member of the AIAW until joining the NCAA in 1984.", "The UCLA Bruins women's basketball team won the AIAW championship in 1978, and a banner commemorating the championship hangs in Pauley Pavilion, the current home of the Bruins basketball teams.", "The 2014\u201315 team won the 2015 WNIT championship.", "While Pauley Pavilion was being renovated, the women's basketball team played its 2011\u201312 season home games at the John Wooden Center.", "The 1978 team led by Ann Meyers, Denise Curry and Anita Ortega won the AIAW National Championship under head coach Billie Moore.", "Conference tournament winners noted with # Source" ], [ "2014\u201315 UCLA Bruins women's basketball team", "2014\u201315 UCLA Bruins women's basketball team\n\n", "The 2014\u201315 UCLA Bruins women's basketball team represented the University of California, Los Angeles during the 2014\u201315 NCAA Division I women's basketball season.", "The Bruins, led by fourth year head coach Cori Close, play their home games at the Pauley Pavilion and were members of the Pac-12 Conference.", "The Bruins finished in 6th place in the Pac-12 Conference and were selected to play in the WNIT.", "The Bruins defeated the West Virginia Mountaineers 62\u201360 for the WNIT championship on April 4, 2015.", "Jordin Canada was the tournament's most valuable player." ] ], "gold": "The UCLA Bruins men's basketball team has won 11 NCAA Division I championship titles since their establishment in 1919, including seven consecutive national titles won from 1967 to 1973. The UCLA women's basketball team hasn't won any NCAA titles since their establishment in 1974, but did win the NIT in 2015.", "prediction 1": "The UCLA Bruins basketball program has won a record 11 NCAA championships since 1919. In the last decade, the UCLA Bruins women's basketball team has won three WNIT championships and one AIAW championship. In the last 10 years, the UCLA men's basketball team has won three WNIT championships. In the last 10 years, the UCLA women's basketball team has won seven WNIT championships.", "prediction 2": "The UCLA Bruins basketball program is a member of the Pac-12 Conference and the Mountain Pacific Sports Federation and is part of the Pac-12 Conference. Established in 1919, the program has won a record 11 NCAA titles. Teams coached by John Wooden won 10 national titles in 12 seasons, from 1964 to 1975, including seven straight from 1967 to 1973. The UCLA Bruins women's basketball team won the AIAW championship in 1978, and a banner commemorating the championship hangs in Pauley Pavilion, the current home of the UCLA basketball program.", "prediction 3": "The UCLA Bruins basketball program has won a total of 116 NCAA team championships, including 11 NCAA men's basketball titles, 10 NCAA women's basketball championships, and 9 NCAA women's basketball championships. Since joining the NCAA in 1984, the UCLA Bruins women's basketball program has won a total of 17 NCAA conference championships. The UCLA Bruins women's basketball team has won a total of 17 NCAA conference championships. The UCLA Bruins women's basketball team won the AIAW championship in 1978, and the current head coach is Cori Close. The UCLA Bruins women's basketball team has won a total of 13 NCAA Division I Championships.", "prediction 4": "The UCLA Bruins have won a total of 116 NCAA basketball titles. In the men's basketball department, the UCLA Bruins have won 11 NCAA titles. The UCLA Bruins women's basketball team has won 3 NCAA basketball championships. The UCLA Bruins women's basketball program has won 5 NCAA basketball championships.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 292 }, { "error type": "Redundant", "explanation": "The UCLA Bruins basketball program has won a record 11 NCAA championships since 1919. In the last decade, the UCLA Bruins women's basketball team has won three WNIT championships ", "start": 293, "end": 381 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 154, "end": 159 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The UCLA Bruins basketball program has won a record 11 NCAA championships since 1919. Including seven straight national titles from 1967 to 1973. In the last decade, the UCLA Bruins women's basketball team, established in 1974, have won the 2015 WNIT championship. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who developed one of the earliest versions of social exchange theory?", "passages": [ [ "Social exchange theory", "Social exchange theory\n\n\"Social exchange theory\" is a Sociological and Psychological theory that studies the social behavior in the interaction of two parties that implement a cost-benefit analysis to determine risks and benefits.", "Also, the theory involves economic relationships, it occurs when each party have goods that the other parties value.", "Social exchange theory suggests that these calculations occur on romantic relationships, friendships, professional relationships and ephemeral relationships as simple as exchanging words with a customer at the cash register.", "During the beginning of this theory, The most comprehensive social exchange theories are those of the American social psychologists John W. Thibaut (1917-1986) and Harold H. Kelley (1921-2003), the American sociologists George C. Homans (1910-1989), Peter M. Blau (1918-2002), Richard Marc Emerson (? - 1982), and Claude L\u00e9vi-Strauss (1908-2009) .", "He defined social exchange as the exchange of activity, tangible or intangible, and more or less rewarding or costing between at least two persons.", "After Homans founded the theory, other theorists continued to write about it, particularly Peter M. Blau and Richard M. Emerson, who in addition to Homans are generally thought of as the major developers of the exchange perspective within sociology.", "Homans' work emphasized the individual behavior of actors in interaction with one another." ] ], "gold": "Social exchange theory is a sociological and psychological theory that studies the social behavior in the interaction of two parties that implement a cost-benefit analysis to determine risks and benefits, as well as economic relationships\u2014the cost-benefit analysis occurs when each party has goods that the other parties value. During the beginning of this theory, the most comprehensive social exchange theories are those of the American social psychologists John W. Thibaut 1917\u20131986, and Harold H. Kelley 1921\u20132003. And American sociologists George C. Homans 1910\u20131989, Peter M. Blau 1918-2002, Richard Marc Emerson, died in 1982, and Claude L\u00e9vi-Strauss 1908\u20132009.", "prediction 1": "George C. Homans developed one of the earliest versions of social exchange theory, while Peter M. Blau and Richard M. Emerson developed another.", "prediction 2": "The American sociologists George C. Homans, who founded the theory in 1910, and Peter M. Blau, who later wrote about it, are generally thought of as the major developers of the exchange perspective within sociology.", "prediction 3": "\"Social exchange theory\" is a Sociological and Psychological theory that studies the social behavior in the interaction of two parties that implement a cost-benefit analysis to determine risks and benefits. Also, the theory involves economic relationships, it occurs when each party have goods that the other parties value. The American sociologists George C. Homans (1910-1989), Peter M. Blau (1918-2002), Richard Marc Emerson (? - 1982), and Claude L\u00e9vi-Strauss (1908-2009) are generally thought of as the major developers of the exchange perspective within sociology.", "prediction 4": "The American social psychologist John W. Thibaut developed one of the earliest versions of Social exchange theory. Also, the American sociologists George C. Homans developed another one, as well. Peter M. Blau developed another version of Social exchange theory, which is a Sociological and Psychological theory that studies the social behavior in the interaction of two parties that implement a cost-benefit analysis to determine risks and benefits.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 17, "end": 144 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Social exchange theory is a sociological and psychological theory that studies the social behavior in the interaction of two parties that implement a cost-benefit analysis to determine risks and benefits, as well as economic relationships\u2014the cost-benefit analysis occurs when each party has goods that the other parties value. During the beginning of this theory, the most comprehensive social exchange theories are those of the American social psychologists John W. Thibaut 1917\u20131986, and Harold H. Kelley 1921\u20132003 and American sociologists George C. Homans (1910-1989), Peter M. Blau (1918-2002) and Richard M. Emerson (? - 1982), and Claude L\u00e9vi-Strauss (1908\u20132009)." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "What defcon level is the us at right now?", "passages": [ [ "DEFCON", "The U.S. became concerned that the Soviet Union might intervene, and on October 25, U.S. forces, including Strategic Air Command, Continental Air Defense Command, European Command and the Sixth Fleet, were placed at DEFCON 3.", "According to documents declassified in 2016, the move to DEFCON 3 was motivated by Central Intelligence Agency reports indicating that the Soviet Union had sent a ship to Egypt carrying nuclear weapons along with two other amphibious vessels.", "Soviet troops never landed, though the ship supposedly transporting nuclear weapons did arrive in Egypt.", "Further details are unavailable and remain classified.", "Over the following days, the various forces reverted to normal status with the Sixth Fleet standing down on November 17.", "Following the axe murder incident at Panmunjom on August 18, 1976, readiness levels for American forces in South Korea were increased to DEFCON 3, where they remained throughout Operation Paul Bunyan.", "During the attacks of September 11, 2001, the U.S. Secretary of Defense Donald Rumsfeld ordered the increased DEFCON level to 3, and also a stand-by for a possible increase to DEFCON 2." ], [ "DEFCON", "In October 1959, the JCS Chairman informed NORAD \"that Canada and the U.S. had signed an agreement on increasing the operational readiness of NORAD forces during periods of international tension.\"", "After the agreement became effective on 2 October 1959, the JCS defined a system with DEFCONs in November 1959 for the military commands.", "The initial DEFCON system had \"Alpha\" and \"Bravo\" conditions (under DEFCON 3) and Charlie/Delta under DEFCON 4, plus an \"Emergency\" level higher than DEFCON 1 with two conditions: \"Defense Emergency\" and the highest, \"Air Defense Emergency\" (\"Hot Box\" and \"Big Noise\" for exercises).", "During the Cuban Missile Crisis on October 22, 1962, the U.S. Armed Forces (with the exception of United States Army Europe (USAREUR)) were ordered to DEFCON 3.", "On October 24, Strategic Air Command (SAC) was ordered to DEFCON 2, while the rest of the U.S. Armed Forces remained at DEFCON 3.", "SAC remained at DEFCON 2 until November 15.", "On January 15, 1991, the Joint Chiefs of Staff declared DEFCON 2 in the opening phase of Operation Desert Storm during the Persian Gulf War.", "On October 6, 1973, Egypt and Syria launched a joint attack on Israel resulting in the Yom Kippur War." ], [ "DEFCON", "DEFCON\n\nThe defense readiness condition (DEFCON) is an alert state used by the United States Armed Forces.", "The DEFCON system was developed by the Joint Chiefs of Staff (JCS) and unified and specified combatant commands.", "It prescribes five graduated levels of readiness (or states of alert) for the U.S. military.", "It increases in severity from DEFCON 5 (least severe) to DEFCON 1 (most severe) to match varying military situations.", "DEFCONs are a subsystem of a series of Alert Conditions, or LERTCONs, which also include Emergency Conditions (EMERGCONs).", "The DEFCON level is controlled primarily by the U.S. president and the U.S. Secretary of Defense through the Chairman of the Joint Chiefs of Staff and the Combatant Commanders; each DEFCON level defines specific security, activation and response scenarios for the personnel in question.", "Different branches of the U.S. Armed Forces (i.e. U.S. Army, U.S. Navy, U.S. Air Force, U.S. Marine Corps, U.S. Coast Guard) and different bases or command groups can be activated at different defense conditions.", "In general, there is no single DEFCON status for the world or country and it may be set to only include specific geographical areas." ] ], "gold": "The DEFCON system was developed by the Joint Chiefs of Staff (JCS) and unified and specified combatant commands. During the attacks of September 11, 2001, the U.S. Secretary of Defense Donald Rumsfeld ordered to increase the DEFCON level to 3, and also a stand-by for a possible increase to DEFCON 2. It was lowered to DEFCON 4 on September 14.", "prediction 1": "The defense readiness condition (DEFCON) is an alert state used by the United States Armed Forces. The DEFCON system was developed by the Joint Chiefs of Staff and unified and specified combatant commands. It prescribes five graduated levels of readiness, or states of alert, for the U.S. military. It increases in severity from DEFCON 5 (least severe) to DEFCON 1 (most severe).", "prediction 2": "The defense readiness condition (DEFCON) is an alert state used by the United States Armed Forces. It has different levels depending on the specific operational situation. For example, the US is currently at DEFCON 3 (severe).", "prediction 3": "The defense readiness condition (DEFCON) is an alert state used by the United States Armed Forces. It was developed by the Joint Chiefs of Staff and unified and specified combatant commands. It prescribes five graduated levels of readiness (or states of alert) for the U.S. military. It increases in severity from DEFCON 5 (least severe) to DEFCON 1 (most severe) to match varying military situations.", "prediction 4": "The defense readiness condition (DEFCON) is an alert state used by the United States Armed Forces. It is controlled primarily by the U.S. president and the U.S. Secretary of Defense through the Chairman of the Joint Chiefs of Staff and the Combatant Commanders. It prescribes five graduated levels of readiness (or states of alert) for the U.S. military. It increases in severity from DEFCON 5 (least severe) to DEFCON 1 (most severe) to match varying military situations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 379 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": " The DEFCON system was developed by the Joint Chiefs of Staff and unified and specified combatant commands. The U.S. Secretary of Defense, Donald Rumsfeld, ordered to increase the DEFCON level to 3, and also a stand-by for a possible increase to DEFCON 2 during the attacks of September 11, 2001." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Where was the movie red dawn filmed at?", "passages": [ [ "Red Dawn", "Red Dawn\n\nRed Dawn is a 1984 American war film directed by John Milius, with a screenplay by Kevin Reynolds and Milius.", "It stars Patrick Swayze, C. Thomas Howell, Lea Thompson, Jennifer Grey, Ben Johnson, Harry Dean Stanton, Ron O'Neal, William Smith, and Powers Boothe.", "It was the first film to be released in the US with a PG-13 rating (under the modified rating system introduced on July 1, 1984).", "The film is set in an alternate history timeline in which the United States is invaded by the Soviet Union and its Cuban and Nicaraguan allies.", "However, the onset of World War III is in the background and not fully elaborated.", "The story follows a group of American high school students who resist the occupation with guerrilla warfare, calling themselves \"Wolverines\", after their high school mascot.", "The United States has gradually become strategically isolated after several European nations (except the United Kingdom) withdraw from NATO.", "At the same time, the Soviet Union and its Warsaw Pact partners aggressively expand their sphere of influence.", "In addition, the Ukrainian wheat harvest fails while a communist \"coup d'etat\" occurs in Mexico.", "On a September morning, in the small town of Calumet, Colorado, a local high school teacher pauses when he sees Soviet paratroopers landing in a nearby field.", "The paratroopers open fire when the teacher confronts them." ], [ "Red Dawn", "In fact, everything that happened in the movie happened in World War Two.\"", "The movie was filmed in and around the city of Las Vegas, New Mexico.", "Many of the buildings and structures which appeared in the film, including a historic Fred Harvey Company hotel adjacent to the train depot, the train yard, and a building near downtown, which was repainted with the name of \"Calumet, Colorado\", are still there today.", "An old Safeway grocery store was converted to a sound stage and used for several scenes in the movie.", "Before starting work on the movie, the cast underwent an intensive eight-week military training course.", "During that time, production crews designed and built special combat vehicles in Newhall, California.", "\"Soldier of Fortune\" reported that the movie's T-72 tank was such a precise replica that \"while it was being carted around Los Angeles, two CIA intelligence officers followed it to the studio and wanted to know where it had come from\".", "Powers Boothe later claimed \"Milius cut out the emotional life of its characters.", "Originally, my character was anti-war, as well as a rightist.", "I was supposed to be the voice of reason in that movie.", "But certain cuts negated my character.\"" ], [ "Red Dawn (2012 film)", "Red Dawn (2012 film)\n\n", "Red Dawn is a 2012 American war film directed by Dan Bradley.", "The screenplay by Carl Ellsworth and Jeremy Passmore is based on the 1984 film of the same name.", "The film stars Chris Hemsworth, Josh Peck, Josh Hutcherson, Adrianne Palicki, Isabel Lucas, and Jeffrey Dean Morgan.", "The film centers on a group of young people who defend their hometown from a North Korean invasion.", "Metro-Goldwyn-Mayer announced its intention to remake \"Red Dawn\" in May 2008 and subsequently hired Bradley and Ellsworth.", "The principal characters were cast the following year and the film went into production in September 2009 in Mount Clemens, Michigan.", "Originally scheduled to be released on November 24, 2010, the film was shelved because of MGM's financial troubles.", "While in post-production, the invading army and antagonists were changed from Chinese to North Korean in order to maintain access to the Chinese box office, though the film was still not released in China.", "FilmDistrict bought the worldwide distribution rights in September 2011 and the film was released in the United States on November 23, 2012.", "An introductory montage shows the fallout of an economic crisis in the European Union and a weakened NATO alliance, amid increasing cooperation between an increasingly militant North Korea and ultranationalist-controlled Russia." ], [ "Red Dawn (2012 film)", "Later the same month, MGM announced that Dan Bradley had been confirmed as the director with Carl Ellsworth, screenwriter of \"Red Eye\" and \"Disturbia\", writing the updated screenplay.", "Ellsworth worked from a story written by Jeremy Passmore.", "Vincent Newman (\"A Man Apart\") was announced as the producer.", "Australian Chris Hemsworth was cast in a lead role: other cast members include Josh Peck, Adrianne Palicki, Josh Hutcherson, Isabel Lucas, Edwin Hodge, and Connor Cruise.", "Principal photography began September 2009 in Mount Clemens, Michigan.", "The closed Notre Dame High School in Harper Woods, Michigan (Greater Detroit) was used as a filming location.", "Mark Binelli, author of \"Detroit City is the Place to Be\", wrote that the school cafeteria was used as the catering hall for the employees.", "According to photographs taken on set, the film features propaganda pamphlets, posters, and banners featuring People's Liberation Army symbols, such as the August 1 star.", "The posters attempt to garner support for a Chinese occupation, with slogans such as \"\"Rebuilding Your Reputation\"\", \"\"Repairing Your Economy\"\", and \"\"Fighting Corporate Corruption\"\".", "In June 2010, release of the film was delayed by MGM\u2019s financial difficulties." ] ], "gold": "The 1984 action film Red Dawn was filmed in and around Las Vegas, New Mexico. Many of the buildings and structures which appear in the film are still there today. The 2012 remake of Red Dawn began principal photography in Mount Clemens, Michigan, and used the closed Notre Dame High School in Harper Woods, Michigan as a filming location.", "prediction 1": "The 1984 American war film Red Dawn was filmed in and around the city of Las Vegas, New Mexico. Many of the buildings and structures which appeared in the movie, including a historic Fred Harvey Company hotel adjacent to the train depot, the train yard, and a building near downtown, which was repainted with the name of \"Calumet, Colorado\", are still there today. The 2012 American war film Red Dawn is a remake of the 1984 film. The screenplay by Carl Ellsworth and Jeremy Passmore is based on the 1984 American war film of the same name.\n", "prediction 2": "The 1984 American war film Red Dawn was filmed in and around the city of Las Vegas, New Mexico. Many of the buildings and structures which appeared in the movie, including a historic Fred Harvey Company hotel adjacent to the train depot, the train yard, and a building near downtown, which was repainted with the name of \"Calumet, Colorado\", are still there today. Red Dawn: Invasion, a remake of the 1984 film, was filmed in and around the city of Las Vegas, New Mexico. A 2012 American remake of the 1984 film of the same name, with a remake.", "prediction 3": "Movie Red Dawn, a 1984 American war film, was filmed both in and around the city of Las Vegas, New Mexico. Many of the buildings and structures which appeared in the 1984 film, including a historic Fred Harvey Company hotel adjacent to the train depot, the train yard, and a building near downtown, which was repainted with the name of \"Calumet, Colorado\", are still there today. Red Dawn: A World War II War Story, the 2012 American war film that was based on the 1984 movie went into production in September 2009 in Mount Clemens, Michigan. The 2012 American film was based on the 1984 film, which was filmed in and around the city of Las Vegas, New Mexico.", "prediction 4": "Red Dawn is a 1984 American action film set in World War Two and is based on real events. The film is set in a fictional world in which the United States is invaded by the Soviet Union and its Cuban and Nicaraguan allies. Red Dawn, a 2012 American war film directed by Dan Bradley, was originally scheduled to be released on November 24, 2010, but was shelved due to MGM's financial concerns. Thereafter, Metro-Goldwyn-Mayer announced its intention to remake Red Dawn in 2008 and subsequently hired Bradley and Ellsworth to direct the 2012 movie.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 413, "end": 430 }, { "error type": "Irrelevant", "explanation": "", "start": 431, "end": 541 }, { "error type": "Redundant", "explanation": "The 1984 American war film Red Dawn", "start": 374, "end": 400 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": "The 1984 American war film Red Dawn was filmed in and around the city of Las Vegas, New Mexico. Many of the buildings and structures which appeared in the movie, are still there today. The 2012 remake principal photography began September 2009 in Mount Clemens, Michigan, and the closed Notre Dame High School in Harper Woods, Michigan (Greater Detroit) was used as a filming location.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who died in the plane crash grey's anatomy?", "passages": [ [ "Flight (Grey's Anatomy)", "The episode opened to mixed reviews from television critics, with some criticizing the death of Lexie, but praising Leigh's performance, in addition to Ellen Pompeo (Dr. Meredith Grey)'s and Eric Dane (Dr. Mark Sloan)'s.", "\"Flight\" earned Rhimes an NAACP Image Award nomination and it was also nominated under several categories of \"Entertainment Weekly\" finale awards.", "Upon its initial airing, the episode was viewed in the United States by 11.44\u00a0million people, garnered a 4.1/11 Nielsen rating/share in the 18\u201349 demographic, ranking fourth for the night in terms of viewership, and registering as Thursday's highest-rated drama.", "After their plane crashes in the woods, Dr. Meredith Grey (Ellen Pompeo), Dr. Lexie Grey (Chyler Leigh), Dr. Cristina Yang (Sandra Oh), Dr. Arizona Robbins (Jessica Capshaw), Dr. Derek Shepherd (Patrick Dempsey), and Dr. Mark Sloan (Eric Dane) desperately fight to stay alive.", "Meredith is relatively unscathed, while the rest have serious injuries: the pilot, Jerry (James LeGros), has a major spine injury, and Yang dislocates her arm.", "Robbins' femur is broken and sticking through the skin, Sloan has serious internal injuries; though initially adrenaline keeps him on his feet." ], [ "Lexie Grey", "The pair try in vain to free Lexie, who realizes that she is suffering from a hemothorax and is unlikely to survive.", "While Cristina tries to find an oxygen tank and water to save Lexie, Mark holds Lexie's hand and professes his love for her, telling her that they will get married, have kids and live the best life together, as they are \"meant to be\".", "While fantasizing about the future that she and Mark could have had together, Lexie succumbs to her injuries and dies moments before Meredith arrives.", "The remaining doctors are left stranded in the woods waiting for rescue, with a devastated Meredith crying profusely and Mark refusing to let go of Lexie's hand.", "In season 9, the remaining surgeons are rescued from the wilderness days later, and Lexie's body is returned to Seattle.", "Still devastated by Lexie's passing, Mark advises his prot\u00e9g\u00e9 Jackson, 'when you love someone, tell them', which Mark felt that he did not tell Lexie enough when she was alive.", "Mark subsequently makes a clean break with Julia, stating that he had always only truly loved Lexie.", "Mark is soon placed on life support due to the extensive internal injuries he sustained during the plane crash and, as determined by his will, the machines keeping him alive are eventually turned off as he showed no signs of waking after 30 days." ], [ "Lexie Grey", "Alex, Jackson and April move out of Meredith's house without inviting Lexie to join them, and with Derek and Meredith settling down with baby Zola, Lexie begins to feel lonely and isolated.", "After being left babysitting Zola on Valentine's Day, she contemplates confessing her true feelings to Mark.", "However, after plucking up the courage to visit his apartment, she finds Mark studying with Jackson and loses her nerve, instead claiming that she wanted to set up a play date for Zola and Sofia.", "When Mark confides in Derek that he and Julia have been discussing moving in together, Derek warns Lexie not to miss her chance again, resulting in her professing her love to a shell-shocked Mark, who merely thanks her for her candor.", "Mark later confesses to Derek that he feels the same way about Lexie, but is unsure of how to go about things.", "Days later, Lexie is named as part of a team of surgeons that will be sent to Boise to separate conjoined twins, along with Mark, Meredith, Derek, Cristina and Arizona Robbins (Jessica Capshaw).", "However, while flying to their destination, the doctors' plane crashes in the wilderness and Lexie is crushed under debris from the aircraft but manages to alert Mark and Cristina to help her." ], [ "Flight (Grey's Anatomy)", "Flight (Grey's Anatomy)\n\n\"Flight\" is the twenty-fourth and final episode of the eighth season of the American television medical drama \"Grey's Anatomy\", and the show's 172nd episode overall.", "It was written by series creator Shonda Rhimes, and directed by Rob Corn.", "The episode was originally broadcast on the American Broadcasting Company (ABC) in the United States on May 17, 2012.", "In the episode, six doctors from Seattle Grace Mercy West Hospital who are victims of an aviation accident fight to stay alive, but Dr. Lexie Grey (Chyler Leigh) ultimately dies.", "Other storylines occur in Seattle where Dr. Richard Webber (James Pickens, Jr.) plans his annual dinner for the departing residents, Dr. Owen Hunt (Kevin McKidd) fires Dr. Teddy Altman (Kim Raver), and Dr. Miranda Bailey (Chandra Wilson) gets engaged.", "The episode marked Leigh's final appearance in the series and Raver's last until late in the fourteenth season.", "Exterior filming of the accident took place at Big Bear Lake, California.", "Jason George reprised his role as a guest star, whereas James LeGros made his first appearance." ] ], "gold": "Dr. Lexie Grey, who is played by the actress Chyler Leigh, died in the plane crash on Grey's Anatomy. Lexie is named as part of a team of surgeons that will be sent to Boise to separate conjoined twins, along with Mark, Meredith, Derek, Cristina and Arizona Robbins. While flying to their destination, the doctors' plane crashes in the wilderness, and Lexie is crushed under debris from the aircraft. However, she manages to alert Mark and Cristina to help her. The pair try in vain to free Lexie, who realizes that she is suffering from a hemothorax and is unlikely to survive. While Cristina tries to find an oxygen tank and water to save Lexie, Mark holds Lexie's hand and professes his love for her. He tells her that they will get married, have kids and live the best life together. While fantasizing about the future that she and Mark could have had together, Lexie succumbs to her injuries and dies moments before Meredith arrives. The remaining doctors are left stranded in the woods waiting for rescue, with a devastated Meredith crying profusely and Mark refusing to let go of Lexie's hand.", "prediction 1": "In Grey's Anatomy's Season 8 episode Flight, Dr. Lexie Grey, Dr. Cristina Yang, Dr. Arizona Robbins, Dr. Derek Shepherd, and Dr. Mark Sloan die in the plane crash. The remaining doctors are left stranded in the woods waiting for rescue, with a devastated Meredith crying profusely and Mark refusing to let go of Lexie's hand. Still devastated by Lexie's passing, Mark advises his prot\u00e9g\u00e9 Jackson, 'when you love someone, tell them', telling her that they will get married, have kids and live the best life together, as they are meant to be.\n", "prediction 2": "Grey's Anatomy episode Flight became a major event on the show when a plane crashes while en route to save Dr. Meredith Grey and Dr. Lexie Grey desperately fight to stay alive but are ultimately pronounced dead at the scene. Within minutes, the injured Dr. Meredith Grey arrives from their final destination to find the injured Dr. Lexie Grey unconscious before they can communicate. There, the injured Dr. Lexie Grey succumbs to her injuries and dies before she can be revived.", "prediction 3": "In Grey's Anatomy, when the doctors' plane crashes in the woods during a flight to Boise to separate conjoined twins, Lexie Grey is found trapped under debris from the aircraft but manages to alert Mark and Cristina to help her. Meanwhile, she died from injuries sustained when a bottle was dropped on her head at the hands of Meredith Grey. Later, in season 9, the remaining doctors are rescued from the wilderness days later, and Lexie's body is returned to Seattle. In season 7, the remaining surgeons are surprised by the irreverssed Mark Sloan's life support machine to eventually turned off as determined by his will, as determined by his will, the remaining doctors are rescued from the wilderness and Meredith Grey's deaths, and Elisha joined in fancier and later dies.", "prediction 4": "Dr. Meredith Grey (Ellen Pompeo), Dr. Lexie Grey (Chyler Leigh), Dr. Cristina Yang (Sandra Oh), Dr. Arizona Robbins (Jessica Capshaw), Dr. Derek Shepherd (Patrick Dempsey), and Dr. Mark Sloan (Eric Dane) desperately fight to stay alive after their plane crashes in the woods. While Cristina tries to find an oxygen tank and water to save Lexie, Mark holds Lexie's hand and professes his love for her, telling her that they will get married, have kids and live their only as they will have kids and live the best life together, as they are all killed in the crash.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 44 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 61, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 326, "end": 541 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "In Grey's Anatomy's Dr. Lexie Grey dies in the plane crash. Lexie is named as part of a team of surgeons that will be sent to Boise to separate conjoined twins, along with Mark, Meredith, Derek, Cristina and Arizona Robbins. However, while flying to their destination, the doctors' plane crashes in the wilderness and Lexie is crushed under debris from the aircraft but manages to alert Mark and Cristina to help her. The pair try in vain to free Lexie, who realizes that she is suffering from a hemothorax and is unlikely to survive. While Cristina tries to find an oxygen tank and water to save Lexie, Mark holds Lexie's hand and professes his love for her, telling her that they will get married, have kids and live the best life together, as they are \"meant to be\". While fantasizing about the future that she and Mark could have had together, Lexie succumbs to her injuries and dies moments before Meredith arrives. The remaining doctors are left stranded in the woods waiting for rescue, with a devastated Meredith crying profusely and Mark refusing to let go of Lexie's hand. \n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is catch me if you can based on?", "passages": [ [ "Catch Me If You Can (musical)", "Catch Me If You Can (musical)\n\nCatch Me If You Can is a musical with a libretto by Terrence McNally and a theatrical score by Marc Shaiman and Scott Wittman.", "It follows the story of a con artist named Frank Abagnale Jr.", "A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding.", "After a tryout musical performance in Seattle in 2009, \"Catch Me If You Can\" opened at Broadway's Neil Simon Theatre in April 2011.", "The production received four Tony Awards nominations, including one for Best Musical, winning Best Actor in a Musical for Norbert Leo Butz.", "The musical had a reading in 2005, directed by Jack O'Brien, with Nathan Lane, Tom Wopat, Brandon Wardell and Matthew Morrison.", "In private workshops held in July 2007, O'Brien was director, with Nathan Lane, Christian Borle, Angie Schworer, Tom Wopat and Brandon Wardell.", "Other actors involved in the readings included Aaron Tveit and Norbert Leo Butz, Celia Keenan-Bolger, Sara Gettelfinger, Katharine McPhee, Felicia Finley, Autumn Hurlbert, Lauren Ashley Zakrin and Annaleigh Ashford." ], [ "Catch Me If You Can (book)", "Catch Me If You Can (book)\n\nCatch Me If You Can is the semi-autobiography of Frank Abagnale Jr., a former con artist who, as a young man, cashed $2.5 million worth of bad checks while impersonating a Pan Am pilot, a doctor, a teacher, and an attorney.", "The book is co-written by Stan Redding, and was adapted into a 2002 film of the same name by director Steven Spielberg, starring Leonardo DiCaprio as Abagnale and Tom Hanks as the FBI agent who pursued him.", "The book details the life of Frank Abagnale, who was one of the most famous con-artists in the 20th century.", "It is written in the first person and describes how he cashed $2.5 million worth of bad checks.", "He assumed various jobs, such as pretending to be a Pan Am pilot, a doctor, a teacher, and an attorney.", "Abagnale was eventually caught by the FBI Agents, who had been chasing him the whole way, while living in France and then served approximately five years in prison\u00a0\u2014 six months in France, six months in Sweden, and four years in the United States.", "The book ends with an epilogue telling the story of Frank Abagnale's final capture and the story of his rehabilitation, which resulted in the creation of his security firm." ], [ "Catch Me If You Can (book)", "After being released, Frank has a hard time finding a job.", "He figures he should use his talents for a new job and starts his own firm.", "He now visits banks to teach the personnel how to recognize fraudulent checks.", "In 2002, Abagnale addressed the issue of the book's truthfulness with a statement posted on his company's website which said (in part): \"I was interviewed by the co-writer only about four times.", "I believe he did a great job of telling the story, but he also over-dramatized and exaggerated some of the story.", "That was his style and what the editor wanted.", "He always reminded me that he was just telling a story and not writing my biography.\"", "Specifically he addressed details such as the amount of money he wrote in bad checks, and the years in which his crimes took place.", "The 2002 film \"Catch Me If You Can\", directed by award-winning director Steven Spielberg, stars Leonardo DiCaprio as Abagnale and Tom Hanks as Hanratty.", "The film is based upon his life and the autobiography and is mainly true to the source as Abagnale was a consultant to the writers, but some of the details were changed to create a more dramatic narrative for film." ] ], "gold": "Catch Me If You Can is a 1980 autobiographical book based on the early life exploits of Frank Abagnale Jr., a former con artist who reportedly cashed $2.5 million worth of bad checks while impersonating a Pan Am pilot, a doctor, a teacher, and an attorney. Though Abagnale Jr.'s story is questionable, Catch Me If You Can inspired adaptations in the form of a 2002 film and a 2011 Broadway musical, both of the same name. ", "prediction 1": "Catch Me If You Can is a musical with a libretto by Terrence McNally and a theatrical score by Marc Shaiman and Scott Wittman. The musical follows the story of a con artist named Frank Abagnale Jr. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. The book details the life of Frank Abagnale, who was one of the most famous con artist in the 20th century, which was co-written by Stan Redding.", "prediction 2": "Catch Me If You Can is a musical with a libretto by Terrence McNally and a theatrical score by Marc Shaiman and Scott Wittman. It follows the story of a con artist named Frank Abagnale Jr. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. The book is co-written by Stan Redding, and was adapted into a 2002 film of the same name by Steven Spielberg, starring Leonardo DiCaprio as Abagnale, with Tom Hanks as the FBI agent who pursued Abagnale.", "prediction 3": "Catch Me If You Can is a musical, a musical comedy and a musical comedy. It follows the story of a con artist named Frank Abagnale Jr. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. The book details the life of Frank Abagnale, a former con artist who, as a young man, cashed $2.5 million worth of bad checks while impersonating various jobs, a doctor, a teacher, and an attorney. The book was co-written by Stan Redding, and was adapted into a 2002 film of the same name by Steven Spielberg, starring Leonardo DiCaprio as Abagnale and Tom Hanks as the FBI agent who pursued him. The 2002 film is based upon his life and", "prediction 4": "Catch Me If You Can is a musical with a libretto by Terrence McNally and a theatrical score by Marc Shaiman and Scott Wittman. The musical follows the story of a con artist named Frank Abagnale Jr. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. The book details the life of Frank Abagnale, a former con artist who, as a young man, cashed $2.5 million worth of bad checks while impersonating Pan Am pilot, a doctor, a teacher, and an attorney. The book is co-written by Stan Redding, and was adapted into a 2002 film of the same name by director Steven Spielberg, starring Leonardo DiCaprio as Abagnale and Tom Hanks as", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 126 }, { "error type": "Redundant", "explanation": "Catch Me If You Can is a musical with a libretto by Terrence McNally and a theatrical score by Marc Shaiman and Scott Wittman. The musical follows the story of a con artist named Frank Abagnale Jr. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. ", "start": 475, "end": 512 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Catch Me If You Can the musical follows the story of a con artist named Frank Abagnale Jr, who, as a young man, cashed $2.5 million worth of bad checks while impersonating a Pan Am pilot, a doctor, a teacher, and an attorney. A majority of the plot is borrowed from the 2002 film of the same name, which in turn was based on the 1980 autobiography of the same name by Abagnale and Stan Redding. The book details the life of Frank Abagnale, who was one of the most famous con artist in the 20th century, although the book's truthfulness has been questioned." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does the new star wars movie 2017?", "passages": [ [ "Star Wars: The Last Jedi", "\"The Last Jedi\" is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012.", "It was produced by Lucasfilm President Kathleen Kennedy and Ram Bergman, with \"Force Awakens\" director J. J. Abrams as an executive producer.", "John Williams, composer for the previous films, returned to compose the score.", "A number of scenes were filmed at Skellig Michael in Ireland during pre-production in September 2015, but principal photography began at Pinewood Studios in the United Kingdom in February 2016, and ended in July 2016.", "Post-production wrapped in September 2017.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "It grossed over $1.3billion worldwide, becoming the highest-grossing film of 2017, the seventh-highest-ever grossing film in North America and the ninth-highest-grossing film of all time during its theatrical run.", "It is also the second-highest-grossing film of the \"Star Wars\" franchise, and turned a net profit of over $417\u00a0million.", "It was positively received by film critics, who praised the ensemble cast, visual effects, musical score, action sequences and emotional weight." ], [ "Star Wars: The Last Jedi", "In January 2016, \"The Last Jedi\" was rescheduled for December 15, 2017 in 3D and IMAX 3D.", "On January 23, 2017, the film's title was announced as \"Star Wars: The Last Jedi\".", "Similarly to \"The Empire Strikes Back\", \"Return of the Jedi\" and \"The Force Awakens\", \"Episode VIII\" was included in the film's opening crawl, although not in its official title.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017.", "The European premiere was held at London's Royal Albert Hall on December 12, 2017, with a red carpet event.", "It was reported that Disney had placed notable conditions on U.S. cinemas screening \"The Last Jedi\", which some operators described as onerous.", "Disney required that the film be screened in a cinema's largest auditorium for a four-week period (other Disney releases have had similar clauses, but only for two weeks), and was given a 65% cut of ticket sales (a percentage higher than the 55\u201360% average of other major films, and cited as the highest split ever demanded by a Hollywood film behind the 64% split of \"The Force Awakens\").", "The agreement, which was required to be kept confidential, also contained regulations on promotions and restrictions on removing any scheduled screening." ], [ "Star Wars: The Last Jedi", "Star Wars: The Last Jedi\n\nStar Wars: The Last Jedi (also known as Star Wars: Episode VIII \u2013 The Last Jedi) is a 2017 American space opera film written and directed by Rian Johnson.", "It is the second installment of the \"Star Wars\" sequel trilogy and the eighth installment of the main \"Star Wars\" film franchise, following \"\" (2015).", "It was produced by Lucasfilm and distributed by Walt Disney Studios Motion Pictures.", "The film's ensemble cast includes Daisy Ridley, John Boyega, Oscar Isaac, Adam Driver, Mark Hamill, Carrie Fisher, Andy Serkis, Lupita Nyong'o, Domhnall Gleeson, Anthony Daniels, Gwendoline Christie, and Frank Oz in returning roles, with Kelly Marie Tran, Laura Dern and Benicio del Toro joining the cast.", "It features the first posthumous film performance by Fisher, who died in December 2016, and the film is dedicated to her memory.", "The plot follows Rey as she receives Jedi training from Luke Skywalker, in hopes of turning the tide for the Resistance in the fight against Kylo Ren and the First Order, while General Leia Organa, Finn, and Poe Dameron attempt to escape a First Order attack on the dwindling Resistance fleet." ] ], "gold": "Star Wars: The Last Jedi, also known as Star Wars: Episode VIII \"The Last Jedi\", is a 2017 American epic space opera film written and directed by Rian Johnson. \"The Last Jedi\" had its world premiere at the Shrine Auditorium in Los Angeles on December 9, 2017. The European premiere was held at the Royal Albert Hall in London on December 12, 2017, with a red carpet event. It was released in the United States on December 15, 2017.", "prediction 1": "Star Wars: The Last Jedi is a 2017 American space opera film written and directed by Rian Johnson. It is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012. The film premiered in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "prediction 2": "Star Wars: The Last Jedi was released on December 15, 2017 in the United States. In the United Kingdom, it was released on December 15, 2017. In the United States, it was released on December 15, 2017.", "prediction 3": "Star Wars: The Last Jedi is a 2017 American space opera film written and directed by Rian Johnson. It is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012. The film's world premiere was held on December 9, 2017 in Los Angeles. The European premiere was held at London's Royal Albert Hall on December 12, 2017 with a red carpet event.", "prediction 4": "Star Wars: The Last Jedi is a 2017 American space opera film written and directed by Rian Johnson. It is the second installment of the Star Wars sequel trilogy and the eighth installment of the main Star Wars film franchise, following \"\" (2015). The film has a world premiere in Los Angeles on December 9, 2017. The European premiere was held at London's Royal Albert Hall on December 12, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 202 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Star Wars: The Last Jedi, also known as Star Wars: Episode VIII \"The Last Jedi\", is a 2017 American space opera film written and directed by Rian Johnson. It is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012. The film premiered in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017. The European premiere was held at the Royal Albert Hall in London on December 12, 2017, with a red carpet event." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who played alan michael spaulding on guiding light?", "passages": [ [ "Alan-Michael Spaulding", "Alan-Michael Spaulding\n\nAlan-Michael Spaulding is a fictional character on the CBS soap opera \"Guiding Light\".", "The character is the son of wealthy businessman, Alan Spaulding, and his former wife, Hope Bauer.", "Alan-Michael was born on-screen on September 23, 1981, but this was subsequently revised to 1970 when he turned 17 years old and then later to 1965 or 1966 during his brief dalliance with Marina Cooper in 2006.", "Four actors have regularly portrayed the character, the most recent being Michael Dempsey from November 2005 to May 2007.", "Rick Hearst was the actor who portrayed him the longest, and is arguably the best known for the role.", "He was nominated for four Daytime Emmy Awards, winning his first in 1991.", "The child who played him at birth was a baby girl named Jessica Zutterman.", "Carl T. Evans introduced the teenage character on July 4, 1987, when Alan-Michael literally parachuted onto the annual Bauer barbecue.", "He played Alan-Michael until 1990 when Rick Hearst took over the character, playing him for six years.", "When he left, Michael Dietz was recast briefly (July 3, 1996, to February 7, 1997).", "In 2005, \"Guiding Light\" reintroduced the character with Michael Dempsey in the role." ] ], "gold": "On Guiding Light, the child who played Alan-Michael Spaulding at birth was a baby girl named Jessica Zutterman. Carl T. Evans introduced the teenage character on July 4, 1987, when Alan-Michael Spaulding literally parachuted onto the annual Bauer barbecue. Evans played Alan-Michael Spaulding until 1990 when Rick Hearst took over the character, playing him for six years. Rick Hearst was the actor who portrayed Alan-Michael Spaulding the longest and is arguably the best known for the role. Hearst was nominated for four Daytime Emmy Awards, winning his first in 1991. When he left, Michael Dietz was recast briefly as Alan-Michael Spaulding from July 3, 1996 to February 7, 1997. In 2005, Guiding Light reintroduced the character of Alan-Michael Spaulding with Michael Dempsey in the role from November 2005 to May 2007.", "prediction 1": "Alan-Michael Spaulding is a fictional character on the CBS soap opera, Guided Light. Several actors have played him, the most recent being Michael Dempsey from November 2005 to May 2007. Rick Hearst portrayed the character the longest, and is arguably the best known for the role. He was nominated for four Daytime Emmy Awards, winning his first in 1991.", "prediction 2": "Alan-Michael Spaulding is a fictional character on the CBS soap opera \"Guiding Light\". Four actors have regularly portrayed the character, the most recent being Michael Dempsey from November 2005 to May 2007. Rick Hearst was the actor who portrayed him the longest, and is arguably the best known for the role. He was nominated for four Daytime Emmy Awards, winning his first in 1991. Michael Dietz was recast briefly (July 3, 1996, to February 7, 1997).", "prediction 3": "Alan-Michael Spaulding is a fictional character on the CBS soap opera, \"Guiding Light.\" Rick Hearst played Alan-Michael for six years, Rick Hearst for five, and Michael Dempsey for two.", "prediction 4": "Rick Hearst played Alan-Michael Spaulding the longest, and is arguably the best known for the role. Rick Hearst was the actor who portrayed him the longest and is the one who was nominated for four Daytime Emmy Awards, winning his first in 1991. When Rick Hearst left, Michael Dietz was recast briefly. In 2005, \"Guiding Light\" reintroduced the character with Michael Dempsey in the role.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Alan-Michael Spaulding is a fictional character on the CBS soap opera, Guiding Light. Several actors have played him, the most recent being Michael Dempsey from November 2005 to May 2007. Rick Hearst portrayed the character the longest, six years since taking over the role in 1990, and is arguably the best known for the role. He was nominated for four Daytime Emmy Awards, winning his first in 1991. When he left, Michael Dietz was recast briefly (July 3, 1996, to February 7, 1997). Carl T. Evans introduced the teenage character on July 4, 1987, when Alan-Michael literally parachuted onto the annual Bauer barbecue. The child who played him at birth was a baby girl named Jessica Zutterman." }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "When is the new criminal minds coming on?", "passages": [ [ "Criminal Minds (franchise)", "Criminal Minds (franchise)\n\nCriminal Minds is a media franchise of American television programs created by Jeff Davis.", "The police procedural thriller series follow the work of the members of the Behavioral Analysis Unit (BAU) of the FBI.", "The original television series \"Criminal Minds\" premiered on September 22, 2005 on CBS, followed by spin-offs \"\" and \"\" which premiered on the same network on February 16, 2011 and March 16, 2016 respectively.", "In April 2012, a video game was released based on the series.", "As of October 31, 2018, a total of 343 episodes of the \"Criminal Minds\" franchise have aired.", "\"Criminal Minds\" which premiered on September 22, 2005 is set primarily at the BAU based in Quantico, Virginia, and focuses on profiling the criminal, called the unsub (unknown subject), rather than the actual crime itself.", "The focal point of the series follows a group of FBI profilers who set about catching various criminals through behavioral profiling.", "The plot focuses on the team working cases and the personal lives of the characters, depicting the hardened life and statutory requirements of a profiler.", "In early 2009, Michael Ausiello from \"Entertainment Weekly\" said that he and studios were discussing the possibility of a spin-off of the procedural crime drama \"Criminal Minds\"." ], [ "Criminal Minds", "\"Criminal Minds\" has gained critical acclaim for its characterization, pacing, atmosphere, acting, directing, and writing.", "It has also become a ratings hit for CBS, regularly featuring as one of the network's most-watched cable shows throughout its decade-long run.", "The show's success has spawned a media franchise, with several spinoffs, including a South Korean adaptation and a video game.", "Following the conclusion of the thirteenth season, CBS renewed the show for a fourteenth season, which premiered on October 3, 2018.", "Every episode includes one or more quotations that are tangentially connected to the crimes under investigation, recited by a main character.", "Most often, one quotation is heard after the opening credits, and another at the end of the episode.", "When the series premiered in September 2005, it featured FBI agents Jason Gideon, Aaron Hotchner, Elle Greenaway, Derek Morgan, Spencer Reid, Jennifer \"JJ\" Jareau, and Penelope Garcia.", "For season 1, Garcia was not a main cast member but rather had a recurring role, although she appeared in most episodes.", "In 2006, at the start of season 2, Lola Glaudini announced her departure from the show, as she wanted to return home to New York City.", "Paget Brewster replaced her in the role of Emily Prentiss." ], [ "Criminal Minds (season 11)", "Criminal Minds (season 11)\n\nThe eleventh season of \"Criminal Minds\" was ordered on May 11, 2015 by CBS.", "It premiered on September 30, 2015 on CBS and ended on May 4, 2016.", "The season consisted of 22 episodes.", "The entire main cast returned for the season, except Jennifer Love Hewitt (Kate Callahan), who left the show in the season ten finale.", "On June 22, 2015, it was announced that Aisha Tyler would replace Hewitt in a recurring role as Dr. Tara Lewis, a psychologist with an eye on forensic psychology and its application toward the criminal justice system.", "Jennifer Love Hewitt left the show because of her pregnancy, and her character Kate Callahan, handed in her resignation at the end of the season ten finale, due to her pregnancy and decision to devote the next year to her baby.", "It was announced that Aisha Tyler will replace Hewitt in a recurring role as Dr. Tara Lewis.", "A.J. Cook revealed herself to be pregnant, and it was later revealed in the tenth-season finale that her character Jennifer \"JJ\" Jareau was also pregnant.", "She did not appear in the first six episodes (except the season premiere).", "Showrunner Erica Messer expressed her desire about bringing back old characters from previous seasons, including Spencer Reid's mother played by Jane Lynch." ] ], "gold": "Criminal Minds is an American police procedural crime drama television series created and produced by Jeff Davis that premiered on CBS on September 22, 2005. The shows fifteenth and final season of ten episodes aired from January 8, 2020, to February 19, 2020. Season 12 came out on September 28, 2016, Season 11 came out September 30, 2015 and Season 10 came out October 1, 2014.", "prediction 1": "Criminal Minds is an American television police procedural thriller series, created by Jeff Davis, that follows the work of the members of the Behavioral Analysis Unit (BAU) of the FBI. The original television series premiered on September 22, 2005 on CBS. The eleventh season was ordered on May 11, 2015 by CBS. It premiered on September 30, 2015 on CBS and ended on May 4, 2016. The season consisted of 22 episodes.", "prediction 2": "Criminal Minds is a media franchise of American television programs created by Jeff Davis. The police procedural thriller series follow the work of the members of the Behavioral Analysis Unit (BAU) of the FBI. The original television series premiered on September 22, 2005 on CBS, followed by spin-offs \"\" and \"\" which premiered on the same network on February 16, 2011 and March 16, 2016 respectively. The eleventh season of Criminal Minds was ordered on May 11, 2015 by CBS. It premiered on September 30, 2015 on CBS and ended on May 4, 2016.", "prediction 3": "Criminal Minds is an American television series created by Jeff Davis that follows the work of the members of the Behavioral Analysis Unit (BAU) of the FBI. The original television series premiered on September 22, 2005 on CBS. The eleventh season of Criminal Minds was ordered on May 11, 2015 by CBS. It premiered on September 30, 2015 on CBS and ended on May 4, 2016. The season consisted of 22 episodes.", "prediction 4": "Criminal Minds is a media franchise of American television programs created by Jeff Davis. The police procedural thriller series follow the work of the members of the Behavioral Analysis Unit (BAU) of the FBI. The original television series Criminal Minds premiered on September 22, 2005 on CBS. The eleventh season of Criminal Minds was ordered on May 11, 2015 by CBS. It premiered on September 30, 2015 on CBS and ended on May 4, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 277, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 417 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Criminal Minds is an American television police procedural thriller series, created by Jeff Davis. The original television series premiered on September 22, 2005 on CBS. The eleventh season premiered on September 30, 2015 on CBS. A fourteenth season, premiered on October 3, 2018. The spin-offs premiered on February 16, 2011 and March 16, 2016. In April 2012, a video game was released." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who holds the record for most inside the park home runs?", "passages": [ [ "Inside-the-park home run", "Inside-the-park home run\n\nIn baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play.", "It is also known as an \"in-the-park home run\" or \"in the park homer\".", "To score an inside-the-park home run, the player must touch all four bases (in the order of first, second and third, ending at home plate) before a fielder on the opposing team can tag him out.", "In Major League Baseball, if the defensive team commits one or more errors during the play, it is not scored as a home run, but rather advancing on an error, and is colloquially referred to as a Little League home run.", "Statistically, an inside-the-park home run counts as a regular home run in the player's season and career totals.", "The vast majority of home runs occur when the batter hits the ball beyond the outfield fence on the fly.", "This is purely a feat of hitting with power, along with a fortuitous flight angle of the ball.", "The inside-the-park home run has a different character: it combines fast baserunning with a strong hit." ], [ "Inside-the-park home run", "In the early days of Major League Baseball, with outfields more spacious and less uniform from ballpark to ballpark, inside-the-park home runs were common.", "However, in the modern era, with smaller outfields, the feat has become increasingly rare, happening only a handful of times each season.", "Today an inside-the-park home run is typically accomplished by a fast baserunner hitting the ball in a direction that bounces far away from the opposing team's fielders.", "Sometimes (such as Alcides Escobar's inside-the-park homer in the 2015 World Series), the outfielder misjudges the ball or otherwise misplays it, but not so badly that an error is charged.", "Of the 154,483 home runs hit between 1951 and 2000, 975 (about 1 in every 158) were inside-the-park.", "The percentage has dwindled since the increase in emphasis on power hitting which began in the 1920s." ], [ "Sam Crawford", "Sam Crawford\n\nSamuel Earl Crawford (April 18, 1880 \u2013 June 15, 1968), nicknamed \"Wahoo Sam\", was a Major League Baseball outfielder for the Cincinnati Reds and Detroit Tigers from 1899 to 1917.", "He was elected to the Baseball Hall of Fame in 1957.", "Crawford batted and threw left-handed, stood tall and weighed .", "He was one of the greatest sluggers of the dead-ball era and still holds the Major League records for triples in a career (309) and inside-the-park home runs in a season (12).", "He has the second best all-time record for most inside-the-park home runs in a career (51).", "He finished his career with 2,961 hits and a .309 batting average, and became the first player to lead both the American League and National League in home runs (1901 and 1908).", "Ed Barrow, who managed Crawford in his first two years with Detroit, and went on to convert Babe Ruth to an outfielder as general manager of the Yankees, once said that there never was a better hitter than Crawford.", "One of his contemporaries, Fielder Jones, said of Crawford: \"None of them can hit quite as hard as Crawford.", "He stands up at the plate like a brick house and he hits all the pitchers, without playing favorites.\"" ] ], "gold": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. Jesse Burkett holds the all-time MLB record for most inside-the-park home runs, with a total of 55 throughout his career, although the post-1950 record is held by Willie Wilson, with a total of 13. On a single MLB season, Sam Crawford has achieved the most inside-the-park home runs, having scored 12, and Tom McCreery has the record for a single match, it being 3. Within the two leagues that constitute the MLB, the record holders for most inside-the-park home runs are Tommy Leach for the National League and Ty Cobb for the American League.", "prediction 1": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. It is also known as an \"in-the-park home run\" or \"in the park homer\". Sam Crawford holds the record for most inside-the-park home runs in a career, while Alcides Escobar holds the record for most inside-the-park home runs in a season.", "prediction 2": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. It is also known as an \"in-the-park home run\" or \"in the park homer\". Samuel Earl Crawford has the record for most inside the park home runs in a career, and the second best all-time record for most inside the park home runs in a career.", "prediction 3": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. Sam Crawford holds the record for most inside-the-park home runs in a career. Alcides Escobar holds the record for most inside-the-park home runs in a season.", "prediction 4": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. It is also known as an \"in-the-park home run\" or \"in the park homer\". Sam Crawford has the record for most inside-the-park home runs in a career (51).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 202 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 216, "end": 280 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 281, "end": 302 } ], "missing-info": [], "corrected-prediction": "In baseball, an inside-the-park home run is a play where a batter hits a home run without hitting the ball out of the field of play. Sam Crawford holds the record for most inside-the-park home runs in a season with 12." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Which of the seven wonders of the ancient world was destroyed in an earthquake?", "passages": [ [ "Seven Wonders of the Ancient World", "425 BC) and the architect Callimachus of Cyrene (ca. 305\u2013240 BC), housed at the Museum of Alexandria, survived only as references.", "The Colossus of Rhodes was the last of the seven to be completed, after 280 BC, and the first to be destroyed, by an earthquake in 226/225 BC.", "Hence, all seven existed at the same time for a period of less than 60 years.", "The list covered only the sculptural and architectural monuments of the Mediterranean and Middle Eastern regions, which then comprised the known world for the Greeks.", "Hence, extant sites beyond this realm were not considered as part of contemporary accounts.", "The primary accounts, coming from Hellenistic writers, also heavily influenced the places included in the wonders list.", "Five of the seven entries are a celebration of Greek accomplishments in the arts and architecture (the exceptions being the Pyramids of Giza and the Hanging Gardens of Babylon).", "The seven wonders on Antipater's list won praises for their notable features, ranging from superlatives of the highest or largest of their types, to the artistry with which they were executed.", "Their architectural and artistic features were imitated throughout the Hellenistic world and beyond.", "The Greek influence in Roman culture, and the revival of Greco-Roman artistic styles during the Renaissance caught the imagination of European artists and travellers." ], [ "Seven Wonders of the Ancient World", "Paintings and sculptures alluding to Antipater's list were made, while adventurers flocked to the actual sites to personally witness the wonders.", "Legends circulated to further complement the superlatives of the wonders.", "Of Antipater's wonders, the only one that has survived to the present day is the Great Pyramid of Giza.", "Its brilliant white stone facing had survived intact until around 1300 AD, when local communities removed most of the stonework for building materials.", "The existence of the Hanging Gardens has not been proven, although theories abound.", "Records and archaeology confirm the existence of the other five wonders.", "The Temple of Artemis and the Statue of Zeus were destroyed by fire, while the Lighthouse of Alexandria, Colossus, and tomb of Mausolus were destroyed by earthquakes.", "Among the artifacts to have survived are sculptures from the tomb of Mausolus and the Temple of Artemis in the British Museum in London.", "Still, the listing of seven of the most marvellous architectural and artistic human achievements continued beyond the Ancient Greek times to the Roman Empire, the Middle Ages, the Renaissance and to the modern age.", "The Roman poet Martial and the Christian bishop Gregory of Tours had their versions." ], [ "Seven Wonders of the Ancient World", "Seven Wonders of the Ancient World\n\nThe Seven Wonders of the World or the Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists.", "Although the list, in its current form, did not stabilise until the Renaissance, the first such lists of seven wonders date from the 1st-2nd century BC.", "The original list inspired innumerable versions through the ages, often listing seven entries.", "Of the original Seven Wonders, only one\u2014the Great Pyramid of Giza (also called the Pyramid of Khufu, after the pharaoh who built it), the oldest of the ancient wonders\u2014remains relatively intact.", "The Colossus of Rhodes, the Lighthouse of Alexandria, the Mausoleum at Halicarnassus, the Temple of Artemis and the Statue of Zeus were all destroyed.", "The location and ultimate fate of the Hanging Gardens are unknown, and there is speculation that they may not have existed at all.", "The Greek conquest of much of the known western world in the 4th century BC gave Hellenistic travellers access to the civilizations of the Egyptians, Persians, and Babylonians.", "Impressed and captivated by the landmarks and marvels of the various lands, these travellers began to list what they saw to remember them." ] ], "gold": "The Seven Wonders of the World or the Seven Wonders of the Ancient World, simply known as Seven Wonders, is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The Colossus of Rhodes was the last of the seven to be completed, after 280 BC, and the first to be destroyed, by an earthquake in 226/225 BC. The Temple of Artemis and the Statue of Zeus were destroyed by fire, while the Lighthouse of Alexandria, Colossus, and tomb of Mausolus were destroyed by earthquakes.", "prediction 1": "The Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The Colossus of Rhodes was the last of the seven to be completed, after 280 BC, and the first to be destroyed, by an earthquake in 226/225 BC.", "prediction 2": "The Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The Lighthouse of Alexandria, the Colossus, and tomb of Mausolus were destroyed by earthquakes. The Temple of Artemis and the Statue of Zeus were destroyed by fire, while the Temple of Artemis and the Statue of Zeus were destroyed by earthquakes.", "prediction 3": "The Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. Five of the seven wonders on Antipater's list are celebrations of Greek accomplishments in the arts and architecture, the exceptions being the Pyramids of Giza and the Hanging Gardens of Babylon. The Lighthouse of Alexandria, the Colossus, and tomb of Mausolus were destroyed by earthquakes. The location and ultimate fate of the Hanging Gardens of Babylon are unknown.", "prediction 4": "The Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. Five of the seven wonders on Antipater's list are a celebration of Greek accomplishments in the arts and architecture, the exceptions being the Pyramids of Giza and the Hanging Gardens of Babylon. The Temple of Artemis and the Statue of Zeus were destroyed by fire, while the Lighthouse of Alexandria, the Mausoleum at Halicarnasssssssssssssus and the Temple of Artemis were destroyed by earthquakes.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The Colossus of Rhodes was the last of the seven to be completed, after 280 BC, and the first to be destroyed, by an earthquake in 226/225 BC. The Temple of Artemis and the Statue of Zeus were destroyed by fire, while the Lighthouse of Alexandria, Colossus, and tomb of Mausolus were destroyed by earthquakes. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "What is the worst season record in mlb history?", "passages": [ [ "1899 Cleveland Spiders season", "The next day, \"The Plain Dealer\" contained what proved to be a prescient headline--\"THE FARCE HAS BEGUN.\"", "Ultimately, the club finished 20\u2013134 (.130) and lost 40 of their last 41 games of the season.", "By season's end, they trailed the pennant-winning Brooklyn Superbas by 84 games.", "Cleveland was 35 games behind the next-to-last (11th) place Washington Senators.", "For comparison, this would project to 21\u2013141 under the current schedule, and Pythagorean expectation based on the Spiders' results and the current 162 game schedule would translate to a record of 25\u2013137.", "The 1899 Spiders were 11\u2013101 (.098) on the road and 9\u201333 (.214) at home.", "The 101 road losses is far and away the most in major-league history, and will never be threatened, since under current scheduling practices a team does not typically play more than 81 road games (barring tie-breaking playoffs, which are counted as regular season games).", "The team's longest winning streak of the season was two games, which they accomplished once: on May 20 against the Phillies and May 21 against Louisville.", "The Spiders were winless against two teams: Brooklyn and Cincinnati.", "Spiders opponents scored ten or more runs 49 times in 154 games." ], [ "Jack Powell (baseball)", "Jack Powell (baseball)\n\nJohn Joseph Powell (July 9, 1874 \u2013 October 17, 1944) was a Major League Baseball pitcher around the turn of the 19th and 20th century.", "He had a relatively successful 16-year career, which lasted from 1897 to 1912 he won 245 games, but also lost 254 games.", "So, despite his sparking 2.97 career ERA, he holds the record for most wins by a pitcher with a career losing record.", "Powell was born in Bloomington, Illinois.", "He made his debut with the Cleveland Spiders in 1897, and by 1898 he became one of the best pitchers on the team.", "His 23 wins trailed only teammate Cy Young.", "He was one of the star players sold to the St. Louis Browns before the 1899 season.", "He won 23 games again that year, which was three more than the Spiders had all year.", "After three successful seasons, he was lured to the new American League in 1902, where he pitched for the St. Louis Browns.", "Powell was traded to the New York Highlanders before the 1904 season, where he went 23\u201319.", "However, after an 8\u201313 start in 1905, he was traded back to the Browns.", "By this time, the Browns had become one of the worst teams in the league.", "He had a 2.50 ERA over the last seven years of his career, but posted a 78\u2013106 record." ], [ "1962 New York Mets season", "1962 New York Mets season\n\nThe 1962 New York Mets season was the first regular season for the Mets, as the National League returned to New York City for the first time since 1957.", "They went 40\u2013120 (.250) and finished tenth and last in the National League, games behind the NL Champion San Francisco Giants, who once called New York home.", "The Mets were the latest team to be 60+ games behind in a division before the 2018 Baltimore Orioles finished 61 games behind the World Series Champion Boston Red Sox.", "The Mets' 120 losses are the most by any MLB team in one season since the 1899 Cleveland Spiders (20\u2013134, .130).", "Since then, the 2003 Detroit Tigers and 2018 Orioles have come the closest to matching this mark, at 43\u2013119 (.265), and 47-115 (.290), respectively.", "The Mets' starting pitchers also recorded a new major league low of just 23 wins all season.", "The team lost its first game 11\u20134 to the St. Louis Cardinals on April 11, and went on to lose its first nine games.", "Having repaired their record to 12\u201319 on May 20 after sweeping a doubleheader against the Milwaukee Braves, the Mets lost their next 17 games.", "They also lost 11 straight from July 15 to July 26, and 13 straight from August 9 to August 21." ] ], "gold": "The 1899 Cleveland Spiders own the worst single-season record in Major League Baseball history, for a minimum of 120 games and for all eras. The 1899 Cleveland Spiders finished at 20-134, or a.130 percentage, in the final year of the National League's 12-team era in the 1890s. The 1899 Spiders also set the major league record for the most consecutive losses in a season with 24 from July 26 to September 16. Additionally, the team had six losing streaks of 10 games or more. The 1899 Cleveland Spiders also lost 40 of their last 41 games.", "prediction 1": "The worst season record in MLB history is the 1899 season of the Cleveland Spiders. The 1899 Spiders finished 20\u2013134 (.130) and lost 40 of their last 41 games. The 1899 Spiders' record for the regular season was 40\u2013120 (.250).", "prediction 2": "There are several season records in Major League Baseball that are considered to be the worst in their respective eras. The 1899 Cleveland Spiders season is the worst in MLB history. The 1899 Spiders season records are 20\u2013134 (.130) and 40 of their last 41 games. The 1962 New York Mets season was the worst in MLB history with a record of 40\u2013120 (.250).", "prediction 3": "The worst regular season record in MLB history is 25-137. The worst MLB team's record in a single season is the 1899 Cleveland Spiders, who finished the season with a record of 20-134 and lost 40 of their last 41 games. The worst team's record in a single season is 25-137.", "prediction 4": "The worst season record in MLB history dates back to the 1899 Cleveland Spiders season, when the club finished 20\u2013134 (.130) and lost 40 of their last 41 games of the season. The worst season record in MLB history dates back to the 1962 New York Mets season, when the team went 40\u2013120 (.250) and finished tenth and last in the National League, games behind the NL Champion San Francisco Giants.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The worst season record in MLB history is the 1899 season of the Cleveland Spiders. The 1899 Spiders finished 20\u2013134 (.130) ", "start": 160, "end": 226 } ], "missing-info": [], "corrected-prediction": "The worst season record in MLB history is the 1899 season of the Cleveland Spiders. The 1899 Spiders finished 20\u2013134 (.130) and lost 40 of their last 41 games. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Where will the next world cup be held 2022?", "passages": [ [ "2022 FIFA World Cup", "The issue of migrant workers' rights has also attracted attention, with an investigation by \"The Guardian\" newspaper claiming that many workers are denied food and water, have their identity papers taken away from them, and that they are not paid on time or at all, making some of them in effect slaves.", "\"The Guardian\" has estimated that up to 4,000 workers may die due to lax safety and other causes by the time the competition is held.", "These claims are based upon the fact that 522 Nepalese workers and over 700 Indian workers have died since 2010, when Qatar's bid as World Cup's host was won, about 250 Indian workers dying each year.", "Given that there are half a million Indian workers in Qatar, the Indian government says that is quite a normal number of deaths.", "In the United Kingdom, in any group of half a million 25- to 30-year-old men, an average of 300 die each year, a higher rate than among Indian workers in Qatar.", "In 2015, a crew of four journalists from the BBC were arrested and held for two days after they attempted to report on the condition of workers in the country.", "The reporters had been invited to visit the country as guests of the Government of Qatar." ], [ "Hockey World Cup", "Hockey World Cup\n\nThe Men's Hockey World Cup is an international field hockey competition organised by the International Hockey Federation (FIH).", "The tournament was started in 1971.", "It is held every four years, bridging the four years between the Summer Olympics.", "There is also a Women's Hockey World Cup, which has been held since 1974 and was organised by the International Federation of Women's Hockey Associations (IFWHA) until 1981, when the governing bodies merged into the current International Hockey Federation in 1982.", "Pakistan is the most successful team, having won the tournament four times.", "The Netherlands and Australia have each won three titles, and Germany has won two titles.", "Belgium and India have both won the tournament once.", "The 2018 tournament was held in Bhubaneswar, India from 28 November to 16 December.", "Belgium defeated Netherlands in a penalty shoot-out 3\u20132 after the match ended in a 0\u20130 tie to win their first World Cup title.", "The World Cup expanded to 16 teams in 2018, and FIH will evaluate the possibility of increasing it to 24 in 2022.", "The Hockey World Cup was first conceived by Pakistan's Air Marshal Nur Khan.", "He proposed his idea to the FIH through Patrick Rowley, the first editor of \"World Hockey\" magazine." ], [ "2022 FIFA World Cup", "2022 FIFA World Cup\n\nThe 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA.", "It is scheduled to take place in Qatar in 2022.", "This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country.", "This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan (the 2018 competition in Russia featured one geographically Asian venue, Yekaterinburg).", "In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament.", "The reigning World Cup champions are France.", "This will also mark the first World Cup not to be held in May, June, or July; the tournament is instead scheduled for late November until mid-December.", "It is to be played in a reduced timeframe of around 28 days, with the final being held on 18 December 2022, which is also Qatar National Day.", "Accusations of corruption have been made relating to how Qatar won the right to host the event." ] ], "gold": "The 2022 FIFA World Cup is scheduled to take place in Qatar, making it the first World Cup ever to be held in the Arab world. The competition will take place in Lusail Iconic Stadium, Al Bayt Stadium, Education City Stadium, Al Rayyan Stadium, Al Janoub Stadium, Ras Abu Aboud Stadium, Al Thumama Stadium, and Khalifa International Stadium. 2022 World Cup competitions in other sports include the Women's FIH Hockey World Cup, which will be held in Terrassa, Spain and Amstelveen, Netherlands, and the Cricket World Cup Qualifier, the location of which is still TBD.", "prediction 1": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. The 2018 Hockey World Cup was held in Bhubaneswar, India from 28 November to 16 December. Belgium and India have both won the tournament once. The 2018 Hockey World Cup expanded to 16 teams in 2018 and FIH will evaluate the possibility of increasing it to 24 in 2022. In 2019 the 2022 tournament expanded to 16 teams, and the possibility of increasing it to 24 teams.", "prediction 2": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. The Men's Hockey World Cup is an international field hockey competition organised by the International Hockey Federation. It is held every four years, bridging the four years between the Summer Olympics.", "prediction 3": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. The Hockey World Cup is an international field hockey competition organised by the International Hockey Federation (FIH). The tournament was started in 1971 and is held every four years, bridging the four years between the Summer Olympics. The Women's Hockey World Cup is held every four years, bridging the four years between the Summer Olympics. The Women's Hockey World Cup is held every four years, bridging the four years between the four years between the Olympic Games. The 2018 tournament was held in Bhubaneswar, India and Belgium and India have both won", "prediction 4": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 457 }, { "error type": "Irrelevant", "explanation": "", "start": 458, "end": 510 }, { "error type": "Irrelevant", "explanation": "", "start": 511, "end": 635 }, { "error type": "Irrelevant", "explanation": "", "start": 636, "end": 735 } ], "missing-info": [], "corrected-prediction": "The 2022 FIFA World Cup is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When was the lovesong of j alfred prufrock published?", "passages": [ [ "The Love Song of J. Alfred Prufrock", "The Love Song of J. Alfred Prufrock\n\n\"The Love Song of J. Alfred Prufrock\", commonly known as \"Prufrock\", is the first professionally published poem by American-born British poet T. S. Eliot (1888\u20131965).", "Eliot began writing \"Prufrock\" in February 1910, and it was first published in the June 1915 issue of \"Poetry: A Magazine of Verse\" at the instigation of Ezra Pound (1885\u20131972).", "It was later printed as part of a twelve-poem pamphlet (or chapbook) titled \"Prufrock and Other Observations\" in 1917.", "At the time of its publication, Prufrock was considered outlandish, but is now seen as heralding a paradigmatic cultural shift from late 19th-century Romantic verse and Georgian lyrics to Modernism.", "The poem's structure was heavily influenced by Eliot's extensive reading of Dante Alighieri and makes several references to the Bible and other literary works\u2014including William Shakespeare's plays \"Henry IV Part II\", \"Twelfth Night\", and \"Hamlet\", the poetry of seventeenth-century metaphysical poet Andrew Marvell, and the nineteenth-century French Symbolists.", "Eliot narrates the experience of Prufrock using the stream of consciousness technique developed by his fellow Modernist writers." ], [ "The Love Song of J. Alfred Prufrock", "Pound served as the overseas editor of \"Poetry: A Magazine of Verse\" and recommended to the magazine's founder, Harriet Monroe, that \"Poetry\" publish \"The Love Song of J. Alfred Prufrock\", extolling that Eliot and his work embodied a new and unique phenomenon among contemporary writers.", "Pound claimed that Eliot \"has actually trained himself AND modernized himself ON HIS OWN.", "The rest of the \"promising\" young have done one or the other, but never both.\"", "The poem was first published by the magazine in its June 1915 issue.", "In November 1915 \"The Love Song of J. Alfred Prufrock\"\u2014along with Eliot's poems \"Portrait of a Lady,\" \"The Boston Evening Transcript,\" \"Hysteria,\" and \"Miss Helen Slingsby\"\u2014was included in \"Catholic Anthology 1914\u20131915\" edited by Ezra Pound and printed by Elkin Mathews in London.", "In June 1917 \"The Egoist\", a small publishing firm run by Dora Marsden, published a pamphlet entitled \"Prufrock and Other Observations\" (London), containing twelve poems by Eliot.", "\"The Love Song of J. Alfred Prufrock\" was the first in the volume.", "Also Eliot was appointed assistant editor of the \"Egoist\" in June 1917." ], [ "T. S. Eliot", "Eliot was awarded a scholarship to Merton College, Oxford, in 1914.", "He first visited Marburg, Germany, where he planned to take a summer programme, but when the First World War broke out he went to Oxford instead.", "At the time so many American students attended Merton that the Junior Common Room proposed a motion \"that this society abhors the Americanization of Oxford\".", "It was defeated by two votes, after Eliot reminded the students how much they owed American culture.", "Eliot wrote to Conrad Aiken on New Year's Eve 1914: \"I hate university towns and university people, who are the same everywhere, with pregnant wives, sprawling children, many books and hideous pictures on the walls ...", "Oxford is very pretty, but I don't like to be dead.\"", "Escaping Oxford, Eliot spent much of his time in London.", "This city had a monumental and life-altering effect on Eliot for several reasons, the most significant of which was his introduction to the influential American literary figure Ezra Pound.", "A connection through Aiken resulted in an arranged meeting and on 22 September 1914, Eliot paid a visit to Pound's flat.", "Pound instantly deemed Eliot \"worth watching\" and was crucial to Eliot's beginning career as a poet, as he is credited with promoting Eliot through social events and literary gatherings." ] ], "gold": "T.S. Eliot's The Love Song of J. Alfred Prufrock, commonly known as Prufrock, was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound. T.S. Eliot had traveled from Merton College, Oxford, with an introduction from Conrad Aiken, to have Pound read Eliot's unpublished The Love Song of J. Alfred Prufrock. Pound served as the overseas editor of Poetry: A Magazine of Verse and recommended to the magazine's founder, Harriet Monroe, that Poetry publish Eliot's poem. Additionally, the poem was printed as part of a twelve-poem pamphlet titled Prufrock and Other Observations in 1917.", "prediction 1": "The love song of J. Alfred Prufrock was the first professionally published poem by American-born British poet T. S. Eliot in 1915. The poem was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound. The love song was printed as part of a twelve-poem pamphlet titled \"Prufrock and Other Observations\" in 1917.", "prediction 2": "The Love Song of J. Alfred Prufrock, commonly known as \"Prufrock\", is the first professionally published poem by American-born British poet T. S. Eliot. The Love Song was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound.", "prediction 3": "The Love Song of J. Alfred Prufrock, commonly known as \"Prufrock\", is the first professionally published poem by American-born British poet T. S. Eliot in 1915. The poem was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound.", "prediction 4": "The Love Song of J. Alfred Prufrock, commonly known as Prufrock, is the first professionally published poem by American-born British poet T. S. Eliot (1888\u20131965). The poem was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound (1885\u20131972). It was later printed as part of a twelve-poem pamphlet (or chapbook) titled Prufrock and Other Observations in 1917.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The love song of J. Alfred Prufrock was the first professionally published poem by American-born British poet T. S. Eliot in 1915. ", "start": 140, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 104 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The love song of J. Alfred Prufrock, commonly known as \"Prufrock\", was the first professionally published poem by poet T. S. Eliot. The poem was first published in the June 1915 issue of Poetry: A Magazine of Verse at the instigation of Ezra Pound. Pound served as the overseas editor of \"Poetry: A Magazine of Verse\" and recommended to the magazine's founder, Harriet Monroe, that \"Poetry\" publish \"The Love Song of J. Alfred Prufrock\". The love song was printed as part of a twelve-poem pamphlet titled \"Prufrock and Other Observations\" in 1917." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Which type of economy most often practices polygyny?", "passages": [ [ "Polygyny", "Anthropologist Jack Goody's comparative study of marriage around the world, using the Ethnographic Atlas, demonstrated a historical correlation between the practice of extensive shifting horticulture and polygyny in the majority of Sub-Saharan African societies.", "Drawing on the work of Ester Boserup, Goody notes that in some of the sparsely populated regions where shifting cultivation takes place in Africa, much of the work is done by women.", "This favoured polygamous marriages in which men sought to monopolize the production of women \"who are valued both as workers and as child bearers.\"", "Goody however, observes that the correlation is imperfect, and also describes more traditionally male dominated though relatively extensive farming systems such as those that exist in much of West Africa, particularly the savanna region, where polygamy is desired more for the production of male offspring whose labor in farming is valued.\"", "Goody's observation regarding African male farming systems is discussed and supported by anthropologists Douglas R. White and Michael L. Burton in \"Causes of Polygyny: Ecology, Economy, Kinship, and Warfare\", where the authors note: \"Goody (1973) argues against the female contributions hypothesis." ], [ "Polygyny", "In such regions, polygyny is either non-existent or is a luxury which only a small minority of rich farmers can indulge.", "A report by the secretariat of the UN Economic Commission for Africa (ECA) quotes: \"one of the strongest appeals of polygyny to men in Africa is precisely its economic aspect, for a man with several wives commands more land, can produce more food for his household and can achieve a high status due to the wealth which he can command.\".", "According to Esther Boserup, over much of the continent of Africa, tribal rules of land tenure are still in force.", "This implies that members of a tribe, which commands a certain territory, have a native right to take land under cultivation for food production and in many cases also for the cultivation of cash crops.", "Under this tenure system, an additional wife is an economic asset that helps the family to expand its production.", "The economist Mich\u00e8le Tertilt concludes that countries that practice polygyny are less economically stable than those that practice monogamy.", "Polygynous countries usually have a higher fertility rate, fewer savings reserves, and a lower GDP.", "Fertility would decrease by 40%, savings would increase by 70%, and GDP would increase by 170% if polygyny was banned." ] ], "gold": "Polygyny is the most common and accepted form of polygamy, entailing the marriage of a man with several women. Anthropologist Jack Goody's comparative study of marriage around the world, using the Ethnographic Atlas, demonstrated a historical correlation between the practice of extensive shifting horticulture and polygyny in many Sub-Saharan African societies. Polygynous countries usually have a higher fertility rate, fewer savings reserves, and a lower GDP. The economist Mich\u00e8le Tertilt concludes that countries that practice polygyny are less economically stable than those that practice monogamy.", "prediction 1": "In the majority of Sub-Saharan African societies, there is polygyny, or polygamy as a practice, but it is usually practiced in societies with extensive shifting horticulture, an agricultural society dominated by men. The savanna economy, for example, is the region where the economy practices polygyny most commonly, whereas the agrarian economy, or agrarian economy, is the country where polygyny is practiced in large numbers.", "prediction 2": "In the majority of Sub-Saharan African societies, there is polygyny. However, in more traditionally male dominated economies, such as those that exist in much of West Africa, particularly the savanna region, where polygamy is desired more for the production of male offspring whose labor in farming is valued, polygyny is either non-existent or a luxury which only a small minority of rich farmers can indulge.", "prediction 3": "In sub-Saharan African societies, extensive shifting horticulture is most often practiced. In the sparsely populated regions where shifting cultivation takes place in Africa, much of the work is done by women. This favoured polygamous marriages in which men sought to monopolize the production of women \"who are valued both as workers and as child bearers.\" In such regions, polygyny is either non-existent or is a luxury which only a small minority of rich farmers can indulge.", "prediction 4": "In the majority of Sub-Saharan African societies, anthropologist Jack Goody's comparative study of marriage around the world, using the Ethnographic Atlas, demonstrated a historical correlation between the practice of extensive shifting horticulture and polygyny. Goody observed that in some of the sparsely populated regions where shifting cultivation takes place in Africa, much of the work is done by women. This favoured polygamous marriages in which men sought to monopolize the production of women \"who are valued both as workers and as child bearers.\"", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 251, "end": 316 }, { "error type": "Redundant", "explanation": "The savanna economy, for example, is the region where the economy practices polygyny most commonly, whereas the agrarian economy, or ", "start": 350, "end": 367 }, { "error type": "Incoherent", "explanation": "", "start": 375, "end": 382 }, { "error type": "Unverifiable", "explanation": "", "start": 389, "end": 428 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 175, "end": 216 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Anthropologist Jack Goody's comparative study of marriage around the world, using the Ethnographic Atlas, demonstrated a historical correlation between the practice of extensive shifting horticulture and polygyny in the majority of Sub-Saharan African societies. Polygynous countries usually have a higher fertility rate, fewer savings reserves, and a lower GDP. The economist Mich\u00e8le Tertilt concludes that countries that practice polygyny are less economically stable than those that practice monogamy." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played charlie's voice on charlie's angels?", "passages": [ [ "Charlie's Angels (2000 film)", "Cameron Diaz, Drew Barrymore and Lucy Liu reprised their roles, as did John Forsythe as the voice of Charlie in his last film role.", "Bernie Mac replaced Bill Murray as Bosley, Demi Moore had a major role, and Jaclyn Smith reprised her role of Kelly Garrett from the original television series.", "On September 15, 2015, \"The Hollywood Reporter\" has reported that Sony are rebooting the film with Elizabeth Banks both producing with her producing partner and husband Max Handelman and the studio are in negotiations with her to direct the film.", "On April 13, 2016, Sony has confirmed that Banks will direct the reboot." ], [ "Charlie's Angels (2011 TV series)", "Charlie's Angels (2011 TV series)\n\nCharlie's Angels is an American action crime drama television series developed by Alfred Gough and Miles Millar.", "The series is a reboot based of the 1976\u20131981 series of the same name created by Ivan Goff and Ben Roberts.", "The series premiered on ABC on September 22, 2011.", "On October 14, 2011, the day after the fourth episode, low ratings led ABC to cancel the series.", "Three more episodes aired, with the eighth episode left unaired in the United States.", "A reboot of the original series had been announced since late 2009, when screenwriter Josh Friedman was hired to write a pilot script.", "Friedman's script was ultimately rejected, and ABC hired \"Smallville\" creators Alfred Gough and Miles Millar to pen a new version.", "In an interview, Alfred Gough expressed his desire to avoid doing anything \"campy or retro.\"", "He later stated, \"The characters are real and emotionally grounded, but they still like to have fun, wear great clothes, solve crime, and kick some serious ass...we hope to surprise people and bring a whole new generation to \"Charlie's Angels\".\"", "Robert Wagner was set to star as Charlie, but due to scheduling conflicts, had to exit the project." ], [ "Charlie's Angels (franchise)", "Charlie's Angels (franchise)\n\nCharlie's Angels is a media franchise that began with the 1976\u20131981 television series of the same name created by Ivan Goff and Ben Roberts.", "The captivating crime-fighting trio who are the masters of disguise, espionage and martial arts.", "When a devious mastermind embroils them in a plot to destroy individual privacy, the Angels, aided by their loyal sidekick Bosley, set out to bring down the bad guys.", "But when a terrible secret is revealed it makes the Angels targets for assassination.", "The Angels investigate a series of murders which occur after the theft of a witness protection profile database.", "On September 15, 2015, \"The Hollywood Reporter\" has reported that Sony Pictures Entertainment is planning a reboot of the 'Charlie's Angels film franchise' with a new 'Charlie's Angels film' to be drafted.", "Sony are in talks with American actress, director, and producer Elizabeth Banks to helm director's chair.", "Banks will also produce with her producing partner and husband Max Handelman.", "The studio and producers will begin a search for a writer to tackle the reboot.", "In April 2016, Banks signed up to direct a revival of the classic \"Charlie's Angels\" TV series." ], [ "Charlie's Angels", "Charlie's Angels\n\nCharlie's Angels is an American crime drama television series that aired on ABC from September 22, 1976 to June 24, 1981, producing five seasons and 110 episodes.", "The series was created by Ivan Goff and Ben Roberts and was produced by Aaron Spelling.", "It follows the crime-fighting adventures of three women working in a private detective agency in Los Angeles, California, and originally starred Kate Jackson, Farrah Fawcett (billed as Farrah Fawcett-Majors), and Jaclyn Smith in the leading roles and John Forsythe providing the voice of their boss, the unseen Charlie Townsend, who directed the \"Angels\" crime-fighting operations over a speakerphone.", "There were a few casting changes: after the departure of Fawcett and Jackson came the additions of Cheryl Ladd, Shelley Hack, and Tanya Roberts.", "Despite mixed reviews from critics and a reputation for merely being \"Jiggle TV\" (specifically emphasizing the sex appeal of the female leads), \"Charlie's Angels\" enjoyed huge popularity with audiences and was a top ten hit in the Nielsen ratings for its first two seasons.", "By the third season, however, the show had fallen from the top 10." ], [ "Charlie's Angels (2011 TV series)", "After an exhaustive search, Victor Garber was finally cast as the new voice of Charlie.", "Veteran television director Marcos Siega directed the pilot.", "Filming began in Miami on March 8, 2011.", "On May 13, 2011, ABC picked the project up to series.", "ABC later announced that the show would air Thursdays at 8:00 pm Eastern/7:00 pm Central, starting at the beginning of the 2011\u201312 United States network television season.", "Thirteen episodes of the series were ordered.", "However, after the fourth episode aired, ABC announced on October 14, 2011 that it had decided to cancel the series because of the low ratings.", "The eighth and final episode of the show was never aired on ABC, but was aired by AXN in Poland in late December 2011 and aired by Cinemax Latinoamerica & E4 in the UK in January 2012.", "Shortly before the show ended, Minka Kelly made a post of her thoughts on Twitter about the cancellation of the show with her fans.", "\"I've had a wonderful time working with this incredible crew and amazing cast.", "I've made friends 4 life!", "A beautiful experience.", "#CharliesAngels.\"" ] ], "gold": "Charlie's Angels is an American media franchise created by Ivan Goff and Ben Roberts. The original Charlie's Angels aired from 1976-1981, with John Forsythe providing the voice of their boss, the unseen Charlie Townsend. The franchise has been rebooted severally, continuing the story that began with the television series of the same name by Ivan Goff and Ben Roberts. Forsythe played Charlie's voice in the 2000 and 2003 Charlie's angels film. Victor Garber was finally cast as the new voice of Charlie on the 2011 Charlie's angels tv series, while Robert Clotworthy provided Charlie's voice on the 2019 Charlie's angels tv series.", "prediction 1": "Charlie's Angels is an American crime drama television series that aired on ABC from September 22, 1976, to June 24, 1981, producing five seasons and 110 episodes. In the 2000 film Charlie's Angels, John Forsythe played the voice of Charlie. In the 2011 TV series Charlie's Angels, Robert Wagner was set to star as Charlie, but due to scheduling conflicts, had to exit the project. In the 2016 revival of the classic Charlie's Angels TV series, Elizabeth Banks signed up to direct a revival of the classic Charlie's Angels.\n", "prediction 2": "Charlie's Angels is an American crime drama television series that aired on ABC from September 22, 1976 to June 24, 1981, producing five seasons and 110 episodes. In the American movie Charlie's Angels: Rise of the Planet of the Apes, John Forsythe reprised his role, as did Cameron Diaz reprise his role, and Bernie Mac played Charlie's last film role. On the TV show, Charlie's Angels took on a modern day voice over for the character called Bosley. During the radio drama that which was written by John Forsythe, John Forsythe, who was Charlie Townsend, who spoke through a character who was voiceover a audiotape.", "prediction 3": "Charlie's Angels is an American crime drama television series that aired on ABC from September 22, 1976, to June 24, 1981, producing five seasons and 110 episodes. Robert Wagner was set to star as Charlie, but due to scheduling conflicts, had to exit the project. On October 14, 2011, the day after the fourth episode, low ratings led ABC to cancel the series. On October 14, 2011, the day after the eighth episode, low ratings led ABC to cancel the series. A reboot of the original series had been announced since late 2009, when screenwriter Josh Friedman was set to write a new's chair.", "prediction 4": "Charlie's Angels is an American crime drama television series that aired on ABC from September 22, 1976, to June 24, 1981, producing five seasons and 110 episodes. Robert Wagner was set to star as Charlie, but due to scheduling conflicts, had to exit the project. On September 14, 2015, The Hollywood Reporter reported that Sony Pictures Entertainment is planning a reboot of the Charlie's Angels movie franchise' with a new Charlie's Angels film to be drafted. On April 13, 2016, Sony has confirmed that Banks will direct the revival of the classic Charlie's Angels TV series. In 2009, Michael Jiggler and Jean Bart were both the live-action film and explorer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 524 }, { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 116 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 3 ] } ], "corrected-prediction": "Charlie's Angels is an American crime drama television series that aired from 1976 to 1981. The series was created by Ivan Goff and Ben Roberts and was produced by Aaron Spelling. John Forsythe providing the voice of their boss, the unseen Charlie Townsend. In the 2000 film Charlie's Angels, John Forsythe still played the voice of Charlie. In the 2011 TV series Charlie's Angels, Victor Garber was cast as the new voice of Charlie. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was the gettysburg national military park established?", "passages": [ [ "Gettysburg National Military Park", "The 1864 Gettysburg Battlefield Memorial Association and later veteran's associations acquired land for memorials and preservation (e.g., the 72nd Pennsylvania Infantry Monument tract with the statuary memorial depicted on the 2011 America the Beautiful Quarter dollar).", "Federal acquisition of land that would become the 1895 national park began on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M Bushman.", "In addition to land purchases, federal eminent domain takings include the Gettysburg Electric Railway right-of-ways in 1917 (cf. 1896 United States v. Gettysburg Electric Ry. Co.).", "Donated land included 160 acres from the 1959 Gettysburg Battlefield Preservation Association and from the W. Alton Jones Foundation.", "The Gettysburg Foundation is a 501(c)(3) non-profit philanthropic, educational organization that operates in partnership with the National Park Service to preserve Gettysburg National Military Park and the Eisenhower National Historic Site, and to educate the public about their significance.", "(e.g., the Foundation raised funds for and built the new Museum and Visitor Center, opened in 2008, and secured funds for the creation of a new cannon shop that daily preserves the nearly 400 cannons representing actual artillery lines on the battlefield.", "In addition, the Gettysburg Foundation has provided approximately $20 million in direct support of the National Park Service just since 2009." ], [ "Gettysburg Battlefield Historic District", "The 1776 Dobbin House Tavern was outside of the borough when it was surveyed in 1785, and the 1786 Brafferton Inn (Hoke-Codori House) is the \"oldest deeded house in downtown Gettysburg\".", "The pub (Quinn's 1859 \"Railroad Store\", 1924 Mitchell's Restaurant) on the northeast of the center square subsequently burned and has been restored.", "By 1934, the first National Park Service Parkitecture of Gettysburg granite had been completed near The Pennsylvania State Memorial.", "Official groupings of historical real estate tracts began with the 1864 Gettysburg Battlefield Memorial Association era, and continued with the initial United States Department of War acquisitions in 1893.", "The 1895 \"Sickles Gettysburg Park Bill\" (28 Stat. 651) designated the Gettysburg National Military Park (GNMP), which included areas outside of the battlefield (e.g., structures used as field hospitals) and which was transferred in 1933 to the 1916 National Park Service.", "The GNMP was added to the national register in 1966, and the Gettysburg Borough Council adopted a Historic District ordinance in 1972.", "The historic district, which covers a larger area than either the national park or the battlefield, was designated via 2 multiple property submissions of contributing structures and properties, the first being the Battle of Gettysburg MPS on March 19, 1975." ], [ "Gettysburg National Military Park", "Gettysburg National Military Park\n\nThe Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War.", "Located in Gettysburg, Pennsylvania, the park is managed by the National Park Service.", "The GNMP properties include most of the Gettysburg Battlefield, many of the battle's support areas during the battle (e.g., reserve, supply, & hospital locations), and several other non-battle areas associated with the battle's \"aftermath and commemoration\", including the Gettysburg National Cemetery.", "Many of the park's 43,000 American Civil War artifacts are displayed in the Gettysburg Museum and Visitor Center.", "The park has more wooded land than in 1863, and the National Park Service has an ongoing program to restore portions of the battlefield to their historical non-wooded conditions, as well as to replant historic orchards and woodlots that are now missing.", "In addition, the NPS is restoring native plants to meadows and edges of roads, to encourage habitat as well as provide for historic landscape.", "There are also considerably more roads and facilities for the benefit of tourists visiting the battlefield park.", "In 1915, the \"National Park Commission\" tested the battlefield guides and, due to the limited knowledge (particularly of the most experienced, e.g., only 1 in 8 could name the 7 avenues), established a school for licensing tour guides to charge fees." ] ], "gold": "The Gettysburg National Military Park, located in Gettysburg, Pennsylvania, protects and interprets the landscape of the Battle of Gettysburg during the American Civil War. It was first established with initial protection in 1863, with the Gettysburg Battlefield Memorial Association and later veteran's associations acquiring the land for memorials and preservation in 1864. Federal protection began with the acquisition of land that would be later designed as national park in 1895 on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M. Bushman. The park was added to the National Register of Historic Places on October 15, 1966.", "prediction 1": "The 1863 Battle of Gettysburg was fought on the American soil and took place on August 27, 1863. The Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War. The National Park Service manages the park, which is located in Gettysburg, Pennsylvania.", "prediction 2": "The Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War. Federal acquisition of land that would become the 1895 national park began on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M Bushman. Donated land included 160 acres from the 1959 Gettysburg Battlefield Preservation Association and from the W. Alton Jones Foundation. The Gettysburg Foundation operates in partnership with the National Park Service to preserve and to educate the public about their significance.", "prediction 3": "The Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War. Federal acquisition of land that would become the 1895 national park began on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M Bushman. The Gettysburg Foundation is a 501(c)(3) non-profit educational organization that operates in partnership with the National Park Service to preserve Gettysburg National Military Park and the Eisenhower National Historic Site, and to educate the public about their significance.", "prediction 4": "The Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War. Federal acquisition of land that would become the 1895 national park began on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M Bushman. The Gettysburg Foundation, a non-profit philanthropic educational organization that operates in partnership with the National Park Service to preserve Gettysburg National Military Park and the Eisenhower National Historic Site, and to educate the public about their significance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 326 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": " The 1864 Gettysburg Battlefield Memorial Association and later veteran's associations acquired land for memorials and preservation. The Gettysburg National Military Park protects and interprets the landscape of the 1863 Battle of Gettysburg during the American Civil War. Federal acquisition of land that would become the 1895 national park began on June 7, 1893, with 9 monument tracts of each and a larger 10th lot of from the Association, as well as from Samuel M Bushman. The GNMP was added to the national register in 1966. " }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who sang the theme to gilligan's island?", "passages": [ [ "Gilligan's Island", "The studio caved in, and \"the Professor and Mary Ann\" were added.", "The first-season version was recorded by the folk group The Wellingtons.", "The second-season version, which incorporated more of a sea shanty sound, was uncredited, but according to Russell Johnson in his book \"Here on Gilligan's Isle\", it was performed by a group called the Eligibles.", "The show's original pilot episode featured a Calypso theme song by future film composer John Williams, and different lyrics.", "The original length of the voyage was \"a six-hour ride\", not \"a three-hour tour\".", "John Williams (or Johnny Williams as he was often listed in the show credits) also started out as the composer of the incidental music for the show (from 1964 to 1965), but was replaced by Gerald Fried for the remaining seasons (1965\u20131967).", "The band Little Roger and the Goosebumps recorded \"Stairway to Gilligan's Island,\" a parody of Led Zeppelin's \"Stairway to Heaven\", substituting the words to the \"Gilligan's Island\" theme song.", "\"Weird Al\" Yankovic recorded a song called \"Isle Thing\", a parody of Tone L\u014dc's \"Wild Thing\", about a rapper whose girlfriend introduces him to the show." ], [ "The Castaways on Gilligan's Island", "The Castaways on Gilligan's Island\n\nThe Castaways on Gilligan's Island is a 1979 made-for-television comedy film that continues the adventures of the shipwrecked castaways from the 1964\u201367 sitcom \"Gilligan's Island\" and the first reunion movie, \"Rescue from Gilligan's Island\", featuring the original cast from the television series with the exception of Tina Louise, who was replaced in the role of Ginger Grant by Judith Baldwin.", "Written by Al Schwartz, Elroy Schwartz and series creator Sherwood Schwartz and directed by Earl Bellamy, it was first broadcast on NBC May 3, 1979.", "Unlike the independently-produced \"Rescue from Gilligan's Island\", this and the subsequent \"The Harlem Globetrotters on Gilligan's Island\" were produced by Universal Television.", "The movie picks up directly after the end of \"Rescue from Gilligan's Island\".", "The castaways are once again stranded on the same island that they had been on for so many years.", "The storm has contaminated all of the underground springs, and they are desperately searching for fresh water.", "Gilligan stumbles upon a pair of airplanes that are hidden in the jungle that they failed to notice throughout their 15 years on the island." ], [ "Gilligan's Island", "In homage to those telegrams, the film \"Rescue from Gilligan's Island\" showed the successful rescue where Gilligan lights a fire aboard the castaways' makeshift raft and is chastised for a thoughtless, dangerous action by the others.", "However, the resultant smoke attracts the attention of a US Coast Guard helicopter, whose pilot commends Gilligan's fire; otherwise the castaways would have been adrift and unnoticed.", "The music and lyrics for the theme song, \"The Ballad of Gilligan\u2019s Isle\", were written by Sherwood Schwartz and George Wyle.", "One version was used for the first season and another for the second and third seasons.", "In the original song, the Professor and Mary Ann, originally considered \"second-billed co-stars\", were referred to as \"the rest\", but with the growing popularity of those characters, their names were inserted into the lyrics in the second season.", "The \"Gilligan\" theme song underwent this one major change because star Bob Denver personally asked studio executives to add Johnson and Wells to the song.", "When the studio at first refused, saying it would be too expensive to reshoot, Denver insisted, even going so far as to state that if Johnson and Wells were not included, he wanted his name out of the song, as well." ] ], "gold": "Gilligan's Island is an American sitcom created and produced by Sherwood Schwartz. The music and lyrics for the theme song, \"The Ballad of Gilligan\u2019s Isle\", were written by Sherwood Schwartz and George Wyle. The first-season version was recorded by the folk group The Wellingtons. The second-season version, which incorporated more of a sea shanty sound, was uncredited, but according to Russell Johnson in his book \"Here on Gilligan's Isle\", it was performed by a group called the Eligibles.", "prediction 1": "The original series theme song, \"The Ballad of Gilligan's Isle\", was originally sung by Bob Denver and his two co-stars, The Professor and Mary Ann. The first-season version was recorded by the folk group The Wellingtons. The second-season version, which incorporated more of a sea shanty sound, was uncredited, but according to Russell Johnson in his book \"Here on Gilligan's Isle\", it was performed by a group called the Eligibles. The first reunion movie, \"Rescue from Gilligan's Island\", starred the original cast and was the cast of the 1964\u201367 sitcom. The Castaways on Gilligan's Island was a 1979 made-for-telev show called \"The Ballad of Gilligan's Island\" and \"Stairway to Gilligan's Island\" was a parody of Led Ze", "prediction 2": "The character theme song for Gilligan's Island was originally performed by the folk group The Wellingtons. However, when the studio caved in, the names of the Professor and Mary Ann were added. The theme songs for the first and second seasons were both performed by the folk group The Wellingtons. The second season version was performed by a group called the Eligibles.", "prediction 3": "The show's original pilot episode featured a Calypso theme song by future film composer John Williams, and different lyrics. The band Little Roger and the Goosebumps recorded \"Stairway to Gilligan's Island\", a parody of Led Zeppelin's \"Stairway to Heaven\", substituting the words to the \"Gilligan's Island\" theme song. The music and lyrics for the theme song, \"The Ballad of Gilligan's Isle\", were written by Sherwood Schwartz and George Wyle. One version was used for the first season and then for the second and third seasons.", "prediction 4": "On the sitcom Gilligan's Island, the theme song was originally recorded by the folk group The Wellingtons. However, the second-season version of the song, which incorporated more of a sea shanty sound, was uncredited. Also, the show's original pilot episode featured a Calypso theme song by future film composer John Williams, a former show regular who later recorded the incidental music for the show from 1964 to 1965, and different lyrics. Also, the band Little Roger and the Goosebumps recorded \"Stairway to Gilligan's Island, a parody of Led Zeppelin's \"Stairway to Heaven\", substituting the words to the \"Gilligan's Island\". And, \"Weird Al\" Yankovic recorded a song called \"Isle Thing\", a parody of Tone Lc's \"W", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5,6]}", "start": 80, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 434, "end": 557 }, { "error type": "Irrelevant", "explanation": "", "start": 558, "end": 723 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The original series theme song, \"The Ballad of Gilligan's Isle\", the first-season version, was recorded by the folk group The Wellingtons. The second-season version, which incorporated more of a sea shanty sound, was uncredited, but according to Russell Johnson in his book \"Here on Gilligan's Isle\", it was performed by a group called the Eligibles. The music and lyrics for the theme song, \"The Ballad of Gilligan\u2019s Isle\", were written by Sherwood Schwartz and George Wyle." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What was the vote of texas vs johnson case?", "passages": [ [ "Texas v. Johnson", "Texas v. Johnson\n\nTexas v. Johnson, 491 U.S. 397 (1989), was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states.", "Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution.", "Johnson was represented by attorneys David D. Cole and William Kunstler.", "Gregory Lee \"Joey\" Johnson, then a member of the Revolutionary Communist Youth Brigade, participated in a political demonstration during the 1984 Republican National Convention in Dallas, of the Reagan Administration and of certain companies based in Dallas.", "They marched through the streets, shouted chants, destroyed property, broke windows and threw trash, beer cans, soiled diapers and various other items, and held signs outside the offices of several companies.", "At one point, another demonstrator handed Johnson an American flag stolen from a flagpole outside one of the targeted buildings.", "When the demonstrators reached Dallas City Hall, Johnson poured kerosene on the flag and set it on fire." ], [ "Texas v. Johnson", "The court also concluded that the flag burning in this case did not cause or threaten to cause a breach of the peace.", "Texas asked the Supreme Court of the United States to hear the case.", "In 1989, the Court handed down its decision.", "The opinion of the Court came down as a controversial 5\u20134 decision, with the majority opinion being authored by Justice William J. Brennan, Jr. and joined by Justices Thurgood Marshall, Harry Blackmun, Antonin Scalia, and Anthony Kennedy.", "In addition to joining the majority opinion, Kennedy also authored a separate concurrence.", "The Court first considered the question of whether the First Amendment to the United States Constitution protected non-speech acts, since Johnson was convicted of flag desecration rather than verbal communication, and, if so, whether Johnson's burning of the flag constituted expressive conduct, which would permit him to invoke the First Amendment in challenging his conviction.", "The First Amendment specifically disallows the abridgment of \"speech,\" but the court reiterated its long recognition that its protection does not end at the spoken or written word." ], [ "Texas v. Johnson", "The Court noted that Texas already punished \"breaches of the peace\" directly.", "Justice Kennedy wrote a concurrence with Brennan's opinion.", "Kennedy wrote:\n\nBrennan's opinion for the court generated two dissents.", "Chief Justice William H. Rehnquist, joined by Justices Byron White and Sandra Day O'Connor, argued that the \"unique position\" of the flag \"justifies a governmental prohibition against flag burning in the way respondent Johnson did here.\"", "Rehnquist wrote:\n\nHowever, the Johnson majority found the lack of evidence for flag protection in the Constitution that necessitated the claim of \"uniqueness\" to counter indicate protection of the flag from free speech.", "They answered the \"uniqueness\" claim directly: \"We have not recognized an exception to [bedrock First Amendment principles] even where our flag has been involved. ...", "There is, moreover, no indication\u2014either in the text of the Constitution or in our cases interpreting it\u2014that a separate juridical category exists for the American flag alone...", "We decline, therefore, to create for the flag an exception to the joust of principles protected by the First Amendment.\"" ] ], "gold": "By a vote of 5\u20134, Texas versus Johnson was a landmark decision of the United States Supreme Court that invalidated prohibitions on desecrating the American flag. Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. Justice William J. Brennan was joined in the majority by Justices Thurgood Marshall, Harry Blackmun, Antonin Scalia, and Anthony Kennedy, while Chief Justice William H. Rehnquist, joined by Justices Byron White, Sandra Day O'Connor and John Paul Stevens dissented. ", "prediction 1": "Texas v. Johnson, 491 U.S. 397 (1989), was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states. Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. Justice Anthony Kennedy wrote a concurrence with Brennan's opinion.", "prediction 2": "Texas v. Johnson was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states. Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. The opinion of the Court came down as a controversial 5\u20134 decision, with the majority opinion being authored by Justice William J. Brennan, Jr. and joined by Justices Thurgood Marshall, Harry Blackmun, Antonin Scalia, Antonin Scalia, and Anthony Kennedy wrote a separate concurrence with Brennan's opinion.", "prediction 3": "Texas v. Johnson, 491 U.S. 397 (1989), was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states. The majority opinion was written for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. The Court noted that Texas already punished \"breaches of the peace\" directly. Chief Justice William H. Rehnquist and Sandra Day O'Connor argued that the lack of evidence for flag protection in the Constitution.", "prediction 4": "Texas v. Johnson, 491 U.S. 397 (1989), was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states. Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. The opinion of the Court came down as a controversial 5\u20134 decision, with the majority opinion being authored by Justice William J. Brennan, Jr. and joined by Justices Thurgood Marshall, Harry Blackmun, Antonin Scalia, Antonin Scalia, and Anthony Kennedy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 467 } ], "missing-info": [], "corrected-prediction": "Texas v. Johnson, 491 U.S. 397 (1989), was a decision by the Supreme Court of the United States that invalidated prohibitions on desecrating the American flag enforced in 48 of the 50 states. Justice William Brennan wrote for a five-justice majority in holding that defendant Gregory Lee Johnson's act of flag burning was protected speech under the First Amendment to the United States Constitution. The opinion of the Court came down as a controversial 5\u20134 decision, with the majority opinion being authored by Justice William J. Brennan, Jr. and joined by Justices Thurgood Marshall, Harry Blackmun, Antonin Scalia, and Anthony Kennedy. Chief Justice William H. Rehnquist, was joined by Justices Byron White and Sandra Day O'Connor." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who built the second temple in the bible?", "passages": [ [ "Second Temple", "Second Temple\n\nThe Second Temple (, \"Beit HaMikdash HaSheni\") was the Jewish holy temple which stood on the Temple Mount in Jerusalem during the Second Temple period, between 516 BCE and 70 CE.", "According to Jewish tradition, it replaced Solomon's Temple (the First Temple), which was destroyed by the Neo-Babylonian Empire in 586 BCE, when Jerusalem was conquered and part of the population of the Kingdom of Judah was taken into exile to Babylon.", "The Second Temple was originally a rather modest structure constructed by a number of Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel.", "However, during the reign of Herod the Great, the Second Temple was completely refurbished, and the original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable.", "Much like the Babylonians destroyed the First Temple, the Romans destroyed the Second Temple and Jerusalem in 70 CE as retaliation for an ongoing Jewish revolt.", "Jewish eschatology includes a belief that the Second Temple will be replaced by a future Third Temple.", "The accession of Cyrus the Great of the Achaemenid Empire in 559 BCE made the re-establishment of the city of Jerusalem and the rebuilding of the Temple possible." ] ], "gold": "The Second Temple was constructed by a number of Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel. However, during the reign of Herod the Great, the Second Temple was completely refurbished, and the original structure was totally overhauled into the large and magnificent edifices and fa\u00e7ades that are more recognizable.", "prediction 1": "The Second Temple was originally a rather modest structure constructed by a number of Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel. However, during the reign of Herod the Great, the Second Temple was completely refurbished, and the original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable. Much like the Babylonians destroyed the First Temple, the Romans destroyed the Second Temple and Jerusalem in 70 CE as retaliation for an ongoing Jewish revolt.", "prediction 2": "The Second Temple was originally a rather modest structure constructed by a number of Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel. However, during the reign of Herod the Great, the Second Temple was completely refurbished, and the original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable.", "prediction 3": "There are several references to the second temple in the Bible. According to Jewish tradition, it replaced Solomon's Temple, the First Temple, which was destroyed by the Neo-Babylonian Empire in 586 BCE, when Jerusalem was conquered and part of the population of the Kingdom of Judah was taken into exile to Babylon. However, during the reign of Herod the Great, the Second Temple was completely refurbished. The original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable.", "prediction 4": "The Second Temple is the name of the Jewish holy temple which stood on the Temple Mount in Jerusalem within the second Temple period, between 516 BCE and 70 CE. According to Jewish tradition, it replaced Solomon's Temple (the First Temple), which was destroyed by the Neo-Babylonian Empire in 586 BCE, when Jerusalem was conquered and part of the population of the Kingdom of Judah was taken into exile to Babylon. According to the Bible, the second temple was initially a rather modest structure constructed by Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel. However, during the reign of Herod the Great, the second temple was completely refurbished and the original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 577 }, { "error type": "Irrelevant", "explanation": "", "start": 22, "end": 58 } ], "missing-info": [], "corrected-prediction": "The Second Temple was constructed by a number of Jewish exile groups returning to the Levant from Babylon under the Achaemenid-appointed governor Zerubbabel. However, during the reign of Herod the Great, the Second Temple was completely refurbished, and the original structure was totally overhauled into the large and magnificent edifices and facades that are more recognizable. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the museum of islamic art built?", "passages": [ [ "Museum of Islamic Art, Doha", "Its collection includes metal work, ceramics, jewelry, wood work, textiles and glass obtained from three continents and dating from the 7th to the 19th century.", "The museum houses a collection of work gathered since the late 1980's including manuscripts, textiles and ceramics.", "It is one of the world\u2019s most complete collections of Islamic artifacts, with items originating in Spain, Egypt, Iran, Iraq, Turkey, India, and Central Asia." ], [ "Museum of Islamic Art, Doha", "It is the first of its kind to feature over 14 centuries of Islamic art in the Arab States of the Persian Gulf.", "Occupying a total area of 45,000 m, the museum is located on an artificial peninsula overlooking the south end of Doha Bay.", "Construction of the building was done by a Turkish company, Baytur Construction in 2006.", "The interior gallery spaces were designed by a team of Wilmotte Associates.", "The museum was officially opened on November 22, 2008 by the then emir of Qatar, Sheikh Hamad.", "It opened to the general public on December 8, 2008.", "At 91 years of age, the museum's architect, I. M. Pei had to be coaxed out of retirement to undertake this enterprise.", "He traveled throughout the Muslim world on a six-month quest to learn about Muslim architecture and history and read Muslim texts to draw inspiration for his design.", "According to Pei, the light fountain in 9th century Ibn Tulun Mosque of Cairo was the inspiration.", "Declining all proposed sites for the museum, he suggested a stand-alone island for the structure in order to avoid encroachments by other buildings in the future.", "It was built off an artificial peninsula, approximately 60m off the Doha Corniche and surrounded by a some-what crescent shaped 290,000 m park." ], [ "Museum of Islamic Art, Cairo", "Museum of Islamic Art, Cairo\n\nThe Museum of Islamic Art in Cairo, Egypt is considered one of the greatest in the world, with its exceptional collection of rare woodwork and plaster artefacts, as well as metal, ceramic, glass, crystal, and textile objects of all periods, from all over the Islamic world.", "In recent years, the museum has displayed about 4,500 artefacts in 25 Halls , but it houses more than 100,000 objects, with the remainder in storage.", "The collection includes rare manuscripts of the Qur'an, with some calligraphy written in silver ink, on pages with elaborate borders.", "The Museum has conducted archaeological excavations in the Fustat area and has organized a number of national and international exhibitions.", "The museum closed for renovations in 2003, and re-opened 8 years later, in August 2010.", "The restoration cost nearly US$10 million.", "Although recognition of the Egyptian Pharaonic art was signalled in Cairo by the establishment in 1858 of the Egyptian Department of Antiquities and the Egyptian Museum, the appreciation of Islamic Art lagged behind." ], [ "Mshatta Facade", "The name of the place, Mshatta, is a name used by the modern Bedouins in the area, and the original name remains unknown.", "The remains of the palace were excavated in 1840.", "The facade was a gift from the Ottoman Sultan Abdul Hamid II to Emperor Wilhelm II of Germany.", "A large part of it was brought to the then Kaiser-Friedrich-Museum (now the Bode Museum) in Berlin in 1903.", "It was reconstructed as a 33 metres long, 5 metres high facade, with two towers, and parts of a central gateway.", "In 1932 it was reconstructed in the Pergamon Museum.", "It was seriously damaged during the Second World War and the bombardment of Berlin.", "Today, it is one of the most important exhibits of the \"Museum f\u00fcr Islamische Kunst\" in the Pergamon Museum, and a key monument of early Islamic art and architecture, demonstrating early forms of the arabesque, millefleur and also animals carved in relief.", "There has been much discussion of the fact that the decoration on the left side of the facade contains many animals among the foliar forms, while on the right of the entranceway in the centre there are no animals.", "It has been suggested that this is because the right-hand side was the outside wall of the mosque." ] ], "gold": "The Museum of Islamic Art in Doha houses a collection of work gathered since the late 1980s including manuscripts, textiles and ceramics and is one of the world\u2019s most complete collections of Islamic artifacts, with items originating in Spain, Egypt, Iran, Iraq, Turkey, India, and Central Asia. The museum was opened on November 22, 2008 by the then-emir of Qatar, Sheikh Hamad and opened to the general public on December 8, 2008. There is also a Museum of Islamic Art in Cairo, Egypt, which is considered one of the greatest museums in the world, with its exceptional collection of rare woodwork and plaster artefacts, as well as metal, ceramic, glass, crystal, and textile objects of all periods, from all over the Islamic world. This museum was established in 1903. ", "prediction 1": "The Museum of Islamic Art in Doha was originally built in 1840. The building was reconstructed in 1932 and reopened in September 2010.", "prediction 2": "The Museum of Islamic Art in Doha was opened on November 22, 2008 by the then emir of Qatar, Sheikh Hamad. Construction of the building was done by a Turkish company, Baytur Construction in 2006. The interior gallery spaces were designed by a team of Wilmotte Associates.", "prediction 3": "The museum of Islamic art in Doha is the first of its kind to feature over 14 centuries of Islamic art in the Arab States of the Persian Gulf, occupying a total area of 45,000 m, located on an artificial peninsula overlooking the south end of Doha Bay. Construction of the building was done by a Turkish company, Baytur Construction in 2006. The interior gallery spaces were designed by a team of Wilmotte Associates. The museum closed for renovations in 2003, and re-opened 8 years later, in August 2010.", "prediction 4": "The first museum of Islamic art to be built in Qatar is in Doha, Qatar. The building was completed in 2006 and the first museum of Islamic art to be built in Cairo, Egypt was opened in 1841. The Museum of Islamic Art in Cairo was built in 1840. The facade of the palace, Mshatta, was a gift from the Ottoman Sultan Abdul Hamid II to Emperor Wilhelm II of Germany. A large part of it was brought to the then Kaiser-Friedrich-Museum (now the Bode Museum) in Berlin. It was reconstructed in the Pergamon Museum in 1932 and reconstructed in the Pergamon Museum. It was seriously damaged during the Second World War and the bombardment of Berlin.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[2]}", "start": 4, "end": 33 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 134 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Museum of Islamic Art in Doha houses a collection of work gathered since the late 1980's including manuscripts, textiles and ceramics. It is one of the world\u2019s most complete collections of Islamic artifacts, with items originating in Spain, Egypt, Iran, Iraq, Turkey, India, and Central Asia. The museum was officially opened on November 22, 2008 by the then emir of Qatar, Sheikh Hamad. It opened to the general public on December 8, 2008. The Museum of Islamic Art in Cairo, Egypt is considered one of the greatest in the world, with its exceptional collection of rare woodwork and plaster artefacts, as well as metal, ceramic, glass, crystal, and textile objects of all periods, from all over the Islamic world.\n" }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When is the world series of poker 2018?", "passages": [ [ "2018 World Series of Poker", "2018 World Series of Poker\n\nThe 2018 World Series of Poker (WSOP) is the 49th annual tournament, and took place from May 30 to July 17 at the Rio All Suite Hotel and Casino in Las Vegas, Nevada.", "There was a record 78 bracelet events.", "The $10,000 No Limit Hold'em Main Event began on July 2 and concluded on July 15.", "The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central.", "The 2018 World Series of Poker featured the announced retirement of ten-time bracelet winner and poker Hall of Fame member Doyle Brunson from tournament poker, an announcement that came after he registered for the $10,000 No Limit 2-7 Lowball Draw Championship (Event 23).", "Brunson made the final table of the event and finished in sixth place.", "The World Series of Poker introduced the Big Blind Ante to eight events.", "This format made the big blind pay the ante for the entire table.", "It was utilized for events 13, 20, 45, 54, 74, 77 and 78.", "Source: \nThe $10,000 No Limit Hold'em Main Event began on July 2 with the first of three starting flights.", "There were then 2 day 2 flights (AB and C) and then 5 more days of play before the final table." ], [ "Rick Salomon", "Rick Salomon\n\nRick Salomon (born January 24, 1969) is an American poker player, mostly known for his relationships with various female celebrities, including Elizabeth Daily, Shannen Doherty, Paris Hilton, and Pamela Anderson.", "He is also known for winning $2.8 million in the 2014 and $2.84 million in the 2018 World Series of Poker's Big One for One Drop event.", "Salomon was born and raised in Neptune Township, New Jersey.", "He has owned an online gambling site.", "On July 1, 2014, Salomon won $2.8 million in the World Series of Poker Big One for One Drop.", "On July 17, 2018, Salomon won $2.84 million in the World Series of Poker Big One for One Drop.", "In 2003, a sex tape featuring Salomon and then-girlfriend Paris Hilton was leaked onto the Internet.", "Shortly afterward, Salomon filed a lawsuit against the company that distributed the tape, and against the Hilton family, whom he accused of tarnishing his reputation by suggesting that he had exploited Hilton." ] ], "gold": "The 2018 World Series of Poker is the 49th annual tournament, and took place from May 30, 2018 to July 17, 2018 at the Rio All Suite Hotel and Casino in Las Vegas, Nevada. There was a record 78 bracelet events. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central. The event featured the announced retirement of ten-time bracelet winner and Poker Hall of Fame member Doyle Brunson from tournament poker, and he made the final table of the event and finished in sixth place.", "prediction 1": "The World Series of Poker is the 49th annual tournament, and took place from May 30 to July 17 at the Rio All Suite Hotel and Casino in Las Vegas, Nevada. The $10,000 No Limit Hold'em Main Event began on July 2, and concluded on July 15. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central. The World Series of Poker introduced the Big Blind Ante to eight events. This format made the big blind pay the ante for the entire table.", "prediction 2": "The 2018 World Series of Poker, also known as the WSOP, is the 49th annual poker tournament. The $10,000 No Limit Hold'em Main Event began on July 2 and concluded on July 15. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central. The World Series of Poker introduced the Big Blind Ante to eight events. This format made the big blind pay the ante for the entire table.", "prediction 3": "The 2018 World Series of Poker was held from May 30 to July 17, 2018 at the Rio All Suite Hotel and Casino in Las Vegas, Nevada. The $10,000 No Limit Hold'em Main Event began on July 2 and concluded on July 15. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central.", "prediction 4": "The 2018 World Series of Poker, also known as the WSOP, is an annual poker tournament that took place from May 30 to July 17. It was the 49th annual tournament, and took place at the Rio All Suite Hotel and Casino in Las Vegas, Nevada. The $10,000 No Limit Hold'em Main Event began on July 2 and concluded on July 15. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 356, "end": 428 }, { "error type": "Irrelevant", "explanation": "", "start": 429, "end": 494 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The World Series of Poker is the 49th annual tournament, and took place from May 30 to July 17 at the Rio All Suite Hotel and Casino in Las Vegas, Nevada. There was a record 78 bracelet events. The Main Event, as well as the Big One for One Drop, were again streamed in their entirety on ESPN and Poker Central. The 2018 World Series of Poker featured the announced retirement of ten-time bracelet winner and poker Hall of Fame member Doyle Brunson from tournament poker. Brunson made the final table of the event and finished in sixth place. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "April 1980 armed gunmen stormed the iranian embassy in princes gate?", "passages": [ [ "Iranian Embassy siege", "Iranian Embassy siege\n\nThe Iranian Embassy siege took place from 30 April to 5 May 1980, after a group of six armed men stormed the Iranian embassy in South Kensington, London.", "The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province, took 26 people hostage, mostly embassy staff, but also several visitors, as well as a police officer who had been guarding the embassy.", "They demanded the release of Arab prisoners from prisons in Khuzestan and their own safe passage out of the United Kingdom.", "Margaret Thatcher's government quickly resolved that safe passage would not be granted, and a siege ensued.", "Over the following days, police negotiators secured the release of five hostages in exchange for minor concessions, such as the broadcasting of the hostage-takers' demands on British television.", "By the sixth day of the siege the gunmen had become increasingly frustrated at the lack of progress in meeting their demands.", "That evening, they killed one of the hostages and threw his body out of the embassy.", "As a result, the government ordered the Special Air Service (SAS), a special forces regiment of the British Army, to conduct an assault, known as Operation Nimrod, to rescue the remaining hostages.", "Shortly afterwards, SAS soldiers abseiled from the roof of the building and forced entry through the windows." ] ], "gold": "The Iranian Embassy siege took place from April 30 - May 5 1980, after a group of 6 armed men stormed the Iranian embassy on Prince's Gate in South Kensington, London, England. The gunmen were Arabs of KSA that were campaigning for Arab national sovereignty of Khuzestan.", "prediction 1": "The Iranian Embassy siege took place from 30 April to 5 May 1980, after a group of six armed men stormed the Iranian embassy in South Kensington, London. The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province, took 26 people hostage, mostly embassy staff, but also several visitors, as well as a police officer who had been guarding the embassy. They demanded the release of Arab prisoners from prisons in Khuzestan and their own safe passage out of the United Kingdom.", "prediction 2": "The Iranian Embassy siege took place after a group of six armed men stormed the Iranian embassy in Princes Gate, London. The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province, took 26 people hostage, mostly embassy staff, but also several visitors, as well as a police officer who had been guarding the embassy. The siege lasted from 30 April to 5 May 1980.", "prediction 3": "The Iranian Embassy siege took place from 30 April to 5 May 1980, after a group of six armed men stormed the Iranian embassy in South Kensington, London. The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province, took 26 people hostage, mostly embassy staff, but also several visitors, as well as a police officer who had been guarding the embassy.", "prediction 4": "The Iranian Embassy siege took place from 30 April to 5 May 1980, after a group of six armed men stormed the Iranian embassy in South Kensington, London. The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province, took 26 people hostage, mostly embassy staff, but also several visitors, as well as a police officer who had been guarding the embassy. They demanded the release of Arab prisoners from prisons in Khuzestan and their own safe passage out of the United Kingdom. They killed one of the hostages and threw his body out of the embassy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 551 } ], "missing-info": [], "corrected-prediction": "The Iranian Embassy siege took place from 30 April to 5 May 1980, after a group of six armed men stormed the Iranian embassy in South Kensington, London. The gunmen, members of Arabs of KSA group campaigning for Arab national sovereignty in the southern Iranian region of Khuzestan Province." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does the new season of cake boss come out?", "passages": [ [ "Cake Boss", "Cake Boss\n\nCake Boss is an American reality television series, airing on the cable television network TLC.", "The show follows the operations of Carlo's Bake Shop, an Italian-American family-owned business in Hoboken, New Jersey owned and operated by siblings Buddy Valastro (to whom the series' title refers), Lisa Valastro (Buddy's wife), Maddalena Castano, Grace Faugno and Mary Sciarrone.", "The show focuses on how they make their edible art cakes, and the interpersonal relationships among the various family members and other employees who work at the shop.", "The show premiered on April 19, 2009, and four additional seasons followed, premiering October 26, 2009, May 31, 2010 (returning in October), January 31, 2011 (returning in September), and May 28, 2012, respectively.", "The show's sixth season debuted on Monday May 27, 2013 at 9PM ET; the second part of the sixth season began airing on December 30, 2013.", "The seventh season premiered live on September 8, 2015.", "On January 26, 2015 \"Cake Boss\" was renewed for two additional seasons.", "TLC has announced new episodes will begin airing September 8, 2015.", "Season ten premiered on September 30, 2017." ], [ "The Marvelous Mrs. Maisel", "On March 2, 2017, it was reported that the pilot would premiere as a part of Amazon's Spring 2017 pilot season on March 17, 2017.", "On April 10, 2017, it was announced that Amazon had given the production a series order consisting of two seasons.", "The series was expected to be executive produced by Sherman-Palladino and Daniel Palladino with Dhana Gilbert serving as a producer.", "On October 10, 2017, it was reported that the series would premiere on November 29, 2017.", "On May 20, 2018, it was announced that Amazon had renewed the series for a third season.", "On October 24, 2018, it was announced that the second season would premiere on December 5, 2018.", "On August 5, 2016, it was announced that Rachel Brosnahan had been cast in the pilot's titular lead role.", "In September 2016, it was reported that Tony Shalhoub and Michael Zegen had joined the pilot's main cast.", "On October 6, 2016, it was announced that Marin Hinkle had been cast in one of the pilot's main roles.", "In May 2017, it was reported that Joel Johnstone, Caroline Aaron, Kevin Pollak, and Bailey De Young were set to appear in recurring roles.", "On May 23, 2018, it was announced that Zachary Levi would appear in the second season in a recurring capacity." ] ], "gold": "Cake Boss is an American reality television series, airing on the cable television network TLC. The eighth season of the show premiered on August 23, 2016. The ninth season came out on March 17, 2017 and was followed by the premier of the tenth season on September 30, 2017.", "prediction 1": "Cake Boss is an American reality television show that follows the operations of Carlo's Bake Shop, an Italian-American family-owned business in Hoboken, New Jersey owned and operated by siblings Buddy Valastro, Lisa Valastro, Maddalena Castano, Grace Faugno and Mary Sciarrone. The show's fifth season debuted on Monday May 27, 2013 at 9PM ET; the second part of the fifth season began airing on December 30, 2013. The show's sixth season debuted on Monday May 20, 2018, it was reported that the series would premiere on November 29, 2017. On October 24, 2018, it was announced that the second season would premiere on December 5, 2018.", "prediction 2": "Cake Boss is an American reality television series which focuses on the operations of a family-owned bakery business in Hoboken, New Jersey, owned and operated by Buddy Valastro, Lisa Valastro, Maddalena Castano, Grace Faugno and Mary Sciarrone. The show's first season aired on March 1, 2009, and its sixth season aired on Monday May 27, 2013 at 9PM ET. The show's tenth season aired on September 30, 2017. Season ten premiered on September 8, 2017.", "prediction 3": "Cake Boss is an American reality television show, airing on the cable television network TLC. Season ten premiered on September 30, 2017. Season nine came out on October 24, 2018 and new episodes began airing September 8, 2015.", "prediction 4": "Cake Boss is an American reality television series which airs on the cable television network TLC. The show follows the operations of Carlo's Bake Shop, an Italian-American family-owned business in Hoboken, New Jersey owned and operated by siblings Buddy Valastro and Lisa Valastro. The series focuses on how they make their edible art cakes, and the interpersonal relationships among the various family members and other employees who work at the shop. Season ten premiered on September 30, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 277 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 278, "end": 414 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 415, "end": 539 }, { "error type": "Irrelevant", "explanation": "", "start": 540, "end": 636 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Cake Boss is an American reality television show, airing on the cable television network TLC. Season ten premiered on September 30, 2017. " }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who is hosting the miss america pageant 2018?", "passages": [ [ "Miss America 2018", "Miss America 2018\n\nMiss America 2018 was the 91st Miss America pageant, though the Miss America Organization celebrated its 97th anniversary in 2017.", "This discrepancy is due to no national pageants being held from 1928-1932 or in 1934 because of financial problems associated with the Great Depression.", "The 2018 pageant was held in Boardwalk Hall in Atlantic City, New Jersey on Sunday, September 10, 2017.", "This was the first Miss America pageant to be held in Atlantic City since the Miss America Organization headquarters relocated to Boardwalk Hall.", "The event was broadcast by the American Broadcasting Company (ABC).", "On July 24, 2017, it was announced that Chris Harrison and Sage Steele would be returning to co-host the Miss America pageant for the second year in a row.", "Miss America 2017 Savvy Shields of Arkansas, officially crowned her successor Cara Mund of North Dakota as Miss America 2018 at the end of the event.", "From September 6\u20138, 2017, judges for the preliminary competition selected the winners of the preliminary talent and lifestyle and fitness competitions as well as the top 15 finalists for the final night of competition on September 10, 2017." ] ], "gold": "The 2018 Miss America pageant was held in Boardwalk Hall in Atlantic City, New Jersey on Sunday, September 10, 2017. Chris Harrison and Sage Steele hosted the pageant for second year in a row.", "prediction 1": "Chris Harrison and Sage Steele hosted the Miss America pageant in 2017. Chris Harrison and Sage Steele co-hosted the Miss America pageant in 2017 and 2018.", "prediction 2": "The Miss America pageant was held in Atlantic City, New Jersey on Sunday, September 10, 2017. On July 24, 2017, it was announced that Chris Harrison and Sage Steele would be returning to co-host the Miss America pageant for the second year in a row.", "prediction 3": "There was a Miss America pageant in Atlantic City, New Jersey in 2018. In 2018, it was Chris Harrison and Sage Steele who were hosting the Miss America pageant. In 2017, it was also announced that Savvy Shields of Arkansas, who was Miss America 2017, was hosting the Miss America pageant. In 2017, it was announced that Sage Steele and Chris Harrison were co-hosting the Miss America pageant.", "prediction 4": "The Miss America pageant was held in Atlantic City, New Jersey on Sunday, September 10, 2017. It was announced on July 24, 2017 that Chris Harrison and Sage Steele would be returning to co-host the Miss America pageant for the second year in a row.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Chris Harrison and Sage Steele hosted the Miss America pageant in 2017. ", "start": 72, "end": 155 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2018 Miss America pageant was held in Boardwalk Hall in Atlantic City, New Jersey on Sunday, September 10, 2017. Chris Harrison and Sage Steele hosted the Miss America pageant in 2017. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "When is world water day celebrated and why?", "passages": [ [ "World Water Day", "World Water Day\n\nWorld Water Day is an annual UN observance day (always on 22 March) that highlights the importance of freshwater.", "The day is used to advocate for the sustainable management of freshwater resources.", "World Water Day is celebrated around the world with a variety of events.", "These can be educational, theatrical, musical or lobbying in nature.", "The day can also include campaigns to raise money for water projects.", "The first World Water Day, designated by the United Nations, was commemorated in 1993.", "Each year more and more countries celebrate World Water Day.", "UN-Water selects a theme for each year.", "The theme for 2018 was \"Nature for Water\" to encourage people to \"look for the answer in nature\".", "The theme encouraged the use of nature-based solutions to water-related challenges.", "For example, reducing floods, droughts, water pollution and protecting ecosystems could be solved using natural means, which nature uses, rather than man-made approaches.", "Previous themes for the years 2015 to 2017 were \"Water and Sustainable Development\", \"Water and Jobs'\" and \"Why waste water?\"", "The latter theme included attention to both wastewater and the value of reclaiming water.", "The focus on universal access to clean water, sanitation and hygiene (WASH) is in line with the targets of Sustainable Development Goal 6.", "The UN World Water Development Report is released each year around World Water Day." ] ], "gold": "World Water Day is an annual United Nations observance day held on 22 March that highlights the importance of fresh water. The day is used to advocate for the sustainable management of freshwater resources. The theme of each day focuses on topics relevant to clean water, sanitation and hygiene, which is in line with the targets of Sustainable Development Goal 6. The UN World Water Development Report is released each year around World Water Day.", "prediction 1": "World Water Day is an annual UN observance day that highlights the importance of freshwater. The day is used to advocate for the sustainable management of freshwater resources. It is celebrated around the world with a variety of events. These can be educational, theatrical, musical or lobbying in nature.", "prediction 2": "World Water Day is an annual UN observance day that highlights the importance of freshwater. The day is used to advocate for the sustainable management of freshwater resources. World Water Day is celebrated around the world with a variety of events. These can be educational, theatrical, musical or lobbying in nature. World Water Day can also include campaigns to raise money for water projects. World Water Day is celebrated on 22 March every year.", "prediction 3": "World Water Day is an annual UN observance day that highlights the importance of freshwater. The day is used to advocate for the sustainable management of freshwater resources. It is celebrated around the world with a variety of events. These can be educational, theatrical, musical or lobbying in nature. World Water Day can also include campaigns to raise money for water projects.", "prediction 4": "World Water Day is an annual UN observance day that highlights the importance of freshwater. The day is used to advocate for the sustainable management of freshwater resources. World Water Day is celebrated around the world with a variety of events. These can be educational, theatrical, musical or lobbying in nature.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 305 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 14 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 15 ] } ], "corrected-prediction": "World Water Day World Water Day is an annual UN observance day (always on 22 March) that highlights the importance of freshwater. The day is used to advocate for the sustainable management of freshwater resources. The focus on universal access to clean water, sanitation and hygiene (WASH) is in line with the targets of Sustainable Development Goal 6. The UN World Water Development Report is released each year around World Water Day." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who owns rehabilitation center at hollywood hills llc?", "passages": [ [ "The Rehabilitation Center at Hollywood Hills", "The Rehabilitation Center at Hollywood Hills\n\nThe Rehabilitation Center at Hollywood Hills was a private nursing home located in Hollywood, Florida, United States with 152 beds.", "It was owned by Jack Michel and affiliated with Larkin Community Hospital.", "It was acquired by Hollywood Property Investments in 2015.", "The facility offered services such as advanced nursing care, 24 hour nursing care, tube feeding and nutritional management.", "The facility was rated below average on inspections, staffing and quality of care, according to a federal scorecard.", "After the air conditioning system failed due to a power outage during Hurricane Irma in 2017, residents suffered from sweltering heat inside the facility.", "The facility had previously been cited for failing to maintain the emergency generator.", "Although portable A/C units were in use, engineer expert William Crawford later testified in a deposition in February 2018 that the A/C units were insufficient and actually made conditions worse.", "Crawford stated that heat would have been vented upwards, causing temperatures on the second floor to have possibly reached between , while the remainder of the facility was well above , the maximum temperature allowed by state law.", "Additionally, for unknown reasons, the nursing home was not listed on FPL's priority restoration list." ], [ "The Rehabilitation Center at Hollywood Hills", "In October, Governor Scott implemented emergency rules requiring assisted living facilities and nursing homes to have generators that are capable of operating air conditioners for up to four days in the event of a power outage.", "On November 22, the 12\u00a0deaths at the nursing home were ruled to be homicides by heat exposure.", "Court hearings for the potential permanent revocation of the nursing home's license began on January 29, 2018.", "The deaths at the Hollywood Hills nursing home prompted an immediate response from Florida lawmakers.", "Governor Scott signed an executive order mandating nursing facilities to have plans in place to supply emergency power for four days in the event of a power outage.", "Calling the incident \"a tragedy of gargantuan proportion\", Representative Frederica Wilson proposed all nursing and assisted-living facilities have backup generators and the ability to run air conditioning with generator power.", "By September 19, Senator Lauren Book filed a bill that would require such facilities to be able to use generator power for five days.", "About twelve bills related to nursing homes and generators were filed in the 2018 Florida Legislative session.", "An emergency order on Wednesday, September 20, 2017 by the Florida Agency for Health Care Administration (AHCA) suspended the home's license to operate, after the deaths in the aftermath of Irma.", "On the same day, the facility closed permanently, laying off 245 people." ] ], "gold": "The Rehabilitation Center at Hollywood Hills nursing home in Hollywood, Florida, was owned by Jack Michel prior to 2015 and owned by Hollywood Property Investments after 2015, the year Hollywood Property Investments acquired it. The facility closed permanently on September 20, 2017.", "prediction 1": "The Rehabilitation Center at Hollywood Hills was a private nursing home located in Hollywood, Florida, United States with 152 beds. It was owned by Jack Michel and affiliated with Larkin Community Hospital. It was acquired by Hollywood Property Investments in 2015.\n", "prediction 2": "The Rehabilitation Center at Hollywood Hills is a private nursing home located on Hollywood Boulevard, in Hollywood, Florida that was owned by Jack Michel and affiliated with Larkin Community Hospital. Until 2015, the home was owned by Hollywood Property Investments, Inc., which acquired it in 2015.", "prediction 3": "The Rehabilitation Center at Hollywood Hills was a private nursing home located in Hollywood, Florida, United States with 152 beds that was owned by Jack Michel. In 2015, it was acquired by Hollywood Property Investments and sold to Humana Care Services LLC.", "prediction 4": "The Rehabilitation Center at Hollywood Hills was a private nursing home located in Hollywood, Florida, United States with 152 beds. It was owned by Jack Michel and affiliated with Larkin Community Hospital, before being acquired by Hollywood Property Investments in 2015. After the air conditioning system failed due to a power outage during Hurricane Irma in 2017, residents suffered from sweltering heat inside the facility, which resulted in 12 deaths.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 206 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "The Rehabilitation Center at Hollywood Hills was a private nursing home located in Hollywood, Florida. It was owned by Jack Michel. It was acquired by Hollywood Property Investments in 2015. On Wednesday, September 20, 2017, the facility was permanently closed.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays poussey washington on orange is the new black?", "passages": [ [ "Samira Wiley", "When the Netflix television series \"Orange Is the New Black\" \u2014based on Piper Kerman's \u2014 came into development, Wiley was told about the auditions by a friend from Juilliard, Marco Ramirez, who was a writer for the show.", "After discovering that another Juilliard friend, Danielle Brooks, had won a role in the show, Wiley asked Brooks to rehearse lines with her to prepare for her audition for the role of Poussey Washington, the on-screen best friend of Brooks' character.", "Wiley's audition was ultimately successful; she appeared in all twelve episodes of the series' first season and was featured prominently throughout the second season.", "The darker and more violent plot of the second season allowed for the growth of Wiley's character, whose evolved story lines led to Wiley's prolonged screen exposure and ultimate development as a \"fan-favorite.\"", "She was promoted to series regular for the third season.", "The fourth season revolves heavily around her character, leading up to the reactions within the prison upon Poussey's death at the hands of a prison officer.", "Wiley's wife, Lauren Morelli, is a writer on the show.", "In between seasons of \"Orange Is the New Black\", Wiley filmed \"Rob the Mob\" (2014), an independent crime film directed by Raymond De Felitta." ] ], "gold": "In the American TV series \"Orange Is the New Black\", the character of Poussey Washington is played by Samira Wiley when she is an adult and Jade Tuck as a child.", "prediction 1": "On the Netflix television series Orange Is the New Black, Samira Wiley plays Poussey Washington, a best friend of Danielle Brooks' character. In the first season, Brooks plays Poussey. In the second season, Brooks plays Poussey Washington.", "prediction 2": "On the Netflix television series \"Orange Is the New Black\", Samira Wiley plays Poussey Washington, the best friend of Danielle Brooks. Brooks played Poussey Washington in the first and second seasons.", "prediction 3": "On the Netflix television series Orange Is the New Black, Samira Wiley plays Poussey Washington, the on-screen best friend of Danielle Brooks. In the first season, Brooks plays Poussey Washington. In the second season, Brooks plays Poussey Washington.", "prediction 4": "Danielle Brooks plays Poussey Washington on Orange Is the New Black. Brooks plays Poussey Washington on the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 141 }, { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 239 } ], "missing-info": [], "corrected-prediction": "On the Netflix television series Orange Is the New Black, Samira Wiley plays Poussey Washington." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who was in charge of japan in 1945?", "passages": [ [ "Occupation of Japan", "Occupation of Japan\n\nThe Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers, with support from the British Commonwealth.", "Unlike in the occupation of Germany, the Soviet Union was allowed little to no influence over Japan.", "This foreign presence marks the only time in Japan's history that it has been occupied by a foreign power.", "The country became a parliamentary democracy that recalled \"New Deal\" priorities of the 1930s by Roosevelt.", "The occupation, codenamed Operation \"Blacklist\", was ended by the San Francisco Peace Treaty, signed on September 8, 1951, and effective from April 28, 1952, after which Japan's sovereigntywith the exception, until 1972, of the Ryukyu Islands was fully restored.", "According to John Dower, in his book \"Cultures of War: Pearl Harbor/Hiroshima/9-11/Iraq\", the factors behind the success of the occupation were:\n\nJapan surrendered to the Allies on August 14, 1945, when the Japanese government notified the Allies that it had accepted the Potsdam Declaration.", "On the following day, Emperor Hirohito announced Japan's unconditional surrender on the radio (the \"Gyokuon-h\u014ds\u014d\").", "The announcement was the emperor's first ever planned radio broadcast and the first time most citizens of Japan ever heard their sovereign's voice." ], [ "Occupation of Japan", "Under the final plan, however, SCAP was given direct control over the main islands of Japan (Honshu, Hokkaido, Shikoku, and Kyushu) and the immediately surrounding islands, while outlying possessions were divided between the Allied Powers as follows:\n\n\nIt is unclear why the occupation plan was changed.", "Common theories include the increased power of the United States following development of the atomic bomb, Truman's greater distrust of the Soviet Union when compared with Roosevelt, and an increased desire to restrict Soviet influence in East Asia after the Yalta Conference.", "The Soviet Union had some intentions of occupying Hokkaid\u014d.", "Had this occurred, there might have eventually been a communist state in the Soviet zone of occupation.", "However, unlike the Soviet occupations of East Germany and North Korea, these plans were frustrated by Truman's opposition.", "MacArthur's first priority was to set up a food distribution network; following the collapse of the ruling government and the wholesale destruction of most major cities, virtually everyone was starving.", "Even with these measures, millions of people were still on the brink of starvation for several years after the surrender.", "As expressed by Kawai Kazuo, \"Democracy cannot be taught to a starving people\".", "The US government encouraged democratic reform in Japan, and while it sent billions of dollars in food aid, this was dwarfed by the occupation costs it imposed on the struggling Japanese administration." ], [ "Occupation of Japan", "Allied (primarily American) forces were set up to supervise the country, and \"for eighty months following its surrender in 1945, Japan was at the mercy of an army of occupation, its people subject to foreign military control.\"", "At the head of the Occupation administration was General MacArthur, who was technically supposed to defer to an advisory council set up by the Allied powers, but in practice did not and did everything himself.", "As a result, this period was one of significant American influence, described near the end of the occupation in 1951 that \"for six years the United States has had a free hand to experiment with Japan than any other country in Asia, or indeed in the entire world.\"", "Looking back to his work among the Japanese, MacArthur said, \"Measured by the standards of modern civilization, they would be like a boy of twelve\" compared to the maturity of the US and Germany, and had a good chance of putting away their troubled past.", "On V-J Day, US President Harry Truman appointed General Douglas MacArthur as Supreme Commander for the Allied Powers (SCAP), to supervise the occupation of Japan.", "During the war, the Allied Powers had planned to divide Japan amongst themselves for the purposes of occupation, as was done for the occupation of Germany." ] ], "gold": "The occupation of Japan in 1945 was overseen by American General Douglas MacArthur, who was appointed Supreme Commander for the Allied Powers by President Harry Truman, after Emperor Hirohito announced Japan's unconditional surrender.", "prediction 1": "The Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers, with support from the British Commonwealth. Unlike in the occupation of Germany, the Soviet Union was allowed little to no influence over Japan. This foreign presence marks the only time in Japan's history that it has been occupied by a foreign power.", "prediction 2": "The Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers, with support from the British Commonwealth. Under the final plan, however, the SCAP was given direct control over the main islands of Japan (Honshu, Hokkaido, Shikoku, and Kyushu) and the immediately surrounding islands, while outlying possessions were divided between the Allied Powers as follows.", "prediction 3": "The Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers, with support from the British Commonwealth. The Allied occupation of Japan in 1945 was codenamed Operation Blacklist and was led by General MacArthur. The United States was the main Allied power in charge of Japan, which meant that for eighty months following Japan's surrender in 1945, the country was at the mercy of an army of occupation, its people subject to foreign military control.", "prediction 4": "The Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers, with support from the British Commonwealth. In 1945, Japan surrendered to the Allies on August 14, 1945, when the Japanese government notified the Allies that it had accepted the Potsdam Declaration. Then, on V-J Day, US President Harry Truman appointed General MacArthur as Supreme Commander for the Allied Powers (SCAP), to supervise the occupation of Japan. In the end of the war, Japan's sovereignty was fully restored.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 391 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Allied occupation of Japan at the end of World War II was led by General Douglas MacArthur, the Supreme Commander of the Allied Powers. Emperor Hirohito announced Japan's unconditional surrender on the radio." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When was the last time the new york giants won a superbowl?", "passages": [ [ "Super Bowl XLVI", "Super Bowl XLVI\n\nSuper Bowl XLVI (46) was an American football game between the National Football Conference (NFC) champion New York Giants and the American Football Conference (AFC) champion New England Patriots to decide the National Football League (NFL) champion for the 2011 season.", "The Giants defeated the Patriots by the score of 21\u201317.", "The game was played on February 5, 2012 at Lucas Oil Stadium in Indianapolis, the first time that the Super Bowl was played in Indiana.", "In addition to winning their fourth Super Bowl in team history, the Giants set a new record for the lowest regular season record (9\u20137, win percentage of 56.3%) by a Super Bowl champion.", "The Patriots entered the game with a 13\u20133 regular season record, and were also seeking their fourth Super Bowl win.", "The game was also a rematch of Super Bowl XLII, in which New York also won, 17\u201314, to spoil New England's run at a perfect 2007 season in what is now considered to be one of the greatest upsets in sports history.", "The Giants jumped to a 9\u20130 lead in the first quarter of Super Bowl XLVI before the Patriots scored 17 unanswered points to take a 17\u20139 lead in the third quarter." ] ], "gold": "As of 2017, the last time the New York Giants won a super bowl was in 2011. It was Super Bowl XLVI and they beat the New England Patriots.", "prediction 1": "The New York Giants last won a Super Bowl on February 5, 2012, when they defeated the New England Patriots 21-17.", "prediction 2": "The New York Giants won a Super Bowl on February 5, 2012. The last time the New York Giants won a Super Bowl was in 2008.", "prediction 3": "The New York Giants last won a Super Bowl on February 5, 2012. The team also set a record for the lowest regular season record (9\u20137, win percentage of 66.3%) by a Super Bowl champion.", "prediction 4": "In addition to winning their fourth Super Bowl in team history, the New York Giants set a new record for the lowest regular season record (9\u20137, win percentage of 56.3%) by a Super Bowl champion. The Patriots entered the game with a 13\u20133 regular season record, and were also seeking their fourth Super Bowl win.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The New York Giants last won a Super Bowl XLVI on February 5, 2012, when they defeated the New England Patriots 21-17." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When were the common core state standards developed?", "passages": [ [ "Common Core State Standards Initiative", "Common Core State Standards Initiative\n\nThe Common Core State Standards Initiative is an educational initiative from 2010 that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade.", "The initiative is sponsored by the National Governors Association (NGA) and the Council of Chief State School Officers (CCSSO) and seeks to establish consistent educational standards across the states as well as ensure that students graduating from high school are prepared to enter credit-bearing courses at two- or four-year college programs or to enter the workforce.", "In the 1990s, a movement for establishing national standards and accountability began in the United States as states began writing standards (a) outlining what students were expected to know and to be able to do at each grade level, and (b) implementing assessments designed to measure whether students were meeting the standards.", "As part of this education reform movement, the nation's governors and corporate leaders founded Achieve, Inc. in 1996 as a bipartisan organization to raise academic standards and graduation requirements, improve assessments, and strengthen accountability in all 50 states.", "The initial motivation for the development of the Common Core State Standards (CCSS) was part of the American Diploma Project (ADP)." ], [ "Common Core State Standards Initiative", "A 2004 report, titled \"Ready or Not: Creating a High School Diploma That Counts\", found that employers and colleges are demanding more of high school graduates than in the past.", "According to Achieve, Inc., \"current high-school exit expectations fall well short of employer and college demands.\"", "The report explained that the major problem currently facing the American school system is that high school graduates were not provided with the skills and knowledge they needed to succeed in college and careers.", "Furthermore, \"While students and their parents may still believe that the diploma reflects adequate preparation for the intellectual demands of adult life, in reality it falls far short of this common-sense goal.\"", "The report also stated that the high school diploma itself lost its value because graduates could not compete successfully beyond high school, and that the solution to this problem is a common set of rigorous standards.", "In 2009, the NGA convened a group of people to work on developing the standards.", "This team included David Coleman, William McCallum of the University of Arizona, Phil Daro, and Student Achievement Partners founders Jason Zimba and Susan Pimentel to write standards in the areas of English and language arts.", "Announced on June 1, 2009, the initiative's stated purpose is to \"provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help them.\"" ], [ "Common Core State Standards Initiative", "Instead, it was indicated that the ELPD standards would be left to individual states.", "However, the need for more guidance quickly became apparent, and led to the creation of several initiatives to provide resources to states and educators, including:\nFurthermore, the U.S. Department of Education has since funded two grants to develop the next generation of ELPD assessments, which must measure students\u2019 proficiency against a set of common ELPD standards, which in turn correspond to the college/career-ready standards in English language arts and mathematics.", "The new assessment system must also:\n\n\nSince 2010, forty-two (42) of the fifty U.S. states and the District of Columbia have been members of the Common Core State Standards Initiative, while Oklahoma, Texas, Virginia, Alaska, Nebraska, Indiana, and South Carolina did not adopt the initiative at a state level.", "Minnesota adopted the English Language Arts standards but not the Mathematics standards.", "Although starting as a fast trend, the curriculum lost momentum and found at least 12 states introducing legislation to prohibit implementation.", "Four states that initially adopted Common Core have since decided to repeal or replace it: Indiana, Arizona, Oklahoma, and South Carolina.", "Standards were released for mathematics and English language arts on June 2, 2010, with a majority of states adopting the standards in the subsequent months.", "(See map for current status.)" ] ], "gold": "The Common Core State Standards Initiative is an educational initiative from 2010 that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. Announced on June 1, 2009, the initiative's stated purpose is to \"provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help them.\" Standards were released for mathematics and English language arts on June 2, 2010, with a majority of states adopting the standards in the subsequent months.", "prediction 1": "The Common Core State Standards are an educational initiative that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. In 2009, the NGA convened a group of people to work on developing the standards, which included David Coleman, William McCallum of the University of Arizona, Phil Daro, and Student Achievement Partners founders Jason Zimba and Susan Pimentel to write standards in the areas of English and language arts. The standards were released for mathematics on June 2, 2010, with a majority of states adopting the initiative in the subsequent months.", "prediction 2": "The Common Core State Standards Initiative is an educational initiative from 2010 that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. The standards were announced on June 1, 2009, by the National Governors Association and the Council of Chief State School Officers.", "prediction 3": "The Common Core State Standards Initiative is a national initiative that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. The Common Core State Standards Initiative was announced on June 1, 2009 by the National Governors Association. The standards were released for English language arts and mathematics on June 2, 2010, with a majority of states adopting the standards in the subsequent months.", "prediction 4": "The Common Core State Standards Initiative is an educational initiative from 2010 that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. The initiative is sponsored by the National Governors Association and the Council of Chief State School Officers and seeks to establish consistent educational standards across the states as well as ensure that students graduating from high school are prepared to enter credit-bearing courses at two- or four-year college programs or to enter the workforce. On June 2, 2010, the English and mathematics standards were released on June 2, 2010.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Common Core State Standards are an educational initiative from 2010 that details what K\u201312 students throughout the United States should know in English language arts and mathematics at the conclusion of each school grade. Announced on June 1, 2009, the initiative's stated purpose is to \"provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help them.\" The standards were released for mathematics on June 2, 2010, with a majority of states adopting the initiative in the subsequent months." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has the authority to make laws for the united states?", "passages": [ [ "United States Congress", "United States Congress\n\nThe United States Congress is the bicameral legislature of the Federal government of the United States.", "The legislature consists of two chambers: the House of Representatives and the Senate.", "The Congress meets in the United States Capitol in Washington, D.C..", "Both senators and representatives are chosen through direct election, though vacancies in the Senate may be filled by a gubernatorial appointment.", "Congress has 535 voting members: 435 representatives and 100 senators.", "The House of Representatives has six non-voting members representing Puerto Rico, American Samoa, Guam, the Northern Mariana Islands, the U.S. Virgin Islands, and the District of Columbia in addition to its 435 voting members.", "Although they cannot vote in the full house, these members can sit and vote in congressional committees and introduce legislation.", "The members of the House of Representatives serve two-year terms representing the people of a single constituency, known as a \"district\".", "Congressional districts are apportioned to states by population using the United States Census results, provided that each state has at least one congressional representative.", "Each state, regardless of population or size, has two senators.", "Currently, there are 100 senators representing the 50 states.", "Each senator is elected at-large in their state for a six-year term, with terms staggered, so every two years approximately one-third of the Senate is up for election." ], [ "Law of the United States", "There is only one federal court that binds all state courts as to the interpretation of federal law and the federal Constitution: the U.S. Supreme Court itself.", "The fifty American states are separate sovereigns, with their own state constitutions, state governments, and state courts.", "All states have a legislative branch which enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and a judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as local ordinances.", "They retain plenary power to make laws covering anything not preempted by the federal Constitution, federal statutes, or international treaties ratified by the federal Senate.", "Normally, state supreme courts are the final interpreters of state constitutions and state law, unless their interpretation itself presents a federal issue, in which case a decision may be appealed to the U.S. Supreme Court by way of a petition for writ of certiorari.", "State laws have dramatically diverged in the centuries since independence, to the extent that the United States cannot be regarded as one legal system as to the majority of types of law traditionally under state control, but must be regarded as 50 \"separate\" systems of tort law, family law, property law, contract law, criminal law, and so on." ], [ "United States administrative law", "Federal administrative agencies, when granted the power to do so in a statutory grant of authority from Congress, may promulgate rules that have the effect of substantive law.", "Agencies \"legislate\" through rulemaking\u2014the power to promulgate (or issue) regulations.", "Such regulations are codified in the Code of Federal Regulations (CFR) and published in the \"Federal Register\".", "Section 551 of the Administrative Procedure Act gives the following definitions:\n\nThe primary administrative law statutes and other laws that govern agency rule making include:\n\nThe Congressional Review Act passed in 1996 created a category of \"major rules\", which are those that the Office of Information and Regulatory Affairs determines result in either: (1) \"an annual effect on the economy of $100,000,000,\" (2) \"a major increase in costs or prices for consumers, individual industries, Federal, State, or local government agencies, or geographic regions,\" or (3) \"significant adverse effects on competition, employment, investment, productivity, innovation, or on the ability of United States-based enterprises to compete with foreign-based enterprises in domestic and export markets.\"", "If the rule is major, an additional report must be provided to congressional committees.", "From 1997 to 2012, the number of major rules has ranged from 100 (2010) to 50 (2002).", "E.O." ] ], "gold": "Federal laws in the United States generally must pass through both houses of Congress. However, the Constitution sets out other ways federal laws can come into being, including treaties ratified by the Senate, regulations promulgated by the executive branch through federal administrative agencies, and case law originating from the federal judiciary. Below the federal level, each of the fifty American states has its own constitution, legislature, and courts with which to establish any laws that are not in the domain of the federal government.", "prediction 1": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. The 50 American states each have a legislative branch which enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and a judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as local ordinances. Federal administrative agencies, when granted the power to do so in a statutory grant of authority from Congress, may promulgate rules that have the effect of substantive law.", "prediction 2": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. The House of Representatives has 6 non-voting members representing Puerto Rico, American Samoa, Guam, the Northern Mariana Islands, the U.S. Virgin Islands, and the District of Columbia in addition to its 435 voting members. The Senate is the bicameral legislative branch of the Federal government. The 50 states each have a legislative branch that enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as well as well as local ordinances.", "prediction 3": "The United States Congress is the bicameral legislature of the Federal government of the United States. Congress consists of two chambers: the House of Representatives and the Senate. The House of Representatives is composed of 500 members and consists of 185 voting members. The Senate consists of 100 members and consists of 100 members. The 50 states have a legislative branch which enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and a judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as local ordinances.", "prediction 4": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. All 50 states have a legislative branch which enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and a judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as local ordinances. Federal administrative agencies, when granted the power to do so in a statutory grant of authority from Congress, may promulgate rules that have the effect of substantive law.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. The 50 American states retain plenary power to make laws covering anything not preempted by the federal Constitution, federal statutes, or international treaties ratified by the federal Senate. Each have a legislative branch which enacts state statutes, an executive branch that promulgates state regulations pursuant to statutory authorization, and a judicial branch that applies, interprets, and occasionally overturns both state statutes and regulations, as well as local ordinances. Federal administrative agencies, when granted the power to do so in a statutory grant of authority from Congress, may promulgate rules that have the effect of substantive law." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who starred in the original a star is born?", "passages": [ [ "A Star Is Born (1937 film)", "The film was adapted as a radio play on the September 13, 1937, episode of \"Lux Radio Theater\" with Robert Montgomery and Janet Gaynor, the November 17, 1940, episode of The Screen Guild Theater starring Loretta Young and Burgess Meredith, the December 28, 1942, episode of \"Lux Radio Theater\" with Judy Garland and Walter Pidgeon, the June 29, 1946, episode of Academy Award Theater, starring Fredric March, the May 23, 1948, episode of the Ford Theatre and the June 16, 1950, episode of \"Screen Director's Playhouse\" starring Fredric March.", "\"A Star Is Born\" has been remade four times, in 1954 with Judy Garland and James Mason, in 1976 with Barbra Streisand and Kris Kristofferson, in 2013 with Aditya Roy Kapur and Shraddha Kapoor in Aashiqui 2 and in 2018 with Lady Gaga and Bradley Cooper.", "Selznick International Pictures dissolved leaving the film's rights to financier John Hay Whitney.", "Whitney then sold the film to Film Classics, Inc. in 1943.", "With declining rerun revenue, Film Classics place the film up for sale with producer Edward L. Alperson with the intent to remake the film.", "Instead Alperson sold the film's copyright including film, story, screenplay, and score to Warner Bros. in 1953." ], [ "A Star Is Born (1937 film)", "A Star Is Born (1937 film)\n\n", "A Star Is Born is a 1937 American Technicolor romantic drama film produced by David O. Selznick, directed by William A. Wellman from a script by Wellman, Robert Carson, Dorothy Parker, and Alan Campbell, and starring Janet Gaynor (in her only Technicolor film) as an aspiring Hollywood actress, and Fredric March (in his Technicolor debut) as a fading movie star who helps launch her career.", "The supporting cast features Adolphe Menjou, May Robson, Andy Devine, Lionel Stander, and Owen Moore.", "The film has been remade three times: in 1954 (directed by George Cukor and starring Judy Garland and James Mason), in 1976 (directed by Frank Pierson and starring Barbra Streisand and Kris Kristofferson), and in 2018 (starring Lady Gaga and Bradley Cooper, who also directed).", "North Dakota farm girl Esther Victoria Blodgett yearns to become a Hollywood actress.", "Although her aunt and father discourage such thoughts, Esther's grandmother gives Esther her savings to follow her dream.", "Esther goes to Hollywood and tries to land a job as an extra, but so many others have had the same idea that the casting agency has stopped accepting applications." ], [ "Kathleen Crowley", "Kathleen Crowley\n\nKathleen Crowley (born Betty Jane Crowley, December 26, 1929 \u2013 April 23, 2017) was an American actress who starred in a number of TV shows and films throughout the 1950s and 1960s, ending her career in 1970 at age 40.", "Born on December 26, 1929, in the Green Bank section of Washington Township, Burlington County, New Jersey, Crowley graduated from Egg Harbor City High School in 1946.", "On August 7, 1949, the 19-year-old Crowley won the title of Miss New Jersey at a contest held at Asbury Park.", "As the winner, she entered the Miss America pageant held in Atlantic City, New Jersey, on September 10, 1949, and finished in seventh place.", "At the time she was working as a bookkeeper.", "Crowley attended New York's American Academy of Dramatic Arts in 1950 on a scholarship won at the Miss America pageant, and undertook some live TV work there.", "In February 1951, she appeared with Conrad Nagel in \"A Star is Born\" on \"Robert Montgomery Presents\".", "Crowley made 81 television appearances, and was cast in 20 movies between 1951\u20131970.", "One of her last movie roles was in \"Downhill Racer\" with Robert Redford.", "She made three guest appearances on \"Perry Mason\", including the role of defendant and title character Marylin Clark in the 1958 episode, \"The Case of the Lonely Heiress.\"" ] ], "gold": "The original A Star Is Born, a 1937 American Technicolor romantic drama film about an aspiring actress and a fading movie star, starred Janet Gaynor and Fredric March. A Star Is Born has since been remade as a film three times, in 1951 starring Judy Garland and James Mason, in 1976 starring Barbara Streisand and Kris Kristofferson and in 2018 starring Lady Gaga and Bradley Cooper. All three of these movies have been nominated for at least four Academy Awards each. Additionally, in 1951, A Star is Born was remade into a television adaptation starring Kathleen Crowley and Conrad Nagel.", "prediction 1": "A Star Is Born is a 1937 American Technicolor romantic drama film produced by David O. Selznick, directed by William A. Wellman from a script by Wellman, Robert Carson, Dorothy Parker, and Alan Campbell, starring Janet Gaynor as an aspiring Hollywood actress and Fredric March as a fading movie star who helps launch her career. The film has been remade four times, in 1954 with Judy Garland and James Mason, in 1976 with Barbra Streisand and Kris Kristofferson, in 2013 with Aditya Roy Kapur and Shraddha Kapoor in Aashiqui 2, and in 2018 with Lady Gaga and Bradley Cooper, who also directed the film.", "prediction 2": "A Star Is Born is a 1937 American Technicolor romantic drama film produced by David O. Selznick, directed by William A. Wellman from a script by Wellman, Robert Carson, Dorothy Parker, and Alan Campbell, and starring Janet Gaynor as an aspiring Hollywood actress and Fredric March as a fading movie star who helps launch her career. The film was adapted as a radio play on the September 13, 1937, episode of Lux Radio Theater with Robert Montgomery and Janet Gaynor, the December 28, 1942, episode of Academy Award Theater, starring Fredric March, the June 29, 1946 episode of Screen Director's Playhouse starring Fredric March as an fading movie star who helps launch Esther's career. The film has been remade four times, in 1954 with Judy Garland and James Mason, in 1976 with Barbra Streisand and Kris Kristofferson, in 2013", "prediction 3": "A Star Is Born is a 1937 American Technicolor romantic drama film directed by William A. Wellman from a script by Wellman, Robert Carson, Dorothy Parker, and Alan Campbell. The film starred Janet Gaynor as an aspiring Hollywood actress and Fredric March as a fading movie star who helps launch her career. The radio play adaptation had Loretta Young and Burgess Meredith as the lead characters. As of 2018, the original A Star Is Born was a radio play, while the original film was based on the character played by Peter Mark Morrison. The original A Star Is Born was a musical play written and performed by John Hay Whitney. The song by John Williams was recorded on the album, which was recorded in 1936. The original was performed by the band, and starred in the song, which was recorded by the singer and songwriter, the songs \"The World\" which was recorded", "prediction 4": "A Star is Born is a 1937 American Technicolor romantic drama film made in Technicolor and produced by David O. Selznick and starring Janet Gaynor as an aspiring Hollywood actress. Fredric March stars as a fading movie star who helps launch Gaynor's career.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 575, "end": 602 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "A Star Is Born is a 1937 American Technicolor romantic drama film starring Janet Gaynor as an aspiring Hollywood actress, and Fredric March as a fading movie star. The film has been remade four times, in 1954 with Judy Garland and James Mason, in 1976 with Barbra Streisand and Kris Kristofferson, in 2013 with Aditya Roy Kapur and Shraddha Kapoor in Aashiqui 2, and in 2018 with Lady Gaga and Bradley Cooper. In February 1951, Kathleen Crowley appeared with Conrad Nagel in \"A Star is Born\"." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does super smash bro's come out?", "passages": [ [ "Super Smash Bros. for Nintendo 3DS and Wii U", "Super Smash Bros. for Nintendo 3DS and Wii U\n\nLike the rest of the \"Super Smash Bros.\" series, \"Super Smash Bros. for Nintendo 3DS\" and \"Super Smash Bros. for Wii U\" are non-traditional fighting games where players use different attacks to weaken their opponents and knock them out of an arena.", "The games are crossover titles that feature characters, items, music, and stages from various Nintendo franchises, as well as from several third-party franchises.", "The games began development in 2012 and were officially announced at E3 2013.", "The gameplay was designed to be somewhere between that of the faster, more competition-oriented \"Super Smash Bros. Melee\" and the slower, more casual-friendly \"Brawl\".", "New features include having up to eight players fighting at a time on the Wii U version, support for Nintendo's line of Amiibo, using custom Miis as playable fighters, post-release downloadable content including additional fighters and stages, and customizable special moves.", "Some features from previous games in the series were removed, such as the story mode from \"Super Smash Bros. Brawl\".", "Critics applauded the fine-tuning of existing \"Super Smash Bros.\" gameplay elements, but criticized some issues with online play." ], [ "Super Smash Bros. (video game)", "Super Smash Bros. (video game)\n\nSuper Smash Bros. (retroactively known as Super Smash Bros. 64) is a fighting video game developed by HAL Laboratory and published by Nintendo for the Nintendo 64 home video game console.", "It was released in Japan on January 21, 1999; in North America on April 26, 1999; and in Europe on November 19, 1999.", "\"Super Smash Bros.\" is the first game in the \"Super Smash Bros.\" series.", "The game is a crossover between many different Nintendo franchises, including \"Mario\", \"The Legend of Zelda\", \"Star Fox\", \"Donkey Kong\", \"Metroid\", \"Mother\", \"F-Zero\", \"Yoshi\", \"Kirby\", and \"Pok\u00e9mon\".", "It presents a cast of characters and locations from these franchises and allows players to use each character's unique skill sets and even take advantage of the stage's offensive events to inflict damage, recover health, and ultimately attempt to knock opponent characters off the stage.", "It received mostly positive reviews from the media and was commercially successful, selling over 5\u00a0million copies worldwide by 2001, with 2.93\u00a0million sold in the United States and 1.97\u00a0million copies sold in Japan.", "It was given an Editors' Choice award from IGN for the \"Best Fighting Game\"." ] ], "gold": "Super Smash Bros. is a crossover fighting game series published by Nintendo, and primarily features characters from various Nintendo franchises. Super Smash Bro's came out on Nintendo 64 in Japan on January 21, 1999, and in North America on April 26, 1999. It came out in the EU on November 19, 1999. It came out in the iQue player in China on November 15, 2005.", "prediction 1": "Super Smash Bros. is a fighting video game developed by HAL Laboratory and published by Nintendo for the Nintendo 64 home video game console. It was released in Japan on January 21, 1999, in North America on April 26, 1999, and in Europe on November 19, 1999. Super Smash Bros. for Nintendo 3DS and Super Smash Bros. for Wii U are non-traditional fighting games where players use different attacks to weaken their opponents and knock them out of an arena.", "prediction 2": "Super Smash Bros. is a fighting video game developed by HAL Laboratory and published by Nintendo for the Nintendo 64 home video game console. It was released in Japan on January 21, 1999, in North America on April 26, 1999, and in Europe on November 19, 1999. The Wii U version was released on November 19, 1999. Super Smash Bros. for Nintendo 3DS is released on February 24, 2020.", "prediction 3": "Super Smash Bros. is a fighting video game developed by HAL Laboratory and published by Nintendo for the Nintendo 64 home video game console. It was released in Japan on January 21, 1999; in North America on April 26, 1999; and in Europe on November 19, 1999. Super Smash Bros. for Nintendo 3DS and Super Smash Bros. for Nintendo Wii U are non-traditional fighting games where players use different attacks to weaken their opponents and knock them out of an arena.", "prediction 4": "Super Smash Bros. is a fighting video game developed by HAL Laboratory and published by Nintendo for the Nintendo 64 home video game console. It was released in Japan on January 21, 1999; in North America on April 26, 1999; and in Europe on November 19, 1999. Super Smash Bros. for Nintendo 3DS and Super Smash Bros. for Wii U are non-traditional fighting games where players use different attacks to weaken their opponents and knock them out of an arena.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 455 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Super Smash Bros. is a fighting video game that primarily features characters from various Nintendo franchises published by Nintendo for the Nintendo 64 home video game console. It was released in Japan on January 21, 1999, in North America on April 26, 1999, and in Europe on November 19, 1999. Super Smash Bros. for Nintendo 3DS and Super Smash Bros. for Wii U were announced in 2013." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "How do they test for drugs at the olympics?", "passages": [ [ "Blood doping", "Blood doping\n\nBlood doping is the practice of boosting the number of red blood cells in the bloodstream in order to enhance athletic performance.", "Because such blood cells carry oxygen from the lungs to the muscles, a higher concentration in the blood can improve an athlete\u2019s aerobic capacity (VO max) and endurance.", "Many methods of blood doping are illegal, particularly in professional sports.", "Blood doping is defined as the use of illicit products (e.g. erythropoietin (EPO), darbepoetin-alfa, hypoxia-inducible factor (HIF) stabilizers) and methods (e.g. increase aerobic capacity by maximizing the uptake of O) in order to enhance the O transport of the body to the muscles.", "The body undergoes aerobic respiration in order to provide sufficient delivery of O to the exercising skeletal muscles and the main determining factors are shown in figure 1.", "The rate of maximum O uptake (Omax) depends on cardiac output, O extraction and hemoglobin mass.", "The cardiac output of an athlete is difficult to manipulate during competitions and the distribution of cardiac output is at the maximum rate (i.e. 80%) during competitions.", "In addition, the O extraction is approximately 90% at maximal exercise." ], [ "Drug test", "Van Urk reagent turns blue-purple when in the presence of LSD.", "Scott Test's chemical solution shows up as a faint blue for cocaine base.", "Saliva / oral fluid-based drug tests can generally detect use during the previous few days.", "Is better at detecting very recent use of a substance.", "THC may only be detectable for 2\u201324 hours in most cases.", "On site drug tests are allowed per the Department of Labor.", "Detection in saliva tests begins almost immediately upon use of the following substances, and lasts for approximately the following times:\n\n\n", "A disadvantage of saliva based drug testing is that it is not approved by FDA or SAMHSA for use with DOT / Federal Mandated Drug Testing.", "Oral fluid is not considered a bio-hazard unless there is visible blood; however, it should be treated with care.", "Sweat patches are attached to the skin to collect sweat over a long period of time (up to 14 days).", "These are used by child protective services, parole departments, and other government institutions concerned with drug use over long periods, when urine testing is not practical.", "There are also surface drug tests that test for the metabolite of parent drug groups in the residue of drugs left in sweat.", "Drug-testing a blood sample measures whether or not a drug or a metabolite is in the body at a particular time." ], [ "Doping at the Olympic Games", "His gold medal was subsequently stripped and awarded to runner-up Carl Lewis, who himself had tested positive for banned substances prior to the Olympics, but had not been banned due to a lack of consistency in the application of the rules.", "At that time National Olympic Committees had leeway to determine whether a specific athlete met the criteria to be banned from Olympic competition.", "In the late 1990s, the IOC took the initiative in a more organized battle against doping, leading to the formation of the World Anti-Doping Agency (WADA) in 1999.", "The 2000 Summer Olympics and 2002 Winter Olympics have shown that the effort to eliminate performance-enhancing drugs from the Olympics is not over, as several medalists in weightlifting and cross-country skiing were disqualified due to failing a drug test.", "During the 2006 Winter Olympics, only one athlete failed a drug test and had a medal revoked.", "The IOC-established drug testing regimen (now known as the \"Olympic Standard\") has set the worldwide benchmark that other sporting federations attempt to emulate.", "During the Beijing games, 3,667 athletes were tested by the IOC under the auspices of the World Anti-Doping Agency.", "Both urine and blood testing was used in a coordinated effort to detect banned substances and recent blood transfusions." ] ], "gold": "They use urine testing for most drugs at the Olympics. Blood test results, however, show use of blood doping at the Olympics, a blood transfusion given to athletes to increase the number of red blood cells to enhance aerobic performance.", "prediction 1": "In the Olympic Games, the use of banned substances is tested for through a variety of different methods. The IOC uses a combination of saliva and oral fluid-based tests, which can detect use during the previous few days, and are better at detecting very recent use of a substance. There are also surface drug tests to test for metabolites of parent drug groups in the residue of drugs left in sweat.", "prediction 2": "In the 2012 Olympics, the IOC tested 3,667 athletes for drugs including LSD, DHEA, and METHANE. They used saliva and oral fluid-based drug tests to detect the presence of various drugs. They also used sweat patches to collect sweat over a long period of time, which are used by child protective services, parole departments, and other government institutions concerned with drug use over long periods, when urine testing is not practical. The IOC also used surface drug tests to test for metabolites of parent drug groups in the residue of drugs left in sweat.", "prediction 3": "The IOC tests athletes for drugs using the IUD, which measures the level of a substance in the bloodstream and whether or not a drug is present in the blood. The testing was performed using several methods, including saliva testing, oral fluid testing, sweat testing, and sweat patches. The testing was done using a combination of urine and blood samples, and was performed under the auspices of the World Anti-Doping Agency.", "prediction 4": "In the 2012 Games, the IOC and the World Anti-Doping Agency used both urine and blood testing in a coordinated effort to detect banned substances and recent blood transfusions. During the Beijing games, 3,667 athletes were tested by the IOC under the auspices of the World Anti-Doping Agency. In the 2012 Summer Olympics, the Olympic Committee used sweat patches attached to the skin to collect sweat over a long period of time (up to 14 days).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 280 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Both urine and blood testing was used in a coordinated effort to detect banned substances and recent blood transfusions. Blood doping is the practice of boosting the number of red blood cells in the bloodstream in order to enhance athletic performance." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who does demarcus cousins play for in the nba?", "passages": [ [ "DeMarcus Cousins", "DeMarcus Cousins\n\nDeMarcus Amir Cousins (born August 13, 1990) is an American professional basketball player for the Golden State Warriors of the National Basketball Association (NBA).", "Nicknamed \"Boogie\", he played college basketball for the Kentucky Wildcats, where he was an All-American in 2010.", "He left Kentucky after one season, and was selected with the fifth overall pick in the 2010 NBA draft by the Sacramento Kings.", "In his first season with the Kings, Cousins was named to the NBA All-Rookie First Team, and from 2015 to 2018, he was named an NBA All-Star.", "He is also a two-time gold medal winner as a member of the United States national team, winning his first in 2014 at the FIBA Basketball World Cup and his second in 2016 at the Rio Olympics.", "Cousins attended LeFlore Magnet High School in his hometown of Mobile, Alabama.", "He was a first-team \"Parade\" All-American in 2009, and played in the 2009 McDonald's All-American Boys Game, finishing with 14 points and 8 rebounds.", "Cousins also played in the 2009 Nike Hoop Summit at the Rose Garden in Portland and the Jordan Brand Classic at Madison Square Garden where he scored 10 points for the black team." ], [ "DeMarcus Cousins", "On February 3, 2017, Cousins recorded his sixth career triple-double with 22 points, 12 rebounds and 12 assists in a 105\u2013103 loss to the Phoenix Suns.", "Four days later, he was suspended one game without pay for receiving his 16th technical foul of the 2016\u201317 season.", "In addition, Cousins was fined $25,000 for making an inappropriate statement and gesture after leaving the playing court following the Kings' 109\u2013106 overtime win against the Golden State Warriors on February 4 at Golden 1 Center.", "On February 20, 2017, Cousins and teammate Omri Casspi were traded to the New Orleans Pelicans in exchange for Tyreke Evans, Buddy Hield, Langston Galloway, and 2017 first-round and second-round draft picks.", "He made his debut for the Pelicans three days later, recording 27 points and 14 rebounds in a 129\u201399 loss to the Houston Rockets.", "On March 3, 2017, he had 19 points and a season-high 23 rebounds in a 101\u201398 overtime loss to the San Antonio Spurs.", "His 23 rebounds tied the Pelicans' franchise record held by Tyson Chandler.", "Two days later, he had 26 points and 15 rebounds before fouling out in the Pelicans' 105\u201397 win over the Los Angeles Lakers, marking Cousins' first win as a Pelican." ] ], "gold": "DeMarcus Cousins played for several teams in the NBA. First, he played for the Sacramento Kings. Then, it was the New Orleans Pelicans he played for. And, finally, Cousins played for the Golden State Warriors.", "prediction 1": "DeMarcus Amir Cousins is an American professional basketball player for the Golden State Warriors of the National Basketball Association. He plays for the Golden State Warriors after being drafted by the Sacramento Kings in the 2010 NBA draft. On February 3, 2017, he recorded his sixth career triple-double with 22 points, 12 rebounds and 12 assists in a 105\u2013103 loss to the Phoenix Suns. On March 3, 2017, he had 19 points and a season-high 23 rebounds in a 101\u201398 overtime loss to the San Antonio Spurs. His 23 rebounds tied the franchise record held by Tyson Chandler.", "prediction 2": "DeMarcus Amir Cousins, better known by his sarcastic nickname Boogie, is an American professional basketball player who plays for the Golden State Warriors of the National Basketball Association. Cousins, a free agent, was signed on July 1, 2012 by the Sacramento Kings after being selected with the fifth overall pick in the 2010 NBA draft. He left Kentucky after one season, and was selected with the sixth overall pick in the 2010 NBA draft by the Sacramento Kings. In his first season with the Kings, Cousinsinsinsinsins was named to the NBA All-Rookie First Team and from 2015 to 2018, Cousinsinsins was named an NBA All-Star.", "prediction 3": "DeMarcus Cousins is an American professional basketball player who plays for the Golden State Warriors of the National Basketball Association. He is a member of the United States National Team and has been with the Warriors since the 2013-14 season. On February 20, 2017, he and teammate Omri Casspi were traded to the New Orleans Pelicans in exchange for Tyreke Evans, Buddy Hield, Langston Galloway, and 2017 first-round and second-round draft picks. Cousins made his debut for the New Orleans Pelicans in exchange for Tyreke Evans, Buddy Hield, Langston Galloway, and 2017 first-round draft picks, Buddy Hield, Langston Galloway, and 2017 first-round, and second-round draft picks, and 2017 second-round draft picks.", "prediction 4": "DeMarcus Amir Cousins is an American professional basketball player for the Golden State Warriors. He played for the Warriors for one season. Cousins, nicknamed Boogie, was an All-American in college basketball for the Kentucky Wildcats from 2010 to 2017. Cousins is also a two-time gold medal winner as a member of the United States national team, winning his first gold medal in 2014 at the FIBA Basketball World Cup and his second in 2016 at the Rio Olympics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 506 }, { "error type": "Irrelevant", "explanation": "", "start": 507, "end": 572 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "DeMarcus Amir Cousins is an American professional basketball player for the Golden State Warriors of the National Basketball Association. He plays for the Golden State Warriors after being drafted by the Sacramento Kings and traded to the the New Orleans Pelicans." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who represents wellesley in the house of representatives?", "passages": [ [ "Massachusetts's 4th congressional district", "Massachusetts's 4th congressional district\n\nMassachusetts's 4th congressional district is located mostly in southern Massachusetts.", "It is represented by Democrat Joseph P. Kennedy III.", "The district covers much of the area included in the before the 1982 redistricting.", "In prior years, the district stretched from Brookline to Fitchburg.", "The shape of the district underwent some changes effective from the elections of 2012, after Massachusetts congressional redistricting to reflect the 2010 census.", "Most of Plymouth County and the South Coast are included in the new 9th district.", "The new 4th district has expanded westward to include towns along the Rhode Island border that had been in the old 3rd district.", "For a very brief time (1793\u201395) it represented part of the District of Maine." ], [ "Massachusetts's 10th congressional district", "1934:", "Boston, Wards 4, 5, 9, 10, 11, 12, 19, 20, 21. 1941-1953: Boston, Wards 4, 5, 10, 12, 19, 20, 21; Brookline, Newton. 1963: \"Bristol County: Cities of Attleboro, Fall River, and Taunton.", "Towns of Berkley, Dighton, Easton, Freetown, Mansfield, North Attleboro, Norton, Raynham, Rehoboth, Seekonk, Somerset, and Swansea.", "Middlesex County: City of Newton.", "Norfolk County: Towns of Dover, Foxborough, Medfield, Needham, Norfolk, Plainville, Walpole, Wellesley, Westwood, and Wrentham.\"", "1977: \"Bristol County: Cities of Attleboro, Fall River, and Taunton.", "Towns of Berkley, Dighton, Easton, Freetown, Mansfield, North Attleborough, Norton, Raynham, Rehoboth, Seekonk, Somerset, Swansea, and Westport.", "Middlesex County: Towns of Natick and Sherborn.", "Norfolk County: Towns of Foxborough, Medfield, Millis, Norfolk, Plainville, Sharon, Wellesley, and Wrentham.", "Plymouth County: Towns of Bridgewater, East Bridgewater, Halifax, Hanson, Lakeville, Middleborough, and West Bridgewater.\"" ], [ "Laurie Glimcher", "Her daughter, Kalah Auchincloss, J.D., M.P.H., is an Senior Vice President, Regulatory Compliance and Deputy General Counsel for Greenleaf Health following six years at the Food & Drug Administration as Deputy Chief of Staff for two FDA Commissioners.", "Her older son, Dr. Hugh Glimcher Auchincloss, is also a physician, who was in training as a cardiothoracic surgeon at Massachusetts General Hospital in 2016.", "Her younger son, Jake Auchincloss, is a cybersecurity professional and a Newton, Massachusetts City Counselor-at-large following service as an infantry officer in the Marine Corps.", "Laurie Glimcher has been considered a champion of women's rights in the scientific by many of her peers.", "While she was at Harvard, she hired lab technicians with her own research fund to support her postdoctoral fellows after they had babies so that they were allowed to leave by 6.", "This carried on into Glimcher's involvement with the National Institutes of Health to create a similar postdoc grant program caring for family members.", "Glimcher served on the 2005 Larry Summers Task Force for Women in Science and Engineering, where she expressed her disappointment in the rate of progress for women in science." ] ], "gold": "Massachusetts's 4th congressional district is located mostly in southern Massachusetts and includes the city of Wellesley. Joseph P. Kennedy III represented the 4th congressional district after the 2012, 2014, and 2016 elections. As of 2020, Jake Auchincloss represents the 4th congressional district.", "prediction 1": "The district covers much of the area included in the before the 1982 redistricting. Wellesley is in the 4th congressional district of Massachusetts, located mostly in southern Massachusetts, and is represented by Democrat Joseph P. Kennedy III. The shape of the district underwent some changes effective from the elections of 2012, after Massachusetts congressional redistricting to reflect the 2010 census. The 4th district has expanded westward to include towns along the Rhode Island border that had been in the old 3rd district. Wellesley is in the 9th district, which is located in Norfolk County, and in the towns of Dover, Foxborough and Westwood, and Wrentham.", "prediction 2": "Massachusetts' 4th congressional district is located mostly in southern Massachusetts. It is represented by Democrat Joseph P. Kennedy III. The district covers much of the area included in the before the 1982 redistricting. In prior years, the district stretched from Brookline to Fitchburg. The shape of the district underwent some changes effective from the elections of 2012, after Massachusetts congressional redistricting to reflect the 2010 census. The new 4th district has expanded westward to include towns along the Rhode Island border that had been in the old 3rd district.", "prediction 3": "Massachusetts has three congressional districts. Wellesley, in Massachusetts, is in the 4th congressional district, which is located mostly in southern Massachusetts. The district covers much of the area included in the before the 1982 redistricting. In prior years, the district stretched from Brookline to Fitchburg. In the 9th congressional district, Wellesley is represented by Democrat Laurie Glimcher.", "prediction 4": "Massachusetts' 4th congressional district is located mostly in southern Massachusetts and is represented by Democrat Joseph P. Kennedy III. The district covers much of the area included in the before the 1982 redistricting. The shape of the district underwent some changes effective from the elections of 2012, after Massachusetts congressional redistricting to reflect the 2010 census. The new 4th district has expanded westward to include towns along the Rhode Island border that had been in the old 3rd district.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 407 }, { "error type": "Irrelevant", "explanation": "", "start": 408, "end": 532 }, { "error type": "Unverifiable", "explanation": "", "start": 533, "end": 566 }, { "error type": "Irrelevant", "explanation": "", "start": 567, "end": 668 } ], "missing-info": [], "corrected-prediction": "The district covers much of the area included in the before the 1982 redistricting. Wellesley is in the 4th congressional district of Massachusetts, located mostly in southern Massachusetts, and is represented by Democrat Joseph P. Kennedy III. " }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When did they start calling world war 1?", "passages": [ [ "World War I", "World War I\n\nWorld War I (often abbreviated as WWI or WW1), also known as the First World War or the Great War, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918.", "Contemporaneously described as \"the war to end all wars\", it led to the mobilisation of more than 70\u00a0million military personnel, including 60 million Europeans, making it one of the largest wars in history.", "An estimated nine million combatants and seven million civilians died as a direct result of the war, and it also contributed to later genocides and the 1918 influenza pandemic, which caused between 50 and 100 million deaths worldwide.", "Military losses were exacerbated by new technological and industrial developments and the tactical stalemate caused by gruelling trench warfare.", "It was one of the deadliest conflicts in history and precipitated major political changes, including the Revolutions of 1917\u20131923, in many of the nations involved.", "Unresolved rivalries at the end of the conflict contributed to the start of World War II about twenty years later.", "On 28 June 1914, Gavrilo Princip, a Bosnian Serb Yugoslav nationalist, assassinated the Austro-Hungarian heir Archduke Franz Ferdinand in Sarajevo, leading to the July Crisis.", "In response, on 23 July Austria-Hungary issued an ultimatum to Serbia." ], [ "World War I", "The term \"First World War\" was first used in September 1914 by German biologist and philosopher Ernst Haeckel, who claimed that \"there is no doubt that the course and character of the feared 'European War'\u00a0... will become the first world war in the full sense of the word,\" citing a wire service report in \"The Indianapolis Star\" on 20 September 1914.", "Prior to World War II, the events of 1914\u20131918 were generally known as the Great War or simply the World War.", "Contemporary Europeans also referred to it as \"the war to end war\" or \"the war to end all wars\" due to their perception of its then-unparalleled scale and devastation.", "After World War II began in 1939, the terms became more standard, with British Empire historians, including Canadians, favouring \"The First World War\" and Americans \"World War I\".", "In October 1914, the Canadian magazine \"Maclean's\" wrote, \"Some wars name themselves.", "This is the Great War.\"", "However, while certainly accurate in Canada, this was not so even in Britain; historian John Holland Rose's 1911 account of the 1793\u20131815 wars against France was titled \"William Pitt and the Great War\"." ], [ "World war", "German writer August Wilhelm Otto Niemann had used the term \"world war\" in the title of his anti-British novel, \"Der Weltkrieg: Deutsche Tr\u00e4ume\" (\"The World War: German Dreams\") in 1904, published in English as \"The Coming Conquest of England\".", "In English, the term \"First World War\" had been used by Charles \u00e0 Court Repington, as a title for his memoirs (published in 1920); he had noted his discussion on the matter with a Major Johnstone of Harvard University in his diary entry of September 10, 1918.", "The term \"World War I\" was coined by \"Time\" magazine on page 28b of its June 12, 1939 issue.", "In the same article, on page 32, the term \"World War II\" was first used speculatively to describe the upcoming war.", "The first use for the actual war came in its issue of September 11, 1939.", "One week earlier, on September 4, the day after France and the United Kingdom declared war on Germany, the Danish newspaper \"Kristeligt Dagblad\" used the term on its front page, saying \"The Second World War broke out yesterday at 11 a.m.\"\n\nSpeculative fiction authors had been noting the concept of a Second World War in 1919 and 1920, when Milo Hastings wrote his dystopian novel, \"City of Endless Night\"." ] ], "gold": "World War I or the First World War, often abbreviated as WWI or WW1, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. It was also known as the Great War, the World War, and \"the war to end all wars\". The term world war was first coined in September 1914 by German biologist and philosopher Ernst Haeckel. The term \"World War I\" was coined by Time magazine on page 28b of its June 12, 1939 issue. In the same article, on page 32, the term \"World War II\" was first used speculatively to describe the upcoming war. The first use for the actual war came in its issue of September 11, 1939.", "prediction 1": "World War I, often abbreviated as WWI or WW1, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. Contemporary Europeans also referred to it as \"the war to end all wars\" due to their perception of its then-unparalleled scale and devastation. The term \"World War I\" was first used in September 1914 by German biologist and philosopher Ernst Haeckel, who claimed that \"there is no doubt that the course and character of the feared 'European War'... will become the first world war in the full sense of the word,\" citing a wire service report in \"The Indianapolis Star on 20 September 1914 influenza pande, which caused between 50 and 100 million deaths worldwide.\n", "prediction 2": "World War I, often abbreviated as WWI or WW1, also known as the First World War or the Great War, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. On June 28, 1914, Gavrilo Princip, a Bosnian Serb Yugoslav nationalist, assassinated the Austro-Hungarian heir Archduke Franz Ferdinand in Sarajevo, leading to the July Crisis. The term \"First World War\" was first used in September 1914 by German biologist and philosopher Ernst Haeckel, who claimed that \"there is no doubt that the course and character of the feared 'European War'... will become the first world war in the full sense of the war in the first world war, which was believed to be the first world war in the full sense of the word\".", "prediction 3": "World War 1, often abbreviated as WWI or WW1, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. The term \"World War\" was first used in September 1914 by German philosopher Ernst Haeckel, who claimed that \"there is no doubt that the course and character of the feared 'European War'... will become the first world war in the full sense of the word\", citing a wire service report in The Indianapolis Star on 20 September 1914. The term \"World War\" was coined by Time magazine on page 28b of its June 12, 1939 issue, and then, the term \"World War II\" was used speculatively to describe the upcoming war. The first use for the actual war came in its issue of September 11, 1939.", "prediction 4": "World War I, often abbreviated as WWI or WW1, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. It was contemporaneously described as \"the war to end all wars\" because of its perceived immense scale and devastation. The term was first used in September 1914 by German biologist and philosopher Ernst Haeckel, when he claimed that \"there is no doubt that the course and character of the feared 'European War'... will become the first world war in the full sense of the word,\" citing a wire service report in \"The Indianapolis Star\" on 20 September 1914 July Crisis in Sarajevo, leading to the July Pandemic.\" World War I was coined by Time magazine in its June 12, 1939.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 700 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "World War I, often abbreviated as WWI or WW1, was a global war originating in Europe that lasted from 28 July 1914 to 11 November 1918. Prior to World War II, the events of 1914\u20131918 were generally known as the Great War or simply the World War. Contemporary Europeans also referred to it as \"the war to end all wars\" . The term \"World War I\" was first used in September 1914 by German biologist and philosopher Ernst Haeckel. The term \"World War I\" was coined by \"Time\" magazine on page 28b of its June 12, 1939 issue. In the same article, on page 32, the term \"World War II\" was first used speculatively to describe the upcoming war. The first use for the actual war came in its issue of September 11, 1939. After World War II began in 1939, the terms became more standard, with British Empire historians, including Canadians, favouring \"The First World War\" and Americans \"World War I\". In English, the term \"First World War\" had been used by Charles \u00e0 Court Repington as well.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Top of the lake series 2 how many episodes?", "passages": [ [ "Top of the Lake", "Top of the Lake\n\nTop of the Lake is a mystery drama television series created and written by Jane Campion and Gerard Lee, and directed by Campion and Garth Davis.", "It aired in 2013, and the sequel, entitled \"Top of the Lake: China Girl\", in 2017.", "It marks Campion's first work for television since \"An Angel at My Table\" in 1990.", "Season 1 follows Detective Robin Griffin (Elisabeth Moss) and deals with her investigation of the disappearance of a pregnant 12-year-old girl in New Zealand.", "Season 2, \"China Girl\", is set in Sydney four years later, as Detective Griffin investigates the death of an unidentified Asian girl found at Bondi Beach.", "\"Top of the Lake\" was co-produced for BBC Two in the UK, BBC UKTV in Australia and New Zealand, and Sundance Channel in the United States.", "It has been generally very well received.", "Elisabeth Moss plays the central role of Robin Griffin, a Sydney detective specialising in sexual assault, in both series.", "Additional cast members are as follows:\n\n\n\n\n\n\n\nDavid Wenham returns as Al in one episode.", "Kip Chapman, Jacqueline Joe, Byron Coll and Cohen Holloway also reprise their \"Top of the Lake\" roles in a flashback sequence, with Mark Leonard Winter appearing as Johnno.", "Actress Jennifer Ehle auditioned for the role of GJ, which went to Holly Hunter." ], [ "Imagine (TV series)", "Series 1 (from 11 June 2003):\n\n\nSeries 2 (from 12 November 2003):\n\n\nSeries 3 (from 2 June 2004):\n\n\nSeries 4 (from 24 November 2004):\n\n\nSeries 5 (from 11 May 2005):\n\n\nSeries 6 (from 22 June 2005):\n\n\nSeries 7 (from 23 November 2005):\n\n\nSeries 8 (from 17 January 2006)\n\n\nSeries 9 (from 23 May 2006)\n\n\nSeries 10 (from 17 October 2006)\n\n\nSpecial (27 December 2006)\n\n\nSeries 11 (from 8 May 2007)\n\n\n", "Special (4 July 2007)\n\n\nSeries 12 (from 23 October 2007)\n\n\nSeries 13 (from 23 May 2008)\n\n\nSeries 14 (from 5 October 2008)\n\n\nSeries 15 (from 23 June 2009)\n\n\nSeries 16 (from 17 November 2009)\n\n\nSeries 17 (from 5 April 2010)\n\n\nSeries 18 (from 15 June 2010)\n\n\nSeries 19 (from 16 November 2010)\n\n\n", "Special (23 February 2011)\n\n\n", "The Trouble with Tolstoy (from 27 March 2011)\n\n\nSeries 20 (from 28 June 2011)\n\n\nSeries 21 (from 1 November 2011)\n\n\nSeries 22 (from 26 June 2012)\n\n\nSeries 23 (from 19 September 2012)\n\n\nSeries 24 (from 28 March 2013)\n\n\nSeries 25 (from 5 Nov 2013)\n\n\nSeries 26 (from 18 May 2014)\n\n\nSeries 27\n\n\nSeries 28\n\n\nSeries 29\n\n\nOther (2006)" ] ], "gold": "Top of the lake is a mystery drama television series. Top of the lake series 2 had 6 episodes as of August 21, 2017. It had 5 episodes of as August 24, 2017 and it had 4 episodes as of August 17, 2017.", "prediction 1": "Top of the Lake is a mystery drama television series created and written by Jane Campion and Gerard Lee, and directed by Campion and Garth Davis. It aired in 2013, and the sequel, Top of the Lake: China Girl, in 2017. The series had a total of 76 episodes.", "prediction 2": "Top of the Lake is a mystery drama television series created and written by Jane Campion and Gerard Lee, and directed by Campion and Garth Davis. Top of the Lake series 2 has a total of 68 episodes. Top of the Lake series 1 has 68 episodes. Top of the Lake series 2 has 67 episodes. Top of the Lake series 2 has 69 episodes. Top of the Lake series 2: China Girl has 62 episodes.", "prediction 3": "Top of the Lake is a mystery drama television series created and written by Jane Campion and Gerard Lee, and directed by Campion and Garth Davis. Top of the Lake series 2 has 25 episodes, while series 1 has 24 episodes, while series 2 has 25 episodes. Series 3 has 32 episodes. Top of the Lake series 2 has 37 episodes. Top of the Lake series 2 has 32 episodes.", "prediction 4": "Top of the Lake is a mystery drama television series created and written by Jane Campion and Gerard Lee, and directed by Campion and Garth Davis. It aired in 2013, and the sequel, Top of the Lake: China Girl, in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 145 }, { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 217 }, { "error type": "Unverifiable", "explanation": "", "start": 218, "end": 256 } ], "missing-info": [], "corrected-prediction": "Top of the Lake is a mystery drama television series." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did mother's day become a holiday?", "passages": [ [ "Anna Jarvis", "After the death of Jarvis\u2019 father, Granville, in 1902, she urged her mother to move to Philadelphia to stay with her and her brother.", "Both brother and sister worried about their mother\u2019s health and Ann Reeves Jarvis ultimately agreed to move to Philadelphia in 1904 when her heart problems necessitated it.", "Jarvis spent the majority of her time taking care of her mother as Ann Reeves Jarvis' health declined.", "She died on May 9, 1905.", "On May 10, 1908, three years after her mother's death, Jarvis held a memorial ceremony to honor her mother and all mothers at Andrews Methodist Episcopal Church, today the International Mother's Day Shrine, in Grafton, West Virginia, marking the first official observance of Mother's Day.", "The International Mother's Day Shrine has been a designated National Historic Landmark since October 5, 1992.", "Although Jarvis did not attend this service, she sent a telegram that described the significance of the day as well as five hundred white carnations for all who attended the service.", "As she spoke in Philadelphia at the Wanamaker's Store Auditorium, she moved her audience with the power of her speech.", "Although the national proclamation represented a public validation of her efforts, Jarvis always believed herself to be the leader of the commemorative day and therefore maintained her established belief in the sentimental significance of the day to honor all mothers and motherhood." ], [ "International Mother's Day Shrine", "Anna chose the second Sunday in May as the annual date for the holiday because it marked the anniversary of her mother's death.", "The white carnation became a symbol of the day, and was selected by Jarvis to honor her mother's favorite flower.", "The celebration also extended to many foreign countries within only a few years of its conception.", "In 1914, President Woodrow Wilson proclaimed that flags be flown \"on the second Sunday in May as a public expression of our love and reverence for the mothers of our country.\"", "The 1914 proclamation by Wilson represents a victory for Jarvis, since it recognized her holiday and mothers across America.", "The year 2014 represents the 100th anniversary of Wilson's proclamation and the official national recognition of Mother's Day as a holiday.", "The International Mother's Day Shrine in Grafton, West Virginia holds special commemorations and events in recognition of this anniversary.", "The adoption of Mother's Day spread quickly internationally.", "By the third call for a Mother's Day celebration by Anna Jarvis in 1909, \"forty-five states, Puerto Rico, Hawaii, Canada, and Mexico\" participated with celebrations on the second Sunday in May.", "The rapid adoption of Mother's day by other nations surprised Jarvis, who stated, \"Where it will end must be left for the future to tell.", "That it will girdle the globe seems now certain.\"" ], [ "Mother's Day (United States)", "Mother's Day (United States)\n\nMother's Day in the United States is an annual holiday celebrated on the second Sunday in May.", "Mother's Day recognizes mothers, motherhood and maternal bonds in general, as well as the positive contributions that they make to society.", "It was established by Anna Jarvis, with the first official Mother's Day celebrated at St. Andrew's Methodist Church in Grafton, West Virginia, on May 10, 1908.", "In the United States, Mother's Day complements similar celebrations honoring family members, such as Father's Day, Siblings Day and Grandparents Day.", "Internationally, there are a large variety of Mother's Day celebrations with different origins and traditions, some now also having been influenced by this more recent American tradition.", "During the 19th century, women's peace groups in the United States tried to establish holidays and regular activities in favor of peace and against war.", "A common early activity was the meeting of groups of mothers whose sons had fought or died on opposite sides of the American Civil War.", "In 1868, Ann Jarvis, Anna Jarvis's mother, organised a committee to establish a \"Mother's Friendship Day\", the purpose of which was \"to reunite families that had been divided during the Civil War.\"" ] ], "gold": "Mother's Day is a celebration honoring the mother of the family or individual, as well as motherhood, maternal bonds, and the influence of mothers in society. The modern holiday of Mother's Day was first celebrated in 1908, when Anna Jarvis held a memorial for her mother at St Andrew's Methodist Church in Grafton, West Virginia. St Andrew's Methodist Church now holds the International Mother's Day Shrine. However, owing to the efforts of Anna Jarvis, by 1911 all U.S. states observed the holiday, with some of them officially recognizing Mother's Day as a local holiday. In 1914, Woodrow Wilson signed a proclamation designating Mother's Day, held on the second Sunday in May, as a national holiday to honor mothers.", "prediction 1": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. According to Anna Jarvis, the day was first proposed by women's groups during the 19th century to establish holidays and regular activities in favor of peace and against war. In 1914, President Woodrow Wilson proclaimed that flags be flown \"on the second Sunday in May as a public expression of our love and reverence for the mothers of our country.\" In 2014, the 100th anniversary of Wilson's proclamation and the official national recognition of Mother's Day as a holiday.", "prediction 2": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. In 1908, Anna Jarvis held a memorial ceremony to honor her mother and all mothers at Andrews Methodist Episcopal Church, today the International Mother's Day Shrine, in Grafton, West Virginia, marking the first official observance of Mother's Day. The adoption of Mother's Day spread quickly internationally.", "prediction 3": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. The adoption of Mother's Day by Anna Jarvis spread quickly internationally. The first official Mother's Day celebration was held at Andrews Methodist Episcopal Church in Grafton, West Virginia on May 10, 1908. The International Mother's Day Shrine in Grafton, West Virginia holds special commemorations and events in recognition of this anniversary.", "prediction 4": "In 1914, President Woodrow Wilson proclaimed that flags be flown \"on the second Sunday in May as a public expression of our love and reverence for the mothers of our country.\" The year 2014 marks the 100th anniversary of Wilson's proclamation and the official national recognition of Mother's Day as a holiday. Anna Jarvis's first official Mother's Day celebration was celebrated at St. Andrew's Methodist Church in Grafton, West Virginia, on May 10, 1908.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 446, "end": 569 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 269 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May, honoring the mother of the family or individual, as well as motherhood, maternal bonds, and the influence of mothers in society. It was established by Anna Jarvis, with the first official Mother's Day celebrated at St. Andrew's Methodist Church in Grafton, West Virginia, on May 10, 1908. In 1914, President Woodrow Wilson proclaimed that flags be flown \"on the second Sunday in May as a public expression of our love and reverence for the mothers of our country.\"" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings cory in the house theme song?", "passages": [ [ "Cory in the House", "The theme song to \"Cory in the House\", was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley (though the closing credits of the show credit the performance of the theme song only to Massey).", "An alternate theme song \"Rollin' to D.C.\" is also sung by Massey and Walsh and was used in the music video to promote the series.", "The \"Cory in the House\" franchise has spawned one video game, of which it shares the same name.", "The game was released in 2008 for the Nintendo DS.", "The series originally aired from January 12, 2007, to September 12, 2008, on Disney Channel.", "The show returned to Disney Channel on August 14, 2014, as part of Disney Replay.", "It premiered on the same date on Family Channel and on June 1, 2011, on Disney XD (Canada).", "In the United Kingdom and Ireland it premiered on January 28, 2007, on Disney Channel and on September 5, 2009, on Disney XD.", "It premiered on February 2, 2007, on Disney Channel (Australia and New Zealand), on April 27, 2007, on Disney Channel (Southeast Asia), and on June 9, 2007, on Disney Channel (India)." ], [ "Cory in the House", "Cory in the House\n\nCory in the House is an American television series which aired on the Disney Channel from January 12, 2007, to September 12, 2008, and was a spin-off from the Disney show \"That's So Raven\".", "The show focuses on Cory Baxter, who moves from San Francisco, California to Washington, D.C. with his father, after Victor Baxter gets a new job in the White House as the official head chef.", "The series marks a Disney Channel first, as it is the channel's first spin-off.", "This is also the only Disney Channel spin-off series to be broadcast in standard definition for the entire length of the show.", "Reruns of the series have not been produced on Disney Channel, or on Disney XD; however, they continue to air on the Family channel in Canada.", "Raven-Symon\u00e9 guest-starred, reprising her role as Raven Baxter in one episode.", "In 2014, Disney Channel started airing a weekly block called \"Disney Replay\" on Wednesdays nights, during which episodes of \"Cory in the House\" air alongside \"That's So Raven\" and \"Kim Possible\", among others.", "After the completion of \"That's So Raven\", propositions were made for a spin-off including \"That's So Raven Too!\"" ] ], "gold": "Cory in the House is an American television sitcom which aired on the Disney Channel from January 12, 2007, to September 12, 2008, and was a spin-off from the Disney show That's So Raven. The theme song to \"Cory in the House\", was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley. An alternate theme song, \"Rollin' to D.C.\", is also sung by Massey and Walsh and was used in the music video to promote the series.", "prediction 1": "The theme song to Cory in the House was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley. The closing credits of the show credit the performance of the theme song only to Massey. An alternate theme song \"Rollin' to D.C.\" is also sung by Massey and Walsh and was used in the music video to promote the series.", "prediction 2": "Cory in the House is an American television series which was a spin-off from the Disney channel show That's So Raven and aired on the Disney Channel from January 12, 2007 to September 12, 2008. The theme song was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley, though the closing credits of the show credit the performance of the theme song only to Massey.", "prediction 3": "The theme song to \"Cory in the House\", was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley. Kyle Massey, who also sings the theme song, also sang in the closing credits of the show.", "prediction 4": "The theme song to \"Cory in the House\", was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley. The closing credits of the show credit the performance of the theme song only to Massey.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 248 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Cory in the House Cory in the House is an American television series which aired on the Disney Channel from January 12, 2007, to September 12, 2008, and was a spin-off from the Disney show \"That's So Raven\". The theme song to Cory in the House was written and produced by Matthew Gerrard and Robbie Nevil, and performed by Kyle Massey, Maiara Walsh, and Jason Dolley. An alternate theme song \"Rollin' to D.C.\" is also sung by Massey and Walsh and was used in the music video to promote the series." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is the most common language in mexico?", "passages": [ [ "Languages of Mexico", "For instance, the Mixtec are a single ethnicity and therefore count as a single language for governmental/legal purposes, but there are a dozen distinct Mixtec dialect regions, each of which includes at least one variety that is not mutually intelligible with those of the other dialect regions (Josserand, 1983), and \"Ethnologue\" counts 52 varieties of Mixtec that require separate literature.", "\"Ethnologue\" currently counts 282 indigenous languages currently spoken in Mexico, plus a number of immigrant languages (Lewis et al. 2018).", "Due to the long history of marginalization of indigenous groups, most indigenous languages are endangered, with some languages expected to become extinct within years or decades, and others simply having populations that grow slower than the national average.", "According to the Commission for the Development of Indigenous Peoples (CDI) and National Institute of Indigenous Languages (INALI), while 10\u201314% of the population identifies as belonging to an indigenous group, around 6% speak an indigenous language.", "There are other languages not native to Mexico that are spoken in the country.", "Besides Spanish, the most populous are probably English, German (Plautdietsch), Arabic, Chinese and Japanese.", "From the arrival of the first Franciscan missionaries, Spanish, Latin, and indigenous languages played parts in the evangelization of Mexico." ], [ "Languages of Mexico", "\"Indigenous people\u2019s disadvantaged socioeconomic status and the pressure of assimilation into mestizo or Ladino society have been influential on indigenous language loss.\"", "The result of the conflict between indigenous languages and Spanish has been a language shift in Mexico from indigenous languages being spoken to more people using Spanish in every domain.", "Due to this situation there have been many different language revitalization strategies put in place in Mexico to try to reverse this language shift.", "See literature on projects done with the Nahua people and the experiences of language revitalization in the South of Mexico.", "The following is a classification of the 65 indigenous languages grouped by family:\n\nLanguage families with members north of Mexico\n\n\nLanguage families with all known members in Mexico\n\nLanguage family with members south of Mexico\n\nLanguage isolates:\n*In danger of extinction.", "The deaf community uses Mexican Sign Language, Yucatan Sign Language, and, in northern Baja California, American Sign Language.", "The non-indigenous languages spoken in Mexico include English (by English-speaking as well as by the residents of border states).", "One example of this group is of the American Mormon colony of Nueva Casas Grandes in Chihuahua, which settled in the late 19th century." ], [ "World language", "Russian is the largest native language in Europe, one of the six official languages of the United Nations, one of two official languages aboard the International Space Station and the third most widespread language on the Internet after English and German.", "Spanish is the world's second-most spoken native language, after Mandarin Chinese.", "Spanish was used in the Spanish Empire and today is in use in Spain, in Latin American countries (except Brazil, French Guyana, Suriname, Guiana, Haiti and other Caribbean islands), and is spoken in many parts of the United States, particularly in Florida and the states which border Mexico.", "Indeed, by 2013 Spanish was the most widely taught non-English language in American secondary schools and schools of higher education.", "It is also an official language of the United Nations.", "As of December 2017 Spanish had the third largest number of internet users by language (after English and Chinese)." ] ], "gold": "Many languages are spoken in Mexico, though Spanish is the most widespread. Besides Spanish, the most populous are probably English, German (Plautdietsch), Arabic, Chinese and Japanese. The deaf community uses Mexican Sign Language, Yucatan Sign Language, and, in northern Baja California, American Sign Language. The most common indigenous language in Mexico is Aztec and Nahuatl.", "prediction 1": "The most common language in Mexico is Spanish, followed by English, German and Arabic. There are several different languages spoken in Mexico, including the Mixtec and the Creole languages. Spanish is the most commonly spoken language in Mexico, followed by the Creole, Creole and Creole languages. The most common languages spoken in Mexico are Mexican Sign Language, Mexican Sign Language, and Yucatan Sign Language.", "prediction 2": "The majority of Mexicans speak Spanish, the second most common language in the country, while the Mixtec are a single ethnicity and therefore count as a single language for governmental/legal purposes. Besides Spanish, the most populous are probably English, German (Plautdietsch), Arabic, Chinese and Japanese. The deaf community uses Mexican Sign Language, Yucatan Sign Language, and, in northern Baja California, American Sign Language.", "prediction 3": "The most common language spoken in Mexico is Spanish, which is the language of the country. Spanish is the most widely spoken language in Mexico and the second most widely taught language outside of the United States. However, in Mexico, Spanish is also the language of the country's largest population and the most widely spoken language.", "prediction 4": "The most common language in Mexico is Spanish. In the country, there are 282 indigenous languages, and 126 indigenous languages spoken. The most common language spoken in Mexico is Spanish. The most common language used abroad is German.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 164, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 163 }, { "error type": "Redundant", "explanation": "The most common language in Mexico is Spanish, ", "start": 190, "end": 245 }, { "error type": "Unverifiable", "explanation": "", "start": 246, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 299, "end": 418 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The most common language in Mexico is Spanish, followed by English, German and Arabic, Chinese and Japanese. The deaf community uses Mexican Sign Language, Yucatan Sign Language, and, in northern Baja California, American Sign Language." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who plays mr walker on 13 reasons why?", "passages": [ [ "Amalfi Coast", "In Season 2 of\" 13 Reasons Why\", the character Bryce Walker talks about his family's plans to spend the summer at the Amalfi Coast and invites his girlfriend, Chl\u00f6e Rice, to join him." ], [ "13 Reasons Why", "13 Reasons Why\n\n13 Reasons Why (stylized onscreen as TH1RTEEN R3ASONS WHY) is an American teen drama web television series developed for Netflix by Brian Yorkey, based on the 2007 novel \"Thirteen Reasons Why\" by Jay Asher.", "The series revolves around seventeen-year-old high school student, Clay Jensen, and his deceased friend Hannah Baker, who has killed herself after having to face a culture of gossip and sexual assault at her high school and a lack of support from her friends and her school.", "A box of cassette tapes recorded by Hannah in the lead up to her suicide detail thirteen reasons why she ended her life.", "The series is produced by July Moon Productions, Kicked to the Curb Productions, Anonymous Content and Paramount Television, with Yorkey and Diana Son serving as showrunners.", "Dylan Minnette stars as Clay, while Katherine Langford plays Hannah.", "Christian Navarro, Alisha Boe, Brandon Flynn, Justin Prentice, Miles Heizer, Ross Butler, Devin Druid, Amy Hargreaves, Derek Luke, Kate Walsh, and Brian d'Arcy James also star.", "A film from Universal Pictures based on \"Thirteen Reasons Why\" began development in February 2011, with Selena Gomez set to star as Hannah, before being shelved in favor of a television series and Netflix ordering the show straight to series in October 2015, with Gomez instead serving as an executive producer." ] ], "gold": "13 Reasons Why is an American teen drama streaming television series developed for Netflix by Brian Yorkey and based on the 2007 novel Thirteen Reasons Why by Jay Asher. On it, Jake Weber plays the character of Barry Walker, father of Bryce Walker, who was played by Justin Prentice.", "prediction 1": "13 Reasons Why is an American teen drama web television series developed for Netflix by Brian Yorkey, based on the 2007 novel Thirteen Reasons Why by Jay Asher. The series revolves around seventeen-year-old high school student, Clay Jensen, and his deceased friend Hannah Baker, who has killed herself after having to face a culture of gossip and sexual assault at her high school and a lack of support from her friends and her school. The thirteen reasons why included a box of cassette tapes recorded by Hannah in the lead up to her suicide and the thirteen reasons why she ended her life. Christian Navarro, Derek Luke, Brian d, Derek Luke, Derek Luke, Kate Walsh, and Brian d'Arcy James also star.", "prediction 2": "13 Reasons Why is an American teen drama web television series developed for Netflix by Brian Yorkey and Brian d'Arcy James based on the 2007 novel Thirteen Reasons Why by Jay Asher. In the first two seasons, the character Bryce Walker is played by Dylan Minnette and Hannah Baker is played by Katherine Langford. In Season 3, the character is played by Ross Butler.", "prediction 3": "13 Reasons Why is an American teen drama web television series developed for Netflix by Brian Yorkey, based on the 2007 novel Thirteen Reasons Why by Jay Asher. The series revolves around seventeen-year-old high school student, Clay Jensen, and his deceased friend Hannah Baker, who has killed herself after having to face a culture of gossip and sexual assault at her high school and a lack of support from her friends and her school. In Season 2, the character Bryce Walker talks about his family's plans to spend the Amalfi Coast and invites his girlfriend, Chl\u00f6e Rice, to join him. In Season 3, the character Bryce Walker talks about his family's plans to spend the summer at the Amalfi Coast and invites Rice, to join him.", "prediction 4": "13 Reasons Why is an American teen drama web television series developed for Netflix by Brian Yorkey, based on the 2007 novel Thirteen Reasons Why by Jay Asher. The series revolves around seventeen-year-old high school student, Clay Jensen, and his deceased friend Hannah Baker, who has killed herself after having to face a culture of gossip and sexual assault at her high school and a lack of support from her friends and her school. A box of cassette tapes recorded by Hannah in the lead up to her suicide detail thirteen reasons why she ended her life. Christian Navarro, Derek Luke, Derek Luke, Derek Luke, Christian Navarro, Derek Luke, Derek Luke, and Brian d'Arcy James also star.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 435 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 591 }, { "error type": "Irrelevant", "explanation": "", "start": 592, "end": 701 } ], "missing-info": [], "corrected-prediction": "13 Reasons Why is an American teen drama web television series developed for Netflix by Brian Yorkey, based on the 2007 novel Thirteen Reasons Why by Jay Asher. " }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Who is the girl in how you remind me?", "passages": [ [ "How You Remind Me", "How You Remind Me\n\n\"How You Remind Me\" is a song by Canadian rock band Nickelback.", "It was released on August 21, 2001 as the lead single from their third studio album \"Silver Side Up\" (2001).", "A \"Gold Mix\" was made for latter editions of the single with the heavier guitars edited out of the chorus.", "Lead vocalist and guitarist Chad Kroeger wrote the song about his old girlfriend Jodi, with whom he had a dysfunctional relationship.", "He referred to this song as the song that put Nickelback on the map when played at their concert in Sturgis, South Dakota, and is often considered to be their signature song.", "\"How You Remind Me\" was named the number one most played song on U.S. radio of the 2000s decade by Nielsen Soundscan, being spun over 1.2 million times on U.S. airwaves since its release in 2001 to the end of 2009.", "The song was named fourth on the \"Billboard\" Hot 100 Songs of the Decade and 75th in the UK decade-end chart.", "It was nominated for the \"Kerrang!\"", "Award for Best Single.", "\"How You Remind Me\" was also rated the number one rock song and number 4 alternative song of the decade of the 2000s by \"Billboard\"." ], [ "Chad Kroeger", "Chad Kroeger\n\nChad Robert Kroeger (), (born November 15, 1974), is a Canadian musician and producer, best known as the lead vocalist and guitarist for the Canadian rock band Nickelback.", "In addition to his work with Nickelback, Kroeger has been involved with a variety of collaborations, appearing as a guest musician in several songs and has contributed in both production and songwriting.", "He has co-written several songs for other artists and films.", "Kroeger was born Chad Robert Turton in Hanna, Alberta on November 15, 1974.", "His maternal grandfather was Alberta MLA Henry Kroeger, who was born in Moscow, Russia, to a Mennonite family of German descent.", "After his father left the family when he was two, he started going by his mother's maiden name of Kroeger.", "He learned to play the guitar at age 13.", "In the early 1990s, Kroeger was part of a grunge cover band, The Village Idiots, with his cousin Brandon Kroeger and future Nickelback members bassist Mike Kroeger (his brother) and singer Ryan Peake.", "In 1995, Kroeger, Peake, Mike Kroeger, and then drummer Brandon Kroeger, formed the band Nickelback.", "Kroeger has continued to record and tour with this successful band for more than 20 years." ], [ "How You Remind Me", "The song was featured in the music video game \"\" and in a recut, PG-13 version of \"Deadpool 2\" titled \"Once Upon a Deadpool\".", "The song played a large role in a \"Saturday Night Live\" skit on March 10, 2018 with Sterling K. Brown in which the lyrics are a dying woman's final words.", "The music video for \"How You Remind Me\" was directed by the Brothers Strause, and featured Nickelback playing a small venue with focus on a female audience member.", "Chad Kroeger admitted to disliking the idea of a small venue performance at first, opting for a bigger scale arena concert; however, he found the outcome of the video satisfying.", "In the video, Kroeger plays a man whose girlfriend (played by model Annie Henley) has left him and is still haunted by her memory.", "He still feels strongly for her, and sees her everywhere he goes.", "Whenever he imagines her touch, he feels a warm memory, indicated by the change in lighting in the video.", "As the music video progresses, he starts to get over her.", "At the end, she shows up and apparently asks him to forgive her.", "This is what he thought he had wanted all along, but suddenly he realizes that it isn't really what he wanted, and pushes her away." ] ], "gold": "Jodi is the girl in the rock band Nickelback's song How You Remind Me, while model Annie Henley is the girl in the How You Remind Me music video. In the video, Henley plays the girlfriend of a man played by Chad Kroeger, the band's lead vocalist and guitarist.", "prediction 1": "\"How You Remind Me\" is a song by Canadian rock band Nickelback, released on August 21, 2001 as the lead single from their third studio album Silver Side Up. Lead vocalist and guitarist Chad Kroeger wrote the song about his old girlfriend Jodi, with whom he had a dysfunctional relationship. He referred to this song as the song that put Nickelback on the map when played at their concert in Sturgis, South Dakota, and is often considered to be their signature song.", "prediction 2": "\"How You Remind Me\" is a song by Canadian rock band Nickelback. The music video for the song features Annie Henley as the girlfriend. The song was released on August 21, 2001 as the lead single from their third studio album Silver Side Up.", "prediction 3": "Nickelback's hit song \"How You Remind Me\" is sung by Chad Kroeger and features actress Annie Henley as the girlfriend. In the music video for the song, which features a small venue with focus on a female audience member, the girlfriend is played by Chad Kroeger.", "prediction 4": "In the song How You Remind Me, the lead singer and guitarist for the Canadian rock band Nickelback sings about his old girlfriend Jodi, played by model Annie Henley. The song was released on August 21, 2001 as the lead single from their third studio album Silver Side Up.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 156 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 465 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"How You Remind Me\" is a song by Canadian rock band Nickelback about a girlfriend Jodi. In the How You Remind Me music video, Kroeger plays a man whose girlfriend is played by model Annie Henley." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When did spain give the united states full control of the philippines?", "passages": [ [ "Spanish Filipino", "The Spanish culture and Spanish language are the main traditions.", "Between 1565 and 1898, Hispanics from Latin America and Spain sailed to and from the Philippine Islands.", "This contributed to the assimilation of the Hispanics into everyday society.", "According to an 1818 study by the renowned German ethnologist F\u00ebdor Jagor entitled \"The Former Philippines thru Foreign Eyes\", not less than 1/3rd of the inhabitants of the island of Luzon were then mixed with varying degrees of Spanish ancestry and the vast majority of military personnel then had Latin-American origins.", "Spanish Philippines is the history of the Philippines from 1521 to 1898.", "It begins with the arrival in 1521 of European explorer Ferdinand Magellan sailing for Spain, which heralded the period when the Philippines was an overseas province of Spain, and ends with the outbreak of the Spanish\u2013American War in 1898.", "The Spanish East Indies (\"\") were the Spanish territories in Asia-Pacific from 1565 until 1899.", "They comprised the Philippine Islands, Guam and the Mariana Islands, the Caroline Islands (Palau and the Federated States of Micronesia), and for some time parts of Formosa (Taiwan) and the Moluccas (Indonesia).", "Cebu was the first seat of government, later transferred to Manila.", "From 1565 to 1821 these territories, together with the Spanish West Indies, were administered through the Viceroyalty of New Spain based in Mexico City." ], [ "History of the Philippines (1521\u20131898)", "To this end, the Tejeros Convention was convened, where Aguinaldo was elected president of the new insurgent government.", "On 22 March, 1897, the convention established the Tejeros Revolutionary Government.", "Bonifacio refused to recognize this and he was executed for treason in May 1897.", "On November 1, the Tejeros government was supplanted by the Republic of Biak-na-Bato.", "By December 1897, the revolution had resulted to a stalemate between the colonial government and rebels.", "Pedro Paterno mediated between the two sides for the signing of the Pact of Biak-na-Bato.", "The conditions of the armistice included the self-exile of Aguinaldo and his officers in exchange for $800,000 or 40,104,392.82542 pesosto be paid by the colonial government.", "Aguinaldo then sailed to Hong Kong for self exile.", "On April 25, 1898, the Spanish\u2013American War began.", "On May 1, 1898, in the Battle of Manila Bay, the Asiatic Squadron of the U.S. Navy, led by Commodore George Dewey aboard the \"USS Olympia\", decisively defeated the Spanish naval forces in the Philippines.", "With the loss of its naval forces and of control of Manila Bay, Spain lost the ability to defend Manila and therefore the Philippines." ], [ "History of the Philippines (1521\u20131898)", "On May 19, Emilio Aguinaldo returned to the Philippines aboard a U.S. Navy ship and on May 24 took command of Filipino forces.", "Filipino forces had liberated much of the country from the Spanish.", "On June 12, 1898 Aguinaldo issued the Philippine Declaration of Independence declaring independence from Spain.", "Filipino forces then laid siege to Manila, as had American forces.", "In August 1898, the Spanish governor-general covertly agreed with American commanders to surrender Manila to the Americans following a mock battle.", "On August 13, 1898, during the Battle of Manila (1898), Americans took control of the city.", "In December, 1898, the Treaty of Paris (1898) was signed, ending the Spanish\u2013American War and selling the Philippines to the United States for $20 million.", "With this treaty, Spanish rule in the Philippines formally ended.", "On January 23, 1899, Aguinaldo established the First Philippine Republic in Malolos.", "On February 4, 1899, the Philippine\u2013American War began with the Battle of Manila (1899) between Americans forces and the nascent Philippine Republic." ] ], "gold": "On April 25, 1898, the Spanish\u2013American War began. On May 1, 1898, in the Battle of Manila Bay, the Asiatic Squadron of the U.S. Navy, led by Commodore George Dewey aboard the USS Olympia, decisively defeated the Spanish naval forces in the Philippines. On August 13, 1898, during the Battle of Manila, Americans took control of the city. In December 10, 1898, the Treaty of Paris was signed, ending the Spanish\u2013American War and selling the Philippines to the United States for $20 million.", "prediction 1": "Spanish Philippines is the history of the Philippines from 1521 to 1898. It begins with the arrival in 1521 of European explorer Ferdinand Magellan sailing for Spain, which heralded the period when the Philippines was an overseas province of Spain, and ends with the outbreak of the Spanish\u2013American War in 1898. Spanish rule in the Philippines formally ended on August 13, 1898, when the Spanish governor-general covertly agreed with American commanders to surrender Manila to the Americans following a mock battle. This ended the Spanish\u2013American War and selling the Philippines to the United States for $20 million. On February 4, 1899, the Philippine Republic was established.", "prediction 2": "Spanish rule in the Philippines officially ended on August 13, 1898 with the signing of the Treaty of Paris. The treaty officially sold the Philippines to the United States for $20 million. Spanish Philippines is the history of the Philippines from 1521 to 1898. It begins with the arrival in 1521 of European explorer Ferdinand Magellan sailing for Spain, which heralded the period when the Philippines was an overseas province of Spain, and ends with the outbreak of the Spanish\u2013American War in 1898.", "prediction 3": "Spanish rule in the Philippines formally ended on December 14, 1898, when the Treaty of Paris was signed and the Philippines was sold to the United States for $20 million.", "prediction 4": "The Spanish East Indies, also known as the Philippine Islands, were the Spanish territories in Asia-Pacific from 1521\u20131898. They comprised the Philippine Islands, Guam and the Mariana Islands, the Caroline Islands, the Philippine Islands, the Federated States of Micronesia, and for some time parts of Formosa (Taiwan) and the Moluccas (Indonesia). Spanish rule in the Philippines formally ended on June 12, 1898, when Emilio Aguinaldo took command of Filipino forces. With this treaty of Paris, Spain sold the Philippines to the United States for $20 million. With this treaty, Spanish rule in the Philippines was officially ended. With the signing of this treaty of Paris, Spanish rule in the Philippines was signed, ending the Spanish\u2013American War and selling the Philippines to the United States for $20 million. With this treaty, Spanish rule in the Philippines was", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 72 }, { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 619, "end": 680 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "On May 1, 1898, in the Battle of Manila Bay, the Asiatic Squadron of the U.S. Navy, led by Commodore George Dewey aboard the \"USS Olympia\", decisively defeated the Spanish naval forces in the Philippines. Spanish rule in the Philippines formally ended on August 13, 1898, when the Spanish governor-general covertly agreed with American commanders to surrender Manila to the Americans following a mock battle. In December, 1898, the Treaty of Paris (1898) was signed this ended the Spanish\u2013American War and selling the Philippines to the United States for $20 million. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "How many house of cards seasons are there?", "passages": [ [ "House of Cards (UK TV series)", "House of Cards (UK TV series)\n\nHouse of Cards is a 1990 British political thriller television serial in four episodes, set after the end of Margaret Thatcher's tenure as Prime Minister of the United Kingdom.", "It was televised by the BBC from 18 November to 9 December 1990, to critical and popular acclaim.", "Andrew Davies adapted the story from the novel of the same title by Michael Dobbs, a former Chief of Staff at Conservative Party headquarters.", "Neville Teller also dramatised Dobbs's novel for BBC World Service in 1996, and it had two television sequels (\"To Play the King\" and \"The Final Cut\").", "The opening and closing theme music for those TV series is entitled \"Francis Urquhart's March.\"", "\"House of Cards\" was ranked 84th in the British Film Institute list of the 100 Greatest British Television Programmes in 2000.", "In 2013, the serial and the Dobbs novel were the basis for a US adaptation set in Washington, D.C., commissioned and released by Netflix.", "The antihero of \"House of Cards\" is Francis Urquhart, a fictional Chief Whip of the Conservative Party, played by Ian Richardson.", "The plot follows his amoral and manipulative scheme to become leader of the governing party and, thus, Prime Minister of the United Kingdom." ], [ "House of Cards (U.S. TV series)", "House of Cards (U.S. TV series)\n\nHouse of Cards is an American political thriller web television series created by Beau Willimon.", "It is an adaptation of the 1990 BBC miniseries of the same title and based on the novel of the same title by Michael Dobbs.", "The first 13-episode season was released on February 1, 2013, on the streaming service Netflix.", "\"House of Cards\" is set in Washington, D.C. and is the story of Congressman Frank Underwood (Kevin Spacey), a Democrat from South Carolina's 5th congressional district and House Majority Whip.", "He is passed over for appointment as Secretary of State, so he initiates an elaborate plan to attain power, aided by his wife Claire Underwood (Robin Wright).", "The series deals with themes of ruthless pragmatism, manipulation, betrayal, and power.", "\"House of Cards\" has received positive reviews and several award nominations, including 33 Primetime Emmy Award nominations for Outstanding Drama Series, Outstanding Lead Actor for Spacey, and Outstanding Lead Actress for Wright.", "It is the first original online-only web television series to receive major Emmy nominations.", "The show also earned eight Golden Globe Award nominations, with Wright winning for Best Actress \u2013 Television Series Drama in 2014 and Spacey winning for Best Actor \u2013 Television Series Drama in 2015." ], [ "Beau Willimon", "It was produced by Media Rights Capital, David Fincher, and Kevin Spacey, and for five seasons starred Spacey as ruthless politician Frank Underwood and Robin Wright as his equally scheming wife Claire.", "The series also stars Kate Mara, Corey Stoll, Michael Kelly, Neve Campbell, Michel Gill, Jayne Atkinson and Sebastian Arcelus.", "It premiered on Netflix on February 1, 2013.", "Willimon served as the series' showrunner for its first four seasons, stepping down in January 2016.", "\"House of Cards\" is set to premiere its sixth and final season on November 2, 2018.", "On November 3, 2017, Netflix fired Spacey from \"House of Cards\" and cut all ties with the actor following several allegations of sexual misconduct.", "Several crew members on the \"House of Cards\" set accused Spacey of sexually harassing them.", "When the accusations first surfaced in late October of that year, Willimon released a statement saying, \"During the time I worked with Kevin Spacey on House of Cards, I neither witnessed nor was aware of any inappropriate behavior on set or off\"." ] ], "gold": "There are several series entitled House of Cards. There was one season in the British House of Cards, a serial in four episodes televised by the BBC in 1990. The American House of Cards TV series, an adaptation of the BBC series, was released on Netflix and had 6 seasons in all, with 6 seasons in 2018, 5 seasons in 2017, 4 seasons in 2016, and 3 in seasons 2015.", "prediction 1": "House of Cards is a 1990 British political thriller television serial in four episodes, set after the end of Margaret Thatcher's tenure as Prime Minister of the United Kingdom. It was televised by the BBC from 18 November to 9 December 1990, to critical and popular acclaim. In 2013, the serial and the Dobbs novel were the basis for a US adaptation set in Washington, D.C., commissioned and released by Netflix. House of Cards is an American political thriller web television series created by Beau Willimon.", "prediction 2": "House of Cards is a 1990 British political thriller television serial in four episodes set after the end of Margaret Thatcher's tenure as Prime Minister of the United Kingdom. It was televised by the BBC from 18 November to 9 December 1990, to critical and popular acclaim. In 2013, the serial and the Dobbs novel were the basis for a US adaptation set in Washington, D.C., commissioned and released by Netflix. House of Cards is the first American political thriller web television series created by Beau Willimon. It is an adaptation of the 1990 BBC miniseries of the same title and based on the novel of the same title by Michael Dobbbbs. The first 13-episode season was released on February 1, 2013.", "prediction 3": "House of Cards is a 1990 British political thriller television serial based on the 1990 BBC miniseries of the same title, created by Andrew Davies, adapted from the novel of the same title by Michael Dobbs, which had two television sequels. The first 13 episodes of the American adaptation, House of Cards, were released on February 1, 2013. House of Cards has received positive reviews and several award nominations, including 33 Primetime Emmy Award nominations for Outstanding Drama Series, Outstanding Lead Actor for Kevin Spacey, and Outstanding Lead Actress for Wright.", "prediction 4": "House of Cards is a 1990 British political thriller television serial in four episodes, set after the end of Margaret Thatcher's tenure as Prime Minister of the United Kingdom. It was televised by the BBC from 18 November to 9 December 1990, to critical and popular acclaim. It was ranked 84th in the British Film Institute list of the 100 Greatest British Television Programmes in 2000. House of Cards is an American political thriller web television series created by Beau Willimon. It is an adaptation of the 1990 BBC miniseries of the same title and based on the novel of the same title by Michael Dobbbbbbs. It had 13-episode season that was released on February 1, 2013, on the streaming service.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 391 }, { "error type": "Irrelevant", "explanation": "", "start": 413, "end": 509 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "House of Cards is a 1990 British political thriller television serial in four episodes. The US adaptation released by Netflix premiered its sixth and final season in 2018." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sings the song that's what i like about you?", "passages": [ [ "That's What I Like About You (Collette song)", "That's What I Like About You (Collette song)\n\n", "\"That's What I Like About You\" is a song written and recorded by New Zealand born, Australian pop singer Collette.", "It was released in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\" (1989).", "The song peaked at number 31 on the ARIA Charts. 7\" (CBS 655337) \n\n12\"" ], [ "What I Like About You (song)", "What I Like About You (song)\n\n\"What I Like About You\" is a song by American rock band The Romantics.", "The song, written by Romantics members Wally Palmar, Mike Skill and Jimmy Marinos in 1979 is included on the band's self-titled debut album (1980), and was also released as a single.", "Marinos, the band's drummer, is the lead vocalist on the song.", "The band filmed a music video for the song that appeared frequently on MTV during the early 1980s.", "\"What I Like About You\" was written by Palmar, Marinos and Skill around a guitar part by Skill.", "The song's \"Hey, uh-huh-huh\" refrain was influenced by The Yardbirds' \"Over Under Sideways Down\" and Chuck Berry's \"Back in the U.S.A.\".", "The song's riff is slightly similar to Neil Diamond's \"Cherry, Cherry\", The Standells 1966 hit \"Dirty Water\", and Joe Jackson's 1979 single \"I'm the Man\".", "The Romantics recorded the song and the accompanying album at Coconuts Recording Studio in Miami Beach, Florida.", "When first released, \"What I Like About You\" was already a popular song on the Romantics' concert playlist." ], [ "James House (singer)", "James House (singer)\n\nJames Andrew House (born March 22, 1955) is an American country music artist.", "Originally a member of a group called the House Band, he recorded a solo rock album in 1983 on Atlantic Records before he began his country music career in 1989 on MCA Records, recording two albums for that label.", "He later penned singles for Diamond Rio and Dwight Yoakam, before finding another record deal on Epic Records in 1994.", "That year, he charted two Top 40 singles on the \"Billboard\" country chart, including the Top ten hit \"This Is Me Missing You\".", "He has also written singles for Diamond Rio, Dwight Yoakam, and Martina McBride.", "James House's musical career began in a band called the House Band, which was signed first to Warner Bros. Records and later to Atlantic Records.", "In addition, House served as vocal coach for Dustin Hoffman on the movie \"Ishtar\".", "In 1983, House recorded a rock album for Atlantic.", "House later moved to Nashville in 1988 and signed as a solo artist on MCA Nashville in 1989.", "On that label, he recorded two albums: \"James House\" and \"Hard Times for an Honest Man\".", "The former accounted for \"Don't Quit Me Now\", a number 25 on the country charts, while the latter produced no Top 40 hits." ], [ "That's What I Like About You", "That's What I Like About You\n\n\"That's What I Like About You\" is a song written by Kevin Welch, Wally Wilson, and John Hadley.", "It was originally recorded by James House for his 1990 album \"Hard Times for an Honest Man\".", "It was later recorded by American country music artist Trisha Yearwood.", "It was released in December 1991 as the third single from her debut album \"Trisha Yearwood\".", "The song reached number 8 on the US \"Billboard\" Hot Country Singles & Tracks chart.", "The music video was directed by Gerry Wenner and premiered in late 1991." ] ], "gold": "There are many different songs named \"That's What I Like About You\" or with a similar title to it. In 1990, James House, an American country music artist, recorded a song under that name as part of his album \"Hard Times for an Honest Man\", which was later covered in 1991 by American country music artist Trisha Yearwood. A previous song by the same name is that of the Australian pop singer Collette, who released it in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\". The American rock band The Romantics also recorded a song titled \"What I Like About You\" that was released as a single in late 1979.", "prediction 1": "That's What I Like About You is a song written and recorded by New Zealand born, Australian pop singer Collette. It was released in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\". \"What I Like About You\" is a song by American rock band The Romantics. The song, written by Romantics members Wally Palmar, Mike Skill and Jimmy Marinos in 1979, is included on the band's self-titled debut album and was also released as a single. \"That's What I Like About You\" is also a song by American country music artist Trisha Yearwood. It was originally recorded by James House for his 1990 album \"Hard Times for an Honest Man\".", "prediction 2": "There are several songs titled \"That's What I Like About You\". \"What I Like About You\" is a song by American rock band The Romantics. The song, written by Romantics members Wally Palmar, Mike Skill and Jimmy Marinos in 1979, is included on the band's self-titled debut album and was also released as a single. \"That's What I Like About You\" is a song written by Kevin Welch, Wally Wilson, and John Hadley, and was originally recorded by James House for his 1990 album Hard Times for an Honest Man. It was later recorded by American country music artist Trisha Yearwood. It was released in December 1991 as the third single from her debut album, Trisha Yearwood. It was released in December 1991 as the third single from her debut album Trisha Yearwood.", "prediction 3": "\"That's What I Like About You\" is a song written and recorded by New Zealand born, Australian pop singer Collette. It was released in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\". \"What I Like About You\" is also a song by American rock band The Romantics. Marinos, the band's drummer, is the lead vocalist on the song. \"That's What I Like About You\" is also a song written by Kevin Welch, Wally Wilson, and John Hadley. It was originally recorded by James House for his 1990 album \"Hard Times for an Honest Man\". \"That's What I Like About You\" is also a song written by Kevin Welch, Wally Wilson, Wally Wilson, and John Hadley. It was later recorded by American country music artist Trisha Yearwood. It was released in December", "prediction 4": "\"That's What I Like About You\" is a song written and recorded by New Zealand born, Australian pop singer Collette. It was released in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\" (1989). \"What I Like About You\" is a song by American rock band The Romantics. The song, written by Romantics members Wally Palmar, Mike Skill and Jimmy Marinos in 1979, is included on the band's self-titled debut album and was also released as a single.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 373 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 4 ] } ], "corrected-prediction": "That's What I Like About You is a song written and recorded by New Zealand born, Australian pop singer Collette. It was released in October 1989 as the third and final single from her debut studio album, \"Raze the Roof\". \"What I Like About You\" is a song by American rock band The Romantics. The song, written in 1979, is included on the band's self-titled debut album and was also released as a single. \"That's What I Like About You\" is also a 1991 song by American country music artist Trisha Yearwood. It was originally recorded by James House for his 1990 album \"Hard Times for an Honest Man\"." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who won survivor heroes vs healers vs hustlers?", "passages": [ [ "Survivor: Heroes vs. Healers vs. Hustlers", "The cast is composed of 18 new players, initially split into three tribes containing six members each; Levu (\"Heroes\"), Soko (\"Healers\"), and Yawa (\"Hustlers\").", "The 18 players were initially divided into three tribes: Levu (Heroes), Soko (Healers) and Yawa (Hustlers).", "During the marooning, Ryan from the Hustlers tribe found a Super Immunity Idol that was only valid at the first Tribal Council.", "As his tribe won immunity, he was able to send the Idol to a member of the losing Heroes tribe; he chose Chrissy.", "Ryan and Chrissy both became dominant players on their tribes, forming strong alliances with Devon and Ben, respectively.", "The Healers tribe went undefeated, while the Heroes lost one member and the Hustlers lost two.", "When the tribes were switched, Ryan and Chrissy aligned on the new Soko tribe, working to eliminate Healers and their allies, including Ryan's former Hustlers tribemate Ali.", "At the merge, Ryan and Chrissy brought their former Heroes and Hustlers tribemates together against the Healers." ], [ "Survivor: Heroes vs. Healers vs. Hustlers", "Survivor: Heroes vs. Healers vs. Hustlers\n\nSurvivor: Heroes vs. Healers vs. Hustlers is the 35th season of the American CBS competitive reality television series \"Survivor\".", "This season featured 18 new players divided into three tribes based on a dominant perceived trait: \"Heroes\" (courage), \"Healers\" (compassion), and \"Hustlers\" (tenacity).", "The season premiered on September 27, 2017, and ended on December 20, 2017, when Ben Driebergen was named the winner over Chrissy Hofbeck and Ryan Ulrich in a 5\u20132\u20131 vote.", "This season featured several alterations to the rules.", "This season marked a return to the tiebreaker format used before the previous season, \"\", where a tied vote at Tribal Council was followed by a second ballot before being declared \"deadlocked\".", "The format of the penultimate Tribal Council, with four players remaining, was changed; in lieu of a vote, the winner of the final immunity challenge was to assign additional immunity to another castaway, with the remaining two competing in a fire-making challenge to determine the third finalist.", "This was the fourth season of the show filmed in Fiji (tied with the Philippines), following \"\", \"\", and \"Survivor: Game Changers\"." ] ], "gold": "Survivor: Heroes vs. Healers vs. Hustlers is the 35th season of the American CBS competitive reality television series Survivor where the 18 players were divided into three tribes based on a dominant perceived trait. The winner of the show was Ben Driebergen, who was cast as part of the Heroes tribe.", "prediction 1": "In the 35th season of the American CBS competitive reality television series Survivor, Ben Driebergen was named the winner over Chrissy Hofbeck and Ryan Ulrich in a 5\u20132\u20131 vote.", "prediction 2": "In the 35th season of the American competitive reality television series \"Survivor\", Chrissy Hofbeck and Ryan Ulrich won the battle of the tribes. Ben Driebergen won the battle of the tribes.", "prediction 3": "The 35th season of the American CBS competitive reality television show \"Survivor\" featured 18 new players divided into three tribes based on a dominant perceived trait: \"Heroes\" (courage), \"Healers\" (compassion), and \"Hustlers\" (tenacity). The season premiered on September 27, 2017, and ended on December 20, 2017, when Ben Driebergen was named the winner over Chrissy Hofbeck and Ryan Ulrich in a 5\u20132\u20131 vote.", "prediction 4": "Survivor: Heroes vs. Healers vs. Hustlers, the 35th season of the American television game show Survivor, was won by Ben Driebergen. Chrissy Hofbeck and Ryan Ulrich shared the win.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 176 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the 35th season of the American CBS competitive reality television series Survivor, featured 18 new players divided into three tribes based on a dominant perceived trait. Ben Driebergen was named the winner." }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "Who played james west in the wild wild west?", "passages": [ [ "The Wild Wild West", "\"For the first few episodes we tried stuntmen,\" Conrad explained, \"but the setup time slowed production down, so I volunteered.", "Things started moving quicker when I took the jumps and the spills.", "We started meeting the budget.\"", "Early on he was doubled by Louie Elias or Chuck O'Brien.", "On January 24, 1968, however, during filming of \"The Night of the Fugitives\", Conrad fell from a chandelier onto a concrete floor and suffered a concussion.", "As a result, production of the series (then near the end of its third season) ended two weeks early.", "Conrad spent weeks in the hospital, and had a long convalescence slowed by constant dizziness.", "The episode was eventually completed and aired during the fourth season, with footage of the fall left in.", "Conrad later told Percy Shain of the \"Boston Globe\", \"I have the whole scene on film.", "It's a constant reminder to be careful.", "It also bolstered my determination to make this my last year with the series.", "Four seasons are enough of this sort of thing.\"", "Artemus Gordon was played by Ross Martin.", "Prior to \"The Wild Wild West,\" Martin co-starred in the CBS series \"Mr. Lucky\" from 1959 to 1960, portraying Mr. Lucky's sidekick, Andamo." ], [ "The Wild Wild West", "Directed by Barry Sonnenfeld, the film made substantial changes to the characters of the series re-imagining James West as a black man (played by Will Smith) and Artemus Gordon (played by Kevin Kline) as egotistical and bitterly competitive with West.", "Additionally, significant changes were made to Dr. Loveless (Kenneth Branagh in the film).", "No longer a dwarf, he was portrayed as a double amputee with no legs in a steam-powered wheelchair (similar to that employed by the villain in the episode \"The Night of the Brain\").", "Loveless' first name was changed from Miguelito to Arliss and he was given the motive of a bitter Southerner who sought revenge on the North after the Civil War.", "Robert Conrad reportedly was offered the role of President Grant but turned it down.", "He was outspoken in his criticism of the new film, now little more than a comedic Will Smith showcase with virtually no relationship to the action-adventure series.", "In a \"New York Post\" interview (July 3, 1999)", "Conrad stated that he disliked the movie and that contractually he was owed a share of money on merchandising that he was not paid.", "He had a long-standing feud with producer Jon Peters which may have colored his opinion." ], [ "The Wild Wild West", "The Wild Wild West\n\nThe Wild Wild West is an American science fiction western television series that ran on the CBS television network for four seasons from September 17, 1965 to April 4, 1969.", "Two television films were made with the original cast in 1979 and 1980 and the series was adapted for a feature-length film in 1999.", "Developed at a time when the television western was losing ground to the spy genre, this show was conceived by its creator, Michael Garrison, as \"James Bond on horseback.\"", "Set during the administration of President Ulysses Grant (1869\u201377), the series followed Secret Service agents James West (Robert Conrad) and Artemus Gordon (Ross Martin) as they solved crimes, protected the President, and foiled the plans of megalomaniacal villains to take over all or part of the United States.", "The show featured a number of fantasy elements, such as the technologically advanced devices used by the agents and their adversaries.", "The combination of the Victorian era time-frame and the use of Verne-esque technology has inspired some to give the show credit as being one of the more \"visible\" origins of the steampunk genre.", "These elements were accentuated even more in the 1999 film adaptation.", "Despite high ratings, the series was cancelled near the end of its fourth season as a concession to Congress over television violence." ], [ "Wild Wild West", "Wild Wild West\n\nWild Wild West is a 1999 American steampunk western action comedy film produced and directed by Barry Sonnenfeld and written by S. S. Wilson, Brent Maddock, Jeffrey Price and Peter S. Seaman.", "Loosely based on \"The Wild Wild West\" 1960s TV series created by Michael Garrison, the film stars Will Smith and Kevin Kline as two Secret Service agents who protect President Ulysses S. Grant and the United States during the American Old West.", "The supporting cast features Kenneth Branagh, Salma Hayek, Ted Levine, M. Emmet Walsh and Bai Ling.", "Produced by Peters Entertainment and Sonnenfeld-Josephson Worldwide Entertainment, \"Wild Wild West' was released theatrically in the United States on June 30, 1999 by Warner Bros. and was a major critical and commercial disappointment, grossing only $222.1 million worldwide against a $170 million budget.", "Four years after the end of the American Civil War in 1869, U.S. Army Captain James T. \u201cJim\u201d West and U.S. Marshal Artemus Gordon hunt for Confederate General \"Bloodbath\" McGrath throughout the Southern United States due to ordering a massacre in a settlement called New Liberty where many of the freed slaves were murdered, including West's biological parents." ] ], "gold": "Robert Conrad starred as James West in The Wild Wild West, an American Western, espionage and science fiction television series that ran on the CBS television network for four seasons from September 17, 1965 to April 11, 1969. Two satirical comedy television film sequels were made with the original cast in 1979 and 1980. This series was then adapted for a theatrical film in 1999. In this 1999 steampunk Western comedy adaptation, Will Smith stars as James West, a Secret Service agent who works to protect President Ulysses S. Grant and the United States from all manner of dangerous threats in the American Old West. ", "prediction 1": "The Wild Wild West is an American science fiction western television series that ran on the CBS television network for four seasons from September 17, 1965, to April 4, 1969. Two television films were made with the original cast in 1979 and 1980 and the series was adapted for a feature-length film in 1999. The 1999 film loosely based on \"The Wild Wild West\" 1960s TV series created by Michael Garrison, the film portrayed Secret Service agents James West and Artemus Gordon as they solved crimes, protected the President, and foiled the plans of megalomaniacal villains to take over all or part of the United States.\n", "prediction 2": "The original cast of The Wild Wild West was Will Smith and Kevin Kline, but new actors adapted the show for a 1999 movie. The actress who played James West in the movie was Kerry Alexis Rivas-Levy.", "prediction 3": "The Wild Wild West is a well-known American science fiction western TV series that was published by CBS Television Network. The series followed Secret Service agents James West and Artemus Gordon as they solved crimes, protected the President, and foiled the plans of megalomaniacal villains to take over all or part of the United States. Will Smith played James West in this 1999 film, which is loosely based on the 1960s TV series.", "prediction 4": "The Wild Wild West is an American science fiction western television series that ran on the CBS television network for four seasons from September 17, 1965, to April 4, 1969. James West was played by Robert Conrad throughout the series and in two television movies made with the original cast in 1979 and 1980 and the series was adapted for a feature-length film in 1999. James West (played by Robert Conrad) was portrayed by Will Smith in the 1999 film. American steampunk western action comedy film Wild Wild West is loosely based on \"The Wild Wild West\" 1960s TV series that was created by Michael Garrison, loosely a convention in the 1960s. Will Smith portrayed James West throughout the series and portrayed the character in a number of television western action adventure and adventures of James West as a murderous secret agent James West on horseback as James Bond on horseback.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 404 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[2]}", "start": 457, "end": 619 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Wild Wild West is an American science fiction western television series, starring Robert Conrad as James West, that ran on the CBS television network for four seasons from September 17, 1965, to April 4, 1969. Two television films were made with the original cast in 1979 and 1980 and the series was adapted for a feature-length film in 1999. The 1999 film loosely based on \"The Wild Wild West\" 1960s TV series the film portrayed Secret Service agents James West, played by Will Smith, who protects President Ulysses S. Grant and the United States during the American Old West.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was st paul's cathedral melbourne built?", "passages": [ [ "St Paul's Cathedral, Melbourne", "St Paul's Cathedral is built on the site where the first public Christian service in Melbourne was conducted in 1835.", "The block was then a government reserve far from the centre of town to the west, and used as a corn market.", "By 1848 the site was then adjacent to the first Princes Bridge across the Yarra, and the prominent site was granted to the Anglican Church.", "The bluestone Church of St Paul the Apostle was consecrated in 1852.", "Nearly 30 years later with the huge growth of the city and Swanston Street becoming a major thoroughfare, the Diocese decided to build a grand cathedral on the site to supersede the 1839 St James Old Cathedral located in the western end of the CBD.", "The distinguished English architect William Butterfield, known for his unique interpretation of the Gothic Revival, was commissioned to design the new cathedral.", "the foundation stone was laid in 1880 by John, Earl of Hopetoun (\"later\" Marquess of Linlithgow), Governor of Victoria in the presence of the Rt Revd Charles Perry, Bishop of Melbourne, and on 22 January 1891 the cathedral (without the spires) was consecrated by the Rt Revd Field Flowers Goe, Bishop of Melbourne.", "The building work was marked by disputes between Butterfield and the church authorities in Melbourne, leading to Butterfield's resignation in 1884." ], [ "St Paul's Cathedral, Melbourne", "The job was then awarded to a local architect, Joseph Reed, who completed the building generally faithfully to Butterfield's design and who also designed the attached chapter house in matching style in 1889.", "To fit the block, the cathedral is orientated in line with the central city grid, just off the north-south axis, rather than facing east, the traditional direction.", "The pipe organ was commissioned from the English builder T. C. Lewis, one of the most prominent organ builders of the 19th century.", "For nearly 40 years, without the spires, the cathedral presented as a rather solid, horizontal mass.", "Construction of the spires began in 1926, to a new design by John Barr of Sydney in a more traditional Gothic Revival style, in a different stone from the Sydney area, and much taller than Butterfield's original design.", "They reached their full height in 1932, and on 30 April 1933 a Service of Thanks was held for their completion.", "Once the central spire, named the Moorhouse Spire, was completed to its full height of 312ft (95m), St Paul's became the tallest structure in central Melbourne and dominated the city's skyline when viewed from the south.", "The 1960s saw extensive work completed to the exterior of the cathedral and in 1989 the organ was restored with the help of a major National Trust appeal." ], [ "St Paul's Cathedral, Melbourne", "Because the spires are built from Sydney sandstone and are 40 years newer, they are a different, darker colour than the older parts of the building.", "The interior features rich colours and strident colour contrasts, characteristic of Butterfield's work, compared to the exterior.", "All the stonework is constructed of the Waurn Ponds limestone with contrasting stripes of the very dark-coloured local bluestone.", "The dado, floor, high altar and reredos are outstanding examples of High Victorian Gothic polychromy.", "The reredos is made from Devonshire marble, alabaster and glittering Venetian glass mosaics.", "One of the carved figures on the pulpit is said to be the image of a former Mayor of Melbourne's daughter who died in infancy.", "The floor is entirely paved with encaustic tile imported from the English firm of Maw & Co., featuring both patterned layouts and patterns within the tiles, while the dado is created with patterned glazed tiles.", "In Persian tile on the rear wall of the narthex is a replica of an 8-pointed star found in two churches of the Anglican Diocese of Iran, the church of St Simon the Zealot in Shiraz and St Luke's Church in Isfahan.", "There are two baptismal fonts.", "The round font of Harcourt granite was installed when the cathedral was first built." ] ], "gold": "The English architect William Butterfield, known for his distinctive interpretation of the Gothic Revival, was commissioned to design St. Paul's Cathedral in Melbourne. The foundation stone for St. Paul's Cathedral in Melbourne was laid in 1880 by the Governor of Victoria, John, Earl of Hopetoun. Then, on 22 January 1891 the cathedral, without the spires, was consecrated by the Right Reverend Field Flowers Goe, Bishop of Melbourne. Then, for nearly 40 years, without the spires, the cathedral presented as a rather solid, horizontal mass. However, construction of the spires commenced in 1926 to a new design by John Barr of Sydney. This new design was a more traditional Gothic Revival style and included different stone, Sydney sandstone, from the Sydney area. It was also much taller than Butterfield's original design. The spires reached their full height in 1932 and on 30 April 1933 a service of thanksgiving was held for their completion. Once the central spire, named the Moorhouse Spire, was completed to its full height of 312 feet, St. Paul's became the tallest structure in central Melbourne and dominated the city's skyline when viewed from the south. However, because the spires were built from Sydney sandstone and were 40 years newer, they were a different and darker color than the older parts of the building. ", "prediction 1": "St Paul's Cathedral in Melbourne was built in 1880. The foundation stone was laid in 1880 by John, Earl of Hopetoun, Governor of Victoria in the presence of the Rt Revd Charles Perry, Bishop of Melbourne. By 1891 the cathedral was consecrated without the spires on 22 January 1891. The spires were completed in 1926, to a new design by John Barr of Sydney in a more traditional Gothic Revival style, in a different stone from the Sydney area and much taller than Butterfield's original design. The spires were added later in 1932, and on 30 April 1933 a Service of Thanks was held for their completion.", "prediction 2": "St Paul's Cathedral is a cathedral in Melbourne, Australia. It was built on the site where the first public Christian service in Melbourne was conducted in 1835. The foundation stone was laid in 1880 by John, Earl of Hopetoun, Governor of Victoria in the presence of the Rt Revd Charles Perry, Bishop of Melbourne. The job was then awarded to a local architect, Joseph Reed, who completed the building generally faithfully to Butterfield's design and also designed the attached chapter house in matching style in 1889. Construction of the spires began in 1926, to a new design by John Barr of Sydney in a more traditional Gothic Revival style, in a different stone from the Sydney area, and on 30 April 1933 a Service of Thanks was held for their completion.", "prediction 3": "The first public Christian service in Melbourne was conducted in 1835. The foundation stone was laid in 1880 by John, Earl of Hopetoun, Governor of Victoria in the presence of the Rt Revd Charles Perry, Bishop of Melbourne. On 22 January 1891 the cathedral (without the spires) was consecrated by the Rt Revd Field Flowers Goe, Bishop of Melbourne. Construction of the spires began in 1926, to a new design by John Barr of Sydney in a more traditional Gothic Revival style, in a different stone from the Sydney, and on 30 April 1933 a Service of Thanks was held for their completion.", "prediction 4": "St Paul's Cathedral in Melbourne was built in 1881, with the foundation stone laid in 1880. The building was completed by a local architect, Joseph Reed, in 1889. The spires were installed in 1932 and were dedicated on 22 January 1891 without the spires.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 141, "end": 204 }, { "error type": "Redundant", "explanation": "By 1891 the cathedral was consecrated without the spires on 22 January ", "start": 276, "end": 281 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 298, "end": 307 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 510, "end": 521 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "St Paul's Cathedral in Melbourne was built in 1880. The foundation stone was laid in 1880 by John, Earl of Hopetoun, Governor of Victoria. On 22 January, 1891 the cathedral was consecrated without the spires, by the Rt Revd Field Flowers Goe, Bishop of Melbourn. For nearly 40 years, without the spires, the cathedral presented as a rather solid, horizontal mass. The spires work restarted in 1926, to a new design by John Barr of Sydney in a more traditional Gothic Revival style, in a different stone from the Sydney area, and much taller than Butterfield's original design. The spires reached their full height in 1932, and on 30 April 1933 a Service of Thanks was held for their completion. Once the central spire, named the Moorhouse Spire, was completed to its full height of 312ft (95m), St Paul's became the tallest structure in central Melbourne and dominated the city's skyline when viewed from the south. Because the spires are built from Sydney sandstone and are 40 years newer, they are a different, darker colour than the older parts of the building." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When will the new bucks arena be done?", "passages": [ [ "Fiserv Forum", "Fiserv Forum\n\nFiserv Forum () is a multi-purpose arena located in downtown Milwaukee, Wisconsin.", "Groundbreaking and construction began on June 18, 2016, and the arena received its certificate of occupancy on June 5, 2018.", "It is the home of the Milwaukee Bucks of the National Basketball Association (NBA) and the Marquette Golden Eagles men's basketball team of Marquette University.", "The arena opened on August 26, 2018.", "Despite being one of the premier NBA facilities when completed in 1988, the BMO Harris Bradley Center was one of the oldest active NBA arenas by the end of the Bucks' tenancy in 2018.", "Only Madison Square Garden in New York City and Oracle Arena in Oakland were older than the Bradley Center; however, both Madison Square Garden and Oracle Arena were substantially renovated during their lifetimes, although Oracle Arena is scheduled to be replaced by the new Chase Center in San Francisco in 2019.", "The funds for the building of the BMO Harris Bradley Center were donated by Jane Bradley Pettit and husband Lloyd Pettit without any provision for the building's long-term capital needs or annual operating expenses.", "Although the facility was self-sufficient, the BMO Harris Bradley Center tenants, such as the Bucks, were at a disadvantage compared with other NBA teams because of the arrangement.", "Building a new downtown arena was proposed by former Bucks owner and former U.S." ], [ "Fiserv Forum", "Feigin's announcement was from the site of the new arena, after the first roof truss was installed and bolted into place.", "The roof was officially topped off on August 24, 2017.", "On August 26, 2018, Fiserv Forum was officially opened in a ribbon-cutting ceremony at the 4th annual Bucks Block Party.", "The first live event at Fiserv Forum was The Killers with Violent Femmes on September 4, 2018.", "The Bucks played their inaugural game at the Fiserv Forum during the preseason against the Chicago Bulls on October 3, 2018.", "They won the game 116\u201382.", "Their regular season home opener was played on October 19, 2018, against the Indiana Pacers.", "The Bucks won, 118-101.", "Local companies including Johnson Controls, Miller Brewing, Harley-Davidson, and BMO Harris Bank have agreed to be partners with the Bucks, but not for naming rights.", "On July 26, 2018, the Bucks agreed to a 25-year naming rights deal with Fiserv.", "After the official name was announced, fans nicknamed the building the \"Four-One-Forum\", a reference to the city's area code.", "The Milwaukee Bucks released the first images and details of their vision for the development of a new multi-purpose arena and sports and entertainment district to revitalize downtown Milwaukee on April 8, 2015." ] ], "gold": "Groundbreaking and construction on Fiserv Forum, a multi-purpose arena meant to be the home of the Milwaukee Bucks of the NBA, began on June 18, 2016 and was completed on June 5, 2018, when it received its certificate of occupancy. The arena opened on August 26, 2018.", "prediction 1": "Groundbreaking and construction began on June 18, 2016 and the arena received its certificate of occupancy on June 5, 2018. The arena opened on August 26, 2018.", "prediction 2": "Groundbreaking and construction began on June 18, 2016 and the arena received its certificate of occupancy on June 5, 2018. The arena opened on August 26, 2018. The Milwaukee Bucks played their inaugural game at the Fiserv Forum during the preseason against the Chicago Bulls on October 3, 2018. Then, on October 19, 2018, against the Indiana Pacers, the Bucks won, 118-101.", "prediction 3": "The new Milwaukee Bucks arena was completed in phases starting in 2018 and 2021, with the first phase beginning in 2021 and the second phase beginning in 2021. Groundbreaking and construction for the new arena started on June 18, 2016 and the arena received its certificate of occupancy on June 5, 2018.", "prediction 4": "Groundbreaking and construction began on June 18, 2016 and the arena received its certificate of occupancy on June 5, 2018. The arena opened on August 26, 2018 and is the home of the Milwaukee Bucks of the National Basketball Association (NBA).", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Groundbreaking and construction began on June 18, 2016 on Fiserv Forum, a multi-purpose arena located in downtown Milwaukee, Wisconsin. The arena received its certificate of occupancy on June 5, 2018. The arena opened on August 26, 2018." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Before the spanish took over who owned the land that is now mexico?", "passages": [ [ "History of Mexico City", "Here were the main temple, the palaces of the tlatoani or emperors, palaces of nobles such as the \"House of the Demons\" and the \"House of the Flowers\".", "Also located here were the two most renowned Aztec schools: the Telpuchcalli for secular studies and the Calmecac for priestly training.", "After landing near the modern-day city of Veracruz, Hern\u00e1n Cort\u00e9s heard about the great city and also learned of long-standing rivalries and grievances against it.", "Although Cort\u00e9s came to Mexico with a very small contingent of Spaniards, he was able to persuade many of the other native peoples to help him destroy Tenochtitlan.", "For a time, these allied peoples made use of the arrival of the European in the hopes of creating a world freed of Aztec domination.", "Spanish objective, however, was that they themselves would benefit from the destruction of Tenochtitlan, making the native peoples not free, but rather more subservient to the Spaniards than they were to the Aztecs.", "Moctezuma, then-chief of the Aztecs, had been receiving accounts of the Europeans' arrival since their ships (reported as towers or small mountains on the eastern sea) arrived in the Yucat\u00e1n then Veracruz.", "First-hand accounts indicate that the Aztec were under some impression that Cort\u00e9s was the god Quetzalcoatl." ], [ "Mexico City", "After landing in Veracruz, Spanish explorer Hern\u00e1n Cort\u00e9s advanced upon Tenochtitlan with the aid of many of the other native peoples,\narriving there on November 8, 1519.", "Cort\u00e9s and his men marched along the causeway leading into the city from Iztapalapa, and the city's ruler, Moctezuma II, greeted the Spaniards; they exchanged gifts, but the camaraderie did not last long.", "Cort\u00e9s put Moctezuma under house arrest, hoping to rule through him.", "Tensions increased until, on the night of June 30, 1520 \u2013 during a struggle known as \"La Noche Triste\" \u2013 the Aztecs rose up against the Spanish intrusion and managed to capture or drive out the Europeans and their Tlaxcalan allies.", "Cort\u00e9s regrouped at Tlaxcala.", "The Aztecs thought the Spaniards were permanently gone, and they elected a new king, Cuitl\u00e1huac, but he soon died; the next king was Cuauht\u00e9moc.", "Cort\u00e9s began a siege of Tenochtitlan in May 1521.", "For three months, the city suffered from the lack of food and water as well as the spread of smallpox brought by the Europeans.", "Cort\u00e9s and his allies landed their forces in the south of the island and slowly fought their way through the city.", "Cuauht\u00e9moc surrendered in August 1521." ], [ "History of Mexico City", "History of Mexico City\n\nThe city now known as Mexico City was founded as Tenochtitlan in 1324 and a century later became the dominant city-state of the Aztec Triple Alliance, formed in 1430 and composed of Tenochtitlan, Texcoco, and Tlacopan.", "At its height, Tenochtitlan had enormous temples and palaces, a huge ceremonial center, residences of political, religious, military, and merchants.", "Its population was estimated at least 100,000 and perhaps as high as 200,000 in 1519 when the Spaniards first saw it.", "During the final stage of the Spanish conquest of the Aztecs, Tenochtitlan was besieged and essentially razed.", "Hern\u00e1n Cort\u00e9s understood the strategic and symbolic importance of the Aztec capital and founded the Spanish capital of Mexico City on the site, and in particular rebuilt the Aztec ceremonial and political center as the main square, the Plaza Mayor, usually called the Z\u00f3calo.", "Some of the oldest structures in Mexico City date from the early conquest era.", "Many colonial-era buildings remain standing and have been re-purposed government buildings and museums." ] ], "gold": "The Spaniards, led by Hern\u00e1n Cort\u00e9s, took over the land, which is now Mexico, in August 1521. The land was previously owned by the Aztecs from 1325 until the Spanish takeover in 1521. The Aztec empire, or the Aztec Triple Alliance, composed three Nahua altepetl city-states: Tenochtitlan, Texcoco, and Tlacopan. The Mixtecs owned the land before the Aztecs.", "prediction 1": "The land that is now Mexico was owned by the Aztecs for a hundred years before the Spanish took over. It was founded as Tenochtitlan in 1324. The Aztecs rose up against the Spanish intrusion and managed to capture or drive out the Europeans and their Tlaxcalan allies. Spanish objective, however, was that they themselves would benefit from the destruction of Tenochtitlan, making the native peoples not free, but rather more subservient to the Spaniards than they were to the Aztecs.", "prediction 2": "The land that is now Mexico was owned by the Aztecs for thousands of years. Before the Spanish took over, the Aztecs owned the land that is now Mexico. At its height, Tenochtitlan had enormous temples and palaces, a huge ceremonial center, residences of political, religious, and military, and merchants.", "prediction 3": "The land that is now Mexico was owned by the Aztecs before the Spanish took over. Moctezuma, the then-chief of the Aztecs, had been receiving accounts of the Europeans' arrival since their ships (reported as towers or small mountains) arrived in the Yucat\u00e1n then Veracruz. It was here that Spanish explorer Hern\u00e1n Cort\u00e9s advanced upon Tenochtitlan with the aid of many of the other native peoples, arriving there on November 8, 1519. Cort\u00e9s began a siege of Tenochtitlan in May, 1521. It was essentially razed to the Spanish.", "prediction 4": "The land that is now Mexico was owned by the Aztecs since at least 1000 A.D., when the Spanish took over, and the Aztecs were under some impression that Cort\u00e9s was the god Quetzalcoatl. The Aztecs also had a relationship with the Spanish, and they had been living in the area since before the Spanish took over. Cort\u00e9s and his men arrived in Tenochtitlan on November 8, 1519, after learning of the great city and also learning of long-standing rivalries and grievances against it. Spanish objective, however, was that they themselves would benefit from the destruction of Tenochtitlan, making the native peoples not free, but rather more subservient to the Spanish than they were to the Aztecs. They also learned of long-standing rivalries and grievances against it. The Aztecs were under some impression that Cort\u00e9s was the god Quetz", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 52, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 141 }, { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 268 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 484 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Spaniards, led by Hern\u00e1n Cort\u00e9s, took over the land, which is now Mexico, in August 1521. The land that is now Mexico was owned by the Aztecs for a hundred years before the Spanish took over. The Aztec Triple Alliance, composed three Nahua altepetl city-states: Tenochtitlan, Texcoco, and Tlacopan. The Mixtecs owned the land before the Aztecs." }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Ncaa basketball national player of the year 2018?", "passages": [ [ "Naismith College Player of the Year", "Naismith College Player of the Year\n\nThe Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players.", "It is named in honor of the inventor of basketball (in 1891), Dr. James Naismith.", "First awarded exclusively to male players in 1969, the award was expanded to include female players in 1983.", "Annually before the college season begins in November, a \"watchlist\" consisting of 50 players is chosen by the Atlanta Tipoff Club board of selectors, comprising head coaches, administrators and media members from across the United States.", "By February, the list of nominees is narrowed down to 30 players based on performance.", "In March, four out of the 30 players are selected as finalists and are placed in the final ballot.", "The final winners are selected in April by both the board of selectors and fan voting via text messaging.", "The winners receive the Naismith Trophy.", "Since its beginning in 1969, the trophy has been awarded to 42 male and 23 female players.", "Lew Alcindor of the University of California, Los Angeles (UCLA) and Anne Donovan of Old Dominion University were the first winners, respectively.", "Bill Walton of UCLA and Ralph Sampson of the University of Virginia have been the only men to win this award multiple times, with both winning three times." ], [ "Jalen Brunson", "Jalen Brunson\n\nJalen Marquis Brunson (born August 31, 1996) is an American professional basketball player for the Dallas Mavericks of the National Basketball Association (NBA).", "He played college basketball for Villanova University, where he was the National Player of the Year as a junior and won two national championships.", "According to ESPN, he ended his junior year of high school for Stevenson High School in Lincolnshire, Illinois as the number one point guard in the country and prior to his senior year he was rated number one by Scout.com.", "He was selected as the 2014 Illinois Boys Basketball Gatorade Player of the Year.", "He was selected to participate in the 2015 McDonald's All-American Boys Game as well as the 2015 Jordan Brand Classic and to represent the Team USA in the Nike Hoop Summit.", "As a senior, he repeated as the 2015 Illinois Gatorade Player of the Year and earned a third Associated Press All-state recognition (2nd first team).", "That year, he led Stevenson to the Illinois High School Association (IHSA)", "Class 4A championship.", "Following the season, he won Illinois Mr. Basketball.", "He completed his senior season in the 2014\u201315 academic year." ], [ "A'ja Wilson", "Throughout Wilson's high school career she played a total of 119 games.", "She averaged 24.7 points, 13.9 rebounds, and 4.3 blocks a game throughout her high school career.", "She was number 22 and played as a forward.", "After finishing as a runner-up in her junior year, Wilson led Heathwood Hall to the 2014 state championship as a senior.", "She won the National High School player of the year in 2014, was a Parade and McDonald's All-American, and was the #1 rated ESPN HoopGurlz prospect in 2014.", "Wilson chose to stay home, and committed to play for Dawn Staley at the University of South Carolina.", "Wilson played in 37 games her freshmen year, leading to 4 single game freshmen records in the SEC and 3 single season freshmen records in the SEC, and won the SEC Freshman of the year award.", "In 2016 as a Sophomore she would win her first SEC Player of the year ward and was a consensus All-American, Wilson led the Gamecocks to a SEC regular season and Tournament Championship.", "In 2017 Wilson once again led the Gamecocks to a SEC regular season and Tournament championship, and went on to win the schools first National Championship with a stirring victory over the Mississippi State Bulldogs in the championship game.", "She was named the Most Outstanding Player of the tournament." ] ], "gold": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. It is named in honor of Dr. James Naismith, the inventor of basketball. In 2018, Jalen Brunson from Villanova University won the men's Player of the Year award and A'ja Wilson from the University of South Carolina won the women's Player of the Year award. ", "prediction 1": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. In 2018, the award was expanded to include female players in 1983. Jalen Brunson was the winner of the 2014 Illinois Boys Basketball Gatorade Player of the Year, A'ja Wilson was the winner of the Ncaa basketball National Player of the Year in 2017, and A'ja Wilson was the winner of the Ncaa basketball National Player of the Year in 2018.", "prediction 2": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. In 2018, a watchlist consisting of 50 players is chosen by the Atlanta Tipoff Club board of selectors, comprising head coaches, administrators and media members from across the United States. In 2019, there was no female player in the list, only a male.", "prediction 3": "The NAA Basketball National Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. In 2018, the award was expanded to include female players in 1983. In 2013, the award was given to the University of Kentucky for its male team. In 2014, the award went to Villanova University. In 2015, the award went to the Illinois State University. In 2016, the award went to the University of South Carolina for its female team.", "prediction 4": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. First awarded exclusively to male players in 1969, the award was expanded to include female players in 1983. In 2018, Jalen Brunson was named the National High School player of the year in Illinois and A'ja Wilson was named the Ncaa basketball national player of the year in 2017. The award is named in honor of the inventor of basketball, Dr. James Naismith.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 324 }, { "error type": "Unverifiable", "explanation": "", "start": 359, "end": 411 }, { "error type": "Redundant", "explanation": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. In 2018, the award was expanded to include female players in 1983. Jalen Brunson was the winner of the 2014 Illinois Boys Basketball Gatorade Player of the Year, A'ja Wilson was the winner of the Ncaa basketball National Player of the Year in 2017, ", "start": 412, "end": 502 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "The Naismith College Player of the Year is an annual basketball award given by the Atlanta Tipoff Club to the top men's and women's collegiate basketball players. It is named in honor of the inventor of basketball, Dr. James Naismith. Jalen Brunson, from Villanova University, was the National Player of the Year as a junior. A'ja Wilson won the National High School player of the year and played at University of South Carolina." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the high commissioner of india in london?", "passages": [ [ "Commonwealth War Graves Commission", "The members are: the High Commissioner for New Zealand to the United Kingdom, Lieutenant-General Sir Jerry Mateparae, the High Commissioner of Australia to the United Kingdom, George Brandis, the High Commissioner of the Republic of South Africa to the United Kingdom, Nomatemba Tambo, the High Commissioner for India to the United Kingdom, Yashvardhan Kumar Sinha, the High Commissioner for Canada to the United Kingdom, Janice Charette, Sir Hew Strachan, Keith Simpson, Kevan Jones, Edward Chaplin, Robert Fox, Ros Kelly, Air Marshall David Walker and Lieutenant General Sir Bill Rollo.", "Victoria Wallace is the Director-General of the CWGC and serves as secretary to the Board.", "The CWGC is headquartered in Maidenhead, England.", "Offices or agencies that are each responsible for a specific geographical area manage the worldwide affairs of the organisation.", "They are:\n\n\n", "The CWGC's work is funded predominantly by grants from the governments of the six member states.", "In the fiscal year 2012/13, these grants amounted to \u00a358.6 million of the organisation's \u00a366.5 million of income.", "This equates to an approximate cost of per commemorated war dead.", "The contribution from each country is proportionate to the number of graves the CWGC maintains on behalf of that country." ], [ "Ranjan Mathai", "Ranjan Mathai\n\nRanjan Mathai (born 1952) is an Indian diplomat who was a former Indian Foreign Secretary and Indian High Commissioner to the UK.", "Prior to this, he served as Foreign Secretary of India from 1 August 2011 to 31 July 2013.", "Ranjan Mathai was born in Thiruvalla, Kerala, India.", "He did his post graduate studies in Political Science at the University of Pune.", "His father, Thomas Mathai, was a senior faculty member at the National Defence Academy.", "His mother Sara was a teacher at Khadakvasla, Pune.", "Ranjan Mathai is a 1974 batch Indian Foreign Service Officer.", "Ranjan Mathai, former foreign secretary of India, has taken over as India's next high commissioner to the UK on Monday, 9 December 2013.", "He succeeds Jaimini Bhagwati, who retired recently.", "He was the Foreign Secretary for India prior to this position.", "On 31 July 2013, he demitted office and Sujatha Singh took over as the new Foreign Secretary.", "He joined the IFS after completing post graduate studies in Political Science at the University of Poona.", "He has served in Indian Embassies in Vienna, Colombo, Washington, Tehran and Brussels." ], [ "Navtej Sarna", "Navtej Sarna\n\nNavtej Singh Sarna (born 1957) is an Indian author-columnist, diplomat & current Indian Ambassador to the United States.", "He previously served as the High Commissioner of India to the United Kingdom, and the Ambassador to Israel.", "He was born in Jalandhar, India to noted writer in Punjabi, Mohinder Singh Sarna and Punjabi poetess and translator Surjit Sarna, and did his schooling from St. Joseph's Academy, Dehradun.", "Later he joined the Indian Foreign Service in 1980.", "He holds the distinction of being the longest-serving spokesperson of the Indian Foreign Ministry (six years), and served two prime ministers, three foreign ministers and four foreign secretaries, till the end of his term in September, 2008.", "Previously as a diplomat served in Moscow, Warsaw, Thimphu, Geneva, Teheran and Washington, DC.He Served as India's ambassador to Israel from 2008 to 2012, High Commissioner to the UK 2016 and as India's ambassador to the United States since November 2016.", "Navtej Sarna first novel published was \"We Weren't Lovers Like That\" in 2003, followed by\" The Book of Nanak\" was published in the same year." ] ], "gold": "The High Commissioner of India to the United Kingdom is the head of the High Commission of India to the United Kingdom. The High Commissioner of India to the UK from December 2013 to December 2015 was Ranjan Mathai, an Indian civil servant of the IFS cadre who was a former Indian Foreign Secretary and Indian High Commissioner to the UK. The High Commissioner from January 2016 to December 2016 was Navtej Sarna, an Indian author-columnist, diplomat and former Indian Ambassador to the United States. The High Commissioner from December 2016 to October 2018 was Yashvardhan Kumar Sinha, an Indian diplomat who belongs to the Indian Foreign Service.", "prediction 1": "The High Commission of India in London is composed of various officials representing India in the United Kingdom. Prior to this, Ranjan Mathai was the High Commissioner of India to the UK, followed by Navtej Singh Sarna in 2013.", "prediction 2": "The High Commissioner of India to the United Kingdom was Ranjan Mathai from January 1, 2011 to July 31, 2013. He succeeded Jaimini Bhagwati, who retired recently. Navtej Sarna, an Indian author-columnist, diplomat and current Indian Ambassador to the United States, was the High Commissioner of India to the United Kingdom from January 9, 2016 to November 16, 2017.", "prediction 3": "The High Commissioner of India to the United Kingdom from 2016 to 2021 is Nomatemba Tambo, a former Indian diplomat who was a former Indian Foreign Secretary and Indian High Commissioner to the UK from 2011 to 2013. Ranjan Mathai succeeded Jaimini Bhagwati, who retired recently. Navtej Sarna, who previously served as the High Commissioner of India to the UK from 2016 to 2021, is the current High Commissioner of India to the UK.", "prediction 4": "The High Commissioner of India to the United Kingdom is Ranjan Mathai, who succeeded Jaimini Bhagwati as High Commissioner in August 2011. Navtej Sarna, an Indian author-columnist, diplomat and current Indian Ambassador to the United States, replaced Mathai as high commissioner in September 2013.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 220, "end": 228 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The High Commission of India in London is composed of various officials representing India in the United Kingdom. Jaimini Bhagwati was succeeded by Ranjan Mathai, an Indian diplomat who was a former Indian Foreign Secretary, as the High Commissioner of India to the UK, when he took office in December 2013. He was followed by Navtej Singh Sarna, an Indian author-columnist, diplomat & current Indian Ambassador to the United States, who took office in 2016." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who wrote there is power in a union?", "passages": [ [ "There Is Power in a Union", "There Is Power in a Union\n\n\"There Is Power in a Union\" is a song written by Joe Hill in 1913.", "The Industrial Workers of the World (commonly known as the Wobblies) concentrated much of its labor trying to organize migrant workers in lumber and construction camps.", "They sometimes had competition for the attention of the workers from religious organizations.", "The song uses the tune of Lewis E. Jones' 1899 hymn \"There Is Power in the Blood (Of the Lamb)\".", "\"There Is Power in a Union\" was first published in the \"Little Red Songbook\" in 1913.", "The song has been recorded several times.", "Billy Bragg recorded a song with the title \"There Is Power in a Union\" on the \"Talking with the Taxman About Poetry\" album; this has different words and is set to the tune of \"Battle Cry of Freedom\".", "The Billy Bragg version of this title is featured in the 2004 film \"\" in which American Communist organizations march in Time Square.", "The Billy Bragg song of this title, but unrelated to Joe Hill's song, is featured in the 2014 film \"Pride\" in which London organization Lesbians and Gays Support the Miners collects funds to support the striking miners of a Welsh pit village during the UK miners' strike (1984\u201385)." ], [ "Battle Cry of Freedom", "Battle Cry of Freedom\n\nThe \"Battle Cry of Freedom\", also known as \"Rally 'Round the Flag\", is a song written in 1862 by American composer George Frederick Root (1820\u20131895) during the American Civil War.", "A patriotic song advocating the causes of Unionism and abolitionism, it became so popular that composer H. L. Schreiner and lyricist W. H. Barnes adapted it for the Confederacy.", "A modified Union version was used as the campaign song for the Lincoln-Johnson ticket in the 1864 presidential election, as well as in elections after the war, such as for Garfield in the 1880 U.S. presidential election.", "The song was so popular that the music publisher had 14 printing presses going at one time and still could not keep up with demand.", "It is estimated that over 700,000 copies of this song were put in circulation.", "Louis Moreau Gottschalk thought so highly of the song that in his diary he confided that he thought \"it should be our national anthem\" and used it as the basis for his 1863 concert paraphrase for solo piano \"Le Cri de d\u00e9livrance,\" opus 55, and dedicated it to Root, who was a personal friend.", "Charles Ives quoted the song in his own patriotic song, \"They Are There\"." ], [ "Billy Bragg", "Billy Bragg\n\nStephen William Bragg (born 20 December 1957) is an English singer-songwriter and far left-wing political activist.", "His music blends elements of folk music, punk rock and protest songs, with lyrics that mostly span political or romantic themes.", "His music is heavily centred on bringing about change and involving the younger generation in activist causes.", "Bragg was born in 1957 in Barking, Essex, one of the sons of Dennis Frederick Austin Bragg, an assistant sales manager to a Barking cap maker and milliner, and his wife Marie Victoria D'Urso, who was of Italian descent.", "Bragg's father died of lung cancer in 1976, and his mother in 2011.", "Bragg was educated at Northbury Junior School and Park Modern Secondary School (now part of Barking Abbey Secondary School) in Barking, where he failed his eleven-plus exam, effectively precluding him from going to university.", "However he developed an interest in poetry at the age of twelve, when his English teacher chose him to read a poem he had written for a homework assignment on a local radio station.", "He put his energies into learning and practising the guitar with his next-door neighbour, Philip Wigg (Wiggy); some of their influences were the Faces, Small Faces and the Rolling Stones." ] ], "gold": "\"There Is Power in a Union\" is a song written by Joe Hill in 1913. The song has been recorded several times, including a version English singer-songwriter and activist Billy Bragg recorded with the title \"There Is Power in a Union\" on the Talking with the Taxman About Poetry album; this has different words and is set to the tune of \"Battle Cry of Freedom\". The \"Battle Cry of Freedom\", is a song written in 1862 by American composer George Frederick Root during the American Civil War and is a patriotic song advocating the causes of Unionism and abolitionism. The Billy Bragg song \"There is Power in a Union\" is featured in the 2014 film Pride in which London organization Lesbians and Gays Support the Miners collects funds to support the striking miners of a Welsh pit village during the UK miners' strike.", "prediction 1": "There Is Power in a Union is a song written by Joe Hill in 1913. The song uses the tune of Lewis E. Jones' 1899 hymn There Is Power in the Blood (of the Lamb). Billy Bragg recorded a song with the title There Is Power in a Union on the Talking with the Taxman About Poetry album, which has different words and is set to the tune of the Battle Cry of Freedom.", "prediction 2": "There is a song titled \"There Is Power in a Union\" written by Joe Hill in 1913. The song uses the tune of Lewis E. Jones' 1899 hymn \"There Is Power in the Blood (Of the Lamb)\". The American singer-songwriter Billy Bragg recorded a song with the title \"There Is Power in a Union\" on the \"Talking with the Taxman About Poetry\" album, this has different words and is set to the tune of \"Battle Cry of Freedom\".", "prediction 3": "There is a song titled There Is Power in a Union written by Joe Hill in 1913. The song uses the tune of Lewis E. Jones' 1899 hymn There Is Power in the Blood (Of the Lamb). Billy Bragg recorded a song with the title \"There Is Power in a Union\" on the \"Talking with the Taxman About Poetry\" album, this has different words and is set to the tune of \"Battle Cry of Freedom\".", "prediction 4": "There is a song called There Is Power in a Union, written by Joe Hill in 1913, which is based on the 1899 hymn, There Is Power in the Blood of the Lamb, by Lewis E. Jones. There is also another song called There Is Power in a Union, written by Billy Bragg, which was recorded in 2004.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 159 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "There Is Power in a Union is a song written by Joe Hill in 1913. Billy Bragg recorded a song with the title There Is Power in a Union on the Talking with the Taxman About Poetry album, which has different words and is set to the tune of the Battle Cry of Freedom. The \"Battle Cry of Freedom\", is a song written in 1862 by American composer George Frederick Root during the American Civil War and is a patriotic song advocating the causes of Unionism and abolitionism. The Billy Bragg song \"There is Power in a Union\" is featured in the 2014 film Pride in which London organization Lesbians and Gays Support the Miners collects funds to support the striking miners of a Welsh pit village during the UK miners' strike." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When did the mayflower come over to america?", "passages": [ [ "Mayflower", "The passengers had already suffered agonizing delays, shortages of food, and other shortages, and they were now called upon to provide assistance to the ship's carpenter in repairing the fractured main support beam.", "This was repaired with the use of a metal mechanical device called a jackscrew, which had been loaded on board to help in the construction of settler homes.", "It was now used to secure the beam to keep it from cracking farther, thus maintaining the seaworthiness of the vessel.", "The crew of the \"Mayflower\" had some devices to assist them en route, such as a compass for navigation, as well as a log and line system to measure speed in nautical miles per hour (knots).", "Time was measured with the ancient method of an hourglass.", "On November 9, 1620, they sighted present-day Cape Cod.", "They spent several days trying to sail south to their planned destination of the Colony of Virginia, where they had obtained permission to settle from the Company of Merchant Adventurers.", "However, strong winter seas forced them to return to the harbor at Cape Cod hook, well north of the intended area, where they anchored on November 11.", "The settlers wrote and signed the Mayflower Compact after the ship dropped anchor at Cape Cod, in what is now Provincetown Harbor, in order to establish legal order and to quell increasing strife within the ranks." ], [ "Mayflower", "They made a new start after the repairs, and they were more than 200 miles (320\u00a0km) beyond Land's End at the southwestern tip of England when \"Speedwell\" sprang another leak.", "It was now early September, and they had no choice but to abandon the \"Speedwell\" and make a determination on her passengers.", "This was a dire event, as the ship had wasted vital funds and was considered very important to the future success of their settlement in America.", "Both ships returned to Plymouth, where some of the \"Speedwell\" passengers joined the \"Mayflower\" and others returned to Holland.", "The \"Mayflower\" then continued on her voyage to America, and the \"Speedwell\" was sold soon afterwards.", "\"Mayflower\" carried 102 passengers plus a crew of 25 to 30 officers and men, bringing the total to approximately 130.", "According to William Bradford, \"Speedwell\" was refitted and \"made many voyages\u2026 to the great profit of her owners.\"", "He also suggested that the \"Speedwell\"'s master used \"cunning and deceit\" to abort the voyage, possibly by causing leaks in the ship and motivated by a fear of starving to death in America.", "In early September, western gales began to make the North Atlantic a dangerous place for sailing." ], [ "Edward Tilley", "On the way there were two deaths, a crew member and a passenger, but the worst was yet to come after arriving at their destination when, in the space of several months, almost half the passengers perished in cold, harsh, unfamiliar New England winter.", "On November 9/19, 1620, after about three months at sea, including a month of delays in England, they spotted land, which was the Cape Cod Hook, now called Provincetown Harbor.", "After several days of trying to get south to their planned destination of the Colony of Virginia, strong winter seas forced them to return to the harbor at Cape Cod hook, where they anchored on November 11/21.", "The Mayflower Compact was signed that day.", "Upon arrival at Cape Cod, he was a signatory to the Mayflower Compact, signing as \"Edward Tilly.\"", "He and his brother John both signed the Compact with the \"Tilly\" surname.", "During the first weeks after arrival in the New World, Edward Tilley was an active participant, often with his brother John, in the various exploring parties of late November and early December 1620 while the \"Mayflower\" was anchored at Cape Cod.", "The same day the Mayflower Compact was signed, November 11, 1620, about fifteen or sixteen men made their first landing ashore at the tip of Cape Cod for the purpose of making a short exploration." ] ], "gold": "The Mayflower sailed to present-day America on September 6, 1620, with 102 passengers and a crew of around 30. After a grueling 10 weeks at sea, the Mayflower sighted present day Cape Cod on November 9, 1620. ", "prediction 1": "The Mayflower made her way to America on November 11, 1620, when 102 passengers and a crew of 25 to 30 officers and men arrived on the Cape Cod where they anchored. The same day the Mayflower Compact was signed, November 11, 1620, about fifteen or sixteen men made their first landing ashore at the tip of Cape Cod for the purpose of making a short exploration.", "prediction 2": "On November 10, 1620, the Mayflower made her first landfall on the New England shores, at Cape Cod. The settlers wrote and signed the Mayflower Compact after the ship dropped anchor at Cape Cod, in what is now Provincetown Harbor, in order to establish legal order and to quell increasing strife within the ranks.", "prediction 3": "The Mayflower came over to America on November 11, 1620, after being at sea for several months. They had already suffered agonizing delays, shortages of food, and other shortages, and they were now called upon to provide assistance to the ship's carpenter in repairing the fractured main support beam. This was repaired with the use of a metal mechanical device called a jackscrew, which had been loaded on board to help in the construction of settler homes. On November 9, 1620, they sighted present-day Cape Cod Hook, now called Provincetown Harbor.", "prediction 4": "On November 9, 1620, the Mayflower arrived at Cape Cod, Massachusetts. On November 11, 1620, the Mayflower anchored at Cape Cod Hook, where they anchored the Mayflower Compact, which was written by settlers to establish legal order and quell increasing strife within the ranks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 361 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Mayflower made her way to America on November 11, 1620, with 102 passengers and a crew of 25 to 30 officers. On November 9/19, 1620, after about three months at sea they spotted land, which was the Cape Cod Hook." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who play the role of jagya in balika vadhu?", "passages": [ [ "Balika Vadhu", "Balika Vadhu\n\nBalika Vadhu (English: \"Child Bride\") is an Indian soap opera that aired on Colors TV.", "It aired between 21 July 2008 and 31 July 2016 with 2,245 episodes.", "The story which is set in rural Rajasthan revolved around the life of a child bride from childhood to womanhood.", "The first season focused on Anandi and Jagdish, who were married in childhood.", "The second season reflects the lives of Anandi's daughter Dr. Nandini who was also a child bride.", "It has been credited as the first Indian fiction show to complete 2,000 episodes.", "The show had two seasons titled Balika Vadhu\u2014Kacchi Umar Ke Pakke Rishte (English:\u00a0\"Child Bride\u2014Strong Relationships of Tender Age, Child Marriage\u2014Strong Relationship of Tender Age\") and Balika Vadhu\u2014Lamhe Pyaar Ke (English: \"Child Bride\u2014Moments of Love, Child Marriage\u2014Moments of Love\").", "Balika Vadhu:", "Kakchi Umar Ke Pakke Rishte traces the life journey of Anandi (Avika Gor) and Jagdish (Avinash Mukherjee), who are married in childhood." ], [ "Shashank Vyas", "Shashank Vyas\n\nShashank Vyas (born 30 November 1986 in Ujjain, Madhya Pradesh) is an Indian actor and model.", "He is well known for the lead character of Dr. Jagdish Bhairon Singh in the longest-running show \"Balika Vadhu\".", "Currently, he is playing the lead character of Roopendra Shamsher Singh Vaghela in the serial \"Roop - Mard Ka Naya Swaroop\".", "Shashank was born on 30 November 1986 in Ujjain, Madhya Pradesh.", "He graduated from Maharaja Ranjit Singh College, Indore and started studying for MBA entrance exams.", "But later he moved on to pursue his acting career upon the encouragement of a friend.", "Shashank Vyas made his debut with the lead role, Jagdish/Jagya in Colors's serial \"Balika Vadhu\" in July 2010.", "His performance in the show earned him critical and people's praise and he became one of the most favorite television actors of India.", "After playing Jagdish in \"Balika Vadhu\" for five years, Shashank quit the show in July 2015.", "His last episode was aired on 8 August 2015; he was replaced by Shakti Anand." ], [ "Avinash Mukherjee", "Avinash Mukherjee\n\nAvinash Mukherjee is an Indian actor known for the role of \"Jagya\" in the Colors TV serial \"Balika Vadhu\".", "He appears in the role of \"Ranbir Neil Khanna\" in \"Itna Karo Na Mujhe Pyaar\".", "He is cousin of Mere Angne Mein fame Richa Mukherjee" ] ], "gold": "Balika Vadhu is an Indian soap opera that aired on Colors TV between 21 July 2008 and 31 July 2016 and ran for 2,248 episodes. The character, Jagya, was played by Shashank Vyas from 2010 to 2015 and Shakti Anand from 2015 to 2016. Young Jagya was played by Avinash Mukherjee.", "prediction 1": "Avinash Mukherjee played the role of Jagya in the Colors TV serial Balika Vadhu. Shashank Vyas played the role of Jagdish for five years. Shakti Anand played the role of Jagya for one season.", "prediction 2": "Avinash Mukherjee plays the role of Jagya in the Colors TV serial Balika Vadhu. Shashank Vyas, who played the role of Jagdish for five years, quit the show in July 2015. Shakti Anand played the role of Jagdish for two seasons.", "prediction 3": "The character of Jagya in the Indian soap opera Balika Vadhu was played by a number of actors. The first and second season of the show revolved around Anandi and Jagdish, who were married in childhood. The third and final season focused on Anandi and Jagdish, who were married in childhood. Avinash Mukherjee played the role of Jagya.", "prediction 4": "Avinash Mukherjee played the role of Jagya in the Colors TV serial Balika Vadhu. In the 2015-16 season, Shakti Anand, Shashank Vyas played the role of Jagya. In the 2017-18 season, Avika Gor played the role of Jagya.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 176, "end": 191 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "Balika Vadhu is an Indian soap opera that aired on Colors TV between 21 July 2008 and 31 July 2016 and ran for 2,248 episodes. Avinash Mukherjee played the role of Jagya in the Colors TV serial Balika Vadhu. Shashank Vyas played the role of Jagdish for five years from 2010 to 2015; he was replaced by Shakti Anand." }, "preference": [ 0, 1, 0, 1, 1, 2 ] }, { "question": "Who is the owner of the brand bape?", "passages": [ [ "A Bathing Ape", "A Bathing Ape\n\nThe company previously operated (Busy Work Shop), Bape Cuts hair salon, Bape Caf\u00e9, BABY MILO and The cay Soldier.", "Nigo also founded the secondary lines AAPE (by A Bathing Ape) and BAPY (Busy Working Lady).", "In 2011, the company was sold to Hong Kong fashion conglomerate I.T Group.", "Nigo left the brand in 2013.", "Nigo, founder and owner, cites his mother and father, who were a nurse and a billboard maker respectively, as major influences in the development of his character, though because they both worked, he spent a lot of time alone with toys.", "He also credits DJ/fashion guru Hiroshi Fujiwara as his business model.", "His nickname means \"number two\" in Japanese; the MD of Astoarobot, the fashion store, coined the moniker when he noted the physical resemblance to Fujiwara.", "Nigo cites his early influences as Elvis, The Beatles and hip-hop acts such as Beastie Boys and Run\u2013D.M.C. After studying fashion editing at college, he worked as an editor and a stylist for \"Popeye\" magazine.", "After borrowing four million yen from an acquaintance, who also let him use his shop, he opened \"Nowhere\", his first store, along with Jun Takahashi of Undercover, on April 1, 1993, in Ura-Harajuku." ], [ "Nigo", "Nigo\n\nNigo's venture into fashion started in a small store selling a few Bape T-shirts and camouflage print hoodies, which became very popular among teenagers.", "In 2002, Nigo released the Bapesta sneaker, which according to BBC presenter Jonathan Ross, later became the \"epitome of collectable footwear.\"", "The sneaker resembles Nike's Air Force 1 design, but instead of the swoosh on the side, it has Nigo's Bapesta logo that is a star with a lightning zap extending out of the star.", "In 2005, Nigo partnered with Pharrell Williams to create and launch the streetwear brands Billionaire Boys Club and Ice Cream footwear.", "In 2017, Nigo became the creative director for Uniqlo's UT brand and his new brand Human Made.", "Nigo has been associated with popular rap and hip hop artists such as Kanye West and Pharrell Williams.", "He is the DJ of the Japanese hip hop group Teriyaki Boyz and is also owner of BAPE Sounds record label.", "He also has an MTV Japan show which he created called Nigoldeneye.", "Together with BiS manager Watanabe Junnosuke, Nigo is the producer and manager for the female pop group BILLIE IDLE." ] ], "gold": "Tomoaki Nagao, known professionally as Nigo, is a Japanese fashion designer, DJ, record producer, and entrepreneur. He founded the brand Bape (A Bathing Ape) in 1993 and was the original owner. In 2011, Bape was sold to Hong Kong fashion conglomerate I.T Group for about $2.8 Million. Nigo left the brand in 2013.", "prediction 1": "The brand Bape is owned by Japanese fashion designer and DJ, A Bathing Ape, and its secondary lines, AAPE by A Bathing Ape and BAPY by Busy Working Lady. Bape was founded in 1993 by Nigo Nigo, a Japanese hip hop DJ and owner of the record label BAPE Sounds.", "prediction 2": "Nigo, the founder and owner of the brand Bape, is the DJ of the Japanese hip hop group Teriyaki Boyz and also the owner of BAPE Sounds record label.", "prediction 3": "Nigo, the founder and owner of the brand Bape, is a Japanese DJ, fashion designer, and hip hop artist. In 2002, he released the Bapesta sneaker, which according to BBC presenter Jonathan Ross, later became the \"epitome of collectable footwear.\" In 2005, he partnered with Pharrell Williams to create and launch the streetwear brands Billionaire Boys Club and Ice Cream footwear. In 2013, he left the brand in 2013. Nigo, the founder and owner of the brand Bape, is the owner of the brand Bapesta Records record label.", "prediction 4": "Nigo, the founder and owner of the brand Bape, founded the company with Jun Takahashi of Undercover in 1993. The brand's owner is the DJ of the Japanese hip hop group Teriyaki Boyz and the owner of BAPE Sounds record label.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 0, "end": 153 } ], "missing-info": [], "corrected-prediction": "The brand Bape (A Bathing Ape) was founded in 1993 by Nigo, a Japanese fashion designer and hip hop DJ. In 2011, the company was sold to Hong Kong fashion conglomerate I.T Group." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the director of the defense intelligence agency?", "passages": [ [ "Russian military intervention in the Syrian Civil War", "In January 2016, a few months after Russia's involvement in Syria, diplomat Ranjit Gupta wrote, in an article published by , that the Russian reinforcement was \"godsend for Assad, greatly boosting the regime's sagging morale and that of its armed forces.\"", "Gupta continued:\nIn February 2016, Professor Fawaz A. Gerges of the London School of Economics opined the Russian military intervention had turned out to be a game-changer in the Syrian Civil War: \u2033Mr", "Putin's decision to intervene in Syria and shore up Mr Assad with new fighter jets, military advisers and advanced weapons stopped the bleeding of the Syrian army and allowed it to shift from defence to offence.\u2033\n\nVincent R. Stewart, Director of the Defense Intelligence Agency, stated in February 2016 that the \"Russian reinforcement has changed the calculus completely\" and added that Assad \"is in a much stronger negotiating position than he was just six months ago\"." ], [ "David Shedd", "David Shedd\n\nDavid R. Shedd is a retired U.S. intelligence officer whose final post was as the acting Director of the Defense Intelligence Agency.", "He is a former Central Intelligence Agency operative.", "Shedd holds a B.A. degree from Geneva College in Beaver Falls, Pennsylvania, and a M.A. degree from Georgetown University\u2019s Edmund A. Walsh School of Foreign Service in Latin American studies.", "From 1984 to 1993, Shedd was posted overseas in the U.S. embassies in Costa Rica and Mexico.", "Shedd has held a variety of senior management assignments including Chief of Congressional Liaison at the Central Intelligence Agency.", "Shedd served from May 2007 to August 2010 as the Deputy Director of National Intelligence (DNI) for Policy, Plans, and Requirements, where he oversaw the formulation and implementation of major Intelligence Community (IC) policies from information sharing and IC authorities to analytic standards, among others.", "In particular, he led the review of Executive Order 12333, the foundational U.S. intelligence policy, which was revised by President George W. Bush in July 2008.", "Shedd also developed and implemented a National Intelligence Strategy, published in August 2009 for the IC and led strategic planning efforts to determine intelligence priorities for the IC and the nation." ] ], "gold": "Several individuals have been nominated as the director of the defense intelligence agency. In 2012, Michael T. Flynn took office as the director of the US defense intelligence agency. In 2014, David Shedd became the acting director of the US defense intelligence agency and was succeeded by Vincent R. Stewart. Robert Paul Ashley Jr. took office as the director of the US defense intelligence agency in 2017.", "prediction 1": "Vincent R. Stewart, former U.S. intelligence officer and former Central Intelligence Agency operative, is the Director of the Defense Intelligence Agency. David R. Shedd served from May 2007 to August 2010 as the Deputy Director of National Intelligence (DNI) for Policy, Plans, and Requirements, where he oversaw the formulation and implementation of major Intelligence Community (IC) policies from information sharing and IC authorities to analytic standards, among others. In March 2016, Russia's military intervention in Syria helped Assad win the civil war.", "prediction 2": "Vincent R. Stewart was the Director of the Defense Intelligence Agency from 2013 to 2016 and Vincent R. Shedd was the acting Director from 2016 to 2021. David R. Shedd served as the acting Director from 2013 to 2016 and Vincent R. Stewart served as the acting Director from 2014 to 2021.", "prediction 3": "Vincent R. Stewart is the current director of the Defense Intelligence Agency. Vincent R. Stewart was a retired U.S. intelligence officer whose final post was as the acting director of the agency between August 2010 and January 2020. David R. Shedd was the acting director between January 2010 and February 2016. Stewart was previously the acting director between January 2010 and February 2016, and was succeeded by Vincent R. Stewart in February 2016.", "prediction 4": "Vincent R. Stewart is the Director of the Defense Intelligence Agency. David Shedd serves as acting director.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 20, "end": 102 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 475 }, { "error type": "Irrelevant", "explanation": "", "start": 476, "end": 543 }, { "error type": "Unverifiable", "explanation": "", "start": 544, "end": 547 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Vincent R. Stewart is the Director of the Defense Intelligence Agency, in 2016. David R. Shedd's final post was as the acting Director of the Defense Intelligence Agency." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Which is the biggest nuclear power plant in india?", "passages": [ [ "Nuclear power in India", "In June 2014, Kudankulam-1 became the single largest power generating unit in India (1000\u00a0MWe).", "Currently, twenty-two nuclear power reactors have a total install capacity of 6,780\u00a0MW (3.5% of total installed base).", "The details of the nuclear power generation capacity in the country are given below :\n\nFollowing the March 2011 Fukushima nuclear disaster in Japan, populations around proposed Indian NPP sites have launched protests that had found resonance around the country.", "There have been mass protests against the French-backed 9,900 MW Jaitapur Nuclear Power Project in Maharashtra and the Russian-backed 2,000 MW Koodankulam Nuclear Power Plant in Tamil Nadu.", "The Government of West Bengal initially refused permission to a proposed 6,000 MW facility near the town of Haripur that intended to host 6 Russian reactors.", "But after stiff resistance from locals, the proposed Nuclear Power Plant planned in Haripur has been shifted to Kavali in Andhra Pradesh.", "Interestingly, the Nuclear Power Plant planned at Kovvada in Andhra Pradesh was shifted from Mithi Virdi in Gujarat after locals in the Western state too showed resistance.", "A Public-interest litigation (PIL) has also been filed against the government\u2019s civil nuclear program at the Supreme Court." ], [ "Kudankulam Nuclear Power Plant", "Kudankulam Nuclear Power Plant\n\nKudankulam Nuclear Power Plant (or Koodankulam NPP or KKNPP) is the single largest nuclear power station in India, situated in Koodankulam in the Tirunelveli district of the southern Indian state of Tamil Nadu.", "Construction on the plant began on 31 March 2002, but faced several delays due to opposition from local fishermen.", "KKNPP is scheduled to have six VVER-1000 reactors built in collaboration with Atomstroyexport, the Russian state company and Nuclear Power Corporation of India Limited (NPCIL), with an installed capacity of 6,000\u00a0MW of electricity.", "Unit 1 was synchronised with the southern power grid on 22 October 2013 and since then, has been generating electricity at its warranted limit of 1,000\u00a0MW.", "The original cost of the two units was 13,171 crore, but it was later revised to 17,270 crore ($2.6 billion).", "Russia advanced a credit of 6,416 crore ($0.97 billion) for both the units.", "Unit 2 attained criticality on 10 July 2016 and was synchronised with the electricity grid on 29 August." ], [ "Jaitapur Nuclear Power Project", "Jaitapur Nuclear Power Project\n\nJaitapur Nuclear Power Project is a proposed nuclear power plant in India.", "If built, it would be the largest nuclear power generating station in the world by net generation capacity, at 9,900\u00a0MW.", "The power project is proposed by Nuclear Power Corporation of India (NPCIL) and would be built at Madban village of Ratnagiri district in Maharashtra.", "On 6 December 2010 agreement was signed for the construction of a first set of two third-generation European Pressurized Reactors and the supply of nuclear fuel for 25 years in the presence of French president Nicolas Sarkozy and Indian prime minister Manmohan Singh.", "French state-controlled nuclear engineering firm Areva S.A. and Indian state-owned nuclear operator Nuclear Power Corporation of India signed the agreement, valued about $9.3 billion.", "This is a general framework agreement that was signed along with the agreement on 'Protection of Confidentiality of Technical Data and Information Relating to Nuclear Power Corporation in the Peaceful Uses of Nuclear Energy'.", "The plant construction is expected to start in late 2018.", "The proposed Jaitapur Nuclear Power Project is located at the west coast.", "It has an average elevation of .", "This project will spread over of land.", "Jaitapur is on the Arabian Sea coast in Ratnagiri district in the southwestern part of Maharashtra, India." ] ], "gold": "Kudankulam Nuclear Power Plant is the largest nuclear power station in India, situated in Kudankulam in the Tirunelveli district of the southern Indian state of Tamil Nadu. Jaitapur Nuclear Power Project is a proposed nuclear power plant in India. If built, it would be the largest nuclear power generating station in the world by net generation capacity, at 9,900 MW.", "prediction 1": "The biggest nuclear power plant in India by capacity is the Kudankulam Nuclear Power Plant, situated in Koodankulam in the Tirunelveli district of the southern Indian state of Tamil Nadu. If built, it would be the largest nuclear power generating station in the world by net generation capacity, at 9,900 MW.\n", "prediction 2": "Since the March 2011 Fukushima nuclear disaster, mass protests have been held against the French-backed 9,900 MW Jaitapur Nuclear Power Project and the Russian-backed 2,000 MW Koodankulam Nuclear Power Plant in the southern Indian state of Tamil Nadu. There have also been mass protests against the proposed French-backed 5,700 MW Karjat Nuclear Power Plant in West Bengal. These protests have been followed by the most recent protest against the National Power Corporation of India's proposed 5,700 MW Kirenka Nuclear Power Project in India.", "prediction 3": "The nation is home to two nuclear power plants. The biggest nuclear power station in India is the Kudankulam Nuclear Power Plant, in the southern state of Tamil Nadu. The second biggest nuclear power plant in India is the Jaitapur Nuclear Power Project, in the western state of Maharashtra.", "prediction 4": "In India, the single largest nuclear power station by capacity is named Kudankulam Nuclear Power Plant or KKNPP for short. Based on the most recent figures, that number has been revised to 16,710,720 MW, which is 3,200 MW higher than the largest nuclear power station in the world by net generation capacity. The most popular conventional nuclear plant that has been built in India has been the 8500 MW Kudankulam Nuclear Power Plant, formed in 2002. According to government estimates, this nuclear plant produces 6,800 MW.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 198, "end": 200 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The biggest nuclear power plant in India by capacity is the Kudankulam Nuclear Power Plant, situated in Koodankulam in the Tirunelveli district of the southern Indian state of Tamil Nadu. Jaitapur Nuclear Power Project is a proposed nuclear power plant in India. If built, it would be the largest nuclear power generating station in the world by net generation capacity, at 9,900 MW.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What is the most current software for mac?", "passages": [ [ "Macintosh operating systems", "Macintosh operating systems\n\nThe family of Macintosh operating systems developed by Apple Inc. includes the graphical user interface-based operating systems it has designed for use with its Macintosh series of personal computers since 1984, as well as the related system software it once created for compatible third-party systems.", "In 1984, Apple debuted the operating system that is now known as the \"Classic\" Mac OS with its release of the original Macintosh System Software.", "The system, rebranded \"Mac OS\" in 1996, was preinstalled on every Macintosh until 2002 and offered on Macintosh clones for a short time in the 1990s.", "Noted for its ease of use, it was also criticized for its lack of modern technologies compared to its competitors.", "The current Mac operating system is macOS, originally named \"Mac OS X\" until 2012 and then \"OS X\" until 2016.", "Developed between 1997 and 2001 after Apple's purchase of NeXT, Mac OS X brought an entirely new architecture based on NeXTSTEP, a Unix system, that eliminated many of the technical challenges that the classic Mac OS faced.", "The current macOS is preinstalled with every Mac and is updated annually.", "It is the basis of Apple's current system software for its other devices, iOS, watchOS, and tvOS." ], [ "MacOS", "The Metal API, first introduced in iOS 8, was also included in this operating system for \"all Macs since 2012\".", "According to Apple, Metal accelerates system-level rendering by up to 50 percent, resulting in faster graphics performance for everyday apps.", "Metal also delivers up to 10 times faster draw call performance for more fluid experience in games and pro apps.", "macOS 10.12 Sierra was released to the public on September 20, 2016.", "New features include the addition of Siri, Optimized Storage, and updates to Photos, Messages, and iTunes.", "macOS 10.13 High Sierra was released to the public on September 25, 2017.", "Like OS X El Capitan and OS X Mountain Lion, High Sierra is a refinement-based update having very few new features visible to a user, including updates to Safari, Photos, and Mail, among other changes.", "The major change under the hood is the switch to the Apple File System, which is optimized for solid-state storage used in most new Mac computers.", "macOS 10.14 Mojave was released on September 24, 2018.", "As of July 2016, macOS is the second-most-active general-purpose desktop client operating system in use on the World Wide Web following Microsoft Windows, with a 4.90% usage share according to statistics compiled by the Wikimedia Foundation." ] ], "gold": "The family of Macintosh operating systems developed by Apple Inc. includes the graphical user interface-based operating systems it has designed for use with its Macintosh series of personal computers since 1984, as well as the related system software it once created for compatible third-party systems. MacOS X 10.11 El Capitan edition was released on September 30, 2015, macOS Sierra version 10.12 was released on September 20, 2016, and macOS High Sierra version 10.13 was released on September 25, 2017.", "prediction 1": "The current Mac operating system is macOS, originally named Mac OS X until 2012 and then OS X until 2016. MacOS, the current operating system for the Mac, was released on September 12, 2017 and macOS 10.14 Mojave was released on September 24, 2018.", "prediction 2": "The most current operating system for Mac is macOS, originally named \"Mac OS X\" until 2012 and then \"OS X\" until 2016. The metal API, first introduced in iOS 8, was also included in this operating system for \"all Macs since 2012\". macOS 10.14 Mojave was released on September 24, 2018.", "prediction 3": "The current macOS operating system is macOS, originally named \"Mac OS X\" until 2012 and then \"OS X\" until 2016. Developed between 1997 and 2001 after Apple's purchase of NeXT, Mac OS X brought an entirely new architecture based on NeXTSTEP, a Unix system, that eliminated many of the technical challenges that the classic Mac OS faced. macOS 10.14 Mojave was released on September 24, 2018.", "prediction 4": "The most current software for Mac is macOS. The current macOS is the operating system, originally named Mac OS X until 2012 and then OS X until 2016. Apple also releases updates to other software, including iOS, WatchOS and tvOS. The most recent version of iOS was released on September 25, 2017, and the most recent version of Mail was released on September 24, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 105 }, { "error type": "Unverifiable", "explanation": "", "start": 106, "end": 189 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The family of Macintosh operating systems developed by Apple Inc. includes the graphical user interface-based operating systems it has designed for use with its Macintosh series of personal computers since 1984, as well as the related system software it once created for compatible third-party systems. macOS 10.12 Sierra was released to the public on September 20, 2016. macOS 10.13 High Sierra was released to the public on September 25, 2017. macOS 10.14 Mojave was released on September 24, 2018." }, "preference": [ 0, 1, 0, 1, 0, 0 ] }, { "question": "Who led the charge of the light brigade?", "passages": [ [ "Charge of the Light Brigade", "Charge of the Light Brigade\n\nThe Charge of the Light Brigade was a charge of British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War.", "British commander Lord Raglan had intended to send the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions, a task for which the light cavalry were well-suited.", "However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire.", "The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "The events were the subject of Alfred, Lord Tennyson's narrative poem \"The Charge of the Light Brigade\" (1854), published just six weeks after the event.", "Its lines emphasise the valour of the cavalry in bravely carrying out their orders, regardless of the nearly inevitable outcome.", "Blame has remained controversial for the miscommunication, as the order was vague and Louis Edward Nolan delivered the written orders with some verbal interpretation, then died in the first minute of the assault." ], [ "Charge of the Light Brigade", "When Lucan asked what guns were referred to, Nolan is said to have indicated with a wide sweep of his arm\u2014not the causeway redoubts\u2014but the mass of Russian guns in a redoubt at the end of the valley, around a mile away.", "His reasons for the misdirection are unknown because he was killed in the ensuing battle.", "In response to the order, Lucan instructed Cardigan to lead his command of about 670 troopers of the Light Brigade straight into the valley between the Fedyukhin Heights and the Causeway Heights.", "In his poem, \"The Charge of the Light Brigade\" (1854), Tennyson dubbed this hollow \"The Valley of Death\".", "The opposing Russian forces were commanded by Pavel Liprandi and included approximately 20 battalions of infantry supported by over 50 artillery pieces.", "These forces were deployed on both sides and at the opposite end of the valley.", "Lucan himself was to follow with the Heavy Brigade.", "Although the Heavy Brigade was better armoured and intended for frontal assaults on infantry positions, neither force was remotely equipped for a frontal assault on a fully dug-in and alerted artillery battery\u2014much less one with an excellent line of sight over a mile in length and supported on two sides by artillery batteries providing enfilading fire from elevated ground." ], [ "Armand-Octave-Marie d\u2019Allonville", "In 1839, he was appointed lieutenant-colonel of the 1st Regiment of Spahis by Marshall de Saint Arnaud.", "Colonel of the 5th Hussar Regiment in 1845, he was promoted general of brigade in 1851 and participated to Napol\u00e9on III's coup d'\u00e9tat, 2 December 1851.", "He commanded a division of cavalry on the Champs-\u00c9lys\u00e9es, but did not meet hostility from the Parisian crowd.", "D'Allonville was the commandant of the Chasseurs d'Afrique brigade during the Charge of the Light Brigade.", "Under his command, the Chasseurs d'Afrique cleared the two half batteries of guns, two infantry battalions and Cossacks on the Fedyukhin Heights to ensure the British Light Brigade would not be hit by fire from that flank and later provided cover for the remaining elements of the Light Brigade as they withdrew.", "For this brilliant feat of arms, d'Allonville was promoted general of division and commanded, from 20 May 1855, the 1st brigade, comprising the 1st and 4th hussar regiments, and the 2nd brigade, comprising the 6th and 7th dragoon regiments." ] ], "gold": "The Charge of the Light Brigade was a failed military action involving the British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The opposing Russian forces were commanded by Pavel Liprandi while Armand-Octave-Marie d\u2019Allonville from France was the commandant of the Chasseurs d'Afrique brigade during the Charge of the Light Brigade. ", "prediction 1": "The Charge of the Light Brigade was a British light cavalry charge against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. British commander Lord Raglan wanted to send the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions, a task for which the light cavalry were well-suited. However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "prediction 2": "The Charge of the Light Brigade was a British light cavalry charge led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The events were the subject of Alfred, Lord Tennyson's narrative poem The Charge of the Light Brigade, published just six weeks after the event. The poem's lines emphasise the valour of the cavalry in bravely carrying out their orders, regardless of the nearly inevitable outcome.", "prediction 3": "The Charge of the Light Brigade was a charge of British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. British commander Lord Raglan had intended to send the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions, a task for which the light cavalry were well-suited. However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately.", "prediction 4": "The Charge of the Light Brigade was a charge of British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. British commander Lord Raglan had intended to send the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions, a task for which the light cavalry were well-suited. However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains. The events were the subject of Alfred, Lord Tennyson's narrative poem The Charge of the Light Brigade", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 359 }, { "error type": "Irrelevant", "explanation": "", "start": 360, "end": 578 }, { "error type": "Irrelevant", "explanation": "", "start": 579, "end": 803 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Charge of the Light Brigade was a British light cavalry charge, led by Lord Cardigan, against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The opposing Russian forces were commanded by Pavel Liprandi. Armand-Octave-Marie d\u2019Allonville was the commandant of the Chasseurs d'Afrique brigade during the Charge of the Light Brigade. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who is the guy at the end of matrix reloaded?", "passages": [ [ "The Matrix Reloaded", "The Matrix Reloaded\n\nThe Matrix Reloaded is a 2003 science fiction action film, the first sequel to \"The Matrix\", and the second installment in \"The Matrix\" trilogy, written and directed by The Wachowski Brothers.", "It premiered on May 7, 2003, in Westwood, Los Angeles, California, and went on general release by Warner Bros. in North American theaters on May 15, 2003, and around the world during the latter half of that month.", "It was also screened out of competition at the 2003 Cannes Film Festival.", "The video game \"Enter the Matrix\", which was released on May 15, and a collection of nine animated shorts, \"The Animatrix\", which was released on June 3, supported and expanded the storyline of the film.", "The film received generally positive reviews from critics and grossed $742.1 million worldwide.", "\"The Matrix Revolutions\", which completes the story, was released six months after \"Reloaded\", in November 2003.", "Six months after the events of the first film, Neo (Keanu Reeves) and Trinity (Carrie-Anne Moss) are now romantically involved.", "Morpheus (Laurence Fishburne) receives a message from Captain Niobe (Jada Pinkett Smith) of the \"Logos\" calling an emergency meeting of all of Zion's ships." ], [ "The Matrix Reloaded", "Its captain, Roland, reveals the other ships were wiped out by the machines after someone activated an EMP too early, and that they found only one survivor afterwards\u2014revealed to be the Smith-possessed Bane.", "Zee was originally played by Aaliyah, who died in a plane crash on August 25, 2001, before filming was complete, requiring her scenes to be reshot with actress Nona Gaye.", "\"The Matrix Reloaded\" was largely filmed at Fox Studios in Australia, filming began on March 1, 2001 and ended on August 21st, 2002, concurrently with filming of the sequel, \"Revolutions\".", "The freeway chase and \"Burly Brawl\" scenes were filmed at the decommissioned Naval Air Station Alameda in Alameda, California.", "The producers constructed a 1.5-mile freeway on the old runways specifically for the film.", "Some portions of the chase were also filmed in Oakland, California, and the tunnel shown briefly is the Webster Tube, which connects Oakland and Alameda.", "Some post-production editing was also done in old aircraft hangars on the base as well.", "The city of Akron, Ohio was willing to give full access to Route 59, the stretch of freeway known as the \"Innerbelt\", for filming of the freeway chase when it was under consideration." ], [ "The Matrix Reloaded", "Zion has confirmed the last transmission of the \"Osiris\": an army of Sentinels is tunneling towards Zion and will reach it within 72 hours.", "Commander Lock (Harry Lennix) orders all ships to return to Zion to prepare for the onslaught, but Morpheus asks one ship to remain in order to contact the Oracle (Gloria Foster).", "The \"Caduceus\" receives a message from the Oracle, and the \"Nebuchadnezzar\" ventures out so Neo can contact her.", "One of the \"Caduceus\" crew, Bane (Ian Bliss), encounters Agent Smith (Hugo Weaving), who absorbs his avatar whilst killing him in the process.", "Smith then uses this avatar to leave the Matrix, gaining control of Bane's real body.", "In Zion, Morpheus announces the news of the advancing machines to the people.", "Neo receives a message from the Oracle and returns to the Matrix to meet her bodyguard Seraph (Collin Chou), who then leads him to her.", "After realizing that the Oracle is part of the Matrix, Neo asks how he can trust her; she replies that it is his decision.", "The Oracle instructs Neo to reach the Source of the Matrix with the help of the Keymaker (Randall Duk Kim), a prisoner of the Merovingian (Lambert Wilson)." ] ], "gold": "The Matrix Reloaded is a 2003 American science fiction action film written and directed by the Wachowskis. It is a sequel to The Matrix (1999), and the second installment in The Matrix film series. The character at the end of the film was Zion dweller Bane, who was possessed by Agent Smith.", "prediction 1": "The Matrix Reloaded is a 2003 science fiction action film. It is the first sequel to the 2001 film The Matrix and is the second installment in The Matrix trilogy, written and directed by The Wachowski Brothers. The person at the end of the film is Agent Smith, played by Hugo Weaving, who absorbs his avatar whilst killing him in the process.", "prediction 2": "The Matrix Reloaded is a 2003 science fiction action film that aired on May 15, 2003, and was the first sequel to the 2001 film The Matrix and the second installment in The Matrix trilogy, written and directed by The Wachowski Brothers. The Man in the End is Roland, who reveals that the other ships were wiped out by the machines after someone activated an EMP too early, and that they found only one survivor afterwards\u2014revealed to be the Smith-possessed Bane. The Man in the end of the movie is played by Ia Liam, who controls the Matrix, while playing as the possessed Bane.", "prediction 3": "The Matrix Reloaded is a 2003 science fiction action film which was the first sequel to The Matrix and the second installment in The Matrix trilogy, written and directed by The Wachowski Brothers. In the film, the man at the end of the film is Agent Smith.", "prediction 4": "The Matrix Reloaded is a 2003 science fiction action film, the first sequel to The Matrix and the second installment in The Matrix trilogy, written and directed by The Wachowski Brothers. In the film, the main character, Morpheus, is played by Laurence Fishburne. The main character, Bane, is played by Ioan Bliss, and the main antagonist, Smith, is played by Hugo Weaving.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 211, "end": 260 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 342 } ], "missing-info": [], "corrected-prediction": "The Matrix Reloaded is a 2003 science fiction action film. It is the first sequel to the 2001 film The Matrix and is the second installment in The Matrix trilogy, written and directed by The Wachowski Brothers. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played the role of shakuni in mahabharat 2013?", "passages": [ [ "Mahabharat (2013 TV series)", "Writing for Rediff, Nishi Tiwari wrote that \"If it maintains the quality of writing and able actors who portray key characters, we may have another winner among us\".", "DNA praised the costumes, scenery, Krishna's flute theme which was given by Raj Mohan Sinha, and most of the CGI special effects, but said the story pace was too fast.", "Its premier had a viewership of approximately 8.4 million people.", "The show has become the highest rated weekday historical epic show in the last three years on Indian television.", "The viewership ratings of the week of 1 December 2013 reached 9,801 TVTs.", "The game of dice leading to Draupadi's 'cheer haran' took \"Mahabharat\" at its peak viewership(10TVTs.4 TVM) and helped the broadcasting channel Star Plus clock the highest GTVMs ever achieved by any channel in Indian Television History.", "It won the trophy for the Best Drama in Star Guild Awards 2013 as well as number of accolades in other award shows.", "It won the Indian Telly Awards for \"Actor in a Supporting Role (Drama)\" , given to Aham Sharma for his portrayal as Karna , and \"Actor in a Negative Role\" to Praneet Bhat in 2014 ." ], [ "Mahabharat (2013 film)", "Meena Iyer of The Times of India rated it three and half out of five, saying \"Amitabh Bachchan's bartitone is used for the stellar Bheeshma Pitamah.", "Although the Big B doesn't have muscular arms like his animated counterpart, their faces match.", "A superlative list of actors like Ajay Devgn (Arjun), Manoj Bajpayee (Yudhisthir), Sunny Deol (Bheem), Anil Kapoor (Karan), Jackie Shroff (Duryodhan), Anupam Kher (Shakuni) and Vidya Balan (Draupadi) have also infused life into the computer generated characters with their inimitable voices.\" and concluded, \"On the flip side, the animation effort itself is immature and several notches below those of Hollywood films.", "Yet the dub effort by the Bollywood superstars uplifts this epic, making it enjoyable.\"", "Deepanjana Pal of \"Firstpost\" said, \"The artwork in \"Mahabharat\" is appalling and the animation is worse.", "From the movements of the characters to the visual effects - like two arrows going at each other - it looks like a pirated and outdated version of MS Paint was used to create the film.\"" ], [ "Mahabharat (2013 TV series)", "Mahabharat (2013 TV series)\n\nMahabharat is an Indian historical series based on the ancient Indian Sanskrit epic \"Mahabharat\".", "It aired from 16 September 2013 to 16 August 2014 on Star Plus.", "The show will be re-aired on Star Bharat from 5 August 2018 every Sunday at 8pm IST because of its popularity.", "It was produced by Swastik Productions Pvt. Ltd starring Saurabh Raj Jain as Shri Krishna, Shaheer Sheikh as Arjun, Pooja Sharma as Draupadi, Aham Sharma as Karna, Arav Chowdhary as Bhishma, Arpit Ranka as Duryodhan\n\n\"Mahabharat\" presents the story of the throne of Hastinapur, the kingdom ruled by the Kuru clan where the Kauravs and the Pandavs brothers compete for rulership.", "Both Duryodhan and Yudhisthir claim to be first in line to inherit the throne.", "Duryodhan, younger than Yudhisthir, the eldest Pandav.", "Mahabharat; a story of love, hatred, philosophies, dread, regret, anger, justice, injustice, power, insecurities, support, betrayal.", "In a true sense, Mahabharat is a story of life." ] ], "gold": "Mahabharat is the name of both a film and tv show that came out in 2013. The role of Shakuni was played by Praneet Bhat in the tv show and by Anupam Kher in the film.", "prediction 1": "In the 2013 Indian television series Mahabharat, the character of Shakuni is played by Anupam Kher, while in the 2014 version, Shakuni is played by Praneet Bhat.", "prediction 2": "Mahabharat is an Indian historical drama television series based on the ancient Indian Sanskrit epic Mahabharat. It aired from 16 September 2013 to 16 August 2014 on Star Plus. Anupam Kher played the role of shakuni in the 2013 version.", "prediction 3": "Mahabharat is an Indian historical television series which aired on Star Plus from September 16, 2013 to August 16, 2014. Anupam Kher played the role of Shaku Niwas in the 2013 and 2014 seasons of the show.", "prediction 4": "In the Indian Sanskrit epic Mahabharat, the role of Shakuni is played by Anupam Kher. In the 2013 film version, Sanaya Sen played the role. The 2013 TV series was adapted for the screen by a local company, and was directed by Priyanka Ghosh. The 2013 adaptation was also adapted for the screen by Anupam Kher.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 161 } ], "missing-info": [], "corrected-prediction": "In the 2013 Indian television series Mahabharat, the character of Shakuni is played by Anupam Kher." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Samsung galaxy s7 when did it come out?", "passages": [ [ "Samsung Galaxy S7", "Samsung Galaxy S7\n\nSamsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active are Android smartphones manufactured and marketed by Samsung Electronics.", "The S7 series serves as the successor to the Galaxy S6, S6 Edge, S6 Edge+ and S6 Active released in 2015.", "The S7 and S7 Edge were officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016.", "The S7 Active was unveiled on 4 June 2016, and released on AT&T in the United States on 10 June 2016.", "The Galaxy S7 is an evolution of the prior year's model, with upgraded hardware, design refinements, and the restoration of features removed from the Galaxy S6, such as IP certification for water and dust resistance, as well as expandable storage.", "Succeeding the S6 and S6 Edge+, respectively, the S7 is produced in a standard model with a display size of as well as an Edge variant whose display is curved along the wide sides of the screen and also has a larger display.", "The S7 Active features a thicker more rugged frame and an increased battery capacity." ] ], "gold": "The Samsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active are Android-based smartphones manufactured, released and marketed by Samsung Electronics. The S7 series serves as the successor to the Galaxy S6, S6 Edge, S6 Edge+ and S6 Active released in 2015. The Galaxy S7 is an evolution of the prior year's model, with upgraded hardware, design refinements, and the restoration of features removed from the Galaxy S6, such as IP certification for water and dust resistance, as well as expandable storage with a MicroSD card. The Galaxy S7 Active was unveiled on June 4, 2016 and came out on June 10, 2016. The Galaxy S7 and S7 Edge were unveiled on February 21, 2016 and came out in Europe and North America on March 11, 2016.", "prediction 1": "The Samsung Galaxy S7 and Galaxy S7 Edge were officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016. The Samsung Galaxy S7 Active was unveiled on 4 June 2016, and released on AT&T in the United States on 10 June 2016.", "prediction 2": "The Samsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active are Android smartphones manufactured and marketed by Samsung Electronics. The Galaxy S7 is the successor to the Galaxy S6 and S6 Active, which were released in 2015. The Galaxy S7 was officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016. The Samsung Galaxy S7 Active was unveiled on 4 June 2016, and released on AT&T in the United States on 10 June 2016.", "prediction 3": "The Samsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active were announced on 11 March 2016 and released on AT&T in the United States on 10 June 2016. The S7 and S7 Edge were officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016. The S7 Active was unveiled on 4 June 2016, and released on AT&T in the United States on 10 June 2016.", "prediction 4": "Samsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active are Android smartphones manufactured and marketed by Samsung Electronics. The Galaxy S7 series serves as the successor to the Galaxy S6, S6 Edge, S6 Edge+ and S6 Active released in 2015. The Galaxy S7 and S7 Edge were officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016. The Galaxy S7 Active was unveiled on 4 June 2016, and released on AT&T in the United States on 10 June 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 323 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Samsung Galaxy S7, Samsung Galaxy S7 Edge and Samsung Galaxy S7 Active are Android-based smartphones manufactured, released and marketed by Samsung Electronics. The S7 series serves as the successor to the Galaxy S6, S6 Edge, S6 Edge+ and S6 Active released in 2015. The Galaxy S7 is an evolution of the prior year's model, with upgraded hardware, design refinements, and the restoration of features removed from the Galaxy S6, such as IP certification for water and dust resistance, as well as expandable storage. The Samsung Galaxy S7 and Galaxy S7 Edge were officially unveiled on 21 February 2016 during a Samsung press conference at Mobile World Congress, with a European and North American release on 11 March 2016. " }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who sang the national anthem at the superbowl?", "passages": [ [ "Super Bowl LI", "The Falcons took the field second as the designated home team to Trick Daddy's \"Let's Go\".", "Both teams' season recaps were presented by Ving Rhames.", "Before the game, American country music singer and songwriter Luke Bryan sang the US national anthem.", "Bryan was the first male performer to sing the national anthem at a Super Bowl since Billy Joel at Super Bowl XLI.", "Immediately before Bryan sang the national anthem, Phillipa Soo, Ren\u00e9e Elise Goldsberry and Jasmine Cephas Jones, who originated the roles of the Schuyler sisters in the Broadway musical \"Hamilton\", performed \"America the Beautiful\".", "After the national anthem, former President George H. W. Bush performed the coin toss alongside his wife, Barbara.", "The Patriots called heads, but the Falcons won the coin toss with tails.", "The Falcons chose to defer to the second half.", "On September 29, 2016, Lady Gaga, who had performed the national anthem the previous year at Super Bowl 50, confirmed that she would be performing at the Super Bowl LI halftime show on her Instagram account with the message: \"It's not an illusion.", "The rumors are true.", "This year the SUPER BOWL goes GAGA!\"" ], [ "Super Bowl XLI", "The Super Bowl was broadcast live in Canada on CBS (which is available in Canada) as well as Global TV and NTV which both took the main CBS commentary, and on the French cable channel RDS.", "In the United Kingdom the Super Bowl was broadcast on ITV1, Sky Sports 1 & Sky Sports HD1 with Sky Sports taking the main CBS commentary and ITV taking the NFL supplied international commentary feed of Spero Dedes and Sterling Sharpe.", "Super Bowl XLI was broadcast in over 200 countries.", "Amongst the television networks who broadcast Super Bowl XLI were:\n\nBefore the game, Cirque du Soleil, Romero Britto and Little Louie Vega performed as the pre-game act, and Billy Joel sang the National Anthem, accompanying himself on piano.", "He also performed at Super Bowl XXIII, which was played at the same venue.", "Joel became the second person to sing the National Anthem twice for a Super Bowl; Aaron Neville sang the national anthem before Super Bowl XXIV, in New Orleans, and Super Bowl XL (along with Aretha Franklin), in Detroit.", "This was also the last time until Luke Bryan sang at Super Bowl LI that a male artist had sung the national anthem at a Super Bowl.", "Marlee Matlin and Jason Hay-Southwell performed the National Anthem in American Sign Language." ], [ "Super Bowl LII", "Produced by Jimmy Jam and Terry Lewis, \"Super Bowl Live\" also included performances by Idina Menzel, Soul Asylum, the Suburbs, Bob Mould, Sounds of Blackness, Dessa, VocalEssence, Mint Condition, and the Jets.", "In addition to the concert series, \"Super Bowl Live\" featured a American Birkebeiner International Bridge on Nicollet Mall to showcase cross-country skiing, skijoring, fat-tire bicycle racing, and snow tubing demonstrations.", "There was also a snowmobile stunt show on February 3.", "The NFL presented the \"Super Bowl Experience\" at the Minneapolis Convention Center from January 27 to February 3 with an entrance fee.", "Kelly Clarkson performed at the Minneapolis Armory and a U.S. Bank Stadium lounge on the day of the Super Bowl.", "The Minneapolis Armory also hosted Jennifer Lopez, Imagine Dragons, and Pink concerts close to U.S. Bank Stadium.", "Pink also performed the national anthem before the Super Bowl.", "Halftime performer Justin Timberlake held a ticketed \"listening session\" of his newest album at Prince's Paisley Park.", "Dave Matthews Band performed at Xcel Energy Center in Saint Paul.", "The Shakopee Mdewakanton Sioux Community's Mystic Lake Casino hosted Gwen Stefani, the Chainsmokers, Florida Georgia Line, and Kygo." ] ], "gold": "The U.S. national anthem has been performed at all but one Super Bowl since its first year in 1967; Vikki Carr sang America the Beautiful in place of the anthem at Super Bowl XI in 1977. Since Super Bowl XVI in 1982, famous singers or music groups have performed the anthem at the vast majority of Super Bowl games. Idina Menzel sang the national anthem at the 2015 Super Bowl, Lady Gaga sang the national anthem at the 2016 Super Bowl, and Luke Bryan sang the national anthem at the 2017 Super Bowl.", "prediction 1": "The national anthem for the Super Bowl was sung by several different singers. Before the game, country music singer and songwriter Luke Bryan sang the US national anthem. Bryan was the first male performer to sing the national anthem at a Super Bowl since Billy Joel at Super Bowl XLI. After the national anthem, former President George H. W. Bush performed the coin toss alongside his wife, Barbara.", "prediction 2": "Before the game, American country music singer and songwriter Luke Bryan sang the US national anthem. Bryan was the first male performer to sing the national anthem at a Super Bowl since Billy Joel at Super Bowl XLI. Immediately before Bryan sang the national anthem, Phillipa Soo, Ren\u00e9e Elise Goldsberry and Jasmine Cephas Jones, who originated the roles of the Schuyler sisters in the Broadway musical Hamilton, performed \"America the Beautiful\". After the national anthem, former President George H. W. Bush performed the coin tossssssssssss, Barbara. The Patriots won the coin tos, but the Falcons lost the Super Bowl to the 76.", "prediction 3": "Before the game, American country music singer and songwriter Luke Bryan sang the US national anthem. Bryan was the first male performer to sing the national anthem at a Super Bowl since Billy Joel at Super Bowl XLI. Immediately before Bryan sang the national anthem, Phillipa Soo, Ren\u00e9e Elise Goldsberry and Jasmine Cephas Jones, who originated the roles of the Schuyler sisters in the Broadway musical \"Hamilton\", performed \"America the Beautiful.\" After the national anthem, former President George H. W. W. Bush performed the coin tossssssssssss and Barbara called heads, but the Falcons won the coin tos. The Patriots called heads.", "prediction 4": "Before the game, American country music singer and songwriter Luke Bryan sang the US national anthem. Bryan was the first male performer to sing the national anthem at a Super Bowl since Billy Joel at Super Bowl XLI. Immediately before Bryan sang the national anthem, Phillipa Soo, Ren\u00e9e Elise Goldsberry and Jasmine Cephas Jones, who originated the roles of the Schuyler sisters in the Broadway musical Hamilton, performed \"America the Beautiful\". After the national anthem, former President George H. W. Bush performed the coin tossssssssset and the Patriots. The Falcons won the coin tos. The Falcons won the coin tos.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 255 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The national anthem for the Super Bowl was sung by several different singers. In 2017, Before the game, country music singer and songwriter Luke Bryan sang the US national anthem. Lady Gaga, had performed the national anthem the previous year. Billy Joel sang at Super Bowl XLI and Super Bowl XXIII. Aaron Neville sang the national anthem before Super Bowl XXIV and Super Bowl XL (along with Aretha Franklin). Pink also performed the national anthem before the Super Bowl LII." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Where is game 7 of the world series going to be held?", "passages": [ [ "2017 World Series", "This was the first World Series Game 7 to be played at Dodger Stadium (and the first postseason Game 7 of any postseason series at the stadium since the 1988 NLCS, and the Dodgers' first World Series Game 7 since 1965 against the Minnesota Twins).", "It was also the first time since the 1931 World Series that a Game 7 occurred in a Series with both teams having won at least 100 games during the season.", "Besides, this was the first time since the 2001 World Series and 2002 World Series that back-to-back Fall Classics had a Game 7.", "The starting pitchers for this game were the same as in the third game: McCullers and Darvish.", "Springer doubled to open the game and scored the first run on an error by Bellinger, which allowed Bregman to reach second base.", "Bregman stole third base and scored on an Altuve groundout.", "McCann scored the next inning on a groundout hit by the pitcher McCullers.", "Springer hit a two-run home run, his fifth of the series, tying Reggie Jackson and Chase Utley for most home runs in a single World Series and setting a new record with 29 total bases in any postseason series." ], [ "Dodger Stadium", "Dodger Stadium\n\nDodger Stadium, occasionally called by the metonym Chavez Ravine, is a baseball park located in the Elysian Park neighborhood of Los Angeles, California, the home field to the Los Angeles Dodgers, the city's National League franchise of Major League Baseball (MLB).", "Opened on April 10, 1962, it was constructed in less than three years at a cost of US$23 million, financed by private sources.", "Dodger Stadium is currently the oldest ballpark in MLB west of the Mississippi River, and third-oldest overall, after Fenway Park in Boston (1912) and Wrigley Field in Chicago (1914) and is the world's largest baseball stadium by seat capacity.", "Often referred to as a \"pitcher's ballpark\", the stadium has seen twelve no-hitters, two of which were perfect games.", "The stadium hosted the Major League Baseball All-Star Game in 1980 - and will host in 2020 - as well as games of 10 World Series (1963, 1965, 1966, 1974, 1977, 1978, 1981, 1988, 2017, and 2018).", "It also hosted the semifinals and finals of the 2009 and 2017 World Baseball Classics.", "It also hosted exhibition baseball during the 1984 Summer Olympics.", "It will also host baseball and softball during the 2028 Summer Olympics." ], [ "Progressive Field", "Progressive Field\n\nProgressive Field is a baseball park located in the downtown area of Cleveland, Ohio, United States.", "It is the home field of the Cleveland Indians of Major League Baseball and, together with Quicken Loans Arena, is part of the Gateway Sports and Entertainment Complex.", "It was ranked as Major League Baseball's best ballpark in a 2008 \"Sports Illustrated\" fan opinion poll.", "The ballpark opened as Jacobs Field in 1994 to replace Cleveland Stadium, which the team had shared with the Cleveland Browns of the National Football League.", "Since 2008, the facility has been named for Progressive Corporation, based in the Cleveland suburb of Mayfield, which purchased naming rights for $58 million over 16 years.", "The previous name came from team owners Richard and David Jacobs, who had acquired naming rights when the facility opened.", "The ballpark is still often referred to as \"The Jake\", based on its original name.", "When it opened, the listed seating capacity was 42,865 people and between 1995 and 2001 the team sold out 455 consecutive regular-season games.", "Modifications over the years resulted in several moderate changes to the capacity, peaking at 45,569 in 2010.", "After the 2014 and 2015 seasons, the facility was renovated in two phases, which upgraded and reconfigured several areas of the park and reduced seating capacity." ] ], "gold": "Game 7 of the World Series has been held in different locations. Game 7 of the 2016 World Series was held in Progressive Field, which is located in the downtown area of Cleveland, OH, United States. Game 7 of the 2017 World Series was held in Dodger Stadium. Dodger Stadium is a baseball park in the Elysian Park neighborhood of Los Angeles, CA.", "prediction 1": "Game 7 of the 2017 World Series was played at Dodger Stadium. This was the first World Series Game 7 to be played at Dodger Stadium. Progressive Field was also the site of Game 7 of the 2017 World Series.", "prediction 2": "There are several World Series Game 7s, each with its own unique atmosphere and atmosphere. In the 2017 World Series, the first World Series Game 7 was played at Dodger Stadium. In the 2017 World Series, the second World Series Game 7 was held at the Progressive Field.", "prediction 3": "Game 7 of the World Series is played on February 11, 2018. Game 7 of the World Series is played on February 11, 2018. Game 7 of the World Series is played on February 13, 2020 at Progressive Field in Cleveland, Ohio. Game 7 of the World Series is played on February 14, 2021 at Progressive Field, a baseball park located in the downtown area of Cleveland, Ohio, United States.", "prediction 4": "Game 7 of the World Series is traditionally played at Progressive Field, which is a baseball park located in the downtown area of Cleveland, Ohio. In 2017, the Dodgers took on the Minnesota Twins at Dodger Stadium. In 2018, the Twins took on the Milwaukee Brewers at Safeco Field, a baseball park located in the suburbs of Milwaukee. The 2017 World Series Game 7 was played at Progressive Field.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 132 }, { "error type": "Unverifiable", "explanation": "", "start": 133, "end": 204 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Game 7 of the 2017 World Series was played at Dodger Stadium. Dodger Stadium is a baseball park located in the Elysian Park neighborhood of Los Angeles, California." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Poems of the past and present thomas hardy?", "passages": [ [ "Poems of the Past and the Present", "Poems of the Past and the Present\n\nPoems of the Past and the Present is the second collection of poems by English poet Thomas Hardy, and was published in 1901.", "A wide-ranging collection, divided into five headings, it contains some of Hardy's most powerful and lasting poetic contributions.", "The unusually favourable reception of the collection was due in large part to its opening with the section of 'War Poems', many previously published independently, and welcomed by the public for their treatment of the Boer War - the seminal \"Drummer Hodge\" being the outstanding example.", "Hardy's friend Sir George Douglas called some of the collection's poems Aeschylean, and Hardy himself considered that the 'Doom' themes in the work overlapped with those in \"The Dynasts\".", "However, he had been careful in the collection's Preface to disclaim any organised philosophy therein, adding that \"Unadjusted impressions have their value...\"\n\nAmong other notable pieces were his poem 'Well-beloved', on the transient succession of a man's love-ideal; and \"The Darkling Thrush\", the humorous piece \"The Ruined Maid\", and the dour sequence \"In Tenebris\"." ] ], "gold": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy, and was published in 1901.", "prediction 1": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy, and was published in 1901. A wide-ranging collection, divided into five headings, it contains some of Hardy's most powerful and lasting poetic contributions.", "prediction 2": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy, and was published in 1901. A wide-ranging collection, divided into five headings, it contains some of Hardy's most powerful and lasting poetic contributions. The unusually favourable reception was due in large part to its opening with the section of 'War Poems', many previously published independently, and welcomed by the public for their treatment of the Boer War - the seminal \"Drummer Hodge\" being the outstanding example of his work.", "prediction 3": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy. It was published in 1901.", "prediction 4": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy and was published in 1901. The collection contains some of Hardy's most powerful and lasting poetic contributions. Hardy himself considered that the 'Doom' themes in the work overlapped with those in \"The Dynasts\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 255 } ], "missing-info": [], "corrected-prediction": "Poems of the Past and the Present is the second collection of poems by English poet Thomas Hardy, and was published in 1901. " }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Mayday parade three cheers for five years album?", "passages": [ [ "A Lesson in Romantics", "\"A Lesson in Romantics\" debuted at number 8 on the \"Billboard\" Heatseekers Albums chart, staying on the chart for six weeks.", "The album finally dropped off on the chart dated March 1, 2008 before eventually returning on the chart on July 12.", "It stayed on the chart for 70 consecutive weeks.", "The album also charted on the Independent Albums chart, peaking at number 31.", "In January 2009, it was announced that the album had sold over 100,000 copies.", "The album would later become the band's biggest selling album, selling over 200,000 copies.", "\"A Lesson in Romantics\" and \"Miserable at Best\" were certified gold by the Recording Industry Association of America in December 2017.", "idobi Radio included the album on their best of 2007 list.", "\"When I Get Home, You're So Dead\" was ranked at number 194 on the \"New York Post\"s", "2007 list of best songs to download.", "In 2008, the music video for \"When I Get Home, You're So Dead\" was nominated at the MTV Video Music Awards for Best Rock Video and Video of the Year.", "The album was number 42 on \"Rock Sound\"s The 51 Most Essential Pop Punk Albums of All Time list.", "All songs written by Mayday Parade.", "Personnel per 2008 reissue booklet.", "Mayday Parade\n\nAdditional musicians\n\nProduction\n\nFootnotes\nCitations\nBibliography" ], [ "Mayday Parade", "Mayday Parade\n\nMayday Parade is an American rock band from Tallahassee, Florida.", "Their debut EP \"Tales Told by Dead Friends\" was released in 2006, and sold over 50,000 copies without any label support.", "In July 2007, Mayday Parade released their debut album \"A Lesson in Romantics\".", "After signing to Fearless in 2006, the band also signed onto a major label with Atlantic in 2009.", "Their second studio album, \"Anywhere but Here\" was released in October 2009 and their third album, entitled \"Mayday Parade\", was released in October 2011.", "Mayday Parade's fourth album, titled \"Monsters in the Closet\", was released in October 2013.", "Their fifth album, titled \"Black Lines\", was released October 2015.", "In April 2018, the band signed to Rise Records and released their sixth studio album \"Sunnyland\" on June 15, 2018.", "Mayday Parade was formed in the winter of 2005 following the merger of two local Tallahassee bands, Kid Named Chicago and Defining Moment.", "Kid Named Chicago featured vocalist/guitarist Jason Lancaster, guitarist Alex Garcia and drummer Jake Bundrick, while Defining Moment featured vocalist Derek Sanders, guitarist Brooks Betts, and bassist Jeremy Lenzo.", "Both bands previously practiced in the same building, before it occurred to Lenzo that it \"made more sense if we put them together instead of playing separately.\"" ], [ "Mayday Parade", "Following this, a 10th anniversary edition of \"A Lesson in Romantics\" was released in March 2017, featuring demos.", "Producer Kenneth Mount criticized the band on Twitter for not giving Lancaster credit in commentary, \"I'm slightly confused why mayday parades commentary for lesson in romantics never mentions Jason Lancaster at all, voice of 50% of the album...", "Jason also recorded all his vocals naked for a lesson in romantics, that should totally make the commentary.", "I've waited ten years for that\".", "In April 2018, the band announced that they had signed to Rise Records and began teasing the release of their sixth studio album.", "In their announcement, the band said, \u201cRise has done a fantastic job with their projects, and it\u2019s clear that they are passionate about the music they help put out into the world.", "We appreciate the fact that they believe in our band still after all these years and we are so excited for everyone to hear what we\u2019ve been working on.\u201d", "On May 3, the band released \"Piece of Your Heart\" as the lead single from \"Sunnyland.\"", "The full album \"Sunnyland\" released on June 15, 2018.", "Mayday Parade's musical style has been described as pop punk, pop rock, alternative rock, emo pop, emo, and rock.", "\"A Lesson in Romantics\" has been described as pop punk." ] ], "gold": "American rock band Mayday Parade originally released the song \"Three Cheers for Five Years\" on their 2006 debut EP, Tales Told by Dead Friends. An acoustic version of the song was also included in the 2008 reissue of the group's debut studio album, A Lesson In Romantics. The acoustic version was also featured in the 2007 multi-artist compilation album Punk Goes Acoustic 2.", "prediction 1": "Mayday Parade is an American rock band from Tallahassee, Florida. Their debut album A Lesson in Romantics debuted at number 8 on the Billboard Heatseekers Albums chart, staying on the chart for six weeks. The album finally dropped off on the chart dated March 1, 2008 before eventually returning on the chart on July 12. It stayed on the chart for 70 consecutive weeks.", "prediction 2": "The band Mayday Parade was formed in the winter of 2005 following the merger of two local Tallahassee bands, Kid Named Chicago and Defining Moment. In July 2007, Mayday Parade released their debut album A Lesson in Romantics. After signing to Fearless in 2006, the band also signed onto a major label with Atlantic in 2009. It also charted on the Independent Albums chart, peaking at number 31. In April 2018, the band signed to Rise Records and released their sixth studio album Sunnyland on June 15, 2018.", "prediction 3": "The American rock band Mayday Parade's debut album A Lesson in Romantics was released in July 2007. The band's second studio album, Anywhere but Here, was released in October 2009 and their third album, entitled Mayday Parade, was released in October 2011. In April 2018, the band signed to Rise Records and began teasing the release of their sixth studio album Sunnyland on June 15, 2018.", "prediction 4": "Mayday Parade is an American rock band from Tallahassee, Florida. Their debut album A Lesson in Romantics debuted at number 8 on the Billboard Heatseekers Albums chart, staying on the chart for six weeks. The album finally dropped off on the chart on March 1, 2008 before eventually returning on the chart on July 12. The album would later become the band's biggest selling album, selling over 200,000 copies. In April 2018, the band signed to Rise Records and released their sixth studio album Sunnyland on June 15, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 205, "end": 320 }, { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 369 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 14 ] } ], "corrected-prediction": "Mayday Parade is an American rock band. Their debut EP \"Tales Told by Dead Friends\" was released in 2006. Their debut album A Lesson in Romantics was a 2008 reissue. " }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who wrote there is a season turn turn turn?", "passages": [ [ "Turn! Turn! Turn!", "Ecclesiastes is traditionally ascribed to King Solomon who would have written it in the 10th century BC, but believed by a significant group of biblical scholars to date much later, up to the third century BC.", "The Biblical text posits there being a time and place for all things: laughter and sorrow, healing and killing, war and peace, and so on.", "The lines are open to myriad interpretations, but Seeger's song presents them as a plea for world peace because of the closing line: \"a time for peace, I swear it's not too late.\"", "This line and the title phrase \"Turn!", "Turn!", "Turn!\"", "are the only parts of the lyric written by Seeger himself.", "The song is notable for being one of a few instances in popular music in which a large portion of the Bible is set to music, other examples being the Melodians' \"Rivers of Babylon\", Sister Janet Mead's \"The Lord's Prayer\", U2's \"40\", Sinead O'Connor's \"Psalm 33\" and Cliff Richard's \"The Millennium Prayer\".", "The song was published in illustrated book form by Simon & Schuster in September 2003, with an accompanying CD which contained both Seeger and the Byrds recordings of the song ()." ], [ "Turn! Turn! Turn!", "Turn!", "Turn!", "Turn!", "\"Turn!", "Turn!", "Turn!", "\", sometimes known as \"Turn!", "Turn!", "Turn!", "(To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s.", "The lyrics, except for the title, which is repeated throughout the song, and the final two lines, are adapted word-for-word from an English version of the first eight verses of the third chapter of the biblical Book of Ecclesiastes.", "The song was originally released in 1962 as \"To Everything There Is a Season\" on folk group the Limeliters' RCA album \"Folk Matinee\" and then some months later on Seeger's own \"The Bitter and the Sweet\".", "The song became an international hit in late 1965 when it was adapted by the American folk rock group the Byrds.", "The single entered the record chart at number 80 on October 23, 1965, before reaching number one on the \"Billboard\" Hot 100 chart on December 4, 1965.", "In Canada, it reached number three on Nov. 29, 1965, and also peaking at number 26 on the UK Singles Chart.", "The lyrics are taken almost verbatim from the book of Ecclesiastes, as found in the King James Version (1611) of the Bible (), though the sequence of the words was rearranged for the song." ] ], "gold": "\"Turn! Turn! Turn!\", or \"Turn! Turn! Turn! (To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s and first recorded in 1959. The lyrics are taken almost verbatim from the book of Ecclesiastes, as found in the King James Version of the Bible, (Ecclesiastes 3:1-8) though the sequence of the words was rearranged for the song. Ecclesiastes is traditionally ascribed to King Solomon who would have written it in the 10th century BC, but believed by a significant group of biblical scholars to date much later, up to the third century BC.", "prediction 1": "\"Turn! Turn! Turn! \", sometimes known as \"Turn! Turn! Turn! (To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s. The lyrics, except for the title, which is repeated throughout the song, and the final two lines, are adapted word-for-word from an English version of the first eight verses of the third chapter of the biblical Book of Ecclesiastes. The song was originally released in 1962 as \"Turn!\"", "prediction 2": "Turn! Turn! Turn!, sometimes known as \"Turn! Turn! Turn! (To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s. The words \"Turn! Turn! Turn! \", apart from the title, which is repeated throughout the song, and the final two lines, are adapted word-for-word from an English version of the first eight verses of the third chapter of the biblical Book of Ecclesiastes. The lyrics are taken almost verbatim from the book of Ecclesiastesiastes, as found in the King James Version (1611).", "prediction 3": "The Book of Ecclesiastes is traditionally attributed to King Solomon, who would have written it in the 10th century BC, but believed by a significant group of biblical scholars to date much later, up to the third century BC. The words Turn! Turn! Turn!, sometimes known as \"To Everything There Is a Season\", were written by Pete Seeger in the late 1950s and became an international hit in 1965 when it was adapted by the American folk rock group the Byrds. Seeger's house band The Byrds performed the song during its debut in 1999.", "prediction 4": "\"Turn! Turn! Turn! \", sometimes known as \"Turn! Turn! Turn! (To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s. The lyrics, except for the title, which is repeated throughout the song, and the final two lines, are adapted word-for-word from an English version of the first eight verses of the third chapter of the biblical Book of Ecclesiastes. The first verses are taken from King Solomon's Ecclesia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 432 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 16 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Turn! Turn! Turn! \", sometimes known as \"Turn! Turn! Turn! (To Everything There Is a Season)\", is a song written by Pete Seeger in the late 1950s. The lyrics are adapted word-for-word from an English version of the first eight verses of the third chapter of the biblical Book of Ecclesiastes, as found in the King James Version (1611) of the Bible. Ecclesiastes is traditionally ascribed to King Solomon who would have written it in the 10th century BC, but believed by a significant group of biblical scholars to date much later, up to the third century BC." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does mary go to scotland in reign?", "passages": [ [ "Mary of Guelders", "Mary of Guelders\n\nMary of Guelders (; c. 1434 \u2013 1 December 1463) was the queen consort of Scotland by marriage to King James II of Scotland.", "She served as regent of Scotland from 1460 to 1463.", "She was the daughter of Arnold, Duke of Guelders, and Catherine of Cleves.", "She was a great-niece of Philip the Good, Duke of Burgundy.", "Philip and his wife Isabella of Portugal at first planned to have Mary betrothed to Charles, Count of Maine, but her father could not pay the dowry.", "Mary stayed on at the Burgundian court, where Isabella frequently paid for her expenses.", "Mary attended Isabella's daughter-in-law Catherine of France, while she herself was attended upon by ten people.", "The duke and duchess then started negotiations for a Scottish marriage.", "Philip promised to pay her dowry, while Isabella paid for her trousseau.", "William Crichton came to the Burgundian court to escort her back to Scotland.", "Mary landed in Scotland in June 1449 and both nobles and the common people came to see her as she made her way to Holyrood Abbey in Edinburgh.", "Mary married James II, King of Scots, at Holyrood Abbey on 3 July 1449.", "A sumptuous banquet was given, while the Scottish king gave her several presents." ], [ "Mary, Queen of Scots", "Mary, Queen of Scots\n\nMary, Queen of Scots (8 December 1542 \u2013 8 February 1587), also known as Mary Stuart or Mary I of Scotland, reigned over Scotland from 14\u00a0December 1542 to 24 July 1567.", "Mary, the only surviving legitimate child of King James V, was six days old when her father died and she acceded to the throne.", "She spent most of her childhood in France while Scotland was ruled by regents, and in 1558, she married the Dauphin of France, Francis.", "He ascended the French throne as King Francis II in 1559, and Mary briefly became queen consort of France, until his death in December 1560.", "Widowed, Mary returned to Scotland, arriving in Leith on 19 August 1561.", "Four years later, she married her first cousin, Henry Stuart, Lord Darnley and in June 1566 they had a son, James.", "In February 1567, Darnley's residence was destroyed by an explosion, and he was found murdered in the garden.", "James Hepburn, 4th Earl of Bothwell, was generally believed to have orchestrated Darnley's death, but he was acquitted of the charge in April 1567, and the following month he married Mary.", "Following an uprising against the couple, Mary was imprisoned in Loch Leven Castle." ] ], "gold": "Mary goes to Scotland in Reign in episode 59 of the entire series. By season, it was season 3 episode 15.", "prediction 1": "Mary Stuart, known as Mary I of Scotland, reigned over Scotland from 14 December 1542 to 24 July 1567. Mary, the only surviving legitimate child of King James V, was six days old when her father died. Mary spent most of her childhood in France while Scotland was ruled by regents.", "prediction 2": "Mary, Queen of Scots, also known as Mary Stuart or Mary I of Scotland, reigned over Scotland from 14 December 1542 to 24 July 1567.", "prediction 3": "Mary, Queen of Scots, also known as Mary Stuart or Mary I of Scotland, reigned over Scotland from 14 December 1542 to 24 July 1567. Mary landed in Scotland in June 1449 and both nobles and the common people came to see her as she made her way to Holyrood Abbey in Edinburgh.", "prediction 4": "Mary, Queen of Scots, reigned over Scotland from 14 December 1542 to 24 July 1567, also known as Mary Stuart or Mary I of Scotland, and was a regent of Scotland from 1460 to 1463. Mary's regency was in Scotland between 1660 and 1663, and her reign lasted for 16 years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 200 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 280 } ], "missing-info": [], "corrected-prediction": "Mary Stuart, known as Mary I of Scotland, reigned over Scotland from 14 December 1542 to 24 July 1567. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did they start the 3 point shot in basketball?", "passages": [ [ "Three-point field goal", "During the 1970s, the ABA used the three-point shot, along with the slam dunk, as a marketing tool to compete with the NBA; its ninth and final season concluded in the spring \nThree years later in June 1979, the NBA adopted the three-point line for a one-year trial for the despite the view of many that it was a gimmick.", "Chris Ford of the Boston Celtics is widely credited with making the first three-point shot in NBA history on October 12, 1979; the season opener at Boston Garden was more noted for the debut of Larry Bird (and two new Rick Barry of the Houston Rockets, in his final season, also made one in the same game, and Kevin Grevey of the Washington Bullets made one that Friday night \n\n", "The sport's international governing body, FIBA, introduced the three-point line in 1984, and it made its Olympic debut in 1988 in Seoul, South Korea.", "The NCAA's Southern Conference became the first collegiate conference to use the three-point rule, adopting a line for the 1980\u201381 season.", "Ronnie Carr of Western Carolina was the first to score a three-point field goal in college basketball history on November 29, 1980.", "Over the following five years, NCAA conferences differed in their use of the rule and distance required for a three-pointer." ], [ "Three-point field goal", "The line was as close as in the Atlantic Coast Conference (ACC), and as far away as in the \n\nUsed only in conference play for several years, it was adopted by the NCAA in April 1986 for the 1986\u201387 season at and was first used in the NCAA Tournament in March 1987.", "The NCAA adopted the three-pointer in women's basketball on an experimental basis for that season at the same distance, and made its use mandatory beginning In 2007, the NCAA lengthened the men's distance by a foot to , effective with the season, and the women's line was moved to match the men's in 2011\u201312.", "American high schools, along with elementary and middle schools, adopted a line nationally in 1987, a year after the NCAA.", "The NCAA used the FIBA three-point line (see below) in the National Invitation Tournament (NIT) \n\n", "For three seasons beginning in 1994\u201395, the NBA attempted to address decreased scoring by shortening the distance of the line from ( at the corners) to a uniform around the basket.", "From the 1997\u201398 season on, the NBA reverted the line to its original distance of ( at the corners, with a 3-inch differential).", "Ray Allen is currently the NBA all-time leader in career made three-pointers with 2,973." ], [ "Three-point field goal", "The three-point line was first tested at the collegiate level in 1945, with a 21-foot line, in a game between Columbia and Fordham, but it was not kept as a rule.", "There was another one-game experiment in 1958, this time with a 23-foot line, in a game between St. Francis (N.Y.) and Siena.", "In 1961, Boston University and Dartmouth played one game with an experimental rule that counted all field goals as three points.", "At the direction of Abe Saperstein, the American Basketball League became the first basketball league to institute the rule in 1961.", "Its three-point line was a radius of from the baskets, except along the sides.", "The Eastern Professional Basketball League followed in its 1963\u201364 season.", "The three-point shot later became popularized by the American Basketball Association (ABA), introduced in its inaugural 1967\u201368 ABA commissioner George Mikan stated the three-pointer \"would give the smaller player a chance to score and open up the defense to make the game more enjoyable for the fans.\"" ] ], "gold": " They experimented with the three point in 1945. It was not officially used until 1961 in the ABL, June 1979 in the NBA, April 1986 in the NCAA, and 1988 in the Olympics.", "prediction 1": "The three-point shot in basketball is a contested shot with many facets. In the early 1960s, the three-point line was first tested at the collegiate level in 1945, with a 21-foot line, in a game between Columbia and Fordham, but it was not kept as a rule. In 1961, Boston University and Dartmouth played one game with an experimental rule that counted all field goals as three points. The sport's international governing body, FIBA, introduced the three-point line in 1984, and it made its Olympic debut in 1988 in Seoul, South Korea.", "prediction 2": "In basketball, the three-point shot is a three-pointer that is scored from three different locations. The three-point line was first tested at the collegiate level in 1945, with a 21-foot line, in a game between Columbia and Fordham, but it was not kept as a rule. The sport's international governing body, FIBA, introduced the three-point line in 1984, and it made its Olympic debut in 1988 in Seoul, South Korea. The NCAA adopted the three-point shot in women's basketball in April 1986, and was first used in the NCAA Tournament in March 1987.", "prediction 3": "The three-point shot in basketball was first tested at the collegiate level in 1945, with a 21-foot line, in a game between Columbia and Fordham, but it was not kept as a rule. The sport's international governing body, FIBA, introduced the three-point line in 1984, and it made its Olympic debut in 1988 in Seoul, South Korea. The NCAA's Southern Conference became the first collegiate conference to use the three-point rule, adopting a line for the 1980\u201381 season at and was first used in the NCAA Tournament in March 1987. American high schools, along with elementary and middle schools, adopted a line nationally in 1987, a year after the NCAA.", "prediction 4": "The sport's international governing body, FIBA, introduced the three-point line in 1984, and it made its Olympic debut in 1988 in Seoul, South Korea. The three-point shot was first tested at the collegiate level in 1945, with a 21-foot line, in a game between Columbia and Fordham, but it was not kept as a rule. The American Basketball League became the first basketball league to institute the rule in 1961.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 72 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 73, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 384 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 534 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The three-point line was first tested at the collegiate level in 1945. The American Basketball League became the first basketball league to institute the rule in 1961. In June 1979, the NBA adopted the three-point line for a one-year trial. The three-point shot was adopted by the NCAA in April 1986 and and it made its Olympic debut in 1988. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the land before time come out?", "passages": [ [ "The Land Before Time", "This is the only Don Bluth film of the 1980s in which Dom DeLuise did not participate (instead, he starred in Disney's \"Oliver & Company\" that same year), and the only film in \"The Land Before Time\" series that is not a musical, as well as the only one to be released theatrically worldwide.", "Released by Universal Pictures on November 18, 1988, the film spawned a franchise with thirteen direct-to-video sequels and a television series as well as merchandise.", "During the age of the dinosaurs, a massive famine forces several herds of dinosaurs to seek an oasis known as the Great Valley.", "Among these, a mother in a diminished \"Longneck\" herd gives birth to a single baby, named Littlefoot.", "Years later, Littlefoot plays with Cera, a \"Three-horn\", until her father intervenes, whereupon Littlefoot's mother describes the different kinds of dinosaurs: \"Three-horns\", \"Spiketails\", \"Swimmers\", and \"Flyers\".", "That night, as Littlefoot follows a \"Hopper\", he encounters Cera again, and they play together briefly until a large \"Sharptooth\" attacks them.", "Littlefoot's mother comes to their rescue, but receives fatal injuries in the process.", "An earthquake swallows up the Sharptooth and divides Littlefoot and Cera from their herds." ] ], "gold": "The Land Before Time came out in the US on November 18, 1988, and in the UK on December 1, 1988.", "prediction 1": "The Land Before Time came out on November 18, 1988 and was released theatrically worldwide. The film spawned a franchise with thirteen direct-to-video sequels and a television series as well as merchandise.", "prediction 2": "Released by Universal Pictures on November 18, 1988, the film spawned a franchise with thirteen direct-to-video sequels and a television series as well as merchandise. The first film in the Land Before Time series, released in 1982 as The Little Prince, was released in 1983 as The Little Prince.", "prediction 3": "The Land Before Time is an American dinosaur film created by Don Bluth and released by Universal Pictures on November 18, 1988.", "prediction 4": "The Land Before Time is a 1988 American science fiction adventure film directed by Don Bluth. The film was released by Universal Pictures on November 18, 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 91 } ], "missing-info": [], "corrected-prediction": "The Land Before Time came out on November 18, 1988." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When was the last time chelsea won the champions league?", "passages": [ [ "2012 UEFA Champions League Final", "2012 UEFA Champions League Final\n\nThe 2012 UEFA Champions League Final was a football match which took place on Saturday, 19 May 2012 between Bayern Munich of Germany and Chelsea of England at the Allianz Arena in Munich, Germany.", "The match was to decide the winner of the 2011\u201312 season of the UEFA Champions League, Europe's premier club football tournament.", "Bayern were making their ninth appearance in the competition's final, having won four and lost four, most recently losing in 2010.", "Chelsea were appearing in their second final, having lost their first in 2008.", "It was the first Champions League final to be held at the Allianz Arena (known as Fu\u00dfball Arena M\u00fcnchen for the final).", "As tenants of the Arena, this meant Bayern were the first finalists to have home advantage since 1984.", "Both teams progressed to the knockout stages by finishing top of their group.", "Bayern then beat Basel, Marseille and Real Madrid to reach the final, while Chelsea knocked out Napoli, Benfica and defending champions Barcelona.", "Bayern took the lead late in the second half through Thomas M\u00fcller, but Didier Drogba equalised for Chelsea five minutes later to take the game to extra time, in which Arjen Robben missed an awarded penalty, Petr \u010cech saving the low drive." ] ], "gold": "The last time Chelsea won the champions league was in the 2011-2012 season on 19 May 2012.", "prediction 1": "The last time Chelsea won the champions league was in 2010 when they won it against Arsenal. The last time Chelsea won the champions league was in 2010 when they won it against Arsenal. The last time Chelsea won the champions league was in 2009 when they won it against Manchester United.", "prediction 2": "The last time Chelsea won the champions league was in 2010 and their last time winning the champions league was in 2011. The final took place on Saturday, 19 May 2012.", "prediction 3": "The last time Chelsea won the champions league was in 2009. Chelsea last won the champions league in 2009, and the last time they won the champions league in 2010 was in 2010.", "prediction 4": "Chelsea's last Champions League win came on 19 May 2011, when they defeated Bayern Munich 2-1. The football match took place at the Allianz Arena in Munich, Germany.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 92 }, { "error type": "Redundant", "explanation": "The last time Chelsea won the champions league was in 2010 when they won it against Arsenal. ", "start": 93, "end": 185 }, { "error type": "Unverifiable", "explanation": "", "start": 186, "end": 288 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "What's the name of the eighth sims 3 expansion pack?", "passages": [ [ "The Sims 3: Seasons", "The Sims 3: Seasons\n\nThe Sims 3: Seasons is the eighth expansion pack for \"The Sims 3\" on OS X and PC.", "It was released on November 13, 2012 in North America, and on November 16 in Europe.", "Players can interact with weather, get into the mood of each season and tell meaningful stories with their sims.", "There are also unique festivals during each season, with events sims can take part in.", "Sims can get their faces painted and compete in a hot dog eating contest in the summer, carve a pumpkin and bob for apples during fall and have snowball fight or go snowboarding and ice skating in the winter.", "Sims can also swim in the ocean and play soccer all year round.", "There are new traits, \"loves the cold\" and \"loves the heat\".", "Sims with these traits will enjoy extreme temperatures, finding the cold or heat pleasant rather than uncomfortable.", "Sims can also catch a cold, get a tan, or get struck by lightning.", "Days are shorter in winter and longer in summer.", "Aliens are also added in this expansion pack, similar to the ones from \"The Sims 2\" but with some updates.", "There is a new feature that will allow players to change the appearance of lots throughout the year called \"Seasonal Lot Marker\".", "Players can set up different objects and decorations for every season, but cannot make build mode changes like walls or roofing." ], [ "The Sims 3: Seasons", "\"The Sims 3: Seasons\" received \"mixed or average\" reception according to aggregator \"Metacritic\", which gave the game a rating of 73 out of 100 based on 12 reviews.", "\"Destructoid\" gave the game a \"mediocre\" score of 5 out of 10, citing a lack of new careers and public lots.", "Jon Michael from \"IGN\" gave the game a 7.5 rating out of 10 and believes \"[The game is] a solid gateway expansion that builds on the rules without overwhelming you, but still adds enough variety that you'll never want to play without it.\"", "Amanda \"StormyDawn\" Hale from \"Worthplaying.com\" gave the game an 8.7/10 and claimed even though it isn't a large expansion pack, it is one that it is important for any Sims collection \u2013 \"It's not the biggest expansion for Sims 3...", "[but] it may just be the most important.\"" ], [ "The Sims 3: Showtime", "The Sims 3: Showtime\n\nThe Sims 3: Showtime is the sixth expansion pack for \"The Sims 3\" on OS X and Windows.", "It was released on March 2012.", "A limited collector's edition includes exclusive in-game content such as a stage and two costumes along with a poster based on American singer Katy Perry.", "SimPort allows players to send Star performers on tour to perform special shows in their friends' towns if you have internet connection and friends who play the game.", "They can also invite your friends to send their Sims to perform for you and customize the stage in venues with special themed backgrounds, props, lights and special effects.", "Players can throw objects at performers \u2013 ranging from flowers to lettuce.", "Choosing not to use SimPort will not change gameplay with any interactions that do not require SimPort.", "A player can unlock backgrounds, props, and costumes for their Sim if they choose to use SimPort.", "Sims who visit a player's town via SimPort will default to the traits, clothes, and objects that they have locally in their game.", "Players can message other players while their Sims are performing in other towns.", "Note, there are 3 versions: the regular, the Limited Edition, and the Katy Perry edition.", "These versions do not have much difference other than special venues, stages and clothing.", "Starlight Shores is a new world that is included in \"Showtime\"." ] ], "gold": "The eighth expansion pack for The Sims 3 is titled \"Seasons\" and was released in North America on November 13, 2012 to mixed reviews. In addition to the regular expansion pack, a \"Limited Edition\" and an \"Origin Exclusive Trick or Treat Costume Pack Edition\" were also released.", "prediction 1": "The Sims 3: Seasons is the eighth expansion pack for \"The Sims 3\" on OS X and PC. It was released on November 13, 2012 in North America, and on November 16 in Europe. The Sims 3: Showtime is the sixth expansion pack for \"The Sims 3\" on OS X and Windows. It was released on March 2012.", "prediction 2": "The Sims 3: Seasons is the eighth expansion pack for \"The Sims 3\" on OS X and PC. It was released on November 13, 2012 in North America, and on November 16 in Europe. The Sims 3: Showtime is the sixth expansion pack for The Sims 3 in the series.", "prediction 3": "The Sims 3: Seasons is the eighth expansion pack for The Sims 3 on OS X and PC. It was released on November 13, 2012 in North America, and on November 16 in Europe. The Sims 3: Showtime is the sixth expansion pack for The Sims 3.", "prediction 4": "The Sims 3: Seasons is the eighth expansion pack for The Sims 3 on OS X and PC. It was released on November 13, 2012 in North America, and on November 16 in Europe. The Sims 3: Showtime is the sixth expansion pack for The Sims 3 on OS X and Windows.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 284 } ], "missing-info": [], "corrected-prediction": "The Sims 3: Seasons is the eighth expansion pack for \"The Sims 3\" on OS X and PC. It was released on November 13, 2012 in North America, and on November 16 in Europe. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played zach in saved by the bell?", "passages": [ [ "Saved by the Bell: Wedding in Las Vegas", "Saved by the Bell:", "Wedding in Las Vegas\n\nSaved by the Bell:", "Wedding in Las Vegas is the series finale for \"\".", "It was presented as a two-hour television movie that originally aired on NBC in 1994.", "When aired in syndication, it is commonly split into two double-length episodes.", "TBS aired the episodes as four standard episodes, but because TBS aired a two-hour block of \"Saved by the Bell\" every weekday morning, all four episodes typically air consecutively.", "The hit Crosby, Stills & Nash song \"Live It Up\" was featured in the opening titles instead of the regular theme song and featured shots of Las Vegas at night.", "The film was shot on location in Los Angeles and at The Stardust Resort & Casino in Las Vegas.", "The movie deals with Zack (Mark-Paul Gosselaar) and Kelly's (Tiffani Amber Thiessen) impending wedding, and all of the hijinks and pitfalls that occur on the road to and in Las Vegas.", "The six main cast members from \"Saved by the Bell\" were present at the wedding as were Mr. Belding, Alex Tabor, and Mike from \"\".", "Additional characters from \"Saved by the Bell\" were Derek Morris (played by John Sanderford) and Melanie Morris (played by Melody Rogers)." ], [ "Saved by the Bell", "Saved by the Bell\n\nSaved by the Bell is an American television sitcom that aired on NBC from 1989 to 1993.", "A reboot of the Disney Channel series \"Good Morning, Miss Bliss\", the show follows a group of high school friends and their principal.", "Primarily focusing on lighthearted comedic situations, it occasionally touches on serious social issues, such as drug use, driving under the influence, homelessness, remarriage, death, women's rights, and environmental issues.", "The series starred Mark-Paul Gosselaar, Dustin Diamond, Lark Voorhies, Dennis Haskins, Tiffani-Amber Thiessen, Elizabeth Berkley, and Mario Lopez.", "The show spawned two spin-off series: \"\" (1993\u20131994), a primetime series that follows several of the characters to college, and \"\" (1993\u20132000), a Saturday morning series that follows a new group of students at Bayside High School.", "The series also spawned two TV movies, \"\" in 1992 and \"\" in 1994.", "In recent years, \"Saved by the Bell\" has been classified as educational and informational.", "The show was named one of the \"20 Best School Shows of all Time\" by AOL TV." ], [ "Saved by the Bell: The College Years", "Saved by the Bell: The College Years\n\nSaved by the Bell: The College Years is an American sitcom sequel to the \"Saved by the Bell\" series that ran from May 22, 1993 to February 8, 1994, lasting for only one season.", "It is the third incarnation of the franchise.", "It is also the only series of the franchise to air on primetime television instead of Saturday mornings.", "It aired on NBC on Tuesday evenings.", "\"Saved by the Bell: The College Years\" is very similar to the original \"Saved by the Bell\" series; the plotline has to do with the six characters getting into trouble each week at the fictitious California University (Cal U), under the watchful eye of Mike Rogers (Bob Golic), their dorm adviser.", "The series includes Zack Morris, Samuel \"Screech\" Powers, and A.C. Slater (from the original \"Saved by the Bell\" series) as the main characters, along with newcomers Leslie Burke (Anne Tremko), Alex Tabor (Kiersten Warren) and Danielle Marks (Essence Atkins).", "After the pilot, however, Atkins's role was eliminated, and Tiffani-Amber Thiessen returned to the show in her role of Kelly Kapowski.", "Danielle was written out of the series as having transferred to another college." ] ], "gold": "Saved by the Bell is an American television sitcom that follows a group of high school students, including Zach, who is played by actor Mark-Paul Gosselaar. Mark-Paul Gosselaar continued to play Zach in the show's sequel, Saved by the Bell: The College Years, and a spin-off called Saved by the Bell: The New Class. He also played Zach in the 1992 television movie, Saved by the Bell: Hawaiian Style, and the 1994 film Saved by the Bell: Wedding in Las Vegas. ", "prediction 1": "Saved by the Bell was an American television sitcom that aired on NBC from 1989 to 1993. A reboot of the Disney Channel series Good Morning, Miss Bliss, the show follows a group of high school friends and their principal. Primarily focusing on lighthearted comedic situations, it occasionally touches on serious social issues, such as drug use, driving under the influence, homelessness, remarriage, death, women's rights, and environmental issues. In the 1994 movie that aired as the series, Mark-Paul Gosselaar played Zack Morris.", "prediction 2": "In the 1994 American television sitcom Saved by the Bell: Wedding in Las Vegas, Zack Morris is played by Mark-Paul Gosselaar. In the 1993 television movie, Zack is played by Tiffani Amber Thiessen. In the 1994 film, Zack is played by Estelle Williams.", "prediction 3": "Saved by the Bell is an American television sitcom that aired on NBC from 1989 to 1993. A reboot of the Disney Channel series Good Morning, Miss Bliss, the show follows a group of high school friends and their principal. The show featured several newcomers in the original series, including Mark-Paul Gosselaar, Dustin Diamond, Lark Voorhies, Dennis Haskins, Tiffani-Amber Thiessen, Elizabeth Berkley, Mario Lopez, and Mario Lopez. The series also spawned two spin-off series, Saved by the Bell: The College Years, which was based on the original series and aired from May 22, 1993 to February 8, 1994, lasting for only one season.", "prediction 4": "In Saved by the Bell: Wedding in Las Vegas, the series finale, Mark-Paul Gosselaar played Zack Morris and his wife Kelly.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 88 }, { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 448 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Saved by the Bell was an American television sitcom that follows a group of high school friends. The series starred Mark-Paul Gosselaar, who remained as part of the original cast in the spin-off, Saved by the Bell: The College Years. The show inspired a movie in 1992 and in the 1994 movie that aired as Saved by the Bell: Wedding in Las Vegas Mark-Paul Gosselaar played Zack Morris." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "The first list of elements and their characteristics was written by?", "passages": [ [ "History of the periodic table", "Definition of Triad law:-\"Chemically analogous elements arranged in increasing order of their atomic weights formed well marked groups of three called Triads in which the atomic weight of the middle element was found to be generally the arithmetic mean of the atomic weight of the other two elements in the triad.", "Alexandre-Emile B\u00e9guyer de Chancourtois, a French geologist, was the first person to notice the periodicity of the elements\u00a0\u2014 similar elements occurring at regular intervals when they are ordered by their atomic weights.", "In 1862 he devised an early form of periodic table, which he named \"Vis tellurique\" (the 'telluric helix'), after the element tellurium, which fell near the center of his diagram.", "With the elements arranged in a spiral on a cylinder by order of increasing atomic weight, de Chancourtois saw that elements with similar properties lined up vertically.", "His 1863 publication included a chart (which contained ions and compounds, in addition to elements), but his original paper in the \"Comptes Rendus de l'Acad\u00e9mie des Sciences\" used geological rather than chemical terms and did not include a diagram.", "As a result, de Chancourtois' ideas received little attention until after the work of Dmitri Mendeleev had been published." ], [ "History of chemistry", "An important breakthrough in making sense of the list of known chemical elements (as well as in understanding the internal structure of atoms) was Dmitri Mendeleev's development of the first modern periodic table, or the periodic classification of the elements.", "Mendeleev, a Russian chemist, felt that there was some type of order to the elements and he spent more than thirteen years of his life collecting data and assembling the concept, initially with the idea of resolving some of the disorder in the field for his students.", "Mendeleev found that, when all the known chemical elements were arranged in order of increasing atomic weight, the resulting table displayed a recurring pattern, or periodicity, of properties within groups of elements.", "Mendeleev's law allowed him to build up a systematic periodic table of all the 66 elements then known based on atomic mass, which he published in \"Principles of Chemistry\" in 1869.", "His first Periodic Table was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similarity of properties.", "Mendeleev had such faith in the validity of the periodic law that he proposed changes to the generally accepted values for the atomic weight of a few elements and, in his version of the periodic table of 1871, predicted the locations within the table of unknown elements together with their properties." ], [ "Periodic table", "In 1871, Mendeleev published his periodic table in a new form, with groups of similar elements arranged in columns rather than in rows, and those columns numbered I to VIII corresponding with the element's oxidation state.", "He also gave detailed predictions for the properties of elements he had earlier noted were missing, but should exist.", "These gaps were subsequently filled as chemists discovered additional naturally occurring elements.", "It is often stated that the last naturally occurring element to be discovered was francium (referred to by Mendeleev as \"eka-caesium\") in 1939.", "Plutonium, produced synthetically in 1940, was identified in trace quantities as a naturally occurring element in 1971.", "The popular periodic table layout, also known as the common or standard form (as shown at various other points in this article), is attributable to Horace Groves Deming.", "In 1923, Deming, an American chemist, published short (Mendeleev style) and medium (18-column) form periodic tables.", "Merck and Company prepared a handout form of Deming's 18-column medium table, in 1928, which was widely circulated in American schools.", "By the 1930s Deming's table was appearing in handbooks and encyclopaedias of chemistry.", "It was also distributed for many years by the Sargent-Welch Scientific Company." ] ], "gold": "French geologist Alexandre-Emile B\u00e9guyer de Chancourtois was the first to notice that certain elements displayed similar properties when sorted by atomic weight in increasing order. He published these findings in 1863, including a chart of elements, ions and compounds. In 1869, the first official periodic table of elements and their characteristics was created by Russian chemist Dmitri Mendeleev, who widely distributed his work to chemists in Russia and abroad.", "prediction 1": "The first list of elements and their characteristics was written by Alexandre-Emile B\u00e9guyer de Chancourtois in 1862. In 1869, Dmitri Mendeleev published his first periodic table, which was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similarity of properties. His first Periodic Table was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similarity of properties.", "prediction 2": "An important breakthrough in making sense of the list of known chemical elements was the development of the first modern periodic table, or the periodic classification of the elements by Dmitri Mendeleev in 1869. Mendeleev, a Russian chemist, felt that there was some type of order to the elements and he spent more than thirteen years of his life collecting data and assembling the concept, initially with the idea of resolving some of the disorder in the field for his students. In 1862, French geologist, was the first person to notice the periodicity of the elements occurring at regular intervals when they are ordered by their atomic weight. In 1869, Russian chemistry, Mendeleev published his periodic table in a new form, with groups of similar elements arranged in columns rather than in rows, and those columns corresponding with the element's oxidation state. In 1923, the", "prediction 3": "The first list of elements and their characteristics was written by Alexandre-\u00c9mile B\u00e9guyer de Chancourtois in 1862. He was the first person to notice the periodicity of the elements. An important breakthrough in making sense of the list of known chemical elements was the development of the first modern periodic table. Dmitri Mendeleev, a Russian chemist, felt that there was some type of order to the elements and he spent more than thirteen years of his life collecting data and assembling the concept, initially with the idea of resolving some of the disorder in the field for his students. Mendeleev published his periodic table in Principles of Chemistry in 1871. His first Periodic Table was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similar properties.", "prediction 4": "The first list of known elements and their characteristics was written by Alexandre-Emile B\u00e9guyer de Chancourtois, a French geologist, who was the first person to notice the periodicity of the elements. An important breakthrough in making sense of the list of known chemical elements was Dmitri Mendeleev's development of the first modern periodic table, or the periodic classification of the elements. Mendeleev's law allowed him to build up a systematic periodic table of all the 66 elements then known and predicted the locations within the table of unknown elements together with their characteristics.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The first list of elements and their characteristics was written by Alexandre-Emile B\u00e9guyer de Chancourtois in 1862. In 1869, Dmitri Mendeleev published his first periodic table, which was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similarity of properties. ", "start": 320, "end": 479 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The first list of elements and their characteristics was written by French geologist Alexandre-Emile B\u00e9guyer de Chancourtois in 1862. His 1863 publication included a chart which contained ions and compounds, in addition to elements. In 1869, Dmitri Mendeleev, a Russian chemist, published his first periodic table, which was compiled on the basis of arranging the elements in ascending order of atomic weight and grouping them by similarity of properties." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is singing at the nba all star weekend?", "passages": [ [ "NBA All-Star Weekend", "NBA All-Star Weekend\n\n", "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season that consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night.", "No regular season games are held during this period, which is also known as the All-Star break.", "The All-Star Game, held on Sunday, is the main event of the weekend.", "The 2017 game was held at Smoothie King Center in New Orleans, home of the New Orleans Pelicans.", "The 2018 NBA All-Star Game was held in Los Angeles, California.", "The NBA Jam Session, a \"theme park of basketball\", has been a part of the All-Star festivities since 1992, with fans able to take part in numerous interactive basketball related activities from Thursday through Monday.", "The NBA Jam Session is usually targeted to young fans." ], [ "2009 NBA All-Star Game", "The national anthem of both the United States and Canada were sung before the game.", "Arizona native and \"American Idol\" winner Jordin Sparks sang U.S. national anthem, \"The Star-Spangled Banner\".", "The Canadian national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill.", "The pre-game introduction included a dance performance by the \"America's Best Dance Crew\" winner, the Jabbawockeez.", "Grammy-nominated singer Chris Brown was originally scheduled to appear during the pre-game introductions.", "He, however, withdrew from the performance due to an ongoing domestic violence case against him.", "Other musical guests during the All-Star Weekend were singers Corbin Bleu and Kevin Rudolf.", "Bleu performed \"Moments That Matter\" at the halftime of the Rookie Challenge on Friday while Rudolf performed \"Let It Rock\" during the NBA All-Star Saturday Night.", "The T-Mobile Rookie Challenge featured a team of standout first-year players ('Rookies') against a team of standout second-year players ('Sophomores').", "The game was divided into two twenty-minute halves, similar to college basketball.", "The participating players were chosen by voting among the league's assistant coaches." ], [ "NBA All-Star Celebrity Game", "The Globetrotters, joined by \"Curly\" Neal and \"Bucket\" Blakes, entertained the crowd during the timeouts with their signature ball-handling tricks.", "The 2011 BBVA Celebrity All-Star Game was played on Friday, February 18 at the Los Angeles Convention Center in Los Angeles, California.", "The head coaches were Basketball Hall of Famers Bill Walton and Magic Johnson.", "Their assistants were comedians Ty Burrell and Jason Alexander.", "Each team featured fake \"general managers\" who simulated to have chosen the team.", "The game's MVP was chosen by voting through text messaging and social media.", "At the end of the game, Justin Bieber was announced the MVP.", "Bieber scored eight points (3-11 FG), and had two rebounds and four assists.", "NBA legend Chris Mullin said of Bieber, \"He's got a nice little game... but more importantly, he's got great passion.", "It looked like he loves the game.\"", "The 2012 Sprint NBA All-Star Celebrity Game was played on Friday, February 24, 2012 at the Orange County Convention Center in Orlando, Florida.", "Participants in 2012's version of the game include J. Cole, Common, Vinny Guadagnino, Kevin Hart, and Ne-Yo." ] ], "gold": "The NBA All-Star Weekend is an annual weekend of festivities, basketball events, and performances. Queen Latifah and Tamia sung during the All-Star Weekend in 2015. Nelly Furtado and Ne-Yo sung in 2016. And Jon Batiste and Nikki Yanofsky sung at the All-Star Weekend in 2017.", "prediction 1": "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season that consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night. Arizona native and \"American Idol\" winner Jordin Sparks sang the U.S. national anthem, The Star-Spangled Banner. The Canadian national anthem, \"O Canada\", was also sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill. Grammy-nominated singer Chris Brown was originally scheduled to appear during the pre-game introductions. However, he withdrewockeez.", "prediction 2": "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season and consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night. The national anthem of both the United States and Canada were sung before the game. Arizona native and \"American Idol\" winner Jordin Sparks sang the United States national anthem, The Star Spangled Banner. Canadian national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill. The Canadian national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill. The national anthem was sung by Tamia, Canadian singer who is also the husband of Phoenix Suns", "prediction 3": "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season that consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night. Arizona native and \"American Idol\" winner Jordin Sparks sang the U.S. national anthem, \"The Star-Spangled Banner\". The Canadian national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill. The Canadian national anthem, \"O Canada\", and the U.S. national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill.", "prediction 4": "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season that consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night. Arizona native and \"American Idol\" winner Jordin Sparks sang the U.S. national anthem, The Star-Spangled Banner. The Canadian national anthem, \"O Canada\", were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill. The Canadian national anthem, \"O Canada\" were sung by Tamia, Canadian singer who is also the wife of Phoenix Suns player Grant Hill.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 276 }, { "error type": "Irrelevant", "explanation": "", "start": 277, "end": 318 }, { "error type": "Redundant", "explanation": "The National Basketball Association All-Star Weekend is a weekend festival held every February during the middle of the NBA regular season that consists of a variety of basketball events, exhibitions, and performances culminating in the NBA All-Star Game held on Sunday night. Arizona native and \"American Idol\" winner Jordin Sparks sang the U.S. national anthem, ", "start": 364, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 420, "end": 431 }, { "error type": "Irrelevant", "explanation": "", "start": 456, "end": 527 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 633 }, { "error type": "Irrelevant", "explanation": "", "start": 634, "end": 661 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The National Basketball Association All-Star Weekend is a weekend festival that consists of a variety of basketball events, exhibitions, and performances. Jordin Sparks has sung the U.S. national anthem. The Canadian national anthem has been sung by Tamia. Other musical guests during the 2009 All-Star Weekend were singers Corbin Bleu and Kevin Rudolf." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Where does the university of kentucky play basketball?", "passages": [ [ "Memorial Coliseum (University of Kentucky)", "Memorial Coliseum (University of Kentucky)\n\nMemorial Coliseum is a 8,500-seat multi-purpose arena in Lexington, Kentucky.", "The facility, which opened in 1950, is home to three women's teams at the University of Kentucky \u2013 basketball, volleyball, and gymnastics.", "Before Rupp Arena opened in 1976, it also housed the men's basketball team.", "Memorial Coliseum also housed the university's swimming and diving team prior to the 1989 completion of the Lancaster Aquatics Center.", "The facility was built as a memorial to Kentuckians who had died in World War I, World War II and the Korean War.", "Later, the names of all Kentuckians who died in the Vietnam War were added.", "Originally, it had an official capacity of 12,000, making it the largest arena in the South at the time.", "However, the Coliseum frequently drew crowds of over 13,000 for many UK basketball games.", "A major renovation, completed in 1990, reduced the seating capacity to its current total of 8,500 and added an elaborate weight training facility, new offices for the basketball and athletics programs, a players' lounge, and a team meeting room.", "The seating is now mostly located on the sidelines, and the men's NCAA basketball championship banners still hang on the walls.", "The building is known for its air of great tradition." ], [ "Rupp Arena", "Rupp Arena\n\nRupp Arena is an arena located in downtown Lexington, Kentucky, U.S.", "Since its opening in 1976, it has been the centerpiece of Lexington Center, a convention and shopping facility owned by an arm of the Lexington-Fayette Urban County Government, which is located next to the Lexington Hyatt and Hilton hotels.", "Rupp Arena also serves as home court to the University of Kentucky men's basketball program, and is named after legendary former Kentucky coach and University of Kansas alumnus Adolph Rupp.", "With an official capacity of 23,500, it is currently the largest arena in the United States designed specifically for basketball.", "In Rupp Arena, the Kentucky Wildcats men's basketball team is second in the nation in college basketball home attendance.", "The only other basketball-specific arena in US history larger than the arena is the now-demolished Charlotte Coliseum.", "Rupp Arena also regularly hosts concerts, conventions and shows.", "The arena's primary tenant is the Kentucky Wildcats men's basketball team, but the Kentucky Wildcats women's basketball team has also hosted games there in recent years, particularly an upset in early 2006 of the #1 Tennessee Lady Volunteers.", "Rupp Arena was the host of the 1985 NCAA Final Four, won in an upset by eighth-seeded Villanova." ] ], "gold": "The University of Kentucky Men's basketball team plays at Rupp Arena at Central Bank Center in downtown Lexington. The arena is named after legendary former Kentucky coach Adolph Rupp. Before the arena's opening in 1976, the team played at Memorial Coliseum, a multi-purpose arena that currently serves as home court for the University of Kentucky Women's basketball team. Memorial Coliseum is also a memorial to Kentuckians who died in World War I, World War II, the Korean War, and the Vietnam war.", "prediction 1": "The University of Kentucky plays basketball in Memorial Coliseum, which opened in 1950, in Lexington, Kentucky. Prior to the opening of Rupp Arena in 1976, the University of Kentucky played basketball in Memorial Coliseum, which is a multi-purpose arena in downtown Lexington, Kentucky.", "prediction 2": "The University of Kentucky plays basketball in several venues. The University of Kentucky has had men's and women's basketball at Memorial Coliseum, Rupp Arena and Memorial Coliseum, among others. However, in the men's basketball games, the University of Kentucky has had games at both Memorial Coliseum and Rupp Arena, which are both in downtown Lexington, Kentucky.", "prediction 3": "The University of Kentucky plays basketball at Memorial Coliseum, the multi-purpose arena in downtown Lexington, Kentucky, which opened in 1950. The men's basketball team plays at Rupp Arena, which is the largest arena in the United States designed specifically for basketball.", "prediction 4": "The University of Kentucky plays basketball in Memorial Coliseum, a 8,500-seat multi-purpose arena in Lexington, Kentucky, which opened in 1950. Rupp Arena, which opened in 1976, serves as the home court for the men's basketball team.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 111 }, { "error type": "Redundant", "explanation": "The University of Kentucky plays basketball in Memorial Coliseum", "start": 156, "end": 222 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Rupp Arena Rupp Arena is an arena located in downtown Lexington, Kentucky, U.S. Rupp Arena serves as home court to the University of Kentucky men's basketball program, and is named after legendary former Kentucky coach and University of Kansas alumnus Adolph Rupp. Prior to the opening of Rupp Arena in 1976, the University of Kentucky played basketball in Memorial Coliseum, which is a multi-purpose arena in downtown Lexington, Kentucky. The facility was built as a memorial to Kentuckians who had died in World War I, World War II and the Korean War." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "When was sing something simple on the radio?", "passages": [ [ "Sing Something Simple", "Sing Something Simple\n\nSing Something Simple was a half-hour radio programme, which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion.", "The programme ran for 42 years from 1959 until 2001, initially on the Light Programme and later on BBC Radio 2, and earning itself the title of the longest-running continuous music programme in the world.", "The lyrics to its main theme began as follows:\n\n\"Sing something simple\"\n\"As cares go by\"\n\"Sing something simple\"\n\"Just you and I\"\n\nWhen \"Sing Something Simple\" was broadcast by Radio 2, this song would be followed by an announcer (in latter years, Alan Dedicoat) who would say:\n\n\"\"We invite you to Sing Something Simple, a collection of favourite songs, old and new, sung by The Cliff Adams Singers, accompanied by Jack Emblow.\"", "\" and alternately 'We invite you to Sing Something Simple, not only listening, but joining in we hope, with all these songs you know so well'.", "The pianist, Semprini, introduced his own show with \"Old ones, new ones, loved ones, neglected ones\" but the effect was similar on \"Sing Something Simple\".", "The tune would then continue:\n\n\"We'll sing the old songs\" \n\"like you used to do,\"\n\"We'll sing something simple for you,\" \n\"something for you.\"" ] ], "gold": "Sing Something Simple, the half-hour radio program which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion, debuted in 1959 and aired up until 2001. The 42 year run earned it the title of the longest-running continuous music program in the world.", "prediction 1": "Sing Something Simple was a half-hour radio programme, which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion. The programme ran for 42 years from 1959 until 2001, initially on the Light Programme and later on BBC Radio 2. When \"Sing Something Simple\" was broadcast by Radio 2, this song would be followed by an announcer who would say: \"\"We invite you to Sing Something Simple, a collection of favourite songs, old and new, sung by The Cliff Adams Singers, accompanied by Jack Emblow.\"\" and alternately: \"We invite you to Sing Something Simple, not only listening, but joining in we hope, with all these songs you know so well.", "prediction 2": "Sing Something Simple was a half-hour radio programme, featuring Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion. The programme ran for 42 years from 1959 until 2001, initially on the Light Programme and later on BBC Radio 2.", "prediction 3": "Sing Something Simple was a half-hour radio programme, which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion. It ran for 42 years from 1959 through 2001, initially on the Light Programme and later on BBC Radio 2.", "prediction 4": "Sing Something Simple was a half-hour radio programme, which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion. The program ran for 42 years from 1959 until 2001, initially on the Light Programme and later on BBC Radio 2.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 518 }, { "error type": "Irrelevant", "explanation": "", "start": 519, "end": 659 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Sing Something Simple was a half-hour radio programme, which featured Cliff Adams and The Cliff Adams Singers, with Jack Emblow on accordion. The programme ran for 42 years from 1959 until 2001, earning itself the title of the longest-running continuous music programme in the world." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When does the secret life of bees take place?", "passages": [ [ "The Secret Life of Bees (novel)", "They begin hitch-hiking toward Tiburon, SC, a place written on the back of an image of the Virgin Mary as a black woman, which Deborah, her mother, had owned.", "They spend a night in the woods with little food and little hope before reaching Tiburon.", "There, they buy lunch at a general store, and Lily recognizes a picture of the same \"Black Mary\" but on the side of a jar of honey.", "They receive directions to the origin of that honey, the Boatwright residence.", "They are introduced to the Boatwright sisters, the makers of the honey: August, May, and June, who are all black.", "Lily makes up a story about being an orphan.", "Lily and Rosaleen are invited to stay with the sisters.", "They learn the ways of the Boatwrights, as well as the ways of bee keeping.", "With a new home and a new family for the time being, Lily learns more about the Black Madonna honey that the sisters make.", "She begins working as August's bee keeping apprentice to repay her for her kindness, while Rosaleen works around the house.", "Lily finds out that May had a twin sister, April, who committed suicide with their father's shotgun when they were younger.", "She watches June's ongoing flirtations with, and refusals of marriage to, her boyfriend Neil." ], [ "The Secret Life of Bees (film)", "The Secret Life of Bees (film)\n\n", "The Secret Life of Bees is a 2008 American drama film, adapted from the novel of the same name by Sue Monk Kidd.", "The film was directed by Gina Prince-Bythewood and produced by Lauren Shuler Donner and Will Smith, with his wife, Jada Pinkett Smith, as executive producer.", "The film is noted for Queen Latifah's critically acclaimed performance as August Boatwright.", "The film was released in North America on October 17, 2008, and in the United Kingdom on December 5, 2008.", "Lily Owens lives on a peach orchard, in South Carolina in 1964.", "Her father T-Ray is widowed, abusive, and often angry with her.", "On her 14th birthday, the harvest is starting, societal and personal unrest consumes her life, and a string of events, a mix of mystical, terrifying, and unjust, pushes her to run away to find a better life.", "With Lily goes Rosaleen, their housekeeper.", "Lily is blonde and naively confident; Rosaleen is African American, in her 20's, politically aware, and proud.", "Rosaleen was beaten hours earlier in front of Lily, and somehow Lily gets her out of the hospital and both on the road.", "Lily has but a few hoarded mementos of her mother, dead almost 10 years." ], [ "The Secret Life of Bees (novel)", "The Secret Life of Bees (novel)\n\n", "The Secret Life of Bees is a book by author Sue Monk Kidd.", "Set in 1964, it is a coming-of-age story about loss and betrayal.", "It received critical acclaim and was a \"New York Times\" bestseller.", "It won the 2004 Book Sense Book of the Year Awards (Paperback), and was nominated for the Orange Broadband Prize for Fiction.", "The book was later was adapted into a film directed by Gina Prince-Bythewood.", "Set in the fictitious town of Sylvan, South Carolina, in 1964, \"The Secret Life of Bees\" tells the story of a 14-year-old white girl, Lily Melissa Owens, whose life has been shaped around the blurred memory of the afternoon her mother was killed.", "She lives in a house with her abusive father, whom she refers to as T. Ray.", "They have a no-nonsense maid, Rosaleen, who acts as a surrogate mother for Lily.", "The book opens with Lily's discovery of bees in her bedroom.", "Then, after Rosaleen is arrested for pouring her bottle of \"snuff juice\" on three white men, Lily breaks her out of the hospital and they decide to leave town." ] ], "gold": "The Secret Life of Bees is the title of a novel written by Sue Monk Kidd, and of the American film that was adapted from the novel. The Secret Life of Bees is a coming-of-age story about loss and betrayal that is set in 1964, South Carolina.", "prediction 1": "In the novel The Secret Life of Bees, author Sue Monk Kidd tells the story of a 14-year-old white girl, Lily Melissa Owens, whose life has been shaped around the blurred memory of the afternoon her mother was killed. The novel was first published in 2004 and was a New York Times bestseller. In 2008, the American drama film The Secret Life of Bees was adapted from the novel.", "prediction 2": "The Secret Life of Bees is a book by Sue Monk Kidd. Set in South Carolina in 1964, it is a coming-of-age story about loss and betrayal. It takes place in the fictional town of Sylvan, South Carolina. The 2008 American drama film based on the novel is a tribute to the book, and tells the story of Lily Owens, a 14-year-old white girl whose life has been shaped around the blurred memory of the afternoon her mother was killed.", "prediction 3": "The Secret Life of Bees is a coming-of-age story set in the fictitious town of Sylvan, South Carolina, in 1964. Set in the year 1964, it tells the story of a 14-year-old white girl, Lily Melissa Owens, whose life has been shaped around the blurred memory of the afternoon her mother was killed. The book takes place in the South Carolina town of Sylvan and focuses on Lily's relationship with her maid, Rosaleen, as well as her. The film adaptation of the book was released in the United States in 2008, and in the United Kingdom in 2009.", "prediction 4": "The Secret Life of Bees is a coming-of-age story about a 14-year-old white girl named Lily Melissa Owens, whose life has been shaped around the blurred memory of the afternoon her mother was killed. The Secret Life of Bees takes place in the fictitious town of Sylvan, South Carolina, in 1964. The 2008 American drama film \"The Secret Life of Bees\" takes place just two years before the book's publication date. The film's director is Gina Prince-Bythewood and the film adaptation of the 2008 American coming of the 2008 American drama \"The Secret Life of Bees\" is set in Sylvan, South Carolina.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 291 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the novel The Secret Life of Bees, author Sue Monk Kidd tells the story of a 14-year-old white girl, Lily Melissa Owens, whose life has been shaped around the blurred memory of the afternoon her mother was killed, set in the fictitious town of Sylvan, South Carolina, in 1964. In 2008, the American drama film The Secret Life of Bees was adapted from the novel." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did snape become defense against the dark arts teacher?", "passages": [ [ "Harry Potter and the Half-Blood Prince", "Harry Potter and the Half-Blood Prince\n\nHarry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the \"Harry Potter\" series.", "Set during protagonist Harry Potter's sixth year at Hogwarts, the novel explores the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore.", "The book was published in the United Kingdom by Bloomsbury, and in the United States by Scholastic on 16 July 2005, as well as in several other countries.", "It sold nine million copies in the first 24\u00a0hours after its release, a record at the time which was eventually broken by its sequel, \"Harry Potter and the Deathly Hallows\".", "There were many controversies before and after it was published, including the right to read the copies delivered prior to the release date in Canada.", "Reception to the novel was generally positive and it won several awards and honours, including the 2006 British Book of the Year award.", "Reviewers noted that the book took on a darker tone than its previous predecessors, though it did contain some humour.", "Some considered the main themes to be love, death, trust, and redemption.", "The considerable character development of Harry and many other teenage characters also drew attention." ] ], "gold": "Severus Snape became the Defense Against the Dark Arts teacher in Harry Potter and the Half-Blood Prince, the sixth installment in the Harry Potter series. Though the book was published in 2005, its events take place in-universe in 1996\u20131997.", "prediction 1": "Harry Potter and the Half-Blood Prince is a 2005 fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the Harry Potter series. It features Snape, a defense against the Dark Arts teacher, in the novel. Snape was introduced in the final chapter of the novel.", "prediction 2": "Harry Potter and the Half-Blood Prince is the sixth novel in the Harry Potter series. It's set during protagonist Harry Potter's sixth year at Hogwarts and examines the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore. Snape became defense against the dark arts teacher after Snape's second attack on Snape's house in the first attack on Snape was killed by Snape in the dark arts teacher. Snape was defeated by the Dark Arts teacher.", "prediction 3": "Harry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the Harry Potter series. It is set during protagonist Harry Potter's sixth year at Hogwarts, the novel explores the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore. Snape becomes defence against the Dark Arts teacher, snape, when Snape becomes defense against the Dark Arts teacher Snape. Snape becomes defense against the Dark Arts teacher, Snape becomes defense against the Dark Arts teacher, Snape becomes defense against the Dark Arts Teacher, when Snape becomes an attack against the Dark Arts teacher, Snape becomes defense against the Dark Arts Teacher Snape. Snape becomes defense against the Dark Arts", "prediction 4": "Harry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the Harry Potter series. The novel explores the past of protagonist Harry Potter's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore. Snape, a student at Hogwarts at the time, is the student Snape's second year at Hogwarts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 166 }, { "error type": "Unverifiable", "explanation": "", "start": 167, "end": 240 }, { "error type": "Unverifiable", "explanation": "", "start": 241, "end": 296 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the uk last win the world cup?", "passages": [ [ "England at the FIFA World Cup", "England played all their games at Wembley Stadium in London, which became the last time that the hosts were granted this privilege.", "After drawing 0\u20130 in the opening game against former champions Uruguay, which started a run of four games all ending goalless.", "England then beat both France and Mexico 2\u20130 and qualified for the quarter-finals.", "The quarter-finals saw England play Argentina, which ended in a 1\u20130 win to England.", "This match saw the start of the rivalry between England and Argentina, when Argentinian Antonio Ratt\u00edn was dismissed by German referee Rudolf Kreitlein in a very fierce game.", "A 2\u20131 win against Portugal in the semi-final then followed.", "Portugal were the first team to score against England in the tournament.", "The final saw England play West Germany, with the result finishing in a 4\u20132 win for England, after extra time.", "1970 saw the first World Cup finals take place in North America and England qualified automatically for the tournament by winning the 1966 FIFA World Cup.", "England were drawn in a group with Romania, former world champions Brazil and Czechoslovakia.", "Each of the matches only saw one goal, with England defeating Romania and Czechoslovakia, and losing to Brazil.", "The quarter-final saw a repeat of the 1966 final, with England playing West Germany." ], [ "England at the FIFA World Cup", "England at the FIFA World Cup\n\nThe England national football team has competed at the FIFA World Cup since 1950.", "The FIFA World Cup is the premier competitive international football tournament, first played in 1930, whose finals stage has been held every four years since, except 1942 and 1946, due to the Second World War.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the finals, is used to determine which teams qualify for the finals.", "The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1\u00a0million people watching the 2006 Final.", "England did not enter the competition until 1950, but have entered all eighteen subsequent tournaments.", "They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States), and have failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup." ], [ "2017 Women's Cricket World Cup", "2017 Women's Cricket World Cup\n\nThe 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017.", "It was the eleventh edition of the Women's Cricket World Cup, and the third to be held in England (after the 1973 and 1993 tournaments).", "The 2017 World Cup was the first in which all participating players were fully professional.", "Eight teams qualified to participate in the tournament.", "England won the final against India at Lord's on 23 July by 9 runs.", "The 2014\u201316 ICC Women's Championship, featuring the top eight ranked teams in women's cricket, was the first phase of qualifying for the World Cup, with the top four teams qualifying automatically.", "The remaining four places were decided at the 2017 World Cup Qualifier, a ten-team event that was held in Sri Lanka in February 2017.", "This featured the bottom four teams from the ICC Women's Championship and six other teams.", "On 8 February 2016, the International Cricket Council (ICC) announced the five venues for the 2017 Women's World Cup.", "Lord's hosted the final, and other matches were played at the home grounds of Derbyshire, Leicestershire, Somerset and Gloucestershire.", "The captains of each team were announced on 21 April 2017, with the full squads named shortly after." ] ], "gold": "The England national football team has competed at the FIFA World Cup since 1950. The last time the U.K. won the men's World Cup was in 1966. The ICC Women's Cricket World Cup is the sport's oldest world championship, with the first tournament held in England in 1973.The last time the U.K. won the women's World Cup was 2017.", "prediction 1": "The Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017. It was the first in which all participating players were fully professional. England won the final against India at Lord's on 23 July by 9 runs. The last time the uk won the world cup was in 1966.", "prediction 2": "The England national football team has competed at the FIFA World Cup since 1950. England last won the World Cup in 1966, playing Argentina in the quarter-finals. England then played West Germany in the final, which ended in a 4\u20132 win for England. Then, in 2017, England won the women's cricket world cup at Lord's.", "prediction 3": "The England national football team has competed at the FIFA World Cup since 1950. England last won the World Cup in 1966, which was the last time the team has won the tournament. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017. It was the eleventh edition of the Women's Cricket World Cup, and the third to be held in England (after the 1973 and 1993 tournaments).", "prediction 4": "The England national football team has competed at the FIFA World Cup since 1950. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017. In that tournament, England won the final against India at Lord's on 23 July by 9 runs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 279 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Women's Cricket World Cup, which England hosted for the first time in 1973, again took place in 2017, with England winning the final. The England national football team has competed at the FIFA World Cup since 1950. The last time the uk won the FIFAworld cup was in 1966." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays captain jack sparrow in pirates of the caribbean?", "passages": [ [ "Jack Sparrow", "Depp was excited by the possibility of reviving an old Hollywood genre, and found the script met his quirky sensibilities: the crew of the \"Black Pearl\" were not in search of treasure but trying to return it to lift a curse on them, and the traditional mutiny had already occurred.", "Depp was cast on June 10, 2002.", "Producer Jerry Bruckheimer felt Depp would give the film an edge that could draw teenage and adult audiences despite Disney's reputation for soft children's fare.", "At the first read-through, Depp surprised the cast and crew by portraying the character in an off-kilter manner.", "He researched 18th-century pirates and, seeing parallels with modern rock stars, modeled his performance on Keith Richards.", "Richards later appeared in two cameos as Jack's father, Captain Teague, in \"At World's End\" and \"On Stranger Tides\".", "Verbinski and Bruckheimer had confidence in Depp, partly because Orlando Bloom would play the traditional Errol Flynn-type character.", "Depp improvised the film's final line, \"Now, bring me that horizon\", which the writer called his favorite line.", "Disney executives were initially confused by Depp's performance, questioning whether the character was drunk or gay.", "While watching the rushes, Disney CEO Michael Eisner proclaimed Depp was ruining the film." ], [ "Jack Sparrow", "Jack Sparrow\n\nCaptain Jack Sparrow is a fictional character in the \"Pirates of the Caribbean\" film series.", "The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp.", "The characterization of Sparrow is based on a combination of The Rolling Stones' guitarist Keith Richards and Looney Tunes cartoon character Pep\u00e9 Le Pew.", "He first appears in the 2003 film \"\".", "He later appears in the sequels \"\" (2006), \"\" (2007), \"\" (2011), and \"\" (2017).", "In the films, Sparrow is one of the nine pirate lords in the Brethren Court, the Pirate Lords of the Seven Seas.", "He can be treacherous and survives mostly by using wit and negotiation rather than by force, opting to flee most dangerous situations and to fight only when necessary.", "Sparrow is introduced seeking to regain his ship, the \"Black Pearl\", from his mutinous first mate, Hector Barbossa.", "Later he attempts to escape his blood debt to the legendary Davy Jones while fighting the East India Trading Company.", "The \"Pirates of the Caribbean\" series was inspired by the Disney theme park ride of the same name, and when the ride was revamped in 2006, the character of Captain Jack Sparrow was added to it." ], [ "Pirates of the Caribbean: The Curse of the Black Pearl", "Pirates of the Caribbean: The Curse of the Black Pearl\n\nPirates of the Caribbean: The Curse of the Black Pearl is a 2003 American fantasy swashbuckler film directed by Gore Verbinski and the first film in the \"Pirates of the Caribbean\" film series.", "Produced by Walt Disney Pictures and Jerry Bruckheimer, the film is based on Walt Disney's \"Pirates of the Caribbean\" attraction at Disney theme parks.", "The story follows pirate Jack Sparrow (Johnny Depp) and blacksmith Will Turner (Orlando Bloom) as they rescue the kidnapped Elizabeth Swann (Keira Knightley) from the cursed crew of the \"Black Pearl\", captained by Hector Barbossa (Geoffrey Rush), who become undead skeletons at night.", "Jay Wolpert developed a script in 2001, and Stuart Beattie rewrote it in early 2002.", "Around that time, producer Jerry Bruckheimer became involved in the project; he had Ted Elliott and Terry Rossio work on the script, adding the plot device of a supernatural curse to the story to bring it in line with the original theme park ride.", "Filming took place from October 2002 to March 2003 in Saint Vincent and the Grenadines and on sets constructed around Los Angeles, California.", "It was also significant in being the first film released under the Walt Disney Pictures banner to be rated PG-13 by the MPAA." ] ], "gold": "Pirates of the Caribbean is a series of fantasy swashbuckler films produced by Jerry Bruckheimer that were based on Walt Disney's theme park attraction of the same name. Captain Jack Sparrow is a fictional character and the main protagonist of the film series. Johnny Depp played the adult character in the film. The young Captain Jack Sparrow character was played by Anthony De La Torre.", "prediction 1": "Captain Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp. The characterization of Sparrow is based on a combination of The Rolling Stones' guitarist Keith Richards and Looney Tunes cartoon character Pep\u00e9 Le Pew. In the Pirates of the Caribbean films, the role of Captain Sparrow was first played by Orlando Bloom in the 2003 film.", "prediction 2": "Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp. In the 2006 film Pirates of the Caribbean: The Curse of the Black Pearl, the character is played by Geoffrey Rush.", "prediction 3": "Captain Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp. The characterization of Sparrow is based on a combination of The Rolling Stones' guitarist Keith Richards and Looney Tunes cartoon character Pep\u00e9 Le Pew. In the films, Sparrow is one of the nine pirate lords in the Brethren Court, the Pirate Lords of the Seven Seas. In the 2003 film, the ride, the character of Sparrow was added to it.", "prediction 4": "Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp. The characterization of Sparrow is based on a combination of The Rolling Stones' guitarist Keith Richards and Looney Tunes cartoon character Pep\u00e9 Le Pew. In the movies, Sparrow is one of the nine pirate lords in the Brethren Court, the Pirate Lords of the Seven Seas. Johnny Depp plays Sparrow.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 350 }, { "error type": "Redundant", "explanation": "Captain Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. The character was created by screenwriters Ted Elliott and Terry Rossio, and is portrayed by Johnny Depp.", "start": 351, "end": 469 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Captain Jack Sparrow is a fictional character in the Pirates of the Caribbean film series. Produced by Walt Disney Pictures and Jerry Bruckheimer, the film is based on Walt Disney's \"Pirates of the Caribbean\" attraction at Disney theme parks. The character is portrayed by Johnny Depp. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is haley's boyfriend on modern family?", "passages": [ [ "Grill, Interrupted", "Meanwhile, Andy (Adam Devine) wants to talk to Haley (Sarah Hyland) about his feelings, since it is the first time he will see her after the events of \"Closet?", "You'll Love It!", "\", where Haley told him that he has a shot with her while she thought he was sleeping.", "Andy is nervous and Haley appearing with her new boyfriend Will (Nick Ballard) does not help the situation.", "A series of mishaps leaves Andy and Haley in bed together and, later, Haley removing her clothes due to a drink spillage, but Will does not suspect Andy, nor feeling threatened by him.", "When Haley leaves the room, Will asks Andy to help him come up with a message for a card for Haley, but once Will leaves Haley struggles to read the handwriting.", "She asks Andy to read it to her and gets frustrated about how clingy Will is already after only two weeks of dating.", "Haley kisses Andy on the cheek and heads downstairs, leaving him both disappointed and hopeful.", "Alex (Ariel Winter) finds out she has been accepted into Caltech, but she is acting strange after her parents' reaction.", "Claire blames herself for never praising Alex's achievements because she expects them from her, and begins to overtly praise Alex in front of the whole family, leaving Alex embarrassed and irritated." ], [ "Pilot (Modern Family)", "Back at the Dunphy residence, Haley has invited Dylan (Reid Ewing), a senior boy from her high school, over.", "Claire instructs Phil to \"scare him\", but Phil hurts his back in the process and Dylan is forced to carry Phil to the couch.", "Haley brings her boyfriend upstairs and grows annoyed when Claire constantly checks on them.", "Haley goes downstairs to complain to Phil, who is preparing to shoot Luke against his will.", "Phil though, accidentally shoots Luke, Dylan, and then himself.", "After the soccer game, Jay is mistaken for a mall walker so he decides to buy some 'hip' new clothes.", "Meanwhile, Manny reads a poem for the sixteen-year-old and is crushed when she says she has a boyfriend.", "The last scene is at Mitchell and Cameron's house where Lily is going to be introduced to the rest of the family and is revealed for the first time that all the characters are related.", "Jay is Mitchell & Claire's father.", "Before Lily is introduced, Jay, who is unsure if Mitchell and Cameron are ready for fatherhood, suggests that if they are bored, they should get a dog.", "Cameron enters, holding Lily aloft before the family while \"Circle of Life\" from \"The Lion King\" plays.", "Eventually, the whole family accepts the adoption and welcomes Lily as part of their family." ], [ "Modern Family", "Modern Family\n\nModern Family is an American television mockumentary family sitcom that premiered on ABC on September 23, 2009, which follows the lives of Jay Pritchett and his family, all of whom live in suburban Los Angeles.", "Pritchett's family includes his second wife, their son and his stepson, as well as his two adult children and their spouses and children.", "Christopher Lloyd and Steven Levitan conceived the series while sharing stories of their own \"modern families\".", "\"Modern Family\" employs an ensemble cast.", "The series is presented in mockumentary style, with the characters frequently talking directly into the camera.", "The series was renewed for a tenth season on May 10, 2017, which premiered on September 26, 2018.", "Co-creators Levitan and Lloyd have stated that the tenth season is planned to be the series' final, with talks of a spin-off.", "\"Modern Family\" was acclaimed by critics throughout its first few seasons, although reception has become more mixed as the series has progressed.", "The show won the Emmy Award for Outstanding Comedy Series in each of its first five years and the Emmy Award for Outstanding Supporting Actor in a Comedy Series four times, twice each for Eric Stonestreet and Ty Burrell, as well as the Outstanding Supporting Actress in a Comedy Series twice for Julie Bowen.", "It has so far won a total of 22 Emmy awards from 75 nominations." ] ], "gold": "Modern Family is an American family sitcom television series that follows the lives of three diverse families in LA and ran on ABC for eleven seasons, from September 23, 2009, to April 8, 2020. On the show, the character of Haley Dunphy is portrayed as the stereotypical teenager and is depicted as being a flirt, who focuses more on social status than studies. Haley's had a few different boyfriends during the run of the show including Andy Bailey in season 6-7, Rainer Shine in season 8, and Dr. Arvin Fennerman in season 9. Dylan Marshall was Haley's on and off boyfriend throughout the series, who was introduced when she was in high school and who is the man she eventually called her husband on the show.", "prediction 1": "On Modern Family, Haley has a boyfriend, Will, played by Nick Ballard. Will is Haley's boyfriend on the show.", "prediction 2": "Modern Family is an American television mockumentary sitcom that premiered on ABC on September 23, 2009. The show follows the lives of Jay Pritchett and his family, all of whom live in suburban Los Angeles. Haley's boyfriend is Dylan, played by Reid Ewing.", "prediction 3": "Modern Family is an American television mockumentary sitcom that premiered on ABC on September 23, 2009, following the lives of Jay Pritchett and his family, all of whom live in suburban Los Angeles. Haley's boyfriend on the show is Will, played by Nick Ballard.", "prediction 4": "Haley's boyfriend on modern family is Will. Nick Ballard plays Will. Haley's boyfriend on modern family is Dylan.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1, 3 ] } ], "corrected-prediction": "On Modern Family is an American television mockumentary family sitcom that premiered on ABC on September 23, 2009. Haley Dunphy has more than one boyfriend. She has dated Dylan, Will, and Andy. " }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "What type of server does active director run on?", "passages": [ [ "Active Directory", "Active Directory Services consist of multiple directory services.", "The best known is Active Directory Domain Services, commonly abbreviated as AD DS or simply AD.", "Active Directory Domain Services (AD DS) is the cornerstone of every Windows domain network.", "It stores information about members of the domain, including devices and users, verifies their credentials and defines their access rights.", "The server (or the cluster of servers) running this service is called a domain controller.", "A domain controller is contacted when a user logs into a device, accesses another device across the network, or runs a line-of-business Metro-style app sideloaded into a device.", "Other Active Directory services (excluding LDS, as described below) as well as most of Microsoft server technologies rely on or use Domain Services; examples include Group Policy, Encrypting File System, BitLocker, Domain Name Services, Remote Desktop Services, Exchange Server and SharePoint Server.", "Active Directory Lightweight Directory Services (\"AD LDS\"), formerly known as \"Active Directory Application Mode\" (ADAM), is a light-weight implementation of AD DS.", "AD LDS runs as a service on Windows Server.", "AD LDS shares the code base with AD DS and provides the same functionality, including an identical API, but does not require the creation of domains or domain controllers." ] ], "gold": "Active Directory Lightweight Directory Services (\"AD LDS\"), formerly known as \"Active Directory Application Mode\" (ADAM), is a light-weight implementation of AD DS. AD LDS runs as a service on Windows Server. Active Directory Domain Services (AD DS) is the cornerstone of every Windows domain network. The server running this service is called a domain controller. A domain controller is contacted when a user logs into a device, accesses another device across the network, or runs a line-of-business Metro-style app sideloaded into a device.", "prediction 1": "Active Directory is a directory service provided by Microsoft that resides on Microsoft Windows Server 2008 R2. Active Directory Domain Services (AD DS) is the cornerstone of every Windows domain network. The server (or the cluster of servers) running this service is called a domain controller. Active Directory Lightweight Directory Services (\"AD LDS\"), formerly known as \"Active Directory Application Mode\" (ADAM), is a light-weight implementation of AD DS. AD LDS runs as a service on Windows Server 2008.", "prediction 2": "Active Directory runs as a service on Windows Server. Active Directory Lightweight Directory Services (\"AD LDS\") is a light-weight implementation of Active Directory DS. AD LDS runs as a service on Windows Server. It is formerly known as Active Directory Application Mode (ADAM).", "prediction 3": "Active Directory Domain Services (AD DS) is the cornerstone of every Windows domain network. The server or the cluster of servers running this service is called a domain controller. A domain controller is contacted when a user logs into a device, accesses another device across the network, or runs a line-of-business Metro-style app sideloaded into a device. Active Directory Lightweight Directory Services (\"AD LDS\"), formerly known as \"Active Directory Application Mode\" (ADAM), is a light-weight implementation of AD DS. AD LDS runs as a service on Windows Server.", "prediction 4": "Active Directory runs as a service on Windows Server. Active Directory Lightweight Directory Services (AD LDS) is a light-weight implementation of AD DS. AD LDS runs as a service on Windows Server 2012 R2. Active Directory DS runs as a service on Windows Server 2012 R2.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 243 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 111 }, { "error type": "Unverifiable", "explanation": "", "start": 504, "end": 509 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Active Directory Domain Services (AD DS) is the cornerstone of every Windows domain network. The server running this service is called a domain controller. A domain controller is contacted when a user logs into a device, accesses another device across the network, or runs a line-of-business Metro-style app sideloaded into a device. Active Directory Lightweight Directory Services (\"AD LDS\"), formerly known as \"Active Directory Application Mode\" (ADAM), is a light-weight implementation of AD DS. AD LDS runs as a service on Windows Server." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sang what a lucky man he was?", "passages": [ [ "Lucky Man (Emerson, Lake & Palmer song)", "Lucky Man (Emerson, Lake & Palmer song)\n\n\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album.", "Written by Greg Lake when he was 12 years old and recorded by the trio using improvised arrangements, \nthe song contains one of rock music's earliest instances of a Moog synthesizer solo.", "\"Lucky Man\" was released as a single in 1970 and reached the top 20 in the Netherlands.", "The song also charted in the United States and Canada.", "The single was re-released in 1973 and charted again in the U.S. and Canada.", "The origin of the song, as stated by Greg Lake in interviews, is that it was the first song he wrote, when his mother bought him a guitar at the age of 12.", "With the first chords he learned (D, A minor, E minor, and G), he wrote an acoustic version of the song.", "The song came to be used on Emerson, Lake & Palmer's debut album when they needed one more song.", "Greg played the version he had written from childhood, and the rest of the band did not like it, or feel it would fit.", "Lake then worked on it in the studio with Carl Palmer." ], [ "Shaw Blades", "Shaw Blades\n\nShaw\u2013Blades is an American musical duo/group formed by Tommy Shaw of Styx and Jack Blades of Night Ranger, both of whom played in the supergroup Damn Yankees.", "It is an informal duo which has produced two albums between other projects, 1995s \"Hallucination\" and 2007s \"Influence\".", "The first two songs on \"Hallucination\" -- \"My Hallucination\" and \"I'll Always Be with You\"\u2014received modest airplay.", "\"Influence\" consisted solely of 1960s and 1970s cover songs that influenced them.", "Blades' son Colin, an experimental songwriter himself, contributed backing vocals and arrangements to the album.", "Shaw-Blades also recorded a cover of the classic Christmas song \"The Twelve Days of Christmas\" on the \"A Classic Rock Christmas\" album by various classic rock artists in 2002.", "Shaw\u2013Blades did a short tour of America in Spring 2007 and another in Autumn 2007.", "Both members still principally record and perform with the acts which made them famous.", "\"California Dreamin'\" was used at the end of the last episode of season 2 of the TV show \"Californication\".", "\"My Hallucination\" was used in the movie \"Tommy Boy\"." ], [ "Emerson, Lake & Palmer", "Emerson, Lake & Palmer\n\nEmerson, Lake & Palmer (ELP) were an English progressive rock supergroup formed in London in 1970.", "The band consisted of keyboardist Keith Emerson; singer, bassist, guitarist and producer Greg Lake; and drummer and percussionist Carl Palmer.", "With nine RIAA-certified gold record albums in the US, and an estimated 48 million records sold worldwide, they were one of the most popular and commercially successful progressive rock bands in the 1970s, with a musical sound including adaptations of classical music with jazz and symphonic rock elements, dominated by Emerson's flamboyant use of the Hammond organ, Moog synthesizer, and piano (although Lake wrote several acoustic songs for the group).", "The band came to prominence following their performance at the Isle of Wight Festival in August 1970.", "In their first year, the group signed with E.G. Records (who distributed the band's records through Island Records in the United Kingdom, and Atlantic Records in North America), and released \"Emerson, Lake & Palmer\" (1970) and \"Tarkus\" (1971), both of which reached the UK top five.", "The band's success continued with \"Pictures at an Exhibition\" (1971), \"Trilogy\" (1972), and \"Brain Salad Surgery\" (1973, released on ELP's own Manticore Records label)." ] ], "gold": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album. The 2007 version was sung by Shaw Blades, American musical duo/group formed by Tommy Shaw of Styx and Jack Blades of Night Ranger. The 2013 version was sung by Greg Lake, an English singer, songwriter, bassist, guitarist and record producer. In 2014, Asia featuring John Payne sung a version of \"Lucky Man\".", "prediction 1": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album. Written by Greg Lake when he was 12 years old and recorded by the trio using improvised arrangements, the song contains one of rock music's earliest instances of a Moog synthesizer solo. The origin of the song, as stated by Greg Lake in interviews, is that it was the first song he wrote, when his mother bought him a guitar at the age of 12.", "prediction 2": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer from the group's 1970 self-titled debut album. Written by Greg Lake when he was 12, the song was released as a single in 1970 and reached the top 20 in the Netherlands. With the first chords he learned (D, A minor, E minor, and G), he wrote an acoustic version of the song. Shaw Blades, an American musical duo/group formed by Tommy Shaw of Styx and Jack Blades of Night Ranger, both of whom played in the supergroup Damn Yankees.", "prediction 3": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album. Written by Greg Lake when he was 12, the song was released as a single in 1970 and reached the top 20 in the Netherlands. With the first chords he learned (D, A minor, E minor, and G), he wrote an acoustic version of the song. It came to be used on Emerson, Lake & Palmer's debut album when they needed one more song. The band recorded a cover of the classic Christmas song The Twelve Days of Christmas on the \"A Classic Rock Christmas\" album by various classic rock artists in 2002.", "prediction 4": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album. It was written by Greg Lake when he was 12 years old and recorded by the trio using improvised arrangements. \"Lucky Man\" was released as a single in 1970 and reached the top 20 in the Netherlands. The single was re-released in 1973 and charted again in the United States and Canada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 322 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 478 } ], "missing-info": [], "corrected-prediction": "\"Lucky Man\" is a song by the English progressive rock supergroup Emerson, Lake & Palmer, from the group's 1970 self-titled debut album. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who wrote the music for fantastic beasts and where to find them?", "passages": [ [ "Fantastic Beasts: The Crimes of Grindelwald (soundtrack)", "Fantastic Beasts: The Crimes of Grindelwald (soundtrack)\n\nFantastic Beasts: The Crimes of Grindelwald is the film score to the 2018 composed by James Newton Howard.", "The soundtrack was released digitally on 9 November 2018 by WaterTower Music.", "James Newton Howard who previously scored the previous film confirmed in a podcast that he would be returning to score the sequel.", "Newton Howard said in a interview that he saw a \"wonderful musical opportunity\" with the Fantastic Beasts: The Crimes of Grindelwald due to depth of the film.", "Howard further stated that he had a passionate and enthusiastic collaboration with director David Yates who he said focused a lot on the musical aspect of the film.", "The last 3 tracks which appear on the album are piano solos of the individual themes, that James Newton Howard performed himself and will not appear in the film.", "These tracks were released on 26 October 2018.", "In January 2019, a vinyl record of the soundtrack is planned to be released.", "Unlike the soundtrack for the first movie, there has been no word on a deluxe edition." ], [ "Fantastic Beasts and Where to Find Them (film)", "On 24 October, Pottermore published an official first look at the film's main theme composed by Howard.", "The main theme incorporated John Williams' themes from earlier films, such as \"Hedwig's Theme\".", "The soundtrack was released by WaterTower Music on 18 November 2016.", "\"Fantastic Beasts and Where to Find Them\" had its world premiere at Alice Tully Hall in New York City on 10 November 2016.", "The film was released worldwide on 18 November 2016, in 2D, 3D and the new IMAX 4K Laser system.", "It would premiere one day earlier in a number of other countries, including Argentina, Australia, Brazil, Germany and Italy, on 17 November.", "The film would be released in a total of 1,028 IMAX screens worldwide (388 screens in the United States and Canada, 347 screens in China, 26 screens in Japan and 267 screens in other countries).", "This marked the second time\u2014after \"Doctor Strange\"\u2014that a film secured a release in over 1,000 IMAX screens worldwide.", "On 4 November 2015, \"Entertainment Weekly\" released the first official publicity shots of the film, containing pictures of characters Newt, Tina, and Queenie, and production and filming being held in various sets designed to mirror 1920s New York City." ], [ "James Newton Howard", "Howard composed the score for the fantasy drama \"Fantastic Beasts and Where to Find Them\", a spin-off/prequel of the \"Harry Potter\" film series, and for its sequel, \"\".", "In May 2008, he was made an Honorary Member of the Royal Academy of Music.", "In October 2015, he was honored with the Max Steiner Film Music Achievement Award during the annual Hollywood in Vienna concert." ], [ "Fantastic Beasts: The Crimes of Grindelwald", "Fantastic Beasts: The Crimes of Grindelwald\n\nFantastic Beasts: The Crimes of Grindelwald is a 2018 fantasy film directed by David Yates and written by J. K. Rowling.", "A joint British and American production, it is the sequel to \"Fantastic Beasts and Where to Find Them\" (2016).", "It is the second instalment in the \"Fantastic Beasts\" film series, and the tenth overall in the Wizarding World franchise, which began with the \"Harry Potter\" film series.", "The film features an ensemble cast that includes Eddie Redmayne, Katherine Waterston, Dan Fogler, Alison Sudol, Ezra Miller, Zo\u00eb Kravitz, Callum Turner, Claudia Kim, William Nadylam, Kevin Guthrie, Jude Law, and Johnny Depp.", "The plot follows Newt Scamander and Albus Dumbledore as they attempt to take down the dark wizard Gellert Grindelwald, while facing new threats in a more divided wizarding world.", "A second \"Fantastic Beasts\" film was announced in October 2014, and in July 2016 Rowling confirmed she had completed the script.", "Depp was cast in November 2016, causing some controversy due to domestic violence allegations recently made against him, and Law signed on in April 2017.", "Principal photography on the film began at Warner Bros. Studios in Leavesden in July 2017." ] ], "gold": "Fantastic Beasts and Where to Find Them is the film score to the 2016 film of the same name, written and composed by James Newton Howard. On 9 April 2016, the film's website announced that James Newton Howard would write and compose the score. On 24 October 2016, Pottermore published an official first look at the film's main theme composed by Howard. The main theme incorporated John Williams' themes from earlier films, such as Hedwig's Theme. Additionally, James Newton Howard composed the score for Fantastic Beasts: The Crimes of Grindelald, the 2018 sequel to Fantastic Beasts and Where to Find Them.", "prediction 1": "Fantastic Beasts: The Crimes of Grindelwald is the sequel to the 2016 film Fantastic Beasts and Where to Find Them, which was directed by David Yates and written by J. K. Rowling. Director David Yates said in a podcast that he would be returning to score the sequel. The music for the sequel was composed by James Newton Howard.", "prediction 2": "Fantastic Beasts: The Crimes of Grindelwald is the sequel to Fantastic Beasts and Where to Find Them. The film's music was composed by James Newton Howard, who also composed the score for the 2016 film. In May 2008, he was made an Honorary Member of the Royal Academy of Music. In October 2015, he was honored with the Max Steiner Film Music Achievement Award during the annual Hollywood in Vienna concert.", "prediction 3": "Fantastic Beasts: The Crimes of Grindelwald is a 2018 fantasy film directed by David Yates and written by J. K. Rowling. The film's soundtrack was composed by James Newton Howard. The score was released digitally on 9 November 2018 by WaterTower Music.", "prediction 4": "Fantastic Beasts: The Crimes of Grindelwald is a 2018 fantasy drama film written and directed by J. K. Rowling. James Newton Howard wrote the music for the film, which was released digitally on 9 November 2018 by WaterTower Music. The film's soundtrack was released digitally on 9 November 2018 by WaterTower Music.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 179 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 180, "end": 200 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 266 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Fantastic Beasts: The Crimes of Grindelwald is the sequel to the 2016 film Fantastic Beasts and Where to Find Them. The music for the sequel was composed by James Newton Howard. Howard composed the score for the fantasy drama \"Fantastic Beasts and Where to Find Them\" as well. On 24 October, Pottermore published an official first look at the film's main theme composed by Howard. The main theme incorporated John Williams' themes from earlier films, such as \"Hedwig's Theme\"." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Where did they film return of the jedi endor?", "passages": [ [ "Redwood National and State Parks", "This expansion protected the watershed along Redwood Creek from being adversely affected by logging operations outside the park.", "The federal and state parks were administratively combined in 1994.", "The United Nations designated Redwood National and State Parks a World Heritage Site on September 5, 1980.", "The evaluation committee noted 50 prehistoric archaeological sites, spanning 4,500\u00a0years.", "It also cited ongoing research in the park by Humboldt State University researchers, among others.", "The park is part of a much larger region designated the \"California Coast Ranges\" International Biosphere Reserve on June 30, 1983.", "The California Coast Ranges biosphere is overseen by the University of California Natural Reserve System.", "The park has served as a filming location for numerous films.", "Scenes set on the forest moon Endor in \"\" were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County, though the majority of filming was in private and public forests near the town of Smith River, California.", "Scenes for \"\" as well as the movie \"Outbreak\" were filmed at the nearby Prairie Creek Redwoods State Park and at Patrick's Point State Park.", "Redwood National Park headquarters is located in Crescent City, California, with a service office located in Arcata and an operations center located in Orick, California.", "Lack of money has precluded major improvements, however, and timber companies have replanted much of the logged area with non-native tree species." ], [ "Return of the Jedi", "Return of the Jedi\n\nReturn of the Jedi (also known as Star Wars: Episode VI \u2013 Return of the Jedi is a 1983 American epic space opera film directed by Richard Marquand.", "The screenplay is by Lawrence Kasdan and George Lucas from a story by Lucas, who was also the executive producer.", "It is the third and final installment in the original \"Star Wars\" trilogy, set one year after \"The Empire Strikes Back\".", "The film stars Mark Hamill, Harrison Ford, Carrie Fisher, Billy Dee Williams, Anthony Daniels, David Prowse, Kenny Baker, Peter Mayhew and Frank Oz.", "The Galactic Empire, under the direction of the ruthless Emperor, is constructing a second Death Star in order to crush the Rebel Alliance once and for all.", "Since the Emperor plans to personally oversee the final stages of its construction, the Rebel Fleet launches a full-scale attack on the Death Star in order to prevent its completion and kill the Emperor, effectively bringing an end to his hold over the galaxy.", "Meanwhile, Luke Skywalker struggles to bring his father Darth Vader back to the light side of the Force.", "David Lynch and David Cronenberg were considered to direct the project before Marquand signed on as director.", "The production team relied on Lucas' storyboards during pre-production." ] ], "gold": "In the 1983 epic space opera film Return of the Jedi, scenes set on Endor were filmed on private logging company land that was shortly thereafter clear-cut near the town of Smith River, California. The speeder chase scene was filmed at the Chetham Grove section of Grizzly Creek Redwoods State Park, near the \"Avenue of the Giants\" in Humboldt Redwoods State Park.", "prediction 1": "Return of the Jedi is a 1983 American epic space opera film directed by Richard Marquand. Scenes set on the forest moon Endor in the film were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County. The majority of filming was in private and public forests near the town of Smith River, California.", "prediction 2": "Return of the Jedi is a 1983 American epic space opera film directed by Richard Marquand. Scenes set on the forest moon Endor in the film were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County, though the majority of filming was in private and public forests near the town of Smith River, California. The movie Outbreak was filmed in the nearby Prairie Creek Redwoods State Park and at Patrick's Point State Park, as well as the park headquarters.", "prediction 3": "Scenes set on the forest moon Endor in Return of the Jedi were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County, though the majority of filming was in private and public forests near the town of Smith River, California. The movie \"Outbreak\" was also filmed near the park, in Prairie Creek Redwoods State Park and at Patrick's Point State Park.", "prediction 4": "Return of the Jedi is a 1983 American epic space opera film directed by Richard Marquand. Scenes set on the forest moon Endor in the film were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County, though the majority of filming was in private and public forests near the town of Smith River, California. In addition, scenes for Return of the Jedi Episode VII were filmed in the Prairie Creek Redwoods State Park and at Patrick's Point State Park.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 322 }, { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 89 } ], "missing-info": [], "corrected-prediction": "Return of the Jedi is a 1983 American epic space opera film. Scenes set on the forest moon Endor in the film were filmed in the Tall Trees Redwood Grove in the northern part of Humboldt County. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When is the nathan's hotdog eating contest at coney island?", "passages": [ [ "Nathan's Hot Dog Eating Contest", "The belt is of \"unknown age and value\" according to IFOCE co-founder George Shea and rests in the country of its owner.", "In 2011, Sonya Thomas won the inaugural women's competition and its \"bejeweled\" pink belt.", "Various other prizes have been awarded over the years.", "For example, in 2004 Orbitz donated a travel package to the winner.", "Starting in 2007, cash prizes have been awarded to the top finishers.", "The Nathan's Hot Dog Eating Contest has been held at the original location on Coney Island most years since about 1972, usually in conjunction with Independence Day.", "Nathan's promoter Mortimer Matz claimed that on July 4, 1916, four immigrants held a hot dog eating contest at Nathan's Famous stand on Coney Island to settle an argument about who was the most patriotic.", "He also made the spurious claim that the contest has been held each year since then except 1941 (\"as a protest to the war in Europe\") and 1971 (as a protest to political unrest in the U.S.).", "A man by the name of Jim Mullen is said to have won the first contest, although accounts vary.", "One account describes Jimmy Durante (who was \"not\" an immigrant) as competing in that all-immigrant inaugural contest, which was judged by Eddie Cantor and Sophie Tucker." ], [ "Joey Chestnut", "In 2013, Chestnut captured his seventh straight title, eating a total of 69 HDB, breaking his previous world record.", "In 2014, Chestnut captured his eighth straight title eating a total of 61 HDB.", "Chestnut proposed to his longtime girlfriend Neslie Ricasa just before defending his title in the 2014 Nathan's competition.", "The couple split up in early 2015, prior to their scheduled wedding date.", "Chestnut lost the 2015 Hot Dog eating contest to Matt Stonie.", "On July 4, 2016, Chestnut regained the championship belt from Stonie by eating 70 hot dogs; 3.5 hot dogs short of his record-setting qualifying round.", "A year later on July 4, 2017, he raised the bar again by raising his record to 72 hot dogs; and again the following year to a world record of 74.", "Chestnut, a San Jose State University student, entered the competitive eating scene in 2005 with a break-out performance in the deep-fried asparagus eating championship, in which he beat high-ranked eater Rich LeFevre by eating 6.3 pounds of asparagus in 11.5 minutes.", "That same year, during Nathan's Famous Fourth of July International Hot Dog Eating Contest, he downed 32 dogs, placing third behind Takeru Kobayashi and Sonya Thomas." ], [ "Nathan's Famous", "Service is provided year-round inside, and during the summer additional walk-up windows are opened to serve the larger seasonal crowds.", "Nathan's also operates a second, smaller location nearby on the Coney Island boardwalk.", "The Nathan's Hot Dog Eating Contest has been held annually at the original location on Coney Island since the early 1970s on the 4th of July.", "Contestants try to consume as many hot dogs as possible in 10 minutes.", "Winners include Takeru Kobayashi (2001\u20132006), Joey Chestnut (2007\u20132014, 2016\u20132018) and Miki Sudo (women's 2014\u20132018).", "In 2008, Chestnut tied Kobayashi after eating 59 hot dogs and buns in 10 minutes.", "The tie resulted in a five hot dog eat-off, which Chestnut won by consuming all five before Kobayashi.", "In 2018, Chestnut consumed 74 hot dogs and buns for a new world record." ] ], "gold": "The Nathan's Hot Dog Eating Contest, held annually, is a competition that has been held at the original location on Coney Island most years since about 1972, usually in conjunction with Independence Day. The contest has been held on July 4, 2016, July 4, 2017, and July 4, 2018.", "prediction 1": "The Nathan's Hot Dog Eating Contest has been held at the original location on Coney Island most years since 1972, usually in conjunction with Independence Day. The inaugural men's contest was held on July 4, 1916 and the inaugural women's contest was held on July 4, 2015. The first men's contest was held on July 4, 2014. The second men's contest was held July 4, 2017.", "prediction 2": "The Nathan's Hot Dog Eating Contest has been held at the original location on Coney Island since the early 1970s on the 4th of July. Nathan's promoter Mortimer Matz claimed that on July 4, 1916, four immigrants held a hot dog eating contest at Nathan's Famous stand on Coney Island to settle an argument about who was the most patriotic. He also made the spurious claim that the contest has been held each year since then except 1941 (\"as a protest to the war in Europe\") and 1971 (as a protest to political unrest in the U.S.S.S.", "prediction 3": "The Nathan's Hot Dog Eating Contest has been held at the original location on Coney Island most years since about 1972, usually in conjunction with Independence Day. The contest has been held annually at the original location since the early 1970s on the 4th of July. Nathan's promoter Mortimer Matz claimed that on July 4, 1916, four immigrants held a hot dog eating contest at Nathan's Famous stand on Coney Island to settle an argument about who was the most patriotic.", "prediction 4": "Nathan's Hot Dog Eating Contest has been held at the original location on Coney Island most years since about 1972, usually in conjunction with Independence Day. The contest was originally started on July 4, 1916, when four immigrants held a hot dog eating contest at Nathan's Famous stand on Coney Island to settle an argument about who was the most patriotic.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 160, "end": 272 }, { "error type": "Unverifiable", "explanation": "", "start": 273, "end": 322 }, { "error type": "Unverifiable", "explanation": "", "start": 323, "end": 370 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Nathan's Hot Dog Eating Contest has been held annually at the original location on Coney Island most years since 1972, usually in conjunction with Independence Day. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does 999 what's your emergency start?", "passages": [ [ "999: What's Your Emergency?", "999: What's Your Emergency?", "999: What's Your Emergency?", "is a British factual programme, following the emergency service.", "Series 1 followed all 3 frontline services in Blackpool, Lancashire.", "Series 2 followed ambulance services throughout the UK.", "Series 3 followed the work of the police and ambulance services in Cheshire.", "Series 4 followed the work of police and ambulance services in Wiltshire.", "The first series was filmed in Blackpool over 6 weeks in 2011 and follows members of the Police service, the Fire service and Ambulance service as they work together to tackle crime and disorder in Blackpool.", "The third series was announced on 27 June 2016 to be starting on 4 July 2016 on Channel 4.", "This series follows the Ambulance service and Police force in Cheshire as they attend a wide range of urgent and not so urgent call outs.", "A fourth series was announced on the 1 January 2017 which will start to air in July 2017.", "The series will follow the emergency services in Wiltshire.", "Every episode highlights issues ranging from the damage caused by drugs and alcohol to the reality of domestic violence, and from the dysfunctional way that some people bring up their children to the plight of those who slip through society's safety net, with one or multiple issues raised per episode.", "All episode ratings are taken from the BARB website and include Channel 4 and Channel 4+1." ] ], "gold": "999: What's Your Emergency? is a British television documentary with several seasons. Season 3 started on 4 July 2016, season 4 started on 24 July 2017. The premiere episode of season 5 aired on 30 October 2017, the fifth episode of season 5 aired on 27 November 2017, the sixth episode of season 5 aired on 4 December 2017, while the seventh episode aired on 11 December 2017. As of 2021 the show is in its thirteenth season.", "prediction 1": "999: What's Your Emergency? is a British factual programme, following the emergency service. Series 1 followed all 3 frontline services in Blackpool, Lancashire. Series 2 followed ambulance services throughout the UK. Series 3 followed the work of the police and ambulance services in Cheshire. Series 4 followed the work of police and ambulance services in Wiltshire. The series 5 premiere was on 1 July 2016.\n", "prediction 2": "999: What's Your Emergency? is a British factual programme, following the emergency service. Series 1 followed all 3 frontline services in Blackpool, Lancashire. Series 2 followed ambulance services throughout the UK. Series 3 followed the work of the police and ambulance services in Cheshire. Series 4 followed the work of police and ambulance services in Wiltshire. Series 5 started on 13 October 2015.", "prediction 3": "999: What's Your Emergency? is a British factual series, following the emergency service. Series 1 was filmed in Blackpool over 6 weeks in 2011 and follows members of the Police service, the Fire service and Ambulance service as they work together to tackle crime and disorder in Blackpool. Series 2 was filmed throughout the UK, and was called My Emergency. Series 3 was called My Emergency. It began airing on 4 July 2016 on Channel 4, and was called My Emergency in Wiltshire. The television show finished its sixth series on 22 November 2015.", "prediction 4": "999: What's Your Emergency? is a British factual programme, following the emergency service. The series 1 started on 27 June 2016 and the series 2 started on 14 July 2016. The series 3 started on 4 July 2016 and the series 4 started on 15 January 2017. Series 4 started on 7 January 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 294 }, { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 368 }, { "error type": "Unverifiable", "explanation": "", "start": 369, "end": 411 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "999: What's Your Emergency? is a British factual programme. The first series was filmed in 2011. The third series started on 4 July 2016. A fourth series was announced on the 1 January 2017 which will start to air in July 2017." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played count dooku in star wars the clone wars?", "passages": [ [ "Count Dooku", "Count Dooku\n\nCount Dooku is a fictional character in the \"Star Wars\" franchise, appearing in \"\" and \"\" as a primary and minor antagonist respectively.", "He was portrayed by Christopher Lee and voiced by Corey Burton in the animated series \"\" and \"\".", "Once a respected Jedi Master who was trained by Yoda as a Padawan learner, Dooku fell to the Dark side of the Force after the death of his former Padawan - Qui-Gon Jinn - and becomes Darth Sidious's second apprentice under the name \"Darth Tyranus\".", "As the leader of the Confederacy of Independent Systems, he is instrumental in the Clone Wars before eventually getting killed by Anakin Skywalker in \"Revenge of the Sith\".", "Introduced in \"\", Count Dooku appears as the leader of the Confederacy of Independent Systems, a federation of planetary systems rebelling against the Galactic Republic.", "He says that the Republic is corrupt, and that its politicians are more interested in maintaining the bureaucracy and enriching themselves than in helping poor, oppressed systems.", "Dooku recruits bounty hunter Jango Fett to assassinate Padm\u00e9 Amidala on Coruscant; the attempt on her life fails, however.", "When a fight with Obi-Wan Kenobi forces Fett to flee from Kamino to Geonosis, the bounty hunter rendezvous with his benefactor." ], [ "Count Dooku", "A number of toys based on Count Dooku have been produced, including the Lego set \"Lego Star Wars: Duel on Geonosis\" which recreates the duel between Jedi master Yoda and the Count Dooku, and a Hasbro Count Dooku lightsaber.", "Count Dooku was portrayed by Christopher Lee in \"Attack of the Clones\" and \"Revenge of the Sith\", while Kyle Rowling performed the lightsaber action sequences.", "The character was voiced by Corey Burton in \"\" (as well as most of the video games).", "Lee reprised his role to voice the character in the , while Burton returned to voice the character in the ." ], [ "Star Wars: Jedi", "She is a very well respected warrior, known for slaying Artel Darc and surviving an encounter with General Grievous.", "Shaak Ti is portrayed in the Star Wars films by Orli Shoshan in Episodes II & III.", "Aayla Secura was first brought into the Star Wars saga by Dark Horse Comics.", "George Lucas took a liking to the character and decided to use her.", "Aayla Secura is a female Twi'lek, an exotic bluish alien species, from the planet Ryloth.", "Aayla is very skilled in lightsaber combat.", "She was a Jedi Knight and Clone Wars General.", "Aayla caved to the Dark Side for a period when she was involved with Volfe Karkko.", "She died in the tragedy of Order 66 on Felucia.", "Aayla Secura is portrayed in the Star Wars films by Amy Allen in Episodes II & III.", "Dooku, also known as Darth Tyranus or Count Dooku, is a male Human from the planet Serenno.", "Padawan of Yoda and Master of Qui-Gon Jin.", "Dooku was a master swordsman known throughout the galaxy.", "He served as a combat instructor in the Jedi Temple.", "It is said that only Mace Windu and Yoda are considered on equal terms.", "Dooku was a Jedi Master turned Sith Lord." ] ], "gold": "Count Dooku is a fictional character in the Star Wars franchise, created by George Lucas. One of the main antagonists of the Star Wars prequel trilogy, he appears in both Episode II \u2013 Attack of the Clones and Episode III \u2013 Revenge of the Sith, played by Christopher Lee with Kyle Rowling as his stunt double in the films. Lee also voiced the character in the Star Wars: The Clone Wars animated film but was replaced by Corey Burton in the subsequent Clone Wars TV series. Burton had previously voiced Dooku in the 2003 micro-series Star Wars: Clone Wars and went on to voice him in most of his video game appearances.", "prediction 1": "Count Dooku is a fictional character in the Star Wars franchise. Christopher Lee played Count Dooku in Attack of the Clones and Revenge of the Sith. Corey Burton voiced Dooku in the animated series \"\" and \"\", while Kyle Rowling performed the lightsaber action sequences.", "prediction 2": "Count Dooku is a fictional character in the Star Wars franchise, appearing in Episodes 4 and 7 as a primary and minor antagonist, respectively. He was portrayed by Christopher Lee in the movies Attack of the Clones and Rebellion of the Sith, while Corey Burton voiced the character in the video games.", "prediction 3": "Count Dooku is a fictional character in the Star Wars franchise. He was portrayed by Christopher Lee in the films Attack of the Clones and Rebellion of the Sith and voiced by Corey Burton in the video games. In the Star Wars Clone Wars, he is voiced by Corey Burton in the video games and the animated series.", "prediction 4": "Christopher Lee played Count Dooku in the video game Star Wars: The Clone Wars. Corey Burton voiced Count Dooku in Star Wars: The Clone Wars.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Count Dooku is a fictional character in the Star Wars franchise. Christopher Lee played Count Dooku in Attack of the Clones and Revenge of the Sith. Corey Burton voiced Dooku in the animated series as well as most of the video games. Kyle Rowling performed the lightsaber action sequences." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Number of languages spoken in the united states?", "passages": [ [ "Languages of the United States", "Languages of the United States\n\nThe most commonly used language in the United States is English (specifically, American English), which is the de facto national language.", "Nonetheless, many other languages are also spoken, or historically have been spoken, in the United States.", "These include indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia.", "There are also several languages, including creoles and sign languages, that developed in the United States.", "Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area.", "Fifty-two languages formerly spoken in the country's territory are now extinct.", "Based on annual data from the American Community Survey (ACS), the U.S. Census Bureau regularly publishes information on the most common languages spoken at home.", "It also reports the English speaking ability of people who speak a language other than English at home.", "In 2015, the U.S. Census Bureau published information on the number of speakers of over 350 languages as surveyed by the ACS from 2009 to 2013, but it does not regularly tabulate and report data for that many languages." ] ], "gold": "The most commonly used language in the United States is English, specifically American English, which is the de facto national language. There are also several languages, including creoles and sign languages, that developed in the United States. Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area. Fifty-two languages formerly spoken in the country's territory are now extinct.", "prediction 1": "The United States has a total of 430 spoken languages. Approximately 176 of them are indigenous languages. Fifty-two languages formerly spoken in the country's territory are now extinct.", "prediction 2": "The most commonly used language in the United States is English, which is the national language. However, many other languages are also spoken, or historically have been spoken, in the United States. These include indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia, as well as languages developed in the United States. Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area. Fifty-two languages formerly spoken in the country's territory are now extinct. Fifty-two languages formerly spoken in the country's territory are now extinct.", "prediction 3": "The number of languages spoken in the United States is approximately 430, the most common language used in the country. In 2015, the U.S. Census Bureau published information on the number of speakers of over 350 languages as surveyed by the ACS from 2009 to 2013. However, it does not regularly tabulate and report data for that many languages.", "prediction 4": "The most commonly used language in the United States is English, which is the de facto national language. However, many other languages are also spoken, or historically have been spoken, in the United States, including indigenous languages, languages brought to the country by colonists, enslaved people and immigrants from Europe, Africa and Asia. Approximately 430 languages are spoken or signed by the population, of which 176 are indigenous to the area. Fifty-two languages formerly spoken in the country's territory are now extinct.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The most commonly used language in the United States is English, specifically American English, which is the de facto national language. There are also several languages, including creoles and sign languages, that developed in the United States. The United States has a total of 430 spoken languages. Approximately 176 of them are indigenous languages. Fifty-two languages formerly spoken in the country's territory are now extinct." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the song rockin robin come out?", "passages": [ [ "Rockin' Robin (song)", "Rockin' Robin (song)\n\n\"Rockin' Robin\" (originally released as \"Rock-In Robin\" on the Class Records 45 single) is a song written by Leon Ren\u00e9 under the pseudonym Jimmie Thomas, and recorded by Bobby Day in 1958.", "It was Day's biggest hit single, becoming a number two hit on the \"Billboard\" Hot 100, and spent one week at the top of the charts (number one hit) in R&B sales.", "In 1972, Michael Jackson recorded his own version of \"Rockin' Robin\", which was released as a single from his gold-certified solo album titled \"Got to Be There\".", "It was the biggest hit from the album, hitting number 1 on the \"Cash Box\" singles chart and peaking at number 2 on both the \"Billboard\" Hot 100, behind \"The First Time", "Ever I Saw Your Face\" by Roberta Flack.", "On the Billboard soul singles chart, \"Rockin' Robin\" went to number 2." ] ], "gold": "The hit R&B song \"Rockin' Robin\" was originally written by Leon Ren\u00e9 and recorded by Bobby Day in 1958. Michael Jackson recorded his own version of the song in 1972, which achieved greater success.", "prediction 1": "Rockin' Robin is a song written by Leon Ren\u00e9 under the pseudonym Jimmie Thomas, and recorded by Bobby Day in 1958. It was Day's biggest hit single, becoming a number two hit on the \"Billboard\" Hot 100, and spent one week at the top of the charts (number one hit in R&B sales). Then in 1972, Michael Jackson recorded his own version of Rockin' Robin, which was released as a single from his gold-certified solo album titled \"Got To Be There\". It was the biggest hit from the album, hitting number 1 on the \"Cash Box\" singles chart and peaking at number 2 on both the \"Billboard\" Hot 100, behind \"The First Time Ever I Saw Your Face\" by Roberta Flack.", "prediction 2": "Rockin' Robin is a song written by Leon Ren\u00e9 under the pseudonym Jimmie Thomas, and recorded by Bobby Day in 1958. It was Day's biggest hit single, becoming a number two hit on the Billboard Hot 100, and spent one week at the top of the charts (number one hit in R&B sales). In 1972, Michael Jackson recorded his own version of Rockin' Robin, which was released as a single from his gold-certified solo album titled \"Got To Be There\". It was the biggest hit from the album, hitting number 1 on the Cash Box singles chart and peaking at number 2 on both the Billboard Hot 100, behind \"The First Time Ever I Saw Your Face\" by Roberta Flack.", "prediction 3": "\"Rockin' Robin\", originally released as \"Rock-In Robin\" on the Class Records 45 single, is a song written by Leon Ren\u00e9 under the pseudonym Jimmie Thomas, and recorded by Bobby Day in 1958. In 1972, Michael Jackson recorded his own version of \"Rockin' Robin\", which was released as a single from his gold-certified solo album titled \"Got to Be There\". It was the biggest hit from the album, hitting number 1 on the \"Cash Box\" singles chart and peaking at number 2 on both the \"Billboard\" Hot 100, behind \"The First Time Ever I Saw Your Face\" by Roberta Flack. On the Billboard soul singles chart, \"Rockin' Robin\" went to number 2.", "prediction 4": "Rockin' Robin, originally released as Rock-In Robin on the Class Records 45 single, is a song written by Leon Ren\u00e9 under the pseudonym Jimmie Thomas, and recorded by Bobby Day in 1958. In 1972, Michael Jackson recorded his own version of Rockin' Robin, which was released as a single from his gold-certified solo album, Got To Be There. It was the biggest hit from the album, hitting number 1 on the \"Cash Box\" singles chart and peaking at number 2 on both the Billboard Hot 100, behind \"The First Time Ever I Saw Your Face\" by Roberta Flack. On the Billboard soul singles chart, \"Rockin' Robin\" went to number 2 on the Billboard soul singles chart, \"Rockin' Robin\" went to number 2 on the Billboard soul singles chart, \"Rockin' Robin\" went to number 2.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 276 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 441 }, { "error type": "Irrelevant", "explanation": "", "start": 442, "end": 649 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Rockin' Robin is a hit R&B song written by Leon Ren\u00e9, and recorded by Bobby Day in 1958. Then in 1972, Michael Jackson recorded his own version of Rockin' Robin." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where was the last olympic gold medal won by the indian hockey team?", "passages": [ [ "Zimbabwe women's national field hockey team at the 1980 Summer Olympics", "Zimbabwe women's national field hockey team at the 1980 Summer Olympics\n\nThe 1980 Zimbabwe women's national field hockey team won the gold medal in women's field hockey at that year's Summer Olympics in Moscow, the capital of the Soviet Union.", "The squad of 16 women, all from Zimbabwe's white minority, was assembled less than a month before the Olympics began to help fill the gaps the American-led Olympic boycott created in the women's hockey competition.", "Zimbabwe's subsequent victory in the round-robin tournament with three wins and two draws was regarded as a huge upset, particularly considering the team's lack of preparation and experience; it has been called an \"irresistible fairy story\".", "Won at a time of great political transition in Zimbabwe, the gold medal was the country's first Olympic medal of any colour.", "The 1980 Olympics were first to feature women's hockey, and the first to include Zimbabwe under that name\u2014barred from the last three Olympics for political reasons, the country had last competed as Rhodesia in 1964.", "The women's hockey matches, held between 25 and 31 July, were all played on artificial turf, which none of the Zimbabwean team members had ever seen; they had also never played together until that month." ], [ "Dynamo Minor Arena", "Dynamo Minor Arena\n\nThe Dynamo Minor Arena is a sports venue in Moscow, Russia that is located near neighboring Dynamo Stadium.", "Constructed in 1928, but renovated in 1979 in time for the 1980 Summer Olympics, it hosted the field hockey tournament.", "The stadium is located in the Park of Sport Complex Dynamo along with Dynamo Grand Arena, Dynamo Manage (indoor field), Dynamo Hockey School, and other sports facilities." ], [ "Sport in India", "This was the same event in which Abhinav Bindra won India's first individual gold medal in the 2008 Summer Olympics Beijing.", "The second medal came from the unheralded army man Vijay Kumar when he won the silver in the 25m rapid fire pistol event after finishing 4th in the qualification rounds.", "He had to fend off some tough competition from the third-placed Chinese Ding Feng.", "A notable performance was made by Joydeep Karmakar who finished 4th in the 50m rifle prone event.", "A strong medal prospect Ronjan Sodhi who is an Asian Games gold medallist, however, crashed out in the qualification rounds of the Double trap event.", "Field Hockey is a popular sport in India.", "Until the mid-1970s, India men's team dominated international field hockey, winning 7 Olympic gold medals and won the 1975 Men's Hockey World Cup.", "Since then, barring a gold medal at the 1980 Olympics, India's performance in field hockey has been dismal, with other hockey-playing nations such as Australia, Netherlands and Germany improving their standards and catching up with India.", "Its decline is also due to the change in rules of the game, introduction of artificial turf, and internal politics in Indian field hockey bodies.", "The popularity of field hockey has also declined massively parallel to the decline of the Indian hockey team." ], [ "Field hockey at the 1980 Summer Olympics", "Field hockey at the 1980 Summer Olympics\n\nField hockey at the 1980 Summer Olympics in Moscow took place from July 20 to 31, 1980 at the Minor Arena of the Central Dynamo Stadium and the Young Pioneers Stadium.", "India won the men's tournament for the record eighth time, defeating Spain 4\u20133 in the final.", "The 1980 Olympic Games also saw the introduction of a women's tournament, which was won by Zimbabwe.", "The 33 matches of hockey events across the two venues were watched by 177,880 spectators." ] ], "gold": "The last Olympic gold medal won by the Indian hockey team was at the 1980 Summer Olympics in Moscow, where field hockey was held at the Dynamo Minor Arena. Here, India won a record eighth title in men's field hockey. The Indian national ice hockey team has never played at the Olympic games. ", "prediction 1": "In women's hockey, the Indian national field hockey team won the gold medal in the men's competition at the 1980 Summer Olympics in Moscow. While the men's team won the gold medal in the men's competition at the 1976 Summer Olympics in Atlanta, the women's team won the gold medal in the men's competition at the 1976 Summer Olympics in Vancouver.", "prediction 2": "The last Indian hockey gold medal was won at the 1980 Summer Olympics in Moscow, where they won the gold medal in women's field hockey. The last Indian hockey gold medal was won at the 1988 Winter Olympics in Beijing.", "prediction 3": "The last gold medal won by the Indian hockey team was in the men's field hockey competition at the 1980 Summer Olympics in Moscow. The women's team came in first place in the men's competition, with the men's team winning the gold medal in the mixed doubles. The men's team also won the gold medal in the women's singles event at the 1980 Summer Olympics in Moscow.", "prediction 4": "The last Indian hockey gold medal was won in the men's field hockey at the 1980 Summer Olympics, in Moscow, Russia. The 1980 Zimbabwe women's national field hockey team won the gold medal in women's field hockey at that year's Summer Olympics in Moscow, the capital of the Soviet Union.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[3]}", "start": 0, "end": 139 }, { "error type": "Unverifiable", "explanation": "", "start": 140, "end": 347 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Indian national field hockey team won the gold medal at the 1980 Summer Olympics in Moscow at the Dynamo Minor Arena for the eighth time. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who did oklahoma play in the bowl game this year?", "passages": [ [ "Oklahoma Sooners football", "Oklahoma Sooners football\n\nThe Oklahoma Sooners football program is a college football team that represents the University of Oklahoma (variously \"Oklahoma\" or \"OU\").", "The team is a member of the Big 12 Conference, which is in Division I Football Bowl Subdivision (formerly Division I-A) of the National Collegiate Athletic Association (NCAA).", "The program began in 1895 and is one of the most successful programs since World War II with the most wins (606) and the highest winning percentage (.762) since 1945.", "The program has 7 national championships, 48 conference championships, 162 First Team\u00a0All-Americans (80 consensus), and seven\u00a0Heisman Trophy winners.", "In addition, the school has had 23 members (five coaches and 18\u00a0players) inducted into the College Football Hall of Fame and holds the record for the longest winning streak in Division I history with 47\u00a0straight victories.", "Oklahoma is also the only program that has had four coaches with 100+ wins.", "They became the sixth NCAA FBS team to win 850\u00a0games when they defeated the Kansas Jayhawks on November 22, 2014.", "The Sooners play their home games at Gaylord Family Oklahoma Memorial Stadium in Norman, Oklahoma.", "Lincoln Riley is currently the team's head coach.", "Football at Oklahoma made its start in September 1895, 12\u00a0years before statehood and one year after the first organized football game in Oklahoma Territory." ], [ "2017 Sugar Bowl", "2017 Sugar Bowl\n\nThe 2017 Sugar Bowl is a bowl game that was played on January 2, 2017 at the Mercedes-Benz Superdome in New Orleans, Louisiana.", "This 83rd Sugar Bowl was played between a team from the Big 12 Conference and the Southeastern Conference.", "It is one of the 2016\u201317 bowl games that concluded the 2016 FBS football season.", "Sponsored by the Allstate insurance company, the game is officially known as the Allstate Sugar Bowl.", "The two teams were selected by the College Football Playoff committee on December 4, 2016.", "The highest-ranked team from the SEC and the Big 12 were to be selected.", "However, the highest-ranked team from the SEC, Alabama, was selected in the semifinals of the playoff, so the second highest ranked SEC team went in their place.", "Auburn was the second highest ranked team at 14th in the playoff rankings, so they were selected for the Sugar Bowl.", "Oklahoma was the Big 12 champion and the conference's highest ranked at 7th, therefore sending the Sooners to the Sugar Bowl.", "This was the second meeting between the two schools; the previous meeting was the 1972 Sugar Bowl, which saw the Sooners defeat the Tigers by a score of 40\u201322.", "After a disappointing 2015 season, Auburn coach Gus Malzahn was considered to be at risk of losing his job if a similar season followed." ], [ "2015 Orange Bowl", "2015 Orange Bowl\n\nThe 2015 Capital One Orange Bowl was a college football bowl game that was played on December 31, 2015 at Sun Life Stadium in Miami Gardens, Florida.", "The 82nd Orange Bowl was a College Football Playoff semifinal with the winner of the game competing against the winner of the 2015 Cotton Bowl: Alabama Crimson Tide football in the 2016 College Football Playoff National Championship, which took place at University of Phoenix Stadium in Glendale, Arizona.", "It was one of the 2015\u201316 bowl games that concluded the 2015 FBS football season.", "The Orange Bowl game is usually played at night, but with a 4 pm starting time, this Orange Bowl game was the first with an afternoon kickoff in 51 years.", "The game matched the undefeated and number 1 overall team in the nation, the Clemson Tigers, against the 1 loss Oklahoma Sooners.", "This was the fifth overall meeting between these two teams, with Clemson winning the series 3\u20132.", "The game was a rematch of the previous year's Russell Athletic Bowl, which Clemson won 40\u20136.", "The two participants for the game were two of the semifinalists which were the Clemson Tigers and Oklahoma Sooners.", "Clemson began the season hoping to improve on their 10-3 record from last year.", "In the preseason poll, the Tigers ranked number 12, and to kick off the season, won their first 3 games." ] ], "gold": "The Oklahoma Sooners college football team competes as part of the National Collegiate Athletic Association (NCAA) Division I Football Bowl Subdivision (FBS), representing the University of Oklahoma in the Big 12 Conference. Oklahoma played Clemson in the 2014 Russell Athletic Bowl was a college football bowl game played on December 29, 2014, at Orlando Citrus Bowl Stadium in Orlando, Florida. Oklahoma played Clemson in the 2015 Capital One Orange Bowl was a college football bowl game that was played on December 31, 2015 at Sun Life Stadium in Miami Gardens, Florida. Oklahoma played Auburn in the 2017 Sugar Bowl is a bowl game that was played on January 2, 2017 at the Mercedes-Benz Superdome in New Orleans, Louisiana.", "prediction 1": "The 2018 Sooners football program is a college football team that represents the University of Oklahoma. The team is a member of the Big 12 Conference, which is in Division I Football Bowl Subdivision, formerly Division I-A of the National Collegiate Athletic Association. It has played in 83 consecutive bowl games, with one of them being in 2016 and the other in 2017.", "prediction 2": "The Oklahoma Sooners football program is a college football team that represents the University of Oklahoma. In 2015, the Sooners played the Clemson Tigers in the Capital One Orange Bowl and in 2016, the Auburn Tigers played the Tennessee Volunteers in the Cotton Bowl. In 2017, the Texas Longhorns played in the Sugar Bowl, and in 2016, the Tennessee Volunteers played in the Sugar Bowl.", "prediction 3": "The Oklahoma Sooners football program is a college football team that represents the University of Oklahoma. The team is a member of the Big 12 Conference, which is in Division I Football Bowl Subdivision, which is formerly Division I-A of the National Collegiate Athletic Association (NCAA). The 2017 Sugar Bowl was played between a team from the Big 12 Conference and the Southeastern Conference. This 83rd Sugar Bowl was played between a team from the Big 12 Conference and the Southeastern Conference. The 2015 Capital One Orange Bowl was a college football playoff semifinal with the winner of the game competing against the winner of the 2015 Cotton Bowl: Alabama Crimson Tide football in the 2016 College Football Playoff semifinal with the winner of the game competing against the winner of the 2015 Cotton Bowl: Clemson Tigers. This was the first with an afternoon kickoff in 51 years.", "prediction 4": "The Oklahoma Sooners football program is a college football team that represents the University of Oklahoma. The team is a member of the Big 12 Conference, which is in Division I Football Bowl Subdivision (formerly Division I-A) of the National Collegiate Athletic Association (NCAA). In the 2015 Capital One Orange Bowl, the undefeated and number 1 overall team in the nation, the Clemson Tigers, faced off against the 1 loss Oklahoma Sooners, while in the 2017 Sugar Bowl, the game was played between the Southeastern Conference.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 273, "end": 370 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Oklahoma Sooners college football team competes as part of the National Collegiate Athletic Association (NCAA) Division I Football Bowl Subdivision (FBS), representing the University of Oklahoma in the Big 12 Conference. Oklahoma played Clemson in the 2015 Capital One Orange Bowl was a college football bowl game played on December 31, 2015 at Sun Life Stadium in Miami Gardens, Florida. Oklahoma played Auburn in the 2017 Sugar Bowl is a bowl game that was played on January 2, 2017 at the Mercedes-Benz Superdome in New Orleans, Louisiana. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When is the cutoff for being a millennial?", "passages": [ [ "Millennials", "Millennials\n\nMillennials, also known as Generation Y or Gen Y, are the generational demographic cohort following Generation X and preceding Generation Z.", "There are no precise dates for when this cohort starts or ends; demographers and researchers typically use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years.", "Millennials are sometimes referred to as \"echo boomers\" due to a major surge in birth rates in the 1980s and 1990s, and because millennials are often the children of the baby boomers.", "Although millennial characteristics vary by region, depending on social and economic conditions, the generation has been generally marked by an increased use and familiarity with communications, media, and digital technologies.", "Authors William Strauss and Neil Howe are widely credited with naming the millennials.", "They coined the term in 1987, around the time children born in 1982 were entering preschool, and the media were first identifying their prospective link to the impending new millennium as the high school graduating class of 2000.", "They wrote about the cohort in their books \"Generations: The History of America's Future, 1584 to 2069\" (1991) and \"Millennials Rising: The Next Great Generation\" (2000)." ] ], "gold": "Millennials, also known as Generation Y or Gen Y, are the demographic cohort following Generation X and preceding Generation Z. Researchers and popular media use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years, with the generation typically being defined as people born from 1981 to 1996. Most millennials are the children of baby boomers and early Gen Xers; Millennials are often the parents of Generation Alpha.", "prediction 1": "There are no precise dates for when this generational demographic cohort starts or ends. Demographers and researchers typically use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years. Millennial characteristics vary by region, depending on social and economic conditions. The generation has been generally marked by an increased use and familiarity with communications, media, and digital technologies.", "prediction 2": "There are no precise dates for when this cohort starts or ends. Demographers and researchers typically use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years.", "prediction 3": "There are no precise dates for when this cohort starts or ends; demographers and researchers typically use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years.", "prediction 4": "The age cutoff for being a millennial is now 2029 (the cutoff for being a millennial in 2016 is 2027).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 88 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 446 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Millennials, also known as Generation Y or Gen Y, are the demographic cohort following Generation X and preceding Generation Z Demographers and researchers typically use the early 1980s as starting birth years and the mid-1990s to early 2000s as ending birth years. Millennials are sometimes referred to as \"echo boomers\" due to a major surge in birth rates in the 1980s and 1990s, and because millennials are often the children of the baby boomers." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "What is the current version of php and mysql?", "passages": [ [ "MySQL", "MySQL\n\nMySQL ( \"My S-Q-L\") is an open source relational database management system (RDBMS).", "Its name is a combination of \"My\", the name of co-founder Michael Widenius's daughter, and \"SQL\", the abbreviation for Structured Query Language.", "The MySQL development project has made its source code available under the terms of the GNU General Public License, as well as under a variety of proprietary agreements.", "MySQL was owned and sponsored by a single for-profit firm, the Swedish company MySQL AB, now owned by Oracle Corporation.", "For proprietary use, several paid editions are available, and offer additional functionality.", "MySQL is a central component of the LAMP open-source web application software stack (and other \"AMP\" stacks).", "LAMP is an acronym for \"Linux, Apache, MySQL, Perl/PHP/Python\".", "Applications that use the MySQL database include: TYPO3, MODx, Joomla, WordPress, Simple Machines Forum, phpBB, MyBB, and Drupal.", "MySQL is also used in many high-profile, large-scale websites, including Google (though not for searches), Facebook, Twitter, Flickr, and YouTube." ], [ "PHP", "PHP\n\nPHP: Hypertext Preprocessor (or simply PHP) is a server-side scripting language designed for Web development.", "It was originally created by Rasmus Lerdorf in 1994; the PHP reference implementation is now produced by The PHP Group.", "PHP originally stood for \"Personal Home Page\", but it now stands for the recursive initialism \"PHP: Hypertext Preprocessor\".", "PHP code may be embedded into HTML code, or it can be used in combination with various web template systems, web content management systems, and web frameworks.", "PHP code is usually processed by a PHP interpreter implemented as a module in the web server or as a Common Gateway Interface (CGI) executable.", "The web server combines the results of the interpreted and executed PHP code, which may be any type of data, including images, with the generated web page.", "PHP code may also be executed with a command-line interface (CLI) and can be used to implement standalone graphical applications.", "The standard PHP interpreter, powered by the Zend Engine, is free software released under the PHP License.", "PHP has been widely ported and can be deployed on most web servers on almost every operating system and platform, free of charge.", "The PHP language evolved without a written formal specification or standard until 2014, with the original implementation acting as the \"de facto\" standard which other implementations aimed to follow." ] ], "gold": "MySQL is an open-source relational database management system, whose name is a combination of \"My\", the name of co-founder Michael Widenius's daughter, and \"SQL\", the abbreviation for Structured Query Language. The current version of MySQL is 8.0.18. PHP is a general-purpose scripting language geared towards web development, which was originally created by Danish-Canadian programmer Rasmus Lerdorf in 1994. The current version of PHP is 7.4.2.", "prediction 1": "PHP and MySQL are both server-side scripting languages designed for Web development. PHP 2.4 is the current version of php and MySQL. MySQL 4.3 is the current version of mysql.", "prediction 2": "PHP: Hypertext Preprocessor is a server-side scripting language designed for Web development. It was originally created by Rasmus Lerdorf in 1994; the PHP reference implementation is now produced by The PHP Group. In 2017, PHP 7.x was released, with the current version being released on April 27, 2017 at 15:14 UTC. In 2018, PHP 7.x was released on April 28, 2017, while PHP 8.x was released on April 29, 2018.", "prediction 3": "PHP: Hypertext Preprocessor, or simply PHP, is a server-side scripting language designed for Web development. It was originally created by Rasmus Lerdorf in 1994; the PHP reference implementation is now produced by The PHP Group. The current version of PHP and MySQL is PHP 5.6, 6.0, and 7.0, respectively. MySQL 5.6 is a version of PHP that was released as part of the PHP-PHP-1 specification in 2009. The current version of MySQL is MySQL 5.7, which was released in November 2008.", "prediction 4": "The two programs are PHP and MySQL. The current version of the PHP software is PHP 4.0. The current version of the MySQL software is MySQL 5.6. The current version of MySQL is MySQL 6.x. The current version of PHP 5.4.x is PHP 5.5.x. The current version of MySQL is MySQL 6.x. The current version of MySQL is MySQL 6.x.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 85, "end": 133 }, { "error type": "Unverifiable", "explanation": "", "start": 134, "end": 176 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "MySQL is an open-source relational database management system. Its name is a combination of \"My\", the name of co-founder Michael Widenius's daughter, and \"SQL\", the abbreviation for Structured Query Language. PHP and MySQL are both server-side scripting languages designed for Web development. It was originally created by Rasmus Lerdorf in 1994. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won the most grammys of all time?", "passages": [ [ "Grammy Award records", "Grammy Award records\n\nThroughout the history of the Grammy Awards, many significant records have been set.", "This page only includes the competitive awards which have been won by various artists.", "This does not include the various special awards that are presented by the National Academy of Recording Arts and Sciences such as Lifetime Achievement Awards, Trustees Awards, Technical Awards or Legend Awards.", "The page however does include other non-performance related Grammys (known as the Craft & Production Fields) that may have been presented to the artist(s).", "The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years.", "He has won a total of 31 competitive Grammy Awards out of 74 nominations and was awarded a Grammy Lifetime Achievement Award in 1996.", "Georg Solti has won a total of 31 Grammy Awards.", "Alison Krauss has, as a solo artist, collaborator and producer, won 27 Grammy Awards.", "U2 holds the record for most Grammy Awards won by a group.", "They have won 22 awards.", "Quincy Jones with 27 awards holds the record for most Grammy Awards won by a producer (and eleven of those were awarded for production duties.", "Jones also received Grammys as an arranger and a performing artist).", "Some producers have also won awards as engineers, mixers and/or mastering engineers." ] ], "gold": "Throughout the history of the Grammy Awards, many significant records have been set. The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who was music director of the Chicago Symphony Orchestra for twenty-two years, who won 31 competitive Grammy Awards out of 74 nominations and was also awarded the first Grammy Trustees Award in 1967 and a Grammy Lifetime Achievement Award in 1996. U2 holds the record for most Grammy Awards won by a group, with 22 awards. The record for most Grammy Awards won by a producer is held by Quincy Jones, with 28 awards, eleven of those being for production duties, and others were received as an arranger or as a performing artist.", "prediction 1": "The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years. In addition to his 31 competitive Grammy Awards, Solti also received a Grammy Lifetime Achievement Award in 1996. Alison Krauss has won 27 Grammy Awards and Quincy Jones with 27 awards holds the record for most Grammy Awards won by a producer.", "prediction 2": "The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years. He has won a total of 31 competitive Grammy Awards out of 74 nominations. Alison Krauss has, as a solo artist, collaborator and producer, won 27 Grammy Awards. U2 holds the record for most Grammy Awards won by a group. They have won 22 awards. Quincy Jones with 27 awards holds the record for most Grammy Awards won by a producer.", "prediction 3": "The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years. He has won a total of 31 competitive Grammy Awards out of 74 nominations and was awarded a Grammy Lifetime Achievement Award in 1996. Alison Krauss has, as a solo artist, collaborator and producer, won 27 Grammy Awards. Quincy Jones holds the record for most Grammy Awards won by a producer.", "prediction 4": "The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years. He has won a total of 31 competitive Grammy Awards out of 74 nominations and was awarded a Grammy Lifetime Achievement Award in 1996. Alison Krauss has, as a solo artist, collaborator and producer, won 27 Grammy Awards. U2 holds the record for most Grammy Awards won by a group. They have won 22 awards. Quincy Jones has 27 awards and 11 of those were awarded for production duties.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 420 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] } ], "corrected-prediction": "Throughout the history of the Grammy Awards, many significant records have been set. The record for the most Grammy Awards won in a lifetime is held by Georg Solti, a Hungarian-British conductor who conducted the Chicago Symphony Orchestra for twenty-two years. In addition to his 31 competitive Grammy Awards out of 74 nominations, Solti also received a Grammy Lifetime Achievement Award in 1996. U2 holds the record for most Grammy Awards won by a group. They have won 22 awards. Quincy Jones with 27 awards holds the record for most Grammy Awards won by a producer (and eleven of those were awarded for production duties. Jones also received Grammys as an arranger and a performing artist). " }, "preference": [ 1, 0, 1, 0, 1, 1 ] }, { "question": "What type of dogs are in where the red fern grows?", "passages": [ [ "Where the Red Fern Grows", "Where the Red Fern Grows\n\nWhere the Red Fern Grows is a 1961 children's novel by Wilson Rawls about a boy who buys and trains two Redbone Coonhound hunting dogs.", "When leaving work in Idaho's Snake River Valley, Billy Colman sees a pack of dogs attacking a stray coonhound.", "He takes the stray home to feed it.", "Once it has rested, Billy sets it free, knowing that it will return home.", "The experience reminds Billy of his childhood in the Ozark Mountains of Oklahoma.", "He wants a dog, and his parents offer to get him a collie from a neighbor.", "But Billy doesn't want just any dog; he wants two coonhounds, but his parents cannot afford them.", "Billy finds a magazine ad for a Kentucky kennel which breeds Redbone Coonhounds and sells them for $25 each.", "He goes to work performing odd jobs and saves the $50 he needs with the help of his grandfather.", "Since it takes two years to do so, his grandfather writes to see if the kennel will honor the ad.", "They do and the price has dropped, so the two puppies only cost $40.", "Billy's dogs are delivered to the freight depot in Tahlequah.", "His family does not have transportation, so he finds his own way to get to the depot and walks through the hills." ] ], "gold": "Hunting Dogs were in Where The Red Fern Grows. Specifically, Redbone Coonhound is the type of hunting dog that was used in the novel.", "prediction 1": "In the 1961 children's novel Where the Red Fern Grows, Billy Colman buys and trains two Redbone Coonhound hunting dogs, which are called \"Boneys.\"", "prediction 2": "There are several dogs in the 1961 children's novel Where the Red Fern Grows. Billy Colman is a boy who buys and trains two Redbone Coonhound hunting dogs.", "prediction 3": "There are several dogs in Where the Red Fern Grows. The characters are Billy Colman and his two Redbone Coonhound hunting dogs.", "prediction 4": "Where the Red Fern Grows is a 1961 children's novel by Wilson Rawls about a boy who buys and trains two Redbone Coonhound hunting dogs.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 146 } ], "missing-info": [], "corrected-prediction": "In the 1961 children's novel Where the Red Fern Grows, Billy Colman buys and trains two Redbone Coonhound hunting dogs." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who did the song oh what a night?", "passages": [ [ "Oh, What a Night (The Dells song)", "Oh, What a Night (The Dells song)\n\n\"Oh, What a Night\" is a song first recorded by the doo-wop group the Dells and released in 1956, originally under the title \"Oh What a Nite\".", "The song is said to have been inspired by a party, which had been held in the Dells' honor by some female friends of the group.", "The Dells' original recording on the Vee Jay label peaked at number four on the R&B singles chart.", "In 1969, they refashioned it as a soul song on the Cadet label.", "The new \"Oh, What a Night\" was notably different from its original counterpart with an altered arrangement and tempo, and included a spoken recitation, in the introduction, from the bass member of the group.", "This new version reached number ten on the \"Billboard\" Hot 100 singles chart and number one on the Best Selling Soul singles chart.", "The 1969 version was ranked #260 on Rolling Stone's list of The 500 Greatest Songs of All Time." ], [ "December, 1963 (Oh, What a Night)", "December, 1963 (Oh, What a Night)\n\n\"December, 1963 (Oh, What a Night)\" is a song by the Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, \"Who Loves You\" (1975).", "The song features drummer Gerry Polci on lead vocals, with the usual lead Frankie Valli singing the bridge sections and backing vocals, and bass player Don Ciccone (former lead singer of The Critters) singing the falsetto part (\"And I felt a rush like a rolling ball of thunder / Spinning my head around and taking my body under\").", "According to the co-writer and longtime group member Bob Gaudio, the song lyrics were originally set in 1933 with the title \"December 5th, 1933,\" and celebrated the repeal of Prohibition, but the lyrics were changed at the urgings of Frankie Valli and lyricist Parker to reposition the song as a nostalgic remembrance of a young man's first affair with a woman, and, more specifically, Gaudio's courtship with his wife, Judy Parker.", "The song is an up-tempo, piano-led dance song with a distinct and easily recognizable opening drum and then piano riff." ], [ "Oh What a Night (Guano Apes song)", "Oh What a Night (Guano Apes song)\n\n\"", "Oh What a Night\" is a 2011 song by the Guano Apes and the first single from their fourth album, \"Bel Air\".", "It was their first single released in seven years, following \"Break the Line\" in 2004.", "\"Oh What a Night\" was released on 18 March 2011 and peaked at No. 37 in Germany.", "\"AllMusic\" gave the song 3\u00bd out of 5 stars.", "A music video was released on YouTube on 7 March 2011 and reached over 1 million views by 6 July.", "The video features the band playing in the city of Dubai as a solar eclipse occurs." ] ], "gold": "\"Oh, What a Night\" is a song first recorded by the doo-wop group the Dells and released in 1956, originally under the title \"Oh What a Nite\". The song is said to have been inspired by a party, which had been held in the Dells' honor by some female friends of the group. \"December, 1963 (Oh, What a Night)\" is also a song originally performed by The Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, Who Loves You in 1975. There is also a 2011 song titled \"Oh What a Night\" by the Guano Apes and the first single from their fourth album, Bel Air. It was their first single released in seven years, following Break the Line in 2004. ", "prediction 1": "The song Oh, What a Night was originally recorded by the doo-wop group the Dells in 1956. In 1969, the group refashioned the song as a soul song on the Cadet label. Oh, What a Night was also a song by the Four Seasons in 1975. Oh, What a Night was also a song by the Guano Apes in 2011.\n", "prediction 2": "There are several songs entitled Oh, What a Night. Some include a song by the doo-wop group, The Dells and one by the Guano Apes. The song is an up-tempo, piano-led dance song with a distinct and easily recognizable opening drum and then piano riff. In 1979, the Van Morrison Project did a cover of Oh, What a Night. In 1953, The Four Seasons did a song entitled December, 1963, Oh, What a Night. Oh, What a Night was released in 1956.", "prediction 3": "There are several songs called Oh What a Night. First, it was sung by doo-wop group the Dells who released the song in 1956. Second, it was refashioned as a soul song by The Four Seasons in 1969. There's also a 2011 song that the Guano Apes performed.", "prediction 4": "There are several different versions of the song Oh, What a Night. The Dells did the song first, in 1956. Musicians The Guano Apes did the song in 2011, while The Four Seasons did the song in 1975.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 164 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 165, "end": 181 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The song Oh, What a Night was originally recorded by the doo-wop group the Dells in 1956, originally under the title \"Oh What a Nite\". The song is said to have been inspired by a party, which had been held in the Dells' honor by some female friends of the group. \"December, 1963 (Oh, What a Night)\" is a song by the Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, \"Who Loves You\" (1975). Additionally, \"Oh What a Night\" is a 2011 song by the Guano Apes and the first single from their fourth album, \"Bel Air\". It was their first single released in seven years, following \"Break the Line\" in 2004.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "A group of objects orbiting between mars and jupiter?", "passages": [ [ "Asteroid belt", "Asteroid belt\n\nThe asteroid belt is the circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter.", "It is occupied by numerous irregularly shaped bodies called asteroids or minor planets.", "The asteroid belt is also termed the main asteroid belt or main belt to distinguish it from other asteroid populations in the Solar System such as near-Earth asteroids and trojan asteroids.", "About half the mass of the belt is contained in the four largest asteroids: Ceres, Vesta, Pallas, and Hygiea.", "The total mass of the asteroid belt is approximately 4% that of the Moon, or 22% that of Pluto, and roughly twice that of Pluto's moon Charon (whose diameter is 1200\u00a0km).", "Ceres, the asteroid belt's only dwarf planet, is about 950\u00a0km in diameter, whereas 4\u00a0Vesta, 2\u00a0Pallas, and 10\u00a0Hygiea have mean diameters of less than 600\u00a0km.", "The remaining bodies range down to the size of a dust particle.", "The asteroid material is so thinly distributed that numerous unmanned spacecraft have traversed it without incident.", "Nonetheless, collisions between large asteroids do occur, and these can produce an asteroid family whose members have similar orbital characteristics and compositions." ] ], "gold": "The group of objects orbiting between Mars and Jupiter are asteroid, or minor planets, that are much smaller than planets. These asteroids are located in the main asteroid belt, which is named such to distinguish itself from other asteroid populations in the Solar System.", "prediction 1": "The asteroid belt is the circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter. It is occupied by numerous irregularly shaped bodies called asteroids or minor planets. These irregularly shaped bodies are called asteroids.", "prediction 2": "The asteroid belt is the circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter. It is occupied by numerous irregularly shaped bodies called asteroids or minor planets.", "prediction 3": "The asteroid belt is the circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter. It is occupied by numerous irregularly shaped bodies called asteroids or minor planets. About half the mass of the belt is contained in the four largest asteroids: Ceres, Vesta, Pallas, and Hygiea.", "prediction 4": "The asteroid belt is a circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter. It is occupied by numerous irregularly shaped bodies called asteroids or minor planets. The asteroid belt is also termed the main asteroid belt or main belt to distinguish it from other asteroid populations in the Solar System such as near-Earth asteroids and trojan asteroids.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 219 }, { "error type": "Redundant", "explanation": "It is occupied by numerous irregularly shaped bodies called asteroids or minor planets. ", "start": 220, "end": 273 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The asteroid belt is the circumstellar disc in the Solar System located roughly between the orbits of the planets Mars and Jupiter. The asteroid belt is also termed the main asteroid belt or main belt to distinguish it from other asteroid populations in the Solar System." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When did the first rainbow vacuum come out?", "passages": [ [ "Thomas Dyson", "Thomas Dyson\n\nThe Ven.", "Thomas Dyson was Archdeacon of Bermuda from 1982 until 1994.", "Dyson was educated at the University of Manchester and ordained in 1940.", "After a curacy at St Anselm's, Kennington he was a Chaplain in the RNVR from 1943 to 1947.", "He was Vicar of St Peter-in-the-East, Oxford from 1947 to 1955; and Rector of St Bartholemew, Colne, Lancashire from 1955 to 1957 when he became the incumbent in Warwick, Bermuda.", "Thomas Dyson is also the creator of the world's famous \"microscopic dirt and dust remover\" vacuum" ] ], "gold": "The first Rexair LLC vacuum came out in 1936, which would evolve into the Rainbow vacuum. The first officially named Rainbow vacuum came out in 1955.", "prediction 1": "The first rainbow vacuum came out in 1927.", "prediction 2": "The first rainbow vacuum came out in 1932. It was marketed as a'miniature dirt and dust remover' vacuum cleaner. It came out in the UK and Canada in 1937.", "prediction 3": "The first rainbow vacuum came out in 1969.", "prediction 4": "The first rainbow vacuum came out in May 1959.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 42 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who voices the man in the yellow hat?", "passages": [ [ "Curious George", "In this film (in which The Man is referred to as \"Ted\"), Curious George secretly follows The Man onto the ship to the city on his own accord.", "Frank Welker provided the vocal effects of Curious George.", "On March 2, 2010, a direct to video sequel to the film was released, titled \"\", which featured Jeff Bennett replacing Ferrell as the voice of the Man.", "Bennett also provides the Man's voice in the television series.", "The second direct to video sequel, \"\", was released on June 23, 2015.", "A Christmas film, \"\", was released in 2009 on PBS.", "\"Curious George Swings Into Spring\" and \"Curious George: A Halloween Boo Fest\" were released in 2013.", "On Monday August 6, It began to re-run on Cartoonito.", "A live action/computer animated film was in development at Illumination Entertainment in the beginning of the 2010s.", "In August 2016, it was reported that Andrew Adamson was in negotiations to direct, co-write, and executive produce a live action film for Universal Pictures, along with Ron Howard, Brian Grazer, David Kirschner, Jon Shapiro and Erica Huggins producing." ], [ "Curious George", "Curious George\n\nCurious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck.", "The books feature a chimp named George, who is brought from his home in Africa by \"The Man with The Yellow Hat\" as his best friend to live with him in a giant city.", "When the first story, \"Cecily G. and the Nine Monkeys\" was published in France in 1939, George was named Fifi.", "In the United Kingdom, George was originally called \"Zozo\" in 1941, apparently to avoid using the name of the then King George VI for a monkey.", "Books featuring the adventures of Curious George have been translated from the original French into many other languages in addition to English.", "The books have been adapted into several television series and films.", "The original series was written by the team of Hans Augusto Rey and Margret Rey.", "The couple fled Paris in June 1940, on self made bicycles, carrying the \"Curious George\" manuscript with them.", "At first, only H. A. Rey was credited for the work in order to distinguish the Reys' books from the large number of children's books written by female authors.", "The first seven books were illustrated by H.A. Rey." ], [ "Curious George", "He is always seen wearing a bright yellow suit and a wide brimmed yellow hat.", "The Man is never mentioned by name in the original adventures or in any subsequent content over more than six decades.", "He is always referred to as \"The Man\" or fully \"The Man with the Yellow Hat\".", "When people speak to George about the Man, they often refer to him as \"Your friend\", though the Man is more like a father to George.", "However, in \"Curious George\" (2006), the Man, who is voiced by Will Ferrell, is referred to as \"Ted\" throughout the film, and his last name is revealed as being \"Shackleford\" in a deleted scene.", "There was a series of animated television films made (beginning in 1980) featuring the character, which were then adapted into books themselves (making up part of the New Adventures series listed above).", "This series was produced and co-written by Alan Shalleck.", "A series of Curious George animated shorts were aired on The Disney Channel as a segment on the program \"Lunch Box\" from the late 1980s into the 1990s.", "On Playhouse Disney (now Disney Junior), Jack Duffy narrated a 2D animated story version of Curious George which had different episodes from the book series that were written by H.A. Rey and Margret Rey." ] ], "gold": "In the 2006 Curious George film, Will Ferrell plays the role of Ted, The Man with the Yellow Hat, who is a tour guide at the Bloomsberry Museum. Ferrell described the character as \"a blank canvas\" and \"a guy who's lived his life in a box\". Since 2006, Jeff Bennett has voiced the role of The Man With the Yellow Hat and also voices neighborhood farmer Mr. Renkins in the PBS Kids TV series Curious George. He voiced the character in Curious George: A Very Monkey Christmas, as well as the 2010 and 2015 Curious George sequels.", "prediction 1": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by \"The Man with the Yellow Hat\" as his best friend to live with him in a giant city. Will Ferrell voices the Man in Curious George (2006), Curious George: The Movie and Curious George: The Television Series. Bennett also provides the Man's voice in the television series. In the series Curious George: The Man with the Yellow Hat: The Man, the Man in the Man, the Man is voiced by Jeff Bennett. Bennett replaces Ferrell as the Man with the Yellow Hat in the live action/computer animated film, which features Bennett replacing Ferrell as the Man. Bennett voices the Man in the television series.", "prediction 2": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by \"The Man with the Yellow Hat\" as his best friend to live with him in a giant city. In the 2006 film Curious George, Will Ferrell voices the Man, while Jeff Bennett voices the Man in the 2010 direct to video sequel to the movie. In the 2012 Curious George, the Man with the Yellow Hat, which was narrated a 2D animated story version of the Man in the 1980s. In the 2004 film, Bennett voices the Man. In the 2010 Jeff Bennett replaces Ferrell, replacing Ferrell as the Man. In the 2016 the Man's voice in the television series.", "prediction 3": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. In the 2006 film Curious George, the Man is voiced by Will Ferrell, but in the 2009 film and subsequent animated television series, the Man is voiced by Jeff Bennett. Bennett also provides the Man's voice in the television series.", "prediction 4": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by The Man with the Yellow Hat as his best friend to live with him in a giant city. In the 2006 film Curious George, the Man, who is voiced by Will Ferrell, is referred to as \"Ted\" throughout the film and the television series Curious George. In the 2014, the Netflix series Curious George was voiced by Jeff Bennett. Bennett replaced Ferrell as the Man.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by \"The Man with the Yellow Hat\" as his best friend to live with him in a giant city. Will Ferrell voices the Man in Curious George (2006), Curious George: The Movie and Curious George: The Television Series. Bennett also provides the Man's voice in the television series. ", "start": 521, "end": 643 }, { "error type": "Redundant", "explanation": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by \"The Man with the Yellow Hat\" as his best friend to live with him in a giant city. Will Ferrell voices the Man in Curious George (2006), Curious George: The Movie and Curious George: The Television Series. Bennett also provides the Man's voice in the television series. In the series Curious George: The Man with the Yellow Hat: The Man, the Man in the Man, the Man is voiced by Jeff Bennett. Bennett replaces Ferrell as the Man with the Yellow Hat in the live action/computer animated film, ", "start": 743, "end": 795 }, { "error type": "Redundant", "explanation": "Curious George is the protagonist of a series of popular children's books by the same name, written by H. A. Rey and Margret Rey with illustrations by Alan J. Shalleck. The books feature a chimp named George, who is brought from his home in Africa by \"The Man with the Yellow Hat\" as his best friend to live with him in a giant city. Will Ferrell voices the Man in Curious George (2006), Curious George: The Movie and Curious George: The Television Series. Bennett also provides the Man's voice in the television series. ", "start": 796, "end": 844 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 700, "end": 736 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": " Will Ferrell voices the Man in Curious George (2006), who is referred to as \"Ted\" throughout the film. In the Television Series The Man with the Yellow Hat is voiced by Jeff Bennett. Bennett also replaces Ferrell as the Man with the Yellow Hat in the films sequels in 2010 and 2015 and a Christmas film." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who played bobby c in saturday night fever?", "passages": [ [ "Saturday Night Fever (musical)", "\"(21 April 1998-17 April 1999)\"\n\nAfter twenty-seven previews, the Broadway production, with Phillips directing, opened on 21 October 1999 at the Minskoff Theatre, where it ran for 501 performances.", "The cast included James Carpinello as Tony and Paige Price as Stephanie, with Orfeh as Annette, Paul Castree as Bobby C., and Bryan Batt as DJ Monty.", "\"(21 October 1999 to 31 December 2000)\"\n\nThe first UK tour production ran from 11 November 2000 to 29 September 2001, with Ben Richards as Tony Manero.", "An argentinian production opened at El Nacional, Buenos Aires, on 4 April 2001 and closed on 28 July 2001.", "The cast included Dar\u00edo Petruzio as Tony Manero, Silvia Luchetti as Stephanie, Elena Roger as Annette, H\u00e9ctor Pilatti as Monty and Charlie G. as Bobby C.\n\nProducer Joop van den Ende's Stage Entertainment company opened a Dutch production at the newly purchased Beatrix Theater, Utrecht, on 17 June 2001.", "It closed on 23 February 2003.", "The cast included Joost de Jong as Tony Manero, Chantal Janzen as Stephanie, and various TV personalities as DJ Monty, one of them was Carlo Boszhard." ], [ "Fame (1980 film)", "Simkin had discovered Ray breakdancing on a street corner in Harlem before asking him to audition for a role in the film.", "Lee Curreri, who was cast as Bruno Martelli, learned of the production while attending the Manhattan School of Music.", "During his audition, Paul McCrane performed an original song he had written, \"Is It", "Okay", "If I Call You Mine?\".", "He was cast as Montgomery MacNeil, and the song inspired Parker to include it in the film.", "Barry Miller, who achieved critical acclaim for his supporting role in \"Saturday Night Fever\" (1977), was cast as Ralph Garci, an aspiring actor and standup comic of Puerto Rican descent.", "Maureen Teefy, an established actress of Irish descent, was cast as Doris Finsecker, a shy and uptight Jewish girl.", "De Silva disagreed with her casting, stating, \"...", "I'd envisioned [Doris] as a 16-or 17-year-old Barbra Streisand from Brooklyn, and when [Parker] cast this Irish actress that was a trouble\u00a0... that was my only reservation; I really had envisioned she was a young Barbra Streisand, a Jewish girl.\"", "Parker and the casting department had difficulty finding an actress for the role of Hilary Van Doren." ], [ "Saturday Night Fever (musical)", "From 27 March 2003 to 28 September 2003 the show ran at Teatro Pedregal, Mexico City with Mauricio Mart\u00ednez as Tony Manero, Lisset as Stephanie, Gisela Sehedi as Annette, Jaime Rojas as Monty and Eduardo Partida as Bobby C.\n\n", "In 2003 a second tour production was started across the United Kingdom and Ireland.", "The tour ran from 1 March 2003 to 19 June 2004.", "The tour was a different version to the previous productions including some major revival changes.", "In the place of \"More than a Woman (1)\" the song \"Words\" was put into the show.", "This song was performed by Tony and Stephanie.", "\"(1 March 2003 to 19 June 2004\"\n\nA London revival ran from 6 July 2004 to 16 February 2006 at the Apollo Victoria Theatre, prior to a lengthy UK tour. .", "The cast included newcomer Stephane Anelli as Tony and Zoe Ebsworth as Stephanie, with Kym Marsh from the pop group Hear'Say as Annette and Shaun Williamson of the television series \"EastEnders\" as DJ Monty.", "The Third UK tour began on 12 September 2005, while the show was also playing on the West End.", "The tour ran until 5 August 2006.", "The tour became a bigger success than the previous tour and yet again the changes made to both scenic and musical aspects of the show caused raving reviews." ] ], "gold": "There were several productions of Saturday Night Fever. The Teatro Pedregal version's Bobby C was played by Eduardo Partida. The Argentinian version's Bobby C was Charlie G. The Original Broadway production's Bobby C was Paul Castree. And, Barry Miller played Bobby C in the film Saturday Night Fever.", "prediction 1": "In the musical, \"Saturday Night Fever\", Bobby C was played by several actors. Eduardo Partida played Bobby C in all of the performances.", "prediction 2": "In the musical Saturday Night Fever, Eddie Vedder played Bobby C. Paul Castree played Bobby C. in the 2003 Broadway production.", "prediction 3": "In the 2007 film version of Saturday Night Fever, Bobby C. is played by Eduardo Partida, while in the 2008 film Bobby C. is played by James McDowell.", "prediction 4": "There are several performances of Saturday Night Fever. In the 1977 musical it was played by Ray Breakdancing. The character of Bobby C. was played by Paul Castree. In the 2002 musical it was played by Eduardo Partida. In the 2004 musical it was played by Bryan Batt.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 62, "end": 77 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the musical, \"Saturday Night Fever\", Bobby C was played byEduardo Partida. The Argentinian production version's Bobby C was Charlie G. The Original Broadway production's Bobby C was Paul Castree." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who is the founder of johns hopkins hospital?", "passages": [ [ "Johns Hopkins Hospital", "Most importantly, Hopkins told the trustees to \"bear constantly in mind that it is my wish and purpose that the hospital shall ultimately form a part of the Medical School of that university for which I have made ample provision in my will.\"", "By calling for this integral relationship between patient care, as embodied in the hospital, and teaching and research, as embodied in the university, Hopkins laid the groundwork for a revolution in American medicine.", "Johns Hopkins' vision, of two institutions in which the practice of medicine would be wedded to medical research and medical education was nothing short of revolutionary.", "Initial plans for the hospital were drafted by surgeon John Shaw Billings, and the architecture designed by John Rudolph Niernsee and completed by Edward Clarke Cabot of the Boston firm of Cabot and Chandler in a Queen Anne style.", "When completed in 1889 at a cost of $2,050,000 (US$50.8 million in 2016), the hospital included what was then state-of-the art concepts in heating and ventilation to check the spread of disease.", "The trustees obtained the services of four outstanding physicians, known as the \"Big Four,\" to serve as the founding staff of the hospital when it opened on May 7, 1889.", "They were pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly." ] ], "gold": "Johns Hopkins Hospital was founded by the group of founders called the Big Four, while the people who founded it were physicians Howard Atwood Kelly, William Osler, William Halsted, and William Welch, who comprised the Big Four.", "prediction 1": "Johns Hopkins Hospital was founded by Johns Hopkins and his trustees on May 7, 1889. The founders obtained the services of four outstanding physicians, known as the \"Big Four,\" to serve as the founding staff. They were pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly.", "prediction 2": "The trustees obtained the services of four outstanding physicians, known as the \"Big Four,\" to serve as the founding staff of the hospital when it opened on May 7, 1889. They were pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly.", "prediction 3": "The founder of Johns Hopkins Hospital is pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly.", "prediction 4": "Johns Hopkins Hospital was founded on May 7, 1889 by trustees of the Johns Hopkins University Medical School in Baltimore, Maryland. The hospital's founder, Johns Hopkins, sought the services of four outstanding doctors, known as the \"Big Four,\" to serve as the founding staff of the hospital when it opened. They were pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Johns Hopkins Hospital was founded by Johns Hopkins and his trustees on May 7, 1889. The founders obtained the services of four outstanding physicians, known as the \"Big Four,\" to serve as the founding staff. They were pathologist William Henry Welch, surgeon William Stewart Halsted, internist William Osler, and gynecologist Howard Atwood Kelly." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who sang back in the high life again?", "passages": [ [ "Back in the High Life Again", "Back in the High Life Again\n\n\"Back in the High Life Again\" is a 1986 single written by Steve Winwood and Will Jennings and performed by Winwood.", "The single was included on his album \"Back in the High Life\" and included backing vocals by James Taylor as well as a prominent mandolin played by Winwood.", "\"Back in the High Life Again\" was Winwood's second number one on the Adult Contemporary chart.", "The single stayed at number one for three weeks and went to number 13 on the \"Billboard\" Hot 100.", "\"Back in the High Life Again\" received a Grammy nomination for Record of the Year in 1988.", "The song was in closing credits of the CBS Sports coverage of the NBA Finals in 1987, and appeared in the \"It's Always Sunny in Philadelphia\" episode \"The Gang Buys a Boat\".", "It was also used in a photo montage of the \"NASCAR on TNN\" production crew after TNN's final NASCAR race broadcast, the 2000 Checker Auto Parts/Dura Lube 500 at Phoenix International Raceway.", "Warren Zevon subsequently covered the song on his 2000 album \"Life'll Kill Ya\".", "The Zevon version appeared in season 6, episode 6 of \"Longmire\" entitled \"No Greater Character Endorsement.\"" ] ], "gold": "Steve Winwood sang lead vocals with James Taylor in the 1986 single, Back In The High Life Again.", "prediction 1": "Back in the High Life Again is a 1986 single written by Steve Winwood and Will Jennings and performed by Winwood. The single was included on Winwood's album \"Back in the High Life\" and included backing vocals by James Taylor as well as a prominent mandolin played by Winwood. Back in the High Life Again received a Grammy nomination for Record of the Year in 1988. Warren Zevon subsequently covered the song on his 2000 album \"Life'll Kill Ya\".", "prediction 2": "\"Back in the High Life Again\" is a 1986 single written by Steve Winwood and Will Jennings and performed by Winwood. The single was included on his album \"Back in the High Life\" and included backing vocals by James Taylor as well as a prominent mandolin played by Winwood. \"Back in the High Life Again\" received a Grammy nomination for Record of the Year in 1988. Warren Zevon subsequently covered the song on his 2000 album \"Life'll Kill Ya\".", "prediction 3": "\"Back in the High Life Again\" is a 1986 single written by Steve Winwood and Will Jennings and performed by Winwood. The single was included on his album \"Back in the High Life\" and included backing vocals by James Taylor as well as a prominent mandolin played by Winwood.", "prediction 4": "\"Back in the High Life Again\" is a 1986 single written by Steve Winwood and Will Jennings and performed by Winwood. The single was included on his album Back in the High Life and included backing vocals by James Taylor as well as a prominent mandolin played by Winwood.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 364 }, { "error type": "Irrelevant", "explanation": "", "start": 365, "end": 444 }, { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 275 } ], "missing-info": [], "corrected-prediction": "Back in the High Life Again is a 1986 single performed by Steve Winwood and included backing vocals by James Taylor." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "What do you win on lotto max with 3 numbers?", "passages": [ [ "Lotto Super 7", "Lotto Super 7\n\nLotto Super 7 was a national lottery game in Canada, operated by the Interprovincial Lottery Corporation (ILC).", "It was launched on June 10, 1994, and its last draw was on September 18, 2009.", "Drawn every Friday night, the lottery had a guaranteed jackpot of $2.5 million, which was carried forward to the next draw if no purchased ticket matched all seven numbers in that draw.", "The largest jackpot awarded was in May 2002, in which four winning tickets shared a $37.8 million jackpot.", "Its final draw date was announced by ILC in March 2009, and in July 2009, ILC announced that it would be replaced by a new game, Lotto Max.", "ILC works with various lottery corporations owned by provincial governments.", "Profits are shared amongst the various retailers who sell tickets.", "Retailers receive from the lottery a percentage of the winnings for tickets sold from their shop (the money is not taken from the prize award).", "Lotto Super 7 involved picking seven numbers from 1 through 47.", "The prizes ranged from a free play to the jackpot.", "Prizes were awarded as follows:\n", "Note: The fixed prizes for 3 of 7, 3 of 7+ Bonus and 4 of 7 were payable from the Prize Fund (45% of sales)." ] ], "gold": "Winners of lotto max with 3 numbers and no bonus receive free play, while winners with 3 numbers and a bonus number win C$20.00.", "prediction 1": "Lotto Max is a national lottery game in Canada, operated by the Interprovincial Lottery Corporation, and it was launched on June 10, 1994. The lottery game was replaced by a new game in July 2009.", "prediction 2": "Lotto Max was a national lottery game in Canada, operated by the Interprovincial Lottery Corporation. Lotto Super 7 involved picking seven numbers from 1 through 47. The prizes ranged from a free play to the jackpot.", "prediction 3": "Lotto Max was a national lottery game in Canada, operated by the Interprovincial Lottery Corporation (ILC). It was launched on June 10, 1994, and its last draw was on September 18, 2009. Lotto Super 7 involved picking seven numbers from 1 through 47. The prizes ranged from a free play to the jackpot.", "prediction 4": "Lotto Max is a 3 number scratch-off game for the Lotto Super 7 game, which was launched on June 10, 1994, and its last draw was on September 18, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 196 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When did the age of criminal responsibility become 10?", "passages": [ [ "Defense of infancy", "Defense of infancy\n\nThe defense of infancy is a form of defense known as an excuse so that defendants falling within the definition of an \"infant\" are excluded from criminal liability for their actions, if at the relevant time, they had not reached an age of criminal responsibility.", "After reaching the initial age, there may be levels of responsibility dictated by age and the type of offense committed.", "Under the English common law the defense of infancy was expressed as a set of presumptions in a doctrine known as doli incapax.", "A child under the age of seven was presumed incapable of committing a crime.", "The presumption was conclusive, prohibiting the prosecution from offering evidence that the child had the capacity to appreciate the nature and wrongfulness of what they had done.", "Children aged seven to under fourteen were presumed incapable of committing a crime but the presumption was rebuttable.", "The prosecution could overcome the presumption by proving that the child understood what they were doing and that it was wrong.", "In fact, capacity was a necessary element of the state's case.", "If the state failed to offer sufficient evidence of capacity, the infant was entitled to have the charges dismissed at the close of the state's evidence.", "\"Doli incapax\" was abolished in England and Wales in 1998, but persists in other common law jurisdictions." ], [ "Young offender", "While this has been set at the federal level, each state is responsible for setting their own age of criminal responsibility.", "Thirty-three of The United States have no minimum age for criminal responsibility, leaving there to be 17 states that do.", "North Carolina has the lowest responsibility age of 7 years old and Wisconsin has the highest of 10 years old.", "There are 1.5 million cases per year in The United States that handle status offenses or criminal offenses by young offenders.", "Although this is a big number of juveniles, it is found that there was only 52 juveniles fully sentenced to prison-time throughout the five year span between 2010-2015.", "Although there are only 52 offenders committed to full incarceration, recidivism is common among young offenders, with 67% of them repeating a crime and being brought back into the system.", "In Brazil, the age of criminal responsibility was originally set at the age of 18.", "Anyone that was found guilty of committing crimes prior to the age of 18 were solely given an infraction and given other options rather than jail.", "These included, for children under 12, foster care options in order get them a safer family and for young offenders over 12 a class that they had to attend in order to help rehabilitate them." ], [ "Criminal law of Australia", "The \"Crimes Act 1900\" (NSW) is the New South Wales statute that establishes most criminal offences for New South Wales.", "This legislation along with federal acts \"Crimes Act 1914\", and the \"Criminal Code Act 1995\", form the majority of criminal law for New South Wales.", "Other statutes, such as the \"Summary Offences Act 1988\", also create criminal offences which are generally dealt with in the Local Court system.", "These include offensive conduct, offensive language, obscene exposure, knife possession.", "and loitering by convicted child sexual offenders.", "The offences spelt out in the Drug Misuse and Trafficking Act 1985 (NSW) cover all prohibited drugs.", "Other frequently used legislation includes the Bail Act 2013, (now amended by the \"Bail Amendment Act 2015\". )", ", Evidence Act 1995 and the Customs Act 1901.", "The \"Bail Amendment Act 2015\" was enacted in response to the Hatzistergos and Sentencing Council reports, as well as the Martin Place Siege.", "Controversially, the Act now contains provisions which limit the power to release an offender when the offences are related to terrorism.", "Prosecution of criminal offences is subject to the Law Enforcement (Powers and Responsibilities) Act 2002, which sets out the limits of police powers.", "Commonly contested parts of the act include Part 4 and Part 5 which are in relation to police search powers, and Part 8 in relation to powers of arrest." ] ], "gold": "The age of criminal responsibility became 10 in Australia in 1914, in New Zealand in 1989, in South Africa on 1 April 2010 and in England, Wales and Northern Ireland in 1998. In the United States, the age of criminal responsibility for federal crimes is set at 11. While this has been set at the federal level, each state is responsible for setting their own age of criminal responsibility. ", "prediction 1": "The age of criminal responsibility in the United States was set at the age of 7 in 1970, and at the age of 18 in 1978. The age of criminal responsibility was increased to 10 in 1982, and in 2013 it was increased to 12. In the United Kingdom, the age of criminal responsibility was set at the age of 19. In the United States, the age of criminal responsibility was set at the age of 18 in 1978, and at the time of writing, it was set at the age of 21. In France, the age of criminal responsibility was set at the year 2000, and in England and Wales in 1998, but was abolished in 1998, and Wales in 1998, and is now 10 years. In the United States, the age of criminal responsibility was set at the federal level, but each state is responsible for setting their own.", "prediction 2": "The age of criminal responsibility in the United States has been set at 7 years, in the United States it is 10 and in Brazil it is 18. The age of criminal responsibility was initially set at the age of 18 in Brazil, but was increased to 10 years in 2014.", "prediction 3": "The age of criminal responsibility in the United States changed from 7 to 10 years old in 2003. The age of criminal responsibility in Brazil was originally set at 18, with the age of criminal responsibility in Brazil increasing from 14 to 15. The age of criminal responsibility in the United Kingdom changed from 7 to 10 years old in 2007 to 8 and from 9 to 12 in 2014. In the United States, the age of criminal responsibility was increased to 8 from 9 in 2011 and from 12 to 14 in 2012.", "prediction 4": "The age of criminal responsibility in the United States became 10 years old on January 1, 2006. In Australia, the age of criminal responsibility has been set at the age of 18.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 118 }, { "error type": "Unverifiable", "explanation": "", "start": 119, "end": 218 }, { "error type": "Unverifiable", "explanation": "", "start": 219, "end": 302 }, { "error type": "Unverifiable", "explanation": "", "start": 303, "end": 450 }, { "error type": "Unverifiable", "explanation": "", "start": 451, "end": 623 } ], "missing-info": [], "corrected-prediction": " In the United States, the age of criminal responsibility was set at the federal level, but each state is responsible for setting their own." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When's the last time notre dame played georgia?", "passages": [ [ "1981 Sugar Bowl", "1981 Sugar Bowl\n\nThe 1981 edition to the Sugar Bowl was played on January 1, 1981, at the Louisiana Superdome in New Orleans, Louisiana.", "It featured the top-ranked and undefeated Georgia Bulldogs of the Southeastern Conference, and the seventh-ranked \n\nIn the first quarter, Notre Dame scored first on a 50-yard Oliver field goal.", "Another Notre Dame scoring opportunity in the first quarter was foiled when Bulldog freshman Terry Hoage blocked a field goal.", "Hoage had been a last minute addition to the roster by coach Vince Dooley for his kick blocking ability.", "Due to good field position Georgia's Rex Robinson would eventually boot a 46-yard field goal of his own to tie the game at 3.", "On the ensuing kickoff, a communication gaffe between the Irish's deep return players resulted in neither one fielding the kick which bounced at the one-yard line and was recovered by Georgia's Bob Kelly.", "Two plays later, Bulldog running back Herschel Walker scored on a 1-yard touchdown run as Georgia led 10\u20133.", "In the second quarter, Walker scored on a 3-yard run making the score 17\u20133 \n\nThe only score in the second half came in the third quarter; Notre Dame scored on a 1-yard run to close the margin to 17\u201310.", "Georgia's defense held on to that lead, giving Georgia the victory and the 1980 national championship." ], [ "2017 Georgia Bulldogs football team", "In their most recent matches, Georgia defeated Appalachian State 45\u20136 in 2013, Notre Dame 17\u201310 for the 1980 National Championship, and lost to Georgia Tech 28\u201327 at Sanford Stadium in 2016.", "From the SEC West, Georgia played Mississippi State for the first time since 2011 when they beat Mississippi State 24\u201310 as well as Auburn in their annual Deep South's Oldest Rivalry, leading the series 57\u201355\u20138 after winning 3 straight times against Auburn including last year's win against #8 Auburn 13\u20137 in Sanford Stadium.", "On September 2, 2017, Georgia faced Appalachian State University.", "Returning starting QB Jacob Eason suffered a knee injury early into the game, prompting true freshman QB Jake Fromm to enter.", "The freshman went 10 of 15 for 143 yards and a touchdown, and the defense kept the Mountaineers off the scoreboard for most of the game as the Bulldogs took care of business in Athens.", "Georgia traveled to Notre Dame for the first game between the two teams since the 1981 Sugar Bowl, which gave the No. 1 Bulldogs the 1980 National Championship.", "An estimated 70,000 Georgia fans traveled with the Bulldogs for the team's first trip north of the Mason-Dixon line in over 50 years." ], [ "Indiana Hoosiers football", "On January 4, 2017, former Tennessee offensive coordinator Mike DeBord was hired to the same position for the Hoosiers.", "On August 3, 2017, ESPN's \"College GameDay\" announced that it will hold its first show of the season in Bloomington (and the first time it has been held in that city).", "On September 9, 2017, Allen would record his first win as the head coach of the Hoosiers, defeating the Virginia Cavaliers, in Charlottesville, by a score of 34\u201317.", "The following week, Indiana University Athletics reached a mutual agreement with Florida International University to cancel its September 16 matchup, following the aftermath of Hurricane Irma in southern Florida.", "Following the loss at Purdue on November 25, 2017, Allen and the Hoosiers would finish the 2017 season 5-7 overall and fail to earn a bowl appearance.", "After the culmination of the 2018 season for Indiana, Allen's Hoosiers would again finish the season 5-7 overall; Indiana failed to beat Purdue in a must-win, last game of the season, to become bowl eligible.", "The loss to the Boilermakers would secure the Hoosiers second-straight year without a bowl appearance.", "Indiana has won two conference championships, one outright and one shared." ] ], "gold": "As of 2017, the last time Notre Dame played Georgia was on September 9, 2017. 2017 was the year of the first game between the two teams since the 1981 Sugar Bowl on January 1, 1981, in which the Georgia Bulldogs defeated the Notre Dame Fighting Irish 17 to 10.", "prediction 1": "The last time Notre Dame played Georgia was on January 1, 1981. On September 2, 2017, the last time Notre Dame played Georgia was on September 9, 2017. The last time Notre Dame played Georgia on October 6, 2016 was on October 16, 2016.", "prediction 2": "On September 2, 2017, Georgia faced Appalachian State University. Returning starting QB Jacob Eason suffered a knee injury early into the game, prompting true freshman QB Jake Fromm to enter. Following the loss at Purdue on November 25, 2017, Allen and the Hoosiers would finish the 2017 season 5-7 overall and fail to earn a bowl appearance. Following the loss at Purdue on November 25, 2017, Allen and the Hoosiers would again finish the 2017 season 5-7 overall and fail to earn a bowl eligible.", "prediction 3": "The last time Notre Dame played Georgia was January 1, 1981. From the SEC West, Georgia played Mississippi State for the first time since 2011 when they beat Mississippi State 24\u201310 as well as Auburn in their annual Deep South's Oldest Rivalry, leading the series 57\u201355\u20138 after winning 3 straight times against Auburn including last year's win against #8 Auburn 13\u20137 in Sanford Stadium.", "prediction 4": "Notre Dame played Georgia in the 1980 Sugar Bowl on January 1, 1981. In the 1981 edition of the Sugar Bowl, Notre Dame defeated the Georgia Bulldogs 17-10. From the SEC West, Georgia played Mississippi State for the first time since 2011, when they beat Mississippi State 24\u201310. In 2017, Georgia faced Appalachian State University. Returning starting QB Jacob Eason suffered a knee injury early into the game, prompting true freshman QB Jake Fromm to enter.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The last time Notre Dame played Georgia was on January 1, 1981.", "start": 152, "end": 210 }, { "error type": "Redundant", "explanation": "on October 6, 2016 ", "start": 211, "end": 235 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 0, "end": 63 }, { "error type": "Redundant", "explanation": "On September 2, 2017", "start": 126, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 64, "end": 125 } ], "missing-info": [], "corrected-prediction": "Notre Dame played Georgia in 2017 for the first time since the Sugar Bowl on January 1, 1981. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who won mvp at the all star game 2018?", "passages": [ [ "2018 NBA All-Star Game", "2018 NBA All-Star Game\n\nThe 2018 NBA All-Star Game was the 67th edition of an exhibition basketball game that was played on February 18, 2018.", "It was held at Staples Center in Los Angeles, home of the Los Angeles Lakers and Los Angeles Clippers.", "It was the sixth time that Los Angeles had hosted the All-Star Game and the first time since 2011.", "Team LeBron won against Team Stephen 148-145.", "The MVP of the game was LeBron James, scoring 29 points, 10 rebounds, 8 assists, winning his third NBA All-Star Game Most Valuable Player (MVP) award.", "The game was televised nationally by TNT for the 16th consecutive year.", "On October 3, 2017, the NBA announced that the format would change from the traditional Eastern Conference versus Western Conference format, and would instead switch to a draft-style format, similar to the format used by the NHL All-Star Game from 2011 through 2015 and the NFL Pro Bowl from 2014 through 2016.", "The team captains were determined by the most votes received in their respective conference.", "Each team will pick a charity to play for, and the winning team will have money donated to their charity.", "The winning team will receive $100,000 for each player and the losing team $25,000 each.", "The two teams were coached from their respective conference." ], [ "2018 National Hockey League All-Star Game", "2018 National Hockey League All-Star Game\n\nThe 2018 National Hockey League", "All-Star Game took place at Amalie Arena in Tampa, home of the Tampa Bay Lightning on January 28, 2018.", "Tampa last held the NHL All-Star Game in 1999.", "The All-Star Game was played in lieu of NHL participation in the 2018 Winter Olympics, as the NHL Board of Governors ruled against interrupting the season to send players to Pyeongchang from February 10 to 25.", "The Pacific All-Stars won the All-Star Game, which was in its third straight year of a four-team, 3-on-3, single elimination format, with one team representing each of the league's four divisions.", "Rookie Brock Boeser of the Vancouver Canucks was named the Most Valuable Player, scoring two goals with an assist.", "He became the first rookie to win MVP since Mario Lemieux in 1985.", "The 2018 All-Star Game again used the 3-on-3 tournament format successfully introduced in 2016, in which teams representing each of the NHL's four divisions (the Atlantic, Metropolitan, Central, and Pacific) played a single-elimination tournament, with each game consisting of two 10-minute halves played 3-on-3 and going directly to a shootout if tied after 20 minutes." ], [ "Brock Boeser", "Boeser was selected 23rd overall by the Vancouver Canucks in the 2015 NHL Entry Draft.", "He signed a three-year entry-level contract with the Canucks on March 25, 2017.", "Later that same day, he made his NHL debut in his home state of Minnesota and scored his first NHL goal in the 4\u20132 win.", "On November 4, 2017, Boeser scored a hat trick, the first Canucks player age 20 or younger to do so since Trevor Linden on December 20, 1990 as well as the third youngest behind Trevor Linden and Tony Tanti.", "All three goals came against Matt Murray of the Pittsburgh Penguins, allowing the Canucks to win 4\u20132.", "Boeser was named the league's Rookie of the Month for November after leading all skaters (not just rookies) with 11 goals in 15 games.", "He was again named Rookie of the Month for the month of December after scoring 8 goals and 13 points in 13 games.", "On January 10, 2018, Boeser was named to his first career NHL All-Star Game as a member of the Pacific Division roster.", "With two goals and an assist in two games, Boeser was named the Most Valuable Player of the 2018 NHL All-Star Game becoming the first rookie to do so since Mario Lemieux in 1985." ] ], "gold": "LeBron James was named MVP at the 2018 NBA All-Star Game that was played on February 18 at Staples Center in Los Angeles, California, where he recorded 29 points, 10 rebounds, and 8 assists and it was his third time winning the award since the 2008 All-Star Game. Brock Boeser of the Vancouver Canucks was named MVP at the 2018 National Hockey League All-Star Game which took place at Amalie Arena in Tampa on January 28, 2018 and he became the first rookie to win MVP since Mario Lemieux in 1985. Alex Bregman, an American professional baseball third baseman and shortstop for the Houston Astros, was awarded MVP at the 2018 Major League Baseball All-Star Game which was played at Nationals Park on July 17 of that year. Josef Mart\u00ednez, a Venezuelan professional footballer who plays as a striker for Major League Soccer club Atlanta United and the Venezuela national team, became the most decorated single-season player in MLS history by winning the League MVP, All-Star Game MVP, Golden Boot, and MLS Cup Final MVP in 2018.", "prediction 1": "LeBron James won the MVP of the 2018 NBA All-Star Game, scoring 29 points, 10 rebounds, and 8 assists, winning his third NBA All-Star Game Most Valuable Player award. Rookie Brock Boeser of the Vancouver Canucks was named the Most Valuable Player, scoring two goals with an assist. He became the first rookie to win MVP since Mario Lemieux in 1985.", "prediction 2": "LeBron James, scoring 29 points, 10 rebounds, and 8 assists, is the NBA All-Star Game MVP for the third time. Additionally, Brock Boeser, a rookie with the Vancouver Canucks, is the first rookie to win MVP in NHL All-Star Game since 1985.", "prediction 3": "The All-Star Game is an annual basketball game held between the NBA and NHL, where the most valuable player is LeBron James, who won the MVP award in 2017. Brock Boeser of the Vancouver Canucks won the MVP award in 2018, and the most valuable player in the National Hockey League all star game was Kevin Durant.", "prediction 4": "The NBA All-Star Game is an annual exhibition basketball game held every two years. During the 2018 NBA All-Star Game, LeBron James, playing for the Los Angeles Lakers, won the MVP award. The NHL All-Star Game was held on January 28, 2018. Brock Boeser, from the Vancouver Canucks, won the MVP award.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 281 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "LeBron James won the MVP of the 2018 NBA All-Star Game that was played on February 18th at Staples Center in Los Angeles, California, scoring 29 points, 10 rebounds, and 8 assists, winning his third NBA All-Star Game Most Valuable Player award. Rookie Brock Boeser of the Vancouver Canucks was named the Most Valuable Player at the 2018 NHL All-Star Game, which took place at Amalie Arena in Tampa on January 28. He became the first rookie to win MVP since Mario Lemieux in 1985." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who owns the san diego padres baseball team?", "passages": [ [ "Ron Fowler", "Ron Fowler\n\nRonald L Fowler (born 1943/1944) is the executive chairman of the ownership group of the San Diego Padres franchise in Major League Baseball (MLB).", "He also serves as the CEO of Liquid Investments Incorporated, a San Diego beer distributorship.", "Fowler was a member of a minority group that owned 49.32 percent of the Padres.", "The group, headed by then-Padres chief executive Jeff Moorad, attempted to buy the Padres from controlling owner John Moores for $530 million, but the deal fell through in April 2012.", "Fowler then replaced Moorad as the general partner of the minority group, and he served on the Padres executive committee.", "Fowler joined a new group to purchase the Padres that included four heirs to the O\u2019Malley family\u2014who owned the Los Angeles Dodgers franchise for five decades.", "Kevin and Brian O'Malley are the sons of former Dodgers owner Peter O'Malley and grandsons of Walter O'Malley, the owner who moved the Dodgers west from Brooklyn after the 1957 season.", "Peter and Tom Seidler are the nephews of Peter O\u2019Malley.", "MLB approved the $800 million sale, which completed on August 28, 2012.", "As much as $200 million of the sale price included the team's 20-percent stake in Fox Sports San Diego, a cable channel that pays the Padres annual fees as part of a $1.2 billion, 20-year agreement." ] ], "gold": "Ronald Fowler is the vice-chairman of the ownership group of the San Diego Padres. Fowler joined a group to purchase the Padres that included four heirs to the O\u2019Malley family\u2014who owned the Los Angeles Dodgers franchise for five decades. Kevin and Brian O'Malley are the sons of former Dodgers owner Peter O'Malley and grandsons of Walter O'Malley. Peter and Tom Seidler are the nephews of Peter O\u2019Malley. This group purchased the Padres for 800 million dollars. ", "prediction 1": "John Moores, the controlling owner of the San Diego Padres, sold the team to Ron Fowler and a new ownership group formed to purchase the team.\n", "prediction 2": "John Moores was the controlling owner of the San Diego Padres from 1927 to 2012, while Ron Fowler and four heirs to the O'Malley family controlled the Los Angeles Dodgers. Moores sold his controlling stake in the Padres to Jeff Moorad for $530 million in 2012. Lotus Sports Holdings LLC bought Lotus Sports Holdings LLC for $1.87 billion in 2012.", "prediction 3": "John Moores was the controlling owner of the San Diego Padres from 1928 to 2012, until two new ownership groups became formed in 2012. John Moores owned the San Diego Padres from 1989 to 2012, while Ron Fowler owned them from 1999 to 2012.", "prediction 4": "John Moores owns the San Diego Padres baseball team. John Moores had owned the team since 1955. Ron Fowler bought the Padres in 2012 and Ron Fowler's new ownership group including four heirs to the O'Malley family, who owned the Los Angeles Dodgers franchise for five decades, and Peter O'Malley's nephew Peter O'Malley.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 76 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6, 7, 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "John Moores, the controlling owner of the San Diego Padres, sold the team to Ron Fowler and a new ownership group formed to purchase the team. The group included four heirs to the O\u2019Malley family\u2014who owned the Los Angeles Dodgers franchise for five decades. They include, Kevin and Brian O'Malley are the sons of former Dodgers owner Peter O'Malley and grandsons of Walter O'Malley as well as Peter and Tom Seidler, the nephews of Peter O\u2019Malley. It was a $800 million sale.\n" }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who are the members of the band gorillaz?", "passages": [ [ "Gorillaz", "Gorillaz\n\nGorillaz are a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett.", "The band primarily consists of four animated members: 2-D (lead vocals, keyboards), Murdoc Niccals (bass guitar), Noodle (guitar, keyboards, occasional vocals), and Russel Hobbs (drums and percussion).", "Their fictional universe is explored through music videos, interviews, and other short cartoons.", "In reality, Albarn is the only permanent musical contributor, and often collaborates with other musicians.", "With Gorillaz, Albarn departed from the distinct Britpop of his band Blur and explored influences including hip hop, electronic music, and world music through an \"eccentrically postmodern\" approach.", "The band's 2001 debut album \"Gorillaz\" went Triple Platinum in the UK and Double Platinum in Europe and earned the group an entry in the \"Guinness Book of World Records as\" the Most Successful Virtual Band.", "It was nominated for the Mercury Prize, but the nomination was withdrawn at the band's request.", "Their second studio album, \"Demon Days\" (2005), went six times platinum in the UK and double platinum in the US, The band has won other awards, including one Grammy Award, two MTV Video Music Awards, an NME Award and three MTV Europe Music Awards." ] ], "gold": "Gorillaz is an English virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. The band currently consists of four animated members: 2-D, Murdoc Niccals, Russel Hobbs, Noodle part of a fictional universe presented in the band's music videos, interviews and short cartoons. The non-virtual members of the band are Damon Albarn, Jamie Hewlett, Remi Kabaka Jr., Stephen Sedgwick, who have presented live in a variety of different ways throughout the band's history, such as hiding the live band from the audience's view in the early years of the project, projecting animated band members on stage via computer graphics and traditional live touring featuring a fully visible live band.", "prediction 1": "Gorillaz are a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. The band primarily consists of four animated members: 2-D (lead vocals, keyboards), Murdoc Niccals (bass guitar), Noodle (guitar, keyboards, occasional vocals), and Russel Hobbs (drums and percussion).\n", "prediction 2": "Gorillaz are a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. The band mainly consists of four animated members: 2-D (lead vocals, keyboards), Murdoc Niccals (bass guitar), Noodle (guitar, keyboards, occasional vocals), and Russel Hobbs (drums and percussion).", "prediction 3": "Gorillaz are a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. Their fictional universe is explored through music videos, interviews, and other short cartoons. The members of the band are 2-D (lead vocals, keyboards), Murdoc Niccals (bass guitar), Noodle (guitar, keyboards, occasional vocals), and Russel Hobbs (drums and percussion).", "prediction 4": "Gorillaz is a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. The band primarily consists of four animated members: 2-D (lead vocals, keyboards), Murdoc Niccals (bass guitar), Noodle (guitar, keyboards, occasional vocals), and Russel Hobbs (drums and percussion).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 216 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 305 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Gorillaz are a British virtual band created in 1998 by musician Damon Albarn and artist Jamie Hewlett. The band primarily consists of four animated members: 2-D, Murdoc Niccals , Noodle, and Russel Hobbs. Their fictional universe is explored through music videos, interviews, and other short cartoons. In reality, Albarn is the only permanent musical contributor, and often collaborates with other musicians.\n" }, "preference": [ 0, 0, 0, 1, 0, 0 ] }, { "question": "Who has most grand slams in mlb history?", "passages": [ [ "Tony Lazzeri", "Despite his hitting 60 home runs in an extended PCL season in 1925, Lazzeri never hit more than 18 home runs in a major league season (a mark he reached four times).", "Lazzeri holds the American League record for most RBI in a game with 11, set May 24, 1936, as he also became the first major league player to hit two grand slams in one game.", "He holds the major league record of 15 RBIs in consecutive games (one more than Rudy York in 1946 and Sammy Sosa in 2002).", "He also set major league records of six home runs in three consecutive games, and seven in four consecutive games.", "Lazzeri continues to share the consecutive-game American League record, but the three-game record was topped by Shawn Green of the Dodgers (seven in 2002) and the four-game mark was broken by Ralph Kiner of the Pittsburgh Pirates (eight in 1947).", "Lazzeri is also the only player in major league baseball to hit a natural cycle with the final home run being a grand slam on June 3, 1932.", "The Veterans Committee elected Lazzeri to the National Baseball Hall of Fame in 1991.\n\n\n, or Retrosheet" ], [ "Grand slam (baseball)", "Travis Hafner tied Mattingly's Major League record in , while in , Albert Pujols tied the one-season National League record of five grand slams set by Ernie Banks in .", "Several grand slams, the first being Connor's in 1881, consisted of a player hitting a walk-off grand slam for a one-run victory; some baseball observers call this an \"ultimate grand slam\".", "Roberto Clemente is the only player to have hit a walk-off inside-the-park grand slam in a one-run victory; the Pittsburgh Pirates defeated the Chicago Cubs 9\u20138 on July 25, 1956 at Forbes Field, a park known for its spacious outfield.", "On April 10, 1980 \u2013 on Opening Day, the Milwaukee Brewers' Sixto Lezcano hit a walk-off Grand Slam, reportedly the first such feat on an Opening Day.", "(Lezcano also has the distinction of hitting a Grand Slam the previous year, also on Opening Day.)", "During the major league season, grand slams accounted for 132 of the 5017 home runs hit (2.6%).", "On June 13\u201314, , the Minnesota Twins hit grand slams in consecutive games against the Boston Red Sox, including a walk-off grand slam by Jason Kubel in the 12th inning on June 13." ], [ "Alex Rodriguez", "The first time he faced Dempster, Rodriguez was hit by a pitch on a 3-0 count, leading to home plate umpire Brian O'Nora warning both benches and ejecting Girardi, while Dempster was allowed to stay in the game.", "Later in the top of the 6th inning, Rodriguez hit a 442-foot home run to straightway center off Dempster.", "The Yankees won 9-6, and Dempster, who hit Rodriguez before, was suspended 5 games by the MLB with an undisclosed fine (although he did not miss a start).", "On September 20, at Yankee Stadium, Rodriguez hit his 24th career grand slam, an opposite field 654th career home run, off George Kontos of the San Francisco Giants, breaking the all-time grand slam record, formerly held by Lou Gehrig.", "For the 2013 season, Rodriguez played in only 44 games batting .244 with 7 home runs and 19 RBI.", "Rodriguez's suspension that was announced the previous season but delayed pending an appeal, was upheld for the entirety of the 2014 regular season and postseason." ] ], "gold": "Alex Rodriguez has 25 career grand slams, the most by any player in Major League Baseball history. On September 20, 2013, at Yankee Stadium, Rodriguez hit his 24th career grand slam breaking the all-time grand slam record, formerly held by Lou Gehrig. Don Mattingly and Travis Hafner share the single-season grand slam record with six grand slams each. The record for most grand slams in one game is two. In 1936, Tony Lazzeri was the first player to hit two grand slams in a single game while Josh Willingham is the most recent player to accomplish this feat in 2009. ", "prediction 1": "In the major league game history, the player who has hit the most grand slams is Tony Lazzeri. On April 10, 1980 \u2013 on Opening Day, the Milwaukee Brewers' Sixto Lezcano hit a walk-off Grand Slam, reportedly the first such feat on an Opening Day. On September 20, at Yankee Stadium, Alex Rodriguez hit his 24th career grand slam, an opposite field 654th career home run, off George Kontos of the San Francisco Giants, breaking the all-time Grand Slam record.", "prediction 2": "There are several players with the most grand slams in major league baseball history. Travis Hafner has the most grand slams in a career, while Albert Pujols has the most grand slams in a season. Sixto Lezcano has the most grand slams in a career, hitting a Grand Slam on Opening Day, on April 10, 1980.", "prediction 3": "The player with the most grand slams in major league baseball history is Tony Lazzeri. However, the player with the most grand slams in a single season is Alex Rodriguez, who hit 24 career grand slams in the majors.", "prediction 4": "The player with the most grand slams in major league baseball history is Tony Lazzeri, who hit his career grand slam on May 24, 1936. Sixto Lezcano, who hit his career grand slam on Opening Day 1980, has hit his career grand slam on June 13, 1980.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 81, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 244 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the major league game history, the player who has hit the most grand slams in a single season is Albert Pujols and Ernie Banks. The first player to hit two grand slams in a single game is Tony Lazzeri. He accomplished this in 1936. On September 20, at Yankee Stadium, Alex Rodriguez hit his 24th career grand slam, breaking the all-time Grand Slam record, formerly held by Lou Gehrig." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "How many members are in the senate in france?", "passages": [ [ "Senate (France)", "The Second Republic returned to a unicameral system after 1848, but soon after the establishment of the Second French Empire in 1852, a Senate was established as the upper chamber.", "In the Fourth Republic, the Senate was replaced by the Council of the Republic, but its function was largely the same.", "With the new constitution of the Fifth Republic enforced on 4 October 1958, the older name of Senate was restored.", "In 2011, the Socialist Party won control of the French Senate for the first time since the foundation of the French Fifth Republic.", "In 2014, the centre-right Gaullists and its allies won back the control of the Senate.", "Until September 2004, the Senate had 321 senators, each elected to a nine-year term.", "That month, the term was reduced to six years, while the number of senators progressively increased to 348 in 2011, in order to reflect the country's population growth.", "Senators were elected in thirds every three years; this was also changed to one-half of their number every three years.", "Senators are elected indirectly by approximately 150,000 officials (\"grands \u00e9lecteurs\"), including regional councilors, department councilors, mayors, city councilors in large towns, and members of the National Assembly.", "However, 90 % of the electors are delegates appointed by councilors.", "This system introduces a bias in the composition of the Senate favoring rural areas." ] ], "gold": "There are 348 members in the Senate in France. Until September 2004, the Senate had 321 members, each elected to serve for a nine-year term. In that month, the term was reduced to six years, and the number of members in the Senate was set to increase to 348 by 2011 in order to reflect a growth in France's population. ", "prediction 1": "The Senate in France has 348 members, the most-recent count being 322. As of 2016, there were 341 senators, but that number increased to 348 as of 2019.", "prediction 2": "The French Senate has 348 members. The number of senators progressively increased to 348 in 2011 in order to reflect the country's population growth.", "prediction 3": "Until September 2004, the Senate had 321 senators, each elected to a nine-year term. That month, the term was reduced to six years, while the number of senators progressively increased to 348 in 2011, in order to reflect the country's population growth.", "prediction 4": "The French Senate is composed of three chambers, each with a number of members. Until September 2004, the Senate had 321 senators, each elected to a nine-year term. That month, the term was reduced to six years, while the number of senators progressively increased to 348 in 2011, in order to reflect the country's population growth.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 38, "end": 70 }, { "error type": "Unverifiable", "explanation": "", "start": 71, "end": 107 }, { "error type": "Unverifiable", "explanation": "", "start": 141, "end": 152 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Senate in France has 348 members. Until September 2004, the Senate had 321 senators, each elected to a nine-year term. That month, the term was reduced to six years, while the number of senators progressively increased to 348 in 2011, in order to reflect the country's population growth.\n" }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who is the governor of the state of missouri?", "passages": [ [ "Mike Parson", "Mike Parson\n\nMichael L. Parson (born September 17, 1955) is an American politician and former law enforcement officer currently serving as the 57th Governor of Missouri since June 1, 2018, having taken office after the resignation of Eric Greitens.", "Parson previously served as the 47th Lieutenant Governor of Missouri.", "Before that, he served as a Republican member of the Missouri House of Representatives from the 133rd district (2005\u20132011) and as a member of the Missouri Senate representing the 28th district (2011\u20132017).", "Parson served as the Majority Caucus Whip in the Senate during the 96th General Assembly.", "Parson was born on September 17, 1955, in Wheatland, Missouri, and raised on a farm in Hickory County.", "He graduated from Wheatland High School in 1973.", "In 1975 Parson spent six years in the U.S. Army, serving two tours in the Military Police working up to sergeant.", "He attended night classes at the University of Maryland and the University of Hawaii.", "Following his military service, in 1981 Parson returned to Hickory County to serve as a deputy.", "In 1983 he transferred to the Polk County Sheriff's Office to become its first criminal investigator.", "He purchased his first gasoline station, \"Mike's,\" in 1984.", "The following year he started a cow and calf operation, becoming a third-generation farmer." ], [ "Eric Greitens", "Eric Greitens\n\nEric Robert Greitens (; born April 10, 1974) is an American politician and former Navy SEAL who served as the 56th Governor of Missouri from January 2017 until his resignation in June 2018.", "Born and raised in St. Louis, Greitens earned a doctorate from Lady Margaret Hall, Oxford as a Rhodes scholar.", "During his four tours of duty as a U.S. Navy SEAL officer, he rose to the rank of lieutenant commander, commanded a unit targeting Al-Qaeda, and was awarded a Bronze Star and a Purple Heart.", "Later, after serving as a White House Fellow, Greitens founded a non-profit organization, The Mission Continues, to serve veterans.", "\"Time\" included him in its list of the 100 most influential people in the world in 2013.", "Greitens joined the Republican Party in 2015 after having been a Democrat.", "He ran for Governor of Missouri as a Republican in 2016.", "After defeating three opponents in the Republican primaries, he faced state Attorney General Chris Koster, whom he defeated in the general election.", "One of Greitens's signature accomplishments during his time in office was signing Missouri's right-to-work law, which was later repealed by statewide referendum.", "His tenure as Governor was marred by controversy, including multiple allegations of campaign finance and open records statute violations." ], [ "Jay Nixon", "Jay Nixon\n\nJeremiah Wilson \"Jay\" Nixon (born February 13, 1956) is an American politician and lawyer who served as the 55th Governor of Missouri from 2009 to 2017 as a member of the Democratic Party.", "Nixon was first elected Governor in 2008 and re-elected in 2012.", "Prior to his governorship, he served as the state's 40th Attorney General from 1993 to 2009.", "After leaving public office he joined the Dowd Bennett law firm in St. Louis.", "Jay Nixon grew up in De Soto, Missouri, where he was born.", "His mother, Betty Lea (n\u00e9e Willson), was a teacher and president of the local school board, and his father, Jeremiah \"Jerry\" Nixon, served as the city's mayor.", "One of his paternal three great-grandfathers, Abraham Jonas, was an early Jewish settler in Illinois and friend of former President Abraham Lincoln (one of Nixon's paternal great-grandmothers was Jewish, though Nixon is Methodist).", "His great-great-grandfather Charles Henry Jonas was the brother of Democratic U.S. Senator Benjamin F. Jonas of Louisiana and another, James Oscar Nixon, was a brother of U.S. Representative John Thompson Nixon of New Jersey.", "Another paternal ancestor, John Inskeep, had served as Mayor of Philadelphia (from 1800\u20141801 and 1805\u20141806)." ] ], "gold": "Michael Parson serves as the 57th and current governor of Missouri. Parson succeeded Eric Greitens who was the governor of Missouri from January 2017 until his resignation in June 2018. Preceding Greitens, Jay Nixon served as the governor of Missouri from 2009 to 2017, and Matt Blunt served as governor of Missouri from 2005 to 2009. ", "prediction 1": "Eric Greitens, an American politician and former Navy SEAL, served as the 56th Governor of Missouri from January 2017 until his resignation in June 2018. Jay Nixon, an American politician and lawyer, served as the 55th Governor of Missouri from 2009 to 2017 as a member of the Democratic Party. Michael Parson, an American politician and former law enforcement officer currently serving as the 57th Governor of Missouri since June 1, 2018, having taken office after the resignation of Eric Greitens.", "prediction 2": "Eric Greitens was the 56th Governor of Missouri from January 2017 until his resignation in June 2018. Jay Nixon was the 55th Governor of Missouri from 2009 to 2013 and was first elected Governor in 2008 and re-elected in 2012.", "prediction 3": "Mike Parson, born September 17, 1955, is an American politician and former law enforcement officer currently serving as the 57th Governor of Missouri since June 1, 2018, having taken office after the resignation of Eric Greitens. Jay Nixon, born February 13, 1956, is an American politician and lawyer who served as the 55th Governor of Missouri from 2009 to 2017 as a member of the Democratic Party. Eric Greitens, born April 10, 1974, is an American politician and former Navy SEAL who served as the 56th Governor of Missouri from January 2017 through June 2018 until his resignation in June 2018.", "prediction 4": "Eric Greitens was the 56th Governor of Missouri from January 2017 until his resignation in June 2018. Jay Nixon served as the 55th Governor of Missouri from 2009 to 2017. Michael L. Parson was the 57th Governor of Missouri from June 1, 2018 to June 1, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 59 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 294 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 368 }, { "error type": "Redundant", "explanation": " until his resignation in June 2018.", "start": 440, "end": 499 } ], "missing-info": [], "corrected-prediction": "Eric Greitens served as the 56th Governor of Missouri from January 2017 until his resignation in June 2018. Jay Nixon served as the 55th Governor of Missouri from 2009 to 2017. Michael Parson is currently serving as the 57th Governor of Missouri since June 1, 2018." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Which indian city is known as venice of the east?", "passages": [ [ "Alappuzha", "Alappuzha\n\nAlappuzha (), also known by its former name Alleppey, is the administrative headquarters of Alappuzha District in the Indian State of Kerala.", "Alappuzha is a city and a municipality in Kerala with an urban population of 174,164 and third among the districts having highest literacy rate in Kerala.", "In 2016, Centre for Science and Environment rated Alappuzha as the top cleanest town in India followed by Mysuru\n& Panaji Alappuzha is considered to be the oldest planned city in this region and the lighthouse built on the coast of the city is the first of its kind along the Laccadive Sea coast (reference encyclopaedia of Kerala in Malayalam language).", "The city is situated at a distance 28\u00a0km from Changanacherry, 46\u00a0km from Kottayam and 53 from Kochi and north of Trivandrum.", "A town with picturesque canals, backwaters, beaches, and lagoons, it was described as the one of the places known as the \"Venice of the East\" by Lord Curzon.", "Hence, it is known as the \"Venetian Capital\" of Kerala.", "Malayalam is the most spoken language.", "It is an important tourist destination in India.", "The Backwaters of Alappuzha are the most popular tourist attraction in Kerala." ], [ "Srinagar", "Birds found in Hokersar\u2014Migratory ducks and geese which include brahminy duck, tufted duck, gadwall, garganey, greylag goose, mallard, common merganser, northern pintail, common pochard, ferruginous pochard, red-crested pochard, ruddy shelduck, northern shoveller, common teal, and Eurasian wigeon.", "Srinagar has a humid subtropical climate (K\u00f6ppen \"Cfa\").", "The valley is surrounded by the Himalayas on all sides.", "Winters are cool, with daytime temperature averaging to , and drops below freezing point at night.", "Moderate to heavy snowfall occurs in winter and the highway connecting Srinagar with the rest of India faces frequent blockades due to icy roads and avalanches.", "Summers are warm with a July daytime average of .", "The average annual rainfall is around .", "Spring is the wettest season while autumn is the driest.", "The highest temperature reliably recorded is and the lowest is .", "In November 2011, the City Mayors Foundationan advocacy think tankannounced that Srinagar was the 92nd fastest growing urban areas in the world in terms of economic growth, based on actual data from 2006 onwards and projections to 2020.", "Srinagar is one of several places that have been called the \"Venice of the East\"." ], [ "Tourist attractions in Udaipur", "Tourist attractions in Udaipur\n\nUdaipur city, also known as the 'City of Lakes' and 'Venice of East', is a very popular tourist destination in Rajasthan, India.", "The capital of the former princely state of Mewar, and considered as one amongst the most romantic cities of India, Udaipur is a land around the azure water lakes, hemmed in by the lush hills of the Aravalis.", "The city is a blend of sights, sounds and experiences.", "With its kaleidoscope of fairy-tale palaces, lakes, temples, gardens and narrow lanes, the city carries the flavor of heroic past, epitomizing valor and chivalry.", "Voted the Best City in the World in 2009 by \"Travel + Leisure\" magazine, Udaipur is now amongst the favourite wedding destinations for Indian as well as foreign nationals.", "Some of the key tourist destinations are:\n\nThe Ahar Cenotaphs are a group of royal cenotaphs of the Maharanas of Mewar, located about 2\u00a0km east of Udaipur.", "It has about nineteen cenotaphs of various Maharanas cremated, including one of Maharana Amar Singh, who reigned from 1597 to 1620.", "Nearby is also Ahar Museum, where on display is limited but very rare earthen pottery, as well as some sculptures and other archaeological finds." ] ], "gold": "There are multiple cities in India that have been known as the \"Venice of the East.\" Alappuzha, formerly known as Alleppey, is the head of the Alappuzha District in the Indian State of Kerala, and was described by\u00a0George Curzon, Viceroy of India at the start of the 20th century, as the \"Venice of the East.\" The summer capital of the Indian union territory of Jammu and Kashmir, Srinagar, and Udaipur, known as the \"City of Lakes\" in Rajasthan, have also been called \"Venice of the East.\"", "prediction 1": "In India, several cities have been called the Venetian of the East. In India, Alappuzha is the city and municipality that is known as the Venetian Capital of Kerala. Among the other places that have been called the Venetian of the East is Udaipur in Rajasthan, India.", "prediction 2": "The Indian city of Alappuzha, also known by its former name Alleppey, is the administrative headquarters of Alappuzha District in the Indian State of Kerala. The city of Srinagar, one of several places that have been called the \"Venice of the East\", is a very popular tourist destination in Rajasthan, India. The city of Udaipur is known as the City of Lakes and the \"Venice of East\".", "prediction 3": "There are several Indian cities that have been described as the Venice of the East. The city of Alappuzha, in Kerala, is one of the places known as the Venetian Capital of Kerala. In Rajasthan, Udaipur, in Udaipur, is also known as the City of Lakes and the Venetian Capital of Mewar. The city of Cochin is one of the places known as the Venetian Capital of Kerala.", "prediction 4": "There are several Indian cities that have been called \"Venice of the East\". The city of Alappuzha is one of the places in Kerala that has been named as the \"Venice of the East\" by Lord Curzon. The city of Udaipur, also known as the City of Lakes, is a very popular tourist destination in Rajasthan, India.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 267 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "In India, several cities have been called the Venetian of the East. Alappuzha known by its former name Alleppey, is the administrative headquarters of Alappuzha District in the Indian State of Kerala, and is described as the Venetian of the East George Curzon. Srinagar is one of several places that have been called the \"Venice of the East\"." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who is the owner of tom and jerry?", "passages": [ [ "Tom and Jerry", "Mammy Two Shoes is a heavy-set middle-aged mammy who often has to deal with the mayhem generated by the lead characters.", "Voiced by character actress Lillian Randolph, she is often seen as the owner of Tom.", "Her face was only shown once, very briefly, in \"Saturday Evening Puss\".", "Mammy's appearances have often been edited out, dubbed, or re-animated as a slim white woman in later television showings, since her character is a mammy archetype now often regarded as racist.", "She was mostly restored in the DVD releases of the cartoons, with an introduction by Whoopi Goldberg explaining the importance of African-American representation in the cartoon series, however stereotyped.", "\"Tom and Jerry\" was a commonplace phrase for youngsters indulging in riotous behaviour in 19th-century London.", "The term comes from \"Life in London, or Days and Nights of Jerry Hawthorne and his elegant friend Corinthian Tom\" (1823) by Pierce Egan.", "However Brewer notes no more than an \"unconscious\" echo of the Regency era original in the naming of the cartoon.", "William Hanna and Joseph Barbera were both part of the Rudolf Ising unit at the MGM cartoon studio in the late 1930s." ], [ "Tom and Jerry", "Turner sold the company a short while later, but retained MGM's pre-1986 film library, thus \"Tom and Jerry\" became the property of Turner Entertainment Co. (where the rights stand today via Warner Bros.), and have in subsequent years appeared on Turner-run stations, such as TBS, TNT, Cartoon Network, The WB, Boomerang, and Turner Classic Movies.", "One of the biggest trends for Saturday morning television in the 1980s and 1990s was the child versions of famous classic cartoon stars \"babyfication\" of older, classic cartoon stars, and on March 2, 1990, \"Tom and Jerry Kids\", co-produced by Turner Entertainment Co. and Hanna-Barbera Productions (which would be sold to Turner in 1991) debuted on Fox Kids and for a few years, aired on British children's block, CBBC.", "It featured a youthful version of the famous cat-and-mouse duo chasing each other.", "As with the 1975 H-B series, Jerry wears his red bowtie, while Tom now wears a red cap.", "Spike and his son Tyke (who now had talking dialogue) and Droopy and his son Dripple, appeared in back-up segments for the show, which ran until November 18, 1994.", "\"Tom and Jerry Kids\" was the last Tom and Jerry cartoon series produced in 4:3 (full screen) aspect ratio." ], [ "Joseph Barbera", "In 1996, Turner merged with Time Warner, owners of Warner Bros., who would eventually absorb Hanna-Barbera into Warner Bros. Animation.", "Barbera and Hanna continued to advise their former company and periodically worked on new Hanna-Barbera shows, including shorts for the series \"The Cartoon Cartoon Show\" and feature film versions of \"The Flintstones\" (1994) and \"Scooby-Doo\" (2002).", "In a new \"Tom and Jerry\" cartoon produced in 2000, \"The Mansion Cat\", Barbera voiced the houseowner.", "After Hanna's death from throat cancer in March 2001, Hanna-Barbera was absorbed into Warner Bros. Animation, with the unit dedicated to the Cartoon Network original series spun off into Cartoon Network Studios.", "Barbera remained active as an executive producer for Warner Bros. on direct-to-video cartoon features as well as television series such as \"What's New, Scooby-Doo?\" and \"Tom and Jerry Tales\".", "He also wrote, co-storyboarded, co-directed and co-produced \"The Karate Guard\" (2005), the return of \"Tom and Jerry\" to the big screen.", "His final animated project was the direct-to-video feature \"\" (2007)." ] ], "gold": "In the show Tom and Jerry, Tom's owner is presumed to be Mammy Two Shoes, whose appearances in the show have often been edited out as her character is regarded as a racist archetype. The television property Tom and Jerry is owned by Warner Bros. following Time Warner's 1996 merger with previous Tom and Jerry owners Turner Entertainment.", "prediction 1": "Tom and Jerry was a commonplace phrase for youngsters indulging in riotous behaviour in 19th-century London. The name comes from \"Life in London, or Days and Nights of Jerry Hawthorne and his elegant friend Corinthian Tom\" (1823) by Pierce Egan. William Hanna and Joseph Barbera were both part of the Rudolf Ising unit at the MGM cartoon studio in the late 1930s. The owner of the cartoon was voiced by character actress Lillian Randolph.", "prediction 2": "Tom and Jerry was a commonplace phrase for youngsters indulging in riotous behaviour in 19th-century London. The cartoon series is owned by Turner Entertainment Co. and its property rights now rest with Warner Bros. Television. In a new Tom and Jerry cartoon produced in 2000, the houseowner is voiced by Joseph Barbera.", "prediction 3": "Mammy Two Shoes is a heavy-set middle-aged mammy who often has to deal with the mayhem generated by the lead characters. Voiced by character actress Lillian Randolph, she is often seen as the owner of Tom. In later cartoon series, Mammy's appearances have often been edited out, dubbed, or re-animated as a slim white woman in later television showings, since her character is a mammy archetype now often regarded as racist.", "prediction 4": "Mammy Two Shoes is a heavy-set middle-aged mammy who often has to deal with the mayhem generated by the lead characters. Voiced by character actress Lillian Randolph, she is often seen as the owner of Tom. In later years, Tom and Jerry have appeared on Turner-run stations, such as TBS, TNT, Cartoon Network, The WB, Boomerang, and Turner Classic Movies. In 1996, Turner merged with Time Warner, owners of Warner Bros., who would eventually absorb Hanna-Barbera Productions into Warner Bros. After Hanna's death from throat cancer in March 2001, Hanna was absorbed into Warner Bros. Animation, with the unit dedicated to the Cartoon Network Original series., Cartoon Network, and Cartoon Network Studios.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 364, "end": 438 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the show Tom and Jerry, Mammy Two Shoes is seen as the owner of Tom. Her appearance in the show has often been edited out as her character is regarded as a racist archetype. Tom and Jerry, the show, is owned by Warner Bros, following Time Warner's 1996 merger with the previous owners, Turner Entertainment." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did denzel washington win his first oscar?", "passages": [ [ "Denzel Washington on screen and stage", "Denzel Washington on screen and stage\n\nDenzel Washington is an American actor who made his feature film debut in \"Carbon Copy\" (1981).", "In 1982, Washington made his first appearance in the medical drama \"St. Elsewhere\" as Dr. Philip Chandler.", "The role proved to be the breakthrough in his career.", "He starred as Private First Class Melvin Peterson in the drama \"A Soldier's Story\" (1984).", "The film was an adaptation of the Off-Broadway play \"A Soldier's Play\" (1981\u20131983) in which Washington had earlier portrayed the same character.", "In 1987, he played Steve Biko, an anti-apartheid activist in the Richard Attenborough-directed drama \"Cry Freedom\", for which he received his first nomination for the Academy Award for Best Supporting Actor.", "Two years later, Washington won the award for playing Trip, a former slave-turned-soldier in Civil War film \"Glory\" (1989).", "In 1990, he played the title character in the play \"The Tragedy of Richard III\", and starred in Spike Lee's comedy-drama \"Mo' Better Blues\".", "Washington received the Silver Bear for Best Actor at the Berlin International Film Festival, for playing the eponymous civil rights activist in Lee's \"Malcolm X\" (1992)." ] ], "gold": "Denzel Washington won his first Oscar at the 62nd Academy Awards in 1990. He won in the Best Supporting Actor category for his role as Private Silas Trip in the 1989 Civil War drama Glory.", "prediction 1": "Denzel Washington is an American actor who made his feature film debut in Carbon Copy in 1981. In 1982, Washington made his first appearance in the medical drama St. Elsewhere as Dr. Philip Chandler. The role proved to be the breakthrough in his career. In 1984, Washington starred as Private First Class Melvin Peterson in the drama A Soldier's Story.", "prediction 2": "Denzel Washington is an American actor whose feature film debut was in Carbon Copy (1981). In 1982, Washington made his first appearance in the medical drama St. Elsewhere as Dr. Philip Chandler. The role proved to be the breakthrough in his career. In 1987, he played Steve Biko, an anti-apartheid activist in the Richard Attenborough-directed drama Cry Freedom, for which he received his first nomination for the Academy Award for Best Supporting Actor. Two years later, Washington won the award for playing Trip, a former slave-turned-turned-sold soldier in Civil War film Glory (1989).", "prediction 3": "Denzel Washington is an American actor whose feature film debut was in Carbon Copy (1981). In 1982, Washington made his first appearance in the medical drama St. Elsewhere as Dr. Philip Chandler. The role proved to be the breakthrough in his career. He starred as Private First Class Melvin Peterson in the drama A Soldier's Story (1984), for which he received his first nomination for the Academy Award for Best Supporting Actor. Two years later, Washington won the award for playing Trip, a former slave-turned-soldolde in Civil War film Glory (1989).", "prediction 4": "Denzel Washington is an American actor who made his feature film debut in Carbon Copy in 1981. In 1982, Washington made his first appearance in the medical drama St. Elsewhere as Dr. Philip Chandler. The role proved to be the breakthrough in his career. In 1987, he played Steve Biko, an anti-apartheid activist in the Richard Attenborough-directed drama Cry Freedom, for which he received his first nomination for the Academy Award for Best Supporting Actor. Two years later, Washington won the award for playing Trip, a former slave-turned-sold soldier in Civil War film Glory (1989).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 352 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When does the new season of property brothers start?", "passages": [ [ "Property Brothers", "Property Brothers\n\nProperty Brothers is a Canadian reality television series produced by Cineflix, and is the original show in the \"Property Brothers\" franchise.", "The series features identical twin brothers Drew and Jonathan Scott.", "Drew is a real estate expert who scouts neglected houses and negotiates their purchases.", "His brother, Jonathan, is a licensed contractor who then renovates the houses.", "Together, the Property Brothers help families find, buy, and transform fixer-uppers into dream homes on a strict timeline and budget.", "The show has aired in over 150 countries, including on the W Network in Canada and on HGTV in the United States.", "In January 2016, Cineflix renewed the show for 52 more episodes.", "Drew was offered a gig as a host of a real estate competition show that ultimately didn't materialize.", "Cineflix, however, wanted Drew for a show tentatively called \"My Dream Home\", with the intention of finding a female co-host.", "When they learned he had a brother who was also in real estate, the production company asked the brothers to make a sizzle reel.", "Jonathan and Drew submitted a video of themselves making over their older brother's living room.", "Six months went by before Cineflix responded favorably, and a week later they began filming a pilot for the show in Toronto." ], [ "Property Brothers", "The show has been nominated for a Cablefax Award and for Outstanding Structured Reality Program at the 2015 Emmy Awards.", "At the 2018 Canadian Screen Awards, the program won for Best Lifestyle Program or Series.", "The program has influenced popular culture, and has been the subject of multiple jokes on \"Brooklyn 99\", \"Unbreakable Kimmy Schmidt\", \"The Late Show with Stephen Colbert\", and \"Saturday Night Live\".", "For its duration, \"Property Brothers\" has been produced by Cineflix.", "HGTV (a property of Discovery Inc.) has since joined the program as a distributor, however, and has broadcast the show's episodes on a separate schedule.", "The dates in the chart below correspond to the episodes' earliest broadcast date.", "In January 2016, Cineflix renewed the show for 52 more episodes.", "On November 9, 2015, the brothers hosted an hour-long special, \"The Property Brothers: 100 Episodes & Counting\", ahead of its 100th episode.", "The special highlighted their favourite moments from the preceding 99 episodes, and was accompanied by the release of the Property Brothers Handbook, an mobile app that includes design tips, multimedia from the show, and \"inspirational photos\"." ], [ "Who Wants to Be a Millionaire (U.S. game show)", "While Philbin briefly considered a return to the show, Cedric the Entertainer was introduced as her successor when season twelve premiered on September 2, 2013.", "On April 30, 2014, \"Deadline\" announced that Cedric had decided to leave the show in order to lighten his workload, resulting in him being succeeded by Terry Crews for the 2014\u201315 season.", "Crews was succeeded by Chris Harrison, host of \"The Bachelor\" and its spin-offs, when season 14 premiered on September 14, 2015.", "The original executive producers of the U.S. \"Millionaire\" were British television producers Michael Davies and Paul Smith, the latter of whom undertook the responsibility of licensing \"Millionaire\" to American airwaves as part of his effort to transform the UK program into a global franchise.", "Smith served until 2007 and Davies until 2010; additionally, Leigh Hampton (previously co-executive producer in the later days of the network version and in the syndicated version's first two seasons) served as an executive producer from 2004 to 2010.", "Rich Sirop, who was previously a supervising producer, became the executive producer in 2010 and held that position until 2014, when he left \"Millionaire\" to hold the same position with Vieira's newly launched syndicated talk show, and was replaced by James Rowley." ] ], "gold": "The home purchase and renovation reality series Property Brothers is broadcast on two different schedules by HGTV and original producer Cineflix. By the Cineflix schedule, the 4th season of Property Brothers premiered on January 12, 2014, the 5th season on September 14, 2015, and the 6th season on October 24, 2016. The 6th Cineflix season is the 10th season by the HGTV schedule, preceded by the 9th HGTV season premiering on February 17, 2016 and followed by the 11th HGTV season on April 17, 2017.", "prediction 1": "Property Brothers is a Canadian reality television series produced by Cineflix and is the original show in the Property Brothers franchise. The show features identical twin brothers Drew and Jonathan Scott, who help families find, buy, and transform fixer-uppers into dream homes on a strict timeline and budget. Season 13 started on September 29, 2016 and season 14 started on September 14, 2015.", "prediction 2": "Property Brothers is a Canadian reality television series produced by Cineflix, and is the original show in the Property Brothers franchise. The series features identical twin brothers Drew and Jonathan Scott, who are real estate experts who scout neglected houses and negotiate their purchases. Jonathan, who is a licensed contractor who then renovates the houses, is a licensed contractor. Together, the Property Brothers help families find, buy, and transform fixer-uppers into dream homes on a strict timeline and budget. The pilot for the new season started on November 9, 2015, and the pilot was broadcast the next day after the pilot had begun filming the pilot. The pilot episode's earliest broadcast date was October 12, 2014.", "prediction 3": "Property Brothers is a Canadian reality television series produced by Cineflix, and is the original show in the Property Brothers franchise. The show features identical twin brothers Drew and Jonathan Scott, who are real estate experts who scout neglected houses and negotiate their purchases. Jonathan is a licensed contractor who then renovates the houses. Drew is also a real estate expert who scouts neglected houses and negotiates their purchases. The show has aired in over 150 countries, including on the W Network in Canada and on HGTV in the United States. The new season starts on September 2, 2019.", "prediction 4": "Property Brothers is a Canadian reality television series produced by Cineflix. In January 2016, Cineflix renewed the show for 52 more episodes. In 2018, the new season of Property Brothers started airing on September 14, 2018 and the new season of Property Brothers started airing on September 6, 2019. Since 2016, the new season of Property Brothers has started airing on September 10, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 280, "end": 312 }, { "error type": "Unverifiable", "explanation": "", "start": 313, "end": 322 }, { "error type": "Unverifiable", "explanation": "", "start": 357, "end": 366 } ], "missing-info": [], "corrected-prediction": "Property Brothers is a Canadian reality television series produced by Cineflix and is about finding, buying, and transforming fixer-uppers into dream homes." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "A society's shared sense of identity and world view is known as?", "passages": [ [ "Social capital", "Social capital\n\nSocial capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity.", "However, the many views of this complex subject make a single definition difficult.", "The term generally refers to (a) resources, and the value of these resources, both tangible (public spaces, private property) and intangible (\"actors\", \"human capital\", people), (b) the relationships among these resources, and (c) the impact that these relationships have on the resources involved in each relationship, and on larger groups.", "It is generally seen as a form of capital that produces public goods for a common good.", "Social capital has been used to explain the improved performance of diverse groups, the growth of entrepreneurial firms, superior managerial performance, enhanced supply chain relations, the value derived from strategic alliances, and the evolution of communities.", "During the 1990s and 2000s, the concept has become increasingly popular in a wide range of social science disciplines and also in politics.", "The term \"social capital\" was in intermittent use from about 1890, before becoming widely used in the late 1990s.", "In the first half of the 19th century, Alexis de Tocqueville had observations about American life that seemed to outline and define social capital." ], [ "Positive psychological capital", "EK is a crucial capital as it impacts people's learning processes, especially for children and young people at risk, enables their balanced human development, which participates to better social cohesion, smoother human relationships, their future successful life in the society and already to their school retention and success.", "Emotional capital has specific characteristics related to emotional competencies.", "Emotional capital is a crucial capital: more than an additional capital, it is also a booster capital.", "If social, cultural and, human capitals are often complementary (Coleman,1993), emotional capital has a particular place among them.", "It is first a catalyser as it is essential for the constitution of the human capital.", "Indeed, human capital constitution might never happen if basic or appropriate emotional capital is not there.", "Only ad hoc emotional capital will allow human capital formation.", "Also, emotional capital is a potentionalizing \u2013 boostering- capital more than a simple additional capital as it is essential for utilizing effectively the social capital and the Becker Human capital (the way it has been restrictedly measured as general knowledge and technical skills).", "EK is a crucial capital as it impacts people's learning processes, especially for children and young people at risk, enables balanced human development, which participates in social cohesion, smoother human relationships, future successful life in the society and already to their school retention and success and as well as at work." ], [ "Historical materialism", "Human beings collectively work on nature but do not do the same work; there is a division of labour in which people not only do different jobs, but some people live off the fruits of others' labour by owning the means of production.", "How production is accomplished depends on the character of society's productive forces, which refers to the means of production such as the tools, instruments, technology, land, raw materials, and human knowledge and abilities in terms of using these means of production.", "The relations of production are determined by the level and character of these productive forces present at any given time in history.", "Marx identified society's relations of production (arising on the basis of given productive forces) as the economic base of society.", "He also explained that on the foundation of the economic base there arise certain political institutions, laws, customs, culture, etc., and ideas, ways of thinking, morality, etc.", "These constitute the political/ideological \"superstructure\" of society.", "This superstructure not only has its origin in the economic base, but its features also ultimately correspond to the character and development of that economic base, i.e. the way people organize society, its relations of production, and its mode of production.", "G.A. Cohen argues in \"\" that a society\u2019s superstructure stabilizes or entrenches its economic structure, but that the economic base is primary and the superstructure secondary." ] ], "gold": "Social capital, superstructure and collective consciousness are three terms that can be used to describe a society's shared sense of identity and worldview. Social capital can be defined as the networks of relationships among people who live and work in a particular society, enabling that society to function effectively. The term social capital was in intermittent use from about 1890, before becoming widely used in the late 1990s as a term describing a society's shared sense of identity and world view. The Marxist term for a society's shared sense of identity and world view is superstructure. In Marxist theory, the superstructure determines a society's other relationships and ideas to comprise its superstructure, including its culture, institutions, political power structures, roles, rituals and state. A third term, collective consciousness, can be defined as the set of shared beliefs, ideas and moral attitudes which operate as a unifying force within society. In general, collective consciousness does not refer to the specifically moral conscience but to a shared understanding of social norms.", "prediction 1": "Social capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity. However, the many views of this complex subject make a single definition difficult. The term generally refers to (a) resources, and the value of these resources, both tangible and intangible, as well as (b) the relationships among these resources, and (c) the impact that these relationships have on the resources involved in each relationship with each relationship, and on the people. Emotional capital has specific characteristics related to emotional competencies.", "prediction 2": "Social capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity. Emotional capital has specific characteristics related to emotional competencies.", "prediction 3": "Social capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity. However, the many views of this complex subject make a single definition difficult. Marx identified society's relations of production (arising on the basis of given productive forces) as the economic base of society. G.A. Cohen argues in \"\" that a society's political/ideological superstructure stabilizes or entrenches its economic base.", "prediction 4": "Social capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity. However, the many views of this complex subject make a single definition difficult. Marx identified society's relations of production as the economic base of society. In a second definition, a society's shared sense of identity is known as shared sense of world view.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 649 }, { "error type": "Irrelevant", "explanation": "", "start": 650, "end": 731 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Social capital broadly refers to those factors of effectively functioning social groups that include such things as interpersonal relationships, a shared sense of identity, a shared understanding, shared norms, shared values, trust, cooperation, and reciprocity. The term \"social capital\" was in intermittent use from about 1890, before becoming widely used in the late 1990s. The Marxist term for a society's shared sense of identity and worldview is superstructure. He also explained that on the foundation of the economic base there arise certain political institutions, laws, customs, culture, etc., and ideas, ways of thinking, morality, etc." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When is love bug mating season in florida'?", "passages": [ [ "Lovebug", "The slow, drifting movement of the insects has been described as almost reminiscent of snow fall except that, unlike snow, the flies also rise into the air.", "Two major flights occur each year, first in late spring, then in late summer.", "In south Florida, a third (but smaller) flight can occur in December.", "The spring flight occurs during late April and May, and in the summer during late August and September.", "Flights extend over periods of four to five weeks.", "Mating takes place almost immediately after emergence of the females.", "Adult females live only three to four days, while males live a little longer.", "They have to stick to each other at all times.", "This species' reputation as a public nuisance is due not to any bite or sting (it is incapable of either), but to its slightly acidic body chemistry.", "Because airborne lovebugs can exist in enormous numbers near highways, they die in large numbers on automobile windshields, hoods, and radiator grills when the vehicles travel at high speeds.", "If left for more than an hour or two, the remains become extremely difficult to remove.", "Their body chemistry has a nearly neutral 6.5 pH but may become acidic at 4.25 pH if left on the car for a day." ], [ "Lovebug", "Lovebug\n\nThe lovebug (\"Plecia nearctica\") is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast.", "It is also known as the honeymoon fly or double-headed bug.", "During and after mating, adult pairs remain coupled, even in flight, for up to several days.", "The species was first described in 1940 by D. E. Hardy, but was seen in Louisiana as early as 1911.", "At that time, he reported the incidence of lovebugs to be widespread, but most common in Texas, Florida, Alabama, Mississippi, and Louisiana.", "However, by the end of the 20th century the species had spread heavily to all areas bordering the Gulf of Mexico, as well as Georgia and South Carolina.", "L. A. Hetrick, writing in 1970, found the bug was also widespread in central and northern Florida and described its flights as reaching altitudes of and extending several kilometers over the Gulf.", "Lovebugs' larvae feed on partially decayed vegetation in the landscape and, in this respect, are beneficial to humans.", "Adults primarily feed on nectar from various plants, particularly sweet clover, goldenrod, and Brazilian pepper.", "Localized lovebug flights can number in the hundreds of thousands." ] ], "gold": "The lovebug is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. It is also known as the honeymoon fly or double-headed bug. During and after mating, matured pairs remain together, even in flight, for up to several days. Localized lovebug flights can number in the millions. Two major flights occur each year. The spring flight occurs during late April and May, and the summer flight occurs during late August and September. In south Florida, a third (but smaller) flight can occur in December.", "prediction 1": "The lovebug (\"Plecia nearctica\") is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. Mating takes place almost immediately after emergence of the females. Mating takes place during the spring during late April and May, and in the summer during late August and September.", "prediction 2": "The lovebug is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. Mating takes place almost immediately after emergence of the females. Flights extend over periods of four to five weeks. Mating season in Florida is from late spring to late summer.", "prediction 3": "The lovebug is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. Mating takes place almost immediately after emergence of the females. The spring flight occurs during late April and May, and in the summer during late August and September. Flights extend over periods of four to five weeks.", "prediction 4": "The lovebug is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. The spring flight occurs during late April and May, and in the summer during late August and September. Mating takes place almost immediately after emergence of the females. During and after mating, adult pairs remain coupled, even in flight, for up to several days.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The lovebug (\"Plecia nearctica\") is a species of march fly found in parts of Central America and the southeastern United States, especially along the Gulf Coast. It is also known as the honeymoon fly or double-headed bug. During and after mating, adult pairs remain coupled, even in flight, for up to several days. Localized lovebug flights can number in the hundreds of thousands. Mating takes place almost immediately after emergence of the females. Two major flights occur each year, first in late spring, then in late summer. The spring flight occurs during late April and May, and in the summer during late August and September. In south Florida, a third (but smaller) flight can occur in December. Mating takes place almost immediately after emergence of the females. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many games are the cubs ahead of the cardinals?", "passages": [ [ "Chicago Cubs", "Chicago Cubs\n\nThe Chicago Cubs are an American professional baseball team based in Chicago, Illinois.", "The Cubs compete in Major League Baseball (MLB) as a member club of the National League (NL) Central division.", "The team plays its home games at Wrigley Field, located on the city's North Side.", "The Cubs are one of two major league teams in Chicago; the other, the Chicago White Sox, is a member of the American League (AL) Central division.", "The Cubs, first known as the White Stockings, were a founding member of the NL in 1876, becoming the Chicago Cubs in 1903.", "The Cubs have appeared in a total of eleven World Series.", "The 1906 Cubs won 116 games, finishing 116\u201336 and posting a modern-era record winning percentage of , before losing the World Series to the Chicago White Sox (\"The Hitless Wonders\") by four games to two.", "The Cubs won back-to-back World Series championships in 1907 and 1908, becoming the first major league team to play in three consecutive World Series, and the first to win it twice.", "Most recently, the Cubs won the 2016 National League Championship Series and 2016 World Series, which ended a 71-year National League pennant drought and a 108-year World Series championship drought, both of which are record droughts in Major League Baseball." ], [ "St. Louis Cardinals", "St. Louis Cardinals\n\nThe St. Louis Cardinals are an American professional baseball team based in St. Louis, Missouri.", "The Cardinals compete in Major League Baseball (MLB) as a member club of the National League (NL) Central division.", "Busch Stadium has been their home ballpark since 2006.", "One of the most successful franchises in baseball history, the Cardinals have won 11 World Series championships, the second-most in Major League Baseball (behind the New York Yankees) and the most in the National League.", "Their 19 National League pennants rank third in NL history.", "In addition, St. Louis has won 13 division titles in the East and Central divisions.", "While still in the old American Association (AA), named then as the St. Louis Browns, the team won four AA league championships, qualifying them to play in the professional baseball championship tournament (a forerunner of the modern World Series, established 1903) of that era.", "They tied in 1885 and won outright in 1886 and lost in 1888 for the early trophy Hall Cup versus the New York Giants.", "The others both times against the Chicago Cubs (originally the Chicago White Stockings then), in the first meetings of the Cardinals\u2013Cubs rivalry between nearby cities of St. Louis and Chicago that continues to this day." ], [ "History of the Chicago Cubs", "The two stadiums are roughly equidistant for Cubs fans living in north-suburban Chicago; hence, fans in this region take advantage of Miller Park's larger seating and parking capacity, more modern amenities, and the certainty that the game will not be weather-delayed (due to Miller Park's roof) to attend Cubs games in Milwaukee in large numbers, enhancing the rivalry's intensity.", "Due to the close proximity of the ball park, many Cub fans make the drive to Miller Park which coined the nickname \"Wrigley North\".", "The Cardinals\u2013Cubs rivalry refers to games between the St. Louis Cardinals and the Cubs.", "The Cubs lead the series 1,137\u20131,106 through , while the Cardinals lead in National League pennants with 19 against the Cubs' 17.", "The Cubs have won 11 of those pennants in Major League Baseball's Modern Era (1901\u2013present), while all 19 of the Cardinals' have been won since 1901.", "The Cardinals also have a clear edge when it comes to World Series successes, having won 11 championships to the Cubs' 3.", "The Cardinals have enjoyed an overwhelming advantage over their Chicago rivals in the regular season standings.", "In the 70 seasons from 1946 through 2016, the Cardinals have finished ahead of the Cubs 53 times." ] ], "gold": "The Chicago Cubs are an American professional baseball team based in Chicago. Most recently, the Cubs won the 2016 National League Championship Series and 2016 World Series. The St. Louis Cardinals are an American professional baseball team based in St. Louis. One of the nation's oldest and most successful professional baseball clubs, the Cardinals have won 11 World Series championships, more than any NL team and second in MLB only to the New York Yankees. In the 2015 standings, the Cubs were 0 games ahead of the Cardinals. In the 2016 standings, the Cubs were 17 1/2 games ahead of the Cardinals. In the 2017 standings, the Cubs were 9 games ahead of the Cardinals.", "prediction 1": "The Chicago Cubs are an American professional baseball team based in Chicago. The St. Louis Cardinals are an American professional baseball team based in St. Louis, Missouri. The Cubs have appeared in a total of eleven World Series. In the 70 seasons from 1946 through 2016, the Cardinals have finished ahead of the Cubs 53 times.", "prediction 2": "The Chicago Cubs have finished ahead of their Chicago rivals 53 times. The St. Louis Cardinals have finished ahead of the Chicago Cubs 53 times.", "prediction 3": "The Chicago Cubs are an American professional baseball team based in Chicago. The St. Louis Cardinals are an American professional baseball team based in St. Louis, Missouri. The Cubs lead the series 1,137\u20131,106 through, while the Cardinals lead in National League pennants with 19 against the Cubs' 17. The Cardinals have enjoyed an overwhelming advantage over their Chicago rivals in the regular season standings. In the 70 seasons from 1946 through 2016, the Cardinals have finished ahead of the Cubs 53 times.", "prediction 4": "The Chicago Cubs are an American professional baseball team based in Chicago. The Cardinals are an American professional baseball team based in St. Louis. The Cubs compete in MLB as a member club of the National League Central division. In the 70 seasons from 1946 through 2016, the Cardinals have finished ahead of the Cubs 53 times.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Chicago Cubs are an American professional baseball team based in Chicago. Most recently, the Cubs won the 2016 National League Championship Series and 2016 World Series. The St. Louis Cardinals are an American professional baseball team based in St. Louis, Missouri. One of the most successful franchises in baseball history, the Cardinals have won 11 World Series championships, the second-most in Major League Baseball (behind the New York Yankees) and the most in the National League. In the 70 seasons from 1946 through 2016, the Cardinals have finished ahead of the Cubs 53 times." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who sings on paradise by the dashboard light?", "passages": [ [ "Paradise by the Dashboard Light", "Paradise by the Dashboard Light\n\n\"Paradise by the Dashboard Light\" is a song written by Jim Steinman.", "It was first released in 1977 on the album \"Bat Out of Hell\", with vocals by the American musician Meat Loaf alongside Ellen Foley.", "The song is most notable for its unique structure and length, and has become a staple of classic rock radio.", "Entitled \"Let Me Sleep on It,\" the song was also recorded by Brotherhood of Man.", "\"Paradise by the Dashboard Light\" is one of the longest songs to be released uncut on one side of a 45 RPM record.", "The only difference between the single (45 RPM) and album versions is that the single version fades out almost immediately after the final line is sung.", "In some countries, a shorter 5:32 edit was released.", "The largest change is the complete removal of the \"baseball play-by-play\" section.", "Jim Steinman had stated that he wanted to write \"the ultimate car/sex song in which everything goes horribly wrong in the end.\"", "According to Meat Loaf on \"VH1 Storytellers\", the original length of the track was to be 27 minutes.", "The song is divided into three parts:\n\nThe song opens with the characters reminiscing about days as a young high school couple on a date." ] ], "gold": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman. It was released in 1977 on the album Bat Out of Hell, with vocals by the American musician Meat Loaf alongside Ellen Foley. The song is notable for its unique structure and length, and became a staple of classic rock radio.", "prediction 1": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman. It was first released in 1977 on the album \"Bat Out of Hell\", with vocals by the American musician Meat Loaf alongside Ellen Foley. The song is most notable for its unique structure and length, and has become a staple of classic rock radio.\n", "prediction 2": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman that was originally recorded in 1977. It was first released in 1977 on the album Bat Out of Hell, with vocals by Meat Loaf alongside Ellen Foley.", "prediction 3": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman. The song was first released in 1977 on the album \"Bat Out of Hell\", with vocals by the American musician Meat Loaf alongside Ellen Foley. The song is most notable for its unique structure and length, and has become a staple of classic rock radio. Entitled \"Let Me Sleep on It,\" the song was also recorded by Brotherhood of Man.", "prediction 4": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman. It was first released in 1977 on the album \"Bat Out of Hell\", with vocals by the American musician Meat Loaf alongside Ellen Foley. The song is most notable for its unique structure and length, and has become a staple of classic rock radio. Entitled \"Let Me Sleep on It,\" the song was also recorded by Brotherhood of Man.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 217 } ], "missing-info": [], "corrected-prediction": "\"Paradise by the Dashboard Light\" is a song written by Jim Steinman. It was released in 1977 on the album \"Bat Out of Hell\", with vocals by the American musician Meat Loaf alongside Ellen Foley. The song is notable for its unique structure and length, and has become a staple of classic rock radio.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the smoking ban come into effect?", "passages": [ [ "Cigarette receptacle", "Cigarette receptacle\n\nA cigarette receptacle is a container or device for extinguishing and disposal of cigarette waste.", "Other common names for cigarette receptacle include: ash urn, ash pan, cigarette butt receptacles, butt bins, butt holders, snuffers, smokers poles, cigarette waste receptacles, smokers waste receptacles, and ash/trash combination.", "Originally provided as a courtesy to smokers in public places, cigarette receptacles are now commonplace as smoking bans and designated smoking areas require proper disposal methods.", "A typical receptacle can hold hundreds - even thousands - of disposed cigarette butts.", "While the United States congress has not attempted to pass a nationwide smoking ban, many states and local governments have enacted their own statutes addressing smoking in public places.", "Proper disposal of cigarette butts is promoted as both an environmental and health issue.", "It is estimated 4.5 trillion cigarette butts become litter every year.", "While cigarette smoking in the United States has decreased, cigarette butt litter remains the most littered item in the United States and globally.", "The overall littering rate for cigarette butts is 65%, and in all, tobacco products make up 38% of all roadway litter in the United States." ], [ "Smoking ban", "The resort town of Aspen, Colorado, became the first city in the US to restrict smoking in restaurants, in 1985, though it allowed smoking in areas that were separately ventilated.", "On 3 April 1987, the City of Beverly Hills, California, initiated an ordinance to restrict smoking in most restaurants, in retail stores and at public meetings.", "It exempted restaurants in hotels \u2013 City Council members reasoned that hotel restaurants catered to large numbers of visitors from abroad, where smoking is more acceptable than in the United States.", "In 1990, the city of San Luis Obispo, California, became the first city in the world to restrict indoor smoking in bars as well as restaurants.", "However, the ban did not include workplaces but covered all other indoor public spaces and its enforcement was somewhat limited.", "In America, California's 1998 smoking ban encouraged other states such as New York to implement similar regulations.", "California's ban included a controversial restriction upon smoking in bars, extending the statewide ban enacted in 1994.", "As of April 2009 there were 37 states with some form of smoking ban.", "Some areas in California began banning smoking across whole cities, including every place except residential homes.", "More than 20 cities in California enacted park and beach smoking restrictions." ], [ "Classes of United States Senators", "Class 2 consists of:\nStates with a class 2 senator: Alabama, Alaska, Arkansas, Colorado, Delaware, Georgia, Idaho, Illinois, Iowa, Kansas, Kentucky, Louisiana, Maine, Massachusetts, Michigan, Minnesota, Mississippi, Montana, Nebraska, New Hampshire, New Jersey, New Mexico, North Carolina, Oklahoma, Oregon, Rhode Island, South Carolina, South Dakota, Tennessee, Texas, Virginia, West Virginia, and Wyoming.", "Class 3 consists of:\nStates with a class 3 senator: Alabama, Alaska, Arizona, Arkansas, California, Colorado, Connecticut, Florida, Georgia, Hawaii, Idaho, Illinois, Indiana, Iowa, Kansas, Kentucky, Louisiana, Maryland, Missouri, Nevada, New Hampshire, New York, North Carolina, North Dakota, Ohio, Oklahoma, Oregon, Pennsylvania, South Carolina, South Dakota, Utah, Vermont, Washington, and Wisconsin.", "The following table lists the senators by party by class.", "The following table lists the senators by state and by class, including the states' Cook Partisan Voting Index ratings, which indicate the party direction in which a state tends to lean and the extent of that lean." ] ], "gold": "The United States Congress has not attempted to enact any type of nationwide federal smoking ban in workplaces and public places. In 1995, California was the first state to enact a statewide smoking ban for restaurants. On August 9, 1997, President Bill Clinton issued Executive Order 13058, banning smoking in all interior spaces owned, rented, or leased by the Executive Branch of the Federal Government, as well as in any outdoor areas under executive branch control near air intake ducts. Throughout the early to mid-2000s, especially between 2004 and 2007, an increasing number of states enacted a statewide smoking ban of some kind. As of July, 2018, 26 states have enacted statewide bans on smoking in all enclosed workplaces, including all bars and restaurants.", "prediction 1": "In the United States, smoking bans have been in place since the 1950s, beginning in 1913. The first nationwide bans came into effect in 1992 and 1998. In California, the bans came into effect in 1998 and 1999, and in Utah, the bans came into effect in 2000.", "prediction 2": "The federal smoking ban came into effect on 1 January 1970. The state smoking ban came into effect on 1 January 1978. The federal smoking ban came into effect on 1 January 1978.", "prediction 3": "The bans on smoking in restaurants, bars, and public meetings in the United States came into effect on 1 January 1994. Then, on 3 April 1987, the City of Beverly Hills, California, initiated an ordinance to restrict smoking in most restaurants, in retail stores and at public meetings. Then, on 3 April 1990, the city of San Luis Obispo, California, became the first city in the world to restrict indoor smoking in bars as well as restaurants.", "prediction 4": "On 3 April 1987, the City of Beverly Hills, California, initiated an ordinance to restrict smoking in most restaurants, in retail stores and at public meetings. On 3 April 1988, the city of Aspen, Colorado, became the first city in the US to restrict indoor smoking in restaurants. On 3 April 1990, the city of San Luis Obispo, California, became the first city in the world to restrict indoor smoking in bars as well as restaurants. However, the ban did not include workplaces but covered all other indoor public spaces and its enforcement was somewhat limited. In America, California's 1998 smoking ban encouraged other states to implement similar regulations. As of April 2009 there were 37 states with some form of smoking ban.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 22, "end": 89 }, { "error type": "Unverifiable", "explanation": "", "start": 90, "end": 150 }, { "error type": "Unverifiable", "explanation": "", "start": 200, "end": 209 }, { "error type": "Unverifiable", "explanation": "", "start": 210, "end": 257 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the United States, while the United States congress has not attempted to pass a nationwide smoking ban, as of April 2009 there were 37 states with some form of smoking ban. The first city in the US to restrict smoking in restaurants did so in 1985. In California the 1998 ban included a restriction upon smoking in bars, extending the statewide ban enacted in 1994." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When did the first call of duty come out?", "passages": [ [ "Call of Duty (video game)", "Call of Duty (video game)\n\nCall of Duty is a first-person shooter video game developed by Infinity Ward and published by Activision.", "It is the first installment in the \"Call of Duty\" franchise, released on October 29, 2003, for Microsoft Windows.", "The game simulates infantry and combined arms warfare of World War II using a modified version of the id Tech 3 engine.", "Much of its theme and gameplay is similar to the \"Medal of Honor\" series; however, \"Call of Duty\" showcases multiple viewpoints staged in the British, American, and Soviet theaters of World War II.", "The game introduced a new take on AI-controlled allies who support the player during missions and react to situational changes during gameplay.", "This led to a greater emphasis on squad-based play as opposed to the \"lone wolf\" approach often portrayed in earlier first-person shooter games.", "Much of Infinity Ward's development team consisted of members who helped develop \"\".", "In September 2004, an expansion pack called \"\", which was produced by Activision and developed by Gray Matter Interactive and Pi Studios, was released." ], [ "Blizzard Entertainment", "\"World of Warcraft\" is the fourth released game set in the fantasy \"Warcraft\" universe, which was first introduced by \"\" in 1994.", "Blizzard announced \"World of Warcraft\" on September 2, 2001.", "The game was released on November 23, 2004, on the 10th anniversary of the \"Warcraft\" franchise.", "Having peaked at 12 million monthly subscriptions in 2010, \"World of Warcraft\" subscriptions sunk to 6.8 million in 2014, the lowest number since the end of 2006, prior to \"\" expansion.", "However, \"World of Warcraft\" is still the world's most-subscribed MMORPG, and holds the Guinness World Record for the most popular MMORPG by subscribers.", "In April 2008, \"World of Warcraft\" was estimated to hold 62 percent of the MMORPG subscription market.", "In 2008, Blizzard was honored at the 59th Annual Technology & Engineering Emmy Awards for the creation of \"World of Warcraft\".", "Mike Morhaime accepted the award.", "In 2012 Blizzard had 4,700 employees, with offices across 11 cities including Austin, Texas, and countries around the globe.", ", the company's headquarters in Irvine, California had 2,622 employees." ] ], "gold": "Call of Duty is a first-person shooter video game franchise published by Activision. The first Call of Duty came out in Microsoft Windows NA on October 29, 2003 and in Microsoft Windows EU on November 7, 2003. It came out for Mac OS X in May 2004. It came out for N-Gage EU on November 10, 2004, and N-Gage NA on November 23, 2004.", "prediction 1": "Call of Duty is a first-person shooter video game developed by Infinity Ward and published by Activision. It is the first installment in the \"Call of Duty\" franchise, released on October 29, 2003, for Microsoft Windows. In September 2004, an expansion pack called \"\" produced by Activision and developed by Gray Matter Interactive and Pi Studios, was released. \"World of Warcraft\" is the fourth released game set in the fantasy \"Warcraft\" universe, which was first introduced by \"\" in 1994. Blizzard announced \"World of Warcraft\" on November 23, 2004, on the 10th anniversary of the \"Warcraft\" franchise.", "prediction 2": "The first Call of Duty video game came out on October 29, 2003, for Microsoft Windows. The game simulates infantry and combined arms warfare of World War II using a modified version of the id Tech 3 engine. The first Call of Duty game was developed by Infinity Ward and published by Activision. In September 2004, an expansion pack called \"\", which was produced by Activision and developed by Gray Matter Interactive and Pi Studios, was released. The first World of Warcraft video game came out on November 23, 2004, on the 10th anniversary of the Warcraft series.", "prediction 3": "Call of Duty is a first-person shooter video game developed by Infinity Ward and published by Activision, which is the first installment in the Call of Duty franchise, released on October 29, 2003, for Microsoft Windows. The game simulates infantry and combined arms warfare of World War II using a modified version of the id Tech 3 engine. The first edition of Call of Duty was released on October 29, 2003, for Microsoft Windows. The first edition of the first Call of Duty game was released on October 29, 2003, for Microsoft Windows. Call of Duty was the first game in the Call of Duty video game series, and was announced in October 29, 2003, and released on October 29, 2003, for Microsoft Windows.", "prediction 4": "Call of Duty is a first-person shooter video game developed by Infinity Ward and published by Activision. It is the first installment in the Call of Duty franchise, released on October 29, 2003, for Microsoft Windows. Call of Duty was first announced on September 2, 2001, and the first World of Warcraft game was announced on November 23, 2004 on the 10th anniversary of the Warcraft franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 76 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 491, "end": 604 } ], "missing-info": [], "corrected-prediction": "Call of Duty is a first-person shooter video game published by Activision. It is the first installment in the \"Call of Duty\" franchise, released on October 29, 2003, for Microsoft Windows." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How early can you buy alcohol in maine?", "passages": [ [ "Alcohol laws of Maine", "The Maine Department of Public Safety, through the Maine State Police's Liquor and Licensing Division, is responsible for licensing the manufacture, importation, storage, transportation and sale of all liquor.", "They also administer those laws relating to licensing and the collection of taxes on malt liquor and wine.", "Title 28-A of the Maine Revised Statutes contains the laws and rules regulating liquor.", "Alcohol may be sold between the hours of 5 a.m. and 1 a.m. each day of the week.", "On New Year's Day, alcohol may be sold until 2 a.m.", "It may be consumed in establishments licensed for on-premises consumption until 1:15\u00a0a.m., with the exception of New Year's Day when it is 2:15\u00a0a.m.\n\nAlcohol sales were previously prohibited until 9 a.m. on Sundays.", "In 2013 an exception was made to allow sales starting at 6 a.m. when St. Patrick's Day falls on a Sunday.", "But in 2015 the legislature revised the law again to allow sales on any Sunday starting at 5 a.m., the same as every other day of the week.", "It is illegal to distribute alcoholic beverages for free, as well as serving a customer more than two beverages at a time." ] ], "gold": "In Maine, alcohol may be sold between the hours of 5:00 AM and 1:00 AM of the next calendar day. On New Year's Day, alcohol may be sold until 2:00 AM. It may be consumed in establishments licensed for on-premises consumption until 1:15 AM, with the exception of New Year's Day when it is 2:15 AM. Alcohol sales were previously prohibited until 9:00 AM on Sundays. In 2013 an exception was made to allow sales starting at 6:00 AM when St. Patrick's Day falls on a Sunday. In 2015 the legislature revised the law again to allow sales on any Sunday starting at 5:00 AM, the same as every other day of the week.", "prediction 1": "On New Year's Day, alcohol may be sold until 2 a.m. It may be consumed in establishments licensed for on-premises consumption until 1:15 a.m., with the exception of New Year's Day when it is 2:15 a.m. Alcohol sales were previously prohibited until 9 a.m. on Sundays. In 2013 an exception was made to allow sales starting at 6 a.m. when St. Patrick's Day falls on a Sunday. In 2015 the legislature revised the law again to allow sales on any Sunday starting at 5 a.", "prediction 2": "On New Year's Day, alcohol may be sold from 5 a.m. until 2 a.m. It may be consumed in establishments licensed for on-premises consumption until 1:15 a.m., with the exception of New Year's Day when it is 2:15 a.m.", "prediction 3": "The law for alcohol in Maine is that it may be purchased between the hours of 5 a.m. and 1 a.m. each day of the week and may be consumed in establishments licensed for on-premises consumption until 1:15 a.m., with the exception of New Year's Day when it is 2:15 a.m. In 2010, it was prohibited to buy alcohol before 9 a.m., but in 2015 the legislature revised the law again to allow sales on any Sunday starting at 5 a. In 2013, an exception was made to allow sales starting at 6 a. On New Year's Day, alcohol may be sold between 5 a.m.m.m. It may be consumed in establishments licensed for on-premises licensed for on-premises licensed for on-premises licensed for on-premises licensed for on-premises licensed for", "prediction 4": "Alcohol may be sold between the hours of 5 a.m. and 1 a.m. each day of the week. On New Year's Day, alcohol may be sold until 2 a.m. It may be consumed in establishments licensed for on-premises consumption until 1:15 a.m., with the exception of New Year's Day when it is 2:15 a.m. Alcohol sales were previously prohibited until 9 a.m. on Sundays. In 2013, an exception was made to allow sales starting at 6 a. But in 2015 the legislature revised the law again to allow sales on any Sunday starting at 5 a.m.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Alcohol may be sold between the hours of 5 a.m. and 1 a.m. each day of the week. On New Year's Day, alcohol may be sold until 2 a.m. It may be consumed in establishments licensed for on-premises consumption until 1:15 a.m., with the exception of New Year's Day when it is 2:15 a.m. Alcohol sales were previously prohibited until 9 a.m. on Sundays. In 2013 an exception was made to allow sales starting at 6 a.m. when St. Patrick's Day falls on a Sunday. In 2015 the legislature revised the law again to allow sales on any Sunday starting at 5 a.m., the same as every other day of the week." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When was the last time ohio state played notre dame?", "passages": [ [ "2016 Fiesta Bowl (January)", "2016 Fiesta Bowl (January)\n\nThe 2016 Fiesta Bowl was a college football bowl game that was played on January 1, 2016 at University of Phoenix Stadium in Glendale, Arizona.", "The 44th Fiesta Bowl was one of the New Year's Bowls.", "It was one of the 2015\u201316 bowl games that concluded the 2015 FBS football season.", "The game was televised on ESPN and ESPN Deportes, and broadcast on ESPN Radio and XM Satellite Radio, with the kickoff time set for 1:00 P.M. ET (11 A.M. MT).", "Sponsored by obstacle racing series BattleFrog, it was officially known as the BattleFrog Fiesta Bowl.", "Coincidentally, it took place 10 years after the 2006 Fiesta Bowl, that was also played by Ohio State and Notre Dame.", "That was also the last time Notre Dame participated in the Fiesta Bowl.", "Ohio State wound up beating Notre Dame, 44-28.", "The two participants for the game will be determined by the College Football Playoff selection committee, and will consist of at-large selections and/or the highest ranked team from the \"Group of Five\" conferences.", "The two participants are going to be the #8 Notre Dame Fighting Irish at 10-2 VS The #7 Ohio State Buckeyes at 11-1.", "Source:" ], [ "2006 Fiesta Bowl", "2006 Fiesta Bowl\n\nThe 2006 Tostitos Fiesta Bowl, played on January 2, 2006, was the 35th edition of the Fiesta Bowl, sponsored by Frito-Lay through its Tostitos tortilla chip brand.", "The game featured the Notre Dame Fighting Irish and the Ohio State Buckeyes, and resulted in a 34\u201320 Ohio State win.", "Ohio State quarterback Troy Smith became the frontrunner of the 2006 Heisman race, after he completed 19 of his 28 passes for 342 yards, including 2 touchdowns and no interceptions.", "Notre Dame's Brady Quinn completed 29 out of his 45 passes for 286 yards.", "Notre Dame got the 1st score of the game, with a 20 yard touchdown run by Darius Walker.", "Then Ohio State responded on a 6 play 86 yard drive capped off with a 56 yard touchdown pass to Ted Ginn, Jr.", "In the second quarter, off a wide-receiver reverse, Ginn rushed 68 yards to the left side for a touchdown.", "Then with just over 2 minutes to go in the half, Troy Smith found Santonio Holmes for an 85 yard touchdown pass, and Ohio State led 21\u20137 at half-time.", "In the second half, Notre Dame scored on Darius Walker's second rushing touchdown of the game, to make the score 21-13 in favor of Ohio State." ] ], "gold": "The most recent college football game between Ohio State and Notre Dame was at the Fiesta Bowl on January 1, 2016, 10 years after the two teams played in the January 2, 2006 Fiesta Bowl. Both contests resulted in a victory for Ohio State. ", "prediction 1": "The last time Ohio State played Notre Dame was on January 1, 2016, when the Buckeyes defeated the Irish 44\u201328. The last time Ohio State played Notre Dame was on January 2, 2006.", "prediction 2": "The last time Ohio State played Notre Dame in the Fiesta Bowl was on January 1, 2016, which was 10 years ago. The 2006 Tostitos Fiesta Bowl, played on January 2, 2006, was the 35th edition of the Fiesta Bowl, sponsored by Frito-Lay through its Tostitos tortilla chip brand. The game featured the Notre Dame Fighting Irish and the Ohio State Buckeyes, and resulted in a 34-20 Ohio State win.", "prediction 3": "The last time Ohio State played Notre Dame was in 2006, when the teams played the Tostitos Fiesta Bowl. The last time Ohio State played Notre Dame was in 2006, when the teams played the 2006 Fiesta Bowl.", "prediction 4": "The last time Ohio State played Notre Dame was on January 2, 2006, when the two teams faced off in the Tostitos Fiesta Bowl. That was the 35th edition of the Fiesta Bowl sponsored by Frito-Lay through its Tostitos tortilla chip brand. The last time the two teams met was on January 1, 2016 when the 2016 Fiesta Bowl was played at University of Phoenix Stadium in Glendale, Arizona.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 110 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 13 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Ohio State played Notre Dame was on January 1, 2016. Coincidentally, it took place 10 years after the 2006 Fiesta Bowl, that was also played by Ohio State and Notre Dame. That was also the last time Notre Dame participated in the Fiesta Bowl. Ohio State wound up beating Notre Dame, 44-28. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When did the english start using the longbow?", "passages": [ [ "English longbow", "Traditionally it has been argued that prior to the beginning of the 14th century, the weapon was a self bow between four and five feet in length, known since the 19th century as the shortbow.", "This weapon, drawn to the chest rather than the ear, was much weaker.", "However, in 1985, Jim Bradbury reclassified this weapon as the \"ordinary wooden bow\", reserving the term shortbow for short composite bows and arguing that longbows were a developed form of this ordinary bow.", "Strickland and Hardy in 2005 took this argument further, suggesting that the shortbow was a myth and all early English bows were a form of longbow.", "In 2011, Clifford Rogers forcefully restated the traditional case based upon a variety of evidence, including a large scale iconographic survey.", "In 2012, Richard Wadge added to the debate with an extensive survey of record, iconographic and archaeological evidence, concluding that longbows co-existed with shorter self-wood bows in England in the period between the Norman conquest and the reign of Edward III, but that powerful longbows shooting heavy arrows were a rarity until the later 13th century.", "Whether or not there was a technological revolution at the end of the 13th century therefore remains in dispute.", "What is agreed, however, is that the English longbow as an effective weapon system evolved in the late 13th and early 14th centuries." ], [ "English longbow", "English longbow\n\nThe English longbow was a powerful medieval type of longbow (a tall bow for archery) about long used by the English and Welsh for hunting and as a weapon in medieval warfare.", "English use of longbows was effective against the French during the Hundred Years' War, particularly at the start of the war in the battles of Sluys (1340), Cr\u00e9cy (1346), and Poitiers (1356), and perhaps most famously at the Battle of Agincourt (1415).", "They were less successful after this, with longbowmen having their lines broken at the Battle of Verneuil (1424), and being completely routed at the Battle of Patay (1429) when they were charged before they had set up their defensive position.", "The earliest longbow known, from what is now England, found at Ashcott Heath, Somerset, is dated to 2665 BC, but no longbows survive from the period when the longbow was dominant (c. 1250\u20131450 AD), probably because bows became weaker, broke and were replaced, rather than being handed down through generations.", "More than 130 bows survive from the Renaissance period, however." ], [ "Battle of Hastings", "Battle of Hastings\n\nThe Battle of Hastings was fought on 14 October 1066 between the Norman-French army of William, the Duke of Normandy, and an English army under the Anglo-Saxon King Harold Godwinson, beginning the Norman conquest of England.", "It took place approximately northwest of Hastings, close to the present-day town of Battle, East Sussex, and was a decisive Norman victory.", "The background to the battle was the death of the childless King Edward the Confessor in January 1066, which set up a succession struggle between several claimants to his throne.", "Harold was crowned king shortly after Edward's death, but faced invasions by William, his own brother Tostig, and the Norwegian King Harald Hardrada (Harold III of Norway).", "Hardrada and Tostig defeated a hastily gathered army of Englishmen at the Battle of Fulford on 20 September 1066, and were in turn defeated by Harold at the Battle of Stamford Bridge five days later.", "The deaths of Tostig and Hardrada at Stamford Bridge left William as Harold's only serious opponent.", "While Harold and his forces were recovering, William landed his invasion forces in the south of England at Pevensey on 28 September 1066 and established a beachhead for his conquest of the kingdom.", "Harold was forced to march south swiftly, gathering forces as he went." ] ], "gold": "The origins of the English longbow are disputed. While it is hard to assess the significance of military archery in pre-Norman Conquest Anglo-Saxon warfare, it is clear that archery played a prominent role under the Normans, as the story of the Battle of Hastings shows. In this battle on 14 October 1066, the English army was composed almost entirely of infantry and had few archers, whereas only about half of the invading force of the Norman-French army was infantry with the rest split equally between cavalry and archers. This battle was ultimately a decisive Norman victory. Then in the 14th century, the English use of longbows was effective against the French during the Hundred Years' War, particularly at the start of the war in the battles of Sluys in 1340, Cr\u00e9cy in 1346 and Poitiers in 1356.", "prediction 1": "The English longbow was a powerful medieval type of longbow used by the English and Welsh for hunting and as a weapon in medieval warfare. It was primarily used against the French during the Hundred Years' War, particularly at the start of the war in the battles of Sluys, Cr\u00e9cy, and Poitiers, and perhaps most famously at the Battle of Agincourt in 1415. However, the earliest longbow found at Ashcott Heath, Somerset, is dated to 2665 BC, but no longbow survive from the period when the longbow was dominant (c. 1250\u20131450 AD), probably because bows became weaker, broke and were replaced, rather than being handed down through generations.", "prediction 2": "The English longbow was a powerful medieval type of longbow (a tall bow for archery) about long used by the English and Welsh for hunting and as a weapon in medieval warfare. English use of longbows was effective against the French during the Hundred Years' War, particularly at the start of the war in the battles of Sluys (1340), Cr\u00e9cy (1346), and Poitiers (1356), and perhaps most famously at the Battle of Agincourt (1415). The earliest longbow known from what is dated to 2665 BC, but no longbow survive from the period when the longbow was dominant (c. 1250\u20131450 AD), probably because bows became weaker, broke and were replaced, rather than being handed down through generations.", "prediction 3": "The English longbow was a powerful medieval type of longbow (a tall bow for archery) about long used by the English and Welsh for hunting and as a weapon in medieval warfare. Traditionally it has been argued that prior to the beginning of the 14th century, the weapon was a self bow between four and five feet in length, known since the 19th century as the shortbow. However, in 1985, Jim Bradbury reclassified this weapon as the \"ordinary wooden bow\", reserving the term shortbow for short composite bows and arguing that longbows were a developed form of this ordinary bow. The earliest longbow known, from what is now England, found at Ashcott Heath, Somerset, is dated to 2665 BC, but no longbow survive from the period when the longbow was dominant (c. 1250\u20131450 AD), probably because bows became weaker, broke and", "prediction 4": "The english started using the longbow in the mid-13th century. Early examples of the longbow can be found in the 13th century at the Battle of Hastings. Later examples include the Longbow of Dover, a longbow made from a tree trunk, the Longbow of Dunkirk, and the Longbow of Salisbury. The English longbow was developed in the late 13th century and evolved into a powerful medieval type of longbow. However, there is also evidence that the longbow was first used by the mid-13th century.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 356, "end": 641 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The English longbow was used as a weapon in medieval warfare. It was primarily used against the French during the Hundred Years' War, particularly at the start of the war in the battles of Sluys, Cr\u00e9cy, and Poitiers, and perhaps most famously at the Battle of Agincourt in 1415. The Battle of Hastings was fought on 14 October 1066 between the Norman-French army and an English army. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Which actress stars as a mom in the film diary of a wimpy kid the long haul?", "passages": [ [ "Diary of a Wimpy Kid: The Long Haul (film)", "Diary of a Wimpy Kid: The Long Haul (film)\n\nDiary of a Wimpy Kid: The Long Haul (sometimes known as Diary of a Wimpy Kid 4: The Long Haul) is a 2017 American road comedy film directed by David Bowers.", "It is the fourth and final installment in the \"Diary of a Wimpy Kid\" film series, and is based on the ninth and tenth books in the series, \"\" and \"\", and one element based on the eighth book \"\".", "Despite not being a reboot, the cast members from the first three films do not reprise their roles, as they are replaced by a new cast.", "It was theatrically released on May 19, 2017, by 20th Century Fox.", "The film grossed $40 million worldwide on a $22 million production cost.", "One year after the , while at the Corny's family restaurant, the Heffley family \u2014 consists of Greg, Rodrick, Frank, Susan and Manny \u2014 plans to take a road trip across the USA to attend Meemaw's 90th birthday.", "However, after Greg and Rowley rescue his younger brother Manny, who got stuck inside a tube in the play area, Greg ends up in a ball pit with a diaper stuck on his hand, startling him." ], [ "Diary of a Wimpy Kid (film series)", "The film was directed by David Bowers and features the same familiar cast of characters, introducing a few new ones, and also focusing on lesser characters not elaborated on in previous films, including Frank Heffley (Steve Zahn), Mr. Robert Jefferson (Alf Humphreys) and Holly Hills (Peyton List).", "\"Dog Days\" is the first film in the series not to be released in March.", "\"Diary of a Wimpy Kid: The Long Haul\" was released on May 19, 2017, and is the first film to feature an entirely new cast.", "Jason Drucker and Charlie Wright portray Greg and Rodrick Heffley, and Tom Everett Scott and Alicia Silverstone as their parents, Frank and Susan.", "The film follows Greg and Rodrick convincing their family to go on a road trip for their great grandmother's 90th birthday, but they actually plan on attending a video game convention.", "An animated short film set after the events of Dog Days, \"Diary of a Wimpy Kid: Class Clown\", was released on the home media release of \"Dog Days\" in 2012.", "The short is told through Greg's point of view as he explains his experience with humor and comedy.", "Zachary Gordon reprises his role as Greg Heffley along other cast members voicing their characters from the films in minor roles." ] ], "gold": "Several actresses star as a mom in the 2017 film Diary of a Wimpy Kid: The Long Haul. In the film, actress Alicia Silverstone stars as Greg's mom and actress Kimberli Lincoln stars as Brandi's mom.", "prediction 1": "In the 2017 American road comedy film, Diary of a Wimpy Kid: The Long Haul, Alicia Silverstone stars as a mom.", "prediction 2": "In the 2017 American road comedy film Diary of a Wimpy Kid: The Long Haul, Alicia Silverstone stars as Susan Heffley, the mother of Greg and Rodrick Heffley, and Susan is played by Jason Drucker and Charlie Wright.", "prediction 3": "In the 2017 American road comedy film Diary of a Wimpy Kid: The Long Haul, Alicia Silverstone stars as the mother of the film's main characters, Frank and Susan Heffley. Susan Heffley is played by the late Veronica Rothermeier.", "prediction 4": "In the 2017 American road comedy film Diary of a Wimpy Kid: The Long Haul, Alicia Silverstone stars as a mother. The film stars Jason Drucker as Greg Heffley's father and Tom Everett Scott as Frank's father.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the 2017 American road comedy film, Diary of a Wimpy Kid: The Long Haul, Alicia Silverstone stars as Greg's mom." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Where is the state of new york located?", "passages": [ [ "New York (state)", "New York (state)\n\nNew York is a state in the Northeastern United States.", "New York was one of the original Thirteen Colonies that formed the United States.", "With an estimated 19.85 million residents in 2017, it is the fourth most populous state.", "To distinguish the state from the city in the state with the same name, it is sometimes called New York State.", "The state's most populous city, New York City, makes up over 40% of the state's population.", "Two-thirds of the state's population lives in the New York metropolitan area, and nearly 40% lives on Long Island.", "The state and city were both named for the 17th century Duke of York, the future King James II of England.", "With an estimated population of 8.55 million in 2015, New York City is the most populous city in the United States and the premier gateway for legal immigration to the United States.", "The New York metropolitan area is one of the most populous in the world.", "New York City is a global city, home to the United Nations Headquarters and has been described as the cultural, financial and media capital of the world, as well as the world's most economically powerful city.", "The next four most populous cities in the state are Buffalo, Rochester, Yonkers, and Syracuse, while the state capital is Albany." ], [ "Long Island", "Long Island\n\nLong Island is a densely populated island off the East Coast of the United States, beginning at New York Harbor approximately 0.35 miles (0.56\u00a0km) from Manhattan Island and extending eastward into the Atlantic Ocean.", "The island comprises four counties in the U.S. state of New York.", "Kings and Queens Counties (the New York City boroughs of Brooklyn and Queens, respectively) and Nassau County share the western third of the island, while Suffolk County occupies the eastern two-thirds.", "More than half of New York City's residents now live on Long Island, in Brooklyn and Queens.", "However, many people in the New York metropolitan area (including those in Brooklyn and Queens) colloquially use the term \"Long Island\" (or the Island) to refer exclusively to Nassau and Suffolk Counties, which are mainly suburban in character, conversely employing the term \"the City\" to mean Manhattan alone.", "Broadly speaking, \"Long Island\" may refer both to the main island and the surrounding outer barrier islands.", "North of the island is Long Island Sound, across which lie Westchester County, New York, and the state of Connecticut.", "Across the Block Island Sound to the northeast is the state of Rhode Island.", "To the west, Long Island is separated from the Bronx and the island of Manhattan by the East River." ] ], "gold": "New York is located in the Northeastern part of the United States on the East Coast, and borders these states: New Jersey, Pennsylvania, Connecticut, Vermont, Massachusetts. ", "prediction 1": "New York is a state in the Northeastern United States and was one of the original Thirteen Colonies that formed the United States. With an estimated 19.85 million residents in 2017, it is the fourth most populous state. To distinguish the state from the city in the state with the same name, it is sometimes called New York State.", "prediction 2": "New York is a state in the Northeastern United States. It was one of the original Thirteen Colonies that formed the United States. In 1791, New York was one of the Thirteen Colonies that formed the United States. New York was one of the original Thirteen Colonies that formed the United States. The state capital is Albany.", "prediction 3": "New York is a state in the Northeastern United States. New York was one of the original Thirteen Colonies that formed the United States. It is the fourth most populous state and the fourth largest city. The state's most populous city, New York City, makes up over 40% of the state's population. The state capital is Albany. Two-thirds of the state's population lives in the New York metropolitan area, and nearly 40% lives on Long Island.", "prediction 4": "New York is a state in the Northeastern United States. New York was one of the original Thirteen Colonies that formed the United States. With an estimated 19.85 million residents in 2017, it is the fourth most populous state. New York's most populous city, New York City, makes up over 40% of the state's population. Two-thirds of the state's population lives in the New York metropolitan area, and nearly 40% lives on Long Island.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 330 }, { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 130 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "New York is a state in the Northeastern United States on the East Coast." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who got promoted to the premier league this year?", "passages": [ [ "2017\u201318 Premier League", "2017\u201318 Premier League\n\nThe 2017\u201318 Premier League was the 26th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The season started on 11 August 2017 and concluded on 13 May 2018.", "Fixtures for the 2017\u201318 season were announced on 14 June 2017.", "Chelsea were the defending champions, while Newcastle United, Brighton & Hove Albion and Huddersfield Town entered as the promoted teams from the 2016\u201317 EFL Championship.", "Manchester City won their third Premier League title, and fifth English top-flight title overall, with five games to spare.", "The team broke numerous Premier League records over the course of the season, including: most points (100), most wins (32), most away wins (16), most goals (106), most consecutive league wins (18), highest goal difference (+79), most passes in a game (903), fewest minutes behind in matches (153 minutes) and biggest winning points margin (19).", "All three promoted clubs avoided relegation for the first time since the 2011\u201312 campaign, and for only the third time in Premier League history.", "From this season on, club strips can feature sleeve sponsorship, whereby sponsors' logos will appear on the left sleeve of the strip in lieu of the Premier League patch." ], [ "2010\u201311 Premier League", "The new rule required clubs to name at least eight players in their squad of 25 players that have been registered domestically for a minimum of three seasons prior to their 21st birthday.", "All of the Premier League teams submitted their 25-man squads on 1 September 2010 deadline.", "A total of twenty teams contested the league, including seventeen sides from the 2009\u201310 season and three promoted teams from the 2009\u201310 Football League Championship.", "Hull City, Burnley and Portsmouth were relegated from 2009\u201310 Premier League after finishing the season in the bottom three places of the league table.", "From the three teams relegated, Portsmouth had the longest tenure as a Premier League member as the club completed a seven-year stay at the highest level of English football.", "In comparison, Hull City and Burnley had to return to the Championship after two and one years respectively.", "2009\u201310 Football League Championship champions Newcastle United and runners-up West Bromwich Albion secured direct promotion to the Premier League.", "Both teams made their immediate return to the Premier League after being relegated at the end of the 2008\u201309 season.", "Blackpool beat Cardiff City 3\u20132 in the Championship play-off Final to join them after 39 years of absence from the top flight.", "It was the first time since 1983\u201384 that all four major West Midlands clubs\u2014Birmingham City, West Bromwich Albion, Aston Villa and Wolverhampton Wanderers\u2014had been in the top division at the same time." ], [ "Premier League", "The three lowest placed teams in the Premier League are relegated to the Championship, and the top two teams from the Championship promoted to the Premier League, with an additional team promoted after a series of play-offs involving the third, fourth, fifth and sixth placed clubs.", "The Premier League had 22 teams when it began in 1992, but this was reduced to the present 20-team format in 1995.", "49 clubs have played in the Premier League from its inception in 1992, up to and including the 2018\u201319 season.", "The following 20 clubs will compete in the Premier League during the 2018\u201319 season.", "The following clubs are not competing in the Premier League during the 2018\u201319 season, but competed in the Premier League for at least one season.", "In 2011, a Welsh club participated in the Premier League for the first time after Swansea City gained promotion.", "The first Premier League match to be played outside England was Swansea City's home match at the Liberty Stadium against Wigan Athletic on 20 August 2011.", "The number of Welsh clubs in the Premier League increased to two in 2013\u201314, as Cardiff City gained promotion, but they were relegated after their maiden season.", "Cardiff were promoted again in 2017-18 but the number of Welsh clubs will remain the same as Swansea City were relegated from the Premier League in the same season." ] ], "gold": "Each year, the top two teams from the EFL Championship are promoted to the Premier League, with an additional team promoted after a series of play-offs, as part of the system of promotions and relegations between both leagues. In 2015, Bournemouth, Watford and Norwich City were promoted, with Burnley, Middlesbrough and Hull City following them in 2016. The turn came for Newcastle United, Brighton & Hove Albion and Huddersfield Town to be part of the Premier League in 2017, the year in which they were all promoted.", "prediction 1": "The Premier League was established in 1992 and is the top English professional league for association football clubs. The three lowest placed teams in the Premier League are relegated to the Championship, and the top two teams from the Championship promoted to the Premier League, with an additional team promoted after a series of play-offs involving the third, fourth, fifth and sixth placed clubs. The promotion campaigns for each Premier League season start on 11 August and conclude on 13 May 2018.", "prediction 2": "The Premier League is the top English professional league for association football clubs, established in 1992. In the 2017\u201318 season Newcastle United, Brighton & Hove Albion and Huddersfield Town entered as the promoted teams from the 2016\u201317 EFL Championship. The promotion of Birmingham City was based on a combination of two different methods. The first method involved a combination of direct promotion from the Football League Championship and promotion by a team from the Football League National League. The second method involved the promotion of Sheffield United and Manchester United. The promoted teams were promoted by their respective promotions.", "prediction 3": "There were three teams promoted to the Premier League in 2017-18. In the 2009-10 season, Newcastle United and runners-up West Bromwich Albion secured direct promotion to the Premier League. In the 2010-11 season, Manchester City were the promoted team, while in the 2015/16 season, Arsenal were promoted to the Premier League. In the 2017\u201318 season, Chelsea were the promoted team.", "prediction 4": "The Premier League is the top English professional league for association football clubs. Manchester City, Newcastle United and Brighton & Hove Albion were the three teams promoted to the Premier League in 2017. Sheffield United were also promoted to the Premier League in 2017. Cardiff City were promoted to the Premier League in 2017-18.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 400 }, { "error type": "Unverifiable", "explanation": "", "start": 405, "end": 424 }, { "error type": "Unverifiable", "explanation": "", "start": 465, "end": 503 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7, 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The three lowest placed teams in the Premier League are relegated to the Championship, and the top two teams from the Championship promoted to the Premier League, with an additional team promoted after a series of play-offs. Cardiff City was promoted in the 2013-2014 season. They were promoted again in 2017-2018. Newcastle United,West Bromwich Albion and Blackpool were promoted in 2009-2010. Newcastle United, Brighton & Hove Albion and Huddersfield Town were promoted from 2016-2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is ramsey from if loving you is wrong?", "passages": [ [ "If Loving You Is Wrong", "If Loving You Is Wrong\n\nIf Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry.", "The series premiered on September 9, 2014.", "It focuses on the lives and relationships of a group of five husbands and wives who live on the same street (Castillo Lane) in the fictional community of Maxine.", "The show stars Amanda Clayton, Edwina Findley, Heather Hemmens, Zulay Henao, and April Parker Jones as the five female leads Alex, Kelly, Marcie, Esperanza and Natalie on \"their quest to find love in the midst of managing very complex lives.\"", "\"If Loving You Is Wrong\" is loosely based on Perry's 2014 film \"The Single Moms Club\".", "Actress Zulay Henao reprised her movie role of Esperanza, although her character and storyline was rebooted for the TV series.", "It was officially ordered straight-to-series on January 9, 2014.", "It premiered on September 9, 2014, on the Oprah Winfrey Network (OWN), and the first half of the first season finale aired on November 4, 2014.", "The series premiere was the highest-rated in OWN history, setting a new record over \"The Haves and the Have Nots\".", "The second half of the first season aired on March 24, 2015." ], [ "Travis Nash", "Travis arranged for Kibiri's younger sister, Stephanie (Fleur Beaupert), to be smuggled out of the country and he returned to Australia.", "Travis is a witness to Laura Bonnetti's (Claudia Buttazonni) death, after she and her boyfriend, Curtis Reed (Shane Ammann), play on some railway tracks.", "Travis comforts a distraught Curtis and supports him when he descends into alcoholism.", "While back in the bay, Travis reconnects with his old friends Donna and Rob.", "Travis and Donna rekindle their relationship, after Donna dumps her violent boyfriend Andrew Warren (Adrian Lee).", "They later leave for Canada on a whale-watching trip.", "Several months later, Travis returns after breaking off his engagement with Donna and moves back into his house to find two new tenants, local doctor Kelly Watson and old friend Steven.", "Travis and Steven compete for Kelly's affections and Travis wins.", "When Kelly suffers a scare at the hospital after treating an HIV-positive patient, Travis stands by her.", "Stephanie arrives and Travis and Kelly become her guardians.", "When Stephanie dies after a cliff fall, Travis is distraught as he promised Kibiri he would always look after her.", "Travis asks Kelly's father for her hand in marriage and the couple become engaged." ] ], "gold": "If Loving You Is Wrong is an American prime time television soap opera that focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. On the show, Trevante Rhodes plays the character of Ramsey, Kelly's new neighbor, for whom she later develops feelings.", "prediction 1": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. The show focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. The five female leads on the show are Alex, Kelly, Marcie, Esperanza, and Natalie.", "prediction 2": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. The show focuses on the lives and relationships of a group of five husbands and wives who live on the same street (Castillo Lane) in the fictional community of Maxine. The five female leads are Alex, Kelly, Marcie, Esperanza, and Natalie.", "prediction 3": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. The series focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine, Colorado. The show stars Amanda Clayton, Edwina Findley, Heather Hemmens, Zulay Henao, and April Parker Jones as the five female leads Alex, Kelly, Marcie, Esperanza and Natalie on \"their quest to find love in the midst of managing very complex lives.\"", "prediction 4": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. The series focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. There is a character named 'ramsey' from the show. 'Ramsey' is played by Fleur Beaupert, who plays Travis Nash, who has been on the show since Season 1 and has also played by Zulay Henao, who played the character's mother of Travis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 372 } ], "missing-info": [], "corrected-prediction": "If Loving You Is Wrong is an American prime time television soap opera. The show focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did women get the vote in the uk?", "passages": [ [ "Women's suffrage in the United Kingdom", "Women's suffrage in the United Kingdom\n\nWomen's suffrage in the United Kingdom was a movement to fight for women's right to vote.", "It finally succeeded through two laws in 1918 and 1928.", "It became a national movement in the Victorian era.", "Women were not explicitly banned from voting in Great Britain until the 1832 Reform Act and the 1835 Municipal Corporations Act.", "In 1872 the fight for women's suffrage became a national movement with the formation of the National Society for Women's Suffrage and later the more influential National Union of Women's Suffrage Societies (NUWSS).", "As well as in England, women's suffrage movements in Wales and other parts of the United Kingdom gained momentum.", "The movements shifted sentiments in favour of woman suffrage by 1906.", "It was at this point that the militant campaign began with the formation of the Women's Social and Political Union (WSPU).", "The outbreak of the First World War in 1914 led to a suspension of all politics, including the militant suffragette campaigns.", "Lobbying did take place quietly.", "In 1918, a coalition government passed the Representation of the People Act 1918, enfranchising all men, as well as all women over the age of 30 who met minimum property qualifications." ], [ "Representation of the People (Equal Franchise) Act 1928", "Representation of the People (Equal Franchise) Act 1928\n\nThe Representation of the People (Equal Franchise) Act 1928 was an Act of the Parliament of the United Kingdom.", "This act expanded on the Representation of the People Act 1918 which had given some women the vote in Parliamentary elections for the first time after World War I. The 1928 Act widened suffrage by giving women electoral equality with men.", "It gave the vote to all women over 21 years old, regardless of property ownership.", "Prior to this act only women over 30 who met minimum property qualifications could vote.", "Similar provision was made for the Parliament of Northern Ireland by the Representation of the People Act (Northern Ireland) 1928 (18 & 19 Geo V, Ch 24 (NI)).", "This statute is sometimes known informally as the Fifth Reform Act or the Equal Suffrage Act.", "The act was passed by the Conservative Party without much opposition from other parties.", "The bill became law on 2 July 1928, having been introduced in March.", "The leader of the National Union of Women's Suffrage Societies who had campaigned for the vote, Millicent Fawcett, was still alive and attended the parliament session to see the vote take place.", "She wrote in her diary the same night \"It is almost exactly 61 years ago since I heard John Stuart Mill introduce his suffrage amendment to the Reform Bill on 20 May 1867." ], [ "Parliament (Qualification of Women) Act 1918", "Parliament (Qualification of Women) Act 1918\n\nThe Parliament (Qualification of Women Act) 1918 is an Act of the Parliament of the United Kingdom.", "It gave women over 21 the right to stand for election as an MP.", "It did not alter the minimum age for a woman to vote in an election, which had been 30 since the Representation of the People Act 1918.", "It was not until the Representation of the People (Equal Franchise) Act 1928 that women were given the vote on equal terms with men, at the age of 21.", "At 27 words it is the shortest UK statute.", "The Representation of the People Act 1918, passed on 6 February 1918, gave about 8.4 million women the vote, and it led to the Parliament (Qualification of Women) Act being passed.", "In the 1918 election to the House of Commons, seventeen women candidates stood to be elected, among them well-known suffragette Christabel Pankhurst, representing the Women's Party in Smethwick.", "However the only woman to be elected was the Sinn F\u00e9in candidate for Dublin St. Patrick's, Constance Markievicz.", "Following the popular Irish political policy of abstentionism, she chose not to take her seat at Westminster and instead sat in D\u00e1il \u00c9ireann (the First D\u00e1il) in Dublin." ] ], "gold": "Women's suffrage in the United Kingdom was a movement that fought for women's right to vote that became a nation-wide campaign during the Victorian Era. It finally succeeded when laws were established in 6 February 1918, when women over 30 who met property qualifications were allowed to vote, and 2 July 1928, when all women over the age of 21 where given access to voting.", "prediction 1": "Women's suffrage in the United Kingdom was a movement to fight for women's right to vote. It finally succeeded through two laws in 1918 and 1928. The Representation of the People Act 1918 gave women the vote in Parliamentary elections for the first time after World War I. The Representation of the People (Equal Franchise) Act 1928 expanded on the Representation of the People Act 1918, which had given some women the vote in Parliamentary elections for the first time after World War I. It gave the vote to all women over the age of 21 years old, regardless of property ownership.", "prediction 2": "Women's suffrage in the United Kingdom was a movement to fight for women's right to vote. It finally succeeded through two laws in 1918 and 1928. The first women's suffrage act in the United Kingdom was the Representation of the People Act 1918, which gave some women the vote in Parliamentary elections for the first time after World War I. The second women's suffrage act in the United Kingdom was the Parliament (Qualification of Women) Act 1918, which gave women over 21 the right to stand for election as an MP.", "prediction 3": "Women's suffrage in the United Kingdom was a movement to fight for women's right to vote. It finally succeeded through two laws in 1918 and 1928. In 1872 the fight for women's suffrage became a national movement with the formation of the National Society for Women's Suffrage and later the more influential National Union of Women's Suffrage Societies (NUWSS). In 1918, a coalition government passed the Representation of the People Act 1918 and it expanded on the Representation of the People (Equal Franchise) Act 1918. The Parliament (Qualification of Women) Act 1918 gave women over 21 the right to stand for election as an MP. It did not alter the minimum age for a woman the vote in an election, which had been 30 since the Representation of the People Act 1918.", "prediction 4": "Women's suffrage in the United Kingdom was a movement to fight for women's right to vote. It finally succeeded through two laws in 1918 and 1928. The Representation of the People Act 1918, passed on 6 February 1918, gave about 8.4 million women the vote. The Parliament (Qualification of Women) Act 1918 is an Act of the Parliament of the United Kingdom. It gave women over 21 the right to stand for election as an MP. It did not alter the minimum age for a woman to vote in an election, which was 30 at the age for a woman in an election, which had been 30 since the Representation of the People Act 1918. The Representation of the People (Equal Franchise) Act 1928, was passed on 2 July 1928.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 488 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "Women's suffrage in the United Kingdom was a movement to fight for women's right to vote that became a nation-wide campaign during the Victorian Era. It finally succeeded through two laws in 1918 and 1928, when women over 30 who met property qualifications were allowed to vote. The Representation of the People Act 1918 gave the vote to all women over the age of 21 years old, regardless of property ownership." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What form of government does the united states use?", "passages": [ [ "Presidency", "The Italian presidency is based on a Parliamentary republic system, where both a president and a prime minister are active participants in administration of the state, but where the de facto the prime minister holds the majority of power, while the president remains the nominal head of state.", "The president is intended to represent national unity and guarantee that Italian politics complies with the Constitution.", "Although the prime minister is considered the head of government, the formal Italian order of precedence lists the office as being ceremonially the fourth most important Italian state office.", "It also is considered the de facto leader of the Italian government.", "The prime minister appoints Council of Ministers and Cabinet officials to their rightful area of office.", "The president of the Republic gives wide support across all political parties.", "The president of the Republic appoints Italy\u2019s prime minister and accepts advice from the prime minister.", "The Italian government includes the traditional three branches: Executive, Judicial and Legislative.", "Australia has a constitutional monarchy \u2013 a form of government in which a monarch acts as the head of state within the parameters of a constitution.", "The constitution could be written, unconfined or blended.", "It uses what is called a \"Parliamentary System of Government,\" one that administers the executive branch which then gets Democratic legitimacy from the Legislature.", "The Legislature in Australia is defined as a \"Bicameral Parliament.\"" ], [ "Parliamentary republic", "Parliamentary republic\n\nA parliamentary republic is a republic that operates under a parliamentary system of government where the executive branch (the government) derives its legitimacy from and is accountable to the legislature (the parliament).", "There are a number of variations of parliamentary republics.", "Most have a clear differentiation between the head of government and the head of state, with the head of government holding real power, much like constitutional monarchies (however some head of states, regardless whether the country's system is a parliamentary republic or a constitutional monarchy, are given 'reserve powers' to use at his/her discretion in order to act as a non-partisan 'referee' of the political process and ensure the nation's constitution is upheld).", "Some have combined the roles of head of state and head of government, much like presidential systems, but with a dependency upon parliamentary power.", "For the first case mentioned above, the form of executive-branch arrangement is distinct from most other government and semi-presidential republics that separate the head of state (usually designated as the \"president\") from the head of government (usually designated as \"prime minister\", \"premier\" or \"chancellor\") and subject the latter to the confidence of parliament and a lenient tenure in office while the head of state lacks dependency and investing either office with the majority of executive power." ], [ "Federal government of Mexico", "Federal government of Mexico\n\nThe Federal government of Mexico (alternately known as the Government of the Republic or \"\") is the national government of the United Mexican States, the central government established by its constitution to share sovereignty over the republic with the governments of the 31 individual Mexican states, and to represent such governments before international bodies such as the United Nations.", "The Mexican federal government has three branches: executive, legislative, and judicial and functions per the Constitution of the United Mexican States, as enacted in 1917, and as amended.", "The executive power is exercised by the executive branch, which is headed by the president and his Cabinet, which, together, are independent of the legislature.", "Legislative power is vested upon the Congress of the Union, a bicameral legislature comprising the Senate and the Chamber of Deputies.", "Judicial power is exercised by the judiciary, consisting of the Supreme Court of Justice of the Nation, the Council of the Federal Judiciary, and the collegiate, unitary, and district courts.", "The federal government, known as the Supreme Power of the Federation, is constituted by the Powers of the Union: the legislative, the executive, and the judicial.", "Mexico City, as the capital, the seat of the powers of the Union.", "All branches of government are independent; no two separate branches must be vested upon a single person or institution, and the legislative power must not be vested upon a single individual." ] ], "gold": "The United States is a federal republic and a representative democracy with three separate branches of government, including a bicameral legislature. A combined head of state and government in the form of an executive president is either elected by the legislature or by the people and they are subject to parliamentary confidence during their term. In the United States, the presidency is independent of legislature.", "prediction 1": "The United States uses a form of government that is called a parliamentary republic. This form of government is where the executive branch derives its legitimacy from and is accountable to the legislature. The federal government of Mexico uses a form of government that is called a parliamentary republic.\n", "prediction 2": "The United States operates under a federal government known as the federal government of the United States. The Federal government of Mexico is the national government of the United Mexican States, the central government established by its constitution to share sovereignty over the republic with the governments of the 31 individual Mexican states, and to represent such governments before international bodies such as the United Nations. The President of the United States is known as the Commander-in-Chief of the United States Air Force. The Federal government of Great Britain operates under a Federal government based on a presidential system of government, where both a president and a prime minister are active participants in administration of the state, but where the de facto the prime minister holds the majority of power, while the president is the nominal head of state. The President is intended to represent national unity and guarantee that Italian politics complies with the Constitution.", "prediction 3": "Washington is the nominal head of state of the United States and has been since 1787. The federal government in the United States employs a three- branch federal government that serves as a system of federal government since 1920.", "prediction 4": "United States uses a form of government that is referred to as a parliamentary republic. This system of government makes the president a nominal head of state. The president is an elected public official with broad authority to make decisions on behalf of the people. In the United Kingdom, parliament operates under a bicameral system of government. The United States federal government has three branches: executive, legislative and judicial, and functions under the Constitution of the United Kingdom. In France, the head of state is the common law monarch. In Spain, the form of government is a constitutional monarchy, where the president is a national parliament.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 61, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 205 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who has the most youtube subscribers in the world 2017?", "passages": [ [ "PewDiePie", "A \"Wired\" article covering the controversy was originally titled \"PewDiePie Was Always Kinda Racist\u2014But Now He's a Hero to Nazis\", although this was later changed to \"PewDiePie's Fall Shows the Limits of 'LOL JK'.", "Writing for \"The New York Times\", John Herman commented \"[PewDiePie] bemoaned [YouTube's] structure and the way it had changed; he balked at its limits and took joy in causing offense and flouting rules.", "Over time, he grew into an unlikely, disorienting and insistently unserious political identity: He became YouTube's very own populist reactionary.\"", "Over a year after the controversy, MacInnes opined that PewDiePie \"is funny, intelligent, innovative and highly charismatic", "[...] to call him an alt-right agitator would perhaps be unfair as he has never publicly identified with the proto-fascist movement.", "But he shares much of their culture and amplifies it across the world.", "People should pay PewDiePie more attention.\"", "PewDiePie has been noted to support video games from indie developers, often playing through them in his videos." ], [ "PewDiePie", "PewDiePie\n\nFelix Arvid Ulf Kjellberg ( ; ; born 24 October 1989), known online as PewDiePie ( ), is a Swedish YouTuber, comedian and video game commentator, formerly best known for his Let's Play commentaries and now mostly known for his comedic formatted shows.", "Born in Gothenburg, Sweden, PewDiePie originally pursued a degree in industrial economics and technology management at Chalmers University of Technology in Gothenburg.", "In 2010, during his time at the university, he registered a YouTube account under the name PewDiePie.", "The following year, he dropped out of Chalmers after losing interest in his degree field, much to the dismay of his parents.", "After failing to earn an apprenticeship with an advertising agency in Scandinavia, he then decided to focus on creating content for his YouTube channel.", "In order to fund his videos, PewDiePie began selling prints of his Photoshop art projects and worked at a hot dog stand.", "PewDiePie soon gathered a rapidly increasing online following, and in July 2012, his channel surpassed one million subscribers.", "On 15 August 2013, PewDiePie became the most-subscribed user on YouTube, being briefly surpassed in late 2013 by YouTube Spotlight.", "After regaining the top position on 23 December 2013 the channel has now amassed over 77 million subscribers ." ], [ "T-Series (company)", "T-Series' and one of the most expensive Indian films will be \"Saaho\", a sci-fi thriller with a production budget of , scheduled for release in 2019.", "T-Series is also producing a biopic film based on the life of its founder Gulshan Kumar, called \"Mogul\", which is currently under production and is scheduled for release in 2019.", "T-Series joined YouTube on 13 March 2006, but only started uploading videos in late 2010.", "Under this channel, T-Series primarily shows music videos and film trailers.", "By July 2013, it had crossed 100 crore (1 billion) views, becoming the second Indian YouTube channel to cross the milestone after Rajshri Productions.", "In February 2017, T-Series surpassed PewDiePie to become the world's most-viewed YouTube channel.", "As of 19 December 2018 it has 5,600 crore (56 billion) views.", "The YouTube channel has reached 7.5 crore (75 million) subscribers, making it the second most-subscribed YouTube channel after PewDiePie.", "Currently, it is the most subscribed Asian and non-English-language YouTube channel.", "Reaching 5 crore (50 million) subscribers, the channel received a Custom Play Button on September 10, 2018.", "It is also the second channel ever to hit 7 crore (70 million) subscribers." ] ], "gold": "Felix Arvid Ulf Kjellberg, better known online as PewDiePie, is a Swedish YouTuber known primarily for his Let's Play videos and comedic formatted videos and shows. Kjellberg had the most viewed channel on YouTube from December 2014 to February 2017, but in 2019, following a public competition with Indian record label T-Series, Kjellberg was overtaken as the most-subscribed channel. His channel currently holds the title of the fourth most subscribed, albeit remaining the most subscribed operated by an individual. As of August 2021, his channel has over 110 million subscribers and has received 27.7 billion total views.", "prediction 1": "In 2017, the person with the most YouTube subscribers overall was Swedish YouTuber PewDiePie. In 2018, American YouTuber T-Series has the most subscribers worldwide. In 2019, Swedish YouTuber Felix Arvid Ulf Kjellberg has the most subscribers worldwide.", "prediction 2": "PewDiePie, a Swedish YouTuber, comedian and video game commentator, has the most subscribers on YouTube in the world 2017. T-Series, a company owned by Indian film company T-Series, has the most subscribers on YouTube in 2017.", "prediction 3": "In 2017, the most-subscribed user on YouTube was comedian and video game commentator PewDiePie. On 15 August 2013, PewDiePie became the most-subscribed user on YouTube, being briefly surpassed in late 2013 by YouTube Spotlight. However, in February 2017, T-Series surpassed PewDiePie to become the world's most-subscribed user on YouTube. The channel had 7.5 crore (75 million) subscribers, making it the second most-subscribed YouTube channel after PewDiePie.", "prediction 4": "In 2017, the most-subscribed user on YouTube was Swedish YouTuber, comedian and video game commentator, PewDiePie, who reached one million subscribers in July 2012. In February 2017, T-Series surpassed PewDiePie to become the world's most-subscribed YouTube channel. As of 19 December 2018, T-Series has over 7.5 crore (75 million) subscribers, making it the second most-subscribed channel after PewDiePie.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7,8]}", "start": 94, "end": 165 }, { "error type": "Unverifiable", "explanation": "", "start": 166, "end": 174 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In 2017, the person with the most YouTube subscribers overall was Swedish YouTuber PewDiePie. Felix Arvid Ulf Kjellberg, known online as PewDiePie, is a comedian and video game commentator, formerly best known for his Let's Play commentaries and now mostly known for his comedic formatted shows. In February 2017, T-Series surpassed PewDiePie to become the world's most-viewed YouTube channel." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "How many times did the broncos win the superbowl?", "passages": [ [ "Denver Broncos", "Denver Broncos\n\nThe Denver Broncos are a professional American football franchise based in Denver, Colorado.", "The Broncos compete as a member club of the National Football League (NFL)'s American Football Conference (AFC)", "West division.", "They began play in 1960 as a charter member of the American Football League (AFL) and joined the NFL as part of the merger in 1970.", "The Broncos are owned by the Pat Bowlen trust and currently play home games at Broncos Stadium at Mile High (formerly known as Invesco Field at Mile High from 2001\u20132010 and Sports Authority Field at Mile High from 2011\u20132017).", "Prior to that, they played at Mile High Stadium from 1960 to 2000.", "The Broncos were barely competitive during their 10-year run in the AFL and their first seven years in the NFL.", "They did not complete a winning season until 1973.", "In 1977, four years later, they qualified for the playoffs for the first time in franchise history and advanced to Super Bowl XII.", "Since 1975, the Broncos have become one of the NFL's most successful teams, having suffered only seven losing seasons.", "They have won eight AFC Championships (, , , , , , , ), and three Super Bowl championships ( (XXXII), (XXXIII), (50)).", "However, the Broncos share the NFL record for most Super Bowl losses (5) with the New England Patriots." ], [ "History of the Denver Broncos", "History of the Denver Broncos\n\nThe history of the Denver Broncos American football club began when the team was chartered a member of the American Football League in 1960.", "The Broncos have played in the city of Denver, Colorado throughout their entire history.", "The Broncos did not win any titles as members of the AFL.", "Since the 1970 AFL\u2013NFL merger, the Broncos have won 15 division titles, and played in eight Super Bowls, following the 1977, 1986, 1987, 1989, 1997, 1998, 2013, and 2015 seasons.", "They won Super Bowl XXXII, Super Bowl XXXIII and Super Bowl 50.", "Their most famous player is former quarterback John Elway, starting quarterback in five Super Bowls and holder of many NFL records.", "The Broncos currently play in the National Football League's AFC West division.", "Their current leadership includes owner Pat Bowlen, CEO Joe Ellis, VP John Elway, and head coach Vance Joseph.", "For much of their first 3 decades, excluding teams in Texas, they were the only major pro football team between Kansas City and California (and the only team in the Interior West).", "This distinction ended in 1988, when the Cardinals moved from St. Louis to Phoenix.", "The Broncos remain the only current AFC West (formerly AFL West) team to never relocate or change its name." ] ], "gold": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. Throughout the team's history, they have won 8 AFC Championships and 3 Super Bowl championships, having achieved their last title in 2015.", "prediction 1": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. The Broncos compete as a member club of the National Football League's American Football Conference West division. The team has won the Super Bowl eight times. Their most famous player is former quarterback John Elway, starting quarterback in five Super Bowls and holder of many NFL records.", "prediction 2": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. They compete as a member club of the National Football League (NFL)'s American Football Conference West division. The Broncos have won Super Bowl XXXII, Super Bowl XXXIII and Super Bowl 50.", "prediction 3": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. They compete as a member club of the National Football League's American Football Conference West division. The Broncos have won Super Bowl XXXII, Super Bowl XXXIII, and Super Bowl 50.", "prediction 4": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. The team competes as a member club of the National Football League's American Football Conference West division. The most recent Super Bowl victory was in 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 207 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[11]}", "start": 208, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 384 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Denver Broncos are a professional American football franchise based in Denver, Colorado. They have won 8 AFC Championships and 3 Super Bowl championships." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When was the first nuclear power plant built in canada?", "passages": [ [ "Nuclear power in Canada", "Nuclear power in Canada\n\nNuclear power in Canada is provided by 19 commercial reactors with a net capacity of 13.5 Gigawatts (GWe), producing a total of 95.6 Terawatt-hours (TWh) of electricity, which accounted for 16.6% of the country's total electric energy generation in 2015.", "All but one of these reactors are located in Ontario where they produced 61% of the province's electricity in 2016 (91.7 TWh).", "Seven smaller reactors are used for research and to produce radioactive isotopes for nuclear medicine.", "Canadian nuclear reactors are a type of pressurized heavy-water reactor (PHWR) of indigenous design, the CANDU reactor.", "CANDU reactors have been exported to India, Pakistan, Argentina, South Korea, Romania, and China.", "The nuclear industry (as distinct from the uranium industry) in Canada dates back to 1942 when a joint British-Canadian laboratory, the Montreal Laboratory, was set up in Montreal, Quebec, under the administration of the National Research Council of Canada, to develop a design for a heavy-water nuclear reactor.", "This reactor was called the National Research Experimental (NRX) reactor and would be the most powerful research reactor in the world when completed." ], [ "Nuclear power in Canada", "In 1944, approval was given to proceed with the construction of the smaller ZEEP (Zero Energy Experimental Pile) test reactor at Chalk River, Ontario and on September 5, 1945 at 3:45\u00a0p.m., the 10-watt ZEEP achieved the first self-sustained nuclear reaction outside the United States.", "In 1946, the Montreal Laboratory was closed, and the work continued at the Chalk River Nuclear Laboratories.", "Building partly on the experimental data obtained from ZEEP, the National Research Experimental (NRX)\u2014a natural uranium, heavy water moderated research reactor\u2014started up on July 22, 1947.", "It operated for 43 years, producing radioisotopes, undertaking fuels and materials development work for CANDU reactors, and providing neutrons for physics experiments.", "It was eventually joined in 1957 by the larger 200 megawatt (MW) National Research Universal reactor (NRU).", "From 1967 to 1970, Canada also developed an experimental \"miniature\" nuclear reactor named SLOWPOKE (acronym for Safe LOW-POwer Kritical Experiment).", "The first prototype was assembled at Chalk River and many SLOWPOKEs were built, mainly for research.", "Many SLOWPOKEs are still in use in Canada; one has been running at \u00c9cole Polytechnique de Montr\u00e9al since 1976, for instance." ] ], "gold": "Nuclear power in Canada is provided by 19 commercial reactors with a net capacity of 13.5 gigawatt, producing a total of 95.6 terawatt-hours of electricity, which accounted for 16.6% of the country's total electric energy generation in 2015. In 1942, the beginning of designing the first nuclear plant to be built started when a joint British-Canadian laboratory, the Montreal Laboratory, was set up in Montreal, Quebec, under the administration of the National Research Council of Canada, to develop a design for a heavy-water nuclear reactor. On July 22, 1947, the first nuclear power plant, Chalk River Nuclear Laboratories, started up. ", "prediction 1": "In Canada, the first nuclear power plant was built in 1944. The first commercial nuclear power plant in Canada was built in 1964. The first Canadian heavy-water research reactor was built on July 22, 1947. The first Canadian heavy-water research reactor was built in 1944.", "prediction 2": "The first Canadian nuclear power plant was built in 1944, and the first Canadian heavy-water reactor was built in July 1947. It was called the National Research Experimental reactor. The first Canadian heavy-water reactor was a pressurized heavy-water reactor of indigenous design. The Canadian heavy-water reactor has a capacity of 13.5 Gigawatts and was built in Ottawa in 1974.", "prediction 3": "The first Canadian nuclear power plant was built in 1944, with approval given to proceed with the construction of the smaller ZEEP test reactor at Chalk River, Ontario. On September 5, 1945 at 3:45 p.m., the 10-watt ZEEP achieved the first self-sustained nuclear reaction outside the United States. In the year 1946, the Montreal Laboratory was closed, and the work continued at the Chalk River Nuclear Laboratories. In 1967, Canada also developed an experimental \"miniature\" nuclear reactor called SLOWPOKE, where the first prototype was assembled at Chalk River and many SLOWPOKEs were built, mainly for research.", "prediction 4": "The first Canadian nuclear power plant was built in 1944. The first Canadian heavy water nuclear reactor was started up on July 22, 1947. The first Canadian small-scale nuclear reactor was built in 1967. The first Canadian nuclear power plant was built in Chalk River, Ontario on October 8, 1947. The first Canadian heavy-water nuclear reactor was started up on March 6, 1947.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 59 }, { "error type": "Unverifiable", "explanation": "", "start": 60, "end": 129 }, { "error type": "Unverifiable", "explanation": "", "start": 130, "end": 205 }, { "error type": "Unverifiable", "explanation": "", "start": 206, "end": 272 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Nuclear power in Canada Nuclear power in Canada is provided by 19 commercial reactors with a net capacity of 13.5 Gigawatts (GWe), producing a total of 95.6 Terawatt-hours (TWh) of electricity, which accounted for 16.6% of the country's total electric energy generation in 2015. The nuclear industry (as distinct from the uranium industry) in Canada dates back to 1942 when a joint British-Canadian laboratory, the Montreal Laboratory, was set up in Montreal, Quebec, under the administration of the National Research Council of Canada, to develop a design for a heavy-water nuclear reactor. On July 22, 1947, the first nuclear power plant, Chalk River Nuclear Laboratories, started up. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who does the voice of templeton in charlotte web?", "passages": [ [ "Charlotte's Web (1973 film)", "That same month, it was reported that Sagittarius Productions had signed a two-picture production deal with Hanna-Barbera Productions in which both films would be distributed by Paramount Pictures; one of the films being \"Charlotte's Web\".", "Around that same time, Joe Barbera had visited White at his residence in Maine, in which the author highlighted parts of the book he did not want to change, and parts that were \"subject to discussion.\"", "In January 1972, it was reported that Henry Gibson, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Wilbur, Charlotte, and Templeton.", "Writing in his autobiography, Barbera wrote that Reynolds had called him and said that she was willing to join the project even without being paid.", "Although Randall had completed all of his voicework, co-director Iwao Takamoto wrote that \"his readings just went flat, which surprised all of us.", "Tony's delivery was a bit too sophisticated and his singing was too operatic.", "He did not have enough of that raunchy feeling that the character required.\"", "Barbera felt Randall had to be replaced, and approached Paul Lynde, who was voicing characters in \"The Perils of Penelope Pitstop\" at the time, to do a reading." ], [ "Karey Kirkpatrick", "In 1997, Kirkpatrick teamed again with \"James and the Giant Peach\" executive producer Jake Eberts to write the screenplay for Aardman's \"Chicken Run\" from a story by Peter Lord and Nick Park.", "Kirkpatrick also wrote the screenplay adaptation of \"The Hitchhiker's Guide to the Galaxy\" for Touchstone Pictures and Spyglass Entertainment.", "Kirkpatrick has a longstanding relationship with DreamWorks Animation, where he has contributed as a writer or story consultant on \"The Road to El Dorado\" and \"Madagascar\".", "In May 2006, DreamWorks Animation released \"Over the Hedge\", for which Kirkpatrick co-wrote the screenplay and made his directorial debut, sharing directing credits with Tim Johnson.", "That same year, Kirkpatrick co-wrote the screenplay of the live-action adaptation of E.B. White's classic \"Charlotte's Web\" for Paramount Pictures/Walden Media/Nickelodeon Movies.", "The film starred Dakota Fanning and the voice talents of Julia Roberts, Robert Redford, Steve Buscemi, Oprah Winfrey, John Cleese and many others.", "He produced and co-wrote, with partner Chris Poche, the original comedy \"Flakes\", which completed filming in New Orleans in January 2005 and stars Zooey Deschanel, Christopher Lloyd and Aaron Stanford." ], [ "Charlotte's Web (1973 film)", "Charlotte's Web (1973 film)\n\nCharlotte's Web is a 1973 American animated musical drama film produced by Hanna-Barbera Productions and Sagittarius Productions and based upon the 1952 children's book \"Charlotte's Web\" by E. B. White.", "The film, like the book, is about a pig named Wilbur who befriends an intelligent spider named Charlotte who saves him from being slaughtered.", "Released to theaters by Paramount Pictures, \"Charlotte's Web\" features a song score of music and lyrics written by the Sherman Brothers, who had previously written music for family films like \"Mary Poppins\" (1964), \"The Jungle Book\" (1967), and \"Chitty Chitty Bang Bang\" (1968).", "It is the first of only three Hanna-Barbera features not to be based upon one of their famous television cartoons, \"Heidi's Song\" (1982) and \"Once Upon a Forest\" (1993) being the other two.", "\"Charlotte's Web\" was filmed in 1972 and released on February\u00a022, 1973, to moderate critical and commercial success.", "The film has developed a devoted following over the following years due to television and VHS; in 1994 it surprised the marketplace by becoming one of the best-selling titles of the year, 21\u00a0years after its first premiere." ] ], "gold": "Various movies have been adapted from E.B. White's 1952 children's book Charlotte's Web. Some of them are the 1973 American animated musical drama film which was followed by a sequel in 2003 and a comedy-drama film released in 2006. The character of Templeton appears in all of them, being voiced by Paul Lynde and Charlie Adler in the 1973 animated feature and its sequel respectively, and by Steve Buscemi in the 2006 version.", "prediction 1": "Charlotte's Web is a 1973 American animated musical drama film produced by Hanna-Barbera Productions and Sagittarius Productions and based upon the 1952 children's book Charlotte's Web by E. B. White. In January 1972, it was reported that Henry Gibson, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Wilbur, Charlotte, and Templeton. In May 2006, DreamWorks Animation released Over the Hedge, for which Kirkpatrick co-wrote the screenplay and made his directorial debut, sharing directing credits with Tim Johnson. In May 2005, he produced and co-wrote the screenplay of the live-action adaptation of E. B. B. White's classic Charlotte's Web for Paramount Pictures/Walden Media/Nickelodeon Movies. In June 22, 1973, it was released to moderate critical and commercial success.", "prediction 2": "Charlotte's Web is a 1973 American animated musical drama film produced by Hanna-Barbera Productions and Sagittarius Productions based upon the 1952 children's book Charlotte's Web by E. B. White. In January 1972, it was reported that Henry Gibson, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Wilbur, Charlotte, and Templeton. In April 1972, it was reported that Henry Gibson, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Wilbur, Charlotte, Templeton. In June 1972, it was reported that Henry Gibson, Debbie Reynolds, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Templeton. On March 24, 1973, it was reported that Henry Gibson, Debbie Reynolds, Debbie Reynolds, and Tony Randall had signed on to provide the voices of Templeton.", "prediction 3": "In the 1973 animated musical drama film Charlotte's Web, Templeton was voiced by Tony Randall. In the 1997 film, The Road to El Dorado, Randall's readings just went flat. In the 2008 film, Templeton was voiced by Paul Lynde. In the 2012 film, Templeton was voiced by Robert Downey Jr. and Gary Slater.", "prediction 4": "Charlotte's Web is a 1973 American animated musical drama film produced by Hanna-Barbera Productions and Sagittarius Productions and based upon the 1952 children's novel Charlotte's Web by E. B. White. In the 1972 film, Tony Randall did the voice of Templeton, while Henry Gibson did the voice of Wilbur in the 1973 film, and Debbie Reynolds did the voice of Charlotte.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 360, "end": 540 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4,5]}", "start": 541, "end": 553 }, { "error type": "Irrelevant", "explanation": "", "start": 554, "end": 596 }, { "error type": "Irrelevant", "explanation": "", "start": 668, "end": 802 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Charlotte's Web is a 1973 American animated musical drama film produced by Hanna-Barbera Productions and Sagittarius Productions and based upon the 1952 children's book Charlotte's Web by E. B. White. In January 1972, Tony Randall had signed on to provide the voices of Templeton, Paul Lynde was later approached to replace Randall. In 2006, the live-action adaptation of E. B. B. White's classic Charlotte's Web, starred Steve Buscemi." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Most total goals in a premier league season?", "passages": [ [ "Football in France", "Modern football was introduced nine years later in 1872 by English sailors playing in Le Havre in 1872.", "The top two divisions of French football, Ligue 1 and Ligue 2, are governed by the Ligue de Football Professionnel.", "The league is responsible for overseeing, organizing, and managing the top two leagues and is also responsible for the 46 professional football clubs that contest football in France (20 in Ligue 1, 20 in Ligue 2, and 6 in the Championnat National).", "Ligue 1 is the French professional league for football clubs.", "It is the country's primary football competition and serves as the top division of the French football league system.", "Contested by 20 clubs, it operates on a system of promotion and relegation with Ligue 2.", "Ligue 1 is one of the top national leagues, currently ranked fifth in Europe behind the English Premier League, Spanish La Liga, Italian Serie A, and the German Bundesliga.", "Ligue 1 was inaugurated on 11 September 1932 under the name \"National\" before switching to \"Division 1\" after a year of existence.", "The name lasted until 2002 before switching to its current name.", "The current champions of France are Paris Saint-Germain, who won their seventh title in 2018.", "Ligue 2 is the second division of French football.", "Contested by 20 clubs, it operates on a system of promotion and relegation with the Championnat National." ], [ "2017\u201318 Manchester City F.C. season", "2017\u201318 Manchester City F.C. season\n\nThe 2017\u201318 season was Manchester City's 116th season of competitive football, 89th season in the top division of English football and 21st season in the Premier League since the league was first created.", "In addition to the Premier League, the club also competed in the FA Cup, EFL Cup and UEFA Champions League.", "City won their third Premier League title on 15 April 2018 following West Bromwich Albion's 1\u20130 win away to second place Manchester United, and the EFL Cup with a 3\u20130 win over Arsenal.", "The team set a number of Premier League records during the season, including: most points (100), most away points (50), most points ahead of second (19), most wins (32), most away wins (16), most goals (106), best goal difference (+79) and most consecutive victories (18).", "The team also equalled the record for the earliest Premier League title win (5 games to spare), beating of every other team in the league throughout the season and recording the most consecutive away wins (11).", "An Amazon Original docuseries of the season titled \"\" was released on Amazon Video on 17 August 2018." ], [ "1993\u201394 in English football", "Wigan Athletic's first season at this level for over a decade brought their lowest ever finish of 19th place (89th out of the league's 92 clubs).", "Leading goalscorer: Tony Ellis (Preston North End) - 26\n\nFor subsequent transfer deals see 1994\u201395 in English football.", "Eric Cantona received the PFA Players' Player of the Year award after his 25 goals in all competitions were the key force in Manchester United's double glory.", "Alan Shearer was voted FWA Footballer of the Year after returning from injury to score 31 Premier League goals for runners-up Blackburn Rovers.", "Andy Cole was voted PFA Young Player of the Year after finishing top scorer in the Premier League with 34 goals for newly promoted Newcastle United, who finished third and qualified for Europe for the first time since the 1970s.", "Cole's veteran partner Peter Beardsley scored 24 goals in all competitions in his first season back on Tyneside.", "Dean Saunders was again a consistent goalscorer for Aston Villa, who dipped to 10th in the league a year after finishing runners-up, but booked themselves another UEFA Cup campaign thanks to glory in the League Cup.", "21-year-old striker Chris Sutton attracted huge attention from England's top clubs before his record-breaking transfer from Norwich City to Blackburn Rovers." ] ], "gold": "The Premier League is an English professional league for association football clubs. At the top of the English football league system, it is the country's primary football competition and is contested by 20 clubs. The most goals scored in a premier league season is 106, in 2017-18 by Manchester City. The most total goals in a premier league season by a player is 34, accomplished both by Andy Cole, from Newcastle United, in 1993\u201394, and Alan Shearer, from Blackburn Rovers, in 1994\u201395.", "prediction 1": "The most total goals in a Premier League season for a club in 2018 was 106. In the previous season Manchester United scored a total of 109 goals. Manchester City scored 106 goals in the previous season.", "prediction 2": "In the English Premier League, the most total goals in a season was 106, and in the French Premier League, the most total goals were 105, and the most goals conceded were 102. At the end of the season, the most goals scored were 102.", "prediction 3": "The most total goals in a Premier League season is 106, in the 2018/19 season it was 106, in the 1993\u201394 season it was 89, and in the 1990\u201391 season it was 115, and in the 1999\u20132000 season it was 115. In the 2014\u201315 season it was 107, and in the 2015\u201316 season it was 108, and in the 2018\u201319 season it was 106.", "prediction 4": "The most total goals in a Premier League season during the 2016-17 season was 105, scored by Manchester United and Arsenal. The most goals scored in a Premier League season during the 2017-18 season was 106, scored by Manchester City. The most total goals scored in a Premier League season during the 2013-14 season was 106, scored by Cardiff City, and scored by Manchester United.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 76, "end": 145 }, { "error type": "Redundant", "explanation": "The most total goals in a Premier League season for a club in 2018 was 106. ", "start": 162, "end": 202 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The most total goals in a Premier League season for a club was set in 2017-2018 when Manchester City scored 106 goals. In 1993-94 Andy Cole was top scorer in the Premier League with 34 goals for Newcastle United." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "What type of government does thailand have today?", "passages": [ [ "Government of Thailand", "Government of Thailand\n\nThe Government of Thailand, or formally the Royal Thai Government (RTG) (; ), is the unitary government of the Kingdom of Thailand.", "The country emerged as a modern nation state after the foundation of the Chakri Dynasty and the city of Bangkok in 1782.", "The Revolution of 1932 brought an end to absolute monarchy and replaced it with a constitutional monarchy.", "From then on the country was ruled by a succession of military leaders installed after coups d\u2019etat, the most recent in May 2014, and a few democratic intervals.", "The 2007 Constitution (drafted by a military-appointed council, but approved by a referendum) was annulled by the 2014 coup-makers who run the country as a military dictatorship.", "Thailand has so far had seventeen Constitutions.", "Throughout, the basic structure of government has remained the same.", "The government of Thailand is composed of three branches: the executive, the legislative, and the judiciary.", "The system of government is modelled after the Westminster system.", "All branches of government are concentrated in Bangkok, the capital city of Thailand.", "Since May 2014 Thailand has been ruled by a military junta, the National Council for Peace and Order, which has partially repealed the 2007 constitution, declared martial law and nationwide curfew, banned political gatherings, arrested and detained politicians and anti-coup activists, imposed internet censorship and taken control of the media." ] ], "gold": "The government of Thailand has officially been a constitutional monarchy ever since the Revolution of 1932 brought an end to the country's historical absolute monarchy. In practice, however, Thailand is ruled by a succession of military leaders installed after coups d'\u00e9tat. The current military junta was established in May 2014.", "prediction 1": "Thailand has had different types of government over the years. The Revolution of 1932 brought an end to absolute monarchy and replaced it with a constitutional monarchy. The country emerged as a modern nation state after the foundation of the Chakri Dynasty and the city of Bangkok in 1782. Throughout the years the country has had different types of government.", "prediction 2": "The Government of Thailand, or formally the Royal Thai Government, is the unitary government of the Kingdom of Thailand. The country emerged as a modern nation state after the foundation of the Chakri Dynasty and the city of Bangkok in 1782. The Revolution of 1932 brought an end to absolute monarchy and replaced it with a constitutional monarchy. From then on the country was ruled by a succession of military leaders installed after coups d\u2019etat, the most recent in May 2014, and a few democratic intervals.", "prediction 3": "The Government of Thailand, or formally the Royal Thai Government (RTG), is the unitary government of the Kingdom of Thailand. Prior to the Revolution of 1932, Thailand had an absolute monarchy. The country was ruled from then on by a succession of military leaders installed after coups d\u2019etat, the most recent in May 2014, and a few democratic intervals. Since then, the country has been ruled by a military junta, the National Council for Peace and Order, which has partially repealed the 2007 constitution.", "prediction 4": "Thailand emerged as a modern nation state after the foundation of the Chakri Dynasty and the city of Bangkok in 1782. The Revolution of 1932 brought an end to absolute monarchy and replaced it with a constitutional monarchy. From then on the country was ruled by a succession of military leaders installed after coup d\u2019etat, the most recent in May 2014, and a few democratic intervals. The 2007 Constitution was annulled by the 2014 coup-makers who run the country as a military dictatorship.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 362 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 62 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Revolution of 1932 brought an end to absolute monarchy and replaced it with a constitutional monarchy. From then on the country was ruled by a succession of military leaders installed after coups d\u2019etat. Since May 2014 Thailand has been ruled by a military junta." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What year was fiddler on the roof made?", "passages": [ [ "Fiddler on the Roof (film)", "Fiddler on the Roof (film)\n\nFiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison.", "It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem.", "Starring Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann, the film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "He must cope both with the strong-willed actions of his three older daughters, who wish to marry for love \u2013 each one's choice of a husband moves further away from the customs of his faith \u2013 and with the edict of the Tsar who evicts the Jews from the town of Anatevka.", "Throughout the film, Tevye talks to God and directly to the audience, breaking the fourth wall.", "In these monologues, Tevye ponders tradition, the difficulties of being poor, the Jewish community's constant fear of harassment from their non-Jewish neighbors, and important family decisions." ], [ "Fiddler on the Roof", "The original Broadway cast of the musical \"Avenue Q\" and the Broadway 2004 revival cast of \"Fiddler on the Roof\" collaborated for a Broadway Cares/Equity Fights AIDS benefit and produced an approximately 10-minute-long show, \"Avenue Jew\", that incorporated characters from both shows, including puppets.", "Songs from the musical have been covered by notable artists.", "For example, in 1964, jazz saxophonist Cannonball Adderley recorded the album \"Fiddler on the Roof\", which featured jazz arrangements of eight songs from the musical.", "\"AllMusic\" awarded the album 4 stars and states \"Cannonball plays near his peak; this is certainly the finest album by this particular sextet\".", "That same year, Eydie Gorm\u00e9 released a single of \"Matchmaker\".", "In 1999, Knitting Factory Records released \"Knitting on the Roof\", a compilation CD featuring covers of \"Fiddler\" songs by alternative bands such as The Residents, Negativland, and The Magnetic Fields.", "Indie rock band Bright Eyes recorded an adaptation of \"Sunrise, Sunset\" on their 2000 album \"Fevers and Mirrors\".", "\"Allmusic\" gave the album a favorable review, and the online music magazine \"Pitchfork Media\" ranked it at number 170 on their list of top 200 albums of the 2000s." ], [ "Neva Small", "Neva Small\n\nNeva Small (born November 17, 1952) is an American theatrical, film, and television actress and singer.", "She made her singing debut at the age of 10 at the New York City Opera, and her Broadway debut the following year.", "She has numerous acting credits on and Off-Broadway.", "She is best known for her portrayal of Chava, the third of Tevye's five daughters who marries a gentile, in the 1971 film \"Fiddler on the Roof\".", "Neva Small was born in New York City to Seldan and Berma Small.", "She grew up in Central Park West.", "Her mother graduated in the first class of harpists at Juilliard in 1938, and played in an all-female orchestra at the Waldorf Astoria.", "Small began singing in an extracurricular after-school program, and acted in Hebrew school and in the Jewish Theater for Children, where she was an understudy for Don Scardino.", "At age 10, she played Beverly Sills' daughter in \"The Ballad of Baby Doe\" (1963) at the New York City Opera.", "She studied at the LaGuardia High School of Music & Art and Performing Arts.", "She was accepted at the Juilliard drama school, but deferred her admission for a year in order to act in the 1971 film \"Fiddler on the Roof\"." ] ], "gold": "There are several Fiddler on the Roofs. Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It was theatrically released on November 3, 1971, by United Artists to critical and commercial success.It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. Cannonball Adderley's Fiddler on the Roof is an album by jazz saxophonist Cannonball Adderley released on the Capitol label featuring performances of material from the Broadway musical Fiddler on the Roof by Adderley with Nat Adderley, Charles Lloyd, Joe Zawinul, Sam Jones and Louis Hayes. It was released in 1964.", "prediction 1": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. The original Broadway cast of the musical Avenue Q and the Broadway 2004 revival cast of Fiddler on the Roof collaborated for a Broadway Cares/Equity Fights AIDS benefit and produced an approximately 10-minute-long show, Avenue Jew, that incorporated characters from both shows, including puppets.", "prediction 2": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. The original Broadway cast of the musical Avenue Q and the Broadway 2004 revival cast of Fiddler on the Roof collaborated for a Broadway Cares/Equity Fights AIDS benefit and produced an approximately 10-minute-long show, Avenue Jew that incorporated characters from both shows, including puppets.", "prediction 3": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. The original Broadway cast of the musical Avenue Q and the Broadway 2004 revival cast of Fiddler on the Roof collaborated for a Broadway Cares/Equity Fights AIDS benefit and produced an approximately 10-minute-long show, that incorporated characters from both shows, including puppets.", "prediction 4": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison, an adaptation of the 1964 Broadway musical of the same name. The film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives. The original Broadway cast of the musical Avenue Q and the Broadway 2004 revival cast of Fiddler on the Roof collaborated for a Broadway Cares/Equity Fights AIDS benefit and produced an approximately 10-minute-long show, that incorporated characters from both shows, including puppets.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 604 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. There was a Broadway 2004 revival of Fiddler on the Roof. In 1964, jazz saxophonist Cannonball Adderley recorded the album \"Fiddler on the Roof\", which featured jazz arrangements of eight songs from the musical." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When's the next steven universe episode coming out?", "passages": [ [ "Steven Universe", "Steven Universe\n\nSteven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network.", "It is the coming-of-age story of a young boy, Steven Universe (voiced by Zach Callison), who lives with the Crystal Gems\u2014magical, humanoid aliens named Pearl (Deedee Magno Hall), Garnet (Estelle), and Amethyst (Michaela Dietz)\u2014in the fictional town of Beach City.", "Steven, who is half-Gem, has adventures with his friends and helps the Gems protect the world from their own kind.", "\"Steven Universe\" premiered on November 4, 2013, and is Cartoon Network's first animated show solely created by a woman.", "The themes of the series include love, family, and the importance of healthy interpersonal relationships.", "Books, comics and video games based on the series have been released, and a film is in development.", "Sugar based the lead character on her younger brother Steven, who is an artist for the series.", "She developed \"Steven Universe\" while she was a writer and storyboard artist on \"Adventure Time\", which she left when Cartoon Network commissioned her series for full production.", "The series is storyboard-driven; when episodes are being produced the show's storyboard artists are responsible for writing the dialogue and blocking out the action." ], [ "Steven Universe", "An example is \"Here Comes a Thought\", sung by Estelle and AJ Michalka (who voices Stevonnie).", "The two were less inspired by a specific musical style, but rather by the song's \"feel\", which Sugar had explained to them.", "The pilot episode of \"Steven Universe\" was released on Cartoon Network's video platform on May 21, 2013, and an edited version was released on July 20.", "The pilot was shown at the 2013 San Diego Comic-Con, and Sugar hosted a 30-minute panel discussion about the series at the 2013 New York Comic Con on October 13.", "On November 14, thirteen additional episodes were ordered for the first season.", "The series was renewed for a second season on July 25, 2014, which began airing on March 13, 2015.", "It was renewed in July 2015 for a third season, and in March 2016 the second and third seasons were split in two, making a total of five seasons.", "The series premiered in the United States on November 4, 2013, on Cartoon Network with two episodes.", "In Canada, it began airing on Cartoon Network on November 11, 2013, and on Teletoon on April 24, 2014.", "It began airing on Cartoon Network channels in Australia on February 3, 2014, and in the United Kingdom and Ireland on May 12 of that year." ], [ "I Love Lucy", "Nearly a year later, on December 7, 2014, the Christmas special was again aired on CBS, but this time paired with the popular episode \"Job Switching,\" which was newly colorized for that broadcast.", "That episode appeared on the \"I Love Lucy: The Ultimate Season 2\" Blu-ray edition on August 4, 2015.", "CBS aired the Christmas special again on December 23, 2015, with the flashback scenes being colorized for the first time, and with a colorized \"Lucy Does a TV Commercial\" replacing \"Job Switching\".", "It is currently unknown if these will also be added to a new DVD.", "CBS next aired the Christmas special on December 2, 2016.", "This time the Christmas episode was paired with the newly colorized \"Lucy Gets in Pictures\".", "On December 22, 2017, the Christmas episode was aired again, followed by a newly-colorized episode, \"The Fashion Show\".", "On December 14, 2018, the Christmas episode was re-aired, paired with a newly-colorized episode, \"Pioneer Women\"\n\nOn May 17, 2015, CBS began a new springtime tradition when it aired two newly colorized episodes in an \"I Love Lucy Superstar Special.\"", "The special consisted of \"L.A. at Last\" and \"Lucy and Superman\" and attracted 6.4 million viewers.", "A DVD of this special was released on October 4, 2016." ] ], "gold": "Steven Universe is an American animated Cartoon Network television series created by Rebecca Sugar, and is the networks first animated series to be created solely by a woman. The pilot was first shown in May 2013, and the show ran for five seasons, from November 2013 until January 2019. Episode 136 came out on TV on December 22, 2017 and on the Cartoon Network app and website on November 10, 2017. Episodes 137 and 138 came out on TV on December 29, 2017 and came out on the app and the website on November 10, 2017.", "prediction 1": "Steven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network. It is the coming-of-age story of a young boy, Steven Universe, who lives with the Crystal Gems\u2014magical, humanoid aliens named Pearl, Garnet, and Amethyst in the fictional town of Beach City. Episode 008 came out on Cartoon Network's video platform on May 21, 2013, and an edited version came out on July 20. Episode 009 came out on Cartoon Network's video platform on July 20, 2014.", "prediction 2": "Steven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network. Episodes 1-3 of the series came out on a variety of dates, with the latest coming out on March 4, 2019. The series' final episode was released on Cartoon Network's video platform on May 21, 2013. The next episode came out on Cartoon Network's video platform on August 29, 2019.", "prediction 3": "Steven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network. The series is the coming-of-age story of a young boy, Steven Universe, who lives with the Crystal Gems\u2014magical, humanoid aliens named Pearl, Garnet, and Amethyst. The pilot episode of the series was released on Cartoon Network's video platform on May 21, 2013, and an edited version was released on July 20. On December 14, 2018, the Christmas episode was re-aired, paired with a newly colorized episode, The Fashion Show. The episode was re-aired again on December 14, 2018, the Christmas special was paired with the newly colorized episode, \"Job Switching\", which was paired with the episode, Job Switching.", "prediction 4": "Steven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network. Episodes of the series were first released in the United States on November 4, 2013, and were released on Cartoon Network's video platform on May 21, 2013. Episodes of the series were released in the United Kingdom and Ireland on May 12, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 294 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 352, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 373, "end": 411 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 412, "end": 423 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Steven Universe is an American animated television series created by Rebecca Sugar for Cartoon Network, it is the network's first animated show solely created by a woman. The pilot episode was released on May 21, 2013. There were a total of five seasons." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Maddie from suite life of zack and cody full name?", "passages": [ [ "The Suite Life of Zack & Cody", "Reruns of the show aired on Disney Channel until April 14, 2017.", "\"The Suite Life\" spawned a sequel series, also starring the Sprouse twins in their respective roles as Zack and Cody, called \"The Suite Life on Deck\", which aired on the Disney Channel from 2008 to 2011.", "A TV movie based on both series, \"The Suite Life Movie\", premiered on Disney Channel on March 25, 2011.", "The show centers upon Zack and Cody Martin, twin brothers who live in the Tipton Hotel (parody of the Hilton Hotel) in Boston, where their mother, Carey, sings and performs in the hotel lounge.", "However, it also centers upon the hotel owner's teenage daughter, London Tipton (A parody of Paris Hilton), who is very wealthy and ditzy, the hotel's down-to-earth candy-counter girl, Maddie Fitzpatrick, and Mr. Moseby, the strict, dutiful, and serious manager, who is often the foil to Zack and Cody's schemes and has a liking to the piano, pocket hankies and ballet.", "The show is often set at the Tipton Hotel, but has other settings such as Zack and Cody's school, Cheevers High, and Maddie and London's private school, Our Lady of Perpetual Sorrow Catholic." ], [ "The Suite Life of Zack & Cody", "The Suite Life of Zack & Cody\n\nThe Suite Life of Zack & Cody is an American sitcom created by Danny Kallis and Jim Geoghan.", "The series aired on Disney Channel from March 18, 2005, to September 1, 2008 with 4 million viewers, making it the most successful premiere for Disney Channel.", "The series was nominated for an Emmy Award three times and was nominated for a Nickelodeon Kids' Choice Award three times.", "The show was also a long-standing staple of the now defunct ABC Kids Saturday morning block on ABC.", "The series is set in the Tipton Hotel in Boston and centers on Zack Martin and Cody Martin (Dylan and Cole Sprouse), troublesome twins who live at the Tipton Hotel.", "The series' other main characters include the Tipton hotel's ditzy heiress London Tipton (Brenda Song), the hotel's candy counter girl Maddie Fitzpatrick (Ashley Tisdale), the manager, Mr. Marion Moseby (Phill Lewis), and the boys' single mother who is also the Hotel's lounge singer, Carey Martin (Kim Rhodes).", "The series is the third Disney Channel Original to have more than 65 episodes, after \"That's So Raven\" and \"Kim Possible\".", "Reruns aired on Disney XD and on the Watch Disney XD app." ], [ "Ashley Tisdale", "Ashley Tisdale\n\nAshley Michelle Tisdale (born July 2, 1985) is an American actress, singer, and film producer.", "During her childhood, Tisdale was featured in over 100 advertisements and had minor roles in television and theatre.", "She achieved mainstream success as Maddie Fitzpatrick in the Disney Channel series \"The Suite Life of Zack & Cody\".", "This success was heightened when she starred as Sharpay Evans in the \"High School Musical\" franchise.", "The film series proved to be a huge success for Disney and earned a large following.", "The success of the films led to Tisdale signing with Warner Bros. Records, releasing her debut album, \"Headstrong\" (2007), through the label.", "The album was a commercial success, earning a gold certification from the Recording Industry Association of America (RIAA).", "She starred as Candace Flynn in the animated series \"Phineas & Ferb\" from 2007 to 2015.", "Tisdale's second studio album, \"Guilty Pleasure\" (2009), was released to less commercial success than its predecessor.", "Tisdale would part ways with Warner Bros. Records following the release of the album.", "During this time, Tisdale began appearing in more films and returned to television with shows such as \"Hellcats\" (2010)." ] ], "gold": "Maddie Fitzpatrick is a character from Disney Channel's teen sitcom \"The Suite Life of Zack & Cody\", played by actress Ashley Michelle Tisdale. Maddie is London's closest friend and the candy-counter girl at the Tipton Hotel, although she holds several other jobs throughout the series. During the episode \"Pilot Your Own Life\", it is revealed that her full name is Madeline Margaret Genevieve Miranda Catherine Fitzpatrick.", "prediction 1": "The Suite Life of Zack & Cody is an American sitcom created by Danny Kallis and Jim Geoghan. The show centers upon Zack and Cody Martin, troublesome twin brothers who live in the Tipton Hotel in Boston, where their mother, Carey, sings and performs in the hotel lounge. However, it also centers upon the hotel owner's teenage daughter, London Tipton, who is very wealthy and ditzy, the hotel's down-to-earth candy-counter girl, Maddie Fitzpatrick, and Mr. Moseby, the strict, dutiful, who is often the foil to Zack and Cody and has a TV movie based on both series, called The Suite Life Movie.", "prediction 2": "The Suite Life of Zack & Cody is an American sitcom created by Danny Kallis and Jim Geoghan. The series aired on Disney Channel from March 18, 2005, to September 1, 2008 with 4 million viewers, making it the most successful premiere for Disney Channel. The show also centers upon the hotel owner's teenage daughter, London Tipton, who is very wealthy and ditzy, the hotel's down-to-earth candy counter girl, Maddie Fitzpatrick, played by actress Ashley Tisdale.", "prediction 3": "The Suite Life of Zack & Cody is an American sitcom created by Danny Kallis and Jim Geoghan that aired on Disney Channel from March 18, 2005, to September 1, 2008 with 4 million viewers, making it the most successful premiere for Disney Channel. American actress, singer, and film producer Ashley Tisdale plays the role of candy counter girl Maddie Fitzpatrick in the Disney Channel series The Suite Life of Zack & Cody.", "prediction 4": "In the American sitcom The Suite Life of Zack & Cody, the candy counter girl Maddie Fitzpatrick plays the role of Maddie Fitzpatrick. Ashley Tisdale played the role for six seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 448, "end": 593 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Suite Life of Zack & Cody is an American sitcom. The show centers upon the Tipton Hotel and down-to-earth candy-counter girl, Maddie Fitzpatrick, played by Ashley Michelle Tisdale." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When is the next series of the dumping ground?", "passages": [ [ "The Dumping Ground", "The Dumping Ground\n\nThe Dumping Ground (also informally referred to as TDG) is an award-winning British children's television drama series that focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013.", "The series is a spin-off to \"Tracy Beaker Returns\" and the first series, consisting of thirteen, thirty-minute episodes, was commissioned in early 2012.", "A second series, also with thirteen, thirty-minute episodes, was announced in 2013.", "The third and fourth series, announced in 2014 and 2015 respectively, both had an increase in episodes: twenty, thirty-minute episodes.", "In 2016, it was confirmed that two further series, with 24 episodes in each series, would be made.", "An eighth series was announced in 2018.", "The Dumping Ground was initially aimed at CBBC's target audience of 6 to 12-year-olds, but is also popular with older children and families, and is now aimed at their maturing fans, up to age 16.", "The Dumping Ground broadcast its 100th episode on 16 March 2018, which was the tenth episode of series six.", "The series revolves around the life of children in the Ashdene Ridge (previously Elm Tree House) care home; typically each episode follows one or more characters' life and includes subplots featuring other characters." ], [ "The Dumping Ground", "\"The Dumping Ground\" deals with issues related to the care system as well as social issues such as friendships, family, relationships, mental health, adolescence and LGBT parenting.", "Since its inception, \"The Dumping Ground\" has had four spin-offs.", "\"The Dumping Ground Survival Files\" aired for two series from 6 January to 12 December 2014.", "Webisode series \"Liam's Story\" aired from 17 January to 14 March 2014 and aired in a full episode on television on 23 March 2014.", "The series followed the character of Liam O'Donovan, played by Richard Wisker, after his life in care.", "In November 2015, a five-part miniseries aired, titled \"The Dumping Ground Dish Up\", that featured five former cast members - Joe Maw, Jessie Williams, Chris Slater, Jessica Revell and Saffron Coomber - in character and showing how to make different dishes.", "\"\", another webisode series where young people and staff describe living and working in care, aired for two series from 25 January 2016 to 9 February 2017.", "On 6 April 2018, a five-part mini webisode series was released called \"Sasha's Contact Meeting\", which followed Sasha with her social worker planning her pathway plan for when she leaves care.", "Amy-Leigh Hickman announced that \"The Dumping Ground\" had been commissioned in March 2012." ], [ "The Dumping Ground (series 4)", "The Dumping Ground (series 4)\n\nThe fourth series of the British children's television series \"The Dumping Ground\" began broadcasting on 29 January 2016 on CBBC and ended on 2 December 2016.", "The series follows the lives of the children living in the fictional children's care home of Ashdene Ridge, nicknamed by them \"The Dumping Ground\".", "It consists of twenty, thirty-minute episodes, airing in two halves in January and October 2016.", "It is the twelfth series in The Story of Tracy Beaker franchise.", "All of the main cast from the second half of the third series reprise their roles in the fourth series.", "Series 4 saw the departure of 3 cast members who'd been in the series since \"Tracy Beaker Returns\" began.", "Harry (Philip Graham Scott) departed in episode 12, but returns for a guest appearance in episode 19.", "Both Carmen (Amy-Leigh Hickman) and Tee (Mia McKenna-Bruce) departed in episode in 19.", "After a guest appearance in episode 5, Chloe (Hannah Moncur) became a regular character from episode 15.", "The Dumping Ground is inspected whilst Bailey meets a woman claiming to be his mother and forgives his father.", "Jody enters a street dance competition with Tee and Carmen, but it turns out she suffers from stage fright, caused by her past at home.", "However, Jody overcomes her fear." ] ], "gold": "The Dumping Ground, also informally referred to as the DG, is a British children's television drama series that focuses on the lives and experiences of young people who live in a care home with their care workers in care, broadcast on CBBC since 4 January 2013. Series 3 started on 16 January 2015, series 4 started on 29 January 2016, series 5 started on 20 January 2017 and series 9 started on 11 June 2021. The Dumping Ground Survival Files, a spinoff of the original The Dumping Ground, started on 6 January 2014.", "prediction 1": "The Dumping Ground is an award-winning British children's television drama series. The series focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013. The series begins broadcasting on 29 January 2016, consists of twenty, thirty-minute episodes, airing in two halves in January and October 2016, and ended on 2 December 2016.", "prediction 2": "The Dumping Ground is an award-winning British children's television drama series that focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013. The next four series of the dumping ground began broadcasting on 29 January 2016 and ended on 2 December 2016.", "prediction 3": "The Dumping Ground is an award-winning British children's television drama series that focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013. It began broadcasting on 29 January 2016 and ended on 2 December 2016. The fourth series of the British children's television series The Dumping Ground began broadcasting on 29 January 2016 and ended on 2 December 2016.", "prediction 4": "The Dumping Ground is an award-winning British children's television drama series that focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013. The series revolves around the life of children in the Ashdene Ridge (previously Elm Tree House) care home. Originally aimed at CBBC's target audience of 6 to 12-year-olds, but is also popular with older children and families, and is now aimed at their maturing fans, up to age 16. The fourth series of the British children's television series of the British children's television series began broadcasting on 29 January 2016 and ended on 2 December 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 38 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 223, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 393 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Dumping Ground is a British children's television drama series. The series focuses on the lives and experiences of young people and their care workers in care, broadcast on CBBC since 4 January 2013. The fourth series begins broadcasting on 29 January 2016. The Dumping Ground Survival Files, a spin off, aired for two series from 6 January to 12 December 2014. An eighth series was announced in 2018." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who was the original writer of stand by me?", "passages": [ [ "Stand By Me (Grey's Anatomy)", "Stand By Me (Grey's Anatomy)\n\n\"Stand By Me\" is the 18th episode of the fifth season of the American television medical drama, \"Grey's Anatomy\" and the show's 96th episode overall.", "Written by Zoanne Clack and directed by Jessica Yu, the episode was originally broadcast on the American Broadcasting Company (ABC) in the United States on March 26, 2009.", "The initial airing was viewed by 14.36 million Americans and garnered a 4.9/12 Nielsen rating/share in the 18\u201349 demographic.", "The episode garnered many positive reviews from critics.", "In the episode Izzie Stevens (Katherine Heigl) doesn't want to fight the brain tumor, despite Cristina Yang (Sandra Oh)'s efforts to help her.", "This starts affecting Cristina's surgery performance so she tells everyone and Izzie is admitted at the hospital as a patient.", "Mark Sloan (Eric Dane) has a big surgery going on a facial transplant and chooses Izzie and Lexie Grey (Chyler Leigh) to assist.", "Meredith Grey (Ellen Pompeo) and George O'Malley (T.R. Knight) look over the hospital with the interns creating chaos in the hospital due to a love fight." ], [ "Stand by Me (film)", "Stand by Me (film)\n\nStand by Me is a 1986 American coming-of-age film directed by Rob Reiner and starring Wil Wheaton, River Phoenix, Corey Feldman, and Jerry O'Connell.", "The film is based on Stephen King's 1982 novella \"The Body\".", "Its title is derived from Ben E. King's eponymous song, which plays over the ending credits.", "\"Stand by Me\" tells the fictional story of four boys in a small town in Oregon who go on a hike to find the dead body of another boy.", "The film was nominated for one Academy Award (for Best Adapted Screenplay) and two Golden Globe Awards (for Best Motion Picture-Drama and Best Director, respectively).", "Author Gordie Lachance reads in the newspaper that his childhood friend Chris Chambers has been killed.", "Gordie then narrates an extended flashback, later revealed to be a story he is writing.", "The flashback tells the story of a childhood incident when he, Chambers, and two buddies journeyed to find the body of a missing boy near the town of Castle Rock, Oregon.", "Twelve-year-old Gordie's parents, grieving the recent death of Gordie's older brother Denny, neglect Gordie." ], [ "Stand Up Before Me, Oh My Soul!", "Stand Up Before Me, Oh My Soul!", "Stand Up Before Me, Oh My Soul!", "is a studio album recorded and performed by Italian musician Fabio Orsi in 2009 and 2010 and released on January 18, 2011 by the Italian label Preservation.", "Preservation's press release for \"Stand Up Before Me, Oh My Soul!\" describes the record as a \"pursuit of pure dissonant bliss,\" where it has a combination of a bright, gorgeous tone and a harsh, dark feel.", "There are many ways in which the album deviates from his past works; it is a hazy-sounding punk rock album whose \"raw and primal pulse at [its] heart\" is very prevalent, its instrumentation consisting of very-heavily distorted electric guitars and bombastic drums performed by Rich Baker.", "\"Allmusic\" additionally categorized \"Stand Up Before Me, Oh My Soul!\" as a space rock and post-rock album.", "The tracks of \"Stand Up Before Me, Oh My Soul!\" vary in style, from the kraut-rock track \"Papa, Show Me Your Blues LPs\" to the electro-noise on \"My Awesome Drugs Propaganda.\"", "All of the songs on \"Stand Up Before Me, Oh My Soul!\" follow a controlled structure which involves a central drone building into biggers and then moving into silence." ], [ "Stand by Me (Ben E. King song)", "Stand by Me (Ben E. King song)\n\n\"Stand by Me\" is a song originally performed by American singer-songwriter Ben E. King and written by King, Jerry Leiber, and Mike Stoller.", "According to King, the title is derived from, and was inspired by, a spiritual written by Sam Cooke and J. W. Alexander called \"Stand by Me Father,\" recorded by the Soul Stirrers with Johnnie Taylor singing lead.", "The third line of the second verse of the former work derives from Psalm 46:2c/3c.", "There have been over 400 recorded versions of the song, performed by many artists.", "It was featured on the soundtrack of the 1986 film \"Stand by Me\", and a corresponding music video was released to promote the film.", "In 2012 it was estimated that the song's royalties had topped $US 22.8 million (\u00a317 million), making it the sixth highest-earning song as of that time.", "50% of the royalties were paid to King.", "In 2015 King's original version was inducted into the National Recording Registry by the Library of Congress, as \"culturally, historically, or aesthetically significant\", just under five weeks before his death.", "Later in the year, the 2015 line up of the Drifters recorded it, in tribute to him." ] ], "gold": "The 1961 song \"Stand by Me\" that was originally performed by American singer-songwriter Ben E. King was written by Ben E. King, Jerry Leiber and Mike Stoller. The 1986 American coming-of-age dramedy film \"Stand by Me\" that was directed by Rob Reiner and was based on a 1982 novel, The Body, was written by Stephen King. The 18th episode of the fifth season of the American television medical drama, Grey's Anatomy titled \"Stand by Me\" was written by Zoanne Clack and directed by Jessica Yu. The 2010 novel titled \"Stand by Me\" was written by Sheila O'Flanagan.", "prediction 1": "Stand by Me is a 1986 American musical comedy-drama film based on Stephen King's 1982 novella The Body. Stand by Me is a song originally performed by American singer-songwriter Ben E. King and written by King, Jerry Leiber, and Mike Stoller. Stand By Me is also the title of an episode of the fifth season of the American television medical drama, Grey's Anatomy.\n", "prediction 2": "Stand by Me is a 1986 American comedy-drama film adapted from Stephen King's 1982 novella The Body and starring Wil Wheaton, River Phoenix, Corey Feldman, Jerry O'Connell, and Aaron Sorkin. It also serves as the title for the song of the same name performed by American singer-songwriter Ben E. King.", "prediction 3": "Stand by Me is a 1986 American coming-of-age film directed by Rob Reiner and starring Wil Wheaton, River Phoenix, Corey Feldman, Jerry O'Connell, and Rian Johnson. Its title is derived from Ben E. King's eponymous song, which plays over the ending credits. Stand By Me is also a song originally performed by American singer-songwriter Ben E. King and written by King, Jerry Leiber, and Mike Stoller. The 1984 musical song \"Is\" is called \"Wayne,\" a verse of the first verse. In the \"Stand By Me\" is a short comedy drama television episode of the fifth season of the American television drama, Grey's Anatomy.", "prediction 4": "In the 1989 film Stand by Me, the title of the episode is \"Stand By Me\", and the episode was originally written by Zoanne Clack and directed by Jessica Yu. In 1986's Stand by Me, an American coming-of-age film based on Stephen King's 1982 novella The Body, the title of the song is \"Stand By Me\". In 2008's Stand by Me, a song written by King, Jerry Leiber, and Mike Stoller, and featured in a single from the 2015 song by Fabio Orsi in frontman. In 2010, the song \"Stand by Me, Oh My Soul!\" became a song that was directly inspired by King. In the 2008, there was retitled \"Stand by Me.\" In 2007, Beck with the song, \"Stand by Me!\" Written by Bill King.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 31, "end": 51 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Stand by Me is a 1986 American coming-of-age film, directed by Rob Reiner, based on Stephen King's 1982 novella The Body. Stand by Me is a song originally performed by American singer-songwriter Ben E. King and written by King, Jerry Leiber, and Mike Stoller. Stand By Me is also the title of an episode of the fifth season of the American television medical drama, Grey's Anatomy, written by Zoanne Clack and directed by Jessica Yu.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the chief executive of the state of florida?", "passages": [ [ "Government of Florida", "Government of Florida\n\nThe government of Florida is established and operated according to the Constitution of Florida and is composed of three branches of government: the executive branch consisting of the Governor of Florida and the other elected and appointed constitutional officers; the legislative branch, the Florida Legislature, consisting of the Senate and House; and the judicial branch consisting of the Supreme Court of Florida and lower courts.", "The state also allows direct participation of the electorate by initiative, referendum, and ratification.", "The executive branch of the government of Florida consists of the Governor, Lieutenant Governor, Florida Cabinet (which includes the Attorney General, Commissioner of Agriculture and Chief Financial Officer), and several executive departments.", "Each office term is limited for two four-year terms.", "The Governor of Florida is the chief executive of the government of Florida and the chief administrative officer of the state responsible for the planning and budgeting for the state, and serves as chair when the Governor and the Florida Cabinet sit as a decision-making body in various constitutional roles.", "The Governor has the power to execute Florida's laws and to call out the state militia to preserve the public peace, being Commander-in-Chief of the state's military forces that are not in active service of the United States." ], [ "Ron DeSantis", "Ron DeSantis\n\nRonald Dion DeSantis (born September 14, 1978) is an American politician who is the Governor-elect of Florida and is a former U.S. Representative for .", "After graduating from Yale University and Harvard Law School, DeSantis served as an officer and attorney in the Judge Advocate General's Corps, U.S. Navy (JAG).", "A Republican, he was first elected to the House of Representatives in 2012.", "DeSantis ran in Florida's 2016 U.S. Senate election, but ended his campaign when incumbent Senator Marco Rubio announced that he would seek re-election.", "DeSantis then opted to run for re-election to his U.S. House seat and was re-elected in November 2016.", "Described as a \"top Trump ally\", DeSantis drew increased attention in 2017 for his frequent criticisms of Special Counsel Robert Mueller's investigation into Russian interference in the 2016 election, urging Trump to shut down or significantly limit said investigation.", "On August 28, 2018, DeSantis won the Republican primary for Governor of Florida.", "On September 10, 2018, DeSantis resigned from his seat in the House of Representatives to focus on his gubernatorial campaign.", "DeSantis was officially certified as the winner on November 20, 2018, following a machine recount, defeating Democratic nominee and Mayor of Tallahassee Andrew Gillum." ], [ "Rick Scott", "Rick Scott\n\nRichard Lynn Scott (n\u00e9 Myers; born December 1, 1952) is an American businessman and politician, serving as the 45th and current Governor of Florida since 2011.", "He is the United States Senator-elect from Florida.", "Born in Bloomington, Illinois, Scott is a graduate of the University of Missouri, Kansas City, later receiving his law degree from Southern Methodist University's Dedman School of Law.", "In 1987, after serving in the United States Navy and becoming a law firm partner, he co-founded Columbia Hospital Corporation.", "Columbia later merged with another corporation to form Columbia/HCA, which eventually became the largest private for-profit health care company in the United States.", "Scott was pressured to resign as chief executive of Columbia/HCA in 1997.", "During his tenure as chief executive, the company defrauded Medicare, Medicaid and other federal programs.", "The Department of Justice ultimately fined the company in what was at the time the largest health care fraud settlement in U.S. history.", "Scott was never charged with any crime.", "Following his departure from Columbia/HCA, Scott became a venture capitalist and pursued other business interests.", "Scott ran for Governor of Florida in 2010.", "He defeated Bill McCollum in the vigorously contested Republican primary election, then narrowly defeated Democratic nominee Alex Sink in the general election, spending roughly $75 million of his own money in the process." ] ], "gold": "The governor of Florida is the chief executive position of the state of Florida. Ron DeSantis is currently the chief executive of the state of Florida as the 46th governor of Florida. He has been serving as the governor of Florida since 2019. DeSantis succeeded Rick Scott in this position. Scott served as the 45th governor of Florida from 2011 to 2019. Scott was preceded by Charlie Crist. Crist served as the 44th governor of Florida from 2007 to 2011. Prior to Crist, Jeb Bush served as the governor of Florida. Bush served as the 43rd Governor of Florida from 1999 to 2007. He is the son of former President George H.W. Bush and the brother of former President George W. Bush.", "prediction 1": "The Governor of Florida is the chief executive of the state of Florida. The current Governor is Rick Scott. Previously, the Governor-elect was Ron DeSantis, who served from 2017-2018. Rick Scott is the 45th and current Governor of Florida.", "prediction 2": "The Governor of Florida is the chief executive of the state of Florida since 2011. He is succeeded by Rick Scott, who serves as the 45th and current Governor of Florida since 2011.", "prediction 3": "The head of state of Florida is the Governor of Florida. The Governor is also the chief executive officer of the state of Florida and the chief administrative officer of the state responsible for the planning and budgeting for the state.", "prediction 4": "The governor of Florida is the chief executive of the state of Florida and the chief administrative officer of the state responsible for the planning and budgeting for the state. The current governor, Rick Scott, is the chief executive, with Ron DeSantis as the chief executive officer.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,9]}", "start": 96, "end": 107 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 143, "end": 156 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 173, "end": 183 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,9]}", "start": 207, "end": 218 } ], "missing-info": [], "corrected-prediction": "The Governor of Florida is the chief executive of the state of Florida. The current Governor-elect is Ron DeSantis. Previously, the Governor was Rick Scott, who served from 2011. Rick Scott is the 45th Governor of Florida. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "6. what are the three responsibilities of the federal reserve system?", "passages": [ [ "Federal Reserve", "Federal Reserve\n\nThe Federal Reserve System (also known as the Federal Reserve or simply the Fed) is the central banking system of the United States of America.", "It was created on December 23, 1913, with the enactment of the Federal Reserve Act, after a series of financial panics (particularly the panic of 1907) led to the desire for central control of the monetary system in order to alleviate financial crises.", "Over the years, events such as the Great Depression in the 1930s and the Great Recession during the 2000s have led to the expansion of the roles and responsibilities of the Federal Reserve System.", "The U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act: maximizing employment, stabilizing prices, and moderating long-term interest rates.", "The first two objectives are sometimes referred to as the Federal Reserve's dual mandate.", "Its duties have expanded over the years, and currently also include supervising and regulating banks, maintaining the stability of the financial system, and providing financial services to depository institutions, the U.S. government, and foreign official institutions.", "The Fed conducts research into the economy and provides numerous publications, such as the Beige Book and the FRED database.", "The Federal Reserve System is composed of several layers.", "It is governed by the presidentially appointed board of governors or Federal Reserve Board (FRB)." ] ], "gold": "The Federal Reserve is the central banking system of the United States of America. Created on December 23, 1913 in order to alleviate financial crises, it's role was later stipulated when the U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act. In terms of jobs, the Federal Reserve has the objective of maximizing employment, also being responsible for stabilizing prices in order to regulate how much things cost and moderating long-term interest rates. Nonetheless, its duties have expanded over the years, and currently also include supervising and regulating banks, maintaining the stability of the financial system, and providing financial services to depository institutions, the U.S. government, and foreign official institutions.", "prediction 1": "The Federal Reserve System is the central banking system of the United States of America. It was created on December 23, 1913, with the enactment of the Federal Reserve Act, after a series of financial panics led to the desire for central control of the monetary system in order to alleviate financial crises. The U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act: maximizing employment, stabilizing prices, and moderating long-term interest rates. The first two objectives are sometimes referred to as the Federal Reserve's dual mandate.", "prediction 2": "The Federal Reserve System (also known as the Federal Reserve or simply the Fed) is the central banking system of the United States of America. It was created on December 23, 1913, with the enactment of the Federal Reserve Act, after a series of financial panics (particularly the panic of 1907) led to the desire for central control of the monetary system in order to alleviate financial crises. Over the years, events such as the Great Depression in the 1930s and the Great Recession during the 2000s have led to the expansion of the roles and responsibilities of the Federal Reserve System.", "prediction 3": "The Federal Reserve System is the central banking system of the United States of America. It was created on December 23, 1913, with the enactment of the Federal Reserve Act. The U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act: maximizing employment, stabilizing prices, and moderating long-term interest rates. The first two objectives are sometimes referred to as the Federal Reserve's dual mandate.", "prediction 4": "The Federal Reserve System is the central banking system of the United States of America. The U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act: maximizing employment, stabilizing prices, and moderating long-term interest rates. The first two objectives are sometimes referred to as the Federal Reserve's dual mandate. The Federal Reserve's duties have expanded over the years, and currently also include supervising and regulating banks, maintaining the stability of the financial system, and providing financial services to depository institutions, the U.S.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 493, "end": 582 } ], "missing-info": [], "corrected-prediction": "The Federal Reserve System is the central banking system of the United States of America. It was created on December 23, 1913 in order to alleviate financial crises. The U.S. Congress established three key objectives for monetary policy in the Federal Reserve Act: maximizing employment, stabilizing prices, and moderating long-term interest rates. Its duties have expanded over the years, and currently also include supervising and regulating banks, maintaining the stability of the financial system, and providing financial services to depository institutions, the U.S. government, and foreign official institutions." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What was the result of the 100 year war?", "passages": [ [ "Hundred Years' War", "Hundred Years' War\n\nThe Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France.", "Each side drew many allies into the war.", "It was one of the most notable conflicts of the Middle Ages, in which five generations of kings from two rival dynasties fought for the throne of the largest kingdom in Western Europe.", "The war marked both the height of chivalry and its subsequent decline, and the development of strong national identities in both countries.", "Tensions between the crowns of France and England can be traced back to the origins of the English royal family itself, which was French (Norman, and later, Angevin) in origin.", "For this reason, English monarchs had historically held not only the English crown, but also titles and lands within France, the possession of which made them vassals to the kings of France.", "The status of the English king's French fiefs was a major source of conflict between the two monarchies throughout the Middle Ages.", "French monarchs systematically sought to check the growth of English power, stripping away lands as the opportunity arose, particularly whenever England was at war with Scotland, an ally of France." ], [ "Hundred Years' War", "He moved further and further south, worryingly close to Paris, until he found the crossing at Poissy.", "This had only been partially destroyed, so the carpenters within his army were able to fix it.", "He then continued on his way to Flanders until he reached the river Somme.", "The army crossed at a tidal ford at Blanchetaque, leaving Philip's army stranded.", "Edward, assisted by this head start, continued on his way to Flanders once more, until, finding himself unable to outmanoeuvre Philip, Edward positioned his forces for battle and Philip's army attacked.", "The Battle of Cr\u00e9cy was a complete disaster for the French, largely credited to the longbowmen and the French king, who allowed his army to attack before it was ready.", "Philip appealed to his Scottish allies to help with a diversionary attack on England.", "King David II of Scotland responded by invading northern England, but his army was defeated and he was captured at the Battle of Neville's Cross, on 17 October 1346.", "This greatly reduced the threat from Scotland.", "In France, Edward proceeded north unopposed and besieged the city of Calais on the English Channel, capturing it in 1347.", "This became an important strategic asset for the English, allowing them to safely keep troops in northern France." ], [ "Hundred Years' War", "Several overwhelming English victories in the war\u2014especially at Cr\u00e9cy, Poitiers, and Agincourt\u2014raised the prospects of an ultimate English triumph, and convinced the English to continue pouring money and manpower into the war over many decades.", "However, the greater resources of the French monarchy prevented the English kings from ever completing the conquest of France.", "Starting in 1429, decisive French victories at Orl\u00e9ans, Patay, Formigny, and Castillon concluded the war in favour of the House of Valois, with England permanently losing most of its possessions on the continent.", "Historians commonly divide the war into three phases separated by truces: the Edwardian War (1337\u20131360), the Caroline War (1369\u20131389), and the Lancastrian War (1415\u20131453).", "Local conflicts in neighbouring areas, which were contemporarily related to the war, including the War of the Breton Succession (1341\u20131365), the Castilian Civil War (1366\u20131369), the War of the Two Peters (1356\u20131369) in Aragon, and the 1383\u201385 crisis in Portugal, were availed by the parties to advance their agendas." ] ], "gold": "The Hundred Years' War was a series of conflicts between the kingdoms of England and France during the Late Middle Ages that originated from disputed claims to the French throne between the English royal House of Plantagenet and the French royal House of Valois. As the conflicts grew into a broader power struggle, strong national identities were developed in both countries as a result of a war that was transforming into the largest conflict in European history. England was decisively defeated at the Battle of Castillon in 1453, after which the nation lost most of its continental possessions, with only the Pale of Calais remaining under its control, and the House of Plantagenet was left severely weakened. The French victory resulted on the House of Valois retaining and strengthening the French Throne and the establishment of a succession to the Throne based on agnatic primogeniture.", "prediction 1": "The Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France. The English kings were convinced of an English triumph by a series of overwhelming victories during the war, especially at Cr\u00e9cy, Poitiers and Agincourt, which raised the prospects of an ultimate English triumph, and convinced the English to continue pouring money and manpower into the war over many decades. However, the greater resources of the French monarchy prevented the English kings from ever completing the conquest of France. The French victories at Orl\u00e9ans, Patay, Formigny, and Castillon concluded the war in favour of the House of Valois, with England permanently losing most of its possessions on the continent.", "prediction 2": "The Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France. It was one of the most notable conflicts of the Middle Ages in which five generations of kings from two rival dynasties fought for the throne of the largest kingdom in Western Europe. Starting in 1429, decisive French victories at Orl\u00e9ans, Patay, Formigny, and Castillon concluded the war in favour of the House of Valois, with England permanently losing most of its possessions on the continent. However, the greater resources of the French monarchy prevented the English kings from ever completing the conquest of France.", "prediction 3": "The Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France. Each side drew many allies into the war. The Hundred Years' War marked both the height of chivalry and its subsequent decline, and the development of strong national identities in both countries. The result of the war was that five generations of kings from two rival dynasties fought for the throne of the largest kingdom in Western Europe.", "prediction 4": "The Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France. Each side drew many allies into the war. The Hundred Years' War marked both the height of chivalry and its subsequent decline, and the development of strong national identities in both countries. The Hundred Years' War was one of the most notable conflicts of the Middle Ages, in which five generations of kings from two rival dynasties fought for the throne of the largest kingdom in Western Europe.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 527 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 654 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Hundred Years' War was a series of conflicts waged from 1337 to 1453 by the House of Plantagenet, rulers of the Kingdom of England, against the French House of Valois, over the right to rule the Kingdom of France. The war marked the development of strong national identities in both countries, in what was one of the most notable conflicts of the Middle Ages. The French victories at Orl\u00e9ans, Patay, Formigny, and Castillon concluded the war in favour of the House of Valois, with England permanently losing most of its possessions on the continent." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When did the \u00a320 note come out?", "passages": [ [ "Bank of England \u00a320 note", "These are broadly similar to the earlier series E notes but feature Edward Elgar on the reverse.", "The current \u00a320 note was introduced in 2007.", "It features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory.", "The note features a number of security features in addition to the metallic thread: these include raised print, a watermark, microlettering, a holographic strip, a see-through register, and a colourful pattern which only appears under ultraviolet light.", "In September 2015 the Bank of England announced that the next \u00a320 note will be printed on polymer, rather than cotton paper.", "This was followed by an announcement in April 2016 that Adam Smith will be replaced by artist J. M. W. Turner on the next \u00a320 note, which will enter circulation in 2020.", "Images on the reverse of the Turner note will include a c.1799 self-portrait of Turner, a version of Turner's \"The Fighting Temeraire\", the quote \"Light is therefore colour\" from an 1818 lecture by Turner, and a copy of Turner's signature as made on his will.", "Information taken from Bank of England website." ], [ "Bank of England \u00a320 note", "This declaration remains on Bank of England banknotes to this day.", "A printed signature of one of three cashiers appeared on the printed notes, though this was replaced by the signature of the Chief Cashier from 1870 onward.", "The right to redeem banknotes for gold ceased in 1931 when Britain stopped using the gold standard.", "The twenty pound note ceased to be produced by the Bank of England in 1943, and it was not until 1970 with the introduction of the series D notes that the denomination reappeared.", "The predominantly purple series D notes were two-sided, with an image of Queen Elizabeth II appearing on one side, accompanied by an image of Saint George and the Dragon (all subsequent Bank of England notes also feature an image of the Queen) and an image of William Shakespeare appearing on the other.", "This note also had a security feature in the form of a 'windowed' metal thread.", "The thread is woven into the paper so that it forms a dashed line, yet appears as a single line when held up to the light.", "Series D notes were phased out in favour of the newer series E notes beginning in 1991.", "These notes were multicoloured (predominantly mauve-purple) and featured an image of scientist Michael Faraday on the back.", "Series E notes were replaced by a variant design from 1999 onwards." ], [ "Bank of England note issues", "On 24 June 2013, Governor of the Bank of England Mark Carney announced that a newly designed \u00a310 banknote, featuring novelist Jane Austen, would be issued in 2017.", "The campaign for a woman to appear celebrated the choice as \"a brilliant day\".", "The date of issue was subsequently confirmed as 14 September 2017.", "Like the \u00a35 note featuring Churchill, the new \u00a310 note is made from polymer rather than cotton paper.", "It depicts:\n\n\n\u00a320 notes, in white, appeared in 1725 and continued to be issued until 1943.", "They ceased to be legal tender in 1945.", "After World War II, the \u00a320 denomination did not reappear until 1970, when the new Series D \u00a320 note, predominantly in purple and featuring a statue of William Shakespeare and the balcony scene from \"Romeo and Juliet\" on its reverse, was introduced on 9 July.", "On 5 June 1991 this note was replaced by the first Series E \u00a320 note, featuring the physicist Michael Faraday and the Royal Institution lectures.", "By 1999 this note had been extensively copied, and therefore it became the first denomination to be replaced on 22 June 1999 by a second Series E design, featuring a bolder denomination figure at the top left of the obverse side, and a reverse side featuring the composer Sir Edward Elgar and Worcester Cathedral." ] ], "gold": "The newest series of \u00a320 note, made of polymer and featuring an image of J.M.W. Turner, entered circulation on 20 February 2020. However, the most prevalent \u00a320 note currently in use is the series F note featuring a portrait of Adam Smith, which was introduced on 13 March 2007. The series F note replaced the series E note, which was first introduced on 5 June 1991 featuring an image of Michael Faraday, as well as the 22 June 1999 variant of the series E note, featuring an image of Edward Elgar.", "prediction 1": "The first \u00a320 note, in white, appeared in 1725. Then, on 9 July 1970, the new Series D \u00a320 note was introduced. Then, on 5 June 1991, the first Series E \u00a320 note was introduced. The current \u00a320 note was introduced in 2007. The note features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory.", "prediction 2": "The \u00a320 note first appeared in 1725 and continued to be issued until 1943. After World War II, the \u00a320 denomination did not reappear until 1970, when the new Series D \u00a320 note, predominantly in purple and featuring a statue of William Shakespeare and the balcony scene from Romeo and Juliet on its reverse, was introduced on 9 July. On 5 June 1991 this note was replaced by the first Series E \u00a320 note, featuring the physicist Michael Faraday and the Royal Institution lectures. The current \u00a320 note was introduced in 2007 and features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory.", "prediction 3": "The original \u00a320 note came out on 9 July 1725 and the current \u00a320 note was introduced on 6 April 2007. The note features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory. The current \u00a320 note was introduced on 6 April 2007 and on 9 September 2015, and on 5 June 1991, the first Series E \u00a320 note was introduced.", "prediction 4": "The \u00a320 note was originally introduced on 9 July 1725. The current \u00a320 note was introduced in 2007. The current \u00a320 note features a portrait of Scottish economist Adam Smith on the back as well as an illustration of workers in a pin factory. The next \u00a320 note will be printed on polymer, rather than cotton paper.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 352 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "The first \u00a320 note, in white, appeared in 1725. Then, on 9 July 1970, the new Series D \u00a320 note was introduced. Then, on 5 June 1991, the first Series E \u00a320 note was introduced, featuring Michael Faraday. 22 June 1999 a second Series E design was released with Edward Elgar on it. The current \u00a320 note was introduced in 2007. The note features a portrait of Adam Smith. The next \u00a320 note will be printed on polymer and features J. M. W. Turner, set to enter circulation in 2020. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sings don't get hooked on me?", "passages": [ [ "Baby, Don't Get Hooked on Me", "Baby, Don't Get Hooked on Me\n\n\"Baby Don't Get Hooked on Me\" is a hit song by country and pop singer-songwriter Mac Davis.", "From his breakthrough album of the same name, the song reached number one on both the \"Billboard\" Hot 100 and Easy Listening charts in September 1972, spending three weeks atop each chart.", "\"Billboard\" ranked it as the No. 8 song of 1972.", "He wrote the song when the record company demanded he write a tune with a \"hook\".", "The song was also a modest country hit concurrent with its pop success, reaching number 26 shortly after the peak of its pop success.", "The \"Nashville Edition\" provided backing vocals.", "The song was featured on an episode of The Muppet Show that Mac Davis was hosting." ] ], "gold": "The 1972 hit country song \"Baby Don't Get Hooked on Me\" was originally recorded by Mac Davis for his breakthrough album of the same name. Notable covers of the song include performances by Liza Minelli in 1973, Blaine Larson in 2006, and Rascal Flatts in 2009.", "prediction 1": "\"Baby Don't Get Hooked on Me\" is a hit song by country and pop singer-songwriter Mac Davis. From his breakthrough album of the same name, the song reached number one on both the \"Billboard\" Hot 100 and Easy Listening charts in September 1972, spending three weeks atop each chart. The \"Nashville Edition\" provided backing vocals.", "prediction 2": "\"Baby Don't Get Hooked On Me\" is a hit song by country and pop singer-songwriter Mac Davis. It reached number one on both the Billboard Hot 100 and Easy Listening charts in September 1972, spending three weeks atop each chart. The \"Nashville Edition\" provided backing vocals.", "prediction 3": "The Nashville Edition sang Don't Get Hooked On Me. It was written by Mac Davis and was a hit song by country and pop singer-songwriter.", "prediction 4": "\"Baby Don't Get Hooked on Me\" is a hit song by country and pop singer-songwriter Mac Davis. It reached number one on both the Billboard Hot 100 and Easy Listening charts in September 1972, spending three weeks atop each chart. The Nashville Edition provided backing vocals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 280 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 329 } ], "missing-info": [], "corrected-prediction": "\"Baby Don't Get Hooked on Me\" is a hit song by country and pop singer-songwriter Mac Davis for his breakthrough album of the same name. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who was patch married to on days of our lives?", "passages": [ [ "Steve Johnson (Days of Our Lives)", "Marina made it clear that she didn't want Steve back, she just needed his help getting a key that they'd thrown into the sea.", "Hoping for a quick divorce, he agreed to help her and went to Italy to get the key.", "While there, he had to fight off Kiriakis' henchmen when they tried to get the key from him.", "The fight left him with a broken glass eye.", "Meanwhile, in Salem, Kayla had had enough of Marina putting her husband and family in danger and the pair got in a fight.", "Later, Marina turned up dead and Kayla became a key suspect.", "To make things worse, Kiriakis kidnapped her in a bid to get the key.", "She was released when Isabella gave the key to Victor.", "The couple then rushed to get married before she gave birth and she was arrested for Marina's murder during the wedding.", "Kayla stood trial, thanks largely to doctored evidence that Kiriakis had sent to John Black.", "She was convicted and gave Steve their newborn daughter, Stephanie, to raise.", "He hired a nanny, Kelly Parker, who, unfortunately, turned out to be quite crazy and kidnapped the child when Kayla escaped from prison.", "Steve and Kayla went in pursuit of her, tracking her to Australia where they were lucky enough to find Bo and Hope who helped them track her down." ], [ "Steve Johnson and Kayla Brady", "Steve Johnson and Kayla Brady\n\nSteve \"Patch\" Earl Johnson and Dr. Kayla Caroline Brady are a supercouple on the American soap opera \"Days of Our Lives\".", "Steve is portrayed by Stephen Nichols and Kayla is portrayed by Mary Beth Evans.", "On the Internet message boards[5] the couple is often referred to by the portmanteau \"Stayla\" (for Steve and Kayla).", "The couple was initially popular from 1986 through 1990 until the \"death\" of Steve.", "Both characters have recently returned: after Steve being presumed dead for 16 years, Steve returned to the show on June 9, 2006; Kayla returned on June 12, 2006.", "Steve and Kayla were dropped off canvas in February 2009.", "Kayla returned in December 2011.", "In August 2015, Steve returned to Salem, and the couple reunited soon after\n\nSteve Johnson was a former Merchant Marine who came to Salem working as a mercenary.", "He had a vendetta against his former best friend, Bo Brady (Kayla's brother) who had gouged out his eye during a fight long ago.", "His bad boy image and criminal actions were no match for the beautiful good girl, Kayla Brady.", "One night, he rescued her from a street gang and left a note with his number on her car, and eventually, the two fell in love.", "Kayla pushed Steve away, but he was undeterred." ], [ "Days of Our Lives", "Days of Our Lives\n\nDays of Our Lives (also stylized as Days of our Lives; often abbreviated to DOOL or Days) is an American daytime soap opera broadcast on the NBC television network.", "It is one of the longest-running scripted television programs in the world, airing nearly every weekday since November 8, 1965.", "It has since been syndicated to many countries around the world.", "Until the network's closure in 2013, Soapnet rebroadcast episodes of \"Days\" on a same-day basis each weeknight at 8:00 and 10:00 (Eastern and Pacific Time).", "The series was created by husband-and-wife team Ted Corday and Betty Corday.", "Irna Phillips was a story editor for \"Days of Our Lives\" and many of the show's earliest storylines were written by William J. Bell.", "Due to the series' success, it was expanded from 30 minutes to 60 minutes on April 21, 1975.", "The series focuses on its core families, the Hortons and the Bradys.", "Several other families have been added to the cast, and many of them still appear on the show.", "Frances Reid, the matriarch of the series' Horton family remained with the show from its inception to her death on February 3, 2010." ] ], "gold": "Days of Our Lives is an American television daytime soap opera broadcast on NBC, and is one of the longest-running scripted television programs in the world, airing nearly every weekday since November 8, 1965. On the show Steve \"Patch\" Earl Johnson was married to Marina Toscano until 1989. Patch married his on and off love interest on the show, Dr. Kayla Caroline Brady, in 1990 until 2012. In August 2015, Steve returned to Salem, and the couple reunited soon after.", "prediction 1": "Days of Our Lives is an American daytime soap opera broadcast on the NBC television network. Steve Earl Johnson and Dr. Kayla Caroline Brady are a supercouple on the American soap opera. Steve is played by Stephen Nichols and Kayla is portrayed by Mary Beth Evans. Steve and Kayla were first married on the show in 1986, but their marriage was broken by the deaths of Marina Hortons and Victor Brady.", "prediction 2": "Steve Earl Johnson and Dr. Kayla Caroline Brady are a supercouple on the American daytime soap opera Days of Our Lives. They were married at the end of Season 5 episode 16 for the second time and again in Season 6 episode 7. Kayla's character in Season 7 episode 17 was Victor, the tycoon who killed Marina in Season 6 episode 7.", "prediction 3": "Steve Johnson and Kayla Caroline Brady are a supercouple on the American daytime soap opera Days of Our Lives. Patch Earl Johnson married Marina Hortons in the 1986 episode. However, the episode with Patch's wife, Dr. Kayla Brady, included a scene with Dr. Victor Hortons.", "prediction 4": "Steve Johnson and Dr. Kayla Caroline Brady are a supercouple on the American daytime soap opera Days of Our Lives. The couple was initially popular from 1986 through 1990 until the death of Steve. Steve was portrayed by Stephen Nichols and Kayla was portrayed by Mary Beth Evans. They were married on the show on January 20, 1991.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 265, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 264 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Days of Our Lives is an American daytime soap opera broadcast on the NBC television network. It is one of the longest-running scripted television programs in the world, airing nearly every weekday since November 8, 1965. Steve Earl Johnson and Dr. Kayla Caroline Brady are a supercouple on the American soap opera. In August 2015, Steve returned to Salem, and the couple reunited soon after." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was it discovered that asbestos was dangerous?", "passages": [ [ "Asbestosis", "The enquiry formally acknowledged the existence of asbestosis, recognised that it was hazardous to health and concluded that it was irrefutably linked to the prolonged inhalation of asbestos dust.", "Having established the existence of asbestosis on a medical and judicial basis, the report resulted in the first Asbestos Industry Regulations being published in 1931, which came into effect on 1 March 1932.", "The first lawsuits against asbestos manufacturers occurred in 1929.", "Since then, many lawsuits have been filed against asbestos manufacturers and employers, for neglecting to implement safety measures after the link between asbestos, asbestosis and mesothelioma became known (some reports seem to place this as early as 1898 in modern times).", "The liability resulting from the sheer number of lawsuits and people affected has reached billions of dollars.", "The amounts and method of allocating compensation have been the source of many court cases, and government attempts at resolution of existing and future cases.", "To date, about 100 companies have declared bankruptcy at least partially due to asbestos-related liability.", "In accordance with Chapter 11 and \u00a7 524(g) of the federal bankruptcy code, a company may transfer its liabilities and certain assets to an asbestos personal injury trust, which is then responsible for compensating present and future claimants.", "Since 1988, 60 trusts have been established to pay claims with about $37 billion in total assets." ], [ "Asbestos", "The use of asbestos became increasingly widespread towards the end of the 19th century, when its diverse applications included fire retardant coatings, concrete, bricks, pipes and fireplace cement, heat, fire, and acid resistant gaskets, pipe insulation, ceiling insulation, fireproof drywall, flooring, roofing, lawn furniture, and drywall joint compound.", "In 2011 it was reported that over 50% of UK houses still contained asbestos, despite a ban on asbestos products some years earlier.", "In Japan, particularly after World War II, asbestos was used in the manufacture of ammonium sulfate for purposes of rice production, sprayed upon the ceilings, iron skeletons, and walls of railroad cars and buildings (during the 1960s), and used for energy efficiency reasons as well.", "Production of asbestos in Japan peaked in 1974 and went through ups and downs until about 1990, when production began to drop dramatically.", "In 1899, Montague Murray noted the negative health effects of asbestos.", "The first documented death related to asbestos was in 1906.", "In the early 1900s researchers began to notice a large number of early deaths and lung problems in asbestos-mining towns." ] ], "gold": "Some sources suggest reports that asbestos may be dangerous had been made as early as 1898. Montague Murray noted the negative health effects of asbestos in 1899. The first death that was documented as being related to asbestos occurred in 1906.", "prediction 1": "The first documented death related to asbestos was in 1906. In 1899, Montague Murray noted the negative health effects of asbestos. In 1931, the first Asbestos Industry Regulations were published.", "prediction 2": "The first documented death related to asbestos was in 1906. In 1899, Montague Murray noted the negative health effects of asbestos. In 1931, an enquiry formally acknowledged the existence of asbestosis, recognised that it was hazardous to health and concluded that it was irrefutably linked to the prolonged inhalation of asbestos dust.", "prediction 3": "The use of asbestos became increasingly widespread towards the end of the 19th century, when its diverse applications included fire retardant coatings, concrete, bricks, pipes and fireplace cement, heat, fire, and acid resistant gaskets, pipe insulation, ceiling insulation, fireproof drywall, flooring, roofing, lawn furniture, and drywall joint compound. In 1916, the Occupational Safety and Health Administration (OSHA) issued the first Asbestos Inhalation Control Act, which came into effect on 1 March 1932. In 1929, the first lawsuits against asbestos manufacturers and employers, for neglecting to implement safety measures after the link between asbestos, asbestosis and mesothelioma became known.", "prediction 4": "The first documented death related to asbestos was in 1906. In 1898, Montague Murray noted the negative health effects of asbestos. In 1907, the National Academy of Sciences published an enquiry that formally acknowledged the existence of asbestosis and recognised that it was hazardous to health. The report resulted in the first Asbestos Industry Regulations being published in 1931, which came into effect on 1 March 1932.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 196 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Some sources suggest reports that asbestos may be dangerous had been made as early as 1898. In 1899, Montague Murray noted the negative health effects of asbestos. The first documented death related to asbestos was in 1906. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When is the new season of the crown being released?", "passages": [ [ "The Crown (TV series)", "Despite confirming historical accuracy that Queen Elizabeth did condemn the Duke of Windsor following her informing of The Marburg Files; historians have stated that the episode's implication that the Duke was admonished from the Royal family upon publication is false and that the Duke remained in contact and his public appearances continued.", "Peggy Noonan of \"The Wall Street Journal\" highlighted the historical inaccuracy of the series, and argued for \"more truth in art and entertainment\".", "Gordonstoun School responded to its negative portrayal in series two, claiming that in fact that Prince Charles's personal feedback to the school had been overwhelmingly positive.", "Royal historian Hugo Vickers said that the same episode inaccurately depicted Philip\u2019s sister\u2019s death in a plane crash as having arisen from his own misbehaviour at Gordonstoun, stating \u201cIt is beyond me how serious film-makers would wish to turn such a dreadful tragedy into a series of invented scenes bearing no relation to the truth.\"", "The series's first two episodes were released theatrically in the United Kingdom on November 1, 2016.", "The first season was released worldwide in its entirety on November 4, 2016.", "The second season was released on December 8, 2017.", "The third season is expected to be released in 2019." ], [ "The Crown (TV series)", "Season 1 was released on DVD and Blu-ray in the United Kingdom on October 16, 2017 and released worldwide on November 7, 2017.", "Season 2 was released on DVD and Blu-ray in the United Kingdom on October 22, 2018 and was released worldwide on November 13, 2018.", "The review aggregator website Rotten Tomatoes reported 89% approval for the first season based on 64 reviews, with an average rating of 8.72/10.", "Its critical consensus reads, \"Powerful performances and lavish cinematography make \"The Crown\" a top-notch production worthy of its grand subject.\"", "On Metacritic, the series holds a score of 81 out of 100, based on 29 critics, indicating \"universal acclaim\".", "\"The Guardian\"s TV critic Lucy Mangan praised the series and wrote that \"Netflix can rest assured that its \u00a3100m gamble has paid off.", "This first series, about good old British phlegm from first to last, is the service's crowning achievement so far.\"", "Writing for \"The Daily Telegraph\", Ben Lawrence said, \"\"The Crown\" is a PR triumph for the Windsors, a compassionate piece of work that humanises them in a way that has never been seen before.", "It is a portrait of an extraordinary family, an intelligent comment on the effects of the constitution on their personal lives and a fascinating account of postwar Britain all rolled into one.\"" ], [ "The Crown (TV series)", "The Crown (TV series)\n\n", "The Crown is a historical drama web television series, created and principally written by Peter Morgan and produced by Left Bank Pictures and Sony Pictures Television for Netflix.", "The show is a biographical story about the reign of Queen Elizabeth II.", "The first season covers the period from her marriage to Philip, Duke of Edinburgh, in 1947 to the disintegration of her sister Princess Margaret's engagement to Group Captain Peter Townsend in 1955.", "The second season covers the period from the Suez Crisis in 1956 through the retirement of the Queen's third prime minister, Harold Macmillan, in 1963 to the birth of Prince Edward in 1964.", "The third season will continue from 1964, covering Harold Wilson's two periods as prime minister until 1976, while the fourth will include Margaret Thatcher's premiership and introduce Lady Diana Spencer.", "\"The Crown\" evolved out of Morgan's 2006 film \"The Queen\" and 2013 stage play \"The Audience\".", "The series is intended to last 60 episodes over six seasons, with 10 one-hour episodes per season, covering Elizabeth's life from her younger years to her reign, and with new actors being cast every two seasons.", "Claire Foy portrays the Queen in the first two seasons, alongside Matt Smith as Prince Philip, and Vanessa Kirby as Princess Margaret." ] ], "gold": "The streaming television series The Crown has several seasons. The Crown's fifth season will be released by Netflix in 2022. Season 4, 3, and 2 of the series were released, respectively, on November 15, 2020, November 17, 2019, and December 8, 2017. The series' first season was released on November 4, 2016.", "prediction 1": "The Crown is a historical drama web television series created and principally written by Peter Morgan and produced by Left Bank Pictures and Sony Pictures Television for Netflix. The series is a biographical story about the reign of Queen Elizabeth II. The first season was released theatrically in the United Kingdom on November 1, 2016. The second season was released worldwide in its entirety on November 4, 2016. The third season is expected to be released in 2019.", "prediction 2": "The Crown is a historical drama web television series, created and principally written by Peter Morgan and produced by Left Bank Pictures and Sony Pictures Television for Netflix. The series is a biographical story about the reign of Queen Elizabeth II. The first two episodes of the show were released theatrically in the United Kingdom on November 1, 2016. Season 1 was released on DVD and Blu-ray in the United Kingdom on October 16, 2017 and released worldwide in its entirety on November 7, 2017. Season 2 was released on DVD and Blu-ray in the United Kingdom on October 22, 2018 and was released worldwide on December 8, 2017. Season 3 was released worldwide on November 13, 2018. The season was released worldwide on December 8, 2017.", "prediction 3": "The Crown, a historical drama web television series, was created and principally written by Peter Morgan and produced by Left Bank Pictures and Sony Pictures Television for Netflix. Season 1 was released on DVD and Blu-ray in the United Kingdom on October 16, 2017 and released worldwide in its entirety on November 7, 2017. The second season was released on December 8, 2017. The third season is expected to be released in 2019.", "prediction 4": "The Crown is a historical drama web television series created and principally written by Peter Morgan and produced by Left Bank Pictures and Sony Pictures Television for Netflix. Season 1 was released on DVD and Blu-ray in the United Kingdom on October 16, 2017 and released worldwide on November 7, 2017. The second season was released on December 8, 2017. The third season is expected to be released in 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 252 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 339, "end": 356 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Crown is a historical drama web television series created and principally written for Netflix. The first season was released theatrically in the United Kingdom on November 1, 2016 and was released worldwide in its entirety on November 4, 2016. The second season was released on December 8, 2017. The third season is expected to be released in 2019. Season 1 was released on DVD and Blu-ray in the United Kingdom on October 16, 2017 and released worldwide on November 7, 2017. Season 2 was released on DVD and Blu-ray in the United Kingdom on October 22, 2018 and was released worldwide on November 13, 2018." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did the suite life on deck start?", "passages": [ [ "The Suite Life on Deck", "1 scripted series in tweens 9\u201314 in 2008, outpacing veteran series \"Hannah Montana\" and \"Wizards of Waverly Place\" in the ratings.", "On October 19, 2009, it was announced that the series had been renewed for a third season, which began production in January 2010 and debuted on July 2, 2010.", "The series is also 2009's top rated scripted series in the children and tween demographic (6\u201314).", "The series has been broadcast in more than 30 countries worldwide, and was shot at Hollywood Center Studios in Los Angeles (as was the original series).", "The series was taped in front of a live studio audience, though a laugh track is used for some scenes." ], [ "The Suite Life on Deck", "In the meantime, the Russo siblings enjoy a cruise of their own until Alex pulls a prank that causes Justin to turn blue.", "On September 20, 2010, Disney Channel announced that production had begun for a Disney Channel Original Movie based on \"The Suite Life of Zack & Cody\" and \"The Suite Life on Deck\".", "\"The Suite Life Movie\" premiered on the Disney Channel in the United States and Canada on March 25, 2011.", "In 2013, during an interview with \"Gawker\", Dylan Sprouse revealed he and his brother had pitched an idea to the Disney Channel about continuing the \"Suite Life\" series.", "The show would see Zack and Cody return to the Tipton Hotel in Boston to live with their mother, and would become mentors to a boy who lived with his father at the hotel.", "Disney rejected the idea initially, but contacted the twins a year later with an edited concept that retained the boy and his father storyline, but Zack and Cody would move to a Miami hotel instead, Selena Gomez would also star and the twins would not get producer credits like they had requested.", "The Sprouses rejected the concept, leaving the project abandoned.", "\"The Suite Life on Deck\" premiered in Australia and New Zealand October 6, 2008.", "It is broadcast on Disney Channel and on NZ MediaWorks TV3 and FOUR.", "The Canadian Family Channel debuted the series October 13, 2008." ], [ "The Suite Life on Deck", "The Suite Life on Deck\n\nThe Suite Life on Deck is an American sitcom that aired on Disney Channel from September 26, 2008 to May 6, 2011.", "It is a sequel/spin-off of the Disney Channel Original Series \"The Suite Life of Zack & Cody\".", "The series follows twin brothers Zack and Cody Martin and hotel heiress London Tipton in a new setting, the SS \"Tipton\", where they attend classes at \"Seven Seas High School\" and meet Bailey Pickett while Mr. Moseby manages the ship.", "The ship travels around the world to nations such as Italy, France, Greece, India, Sweden and the United Kingdom where the characters experience different cultures, adventures, and situations.", "The series' pilot aired in the UK on September 19, 2008, and in U.S. markets on September 26, 2008.", "The series premiere on the Disney Channel in the U.S. drew 5.7 million viewers, and it became the most watched series premiere in Canada on the Family Channel.", "The show was also TV's No. 1 series in Kids 6\u201311 and No." ] ], "gold": "The Suite Life on Deck is an American teen television sitcom. The series pilot aired in the UK on September 19, 2008, and in the US markets on September 26, 2008. It premiered in Australia and New Zealand on October 6, 2008. In Canada, it became the most watched series premiere on the Family Channel.", "prediction 1": "The Suite Life on Deck is an American sitcom that aired on Disney Channel from September 26, 2008 until May 6, 2011. The series follows twin brothers Zack and Cody Martin and hotel heiress London Tipton in a new setting, the SS Tipton, where they attend classes at Seven Seas High School and meet Bailey Pickett while Mr. Moseby manages the ship. The series was also TV's No. 1 series in Kids 6\u201311 and No. 2 series in Teens 9\u201314 in 2008.", "prediction 2": "The Suite Life on Deck is an American sitcom that aired on Disney Channel from September 26, 2008 to May 6, 2011. It is a sequel/spin-off of the Disney Channel Original Series The Suite Life of Zack & Cody.", "prediction 3": "There are multiple seasons to the American sitcom The Suite Life on Deck. The first is the Australian version that aired on the Disney Channel from September 26, 2008, and the second is the Canadian adaptation that aired on the Disney Channel from September 26, 2008, to May 6, 2011.", "prediction 4": "The Suite Life on Deck is an American sitcom that aired on Disney Channel from September 26, 2008 to May 6, 2011. The series follows twin brothers Zack and Cody Martin and hotel heiress London Tipton in a new setting, the SS Tipton, where they attend classes at Seven Seas High School and meet Bailey Pickett while Mr. Moseby manages the ship. The series was also TV's No. 1 series in Kids 9\u201314 in 2008.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 346 }, { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 437 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Suite Life on Deck is an American sitcom . The series' pilot aired in the UK on September 19, 2008, and in U.S. markets on September 26, 2008. \"The Suite Life on Deck\" premiered in Australia and New Zealand October 6, 2008. In Canada, it became the most watched series premiere on the Family Channel. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "How many secondary schools are there in wales?", "passages": [ [ "Education in Wales", "It began for 3- to 4-year-olds and by 2011 is in place for 3- to 7-year-olds.", "It is based on experiential learning, in small groups, with a teacher ratio of 1:8 for the youngest ages.", "In 2014/15, there were 435 Welsh-medium primary schools with 65,460 pupils, rising from 64,366 in 2013/14 but the number of Welsh-medium primary schools decreasing from 444 due primarily to the closure of small rural schools.", "Pupils in secondary school take part in the compulsory GCSE and the non-compulsory A-level or BTEC qualifications at age 16 and 18 respectively.", "Since 2007 the Welsh Baccalaureate Qualification has also been available as an option although it was ungraded until 2014.", "In 2014/15 there were 207 secondary schools (a drop of six since 2013/14) in Wales with 182,408 pupils and 11,269 FTE teachers (a drop of 310 since 2013/14).", "The pupil/teacher ratio was 17:1, which has remained largely the same since 2000/01.", "In 2015/16, there were 178,650 pupils in 205 secondary schools - a drop of 3,700 since 2014/15." ] ], "gold": "In 2015/16, Wales had 205 secondary schools, but in the 2014/15 year there were 207 secondary schools.", "prediction 1": "In 2014/15 there were 207 secondary schools in Wales with 182,408 pupils and 11,269 FTE teachers (a drop of 310 since 2013/14) and a total of 205 secondary schools in 2015/16.\n", "prediction 2": "There are 205 secondary schools in Wales with 182,408 pupils and 11,269 FTE teachers.", "prediction 3": "In 2014/15 there were 207 secondary schools in Wales with 182,408 pupils and 11,269 FTE teachers. 3.16 million pupils attended secondary school in Wales in 2015/16.", "prediction 4": "In 2014/15 there were 207 secondary schools in Wales, a drop of six since 2013/14.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 126 } ], "missing-info": [], "corrected-prediction": "In 2014/15 there were 207 secondary schools in Wales and a total of 205 secondary schools in 2015/16.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Based on their shape the bones of the skull can be classified as?", "passages": [ [ "Skull", "Most commonly these are found in the course of the lambdoid suture.", "The human skull is generally considered to consist of twenty-two bones\u2014eight cranial bones and fourteen facial skeleton bones.", "In the neurocranium these are the occipital bone, two temporal bones, two parietal bones, the sphenoid, ethmoid and frontal bones.", "The bones of the facial skeleton(14) are the vomer, two inferior nasal conchae, two nasal bones, two maxilla, the mandible, two palatine bones, two zygomatic bones, and two lacrimal bones.", "Some sources count a paired bone as one, or the maxilla as having two bones (as its parts); some sources include the hyoid bone or the three ossicles of the middle ear but the overall general consensus of the number of bones in the human skull is the stated twenty-two.", "Some of these bones\u2014the occipital, parietal, frontal, in the neurocranium, and the nasal, lacrimal, and vomer, in the facial skeleton are flat bones.", "The skull also contains sinuses, air-filled cavities known as paranasal sinuses, and numerous foramina.", "The sinuses are lined with respiratory epithelium." ], [ "Irregular bone", "Irregular bone\n\nThe irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat or sesamoid bones.", "Irregular bones serve various purposes in the body, such as protection of nervous tissue (such as the vertebrae protect the spinal cord), affording multiple anchor points for skeletal muscle attachment (as with the sacrum), and maintaining pharynx and trachea support, and tongue attachment (such as the hyoid bone).", "They consist of cancellous tissue enclosed within a thin layer of compact bone.", "Irregular bones can also be used for joining all parts of the spinal column together.", "The spine is the place in the human body where the most irregular bones can be found.", "There are, in all, 33 irregular bones found here.", "The irregular bones are: the vertebrae, sacrum, coccyx, temporal, sphenoid, ethmoid, zygomatic, maxilla, mandible, palatine, inferior nasal concha, and hyoid." ], [ "Skull", "The skull is made up of a number of fused flat bones, and contains many foramina, fossae, processes, and several cavities or sinuses.", "In zoology there are openings in the skull called fenestrae.", "The human skull is the bony structure that forms the head in the human skeleton.", "It supports the structures of the face and forms a cavity for the brain.", "Like the skulls of other vertebrates, it protects the brain from injury.", "The skull consists of two parts, of different embryological origin\u2014the neurocranium and the facial skeleton (also called the \"membraneous viscerocranium\").", "The neurocranium (or \"braincase\") forms the protective cranial cavity that surrounds and houses the brain and brainstem.", "The upper areas of the cranial bones form the calvaria (skullcap).", "The membranous viscerocranium includes the mandible.", "The facial skeleton is formed by the bones supporting the face.", "Except for the mandible, all of the bones of the skull are joined together by sutures\u2014synarthrodial (immovable) joints formed by bony ossification, with Sharpey's fibres permitting some flexibility.", "Sometimes there can be extra bone pieces within the suture known as wormian bones or \"sutural bones\"." ] ], "gold": "The skull is a bone structure that forms the head in vertebrates and is made up of a number of bones. Some of the bones, the occipital, parietal, frontal, nasal, lacrimal, and vomer bones, are classified as flat bones based on their shape. But other bones in the skull, such as the sphenoid, ethmoid, zygomatic, maxilla, mandible, palatine, and inferior nasal concha are categorized as irregular bones based on their shape. Irregular bones are bones which cannot be grouped as long, short, flat, or sesamoid.", "prediction 1": "The human skull is the bony structure that forms the head in the human skeleton. It supports the structures of the face and forms a cavity for the brain. Based on their shape the bones of the skull can be classified as long, short, flat, sesamoid, irregular, or sesamoid. Irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat, or sesamoid bones.", "prediction 2": "The human skull is generally considered to consist of twenty-two bones\u2014eight cranial bones and fourteen facial skeleton bones. The irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat or sesamoid bones. Irregular bones serve various purposes in the body, such as protection of nervous tissue, affording multiple anchor points for skeletal muscle attachment, and maintaining pharynx and trachea support, and tongue attachment (such as the hyoid bone). Irregular bones serve various purposes in the body, such as protection of nervous tissue, affording multiple anchor points for skeletal muscle attachment, affording multiple anchor points for skeletal muscle attachment, and maintaining pharynx, and pharynx.", "prediction 3": "The skull is the bony structure that forms the head in the human skeleton. Based on their shape the bones of the skull can be classified as long, short, flat, sesamoid, irregular, and sesamoid. The irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat, or sesamoid.", "prediction 4": "The human skull is the bony structure that forms the head in the human skeleton. It supports the structures of the face and forms a cavity for the brain. Based on their shape the bones of the skull can be classified as long, short, flat, sesamoid or irregular. Irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat or sesamoid bones.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 153 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The human skull is the bony structure that forms the head in the human skeleton. Some of these bones\u2014the occipital, parietal, frontal, in the neurocranium, and the nasal, lacrimal, and vomer, in the facial skeleton are flat bones. The irregular bones are: the vertebrae, sacrum, coccyx, temporal, sphenoid, ethmoid, zygomatic, maxilla, mandible, palatine, inferior nasal concha, and hyoid. Irregular bones are bones which, from their peculiar form, cannot be grouped as long, short, flat, or sesamoid bones." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who sings do you love me in dirty dancing?", "passages": [ [ "Do You Love Me", "However, when Gordy wanted to locate the group and record the song, they were nowhere to be found (the Temptations had not been made aware of Gordy's intentions and had departed Motown's Hitsville USA recording studio for a local Detroit gospel music showcase).", "After spending some time looking for the Temptations, Gordy ran into the Contours (Billy Gordon, Hubert Johnson, Billy Hoggs, Joe Billingslea, Sylvester Potts, and guitarist Hugh Davis) in the hallway.", "Wanting to record and release \"Do You Love Me\" as soon as possible, Gordy decided to let them record his \"sure-fire hit\" instead of the Temptations.", "The Contours, who were in danger of being dropped from the label after their first two singles (\"Whole Lotta' Woman\" and \"The Stretch\") failed to chart, were so elated at Gordy's offer that they immediately began hugging and thanking him.", "\"Do You Love Me,\" the fifth release on Gordy Records, became a notably successful dance record, built around Gordon's screaming vocals.", "Selling over a million copies, \"Do You Love Me\" peaked at number three on the \"Billboard\" Hot 100 for three weeks starting on October 20, 1962 and was a number-one hit on the Billboard R&B Singles chart." ], [ "The Contours", "The Contours\n\nThe Contours were one of the early African-American soul singing groups signed to Motown Records.", "The group is best known for its classic chart-topping 1962 hit, \"Do You Love Me\", a million-selling single that became a major hit all over again in 1988.", "Joe Billingslea (born November 14, 1937) and Billy Gordon founded a singing group called the Blenders in their native Detroit, Michigan in 1959.", "They completed the group with Billy Hoggs and Billy Rollins, who had responded to an ad placed in the local newspaper by Billingslea.", "The group soon added Leroy Fair (in place of Billy Rollins), and bass singer Hubert Johnson, and changed the name to \"The Contours\".", "In the fall of 1960, the group auditioned for Berry Gordy's Motown Records.", "Gordy turned the act down, prompting the group to pay a visit to the home of Johnson's cousin, R&B star and Gordy associate Jackie Wilson.", "Wilson in turn got the Contours a second audition with Gordy, at which they sang the same songs they had at the first audition, the same way, and were signed to a seven-year contract.", "Each artist at Motown Records received its own guitarist.", "Huey Davis was the guitarist assigned to the Contours." ], [ "Do You Love Me", "Do You Love Me\n\n\"Do You Love Me\" is a 1962 hit single recorded by The Contours for Motown's Gordy Records label.", "Written and produced by Motown CEO Berry Gordy, Jr., \"Do You Love Me?\" was the Contours' only Top 40 single on the \"Billboard\" Hot 100 chart in the United States.", "Notably, the record achieved this feat twice, once in 1962 and again in 1988.", "A main point of the song is to name the Mashed Potato, The Twist, and a variation of the title \"I like it like that\", as \"You like it like this\", and many other fad dances of the 1960s.", "The song is noted for the spoken recitation heard in the introduction which goes: \"You broke my heart /", "'Cause I couldn't dance /", "You didn't even want me around /", "And now I'm back /", "To let you know /", "I can really shake 'em down\"\n\nThe song is noted for its false ending at 2:26.", "Berry Gordy wrote \"Do You Love Me\" with the intention that The Temptations, who had no Top 40 hits to their name yet, would record it." ] ], "gold": "The song Do You Love Me in the 1987 film Dirty Dancing was sung by Billy Gordon, who sang lead vocals in the song, and The Contours, a soul singing group who recorded the song in 1962.", "prediction 1": "The Contours are an early African-American soul singing group signed to Motown Records. In 1962, the group, comprised of Billy Gordon, Hubert Johnson, Billy Hoggs, Joe Billingslea, Sylvester Potts, and guitarist Hugh Davis, sang Do You Love Me in dirty dancing.", "prediction 2": "The Contours sang Do You Love Me in dirty dancing. In 1962 they sang the song with lead singer Billy Gordon, with other members including Billy Hoggs and Billy Rollins and bass singer Hubert Johnson. The Contours were one of the early African-American soul singing groups signed to Motown Records.", "prediction 3": "The Contours sang \"Do You Love Me\" in dirty dancing in 1962. The song was written and produced by Berry Gordy for Motown's Gordy Records label. The Contours were one of the early African-American soul singing groups signed to Motown Records. The song was written for Gordy with the intention that The Temptations, who had no Top 40 hits to their name yet, would record it. The Contours sang \"Do You Love Me\" in dirty dancing in 1962.", "prediction 4": "\"Do You Love Me\" is a 1962 hit single recorded by The Contours for Motown's Gordy Records label. Written and produced by Motown CEO Berry Gordy, Jr., \"Do You Love Me?\" was the Contours only Top 40 single on the Billboard Hot 100 chart in the United States. Notably, the record achieved this feat twice, once in 1962 and again in 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 87 }, { "error type": "Unverifiable", "explanation": "", "start": 244, "end": 261 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Contours are an early African-American soul singing group. In 1962, the group, comprised of Billy Gordon, Hubert Johnson, Billy Hoggs, Joe Billingslea, Sylvester Potts, and guitarist Hugh Davis, recorded Do You Love Me. The song was built around Gordon's screaming vocals. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who introduced the bass clarinet as a solo instrument in jazz?", "passages": [ [ "Jelly Roll Blues", "Jelly Roll Blues\n\n\"Original Jelly Roll Blues\", usually shortened to and known as \"Jelly Roll Blues\", is an early jazz fox-trot composed by Jelly Roll Morton.", "He recorded it first as a piano solo in Richmond, Indiana, in 1924, and then with his Red Hot Peppers in Chicago two years later, titled as it was originally copyrighted: \"Original Jelly-Roll Blues\".", "It is referenced by name in the 1917 Shelton Brooks composition \"Darktown Strutters' Ball\".", "The Red Hot Peppers version is a typical New Orleans jazz presentation where the trumpet, clarinet and trombone play lead melody and counterpoint, with the piano, guitar, string bass and drums providing the rhythmic accompaniment.", "However, Morton varies and enriches this basic structure by providing many instrumental breaks in suspended rhythm, as well as giving the horns and the piano solo passages.", "The final chorus is in New Orleans \"ride-out\" style, where all the instruments play together and vary the melody and chord progression in counterpoint over a driving, climactic rhythm.", "The tune is also notable for having an Argentine tango-like rhythm and flavor in several passages, which Morton claimed was essential to real jazz.", "Although this tango flavoring did not survive into later jazz, it is noteworthy in the mixture of international cultural influences that produced New Orleans jazz, and this recording is a prime example of it." ], [ "Bennie Maupin", "Bennie Maupin\n\nBennie Maupin (born August 29, 1940, Detroit, Michigan) is a jazz multireedist who performs on various saxophones, flute, and bass clarinet.", "He is known for his participation in Herbie Hancock's \"Mwandishi\" sextet and Headhunters band, and for performing on Miles Davis's seminal fusion record, \"Bitches Brew\".", "Maupin has collaborated with Horace Silver, Roy Haynes, Woody Shaw, Lee Morgan and many others.", "He has performed on several Meat Beat Manifesto albums.", "He is noted for having a harmonically-advanced, \"out\" improvisation style, while having a different sense of melodic direction than other \"out\" jazz musicians such as Eric Dolphy.", "Maupin was a member of Almanac, a group with Cecil McBee (bass), Mike Nock (piano) and Eddie Marshall (drums).", "With John Beasley\nWith Marion Brown\nWith Mike Clark\nWith Miles Davis\nWith Jack DeJohnette\nWith Herbie Hancock\nWith The Headhunters\nWith Eddie Henderson\nWith Andrew Hill\nWith Lee Morgan\nWith Darek Oleszkiewicz\nWith the Jimmy Owens-Kenny Barron Quintet\nWith Woody Shaw\nWith Horace Silver\nWith Lonnie Smith\nWith McCoy Tyner\nWith Lenny White\nWith Patrick Gleeson and Jim Lang (Electronic Musical Industries, 2008)" ], [ "Herbie Mann", "Herbie Mann\n\nHerbert Jay Solomon (April 16, 1930 \u2013 July 1, 2003), known by his stage name Herbie Mann, was an American jazz flutist and important early practitioner of world music.", "Early in his career, he also played tenor saxophone and clarinet (including bass clarinet), but Mann was among the first jazz musicians to specialize on the flute.", "His most popular single was \"Hijack\", which was a \"Billboard\" No. 1 dance hit for three weeks in 1975.", "Mann emphasized the groove approach in his music.", "Mann felt that from his repertoire, the \"epitome of a groove record\" was \"Memphis Underground\" or \"Push Push\", because the \"rhythm section locked all in one perception.\"", "Herbie Mann was born in Brooklyn, New York, to Jewish parents, Harry C. Solomon (May 30, 1902 \u2013 May 31, 1980), who was of Russian descent, and Ruth Rose Solomon (n\u00e9e Brecher) (July 4, 1905 \u2013 November 11, 2004), of Romanian descent who was born in Bukovina, Austria-Hungary but immigrated to the United States with her family at the age of 6.", "Both of his parents were dancers and singers, as well as dance instructors later in life.", "He attended Lincoln High School in Brighton Beach.", "His first professional performance was playing the Catskills resorts at age 15." ] ], "gold": "Jazz flute player Herbie Mann introduced the bass clarinet as a solo instrument in jazz by recording the first jazz album on which the leader solely played bass clarinet, 1957's Great Ideas of Western Mann, while Wilbur Sweatman recorded the first known bass clarinet solo in jazz, and Eric Dolphy was the first musician to play as a major jazz soloist on the bass clarinet.", "prediction 1": "Herbert Jay Solomon, known by his stage name Herbie Mann, was an American jazz flutist and important early practitioner of world music. Early in his career, he also played tenor saxophone and clarinet (including bass clarinet), but Mann was among the first jazz musicians to specialize on the flute. He performed with the Jimmy Owens-Kenny Barron Quintet, with Cecil McBee on bass and Mike Nock on piano.", "prediction 2": "The bass clarinet was introduced to jazz by pianist Jelly Roll Morton in 1924. Morton recorded the song first as a piano solo in Richmond, Indiana, in 1924, and then with his Red Hot Peppers in Chicago two years later. Herbie Mann introduced the bass clarinet as a solo instrument in jazz in 1975. Bette Midler introduced the bass clarinet as a solo instrument in jazz in 1976.", "prediction 3": "Bennie Maupin is an American jazz multireedist who performs on various saxophones, flute, and bass clarinet. He is known for his participation in Herbie Hancock's \"Mwandishi\" sextet and Headhunters band, and for performing on Miles Davis' seminal fusion record, \"Bitches Brew\". Herbert Jay Solomon is an American jazz flutist and important early practitioner of world music. He also played tenor saxophone and clarinet, but was among the first jazz musicians to specialize on the flute.", "prediction 4": "The bass clarinet has been played as a solo instrument in jazz since 1924, when it was recorded by Jelly Roll Morton as a piano solo. The bass clarinet was introduced to jazz by Herbie Mann, who was an American jazz flutist and early practitioner of world music and emphasized the groove approach in his music.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 404 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When did the cartoon tom and jerry first come out?", "passages": [ [ "Tom and Jerry", "A number of spin-offs have been made, including the television series \"The Tom and Jerry Show\" (1975), \"The Tom and Jerry Comedy Show\" (1980\u201382), \"Tom and Jerry Kids\" (1990\u201393), \"Tom and Jerry Tales\" (2006\u201308), and \"The Tom and Jerry Show\" (2014\u2013present).", "The first feature-length film based on the series, \"\", was released in 1992, and 13 direct-to-video films have been produced since 2002.", "The series features comic fights between an iconic set of adversaries, a house cat (Tom) and a mouse (Jerry).", "The plots of each short usually center on Tom's numerous attempts to capture Jerry and the mayhem and destruction that follows.", "Tom rarely succeeds in catching Jerry, mainly because of Jerry's cleverness, cunning abilities, and luck.", "However, there are also several instances within the cartoons where they display genuine friendship and concern for each other's well-being.", "At other times, the pair set aside their rivalry in order to pursue a common goal, such as when a baby escaped the watch of a negligent babysitter, causing Tom and Jerry to pursue the baby and keep it away from danger." ], [ "Tom and Jerry", "Tom and Jerry's first feature film appearance was in the 1945 MGM musical \"Anchors Aweigh\", in which Jerry performs a dance number with Gene Kelly.", "In this scene, Tom also made a cameo as a servant.", "Filmmakers had wanted Mickey Mouse for the scene, but Roy Disney had rejected the deal, as the Disney studio was focusing on its own cartoons to help pay off its debts after World War II.", "William Hanna and Joe Barbera supervised animation for the scene.", "Tom and Jerry's second feature film appearance was swimming with Esther Williams in a dream sequence in another MGM big-screen musical, \"Dangerous When Wet\" (1953).", "On October 1, 1992, the first international release of \"\" arrived when the film was released overseas to theaters in Europe and then domestically by Miramax Films on July 30, 1993, with future video and DVD releases that would be sold under Warner Bros., which, following Disney's acquisition of Miramax and Turner's subsequent merger with Time Warner, had acquired the film's distribution rights.", "Barbera served as creative consultant for the picture, which was produced and directed by Phil Roman.", "The film was a musical with a structure similar to MGM's blockbusters, \"The Wizard of Oz\" and \"Singin' in the Rain\"." ], [ "Tom and Jerry", "However, recent telecasts on Cartoon Network and Boomerang retain Mammy with new voiceover work performed by Thea Vidale to remove the stereotypical black jargon featured on the original cartoon soundtracks.", "The standard \"Tom and Jerry\" opening titles were removed as well.", "Instead of the roaring MGM Lion sequence, an opening sequence featuring different clips of the cartoons was used instead.", "The title cards were also changed.", "A pink title card with the name written in white font was used instead.", "Debuting on CBS' Saturday morning schedule on September 25, 1965, \"Tom and Jerry\" moved to CBS Sundays two years later and remained there until September 17, 1972.", "In 1975, Tom and Jerry were reunited with Hanna and Barbera, who produced new \"Tom and Jerry cartoons\" for Saturday mornings.", "These 48 seven-minute short cartoons were paired with \"Grape Ape\" and \"Mumbly\" cartoons, to create \"The Tom and Jerry/Grape Ape Show\", \"The Tom and Jerry/Grape Ape/Mumbly Show\", and \"The Tom and Jerry/Mumbly Show\", all of which initially ran on ABC Saturday mornings between September 6, 1975 and September 3, 1977." ] ], "gold": "The cartoon Tom and Jerry first came out on several dates. It first came out as a television show in 1975, the year The Tom & Jerry Show originally aired on ABC, while it first came out as a television special on July 17, 1989. It first came out as a feature film on July 30, 1993, the day Tom and Jerry: The Movie was released domestically.", "prediction 1": "Tom and Jerry is an American children's cartoon series created by William Hanna and Joe Barbera that features comic fights between an iconic set of adversaries, a house cat named Tom and a mouse named Jerry. The cartoon first came out on CBS Saturday mornings on September 25, 1965, before moving to CBS Sundays on September 6, 1975, and remained there until September 3, 1977. The first feature-length film based on the series, \"\", was released in 1992, and 13 direct-to-video films have been produced since 2002. The first international release of \"\" arrived on October 1, 1992, when the first international release of \"\" arrived when the film was released overseas to theaters in Europe and then domestically by Miramax Films on July 30, 1993, with future video and DVD releases that would be sold under Warner Bros, which, following Disney's acquisition of Miramax and Turner's subsequent merger with Time Warner Bros", "prediction 2": "The cartoon Tom and Jerry first came out on CBS Saturday mornings on September 25, 1965. The first feature-length film based on the series, \"Tom and Jerry: A Musical\", was released in 1992. The second feature film appearance was swimming with Esther Williams in a dream sequence in another MGM big-screen musical, \"Dangerous When Wet\" (1953). The first television series, Tom and Jerry: A Musical, has been produced every year since 1984.", "prediction 3": "Tom and Jerry is an American sitcom and animated television series created by William Hanna and Joe Barbera for CBS Sunday mornings. It first came out on CBS Saturday mornings on September 25, 1965, and went to Sundays on CBS Sundays from September 6, 1975 until September 3, 1977. The first feature-length film based on the series, \"\", was released in 1992, and 13 direct-to-video films have been produced since 2002. In 1975, Hanna and Barbera collaborated on 48 seven-minute short cartoons, paired with Grape Ape and Mumbly cartoons, to create The Tom and Jerry/Grape Ape Show, The Tom and Jerry/Mumbly Show, and The Tom and Jerry/Mumbly Show.", "prediction 4": "Several Tom and Jerry cartoons have been produced over the years. The first of these was on CBS Saturday morning on September 25, 1965. The second was in the 1945 MGM musical \"Anchors Aweigh\". The third was on CBS Sundays on September 6, 1975. The fourth was the television series \"The Tom and Jerry Show\" on ABC Saturday mornings between September 6, 1975 and September 3, 1977.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 377 }, { "error type": "Irrelevant", "explanation": "", "start": 455, "end": 514 }, { "error type": "Incoherent", "explanation": "", "start": 515, "end": 921 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The cartoon first came out on CBS Saturday mornings on September 25, 1965, before moving to CBS Sundays on September 6, 1975, and remained there until September 3, 1977. The first feature-length film based on the series was released in 1992 internationally, and then domestically on July 30, 1993." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who sang there's a danger in loving somebody too much?", "passages": [ [ "Sometimes Love Just Ain't Enough", "Sometimes Love Just Ain't Enough\n\n\"Sometimes Love Just Ain't Enough\" is the title of a 1992 rock ballad performed as a duet by the American singers Patty Smyth and Don Henley.", "The song was written by Smyth and Glen Burtnik.", "Smyth was the former lead singer for the band Scandal, whose hits included \"The Warrior\" and \"Goodbye To You\"; Henley is a longtime member of the band Eagles (singing lead vocals on \"Desperado\" and \"Hotel California\", among many others) as well as a successful solo artist (\"The Boys of Summer\", \"The End of the Innocence\").", "Smyth had previously provided backing vocals on Henley's solo albums \"Building the Perfect Beast\" (1984) and \"The End of the Innocence\" (1989).", "\"Sometimes Love Just Ain't Enough\" was written by Smyth and Glen Burtnik and would appear on her self-titled 1992 album.", "The lyrics refer to a past relationship between two people as narrated by the two singers, and their efforts to move on with their respective lives and make sense of the aftermath: \"There's a reason why people don't stay where they are / Baby sometimes love just ain't enough\"." ], [ "Jennylyn Mercado", "Jennylyn Mercado\n\nJennylyn Anne Pineda Mercado (born May 15, 1987) is a Filipino actress, singer, and songwriter.", "She was the winner of the first season of the reality talent competition \"StarStruck\".", "Mercado garnered acclaim at a young age for her acting performances on television and film.", "She is known for starring in multiple box office successes, namely \"English Only, Please\" (2014), \"The Prenup\" (2015), \"Walang Forever\" (2015), and \"Just the 3 of Us\" (2016).", "She has released three albums from GMA Records and Viva Records which have several popular singles such as \"Sa Aking Panaginip\", \"Moments Of Love\" collaboration with Janno Gibbs, \"Maybe This Time\" and \"Kahit Sandali\".", "In 2017, she top billed the Philippine remake of \"My Love from the Star\".", "Mercado's success in Philippine show business made her one of the top actresses in the country and established her status as the \"Ultimate Star\".", "Jennylyn Mercado was born on May 15, 1987, to a mother who was a duty-free store beauty consultant.", "Mercado had opened up about her stepfather who abused her as a child.", "He burned her skin with cigarette butts." ], [ "The Storm (Travis Tritt album)", "In 2013, Tritt acquired the rights to the album in order to re-release it via his own Post Oak Records under the title \"The Calm After...\"", "The re-release includes a cover of the Patty Smyth and Don Henley duet \"Sometimes Love Just Ain't Enough\" with his daughter, Tyler Reese, and a cover of Faces' \"Stay with Me\".", "\"The Calm After...\" sold more than 2.000 copies in its opening week and entered the Country Albums chart at number 31." ] ], "gold": "There were several singers of \"there's a danger in loving somebody too much.\" Its original version was sung by American singers Patty Smyth and Don Henley, who performed the 1992 ballad \"Sometimes Love Just Ain't Enough\" as a duet. Filipina actress, singer, and songwriter Jennylyn Mercado sang it in 2010. Country singer Travis Tritt and Tyler Reese, his daughter, sang it in 2013.", "prediction 1": "\"Sometimes Love Just Ain't Enough\" is the title of a 1992 rock ballad performed as a duet by the American singers Patty Smyth and Don Henley. The song was written by Smyth and Glen Burtnik and would appear on her self-titled 1992 album. The lyrics refer to a past relationship between two people as narrated by the two singers, and their efforts to move on with their respective lives and make sense of the aftermath.", "prediction 2": "\"Sometimes Love Just Ain't Enough\" is the title of a 1992 rock ballad performed as a duet by the American singers Patty Smyth and Don Henley. The song was written by Smyth and Glen Burtnik and would appear on her self-titled 1992 album. The lyrics refer to a past relationship between two people as narrated by the two singers, and their efforts to move on with their respective lives and make sense of the aftermath: \"There's a reason why people don't stay where they are\"; and their efforts to move on with their respective lives and make sense of the aftermath.", "prediction 3": "There's a danger in loving somebody too much. The song \"Sometimes Love Just Ain't Enough\" is a rock ballad performed as a duet by the American singers Patty Smyth and Don Henley. It was written by Smyth and Glen Burtnik and would appear on her self-titled 1992 album. Mercado sang the song with his daughter, Tyler Reese.", "prediction 4": "\"Sometimes Love Just Ain't Enough\" is the title of a 1992 rock ballad performed as a duet by the American singers Patty Smyth and Don Henley. The song was written by Smyth and Glen Burtnik and would appear on her self-titled 1992 album. The lyrics refer to a past relationship between two people as narrated by the two singers, and their efforts to move on with their respective lives and make sense of the aftermath: \"There's a reason why people don't stay where they are / Baby sometimes love just ain't enough\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 417 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Sometimes Love Just Ain't Enough\" is the title of a 1992 rock ballad performed as a duet by the American singers Patty Smyth and Don Henley. Travis Tritt did a cover of the Patty Smyth and Don Henley duet \"Sometimes Love Just Ain't Enough\" with his daughter, Tyler Reese." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "How many brands of e cigarettes are there?", "passages": [ [ "Electronic cigarette", "There are around 500 brands of e-cigarettes, with global sales in excess of US$7 billion.", "Electronic cigarettes are also known as e-cigarettes, e-cigs, EC, electronic nicotine delivery systems (ENDS) or electronic non-nicotine delivery systems (ENNDS), electronic smoking devices (ESDs), personal vaporizers, or PVs.", "They are handheld devices, often made to look like conventional cigarettes, and used in a similar way.", "E-liquid or juice are names for the flavored solution that goes inside the e-cigarette.", "An aerosol, or vapor, is produced by heating the e-liquid.", "Irish public health discussions refer to NMNDS (\"non-medicinal nicotine delivery systems\").", "When the FDA commissioned their 2018 report on ENDS which they label as a Tobacco Product, the authors chose to use the term e-cigarettes for some use e-juice without nicotine.", "Between their introduction to the market in 2004 and approximately 2015, global usage of e-cigarettes rose exponentially.", "By 2013, there were several million users globally.", "Awareness and use of e-cigarettes greatly increased in a relatively short period of time.", "Growth rates in the US and UK slowed in 2015, although use is still increasing.", "Most users have a history of smoking regular cigarettes." ], [ "Electronic cigarette", "The number of e-cigarettes sold increased every year from 2003 to 2015, when a slowdown in the growth in usage occurred in both the US and the UK.", "there were at least 466 e-cigarette brands.", "Worldwide e-cigarette sales in 2014 were around US$7 billion.", "Approximately 30\u201350% of total e-cigarettes sales are handled on the internet.", "The consumer preference for e-cigarettes is having a dramatic effect on the tobacco industry.", "In the US, established tobacco companies have a significant share of the e-cigarette market.", "In 2015, 80% of all e-cigarette sales in convenience stores in the U.S. were products made by tobacco companies.", "According to Nielsen Holdings, convenience store e-cigarette sales in the US went down for the first time during the four-week period ending on 10 May 2014.", "Wells Fargo analyst Bonnie Herzog attributes this decline to a shift in consumers' behavior, buying more specialized devices or what she calls \"vapor/tank/mods (VTMs)\" that are not tracked by Nielsen.", "Wells Fargo estimated that VTMs accounted for 57% of the 3.5 billion dollar market in the US for vapor products in 2015.", "In 2014, the Smoke-Free Alternatives Trade Association estimated that there were 35,000 vape shops in the US, more than triple the number a year earlier." ] ], "gold": "As of 2014, there were more than 460 e-cigarette brands worldwide. In 2014 it was reported that in every month there was a net growth of 10.5 e-cigarette brands. New e-cigarette brands are continuously being brought into the marketplace.", "prediction 1": "There are around 500 brands of e cigarettes, with global sales in excess of US$7 billion. There are handheld devices, often made to look like conventional cigarettes, and used in a similar way. Between their introduction to the market in 2004 and approximately 2015, global usage of e-cigarettes rose exponentially. Awareness and use of e-cigarettes greatly increased in a relatively short period of time. There were at least 466 different brands of e cigarettes. Worldwide e-cigarette sales in 2014 were around US$7 billion.", "prediction 2": "There are around 500 brands of electronic cigarettes, with global sales in excess of US$7 billion. There are handheld devices, often made to look like conventional cigarettes, and used in a similar way. Between their introduction to the market in 2004 and approximately 2015, global usage of e-cigarettes rose exponentially. In 2015, there were at least 466 e-cigarette brands.", "prediction 3": "There are around 500 brands of electronic cigarettes, with global sales in excess of US$7 billion. Between their introduction to the market in 2004 and approximately 2015, global usage of e-cigarettes rose exponentially. There were at least 466 e-cigarette brands. Worldwide e-cigarette sales in 2014 were around US$7 billion.", "prediction 4": "There are around 500 brands of electronic cigarettes, with global sales in excess of US$7 billion. There are also known as e-cigs, e-cigs, EC, electronic nicotine delivery systems (ENDS) or electronic non-nicotine delivery systems (ENNDS), electronic smoking devices (ESDs), personal vaporizers, or PVs. Between their introduction to the market in 2004 and approximately 2015, global usage of e-cigarettes rose exponentially. Between 2003 and 2015, global awareness and use of e-cigarettes greatly increased in a relatively short period of time. There were at least 466 e-cigarette brands.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 405 }, { "error type": "Irrelevant", "explanation": "", "start": 464, "end": 525 } ], "missing-info": [], "corrected-prediction": "There are around 500 brands of e cigarettes, with global sales in excess of US$7 billion. There were at least 466 different brands of e cigarettes. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who won the soccer world cup this year?", "passages": [ [ "2018 FIFA World Cup", "2018 FIFA World Cup\n\nThe 2018 FIFA World Cup was the 21st FIFA World Cup, an international football tournament contested by the men's national teams of the member associations of FIFA once every four years.", "It took place in Russia from 14 June to 15 July 2018.", "It was the first World Cup to be held in Eastern Europe, and the 11th time that it had been held in Europe.", "At an estimated cost of over $14.2\u00a0billion, it was the most expensive World Cup.", "It was also the first World Cup to use the video assistant referee (VAR) system.", "The finals involved 32 teams, of which 31 came through qualifying competitions, while the host nation qualified automatically.", "Of the 32 teams, 20 had also appeared in the previous tournament in 2014, while both Iceland and Panama made their first appearances at a FIFA World Cup.", "A total of 64 matches were played in 12 venues across 11 cities.", "The final took place on 15 July at the Luzhniki Stadium in Moscow, between France and Croatia.", "France won the match 4\u20132 to claim their second World Cup title, marking the fourth consecutive title won by a European team.", "The bidding procedure to host the 2018 and 2022 FIFA World Cup tournaments began in January 2009, and national associations had until 2 February 2009 to register their interest." ], [ "2010 FIFA World Cup", "A large number of fouls were committed in the final match.", "Referee Howard Webb handed out 14 yellow cards, more than doubling the previous record for this fixture, set when Argentina and West Germany shared six cards in 1986, and John Heitinga of the Netherlands was sent off for receiving a second yellow card.", "The Netherlands had chances to score, most notably in the 60th minute when Arjen Robben was released by Wesley Sneijder to be one-on-one with Spain's goalkeeper Iker Casillas, only for Casillas to save the shot with an outstretched leg.", "For Spain, Sergio Ramos missed a free header from a corner kick when he was unmarked.", "Iniesta finally broke the deadlock in extra time, scoring a volleyed shot from a pass by Cesc F\u00e0bregas.", "This result marked the first time that two teams from the same continent had won successive World Cups (following Italy in 2006), and saw Europe reaching 10 World Cup titles, surpassing South America's nine titles.", "Spain became the first team since West Germany in 1974 to win the World Cup as European champions.", "The result also marked the first time that a European nation had won a World Cup Finals that was not hosted on European soil.", "A closing ceremony was held before the final, featuring singer Shakira." ], [ "2010 FIFA World Cup", "Spain reached the final four for the first time since 1950 after a 1\u20130 win over Paraguay.", "Uruguay, the only South American team to reach the semi-finals, overcame Ghana in a penalty shoot-out after a 1\u20131 draw in which Ghana missed a penalty at the end of extra time after Luis Su\u00e1rez controversially handled the ball on the line.", "The Netherlands qualified for the final for the third time with a 3\u20132 win over Uruguay.", "Spain reached their first ever final with a 1\u20130 victory over Germany.", "As a result, it was the first World Cup final not to feature at least one of Brazil, Italy, Germany or Argentina.", "Germany defeated Uruguay 3\u20132 to secure third place.", "Germany holds the record for most third-place finishes in the World Cup (4), while Uruguay holds the record for most fourth-place finishes (3).", "The final was held on 11 July 2010 at Soccer City, Johannesburg.", "Spain defeated the Netherlands 1\u20130, with an extra time goal from Andr\u00e9s Iniesta.", "Iniesta scored the latest winning goal in a FIFA World Cup final (116').", "The win gave Spain their first World Cup title, becoming the eighth team to win it.", "This made them the first new winner without home advantage since Brazil in 1958, and the first team to win the tournament after having lost their opening game." ] ], "gold": "France won the most recent World Cup in 2018, claiming their second World Cup title. France defeated Croatia 4 to 2 in the final. In 2014, Germany won the World Cup, claiming their fourth World Cup title. In the final, Germany defeated Argentina 1 to 0. In 2010, Spain won the World Cup, giving Spain their first World Cup title. Spain defeated the Netherlands 1 to 0 in the final. The next World Cup is scheduled to take place in Qatar from November 21 to December 18, 2022.", "prediction 1": "The soccer world cup is an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. The 2018 FIFA World Cup was the 21st FIFA World Cup, an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. The 2010 FIFA World Cup was won by Spain and the 2010 FIFA World Cup was won by Spain and the Netherlands. The 2018 FIFA World Cup was won by Croatia.", "prediction 2": "The 2019 FIFA World Cup was an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. France won the match 4\u20132 to claim their second World Cup title, marking the fourth consecutive title won by a European team. The 2010 FIFA World Cup was contested by Spain, and featured France beating Croatia 1\u20130.", "prediction 3": "The 2018 FIFA World Cup was an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. During the tournament, France won the match 4\u20132 to claim their second World Cup title, marking the fourth consecutive title won by a European team. The 2010 FIFA World Cup was won by Spain, becoming the eighth team to win it, and the 2011 FIFA World Cup was won by Brazil.", "prediction 4": "During the 2018 FIFA World Cup, Spain became the first team since West Germany in 1974 to win the World Cup as European champions. In the 2010 FIFA World Cup, Spain defeated the Netherlands 1\u20130, with an extra time goal from Andr\u00e9s Iniesta. In the 2014 FIFA World Cup, France won the match 4\u20132 to claim their second World Cup title, marking the fourth consecutive title won by a European team.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 156 }, { "error type": "Redundant", "explanation": "The soccer world cup is an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. ", "start": 157, "end": 342 }, { "error type": "Redundant", "explanation": "The soccer world cup is an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. The 2018 FIFA World Cup was the 21st FIFA World Cup, an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. The 2010 FIFA World Cup was won by Spain and ", "start": 388, "end": 428 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 429, "end": 449 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 482, "end": 493 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] } ], "corrected-prediction": " The 2010 FIFA World Cup was won by Spain, who defeated the Netherlands 1-0, giving Spain their first World Cup title. The 2018 FIFA World Cup was won by France, who beat Croatia 4\u20132 to claim their second World Cup title." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sings it must be love on the brain?", "passages": [ [ "Love on the Brain", "On May 19, 2016, \"Love on the Brain\" was featured on the season 12 finale of long-running ABC medical drama \"Grey's Anatomy\".", "It charted at the top of the Top TV Songs Chart, powered by 40,000 Shazam tags.", "Furthermore, according to Nielsen Music, 45,000 downloads and 8.1 million US streams were made in the same month.", "American singer Kelly Clarkson performed the song during a Facebook live session on August 26, 2016.", "Danish singer M\u00d8 covered \"Love on the Brain\" on the BBC Radio 1Xtra website's \"Live Lounge\".", "British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"", "Credits adapted from Rihanna's official website.", "Locations\n\nPersonnel" ], [ "Love on the Brain", "Love on the Brain\n\n\"Love on the Brain\" is a song recorded by singer Rihanna for her eighth studio album, \"Anti\" (2016).", "It was written by Joseph Angel and produced by Fred Ball, with additional writing by Rihanna, and Kuk Harrell serving as the vocal producer.", "The song was provided to US rhythmic contemporary and urban contemporary radio stations on September 27, 2016, as the album's fourth single.", "\"Love on the Brain\" is a doo-wop, R&B and soul ballad inspired by 1950s and 1960s music.", "Its instrumentation consists of a guitar arpeggio, swirling organ, a simple chord progression, syncopated strings, and orchestra.", "Lyrically, the song has themes of swinging back and forth between the highs and lows of a toxic love.", "Commercially, the song reached the top of the Polish chart, as well as the top-twenty in France and New Zealand, and top-forty in Austria, Canada and Germany.", "In the United States, the song reached number five on the \"Billboard\" Hot 100, becoming her 22nd top-five single breaking her tie with Elvis Presley as the artist with the 5th most top-five singles, and it was also her 30th top-ten single tying her with Madonna and The Beatles as the only acts in history to appear at least thirty times in the top-ten of the Hot 100." ] ], "gold": "\"Love on the Brain\" is a song recorded by Barbadian singer Rihanna for her eighth studio album, Anti (2016). British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\" British soap actress Jane Danson also performed to the song in February 2019 on ITV show Dancing on Ice.", "prediction 1": "\"Love on the Brain\" is a song recorded by singer Rihanna for her eighth studio album, Anti (2016). It was written by Joseph Angel and produced by Fred Ball, with additional writing by Rihanna, and Kuk Harrell serving as the vocal producer. Danish singer M covered \"Love on the Brain\" on the BBC Radio 1Xtra website's \"Live Lounge.\" British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"", "prediction 2": "Love on the Brain is a song recorded by singer Rihanna for her eighth studio album, Anti (2016). It was written and produced by Joseph Angel and produced by Fred Ball, with additional writing by Rihanna, and Kuk Harrell serving as the vocal producer. Danish singer M covered Love on the Brain on the BBC Radio 1Xtra website's \"Live Lounge.\" British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"", "prediction 3": "The song \"Love on the Brain\" is by American singer Rihanna for her eighth studio album, Anti. It was written by Joseph Angel and produced by Fred Ball, with additional writing by Rihanna, and Kuk Harrell serving as the vocal producer. Danish singer M covered \"Love on the Brain\" on the BBC Radio 1Xtra website's \"Live Lounge.\" British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"", "prediction 4": "Love on the Brain is a song recorded by singer Rihanna for her eighth studio album, Anti (2016). It was written by Joseph Angel and produced by Fred Ball, with additional writing by Rihanna, and Kuk Harrell serving as the vocal producer. Danish singer M covered \"Love on the Brain\" on the BBC Radio 1Xtra website's \"Live Lounge.\" British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 239 } ], "missing-info": [], "corrected-prediction": "\"Love on the Brain\" is a song recorded by singer Rihanna for her eighth studio album, Anti (2016). Danish singer M covered \"Love on the Brain\" on the BBC Radio 1Xtra website's \"Live Lounge.\" British girl band Little Mix covered the song on iHeartRadio's \"Honda Stage.\"" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was last time seattle seahawks won superbowl?", "passages": [ [ "Seattle Seahawks", "However, none of them was able to play in the Pro Bowl, as the Seahawks defeated the New Orleans Saints 23\u201315 and the San Francisco 49ers 23\u201317, in the playoffs to advance to Super Bowl XLVIII against the Denver Broncos.", "On February 2, 2014, the Seahawks won the franchise's first Super Bowl Championship, defeating Denver 43\u20138.", "The Seahawks' defense performance in 2013 was acclaimed as one of the best in the Super Bowl era.", "The following season, Seattle advanced to Super Bowl XLIX, their second consecutive Super Bowl, but they were dethroned of their title by the New England Patriots by a score of 28\u201324.", "They got off to a slow start the next year starting 0-2 and 2-4 through 6 games but finished 10-6 on the year clinching a wild card berth.", "They beat the Minnesota Vikings 10-9 to advance to the divisional round.", "Against Carolina, they were down 31-0 at halftime before scoring 24 unanswered points.", "Their comeback attempt fell short and they failed to make the Super Bowl.", "Most recently, the Seahawks and the San Francisco 49ers have begun to develop a rivalry, starting with the 49ers hiring of coach Jim Harbaugh for the 2011 NFL season.", "Harbaugh had coached against Seahawks coach Pete Carroll before in college at Stanford and Southern California, respectively." ], [ "Seattle Seahawks", "Colin Kaepernick and the 49ers lost their first 2013 season matchup against their NFC West rivals 29\u20133, with the help of Marshawn Lynch's three touchdowns, with the fans setting a new Guinness World Record for the loudest crowd roar at 136.6\u00a0dB. However, the Seahawks were defeated 19\u201317 in their second 2013 game with the 49ers at Candlestick Park.", "This was largely due to a late game 51-yard run by Frank Gore.", "The Seahawks had not won in San Francisco since 2008 until defeating the 49ers in convincing 19\u20133 fashion on Thanksgiving Day in 2014.", "In the 2013 NFC Championship Game, the Seahawks defeated the 49ers 23 to 17, thanks to Malcolm Smith's interception, which was tipped by Richard Sherman.", "This clinched the Seahawks' berth into Super Bowl XLVIII.", "The Seahawks have developed a rivalry with the Carolina Panthers.", "The two teams have played each other in the NFL playoffs three times: during the 2005 NFC Championship Game, which Seattle won 34\u201314; the 2014 NFC Divisional playoffs, which the Seahawks won 31\u201317; and the 2015 NFC Divisional playoffs, which the Panthers won 31\u201324.", "The Seahawks lead the Panthers in the all-time series 9\u20134.", "From the 1980s to the 2002 league realignment, the Denver Broncos were a major rival for the Seahawks." ] ], "gold": "In the 2013 NFL season, the Seahawks advanced to Super Bowl XLVIII against the Denver Broncos. On February 2, 2014, the Seahawks won the franchise's only Super Bowl Championship, defeating Denver 43\u20138. ", "prediction 1": "On February 2, 2014, the Seattle Seahawks won the franchise's first Super Bowl Championship, defeating Denver 43\u20138. The Seahawks have developed a rivalry with the Carolina Panthers. The two teams have played each other in the NFL playoffs three times: during the 2005 NFC Championship Game, which Seattle won 34\u201314; the 2014 NFC Divisional playoffs, which the Seahawks won 31\u201317; and the 2015 NFC Divisional playoffs, which the Panthers won 31\u201324.", "prediction 2": "The Seahawks have won Super Bowls in both the 2005 and 2014 seasons, but have failed to win Super Bowls in 2016 or 2017. The last time the Seahawks won Super Bowl was on February 2, 2014.", "prediction 3": "The Seattle Seahawks have won Super Bowl XLVIII three times since 2002, including winning in 2005 and winning in 2014. Seattle's first Super Bowl victory came on February 2, 2014, when they defeated the Denver Broncos 43-8. The Seahawks also won Super Bowl XLIX in 2012, which was their second consecutive Super Bowl. The following year, they advanced to Super Bowl XLVIII, but were dethroned of their title by the New England Patriots by a score of 28-24. The Seahawks also developed a rivalry with the Carolina Panthers.", "prediction 4": "The last time the Seattle Seahawks won the Super Bowl was February 2, 2014 against the Denver Broncos.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 447 } ], "missing-info": [], "corrected-prediction": "On February 2, 2014, the Seattle Seahawks won the franchise's first Super Bowl Championship, defeating Denver 43\u20138. " }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Where was the movie fundamentals of caring filmed?", "passages": [ [ "The Fundamentals of Caring", "He narrates his writing the last few lines, informing the audience that he eventually quit as Trevor's caregiver, but the two remained friends.", "On Trevor's 21st birthday, Ben went into his room to find Trevor lying dead on the floor and his new caregiver crying on the floor next to him, only to find out Trevor was faking.", "The caregiver quit the next day.", "On October 11, 2012, Worldwide Pants' Rob Burnett and Jon Beckerman acquired the film rights to Jonathan Evison's novel \"The Revised Fundamentals of Caregiving\".", "Burnett would adapt and direct the film.", "On January 7, 2015, Paul Rudd was added to the cast to play the male lead, which Donna Gigliotti and James Spies would produce.", "On January 13, Selena Gomez also joined the film.", "On December 7, it was announced that the original title, \"The Revised Fundamentals of Caregiving\", had been changed to \"The Fundamentals of Caring\".", "It was later revealed Bobby Cannavale and Frederick Weller had been cast in the film.", "Filming began on January 22, 2015, in Atlanta, Georgia.", "In early February filming took place in Cartersville, Georgia.", "Filming concluded on February 26, 2015, after 26 days of filming.", "The film had its world premiere at the 2016 Sundance Film Festival as the Closing Night Film." ], [ "The Fundamentals of Caring", "The Fundamentals of Caring\n\nThe Fundamentals of Caring is a 2016 American comedy-drama film written and directed by Rob Burnett, based on the 2012 novel \"The Revised Fundamentals of Caregiving\" by Jonathan Evison and stars Paul Rudd, Craig Roberts, and Selena Gomez.", "The film had its world premiere at the Sundance Film Festival on January 29, 2016 and was released by Netflix on June 24, 2016.", "Ben is a retired writer.", "Needing a new job, he takes a six-week course to become a caregiver.", "He gets a job from an English woman named Elsa, a registered caregiver and an office manager at a bank, whose 18-year-old son Trevor suffers from Duchenne muscular dystrophy.", "Trevor is a sardonic, anxious boy fascinated by American roadside attractions, and Ben suggests that they see several.", "Trevor initially refuses, and Elsa worries Ben is becoming too close to him.", "Trevor's father left when he was diagnosed, only sending him letters throughout the years.", "Ben is hounded by a court tracker hired by his wife and avoids his visits.", "Eventually, Elsa agrees with Ben's road trip plan, and he and Trevor embark on a journey to the world's deepest pit.", "On the way there, Trevor says he wants to see his father, who owns a car dealership in Salt Lake City." ] ], "gold": "The Fundamentals of Caring is a 2016 American road comedy drama film written and directed by Rob Burnett, based on the 2012 novel The Revised Fundamentals of Caregiving by Jonathan Evison. On January 22, 2015 the movie began filming in Atlanta, Georgia, and in early February 2015, the movie began filming in Cartersville, Georgia. ", "prediction 1": "The 2016 American comedy-drama film, The Fundamentals of Caring, was written and directed by Rob Burnett, based on the 2012 novel of the same name by Jonathan Evison. Filming began on January 22, 2015, in Atlanta, Georgia. In early February filming took place in Cartersville, Georgia. Filming concluded on February 26, 2015, after 26 days of filming. The film had its world premiere at the Sundance Film Festival on January 29, 2016.", "prediction 2": "The movie Fundamentals of Caring is a 2016 American comedy-drama film written and directed by Rob Burnett, based on the 2012 novel The Revised Fundamentals of Caregiving by Jonathan Evison, which was originally released in 2012. Filming began on January 22, 2015, in Atlanta, Georgia, and in early February filming took place in Cartersville, Georgia. Filming concluded on February 26, 2015, after 26 days of filming.", "prediction 3": "The movie Fundamentals of Caring is a 2016 American comedy-drama film written and directed by Rob Burnett, based on the 2012 novel The Revised Fundamentals of Caregiving by Jonathan Evison. Filming began on January 22, 2015, in Atlanta, Georgia. In early February filming took place in Cartersville, Georgia. Filming concluded on February 26, 2015, after 26 days of filming.", "prediction 4": "The movie Fundamentals of Caring is a 2016 American comedy-drama written and directed by Rob Burnett, based on the 2015 novel of the same name by Jonathan Evison. Filming began on January 22, 2015, in Atlanta, Georgia. In early February filming took place in Cartersville, Georgia. Filming concluded on February 26, 2015, after 26 days of filming.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 130, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 351 }, { "error type": "Irrelevant", "explanation": "", "start": 352, "end": 434 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2016 American comedy-drama film, The Fundamentals of Caring, was written and directed by Rob Burnett, based on the 2012 novel \"The Revised Fundamentals of Caregiving\" by Jonathan Evison. Filming began on January 22, 2015, in Atlanta, Georgia. In early February filming took place in Cartersville, Georgia. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who scored the most goals in the premier league in a season?", "passages": [ [ "2014\u201315 Premier League", "2014\u201315", "Premier League\n\nThe 2014\u201315 Premier League (known as the Barclays Premier League for sponsorship reasons) was the 23rd season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The fixtures were announced on 18 June 2014.", "The season started on 16 August 2014 and concluded on 24 May 2015.", "Manchester City came into the season as defending champions of the 2013\u201314 season.", "Leicester City, Burnley and Queens Park Rangers entered as the three promoted teams.", "On 3 May 2015, Chelsea won the title with three games to spare after a 1\u20130 home win over Crystal Palace.", "It was their first league title since 2010, their fourth Premier League title and their fifth English league title overall.", "Holders Manchester City eventually finished second, after a short drop to fourth a few weeks before the final match.", "Burnley were the first team to be relegated despite beating Hull City 1\u20130, while Queens Park Rangers suffered the same fate after a 6\u20130 demolition by Manchester City the next day.", "Hull City were the third and final team to be relegated after a draw against Manchester United on the final day of the season.", "Manchester City's Sergio Ag\u00fcero won the Golden Boot with 26 goals, with his teammate Joe Hart clinching a record fourth Golden Glove, having kept 14 clean sheets." ], [ "Harry Kane", "On 23 December, Kane equalled Alan Shearer's record of 36 Premier League goals in a calendar year, having scored a hat-trick in a 0\u20133 away win to Burnley.", "He surpassed Shearer's record the following game with another hat-trick in the 5\u20132 home win against Southampton, ending the year with 39 Premier League goals.", "The hat-trick, his sixth of the year in the Premier League (eighth in all competitions), also made him the first player in Premier League history to score six hat-tricks in a year.", "With a total of 56 goals scored in all competitions for the year, he also became Europe's top goal scorer of 2017, breaking the seven-year dominance of Lionel Messi and Cristiano Ronaldo as Europe's top goalscorer in a calendar year.", "In January 2018, he scored twice in the 4\u20130 home win against Everton, and became Tottenham's top goalscorer in the Premier League era, breaking Teddy Sheringham's record of 97 Premier League goals for the club.", "On 4 February, Kane scored an added-time penalty to equalise in a 2\u20132 draw with Liverpool at Anfield for his 100th Premier League goal; he achieved the century of league goals in 141 games, beaten only by Alan Shearer's 124." ], [ "Harry Kane", "He was named in the PFA Team of the Year for the fourth consecutive season in April 2018, alongside fellow forwards Mohamed Salah and Sergio Ag\u00fcero.", "On 8 June, Kane signed a new contract to keep him at the club until 2024.", "Kane started the season opener against Newcastle United without scoring, before opening his account against Fulham the following weekend.", "In doing so he ended his hoodoo of failing to score a Premier League goal in the month of August.", "He also scored for the first time at Old Trafford in the following game as Tottenham won 3\u20130 in what was only their third away win against Manchester United since 1992 as well as the biggest away win against the club in 46 years.", "In January 2010, Kane was called up to play for the England under-17 team for the Algarve Tournament in Portugal.", "Kane missed the 2010 UEFA European Under-17 Championship due to illness, with England going on to win the tournament in his absence.", "He later moved up to the under-19s and scored twice in a 6\u20131 victory over Albania on 8 October 2010.", "Kane played a large role in the England under-19s progression to the semi-finals of the 2012 UEFA European Under-19 Championship in Estonia.", "Kane scored the winner against France in the final group stage match to ensure the team a safe passage through to the semi-finals." ] ], "gold": "Manchester City F.C. scored the most goals in the premier league in a season. Andy Cole and Alan Shearer scored the most goals in a 42 game season. Mohamed Salah scored the most goals in a 42 38 game season.", "prediction 1": "The player who scored the most Premier League goals in a season is Harry Kane, who set a record with 36 goals in a calendar year for the league. He also set a record with a hat-trick in a 0\u20133 away win to Burnley on December 23, 2014, and a hat-trick in a 5\u20132 home win against Southampton on December 23, 2014.\n", "prediction 2": "Harry Kane holds the record for most Premier League goals in a season with 36. In the 2014\u201315 season, the record was broken by Alan Shearer, who scored 36 Premier League goals in a calendar year.", "prediction 3": "Three players scored more premier league goals in a season than anyone else in the history of the league. Tim Howard scored the most Premier League goals in a season with 36, Alan Shearer scored 36, and Harry Kane scored 39.", "prediction 4": "In the Premier League, either players or teams have scored the most goals in a season. For example, Harry Kane, has scored the most goals in the Premier League in any season. In 2014-2015, Lionel Messi scored 53 Premier League goals in 7 games, and Ronaldo scored 32 in 2 games.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 310 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 83, "end": 86 } ], "missing-info": [], "corrected-prediction": "The player who scored the most Premier League goals in a season is Harry Kane, who equalled equalled Alan Shearer's a record with 36 goals in a calendar year for the league.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is dr sloan in kevin saves the world?", "passages": [ [ "Kevin (Probably) Saves the World", "Kevin (Probably) Saves the World\n\nKevin (Probably) Saves the World (stylized as Kevin ^", "Saves the World) is an American high-concept angelic-themed fantasy comedy-drama television series that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios.", "The series was greenlit on May 11, 2017, and aired on ABC as a Tuesday night entry during the 2017\u201318 television season.", "The series premiered on October 3, 2017.", "The show was set in Taylor, Texas.", "On May 11, 2018, ABC canceled the show after one season.", "Kevin, a down-on-his-luck man who survived a suicide attempt, moves in with his twin sister Amy, an engineer and professor at the local college, and Amy's teenage daughter Reese.", "Shortly after, he encounters a celestial being named Yvette; Yvette claims that God has tasked Kevin with saving the world, and sent Yvette to guide and protect him.", "At first, Kevin was the only one who could see and hear Yvette, so his conversations appear to be hallucinations to those around him.", "Kevin must perform good deeds to build up his spiritual powers, forcing him to become a better person." ] ], "gold": "Kevin (Probably) Saves the World is an American high-concept angelic-themed fantasy comedy-drama television series that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. In the series, Richard Masur plays Dr. Sloan, Kevin's therapist from New York.", "prediction 1": "Kevin Saves the World is an American high-concept angelic-themed fantasy comedy-drama television show that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. Dr. sloan, a nurse who helps Kevin save the world, is a character on the show.", "prediction 2": "Kevin Saves the World, aka Kevin Saves the World, is an American high-concept angelic-themed fantasy comedy-drama television series created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. In the show, Dr. Sloan is a physician who performs miracles and cures people of illness.", "prediction 3": "Kevin Saves the World is an American high-concept angelic-themed fantasy comedy-drama television series that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. Dr. Yvette is played by Yvette.", "prediction 4": "Kevin Saves the World is an American high-concept fantasy comedy-drama television series that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. Dr. Sloan plays a character on the show, who is a doctor with special powers.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Kevin Saves the World is an American high-concept angelic-themed fantasy comedy-drama television show that was created and executive produced by Michele Fazekas & Tara Butters for ABC Studios. Dr. sloan, a nurse who helps Kevin save the world, is a character on the show." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When does the resident season 1 come out on dvd?", "passages": [ [ "The Resident (TV series)", "Hulu currently owns the SVOD rights to the series, and individual episodes, or the season as a whole, are available for purchase on Amazon and iTunes.", "The first season DVD set was made available for pre-order in June 2018 through Amazon and was released on October 2, 2018.", "The review aggregator website, Rotten Tomatoes, reported an approval rating of 61% based on 18 reviews, with an average rating of 4.89/10.", "On Metacritic, which uses a normalized rating to reviews, assigned a weight average score of 54 out of 100, based on 12 critics.", "The first season received mostly mixed reviews.", "USA Today rated the series 1/2 out of 4 stars stating \"It's a shame, because it's a waste of the talents of Czuchry and VanCamp (Revenge), two usually appealing TV veterans\" and \"\"The Resident\" can't save itself\".", "Meanwhile, TV Line rated the series a B+ and said, \"The Resident takes a hard look at the thorny ethical issues surrounding today's health-care providers.\"", "The first season was also often compared to ABC's medical drama, \"The Good Doctor\".", "The series also proved to be unpopular with medical officials.", "A current medical student stated \"It harms the public by grossly misrepresenting core concepts of medicine\"." ], [ "The Resident (TV series)", "The Resident (TV series)\n\nThe Resident is an American medical drama television series aired by Fox Broadcasting Company that premiered on January 21, 2018, as a lead-out to the Vikings-Eagles NFC Championship, and as a mid-season replacement entry in the 2017\u201318 television season.", "The fictional series focuses on the lives and duties of staff members at Chastain Park Memorial Hospital, while delving into the bureaucratic practices of the hospital industry.", "The show was purchased by Fox from Showtime in 2017.", "It was created by Amy Holden Jones, Hayley Schore, and Roshan Sethi.", "On May 10, 2017, Fox ordered a full 14-episode season and renewed the series for a second season on May 7, 2018.", "The first season officially concluded on May 14, 2018.", "During the 2017\u20132018 United States television season, the series ranked #41 and averaged 7.02 million viewers.", "The second season premiered on September 24, 2018.", "The series revolves around the lives and actions of staff members at Chastain Park Memorial Hospital located in Atlanta, Georgia, primarily those of third-year resident internist, Conrad Hawkins; first-year medical intern, Devon Pravesh, who is assigned to Hawkins; as well as Nicolette \"Nic\" Nevin, a nurse practitioner and Hawkins' love interest." ], [ "Loudermilk (TV series)", "Loudermilk (TV series)\n\nLoudermilk is an American comedy television series created by Peter Farrelly and Bobby Mort that premiered on October 17, 2017 on Audience.", "The series stars Ron Livingston, Will Sasso, Laura Mennell, Anja Savcic, Mat Fraser, Toby Levins and Mark Brandon.", "In December 2018, it was announced that Audience had renewed the series for a third season.", "On April 12, 2018, it was announced that the series was renewed for a second season.", "On July 27, 2018, it was reported that it would premiere on October 16, 2018.", "On December 5, 2018, it was announced that the AT&T Audience Network has renewed the series for a third season.", "In the United Kingdom, Germany, and Italy, the series is distributed via Amazon Video." ] ], "gold": "The Resident is an American medical drama television series based on the book Unaccountable by Marty Makary. The season 1 DVD set came out on October 2, 2018 in Region 1 and on December 5, 2018 in Region 4.", "prediction 1": "The Resident is an American medical drama television series aired by Fox Broadcasting Company that premiered on January 21, 2018. The one-season DVD set was made available for pre-order in June 2018 through Amazon and was released on October 2, 2018.", "prediction 2": "Season 1 of the medical drama series The Resident was released on DVD on October 2, 2018. Season 3 of the comedy series Loudermilk was released on DVD on September 24, 2018.", "prediction 3": "The Resident is an American medical drama television series aired by Fox Broadcasting Company that premiered on January 21, 2018. The DVD set of the first season was made available for pre-order in June 2018 through Amazon and was released on October 2, 2018. The Resident season 1 premiered on January 21, 2018 as a lead-out to the Vikings-Eagles NFC Championship, and as a mid-season replacement entry in the 2017\u201318 television season.", "prediction 4": "The Resident is an American medical drama television series that premiered on January 21, 2018 at 10:30 PM ET/PT on Fox. The first DVD set was made available for pre-order in June 2018 through Amazon and was released on October 2, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 129 } ], "missing-info": [], "corrected-prediction": "The Resident is an American medical drama television series. The one-season DVD set was made available for pre-order in June 2018 through Amazon and was released on October 2, 2018." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "If there are 5 fluorines and 1 phosphorous atom. what is the formal name?", "passages": [ [ "Phosphorus pentafluoride", "Phosphorus pentafluoride\n\nPhosphorus pentafluoride, PF, is a phosphorus halide.", "It is a colourless, toxic gas that fumes in air.", "Phosphorus pentafluoride was first prepared in 1876 by the fluorination of phosphorus pentachloride using arsenic trifluoride, which remains a favored method:\n\nSingle-crystal X-ray studies indicate that the PF has trigonal bipyramidal geometry.", "Thus it has two distinct types of P\u2212F bonds (axial and equatorial): the length of an axial P\u2212F bond is distinct from the equatorial P-F bond in the solid phase, but not the liquid or gas phases due to Pseudo Berry Rotation.", "Fluorine-19 NMR spectroscopy, even at temperatures as low as \u2212100\u00a0\u00b0C, fails to distinguish the axial from the equatorial fluorine environments.", "The apparent equivalency arises from the low barrier for pseudorotation via the Berry mechanism, by which the axial and equatorial fluorine atoms rapidly exchange positions.", "The apparent equivalency of the F centers in PF was first noted by Gutowsky.", "The explanation was first described by R. Stephen Berry, after whom the Berry mechanism is named." ] ], "gold": "For 5 fluorines and 1 phosphorous atom, the IUPAC formal name is Phosphorus pentafluoride. In addition to Phosphorus pentafluoride, Phosphorus(V) fluoride, Pentafluoridophosphorus, and Pentafluorophosphorane are formal names for 5 fluorines and 1 phosphorous atom. Phosphorus pentafluoride was first prepared in 1876.", "prediction 1": "Phosphorus pentafluoride, PF, is a phosphorus halide. It is a colourless, toxic gas that fumes in air.", "prediction 2": "Phosphorus pentafluoride is a phosphorus halide, a colourless, toxic gas that fumes in air. Phosphorus pentafluoride was first prepared in 1876 by the fluorination of phosphorus pentachloride using arsenic trifluoride, which remains a favored method. Single-crystal X-ray studies indicate that the PF has trigonal bipyramidal geometry. Thus it has two distinct types of PF bonds: the length of an axial PF bond is distinct from the length of an equatorial P-F bond in the solid phase.", "prediction 3": "Phosphorus pentafluoride is a phosphorus halide. It is a colourless, toxic gas that fumes in air. Single-crystal X-ray studies indicate that the PF has trigonal bipyramidal geometry. Thus it has two distinct types of PF bonds (axial and equatorial): the length of an axial P-F bond is distinct from the equatorial P-F bond in the solid phase, but not the liquid or gas phases due to Pseudo Berry Rotation.", "prediction 4": "Phosphorus pentafluoride, PF, is a phosphorus halide. Single-crystal X-ray studies indicate that the PF has trigonal bipyramidal geometry, which means it has two distinct types of PF bonds (axial and equatorial).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 102 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Phosphorus pentafluoride, PF, is a phosphorus halide. Phosphorus pentafluoride was first prepared in 1876." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who plays in the big 12 football championship?", "passages": [ [ "Big 12 Championship Game", "Like the SEC Championship Game (which has been played since 1992), the game matched the winners of the conference's two six-team divisions.", "The championship game was held at several sites within the Big 12 states, with Arrowhead Stadium in Kansas City, Missouri, hosting more often than any other venue.", "The 2008 Big 12 Championship Game was notable for the controversy over choosing the South Division representative.", "The Oklahoma Sooners, Texas Longhorns, and Texas Tech Red Raiders all finished with identical records and had each recorded a win and loss amongst one another.", "The Sooners earned a berth to the title game because they had the highest Bowl Championship Series ranking of the three at the time of selection.", "Oklahoma defeated the Missouri Tigers and earned a berth in the 2009 BCS National Championship Game.", "From 2009 through 2013, the game was scheduled to be played at Cowboys Stadium, now known as AT&T Stadium, in Arlington, Texas.", "During June 2010, however, Nebraska and Colorado announced that they would leave the Big 12 for other conferences (the Big Ten Conference and the Pac-12 Conference, respectively) in 2011.", "Because NCAA rules at the time required that a conference have 12 members in order to stage a football championship game that was exempt from NCAA limits on regular-season games, the conference dropped the championship game following the 2010 season." ], [ "2017 Oklahoma Sooners football team", "2017 Oklahoma Sooners football team\n\nThe 2017 Oklahoma Sooners football team represented the University of Oklahoma in the 2017 NCAA Division I FBS football season, the 123rd season of Sooner football.", "The team was led by Lincoln Riley, who was in his first year as head coach, after the retirement of Bob Stoops in June 2017.", "They played their home games at Gaylord Family Oklahoma Memorial Stadium in Norman, Oklahoma.", "They are a charter member of the Big 12 Conference.", "Conference play began with a 49\u201341 win against Baylor in Waco, Texas and ended with a 59\u201331 win against West Virginia in Norman, Oklahoma.", "Oklahoma finished conference play with the best record in the conference with an 8\u20131 record.", "They went on to play TCU in the 2017 Big 12 Championship Game which they won 41\u201317 to win their twelfth Big 12 Championship and their third consecutive.", "Oklahoma was selected as the 2nd seed to play in the 2017 College Football Playoff and lost to the 3rd seed Georgia in the Rose Bowl.", "Sooners quarterback Baker Mayfield earned several national honors, including winning the school's sixth Heisman Trophy, distinguishing him as the best player in college football during the 2017 season.", "Mayfield threw for 4,627 yards and 43 passing touchdowns on the year, second in FBS in both categories." ], [ "2018 Big 12 Championship Game", "2018 Big 12 Championship Game\n\nThe 2018 Big 12 Championship Game was a college football game played on Saturday, December 1, 2018, at AT&T Stadium in Arlington, Texas.", "The 17th Big 12 Championship Game, it determined the 2018 champion of the Big 12 Conference.", "The game featured the Oklahoma Sooners and the Texas Longhorns.", "These respectively were the 10th and sixth appearances for Oklahoma and Texas in the conference championship game.", "Texas defeated Oklahoma 48\u201345 in their regular-season meeting in the annual Red River Showdown.", "The game was also the first time since 1903 that the two teams played twice in the same season and the first time since 1929 that a game between the two was not played in the Cotton Bowl.", "The game was televised nationally by ABC.", "The game also broke the Conference Championship attendance record, breaking the record previously held by the 1992 SEC Championship Game.", "This was the second time since 2010 that the conference champion was determined in a championship game.", "Formerly the Big 12 Championship Game was played between the champions of the North Division and the South Division.", "Without a current Big 12 divisional structure, the game is played between the two teams with the best conference records.", "The 2017 Big 12 Championship Game was the first since the conference's realignment.", "Televised nationally by Fox, the game featured the Oklahoma Sooners and the TCU Horned Frogs." ] ], "gold": "In 2015, the Clemson Tigers took on the Oklahoma Sooners football team, with Oklahoma coming out on top. 2016's Big 12 Championship saw the returning Sooners go head to head with the Auburn Tigers, where, again, they prevailed. Then in 2017, OU beat the Georgia Bulldogs to continue their winning streak.", "prediction 1": "The Big 12 Football Championship is a conference football championship game played between the champions of the conference's two six-team divisions. The winners of the North Division play in the North Division. The South Division plays in the South Division. The 2017 Oklahoma Sooners play in the Big 12 Football Championship.", "prediction 2": "The Big 12 football championship game is played between the champions of the conference's two six-team divisions. The North Division team typically plays in the championship game while the South Division team plays in the championship game. The Texas Longhorns play in the championship game, while the Oklahoma Sooners play in the championship game. The Texas Longhorns play in the championship game, which is played between the teams that finished with the best regular-season records.", "prediction 3": "The Big 12 Football Championship is a football championship game played between the champions of the conference's two six-team divisions. The championship game is played between the Oklahoma Sooners and the Texas Longhorns. The Oklahoma Sooners play in the football championship game each year, while the Texas Longhorns play in the football championship game each year.", "prediction 4": "The Big 12 Football Championship is a regular-season football game played between the champions of the conference's two six-team divisions, the North Division and the South Division. The Oklahoma Sooners, Texas Longhorns, and Texas Tech Red Raiders play in the Big 12 Championship. The 2017 Oklahoma Sooners football team represented the University of Oklahoma in the 2017 NCAA Division I FBS football season, the 123rd season of Sooner football. In 2018, the Oklahoma Sooners played TCU in the Big 12 Championship Game, which they won 41\u201317 to win their twelfth Big 12 Championship and their third consecutive. The 2018 Big 12 Championship Game featured the Oklahoma Sooners and the Texas Longhorns, respectively were the 10th and 6th appearances for Oklahoma and the 6th and the 7th Big 12 Championship Game, respectively were the 10th and the 6th and the 7th Big 12 Championship Game, which was played between", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 75 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 13 ] } ], "corrected-prediction": "The Big 12 Football Championship is played between the champions of the conference's two six-team divisions. The 2017 Big 12 Championship Game featured the Oklahoma Sooners and the TCU Horned Frogs. In 2018 it featured the Oklahoma Sooners and the Texas Longhorns." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who won for america's got talent 2018?", "passages": [ [ "America's Got Talent (season 13)", "America's Got Talent (season 13)\n\nSeason thirteen of the reality competition series \"America's Got Talent\" premiered on May 29, 2018, on NBC.", "Howie Mandel, Mel B, Heidi Klum and Simon Cowell returned as judges for their respective ninth, sixth, sixth, and third seasons.", "Meanwhile, Tyra Banks returned for her second season as host.", "The live shows returned to the Dolby Theatre, beginning August 14, 2018.", "\"AGT\" is co-produced by FremantleMedia North America and Syco Entertainment, Cowell's company.", "Dunkin Donuts is a sponsor for a fourth consecutive season.", "Shin Lim was named the winner on the season finale, September 19, 2018.", "This marks the second magician to win.", "Acrobatic group Zurcaroh and violinist Brian King Joseph came in second and third place respectively.", "The season had preliminary open call auditions in Orlando, Cincinnati, Savannah, Milwaukee, Houston, Las Vegas, New York City, Nashville, and Los Angeles.", "As in years past, prospective contestants could also submit online auditions.", "Auditions were taped from March 6-23 at the Pasadena Civic Auditorium in Los Angeles and began to air on May 29, 2018.", "The golden buzzer returned for its fifth consecutive season." ], [ "Shin Lim", "Shin Lim\n\nShin Lim (born September 25, 1991 in British Columbia, Canada) is a Canadian-American magician recognized for his use of card manipulation and sleight of hand, and widely known as the winner of America's Got Talent (season 13).", "He is known for elaborate close-up card magic routines, during which he remains silent with the tricks set to music, including his award-winning acts \"The Dream Act\" and \"52 Shades of Red\".", "He is self-taught, having learned most of his skills from watching YouTube.", "Since then, he has shared some of his techniques on YouTube.", "Originally educated to be a pianist, he took up magic as his career after being diagnosed with carpal tunnel syndrome.", "Lim was discovered around 2012 and began to tour internationally, and subsequently won the 2015 F\u00e9d\u00e9ration Internationale des Soci\u00e9t\u00e9s Magiques in Close-up Card Magic.", "His appearances on \"\" and his win on \"America's Got Talent\" during its 13th season in 2018 led to more international fame.", "Lim is the second of three children of Singapore-born parents and is ethnically Han Chinese.", "He was born in Vancouver, where his dad was completing his post graduate studies.", "His family returned to Singapore when he was 2 and moved to Acton, Massachusetts when he was 11.", "Lim attended the Acton-Boxborough Regional High School." ], [ "Zurcaroh", "Zurcaroh\n\nZurcaroh is an acrobatic show group based in G\u00f6tzis, Austria, and directed by Brazilian choreographer Peterson da Cruz Hora.", "The group became internationally known after they won a golden buzzer on the 2017 season of France's Got Talent, and again on season 13 of America's Got Talent, where they finished second overall.", "Peterson da Cruz Hora, a choreographer from S\u00e3o Paulo, originally founded the group in 2007 in Brazil.", "In 2009, after moving to Austria, he decided to refound the group there with a local crew.", "Their first international appearance as an Austrian group occurred in 2011, in Lausanne, Switzerland.", "Some of the moves and routines are unique or rarely seen in dance routines.", "These include multiple flips at once and circus style trapeze acts.", "One move has two dancers doing cartwheel-style somersaults off the ground, landing each revolution on fellow performers' arms.", "Another has a dancer acting as a jump rope.", "Peterson explained why it was important for the troupe to audition for AGT, \"Because this is the biggest stage in the world where we can share our skills and our talent.\"", "He went on to say how the group accepts dancers, gymnasts, and acrobats at all levels.", "As of May 2018, there are 31 members in the troupe." ] ], "gold": "There were several winners on the 13th season of NBC's talent show series America's Got Talent in 2018. First place was won by Shin Lim, a Canadian-American close-up magician recognized for his use of card manipulation and sleight of hand. The acrobatic show group Zurcaroh won runner-up, and electric violinist Brian King Joseph won third place.", "prediction 1": "Shin Lim was named the winner for America's Got Talent 2018 on the season finale, September 19, 2018. Acrobatic group Zurcaroh and violinist Brian King Joseph came in second and third place respectively.", "prediction 2": "Shin Lim was named the winner of America's Got Talent in the season finale, September 19, 2018. This marks the second magician to win the series. Acrobatic group Zurcaroh and violinist Brian King Joseph came in second and third place respectively.", "prediction 3": "Shin Lim, a Canadian-American magician recognized for his use of card manipulation and sleight of hand, was named the winner of America's Got Talent season 13 on the season finale, September 19, 2018. Acrobatic group Zurcaroh, a group based in G\u00f6tzis, Austria, and directed by Brazilian choreographer Peterson da Cruz Hora, came in second and third place respectively.", "prediction 4": "Shin Lim, a Canadian-American magician, won the season finale of America's Got Talent 2018. This marks the second time a magician has won the competition. Acrobatic group Zurcaroh and violinist Brian King Joseph came in second and third place respectively.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Shin Lim, a Canadian-American magician recognized for his use of card manipulation and sleight of hand, was named the winner for America's Got Talent 2018 on the season finale, September 19, 2018. Acrobatic group Zurcaroh and violinist Brian King Joseph came in second and third place respectively." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who wrote i was born under a wandering star?", "passages": [ [ "Wand'rin' Star", "Wand'rin' Star\n\n\"Wand'rin' Star\" was a number one single in the UK and Ireland for Lee Marvin for three weeks in March 1970.", "It was originally written by Alan J. Lerner (lyrics) and Frederick Loewe (music) for the stage musical \"Paint Your Wagon\" in 1951.", "When the film of the musical was made in 1969, Lee Marvin took the role of prospector Ben Rumson.", "Not a natural singer, Marvin nevertheless sang all of his songs in the film, rejecting the idea of miming to another singer's voice.", "Despite the film being a box office flop, the soundtrack became a success.", "Orchestrated and arranged by Nelson Riddle, Marvin's version of the song \"Wand'rin Star\" became a number-one single in Ireland and the UK, keeping The Beatles at number two in the UK with their single \"Let It Be\".", "Marvin never released a follow-up single, so he is considered a one-hit wonder.", "A sound-alike cover appeared on the 1970 album \"Top of the Pops, Volume 10\", with one reviewer using terms like \"laryngitic croak\" and \"gargling gargoyles\" to describe how he felt about the cover." ], [ "Alan Jay Lerner", "Their first hit was \"Brigadoon\" (1947), a romantic fantasy set in a mystical Scottish village, directed by Robert Lewis.", "It was followed in 1951 by the Gold Rush story \"Paint Your Wagon\".", "While the show ran for nearly a year and included songs that later became pop standards, it was less successful than Lerner's previous work.", "He later said of \"Paint Your Wagon\", it was \"a success but not a hit.\"", "Lerner worked with Kurt Weill on the stage musical \"Love Life\" (1948) and Burton Lane on the movie musical \"Royal Wedding\" (1951).", "In that same year Lerner also wrote the Oscar-winning original screenplay for \"An American in Paris\", produced by Arthur Freed and directed by Vincente Minnelli.", "This was the same team who would later join with Lerner and Loewe to create \"Gigi\".", "In 1956, Lerner and Loewe unveiled \"My Fair Lady\".", "Before finishing the musical, Lerner was eager to write while \"My Fair Lady\" was taking so long to complete.", "Burton Lane and Lerner were working on a musical about Li'l Abner.", "Gabriel Pascal owned the rights to \"Pygmalion\", which had been unsuccessful with other composers who tried to adapt it into a musical." ], [ "Alan Jay Lerner", "Alan Jay Lerner\n\nAlan Jay Lerner (August 31, 1918 \u2013 June 14, 1986) was an American lyricist and librettist.", "In collaboration with Frederick Loewe, and later Burton Lane, he created some of the world's most popular and enduring works of musical theatre both for the stage and on film.", "He won three Tony Awards and three Academy Awards, among other honors.", "Born in New York City, he was the son of Edith Adelson Lerner and Joseph Jay Lerner, whose brother, Samuel Alexander Lerner, was founder and owner of the Lerner Stores, a chain of dress shops.", "One of Lerner's cousins was the radio comedian and television game show panelist Henry Morgan.", "Lerner was educated at Bedales School in England, The Choate School (now Choate Rosemary Hall) in Wallingford, Connecticut, (where he wrote \"The Choate Marching Song\") and Harvard.", "He attended both Camp Androscoggin and Camp Greylock.", "At both Choate and Harvard, Lerner was a classmate of John F. Kennedy's; at Choate they had worked together on the yearbook staff.", "Like Cole Porter at Yale and Richard Rodgers at Columbia, his career in musical theater began with his collegiate contributions, in Lerner's case to the annual Harvard Hasty Pudding musicals." ] ], "gold": "Alan Jay Lerner wrote the lyrics for Wand'rin Star, while Frederick Loewe wrote the music for the song. Lerner and Loewe collaborated on some of the world's most popular and enduring works for musical theatre both for the stage and on film. Wand'rin Star was originally written for the stage musical Paint Your Wagon. In addition to Paint Your Wagon, some of Lerner and Loewe's collaborations include My Fair Lady, Pygmalion, Gigi and Camelot. ", "prediction 1": "Alan Jay Lerner wrote lyrics and music for the 1951 stage musical \"Paint Your Wagon\". Frederick Loewe wrote music and the music for the 1970 film, which featured Lee Marvin as prospector Ben Rumson. In collaboration with Lerner and Loewe, he created some of the world's most popular and enduring works of musical theatre, both for the stage and on film. In 1970, Lee Marvin sang Wand'rin Star, which was a number one single in the UK and Ireland for three weeks in March 1970.", "prediction 2": "\"Wand'rin' Star\" was originally written by Alan J. Lerner (lyrics) and Frederick Loewe (music) for the stage musical \"Paint Your Wagon\" in 1951. In collaboration with Frederick Loewe, and later Burton Lane, he created some of the world's most popular and enduring works of musical theatre both for the stage and on film. In 1960, Lerner wrote the original screenplay for the musical \"Gigi\". In 1964, Lerner and Loewe combined to create the song \"I was born under a wandering star\" as a number one single in the UK and Ireland. It was also a number one single in the UK and Ireland for three weeks in March 1970.", "prediction 3": "\"Wand'rin' Star\" was originally written by Alan J. Lerner (lyrics) and Frederick Loewe (music) for the stage musical \"Paint Your Wagon\" in 1951. In collaboration with Frederick Loewe, and later Burton Lane, he created some of the world's most popular and enduring works of musical theatre both for the stage and on film. In 1950, Lerner wrote the Oscar-winning original screenplay for the movie musical \"Royal Wedding\". In 1960, American composer and libretttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttt", "prediction 4": "\"Wand'rin' Star\" was a number one single in the UK and Ireland for three weeks in March 1970. It was originally written by Alan Jay Lerner (lyrics) and Frederick Loewe (music) for the stage musical \"Paint Your Wagon\" in 1951. In collaboration with Frederick Loewe, and later Burton Lane, he created some of the world's most popular and enduring works of musical theatre both for the stage and on film. In collaboration with Alan Jay Lerner, and later, they created some of the world's most popular and enduring works of musical theatre both for the stage and on film.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 114, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 476 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Alan Jay Lerner wrote the lyrics for Wand'rin Star, while Frederick Loewe wrote the music for the song. In collaboration with Lerner and Loewe, he created some of the world's most popular and enduring works of musical theatre, both for the stage and on film. In addition to Paint Your Wagon, some of Lerner and Loewe's collaborations include My Fair Lady." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Which is the highest collection movie in tamil?", "passages": [ [ "Baahubali 2: The Conclusion", "Production design was done by Sabu Cyril, while the action sequences were choreographed by Peter Hein.", "The visual effects were designed by R. C. Kamalakannan, with assistance from Adel Adili and Pete Draper.", "The soundtrack and background music was composed by M. M. Keeravani.", "Released in conventional 2D and IMAX formats, \"The Conclusion\" was the first Telugu film to also release in 4K High Definition format.", "Grossing worldwide, \"The Conclusion\" surpassed \"PK\" (2014) to briefly become the highest grossing Indian film of all time, collecting approximately worldwide within just six days of its release.", "It became the first ever Indian film to gross over , doing so in just ten days.", "Within India, it set many films records, becoming the highest-grossing film in Hindi, as well as in its original Telugu and Tamil languages.", "It stands as the highest grossing film in India, the second highest-grossing Indian film worldwide and the 39th highest-grossing film of 2017.", "The film sold an estimated 100million tickets (all languages combined) during its box office run, the highest estimated footfall for any film in India since \"Sholay\" (1975).", "\"The Conclusion\" released to positive reviews from critics.", "It was also praised by the actors of the film industry alike." ], [ "Prabhas", "Way2movies also gave a rating of 3.25/5, giving the verdict that \"Prabhas rocks the show in this decent yet formulaic commercial entertainer\".", "Super good movies gave the film 3 stars in a scale of 5, reviewing that \"Go and Watch \"Mirchi\", It entertains both Class and Mass.", "It is a worth watch\"..", "In 2015 he appeared as Shivudu/Mahendra Baahubali and Amarendra Baahubali in S.S. Rajamouli's epic \"\".The film was made on a budget of \u20b9180 crore (US$25 million), making it the most expensive Indian film at its time of release.", "The film opened worldwide on 10 July 2015, garnering critical acclaim and record breaking box office success.", "With a worldwide box office gross of \u20b9650 crore (US$90 million), it became the highest-grossing film in India, third highest-grossing Indian film worldwide, and highest-grossing South Indian film, at the time of its release.", "Its Hindi dubbed version also broke several records by becoming the highest grossing dubbed film in India.", "Both budget and box office records have since been surpassed by Baahubali 2: The Conclusion, the second highest grossing Indian film of all time." ], [ "Kabali (film)", "Kabali (film)\n\nKabali is a 2016 Indian Tamil-language gangster film written and directed by Pa. Ranjith and produced by Kalaipuli S. Thanu.", "The film plot concerns the gang war between Kabaleeswaran (played by Rajinikanth) and Tony Lee (portrayed by Winston Chao).", "Radhika Apte, Dhansika, Dinesh Ravi, Kalaiyarasan, and John Vijay also star in pivotal roles.", "Principal photography for the film began on 21 August 2015 in Chennai.", "While filming mostly occurred in Malaysia, some scenes were shot in Bangkok and Hong Kong.", "The film was released in Tamil along with dubbed versions in Telugu and Hindi on 22 July 2016, while the film was released in Malay a week later.", "\"Kabali\" was released on 3200 screens in India, of which 2200 were in South India.", "A Kuala Lumpur\u2013based don Kabaleeswaran alias Kabali (Rajinikanth) is released after spending 25 years in prison on a false charge of starting a massacre at a local Hindu temple that killed many, including his wife Kumudhavalli alias Kumudha (Radhika Apte).", "He immediately resumes charge of his old gang and soon confronts Loganathan alias Loga (Mime Gopi), a drug smuggler." ] ], "gold": "In 2015 the highest collecting film in Tamil was Baahubali: The Beginning, which was the highest-grossing film in India, third highest-grossing Indian film worldwide, and highest-grossing South Indian film, at the time of its release. In 2016, the highest collecting movie in Tamil was Kabali, a 2016 Indian Tamil-language action crime film written and directed by Pa. Ranjith and produced by Kalaipuli S. Thanu and starring Rajinikanth in the titular role, with Radhika Apte, Winston Chao, Sai Dhanshika, Kishore, Dinesh, Kalaiyarasan and John Vijay in supporting roles. In 2017, the highest collecting film was Baahubali 2: The Conclusion, which was the first ever Indian film to gross over \u20b910 billion, doing so in just ten days. Baahubali 2: The Conclusion was the highest collecting movie in Tamil of all time.", "prediction 1": "The highest collection movie in Tamil is Kabali, a 2016 Indian Tamil-language gangster film written and directed by Rajinikanth and produced by Kalaipuli S. Thanu. The movie had a worldwide box office gross of 650 crore (US$90 million). It sold an estimated 100 million tickets (all languages combined) during its box office run, the highest estimated footfall for any film in India since \"Sholay\" (1975).", "prediction 2": "The highest collection movie in Tamil cinema history is Kabali. It is the highest collection movie in Telugu history. PK was the highest collection movie in Telugu history. Kabali is the highest collection movie in Tamil in history. It is the highest collection movie in Tamil in history.", "prediction 3": "The highest grossing film in Tamil is Kabali, with a worldwide box office gross of 650 crore. The highest grossing movie in Telugu is PK, with a worldwide box office gross of 606 million. The highest grossing film in Telugu is Yami Gautam's The Rise of the Cobra, with a worldwide box office gross of 690 million. The highest collection movie in Telugu is Yami Gautam's The Rise of the Cobra, which has the highest collection movie in the highest collection movie in Telugu and Tamil is Kabali, with a worldwide box office gross of 650 crore, making it the highest collection film in Telugu and Tamil languages.", "prediction 4": "The highest collection movie in Tamil is Kabali, which was released on 22 July 2016. It is the highest grossing movie in Tamil in 2016 and the highest collection movie in Telugu in 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 48 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 164, "end": 173 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 237, "end": 239 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 405 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 236 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4, 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Kabali is a 2016 Indian Tamil-language gangster film written and directed by Pa. Ranjith and produced by Kalaipuli S. Thanu. It stars Rajinikanth, Winston Chao, Radhika Apte, Dhansika, Dinesh Ravi, Kalaiyarasan, and John Vijay. The movie Prabhas was in 2015 would became the highest-grossing film in India, third highest-grossing Indian film worldwide, and highest-grossing South Indian film, at the time of its release. Baahubali 2: \"The Conclusion\" briefly become the highest grossing Indian film of all time. It broke a gross amount record in just ten days." }, "preference": [ 0, 0, 1, 0, 0, 0 ] }, { "question": "Where is alpha amylase found in the body?", "passages": [ [ "Alpha-amylase", "Salivary amylase is inactivated in the stomach by gastric acid.", "In gastric juice adjusted to pH 3.3, ptyalin was totally inactivated in 20 minutes at 37\u00a0\u00b0C.", "In contrast, 50% of amylase activity remained after 150 minutes of exposure to gastric juice at pH 4.3.", "Both starch, the substrate for ptyalin, and the product (short chains of glucose) are able to partially protect it against inactivation by gastric acid.", "Ptyalin added to buffer at pH 3.0 underwent complete inactivation in 120 minutes; however, addition of starch at a 0.1% level resulted in 10% of the activity remaining, and similar addition of starch to a 1.0% level resulted in about 40% of the activity remaining at 120 minutes.", "The salivary amylase gene has undergone duplication during evolution, and DNA hybridization studies indicate many individuals have multiple tandem repeats of the gene.", "The number of gene copies correlates with the levels of salivary amylase, as measured by protein blot assays using antibodies to human amylase.", "Gene copy number is associated with apparent evolutionary exposure to high-starch diets.", "For example, a Japanese individual had 14 copies of the amylase gene (one allele with 10 copies, and a second allele with four copies)." ], [ "Alpha-amylase", "Alpha-amylase\n\nAlpha-amylase, (\u03b1-amylase) is a protein enzyme that hydrolyses alpha bonds of large, alpha-linked polysaccharides, such as starch and glycogen, yielding glucose and maltose.", "It is the major form of amylase found in humans and other mammals.", "It is also present in seeds containing starch as a food reserve, and is secreted by many fungi.", "Although found in many tissues, amylase is most prominent in pancreatic juice and saliva, each of which has its own isoform of human \u03b1-amylase.", "They behave differently on isoelectric focusing, and can also be separated in testing by using specific monoclonal antibodies.", "In humans, all amylase isoforms link to chromosome 1p21 (see AMY1A).", "Amylase is found in saliva and breaks starch into maltose and dextrin.", "This form of amylase is also called \"ptyalin\" It will break large, insoluble starch molecules into soluble starches (amylodextrin, erythrodextrin, and achrodextrin) producing successively smaller starches and ultimately maltose.", "Ptyalin acts on linear \u03b1(1,4) glycosidic linkages, but compound hydrolysis requires an enzyme that acts on branched products." ], [ "Alpha-amylase", "The Japanese diet has traditionally contained large amounts of rice starch.", "In contrast, a Biaka individual carried six copies (three copies on each allele).", "The Biaka are rainforest hunter-gatherers who have traditionally consumed a low-starch diet.", "Perry and colleagues speculated the increased copy number of the salivary amylase gene may have enhanced survival coincident to a shift to a starchy diet during human evolution.", "Pancreatic \u03b1-amylase randomly cleaves the \u03b1(1-4) glycosidic linkages of amylose to yield dextrin, maltose, or maltotriose.", "It adopts a double displacement mechanism with retention of anomeric configuration.", "The test for amylase is easier to perform than that for lipase, making it the primary test used to detect and monitor pancreatitis.", "Medical laboratories will usually measure either pancreatic amylase or total amylase.", "If only pancreatic amylase is measured, an increase will not be noted with mumps or other salivary gland trauma.", "However, because of the small amount present, timing is critical when sampling blood for this measurement.", "Blood should be taken soon after a bout of pancreatitis pain, otherwise it is excreted rapidly by the kidneys." ] ], "gold": "Alpha amylase is mainly found in two different parts of the body: the saliva and the pancreatic juice. Pancreatic alpha amylase randomly cleaves the alpha glycosidic linkages of amylose to yield dextrin, maltose, or maltotriose. It adopts a double displacement mechanism with retention of anomeric configuration. In humans, the salivary amylase evolved from a copy of it.", "prediction 1": "Alpha-amylase is a protein enzyme that hydrolyses alpha bonds of large, alpha-linked polysaccharides, such as starch and glycogen, yielding glucose and maltose. Though found in many tissues, amylase is most prominent in pancreatic juice and saliva. Each of these tissues has its own isoform of human -amylase, which behave differently on isoelectric focusing, and can also be separated in testing by using specific monoclonal antibodies.", "prediction 2": "Alpha-amylase is a protein enzyme that hydrolyses alpha bonds of large, alpha-linked polysaccharides, such as starch and glycogen, yielding glucose and maltose. It is also present in seeds containing starch as a food reserve, and is secreted by many fungi. Although found in many tissues, amylase is most prominent in pancreatic juice and saliva, each of which has its own isoform of human -amylase. They behave differently on isoelectric focusing, and can also be separated in testing by using specific monoclonal antibodies.", "prediction 3": "Alpha-amylase, (-amylase), is a protein enzyme that hydrolyses alpha bonds of large, alpha-linked polysaccharides, such as starch and glycogen, yielding glucose and maltose. It is the major form of amylase found in humans and other mammals. Amylase is found in pancreatic juice and saliva, each of which has its own isoform of human -amylase.", "prediction 4": "Alpha amylase is a protein enzyme that hydrolyses alpha bonds of large, alpha-linked polysaccharides, such as starch and glycogen, yielding glucose and maltose. Although found in many tissues, amylase is most prominent in pancreatic juice and saliva, each of which has its own isoform of human -amylase. They behave differently on isoelectric focusing, and can also be separated in testing by using specific monoclonal antibodies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 160 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 437 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Alpha-amylase, though found in many tissues, amylase is most prominent in pancreatic juice and saliva. Pancreatic \u03b1-amylase randomly cleaves the \u03b1(1-4) glycosidic linkages of amylose to yield dextrin, maltose, or maltotriose. It adopts a double displacement mechanism with retention of anomeric configuration. The salivary amylase gene has undergone duplication during evolution." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who does candace like in phineas and ferb?", "passages": [ [ "Candace Flynn", "She often over complicates things in their relationships and worries that Jeremy doesn't like her when in truth he is always shown to care deeply for her: Candace's insecurity blinds her to the fact that she has already won him over.", "Candace tends to get annoyed with Perry when he gets to her bed while she's sleeping.", "Although she gets annoyed with Perry, she does generally care for him, as seen in such episodes as \"Mom's Birthday\", \"Traffic Cam Caper\" and \"Sidetracked\".", "Candace blamed herself for Perry's disappearance in \"Oh, There You Are, Perry\" when he was actually reassigned to a more dangerous villain.", "Candace saw Perry as a secret agent two times while she was dreaming or hallucinating, as it was seen in episodes \"The Ballad of Badbeard\" and \"Wizard of Odd\".", "(\"Phineas and Ferb Gets Busted\" doesn't count, considering \"Perry\" was the one dreaming about Candace dreaming.)", "There is a recurring (but unexplained) zebra that pops up whenever Candace is dreaming or hallucinating that calls her \"Kevin\".", "At one point she asked Phineas and Ferb about it, and they claimed to have no knowledge of it." ], [ "Candace Flynn", "Candace Flynn\n\nCandace Gertrude Flynn is a main character of the Disney Channel animated television series \"Phineas and Ferb\", voiced by Ashley Tisdale and created and designed by Dan Povenmire.", "She first appeared in the series' pilot episode along with the other main characters who star in the A-Plot.", "Candace is part of a blended family, a decision made after an experience Swampy Marsh had in his childhood.", "In the series, she has two younger brothers, Phineas Flynn and Ferb Fletcher, with Phineas being a biological brother and Ferb a step-brother.", "She is the pair's sister.", "Her best friend is Stacy Hirano.", "Candace speaks in a valley girl accent, especially when conversing with Stacy.", "Her birthday is on July 11.", "Unbeknownst to her and the other family members, their pet platypus, Perry, is an espionage secret agent who fights Dr. Doofenshmirtz, an evil genius.", "She is unaware that his battle with Dr. Doofenshmirtz is the cause of many Phineas and Ferb's inventions' disappearances.", "In \"Phineas and Ferb's Quantum Boogaloo\", it is shown that she will have three children in the future: Xavier, Fred and Amanda." ], [ "Mitchel Musso", "Mitchel Musso\n\nMitchel Tate Musso (born July 9, 1991) is an American actor, musician, and singer, best known for his three Disney Channel roles as Oliver Oken/Mike Standley III in \"Hannah Montana\"; Jeremy Johnson in the animated series \"Phineas and Ferb\"; and his Disney XD role as King Brady on \"Pair of Kings\".", "He was the host of Disney Channel's \"PrankStars\".", "In some of his other works, he voiced DJ in the computer animated/motion capture film, \"Monster House\", and starred as Raymond Figg in the Disney Channel Original Movie, \"Life Is Ruff\", released in 2005.", "Musso's self-titled debut album was released on June 2, 2009 on Walt Disney Records.", "The album debuted at number 19 on the \"Billboard\" 200.", "Musso was born in Garland, Texas, the son of Katherine (n\u00e9e Moore) and Samuel Musso, who were involved in community theater in Dallas, Texas.", "He has two brothers \u2013 Mason Musso, who sings lead vocals in the band Metro Station with Miley Cyrus' brother Trace, and Marc Musso, an actor.", "He grew up in Rockwall, Texas.", "In 2003, Mitchel made his Hollywood film debut in \"Secondhand Lions\", alongside his brother Marc." ] ], "gold": "The character Candace likes in Phineas and Ferb is Jeremy Johnson, who is played by Mitchel Musso, an American actor, singer, and songwriter best known for his three Disney Channel roles. In the Disney Channel animated television series, Jeremy is the character Candace Flynn's crush and later boyfriend.", "prediction 1": "Candace Flynn is a main character of the Disney Channel animated television series Phineas and Ferb, voiced by Ashley Tisdale and created and designed by Dan Povenmire. In the series, she gets annoyed with Perry when he gets to her bed while she's sleeping. Although she gets annoyed with Perry, she does generally care for him, as seen in such episodes as Mom's Birthday, Traffic Cam Caper and Sidetracked.", "prediction 2": "In the Disney Channel animated television series Phineas and Ferb, Candace Gertrude Flynn, played by Ashley Tisdale, a recurring character, the character loves Perry, the platypus who protects Phineas and Ferb from evil forces. American actor, musician, and singer Mitchel Musso plays Jeremy Johnson, Candace's older brother, who is an espionage secret agent.", "prediction 3": "In the Disney Channel animated television series Phineas and Ferb, Candace is a main character who is played by Ashley Tisdale and voiced by Dan Povenmire. She does not like Jeremy Johnson, but does like him in the episodes \"Mom's Birthday\", \"Traffic Cam Caper\" and \"Sidetracked\".", "prediction 4": "In the Disney Channel animated television series Phineas and Ferb, Candace Gertrude Flynn is a main character and is voiced by Ashley Tisdale. Although she gets annoyed with Perry, she does generally care for him, as seen in such episodes as Mom's Birthday, Traffic Cam Caper, and Sidetracked. There is a recurring (but unexplained) zebra that pops up whenever Candace is dreaming or hallucinating, as it was seen in episodes The Ballad of Badbeard and Wizard of Odd. At one point she asked Phineas and Ferb about it, and they claimed that they had no knowledge of it.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 407 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Candace Flynn is a main character of the Disney Channel animated television series Phineas and Ferb, In the series, she has a relationship with Jeremy Johnson, voiced by Mitchel Musso, an American actor, musician, and singer, best known for his three Disney Channel roles." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first ipod video come out?", "passages": [ [ "IPod Classic", "The fifth-generation iPod featured a 2.5\" 320\u00d7240 QVGA screen and a smaller Click Wheel.", "It was the first iPod to be able to play videos.", "The fifth-generation iPod is the first iPod to be available in an alternative color scheme in a non-special-edition form, as a black option was added alongside \"Signature iPod White\", and marked the second full redesign of the iPod's aesthetic with its re-arranged proportions, its return to a fully flat front plate, and its more rounded rear casing.", "The 4-pin remote port was removed as well, causing backwards compatibility issues with certain accessories.", "A 30GB model was offered for US$299 and a 60GB model was offered for US$399.", "The fifth-generation iPod was also offered in the U2 special edition for US$349 with 30\u00a0GB.", "The fifth-generation iPod was the last model to have a plastic face.", "The fifth-generation iPod plays video in MP4 (up to 2.5\u00a0Mbit/s) and H.264 (up to 768\u00a0kbit/s, baseline profile only) formats.", "The fifth-generation enhance iPod and or 1st revision plays video in MP4 (up to 2.5\u00a0Mbit/s) and H.264 (up to 1.5\u00a0Mbit/s, baseline profile only) formats." ], [ "IPod Nano", "\"This change means that any dock accessories that use the dock connector's FireWire pins to send power\u2014many older speakers and car chargers, for example\u2014will not charge the fourth-generation iPod Nano.\"", "At Apple's September 9, 2009 event, a fifth generation iPod Nano was unveiled with reduced prices on the larger model (at the time of release, the 8GB was priced at $149 and the 16GB at $179), a larger, diagonal screen (up from in third and fourth generation iPod Nanos), which was also wider, integrated video camera with 16 special effects, microphone, FM Radio with iTunes tagging (via RDS) multiple radio regions including Americas, Asia, Australia, Europe, and Japan.", "As well as continuing to support picture viewing and video playback, it also included Live Pause, a built-in pedometer, Nike+iPod Support and a speaker.", "This model also had the Genius Mix feature installed.", "The headphone jack and dock connector swapped locations so that the headphone jack was to the left of the dock connector.", "Therefore, the fifth generation iPod Nano used a different Apple Universal Dock insert than the fourth generation.", "The fifth generation iPod Nano had nine finishes: Silver, Black, Purple, Blue, Yellow, Orange, Product Red, Green and Pink.", "All have a glossier, shinier finish than the fourth generation." ] ], "gold": "The fifth-generation iPod was the first iPod that was able to play videos. The fifth-generation iPod was introduced on October 12, 2005. The fifth generation iPod Nano was the first iPod with a video camera. This iPod Nano featured an integrated video camera with 16 special effects. The fifth generation iPod Nano was unveiled at Apple's September 9, 2009 event. ", "prediction 1": "The first ipod video came out on September 9, 2009, at Apple's September 9, 2009 event.", "prediction 2": "First iPod video came out on September 9, 2009, with an enhanced version available. The enhanced version came out on September 9, 2009.", "prediction 3": "The first ipod video came out on the fifth-generation iPod with a 2.5\" 320240 QVGA screen and a smaller Click Wheel. In the first quarter of 2009, video was added to the fifth-generation iPod with a built-in video camera.", "prediction 4": "The first ipod video came out on the fifth-generation iPod, with a 2.5-inch QVGA screen and a smaller Click Wheel, on September 9, 2009. The fifth-generation iPod plays video in MP4 (up to 2.5 Mbit/s) and H.264 (up to 768 kbit/s, baseline profile only) formats. The fifth-generation enhance iPod and or 1st revision plays video in MP4 (up to 2.5 Mbit/s) and H.264 (up to 1.5 Mbit/s, baseline profile only) formats.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The fifth-generation iPod was the first iPod that was able to play videos. The fifth generation iPod Nano featured an integrated video camera with 16 special effects. The fifth generation iPod Nano was unveiled at Apple's September 9, 2009 event. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who did michigan state lose to in 2017?", "passages": [ [ "2018\u201319 Michigan State Spartans men's basketball team", "2018\u201319 Michigan State Spartans men's basketball team\n\nThe 2018\u201319 Michigan State Spartans men's basketball team represents Michigan State University in the 2018\u201319 NCAA Division I men's basketball season.", "The Spartans are led by 24th-year head coach Tom Izzo and play their home games at Breslin Center in East Lansing, Michigan as members of the Big Ten Conference.", "The Spartans finished the 2017\u201318 season 30\u20135, 16\u20132 in Big Ten play to win the regular season championship.", "As the No. 1 seed in the Big Ten Tournament, they beat Wisconsin in the quarterfinals before losing to Michigan in the semifinals.", "The Spartans received an at-large bid to the NCAA Tournament, their 21st consecutive trip under Izzo, as the No. 3 seed in the Midwest region.", "They defeated No. 14 Bucknell in the First Round before losing to No. 11-seeded Syracuse in the Second Round.", "As a result, the Spartans failed to make the Sweet Sixteen for the third consecutive year, a first for the Spartans with Izzo as head coach.", "The 16 Big Ten wins for the Spartans marked a school record and the 30 overall wins was only the fourth time in school history that the Spartans had won at least 30 games (all under Izzo)." ], [ "2016\u201317 Michigan State Spartans men's basketball team", "Nick Ward was whistled for a technical for tripping a Michigan player during a dead ball as the Spartans fell apart.", "Bridges led the Spartans with 15 points and Ward added 13, but MSU's defense struggled allowing Michigan to shoot 75 percent from the field in the first half.", "The 29-point loss tied for the worst loss MSU has suffered to Michigan under Tom Izzo and moved the Spartans to 14\u201310 overall and 6\u20135 in the Big Ten.", "Looking to rebound from their embarrassing loss against Michigan, the Spartans welcomed Iowa, who had swept the Spartans the previous year, to the Breslin Center.", "MSU continued to struggle with turnovers, committing 12 turnovers in the first half.", "Miles Bridges led the Spartans, scoring 14 of his game-high 16 points in the first half, and kept MSU close as they trailed 32\u201331 at the half.", "In the second half, MSU's hot shooting and suffocating defense allowed the Spartans to pull away, leading by as many as 16.", "For the first time this season, all four MSU freshmen, Bridges, Joshua Langford, Nick Ward, and Cassius Winson, each scored in double figures.", "Bridges added 11 rebounds for his fifth double-double of the season." ], [ "2017 Holiday Bowl", "2017 Holiday Bowl\n\nThe 2017 Holiday Bowl was a postseason college football bowl game, played at SDCCU Stadium in San Diego, California, on December 28, 2017.", "The 40th edition of the Holiday Bowl featured the Michigan State Spartans of the Big Ten Conference versus the Washington State Cougars of the Pac-12 Conference.", "It was one of the 2017\u201318 bowl games concluding the 2017 FBS football season.", "Sponsored by San Diego County Credit Union, the game was officially known as the San Diego County Credit Union Holiday Bowl.", "This was Michigan State's first appearance in a Holiday Bowl.", "The Spartans finished the 2017 regular season at 9\u20133, and were second in the B1G East Division (7\u20132).", "The team had upset wins over then-#7", "Michigan and then-#7 Penn State.", "Their three losses were all against teams that finished in the AP Top 20 (#14 Notre Dame, #20 Northwestern and #5 Ohio State).", "This was Washington State's fourth appearance in the Holiday Bowl, having lost to #14 Brigham Young in 1981, having defeated #5 Texas in 2003, and having lost to Minnesota in 2016.", "The Cougars finished the 2017 regular season at 9\u20133, and were third in the Pac-12 North Division (6\u20133).", "The season featured wins against then-#5 USC and then-#18 Stanford." ] ], "gold": "Michigan State lost to Syracuse in the 2017 NCAA basketball tournament. Michigan also lost to Notre Dame in football on September 23, 2017 and to Ohio State in football on November 11, 2017. ", "prediction 1": "The 2017 Michigan State Spartans men's basketball team lost to Michigan in the Big Ten Tournament semifinals. Michigan State finished the 2017\u201318 season 30\u20135, 16\u20132 in Big Ten play to win the regular season championship. The 2017 Holiday Bowl was a postseason college football bowl game, played at SDCCU Stadium in San Diego, California, on December 28, 2017.\n", "prediction 2": "In 2017, Michigan State lost to Michigan in the Big Ten Tournament semifinals, leading the Spartans to a 38-point loss. During the 2017-18 season, MSU lost to Michigan 35-33 in the Big Ten Tournament semi-finals, leading the Spartans to a 29-point deficit. During the 2018-2019 season, the Michigan State Spartans played at home against Iowa in the same February semifinal.", "prediction 3": "The 2017-18 Michigan State men's basketball team lost to Michigan, a team that the Spartans defeated 141\u201375 in the 2017-18 regular season championship game. The 2017-18 Michigan State men's basketball team lost to the Michigan Wolverines, a team that the Spartans beat 146\u201375 at home in the 2017-18 regular season finale. The 2017-18 Michigan State men's basketball team lost to Boston University 64\u201359 in the NCAA Tournament first round, but recovered to beat Iowa in the fourth round.", "prediction 4": "The Spartans lost to Michigan State in the 2017 Holiday Bowl, a postseason college football bowl game, on December 28, 2017. With this loss, Michigan State dropped to 14\u201310 overall and 6\u20135 in Big Ten play.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 359 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The 2017 Michigan State Spartans men's basketball team lost to Michigan in the Big Ten Tournament semifinals. During the 2017 football season three losses were against Notre Dame, Northwestern and Ohio State.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sings how far i'll go in the movie moana?", "passages": [ [ "How Far I'll Go", "On December 15, a 5-languages mash-up was released online, featuring singers from Southeast Asian countries: Janella Salvador from the Philippines, Maudy Ayunda from Indonesia, Myra Molloy from Thailand, Ayda Jebat from Malaysia and Tr\u1ea7n Minh Nh\u01b0 from Vietnam.", "Shortly thereafter, a 24-languages video was released on Disney's Vevo channel.", "In June 2017, a M\u0101ori-language version of the movie, featuring four voice-actors from the original English cast, was announced.", "Three weeks later, New Zealander Jaedyn Randell was introduced as Moana's singing voice.", "The movie was released in September 2017.", "In the same year, Shruti Rane (Hindi) reprised her role in the Bengali-language version of the movie.", "In November 2017, a Hawaiian-language dubbing was announced to be under way, with Auli\u02bbi Cravalho reprising her role as Moana.", "Canadian singer and songwriter Alessia Cara recorded \"How Far I'll Go\" for the \"Moana\" soundtrack, with the song being released ahead of the soundtrack on October 28, 2016." ], [ "How Far I'll Go", "How Far I'll Go\n\n\"How Far I'll Go\" is a song from Disney's 2016 animated feature film \"Moana\".", "It was written and produced by Lin-Manuel Miranda.", "The song was performed in the film by American actress and singer Auli\u02bbi Cravalho in her role as Moana.", "It was released along with the album on November 18, 2016.", "Canadian singer Alessia Cara also recorded the song for the \"Moana\" soundtrack.", "The song was nominated for Best Original Song at the 89th Academy Awards and Best Original Song at the 74th Golden Globe Awards but lost both to \"City of Stars\" from \"La La Land.\"", "\"How Far I'll Go\" was composed as Moana's \"I Want\" song, following in the long tradition of \"I Want\" songs in 1990s Disney animated musicals.", "It replaced an earlier attempt called \"More\", for which the demo version recorded by Marcy Harriell was released as an outtake on the deluxe version of the soundtrack album.", "Although Miranda has stressed that he is still \"very proud of\" the song as a first draft, \"More\" was not good enough in retrospect because it merely expressed Moana's vague desire to see more since she had already figured out everything about the island." ], [ "How Far I'll Go", "\"Rolling Stone\"s Brittany Spanos called the song \"inspirational and sweet\" and went on to say \"the uplifting song is a perfect fit into the \"Disney\" canon, with Cara belting lyrics about persevering to achieve her dreams in spite of her imperfections or detractors.\"", "US magazine \"Rap-Up\" said \"the empowering anthem allows the Canadian songstress to deliver outstanding vocals about overcoming adversity to reach for goals\" and labeled it \"a song with a message\" and an \"emotionally-charged track.\"", "Taylor Weatherby of \"Billboard\" dubbed it a \"bouncy, uplifting tune.\"", "Idolator's Mike Wass said \"the inspiring anthem is the perfect antidote to the general ugliness of 2016\" and called it \"a soaring ballad.\"", "The official music video for the song, directed by Aya Tanimura, was released on November 3, 2016.", "Derek Lawrence of \"Entertainment Weekly\" described the video: \"The video finds Cara roaming an empty beach as she belts out lyrics that reflect the film\u2019s plot about a young Polynesian girl setting sail for an epic adventure.\"", "The video was filmed at El Matador Beach in Malibu, California.", "In many versions of \"Moana\", Alessia Cara's version of the song played during the end credits." ] ], "gold": "The song How Far I'll Go was performed in the movie Moana by American actress and singer Auli\u02bbi Cravalho in her role as Moana. However, in many versions of the movie Moana, Alessia Cara's rendition of the song is played during the end credits.", "prediction 1": "\"How Far I'll Go\" is a song from Disney's 2016 animated feature film Moana. The song was performed in the film by American actress and singer Aulii Cravalho in her role as Moana. Canadian singer Alessia Cara also recorded the song for the Moana soundtrack. The song was nominated for Best Original Song at the 89th Academy Awards and Best Original Song at the 74th Golden Globe Awards but lost both to \"City of Stars\" from \"La La La Land.\"", "prediction 2": "\"How Far I'll Go\" is a song from Disney's 2016 animated feature film Moana. The song was performed in the film by American actress and singer Aulii Cravalho in her role as Moana. Canadian singer and songwriter Alessia Cara recorded \"How Far I'll Go\" for the \"Moana\" soundtrack, with the song being released ahead of the soundtrack on October 28, 2016.", "prediction 3": "\"How Far I'll Go\" is a song from Disney's 2016 animated feature film Moana, which was written and produced by Lin-Manuel Miranda. The song was performed in the film by American actress and singer Aulii Cravalho in her role as Moana. Canadian singer Alessia Cara also recorded the song for the Moana soundtrack, with the song being released ahead of the soundtrack on October 28, 2016.", "prediction 4": "\"How Far I'll Go\" is a song from the 2016 Disney animated movie Moana. The song was performed in the film by American actress and singer Aulii Cravalho in her role as Moana. Canadian singer Alessia Cara also recorded the song for the Moana soundtrack.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 439 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"How Far I'll Go\" is a song from Disney's 2016 animated feature film Moana. The song was performed in the film by American actress and singer Aulii Cravalho in her role as Moana. Canadian singer Alessia Cara also recorded the song for the Moana soundtrack. In many versions of \"Moana\", Alessia Cara's version of the song played during the end credits." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "What type of painting is the starry night?", "passages": [ [ "The Starry Night", "The Starry Night\n\nThe Starry Night is an oil on canvas by the Dutch post-impressionist painter Vincent van Gogh.", "Painted in June 1889, it depicts the view from the east-facing window of his asylum room at Saint-R\u00e9my-de-Provence, just before sunrise, with the addition of an idealized village.", "It has been in the permanent collection of the Museum of Modern Art in New York City since 1941, acquired through the Lillie P. Bliss Bequest.", "Regarded as among Van Gogh's finest works, \"The Starry Night\" is one of the most recognized paintings in the history of Western culture.", "In the aftermath of the 23 December 1888 breakdown that resulted in the self-mutilation of his left ear, Van Gogh voluntarily admitted himself to the Saint-Paul-de-Mausole lunatic asylum on 8 May 1889.", "Housed in a former monastery, Saint-Paul-de-Mausole catered to the wealthy and was less than half full when Van Gogh arrived, allowing him to occupy not only a second-story bedroom but also a ground-floor room for use as a painting studio.", "During the year Van Gogh stayed at the asylum, the prolific output of paintings he had begun in Arles continued." ], [ "Melancholy (Edvard Munch)", "Melancholy (Edvard Munch)\n\nMelancholy (Norwegian: Melankoli ; also known as Jappe on the Beach, Jealousy or Evening) is a painting by the Norwegian artist, Edvard Munch.", "Munch painted multiple variant versions of the expressionist work in oil on canvas during the period 1891\u201393.", "The painting depicts a man with his head resting in his hand in a pensive mood at the edge of a shoreline.", "The inspiration for the painting was an unhappy romantic affair that Munch's friend, Jappe Nilssen, was involved in.", "In Munch's painting the figure of the melancholy man is at the right, and his mood is represented by the undulating shoreline and skylines that extend toward the left.", "Critics suggest that there are also erotic allusions, perhaps in the presence of the moon reflected on the water.", "The landscape represents Asgardstrand's beach where Munch spent his summers from 1889.", "\"Melancholy\" was exhibited in 1891 at the Autumn Exhibition in Oslo.", "The artist and journalist Christian Krohg credited it as the first Symbolist painting by a Norwegian artist.", "Munch painted more than one version of the composition in 1891.", "A version completed in 1892\u201393 is in the National Gallery, Oslo." ], [ "Shepherdess Seated on a Rock", "Shepherdess Seated on a Rock\n\nShepherdess Seated on a Rock or The Knitter or Shepherdess Knitting is an 1856 oil on wood painting by Jean-Fran\u00e7ois Millet.", "It is in the collection of the Metropolitan Museum of Art in New York city.", "Millet was a leader of the Barbizon school, which emphasized realism, and is noted for his scenes of peasant farmers and for reinvigorating the genre of landscape painting.", "The shepherdess in this painting is wearing the linen hood and white cloak that were typical of the peasant women in communities of north-central France such as Barbizon.", "This painting at the Metropolitan Museum of Art is virtually identical to another at the Cincinnati Art Museum.", "The reason for the duplication is that Millet was painting the first one when he received an offer for it, but as he had already promised the painting to someone else he painted another.", "This was the only time that Millet ever duplicated one of his paintings.", "There are many other similar paintings by Millet depicting a shepherdess who is knitting, though they are not duplicates.", "Prior to painting the two duplicates, Millet composed a preparatory drawing, which is now located at the National Gallery of Scotland.", "According to that gallery, \"Millet\u2019s paintings of shepherdesses were greatly admired, and inspired Vincent van Gogh to pay homage to Millet in his own work.\"" ] ], "gold": "There are various oil on canvas paintings named \"The Starry Night\" or similarly. An 1893 one by Van Gogh, widely considered the artist's magnum-opus, a 1893 one by Edward Munch that representsthe coastline at \u00c5sg\u00e5rdstrand and a 1850 painting by Jean-Fran\u00e7ois Millet are just some of them.", "prediction 1": "The Starry Night is an oil on canvas painting by the Dutch post-impressionist painter Vincent van Gogh. Painted in June 1889, it depicts the view from the east-facing window of his asylum room at Saint-R\u00e9my-de-Provence, just before sunrise, with the addition of an idealized village. Regarded as among Van Gogh's finest works, \"The Starry Night\" is one of the most recognized paintings in the history of Western culture. Also known as Melancholy, is a painting by the Norwegian artist, Edvard Munch. Munch painted multiple variant versions of the expressionist work in oil on canvas during the period 1891\u201393. Another painting, Shepherdesssssssssssss Seated on a Rock, or Shepherdessssssssssssssssssss", "prediction 2": "In the history of Western culture, the starry night is one of the most recognized paintings, as it depicts the view from the east-facing window of Vincent van Gogh's asylum room at Saint-R\u00e9my-de-Provence, just before sunrise, with the addition of an idealized village. In the aftermath of the 23 December 1888 breakdown that resulted in the self-mutilation of his left ear, Van Gogh painted The Starry Night in June 1889.", "prediction 3": "The Starry Night is an oil on canvas by the Dutch post-impressionist painter Vincent van Gogh. Painted in June 1889, it depicts the view from the east-facing window of his asylum room at Saint-R\u00e9my-de-Provence, just before sunrise, with the addition of an idealized village. It has been in the permanent collection of the Museum of Modern Art in New York City since 1941, acquired through the Lillie P. Bliss Bequest.", "prediction 4": "The Starry Night is an oil on canvas by the Dutch post-impressionist painter Vincent van Gogh. Painted in June 1889, it depicts the view from the east-facing window of his asylum room at Saint-R\u00e9my-de-Provence, just before sunrise, with the addition of an idealized village. The Starry Night has been in the permanent collection of the Museum of Modern Art in New York City since 1941, acquired through the Lillie P. Bliss Bequest. Melancholy is an 1891 expressionist work by the Norwegian artist, Edvard Munch. Munch painted multiple variant versions of the expressionist work in oil on canvas during the period 1891\u201393. Munch painted multiple variant versions of the expressionist work in oil on canvas during the period 1891\u201393.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 283 }, { "error type": "Irrelevant", "explanation": "", "start": 284, "end": 420 }, { "error type": "Unverifiable", "explanation": "", "start": 421, "end": 434 }, { "error type": "Irrelevant", "explanation": "", "start": 500, "end": 582 }, { "error type": "Irrelevant", "explanation": "", "start": 628, "end": 701 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Starry Night is an oil on canvas painting by the Dutch post-impressionist painter Vincent van Gogh. Painted in June 1889 it is regarded as among Van Gogh's finest works. Melancholy, is a painting by the Norwegian artist, Edvard Munch. Painted during the period 1891\u201393, the landscape represents Asgardstrand's beach. Another painting is an 1856 painting by Jean-Fran\u00e7ois Millet." }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "A mirrored glass gazing globe in a garden is?", "passages": [ [ "Lawn ornament", "Their collection included dog, ducks, frogs, and a flamingo.", "Spinners: Usually shaped like flowers with petals that spin in the wind.", "Variations include birds or insects with spinning wings.", "Statuary and outdoor sculpture\n\nTopiary specimens\n\nWhirligig: An often animalistic sculpture generally supported vertically by being pushed in the ground characterized by at least one rotating member often designed to appear as a bodypart of the sculpture.", "Windmill:", "A disconnected but free-spinning miniature, typically in the American Aermotor style having about a dozen metal vanes, or the traditional Dutch style having four wood vanes.", "Yard globe: A light-reflective sphere, as large as 16\" in diameter and generally displayed on top of a support structure.", "Also called gazing globes or gazing balls." ] ], "gold": "A mirrored glass gazing globe in a garden has a number of names. The common name for one is a yard globe, but alternative names for one include garden globe, gazing ball, lawn ball, garden ball, gazing globe, mirror ball, chrome ball, and orb. A yard globe is a mirrored sphere typically displayed atop a conical ceramic or wrought iron stand and sometimes the grass as a lawn ornament.", "prediction 1": "A light-reflective sphere, as large as 16\" in diameter and generally displayed on top of a support structure. Also called gazing globes or gazing balls.", "prediction 2": "A mirror glass gazing globe is a light-reflective sphere, as large as 16\" in diameter and generally displayed on top of a support structure. Also called gazing balls and gazing globes.", "prediction 3": "A mirrored glass gazing globe in a garden is a light-reflective sphere, as large as 16\" in diameter and generally displayed on top of a support structure. Also called gazing balls or gazing globes.", "prediction 4": "A mirrored glass gazing globe in a garden is a light-reflective sphere, as large as 16 inches in diameter and generally displayed on top of a support structure. Also called gazing globes or gazing balls.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "A light-reflective sphere, as large as 16\" in diameter and generally displayed on top of a support structure. Also called gazing globes or gazing balls." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Halloween baking championship season 3 episode 6 winner?", "passages": [ [ "Halloween Baking Championship", "Halloween Baking Championship\n\nHalloween Baking Championship is an American cooking competition show that premiered on Food Network on October 5, 2015.", "Like its sister show, Holiday Baking Championship, it's a seasonal program that runs for a few weeks (in this case, the month of October) and aims to crown the best baker of spooky, creepy desserts.", "Each episode has two rounds.", "The first round is the \"Preliminary Heat\" where the bakers are first told of their themes and get varying cook times (anywhere from 30 minutes up to 2 hours) to create a small pastry (usual cookies or small cakes).", "The person who wins the first round gets an advantage going into the next round, and aren't told until after the second round is announced (and sometimes they're not told until the middle of cooking in the second round).", "The advantage varies by episode (\"Ex\": exclusive use of a certain baking mold/ingredient or first choice of a specific theme).", "The second round is called the \"Main Heat\" and the contestants get a considerably longer time to bake than the \"pre-heat\" (in the final round of the final episode they're given several hours to make a large confection).", "This larger dessert must fit a new theme presented (usually in the same vein as the pre-heat theme)." ] ], "gold": "Halloween Baking Championship is an American cooking competition television show, where each episode has two rounds and the person who wins has a chance to compete for $25,000 in the finale. In the first round, called the \"Preliminary Heat,\" the bakers are told a theme and a varying cook time to create a small pastry and the person who wins gets an advantage going into the next round. In the second round, called the \"Main Heat,\" the contestants are required to bake a larger dessert, in a new theme, and get a considerably longer time to do so, with the winner being able to advance to the next episode and one contestant is eliminated each episode. In season 3, episode 6, Jasmin Bell was the preliminary winner and went on to be the mean heat winner and the winner of the $25,000 for the season.", "prediction 1": "Halloween Baking Championship is an American cooking competition show that premiered on Food Network on October 5, 2015. The winner of Halloween Baking Championship Season 3 episode 6 is a dessert made from a skeleton.", "prediction 2": "Halloween Baking Championship is an American cooking competition show that premiered on Food Network on October 5, 2015. Season 3 episode 6 winner is the \"Evil\" baker.", "prediction 3": "Halloween Baking Championship is an American cooking competition show that premiered on Food Network on October 5, 2015. The person who wins the first round gets an advantage going into the next round, and aren't told until after the second round is announced. The winner of the season 3 episode 6 finale was the \"Autumn Nights\" winner.", "prediction 4": "Halloween Baking Championship is an American cooking competition show that premiered on Food Network on October 5, 2015. Season 3 episode 6 winner is a Halloween-themed dessert.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 120 }, { "error type": "Unverifiable", "explanation": "", "start": 121, "end": 218 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Halloween Baking Championship is an American cooking competition show, where each episode has two rounds. In the first round, called the \"Preliminary Heat,\" the bakers are told a theme and a varying cook time to create a small pastry and the person who wins gets an advantage going into the next round. The second round is called the \"Main Heat\" and the contestants get a considerably longer time to bake than the \"pre-heat\". " }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "When did england last get into world cup semi finals?", "passages": [ [ "Penalty shoot-out (association football)", "England lost six (out of eight) penalty shoot-outs in major tournament finals, including losses to Germany in the semi-finals of the 1990 FIFA World Cup and UEFA Euro 1996 (the latter following a win over Spain by the same method in the previous round).", "After Euro 1996, England lost four more shoot-outs in a row in major tournament finals, losing to Argentina at the 1998 World Cup, Portugal at Euro 2004 and the 2006 World Cup and Italy at Euro 2012, before finally breaking their losing streak at the 2018 World Cup against Colombia; this shootout also allowed England to progress into the quarter-finals for the first time in twelve years.", "The Netherlands, meanwhile, lost four consecutive shoot-outs; against Denmark in Euro 1992, France in Euro 1996, Brazil in the 1998 World Cup, and Italy in Euro 2000, before finally winning one against Sweden in Euro 2004.", "In Euro 2000, the Netherlands had two penalty kicks during the match and four attempts in the shootout but only managed to convert one kick against Italian keeper Francesco Toldo.", "Frank de Boer had both a penalty kick and shootout kick saved by Toldo, who also saved from Paul Bosvelt to give Italy a 3\u20131 shootout victory." ], [ "Eden Park", "It first hosted a test in 1930.", "The ground was also the host to New Zealand's first Test victory, against West Indies in 1955\u201356 season.", "It has also been the scene of a dark day in New Zealand's cricket history when on 28 March 1955, the hosts collapsed to their lowest Test score (26 all out) against England.", "It is scheduled to host three day-night test matches in March 2018, March 2019 and February 2020.", "The ground hosted four matches during the 1992 Cricket World Cup including the semi-final between New Zealand and Pakistan.", "It also hosted four matches during the 2015 Cricket World Cup, which was co-hosted by Australia and New Zealand.", "The matches played here were two pool B games, the pool A clash between co-hosts New Zealand and Australia and the first semi final between New Zealand and South Africa.", "In 2018, Eden Park hosted the first day-night test in New Zealand, against England.", "England were bowled out for 58 in the 1st innings.", "It took New Zealand only 20.4 overs to dismiss England on the first day of the test match.", "Trent Boult and Tim Southee took 6 and 4 wickets each and bowled unchanged throughout the 20.4 overs.", "No other bowler was required to bowl.", "This was just the 4th instance that only 2 bowlers were required to dismiss the opposition since 1920.", "Five England players were dismissed for a duck." ], [ "Gorilla (advertisement)", "The 90-second version was rebroadcast as the final commercial in the break before the final of the 2007 Rugby World Cup between England and South Africa on 20 October, with the face of the bass drum emblazoned with an English flag and the slogan \"Bring It Home\".", "Another variant of the advert was broadcast a week earlier before the semi-final of the 2007 Rugby World Cup between England and France on 13 October, with the face of the bass drum emblazoned with an English flag and the slogan \"Come On Lads\".", "The spot cost Cadbury an estimated \u00a3700,000.", "Billboard and print campaigns were set up to run alongside the television commercial, and a sponsorship deal with the \"Great Gorilla Run\" charity fun run through London on 23 September 2007 was set up through Sputnik Communications.", "An online presence was established with a competition on the Glass and a Half Full Productions website offering tickets to Las Vegas.", "The Glass and a Half Full Productions website was created by Hyper as part of a UK-focussed digital marketing strategy.", "Following the positive reception of the commercial in the United Kingdom and online, Cadbury Canada arranged to show the advertisements in 850\u00a0cinemas across Canada throughout November 2007." ] ], "gold": "England has been to the World Cup semifinals in multiple different sports. Their last appearance in the cricket World Cup semifinals was during the 1992 Cricket World Cup on 22 March 1992. The 1990 FIFA World Cup on 4 July 1990 was the last time England was in the Men's FIFA World Cup semifinals, and the 2007 Rugby World Cup on 13 October 2007 was their last appearance at the Men's Rugby World Cup semifinals.", "prediction 1": "England last made it into the semi finals of the World Cup in 1998, while they reached them in the 1990 FIFA World Cup and UEFA Euro 1996. However, in the 2018 World Cup, they reached the quarter finals for the first time in twelve years after winning the penalty shootout against Colombia.", "prediction 2": "England last reached the semi-finals of a major tournament in 1992, when they had two teams from Pool A and two teams from Pool B. During the 1990 FIFA World Cup, England lost six (out of eight) penalty shoot-outs in major tournament finals, including losses to Germany in the semi-finals of the 1990 FIFA World Cup and UEFA Euro 1996. In the 2014 World Cup, England reached the semi-finals of the 2016 World Cup and reached the quarter-finals for the first time in twelve years. In 2018, England reached the semi-final when they defeated South Africa, and reached the final when they beat South Africa in the final.", "prediction 3": "England last made it into the semi finals of a major tournament in 1990, when they lost to Germany. In a major tournament, they lost six out of eight penalty shoot-outs in major tournament finals, including losses to Germany in the semi-finals of the 1990 FIFA World Cup and UEFA Euro 1996. In a major cricket tournament, they lost four more shoot-outs in a row, losing to Argentina at the 1998 World Cup, Portugal at Euro 2004 and the 2006 World Cup, and Italy at Euro 2012, before finally breaking their losing streak at the 2018 World Cup against Colombia; this shootout also allowed England to progress into the quarter-finals for the first time in twelve years. In 2018, Eden Park hosted the first day-night test match in New Zealand, against England. It hosted four matches during the 2015 Cricket World Cup, including the semi final between New Zealand and South Africa.", "prediction 4": "England last made it into the semi finals of major tournaments in 1990, 1994, and 1990. Then, in 1998, England lost to Argentina in the final and in 1999, they lost to Brazil in the final and in 2000 they lost to Italy in the final. In 2018, England made it into the quarter finals of the Cricket World Cup again after defeating New Zealand in a day-night match at Eden Park.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 290 }, { "error type": "Unverifiable", "explanation": "", "start": 62, "end": 67 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 138 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "England last made it into the semi finals of the 1990 FIFA World Cup. England also was in the semi-finals of the 2007 Rugby World Cup against France, on 13 October." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who sang please don't let me be misunderstood?", "passages": [ [ "Don't Let Me Be Misunderstood", "Don't Let Me Be Misunderstood\n\n\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964.", "\"Don't Let Me Be Misunderstood\" has been covered by many artists, most notably by The Animals, whose blues rock version of the song became a transatlantic hit in 1965.", "A 1977 four-on-the-floor disco rearrangement by disco group Santa Esmeralda was also a hit.", "The beginnings of \"Don't Let Me Be Misunderstood\" came with composer and arranger Horace Ott, who came up with the melody and chorus lyric line after a temporary falling out with his girlfriend (and wife-to-be), Gloria Caldwell.", "He then brought it to writing partners Bennie Benjamin and Sol Marcus to complete.", "However, when it came time for songwriting credits, rules of the time prevented BMI writers (Ott) from officially collaborating with ASCAP members (the other two), so Ott instead listed Caldwell's name on the credits.", "\"Don't Let Me Be Misunderstood\" was one of five songs involving the writing of Benjamin and Marcus, presented for Nina Simone's 1964 album \"Broadway-Blues-Ballads\"." ], [ "Don't Let Me Be Misunderstood", "In 2017, it was used again for the final scene of the pilot of FX's crime drama \"Snowfall\".", "The Animals' lead singer Eric Burdon would later say of the song, \"It was never considered pop material, but it somehow got passed on to us and we fell in love with it immediately.\"", "The Animals sped up the tempo and made prominent use of a guitar and organ riff that was picked out and expanded from an element that originally appeared in the Simone recording's outro.", "The song was recorded in November 1964.", "The group gained a trans-Atlantic hit in early 1965 from their rendition, rising to number 3 on the UK Singles Chart, number 15 on the U.S. pop singles chart, and number 4 in Canada.", "This single was ranked by \"Rolling Stone\" at #322 on their list of the 500 Greatest Songs of All Time.", "In Animals concerts at the time, the group maintained the recorded arrangement, but Burdon sometimes slowed the vocal line down to an almost spoken part, recapturing a bit of the Simone flavor.", "It is heard in a 2012 commercial for H&M featuring David Beckham that aired during NBC's coverage of Super Bowl XLVI on February 5, 2012.", "At the South by Southwest conference in 2012, Bruce Springsteen credited the song as the inspiration and the riff for his song \"Badlands\"." ], [ "Don't Let Me Be Misunderstood", "A Disco version of the song by the disco group Santa Esmeralda, which took The Animals' arrangement and added some disco, flamenco, salsa, and other Latin rhythm and ornamentation elements to it, also became a hit in the late 1970s.", "First released in summer 1977 as a 16-minute epic that took up an entire side of their \"Don't Let Me Be Misunderstood\" album, it was picked up for more worldwide distribution by the label of the time, Casablanca Records.", "A 12-inch club remix was extremely popular, hitting number one on the U.S. Billboard Club Play Singles chart and in some European countries as well.", "The single peaked at number four on the Hot Dance/Disco-Club Play chart.", "Released as a pop single late in the year, it did well as well, reaching number 15 on the \"Billboard\" Hot 100 by early 1978.", "NBC Sports would use the song frequently in the years following its release, especially during their coverage of the World Series.", "Santa Esmeralda's \"Don't Let Me Be Misunderstood\" was used as the opening theme of the 1980 pilot for the U.S. game show \"Bullseye\", after which a sound-alike was used in regular episodes." ] ], "gold": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott, and Sol Marcus for the singer and pianist Nina Simone, who first recorded it in 1964. Many artists have covered the song, most notably The Animals, whose blues rock version became a transatlantic hit in 1965, rising to No. 3 on the UK Singles Chart, No. 15 on the US pop singles chart, and No. 4 in Canada. A 1977 four-on-the-floor disco rearrangement by disco group Santa Esmeralda was also a hit, with the 12-inch club remix reaching No. 1 on the US Billboard Club Play Singles chart.", "prediction 1": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964. It has been covered by many artists, most notably by The Animals, whose blues rock version of the song became a transatlantic hit in 1965. A disco version of the song by the disco group Santa Esmeralda, which took The Animals' arrangement and added some disco, flamenco, salsa, also became a hit in the late 1970s. The Animals' lead singer Eric Burdon sung a transatlantic hit in early 1965 from their version of Don't Let Me Be Misunderstood, which became a hit in early 1965.", "prediction 2": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964. The Animals, whose blues rock version of the song became a transatlantic hit in 1965, also covered the song. In 1977, disco group Santa Esmeralda covered the song as a 16-minute epic, which took up an entire side of their \"Don't Let Me Be Misunderstood\".", "prediction 3": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964. It has been covered by many artists, most notably by The Animals, whose blues rock version of the song became a transatlantic hit in 1965. A disco version of the song by the disco group Santa Esmeralda, which took The Animals' arrangement and added some disco, flamenco, flamenco, salsa, also became a hit in the late 1970s, and became a hit in December 1977. Santa Esmeralda's \"Don't Let Me Be Misunderstood\" was also a hit in the late 1970s.", "prediction 4": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964. The Animals, whose blues rock version of the song became a transatlantic hit in 1965, have covered \"Don't Let Me Be Misunderstood.\" A disco version of the song by the disco group Santa Esmeralda, which took The Animals' arrangement and added some disco, flamenco, salsa, salsa, has also been covered by a number of the pop single in the late 1970s.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 486 }, { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 523 }, { "error type": "Redundant", "explanation": "It has been covered by many artists, most notably by The Animals, whose blues rock version of the song became a transatlantic hit in 1965. ", "start": 524, "end": 649 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Don't Let Me Be Misunderstood\" is a song written by Bennie Benjamin, Horace Ott and Sol Marcus for the jazz singer and pianist Nina Simone, who first recorded it in 1964. It has been covered by many artists, most notably by The Animals, whose blues rock version of the song became a transatlantic hit in 1965, rising to number 3 on the UK Singles Chart, number 15 on the U.S. pop singles chart, and number 4 in Canada. A 1977 four-on-the-floor disco rearrangement by disco group Santa Esmeralda was also a hit, with the 12-inch club remix reaching No. 1 on the US Billboard Club Play Singles chart. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where did the battle of the atlantic take place?", "passages": [ [ "Battle of the Atlantic", "Battle of the Atlantic\n\nThe Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II.", "At its core was the Allied naval blockade of Germany, announced the day after the declaration of war, and Germany's subsequent counter-blockade.", "It was at its height from mid-1940 through to the end of 1943.", "The Battle of the Atlantic pitted U-boats and other warships of the \"Kriegsmarine\" (Navy) and aircraft of the \"Luftwaffe\" (Air Force) against the Royal Canadian Navy, Royal Navy, United States Navy, and Allied merchant shipping.", "Convoys, coming mainly from North America and predominantly going to the United Kingdom and the Soviet Union, were protected for the most part by the British and Canadian navies and air forces.", "These forces were aided by ships and aircraft of the United States beginning September 13, 1941.", "The Germans were joined by submarines of the Italian Royal Navy (\"Regia Marina\") after their Axis ally Italy entered the war on June 10, 1940.", "As an island nation, the United Kingdom was highly dependent on imported goods.", "Britain required more than a million tons of imported material per week in order to be able to survive and fight." ], [ "Timeline of the Battle of the Atlantic", "August 19, 1939\nAugust 21, 1939\nAugust 24, 1939\n\nSeptember 3, 1939\nSeptember 5, 1939\nSeptember 7, 1939\nSeptember 14, 1939\nSeptember 16, 1939\nSeptember 17, 1939\nSeptember 17, 1939\nSeptember 20, 1939\nSeptember 26, 1939\nSeptember 30, 1939\n\nOctober 5, 1939\nOctober 14, 1939\nOctober 16, 1939\nOctober 27, 1939\nOctober 30, 1939\n\nNovember 21, 1939\nNovember 23, 1939\nNovember 25, 1939\n\nDecember 4, 1939\nDecember 5, 1939\nDecember 10, 1939\n\nJanuary 30, 1940\n\nFebruary 5, 1940\nFebruary 14, 1940\n\nMarch 16, 1940\n\nJune 12, 1940\nJune 14, 1940\nJune 22, 1940\nJune 25, 1940\nJune 30, 1940\n\nJuly 2, 1940\nJuly 4, 1940\nJuly 8, 1940\nJuly 10, 1940\nJuly 17, 1940\nJuly 26, 1940\nJuly 31, 1940\n\nAugust 4, 1940\nAugust 5, 1940\nAugust 15, 1940\nAugust 16, 1940\nAugust 23, 1940\nAugust 24, 1940\nAugust 25, 1940\nAugust 28, 1940\nAugust 30, 1940\nAugust 31, 1940\n\nSeptember 2, 1940\nSeptember 4, 1940\nSeptember 6, 1940\nSeptember 8, 1940\nSeptember 15, 1940\nSeptember 17, 1940\nSeptember 18, 1940\nSeptember 20, 1940\nSeptember 21, 1940\nSeptember 26, 1940\nSeptember 27, 1940\nSeptember 28, 1940\n\nOctober 9, 1940\nOctober 11, 1940\nOctober 14, 1940\nOctober 15, 1940\nOctober 17, 1940\nOctober 18, 1940\nOctober 19, 1940\nOctober 22, 1940\n\nNovember 5, 1940\nNovember 6, 1940\nNovember 15, 1940\nNovember 21, 1940\nNovember 22, 1940\nNovember 23, 1940\n\nDecember 1." ], [ "Military career of Dwight D. Eisenhower", "In January 1944, he resumed command of ETOUSA and the following month was officially designated as the Supreme Allied Commander of the Allied Expeditionary Force (SHAEF), serving in a dual role until the end of hostilities in Europe in May 1945.", "In these positions he was charged with planning and carrying out the Allied assault on the coast of Normandy in June 1944 under the code name Operation Overlord, the liberation of western Europe and the invasion of Germany.", "A month after the Normandy D-Day landings on June 6, 1944, Operation Dragoon the invasion of southern France took place, and control of the forces which took part in the southern invasion passed from the AFHQ to the SHAEF.", "From then until the end of World War II in Europe on May 8, 1945, Eisenhower through SHAEF had supreme command of all operational Allied forces and through his command of ETOUSA, administrative command of all U.S. forces, on the Western Front north of the Alps.", "As recognition of his senior position in the Allied command, on December 20, 1944, he was promoted to General of the Army, equivalent to the rank of Field marshal in most European armies.", "In this and the previous high commands he held, Eisenhower showed his great talents for leadership and diplomacy.", "Although he had never seen action himself, he won the respect of front-line commanders." ] ], "gold": "The Battle of the Atlantic, the longest continuous military campaign in World War II, ran from September 3, 1939 to the defeat of Nazi Germany on May 8, 1945, covering a major part of the naval history of World War II. At its core was the Allied naval blockade of Germany, announced the day after the declaration of war, and Germany's subsequent counter-blockade. The campaign peaked from mid-1940 through to the end of 1943. ", "prediction 1": "The Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II. The battle took place in Normandy, France, and was part of the Operation Overlord which led to the liberation of western Europe and the invasion of Germany. The battle took place in Halifax, Nova Scotia, Canada. The battle of the Atlantic took place in Halifax, Nova Scotia, Canada.", "prediction 2": "The Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II. The Battle of the Atlantic pitted U-boats and other warships of the \"Kriegsmarine\" (Navy) and aircraft of the \"Luftwaffe\" (Air Force) against the Royal Canadian Navy, Royal Navy, United States Navy, and Allied merchant shipping. The battle took place in Normandy, France. The invasion of southern France took place a month after the Normandy D-Day landings on June 6, 1944.", "prediction 3": "The Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II. The battle took place in the English Channel, North Atlantic and the Atlantic. The battle took place in England, France, Canada, and the United States, and took place on the French coast of Normandy.", "prediction 4": "The Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II. The battle took place in France, England, and Canada, and pitted U-boats and other warships of the \"Kriegsmarine\" (Navy) and aircraft of the \"Luftwaffe\" (Air Force) against the Royal Canadian Navy, Royal Navy, United States Navy, and Allied merchant shipping.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 200, "end": 356 }, { "error type": "Unverifiable", "explanation": "", "start": 357, "end": 411 }, { "error type": "Redundant", "explanation": " The battle took place in Halifax, Nova Scotia, Canada. ", "start": 412, "end": 482 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Battle of the Atlantic was the longest continuous military campaign in World War II, running from 1939 to the defeat of Germany in 1945, and was a major part of the Naval history of World War II. At its core was the Allied naval blockade of Germany, announced the day after the declaration of war, and Germany's subsequent counter-blockade. It was at its height from mid-1940 through to the end of 1943." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is the desert located in the usa?", "passages": [ [ "Mountain states", "The southern portion (Arizona and New Mexico) is often called the Southwest region, while the northern portion (Idaho and Montana) is often included in either the Northwest states or called the \"Northern Rockies\".", "Together with the Pacific States of Alaska, California, Hawaii, Oregon, and Washington, the Mountain States constitute the broader region of the West, one of the four regions the United States Census Bureau formally recognizes (the Northeast, South, and Midwest being the other three).", "The terrain of the Mountain West is more diverse than any other region in the United States.", "Its physical geography ranges from some of the highest mountain peaks in the continental United States, to large desert lands, and rolling plains in the eastern portion of the region.", "The Mountain West states contain all of the major deserts found in North America.", "The Great Basin Desert is located in almost all of Nevada, western Utah, and southern Idaho.", "Portions of the Mojave Desert are located in California, but over half of the desert is located in southern Nevada, in the Mountain West.", "Meanwhile, the Sonoran Desert is located in much of Arizona, and the Chihuahuan Desert is located in most of southwestern and southern New Mexico, including White Sands and Jornada del Muerto.", "Colorado also has scattered desert lands in the southern and northwestern portions of the state, including the expansive San Luis Valley." ], [ "High Desert (Oregon)", "The southern high desert is part of North America's Basin and Range Province, which extends south through Nevada and Arizona and into Mexico.", "It contains large alkali lakes and tall cliffs, some with a prominence of more than .", "Steens Mountain, in Harney County, is the highest point within the region; its summit is above sea level.", "To the east, the high desert country of the Columbia Plateau extends across the Snake River and into Idaho.", "A number of rivers flow through the high desert region.", "These include the Deschutes River and its tributary the Crooked River, as well as the Malheur, Owyhee, and John Day rivers, which are all within the Columbia River watershed.", "Because the high desert encompasses the portion of the hydrographic Great Basin located in Oregon, smaller rivers in the high desert flow into closed basins.", "The Chewaucan River, the Donner und Blitzen River, and the Silvies River each flow into some of the high desert's salt lakes.", "The largest landowner in eastern Oregon is the U.S. government.", "The Bureau of Land Management administers over in the bureau's Burns, Lakeview, Prineville, and Vale districts, most of which are in the state's high desert country." ], [ "Mojave Desert", "Mojave Desert\n\nThe Mojave Desert ( ) is an arid rain-shadow desert and the driest desert in North America.", "It is in the southwestern United States, primarily within southeastern California and southern Nevada, and it occupies .", "Very small areas also extend into Utah and Arizona.", "Its boundaries are generally noted by the presence of Joshua trees, which are native only to the Mojave Desert and are considered an indicator species, and it is believed to support an additional 1,750 to 2,000 species of plants.", "The central part of the desert is sparsely populated, while its peripheries support large communities such as Las Vegas, Barstow, Lancaster, Palmdale, Victorville, and St. George.", "The Mojave Desert is bordered by the Great Basin Desert to its north and the Sonoran Desert to its south and east.", "Topographical boundaries include the Tehachapi Mountains to the west, and the San Gabriel Mountains and San Bernardino Mountains to the south.", "The mountain boundaries are distinct because they are outlined by the two largest faults in California \u2013 the San Andreas and Garlock faults.", "The Mojave Desert displays typical basin and range topography." ] ], "gold": "The following are three major hot and dry deserts in North America, all located in the southwestern United States and northern Mexico: the Chihuahuan, the Sonoran, and the Mojave deserts. The largest cold desert is the Great Basin Desert north of the Mojave Desert. Other cold deserts lie within the Columbia Plateau/Columbia Basin, the Snake River Plain, and the Colorado Plateau regions.", "prediction 1": "The desert is located in the southwestern United States, primarily within southeastern California and southern Nevada. It is also the driest desert in North America. The Great Basin, Sonoran, and Chihuahuan deserts are all located in the Mountain West.", "prediction 2": "The deserts of the United States are located in the Mountain West, including the Mojave, Sonora, and Chihuahuan deserts. The Great Basin Desert is located in almost all of Nevada, western Utah, and southern Idaho. The Mojave Desert is an arid rain-shadow desert and the driest desert in North America. The Sonoran desert is located in much of Arizona, the Chihuahuan Desert is located in most of southwestern and southern New Mexico, including White Sands and Jornada del Muerto.", "prediction 3": "The desert is located in the southwestern United States, in southeastern California and southern Nevada, primarily within southeastern California and southern Nevada. In the northern part of the United States, in Idaho and Montana, the desert is called the Northern Rockies. In the southern portion of the US, in Arizona and New Mexico, the desert is called the Southwest region.", "prediction 4": "The Mojave Desert, an arid rain-shadow desert and the driest desert in North America, is in the southwestern United States, primarily within southeastern California and southern Nevada. Alternatively, the High Desert is located in central Oregon, while the Sonoran Desert is located in much of Arizona, and the Chihuahuan Desert is located in most of southwestern and southern New Mexico.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 252 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Mojave Desert is located in the southwestern United States, primarily within southeastern California and southern Nevada. It is bordered by the Great Basin Desert to its north and the Sonoran Desert to its south and east. The Chihuahuan Desert is located in most of southwestern and southern New Mexico." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When does episode 3 of final space come out?", "passages": [ [ "Final Space", "Final Space\n\nFinal Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS.", "The show was created by independent internet filmmaker Olan Rogers with David Sacks serving as showrunner.", "The series involves an astronaut named Gary and his alien friend, Mooncake, and focuses on their intergalactic adventures as they try to solve the mystery of the titular \"Final Space.\"", "The series premiere of \"Final Space\" was shown off early via Reddit on February 15, 2018.", "Later that day, the first two episodes became available on TBS's website and app.", "The series premiere later aired as a sneak peek on TBS's sister network TNT on February 17, 2018.", "The series premiered on TBS on February 26, 2018 and was renewed for a second season on May 7, 2018 with this season having 13 episodes instead of 10.", "It is scheduled to air sometime in 2019.", "The show is distributed internationally via Netflix, and in select territories as a Netflix Original.", "Gary Goodspeed is a boisterous yet inept astronaut who, in the midst of working off the last few days of his five-year sentence aboard the prison spacecraft \"Galaxy One\", encounters a mysterious planet-destroying alien." ], [ "Final Space", "In July 2017, an additional cast list of Fred Armisen, Conan O'Brien, Keith David, Coty Galloway, Tom Kenny, Caleb McLaughlin, John DiMaggio, Ron Perlman, Shannon Purser, Andy Richter, David Tennant, and Steven Yeun was revealed.", "The animation is produced in Los Angeles at ShadowMachine and outsourced in Canada at Ottawa's Jam Filled studio using the Toon Boom Harmony software.", "The show uses NASA space imagery for the space backgrounds.", "\n\n", "The second season was announced in May 2018 and will consist of 13 episodes.", "When responding to a question on Twitter, Olan Rogers revealed that \"Final Space\" would be showcased by TBS at San Diego Comic-Con and VidCon in 2017.", "\"Final Space\" premiered on Reddit on February 15, 2018, followed by an AMA with Rogers.", "This would mark a first for a TV network to premiere a series on the site.", "TBS's sister network TNT aired a sneak peek premiere of the show on February 17, 2018, after the 2018 NBA All-Star Weekend.", "After airing on TBS, the pilot aired two hours later on TBS' sister channel Cartoon Network under its adult-oriented programming block Adult Swim.", "(The rest of the season also aired on Adult Swim in a similar pattern.)" ] ], "gold": "Final Space is an American adult animated space opera comedy-drama television series that follows an astronaut named Gary Goodspeed and his immensely powerful alien friend Mooncake on their intergalactic adventures as they try to save the universe from certain doom. The series began airing on TBS on February 26, 2018 but was moved to Cartoon Network's late-night programming block, Adult Swim, beginning with the second season in 2019. Season 1, Episode 3 of the show came out on TBS on March 12, 2018, but was previously released online on February 26, 2018. Alternatively, Season 2, Episode 3, came out on Adult Swim on July 8, 2019, airing on TBS on July 15, 2019.", "prediction 1": "Final Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS. The show involved an astronaut named Gary and his alien friend, Mooncake, and focuses on their intergalactic adventures as they try to solve the mystery of the titular \"Final Space.\" The series premiere of \"Final Space\" was shown off early via Reddit on February 15, 2018. Later that day, the first two episodes became available on TBS's website and app. The series premiere later aired as a sneak peek on TBS's sister network TNT on February 17, 2018.", "prediction 2": "Final Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS. The series involves an astronaut named Gary and his alien friend, Mooncake, and focuses on their intergalactic adventures as they try to solve the mystery of the titular \"Final Space.\" Episode 3 of final space came out on February 17, 2018, and episode 3 of season 2 came out on May 7, 2018.", "prediction 3": "Final Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS. The series involves an astronaut named Gary and his alien friend, Mooncake, and focuses on their intergalactic adventures as they try to solve the mystery of the titular \"Final Space.\" The series premiere of \"Final Space\" was shown off early via Reddit on February 15, 2018. Later that day, the first two episodes became available on TBS's website and app.", "prediction 4": "Final Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS. Episode 3 of the series came out on TBS's website and app on February 19, 2018. Episode 3 of the second season came out on TBS' sister network TNT on February 17, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 396, "end": 477 }, { "error type": "Irrelevant", "explanation": "", "start": 478, "end": 575 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Final Space is an American animated space opera comedy-drama television series for adults developed for cable network TBS. The show involved an astronaut named Gary Goodspeed and his alien friend, Mooncake, and focuses on their intergalactic adventures as they try to solve the mystery of the titular \"Final Space.\" The series premiered on TBS on February 26, 2018." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does kc undercover come back on 2017?", "passages": [ [ "K.C. Undercover", "The series was set to star \"Shake It Up\" star Zendaya, who would play 16-year-old Katy Cooper, an outspoken and confident technology wiz and skilled black belt, who discovers that both her parents are spies who expect her to follow in their footsteps.", "Production on the pilot was set to begin in early 2014.", "On November 6, 2013, Zendaya tweeted about the pilot, saying she wants to bring back the \"cool Disney Channel\", mentioning shows like \"That's So Raven\", \"The Proud Family\", and \"Kim Possible\".", "It was ordered to series by Disney Channel in May 2014, with the series now under the title \"K.C. Undercover\".", "The series was released on Watch Disney Channel on January 1, 2015, and was followed by the television premiere on January 18, 2015.", "The first season consisted of 27 episodes.", "On May 15, 2015, Disney Channel renewed the series for a second season, which premiered on March 6, 2016.", "On August 1, 2016, \"People\" revealed that the series had been renewed for a third season.", "The third season premiered on Disney Channel on July 7, 2017 and ended on February 2, 2018.", "In Canada, the series premiered on Family Channel on January 23, 2015, and moved to Disney Channel on September 1, 2015." ], [ "K.C. Undercover", "K.C. Undercover\n\nK.C. Undercover is an American comedy television series created by Corinne Marshall that aired on Disney Channel from January 18, 2015 to February 2, 2018.", "The series stars Zendaya as a teenager named K.C. who becomes a spy.", "Starring alongside her are Veronica Dunne, Kamil McFadden, Trinitee Stokes, Tammy Townsend, and Kadeem Hardison.", "Set in Washington, D.C., the series follows K.C. Cooper, a high school math genius who gets recruited by her parents, Craig and Kira Cooper, after she discovers that they are secretly undercover spies working for an agency called The Organization.", "Her brother, Ernie, tries to help because he feels left out, and eventually joins the team, and his desire leads Craig and Kira to get a new robot child named Judy.", "Each episode centers on K.C. and her family as they contend with common familial issues while also performing missions to save the country, with a recurring storyline involving thwarting the plans of a criminal organization called the Other Side.", "The third season introduces a renegade organization called the Alternate which is against the Organization and the Other Side with plans to destroy the United States government to change the world their way.", "The series was first announced as a pilot in pre-production titled \"Super Awesome Katy\" in November 2013." ] ], "gold": "K.C. Undercover aired on the Disney Channel from January 18, 2015 to February 2, 2018.\u00a0The second season end was January 6, 2017. The third season premiered July 7, 2017", "prediction 1": "K.C. Undercover is an American teen spy comedy television series created by Corinne Marshall that was originally airing on Disney Channel from January 18, 2015 to February 2, 2018. The series came back on Disney Channel on July 7, 2017.", "prediction 2": "K.C. Undercover is an American spy comedy television series created by Corinne Marshall that aired on Disney Channel from January 18, 2015 to February 2, 2018. The first season premiered on Watch Disney Channel on January 1, 2015. The second season premiered on March 6, 2016. The third season premiered on Disney Channel on July 7, 2017 and ended on February 2, 2018. The fourth season premiered on Disney Channel on January 12, 2018.", "prediction 3": "K.C. Undercover is an American spy television series created by Corinne Marshall that aired on Disney Channel from January 18, 2015 to February 2, 2018. In 2018, the series returned to Disney Channel for its third season which came back on July 7, 2017.", "prediction 4": "K.C. Undercover is an American spy comedy television series created by Corinne Marshall that aired on Disney Channel from January 18, 2015 to February 2, 2018. The third season premiered on Disney Channel on July 7, 2017 and ended on February 2, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 97 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "K.C. Undercover was originally airing on Disney Channel from January 18, 2015 to February 2, 2018. The second season end was March 6, 2016. The series came back on Disney Channel on July 7, 2017 for the third season. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who wrote the book art of the deal?", "passages": [ [ "Trump: The Art of the Deal", "Trump was persuaded to produce the book by Cond\u00e9 Nast owner Si Newhouse after the May 1984 issue of Newhouse's magazine \"GQ\" \u2013 with Trump appearing on the cover \u2013 sold well.", "Schwartz was hired to work on the book, and began working with Trump in late 1985.", "He interviewed Trump and \u2013 with permission from him \u2013 listened in on his phone calls.", "According to Schwartz in July 2016, Trump wrote none of the book, choosing only to remove a few critical mentions of business colleagues at the end of the process.", "Trump responded with conflicting stories, saying \"I had a lot of choice of who to have write the book, and I chose [Schwartz]\", but then said \"[Schwartz] didn't write the book.", "\"I\" wrote the book.\"", "Former Random House head Howard Kaminsky, the book's original publisher, said \"Trump didn\u2019t write a postcard for us!\"", "The book was published in November 1987 by Random House, with the authorship given as \"Donald Trump with Tony Schwartz\".", "Schwartz was the subject of a July 2016 article in \"The New Yorker\" in which Schwartz describes Donald Trump unfavorably and relates how he came to regret writing \"The Art of the Deal\".", "He also stated that if it were to be written today it would be very different and titled \"The Sociopath\"." ], [ "Trump: The Art of the Deal", "Trump: The Art of the Deal\n\nTrump: The Art of the Deal is a 1987 book credited to Donald Trump and journalist Tony Schwartz.", "Part memoir and part business-advice book, it was the first book credited to Trump, and helped to make him a \"household name\".", "It reached number 1 on \"The New York Times\" Best Seller list, stayed there for 13 weeks, and altogether held a position on the list for 48 weeks.", "The book received additional attention during Trump's 2016 campaign for the presidency of the United States.", "He cited it as one of his proudest accomplishments and his second-favorite book after the Bible.", "Schwartz expressed regrets about his involvement in the book, and both he and the book's publisher, Howard Kaminsky, said that Trump had played no role in the actual writing of the book.", "Trump has given conflicting accounts on the question of authorship.", "The book talks about Trump's childhood in Jamaica Estates, Queens.", "It then describes his early work in Brooklyn prior to moving to Manhattan and building The Trump Organization, his actions and thoughts in developing the Grand Hyatt Hotel and Trump Tower, in renovating Wollman Rink, and regarding various other projects.", "The book also contains an 11-step formula for business success, inspired by Norman Vincent Peale's \"The Power of Positive Thinking\"." ] ], "gold": "Trump: The Art of the Deal is a part memoir and part business-advice book that was published in 1987. The book is credited to both Donald J. Trump and a journalist named Tony Schwartz. Donald Trump has claimed that he wrote the book, but has also claimed that he chose Tony Schwartz to write the book. Tony Schwartz claims that he wrote the book and that Donald Trump didn't write any of it.", "prediction 1": "Trump: The Art of the Deal is a 1987 book credited to Donald Trump and journalist Tony Schwartz. Part memoir and part business-advice book, it was the first book credited to Trump, and helped to make him a \"household name\". It reached number 1 on \"The New York Times\" Best Seller list, stayed there for 13 weeks, and altogether held a position on the list for 48 weeks.\n", "prediction 2": "Trump: The Art of the Deal is a 1987 book credited to Donald Trump and journalist Tony Schwartz. Part memoir and part business-advice book, it was the first book credited to Trump, and helped to make him a \"household name\". It reached number 1 on The New York Times Best Seller list, stayed there for 13 weeks, and altogether held a position on the list for 48 weeks. The authorship given as \"Donald Trump with Tony Schwartz\", but both he and the book's publisher, Howard Kaminsky, said that Trump had played no role in the actual writing of the book.", "prediction 3": "Trump: The Art of the Deal is a 1987 book that was co-written by Donald Trump and journalist Tony Schwartz. Part memoir and part business-advice book, it was the first book credited to Trump and helped to make him a household name. According to Schwartz in July 2016, Trump wrote none of the book, choosing only to remove a few critical mentions of business colleagues at the end of the process. The book was published in November 1987 by Random House, with the authorship given as Donald Trump with Tony Schwartz.", "prediction 4": "Trump: The Art of the Deal is a 1987 book credited to Donald Trump and journalist Tony Schwartz. Part memoir and part business-advice book, it was the first book credited to Trump, and helped to make him a \"household name\". The book was published in November 1987 by Random House, with the authorship given as \"Donald Trump with Tony Schwartz\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 370 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 4, 5, 6 ] } ], "corrected-prediction": "Trump: The Art of the Deal is a 1987 book credited to Donald Trump and journalist Tony Schwartz. It is a part memoir and part business-advice book. Schwartz was hired to work on the book, and according to Schwartz, Trump wrote none of it. Trump responded with conflicting stories, saying that he wrote it and that Schwartz did not." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has the fastest 40 yard dash in the nfl combine?", "passages": [ [ "40-yard dash", "Jacoby Ford, who ran a 4.28\u00a0s in the 2010 NFL Combine, had a collegiate best of 6.51\u00a0s in the 60-meter dash (outside the top-40 of the all-time lists).", "This highlights the difficulties in comparing track running times to football 40-yard times due to the different timing methods.", "Auburn's Bo Jackson claims to have run a 40-yard dash with a time of 4.13 s.", "A time of 4.18 run by Jackson within the same week added some support to the legitimacy of the times.", "Texas Tech's Jakeem Grant was hand-timed by a New Orleans Saints scout as running a 4.10 in 2016, potentially beating Jackson's record.", "Deion Sanders ran a 4.27-second 40-yard dash in 1989.", "In 2013, Carlin Isles recorded a time of 4.22 at a Detroit Lions facility during a workout.", "In 2017 Olympic sprinter Christian Coleman ran a time of 4.12 seconds on turf in response to claims that NFL players are as fast as Usain Bolt.", "This is a list of the official 40-yard dash results of 4.30 seconds or better recorded at the NFL Scouting combine since 1999, the first year electronic timing was implemented at the NFL Scouting Combine." ] ], "gold": "Since the NFL implemented electronic timing in 1999, John Ross has the fastest 40 yard dash at the NFL Combine, which was a 4.22 second run in 2017. Prior to the implementation of electronic timing, Bo Jackson claimed to have ran a 40 yard dash in 4.13 seconds in 1986, making him have the fastest time at the NFL Combine. Then, in 2016, Jakeem Grant was hand timed doing a 40 yard dash in 4.10 seconds at the NFL Combine, making it the fastest time.", "prediction 1": "Jacoby Ford, who ran a 4.28 s in the 2010 NFL Combine, had a collegiate best of 6.51 s in the 60-meter dash. This highlights the difficulties in comparing track running times to football 40-yard times due to the different timing methods. Deion Sanders ran a 4.27-second 40-yard dash in 1989. Texas Tech's Jakeem Grant was hand-timed by a New Orleans Saints scout as running a 4.10 in 2016, potentially beating Jackson's record.", "prediction 2": "The 40-yard dash is typically run by defensive ends. The NFL Scouting Combine uses a combination of various timing methods, including hand-timed times. The fastest 40-yard dash time at the NFL Scouting Combine is 4.30 seconds.", "prediction 3": "Jacoby Ford, who ran a 4.28 s in the 2010 NFL Combine, had a collegiate best of 6.51 s in the 60-meter dash (outside the top-40 of the all-time lists). Alabama's Bo Jackson claims to have run a 40-yard dash with a time of 4.13 s. A time of 4.18 run by Jackson within the same week added some support to the legitimacy of the times. In 2013, Carlin Isles recorded a time of 4.22 at a Detroit Lions facility during a workout.", "prediction 4": "The official 40-yard dash times at the NFL Scouting Combine are 4.30 seconds or better. Deion Sanders has the fastest time of any player in the league. Jacoby Ford, who ran a 4.28 s in the 2010 NFL Combine, had a collegiate best of 6.51 s in the 60-meter dash. Texas Tech's Jakeem Grant was hand-timed by a New Orleans Saints scout as running a 4.10 in 2016, potentially beating Jackson's time. In 2013, Carlin Isles recorded a time of 4.22 at a Detroit Lions facility during a workout.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 291 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Jacoby Ford, who ran a 4.28 s in the 2010 NFL Combine, had a collegiate best of 6.51 s in the 60-meter dash. Auburn's Bo Jackson claims to have run a 40-yard dash with a time of 4.13 s. Texas Tech's Jakeem Grant was hand-timed by a New Orleans Saints scout as running a 4.10 in 2016, potentially beating Jackson's record." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What is formed on top of continental crust?", "passages": [ [ "Continental crust", "It makes up about 70% of the volume of Earth's crust.", "Because the surface of continental crust mainly lies above sea level, its existence allowed land life to evolve from marine life.", "Its existence also provides broad expanses of shallow water known as epeiric seas and continental shelves where complex metazoan life could become established during early Paleozoic time, in what is now called the Cambrian explosion.", "All continental crust ultimately derives from the fractional differentiation of oceanic crust over many millions of years.", "This process has occurred, and continues to occur today, primarily as a result of the volcanism associated with subduction.", "There is little evidence of continental crust prior to 3.5 Ga.", "About 20% of the continental crust's current volume was formed by 3.0 Ga.", "There was relatively rapid development on shield areas consisting of continental crust between 3.0 and 2.5 Ga.", "During this time interval, about 60% of the continental crust's current volume was formed.", "The remaining 20% has formed during the last 2.5 Ga.", "In contrast to the persistence of continental crust, the size, shape, and number of continents are constantly changing through geologic time.", "Different tracts rift apart, collide and recoalesce as part of a grand supercontinent cycle." ], [ "Pedosphere", "As part of the larger global system, any particular environment in which soil forms is influenced solely by its geographic position on the globe as climatic, geologic, biologic and anthropogenic changes occur with changes in longitude and latitude.", "The pedosphere lies below the vegetative cover of the biosphere and above the hydrosphere and lithosphere.", "The soil forming process (pedogenesis) can begin without the aid of biology but is significantly quickened in the presence of biologic reactions.", "Soil formation begins with the chemical and/or physical breakdown of minerals to form the initial material that overlies the bedrock substrate.", "Biology quickens this by secreting acidic compounds (dominantly fulvic acids) that help break rock apart.", "Particular biologic pioneers are lichen, mosses and seed bearing plants, but many other inorganic reactions take place that diversify the chemical makeup of the early soil layer.", "Once weathering and decomposition products accumulate, a coherent soil body allows the migration of fluids both vertically and laterally through the soil profile, causing ion exchange between solid, fluid and gaseous phases.", "As time progresses, the bulk geochemistry of the soil layer will deviate away from the initial composition of the bedrock and will evolve to a chemistry that reflects the type of reactions that take place in the soil." ], [ "Continental crust", "Continental crust\n\nContinental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves.", "This layer is sometimes called \"sial\" because its bulk composition is richer in silicates and aluminium minerals and has a lower density compared to the oceanic crust, called \"sima\" which is richer in magnesium silicate minerals and is denser.", "Changes in seismic wave velocities have shown that at a certain depth (the Conrad discontinuity), there is a reasonably sharp contrast between the more felsic upper continental crust and the lower continental crust, which is more mafic in character.", "The continental crust consists of various layers, with a bulk composition that is intermediate to felsic.", "The average density of continental crust is about 2.7\u00a0g/cm, less dense than the ultramafic material that makes up the mantle, which has a density of around 3.3\u00a0g/cm.", "Continental crust is also less dense than oceanic crust, whose density is about 2.9\u00a0g/cm.", "At 25 to 70\u00a0km, continental crust is considerably thicker than oceanic crust, which has an average thickness of around 7\u201310\u00a0km.", "About 40% of Earth's surface is currently occupied by continental crust." ] ], "gold": "Continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the geological continents and the areas of shallow seabed close to their shores, known as continental shelves. Because the surface of continental crust mainly lies above sea level, its existence allowed land life to evolve from marine life. The pedosphere is formed on top of the continental crust and chemically reacts through the soil forming process.", "prediction 1": "Continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves. The upper continental crust consists of various layers, with a bulk composition that is intermediate to felsic. The lower continental crust is more mafic in character. The continental shelf layer is sometimes called sial because its bulk composition is richer in silicates and aluminium minerals and has a lower density compared to the oceanic crust, which is denser.", "prediction 2": "The continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves. The soil forming process (pedogenesis) can begin without the aid of biology but is significantly quickened in the presence of biologic reactions. Soil formation begins with the chemical and/or physical breakdown of minerals to form the initial material that overlies the bedrock substrate.", "prediction 3": "Continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves. It makes up about 70% of the volume of Earth's crust. The pedosphere, or soil layer, is formed on top of the continental crust. Soil formation begins with the chemical and/or physical breakdown of minerals to form the initial material that overlies the bedrock substrate. Biology quickens this by secreting acidic compounds to form the initial material that overlies the bedrock substrate.", "prediction 4": "Continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves. This layer is sometimes called sial because its bulk composition is richer in silicates and aluminium minerals and has a lower density compared to the oceanic crust, called sima, which is richer in magnesium silicate minerals and is denser.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 556 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Continental crust is the layer of igneous, sedimentary, and metamorphic rocks that forms the continents and the areas of shallow seabed close to their shores, known as continental shelves. Because the surface of continental crust mainly lies above sea level, its existence allowed land life to evolve from marine life. The pedosphere lies below the vegetative cover of the biosphere and above the hydrosphere and lithosphere. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Where were the first oreo cookies sold in america?", "passages": [ [ "Sam Porcello", "He later worked at Nabisco's corporate headquarters in East Hanover, New Jersey.", "Porcello joined Nabisco's research and development department, which develops new lines of snack foods.", "He was considered one of the world's leading experts on cocoa, which is used to make chocolate.", "He was given the title, \"principal scientist,\" during his career at Nabisco.", "The Oreo cookie, has been sold since 1912 (450 billion Oreos have been sold since their introduction), but it was Porcello who invented the modern creme-filling for Oreos and the Double Stuffed Oreo, which has extra filling.", "In total, Porcello held five patents related to his work on the Oreo.", "He also developed a product line of Oreos enrobed in white chocolate and dark chocolate.", "Porcello found the particular type of chocolate which he used for chocolate-covered Oreos while attending a food industry trade show in Europe.", "Aside from his work with the Oreo, Porcello developed other Nabisco snack products, including SnackWells.", "His position required him to travel extensively in search of new potential products and ingredients.", "According to his son, Curtis, Porcello often brought new snacks home with him to see how his family liked or disliked the potential new products." ], [ "Hydrox", "Hydrox\n\nHydrox is the brand name for a creme-filled chocolate sandwich cookie manufactured by Leaf Brands.", "It debuted in 1908, and was manufactured by Sunshine Biscuits for over 90 years.", "The similar Oreo cookie, introduced in 1912, was inspired by the Hydrox.", "The Oreo eventually exceeded in popularity which resulted in the Hydrox being perceived as an imitator, although it was the original.", "Hydrox was largely discontinued in 1999 after Sunshine was acquired by Keebler, which was later acquired by Kellogg's.", "In September 2015, the product was re-introduced by Leaf Brands.", "Compared to Oreos, Hydrox cookies have a less-sweet filling and a crunchier cookie shell that has been noted to become less soggy in milk.", "In 1908, the creators of the cookie sought a name that would convey \"purity and goodness\" and derived their choice from the component elements that comprise the molecule of water (Hydrogen and Oxygen).", "Sunshine Biscuits was purchased by Keebler in 1996, and in 1999, Keebler replaced Hydrox with a similar but reformulated product called Droxies.", "Keebler was acquired by Kellogg's in 2001.", "Kellogg's removed Droxies from the market in 2003.", "Kellogg's marketed a similar chocolate sandwich cookie under the Famous Amos brand, along with sandwich cookies of other flavors, but has discontinued the line." ] ], "gold": "The Oreo sandwich cookie, consisting of two chocolate wafers or biscuits with a sweet cr\u00e8me filling, is the current best-selling cookie brand in the United States. They were introduced on March 6, 1912, being first sold to a grocer in Hoboken, New Jersey. They were commercialized for 25 cents a pound in novelty metal canisters with clear glass tops.", "prediction 1": "The first Oreo cookies sold in America were sold at a candy store in San Francisco, California. In 1912, the first Oreo cookie sold in the United States was sold at a bakery in Philadelphia. In 1913, the first Oreo cookies sold in the United States were sold at a supermarket in Chicago.", "prediction 2": "The Oreo cookie, has been sold since 1912, but it was Sam Porcello who invented the modern creme-filling for Oreos and the Double Stuffed Oreo, which has extra filling. In total, Porcello held five patents related to his work on the Oreo. The similar Oreo cookie, introduced in 1912, was inspired by the Hydrox, a creme-filled chocolate sandwich cookie manufactured by Leaf Brands. It debuted in 1908, and was manufactured by Keebler, which was later acquired by Kellogg's. In September 2015, the product was re-introduced by Leaf Brands. It was largely discontinued in 1999 after being acquired by Keebler.", "prediction 3": "The first Oreo cookies sold in America were sold in San Francisco, California in 1908 and in New York City in 1912. The Oreo cookie, has been sold since 1912, but it was Sam Porcello who invented the modern creme-filling for Oreos and the Double Stuffed Oreo, which has extra filling. The first Oreo cookies sold in America were sold in New York City in 1909 and in Philadelphia in 1912.", "prediction 4": "The first Oreos sold in America were sold in a bakery shop in New York City in 1908, and were sold in a grocery store in Pennsylvania in 1912.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 49, "end": 95 }, { "error type": "Unverifiable", "explanation": "", "start": 157, "end": 190 }, { "error type": "Unverifiable", "explanation": "", "start": 254, "end": 287 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Oreo was first sold in 1912. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "How much of the u.s. national debt is owed to foreigners?", "passages": [ [ "National debt of the United States", "Because a large variety of people own the notes, bills, and bonds in the \"public\" portion of the debt, Treasury also publishes information that groups the types of holders by general categories to portray who owns United States debt.", "In this data set, some of the public portion is moved and combined with the total government portion, because this amount is owned by the Federal Reserve as part of United States monetary policy.", "(See Federal Reserve System.)", "As is apparent from the chart, a little less than half of the total national debt is owed to the \"Federal Reserve and intragovernmental holdings\".", "The foreign and international holders of the debt are also put together from the notes, bills, and bonds sections.", "To the right is a chart for the data as of June 2008:\n\n", "As of September 2014, foreigners owned $6.06\u00a0trillion of U.S. debt, or approximately 47 percent of the debt held by the public of $12.8\u00a0trillion and 34 percent of the total debt of $17.8\u00a0trillion.", ", the largest holders were China, Japan, Ireland, and Brazil.", "The share held by foreign governments has grown over time, rising from 13 percent of the public debt in 1988 to 25 percent in 2007." ], [ "National debt of the United States", "According to the OECD, general government gross debt (federal, state, and local) in the United States in the fourth quarter of 2015 was $22.5 trillion (125% of GDP); subtracting out $5.25 trillion for intergovernmental federal debt to count only federal \"debt held by the public\" gives 96% of GDP.", "The ratio is higher if the total national debt is used, by adding the \"intragovernmental debt\" to the \"debt held by the public.\"", "For example, on April 29, 2016, debt held by the public was approximately $13.84 trillion or about 76% of GDP.", "Intra-governmental holdings stood at $5.35 trillion, giving a combined total public debt of $19.19 trillion.", "U.S. GDP for the previous 12 months was approximately $18.15 trillion, for a total debt to GDP ratio of approximately 106%.", "Conceptually, an annual deficit (or surplus) should represent the change in the national debt, with a deficit adding to the national debt and a surplus reducing it.", "However, there is complexity in the budgetary computations that can make the deficit figure commonly reported in the media (the \"total deficit\") considerably different from the annual increase in the debt." ] ], "gold": "The national debt of the United States is the total national debt owed by the federal government of the United States to Treasury security holders, and a portion of the debt is owned by foreign governments. The share of the debt held by foreign governments increased from 13 percent in 1988 to 28 percent in 2008, and to 34 percent in 2015. But in 2018, the percentage of foreign ownership of the US national debt decreased.", "prediction 1": "The United States has a national debt of approximately $17.5 trillion. As of September 2014, foreigners owned $6.06 trillion of U.S. debt, or approximately 47 percent of the debt held by the public of $12.8 trillion and 34 percent of the total debt of $17.8 trillion. The largest holders of the debt were China, Japan, Ireland, and Brazil.", "prediction 2": "The U.S. national debt is comprised of notes, bills, and bonds that are owned by the public. Foreigners own approximately 47 percent of the debt held by the public of $12.8 trillion and 34 percent of the total debt of $17.8 trillion. As of September 2014, foreigners owned $6.06 trillion of U.S. debt, or approximately 47 percent of the debt held by the public of $12.8 trillion and 34 percent of the total debt of $17.8 trillion.", "prediction 3": "In 2016, approximately 47 percent of the U.S. national debt was held by the public, and 34 percent of the total debt was owned by foreigners. In 2016, approximately $13.9 trillion was owned by foreigners. In 2015, approximately $12.6 trillion was held by foreigners.", "prediction 4": "In the United States, foreigners own approximately 47 percent of the debt held by the public of $12.8 trillion and 34 percent of the total debt of $17.8 trillion. However, Treasury publishes information that groups the types of holders by general categories to portray who owns United States debt. As is apparent from the chart, a little less than half of the total national debt is owed to the Federal Reserve and intragovernmental holdings. The share held by foreign governments has grown over time, rising from 13 percent of the public debt in 1988 to 25 percent in 2007.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 55, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 339 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": " As of September 2014, foreigners owned $6.06 trillion of U.S. debt, or approximately 47 percent of the debt held by the public of $12.8 trillion and 34 percent of the total debt of $17.8 trillion. The share held by foreign governments has grown over time, rising from 13 percent of the public debt in 1988 to 25 percent in 2007." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who plays sally in the nightmare before christmas?", "passages": [ [ "The Nightmare Before Christmas", "The attraction, an overlay of the park's Haunted Mansion, features characters, decorations and music from the film.", "In addition to Mickey's Not-So-Scary Halloween Party and Mickey's Halloween Party featuring the film's characters, Jack Skellington, Sally, Pajama Jack, and the Mayor have been made into Bendies figures, while Jack and Sally even appear in fine art.", "Moreover, Sally has been made into an action figure and a Halloween costume.", "A Jack Skellington figurine is available for the \"Disney Infinity\" video game, allowing the character to be playable in the game's \"Toy Box Mode\".", "Jack is also the titular character in the short story \"\"Tim Burton's The Nightmare Before Christmas\": Jack's Story\", and also appeared in HalloWishes and Halloween Screams fireworks at Magic Kingdom (where the host is Ghost Host) and Disneyland (where the host is Jack himself).", "\"Nightmare\" has inspired video game spin-offs, including \"\" and \"\", and is among the many Disney-owned franchises that contribute to the mythology of the \"Kingdom Hearts\" series.", "A trading card game is also available.", "Around the release of the film, Disney executive David Hoberman was quoted, \"I hope \"Nightmare\" goes out and makes a fortune.", "If it does, great." ], [ "The Nightmare Before Christmas: Oogie's Revenge", "For example, Santa Jack (which is obtained once Doctor Finklestein is defeated) can throw out presents to stun enemies or freeze enemies in ice, and the Pumpkin King (which you get after saving Sally from a large spider) can burn enemies, open doors by burning them etc.", "Additionally, there are several unlockable costumes, however, they do not grant any additional abilities.", "Reception to the game was mostly mixed.", "GameRankings gave \"The Nightmare Before Christmas: Boogie's Revenge\" a score of 66.46% for Xbox and 64.95% for PlayStation 2, while Metacritic gave it a score of 65 out of 100 for both console versions.", "IGN reviewed the game, saying, \"Unpolished gameplay and poor pacing won't ever make for an outstanding product regardless of however endearing the source material may be\" and gave the game a 6/10 rating overall.", "Gametrailers.com criticized the game for its camera and story, which they believed copied too much from the movie instead of coming up with something truly original.", "However, \"The Times\" gave it all five stars and said, \"This adventure looks great, its landscape dominated by crooked buildings and brooding grey skies; navigating Jack is simple and the characters are all well realised.", "A perfect children\u2019s game.\"" ] ], "gold": "Sally is voiced by Catherine Anne O'Hara in the 1993 movie The Nightmare Before Christmas. She is voiced by Katherine Soucie in the video game spin off The Nightmare Before Christmas: Oogie's Revenge.", "prediction 1": "In the Nightmare Before Christmas, Sally is played by a variety of people. In the film, Sally is played by a young actress, while in the video game Sally is played by a teenage girl.", "prediction 2": "There are multiple incarnations of Sally from The Nightmare Before Christmas. In the movie, Sally is played by Kate Hagen, while in the video game, Sally is played by Joanna McElhone.", "prediction 3": "Sally from the Nightmare Before Christmas film and the video game have been given different roles. In the film, Sally is played by Jennifer Ellis. In the video game, Sally is played by Melissa McCormick.", "prediction 4": "Sally is the main character of the horror film The Nightmare Before Christmas. In the video game The Nightmare Before Christmas: Boogie's Revenge, Sally is played by actress Carmela Ann McKinney, while actress Anna Kendrick plays Sally.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 74 }, { "error type": "Unverifiable", "explanation": "", "start": 75, "end": 182 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Winner of worst cooks in america season 4?", "passages": [ [ "Worst Cooks in America", "Worst Cooks in America\n\nWorst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network.", "The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set.", "The recruits are trained on the various basic cooking techniques including: baking, knife skills, temperature, seasoning and preparation.", "The final challenge is to cook a restaurant quality three-course meal for three food critics.", "The show premiered on January 3, 2010.", "The show was initially hosted by chef Anne Burrell and chef Beau MacMillan in Season 1.", "MacMillan was replaced by chef Robert Irvine on Season 2, followed by chef Bobby Flay for Seasons 3\u20135.", "On November 20, 2014, a Food Network press release announced that chef Tyler Florence will be paired with chef Burrell to host Season 6, to debut on January 4, 2015.", "Burrell was the winning instructor in seasons 1, 2, 3, 6, 7 and 8 with Flay winning in Seasons 4\u20135.", "Rachael Ray and Burrell hosted the Season 7 special celebrity edition, which premiered September 23, 2015.", "During the finale of Season 7, a trailer previewing Season 8 was shown and was aired in January 2016 with the return of Tyler Florence." ], [ "Alina Bolshakova", "Alina Bolshakova\n\nAlina Bolshakova () is a Latvian-born American ballerina, actress, and voice actress.", "Alina was born and raised in Riga, Latvia where she professionally studied ballet.", "At the age of 17, she moved to CA to pursue her career in acting.", "Bolshakova has portrayed Tecmessa in the play \"Ajax in Iraq\".", "She was the winner of the fourth season of the Food Network show \"Worst Cooks in America\".", "Now she teaches ballet and is a certified GYROTONIC Instructor." ] ], "gold": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. In season 4 the regular edition of the show was won by Alina Bolshakova. In the celebrity edition of the show, Bobby Flay won season 4.", "prediction 1": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. In Season 4 Alina Bolshakova was the winner of the competition.", "prediction 2": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show took 12 to 16 contestants with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. The final challenge is to cook a restaurant quality three-course meal for three food critics. Tecmessa from Ajax In Iraq was the winner of season 4 of Worst Cooks in America. Alina Bolshakova was the winner of season 5 of Worst Cooks in America season 5.", "prediction 3": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Alina Bolshakova was the winner of season 4 of Worst Cooks in America. She is a Latvian-born American ballerina, actress, and voice actress.", "prediction 4": "Worst Cooks in America is an American reality television show that premiered on January 3, 2010. The show takes 12-16 contestants with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Alina Bolshakova was the winner of season 4 of Worst Cooks in America.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. In Season 4 Alina Bolshakova was the winner of the competition." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "How many international airports do we have in nigeria?", "passages": [ [ "Murtala Muhammed International Airport", "Police secured the inside of the terminal and the arrival areas outside.", "The FAA ended its suspension of direct flights to Nigeria in 2001 in recognition of these security improvements.", "By 2010, the FAA had granted the airport its highest safety rating.", "In 2010, the airport served 6,273,545 passengers.", "Recent years have seen substantial improvements at Murtala Muhammed International Airport.", "Malfunctioning and non-operational infrastructures such as air conditioning and luggage belts have been repaired.", "The entire airport has been cleaned, and many new restaurants and duty-free stores have opened.", "Bilateral Air Services Agreements signed between Nigeria and other countries are being revived and new ones signed.", "These agreements have seen the likes of Emirates, Ocean Air, Delta and China Southern Airlines express interest and receive landing rights to Nigeria's largest international airport.", "The airport includes the headquarters of the Federal Airports Authority of Nigeria.", "It also houses the head office of the Accident Investigation Bureau.", "The Lagos office of the Nigerian Civil Aviation Authority is located in Aviation House on the grounds of the airport.", "Arik Air's head office is in the Arik Air Aviation Center on the grounds of the airport.", "Aero Contractors has its head office in the Private Terminal of the Domestic Wing at Murtala Muhammed International Airport.", "At one time Nigeria Airways had its head office in Airways House on the airport property." ], [ "Nigeria Airways", "The airline ceased operations in 2003 and was liquidated a year later.", "The Nigerian government later came to an agreement with Virgin Atlantic Airways to found Virgin Nigeria Airways, intended as a replacement.", "Even though Virgin Nigeria succeeded Nigeria Airways, the ground facilities of the folded Nigeria Airways were eventually taken over by the then-startup carrier Arik Air.", "Nigeria Airways had its headquarters at Airways House in Abuja at the time of dissolution.", "It had been moved from Murtala Muhammed Airport between 1999 and 2000.", "The airline logo consisted of the Nigerian flag with a green elephant named \"Skypower\" in its centre.", "At the time of closure the Nigeria Airways network consisted of four domestic destinations, namely Abuja, Kano, Lagos and Port Harcourt.", "The international network comprised five routes, to Abidjan, Dubai, Jeddah, London and New York.", "The following aircraft types were operated by Nigeria Airways during the course of its history:\n\n\nAviation Safety Network records 16 events for the airline, eight of which led to fatalities.", "The worst accident experienced by the carrier took place on , when 261 people were killed in an accident at King Abdulaziz International Airport.", "The following list includes events that had reported fatalities, there was a hull-loss of the aircraft involved, or both." ], [ "Arik Air", "The airline was wholly owned by Ojemai Investments.", "The Nigerian government set a deadline of 30 April 2007 for all airlines operating in the country to re-capitalise or be grounded in an effort to ensure better services and safety.", "The airline satisfied the Nigerian Civil Aviation Authority (NCAA)\u2019s criteria in terms of re-capitalisation and was re-registered for operation.", "On 4 April 2008, Arik Air was given permission to fly to the United States by the US Department of Transportation.", "Arik Air started international operations to London-Heathrow on 15 December 2008, using an Airbus A340-500 aircraft damp-leased from Hi Fly.", "It added Johannesburg on 1 June 2009, New York JFK on 30 November 2009, and Dubai on 28 July 2014.", "Subsidiary airline Arik Niger (IATA code: Q9) commenced operations in April 2009, but was shut down in February 2010.", "Arik Air transported its 5 millionth passenger on 6 August 2010 and it transported its 10 millionth passenger on 18 September 2012, both on flights between Johannesburg and Lagos.", "On 20 September 2012, the airline cancelled all its domestic operations after aviation officials raided the airline's office in Lagos, Nigeria.", "Flights resumed on 23 September.", "Arik Air had placed an order for five Boeing 777-300ER aircraft, which was cancelled in 2011." ] ], "gold": "In Nigeria, there are fifteen airports with the name international in them. There are 8 functional international airports in Nigeria, 5 of which are operated by FAAN.", "prediction 1": "Nigeria has a total of 6 international airports. Of these, Murtala Muhammed International Airport is the one with the most international flights to Nigeria. Nigeria has 9 other international airports, Murtala Muhammed International Airport is the one with the least international flights, King Abdulaziz International Airport is the one with the most domestic flights, and King Abdulaziz International Airport is the one with the most passengers.", "prediction 2": "There are a total of 9 international airports in Nigeria. As of March 31, 2015, there were 12 international airports in Nigeria.", "prediction 3": "Nigeria has nine international airports, including King Abdulaziz, Murtala Muhammed, Enugu, Lagos, Abuja, and Port Harcourt on the national capital territory.", "prediction 4": "There are currently 3 international airports in Nigeria. Murtala Muhammed International Airport has the most international connections of any of the 4 currently operating in Nigeria. At one time, Nigeria Airways had its head office in Airways House in Abuja at the time of dissolution. Arik Air had its head office in the Arik Air Aviation Center on the grounds of the airport. Aero Contractors has its head office in the Private Terminal of the Domestic Wing at Murtala Muhammed International Airport.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 23, "end": 24 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 156 }, { "error type": "Redundant", "explanation": "Nigeria has a total of 6 international airports. ", "start": 157, "end": 200 }, { "error type": "Redundant", "explanation": "Nigeria has a total of 6 international airports. Of these, Murtala Muhammed International Airport is the one with the most international flights to Nigeria. ", "start": 201, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 446 } ], "missing-info": [], "corrected-prediction": "Nigeria has a total of at least 1 international airports. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When will the international space station be completed?", "passages": [ [ "International Space Station", "Part of Boeing's services under the contract will relate to extending the station's primary structural hardware past 2020 to the end of 2028.", "Regarding extending the ISS, on 15 November 2016 General Director Vladimir Solntsev of RSC Energia stated \"Maybe the ISS will receive continued resources.", "Today we discussed the possibility of using the station until 2028,\" and \"Much will depend on the political moments in relations with the Americans, with the new administration.", "It will be discussed.\"", "There have also been suggestions that the station could be converted to commercial operations after it is retired by government entities.", "In September 2018, U.S. House member Brian Babin introduced legislation intended to extend operations of the ISS to 2030.", "The ISS has been described as the most expensive single item ever constructed.", "In 2010 the cost was expected to be $150\u00a0billion.", "This includes NASA's budget of $58.7\u00a0billion (inflation-unadjusted) for the station from 1985 to 2015 ($72.4\u00a0billion in 2010 dollars), Russia's $12\u00a0billion, Europe's $5\u00a0billion, Japan's $5\u00a0billion, Canada's $2\u00a0billion, and the cost of 36 shuttle flights to build the station; estimated at $1.4\u00a0billion each, or $50.4\u00a0billion in total." ], [ "Assembly of the International Space Station", "Assembly of the International Space Station\n\nThe process of assembling the International Space Station (ISS) has been under way since the 1990s.", "\"Zarya\", the first ISS module, was launched by a Proton rocket on November 20, 1998.", "The STS-88 shuttle mission followed two weeks after \"Zarya\" was launched, bringing \"Unity\", the first of three node modules, and connecting it to \"Zarya\".", "This bare 2-module core of the ISS remained unmanned for the next one and a half years, until in July 2000 the Russian module \"Zvezda\" was launched by a Proton rocket, allowing a maximum crew of two astronauts or cosmonauts to be on the ISS permanently.", "The ISS has a planned pressurized volume of approximately 1,000 cubic meters, a mass of approximately 400,000 kilograms, approximately 100 kilowatts of power output, a truss 108.4 meters long, modules 74 meters long, and a crew of six.", "Building the complete station required more than 40 assembly flights.", "As of March 2011, 26 Space Shuttle flights have docked with ISS to add elements, and 9 other Shuttle flights have flown logistics-servicing missions to ISS without adding major external elements.", "These 35 Shuttle missions include 9 SpaceHab and 10 MPLM logistics-servicing missions in various combinations." ], [ "Axiom Space", "Axiom Space\n\nAxiom Space is an American space technology startup company based in Houston, Texas, that plans to manufacture and develop orbital space stations.", "It was established in January 2015 by Michael T. Suffredini, former program manager of the International Space Station (ISS) at Johnson Space Center.", "Suffredini is also the current CEO of Axiom Space.", "The company has over 60 employees, most of them with experience from NASA and NASA contractors.", "In 2018, Axiom contracted famed French designer Philippe Starck, who also happens to be the son of an aerospace engineer and a space enthusiast, to design the space station.", "Renderings of the habitat show a chamber with walls that are covered with tufted padding and studded with hundreds of color-changing LEDs.", "The company plans to launch and begin linking a module with the ISS in 2019.", "It plans to send people up as soon as 2020 but the station won't be ready until 2022.", "Upon retirement of the ISS, the Axiom module will be joined by additional elements that together will function as the \"Axiom International Commercial Space Station\".", "Axiom plans to conduct astronaut training for commercial astronauts, to host governments and commercial partners, as well as space tourists." ] ], "gold": "The construction of the International Space Station, or ISS, began in the 1990s and the main construction was completed in 2011, though upgrades continue and future modifications are planned. As of 2018 the mission of the ISS was extended 2030.", "prediction 1": "The process of assembling the International Space Station (ISS) has been under way since the 1990s. The station's primary structural hardware is scheduled to be complete by 2027. The company that designed the station, Axiom Space, plans to launch and begin linking a module with the ISS in 2019. The company plans to send people up as soon as 2020 but the station won't be ready until 2022.", "prediction 2": "The process of assembling the International Space Station (ISS) has been under way since the 1990s. Part of Boeing's services under the contract will relate to extending the station's primary structural hardware past 2020 to the end of 2028. American space technology startup company Axiom Space plans to launch and begin linking a module with the ISS in 2019. It plans to send people up as soon as 2020 but the station won't be ready until 2022.", "prediction 3": "The process of assembling the International Space Station has been under way since the 1990s. The process of assembling the station has been described as the most expensive single item ever constructed. Part of Boeing's services under the contract will relate to extending the station's primary structural hardware past 2020 to the end of 2028. The International Commercial Space Station was designed, built, and launched in phases by Axiom Space in 2018. The station will be complete in 2022.", "prediction 4": "The process of assembling the International Space Station has been under way since the 1990s. Currently, the station has been described as the most expensive single item ever constructed. During the assembly process, Boeing is extending the station's primary structural hardware past 2020 to the end of 2028. The American space technology startup company Axiom Space plans to launch and begin linking a module with the ISS in 2019.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 295 }, { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 390 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The process of assembling the International Space Station (ISS) has been under way since the 1990s. Part of Boeing's services under the contract will relate to extending the station's primary structural hardware past 2020 to the end of 2028." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the girl sloths name in zootopia?", "passages": [ [ "Zootopia", "Zootopia\n\nZootopia is a 2016 American 3D computer-animated buddy cop comedy film produced by Walt Disney Animation Studios and released by Walt Disney Pictures.", "It is the 55th Disney animated feature film.", "It was directed by Byron Howard and Rich Moore, co-directed by Jared Bush, and stars the voices of Ginnifer Goodwin, Jason Bateman, Idris Elba, Jenny Slate, Nate Torrence, Bonnie Hunt, Don Lake, Tommy Chong, J. K. Simmons, Octavia Spencer, Alan Tudyk, and Shakira.", "It details the unlikely partnership between a rabbit police officer and a red fox con artist, as they uncover a conspiracy involving the disappearance of savage predator inhabitants of a mammalian metropolis.", "\"Zootopia\" premiered at the Brussels Animation Film Festival in Belgium on February 13, 2016, and went into general theatrical release in conventional 2D, Disney Digital 3-D, RealD 3D, and IMAX 3D formats in the United States on March 4.", "Critics praised its screenplay, animation, voice acting, and subject matter." ], [ "Kristen Bell", "In September 2014, Bell starred with her husband, Dax Shepard, in a commercial for the Samsung Galaxy Tab S. It was so popular (with over 20 million YouTube views) that they did another for the holiday season.", "The ad agency McKinney was behind both.", "In 2016, Bell voiced the sloth Priscilla in the animated comedy film \"Zootopia\", and starred as Claire in the comedy film \"The Boss\".", "Bell starred as Kiki in the 2016 comedy film \"Bad Moms\", a role she reprised in the 2017 sequel, \"A Bad Moms Christmas\".", "In late 2016, Bell began starring as Eleanor Shellstrop in the NBC comedy series \"The Good Place\".", "Also in 2017, she appeared in the biographical comedy-drama \"The Disaster Artist\", the action comedy \"CHiPs\" and the comedy \"How to Be a Latin Lover\".", "In March 2017, Bell starred in an episode of the Houzz series \"My Houzz\", in which she surprised her sister with a major basement renovation.", "In November 2017, she played a housewife (with Dax Shepard as her husband) preparing for a Christmas party in Sia's music video for \"Santa's Coming For Us\"." ], [ "Kristen Bell", "Kristen Bell\n\nKristen Anne Bell (born July 18, 1980) is an American actress.", "She began her acting career by starring in stage productions while attending the Tisch School of the Arts in New York.", "In 2001, she made her Broadway debut as Becky Thatcher in \"The Adventures of Tom Sawyer\" and starred in the Broadway revival of \"The Crucible\" the following year.", "In 2004, she appeared in the film \"Spartan\" and won praise for her performance in \"Gracie's Choice\".", "Bell garnered critical acclaim for her first major role as the title character in the teen noir drama television series \"Veronica Mars\" (2004\u201307).", "For her performance, she was awarded a Saturn Award for Best Actress on Television.", "She reprised the eponymous role in the 2014 film continuation of the series.", "During her time on \"Veronica Mars\", Bell starred as Mary Lane in the film \"\" (2005), a reprise of the role she had played in the New York musical upon which the film was based.", "From 2007 to 2008, Bell starred as Elle Bishop in the sci-fi drama series \"Heroes\".", "From 2007 to 2012, she voiced the titular narrator in the teen drama television series \"Gossip Girl\".", "In 2008, she had her breakout film role as the title character in \"Forgetting Sarah Marshall\"." ] ], "gold": "Zootopia is a 2016 American computer-animated buddy cop film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. In the film, the girl sloth's name is Priscilla. Priscilla was voice by American Actress Kristen Bell. Bell has also voiced Princess Anna in the Disney animated fantasy films Frozen in 2013, Ralph Breaks the Internet 2018, and Frozen II 2019, and the short films Frozen Fever in 2015, and Olaf's Frozen Adventure in 2017.", "prediction 1": "The sloth named Priscilla in Zootopia is a girl sloth. Kristen Bell voiced the character.", "prediction 2": "In the 2016 American 3D computer-animated buddy cop comedy film Zootopia, American actress Kristen Bell voiced the sloth Priscilla. The female sloth in the film is named Priscilla.", "prediction 3": "Zootopia is a 2016 American computer-animated comedy film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The sloth's name in the film is Priscilla. American actress Kristen Bell voiced the sloth in the 2016 animated comedy film.", "prediction 4": "In the 2016 American computer-animated buddy cop comedy film Zootopia, American actress Kristen Bell voiced the sloth Priscilla.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Zootopia Zootopia is a 2016 American 3D computer-animated buddy cop comedy film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The sloth named Priscilla in Zootopia is a girl sloth. Kristen Bell voiced the character." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What team was case keenum on before the vikings?", "passages": [ [ "Case Keenum", "He was waived by the St. Louis Rams on October 28, 2014, in order to make room on the roster for newly acquired safety Mark Barron.", "He re-signed to the team's practice squad on October 30.", "On December 15, 2014, Keenum was signed off the Rams practice squad back to the Houston Texans.", "He filled a roster spot after starting quarterback Ryan Fitzpatrick broke his left leg in a game against the Indianapolis Colts on December 14, 2014, and on December 21, 2014, he won his first NFL game beating the Baltimore Ravens by a score of 25\u201313.", "On December 28, 2014, he won a second consecutive game with the Texans against the Jacksonville Jaguars 23\u201317.", "On March 11, 2015, Keenum was acquired from the Texans for a 7th-round pick in 2016.", "It was announced by head coach Jeff Fisher that Keenum would be the backup quarterback to recently acquired Nick Foles.", "On November 16, the Rams named Keenum the starting quarterback after announcing they had benched Foles.", "Near the end of the Rams' week-11 game against the Baltimore Ravens, Keenum suffered a concussion that left him visibly wobbly but was not removed from the game for evaluation.", "This led to an investigation by the NFL and the NFL Players Association." ], [ "Case Keenum", "In 2015, the Rams traded a draft pick to the Texans for Keenum, where he played until signing as a free agent with the Minnesota Vikings in 2017.", "After starter Sam Bradford got injured, Keenum came in and had a career year, setting highs in starts, passing yards, completions and touchdowns.", "He led the Vikings to a 13-win regular season, followed by a last-second win over the New Orleans Saints in the divisional round of the playoffs; the Vikings lost in the next round to the eventual Super Bowl champion Philadelphia Eagles.", "Keenum once again became a free agent, and signed a two-year deal with the Broncos in March 2018.", "Keenum played football for Wylie High School in Abilene, Texas.", "During his high school football career, he passed for 6,783 yards and 48 touchdowns and rushed for 41 touchdowns and 2,000 yards.", "Logging 42 starts at quarterback, Keenum posted a career record of 31\u201311.", "In 2004, Keenum led Wylie in the game-winning drive for a 17\u201314 victory over Cuero High School of Cuero, Texas in the Texas Class 3A Division I championship game.", "This is Wylie's only state championship to date as of the end of the 2015 season.", "Keenum also earned varsity letters in basketball and track during his high school career." ], [ "Case Keenum", "In week 6 at Detroit, Keenum went 27/32 with 321 yards, three touchdowns, an interception, a rushing touchdown, and set a team record with 19 consecutive completions.", "The Rams lost in a 31-28 shootout.", "The following week against the Giants at Twickenham Stadium, Keenum was intercepted four times as the Giants won 17-10.", "After the game, Rams head coach Jeff Fisher announced his decision to keep Keenum as starter.", "On November 15, 2016, Keenum was benched for Jared Goff, who the Rams had taken with the first overall pick in the 2016 NFL Draft.", "On March 31, 2017, Keenum signed a one-year contract with the Minnesota Vikings.", "Due to an injury to Sam Bradford, Keenum started the Week 2 game against the Pittsburgh Steelers, completing 20 of 37 passes for 167 yards in a 26\u20139 loss.", "During Week 3 against the Tampa Bay Buccaneers, Keenum threw for 369 yards and 3 touchdowns as the Vikings won by a score of 34\u201317.", "In Weeks 4\u20137, Keenum averaged 196 yards with a total of two touchdowns and two interceptions, but a record of 3\u20131 over the span.", "In Week 8 he had two touchdowns and 288 yards against the winless Cleveland Browns to enter the bye-week." ] ], "gold": "Before joining the Minnesota Vikings in 2017, NFL quarterback Case Keenum played for the St. Louis / Los Angeles Rams both before and after the team switched home cities in 2016. Keenum initially joined the St. Louis Rams prior to the 2014 season, before signing with the Houston Texans on December 15, 2014 and then rejoining the Rams in 2015.", "prediction 1": "Case Keenum played for the St. Louis Rams from 2014\u20132018. Then, from 2017\u201318, he was on the Minnesota Vikings.", "prediction 2": "Case Keenum was on the Saint Louis Rams practice squad from October 28 to December 15, 2014. He was then signed off the Rams practice squad back to the Houston Texans from December 15 to December 31, 2014. He then signed a free agent deal with the Minnesota Vikings from March 31 to March 31, 2017.", "prediction 3": "Case Keenum played for the Houston Texans from 2014 to 2017. He was waived by the St. Louis Rams on October 28, 2014, in order to make room on the roster for newly acquired safety Mark Barron. On December 15, 2014, he was signed off the Rams practice squad back to the Houston Texans. He filled a roster spot after starting quarterback Ryan Fitzpatrick broke his left leg in a game against the Indianapolis Colts on December 14, 2014, and on December 21, 2014, he won his first NFL game beating the Baltimore Ravens by a score of 25\u201313.", "prediction 4": "Case Keenum played for the St. Louis Rams from 2014 through 2018. He was on the Texans practice squad from 2014 until his signing as a free agent with the Minnesota Vikings in 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 47, "end": 57 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Case Keenum played for the St. Louis Rams and the Houston Texans from 2014\u20132016. Then from 2017\u201318, he was on the Minnesota Vikings." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "The guy who ate mcdonald's for a month and lost weight?", "passages": [ [ "Super Size Me", "After John Cisna, a high school science teacher, lost 60 pounds while eating exclusively at McDonald's for 180 days, he said, \"I'm not pushing McDonald's.", "I'm not pushing fast food.", "I'm pushing taking accountability and making the right choice for you individually...", "As a science teacher, I would never show \"Super Size Me\" because when I watched that, I never saw the educational value in that...", "I mean, a guy eats uncontrollable amounts of food, stops exercising, and the whole world is surprised he puts on weight?", "What I'm not proud about is probably 70 to 80 percent of my colleagues across the United States still show \"Super Size Me\" in their health class or their biology class.", "I don't get it.\"", "Six weeks after the film's debut, McDonald's dropped its supersize portions.", "In the United Kingdom, McDonald's publicized the website, which included a response to and criticisms of the film.", "In theaters in the UK, the company placed a brief ad in the film's trailers, pointing to the URL and stating \"See what we disagree with.", "See what we agree with\".", "Internationally, \"Super Size Me\" was a major success in the box office of Australia." ], [ "Super Size Me", "Super Size Me\n\nSuper Size Me is a 2004 American documentary film directed by and starring Morgan Spurlock, an American independent filmmaker.", "Spurlock's film follows a 30-day period from February 1 to March 2, 2003, during which he ate only McDonald's food.", "The film documents this lifestyle's drastic effect on Spurlock's physical and psychological well-being, and explores the fast food industry's corporate influence, including how it encourages poor nutrition for its own profit.", "Spurlock ate at McDonald's restaurants three times per day, eating every item on the chain's menu at least once.", "Spurlock consumed an average of 20.9 megajoules or 5,000 kcal (the equivalent of 9.26 Big Macs) per day during the experiment.", "An intake of around 2,500 kcal within a healthy balanced diet is more generally recommended for a man to maintain his weight.", "As a result, the then-32-year-old Spurlock gained , a 13% body mass increase, increased his cholesterol to 230\u00a0mg/dL (6.0\u00a0mmol/L), and experienced mood swings, sexual dysfunction, and fat accumulation in his liver.", "It took Spurlock fourteen months to lose all the weight gained from his experiment using a vegan diet supervised by his then-girlfriend, a chef who specializes in gourmet vegan dishes." ] ], "gold": "In the 2004 American documentary Super Size Me, independent filmmaker Morgan Spurlock ate only McDonald's food from February 1 to March 2, 2003 and recorded his experience.", "prediction 1": "John Cisna, a high school science teacher, lost 60 pounds while eating exclusively at McDonald's for 180 days. Super Size Me is a 2004 American documentary film directed by and starring Morgan Spurlock, an American independent filmmaker. Spurlock ate at McDonald's restaurants three times per day, eating every item on the chain's menu at least once. It took Spurlock fourteen months to lose all the weight gained from his experiment using a vegan diet supervised by his then-girlfriend, a chef who specializes in gourmet vegan dishes.\n", "prediction 2": "John Cisna, a high school science teacher, lost 60 pounds while eating exclusively at McDonald's for 180 days. John Cisna's success inspired him to write his own cookbook and execute his own eating experiment. Super Size Me is an American documentary film that follows a 30-day period from February 1 to March 2, 2003, during which he ate only McDonald's food. Coach Howard Smith, a doctor, wrote a book about his experience during the experiment.", "prediction 3": "In 2003, a middle-school science teacher named John Cisna, ate constantly at McDonald's restaurants for a month and lost 60 pounds. This guy is Morgan Spurlock, the subject of the 2004 documentary film, Super Size Me, which documents this lifestyle's drastic effect on Spurlock's physical and psychological well-being. American independent filmmaker Morgan Spurlock followed a 30-day period from February 1 to March 2, 2003, during which he ate only McDonald's food. The man's weight went down as a few days and after a single meal. Spurlock's weight went down to a vegan diet supervised by his then-girlfriend, a chef who specializes in gourmet vegan dishes.", "prediction 4": "Super Size Me is a 2004 documentary film that documents the negative effects of a fast food lifestyle on an individual's physical and psychological health. Morgan Spurlock lived the fast food lifestyle for 30 days from February 1 to March 2, 2003. He consumed an average of 18 kilos each day, or 17,867 calories a day. The man in the film, named Mike, lost 11 kilos in that time span, and it took Spurlock fourteen months to lose all the weight gained.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 350 }, { "error type": "Irrelevant", "explanation": "", "start": 351, "end": 536 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Super Size Me is a 2004 American documentary film directed by and starring Morgan Spurlock, an independent filmmaker. Spurlock's film follows a 30-day period from February 1 to March 2, 2003, during which he ate only McDonald's food. The film documents this lifestyle's drastic effect on Spurlock's physical and psychological well-being.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When do blair and the prince get married?", "passages": [ [ "Gossip Girl (season 5)", "Season five opens in Los Angeles, where a vacationing Chuck and Nate decide to visit Serena, who is working on a film set.", "Back in New York, Blair learns that planning a royal wedding can be stressful, especially with a baby on the way, and Dan discovers the consequences of writing candidly about his closest friends.", "Also, the surprise return of cousin Charlie will threaten to destroy the van der Woodsen family.", "Confused about Chuck's sudden change, Blair is determined to prove his behaviour is an act to win her back.", "The series' 100th episode focused on Blair's wedding to prince Louis.", "\"I think it's our biggest episode since the pilot\", said executive producer Joshua Safran.", "With the move to 8:00pm, The CW charged $50,304 for a 30-second advertising slot before the fifth season began airing.", "The season premiere was watched by 1.37 million viewers and received a 0.7 rating in the Adults 19\u201349 demo, down 0.3 compared to last season's premiere.", "Episode 23 hit a new series low, hitting for the fourth time a total viewership below the one-million-viewer mark, to 869,000 viewers and a 0.4 in the 18-49 demographic." ], [ "G.G. (Gossip Girl)", "G.G. (Gossip Girl)\n\n\"G.G.\" is the thirteenth episode of the fifth season of the American television teen drama, \"Gossip Girl\" and the show's 100th episode overall.", "The episode was written by executive producer Joshua Safran and directed by Mark Piznarski.", "It premiered on The CW Television Network (The CW) in the United States on January 30, 2012.", "In the episode, the wedding of Blair Waldorf (Leighton Meester) to Prince Louis Grimaldi (Hugo Becker) takes place.", "The episode opened to favorable reviews, with television critics praising the fact it honored the series' successful days.", "Michelle Trachtenberg's performance as Georgina Sparks was also well received.", "Upon its initial airing, the episode was viewed by 1.39 million Americans and garnered a 0.7/2 Nielsen rating/share in the 18\u201349 demographic.", "The total viewership and ratings for this episode were slightly up in comparison to the previous episode \"Father and the Bride\".", "The episode begins with a musical dream sequence of Serena (Blake Lively), featuring herself as Marilyn Monroe singing \"Diamonds Are a Girl's Best Friend\" and Blair (Leighton Meester) as Audrey Hepburn.", "Everyone prepares for the wedding of Blair to Prince Louis Grimaldi of Monaco (Hugo Becker)." ] ], "gold": "In the U.S. TV show \"Gossip Girl, the wedding between Blair Waldorf and Prince Louis Grimaldi occurred in episode 13 of season 5, \"G.G.\". It was the series' 100th episode. It aired on January 30, 2012, and was watched by 1.39 million people.", "prediction 1": "The episode \"G.G.\" is the 13th episode of the fifth season of the American television teen drama, Gossip Girl, and the show's 100th episode overall. In the episode, the wedding of Blair Waldorf to Prince Louis Grimaldi of Monaco takes place.", "prediction 2": "In the episode \"G.G.\", Blair and the prince get married. The episode was the thirteenth episode of the fifth season of the American television teen drama, \"Gossip Girl\".", "prediction 3": "The episode \"G.G.\" is the thirteenth episode of the fifth season of the American television teen drama, Gossip Girl, and the show's 100th episode overall. In the episode, the wedding of Blair Waldorf to Prince Louis Grimaldi of Monaco takes place.", "prediction 4": "In The CW Television Network's fifth season Gossip Girl, the third episode of the fifth season focused on the wedding of Blair Waldorf and Prince Louis Grimaldi, and the show's 100th episode overall. In the episode G.G., the wedding of Blair Waldorf and Prince Louis Grimaldi takes place. The episode premiered on The CW Television Network in the United States on January 30, 2012.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The episode \"G.G.\" is the 13th episode of the fifth season of the American television teen drama, Gossip Girl, and the show's 100th episode overall. In the episode, the wedding of Blair Waldorf to Prince Louis Grimaldi of Monaco takes place. It aired on January 30, 2012, and was watched by 1.39 million Americans." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When did the kindle fire first come out?", "passages": [ [ "Kindle Fire", "Kindle Fire\n\nThe Fire Tablet, formerly called the Kindle Fire, is a tablet computer developed by Amazon.com.", "Built with Quanta Computer, the Kindle Fire was first released in November 2011, featuring a color 7-inch multi-touch display with IPS technology and running a custom version of Google's Android operating system called Fire OS.", "The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013.", "In September 2014, when the fourth generation was introduced, the name \"Kindle\" was dropped.", "In September 2015, the fifth generation Fire 7 was released, followed by the sixth generation Fire HD 8, in September 2016.", "The seventh generation Fire 7 was released in June 2017.", "On September 7, 2012, upgrades to the device were announced with consumer availability to those European countries with a localized version of Amazon's website (United Kingdom, France, Germany, Italy and Spain).", "The original Kindle Fire retailed for in 2011.", "Estimates of the device's initial bill of materials cost ranged from $150 to $202.", "Amazon's business strategy was stated in 2011 as making money through sales of digital content on the \"Fire\", rather than through sales of the device itself." ], [ "Kindle Fire", ", the Kindle Fire was the second best selling tablet after Apple's iPad, with about 7\u00a0million units sold according to estimates by Forrester Research and Amazon's tablets were the fourth best selling.", "On September 6, 2012, the Kindle Fire was upgraded to the second generation, and its price was reduced to , RAM upgraded to 1\u00a0GB and processor clock speed upgraded to 1.2\u00a0GHz.", "A more powerful and video-friendly version, the Kindle Fire HD (7 and 8.9 inch versions) was also made available, initially priced at $199 and $299.", "On September 25, 2013, the Kindle Fire HD was upgraded as the third generation \"Fire\", priced at , and the Kindle Fire HDX was introduced.", "The Kindle Fire HDX had an improved graphics engine, double the memory, and triple the processor speed of the previous model.", "The 7-inch and 8.99-inch versions were introduced at and respectively.", "In September 2014, the Fire HDX 8.9 and the Fire HD were upgraded to the fourth generation of Fire tablets, removing the \"Kindle\" adjective in the naming scheme.", "There was also the Fire HD 6 that has a six-inch screen with a quad-core processor priced at ." ] ], "gold": "Amazon's tablet computer the Kindle Fire was first released in November 2011. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. In September 2014, when the fourth generation was introduced, the name \"Kindle\" was abandoned. New generations of the tablet continued to drop annually through June 2019, with the release of the ninth generation, Fire 7.", "prediction 1": "The Kindle Fire tablet is a tablet computer developed by Amazon.com. The Kindle Fire was first released in November 2011, featuring a color 7-inch multi-touch display with IPS technology and running a custom version of Google's Android operating system called Fire OS. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. The seventh generation Kindle Fire 7 was released in June 2017.", "prediction 2": "The Fire Tablet, formerly called the Kindle Fire, is a tablet computer developed by Amazon.com. Built with Quanta Computer, the Kindle Fire was first released in November 2011, featuring a color 7-inch multi-touch display with IPS technology and running a custom version of Google's Android operating system called Fire OS. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. In September 2014, when the fourth generation was introduced, the name \"Kindle\" was dropped.", "prediction 3": "The Kindle Fire is a tablet computer developed by Amazon.com. It was first released in November 2011, featuring a color 7-inch multi-touch display with IPS technology and running a custom version of Google's Android operating system called Fire OS. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. In September 2014, when the fourth generation was introduced, the name \"Kindle\" was dropped. On September 7, 2012, upgrades to the device were announced with consumer availability to those European countries with a localized version of Amazon's website (United Kingdom, France, Germany, Italy and Spain).", "prediction 4": "Built with Quanta Computer, the Kindle Fire was first released in November 2011, featuring a color 7-inch multi-touch display with IPS technology and running a custom version of Google's Android operating system called Fire OS. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. In September 2014, when the fourth generation was introduced, the name \"Kindle\" was dropped. In September 2015, the fifth generation Fire 7 was released, followed by the sixth generation Fire HD 8, in September 2016. The seventh generation Fire 7 was released in June 2017. The seventh generation Fire 7 was released in June 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 268 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Kindle Fire tablet is a tablet computer developed by Amazon.com. The Kindle Fire was first released in November 2011. The Kindle Fire HD followed in September 2012, and the Kindle Fire HDX in September 2013. In September 2014, when the fourth generation was introduced, the name \"Kindle\" was dropped. The seventh generation Kindle Fire 7 was released in June 2017." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played the marshal in the man who shot liberty valance?", "passages": [ [ "The Man Who Shot Liberty Valance", "The Man Who Shot Liberty Valance\n\nThe Man Who Shot Liberty Valance () is a 1962 American Western film directed by John Ford starring James Stewart and John Wayne.", "The black-and-white film was released by Paramount Pictures.", "The screenplay by James Warner Bellah and Willis Goldbeck was adapted from a short story written by Dorothy M. Johnson.", "The supporting cast features Vera Miles, Lee Marvin, Edmond O'Brien, Andy Devine, John Carradine, Woody Strode, Strother Martin, and Lee Van Cleef.", "In 2007, the film was selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant.\"", "Senator Ranse Stoddard and his wife Hallie arrive in Shinbone, a frontier town in an unnamed western state, to attend the funeral of Tom Doniphon.", "As they pay their respects, reporters ask Stoddard why a United States Senator would make the long journey from Washington to attend the funeral of a local rancher.", "The story flashes back 25 years; Stoddard is a young, idealistic attorney.", "His stagecoach is robbed by Liberty Valance and his gang.", "When Stoddard tries to take Valance to task, Stoddard is brutally whipped and left for dead." ], [ "Andy Devine", "Andy Devine\n\nAndrew Vabre Devine (October 7, 1905 \u2013 February 18, 1977) was an American character actor known for his distinctive raspy, crackly voice and roles in Western films.", "He is probably best remembered for his role as Cookie, the sidekick of Roy Rogers in 10 feature films.", "He also appeared alongside John Wayne in films like \"Stagecoach\" (1939), \"The Man Who Shot Liberty Valance\" and \"How the West Was Won\" (both 1962).", "He is also remembered as Jingles on the TV series \"The Adventures of Wild Bill Hickok\" from 1951 to 1958, as Danny McGuire in \"A Star Is Born\" (1937) and as the voice of Friar Tuck in the Disney Animation film \"Robin Hood\" (1973).", "Devine was born in Flagstaff, Arizona on October 7, 1905.", "He grew up in Kingman, Arizona, where his family moved when he was one year old.", "His father was Thomas Devine Jr., born in 1869 in Kalamazoo County, Michigan.", "Andy's grandfather Thomas Devine Sr. was born in 1842 in County Tipperary, Ireland, and immigrated to the United States in 1852.", "Andy's mother was Amy Ward, a granddaughter of Commander James H. Ward, the first officer of the United States Navy killed during the Civil War.", "Devine was a Republican." ], [ "The Man Who Shot Liberty Valance (stage play)", "The Man Who Shot Liberty Valance (stage play)\n\nThe Man Who Shot Liberty Valance is a 2014 Western stage play by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for the 1962 Paramount Pictures film \"The Man Who Shot Liberty Valance\", directed by John Ford, starring James Stewart and John Wayne, with the song performed by Gene Pitney.", "The play is billed as \"classic story of good versus evil, law versus the gun, one man versus Liberty Valance.", "A tale of love, hope and revenge set against the vicious backdrop of a lawless society\".", "A young scholar from New York City travels west in search of a new life he arrives beaten and half-dead on the dusty streets of Twotrees.", "Rescued from the plains, the town soon becomes his home as he finds the love of a local woman.", "This love gives him purpose in a broken land, but is it enough to save him from the vicious outlaw who wants him dead?" ] ], "gold": "The Man Who Shot Liberty Valance is a 1962 American dramatic Western film directed by John Ford, which was adapted from a 1953 short story written by Dorothy M. Johnson. American character actor Andy Devine, who was known for his distinctive raspy, crackly voice and roles in Western films, played the role of the marshal in the film. In addition, The Man Who Shot Liberty Valance is a 2014 Western stage play by Jethro Compton, which is also based on the 1953 short story of the same name by Dorothy M. Johnson. In the play, Robert G Slade plays the role of the marshal.", "prediction 1": "The Man Who Shot Liberty Valance is a 1962 American Western film directed by John Ford starring James Stewart and John Wayne. The black-and-white film was released by Paramount Pictures. The 2014 Western stage play is by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for the 1962 Paramount Pictures film and the 2014 Western stage play by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for the 2014 Western stage play by Jethro Compton billed as \"classic story of good versus the gun, one man versus Liberty Valance\".", "prediction 2": "The Man Who Shot Liberty Valance is a 1962 American western film directed by John Ford starring James Stewart and John Wayne. The 2014 Western stage play by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for the 1962 Paramount Pictures film The Man Who Shot Liberty Valance, directed by John Ford. In the 1962 film, Edmond O'Brien plays the marshal.", "prediction 3": "The Man Who Shot Liberty Valance is a 1962 American Western film directed by John Ford starring James Stewart and John Wayne. The black-and-white film was released by Paramount Pictures. The 2014 Western stage play by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which became the basis for the 1962 Paramount Pictures film The Man Who Shot Liberty Valance. The marshal in the 2014 Western stage play is played by Andy Devine.", "prediction 4": "The Man Who Shot Liberty Valance is a 1962 American Western film directed by John Ford starring James Stewart and John Wayne, as well as a Western stage play by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson. The marshal in the 1962 Paramount Pictures film is played by Edmond O'Brien, Edmond O'Brien plays the marshal in the 2014 play by Jethro Compton, and the marshal in the 1962 Paramount Pictures film is played by Ed Roberts. The marshal in the 2014 Western stage play is directed by Jethro Compton.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 125 }, { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 370 }, { "error type": "Redundant", "explanation": "The 2014 Western stage play is by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for ", "start": 375, "end": 522 }, { "error type": "Irrelevant", "explanation": "", "start": 523, "end": 650 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Man Who Shot Liberty Valance is a 1962 American Western film directed by John Ford based on the 1953 short story of the same name by Dorothy M. Johnson. Andy Devine was an American character actor known for his distinctive raspy, crackly voice and roles in Western films. The 2014 Western stage play is by Jethro Compton based on the 1953 short story of the same name by Dorothy M. Johnson, which also became the basis for the 1962 Paramount Pictures film." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who founded the first english institution of higher learning in india?", "passages": [ [ "Presidency University, Kolkata", "The purpose of the meeting was to \"discuss the proposal to establish an institution for giving a liberal education to the children of the members of the Hindu Community\".", "The proposal was received with unanimous approbation and a donation of over Rs. 100, 000 was promised for the setting up of the new college.", "Raja Ram Mohan Roy showed full sympathy for the scheme but chose not to come out in support of the proposal publicly for fear of \"alarming the prejudices of his orthodox countrymen and thus marring the whole idea\".", "The College was formally opened on Monday, 20 January 1817 with 20 'scholars'.", "The foundation committee of the college, which oversaw its establishment, was headed by Raja Rammohan Roy.", "The control of the institution was vested in a body of two Governors and four Directors.", "The first Governors of the college were Maharaja Tejchandra Bahadur of Burdwan and Gopee Mohan Thakoor.", "The first Directors were Gopi Mohun Deb of Sobhabazar, Joykissen Sinha, Radha Madhab Banerjee and Gunganarain Doss.", "Buddinath Mukherjee was appointed as the first Secretary of the college.", "The newly established college mostly admitted Hindu students from affluent and progressive families, but also admitted non-Hindu students such as Muslims, Jews, Christians and Buddhists." ], [ "Presidency University, Kolkata", "Presidency University, Kolkata\n\nPresidency University, Kolkata, formerly known as Hindu College and Presidency College, is a public state university located in College Street, Kolkata.", "It is considered to be one of the best liberal arts and science institutions in India.", "The institution was elevated to University status in 2010, before which it was functioning as a top constituent college under University of Calcutta for a period of around 193 years.", "The University had its bicentenary celebrations in 2017.", "In its first cycle as a university, Presidency received the highest possible \"A\" rating by the NAAC.", "Presidency has been recognized as an \"Institute of National Eminence\" by the UGC.", "It appeared in the inaugural top 50 of NIRF rankings in 2016.", "However, NIRF rankings in 2017 and 2018 excluded Universities like Presidency University which taught only science and humanities but not engineering, commerce, agriculture etc.", "With the creation of the Supreme Court of Calcutta in 1773 many Hindus of Bengal showed eagerness to learn the English language.", "David Hare, in collaboration with Raja Radhakanta Deb had already taken steps to introduce English education in Bengal.", "Babu Buddinath Mukherjee advanced the introduction of English as a medium of instruction further by enlisting the support of Sir Edward Hyde East, Chief Justice of the Supreme Court of Fort William who called a meeting of 'European and Hindu Gentlemen' in his house in May 1816." ] ], "gold": "David Hare was the philanthropist who took steps to introduce English education in Bengal. Babu Buddinath Mukherjee advanced the introduction of English as a medium of instruction further by enlisting the support of Sir Edward Hyde East, Chief Justice of the Supreme Court of Fort William, who called a meeting of 'European and Hindu Gentlemen' in his house in May 1816. The College was formally opened on Monday, 20 January 1817 with 20 'scholars'. The foundation committee of the college, which oversaw its establishment, was headed by Raja Rammohan Roy.", "prediction 1": "David Hare, in collaboration with Raja Radhakanta Deb, had already taken steps to introduce English education in Bengal. Babu Buddinath Mukherjee advanced the introduction of English as a medium of instruction further by enlisting the support of Sir Edward Hyde East, Chief Justice of the Supreme Court of Fort William, who called a meeting of 'European and Hindu Gentlemen' in his house in May 1816.", "prediction 2": "The first English institution of higher learning in India was founded by Sir Edward Hyde East in May 1816. Presidency University, Kolkata is considered to be one of the best liberal arts and science institutions in India. The first English institution of higher learning in India was founded by Babu Buddinath Mukherjee.", "prediction 3": "The first English institution of higher learning in India was founded by Sir Edward Hyde East in 1816. Sir Edward Hyde East called a meeting of 'European and Hindu Gentlemen' in his house in May 1816. Sir Edward Hyde East was a former justice of the Supreme Court of Fort William.", "prediction 4": "Sir Edward Hyde East, Chief Justice of the Supreme Court of Fort William, called a meeting of 'European and Hindu Gentlemen' in his house in May 1816. This meeting was to discuss the proposal to establish an institution for giving a liberal education to the children of the members of the Hindu Community. The proposal was received with unanimous approbation and a donation of over Rs. 100, 000 was promised for the setting up of the new college. Raja Rammohan Roy headed the foundation committee of the college, which oversaw its establishment. The foundation committee of the college, which oversaw its establishment, was headed by Raja Rammohan Roy. The first Governors were Maharaja Tejchandra Bahadur of Burdwan and Gopeeeeeeeeeeeeeeeeeee Mohan Thakoor. The first Directors were Gopi Mohun Deb", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "David Hare, in collaboration with Raja Radhakanta Deb, had already taken steps to introduce English education in Bengal. Babu Buddinath Mukherjee advanced the introduction of English as a medium of instruction further by enlisting the support of Sir Edward Hyde East, Chief Justice of the Supreme Court of Fort William, who called a meeting of 'European and Hindu Gentlemen' in his house in May 1816. The College was formally opened on Monday, 20 January 1817 with 20 'scholars'. The foundation committee of the college, which oversaw its establishment, was headed by Raja Rammohan Roy." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who threw the overalls in mistress murphy's chowder?", "passages": [ [ "Who Threw the Overalls in Mrs. Murphy's Chowder", "Who Threw the Overalls in Mrs. Murphy's Chowder\n\n\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\".", "It was written by George L. Giefer in 1898 and originally recorded by Edward M. Favor in 1901.", "It was later recorded by Bing Crosby on December 6, 1945 and included in his album\n\"St. Patrick's Day\".", "Julie Andrews included the song in her album \"Don't Go in the Lion's Cage Tonight\" (1962).
\n\n", "The song describes an incident in which a pair of worn-out overalls are found in a batch of Mrs. Murphy's large pot of chowder.", "Tim Nolan, who discovered the overalls, immediately assumes it was a prank, and promises to inflict pain on \"the mick that threw the overalls ... \".", "Mistress Murphy, upon realizing the ruckus, admits that she forgot to take the overalls out of the pot after she had been using it for laundry earlier in the day, at which point Nolan apologizes and the group puts music to his words and sing (the chorus)." ] ], "gold": "Who Threw the Overalls in Mrs. Murphy's Chowder? is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". The song describes an incident in which a pair of worn-out overalls are found in a batch of Mrs. Murphy's large pot of chowder. Tim Nolan, who discovered the overalls, immediately assumes it was a prank, and promises to inflict pain on \"the mick that threw the overalls ... \". Mistress Murphy, upon realizing the ruckus, admits that she forgot to take the overalls out of the pot after she had been using it for laundry earlier in the day, at which point Nolan apologizes and the group puts music to his words and sing (the chorus).", "prediction 1": "\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". It was written by George L. Giefer in 1898 and originally recorded by Edward M. Favor in 1901. It was later recorded by Bing Crosby on December 6, 1945 and included in his album \"St. Patrick's Day\". Julie Andrews included the song in her album \"Don't Go in the Lion's Cage Tonight\" (1962).", "prediction 2": "\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". It was written by George L. Giefer in 1898, originally recorded by Edward M. Favor in 1901. It was later recorded by Bing Crosby on December 6, 1945, and included in his album \"St. Patrick's Day\". Julie Andrews included the song in her album \"Don't Go in the Lion's Cage Tonight\" in 1962.", "prediction 3": "\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". It was written by George L. Giefer in 1898 and originally recorded by Edward M. Favor in 1901. It was later recorded by Bing Crosby on December 6, 1945 and included in his album \"St. Patrick's Day\". Julie Andrews included the song in her album \"Don't Go in the Lion's Cage Tonight\".", "prediction 4": "\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". It was written by George L. Giefer in 1898 and originally recorded by Edward M. Favor in 1901. It was later recorded by Bing Crosby on December 6, 1945 and included in his album St. Patrick's Day. Julie Andrews included the song in her album \"Don't Go in the Lion's Chowder Tonight\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 433 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Who Threw the Overalls in Mrs. Murphy's Chowder?\" is a popular song, sometimes known as \"Who Threw the Overalls in Mistress Murphy's Chowder\". The song describes an incident in which a pair of worn-out overalls are found in a batch of Mrs. Murphy's large pot of chowder. Tim Nolan, who discovered the overalls, immediately assumes it was a prank, and promises to inflict pain on \"the mick that threw the overalls ... \". Mistress Murphy, upon realizing the ruckus, admits that she forgot to take the overalls out of the pot after she had been using it for laundry earlier in the day, at which point Nolan apologizes and the group puts music to his words and sing (the chorus)." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is the difference between blue and red cigarettes?", "passages": [ [ "L&M", "L&M\n\nL&M is an American brand of cigarettes, currently owned and manufactured by Altria (previously known as Philip Morris Companies, Inc.).", "The name comes from the tobacco company founded in 1873 called Liggett & Myers Tobacco Company, predecessor of today's Liggett Group in which L&M was originally produced.", "\"L&M\" was launched in 1885 by Liggett & Myers as a plug chewing tobacco.", "In 1952 or 1953, the first L&M cigarettes were created and they were one of the earliest, perhaps the earliest brand to have a filter that was not a one-sided filter.", "When \"L&M\" was launched, their motto was \"\"American cigarettes of the highest quality with the best filter\"\".", "When their success in the American market was solidified, Liggett Group made a proposal to take the brand international.", "In 1999, the L&M trademark rights were acquired by the largest tobacco company in the United States, Philip Morris, and are still produced by them today.", "The brand is popular in Latin America, central and northern Europe, the Arab World and the far east and south Asia.", "They were not very common in the continental US until a new roll out made them available in October 2007." ], [ "Sterling (cigarette)", "Sterling (cigarette)\n\nSterling is a British brand of cigarettes, currently owned and manufactured by Gallaher Group, a subsidiary of Japan Tobacco in 2007.", "Sterling Dual had been a fairly popular mid-range brand up to the 1970s but sales dwindled and the brand was eventually discontinued.", "The brand was officially re-launched in the United Kingdom in 2006.", "Sterling Dual is the largest selling cheap brand in the UK and is the 8th biggest selling brand of cigarettes in the UK.", "According to data from AC Nielsen, Sterling Dual has a 44% share in the cheap brand tobacco sector and has retail sales of an excess of \u00a3261million.", "They are available in four different colours, red, blue (smooth), green (menthol) and a blue-green gradient (click-on menthol \"Fresh Taste\").", "Sterling Dual cigarettes are also available in Superking size.", "In 2018, a double capsule cigarette was introduced as Sterling Double Capsule, available in king size.", "Some advertising posters were made for Sterling cigarettes.", "Sterling is mainly sold in the United Kingdom, but also was or still is sold in The Netherlands, Cyprus,Spain, Australia, New Zealand, Papua New Guinea and the United States." ], [ "West (cigarette)", "West (cigarette)\n\nWest is a German brand of cigarettes, currently owned and manufactured by Imperial Tobacco.", "West was introduced to the German market in 1981 and initially were only available in specialised tobacco shops.", "The launch of the new brand was accompanied by a dynamic advertising campaign under the slogan \"\"Let's go West!\"\".", "Thanks to a successful pricing policy and positioning quality at a reasonable price, a year later the brand became one of the leading in Germany.", "Since approximately 1987 West became available in supermarkets and cigarette vending machines.", "West is the second-strongest cigarette brand in Germany.", "In 1986, the advertising campaign \"\"Test the West!\"\" started, which significantly increased the brand recognition.", "The success consisted in simplicity and originality of the action.", "Promoters in pubs, bars, restaurants and discotheques offered young people with blindfolds to try West cigarettes, compare them with what they usually smoke, and make a choice in favor of one or another brand.", "In 1989, West Lights were introduced.", "The expansion of the range and the high demand for West cigarettes made it possible in two years to begin sales in Central and Eastern Europe.", "In July 1995, it was reported that West was one of the most popular brands in the former German Democratic Republic." ] ], "gold": "Some companies have red and blue cigarettes. The difference in color in Winfield cigarettes is due to tar content, with Winfield Red (16mg) and Winfield Blue (12 mg). L&M, an American brand of cigarettes, currently owned and manufactured by Altria and Philip Morris International, has L&M Red (Full Flavor) and L&M Blue Pack. Sterling, a British brand of cigarettes, currently owned and manufactured by Gallaher Group, a subsidiary of Japan Tobacco in 2007, has Red and blue (smooth). West, a German brand of cigarettes, currently owned and manufactured by Imperial Tobacco, has West Red with 10 mg tar, 0.9 mg nicotine, and 10 mg carbon monoxide and West Blue with 4 mg tar, 0.4 mg nicotine, and 4 mg carbon monoxide.", "prediction 1": "There is a difference between two different types of cigarettes, called blue and red cigarettes. The difference between the two is the thickness of the cigarette pack. For a full comparison, see the table below.", "prediction 2": "There are numerous different types of cigarettes. There is the American brand L&M, which is owned and manufactured by Altria, and the British brand Sterling. In the United States there is the L&M brand, which is owned and manufactured by Philip Morris. There is also the West brand, which is owned and manufactured by Imperial Tobacco.", "prediction 3": "Blue cigarettes have a smoother taste than red cigarettes, while the smoother ones have a menthol taste. Sterling Dual is a British brand of cigarettes owned and manufactured by Gallaher Group, a subsidiary of Japan Tobacco in 2007.", "prediction 4": "There are several different brands of cigarettes. The difference is that the blue cigarettes are smooth and the red are menthol cigarettes. The difference between the two colors is that the menthol is mixed with the blue and the menthol is mixed with the red.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 211 }, { "error type": "Incoherent", "explanation": "", "start": 65, "end": 71 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There is a difference between blue and red cigarettes. L&M is an American brand of cigarettes, currently owned and manufactured by Altria (previously known as Philip Morris Companies, Inc.). Sterling is a British brand of cigarettes, currently owned and manufactured by Gallaher Group, a subsidiary of Japan Tobacco in 2007. They have red cigarettes and blue, which is (smooth). West is a German brand of cigarettes, currently owned and manufactured by Imperial Tobacco." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who owns the lord of the rings franchise?", "passages": [ [ "Middle-earth Enterprises", "Middle-earth Enterprises\n\nMiddle-earth Enterprises, formerly known as Tolkien Enterprises, is a trading name for a division of The Saul Zaentz Company, located in Berkeley, California.", "The company owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: \"The Lord of the Rings\" and \"The Hobbit\".", "These elements include the titles of the works, the names of characters contained within as well as the names of places, objects and events within them, and certain short phrases and sayings from the works.", "J. R. R. Tolkien, the author of \"The Hobbit\" and \"The Lord of the Rings\", sold the film, stage and merchandising rights of those works to United Artists in 1968, who in turn sold them to The Saul Zaentz Company in 1976, which licenses them through the former Tolkien Enterprises, now \"Middle-earth Enterprises\".", "United Artists retained distribution rights.", "In 1977, Rankin/Bass licensed the rights to produce an animated version of \"The Hobbit\", which was broadcast on NBC.", "In 1978, Tolkien Enterprises and the distributor United Artists funded and released an animated version of \"The Lord of the Rings\" directed by Ralph Bakshi, which covered approximately the first half of the Lord of the Rings." ] ], "gold": "Middle-earth Enterprises, a trading name for a division of The Saul Zaentz Company, owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works, \"The Lord of the Rings\" and \"The Hobbit\". Middle-earth Enterprises, then known as Tolkien Enterprises, bought the film, stage, and merchandizing rights to those works in 1976 from United Artists, who had purchased the rights from Tolkien in 1968.", "prediction 1": "Middle-earth Enterprises, formerly known as Tolkien Enterprises, is a trading name for a division of The Saul Zaentz Company, located in Berkeley, California. The company owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: \"The Lord of the Rings\" and \"The Hobbit\". The Saul Zaentz Company in 1976 licensed the film, stage and merchandising rights of those works to the former Tolkien Enterprises, now called Middle-earth Enterprises.", "prediction 2": "Middle-earth Enterprises is a trading name for a division of The Saul Zaentz Company, located in Berkeley, California. The company owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: The Lord of the Rings and The Hobbit. These elements include the titles of the works, the names of characters contained within as well as the names of places, objects and events within them, and certain short phrases and sayings from the works. J. R. R. Tolkien sold the film, stage and merchandising rights of those works to United Artists in 1968. In 1976, Middle-earth Enterprises, formerly known as Tolkien Enterprises, which licenses them through the former Tolkien Enterprises, which licenses them through the former Tolkien Enterprises, now \"Tolkien Enterprise", "prediction 3": "Middle-earth Enterprises is a trading name for a division of The Saul Zaentz Company, located in Berkeley, California. The company owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: \"The Lord of the Rings\" and \"The Hobbit\". These elements include the titles of the works, the names of characters contained within as well as the names of places, objects and events within them, and certain short phrases and sayings from the works.", "prediction 4": "Middle-earth Enterprises holds the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: \"The Lord of the Rings\" and \"The Hobbit\". These elements include the titles of the works, the names of characters contained within as well as the names of places, objects and events within them, and certain short phrases and sayings from the works. Tolkien sold the film, stage and merchandising rights of those works to United Artists in 1968, who in turn sold them to The Saul Zaentz Company in 1976, who licenses them through the former Tolkien Enterprises, now Middle-earth Enterprises, which licenses them through the former Tolkien Enterprises, which licenses them through the former Tolkien Enterprises, which licenses them through the former Tolkien Enterprises and the distributor United Artists funded", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 158 } ], "missing-info": [], "corrected-prediction": "Middle-earth Enterprises, formerly known as Tolkien Enterprises, is a trading name for a division of The Saul Zaentz Company. The company owns the worldwide exclusive rights to certain elements of J. R. R. Tolkien's two most famous literary works: \"The Lord of the Rings\" and \"The Hobbit\". The Saul Zaentz Company in 1976 licensed the film, stage and merchandising rights of those works to the former Tolkien Enterprises, now called Middle-earth Enterprises." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays the white walkers in game of thrones?", "passages": [ [ "White Walker", "Their apparent leader is the Night King, portrayed by Richard Brake and Vladimir Furdik, who first appeared in the episode \"Oathkeeper\".", "In \"Hardhome\", the effectiveness of Valyrian steel against the White Walkers is proven as Jon shatters one to pieces with a single stroke of his ancient sword Longclaw.", "Unlike in the novels, the TV series has established that wights can be destroyed by dragonglass.", "In the season 6 episode \"The Door\" (May 2016), Bran Stark experiences a vision of the creation of the Night King by Leaf, one of the Children of the Forest, by stabbing a human prisoner in the chest with a dragonglass dagger.", "Leaf explains to an incredulous Bran that the Children were at war with the First Men.", "In 2012, Funko released a White Walker figure as part of their POP!", "Television line, which are 4.5 inch vinyl figures in the Japanese super deformed style.", "The company later produced a Mystery Mini Blind Box figurine of a stylized White Walker.", "Dark Horse released a 9-inch White Walker bust statue in 2013, and later a 9-inch full figure statue.", "In 2014, Funko released a 6.5 inch articulated White Walker action figure (with spear accessory) as part of their HBO-licensed Legacy Collection line, which features \"some of the series\u2019 most popular characters\"." ], [ "Ian Whyte (actor)", "Ian Whyte (actor)\n\nIan Stuart Whyte (born 17 September 1971) is a Welsh actor, stuntman and former professional basketball player.", "Whyte began his career a professional basketball player for the Newcastle Eagles.", "He also collected 80 caps for the England national team.", "After his retirement from basketball he began his second career as a stuntman and actor.", "Whyte is best known for portraying Predators in the movies \"Alien vs. Predator\" and \"\".", "Whyte portrayed one of the \"Engineer\" aliens seen in Ridley Scott's 2012 science fiction film, \"Prometheus\".", "In 2010, Whyte played Sheikh Sulieman in Clash of the Titans.", "He has portrayed various characters requiring a physically tall actor in the HBO series \"Game of Thrones\", including White Walkers in season 1 and season 2 and a giant in the opening episode of season 3.", "For these roles he was unrecognisable under make-up and computer effects.", "In season 2, he also had a speaking role as Ser Gregor Clegane.", "In season 5 and season 6, Whyte portrayed the giant Wun Wun.", "Whyte was born in Bangor, Gwynedd, Wales.", "He is tall.", "Whyte is married to Amy, a business development manager for the Gordon Brown Law Firm.", "They have one son." ], [ "Richard Brake", "Brake had a recurring role as mobster Terry Mandel on Frank Darabont's neo-noir crime drama \"Mob City\".", "In 2014, he made guest appearances on the crime drama \"Crossing Lines\" and the action thriller series \"\", both roles he played were international criminals wanted for murder.", "From 2014 to 2015, Brake portrayed the Night King on the HBO fantasy series \"Game of Thrones\", appearing in the show's fourth and fifth seasons, most notably in the fifth season episode \"Hardhome\", which received seven Emmy nominations.", "Brake co-starred with Colin Firth and Samuel L. Jackson in the action comedy \"\", where he plays an unnamed man who interrogates Taron Egerton's character as part of his training to become a spy for the intelligence agency Kingsman.", "He made a cameo as a bar patron in the semi-biographical drama \"Set Fire to the Stars\", which premiered at the Edinburgh International Film Festival on June 23, 2014.", "In 2015, he appeared on the FX historical fiction drama \"The Bastard Executioner\" as Baron Edwin Pryce.", "Due to scheduling conflicts with \"The Bastard Executioner\", Brake was unable to reprise as The Night King for the sixth season of \"Game of Thrones\" and was replaced by Vladimir Furdik, one of the shows main stunt performers." ] ], "gold": "On the TV series Game of Thrones, White Walkers are played by various actors. Ross Mullan played a White Walker in the 2012 episode Valar Morghulis. Mullan then reprised his role as a White Walker in the May 2013 episode Second Sons, in which he is notably killed by Samwell Tarly. Mullen then played a different White Walker in the April 2014 episode Oathkeeper. The White Walkers apparent leader is the Night King, who is played by Richard Brake in seasons 4 and 5 of Game of Thrones and Vladimir Furdik starting in season 6. Ian Whyte has also played a White Walker in season 1 and season 2 of the series. Additionally, Spencer Wilding played a White Walker in season 1, and Tim Loane played a White Walker in season 5 of Game of Thrones.", "prediction 1": "There are two main characters who are known as White Walkers in Game of Thrones. The Night King is played by Richard Brake. The White Walkers are also portrayed by Ian Whyte.", "prediction 2": "White Walkers are creatures of the Night, whose apparent leader is the Night King, who is played by Richard Brake. The White Walkers first appear in season 1 episode Hardhome, where they attack Jon Snow and his party. The White Walkers first appear in season 2 episode Hardhome where they attack Jon Snow and his party.", "prediction 3": "Richard Brake plays the Night King on the HBO fantasy series Game of Thrones and Vladimir Furdik plays the White Walkers. The White Walkers appear in season 5 episode \"Hardhome\" and in season 6 episode \"The Door\".", "prediction 4": "Richard Brake plays the Night King in Game of Thrones. Vladimir Furdik plays the White Walkers.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": " The White Walkers apparent leader is the Night King, who is played by Richard Brake in seasons 4 and 5 of Game of Thrones and Vladimir Furdik starting in season 6. The White Walkers are also portrayed by Ian Whyte, in season 1 and season 2" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is the scientific name for a red fox?", "passages": [ [ "Red fox", "Red foxes colonised the North American continent in two waves: during or before the Illinoian glaciation, and during the Wisconsinan glaciation.", "Gene mapping demonstrates that red foxes in North America have been isolated from their Old World counterparts for over 400,000 years, thus raising the possibility that speciation has occurred, and that the previous binomial name of \"Vulpes fulva\" may be valid.", "In the far north, red fox fossils have been found in Sangamonian deposits in the Fairbanks District and Medicine Hat.", "Fossils dating from the Wisconsian are present in 25 sites in Arkansas, California, Colorado, Idaho, Missouri, New Mexico, Tennessee, Texas, Virginia, and Wyoming.", "Although they ranged far south during the Wisconsinan, the onset of warm conditions shrank their range toward the north, and have only recently reclaimed their former American ranges because of human-induced environmental changes.", "Genetic testing indicates two distinct red fox refugia exist in North America, which have been separated since the Wisconsinan.", "The northern (or boreal) refugium occurs in Alaska and western Canada, and consists of the large subspecies \"V.\u00a0v.\u00a0alascensis\", \"V.\u00a0v.\u00a0abietorum\", \"V.\u00a0v.\u00a0regalis\", and \"V.\u00a0v.\u00a0rubricosa\"." ], [ "Red fox", "The southern (or montane) refugium occurs in the subalpine parklands and alpine meadows of the Rocky Mountains, the Cascade Range, and Sierra Nevada.", "It encompasses the subspecies \"V.\u00a0v.\u00a0macroura\", \"V.\u00a0v.\u00a0cascadensis\", and \"V.\u00a0v.\u00a0necator\".", "The latter clade has been separated from all other red fox populations since the last glacial maximum, and may possess unique ecological or physiological adaptations.", "Although European foxes were introduced to portions of the United States in the 1900s recent genetic investigation indicates an absence of European fox haplotypes in any North American populations.", "Also, introduced eastern red foxes have colonized southern California, the San Joaquin Valley, and San Francisco Bay Area, but appear to have mixed with the Sacramento Valley red fox \"V.\u00a0v.\u00a0patwin\" only in a narrow hybrid zone.", "In addition, no evidence is seen of interbreeding of eastern red foxes in California with the montane Sierra Nevada red fox \"V.\u00a0v.\u00a0necator\" or other populations in the Intermountain West (between the Rocky Mountains to the east and the Cascade and Sierra Nevada ranges to the west.", ", 45 subspecies are recognised.", "In 2010, another distinct subspecies, which inhabits the grasslands of the Sacramento Valley, \"V.\u00a0v.\u00a0patwin\", was identified through mitochondrial haplotype studies." ], [ "Red fox", "Red fox\n\nThe red fox (\"Vulpes vulpes\") is the largest of the true foxes and one of the most widely distributed members of the order Carnivora, being present across the entire Northern Hemisphere from the Arctic Circle to North Africa, North America and Eurasia.", "It is listed as least concern by the IUCN.", "Its range has increased alongside human expansion, having been introduced to Australia, where it is considered harmful to native mammals and bird populations.", "Due to its presence in Australia, it is included among the list of the \"world's 100 worst invasive species\".", "The red fox originated from smaller-sized ancestors from Eurasia during the Middle Villafranchian period, and colonised North America shortly after the Wisconsin glaciation.", "Among the true foxes, the red fox represents a more progressive form in the direction of carnivory.", "Apart from its large size, the red fox is distinguished from other fox species by its ability to adapt quickly to new environments.", "Despite its name, the species often produces individuals with other colourings, including albinos and melanists.", "Forty-five subspecies are currently recognised, which are divided into two categories: the large northern foxes, and the small, basal southern foxes of Asia and North Africa." ] ], "gold": "The red fox, scientific name Vulpes vulpes, is the largest of the true foxes and one of the most widely distributed members of the order Carnivora, being present across the entire Northern Hemisphere including most of North America, Europe and Asia, plus parts of North Africa. The scientific name for the European red fox is V. v. crucigera, in Alaska and Western Canada V. v. alascensis, V. v. abietorum, V. v. regalis, and V. v. rubricosa. In the Rocky Mountains, the Cascade Range, and Sierra Nevada the scientific names are V. v. macroura, V. v. cascadensis, and V. v. necator, and in Sacramento Valley V. v. patwin. ", "prediction 1": "The red fox is the largest of the true foxes and one of the most widely distributed members of the order Carnivora, being present across the entire Northern Hemisphere from the Arctic Circle to North Africa, North America and Eurasia. It was originally from smaller-sized ancestors from Eurasia during the Middle Villafranchian period, and colonised North America shortly after the Wisconsinan glaciation. However, the scientific name for the red fox is Vulpes vulpes.", "prediction 2": "The red fox is a species of fox that is found in North America. It is scientifically known as Vulpes vulpes and is the largest of the true foxes. It originated from smaller-sized ancestors from Eurasia during the Middle Villafranchian period, and colonised North America shortly after the Wisconsinan glaciation. In the far north, red fox fossils have been found in Sangamonian deposits in the Fairbanks District and Medicine Hat. In the southern (or montane) refugium occurs in the subal parklands and alpine meadows of the Rocky Mountains, the Cascadensis, and Sierra Nevada. It encompasses the subspecies V. v. macroura, V. v. v. v. v. cascadensis, and V. v. necator.", "prediction 3": "The red fox is a species of fox that is one of the most widely distributed members of the order Carnivora, being present across the entire Northern Hemisphere from the Arctic Circle to North Africa, North America and Eurasia. The scientific name for the red fox is Vulpes vulpes. The red fox originated from smaller-sized ancestors from Eurasia during the Middle Villafranchian period, and colonised North America shortly after the Wisconsinan glaciation. It is listed as least concern by the IUCN.", "prediction 4": "The red fox is a fox species that has been found in North America for over a million years. The scientific name for this species is Vulpes vulpes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 405 }, { "error type": "Unverifiable", "explanation": "", "start": 406, "end": 468 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The red fox, Vulpes vulpes, is the largest of the true foxes and one of the most widely distributed members of the order Carnivora, being present across the entire Northern Hemisphere from the Arctic Circle to North Africa, North America and Eurasia. The northern (or boreal) refugium occurs in Alaska and western Canada, and consists of the large subspecies \"V. v. alascensis\", \"V. v. abietorum\", \"V. v. regalis\", and \"V. v. rubricosa\". The southern (or montane) refugium occurs in the subalpine parklands and alpine meadows of the Rocky Mountains, the Cascade Range, and Sierra Nevada. It encompasses the subspecies \"V. v. macroura\", \"V. v. cascadensis\", and \"V. v. necator\".\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays the main girl in phantom of the opera?", "passages": [ [ "The Phantom of the Opera", "In Paris in the 1880s, the Palais Garnier opera house is believed to be haunted by an entity known as the Phantom of the Opera, or simply the Opera Ghost.", "A stagehand named Joseph Buquet is found hanged and the rope around his neck goes missing.", "At a gala performance for the retirement of the opera house's two managers, a young little-known Swedish soprano, Christine Daa\u00e9, is called upon to sing in the place of the Opera's leading soprano, Carlotta, who is ill, and her performance is an astonishing success.", "The Vicomte Raoul de Chagny, who was present at the performance, recognizes her as his childhood playmate and recalls his love for her.", "He attempts to visit her backstage, where he hears a man complimenting her from inside her dressing room.", "He investigates the room once Christine leaves, only to find it empty.", "At Perros-Guirec, Christine meets with Raoul, who confronts her about the voice he heard in her room.", "Christine tells him she has been tutored by the Angel of Music, whom her father used to tell them about.", "When Raoul suggests that she might be the victim of a prank, she storms off.", "Christine visits her father's grave one night, where a mysterious figure appears and plays the violin for her.", "Raoul attempts to confront it but is attacked and knocked out in the process." ] ], "gold": "Christine Daa\u00e9, a young, little-known Swedish soprano in Phantom of the Opera, has been played by multiple actresses. In the original West End Cast, she was played by: Sarah Brightman, Claire Moore. In the original Broadway Cast, she was played by: Sarah Brightman, Patti Cohenour. In the original US Tour Cast, she was played by: Dale Kristien, Mary D'Arcy.", "prediction 1": "The Phantom of the Opera, sometimes called the Opera Ghost, is believed to be haunted by an entity known as Carlotta. Swedish soprano Christine Daa\u00e9 plays the main girl in Phantom of the Opera.", "prediction 2": "The Palais Garnier opera house is believed to be haunted by an entity known as the Phantom of the Opera, or simply the Opera Ghost. At a gala performance for the retirement of the opera house's two managers, a young little-known Swedish soprano, Christine Daa\u00e9, is called upon to sing in the place of the Opera's leading soprano, Carlotta, who is ill, and her performance is an astonishing success. The Vicomte Raoul de Chagny, who was present at the performance, recognizes Christine as his childhood playmate and recalls his love for her. He attempts to visit her backstage, but Christine leaves empty.", "prediction 3": "In The Phantom of the Opera, the main girl is played by Christine Daa\u00e9.", "prediction 4": "In The Phantom of the Opera, the main girl is played by Christine Daa\u00e9, a Swedish soprano.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "a young little-known Swedish soprano, Christine Daa\u00e9, is called upon to sing in the place of the Opera's leading soprano. " }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "When did atlanta braves win the world series?", "passages": [ [ "Atlanta Braves", "The Braves won the NL West 1991\u201393 and the NL East 1995\u20132005, and they returned to the playoffs as the National League Wild Card in 2010.", "The Braves advanced to the World Series five times in the 1990s, winning the title in 1995.", "Since their debut in the National League in 1876, the franchise has won 18 divisional titles, 17 National League pennants, and three World Series championships\u2014in 1914 as the Boston Braves, in 1957 as the Milwaukee Braves, and in 1995 in Atlanta.", "The Braves are the only Major League Baseball franchise to have won the World Series in three different home cities.", "The Braves and the Chicago Cubs are the National League's two remaining charter franchises.", "The Braves were founded in Boston, Massachusetts, in 1871, as the Boston Red Stockings (not to be confused with the American League's Boston Red Sox).", "The team states it is \"the oldest continuously operating professional sports franchise in America.\"", "After various name changes, the team eventually began operating as the Boston Braves, which lasted for most of the first half of the 20th century.", "Then, in 1953, the team moved to Milwaukee, Wisconsin, and became the Milwaukee Braves, followed by the final move to Atlanta in 1966.", "The team's tenure in Atlanta is noted for Hank Aaron breaking Babe Ruth's career home run record in 1974." ], [ "World Series", "World Series\n\nThe World Series is the annual championship series of Major League Baseball (MLB) in North America, contested since 1903 between the American League (AL) champion team and the National League (NL) champion team.", "The winner of the World Series championship is determined through a best-of-seven playoff, and the winning team is awarded the Commissioner's Trophy.", "As the series is played during the fall season in North America, it is sometimes referred to as the Fall Classic.", "Prior to 1969, the team with the best regular season win-loss record in each league automatically advanced to the World Series; since then each league has conducted a championship series (ALCS and NLCS) preceding the World Series to determine which teams will advance.", "As of 2018, the World Series has been contested 114 times, with the AL winning 66 and the NL winning 48.", "The 2018 World Series took place between the Los Angeles Dodgers and Boston Red Sox from October 23-28, with the Red Sox winning in five games to earn their ninth title.", "This was the first World Series meeting between these two teams since 1916.", "Having previously lost to the Houston Astros in the 2017 World Series, the Dodgers became the 11th team to lose the World Series in consecutive seasons." ], [ "Atlanta Braves", "Atlanta Braves\n\nThe Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area.", "The franchise competes in Major League Baseball (MLB) as a member of the National League (NL) East division.", "The Braves played home games at Atlanta\u2013Fulton County Stadium from 1966 to 1996, and Turner Field from 1997 to 2016.", "Since 2017, their home stadium has been SunTrust Park, a new stadium 10 miles (16 km) northwest of downtown Atlanta in the Cumberland neighborhood of Cobb County.", "The Braves play spring training games in Lake Buena Vista, Florida.", "The Braves have agreed to move their spring training home to North Port, Florida in 2019.", "The \"Braves\" name, which was first used in 1912, originates from a term for a Native American warrior.", "They are nicknamed \"the \"Bravos\"\", and often referred to as \"America's Team\" in reference to the team's games being broadcast on the nationally available TBS from the 1970s until 2007, giving the team a nationwide fan base.", "From 1991 to 2005, the Braves were one of the most successful teams in baseball, winning division titles an unprecedented 14 consecutive times (omitting the strike-shortened 1994 season in which there were no official division champions), and producing one of the greatest pitching rotations in the history of baseball." ] ], "gold": "The Atlanta Braves are an American professional baseball team based in the Atlanta metropolitan area, a team that competes in Major League Baseball as a member club of the National League East Division. The World Series is the annual championship series of Major League Baseball in the United States and Canada, contested since 1903 between the champion teams of the American League, and the National League. The winner of the World Series championship is determined through a best-of-seven playoff, and the winning team is awarded the Commissioner's Trophy. The Atlanta Braves won the World Series in 1914, 1957 and 1995.", "prediction 1": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area. The team won the 1995 World Series, their first since the team's debut in the National League in 1876. The Braves have won the World Series three times, in 1914 as the Boston Braves, in 1957 as the Milwaukee Braves, and in 1995 in Atlanta.\n", "prediction 2": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area that competes in Major League Baseball as a member of the National League East division. The Braves won the World Series in 1995. The team has been in the American League since 1903 and has won the World Series three times.", "prediction 3": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area. Since their debut in the National League in 1876, the franchise has won 18 divisional titles, 17 National League pennants, and three World Series championships. They won the World Series in 1995, in 1958, and in 1960. The team won the World Series in 2018, when they defeated the Los Angeles Dodgers in five games.", "prediction 4": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area. From 1916 to 2000, the Braves won the World Series. In 1995, the Braves won the World Series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 298, "end": 322 }, { "error type": "Redundant", "explanation": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area. The team won the 1995 ", "start": 327, "end": 334 }, { "error type": "Irrelevant", "explanation": "", "start": 335, "end": 347 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Atlanta Braves are an American professional baseball franchise based in the Atlanta metropolitan area, that competes in Major League Baseball (MLB) as a member of the National League (NL) East division. The World Series is the annual championship series of Major League Baseball (MLB) in North America, contested since 1903 between the American League (AL) champion team and the National League (NL) champion team. The winner of the World Series championship is determined through a best-of-seven playoff, and the winning team is awarded the Commissioner's Trophy. The Braves have won the World Series three times, in 1914, 1957, and 1995.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the superbowl in 2004 and 2005?", "passages": [ [ "2004 Philadelphia Eagles season", "It was later learned that Lewis broke his ankle on the second touchdown catch, and he would be left off the Super Bowl roster.", "Meanwhile, the defense held Vick to 136 passing yards and 26 rushing yards, and kept Atlanta off the scoreboard in the second half.", "In their first Super Bowl appearance since Super Bowl XV, the Eagles met the New England Patriots on February 6, 2005 at ALLTEL Stadium in Jacksonville, Florida.", "The Patriots, led by Tom Brady had won two of the past three Super Bowls and a win against the Eagles would likely lead to \"dynasty status\".", "They had cruised to a 14\u20132 regular season record, and taken down the Indianapolis Colts and 15\u20131 Pittsburgh Steelers in the AFC playoffs.", "Meanwhile, the Eagles, considered heavy underdogs, had star wide receiver Terrell Owens miraculously returning, against doctor's orders, from injury.", "A third-down sack and subsequent fumble by Donovan McNabb on the Eagles' first possession nearly led to a turnover in Eagles' territory, but Andy Reid challenged the play and the Eagles were able to punt.", "Both offenses struggled in general until McNabb hit Owens on a 30-yard catch and run to inside the New England 10-yard line.", "Unfortunately, Patriot safety Rodney Harrison picked off McNabb's pass to the end zone." ], [ "Super Bowl XXXVIII", "Super Bowl XXXVIII\n\nSuper Bowl XXXVIII was an American football game between the National Football Conference (NFC) champion Carolina Panthers and the American Football Conference (AFC) champion New England Patriots to decide the National Football League (NFL) champion for the 2003 season.", "The Patriots defeated the Panthers by a score of 32\u201329.", "The game was played at Reliant Stadium in Houston, Texas, on February 1, 2004.", "At the time, this was the most watched Super Bowl ever with 144.4 million viewers.", "The Panthers were making their first ever Super Bowl appearance after posting an 11\u20135 regular season record.", "They also made it the second straight year that a team from the NFC South division made the Super Bowl, with the Tampa Bay Buccaneers winning Super Bowl XXXVII.", "The Patriots were seeking their second Super Bowl title in three years after posting a 14\u20132 record.", "NFL fans and sports writers widely consider this game one of the most well-played and thrilling Super Bowls; \"Sports Illustrated\" writer Peter King hailed it as the \"Greatest Super Bowl of all time.\"", "Although neither team could score in the first and third quarters, they ended up with a combined total of 868 yards and 61 points.", "The game was scoreless for a Super Bowl record 26:55 before the two teams combined for 24 points prior to halftime." ], [ "Super Bowl XXXIX", "Super Bowl XXXIX\n\nSuper Bowl XXXIX was an American football game played between the American Football Conference (AFC) champion New England Patriots and", "the National Football Conference (NFC) champion Philadelphia Eagles to decide the National Football League (NFL) champion for the 2004 season.", "The Patriots defeated the Eagles by the score of 24\u201321.", "The game was played on February 6, 2005, at Alltel Stadium in Jacksonville, Florida, the first time the Super Bowl was played in that city.", "The Patriots, who entered the Super Bowl after compiling a 14\u20132 regular season record, became the first, and most recent (as of Super Bowl LII), team since the 1997\u20131998 Denver Broncos to win consecutive Super Bowls.", "New England also became the second team after the Dallas Cowboys to win three Super Bowls in four years.", "The Eagles were making their second Super Bowl appearance after posting a 13\u20133 regular season record.", "The game was close throughout, with the teams battling to a 14\u201314 tie by the end of the third quarter.", "The Patriots then scored 10 points in the 4th quarter with Corey Dillon's 2-yard touchdown run and Adam Vinatieri's 22-yard field goal." ] ], "gold": "Super Bowl XXXVIII was an American football game between the Carolina Panthers and the New England Patriots to decide the National Football League (NFL) champion for the 2003 season. The game was played at Reliant Stadium in Houston, Texas, on February 1, 2004, and the Patriots defeated the Panthers by a score of 32\u201329. Super Bowl XXXIX was an American football game played between the New England Patriots and the Philadelphia Eagles to decide the National Football League (NFL) champion for the 2004 season. The game was played on February 6, 2005, at Alltel Stadium in Jacksonville, Florida, the first time the Super Bowl was played in that city and the Patriots defeated the Eagles by the score of 24\u201321. Bill Belichick was the coach of the New England Patriots for the 2004 and 2005 Super Bowls.", "prediction 1": "In 2004, the Patriots defeated the Philadelphia Eagles in the Super Bowl to determine the National Football League (NFL) champion for the 2004 season. In 2005, the Patriots defeated the Eagles in the Super Bowl to decide the National Football League (NFL) champion for the 2004 season. In 2016, the Patriots won the Super Bowl.", "prediction 2": "In 2004, the New England Patriots defeated the Philadelphia Eagles in a Super Bowl to win the National Football League champion for the 2004 season. In 2005, the Patriots defeated the Philadelphia Eagles in a Super Bowl to win the National Football League champion for the 2004 season. In 2016, the Patriots defeated the Eagles in a Super Bowl to win the National Football League champion for the 2005 season.", "prediction 3": "In 2004, the New England Patriots defeated the Philadelphia Eagles in a Super Bowl to determine the National Football League champion for the 2004 season. In 2005, the game was played between the Patriots and the Philadelphia Eagles and ended with the Patriots winning the Super Bowl for the second time.", "prediction 4": "In 2004, the New England Patriots and the Philadelphia Eagles both won the Super Bowl, while in 2005 the Falcons won it.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 286, "end": 327 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 0, "end": 150 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Super Bowl XXXVIII was an American football game between the Carolina Panthers and the New England Patriots to decide the National Football League (NFL) champion for the 2003 season. The game was played at Reliant Stadium in Houston, Texas, on February 1, 2004. The Patriots defeated the Panthers by a score of 32\u201329. Super Bowl XXXIX was an American football game played between the New England Patriots and the Philadelphia Eagles to decide the National Football League (NFL) champion for the 2004 season. The game was played on February 6, 2005, at Alltel Stadium in Jacksonville, Florida, the first time the Super Bowl was played in that city. The Patriots defeated the Eagles by the score of 24\u201321. " }, "preference": [ 0, 2, 1, 2, 0, 1 ] }, { "question": "Who played guitar on is there anybody out there?", "passages": [ [ "Is There Anybody Out There?", "Is There Anybody Out There?", "\"Is There Anybody Out There?\" is a song from the Pink Floyd album, \"The Wall\".", "The first half of the piece has the same concept of \"Hey You\", being a distress call from Pink.", "Musically, it's a droning bass synthesizer with various sound effects layered on top, and a repeating chorus of \"Is there anybody out there?\".", "The shrill siren-like sound effect used during this song is also used in an earlier Pink Floyd work, \"Echoes\".", "The noise was originally used as a sort of whale call for the deep-water-based \"Echoes\", and is created by David Gilmour using a wah-wah pedal with the cables reversed.", "The second half of the song is an instrumental classical guitar solo.", "It is not widely known who played it: In several interviews, David Gilmour has said that he tried to perform it, and was not satisfied with the final result (\"I could play it with a leather pick but couldn't play it properly fingerstyle\").", "Accordingly, session musician Joe DiBlasi was brought in by Michael Kamen to play with the rest of the orchestra." ], [ "Roger Waters", "Roger Waters\n\nGeorge Roger Waters (born 6 September 1943) is an English songwriter, singer, bassist, and composer.", "In 1965, he co-founded the progressive rock band Pink Floyd with drummer Nick Mason, keyboardist Richard Wright, guitarist Bob Klose, as well as lead guitarist, singer, and songwriter Syd Barrett.", "Waters initially served as the bassist, but following the departure of Barrett in 1968, he also became their lyricist, co-lead vocalist, and conceptual leader.", "Pink Floyd achieved international success with the concept albums, \"The Dark Side of the Moon\" (1973), \"Wish You Were Here\" (1975), \"Animals\" (1977), and \"The Wall\" (1979).", "By the early 1980s, they had become one of the most critically acclaimed and commercially successful groups in popular music; by 2013, they had sold more than 250 million albums worldwide.", "Amid creative differences, Waters left in 1985 and began a legal dispute with the remaining members over their use of the band's name and material.", "They settled out of court in 1987.", "Waters' solo work includes the studio albums \"The Pros and Cons of Hitch Hiking\" (1984), \"Radio K.A.O.S.\" (1987)\",\" \"Amused to Death\" (1992)\",\" and \"Is This the Life We Really Want?\" (2017)." ], [ "David Gilmour", "David Gilmour\n\nDavid Jon Gilmour, (born 6 March 1946) is an English guitarist, singer and songwriter who was a member of the progressive rock band Pink Floyd.", "He joined the group as guitarist and co-lead vocalist in 1968 shortly before the departure of founding member Syd Barrett.", "Pink Floyd subsequently achieved international success with the concept albums \"The Dark Side of the Moon\", \"Wish You Were Here\", \"Animals\", and \"The Wall\".", "By the early 1980s, they had become one of the best-selling and most acclaimed acts in music history; by 2012, the band had sold over 250 million records worldwide, including 75\u00a0million units sold in the United States.", "Following the departure of Roger Waters in 1985, Gilmour assumed leadership of Pink Floyd; they released three more studio albums before disbanding in 2014.", "Gilmour has produced a variety of artists, such as the Dream Academy, and has released four solo studio albums: \"David Gilmour\", \"About Face\", \"On an Island\", and \"Rattle That Lock\".", "He is also credited for bringing songwriter Kate Bush to public attention.", "As a member of Pink Floyd, he was inducted into the US Rock and Roll Hall of Fame in 1996, and the UK Music Hall of Fame in 2005." ] ], "gold": "There were several guitars played on the song \"Is There Anybody Out There?\" from Pink Floyd's The Wall album. On the song, Pink Floyd member David Gilmour played the guitar and wah-wah pedal, Pink Floyd co-founder Roger Waters played the bass guitar, and session musician Joe DiBlasi played the classical guitar.", "prediction 1": "\"Is There Anybody Out There?\" is a song from the Pink Floyd album, The Wall. It has multiple guitar players, including guitar player David Gilmour and guitarist Bob Klose. Joe DiBlasi played guitar with the rest of the Pink Floyd orchestra.", "prediction 2": "\"Is There Anybody Out There?\" is a song from the Pink Floyd album, The Wall. The first half of the piece has the same concept of \"Hey You\", being a distress call from Pink. Musically, it's a droning bass synthesizer with various sound effects layered on top, and a repeating chorus of \"Is there anybody out there?\". The second half of the song is an instrumental classical guitar solo. It is not widely known who played it.", "prediction 3": "On the song \"Is There Anybody Out There?\" the lead guitarist is Roger Waters. On the second half of the song, there is an instrumental classical guitar solo. However, it is not widely known who played it. The second half of the song is an instrumental rock instrumental.", "prediction 4": "\"Is There Anybody Out There?\" is a song from the Pink Floyd album, The Wall. It is not widely known who played guitar on the song. In several interviews, David Gilmour has said that he tried to perform the classical guitar solo, but was not satisfied with the final result. Accordingly, session musician Joe DiBlasi was brought in by Michael Kamen to play with the rest of the orchestra.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 84, "end": 108 }, { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 197 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"Is There Anybody Out There?\" is a song from the Pink Floyd album, The Wall. David Gilmour used a wah-wah pedal in the song, he was also a guitar player for the band." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who has scored the most goals for everton?", "passages": [ [ "Liverpool F.C. league record by opponent", "Liverpool F.C. league record by opponent\n\nLiverpool Football Club is an English association football club based in Liverpool, Merseyside, which competes in the top tier of English football, for the 2018\u201319 season.", "The club was formed in 1892 following a disagreement between the board of Everton and club president John Houlding, who owned the club's ground, Anfield.", "The dispute over rent resulted in Everton leaving Anfield for Goodison Park, which left Houlding with an empty stadium.", "Not content for his ground to lay idle, he created his own club: Liverpool.", "Liverpool joined the Lancashire League on their foundation before the 1892\u201393 season.", "They ended their inaugural season as league champions, and were elected to The Football League soon afterwards.", "The club remained in The Football League until 1992, when its First Division was superseded as English football's top level by the newly formed Premier League.", "Liverpool's first team have competed in a number of nationally and regionally contested leagues, and its record against each club faced in these competitions is listed below.", "The team that Liverpool have met most in league competition is Everton, against whom they have contested 199 league matches; having drawn 65 of these, Everton are the side Liverpool have tied with most in league competition." ], [ "Dixie Dean", "Dixie Dean\n\nWilliam Ralph \"Dixie\" Dean (22 January 1907 \u2013 1 March 1980) was an English footballer who played as a centre forward.", "Born in Birkenhead, he began his career at his hometown club Tranmere Rovers before moving on to Everton, the club he had supported as a child.", "He was particularly known for scoring goals with his head.", "Dean played the majority of his career at Everton before injuries caught up with him and he moved on to new challenges at Notts County.", "He is best known for his exploits during the 1927\u201328 season, which saw him score a record 60 league goals.", "He also scored 18 goals in 16 appearances for England.", "A statue of Dean was unveiled outside Goodison Park in May 2001.", "A year later, he became one of 22 players inducted into the inaugural English Football Hall of Fame.", "Dean was the first Everton player to wear the number-9 shirt, which in later years would become iconic at the club.", "Dean was born at 313 Laird Street in Birkenhead, Cheshire, across the River Mersey from Liverpool.", "Dean's family on both sides hailed from Chester." ], [ "Jack Southworth", "Jack Southworth\n\nJohn (Jack) Southworth, also known as Skimmy Southworth, (born in Blackburn on 11 December 1866, died 16 October 1956), was a footballer who played in the early days of professional football for Blackburn Rovers and Everton as well as being capped three times for England.", "He was the top scorer in the Football League in 1890\u201391 and 1893\u201394.", "He began his football career at the age of 7 when he helped form a junior club named Inkerman Rangers.", "He later played for Chester, and scored their first ever goal against their local rivals Wrexham Olympic in 1886.", "In the 1885\u201386 season, despite having signed professional for Chester FC earlier in the season, he turned out for Blackburn Olympic in their First Round FA Cup match.", "As a result of the subsequent FA enquiry he was suspended for four months.", "(Source: Shooting Stars: The History of Blackburn Olympic, p.\u00a070)\n\nA keen musician, he took a job with a theatre in Chester and returned to Olympic, resuming his old position of centre forward.", "Having overcome his injuries, he became a great success as a centre forward and the 1887\u201388 season saw him finally join Blackburn Rovers, together with his less-talented brother James.", "Both were involved in performances at the Royalty Theatre in Chester, with Jack playing the violin and James the conductor." ] ], "gold": "Everton Football Club is a professional association football club located in Liverpool. Dixie Dean, an English footballer who played as a centre forward, scored the most career goals for Everton and the most goals in a season for Everton. Jack Southworth, an English footballer who played in the early days of professional football for Blackburn Rovers and Everton, scored the most goals in a single match for Everton.", "prediction 1": "Everton have scored the most goals against an opponent during their history. Dixie Dean and Jack Southworth have scored the most goals for the club. John (Jack) Southworth scored the most goals against Everton in the 1927\u201328 season, in which they scored a total of 60 league goals. Jack Southworth scored the most goals against a team in the 1890\u201391 and 1893\u201394 seasons.", "prediction 2": "Everton have scored the most goals in a season in which they have played. Everton have scored the most goals in a season in which they have played. Dixie Dean, born on January 22, 1907, scored the most goals during the 1927\u201328 season. Jack Southworth, born on December 11, 1866, scored the most goals for the club in 1885\u201386.", "prediction 3": "Everton have scored the most goals against a team in the Premier League, including 11 goals against a team in the Second Division. The longest goal drought between two successive seasons was in 1932\u201333, when the team that Liverpool have met most in league competition is Everton. The goal drought between 1888\u20131990 was 3 goals against a team in the Second Division, and the longest goal drought between 1892\u20131993 and 1992\u2013199. The most goals scored by a team against a team in the Third Division is.", "prediction 4": "The footballer who has scored the most goals for Everton is Jack Southworth. Everton have scored a total of 61 goals in the Premier League since 1902. The player with the most goals is Dixie Dean, who scored a total of 60 league goals in 1927\u201328.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 149, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 370 }, { "error type": "Unverifiable", "explanation": "", "start": 77, "end": 148 }, { "error type": "Incoherent", "explanation": "", "start": 0, "end": 76 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Dixie Dean is an English footballer who played as a centre forward. He is best known for his exploits during the 1927\u201328 season, which saw him score a record 60 league goals for Everton." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played eddie on the tv show frasier?", "passages": [ [ "Minor characters on Frasier", "Her traditionally minded, prudish mother lives in Spokane, Washington.", "Claire (Patricia Clarkson) is a friend of Frasier's old date / high school prom queen.", "She appears in season 8.", "The following are significant members of the Crane family excluding Frasier, Martin, Niles, and Daphne Crane.", "Although most of the series revolves around Frasier Crane and his immediate family, occasionally members of Frasier's extended family appear.", "These are listed below.", "David is Niles' and Daphne's son.", "He was born in the two-part episode \"Goodnight, Seattle\".", "During Daphne's pregnancy, it is implied he takes after his low-brow uncles (Daphne's brothers); for example, he kicks away classical music and jumps at the mention of a pub.", "He was born in a veterinary clinic and is named after show's creator David Angell, who died along with his wife Lynn aboard American Airlines Flight 11 during the September 11, 2001 attacks.", "Eddie (born May 1990) is a Parson Russell Terrier.", "Eddie was originally played by Moose, and later by Moose's son Enzo.", "Eddie is known for responding to Martin and Daphne with human-like understanding, but often seems to taunt Frasier." ], [ "Frasier", "Frasier\n\nFrasier is an American sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004.", "The program was created and produced by David Angell, Peter Casey, and David Lee (as Grub Street Productions) in association with Grammnet (2004) and Paramount Network Television.", "The series was created as a spin-off of \"Cheers\", continuing the story of psychiatrist Frasier Crane as he returned to his hometown of Seattle and started building a new life as a radio advice show host while reconnecting with his father and brother.", "\"Frasier\" stars Kelsey Grammer, Jane Leeves, David Hyde Pierce, Peri Gilpin, and John Mahoney.", "The show was critically acclaimed, with the show itself and the cast winning thirty-seven Emmy Awards, a record at the time for a scripted series.", "It also won the Emmy for Outstanding Comedy Series for five consecutive years.", "Psychiatrist Dr. Frasier Crane (Grammer) returns to his home town of Seattle, Washington, following the end of his marriage and his life in Boston (as seen in \"Cheers\")." ] ], "gold": "Frasier is an American television sitcom that was broadcast on NBC for 11 seasons. The character, Eddie, was a Parson Russell Terrier. He was originally played by Moose, and later by Moose's son Enzo.", "prediction 1": "Eddie is a parson Russell Terrier who is played by Moose, and later by Moose's son Enzo, on the tv show Frasier. Eddie was originally played by Moose, and later by Moose's son Enzo.", "prediction 2": "Eddie was originally played by Moose, and later by Moose's son Enzo. Eddie is known for responding to Martin and Daphne with human-like understanding, but often seems to taunt Frasier. On the sitcom Frasier, the character of Eddie was played by Kelsey Grammer, Jane Leeves, David Hyde Pierce, Peri Gilpin, and John Mahoney.", "prediction 3": "Eddie was originally played by Moose, and later by Moose's son Enzo. Eddie is known for responding to Martin and Daphne with human-like understanding, but often seems to taunt Frasier. The show had a runaway success as a sitcom, with the final season starring Kelsey Grammer.", "prediction 4": "Frasier is an American sitcom that was broadcast on NBC for 11 seasons. Eddie was originally played by Moose, and later by Moose's son Enzo. Enzo was a puppy. The character was played by Kelsey Grammer in season 1 and by Jonathan R. Davidson in season 11.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Eddie is a parson Russell Terrier who is played by Moose, and later by Moose's son Enzo", "start": 113, "end": 181 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Frasier Frasier is an American sitcom that was broadcast on NBC for 11 seasons. Eddie is a parson Russell Terrier who is played by Moose, and later by Moose's son Enzo." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is the the great pacific garbage patch located?", "passages": [ [ "Great Pacific garbage patch", "Great Pacific garbage patch\n\nThe Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean.", "It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N.", "The collection of plastic and floating trash, which comes primarily from countries in Asia, lies halfway between Hawaii and California and extends over an indeterminate area of widely varying range, depending on the degree of plastic concentration used to define it.", "The patch is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre.", "Despite the common public image of islands of floating rubbish, its low density (4 particles per cubic meter) prevents detection by satellite imagery, or even by casual boaters or divers in the area.", "It consists primarily of an increase in suspended, often microscopic, particles in the upper water column.", "The patch is not easily seen from the sky, because the plastic is dispersed over a large area.", "Researchers from The Ocean Cleanup project claimed that the patch covers 1.6 million square kilometers.", "The plastic concentration is estimated to be up to 100 kilograms per square kilometer in the center, going down to 10 kilograms per square kilometer in the outer parts of the patch." ] ], "gold": "The Great Pacific Garbage Patch is located in a part of the ocean called the north central Pacific Ocean, while its coordinates are located from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. Also, the patch is actually two masses. What has been referred to as the Eastern Garbage Patch lies between Hawaii and California, while the Western Garbage Patch extends eastward from Japan to the Hawaiian Islands.", "prediction 1": "The Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. It is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre.", "prediction 2": "The Great Pacific garbage patch is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The patch is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre.", "prediction 3": "The Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The collection of plastic and floating trash, which comes primarily from countries in Asia, lies halfway between Hawaii and California and extends over an indeterminate area of widely varying range, depending on the degree of plastic concentration used to define it.", "prediction 4": "The Great Pacific garbage patch, also known as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The collection of plastic and floating trash, which comes primarily from countries in Asia, lies halfway between Hawaii and California and extends over an indeterminate area of widely varying range, depending on the degree of plastic concentration used to define it.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 76 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 395 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The collection of plastic and floating trash, which comes primarily from countries in Asia, lies halfway between Hawaii and California." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "When does miraculous season 2 episode 10 come out?", "passages": [ [ "TFOU", "TFOU\n\nTFOU is a French children's television programming block broadcast on TF1.", "It was launched on 1 January 2007, replacing TF!", "Jeunesse (French for TF!", "Youth).", "TF!", "Jeunesse first appeared on Monday, September 1, 1997 at 4:30 in the afternoon on TF1, replacing Club Doroth\u00e9e, with the first episode of Beetleborgs.", "TF!", "Jeunesse was created by Dominique Poussier, the director of children's television for TF1.", "It was hoped that this new show would distance itself from its predecessor, whose shows had often been accused by parents and the Conseil sup\u00e9rieur de l'audiovisuel (the Superior Audiovisual Council) of being too violent.", "Poussier had previously created the morning program Salut les Toons!", "(\"Hello Toons!", "\"), which was presented by two CGI-generated mice, in 1996.", "In September 1997, she was given the difficult task of revitalizing children's programming on TF1, whose ratings had been in decline thanks to the popularity of \"Minikeums\" on France 3.", "Using the same model which she had already presented with The Planet of Donkey Kong on France 2, Poussier suggested a program without animation." ], [ "TF1", "TF1\n\nTF1 (\"t\u00e9 effe un\" ) is a private national French TV channel, controlled by TF1 Group, whose major share-holder is Bouygues.", "TF1's average market share of 24% makes it the most popular domestic network.", "It is also considered to be the most viewed television channel in Europe.", "Flagship series include \"\", \"\" and \"House M.D.\"", "The channel is part of the TF1 Group of mass media companies, which also includes the news channel LCI.", "TF1 had possessed the satellite-network TPS, which have been sold to the Canal+ Group.", "TF1 is a supporter of the Hybrid Broadcast Broadband TV (HbbTV) initiative that is promoting and establishing an open European standard for hybrid set-top boxes for the reception of broadcast TV and broadband multimedia applications with a single user interface.", "It was the only channel in France for 28 years, and has often changed its name since the creation of Radio-PTT Vision on 26 April 1935, making it one of the oldest television stations in the world, and one of the very few prewar television stations to remain in existence to the present day." ], [ "Miraculous: Tales of Ladybug & Cat Noir", "Miraculous: Tales of Ladybug & Cat Noir\n\nMiraculous:", "Tales of Ladybug & Cat Noir (; also known as Miraculous Ladybug or Miraculous) is a CGI superhero animated series produced by French studios Zagtoon and Method Animation in collaboration with De Agostini S.p.A in Italy, Toei Animation in Japan and SAMG Animation in South Korea.", "The series features two Parisian teenagers, Marinette Dupain-Cheng and Adrien Agreste, who transform into the superheroes Ladybug and Cat Noir, respectively, to protect the city from supervillains.", "Prior to its debut in France on 19 October 2015 on TF1, the series was first shown in South Korea on 1 September 2015 on EBS1.", "In the United States, the series debuted on Nickelodeon on 6 December.", "In the United Kingdom and Ireland, the show premiered on 30 January 2016 on Disney Channel.", "A Christmas special was released in 2016 and the second season premiered in French on TF1 and in English on Disney Channel UK in 2017.", "Netflix acquired the U.S. video-on-demand streaming rights and further seasons are in production.", "Set in modern-day Paris, the series focuses on teenagers Marinette Dupain-Cheng and Adrien Agreste." ] ], "gold": "Episode 10 of Season 2 of the French series Miraculous: Tales of Ladybug and Cat Noir came out on several dates. It was scheduled to premiere on TFOU, a children's television broadcast programming block on French television channel TF1, on 17 December 2017. It came out in France on 14 January 2018. It came out on streaming service provider Netflix on 30 March 2018.", "prediction 1": "Miraculous: Tales of Ladybug & Cat Noir, also known as Miraculous Ladybug or Miraculous, is a superhero animated series produced by French studios Zagtoon and Method Animation in collaboration with De Agostini S.p.A in Italy, Toei Animation in Japan and SAMG Animation in South Korea. Season 2 episode 10 came out on January 30, 2017. Season 1 episode 10 came out on January 30, 2018.", "prediction 2": "Miraculous: Tales of Ladybug & Cat Noir is a CGI superhero animated series produced by French studios Zagtoon and Method Animation in collaboration with De Agostini S.p.A. in Italy, Toei Animation in Japan and SAMG Animation in South Korea. Season 2 episode 10 came out on October 5, 2017. Season 2 episode 7 came out on October 9, 2017.", "prediction 3": "Miraculous: Tales of Ladybug & Cat Noir is a CGI superhero animated series produced by French studios Zagtoon and Method Animation in collaboration with De Agostini S.p.A in Italy, Toei Animation in Japan and SAMG Animation in South Korea. Episode 10 of the first season came out on October 30, 2015, and episode 10 of the second season came out on October 19, 2017.", "prediction 4": "Miraculous: Tales of Ladybug & Cat Noir is a CG superhero animated series produced by French studios Zagtoon and Method Animation in collaboration with De Agostini S.p.A in Italy, Toei Animation in Japan and SAMG Animation in South Korea. Season 2 episode 10 came out on TF1 on December 19, 2017. Season 2 episode 10 came out on TF1 on December 18, 2017. Season 2 episode 10 came out on January 31, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 284 }, { "error type": "Unverifiable", "explanation": "", "start": 314, "end": 334 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 335, "end": 354 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "TFOU is a French children's television programming block broadcast on TF1, a private national French TV channel." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is playing in the cotton bowl 2017?", "passages": [ [ "2017 Cotton Bowl Classic (December)", "2017 Cotton Bowl Classic (December)\n\nThe 2017 Cotton Bowl Classic was a college football bowl game played at 7:30 pm CST on December 29, 2017 at AT&T Stadium in Arlington, Texas.", "The 82nd Cotton Bowl Classic was one of the 2017\u201318 bowl games that concluded the 2017 FBS football season.", "The game was broadcast on ESPN, ESPN Deportes, ESPN Radio and XM Satellite Radio.", "It was sponsored by the Goodyear Tire and Rubber Company and was officially known as the Goodyear Cotton Bowl Classic.", "The Cotton Bowl was played by Pac-12 Conference champion USC Trojans and Big Ten Conference champion Ohio State Buckeyes.", "These teams were chosen by the CFP Selection Committee.", "Traditionally, the Pac-12 and Big Ten champions meet in the Rose Bowl, however in the 2017 season, that game will be used for one of the two College Football Playoff semifinal games.", "Of note is that this year's Rose Bowl features SEC champion Georgia and Big 12 champion Oklahoma, a matchup which traditionally occurs in the Sugar Bowl, which is being used as the other CFP semifinal game for this year." ], [ "2017 Cotton Bowl Classic (January)", "2017 Cotton Bowl Classic (January)\n\nThe 2017 Cotton Bowl Classic was a college football bowl game played on January 2, 2017, at AT&T Stadium in Arlington, Texas.", "It featured the Western Michigan Broncos from the Mid-American Conference and the Wisconsin Badgers from the Big Ten Conference.", "The 81st Cotton Bowl Classic was one of the New Years Six bowl games in the College Football Playoff for the 2016\u201317 bowl games concluding the 2016 FBS football season.", "The game was broadcast on ESPN, ESPN Deportes, ESPN Radio and XM Satellite Radio.", "It was sponsored by the Goodyear Tire and Rubber Company and was officially known as the Goodyear Cotton Bowl Classic.", "Mid-American Conference (MAC) champion Western Michigan was selected as an at-large as the highest ranked College Football Playoff (CFP) Group of Five team while Wisconsin was chosen as an at-large out of the Big Ten Conference.", "Wisconsin was an 8 point favorite to start the game.", "This was the fifth meeting between the schools, with Wisconsin leading the all-time series 4\u20131.", "The most recent meeting was on August 31, 2000, where the Badgers defeated the Broncos by a score of 19\u20137.", "This was the first Cotton Bowl for both teams." ], [ "Cotton Bowl Classic", "Cotton Bowl Classic\n\nThe Cotton Bowl Classic, also simply known as the Cotton Bowl, is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937.", "The game was originally played at its namesake stadium in Dallas before moving to AT&T Stadium in nearby Arlington in 2010.", "Since 2014, the game has been sponsored by the Goodyear Tire and Rubber Company and officially known as the \"Goodyear Cotton Bowl Classic\".", "It has been previously sponsored and Southwestern Bell Corporation/SBC Communications/AT&T (1997\u20132014) and Mobil (1989\u20131995)\n\n", "Historically, the game hosted the champion of the Southwest Conference (SWC) against a team invited from elsewhere in the country, frequently a major independent or a runner-up from the Southeastern Conference (SEC).", "Following the dissolution of the SWC in 1996, the game hosted a runner-up from the Big 12 Conference, facing an SEC team from 1999 to 2014.", "The Cotton Bowl Classic has served as one of six bowls in the College Football Playoff (CFP) since the 2014 season; it hosted a national semifinal following the 2015 season and will do so again following the 2018 season.", "In the most recent edition of the Classic, following the 2017 season, Big Ten champion Ohio State defeated Pac-12 champion USC by a score of 24-7." ] ], "gold": "The Cotton Bowl is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. Historically, the game hosted the champion of the Southwest Conference against a team invited from elsewhere in the country, frequently a major independent or a runner-up from the Southeastern Conference, but it now hosts one of six bowls in the CFP since 2014. Two different Cotton Bowls were organized in 2017. In January, the Wisconsin Badgers faced against the Western Michigan Broncos, while the USC Trojans and the Ohio State Buckeyes did so in December.", "prediction 1": "The 2017 Cotton Bowl Classic, also simply known as the Cotton Bowl, is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. The 2017 Cotton Bowl Classic was a college football bowl game played at 7:30 pm CST on December 29, 2017 at AT&T Stadium in Arlington, Texas. It featured the Western Michigan Broncos from the Mid-American Conference and the Wisconsin Badgers from the Big Ten Conference. The 2017 Cotton Bowl Classic was a college football bowl game played on January 2, 2017, at AT&T Stadium in Arlington, Texas.", "prediction 2": "The Cotton Bowl Classic, also known as the Cotton Bowl, is an American college football bowl game that has been played annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. The 2017 Cotton Bowl Classic was a college football bowl game played at 7:30 pm CST on December 29, 2017 at AT&T Stadium in Arlington, Texas. The 2017 Cotton Bowl Classic was a college football bowl game played on January 2, 2017, at AT&T Stadium in Arlington, Texas. It featured the Western Michigan Broncos from the Mid-American Conference and the Wisconsin Badgers from the Big Ten Conference.", "prediction 3": "The Cotton Bowl Classic, also simply known as the Cotton Bowl, is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. In 2017, the teams playing in the Cotton Bowl were the USC Trojans from the Pac-12 Conference and the Ohio State Buckeyes from the Big Ten Conference. In 2017, the teams playing in the Cotton Bowl were the Western Michigan Broncos from the Mid-American Conference and the Wisconsin Badgers from the Big Ten Conference.", "prediction 4": "The Cotton Bowl Classic is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. In 2017, the NCAA men's basketball team played in the Cotton Bowl, while the Pac-12 Conference team played in the Cotton Bowl. In 2017, the Big Ten conference team played in the Cotton Bowl, while the Mid-American Conference team played in the Cotton Bowl.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 467, "end": 592 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Cotton Bowl, is an American college football bowl game that has been held annually in the Dallas\u2013Fort Worth metroplex since January 1, 1937. Historically, the game hosted the champion of the Southwest Conference (SWC) against a team invited from elsewhere in the country, frequently a major independent or a runner-up from the Southeastern Conference (SEC). It featured the Western Michigan Broncos from the Mid-American Conference and the Wisconsin Badgers from the Big Ten Conference. The Cotton Bowl was played by Pac-12 Conference champion USC Trojans and Big Ten Conference champion Ohio State Buckeyes." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who are the two current senators that represent california today?", "passages": [ [ "Elections in California", "Although, the electors are not obligated to vote for the candidates they are pledged to, they usually do.", "The number of electors the state is allocated is equal to the number representatives in Congress that the state has (the members in the House of Representatives, plus the two senators).", "California, like all other states in the United States, is represented in the United States Senate by two Senators.", "In addition to Representatives in the House of Representatives, California's Senators represent the state's constituents in Congress.", "Both Kamala Harris, and Dianne Feinstein currently serve as the state's representatives.", "Each senator is elected to serve a six-year term with Harris having last been elected in 2016 (filling the recently vacated seat of former ret.", "U.S. Senator Barbara Boxer) and Feinstein in 2012.", "Each U.S. Senator is elected in a statewide election following earlier primary elections typically held in the first week of June during which both major national parties (the Democrats and Republicans) and minor parties nominate candidates via popular vote.", "There is no limit to the number of terms which any senator may serve so long as they continue to be elected to the position via statewide vote.", "Similarly, California is also represented in the US Congress by fifty-three Congressional Representatives representing the fifty-three congressional districts in the state." ], [ "Alex Padilla", "He has served as president of the League of California Cities and was its youngest-ever president and the first Latino to lead the league.", "He serves as chair of the Los Angeles Leadership Council for the American Diabetes Association.", "Padilla had been a staff member to United States Senator Dianne Feinstein and California State Assembly member Tony Cardenas.", "On July 1, 1999 at the age of 26, Padilla was sworn in as a member of the Los Angeles City Council.", "Two years later his council colleagues elected him council president.", "Padilla was the first Latino and the youngest person elected president of the Los Angeles City Council.", "Padilla was elected to the State Senate in 2006 and re-elected in 2010, with nearly 70% of the vote.", "He served as a member of the Appropriations Committee, Business and Professions and Economic Development Committee, Governmental Organization Committee, Labor and Industrial Relations Committee, and chairs the Select Committee on Science, Innovation and Public Policy.", "He left office on November 30, 2014, after two terms in the body.", "California places a two-term limit on its constitutional officers, and incumbent Debra Bowen, a fellow Democrat, was unable to run for reelection to the position of Secretary of State, the state's top elections official.", "On April 11, 2013, Alex Padilla, then a term limited State Senator, announced his intention to run for the position." ], [ "Kamala Harris", "Harris won seven counties with more than 50% of the vote: Alameda, Contra Costa, Marin, San Francisco, San Mateo, Santa Cruz, and Sonoma.", "The highest percentage was San Francisco, with 70.4% of the vote.", "She faced Congresswoman Loretta Sanchez, also a Democrat, in the general election.", "This assured that the seat would stay in Democratic hands; it was the first time a Republican did not appear in a general election for the Senate since California began directly electing Senators in 1914.", "In the November 2016 election, Harris defeated Sanchez with 62 percent of the vote, carrying all but four counties.", "Following her victory, Harris promised to protect immigrants from the policies of President-elect Donald Trump.", "Following her election to the United States Senate, Harris announced her intention to remain California's Attorney General through the end of 2016 and resign shortly before being sworn in as Senator on January 3, 2017.", "Governor Jerry Brown announced his intention to nominate Congressman Xavier Becerra as her successor.", "On January 21, 2017, a day after President Trump was sworn into office, Harris called the message of Trump's inaugural address \"dark\" when speaking during the Women's March on Washington." ] ], "gold": "The two senators currently representing the state of California in the Senate are Dianne Feinstein, who holds the position since 1992, and Alex Padilla. In 2021, Padilla replaced Kamala Harris, who served as Senator since 2017 until her resignation following her election as Vice President of the United States. Prior to her, Barbara Boxer held the seat alongside Feinstein from 1993 to 2017.", "prediction 1": "In addition to Representatives in the House of Representatives, California's Senators represent the state's constituents in Congress. Kamala Harris, and Dianne Feinstein, both Democrats, are currently the two individuals representing California in the US Senate. Senators are elected to serve a six-year term, with Harris having last been elected in 2016 (filling the recently vacated seat of former ret. U.S. Senator Barbara Boxer) and Feinstein in 2012.", "prediction 2": "In addition to Representatives in the House of Representatives, California's Senators represent the state's constituents in Congress, and both Kamala Harris and Dianne Feinstein serve as the state's representatives. Each senator is elected to serve a six-year term, with Harris having last been elected in 2016 and Feinstein in 2012.", "prediction 3": "Two senators from California are currently serving in the United States Senate. Kamala Harris and Dianne Feinstein are the current two representatives from California in the United States Senate.", "prediction 4": "Both Kamala Harris, and Dianne Feinstein, both Democrats, currently serve as the state's senators.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 432 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "In addition to Representatives in the House of Representatives, California's Senators represent the state's constituents in Congress. Kamala Harris, and Dianne Feinstein, both Democrats, are currently the two individuals representing California in the US Senate. Senators are elected to serve a six-year term, with Harris having last been elected in 2016 and Feinstein in 2012. Padilla was elected to the State Senate in 2006 and re-elected in 2010" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What people group established an empire in the valley of mexico?", "passages": [ [ "Valley of Mexico", "After the Conquest, the Spaniards rebuilt the largest and most dominant city here, Tenochtitlan, renaming it Mexico City.", "The valley used to contain five lakes called Lake Zumpango, Lake Xaltocan, Lake Xochimilco, Lake Chalco, and the largest, Texcoco covering about of the valley floor, but as the Spaniards expanded Mexico City, they began to drain the lakes' waters to control flooding.", "Although violence and disease significantly lowered the population of the valley after the Conquest, by 1900 it was again over one million people.", "The 20th and 21st\u00a0centuries have seen an explosion of population in the valley along with the growth of industry.", "Since 1900, the population has doubled every fifteen years.", "Today, around 21\u00a0million people live in the Mexico City Metropolitan Area which extends throughout almost all of the valley into the states of Mexico and Hidalgo.", "The growth of a major urban, industrial centre in an enclosed basin has created significant air and water quality issues for the valley.", "Wind patterns and thermal inversions trap contaminants in the valley.", "Over-extraction of ground water has caused new flooding problems for the city as it sinks below the historic lake floor.", "This causes stress on the valley's drainage system, requiring new tunnels and canals to be built.", "The Valley of Mexico attracted early humans because the region was rich in biodiversity and had the capacity of growing substantial crops." ], [ "Valley of Mexico", "Valley of Mexico\n\nThe Valley of Mexico (; ) is a highlands plateau in central Mexico roughly coterminous with present-day Mexico City and the eastern half of the State of Mexico.", "Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec.", "The ancient Aztec term \"Anahuac (Land Between the Waters) \" and the phrase Basin of Mexico are both used at times to refer to the Valley of Mexico.", "The Basin of Mexico became a well known site that epitomized the scene of early Classic Mesoamerican cultural development as well.", "The Valley of Mexico is located in the Trans-Mexican Volcanic Belt.", "The valley contains most of the Mexico City Metropolitan Area, as well as parts of the State of Mexico, Hidalgo, Tlaxcala and Puebla.", "The Valley of Mexico can be subdivided into four basins, but the largest and most-studied is the area which contains Mexico City.", "This section of the valley in particular is colloquially referred to as the \"Valley of Mexico\".", "The valley has a minimum elevation of above sea level and is surrounded by mountains and volcanoes that reach elevations of over .", "It is an enclosed valley with no natural outlet for water to flow and a gap to the north where there is a high mesa but no high mountain peaks." ] ], "gold": "Several people groups established an empire in the Valley of Mexico in central Mexico, including the Toltec people, who did in the 10th century, and the Aztec people, who did in 1325.", "prediction 1": "The Valley of Mexico is a highlands plateau in central Mexico roughly coterminous with present-day Mexico City and the eastern half of the State of Mexico. Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec.", "prediction 2": "The Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec. Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec. The Aztec established an empire in the Valley of Mexico from 900 BC to 1525 BC, and their empire reached a height of 538 km2 km2 km2 km2 km2 km2 km2,700 km2 km2 km2 xomexpresso, and a valley floor.", "prediction 3": "The Valley of Mexico, also known as the Basin of Mexico, is a highlands plateau in central Mexico roughly coterminous with present-day Mexico City and the eastern half of the State of Mexico. Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec.", "prediction 4": "The Valley of Mexico is a highlands plateau in central Mexico roughly coterminous with present-day Mexico City and the eastern half of the State of Mexico. Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec. The Aztec established an empire in the Valley of Mexico in the early 20th century.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 155 } ], "missing-info": [], "corrected-prediction": "Surrounded by mountains and volcanoes, the Valley of Mexico was a centre for several pre-Columbian civilizations, including Teotihuacan, the Toltec, and the Aztec." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was fly me to the moon released?", "passages": [ [ "Fly Me to the Moon", "Frank Sinatra's 1964 recording of \"Fly Me to the Moon\" became closely associated with NASA's Apollo space program.", "A copy of the song was played on the Apollo 10 mission which orbited the Moon.", "It became the first music heard on the Moon when played on a portable cassette player by Apollo 11 astronaut Buzz Aldrin after he stepped onto the Moon.", "The song\u2019s association with Apollo 11 was reprised many years later when Diana Krall sang it at the mission's 40th anniversary commemoration ceremony.", "She also sang a \u201cslow and solemn version\u201d in 2012 at the national memorial service for Apollo 11 mission commander Neil Armstrong." ], [ "Fly Me to the Moon", "Many years later Howard commented that \"... it took me 20 years to find out how to write a song in 20 minutes.\"", "He used his position as a piano accompanist and presenter at the Blue Angel cabaret venue to promote the song, and it was soon introduced in cabaret performances by Felicia Sanders.", "Kaye Ballard made the song's first commercial recording, and Decca released it in April 1954.", "A brief review published on 8 May 1954 in \"Billboard\" said that \"In Other Words\" was \"...a love song sung with feeling by Miss Ballard.\"", "This recording was released as the flipside of \"Lazy Afternoon\", which Kaye Ballard was currently performing as star of the stage show \"The Golden Apple\".", "Over the next few years, jazz and cabaret singers released cover versions of \"In Other Words\" on EP or LP record albums, including Chris Connor, Johnny Mathis, Portia Nelson, and Nancy Wilson.", "Eydie Gorm\u00e9 sang the song on her 1958 album \"Eydie In Love\", which reached #20 in the \"Cashbox\" Album Charts and was nominated for a Grammy Award.", "In 1960, Peggy Lee released the song on the album \"Pretty Eyes\", then made it more popular when she performed it in front of a large television audience on \"The Ed Sullivan Show\"." ], [ "Kaye Ballard", "Kaye Ballard\n\nKaye Ballard (born November 20, 1925) is a retired American musical theatre and television actress, comedian and singer.", "Ballard was born Catherine Gloria Balotta in Cleveland, Ohio, one of four children born to Italian immigrant parents, Lena (n\u00e9e Nacarato) and Vincenzo (later Vincent James) Balotta.", "Her siblings are Orlando, Jean, and Rosalie.", "Kaye established herself as a musical comedian in the 1940s, joining the Spike Jones touring revue of entertainers.", "Capable of playing broad physical comedy as well as stand-up dialogue routines, she became familiar in television and stage productions.", "A phrase her mother had used when Kaye was a child, \"Good luck with your MOUTH!", "\", became her catchphrase in her sketches and on television.", "Ballard made her television debut on \"Henry Morgan's Great Talent Hunt\", hosted by Henry Morgan, a short-lived NBC program, which first aired January 26, 1951.", "In 1954, she was the first person to record the song \"Fly Me to the Moon\".", "In 1957, she and Alice Ghostley played the two wicked stepsisters in the live telecast of Rodgers and Hammerstein's \"Cinderella\", starring Julie Andrews in the title role." ] ], "gold": "The song Fly Me to the Moon was released several times. It was originally released in April 1954 when the song's first commercial recording, made by American singer Kaye Ballard, was released by Decca. A rendition of the song by American singer and actor Frank Sinatra was released in 1964.", "prediction 1": "Frank Sinatra's 1964 recording of Fly Me to the Moon became closely associated with NASA's Apollo space program. In April 1954, Kaye Ballard made the song's first commercial recording, and Decca released it in April 1954. Eydie Gorm\u00e9 sang the song on her 1958 album \"Eydie In Love\", which reached #20 in the Cashbox Album Charts and was nominated for a Grammy Award. Over the next few years, jazz and cabaret singers released cover versions of \"In Other Words\".", "prediction 2": "The first commercial fly me to the moon recording was made by Kaye Ballard in April 1954, and Decca released it in April 1954. Frank Sinatra's 1964 recording of Fly Me to the Moon became closely associated with NASA's Apollo space program.", "prediction 3": "Fly Me to the Moon was first recorded by Kaye Ballard in April 1954 and Decca released it in April 1954. Frank Sinatra's 1964 recording of Fly Me to the Moon became closely associated with NASA's Apollo space program. In 1957, she was the first person to record the song. In 2012, Diana Krall sang a slow and solemn version of Fly Me to the Moon at the national memorial service for Apollo 11 mission commander Neil Armstrong.", "prediction 4": "Kaye Ballard made the song's first commercial recording, and Decca released it in April 1954. A brief review published on 8 May 1954 in Billboard said that \"In Other Words\" was \"...a love song sung with feeling by Miss Ballard.\" This recording was released as the flipside of \"Lazy Afternoon\", which Kaye Ballard was currently performing as star of the stage show The Golden Apple. Over the next few years, jazz and cabaret singers released cover versions of \"In Other Words\" on EP or LP record albums. Later, and cover versions of \"In Other Words\" were released on EP or LP record albums, including Chris Connor, Johnny Mathis, Portia Nelson, Portia Nelson, Nancy Wilson, and Nancy Wilson. In 1960, Peggy Lee released the song on the album Pretty Eyes, then made it more popular when she performed it in front of", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 112 } ], "missing-info": [], "corrected-prediction": "Frank Sinatra recorded the song Fly Me to the Moon in 1964. In April 1954, Kaye Ballard made the song's first commercial recording, and Decca released it in April 1954. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the salary cap introduced to the nfl?", "passages": [ [ "Salary cap", "Penalties for violating or circumventing the cap regulations include fines of up to $5 million for each violation, cancellation of contracts and/or loss of draft picks.", "Violating the salary floor regulations does not result in any fines or competitive penalties; instead, deficiencies are placed into a pool and distributed among all players who were on the regular roster of the offending team during a four-year floor cycle, prorated according to time on the roster in said period.", "The cap was first introduced for the 1994 season and was initially $34.6 million.", "Both the cap and the floor are adjusted annually based on the league's revenues, and they have increased each year.", "In , the final capped year under that agreement, the cap was $128 million per team, while the floor was 87.6% of the cap.", "Using the formula provided in the league's collective bargaining agreement, the floor in 2009 was $112.1 million.", "Under the NFL's agreement with the NFLPA, the effects on the salary cap of guaranteed payments (such as signing bonuses) are, with a few rare exceptions, prorated evenly over the term of the contract.", "In transitions, if a player retires, is traded, or is cut before June 1, all remaining bonus is applied to the salary cap for the current season." ], [ "Salary cap", "Salary cap\n\nIn professional sports, a salary cap (or wage cap) is an agreement or rule that places a limit on the amount of money that a team can spend on players' salaries.", "It exists as a per-player limit or a total limit for the team's roster, or both.", "Several sports leagues have implemented salary caps, using it to keep overall costs down, and also to maintain a competitive balance by restricting richer clubs from entrenching dominance by signing many more top players than their rivals.", "Salary caps can be a major issue in negotiations between league management and players' unions because they limit players' ability to negotiate higher salaries even if a team is operating at significant profits, and have been the focal point of several strikes by players and lockouts by owners and administrators.", "Salary caps are used by the following major sports leagues around the world:\n\n\nRecently, several European association football leagues have also discussed introducing salary caps.", "The Union of European Football Associations introduced a set of Financial Fair Play Regulations in 2011, which limits football clubs' spending relative to their income.", "In theory, there are two main benefits derived from salary caps \u2013 promotion of parity between teams, and control of costs.", "Primarily, an effective salary cap prevents wealthy teams from certain destructive behaviours, such as signing a multitude of high-paid star players to prevent their rivals from accessing these players, and ensuring victory through superior economic power." ], [ "2011 NFL lockout", "ESPN writer John Clayton notes that there were five major parts of the new CBA: free agency, salary cap, rookie compensation, minimum salaries, and franchise tags.", "First, free agency guidelines returned to the way they were from 1993 to 2011.", "This means that a player needs four years of experience to become an unrestricted free agent, and three years of experience for restricted free agency.", "Second, the salary cap is now $120.375 million, but unlike the previous CBA, the new one initially has no per-team salary minimum.", "Team salary floors would not return until the 2013 season, at which time they became 89% of the cap.", "For the 2011 season, teams had the ability to \"borrow\" $3 million in future salary cap space to use on a signed player.", "For the years following the 2011 season, teams have the option of \"borrowing\" $1.5 million each for up to three players.", "Third, the rookie compensation was altered.", "There is a limit to the amount of money given to rookies, with the maximum total in 2011 being $874 million.", "First round picks receive four-year deals, with a fifth year option.", "In the second through seventh rounds, there are slotted four-year deals.", "Fourth, the league minimum salary for players increased by 10\u201312 percent, based on tenure." ] ], "gold": "In professional sports, a salary cap (or wage cap) is an agreement or rule that places a limit on the amount of money that a team can spend on players' salaries. It exists as a per-player limit or a total limit for the team's roster, or both. Several sports leagues have implemented salary caps, using it to keep overall costs down, and also to maintain a competitive balance by restricting richer clubs from entrenching dominance by signing many more top players than their rivals. The salary cap in the NFL was first agreed on in 1993 and was introduced for the 1994 season.", "prediction 1": "The salary cap in professional sports is an agreement or rule that places a limit on the amount of money that a team can spend on players' salaries. The salary cap was first introduced to the NFL for the 1994 season and was initially $34.6 million. Both the cap and the floor are adjusted annually based on the league's revenues, and they have increased each year. In 2009, the salary floor was 87.6% of the cap. In 2011, the salary floor was 89% of the cap.\n", "prediction 2": "In professional sports, a salary cap is an agreement that places a limit on the amount of money that a team can spend on players' salaries. It exists as a per-player limit or a total limit for the team's roster, or both, and was first introduced to the NFL in 1994. Since that time, the salary cap has increased to $120.375 million for the 2019 NFL season, with a player salary floor of 87.6% under the cap as of 2019.", "prediction 3": "The salary cap, or wage cap, in professional sports is an agreement or rule that places a limit on the amount of money a team can spend on players' salaries. It is used by several sports leagues, most commonly the NFL. In professional sports, a salary cap is an agreement or rule that places a limit on the amount of money a team can spend on players' salaries, either as a per-player limit or a total limit for the team's roster, or both. The salary cap was first introduced to the NFL in 1994 season, initially $34.6 million, and was $34.6 million. In 2009, the salary floor was 87.6% of the cap.6 million.", "prediction 4": "In professional sports, a salary cap is an agreement or rule that places a limit on the amount of money that a team can spend on players' salaries. The cap was first introduced to the NFL for the 1994 season, and was initially $34.6 million. Both the cap and the floor are adjusted annually based on the league's revenues, and they have increased each year. In 2009, the salary floor was 87.6% of the salary cap.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 248 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 459 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The salary cap in professional sports is an agreement or rule that places a limit on the amount of money that a team can spend on players' salaries. The salary cap was first introduced to the NFL for the 1994 season. It exists as a per-player limit or a total limit for the team's roster, or both. Several sports leagues have implemented salary caps, using it to keep overall costs down, and also to maintain a competitive balance by restricting richer clubs from entrenching dominance by signing many more top players than their rivals.\n" }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "How many volumes of cowboy bebop are there?", "passages": [ [ "Cowboy Bebop: The Movie", "Cowboy Bebop: The Movie\n\nCowboy Bebop: The Movie, known in Japan as , is a 2001 Japanese animated science fiction film based on the 1998 anime series \"Cowboy Bebop\" created by Hajime Yatate.", "Multiple staff from the original series worked on the film, including director Shinichir\u014d Watanabe, writer Keiko Nobumoto, character designer/animation director Toshihiro Kawamoto, and composer Yoko Kanno.", "The original Japanese and English voice cast also reprised their roles.", "\"Cowboy Bebop: The Movie\" is set between episodes 22 and 23 of the original series.", "The plot centers on a mysterious terrorist planning to destroy the human population on Mars using an unknown pathogen.", "The bounty hunter crew of the spaceship \"Bebop\" work to find the terrorist and discover the source of the pathogen before the attack can take place.", "The film was conceived by Watanabe as an extension of his work on the television series, which he treated as a series of miniature films.", "So as not to alienate fans of the series, a large amount of aesthetic material was incorporated, while also adjusting it to make it accessible to newcomers.", "Increased budget and production facilities enabled the use of filming styles associated with live action films and a higher animation quality than the series." ], [ "Cowboy Bebop", "Cowboy Bebop\n\nThe series premiered in Japan on TV Tokyo from April 3 until June 26, 1998, broadcasting only twelve episodes and a special due to its controversial adult-themed content.", "The entire twenty-six episodes of the series were later broadcast on WOWOW from October 24 until April 24, 1999.", "The anime was adapted into two manga series which were serialized in Kadokawa Shoten's Asuka Fantasy DX.", "A was later released to theaters worldwide.", "The anime series was dubbed in the English language by Animaze and ZRO Limit Productions, and was licensed by Bandai Entertainment in North America and is now licensed by Funimation.", "In Britain, it was licensed by Beez Entertainment and is currently licensed by Anime Limited.", "Madman Entertainment has licensed it for releases in Australia and New Zealand.", "In 2001, \"Cowboy Bebop\" became the first anime title to be broadcast on Adult Swim in the United States.", "\"Cowboy Bebop\" became a critical and commercial success both in Japanese and international markets (most notably in the United States), garnered several major anime and science fiction awards upon its release, and received wide acclaim for its style, characters, story, voice acting, animation, and soundtrack.", "In the years since its release, critics have hailed \"Cowboy Bebop\" as a masterpiece and frequently cite it as one of the greatest anime titles of all time." ], [ "Cowboy Bebop", "Following the closure of Bandai Entertainment in 2012, Funimation and Sunrise had announced that they rescued \"Cowboy Bebop\", along with a handful of other former Bandai Entertainment properties, for home video and digital release.", "Funimation released the series on Blu-ray and DVD on December 16, 2014.", "The series was released in four separate editions: standard DVD, standard Blu-ray, an Amazon.com exclusive Blu-ray/DVD combo, and a Funimation.com exclusive Blu-ray/DVD combo.", "Two \"Cowboy Bebop\" manga series have been released, both published by Kadokawa Shoten and serialized in \"Asuka Fantasy DX\".", "The first manga series, titled \"Cowboy Bebop: Shooting Star\" and written and illustrated by Cain Kuga, was serialized from October issue 1997, before the anime series' release, to July issue 1998.", "It was collected into two volumes in 1998, the first one in May and the second one in September.", "The second manga series, simply titled \"Cowboy Bebop\" and written and illustrated by Yutaka Nanten, was serialized from November issue 1998 to March issue 2000." ] ], "gold": "The Japanese science fiction neo-noir anime series Cowboy Bebop ran for a total of 26 episodes over 2 seasons from April 3 to June 26, 1998. Two related Cowboy Bebop manga series have since been released. The first manga series was Cowboy Bebop: Shooting Star, illustrated by Cain Kuga and released in 2 volumes in 1998. The second manga series was simply titled Cowboy Bebop, illustrated by Yutaka Nanten and released in 3 volumes in 1999 and 2000.", "prediction 1": "Cowboy Bebop is a Japanese anime series created by Hajime Yatate. There are 2 manga series published by Kadokawa Shoten. Cowboy Bebop: Shooting Star was serialized from October issue 1997 to July issue 1998. The manga series was collected into 2 volumes, one in May and one in September. Cowboy Bebop: The Movie is a 2001 Japanese animated science fiction film based on the 1998 anime series Cowboy Bebop.\n", "prediction 2": "The Cowboy Bebop anime series was originally published in Japan as 12 issues included a special episode on April 28, 1998. Two Cowboy Bebop manga series were released. The first Cowboy Bebop manga, Cowboy Bebop: Shooting Star, was serialized from October issue 1997, before the anime series' release, to July issue 1998. It was collected into two volumes in 1998, the first one in May and the second one in September. The Cowboy Bebop anime series was adapted into 2 Cowboy Bebop: The Movie, based on the Cowboy Bebop: The Movie. After the closure of Bandai Entertainment in 2012, Funimation had announced that they were to reprise the series for home video and digital release in 2017.", "prediction 3": "There are several media sources for the 1988 Japanese anime series Cowboy Bebop. Two manga series were serialized in Kinkaku Shoten's Asuka Fantasy DX. The first manga series, Cowboy Bebop: Shooting Star, was serialized from October issue 1997, before the anime series' release, to July issue 1998. The second manga series, simply titled Cowboy Bebop, was serialized from November issue 1998 to March issue 2000.", "prediction 4": "The Cowboy Bebop cartoon series has been adapted into manga and a 2001 film based on the same series. The Cowboy Bebop anime was first published by Bandai Entertainment in Japan in June 1998, then reprinted in English by Funimation and published by Kadokawa Shoten in North America and Australia from 1998 to 1999. The manga series was then serialized as Asuka Fantasy DX by Kadokawa Shoten, and then collected into two volumes, one in May and the second one in September 1998. Three Cowboy Bebop: The Movie was published by Funimation in Japan in 2014 and released on three separate editions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 120 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 406 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Cowboy Bebop is a Japanese anime series premiered from April 3 until June 26, 1998, broadcasting only twelve episodes and a special. The entire twenty-six episodes of the series were later broadcast from October 24 until April 24, 1999. Two \"Cowboy Bebop\" manga series have been released. The first manga series, titled \"Cowboy Bebop: Shooting Star\" and written and illustrated by Cain Kuga, was collected into two volumes in 1998. The second manga series, simply titled \"Cowboy Bebop\" and written and illustrated by Yutaka Nanten, was serialized from November issue 1998 to March issue 2000.\n\n" }, "preference": [ 1, 2, 0, 2, 0, 1 ] }, { "question": "Who is chief election commissioner of india now?", "passages": [ [ "Sushil Chandra Varma", "Sushil Chandra Varma\n\nSushil Chandra Varma (24 February 1926 \u2013 6 October 2011) was an Indian politician.", "Sushil Chandra Varma was born on 24 February 1926 in Khandwa, Madhya Pradesh and married Renu Varma in 1951.", "He attended the University of Bhopal and the University of Allahabad, earning an M.Sc.", "in chemistry and a Ph.D in sociology.", "He joined the Indian Administrative Service in 1949 and held various posts in Madhya Pradesh and in Delhi.", "Varma was elected from the Bhopal constituency to the 9th, 10th, 11th and 12th Lok Sabhas, with the first of those elections occurring in 1991.", "He was a member of various parliamentary committees and of the Bharatiya Janata Party.", "He committed suicide in 2011, having suffered from ill-health for some years previously." ], [ "Sunil Arora", "Sunil Arora\n\nSunil Arora (born 13 April 1956) is the current and 23rd Chief Election Commissioner of India.", "He is a retired 1980 batch Indian Administrative Service (IAS) officer of Rajasthan cadre.", "He also served as a secretary to the Government of India in two\u00a0ministries.", "Arora's father is a retired accounts officer of the Indian Railways, whereas his mother served in DAV College, Hoshiarpur.", "Of his two\u00a0brothers, one is also an IAS officer, whereas, the other is a diplomat from the Indian Foreign Service.", "Arora has graduate (BA Honours) and postgraduate (MA) degrees in English from Panjab University in the Union Territory of Chandigarh.", "Before being appointed as an IAS officer, Sunil Arora served as an associate professor in DAV College in Jalandhar." ], [ "Om Prakash Rawat", "Om Prakash Rawat\n\nOm Prakash Rawat (IAST: \"Oma Prak\u0101\u015ba R\u0101vata\"; born 2 December 1953) is a retired 1977 batch Indian Administrative Service (IAS) officer of the Madhya Pradesh cadre who served as 22nd Chief Election Commissioner of India.", "He has also served as one of the twoElection Commissioners of India and the Public Enterprise Secretary of India.", "Rawat is a graduate (BSc) and postgraduate (MSc) in physics from the Banaras Hindu University, Varanasi (BHU), and has postgraduate degree (MSc) in social development planning, which he did in 1989 in the United Kingdom.", "Rawat served in various positions for both the Government of India and the Government of Madhya Pradesh such as Principal Secretary (Commerce and Industries), Principal Secretary to the Chief Minister of Madhya Pradesh, Principal Secretary (Woman and Child Development) Principal Secretary (Tribal Welfare), Vice Chairman of Narmada Valley Development Authority, Excise Commissioner of Madhya Pradesh, and as the district magistrate and collector of Narsinghpur and Indore districts in the Madhya Pradesh government; and as the Union Public Enterprise Secretary, and as a joint secretary in the Ministry of Defence in the Indian government." ] ], "gold": "Sushil Chandra is the current and 24th Chief Election Commissioner of India. Chandra is also a 1980 batch Indian Revenue Service officer. Prior to Chandra, Sunil Arora was the 23rd Chief Election Commissioner of India. Arora is a retired 1980 batch Indian Administrative Service officer from the Rajasthan cadre. Arora succeeded Om Prakash Rawat as the Chief Election Commissioner of India. Rawat is a retired 1977 batch Indian Administrative Service officer from the Madhya Pradesh cadre. Prior to Rawat, Achal Kumar Jyoti is a retired 1975 batch Indian Administrative Service officer from the Gujarat cadre who served as 21st Chief Election Commissioner of India. Before Jyoti, Syed Nasim Zaidi served as 20th Chief Election Commissioner of India. Zaidi is a retired 1976 batch Indian Administrative Service officer from the Uttar Pradesh cadre. Prior to Zaidi, Harishankar Brahma served as 19th Chief Election Commissioner of India. Brahma is a retired 1975 batch Indian Administrative Service officer from the Andhra Pradesh cadre.", "prediction 1": "In 2019, Sushil Chandra Varma was the Chief Election Commissioner of India. Sunil Arora was the Chief Election Commissioner of India from 2013 to 2017. Om Prakash Rawat was the 22nd Chief Election Commissioner of India from 2017 to 2019.", "prediction 2": "There are 3 chief election commissioners in India. Om Prakash Rawat is the current chief election commissioner of India, and Sunil Arora is the current and 23rd chief election commissioner of India. Varma was the chief election commissioner of Madhya Pradesh from 1993 to 2011.", "prediction 3": "Sushil Chandra Varma was an Indian politician and elected from Bhopal constituency to the 9th, 10th, 11th and 12th Lok Sabhas, with the first of those elections occurring in 1991. Sunil Arora is the current and 23rd Chief Election Commissioner of India. Om Prakash Rawat was a retired 1977 batch Indian Administrative Service (IAS) officer of the Madhya Pradesh cadre. He served as 22nd Chief Election Commissioner of India.", "prediction 4": "Om Prakash Rawat, a retired 1977 batch Indian Administrative Service officer of the Madhya Pradesh cadre, is a retired 1977 batch Indian Administrative Service (IAS) officer of the Madhya Pradesh cadre who served as 22nd Chief Election Commissioner of India. He is also a graduate (BSc) and postgraduate (MSc) in physics from the Banaras Hindu University, Varanasi, and has also served as one of the two Election Commissioners of India and the Public Enterprise Secretary of India.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 }, { "error type": "Unverifiable", "explanation": "", "start": 133, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 219, "end": 237 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sunil Arora was the 23rd Chief Election Commissioner of India. Om Prakash Rawat is a retired 1977 batch Indian Administrative Service (IAS) officer of the Madhya Pradesh cadre who was the 22nd Chief Election Commissioner of India." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When did canada become a completely independent country?", "passages": [ [ "Amendments to the Constitution of Canada", "Amendments to the Constitution of Canada\n\nAmendments to the Constitution of Canada are changes to the Constitution of Canada.", "Before 1982, modifying the Constitution of Canada primarily meant amending the British North America Act, 1867.", "Unlike most constitutions, however, this Act had no amending formula: instead changes were enacted through Acts of the Parliament of the United Kingdom (or \"Imperial Parliament\") called the British North America Acts.", "Other Commonwealth countries had taken over the authority for constitutional amendment after the Statute of Westminster 1931, but at the time, Canada decided to allow the Parliament of the United Kingdom to \"temporarily\" retain the power.", "With the Constitution Act 1982, Canada took over the authority to amend its own constitution, achieving full sovereignty.", "Between 1931 and 1982, the federal government, on behalf of the House of Commons of Canada and the Senate, would issue an address to the British government requesting an amendment.", "The request would include a resolution containing the desired amendments.", "These in turn, were always passed by the British Parliament, with little or no debate.", "As part of the patriation of the Constitution in 1982 an amending formula was adopted in sections 38 to 49 of the Constitution Act, 1982.", "Most amendments can be passed only if identical resolutions are adopted by the House of Commons, the Senate and two thirds or more of the provincial legislative assemblies representing at least 50 percent of the national population." ], [ "Patriation", "Patriation\n\nPatriation was the political process that led to full Canadian sovereignty, culminating with the Constitution Act, 1982.", "That Act was necessary because under the Statute of Westminster 1931, with Canada's agreement at the time, the British parliament had retained the power to amend Canada's Constitution Acts (Statute of Westminster sec.", "7(1)), and to enact more generally for Canada at the request and with the consent of the Dominion (sec. 4).", "That authority was removed from the UK by the passing of the Canada Act 1982 on March 29, 1982, by the Parliament of the United Kingdom, as requested by the Parliament of Canada.", "Patriation was subsequently confirmed by Canada's Constitution Act, 1982 which was signed by then Prime Minister Pierre Trudeau and by Elizabeth II, as Queen of Canada, on April 17, 1982, on Parliament Hill, in Ottawa.", "Queen Elizabeth's constitutional powers over Canada were not affected by the act.", "Canada has complete sovereignty as an independent country, however, and the Queen's role as monarch of Canada is distinct from her role as the British monarch or the monarch of any of the other Commonwealth realms.", "The patriation process saw the provinces granted influence in constitutional matters and resulted in the constitution being amendable by Canada only and according to its amending formula, with no role for the United Kingdom." ] ], "gold": "In 1931, Canada became a self governing country, but Britain could still make changes to their constitution. The Canada Act 1982 was enacted at the request of the Senate and House of Commons of Canada to patriate Canada's Constitution, ending the power of the British Parliament to amend the Constitution. ", "prediction 1": "Canada became a completely independent country in 1982, when the Constitution Act was passed. The process that led to full Canadian sovereignty was called patriation. Patriation was the political process that led to full Canadian sovereignty. The Constitution was amended by the Constitution Act, 1982.", "prediction 2": "Patriation was the political process that led to full Canadian sovereignty, culminating with the Constitution Act, 1982. That Act was necessary because under the Statute of Westminster 1931, with Canada's agreement at the time, the British parliament had retained the power to amend Canada's Constitution Acts. That authority was removed from the UK by the passing of the Canada Act 1982 on March 29, 1982, by the Parliament of the United Kingdom, as requested by the Parliament of Canada. Canada became a completely independent country on April 17, 1982, when Elizabeth II became Queen of Canada.", "prediction 3": "Canada became a completely independent country in 1982, when the Constitution Act was passed. Patriation was the political process that led to full Canadian sovereignty, culminating with the Constitution Act, 1982. The Constitution Act was signed by then Prime Minister Pierre Trudeau and by Elizabeth II, as Queen of Canada, on April 17, 1982, on Parliament Hill, in Ottawa.", "prediction 4": "Canadian sovereignty was achieved through a political process called patriation. Patriation was the process by which Canada became a fully independent country, culminating in the 1982 Constitution Act. The Canada Act was signed by then Prime Minister Pierre Trudeau and by Elizabeth II, as Queen of Canada, on April 17, 1982, on Parliament Hill, in Ottawa.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 166 }, { "error type": "Redundant", "explanation": "The process that led to full Canadian sovereignty was called patriation. ", "start": 167, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 302 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Canada became a completely independent country in 1982, when the Constitution Act was passed. The United Kingdom had authority over constitutional amendments prior." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who's winning the alabama clemson football game?", "passages": [ [ "Clemson Tigers football", "The Crimson Tide and Tigers met again in 1904 and 1905, with Clemson winning both games.", "Beginning with the next meeting between the two squads in 1909, Alabama won the next thirteen matchups against Clemson.", "The Tide posted the biggest margin of victory in the rivalry in 1931, whopping the Tigers by a margin of 74\u20137.", "In the first seven games of Alabama's 13-game streak, Clemson only score seven total points and was shut out in six of the seven games.", "After a 56\u20130 shutout Alabama victory in 1975, the squads didn't meet again until 2008, when they squared off on opening weekend in Atlanta, Georgia.", "The Tide emerged victorious with a 34\u201310 victory.", "The last three matchups between the squads have had national championship implications and have greatly intensified the rivalry.", "The teams squared off in the 2016 College Football Playoff National Championship in Glendale, Arizona, with Alabama emerging with a thrilling 45-40 victory.", "The next year, the teams again found themselves doing battle in the 2017 College Football Playoff National Championship in Tampa, Florida, with Clemson emerging with a thrilling 35-31 victory and their first win over the Crimson Tide since 1905.", "Once again the teams did battle in the 2018 Sugar Bowl in New Orleans, Louisiana with a trip to the 2018 College Football Playoff National Championship game on the line.", "Alabama won the contest by a score of 24\u20136." ] ], "gold": "Alabama and Clemson squared off in the 2016 College Football Playoff National Championship in Glendale, Arizona, with Alabama emerging with a thrilling 45\u201340 victory. The next year, they found themselves doing battle in the 2017 College Football Playoff National Championship in Tampa, Florida, with Clemson emerging with a thrilling 35\u201331 victory and their first win over the Crimson Tide since 1905.", "prediction 1": "There are several Alabama - Clemson football games. In the 1905 game, the Crimson Tide defeated the Tigers 75-7, in 1931 the Tide won by 74-7. The next three games in the rivalry have had national championship implications and have greatly intensified the rivalry.", "prediction 2": "The Crimson Tide has won the Alabama-Clemson football game in 1905. In the following years, the Tide has won the Alabama-Clemson football game, while the Tigers have won the Alabama-Clemson football game since 1905.", "prediction 3": "The Crimson Tide and Clemson Tigers met again in 1904 and 1905, with Clemson winning both games. Beginning with the next meeting between the two squads in 1909, Alabama won the next thirteen matchups against Clemson. The Tide posted the biggest margin of victory in the rivalry in 1931, whopping the Tigers by a margin of 74\u20137.", "prediction 4": "The Crimson Tide and Clemson Tigers met again in 1904 and 1905, with Clemson winning both games. Beginning with the next meeting between the two squads in 1909, Alabama won the next thirteen matchups against Clemson. The Crimson Tide posted the biggest margin of victory in the rivalry in 1931, whopping the Tigers by a margin of 74-7.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 59, "end": 69 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 107, "end": 112 }, { "error type": "Redundant", "explanation": "In the 1905 game, the Crimson Tide defeated the Tigers 75-7, ", "start": 113, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 264 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10, 11 ] } ], "corrected-prediction": "There are several Alabama - Clemson football games. The teams squared off in the 2016 College Football Playoff National Championship in Glendale, Arizona, with Alabama emerging with a thrilling 45-40 victory. The next year, the teams again found themselves doing battle in the 2017 College Football Playoff National Championship in Tampa, Florida, with Clemson emerging with a thrilling 35-31 victory and their first win over the Crimson Tide since 1905. The teams did battle in the 2018 Sugar Bowl in New Orleans, Louisiana, Alabama won the contest by a score of 24\u20136." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the soundtrack for la la land?", "passages": [ [ "La La Land (soundtrack)", "La La Land (soundtrack)\n\nLa La Land: Original Motion Picture Soundtrack is the soundtrack album to the 2016 film \"La La Land\".", "The soundtrack album was released through Interscope Records on December 9, 2016.", "The album has peaked at number 2 on the US \"Billboard 200\" and number 1 on the UK Albums Chart.", "At the 89th Academy Awards, the film won the Academy Awards for Best Original Score and Best Original Song for \"City of Stars\".", "The songs and score for \"La La Land\" were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films.", "The lyrics were written by Pasek and Paul, except for \"Start a Fire\", which was written by John Legend, Hurwitz, Marius de Vries and Ang\u00e9lique Cin\u00e9lu." ] ], "gold": "The songs and score for the 2016 film La La Land were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films. The lyrics were written by Benj Pasek and Justin Paul, except for the song Start a Fire, which was written by John Legend, Hurwitz, Marius de Vries and Ang\u00e9lique Cin\u00e9lu. At the 89th Academy Awards, La La Land won the Academy Awards for Best Original Score and Best Original Song for City of Stars.", "prediction 1": "La La Land: Original Motion Picture Soundtrack is the soundtrack album to the 2016 film La La Land. The songs and score for La La Land were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films.", "prediction 2": "La La Land: Original Motion Picture Soundtrack is the soundtrack album to the 2016 film \"La La Land\". The songs and score for \"La La Land\" were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films. The lyrics were written by Pasek and Paul, except for \"Start a Fire\", which was written by John Legend, Hurwitz, Marius de Vries and Ang\u00e9lique Cin\u00e9lu.", "prediction 3": "The soundtrack for La La Land was written and composed by Justin Hurwitz and orchestrated by David Pasek and Paul. The songs and score for La La Land were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films. The lyrics were written by John Legend, Hurwitz, Marius de Vries and Ang\u00e9lique Cin\u00e9lu.", "prediction 4": "The La La Land: Original Motion Picture Soundtrack is the soundtrack album to the 2016 film La La Land. The songs and score for La La Land were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 99 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The songs and score for La La Land were composed and orchestrated by Justin Hurwitz, film director Damien Chazelle's Harvard University classmate, who also worked on his two prior films. The lyrics were written by Pasek and Paul, except for \"Start a Fire\", which was written by John Legend, Hurwitz, Marius de Vries and Ang\u00e9lique Cin\u00e9lu. At the 89th Academy Awards, the film won the Academy Awards for Best Original Score and Best Original Song for \"City of Stars\"." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "American type of apple pie in a deep dish?", "passages": [ [ "Apple pie", "Apple pie\n\nAn apple pie is a pie or a tart, in which the principal filling ingredient is apple.", "It is, on occasion, served with whipped cream or ice cream on top, (which is known as apple pie a la mode), or with cheddar cheese.", "The pastry is generally used top-and-bottom, making it a double-crust pie; the upper crust may be a circular or a pastry lattice woven of crosswise strips.", "Depending on the baker's preference, the bottom of the double-crust may be baked first (before baking the whole pie) to prevent the bottom from getting soggy.", "Exceptions are deep-dish apple pie, with a top crust only, and open-face Tarte Tatin.", "Apple pie is an unofficial symbol of the United States and one of its signature comfort foods.", "Apple pie can be made with many different sorts of apples.", "The more popular cooking apples include, Braeburn, Gala, Cortland, Bramley, Empire, Northern Spy, Granny Smith, and McIntosh.", "The fruit for the pie can be fresh, canned, or reconstituted from dried apples.", "These different types of apples (canned, dried, fresh) affects the final texture and the length of cooking time required will vary, therefore people disagree on if it affects the flavour or not." ], [ "Apple pie", "Dutch apple pies may include ingredients such as full-cream butter, raisins and almond paste, in addition to ingredients such as apples and sugar, which they have in common with other recipes.", "The basis of Dutch apple pie is a crust on the bottom and around the edges.", "This crust is then filled with pieces or slices of apple, usually a crisp and mildly tart variety such as Goudreinet or Elstar.", "Cinnamon and sugar are generally mixed in with the apple filling.", "Atop the filling, strands of dough cover the pie in a lattice holding the filling in place but keeping it visible or cover the pie with crumbs.", "It can be eaten warm or cold, sometimes with a dash of whipped cream or vanilla ice cream.", "In the US, \"Dutch apple pie\" refers specifically to the apple pie style with a crumb, streusel, topping.", "English apple pie recipes go back to the time of Chaucer.", "The 1381 recipe (see illustration at right) lists the ingredients as \"good apples, good spices, figs, raisins and pears.\"", "The \"cofyn\" of the recipe is a casing of pastry.", "Saffron is used for colouring the pie filling." ] ], "gold": "An apple pie is a pie in which the principal filling ingredient is apple. Deep-dish apple pie often has a top crust only and tarte Tatin is baked with the crust on top, but served with it on the bottom. Whereas Dutch apple pie has a crumb and streusel topping. ", "prediction 1": "Apple pie is an unofficial symbol of the United States and one of its signature comfort foods. In the US, \"Dutch apple pie\" refers specifically to the apple pie style with a crumb, streusel, topping.", "prediction 2": "American apple pie in a deep dish is a pie or tart, in which the principal filling ingredient is apple. In the US, the \"Dutch apple pie\" refers specifically to the apple pie style with a crumb, streusel, topping.", "prediction 3": "Apple pie is a pie or a tart in which the principal filling ingredient is apple. The pastry is generally used top-and-bottom, making it a double-crust pie; the upper crust may be a circular or a pastry lattice woven of crosswise strips. Deep dish apple pie: In the US, deep dish apple pie in a deep dish is a dessert that is covered in a pastry lattice covering the entire pie. In the Netherlands, Dutch apple pie refers specifically to the apple pie style with a crumb, streusel topping. In the US, \"Dutch apple pie\" refers specifically to the apple pie style with a crumb, streusel topping.", "prediction 4": "An apple pie is a pie or a tart in which the principal filling ingredient is apple. The pastry is generally used top-and-bottom, making it a double-crust pie. The American type of apple pie in a deep dish is a Dutch style apple pie with a crumb, streusel, topping.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 94 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "An apple pie is a pie or a tart, in which the principal filling ingredient is apple. Deep-dish apple pie, with a top crust only, and open-face Tarte Tatin. In the US, \"Dutch apple pie\" refers specifically to the apple pie style with a crumb, streusel, topping." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Where does air canada fly to in italy?", "passages": [ [ "Milan Malpensa Airport", "Milan Malpensa Airport\n\nMilan Malpensa Airport is the largest international airport in the Milan metropolitan area in northern Italy.", "It serves 15 million inhabitants in Lombardy, Piedmont and Liguria, as well as those living in the Swiss region of Canton Ticino.", "The airport is located northwest of central Milan, next to the Ticino river (dividing Lombardy and Piedmont).", "The airport has two terminals and two runways as well as a dedicated cargo terminal.", "In 2017, Malpensa Airport handled 22,169,167 passengers and was the 26th busiest airport in Europe in terms of passengers and 2nd busiest airport in Italy in terms of passengers.", "Until 2008, Malpensa Airport was a major hub for flag carrier Alitalia.", "Malpensa Airport remains the second-busiest Italian airport for international passenger traffic (after Rome Fiumicino Airport), and the busiest for freight and cargo, handling over 500,000 tons of international freight annually.", "The first industrial airport was opened in 1909 near the Cascina Malpensa, an old farm, by Giovanni Agusta and Gianni Caproni to test their aircraft prototypes.", "This airport was then opened for civil operation in 1948 during the war reconstruction period, in order to serve the northern area of Milan.", "The site of today's Malpensa Airport has seen aviation activities for more than 100 years." ], [ "Leonardo da Vinci\u2013Fiumicino Airport", "Leonardo da Vinci\u2013Fiumicino Airport\n\nRome\u2013Fiumicino International Airport \"Leonardo da Vinci\" () , is an international airport in Rome and the major airport in Italy.", "It is one of the busiest airports in Europe by passenger traffic with 41.7 million passengers served in 2016.", "It is located in Fiumicino, west of Rome's historic city centre.", "The airport serves as the main hub for Alitalia, the largest Italian airline and Vueling, a Spanish low-cost carrier owned by International Airlines Group.", "Based on total passenger numbers, it is the eighth-busiest airport in Europe and was the world's 47th-busiest airport in 2017.", "It covers an area of and is named after polymath Leonardo da Vinci who, in 1480, designed a flying machine with wings and the first proto helicopter.", "The airport was officially opened on 15 January 1961, with two runways, replacing the smaller Rome Ciampino Airport, which remains in service for some low-cost airlines as well as domestic and charter operations.", "Despite being officially opened in 1961, Leonardo da Vinci\u2013Fiumicino Airport had actually been in use since 20 August 1960.", "This was to help relieve air traffic that was congesting Rome Ciampino Airport during the 1960 Summer Olympics." ], [ "Venice Marco Polo Airport", "Venice Marco Polo Airport\n\nVenice Marco Polo Airport is the international airport of Venice, Italy.", "It is located on the mainland north of the city in Tessera, a \"Frazione\" of the Comune of Venice nearest to Mestre.", "Due to the importance of Venice as a leisure destination, it features flights to many European metropolitan areas as well as some partly seasonal long-haul routes to the United States, Canada and the Middle East.", "The airport handled 10.371.380 passengers in 2017, making it the fourth busiest airport in Italy.", "The airport is named after Marco Polo and serves as a base for Volotea and easyJet.", "Another airport located in the Venice area, Treviso Airport, is sometimes unofficially labelled as \"Venice - Treviso\" and mostly serves low-cost airlines, mainly Ryanair and Wizz Air.", "A modern terminal was opened in 2002, but it is already at full capacity.", "The airport is managed by SAVE S.p.A., a company partially owned by local authorities that also controls the smaller Treviso Airport, dedicated mainly to low-cost carriers.", "The airport was named after the Venetian traveller Marco Polo, whose travelogue introduced Central Asia and China to Europeans.", "The airport terminal has three floors: the ground floor for arrivals and the second floor for departures." ] ], "gold": "In Italy, Air Canada flies to three airports. Air Canada flies to Leonardo da Vinci\u2013Fiumicino Airport, an international airport in Rome and the major airport in Italy. Additionally, Air Canada flies to Venice Marco Polo Airport, the international airport of Venice, Italy, that is located on the mainland near the village of Tessera. Air Canada also flies to Milan\u2013Malpensa Airport, the largest international airport in the Milan metropolitan area in northern Italy. ", "prediction 1": "Air Canada operates non-stop flights to several airports in Italy, including Milan Malpensa Airport, Rome Fiumicino Airport, Venice Marco Polo Airport, as well as Treviso Airport. The two main Italian airports that air Canada operates to in Italy are Milan Malpensa Airport and Venice Marco Polo Airport.", "prediction 2": "Italy has several international airports that fly to Canada, including Milan Malpensa Airport, Rome-Fiumicino International Airport, Venice Marco Polo Airport, and Naples Marco Polo Airport. Air Canada has flights to many European cities, as well as some partly seasonal long-haul routes to the United States, Canada and the Middle East.", "prediction 3": "Milan Malpensa Airport is the largest international airport in the Milan metropolitan area in northern Italy. Air Canada operates flights to Milan Malpensa Airport, Rome\u2013Fiumicino Airport, Venice Marco Polo Airport, and Treviso Airport. During the summer months, the airline flies to several European destinations and also flies to Venice, Venice Marco Polo Airport, Rome-Fiumicino Airport, and Rome-Milan Malpensa Airport. Air Canada also offers flights to Rome-Venice Marco Polo Airport, Milan Malpensa, Rome, Venice, Venice, Venice Marco Polo Airport, Italy.", "prediction 4": "The international airports that Air Canada flies to in Italy are Milan Malpensa Airport, Leonardo da Vinci Airport, Venice Marco Polo Airport and Milan Malpensa Airport. Air Canada has flights to Milan Malpensa, Milan Fiumicino, Rome Lucca and Milan Malpensa Airport.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Air Canada operates non-stop flights to several airports in Italy, including Milan Malpensa Airport, Rome Fiumicino Airport, Venice Marco Polo Airport, ", "start": 180, "end": 304 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 39 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 179 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several airports in Italy. Milan Malpensa Airport is the largest international airport in the Milan metropolitan area in northern Italy. Leonardo da Vinci\u2013Rome Fiumicino Airport is an international airport in Rome and the major airport in Italy. Venice Marco Polo Airport is the international airport of Venice, located on the mainland north of the city in Tessera. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who played dr zeus in planet of the apes?", "passages": [ [ "Planet of the Apes (1968 film)", "Planet of the Apes (1968 film)\n\nPlanet of the Apes is a 1968 American science fiction film directed by Franklin J. Schaffner.", "It stars Charlton Heston, Roddy McDowall, Kim Hunter, Maurice Evans, James Whitmore, James Daly and Linda Harrison.", "The screenplay by Michael Wilson and Rod Serling was loosely based on the 1963 French novel \"La Plan\u00e8te des Singes\" by Pierre Boulle.", "Jerry Goldsmith composed the groundbreaking avant-garde score.", "It was the first in a series of five films made between 1968 and 1973, all produced by Arthur P. Jacobs and released by 20th Century Fox.", "The film tells the story of an astronaut crew who crash-lands on a strange planet in the distant future.", "Although the planet appears desolate at first, the surviving crew members stumble upon a society in which apes have evolved into creatures with human-like intelligence and speech.", "The apes have assumed the role of the dominant species and humans are mute creatures wearing animal skins.", "The script was originally written by Rod Serling, but underwent many rewrites before filming eventually began.", "Directors J. Lee Thompson and Blake Edwards were approached, but the film's producer Arthur P. Jacobs, upon the recommendation of Charlton Heston, chose Franklin J. Schaffner to direct the film." ], [ "Planet of the Apes (TV series)", "Planet of the Apes (TV series)\n\nPlanet of the Apes is an American science fiction television series that aired on CBS in 1974.", "The series stars Roddy McDowall, Ron Harper, James Naughton, Mark Lenard and Booth Colman.", "It is based on the 1968 \"Planet of the Apes\" film and its sequels, which were inspired by the novel \"Planet of the Apes\" by Pierre Boulle.", "The series begins with the crash of an Earth spaceship that encountered a time warp while approaching Alpha Centauri on August 19, 1980.", "The spaceship is manned by three astronauts, one of whom has died in the crash.", "The other two astronauts, Colonel Alan Virdon and Major Peter J. Burke, are unconscious but are rescued by a human who carries them to an old bomb shelter.", "After the human opens a book containing historical text and pictures of Earth circa 2500, the two astronauts are convinced that they are indeed on a future Earth.", "The crash is also witnessed by a young chimpanzee who tells his father, a village official who alerts the authorities.", "Ape counselor Zaius (an analog of the character from the original movie), notes that another such incident occurred ten years earlier.", "He orders the head gorilla, Security Chief Urko, to find the humans and bring them back alive." ] ], "gold": "Dr. Zaius is a character from the film Planet of the Apes. Planet of the Apes is a 1968 American science fiction film loosely based on the 1963 French novel La Plan\u00e8te des Singes by Pierre Boulle, it was remade in 2001, as well as made into a television series. In the 1968 film, Maurice Evans plays Dr. Zaius, in the 2001 film, the character was played by Charleton Heston, and in the television series, Zaius was played by Booth Colman.", "prediction 1": "Planet of the Apes is a 1968 American science fiction film directed by Franklin J. Schaffner. It stars Charlton Heston, Roddy McDowall, Kim Hunter, Maurice Evans, James Whitmore, James Daly and Linda Harrison. Zaius is a character who is played by Booth Colman in the 1974 television series Planet of the Apes.", "prediction 2": "In the 1968 American science fiction film Planet of the Apes, the character of Dr. Zeus is played by Maurice Evans. In the 1974 American science fiction television series Planet of the Apes, the character of Dr. Zeus is played by Booth Colman.", "prediction 3": "Planet of the Apes is a 1968 American science fiction film directed by Franklin J. Schaffner. In the 1968 film, Charlton Heston plays Dr. Zaius. In the 1974 television series, Planet of the Apes, Booth Colman plays Dr. Zeus.", "prediction 4": "In the 1968 film Planet of the Apes, dr. Zaius is played by Charlton Heston. In the 1974 television series Planet of the Apes, dr. Zaius is played by Booth Colman.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 209 }, { "error type": "Unverifiable", "explanation": "", "start": 231, "end": 247 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 272 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Planet of the Apes is a 1968 American science fiction film loosely based on the 1963 French novel \"La Plan\u00e8te des Singes\" by Pierre Boulle. It stars Charlton Heston. Zaius is a character and Booth Colman is an actor in the television series Planet of the Apes." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is the sinai peninsula on a map?", "passages": [ [ "Sinai Peninsula", "Sinai Peninsula\n\nThe Sinai Peninsula or simply Sinai (now usually ) is a peninsula in Egypt, and the only part of the country located in Asia.", "It is situated between the Mediterranean Sea to the north and the Red Sea to the south, and is a land bridge between Asia and Africa.", "Sinai has a land area of about and a population of approximately 1,400,000 people.", "Administratively, the Sinai Peninsula is divided into two governorates: the South Sinai Governorate and the North Sinai Governorate.", "Three other governorates span the Suez Canal, crossing into African Egypt: Suez Governorate on the southern end of the Suez Canal, Ismailia Governorate in the center, and Port Said Governorate in the north.", "The Sinai Peninsula has been a part of Egypt from the First Dynasty of ancient Egypt ( BC).", "This comes in stark contrast to the region north of it, the Levant (present-day territories of Syria, Lebanon, Jordan, Israel and Palestine), which, due largely to its strategic geopolitical location and cultural convergences, has historically been the center of conflict between Egypt and various states of Mesopotamia and Asia Minor.", "In periods of foreign occupation, the Sinai was, like the rest of Egypt, also occupied and controlled by foreign empires, in more recent history the Ottoman Empire (1517\u20131867) and the United Kingdom (1882\u20131956)." ], [ "Sinai Peninsula", "In addition to its formal name, Egyptians also refer to it as \"\" ( 'the land of turquoise').", "The ancient Egyptians called it \"Ta Mefkat\", or 'land of turquoise'.", "In English, the name is now usually pronounced .", "The traditional pronunciation is or .", "Sinai is triangular in shape, with northern shore lying on the southern Mediterranean Sea, and southwest and southeast shores on Gulf of Suez and Gulf of Aqaba of the Red Sea.", "It is linked to the African continent by the Isthmus of Suez, wide strip of land, containing the Suez Canal.", "The eastern isthmus, linking it to the Asian mainland, is around wide.", "The peninsula's eastern shore separates the Arabian plate from the African plate.", "The southernmost tip is the Ras Muhammad National Park.", "Most of the Sinai Peninsula is divided among the two governorates of Egypt: South Sinai (Ganub Sina) and North Sinai (Shamal Sina).", "Together, they comprise around 60,000 square kilometres (23,000 sq mi) and have a population (January 2013) of 597,000.", "Three more governates span the Suez Canal, crossing into African Egypt: Suez (el-Sewais) is on the southern end of the Suez Canal, Ismailia (el-Isma'ileyyah) in the centre, and Port Said in the north." ] ], "gold": "The Sinai Peninsula or simply Sinai is a peninsula in Egypt. It is the only part of the country located in Asia. It is situated between the Mediterranean Sea to the north and the Red Sea to the south. The peninsula serves as a land bridge between Asia and Africa. The Sinai Peninsula is triangular in shape, with its northern shore lying on the southern Mediterranean Sea. The peninsula's southwest and southeast shores lie on the Gulf of Suez and the Gulf of Aqaba of the Red Sea. The Sinai Peninsula is linked to the African continent by the Isthmus of Suez.", "prediction 1": "The Sinai Peninsula is a peninsula in Egypt, and the only part of the country located in Asia. It is situated between the Mediterranean Sea to the north and the Red Sea to the south, and is a land bridge between Asia and Africa. The peninsula has a land area of about and a population of approximately 1,400,000 people. Geographically, the Sinai peninsula is divided into two governorates: the South Sinai Governorate and the North Sinai Governorate. Three more governorates span the Suez Canal, crossing into African Egypt: Suez Governorate on the southern end of the Suez Canal, Ismailia Governorate in the center, and Port Said Governorate in the north.", "prediction 2": "The Sinai Peninsula, officially the Sinai Peninsula, is located in Egypt. It is situated between the Mediterranean Sea to the north and the Red Sea to the south, making it one of the only parts of Egypt located in Asia. Geographically, this peninsula is divided into two governorates: the South Sinai Governorate and the North Sinai Governorate, with three more governorates that span the Suez Canal, crossing into African Egypt. The Sinai Peninsula is linked to the African continent by the Isthmus of Suez, wide strip of land, containing the Suez Canal.", "prediction 3": "The Sinai Peninsula is a peninsula in Egypt and the only part of the country located in Asia. It is situated between the Mediterranean Sea to the north and the Red Sea to the south, and is a land bridge between Asia and Africa. Geographically, the Sinai Peninsula is divided into two governorates: the South Sinai Governorate and the North Sinai Governorate. Three more governorates span the Suez Canal, crossing into African Egypt: Suez Governorate on the southern end of the Suez Canal, Ismailia Governorate in the center, and Port Said Governorate in the north.", "prediction 4": "The Sinai Peninsula is a peninsula in Egypt that is situated between the Red Sea and the Mediterranean Sea. It has a land area of about 400,000 square kilometers and a population of approximately 1,400,000 people.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 319 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 656 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Sinai Peninsula is a peninsula in Egypt, and the only part of the country located in Asia. It is situated between the Mediterranean Sea to the north and the Red Sea to the south, and is a land bridge between Asia and Africa. Sinai is triangular in shape, with northern shore lying on the southern Mediterranean Sea, and southwest and southeast shores on Gulf of Suez and Gulf of Aqaba of the Red Sea. It is linked to the African continent by the Isthmus of Suez, wide strip of land, containing the Suez Canal." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When was the palace of fine arts built?", "passages": [ [ "Palace of Fine Arts", "Palace of Fine Arts\n\nThe Palace of Fine Arts in the Marina District of San Francisco, California, is a monumental structure originally constructed for the 1915 Panama-Pacific Exposition in order to exhibit works of art presented there.", "One of only a few surviving structures from the Exposition, it is still situated on its original site.", "It was rebuilt in 1965, and renovation of the lagoon, walkways, and a seismic retrofit were completed in early 2009.", "In addition to hosting art exhibitions, it remains a popular attraction for tourists and locals and is a favorite location for weddings and wedding party photographs for couples throughout the San Francisco Bay Area and such an icon that a miniature replica of it was built in Disney's California Adventure in Anaheim.", "The Palace of Fine Arts was one of ten palaces at the heart of the Panama-Pacific Exhibition, which also included the exhibit palaces of Education, Liberal Arts, Manufactures, Varied Industries, Agriculture, Food Products, Transportation, Mines and Metallurgy and the Palace of Machinery.", "The Palace of Fine Arts was designed by Bernard Maybeck, who took his inspiration from Roman and Ancient Greek architecture in designing what was essentially a fictional ruin from another time.", "While most of the exposition was demolished when the exposition ended, the Palace was so beloved that a Palace Preservation League, founded by Phoebe Apperson Hearst, was founded while the fair was still in progress." ], [ "Palacio de Bellas Artes", "Adamo Boari promised in October 1904 to build a grand metallic structure, which at that time only existed in the United States, but not to this size.", "The first stone of the building was placed by Porfirio D\u00edaz in 1904.", "Despite the 1910 deadline, by 1913, the building was hardly begun with only a basic shell.", "One reason for this is that the project became more complicated than anticipated as the heavy building sank into the soft spongy subsoil.", "The other reason was the political and economic instability that would lead to the Mexican Revolution.", "Full hostilities suspended construction of the palace completely and Adamo Boari returned to Italy.", "The project would sit unfinished for about twenty years.", "In 1932, construction resumed under Mexican architect Federico Mariscal.", "Mariscal completed the interior but updated it from Boari's plans to the more modern Art Deco style.", "The building was completely finished in 1934, and was inaugurated on 29 September of that year.", "The inaugural work presented in the theatre was \"La Verdad Sospechosa\" by Juan Ruiz de Alarc\u00f3n in 1934.", "In 1946, the Instituto Nacional de Bellas Artes (National Institute of the Fine Arts) was created as a government agency to promote the arts and was initially housed at the Museo Nacional de Artes Pl\u00e1sticas, the Museo del Libro and other places." ] ], "gold": "There are multiple Palaces of Fine Arts. The Palace of Fine Arts in San Francisco was originally built in 1915. It had to be rebuilt in 1965, and in 2009, it was renovated to include a lagoon, walkways, and a seismic retrofit. The Palacio de Bellas Artes, or Palace of Fine Arts, broke ground in Mexico on 1 Oct 1904 and was completed in 1934.", "prediction 1": "The Palace of Fine Arts in the Marina District of San Francisco, California, is a monumental structure originally constructed for the 1915 Panama-Pacific Exposition in order to exhibit works of art presented there. One of only a few surviving structures from the Exposition, it is still situated on its original site. It was rebuilt in 1965, and renovation of the lagoon, walkways, and a seismic retrofit were completed in early 2009. While most of the exposition was demolished when the exposition ended, the Palace was so beloved that a Palace Preservation League, founded while the exposition was still in progress.", "prediction 2": "The Palace of Fine Arts was originally constructed for the 1915 Panama-Pacific Exposition in order to exhibit works of art presented there. One of only a few surviving structures from the Exposition, it is still situated on its original site. It was rebuilt in 1965, and renovation of the lagoon, walkways, and a seismic retrofit were completed in early 2009.", "prediction 3": "The Palace of Fine Arts, located in the Marina District of San Francisco, California, is a monumental structure originally constructed for the 1915 Panama-Pacific Exposition in order to exhibit works of art presented there. In addition to hosting art exhibitions, it remains a popular attraction for tourists and locals and is a favorite location for weddings and wedding party photographs for couples throughout the San Francisco Bay Area. The building was completely finished in 1934, and was inaugurated on 29 September of that year.", "prediction 4": "The Palace of Fine Arts is a monumental structure originally constructed for the 1915 Panama-Pacific Exposition in order to exhibit works of art presented there. The building was started in 1904 and was completed in 1913, by which time it was hardly begun with only a basic shell. Construction was resumed in 1932, and was finished in 1934, and it was inaugurated on 29 September of that year. The structure was rebuilt in 1965, and renovation of the lagoon, walkways, and a seismic retrofit were completed in early 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 435, "end": 618 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Palace of Fine Arts in the Marina District of San Francisco, California, is a monumental structure originally constructed for the 1915. It was rebuilt in 1965, and renovation of the lagoon, walkways, and a seismic retrofit were completed in early 2009. The construction of the Palacio de Bellas Artes began in 1904 and was completely finished in 1934." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who is the current steel minister of india?", "passages": [ [ "Minister of Steel (India)", "Minister of Steel (India)\n\nThe Minister of Steel is the head of the Ministry of Steel and one of the cabinet ministers of the Government of India.", "He is assisted by a Secretary to the Government of India, an Additional Secretary and Financial Adviser to Government of India, 4 Joint Secretaries, a Chief Controller of Accounts also looking after the accounting matters of the Ministry, one Economic Adviser of the rank of Joint Secretary, 6 Directors, 2 Deputy Secretaries, 12 Under Secretaries, One Deputy Director, other Officers and supporting staff and a Technical Wing under the charge of an Industrial Adviser to Government of India.", "The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar." ], [ "Ministry of Steel", "Ministry of Steel\n\nThe Ministry of Steel, a branch of Government of India, is the apex body for formulating all policies regarding steel production, distribution and pricing in India.", "As of June 2014, the ministry is headed by a minister of cabinet rank, Chaudhary Birender Singh and is assisted by a Minister of State, Vishnu Deo Sai.", "The members of the Steel Consumers Council are nominated by the Minister of Steel & Mines.", "The tenure of the council was initially fixed for two years, and it was re-constituted on 25 February 2010.", "The term of the present council is up to 29 February 2012." ], [ "Beni Prasad Verma", "Beni Prasad Verma\n\nBeni Prasad Verma (born 11 February 1941) is an Indian politician and presently a member of the Samajwadi Party.", "Earlier he was with Samajwadi Party of Mulayam Singh Yadav, before leaving to join the Indian National Congress.", "Barabanki, Uttar Pradesh into a kurmi family.", "Beni Prasad Verma was steel Minister of Indian Government.", "He was the Public Works Department minister for the State of Uttar Pradesh in India for several years.", "He served as the Union Communications Minister in Deve Gowda's cabinet from 1996-98.", "He was re-elected to the Lok Sabha in 1998, 1999 and 2004 from the same constituency.", "In 2009, he was re-elected to the Lok Sabha from Gonda constituency in Uttar Pradesh state as an Indian National Congress candidate and on July-12-2011 was appointed the Steel Minister in Manmohan Singh Government.", "In 2016, he rejoined the Samajwadi Party.", "Beni Prasad Verma has established educational institutions Chaudhary charan Singh Mahavidyalay at Bardari near Badosarai and Mahanlal Verma Educational Educational Institute in his home district of Barabanki." ] ], "gold": "The Minister of Steel is the head of the Ministry of Steel and one of the cabinet ministers of the Government of India. Beni Prasad Verma took office as the Minister of Steel in 2011. He was replaced in 2014 by Narendra Singh Tomar. Then, in 2016, Chaudhary Birender Singh Dumerkhan took over the office.", "prediction 1": "The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar. The Ministry of Steel, a branch of Government of India, is the apex body for formulating all policies regarding steel production, distribution and pricing in India. Beni Prasad Verma was the steel minister of Indian Government. Beni Prasad Verma was the former steel minister of Indian Government.", "prediction 2": "The Minister of Steel is the head of the Ministry of Steel and one of the cabinet ministers of the Government of India. The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar. Beni Prasad Verma was the former steel minister of the Indian Government. He was re-elected to the Lok Sabha on July 12, 2011 as an Indian National Congress candidate and on July-12-2011 was appointed the Steel Minister in Manmohan Singh Government.", "prediction 3": "The current Hon'ble Minister of Steel, is Shri Narendra Singh Tomar. The previous Hon'ble Minister of Steel was Beni Prasad Verma.", "prediction 4": "The Minister of Steel is the head of the Ministry of Steel and one of the cabinet ministers of the Government of India. The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar. The previous Hon'ble Minister of Steel was Beni Prasad Verma who served from 1996-98 to 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 232 }, { "error type": "Redundant", "explanation": "The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar. The Ministry of Steel, a branch of Government of India, is the apex body for formulating all policies regarding steel production, distribution and pricing in India. Beni Prasad Verma was the steel minister of Indian Government. ", "start": 296, "end": 365 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The current Hon'ble Minister of Steel is Shri Narendra Singh Tomar. The Ministry of Steel, a branch of Government of India, in 2014 was Chaudhary Birender Singh, and in 2011 Beni Prasad Verma." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the movie the terminal based on?", "passages": [ [ "The Terminal", "Viktor arrives in New York at the hotel where Benny Golson is performing and finally collects the last autograph.", "Then he gets in a taxi, telling the driver, \"I am going home.\"", "Some have noted that the film appears to be inspired by the story of Mehran Karimi Nasseri, an Iranian refugee who lived in Terminal One of the Charles de Gaulle airport, Paris from 1988 when his refugee papers were stolen until 2006 when he was hospitalized for unspecified ailments.", "In September 2003, \"The New York Times\" noted that Spielberg bought the rights to Nasseri's life story as the basis for the film; and in September 2004 \"The Guardian\" noted Nasseri received thousands of dollars from the filmmakers.", "However, none of the studio's publicity materials mention Nasseri's story as an inspiration for the film.", "The 1993 French film \"Lost in Transit\" was already based on the same story.", "In deciding to make the film, Steven Spielberg stated that after directing \"Catch Me If You Can\", \"I wanted to do another movie that could make us laugh and cry and feel good about the world...", "This is a time when we need to smile more and Hollywood movies are supposed to do that for people in difficult times.\"" ], [ "Terminal (2018 film)", "Terminal (2018 film)\n\nTerminal is a 2018 neo-noir thriller film written and directed by Vaughn Stein.", "The film stars Margot Robbie alongside an ensemble cast, featuring Simon Pegg, Dexter Fletcher, Max Irons, and Mike Myers.", "The plot follows the intertwining lives of two assassins, a fatally-ill teacher, a janitor and a waitress, all of whom become part of an evil mastermind's murderous plan.", "The film is an international co-production between Ireland, the United Kingdom, Hungary, Hong Kong and the United States.", "Principal photography took place in Budapest, Hungary during May 2016.", "\"Terminal\" was released in the United States on 11 May 2018, by RLJE Films.", "The film premiered in the United Kingdom on 26 June 2018 at the Edinburgh International Film Festival as part of the American Dreams Strand.", "It was released theatrically in the United Kingdom and Ireland on 6 July 2018 by Arrow Films.", "The film received generally negative reviews from critics, who criticised the plot, narrative, pacing and direction, though many praised Robbie's performance and the visual style.", "Annie meets Mr. Franklyn in a confession booth, and tells him that she wants to become his sole hitman.", "She describes how she will eliminate the other hitmen he uses to prove that she can do the job." ], [ "The Terminal", "The Terminal\n\nThe Terminal is a 2004 American comedy-drama film co-produced and directed by Steven Spielberg and starring Tom Hanks, Catherine Zeta-Jones, and Stanley Tucci.", "The film is about an Eastern European man who becomes stuck in New York's John F. Kennedy Airport terminal when he is denied entry into the United States and at the same time cannot return to his native country because of a military coup.", "The film is partially inspired by the 18-year stay of Mehran Karimi Nasseri in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988 to 2006.", "After finishing his previous film, \"Catch Me If You Can\", Spielberg decided to direct \"The Terminal\" because he wanted to make another film \"that could make us laugh and cry and feel good about the world\".", "Due to a lack of suitable airports willing to provide their facilities for the production, an entire working set was built inside a large hangar at the LA/Palmdale Regional Airport, while most of the film's exterior shots were from the Montr\u00e9al\u2013Mirabel International Airport.", "The film was released in North America on June 18, 2004 to general acclaim and commercial success, earning $77.9 million in domestic grosses and $219.4 million worldwide." ] ], "gold": "The 2018 neo-noir thriller film Terminal is written and directed by Vaughn Stein, and stars Margot Robbie alongside Simon Pegg, Dexter Fletcher, Max Irons, and Mike Myers. The plot follows the intertwining lives of two assassins, a fatally ill teacher, a janitor, and a waitress, all of whom become part of an evil mastermind's murderous plan. The 2004 film The Terminal is an American comedy-drama film produced and directed by Steven Spielberg and starring Tom Hanks, Catherine Zeta-Jones, and Stanley Tucci. The film is about an Eastern European man who is stuck in New York's John F. Kennedy Airport terminal when he is denied entry to the United States and at the same time is unable to return to his native country because of a military coup, which is a plot that is partially inspired by the true story of the 18-year stay of Mehran Karimi Nasseri in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988 to 2006. ", "prediction 1": "The 2004 American comedy-drama film The Terminal is partially inspired by the 18-year stay of Mehran Karimi Nasseri in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988 to 2006. Some have noted that the film appears to be inspired by the story of Mehran Karimi Nasseri, an Iranian refugee who lived in Terminal One of the Charles de Gaulle airport, Paris from 1988 when his refugee papers were stolen until 2006 when he was hospitalized for unspecified ailments.\n", "prediction 2": "The 2004 American comedy-drama film The Terminal is partially inspired by the 18-year stay of Mehran Karimi Nasseri in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988 to 2006. There has been no other film based on this life story. The 2018 thriller called Terminal stars Margot Robbie and is a co-production between Ireland, the United Kingdom, Hungary, Hong Kong and the United States.", "prediction 3": "There's more than one movie named \"The Terminal\", partially inspired by Mehran Karimi Nasseri's stay in the Paris-Charles de Gaulle Airport terminal from 1988 to 2006. Some have noted that the film appears to be inspired by the story of Mehran Karimi Nasseri, an Iranian refugee who lived in Terminal One of the Charles de Gaulle airport, Paris from 1988 when his refugee papers were stolen until 2006. The 2004 American comedy-drama film is partially inspired by the 18-year stay of Mehran Karimi Nasseri in Terminal one of the Paris-Charles de Gaulle airport, Paris-Charles de Gaulle Airport terminal from 1988 to 2006. Some have noted that the film appears to be inspired by the story of Mehran Karimi Nasseri.", "prediction 4": "There is more than one film called The Terminal. In 2004, Steven Spielberg directed a comedy-drama about a man who becomes stuck in New York's John F. Kennedy Airport terminal when he is denied entry into the United States and at the same time cannot return to his native country because of a military coup. Tom Hanks starred in The Terminal, and Catherine Zeta-Jones and Stanley Tucci starred as well. In 2018, Vaughn Stein wrote and directed a neo-noir thriller directed by Vaughn Stein that was partially inspired by Mehran Karimi Nasseri, an Iranian refugee who lived in terminal One of the Charles de Gaulle airport, Paris, from 1988 when his refugee papers were stolen until 2006 when he was hospitalized for unspecified ailments.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Terminal is partially inspired by the 18-year stay of Mehran Karimi Nasseri ", "start": 193, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 303 }, { "error type": "Redundant", "explanation": "in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988", "start": 304, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 415 }, { "error type": "Redundant", "explanation": "to 2006", "start": 416, "end": 426 }, { "error type": "Irrelevant", "explanation": "", "start": 427, "end": 478 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2004 American comedy-drama film The Terminal is partially inspired by the 18-year stay of Mehran Karimi Nasseri in Terminal 1 of Paris-Charles de Gaulle Airport, France, from 1988 to 2006. The film, co-produced and directed by Steven Spielberg and starring Tom Hanks, Catherine Zeta-Jones, and Stanley Tucci, is about an Eastern European man who becomes stuck in New York's John F. Kennedy Airport terminal when he is denied entry into the United States and at the same time cannot return to his native country because of a military coup. Terminal (2018 film) Terminal is a 2018 neo-noir thriller film written and directed by Vaughn Stein. The film stars Margot Robbie alongside an ensemble cast, featuring Simon Pegg, Dexter Fletcher, Max Irons, and Mike Myers. The plot follows the intertwining lives of two assassins, a fatally-ill teacher, a janitor and a waitress, all of whom become part of an evil mastermind's murderous plan." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Most consecutive t20 series win by a team?", "passages": [ [ "Twenty20", "Twenty20\n\nTwenty20 cricket, sometimes written Twenty-20, and often abbreviated to T20, is a short form of cricket.", "At the professional level, it was originally introduced by the England and Wales Cricket Board (ECB) in 2003 for the inter-county competition in England and Wales.", "In a Twenty20 game the two teams have a single innings each, which is restricted to a maximum of 20 overs.", "Together with first-class and List A cricket, Twenty20 is one of the three current forms of cricket recognised by the International Cricket Council (ICC) as being at the highest international or domestic level.", "A typical Twenty20 game is completed in about three hours, with each innings lasting around 90 minutes and an official 10 minute break between the innings.", "This is much shorter than previously-existing forms of the game, and is closer to the timespan of other popular team sports.", "It was introduced to create a fast-paced form of the game which would be attractive to spectators at the ground and viewers on television.", "The game has succeeded in spreading around the cricket world.", "On most international tours there is at least one Twenty20 match and all Test-playing nations have a domestic cup competition.", "The inaugural ICC World Twenty20 was played in South Africa in 2007 with India winning by five runs against Pakistan in the final.", "Pakistan won the second tournament in 2009, and England won the title in the West Indies 2010." ], [ "Australia national cricket team record by opponent", ", Australia have played 106 T20I matches and won 56 of them.", "47 were lost, 2 tied and 1 had no result.", "The winning percentage is only 54.28.", "During 5 ICC World Twenty20 tournaments, Australia's best performance came during 2010, where they lost the final to England, became runner-up.", ", Australia have faced nine of the eleven other teams in Test cricket, with their most frequent opponent being The Ashes rivals, England; playing 346 matches against them.", "Due to more matches against England, they have registered more wins against England, but the best winning percentage of 100 against Zimbabwe, having won all three Tests.", "In ODI matches, Australia have played against 18 teams; they have played against England most frequently, with a winning percentage of 56.94 in 147 matches.", "Against the other nations with Test status, Australia has the best record against Ireland and Afghanistan having never lost in a ODI match against them.", "They have also never lost an ODI match against a non-Test playing nation.", "The team have competed against 10 countries in T20Is, and have played 17 matches against South Africa.", "Out of that, Australia have defeated South Africa on 11 occasions." ], [ "2012 ICC World Twenty20", "2012 ICC World Twenty20\n\nThe 2012 ICC World", "Twenty20 was the fourth ICC World Twenty20 competition, an international Twenty20 cricket tournament that took place in Sri Lanka from 18 September to 7 October 2012 which was won by the West Indies.", "The schedule has been posted by International Cricket Council (ICC).", "This is the first World Twenty20 tournament held in an Asian country, the last three having been held in South Africa, England and the West Indies.", "Sri Lankan pacer Lasith Malinga has been chosen as the event ambassador of the tournament by ICC.", "The format has four groups of three teams in a preliminary round.", "India and England are in the same group and were joined by the runner up of the ICC World Twenty20 Qualifier, Afghanistan.", "The champions of the ICC World Twenty20 Qualifier, Ireland, are in a group with West Indies and Australia.", "Sri Lanka, South Africa and Zimbabwe, and Pakistan, New Zealand and Bangladesh are the other two groups.", "Match fixtures were announced on 21 September 2011 by ICC.", "On the same date, the ICC also unveiled the logo of the tournament, named \"Modern Spin\".", "The 2012 World Twenty20 is the fourth edition of the Twenty20 tournament.", "The first was hosted by South Africa in 2007, where India beat Pakistan in a thriller to become Twenty20 champions.", "Pakistan, the losing finalists in 2007, defeated Sri Lanka in 2009 tournament to become World T20 Champions, held in England." ] ], "gold": "Twenty20 is a form of cricket in which each team faces a maximum of twenty overs. It was introduced to create a fast-paced game that would be attractive to spectators at the ground and viewers on television. The nation with the current most consecutive wins in this format is Afghanistan, with a total of 12 victories on a row.", "prediction 1": "In professional cricket, Twenty20 cricket is a short form of the game and is sometimes written Twenty-20, and often abbreviated to T20. England and Wales Cricket Board (ECB) introduced it in 2003 for the inter-county competition in England and Wales. In 10 ICC World Twenty20 competitions, South Africa has won a total of 4 series. In 2012, India won a total of 5 series, with Pakistan winning the title in both 2009 and 2010.", "prediction 2": "Twenty20 cricket is a short form of cricket. It was introduced by the England and Wales Cricket Board (ECB) in 2003 for the inter-county competition in England and Wales. India won the most consecutive Twenty20 series in the history of the game, with five wins. Pakistan won the second and third consecutive T20I series, with two wins and a draw.", "prediction 3": "In the professional level, Twenty20 cricket is a short form of cricket. An Indian team has won the most consecutive T20 series (seven matches) in a row. The most consecutive defeats in a row by a team is in 2007 against Pakistan. During the 5 ICC World Twenty20 tournaments, Australia's best performance came during 2010, where they lost the final to England, becoming runner-up.", "prediction 4": "Twenty20 cricket, sometimes written Twenty-20, and often abbreviated to T20, is a short form of cricket. At the professional level, it was originally introduced by the England and Wales Cricket Board (ECB) in 2003 for the inter-county competition in England and Wales. Australia have played 106 T20I matches and won 56 of them. 47 were lost, 2 tied and 1 had no result. The winning percentage is only 54.28.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 331 }, { "error type": "Irrelevant", "explanation": "", "start": 332, "end": 426 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In professional cricket, Twenty20 cricket is a short form of the game. Australia have played 106 T20I matches and won 56 of them." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What is juliet's baby's name on nashville?", "passages": [ [ "Juliette Barnes", "Juliette Barnes\n\nJuliette Jolene Barnes-Barkley is a fictional character and one of the two leads in the ABC/CMT musical drama series \"Nashville\".", "Juliette is portrayed by actress Hayden Panettiere since the pilot episode, which aired on October 10, 2012.", "Juliette was a teenage country sensation and is now making more mature music.", "She tries to take the throne, as Queen of Country music, from rival Rayna Jaymes.", "Panettiere has received critical acclaim for her performance as Juliette and she has been nominated for a Golden Globe Award for Best Supporting Actress \u2013 Television Series Drama in 2013 and 2014, a Satellite Award for Best Actress \u2013 Television Series Drama in 2012 and a Critics' Choice Television Award for Best Supporting Actress in a Drama Series in 2016.", "The casting of Hayden Panettiere as Juliette Barnes was announced on February 29, 2012.", "Juliette was characterized as an up-and-coming country-pop diva and rival of series co-lead Rayna Jaymes, a fading country star played by Connie Britton.", "Although best known as an actress, Panettiere had a brief music career, recording songs for several films between 2004 and 2007 and planning to release an album.", "Though she co-wrote and recorded some songs for it, it was never completed or released.", "She later explained: \"I quit after about four or five years of recording, and I said this is not me." ], [ "Juliette Barnes", "Darius pushes Juliette to grow and has her do humanity projects.", "Everyone in Juliette's life tries to tell her they are worried about her and she is changing, but she doesn't believe them.", "She says she wants to be a new person.", "It is eventually revealed that Jolene had men pay her to rape Juliette.", "After this, she doesn't want to be with Avery anymore.", "Darius tells Juliette the next step in their movement and his cult is outreach in Bolivia, to which Juliette ditches her family for.", "Avery tries to get her to come back but she refuses and says she's not herself anymore and loves it and does not care about him or Cadence.", "Avery eventually decides later on that his relationship is over with Juliette.", "Juliette eventually comes back home when she finds the conditions bad and realizes who the cult is, motivated by a pregnancy revelation.", "She ends up quitting the music business and moves to a farm to raise Cadence, but promises Avery", "she's not running away.", "She hides the pregnancy from him for a few weeks after she tells him she loves him but she wants him to really want to be with her for the rest of their lives, not influenced by their new baby.", "A flash forward shows a visibly pregnant Juliette playing with Cadence, and Avery coming back to them, wanting to be with Juliette for the rest of their lives." ], [ "Bella Swan", "On their honeymoon, she becomes pregnant by Edward and, due to the peculiar nature of her baby, Bella nearly dies giving birth to their daughter, Renesmee Cullen.", "Edward turns Bella into a vampire to save her life.", "The premise for both the Bella Swan character and the \"Twilight\" series originated in a dream Stephenie Meyer had in which an \"average girl\" and a \"fantastically beautiful, sparkly ... vampire ... were having an intense conversation in a meadow in the woods.\"", "In this dream, the pair \"were discussing the difficulties inherent in the facts that ...", "they were falling in love with each other while ... the vampire was particularly attracted to the scent of her blood, and was having a difficult time restraining himself from killing her.\"", "Meyer's original characters were unnamed; she took to calling the characters, who would later become Edward Cullen and Bella, 'he' and 'she' for the purpose of convenience as she, \"didn't want to lose the dream.\"", "The name 'Isabella' was decided upon, Meyer explains, because \"after spending so much time with [the character], I loved her like a daughter. ...", "Inspired by that love, I gave her the name I was saving for my daughter... Isabella.\"" ] ], "gold": "Juliette Jolene Barnes-Barkley is a fictional character from musical drama series Nashville. Portrayed by actress Hayden Panettiere, Juliette is a teenage country sensation that tries to take the throne, as Queen of Country music, from rival Rayna Jaymes. During the span of the show, she has a baby named Cadence Barkley, with a second and visible pregnancy of an unnamed baby being shown in a flash forward at the end of the series.", "prediction 1": "On the television show NASHVILLE, Juliette plays the lead character, a teenage country music sensation who is now making more mature music. The character's baby's name on the show is Isabella.", "prediction 2": "Juliette Barnes is a fictional character and one of the two leads in the ABC/CMT musical drama series Nashville. On the show, she is played by actress Hayden Panettiere. Her baby girl's name is Isabella.", "prediction 3": "On the show Nashville, Juliette Barnes is portrayed by Hayden Panettiere. The character is best known as a country music diva. The name of her baby on the show was Isabella, but that name was changed to Juliette when the baby was born on the show.", "prediction 4": "Juliette Jolene Barnes-Barkley is a fictional character and one of the two leads in the ABC/CMT musical drama series Nashville. Her baby's name on Nashville is Renesmee Cullen. In the original series, the character was named Bella Swan, but the baby's real name was Isabella.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 13 ] } ], "corrected-prediction": "Juliette Jolene Barnes-Barkley is a fictional character from musical drama series Nashville. Portrayed by actress Hayden Panettiere, Juliette is a teenage country sensation that tries to take the throne, as Queen of Country music, from rival Rayna Jaymes. she has a baby named Cadence Barkley, with a second and visible pregnancy of an unnamed baby being shown in a flash forward at the end of the series. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "In which countries would you most likely see a blue jay?", "passages": [ [ "Blue jay", "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas.", "The western edge of the range stops where the arid pine forest and scrub habitat of the closely related Steller's jay (\"C. stelleri\") begins.", "Recently, the range of the blue jay has extended northwestwards so that it is now a rare but regularly seen winter visitor along the northern US and southern Canadian Pacific Coast.", "As the two species' ranges now overlap, \"C. cristata\" may sometimes hybridize with Steller's jay.", "The increase in trees throughout the Great Plains during the past century due to fire suppression and tree planting facilitated the western range expansion of the blue jay as well as range expansions of many other species of birds.", "The northernmost subspecies \"C. c. bromia\" is migratory, subject to necessity.", "It may withdraw several hundred kilometres south in the northernmost parts of its range.", "Thousands of blue jays have been observed to migrate in flocks along the Great Lakes and Atlantic coasts.", "It migrates during the daytime, in loose flocks of 5 to 250 birds.", "Much about their migratory behavior remains a mystery.", "Some are present throughout winter in all parts of their range.", "Young jays may be more likely to migrate than adults, but many adults also migrate." ] ], "gold": "The blue jay occurs from southern Canada, including the southern areas of provinces from Alberta eastward to Quebec and throughout the Atlantic provinces, and throughout the eastern and central United States south to Florida and northeastern Texas. This is where you are most likely to see a blue jay.", "prediction 1": "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas. The western edge of the range stops where the arid pine forest and scrub habitat of the closely related Steller's jay begins. Recently, the range of the blue jay has extended northwestwards so that it is now a rare but regularly seen winter visitor along the northern US and southern Canadian Pacific Coast.", "prediction 2": "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas. The western edge of the range stops where the arid pine forest and scrub habitat of the closely related Steller's jay (\"C. stelleri\") begins. Recently, the range of the blue jay has extended northwestwards so that it is now a rare but regularly seen winter visitor along the northern US and southern Canadian Pacific Coast.", "prediction 3": "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas. Recenty, the range of the blue jay has extended northwestwards so that it is now a rare but regularly seen winter visitor along the northern US and southern Canadian Pacific Coast.", "prediction 4": "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas. The western edge of the range stops where the arid pine forest and scrub habitat of the closely related Steller's jay (\"C. stelleri\") begins. The increase in trees throughout the Great Plains during the past century due to fire suppression and tree planting facilitated the western range expansion of the blue jay as well as range expansions of many other species of birds.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 435 } ], "missing-info": [], "corrected-prediction": "The blue jay occurs from southern Canada through the eastern and central United States south to Florida and northeastern Texas. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who does chef's voice in south park?", "passages": [ [ "South Park controversies", "One scene retold the story of Xenu, a story Scientology normally attempts to keep confidential and only reveals to members once they make significant monetary contributions to the church.", "The show's closing credits billed every member of the episode's cast and crew as \"John Smith\" and \"Jane Smith\" in a parody of both Cruise and the church's reputations for litigiousness.", "On March 13, 2006, nearly two months after suffering a stroke, Isaac Hayes, the voice of the character Chef, quit \"South Park\".", "A press release cited his objections to the show's attitudes toward and depiction of various religions.", "While the press release did not specifically mention \"Trapped in the Closet,\" Parker and Stone assert that he quit because of the episode and its treatment of Scientology, as Hayes was a member.", "Stone commented that Hayes practiced a double standard regarding the treatment of religion on \"South Park\": \"[We] never heard a peep out of Isaac in any way until we [lampooned] Scientology.", "He wants a different standard for religions other than his own, and to me, that is where intolerance and bigotry begin\".", "Fox News suggested that, because he was still suffering from the effects of his stroke, Hayes was hospitalized and not in a position to make a rational decision to leave the show." ], [ "Chef (South Park)", "He falls to a violent death, culminating with his mutilation at the hands of a grizzly bear and a mountain lion and finally discharged fecal matter (a reference to the episode \"Something Wall-Mart This Way Comes\", in which Cartman claims that the relaxation of the bowel muscles confirms that a person is really dead).", "South Park holds a memorial service for him (Canadian comedians Terrance and Phillip even attend, despite having never met the man themselves), in which Kyle gives a eulogy stating, \"We shouldn't be mad at Chef for leaving us, we should be mad at that fruity little club for scrambling his brains\", a deliberate parallel with Hayes' departure from the show in favor of Scientology.", "Mimicking a scene from the finale of \"\", Chef's body is secretly collected by the Super Adventure Club, who managed to revive him as a cyborg \u2014 identified on the show's official website as \"Darth Chef\" (a parody of\" Star Wars' \"Darth Vader).", "He is fitted with a suit and mask like those of Vader, except with the helmet taking on the appearance of Chef's trademark hat, and wields a red, glowing spatula, parodying Vader's red lightsaber." ] ], "gold": "Isaac Hayes is the chef's original voice actor for the show South Park. Peter Serafinowicz was the voice of Darth Chef, a parody of Star Wars' Darth Vader, when they were mimicking a scene from the finale of Star Wars: Episode III \u2013 Revenge of the Sith.", "prediction 1": "Chef is the character on South Park and his voice is sung by Isaac Hayes. Hayes was the voice of Chef in the episode \"Trapped in the Closet\" in Season 2 and for Season 3 the voice of Chef is sung by Michael Moore. On March 13, 2006, nearly two months after suffering a stroke, Hayes, the voice of Chef, quit \"South Park\".", "prediction 2": "Isaac Hayes, who voices Chef on South Park, did not return to the role until March 6, 2006, nearly two months after suffering a stroke.", "prediction 3": "Isaac Hayes, the voice of Chef in South Park, took over as the voice of Chef in the episode \"Trapped in the Closet\" on March 13, 2006.", "prediction 4": "Chef is voiced by Isaac Hayes on South Park. Hayes was originally the voice of Chef in Season 1 and 2 of South Park. Hayes quit the show after suffering a stroke on March 13, 2006.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 74, "end": 213 }, { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 321 } ], "missing-info": [], "corrected-prediction": "Chef is the character on South Park and his voice is sung by Isaac Hayes. " }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "The portion of the uterine endometrium that is shed every month is the?", "passages": [ [ "Menstrual cycle", "The sudden change in hormones at the time of ovulation sometimes also causes light mid-cycle blood flow.", "The luteal phase is the final phase of the ovarian cycle and it corresponds to the secretory phase of the uterine cycle.", "During the luteal phase, the pituitary hormones FSH and LH cause the remaining parts of the dominant follicle to transform into the corpus luteum, which produces progesterone.", "The increased progesterone in the adrenals starts to induce the production of estrogen.", "The hormones produced by the corpus luteum also suppress production of the FSH and LH that the corpus luteum needs to maintain itself.", "Consequently, the level of FSH and LH fall quickly over time, and the corpus luteum subsequently atrophies.", "Falling levels of progesterone trigger menstruation and the beginning of the next cycle.", "From the time of ovulation until progesterone withdrawal has caused menstruation to begin, the process typically takes about two weeks, with 14 days considered normal.", "For an individual woman, the follicular phase often varies in length from cycle to cycle; by contrast, the length of her luteal phase will be fairly consistent from cycle to cycle." ] ], "gold": "During menstruation, the functional layer, adjacent to the uterine cavity, thickens and is later shed. The layer is then built up after the end of menstruation and in the course of the first part of the previous menstrual cycle.", "prediction 1": "The part of the endometrium that is shed every month is the corpus luteum, and the amount that is shed each month is the luteal phase.", "prediction 2": "The corpus luteum is the portion of the uterine endometrium that is shed every month. The corpus luteum is the final phase of the ovarian cycle and corresponds to the secretory phase of the uterine cycle.", "prediction 3": "The corpus luteum, the remaining part of the dominant follicle, is the uterine endometrium that is shed every month. The secretory phase of the uterine cycle is known as the luteal phase.", "prediction 4": "The corpus luteum is the portion of the uterine endometrium that is shed every month. The luteal phase is the final phase of the ovarian cycle and corresponds to the secretory phase of the uterine cycle.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 134 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who developed the modern model of the solar nebular disk instability model?", "passages": [ [ "Nebular hypothesis", "In 1978 Andrew Prentice resurrected the initial Laplacian ideas about planet formation and developed the \"modern Laplacian theory\".", "None of these attempts proved completely successful, and many of the proposed theories were descriptive.", "The birth of the modern widely accepted theory of planetary formation\u2014the solar nebular disk model (SNDM)\u2014can be traced to the Soviet astronomer Victor Safronov.", "His 1969 book \"Evolution of the protoplanetary cloud and formation of the Earth and the planets\", which was translated to English in 1972, had a long-lasting effect on the way scientists think about the formation of the planets.", "In this book almost all major problems of the planetary formation process were formulated and some of them solved.", "Safronov's ideas were further developed in the works of George Wetherill, who discovered \"runaway accretion\".", "While originally applied only to the Solar System, the SNDM was subsequently thought by theorists to be at work throughout the Universe; as of astronomers have discovered extrasolar planets in our galaxy.", "The star formation process naturally results in the appearance of accretion disks around young stellar objects.", "At the age of about 1\u00a0million years, 100% of stars may have such disks.", "This conclusion is supported by the discovery of the gaseous and dusty disks around protostars and T Tauri stars as well as by theoretical considerations." ], [ "Chamberlin\u2013Moulton planetesimal hypothesis", "Chamberlin\u2013Moulton planetesimal hypothesis\n\nThe Chamberlin\u2013Moulton planetesimal hypothesis was proposed in 1905 by geologist Thomas Chrowder Chamberlin and astronomer Forest Ray Moulton to describe the formation of the solar system.", "It was proposed as a replacement for the Laplacian version of the nebular hypothesis that had prevailed since the 19th century.", "The theory was based on the idea that a star passed close enough to the sun early in its life to cause tidal bulges to form on its surface, which along with the internal process that leads to solar prominences, caused material to be ejected repeatedly from the sun.", "Due to the gravitational effects of the passing star, two spiral-like arms would have extended from the sun, and while most of the material would have fallen back, part of it would remain in orbit.", "This orbiting material would cool and condense into numerous small bodies that they termed planetesimals and a few larger protoplanets.", "Their theory proposed that as these objects collided over time, the planets and their moons were built up, with comets and asteroids being the leftover debris.", "The \"spiral nebulae\" photographed at Lick Observatory were thought to possibly be views of other suns undergoing this process.", "These nebulae are now known to be galaxies rather than developing solar systems." ] ], "gold": "Soviet astronomer Victor Safronov is credited with the creation of the widely-accepted modern theory of planetary formation known as the solar nebular disk model, or SNDM. Though Safronov published his work in 1969, the precursor to his model was developed in 1905 with the planetismal hypothesis of the formation of the Solar System proposed by geologist Thomas Chrowder Chamberlin and astronomer Forest Ray Moulton.", "prediction 1": "The solar nebular disk instability model, or SNDM, was developed by astronomer Victor Safronov and is based on the idea that a star passed close enough to the sun early in its life to cause tidal bulges to form on its surface. This bulge formation process, along with the internal process that leads to solar prominences, caused material to be ejected repeatedly from the sun. Safronov's ideas were further developed in the works of George Wetherill, who discovered runaway accretion. While originally applied only to the Solar System, the SNDM was subsequently thought by theorists to be at work throughout the Universe.", "prediction 2": "The birth of the modern widely accepted theory of planetary formation, the solar nebular disk model (SNDM), can be traced to the Soviet astronomer Victor Safronov. Safronov's ideas were further developed in the works of George Wetherill, who discovered \"runaway accretion\". While originally applied only to the Solar System, the modern model of the solar nebular disk instability model was subsequently thought by theorists to be at work throughout the Universe.", "prediction 3": "The solar nebular disk instability model, or SNDM, is a theory of planet formation that was developed by Victor Safronov, a Soviet astronomer, in 1969. The modern widely accepted theory of planet formation can be traced to Andrew Prentice, who developed the \"modern Laplacian theory\".", "prediction 4": "The modern widely accepted theory of planetary formation, the solar nebular disk instability model, can be traced to the Soviet astronomer Victor Safronov. Victor Safronov's 1969 book Evolution of the protoplanetary cloud and formation of the Earth and the planets, translated to English in 1972, had a long-lasting effect on the way scientists think about the formation of the planets. The Chamberlin\u2013Moulton planetesimal hypothesis was proposed in 1905 by geologist Thomas Chrowder Chamberlin and astronomer Forest Ray Moulton to describe the formation of the solar system. The SNDM was based on the idea that a star passed close enough to the Sun early in its life to cause material to be ejected repeatedly from the Sun.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 376 }, { "error type": "Irrelevant", "explanation": "", "start": 377, "end": 484 }, { "error type": "Irrelevant", "explanation": "", "start": 485, "end": 621 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The birth of the modern widely accepted theory of planetary formation\u2014the solar nebular disk model (SNDM)\u2014can be traced to the Soviet astronomer Victor Safronov. Though Safronov published his work in 1969, the precursor to his model was developed in 1905 with the planetismal hypothesis of the formation of the Solar System proposed by geologist Thomas Chrowder Chamberlin and astronomer Forest Ray Moulton. the Universe." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who raps in the beginning of the get down?", "passages": [ [ "Nas", "In October 2013, Nas confirmed that a rumored song \"Sinatra in the Sands\" featuring Jay-Z, Justin Timberlake, and Timbaland would be featured on the album.", "On April 16, 2014, on the twentieth anniversary of \"Illmatic\", the documentary \"\" was premiered which recounted circumstances leading up to Nas's debut album.", "It was reported on September 10, that Nas has finished his last album with Def Jam.", "On October 30, Nas released a song which might have been the first single on his new album, titled \"The Season\", produced by J Dilla.", "Nas has also collaborated with the Australian hip-hop group, Bliss n Eso, in 2014.", "They released the track \"I Am Somebody\" in May 2014.", "Nas was featured on the song \"We Are\" from Justin Bieber's fourth studio album, \"Purpose\", released in November 2015.", "Nas was announced as one of the executive producers of the Netflix original series, \"The Get Down\", prior to its release in August 2016.", "He narrated the series and rapped as adult Ezekiel of 1996.", "He also appeared on DJ Khaled's album \"Major Key\", on a track simply titled \"Nas Album Done\", suggesting an upcoming album was not only completed, but also was imminent." ], [ "The Get Down", "The Get Down\n\nThe Get Down is an American musical drama television series created by Baz Luhrmann and Stephen Adly Guirgis.", "It originally aired on Netflix on August 12, 2016, and ran for one season.", "Produced by Sony Pictures Television, the series is set in the South Bronx region of New York City in the late 1970s; its title refers to parts of disco and R&B records that could be repeated using multiple turntables and were enjoyed most by dancers.", "A five-episode second part concluding the series was released on April 7, 2017.", "On May 24, 2017, Netflix announced that the series is concluded after part 2 and that there would be no more parts.", "The series is set in the 1970s in the Bronx, New York City, and follows the rise of hip-hop and disco music through the eyes of a group of teenagers.", "Each episode begins with MC Books, a famous artist that raps his story to a large crowd during a concert in 1996.", "The short rap serves both as a recap of previous episodes and as a setup of the events of the next.", "Each episode is also intercut with real footage and newscasts from the 1970s.", "Part 1 begins in 1977 with Zeke (young MC Books), a young poet who lives with his aunt Wanda following the death of his parents, meeting Shaolin Fantastic, a graffiti artist and aspiring DJ." ], [ "Get Down (Nas song)", "Get Down (Nas song)\n\n\"Get Down\" is the third and final single released from Nas' 2002 album \"God's Son\".", "It features descriptive storytelling by Nas and funk-based production by Nas and Salaam Remi.", "In addition to elements of Funky Drummer, the track samples \"The Boss\" by James Brown which was previously made famous by the West Coast rapper Ice-T on his 1990 single \"You Played Yourself\"; the same sample was used in Poor Righteous Teachers' song \"Word from the Wise\" and Lord Finesse's \"Bad Mutha\".", "It was not as popular as Nas' previous two singles from \"God's Son\", but still reached #76 on the Hot R&B/Hip-Hop Singles & Tracks chart." ] ], "gold": "The 2016 musical drama show The Get Down is rap-narrated by Daveed Diggs, though Diggs's rapping voice is dubbed by Nas, artist of the similarly-titled 2002 song Get Down.", "prediction 1": "The Get Down is an American musical drama television series created by Baz Luhrmann and Stephen Adly Guirgis. Each episode begins with MC Books, a famous artist that raps his story to a large crowd during a concert in 1996. The short rap serves both as a recap of previous episodes and as a setup of the events of the next.", "prediction 2": "The Get Down is an American musical drama television series created by Baz Luhrmann and Stephen Adly Guirgis. In the first episode of the series, MC Books, a famous artist that raps his story to a large crowd during a concert in 1996, begins rapping.", "prediction 3": "The Get Down is an American musical drama television series that follows the rise of hip-hop and disco music through the eyes of a group of teenagers. The episodes begin with MC Books, a famous artist that raps his story to a large crowd during a concert in 1996. The short rap serves both as a recap of previous episodes and as a setup of the events to come.", "prediction 4": "The Get Down is an American musical drama television series created by Baz Luhrmann and Stephen Adly Guirgis, set in the 1970s in the Bronx, New York City, and follows the rise of hip-hop and disco music through the eyes of a group of teenagers. In episode 1, MC Books, a famous artist that raps his story to a large crowd during a concert in 1996, is shown rapping at the beginning of the episode.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 323 } ], "missing-info": [], "corrected-prediction": "The Get Down is an American musical drama television series created by Baz Luhrmann and Stephen Adly Guirgis. Each episode begins with MC Books, a famous artist that raps his story to a large crowd during a concert in 1996. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most career nba triple doubles?", "passages": [ [ "Double (basketball)", "Double (basketball)\n\nIn basketball, a double is the accumulation of a double-digit number total in one of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game.", "Multiple players usually score double-digit points in any given basketball game; the double nomenclature is usually reserved for when a player has double-digit totals in more than one category.", "A double-double is the accumulation of a double-digit number total in two of the statistical five categories in a game.", "The most common double-double combination is points-rebounds, followed by points-assists.", "Since the season, Tim Duncan leads the National Basketball Association (NBA) in the points-rebounds combination with 840, and John Stockton leads the points-assists combination with 714.", "A triple-double is the accumulation of a double-digit number total in three of the five categories in a game.", "The most common way to achieve a triple-double is through points, rebounds, and assists.", "Oscar Robertson leads the all-time NBA list with 181 career triple-doubles and is, with Russell Westbrook, one of only two players ever to average a triple-double for a season.", "Westbrook currently holds the record for most triple-doubles in a season with 42 and is the only person to average a triple-double for two consecutive seasons." ], [ "Double (basketball)", "Some sources claim that it was coined by former Los Angeles Lakers public relations director Bruce Jolesch in the 1980s in order to showcase Magic Johnson's versatility, while others claim that it was coined by then Philadelphia 76ers media relations director Harvey Pollack in 1980.", "The triple-double became an officially recorded statistic during the .", "There has been occasional controversy surrounding triple-doubles made when a player achieves the feat with a late rebound.", "Players with nine rebounds in a game have sometimes been accused of deliberately missing a shot late in the game in order to recover the rebound; a few have even gone so far as shooting off their opponent's basket trying to score a triple-double.", "To deter this, NBA rules allow rebounds to be nullified if the shot is determined not to be a legitimate scoring attempt.", "From the to the , the NBA averaged 34.5 triple-doubles per season, roughly 1 in every 36 games.", "From the to the , the NBA saw a dramatic increase in the number of triple-doubles, with an average of 57.33 triple-doubles per season, roughly 1 in every 22 games.", "Russell Westbrook was responsible for 74 of the triple-doubles during that span, or 21.5% of the 344 total triple-doubles." ], [ "Magic Johnson", "Magic Johnson\n\nEarvin \"Magic\" Johnson Jr. (born August 14, 1959) is an American retired professional basketball player and current president of basketball operations of the Los Angeles Lakers of the National Basketball Association (NBA).", "He played point guard for the Lakers for 13 seasons.", "After winning championships in high school and college, Johnson was selected first overall in the 1979 NBA draft by the Lakers.", "He won a championship and an NBA Finals Most Valuable Player Award in his rookie season, and won four more championships with the Lakers during the 1980s.", "Johnson retired abruptly in 1991 after announcing that he had contracted HIV, but returned to play in the 1992 All-Star Game, winning the All-Star MVP Award.", "After protests from his fellow players, he retired again for four years, but returned in 1996, at age 36, to play 32\u00a0games for the Lakers before retiring for the third and final time.", "Johnson's career achievements include three NBA MVP Awards, nine NBA Finals appearances, twelve All-Star games, and ten All-NBA First and Second Team nominations.", "He led the league in regular-season assists four times, and is the NBA's all-time leader in average assists per game, at 11.2.", "Johnson was a member of the 1992 United States men's Olympic basketball team (\"The Dream Team\"), which won the Olympic gold medal in 1992." ] ], "gold": "Oscar Robertson, who played for the Cincinnati Royals and the Milwaukee Bucks, has the most career NBA triple-doubles in the regular season with 181. This record is even more astonishing if it is taken into account that the three-point shot did not exist when Robertson played. Magic Johnson, former Los Angeles Laker, holds the record for the most triple-doubles in the postseason. ", "prediction 1": "The NBA has a number of different statistics associated with triple-doubles. The most career double-doubles is the accumulation of a double-digit number total in one of five statistical categories in a game. The most career triple-doubles are the accumulation of a double-digit number total in two of the statistical five categories in a game. The most common way to achieve a triple-double is through points, rebounds, and assists. The most career triple-doubles are the accumulation of a double-digit number total in three of the five statistical categories in a game. The most career triple-doubles is the accumulation of a double-digit number total in three of the statistical categories in one or more than one statistical categories. A triple-double is the accumulation of a double-digit number total in one of points, rebounds, assists, and the record for most triple-doubles in a season.", "prediction 2": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories in a game. Oscar Robertson leads the all-time NBA list with 181 career triple doubles, while John Stockton holds the record for most triple doubles in a season with 720. Russell Westbrook holds the record for most triple doubles in a season with 42, and is the only person to average a triple-double for two consecutive seasons.", "prediction 3": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories, typically points, rebounds, assists, steals, and blocked shots, in a game. Oscar Robertson leads the all-time NBA list with 181 career triple-doubles. Russell Westbrook currently holds the record for most triple-doubles in a season with 42 and is the only person to average a triple-double for two consecutive seasons.", "prediction 4": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game. In the NBA, a double-double is the accumulation of a double-digit number total in two of the statistical five categories in a game. Oscar Robertson leads the all-time list with 181 career triple-doubles, while John Stockton holds the record for most triple-doubles in a season. Russell Westbrook currently holds the record for the most triple-doubles in a season with 42, and is the only person to average a triple-double for two consecutive seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 207 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 294, "end": 297 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 343 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 432 }, { "error type": "Redundant", "explanation": "The most career triple-doubles are the accumulation of a double-digit number total in two of the statistical five categories in a game.", "start": 449, "end": 570 }, { "error type": "Redundant", "explanation": "The most career triple-doubles are the accumulation of a double-digit number total in three of the five statistical categories in a game.", "start": 605, "end": 739 }, { "error type": "Redundant", "explanation": " The most career triple-doubles are the accumulation of a double-digit number total in two of the statistical five categories in a game. ", "start": 740, "end": 806 }, { "error type": "Redundant", "explanation": " The most common way to achieve a triple-double is through points, rebounds, and assists.", "start": 810, "end": 843 }, { "error type": "Incoherent", "explanation": "", "start": 852, "end": 895 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 76 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Oscar Robertson leads the all-time NBA list with 181 career triple-doubles." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "What country flag is white with red cross?", "passages": [ [ "Flag of England", "The flag used by the British Royal Navy (the White Ensign) is also based on the flag of England, consisting of the St George's Cross and a Union Flag in the canton.", "In addition to the United Kingdom, several countries in the Commonwealth of Nations also have variants of the White Ensign with their own national flags in the canton, with the St George's Cross sometimes being replaced by a naval badge.", "Churches belonging to the Church of England (unless for special reasons another flag is flown by custom) may fly St George's Cross.", "The correct way (since an order from the Earl Marshal in 1938) is for the church to fly the St George's cross, with the arms of the diocese in the left-hand upper corner of the flag.", "The flag is also seen during other sporting events in which England competes, for example during England Cricket matches (the Cricket World Cup and The Ashes), during Rugby Union matches and in football.", "It is also used in icons on the Internet and on the TV screen to represent teams and players from England.", "Before 1996, most of the flags waved by supporters were Union Flags.", "It is now observed that most are England flags.", "In a sporting context, the flag is often seen being waved by supporters with the unofficial addition of the word 'England' across its horizontal bar." ], [ "Flag of England", "Flag of England\n\nThe flag of England is derived from Saint George's Cross (heraldic blazon: \"Argent, a cross gules\").", "The association of the red cross as an emblem of England can be traced back to the Middle Ages, and it was used as a component in the design of the Union Flag in 1606.", "Since the 1990s it has been in increasingly wide use, particularly at national sporting events.", "In 1188 Henry II of England and Philip II of France agreed to go on a crusade, and that Henry would use a white cross and Philip a red cross.", "13th-century authorities are unanimous on the point that the English king adopted the white cross, and the French king the red one (and not vice versa as suggested by later use).", "It is not clear at what point the English exchanged the white cross for the red-on-white one.", "There was a historiographical tradition claiming that Richard the Lionheart himself adopted both the flag and the patron saint from Genoa at some point during his crusade.", "This idea can be traced to the Victorian era, Perrin (1922) refers to it as a \"common belief\", and it is still popularly repeated today even though it cannot be substantiated as historical." ], [ "Flag of Georgia (country)", "It was adopted in the early 2000s by the main opposition party, the United National Movement led by Mikheil Saakashvili, as a symbol of popular resistance to Shevardnadze's rule.", "The flag was adopted by Parliament on 14 January 2004.", "Saakashvili formally endorsed it via Presidential Decree No. 31 signed on 25 January, following his election as President.", "14 January is annually marked as a Flag Day in Georgia.", "The national flag of Georgia, as described in the decree:\n\nThe Georgian national flag is a white rectangle, with in its central portion a large red cross touching all four sides of the flag.", "In the four corners there are four \"bolnur-katskhuri\" crosses (Also refer as Georgian Crosses aside with Grapevine cross) of the same colour (as the large cross).", "The first Georgian flag design came about during the era of the early Georgian state, the Principality of Iberia which had a red cross against a white background, similar to the flag of England).", "The subsequent Principality of Tao-Klarjeti, shared this same flag.", "The flag of the Kingdom of Abkhazia had 4 green strips in a dextral position on the right side, while the left side contained the cross seen on the current Georgian flag." ] ], "gold": "The flag of England is white with a red cross. The flag of England is derived from Saint George's Cross. The association of the red cross as an emblem of England can be traced back to the Late Middle Ages. Similar to the flag of England, the first flag design for the country of Georgia, which came about during the era of the early Georgian state, featured a red cross against a white background. Today, the national flag for the country of Georgia is a white rectangle with a large red cross in its central portion touching all four sides of the flag. In the four corners there are four bolnur-katskhuri crosses of the same color as the large cross.", "prediction 1": "The flag of England is derived from Saint George's Cross, and the association of the red cross as an emblem of England can be traced back to the Middle Ages, and it was used as a component in the design of the Union Flag in 1606. It can also be seen during other sporting events in which England competes, for example during England Cricket matches and at The Ashes, during Rugby Union matches and in football. The flag of Georgia is white with a red cross touching all four sides of the flag.", "prediction 2": "The flag of England is derived from Saint George's Cross, which is the emblem of England. The flag of Georgia is white with a red cross in the center. The flag of Georgia was adopted in the early 2000s by the main opposition party, the United National Movement led by Mikheil Saakashvili, as a symbol of popular resistance to Shevardnadze's rule. The flag of Abkhazia is white with a red cross in the center.", "prediction 3": "The flag of England is derived from the cross of St. George, which was used as an emblem of England in the Middle Ages. The flag of Georgia is white with a red cross in its central portion, similar to the flag of England.", "prediction 4": "The flag of England is derived from Saint George's Cross. The association of the red cross as an emblem of England can be traced back to the Middle Ages, and it was used as a component in the design of the Union Flag in 1606. The flag of Georgia is white with a red cross in the central portion. The flag of Abkhazia is red with a white cross in the central portion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 410 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The flag of England is derived from Saint George's Cross, and the association of the red cross as an emblem of England can be traced back to the Middle Ages. The Georgian national flag is a white rectangle, with in its central portion a large red cross touching all four sides of the flag. In the four corners there are four \"bolnur-katskhuri\" crosses of the same colour as the large cross." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the 6th generation ipod come out?", "passages": [ [ "IPod Classic", "Gapless playback and support for iPod games was enabled on all fifth-generation iPods through a firmware update released at the same time.", "During a special iPod-centric event on September 5, 2007, Steve Jobs introduced the sixth-generation iPod and the suffix \"classic\".", "Featuring slightly thinner bodies, the sixth-generation iPod also had dramatically improved battery life, claiming up to 36 hours of music playback and 6 hours of video playback.", "The iPod Classic has a 2.5\" backlit display at a resolution of 320\u00d7240.", "The front plate of the iPod is now made of anodized aluminium instead of polycarbonate plastic, and \"Signature iPod White\" has been replaced by silver.", "This marks the first time white is not available as a color option for an iPod.", "The sixth-generation iPod also introduced a completely overhauled user interface, incorporating more graphics and Cover Flow.", "The iPod Classic was offered in an 80GB model for MSRP US$249 and a 160GB model for MSRP US$349.", "During the 'Let's Rock' Apple Event on September 9, 2008, the 80GB and the thicker 160GB model were discontinued in favor of a thin 120GB version retailing for US$249." ], [ "IPod Classic", "It introduced Genius and audio recording capabilities which are also available in other iPod models released at similar times; no firmware update provides either feature to the first-generation iPods.", "Also, the black model's faceplate was replaced with a gray colored faceplate, while retaining the silver backing and the black Click Wheel.", "Prior to the 'It's Only Rock and Roll' event on September 9, 2009, the price of the 120GB version was dropped to US$229.", "During the event, Apple replaced the 120GB version with an 160GB model, featuring the same slim profile which retailed at US$249.", "U2 Special Editions\nThere are four different U2 Special Edition iPod models, each with widely differing capabilities.", "However, each of the U2 models -- the iPod U2 (4th Gen), iPod U2 (Color), iPod U2 (5th Gen/Video), and iPod U2 (5th Gen Enhanced) -- are the same internally as the \"standard\" iPod model available at the time, and the U2 models vary only in case design and cost." ], [ "IPod Nano", "Just like the fourth-generation iPod Nano, Product Red and the yellow Nano were only available on the Apple Online Store and Apple Retail Store.", "This generation was discontinued on September 1, 2010.", "At a media event on September 1, 2010, Apple announced the sixth generation iPod Nano, which, among many new features, was designed around a high resolution square touch-screen.", "The device featured a small 1.55\u00a0inch multi-touch screen with a lower resolution of 240\u00d7240 pixels but a higher pixel density of 220 pixels per inch, as opposed to the larger 2.2\u00a0inch screen on the fifth-generation iPod Nano.", "The device had a 0.39 watt-hour battery rated at 3.7 volts, giving a capacity of 105 mAh, and specified to give 24 hours of music playback on a single full charge.", "The device takes about three hours for one full charge.", "The device retained the same 30-pin dock connector as previous generations.", "This Nano lost the previous generation's video camera, built-in voice recorder microphone (although plugging in headphones with a built in microphone revealed a Voice Memos app) and built-in speaker, and games." ] ], "gold": "During a special iPod-centric event on September 5, 2007, Steve Jobs introduced the sixth-generation iPod and the suffix classic. Featuring slightly thinner bodies, the sixth-generation iPod also had dramatically improved battery life, claiming up to 36 hours of music playback and 6 hours of video playback. The next year, during the Let's Rock Apple Event on September 9, 2008, the 80GB and the thicker 160GB model of the sixth-generation iPod were discontinued in favor of a thin 120GB version retailing for $249. This version introduced Genius and audio recording capabilities. The following year, prior to the It's Only Rock and Roll event on September 9, 2009, the price of the 120GB version was dropped to $229. During this event, Apple replaced the 120GB version with a 160GB model, featuring the same slim profile of the 80GB and 120GB models. It retailed for $249. The next year, at a media event on September 1, 2010, Apple announced the sixth generation iPod Nano, which, among many new features, was designed around a high-resolution square touchscreen. Additionally, the sixth-generation iPod Touch, a multipurpose handheld device designed and marketed by Apple with a touchscreen-based user interface, was the successor to the iPod Touch fifth generation. This sixth-generation iPod Touch became the first major update to the iPod lineup in more than two and a half years. It was released in the online Apple Store on July 15, 2015.", "prediction 1": "The sixth-generation iPod was introduced on September 5, 2007 at an iPod-centric event. At a media event on September 1, 2010, Apple announced the sixth-generation iPod Nano. The device featured a small 1.55 inch multi-touch screen with a lower resolution of 240240 pixels but a higher pixel density of 220 pixels per inch, as opposed to the larger 2.2 inch screen on the fifth-generation iPod Nano.", "prediction 2": "The sixth-generation iPod came out on September 5, 2007, along with the suffix \"classic\" and a completely revamped user interface with more graphics and Cover Flow. During a special iPod-centric event on September 5, 2007, Steve Jobs introduced the sixth-generation iPod and the suffix \"classic\". At a media event on September 1, 2010, Apple announced the sixth generation iPod Nano, which, among many new features, was designed around a high resolution square touch-screen and featured a small 1.55 inch multi-touch screen with a lower resolution of 240240 pixels but a higher pixel density of 220 pixels per inch, as opposed to the larger 2.2 inch screen of the larger 2.2 inch screen on the previous generation's larger 2.2 inch resolution of 240240240 pixels per inch.", "prediction 3": "On September 5, 2007, Steve Jobs introduced the sixth-generation iPod and the suffix \"classic\". In addition, the sixth-generation iPod introduced a completely overhauled user interface, incorporating more graphics and Cover Flow.", "prediction 4": "The sixth-generation iPod was announced during a special iPod-centric event on September 5, 2007 by Steve Jobs. The sixth-generation iPod had dramatically improved battery life, claiming up to 36 hours of music playback and 6 hours of video playback. At a media event on September 1, 2010, Apple announced the sixth generation iPod Nano, which, among many new features, was designed around a high resolution square touch-screen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 399 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The sixth-generation iPod and the suffix \"classic\" were introduced by Steve Jobs on September 5, 2007 at an iPod-centric event. Featuring slightly thinner bodies, the sixth-generation iPod also had dramatically improved battery life, claiming up to 36 hours of music playback and 6 hours of video playback. During the 'It's Only Rock and Roll' event on September 9, 2009, the price of the 120GB version was dropped to US$229 and Apple replaced the 120GB version with an 160GB model, featuring the same slim profile which retailed at US$249. This version introduced Genius and audio recording capabilities. At a media event on September 1, 2010, Apple announced the sixth-generation iPod Nano, which, among many new features, was designed around a high resolution square touch-screen." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When does the sims 4 get to work come out?", "passages": [ [ "The Sims 4", "The Sims 4\n\nThe Sims 4 is the fourth major title in the life simulation video game series \"The Sims\".", "Developed by The Sims Studio and published by Electronic Arts, \"The Sims 4\" was originally announced on May 6, 2013, and was released in North America on September 2, 2014 for Microsoft Windows.", "A Mac compatible version of the game was made available for digital download on February 17, 2015.", "\"The Sims 4\" is the first PC game to top all-format charts in two years.", "The game has received mixed reviews since its release, with the majority of criticism directed towards its lack of content.", "Since its launch, it became the best selling PC game of 2014 and 2015.", "As of June 2018, \"The Sims 4\" has sold over 10 Million copies worldwide.", "To date EA has released six expansion packs.", "The most recent is , which was released on November 16, 2018.", "There have also been several \"game packs\" released, including \"Parenthood\" which allows the players to shape the characters' children and teenagers as they go through life, as well as free updates that include major changes such as the addition of a toddler life stage that was previously non-existent.", "\"The Sims 4\" is a life simulation game, similar to its predecessors.", "Players create a Sim character and control their life to explore different personalities which change the way the game plays out." ], [ "The Sims 4: Get to Work", "The Sims 4: Get to Work\n\nThe Sims 4: Get to Work or Get to Work is the first expansion pack for the strategic life simulation computer game \"The Sims 4\".", "It was announced on February 4, 2015 and was released in North America on March 31, 2015.", "It includes four new active careers; Detective, Doctor, Scientist and retail business.", "The game also features a new neighborhood called Magnolia Promenade where you can go shopping.", "It takes elements from \"\" and \"\".", "Get to Work image color is Golden Orange.", "The expansion pack features songs re-recorded in the fictional Simlish language, including:\n\n\"The Sims 4: Get to Work\" received a score of 73% from the aggregator \"Metacritic\" based on 24 reviews.", "\"GameZone\"'s Matt Liebl called \"The Sims 4: Get to Work\" \"a decent expansion that adds new, unique experiences to The Sims 4's gameplay\".", "Digital Spy's Mark Langshaw criticized the Detective career, calling it \"limited and repetitive\", however he praised the other two careers." ] ], "gold": "The Sims 4: Get To Work had several releases, including an NA release on March 31, 2015, and an EU release on April 2, 2015. The Sims 4: Get to Work, the first of 11 expansion packs released for the 2014 video game The Sims 4, was released in North America on March 31, 2015, and in Europe on April 2, 2015.", "prediction 1": "The Sims 4: Get to Work is the first expansion pack for the strategic life simulation computer game The Sims 4. It was announced on February 4, 2015 and was released in North America on March 31, 2015. The expansion pack includes four new active careers; Detective, Doctor, Scientist and retail business. A Mac compatible version of the game was made available for digital download on February 17, 2015.\n", "prediction 2": "The Sims 4: Get to Work, first expansion pack for the strategic life simulation computer game The Sims 4, was announced on February 4, 2015, and released in North America on March 31, 2015. A Mac compatible version of the game was made available for digital download on February 17, 2015.", "prediction 3": "The Sims 4: Get to Work is the first expansion pack for the life simulation computer game The Sims 4. It was announced on February 4, 2015 and was released in North America on March 31, 2015.", "prediction 4": "The Sims 4: Get to Work is the first expansion pack for the upcoming life simulation computer game The Sims 4. It was announced on February 4, 2015 and was released in North America on March 31, 2015. The expansion pack features songs re-recorded in the fictional Simlish language including: Get to Work.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 404 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Sims 4 was released in North America on September 2, 2014. The Sims 4: Get to Work is the first expansion pack for the strategic life simulation computer game The Sims 4. It was announced on February 4, 2015 and was released in North America on March 31, 2015. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Most goals scored by a premier league team in a season?", "passages": [ [ "Football DataCo", "Football DataCo\n\nFootball DataCo is a British company in the football industry that grants licences to third parties (such as newspapers) allowing them to reproduce certain intellectual property (such as fixture lists and statistics) owned by the UK's three professional football leagues: the Premier League, The Football League and the Scottish Professional Football League.", "Many of Football DataCo's activities are contracted out to the Press Association (PA).", "Thus, PA Sport handles applications for and distributes fixture lists and produces the ACTIM statistics service on behalf of Football DataCo.", "Football DataCo is wholly owned by Premier League and The Football League.", "Football DataCo charges a standard fee for the reproduction of fixture lists, which currently stands at: \u00a3266 plus VAT to print the fixtures of one English club.", "Newspapers printing the fixtures of all clubs are charged around \u00a33,931 plus VAT by DataCo for a date ordered listing.", "The money accrued by Football DataCo for the rights to this data is distributed to league clubs on an egalitarian basis, approximately:\n\n\nThe company has been racked by controversy in the UK media, after a 2004 European Court of Justice ruling that the Premier League and Football League cannot use the European Database Directive to demand payment from media and pools companies for the publication of fixture lists." ], [ "Manchester United F.C.", "Manchester United F.C. Manchester United Football Club, commonly known as Man United, or simply United, is a professional football club based in Old Trafford, Greater Manchester, England, that competes in the Premier League, the top flight of English football.", "Nicknamed \"the Red Devils\", the club was founded as Newton Heath LYR Football Club in 1878, changed its name to Manchester United in 1902 and moved to its current stadium, Old Trafford, in 1910.", "Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields.", "United have also won three UEFA Champions Leagues, one UEFA Europa League, one UEFA Cup Winners' Cup, one UEFA Super Cup, one Intercontinental Cup and one FIFA Club World Cup.", "In 1998\u201399, the club became the first in the history of English football to achieve the continental European treble.", "By winning the UEFA Europa League in 2016\u201317, they became one of five clubs to have won all three main UEFA club competitions, and the only English club to have won every competition available to them.", "The 1958 Munich air disaster claimed the lives of eight players.", "In 1968, under the management of Matt Busby, Manchester United became the first English football club to win the European Cup." ] ], "gold": "The Premier League is an English professional league for association football clubs. Manchester United, a professional football club based in Old Trafford, Greater Manchester, England, has scored the most goals in the 2015-16 season, the 2016-17 season, and the 2017-18 season.", "prediction 1": "The most goals scored by a premier league team in a season is 50 goals, scored by Manchester United in the Premier League.", "prediction 2": "The most goals scored by a premier league team in a season is 78, with 71 goals scored in the 2017/18 season. The most goals scored by a Premier League team in a season is 68, with 68 goals in the 2017/18 season.", "prediction 3": "There are a number of premier league teams who score the most goals in a season. The most goals scored by a premier league team in a single season is 69, with 27 goals in a season scoring the most goals.", "prediction 4": "The most goals scored by a premier league team in a single season is 82. Manchester United have won more trophies than any other club in English football, with a record 20 League titles, 12 FA Cups, 5 League Cups and a record 21 FA Community Shields.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 122 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Manchester United, a professional football club based in Old Trafford, Greater Manchester, England." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What do the dazante figures from monte alban depict?", "passages": [ [ "Monte Alb\u00e1n", "On its eastern and western sides the plaza is similarly bounded by a number of smaller platform mounds on which stood temples and elite residences, as well as one of two ballcourts known to have existed at the site.", "A north-south spine of mounds occupies the center of the plaza and similarly served as platforms for ceremonial structures.", "One characteristic of Monte Alb\u00e1n is the large number of carved stone monuments one encounters throughout the plaza.", "The earliest examples are the so-called \"Danzantes\" (literally, dancers), found mostly in the vicinity of Building L and which represent naked men in contorted and twisted poses, some of them genitally mutilated.", "The figures are said to represent sacrificial victims, which explains the morbid characteristics of the figures.", "The Danzantes feature physical traits characteristic of Olmec culture.", "The 19th century notion that they depict dancers is now largely discredited, and these monuments, dating to the earliest period of occupation at the site (Monte Alb\u00e1n I), are now seen to clearly represent tortured, sacrificed war prisoners,", "some identified by name, and may depict leaders of competing centers and villages captured by Monte Alb\u00e1n.", "(Blanton et al. 1996)", "Over 300 \u201cDanzantes\u201d stones have been recorded to date, and some of the better preserved ones can be viewed at the site's museum." ], [ "Monte Alb\u00e1n", "Subsequent seasons of the same project under the direction of Blanton, Gary Feinman, Steve Kowalewski, Linda Nicholas, and others extended the survey coverage to practically the entire valley, producing an invaluable amount of data on the region's changing settlement patterns from the earliest times to the arrival of the Spanish in CE 1521.", "As indicated by Blanton's survey of the site, the Monte Alb\u00e1n hills appear to have been uninhabited prior to 500 BCE (the end of the Rosario ceramic phase).", "At that time, San Jos\u00e9 Mogote was the major population center in the valley and head of a chiefdom that likely controlled much of the northern Etla branch.", "Perhaps as many as three or four other smaller chiefly centers controlled other sub-regions of the valley, including Tilcajete in the southern Valle Grande branch and Yeg\u00fcih in the Tlacolula arm to the east.", "Competition and warfare seem to have characterized the Rosario phase, and the regional survey data suggests the existence of an unoccupied buffer zone between the San Jos\u00e9 Mogote chiefdom and those to the south and east." ] ], "gold": "The 19th century notion that the dazante figures from Monte Alban depict dancers is now largely discredited. These monuments, dating to the earliest period of occupation at the site, are now seen to clearly represent tortured, sacrificed war prisoners, some of whom are identified by name. Additionally, the dazante figures may depict leaders of competing centers and villages captured by Monte Alb\u00e1n. Monte Alban was founded at the end of the Rosario period, a period which was characterized by competition and warfare.", "prediction 1": "The earliest examples are the so-called \"Danzantes\" (literally, dancers), found mostly in the vicinity of Building L and which represent naked men in contorted and twisted poses, some of them genitally mutilated. The figures are said to represent sacrificial victims, which explains the morbid characteristics of the figures.", "prediction 2": "The earliest examples are the so-called \"Danzantes\" (literally, dancers), found mostly in the vicinity of Building L and which represent naked men in contorted and twisted poses, some of them genitally mutilated. The figures are said to represent sacrificial victims, which explains the morbid characteristics of the figures. The 19th century notion that they depict dancers is now largely discredited, and these monuments, dating to the earliest period of occupation at the site, are now seen to clearly represent tortured, sacrificed war prisoners, some identified by name, and may depict leaders of competing centers and villages captured by Monte Alb\u00e1n.", "prediction 3": "The earliest examples of carved stone monuments one encounters at Monte Alb\u00e1n are the so-called \"Danzantes\" (literally, dancers), found mostly in the vicinity of Building L, which represent naked men in contorted and twisted poses, some of them genitally mutilated. The figures are said to represent sacrificial victims, which explains the morbid characteristics of the figures. However, the 19th century notion that they depict dancers is now largely discredited, and these monuments, dating to the earliest period of occupation at the site, are now seen to clearly represent tortured, sacrificed war prisoners, some identified by name, and may depict leaders of competing centers and villages captured by Monte Alb\u00e1n.", "prediction 4": "The earliest examples are the so-called \"Danzantes\" (literally, dancers), found mostly in the vicinity of Building L, which represent naked men in contorted and twisted poses, some of them genitally mutilated. The figures are said to represent sacrificial victims, which explains the morbid characteristics of the figures. The 19th century notion that they depict dancers is now largely discredited, and these monuments, dating to the earliest period of occupation at the site (Monte Alb\u00e1n I), are now seen to clearly represent tortured, sacrificed war prisoners, some identified by name, and may depict leaders of competing centers and villages captured by Monte Alb\u00e1n.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 325 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The 19th century notion that they depict dancers is now largely discredited, and these monuments, dating to the earliest period of occupation at the site (Monte Alb\u00e1n I), are now seen to clearly represent tortured, sacrificed war prisoners, some of whom are identified by name and may depict leaders of competing centers and villages captured by Monte Alb\u00e1n. Monte Alban was founded at the end of the Rosario period, a period which was characterized by competition and warfare." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When did the human genome project start and finish?", "passages": [ [ "Human Genome Project", "It is considered a megaproject because the human genome has approximately 3.3 billion base pairs.", "With the sequence in hand, the next step was to identify the genetic variants that increase the risk for common diseases like cancer and diabetes.", "It was far too expensive at that time to think of sequencing patients\u2019 whole genomes.", "So the National Institutes of Health embraced the idea for a \"shortcut\", which was to look just at sites on the genome where many people have a variant DNA unit.", "The theory behind the shortcut was that, since the major diseases are common, so too would be the genetic variants that caused them.", "Natural selection keeps the human genome free of variants that damage health before children are grown, the theory held, but fails against variants that strike later in life, allowing them to become quite common (In 2002 the National Institutes of Health started a $138 million project called the HapMap to catalog the common variants in European, East Asian and African genomes).", "The genome was broken into smaller pieces; approximately 150,000 base pairs in length.", "These pieces were then ligated into a type of vector known as \"bacterial artificial chromosomes\", or BACs, which are derived from bacterial chromosomes which have been genetically engineered.", "The vectors containing the genes can be inserted into bacteria where they are copied by the bacterial DNA replication machinery." ], [ "Human Genome Project", "Human Genome Project\n\nThe Human Genome Project (HGP) was an international scientific research project with the goal of determining the sequence of nucleotide base pairs that make up human DNA, and of identifying and mapping all of the genes of the human genome from both a physical and a functional standpoint.", "It remains the world's largest collaborative biological project.", "After the idea was picked up in 1984 by the US government when the planning started, the project formally launched in 1990 and was declared complete on April 14, 2003.", "Funding came from the US government through the National Institutes of Health (NIH) as well as numerous other groups from around the world.", "A parallel project was conducted outside government by the Celera Corporation, or Celera Genomics, which was formally launched in 1998.", "Most of the government-sponsored sequencing was performed in twenty universities and research centers in the United States, the United Kingdom, Japan, France, Germany, Spain and China.", "The Human Genome Project originally aimed to map the nucleotides contained in a human haploid reference genome (more than three billion).", "The \"genome\" of any given individual is unique; mapping the \"human genome\" involved sequencing a small number of individuals and then assembling these together to get a complete sequence for each chromosome.", "Therefore, the finished human genome is a mosaic, not representing any one individual." ] ], "gold": "The Human Genome Project was started in 1990 with the goal of sequencing and identifying all three billion chemical units in the human genetic instruction set, finding the genetic roots of disease and then developing treatments. Planning started after the idea was picked up in 1984 by the US government, the project formally launched in 1990, and was declared complete on April 14, 2003.", "prediction 1": "The Human Genome Project, or HGP, was an international scientific research project that was officially launched in 1990 and was declared complete on April 14, 2003. The project originally aimed to map the nucleotides contained in a human haploid reference genome, which has approximately 3.3 billion base pairs. The next step was to identify the genetic variants that increase the risk for common diseases like cancer and diabetes. The project was picked up in 1984 by the US government when the planning started, the formally launched in 1990 and was declared complete on April 14, 2003.", "prediction 2": "The Human Genome Project was an international scientific research project with the goal of determining the sequence of nucleotide base pairs that make up human DNA, and of identifying and mapping all of the genes of the human genome from both a physical and a functional standpoint. Originally aimed to map the nucleotides contained in a human haploid reference genome, with approximately 3.3 billion base pairs. It was formally launched in 1990 and was declared complete on April 14, 2003.", "prediction 3": "The Human Genome Project (HGP) was an international scientific research project with the goal of determining the sequence of nucleotide base pairs that make up human DNA, and of identifying and mapping all of the genes of the human genome from both a physical and a functional standpoint. The project officially started in 1990 and was declared complete on April 14, 2003.", "prediction 4": "The Human Genome Project was an international scientific research project with the goal of determining the sequence of nucleotide base pairs that make up human DNA, and of identifying and mapping all of the genes of the human genome from both a physical and a functional standpoint. The project was formally launched in 1990 and was declared complete on April 14, 2003. Funding came from the US government through the National Institutes of Health (NIH) and numerous other groups from around the world.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 311 } ], "missing-info": [], "corrected-prediction": "The Human Genome Project, or HGP, was an international scientific research project that was officially launched in 1990 and was declared complete on April 14, 2003. The project originally aimed to map the nucleotides contained in a human haploid reference genome. The next step was to identify the genetic variants that increase the risk for common diseases like cancer and diabetes. The project was picked up in 1984 by the US government when the planning started, the formally launched in 1990 and was declared complete on April 14, 2003." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "What is a zebra crossing called in the uk?", "passages": [ [ "Zebra crossing", "It made it a tourist attraction, and it has been incorporated into the Abbey Road Studios logo.", "Since the Abbey Road photo was taken, zigzag lines at the kerb and in the centre of the road have been added to all zebra crossings.", "The band Shriekback's album \"Sacred City\" contains an entire song, \"Beatles Zebra Crossing?", "\", about the Abbey Road zebra crossing and its status as a tourist attraction.", "English Heritage has given this crossing Grade II listed building status.", "There is also a tongue-in-cheek reference to zebra crossings in the science-fiction comedy \"The Hitchhiker's Guide to the Galaxy\" by English author Douglas Adams, in reference to Man using the improbable creature called the Babel fish as proof of the \"non\"-existence of God; the novel says, \"Man then goes on to prove that black is white and gets himself killed at the next zebra crossing.\"", "The La Paz traffic zebras is a team of young people who dress in zebra costumes and dance in the streets of La Paz, Bolivia in order to make drivers and pedestrians aware of traffic rules.", "A zebra crossing immediately outside the Russian Embassy in Helsinki was painted in summer 2013 with the colours of the rainbow in protest the Russian government's policy towards lesbian and gay people, the rainbow being one symbol of the LGBT culture." ], [ "Zebra crossing", "In Switzerland yellow stripes are used for pedestrian crossings.", "Unlike with yellow \"tiger crossings\" in the UK, however, cyclists are required to dismount to cross.", "In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings (Rule 195 of \"The Highway Code\").", "They were introduced in the late 1940s and '50s to tackle high death rates of pedestrians crossing roads.", "For over 60 years they have been recognized as a safe place for pedestrians to cross but more recently, some drivers are failing to give way to pedestrians.", "It is believed that hundreds of people have died at the crossings and thousands more have been injured.", "This has prompted some councils to install enforcement cameras at the crossings to catch offenders.", "In the United Kingdom, a fine of \u00a3100 and three licence penalty points is given to those failing to give way at the crossings.", "Such a penalty has attracted criticisms of leniency when compared to other countries which enforce fines of up to \u00a32,000.", "For failing to give way at a zebra crossing patrolled by a school crossing patrol (\"lollipop man/lady\" as they are commonly called), however, the penalty rises to \u00a31,000 and a minimum of three licence points, with the possibility even of disqualification.", "In the United Kingdom, motorists have to stop for a crossing patrol, even when it is not on a pedestrian crossing." ], [ "Road signs in Singapore", "When pedestrians are present at the side of a zebra crossing, all motorists are obligated to give priority to pedestrians crossing the zebra crossing bars, by stopping before the white line across the lane.", "No waiting is permitted within the vicinity of the zebra crossing.", "A sign indicating a pedestrian crossing or a 'SLOW' painted on the road may be present as well." ] ], "gold": "A zebra crossing is a type of pedestrian crossing (or crosswalk) used in certain places around the world. Its distinguishing characteristic is that it gives priority to pedestrians, in that motorists are obliged to stop when someone has indicated their intent to cross by waiting by the crossing. In Switzerland yellow stripes are used for pedestrian crossings. Unlike a yellow tiger crossing in the UK, however, cyclists are required to dismount to cross.", "prediction 1": "In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings. They were introduced in the late 1940s and '50s to tackle high death rates of pedestrians crossing roads. For over 60 years they have been recognized as a safe place for pedestrians to cross but more recently, some drivers are failing to give way to pedestrians. In the UK, a zebra crossing is known as a zebra crossing or a white line that is placed between the bars of the road.", "prediction 2": "In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings, and is known in English as the \"zebra crossing\". In other countries, zebra crossings are called tiger crossings, zebra crossings are called yellow stripes and zebra crossings are called white stripes. In the United Kingdom, zebra crossings are called yellow stripes, yellow zigzag lines, zebra crossings and zebra crossings.", "prediction 3": "In the UK, a zebra crossing is a road crossing made from grass or thorns, made of plastic or metal bars, which are used to mark pedestrian crossings. In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings. It is believed that hundreds of people have died at the crossings and thousands more have been injured.", "prediction 4": "In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings (Rule 195 of The Highway Code). They were introduced in the late 1940s and '50s to tackle high death rates of pedestrians crossing roads. Zebra crossings have been recognized for over 60 years as a safe place for pedestrians to cross but more recently, some drivers are failing to give way to pedestrians. In the United Kingdom, motorists have to stop for a crossing patrol, even when it is not on a pedestrian crossing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 358 }, { "error type": "Unverifiable", "explanation": "", "start": 359, "end": 476 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "When pedestrians are present at the side of a zebra crossing, all motorists are obligated to give priority to pedestrians crossing the zebra crossing bars, by stopping before the white line across the lane. In Switzerland yellow stripes are used for pedestrian crossings. Unlike with yellow \"tiger crossings\" in the UK, however, cyclists are required to dismount to cross. In the United Kingdom, it is the law that motorists give way to pedestrians at zebra crossings. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the song the fighter come out?", "passages": [ [ "The Fighter (Keith Urban song)", "The Fighter (Keith Urban song)\n\n\"The Fighter\" is a song co-written and recorded by New Zealand-born Australian country singer Keith Urban featuring Carrie Underwood as a duet.", "It was released on 6 February 2017 as the fifth and final single from Urban's 2016 album, \"Ripcord\".", "Urban co-wrote and co-produced this song with busbee.", "The song has entered the record charts of Australia, Canada, the United States, Belgium, and Scotland, where it became Urban's first song to enter the Scottish and Belgian charts.", "The song is set in the key of B minor with a main chord pattern of G7\u2013A4\u2013F7\u2013Bm and an approximate tempo of 132 beats per minute.", "It is about a man promising that he will defend and support a woman.", "Urban said of the song's evolution as \"I was working with busbee that day; we were in London.", "I was actually driving to the studio to work on this other song we started, and I had most of it the chorus in my head, and it felt like I had most of the song in my head \u2014 the verses just had to flesh out.", "I walked into the studio and played the chord progression, and he built this track really quickly, and then I could sing over the top of it\"." ], [ "The Fighter (Gym Class Heroes song)", "The Fighter (Gym Class Heroes song)\n\n\"The Fighter\" is a song by American rap rock band Gym Class Heroes, from their fifth studio album \"The Papercut Chronicles II\".", "The song features vocals from American singer-songwriter and record producer Ryan Tedder of the band OneRepublic, and was released as the third single from the album in May 2012.", "It was featured in the season finale of \"90210\" season 4 and the Cathay Pacific television commercial for the 2013 Hong Kong Sevens \n\nThe music video for \"The Fighter\" was filmed in April 2012.", "It was released to YouTube on May 24, 2012.", "The video features American gymnast John Orozco.", "It depicts Tedder playing at an upright piano, and the band members around him singing and playing their instruments.", "Shots of Orozco doing Olympic training in a gym, as well as clips of home video of him competing as a child are shown in between.", "The single was written by several writers, including all four Gym Class Heroes members, Tedder, Noel Zancanella and Jamie Heffernan." ], [ "Fighter (song)", "Fighter (song)\n\n\"Fighter\" is a song recorded by American singer Christina Aguilera for her fourth studio album, \"Stripped\" (2002).", "The song was written by Aguilera and Scott Storch, and produced by the latter.", "It was released by RCA Records as the third single from \"Stripped\" on March 13, 2003.", "Inspired by Guns N' Roses' song \"November Rain\", \"Fighter\" was characterized as a hybrid of rock and R&B that incorporates elements of arena rock and rock and roll.", "The track sees Aguilera thanking a man who had done wrong to her for making her a \"fighter.\"", "\"Fighter\" received mostly positive reviews from music critics, who praised Aguilera's vocals and the song's empowering lyrics.", "The single peaked at number 20 on the US \"Billboard\" Hot 100 and was certified gold by the Recording Industry Association of America (RIAA).", "As of September 2014, \"Fighter\" has sold 1.184 million copies in the United States.", "Elsewhere, the song reached the top ten of several national music charts, including those in the United Kingdom, Canada, Australia, and the Netherlands.", "A music video for \"Fighter\" was directed by Floria Sigismondi." ] ], "gold": "Multiple songs have been released under titles such as The Fighter, Fighter or Fighters. The Fighter is a song co-written and recorded by country music singer Keith Urban that features Carrie Underwood as a duet. It was released on 6 February 2017. The Fighter is also the title of a song by American rap rock band Gym Class Heroes that was released on November 8, 2011. This song was featured in the season finale of 90210 season 4. Fighter, a song recorded by American singer Christina Aguilera, was released on March 13, 2003. Since its release, Fighter has been recognized as one of Aguilera's most empowering songs for women due to its lyrics. Fighter is also the title of a song recorded by Japanese singer Namie Amuro that was released on October 26, 2016. This single serves as the insert song to the Japanese drama\u2013horror film Death Note: Light Up the New World and the theme song to its accompanying spin-off series Death Note: New Generation. Fighters is also the title of a single by Japanese group Sandaime J Soul Brothers from Exile Tribe. It was released on September 7, 2011.", "prediction 1": "The song The Fighter was co-written and recorded by Australian country singer Keith Urban featuring Carrie Underwood as a duet. It was released on 6 February 2017 as the fifth and final single from Urban's 2016 album, Ripcord. American rap rock band Gym Class Heroes also released a song titled The Fighter which features vocals from American singer-songwriter and record producer Ryan Tedder of the band OneRepublic. The song was released as the third single from the album in May 2012. The music video for \"The Fighter\" was filmed in April 2012 and was released to YouTube on May 24, 2012.", "prediction 2": "The song \"The Fighter\" comes out on 6 February 2017 as the fifth and final single from Keith Urban's 2016 album, Ripcord. It was also released on May 24, 2012 as the third single from American rap rock band Gym Class Heroes' fifth studio album, The Papercut Chronicles II. \"The Fighter\" is a song co-written and recorded by New Zealand-born Australian country singer Keith Urban featuring Carrie Underwood as a duet. It came out on 6 February 2017 as the fifth and final single from Urban's 2016 album, Ripcord.", "prediction 3": "The song The Fighter was released on 6 February 2017 as the fifth and final single from Australian country singer Keith Urban's 2016 album Ripcord. The song starred Carrie Underwood on vocals and was co-written and co-produced by Urban and busbee.", "prediction 4": "The song \"The Fighter\" is a song co-written and recorded by New Zealand-born Australian country singer Keith Urban featuring Carrie Underwood as a duet. It was released on 6 February 2017 as the fifth and final single from Urban's 2016 album, \"Ripcord\". The Fighter is also a song by American rap rock band Gym Class Heroes, from their fifth studio album The Papercut Chronicles II. The song features vocals from American singer-songwriter and record producer Ryan Tedder of the band OneRepublic.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 417 }, { "error type": "Irrelevant", "explanation": "", "start": 488, "end": 591 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The song The Fighter was co-written and recorded by Australian country singer Keith Urban featuring Carrie Underwood as a duet. It was released on 6 February 2017. American rap rock band Gym Class Heroes also released a song titled The Fighter. The song was released as the third single from the album in May 2012. It was featured in the season finale of \"90210\" season 4. Fighter, a song recorded by American singer Christina Aguilera, was released on March 13, 2003. Since its release, Fighter has been recognized as one of Aguilera's most empowering songs for women due to its lyrics. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the women's first world cup held?", "passages": [ [ "FIFA Women's World Cup", "FIFA Women's World Cup\n\nThe FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's international governing body.", "The competition has been held every four years since 1991, when the inaugural tournament, then called the FIFA Women's World Championship, was held in China.", "Under the tournament's current format, national teams vie for 23 slots in a three-year qualification phase.", "(The host nation's team is automatically entered as the 24th slot.)", "The tournament proper, alternatively called the \"World Cup Finals\", is contested at venues within the host nation(s) over a period of about one month.", "The seven FIFA Women's World Cup tournaments have been won by 4 national teams.", "The current champion is the United States, after winning their third title in the 2015 FIFA Women's World Cup.", "In 1971 an unofficial tournament was held in Mexico.", "In 1988 \u2013 58 years after the first Men's FIFA World Cup tournament in 1930 and approximately 17 years after the FA ban on women's football was eliminated in 1971 \u2013 FIFA hosted an invitational in China as a test to see if a global women's World Cup was feasible." ], [ "Scotland women's national cricket team", "Scotland women's national cricket team\n\nThe Scotland women's national cricket team, nicknamed the Wildcats, represents Scotland in international women's cricket.", "The team is organised by Cricket Scotland, an associate member of the International Cricket Council (ICC).", "Scotland were involved in the first international women's cricket match, when they played against England in August 1932.", "The team played sporadically throughout the remainder of the 20th century, with regular competition beginning only in 2000.", "Scotland's first international tournament was the 2001 European Championship, where matches held One Day International (ODI) status.", "The team's only other ODI appearances to date came at the 2003 IWCC Trophy in the Netherlands, a qualifier for the 2005 World Cup.", "Outside regional tournaments, Scotland has only qualified for two major events since then \u2013 the 2008 World Cup Qualifier and the 2015 World Twenty20 Qualifier.", "In April 2018, the ICC granted full Women's Twenty20 International (WT20I) status to all its members.", "Therefore, all Twenty20 matches played between Scotland women and another international side after 1 July 2018 will be a full WT20I.", "In August 1932, a Scottish women's team played England at New Road, Worcester, in what was the first international women's cricket fixture." ], [ "Women's Rugby World Cup", "Women's Rugby World Cup\n\nThe Women's Rugby World Cup is the premier international competition in rugby union for women.", "The tournament is organised by the sport's governing body, World Rugby.", "The championships are currently held every four years; the event was most recently held in Ireland in 2017.", "World Rugby has reset the tournament on a new four-year cycle to avoid conflict with the Olympics and Women's World Cup Sevens; World Cups will thus be held every four years after 2017.", "The first Women's Rugby World Cup was held in 1991 and won by the United States.", "The 1991 and 1994 competitions were not officially sanctioned by World Rugby, then known as the International Rugby Football Board, at the time - they later received retrospective endorsement in 2009 when the governing body included the 1991 and 1994 champions in its list of previous winners.", "It was not until the 1998 tournament held in the Netherlands that the tournament received official IRB backing.", "The most successful team, with five titles, is New Zealand.", "Prior to the first Women's Rugby World Cup officially sanctioned by the International Rugby Board there had been three previous tournaments of a similar nature.", "The first of these was an event held in August 1990 in New Zealand.", "Though not considered a world cup, the tournament was referred to as the World Rugby Festival for Women." ] ], "gold": "The FIFA Women's World Cup is an international association football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association, the sport's international governing body. It has been held every four years and one year after the FIFA World Cup since 1991, when the inaugural tournament was held in China. The ICC Women's Cricket World Cup is the sport's oldest world championship, with the first tournament held in England in June and July 1973. The Rugby World Cup for women, historically known as the Women's Rugby World Cup, is the premier international competition in rugby union for women and was first held in 1991 and won by the United States. ", "prediction 1": "The FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association, the sport's international governing body. The tournament has been held every four years since 1991, when the inaugural tournament, then called the FIFA Women's World Championship, was held in China. The Women's Rugby World Cup is the premier international competition in rugby union for women, and was first held in 1991 and won by the United States.", "prediction 2": "The FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's international governing body. The competition has been held every four years since 1991, when the inaugural tournament, then called the FIFA Women's World Championship, was held in China. The Women's Rugby World Cup is the premier international competition in rugby union for women. The championships are currently held every four years; the event was most recently held in 2017 in Ireland. The Women's Rugby World Cup was held in 1991 and won by the United States. The first Men's Rugby World Cup was held in New Zealand in August 1990.", "prediction 3": "The FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association, the sport's international governing body. The tournament has been held every four years since 1991, when the inaugural tournament, then called the FIFA Women's World Championship, was held in China. The first Women's Rugby World Cup was held in 1991 and won by the United States.", "prediction 4": "The FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's international governing body. The women's first FIFA Women's World Cup was held in China in 1991. The Women's Rugby World Cup is the premier international competition in rugby union for women. The championships are currently held every four years; the event was most recently held in Ireland in 2017.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The FIFA Women's World Cup is an international football competition contested by the senior women's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association, the sport's international governing body. The tournament has been held every four years since 1991, when the inaugural tournament, then called the FIFA Women's World Championship, was held in China. The Women's Rugby World Cup is the premier international competition in rugby union for women, and was first held in 1991 and won by the United States." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When did the babylonian captivity take place quizlet?", "passages": [ [ "Babylonian captivity", "Babylonian captivity\n\nThe Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia.", "After the Battle of Carchemish in 605 BCE, King Nebuchadnezzar of Babylon besieged Jerusalem, resulting in tribute being paid by King Jehoiakim.", "Jehoiakim refused to pay tribute in Nebuchadnezzar's fourth year, which led to another siege in Nebuchadnezzar's seventh year, culminating with the death of Jehoiakim and the exile of King Jeconiah, his court and many others; Jeconiah's successor Zedekiah and others were exiled in Nebuchadnezzar's eighteenth year; a later deportation occurred in Nebuchadnezzar's twenty-third year.", "The dates, numbers of deportations, and numbers of deportees given in the biblical accounts vary.", "These deportations are dated to 597 BCE for the first, with others dated at 587/586 BCE, and 582/581 BCE respectively.", "After the fall of Babylon to the Persian king Cyrus the Great in 539 BCE, exiled Judeans were permitted to return to Judah.", "According to the biblical book of Ezra, construction of the second temple in Jerusalem began around 537 BCE." ], [ "Avignon Papacy", "Avignon Papacy\n\nThe Avignon Papacy was the period from 1309 to 1376 during which seven successive popes resided in Avignon (then in the Kingdom of Arles, part of the Holy Roman Empire, now in France) rather than in Rome.", "The situation arose from the conflict between the papacy and the French crown, culminating in the death of Pope Boniface VIII after his arrest and maltreatment by Philip IV of France.", "Following the further death of Pope Benedict XI, Philip forced a deadlocked conclave to elect the French Clement V as Pope in 1305.", "Clement refused to move to Rome, and in 1309, he moved his court to the papal enclave at Avignon, where it remained for the next 67 years.", "This absence from Rome is sometimes referred to as the \"Babylonian Captivity of the Papacy\".", "A total of seven popes reigned at Avignon, all French, and all under the influence of the French Crown.", "In 1376, Gregory XI abandoned Avignon and moved his court to Rome (arriving on January 17, 1377).", "But after Gregory's death in 1378, deteriorating relations between his successor Urban VI and a faction of cardinals gave rise to the Western Schism.", "This started a second line of Avignon popes, subsequently regarded as illegitimate." ], [ "Avignon Papacy", "After initial successful talks the effort failed, largely due to the mistrust from English side over Guy's strong ties with the French court.", "In a letter Innocent VI himself wrote to the Duke of Lancaster: \"Although we were born in France and although for that and other reasons we hold the realm of France in special affection, yet in working for peace we have put aside our private prejudices and tried to serve the interests of everyone\".", "With Pope Urban V (1362\u20131370), the control by Charles V of France of the papacy became more direct.", "Urban V himself is described as the most austere of the Avignon popes after Benedict XII and probably the most spiritual of all.", "However, he was not a strategist and made substantial concessions to the French crown especially in finances, a crucial issue during the war with England.", "In 1369 Pope Urban V supported the marriage of Philip the Bold of the Duchy of Burgundy and Margaret III, Countess of Flanders, rather than giving dispensation to one of Edward III of England's sons to marry Margaret.", "This clearly showed the partisanship of the papacy; correspondingly, the respect for the church dropped.", "The most influential decision in the reign of Pope Gregory XI (1370\u20131378) was the return to Rome, beginning on 13 September 1376 and ending with his arrival on 17 January 1377." ] ], "gold": "The first deportation of the Babylonian took place from 609\u2013598 BCE, after Josiah, the king of Judah, was killed in a battle with the Egyptians at the Battle of Megiddo. The second took place 16 March 597 when Nebuchadnezzar captured Jerusalem, which put an end to the reign of Jehoaichin. The third took place 587/586 BCE when Nebuchadnezzar destroyed the Kingdom of Judah, and its capital, Jerusalem, which led to people from surrounding areas deporting to Babylonia. The Avignon Papacy, also known as the Babylonian Captivity, was the period in which seven successive popes resided in Avignon rather than in Rome, beginning 1309 until 13 September 1378, when Pope Gregory XI made the influential decision to return to Rome for the length of his reign. ", "prediction 1": "The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. In the Avignon Papacy, seven successive popes resided in Avignon, then in the Kingdom of Arles, part of the Holy Roman Empire, now in France, rather than in Rome. Clement refused to move to Rome, and in 1309, he moved his court to the papal enclave at Avignon, where it remained for the next 67 years.", "prediction 2": "The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the Avignon Papacy from 1309 to 1376 during which seven successive popes resided in Avignon, then in the Kingdom of Arles, part of the Holy Roman Empire, where it remained for the next 67 years. This absence from Rome is sometimes referred to as the Babylonian Captivity of the Papacy.", "prediction 3": "The Babylonian captivity, or Babylonian exile, is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Babylonian captivity or Babylonian exile took place from 597 BCE through 1377.", "prediction 4": "The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Babylonian captivity or Babylonian exile is the period in Jewish history during which a number of people from the ancient Kingdom of Judah were captives in Babylonia. The Avignon Papacy was the period from 1309 to 1376 when seven successive popes resided in Avignon, then in the Kingdom of Arles, part of the Holy Roman Empire, now in France. The absence from Rome is sometimes referred to as the Babylonian Captivity of the Papacy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 472 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Babylonian captivity began after the Battle of Carchemish in 605 BCE, when King Nebuchadnezzar of Babylon besieged Jerusalem. Another siege in Nebuchadnezzar's seventh year resulted in the exile of King Jeconiah. Jeconiah's successor and others were exiled in Nebuchadnezzar's eighteenth year and a later deportation occurred in Nebuchadnezzar's twenty-third year. In the Avignon Papacy, sometimes referred to as the \"Babylonian Captivity of the Papacy\", seven successive popes resided in Avignon, rather than in Rome, starting in 1309, and ending in 1376, Gregory XI abandoned Avignon and moved his court to Rome (arriving on January 17, 1377)." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "When did new zealand stop being a dominion?", "passages": [ [ "New Zealand", "Wellington was chosen for its central location, with Parliament officially sitting there for the first time in 1865.", "As immigrant numbers increased, conflicts over land led to the New Zealand Wars of the 1860s and 1870s, resulting in the loss and confiscation of much M\u0101ori land.", "In 1891 the Liberal Party, led by John Ballance, came to power as the first organised political party.", "The Liberal Government, later led by Richard Seddon, passed many important social and economic measures.", "In 1893 New Zealand was the first nation in the world to grant all women the right to vote and in 1894 pioneered the adoption of compulsory arbitration between employers and unions.", "In 1907, at the request of the New Zealand Parliament, King Edward VII proclaimed New Zealand a Dominion within the British Empire, reflecting its self-governing status.", "In 1947 the country adopted the Statute of Westminster, confirming that the British Parliament could no longer legislate for New Zealand without the consent of New Zealand.", "Early in the 20th century, New Zealand was involved in world affairs, fighting in the First and Second World Wars and suffering through the Great Depression.", "The depression led to the election of the First Labour Government and the establishment of a comprehensive welfare state and a protectionist economy.", "New Zealand experienced increasing prosperity following the Second World War and M\u0101ori began to leave their traditional rural life and move to the cities in search of work." ], [ "Dominion of New Zealand", "Preferring the British Government to handle most of its foreign affairs and defence, New Zealand held back from adopting the Statute of Westminster Act.", "The First Labour Government (1935\u20131949) pursued a more independent path in foreign affairs, in spite of the statute remaining unadopted.", "In 1938 Deputy Prime Minister Peter Fraser told Parliament, \"this country has to make up its own mind on international problems as a sovereign country \u2013 because under the Statute of Westminster ours is a sovereign country\".", "In the 1944 Speech from the Throne the Governor-General announced the government's intention to adopt the Statute of Westminster.", "It was forced to abandon the proposal when the opposition accused the government of being disloyal to Britain at a time of need.", "Ironically, the National opposition prompted the adoption of the statute in 1947 when its leader, and future prime minister, Sidney Holland introduced a private member's bill to abolish the Legislative Council.", "Because New Zealand required the consent of the British Parliament to make the necessary amendments to the New Zealand Constitution Act 1852, Peter Fraser, now Prime Minister, had a reason to finally adopt the statute.", "It was formally adopted on 25 November 1947 with the Statute of Westminster Adoption Act 1947, along with consenting legislation from the British Parliament.", "New Zealand was the last Dominion listed in the statute to adopt it." ], [ "Statute of Westminster 1931", "Statute of Westminster 1931\n\nThe Statute of Westminster 1931 is an Act of the Parliament of the United Kingdom and modified versions of it are now domestic law within Australia and Canada; it has been repealed in New Zealand and implicitly in former Dominions that are no longer Commonwealth realms.", "Passed on 11 December 1931, the act, either immediately or upon ratification, effectively both established the legislative independence of the self-governing Dominions of the British Empire from the United Kingdom and bound them all to seek each other's approval for changes to monarchical titles and the common line of succession.", "It thus became a statutory embodiment of the principles of equality and common allegiance to the Crown set out in the Balfour Declaration of 1926.", "As the Statute removed nearly all of the British Parliament's authority to legislate for the Dominions, it had the effect of making the Dominions fully sovereign nations in their own right.", "It was a crucial step in the development of the Dominions as separate states.", "The Statute of Westminster's relevance today is that it sets the basis for the continuing relationship between the Commonwealth realms and the Crown.", "The Statute of Westminster gave effect to certain political resolutions passed by the Imperial Conferences of 1926 and 1930; in particular, the Balfour Declaration of 1926." ] ], "gold": "In 1907, King Edward VII proclaimed New Zealand a Dominion within the British Empire, at the request of the New Zealand Parliament, reflecting its self-governing status. On 11 December 1931, the Statue of Westminster was passed by the United Kingdom's Parliament. New Zealand did not adopt the Statue of Westminster until 25 November 1947. This confirmed that the British Parliament could no longer legislate for New Zealand without their consent.", "prediction 1": "New Zealand stopped being a dominion on 25 November 1947, when it adopted the Statute of Westminster. The Statute of Westminster was passed in 1931 and repealed on 11 December 1931, effectively both establishing the legislative independence of the self-governing Dominions of the British Empire from the United Kingdom and binding them all to seek each other's approval for changes to monarchical titles and the common line of succession. The Statute of Westminster repealed the Statute of Westminster in New Zealand on 11 December 1931, effectively both established the legislative independence of the self-governing Dominion and bound them all to seek each other's approval for changes to monarchical titles and the common line of succession, it had the effect of making the Dominions fully sovereign nations in their own right. New Zealand stopped being a Dominion in 1947, when it repealed the Statute of Westminster repeale of Westminster repealed on 25", "prediction 2": "In 1907, at the request of the New Zealand Parliament, King Edward VII proclaimed New Zealand a Dominion within the British Empire, reflecting its self-governing status. In 1947 the country adopted the Statute of Westminster, confirming that the British Parliament could no longer legislate for New Zealand without the consent of New Zealand. The Statute was repealed in New Zealand and implicitly in former Dominions that are no longer Commonwealth realms.", "prediction 3": "In 1907, King Edward VII proclaimed New Zealand a Dominion within the British Empire, reflecting its self-governing status. In the early 20th century, the country was involved in world affairs, fighting in the First and Second World Wars and suffering through the Great Depression. The First Labour Government pursued a more independent path in foreign affairs, in spite of the statute remaining unadopted. The Statute of Westminster was formally adopted on 25 November 1947, along with consenting legislation from the British Parliament.", "prediction 4": "In 1907, at the request of the New Zealand Parliament, King Edward VII proclaimed New Zealand a Dominion within the British Empire, reflecting its self-governing status. In 1947, the country adopted the Statute of Westminster, confirming that the British Parliament could no longer legislate for New Zealand without the consent of New Zealand. This was after the last Dominion listed in the statute to adopt it, New Zealand, which had held off adopting the Statute of Westminster until it was formally adopted on 25 November 1947, formally adopted on 25 November 1947 with the Statute of Westminster Adoption Act, along with consenting legislation from the British Parliament.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 181 }, { "error type": "Redundant", "explanation": "New Zealand stopped being a dominion on 25 November 1947, when it adopted the Statute of Westminster. The Statute of Westminster was passed in 1931 and repealed on 11 December 1931, effectively both establishing the legislative independence of the self-governing Dominions of the British Empire from the United Kingdom and binding them all to seek each other's approval for changes to monarchical titles and the common line of succession. ", "start": 439, "end": 744 }, { "error type": "Redundant", "explanation": "New Zealand stopped being a dominion on 25 November 1947, when it adopted the Statute of Westminster. ", "start": 831, "end": 958 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": " In 1907, at the request of the New Zealand Parliament, King Edward VII proclaimed New Zealand a Dominion within the British Empire, reflecting its self-governing status. New Zealand stopped being a dominion on 25 November 1947, when it adopted the Statute of Westminster. The Statute of Westminster was passed in 1931, effectively both establishing the legislative independence of the self-governing Dominions of the British Empire from the United Kingdom and binding them all to seek each other's approval for changes to monarchical titles and the common line of succession, it had the effect of making the Dominions fully sovereign nations in their own right. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When did the golden knights become a team?", "passages": [ [ "Clarkson Golden Knights", "Clarkson Golden Knights\n\nThe Clarkson Golden Knights are composed of 20 teams representing Clarkson University in intercollegiate athletics, including men and women's alpine skiing, basketball, cross country, ice hockey, lacrosse, nordic skiing, soccer, and swimming.", "Men's sports include baseball and golf.", "Women's sports include softball and volleyball.", "The Golden Knights compete in the NCAA Division III and are members of the Liberty League for all sports except ice hockey, which competes in NCAA Division I, as a member of ECAC Hockey.", "While Clarkson is a NCAA Division III school, both the men's and women's ice hockey teams compete in Division I, with both teams playing in the ECAC.", "The men's team is a traditional power in the ECAC.", "They have won 5 ECAC Tournament Championships, most recently in 2007.", "Clarkson's most recent NCAA tournament was as the number three seed in the 2008 NCAA East regional, where they knocked off St. Cloud State 2\u20131 to advance to the second round.", "The Golden Knights were then defeated by national number one seed, Michigan, 2\u20130.", "The women's team is far younger, beginning play in 2003, than the men's team, although they too have become an ECAC power." ], [ "Vegas Golden Knights", "Vegas Golden Knights\n\nThe Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season.", "They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL).", "The team is owned by Black Knight Sports & Entertainment, a consortium led by Bill Foley and the Maloof family.", "The team plays its home games at T-Mobile Arena on the Las Vegas Strip in Paradise, Nevada.", "The NHL has had a presence in Las Vegas since 1991; that year, the city hosted the first outdoor game between two NHL teams \u2013 a preseason exhibition between the Los Angeles Kings and New York Rangers outside Caesars Palace.", "The Kings would subsequently organize \"Frozen Fury\" \u2013 a series of annual preseason games in Las Vegas against the Colorado Avalanche.", "The NHL Awards ceremonies have been held in Las Vegas since 2009.", "In 2009, the media speculated about a plan involving Hollywood producer Jerry Bruckheimer to move the Phoenix Coyotes to Nevada.", "Rumors of a Las Vegas expansion team surfaced again in August 2014, pointing to a new indoor arena on the Strip (built as a joint venture between Anschutz Entertainment Group, owners of the Los Angeles Kings, and MGM Resorts International) as the potential home arena, although these rumors were denied by the league." ], [ "Calgary Flames", "Calgary Flames\n\nThe Calgary Flames are a professional ice hockey team based in Calgary, Alberta.", "They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL).", "The club is the third major-professional ice hockey team to represent the city of Calgary, following the Calgary Tigers (1921\u20131927) and Calgary Cowboys (1975\u20131977).", "The Flames are one of two NHL franchises in Alberta; the other is the Edmonton Oilers.", "The cities' proximity has led to a rivalry known as the \"Battle of Alberta\".", "The team was founded in 1972 in Atlanta as the Atlanta Flames until relocating to Calgary in 1980.", "The Flames played their first three seasons in Calgary at the Stampede Corral before moving into their current home arena, the Scotiabank Saddledome (originally known as the Olympic Saddledome), in 1983.", "In 1985\u201386, the Flames became the first Calgary team since the 1923\u201324 Tigers to compete for the Stanley Cup.", "In 1988\u201389, the Flames won their first and only championship.", "The Flames' unexpected run to the 2004 Stanley Cup Finals gave rise to the Red Mile, and in 2011 the team hosted and won the second Heritage Classic outdoor game.", "The Flames have won two Presidents' Trophies as the NHL's top regular season team, and have claimed five division championships." ] ], "gold": "Several hockey teams bear the name Golden Knights. Clarkson University has two ice hockey teams: The Clarkson Golden Knights men's team, which became a team in 1921, and the Clarkson Golden Knights women's team, which became a team in 2003. The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that competes in the National Hockey League. They became a team in the 2017-18 NHL season. ", "prediction 1": "The Clarkson Golden Knights are an intercollegiate athletics team composed of 20 teams representing Clarkson University in intercollegiate athletics. The men's team is a traditional power in the ECAC. The women's team is far younger, beginning play in 2003, than the men's team, although they too have become an ECAC power. The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. The team is owned by Black Knight Sports & Entertainment, a consortium led by Bill Foley and the Maloof family.", "prediction 2": "The Clarkson Golden Knights are a professional collegiate hockey team based in Clarkson, Nevada. The team became a team on February 14, 2003. The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area and began play in the 2017\u201318 NHL season.", "prediction 3": "The Clarkson Golden Knights are a professional basketball team representing Clarkson University. They are composed of 20 teams representing the university in intercollegiate athletics, including men's and women's alpine skiing, basketball, cross country, ice hockey, lacrosse, nordic skiing, soccer, and swimming. The men's team is a traditional power in the ECAC. The women's team is far younger, beginning play in 2003, than the men's team, although they too have become an ECAC power.", "prediction 4": "The Clarkson Golden Knights are a college sports team based in Clarkson, Nevada. They are comprised of 20 teams representing Clarkson University in intercollegiate athletics, including men's and women's alpine skiing, basketball, cross country, ice hockey, lacrosse, nordic skiing, soccer, and swimming. The women's team is far younger, beginning play in 2003, than the men's team, although they too have become an ECAC power. The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 468, "end": 579 }, { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 86 } ], "missing-info": [], "corrected-prediction": "The Clarkson Golden Knights are an intercollegiate athletics team representing Clarkson University in intercollegiate athletics. The men's team is a traditional power in the ECAC. The women's team is far younger, beginning play in 2003, than the men's team, although they too have become an ECAC power. The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When is the peach bowl played this year?", "passages": [ [ "2016 Peach Bowl", "2016 Peach Bowl\n\nThe 2016 Peach Bowl was a college football bowl game played on December 31, 2016 at the Georgia Dome in Atlanta, Georgia.", "It was one of the 2016\u201317 bowl games concluding the 2016 FBS football season.", "The 49th Peach Bowl was a College Football Playoff semifinal, with the winner of this game advancing to play the winner of the 2016 Fiesta Bowl in the 2017 College Football Playoff National Championship.", "This was the final edition of the Peach Bowl (and final college football game) contested in the Georgia Dome, as the stadium was demolished on November 20, 2017 after its replacement, Mercedes-Benz Stadium, opened on August 26 of the same year.", "Sponsored by Chick-fil-A, the game was officially known as the College Football Playoff Semifinal at the Chick-fil-A Peach Bowl.", "The game was televised on ESPN with a radio broadcast on ESPN Radio.", "The winner of the game received the George P. Crumbley Trophy, named for the founder of the original Peach Bowl.", "On Sunday December 4, 2016, the CFP Semifinals were announced, with #1 Alabama vs. #4 Washington playing in the Peach Bowl.", "This was the fifth meeting between the schools, with Alabama having won all four previous encounters.", "Their most recent meeting was at the 1986 Sun Bowl, where the Crimson Tide defeated the Huskies by a score of 28\u20136." ], [ "Peach Bowl", "Peach Bowl\n\nThe Peach Bowl is an annual college football bowl game played in Atlanta since December 1968.", "Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl.", "From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl.", "The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta.", "Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game.", "Between 1993 and 2016, the Georgia Dome played host.", "The bowl then moved to Mercedes-Benz Stadium starting in 2017.", "Since the 2014 season, the Peach Bowl has featured College Football Playoff matchups, with the 2016, 2019, 2022, and 2025 games hosting a national semifinal.", "Seven of the first ten meetings (all but the 1968, 1971, and 1974 games) pitted an Atlantic Coast Conference team against an at-large opponent.", "The bowl had no automatic berths prior to 1993, but usually featured an ACC team or a team from the Southeastern Conference.", "From 1993 until 2013, the game matched a SEC team against one from the ACC.", "From 1993 to 2005, this matchup was the third selection from the ACC against the fourth from the SEC.", "In 2005, the bowl hosted its first-ever matchup of top 10 ranked teams." ], [ "2014 Peach Bowl", "2014 Peach Bowl\n\nThe 2014 Peach Bowl was a college football bowl game that was played on December 31, 2014, at the Georgia Dome in Atlanta, Georgia.", "The 47th Peach Bowl was one of the \"New Year's Six\" bowl games in the College Football Playoff.", "It was one of the 2014\u201315 bowl games that concluded the 2014 FBS football season.", "The game started at 12:30 PM.", "It was televised on ESPN and ESPN Deportes, and broadcast on ESPN Radio and XM Satellite Radio.", "The 2014 Peach Bowl featured the TCU Horned Frogs of the Big 12 Conference against the Ole Miss Rebels of the Southeastern Conference.", "TCU defeated Ole Miss by a score of 42\u20133.", "Sponsored by the Chick-fil-A restaurant franchise, the game was officially known as the Chick-fil-A Peach Bowl.", "This was the first time since 2005 that the game was called the Peach Bowl.", "Between 2006 and 2013 it was known as the Chick-fil-A Bowl.", "The College Football Playoff Selection Committee selected #6 TCU Horned Frogs and the #9 Ole Miss Rebels to participate in the game.", "TCU was the Big 12 Conference Co-Champions, while Ole Miss was an at-large team, finishing in 3rd place in the SEC West.", "This was the seventh overall meeting between these two teams, with Ole Miss previously leading the series 5\u20131." ] ], "gold": "The Peach Bowl is an annual college football bowl game played in Atlanta, Georgia since December 1968. Since 1997, it has been sponsored by Chick-fil-A and is officially known as the Chick-fil-A Peach Bowl. The bowl game has been played on the following dates recently: December 31, 2014; December 31, 2015; and December 31, 2016.", "prediction 1": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. Since the 2014 season, the Peach Bowl has featured College Football Playoff matchups, with the 2016, 2019, 2022, and 2025 games hosting a national semifinal. The 2017 Peach Bowl was played on December 30, 2017 at the Mercedes-Benz Stadium in Atlanta, Georgia.", "prediction 2": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997 it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as the Chick-fil-A Bowl. The 2014 Peach Bowl was one of the New Year's Six bowl games in the College Football Playoff. The 2016 Peach Bowl was one of the 2016\u201317 bowl games concluding the 2016 FBS football season.", "prediction 3": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl. The 2014 Peach Bowl was played on December 31, 2014, at the Georgia Dome in Atlanta, Georgia.", "prediction 4": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. The 2016 Peach Bowl was played on December 31, 2016 at the Georgia Dome in Atlanta, Georgia. The 2014 Peach Bowl was one of the New Year's Six bowl games in the College Football Playoff.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 352 }, { "error type": "Irrelevant", "explanation": "", "start": 405, "end": 454 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. The 2016 Peach Bowl was played on December 31, 2016. The 2017 Peach Bowl was played on December 30, 2017 ." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who showed that our universe is heliocentric the planets of the solar system revolve around the sun?", "passages": [ [ "Heliocentrism", "Heliocentrism\n\nHeliocentrism is the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System.", "Historically, heliocentrism was opposed to geocentrism, which placed the Earth at the center.", "The notion that the Earth revolves around the Sun had been proposed as early as the 3rd century BC by Aristarchus of Samos, but at least in the medieval world, Aristarchus's heliocentrism attracted little attention\u2014possibly because of the loss of scientific works of the Hellenistic Era.", "It was not until the 16th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus, leading to the Copernican Revolution.", "In the following century, Johannes Kepler introduced elliptical orbits, and Galileo Galilei presented supporting observations made using a telescope.", "With the observations of William Herschel, Friedrich Bessel, and other astronomers, it was realized that the sun, while near the barycenter of the solar system, was not at any center of the universe." ], [ "Aristarchus of Samos", "Aristarchus of Samos\n\nAristarchus of Samos (; , \"Aristarkhos ho Samios\"; c. 310 \u2013 c. 230 BC) was an ancient Greek astronomer and mathematician who presented the first known heliocentric model that placed the Sun at the center of the known universe with the Earth revolving around it.", "He was influenced by Philolaus of Croton, but Aristarchus identified the \"central fire\" with the Sun, and he put the other planets in their correct order of distance around the Sun.", "Like Anaxagoras before him, he suspected that the stars were just other bodies like the Sun, albeit further away from Earth.", "His astronomical ideas were often rejected in favor of the incorrect geocentric theories of Aristotle and Ptolemy.", "Nicolaus Copernicus attributed the heliocentric theory to Aristarchus." ] ], "gold": "Heliocentrism, the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System, has been proposed as early as the 3rd century BC by Aristarchus of Samos. But it was not until the 16th century that a mathematical model was presented, by Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus. In the following century, Galileo Galilei presented supporting observations made using a telescope.", "prediction 1": "Heliocentrism is the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System. It was not until the 16th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus, leading to the Copernican Revolution.\n", "prediction 2": "Heliocentrism is the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System. It was not until the 16th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus, leading to the Copernican Revolution. It was not until the 20th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and philosopher, who presented the first known heliocentric model that placed the Learxtolaus of Samos, Aristarchus of Samos, who identified the \"central fire\" with the Sun.", "prediction 3": "Heliocentrism is the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System. The notion that the Earth revolves around the Sun had been proposed as early as the 3rd century BC by Aristarchus of Samos, but at least in the medieval world, Aristarchus's heliocentrism attracted little attention\u2014possibly because of the loss of scientific works of the Hellenistic Era. It was not until the 16th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus, leading to the Copernican Revolution.", "prediction 4": "Heliocentrism, in astronomy, is the astronomical model, in which the Earth and planets revolve around the Sun, the center of the Solar System. And it was pointed out by Nicolaus Copernicus, a mathematician and astronomer of the Renaissance, in the 16th century that a mathematical model of a heliocentric system was presented, leading to the Copernican Revolution.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Heliocentrism is the astronomical model in which the Earth and planets revolve around the Sun at the center of the Solar System. The notion that the Earth revolves around the Sun had been proposed as early as the 3rd century BC by Aristarchus of Samos. It was not until the 16th century that a mathematical model of a heliocentric system was presented, by the Renaissance mathematician, astronomer, and Catholic cleric Nicolaus Copernicus, leading to the Copernican Revolution. In the following century, Johannes Kepler introduced elliptical orbits, and Galileo Galilei presented supporting observations made using a telescope.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who gave the idea of constituent assembly for india?", "passages": [ [ "Constituent Assembly of India", "Constituent Assembly of India\n\nThe Constituent Assembly of India was elected to write the Constitution of India.", "Following India's independence from Great Britain in 1947, its members served as the nation's first Parliament.", "An idea for a Constituent Assembly was proposed in 1934 by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy.", "It became an official demand of the Indian National Congress in 1935, C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise, and was accepted by the British in August 1940.", "On 8 August 1940, a statement was made by Viceroy Lord Linlithgow about the expansion of the Governor-General's Executive Council and the establishment of a War Advisory Council.", "This offer, known as the August Offer, included giving full weight to minority opinions and allowing Indians to draft their own constitution.", "Under the Cabinet Mission Plan of 1946, elections were held for the first time for the Constituent Assembly.", "The Constitution of India was drafted by the Constituent Assembly, and it was implemented under the Cabinet Mission Plan on 16 May 1946.", "The members of the Constituent Assembly were elected by the provincial assemblies by a single, transferable-vote system of proportional representation." ], [ "Constituent assembly", "Further, 67% of the voters declared their support for equal voting rights (one person, one vote) and 83% declared their support for national ownership of natural resources, two key provisions of the bill.", "Parliament has failed to ratify the bill, however, inviting accusations that the political class is trying to thwart the will of the people by disrespecting the result of the 2012 constitutional referendum.", "The Constituent Assembly of India was elected to write the Constitution of India, and served as its first Parliament as an independent nation.", "It was set up as a result of negotiations between the leaders of the Indian independence movement and members of the British Cabinet Mission.", "The constituent assembly was elected indirectly by the members of the Provincial legislative assembly, which existed under the British Raj.", "It first met on December 9, 1946, in Delhi.", "On August 15, 1947, India became an independent nation, and the Constituent Assembly started functioning as India's Parliament.", "Dr. Ambedkar drafted the Constitution of India in conjunction with the requisite deliberations and debates in the Constituent Assembly.", "The Assembly approved the Constitution on November 26, 1949 (celebrated as Constitution Day), and it took effect on January 26, 1950 \u2014 a day now commemorated as Republic Day in India.", "Once the Constitution took effect, the Constituent Assembly became the Provisional Parliament of India\n\nThe Constitutional Assembly of Indonesia was established to draw up a permanent constitution." ] ], "gold": "The Constituent Assembly of India was elected to frame the Constitution of India and was elected by the 'Provincial Assembly'. Following India's independence from British Government in 1947, its members served as the nation's first Parliament. An idea for a Constituent Assembly was proposed in 1934 by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy. It became an official demand of the Indian National Congress in 1935, C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise, and was accepted by the British in August 1940.", "prediction 1": "An idea for a Constituent Assembly for India was proposed in 1934 by M. N. Roy, pioneer of the Communist movement in India and an advocate of radical democracy. It became an official demand of the Indian National Congress in 1935, C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise, and was accepted by the British in August 1940. The Constituent Assembly of India was elected to write the Constitution of India, and served as its first Parliament as an independent nation.", "prediction 2": "The Constituent Assembly of India was elected to write the Constitution of India. Following India's independence from Great Britain in 1947, its members served as the nation's first Parliament. The idea for a Constituent Assembly was proposed in 1934 by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy. On 15 November 1939, C. Rajagopalachari voiced the demand for a Constituent Assembly.", "prediction 3": "The Constituent Assembly of India was set up in 1934 as a result of negotiations between the leaders of the Indian independence movement and members of the British Cabinet Mission. A proposal for a Constituent Assembly was made by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy. C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise and was accepted by the British in August 1940.", "prediction 4": "The idea for a Constituent Assembly for India was proposed in 1934 by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy. C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise, and was accepted by the British in August 1940. The Constituent Assembly of India was elected to write the Constitution of India, and served as its first Parliament as an independent nation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 531 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": " The Constituent Assembly of India was elected to frame the Constitution of India and was elected by the 'Provincial Assembly'. Following India's independence from British Government in 1947, its members served as the nation's first Parliament. An idea for a Constituent Assembly was proposed in 1934 by M. N. Roy, a pioneer of the Communist movement in India and an advocate of radical democracy. It became an official demand of the Indian National Congress in 1935, C. Rajagopalachari voiced the demand for a Constituent Assembly on 15 November 1939 based on adult franchise, and was accepted by the British in August 1940. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is playing alfs wife martha in home and away?", "passages": [ [ "Martha MacKenzie", "Martha MacKenzie\n\nMartha Jane MacKenzie (also Stewart, previously Holden) is a fictional character from the Australian Channel Seven soap opera \"Home and Away\", played by Jodi Gordon.", "Martha made her first on-screen appearance on 8 September 1988.", "She was originally played by Burcin Kapkin.", "In 2005, the character returned to \"Home and Away\", played by Jodi Gordon.", "Gordon was a model and she took acting lessons before auditioning for the role.", "Gordon won a Logie Award for \"Most Popular New Female Talent\" in 2006 and she earned several more award nominations for her portrayal of Martha.", "Martha returned on screen on 30 March 2005.", "Martha was described as being friendly, feisty and fun loving.", "Martha's appearance has evolved throughout her time in the show: she was initially a tomboy who loved sport, but she later became a stylish woman.", "Upon her return in March 2005, Martha's storylines saw her surviving a helicopter crash, having an abortion and a miscarriage, battling alcoholism, being diagnosed with breast cancer and becoming a widow after her husband was shot.", "In a controversial storyline Martha worked as a pole dancer; the scenes were criticised by the broadcasting regulator for their content.", "Whilst playing Martha, Gordon was at the center of a number of personal scandals, which put her future in the show in doubt." ], [ "Sons and Daughters (Australian TV series)", "One such cliffhanger featured character Alison Carr (Belinda Giblin) being bitten by a venomous snake, which had been hidden in a wall safe that Alison broke into to steal documents from villain Wayne Hamilton played by Ian Rawlings.", "Though the snake used, a python, would have a non lethal bite, that storyline featuring the infamous snake cliffhanger was often credited as a way to try and increase ratings for the show.", "Another rather spurious storyline featured a bomb being hidden in the bottom of wheelchair that killed off Barney Adams, a love interest of Fiona Thompson, when it exploded.", "The show gained a cult following and has been repeated more than once in both Australian and international territories.", "\"Sons and Daughters\" won the 1983 Logie Award for Most Popular Australian Drama.", "Rowena Wallace was the most nominated actress of the soap and was nominated for a Gold Logie Award for Most Popular Personality on Australian Television at the 26th Annual TV Week Logie Awards in 1984, and went on to win the award the following year in 1985.", "She was the first woman to win the award since it was opened up to Most Popular Australian Personality." ], [ "Tom Fletcher (Home and Away)", "Ten years later, Frank is still living with the Fletchers and they have since taken on four more children; Carly Morris (Sharyn Hodgson); Steven Matheson (Adam Willits); Lynn Davenport (Helena Bozich); and Sally Keating (Kate Ritchie).", "Following Tom's 40th birthday, his boss informs him he has been retrenched.", "Jarvis worries about the children's welfare but the Fletchers are determined not to lose them so they sell the house, pack up and move to the coastal town of Summer Bay.", "Shortly after the Fletchers arrive, Tom and Pippa purchase Summer Bay House and the Caravan Park from Alf Stewart (Ray Meagher), who had lived there with his late wife, Martha (Alison Mulvaney), and their daughter, Roo (Justine Clarke).", "They quickly make friends in the community including park tenants Floss (Sheila Kennelly) and Neville McPhee (Frank Lloyd) and local shopkeeper Ailsa Hogan (Judy Nunn).", "Tom makes an enemy of neighbour Donald Fisher (Norman Coburn) after he and Pippa foster local tearaway Bobby Simpson (Nicolle Dickson).", "Fisher sets about making life difficult for Tom, who struggles find to work." ] ], "gold": "Martha MacKenzie is a fictional character from the Australian Channel Seven soap opera Home and Away, commonly described as being friendly, feisty and fun loving. In 1989, the character was portrayed by actress Alison Mulvaney, with Martha returning to the show in 2005, played by Jodi Gordon. From 2018, the role has been in the hands of Belinda Giblin.", "prediction 1": "Alison Mulvaney plays Alf Stewart's wife in the TV show Home and Away. In the 2005 version of Home and Away, Martha is played by Jodi Gordon. Alison Mulvaney plays Martha's daughter Roo on the 2005 version.", "prediction 2": "Alison Mulvaney plays Martha Jane MacKenzie, a fictional character from the Australian Channel Seven soap opera Home and Away. In 2005 the character returned to the show, played by Jodi Gordon. Martha made her first on-screen appearance on 8 September 1988. She was originally played by Burcin Kapkin.", "prediction 3": "Alison Mulvaney plays Martha Jane MacKenzie in the Australian TV soap opera Home and Away. In 2005, Martha returned to the show and is played by Jodi Gordon. In the 1983 television series Sons and Daughters, Alison was the most nominated actress. In the 2005 version of Home and Away, Alison was the first to play the role of Martha.", "prediction 4": "Alison Mulvaney plays Martha Stewart in Home and Away. In 2005, the character returned to the Australian Channel Seven soap opera, played by Jodi Gordon. In the Australian television series Sons and Daughters, Martha was played by Rowena Wallace.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 142, "end": 206 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Martha MacKenzie is a fictional character from the Australian Channel Seven soap opera Home and Away, commonly described as being friendly, feisty and fun loving. Alison Mulvaney plays Alf Stewart's wife in the TV show Home and Away. In the 2005 version of Home and Away, Martha is played by Jodi Gordon. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who presided over the muslim league session at dhaka?", "passages": [ [ "All-India Muslim League", "The Simla Deputation reconsidered the issue in October 1906 and decided to frame the objectives of the party on the occasion of the annual meeting of the Educational Conference, which was scheduled to be held in Dhaka.", "Meanwhile, Nawab Salimullah Khan published a detailed scheme through which he suggested the party to be named All-India Muslim Confederacy.", "Pursuant upon the decisions taken earlier at the Lucknow meeting and later in Simla, the annual meeting of the All-India Muhammadan Educational Conference was held in Dhaka from 27 December until 30 December 1906.", "Three thousand delegates attended, headed by both Nawab Waqar-ul-Mulk and Nawab Muhasan-ul-Mulk (the Secretary of the Muhammaden Educational Conference), in which they explained its objectives and stressed the unity of Muslims under the banner of an association.", "It was formally proposed by Nawab Salimullah Khan and supported by Hakim Ajmal Khan, Maulana Muhammad Ali Jauhar, Zafar Ali Khan, Syed Nabiullah, a barrister from Lucknow, and Syed Zahur Ahmad, an eminent lawyer, as well as several others.", "Sir Sultan Muhammad Shah (Aga Khan III) was appointed the first honorary president of the Muslim League, though he did not attend the Dhaka inaugural session." ], [ "All-India Muslim League", "There were also six vice-presidents, a secretary, and two joint secretaries initially appointed for a three-year term, proportionately from different provinces.", "The League's constitution was framed in 1907, espoused in the \"Green Book,\" written by Maulana Mohammad Ali.", "Aga Khan III shared Ahmad Khan's belief that Muslims should first build up their social capital through advanced education before engaging in politics, but would later boldly tell the British Raj that Muslims must be considered a separate nation within India.", "Even after he resigned as president of the AIML in 1912, he still exerted a major influence on its policies and agendas.", "In 1913, Mohammed Ali Jinnah joined the Muslim league.", "Intellectual support and a cadre of young activists emerged from Aligarh Muslim University.", "Historian Mushirul Hasan writes that in the early 20th century, this Muslim institution, designed to prepare students for service to the British Raj, exploded into political activity.", "Until 1939, the faculty and students supported an all-India nationalist movement.", "After 1939, however, sentiment shifted dramatically toward a Muslim separatist movement, as students and faculty mobilised behind Jinnah and the Muslim League.", "Politically, there was a degree of unity between Muslim and Hindu leaders after World War I, as typified by the Khilafat Movement.", "Relationships cooled sharply after that campaign ended in 1922." ], [ "All-India Muslim League", "All-India Muslim League\n\n", "The All-India Muslim League (popularised as Muslim League) was a political party established during the early years of the 20th century in the British Indian Empire.", "Its strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire.", "The party arose out of a literary movement begun at The Aligarh Muslim University in which Syed Ahmad Khan was a central figure.", "It remained an elitist organisation until 1937 when the leadership began mobilising the Muslim masses and the league then became a popular organisation.", "In the 1930s, the idea of a separate nation-state and influential philosopher Sir Muhammad Iqbal's vision of uniting the four provinces in North-West British India further supported the rationale of the two-nation theory.", "With global events leading up to World War II and the Congress party's effective protest against the United Kingdom unilaterally involving India in the war without consulting the Indian people, the Muslim League went on to support the British war efforts.", "The Muslim League played a decisive role in the 1940s, becoming a driving force behind the division of India along religious lines and the creation of Pakistan as a Muslim state in 1947.", "After the partition and subsequent establishment of Pakistan, the Muslim League continued as a minor party in India where it was often part of the government." ] ], "gold": "The Muslim League was a political party established in 1906 in British India that campaigned for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully leading to the partition of India in 1947 by the British Empire. Sir Sultan Muhammad Shah (Aga Khan III) was appointed the first honorary president of the Muslim League, though he did not attend the Dhaka inaugural session, which was ultimately presided by both Nawab Waqar-ul-Mulk Kamboh and Nawab Muhasan-ul-Mulk.", "prediction 1": "The All-India Muslim League, popularised as Muslim League, was a political party established during the early years of the 20th century in the British Indian Empire. Its strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire. Sir Sultan Muhammad Shah (Aga Khan III) was appointed the first honorary president of the Muslim League, though he did not attend the Dhaka inaugural session.", "prediction 2": "The All-India Muslim League was a political party established during the early years of the 20th century in the British Indian Empire. Its strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire. The first session of the Muslim League at Dhaka was presided over by Nawab Waqar-ul-Mulk, who was also the secretary of the Muhammaden Educational Conference. The Simla Deputation reconsidered the issue in October 1906 and decided to frame the objectives of the party on the occasion of the annual meeting of the All-India Muhammadan Educational Conference, which was scheduled to be held in Dhaka. The first session of the Muslim League session of the All-India Muhammadan Educational Conference was held in Dhaka. Sir Sultan Muhammad Shah, who was appointed the first honorary president of the Muslim League, though", "prediction 3": "The All-India Muslim League, popularised as Muslim League, was a political party established during the early years of the 20th century in the British Indian Empire. Its strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire. Nawab Salimullah Khan presided over the inaugural session at Dhaka. Nawab Waqar-ul-Mulk presided over the inaugural session at Dhaka. Aga Khan III was appointed the first honorary president of the Muslim League, though he did not attend the session at Dhaka.", "prediction 4": "The All-India Muslim League (Aga Khan III) was an Indian Muslim political party whose strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire. In 1906, Sir Sultan Muhammad Shah, also known as Aga Khan III, presided over the inaugural session of the Muslim League held in Dhaka.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The All-India Muslim League, popularised as Muslim League, was a political party established during the early years of the 20th century in the British Indian Empire. Its strong advocacy for the establishment of a separate Muslim-majority nation-state, Pakistan, successfully led to the partition of British India in 1947 by the British Empire. Sir Sultan Muhammad Shah (Aga Khan III) was appointed the first honorary president of the Muslim League, though he did not attend the Dhaka 1906 inaugural session, which was ultimately presided by both Nawab Waqar-ul-Mulk Kamboh and Nawab Muhasan-ul-Mulk." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Where is the tower of babel in the bible?", "passages": [ [ "Tower of Babel", "Tower of Babel\n\nThe Tower of Babel (, \"Migdal Bavel\") as told in Genesis 11:1-9 is an origin myth meant to explain why the world's peoples speak different languages.", "According to the story, a united humanity in the generations following the Great Flood, speaking a single language and migrating eastward, comes to the land of Shinar ().", "There they agree to build a city and a tower tall enough to reach heaven.", "God, observing their city and tower, confounds their speech so that they can no longer understand each other, and scatters them around the world.", "Some modern scholars have associated the Tower of Babel with known structures, notably the Etemenanki, a ziggurat dedicated to the Mesopotamian god Marduk by Nabopolassar, the king of Babylonia circa 610 BCE.", "The Great Ziggurat of Babylon was in height.", "Alexander the Great ordered it to be demolished circa 331 BCE in preparation for a reconstruction that his death forestalled.", "A Sumerian story with some similar elements is told in \"Enmerkar and the Lord of Aratta\".", "The phrase \"Tower of Babel\" does not appear in the Bible; it is always \"the city and the tower\" () or just \"the city\" ()." ], [ "Archaeology and the Book of Mormon", "Archaeology and the Book of Mormon\n\nSince the publication of the Book of Mormon in 1830, Mormon archaeologists have attempted to find archaeological evidence to support it.", "Members of The Church of Jesus Christ of Latter-day Saints (LDS Church) and other denominations of the Latter Day Saint movement generally believe that the Book of Mormon describes ancient historical events in the Americas, but historians and archaeologists do not regard it as a work of ancient American history.", "The Book of Mormon describes God's dealings with three civilizations in the Americas over the course of several hundred years.", "The book primarily deals with the Nephites and the Lamanites, who - it states - existed in the Americas from about 600 BC to about AD 400.", "It also deals with the rise and fall of the Jaredite nation, which the Book of Mormon says came from the Old World shortly after the confounding of the languages at the Tower of Babel.", "Some early-20th century Mormon researchers claimed various archaeological findings such as place names, and ruins of the Inca, Maya, Olmec, and other ancient American and Old World civilizations as giving credence to the Book of Mormon record.", "Others disagree with these conclusions, arguing that the Book of Mormon mentions several animals, plants, and technologies that are not substantiated by the archaeological record of the period 3100 BC to 400 AD in the Americas." ] ], "gold": "The Tower of Babel narrative in Genesis 11:1-9 is an origin myth meant to explain why the world's peoples speak different languages. The church firmly believes in the factual nature of at least one \"great tower\" built in the region of ancient Sumeria, Assyria, or Babylonia.", "prediction 1": "The phrase \"Tower of Babel\" does not appear in the Bible. It is always \"the city and the tower\" or just \"the city\" ().", "prediction 2": "The phrase \"Tower of Babel\" does not appear in the Bible; it is always the city and the tower or just the city.", "prediction 3": "The phrase \"Tower of Babel\" does not appear in the Bible, instead it is always \"the city and the tower\" () or just \"the city\" ().", "prediction 4": "The phrase \"Tower of Babel\" does not appear in the bible; it is always \"the city and the tower\" or just \"the city\". The Book of Mormon describes God's dealings with three civilizations in the Americas over the course of several hundred years.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 57 }, { "error type": "Incoherent", "explanation": "", "start": 58, "end": 118 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Tower of Babel narrative in Genesis 11:1-9 is an origin myth meant to explain why the world's peoples speak different languages. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When did we begin to stand for the national anthem?", "passages": [ [ "The Star-Spangled Banner", "On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played.", "That revision also directed men and women to place their hands over their hearts only if the flag was displayed.", "Those in uniform were required to salute.", "On July 7, 1976, the law was simplified.", "Men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting.", "On August 12, 1998, the law was rewritten keeping the same instructions, but differentiating between \"those in uniform\" and \"members of the Armed Forces and veterans\" who were both instructed to salute during the playing whether or not the flag was displayed.", "Because of the changes in law over the years and confusion between instructions for the Pledge of Allegiance versus the National Anthem, throughout most of the 20th century many people simply stood at attention or with their hands folded in front of them during the playing of the Anthem, and when reciting the Pledge they would hold their hand (or hat) over their heart.", "After 9/11, the custom of placing the hand over the heart during the playing of the national anthem became nearly universal." ] ], "gold": "When the U.S. national anthem was first recognized by law in 1931, there was no prescription as to behavior during its playing. On June 22, 1942, the law was revised indicating that those in uniform should salute during its playing, others should stand at attention, men should remove their hats, and women should place their hands over their hearts when the flag is present. On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played and it also directed men and women to place their hands over their hearts only if the flag was displayed. On July 7, 1976, the law was simplified, instructing men and women to stand with their hands over their hearts, men to remove their hats, whether or not the flag was displayed and those in uniform to salute. ", "prediction 1": "On July 7, 1976, the law was simplified and men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. Because of the changes in law over the years and confusion between instructions for the Pledge of Allegiance versus the National Anthem, throughout most of the 20th century many people simply stood at attention or with their hands folded in front of them during the playing of the Anthem, and when reciting the Pledge they would hold their hand (or hat) over their heart. After 9/11, the custom of placing the hand over the heart during the playing of the Anthem became nearly universal.", "prediction 2": "On December 24, 1921, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played. That revision also directed men and women to place their hands over their hearts only if the flag was displayed. Those in uniform were required to salute. On July 7, 1976, the law was simplified. Men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. On August 12, 1998, the law was rewritten keeping the same instructions, but differentiating between \"those in uniform\" and \"members of the Armed Forces and veterans\" who were both instructed to salute during the playing whether or not the flag was displayed.", "prediction 3": "On July 7, 1976, the law was simplified and men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. On August 12, 1998, the law was rewritten keeping the same instructions, but differentiating between \"those in uniform\" and \"members of the Armed Forces and veterans\" who were both instructed to salute during the playing whether or not the flag was displayed. After 9/11, the custom of placing the heart during the playing of the national anthem became nearly universal.", "prediction 4": "On July 7, 1976, the law was simplified. Men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played. After 9/11, the custom of placing the hand over the heart during the playing of the national anthem became nearly universal.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 600 }, { "error type": "Irrelevant", "explanation": "", "start": 601, "end": 716 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played. That revision also directed men and women to place their hands over their hearts only if the flag was displayed. On July 7, 1976, the law was simplified and men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Which group of organisms is most commonly responsible for red tides?", "passages": [ [ "Algal bloom", "Examples of common harmful effects of HABs include:\n\nDue to their negative economic and health impacts, HABs are often carefully monitored.", "HABs occur in many regions of the world, and in the United States are recurring phenomena in multiple geographical regions.", "The Gulf of Maine frequently experiences blooms of the dinoflagellate \"Alexandrium fundyense\", an organism that produces saxitoxin, the neurotoxin responsible for paralytic shellfish poisoning.", "The well-known \"Florida red tide\" that occurs in the Gulf of Mexico is a HAB caused by \"Karenia brevis\", another dinoflagellate which produces brevetoxin, the neurotoxin responsible for neurotoxic shellfish poisoning.", "California coastal waters also experience seasonal blooms of \"Pseudo-nitzschia\", a diatom known to produce domoic acid, the neurotoxin responsible for amnesic shellfish poisoning.", "Off the west coast of South Africa, HABs caused by \"Alexandrium catanella\" occur every spring.", "These blooms of organisms cause severe disruptions in fisheries of these waters as the toxins in the phytoplankton cause filter-feeding shellfish in affected waters to become poisonous for human consumption." ], [ "Red tide", "Red tide is also sometimes used to describe harmful algal blooms on the northeast coast of the United States, particularly in the Gulf of Maine.", "This type of bloom is caused by another species of dinoflagellate known as \"Alexandrium fundyense\".", "These blooms of organisms cause severe disruptions in fisheries of these waters, as the toxins in these organism cause filter-feeding shellfish in affected waters to become poisonous for human consumption due to saxitoxin.", "The related \"Alexandrium monilatum\" is found in subtropical or tropical shallow seas and estuaries in the western Atlantic Ocean, the Caribbean Sea, the Gulf of Mexico, and the eastern Pacific Ocean.", "Red tides contain dense concentrations of organisms and appear as discolored water, often reddish-brown in color.", "It is a natural phenomenon, but the exact cause or combination of factors that result in a red tide outbreak are not necessarily known.", "However, three key factors are thought to play an important role in a bloom - salinity, temperature, and wind.", "Red tides cause economic harm, so outbreaks are carefully monitored.", "For example, the Florida Fish and Wildlife Conservation Commission provides an up-to-date status report on red tides in Florida.", "The Texas Parks and Wildlife Department also provides a status report.", "While no particular cause of red tides has been found, many different factors can contribute to their presence." ], [ "Red tide", "Red tide\n\nRed tide is a common name for algae blooms, which are large concentrations of aquatic microorganisms (protozoans or unicellular algae such as dinoflagellates and diatoms).", "The upwelling of nutrients from the sea floor, often following massive storms, provides for the algae and triggers bloom events.", "Harmful algal blooms can occur worldwide, and natural cycles can vary regionally.", "The growth and persistence of an algal bloom depends on wind direction and strength, temperature, nutrients, and salinity.", "Red tide species can be found in oceans, bays, and estuaries, but they cannot thrive in freshwater environments.", "Certain species of phytoplankton and dinoflagellates found in red tides contain photosynthetic pigments that vary in color from brown to red.", "When the algae are present in high concentrations, the water may appear to be discolored or murky.", "The most conspicuous effects of red tides are the associated wildlife mortalities and harmful human exposure.", "The production of natural toxins such as brevetoxins and ichthyotoxins are harmful to marine life.", "Red tides occur naturally off coasts all over the world.", "Marine dinoflagellates produce ichthyotoxins, but not all red tides are harmful." ] ], "gold": "Red tides are a phenomenon of discoloration of sea surface. It is a common name for harmful algal blooms occurring along coastal regions, which result from large concentrations of aquatic microorganisms, such as protozoans and unicellular algae. Gymnodinium nagasakiense is most commonly responsible for red tides. The well-known \"Florida red tide\" that occurs in the Gulf of Mexico is a HAB caused by \"Karenia brevis\", another dinoflagellate which produces brevetoxin, the neurotoxin responsible for neurotoxic shellfish poisoning. California coastal waters also experience seasonal blooms of \"Pseudo-nitzschia\", a diatom known to produce domoic acid, the neurotoxin responsible for amnesic shellfish poisoning.", "prediction 1": "Red tides are a common name for algae blooms, which are large concentrations of aquatic microorganisms, such as dinoflagellates and diatoms. The most commonly responsible organisms for red tides are dinoflagellates, marine dinoflagellates, and cyanobacteria. Harmful algal blooms can occur worldwide, and natural cycles can vary regionally. Red tides contain dense concentrations of organisms and appear as discolored water, often reddish-brown in color.", "prediction 2": "Red tide is a common name for algae blooms, which are large concentrations of aquatic microorganisms such as dinoflagellates and diatoms. Marine dinoflagellates produce ichthyotoxins, but not all red tides are harmful.", "prediction 3": "Red tide is a common name for algae blooms, which are large concentrations of aquatic microorganisms such as dinoflagellates and diatoms. Red tides contain dense concentrations of organisms and appear as discolored water, often reddish-brown in color. The Gulf of Maine frequently experiences blooms of the dinoflagellate Alexandrium fundyense, an organism that produces saxitoxin, the neurotoxin responsible for paralytic shellfish poisoning. The well-known Florida Red tide is a HAB caused by Karenia brevis, another dinoflagellate, another species of dinoflagellates, another dinoflagellate that produces brevetoxin, the neurotoxin responsible for neurotoxic shellfish poisonous for human consumption due to s in the phytoplanktoxin in these organisms cause severe disruptions in fisheries of these", "prediction 4": "Red tides are natural phenomena caused by large concentrations of aquatic microorganisms, such as dinoflagellates and diatoms. Dinoflagellates, or protozoans, are the organisms responsible for red tides. The Gulf of Maine frequently experiences blooms of the dinoflagellate \"Alexandrium fundyense\", an organism that produces saxitoxin, the neurotoxin responsible for paralytic shellfish poisoning. The well-known \"Florida red tide\" that occurs in the Gulf of Mexico is a HAB caused by \"Alexandrium catanella\", another species of dinoflagellates known to produce brevetoxin, the neurotoxic shellfish in affected waters to become poisonous for human consumption due to domoic acid.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 141, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 454 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Red tides are a common name for algae blooms, which are large concentrations of aquatic microorganisms, such as dinoflagellates and diatoms. The well-known \"Florida red tide\" that occurs in the Gulf of Mexico is a HAB caused by \"Karenia brevis\", another dinoflagellate which produces brevetoxin, the neurotoxin responsible for neurotoxic shellfish poisoning. California coastal waters also experience seasonal blooms of \"Pseudo-nitzschia\", a diatom known to produce domoic acid, the neurotoxin responsible for amnesic shellfish poisoning. " }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "When does amelia come back to grey's anatomy?", "passages": [ [ "Amelia Shepherd", "Amelia Shepherd\n\nAmelia Shepherd, M.D. is a fictional character on the ABC American television medical drama \"Private Practice\", and the spinoff series' progenitor show, \"Grey's Anatomy\", portrayed by Caterina Scorsone.", "In her debut appearance in season three, Amelia visited her former sister-in-law, Addison Montgomery, and became a partner at the Oceanside Wellness Group.", "After \"Private Practice\" ended its run, Scorsone recurred on the tenth season of \"Grey's Anatomy\", before becoming a series regular in season eleven.", "Amelia Shepherd is the youngest sister of Dr. Derek Shepherd, and like her brother, an excellent neurosurgeon.", "Her ambition to prove herself equal to her brother is only surpassed by her surgical skill.", "After graduating in the top of her class at Harvard and completing her surgical residency at Johns Hopkins, she comes to Los Angeles on a medical case and decides to stay after she is fired from her fellowship.", "She asks Naomi Bennett for a job when the two practices merge.", "She has known Dr. Addison Montgomery for many years and views her as a close friend and surrogate sister.", "As a young woman, she was addicted to prescription medication and crashed Derek's car while high.", "When she came home, she overdosed and was dead for three minutes." ], [ "Amelia Shepherd", "Before taking him away for the donation, she decides to hold her baby, where she lifts the cap from his head.", "When the baby goes into respiratory distress in her arms, she momentarily breaks down, wishing for more time, but, then hands the baby over to Addison for the donation.", "Her last words to her son are \"Your daddy is waiting for you in heaven.", "His name is Ryan.\"", "Later on in the series, she gets engaged to Dr. James Peterson, an ER doctor at St. Ambrose Hospital, but breaks it off by moving to Seattle.", "Following the end of \"Private Practice\", when ABC cancelled it after six seasons in January 2013, the character of Amelia was added to its progenitor show \"Grey's Anatomy\".", "In Season 10, she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children.", "Previously, she had only made one-off guest appearances on the show when storylines crossed over between the two series.", "On June 23, 2014, Scorsone and her character was permanently added to the regular cast for Season 11, which began airing in September 2014." ], [ "Caterina Scorsone", "Scorsone's first TV appearances were regular guest spots as a child on the Canadian children's TV show \"Mr. Dressup\" starting at age eight.", "In 1998, she had a role in one of CBC radio's Mystery Project shows called, \"Peggy Delaney\".", "Scorsone played the estranged fifteen-year-old daughter, Amber, who comes from Vancouver to stay with her mom for a school term in Toronto.", "Scorsone had her breakthrough after landing the leading role in the Lifetime crime drama series \"1-800-Missing\", from 2003 to 2006.", "She played the part of Jess Mastriani, a young woman who sees missing persons in visions.", "After Jess saved some missing persons, she joined the FBI, where a special squad was formed around her, to find missing persons.", "In 2009, she starred as Alice Hamilton on the Showcase TV miniseries \"Alice\" which was later broadcast on Syfy in America.", "In 2010, Scorsone joined the cast of Shonda Rhimes' drama series \"Private Practice\" in the recurring role of Amelia Shepherd, the sister of Derek Shepherd from \"Grey's Anatomy\".", "She was cast after Eric Stoltz, who was directing one of the show's episodes, heard about the role of Amelia and remembered Scorsone from working with her on \"My Horrible Year!\"" ] ], "gold": "Amelia Frances Shepherd, M.D., F.A.C.S. is a fictional character on the ABC American television medical drama Private Practice, and the spinoff series' progenitor show, Grey's Anatomy, and is portrayed by Caterina Scorsone. In 2010, Scorsone was recruited to the Private Practice cast as a sister of the main character from Grey's Anatomy and appeared in 5 episodes of season 3 before being promoted to series regular. Following the end of Private Practice in January 2013, the character of Amelia was added to its progenitor show Grey's Anatomy, beginning in season 10, when she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. She became a series regular for season 11 starting on September 25, 2014.", "prediction 1": "Amelia Shepherd is a fictional character on the ABC American television medical drama Private Practice and the spin-off series' progenitor show, Grey's Anatomy. In Season 10, she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. Previously, she had only made one-off guest appearances on the show when storylines crossed over between the two series. Scorsone recurred on the tenth season, before becoming a series regular in season eleven.", "prediction 2": "Amelia Shepherd is a fictional character on the ABC American television medical drama Private Practice, and the spinoff series Grey's Anatomy, played by Caterina Scorsone. In Season 10, she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. Prior to this, she had only made one-off guest appearances on the show when storylines crossed over between the two series. She made her first appearance in Season 3 episode titled \"Stin's Anatomy\". She appeared in Season 7, episode \"Ston 13\".", "prediction 3": "In Season 10, Amelia Shepherd is seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. Previously, she had only made one-off guest appearances on the show when storylines crossed over between the two series. In Season 11, Caterina Scorsone was cast in the role of Amelia Shepherd, the sister of Dr. Derek Shepherd from Grey's Anatomy. Scorsone recurred on the tenth season before becoming a series regular in season 11.", "prediction 4": "Amelia Shepherd is a fictional character on the ABC American television medical drama, Private Practice, and the spinoff series Grey's Anatomy, portrayed by Caterina Scorsone. In Season 10, she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. Previously, she had only made one-off guest appearances on the show when storylines crossed over between the two series. Scorsone was cast after Eric Stoltz, who directing the episode, which aired on the next day before season 11 in September 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 456 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Amelia Shepherd is a fictional character on the ABC American television medical drama Private Practice and the spin-off series' progenitor show, Grey's Anatomy, portrayed by Caterina Scorsone. In 2010, Scorsone joined the cast of Shonda Rhimes' drama series \"Private Practice\" in the recurring role of Amelia Shepherd, the sister of Derek Shepherd from \"Grey's Anatomy\". Following the end of \"Private Practice\", when ABC cancelled it after six seasons in January 2013, the character of Amelia was added to its progenitor show \"Grey's Anatomy\". In Season 10, she was seen in the season's last four episodes visiting her brother Derek and his wife Meredith Grey in their Seattle home and helping care for their children. On June 23, 2014, Scorsone and her character was permanently added to the regular cast for Season 11, which began airing in September 2014. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did the last godzilla movie come out?", "passages": [ [ "Godzilla (2014 film)", "In the United States, the film was given a PG-13 rating by the Motion Picture Association of America (MPAA) for \"intense sequences of destruction, mayhem and creature violence.\"", "The film was released in China on June 13 and in Japan on July 25, 2014.", "In April 2014, Toho had an early screening of \"Godzilla\" and gave a positive review.", "Edwards said, \"They saw it yesterday and I got an e-mail saying they thought it was fantastic!", "So that was a relief.\"", "Legendary also held screenings for the military.", "Legendary estimated that the film would need to gross $380 million worldwide to break even.", "\"Godzilla\" grossed $9.3 million in North America at early Thursday screenings, one of the best late-night openings for a non-sequel, and $93.2 million for the entire weekend, making it the fifth highest opening weekend in 2014.", "Its opening weekend gross broke the records for the highest weekend debuts for a disaster film and a creature feature.", "It was estimated that approximately half of the gross was in 3D screenings.", "In its second weekend, which saw competition from \"\", \"Godzilla\" had a 66% drop.", "At the end of its domestic run, \"Godzilla\" grossed $200.7 million in North America, the lowest total ever for a movie that opened above $90 million." ], [ "Godzilla (2014 film)", "Godzilla (2014 film)\n\nGodzilla is a 2014 American monster film directed by Gareth Edwards.", "The film is a reboot of Toho's \"Godzilla\" franchise and is the 30th film in the \"Godzilla\" franchise, the first film in Legendary's MonsterVerse, and the second \"Godzilla\" film to be completely produced by a Hollywood studio.", "The film stars Aaron Taylor-Johnson, Ken Watanabe, Elizabeth Olsen, Juliette Binoche, Sally Hawkins, David Strathairn, and Bryan Cranston.", "The project began as an IMAX short film in 2004 but was transferred to Legendary in 2009 to be redeveloped as a feature film.", "The film was officially announced in March 2010 and Edwards was announced as the director in January 2011.", "Principal photography began in March 2013 in the United States and Canada and ended in July 2013.", "\"Godzilla\" was released on May 16, 2014 to generally positive reviews, and was a box office success, grossing $200 million domestically and $529.1 million worldwide.", "The film's success prompted Toho to produce a reboot of their own and Legendary to proceed with a shared cinematic franchise, with \"\" set to be released in 2019 and \"Godzilla vs. Kong\" to be released in 2020.", "In 1954, Godzilla, an ancient alpha predator, is lured to an island in an attempt to kill it with a nuclear bomb." ] ], "gold": "Godzilla is a 2014 American monster film directed by Gareth Edwards. It is a reboot of Toho's Godzilla franchise and is the 30th film in the Godzilla franchise, the first film in Legendary's MonsterVerse, and the second Godzilla film to be completely produced by a Hollywood studio. Godzilla had its red carpet premiere at the Dolby Theatre in Hollywood on May 8, 2014. Godzilla received wide release worldwide in 2D, 3D and IMAX 3D beginning May 16, 2014.", "prediction 1": "Godzilla is a 2014 American monster film directed by Gareth Edwards. The film is a reboot of Toho's Godzilla franchise and is the 30th film in the franchise. Godzilla was released on May 16, 2014 to generally positive reviews, and was a box office success, grossing $200 million domestically and $529.1 million worldwide. The next Godzilla film is scheduled to be released in 2020.", "prediction 2": "The last two Godzilla movies came out in 1954, the first in 1954 and the second in 2014. The last two Godzilla movies came out in 1954 on June 13, 1954, and on July 25, 2014.", "prediction 3": "Godzilla is a 2014 American monster film directed by Gareth Edwards. The film is a reboot of Toho's \"Godzilla\" franchise and is the 30th film in the \"Godzilla\" franchise. The film's last theatrical release was on May 16, 2014, in the United States.", "prediction 4": "The last Godzilla movie came out on May 16, 2014. Godzilla is a 2014 American monster film directed by Gareth Edwards. The film is a reboot of Toho's Godzilla franchise and is the 30th film in the \"Godzilla\" franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 321 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 381 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Godzilla is a 2014 American monster film directed by Gareth Edwards. The film is a reboot of Toho's Godzilla franchise and is the 30th film in the franchise, the first film in Legendary's MonsterVerse, and the second Godzilla film to be completely produced by a Hollywood studio. Godzilla was released on May 16, 2014." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Dads name in how to train your dragon?", "passages": [ [ "How to Train Your Dragon: The Hidden World", "How to Train Your Dragon:", "The Hidden World\n\nHow to Train Your Dragon:", "The Hidden World is an upcoming American computer-animated action fantasy film loosely based on the book series of the same name by Cressida Cowell, produced by DreamWorks Animation and distributed by Universal Pictures.", "A sequel to 2010's \"How to Train Your Dragon\" and 2014's \"How to Train Your Dragon 2\", it is the third and final installment in the \"How to Train Your Dragon\" trilogy.", "Written and directed by Dean DeBlois, the film stars the voices of Jay Baruchel, Cate Blanchett, Craig Ferguson, America Ferrera, Jonah Hill, Kit Harington, Christopher Mintz-Plasse, T. J. Miller, Kristen Wiig and F. Murray Abraham.", "This will be the first DreamWorks Animation film to be distributed by Universal Pictures, whose parent company NBCUniversal acquired DWA in 2016, and since the end of their distribution deal with 20th Century Fox.", "The film is slated to be released on February 22, 2019 in the United States.", "After becoming the chief of Berk, Hiccup has fulfilled his dream of creating a peaceful dragon utopia, while the sudden discovery of a wild, elusive mate lures Toothless away." ], [ "David Tennant", "David Tennant\n\nDavid John Tennant (n\u00e9 McDonald; born 18 April 1971) is a Scottish actor and voice actor.", "He is best known for his roles as the Tenth Doctor in the British television series \"Doctor Who\", Alec Hardy in \"Broadchurch\", Giacomo Casanova in the TV serial \"Casanova\", Kilgrave in \"Jessica Jones\", and Barty Crouch, Jr. in the film \"Harry Potter and the Goblet of Fire\".", "In addition to his appearances on screen, he has worked as a voice actor and in theatre, including Prince Hamlet in a critically acclaimed 2008 stage production of \"Hamlet\" and as the voice of Scrooge McDuck in the new \"DuckTales\" series starting in 2017.", "In January 2015, Tennant received the National Television Award for Special Recognition.", "Tennant was born David John McDonald on 18 April 1971 in Bathgate, West Lothian, the son of Alexander \"Sandy\" McDonald (1937\u20132016), a minister who served as the Moderator of the General Assembly of the Church of Scotland, and Helen McLeod (1940\u20132007).", "He grew up with his brother Blair and sister Karen in Ralston, Renfrewshire, where his father was the local minister." ], [ "Gerard Butler", "In 2010 he starred in the action/comedy \"The Bounty Hunter\" with Jennifer Aniston, and did a voice-over for the 2010 animated film \"How to Train Your Dragon\" as Stoick the Vast.", "On 15 and 16 October 2010, thanks to the popularity of his role as Spartan King Leonidas and the use of his lines during athletic events at Michigan State University, he was a guest at their Midnight Madness and homecoming American football game.", ", Butler, while filming \"Playing for Keeps\", was writing songs and in the process of recording an album.", "He disavowed gossip reports that Marilyn Manson and Johnny Depp had advised him on the project.", "On 18 December that year, while filming \"Chasing Mavericks\", Butler was hospitalised after he was pulled under big waves.", "Subsequently, he was taken to Stanford University Medical Center and later released.", "Butler starred in the action thriller \"Olympus Has Fallen\" (2013), opposite co-stars Aaron Eckhart and Morgan Freeman.", "Butler said he broke two bones in his neck while shooting the film, but did not realise this until he had an MRI scan.", "Butler reprised his voice role as Stoick in \"How to Train Your Dragon 2\" in 2014.", "Two years later, Butler had the leading role in the \"Olympus Has Fallen\" sequel \"London Has Fallen\" and also portrayed Set in \"Gods of Egypt\"." ] ], "gold": "How to Train Your Dragon is a 2010 American computer-animated action fantasy film loosely based on the 2003 book of the same name by Cressida Cowell, produced by DreamWorks Animation and distributed by Paramount Pictures. Actor David Tennant, who known for his role in Dr. Who, lends his voice to the character of the dad in the film, named Spitelout. How to Train Your Dragon 2 is the sequel to the film and the second installment in the trilogy. In the sequel, Gerard Butler voiced the role of the dad, who is named Stoick the Vast.", "prediction 1": "How to Train Your Dragon: The Hidden World is an upcoming American computer-animated action fantasy film loosely based on the book series of the same name by Cressida Cowell, produced by DreamWorks Animation and distributed by Universal Pictures. The film is the third and final installment in the How to Train Your Dragon trilogy. It is a sequel to 2010's How to Train Your Dragon and 2014's How to Train Your Dragon 2 and features the voices of Jay Baruchel, Cate Blanchett, Craig Ferguson, America Ferrera, and Jonah Hill.", "prediction 2": "How to Train Your Dragon: The Hidden World is an upcoming American computer-animated action fantasy film loosely based on the book series of the same name by Cressida Cowell, produced by DreamWorks Animation and distributed by Universal Pictures. The film is slated to be released on February 22, 2019 in the United States. Gerard Butler did a voice-over for the 2010 animated film How to Train Your Dragon, as Stoick the Vast. David Tennant voices David's father, Alexander McDonald, along with his son, Blair and sister Karen McLeod; he plays Hiccup, and the father of Hiccup.", "prediction 3": "In the 2010 animated film, How to Train Your Dragon, minister Sandy McDonald voiced Stoick the Vast. In 2014, he voiced Stoick the Vast in the sequel How to Train Your Dragon: The Hidden World.", "prediction 4": "How to Train Your Dragon is an American computer-animated action fantasy film loosely based on the book series of the same name by Cressida Cowell produced by DreamWorks Animation and distributed by Universal Pictures. A sequel to 2010's How to Train Your Dragon and 2014's How to Train Your Dragon 2, it is the third and final installment in the \"How to Train Your Dragon\" trilogy. In addition to his roles on screen, David Tennant voiced the character Stoick the Vast in the 2010 animated film \"How to Train Your Dragon\". In the 2014 video game, Gerard Butler voice-over for the 2014 video game How to Train Your Dragon: How to Train Your Dragon: The Hidden World.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 42 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 331 } ], "missing-info": [], "corrected-prediction": "How to Train Your Dragon is an upcoming American computer-animated action fantasy film loosely based on the book series of the same name by Cressida Cowell, produced by DreamWorks Animation and distributed by Universal Pictures. It is a sequel to 2010's How to Train Your Dragon and 2014's How to Train Your Dragon 2 and features the voices of Jay Baruchel, Cate Blanchett, Craig Ferguson, America Ferrera, and Jonah Hill." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the black ribbon on google for?", "passages": [ [ "Black ribbon", "Black ribbon\n\nA black ribbon is a symbol of remembrance or mourning.", "Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement.", "Similar to a black armband, the black ribbon is a public display of grief.", "Individuals or organizations display the ribbon in commemoration of victims after specific incidents.", "Some examples have included:" ] ], "gold": "What the black ribbon on Google is for depends on the date. For example, on November 25, 2017, it was for victims of the 2017 Sinai mosque attack, while on October 2, 2017, it was for victims of the 2017 Las Vegas shooting. On September 11, 2017, it was for remembering September 11th. A black ribbon is a symbol of remembrance or mourning.", "prediction 1": "The black ribbon on Google is a symbol of remembrance or mourning. Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement. Similar to a black armband, the black ribbon is a public display of grief. Individuals or organizations display the ribbon in commemoration of victims after specific incidents.", "prediction 2": "Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement. Individuals or organizations display the ribbon in commemoration of victims after specific incidents.", "prediction 3": "Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement. Similar to a black armband, the black ribbon is a public display of grief. Individuals or organizations display the ribbon in commemoration of victims after specific incidents.", "prediction 4": "Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement. Similar to a black armband, the black ribbon is a public display of grief. Individuals or organizations display the ribbon in commemoration of victims after specific incidents. Some examples have included: apologies for homicide, a memorial for a loved one, a memorial for a loved one's service, a memorial for a victim of a certain incidents.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 368 } ], "missing-info": [], "corrected-prediction": "The black ribbon on Google is a symbol of remembrance or mourning. Wearing or displaying a black ribbon has been used for POW/MIA remembrance, mourning tragedies, or as a political statement. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who played buford t justice in smokey and the bandit?", "passages": [ [ "Buford T. Justice", "Buford T. Justice\n\nSheriff Buford T. Justice is a fictional character played by Jackie Gleason in the films \"Smokey and the Bandit\" (1977), \"Smokey and the Bandit II\" (1980) and \"Smokey and the Bandit Part 3\" (1983).", "He is a determined, foul-mouthed Texas sheriff, from Montague County, and he chases \"the Bandit\" all over the Southern United States.", "Buford T. Justice is an archetypal (approaching cliche) southern sheriff: confrontational, foul-mouthed, short-tempered, stubborn, strict, hypocritical, emotional, rough, impatient, fussy, fearless, bold, understanding, feisty, offensive, rowdy, dignified, temperamental, polite, judgmental, ungenerous, silly, thoughtful, intellectual, cranky, educated and determined.", "While he can be charming and professional, his pursuit of the Bandit is a deeply personal affair (compounded by the fact the Bandit absconded with his son Junior's fiancee, embarrassing the Justice family as a whole).", "Justice tends to take his hunt for the Bandit to the extremes and quite often this leads to the wrecking of his squad cars.", "He nonetheless remains behind the wheel of the wrecked cars and refers to them as \"evidence.\"" ] ], "gold": "Buford T Justice is a fictional sheriff from the Smokey and the Bandit films; Smokey and the Bandit, Smokey and the Bandit II, and Smokey and the Bandit part 3. In all three films, Jackie Gleason played the archetypal, if not clich\u00e9d, Southern sheriff. ", "prediction 1": "Sheriff Buford T. Justice is a fictional character played by Jackie Gleason in the films Smoky and the Bandit (1977), Smoky and the Bandit II (1980) and Smoky and the Bandit Part 3 (1983). He is a determined, foul-mouthed Texas sheriff, from Montague County, and he chases \"the Bandit\" all over the Southern United States.\n", "prediction 2": "Sheriff Buford T. Justice is played by Jackie Gleason in the films Smoky and the Bandit (1977), Smoky and the Bandit II (1980) and Smoky and the Bandit Part 3 (1983). Justice is a determined, foul-mouthed Texas sheriff, from Montague County, and he chases \"the Bandit\" all over the Southern United States. Gleason's acting career began at 19 and her stagecrafting career at 20 was as a teen detective. In the film, dies of Justice was played by Mike Tyson, Ed Harris, as the Sheriff in the 1977 film Smoky and the Bandit (1980).", "prediction 3": "Sheriff Buford T. Justice is a fictional character played by Jackie Gleason in the films Smoky and the Bandit, in which he is a determined, foul-mouthed Texas sheriff from Montague County, Texas and he chases \"the Bandit\" all over the Southern United States. Audrey Chisholm played Buford T. Justice, a friend to Jackie and son of Sheriff Charles and Sheriff Jim Chisholm. The 1977 version of Buford T. Justice came from Burt Reynolds to the film Smoky and The Bandit Part 2 (1980) and Rexford T. Justice was played by Jackie Gleason. In Smoky and the Bandit Part 3 (1983), he was played by Harold McDogin in the film Smokey and the Bandit II. In Smoky and the Bandit Part 3 (1977), Buford T.", "prediction 4": "Sheriff Buford T. Justice is a fictional character played by Jackie Gleason in the films Smokey and the Bandit (1977), Smokey and the Bandit II (1980) and Smokey and the Bandit Part 3 (1983). He is a determined, foul-mouthed Texas sheriff, from Montague County, and he chases \"the Bandit\" all over the Southern United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 323 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Sheriff Buford T. Justice is a fictional character played by Jackie Gleason in the three films Smoky and the Bandit, Smoky and the Bandit II and Smoky and the Bandit Part 3. The character is an archetypal (approaching cliche) southern sheriff." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did the air raids started in ww2?", "passages": [ [ "Strategic bombing during World War II", "After the beginning of Operation Barbarossa in June 1941, the Luftwaffe attacked Soviet cities and infrastructure.", "From 1942 onward, the British bombing campaign against Germany became less restrictive and increasingly targeted industrial sites and eventually, civilian areas.", "When the United States began flying bombing missions against Germany, it reinforced these efforts and controversial firebombings were carried out against Hamburg (1943), Dresden (1945), and other German cities.", "In the Pacific War, the Japanese bombed civilian populations throughout the war (e.g. in Chongqing).", "The US air raids on Japan began in earnest in October 1944 and by March 1945 had started their escalation into widespread firebombing, which culminated in the atomic bombings of Hiroshima and Nagasaki on 6 and 9 August 1945, respectively.", "The effect of strategic bombing was highly debated during and after the war.", "Both the \"Luftwaffe\" and RAF failed to deliver a knockout blow by destroying enemy morale.", "However some argued that strategic bombing of non-military targets could significantly reduce enemy industrial capacity and production and in the opinion of its interwar period proponents, the surrender of Japan vindicated strategic bombing.", "The Hague Conventions of 1899 and 1907, which address the codes of wartime conduct on land and at sea, were adopted before the rise of air power." ], [ "The Blitz", "Too early and the chances of success receded; too late and the real conflagration at the target would exceed the diversionary fires.", "Another innovation was the boiler fire.", "These units were fed from two adjacent tanks containing oil and water.", "The oil-fed fires were then injected with water from time to time; the flashes produced were similar to those of the German C-250 and C-500 \"Flammbomben\".", "The hope was that, if it could deceive German bombardiers, it would draw more bombers away from the real target.", "The first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage.", "Late in the afternoon of 7 September 1940, the Germans began Operation London (\"Unternehmen Loge\") (the codename for London) and \"Seeschlange\" (Sea Snake), the air offensives against London and other industrial cities.", "\"Loge\" continued for 57 nights.", "A total of 348 bombers and 617 fighters took part in the attack.", "Initially the change in strategy caught the RAF off-guard and caused extensive damage and civilian casualties.", "Some 107,400 gross tons of shipping was damaged in the Thames Estuary and 1,600 civilians were casualties.", "Of this total around 400 were killed.", "The fighting in the air was more intense in daylight." ], [ "The Blitz", "The Blitz\n\nThe Blitz was a German bombing offensive against Britain in 1940 and 1941, during the Second World War.", "The term was first used by the British press and is the German word for 'lightning'.", "The Germans conducted mass air attacks against industrial targets, towns, and cities, beginning with raids on London towards the end of the Battle of Britain in 1940, a battle for daylight air superiority between the \"Luftwaffe\" and the Royal Air Force over the United Kingdom.", "By September 1940, the \"Luftwaffe\" had failed and the German air fleets (\"Luftflotten\") were ordered to attack London, to draw RAF Fighter Command into a battle of annihilation.", "Adolf Hitler and \"Reichsmarschall\" Hermann G\u00f6ring, commander-in-chief of the \"Luftwaffe\", ordered the new policy on 6 September 1940.", "From 7 September 1940, London was systematically bombed by the \"Luftwaffe\" for 56 out of the following 57 days and nights.", "Most notable was a large daylight attack against London on 15 September.", "The \"Luftwaffe\" gradually decreased daylight operations in favour of night attacks to evade attack by the RAF, and the Blitz became a night bombing campaign after October 1940." ] ], "gold": "In WWII, strategic bombing began on 1 September 1939 when the Luftwaffe began bombing cities and the civilian population in Poland, while the Blitz, a German bombing campaign against the United Kingdom in 1940 and 1941, began on 7 September 1940.", "prediction 1": "The first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage. Late in the afternoon of 7 September 1940, the Germans began Operation London, the codename for \"Unternehmen Loge\" and the air offensives against London and other industrial cities. Initially the change in strategy caught the RAF off-guard and caused extensive damage and civilian casualties. The British fought in the Battle of Britain during the Second World War and the first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage.", "prediction 2": "The air raids started in ww2 in the afternoon of 7 September 1940, when the Germans began attacks against London. The first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage. Later in the afternoon of 7 September 1940, the Germans began Operation London (\"Unternehmen Loge\") and \"Seeschlange\" (Sea Snake), the air offensives against London and other industrial cities. The British bombing campaign against Germany became less restrictive and increasingly targeted industrial sites and eventually, civilian areas.", "prediction 3": "The air raids of World War II began on 7 September 1940, when the Germans began mass air attacks against industrial targets, towns, and cities, beginning with raids on London towards the end of the Battle of Britain in 1940, a battle for daylight air superiority between the Luftwaffe and the Royal Air Force over the United Kingdom. From 1942 onward, the British bombing campaign against Germany became less restrictive and increasingly targeted industrial sites and eventually, civilian areas. The air raids on Japan began in earnest on October 14, 1944 and by March 15, 1945 had started their escalation into widespread firebombing, which culminated in the atomic bombing of Hiroshima and Nagasaki on 6 and 7 August 1945.", "prediction 4": "The Germans conducted mass air attacks against industrial targets, towns, and cities, beginning with raids on London towards the end of the Battle of Britain in 1940. On 7 September 1940, the first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage. Later in the afternoon of 7 September 1940, the Germans began Operation London, the codename for London, and Seeschlange, the air offensives against London and other industrial cities. The first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage. On September 1940, the first deliberate bombing campaign against London, became a night bombing campaign. However, the effect of strategic bombing was highly debated during and after the war. However, the surrender of Japan vindicated strategic bombing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 397 }, { "error type": "Irrelevant", "explanation": "", "start": 398, "end": 469 }, { "error type": "Redundant", "explanation": "The first deliberate air raids on London were mainly aimed at the Port of London, causing severe damage. ", "start": 474, "end": 578 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Blitz was a German bombing offensive against Britain in 1940 and 1941. Late in the afternoon of 7 September 1940, the Germans began Operation London, the air offensives against London and other industrial cities. The US air raids on Japan began in earnest in October 1944." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the disorder in the movie brain on fire?", "passages": [ [ "Brain on Fire (film)", "Susannah becomes catatonic, and Dr. Souhel Najjar is asked to help in investigating her case.", "Najjar has Susannah draw a clock.", "She draws it with all of the numbers (1\u201312) on the right side of the clock, leading the doctor to believe that the right hemisphere of her brain is swollen and inflamed.", "Najjar has her undergo a brain biopsy in order to take cells from her brain for diagnosis.", "It is found that Susannah has anti-NMDA receptor encephalitis and Najjar describes it to her parents and Stephen as her \"brain is on fire\".", "Dr. Najjar prescribes her a treatment, which leads to a slow, but full recovery of her cognitive abilities.", "Seven months later, Susannah is back at work and presents her first written piece to Richard since her recovery.", "A grateful Richard tells her to start writing a book about her experience.", "Sitting at her desk, she begins to write the story, titled \"Brain on Fire\".", "On May 1, 2014, \"Deadline\" reported that Charlize Theron had acquired the film rights to Susannah Cahalan's 2012 memoir \"Brain on Fire:", "My Month of Madness\"." ], [ "Brain on Fire (film)", "Brain on Fire (film)\n\nBrain on Fire is a 2016 biographical drama film directed and written by Gerard Barrett, based on Susannah Cahalan's memoir \"Brain on Fire:", "My Month of Madness\".", "The film stars Chlo\u00eb Grace Moretz, Jenny Slate, Thomas Mann, Tyler Perry, Carrie-Anne Moss, and Richard Armitage.", "Principal photography began on July 13, 2015, in Vancouver, British Columbia.", "It had its world premiere at the Toronto International Film Festival on September 14, 2016.", "The film was released on Netflix on June 22, 2018.", "Susannah Cahalan (Moretz) is a \"New York Post\" writer, who works with her boss Richard (Perry) and desk neighbor/co-worker Margo (Slate).", "She meets a sound producer named Stephen (Mann) and they become friends.", "Susannah begins to experience strange things (such as being in a trance state, seeing people\u2014who are not actually present\u2014who talk about her, and hypersensitivity to annoying noises and tactile sensations).", "Susannah's behavior becomes unusually erratic.", "After several days of mishaps made by her in the office due to her altered behavior, including talking to Stephen while under her desk, as well as insulting a Senator, his public relations person and firm, Susannah suffers a seizure and seeks treatment." ], [ "Brain on Fire (film)", "After consulting with a clinic, her father Tom (Armitage) confronts Stephen about not calling her parents regarding the incident.", "Tom suggests that she stay with her parents, which Susannah refuses to do, but in the end she leaves to stay with her mother and stepfather.", "At her mother's house, Susannah has another seizure.", "She is taken to a clinic where Susannah undergoes an MRI.", "The doctor advises her mother, Rhona (Moss), that Susannah has been partying too much, working too hard and not getting enough sleep.", "While at one of her doctor's appointments, Susannah expresses she has bipolar disorder, since she is creative and \"creative people are bipolar\".", "Another doctor prescribes an anti-psychotic medication which, after reading of their side effects and believing them as causing her symptoms, she refuses.", "Rhona gets her to take the pills anyway, and asks her father to watch her because she is too difficult to handle.", "During dinner with her father, she becomes violent, yelling at her father to stay away.", "Her parents demand that she is hospitalized despite MRI, EEG and physical tests all showing normal results.", "One of the doctors says to her parents that she is possibly suffering from schizophrenia.", "The doctor tells them that if Susannah's behavior does not improve, she will be transferred to another hospital, where they can deal with psychological problems." ] ], "gold": "The movie, Brain on Fire, is a film adaptation of Susannah Cahalan's memoir, Brain on Fire: My Month of Madness. Susannah is a writer at the New York Post who begins to suffer a mysterious illness. She initially thinks she has Bipolar Disorder because of her sever mood changes. She is hospitalized after a violent outburst at home. The doctors at the hospital tell Susannah's parents she could have Schizophrenia and if her behavior doesn't improve she will be transferred to another hospital. Dr. Souhel Najjar is asked to investigate her case and discovers she has anti-NMDA receptor encephalitis after asking her to draw a clock and she draws all the numbers on the right side of the clock. The doctor describes the disease to her parents as her \"brain is on fire.\"", "prediction 1": "Brain on Fire is a 2016 biographical drama film. The movie stars Chlo Grace Moretz, Jenny Slate, Thomas Mann, Tyler Perry, Carrie-Anne Moss, and Richard Armitage. In the movie, Susannah is diagnosed with anti-NMDA receptor encephalitis, or NMDA-related encephalitis, and Dr. Najjar describes it to her parents and Stephen as her \"brain is on fire\".", "prediction 2": "Brain on Fire is a 2016 biographical drama film directed and written by Gerard Barrett, based on Susannah Cahalan's 2012 memoir Brain on Fire: My Month of Madness. It is a biographical drama film directed and written by Gerard Barrett, based on Susannah Cahalan's memoir. While at one of her doctor's appointments, Susannah expresses she has bipolar disorder, since she is creative and \"creative people are bipolar\", another doctor prescribes an anti-psychotic medication which she refuses. The film also features Susannah's bipolar disorder.", "prediction 3": "Brain on Fire is a 2016 biographical drama film directed and written by Gerard Barrett, based on Susannah Cahalan's 2012 memoir, Brain on Fire: My Month of Madness. Susannah is diagnosed with anti-NMDA receptor encephalitis and is treated with a medication that leads to a slow, but full recovery of her cognitive abilities. In the movie, Susannah also has bipolar disorder, schizophrenia, and anti-psychotic medication.", "prediction 4": "Brain on Fire is a 2016 biographical drama film directed and written by Gerard Barrett, based on Susannah Cahalan's 2012 memoir Brain on Fire: My Month of Madness. Susannah suffers a seizure at the hands of Dr. Souhel Najjar, who diagnoses her with anti-NMDA receptor encephalitis, which causes her brain to swell and inflame. The film also features a mental illness called bipolar disorder which causes Susannah's behavior to be more violent when she is a victim of the drug and one of her father, who prescribes her anti-psychotic medications as well as well as needed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 162 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 12 ] } ], "corrected-prediction": "Brain on Fire is a 2016 biographical drama film based on Susannah Cahalan's memoir \"Brain on Fire: My Month of Madness\". Susannah is a writer at the New York Post who begins to suffer a mysterious illness. She initially thinks she has Bipolar Disorder because she is creative and \"creative people are bipolar\". She is hospitalized after a violent outburst at home. One of the doctors says to her parents that she is possibly suffering from schizophrenia. The doctor tells them that if Susannah's behavior does not improve, she will be transferred to another hospital, In the movie, Susannah is diagnosed with anti-NMDA receptor encephalitis, and Dr. Souhel Najjar, who had been asked to help investigate her case, describes it to her parents and Stephen as her \"brain is on fire\"." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who sings the theme song from the breakfast club?", "passages": [ [ "Don't You (Forget About Me)", "Don't You (Forget About Me)\n\n\"Don't You (Forget About Me)\" is a 1985 pop rock song performed by Scottish rock band Simple Minds.", "It was written and composed by producer Keith Forsey and Steve Schiff, a guitarist and songwriter from the Nina Hagen band.", "The song is best known for being played during the opening (Forsey's demo) and closing (Simple Minds' recording) credits of the John Hughes film \"The Breakfast Club.\"", "Forsey asked Cy Curnin from The Fixx, Bryan Ferry and Billy Idol to record the song, but all three declined; Idol did later perform a cover of it on his 2001 compilation album \"Greatest Hits.\"", "Schiff then suggested Forsey ask Simple Minds who, after refusing as well, agreed under the encouragement of their label, A&M.", "According to frontman Jim Kerr, the band was reluctant to record the song as they felt they should only record their own material, relenting after persuasion from Kerr's wife at the time, Chrissie Hynde of The Pretenders, and a phone call from Forsey in which he expressed his admiration for the band.", "According to one account, the band \"rearranged and recorded 'Don't You (Forget About Me)' in three hours in a north London studio and promptly forgot about it.\"" ], [ "Simple Minds concert tours", "Simple Minds concert tours\n\nThis is the tour history of the Scottish rock band Simple Minds.", "Formed in 1977, the band have toured internationally on a semi-regular basis since 1979.", "Simple Minds' August 1986 shows in Paris on their \"Once Upon A Time\" Tour were recorded and released in May 1987 as the live album \"Live in the City of Light\".", "The double album set reached number one on the UK Albums Chart.", "Simple Minds released in May 1990 on (VHS) home video as \"Verona\" their first ever live film featuring (only) parts of their show on 15 September 1989 in Verona, Italy during their \"Street Fighting Years\" tour.", "24 years later, Simple Minds released in May 2014 on DVD/CD their second ever live film titled \"Celebrate \u2013 Live at the Glasgow SSE Hydro\" featuring their complete show on 27 November 2013 at the SSE Hydro in Glasgow, Scotland, UK during their \"Greatest Hits +\" tour." ], [ "Jim Kerr", "Jim Kerr\n\nJames Kerr (born 9 July 1959) is a Scottish singer-songwriter and the lead singer of the rock band Simple Minds.", "He achieved five UK No. 1 albums with the band, including a No. 1 single in 1989 with \"Belfast Child\".", "He released his first solo album, \"Lostboy!", "AKA Jim Kerr\", on 27 May 2010.", "Kerr's voice has been described as \"David Bowie's rich baritone melded with Bryan Ferry's velvety croon\".", "Born in Toryglen, Glasgow with Irish ancestry, Kerr attended Holyrood R.C. Secondary School there.", "He had a stammer during childhood and in his early teens.", "In 1977, he was one of the founding members of the 6-piece punk rock band Johnny and the Self Abusers.", "Calling himself Pripton Weird, he played keyboards and shared vocals with John Milarky.", "Allan McNeill was also involved with the band, and went on to be the manager of the pop band Hue and Cry.", "The band lasted 8 months, during which time Kerr emerged as one of the main songwriters.", "In November 1977, they changed their name to Simple Minds, quickly reduced to 4 members, then increased to 5, then 6, then back to 5 before a period of stability ensued." ] ], "gold": "Singer Jim Kerr and Scottish rock band Simple Minds sang the 1985 film The Breakfast Club's theme song. Scottish singer-songwriter James Kerr is the lead singer of Simple Minds.", "prediction 1": "\"Don't You (Forget About Me)\" is the theme song from the John Hughes film, The Breakfast Club. It was written and composed by producer Keith Forsey and Steve Schiff, a guitarist and songwriter from the Nina Hagen band. \"Don't You (Forget About Me)\" is performed by Scottish rock band Simple Minds.", "prediction 2": "\"Don't You (Forget About Me)\" is a 1985 pop rock song performed by Scottish rock band Simple Minds. The song is best known for being played during the opening (Forsey's demo) and closing (Simple Minds' recording) credits of the John Hughes film The Breakfast Club. It was written and composed by producer Keith Forsey and Steve Schiff, a guitarist and songwriter from the Nina Hagen band.", "prediction 3": "\"Don't You (Forget About Me)\" is a 1985 pop rock song performed by Scottish rock band Simple Minds. It was written and composed by producer Keith Forsey and Steve Schiff, a guitarist and songwriter from the Nina Hagen band. In the 1985 John Hughes film, the song is played during the opening (Forsey's demo) and closing (Simple Minds' recording) credits. Forsey asked Cy Curnin from The Fixx, Bryan Ferry and Billy Idol to record the song, but all three declined.", "prediction 4": "\"Don't You (Forget About Me)\" is a 1985 pop rock song performed by Scottish rock band Simple Minds. It was written and composed by producer Keith Forsey and Steve Schiff, a guitarist and songwriter from the Nina Hagen band. Forsey asked Cy Curnin from The Fixx, Bryan Ferry and Billy Idol to record the song, but all three declined. Idol did later perform a cover of it on his 2001 compilation album Greatest Hits.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 37, "end": 47 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 218 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Don't You (Forget About Me)\" was performed by Scottish rock band Simple Minds. James Kerr is the lead singer of Simple Minds. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When is the season finale pretty little liars?", "passages": [ [ "Pretty Little Liars", "On June 10, 2014, \"Pretty Little Liars\" was renewed for its sixth and seventh seasons.", "On August 29, 2016, Freeform confirmed that the series would be ending after its seventh season in 2017.", "Filming of the series officially wrapped on October 26, 2016.", "The series finale was viewed by an estimated 1.41 million viewers.", "It had the second-highest rating of any cable TV series that aired that night.", "The episode was followed by \"A-List Wrap Party\", a live special featuring the cast and executive producer King discussing the series ending.", "On September 25, 2017, Freeform announced that a second spin-off series, titled \"\", had been ordered, with Pieterse and Parrish reprising their roles as Alison DiLaurentis and Mona Vanderwaal respectively.", "On May 14, 2018, Freeform picked up the series for a 10-episode first season, set to air in 2019.", "In a 2018 panel, Parrish said that some plot points created in \"Pretty Little Liars\" will be resolved during the spin-off.", "Set in the small suburban town of Rosewood, Pennsylvania, the series follows the lives of five girls: Spencer Hastings, Alison DiLaurentis, Aria Montgomery, Hanna Marin and Emily Fields, whose clique falls apart after the leader of the group, Alison, goes missing." ], [ "Pretty Little Liars (season 6)", "She glances at a photograph of Charlotte and says it is what she would've wanted.", "In the last scene, we see Hanna's unconscious body being dragged by 'Uber A' in the church's bell tower.", "\n\n", "The show was renewed for a sixth and seventh season on June 10, 2014, right before the season five premiere aired, making \"Pretty Little Liars\" ABC Family's longest running original series.", "The sixth and the seventh season will consist of 20 episodes each.", "Filming for season 6 began on March 24, 2015.", "It aired 10 episodes for the first half the season, which began airing on June 2, 2015.", "The table read for the premiere occurred on March 23, 2015, King began writing the mid-season finale, the \"summer finale\", which was titled \"Game Over, Charles\", on May 12, 2015.", "Unlike previous seasons, the sixth season will not include a special holiday-themed episode between the first and second half of the season, just like the first season.", "Previous holiday-themed episodes have been the thirteenth episode of each previous season excluding the first.", "The second half of the season will feature a new intro, after using the same intro in the previous seasons, and will feature the characters after the five-year time jump." ], [ "Pretty Little Liars", "Pretty Little Liars\n\nPretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard.", "The series follows the lives of four girls whose clique falls apart after the disappearance of their leader.", "One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named \"A\" who threatens to expose their deepest secrets.", "The series features an ensemble cast, headed by Troian Bellisario as Spencer Hastings, Lucy Hale as Aria Montgomery, Ashley Benson as Hanna Marin, Shay Mitchell as Emily Fields, Sasha Pieterse as Alison DiLaurentis and Janel Parrish as Mona Vanderwaal.", "The series premiered on June 8, 2010 on Freeform, formerly known as ABC Family, and ended on June 27, 2017.", "After an initial order of 10 episodes, ABC Family ordered an additional 12 episodes on June 28, 2010.", "The ratings success of the first 10 episodes prompted the book series to be extended beyond the initial eight novels.", "Since its debut, the series has received mixed reviews from television critics, but remained a relative success for Freeform, garnering a large fandom, primarily on social media.", "On March 26, 2013, a spin-off series was announced, titled \"Ravenswood\", but was canceled after one season." ] ], "gold": "Pretty Little Liars is an American teen drama mystery thriller television series. The series premiered on June 8, 2010, on Freeform and ended on June 27, 2017 with season 7. The season 5 finale was on March 24, 2015 and the season 6 finale was on March 15, 2016. Pretty Little Liars was Freeform's longest running original series.", "prediction 1": "Pretty Little Liars is an American teen drama mystery thriller television series that followed the characters of four estranged friends as they begin receiving messages from a mysterious figure named A. The series premiered on June 8, 2010, and ended on June 27, 2017. The seventh season finale was aired on October 26, 2016.", "prediction 2": "Pretty Little Liars is an American teen drama mystery thriller television series. Filming of the series officially wrapped on October 26, 2016. The series finale was viewed by an estimated 1.41 million viewers. The episode was followed by \"A-List Wrap Party\", a live special featuring the cast and executive producer King discussing the series ending. In the sixth season, King began writing the mid-season finale, the summer finale, which was titled \"Game Over, Charles\", on May 12, 2015.", "prediction 3": "Pretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard. Filming of the series officially wrapped on October 26, 2016. The series finale was viewed by an estimated 1.41 million viewers.", "prediction 4": "Pretty Little Liars is an American teen drama mystery thriller television series, loosely based on the novel series of the same name written by Sara Shepard, which debuted on March 16, 2010. Filming of the series officially wrapped on October 26, 2016, and the series finale was viewed by an estimated 1.41 million viewers. On September 25, 2017, Freeform announced that a second spin-off series, titled \"\", had been ordered, with Pieterse and Parrish reprising their roles as Alison DiLaurentis and Mona Vanderwaal respectively. The mid-season finale was titled \"Game Over, Charles\", and was titled \"Game Over, Charles\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 202 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 295, "end": 304 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Pretty Little Liars is an American teen drama mystery thriller television series. The series premiered on June 8, 2010, on Freeform and ended on June 27, 2017. Filming of the seventh season finale was wrapped on October 26, 2016. Pretty Little Liars was Freeform's longest running original series." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who holds the record for most push ups?", "passages": [ [ "Paul Henry Allen Lynch", "The Pioneer of the first documented one finger push-up can be credited to Mich (Michael Gooch) who in 1982, March 20 achieved 39 one finger push-ups during the Kyokushinkai European Championships (Karate Championships) at Wembley Arena, London UK.", "Soon after, Mich Gooch, broke his record achieving 45 one-finger push-ups to become the first Guinness World Record Holder in the one-finger in 1985.", "The Attempt\n\nOn 21 April 1992 at London's Hippodrome, Lynch performed 124 consecutive one-finger push-ups over approximately 5 minutes, during what would have been his 125th push-up, Paul shattered the bones in his finger.", "After the attempt, Lynch was quoted as saying, \"It felt like sticking my finger in an electrical socket.\"", "Guinness no longer publicizes the consecutive one-finger push-up, rather a new category of most one-finger in 30 seconds has been introduced." ], [ "Push-up", "This variation also reduces the amount of strain in the wrist, compared to the typical \"palms on floor\" approach, and so it is sometimes used by those with wrist injuries.", "Such practitioners will usually perform their knuckle push-ups on a padded floor or a rolled-up towel, unlike martial artists, who may do bare-knuckle push-ups on hard floors.", "The most knuckle push-ups in one minute is 91 by Ron Cooper (Massachusetts, USA) on 15 December 2016.", "The \"Maltese push-up\" is a gymnastic variation of the push-up, in which the hands are positioned further down towards the hips (as opposed to roughly alongside the pectorals), but with a wide distance between them.", "The \"Hindu push-up\" starts from the \"downward dog\" yoga position and transitions to a \"cobra pose\" position.", "It is also known as a Hanuman, judo, or dive bomber push-up.", "It is common in Indian physical culture and Indian martial arts, particularly Pehlwani.", "The \"guillotine push-up\" is a form of push-up exercise done from an elevated position (either hands on elevated platforms or traditionally medicine balls) where in the practitioner lowers the chest, head, and neck (thus the name) past the plane of the hands." ], [ "Charles Servizio", "Charles Servizio\n\nCharles Servizio (born September 5, 1950, in Lynn, Massachusetts) is a retired teacher best known for setting a world record in push-ups in April 25, 1993: 46,001 pushups in 24 hours.", "Servizio's high-school wrestling coach assigned pushups as punishment for poor performance in tournaments.", "He was 38 when he made his first attempt to break the Guinness Book of World Records 24-hour push-up record.", "The attempt was unsuccessful \u2013 he quit at 30,000 pushups and fell short of the standing record by over 4,000 pushups.", "This was the first of four attempts in which he broke the existing records, the last being 46,001 pushups in just over twenty-two hours." ] ], "gold": "The Guinness Book of World Records first recorded a record for push-ups in 1965 when Charles Linster performed 6,006 nonstop on October 5. As of 1980, Minoru Yoshida holds the record for the most nonstop pushups. Charles Servizio is the 24-hour record holder. Bijender Singh performed 3,877 in one hour making him the record holder for that time. The record holder for knuckle push-ups is Syed Taj Muhammad doing 2,175 in one hour in March 2016. ", "prediction 1": "The world record for most push ups with one finger is held by Michael Gooch. However, the world record for most push ups with one finger is held by Paul Henry Allen Lynch, who holds the record for most push ups with one finger in approximately 5 minutes.", "prediction 2": "On April 21, 1992 at London's Hippodrome, Paul Henry Allen Lynch performed 124 consecutive one-finger push-ups over approximately 5 minutes. The most knuckle push-ups in one minute is 91 by Ron Cooper (Massachusetts, USA) on 15 December 2016. The most pushups done from a seated position in one minute is 121 by Scott Taylor (New York, USA) on May 11, 2012.", "prediction 3": "The world record for most push-ups per minute is 357,858 held by Charles Servizio, in 1993. In 2015, the record was set by Paul Henry Allen Lynch, with 124 consecutive one-finger push-ups over approximately 5 minutes.", "prediction 4": "The world record for most push ups in a minute is 59,436 held by Charles Servizio in 1993. Michael Gooch holds the record for most one-finger push-ups in 1985. The Attempt On 21 April 1992 at London's Hippodrome, Paul Henry Allen Lynch performed 124 consecutive one-finger push-ups over approximately 5 minutes.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 140, "end": 171 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 197, "end": 254 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several push up categories. The world record for most push ups with one finger is held by Michael Gooch, in 1985. Charles Servizio set a world record in push-ups in April 25, 1993: 46,001 pushups in 24 hours." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What type of arabic is spoken in palestine?", "passages": [ [ "Palestinian Arabic", "Palestinian Arabic\n\nPalestinian Arabic is the a Southern Levantine Arabic dialect, spoken by most Palestinians in Palestine and in the Palestinian diaspora populations.", "Together with Jordanian Arabic, it has the ISO 639-3 language code \"ajp\", known as South Levantine Arabic.", "Further dialects can be distinguished within Palestine, such as spoken in the northern West Bank, that spoken by Palestinians in the Hebron area, which is similar to Jordan and south-western Syria.", "A form of Palestinian Arabic is also spoken in Central Israel, which is however heavily influenced by modern Hebrew.", "The dialects spoken by the Arabs of the Levant \u2013 the Eastern shore of the Mediterranean \u2013 or Levantine Arabic, form a group of dialects of Arabic.", "Arabic manuals for the \"Syrian dialect\" were produced in the early 20th century, and in 1909 a specific \"Palestinean Arabic\" manual was published.", "The Palestinian Arabic dialects are varieties of Levantine Arabic because they display the following characteristic Levantine features.", "The noticeable differences between southern and northern forms of Levantine Arabic, such as Syrian Arabic and Lebanese Arabic, are stronger in non-urban dialects.", "The main differences between Palestinian and northern Levantine Arabic are as follows:\n\n\nThere are also typical Palestinian words that are shibboleths in the Levant." ] ], "gold": "The dialects that are spoken by the Arabs of the Levant \u2013 the Eastern shore of the Mediterranean \u2013 or Levantine Arabic, form a group of dialects of Arabic. Palestinian Arabic is a Southern Levantine Arabic dialect, spoken by most Palestinians in Palestine and Israel and the Palestinian diaspora populations. Southern Levantine Arabic is made up of a language code \"ajp\" that contains Palestinian Arabic and Jordanian Arabic.", "prediction 1": "The dialects spoken by the Arabs of the Levant \u2013 the Eastern shore of the Mediterranean \u2013 or Levantine Arabic, form a group of dialects of Arabic. The Palestinian Arabic dialects are varieties of Levantine Arabic because they display the following characteristic Levantine features.", "prediction 2": "There are several types of Arabic spoken in Palestine. Palestinian Arabic is the Southern Levantine Arabic dialect, spoken by most Palestinians in Palestine and in the Palestinian diaspora populations. Together with Jordanian Arabic, it has the ISO 639-3 language code \"ajp\", known as South Levantine Arabic.", "prediction 3": "It is a Southern Levantine dialect of Arabic, spoken by most Palestinians in Palestine and in the Palestinian diaspora populations. Together with Jordanian Arabic, it has the ISO 639-3 language code \"ajp\", known as South Levantine Arabic. Further dialects can be distinguished within Palestine, such as spoken in the northern West Bank, that spoken by Palestinians in the Hebron area, which is similar to Jordan and south-western Syria. A form of Palestinian Arabic is also spoken in Central Israel, which is however heavily influenced by modern Hebrew.", "prediction 4": "Palestinian Arabic is the a Southern Levantine Arabic dialect, spoken by most Palestinians in Palestine and in the Palestinian diaspora populations. Together with Jordanian Arabic, it has the ISO 639-3 language code \"ajp\", known as South Levantine Arabic. Further dialects can be distinguished within Palestine, such as spoken in the northern West Bank, that spoken by Palestinians in the Hebron area, which is similar to Jordan and south-western Syria.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 282 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The dialects spoken by the Arabs of the Levant \u2013 the Eastern shore of the Mediterranean \u2013 or Levantine Arabic, form a group of dialects of Arabic. Palestinian Arabic Palestinian Arabic is the a Southern Levantine Arabic dialect, spoken by most Palestinians in Palestine and in the Palestinian diaspora populations. Together with Jordanian Arabic, it has the ISO 639-3 language code \"ajp\", known as South Levantine Arabic." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Where does the volta occur in english and italian sonnets?", "passages": [ [ "Volta (literature)", "This is discussed in Lee Gurga's \"Haiku: A Poet's Guide\".", "Betty Drevniok describes the haiku's turn in \"Aware: A Haiku Primer\" by explaining that haiku must be written using the principles of comparison, contrast, or association.", "She says, \"This technique provides the pivot on which the reader's thought turns and expands.\"", "The sijo, a Korean poem of 43 to 45 syllables, traditionally contains a turn in the third line which moves away from the theme developed in the first two lines.", "A turn in a sonnet is called a volta.", "A vital part of virtually all sonnets, the volta is most frequently encountered at the end of the octave (first eight lines in Petrarchan or Spenserian sonnets), or the end of the twelfth line in Shakespearean sonnets, but can occur anywhere in the sonnet." ], [ "Petrarchan sonnet", "Petrarchan sonnet\n\nThe Petrarchan sonnet is a sonnet form not developed by Petrarch himself, but rather by a string of Renaissance poets.", "Because of the structure of Italian, the rhyme scheme of the Petrarchan sonnet is more easily fulfilled in that language than in English.", "The original Italian sonnet form divides the poem's 14 lines into two parts, the first part being an octave and the second being a sestet.", "The rhyme scheme for the octave is typically ABBAABBA.", "The sestet is more flexible.", "Petrarch typically used CDECDE or CDCDCD for the sestet.", "Some other possibilities for the sestet include CDDCDD, CDDECE, or CDDCCD (as in Wordsworth's \"Nuns Fret Not at Their Convent's Narrow Room\"", "[a sonnet about sonnets]).", "This form was used in the earliest English sonnets by Wyatt and others.", "For background on the pre-English sonnet, see Robert Canary's web page, \"The Continental Origins of the Sonnet\".", "In a strict Petrarchan sonnet, the sestet does not end with a couplet (since this would tend to divide the sestet into a quatrain and a couplet)." ], [ "Petrarchan sonnet", "These poets do not necessarily restrict themselves to the metrical or rhyme schemes of the traditional Petrarchan form; some use iambic hexameter, while others do not observe the octave-sestet division created by the traditional rhyme scheme.", "Whatever the changes made by poets exercising artistic license, no \"proper\" Italian sonnet has more than five different rhymes in it.", "Sir Thomas Wyatt and Henry Howard, Earl of Surrey are both known for their translations of Petrarch's sonnets from Italian into English.", "While Howard tended to use the English sonnet form in his own work, reserving the Petrarchan form for his translations of Petrarch, Wyatt made extensive use of the Italian sonnet form in the poems of his that were not translation and adaptation work.", "As a result, he is often credited for integrating the Petrarchan sonnet into English vernacular tradition.", "The form also gave rise to an \"anti-Petrarchan\" convention which may have revealed the mistress to be ugly and unworthy.", "The convention was also mocked, or adopted for alternative persuasive means by many of the Inns of Court writers during the Renaissance.", "The sonnet is split in two groups: the \"octave\" (of 8 lines) and the \"sestet\" (of 6 lines), for a total of 14 lines." ] ], "gold": "In English sonnets, the volta occurs at the end of the twelfth line, while in Italian sonnets, also known as Petrarchan sonnets, it occurs at the end of the octave, which is the first of two stanzas and consists of eight lines.", "prediction 1": "The volta is a vital part of virtually all sonnets, the volta is most frequently encountered at the end of the octave, or the end of the twelfth line in Shakespearean sonnets, but can occur anywhere in the sonnet. The Petrarchan sonnet is a sonnet form not developed by Petrarch himself, but rather by a string of Renaissance poets. The original Italian sonnet form divides the poem's 14 lines into two parts, the first eight lines in Petrarchan or Spenserian sonnets, or Spenserian sonnets, or the end of the octave, or the end of the sestet.", "prediction 2": "The Petrarchan sonnet is a sonnet form not developed by Petrarch himself, but rather by a string of Renaissance poets. The volta is most frequently encountered at the end of the octave, or the end of the twelfth line, in Petrarchan or Spenserian sonnets, but can occur anywhere in the sonnet. The English sonnet, like the Italian, is divided into two parts, the first part being an octave and the second being a sestet. The rhyme scheme of the Petrarchan sonnet is more easily fulfilled in the original Italian than in English.", "prediction 3": "The volta is most commonly encountered at the end of the octave (first eight lines in Petrarchan or Spenserian sonnets), or the end of the twelfth line in Shakespearean sonnets, but can occur anywhere in the sonnet. Sir Thomas Wyatt and Henry Howard, Earl of Surrey are both known for their translations of Petrarch's sonnets from Italian into English. The Petrarchan sonnet is a sonnet form not developed by Petrarch himself, but rather by a string of Renaissance poets. Because of the structure of Italian, the rhyme scheme of the Petrarchan sonnet is more easily fulfilled in that language than in English.", "prediction 4": "The volta is a vital part of virtually all sonnets, but is most frequently encountered at the end of the octave or sestet. In the Petrarchan sonnet, the volta is at the end of the first eight lines. In the Shakespearean sonnet, the volta occurs at the end of the twelfth line. In the Petrarchan sonnet, the volta is at the end of the sestet.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 332 }, { "error type": "Irrelevant", "explanation": "", "start": 333, "end": 543 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 213 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "A vital part of virtually all sonnets, the volta is most frequently encountered at the end of the octave (first eight lines in Petrarchan or Spenserian sonnets), or the end of the twelfth line in Shakespearean sonnets." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the carolina panthers become a franchise?", "passages": [ [ "Carolina Panthers", "After recording playoff appearances in 2005 and 2008, the team failed to record another playoff appearance until 2013, the first of three consecutive NFC South titles.", "After losing in the divisional round to the San Francisco 49ers in 2013 and the Seattle Seahawks in 2014, the Panthers returned to the Super Bowl in 2015, but lost to the Denver Broncos.", "The Panthers have reached the playoffs seven times, advancing to four NFC Championship Games and two Super Bowls.", "They have won six division titles, one in the NFC West and five in the NFC South.", "The Carolina Panthers are legally registered as Panther Football, LLC.", "and are controlled by David Tepper, whose purchase of the team from founder Jerry Richardson was unanimously approved by league owners on May 22, 2018.", "The club is worth approximately US$2.3\u00a0billion, according to \"Forbes\".", "On December 15, 1987, entrepreneur Jerry Richardson announced his bid for an NFL expansion franchise in the Carolinas.", "A North Carolina native, Richardson was a former wide receiver on the Baltimore Colts who had used his 1959 league championship bonus to co-found the Hardee's restaurant chain, later becoming president and CEO of TW Services.", "Richardson drew his inspiration to pursue an NFL franchise from George Shinn, who had made a successful bid for an expansion National Basketball Association (NBA) team in Charlotte, the Charlotte Hornets." ], [ "Carolina Panthers", "Carolina Panthers\n\nThe Carolina Panthers are a professional American football team based in Charlotte, North Carolina.", "The Panthers compete in the National Football League (NFL), as a member club of the league's National Football Conference (NFC) South division.", "The team is headquartered in Bank of America Stadium in uptown Charlotte; also the team's home field.", "They are one of the few NFL teams to own the stadium they play in, which is legally registered as Panthers Stadium, LLC.", "The Panthers are supported throughout the Carolinas; although the team has played its home games in Charlotte since 1996, it played home games at Memorial Stadium in Clemson, South Carolina during its first season.", "The team hosts its annual training camp at Wofford College in Spartanburg, South Carolina.", "The head coach is Ron Rivera.", "The Panthers were announced as the league's 29th franchise in 1993, and began play in 1995 under original owner and founder Jerry Richardson.", "The Panthers played well in their first two years, finishing in 1995 (an all-time best for an NFL expansion team's first season) and 12\u20134 the following year, winning the NFC West before ultimately losing to the eventual Super Bowl champion Green Bay Packers in the NFC Championship Game.", "They did not have another winning season until 2003, when they won the NFC Championship Game and reached Super Bowl XXXVIII, losing 32\u201329 to the New England Patriots." ], [ "Carolina Panthers", "Richardson founded Richardson Sports, a partnership consisting of himself, his family, and a number of businessmen from North and South Carolina were also recruited to be limited partners.", "Richardson looked at four potential locations for a stadium, ultimately choosing uptown Charlotte.", "To highlight the demand for professional football in the Carolinas, Richardson Sports held preseason games around the area from 1989 to 1991.", "The first two games were held at Carter\u2013Finley Stadium in Raleigh, North Carolina, and Kenan Memorial Stadium in Chapel Hill, North Carolina, while the third and final game was held at Williams-Brice Stadium in Columbia, South Carolina.", "The matchups were between existing NFL teams.", "In 1991, the group formally filed an application for the open expansion spot, and on October 26, 1993, the 28 NFL owners unanimously named the Carolina Panthers as the 29th member of the NFL.", "The Panthers first competed in the 1995 NFL season; they were one of two expansion teams to begin play that year, the other being the Jacksonville Jaguars.", "The Panthers were put in the NFC West to increase the size of that division to five teams; there were already two other southeastern teams in the division, the Atlanta Falcons and the New Orleans Saints.", "Former Pittsburgh Steelers defensive coordinator Dom Capers was named the first head coach.", "The team finished its inaugural season , the best performance ever from a first-year expansion team." ] ], "gold": "The Carolina Panthers are a professional American football team based in Charlotte, North Carolina. They were announced as the league's 29th franchise on October 26, 1993 and began play in 1995 under original owner and founder Jerry Richardson. They have won six division titles, one in the NFC West and five in the NFC South. The Panthers have reached the playoffs eight times, advancing to four NFC Championship Games and two Super Bowls.", "prediction 1": "On December 15, 1987, entrepreneur Jerry Richardson announced his bid for an NFL expansion franchise in the Carolinas. The team was announced as the league's 29th franchise in 1993 and began play in 1995 under original owner and founder Jerry Richardson.", "prediction 2": "The Carolina Panthers are a professional American football team based in Charlotte, North Carolina. They compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) South division. They were announced as the league's 29th franchise in 1993, and began play in 1995.", "prediction 3": "The Carolina Panthers are a professional American football team based in Charlotte, North Carolina. They compete in the National Football League as a member team of the league's National Football Conference South division. The franchise was officially announced on December 15, 1987, by entrepreneur Jerry Richardson. They began play in 1995 under Richardson as one of two expansion teams to begin play in the 1995 NFL season.", "prediction 4": "The Carolina Panthers are a professional American football team based in Charlotte, North Carolina. The team competes in the National Football League as a member club of the league's National Football Conference South division, and has been in the NFL since 1995. The team was announced as the league's 29th franchise in 1993, and began play in 1995 under original owner and founder Jerry Richardson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 118 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Carolina Panthers are a professional American football team based in Charlotte, North Carolina. The team was announced as the league's 29th franchise in 1993 and began play in 1995 under original owner and founder Jerry Richardson. They have won six division titles, one in the NFC West and five in the NFC South. The Panthers have reached the playoffs seven times, advancing to four NFC Championship Games and two Super Bowls." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Where does final maturation of a sperm cell occur?", "passages": [ [ "Immune privilege", "Sperm are immunogenic \u2013 that is they will cause an autoimmune reaction if transplanted from the testis into a different part of the body.", "This has been demonstrated in experiments using rats by Lansteiner (1899) and Metchinikoff (1900), mice and guinea pigs.", "The likely reason for their immunogenicity or rather antigenicity is that sperm first mature at puberty, after central tolerance has been established, therefore the body recognizes them as foreign and mounts an immune reaction against them.", "Therefore, mechanisms for their protection must exist in this organ to prevent any autoimmune reaction.", "The blood\u2013testis barrier is likely to contribute to the survival of sperm.", "However, it is believed in the field of testicular immunology that the blood\u2013testis barrier cannot account for all immune suppression in the testis, due to (1) its incompleteness at a region called the rete testis and (2) the presence of immunogenic molecules outside the blood\u2013testis barrier, on the surface of spermatogonia.", "The Sertoli cells play a crucial role in the protection of sperm from the immune system.", "They create the Sertoli cell barrier, which complements the blood-testis barrier.", "The protection is ensured by tight junctions, which appear between two neighboring Sertoli cells." ], [ "Spermiogenesis", "Spermiogenesis\n\nSpermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa.", "The spermatid is a more or less circular cell containing a nucleus, Golgi apparatus, centriole and mitochondria.", "All these components take part in forming the spermatozoon.", "The process of spermiogenesis is traditionally divided into four stages: the Golgi phase, the cap phase, formation of tail, and the maturation stage.", "The spermatids, which up until now have been mostly radially symmetrical, begin to develop polarity.", "Spermatid DNA also undergoes packaging, becoming highly condensed.", "The DNA is first packaged with specific nuclear basic proteins, which are subsequently replaced with protamines during spermatid elongation.", "The resultant tightly packed chromatin is transcriptionally inactive.", "The Golgi apparatus surrounds the condensed nucleus, becoming the acrosomal cap.", "One of the centrioles of the cell elongates to become the tail of the sperm.", "A temporary structure called the \"manchette\" assists in this elongation.", "During this phase, the developing spermatozoa orient themselves so that their tails point towards the center of the lumen, away from the epithelium." ], [ "Testicle", "The dimensions of the average adult testicle are up to 2\u00a0inches long, 0.8\u00a0inches in breadth, and 1.2\u00a0inches in height (5 \u00d7 2 \u00d7 3\u00a0cm).", "The Tanner scale for the maturity of male genitals assigns a maturity stage to the calculated volume ranging from stage I, a volume of less than 1.5\u00a0ml; to stage V, a volume greater than 20\u00a0ml.", "Normal volume is 15 to 25 ml; the average is 18\u00a0cm\u00b3 per testis (range 12\u00a0cm\u00b3 to 30\u00a0cm\u00b3.", "The testes are covered by a tough membranous shell called the tunica albuginea.", "Within the testes are very fine coiled tubes called seminiferous tubules.", "The tubules are lined with a layer of cells (germ cells) that develop from puberty through old age into sperm cells (also known as spermatozoa or male gametes).", "The developing sperm travel through the seminiferous tubules to the rete testis located in the mediastinum testis, to the efferent ducts, and then to the epididymis where newly created sperm cells mature (see spermatogenesis).", "The sperm move into the vas deferens, and are eventually expelled through the urethra and out of the urethral orifice through muscular contractions." ] ], "gold": "Spermiogenesis is the final stage of spermatogenesis, during which spermatids mature into spermatozoa. There are four stages of spermiogenesis. The first stage is the Golgi phase, the second is the cap phase, the third is the formation of tail, and, finally, the fourth is called the maturation stage. The final maturation stage of sperm cells occurs in Sertoli cells, in the testes.", "prediction 1": "Spermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa. The developing sperm travel through the seminiferous tubules to the rete testis located in the mediastinum testis. The efferent ducts, and then to the epididymis where newly created sperm cells mature.", "prediction 2": "The stages during which the final maturation of sperm cells occur are called spermiogenesis, spermiogenesis, and spermatogenesis. Spermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa. The process of spermatogenesis is traditionally divided into four stages: the Golgi phase, the cap phase, formation of tail, and the maturation stage.", "prediction 3": "Spermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa. Spermiogenesis is traditionally divided into four stages: the Golgi phase, the cap phase, formation of tail, and the maturation stage.", "prediction 4": "Spermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa. The process of spermiogenesis is traditionally divided into four stages: the Golgi phase, the cap phase, formation of tail, and the maturation stage. The developing sperm travel through the seminiferous tubules to the rete testis located in the mediastinum testis, to the efferent ducts, and then to the epididymis where newly created sperm cells mature.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Spermiogenesis is the final stage of spermatogenesis, which sees the maturation of spermatids into mature, motile spermatozoa. The process of spermiogenesis is traditionally divided into four stages: the Golgi phase, the cap phase, formation of tail, and the maturation stage. The developing sperm travel through the seminiferous tubules to the rete testis located in the mediastinum testis, the efferent ducts, and then to the epididymis where newly created sperm cells mature." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What are the two types of mixtures in science?", "passages": [ [ "Mixture", "Air is a homogeneous mixture of the gaseous substances nitrogen, oxygen, and smaller amounts of other substances.", "Salt, sugar, and many other substances dissolve in water to form homogeneous mixtures.", "A homogeneous mixture in which there is both a solute and solvent present is also a solution.", "Mixtures can have any amounts of ingredients.", "The following table shows the main properties of the three families of mixtures and examples of the three tpes of mixture.", "A \"heterogeneous mixture\" is a mixture of two or more chemical substances (elements or compounds).", "Examples are: mixtures of sand and water or sand and iron filings, a conglomerate rock, water and oil, a portion salad, trail mix, and concrete (not cement).", "A mixture of powdered silver metal and powdered gold metal would represent a heterogeneous mixture of two elements.", "Making a distinction between \"homogeneous\" and \"heterogeneous\" mixtures is a matter of the scale of sampling.", "On a coarse enough scale, any mixture can be said to be homogeneous, if the entire article is allowed to count as a \"sample\" of it.", "On a fine enough scale, any mixture can be said to be heterogeneous, because a sample could be as small as a single molecule." ] ], "gold": "Mixtures can be either homogeneous or heterogeneous. A mixture in which its constituents are distributed uniformly is called homogeneous mixture, such as salt in water. A mixture in which its constituents are not distributed uniformly is called heterogeneous mixture, such as sand in water.", "prediction 1": "The principle of homogeneity and heterogeneity in mixtures is a matter of the scale of sampling. When making a distinction between homogeneous and heterogeneous mixtures, it is a matter of the scale of sampling.", "prediction 2": "On a coarse enough scale, any mixture can be said to be homogeneous, if the entire article is allowed to count as a \"sample\" of it. On a fine enough scale, any mixture can be said to be heterogeneous, because a sample could be as small as a single molecule. Making a distinction between \"homogeneous\" and \"heterogeneous\" mixtures is a matter of the scale of sampling.", "prediction 3": "The three types of mixtures in science are homogeneous mixture and heterogeneous mixture.", "prediction 4": "The difference between homogeneous and heterogeneous mixtures in science is a matter of the scale of sampling. On a coarse enough scale, any mixture can be said to be homogeneous, if the entire article is allowed to count as a \"sample\" of it. On a fine enough scale, any mixture can be said to be heterogeneous, because a sample could be as small as a single molecule.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The principle of homogeneity and heterogeneity in mixtures is a matter of the scale of sampling. ", "start": 97, "end": 211 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Mixtures can be either homogeneous or heterogeneous. A homogeneous mixture in which there is both a solute and solvent present is also a solution. A \"heterogeneous mixture\" is a mixture of two or more chemical substances (elements or compounds) such as a mixtures of sand and water. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Youngest artist to win grammy for album of the year?", "passages": [ [ "Grammy Award records", "John Williams with 24 awards holds the record for most Grammy Awards won by a composer or songwriter.", "Some producers have also won awards as producers, singers, and.", "Al Schmitt, with 20 awards, has won more Grammy Awards than any other engineer or mixer.", "The Peasall Sisters are the youngest Grammy winners, when they were credited artists on the \"O Brother, Where Art Thou?\" soundtrack, which won Album of the Year in 2002.", "LeAnn Rimes is the youngest individual winner.", "She was 14 years old when she won her first two awards in 1997.", "She was also the first Country artist to win the Best New Artist Grammy.", "Taylor Swift is the youngest solo artist to win Album of the Year.", "She was 20 years old when she won in 2010 for her album \"Fearless\".", "Pinetop Perkins is the oldest person to win a Grammy.", "In 2011 he was awarded Best Traditional Blues Album for \"Joined At The Hip\" at 97 years of age.", "Santana's \"Supernatural\" and U2's \"How to Dismantle an Atomic Bomb\" hold the record for most honoured album having won nine awards.", "\"Supernatural\" won nine awards in 2000 and \"How to Dismantle an Atomic Bomb\" won three awards in 2005 and won a further six in 2006 giving it a total of nine awards.", "The record for most Album of the Year wins is four." ], [ "Grammy Award for Album of the Year", "In addition, Lauryn Hill, Norah Jones and Alison Krauss are all tied with Swift and Adele with two wins overall, each winning as lead artist for their respective albums, \"The Miseducation of Lauryn Hill\", \"Come Away with Me\" and \"Raising Sand\" (Krauss' collaboration album with Robert Plant); Hill won her second as a producer of her collaboration on Santana's \"Supernatural\" (featured artists on non-soundtrack albums did not share in the award before 2008), while the other two also won as featured artists (Jones on Herbie Hancock's \"\" and Krauss on the \"O Brother, Where Art Thou?\" soundtrack).", "Also, for their own albums, besides Swift and Adele, only two female artists have received nominations after previously winning (Bonnie Raitt nominated again for \"Luck of the Draw\" and \"Longing in Their Hearts\", after winning previously for \"Nick of Time\", and Barbra Streisand nominated again for \"People\", \"My Name Is Barbra\", \"Color Me Barbra\", \"Guilty\" and \"The Broadway Album\", after winning previously for \"The Barbra Streisand Album\")." ], [ "Grammy Award for Album of the Year", "Grammy Award for Album of the Year\n\nThe Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception.\"", "Album of the Year is the most prestigious award category at the Grammys having been presented since 1959.", "Although it was originally presented to the artist alone, the award is now presented to the main artist, the featured artist(s), the producer, the engineer and/or mixer and the mastering engineer.", "In 1962, the award name was extended to Album of the Year (other than classical) but, in 1965, the shorter name returned.", "It was not until 1968, 1969, 1999, 2011, and 2014 that the award was won by a rock, country, hip hop, indie, or electronic music album respectively.", "As of 2012, classical albums are eligible for this award, with the award for Best Classical Album being discontinued (although no classical album has been nominated in this category since).", "The category will expand to include eight nominees in 2019.", "Tom Coyne (as mastering engineer) is the biggest winner in this category with four wins." ], [ "Grammy Award for Album of the Year", "Taylor Swift is also the youngest main artist to win in the category, winning for \"Fearless\" in 2010 at the age of 20, surpassing Alanis Morissette's win for Jagged Little Pill in 1996 when she was 21.", "The Peasall Sisters, Sarah, Hannah and Leah, are the category's youngest credited winners, winning for their contributions to the \"O Brother, Where Art Thou?\" soundtrack at the ages of 13, 9, and 7 respectively.", "Leah Peasall is the youngest winner of any Grammy in any category.", "The youngest person to make an appearance on an Album of the Year is Stevie Wonder's daughter Aisha Morris who appeared on \"Isn't She Lovely?\" off the album \"Songs in the Key of Life\" as an infant.", "The Beatles' \"Sgt. Pepper's Lonely Hearts Club Band\" was the first album by a rock and roll artist to win, Glen Campbell's \"By the Time I Get to Phoenix\" was the first by a country artist, Lauryn Hill's \"The Miseducation of Lauryn Hill\" the first by a hip hop artist, Arcade Fire's \"The Suburbs\" the first by an indie rock artist, and Daft Punk's \"Random Access Memories\" the first by an electronic music artist." ], [ "Alanis Morissette", "At the 1996 Grammy Awards, she won Best Female Rock Vocal Performance, Best Rock Song (both for \"You Oughta Know\"), Best Rock Album and Album of the Year.", "Later in 1996, Morissette embarked on an 18-month world tour in support of \"Jagged Little Pill\", beginning in small clubs and ending in large venues.", "Taylor Hawkins, who later joined the Foo Fighters, was the tour's drummer.", "\"Ironic\" was nominated for two 1997 Grammy Awards\u2014Record of the Year and Best Music Video, Short Form\u2014and won Single of the Year at the 1997 Juno Awards, where Morissette also won Songwriter of the Year and the International Achievement Award.", "The video \"Jagged Little Pill, Live\", which was co-directed by Morissette and chronicled the bulk of her tour, won a 1998 Grammy Award for Best Music Video, Long Form.", "Following that stressful tour, Morissette started practicing Iyengar Yoga for balancing, and after the last December 1996 show, she headed to India for six weeks, accompanied by her mother, two aunts and two friends." ], [ "Alanis Morissette", "Alanis Morissette\n\nAlanis Nadine Morissette (; born June 1, 1974) is a Canadian\u2013American singer, songwriter, multi-instrumentalist, record producer, and actress.", "Known for her emotive mezzo-soprano voice, Morissette began her career in Canada in the early 1990s with two mildly successful dance-pop albums.", "Afterwards, as part of a recording deal, she moved to Holmby Hills, Los Angeles and in 1995 released \"Jagged Little Pill\", a more rock-oriented album which sold more than 33 million copies globally and is her most critically acclaimed work.", "Her follow-up album, \"Supposed Former Infatuation Junkie\", was released in 1998.", "Morissette assumed creative control and producing duties for her subsequent studio albums, including \"Under Rug Swept\" (2002), \"So-Called Chaos\" (2004), and \"Flavors of Entanglement\" (2008).", "Her eighth studio album and most recent to date, \"Havoc and Bright Lights\", was released in 2012.", "Morissette has sold more than 75 million records worldwide and has been dubbed the \"Queen of Alt-Rock Angst\" by \"Rolling Stone\"." ], [ "The Barbra Streisand Album", "The Barbra Streisand Album\n\nThe Barbra Streisand Album is the debut album by Barbra Streisand, released February 25, 1963, on Columbia Records, catalogue CL 2007 in mono and CS 8807 in stereo.", "It peaked at #9 on the Billboard pop albums chart, and has been certified a gold album by the RIAA.", "The album won Grammy awards for Album of the Year and Best Female Vocal Performance.", "In January 2006 the album was inducted into the Grammy Hall of Fame.", "Columbia label president Goddard Lieberson initially resisted signing Streisand to a contract, finding her style too close to the cabaret singers he disliked and too far from the understated approach of Jo Stafford or Rosemary Clooney, who recorded for the label in the 1950s.", "After exposure to Streisand's television interview with Mike Wallace on \"PM East/PM West\" and pressure from associates, Lieberson relented and agreed to sign her.", "Nearly three decades later Streisand would reflect: The most important thing about that first contract \u2013 actually, the thing we held out for \u2013 was a unique clause giving me the right to choose my own material.", "It was the only thing I really cared about." ] ], "gold": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception. Billie Eilish is the youngest main credit artist to win in the category, winning for her debut album When We All Fall Asleep, Where Do We Go? in 2020 at the age of 18, surpassing Taylor Swift who won in 2010 at the age of 20 for her second album Fearless. Canadian musician Alanis Morissette, who was born June 1974, was the youngest person to win the award at the time she won in 1996. In 1964, Barbra Streisand was the youngest person to win the award at the time, when she won for her album The Barbra Streisand Album.", "prediction 1": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception\". Taylor Swift is the youngest main artist to win in the category, winning for Fearless in 2010 at the age of 20, surpassing Alanis Morissette's win for Jagged Little Pill in 1996 when she was 21. The Peasall Sisters are the youngest Grammy winners, when they were credited artists on the \"O Brother, Where Art Thou?\" soundtrack, which won Album of the Year in 2002. LeAnn Rimes is the youngest individual winner. She was 14 years old when she won her first two awards in 1997 and was the first Country artist to win a Grammy.\n", "prediction 2": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception\". The Peasall Sisters, Sarah, Hannah and Leah, are the youngest Grammy winners, when they were credited artists on the \"O Brother, Where Art Thou?\" soundtrack, which won Album of the Year in 2002.", "prediction 3": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception\". Taylor Swift is the youngest solo artist to win the award for Album of the Year, and her album Fearless was released on November 2, 2010. Janet Jackson is the youngest individual winner. LeAnn Rimes is the youngest individual winner. She was 14 years old when she won her first two awards in 1997 and 2002. Annie She was 45 years old when she won her Grammy for Best Country Album of the Year. At nine awards in the same year. Abbey Road is the oldest person to win a Grammy, and 21.", "prediction 4": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry\" without regard to album sales, chart position, or critical reception. Santana's Supernatural and U2's How to Dismantle an Atomic Bomb hold the record for most honoured album having won nine awards across all genres. The current record for most Album of the Year wins is four. Taylor Swift is the youngest main artist to win in the category, winning for her album Fearless in 2010 at the age of 20. In addition, Lauryn Hill, Norah Jones and Alison Krauss are tied with Swift and Adele with two wins overall, each winning as lead artist for their respective albums. Pinetop Perkins is the oldest person to win a Grammy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 450, "end": 472 }, { "error type": "Irrelevant", "explanation": "", "start": 481, "end": 497 }, { "error type": "Irrelevant", "explanation": "", "start": 583, "end": 667 }, { "error type": "Irrelevant", "explanation": "", "start": 715, "end": 828 }, { "error type": "Irrelevant", "explanation": "", "start": 668, "end": 714 } ], "missing-info": [], "corrected-prediction": "The Grammy Award for Album of the Year is presented by the National Academy of Recording Arts and Sciences of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales, chart position, or critical reception\". Taylor Swift is the youngest main artist to win in the category, winning for Fearless in 2010 at the age of 20, surpassing Alanis Morissette's win in 1996 when. The Peasall Sisters are the youngest Grammy winners, when they were credited artists. LeAnn Rimes is the youngest individual winner. The youngest person to make an appearance on an Album of the Year is Stevie Wonder's daughter Aisha Morris.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does episode 107 of dragonball super air?", "passages": [ [ "Dragon Ball", "\"Dragon Ball GT\" and \"Dragon Ball Heroes\" are not originated from any direct source material from Toriyama, being fully created by their respective animation studios.", "\"Dragon Ball Super\" was released parallel to (and many times ahead of) the manga of the same name, due to the fact that they were both based on the same outline by Toriyama for the story of \"Super\".", "Toei Animation produced an anime television series based on the first 194 manga chapters, also titled \"Dragon Ball\".", "The series premiered in Japan on Fuji Television on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes.", "Instead of continuing the anime as \"Dragon Ball\", Toei Animation decided to carry on with their adaptation under a new name and asked Akira Toriyama to come up with the title.", "picks up five years after the first series left off and adapts the final 325 chapters of the manga.", "It premiered in Japan on Fuji Television on April 26, 1989, taking over its predecessor's time slot, and ran for 291 episodes until its conclusion on January 31, 1996.", "Two television specials based on the \"Z\" series were aired on Fuji TV in Japan.", "The first, \"The One True Final Battle ~The Z Warrior Who Challenged Freeza -- Son Goku's Father~\", renamed \"\" by Funimation, was shown on October 17, 1990." ], [ "Dragon Ball Super", "The series ended on March\u00a025, 2018, with the conclusion of the \"Universe Survival Saga\".", "Fuji TV stated that no definite plans were made to either continue the series at a later date or discontinue it entirely.", "\"Dragon Ball Super\" received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017.", "This dub is produced by Los Angeles based Bang Zoom!", "Entertainment for the Asian market.", "A sneak preview of the English dub's first episode aired on December 17, 2016.", "Production on the Bang Zoom!", "dub ended after episode 27.", "On November 4, 2016, Funimation announced the company acquired the rights to \"Dragon Ball Super\" and would be producing an English dub, with many cast members of their previous English-language releases of \"Dragon Ball\" media reprising their respective roles.", "As well as officially announcing the dub, it was also announced they would be simulcasting the series on their streaming platform, \"FunimationNow\".", "On December 7, 2016, IGN reported that the Funimation English dub of \"Dragon Ball Super\" would air on Adult Swim Saturdays at 8 p.m. with an encore showing in their Toonami block later that night at 11:30\u00a0p.m. starting on January 7, 2017.", "This was later confirmed on Toonami's official Facebook page." ], [ "Battle Girl High School", "Battle Girl High School\n\nThe story is set in the future of year 2045.", "Aya Suzaki\n\nChuuuuu\u2661Lip\n\nSirius\n\nTiara\n\nf*f\n\nf*f\n\nf*f\n\nPrincess\n\nROGUE\n\nPixie\n\n/MUTE\n\nClover\n\nf*f\n\nDistributed on official website every Tuesday from June 30, 2015 \u2013 December 8, 2015\n\nDistributed on official website.", "Distributed from the official website June 9, 2015.", "Distributed on LINE to celebrate 3 million download from November 1, 2016.", "An anime television series aired from July 2 to September 17, 2017.", "It is directed by Noriaki Akitaya at studio Silver Link, with scripts written by Y\u014dsuke Kuroda and character design by Sh\u016bhei Yamamoto and Hideki Furukawa.", "The opening theme is performed by Hoshimori, while the ending theme is \"Melody Ring\" by f*f.", "Sentai Filmworks has licensed the series in North America, MVM Films has licensed the series in the UK." ] ], "gold": "The 107th episode of the 131-episode anime series Dragonball Super originally aired in Japan on September 17, 2017. An English dub of the episode, produced by Funimation, first aired in the United States on April 20, 2019.", "prediction 1": "Dragon Ball Super is an American manga series that was created by Akira Toriyama and released parallel to and many times ahead of the Japanese manga of the same name, because they were both based on the same outline by Toriyama for the story of \"Super\". Toei Animation produced an anime television series based on the first 194 manga chapters, also titled Dragon Ball. The series premiered in Japan on Fuji Television on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes. The English-language dub of the series aired on January 21, 2017. The English-language dub premiered on the Toonami channel in Southeast Asia and India on January 21, 2017.", "prediction 2": "Episode 107 of the Japanese Dragon Ball Super television series aired on January 9, 2017. The English-language dub of the show premiered on the Toonami channel in Southeast Asia and India on January 21, 2017.", "prediction 3": "Episode 107 of Dragon Ball Super aired on January 10, 2017. The Japanese version of the animated series Dragon Ball Super was released on January 20, 2016, on January 6, 2018, and on January 7, 2019.", "prediction 4": "The episode 107 of the Japanese TV series Dragon Ball Super aired on January 7, 2017. The English-language dub of Dragon Ball Super aired on January 21, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 491, "end": 556 }, { "error type": "Irrelevant", "explanation": "", "start": 557, "end": 642 }, { "error type": "Redundant", "explanation": "The English-language dub of the series aired on January 21, 2017. ", "start": 643, "end": 663 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who does belly end up with in the summer i turned pretty?", "passages": [ [ "Brothers & Sisters (season 5)", "Subsequently, they begin spending time with a young girl, Olivia, in foster care and eventual officially adopt her.", "After spending time with her, Olivia begins to withdraw and they discover that she cannot read and was too afraid to tell them.", "They pay for her to have a tutor and eventually officially adopt her.", "She is introduced to the rest of the Walkers at Evan's birthday party where she begins to become close to her cousin Paige.", "After her older brother returns Kevin and Scotty must fight for their right to keep custody of Olivia.", "Although they are successful they ask her brother to dinner so that he can keep a close relationship with his sister.", "Scotty bumps into Michelle who is acting strangely and tries to talk to her after months of no contact.", "When he and Kevin see her at the airport with a baby they get the police involved realizing it is their child.", "Michelle calls Scotty and tells him she wants to stay involved as his mother but when Kevin reminds her that she has no right or relation she gives back their son Daniel.", "Olivia has some trouble accepting Daniel into the family but in the end accepts her baby brother.", "Sarah is having trouble with Luc's busy and glamorous new career and begins to feel old around him; however, they become engaged at the end of episode five." ] ], "gold": "Belly is known to have had a crush on her friend Conrad Fisher since she was young, but her relationship with him falls apart at the end of It's Not Summer Without You, the second book in the Summer I Turned Pretty series, after the two become a couple for a short time. Belly then starts a relationship with his brother, Jeremiah Fisher, after he kisses her; making his feelings known to her. The third book in the series, We'll Always Have Summer, then chronicles Belly and Jeremiah's two-year relationship. Belly discovers at a frat party that Jeremiah cheated on her with a sorority girl. To prove his regret, Jeremiah proposes to her, which she hesitantly accepts; however, as a result of ongoing fights with her mother, who is furious with her for choosing to marry so young, she stays at Cousin's Beach. Because of this arrangement, her old feelings for Conrad, who is staying there as well, begin to slowly resurface. Towards the climax of the novel, Conrad confesses his love for her. Although Belly blows up at his confession, saying he was too late, her feelings for both brothers are called into question. She and Jeremiah, in the end, call off their engagement and break up for good after realizing they are not meant to be. In the epilogue, Belly has not heard from Conrad for two years, before receiving handwritten letters from him throughout the rest of her college years. Eventually, she begins to stay in contact with him. Conrad shows up at her college graduation, resulting in them getting back together as a couple. He proposes to Belly a few years later, and the series ends with their marriage.", "prediction 1": "In the episode \"Summer I turned Pretty\" Bella is dating Sarah and Luc.", "prediction 2": "The Walkers end up with Belly Bell in the summer i turned pretty. Belly ends up with Sarah Bell after she tries to marry Luc.", "prediction 3": "Bella is attracted to a young girl, Olivia, who is in foster care. After they spend time with her, Olivia begins to withdraw and they discover that she cannot read and was too afraid to tell them. They pay for her to have a tutor and eventually officially adopt her. Sarah is attracted to Bella, and they become engaged at the end of episode five.", "prediction 4": "In the episode \"Summer I turned Pretty\" Bella ends up with Sarah.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 70 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "When did the 7 digit phone number start?", "passages": [ [ "Seven-digit dialing", "All-number calling is implemented, replacing 2L-5N numbers.", "Although a very small number of places still have non-seven-digit dialing by 1981, they are extremely rare.", "New area codes are introduced, a handful in 1981-83, then status-quo for most of the time until 1990.", "From 1990 to 1994, all remaining assignable codes are put into service.", "Exhaust of NXX codes results in interchangeable NXXes in several more area codes.", "1+10 digit or 10-digit dialing is implemented in area codes that have interchangeable NXX codes.", "Protected dialing plans as in national capital areas are discontinued to help meet demand without an area code relief.", "As 1994 nears an end, 1+10 or 10 becomes required throughout the numbering plan in preparation for interchangeable NPA codes.", "All local numbers are now seven-digit, as the last technological hold-outs have given way to modern switching technology.", "The concept of a ten-digit local number is now conceived, as New York has an overlay code but seven-digit dialing is still the norm.", "Interchangeable NPA codes are introduced in Washington and Alabama, and some 40 new area codes are introduced through the year 1999 as pent-up demand for code relief is implemented." ], [ "Seven-digit dialing", "The NANP area codes were implemented in use to allow operators to dial other operators for call completion assistance.", "Several cities were upgraded in this period to seven-digit (two-letter-five-number) phone numbers.", "As there are no letters on the 0 or 1 position, it fit with the assumption that no central office code would have a zero or one as the middle digit.", "Direct Distance Dialing was implemented in late 1951 in Englewood, New Jersey, giving customers in that exchange the ability to directly dial phones in a select number of cities as far away as San Francisco.", "Direct distance dialing slowly was expanded to other major cities, restrained by the complexity of the technology, the time needed to expand local exchanges to seven-digit numbers, and the limited technology to compile and process billing of long distance calls without modern computers being affordable.", "By 1960, a few places in Canada had DDD as well as most large American cities.", "This decade is notable for some thirty more area codes being implemented, including codes for Alaska, Hawaii and the Caribbean.", "Major progress in provisioning DDD service, computerizing long distance billing.", "Few area codes were introduced during this time.", "Toll free 800 service was introduced.", "Service demands in the largest American cities of New York and greater Los Angeles resulted in the first use of interchangeable NXXes." ] ], "gold": "The 7 digit all-number telephone number format came into use in 1960 with advancements in Direct Distance Dialing technology. From 1960 to 1981, the all-number format became ubiquitous, with only a very small number of places retaining the two-letter-five-number format that was popular from 1947 to 1951.", "prediction 1": "The 7 digit phone number started in the USA in 1961 and in Canada in 1962. It was then introduced in several US cities in the 1960s. It was first implemented in the United States in 1961, and was used for local and long distance calls.", "prediction 2": "The seven digit phone number started in the United States in 1960 and was implemented in several cities by the 1960s. However, it began to be restricted by the complexity of the technology, the time needed to expand local exchanges to seven-digit numbers, and the limited technology to compile and process billing of long distance calls without modern computers being affordable.", "prediction 3": "The first seven-digit phone number was implemented in New York City in 1956. The first seven-digit area code was implemented in 1961 in Englewood, New Jersey. Several cities were upgraded in this period to seven-digit phone numbers, restrained by the complexity of the technology, the time needed to expand local exchanges to seven-digit numbers, and the limited technology to compile and process billing of long distance calls without modern computers being affordable. The first seven-digit area code was implemented in Chicago in 1961. The first seven-digit phone numbers were implemented in the 1960 in Chicago, Illinois, and Los Angeles in 1960.", "prediction 4": "The use of the 7 digit phone number started in the United States in 1960. The 7 digit phone number was first introduced in the United States in 1961.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 133, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 235 }, { "error type": "Unverifiable", "explanation": "", "start": 56, "end": 74 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "By 1960, a few places in Canada had DDD as well as most large American cities used the 7 digit number format with advancements in Direct Distance Dialing technology. Although a very small number of places still have non-seven-digit dialing by 1981, they are extremely rare." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "The walking dead season 3 game release date?", "passages": [ [ "Mafia III", "Players can also purchase the Limited Deluxe Edition and the Limited Collector's Edition.", "The Limited Deluxe Edition's content include the base game and the season pass, while the Limited Collector's Edition added additional content such as the game's original soundtrack and art book.", "A mobile game entitled \"Mafia III Rivals\" was also released to tie in with the main game, developed by Cat Daddy Games for Android and iOS.", "\"Rivals\" is presented as a role-playing game with turn-based combat mechanics.", "Following the game's release, several pieces of story-based downloadable content was released by the developer.", "The first DLC, titled \"Faster, Baby\", was released on March 28, 2017 and features new story missions set in the Sinclair Parish district, as well as new gadgets.", "On the same day, 2K Games released a free demo for players to try the game.", "On May 30, 2017, the second DLC, \"Stones Unturned\", which reunites Lincoln Clay with John Donovan, was released and it introduces several new weapons into the game.", "The third DLC, titled \"Sign of the Times\", which sees Lincoln fighting against a cult called Ensanglante, was released on July 25, 2017.", "\"Mafia III\" received \"mixed or average\" reviews from critics, according to review aggregator Metacritic." ], [ "Outlast", "On March 6, 2017, Red Barrels announced that a physical bundle called \"Outlast Trinity\" would be released for Xbox One and PlayStation 4 on April 25.", "The sequel, titled \"Outlast 2\", was made digitally available for Microsoft Windows, PlayStation 4, and Xbox One on April 25, 2017; and came to the Nintendo Switch, alongside \"Outlast\", in February 2018.", "The game is set in the same universe as the first game, but features different characters and a new region in the Arizona desert.", "\"Outlast 3\" was announced in December 2017, though no time frame or target platforms were confirmed.", "During this announcement, Red Barrels said that because they could not easily add downloadable content for \"Outlast 2\" due to its structure, they have a smaller separate project related to \"Outlast\" that will release before \"Outlast 3\"." ], [ "The Walking Dead (franchise)", "In January 2016, Mantic Games announced plans to release a tabletop miniature wargame based on \"The Walking Dead\", named \"The Walking Dead: All Out War\".", "On February 18, 2011, Telltale Games announced plans to create an episodic video game based on the comics, was scheduled to debut in fall 2011, but finally was released on April 24, 2012.", "Kirkman has said that, unlike typical zombie games such as \"Left 4 Dead\", it focuses more on characterization and emotion than action.", "The video game includes known characters and also introduces characters not shown in the comic or TV show.", "From April 24, 2012 to November 20, 2012, the game released five episodes, and then released a DLC Pack in June 2013.", "The game was met with critical acclaim, winning several Game of the Year awards.", "Following \"Season One\"s success, a sequel was announced for release.", "Its first episode was released on December 17, 2013.", "Its final was released on August 26, 2014.", "Telltale Games confirmed that it will produce a third season of \"Walking Dead\", following the success of the first two seasons.", "The season began on December 20, 2016.", "In July 2017 during San Diego Comic Con, Telltale Games announced that the fourth season of the series will be the final season of the game." ] ], "gold": "The Walking Dead Season 3 game had several release dates. The game had a release for Episodes 1 and 2 on December 20, 2016, for Episode 3 on March 28, 2017, for Episode 4 on April 25, 2017, and for Episode 5 on May 30, 2017. It was released for the Nintendo Switch on January 21, 2020.", "prediction 1": "Season 3 of The Walking Dead, an episodic survival horror television series, began filming on December 20, 2016. It was released on December 20, 2016. The finale of the series, Season 4: The Last of Us, was released on July 25, 2017. The final episode was released on August 26, 2014.", "prediction 2": "Season 3 of The Walking Dead began filming for the game on December 20, 2016 and was released simultaneously on December 17, 2013 and August 26, 2014. Season 3 of Outlast 2 was released on April 25, 2017, and Season 3 of Outlast was released on March 6, 2017. Season 3 of Mafia III was released alongside the main game on December 10, 2017.", "prediction 3": "The season 3 of The Walking Dead was released on December 20, 2016. Season 3 of Outlast was released on July 25, 2017, and season 4 of Outlast was released on October 12, 2017.", "prediction 4": "The Walking Dead season 3 game release date was announced December 20, 2016. The season began on December 20, 2016 and the fourth season of the series was announced as the final season of the game. Mafia III Rivals, an eSports mobile game developed by Cat Daddy Games for Android and iOS, was also released to tie in with the main game.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 234, "end": 284 }, { "error type": "Unverifiable", "explanation": "", "start": 30, "end": 76 }, { "error type": "Unverifiable", "explanation": "", "start": 113, "end": 150 }, { "error type": "Unverifiable", "explanation": "", "start": 151, "end": 233 } ], "missing-info": [], "corrected-prediction": "Season 3 of The Walking Dead began on December 20, 2016. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the next maze runner movie come out?", "passages": [ [ "Maze Runner (film series)", "Maze Runner (film series)\n\nMaze Runner is an American film trilogy consisting of science-fiction dystopian action adventure films based on \"The Maze Runner\" novels by the American author James Dashner.", "Produced by Ellen Goldsmith-Vein and distributed by 20th Century Fox, the films star Dylan O'Brien, Kaya Scodelario, Thomas Brodie-Sangster, Ki Hong Lee, Dexter Darden and Patricia Clarkson.", "Wes Ball directed all three films.", "The first film, \"The Maze Runner\", was released on September 19, 2014 and became a commercial success grossing over $348 million worldwide.", "The second film, \"\" was released on September 18, 2015, and was also a success, grossing over $312 million worldwide.", "The film series concluded with the release of the third film, \"\" on January 26, 2018.", "The film features Thomas, who wakes up trapped in a maze with a group of other boys.", "He has no memory of the outside world other than dreams about an organization known as WCKD (World Catastrophe Killzone Department).", "Only by piecing together fragments of his past with clues he discovers in the maze can Thomas hope to uncover his purpose and a way to escape.", "Development for the film began in January 2011 when Fox purchased the film rights to Dashner's novel \"The Maze Runner\"." ], [ "Maze Runner (film series)", "Principal photography began in Baton Rouge, Louisiana in May 2013 and ended in July.", "It was released on September 19, 2014.", "The film features Thomas and his fellow Gladers as they search for clues about the organization known as WCKD.", "Their journey takes them to the Scorch, a desolate landscape filled with obstacles.", "Teaming up with resistance fighters, the Gladers take on WCKD's \"vastly superior\" forces and uncover its plans for them all.", "Principal photography commenced in Albuquerque, New Mexico, in October 2014 and ended in January 2015.", "It was released on September 18, 2015.", "In the finale to the Maze Runner saga, Thomas leads his group of escaped Gladers on their final and most dangerous mission yet.", "To save their friends, they must break into the legendary Last City, a WCKD-controlled labyrinth that may turn out to be the deadliest maze of all.", "Anyone who makes it out alive will get answers to the questions the Gladers have been asking since they first arrived in the maze.", "In March 2015, T.S. Nowlin, who co-wrote the first and wrote the second film, was hired to write \"Maze Runner:", "The Death Cure\" based on the novel \"The Death Cure\".", "In September 2015, Ball was hired to direct the film.", "Ball said that the film would not be split into two films." ], [ "Proposed acquisition of 21st Century Fox by Disney", "Sports broadcasting was Mexico's main concern.", "On October 5, 2018, Disney announced the commencement of exchange offers and consent solicitations for 21st Century Fox.", "On October 8, 2018, Disney announced that 21st Century Fox's top television executives would join the company, including Peter Rice, Gary Knell, John Landgraf, and Dana Walden.", "Rice will serve as Chairman of Walt Disney Television and Co-Chair of Disney Media Networks, succeeding Ben Sherwood while Walden is to be named Chairman of Disney Television Studios and ABC Entertainment.", "On October 10, 2018, it was reported that the new, post-merger organizational structure of \"New Fox\" would be implemented by January 1, 2019, ahead of the closure of the Disney sale (which is still expected to occur during the first half of 2019).", "On October 15, 2018, Disney offered a list of concessions to the European Commission, which extended the review deadline to November 6.", "On October 18, 2018, Disney announced a new organizational structure for The Walt Disney Studios and the individuals who would join the company, including Emma Watts, Elizabeth Gabler, Nancy Utley and Stephen Gilula.", "Watts who currently serves as Vice Chairman and President of production at 20th Century Fox will lead Fox's film division reporting to Walt Disney Studios Chairman Alan Horn, succeeding Stacey Snider." ] ], "gold": "The Maze Runner, the first film in the Maze Runner trilogy, was released on September 19, 2014. The second film in the series, Maze Runner: The Scorch Trials, was released on September 18, 2015. The film series concluded with the release of the third film, Maze Runner: The Death Cure, on January 26, 2018. However, following the acquisition of 21st Century Fox by Disney in March 2019, Disney announced in April 2019 at their CinemaCon presentation that new Maze Runner films are in development.", "prediction 1": "Maze Runner is an American film trilogy consisting of science-fiction dystopian action adventure films based on \"The Maze Runner\" novels by the American author James Dashner. The first film, \"The Maze Runner\", was released on September 19, 2014 and became a commercial success grossing over $348 million worldwide. The second film, \"\" was released on September 18, 2015, and was also a success, grossing over $312 million worldwide. The film series concluded with the release of the third film, \"\" on January 26, 2018.", "prediction 2": "Maze Runner is a science-fiction dystopian action adventure film series written by American author James Dashner. The first film, The Maze Runner, was released on September 19, 2014. The second film, Maze Runner: The Death Cure, was released on September 18, 2015. Maze Runner: The Final Solution came out on January 26, 2018.", "prediction 3": "Maze Runner is an American film trilogy consisting of science-fiction dystopian action adventure films based on The Maze Runner novels by the American author James Dashner. The first film, The Maze Runner, was released on September 19, 2014 and became a commercial success grossing over $348 million worldwide. The second film, Maze Runner: The Death Cure, was released on September 18, 2015, and was also a success, grossing over $312 million worldwide. The film series concluded with the release of the third film, Maze Runner: The Death Cure, which was released on January 26, 2018.", "prediction 4": "The Maze Runner is an American science fiction dystopian action adventure film trilogy consisting of science fiction and action adventure films based on \"The Maze Runner\" novels by American author James Dashner. The first film, \"The Maze Runner\", was released on September 19, 2014 and became a commercial success grossing over $348 million worldwide. The second film, \"The Maze Runner II\", was released on September 18, 2015. The film series concluded with the release of the third film, \"The Maze Runner: The Death Cure\", which was released on January 26, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 432 } ], "missing-info": [], "corrected-prediction": "Maze Runner is an American film trilogy. The first film, \"The Maze Runner\", was released on September 19, 2014. The second film was released on September 18, 2015. The film series concluded with the release of the third film on January 26, 2018." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "What is the speed of light in km?", "passages": [ [ "Speed of light", "Speed of light\n\nThe speed of light in vacuum, commonly denoted , is a universal physical constant important in many areas of physics.", "Its exact value is (approximately ).", "It is exact because by international agreement a metre is defined to be the length of the path travelled by light in vacuum during a time interval of 1/299792458 second.", "According to special relativity, is the maximum speed at which all conventional matter and hence all known forms of information in the universe can travel.", "Though this speed is most commonly associated with light, it is in fact the speed at which all massless particles and changes of the associated fields travel in vacuum (including electromagnetic radiation and gravitational waves).", "Such particles and waves travel at regardless of the motion of the source or the inertial reference frame of the observer.", "In the special and general theories of relativity, interrelates space and time, and also appears in the famous equation of mass\u2013energy equivalence .", "The speed at which light propagates through transparent materials, such as glass or air, is less than ; similarly, the speed of electromagnetic waves in wire cables is slower than .", "The ratio between and the speed at which light travels in a material is called the refractive index of the material ()." ] ], "gold": "The speed of light in vacuum, commonly denoted c, is a universal physical constant important in many areas of physics. Its exact value is defined as 299792458 metres per second (approximately 300000 km/second, or 186000 metres/second). The speed of light in air is 299700 km/second, or 1080000000 km/hour.", "prediction 1": "The speed of light in vacuum, commonly denoted, is a universal physical constant important in many areas of physics. According to special relativity, is the maximum speed at which all conventional matter and hence all known forms of information in the universe can travel. Though this speed is most commonly associated with light, it is in fact the speed at which all massless particles and changes of the associated fields travel in vacuum, including electromagnetic radiation and gravitational waves. Such particles and waves travel at regardless of the motion of the source or the inertial reference frame of the observer.", "prediction 2": "Speed of light in vacuum, commonly denoted, is a universal physical constant important in many areas of physics. According to special relativity, is the maximum speed at which all conventional matter and hence all known forms of information in the universe can travel. Though this speed is most commonly associated with light, it is in fact the speed at which all massless particles and changes of the associated fields travel in vacuum.", "prediction 3": "The speed of light in vacuum, commonly denoted, is a universal physical constant important in many areas of physics. According to special relativity, is the maximum speed at which all conventional matter and hence all known forms of information in the universe can travel. Though this speed is most commonly associated with light, it is in fact the speed at which all massless particles and changes of the associated fields travel in vacuum, including electromagnetic radiation and gravitational waves.", "prediction 4": "The speed of light in vacuum, commonly denoted by the symbol, is a universal physical constant important in many areas of physics. According to special relativity, is the maximum speed at which all conventional matter and hence all known forms of information in the universe can travel. This speed is in reality the speed at which all massless particles and changes of the associated fields travel in vacuum, including electromagnetic radiation and gravitational waves.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 502 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 625 } ], "missing-info": [], "corrected-prediction": "The speed of light in vacuum, commonly denoted, is a universal physical constant important in many areas of physics. " }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Where does the origin of the easter bunny come from?", "passages": [ [ "Easter Bunny", "In his 1835 \"Deutsche Mythologie\", Jacob Grimm states \"The Easter Hare is unintelligible to me, but probably the hare was the sacred animal of Ostara\".", "This proposed association was repeated by other authors including Charles Isaac Elton and Charles J Billson.", "In 1961 Christina Hole wrote, \"The hare was the sacred beast of Eastre (or Eostre), a Saxon goddess of Spring and of the dawn.\"", "The belief that \u0112ostre had a hare companion who became the Easter Bunny was popularized when it was presented as fact in the BBC documentary \"Shadow of the Hare\" (1993).", "The Oxford \"Dictionary of English Folklore\" however states \"... there is no shred of evidence\" that hares were sacred to \u0112ostre, noting that Bede does not associate her with any animal.", "Sarah Ben Breathnach in \"Mrs Sharp's Traditions\" (1990) provides an origin story for the Easter Bunny: \"According to legend, Eostre's favorite animal was a large handsome bird, which in a fit of anger she turned into a hare.\"", "Another version of this story, in which \u0112ostre transforms the bird into a hare in an act of mercy, was written by Jean-Andrew Dickmann and appeared in \"Cricket\" magazine." ], [ "Easter Bunny", "Easter Bunny\n\nThe Easter Bunny (also called the Easter Rabbit or Easter Hare) is a folkloric figure and symbol of Easter, depicted as a rabbit bringing Easter eggs.", "Originating among German Lutherans, the \"Easter Hare\" originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of the season of Eastertide.", "The Easter Bunny is sometimes depicted with clothes.", "In legend, the creature carries colored eggs in his basket, candy, and sometimes also toys to the homes of children, and as such shows similarities to Santa Claus or the Christkind, as they both bring gifts to children on the night before their respective holidays.", "The custom was first mentioned in Georg Franck von Franckenau's \"De ovis paschalibus\" ('About Easter Eggs') in 1682, referring to a German tradition of an Easter Hare bringing Easter eggs for the children.", "The hare was a popular motif in medieval church art.", "In ancient times, it was widely believed (as by Pliny, Plutarch, Philostratus, and Aelian) that the hare was a hermaphrodite.", "The idea that a hare could reproduce without loss of virginity led to an association with the Virgin Mary, with hares sometimes occurring in illuminated manuscripts and Northern European paintings of the Virgin and Christ Child." ] ], "gold": "The Easter Bunny, also called the Easter Rabbit or Easter Hare, is a folkloric figure and symbol of Easter, depicted as a rabbit, originating among German Lutherans, the \"Easter Hare\" originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of the season of Eastertide, similar to the \"naughty or nice\" list made by Santa Claus. In his 1835 Deutsche Mythologie, Jacob Grimm states \"The Easter Hare is unintelligible to me, but probably the hare was the sacred animal of Ostara\". This proposed association was repeated by other authors including Charles Isaac Elton, and Charles J. Billson, and in 1961 Christina Hole wrote, \"The hare was the sacred beast of Eastre or \u0112ostre, a Saxon goddess of Spring and of the dawn.", "prediction 1": "The origin of the Easter Bunny is unknown. The custom was first mentioned in Georg Franckenau's book De ovis paschalibus in 1682, referring to a German tradition of an Easter Hare bringing Easter eggs for the children. Jacob Grimm states that the Easter Hare is unintelligible to me, but probably the hare was the sacred animal of Ostara. In 1961 Christina Hole wrote, \"The hare was the sacred beast of Eastre (or Eostre), a Saxon goddess of Spring and of the dawn.", "prediction 2": "The Easter Bunny, also called the Easter Rabbit or Easter Hare, is a folkloric figure and symbol of Easter, depicted as a rabbit bringing Easter eggs. Originating among German Lutherans, the Easter Hare originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of Eastertide. Sarah Ben Breathnach in Mrs Sharp's Traditions (1990) provides an origin story for the Easter Bunny: \"According to legend, Eostre's favorite animal was a large handsome bird, which in a fit of anger she turned into a hare.\" Another version of this story, in which ostre transforms the bird into a hare in an act of mercy, was written by Jean-Andrew Dickmann and appeared in Cricket magazine.", "prediction 3": "The origin of the Easter Bunny comes from Germany. Originating among German Lutherans, the Easter Hare originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of Eastertide. Sarah Ben Breathnach in Mrs. Sharp's Traditions provides an origin story for the Easter Bunny, saying, \"According to legend, Eostre's favorite animal was a large handsome bird, which in a fit of anger she turned into a hare.\" Another version of this story, in which ostre transforms the bird into an act of mercy, was written by Jean-Andre Dickmann and appeared in Cricket magazine.", "prediction 4": "The Easter Bunny is a folkloric figure and symbol of Easter, depicted as a rabbit bringing Easter eggs. Originating among German Lutherans, the Easter Hare originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of Eastertide. The custom was first mentioned in Georg Franck von Franckenau's \"De ovis paschalibus\" in 1682, referring to a German tradition of an Easter Hare bringing Easter eggs for the children.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 218 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 42 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Easter Bunny, also called the Easter Rabbit or Easter Hare, is a folkloric figure and symbol of Easter, depicted as a rabbit, originating among German Lutherans, the \"Easter Hare\" originally played the role of a judge, evaluating whether children were good or disobedient in behavior at the start of the season of Eastertide. In his 1835 \"Deutsche Mythologie\", Jacob Grimm states \"The Easter Hare is unintelligible to me, but probably the hare was the sacred animal of Ostara\". This proposed association was repeated by other authors including Charles Isaac Elton and Charles J Billson. In 1961 Christina Hole wrote, \"The hare was the sacred beast of Eastre (or Eostre), a Saxon goddess of Spring and of the dawn." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who wrote when you wish upon a star?", "passages": [ [ "When You Wish Upon a Star", "When You Wish Upon a Star\n\n\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of \"Pinocchio\".", "The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film.", "The song has since become the representative song of The Walt Disney Company.", "The recording by Cliff Edwards and Chorus was released by Victor Records as catalogue number 261546 and 26477A (in the US) and by EMI on the His Master's Voice Label as catalogue number BD\u00a0821.", "Edwards recorded another version in 1940 for an American Decca Records \"cover version\" of the score of \"Pinocchio\", conducted by Victor Young and featuring soprano Julietta Novis and The King's Men.", "It was first released on a 4-record 78-RPM album set, and years later as one side of an LP, backed by selections in grayscale and black and white and technicolor from \"The Wizard of Oz\"." ] ], "gold": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of \"Pinocchio\". The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film.", "prediction 1": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of Pinocchio. The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film. Edwards recorded another version in 1940 for an American Decca Records \"cover version\" of the score of Pinocchio conducted by Victor Young and featuring soprano Julietta Novis and The King's Men.", "prediction 2": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of Pinocchio. The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film. Edwards recorded another version in 1940 for an American Decca Records \"cover version\" of the score of \"Pinocchio\", conducted by Victor Young and featuring soprano Julietta Novis and The King's Men.", "prediction 3": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of Pinocchio. The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film. The song has since become the representative song of The Walt Disney Company. Edwards recorded another version in 1940 for an American Decca Records \"cover version\" of the score of \"Pinocchio\".", "prediction 4": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of \"Pinocchio\". The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film. Edwards recorded another version in 1940 for an American Decca Records \"cover version\" of the score of \"Pinocchio\", conducted by Victor Young and featuring soprano Julietta Novis and The King's Men.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 482 } ], "missing-info": [], "corrected-prediction": "\"When You Wish Upon a Star\" is a song written by Leigh Harline and Ned Washington for Walt Disney's 1940 adaptation of Pinocchio. The original version was sung by Cliff Edwards in the character of Jiminy Cricket, and is heard over the opening credits and in the final scene of the film. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who were the first european to reach the americas and when did they arrive?", "passages": [ [ "Norse colonization of North America", "Norse colonization of North America\n\nThe Norse colonization of North America began in the late 10th century AD when Norsemen explored and settled areas of the North Atlantic including the northeastern fringes of North America.", "Remains of Norse buildings were found at L\u2019Anse aux Meadows near the northern tip of Newfoundland in 1960.", "This discovery aided the reignition of archaeological exploration for the Norse in the North Atlantic.", "The Norse settlements in the North American island of Greenland lasted for almost 500 years.", "L\u2019Anse aux Meadows, the only confirmed settlement on the North American mainland, was small and did not last as long.", "While voyages, for example to collect timber, are likely to have occurred for some time, there is no evidence of any lasting Norse settlements on mainland North America.", "According to the Sagas of Icelanders, Norsemen from Iceland first settled Greenland in the 980s.", "There is no special reason to doubt the authority of the information that the sagas supply regarding the very beginning of the settlement, but they cannot be treated as primary evidence for the history of Norse Greenland because they embody the literary preoccupations of writers and audiences in medieval Iceland that are not always reliable.", "Erik the Red (Old Norse: Eir\u00edkr rau\u00f0i), having been banished from Iceland for manslaughter, explored the uninhabited southwestern coast of Greenland during the three years of his banishment." ], [ "L'Anse aux Meadows", "L'Anse aux Meadows\n\nL'Anse aux Meadows (; a French-English name meaning the bay with the meadows) is an archaeological site on the northernmost tip of the Great Northern Peninsula on the island of Newfoundland in the Canadian province of Newfoundland and Labrador.", "Archaeological evidence of a Norse presence was discovered at L'Anse aux Meadows in the 1960s.", "It is the only confirmed Norse or Viking site in North America outside of the settlements found in Greenland.", "Dating to around the year 1000, L'Anse aux Meadows is widely accepted as evidence of pre-Columbian trans-oceanic contact.", "It is notable for its possible connection with the attempted colony of Vinland established by Leif Erikson around the same period or, more broadly, with Norse exploration of North America.", "It was named a World Heritage Site by UNESCO in 1978.", "L'Anse aux Meadows is a French-English name which can be translated as the bay with the grasslands.", "The site now known as L'Anse aux Meadows was first recorded as \" (\"the M\u00e9d\u00e9e's Cove\") on a French nautical chart made in 1862.", "The toponym probably referred to a ship named after the Greek mythological figure of Medea, which would have been a typical name for seagoing vessels at the time.", "The cove facing the modern village of L'Anse aux Meadows is still named M\u00e9d\u00e9e Bay." ] ], "gold": "Norsemen were the first Europeans to reach the Americas, sighting the coast in 986. By 1000 A.D. there was a short lived Norse settlement on the northernmost tip of the island of Newfoundland in present day Canada.", "prediction 1": "The first European to reach the Americas was Erik the Red, who arrived in the late 10th century. The Norse colonization of North America started in the late 10th century AD when Norsemen explored and settled areas of the North Atlantic including the northeastern fringes of North America. Remains of Norse buildings were found at L'Anse aux Meadows near the northern tip of Newfoundland in 1960. This discovery aided the reignition of archaeological exploration for the Norse in the North Atlantic.", "prediction 2": "The oldest Europeans to arrive in North America were the Vikings, who were part of the Norsemen, and their presence was documented in the late 10th century. According to the Sagas of Icelanders, Norsemen from Iceland first settled Greenland in the 980s. The first European to reach the Americas was Erik the Red, who, having been banished from Iceland for manslaughter, explored the uninhabited southwestern coast of Greenland during the three years of his banishment.", "prediction 3": "The Norse colonization of North America began in the late 10th century AD when Norsemen explored and settled areas of the North Atlantic including the northeastern fringes of North America. The Norse settlements in the North American island of Greenland lasted for almost 500 years, while the only confirmed settlement on the North American mainland, L'Anse aux Meadows, was small and did not last as long.", "prediction 4": "The Norse colonization of North America began in the late 10th century AD when Norsemen explored and settled areas of the North Atlantic including the northeastern fringes of North America. According to the Sagas of Icelanders, Norsemen from Iceland first settled Greenland in the 980s. Erik the Red, having been banished from Iceland for manslaughter, explored the uninhabited southwestern coast of Greenland during the three years of his banishment.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 396, "end": 498 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 96 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " The Norse colonization of North America started in the late 10th century AD when Norsemen explored and settled areas of the North Atlantic including the northeastern fringes of North America. Remains of Norse buildings were found at the northern tip of Newfoundland in Canada." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the last time mount cameroon erupted?", "passages": [ [ "Mount Cameroon", "Mount Cameroon\n\nMount Cameroon is an active volcano in Cameroon near the Gulf of Guinea.", "Mount Cameroon is also known as Cameroon Mountain or Fako (the name of the higher of its two peaks) or by its native name Mongo ma Ndemi (\"Mountain of Greatness\").", "It is the highest point in sub-Saharan western and central Africa, the fourth-most prominent peak in Africa, and the 31st-most prominent in the world.", "The mountain is part of the area of volcanic activity known as the Cameroon Volcanic Line, which also includes Lake Nyos, the site of a disaster in 1986.", "The most recent eruption occurred on February 3, 2012.", "Mount Cameroon is one of Africa's largest volcanoes, rising to above the coast of west Cameroon.", "It rises from the coast through tropical rainforest to a bare summit, which is cold, windy, and occasionally dusted with snow.", "The massive steep-sided volcano of dominantly basaltic-to-trachybasaltic composition forms a volcanic horst constructed above a basement of Precambrian metamorphic rocks covered with Cretaceous to Quaternary sediments.", "More than 100 small cinder cones, often fissure-controlled parallel to the long axis of the massive volcano, occur on the flanks and surrounding lowlands." ] ], "gold": "Mount Cameroon is an active volcano in the South West region of Cameroon next to the city of Buea near the Gulf of Guinea. It is the highest point in sub-Saharan western and central Africa, the fourth-most prominent peak in Africa, and the 31st-most prominent in the world. The mountain is part of the area of volcanic activity known as the Cameroon Volcanic Line, which also includes Lake Nyos, the site of a disaster in 1986. The most recent eruption occurred on February 3, 2012. ", "prediction 1": "Mount Cameroon is an active volcano in Cameroon near the Gulf of Guinea, Africa. The most recent eruption occurred on February 3, 2012.", "prediction 2": "Mount Cameroon is an active volcano in Cameroon near the Gulf of Guinea. The most recent eruption occurred on February 3, 2012, the last time it erupted was on March 6, 2012.", "prediction 3": "Mount Cameroon is an active volcano in Cameroon near the Gulf of Guinea. The last time Mount Cameroon erupted was on February 3, 2012.", "prediction 4": "Mount Cameroon is an active volcano in Cameroon near the Gulf of Guinea, which is also known as Cameroon Mountain or Fako, which is the name of the higher of its two peaks, or by its native name Mongo ma Ndemi (\"Mountain of Greatness\"). The last time Mount Cameroon erupted was on February 3, 2012.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Mount Cameroon is an active volcano in Cameroon near the Gulf of Guinea, Africa. It is the highest point in sub-Saharan western and central Africa, the fourth-most prominent peak in Africa, and the 31st-most prominent in the world. The mountain is part of the area of volcanic activity known as the Cameroon Volcanic Line, which also includes Lake Nyos, the site of a disaster in 1986. The most recent eruption occurred on February 3, 2012." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "How many scoville units in a jalapeno pepper?", "passages": [ [ "Scoville scale", "Scoville scale\n\nThe Scoville scale is a measurement of the pungency (spiciness or \"heat\") of chili peppers and other spicy foods, as recorded in Scoville Heat Units (SHU) based on the concentration of capsaicinoids, among which capsaicin is the predominant component.", "The scale is named after its creator, American pharmacist Wilbur Scoville, whose 1912 method is known as the Scoville organoleptic test.", "In the 21st century, high-performance liquid chromatography (HPLC) is used to quantify the capsaicinoid content as an indicator of pungency.", "The most expedient method for estimating SHU is a subjective assessment derived from the capsaicinoid sensitivity by people experienced with eating hot chilis.", "In the Scoville organoleptic test, an exact weight of dried pepper is dissolved in alcohol to extract the heat components (capsaicinoids), then diluted in a solution of sugar water.", "Decreasing concentrations of the extracted capsaicinoids are given to a panel of five trained tasters, until a majority (at least three) can no longer detect the heat in a dilution.", "The heat level is based on this dilution, rated in multiples of 100 SHU." ], [ "Jalape\u00f1o", "A raw jalape\u00f1o is 92% water, 6% carbohydrates, 1% protein, and contains negligible fat (table).", "In a 100 gram reference serving, raw jalape\u00f1os provide 29 calories, and are a rich source (20% or more of the Daily Value, DV) of vitamin C, vitamin B6, and vitamin E, with vitamin K in a moderate amount (table).", "Other micronutrients are low in content (table).", "Compared to other chillies, the jalape\u00f1o heat level varies from mild to hot depending on cultivation and preparation and can have from a few thousand to over 10,000 Scoville heat units.", "The number of scars on the pepper, which appear as small brown lines, called 'corking', has a positive correlation with heat level, as growing conditions which increase heat level also cause the pepper to form scars.", "For US consumer markets, 'corking' is considered unattractive; however, in other markets, it is a favored trait, particularly in pickled or oil preserved jalape\u00f1os." ], [ "Hungarian wax pepper", "Hungarian wax pepper\n\nThe Hungarian wax pepper is a medium variety of \"Capsicum annuum\" with a wide Scoville Scale range of 1,000 to 15,000 Scoville units.", "This pepper is usually harvested before maturity when still yellow.", "It measures between 4\"-6\" inches in length (10-15cm) which tapers to a rounded point.", "Upon maturity, the pepper becomes orange then red in color.", "Although similar in appearance to banana peppers when immature, it is a different cultivar.", "Due to the ease of cultivation and the productivity of the plant, many home gardeners pickle these whole or sliced in rings." ] ], "gold": "The Scoville scale measures the pungency, meaning spiciness or heat, of chili peppers, based on the concentration of capsaicinoids and recorded in Scoville Heat Units. On this scale, a jalapeno pepper has a minimum of 1,000 units, but it can go up to a maximum of 10,000.", "prediction 1": "There are different types of jalapeno pepper, each with a different number of Scoville units, or heat. The Hungarian wax pepper, for example, is a medium variety of Capsicum annuum with a wide Scoville Scale range of 1,000 to 15,000 Scoville units. The Scoville scale is a measurement of the pungency or \"heat\" of chili peppers and other spicy foods, as recorded in Scoville Heat Units (SHU) based on the concentration of capsaicinoids, among which capsaicin is the predominant component.", "prediction 2": "There are around 1,600 to 2,000 Scoville units in a jalapeno pepper. The Hungarian wax pepper is a medium variety of Capsicum annuum with a wide Scoville Scale range of 1,000 to 15,000 Scoville units.", "prediction 3": "The Scoville scale is a measurement of the pungency or spiciness of chili peppers and other spicy foods, as recorded in Scoville Heat Units (SHU) based on the concentration of capsaicinoids, among which capsaicin is the predominant component. A jalapeo pepper with 1,000 Scoville units is considered a mild pepper while a medium pepper, the Hungarian wax pepper, has 1,000 to 15,000 Scoville units.", "prediction 4": "The Scoville scale is a measurement of the pungency (spiciness or \"heat\") of chili peppers and other spicy foods, as recorded in Scoville Heat Units (SHU) based on the concentration of capsaicinoids, among which capsaicin is the predominant component. There are various varieties of jalapenos, but the average one is 1,000 Scoville units. The Hungarian wax pepper is a medium variety of \"Capsicum annuum\" with a wide Scoville Scale range of 1,000 to 15,000 Scoville Units. Scoville scale is named after its creator, American pharmacist Wilbur Scoville, whose 1912 method is known as the Scoville organoleptic test.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 392, "end": 488 }, { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 248 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 102 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Scoville scale is a measurement of the pungency or \"heat\" of chili peppers and other spicy foods, as recorded in Scoville Heat Units (SHU). The jalape\u00f1o heat level varies from mild to hot depending on cultivation and preparation and can have from a few thousand to over 10,000 Scoville heat units." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who voices the squip in be more chill?", "passages": [ [ "Be More Chill (musical)", "Be More Chill (musical)\n\nBe More Chill is a musical with music and lyrics by Joe Iconis and book by Joe Tracz, based on the 2004 novel of the same name by Ned Vizzini.", "After a 2015 regional theatre production, the musical premiered Off-Broadway in 2018.", "A Broadway production is scheduled for 2019 and a film adaptation is currently in development.", "The musical premiered in May 30, 2015 at the Two River Theater in Red Bank, New Jersey.", "The production featured Will Connolly as Jeremy, Eric William Morris as the Squip, George Salazar as Michael, and Stephanie Hsu as Christine, as well as Katie Ladner, Lauren Marcus, Jake Boyd, Gerard Canonico, Katlyn Carlson, and Paul Whitty.", "The musical was commissioned by Two River Theater as part of their new play development program.", "\"Be More Chill\" received an Off-Broadway production at the Irene Diamond Stage at the Pershing Square Signature Center.", "It began previews July 26, 2018 and ended production on September 30, 2018.", "This production featured several original cast members including Hsu, Salazar, Canonico, Carlson and Marcus reprising their respective roles.", "New cast members included Will Roland as Jeremy, Jason Tam as the Squip, Britton Smith as Jake, Tiffany Mann as Jenna, and Jason \"Sweettooth\" Williams as Mr. Heere." ], [ "Be More Chill (musical)", "As more popular cast members trickle in, their drama teacher, Mr. Reyes, reveals, much to Christine's horror, that their school play will be A Midsummer Night's Dream set in a post-apocalyptic future, re-titled \"A Midsummer Nightmare (With Zombies)\".", "During rehearsal, Jake, one of the popular boys and Rich's friend, flirts with Christine, making Jeremy jealous.", "(\"More Than Survive (Reprise 1)\").", "After rehearsal, Jeremy is confronted in the bathroom by Rich.", "He tells him about how he managed his rise to popularity - as a very unpopular freshman, he took a pill called a \"super quantum unit intel processor\" - a \"SQUIP\" - containing a computer that implants itself inside the user's brain and tells them what to do and say.", "He suggests Jeremy buy one from him in order to become cooler.", "(\"The Squip Song\").", "While playing video games with Michael after school, Jeremy tells him about Rich's offer.", "Michael is convinced that Jeremy is being scammed, but after an awkward conversation with Jeremy's dad (still not wearing pants), Jeremy decides to check it out.", "He assures Michael that no matter what happens they'll always be a team.", "(\"Two Player Game\")." ] ], "gold": "In the show Be More Chill, the SQUIP is a pill called a Super Quantum Unit Intel Processor containing a computer that implants itself inside the user's brain and tells the user what to do and say. During the 2015 world premier and the 2016 workshop cast of Be More Chill, Eric William Morris played the role of the SQUIP. In the 2018 Off Broadway and 2019 Broadway productions of Be More Chill, Jason Tam plays the role of the SQUIP. In the 2020 Off-West End Production of Be More Chill, Stewart Clarke plays the role of the SQUIP.", "prediction 1": "The Squip in Be More Chill is voiced by Eric William Morris, who first appeared in a 2015 regional theatre production, before being introduced by Jason Tam.", "prediction 2": "Be More Chill is a musical with music and lyrics by Joe Iconis and book by Joe Tracz, based on the 2004 novel of the same name by Ned Vizzini. The musical premiered in May 30, 2015 at the Two River Theater in Red Bank, New Jersey. Eric William Morris voices the Squip in the musical. Jason Tam voices the Squip in the musical.", "prediction 3": "The musical Be More Chill was adapted from the 2004 novel of the same name by Ned Vizzini. The Squip is portrayed by Eric William Morris. This production also featured Will Connolly as the Squip, Jason Tam as the Squip, and Britton Smith as Jake.", "prediction 4": "The Squip is a fictional character in the musical, Be More Chill. The Squip was voiced by Eric William Morris in the 2015 production. Jason Tam played the Squip in the 2018 Off-Broadway production.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 119, "end": 156 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "In the show Be More Chill, the SQUIP is a pill called a Super Quantum Unit Intel Processor containing a computer that implants itself inside the user's brain and tells the user what to do and say. The Squip in Be More Chill is voiced by Eric William Morris, who first appeared in a 2015 regional theatre production. In the 2018 Off Broadway and 2019 Broadway productions of Be More Chill, Jason Tam plays the role of the SQUIP." }, "preference": [ 2, 1, 0, 1, 1, 0 ] }, { "question": "Who sings i wanna be like you jungle book 2016?", "passages": [ [ "I Wan'na Be like You (The Monkey Song)", "I Wan'na Be like You (The Monkey Song)\n\n\"I Wan'na Be like You\" is a song from Walt Disney's 1967 film \"The Jungle Book\".", "The song was written by songwriters Robert and Richard Sherman and was performed by Louis Prima.", "Richard Sherman said he and his brother aimed for a jazz sound, with a Dixieland-like melody.", "He added that \"When we first got an idea for 'I Wan'na Be Like You,' we said an ape swings from a tree, and he's the king of apes.", "We'll make him 'the king of the swingers.'", "That's the idea, we'll make him a jazz man.\"", "Once Prima was invited to do the song, he mockingly responded to the Shermans with \"You want to make a monkey out of me?", "You got me!\"", "The instrumentals were originally recorded by Prima\u2014who also played the trumpet\u2014and his band, Sam Butera & The Witnesses, but the music was replaced by one written by the film's composer, George Bruns, and orchestrated by Walter Sheets.", "The \"scat dialogue\" between Baloo and King Louie was the result of two recording sessions." ], [ "King Louie", "King Louie\n\nKing Louie is a fictional character introduced in Walt Disney's 1967 animated musical film, \"The Jungle Book\".", "Unlike the majority of the adapted characters in the film, Louie was not featured in Rudyard Kipling's original works.", "King Louie was portrayed as an orangutan who was the leader of the other jungle primates, and who attempted to gain knowledge of fire from Mowgli, in order to become more human.", "King Louie was voiced by Louis Prima in the original 1967 film.", "Initially, the filmmakers considered Louis Armstrong for the role, but to avoid the likely controversy that would result from casting a black person to voice an ape, they instead chose Prima, a white singer.", "Christopher Walken voiced King Louie in the 2016 live-action/CGI \"The Jungle Book\" film.", "Although the Disney adaptation is based on the Kipling stories, the character King Louie does not appear in Rudyard Kipling's original book, as orangutans, the species as which he is portrayed, are not native to India in real life.", "It is also stated by Kipling in the original that the Bandar-log, or monkeys over which King Louie rules, have no effective leadership, let alone a king." ] ], "gold": "\"I Wanna Be Like You\" is a song from Walt Disney's 1967 film The Jungle Book. In the 2016 live-action adaptation, Christopher Walken, sings the song as King Louie. King Louie was portrayed as an Orangutan who was the leader of the other jungle primates, and who attempted to gain knowledge of fire from Mowgli, in order to become more human.", "prediction 1": "\"I Wan'na Be like You\" is a song from Walt Disney's 1967 film \"The Jungle Book\". The song was written by songwriters Robert and Richard Sherman and was performed by Louis Prima. Christopher Walken voiced King Louie in the 2016 live-action/CGI \"The Jungle Book\" film.", "prediction 2": "\"I Wan'na Be like You\" is a song from Walt Disney's 1967 film The Jungle Book. The song was written by songwriters Robert and Richard Sherman and was performed by Louis Prima. The musicals were originally recorded by Prima\u2014who also played the trumpet\u2014and his band, Sam Butera & The Witnesses, but the music was replaced by one written by the film's composer, George Bruns, and orchestrated by Walter Sheets. Christopher Walken voiced King Louie in the 2016 live-action/CGI film.", "prediction 3": "\"I Wan'na Be like You\" is a song from Walt Disney's 1967 animated musical film, The Jungle Book. The song was written by songwriters Robert and Richard Sherman and was performed by Louis Prima. Christopher Walken voiced King Louie in the 2016 live-action/CGI \"The Jungle Book\" film.", "prediction 4": "\"I Wan'na Be like You\" is a song from Walt Disney's 1967 film The Jungle Book. The song was written by songwriters Robert and Richard Sherman and was performed by Louis Prima. Christopher Walken voiced King Louie in the 2016 live-action/CGI \"The Jungle Book\" film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 177 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"I Wan'na Be like You\" is a song from Walt Disney's 1967 film \"The Jungle Book\". Christopher Walken voiced King Louie in the 2016 live-action/CGI \"The Jungle Book\" film. King Louie was portrayed as an orangutan who was the leader of the other jungle primates, and who attempted to gain knowledge of fire from Mowgli, in order to become more human." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did red hot chili peppers get famous?", "passages": [ [ "Red Hot Chili Peppers", "\"Give It Away\" was released as the first single; it eventually became one of the band's biggest and most well known songs, winning a Grammy Award in 1992 for \"Best Hard Rock Performance With Vocal\" and became the band's first number one single on the Modern Rock chart The ballad \"Under the Bridge\" was released as a second single, and went on to reach No. 2 on the \"Billboard\" Hot 100 chart, the highest the band has reached on that chart as of 2016, and became one of the band's most recognizable songs.", "Other singles such as \"Breaking the Girl\" and \"Suck My Kiss\" also charted well.", "The album sold over 12 million copies.", "\"Blood Sugar Sex Magik\" was listed at number 310 on the Rolling Stone magazine list of The 500 Greatest Albums of All Time, and in 1992 it rose to No. 3 on the U.S. album charts, almost a year after its release.", "The band kicked off their Blood Sugar Sex Magik tour which featured Nirvana, Pearl Jam and Smashing Pumpkins, three of that era's biggest up and coming bands in alternative music, as opening acts.", "The unexpected success instantly turned Red Hot Chili Peppers into rock stars.", "Frusciante was blindsided by his newfound fame, and struggled to cope with it." ], [ "Red Hot Chili Peppers", "Navarro was fired from the band in 1998.", "Frusciante, fresh out of drug rehabilitation, rejoined the band that same year at Flea's request.", "The reunited quartet returned to the studio to record \"Californication\" (1999), which became the band's biggest commercial success with 16 million copies sold worldwide.", "That album was followed three years later by \"By the Way\" (2002), and then four years later by the double album \"Stadium Arcadium\" (2006), their first number-one album in America.", "After a world tour, the group went on an extended hiatus.", "Frusciante announced he was amicably leaving the band in 2009 to focus on his solo career.", "Klinghoffer, who had worked both as a sideman for the band on their Stadium Arcadium tour and on Frusciante's solo projects, replaced him.", "The band's tenth studio album, \"I'm with You\", was released in 2011 and topped the charts in 18 different countries.", "The band released their eleventh studio album, \"The Getaway\", in 2016.", "The album was produced by Danger Mouse, marking the first time since \"Mother's Milk\" that the Red Hot Chili Peppers had not worked with Rubin, and topped the charts in ten different countries." ], [ "Red Hot Chili Peppers", "\"Mother's Milk\" was certified gold by the Recording Industry Association of America in late March 1990\u2014it is now certified platinum\u2014and was the first Chili Peppers album to ship over 500,000 units.", "In 1990, after the success of \"Mother's Milk\", the group decided they had had enough of EMI and entered a major label bidding war ultimately signing with Warner Bros. Records and hired Rick Rubin to produce their then-untitled fifth album.", "Rubin would go on to produce five of the band's subsequent studio albums, but originally turned the band down in 1987 due to the drug problems in the band at the time.", "This time, in 1990, Rubin felt the band was in a better place and much more focused.", "The writing process for this album was far more productive than it had been for \"Mother's Milk\", with Kiedis stating, \"[every day], there was new music for me to lyricize\".", "The band spent six months recording a new album, with long periods of rehearsal, songwriting, and incubating ideas.", "However, Rubin was dissatisfied with a regular recording studio, thinking the band would work better in a less orthodox setting, believing it would enhance their creative output.", "Rubin suggested the mansion magician Harry Houdini once lived in, to which they agreed." ] ], "gold": "The Red Hot Chili Peppers are an American band whose music incorporates alternative rock, funk, punk rock, and psychedelic rock elements. They are one of the most successful alternative rock bands, and their fame and recognition grew throughout various breakthroughs the band had. They first achieved a certified gold album when \"Mother's Milk\" reached over 500,000 united shipped in late March 1990. In September 1991, the band would also release the highly successful album \"Blood Sugar Sex Magik,\" achieving the number one single on the Modern Rock chart in late 1991 and reaching number 2 on the Billboard Hot 100 chart in March 1992.", "prediction 1": "Red Hot Chili Peppers got famous after their song \"Give It Away\" was released as the first single from their 1993 album Mother's Milk. The band also released several other singles that went on to become one of the band's biggest and most well known songs, winning a Grammy Award in 1992 for \"Best Hard Rock Performance With Vocal\".", "prediction 2": "Red Hot Chili Peppers got famous after their first single, Give It Away, was released in 1990. After their second single, Under the Bridge, they became one of the band's biggest and most well known songs, winning a Grammy Award in 1992 for Best Hard Rock Performance With Vocal. In addition, their third single, Californication, was released in 1999, which became the band's biggest commercial success with 16 million copies sold worldwide.", "prediction 3": "Red Hot Chili Peppers became famous in 1989, when their song \"Give It Away\" was released as the first single. The band's album \"Californication\" was released in 1999, with its biggest commercial success having sold 16 million copies worldwide. Their album \"Californication\" was produced by Rick Rubin and topped the charts in 18 different countries. In 2016, the band released their eleventh studio album, \"The Getaway\".", "prediction 4": "The Red Hot Chili Peppers became famous in 1990 with their first single, \"Give It Away\". The band went on to have a number of hit albums and went on to sell 12 million copies worldwide. In 1991, the band released their first album, \"Californication\", which became the band's biggest commercial success with 16 million copies sold worldwide. In 1992, the band's second album, \"Under the Bridge,\" became one of the band's biggest and most well known songs, winning a Grammy Award in 1992 for \"Best Hard Rock Performance With Vocal\". In 1993, \"Californication\" was released as the band's first number one single, while \"Californication\", which became the band's first number one single.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 33, "end": 134 }, { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 331 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Red Hot Chili Peppers got famous after their album Mother's Milk was certified gold by the Recording Industry Association of America in late March 1990. \"Blood Sugar Sex Magik\" was listed at No. 3 on the U.S. album charts, in 1992." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who is the current leader of opposition in uganda?", "passages": [ [ "Leader of Opposition (Uganda)", "Leader of Opposition (Uganda)\n\nThe Leader of Opposition (LOP) in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government.", "The Leader of Opposition appoints and heads an alternative Shadow Cabinet whose duty is to challenge and influence government legislation on the floor of Parliament", "The current Leader of Opposition and first Ugandan female to hold the position is Hon.", "Winnie Kiiza of the Forum for Democratic Change.", "The Opposition in Uganda is made up of members from Forum for Democratic Change, Democratic Party, Uganda People's Congress, Congress Party and JEEMA.", "After Uganda had been colonised in 1894 as a British Protectorate, the British rulers introduced the Legislative Council (Legco) in 1921, whose overall mission was to enact appropriate laws for the Protectorate.", "However it was not until 1945 that the first 3 indigenous Ugandans were allowed to sit in the Legco.", "When the struggle for independence intensified in the early 1950s, an opposition side in the Legco began to emerge.", "The year 1958 saw two important milestones emerge in Uganda's political history.", "That is when the first direct elections to the Legco were held and the position of \"Leader of Opposition\" formally created in the same institution.", "The first Leader of Opposition was Barbara Saben, a Briton who doubled as Mayor of Kampala Municipality at the time." ], [ "Betty Aol Ochan", "Betty Aol Ochan\n\nBetty Aol Ochan (n\u00e9e Betty Aol), also Betty Aol Ocan, is a Ugandan educator and politician, who has served as the Leader of Opposition in Uganda's Parliament since 3 August 2018.", "She was appointed to that position by Patrick Amuriat, the president of Forum for Democratic Change (FDC), the largest opposition party in the 10th Parliament (2016\u20132021).", "She also concurrently serves as the incumbent elected member of parliament representing Gulu Municipality in Uganda's 10th Parliament.", "Ochan was born on 28 November 1958.", "She attended Makerere University, Uganda's largest an oldest public university, graduating with a Diploma in Education in 1981.", "In 2006, she was awarded a Bachelor of Development Studies degree by Gulu University.", "Her Master of Development Studies degree was obtained from Uganda Martyrs University.", "She also holds a number of certificates in rural development, leadership and social work, from local and international institutions.", "Prior to joining politics, Ochan was a secondary school teacher from 1981 to 1990.", "Half of that time, until 1985, was spent at Layibi College, while the remainder of her teaching career was spent at Amere Secondary School." ], [ "Wafula Oguttu", "Wafula Oguttu\n\nPhillip Wafula Oguttu (born 21 December 1952) is a Ugandan journalist and politician.", "He is a former Leader of Opposition in the Ugandan Parliament.", "He was appointed to that position on 31 January 2014, replacing Nandala Mafabi, and held it until June 2016 when he handed over the position to Winnie Kiiza.", "Oguttu was formerly the Member of Parliament (MP) for Bukhooli County Central, a constituency in Bugiri District, Busoga Sub-region, Eastern Region of Uganda, a role he held from 2011 until 2016.", "He is a member of Uganda's opposition party Forum for Democratic Change (FDC) for which he is the spokesperson.", "Oguttu is also one of the co-founders of the \"Daily Monitor\", a privately owned English-language daily newspaper in Uganda.", "Oguttu was born in Buhehe sub-county, Butaleja District, to Wafula Olago, a veteran of World War II, and Lucia Aguttu.", "At the time of Oguttu\u2019s birth, his father was working for a borehole-drilling company in Butaleja.", "A Samia by tribe, Wafula was raised in Mbajja Village, Lumino Sub-county, in present-day Busia District." ] ], "gold": "In Uganda, the Leader of the Opposition (LOP) is the leader of the largest political party in the Parliament of Uganda that is not in government. The current Leader of Opposition is Betty Aol Ochan of the Forum for Democratic Change who was appointed on 3 August 2018. She succeeded Winnie Kiiza who held the position from May 2016 until August 2018. Ms Kiiza succeeded Philip Wafula Oguttu who held the position from January 2014 until June 2016. Mr. Oguttu succeeded Nathan Nandala Mafabi who held the position from May 2011 until January 2014.", "prediction 1": "The Leader of Opposition in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government. The current Leader of Opposition and first Ugandan female to hold the position is Hon. Winnie Kiiza of the Forum for Democratic Change.", "prediction 2": "The Leader of Opposition in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government. The current Leader of Opposition and first Ugandan female to hold the position is Hon. Winnie Kiiza of the Forum for Democratic Change. The former Leader of Opposition Phillip Wafula Oguttu was appointed to that position on 31 January 2014, replacing Nandala Mafabi, and held it until June 2016 when he handed over the position to Winnie Kiiza.", "prediction 3": "The Leader of Opposition in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government. The current Leader of Opposition and first Ugandan female to hold the position is Hon. Winnie Kiiza of the Forum for Democratic Change. The current Leader of Opposition and first Ugandan female to hold the position is Betty Aol Ochan.", "prediction 4": "The Leader of Opposition in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government. The current Leader of Opposition and first Ugandan female to hold the position is Hon. Winnie Kiiza of the Forum for Democratic Change. Phillip Wafula Oguttu is a Ugandan journalist and politician. He was appointed to that position on 31 January 2014, replacing Nandala Mafabi, and held it until June 2016 when he handed over the position to Winnie Kiiza.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 146, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 227 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Leader of Opposition in Uganda is the title bestowed upon the elected leader of the largest political party not within the ruling government. Nandala Mafabi was replaced by Wafula Oguttu on 31 January 2014, who was replaced by Hon Winnie Kiiza of the Forum for Democratic Change in June 2016. Betty Aol Ocan has served as the Leader of Opposition in Uganda's Parliament since 3 August 2018." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Where is the super bowl halftime show held?", "passages": [ [ "Super Bowl LI halftime show", "Super Bowl LI halftime show\n\nThe Super Bowl LI Halftime show took place on February 5, 2017, at NRG Stadium in Houston, Texas, as part of Super Bowl LI.", "Lady Gaga headlined the show performing a medley of her songs, including material from her then-most recent studio album, \"Joanne\".", "The National Football League (NFL) confirmed the singer would helm the LI halftime show after discussions with the singer Adele proved unproductive.", "Gaga began rehearsing the show by January 2017 and had no guest performers.", "Her sister gave her the idea of performing from atop the NRG Stadium; Gaga worked on the logistics behind it.", "She promoted the performance by uploading short clips on her social media accounts.", "Fashion house Versace created the wardrobe for the show with a custom jumpsuit for the singer.", "Designers Bruce Rodgers and LeRoy Bennett did the show's production work with lighting designer Bob Barnhart of 22 Degrees.", "The stage was created by All Access Staging & Productions, which had also created previous Super Bowl halftime stages.", "During the introduction scene, Gaga was accompanied by a fleet of 300 drones provided by Intel, which formed an image of the American flag behind the singer.", "It marked the first time the drones had been used as part of a television broadcast.", "The halftime show was critically acclaimed, with media outlets praising Gaga for demonstrating artistic and musical qualities." ], [ "Super Bowl 50", "Super Bowl 50\n\nSuper Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season.", "The American Football Conference (AFC) champions Denver Broncos defeated the National Football Conference (NFC) champions Carolina Panthers, 24\u201310.", "The game was played on February 7, 2016, at Levi's Stadium in Santa Clara, California (located in the San Francisco Bay Area).", "As this was the 50th Super Bowl game, the league emphasized the \"golden anniversary\" with various gold-themed initiatives during the 2015 season, as well as suspending the tradition of naming each Super Bowl game with Roman numerals (under which the game would have been known as \"Super Bowl L\"), so the logo could prominently feature the Arabic numerals 50.", "The Panthers finished the regular season with a 15\u20131 record, racking up the league's top offense, and quarterback Cam Newton was named the NFL Most Valuable Player (MVP).", "They defeated the Arizona Cardinals 49\u201315 in the NFC Championship Game and advanced to their second Super Bowl appearance since the franchise began playing in 1995.", "The Broncos finished the regular season with a 12\u20134 record, bolstered by having the league's top defense." ], [ "Super Bowl 50", "On December 3, the league confirmed that the show would be headlined by the British rock band Coldplay.", "On January 7, 2016, Pepsi confirmed to the Associated Press that Beyonc\u00e9, who headlined the Super Bowl XLVII halftime show and collaborated with Coldplay on the single \"Hymn for the Weekend\" (which was removed from the setlist before the game), would be making an appearance.", "Bruno Mars, who headlined the Super Bowl XLVIII halftime show, and Mark Ronson (Mars's collaborator on \"Uptown Funk\") also performed.", "Denver took the opening kickoff of Super Bowl 50 and started out strong.", "Quarterback Peyton Manning completed an 18-yard pass to tight end Owen Daniels and a 22-yard throw to wide receiver Andre Caldwell.", "A pair of carries by running back C. J. Anderson moved the ball up 20 yards to the Panthers 14-yard line, but Carolina's defense dug in over the next three plays.", "First, linebacker Shaq Thompson tackled running back Ronnie Hillman for a 3-yard loss.", "Then after an incompletion, linebacker Thomas Davis tackled Anderson for a 1-yard gain on third down, forcing Denver to settle for a 3\u20130 lead on a Brandon McManus 34-yard field goal.", "The score marked the first time in the entire postseason that Carolina was facing a deficit." ] ], "gold": " The Super Bowl LI Halftime show took place on February 5, 2017 at NRG Stadium, Houston, TX as part of Super Bowl LI. Lady Gaga headlined the show. Super Bowl 50\u00a0took place February 7, 2016 at Levi's Stadium, Santa Clara, CA with Coldplay headlining the halftime show. The halftime show for Super Bowl XLIX\u00a0 in 2015 was in University of Phoenix Stadium, Glendale, AZ with Katy Perry headlining.", "prediction 1": "Super Bowl halftime show was held in 2017, on February 5, 2017 in Houston, Texas, at NRG Stadium. Super Bowl 50 was an American football game to determine the champion of the National Football League for the 2015 season. The halftime show was held on February 7, 2016 at Levi's Stadium in Santa Clara, California (located in the San Francisco Bay Area).", "prediction 2": "The Super Bowl halftime show is held on February 5, 2017 at NRG Stadium in Houston, Texas, as part of Super Bowl LI. Lady Gaga headlined the show performing a medley of her songs, including material from her then-most recent studio album, Joanne.", "prediction 3": "The Super Bowl halftime show is held on February 5, 2017 at NRG Stadium in Houston, Texas. Super Bowl LI was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The Super Bowl 50 was an American football game to determine the champion of the National Football Conference (NFC) champions Carolina Panthers. The halftime show for Super Bowl LI took place on February 5, 2017, at Levi's Stadium in Santa Clara, California.", "prediction 4": "Super Bowl halftime show is hosted by Lady Gaga at the NRG Stadium in Houston, Texas. The Super Bowl LI Halftime show took place on February 5, 2017, at NRG Stadium in Houston, Texas, as part of Super Bowl LI. The Super Bowl 50 halftime show was an American football game to determine the champion of the National Football League for the 2015 season. The halftime show was hosted by British rock band Coldplay.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 220 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 353 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Super Bowl halftime show was held in 2017, on February 5, 2017 in Houston, Texas, at NRG Stadium. Lady Gaga headlined the show. In Super Bowl 50, the halftime show was held on February 7, 2016 at Levi's Stadium in Santa Clara, California with the British rock band Coldplay headlining the show. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What does ap class mean in high school?", "passages": [ [ "Advanced Placement", "For example, the state of Florida reimburses schools districts for the exam costs of students enrolled in Advanced Placement courses.", "The Los Angeles Unified School District, the Montebello Unified School District, the Hawaii Department of Education, New York City Department of Education, and the state of Indiana subsidize all AP Examination fees in subjects of math and science, and the Edmonds School District in suburban Seattle currently subsidizes Advanced Placement fees of students who enroll in the free school lunch program.", "In addition, some school districts offer free tests to all students enrolled in any Advanced Placement class.", "There are currently 38 courses and exams available through the AP Program.", "A complete list of courses can be found below:\n\n\n\nBelow are statistics from the 2014 year of exams showing the number of participants, the percentage who obtained a score of three (3) or higher, and the average score.", "(Students generally need a score of three (3) or higher to receive credit or benefit).", "One issue to consider is the fact that not all AP students take their course's test.", "The College Board estimates that about 2/3 of students enrolled in an AP course take the course's AP test.", "On the other hand, a study of University of California system students found that only about 55% to 60% of AP students took their course's exam.", "However, \"It has recently become clear . . ." ], [ "Advanced Placement", "Advanced Placement\n\nAdvanced Placement (AP) is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students.", "American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations.", "The AP curriculum for each of the various subjects is created for the College Board by a panel of experts and college-level educators in that field of study.", "For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satisfies the AP curriculum.", "If the course is approved, the school may use the AP designation and the course will be publicly listed on the AP Course Ledger.", "After the end of World War II, the Ford Foundation created a fund that supported committees studying education.", "The program, which was then referred to as the \"Kenyon Plan\", was founded and pioneered at Kenyon College in Gambier, Ohio, by the then-college president Gordon Chalmers.", "The first study was conducted by three prep schools\u2014the Lawrenceville School, Phillips Academy and Phillips Exeter Academy\u2014and three universities\u2014Harvard University, Princeton University and Yale University." ] ], "gold": "Advanced Placement (AP) is a program in the United States created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations. The AP curriculum for each of the various subjects is created for the College Board by a panel of experts and college-level educators in that field of study. For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satisfies the AP curriculum as specified in the Board's Course and Examination Description (CED). If the course is approved, the school may use the AP designation and the course will be publicly listed on the AP Course Ledger.", "prediction 1": "Advanced Placement class is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations. For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satisfies the AP curriculum. If the course is approved, the school may use the AP designation and the course will be publicly listed on the AP Course Ledger.", "prediction 2": "Advanced Placement (AP) is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations. For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satisfies the AP curriculum. If the course is approved, the school may use the AP designation and the course will be publicly listed on the AP Course Ledger.", "prediction 3": "Advanced Placement (AP) is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations. The AP curriculum for each of the various subjects is created for the College Board by a panel of experts and college-level educators in that field of study. For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satis the AP curriculum.", "prediction 4": "Advanced Placement (AP) is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Advanced Placement class is a program in the United States and Canada created by the College Board which offers college-level curricula and examinations to high school students. American colleges and universities may grant placement and course credit to students who obtain high scores on the examinations. The AP curriculum for each of the various subjects is created for the College Board by a panel of experts and college-level educators in that field of study. For a high school course to have the designation, the course must be audited by the College Board to ascertain that it satisfies the AP curriculum. If the course is approved, the school may use the AP designation and the course will be publicly listed on the AP Course Ledger." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who said if you find yourself in a hole stop digging?", "passages": [ [ "Law of holes", "Law of holes\n\nThe first law of holes, or the law of holes, is an adage which states that \"if you find yourself in a hole, stop digging\".", "Digging a hole makes it deeper and therefore harder to get back out, which is used as a metaphor that when in an untenable position, it is best to stop carrying on and exacerbating the situation.", "The adage has been attributed to a number of sources.", "It appeared in print on page six of \"The Washington Post\" dated October 25, 1911, in the form: \"Nor would a wise man, seeing that he was in a hole, go to work and blindly dig it deeper...\"", "In \"The Bankers magazine\", it was published in 1964 as: \"Let me tell you about the law of holes: If you find yourself in a hole, stop digging.\"", "In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later.", "It has been quoted by American humorist Will Rogers." ], [ "Will Rogers", "Will Rogers\n\nWilliam Penn Adair Rogers (November 4, 1879\u00a0\u2013 August 15, 1935) was an American stage and motion picture actor, vaudeville performer, American cowboy, humorist, newspaper columnist, and social commentator from Oklahoma.", "He was a Cherokee citizen born in the Cherokee Nation, Indian Territory.", "Known as \"Oklahoma's Favorite Son\", Rogers was born to a Cherokee family in Indian Territory (now part of Oklahoma).", "As an entertainer and humorist, he traveled around the world three times, made 71 films (50 silent films and 21 \"talkies\"), and wrote more than 4,000 nationally syndicated newspaper columns.", "By the mid-1930s Rogers was hugely popular in the United States, its leading political wit and the highest paid of Hollywood film stars.", "He died in 1935 with aviator Wiley Post when their small airplane crashed in northern Alaska.", "Rogers's vaudeville rope act led to success in the Ziegfeld Follies, which in turn led to the first of his many movie contracts.", "His 1920s syndicated newspaper column and his radio appearances increased his visibility and popularity.", "Rogers crusaded for aviation expansion and provided Americans with first-hand accounts of his world travels." ] ], "gold": "The first law of holes, or the law of holes, is an adage which states: \"if you find yourself in a hole, stop digging\". The adage has be attributed to a number of sources. On October 25, 1911 it appeared in print on page six of The Washington Post. In 1964, a version of the adage appeared in The Bankers Magazine. In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later. It has been misattributed to American stage and film actor, vaudeville performer, cowboy, humorist, newspaper columnist, and social commentator, Will Rogers.", "prediction 1": "The first law of holes, or the law of holes, is an adage which states that \"if you find yourself in a hole, stop digging\". Digging a hole makes it deeper and therefore harder to get back out, which is used as a metaphor that when in an untenable position, it is best to stop carrying on and exacerbating the situation. The adage has been attributed to a number of sources. In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later. In the United States, it has been quoted by American humorist Will Rogers.", "prediction 2": "The first law of holes, or the law of holes, is an adage which states that \"if you find yourself in a hole, stop digging\". Digging a hole makes it deeper and therefore harder to get back out, which is used as a metaphor that when in an untenable position, it is best to stop carrying on and exacerbating the situation. In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later. It has been quoted by the American humorist Will Rogers.", "prediction 3": "The first law of holes, or the law of holes, is an adage that states that \"if you find yourself in a hole, stop digging.\" Digging a hole makes it deeper and therefore harder to get back out, which is used as a metaphor that when in an untenable position, it is best to stop carrying on and exacerbating the situation. In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later. It has been quoted by American humorist Will Rogers.", "prediction 4": "The first law of holes, or the law of holes, is an adage that states that \"if you find yourself in a hole, stop digging\". Digging a hole makes it deeper and therefore harder to get back out, which is used as a metaphor that when in an untenable position, it is best to stop carrying on and exacerbating the situation. It appeared in print on page six of \"The Washington Post\" dated October 25, 1911, in the form: \"Nor would a wise man, seeing that he was in a hole, go to work and blindly dig it deeper...\" In \"The Bankers magazine\", it was published in 1964 as: \"Let me tell you about the law of holes: If you find yourself in a hole, stop digging.\" It has been quoted by American humorist Will Rogers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 318 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The first law of holes, or the law of holes, is an adage which states that \"if you find yourself in a hole, stop digging\". The adage has been attributed to a number of sources. On October 25, 1911 it appeared in print on page six of The Washington Post. In 1964, a version of the adage appeared in The Bankers Magazine. In the United Kingdom, it has been referred to as \"Healey's first law of holes\" after politician Denis Healey, who used the adage in the 1980s and later. In the United States, it has been quoted by American humorist Will Rogers." }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "Who has won the most oscars of all time?", "passages": [ [ "Walt Disney", "Walt Disney\n\nWalter Elias Disney (; December 5, 1901December 15, 1966) was an American entrepreneur, animator, voice actor and film producer.", "A pioneer of the American animation industry, he introduced several developments in the production of cartoons.", "As a film producer, Disney holds the record for most Academy Awards earned by an individual, having won 22 Oscars from 59 nominations.", "He was presented with two Golden Globe Special Achievement Awards and an Emmy Award, among other honors.", "Several of his films are included in the National Film Registry by the Library of Congress.", "Born in Chicago in 1901, Disney developed an early interest in drawing.", "He took art classes as a boy and got a job as a commercial illustrator at the age of 18.", "He moved to California in the early 1920s and set up the Disney Brothers Studio with his brother Roy.", "With Ub Iwerks, Walt developed the character Mickey Mouse in 1928, his first highly popular success; he also provided the voice for his creation in the early years.", "As the studio grew, Disney became more adventurous, introducing synchronized sound, full-color three-strip Technicolor, feature-length cartoons and technical developments in cameras." ], [ "The Lord of the Rings (film series)", "The three films together were nominated for a total of 30 Academy Awards, of which they won 17, a record for any movie trilogy (the three nominations for \"\" and \"\" along with the single nomination for \"\" brings the series' total to 37 nominations).", "\"The Fellowship of the Ring\" earned thirteen nominations, the most of any film at the 74th Academy Awards, winning four.", "\"The Return of the King\" won in every category in which it was nominated, setting the current Oscar record for the highest clean sweep, and its 11 Academy Awards wins ties the record held by \"Ben-Hur\" and \"Titanic\" (though both of those films had additional nominations that they ultimately lost).", "\"The Return of the King\" became only the second sequel to win the Oscar for Best Picture (after \"The Godfather Part II\") and the first fantasy film to receive this honor, though this has been widely perceived as an award by proxy for the entire series (the first two films were also nominated for Best Picture).", "No actors in any of the three films won Oscars, and Ian McKellen was the only actor in the trilogy to receive a nomination, for his work in \"The Fellowship of the Ring\"." ] ], "gold": "Walt Disney holds the record for most Oscar awards at 22. Ben-Hur, Titanic, The Lord of the Rings: The Return of the King have the most awards for a single film at 11 each.", "prediction 1": "The person who has won the most Academy Awards in a single category is Walt Disney. In a single year, he won 22 Oscars, including Best Picture.", "prediction 2": "There are many films that have won the most Academy Awards in history. The Lord of the Rings film trilogy has the most Oscars of all time. The Return of the King film won in every category in which it was nominated, setting the current Oscar record for the highest clean sweep, and its 11 Academy Awards wins ties the record held by Ben-Hur and Titanic (though both of those films had additional nominations that they ultimately lost).", "prediction 3": "The most Oscars won by an individual in the history of Oscars is 22 by Walt Disney. The Lord of the Rings films have won the most Academy Awards of all time.", "prediction 4": "The film series The Lord of the Rings has won the most Academy Awards of all time, with 17 wins. The Return of the King has won the most Oscars of all time. The most Academy Awards won by an individual by a producer by Walt Disney is 22. Oscar winners by category include Best Picture, Best Director, Best Supporting Actor, Best Picture, Best Actress, Best Screenplay, Best Picture, Best Director, Best Editing, Best Cinematography, Best Director, Best Director, Best Director and Best Actress.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 84, "end": 101 }, { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 143 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "As a film producer, Walt Disney holds the record for most Academy Awards earned by an individual, having won 22 Oscars. Ben-Hur, Titanic, The Lord of the Rings: The Return of the King have the most awards for a single film at 11 each." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who wrote the song crying in the chapel?", "passages": [ [ "Crying in the Chapel", "Crying in the Chapel\n\n\"Crying in the Chapel\" is a song written by Artie Glenn for his son Darrell to sing.", "Darrell recorded it while still in high school in 1953, along with Artie's band the Rhythm Riders.", "The song was rejected by Hill and Range Songs and Acuff-Rose Music.", "The song was eventually published by Valley Publishers which also released the single featuring Darrell Glenn.", "It became a local hit and then it went nationwide.", "The original version of the song (Valley 105) was issued in May 1953.", "A recording by June Valli with orchestra directed by Joe Reisman was made in New York City on June 11, 1953.", "It was released by RCA Victor Records as catalog umber 20-5368 (in USA) and by EMI on the His Master's Voice label as catalog numbers HR\u00a010007, N\u00a014105 and CS\u00a014.", "This was the most successful pop version on the \"Billboard\" charts, reaching number four after charting for 17 weeks beginning August 1, 1953.", "On October 31, 1960, Elvis Presley cut a version of the song with plans to put it on his RCA gospel album, \"His Hand in Mine\".", "Three takes were recorded, but neither Elvis nor The Jordanaires, who provided background vocals, were satisfied.", "Eventually it was decided to shelve the recordings and move on." ], [ "Crying in the Chapel (Peter Blakeley song)", "Crying in the Chapel (Peter Blakeley song)\n\n", "\"Crying in the Chapel\" is song by Australian pop singer Peter Blakeley.", "The song was released in November 1989 as the lead single from Blakeley's second studio album, \"Harry's Caf\u00e9 De Wheels\" (1990).", "It was Blakeley's first single to receive commercial success, peaking at #3 on the ARIA Singles chart, and was certified Platinum.", "At the ARIA Music Awards of 1990, \"Crying in the Chapel\" won ARIA Award for Single of the Year.", "The song also earned Blakeley a nomination for ARIA Award for Best Male Artist and ARIA Award for Song of the Year." ] ], "gold": "There are several songs with the title \"Crying in the Chapel\". \"Crying in the Chapel\" is a 1953 song by Artie Glenn. \"Crying in the Chapel\" is also a song by Australian pop singer Peter Blakeley. The song was released in November 1989 as the lead single from Blakeley's second studio album, \"Harry's Caf\u00e9 De Wheels\", 1990.", "prediction 1": "\"Crying in the Chapel\" is a song written by Artie Glenn for his son Darrell to sing. Darrell recorded it while still in high school in 1953, along with Artie's band the Rhythm Riders. The song was rejected by Hill and Range Songs and Acuff-Rose Music. The song was eventually published by Valley Publishers which also released the single featuring Darrell Glenn. It became a local hit and then it went nationwide. \"Crying in the Chapel\" is a song by Australian pop singer Peter Blakeley. It was released in November 1989 as the lead single from his second studio album, Harry's Caf\u00e9 De Wheels.", "prediction 2": "\"Crying in the Chapel\" is a song written by Artie Glenn for his son Darrell to sing. Darrell recorded it while still in high school in 1953, along with Artie's band the Rhythm Riders. The song was rejected by Hill and Range Songs and Acuff-Rose Music, but was eventually published by Valley Publishers which also released the single featuring Darrell Glenn. \"Crying in the Chapel\" is also the name of a song written by Australian pop singer Peter Blakeley. The song \"Crying in the Chapel\" is also the name of his son Darrell Glenn.", "prediction 3": "\"Crying in the Chapel\" is a song written by Artie Glenn for his son Darrell to sing. Darrell recorded it while still in high school in 1953, along with Artie's band the Rhythm Riders. The song was rejected by Hill and Range Songs and Acuff-Rose Music. The song was eventually published by Valley Publishers which also released the single featuring Darrell Glenn. It became a local hit and then it went nationwide. \"Crying in the Chapel\" is also a song by Australian pop singer Peter Blakeley. The song was released in November 1989 as the lead single from Blakeley's second studio album, Harry's Caf\u00e9 De Wheels.", "prediction 4": "Crying in the Chapel is a song written by Artie Glenn for his son Darrell to sing. Darrell recorded it while still in high school in 1953, along with Artie's band the Rhythm Riders. The song was rejected by Hill and Range Songs and Acuff-Rose Music. The song was eventually published by Valley Publishers which also released the single featuring Darrell Glenn. Crying in the Chapel is also the title of a song by Australian pop singer Peter Blakeley.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 413 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Crying in the Chapel\" is a song written by Artie Glenn for his son Darrell to sing. \"Crying in the Chapel\" is a song by Australian pop singer Peter Blakeley. It was released in November 1989 as the lead single from his second studio album, Harry's Caf\u00e9 De Wheels, 1990." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "India's first official entry at the oscars?", "passages": [ [ "Academy Award for Best Foreign Language Film", "However, Puerto Rico is an unincorporated territory of the United States and used to be eligible due to Puerto Ricans having had American citizenship since 1917.", "Their best success in this award was receiving a nomination for \"Santiago, the Story of his New Life\" (1989).", "However, , the Academy decided not to allow submissions from the territory anymore.", "Every country is invited to submit what it considers its best film to the Academy.", "Only one film is accepted from each country.", "The designation of each country's official submission has to be done by an organization, jury or committee composed of people from the film industry.", "For example, the British entry is submitted by the British Academy of Film and Television Arts, while the Brazilian entry is submitted by a committee under its Ministry of Culture.", "Names of the members of the selecting group must be sent to the Academy.", "After each country has designated its official entry, English-subtitled copies of all submitted films are shipped to the Academy, where they are screened by the Foreign Language Film Award Committee(s), whose members select by secret ballot the five official nominations.", "Final voting for the winner is restricted to active and life Academy members who have attended exhibitions of all five nominated films.", "Members who have watched the Foreign Language Film entries only on videocassette or DVD are ineligible to vote." ], [ "Academy Awards", "Academy Awards\n\nThe Academy Awards, also known as the Oscars, are a set of 24 awards for artistic and technical merit in the film industry, given annually by the Academy of Motion Picture Arts and Sciences (AMPAS), to recognize excellence in cinematic achievements as assessed by the Academy's voting membership.", "The various category winners are awarded a copy of a golden statuette, which will be after a certain \"Academy Award of Merit\", although more commonly referred to by its nickname \"Oscar\".", "The award was originally sculpted by George Stanley from a design sketch by Cedric Gibbons.", "AMPAS first presented it in 1929 at a private dinner hosted by Douglas Fairbanks in the Hollywood Roosevelt Hotel.", "The Academy Awards ceremony was first broadcast on radio in 1930 and televised for the first time in 1953.", "It is the oldest worldwide entertainment awards ceremony and is now seen live worldwide.", "Its equivalents \u2013 the Emmy Awards for television, the Tony Awards for theater, and the Grammy Awards for music \u2013 are modeled after the Academy Awards.", "The 90th Academy Awards ceremony, honoring the best films of 2017, was held on 4 March 2018, at the Dolby Theatre, in Los Angeles, California.", "The ceremony was hosted by Jimmy Kimmel and was broadcast on ABC.", "A total of 3,072 Oscars have been awarded from the inception of the award through the 90th." ] ], "gold": "The 1957 Hindi film \"Mother India\" was India's first film submission to the Academy Awards, popularly known as the Oscars. ", "prediction 1": "The Academy Awards, also known as the Oscars, are a set of 24 awards for artistic and technical merit in the film industry, given annually by the Academy of Motion Picture Arts and Sciences (AMPAS). The various category winners are awarded a copy of a golden statuette, which will be after a certain \"Academy Award of Merit\". India's first official entry at the Oscars was for the film \"The Color Purple\".\n", "prediction 2": "The Academy Awards, also known as the Oscars, are a set of 24 awards for artistic and technical merit in the film industry, given annually by the Academy of Motion Picture Arts and Sciences (AMPAS). The various category winners are awarded a copy of a golden statuette, which will be after a certain \"Academy Award of Merit\". India's first official entry at the Oscars was Forever.", "prediction 3": "The Academy Awards, better known as the Oscars, are a set of 24 awards for artistic and technical merit in the film industry, given annually by the Academy of Motion Picture Arts and Sciences (AMPAS) to recognize excellence in cinematic achievements as assessed by the Academy's voting membership. India's first official entry at the Oscars was for Chilli, which was released in April 2017. After each country has designated its official entry, English-subtitled copies of all submitted films are shipped to the Academy, where they are screened by the Foreign Language Film Award Committee(s) whose members select by secret ballot the five official nominations by secret ballot the five official nominations. Final voting for the winner is restricted to active and life Academy members who have attended exhibitions of all five nominated films and members who have watched the Foreign Language Film Award Committee(s).", "prediction 4": "The Academy Awards, also known as the Oscars, are a set of 24 awards for artistic and technical merit in the film industry, given annually by the Academy of Motion Picture Arts and Sciences (AMPAS) to recognize excellence in cinematic achievements as assessed by the Academy's voting membership. India made its first official submission at the Oscars in 1987 with There Will Be Blood, and it won Best Foreign Language Film. The designation of each country's official submission has to be done by an organization, jury or committee composed of people from the film industry. After each country has designated its official entry, English-subtitled copies of all submitted films are shipped to the Academy, where they are screened by the Foreign Language Film Award Committee(s) whose members select by secret ballot the five official nominations. Final voting for the winner is restricted to active and life Academy members who have attended exhibitions of all five nominated films.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 406 } ], "missing-info": [], "corrected-prediction": "The Academy Awards are also known as the Oscars." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "When did the one child policy end in china?", "passages": [ [ "One-child policy", "One-child policy\n\nChina's one-child policy was part of a birth planning program designed to control the size of its population.", "Distinct from the family planning policies of most other countries (which focus on providing contraceptive options to help women have the number of children they want), it set a limit on the number of children parents could have, the world's most extreme example of population planning.", "It was introduced in 1979 (after a decade-long two-child policy), modified in the mid 1980s to allow rural parents a second child if the first was a daughter, and then lasted three more decades before being eliminated at the end of 2015.", "The policy also allowed exceptions for some other groups, including ethnic minorities.", "The term one-child policy is thus a misnomer, because for nearly 30 years of the 36 years that it existed (1979-2015) about half of all parents in China were allowed to have a second child.", "Provincial governments could (and did) require the use of contraception, sterilizations and abortions to ensure compliance and imposed enormous fines for violations.", "Local and national governments created commissions to raise awareness and carry out registration and inspection work.", "According to the Chinese government, 400million births were prevented, starting from 1970 a decade before the start of the one child policy." ], [ "One-child policy", "Children born in overseas countries were not counted under the policy if they do not obtain Chinese citizenship.", "Chinese citizens returning from abroad were allowed to have a second child.", "Sichuan province allowed exemptions for couples of certain backgrounds.", "By one estimate there were at least 22 ways in which parents could qualify for exceptions to the law towards the end of the one-child policy's existence.", "As of 2007, only 36% of the population were subjected to a strict one-child limit.", "53% were permitted to have a second child if their first was a daughter; 9.6% of Chinese couples were permitted two children regardless of their gender; and 1.6% \u2013 mainly Tibetans \u2013 had no limit at all.", "Following the 2008 Sichuan earthquake, a new exception to the regulations was announced in Sichuan province for parents who had lost children in the earthquake.", "Similar exceptions had previously been made for parents of severely disabled or deceased children.", "People have also tried to evade the policy by giving birth to a second child in Hong Kong, but at least for Guangdong residents, the one-child policy was also enforced if the birth was given in Hong Kong or abroad.", "In accordance with China's affirmative action policies towards ethnic minorities, all non-Han ethnic groups are subjected to different laws and were usually allowed to have two children in urban areas, and three or four in rural areas." ], [ "Prevalence of birth control", "South Africa, Botswana, and Zimbabwe have successful family planning programs, but other central and southern African countries continue to encounter extreme difficulties in achieving higher contraceptive prevalence and lower fertility for a wide variety of compounding reasons.", "The one-child policy of the People's Republic of China requires couples to have no more than one child.", "Beginning in 1979, the policy was implemented to control rapid population growth.", "Chinese women receive free contraception and family planning services.", "Greater than 70% of those of childbearing age use contraception.", "Since the policy was put into place in 1979, over 400 million births have been prevented.", "Because of various exemptions, fertility rate is about 1.7 children per woman, down from 5.9 in the 1960s.", "A strong preference for boys and free access to fetus sex determination and abortion has resulted in an artificially high proportion of males in both rural and urban areas.", "Beginning January 1, 2016, China officially abolished the one-child policy.", "The Chinese government decided to allow families to have a second child to supposedly grow a bigger work force and allow the aging population to relax more.", "They predict that another economic boom with occur in the near future.", "The new policy was also seen as a solution to the massive gender disparity, with China's current population leaning heavily toward males." ] ], "gold": "The one-child policy was part of a broad program designed to control the size of the rapidly growing population of the People's Republic of China. It was introduced in 1979 after a decade-long two-child policy, modified beginning in the mid 1980s to allow rural parents a second child if the first was a daughter, and then lasted three more decades before being eliminated at the end of 2015. The official policy granted local officials the flexibility to make exceptions and allow second children in the case of \"practical difficulties\", such as cases in which the father was a disabled serviceman, or when both parents were single children, and some provinces had other exemptions worked into their policies as well. In October 2015, the Chinese news agency Xinhua announced plans of the government to abolish the one-child policy, now allowing all families to have two children, citing from a communiqu\u00e9 issued by the CPC \"to improve the balanced development of population\", an apparent reference to the country's female-to-male sex ratio, and to deal with an aging population according to the Canadian Broadcasting Corporation. The new law took effect on 1 January 2016 after it was passed in the Standing Committee of the National People's Congress on 27 December 2015.", "prediction 1": "Since 1979, the one-child policy was implemented to control rapid population growth. It was removed after three decades on January 1, 2016, at the end of which half of all Chinese parents were allowed to have a second child. The policy also allowed exceptions for some other groups, including ethnic minorities.", "prediction 2": "The one-child policy of the People's Republic of China requires couples to have no more than one child. Beginning in 1979, the policy was implemented to control rapid population growth. Modifications to the policy were made in the mid 1980s to allow rural parents a second child if the first was a daughter. The policy lasted three more decades before being eliminated at the end of 2015.", "prediction 3": "The one-child policy of the People's Republic of China requires couples to have no more than one child. Beginning in 1979, the policy was implemented to control rapid population growth. Modifications were made in the mid 1980s to allow rural parents a second child if the first was a daughter, and then it lasted three more decades before being eliminated at the end of 2015.", "prediction 4": "Beginning in 1979, the one-child policy of the People's Republic of China requires couples to have no more than one child. Modifications to the one-child policy were made in the mid 1980s to allow rural parents a second child if the first was a daughter. The one-child policy ended in January 1, 2016, when the Chinese government decided to allow families to have a second child to supposedly grow a bigger work force and allow the aging population to relax more.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 140, "end": 224 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The one-child policy was part of a broad program designed to control the size of the rapidly growing population of the People's Republic of China. It was introduced in 1979 after a decade-long two-child policy, modified beginning in the mid 1980s to allow rural parents a second child if the first was a daughter, and then lasted three more decades before being eliminated at the end of 2015. By one estimate there were at least 22 ways in which parents could qualify for exceptions to the law towards the end of the one-child policy's existence. exceptions had previously been made for parents of severely disabled or deceased children. The policy also allowed exceptions for some other groups, including ethnic minorities. The one-child policy was removed after three decades on January 1, 2016." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Number of catholic high schools in the united states?", "passages": [ [ "Catholic schools in the United States", "Catholic schools in the United States\n\nCatholic schools in the United States constitute the largest number of non-public schools in the country.", "They are accredited by independent and/or state agencies, and teachers are generally certified.", "Catholic schools are supported primarily through tuition payments and fundraising, and typically enroll students regardless of religious background.", "By the middle of the 19th century, the Catholics in larger cities started building their own parochial school system.", "The main impetus was fear that indoctrination by Protestant teachers in the public schools would lead to a loss of faith.", "Protestants reacted by strong opposition to any public funding of parochial schools.", "The Catholics nevertheless built their elementary schools, parish by parish, using very low paid and sisters without college educations as teachers.", "This was not unlike the public school system, where college-educated teachers became the norm only in the 20th century.", "Most Catholic elementary schools are operated by a local parish community, while secondary schools are usually operated by a diocese or archdiocese, or a religious institute, and often those in major cities are also attached to a Catholic university.", "In the United States, the term parochial school is commonly used to refer to Catholic schools, to distinguish it from private school (which can refer to either a nonsectarian school or a church-based school)." ], [ "Catholic schools in the United States", "More competitive Catholic secondary schools tend to have tighter academic requirements and/or an entrance exam.", "It is a common expectation that non-Catholic students take religion classes and attend the spiritual exercises of the school.", "Many schools have a policy (sometimes written) banning proselytizing in any form.", "The United States had 7,498 Catholic schools in 2006-07, including 6,288 elementary schools and 1,210 secondary schools.", "In total there were 2,320,651 students, including 1,682,412 students in the elementary/middle schools and 638,239 in high schools.", "Enrollment in the nation's Catholic schools has steadily dropped to less than half of its peak at five million students 40 years ago, \"The New York Times\" reported in early 2009.", "At its peak in 1965, the number of U.S. parochial schools was more than 12,000, and roughly half of all Catholic children in America attended Catholic elementary schools, according to the National Catholic Educational Association.", "The same share in 2009 is about 15 percent.", "Among Latinos, the fastest-growing church group \u2014 soon to comprise a majority of Catholics in the United States \u2014 it is three percent." ] ], "gold": "Catholic schools in the United States constitute the largest number of non-public, Christian schools in the country. They are accredited by independent and/or state agencies, and teachers are generally certified. Catholic schools are supported primarily through tuition payments and fundraising, and typically enroll students irrespective of their religious background. There are 1210 Catholic high schools in the United States with around 638,239 students in attendance.", "prediction 1": "In 2006-07, the United States had 7,498 Catholic schools, including 6,288 elementary schools and 1,210 secondary schools. In total, there were 2,320,651 students, including 1,682,412 students in the elementary/middle schools and 638,239 in high schools.", "prediction 2": "Catholic schools in the United States constitute the largest number of non-public schools in the country. They are accredited by independent and/or state agencies, and teachers are generally certified. Catholic schools are supported primarily through tuition payments and fundraising, and typically enroll students regardless of religious background. In 2006-07, there were 7,498 Catholic schools in the United States, including 6,288 elementary schools and 1,210 secondary schools. In total there were 2,320,651 students, including 1,682,412 students in the elementary/middle schools and 638,239 in high schools.", "prediction 3": "Catholic schools in the United States constitute the largest number of non-public schools in the country. They are accredited by independent and/or state agencies, and teachers are generally certified. In total, there were 6,288 elementary schools and 1,210 secondary schools in the United States in 2006-07.", "prediction 4": "Catholic high schools in the United States constitute the largest number of non-public schools in the country. They are accredited by independent and/or state agencies, and teachers are generally certified. In 2006-07, the United States had 7,498 Catholic schools, including 6,288 elementary schools and 1,210 secondary schools.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Catholic schools in the United States constitute the largest number of non-public, Christian schools in the country. They are accredited by independent and/or state agencies, and teachers are generally certified. Catholic schools are supported primarily through tuition payments and fundraising, and typically enroll students regardless of religious background. In 2006-07, the United States had 7,498 Catholic schools, including 6,288 elementary schools and 1,210 secondary schools. In total, there were 2,320,651 students, including 1,682,412 students in the elementary/middle schools and 638,239 in high schools." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won the battle of the charge of the light brigade?", "passages": [ [ "Charge of the Light Brigade", "Charge of the Light Brigade\n\nThe Charge of the Light Brigade was a charge of British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War.", "British commander Lord Raglan had intended to send the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions, a task for which the light cavalry were well-suited.", "However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire.", "The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "The events were the subject of Alfred, Lord Tennyson's narrative poem \"The Charge of the Light Brigade\" (1854), published just six weeks after the event.", "Its lines emphasise the valour of the cavalry in bravely carrying out their orders, regardless of the nearly inevitable outcome.", "Blame has remained controversial for the miscommunication, as the order was vague and Louis Edward Nolan delivered the written orders with some verbal interpretation, then died in the first minute of the assault." ], [ "Charge of the Light Brigade", "Nigel Kingscote was another of Raglan's staff officers, and he agreed that the fault was Nolan's and said that Nolan would have been \"broke by court martial\" if he had survived.", "The brigade was not completely destroyed, but did suffer terribly, with 118 men killed, 127 wounded, and about 60 taken prisoner.", "After regrouping, only 195 men were still with horses.", "The futility of the action and its reckless bravery prompted the French Marshal Pierre Bosquet to state: \"\"C'est magnifique, mais ce n'est pas la guerre.\"\" (\"It is magnificent, but it is not war.\")", "He continued, in a rarely quoted phrase: \"\"C'est de la folie\"\" \u2014 \"It is madness.\"", "The Russian commanders are said to have initially believed that the British soldiers must have been drunk.", "Somerset Calthorpe, aide-de-camp to Lord Raglan, wrote a letter to a friend three days after the charge.", "He detailed casualty numbers but did not distinguish between those killed and those taken prisoner:\n\nSlow communications meant that news of the disaster did not reach the British public until three weeks after the action.", "The British commanders' dispatches from the front were published in an extraordinary edition of the \"London Gazette\" of 12 November 1854." ], [ "Charge of the Light Brigade", "When Lucan asked what guns were referred to, Nolan is said to have indicated with a wide sweep of his arm\u2014not the causeway redoubts\u2014but the mass of Russian guns in a redoubt at the end of the valley, around a mile away.", "His reasons for the misdirection are unknown because he was killed in the ensuing battle.", "In response to the order, Lucan instructed Cardigan to lead his command of about 670 troopers of the Light Brigade straight into the valley between the Fedyukhin Heights and the Causeway Heights.", "In his poem, \"The Charge of the Light Brigade\" (1854), Tennyson dubbed this hollow \"The Valley of Death\".", "The opposing Russian forces were commanded by Pavel Liprandi and included approximately 20 battalions of infantry supported by over 50 artillery pieces.", "These forces were deployed on both sides and at the opposite end of the valley.", "Lucan himself was to follow with the Heavy Brigade.", "Although the Heavy Brigade was better armoured and intended for frontal assaults on infantry positions, neither force was remotely equipped for a frontal assault on a fully dug-in and alerted artillery battery\u2014much less one with an excellent line of sight over a mile in length and supported on two sides by artillery batteries providing enfilading fire from elevated ground." ] ], "gold": "The Charge of the Light Brigade was a failed military action involving the British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The battle was won by the Russian forces who were led by Pavel Liprandi. The brigade was not completely destroyed, but did suffer terribly, with 118 men killed, 127 wounded, and about 60 taken prisoner. After regrouping, only 195 men were still with horses. ", "prediction 1": "The Charge of the Light Brigade was a British light cavalry charge led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. There was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "prediction 2": "The Battle of the Light Brigade was a charge of British light cavalry led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. There was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "prediction 3": "Lord Raglan sent the Light Brigade to prevent the Russians from removing captured guns from overrun Turkish positions. However, there was miscommunication in the chain of command, and the Light Brigade was instead sent on a frontal assault against a different artillery battery, one well-prepared with excellent fields of defensive fire. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "prediction 4": "The Battle of the Charge of the Light Brigade was a British light cavalry charge led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The Light Brigade reached the battery under withering direct fire and scattered some of the gunners, but they were forced to retreat immediately, and the assault ended with very high British casualties and no decisive gains.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 390 }, { "error type": "Irrelevant", "explanation": "", "start": 391, "end": 615 }, { "error type": "Irrelevant", "explanation": "", "start": 616, "end": 761 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Charge of the Light Brigade was a British light cavalry charge led by Lord Cardigan against Russian forces during the Battle of Balaclava on 25 October 1854 in the Crimean War. The battle was won by the Russian forces who were led by Pavel Liprandi. The brigade was not completely destroyed, but did suffer terribly, with 118 men killed, 127 wounded, and about 60 taken prisoner. After regrouping, only 195 men were still with horses." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Largest great white shark ever caught on rod and reel?", "passages": [ [ "Frank Mundus", "In 1986 he and Donnie Braddick caught a 3,427-pound great white about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel.", "The capture of the shark was controversial at the time, with some saying the shark was feeding on a whale when caught (which would have negated the so-called \"official record\").", "The International Game Fishing Association ruled that the catch was legitimate based on photographs.", "In 1991 the U.S. Coast Guard said that Mundus' license had expired and he had to reapply.", "He initially attempted to sell the \"Cricket II\" and moved to Hawaii.", "The sale did not go through although the boat would be operated by others.", "He officially retired as a charter captain in 1997.", "In the years before his death he would come back to Montauk for its shark tournaments and would ride along on higher priced \"Cricket II\" excursions.", "He died in Hawaii shortly after returning from Montauk.", "Mundus' reputation was enhanced by his eccentric personality and ostentatious displays of the killed sharks (something he would say later he regretted)." ], [ "Frank Mundus", "Frank Mundus\n\nFrank Mundus (October 21, 1925September 10, 2008) was a sport fisherman in Montauk, New York who is said to be the inspiration for the character Quint in the movie and book \"Jaws\".", "Up until his death, he chartered out his boat \"Cricket II\" for those seeking the thrill of big game fishing.", "He started out as a shark hunter but then later became a shark conservationist.", "Mundus' early techniques, which included killing whales merely for chum and harpooning sharks (practices which are outlawed today), earned him criticism even at the time.", "In the last few years of his life Mundus had campaigned for shark fishermen to catch and release their prey including a conservation book \"White Shark Sam Meets The Monster Man.\"", "In 2008 the \"Cricket\" spent much of the summer docked near Atlantis Marine World in Riverhead, New York where conservation of the predators was preached.", "Mundus died on September 10, 2008, in Honolulu due to complications from a heart attack he suffered on September 6, the day he returned home to Hawaii after spending the summer in Montauk.", "According to his obituary he had spent the last night in Montauk aboard the \"Cricket II\" which had made him famous and had his heart attack in the Hawaii airport immediately after returning." ] ], "gold": "Frank Mundus was a fisherman and charter captain based out of Montauk, New York who is said to be the inspiration for the character Quint in the movie and book Jaws. Mundus started what he called \"Monster Fishing\" with boats leaving the port at Lake Montauk. In 1986, Frank Mundus and Donnie Braddick caught a 3,427-pound great white shark about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. ", "prediction 1": "In 1986 he and Donnie Braddick caught a 3,427-pound great white about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. The capture of the shark was controversial at the time, with some saying the shark was feeding on a whale when caught, which would have negated the so-called \"official record\". Mundus later became a shark conservationist after he retired from charter captain in 1997.", "prediction 2": "Frank Mundus and Donnie Braddick caught a 3,427-pound great white shark in 1986, about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. Mundus' reputation was enhanced by his eccentric personality and ostentatious displays of the killed sharks.", "prediction 3": "In 1986 he and Donnie Braddick caught a 3,427-pound great white about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. The capture of the shark was controversial at the time, with some saying the shark was feeding on a whale when caught, which would have negated the so-called \"official record.\" Mundus started out as a shark hunter but later became a shark conservationist.", "prediction 4": "In 1986 he and Donnie Braddick caught a 3,427-pound great white about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. Mundus and Braddick caught the shark in 1986. He was also responsible for the largest striped bass ever caught on rod and reel in the United States in 1990.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 433 }, { "error type": "Irrelevant", "explanation": "", "start": 434, "end": 524 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Frank Mundus was a fisherman and charter captain based out of Montauk, New York who is said to be the inspiration for the character Quint in the movie and book Jaws. In 1986 he and Donnie Braddick caught a 3,427-pound great white about 28 miles off Montauk, and only 18 miles from Block Island, which still holds the record, not only for the largest shark, but for the largest fish of any kind ever caught by rod and reel. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What book of the bible is the ten commandments in?", "passages": [ [ "Ten Commandments", "Ten Commandments\n\nThe Ten Commandments (, \"Aseret ha'Dibrot\"), also known as the Decalogue, are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity.", "The commandments include instructions to worship only God, to honour one's parents, and to keep the sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonesty, and coveting.", "Different religious groups follow different traditions for interpreting and numbering them.", "The Ten Commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy.", "Modern scholarship has found likely influences in Hittite and Mesopotamian laws and treaties, but is divided over exactly when the Ten Commandments were written and who wrote them.", "In biblical Hebrew, the Ten Commandments are called (transliterated ) and in Mishnaic Hebrew (transliterated ), both translatable as \"the ten words\", \"the ten sayings\", or \"the ten matters\".", "The Tyndale and Coverdale English biblical translations used \"ten verses\".", "The Geneva Bible used \"tenne commandements\", which was followed by the Bishops' Bible and the Authorized Version (the \"King James\" version) as \"ten commandments\"." ] ], "gold": "The Ten Commandments, also known as the Decalogue, are a set of Biblical principles relating to ethics and worship, which play a fundamental role in the Abrahamic religions. The Ten Commandments appear twice in the Hebrew Bible: in the books of Exodus and Deuteronomy.", "prediction 1": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. The commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy.", "prediction 2": "The Ten Commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy.", "prediction 3": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. The commandments include instructions to worship only God, to honour one's parents, and to keep the sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonesty, and coveting. The commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy.", "prediction 4": "The Ten Commandments are found in 2 books of the Bible: Exodus and Deuteronomy. The commandments also play a fundamental role in Judaism and Christianity.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Ten Commandments, also known as the Decalogue, are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. The commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays liesel in the sound of music?", "passages": [ [ "The Sound of Music", "The Sound of Music\n\nThe Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse.", "It is based on the memoir of Maria von Trapp, \"The Story of the Trapp Family Singers\".", "Set in Austria on the eve of the \"Anschluss\" in 1938, the musical tells the story of Maria, who takes a job as governess to a large family while she decides whether to become a nun.", "She falls in love with the children, and eventually their widowed father, Captain von Trapp.", "He is ordered to accept a commission in the German navy, but he opposes the Nazis.", "He and Maria decide on a plan to flee Austria with the children.", "Many songs from the musical have become standards, such as \"Edelweiss\", \"My Favorite Things\", \"Climb Ev'ry Mountain\", \"Do-Re-Mi\", and the title song \"The Sound of Music\".", "The original Broadway production, starring Mary Martin and Theodore Bikel, opened in 1959 and won five Tony Awards, including Best Musical, out of nine nominations.", "The first London production opened at the Palace Theatre in 1961.", "The show has enjoyed numerous productions and revivals since then." ], [ "Peter Pan Live!", "Peter Pan Live!", "Peter Pan Live!", "is a television special that was broadcast by NBC on December 4, 2014.", "The special featured a live production of the 1954 musical adaptation of \"Peter Pan\", televised from Grumman Studios in Bethpage, New York, starring Allison Williams in the title role and Christopher Walken as Captain Hook.", "The production was a follow-up to \"The Sound of Music Live!", "\"\u2014a similar adaptation of \"The Sound of Music\" which aired on NBC in December 2013 and brought the network's highest Thursday-night ratings since 2004.", "NBC's entertainment head Bob Greenblatt would sign Craig Zadan and Neil Meron\u2014who served as the executive producers of the special, to produce another live musical for the 2014 holiday season.", "Additionally, the production served as a follow-up to three productions of \"Peter Pan\" produced for NBC in 1955, 1956, and 1960 that featured cast members from its original Broadway run.", "While similar in content to the original, the version of \"Peter Pan\" featured in the special contained revisions to its book to emphasize the character of Captain Hook, along with additional songs from its revivals, new songs adapted from the musicals \"Do Re Mi\" and \"Say, Darling\", and the restoration of a song that had been cut from the musical before its original Broadway premiere." ], [ "The Sound of Music", "A 2016 Australian tour of the Lloyd Webber production, directed by Sams, included stops in Sydney, Brisbane, Melbourne and Adelaide.", "The cast included Cameron Daddo as Captain Von Trapp, Marina Prior as Baroness Schraeder and Lorraine Bayly as Frau Schmidt.", "The choreographer was Arlene Phillips.", "On March 2, 1965, 20th Century Fox released a film adaption of the musical starring Julie Andrews as Maria Rainer and Christopher Plummer as Captain Georg von Trapp.", "It was produced and directed by Robert Wise with the screenplay adaption written by Ernest Lehman.", "Two songs were written by Rodgers specifically for the film, \"I Have Confidence\" and \"Something Good\".", "The film won five Oscars at the 38th Academy Awards, including Best Picture.", "A live televised production of the musical aired twice in December 2013 on NBC.", "It was directed by Beth McCarthy-Miller and Rob Ashford.", "Carrie Underwood starred as Maria Rainer, with Stephen Moyer as Captain von Trapp, Christian Borle as Max, Laura Benanti as Elsa, and Audra McDonald as the Mother Abbess.", "The production was released on DVD the same month.", "British network ITV presented a live version of its own on December 20, 2015.", "It starred Kara Tointon as Maria, Julian Ovenden as Captain von Trapp, Katherine Kelly as Baroness Schraeder and Alexander Armstrong as Max." ] ], "gold": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II, and a book by Howard Lindsay and Russel Crouse. It is based on the 1949 memoir of Maria von Trapp, The Story of the Trapp Family Singers. The original Broadway production opened in 1959 with Lauri Peters portraying Liesl. In the 1965 film version, Charmian Carr, portrayed Liesl. A live televised production of the musical aired twice in December 2013 on NBC with Ariane Rinehart portraying Liesel. British network ITV presented a live version of its own on December 20, 2015 with Evelyn Hoskins portraying Liesl.", "prediction 1": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. It is based on the memoir of Maria von Trapp, \"The Story of the Trapp Family Singers\". In the original production, Maria plays Lisa, the second maid, and the fourth maid. In the live televised productions of the musical, the role of Lisel was played by Kara Tointon and Julian Ovenden.", "prediction 2": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. It is based on the memoir of Maria von Trapp, The Story of the Trapp Family Singers. In the original production, Miranda Hart played the role of Lisel. In the 2014 television special, Peter Pan Live!, a similar adaptation of The Sound of Music, was broadcast by NBC on December 4, 2014.", "prediction 3": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. In the original 1959 production, Therese von Trapp is played by Allison Williams as Maria Rainer. In the 2014 television special, \"The Sound of Music Live! \"\u2014a similar adaptation of \"The Sound of Music\"\u2014there is a different performance of the role of Frau Schmidt, played by Lorraine Bayly.", "prediction 4": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. In the original 1959 production, Maria von Trapp played the role of Elisabeth Wolf in the original stage production, and in the 1984 film, Mary Lou Reese played the role of Elisabeth. In the 2013 televised production of the musical, a live production was broadcast by NBC. Lorraine Bayly played Frau Schmidt in the 2016 Australian tour of the Lloyd Webber production, also featured Karen Ovenden as Lisael. In the 2017 version, British network ITV presented a live version of the show on December 20, 2015 version that starred Kara Tointon as Maria, Julian Ovenden as Captain von Trapp, Katherine Kelly as Baroness Schraeder and Alexander Armstrong as Max.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[13]}", "start": 313, "end": 427 }, { "error type": "Unverifiable", "explanation": "", "start": 229, "end": 312 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. It is based on the memoir of Maria von Trapp, \"The Story of the Trapp Family Singers\". " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What profile has the most followers on instagram?", "passages": [ [ "Cristiano Ronaldo", "He topped the list for the second straight year with earnings of $93\u00a0million in 2016\u201317.", "Ronaldo is one of the world's most marketable athletes: \"SportsPro\" rated him the fifth most marketable athlete in 2012, and eighth most marketable athlete in 2013, with Brazilian footballer Neymar topping both lists.", "Sports market research company Repucom named Ronaldo the most marketable and most recognised football player in the world in May 2014.", "He was additionally named in the 2014 Time 100, \"Time\"s annual list of the most influential people in the world.", "ESPN named Ronaldo the world's most famous athlete in 2016, 2017 and 2018.", "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158\u00a0million total followers across Facebook, Twitter and Instagram by June 2015.", ", he has the world's biggest Facebook fanbase with 103\u00a0million followers: he became the first sportsperson to reach 50\u00a0million followers in August 2010, and in October 2014, he became the first sportsperson, and the second person after Shakira, to reach 100\u00a0million followers.", "By June 2017, Ronaldo had 277\u00a0million followers across social media.", "His sponsors earned $936\u00a0million in media value across his social media accounts between June 2016 to June 2017." ], [ "Celebrity branding", "Companies can simply tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click.", "The culture of advertising on Instagram came naturally when businesses realized that celebrities have a direct means of communication to their target demographic.", "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers.", "By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people.", "Many of America's top-earning celebrities Instagram accounts are continually promoting products such as health supplements, vitamins and detox teas.", "These aren't spontaneous proclamations, but rather posts paid for by brands to advertise products to the celebrities' sizable following.", "On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram.", "At the top end of the digital celebrity pay scale some posts can earn around $300,000, especially when Instagram pictures can be easily linked to other social media platforms such as Facebook or Twitter.", "One of the celebrities that is most well known for promoting brands on her Instagram page is Kim Kardashian." ] ], "gold": "As of September 2021, the most-followed individual on Instagram is Portuguese footballer Cristiano Ronaldo, or @cristiano, with over 340 million followers. However, with its own brand account, Instagram, or @instagram, is the most followed account overall with over 420 million followers.", "prediction 1": "Instagram is a photo-sharing platform, which means you can follow almost any profile you want on Instagram. There are several different Instagram profiles that have the most followers, some have more than 30 million followers, and some have less than 30 million followers. For example, Kim Kardashian has the most followers on Instagram, followed by a profile with 77 million followers, followed by the rapper Rihanna.", "prediction 2": "The Instagram profile with the most followers on Instagram is the one of Brazilian footballer Neymar, who has more than 260 million followers.", "prediction 3": "The Instagram profile with the most followers is the profile of footballer Cristiano Ronaldo, who has 277 million followers and has the most followers on Instagram. The profile of singer Beyonce, who has the most followers, has the most followers on Instagram.", "prediction 4": "The profile with the most followers on Instagram is the one belonging to Brazilian footballer Neymar, who has 277 million followers. The profile with the most followers on Instagram is the one belonging to American singer Justin Bieber, who has about 215 million followers.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 107 }, { "error type": "Unverifiable", "explanation": "", "start": 273, "end": 418 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 272 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158 million total followers across Facebook, Twitter and Instagram by June 2015." }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "What is the origin of the name david?", "passages": [ [ "David (name)", "David (name)\n\nDavid is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition.", "David was adopted as a Christian name from an early period, e.g. David of Wales (6th century), David Saharuni (7th century), David I of Iberia (9th century).", "Name days are celebrated on 8 February (for David IV of Georgia), 1 March (for St. David of Wales) and 29 December (for King David), as well as 25 June (St. David of Sweden), 26 June, 9 July (Russia), 26 August, 11 December and 30 December (Hungary, Latvia, Norway).", "The oldest, most popular and most commonly used diminutive form in the English speaking countries of David is Dave, which first appeared in written form in the 16th century.", "The nickname Dave has been used as a name in its own right in the 19th and 20th centuries, at least in the United States.", "At the height of its popularity in the 1950s and early 1960s, the name Dave was bestowed upon more than 3,000 infants each year.", "Other common English-language hypocorisms of the name David are Davey, Davie and Davy.", "The Welsh Dafydd is also abbreviated Dewi, Dai and Daf." ], [ "Davids", "Davids\n\nDavids is an unusual patronymic surname and a variant of Davidis.", "The name is mostly found in Great Britain and in the Netherlands.", "Davids is derived from the Hebrew word for \"beloved\".", "The name was popularised by the story of King David, who is regarded as the greatest of the early kings of Israel and founder of the Davidic line.", "The surname first migrated to England after the Norman conquest of 1066.", "The surname was first found in Sussex where bearers of the name were Lords of the manor of Peasmarsh in that shire, and were descendend from Robert, count of Eu, in Normandy.", "The name may refer to:" ] ], "gold": "David is a common masculine given name of Biblical Hebrew origin, as King David is a figure of central importance in the Hebrew Bible and in Christian, Sabbatean Judaism, and Islamic religious tradition. The name David originated in Israel.", "prediction 1": "David is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition. The oldest, most popular and most commonly used diminutive form in the English speaking countries of David is Dave, which first appeared in written form in the 16th century. The nickname Dave has been used as a name in its own right in the 19th and 20th centuries, at least in the United States.", "prediction 2": "David is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition. David was adopted as a Christian name from an early period, e.g. David of Wales (6th century), David Saharuni (7th century), David I of Iberia (9th century). The nickname Dave has been used as a name in its own right in the 19th and 20th centuries, at least in the United States. David is a patronymic surname and a variant of Davidis. The name is mostly found in Great Britain and in the Netherlands. Davids are an unusual patronymic surname and a variant of Davidis.", "prediction 3": "David is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition. The name was adopted as a Christian name from an early period, e.g. David of Wales (6th century), David Saharuni (7th century), David I of Iberia (9th century). The nickname Dave has been used as a name in its own right in the 19th and 20th centuries, at least in the United States.", "prediction 4": "David is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition. Davids is an unusual patronymic surname and a variant of Davidis. The name is mostly found in Great Britain and in the Netherlands. The surname first migrated to England after the Norman conquest of 1066. The surname first found in Sussex where bearers of the name were Lords of the manor of Peasmarsh in that shire, and were descendant from Robert, count of Eu, in Normandy. The surname first migrated to England after the Norman conquest of 1066.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 490 } ], "missing-info": [], "corrected-prediction": "David is a common masculine given name of Biblical Hebrew origin, as King David is a character of central importance in the Hebrew Bible and in Christian, Jewish and Islamic religious tradition. " }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who has the right of way in international waters?", "passages": [ [ "International Regulations for Preventing Collisions at Sea", "A commonly held misconception concerning the rules of marine navigation is that by following specific rules, a vessel can gain certain rights of way over other vessels.", "No vessel ever has absolute \"right of way\" over other vessels.", "Rather, there can be a \"give way\" (burdened) vessel and a \"stand on\" (privileged) vessel, or there may be two give way vessels with no stand on vessel.", "A stand on vessel does not have an absolute right of way over any give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged (under Rule 2 and Rule 17) to give way so as to avoid it, if doing so will be effective and is practicable.", "Two power-driven vessels approaching each other head-to-head, are \"both\" deemed to be \"give way\" and both are required to alter course so as to avoid colliding with the other.", "Neither vessel has \"right of way\".", "The summary below is based upon but is not identical to the published text.", "[Rule 2 is sometimes referred to as the \"General Prudential\" rule and provides for non-conformance with stated rules to prevent a collision, because what is paramount is to avoid or minimise the damaging effects of a collision, as opposed to blindly following the rules to the letter." ], [ "International Regulations for Preventing Collisions at Sea", "The overall intent is to minimise actual collision taking place rather than rule compliance in and of itself, per\u00a0se.]", "For the purpose of these Rules, except where the context otherwise requires:\n\nIn determining a safe speed the following factors shall be among those taken into account:\n\n(a) By all vessels:\n(b) Additionally, by vessels with operational radar:\n\n\n\n\n\nSailing vessels underway and vessels under oars\nFishing Vessels\nVessels not under command or restricted in their ability to manoeuvre\n\n\nAny vessel (or class of vessel) provided that she complies with the requirements of the International Regulations for the Preventing of Collisions at Sea, 1960, the keel of which is laid or is at a corresponding stage of construction before the entry into force of these Regulations may be exempted from compliance therewith as follows:\n\n* Refer to the Framework and Procedures for the IMO Member State Audit Scheme (resolution A.1067(28)).", "Rule 40 Application\n\nContracting Parties shall use the provisions of the Code for Implementation in the execution of their obligations and responsibilities contained in the present Convention.", "Rule 41 Verification of compliance\n\n(a)", "Every Contracting Party shall be subject to periodic audits by the Organization in accordance with the audit standard to verify compliance with and implementation of the present Convention." ] ], "gold": "A commonly held misconception concerning the rules of marine navigation is that by following specific rules, a vessel can gain certain rights of way over other vessels. No vessel ever has absolute \"right of way\" over other vessels. Rather, there can be a \"give way\" (burdened) vessel and a \"stand on\" (privileged) vessel, which is a vessel restricted in her ability to manoeuvre, or there may be two give way vessels with no stand on vessel. A stand on vessel does not have an absolute right of way over any give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged (under Rule 2 and Rule 17) to give way so as to avoid it, if doing so will be effective and is practicable.", "prediction 1": "There are different types of vessels that have the right of way in international waters. A \"give way\" vessel has the right of way, while a \"stand on\" vessel has the right of way. A stand on vessel does not have the right of way over a give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged to give way so as to avoid it, if doing so will be effective and is practicable.", "prediction 2": "A commonly held misconception concerning the rules of marine navigation is that by following specific rules, a vessel can gain certain rights of way over other vessels. No vessel ever has absolute \"right of way\" over other vessels. There can be a \"give way\" vessel and a \"stand on\" vessel, or there may be two give way vessels with no stand on vessel. A stand on vessel does not have an absolute right of way over any give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged (under Rule 2 and Rule 17) to give way so as to avoid it, if doing so will be effective and is practicable.", "prediction 3": "A commonly held misconception concerning the rules of marine navigation is that by following specific rules, a vessel can gain certain rights of way over other vessels. No vessel ever has absolute \"right of way\" over other vessels. Rather, there can be a \"give way\" (burdened) vessel and a \"stand on\" (privileged) vessel, or there may be two give way vessels with no stand on vessel. A stand on vessel does not have an absolute right of way over any give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged (under Rule 2 and Rule 17) to give way so as to avoid it, if doing so will be effective and is practicable.", "prediction 4": "There can be a \"give way\" vessel and a \"stand on\" vessel, or there may be two give way vessels with no stand on vessel. A stand on vessel does not have an absolute right of way over any give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged to give way so as to avoid it, if doing so will be effective and practicable. Other than those vessels with operational radar, there is no absolute right of way over any other vessel.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A commonly held misconception concerning the rules of marine navigation is that by following specific rules, a vessel can gain certain rights of way over other vessels. No vessel ever has absolute \"right of way\" over other vessels. Rather, there can be a \"give way\" (burdened) vessel and a \"stand on\" (privileged) vessel, which is a vessel restricted in her ability to manoeuvre, or there may be two give way vessels with no stand on vessel. A stand on vessel does not have the right of way over a give way vessel, for if there is a risk of collision, a stand on vessel may still be obliged to give way so as to avoid it, if doing so will be effective and is practicable." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What is the biggest automobile company in the world?", "passages": [ [ "Renault\u2013Nissan\u2013Mitsubishi Alliance", "Our total annual sales are forecast to exceed 14 million units, generating revenues expected at $240 billion by the end of the plan.\u201d", "Beside the announcement of the new plan, the new logo and the new name of the Alliance had been launched.", "According to the Alliance, it sold one in nine cars worldwide in 2017, ranking as the world's largest producer of light vehicles by sales, with 10,608,366 units sold.", "In 2017, the Renault-Nissan-Mitsubishi alliance recorded an increase of 6.5% compared to 2016.", "The Alliance committed billion (around billion) into its electric vehicle and battery development programs with the aim to become the leader in zero-emission transportation.", "Carlos Ghosn, Chairman and CEO of the Renault\u2013Nissan Alliance predicted that by 2020 one in 10 new car sales will be an electric vehicle.", "The first electric car based on this investment was the Nissan Leaf, launched in December 2010 in the United States and Japan.", "Between 2011 and 2013, Renault launched four zero-emissions (Z.E.) battery electric vehicles (BEVs), the Renault Kangoo Z.E. utility van, Renault Fluence Z.E., Renault Zoe and the Renault Twizy urban quadricycle.", "Zero-emissions refers to no emissions and no regulated exhaust pollutants while driving, that is, no tailpipe pollutants." ], [ "Renault\u2013Nissan\u2013Mitsubishi Alliance", "Renault\u2013Nissan\u2013Mitsubishi Alliance\n\nThe Renault\u2013Nissan\u2013Mitsubishi Alliance is a Franco-Japanese strategic partnership between the automobile manufacturers Renault, based in Paris, France; Nissan, based in Yokohama, Japan; and Mitsubishi Motors, based in Tokyo, Japan; which together sell more than 1 in 9 vehicles worldwide.", "Originally known as the Renault\u2013Nissan Alliance, Renault and Nissan became strategic partners in 1999 and have nearly 450,000 employees and control ten major brands: Renault, Nissan, Mitsubishi, Infiniti, Renault Samsung Motors, Dacia, Alpine, Datsun, Venucia and Lada.", "The car group sold 8.3 million cars worldwide in 2013, behind Toyota, General Motors and Volkswagen Group for total volume.", "The Alliance adopted its current name in September 2017, one year after Nissan acquired a controlling interest in Mitsubishi and subsequently making Mitsubishi an equal partner in the Alliance.", ", the Alliance is the world's leading plug-in electric vehicle manufacturer, with global sales since 2010 of over 500,000 electric vehicles, including those manufactured by Mitsubishi, now part of the Alliance.", "The top selling vehicle of the Alliance EV line-up is the Nissan Leaf all-electric car.", "The Leaf is also the world's best-selling highway-capable plug-in electric car in history, with more than 300,000 units sold worldwide through January 2018." ], [ "Big Three (automobile manufacturers)", "Unlike the plants of domestic automakers, Japanese plants are non-unionized (save for NUMMI), so they have lower wage expenses and do not face the risk of strikes.", "The VER was lifted in 1994 upon agreement of all members of General Agreement on Tariffs and Trade (GATT).", "Establishing US production facilities was also a significant step in improving public relations, along with philanthropy, lobbying efforts, and sharing technology.", "Europe has still largely maintained its protectionism policies against Japanese cars, though theirs varies considerably.", "Toyota has always been by far Japan's largest automaker, and it recently overtook perennial world leader GM in both production and sales by early 2008.", "As the most aggressive of Japan's companies when it came to expanding into light trucks and luxury vehicles, this proved largely successful.", "Their high-end brand Lexus became the top-selling luxury marque worldwide in 2000, despite being only started up in 1989.", "Consequently, Toyota's stock price has traded at a much higher premium than other automakers.", "Nissan regained its position on second place, financial difficulties in the late 1990s caused it to lose its place to Honda before.", "Nissan is Japan\u2019s second largest automaker and ranks sixth in the world, behind Toyota, GM, Volkswagen, Ford, and Hyundai." ] ], "gold": "In 2018, Volkswagen Group was the largest automaker in the world for the fifth consecutive year, selling 10.083 million vehicles, just 7,000 more than the Renault-Nissan-Mitsubishi Alliance. However, by 2020, Toyota reclaimed its position as the largest automaker in the world, surpassing Volkswagen.", "prediction 1": "The world's largest automobile company is Nissan. It sold one in nine cars worldwide in 2017, ranking as the world's largest producer of light vehicles by sales, with 10,608,366 units sold. The Renault\u2013Nissan\u2013Mitsubishi Alliance is a Franco-Japanese strategic partnership between the automobile manufacturers Renault, based in Paris, France; Nissan, based in Yokohama, Japan; and Mitsubishi Motors, based in Tokyo, Japan, which together sell more than 1 in 9 vehicles worldwide. Toyota has always been by far Japan's largest automaker, and it recently overtook perennial world leader GM in both production and sales by early 2008.", "prediction 2": "There are several automobile manufacturers who are the largest in the world. In terms of sales, the largest are Ford, Toyota, and GM. In terms of sales, the largest is Nissan, and the largest is Mitsubishi.", "prediction 3": "The world's largest automobile company is Nissan Motor Co., the world's largest automobile manufacturer, while Toyota Motor Corporation is the world's largest automaker. Nissan is also the world's largest importer of vehicles, and its sales are the second largest in the world. The world's largest car manufacturer is Toyota, while GM is the world's largest exporter of cars.", "prediction 4": "The biggest automobile company in the world is Renault, the largest automobile manufacturer in the world is Honda, and the largest automobile manufacturer in the world is Nissan. The largest automobile company in the world is Nissan. Toyota is the largest automaker in the world, and is followed by GM, Ford, and Hyundai.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 49 }, { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 478 } ], "missing-info": [], "corrected-prediction": " Toyota has always been by far Japan's largest automaker, and it recently overtook perennial world leader GM in both production and sales by early 2008." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "What is the size of a iphone 7 plus?", "passages": [ [ "IPhone 7", "IPhone 7\n\niPhone 7 and iPhone 7 Plus are smartphones designed, developed, and marketed by", "Apple Inc.", "It is the tenth generation of the iPhone.", "They were announced on September 7, 2016, at the Bill Graham Civic Auditorium in San Francisco by Apple CEO Tim Cook, and were released on September 16, 2016, succeeding the iPhone 6S and iPhone 6S Plus as the flagship devices in the iPhone series.", "Apple also released the iPhone 7 and 7 Plus in numerous countries worldwide throughout September and October 2016.", "They were succeeded as flagship devices by the iPhone 8 and iPhone 8 Plus on September 22, 2017, and the iPhone X on November 3, 2017.", "The iPhone X was discontinued almost a year later on September 12, 2018.", "The iPhone 7's overall design is similar to the iPhone 6S, but introduces new color options (matte black and jet black), water and dust resistance, a new capacitive, static home button, and removes the 3.5\u00a0mm headphone jack.", "The device's internal hardware also received upgrades, including a heterogeneous quad-core system-on-chip with improved system and graphics performance, and upgraded 12\u00a0megapixel rear-facing cameras with optical image stabilization on all models and an additional telephoto lens on the iPhone 7 Plus model to provide enhanced zoom capabilities.", "Reception of the iPhone 7 was mixed." ] ], "gold": "The iPhone 7 and iPhone 7 Plus are smartphones designed, developed, and marketed by Apple Inc. They are the tenth generation of the iPhone. The height of the Plus is 6.23 in, width 3.07 in, the depth 0.29 in, and the mass is 6.6 oz. ", "prediction 1": "The iPhone 7 and iPhone 7 Plus are smartphones designed, developed, and marketed by Apple Inc. It is the tenth generation of the iPhone. The iPhone 7's overall design is similar to the iPhone 6S, but introduces new color options (matte black and jet black), water and dust resistance, a new capacitive, static home button, and removes the 3.5 mm headphone jack. The iPhone 7 Plus's screen is 4.7 inches in diagonal.\n", "prediction 2": "The iPhone 7 and iPhone 7 Plus are smartphones designed, developed, and marketed by Apple Inc. It is the tenth generation of the iPhone and the company's flagship products. A larger iPhone 7 Plus is available in eight colors, as well as two different bands of colours.", "prediction 3": "The iPhone 7 Plus is the tenth generation flagship device from Apple Inc. and its successor the iPhone. The iPhone 7's overall design is similar to the iPhone 6S, but introduces new color options (matte black and jet black), water and dust resistance, a new capacitive, static home button, and removes the 3.5 mm headphone jack. It is slightly bigger than the iPhone 6 Plus. An iphone 7 Plus has a screen that is 23 percent larger than that of an iPhone 6S, but has the same specs as the iPhone 7 Plus are identical to that are identically.", "prediction 4": "There are two sizes of iPhone 7 Plus. The iPhone 7 is larger than the iPhone 7 Plus by way of its larger display and dual sim card slots. The size of this model is 5.5-inch and the capacity of this model is 64GB.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 361 }, { "error type": "Unverifiable", "explanation": "", "start": 362, "end": 416 } ], "missing-info": [], "corrected-prediction": "The iPhone 7 and iPhone 7 Plus are smartphones designed, developed, and marketed by Apple Inc. It is the tenth generation of the iPhone.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the attendance of the indianapolis 500?", "passages": [ [ "Indianapolis 500", "They instead chose a contest, as the estimated distance a race car could run before dark descended on the track, and a spectacular purse of $US25,000, equivalent to of pure gold.", "The combination allowed the track to rapidly acquire a privileged status for automobile races.", "The first \"500\" was held at the Speedway on Decoration Day (as Memorial Day was known from its inception in 1868 to 1967 when Federal Law made Memorial Day the official name), May 30, 1911, run to a maximum engine size formula.", "It saw a field of 40 starters, with Harroun piloting a Marmon Model 32-based \"Wasp\" racer\u2014outfitted with his invention, the rear view mirror.", "Harroun (with relief from Cyrus Patschke) was declared the winner, although Ralph Mulford protested the official result.", "Eighty thousand spectators were in attendance, and an annual tradition had been established.", "Many considered Harroun to be a hazard during the race, as he was the only driver in the race driving without a riding mechanic, who checked the oil pressure and let the driver know when traffic was coming.", "In 1912, the purse was raised to US$50,000.", "The field was limited to 33 (where it remains) and a riding mechanic was made mandatory.", "This second event was won by Joe Dawson in a National, after Ralph de Palma's Mercedes broke." ], [ "Indianapolis 500", "Indianapolis 500\n\nThe Indianapolis 500-Mile Race (better known as the Indianapolis 500) is an automobile race held annually at Indianapolis Motor Speedway (IMS) in Speedway, Indiana, United States, an enclave suburb of Indianapolis, Indiana.", "The event is held over Memorial Day weekend in late May.", "It is contested as part of the Verizon INDYCAR Series, the top level of American Championship Car racing, an open-wheel open-cockpit formula colloquially known as \"Indy Car Racing\".", "The name of the race is often shortened to Indy 500, and the track itself is nicknamed \"the Brickyard\", as the racing surfacing was paved in brick in the fall of 1909.", "The event, billed as \"The Greatest Spectacle in Racing\", is considered part of the Triple Crown of Motorsport, which comprises three of the most prestigious motorsports events in the world, also including the Monaco Grand Prix and the 24 Hours of Le Mans.", "The official attendance is not disclosed by Speedway management, but the permanent seating capacity is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000.", "The inaugural race was held in 1911 and was won by Ray Harroun.", "The event celebrated its 100th anniversary in 2011, and the 100th running was held in 2016.", "Will Power is the current champion." ], [ "Indianapolis 500", "To avoid confusion between the 100th anniversary, and the actual number of times the race has been run, references to the ordinal during the \"Centennial Era\" were curtailed.", "Six years later, in 2016, the race celebrated its 100th running with about 350,000 in attendance.", "Female participation of any sort at Indianapolis was discouraged and essentially banned throughout the first several decades of competition.", "As such, female reporters were not even allowed in the pit area until 1971.", "There have been nine female drivers to qualify, starting with Janet Guthrie in 1977.", "Sarah Fisher has competed nine times, the most of any woman.", "Danica Patrick led 19 laps in the 2005 race and ten laps in the 2011 race, the only times a woman has led laps during the race.", "Pippa Mann has raced in Indy five consecutive times between 2013 and 2017.", "From 1911 to 1955, the race was organized under the auspices of the AAA Contest Board.", "Following the 1955 Le Mans disaster, AAA dissolved the Contest Board to concentrate on its membership program aimed at the general motoring public.", "Speedway owner Tony Hulman founded USAC in 1956, which took over sanctioning of the race and the sport of Championship racing.", "From 1950 to 1960, the Indianapolis 500 also counted toward the FIA's World Championship of Drivers (now synonymous with Formula One), although few drivers participated in the other races of that series." ] ], "gold": "The Indianapolis 500 is an annual automobile race held at the Indianapolis Motor Speedway in Speedway, Indiana, United States. The permanent seating capacity of the speedway is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000. The attendance of the original Indianapolis 500 was eighty thousand. The attendance of the Indianapolis 500 during its 100th running in 2016 was about 350,000.", "prediction 1": "The Indianapolis 500-Mile Race is an automobile race held annually at Indianapolis Motor Speedway in Speedway, Indiana, United States, an enclave suburb of Indianapolis. The official attendance is not disclosed by Speedway management, but the permanent seating capacity is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000. The first Indianapolis 500 was held at the Speedway on Decoration Day in 1911, run to a maximum engine size formula. The inaugural race was held in 1911 and was won by Ray Harroun. The event celebrated its 100th anniversary in 2011, and the 100th running was held in 2016 with about 350,000 in attendance.", "prediction 2": "The Indianapolis 500-Mile Race, also known as the Indy 500, is an automobile race held annually at Indianapolis Motor Speedway (IMS) in Speedway, Indiana, United States, an enclave suburb of Indianapolis, Indiana. The official attendance is not disclosed by Speedway management, but the permanent seating capacity is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000.", "prediction 3": "The Indianapolis 500-Mile Race, also known as the Indianapolis 500, is an automobile race held annually at Indianapolis Motor Speedway in Speedway, Indiana, United States, an enclave suburb of Indianapolis. From 1911 to 1955, the race was organized under the auspices of the AAA Contest Board. In 1955, the Indianapolis 500 was expanded to include a new oval track. The permanent seating capacity was increased to 250,000, and infield patrons raised the race-day attendance to approximately 300,000. In 2016, the official attendance was approximately 300,000 people.", "prediction 4": "The Indianapolis 500-Mile Race is an automobile race held annually at Indianapolis Motor Speedway, Indiana, United States. The official attendance is not disclosed by Speedway management, but the permanent seating capacity is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000. In 2016, the race celebrated its 100th running with about 350,000 in attendance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 485 }, { "error type": "Irrelevant", "explanation": "", "start": 486, "end": 549 } ], "missing-info": [], "corrected-prediction": "The Indianapolis 500-Mile Race is an automobile race held annually at Indianapolis Motor Speedway in Speedway, Indiana, United States. The permanent seating capacity is upwards of 250,000, and infield patrons raise the race-day attendance to approximately 300,000. The event celebrated its 100th anniversary in 2011, and the 100th running was held in 2016 with about 350,000 in attendance." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Just call me angel in the morning original singer?", "passages": [ [ "Angel of the Morning", "Taylor produced a recording of the song with Evie Sands, but the financial straits of Cameo-Parkway Records, which had Sands on their roster, reportedly prevented either that version's release or its distribution.", "Other early recordings of the song were made in 1967 by Danny Michaels for Lee Hazlewood's LHI label and by UK vocalist Billie Davis.", "The song finally became a hit in 1968 through a recording by Merrilee Rush, made that January at American Sound Studios in Memphis, with Chips Moman and Tommy Cogbill producing.", "Rush had come to Memphis through the group she fronted, the Turnabouts, being the opening act for a Paul Revere and the Raiders tour.", "While in Memphis, the Raiders recorded the album \"Going to Memphis\" at American Sound Studios, an association which led to Rush's discovery by Tommy Cogbill, who had been hoping to find the right voice for \"Angel of the Morning\"\u2014he had kept a tape of the demo of that song constantly in his pocket for several months.", "Rush recorded the song and the tracks which would compose her \"Angel of the Morning\" album with the American Sound house band, even though the single and the album would be credited to the group \"Merrilee Rush & the Turnabouts.\"" ], [ "Angel of the Morning", "The single version was released in February 1968, and reached the Top 10 on the \"Billboard\" Hot 100 that June, peaking at No. 7.", "A No. 1 hit in Canada, Australia and New Zealand, and also gave Rush a hit in the Netherlands (No. 4).", "The song earned Rush a Grammy nomination for Best Contemporary-Pop Vocal Performance, Female.", "Rush recorded a new version of the song for her 1977 eponymous album release.", "(Rush's version of \"Angel of the Morning\" would be featured on the soundtrack of the 1999 film \"Girl, Interrupted,\" whose time frame is 1967 and 1968, in which author-composer Chip Taylor's niece Angelina Jolie had a starring role.)", "In the United Kingdom, where Rush's version stalled at No. 55, a rendition by P. P. Arnold, who had sung background on the 1967 Billie Davis version, reached No. 29 in August 1968.", "In 1970 a rendition by Connie Eaton reached No. 34 on the \"Billboard\" C&W charts.", "In 1977, Mary Mason also had a UK Top 30 hit with her version, which was actually a medley of two Chip Taylor songs, \"Angel of the Morning\" and \"Any Way That You Want Me,\" reaching No. 27." ] ], "gold": "The song Angel of the Morning was composed in 1967 by Chip Taylor. Taylor produced a recording of this song with Evie Sands, but the financial straits of Cameo-Parkway Records, which had Sands on their roster, led to a highly limited single release and no promotion. The song then first became a hit in 1968 through a recording by Merrilee Rush. Rush's version of Angel of the Morning was released in February 1968 and reached the Top 10 on the Billboard Hot 100 that June, peaking at number 7. Additionally, Angel of the Morning earned Rush a Grammy nomination for Best Contemporary-Pop Vocal Performance, Female.", "prediction 1": "The song \"Angel of the Morning\" was originally sung by Billie Davis in 1967, but was recorded by Merrilee Rush in January 1968.", "prediction 2": "There are several unauthorized recordings of the song \"Angel of the Morning.\" In 1967, Evie Sands recorded a version of the song with Danny Michaels for Lee Hazlewood's LHI label and in 1967, UK vocalist Billie Davis recorded a version of the song with P.P. Arnold, who had sung background on the 1967 Billie Davis version, reaching No. 29 in August 1968. In 1968, Merrilee Rush recorded a new version of the song for her January 1968 album, with Chips Moman and Tommy Cogbill producing.", "prediction 3": "There were several early recordings of Angel of the Morning. The 1967 version was recorded by Evie Sands and a 1967 version was recorded by Merrilee Rush.", "prediction 4": "There were several original singers of Angel of the Morning. In 1967, Billie Davis sang the song as background for Danny Michaels' recording of the song. In 1968, Merrilee Rush sang a version of the song as background for Danny Michaels' recording. There was also a version of the song as background for Billie Davis.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 36, "end": 67 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 85, "end": 93 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Taylor produced a recording of the song with Evie Sands, but the financial straits of Cameo-Parkway Records, which had Sands on their roster, reportedly prevented either that version's release or its distribution. The song finally became a hit in January 1968 through a recording by Merrilee Rush. The single version was released in February 1968, and reached the Top 10 on the \"Billboard\" Hot 100 that June, peaking at No. 7. The song earned Rush a Grammy nomination for Best Contemporary-Pop Vocal Performance, Female." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who recorded don't think twice it's alright?", "passages": [ [ "Don't Think Twice, It's All Right", "Don't Think Twice, It's All Right\n\n\"Don't Think Twice, It's All Right\" is a song written by Bob Dylan in 1962, recorded on November 14 that year, and released on the 1963 album \"The Freewheelin' Bob Dylan\" and as a single.", "In the liner notes to the original release, Nat Hentoff calls the song \"a statement that maybe you can say to make yourself feel better\u00a0...", "as if you were talking to yourself.\"", "It was written around the time that Suze Rotolo indefinitely prolonged her stay in Italy.", "The melody is based on the public domain traditional song \"Who's Gonna Buy Your Chickens When I'm Gone\" and was taught to Dylan by folksinger Paul Clayton, who had used it in his song \"Who's Gonna Buy You Ribbons When I'm Gone?\"", "As well as the melody, a couple of lines were taken from Clayton's \"Who's Gonna Buy You Ribbons When I'm Gone?", "\", which was recorded in 1960, two years before Dylan wrote \"Don't Think Twice\"." ], [ "Don't Think Twice, It's All Right", "Lines taken word-for-word or slightly altered from the Clayton song are, \"T'ain't no use to sit and wonder why, darlin',\" and, \"So I'm walkin' down that long, lonesome road.\"", "On the first release of the song, instead of \"So I'm walkin' down that long, lonesome road babe, where I'm bound, I can't tell\" Dylan sings \"So long, honey babe, where I'm bound, I can't tell\".", "The lyrics were changed when Dylan performed live versions of the song and on cover versions recorded by other artists.", "In addition to its original release, the song has appeared on several of Dylan's greatest hits compilations, including \"Bob Dylan's Greatest Hits Vol. II\" (1971), \"The Best of Bob Dylan\" (1997), and \"The Essential Bob Dylan\" (2000).", "Another version of the song, recorded as a demo for Dylan's music publisher M. Witmark & Sons in 1963, was included on two releases in Columbia's \"Bootleg Series\": \"\" (2005) and \"\" (2010)." ], [ "Don't Think Twice, It's All Right", "with Matt Nathanson and Mike Ness, The Kingston Trio, David Wiffen, Billy Paul, guitarist Lenny Breau, Ryan Montbleau, John Mayer, Albert Hammond Jr., The Allman Brothers Band, Emilie-Claire Barlow, Cock Robin, Gregory and the Hawk, Eddie from Ohio, Barbara Dickson, Chris Thile, Brad Mehldau, Kronos Quartet, Drew Holcomb and The Neighbors, Milky Chance, Eastern Conference Champions, Post Malone, Jess & Matt, Lill Lindfors, and Nick Takenobu Ogawa.", "The Peter, Paul and Mary cover was the definitive single, reaching #9 pop Billboard Hot 100, #2 easy listening on Billboard's charts.", "Eric Clapton performed, to critical acclaim, a blues rendition of the song at the 1992 30th Anniversary Concert Celebration in Dylan's honor.", "The Four Seasons released a cover of the song as a single in 1965 (with the title \"Don't Think Twice\") under the pseudonym The Wonder Who?", "Their \"joke\" version reached the #12 position on the \"Billboard\" Hot 100 chart, and eventually sold one million copies." ] ], "gold": "\"Don't Think Twice, It's All Right\" is a song written by Bob Dylan, produced by John Hammond and recorded by Columbia Records on November 14, 1963. It was included on the 1963 album The Freewheelin' Bob Dylan. In addition to its original release, the song has appeared on several of Dylan's greatest hits compilations, including Bob Dylan's Greatest Hits Vol. II in 1971, The Best of Bob Dylan in 1997, and The Essential Bob Dylan in 2000. ", "prediction 1": "Don't Think Twice, It's All Right is a song written by Bob Dylan in 1962, recorded on November 14, that year, and released on the 1963 album The Freewheelin' Bob Dylan and as a single. The Kingston Trio, David Wiffen, Billy Paul, Lenny Breau, Ryan Montbleau, John Mayer, Albert Hammond Jr., The Allman Brothers Band, Emilie-Claire Barlow, Drew Holcomb and The Neighbors, Drew Holcomb and Barry Peggy Peggy Lee \u2013Hitch, and the Four Seasons released a cover of the song as a single in 1965 under the pseudony The Wonder Who? Their \"joke\" reached the #12 position on the \"Billboard Hot 100\" position on the \"Billboard\" Hot 100 chart, and eventually sold one million copies.", "prediction 2": "Don't Think Twice, It's All Right is a song written by Bob Dylan in 1962, recorded on November 14 that year, and released on the 1963 album The Freewheelin' Bob Dylan and as a single. It was released by Matt Nathanson and Mike Ness, The Kingston Trio, David Wiffen, Billy Paul, Lenny Breau, Ryan Montbleau, John Mayer, Albert Hammond Jr., The Allman Brothers Band, Emilie-Claire Barlow, Drew Holcomb and the Neighbors, Drew Holcomb and the Neighbors, The Four Seasons released a cover of the song as a single in 1965 under the pseudony The Wonder Who?", "prediction 3": "Don't Think Twice, It's All Right is a song written by Bob Dylan in 1962, recorded on November 14 that year, and released on the 1963 album The Freewheelin' Bob Dylan and as a single. The Kingston Trio, David Wiffen, Billy Paul, and Ryan Montbleau recorded the song. The Four Seasons released a cover of the song as a single in 1965, under the pseudonym The Wonder Who? The song was released as an instrumental single in 1967.", "prediction 4": "The song Don't Think Twice, It's All Right was written by Bob Dylan in 1962, recorded on November 14, that year, and released on the 1963 album The Freewheelin' Bob Dylan and as a single. There are several cover versions of the song. The Peter, Paul and Mary cover was the definitive single, reaching #9 pop Billboard Hot 100, #2 easy listening on Billboard's charts. In 1965, The Four Seasons released a cover of the song as a single under the pseudonym The Wonder Who? Their \"joke\" reached the #12 position on the Billboard Hot 100 chart, and eventually sold one million copies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 522 }, { "error type": "Irrelevant", "explanation": "", "start": 523, "end": 670 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Don't Think Twice, It's All Right is a song written by Bob Dylan in 1962, recorded on November 14, that year, and released on the 1963 album The Freewheelin' Bob Dylan and as a single. In addition to its original release, the song has appeared on several of Dylan's greatest hits compilations, including \"Bob Dylan's Greatest Hits Vol. II\" (1971), \"The Best of Bob Dylan\" (1997), and \"The Essential Bob Dylan\" (2000)." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "Who won the governor's race in ga?", "passages": [ [ "2018 Georgia gubernatorial election", "2018 Georgia gubernatorial election\n\nThe 2018 Georgia gubernatorial election took place on November 6, 2018, concurrently with other statewide and local elections to elect the next Governor of the U.S. state of Georgia.", "Incumbent Republican Governor Nathan Deal was term-limited and thus could not seek re-election to a third consecutive term.", "The primary elections were held on May 22, 2018, and a primary runoff was held on July 24, 2018, between Republican candidates Casey Cagle and Brian Kemp, with Kemp winning the runoff election.", "The Democratic nominee was Stacey Abrams, the Republican nominee was Brian Kemp, and the Libertarian nominee was Ted Metz.", "If no candidate had gained a simple majority of the votes, a runoff election between the top two candidates would have been held four weeks later on December 4, 2018.", "On November 7, Kemp declared victory over Abrams with 50.3% of the vote versus her 48.7%, while Libertarian Ted Metz trailed behind both with 0.9%.", "The following morning, Kemp resigned as Secretary of State.", "On November 13, 2018, U.S. District Court Judge Leigh Martin May ruled that Gwinnett County violated the Civil Rights Act in its rejection of absentee ballots after U.S. District Court Judge Amy Totenberg ruled the previous day that the votes must be counted and preserved." ], [ "Nathan Deal", "Nathan Deal\n\nJohn Nathan Deal (born August 25, 1942) is an American attorney and politician serving as the 82nd and current Governor of Georgia since 2011.", "He was elected to the United States House of Representatives as a member of the Democratic Party in 1992 and switched to the Republican Party in 1995.", "On March 1, 2010, Deal announced his resignation from Congress to run for Governor of Georgia.", "Deal faced a crowded field of candidates in the July Republican primary election, ultimately facing former Georgia Secretary of State Karen Handel in a tightly contested August 10, 2010 primary runoff election, and won by fewer than 2500 votes.", "The following day, Handel declined to pursue a recount and conceded.", "On November 2, Democratic opponent Roy Barnes called to concede the race for governor of Georgia, making Deal the governor-elect to succeed term-limited Sonny Perdue in 2011.", "Deal won his re-election campaign for governor in 2014.", "He will be succeeded by Governor-elect Brian Kemp.", "Deal was born in the town of Millen and grew up on a farm in Sandersville.", "His parents, Mary (n\u00e9e Mallard) and Noah Jordan Deal, were teachers.", "He attended Mercer University in Macon, where he earned his bachelor and law degrees with honors.", "After he earned his Juris Doctor degree in 1966, he went into the United States Army, where he earned the rank of captain." ] ], "gold": "The 2018 Georgia gubernatorial election took place on November 6, 2018. Republican Secretary of State Brian Kemp won the election, defeating Democratic former State Representative Stacey Abrams by less than 55,000 votes out of almost 4 million votes cast. Kemp was preceded in the Governor's office by Nathan Deal, who won the Georgia gubernatorial election in 2010 and was re-elected in 2014. ", "prediction 1": "The 2018 Georgia gubernatorial election took place on November 6, 2018, concurrently with other statewide and local elections to elect the next Governor of the U.S. state of Georgia. Incumbent Republican Governor Nathan Deal was term-limited and thus could not seek re-election to a third consecutive term. The Democratic nominee was Stacey Abrams, the Republican nominee was Brian Kemp, and the Libertarian nominee was Ted Metz.", "prediction 2": "Brian Kemp won the governor's race in Georgia, with Brian Deal winning his reelection campaign in 2014.", "prediction 3": "The Georgia governor's race in 2018 was held on November 6, 2018 and took place concurrently with other statewide and local elections to elect the next governor of the U.S. state of Georgia. Republican Governor Nathan Deal was term-limited and thus could not seek re-election to a third consecutive term. Democratic nominee Stacey Abrams, the Republican nominee Brian Kemp, and the Libertarian nominee Ted Metz won the runoff election.", "prediction 4": "The 2018 Georgia gubernatorial election took place on November 6, 2018, concurrently with other statewide and local elections to elect the next Governor of the U.S. state of Georgia. Incumbent Republican Governor Nathan Deal was term-limited and thus could not seek re-election to a third consecutive term. John Nathan Deal, an American attorney and politician, defeated Karen Handel, the former Georgia Secretary of State, in a tightly contested August 10, 2010, primary runoff election and won by fewer than 2500 votes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 388, "end": 429 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The 2018 Georgia gubernatorial election took place on November 6, 2018. Republican Secretary of State Brian Kemp won the election, defeating Democratic former State Representative Stacey Abrams with 50.3% of the vote versus her 48.7%. Nathan Deal served as the 82nd and current Governor of Georgia since 2011. Deal won his re-election campaign for governor in 2014." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does dragon ball super episode 110 come out?", "passages": [ [ "Dragon Ball", "Dragon Ball\n\n, sometimes styled as \"Dragonball\", is a Japanese media franchise created by Akira Toriyama in 1984.", "The initial manga, written and illustrated by Toriyama, was serialized in \"Weekly Sh\u014dnen Jump\" from 1984 to 1995, with the 519 individual chapters collected into 42 \"tank\u014dbon\" volumes by its publisher Shueisha.", "\"Dragon Ball\" was initially inspired by the classical Chinese novel \"Journey to the West\".", "The series follows the adventures of the protagonist, Son Goku, from his childhood through adulthood as he trains in martial arts and explores the world in search of the seven orbs known as the Dragon Balls, which summon a wish-granting dragon when gathered.", "Along his journey, Goku makes several friends and battles a wide variety of villains, many of whom also seek the Dragon Balls.", "Toriyama's manga was adapted and divided into two anime series produced by Toei Animation: \"Dragon Ball\" and \"Dragon Ball Z\", which together were broadcast in Japan from 1986 to 1996.", "Additionally, the studio has developed 19 animated feature films and three television specials, as well as two anime sequel series titled \"Dragon Ball GT\" (1996\u20131997) and \"Dragon Ball Super\" (2015\u20132018)." ], [ "Dragon Ball", "\"Dragon Ball GT\" and \"Dragon Ball Heroes\" are not originated from any direct source material from Toriyama, being fully created by their respective animation studios.", "\"Dragon Ball Super\" was released parallel to (and many times ahead of) the manga of the same name, due to the fact that they were both based on the same outline by Toriyama for the story of \"Super\".", "Toei Animation produced an anime television series based on the first 194 manga chapters, also titled \"Dragon Ball\".", "The series premiered in Japan on Fuji Television on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes.", "Instead of continuing the anime as \"Dragon Ball\", Toei Animation decided to carry on with their adaptation under a new name and asked Akira Toriyama to come up with the title.", "picks up five years after the first series left off and adapts the final 325 chapters of the manga.", "It premiered in Japan on Fuji Television on April 26, 1989, taking over its predecessor's time slot, and ran for 291 episodes until its conclusion on January 31, 1996.", "Two television specials based on the \"Z\" series were aired on Fuji TV in Japan.", "The first, \"The One True Final Battle ~The Z Warrior Who Challenged Freeza -- Son Goku's Father~\", renamed \"\" by Funimation, was shown on October 17, 1990." ], [ "Cardfight!! Vanguard G: Z", "Cardfight!!", "Vanguard G: Z\n\nCardfight!!", "Vanguard G: Z is the fifth season of \"Cardfight!!", "Vanguard G\" and the ninth and final season overall in the \"Cardfight!!", "Vanguard\" series.", "It began airing in Japan on October 8, 2017.", "A group of six units from Planet Cray, called the \"Apostles\", have invaded Earth.", "Armed with the power of the six Zeroth Dragons, the Apostles aim to revive the sealed Dragon Deity of Destruction, Gyze who attempted to destroy Cray in the past.", "The final battle between the Vanguards and the Dragon Deity of Destruction begins.", "Japanese\n\nOpening theme\nEnding theme\n\nEnglish\n\nOpening theme\n", "Ending theme\n\n\n\n" ] ], "gold": "Episode 110 of Dragon Ball Super, a Japanese manga series which aired in Japan from April 2015 to March 2018, was released in Japan before it was released in the United States. In Japan, the episode came out on October 8, 2017, while in the United States, the episode came out on May 11, 2019.", "prediction 1": "Dragon Ball Super is an anime television series created by Toei Animation. It comes out on September 30, 2015 in Japan. Episode 110 came out on November 2, 2015 in Japan and on December 13, 2015 in the United States.", "prediction 2": "Dragon Ball Super is a Japanese manga series created by Akira Toriyama in 1984. The first episode of the series, Dragon Ball Super, came out on April 5, 2015. The second episode, Dragon Ball Super : The Final Chapter, came out on April 5, 2018.", "prediction 3": "Dragon Ball Super is the 11th episode of the 2015-2019 Dragon Ball Super anime series. Episode 110 of the episode originally came out on April 10, 2021.", "prediction 4": "Dragon Ball Super is a Japanese manga series created by Akira Toriyama in 1984. Episode 110 came out on October 8, 2017, after the end of the first season.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 216 }, { "error type": "Unverifiable", "explanation": "", "start": 91, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 74 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Dragon Ball Super is an anime sequel series which aired in Japan from 2015 to 2018." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "How many athletes does the united states have in the winter olympics this year?", "passages": [ [ "United States at the 2018 Winter Olympics", "United States at the 2018 Winter Olympics\n\nThe United States of America competed at the 2018 Winter Olympics in Pyeongchang, South Korea, from February 9 to 25, 2018.", "The United States had its worst showing at a Winter Olympics since the 1998 Nagano Games, ranking out of the top three in both the gold and total medal count with 9 and 23 medals respectively, and finished fourth in both rankings.", "However, there were some notable successes for the team.", "Jessica Diggins and Kikkan Randall won the first Olympic gold medal in cross-country skiing ever for the United States in the women's team sprint event.", "Skip John Shuster led his team to the United States' first-ever gold medal in curling, winning the men's curling over Sweden.", "The United States women's national ice hockey team also won the gold in the women's ice hockey tournament for the first time since the inauguration of the sport in 1998 over the four-time defending gold medalist Canada in an overtime penalty shootout.", "The United States earned medals in at least one event in 11 different sports, the most of any nation.", "These Games also witnessed the 100th Winter Olympic gold medal for the Americans, won by Shaun White.", "The following is the list of number of competitors participating at the Games per sport or discipline." ], [ "Russia at the 2014 Winter Olympics", "Russia at the 2014 Winter Olympics\n\nRussia competed at the 2014 Winter Olympics in Sochi, from 7 to 23 February 2014 as the host nation.", "As host, Russia participated in all 15 sports, with a team consisting of 232 athletes.", "It is Russia's largest Winter Olympics team to date.", "In preparation for the Games Russian Olympic Committee naturalized a Korean-born short-track speed-skater Ahn Hyun-soo and an American-born snowboarder Vic Wild.", "They won a total of 5 golds and 1 bronze in Sochi.", "Russia's medal count in 2014, 33 (before doping disqualifications), was its highest ever in the Winter Olympics, improving on the 1994 Games, when the Russian team earned 23 medals overall, also beating the Soviet Union's best medal count ever at the Winter Olympics.", "Bobsledder Aleksandr Zubkov was the flag bearer of the Russian team in the Parade of Nations during the opening ceremony.", "Following the Games, it was discovered that Russia's performance has been aided by a wider state-sponsored doping program.", "On December 9, 2016 Canadian lawyer Richard McLaren published the second part of his independent report.", "The investigation found that from 2011 to 2015, more than 1,000 Russian competitors in various sports (including summer, winter, and Paralympic sports) benefited from the cover-up." ] ], "gold": "The United States of America competed at the 2018 Winter Olympics in Pyeongchang, South Korea, from February 9 to 25, 2018, where they had 244 athletes competing. In the 2014 Winter Olympics, the US had 232 athletes participating. In the 2010 Winter Olympics, the US had 212 athletes participating.", "prediction 1": "The United States had a total of 256 athletes compete at the 2018 Winter Olympics, making it the country's largest Winter Olympics team to date. The United States participated in all 15 sports at the 2018 Games, with a total of 258 athletes. The number of athletes in the United States during the 2018 Olympics was 260.", "prediction 2": "The United States competed at the 2018 Winter Olympics, having 48 athletes in total. The team consisted of 76 athletes in 15 sports and included a total of 243 athletes.", "prediction 3": "The United States competed at the 2018 Winter Olympics in Pyeongchang, South Korea, with a team of 232 athletes. This was the largest team that the United States has contested in the Winter Olympics.", "prediction 4": "The United States participated in the Winter Olympics with a total of 102 athletes.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 144 }, { "error type": "Unverifiable", "explanation": "", "start": 145, "end": 241 }, { "error type": "Unverifiable", "explanation": "", "start": 242, "end": 319 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States of America competed at the 2018 Winter Olympics in Pyeongchang, South Korea, from February 9 to 25, 2018. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where was the lord of the rings filmed?", "passages": [ [ "The Lord of the Rings (film series)", "In 2012, however, he described the films as having \"eviscerated\" the book, and criticized the resulting \"commercialisation\" of his father's work.", "As a result of the series' success, Peter Jackson has become a major player in the film business (sometimes called a mogul) in the mold of Steven Spielberg and George Lucas, in the process befriending some industry heavyweights like Bryan Singer and Frank Darabont.", "Jackson has since founded his own film production company, Wingnut Films, as well as Wingnut Interactive, a video game company.", "He was also finally given a chance to remake \"King Kong\" in 2005.", "The film was a critical and box office success, although not as successful as \"The Lord of the Rings\" series.", "Jackson has been called a \"favourite son\" of New Zealand.", "In 2004, Howard Shore toured with \"The Lord of the Rings Symphony\", playing two hours of the score.", "Along with the \"Harry Potter\" films, the series has renewed interest in the fantasy film genre.", "Tourism for New Zealand is up, possibly due to its exposure in the series, with the country's tourism industry waking up to an audience's familiarity.", "In December 2002, opened at the Te Papa museum in Wellington, New Zealand." ], [ "Principal photography of The Lord of the Rings film series", "Principal photography of The Lord of the Rings film series\n\nPrincipal photography for \"The Lord of the Rings\" film trilogy was conducted concurrently in New Zealand for 438 days from October 11, 1999 through to December 22, 2000.", "Pick-up shoots were conducted annually from 2001 to 2003.", "The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown.", "Peter Jackson directed the whole production, while other unit directors included Alun Bollinger, John Mahaffie, Geoff Murphy, Fran Walsh, Barrie Osborne, and Rick Porras.", "Jackson monitored these units with live satellite feeds, and with the added pressure of constant script re-writes and the multiple units handling his vision, he only got around 4 hours of sleep a night.", "Jackson described the production as the world's largest home movie, due to the independence and sense of family.", "Producer Barrie Osborne saw it as a traveling circus.", "Fran Walsh described writing the script for the production as laying the track down in front of a moving train.", "Jackson also described shooting as like organizing an army, with 2,400 people involved at the height of production.", "Due to the remoteness of some of New Zealand's untamed landscapes, the crew would also bring survival kits in case helicopters couldn't reach the location to bring them home in time." ], [ "The Lord of the Rings (film series)", "The Lord of the Rings (film series)\n\nThe Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson.", "They are based on the novel \"The Lord of the Rings\" by J. R. R. Tolkien.", "The films are subtitled \"\" (2001), \"\" (2002) and \"\" (2003).", "They are a New Zealand-American venture produced by WingNut Films and The Saul Zaentz Company and distributed by New Line Cinema.", "The trilogy was one of the biggest and most ambitious film projects ever undertaken.", "It had a budget of $281 to $330 million depending on the source.", "All three films were shot over eight years simultaneously and entirely in Jackson's native New Zealand.", "One in every 160 New Zealanders was part of the production.", "Each film in the series also had special extended editions released on DVD a year after their respective theatrical releases.", "While the films follow the book's general storyline, they do omit some of the novel's plot elements and include some additions to and deviations from the source material." ] ], "gold": "The Lord of the Rings is a series of three epic fantasy adventure films directed by Peter Jackson and based on the novel written by J. R. R. Tolkien. The three films were shot simultaneously and entirely in New Zealand from October 1999 until December 2000, with pick-up shots done from 2001 to 2004. The principle photography for the movie was filmed in New Zealand's conservation areas and national parks. The soundstages for filming on South Island were located in Queenstown, and soundstages for filming on North Island were located in Wellington.", "prediction 1": "The Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson. The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown. Peter Jackson described the production as the world's largest home movie, due to the independence and sense of family. All three films were shot over eight years simultaneously and entirely in Jackson's native New Zealand. The Lord of the Rings trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown.", "prediction 2": "The Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson. They are based on the novel The Lord of the Rings by J. R. R. Tolkien. Principal photography for The Lord of the Rings film trilogy was conducted concurrently in New Zealand for 438 days from October 11, 1999 through to December 22, 2000. Pick-up shoots were conducted annually from 2001 to 2003. The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown.", "prediction 3": "The Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson. The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown. The trilogy was shot over eight years simultaneously and entirely in Jackson's native New Zealand.", "prediction 4": "The Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson. Principal photography for The Lord of the Rings film trilogy was conducted concurrently in New Zealand for 438 days from October 11, 1999 through to December 22, 2000. Pick-up shoots were conducted annually from 2001 to 2003. The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 381 }, { "error type": "Redundant", "explanation": "The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown. ", "start": 486, "end": 651 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Lord of the Rings is a film series consisting of three epic fantasy adventure films directed by Peter Jackson based on the novel \"The Lord of the Rings\" by J. R. R. Tolkien. All three films were shot over eight years simultaneously and entirely in Jackson's native New Zealand from October 11, 1999 through to December 22, 2000. Pick-up shoots were conducted annually from 2001 to 2003. The trilogy was shot at over 150 different locations, with seven different units shooting, as well as soundstages around Wellington and Queenstown." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who calls a special election to fill a vacancy in the senate?", "passages": [ [ "Seventeenth Amendment to the United States Constitution", "New Deal legislation is another example of expanding federal regulation overruling the state legislatures promoting their local state interests in coal, oil, corn and cotton.", "Ure agrees, saying that not only is each Senator now free to ignore his state's interests, Senators \"have incentive to use their advice-and-consent powers to install Supreme Court justices who are inclined to increase federal power at the expense of state sovereignty\".", "Over the first half of the 20th century, with a popularly elected Senate confirming nominations, both Republican and Democratic, the Supreme Court began to apply the Bill of Rights to the states, overturning state laws whenever they harmed individual state citizens.", "The Seventeenth Amendment says a state legislature may permit its governor to make temporary appointments, which last until a special election is held to fill the vacancy.", "Currently, all but four states \u2014 Massachusetts, Oregon, Wisconsin and Oklahoma \u2014 permit such appointments.", "The Constitution does not set out how the temporary appointee is to be selected.", "The Seventeenth Amendment requires a governor to call a special election to fill the vacancy.", "Oklahoma, admitted to statehood in 1907, chose a Senator by legislative election three times: twice in 1907, when admitted, and once in 1908.", "In 1912, Oklahoma reelected Robert Owen by advisory popular vote." ], [ "Article One of the United States Constitution", "If a senator died, resigned, or was expelled, the legislature of the state would appoint a replacement to serve out the remainder of the senator's term.", "If the State Legislature was not in session, its Governor could appoint a temporary replacement to serve until the legislature could elect a permanent replacement.", "This was superseded by the Seventeenth Amendment, which provided for the Popular Election of Senators, instead of their appointment by the State Legislature.", "In a nod to the less populist nature of the Senate, the Amendment tracks the vacancy procedures for the House of Representatives in requiring that the Governor call a special election to fill the vacancy, but (unlike in the House) it vests in the State Legislature the authority to allow the Governor to appoint a temporary replacement until the special election is held.", "Note, however, that under the original Constitution, the Governors of the states were expressly allowed by the Constitution to make temporary appointments.", "The current system, under the Seventeenth Amendment, allows Governors to appoint a replacement only if their state legislature has previously decided to allow the Governor to do so; otherwise, the seat must remain vacant until the special election is held to fill the seat, as in the case of a vacancy in the House." ], [ "Cities of the Philippines", "The two exceptions are: Iloilo City, which had already been deprived of the right to vote for provincial officials in 1959 by virtue of Section 2 of \"RA 2259\", and Zamboanga City, which had been autonomously governed since its creation by virtue of Section 47 of its city charter (\"Commonwealth Act No. 39\").", "By virtue of Section 30 of \"Batas Pambansa Bilang 881\" (\"Omnibus Election Code of the Philippines\"), approved on December 3, 1985, provided that: \"unless their respective charters provide otherwise, the electorate of component cities shall be entitled to vote in the election for provincial officials of the province of which it is a part.\"", "This provision therefore overrides the 1951 Supreme Court decision on \"Teves, et al. v. Commission on Elections\" by providing voters in component cities whose charters are silent on the matter of electing provincial officials the right to again participate in provincial elections.", "\"BP 881\" therefore again enfranchised voters in the cities of Bais and Canlaon (Negros Oriental), and Ozamiz (Misamis Occidental)." ] ], "gold": "In the United States, the governor of the state calls a special election to fill a vacancy in the senate. The Seventeenth Amendment now requires the governor of the state to issue a writ for a special election to fill a vacant Senate seat and state legislatures may also empower the governor to fill a vacancy by a temporary appointment until the winner of the special election is certified. In the Philippines, the Commission on Elections calls a special election to fill a vacancy in the senate. According to the Omnibus Election Code of the Philippines, approved on December 3, 1985, in case of a vacancy in the Batasang Pambansa 18 months or more before a regular election, the Commission on Elections shall call a special election to be held within sixty days after the vacancy occurs; in case parliament is dissolved, the President shall call an election which shall not be held earlier than forty-five nor later than sixty days from the date of such dissolution.", "prediction 1": "The Senate is the highest court chamber in the United States, and the United States Constitution provides that a governor calls a special election to fill a vacancy. By contrast, the House of Representatives requires that the Governor call a special election to fill a vacancy. In the Philippines, the Governor calls a special election to fill a vacancy for the Senate, but the Senate is a bicameral chamber, and the Speaker of the Senate is also able to call a special election to fill the vacancy.", "prediction 2": "The Seventeenth Amendment to the United States Constitution requires that a governor call a special election to fill a vacancy in the Senate. Currently, all but four states permit such appointments, but the Constitution does not set out how the temporary appointee is to be selected. In the Philippines, the Seventeenth Amendment tracks the vacancy procedures for the House of Representatives in requiring that the Governor call a special election to fill the vacancy. In the Philippines, however, the Governor is not required to call a special election, but (unlike in the House), it vests in the State Legislature the authority to allow the Governor to appoint a temporary replacement only if their state legislature has previously decided to allow the Governor to do so; otherwise, the seat must remain vacant until the special election is held to fill the seat is filled.", "prediction 3": "The United States Constitution requires a governor to call a special election to fill a vacancy in the Senate. The current system, under the Seventeenth Amendment, allows Governors to appoint a replacement only if their state legislature has previously decided to allow the Governor to do so; otherwise, the seat must remain vacant until the special election is held to fill the seat, as in the case of a vacancy in the House of Representatives. In the Philippines, the Governor calls a special election to fill the vacancy, in the Senate.", "prediction 4": "According to the United States Constitution, the Senate is an elected body and the governor is responsible for calling a special election to fill a vacancy in the Senate. The Seventeenth Amendment to the United States Constitution requires a governor to call a special election to fill the vacancy. In the Philippines, the Governor is responsible for calling a special election to fill a vacancy in the Senate, and the State Legislature is responsible for allowing the Governor to appoint a temporary replacement until the special election is held.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 166, "end": 277 }, { "error type": "Unverifiable", "explanation": "", "start": 278, "end": 499 } ], "missing-info": [], "corrected-prediction": "The Senate is the highest court chamber in the United States, and the United States Constitution provides that a governor calls a special election to fill a vacancy. In a nod to the less populist nature of the Senate, the Amendment tracks the vacancy procedures for the House of Representatives in requiring that the Governor call a special election to fill the vacancy, but (unlike in the House) it vests in the State Legislature the authority to allow the Governor to appoint a temporary replacement until the special election is held. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the indian flag hoisted for the first time?", "passages": [ [ "Flag of India", "On 13 April 1923, during a procession by local Congress volunteers in Nagpur commemorating the Jallianwala Bagh massacre, the \"Swaraj\" flag with the spinning wheel, designed by Pingali Venkayya, was hoisted.", "This event resulted in a confrontation between the Congressmen and the police, after which five people were imprisoned.", "Over a hundred other protesters continued the flag procession after a meeting.", "Subsequently, on the first of May, Jamnalal Bajaj, the secretary of the Nagpur Congress Committee, started the \"Flag Satyagraha\", gaining national attention and marking a significant point in the flag movement.", "The \"satyagraha\", promoted nationally by the Congress, started creating cracks within the organisation in which the Gandhians were highly enthused while the other group, the \"Swarajists\", called it inconsequential.", "Finally, at the All India Congress Committee meeting in July, 1923, at the insistence of Jawaharlal Nehru and Sarojini Naidu, Congress closed ranks and the flag movement was endorsed.", "The flag movement was managed by Sardar Vallabhbhai Patel with the idea of public processions and flag displays by common people.", "By the end of the movement, over 1500 people had been arrested across all of British India." ], [ "Flag of India", "Subsequently, to avoid sectarian associations with the colour scheme, saffron, white and green were chosen for the three bands, representing courage and sacrifice, peace and truth, and faith and chivalry respectively.", "A few days before India became independent on 15 August 1947, the specially constituted Constituent Assembly decided that the flag of India must be acceptable to all parties and communities.", "A modified version of the \"Swaraj\" flag was chosen; the tricolour remained the same saffron, white and green.", "However, the \"charkha\" was replaced by the Ashoka Chakra representing the eternal wheel of law.", "The philosopher Sarvepalli Radhakrishnan, who later became India's first Vice President and second President, clarified the adopted flag and described its significance as follows:\n\nA number of flags with varying designs were used in the period preceding the Indian Independence Movement by the rulers of different princely states; the idea of a single Indian flag was first raised by the British rulers of India after the rebellion of 1857, which resulted in the establishment of direct imperial rule.", "The first flag, whose design was based on western heraldic standards, were similar to the flags of other British colonies, including Canada and South Africa; its red field included the Union Flag in the upper-left quadrant and a Star of India capped by the royal crown in the middle of the right half." ], [ "Flag of India", "The British parliament discussed public use of the flag, and based on directives from England, the British Indian government threatened to withdraw funds from municipalities and local governments that did not prevent the display of the \"Swaraj\" flag.", "The \"Swaraj\" flag became the official flag of Congress at the 1931 meeting.", "However, by then, the flag had already become the symbol of the independence movement.", "A few days before India gained its independence in August 1947, the Constituent Assembly was formed.", "To select a flag for independent India, on 23 June 1947, the assembly set up an \"ad hoc\" committee headed by Rajendra Prasad and including Maulana Abul Kalam Azad, Sarojini Naidu, C. Rajagopalachari, K. M. Munshi and B. R. Ambedkar as its members.", "On 14 July 1947, the committee recommended that the flag of the Indian National Congress be adopted as the National Flag of India with suitable modifications, so as to make it acceptable to all parties and communities.", "It was also resolved that the flag should not have any communal undertones.", "The spinning wheel of the Congress flag was replaced by the \"Chakra\" (wheel) from the Lion Capital of Ashoka.", "According to Sarvepalli Radhakrishnan, the \"chakra\" was chosen as it was representative of \"dharma\" and law." ] ], "gold": "There have been a number of Indian flags with varying designs. In 1880, the Civil Ensign Indian flag was hoisted for the first time and later, on 22 August 1907, the Flag of Indian Independence was first hoisted. The Swaraj flag, which became the official flag of Congress in 1931, was first hoisted on 13 April 1923. The independent Indian flag was hoisted for the first time on 15 August 1947, the day that India became independent.", "prediction 1": "The Indian flag was first hoisted on 13 April 1923, during a procession by local Congress volunteers in Nagpur commemorating the Jallianwala Bagh massacre. The flag was then replaced by the one designed by Pingali Venkayya and adopted by the Indian National Congress. The flag was then hoisted on 14 July 1947, just a few days before India gained independence in August 1947.", "prediction 2": "The Indian flag was first raised on 13 April 1923 during a procession by local Congress volunteers in Nagpur commemorating the Jallianwala Bagh massacre. On 14 July 1947, the committee that recommended the flag of the Indian National Congress be adopted as the National Flag of India with suitable modifications, so as to make it acceptable to all parties and communities.", "prediction 3": "The Indian flag was first raised in 1857 by the British, during the rebellion of 1857, and during the independence movement on 15 August 1947, the flag was adopted by the Indian National Congress and was hoisted for the first time on 13 April 1923.", "prediction 4": "The flag of India was first hoisted on 13 April 1923, during a procession by local Congress volunteers in Nagpur commemorating the Jallianwala Bagh massacre. This event resulted in a confrontation between the Congressmen and the police, after which five people were imprisoned. Then, on the first of May, Jamnalal Bajaj, the secretary of the Nagpur Congress Committee, started the Flag Satyagraha, gaining national attention and marking a significant point in the flag movement. The flag of India became independent on 15 August 1947, the specially constituted Constituent Assembly decided that the flag of India must be acceptable to all parties and communities. A modified version of the \"Swaraj\" flag was chosen. However, the \"charkha\" was replaced by the Ashoka Chakra representing the eternal wheel of law.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 310 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": " The \"Swaraj\" flag became the official flag of Congress at the 1931 meeting. The Indian flag was first hoisted on 13 April 1923. Just a few days before India gained independence on 15 August 1947, a modified version of the \"Swaraj\" flag was chosen." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the afghanistan war start and end?", "passages": [ [ "War in Afghanistan (2001\u2013present)", "War in Afghanistan (2001\u2013present)\n\n", "The War in Afghanistan (or the U.S. War in Afghanistan), code named Operation Enduring Freedom \u2013 Afghanistan (2001\u201314) and Operation Freedom's Sentinel (2015\u2013present), followed the United States invasion of Afghanistan of 7 October 2001.", "The U.S. was supported initially by the United Kingdom, Canada, and Australia and later by a coalition of over 40 countries, including all NATO members.", "The war's public aims were to dismantle al-Qaeda and to deny it a safe base of operations in Afghanistan by removing the Taliban from power.", "The War in Afghanistan is the second longest war in United States history, behind the Vietnam War.", "Following the September 11 attacks in 2001 on the U.S., which President George W. Bush blamed on Osama bin Laden who was living or hiding in Afghanistan, President Bush demanded that the Taliban hand over Osama bin Laden and expel al-Qaeda; bin Laden had already been wanted by the U.S. since 1998.", "The Taliban declined to extradite him unless they were provided clear evidence of his involvement in the September 11 attacks, and declined demands to extradite others on the same grounds.", "The U.S. dismissed the request for evidence as a delaying tactic, and on 7 October 2001 launched Operation Enduring Freedom with the United Kingdom." ], [ "War in Afghanistan (2001\u2013present)", "Though outgunned and outnumbered, insurgents from the Taliban, Haqqani Network, Hezb-e-Islami Gulbuddin and other groups have waged asymmetric warfare with guerrilla raids and ambushes in the countryside, suicide attacks against urban targets and turncoat killings against coalition forces.", "The Taliban exploited weaknesses in the Afghan government, which is among the most corrupt in the world, to reassert influence across rural areas of southern and eastern Afghanistan.", "In the initial years there was little fighting, but from 2006 the Taliban made significant gains and showed an increased willingness to commit atrocities against civilians.", "ISAF responded in 2006 by increasing troops for counterinsurgency operations to \"clear and hold\" villages and \"nation building\" projects to \"win hearts and minds\".", "Violence sharply escalated from 2007 to 2009.", "While ISAF continued to battle the Taliban insurgency, fighting crossed into neighboring North-West Pakistan.", "Troop numbers began to surge in 2009 continued to increase through 2011 when roughly 140,000 foreign troops operated under ISAF and U.S. command in Afghanistan.", "Of these 100,000 were from the U.S.", "On 1 May 2011, United States Navy SEALs killed Osama bin Laden in Abbotabad, Pakistan.", "In May 2012, NATO leaders commended for withdrawing their forces." ], [ "United States invasion of Afghanistan", "United States invasion of Afghanistan\n\nThe United States invasion of Afghanistan occurred after the September 11 attacks in late 2001, supported by close US allies.", "The conflict is also known as the U.S. war in Afghanistan.", "Its public aims were to dismantle al-Qaeda, and to deny it a safe base of operations in Afghanistan by removing the Taliban from power.", "The United Kingdom was a key ally of the United States, offering support for military action from the start of preparations for the invasion.", "It followed the Afghan Civil War's 1996\u20132001 phase between the Taliban and the Northern Alliance groups, although the Taliban controlled 90% of the country by 2001.", "U.S. President George W. Bush demanded that the Taliban hand over Osama bin Laden and expel al-Qaeda; bin Laden had already been wanted by the FBI since 1998.", "The Taliban declined to extradite him unless given what they deemed convincing evidence of his involvement in the 9/11 attacks and ignored demands to shut down terrorist bases and hand over other terrorist suspects apart from bin Laden.", "The request was dismissed by the U.S. as a meaningless delaying tactic and it launched Operation Enduring Freedom on 7 October 2001 with the United Kingdom.", "The two were later joined by other forces, including the Northern Alliance troops on the ground." ] ], "gold": "The United States invaded Afghanistan in 7 October 2001, marking the beginning of the first phase of the Afghanistan war, in which the United States successfully drove the Taliban from power. The first phase of the war ended on 28 December 2014, when NATO formally ended ISAF combat operations in Afghanistan and officially transferred full security responsibility to the Afghan government. The second phase of the Afghanistan war began on 1 January 2015, the day that the NATO-led Resolute Support Mission began, and continues until present day.", "prediction 1": "The war in Afghanistan, or the U.S. war in Afghanistan, began and ended with the United States invasion of Afghanistan on 7 October 2001 and ended with Operation Enduring Freedom \u2013 Afghanistan on 14 October 2001. The war's public aims were to dismantle al-Qaeda, and to deny it a safe base of operations in Afghanistan by removing the Taliban from power.", "prediction 2": "The War in Afghanistan, also known as the U.S. war in Afghanistan, began and ended on 7 October 2001, when the United States invaded Afghanistan and was supported by close US allies. Its public aims were to dismantle al-Qaeda, and to deny it a safe base of operations in Afghanistan by removing the Taliban from power. The War in Afghanistan is the second longest war in United States history, behind the Vietnam War. It began on 10 September 2001, and ended on 12 September 2014.", "prediction 3": "The War in Afghanistan, also known as the U.S. War in Afghanistan, began and ended on 7 October 2001. The United States invaded Afghanistan after the September 11 attacks in late 2001, supported by close US allies. The war's public aims were to dismantle al-Qaeda and to deny it a safe base of operations in Afghanistan by removing the Taliban from power.", "prediction 4": "The war in Afghanistan, or the U.S. war in Afghanistan, started and ended on 7 October 2001. It took place after the United States invasion of Afghanistan. The war's public aims were to dismantle al-Qaeda, and to deny it a safe base of operations in Afghanistan by removing the Taliban from power.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 62, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 55 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 141, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 354 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The war in Afghanistan began with the United States invasion of Afghanistan on 7 October 2001. It is still on going in the present." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who wrote somebody that i used to know?", "passages": [ [ "Somebody That I Used to Know", "Somebody That I Used to Know\n\n\"Somebody That I Used to Know\" is a song written by Belgian-Australian singer-songwriter Gotye, featuring New Zealand singer Kimbra.", "The song was released in Australia and New Zealand by on 5 July 2011 as the second single from Gotye's third studio album, \"Making Mirrors\" (2011).", "It was later released by Universal Music in December 2011 in the United Kingdom, and in January 2012 in the United States and Ireland.", "\"Somebody That I Used To Know\" was written and recorded by Gotye at his parents' house on the Mornington Peninsula in Victoria and is lyrically related to the experiences he has had with relationships.", "\"Somebody That I Used to Know\" is a mid-tempo ballad.", "It samples Luiz Bonf\u00e1's instrumental \"Seville\" from his 1967 album \"Luiz Bonfa Plays Great Songs\".", "The song received a positive reception from critics, who noted the similarities between the song and works by Sting, Peter Gabriel, and American folk band Bon Iver.", "In Australia, the song won the Triple J Hottest 100 poll at the end of 2011, as well as ARIA Awards for song of the year and best video, while Kimbra was voted best female artist and Gotye was named best male artist and producer of the year." ], [ "Somebody That I Used to Know (True Blood)", "Somebody That I Used to Know (True Blood)\n\n\"Somebody That I Used to Know\" is the eighth episode of the fifth season of HBO's \"True Blood\", and the 56th episode of the series overall.", "It was written by Mark Hudis and directed by cast member Stephen Moyer, who plays vampire Bill Compton.", "The episode first aired on July 29, 2012 on HBO near the end of the season.", "This episode also marks the directing debut of Moyer.", "The season (and thus its episodes) is loosely based on \"The Southern Vampire Mysteries\" fifth book \"Dead as a Doornail\".", "Moyer noted that it was \"fun\" directing his fellow castmates though his wife joked and called him a \"bossy\" director.", "Moyer stated it was fun although quite unusual for him to direct them (the castmembers) himself prior to everything going on in the season.", "An emotional Luna unintentionally shifts into Sam's form and gets stuck.", "The Authority celebrate the entirely new direction it has chosen to take regarding Lilith, while Eric tries to convince Bill and Nora, about getting a message from Godric.", "Bill is shaken by a memory from 1910.", "Jason convinces Sookie not to dump her faerie ability." ], [ "True Blood", "True Blood\n\nTrue Blood is an American dark fantasy horror\ntelevision series produced and created by Alan Ball and based on \"The Southern Vampire Mysteries\", a series of novels by Charlaine Harris.", "The series revolves around Sookie Stackhouse (Anna Paquin), a telepathic waitress living in the rural town of Bon Temps, Louisiana.", "Two years after the invention of a synthetic blood branded \u201cTru Blood,\u201d vampires are able to \"come out of the coffin\" and allow their presence to be known to mankind.", "Now they are struggling for equal rights and assimilation, while anti-vampire organizations begin to gain power.", "Sookie's world is turned upside down when she falls in love with 173-year-old vampire Bill Compton (Stephen Moyer) and for the first time must navigate the trials, tribulations, and terrors of intimacy and relationships.", "The show was broadcast on the premium cable network HBO, in the United States, and was produced by HBO in association with Ball's production company, Your Face Goes Here Entertainment.", "The series premiered on September 7, 2008 and concluded on August 24, 2014, comprising seven seasons and 80 episodes.", "The first five seasons received highly positive reviews, and both nominations and wins for several awards, including a Golden Globe and an Emmy." ], [ "Gotye", "Gotye\n\nWouter \"Wally\" De Backer (born 21 May 1980), known professionally as Gotye ( ), is a Belgian-born Australian multi-instrumentalist and singer-songwriter.", "The name \"Gotye\" is a pronunciation respelling of \"Gauthier\", the French cognate of Gotye's given Dutch name \"Wouter\" (English \"Walter\", hence the nickname \"Wally\").", "Gotye has released three studio albums independently and one album featuring remixes of tracks from his first two albums.", "He is a founding member of the Melbourne indie-pop trio The Basics, who have independently released four studio albums and numerous other titles since 2002.", "His voice has been compared to those of Peter Gabriel and Sting.", "Gotye's 2011 single \"Somebody That I Used to Know\" reached number one on the \"Billboard\" Hot 100, making him the fifth Australian-based artist to do so and the second born in Belgium (after The Singing Nun in 1963).", "He has won five ARIA Awards and received a nomination for an MTV EMA for Best Asia and Pacific Act.", "On 10 February 2013, he won three Grammy Awards at the 55th Annual Grammy Awards Show: Record of the Year and Best Pop Duo/Group Performance for \"Somebody That I Used to Know\" and Best Alternative Music Album for \"Making Mirrors\"." ] ], "gold": "The title \"Somebody That I Used to Know\" could refer to either a song or a television show episode. The song \"Somebody That I Used to Know\" was written by Belgian-Australian singer-songwriter Wouter \"Wally\" De Backer, who is also known by stage name Gotye. The song was released in Australia and New Zealand by Eleven Music in July 2011 as the second single from Gotye's third studio album, Making Mirrors. \"Somebody That I Used to Know\" is also the title of the eighth episode of the fifth season of HBO's True Blood, an American fantasy horror drama television series based on the books by Charlaine Harris, and was written by Mark Hudis.", "prediction 1": "Somebody That I Used to Know is a song written and recorded by Belgian-Australian singer-songwriter Gotye, featuring New Zealand singer Kimbra. The song was released in Australia and New Zealand by on 5 July 2011 as the second single from Gotye's third studio album, Making Mirrors. It was later released by Universal Music in December 2011 in the United Kingdom, and in January 2012 in the United States and Ireland. Somebody That I Used to Know is the eighth episode of the fifth season of HBO's True Blood. It was written by Mark Hudis and directed by cast member Stephen Moyer, who plays vampire Bill Compton.\n", "prediction 2": "The song, Somebody That I Used To Know, is a song written and produced by Belgian-Australian singer-songwriter Gotye, featuring New Zealand singer Kimbra. The song was released in Australia and New Zealand by on 5 July 2011 as the second single from Gotye's third studio album, Making Mirrors. The song received a positive reception from critics, who noted the similarities between the song and works by Sting, Peter Gabriel, and American folk band Bon Iver. Somebody That I Used To Know is the eighth episode of the fifth season of HBO's True Blood, and the 56th episode on the series overall. It was written by Mark Hudis and directed by cast member Stephen Moyer, who plays vampire Bill Compton. It was written by Mark Hudis and directed by cast member Stephen Moyer, who plays vampire Bill Compton.", "prediction 3": "Somebody That I Used to Know is a song written and recorded by Belgian-Australian singer-songwriter Gotye, featuring New Zealand singer Kimbra. The track was released in Australia and New Zealand by Oct 5, 2011 as the second single from Gotye's third studio album, Being There. Somebody That I Used to Know is also a song featured in the 2012 True Blood episode \"Somebody That I Used To Know\", which was written by Mark Hudis.", "prediction 4": "The song \"Somebody That I Used to Know\" was written by Gotye at his parents' house on the Mornington Peninsula in Victoria, Australia. The song was released in Australia and New Zealand by on 5 July 2011 as the second single from Gotye's third studio album, \"Making Mirrors.\" The song was later released by Universal Music in December 2011 in the United Kingdom, and in January 2012 in the United States and Ireland. Somebody That I Used to Know is the eighth episode of the fifth season of HBO's \"True Blood\" and the 56th episode of the series overall.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 417 }, { "error type": "Irrelevant", "explanation": "", "start": 539, "end": 614 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "Somebody That I Used to Know is a song written and recorded by Belgian-Australian singer-songwriter Wouter \"Wally\" De Backer, who is known professionally as Gotye. The song was released in Australia and New Zealand by on 5 July 2011 as the second single from Gotye's third studio album, Making Mirrors. Somebody That I Used to Know is the eighth episode of the fifth season of HBO's True Blood. It was written by Mark Hudis, and is based on a series of novels by Charlaine Harris.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Which tribe has the highest population in nigeria?", "passages": [ [ "Culture of Nigeria", "Culture of Nigeria\n\nThe culture of Nigeria is shaped by Nigeria's multiple ethnic groups.", "The country has 527 languages, seven of them are extinct.", "Nigeria also has over 1150 dialects and ethnic groups.", "The six largest ethnic groups are the Hausa and Fulani in the north, the Igbo in the southeast, and the Yoruba predominate in the southwest, the Tiv people of North Central Nigeria and the Efik - Ibibio.", "The Edo people are most frequent in the region between Yorubaland and Igboland.", "Many of the Edo tend to be Christian.", "This group is followed by the Ibibio/Annang/Efik people of the coastal south southern Nigeria and the Ijaw of the Niger Delta.", "Nigeria's other ethnic groups, sometimes called 'minorities', are found throughout the country but especially in the north and the middle belt.", "The traditionally nomadic Fulani can be found all over West and Central Africa.", "The Fulani and the Hausa are predominantly Muslim while the Igbo are predominantly Christian and so are the Efik, Ibibio, and Annang people.", "The Yoruba are equally likely to be either Christian or Muslim.", "Indigenous religious practices remain important to all of Nigeria's ethnic groups, and frequently these beliefs are blended with Christian beliefs, a practice known as syncretism." ], [ "Boscia senegalensis", "Common names include: \"aizen\" (Mauritania), \"mukheit\" (Arabic), \"hanza\" (Hausa), \"bere\" (Bambara), \"ngigili\" (Fulani), \"mandiarha\" (Berber), \"anza\" (Zarma) and \"taedent\" (Tamasheq).", "The fruits are also known as \"dilo\" (Hausa), \"bokkhelli\" (Arabic), \"gigile\" (Fulani) and \"kanduwi\" (Tamasheq).", "\"Boscia senegalensis\" is a wild species, native to the Sahel region in Africa.", "It has not yet been domesticated.", "It currently grows in: Algeria, Benin, Burkina Faso, Cameroon, Central African Republic, Chad, Ghana, Guinea, Kenya, Mali, Mauritania, Niger, Nigeria, Senegal, Somalia, Sudan, and Togo.", "Ethnobotanical indigenous knowledge contributes to the importance of this plant to the Hausa peoples of Niger and Fulani herders in West Africa.", "During the famine of 1984\u20131985, it was reported that \"B. senegalensis\" was the most widely consumed famine food in both Sudan and Darfur, relied on by over 94% of people in northern Darfur." ], [ "Hausa people", "Hausa people\n\nThe Hausa (autonyms for singular: Bahaushe (m), Bahaushiya (f); plural: Hausawa and general: Hausa; exonyms: Ausa; Francophonic spelling: Haoussa) is the largest ethnic group in Africa and the second largest after Arabic in the Afroasiatic family of languages.", "The Hausa are a diverse but culturally homogeneous people based primarily in the Sahelian and the sparse savanna areas of southern Niger and northern Nigeria respectively, numbering over 70 million people in total with significant naturalised populations in Cameroon, Central African Republic, Republic of the Congo, Ivory Coast, Chad, Togo, Ghana, Sudan, Eritrea, Equatorial Guinea, Gabon, Senegal and the Gambia\n\nPredominantly Hausa-speaking communities are scattered throughout West Africa and on the traditional Hajj route north and east traversing the Sahara, with an especially large population in and around the town of Agadez.", "Other Hausa have also moved to large coastal cities in the region such as Lagos, Port Harcourt, Accra, Abidjan, Banjul and Cotonou as well as to parts of North Africa such as Libya over the course of the last 5,000 years." ] ], "gold": "The Hausa Fulani, an ethnolinguistic group of the Sudan, is the combined tribe with the highest population in Nigeria, making up about 36% of the population. Within the Hausa\u2013Fulani tribe is the Hausa ethnic group, which is the ethnic group with the highest population in Nigeria, numbering over 80 million people.", "prediction 1": "The Hausa are a diverse but culturally homogeneous people based primarily in the Sahelian and the sparse savanna areas of southern Niger and northern Nigeria respectively, numbering over 70 million people in total. The Hausa are also the largest ethnic group in Africa and the second largest after Arabic in the Afroasiatic family of languages. The largest tribe in Nigeria is the Igbo, in the southeast and southeast, and the largest tribe in Nigeria is the Tiv.", "prediction 2": "The Hausa people of Nigeria are a diverse but culturally homogeneous people based primarily in the Sahelian and the sparse savanna areas of southern Niger and northern Nigeria, numbering 70 million people in total. The Hausa are the largest ethnic group in Africa and the second largest after Arabic in the Afroasiatic family of languages. In 2015, the Hausa population was 62.6%, and their population in 2016 was 67.2%.", "prediction 3": "The Hausa are a diverse but culturally homogeneous people based primarily in the Sahelian and the sparse savanna areas of southern Niger and northern Nigeria respectively, numbering 70 million people in total. The Hausa are the largest ethnic group in Africa and the second largest after Arabic in the Afroasiatic family of languages. The Igbo are the largest ethnic group in Nigeria, with over a million people in the south-west and over a million in the southeast. The Tiv tribe has the highest population in Nigeria, followed by the Efik -Ibik -Ibik -Ibo people of the coastal south-suna, Anang and the Efik -Ibibio people of North Central Nigeria. The Hausa are the largest ethnic group in Nigeria.", "prediction 4": "The Hausa are a diverse but culturally homogeneous people based in the Sahelian and the sparse savanna areas of southern Niger and northern Nigeria respectively. They number over 70 million people in total and are the largest ethnic group in Africa. The Tiv people of North Central Nigeria are the people with the highest population in Nigeria. The Hausa are the largest ethnic group in Nigeria.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 345, "end": 463 }, { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 171 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The six largest ethnic groups are the Hausa and Fulani in the north, the Igbo in the southeast, and the Yoruba predominate in the southwest, the Tiv people of North Central Nigeria and the Efik - Ibibio. The Hausa are a diverse but culturally homogeneous people, numbering over 70 million people in total. The Hausa are also the largest ethnic group in Africa and the second largest after Arabic in the Afroasiatic family of languages. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has lay in state at the capitol?", "passages": [ [ "William Rehnquist", "William Rehnquist\n\nWilliam Hubbs Rehnquist (; October 1, 1924 \u2013 September 3, 2005) was an American lawyer and jurist who served on the Supreme Court of the United States for 33 years, first as an Associate Justice from 1972 to 1986, and then as the 16th Chief Justice of the United States from 1986 until his death in 2005.", "Considered a conservative, Rehnquist favored a conception of federalism that emphasized the Tenth Amendment's reservation of powers to the states.", "Under this view of federalism, the court, for the first time since the 1930s, struck down an act of Congress as exceeding its power under the Commerce Clause.", "Born in Shorewood, Wisconsin, Rehnquist pursued a legal career in Phoenix, Arizona after graduating from Stanford Law School.", "He clerked for Associate Justice Robert H. Jackson during the Supreme Court's 1952\u20131953 term and served as a legal adviser for Republican presidential nominee Barry Goldwater in the 1964 election.", "In 1969, President Richard Nixon appointed Rehnquist as Assistant Attorney General of the Office of Legal Counsel.", "In 1971, Nixon nominated Rehnquist to succeed Associate Justice John Marshall Harlan II, and Rehnquist won Senate confirmation that same year.", "Rehnquist quickly established himself as the most conservative member of the Burger Court." ], [ "Harry Blackmun", "Harry Blackmun\n\nHarry Andrew Blackmun (November 12, 1908 \u2013 March 4, 1999) was an American lawyer and jurist who served as an Associate Justice of the Supreme Court of the United States from 1970 until 1994.", "Appointed by Republican President Richard Nixon, Blackmun ultimately became one of the most liberal justices on the Court.", "He is best known as the author of the Court's opinion in \"Roe v. Wade\", which prohibits many state and federal restrictions on abortion.", "Raised in Saint Paul, Minnesota, Blackmun graduated from Harvard Law School in 1932.", "He practiced law in Minneapolis, Minnesota, representing clients such as the Mayo Clinic.", "In 1959, he was appointed to the United States Court of Appeals for the Eighth Circuit by President Dwight D. Eisenhower.", "After the defeat of two previous nominees, President Richard Nixon successfully nominated Blackmun to the Supreme Court to replace Associate Justice Abe Fortas.", "Blackmun and his close friend, conservative Chief Justice Warren Burger, were often referred to as the \"Minnesota Twins,\" but Blackmun drifted away from Burger during their tenure on the court.", "Blackmun retired from the Court during the administration of President Bill Clinton, and was succeeded by Stephen Breyer." ], [ "Lying in state", "Lying in state\n\nLying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects.", "It traditionally takes place in the principal government building of a country, state, or city.", "While the practice differs among countries, a viewing in a location other than the principal government building may be referred to as lying in repose.", "In Canada, official lying in state is a part of a state funeral, an honor generally reserved for former Governors General and former Prime Ministers.", "It is held in the Centre Block of Parliament Hill, in the national capital, Ottawa, Ontario.", "Ex-governors general lie in state in the Senate Chamber while former prime ministers lie in the Hall of Honour.", "During the period of lying in state, the coffins are flanked at each corner by a Guard of honour, made up of four members drawn from the Canadian Forces and Royal Canadian Mounted Police, as well as members of the Governor General's Foot Guards for former governors general, and guards from the parliamentary security forces for former prime ministers.", "Guards stand at each corner with heads bowed and weapons inverted (resting on Arms reversed) with their backs turned towards the casket.", "Provinces may also mount state funerals and have a lying in state for a distinguished former resident." ] ], "gold": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects. Harry Andrew Blackmun, an American lawyer and jurist who served as an Associate Justice of the Supreme Court of the United States from 1970 until 1994, laid in state in 1999. William Hubbs Rehnquist, an American jurist and lawyer who served on the Supreme Court of the United States for 33 years, laid in state in 2005. U.S. Supreme Court Justice Antonin Scalia laid in state in 2016.", "prediction 1": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects. It traditionally takes place in the principal government building of a country, state, or city. In Canada, official lying in state is a part of a state funeral, an honor generally reserved for former Governors General and former Prime Ministers. In the United States, it is the tradition in which the body of a dead official is placed in the Senate Chamber. In the United Kingdom, the tradition of lying in state is a country, it is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects.", "prediction 2": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin to allow the public to pay their respects. It traditionally takes place in the principal government building of a country, state, or city. In Canada, official lying in state is a part of a state funeral, an honor generally reserved for former Governors General and former Prime Ministers. It is held in the Centre Block of Parliament Hill, in the national capital, Ottawa, Ontario.", "prediction 3": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects. It traditionally takes place in the principal government building of a country, state, or city.", "prediction 4": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects. In the United States, it is the tradition in which the body of a dead official is placed in a building, either outside or inside a coffin to allow the public to pay their respects. In Canada, it is the tradition in which former Governors General and former Prime Ministers lie in state in the Senate Chamber while former Prime Ministers lie in the Hall of Honour.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 423 }, { "error type": "Irrelevant", "explanation": "", "start": 424, "end": 535 }, { "error type": "Irrelevant", "explanation": "", "start": 536, "end": 770 } ], "missing-info": [], "corrected-prediction": "Lying in state is the tradition in which the body of a dead official is placed in a state building, either outside or inside a coffin, to allow the public to pay their respects. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Great britain's royal family is an example of a?", "passages": [ [ "Monarchy of the United Kingdom", "The whole island of Ireland continued to be a part of the United Kingdom until 1922, when what is now the Republic of Ireland won independence as the Irish Free State, a separate Dominion within the Commonwealth.", "The Irish Free State was renamed \u00c9ire (or \"Ireland\") in 1937, and in 1949 declared itself a republic, left the Commonwealth and severed all ties with the monarchy.", "Northern Ireland remained within the Union.", "In 1927, the United Kingdom changed its name to the United Kingdom of Great Britain and Northern Ireland, while the monarch's style for the next twenty years became \"of Great Britain, Ireland and the British Dominions beyond the Seas, King, Defender of the Faith, Emperor of India\".", "In the 1990s, republicanism in the United Kingdom grew, partly on account of negative publicity associated with the Royal Family (for instance, immediately following the death of Diana, Princess of Wales).", "However, polls from 2002 to 2007 showed that around 70\u201380% of the British public supported the continuation of the monarchy.", "The sovereign is the Supreme Governor of the established Church of England.", "Archbishops and bishops are appointed by the monarch, on the advice of the prime minister, who chooses the appointee from a list of nominees prepared by a Church Commission." ], [ "Monarchy of the United Kingdom", "Monarchy of the United Kingdom\n\nThe monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories.", "The current monarch and head of state, Queen Elizabeth II, ascended the throne on the death of her father, King George VI, on 6\u00a0February 1952.", "The monarch and his or her immediate family undertake various official, ceremonial, diplomatic and representational duties.", "As the monarchy is constitutional, the monarch is limited to non-partisan functions such as bestowing honours and appointing the Prime Minister.", "The monarch is commander-in-chief of the British Armed Forces.", "Though the ultimate formal executive authority over the government of the United Kingdom is still by and through the monarch's royal prerogative, these powers may only be used according to laws enacted in Parliament and, in practice, within the constraints of convention and precedent.", "The British monarchy traces its origins from the petty kingdoms of early medieval Scotland and Anglo-Saxon England, which consolidated into the kingdoms of England and Scotland by the 10th century AD.", "In 1066, the last crowned Anglo-Saxon monarch, Harold Godwinson, was defeated and killed during the Norman conquest of England and the English monarchy passed to the Normans' victorious leader, William the Conqueror, and his descendants." ] ], "gold": "The monarchy of the United Kingdom is the constitutional form of government by which a hereditary sovereign reigns as the head of state of the United Kingdom, its dependencies, the Bailiwick of Guernsey, the Bailiwick of Jersey and the Isle of Man, and its overseas territories. It is commonly referred to as the British monarchy. It is also an example of a matriarchal family, with a woman at the head. The current monarch is Queen Elizabeth II, who ascended the throne in 1952.", "prediction 1": "The monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories. The royal family of Great Britain has been a part of the British monarchy since the petty kingdoms of early medieval Scotland and Anglo-Saxon England. In modern times, a modern monarchy is a family of several generations consisting of the monarch, his or her immediate family, and a large contingent of heirs to the throne.", "prediction 2": "The monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories. The monarch and his or her immediate family undertake various official, ceremonial, diplomatic and representational duties. The current monarch and head of state, Queen Elizabeth II, ascended the throne on the death of her father, King George VI, on 6 February 1952.", "prediction 3": "The monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories. The current monarch and head of state, Queen Elizabeth II, ascended the throne on the death of her father, King George VI, on 6 February 1952. The monarch and his or her immediate family undertake various official, ceremonial, diplomatic and representational duties.", "prediction 4": "The monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories. The monarch and his or her immediate family undertake various official, ceremonial, diplomatic and representational duties.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 506 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The monarchy of the United Kingdom, commonly referred to as the British monarchy, is the constitutional monarchy of the United Kingdom, its dependencies and its overseas territories. The current monarch and head of state, Queen Elizabeth II, ascended the throne on 6 February 1952. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sang lead vocals on 25 or 6 to 4?", "passages": [ [ "25 or 6 to 4", "25 or 6 to 4\n\n\u201c25 or 6 to 4\u201d is a song written by American musician Robert Lamm, one of the founding members of the band Chicago.", "It was recorded in 1969 for their second album \"Chicago\", with Peter Cetera on lead vocals.", "The album was released in January 1970 and the song was edited and released as a single in June, climbing to number 4 on the US \"Billboard\" Hot 100 chart and number 7 on the UK Singles Chart.", "It was the band's first song to reach the top five in the US.", "In concurrence with the title, the song moved from number 6 to number 4 on the Billboard Hot 100 the week of September 12, 1970.", "It has been included in numerous Chicago compilation albums.", "An updated version of \"25 or 6 to 4\" was recorded for the 1986 album \"Chicago 18\" with James Pankow listed as co-writer, and new band member Jason Scheff on lead vocals.", "The single reached number 48 on the US chart.", "This version was also used as the B-side for the band's next single in 1986 \"Will You Still Love Me?\"", "Through the 2010s, \"25 or 6 to 4\" continued to be a staple in Chicago's live concert set list and in Peter Cetera's solo concert set list." ], [ "Constantine Maroulis", "Constantine had previously played the role of Jesus in an earlier production when he was much younger.", "Maroulis achieved particular success starring as Drew in the hit Broadway musical \"Rock of Ages\", featuring the music of 1980s rock legends including Journey, Bon Jovi, and Twisted Sister.", "The production began running Off-Broadway at the New World Stages in October 2008, moving to Broadway to the Brooks Atkinson Theatre on April 7, 2009.", "\"Rolling Stone\" stated that the \"play has found a perfect lead in American Idol rocker Constantine Maroulis,\" while \"Associated Press\" added that Maroulis \"gives a touching performance and sings powerfully as Drew, the young wannabe rock singer.\"", "Maroulis' vocal performances were particularly praised, with \"The New York Times\" describing his voice as \"soulful, pure, and intense,\"\nand the \"Chicago Tribune\" singling out his \"dazzling vocal pyrotechnics\" as a standout in the production.", "On May 5, 2009, Maroulis received a nomination for the Tony Award for Best Performance by a Leading Actor in a Musical.", "From Broadway, Maroulis headlined the national touring production, with the first show opening in Chicago on Sept 21, 2010, and his last performance on July 24, 2011 at the National Theatre in Washington, DC." ], [ "Carved in Stone (Vince Neil album)", "Carved in Stone (Vince Neil album)\n\nCarved in Stone is the second solo album by M\u00f6tley Cr\u00fce frontman Vince Neil.", "It was released in 1995 on Warner Bros. Records.", "Produced by the Dust Brothers, the album welded rock and hip-hop.", "\"That was before Kid Rock\u2026\" Neil observed in 2000, \"so no-one was really ready for it then.", "If it came out today it'd probably sell fifty million copies.\"", "The album was put on hold while Neil dealt with the illness of his daughter Skylar.", "Following its release, Vince returned to M\u00f6tley in 1996.", "This is his last album to feature bassist Robbie Crane and drummer Vikki Fox.", "Guitarist Brent Woods also plays on the record.", "He previously jammed with Wildside and was later a touring guitarist for Warrant.", "The album charted at #139 on the \"Billboard 200\".", "\"Skylar's Song\" was released as a single." ] ], "gold": "\"25 or 6 to 4\" is a song written by American musician Robert Lamm, one of the founding members of the band Chicago and was recorded in 1969 for their second album, Chicago, with Peter Cetera on lead vocals. An updated version of \"25 or 6 to 4\" was recorded for the 1986 album Chicago 18 with James Pankow listed as co-writer, and new band member Jason Scheff on lead vocals. In 2011, Constantine Maroulis released his rendition of Chicago's 25 or 6 to 4, as recorded live at a Night at the Rock Show performance. Vince Neil also sang the lead vocals on 25 or 6 to 4 for M\u00f6tley Cr\u00fce.", "prediction 1": "The song 25 or 6 to 4 was written by American musician Robert Lamm, one of the founding members of the band Chicago. It was recorded in 1969 for their second album Chicago, with Peter Cetera on lead vocals. The single was released in June 1970 and reached number 4 on the US Billboard Hot 100 and number 7 on the UK Singles Chart. An updated version of the song was recorded for the 1986 album Chicago 18, with James Pankow listed as co-writer, and new band member Jason Scheff on lead vocals. This version reached number 48 on the US chart and was also used as the B-side for the band's next single in 1986 \"Will You Still Love Me?\". Through the 2010s, \"25 or 6 to 4\" continued to be a staple in Chicago's live concert set list and in Peter Cetera's solo concert set list.", "prediction 2": "\"25 or 6 to 4\" is a song written by American musician Robert Lamm, one of the founding members of the band Chicago. It was recorded in 1969 for their second album Chicago, with Peter Cetera on lead vocals. The album was released in January 1970 and the song was edited and released as a single in June, climbing to number 4 on the US Billboard Hot 100 chart and number 7 on the UK Singles Chart. An updated version of \"25 or 6 to 4\" was recorded for the 1986 album Chicago 18, with James Pankow listed as co-writer, and new band member Jason Schefffffffffffffffffffffffffffffffffffffff on lead vocals. The single reached number 48 on the US chart.", "prediction 3": "On the song 25 or 6 to 4, lead vocals were given to Peter Cetera by Robert Lamm, one of the founding members of the band Chicago. Jason Scheff and James Pankow added lead vocals to the song for the 1986 album Chicago 18 and it reached number 48 on the US chart. American Idol rocker Constantine Maroulis sang lead vocals on the 1986 album Chicago 18 and it reached number 48 on the US chart.", "prediction 4": "There are several songs called 25 or 6 to 4. The original version was written by Robert Lamm, one of the founding members of the band Chicago, and was recorded in 1969 for their second album Chicago, with Peter Cetera on lead vocals. An updated version of 25 or 6 to 4 was recorded for the 1986 album Chicago 18, with James Pankow listed as co-writer, and new band member Jason Scheff on lead vocals. This version was also used as the B-side for the band's next single in 1986, Will You Still Love Me?", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 494, "end": 634 }, { "error type": "Irrelevant", "explanation": "", "start": 635, "end": 773 } ], "missing-info": [], "corrected-prediction": "The song 25 or 6 to 4 was written by American musician Robert Lamm, one of the founding members of the band Chicago. It was recorded in 1969 for their second album Chicago, with Peter Cetera on lead vocals. An updated version of the song was recorded for the 1986 album Chicago 18, with James Pankow listed as co-writer, and new band member Jason Scheff on lead vocals. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time toronto won grey cup?", "passages": [ [ "100th Grey Cup", "100th Grey Cup\n\nThe 100th Grey Cup was a Canadian football game between the East Division champion Toronto Argonauts and the West Division champion Calgary Stampeders of the Canadian Football League to decide the Grey Cup champions of the 2012 season.", "The game took place on Sunday, November 25, 2012, at Rogers Centre in Toronto, Ontario.", "This was the fourth (and last) Grey Cup game played at Rogers Centre (by the next Grey Cup game that Toronto hosted in 2016, it was played at BMO Field), and the 46th in the city of Toronto.", "The Argonauts defeated the Stampeders 35\u201322 to win their sixteenth Grey Cup title.", "This was the third meeting between Calgary and Toronto for the Grey Cup championship and the first since the 79th Grey Cup in 1991.", "This was also the second consecutive year that the Grey Cup game involved, and was won by, the team from the host city.", "The result of the game also meant that Argonauts owner David Braley became the first team owner to win back-to-back Grey Cups with two different teams; Braley also owns the 2011 champions, the BC Lions.", "Over 5.8 million viewers watched the game, with roughly 5.5 million originating from English Canada, making the game the most-watched Grey Cup ever recorded on English-language television." ], [ "105th Grey Cup", "105th Grey Cup\n\n", "The 105th Grey Cup was played on November 26, 2017 between the Calgary Stampeders and the Toronto Argonauts at TD Place Stadium in Ottawa, Ontario.", "In a re-match of the 100th Grey Cup, the Argos won the game 27\u201324, winning their 17th championship.", "It was reported in September 2015 that Ottawa would host the Grey Cup game, and that it would be determined at a board of governor's meeting later that fall.", "It was stated by the Ottawa Redblacks ownership group, Ottawa Sports and Entertainment Group, that one of the clauses in their expansion agreement was that the club would host a Grey Cup game within their first four years of existence.", "Since the Redblacks entered the league in 2014, 2017 would be the fourth such year.", "Ottawa had previously been awarded the 102nd Grey Cup but backed out due to construction delays; that game would be held in Vancouver instead.", "During an Ottawa Redblacks game on July 31, 2016, it was announced in a video featuring Prime Minister Justin Trudeau that the city of Ottawa had been selected to host the 105th Grey Cup, in part to celebrate the 150th anniversary of Canada.", "This will be the seventh time that the Grey Cup game will be played in Ottawa, with each of those games being played at Lansdowne Park." ] ], "gold": "As of 2017, the last time Toronto won the Grey Cup was on November 26, 2017, the first time Toronto won the Grey Cup since November 25, 2012. The Toronto Argonauts defeated the Calgary Stampeders 27 to 24 at the 105th Grey Cup on November 26, 2017, at TD Place Stadium in Ottawa, Ontario. The Toronto Argonauts defeated the Calgary Stampeders 35 to 22 at the 100th Grey Cup on November 25, 2012, at Rogers Centre in Toronto, Ontario.", "prediction 1": "The last time Toronto won the Grey Cup was on November 25, 2012, when the East Division champion Toronto Argonauts defeated the West Division champion Calgary Stampeders 35\u201322 to win their sixteenth Grey Cup title. The 105th Grey Cup was played on November 26, 2017 between the Calgary Stampeders and the Toronto Argonauts at TD Place Stadium in Ottawa, Ontario.", "prediction 2": "The last time Toronto won the Grey Cup was on November 25, 2012.", "prediction 3": "The last time Toronto won the Grey Cup was on November 25, 2012. The 105th Grey Cup was played on November 26, 2017 between the Calgary Stampeders and the Toronto Argonauts at TD Place Stadium in Ottawa, Ontario.", "prediction 4": "The last time Toronto won a Grey Cup was on November 25, 2012. The 105th Grey Cup was played on November 26, 2017 between the Calgary Stampeders and the Toronto Argonauts at TD Place Stadium in Ottawa, Ontario. This was a re-match of the 100th Grey Cup, in which the Toronto Argonauts won the game 27\u201324, winning their 17th championship.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2,3]}", "start": 46, "end": 64 }, { "error type": "Redundant", "explanation": "The last time Toronto won the Grey Cup was on November 25, 2012, when the ", "start": 74, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 150 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 170, "end": 175 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 189, "end": 198 }, { "error type": "Redundant", "explanation": "The last time Toronto won the Grey Cup was on November 25, 2012, when the East Division champion Toronto Argonauts defeated the West Division champion Calgary Stampeders 35\u201322 to win their sixteenth Grey Cup title. ", "start": 215, "end": 322 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "As of 2017, the last time Toronto won the 105th Grey Cup was on November 26, 2017, when they defeated the Calgary Stampeders 27\u201324 to win their seventeenth Grey Cup title. The match was held at the TD Place Stadium in Ottawa, Ontario. The 100th Grey Cup took place on Sunday, November 25, 2012, at Rogers Centre in Toronto, Ontario. The Argonauts defeated the Stampeders 35\u201322 to win their sixteenth Grey Cup title." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who voices the main character in the lego movie?", "passages": [ [ "The Lego Movie", "By June 2012, Chris Pratt had been cast as the voice of Emmet, the lead Lego character, and Will Arnett voicing Lego Batman; the role of Lego Superman was offered to Channing Tatum.", "By August 2012, Elizabeth Banks was hired to voice Lucy (later getting the alias \"Wyldstyle\") and Morgan Freeman to voice Vitruvius, an old mystic.", "In October 2012, Warner Bros. shifted the release date for the film, simply titled \"Lego\", to February 7, 2014.", "In November 2012, Alison Brie, Will Ferrell, Liam Neeson, and Nick Offerman signed on for roles.", "Brie voices Unikitty, a member of Emmet's team; Ferrell voices the antagonist President/Lord Business; Neeson voices Bad Cop/Good Cop and Offerman voices MetalBeard, a pirate seeking revenge on Business.", "In July 2012, a Lego-user contest announced on the film's Facebook page would choose a winning Lego vehicle to appear in the film.", "Miller's childhood Space Village playset is utilized in the film.", "The film is strongly inspired by the visual aesthetic and stylistics of Brickfilms and received a great deal of praise in the respective online communities who saw the film as appraising nod to their work." ], [ "The Lego Movie", "The Lego Movie\n\nThe Lego Movie is a 2014 3D computer-animated adventure comedy film written and directed by Phil Lord and Christopher Miller from a story by Lord, Miller and Dan and Kevin Hageman.", "Based on the Lego line of construction toys, the story focuses on an ordinary Lego minifigure who finds himself being the only one to help a resistance stop a tyrannical businessman from gluing everything in the Lego worlds into his vision of perfection.", "Chris Pratt, Will Ferrell, Elizabeth Banks, Will Arnett, Nick Offerman, Alison Brie, Charlie Day, Liam Neeson and Morgan Freeman provide their voices for the film's main characters.", "The first film produced by the Warner Animation Group, \"The Lego Movie\" was released on February 7, 2014 by Warner Bros. Pictures.", "It became a critical and commercial success, grossing $469 million worldwide against a $60 million budget and receiving praise for its visual style, humor, voice acting and heartwarming message.", "The film won the BAFTA Award for Best Animated Film, the Critics' Choice Movie Award for Best Animated Feature and the Saturn Award for Best Animated Film; it was also nominated for the Golden Globe Award for Best Animated Feature Film and received an Academy Award nomination for Best Original Song for \"Everything Is Awesome\"." ], [ "The Lego Movie 2: The Second Part", "The Duplo invaders announce their plans to destroy everyone in the Lego Universe, after Emmet and his friends have just saved the world by saving President Business from his evil spirit, and after Finn's father allows his younger sister to play with him in the basement.", "They attempt to make friends with the Duplo invaders, but to no avail, and the invasion of Bricksburg ultimately begins.", "Five years later, Finn has become a teenager and still feels uneasy about his sister's ideas of what to do with the Lego world when playing with him.", "The Duplo invaders have turned Bricksburg into a post-apocalyptic wasteland, which everyone now calls \"Apocalypseburg.\"", "Emmet maintains his livelihood and is completely unaffected by this dramatic change and pretends everything is still awesome, unlike everyone else, who have been toughened and hardened, making them ready for more fighting.", "Emmet has wanted to start something new with his life with Lucy ever since they began their relationships, particulary to concieve a family, but with the harmony that the Lego world once obtained gone, she disagrees.", "Suddenly, an intergalactic invader named General Sweet Mayhem from the Systar System in outer space comes to the Earth and joins forces with the Duplo invaders to take over the Legoverse." ] ], "gold": "The Lego Movie is a 2014 computer-animated adventure comedy film based on the Lego line of construction toys. The story focuses on Emme,t an ordinary Lego minifigure voiced by Chris Pratt who helps a resistance movement stop a tyrannical businessman from gluing everything in the Lego world into his vision of perfection. The antagonist in question, Lord Business, is voiced by Will Ferrell.", "prediction 1": "The Lego Movie is a 2014 computer-animated adventure comedy film based on the Lego line of construction toys. In it, Emmet, the lead Lego character, is voiced by Chris Pratt. Will Ferrell voices the antagonist President/Lord Business, Alison Brie voices Unikitty, a member of Emmet's team, Liam Neeson voices Bad Cop/Good Cop, and Nick Offerman voices MetalBeard, a pirate seeking revenge on Business.", "prediction 2": "The 2015 computer-animated film The Lego Movie is a comedy adventure comedy film based on the Lego line of construction toys that follows Emmet, an ordinary Lego minifigure who finds himself being the only one to help a resistance stop a tyrannical businessman from gluing everything in the Lego worlds into his vision of perfection. Chris Pratt voices Emmet, who is the main character in the movie. In the second part of the film, Emmet is voiced by Charlie Day.", "prediction 3": "In the 2014 Lego Movie, Emmet, the lead Lego character, is voiced by Chris Pratt, Will Ferrell, Elizabeth Banks, Will Arnett, Nick Offerman, Liam Neeson, and Morgan Freeman. The third Lego Movie, Lego: Rise of the Tomb Raider, is voiced by Charlie Day, and features a new version of Emmet who voices the Lego minifigure, Emmet.", "prediction 4": "The Lego Movie is a 2014 computer-animated adventure comedy film written and directed by Phil Lord and Christopher Miller from a story by Lord, Miller and Dan and Kevin Hageman. In the film, Emmet is voiced by Chris Pratt, and Emmet's friends will be voiced by Elizabeth Banks, Will Ferrell, Liam Neeson, Nick Offerman, and Charlie Day.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 401 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Lego Movie is a 2014 computer-animated adventure comedy film based on the Lego line of construction toys. In it, Emmet, the lead Lego character, is voiced by Chris Pratt. Will Ferrell voices the antagonist President/Lord Business. The story focuses on an ordinary Lego minifigure who finds himself being the only one to help a resistance stop a tyrannical businessman from gluing everything in the Lego worlds into his vision of perfection." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who was the prime minister of pakistan when martial law was imposed in 1958?", "passages": [ [ "1958 Pakistani coup d'\u00e9tat", "There was already a precedent in Governor General Malik Ghulam Muhammad dismissing prime ministers and ruling by decree, and many viewed Mirza as manipulating the constitution and instigating ousters of governments.", "The One Unit scheme amalgamating the provinces of Pakistan into two wings - West Pakistan and East Pakistan - was politically controversial and proving difficult to administer.", "The quick succession of prime ministers fostered the view within the military and in the public that Pakistani politicians were too weak and corrupt to govern effectively, and that the parliamentary system was flawed.", "On October 7, President Mirza declared martial law in Pakistan.", "He abrogated the constitution of 1956, describing it as \"unworkable\" and full of \"dangerous compromises.\"", "He dismissed the government of Sir Feroz Khan Noon, dissolved the National Assembly of Pakistan and the provincial legislatures.", "Mirza also proceeded to outlaw all political parties.", "He appointed General Ayub Khan, the Commander-in-Chief of the Pakistani army as the Chief Martial Law Administrator and nominated him to become the new Prime Minister of Pakistan, charged with administering the country.", "On October 27, Iskander Mirza resigned from the presidency, transferring it to Ayub Khan.", "Both men saw the other as a rival to their respective positions." ], [ "1958 Pakistani coup d'\u00e9tat", "1958 Pakistani coup d'\u00e9tat\n\nThe 1958 Pakistani coup d'\u00e9tat refers to the events between October 7, when the President of Pakistan Iskander Mirza abrogated the Constitution of Pakistan and declared martial law, and October 27, when Mirza himself was deposed by Gen. Ayub Khan, the Commander-in-Chief of the Pakistani Army.", "Pakistan's first military coup followed a period of prolonged political instability in which Pakistan's dominant political party, the Pakistan Muslim League, was unable to successfully govern on the basis of shared programs or policies.", "Broadly, political scientists have argued that the susceptibility of a military system to coups is inversely correlated with the strength of its political parties.", "In 1956, the Constituent Assembly of Pakistan approved a constitution that ended Pakistan's status of an independent Dominion of the British Empire, to create the Islamic Republic of Pakistan.", "Maj. Gen. Iskander Mirza, the last Governor General of Pakistan, simultaneously became the state's first president.", "However, the new constitution was followed by political turmoil in Pakistan, which saw a succession of four prime ministers - Chaudhry Muhammad Ali, Huseyn Shaheed Suhrawardy, Ibrahim Ismail Chundrigar and Sir Feroz Khan Noon - in a period of two years." ] ], "gold": "The President of Pakistan Iskander Mirza abrogated the Constitution of Pakistan, dismissed the government of Sir Feroz Khan Noon and declared martial law on October 7, 1958. On October 27, 1958 Mirza himself was deposed by Gen. Ayub Khan, the Commander-in-Chief of the Pakistan Army. There were a number of Prime Ministers between 1956 and 1958 and it reached a stage when General Ayub Khan felt the army should take control to restore stability.", "prediction 1": "Pakistan's first military coup d'\u00e9tat refers to the events between October 7, when the President of Pakistan Iskander Mirza abrogated the Constitution of Pakistan and declared martial law. On October 27, when Mirza himself was deposed by Gen. Ayub Khan, the Commander-in-Chief of the Pakistani Army, he appointed him to become the new Prime Minister of Pakistan, charged with administering the country.", "prediction 2": "The 1958 Pakistani coup d'\u00e9tat refers to the events between October 7, when the President of Pakistan, Iskander Mirza, declared martial law in Pakistan and nominated General Ayub Khan to become the new Prime Minister of Pakistan, charged with administering the country. On October 27, when Mirza himself was deposed by Gen. Ayub Khan, both men saw the other as a rival to their respective positions.", "prediction 3": "On October 7, 1958, the president of Pakistan Iskander Mirza declared martial law in Pakistan, a move that saw the dismissal of Prime Minister Chaudhry Muhammad Ali and the appointment of General Ayub Khan as the Chief Martial Law Administrator. On October 27, 1958, Mirza himself was deposed by Gen. Ayub Khan, the Commander-in-Chief of the Pakistani army.", "prediction 4": "The 1958 Pakistani coup d'\u00e9tat refers to the events between October 7, when the President of Pakistan Iskander Mirza declared martial law in Pakistan and nominated General Ayub Khan as the Chief Martial Law Administrator and nominated him to become the new Prime Minister of Pakistan, charged with administering the country. On October 27, Iskander Mirza resigned from the presidency, transferring it to Ayub Khan. Both men saw the other as a rival to their respective positions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 66 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "On October 7, 1958, President of Pakistan Iskander Mirza abrogated the Constitution of Pakistan and declared martial law. Mirza dismissed the government of Sir Feroz Khan Noon. On October 27, when Mirza himself was deposed by Gen. Ayub Khan, the Commander-in-Chief of the Pakistani Army, he appointed him to become the new Prime Minister of Pakistan, charged with administering the country. There were four prime ministers after the new constitution. " }, "preference": [ 1, 1, 1, 0, 0, 1 ] }, { "question": "What two teams are in the stanley cup final?", "passages": [ [ "2017 Stanley Cup Finals", "2017 Stanley Cup Finals\n\nThe 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs.", "The Eastern Conference champion and defending Stanley Cup champion Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two.", "Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs for the second consecutive year.", "The Penguins won the Stanley Cup in their opponent's rink, just like they did the previous four times.", "During the regular season, the Penguins finished second in the league with 111 points, which gave them home ice advantage in the series.", "The series began on May 29 and concluded on June 11.", "The Penguins made their second consecutive Finals appearance, marking the third time in their history they had done this, following their appearances in \u2013 and \u2013.", "This was the first time since 2009, a rematch between the Penguins and Detroit Red Wings, that any team appeared in consecutive Finals.", "The Penguins also became the first team since the Red Wings (in and ) to win the Stanley Cup in consecutive years.", "This marked the second consecutive season in which a Western Conference team made their first appearance in the Finals; the San Jose Sharks made their Finals debut the year prior." ], [ "2016 Stanley Cup Finals", "2016 Stanley Cup Finals\n\nThe 2016 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2015\u201316 season, and the culmination of the 2016 Stanley Cup playoffs.", "The Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history (winning the clinching game of all four on the road).", "Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs.", "The Penguins finished ahead of the Sharks during the regular season, giving them home ice advantage in the series.", "The series began on May 30 and concluded on June 12.", "This was the first Stanley Cup Finals since 2007 to feature a team making their Finals debut.", "This was the first playoff meeting between teams from Pittsburgh and the Bay Area since the Penguins swept the Oakland Seals in the 1970 Stanley Cup Quarterfinals.", "The Eastern Conference had home-ice advantage in consecutive seasons for the first time since the 2004 and 2006 Finals.", "For the first time since 2011, neither the Chicago Blackhawks nor the Los Angeles Kings won the Stanley Cup.", "This was Pittsburgh's fifth Finals appearance, and first since winning the Cup in .", "The Penguins had made the playoffs every year since their win in 2009, but hadn't won a single game in the conference finals in that span." ], [ "2015 Stanley Cup Finals", "2015 Stanley Cup Finals\n\nThe 2015 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) season, and the culmination of the 2015 Stanley Cup playoffs.", "The Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history, and their third title in six seasons.", "The Lightning, as the club with the better regular-season record, held home-ice advantage in the series.", "The best-of-seven series was played in a 2\u20132\u20131\u20131\u20131 format, with Tampa Bay hosting games one, two, five, and seven (if necessary); and Chicago hosting games three, four and six.", "The series started June 3 and ended on June 15.", "Tyler Johnson and Patrick Kane led the Stanley Cup playoffs in points scored with 23 points each.", "This was Tampa Bay's second Finals appearance after winning the Cup in .", "Since their win in 2004, the Lightning had lost in the Conference Finals in 2011 in seven games to the Boston Bruins.", "The Lightning were eliminated in the first round in 2006, 2007, and 2014.", "The Lightning entered the 2014\u201315 season with major re-signings during the offseason including centre Tyler Johnson, wingers Ryan Callahan and Ondrej Palat, and goalie Ben Bishop." ] ], "gold": "The 2017 Stanley Cup Finals was the championship series of the National Hockey League's 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs. In the Nashville Predators, Pittsburgh Penguins competition, The Penguins won the Stanley Cup. The 2016 Stanley Cup final was a San Jose Sharks, Pittsburgh Penguins feud that also ended with a win for the Penguins. The 2015 Stanley Cup Finals was a Chicago Blackhawks, Tampa Bay Lightning battle where the Blackhawks earned the win.", "prediction 1": "The Stanley Cup Finals are a series of hockey championships featuring teams from the National Hockey League and the National Hockey League. In the 2014\u201315 season, the Western Conference champions defeated the Eastern Conference champions Tampa Bay Lightning and the Eastern Conference champions Pittsburgh Penguins. In the 2015 Stanley Cup Finals, the Western Conference champions defeated the Eastern Conference champions Tampa Bay Lightning and the Eastern Conference champions Chicago Blackhawks.", "prediction 2": "The 2016 and 2017 Stanley Cup Finals are the championship series of the National Hockey League's (NHL) 2015-2016 seasons and the culmination of the 2016 Stanley Cup playoffs. The 2015 and 2016 Stanley Cup Finals are the championship series of the National Hockey League's (NHL) 2015-2016 seasons and the culmination of the 2015 Stanley Cup playoffs. In the 2016 Stanley Cup Finals, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks, four games to two to win their fourth championship in franchise history.", "prediction 3": "There were several Stanley Cup Finals from the National Hockey League. In the 2016 Stanley Cup Final, the Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their fourth championship in franchise history. In the 2015 Stanley Cup Final, the Western Conference champion Chicago Blackhawks defeated the Eastern Conference champion Tampa Bay Lightning four games to two to win their sixth championship in franchise history, and their third title in six seasons.", "prediction 4": "The 2015 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) season, and the culmination of the 2015 Stanley Cup playoffs. The Eastern Conference champion Pittsburgh Penguins defeated the Western Conference champion San Jose Sharks four games to two to win their sixth championship in franchise history, and their third title in six seasons. The 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 162 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 167, "end": 195 }, { "error type": "Redundant", "explanation": "In the 2014\u201315 season, the Western Conference champions defeated the Eastern Conference champions Tampa Bay Lightning and ", "start": 262, "end": 294 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 295, "end": 315 }, { "error type": "Redundant", "explanation": "In the 2014\u201315 season, the Western Conference champions defeated the Eastern Conference champions Tampa Bay Lightning and the Eastern Conference champions Pittsburgh Penguins. ", "start": 316, "end": 347 }, { "error type": "Redundant", "explanation": "In the 2014\u201315 season, the Western Conference champions defeated the Eastern Conference champions Tampa Bay Lightning and the Eastern Conference champions Pittsburgh Penguins. ", "start": 348, "end": 442 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 451, "end": 499 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2015 Stanley Cup Finals had the Chicago Blackhawks defeat the Tampa Bay Lightning. The 2016 Stanley Cup Finals had the Pittsburgh Penguins defeat the San Jose Shark. The 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs. The Pittsburgh Penguins defeated the Nashville Predators." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many winter olympic medals have the uk won?", "passages": [ [ "Great Britain at the Olympics", "Chris Hoy and Jason Kenny are jointly the most successful cyclists in Olympic history and Ben Ainslie, with four golds at consecutive Games and a silver medal, is the most successful sailor in Olympic history.", "Great Britain has hosted the Summer Games on three occasions \u2013 1908, 1948 and 2012, all in London \u2013 second only to the United States.", "At the 2016 Summer Olympics in Rio, Great Britain became the first country to win more medals at a Summer Olympics immediately after hosting a Summer Olympics; they won 67 medals overall, coming in second place in the medal table ahead of China, two more than in London in 2012.", "This success came 20 years after finishing 36th in the medal table, after winning just one gold and fourteen other medals at the 1996 Summer Olympics in Atlanta, which led to significant changes into the management and funding of British sports and facilities.", "At the Winter Olympics as a non-alpine nation Great Britain has historically been unable to replicate the amount of success they have achieved in the Summer Olympics although in recent years with the expansion of the Winter Olympics to include sports such as Curling, Snowboarding, Skeleton and Freestyle skiing has brought some increased success." ], [ "Great Britain at the 2014 Winter Olympics", "On 19 February 2014, the men's curling team won their semifinal against Sweden 6\u20135 and on 21 February 2014, they won the silver medal after being defeated by Canada in the gold medal match 9\u20133, but the result still confirmed Great Britain's most successful Olympics for ninety years by equaling the medal count of the 1924 Winter Olympics.", "On 11 February Great Britain matched an Olympic scoreline record by beating USA 12\u20133 in women's curling.", "They also set a new Olympic record by scoring seven points in a single end.", "On 14 February they equalled the scoreline record again, this time beating Japan 12\u20133.", "On 16 January 2014, the funding body UK Sport announced their medal targets for Team GB at the 2014 Winter Olympic Games in Sochi with the target to win three medals with the best chance of success with the ladies skeleton events.", "Although the target was set at three medals the funding body predicted that Great Britain had the potential to win as many as seven medals, although this total was not widely expected to be reached.", "Other realistic chances of medal success were with the bobsleigh and curling events.", "The games proved to be highly successful for Team GB, exceeding the initial target of three medals and achieving all of the targets for each of the winter sports that were set." ], [ "Lizzy Yarnold", "Lizzy Yarnold\n\nElizabeth Anne Yarnold, OBE (born 31 October 1988) is a British former skeleton racer who joined the Great Britain national squad in 2010.", "With consecutive Olympic gold medals in 2014 and 2018, she is the most successful British Winter Olympian and the most successful Olympic skeleton athlete of all time from any nation.", "She won the 2013\u201314 Skeleton World Cup (only once finishing off the podium the whole season), followed by a gold in the 2014 Winter Olympics in Sochi.", "Yarnold was selected to be one of the two women skeleton drivers representing Team GB at the 2018 Winter Olympics in Pyeongchang, and went on to become the first person to defend an Olympic gold in skeleton and the first British athlete to defend a Winter Olympic title.", "Yarnold set the track record for women's skeleton at the Olympic venue in the final heat of the race with a time of 51.46 seconds, beating Jacqueline L\u00f6lling's pre-Olympic record by nearly 1.3 seconds and her own first-heat record by 0.2 second.", "Yarnold was also the flag bearer for Great Britain at the Pyeongchang opening ceremony." ] ], "gold": "As a non-alpine team, Great Britain has historically been unable to replicate at the Winter Olympics the success that they have achieved in their Summer counterparts. Nonetheless, they have obtained a total of 39 medals, 11 gold, 4 silver and 17 bronze", "prediction 1": "During the 2016-2018 Olympic cycle, Great Britain has won a total of 78 medals, including 62 medals in the men's and 67 medals in the women's sports. Additionally, at the 2014 Winter Olympic Games in Sochi, Great Britain won a total of 12 medals, totalling 84 medals in all, including four Olympic Games golds. In addition, Great Britain has won a total of 12 Olympic medals in the women's sports, including two golds, one silver, and skeleton events.", "prediction 2": "The United Kingdom has won a total of 62 winter olympic medals. In the winter sports, Great Britain has won a total of 77 medals, including 67 medals and 63 medals in the women's skeleton. The skeleton is the sport in which British athletes compete for their country, and they have won a total of 62 medals in total, including 62 medals in the men's and 68 medals in the women's.", "prediction 3": "The United Kingdom has won a total of 71 medals in Winter Olympics, with 10 golds and 16 silvers in the individual events. Great Britain has hosted the Winter Olympics on three occasions \u2013 1908, 1948 and 2012, all in London \u2013 second only to the United States. At the 2016 Summer Olympics in Rio, Great Britain became the first country to win more medals at a Summer Olympics immediately after hosting a Summer Olympics. Great Britain won 67 medals overall, coming in second place in the medal table ahead of China, two more than in London in 1924 Winter Olympics.", "prediction 4": "There have been a number of winter Olympics for the United Kingdom. In the past few years, Great Britain has won a total of 76 medals at the Winter Olympics. In total, Great Britain has won a total of 82 medals at the Winter Olympics.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 11, "end": 20 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 69, "end": 79 }, { "error type": "Unverifiable", "explanation": "", "start": 90, "end": 149 }, { "error type": "Unverifiable", "explanation": "", "start": 227, "end": 246 }, { "error type": "Unverifiable", "explanation": "", "start": 247, "end": 274 }, { "error type": "Unverifiable", "explanation": "", "start": 285, "end": 310 }, { "error type": "Unverifiable", "explanation": "", "start": 357, "end": 397 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "As a non-alpine nation, Great Britain has historically been unable to replicate the amount of success they have achieved in the Summer Olympics. The UK won at least 3 medals during the 2014 Winter Olympics. They also achieved at least one medal in 2018." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When did movies start being made in color?", "passages": [ [ "Color motion picture film", "The various additive systems entailed the use of color filters on both the movie camera and projector.", "Additive color adds lights of the primary colors in various proportions to the projected image.", "Because of the limited amount of space to record images on film, and later because the lack of a camera that could record more than two strips of film at once, most early motion-picture color systems consisted of two colors, often red and green or red and blue.", "A pioneering three-color additive system was patented in England by Edward Raymond Turner in 1899.", "It used a rotating set of red, green and blue filters to photograph the three color components one after the other on three successive frames of panchromatic black-and-white film.", "The finished film was projected through similar filters to reconstitute the color.", "In 1902, Turner shot test footage to demonstrate his system, but projecting it proved problematic because of the accurate registration (alignment) of the three separate color elements required for acceptable results.", "Turner died a year later without having satisfactorily projected the footage.", "In 2012, curators at the National Media Museum in Bradford, UK, had the original custom-format nitrate film copied to black-and-white 35\u00a0mm film, which was then scanned into a digital video format by telecine." ], [ "Color motion picture film", "This is done by analyzing the visible spectrum of color into several regions (normally three, commonly referred to by their dominant colors: red, green and blue) and recording each region separately.", "Current color films do this with three layers of differently color-sensitive photographic emulsion coated on one strip of film base.", "Early processes used color filters to photograph the color components as completely separate images (e.g., three-strip Technicolor) or adjacent microscopic image fragments (e.g., Dufaycolor) in a one-layer black-and-white emulsion.", "Each photographed color component, initially just a colorless record of the luminous intensities in the part of the spectrum that it captured, is processed to produce a transparent dye image in the color complementary to the color of the light that it recorded.", "The superimposed dye images combine to synthesize the original colors by the subtractive color method.", "In some early color processes (e.g., Kinemacolor), the component images remained in black-and-white form and were projected through color filters to synthesize the original colors by the additive color method.", "The earliest motion picture stocks were orthochromatic, and recorded blue and green light, but not red.", "Recording all three spectral regions required making film stock panchromatic to some degree." ], [ "RKO Pictures", "On June 13, 1935, RKO premiered the first feature film shot entirely in advanced three-strip Technicolor, \"Becky Sharp\".", "The movie was coproduced with Pioneer Pictures, founded by Cooper\u2014who departed RKO after two years helming production\u2014and John Hay \"Jock\" Whitney, who brought in his cousin Cornelius Vanderbilt Whitney; Cooper had successfully encouraged the Whitneys to purchase a major share of the Technicolor business as well.", "Although judged by critics a failure as drama, \"Becky Sharp\" was widely lauded for its visual brilliance and technical expertise.", "RKO also employed some of the industry's leading artists and craftsmen whose work was never seen.", "From the studio's earliest days through late 1935, Max Steiner, regarded by many historians as the most influential composer of the early years of sound cinema, made music for over 100 RKO films.", "Murray Spivak, head of the studio's audio special effects department, made important advances in the use of rerecording technology first heard in \"King Kong\".", "In October 1935 the ownership team expanded, with financier Floyd Odlum leading a syndicate that bought 50 percent of RCA's stake in the company; the Rockefeller brothers, also major stockholders, increasingly became involved in the business." ] ], "gold": "The first film that utilized any type of color was made September 1, 1902. Edward Raymond Turner shot test footage to demonstrate his system, but projecting it proved problematic and he died a year later without having satisfactorily projected the footage. Later, in 2012, curators at the National Media Museum in Bradford, UK, were able to take the original custom-format nitrate film copied to black-and-white 35 mm film, which was then scanned into a digital video format by telecine and digital image processing was used to align and combine each group of three frames into one color image so that these films from 1902 could become viewable in full color. The first feature length film that was made entirely in three-strip Technicolor, which was an early process where color filters were used to photograph the color components as completely separate images, came out on June 13, 1935.", "prediction 1": "On June 13, 1935, RKO premiered the first feature film shot entirely in advanced three-strip Technicolor, Becky Sharp. Early processes used color filters to photograph the color components as completely separate images (e.g., three-strip Technicolor) or adjacent microscopic image fragments (e.g., Dufaycolor). In some early color processes, the component images remained in black-and-white form and were projected through color filters to synthesize the original colors by the subtractive color method. Additive color adds lights of the primary colors in various proportions to the projected image.", "prediction 2": "The various additive systems entailed the use of color filters on both the movie camera and projector. Additive color adds lights of the primary colors in various proportions to the projected image. The first color films were made in 1935 and were called three-strip Technicolor. The first color TV program was made in 1955, and the first color television documentary was made in 1965.", "prediction 3": "On June 13, 1935, RKO premiered the first feature film shot entirely in advanced three-strip Technicolor, Becky Sharp. RKO Pictures had also produced the first color television program, \"The Great Gatsby\".", "prediction 4": "Color motion picture film started being made in the United States in the 1930s. The film industry first began working in color in 1938 when the U.S. Broadcasting Company launched the technology and RKO Pictures premiered the first feature film shot entirely in advanced three-strip Technicolor, Becky Sharp. Color motion pictures were made in the United States from 1936 to 1938.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 310 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 503 }, { "error type": "Irrelevant", "explanation": "", "start": 504, "end": 599 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In 1902, Turner shot test footage to demonstrate his system, but projecting it proved problematic because of the accurate registration (alignment) of the three separate color elements required for acceptable results. Turner died a year later without having satisfactorily projected the footage. In 2012, curators at the National Media Museum in Bradford, UK, had the original custom-format nitrate film copied to black-and-white 35 mm film, which was then scanned into a digital video format by telecine. On June 13, 1935, RKO premiered the first feature film shot entirely in advanced three-strip Technicolor. Early processes used color filters to photograph the color components as completely separate images (e.g., three-strip Technicolor). " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does the tournament of power arc start?", "passages": [ [ "Dragon Ball", "Dragon Ball\n\n, sometimes styled as \"Dragonball\", is a Japanese media franchise created by Akira Toriyama in 1984.", "The initial manga, written and illustrated by Toriyama, was serialized in \"Weekly Sh\u014dnen Jump\" from 1984 to 1995, with the 519 individual chapters collected into 42 \"tank\u014dbon\" volumes by its publisher Shueisha.", "\"Dragon Ball\" was initially inspired by the classical Chinese novel \"Journey to the West\".", "The series follows the adventures of the protagonist, Son Goku, from his childhood through adulthood as he trains in martial arts and explores the world in search of the seven orbs known as the Dragon Balls, which summon a wish-granting dragon when gathered.", "Along his journey, Goku makes several friends and battles a wide variety of villains, many of whom also seek the Dragon Balls.", "Toriyama's manga was adapted and divided into two anime series produced by Toei Animation: \"Dragon Ball\" and \"Dragon Ball Z\", which together were broadcast in Japan from 1986 to 1996.", "Additionally, the studio has developed 19 animated feature films and three television specials, as well as two anime sequel series titled \"Dragon Ball GT\" (1996\u20131997) and \"Dragon Ball Super\" (2015\u20132018)." ], [ "Dragon Ball Super", "Despite losing, Goku's efforts appease the God of Destruction enough that he decides to spare the planet.", "While Goku and Vegeta leave with Beerus and Whis to train for a year, the remaining remnants of Frieza's army arrive on Earth in search for the Dragon Balls to revive Frieza.", "A few months after coming back to life and training, Frieza gathers his forces and returns to enact his revenge on Goku.", "Despite achieving a new transformation, he is defeated by Goku and Vegeta, who have both mastered the Super Saiyan God Super Saiyan transformation.", "Frieza destroys the Earth in retaliation.", "With Whis's ability to turn back time, Goku is able to destroy Frieza again.", "Champa, Beerus' brother and the God of Destruction of Universe Six, convinces Beerus to hold a tournament between the best fighters from each god's universe for the possession of Earth.", "Goku and some of his friends join the tournament.", "Each match in the tournament shows different surprises and abilities.", "The tournament reaches its climax in the second-to-last match between Goku and Hit.", "After a failed attempt to lift the rules to face Hit in his full power, Goku forfeits the match." ], [ "Dragon Ball Z", "There have also been two sequel series; \"Dragon Ball GT\" (1996\u20131997) and \"Dragon Ball Super\" (2015\u20132018).", "\"Dragon Ball Z\" picks up five years after the end of the \"Dragon Ball\" anime, with Goku as a young adult and father to his son, Gohan.", "A humanoid alien named Raditz arrives on Earth in a spacecraft and tracks down Goku, revealing to him that he is his long-lost big brother and that they are members of a nearly extinct extraterrestrial race called the .", "The Saiyans had sent Goku (originally named \"\"Kakarot\"\") to Earth as an infant to conquer the planet for them, but he suffered a traumatic brain injury soon after his arrival and lost all memory of his mission, as well as his blood-thirsty Saiyan nature.", "Goku refuses to help Raditz continue the mission, which results in Raditz kidnapping Gohan.", "Goku decides to team up with his former enemy Piccolo in order to defeat Raditz and save his son, while sacrificing his own life in the process." ], [ "Dragon Ball Super", "The series ended on March\u00a025, 2018, with the conclusion of the \"Universe Survival Saga\".", "Fuji TV stated that no definite plans were made to either continue the series at a later date or discontinue it entirely.", "\"Dragon Ball Super\" received an English-language dub that premiered on the Toonami channel in Southeast Asia and India on January 21, 2017.", "This dub is produced by Los Angeles based Bang Zoom!", "Entertainment for the Asian market.", "A sneak preview of the English dub's first episode aired on December 17, 2016.", "Production on the Bang Zoom!", "dub ended after episode 27.", "On November 4, 2016, Funimation announced the company acquired the rights to \"Dragon Ball Super\" and would be producing an English dub, with many cast members of their previous English-language releases of \"Dragon Ball\" media reprising their respective roles.", "As well as officially announcing the dub, it was also announced they would be simulcasting the series on their streaming platform, \"FunimationNow\".", "On December 7, 2016, IGN reported that the Funimation English dub of \"Dragon Ball Super\" would air on Adult Swim Saturdays at 8 p.m. with an encore showing in their Toonami block later that night at 11:30\u00a0p.m. starting on January 7, 2017.", "This was later confirmed on Toonami's official Facebook page." ], [ "Dragon Ball", "Unlike the first two anime series, it is not based on Akira Toriyama's original \"Dragon Ball\" manga, being created by Toei Animation as a sequel to the series or as Toriyama called it, a \"grand side story of the original \"Dragon Ball.\"\" Toriyama designed the main cast, the spaceship used in the show, the design of three planets, and came up with the title and logo.", "In addition to this, Toriyama also oversaw production of the series, just as he had for the \"Dragon Ball\" and \"Dragon Ball Z\" anime.", "The television special episode, \"Goku's Side Story!", "The Proof of his Courage is the Four-Star Ball\", or \"\" as Funimation titled it for their dub, aired on March 26, 1997, between episodes 41 and 42, serving as a kind of precursor to the epilogue to the series shown at the end of episode 64.", "On April 28, 2015, Toei Animation announced , the first all-new \"Dragon Ball\" television series to be released in 18 years.", "It debuted on July 5 and ran as a weekly series at 9:00 am on Fuji TV on Sundays until its series finale on March 25, 2018 after 131 episodes.", "Masako Nozawa reprises her roles as Goku, Gohan, and Goten.", "Most of the original cast reprise their roles as well." ] ], "gold": "Dragon Ball Super, a sequel of Dragon Ball Z, features a tournament between the best fighters from across the universe. It started in Japan on July 5, 2015 and in the U.S. on January 7, 2017.", "prediction 1": "The Dragon Ball manga was written and illustrated by Akira Toriyama and first appeared in Shnen Jump in 1984. The series follows the adventures of the protagonist, Son Goku, from his childhood through adulthood as he trains in martial arts and explores the world in search of the seven orbs known as the Dragon Balls, which summon a wish-granting dragon when gathered. The first tournament of power arc starts on January 1, 2015, while the second tournament of power arc starts on January 4, 2015.\n", "prediction 2": "The Dragon Ball manga series, written and illustrated by Akira Toriyama, was initially serialized in Weekly Shnen Jump from 1984 to 1995. The initial manga was serialized in Dragon Ball: Super Original Sin (2001), which was adapted and divided into two anime series produced by Toei Animation: Dragon Ball Z and Dragon Ball Super. In the episode 19 of the show, titled \"The Tournament of Power Arc\", Champa, Beerus' brother convinces Beerus to hold a tournament between the best fighters from each god's universe to win. The first match of the tournament of the Super Saiyans reaches its climax in the second-to-to-final match between Goku and Vegeta. On November 4, 2016, the English dub premiered on the Toonami channel in Southeast Asia and India.", "prediction 3": "In the 2014 video game franchise Dragon Ball, Goku and Vegeta are portrayed as sons of God. Goku and Vegeta join Beerus' army over a year long travel to search for the seven orbs known as the Dragon Balls, which summon a wish-granting dragon when gathered. While Goku and Vegeta leave with Beerus and Whis to train for a year, the remnants of Frieza's army arrive on Earth in search of the Dragon Balls to revive Frieza. While Goku and Vegeta leave with Beerus and Whis to teach themselves how to transform into a month later, Goku is able to turn back time and then able to destroy Frieza again. On November 4, 2016, Goku uses a new Super Saiyan god to attack, who is defeated by Goku.", "prediction 4": "In the animated manga series Dragon Ball, creator Akira Toriyama holds a tournament for the possess of the planet Earth. Thus, Goku participates in the tournament and competes against other characters in different matches to try and become the Super Saiyan God. Horicon reveals the Dying Light Plane to Goku, who uses it to destroy him.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 368 }, { "error type": "Unverifiable", "explanation": "", "start": 369, "end": 498 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Dragon Ball Super, a sequel of Dragon Ball Z, features a tournament between the best fighters from across the universe. \"Dragon Ball Super\" would air on Adult Swim Saturdays starting on January 7, 2017.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What causes the tide to come in and out?", "passages": [ [ "Tide", "When the Moon is closest, at perigee, the range increases, and when it is at apogee, the range shrinks.", "Every lunations (the full cycles from full moon to new to full), perigee coincides with either a new or full moon causing perigean spring tides with the largest \"tidal range\".", "Even at its most powerful this force is still weak, causing tidal differences of inches at most.", "These include solar gravitational effects, the obliquity (tilt) of the Earth's Equator and rotational axis, the inclination of the plane of the lunar orbit and the elliptical shape of the Earth's orbit of the Sun.", "A compound tide (or overtide) results from the shallow-water interaction of its two parent waves.", "Because the \"M\" tidal constituent dominates in most locations, the stage or \"phase\" of a tide, denoted by the time in hours after high water, is a useful concept.", "Tidal stage is also measured in degrees, with 360\u00b0 per tidal cycle.", "Lines of constant tidal phase are called \"cotidal lines\", which are analogous to contour lines of constant altitude on topographical maps.", "High water is reached simultaneously along the cotidal lines extending from the coast out into the ocean, and cotidal lines (and hence tidal phases) advance along the coast." ], [ "King tide", "King tide\n\n\"\"King tide\"\" is a colloquial term for an especially high spring tide, such as a perigean spring tide.", "\"King tide\" is not a scientific term, nor is it used in a scientific context.", "The use of the term \"\"king tide\"\" originated in Australia, New Zealand and other Pacific nations to refer to an especially high tide that occurs only a few times per year.", "The term has now come to be used in North America as well, particularly in low-lying South Florida, where they cause sunny day tidal flooding.", "King tides are the highest tides.", "They are naturally occurring, predictable events.", "Tides are the movement of water across Earth's surface caused by the combined effects of the gravitational forces exerted by the Moon, Sun, and the rotation of Earth which manifest in the local rise and fall of sea levels.", "Tides are driven by the relative positions of the Earth, Sun, Moon, land formations, and relative location on Earth.", "In the lunar month, the highest tides occur roughly every 14 days, at the new and full moons, when the gravitational pull of the Moon and the Sun are in alignment.", "These highest tides in the lunar cycle are called spring tides.", "The proximity of the Moon in relation to Earth and Earth in relation to the Sun also has an effect on tidal ranges." ], [ "Tide", "This rotation, caused by the Coriolis effect, is generally clockwise in the southern hemisphere and counterclockwise in the northern hemisphere.", "The difference of cotidal phase from the phase of a reference tide is the \"epoch\".", "The reference tide is the hypothetical constituent \"equilibrium tide\" on a landless Earth measured at 0\u00b0 longitude, the Greenwich meridian.", "In the North Atlantic, because the cotidal lines circulate counterclockwise around the amphidromic point, the high tide passes New York Harbor approximately an hour ahead of Norfolk Harbor.", "South of Cape Hatteras the tidal forces are more complex, and cannot be predicted reliably based on the North Atlantic cotidal lines.", "Investigation into tidal physics was important in the early development of celestial mechanics, with the existence of two daily tides being explained by the Moon's gravity.", "Later the daily tides were explained more precisely by the interaction of the Moon's and the Sun's gravity.", "Seleucus of Seleucia theorized around 150 B.C. that tides were caused by the Moon.", "The influence of the Moon on bodies of water was also mentioned in Ptolemy's \"Tetrabiblos\".", "In \"De temporum ratione\" (\"The Reckoning of Time\") of 725 Bede linked semidurnal tides and the phenomenon of varying tidal heights to the Moon and its phases." ] ], "gold": "Tides are the rise and fall of sea levels caused by the combined effects of the gravitational forces exerted by the Moon and the Sun, and the rotation of the Earth. The changing distance separating the Moon and Earth also affects tide heights. Investigation into tidal physics was important in the early development of celestial mechanics, with the existence of two daily tides being explained by the Moon's gravity.", "prediction 1": "The movement of water across Earth's surface is caused by the combined effects of the gravitational forces exerted by the Moon, Sun, and the rotation of Earth. The gravitational pull of the Moon and the Sun are in alignment. The phases of the Moon affect the tidal range. The Moon's gravitational pull increases the range of the tide, while the Moon's gravitational pull decreases it.\n", "prediction 2": "With the Moon at its closest position, the range of the Earth's tide will increase when the Earth reaches perigee, and shrink when the Earth reaches its apogee. Even at its most powerful this force is still weak, causing tidal differences of only a few inches at most. This causes seasonal tide fluctuations, which occur between the new and full moons.", "prediction 3": "If the Moon is at perigee, or closer to Earth than Earth, the tidal range changes. This shift occurs when the Earth becomes submerged in water and the tidal winds are paid off by the gravitational attraction of the Moon with Earth's orbit. The effects of this gravitational attraction cause the tide to come in and out in different ways.", "prediction 4": "The cycle of the lunar month produces the highest tide, known as a \"spring tide.\" These highest tides occur when the gravitational pull of the Moon and the Sun are in alignment. The phases of the moon affect the magnitude and direction of the tide. When the Moon is closer, at perigee, the range increases, and when it is at apogee, the range shrinks. The moonrise and sunset together cause the precise time at which the tide comes in and out.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 385 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The movement of water across Earth's surface is caused by the combined effects of the gravitational forces exerted by the Moon, Sun, and the rotation of Earth. The phases of the Moon affect the tidal range. Investigation into tidal physics was important in the early development of celestial mechanics, with the existence of two daily tides being explained by the Moon's gravity.\n" }, "preference": [ 1, 1, 1, 0, 0, 2 ] }, { "question": "How many stages are there to the tour de france?", "passages": [ [ "Tour de France", "Tour de France\n\nThe Tour de France () is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries.", "Like the other Grand Tours (the Giro d'Italia and the Vuelta a Espa\u00f1a), it consists of 21 day-long stages over the course of 23 days.", "The race was first organized in 1903 to increase sales for the newspaper \"L'Auto\" and is currently run by the Amaury Sport Organisation.", "The race has been held annually since its first edition in 1903 except when it was stopped for the two World Wars.", "As the Tour gained prominence and popularity, the race was lengthened and its reach began to extend around the globe.", "Participation expanded from a primarily French field, as riders from all over the world began to participate in the race each year.", "The Tour is a UCI World Tour event, which means that the teams that compete in the race are mostly UCI WorldTeams, with the exception of the teams that the organizers invite.", "Traditionally, the race is held primarily in the month of July.", "While the route changes each year, the format of the race stays the same with the appearance of time trials, the passage through the mountain chains of the Pyrenees and the Alps, and the finish on the Champs-\u00c9lys\u00e9es in Paris." ], [ "Tour de France", "Long-distance cycle races were a popular means to sell more newspapers, but nothing of the length that Lef\u00e8vre suggested had been attempted.", "If it succeeded, it would help \"L'Auto\" match its rival and perhaps put it out of business.", "It could, as Desgrange said, \"nail Giffard's beak shut.\"", "Desgrange and Lef\u00e8vre discussed it after lunch.", "Desgrange was doubtful but the paper's financial director, Victor Goddet, was enthusiastic.", "He handed Desgrange the keys to the company safe and said: \"Take whatever you need.\"", "\"L'Auto\" announced the race on 19 January 1903.", "The first Tour de France was staged in 1903.", "The plan was a five-stage race from 31 May to 5 July, starting in Paris and stopping in Lyon, Marseille, Bordeaux, and Nantes before returning to Paris.", "Toulouse was added later to break the long haul across southern France from the Mediterranean to the Atlantic.", "Stages would go through the night and finish next afternoon, with rest days before riders set off again.", "But this proved too daunting and the costs too great for most and only 15 competitors had entered.", "Desgrange had never been wholly convinced and he came close to dropping the idea." ], [ "2020 Tour de France", "2020 Tour de France\n\nThe 2020 Tour de France will be the 107th edition of the Tour de France, one of cycling's three grand tours.", "The start of the 2020 Tour (known as the \"Grand D\u00e9part\") will be in Nice.", "This will be the second occasion that the city has held the \"Grand D\u00e9part\", the first being for the 1981 Tour de France.", "This will also be the 36th occasion on which the Tour de France has visited Nice, and the first time since the 2013 Tour de France." ] ], "gold": "The Tour de France was first organized in 1903 and had 6 stages: Paris, Lyon, Marseille, Bordeaux, Nantes, and Toulouse. Today, it consists of 21 stages, each a day long, over the course of 23 days.", "prediction 1": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The race was first organized in 1903 to increase sales for the newspaper \"L'Auto\" and is currently run by the Amaury Sport Organisation. The first Tour de France was staged in 1903. The plan was a five-stage race from 31 May to 5 July, starting in Paris and stopping in Lyon, Marseille, Bordeaux, and Nantes before returning to Paris. However, the long haul across southern France was added later to break the long haul across the Mediterranean to the Atlantic. The 2020 Tour de France will be the 107th edition of the Tour de France, one of cycling's three grand tours.", "prediction 2": "There are 21 stages to the Tour de France, one of cycling's three Grand Tours. The first stage of the race was staged on May 31, 1903.", "prediction 3": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The first Tour de France was staged in 1903. The plan was a five-stage race from 31 May to 5 July, starting in Paris and stopping in Lyon, Marseille, Bordeaux, and Nantes before returning to Paris. However, this proved too daunting and the costs too great for most and only 15 competitors had entered. The 2020 Tour de France will be the 107th edition of the Tour de France, one of cycling's three grand tours.", "prediction 4": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The first Tour de France was staged in 1903. The plan was a five-stage race from 31 May to 5 July, starting in Paris and stopping in Lyon, Marseille, Bordeaux, and Nantes before returning to Paris. Then, a 13-stage race from 26 June to 12 July 1909 was added to the race. The 21-stage race is now in its 108th edition.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 286 }, { "error type": "Redundant", "explanation": " The race was first organized in 1903", "start": 287, "end": 331 }, { "error type": "Irrelevant", "explanation": "", "start": 458, "end": 611 }, { "error type": "Irrelevant", "explanation": "", "start": 332, "end": 385 }, { "error type": "Irrelevant", "explanation": "", "start": 612, "end": 720 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": " The race was first organized in 1903 and started in Paris with stops in Lyon, Marseille, Bordeaux, Nantes and Toulouse. It now consists of 21 stages, each a day long, over the course of 23 days." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who wrote the music for conan the barbarian?", "passages": [ [ "Conan the Barbarian (1982 film)", "Conan the Barbarian (1982 film)\n\nConan the Barbarian is a 1982 American fantasy adventure film directed and co-written by John Milius.", "It is based on stories by Robert E. Howard, a pulp-fiction writer of the 1930s, about the adventures of the eponymous character in a fictional prehistoric world of dark magic and savagery.", "The film stars Arnold Schwarzenegger and James Earl Jones, and tells the story of a young barbarian (Schwarzenegger), who seeks vengeance for the death of his parents at the hands of Thulsa Doom (Jones), the leader of a snake cult.", "Buzz Feitshans and Raffaella De Laurentiis produced the film for her father Dino De Laurentiis, with Edward R. Pressman as an executive producer.", "Basil Poledouris composed the music.", "Ideas for a Conan film were proposed as early as 1970; Pressman and associate producer Edward Summer began a concerted effort to get the film made in 1975.", "It took them two years to obtain the film rights, after which they recruited Schwarzenegger for the lead role and Oliver Stone to draft a script.", "Pressman lacked capital for the endeavor, and in 1979, after having his proposals for investments rejected by the major studios, he sold the project to Dino De Laurentiis.", "Milius was appointed as director and he rewrote Stone's script." ], [ "Conan the Barbarian (2011 film)", "Conan the Barbarian (2011 film)\n\nConan the Barbarian is a 2011 American sword and sorcery film based on the character of the same name created by Robert E. Howard.", "The film is a new interpretation of the \"Conan\" mythology, and is not related to the films featuring Arnold Schwarzenegger.", "It stars Jason Momoa in the title role, alongside Rachel Nichols, Rose McGowan, Stephen Lang, Ron Perlman, and Bob Sapp with Marcus Nispel directing.", "The film had spent several years in development at Warner Bros., before the rights were shifted to Nu Image/Millennium Films in 2007, with a clause wishing for immediate start on production.", "Lionsgate and Sony Pictures entered negotiations for distribution, with the film seeing many directors, prominently Brett Ratner, before settling on Nispel in 2009, and subsequently bringing together a cast and crew.", "Filming began on March 15, 2010, and concluded June 5, 2010.", "The film was first released on August 17, 2011, in four countries: France, Belgium, Iceland, and the Philippines prior to the North American release on August 19.", "The film was a box office bomb, and received largely negative reviews.", "Conan is the son of Corin, the chief of a barbarian tribe.", "The youth is a skilled but violent warrior, who his father believes is not ready to wield his own sword." ], [ "Basil Poledouris", "Basil Poledouris\n\nBasil Konstantine Poledouris (; August 21, 1945 \u2013 November 8, 2006) was an American composer, conductor, and orchestrator of film and television scores, best known for his long-running collaborations with directors John Milius and Paul Verhoeven.", "His best known works include music for films like \"Conan the Barbarian\" (1982), \"Red Dawn\" (1984), \"RoboCop\" (1987), \"The Hunt for Red October\" (1990), \"Free Willy\" (1993), and \"Starship Troopers\" (1997).", "Poledouris won the Primetime Emmy Award for Outstanding Music Composition for a Limited Series, Movie, or Special for his work on the four-part miniseries \"Lonesome Dove\" in 1989, and was a four-time recipient of the BMI Film Music Award.", "Born in Kansas City, Missouri, he credited two influences with guiding him towards music: the first was composer Mikl\u00f3s R\u00f3zsa; the second his own Greek Orthodox heritage.", "Poledouris was raised in the Church, and he used to sit in services enthralled by the choir's sound.", "At the age of seven, Poledouris began piano lessons, and after high school graduation, he enrolled at the University of Southern California to study both filmmaking and music." ] ], "gold": "There have been multiple Conan the Barbarian films. Basil Poledouris wrote the music for the 1982 film in which Arnold Schwarzenegger starred. Thomas Kloss wrote the music for the 2011 version starring Jason Momoa. The 2011 film was a new interpretation of the Conan myth, and was not related to the films featuring Arnold Schwarzenegger.", "prediction 1": "Conan the Barbarian is a 1982 American fantasy adventure film directed and co-written by John Milius. Basil Poledouris, an American composer, conductor, and orchestrator of film and television scores, composed the music for the film. His best known works include music for films like \"Conan the Barbarian\" (1982), \"Red Dawn\" (1984), \"RoboCop\" (1987), \"The Hunt for Red October\" (1990), and \"Free Willy\" (1993). The 2011 American sword and sorcery film is a 2011 American sword and sorcery film based on the character of the same name created by Robert E. Howard. Conan is a new interpretation of the \"Conan\" mythology, and not related to the character of the same name created by Robert E. Howard.", "prediction 2": "Conan the Barbarian is a 1982 American fantasy adventure film directed and co-written by John Milius. Basil Poledouris, an American composer, conductor, and orchestrator of film and television scores, composed the music for the film. His best known works include music for films like Conan the Barbarian, Red Dawn, and RoboCop, and his work on the miniseries Lonesome Dove.", "prediction 3": "Conan the Barbarian is a 1982 American fantasy adventure film directed and co-written by John Milius. Basil Poledouris composed the music for the film. Conan the Barbarian is a 2011 American sword and sorcery film based on the character of the same name created by Robert E. Howard.", "prediction 4": "Basil Konstantine Poledouris composed the music for Conan the Barbarian, a 1982 American fantasy action film directed and co-written by John Milius. His best known works include music for films like \"Conan the Barbarian\" (1982), \"Red Dawn\", (1984), \"RoboCop\", (1987), \"The Hunt for Red October,\" (1990), \"Free Willy,\" (1993), and \"Starship Troopers,\" (1997).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 101 }, { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 200 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 410 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 415, "end": 451 }, { "error type": "Irrelevant", "explanation": "", "start": 494, "end": 562 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 642, "end": 697 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Conan the Barbarian is a 1982 American fantasy adventure film. The film stars Arnold Schwarzenegger. Basil Poledouris composed the music for the film. Conan the Barbarian is a 2011 American sword and sorcery film. Conan is a new interpretation of the \"Conan\" mythology, and not related to the films featuring Arnold Schwarzenegger. It stars Jason Momoa. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who is elected as vice president of india?", "passages": [ [ "Vice President of India", "Vice President of India\n\nThe Vice-President of India is the second-highest constitutional office in India after the President.", "Article 63 of Indian Constitution states that \"there shall be a Vice-President of India.\"", "The Vice-President acts as President in the absence of the President due to death, resignation, impeachment, or other situations.", "The Vice-President of India is also \"ex officio\" Chairperson of the Rajya Sabha.", "When a bill is introduced in Rajya Sabha, vice-president decides whether it is a financial bill or not.", "If he is of the opinion, a bill introduced in the Rajya Sabha is a money bill, he would refer the case to the Speaker of the Lok Sabha for deciding it.", "Article 66 of the Indian Constitution states the manner of election of the Vice-President.", "The Vice-President is elected indirectly by members of an electoral college consisting of the members of both Houses of Parliament in accordance with the system of Proportional Representation by means of the Single transferable vote and the voting is by secret ballot conducted by election commission.", "Venkaiah Naidu is the Vice President of India.", "He defeated UPA's candidate Gopalkrishna Gandhi on 5 August 2017 election." ], [ "Mohammad Hamid Ansari", "Mohammad Hamid Ansari\n\nMohammad Hamid Ansari (; born 1 April 1937) is an Indian politician who served as the 12th Vice-President of India from 2007 to 2017.", "He has also served as an Indian ambassador and is ex-chairman of Rajya Sabha.", "Ansari was the first person to be re-elected as Indian VP after Sarvepalli Radhakrishnan in 1957.", "He served as President of the Indian Institute of Public Administration, Chancellor of Panjab University , Delhi University , Pondicherry University and the President of the Indian Council of World Affairs in his capacity as vice president\n\nAnsari worked as an ambassador and served as the Vice-Chancellor of the Aligarh Muslim University from 2000 to 2002.", "Later he was Chairman of the National Commission for Minorities from 2006 to 2007.", "He was elected as the Vice-President of India on 10 August 2007 and took office on 11 August 2007.", "He was reelected on 7 August 2012 and was sworn-in by Pranab Mukherjee, the President of India.", "The oath taking ceremony was conducted at Rashtrapati Bhavan on 11 August 2012.", "His second term ended in August 2017 since he was not offered another term,he decided not to run for a third term in the 2017 vice-presidential election." ], [ "Venkaiah Naidu", "Venkaiah Naidu\n\nMuppavarapu Venkaiah Naidu (born 1 July 1947) is an Indian politician and the current Vice President of India, in office since 11 August 2017.", "Previously, he served as the Minister of Housing and Urban Poverty Alleviation, Urban Development and Information and Broadcasting in the Modi Cabinet.", "A prominent leader of the Bharatiya Janata Party, he also served as its national president from 2002 to 2004.", "Earlier, he was the Union Cabinet Minister for Rural Development in the Atal Bihari Vajpayee government.", "He took the oath as Vice-President of India on 11 August 2017.", "Venkaiah Naidu was born on 1 July 1947 at Unguturu, in the West Godavari District of the Indian state of Andhra Pradesh.", "He completed his schooling from Zilla Parshad High School, Bucchireddy Palem (Nellore), and pursued his bachelor's degree in politics and diplomatic studies from V. R. College.", "Later, he acquired a bachelor's degree in law with specialisation in international law from Andhra University College of Law, Visakhapatnam.", "He was a swayamsevak in the Rashtriya Swayamsevak Sangh and joined ABVP during his college days." ] ], "gold": "A number of politicians have been elected as the vice president of India. Indian politician Venkaiah Naidu was elected the vice president of India on August 5, 2017. Mohammad Hamid Ansari was elected as the vice president of India in 2007 and 2012 and served as the vice president of India from 2007 to 2017.", "prediction 1": "There are multiple people elected as vice president of India. In the Indian Constitution, Article 63 states that \"there shall be a Vice-President of India.\" The current vice president of India is Venkaiah Naidu, who was elected on 5 August 2017, replacing Gopalkrishna Gandhi.", "prediction 2": "There are two vice-presidents of India and two vice-presidential candidates. Muppavarapu Venkaiah Naidu and Mohammad Hamid Ansari are both Indian politicians who served as the 12th and 13th Vice-Presidents of India from 2007 to 2017. Muppavarapu Naidu was elected as the Vice-President of India on 5 August 2017 and has been in office since 11 August 2017.", "prediction 3": "The Vice-President of India is the second-highest constitutional office in India after the President. The Vice-President acts as President in the absence of the President due to death, resignation, impeachment, or other situations. The first person to be re-elected as Indian VP after Sarvepalli Radhakrishnan in 1957 was Mohammad Hamid Ansari. He was elected as the Vice-President of India on 10 August 2007 and took office on 11 August 2007. He was re-elected on 7 August 2012 and was sworn-in on 11 August 2017. He was reelected on 7 August 2012 and was sworn-in by Pranab Mukherjee, the last time.", "prediction 4": "The Vice-President of India is the second-highest constitutional office in India after the President. Article 63 of Indian Constitution states that \"there shall be a Vice-President of India.\" The Vice-President acts as President in the absence of the President due to death, resignation, impeachment, or other situations. Mohammad Hamid Ansari served as the 12th Vice-President of India from 2007 to 2017. He was reelected on 7 August 2012 and was sworn-in by Pranab Mukherjee, the President of India. He was reelected on 10 August 2007 and took office on 11 August 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 156 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 276 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are multiple people elected as vice president of India. The current vice president of India is Venkaiah Naidu, who was elected on 5 August 2017. Mohammad Hamid Ansari served as the 12th Vice-President of India from 2007 to 2017." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What linux distribution is considered a cutting-edge distribution?", "passages": [ [ "Fedora (operating system)", "Fedora Linux was eventually absorbed into the Fedora Project, carrying with it this collaborative approach.", "Fedora Linux was launched in 2003, when Red Hat Linux was discontinued.", "Red Hat Enterprise Linux was to be Red Hat's only officially supported Linux distribution, while Fedora was to be a community distribution.", "Red Hat Enterprise Linux branches its releases from versions of Fedora.", "Before Fedora 7, Fedora was called Fedora Core after the name of one of the two main software repositories - Core and Extras.", "Fedora Core contained all the base packages that were required by the operating system, as well as other packages that were distributed along with the installation CD/DVDs, and was maintained only by Red Hat developers.", "Fedora Extras, the secondary repository that had been included since Fedora Core 3, was community-maintained and not distributed along with the installation CD/DVDs.", "Upon the release of Fedora 7, the distinction between Fedora Core and Fedora Extras was eliminated.", "Since the release of Fedora 21, as an effort to modularize the Fedora distribution and make development more agile, three different versions are available: \"Workstation\", focused on the personal computer, \"Server\" and \"Atomic\" for servers, \"Atomic\" being the version meant for cloud computing." ], [ "Fedora (operating system)", "Fedora (operating system)\n\n", "Fedora is a Linux distribution developed by the community-supported Fedora Project and sponsored by Red Hat.", "Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies.", "Fedora is the upstream source of the commercial Red Hat Enterprise Linux distribution.", "Since the release of Fedora 21, three different editions are currently available: \"Workstation\", focused on the personal computer, \"Server\" for servers, and \"Atomic\" focused on cloud computing.", ", Fedora has an estimated 1.2 million users, including Linus Torvalds, creator of the Linux kernel.", "Fedora has a reputation for focusing on innovation, integrating new technologies early on and working closely with upstream Linux communities.", "Making changes upstream instead of specifically for Fedora ensures that the changes are available to all Linux distributions.", "Fedora has a relatively short life cycle: each version is usually supported for at least 13 months, where version is supported only until 1 month after version +2 is released and with approximately 6 months between most versions.", "Fedora users can upgrade from version to version without reinstalling.", "The default desktop environment in Fedora is GNOME and the default user interface is the GNOME Shell." ], [ "Rolling distribution", "Antergos, ArchBSD/PacBSD, Arch Hurd, ArchBang, Bridge Linux, Chakra Linux, CTKArch, Manjaro Linux, Nosonja Linux and Parabola GNU/Linux-libre (among others) are all rolling release binary-based Linux distributions related to, derived from, or based on, the independent rolling release binary-based Linux distribution Arch Linux.", "\"See list of Linux distributions#Pacman-based for a list of Linux distributions using Arch Linux's Pacman package manager.", "\"
\n\"See Arch Based Distributions (Active) on the Arch Linux Wiki for a list of currently active Arch-based distributions.\"", "Aptosid, siduction and Semplice are rolling-release Deb binary-based Linux distributions based on Debian unstable, Debian's unstable development branch (\"Sid\") is cyclical rolling release Deb binary-based Linux distributions based on Debian testing.", "Debian testing is a cyclical development branch and is thus frozen before each release of Debian stable.", "During this time, Debian testing is no longer rolling, which affects rolling distributions based on it\u00a0\u2014 like antiX." ] ], "gold": "Several Linux distributions are considered cutting-edge distributions. The antiX Linux distribution is considered cutting-edge with respect to kernel and applications. Also, the Fedora Linux distribution is considered a leading-edge distribution. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of free technologies.", "prediction 1": "Fedora is a Linux distribution developed by the community-supported Fedora Project and sponsored by Red Hat. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies. Arch Linux is considered a rolling distribution, meaning that each version is usually supported for at least 13 months.", "prediction 2": "Fedora is a Linux distribution developed by the community-supported Fedora Project and sponsored by Red Hat. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies. Arch Linux is one such distribution.", "prediction 3": "Fedora is a Linux distribution developed by the community-supported Fedora Project and sponsored by Red Hat. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies. Arch Linux is considered to be a cutting-edge distribution. Aptosid, siduction and Semplice are rolling-release Deb binary-based Linux distributions based on Debian unstable.", "prediction 4": "Fedora is a Linux distribution developed by the community-supported Fedora Project and sponsored by Red Hat. Fedora contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies. Antergos, ArchBSD/PacBSD, Arch Hurd, ArchBang, Bridge Linux, Chakra Linux, Chakra Linux, Nosonja Linux and Parabola GNU/Linux-libre are rolling-release Deb binary-based Linux distributions based Linux.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 31, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 366 } ], "missing-info": [], "corrected-prediction": "Fedora is a Linux distribution that contains software distributed under various free and open-source licenses and aims to be on the leading edge of such technologies. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who was president when the bombs were dropped on japan?", "passages": [ [ "Harry S. Truman", "Harry S. Truman\n\nHarry S. Truman (May 8, 1884 \u2013 December 26, 1972) became the 33rd President of the United States (1945\u20131953) upon the death of Franklin D. Roosevelt after serving as Vice President.", "He implemented the Marshall Plan to rebuild the economy of Western Europe, and established the Truman Doctrine and NATO.", "Truman was elected as a U.S. Senator in 1934 and gained national prominence as chairman of the Truman Committee aimed at waste and inefficiency in wartime contracts.", "Soon after succeeding to the presidency he became the only world leader to have used nuclear weapons in war.", "Truman\u2019s administration engaged in an internationalist foreign policy and renounced isolationism.", "He rallied his New Deal coalition during the 1948 presidential election and won a surprise victory that secured his own presidential term.", "Truman oversaw the Berlin Airlift of 1948.", "When Communist North Korea invaded South Korea in 1950, he gained United Nations approval for the very large police action known as the Korean War.", "It saved South Korea but the Chinese intervened, driving back the UN/US forces and preventing a rollback of Communism in North Korea.", "On domestic issues, bills endorsed by Truman faced opposition from a conservative Congress, but his administration successfully guided the U.S. economy through the post-war economic challenges." ], [ "Harry S. Truman", "Truman always said that attacking Japan with atomic bombs saved many lives on both sides; military estimates for the invasion of mainland Japan were that it could take a year and result in 250,000 to 500,000 U.S. casualties.", "Hiroshima was bombed on August 6, and Nagasaki three days later, leaving 105,000 dead.", "The Soviet Union declared war on Japan on August 9 and invaded Manchuria.", "Japan agreed to surrender the following day.", "Supporters of Truman's decision argue that, given the tenacious Japanese defense of the outlying islands, the bombings saved hundreds of thousands of lives of prisoners, civilians, and combatants on both sides that would have been lost in an invasion of Japan.", "Critics have argued that the use of nuclear weapons was unnecessary, given that conventional tactics such as the equally-devastating firebombing and naval blockade would have forced Japan's surrender.", "During the 1948 presidential campaign, Truman defended his decision to deploy atomic bombs during the war:\n\nTruman continued to strongly defend himself in his memoirs in 1955\u201356, stating that many lives could have been lost had the U.S. invaded mainland Japan without the atomic bombs.", "In 1963, he stood by his decision, telling a journalist that \"it was done to save 125,000 youngsters on the U.S. side and 125,000 on the Japanese side from getting killed and that is what it did." ], [ "Debate over the atomic bombings of Hiroshima and Nagasaki", "Ky\u016bma, who is from Nagasaki, said the bombing caused great suffering in the city, but he does not resent the U.S. because it prevented the Soviet Union from entering the war with Japan.", "Ky\u016bma's comments were similar to those made by Emperor Hirohito when, in his first ever press conference given in Tokyo in 1975, he was asked what he thought of the bombing of Hiroshima, and answered: \"It's very regrettable that nuclear bombs were dropped and I feel sorry for the citizens of Hiroshima but it couldn't be helped (shikata ga nai) because that happened in wartime.\"", "In early July 1945, on his way to Potsdam, Truman had re-examined the decision to use the bomb.", "In the end, he made the decision to drop the atomic bombs on strategic cities.", "His stated intention in ordering the bombings was to save American lives, to bring about a quick resolution of the war by inflicting destruction, and instilling fear of further destruction, sufficient to cause Japan to surrender." ] ], "gold": "Harry S. Truman was president when bombs were dropped on Japan. After the Japanese government refused to surrender, Truman went forward with having Hiroshima bombed, and Nagasaki bombed three days later, leaving 105,000 dead. Truman always said attacking Japan with atomic bombs saved many lives on both sides. When asked about the bombing of Hiroshima, the Japanese emperor at the time, Emperor Sh\u014dwa, who was better known in English by his personal name Hirohito, said \"It's very regrettable that nuclear bombs were dropped and I feel sorry for the citizens of Hiroshima but it couldn't be helped because that happened in wartime.\" ", "prediction 1": "Harry S. Truman became the 33rd president of the United States after the death of Franklin D. Roosevelt in 1945. Truman always said that attacking Japan with atomic bombs saved many lives on both sides, and military estimates for the invasion of mainland Japan were that it could take a year and result in 250,000 to 500,000 U.S. casualties. However, he argued that the bombings saved hundreds of thousands of lives, given the tenacious Japanese defense of the outlying islands, and that the bombings were necessary, given the Soviet Union's invasion of Japan and Japan agreed to surrender on August 9, 1945. The Soviet Union declared war on August 9, and invaded Manchuria, and invaded Manchuria. Japan agreed to surrender the following day, and agreed to surrender the following day.", "prediction 2": "Harry S. Truman was the 33rd President of the United States from 1945-1953, and the only world leader to have used nuclear weapons in war. The atomic bombs were dropped on Hiroshima and Nagasaki in August 1945, and were intended to save American lives.", "prediction 3": "Truman was the 33rd President of the United States during the time that the atomic bombs were dropped on Japan. Truman always said that attacking Japan with atomic bombs saved many lives on both sides. Military estimates for the invasion of mainland Japan were that it could take a year and result in 250,000 to 500,000 U.S. casualties. Truman continued to strongly defend himself in his memoirs in 1955\u201356, stating that many lives could have been lost had the U.S. invaded mainland Japan without the atomic bombs.", "prediction 4": "Harry S. Truman was the 33rd president of the United States during the time of the atomic bombings of Hiroshima and Nagasaki. He reacted to the attacks with a strong stance against isolationism, saying that attacking Japan with atomic bombs saved many lives on both sides. Truman continued to stand by his decision, telling a journalist that \"it was done to save 125,000 youngsters on the U.S. side and 125,000 on the Japanese side from getting killed and that is what it did.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 112 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 341 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 351, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 516 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 517, "end": 559 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3,4]}", "start": 590, "end": 608 }, { "error type": "Redundant", "explanation": "However, he argued that the bombings saved hundreds of thousands of lives, given the tenacious Japanese defense of the outlying islands, and that the bombings were necessary, given the Soviet Union's invasion of Japan and Japan agreed to surrender on August 9, 1945. ", "start": 609, "end": 674 }, { "error type": "Redundant", "explanation": "The Soviet Union declared war on August 9, and invaded Manchuria, and ", "start": 679, "end": 697 }, { "error type": "Redundant", "explanation": "However, he argued that the bombings saved hundreds of thousands of lives, given the tenacious Japanese defense of the outlying islands, and that the bombings were necessary, given the Soviet Union's invasion of Japan and Japan agreed to surrender on August 9, 1945. ", "start": 698, "end": 742 }, { "error type": "Redundant", "explanation": "Japan agreed to surrender the following day, and ", "start": 747, "end": 785 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Truman was the President during the bombings. Truman always said that attacking Japan with atomic bombs saved many lives on both sides. Hiroshima was bombed on August 6, and Nagasaki three days later, leaving 105,000 dead. Emperor Hirohito when asked what he thought of the bombing of Hiroshima, and answered: \"It's very regrettable that nuclear bombs were dropped and I feel sorry for the citizens of Hiroshima but it couldn't be helped because that happened in wartime.\"" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays the wife in how i met your mother?", "passages": [ [ "The Mother (How I Met Your Mother)", "The Mother (How I Met Your Mother)\n\nTracy McConnell (colloquial: \"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\".", "The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother.", "Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "The Mother is played by Cristin Milioti.", "The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment.", "Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in \"Last Forever\", the series finale.", "The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "An alternate ending was released in the ninth season DVD." ], [ "Pilot (How I Met Your Mother)", "With Ted being based on Bays and Marshall and Lily based on Thomas and his wife.", "Thomas' wife Rebecca was initially reluctant to have a character based on her, but agreed if they could get Alyson Hannigan to play her.", "Hannigan was looking to do more comedy work, and was available.", "Josh Radnor and Jason Segel, who were cast as Ted and Marshall, respectively, were not well known, though Segel had been a cast member on the short-lived \"Freaks and Geeks\" and a recurring guest star on Judd Apatow follow-up \"Undeclared\".", "The role of Barney was initially envisioned as a \"John Belushi-type character\" before Neil Patrick Harris won the role after being invited to an audition by the show's casting director Megan Branman.", "Pamela Fryman invited Bob Saget to be the voiceover narrator, Future Ted, explaining to him that the show would be like \"The Wonder Years\" but \"kind of into the future\".", "Saget either went to the television studio and recorded the narration while watching the episode, or did so separately and rerecorded with the episode if necessary.", "He normally did not attend table readings, but did so for the last episode." ], [ "Cristin Milioti", "Cristin Milioti\n\nCristin Milioti (born August 16, 1985) is an American actress and vocalist.", "She has worked in Broadway theatre productions such as \"That Face\", \"Stunning\", and the Tony Award-winning musical \"Once\".", "She also played the titular Mother on the sitcom \"How I Met Your Mother\" from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film \"The Wolf of Wall Street\", and Betsy Solverson in the second season of \"Fargo\" (2015).", "She has won a Grammy Award and has been nominated for a Tony Award.", "Milioti was born on August 16, 1985 in Cherry Hill, New Jersey.", "She is of Italian descent, and calls her family \"Olive Garden Italian\".", "In middle school, she found her love of acting at Long Lake Camp for the Arts in New York state.", "She graduated in 2003 from Cherry Hill High School East, where she began performing in school plays.", "She took acting classes at New York University, but dropped out during her freshman year.", "However, she is listed in the university's advertising.", "Milioti's first acting roles were bit parts in national advertising campaign ads, notably one for the Ford Edge.", "She also appeared in television programs such as \"30 Rock\" and films such as \"Greetings from the Shore\"." ] ], "gold": "There are several wives in the CBS sitcom How I Met Your Mother. Ted's wife is played by Tracy Mosby, the sitcom's title character, who is played by American actress and singer Cristin Milioti. Cobie Smulders, a Canadian-American actress, plays Barney's wife. Alyson Hannigan, an American actress and television presenter, plays Marshall's wife.", "prediction 1": "The CBS sitcom \"How I Met Your Mother\" tells the story of how Ted Mosby (Josh Radnor) met The Mother. The title character Tracy McConnell, the wife of Thomas Mosby, is played by American actress and vocalist Cristin Milioti. The show's narrator is Future Ted, who speaks to the characters during the show's final seasons.", "prediction 2": "The story of how Ted met The Mother is the framing device behind the series, and many facts about her are revealed throughout the series. The name of the show's title character is Tracy McConnell, who appears in eight episodes. American actress and vocalist Cristin Milioti plays the Mother on the sitcom from 2013 to 2014.", "prediction 3": "The episode How I Met Your Mother tells the story of how Ted Mosby (Josh Radnor) met the Mother. The show's narrator for the episode is Future Ted, played by Bob Saget. The show also has a female character called Mrs. Mosby. The female character is played by Alyson Hannigan.", "prediction 4": "In the television sitcom How I Met Your Mother, the story of how Ted Mosby met the Mother is the framing device behind the show. The character's wife is played by American actress and vocalist Cristin Milioti.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 101 }, { "error type": "Unverifiable", "explanation": "", "start": 139, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 321 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "Alyson Hannigan plays a character based on Thomas's wife, Rebecca." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has won the most nba 3 point contest?", "passages": [ [ "Three-Point Contest", "Three-Point Contest\n\nThe Three-Point Contest (officially named the JBL Three-Point Contest and previously named the Three-Point Shootout) is a National Basketball Association (NBA) contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend.", "From its introduction in 1986 to 2002, and again from 2017 onward, eight participants were selected to participate in each season's shootout.", "Between 2003 and 2016, the contest was open to just six competitors.", "Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California.", "In this contest, participants attempt to make as many three-point field goals as possible from five positions behind the three-point arc in one minute.", "Players begin shooting from one corner of the court, and move from station to station along the three point arc until they reach the other corner.", "At each shooting station is a rack with five basketballs.", "Out of the five balls, four are worth one point (the standard orange Spalding game balls) and the fifth one (a red/white/blue ABA-style ball; often nicknamed the \"money ball\") is worth two points.", "The goal of this contest is to score as many points as possible within one minute.", "A perfect score used to be 30 points." ], [ "Craig Hodges", "He was waived by the Bulls after the 1991\u201392 season.", "After sitting out the NBA season, he played a season with Clear Cant\u00f9 in the Italian league.", "Hodges appeared in the first eight NBA All-Star Three Point Contests from 1986 to 1993, and won the contest three times, in 1990, 1991, and 1992.", "He reached the final round on two other occasions, in 1986 when he lost to Larry Bird, and in 1989, when he lost to Dale Ellis.", "Hodges holds the Three Point Contest records for the most consecutive shots made with 19 (1991) and is tied with Jason Kapono for most points scored in a single round at 25 (1986).", "He is tied with Hubert Davis for the highest score in the semifinal round at 24 (1991) and with six other players for the most bonus balls made with five (1988).", "Hodges has the second highest three-round combined score with 61 (1991).", "Hodges competed in the Three Point Contest at the 1993 NBA All-Star Weekend as a free agent after he was waived by the Bulls in 1992 and did not sign with an NBA team for the 1992\u201393 season.", "The NBA initially left him off the field of contestants as he was not on an NBA roster at the time, but eventually allowed him to defend his 1992 title.", "Hodges wore a generic \"NBA\" jersey in the contest." ] ], "gold": "The Three-Point Contest is a National Basketball Association shootout contest which includes ten participants and is held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Larry Bird is tied for winning the most NBA 3 point contests and was its inaugural winner. Craig Hodges was tied with Larry Bird for most 3 point contest wins and was the winner in 1989-1990. Stephen Curry was the most recent winner of the contest and holds a record with 31 points.", "prediction 1": "The NBA Three Point Contest, officially named the JBL Three-Point Contest, is a contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Craig Hodges won the contest three times from 1990 to 1991 and from 1992 to 1993. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California.", "prediction 2": "The NBA Three Point Contest is held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Craig Hodges has won the contest the most times, in 1990, 1991, and 1992. Devin Booker of the Phoenix Suns is the most recent winner of the event which was held at the Staples Center in Los Angeles, California.", "prediction 3": "The Three-Point Contest is a National Basketball Association contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Craig Hodges has won the most 3 point contests in NBA history, with three different titles. Jason Kapono holds the record for the most consecutive shots made with 19 in 1991 and is tied with Jason Kapono for the most points scored in a single round at 25 in 1986.", "prediction 4": "The NBA Three-Point Contest is a contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. The most men's three point contests were won by Craig Hodges in 1990, 1991, and 1992, followed by Devin Booker in 2017 and Corey Perry in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 388 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 74 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The NBA Three Point Contest is a contest held on the Saturday before the annual All-Star Game as part of All-Star Weekend. Hodges holds the Three Point Contest records for the most consecutive shots made with 19 (1991) and is tied with Jason Kapono for most points scored in a single round at 25 (1986)." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the united nations ban chemical weapons?", "passages": [ [ "Geneva Protocol", "Eric Croddy, assessing the Protocol in 2005, took the view that the historic record showed it had been largely ineffectual.", "Specifically it did not prohibit:\n\n\nDespite the U.S. having been a proponent of the protocol, the U.S. military and American Chemical Society lobbied against it, causing the U.S. Senate not to ratify the protocol until 1975.", "In 1966, United Nations General Assembly resolution 2162B called for, without any dissent, all states to strictly observe the protocol.", "In 1969, United Nations General Assembly resolution 2603 (XXIV) declared that the prohibition on use of chemical and biological weapons in international armed conflicts, as embodied in the protocol (though restated in a more general form), were generally recognized rules of international law.", "Following this, there was discussion of whether the main elements of the protocol now form part of customary international law, and now this is widely accepted to be the case.", "There have been differing interpretations over whether the protocol covers the use of harassing agents, such as adamsite and tear gas, and defoliants and herbicides, such as Agent Orange, in warfare.", "The 1977 Environmental Modification Convention prohibits the military use of environmental modification techniques having widespread, long-lasting or severe effects." ], [ "Chemical Weapons Convention", "On 3 September 1992 the Conference on Disarmament submitted to the U.N. General Assembly its annual report, which contained the text of the Chemical Weapons Convention.", "The General Assembly approved the Convention on 30 November 1992, and the U.N. Secretary-General then opened the Convention for signature in Paris on 13 January 1993.", "The CWC remained open for signature until its entry into force on 29 April 1997, 180 days after the deposit of the 65th instrument of ratification (by Hungary).", "The convention augments the Geneva Protocol of 1925 for chemical weapons and includes extensive verification measures such as on-site inspections.", "It does not, however, cover biological weapons.", "The convention is administered by the Organisation for the Prohibition of Chemical Weapons (OPCW), which acts as the legal platform for specification of the CWC provisions.", "The \"Conference of the States Parties\" is mandated to change the CWC and pass regulations on implementation of CWC requirements.", "The \"Technical Secretariat\" of the organization conducts inspections to ensure compliance of member states.", "These inspections target destruction facilities (where permanent monitoring takes place during destruction), chemical weapons production facilities which have been dismantled or converted for civil use, as well as inspections of the chemical industry.", "The Secretariat may furthermore conduct \"investigations of alleged use\" of chemical weapons and give assistance after use of chemical weapons." ], [ "Chemical Weapons Convention", "Chemical Weapons Convention\n\nThe Chemical Weapons Convention (CWC) is an arms control treaty that outlaws the production, stockpiling, and use of chemical weapons and their precursors.", "The full name of the treaty is the Convention on the Prohibition of the Development, Production, Stockpiling and Use of Chemical Weapons and on their Destruction and it is administered by the Organisation for the Prohibition of Chemical Weapons (OPCW), an intergovernmental organization based in The Hague, The Netherlands.", "The treaty entered into force in 1997.", "The Chemical Weapons Convention prohibits the large-scale use, development, production, stockpiling and transfer of chemical weapons.", "Very limited production for research, medical, pharmaceutical or protective purposes is still permitted.", "The main obligation of member states under the convention is to effect this prohibition, as well as the destruction of all current chemical weapons.", "All destruction activities must take place under OPCW verification.", "As of May 2018, 193 states have become parties to the CWC and accept its obligations.", "Israel has signed but not ratified the agreement, while three other UN member states (Egypt, North Korea and South Sudan) have neither signed nor acceded to the treaty.", "Most recently, the State of Palestine deposited its instrument of accession to the CWC on 17 May 2018.", "In September 2013 Syria acceded to the convention as part of an agreement for the destruction of Syria's chemical weapons." ] ], "gold": "In 1966, United Nations General Assembly resolution 2162B called for, without any dissent, all states to strictly observe the Geneva Protocol. The Geneva Protocol is a treaty prohibiting the use of chemical and biological weapons in international armed conflicts. Additionally, on 3 September 1992 the Conference on Disarmament submitted to the U.N. General Assembly its annual report, which contained the text of the Chemical Weapons Convention. The Chemical Weapons Convention is an arms control treaty that prohibits the large-scale use, development, production, stockpiling and transfer of chemical weapons and their precursors, except for very limited purposes such as research, medical, pharmaceutical or protective. The U.N General Assembly approved the Chemical Weapons Convention, and the U.N. Secretary-General then opened the Chemical Weapons Convention for signature in Paris on 13 January 1993. The treaty entered into force on 29 April 1997. As of March 2021, 193 states have become parties to the Chemical Weapons Convention and accept its obligations. Israel has signed but not ratified the agreement, while three other U.N. member states, Egypt, North Korea and South Sudan, have neither signed nor acceded to the treaty.", "prediction 1": "The United Nations banned chemical weapons in 1965 through resolutions 2162B and 2403, both of which were based on the Geneva Protocol. The Convention on the Prohibition of the Development, Production, Stockpiling and Use of Chemical Weapons and on their Destruction was ratified on 29 April 1975.", "prediction 2": "The United Nations banned chemical weapons in 1945, 1946, and 1945, and in 1946, 1949, and 1950. However, the Chemical Weapons Convention was adopted in 1992, banning the large-scale production, production, stockpiling, and use of chemical weapons and their precursors.", "prediction 3": "The United Nations banned chemical weapons in 1965, 1966, 1967, and 1969, respectively. However, on 3 September 1992, the Conference on Disarmament submitted to the U.N. General Assembly its annual report, which contained the text of the Chemical Weapons Convention. The General Assembly approved the Convention on 30 November 1992. The U.N. Secretary-General opened the Convention for signature in Paris on 13 January 1993. The Convention entered into force on 29 April 1997, 180 days after the deposit of the 65th instrument of ratification (by Hungary).", "prediction 4": "The United Nations banned chemical weapons in 1966 and in 1969, respectively, and in the Chemical Weapons Convention in 1997.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3,4]}", "start": 46, "end": 86 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 297 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4, 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": " In 1966, United Nations General Assembly resolution 2162B called for, without any dissent, all states to strictly observe the protocol. The United Nations banned chemical and biological weapons and in 1969 through resolutions 2403 based on the Geneva Protocol. On 3 September 1992 the Conference on Disarmament submitted to the U.N. General Assembly its annual report, which contained the text of the Chemical Weapons Convention. The Chemical Weapons Convention is an arms control treaty that prohibits the large-scale use, development, production, stockpiling and transfer of chemical weapons and their precursors, except for very limited purposes such as research, medical, pharmaceutical or protective. The treaty entered into force in 1997. As of May 2018, 193 states have become parties to the CWC and accept its obligations. Israel has signed but not ratified the agreement, while three other UN member states (Egypt, North Korea and South Sudan) have neither signed nor acceded to the treaty." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When was the first car made in america?", "passages": [ [ "History of the automobile", "The offer led to the first city to city automobile race in the United States, starting on 16 July 1878 in Green Bay, Wisconsin, and ending in Madison, Wisconsin, via Appleton, Oshkosh, Waupun, Watertown, Fort Atkinson, and Janesville.", "While seven vehicles were registered, only two started to compete: the entries from Green Bay and Oshkosh.", "The vehicle from Green Bay was faster, but broke down before completing the race.", "The Oshkosh finished the course in 33 hours and 27 minutes, and posted an average speed of six miles per hour.", "In 1879, the legislature awarded half the prize.", "Steam-powered road vehicles, both cars and wagons, reached the peak of their development in the early 1930s with fast-steaming lightweight boilers and efficient engine designs.", "Internal combustion engines also developed greatly during WWI, becoming simpler to operate and more reliable.", "The development of the high-speed diesel engine from 1930 began to replace them for wagons, accelerated in the UK by tax changes making steam wagons uneconomic overnight.", "Although a few designers continued to advocate steam power, no significant developments in production steam cars took place after Doble in 1931.", "Whether steam cars will ever be reborn in later technological eras remains to be seen.", "Magazines such as \"Light Steam Power\" continued to describe them into the 1980s." ], [ "Stacy Building", "Stacy Building\n\nThe Stacy Building is a historic building at 41-43 Taylor Street in Springfield, Massachusetts, in the district of Metro Center known as the Club Quarter.", "On September 20, 1893, Springfielders Charles and Frank Duryea road-tested the first-ever American-built, gasoline-powered car in Springfield, which they had built at the Stacy Building.", "The first Duryea Motor Wagons were all built by hand at the Stacy Building on Taylor Street in Springfield.", "Despite the September 20 road-test on Howard Bemis's Springfield farm, the \"Springfield Republican\" newspaper did get the story until the Duryea brothers' 2nd public road-test on November 10, 1893.", "In 1895, the Duryea Motor Wagon won America's first-ever road race - a 54-mile race from Chicago to Evanston, Illinois, beating out European companies like Daimler Benz.", "Following this, demand for Duryea automobiles soared.", "In 1896, the Duryea Motor Wagon Company became the first company to manufacture and sell gasoline-powered automobiles.", "The Duryea Brothers produced thirteen cars by hand in the company's first year - all at the Stacy Building.", "The company's motto was \"there is no better motorcar.\"", "Immediately, Duryeas were purchased by luminaries of the time, including George Vanderbilt." ] ], "gold": "The first carriage-sized automobile that could be driven on wagon roads in the United States was steam-powered and invented in 1871 by Dr. J.W. Carhart in Racine, Wisconsin. The first running, gasoline-powered car that was made in America, the Duryea Motor Wagon, was built in 1893. The Studebaker Automobile Company, which started building cars in 1897, sold electric vehicles in 1902, and gasoline vehicles in 1904.", "prediction 1": "First car made in America was produced on September 20, 1893, by Springfielders Charles and Frank Duryea. The automobile had been built at the Stacy Building in Springfield. The first Duryea Motor Wagons were all built by hand at the Stacy Building in Springfield.", "prediction 2": "The first car to be made in America was built in Green Bay, Wisconsin, on 16 July 1878, and the first car to be made in the United States was built in Madison, Wisconsin on 17 October 1878. The car was manufactured in Springfield, Massachusetts, on September 20, 1893, by Springfielders Charles and Frank Duryea, who built the car at the Stacy Building. The car was made in America on 11 October 1896 by The Duryea Motor Wagon Company, which became the first company to manufacture and sell gasoline-powered automobiles. The Duryea Brothers produced thirteen cars by hand in the company's first year -all at the Stacy Building.", "prediction 3": "The first gasoline-powered car was made in the United States on September 20, 1893, by Springfielders Charles and Frank Duryea. They built the cars on the premises of the Stacy Building in Springfield, Massachusetts. Duryea Motor Wagon Company manufactured the first gasoline-powered automobile in 1896.", "prediction 4": "The first car made in America was made on September 20, 1893, when Springfielders Charles and Frank Duryea road-tested the first-ever American-built, gasoline-powered car in Springfield, Massachusetts, which they had built at the Stacy Building. The Duryea Brothers produced thirteen cars by hand in the company's first year - all at the Stacy Building.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 264 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 173 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "On September 20, 1893, Springfielders Charles and Frank Duryea road-tested the first-ever American-built, gasoline-powered Duryea Motor Wagon car." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who has the world record for bench press?", "passages": [ [ "Progression of the bench press world record", "Progression of the bench press world record\n\nBench press world records are the international records in bench press across the years, regardless of weight class or governing organization, for bench pressing on the back without using a bridge technique.", "The advent of bench press shirts, which support the lifter's shoulders and provide upward force, have increased records significantly since 1985 (for example, when the shirted record was 438.64\u00a0kg (965\u00a0lb), the unshirted record was 323.41\u00a0kg (713\u00a0lb)).", "As of 2018, the world record bench press without a bench shirt is 335\u00a0kg\u00a0kg (738.5\u00a0lb\u00a0lb), set by Kirill Sarychev (Russian) in November 2015.", "The recent junior bench press world record was broken by Remi Johnson from England, who lifted 165.0 \u00a0kg." ], [ "Progression of the bench press world record", "The women bench press record (single lift, equipped with shirt) belongs to Sandra L\u00f6nn from Sweden, who lifted 235.0\u00a0kg (517\u00a0lb) and the women bench press record (equipped with shirt) belongs to Hugdal Hildeborg from Norway, who lifted 227.0\u00a0kg (499.4\u00a0lb) (IPF standards).http://www.powerlifting-ipf.com/championships/records.html\n\nWith the foundation of the IPF (International Powerlifting Federation), the Federation began keeping \"official\" powerlifting world records as the international governing body for the sport of powerlifting.", "Previous records which hadn't been set within the newly established rules, were reset (For example, elbow bandages had been allowed prior to the formation of the IPF, but were later outlawed).", "These are the official bench press records after the IPF-reset until they surpass the previously set mark of 306\u00a0kg (675\u00a0lb) by Jim Williams.", "For the bench press to be considered raw, no bench shirts are allowed; however, wrist wraps, singlets and belts are allowed.", "Elbow bandages had been allowed prior to the formation of the IPF, but were later outlawed." ], [ "Scot Mendelson", "On October 12, 2002, at 308.0 pound bodyweight Scot Mendelson bench pressed 701\u00a0lbs (318\u00a0kg) without a bench shirt in San Francisco, California (American Powerlifting Association (APF)) for an all-time raw (unassisted) world record in the heavyweight class (308 pounds).All-time RAW Powerlifting world records compiled and updated by PowerliftingWatch.com He became the all-time raw world record holder regardless of weight class for the first time when he pressed 713\u00a0lbs (323.4\u00a0kg) on February 8, 2003 @", "Stark's Gym San Carlos Ca surpassing the previous 711\u00a0lbs-mark of Big James Hendersonheld for 25 year's\n\nAt the age of 36, improving his own world record in the raw bench press, Mendelson pressed 715.0\u00a0lbs (324.3\u00a0kg) with Ed Coan as head judge at the New England Bench Press Classic (Atlantis) on May 22, 2005.", "This record was not broken for 8 years until Eric Spoto bench pressed 722\u00a0lb (327.5\u00a0kg) raw in 2013." ] ], "gold": "Bench press world records are the international records in bench press across the years, regardless of weight class or governing organization, for bench pressing on the back without using a bridge technique. Siamand Rahman has the world record for bench press in IPC Powerlifting. American Julius Maddox has the world record bench press without any equipment at 355 kg (782 lb) surpassing his previous record of 349 kg (770 lb). The women bench press record, single lift and equipped with shirt, belongs to Sandra L\u00f6nn from Sweden, who lifted 235.0 kg (517 lb) and the women bench press record, equipped with shirt, belongs to Hugdal Hildeborg from Norway, who lifted 227.0 kg (499.4 lb). The world record for bench press for a man with a bench shirt was set by Tiny Meeker.", "prediction 1": "The world record for bench press is 714 lbs, held by American powerlifter and amateur slam champion Scot Mendelson. The women bench press mark is held by Sandra L\u00f6nn from Sweden. The men's record is held by Hugdal Hildeborg from Norway, who lifted 227.0 kg (499.4 lb) (IPF standards).", "prediction 2": "On October 12, 2002, at 308.0 pound bodyweight Scot Mendelson bench pressed 701 lbs (318 kg) without a bench shirt in San Francisco, California (American Powerlifting Association (APF)) for an all-time raw world record regardless of weight class for the first time when he pressed 713 lbs (324 kg) on February 8, 2003 @ Stark's Gym San Carlos Ca surpassing the previous 711 lbs-mark of Big James Hendersonheld for 25 year's At the age of 36, improving his own world record in the raw world record was set by Eric Spoto in 2013.", "prediction 3": "The bench press world records are the international records in bench press across the years, regardless of weight class or governing organization, for bench pressing on the back without using a bridge technique. As of 2018, the world record bench press without a bench shirt is 335 kg kg (738.4 lb lb), set by Kirill Sarychev (Russian) in November 2015. The women bench press record (single lift, equipped with shirt) belongs to Sandra L\u00f6nn from Sweden, who lifted 235.0 kg (517 lb) and the women bench press record (equipped with shirt) belongs to Hugdal Hildeborg from Norway, who lifted 227.0 kg (499.4 lb) from Norway, who lifted 227.0 kg (499.4 lb).", "prediction 4": "The world record for bench press is 335 kg without a bench shirt, set by Kirill Sarychev in November 2015. The women's world record for bench press is a single lift and a single lift equipped with a shirt, held by Sandra L\u00f6nn from Sweden, who lifted 235.0 kg (517 lb). The women's world record is a double lift and a single lift equipped with a shirt, held by Hugdal Hildeborg from Norway, who lifted 227.0 kg (499.4 lb).", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 183, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 284 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Bench press world records are the international records in bench press across the years, regardless of weight class or governing organization, for bench pressing on the back without using a bridge technique. The world record for bench press is 714 lbs, held by American powerlifter and amateur slam champion Scot Mendelson. The women bench press record (single lift, equipped with shirt) belongs to Sandra L\u00f6nn from Sweden, who lifted 235.0 kg (517 lb) and the women bench press record (equipped with shirt) belongs to Hugdal Hildeborg from Norway, who lifted 227.0 kg (499.4 lb). " }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Where did the 2017 eclipse start and end?", "passages": [ [ "Solar eclipse of August 21, 2017", "The event's shadow began to cover land on the Oregon coast as a partial eclipse at 4:05\u00a0p.m. UTC (9:05\u00a0a.m. PDT), with the total eclipse beginning there at 5:16\u00a0p.m. UTC (10:16\u00a0a.m. PDT); the total eclipse's land coverage ended along the South Carolina coast at about 6:44\u00a0p.m. UTC (2:44\u00a0p.m. EDT).", "Visibility as a partial eclipse in Honolulu, Hawaii began with sunrise at 4:20\u00a0p.m.", "UTC (6:20\u00a0a.m. HST) and ended by 5:25\u00a0p.m. UTC (7:25\u00a0a.m. HST).", "This total solar eclipse marked the first such event in the smartphone and social media era in America.", "Information, personal communication, and photography were widely available as never before, capturing popular attention and enhancing the social experience.", "Marriage proposals took place coinciding with the eclipse, and at least one wedding was also planned and took place to coincide with the eclipse.", "Logistical problems were expected with the influx of visitors, especially for smaller communities.", "The sale of counterfeit eclipse glasses was also anticipated to be a hazard for eye injuries." ], [ "Solar eclipse of August 21, 2017", "Solar eclipse of August 21, 2017\n\nThe solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts.", "As a partial solar eclipse, it was visible on land from Nunavut in northern Canada to as far south as northern South America.", "In northwestern Europe and Africa, it was partially visible in the late evening.", "In Asia, it was visible only at the eastern extremity, the Chukchi Peninsula.", "Prior to this event, no solar eclipse had been visible across the entire contiguous United States since June 8, 1918; not since the February 1979 eclipse had a total eclipse been visible from anywhere in the mainland United States.", "The path of totality touched 14 states, and the rest of the U.S. had a partial eclipse.", "The area of the path of totality was about 16 percent of the area of the United States, with most of this area over the ocean, not land." ] ], "gold": "In the contiguous United States, the solar eclipse of August 21, 2017, started on the Oregon coast and ended along the South Carolina coast. This solar eclipse was dubbed the \"Great American Eclipse\" by the media.", "prediction 1": "The solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts. Visibility as a partial eclipse, it was visible on land from Nunavut in northern Canada to as far south as northern South America. As a total solar eclipse, it was visible on land from Alaska to Hawaii, and as a partial solar eclipse, it was visible on land from Alaska to as far south as South America.\n", "prediction 2": "This total solar eclipse marked the first such event in the smartphone and social media era in America. Visibility as a partial eclipse began with sunrise in Honolulu, Hawaii at 4:20 p.m. UTC (6:20 a.m. HST), and ended at 5:25 p.m. UTC (7:25 a.m. HST). As a total solar eclipse, it was visible from Alaska to Florida, and from Sweden to Canada.", "prediction 3": "The solar eclipse of August 21, 2017 was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts. Visibility as a partial eclipse, it was visible on land from Nunavut in northern Canada to as far south as northern South America.", "prediction 4": "The solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts. Visibility as a partial eclipse was visible on land from Nunavut in northern Canada to as far south as northern South America. As a total solar eclipse, the 2017 event began over the Oregon coast, with the totality beginning there.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 438, "end": 539 }, { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 437 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, spanned the entire contiguous United States. The event's shadow began to cover land on the Oregon coast as a partial eclipse, with the total eclipse beginning there; the total eclipse's land coverage ended along the South Carolina coast.\n" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When did the modern venture capital industry in the usa most likely begin?", "passages": [ [ "Venture capital", "Only after 1945 did \"true\" private equity investments begin to emerge, notably with the founding of the first two venture capital firms in 1946: American Research and Development Corporation (ARDC) and J.H. Whitney & Company.", "Georges Doriot, the \"father of venture capitalism\" (and former assistant dean of Harvard Business School), founded the graduate business school INSEAD in 1957.", "Along with Ralph Flanders and Karl Compton (former president of MIT), Doriot founded ARDC in 1946 to encourage private-sector investment in businesses run by soldiers returning from World War II.", "ARDC became the first institutional private-equity investment firm to raise capital from sources other than wealthy families, although it had several notable investment successes as well.", "ARDC is credited with the first trick when its 1957 investment of $70,000 in Digital Equipment Corporation (DEC) would be valued at over $355 million after the company's initial public offering in 1968 (representing a return of over 1200 times on its investment and an annualized rate of return of 101%).", "Former employees of ARDC went on to establish several prominent venture-capital firms including Greylock Partners (founded in 1965 by Charlie Waite and Bill Elfers) and Morgan, Holland Ventures, the predecessor of Flagship Ventures (founded in 1982 by James Morgan).", "ARDC continued investing until 1971, when Doriot retired." ], [ "Early history of private equity", "The 1958 Act officially allowed the U.S. Small Business Administration (SBA) to license private \"Small Business Investment Companies\" (SBICs) to help the financing and management of the small entrepreneurial businesses in the United States.", "Passage of the Act addressed concerns raised in a Federal Reserve Board report to Congress that concluded that a major gap existed in the capital markets for long-term funding for growth-oriented small businesses.", "Additionally, it was thought that fostering entrepreneurial companies would spur technological advances to compete against the Soviet Union.", "Facilitating the flow of capital through the economy up to the pioneering small concerns in order to stimulate the U.S. economy was and still is the main goal of the SBIC program today.", "The 1958 Act provided venture capital firms structured either as SBICs or Minority Enterprise Small Business Investment Companies (MESBICs) access to federal funds which could be leveraged at a ratio of up to 4:1 against privately raised investment funds.", "The success of the Small Business Administration's efforts are viewed primarily in terms of the pool of professional private equity investors that the program developed as the rigid regulatory limitations imposed by the program minimized the role of SBICs.", "In 2005, the SBA significantly reduced its SBIC program, though SBICs continue to make private equity investments.", "During the 1960s and 1970s, venture capital firms focused their investment activity primarily on starting and expanding companies." ], [ "Venture capital", "During the 1960s and 1970s, venture capital firms focused their investment activity primarily on starting and expanding companies.", "More often than not, these companies were exploiting breakthroughs in electronic, medical, or data-processing technology.", "As a result, venture capital came to be almost synonymous with technology finance.", "An early West Coast venture capital company was Draper and Johnson Investment Company, formed in 1962 by William Henry Draper III and Franklin P. Johnson, Jr.", "In 1965, Sutter Hill Ventures acquired the portfolio of Draper and Johnson as a founding action.", "Bill Draper and Paul Wythes were the founders, and Pitch Johnson formed Asset Management Company at that time.", "It is commonly noted that the first venture-backed startup is Fairchild Semiconductor (which produced the first commercially practical integrated circuit), funded in 1959 by what would later become Venrock Associates.", "Venrock was founded in 1969 by Laurance S. Rockefeller, the fourth of John D. Rockefeller's six children, as a way to allow other Rockefeller children to develop exposure to venture capital investments.", "It was also in the 1960s that the common form of private equity fund, still in use today, emerged.", "Private equity firms organized limited partnerships to hold investments in which the investment professionals served as general partner and the investors, who were passive limited partners, put up the capital." ] ], "gold": "Before World War II venture capital was primarily the domain of wealthy individuals and families. Following World War II, in 1946, Georges Doriot, the \"father of venture capitalism\" along with Ralph Flanders and Karl Compton founded American Research and Development Corporation or ARDC to encourage private-sector investment in businesses run by soldiers returning from World War II. ARDC became the first institutional private-equity investment firm to raise capital from sources other than wealthy families. Then, in 1958, one of the first steps toward a professionally managed venture capital industry in the United States was the passage of the Small Business Investment Act of 1958. The Small Business Investment Act of 1958 provided tax breaks that helped contribute to the rise of private equity firms. Then in 1959, it is commonly noted that the first venture-backed startup, Fairchild Semiconductor, was funded by what would later become Venrock Associates. Venrock, a compound of \"Venture\" and \"Rockefeller\" is a venture capital firm formed in 1969 to build upon the successful investing activities of the Rockefeller family that began in the late 1930s.", "prediction 1": "The modern venture capital industry in the US most likely began in the 1960s with the founding of two venture capital companies: American Research and Development Corporation (ARDC) and J.H. Whitney & Company. During the 1960s and 1970s, venture capital firms focused their investment activity primarily on starting and expanding companies. More often than not, these companies were exploiting breakthroughs in electronic, medical, or data-processing technology, as a result, venture capital came to be almost synonymous with technology finance.", "prediction 2": "The modern venture capital industry in the usa most likely began in the 1960s and 1970s, when venture capital firms focused their investment activity primarily on starting and expanding companies. More often than not, these companies were exploiting breakthroughs in electronic, medical, or data-processing technology.", "prediction 3": "The modern venture capital industry in the United States most likely began in the 1960s. In 1946, the first venture capital firm was American Research and Development Corporation (ARDC), and the second, J.H. Whitney & Company. It was in the 1960s that the common form of private equity fund, still in use today, emerged.", "prediction 4": "The modern venture capital industry in the United States most likely began in the 1960s and 1970s. It was notably with the founding of the first two venture capital firms in 1946: American Research and Development Corporation and J.H. Whitney & Company.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 71, "end": 76 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 4, "end": 35 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 545 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Only after 1945 did \"true\" private equity investments begin to emerge with the founding of two venture capital companies: American Research and Development Corporation (ARDC) and J.H. Whitney & Company. Georges Doriot, the \"father of venture capitalism\", along with Ralph Flanders and Karl Compton, founded ARDC. ARDC became the first institutional private-equity investment firm to raise capital from sources other than wealthy families. The 1958 Act provided venture capital firms structure. It is commonly noted that the first venture-backed startup is Fairchild Semiconductor was funded to be what would later become Venrock Associates." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What type of business is a food truck?", "passages": [ [ "Foodservice", "Foodservice\n\nFoodservice (US English) or catering industry (British English) defines those businesses, institutions, and companies responsible for any meal prepared outside the home.", "This industry includes restaurants, school and hospital cafeterias, catering operations, and many other formats.", "The companies that supply foodservice operators are called foodservice distributors.", "Foodservice distributors sell goods like small wares (kitchen utensils) and foods.", "Some companies manufacture products in both consumer and foodservice versions.", "The consumer version usually comes in individual-sized packages with elaborate label design for retail sale.", "The foodservice version is packaged in a much larger industrial size and often lacks the colorful label designs of the consumer version.", "The food system, including food service and food retailing supplied $1.24 trillion worth of food in 2010 in the US, $594 billion of which was supplied by food service facilities, defined by the USDA as any place which prepares food for immediate consumption on site, including locations that are not primarily engaged in dispensing meals such as recreational facilities and retail stores.", "Full-service and Fast-food restaurants account for 77% of all foodservice sales, with full-service restaurants accounting for just slightly more than fast food in 2010." ], [ "Food truck", "Finding a niche seems to be a path to success for most trucks.", "While one truck may specialize in outlandish burgers, another may serve only lobster rolls.", "Food trucks are now even Zagat rated.", "Tracking food trucks has been made easy with social media like Facebook and Twitter, where a favorite gourmet truck can be located at any moment, with updates on specials, new menu items and location changes.", "In fact, it could be argued that social media was the biggest contributing factor to the breakthrough success of the gourmet food truck.", "Food truck rallies and food truck parks are also growing in popularity in the US.", "At rallies, people can find their favorite trucks all in one place and as well provide a means for a variety of diverse cultures to come together and find a common ground over a love for food.", "On August 31, 2013, Tampa hosted the world's largest food truck rally, with 99 trucks attending.", "The Tampa Rally broke its own record by bringing together 121 food trucks in 2014.", "And food truck parks, offering permanent locations, are found in urban and suburban areas across the US.", "The popularity of food trucks lead to the creation of associations that protect and support their business rights, such as the Philadelphia Mobile Food Association.", "Food trucks are subject to the same range of concerns as other foodservice businesses.", "They generally require a fixed address to accept delivery of supplies." ], [ "Small business", "Small business\n\nSmall businesses are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation.", "Businesses are defined as \"small\" in terms of being able to apply for government support and qualify for preferential tax policy varies depending on the country and industry.", "Small businesses range from fifteen employees under the Australian \"Fair Work Act 2009\", fifty employees according to the definition used by the European Union, and fewer than five hundred employees to qualify for many U.S. Small Business Administration programs.", "While small businesses can also be classified according to other methods, such as annual revenues, shipments, sales, assets, or by annual gross or net revenue or net profits, the number of employees is one of the most widely used measures.", "Small businesses in many countries include service or retail operations such as convenience stores, small grocery stores, bakeries or delicatessens, hairdressers or tradespeople (e.g., carpenters, electricians), restaurants, guest houses, photographers, very small-scale manufacturing, and Internet-related businesses such as web design and computer programming.", "Some professionals operate as small businesses, such as lawyers, accountants, dentists and medical doctors (although these professionals can also work for large organizations or companies)." ] ], "gold": "Food trucks are part of the food service business. Food service defines those businesses, institutions and companies responsible for any meal prepared outside the home. This industry includes restaurants, food trucks, catering operations and many other formats. Food service businesses such as a bakery, delicatessen, restaurant and food truck are also considered small businesses. Small businesses are privately owned corporations, partnerships or sole proprietorships which have fewer employees and/or less annual revenue than a regular-sized business or corporation. ", "prediction 1": "Foodservice Foodservice businesses are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation. Businesses are defined as \"small\" in terms of being able to apply for government support and qualify for preferential tax policy varies depending on the country and industry. Food trucks are subject to the same range of concerns as other foodservice businesses. Food trucks generally require a fixed address to accept delivery of supplies.", "prediction 2": "Foodservice Foodservice is an industry that involves businesses, institutions, and companies responsible for any meal prepared outside the home. Food trucks are categorized as small businesses because they are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation.", "prediction 3": "Food truck business is a type of private-equity business. Food trucks are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation. It is also known as a food truck industry.", "prediction 4": "Foodservice Foodservice businesses are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation. Small businesses are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation. Food trucks are subject to the same range of concerns as other foodservice businesses. For example, a food truck rally in Tampa, Florida, on August 31, 2013, featured 99 trucks. Food trucks are also growing in popularity in other cities, such as the United States, Canada, and the United Kingdom.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 0, "end": 23 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 468, "end": 545 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Small businesses are privately owned corporations, partnerships, or sole proprietorships that have fewer employees and/or less annual revenue than a regular-sized business or corporation. Food trucks are subject to the same range of concerns as other foodservice businesses. Foodservice defines those businesses, institutions, and companies responsible for any meal prepared outside the home. This industry includes restaurants, school and hospital cafeterias, catering operations, and many other formats." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who was the chairman of the opening and closing ceremonies at the 1960 winter olympics?", "passages": [ [ "1960 Winter Olympics", "He organized an opening that included 5,000 entertainers, the release of 2,000 pigeons, and a military gun salute of eight shots, one for each of the previous Winter Olympic Games.", "The opening ceremonies were held on February 18, 1960, at Blyth Arena in the midst of a blizzard.", "The heavy snow fall caused traffic problems that delayed the ceremony by an hour.", "The festivities began with a sustained drum roll as the flags of each participating nation were raised on specially designed flag poles.", "Vice President Richard Nixon represented the United States government and declared the Games open.", "The Olympic cauldron was lit by Kenneth Henry, Olympic champion of the 500\u00a0meter speed skating race at the 1952 Winter Olympics in Oslo.", "The Olympic oath was taken by Carol Heiss on behalf of all the athletes.", "As the national delegations left the stadium fireworks concluded the ceremonies.", "The ice hockey tournament took place at Blyth Arena and the Squaw Valley Olympic Skating Rink.", "Controversy over the amateur status of some of the players overshadowed the event.", "Canadian Olympic officials objected to the use of \"professional amateurs\" by Eastern Bloc countries, and especially the Soviet Union.", "They alleged that the Soviets were giving their elite hockey players phantom jobs in the military that allowed them to play hockey full-time, which gave Soviet teams an advantage that they used to dominate Olympic hockey tournaments for nearly 30\u00a0years." ] ], "gold": "The 1960 Winter Olympics, officially known as the VIII Olympic Winter Games and commonly known as Squaw Valley 1960, was a winter multi-sport event held from February 18 to February 29, 1960, in Squaw Valley, California, United States. The chairman of the Pageantry Committee was Walt Disney, who was responsible for producing both the opening and closing ceremonies.", "prediction 1": "The opening and closing ceremonies at the 1960 Winter Olympics were led by Vice President Richard Nixon and were led by President Kennedy. The chairman of the opening and closing ceremonies at the 1960 Winter Olympics was Kenneth Henry, Olympic champion of the 500 meter speed skating race at the 1952 Winter Olympics in Oslo.", "prediction 2": "The opening and closing ceremonies for the 1960 Winter Olympics were held at Blyth Arena, in the midst of a blizzard. The chairman of the opening and closing ceremonies was Arthur C. Wright. The chairman of the closing ceremonies was John C. Sullivan.", "prediction 3": "The opening and closing ceremonies at the 1960 Winter Olympics were held on February 18, 1960, at Blyth Arena in the midst of a blizzard. The ceremony was chaired by Arthur H. Blyth.", "prediction 4": "The opening and closing ceremonies at the 1960 Winter Olympics were held on February 18, 1960, at Blyth Arena in the midst of a blizzard. Vice President Richard Nixon represented the United States government and declared the Games open. The Olympic cauldron was lit by Kenneth Henry, Olympic champion of the 500 meter speed skating race at the 1952 Winter Olympics in Oslo. The Olympic oath was taken by Carol Heiss on behalf of all the athletes as the national delegations left the stadium fireworks concluded the ceremonies.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 139, "end": 326 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 0, "end": 103 }, { "error type": "Unverifiable", "explanation": "", "start": 108, "end": 138 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The opening ceremonies were held on February 18, 1960, at Blyth Arena in the midst of a blizzard. Vice President Richard Nixon represented the United States government and declared the Games open." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sang the song with or without you?", "passages": [ [ "With or Without You", "With or Without You\n\n\"With or Without You\" is a song by Irish rock band U2.", "It is the third track on their fifth studio album, \"The Joshua Tree\" (1987), and was released as the album's lead single on 16 March 1987.", "The song was the group's most successful single at the time, becoming their first number-one hit in both the United States and Canada by topping the \"Billboard\" Hot 100 for three weeks and the \"RPM\" national singles chart for one week, with a further three weeks at number two.", "\"With or Without You\" features sustained guitar parts played by guitarist the Edge with a prototype of the Infinite Guitar, along with vocals by lead singer Bono and a bassline by bassist Adam Clayton.", "The song originated from a demo recorded in late 1985 that the group continued to work on throughout \"The Joshua Tree\" sessions.", "Ostensibly a troubled love song, the track's lyrics were inspired by Bono's conflicting feelings about the lives he led as a musician and domestic man.", "Critics praised the song upon its release.", "It is frequently performed on the band's tours, and it has appeared on many of their compilation albums and concert films.", "\"With or Without You\" is U2's second most frequently covered song." ], [ "With or Without You (album)", "With or Without You (album)\n\nWith or Without You is a live CD/DVD U2 tribute album recorded by the Dutch band Kane.", "The DVD was filmed on September 20, 2000 at Plan C in Rotterdam.", "The CD was recorded a day later at Paridiso, Amsterdam.", "The album was released in December 2000, but only in the Netherlands.", "The CD and DVD contained an almost identical track list, the only difference being that the DVD contained one extra song.", "Songs from five U2 albums were covered.", "It is noteworthy that the performance of \"Acrobat\" is the only official live recording of the song available, as it has never been performed live by U2." ] ], "gold": "There are several songs and albums with the title, \"With or Without You\". One \"With or Without You\" is a song by Irish rock band U2. \"With or Without You\" features sustained guitar parts played by guitarist the Edge with a prototype of the Infinite Guitar, along with vocals by lead singer Bono and a bassline by bassist Adam Clayton. Another \"With or Without You \"is a live CD/DVD U2 tribute album recorded by the Dutch band Kane. Kirsten Price sang a song, \"With or Without You\", in 2010. Cher also sang a song, \"With or Without You\", for the album not.com.mercial.", "prediction 1": "With or Without You is a song by Irish rock band U2. It is the third track on their fifth studio album, The Joshua Tree, released as the album's lead single on 16 March 1987. With or Without You is also a live CD/DVD U2 tribute album recorded by the Dutch band Kane. The DVD was filmed on September 20, 2000 at Plan C in Rotterdam and the CD was recorded a day later at Paridiso, Amsterdam. With or Without You is a song by Irish rock band U2 tribute album recorded by the Dutch band Kane.", "prediction 2": "\"With or Without You\" is a song by Irish rock band U2. It is the third track on their fifth studio album, The Joshua Tree, released as the album's lead single on 16 March 1987. With or Without You is a live CD/DVD U2 tribute album recorded by the Dutch band Kane. The DVD was filmed on September 20, 2000 at Plan C in Rotterdam. The album was released in December 2000, but only in the Netherlands.", "prediction 3": "With or Without You is a song by Irish rock band U2. It is the third track on their fifth studio album, The Joshua Tree, released as the album's lead single on 16 March 1987. With or Without You is also featured on a live CD/DVD U2 tribute album recorded by the Dutch band Kane. The DVD was filmed on September 20, 2000 at Plan C in Rotterdam.", "prediction 4": "\"With or Without You\" is a song by Irish rock band U2. It is the third track on their fifth studio album, The Joshua Tree, released as the album's lead single on 16 March 1987. The song features vocals by lead singer Bono, sustained guitar parts played by guitarist the Edge, along with vocals by Bono and a bassline by bassist Adam Clayton. With or Without You is U2's second most frequently covered song. With or Without You is also a live CD/DVD U2 tribute album recorded by the Dutch band Kane. The DVD was filmed on September 20, 2000 at Plan C in Rotterdam.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 390 }, { "error type": "Redundant", "explanation": "With or Without You is a song by Irish rock band U2.", "start": 391, "end": 442 }, { "error type": "Redundant", "explanation": " tribute album recorded by the Dutch band Kane. ", "start": 443, "end": 489 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "With or Without You is a song by Irish rock band U2. \"With or Without You\" features sustained guitar parts played by guitarist the Edge with a prototype of the Infinite Guitar, along with vocals by lead singer Bono and a bassline by bassist Adam Clayton. With or Without You is also a live CD/DVD U2 tribute album recorded by the Dutch band Kane. " }, "preference": [ 0, 1, 0, 1, 2, 2 ] }, { "question": "Who sings it's too late to apologize?", "passages": [ [ "Apologize (OneRepublic song)", "Apologize (OneRepublic song)\n\n\"Apologize\" (also spelled \"Apologise\" internationally) is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album \"Dreaming Out Loud\".", "It was released as the lead single of that album.", "A remix version was included on the Timbaland album, \"Shock Value\", and on the deluxe version of \"Dreaming Out Loud\".", "The song was the biggest radio airplay hit in the history of the Mainstream Top 40 chart in North America, with 10,394 plays in one week, until its record was broken by Leona Lewis's \"Bleeding Love\", which was also co-written by Tedder.", "The song was a major hit internationally, reaching number one in 16 countries, including Australia, Austria, Canada, Germany, Italy, New Zealand, Sweden, Turkey, and the Netherlands, as well as staying at number one for eight consecutive weeks on the \"Billboard\" Pop 100 chart.", "The song peaked at number two on the \"Billboard\" Hot 100, staying in the top-10 for 25 weeks, and spent 13 weeks at number one in Canada." ], [ "Dreaming Out Loud", "When a remixed version of \"Apologize\" found its way onto Timbaland's Shock Value in early 2007, and after the song's appearance in a number of American TV dramas, allied with two years of MySpace notoriety, OneRepublic were blessed with a number one hit, even without an accompanying album.", "Many critics cited U2, Snow Patrol and The Fray as the band's influences on the album.", "The album starts out with \"Say (All I Need)\", which according to Blogcritics is \"a U2-sounding song\", that is full of soaring heartfelt vocals.", "It begins with a vocal effect, and leads to an overlooking verse on a girl's soul by Ryan Tedder.", "With chopped-up, choir-like vocals, Tedder launch a rock ballad that\u2019s filled with rising crescendos and interesting musical textures.", "\"Mercy\" features an upbeat tempo and is full of hope and promise.", "\"Stop and Stare\" is a big, muscular rock ballad, which according to Digital Spy is \"very much in the Matchbox 20 mould\", steered by a vein-poppingly emotional vocal from lead singer Ryan Tedder.", "\"Apologize\" has heart-felt lyrics and is heavy on self-imposed melodrama." ], [ "Dreaming Out Loud", "Dreaming Out Loud\n\nDreaming Out Loud is the debut studio album by American rock band OneRepublic.", "The album was released on November 20, 2007 by Interscope Records.", "The album was recorded between 2004 and 2006 and it was produced by Greg Wells, with two songs produced by singer Ryan Tedder, and was engineered and mixed by Joe Zook.", "The album followed two years of massive success on Myspace; the band had appeared in Myspace Music's Top Artists since early 2006, with over 28 million total song plays counted.", "The album was released after the success of a remix version of the lead single \"Apologize\", which was produced by Timbaland.", "The song reached number one in many countries, while it peaked at number 2 on the \"Billboard\" Hot 100 chart.", "The following single \"Stop and Stare\" was also a success, while \"Say (All I Need)\", \"Mercy\" and \"Come Home\" were also released as singles.", "The album received generally mixed reviews from music critics.", "Many critics cited U2, Coldplay, The Fray, Muse and Snow Patrol as the band's influences on the album.", "Some commended the band for having a \"tremendous confidence apparent in the craft of creating pleasing music\", but others felt it was an unoriginal album and thought that Tedder continued to make pop rock fare better whenever he was writing for groups other than his own." ] ], "gold": "Apologize is a song by One Republic with lead vocalist Ryan Tedder. Apologize was released as the lead single of One Republic's Dreaming Out Loud album on November 20, 2007. Also in 2007, Timbaland remixed the song for his second studio album, Shock Value. Released in 2009, country singer Luke Bryan covered Apologize on his album Doin' My Thing. Female country singers Kacey Musgraves and Pixie Lott have also covered Apologize.", "prediction 1": "\"Apologize\" is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album Dreaming Out Loud. It was released as the lead single of that album. A remix version of \"Apologize\" was included on the Timbaland album, \"Shock Value\", and on the deluxe version of \"Dreaming Out Loud\".", "prediction 2": "\"Apologize\" is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album \"Dreaming Out Loud\". A remix version was included on the Timbaland album, \"Shock Value\", and on the deluxe version of \"Dreaming Out Loud\". The song was the biggest radio airplay hit in the history of the Mainstream Top 40 chart in North America, with 10,394 plays in one week, until Leona Lewis' Bleeding Love, also co-written by Tedder.", "prediction 3": "\"Apologize\" is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album Dreaming Out Loud. A remix version of \"Apologize\" found its way onto Timbaland's Shock Value in early 2007. The song reached number one in 16 countries, including Australia, Austria, Canada, Germany, Italy, New Zealand, Sweden, Turkey, and the Netherlands, as well as staying at number one for eight consecutive weeks on the Billboard Pop 100 chart.", "prediction 4": "\"Apologize\" is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album Dreaming Out Loud. It was released as the lead single of that album. A remix version of the song was included on Timbaland's album, \"Shock Value\", and on the deluxe version of \"Dreaming Out Loud\".", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Apologize\" is the debut single written by OneRepublic frontman Ryan Tedder for OneRepublic's debut album Dreaming Out Loud. It was released as the lead single of that album on November 20, 2007. A remix version of \"Apologize\" was included on the Timbaland album, \"Shock Value\", and on the deluxe version of \"Dreaming Out Loud\"." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who killed maya in pretty little liars season 3?", "passages": [ [ "Pretty Little Liars", "Pretty Little Liars\n\nPretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard.", "The series follows the lives of four girls whose clique falls apart after the disappearance of their leader.", "One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named \"A\" who threatens to expose their deepest secrets.", "The series features an ensemble cast, headed by Troian Bellisario as Spencer Hastings, Lucy Hale as Aria Montgomery, Ashley Benson as Hanna Marin, Shay Mitchell as Emily Fields, Sasha Pieterse as Alison DiLaurentis and Janel Parrish as Mona Vanderwaal.", "The series premiered on June 8, 2010 on Freeform, formerly known as ABC Family, and ended on June 27, 2017.", "After an initial order of 10 episodes, ABC Family ordered an additional 12 episodes on June 28, 2010.", "The ratings success of the first 10 episodes prompted the book series to be extended beyond the initial eight novels.", "Since its debut, the series has received mixed reviews from television critics, but remained a relative success for Freeform, garnering a large fandom, primarily on social media.", "On March 26, 2013, a spin-off series was announced, titled \"Ravenswood\", but was canceled after one season." ], [ "Pretty Little Liars (season 3)", "Pretty Little Liars (season 3)\n\nThe third season of Pretty Little Liars, based on the books of the same name by Sara Shepard, premiered on June 5, 2012 on ABC Family and concluded on March 19, 2013.", "On November 29, 2011, ABC Family renewed the series for a third season, consisting of 24 episodes.", "Filming of the season began on April 2, 2012.", "On October 4, 2012, ABC Family renewed the series for a fourth season, consisting of 24 episodes.", "This season of Pretty Little Liars takes place five months following the discovery that Mona Vanderwaal (Janel Parrish) was the elusive \"A\" that had been creatively and relentlessly tormenting the four main characters, Aria Montgomery (Lucy Hale), Spencer Hastings (Troian Bellisario), Hanna Marin (Ashley Benson), and Emily Fields (Shay Mitchell) for the past year.", "The first half of the season addresses the issue of whether or not Garrett Reynolds (Yani Gellman) actually killed or was involved in the murder of the girls' former friend and queen bee, Alison DiLaurentis (Sasha Pieterse) and who killed Maya St. Germain (Bianca Lawson) in the season two finale, while the second half deals with the reveal that Toby Cavanaugh is a member of the A-Team." ], [ "Emily Fields", "However, after being warned to \"get out\" by \"A\", Emily discovers that Nate was in fact at True North with Maya; Nate admits that his real name is Lyndon James.", "Angry at Emily for \"taking\" Maya from him, Lyndon reveals he has kidnapped Paige and plans to murder her in front of Emily.", "Emily escapes, but is caught by Lyndon in a nearby lighthouse while attempting to call 911.", "During the ensuing struggle, Emily stabs Nate, fatally wounding him.", "She then reconciles with the other Liars when they realize Paige is innocent.", "Emily starts to struggle to know if Alison is alive or not.", "She takes some pills from her mother's medicine cabinet and gets drowsy and groggy, and causes an injury during a swim meet which put her out of action.", "The situation gets worse when someone calls Social Services to her parents in an attempt to get her away from them, which does not happen.", "In addition, Emily's mother is suspended from work because Emily stole a key from Pam's desk in order to invade Officer Wilden's office to find evidence about Alison, and the P.D. ends up blaming Pam for that.", "Shortly after, \"A\", driving a car, goes through her house, leaving her and her mother no other option but to rent a motel." ] ], "gold": "Pretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard. The first half of the third season addresses who killed Maya St. Germain in the season two finale. It is revealed that Nate St. Germain is Maya's killer and that his real name is Lyndon James. The actor who played Lyndon James is Sterling Sulieman.", "prediction 1": "Pretty Little Liars is an American teen drama mystery television series loosely based on the book series of the same name written by Sara Shepard. The series follows the lives of four girls whose clique falls apart after the disappearance of their leader. One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named A who threatens to expose their deepest secrets. The third season of Pretty Little Liars takes place five months following the discovery that Mona Vanderwaal. Sasha Pieterse plays Maya St. Germain.", "prediction 2": "Season 3 of Pretty Little Liars takes place five months following the discovery that Mona Vanderwaal was the elusive A, who had been creatively and relentlessly tormenting the four main characters, Aria Montgomery, Spencer Hastings, Hanna Marin, and Emily Fields. Angry at Emily for \"taking\" Maya from him, Nate admits that his real name is Lyndon James and reveals he has kidnapped Paige and plans to murder her in front of Emily escapes, but is caught by Lyndon, and fatally wounds him. During the ensuing struggle, Emily stabs Lyndon, killing him. During the ensuing struggle, Emily stabs Lyndon James, fatally wounding him. During the ensuing struggle, Emily escapes, but the final episode ends with the reveal that Toby Cavanaugh", "prediction 3": "Pretty Little Liars is an American teen drama mystery thriller television series loosely based on the books of the same name written by Sara Shepard. The series follows the lives of four girls whose clique falls apart after the disappearance of their leader. One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named A, who threatens to expose their deepest secrets. In the third season, Emily Fields stabs Nate, fatally wounding him, during a fight with Emily, while trying to call 911.", "prediction 4": "Pretty Little Liars is an American teen drama mystery thriller television series loosely based on the book series of the same name written by Sara Shepard that follows the lives of four girls whose clique falls apart after the disappearance of their leader. It is based on the American novel series of the same name written by Sara Shepard. In season 3, Emily Fields stabs Toby Cavanaugh, who was involved in killing Maya St. Germain in season two.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 419 }, { "error type": "Irrelevant", "explanation": "", "start": 460, "end": 529 }, { "error type": "Irrelevant", "explanation": "", "start": 530, "end": 550 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Pretty Little Liars is an American teen drama mystery television series, developed by I. Marlene King, loosely based on the book series of the same name written by Sara Shepard. The third season of Pretty Little Liars addresses the issue of who killed Maya St. Germain in the season two finale. It is revealed that Nate was in fact at True North with Maya and Nate admits that his real name is Lyndon James." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the name of the female smurf?", "passages": [ [ "Smurfette", "Smurfette\n\nSmurfette (French: La Schtroumpfette) is one of the protagonists from the comic strip the Smurfs.", "Smurfette was created by evil wizard Gargamel, the Smurfs' enemy, in order to spy on them and sow jealousy.", "However, she decides that she wants to be a real Smurf and Papa Smurf casts a spell that changes her hair from black to blonde as a sign of her transformation.", "She was the only female Smurf until the creation of Sassette.", "A Granny Smurf was also later introduced, although it is unclear how she was created.", "Thierry Culliford, the son of the comics' creator, Peyo, and current head of the Studio Peyo, announced in 2008 that more female Smurfs would be introduced in the stories.", "Smurfette has stereotypical feminine features, with long blonde wavy hair, long eyelashes, and wears a white dress and white high heels.", "She is the love interest of almost every Smurf.", "The adventure of Smurfette first started in \"Spirou\" magazine in 1966.", "She was made by Gargamel the evil wizard as a means to create unrest in the Smurf village." ], [ "The Smurflings", "In \"Sassette,\" the newly created Sassette is at first mischievous until Papa Smurf can cast a spell on her to change her behavior to that of a tomboyish but otherwise normal female Smurfling.", "She runs away when Snappy Smurfling, upset over being punished by Papa, makes an insensitive remark insinuating that Papa didn't want Sassette created and that she was created using one of Gargamel's spells.", "Sassette goes to Gargamel's cottage where she believes she'll be appreciated, causing Gargamel (who cast an explosive spell on the clay used to create her) and Azrael to run in terror.", "Papa is able to break the spell in the end, and Sassette is accepted into the Smurf community.", "Unaware of what Papa had done, Gargamel is surprised and puzzled that Sassette didn't explode, and so goes to check on the clay he had enchanted, only to end up being literally blasted into the sky!", "In the Hanna-Barbara cartoon version of \"The Clockwork Smurf\", Handy makes Clockwork to make the Smurfs' lives easier by doing all their work." ], [ "The Smurfs 2", "In preparation for her birthday celebration, the Smurfs read the story of Smurfette, how she was created by Gargamel to destroy them, only for Papa Smurf to rescue her and turn her fully into a Smurf.", "Meanwhile, she is having nightmares about reverting to her original form and betraying her fellow Smurfs by turning them over to Gargamel.", "The Smurfs are preparing a surprise party, but as Smurfette tries to find out what her fellow Smurfs are planning, none of them are saying a word.", "She takes this to mean that everyone has forgotten her birthday.", "In France, Gargamel is now a celebrity, amazing people with his sorcery, but he sees that he is running low on the Smurf essence that gives him his magic powers.", "With his new creations, evil Smurf-like creatures called the Naughties, named Vexy and Hackus, Gargamel plans on opening a portal to the Smurf village by using the Eiffel Tower as a conduit so that he can kidnap Smurfette and, through her, get Papa Smurf's secret formula for creating Smurfs." ] ], "gold": "Smurfette is one of the protagonists from the comic strip the Smurfs and appears in the Smurf comics, cartoons and movies. She was created by Gargamel and is the love interest of almost every Smurf. She was the only female Smurf until the creation of Nanny Smurf and Sassette, who only appear in the comics and cartoon. Sassette was created by the Smurflings while it is unclear how Nanny Smurf was created. In the 2013 movie The Smurfs 2, Vexy Smurf is an evil, female Smurf-like creature created by Gargamel. Vexy is sent to kidnap Smurfette. In the 2017 movie Smurfs: The Lost Village a mysterious map prompts Smurfette, Brainy, Clumsy, and Hefty to find a lost village before Gargamel does. This film introduced the female Smurfs Smurflily, Smurfblossom, Smurfstorm, Smurfwillow, Smurfijade, Smurfmelody, ", "prediction 1": "Smurfette is one of the protagonists from the comic strip The Smurfs. She was created by evil wizard Gargamel, the Smurfs' enemy, in order to spy on them and sow jealousy. However, she decides that she wants to be a real Smurf and Papa Smurf casts a spell that changes her hair from black to blonde as a sign of her transformation. A Granny Smurf was also later introduced, although it is unclear how she was created.", "prediction 2": "Smurfette is one of the protagonists from the comic strip the Smurfs. She was created by evil wizard Gargamel, the Smurfs' enemy, in order to spy on them and sow jealousy. However, she decides that she wants to be a real Smurf and Papa Smurf casts a spell that changes her hair from black to blonde as a sign of her transformation.", "prediction 3": "Smurfette is the name of one of the protagonists from the comic strip The Smurfs. She was created by evil wizard Gargamel, the Smurfs' enemy, in order to spy on them and sow jealousy. However, she decides that she wants to be a real Smurf and Papa Smurf casts a spell that changes her hair from black to blonde as a sign of her transformation. In the original Smurf series, Sassette was the only female Smurf, but in the later a Granny Smurf was also later introduced, although it is unclear how she was created.", "prediction 4": "Smurfette is a female Smurf who was created by evil wizard Gargamel in order to spy on the Smurfs and sow jealousy. However, she decides that she wants to be a real Smurf and Papa Smurf casts a spell that changes her hair from black to blonde as a sign of her transformation. She was the only female Smurf until the creation of Sassette. In the Hanna-Barbara cartoon version of The Clockwork Smurf, Handy makes Clockwork Smurf and turns her into a Smurf. In the animated Smurf in the Smurfs, Handy makes Clockwork to make the Smurfs's and is the love interest of almost every Smurf. In the cartoon version of the Clockwork Smurf, Smurf, Handy, the love interest of almost every Smurf", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 331 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Smurfette is one of the protagonists from the comic strip The Smurfs. She was created by evil wizard Gargamel, the Smurfs' enemy, in order to spy on them and sow jealousy. She was the only female Smurf until the creation of Sassette. A Granny Smurf was also later introduced, although it is unclear how she was created. In the movie The Smurfs 2, Vexy Smurf is an evil, female Smurf-like creature created by Gargamel. Vexy is sent to kidnap Smurfette. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who got both bharat ratna and nobel prize?", "passages": [ [ "Bharat Ratna", "Similarly in 2015, the Prime Minister Narendra Modi's decision to award Madan Mohan Malaviya, who died in 1946, met with criticism.", "Janardan Dwivedi, politician of the Indian National Congress, said that Malaviya, who worked predominantly in Varanasi, was \"deliberately chosen\" by the Prime Minister Modi, who is the incumbent Member of Parliament from Varanasi.", "A few of the conferments have been criticised for honouring personalities only after they received global recognition.", "The award for Mother Teresa was announced in 1980, a year after she was awarded the Nobel Peace Prize.", "Satyajit Ray received an Academy Honorary Award in 1992 followed by the Bharat Ratna the same year.", "In 1999, Amartya Sen was awarded the Bharat Ratna, a year after his 1998 Nobel Memorial Prize in Economic Sciences.", "The award was proposed by Prime Minister Atal Bihari Vajpayee to President K. R. Narayanan who agreed to the proposal.", "Though, as per the statutes for the Bharat Ratna, the recommendations for the award can only be made by the Prime Minister to the President, there have been several demands from various political parties to honour their leaders." ], [ "Bharat Ratna", "In 2014, cricketer Sachin Tendulkar, then aged 40, became the youngest recipient; while social reformer Dhondo Keshav Karve was awarded on his 100th birthday.", "Though usually conferred on India-born citizens, the Bharat Ratna has been awarded to one naturalised citizen, Mother Teresa, and to two non-Indians, Pakistan national Khan Abdul Ghaffar Khan and former South African President Nelson Mandela.", "On 24 December 2014, the Indian government announced the award to independence activist Madan Mohan Malaviya (posthumously) and former Prime Minister Atal Bihari Vajpayee.", "The Bharat Ratna, along with other personal civil honours, was briefly suspended from July 1977 to January 1980, during the change in the national government; and for a second time from August 1992 to December 1995, when several public-interest litigations challenged the constitutional validity of the awards.", "In 1992, the government's decision to confer the award posthumously on", "Subhas Chandra", "Bose was opposed by those who had refused to accept the fact of his death, including some members of his extended family.", "Following a 1997 Supreme Court decision, the press communiqu\u00e9 announcing Bose's award was cancelled; it is the only time when the award was announced but not conferred.", "Several bestowals of the award have met with criticism." ], [ "Bharat Ratna", "Bharat Ratna\n\nThe Bharat Ratna (; \"Jewel of India\") is the highest civilian award of the Republic of India.", "Instituted in 1954, the award is conferred \"in recognition of exceptional service/performance of the highest order\", without distinction of race, occupation, position, or sex.", "The award was originally limited to achievements in the arts, literature, science, and public services, but the government expanded the criteria to include \"any field of human endeavour\" in December 2011.", "The recommendations for the Bharat Ratna are made by the Prime Minister to the President, with a maximum of three nominees being awarded per year.", "Recipients receive a \"Sanad\" (certificate) signed by the President and a peepal-leaf\u2013shaped medallion; there is no monetary grant associated with the award.", "Bharat Ratna recipients rank seventh in the Indian order of precedence.", "The first recipients of the Bharat Ratna were politician C. Rajagopalachari, philosopher Sarvepalli Radhakrishnan, and scientist C. V. Raman, who were honoured in 1954.", "Since then, the award has been bestowed upon 45 individuals, including 12 who were awarded posthumously.", "The original statutes did not provide for posthumous awards but were amended in January 1955 to permit them.", "Former Prime Minister Lal Bahadur Shastri became the first individual to be honoured posthumously." ] ], "gold": "The Bharat Ratna is the highest civilian award of the Republic of India. Several individuals received both the Bharat Ratna and the Nobel Prize. Chandrasekhara Venkata Raman received the Nobel Prize in 1930 and the Bharat Ratna in 1954. Mother Teresa received the Nobel Prize in 1979 and the Bharat Ratna in 1980. Nelson Mandela received the Bharat Ratna in 1990 and the Nobel Prize in 1993. Amartya Kumar Sen received the Nobel Prize in 1998 and the Bharat Ratna in 1999.", "prediction 1": "The Bharat Ratna is the highest civilian award of the Republic of India. It is conferred in recognition of exceptional service/performance of the highest order, without distinction of race, occupation, position, or sex. In 1984, Mother Teresa was awarded the award, while in 1990 Satyajit Ray received an Academy Honorary Award in 1992 followed by the Bharat Ratna. In 1999, Amartya Sen was awarded the award, a year after his 1998 Nobel Memorial Prize in Economic Sciences. In 2014, cricketer Sachin Tendulkar became the youngest recipient.", "prediction 2": "In 2014, cricketer Sachin Tendulkar became the youngest recipient of the Bharat Ratna, while social reformer Dhondo Keshav Karve was awarded on his 100th birthday. The award for independence activist Madan Mohan Malaviya was announced posthumously on 24 December 2014 and former Prime Minister Atal Bihari Vajpayee was the first to receive both the award and Nobel prize.", "prediction 3": "The Bharat Ratna is the highest civilian award of the Republic of India. Satyajit Ray received an Academy Honorary Award in 1992 followed by the Bharat Ratna the same year. In 1999, Amartya Sen was awarded the Bharat Ratna, a year after his 1998 Nobel Memorial Prize in Economic Sciences. In 2014, cricketer Sachin Tendulkar, then aged 40, became the youngest recipient of the award, while social reformer Dhondo Keshav Karve was awarded on his 100th birthday. In 1999, Satyajit Ray received an Academy Honorary Award in Economic Sciences.", "prediction 4": "The Bharat Ratna is the highest civilian award of the Republic of India. It is awarded in recognition of exceptional service/performance of the highest order, without distinction of race, occupation, position, or sex. In 2014, cricketer Sachin Tendulkar, then aged 40, became the youngest recipient of the award, while social reformer Dhondo Keshav Karve was awarded on his 100th birthday. Satyajit Ray received an Academy Honorary Award in 1992 followed by the Bharat Ratna Sen, a year after his 1998 Nobel Memorial Prize in Economic Sciences. In 1999, Amartya Sen was awarded the Bharat Ratna, a year after his 1998 Nobel Memorial Prize in Economic Sciences.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 219 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 220, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 453, "end": 474 }, { "error type": "Irrelevant", "explanation": "", "start": 475, "end": 541 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Bharat Ratna is the highest civilian award of the Republic of India. In 1980, Mother Teresa was awarded the Bharat Ratna, a year after she was awarded the Nobel Peace Prize. In 1999, Amartya Sen was awarded the award, a year after his 1998 Nobel Memorial Prize in Economic Sciences. Nelson Mandela received the Bharat Ratna in 1990." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who carried the us flag in the 2018?", "passages": [ [ "2018 Winter Olympics closing ceremony flag bearers", "2018 Winter Olympics closing ceremony flag bearers\n\nDuring the closing ceremony of the 2018 Winter Olympics in Pyeongchang, the flag bearers of 92 National Olympic Committees (NOCs) arrived into Pyeongchang Olympic Stadium.", "The flag bearers from each participating country entered the stadium informally in single file, and behind them marched all the athletes, without any distinction or grouping by nationality.", "The blending of all the athletes is a tradition that dates from the 1956 Summer Olympics, after a suggestion by Australian-born British student John Ian Wing, who thought it would be a way of bringing the athletes of the world together as \"one nation.\"", "The flags of each country were not necessarily carried by the same flag bearer as in the opening ceremony.", "The flag-bearers entered in \"ganada\" order of the Korean alphabet.", "The following is a list of each country's flag bearer.", "The list is sorted by the order in which each nation appears in the parade of nations.", "This table is sortable by country name in English, country name in Korean, the flag bearer's name, or the flag bearer's sport.", "Names are given as were officially designated by the International Olympic Committee (IOC)." ], [ "2018 Winter Olympics", "2018 Winter Olympics\n\nThe 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games () and commonly known as PyeongChang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea, with the opening rounds for certain events held on 8 February 2018, the eve of the opening ceremony.", "Pyeongchang was elected as the host city in July 2011, during the 123rd IOC Session in Durban, South Africa.", "This was the first time that South Korea had hosted the Winter Olympics and the second Olympics held in the country overall, after the 1988 Summer Olympics in Seoul.", "It was the third time that an East Asian country had hosted the Winter Games, after Sapporo (1972) and Nagano (1998), both in Japan.", "It was also the first of three consecutive Olympics to be held in East Asia, the other two being the 2020 Summer Olympics in Tokyo and the 2022 Winter Olympics in Beijing.", "The Games featured 102 events over fifteen disciplines in seven sports, with the addition of \"big air\" snowboarding, mass start speed skating, mixed doubles curling, and mixed team alpine skiing to the Winter Olympic programme.", "2,914 athletes from 92 NOCs competed, including the debuts of Ecuador, Eritrea, Kosovo, Malaysia, Nigeria and Singapore." ], [ "Erin Hamlin", "Erin Hamlin\n\nErin Mullady Hamlin (born 19 November 1986) is a four-time Olympian and the first female American luger to medal at any Winter Olympics, as well as the first American of either gender to medal in luge singles competition.", "She took the singles bronze medal in Sochi's 2014 Winter Olympics, something the Associated Press called \"a feat that will surely go down as perhaps the greatest moment in USA Luge history\".", "At age 12 Hamlin took an interest in luge and attended the U.S. Luge Screening Camp in Syracuse, NY.", "By age 17 Hamlin won a gold medal at the Junior National Luge Championship held in Lake Placid, NY.", "At this event Hamlin finished first in the women's singles race with a two-run time of 1-minute, 34.097 seconds.", "In 2004, Hamlin won ten medals in five years of racing.", "Hamlin raced in the Junior World Cups held in Germany and Austria.", "She participated in the Junior World Championships.", "She placed seventh in the 2004 Junior World Cups, making her a U.S. junior national luge champion where she competed around the world as a member of the U.S. Junior National Team." ] ], "gold": "Flag bearers carry the national flag of their country at the opening ceremony and closing ceremony of the Olympic Games. The 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games and commonly known as PyeongChang 2018, was an international winter multi-sport event that was held between February 9 and 25 in Pyeongchang County, Gangwon Province, South Korea, with the opening rounds for certain events held on February 8, 2018, the day before the opening ceremony. Four time Olympian Erin Hamlin, who was the first female American luger to medal at any Winter Olympics, as well as the first American of either gender to medal in luge singles competition, carried the US flag in the opening ceremony for the event. The US flag in the closing ceremony of the event was carried by American cross-country skier, Jessica Diggins won the United States' first ever cross-country skiing gold medal at the Winter Olympics in women's team sprint that year.", "prediction 1": "The flag bearers of the United States at the 2018 Winter Olympics were Erin Hamlin, a four-time Olympian and the first female American luger to medal at any Winter Olympics, as well as the first American of either gender to medal in luge singles competition. However, during the 2018 Winter Olympics closing ceremony, the flag bearers of 92 National Olympic Committees (NOCs) entered the stadium informally in single file, and behind them marched all the athletes, without any distinction or grouping by nationality.", "prediction 2": "A list of the flag bearers for the 2018 Winter Olympics is provided below. Erin Hamlin, the first female American luger to medal at any Winter Olympics, carried the us flag in the closing ceremony of the 2018 Winter Olympics in Pyeongchang. The flags of each participating country were carried by the flag bearers of 92 National Olympic Committees (NOCs) during the closing ceremony of the 2018 Winter Olympics in Pyeongchang.", "prediction 3": "The flags of each participating country were not necessarily carried by the same flag bearer as in the opening ceremony. The flag-bearers entered Pyeongchang Olympic Stadium in single file, and behind them marched all the athletes, without any distinction or grouping by nationality.", "prediction 4": "The flags of each participating country were carried by different flag bearers at the 2018 Winter Olympics closing ceremony. Flag bearers of 92 National Olympic Committees carried the flags of the United States in the opening ceremony and the flag bearer of the United States in the closing ceremony. The flags of each participating country were carried by different flag bearers at the closing ceremony. The flag bearers carried the flags of each participating country in the closing ceremony.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 71, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 516 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games, and commonly known as PyeongChang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea, with the opening rounds for certain events held on 8 February 2018, the eve of the opening ceremony. Erin Hamlin is a four-time Olympian and the first female American luger to medal at any Winter Olympics, as well as the first American of either gender to medal in luge singles competition. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who said all living things are composed of cells?", "passages": [ [ "Cell theory", "Cell theory\n\nIn biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells.", "Cells are the basic unit of structure in all organisms and also the basic unit of reproduction.", "With continual improvements made to microscopes over time, magnification technology advanced enough to discover cells in the 17th century.", "This discovery is largely attributed to Robert Hooke, and began the scientific study of cells, also known as cell biology.", "Over a century later, many debates about cells began amongst scientists.", "Most of these debates involved the nature of cellular regeneration, and the idea of cells as a fundamental unit of life.", "Cell theory was eventually formulated in 1839.", "This is usually credited to Matthias Schleiden and Theodor Schwann.", "However, many other scientists like Rudolf Virchow contributed to the theory.", "It was an important step in the movement away from spontaneous generation.", "The three tenets to the cell theory are as described below:\n\nThe first of these tenets is disputed, as non-cellular entities such as viruses are sometimes considered life-forms.", "The discovery of the cell was made possible through the invention of the microscope.", "In the first century BC, Romans were able to make glass, discovering that objects appeared to be larger under the glass." ], [ "Cell theory", "He claimed this theory as his own, though Barthelemy Dumortier had stated it years before him.", "This crystallization process is no longer accepted with modern cell theory.", "In 1839, Theodor Schwann states that along with plants, animals are composed of cells or the product of cells in their structures.", "This was a major advancement in the field of biology since little was known about animal structure up to this point compared to plants.", "From these conclusions about plants and animals, two of the three tenets of cell theory were postulated.", "1.", "All living organisms are composed of one or more cells\n\n2.", "The cell is the most basic unit of life\n\nSchleiden's theory of free cell formation through crystallization was refuted in the 1850s by Robert Remak, Rudolf Virchow, and Albert Kolliker.", "In 1855, Rudolf Virchow added the third tenet to cell theory.", "In Latin, this tenet states \"Omnis cellula e cellula\".", "This translated to:\n\n3.", "All cells arise only from pre-existing cells\n\nHowever, the idea that all cells come from pre-existing cells had in fact already been proposed by Robert Remak; it has been suggested that Virchow plagiarized Remak and did not give him credit." ] ], "gold": "In biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. This is usually credited to Matthias Schleiden and Theodor Schwann. However, many other scientists like Rudolf Virchow contributed to the theory.", "prediction 1": "In biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. Theodor Schwann stated in 1839 that along with plants, animals are composed of cells or the product of cells in their structures. Matthias Schleiden's theory of free cell formation through crystallization was refuted in the 1850s by Robert Remak, Rudolf Virchow added the third tenet to cell theory. The cell is the most basic unit of life Rudolf Virchow added the third tenet to cell theory. This translated to: 3. All cells arise only from pre-existing cells.", "prediction 2": "In biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. This theory was eventually formulated in 1839. This is usually credited to Matthias Schleiden and Theodor Schwann. However, many other scientists like Rudolf Virchow contributed to the theory. It was an important step in the movement away from spontaneous generation.", "prediction 3": "In biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. In 1839, Theodor Schwann argued that along with plants, animals are composed of cells or the product of cells in their structures. Schleiden's theory of free cell formation through crystallization was refuted in the 1850s by Robert Remak, Rudolf Virchow Virchow added the third tenet to cell theory, which states: \"Omnis cellula e cellula e cellula\". Rudolf Virchow added the third tenet to cell theory. This tenet states \"Omnis cellula e cellula e cellul", "prediction 4": "In biology, cell theory is the historic scientific theory now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. This is usually credited to Matthias Schleiden and Theodor Schwann, although many other scientists like Rudolf Virchow contributed to the theory. This theory was an important step in the movement away from spontaneous generation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 550 }, { "error type": "Irrelevant", "explanation": "", "start": 551, "end": 643 }, { "error type": "Irrelevant", "explanation": "", "start": 644, "end": 712 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In biology, cell theory is the historic scientific theory, now universally accepted, that living organisms are made up of cells, that they are the basic structural/organizational unit of all organisms, and that all cells come from pre-existing cells. This is usually credited to Matthias Schleiden and Theodor Schwann. However, many other scientists like Rudolf Virchow contributed to the theory. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When does love simon come out to dvd?", "passages": [ [ "Love, Simon", "Rich Kidz, \"As Long as You Love Me\" by Justin Bieber, \"Add It Up\" by Violent Femmes, \"Bad Romance\" by Lady Gaga (performed by the Michigan Marching Band), \"Shine a Light\" by BANNERS, and \"Heaven\" by Warrant.", "\"Love, Simon\" premiered at the Mardi Gras Film Festival on February 27, 2018, and also screened at the Glasgow Film Festival and the Melbourne Queer Film Festival.", "The film was released by 20th Century Fox in the United States and Canada on March 16, 2018, and has been or is scheduled to be released in other countries on various dates throughout 2018.", "Following the film's release, several celebrities \u2014 including Jennifer Garner, Kristen Bell, Neil Patrick Harris, Joey Graceffa, Matt Bomer, Robbie Rogers, Benj Pasek, Tyler Oakley, Martin Gero, Andrew Rannells, and Jesse Tyler Ferguson \u2014 bought out theaters and offered free screenings of the film because they believed it conveyed an important message.", "\"Love, Simon\" is notable as the first film by a major Hollywood studio to focus on a gay teenage romance.", "The film became available to pre-order on home video on January 17, 2018, was released digitally on May 29, 2018, and was released on 4K Blu-Ray, Blu-ray and DVD on June 12, 2018." ], [ "Love, Simon", "Love, Simon\n\nLove, Simon is a 2018 American romantic teen comedy-drama film directed by Greg Berlanti, written by Isaac Aptaker and Elizabeth Berger, and based on the novel \"Simon vs. the Homo Sapiens Agenda\" by Becky Albertalli.", "The film stars Nick Robinson, Josh Duhamel, and Jennifer Garner.", "It centers on Simon Spier, a closeted gay high school boy who is forced to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love online.", "\"Love, Simon\" premiered at the Mardi Gras Film Festival on February 27, 2018, and was released in the United States on March 16, 2018, by 20th Century Fox.", "Critics praised the film for its \"big heart, diverse and talented cast, and revolutionary normalcy\", describing it as \"tender, sweet, and affecting\" and a \"hugely charming crowd-pleaser\" that is \"funny, warm-hearted and life-affirming\", with reviews comparing it to the romantic comedy-drama films of John Hughes.", "Notable as the first film by a major Hollywood studio to focus on a gay teenage romance, it grossed $66million worldwide." ] ], "gold": "Love, Simon is a 2018 American romantic comedy-drama film based on the novel Simon vs. the Homo Sapiens Agenda by Becky Albertalli. The film centers on Simon Spier, a closeted gay high school boy who struggles to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love with online. The film was available for pre-order on January 17, 2018 and digitally released May 29 2018, the DVD released on June 12, 2018. ", "prediction 1": "Love, Simon is a 2018 American romantic teen comedy-drama film that centers on Simon Spier, a closeted gay high school boy who is forced to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love online. The film was released by 20th Century Fox in the United States and Canada on March 16, 2018. The film was released on 4K Blu-Ray, Blu-ray and DVD on June 12, 2018.\n", "prediction 2": "Love, Simon is a 2018 American romantic teen comedy-drama film directed by Greg Berlanti, written by Isaac Aptaker and Elizabeth Berger, and based on the novel Simon vs. the Homo Sapiens Agenda by Becky Albertalli. The film centers on Simon Spier, a closeted gay high school boy who is forced to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love online. Love, Simon came out on DVD on June 12, 2018.", "prediction 3": "Love, Simon is a 2018 American romantic teen comedy-drama film directed by Greg Berlanti, written by Isaac Aptaker and Elizabeth Berger and based on the novel Simon vs. the Homo Sapiens Agenda by Becky Albertalli. The film centers on Simon Spier, a closeted gay high school boy who is forced to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love online. Love Simon premiered at the Mardi Gras Film Festival on February 27, 2018, and was released in the United States on March 16, 2018. The DVD version came out on June 12, 2018.", "prediction 4": "Love Simon, a 2018 American romantic teen comedy-drama film based on the novel Simon vs. the Homo Sapiens Agenda by Becky Albertalli, premiered at the Mardi Gras Film Festival on February 27, 2018. It was released on March 16, 2018 by 20th Century Fox. It came out on June 12, 2018 for digital download.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 454 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Love, Simon is a 2018 American romantic teen comedy-drama film that centers on Simon Spier, a closeted gay high school boy who is forced to balance his friends, his family, and the blackmailer threatening to out him to the entire school, while simultaneously attempting to discover the identity of the anonymous classmate with whom he has fallen in love online. It is based on the novel \"Simon vs. the Homo Sapiens Agenda\" by Becky Albertalli. The film became available to pre-order on home video on January 17, 2018, was released digitally on May 29, 2018, and was released on 4K Blu-Ray, Blu-ray and DVD on June 12, 2018.\n" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When did they start using gloves in ufc?", "passages": [ [ "Ultimate Fighting Championship", "Thirty-six states enacted laws that banned \"no-hold-barred\" fighting, including New York, which enacted the ban on the eve of \"UFC 12\", forcing a relocation of the event to Dothan, Alabama.", "The UFC continued to air on DirecTV PPV, though its audience remained minuscule compared to the larger cable pay-per-view platforms of the era.", "In response to the criticism, the UFC increased cooperation with state athletic commissions and redesigned its rules to remove the less palatable elements of fights while retaining the core elements of striking and grappling.", "\"UFC 12\" saw the introduction of weight classes and the banning of fish-hooking.", "For \"UFC 14\", gloves became mandatory, while kicks to the head of a downed opponent were banned.", "\"UFC 15\" saw limitations on hair pulling, and the banning of strikes to the back of the neck and head, headbutting, small-joint manipulations, and groin strikes.", "With five-minute rounds introduced at \"UFC 21\", the UFC gradually re-branded itself as a sport rather than a spectacle.", "Led by UFC commissioner Jeff Blatnick and referee John McCarthy, the UFC continued to work with state athletic commissions." ], [ "Ultimate Fighting Championship", "Ultimate Fighting Championship\n\nThe Ultimate Fighting Championship (UFC) is an American mixed martial arts promotion company based in Las Vegas, Nevada, that is owned and operated by parent company William Morris Endeavor.", "It is the largest MMA promotion company in the world and features the highest-level fighters on the roster.", "The UFC produces events worldwide that showcase twelve weight divisions and abide by the Unified Rules of Mixed Martial Arts.", "As of 2018, the UFC has held over 400 events.", "Dana White serves as the president of the UFC.", "White has held that position since 2001; while under his stewardship, the UFC has grown into a globally popular multi-billion-dollar enterprise.", "The first event was held in 1993 at the McNichols Sports Arena in Denver, Colorado.", "The purpose of the early Ultimate Fighting Championship competitions was to identify the most effective martial art in a contest with minimal rules and no weight classes between competitors of different fighting disciplines like boxing, Brazilian jiu-jitsu, sambo, wrestling, Muay Thai, karate, and judo.", "In subsequent events, fighters began adopting effective techniques from more than one discipline, which indirectly helped create an entirely separate style of fighting known as present-day mixed martial arts.", "In 2016, UFC's parent company, Zuffa, was sold to a group led by William Morris Endeavor (WME\u2013IMG) for $4.025 billion." ], [ "Mixed martial arts in the United States", "Other promotions include: Professional Fighters League in Washington D.C., Cage Fury Fighting Championships in New Jersey, King of the Cage in Southern California, Resurrection Fighting Alliance in Kearney, Nebraska, Legacy Fighting Championships based out of Houston, Texas, Titan Fighting Championship based out of Kansas City, Kansas.", "The first recorded US female competition was at an IFC 4 on March 28, 1997.", "This was soon followed by an IFC four women tournament sanctioned by the Louisiana Boxing and Wrestling Commission on September 5, 1997 in Baton Rouge.", "All female Mixed Martial Arts Organization Invicta FC is based out of Enka, North Carolina.", "The UFC is the most popular MMA organization in the United States and is broadcast on Fox.", "Its major rival for viewers is Bellator which is broadcast on Paramount Network." ] ], "gold": "The Ultimate Fighting Championship (UFC) is an American mixed martial arts (MMA) promotion company based in Las Vegas, Nevada. The purpose of the early Ultimate Fighting Championship competitions was to identify the most effective martial art in a contest with minimal rules and no weight classes between competitors of different fighting disciplines like Boxing, Kickboxing, Brazilian Jiu-Jitsu, Sambo, Wrestling, Muay Thai, Karate, Taekwondo, and Judo. In UFC 14: Showdown, on July 27, 1997, the use of gloves became mandatory. ", "prediction 1": "The Ultimate Fighting Championship is an American mixed martial arts promotion company that is owned and operated by parent company William Morris Endeavor and produces events worldwide that showcase twelve weight divisions and abide by the Unified Rules of Mixed Martial Arts. For UFC 14 gloves became mandatory, while kicks to the head of a downed opponent were banned. The first recorded US female competition was at an IFC 4 on March 28, 1997. The first recorded US male competition was at an IFC 4 on March 28, 1997.", "prediction 2": "The Ultimate Fighting Championship (UFC) is an American mixed martial arts promotion company based in Las Vegas, Nevada, owned and operated by parent company William Morris Endeavor, that features the highest-level fighters on the roster. Since the introduction of weight classes and the banning of fish-hooking, gloves have been mandatory in the UFC. The ban also extended to kicks to the head of a downed opponent.", "prediction 3": "The Ultimate Fighting Championship is an American mixed martial arts promotion company based in Las Vegas, Nevada, that is owned and operated by parent company William Morris Endeavor. In 1994, gloves became mandatory in the UFC at UFC 14 as well as in UFC 12 as weight classes were added and fish-hooking banned. In 2016, gloves were made mandatory in UFC at UFC 21 as well.", "prediction 4": "The Ultimate Fighting Championship (UFC) is an American mixed martial arts promotion company based in Las Vegas, Nevada, that is owned and operated by parent company William Morris Endeavor. For UFC 14, gloves became mandatory, while kicks to the head of a downed opponent were banned.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 277 }, { "error type": "Irrelevant", "explanation": "", "start": 372, "end": 447 }, { "error type": "Redundant", "explanation": "The first recorded US female competition was at an IFC 4 on March 28, 1997. ", "start": 448, "end": 521 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 371 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Ultimate Fighting Championship is an American mixed martial arts promotion company based in Las Vegas, Nevada. The purpose of the early Ultimate Fighting Championship competitions was to identify the most effective martial art in a contest with minimal rules and no weight classes between competitors of different fighting disciplines like boxing, Brazilian jiu-jitsu, sambo, wrestling, Muay Thai, karate, and judo. For UFC 14 gloves became mandatory." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does fertilization take place in the femal reproductive system?", "passages": [ [ "Female reproductive system", "Female reproductive system\n\nThe female reproductive system is made up of the internal and external sex organs that function in reproduction of new offspring.", "In the human the female reproductive system is immature at birth and develops to maturity at puberty to be able to produce gametes, and to carry a foetus to full term.", "The internal sex organs are the uterus, Fallopian tubes, and ovaries.", "The uterus or womb accommodates the embryo which develops into the foetus.", "The uterus also produces vaginal and uterine secretions which help the transit of sperm to the Fallopian tubes.", "The ovaries produce the ova (egg cells).", "The external sex organs are also known as the \"genitals\" and these are the organs of the vulva including the labia, clitoris, and vaginal opening.", "The vagina is connected to the uterus at the cervix.", "At certain intervals, the ovaries release an ovum, which passes through the Fallopian tube into the uterus.", "If, in this transit, it meets with sperm, a single sperm can enter and merge with the egg, fertilizing it.", "Fertilization usually occurs in the Fallopian tubes and marks the beginning of embryogenesis." ], [ "Human fertilization", "Human fertilization\n\nHuman fertilization is the union of a human egg and sperm, usually occurring in the ampulla of the fallopian tube.", "The result of this union is the production of a zygote cell, or fertilized egg, initiating prenatal development.", "Scientists discovered the dynamics of human fertilization in the nineteenth century.", "The process of fertilization involves a sperm fusing with an ovum.", "The most common sequence begins with ejaculation during copulation, follows with ovulation, and finishes with fertilization.", "Various exceptions to this sequence are possible, including artificial insemination, \"in vitro\" fertilization, external ejaculation without copulation, or copulation shortly after ovulation.", "Upon encountering the secondary oocyte, the acrosome of the sperm produces enzymes which allow it to burrow through the outer jelly coat of the egg.", "The sperm plasma, then fuses with the egg's plasma membrane, the sperm head disconnects from its flagellum and the egg travels down the Fallopian tube to reach the uterus.", "In vitro fertilization (IVF) is a process by which egg cells are fertilized by sperm outside the womb, \"in vitro\"." ] ], "gold": "Human fertilization is the union of a human egg and sperm, occurring in the ampulla or oviduct of the fallopian tubes. This begins the process of embryogenesis. ", "prediction 1": "Fertilization usually occurs in the Fallopian tubes and marks the beginning of embryogenesis. Fertilization in the femal reproductive system takes place in the uterus, which accommodates the embryo.", "prediction 2": "Fertilization usually occurs in the Fallopian tubes and marks the beginning of embryogenesis. The female reproductive system is made up of the internal and external sex organs that function in reproduction of new offspring. In the human the female reproductive system is immature at birth and develops to maturity at puberty to be able to produce gametes, and to carry a foetus to full term.", "prediction 3": "Fertilization usually occurs in the Fallopian tubes and marks the beginning of embryogenesis. The process of fertilization involves a sperm fusing with an ovum. The most common sequence of human fertilization involves ejaculation during copulation, followed by ovulation, and finishes with fertilization. Artificial insemination is a process by which egg cells are fertilized by sperm outside the womb, \"in vitro\".", "prediction 4": "Fertilization usually occurs in the Fallopian tubes and marks the beginning of embryogenesis. In the female reproductive system, fertilization occurs in the uterus, the ovaries, and the fallopian tubes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 198 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Human fertilization is the union of a human egg and sperm, usually occurring in the ampulla of the fallopian tubes and marks the beginning of embryogenesis. " }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "When did john snow come back to life?", "passages": [ [ "Jon Snow (character)", "Jon Snow (character)\n\nJon Snow is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation \"Game of Thrones\", in which he is portrayed by English actor Kit Harington.", "He is a prominent point of view character in the novels, and has been called one of the author's \"finest creations\" and most popular characters by \"The New York Times\".", "Jon is a main character in the TV series, and his storyline in the 2015 season 5 finale generated a strong reaction among viewers.", "Speculation about the character's parentage has also been a popular topic of discussion among fans of both the books and the TV series.", "Jon is introduced in 1996's \"A Game of Thrones\" as the illegitimate son of Ned Stark, the honorable lord of Winterfell, an ancient fortress in the North of the fictional continent of Westeros.", "Knowing his prospects are limited by his status, Jon joins the Night's Watch, who guard the far northern borders from the wildlings who live beyond The Wall.", "As the rest of the Starks face grave adversity, Jon finds himself honor bound to remain with the Watch." ], [ "Jon Snow (character)", "The struggle many of them face is how to do that without losing their grip on who they are.\"", "Matt Fowler of IGN wrote in 2013 that while Jon and Daenerys' storylines in season 1 and season 2 \"felt very separate\" from the rest of the series' plot, for the first time in season 3, \"Jon's entire situation felt incorporated into the larger picture.\"", "Fowler also added that Jon's \"oath-breaking romance with Ygritte added a lot of heat to the story\".", "In May 2015, \"International Business Times\" called Jon \"clearly the most popular character\" of the series.", "In a 2015 interview Benioff said, \"The problem with Jon is, he\u2019s not a cautious man.", "It's the problem with him, and also the reason we love him.", "He is a hero, but heroes are inherently incautious.\"", "Weiss added, \"At the end of the day, Jon is his father\u2019s son, he\u2019s a person who\u2019s honorable to a fault and does the right thing even when the right thing is extremely dangerous to him personally.\"", "In the June 2015 season 5 finale \"Mother's Mercy\", Jon is stabbed to death by Alliser Thorne and several men of the Night's Watch after being labeled a traitor." ], [ "Jon Snow (character)", "However, a story in \"Vanity Fair\" pointed out that Charles Dance had been seen in Belfast the previous year after his character Tywin Lannister's death as well, and he only appeared in the first episode of the subsequent season as a corpse.", "Another photo that showed Harington on set in Belfast in a costume that varied from the Night's Watch outfit was published on September 25, 2015.", "A season 6 \"Game of Thrones\" promotional poster released in November 2015 featured a bloodied Jon.", "Jon is resurrected by Melisandre in \"Home\", the May 2016 second episode of season 6.", "Though calling it a \"predictable move\" for a television series, David Sims of \"The Atlantic\" praised the plot development as \"the right choice\" for the show's narrative.", "In a subsequent interview with \"Entertainment Weekly\", Harington said:\nJoanna Robinson of \"Vanity Fair\" credited Jon's much-discussed cliffhanger death as a primary factor behind \"Game of Thrones\" subsequent 25% ratings increase for season 6.", "Harington's performance in season 6 earned the actor his first Primetime Emmy Award nomination in July 2016.", "Harington as Jon has the most screen time of any other character in the seven seasons released to date." ] ], "gold": "Jon Snow is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones, in which he is portrayed by English actor Kit Harington. In the June 2015 season 5 finale Mother's Mercy, Jon is stabbed to death by Alliser Thorne and several men of the Night's Watch after being labeled a traitor. Jon is resurrected by Melisandre in Home, the 52nd episode in the show, or season 6 episode 2, released in May 2016.", "prediction 1": "On Game of Thrones, Jon Snow is a character who first appears in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin and its television adaptation, Game of Thrones, in which he is portrayed by English actor Kit Harington. In the 2015 season 5 finale, Jon is stabbed to death by Alliser Thorne and several men of the Night's Watch after being labeled a traitor. In the May 2016 second episode of season 6, Jon is resurrected by Melisandre.", "prediction 2": "The character Jon Snow is a main character in the television show Game of Thrones. His storyline in the 2015 season 5 finale generated a strong reaction among viewers. Jon is resurrected by Melisandre in \"Home\", the May 2016 second episode of season 6.", "prediction 3": "Jon Snow is the main character in the HBO television series Game of Thrones, and his storyline in the 2015 season 5 finale generated a strong reaction among viewers. In the 2016 season 3, Jon is resurrected by Melisandre in the episode Home.", "prediction 4": "Jon Snow is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones, in which he is portrayed by English actor Kit Harington. Jon Snow was stabbed to death by Alliser Thorne and several men of the Night's Watch in the June 2015 season 5 finale Mother's Mercy. However, he was revived by Melisandre in Home, the May 2016 second episode of season 6.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "On Game of Thrones, Jon Snow is a character who first appears in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin and its television adaptation, Game of Thrones, in which he is portrayed by English actor Kit Harington. In the 2015 season 5 finale, Jon is stabbed to death by Alliser Thorne and several men of the Night's Watch after being labeled a traitor. In the May 2016 second episode of season 6, Jon is resurrected by Melisandre." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who died in the beginning of fast and furious?", "passages": [ [ "Fast & Furious (2009 film)", "Fast & Furious (2009 film)\n\nFast & Furious (alternatively known as The Fast and the Furious 4, or Fast & Furious 4) is a 2009 American action film directed by Justin Lin and written by Chris Morgan.", "It is the fourth installment of \"The Fast and the Furious\" franchise.", "The film, which stars Vin Diesel, \nPaul Walker, Michelle Rodriguez, and Jordana Brewster, is set between the second and installments and bridges from the first film into a present-day setting, with main members of the original cast reprising their roles.", "Originally released on April 3, 2009, it received negative reviews upon release, but was a box office success grossing $363 million worldwide.", "It was followed by \"Fast Five\" in 2011.", "For this entry and onward \"Fast & Furious\" is the official brand name of the franchise, which was used for future installments, as well as video games and a .", "Five years after the first film, Dominic Toretto (Vin Diesel) and his new crew, consisting of his girlfriend Letty (Michelle Rodriguez), Tego Leo (Tego Calderon), Rico Santos (Don Omar), Cara (Mirtha Michelle) and Han Lue (Sung Kang), are hijacking fuel tankers in the Dominican Republic." ], [ "Fast & Furious (2009 film)", "Dominic suspects that the police are on their trail, forcing the crew to disband and go their separate ways, with Han deciding to go to Tokyo.", "Realizing that he must leave, Dominic runs, leaving Letty behind to protect her from harm.", "Three months later, Dominic is now residing in Panama City.", "He gets a call from his sister, Mia Toretto (Jordana Brewster), who tells him that Letty has been murdered.", "Dominic heads back to Los Angeles to attend her funeral and examine the crash and finds traces of nitromethane on the ground.", "He visits the only car mechanic that sells nitromethane in LA and forces him into giving him the name David Park, the man who ordered the fuel, and informs him that the only car that uses nitromethane in the area is a green 1972 Ford Gran Torino Sport.", "Meanwhile, FBI agent Brian O'Conner (Paul Walker) is trying to track down a Mexican drug lord, Arturo Braga (John Ortiz).", "His search leads him to David Park, and he tracks him down using an illegal modification record on his car.", "Dominic arrives at Park's apartment first and hangs him out of the window by his ankles before Brian arrives.", "Brian saves Park and Park becomes the FBI's new informant.", "Park gets Brian into a street race." ], [ "The Fate of the Furious", "The Fate of the Furious\n\nThe Fate of the Furious (alternatively known as Fast & Furious 8 and Fast 8, and often stylized as F8) is a 2017 American action film directed by F. Gary Gray and written by Chris Morgan.", "It is the eighth installment in \"The Fast and the Furious\" franchise.", "The film stars Vin Diesel, Dwayne Johnson, Jason Statham, Michelle Rodriguez, Tyrese Gibson, Chris \"Ludacris\" Bridges, Scott Eastwood, Nathalie Emmanuel, Elsa Pataky, Kurt Russell and Charlize Theron.", "\"The Fate of the Furious\" follows Dominic Toretto (Diesel), who has settled down with his wife Letty Ortiz (Rodriguez), until cyberterrorist Cipher (Theron) coerces him into working for her and turns him against his team, forcing them to find Dom and take down Cipher.", "\"The Fate of the Furious\" marks the first installment in the franchise since \"\" (2006) not to feature both Paul Walker, who died in a single-vehicle crash during the filming of \"Furious 7\" (2015) on November 30, 2013, and Jordana Brewster.", "Script rewrites to the seventh installment after Walker's death were intended to complete the story arcs for both of their characters (Brian O'Conner and Mia Toretto, respectively)." ] ], "gold": "Fast & Furious, also known as Fast & Furious 4, is a 2009 American action film. It is the sequel to The Fast and the Furious and the fourth installment in the Fast & Furious franchise. In the film, fugitive Dominic Toretto and Federal Bureau of Investigation (FBI) agent Brian O'Conner form an unlikely pairing to apprehend a drug lord and avenge the murder of Toretto's lover, Letty Ortiz, who is portrayed by Michelle Rodriguez.", "prediction 1": "The Fast and the Furious trilogy starts with the death of Paul Walker in Fast & Furious 1, which began in 2009. In Fast & Furious 2, Paul Walker dies in a single-vehicle crash. In Fast & Furious 3, Paul Walker dies in a plane crash in which he was driving a Ford Mustang. In Fast & Furious 4, Jordana Brewster dies in a car crash.", "prediction 2": "Fast & Furious, also known as The Fast and the Furious 4 and Fast & Furious 5, is a 2009 American action film directed by Justin Lin and written by Chris Morgan. It is the first film in the Fast and Furious franchise. In the film, Dominic Toretto, played by Vin Diesel, is killed by the infamous cyberterrorist Cipher, played by Charlize Theron. Walker died in a single-vehicle crash during the filming of Fast 7 (2015) on November 30, 2013. In the Fast & Furious 7, Jordana Brewster plays Mia Toretto, who was killed by the gunman.", "prediction 3": "In the 2009 American action film Fast & Furious, Vin Diesel plays Dominic Toretto, a partner to the Fast and the Furious franchise, and the lead character in Fast & Furious. Paul Walker dies in a single-vehicle crash during the filming of Fast 7 on November 30, 2013, and Jordana Brewster dies in the beginning of Fast & Furious.", "prediction 4": "Fast and Furious, also known as Fast & Furious 4 or Fast & Furious 5, is a 2009 American action film directed by Justin Lin and written by Chris Morgan. In the film, Vin Diesel plays Dominic Toretto, who lives in Panama City with his new crew, consisting of his girlfriend Letty, Michelle Rodriguez plays Letty, Don Omar plays Don Omar, and Mariana Michelle plays Mirtha Michelle. In Fast & Furious 8, Jordana Brewster plays Mia Toretto, who is killed by cyberterrorist Cipher.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 112, "end": 132 }, { "error type": "Unverifiable", "explanation": "", "start": 177, "end": 271 }, { "error type": "Unverifiable", "explanation": "", "start": 272, "end": 330 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 111 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Fast & Furious, also known as Fast & Furious 4, is a 2009 American action film. It is the fourth installment of \"The Fast and the Furious\" franchise. In Fast & Furious 7, Paul Walker dies in a single-vehicle crash. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the iconic trump tower open its doors?", "passages": [ [ "Trump Plaza (Jersey City)", "Because construction permits were still pending, Trump's involvement was not announced until September 29, 2005, when he traveled to Jersey City to make the announcement.", "Trump stated that he had a substantial investment in the new project, but did not specify how much.", "The two towers would include the same number of floors and units as the previously planned HarborSpire towers, and were expected to cost a total of $415 million.", "The towers were expected to become the tallest buildings in New Jersey, surpassing the tallest office building, the 42-story Goldman Sachs Tower; and the tallest residential building, the 40-story Marbella Apartments.", "Construction, to be handled by Bovis Lend Lease, was expected to begin in November 2005, with occupancy expected to begin in November 2007.", "Condominium units went on sale in September 2006.", "By February 2007, 215 units had been sold, while construction had progressed to the 25th floor and occupancy was expected for March 2008.", "At the time, Geibel denied that the extent of Trump's involvement was the licensing of his surname: \"people don't realize how much involvement he has in the project.\"", "At Trump's suggestion, the project was to feature BMW zipcars upon its opening.", "Trump Plaza was designed by DeWitt Tishman Architects LLP and was completed in 2008." ], [ "Trump World Tower", "Trump World Tower\n\nTrump World Tower is a residential condominium in Midtown Manhattan, New York City.", "The building was developed by Donald Trump and opened in 2001.", "The tower is located at 845 United Nations Plaza (First Avenue between 47th and 48th Streets, Manhattan).", "Construction began in 1999 and concluded in 2001.", "Designed by the architect Costas Kondylis, the building is high and has 72 constructed floors (but lists 90 stories on elevator panels) with curtain wall facades of dark, bronze-tinted glass.", "The resulting large windows allow for extensive views of the East River and Midtown Manhattan.", "The building is constructed with concrete to improve its wind resistance.", "In 1961, the 18-story United Engineering Center was built on the site.", "The Center was demolished to make way for the Trump World Tower.", "In 1997, Trump and his partners, including the Daewoo Corp., a South Korean \"chaebol\", signed a deal to purchase the site from the United Engineering Trustees for $52 million.", "Trump also acquired unused air rights from at least seven adjacent low-rise properties, specifically two brownstones, the Catholic Holy Family Church and the Japan Society.", "Demolition began in October 1998." ], [ "Ysrael Seinuk", "In 2004, \"Real Estate Weekly\" wrote, \"You can't walk down the streets of Manhattan without seeing a building that famed structural engineer Ysrael Seinuk hasn't touched.\"", "Seinuk and the firm he heads engineered more than 50 high-rise office buildings and hundreds of apartment structures in New York.", "He was dubbed \"Mr. New York\" for his engineering of New York's skyscrapers.", "Seinuk said, \"My work has always been about stretching the horizon.\"", "Seinuk worked on a number of skyscrapers for Donald Trump, including the 70-story Trump World Tower, Trump International Hotel and Tower, and the 58-story Trump Tower on Fifth Avenue.", "Trump said of Seinuk, \"Ysrael Seinuk and his staff are the best in the business.\"", "Other structures that Seinuk worked on include New York's Lipstick Building, the New York Mercantile Exchange, the 48-story Cond\u00e9 Nast Building, the 45-story Bear Stearns Building, and the Arthur Ashe Stadium.", "He also worked on the Chapultepec Tower in Mexico City and the O-14 tower in Dubai.", "Seinuk has compared his projects to children: \"Projects are like children.", "Some are very talkative, some are very smart, some are very playful." ] ], "gold": "Trump Tower is a 58-floor, 664-foot-tall (202 m) mixed-use skyscraper at 721\u2013725 Fifth Avenue in the Midtown Manhattan neighborhood of New York City, between 56th and 57th Streets. It opened on November 30, 1983 and serves as the headquarters for the Trump Organization. Trump World Tower is a residential condominium in Midtown Manhattan, New York City. The building was developed by Donald Trump and opened in 2001. The tower is located at 845 United Nations Plaza (First Avenue between 47th and 48th Streets, Manhattan). Trump Towers Istanbul are two conjoined towers in \u015ei\u015fli, Istanbul, Turkey that opened in 2010. One of the towers is an office tower, and the other a residential tower, consisting of over 200 residences. The complex also holds a shopping mall with some 80 shops and a multiplex cinema.", "prediction 1": "Donald Trump Tower opened its doors on September 29, 2005. Trump Plaza (Jersey City) opened on September 29, 2005. The Trump World Tower was a residential condominium in Midtown Manhattan, New York City. Construction began in 1999 and concluded in 2001.", "prediction 2": "Trump World Tower is a residential condominium in Midtown Manhattan, New York City. The building was developed by Donald Trump and opened in 2001. Construction began in 1999 and concluded in 2001. Trump Plaza was designed by DeWitt Tishman Architects LLP and was completed in 2008.", "prediction 3": "Trump World Tower is a residential condominium in Midtown Manhattan, New York City. The building was developed by Donald Trump and opened in 2001. Trump Plaza was designed by DeWitt Tishman Architects LLP and was completed in 2008. Trump World Tower is located at 845 United Nations Plaza (First Avenue between 47th and 48th Streets, Manhattan). Construction began in 1999 and concluded in 2001.", "prediction 4": "Trump Tower was a residential condominium in Midtown Manhattan, New York City. It was developed by Donald Trump and opened in 2001. Trump World Tower is a residential condominium in Midtown Manhattan, New York City. Construction began in 1999 and concluded in 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 114 }, { "error type": "Unverifiable", "explanation": "", "start": 19, "end": 58 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Donald's Trump Tower is a 58-story skyscraper on Fifth Avenue. . The Trump World Tower was a residential condominium in Midtown Manhattan, New York City. The building was developed by Donald Trump and opened in 2001. The tower is located at 845 United Nations Plaza (First Avenue between 47th and 48th Streets, Manhattan)." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who has won the 2018 formula 1 australian grand pix tournament?", "passages": [ [ "2018 Australian Grand Prix", "2018 Australian Grand Prix\n\nThe 2018 Australian Grand Prix (formally known as the Formula 1 2018 Rolex Australian Grand Prix) was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria.", "The race was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship.", "The race marked the eighty-second race in the combined history of the Australian Grand Prix\u2014which dates back to the 100 Miles Road Race of 1928\u2014and the twenty-third time the event was held at the Albert Park circuit.", "Ferrari driver Sebastian Vettel was the defending race winner.", "Lewis Hamilton started the race from pole\u2014his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "The race marked the competitive d\u00e9but of the \"halo\" cockpit protection device after eighteen months of rigorous testing.", "Tyre supplier Pirelli provided teams with the soft, supersoft and ultrasoft compounds.", "In the week before the Grand Prix, race officials confirmed the inclusion of a third drag reduction system (DRS) zone.", "The detection point for the third zone was positioned on the approach to the Turn 11-12 chicane with the activation point on the exit to Turn 12." ] ], "gold": "The 2018 Australian Grand Prix was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria. The race was contested at the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner.", "prediction 1": "The Formula 1 Australian Grand Prix, formally known as the Formula 1 2018 Rolex Australian Grand Prix, was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria. Sebastian Vettel, the defending race winner, was joined by Lewis Hamilton as the defending race winner.", "prediction 2": "The 2018 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner. Lewis Hamilton started the race from pole\u2014his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "prediction 3": "The Formula 1 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner.", "prediction 4": "The Formula 1 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Sebastian Vettel, Ferrari driver, was the defending race winner. Lewis Hamilton started the race from pole position\u2014his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 37, "end": 102 }, { "error type": "Unverifiable", "explanation": "", "start": 223, "end": 281 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 2018 Australian Grand Prix was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria. The race was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "What do you call a younger girl in japanese?", "passages": [ [ "Hypocorism", "In Japan, diminutive names are made by adding an honorific suffix to a person's name, or to part of the name.", "The suffix \"-chan\" is typically added to a girl's name as a term of endearment.", "The suffix \"-kun\" is added to a male's name.", "Outside of family, the suffix \"-kun\" typically implies a relationship between an authority (the caller) and a subordinate.", "Thus, it is often used by teachers calling on male students, and a boss or supervisor calling on male employees.", "The term \"-chan\" is occasionally added to the name of an effeminate boy or man.", "While the addition of \"-chan\" to a girl's name is endearment and intimacy, when applied to a male's name, it may be either a term of endearment or it may be added as a derogatory taunt, depending on the context and the nature of the relationship.", "In Persian some of the most used personal names have hypocorisms.", "Many of these hypocorisms are formed by truncating the name and adding an -i to the end, or by using just a part of a composed name.", "In Polish, there are multiple affixes used to create the diminutive." ], [ "Honorific speech in Japanese", "This latter example includes two honorific prefixes, nominalization of a verb (for formality), a respectful form, and two humble forms.", "Honorifics in Japanese, or \"keigo\" (\u656c\u8a9e), fall under three main categories: \"sonkeigo\" (\u5c0a\u656c\u8a9e), respectful language; \"kenj\u014dgo\" (\u8b19\u8b72\u8a9e), humble language (or \"modest language\"); and \"teineigo\" (\u4e01\u5be7\u8a9e), polite language.", "Linguistically, the former two are referent honorifics, used for someone being talked about, and the last is an addressee honorific, used for someone being talked to.", "Sometimes two more categories are also used, for a total of five categories: \"teich\u014dgo\" (\u4e01\u91cd\u8a9e) \"courteous language\" and \"bikago\" (\u7f8e\u5316\u8a9e), \"word beautification\", but more often these are included in the above three:", "teich\u014dgo as a kind of kenj\u014dgo (humble), bikago as a kind of teineigo (polite)\u2014these two other categories use the same forms as the general categories, but are used in different contexts, hence differentiated by some linguists.", "Each type of speech has its own vocabulary and verb endings." ], [ "Etiquette in Japan", "The titles for people are \"-chan\" (most often for female close friends, young girls or infants of either gender), \"-kun\" (most often for male close friends, or young boys), \"-san\" (for adults in general) and \"-sama\" (for customers, and also used for feudal lords, gods or buddhas).", "Letter addresses, even those sent to close friends, are normally written in quite formal language.", "Unless some other title is available (\"sensei\", for example, which can mean \"doctor\" or \"professor\" among other things) the standard title used with the addressee's name is the very formal \"-sama\" (\u69d8).", "Letters addressed to a company take the title after the company name.", "It is also considered important to mention in the address if the company is incorporated (kabushiki gaisha) or limited (y\u016bgen gaisha).", "When a letter is addressed to a company employee at their place of work, the address should contain the full name of the place of work, as well as the title of the employee's position, and the full name of the employee.", "Personal letters are traditionally written by hand using blue or black ink, or with a writing brush and black ink.", "The preferred paper is \"washi\" (Japanese paper)." ] ], "gold": "The Japanese language makes use of honorific suffixes and prefixes when referring to others in a conversation. Suffixes are attached to the end of names and are often gender-specific, while prefixes are attached to the beginning of many nouns. Honorific suffixes also indicate the level of the speaker and referred individual's relationship and are often used alongside other components of Japanese honorific speech. Kun is generally used by people of senior status addressing or referring to those of junior status, like an older male to a young female employee. Chan expresses that the speaker finds a person endearing. In general, -chan is used for young children, close friends, babies, grandparents and sometimes female adolescents. On\u0113san is big sister, or also a young lady.", "prediction 1": "In Japan, diminutive names are made by adding an honorific suffix to a person's name, or to part of the name. The suffix \"-chan\" is typically added to a girl's name as a term of endearment. The suffix \"-kun\" is added to a male's name.", "prediction 2": "In Japan, diminutive names are made by adding an honorific suffix to a person's name, or to part of the name. The suffix -chan is typically added to a girl's name as a term of endearment. The suffix -kun is added to a male's name. Outside of family, the suffix -kun typically implies a relationship between an authority (the caller) and a subordinate.", "prediction 3": "In Japan, diminutive names are made by adding an honorific suffix to a person's name, or to part of the name. The suffix -chan is typically added to a girl's name as a term of endearment. The suffix -kun is typically added to a male's name. Outside of family, the suffix -kun typically implies a relationship between an authority (the caller) and a subordinate.", "prediction 4": "There are several names for a younger girl in Japan. The suffix -chan is typically added to a girl's name as a term of endearment. The suffix -kun is typically added to a male's name as a term of endearment.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In Japan, diminutive names are made by adding an honorific suffix to a person's name, or to part of the name. The suffix \"-chan\" is typically added to a girl's name as a term of endearment. It is used most often for female close friends, young girls or infants of either gender. The suffix \"-kun\" is added to a male's name. It typically implies a relationship between an authority and a subordinate." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Where did the battle of the philippine sea take place?", "passages": [ [ "Battle of the Philippine Sea", "Despite this, 80 of the returning aircraft were lost.", "Some crashed on flight decks, but the majority ditched into the sea.", "Some pilots intentionally went down in groups to facilitate rescue, and more ditched individually either in a controlled landing, with a few gallons of fuel left, or in a crash after their engines ran dry.", "Approximately three-quarters of the crews were rescued from the sea, either that night from crash locations within the task forces, or over the next few days for those further out, as search planes and destroyers criss-crossed the ocean looking for them.", "That night, Toyoda ordered Ozawa to withdraw from the Philippine Sea.", "U.S. forces gave chase, but the battle was over.", "The four Japanese air strikes involved 373 carrier aircraft, of which 130 returned to the carriers; many of them were subsequently lost when \"Taiho\" and \"Sh\u014dkaku\" were sunk.", "After the second day of the battle, losses totaled three carriers, more than 433 carrier aircraft, and around 200 land-based aircraft.", "These losses to the already outnumbered Japanese fleet air arm were irreplaceable.", "The Japanese had spent the better part of a year reconstituting their carrier air groups, and the American Fast Carrier Task Force had destroyed 90% of it in two days." ], [ "Battle of the Philippine Sea", "Battle of the Philippine Sea\n\nThe Battle of the Philippine Sea (June 19\u201320, 1944) was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions.", "It took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War.", "The battle was the last of five major \"carrier-versus-carrier\" engagements between American and Japanese naval forces, and pitted elements of the United States Navy's Fifth Fleet against ships and aircraft of the Imperial Japanese Navy's Mobile Fleet and nearby island garrisons.", "This was the largest carrier-to-carrier battle in history.", "The aerial part of the battle was nicknamed the Great Marianas Turkey Shoot by American aviators for the severely disproportional loss ratio inflicted upon Japanese aircraft by American pilots and anti-aircraft gunners.", "During a debriefing after the first two air battles a pilot from remarked \"Why, hell, it was just like an old-time turkey shoot down home!\"", "The outcome is generally attributed to American improvements in training, tactics, technology (including the top-secret anti-aircraft proximity fuze), and ship and aircraft design.", "During the course of the battle, American submarines torpedoed and sank two of the largest Japanese fleet carriers taking part in the battle." ] ], "gold": "The Battle of the Philippine Sea, held on June 19\u201320, 1944, was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. It took place in the Philippine Sea and the Mariana Islands.", "prediction 1": "The Battle of the Philippine Sea was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. It took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War. The battle was the last of five major carrier-versus-carrier engagements between American and Japanese naval forces, and pitted elements of the United States Navy's Fifth Fleet against ships and aircraft of the Imperial Japanese Navy's Mobile Fleet and nearby island garrisons. The aerial part of the battle was nicknamed the Great Marianas Turkey Shoot by American aviators for the severely disproportional loss ratio inflicence ratio infliced upon Japanese aircraft by American pilots and anti-aircraft gunners.", "prediction 2": "The Battle of the Philippine Sea was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. It took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War. The battle was the last of five major \"carrier-versus-carrier\" engagements between American and Japanese naval forces, pitting elements of the United States Navy's Fifth Fleet against ships and aircraft of the Imperial Japanese Navy's Mobile Fleet and nearby island garrisons.", "prediction 3": "The Battle of the Philippine Sea was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. It took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War. The battle was the last of five major \"carrier-versus-carrier\" engagements between American and Japanese naval forces, and pitted elements of the United States Navy's Fifth Fleet against ships and aircraft of the Imperial Japanese Navy's Mobile Fleet and nearby island garrisons.", "prediction 4": "The Battle of the Philippine Sea was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. The battle took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War. It took place in the Philippine Sea from June 19\u201320, 1944.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 551 }, { "error type": "Irrelevant", "explanation": "", "start": 552, "end": 787 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Battle of the Philippine Sea, held on June 19\u201320, 1944, was a major naval battle of World War II that eliminated the Imperial Japanese Navy's ability to conduct large-scale carrier actions. It took place during the United States' amphibious invasion of the Mariana Islands during the Pacific War. " }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "Most home runs in a single season by a player?", "passages": [ [ "Home run", "Only eight other major league players have hit as many as 600: Hank Aaron (755), Babe Ruth (714), Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609).", "The single season record is 73, set by Barry Bonds in 2001.", "Other notable single season records were achieved by Babe Ruth who hit 60 in 1927, Roger Maris, with 61 home runs in 1961, and Mark McGwire, who hit 70 in 1998.", "Negro League slugger Josh Gibson's Baseball Hall of Fame plaque says he hit \"almost 800\" home runs in his career.", "The \"Guinness Book of World Records\" lists Gibson's lifetime home run total at 800.", "Ken Burns' award-winning series, \"Baseball\", states that his actual total may have been as high as 950.", "Gibson's true total is not known, in part due to inconsistent record keeping in the Negro Leagues.", "The 1993 edition of the MacMillan \"Baseball Encyclopedia\" attempted to compile a set of Negro League records, and subsequent work has expanded on that effort.", "Those records demonstrate that Gibson and Ruth were of comparable power." ], [ "50 home run club", "50 home run club\n\nIn Major League Baseball (MLB), the 50 home run club is the group of batters who have hit 50 or more home runs in a single season.", "Babe Ruth was the first to achieve this, doing so in 1920.", "By reaching the milestone, he also became the first player to hit 30 and then 40 home runs in a single-season, breaking his own record of 29 from the 1919 season.", "Ruth subsequently became the first player to reach the 50 home run club on four occasions, repeating the achievement in 1921, 1927 and 1928.", "He remained the only player to accomplish this until Mark McGwire and Sammy Sosa matched his feat in 1999 and 2001, respectively, thus becoming the only players to achieve four consecutive 50 home run seasons.", "Barry Bonds hit the most home runs to join the club, collecting 73 in 2001.", "The most recent players to reach the milestone are Giancarlo Stanton and Aaron Judge, achieving the feat during the 2017 season.", "In total, 29 players have reached the 50 home run club in MLB history and nine have done so more than once.", "Of these, seventeen were right-handed batters, eleven were left-handed, and one was a switch hitter, meaning he could bat from either side of the plate.", "Four of these players (including two active members of the 50 home run club) have played for only one major league team." ] ], "gold": "Barry Bonds holds the record for the most home runs in a single season, with 73.", "prediction 1": "In Major League Baseball, the 50 home run club is the group of batters who have hit 50 or more home runs in a single season. Babe Ruth was the first player to achieve this, doing so in 1920. By reaching the milestone, he also became the first player to hit 30 and then 40 home runs in a single season, breaking his own record of 29 from the 1919 season. The most home runs by a player in a single season in Major League Baseball history is 700. By reaching the milestone, he also became the first player to reach the 50 home run club on four occasions, repeating the achievement in 1921, 1927 and 1928, respectively. The most home runs by a single season record is 73, set by Barry Bonds in 2001.", "prediction 2": "In Major League Baseball, the 50 home run club is the group of batters who have hit 50 or more home runs in a single season. Babe Ruth was the first player to achieve this, doing so in 1920. By reaching the milestone, he also became the first player to hit 30 and then 40 home runs in a single season, breaking his own record of 29 from the 1919 season. By reaching the milestone, he also became the first player to hit 30 and then 40 home runs in a single-season, breaking his own record of 29 from 1919. The single season record is 73, set by Barry Bonds in 2001.", "prediction 3": "In Major League Baseball, the 50 home run club is the group of batters who have hit 50 or more home runs in a single season. Babe Ruth was the first player to achieve this, doing so in 1920. By reaching the milestone, he also became the first player to hit 30 and then 40 home runs in a single-season, breaking his own record of 29 from the 1919 season. Hank Aaron hit 755 home runs in a single season in 1920. Alex Rodriguez hit 696 home runs in a single season in 1919.", "prediction 4": "In Major League Baseball, the 50 home run club is the group of batters who have hit 50 or more home runs in a single season. Babe Ruth was the first player to achieve this, doing so in 1920. The most home runs in a single season by a player in MLB history is 755 by Hank Aaron. The most home runs in a single season by a pitcher is 798 by Alex Rodriguez. The most home runs in a single season by a strikeout is 73 by Barry Bonds in 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 124 }, { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 191, "end": 353 }, { "error type": "Unverifiable", "explanation": "", "start": 354, "end": 444 }, { "error type": "Irrelevant", "explanation": "", "start": 445, "end": 616 } ], "missing-info": [], "corrected-prediction": " The most home runs by a single season record is 73, set by Barry Bonds in 2001." }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "Who constructed the suez canal and when was it finished?", "passages": [ [ "Suez Canal", "Suez Canal\n\nThe Suez Canal ( \"\") is a sea-level waterway in Egypt, connecting the Mediterranean Sea to the Red Sea through the Isthmus of Suez.", "Constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869.", "The canal offers watercraft a shorter journey between the North Atlantic and northern Indian Oceans via the Mediterranean and Red Seas by avoiding the South Atlantic and southern Indian Oceans, reducing the journey by approximately .", "It extends from the northern terminus of Port Said to the southern terminus of Port Tewfik at the city of Suez.", "Its length is , including its northern and southern access channels.", "In 2012, 17,225 vessels traversed the canal (average 47 per day).", "The original canal was a single-lane waterway with passing locations in the Ballah Bypass and the Great Bitter Lake.", "It contains no locks system, with seawater flowing freely through it.", "In general, the canal north of the Bitter Lakes flows north in winter and south in summer.", "South of the lakes, the current changes with the tide at Suez.", "The canal is owned and maintained by the Suez Canal Authority (SCA) of Egypt.", "Under the Convention of Constantinople, it may be used \"in time of war as in time of peace, by every vessel of commerce or of war, without distinction of flag\"." ], [ "Suez Canal", "In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time.", "The expansion was planned to double the capacity of the Suez Canal from 49 to 97 ships a day.", "At a cost of $8.4 billion, this project was funded with interest-bearing investment certificates issued exclusively to Egyptian entities and individuals.", "The \"New Suez Canal\", as the expansion was dubbed, was opened with great fanfare in a ceremony on 6 August 2015.", "On 24 February 2016, the Suez Canal Authority officially opened the new side channel.", "This side channel, located at the northern side of the east extension of the Suez Canal, serves the East Terminal for berthing and unberthing vessels from the terminal.", "As the East Container Terminal is located on the Canal itself, before the construction of the new side channel it was not possible to berth or unberth vessels at the terminal while the convoy was running.", "Ancient west\u2013east canals were built to facilitate travel from the Nile River to the Red Sea.", "One smaller canal is believed to have been constructed under the auspices of Senusret II or Ramesses II.", "Another canal, probably incorporating a portion of the first, was constructed under the reign of Necho II, but the only fully functional canal was engineered and completed by Darius I." ], [ "Suez Canal Company", "Suez Canal Company\n\nThe Universal Maritime Suez Canal Company (, or simply \"Compagnie de Suez\" for short) was the corporation that constructed the Suez Canal between 1859 and 1869 and operated it until the 1956 Suez Crisis.", "It was formed by Ferdinand de Lesseps in 1858, and it owned and operated the canal for many years thereafter.", "Initially, French private investors were the majority of the shareholders, with Egypt also having a significant stake.", "When Isma'il Pasha became W\u0101li of Egypt and Sudan in 1863, he refused to adhere to portions of the concessions to the Canal company made by his predecessor Said.", "The problem was referred during 1864 to the arbitration of Napoleon III, who awarded \u00a33,800,000 (equivalent to \u00a3 in ) to the company as compensation for the losses they would incur by the changes to the original grant which Ismail demanded.", "During 1875, a financial crisis forced Isma'il to sell his shares to the government of the United Kingdom for only \u00a33,976,582 (equivalent to \u00a3 in ).", "The company operated the canal until its nationalization by Egyptian President Gamal Abdel Nasser in 1956, which led to the Suez Crisis.", "In 1962, Egypt made its final payments for the canal to the Universal Suez Ship Canal Company and took full control of the Suez Canal.", "Today the canal is owned and operated by the Suez Canal Authority." ] ], "gold": "In 1858, Ferdinand de Lesseps formed the Suez Canal Company for the express purpose of building the canal. Construction of the canal lasted from 1859 to 1869 and took place under the regional authority of the Ottoman Empire. The canal officially opened on 17 November 1869.The \"New Suez Canal\", as the expansion was dubbed, was opened in a ceremony on 6 August 2015. On 24 February 2016, the Suez Canal Authority officially opened the new side channel. ", "prediction 1": "The Suez Canal is a sea-level waterway in Egypt, connecting the Mediterranean Sea to the Red Sea through the Isthmus of Suez. Constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869. In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time. The expansion was planned to double the capacity of the Suez Canal from 49 to 97 ships a day. On 24 February 2016, the Suez Canal Authority officially opened the new side channel.\n", "prediction 2": "The Suez Canal is a sea-level waterway in Egypt, connecting the Mediterranean Sea to the Red Sea through the Isthmus of Suez. Constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869. In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time. In October 2014, construction was launched to expand the canal's side channel. The expansion was planned to double the capacity of the canal from 49 to 97 ships a day.", "prediction 3": "The Suez Canal is a sea-level waterway in Egypt, connecting the Mediterranean Sea to the Red Sea through the Isthmus of Suez. Constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869. In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time. His Majesty Darius I built the canal with his son Isma'il Pasha. On 24 February 2016, the Suez Canal Authority officially opened the new side channel.", "prediction 4": "The Suez Canal is a sea-level waterway in Egypt, connecting the Mediterranean Sea to the Red Sea through the Isthmus of Suez. Constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869. The canal offers watercraft a shorter journey between the North Atlantic and northern Indian Oceans via the Mediterranean Sea to the Red Sea by avoiding the South Atlantic and southern Indian Oceans, reducing the journey by approximately 840 miles. In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time. The expansion was planned to double the Suez Canal from 49 ships a day.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 125 }, { "error type": "Irrelevant", "explanation": "", "start": 352, "end": 445 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 351 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Suez Canal was constructed by the Suez Canal Company between 1859 and 1869, it was officially opened on 17 November 1869. The company was formed by Ferdinand de Lesseps in 1858. In August 2014, construction was launched to expand and widen the Ballah Bypass for to speed the canal's transit time. At a cost of $8.4 billion, this project was funded with interest-bearing investment certificates issued exclusively to Egyptian entities and individuals. The \"New Suez Canal\", as the expansion was dubbed, was opened with great fanfare in a ceremony on 6 August 2015. On 24 February 2016, the Suez Canal Authority officially opened the new side channel.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was fly me to the moon written?", "passages": [ [ "Fly Me to the Moon", "Fly Me to the Moon\n\nFly Me to the Moon, originally titled In Other Words, is a song written in 1954 by Bart Howard.", "Kaye Ballard made the first recording of the song the year it was written.", "Since then, it has become a frequently recorded jazz standard, often featured in popular culture.", "Frank Sinatra's 1964 version was closely associated with the Apollo missions to the Moon.", "In 1999, the US-based Songwriters Hall of Fame honored \"Fly Me to the Moon\" by inducting it as a \"Towering Song\" which is an award \"...presented each year to the creators of an individual song that has influenced our culture in a unique way over many years.\u201d\n\n", "In 1954, when he began to write the song that became \"Fly Me to the Moon\", Bart Howard had been pursuing a career in music for over 20 years.", "He played piano to accompany cabaret singers, but also wrote songs with Cole Porter, his idol, in mind.", "In response to a publisher's request for a simpler song, Bart Howard wrote a cabaret ballad which he titled \"In Other Words\".", "A publisher tried to make him change some words from \"fly me to the moon\" to \"take me to the moon,\" but Howard refused." ], [ "Fly Me to the Moon (Bobby Womack album)", "Fly Me to the Moon (Bobby Womack album)\n\n", "Fly Me to the Moon is the debut studio album by American singer-songwriter Bobby Womack.", "The album was released in January 1969, by Minit Records.", "All tracks composed by Bobby Womack; except where indicated" ], [ "Keijo (manga)", "Keijo (manga)\n\n, also known as Hip Whip Girl, is a Japanese sports manga series written and illustrated by Daichi Sorayomi.", "It has been serialized in Shogakukan's \"sh\u014dnen\" manga magazine \"Weekly Sh\u014dnen Sunday\" since July 2013 to April 2017 and has been collected in eighteen \"tank\u014dbon\" volumes.", "An anime television series adaptation produced by Xebec ran from October 6 to December 22, 2016.", "The series centers around the fictional women-only sport of keijo, where players stand on floating platforms and aim to incapacitate or push their opponent into the water, using only their breasts and buttocks.", "The story follows Nozomi Kaminashi, a gymnast who trains at a keijo school, hoping to become the richest player in Japan.", "The series is set in an alternate reality where a new, women-only, gambling sport known as \"keijo\", quickly becomes a fad in Japan since its introduction in the dawn of the 21st century.", "Keijo matches are held atop floating platforms, referred to as a \"Land\", in large water-filled stadiums where swimsuit-clad players fight to incapacitate their opponents or push them out to the water, but they can only hit each other using their breasts or buttocks." ], [ "In the Shadow of the Moon (film)", "In the Shadow of the Moon (film)\n\nIn the Shadow of the Moon is a 2007 British documentary film about the United States' manned missions to the Moon.", "It premiered at the 2007 Sundance Film Festival, where it won the World Cinema Audience Award.", "In March 2008, it was the first film to win the Sir Arthur Clarke Award for Best Film Presentation.", "It was given a limited release in the United States on 7 September 2007, and in Canada on 19 October 2007.", "It was released on DVD in the United States on 22 February 2008, and 31 March 2008, in the United Kingdom.", "A Blu-ray disc edition was released on 16 June 2009.", "It is also notable for giving Gareth Edwards an early credit in visual effects.", "The film follows the manned missions to the Moon made by the United States in the late 1960s and early 1970s.", "The documentary reviews both the footage and media available to the public at the time of the missions, as well as NASA films and materials which had not been opened in over 30 years.", "All of this has been sourced and remastered in HD by the stock footage company Footagevault.", "Augmenting the archival audio and video are contemporary interviews with some surviving Apollo era astronauts, including Al Bean, Michael Collins, Buzz Aldrin, John Young, David Scott, Charlie Duke, Eugene Cernan and Harrison Schmitt." ] ], "gold": "\"Fly Me to the Moon\", originally titled \"In Other Words\", is a song written in 1954 by Bart Howard, performed by Kaye Ballard making the first recording of the song the year it was written. Fly Me to the Moon is also the name of the the debut studio album by American singer-songwriter Bobby Womack released in January 1969, by Minit Records. A film Fly Me to the Moon was written in 2007 and Fly Me to the Moon, also known outside Japan as Tonikawa: Over the Moon for You, is a Japanese manga series written and illustrated by Kenjiro Hata, and serialized in Shogakukan's Weekly Sh\u014dnen Sunday since February 14, 2018. ", "prediction 1": "In 1954, Bart Howard began writing the song Fly Me to the Moon. In response to a publisher's request for a simpler song, Howard wrote a cabaret ballad titled \"In Other Words\". A publisher tried to make him change some words from \"fly me to the moon\" to \"take me to the moon,\" but Howard refused. Fly Me to the Moon is also the title of the debut studio album by American singer-songwriter Bobby Womack. It was released on January 1969, by Minit Records.", "prediction 2": "Fly Me to the Moon, originally titled In Other Words, is a song written in 1954 by Bart Howard. Kaye Ballard made the first recording of the song the year it was written. Fly Me to the Moon is also the title of the debut studio album by American singer-songwriter Bobby Womack. The album was released in January 1969 by Minit Records. In the Shadow of the Moon is a 2007 British documentary film about the United States' manned missions to the Moon.", "prediction 3": "Fly Me to the Moon, originally titled In Other Words, is a song written in 1954 by Bart Howard. Kaye Ballard made the first recording of the song the year it was written. Fly Me to the Moon is also the title of the debut studio album by American singer-songwriter Bobby Womack. It was released in January 1969, by Minit Records. In the Shadow of the Moon is a 2007 British documentary film about the United States' manned missions to the Moon.", "prediction 4": "Fly Me to the Moon, originally titled In Other Words, is a song written in 1954 by Bart Howard. Kaye Ballard made the first recording of the song the year it was written. Fly Me to the Moon is the debut studio album by American singer-songwriter Bobby Womack. The album was released in January 1969, by Minit Records. In the Shadow of the Moon is a 2007 British documentary film about the United States' manned missions to the Moon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 295 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "In 1954, Bart Howard began writing the song Fly Me to the Moon. Kaye Ballard made the first recording of the song the year it was written. Fly Me to the Moon is also the title of the debut studio album by American singer-songwriter Bobby Womack. It was released on January 1969, by Minit Records. A film Fly Me to the Moon was written in 2007 and Fly Me to the Moon." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When did india host the commonwealth games for the first time?", "passages": [ [ "Commonwealth Games", "Commonwealth Games\n\nThe Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations.", "The event was first held in 1930, and has taken place every four years since then.", "The Commonwealth Games were known as the British Empire Games from 1930 to 1950, the British Empire and Commonwealth Games from 1954 to 1966, and British Commonwealth Games from 1970 to 1974.", "It is the world's first multi-sport event which inducted equal number of women\u2019s and men\u2019s medal events and was implemented recently in the 2018 Commonwealth Games.", "Their creation was inspired by the Inter-Empire Championships, as a part of the Festival of Empire, which were held in London, United Kingdom in 1911.", "Melville Marks Robinson founded the games as the British Empire Games which were first hosted in Hamilton in 1930.", "During the 20th and 21st centuries, the evolution of the games movement has resulted in several changes to the Commonwealth Games.", "Some of these adjustments include the creation of the Commonwealth Winter Games for snow and ice sports for the commonwealth athletes, the Commonwealth Paraplegic Games for commonwealth athletes with a disability and the Commonwealth Youth Games for commonwealth athletes aged 14 to 18.", "The first edition of the winter games and paraplegic games were held in 1958 and 1962 respectively, with their last edition held in 1966 and 1974 respectively and the first youth games were held in 2000." ], [ "India at the Commonwealth Games", "India at the Commonwealth Games\n\nIndia has competed in fourteen of the eighteen previous Commonwealth Games; starting at the second Games in 1934.", "India has also hosted the games once.", "India hosted the Games in 2010, at Delhi.", "It was India's most successful Commonwealth Games to date with Indian athletes winning 38 gold, 27 silver and 36 bronze medals.", "At the 2018 Commonwealth Games, India ended its campaign with a total of 66 medals (26 Golds, 20 Silvers, 20 Bronzes).", "India's first ever Commonwealth medal was won by Rashid Anwar who won a bronze in Dept category of Wrestling." ], [ "2010 Commonwealth Games", "2010 Commonwealth Games\n\nThe 2010 Commonwealth Games, officially known as the XIX Commonwealth Games and commonly known as Delhi 2010, was an international multi-sport event that was held in Delhi, India, from 3 to 14 October 2010.", "A total of 6081 athletes from 71 Commonwealth nations and dependencies competed in 21 sports and 272 events, making it the largest Commonwealth Games to date.", "It was also the largest international multi-sport event to be staged in Delhi and India, eclipsing the Asian Games in 1951 and 1982.", "The opening and closing ceremonies were held at the Jawaharlal Nehru Stadium, the main stadium of the event.", "It was the first time that the Commonwealth Games were held in India and the second time they were held in Asia after Kuala Lumpur, Malaysia in 1998.", "It was also the first time a Commonwealth Republic hosted the games, second in a country not presently headed by British monarch since Malaysia in 1998.", "The official mascot of the Games was \"Shera\" and the official song of the Games, \"Jiyo Utho Bado Jeeto\", was composed by Academy and Grammy awardee Indian recording artist A.R. Rahman.", "Preparation for the Games received widespread international media attention, with criticism being levelled against the organisers for the slow pace of work, as well as issues related to security and hygiene." ] ], "gold": "The Commonwealth Games, an international multi-sport event involving athletes from the Commonwealth of Nations, has only been hosted by India once. India started hosting the games for the first time on 3 October 2010 and was finished by 14 October 2010. The most successful event for India in these games is shooting.", "prediction 1": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. India hosted the Games in 2010, at Delhi. It was India's most successful Commonwealth Games to date with Indian athletes winning 38 gold, 27 silver and 36 bronze medals. At the 2018 Commonwealth Games, India ended its campaign with a total of 66 medals.", "prediction 2": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. India hosted the Games in 2010, at Delhi. It was India's most successful Commonwealth Games to date with Indian athletes winning 38 gold, 27 silver and 36 bronze medals.", "prediction 3": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. In 2010, India hosted the Games, also known as the XIX Commonwealth Games and commonly known as Delhi 2010. It was India's most successful Commonwealth Games to date with Indian athletes winning 38 gold, 27 silver and 36 bronze medals.", "prediction 4": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. India has competed in fourteen of the eighteen previous Commonwealth Games; starting at the second Games in 1934. India hosted the Games in 2010, at Delhi. The 2010 Commonwealth Games was an international multi-sport event that was held in Delhi, India, from 3 to 14 October 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 197 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 451 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 367 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. India hosted the Games for the first time in 2010, at Delhi, from October 3rd to October 14th." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Where did the baggy pants trend come from?", "passages": [ [ "Sagging (fashion)", "It is often claimed the style originated from the United States prison system where belts are sometimes prohibited and there can be a lack of appropriately sized clothing.", "During the 2000s, many North American local governments, school systems, transit agencies, and even airlines passed laws and regulations against the practice of wearing sagging pants, although no state or federal laws have been enacted banning the practice.", "US presidential candidate Barack Obama, speaking just before the 2008 US Presidential Election, appeared on MTV and said that laws banning the practice of wearing low-slung pants that expose one's underwear were \"a waste of time ...", "Having said that, brothers should pull up their pants.", "You are walking by your mother, your grandmother, your underwear is showing.", "What's wrong with that?", "Come on.", "Some people might not want to see your underwear.", "I'm one of them.\"", "In June 2007 the Town Council of Delcambre, Louisiana, passed an indecent exposure ordinance, which prohibited intentionally wearing trousers in such a way as to show underwear.", "In March 2008 the Hahira, Georgia City Council passed a controversial clothing ordinance, in the name of public safety, that bans citizens from wearing pants with top below the waist that reveal skin or undergarments." ], [ "Hammer pants", "Hammer pants\n\nHammer pants (frequently and mistakenly referred to as \"parachute pants\") are customized/modified baggy pants tapered at the ankle with a sagging rise made suitable for hip-hop dancing.", "They were popularized in the 1980s and 1990s by rapper MC Hammer.", "They were inspired by harem pants which originated in the Arabian Peninsula and introduced to Western fashion by Paul Poiret around 1910.", "MC Hammer often wore them during live concerts and music videos.", "Hammer's specialized clothing line would come in a variety of colors and were usually shiny and flashy-styled, as seen throughout his hip-hop career during talk show appearances, concerts, music videos and again on his own TV reality show in 2009 called \"Hammertime\"." ], [ "Sagging (fashion)", "Sagging (fashion)\n\nSagging is a manner of wearing trousers or jeans which so that the top of the trousers or jeans are significantly below the waist, sometimes revealing much of the underwear.", "Sagging is predominantly a male fashion.", "Women's wearing of low-rise jeans to reveal their G-string underwear (the \"whale tail\") is not generally described as sagging.", "A person wearing sagging trousers is sometimes called a \"sagger\", and in some countries this practice is known as \"low-riding\".", "It has become popular since the popularity of wearing brightly colored and patterned \"boxer shorts\".", "Sagging first peaked in popularity during the 1990s and remained popular into the mid 2000s, but it has recently made a comeback in the 2010s, with celebrities like Justin Bieber, Liam Payne, Ross Lynch, Zac Efron and more bringing back the fashion trend.", "Sagging in the 1990s usually focused on baggy trousers with plaid boxers, but in the 2010s sagging has become popular with skinny jeans and branded boxer-briefs.", "The style was popularized by skaters and hip-hop artists in the 1990s.", "It later became a symbol of freedom and cultural awareness among some youths or a symbol of their rejection of the values of mainstream society." ] ], "gold": "Baggy Hammer pants were popularized in the 1980s and 1990s by rapper MC Hammer who was inspired by harem pants which originated in the Arabian Peninsula and introduced to Western fashion by Paul Poiret around 1910. In the Islamic World, loose-fitting harem pants were trendy; from the 1500s until the early 17th century, very loose-fitting breeches and hosen were fashionable. The baggy, sagging pants trend came from skaters and hip-hop artists in the 1990s, which later symbolized freedom and cultural awareness among some youths. However, it possibly originated from The United States prison system, where belts are sometimes prohibited.", "prediction 1": "Sagging is a manner of wearing trousers or jeans so that the top of the trousers or jeans are significantly below the waist, sometimes revealing much of the underwear. It is often claimed the style originated from the United States prison system where belts are sometimes prohibited and there can be a lack of appropriately sized clothing. During the 2000s, many North American local governments, school systems, transit agencies, and even airlines passed laws and regulations against the practice of wearing sagging pants, although no state or federal laws have been enacted baggy pants.", "prediction 2": "The baggy pants trend originated from the United States prison system, where belts are sometimes prohibited and there can be a lack of appropriately sized clothing. In the 1990s, skaters and hip-hop artists popularized the look, which was inspired by harem pants, which originated in the Arabian Peninsula and introduced to Western fashion by Paul Poiret around 1910. They were popularized in the 1980s and 1990s by rapper MC Hammer.", "prediction 3": "The trend for baggy pants originated from the 1990s, when skaters and hip-hop artists wore baggy pants with plaid boxers, which later became a symbol of freedom and cultural awareness among some youths or a symbol of their rejection of mainstream society. During the 2000s, many North American local governments, school systems, transit agencies, and even airlines passed laws and regulations against the practice of wearing sagging pants, although no state or federal laws have been enacted banning the practice. Hammer pants are customized/modified baggy pants tapered at the ankle with sagging rise made suitable for hip-hop dancing. They were inspired by harem pants which originated in the Arabian Peninsula and introduced to Western fashion by Paul Poiret around 1910.", "prediction 4": "The trend for baggy pants is often claimed to have originated from the United States prison system where belts are sometimes prohibited and there can be a lack of appropriately sized clothing. During the 2000s, many North American local governments, school systems, transit agencies, and even airlines passed laws and regulations against the practice of wearing sagging pants, although no state or federal laws have been enacted banning the practice. Hammer pants are customized/modified baggy pants tapered at the ankle with a sagging rise made suitable for hip-hop dancing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 588 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 339 }, { "error type": "Irrelevant", "explanation": "", "start": 8, "end": 167 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Sagging is often claimed the style originated from the United States prison system where belts are sometimes prohibited. The sagging, baggy pants style was popularized by skaters and hip-hop artists in the 1990s. It later became a symbol of freedom and cultural awareness among some youths. Baggy hammer pants, were popularized in the 1980s and 1990s by rapper MC Hammer. They were inspired by harem pants which originated in the Arabian Peninsula and introduced to Western fashion by Paul Poiret around 1910." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who sang when i fall in love with you?", "passages": [ [ "When I Fall in Love", "When I Fall in Love\n\n\"When I Fall in Love\" is a popular song, written by Victor Young (music) and Edward Heyman (lyrics).", "It was introduced in the film \"One Minute to Zero\".", "Jeri Southern sang on the first recording released in April 1952 with the song's composer, Victor Young, handling the arranging and conducting duties.", "The song has become a standard, with many artists recording it, though the first hit version was sung by Doris Day released in July 1952.", "Day's recording was made on June 5, 1952.", "It was released by Columbia Records as catalog number 39786 and issued with the flip side \"Take Me in Your Arms\".", "The song reached number 20 on the \"Billboard\" chart.", "A 1996 cover by Natalie Cole, a \"duet\" with her father Nat King Cole by way of vocals from his 1956 cover, won 1996 Grammys for Best Pop Collaboration with Vocals and Best Instrumental Arrangement with Accompanying Vocal(s).", "The version by Rick Astley was released on November 30, 1987, coinciding with the 30th anniversary of the release of Nat King Cole's version of the song.", "This single is mainly remembered for a closely fought contest for UK Christmas number one.", "Rivals EMI hoping to see their act, Pet Shop Boys, reach number one, re-released the version by Nat King Cole." ], [ "Rick Astley", "In November 1987, the album \"Whenever You Need Somebody\", containing four tracks written by Astley, also reached number one in the UK and Australia, and No 10 in the US It was certified 4x Platinum in the UK and Canada, and 2x Platinum in the US.", "Overall \"Whenever You Need Somebody\" sold 15.2 million copies worldwide, making him the top-selling British act of the year.", "In December 1987, Astley released a cover version of the Nat King Cole classic \"When I Fall in Love\".", "This single is mainly remembered for a closely fought contest for UK Christmas Number 1.", "Rivals EMI, hoping to see their act the Pet Shop Boys reach No 1, re-released the version by Nat King Cole.", "This led to a slowdown of purchases of Astley's version, allowing the Pet Shop Boys to reach the coveted top spot with their cover version of Always On My Mind.", "Despite selling over 200,000 copies and gaining a Silver certification from the BPI, it peaked in the UK at No 2 for two weeks.", "The re-release of Nat King Cole's version reached No 4.", "The B side was a dance number \"My Arms Keep Missing You\", which was successful in mainland Europe.", "Astley's fourth single release would be \"Together Forever\" in 1988, reaching No 2 in the UK." ] ], "gold": "\"When I Fall in Love\" is a popular song, written by Victor Young and Edward Heyman. The song has become a standard, with many artists recording it. The first hit version was sung by Doris Day released in July 1952. In 1961, The Lettermen released their version of the song, and Rick Astley released a version in 1987 that coincided with the 30th anniversary of the release of Nat King Cole's version of the song.", "prediction 1": "\"When I Fall in Love\" is a popular song, written by Victor Young (music) and Edward Heyman (lyrics). It was introduced in the film \"One Minute to Zero\". Jeri Southern sang on the first recording released in April 1952 with the song's composer, Victor Young, handling the arranging and conducting duties. In December 1987, Rick Astley released a cover version of the Nat King Cole classic \"When I Fall in Love\". This single is mainly remembered for a closely fought contest for UK Christmas Number 1.", "prediction 2": "\"When I Fall in Love\" is a popular song, written by Victor Young (music) and Edward Heyman (lyrics). It was introduced in the film One Minute to Zero. Jeri Southern sang on the first recording released in April 1952 with the song's composer, Victor Young, handling the arranging and conducting duties. The version by Rick Astley was released on November 30, 1987, coinciding with the 30th anniversary of the release of Nat King Cole's version of the song.", "prediction 3": "The popular song, When I Fall in Love, was introduced in the film One Minute to Zero. Jeri Southern sang on the first recording released in April 1952 with the song's composer, Victor Young, handling the arranging and conducting duties. A 1996 cover by Natalie Cole, a \"duet\" with her father Nat King Cole by way of vocals from his 1956 cover, won the 1996 Grammys for Best Pop Collaboration with Vocals and Best Instrumental Arrangement with Accompanying Vocal(s). The version by Rick Astley was released a cover version of the Nat King Cole classic \"When I Fall in Love\".", "prediction 4": "\"When I Fall in Love\" is a popular song, written by Victor Young (music) and Edward Heyman (lyrics) and introduced in the film \"One Minute to Zero\". Jeri Southern sang on the first recording released in April 1952 with the song's composer, Victor Young, handling the arranging and conducting duties. The version by Rick Astley was released on November 30, 1987, coinciding with the 30th anniversary of the release of Nat King Cole's version of the song. Rivals EMI, hoping to see their act the Pet Shop Boys reach No 1, re-released the version by Nat King Cole. This single is mainly remembered for a closely fought contest for UK Christmas Number 1.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 307, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 411, "end": 499 }, { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 303 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "\"When I Fall in Love\" is a popular song, written by Victor Young (music) and Edward Heyman (lyrics). The song has become a standard, with many artists recording it, though the first hit version was sung by Doris Day released in July 1952. The version by Rick Astley was released on November 30, 1987, coinciding with the 30th anniversary of the release of Nat King Cole's version of the song. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where does tea come from in the world?", "passages": [ [ "Tea", "In the \"Chronicles of Huayang\", it was recorded that the Ba people in Sichuan presented \"tu\" to the Zhou king.", "The Qin later conquered the state of Ba and its neighbour Shu, and according to the 17th century scholar Gu Yanwu who wrote in \"Ri Zhi Lu\" (\u65e5\u77e5\u9304): \"It was after the Qin had taken Shu that they learned how to drink tea.\"", "Another possible early reference to tea is found in a letter written by the Qin Dynasty general Liu Kun who requested that some \"real tea\" to be sent to him.", "The earliest known physical evidence of tea was discovered in 2016 in the mausoleum of Emperor Jing of Han in Xi'an, indicating that tea from the genus \"Camellia\" was drunk by Han Dynasty emperors as early as the 2nd century BC.", "The Han dynasty work, \"The Contract for a Youth\", written by Wang Bao in 59 BC, contains the first known reference to boiling tea.", "Among the tasks listed to be undertaken by the youth, the contract states that \"he shall boil tea and fill the utensils\" and \"he shall buy tea at Wuyang\".", "The first record of tea cultivation is also dated to this period (the reign of Emperor Xuan of Han), during which tea was cultivated on Meng Mountain (\u8499\u5c71) near Chengdu." ], [ "History of tea", "History of tea\n\nThe history of tea is long and complex, spreading across multiple cultures over the span of thousands of years.", "Tea likely originated in the Yunnan region during the Shang dynasty as a medicinal drink.", "An early credible record of tea drinking dates to the 3rd century AD, in a medical text written by Hua Tuo.", "Tea was first introduced to Portuguese priests and merchants in Lebanon during the 16th century.", "Drinking tea became popular in Britain during the 17th century.", "The British introduced tea production, as well as tea consumption, to India, in order to compete with the Chinese monopoly on tea.", "\"\"Camellia sinensis\" originated in southeast Asia, specifically around the intersection of latitude 29\u00b0N and longitude 98\u00b0E, the point of confluence of the lands of northeast India, north Burma, southwest China and Tibet.", "The plant was introduced to more than 52 countries, from this 'centre of origin'.\"", "On morphological differences between the Assamese and Chinese varieties, botanists have long asserted a dual botanical origin for tea; however, statistical cluster analysis, the same chromosome number (2n=30), easy hybridization, and various types of intermediate hybrids and spontaneous polyploids all appear to demonstrate a single place of origin for \"Camellia sinensis\"\u2014the area including the northern part of Burma, and Yunnan and Sichuan provinces of China." ], [ "History of tea", "The plantations started by the British were initially taken over by the government in the 1960s, but have been privatized and are now run by 'plantation companies' which own a few 'estates' or tea plantations each.", "Ceylon tea is divided into 3 groups as Upcountry, Mid country and Low country tea based on the geography of the land on which it is grown.", "Africa and South America have seen greatly increased tea production in recent decades, the great majority for export to Europe and North America respectively, produced on large estates, often owned by tea companies from the export markets.", "Almost all production is of basic mass-market teas, processed by the Crush, Tear, Curl method.", "Kenya is now the third largest global producer (figures below), after China and India, and is now the largest exporter of tea to the United Kingdom.", "There is also a great consumption of tea in Chile.", "In South Africa, the non-Camellia sinensis beverage rooibos is popular.", "In South America yerba mate is a popular infused beverage.", "The only European plantation is Ch\u00e1 Gorreana, located in Ribeira Grande, S\u00e3o Miguel island, Azores (Portugal).", "In South America, the tea production in Brazil has strong roots due to the country's origins in Portugal, the strong presence of Japanese immigrants and also because of the influences of their neighbor's yerba mate culture." ] ], "gold": "The tea plant originated in China and India where it was used as a medicinal drink by various ethnic groups encompassing today's Southwest China, Tibet, north Myanmar and Northeast India.", "prediction 1": "The history of tea is long and complex, spreading across multiple cultures over the span of thousands of years. Tea originated in the Yunnan region during the Shang dynasty as a medicinal drink. An early credible record of tea drinking dates to the 3rd century AD, in a medical text written by Hua Tuo. Tea was first introduced to Portuguese priests and merchants in Lebanon during the 16th century. In the 17th century, the British introduced tea production, as well as tea consumption, to India, in order to compete with the Chinese monopoly on tea.", "prediction 2": "The history of tea is long and complex, spreading across multiple cultures over the span of thousands of years. Tea likely originated in the Yunnan region during the Shang dynasty as a medicinal drink. An early credible record of tea drinking dates to the 3rd century AD, in a medical text written by Hua Tuo. The plant that is the root of the Camellia sinensis plant originated in southeast Asia, specifically at the intersection of latitude 29\u00b0N and longitude 98\u00b0E, the point of confluence of the lands of northeast India, north Burma, southwest China and Tibet. It was introduced to more than 52 countries, from this point of confluence of the lands of confluence of the lands of confluence of the lands of northeast India, north Burma, southwest China and Tibet.", "prediction 3": "The history of tea is long and complex, spreading across multiple cultures over the span of thousands of years. Tea likely originated in the Yunnan region during the Shang dynasty as a medicinal drink. An early credible record of tea drinking dates to the 3rd century AD, in a medical text written by Hua Tuo. African and South America have seen greatly increased tea production in recent decades, the great majority for export to Europe and North America respectively.", "prediction 4": "The history of tea is long and complex, spreading across multiple cultures over the span of thousands of years. Tea likely originated in the Yunnan region during the Shang dynasty as a medicinal drink. An early credible record of tea drinking dates to the 3rd century AD, in a medical text written by Hua Tuo. Tea was first introduced to Portuguese priests and merchants in Lebanon during the 16th century. The plant is indigenous to southeast Asia and is called Camellia sinensis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 551 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 111 } ], "missing-info": [], "corrected-prediction": "Tea originated in the Yunnan region during the Shang dynasty as a medicinal drink. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who plays the guitar solo in let it be?", "passages": [ [ "Let It Be (song)", "The first attempt with the other Beatles was made on 8 January.", "Work continued on the song throughout the month.", "Multi-track recordings commenced on 23 January at Apple Studios.", "The master take was recorded on 31 January 1969, as part of the \"Apple studio performance\" for the project.", "McCartney played Bl\u00fcthner piano, Lennon played six-string electric bass (replaced by McCartney's own bass part on the final version at the behest of George Martin), George Harrison and Ringo Starr assumed their conventional roles, on guitar and drums respectively, and Billy Preston contributed on organ.", "This was one of two performances of \"Let It Be\" that day.", "The first version, designated take 27-A, would serve as the basis for all officially released versions of the song.", "The other version, take 27-B, was performed as part of the \"live studio performance\", along with \"Two of Us\" and \"The Long and Winding Road\".", "This performance, in which Lennon and Harrison harmonised with McCartney's lead vocal and Harrison contributed a subdued guitar solo, can be seen in the film \"Let It Be\".", "The film performance of \"Let It Be\" has never been officially released as an audio recording.", "The lyrics in the two versions differ a little in the last verse." ], [ "Let It Be (song)", "Let It Be (song)\n\n\"Let It Be\" is a song by the English rock band the Beatles, released in March 1970 as a single, and (in an alternate mix) as the title track of their album \"Let It Be\".", "At the time, it had the highest debut on the \"Billboard\" Hot 100, beginning its chart run at number 6.", "It was written and sung by Paul McCartney.", "It was their final single before McCartney announced his departure from the band.", "Both the \"Let It Be\" album and the US single \"The Long and Winding Road\" were released after McCartney's announced departure from and the subsequent break-up of the group.", "The alternate mix on their album \"Let It Be\" features an additional guitar solo and some minor differences in the orchestral sections.", "In 1987, the song was recorded by charity supergroup Ferry Aid (which included McCartney).", "It reached number 1 on the UK Singles Chart for three weeks and reached the top ten in many other European countries.", "Paul McCartney's verse used the original take from The Beatles' \"Let It Be\" sessions.", "McCartney said he had the idea of \"Let It Be\" after he had a dream about his mother during the tense period surrounding the sessions for \"The Beatles\" (\"the White Album\") in 1968." ], [ "Ferry Aid", "Ferry Aid\n\nFerry Aid were a British-American ensemble group, brought together to record the song \"Let It Be\" in 1987.", "The single was released following the Zeebrugge Disaster; on 6 March 1987 the ferry ferry had capsized, killing 193 passengers and crew.", "All proceeds from sales of the single were donated to the charity set up in the aftermath of the disaster.", "The recording was organised by \"The Sun\" newspaper, after it had sold cheap tickets for the ferry on that day.", "\"Let It Be\" was written by Paul McCartney and originally recorded by The Beatles in 1969.", "Garry Bushell, then with \"The Sun\" newspaper, organised the recording of the song by recruiting record producers Stock, Aitken and Waterman.", "They then put an invitation out to the music industry for artists to contribute their vocals to the song.", "Although many stars were initially reluctant to join forces with the newspaper, eventually artists such as Boy George, Kate Bush, Gary Moore and Mark Knopfler agreed to take part.", "Original writer, Paul McCartney also contributed to the song, although his performance (and section in the accompanying video) were recorded independently in his own studios.", "It was later revealed that McCartney used his voice of the original recording of the 1970 Beatles track and added it to the Ferry Aid recording." ] ], "gold": "\"Let It Be\" is a song by the Beatles, released on 6 March 1970 as a single, with a different version recorded in 1987 by the charity supergroup Ferry Aid. The single version of the song, produced by George Martin, features a softer guitar solo, compared to the album version, produced by Phil Spector, which features a more aggressive guitar solo. On the original version of Let It Be, George Harrison plays the guitar solo. On the Ferry Aid version of Let It Be, Robert William Gary Moore plays the first guitar solo, and Mark Freuder Knopfler plays the second.", "prediction 1": "The song Let It Be was originally recorded by The Beatles in 1969. The first attempt with the other Beatles was made on 8 January. The second attempt with the other Beatles was made on 8 February. In the second attempt, Harrison played a subdued guitar solo.", "prediction 2": "\"Let It Be\" is a song by the English rock band the Beatles, released in March 1970 as a single, and (in an alternate mix) as the title track of their album Let It Be. George Harrison played the guitar solo on this version of the song while Ringo Starr played the drum solo. In the 1987 version, British-American ensemble group Ferry Aid played the guitar solo.", "prediction 3": "\"Let It Be\" is a song by the English rock band the Beatles, released in March 1970 as a single and (in an alternate mix) as the title track of their album Let It Be. George Harrison plays the guitar solo in the original recording and Ringo Starr plays the solo in the alternate mix.", "prediction 4": "\"Let It Be\" is a song by the English rock band the Beatles that was released in March 1970 as a single and (in an alternate mix) as the title track of their album Let It Be. George Harrison played the guitar solo in this version, as well as in the original recording of the song. Ringo Starr played the guitar solo in the alternate mix of the album Let It Be, and the live studio performance of the song that included Lennon and Harrison harmonising with McCartney's lead vocals. The alternate mix on the album Let It Be features an additional guitar solo and some minor differences in the orchestral sections.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 196 }, { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 219 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The song Let It Be was originally recorded by The Beatles in 1969. George Harrison played a subdued guitar solo. In 1987, the song was recorded by charity supergroup Ferry Aid " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When did no mans sky next come out?", "passages": [ [ "No Man's Sky", "No Man's Sky\n\nNo Man's Sky is an action-adventure survival game developed and published by the indie studio Hello Games.", "It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018.", "The game is built around four pillars: exploration, survival, combat, and trading.", "Players are free to perform within the entirety of a procedurally generated deterministic open world universe, which includes over 18 quintillion planets.", "Through the game's procedural generation system, planets have their own ecosystems with unique forms of flora and fauna, and various sentient alien species may engage the player in combat or trade within planetary systems.", "Players advance in the game by mining for resources to power and improve their spacecraft, tools, and spacesuit for survival, buying and selling resources using credits earned by documenting flora and fauna, and otherwise seeking out the mystery around the Atlas, an entity at the center of the universe.", "The founder of Hello Games, Sean Murray, had wanted to create a game that captured the sense of exploration and optimism of science fiction writings and art of the 1970s and 1980s with \"No Man's Sky\".", "The game was developed over three years by a small team at Hello Games with promotional and publishing help from Sony Interactive Entertainment." ] ], "gold": "No Man's Sky is a game that can be played on different video game systems. It came out for PlayStation 4 and Microsoft Windows in August, 2016. It came out for Xbox One in July 2018.", "prediction 1": "No Man's Sky is an action-adventure survival game developed and published by the indie studio Hello Games. It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018.", "prediction 2": "No Man's Sky is an action-adventure survival game developed and published by the indie studio Hello Games. It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018. The game was released for PC in August 2018 and for Xbox One in July 2019.", "prediction 3": "No Man's Sky is an action-adventure survival game developed and published by the indie studio Hello Games. It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018. The game is built around four pillars: exploration, survival, combat, and trading.", "prediction 4": "No Man's Sky is an action adventure survival game developed and published by the indie studio Hello Games. It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018. The game was developed over three years by a small team at Hello Games with promotional and publishing help from Sony Interactive Entertainment.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 106 } ], "missing-info": [], "corrected-prediction": "No Man's Sky is an action-adventure survival game. It was released worldwide for PlayStation 4 and Microsoft Windows in August 2016, and for Xbox One in July 2018." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where did the traditional heart shape come from?", "passages": [ [ "Heart (symbol)", "Heart (symbol)\n\n", "The heart shape () is an ideograph used to express the idea of the \"heart\" in its metaphorical or symbolic sense as the center of emotion, including affection and love, especially romantic love.", "The \"wounded heart\" indicating lovesickness came to be depicted as a heart symbol pierced with an arrow (Cupid's), or heart symbol \"broken\" in two or more pieces.", "Heart shaped peepal leaves have been used in artistic depictions of indus valley civilization, an indus valley civilization heart pendant has been discovered which is now exhibited in Dehli national museum.", "Greek.", "In the 6th-5th century BC, the heart shape was used to represent the heart-shaped fruit of the plant Silphium, a plant possibly used as a contraceptive Many species in the parsley family have estrogenic properties, and some, such as wild carrot, were used to induce abortion.", "Silver coins from Cyrene of the 6\u20135th BC bear a similar design, sometimes accompanied by a silphium plant and is understood to represent its seed or fruit.", "It is likely that the heart symbol was found in devotion to God.", "The symbol appears as one rights themselves up, after having prayed with one's head to the ground.", "The hands form the symbol as one is in the process of standing up as seen from behind." ], [ "Heart (symbol)", "The combination of the heart shape and its use within the heart metaphor developed at the end of the Middle Ages, although the shape has been used in many ancient epigraphy monuments and texts.", "With possible early examples or direct predecessors in the 13th to 14th century, the familiar symbol of the heart represented love developed in the 15th century, and became popular in Europe during the 16th.", "Before the 14th century, the heart shape was not associated with the meaning of the heart metaphor.", "The geometric shape itself is found in much earlier sources, but in such instances does not depict a heart, but typically foliage: in examples from antiquity fig leaves, and in medieval iconography and heraldry typically the leaves of ivy and of the water-lily.", "One possible early use in the 11th century could be found in the manuscript, Al-Maqamat written by Al Hariri of Basra.", "The manuscript includes an illustration of a farewell greeting between two men while astride their camels, with the heart shape seen prominently over their heads.", "The first known depiction of a heart as a symbol of romantic love dates to the 1250s.", "It occurs in a miniature decorating a capital 'S' in a manuscript of the French \"Roman de la poire\" (National Library FR MS. 2086, plate 12)." ], [ "Heart (symbol)", "In the miniature a kneeling lover (or more precisely, an allegory of the lover's \"sweet gaze\" or \"douz regart\") offers his heart to a damsel.", "The heart here resembles a pine cone (held \"upside down\", the point facing upward), in accord with medieval anatomical descriptions.", "However, in this miniature what suggests a heart shape is only the result of a lover's finger superimposed on an object; the full shape outline of the object is partly hidden, and therefore unknown.", "Moreover, the French title of the manuscript that features the miniature translates into \"Novel Of The Pear\" in English.", "Thus the heart shaped object would be a pear; the conclusion that a pear represents a heart is dubious.", "Opinions therefore differ over this being the first depiction of a heart as symbol of romantic love.", "Giotto in his 1305 painting in the Scrovegni Chapel (Padua) shows an allegory of charity (caritas) handing her heart to Jesus Christ.", "This heart is also depicted in the pine cone shape based on anatomical descriptions of the day (still held \"upside down\")." ] ], "gold": "The heart symbol is often used to represent the center of emotion, including affection and love, especially romantic love. In the\u00a0Indus Valley Civilisation a heart pendant has been discovered and is now exhibited in the Delhi national museum. Heart-shaped peepal leaves were used in artistic depictions in this region. The heart shape was used to represent the heart-shaped fruit of the plant Silphium in the 6th-5th century BC. The traditional heart shape became a metaphor for love at the end of the Middle Ages. The first known depiction of a heart as a symbol of romantic love dates to the 1250s. It occurs in a miniature decorating a capital 'S' in a manuscript of the French\u00a0Roman de la poire. In the miniature a lover. offers his heart to a damsel. Although, the French title of the manuscript that features the miniature translates into \"Novel Of The Pear\" in English. Thus the heart shaped object would be a pear; the conclusion that a pear represents a heart is dubious.", "prediction 1": "The traditional heart shape originated in ancient Greece and has been used to express the idea of the \"heart\" in its metaphorical or symbolic sense as the center of emotion, including affection and love, especially romantic love. Greek. In the 6th-5th century BC, the heart shape was used to represent the heart-shaped fruit of the plant Silphium, a plant possibly used as a contraceptive Many species in the parsley family have estrogenic properties, and some, such as wild carrot, were used to induce abortion. The first known depiction of a heart as a symbol of romantic love dates to the 1250s. It occurs in a manuscript of the French Roman de la poire.", "prediction 2": "The traditional heart shape comes from the Middle East and is an ideograph used to express the idea of the heart in its metaphorical or symbolic sense as the center of emotion, including affection and love, especially romantic love. The symbol of a heart is often used to represent the heart-shaped fruit of a plant, and is often depicted as a pine cone, though in many instances the shape itself does not depict a heart, but typically foliage. The first known depiction of a heart as a symbol of romantic love dates to the 1250s, where it occurs in a manuscript of the French Roman de la poire. The first known depiction of a heart as a symbol of romantic love comes from the 11th century, Al-Mamat written by Al Hariri of Basra. The first known depiction of a heart shape as a pine cone appears in a manuscript of", "prediction 3": "The traditional heart shape comes from ancient Egyptian and Greek symbolism. The combination of the heart shape and its use within the heart metaphor developed at the end of the Middle Ages, although the shape itself has been used in many ancient epigraphy monuments and texts. Greek. In the 6th-5th century BC, the heart shape was used to represent the heart-shaped fruit of the plant Silphium, possibly used as a contraceptive. In the 11th century, the first known depiction of a heart as a symbol of romantic love comes from a miniature decorating a capital S in a manuscript of the French \"Roman de la poire.\" The first known depiction of a heart as a symbol of romantic love dates to the 1250s. It occurs in a manuscript of the French \"Roman de la poire\" (National Library FR MS. 2086, plate 12). In the 11th century,", "prediction 4": "The traditional heart shape comes from ancient Greek and Roman art. In the 13th century, the geometric shape itself is found in much earlier sources, but in such instances does not depict a heart, but typically foliage such as fig leaves, or in medieval iconography and heraldry typically the leaves of ivy and of the water-lily. The first known depiction of a heart as a symbol of romantic love dates to the 1250s. It occurs in a miniature decorating a capital 'S' in a manuscript of the French Roman de la poire.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 28, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 348, "end": 512 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The traditional heart shape has been used to express the idea of the \"heart\" in its metaphorical or symbolic sense as the center of emotion, including affection and love, especially romantic love. In the Indus Valley Civilisation a heart pendant has been discovered and is now exhibited in the Delhi national museum. Heart shaped peepal leaves have been used in artistic depictions in this region. In the 6th-5th century BC, the heart shape was used to represent the heart-shaped fruit of the plant Silphium. The combination of the heart shape and its use within the heart metaphor developed at the end of the Middle Ages. The first known depiction of a heart as a symbol of romantic love dates to the 1250s. It occurs in a manuscript of the French Roman de la poire. In the miniature a kneeling lover offers his heart to a damsel. The French title of the manuscript that features the miniature translates into \"Novel Of The Pear\" in English. Thus the heart shaped object would be a pear; the conclusion that a pear represents a heart is dubious." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who won the most world cup in soccer?", "passages": [ [ "FIFA World Cup", "FIFA World Cup\n\nThe FIFA World Cup, often simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the \"\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the inaugural tournament in 1930, except in 1942 and 1946 when it was not held because of the Second World War.", "The current champion is France, which won its second title at the 2018 tournament in Russia.", "The current format of the competition involves a qualification phase, which currently takes place over the preceding three years, to determine which teams qualify for the tournament phase, which is often called the \"World Cup Finals\".", "After this, 32 teams, including the automatically qualifying host nation(s), compete in the tournament phase for the title at venues within the host nation(s) over a period of about a month.", "The 21 World Cup tournaments have been won by eight national teams.", "Brazil have won five times, and they are the only team to have played in every tournament.", "The other World Cup winners are Germany and Italy, with four titles each; Argentina, France and inaugural winner Uruguay, with two titles each; and England and Spain with one title each." ], [ "FIFA World Cup", "Seven players have collected all three types of World Cup medals (winners', runner- ups', and third-place); five players were from West Germany's squad of 1966\u20131974 including Franz Beckenbauer, J\u00fcrgen Grabowski, Horst-Dieter H\u00f6ttges, Sepp Maier and Wolfgang Overath (1966\u20131974), Italy's Franco Baresi (1982, 1990, 1994) and the most recent has been Miroslav Klose of Germany (2002\u20132014) with four consecutive medals.", "Brazil's M\u00e1rio Zagallo, West Germany's Franz Beckenbauer and France's Didier Deschamps are the only people to date to win the World Cup as both player and head coach.", "Zagallo won in 1958 and 1962 as a player and in 1970 as head coach.", "Beckenbauer won in 1974 as captain and in 1990 as head coach, and Deschamps repeated the feat in 2018, after having won in 1998 as captain.", "Italy's Vittorio Pozzo is the only head coach to ever win two World Cups (1934 and 1938).", "All World Cup-winning head coaches were natives of the country they coached to victory." ], [ "Ghana at the FIFA World Cup", "Ghana at the FIFA World Cup\n\nThe FIFA World Cup, sometimes called the Football World Cup , but usually referred to simply as the World Cup\"', is an international association football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the first tournament in 1930, except in 1942 and 1946, due to World War II.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the Finals, is used to determine which teams qualify for the Finals.", "The current format of the Finals involves 32 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1 million people watching the 2006 tournament final.", "This article is about the recent FIFA World Cup history of one of the leading nations in African football, Ghana.", "Ghana have qualified for three FIFA World Cup tournaments; 2006, 2010, and 2014." ] ], "gold": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the FIFA, the sport's global governing body. There have been eight different champions throughout the 21 World Cup tournaments, with Brazil winning the tournament five times. Alternatively, the player who won the most World Cups is Pele, with three titles, and Vittorio Pozzo holds the record of most World Cups won as a coach, being the only one to win two, in 1934 and 1938. The United States is the nation with the most women's World Cup, a total of four times, and are the current champions after winning it at the 2019 tournament in France.", "prediction 1": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association, the sport's global governing body. Brazil have won five World Cups, and they are the only team to have played in every tournament. The tournament has been awarded every four years since the inaugural tournament in 1930, except in 1942 and 1946 when it was not held because of the Second World War. The most wins at the FIFA World Cup are by Brazil, West Germany and France, with four consecutive medals. The most recent winner is Miroslav Klose, and Miroslav Klose of Germany in 2018 with four consecutive medals.", "prediction 2": "The FIFA World Cup, often simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the FIFA, the sport's global governing body. Brazil have won five World Cups, and they are the only team to have played in every tournament. West Germany's Franz Beckenbauer and France's Didier Deschamps are the only people to date to win the World Cup as both player and head coach. Brazil have won five World Cups, and they are the only team to win the only team to have played in every tournament.", "prediction 3": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's global governing body. M\u00e1rio Zagallo, Franz Beckenbauer and Didier Deschamps are the only people to date to win the World Cup as both player and head coach. Zagallo won in 1958 and 1962 as a player and in 1970 as head coach. Beckenbauer won in 1974 as captain and in 1990 as head coach.", "prediction 4": "The FIFA World Cup, often simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body. The most World Cups won by a single national team are by Brazil, with five, and the most by a single player are by West Germany and France. The most world cup winners are Brazil, with five, and they are the only team to have played in every tournament.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 487 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 320 }, { "error type": "Unverifiable", "explanation": "", "start": 488, "end": 593 }, { "error type": "Irrelevant", "explanation": "", "start": 594, "end": 703 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association, the sport's global governing body. There have been eight different champions throughout the 21 World Cup tournaments. Brazil have won five World Cup. Vittorio Pozzo is the only head coach to ever win two World Cups, one in 1934 and 1938." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who wrote the song i'll be seeing you?", "passages": [ [ "I'll Be Seeing You (song)", "I'll Be Seeing You (song)\n\n", "\"I'll Be Seeing You\" is a popular song, with music by Sammy Fain and lyrics by Irving Kahal.", "Published in 1938, it was inserted into the Broadway musical \"", "Right This Way\", which closed after fifteen performances.", "The resemblance between the main tune's first four lines and a passage within the theme of the last movement of Gustav Mahler's Third Symphony (1896) was pointed out by Deryck Cooke in 1970.", "The recording by Bing Crosby became a hit in 1944, reaching number one for the week of July 1.", "Frank Sinatra's version with Tommy Dorsey and His Orchestra from 1940 charted in 1944 and peaked at No. 4." ] ], "gold": "\"I'll Be Seeing You\" is a popular song about nostalgia, with music by Sammy Fain and lyrics by Irving Kahal.", "prediction 1": "\"I'll Be Seeing You\" is a popular song, with music by Sammy Fain and lyrics by Irving Kahal. Published in 1938, it was inserted into the Broadway musical \"Right This Way\", which closed after fifteen performances. The resemblance between the main tune's first four lines and a passage within the theme of Gustav Mahler's Third Symphony (1896) was pointed out by Deryck Cooke in 1970. The recording by Bing Crosby became a hit in 1944, reaching number one for the week of July 1.", "prediction 2": "\"I'll Be Seeing You\" is a popular song, with music by Sammy Fain and lyrics by Irving Kahal. Published in 1938, it was inserted into the Broadway musical \"Right This Way\", which closed after fifteen performances. The resemblance between the main tune's first four lines and a passage within the theme of Gustav Mahler's Third Symphony (1896) was pointed out by Deryck Cooke in 1970. The recording by Bing Crosby became a hit in 1944, reaching number one for the week of July 1. Frank Sinatra's version with Tommy Dorsey and His Orchestra from 1940 charted in 1944 and peaked at No. 4.", "prediction 3": "\"I'll Be Seeing You\" is a popular song, with music by Sammy Fain and lyrics by Irving Kahal. Published in 1938, it was inserted into the Broadway musical \"Right This Way\", which closed after fifteen performances. The resemblance between the main tune's first four lines and a passage within a passage within the theme within the last movement of Gustav Mahler's Third Symphony was pointed out by Deryck Cooke in 1970. The recording by Bing Crosby became a hit in 1944, reaching number one for the week of July 1. The recording by Bing Crosby became a hit in 1944, reaching number one for the week of July 1. The recording by Bing Crosby became a hit in 1945, reaching number one for the week of July 1.", "prediction 4": "I'll Be Seeing You is a popular song, with music by Sammy Fain and lyrics by Irving Kahal. Published in 1938, it was inserted into the Broadway musical Right This Way, which closed after fifteen performances. The resemblance between the main tune's first four lines and a passage within the theme within the last movement of Gustav Mahler's Third Symphony (1896) was pointed out by Deryck Cooke in 1970.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 382 }, { "error type": "Irrelevant", "explanation": "", "start": 383, "end": 477 } ], "missing-info": [], "corrected-prediction": "\"I'll Be Seeing You\" is a popular song, with music by Sammy Fain and lyrics by Irving Kahal. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did it become legal to own gold again?", "passages": [ [ "Gold Reserve Act", "Gold Reserve Act\n\nThe United States Gold Reserve Act of January 30, 1934 required that all gold and gold certificates held by the Federal Reserve be surrendered and vested in the sole title of the United States Department of the Treasury.", "The Gold Reserve Act outlawed most private possession of gold, forcing individuals to sell it to the Treasury, after which it was stored in United States Bullion Depository at Fort Knox and other locations.", "The act also changed the nominal price of gold from $20.67 per troy ounce to $35.", "This price change incentivized foreign investors to export their gold to the United States, while simultaneously devaluing the U.S. dollar in an attempt to spark inflation.", "The increase in gold reserves due to the price change as well as the confiscation clause resulted in a large accumulation of gold in the Federal Reserve and U.S. Treasury.", "The increase in the money supply lowered real interest rates which increased investment in durable goods.", "A year earlier, in 1933, Executive Order 6102 had made it a criminal offense for U.S. citizens to own or trade gold anywhere in the world, with exceptions for some jewelry and collector's coins.", "These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964, although the obligation to pay the certificate holder on demand in gold specie would not be honored." ], [ "Executive Order 6102", "If no one claimed the box, it remained in the possession of the Treasury.", "In October 1981, there were 1,605 cardboard cartons in the basement of the Treasury, each carton containing the contents of one unclaimed safe deposit box.", "In Australia, Part IV of the Banking Act 1959 allows the Commonwealth government to seize private citizens' gold in return for paper money where the Governor-General \"is satisfied that it is expedient so to do, for the protection of the currency or of the public credit of the Commonwealth\".", "On January 30, 1976, this part's operation was \"suspended\"." ], [ "Executive Order 6102", "The consolidated Gold Clause Cases were:\n\nThe Supreme Court upheld all seizures as constitutional, with Justices James Clark McReynolds, Willis Van Devanter, George Sutherland, and Pierce Butler dissenting.", "The four justices were nicknamed the \"Four Horsemen\" by the press, as their conservative views were in opposition to President Roosevelt's New Deal agenda.", "The Gold Reserve Act of 1934 made gold clauses unenforceable, and changed the value of gold from $20.67 to $35 per ounce, thereby devaluing the U.S. dollar, as the dollar was gold-based.", "This price remained in effect until August 15, 1971, when President Richard Nixon announced that the United States would no longer convert dollars to gold at a fixed value, thus abandoning the gold standard for foreign exchange (see Nixon Shock).", "The private ownership of gold certificates was legalized in 1964, and they can be openly owned by collectors but are not redeemable in gold.", "The limitation on gold ownership in the U.S. was repealed after President Gerald Ford signed a bill to \"permit United States citizens to purchase, hold, sell, or otherwise deal with gold in the United States or abroad\" with an act of Congress codified in , which went into effect December 31, 1974.", "P.L." ] ], "gold": "In 1933, Executive Order 6102 had made it a criminal offense for U.S. citizens to own or trade gold anywhere in the world. These prohibitions were relaxed starting in 1964 and by December 31, 1974, Americans could legally own and trade gold again. In Australia, Part IV of the Banking Act 1959 allowed the Commonwealth government to seize private citizens' gold in return for paper money for the protection of the currency or of the public credit of the Commonwealth. On January 30, 1976, the operation of that part of the Act was suspended.", "prediction 1": "The United States Gold Reserve Act of January 30, 1934, required that all gold and gold certificates held by the Federal Reserve be surrendered and vested in the sole title of the United States Department of the Treasury. The Gold Reserve Act also changed the nominal price of gold from $20.67 per troy ounce to $35. This price change incentivized foreign investors to export their gold to the United States, while simultaneously devaluing the U.S. dollar in an attempt to spark inflation. These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964, although the obligation to pay the certificate holder on demand in gold specie would not be honored.\n", "prediction 2": "The Gold Reserve Act of 1933 made it a criminal offense for U.S. citizens to own or trade gold anywhere in the world. These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964 \u2013 even though the obligation to pay the certificate holder on demand in gold specie would not be honored. The limitation on gold ownership in the U.S. was repealed after President Gerald Ford signed a bill to \"permit United States citizens to purchase, hold, sell, or otherwise deal with gold in the United States\" with an act of Congress codified in, which went into effect December 31, 1974.", "prediction 3": "The United States Gold Reserve Act of January 30, 1934, required that all gold and gold certificates held by the Federal Reserve be surrendered and vested in the sole title of the United States Department of the Treasury. These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964, although the obligation to pay the certificate holder on demand in gold specie would not be honored. In this case, gold certificates were legalized on April 24, 1964, and they can be openly owned by collectors but are not redeemable in gold.", "prediction 4": "The United States Gold Reserve Act of January 30, 1934, required that all gold and gold certificates held by the Federal Reserve be surrendered and vested in the sole title of the United States Department of the Treasury. The Gold Reserve Act also changed the nominal price of gold from $20.67 per troy ounce to $35. This price change incentivized foreign investors to export their gold to the United States, while simultaneously devaluing the U.S. dollar in an attempt to spark inflation. These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964, though the obligation to pay the certificate holder on demand in gold specie would not be honored.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 489 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "In 1933, Executive Order 6102 had made it a criminal offense for U.S. citizens to own or trade gold anywhere in the world, with exceptions for some jewelry and collector's coins. These prohibitions were relaxed starting in 1964 \u2013 gold certificates were again allowed for private investors on April 24, 1964, although the obligation to pay the certificate holder on demand in gold specie would not be honored. The limitation on gold ownership in the U.S. was repealed after President Gerald Ford signed a bill to \"permit United States citizens to purchase, hold, sell, or otherwise deal with gold in the United States or abroad\" with an act of Congress codified in , which went into effect December 31, 1974. In Australia, Part IV of the Banking Act 1959 allows the Commonwealth government to seize private citizens' gold in return for paper money where the Governor-General \"is satisfied that it is expedient so to do, for the protection of the currency or of the public credit of the Commonwealth\". On January 30, 1976, this part's operation was \"suspended\".\n" }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who sang the original version of i will always love you?", "passages": [ [ "I Will Always Love You", "I Will Always Love You\n\n\"I Will Always Love You\" is a song originally written and recorded in 1973 by American singer-songwriter Dolly Parton.", "Her country version of the track was released in 1974 as a single and was written as a farewell to her one-time partner and mentor of seven years, Porter Wagoner, following Parton's decision to pursue a solo career.", "Parton's version of \"I Will Always Love You\" was a commercial success.", "It reached number one on the \"Billboard\" Hot Country Songs chart twice.", "It first reached number one in June 1974, and then in October 1982, with her re-recording on the soundtrack of the movie version of \"The Best Little Whorehouse in Texas.\"", "Thus, she achieved the number one position twice with the same song, a rare feat that Chubby Checker had done previously with \"The Twist\" becoming number one in 1960 and again in 1962.", "Whitney Houston recorded her version of the song for the 1992 film \"The Bodyguard\".", "Her single spent 14 weeks at number one on the \"Billboard\" Hot 100 chart making it one of the best-selling singles of all time.", "It also holds the record for being the best-selling single by a woman in music history." ] ], "gold": "\"I Will Always Love You\" is a song written and originally recorded by American singer-songwriter Dolly Parton. Her country version of the track was released in 1974 as a single and written as a farewell to her former business partner and mentor of seven years, Porter Wagoner, following Parton's decision to leave The Porter Wagoner Show and pursue a solo career. The song's lead vocals were sung by Parton, while the background ones were performed by Hershel Winginton, Dolores Edgin, June Page, and Joe Babcock.", "prediction 1": "\"I Will Always Love You\" is a song originally written and recorded in 1973 by American singer-songwriter Dolly Parton. Her country version of the track was released in 1974 as a single. Whitney Houston recorded her version of the song for the 1992 film The Bodyguard.", "prediction 2": "\"I Will Always Love You\" is a song originally written and recorded in 1973 by American singer-songwriter Dolly Parton. Her country version of the track was released in 1974 as a single and was written as a farewell to her one-time partner and mentor of seven years, Porter Wagoner, following Parton's decision to pursue a solo career. Whitney Houston recorded her version of the song for the 1992 film The Bodyguard.", "prediction 3": "Dolly Parton sang the original version of I Will Always Love You. American singer-songwriter Whitney Houston recorded her version of the song for the 1992 film The Bodyguard.", "prediction 4": "\"I Will Always Love You\" is a song originally written and recorded in 1973 by American singer-songwriter Dolly Parton. Her country version of the track was released in 1974 as a single. The original version of \"I Will Always Love You\" was written as a farewell to her one-time partner and mentor of seven years, Porter Wagoner, following Parton's decision to pursue a solo career. Whitney Houston recorded her version of the song for the 1992 film The Bodyguard.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 267 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I Will Always Love You\" is a song originally written and recorded in 1973 by American singer-songwriter Dolly Parton. Her country version of the track was released in 1974 as a single and was written as a farewell to her one-time partner and mentor of seven years, Porter Wagoner, following Parton's decision to pursue a solo career. " }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "When was the king james version of the bible first printed?", "passages": [ [ "King James Version", "In Britain, the 1611 translation is generally known as the \"Authorised Version\" today.", "As early as 1814, we find King James' version, evidently a descriptive phrase, being used.", "\"The King James Version\" is found, unequivocally used as a name, in a letter from 1855.", "The next year King James Bible, with no possessive, appears as a name in a Scottish source.", "In the United States, the \"1611 translation\" (actually editions following the standard text of 1769, see below) is generally known as the King James Version today.", "The followers of John Wycliffe undertook the first complete English translations of the Christian scriptures in the 14th century.", "These translations were banned in 1409 due to their association with the Lollards.", "The Wycliffe Bible pre-dated the printing press but was circulated very widely in manuscript form, often inscribed with a date earlier than 1409 to avoid the legal ban.", "As the text translated in the various versions of the Wycliffe Bible was the Latin Vulgate, and as it contained no heterodox readings, there was in practice no way by which the ecclesiastical authorities could distinguish the banned version; consequently many Catholic commentators of the 15th and 16th centuries (such as Thomas More) took these manuscript English Bibles to represent an anonymous earlier orthodox translation." ], [ "New King James Version", "New King James Version\n\nThe New King James Version (NKJV) is an English translation of the Bible first published in 1982 by Thomas Nelson.", "The New Testament was published in 1979, the Psalms in 1980, and the full Bible in 1982.", "It took seven years to complete.", "The anglicized edition was originally known as the Revised Authorized Version, but the NKJV title is now used universally.", "The NKJV translation project was conceived by Arthur Farstad.", "It was inaugurated in 1975 with two meetings (Nashville and Chicago) of 130 biblical scholars, pastors, and theologians.", "The men who were invited prepared the guidelines for the NKJV.", "The aim of its translators was to update the vocabulary and grammar of the King James Version, while preserving the classic style and literary beauty of the original 1611 KJV.", "The 130 translators believed in faithfulness to the original Greek, Aramaic, and Hebrew texts including the Dead Sea Scrolls.", "Also agreed upon for most New King James Bibles were easier event descriptions, a history of each book, and added dictionary and updated concordance." ] ], "gold": "The original King James Version of the Bible was first printed in 1611 while the New King James Version of the Bible was first printed in 1982.", "prediction 1": "The King James Version of the Bible was first printed in 1611, and was reprinted in 1611 and 1612 respectively. The New King James Version was first published in 1982 by Thomas Nelson. The New King James Version is an English translation of the Bible first published in 1982 by Thomas Nelson.", "prediction 2": "King James Version was first printed in 1611 and has been in use since 1814. The New King James Version was published in 1982. It is a modern English translation of the Bible. The 1611 King James Version was first printed in England in 1611 and was published in England in 1613.", "prediction 3": "King James Version was first printed in 1611, but the New King James Version was first printed in 1982. The New King James Version is an English translation of the Bible first published in 1982 by Thomas Nelson. The aim of its translators was to update the vocabulary and grammar of the King James Version, while preserving the classic style and literary beauty of the original 1611 KJV.", "prediction 4": "The King James Version of the Bible was first printed in 1611 in England. The New King James Version has updated vocabulary and grammar of the King James Version while preserving the classic style and literary beauty of the original. The NKJV has updated vocabulary and grammar of the King James Version and has remained faithful to the original.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 63, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 184 }, { "error type": "Redundant", "explanation": "The New King James Version was first published in 1982 by Thomas Nelson. ", "start": 185, "end": 292 } ], "missing-info": [], "corrected-prediction": "The King James Version of the Bible was first printed in 1611. The New King James Version was first published in 1982." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the song good vibrations come out?", "passages": [ [ "Good Vibrations", "Good Vibrations\n\n\"Good Vibrations\" is a song composed by Brian Wilson with lyrics by Mike Love for the American rock band the Beach Boys, of which both were members.", "Released on October 10, 1966, the single was an immediate critical and commercial hit, topping record charts in several countries including the US and UK.", "Characterized by its complex soundscapes, episodic structure and subversions of pop music formula, it was the costliest single ever recorded at the time of its release.", "\"Good Vibrations\" later became widely acclaimed as one of the finest and most important works of the rock era.", "Also produced by Wilson, the title derived from his fascination with cosmic vibrations, as his mother would tell him as a child that dogs sometimes bark at people in response to their \"bad vibrations\".", "He used the concept to suggest extrasensory perception, while Love's lyrics were inspired by the nascent Flower Power movement.", "It was written as it was recorded and in a similar fashion to other compositions from Wilson's \"Smile\" period.", "The song was not originally issued as a track from an album, but rather as a standalone single, with the \"Pet Sounds\" instrumental \"Let's Go Away for Awhile\" as the B-side." ], [ "Good Vibrations", "When asked for his opinion, Brian said: \"Oh, he did a marvelous job, he did a great job.", "I was very proud of his version.\"", "Rundgren's single peaked at number 34 on the \"Billboard\" Hot 100.", "Rundgren explained: \"I used to like the sound of the Beach Boys, but it wasn't until they began to compete with the Beatles that I felt that what they were doing was really interesting\u2014like around \"Pet Sounds\" and 'Good Vibrations' ... when they started to shed that whole surf music kind of burden and start to branch out into something that was a little more universal. ...", "I tried to do [the song] as literally as I could because in the intervening 10 years, radio had changed so much.", "Radio had become so formatted and so structured that that whole experience was already gone.\"", "In 2004, Wilson re-recorded the song as a solo artist for his album \"Brian Wilson Presents Smile\".", "It was sequenced as the album's closing track, following \"In Blue Hawaii\".", "In this version, \"Good Vibrations\" was the project's only track that eschewed the modular recording method.", "The song's verses and chorus were recorded as part of one whole take, and were not spliced together." ], [ "Good Vibrations", "In 2012, Wilson Phillips, a trio consisting of Wilson's daughters Carnie and Wendy, and John Phillips' daughter Chynna, released an album containing covers of songs by the Beach Boys and the Mamas & the Papas titled \"Dedicated\".", "Their version of \"Good Vibrations\", with Carnie Wilson, on lead vocals was released as a single from the album and peaked at number 25 on \"Billboard\"s A/C chart.", "In early 2011, the single was remastered and reissued as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"The Smile Sessions\" box set.", "It contained \"Heroes and Villains\" as a B-side, along with previously released alternate takes and mixes.", "Due to the loss of the original multi-track tape, there had never been an official true stereo release of the final track until the 2012 remastered version of \"Smiley Smile\".", "The stereo mix was made possible through the invention of new digital technology by Derry Fitzgerald, and received the blessing of Brian Wilson and Mark Linett.", "Fitzgerald's software extracted individual instrumental and vocal stems from the original mono master\u2014as the multi-track vocals remained missing\u2014to construct the stereo version that appears on the 2012 reissue of \"Smiley Smile\".", "In celebration of its 40th year, the \"Good Vibrations: 40th Anniversary Edition\" EP was released." ] ], "gold": "\"Good Vibrations,\" a song by the American rock band the Beach Boys that was composed by Brian Wilson with lyrics by Mike Love, was released as a single on October 10, 1966 and was an immediate critical and commercial hit, topping record charts in several countries including the U.S. and UK. In May, 1976, a cover version of the song by American multi-instrumentalist, singer, songwriter, and record producer, Todd Rundgren, peaked at number 34 on the Billboard Hot 100, and in 2004, Brian Wilson, the musician, singer, songwriter, and record producer who founded the Beach Boys, re-recorded the song as a solo artist for his album Brian Wilson Presents Smile. In 2012, Wilson Phillips, a trio consisting of Wilson's daughters Carnie and Wendy, and John Phillips' daughter Chynna, released an album containing covers of songs by the Beach Boys and the Mamas & the Papas titled Dedicated, which included a version of \"Good Vibrations\", with Carnie Wilson on lead vocals. On June 27, 2006, the Beach Boys' released a 40th anniversary edition of the song, and on October 31, 2011, the single was remastered for the Beach Boys' The Smile Sessions box set.", "prediction 1": "Good Vibrations is a song composed by Brian Wilson with lyrics by Mike Love for the American rock band the Beach Boys. Released on October 10, 1966, the single was an immediate critical and commercial hit, topping record charts in several countries including the US and the UK. In 2004, Wilson re-recorded the song as a solo artist for his album Brian Wilson Presents Smile. It was sequenced as the album's closing track, following \"In Blue Hawaii\". In early 2011, the single was remastered and reissued as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"Dedicated\". The Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley Smiley", "prediction 2": "\"Good Vibrations\" is a song composed by Brian Wilson with lyrics by Mike Love for the American rock band the Beach Boys. Released on October 10, 1966, the single was an immediate critical and commercial hit, topping record charts in several countries including the US and UK. In 2004, Wilson re-recorded the song as a solo artist for his album Brian Wilson Presents Smile. It was sequenced as the album's closing track, following \"In Blue Hawaii\". In early 2011, Wilson Phillips, a trio consisting of Wilson's daughters Carnie Wilson, on lead vocals, released as a single from the album Dedicated. In early 2011, the single was remastered and reissued as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"The Smile Sessions\" box set.", "prediction 3": "\"Good Vibrations\" is a song composed by Brian Wilson with lyrics by Mike Love for the American rock band the Beach Boys, of which both were members. Released on October 10, 1966, the single was an immediate critical and commercial hit, topping record charts in several countries including the US and UK. In 2004, Wilson re-recorded the song as a solo artist for his album \"Brian Wilson Presents Smile\". In this version, \"Good Vibrations\" was the project's only track that eschewed the modular recording method. In early 2011, Wilson Phillips, with his daughters Carnie Wilson, on lead vocals, released a single as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"The Smile Sessions\". In celebration of its 40th anniversary, the \"Good Vibrations: 40th Anniversary Edition\" EP was released.", "prediction 4": "Brian Wilson, Mike Love and Wilson Phillips composed the song Good Vibrations, a song for the rock band the Beach Boys, of which both were members. The song was released on October 10, 1966, as a single and was an immediate critical and commercial hit, topping record charts in several countries, including the US and UK. In 2004, Wilson re-recorded the song as a solo artist for his album, Brian Wilson Presents Smile. In this version, the song's verses and chorus were recorded as part of one whole, and were not splicated together. In early 2011, the single was remastered and reissued as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"Smiley Smile\" EP. In celebration of its 40th anniversary, the Good Vibrations: 40th Anniversary Edition EP was released in celebration of", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 600, "end": 792 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 449 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 587, "end": 599 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Good Vibrations is a song composed by Brian Wilson with lyrics by Mike Love for the American rock band the Beach Boys. Released on October 10, 1966, the single was an immediate critical and commercial hit, topping record charts in several countries including the US and the UK. Rundgren's single peaked at number 34 on the \"Billboard\" Hot 100. In 2004, Wilson re-recorded the song as a solo artist for his album Brian Wilson Presents Smile. In 2012, Wilson Phillips, a trio consisting of Wilson's daughters Carnie and Wendy, and John Phillips' daughter Chynna, released an album containing covers of songs by the Beach Boys and the Mamas & the Papas titled \"Dedicated\", which included a version of \"Good Vibrations\", with Carnie Wilson on lead vocals. In early 2011, the single was remastered and reissued as a four-sided 78 rpm vinyl for Record Store Day, as a teaser for the forthcoming \"The Smile Sessions\" box set." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the first lok sabha speaker of india?", "passages": [ [ "1st Lok Sabha", "1st Lok Sabha\n\nThe First Lok Sabha was constituted on 17 April 1952 after India's first general election.", "The 1st Lok Sabha lasted its full tenure of five years and was dissolved on 4 April 1957.", "As per Article 93 of Constitution of India, the Lok Sabha must have elected and non-elected officers.", "The elected members are Speaker and the Deputy Speaker whereas the non-elected members are the Secretariat staff.", "Following were the 1st Lok Sabha officers and other important members.", "Leader of the Opposition position got recognition in 1977 post \"Salary and Allowances of Leaders of Opposition in Parliament Act\"." ], [ "M. A. Ayyangar", "M. A. Ayyangar\n\nMadabhushi Ananthasayanam Ayyangar (4 February 1891 \u2013 19 March 1978) was the first Deputy Speaker and then Speaker of Lok Sabha in the Indian Parliament.", "He was Governor of Bihar also.", "He was born in Thiruchanoor, Chittoor district of Madras Presidency.", "He was teacher in Mathematics and later became a lawyer between 1915 -1950.", "Inspired by Mahatma Gandhi he participated actively in Indian Freedom Struggle and was jailed twice.", "He was elected as member of Central Legislative Assembly in 1934.", "He was elected to the first Lok Sabha from Tirupathi and to the second Lok Sabha from Chittoor constituencies in 1952 and 1956 respectively.", "He was elected in 1948 as Deputy Speaker of Lok Sabha with Ganesh Vasudev Mavalankar as the Speaker.", "After the death of Mavalankar in 1956, he was elected as Speaker of Lok Sabha.", "Dowry prohibition act 1961 was passed by joint session of parliament with MA Ayyankar as speaker.", "He worked as Governor of Bihar between 1962 and 1967.", "A life size bronze statue of this celebrated statesman was erected at his hometown Tirupathi in 2007." ], [ "Ganesh Vasudev Mavalankar", "Ganesh Vasudev Mavalankar\n\nGanesh Vasudev Mavalankar (27 November 1888 \u2013 27 February 1956) popularly known as Dadasaheb was an independence activist, the President (from 1946 to 1947) of the Central Legislative Assembly, then Speaker of the Constituent Assembly of India, and later the first Speaker of the Lok Sabha, the lower house of the Parliament of India.", "His son Purushottam Mavalankar was later elected to the Lok Sabha twice from Gujarat.", "Mavalankar hailed from a Marathi family but lived and worked in Ahmedabad, former capital of Gujarat.", "His family originally belonged to Mavalange in Ratnagiri district of Bombay Presidency in British India.", "After his early education in Rajapur and other places in Bombay Presidency, Mavalankar moved to Ahmedabad in 1902 for higher studies.", "He obtained his B.A. Degree in Science from the Gujarat College, Ahmedabad, in 1908.", "He was a Dakshina Fellow of the College for one year in 1909 before beginning his law studies in Government Law School, Bombay.", "He passed his Law examination in First Class in 1912 and entered the legal profession in 1913.", "Soon.", "he came into contact with eminent leaders like Sardar Vallabhbhai Patel and Mahatma Gandhi." ] ], "gold": "The first Speaker of Lok Sabha in India was Ganesh Vasudev Mavalankar at the 1st Lok Sabha on April 17, 1952. The second speaker was M. A. Ayyangar.", "prediction 1": "The First Lok Sabha was constituted on 17 April 1952 after India's first general election. The 1st Lok Sabha lasted its full tenure of five years and was dissolved on 4 April 1957. Madabhushi Ananthasayanam Ayyangar was the first Deputy Speaker and then Speaker of Lok Sabha in the Indian Parliament.", "prediction 2": "The first Lok Sabha was constituted on 17 April 1952 after India's first general election. Ganesh Vasudev Mavalankar, popularly known as Dadasaheb, was an independence activist, the President of the Central Legislative Assembly from 1946 to 1947, then the Speaker of the Constituent Assembly of India, and later the first Speaker of Lok Sabha, the lower house of the Parliament of India. Madabhushi Ananthasayanam Ayyangar was the first Deputy Speaker and then Speaker of Lok Sabha in the Indian Parliament. M. Ayyyyyyangar was the first Deputy Speaker and then Speaker of Lok Sabha in the Indian Parliament.", "prediction 3": "The First Lok Sabha of India was constituted on 17 April 1952 after India's first general election. The First Lok Sabha lasted its full tenure of five years and was dissolved on 4 April 1957. Madabhushi Ananthasayanam Ayyangar was the first Deputy Speaker and later Speaker of Lok Sabha in the Indian Parliament. He was Governor of Bihar also. Ganesh Vasudev Mavalankar was an independence activist, the President (from 1946 to 1947), the Speaker of the Constituent Assembly of India, and later the first Speaker of Lok Sabha. After the death of Mavalankar in 1956, he was elected as Speaker of Lok Sabha.", "prediction 4": "The first Lok Sabha was constituted on 17 April 1952 after India's first general election. The 1st Lok Sabha lasted its full tenure of five years and was dissolved on 4 April 1957. Madabhushi Ananthasayanam Ayyangar was the first Deputy Speaker and then Speaker of Lok Sabha in the Indian Parliament. He was Governor of Bihar from 1962-1967. After the death of Mavalankar in 1956, he was elected as Speaker of Lok Sabha.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 300 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first Speaker of Lok Sabha in India was Ganesh Vasudev Mavalankar at the 1st Lok Sabha constituted on April 17, 1952. The second speaker was Madabhushi Ananthasayanam Ayyangar." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What is the strongest type of nuclear bomb?", "passages": [ [ "Tsar Bomba", "Tsar Bomba\n\nThe Soviet RDS-220 hydrogen bomb (code name \"Ivan\" or \"Vanya\"), known by Western nations as Tsar Bomba (), was the most powerful nuclear weapon ever created.", "Tested on 30 October 1961, it also remains the most powerful explosive ever detonated.", "It was also referred to as \"Kuzma's mother\" (), possibly referring to First secretary Nikita Khrushchev's promise to \"show the United States a Kuzma's mother\" (an idiom roughly translating to \"We'll show you\") at a 1960 session of United Nations General Assembly.", "The bomb had a yield of 50 megatons of TNT (210 PJ).", "In theory, it would have had a maximum yield of 100 megatons of TNT if it had included a uranium-238 tamper, but because only one bomb was built, this was never demonstrated.", "The single bomb was detonated at the Sukhoy Nos cape of Severny Island, part of Novaya Zemlya.", "The remaining bomb casings are located at the Russian Atomic Weapon Museum in Sarov and the Museum of Nuclear Weapons, All-Russian Research Institute of Technical Physics, at Snezhinsk." ] ], "gold": "The Soviet RDS-202 hydrogen bomb is the strongest of all the nuclear bombs is called Tsar Bomba. It's code name is Ivan or Vanya. ", "prediction 1": "The Soviet RDS-220 hydrogen bomb, known by Western nations as Tsar Bomba, was the most powerful nuclear weapon ever created. Tested on 30 October 1961, it also remains the most powerful explosive ever detonated.", "prediction 2": "The Soviet RDS-220 hydrogen bomb, code name Ivan or Vanya, known by Western nations as Tsar Bomba, was the most powerful nuclear weapon ever created. Tested on 30 October 1961, it also remains the most powerful explosive ever detonated.", "prediction 3": "The Soviet RDS-220 hydrogen bomb, known by Western nations as Tsar Bomba, was the most powerful nuclear weapon ever created. Tested on 30 October 1961, it also remains the most powerful explosive ever detonated. It was also referred to as \"Kuzma's mother\", possibly referring to First secretary Nikita Khrushchev's promise to \"show the United States a Kuzma's mother\" at a 1960 session of United Nations General Assembly.", "prediction 4": "The most powerful type of nuclear bomb ever created is the RDS-220 hydrogen bomb, known by Western nations as Tsar Bomba. It was tested on 30 October 1961 and remains the most powerful explosive ever detonated. A tamper was used to control the explosive.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 211 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Soviet RDS-220 hydrogen bomb, known by Western nations as Tsar Bomba, was the most powerful nuclear weapon ever created. It's code name is Ivan or Vanya." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played belle in new beauty and the beast?", "passages": [ [ "Belle (Beauty and the Beast)", "Belle's strength and love of reading was inspired by American actress Katharine Hepburn's performance as Jo March in the film \"Little Women\" (1933), while the writers instilled the adventure-seeking heroine with goals and aspirations beyond romance.", "However, the story artists and animators often contested Woolverton's liberated vision for the character.", "Animated by James Baxter and Mark Henn, the former of whom based the character's graceful gait on those of impressionist Edgar Degas' ballerinas, Belle's European facial features were inspired by those of British actresses Vivien Leigh and Audrey Hepburn.", "Several additional Hollywood actresses inspired Belle's appearance, including Natalie Wood, Elizabeth Taylor, and Grace Kelly.", "Belle has garnered widespread acclaim from film critics who appreciated the character's bravery, intelligence and independence.", "Reception towards her feminism, however, has been more mixed, with commentators accusing the character's actions of being romance-oriented.", "The fifth Disney Princess, Belle is often ranked among the franchise's best.", "Highly regarded as one of Disney's strongest examples of a feminist character, critics agree that Belle helped spearhead a generation of independent film heroines while changing the reputation of a Disney princess.", "Also one of Disney's most iconic characters, Belle was the only animated heroine nominated for the American Film Institute's greatest heroes in film ranking." ], [ "Beauty and the Beast (2014 film)", "Beauty and the Beast (2014 film)\n\nBeauty and the Beast () is a 2014 Franco-German romantic fantasy film based on the traditional fairy tale of the same name by Gabrielle-Suzanne Barbot de Villeneuve.", "Written by Christophe Gans and Sandra Vo-Anh and directed by Gans, the film stars L\u00e9a Seydoux as Belle and Vincent Cassel as the Beast.", "The film was screened out of competition at the 64th Berlin International Film Festival and was released in France on 12 February 2014 to positive reviews, becoming a box office success.", "International reviews were more mixed.", "It was nominated for the People's Choice Award for Best European Film at the 27th European Film Awards.", "It also received three nominations at the 40th C\u00e9sar Awards, winning Best Production Design for Thierry Flamand.", "A widowed merchant (Andr\u00e9 Dussollier) is forced to move to the countryside after going bankrupt, with his six children, three sons and three daughters.", "His youngest daughter, Belle (L\u00e9a Seydoux) is the only one happy with the change.", "When one of the merchant's ships is found, the merchant prepares to return to reclaim his assets.", "While his two older, spoiled daughters give him a long list of expensive things to bring back for them, Belle asks only for a rose." ] ], "gold": "There are several \"Beauty and the Beast\" films. \"Beauty and the Beast\" is a 2014 Franco-German romantic fantasy film based on the traditional fairy tale of the same name by Gabrielle-Suzanne Barbot de Villeneuve. Written by Christophe Gans and Sandra Vo-Anh and directed by Gans, the film stars L\u00e9a Seydoux as Belle and Vincent Cassel as the Beast. In the 2017 \"Beauty and the Beast\", a live action adaptation of the original 1991 film, Emma Watson played a live-action version of the character and Daisy Duczmal played the infant Belle.", "prediction 1": "There has been many incarnations of Belle. In the 2014 version, L\u00e9a Seydoux played Belle and in the 2015 version, Anna Wintour played Belle. In the 2012 version, Anna Wintour was played by Arielle H\u00e9l\u00e8nes.", "prediction 2": "In the 2014 film Beauty and the Beast, L\u00e9a Seydoux plays Belle. In the 2014 film Beauty and the Beast 2: The Beginning, L\u00e9a Seydoux plays Belle.", "prediction 3": "In the 2015 adaptation of the classic fairy tale, \"Beauty and the Beast: The Musical\", the character is played by L\u00e9a Seydoux and the 2014 remake, \"Beauty and the Beast: The Musical\" stars Andr\u00e9 Dussollier as Belle.", "prediction 4": "Belle is a character in the 2014 film Beauty and the Beast, which is a romantic fantasy romantic comedy based on the traditional fairy tale of the same name by Gabrielle-Suzanne Barbot de Villeneuve, and directed by Gans. It stars L\u00e9a Seydoux as Belle and Vincent Cassel as the Beast. In the 2014 film, which was screened out of competition at the 64th Berlin International Film Festival, Belle is played by Aimee McQueen.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 93, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 141, "end": 205 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": " Beauty and the Beast is a Franco-German romantic fantasy film based on the traditional fairy tale of the same name by Gabrielle-Suzanne Barbot de Villeneuve. Written by Christophe Gans and Sandra Vo-Anh and directed by Gans, the film stars L\u00e9a Seydoux as Belle and Vincent Cassel as the Beast. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where does song of the south take place?", "passages": [ [ "Song of the South", "The film is set on a plantation in the southern United States, specifically in the state of Georgia, some distance from Atlanta.", "Although sometimes misinterpreted as taking place before the American Civil War while slavery was still legal in the region, the film takes place during the Reconstruction Era after slavery was abolished.", "Harris' original Uncle Remus stories were all set after the American Civil War and the abolition of slavery.", "Harris himself, born in 1848, was a racial reconciliation activist writer and journalist of the Reconstruction Era.", "The film makes several indirect references to the Reconstruction Era: clothing is in the newer late-Victorian style; Uncle Remus is free to leave the plantation at will; black field hands are sharecroppers, etc.", "Seven-year-old Johnny (Bobby Driscoll) is excited about what he believes to be a vacation at his grandmother's Georgia plantation with his parents, John Sr. (Erik Rolf) and Sally (Ruth Warrick).", "When they arrive at the plantation, he discovers that his parents will be living apart for a while, and he is to live at the plantation with his mother and grandmother (Lucile Watson) while his father returns to Atlanta to continue his controversial editorship in the city's newspaper.", "Johnny, distraught because of his father's departure, secretly sets off that night for Atlanta with only a bindle." ], [ "Song of the South", "Song of the South\n\nSong of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures.", "It is based on the collection of Uncle Remus stories as adapted by Joel Chandler Harris, and stars James Baskett as Uncle Remus.", "The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery.", "The story follows 7-year-old Johnny (Bobby Driscoll) who is visiting his grandmother's plantation for an extended stay.", "Johnny befriends Uncle Remus, one of the workers on the plantation, and takes joy in hearing his tales about the adventures of Br'er Rabbit, Br'er Fox, and Br'er Bear.", "Johnny learns from the stories how to cope with the challenges he is experiencing living on the plantation.", "Walt Disney had wanted to produce a film based on the Uncle Remus stories for some time.", "It was not until 1939 that he began negotiating with the Harris family for film rights, and later in 1944, filming for \"Song of the South\" finally began.", "The studio constructed a plantation set for the outdoor scenes in Phoenix, Arizona, and some other scenes were filmed in Hollywood." ], [ "Song of the South", "Patten had been a professional model since age 3, and caught the attention of Disney when she appeared on the cover of \"Woman's Home Companion\" magazine.", "Leedy was discovered on the playground of the Booker T. Washington school in Phoenix, Arizona, by a talent scout from the Disney studio.", "Ruth Warrick and Erik Rolf, cast as Johnny's mother and father, had actually been married during filming, but divorced in 1946.", "Hattie McDaniel also appeared in the role of Aunt Tempy.", "Production started under the title \"Uncle Remus\".", "The budget was originally $1,350,000.", "The animated segments of the film were directed by Wilfred Jackson, while the live-action segments were directed by Harve Foster.", "Filming began in December 1944 in Phoenix, where the studio had constructed a plantation and cotton fields for outdoor scenes, and Disney left for the location to oversee what he called \"atmospheric shots\".", "Back in Hollywood, the live action scenes were filmed at the Samuel Goldwyn Studio.", "On the final day of shooting, Jackson discovered that the scene in which Uncle Remus sings the film's signature song, \"Zip-a-Dee-Doo-Dah\", had not been properly blocked.", "According to Jackson, \"We all sat there in a circle with the dollars running out, and nobody came up with anything." ] ], "gold": "Song of the South is a 1946 American live-action/animated musical drama film produced by Walt Disney and released by RKO Radio Pictures. It is based on the collection of Uncle Remus stories adapted by Joel Chandler Harris and stars James Baskett as Uncle Remus. The film takes place on a plantation at some distance from Atlanta, Georgia, during the Reconstruction era, a period of American history after the American Civil War and the abolition of slavery. Filming took place in Hollywood, at Samuel Goldwyn Studio, and Phoenix, Arizona, where the studio had constructed a plantation and cotton fields for outdoor scenes.", "prediction 1": "Song of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures. The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery. The film takes place on a plantation in the state of Georgia, some distance from Atlanta. Although sometimes misinterpreted as taking place before the American Civil War while slavery was still legal in the region, the film takes place in the state of Georgia, some distance from Atlanta.", "prediction 2": "Song of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures. The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery. The film's story follows 7-year-old Johnny, who is visiting his grandmother's Georgia plantation for an extended stay. Johnny befriends Uncle Remus, one of the workers on the plantation, and takes joy in hearing his tales about the adventures of Br'er Rabbit, Br'er Fox, Br'er Bear, Br'er Rabbit, Br'er Rabbit, Br'er Rabbit, Br'er Fox, and Br'er Bear.", "prediction 3": "Song of the South is a 1946 American live-action/animated musical comedy film that is produced by Walt Disney and released by RKO Radio Pictures. The film is set on a plantation in the southern United States, specifically in the state of Georgia, some distance from Atlanta. Although sometimes misinterpreted as taking place before the American Civil War while slavery was still legal in the region, the film takes place during the Reconstruction Era after slavery was abolished. The story follows 7-year-old Johnny who is visiting his grandmother's plantation.", "prediction 4": "Song of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures. It is based on the collection of Uncle Remus stories as adapted by Joel Chandler Harris, and stars James Baskett as Uncle Remus. The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery. The film takes place on a plantation in the state of Georgia, some distance from Atlanta.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 410, "end": 534 }, { "error type": "Redundant", "explanation": "Song of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures. The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery. The film takes place on a plantation in the state of Georgia, some distance from Atlanta. ", "start": 535, "end": 608 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Song of the South is a 1946 American live-action/animated musical film produced by Walt Disney and released by RKO Radio Pictures. It is based on the collection of Uncle Remus stories as adapted by Joel Chandler Harris, and stars James Baskett as Uncle Remus. The film takes place in the southern United States during the Reconstruction Era, a period of American history shortly after the end of the American Civil War and the abolition of slavery, on a plantation in the state of Georgia, some distance from Atlanta. The studio constructed a plantation set for the outdoor scenes in Phoenix, Arizona, and some other scenes were filmed in Hollywood." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What was the original name for the hawaiian islands?", "passages": [ [ "Hawaiian Islands", "Hawaiian Islands\n\nThe Hawaiian Islands () are an archipelago of eight major islands, several atolls, numerous smaller islets, and seamounts in the North Pacific Ocean, extending some from the island of Hawaii in the south to northernmost Kure Atoll.", "Formerly the group was known to Europeans and Americans as the Sandwich Islands, a name chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich.", "The contemporary name is derived from the name of the largest island, Hawaii Island.", "The Hawaiian monarchy was overthrown by wealthy U.S. and European settlers in 1893.", "They then established a republic, and despite opposition from the majority of the Hawaiian people, successfully negotiated with the United States for annexation in 1898.", "The U.S. state of Hawaii now occupies the archipelago almost in its entirety (including the uninhabited Northwestern Hawaiian Islands), with the sole exception of Midway Island, which instead separately belongs to the United States as one of its unincorporated territories within the United States Minor Outlying Islands.", "The Hawaiian Islands are the exposed peaks of a great undersea mountain range known as the Hawaiian\u2013Emperor seamount chain, formed by volcanic activity over a hotspot in the Earth's mantle.", "The islands are about from the nearest continent." ], [ "James Cook Collection: Australian Museum", "Captain James Cook, FRS, RN (7 November 1728\u00a0\u2013 14 February 1779) was a British explorer, navigator and cartographer who ultimately rose to the rank of captain in the Royal Navy.", "Cook made detailed maps of Newfoundland prior to making three voyages to the Pacific Ocean, during which he achieved the first European contact with the eastern coastline of Australia and the Hawaiian Islands, as well as the first recorded circumnavigation of New Zealand.", "Cook joined the British merchant navy as a teenager and joined the Royal Navy in 1755.", "He saw action in the Seven Years' War, and subsequently surveyed and mapped much of the entrance to the Saint Lawrence River during the siege of Quebec.", "This helped bring Cook to the attention of the Admiralty and Royal Society.", "This notice came at a crucial moment in both Cook's career and the direction of British overseas exploration, and led to his commission in 1768 as commander of HM Bark \"Endeavour\" for the first of three Pacific voyages.", "In three voyages Cook sailed thousands of miles across largely uncharted areas of the globe.", "He mapped lands from New Zealand to Hawaii in the Pacific Ocean in greater detail and on a scale not previously achieved.", "As he progressed on his voyages of discovery he surveyed and named features, and recorded islands and coastlines on European maps for the first time." ] ], "gold": "Sandwich Islands was the European and American original name for the Hawaiian Islands. British explorer Captain James Cook chose this name in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich, after Cook came across the islands by chance when crossing the Pacific Ocean. However, the native original name for the Hawaiian Islands is Mokupuni o Hawai\u2018i.", "prediction 1": "The Hawaiian Islands are an archipelago of eight major islands, several atolls, numerous smaller islets, and seamounts in the North Pacific Ocean, extending some from the island of Hawaii in the south to northernmost Kure Atoll. Formerly the group was known to Europeans and Americans as the Sandwich Islands, a name chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich. The contemporary name is derived from the name of the largest island, Hawaii Island.", "prediction 2": "The Hawaiian Islands are an archipelago of eight major islands, several atolls, numerous smaller islets, and seamounts in the North Pacific Ocean, extending some from the island of Hawaii in the south to northernmost Kure Atoll. The original name for the Hawaiian Islands was the Sandwich Islands, a name chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich. The contemporary name is derived from the name of the largest island, Hawaii Island.", "prediction 3": "The Hawaiian Islands are an archipelago of eight major islands, several atolls, numerous smaller islands, and seamounts in the North Pacific Ocean, extending some from the island of Hawaii in the south to northernmost Kure Atoll. The original name was the Sandwich Islands, chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich. The contemporary name is derived from the name of the largest island, Hawaii Island.", "prediction 4": "The Hawaiian Islands (or Hawai'i) are an archipelago consisting of eight major islands, several atolls, numerous smaller islets, and seamounts in the North Pacific Ocean. Formerly the group was known to Europeans and Americans as the Sandwich Islands, a name chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich. The contemporary name is derived from the name of the largest island, Hawaii Island.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 507 } ], "missing-info": [], "corrected-prediction": "The hawaiian islands were formly known to Europeans and Americans as the Sandwich Islands, a name chosen by James Cook in honor of the then First Lord of the Admiralty John Montagu, 4th Earl of Sandwich. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played charles dickens in the man who invented christmas?", "passages": [ [ "Jonathan Jackson (actor)", "Jonathan Jackson (actor)\n\nJonathan Stevens Jackson (born May 11, 1982) is an American actor, musician (see Enation) and author.", "His first well known character was Lucky Spencer on the ABC Daytime soap opera \"General Hospital\", a role that has won him five Emmy Awards.", "In 2002, he played Jesse Tuck in the film \"Tuck Everlasting\".", "In 2004 he started the band Enation with his brother, actor and drummer Richard Lee Jackson and friend Daniel Sweatt.", "From 2012\u20132018, he portrayed Avery Barkley in the ABC/CMT musical drama series, \"Nashville\".", "Jackson was born in Orlando, Florida, the son of Jeanine (n\u00e9e Sharp), an amateur ventriloquist and businesswoman, and Dr. Rick \"Ricky Lee\" Jackson, a family physician, country musician and Congressional candidate in the state of Washington.", "Jackson was raised in Battle Ground, Washington with his brother Richard Lee Jackson, now an actor and musician, and his sister Candice Jackson, now a lawyer, author, and official in the Trump administration.", "Jonathan attended Meadow Glade Elementary school.", "In 1991, Jackson's family took a trip to Universal Studios Hollywood, where both Richard and Jonathan decided to pursue acting.", "The brothers took acting lessons in nearby Portland, Oregon, before moving part-time to Burbank, California with their mother in 1993." ] ], "gold": "In The Man Who Invented Christmas, British actor Dan Stevens played Charles Dickens when Dickens was an adult, while Ely Solan played Charles Dickens when Dickens was young. ", "prediction 1": "On the Christmas television series Christmas: The Man Who Invented Christmas, actor Jonathan Jackson played Charles Dickens. Also in the television series Christmas: The Man Who Invented Christmas, American actor Richard Lee Jackson played the part of Charles Dickens.", "prediction 2": "Jonathan Stevens Jackson is an American actor, musician and author. In the 2003 film The Man Who Invented Christmas, Richard Lee Jackson plays Charles \"Charles\" Dickens, played by Jonathan Jackson. In the 2006 film, James Earl Jones plays Charles Dickens, and Jonathan Jackson plays Charles Dickens in the 2006 film The Man Who Invented Christmas.", "prediction 3": "The Man Who Invented Christmas is a 1999 film directed by Michael Moore and starring Jonathan Jackson as Charles Dickens. The character was played by Jonathan Jackson from 2002 to 2019.", "prediction 4": "Jonathan Stevens Jackson, an American actor, musician, and author, was the character charles dickens in the 2002 film The Man Who Invented Christmas, which won him five Emmy Awards. He played the character in several other films and television shows. The Man Who Invented Christmas also features Jonathan Jackson as a musician.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 3, "end": 45 }, { "error type": "Unverifiable", "explanation": "", "start": 78, "end": 124 }, { "error type": "Unverifiable", "explanation": "", "start": 137, "end": 197 }, { "error type": "Unverifiable", "explanation": "", "start": 198, "end": 268 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did miami heat win their first ring?", "passages": [ [ "Miami Heat", "The Mavericks were led by Dirk Nowitzki, and the Heat were led by Dwyane Wade.", "Dallas had home-court advantage in the series due to a better regular season record (60-22) than Miami's (52\u201330) and took the first two games in the series, entering Game 3 with a commanding 2\u20130 lead.", "They looked set to win Game 3 until a rally by the Heat, including many free throws from Wade, resulted in the Mavericks losing the third game.", "The Heat won all of its home games, as the Mavericks dropped games 3, 4 and 5.", "In a highly controversial Game 5, a 101\u2013100 victory for the Heat, Wade shot more free throws than the entire Mavericks team.", "Mavericks owner Mark Cuban as well as Nowitzki were both fined for acts of misconduct.", "During Game 6, the series returned to Dallas, where the Mavericks fell 92\u201395.", "Jason Terry airballed a three-point attempt that could have tied the game.", "Wade picked up the ball, throwing it in the air in celebration as the Heat won the NBA Championship, and its first one as well.", "Wade was named the Finals MVP." ], [ "Miami Heat", "Miami Heat\n\nThe Miami Heat are an American professional basketball team based in Miami.", "The Heat compete in the National Basketball Association (NBA) as a member of the league's Eastern Conference Southeast Division.", "They play their home games at the American Airlines Arena in downtown Miami.", "The team owner is Carnival Corporation owner Micky Arison, the team president and general manager is Pat Riley, and the head coach is Erik Spoelstra.", "The mascot is Burnie, an anthropomorphic fireball.", "Formed in 1988 as an expansion team, the Heat have won three league championships (in 2006, 2012 and 2013), five conference titles and thirteen division titles.", "In 2013, the Heat won twenty-seven regular season games in a row, the third-longest streak in NBA history.", "The Heat are unrelated to the Miami Floridians, an American Basketball Association (ABA) team in the early 1970s, although the Heat have occasionally paid tribute to the older franchise by wearing a replica version of the Floridians' uniforms for the NBA's \"Hardwood Classics Nights\" during the 2005\u201306 and 2011\u201312 seasons.", "In 1987 the NBA granted one of its four new expansion teams to Miami (the others being the Orlando Magic, Charlotte Hornets, and the Minnesota Timberwolves) and the team, known as the Heat began play in November 1988." ], [ "Big Three (Miami Heat)", "Big Three (Miami Heat)\n\n", "The Big Three were a trio of professional basketball players - LeBron James, Dwyane Wade, and Chris Bosh - who played for the Miami Heat of the National Basketball Association (NBA) from 2010 to 2014.", "All three players were selected within the first five picks of the 2003 NBA draft, and became scoring leaders for their respective franchises over their first seven seasons.", "After re-signing Wade following the 2009\u201310 season, the Heat secured the signings of both Bosh and James in free agency, with the latter being announced in the television special, \"The Decision\".", "The trio led the Heat to the NBA Finals in each of their four seasons together, and won back-to-back championships in 2012 and 2013.", "After losing the Finals the following season, James opted out of a contract extension, and returned to play for the Cleveland Cavaliers.", "Both Wade and Bosh continued to play for the Heat for two additional seasons after James' departure, before Wade departed Miami and signed with the Chicago Bulls, while Bosh left the game due to medical reasons.", "On September 27th, 2017, Wade signed a one-year contract with the Cavaliers, reuniting him with James.", "On February 8, 2018, at the NBA trade deadline, the Cavaliers traded back Wade to the Miami Heat in exchange for a protected 2024 second-round draft pick." ] ], "gold": "The Miami Heat are an American professional basketball team based in Miami, who compete in the National Basketball Association as a member of the league's Eastern Conference Southeast Division. They have won three NBA championships total, including two back to back championships in 2012 and 2013. Miami Heat won their first ring on June 20, 2006. Despite the Dallas Mavericks being favored to win the championship that year, the Heat won the title in six games over the Mavericks, becoming the third team to win a championship after trailing 0\u20132 in the series.", "prediction 1": "The Miami Heat have won three league championships, five conference titles, and thirteen division titles. In 2013, the Heat won twenty-seven regular season games in a row, the third-longest streak in NBA history. In 2017 the Miami Heat won their first championship. In 2018, the Miami Heat won their first NBA Championship.", "prediction 2": "The Miami Heat are an American professional basketball team based in Miami. Formed in 1988 as an expansion team, the Heat have won three league championships (in 2006, 2012 and 2013), five conference titles and thirteen division titles. In 2013, the Heat won twenty-seven regular season games in a row, the third-longest streak in NBA history. After losing the Finals the following season, LeBron James, Dwyane Wade, and Chris Bosh led the Heat to the NBA Finals in each of their four seasons together, and won back-to-back championships in 2012 and 2013.", "prediction 3": "The Miami Heat are an American professional basketball team based in Miami. Formed in 1988 as an expansion team, the Heat have won three league championships (in 2006, 2012 and 2013), five conference titles and thirteen division titles. In 2013, the heat won twenty-seven regular season games in a row, the third-longest streak in NBA history. The Miami Heat won their first NBA Championship on March 6, 2013, on March 8, 2014, and on March 4, 2015, on March 5.", "prediction 4": "The Miami Heat were an American professional basketball team based in Miami that compete in the National Basketball Association as a member of the league's Eastern Conference Southeast Division. In 2006, Miami won the league championship, then won a second one the following year on January 27, 2013. In 2012, the team won the conference championship and the first one of its kind in 2013. In 2013, the team won twenty-seven regular season games in a row, the third-longest streak in NBA history.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 212 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 216, "end": 220 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 269, "end": 274 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7, 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Miami Heat have won three league championships, in 2006, 2012, and 2013. The Dallas Mavericks were 2 games up again the Heat. The Heats won in 6 games against the Mavericks and their first championship. The Heat won back to back in 2012 and 2013." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where did quarterback foles go to high school?", "passages": [ [ "Nick Foles", "Nick Foles\n\nNicholas Edward Foles (born January 20, 1989) is an American football quarterback for the Philadelphia Eagles of the National Football League (NFL).", "He played college football at Arizona and was drafted by the Eagles in the third round of the 2012 NFL Draft.", "He has also played for the St. Louis Rams and Kansas City Chiefs.", "Foles played his first game with the Eagles in Week 10 of the 2012 season after Michael Vick left with an injury.", "Foles then made his first start the following week.", "In Week 9 of the 2013 season, he became the second quarterback to post a perfect passer rating (158.3) while passing for more than 400 yards, and also the first quarterback in NFL history to post a perfect passer rating and throw seven touchdowns in a single game.", "It was the 60th time in NFL history that a perfect passer rating was achieved overall.", "After stints with the Rams and the Chiefs, Foles returned to the Eagles in 2017.", "After Carson Wentz was injured late in the regular season, Foles led the Eagles to the franchise's third Super Bowl appearance.", "The Eagles defeated the New England Patriots in Super Bowl LII for their first Super Bowl title, and Foles was named the game's MVP.", "Foles was born and raised in Austin, Texas, the son of restaurateurs Larry and Melissa Foles." ] ], "gold": "Quarterback Foles went to high school in Austin, Travis County, Texas at Westlake High School.", "prediction 1": "Nick Foles is a quarterback for the Philadelphia Eagles of the National Football League. He attended high school in Tempe, Arizona, and played college football at Arizona. He was drafted by the Eagles in the third round of the 2012 NFL Draft. Foles has also played for the St. Louis Rams and Kansas City Chiefs.\n", "prediction 2": "Nick Foles is a professional American football quarterback for the Philadelphia Eagles of the NFL. Foles went to high school in Tempe, Arizona.", "prediction 3": "Nick Foles is a quarterback for the Philadelphia Eagles of the National Football League. He played college football at Arizona before transferring to the University of Arizona where he earned his bachelor's degree. Foles went to high school in Austin, Texas and attended college at the University of Arizona.", "prediction 4": "Nick Foles is a former professional American football quarterback for the Philadelphia Eagles of the National Football League. He played college football at Arizona before entering the NFL Draft in 2012. Foles represented the Eagles in the 2013 NFL Draft.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 116, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 171 }, { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 88 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "Who was the fifth prime minister of canada?", "passages": [ [ "John Sparrow David Thompson", "Despite his concern, Thompson ultimately realized that the conspiracy to make Canada part of the United States was confined to a small and noisy minority within the opposition party.", "In March 1893, Thompson travelled to Paris, France as one of the judges on the tribunal to settle the dispute over the seal harvest in the Bering Sea.", "The tribunal ruled there was no justification for the American claim that the Bering Sea was closed to all but American seal hunters.", "Other matters of concern during Thompson's tenure as Prime Minister included the reduction of trade tariffs and questions over schooling in Manitoba and in the North West Territories, where serious disputes existed over the role of Catholics and Protestants in administering the school system.", "The issue in the North West Territories would be resolved to Thompson's satisfaction but only after his death.", "While in office, Thompson chose the following jurists to sit as justices of the Supreme Court of Canada:\n\nSir John Thompson had been Prime Minister of Canada for only two years when he died suddenly from a heart attack at the age of 49 on December 12, 1894.", "He was at England's Windsor Castle, where Queen Victoria had just made him a member of her Privy Council.", "Thompson's physical condition had deteriorated during his time in Ottawa; he was significantly overweight when he died (standing , he weighed about ), and had always pushed himself very hard in his work." ], [ "Mackenzie Bowell", "Mackenzie Bowell\n\nSir Mackenzie Bowell (; December 27, 1823\u00a0\u2013 December 10, 1917) was a Canadian newspaper publisher and politician, who served as the fifth Prime Minister of Canada, in office from 1894 to 1896.", "Bowell was born in Rickinghall, Suffolk, England.", "He and his family moved to Belleville, Ontario, in 1832.", "His mother died two years after their arrival.", "When in his early teens, Bowell was apprenticed to the printing shop of the local newspaper, the \"Belleville Intelligencer\", and some 15 years later, became its owner and proprietor.", "In 1867, following Confederation, he was elected to the House of Commons for the Conservative Party.", "Bowell entered cabinet in 1878, and would serve under three prime ministers: John A. Macdonald, John Abbott, and John Thompson.", "He served variously as Minister of Customs (1878\u20131892), Minister of Militia and Defence (1892), and Minister of Trade and Commerce (1892\u20131894).", "Bowell kept his Commons seat continuously for 25 years, through a period of Liberal Party rule in the 1870s.", "In 1892, Bowell was appointed to the Senate.", "He became Leader of the Government in the Senate the following year.", "In December 1894, Prime Minister Thompson unexpectedly died in office, aged only 49." ], [ "John A. Macdonald", "John A. Macdonald\n\nSir John Alexander Macdonald (11 January 1815\u00a0\u2013 6 June 1891) was the first Prime Minister of Canada (1867\u20131873, 1878\u20131891).", "The dominant figure of Canadian Confederation, he had a political career which spanned almost half a century.", "Macdonald was born in Scotland; when he was a boy his family immigrated to Kingston in the Province of Upper Canada (today in eastern Ontario).", "As a lawyer he was involved in several high-profile cases and quickly became prominent in Kingston, which elected him in 1844 to the legislature of the Province of Canada.", "By 1857, he had become premier under the colony's unstable political system.", "In 1864, when no party proved capable of governing for long, Macdonald agreed to a proposal from his political rival, George Brown, that the parties unite in a Great Coalition to seek federation and political reform.", "Macdonald was the leading figure in the subsequent discussions and conferences, which resulted in the British North America Act and the birth of Canada as a nation on 1 July 1867.", "Macdonald was the first Prime Minister of the new nation, and served 19\u00a0years; only William Lyon Mackenzie King served longer.", "In 1873, he resigned from office over the Pacific Scandal, in which his party took bribes from businessmen seeking the contract to build the Canadian Pacific Railway.", "However, he was re-elected in 1878, continuing until he died in office in 1891." ] ], "gold": "Sir John Alexander Macdonald was the first prime minister of Canada. He served initially until 1873 but was re-elected in 1878. Only counting John A. Macdonald once, the fifth prime minister of Canada was Sir Mackenzie Bowell, who served from 1894 to 1896. Counting John A. Macdonald twice, the fifth prime minister of Canada was Sir John Thompson.", "prediction 1": "Sir John Sparrow David Thompson was the fifth Prime Minister of Canada. Mackenzie Bowell served as the fifth Prime Minister of Canada from 1894 to 1896.", "prediction 2": "Sir John Sparrow David Thompson was the fifth Prime Minister of Canada from 1894 to 1896. The first Canadian Prime Minister, John A. Macdonald, served as Prime Minister of Canada from 1867 to 1881, followed by Mackenzie Bowell, who served as Prime Minister from 1894 to 1896.", "prediction 3": "Sir John Thompson was the fourth Prime Minister of Canada and Mackenzie Bowell was the fifth Prime Minister of Canada.", "prediction 4": "Sir John Sparrow David Thompson was the fifth prime minister of Canada, serving from 1894 to 1896. Sir Mackenzie Bowell served as the fifth prime minister of Canada, serving from 1894 to 1896. John A. Macdonald was the first prime minister of Canada, serving from 1867-1878, 1878-1891, and 1891-1896.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 40, "end": 45 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "Mackenzie Bowell served as the fifth Prime Minister of Canada from 1894 to 1896. Sir John Alexander Macdonald was the first Prime Minister of Canada. In 1873, he resigned, however, he was re-elected in 1878." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who owns the original han solo in carbonite?", "passages": [ [ "Hasbro", "Hasbro\n\nHasbro, Inc. (a syllabic abbreviation of its original name, Hassenfeld Brothers) is an American multinational toy and board game company.", "It is the largest toy maker in the world in terms of stock market value, and third largest with revenues of approximately $5.12 billion.", "Hasbro acquired the trademarks and products of Kenner, Parker Brothers, and Milton Bradley, among others.", "Among its products are Monopoly, G.I. Joe, Furby, Transformers, Nerf, My Little Pony, Twister and the newly acquired Power Rangers franchise.", "The Hasbro brand also spawned TV shows to promote its products, such as \"Family Game Night\" on the Discovery Family network.", "The corporate headquarters is located in Pawtucket, Rhode Island.", "The majority of its products are manufactured in East Asia.", "Three American Jewish brothers, Herman, Hillel, and Henry Hassenfeld founded Hassenfeld Brothers in Providence, Rhode Island in 1923, a company selling textile remnants.", "Over the next two decades, the company expanded to produce pencil cases and school supplies.", "In 1926, Hassenfeld Brothers was incorporated; Hillel left for another textile business while Henry took charge of the corporation.", "They began making their own pencils when their pencil supplier began making pencil cases as well." ], [ "Kenner Star Wars action figures", "In the anticipation of the release of the sequel movie \"The Empire Strikes Back\", Kenner offered its first mail-in promotion, in which four proof of purchases could be redeemed for a new action figure, Boba Fett.", "This figure was originally intended to feature a backpack with a firing missile, but this was abandoned due to safety concerns.", "Similar mail in promotions were periodically offered through to 1984.", "Sales in 1979 again topped $100 million.", "Kenner continued to introduce waves of action figures from the sequels and in 1984, the year following the release of the movie \"Return of the Jedi\", the range totaled 79 unique character designs.", "In 1985, the figure range was renamed \"Power of the Force\" in which a further 15 figures were released.", "Two further ranges of \"Star Wars\" action figures were also released, based on the animated series, \"\" and \"\".", "The \"Droids\" range comprised 12 figures (two of which were identical to figures from the main \"Star Wars\" line) and the \"Ewoks\" line comprised six figures.", "By mid-1985, the demand for \"Star Wars\" merchandise had slowed and Kenner discontinued production of its action figures." ], [ "Hasbro", "Hasbro issued a statement, saying that it would \"act swiftly and decisively in making any necessary changes\" and had \"increased the intensity of [its] ongoing safety review efforts.\"", "Critics pointed out that Hasbro had no official regulatory control of these factories.", "Hasbro responded by hiring independent auditors.", "These auditors make unannounced visits to the East Asian subcontractors.", "Factory managers have been coached in how to fool the auditors.", "In 2008, Hasbro acquired game maker Cranium, Inc. for $77.5\u00a0million.", "The deal was announced on January 4 and closed on January 25.", "Hasbro is collaborating with Discovery Communications on Hub Network, a new cable network which began on October 10, 2010.", "The venture proved successful in unexpected ways when the TV revival of the \"My Little Pony\" franchise, \"\", became the network's highest-rated program with not only its target demographic of young girls, but attracted an unexpectedly significant cult following .", "The Hub Network was rebranded as Discovery Family on October 13, 2014.", "Hasbro also produces Marvel Comics and Star Wars toys, having recently renewed this deal through at least 2020.", "In 2011, Greenpeace accused Hasbro of purchasing paper for its packaging from ancient forests in Indonesia." ] ], "gold": "The original rights to Han Solo in carbonite action figures were owned by Kenner Products, until 1991 when Hasbro took ownership. Kenner made the first Star Wars action figures to coincide with the release of the original film, and today the original figures are highly valuable. Kenner released more than 100 action figures in their Star Wars range between 1977 and 1985. Since the 1990s, Hasbro holds the rights to create action figures based on the saga. ", "prediction 1": "Hasbro owns the original Han Solo in carbonite. Hasbro, Inc. is an American multinational toy and board game company. Hasbro, Inc. owns the original Han Solo in carbonite.", "prediction 2": "Hasbro Inc. is an American multinational toy and board game company that owns the original Han Solo in carbonite. Hasbro acquired the trademarks and products of Kenner, Parker Brothers, and Milton Bradley, among others. Hasbro also owns the original Han Solo in carbonite.", "prediction 3": "Hasbro, Inc. is an American multinational toy and board game company. Hasbro, Inc. owns the original Han Solo in Carbonite. Hasbro, Inc. owns the original Han Solo in Carbonite.", "prediction 4": "Hasbro, Inc., is an American multinational toy and board game company that owns the original Han Solo in carbonite. Hasbro, Inc. owns the original Han Solo in carbonite. Hasbro has acquired the trademarks and products of Kenner, Parker Brothers, and Milton Bradley, among others.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 47 }, { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 117 }, { "error type": "Redundant", "explanation": "Hasbro owns the original Han Solo in carbonite. ", "start": 118, "end": 171 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "It is unclear, however, Kenner produced Star Wars action figures until midway through 1985." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Noel gallagher's high flying birds full album?", "passages": [ [ "Noel Gallagher's High Flying Birds (album)", "Noel Gallagher's High Flying Birds (album)\n\n", "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds.", "Released on 17 October 2011, it is the first studio album released by eponymous frontman Noel Gallagher since his departure from Oasis in August 2009 and the group's eventual dissolution.", "\"Noel Gallagher's High Flying Birds\" was recorded between 2010 and 2011 in London and Los Angeles, and produced by Gallagher and former Oasis producer Dave Sardy.", "Musicians featured on the record include former Oasis keyboardist Mike Rowe, The Lemon Trees drummer Jeremy Stacey and percussionist Lenny Castro, in addition to guest appearances from the Crouch End Festival Chorus and The Wired Strings.", "The name, High Flying Birds, drew inspiration from the Jefferson Airplane song while using it as a band name was a homage to Peter Green's Fleetwood Mac.", "The track listing includes \"Stop the Clocks\", which is the unreleased Oasis track of that name.", "On 20 July 2011, \"The Death of You and Me\" was confirmed as the lead single, scheduled for release on 21 August 2011, with \"The Good Rebel\" appearing as the B-side.", "On 30 August 2011, \"If I Had a Gun...\" premiered on Kroq Radio and will be Gallagher's debut single in North America." ] ], "gold": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. Released on October 17, 2011, it is the first studio album released by eponymous frontman Noel Gallagher since his departure from Oasis in August 2009 and the group's eventual dissolution. Noel Gallagher's High Flying Birds was recorded between 2010 and 2011 in London and Los Angeles, and produced by Gallagher and former Oasis producer Dave Sardy.", "prediction 1": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. Released on 17 October 2011, it is the first studio album released by the eponymous frontman since his departure from Oasis in August 2009 and the group's eventual dissolution. Musicians featured on the record include former Oasis keyboardist Mike Rowe, The Lemon Trees drummer Jeremy Stacey and percussionist Lennnnny Castro in addition to guest appearances from the Crouch End Festival Choral and The Wired Strings.", "prediction 2": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. It was released on 17 October 2011, and features guest appearances from the Crouch End Festival Chorus and The Wired Strings.", "prediction 3": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. Released on 17 October 2011, it is the first studio album released by eponymous frontman Noel Gallagher since his departure from Oasis in August 2009 and the group's eventual dissolution. Musicians featured on the record include former Oasis keyboardist Mike Rowe, The Lemon Trees drummer Jeremy Stacey and percussionist Lennnnny Castro in addition to guest appearances from the Crouch End Festival Choral and The Wired Strings.", "prediction 4": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. Released on 17 October 2011, it is the first studio album released by eponymous frontman Noel Gallagher since his departure from Oasis in August 2009 and the group's eventual dissolution. Musicians featured on the record include former Oasis keyboardist Mike Rowe, The Lemon Trees drummer Jeremy Stacey and percussionist Lennnny Castro, in addition to guest appearances from the Crouch End Festival Chor and The Wired Strings.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 551 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Noel Gallagher's High Flying Birds is the self-titled debut studio album by the English rock band Noel Gallagher's High Flying Birds. Released on 17 October 2011, it is the first studio album released by the eponymous frontman since his departure from Oasis in August 2009 and the group's eventual dissolution.\"Noel Gallagher's High Flying Birds\" was recorded between 2010 and 2011 in London and Los Angeles, and produced by Gallagher and former Oasis producer Dave Sardy." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Where did the saying just do it come from?", "passages": [ [ "Just Do It", "Just Do It\n\nJust Do It (stylized as JUST DO IT.)", "is a trademark of shoe company Nike, and one of the core components of Nike's brand.", "The slogan was coined in 1988 at an advertising agency meeting.", "The founder of Wieden+Kennedy agency, Dan Wieden credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore\u2019s last words: \"Let's do it.\"", "The \"Just Do It\" campaign allowed Nike to further increase its share of the North American domestic sport-shoe business from 18% to 43%, (from $877 million to $9.2 billion in worldwide sales) from 1988 to 1998.", "In many Nike-related situations, \"Just Do It\" appears alongside the Nike logo, known as the Swoosh.", "The \"Just Do It\" campaign launched in 1988 was highly successful with the Age selecting the campaign as one of the top two taglines of the 20th century with it being both \"universal and intensely personal\".", "While Reebok was directing their campaign at aerobics during the fitness craze of the 1980s, Nike responded with \"a tough, take no prisoners ad campaign\"." ] ], "gold": "Just Do It is a trademark of shoe company Nike, and it is one of the core components of Nike's brand. The slogan was coined in 1988 at an advertising agency meeting. The founder of the Wieden+Kennedy advertising agency, Dan Wieden, credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore's last words: \"Let's do it\".", "prediction 1": "The saying Just Do It comes from Gary Gilmore's last words, \"Let's do it\". The slogan was coined in 1988 at an advertising agency meeting. The founder of Wieden+Kennedy agency, Dan Wieden credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore's last words, \"Let's do it.\" The \"Just Do It\" campaign allowed Nike to further increase its share of the North American domestic sport-shoe business, from 18% to 43%, from $877 million to $9.2 billion in worldwide sales, from 1988 to 1998.", "prediction 2": "The saying Just Do It comes from an advertising agency meeting in 1988. The founder of Wieden+Kennedy agency, Dan Wieden credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore\u2019s last words: \"Let\u2019s do it\".", "prediction 3": "The saying Just Do It, or JUST DO IT, was coined in 1988 at an advertising agency meeting. The founder of Wieden+Kennedy agency, Dan Wieden credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore\u2019s last words: \"Let's do it\". The \"Just Do It\" campaign allowed Nike to further increase its share of the North American domestic sport-shoe business from 18% to 43%, (from $877 million to $9.2 billion in worldwide sales from 1988 to 1998.", "prediction 4": "The saying Just Do It came from Gary Gilmore's last words: \"Let's do it.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 500 } ], "missing-info": [], "corrected-prediction": "The saying Just Do It comes from Gary Gilmore's last words, \"Let's do it\". The slogan was coined in 1988 at an advertising agency meeting. The founder of Wieden+Kennedy agency, Dan Wieden credits the inspiration for his \"Just Do It\" Nike slogan to Gary Gilmore's last words, \"Let's do it.\"" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who medaled in the men's figure skating?", "passages": [ [ "Sweden at the Olympics", "Sweden at the Olympics\n\nSweden first participated at the Olympic Games at the inaugural 1896 Games, and has sent athletes to compete in every Games since then with one exception, the sparsely attended 1904 Summer Olympics.", "Sweden has earned medals at all Olympic games except for two, the 1896 Games and the 1904 Games.", "The only other nation having earned medals at every Olympic game since 1908 is Sweden's neighboring country Finland.", "Sweden hosted the Games on one occasion, the 1912 Summer Olympics in Stockholm.", "The equestrian events of the 1956 Summer Olympics in Melbourne were held in Stockholm, due to quarantine reasons.", "Swedish athletes have won a total of 494 medals at the Summer Olympic Games, and another 144 at the Winter Olympic Games.", "The International Olympic Committee had Swedish officer and sports instructor Viktor Balck as one of its original members.", "The Swedish Olympic Committee was created and recognized in 1913.", "*\"This table does not include six medals \u2013 three gold, two silver, and one bronze \u2013 awarded in the 1908 and 1920 figure skating events.\"", "*\"This table includes six medals \u2013 three gold, two silver, and one bronze \u2013 awarded in the 1908 and 1920 figure skating events.\"", "According to official data of the Swedish Olympic Committee.", "This is a list of people who have won three or more Olympic gold medals for Sweden." ], [ "Javier Fern\u00e1ndez (figure skater)", "Javier Fern\u00e1ndez (figure skater)\n\nJavier Fern\u00e1ndez L\u00f3pez (; born 15 April 1991) is a Spanish figure skater.", "He is the 2018 Olympic bronze medalist, a two-time World champion (2015, 2016), a six-time consecutive European champion (2013, 2014, 2015, 2016, 2017, 2018), a three-time Grand Prix Final medalist (2014\u201315, 2015\u201316, 2011\u201312), and an eight-time Spanish national champion.", "He is the second man to break the 100-point barrier in the short program, the 200-point barrier in the long program, and the 300-point barrier in the total score.", "As of 24 May 2017, he has the second highest personal best scores in both segments and third highest in the combined score.", "Fern\u00e1ndez represented Spain at the 2010, 2014 and 2018 Winter Olympics.", "He is the first skater from Spain to medal at an Olympic Games, ISU Championship or a Grand Prix event.", "In recognition of his achievements, Fern\u00e1ndez received the Gold Medal of the Royal Order of Sports Merit by the Spanish government on 19 April 2016.", "Javier Fern\u00e1ndez L\u00f3pez was born on 15 April 1991 in Madrid.", "He is the younger of two children born to Enriqueta, a mail carrier, and Antonio, an army mechanic." ], [ "Patrick Chan", "Patrick Chan\n\nPatrick Lewis Wai-Kuan Chan (born December 31, 1990) is a Canadian former competitive figure skater.", "He is a 2018 Olympic gold medalist in the team event, 2014 Olympic silver medalist in the men's and team events, a three-time World champion (2011, 2012, 2013), a two-time Grand Prix Final champion (2010 and 2011), a three-time Four Continents champion (2009, 2012, 2016), and a ten-time Canadian national champion (2008\u20132014, 2016\u20132018).", "On April 27, 2011, Chan set a new world record of 93.02 points for the short program.", "On April 28, 2011, Chan then set a new world record for his free skating, receiving an overall score of 280.98.", "In recognition, Chan was named the recipient of the Lou Marsh Award as Canada's top athlete.", "Patrick Lewis Wai-Kuan Chan was born December 31, 1990, in Ottawa, Ontario, Canada.", "He is the only child of Lewis Chan, a lawyer, and Karen, both immigrants from Hong Kong.", "Arriving at the age of four, Lewis grew up in Montreal, Quebec, and pursued table tennis, golf and weight-lifting.", "Karen, who won both singles and doubles tennis championships in her native city, moved to Canada in her 20s in order to continue her studies." ] ], "gold": "Figure skating has been part of the Olympic Games since 1908 and has been included in 25 Olympic Games and there have been 271 medals, including 91 gold, 90 silver, and 90 bronze, awarded to figure skaters representing 29 representing National Olympic Committees. Javier Fern\u00e1ndez L\u00f3pez, a Spanish former figure skater, was the 2018 Olympic bronze medalist, as well as a two-time World champion, a two-time World bronze medalist, a seven-time European champion, a two-time Grand Prix Final silver medalist, a three-time Rostelecom Cup champion, a two-time Grand Prix in France champion and an eight-time Spanish national champion. Former Canadian competitive figure skater Patrick Lewis Wai-Kuan Chan is a 2018 Olympic gold medallist in the team event, 2014 Olympic silver medallist in the men's and team events, a three-time World champion, a two-time Grand Prix Final champion, a three-time Four Continents champion, and a ten-time Canadian national champion. Former Russian figure skater Evgeni Viktorovich Plushenko is a four-time Olympic medalist, including a 2006 gold medal, a 2014 gold medal, 2002 & 2010 silver medals, and a three-time World champion, a seven-time European champion, a four-time Grand Prix Final champion, and a ten-time Russian national champion.", "prediction 1": "Sweden has medaled at every Olympic games except for two, the 1896 Games and the 1904 Games. Javier Fern\u00e1ndez L\u00f3pez, a Spanish figure skater, is the 2018 Olympic bronze medalist, a two-time World champion, a six-time consecutive European champion, a three-time Grand Prix Final medalist, and an eight-time Spanish national champion. Patrick Lewis Wai-Kuan Chan, a Canadian former competitive figure skater, is a 2018 Olympic gold medalist in the team event and 2014 Olympic silver medalist in the men's and team events.", "prediction 2": "The men's figure skating at the 2018 Olympic games was won by American figure skater Javier Fern\u00e1ndez, while the women's figure skating was won by French figure skater Patrick Chan. The men's figure skating was won by Canadian figure skater Patrick Lewis Wai-Kuan Chan, who also won a bronze medal in the 2018 Olympics.", "prediction 3": "There have been several Swedish athletes who have medaled in figure skating at the Olympics, including Javier Fern\u00e1ndez, Patrick Chan, and Alexander Zverev. In the men's competition in 2018, Russian figure skater Alexander Zverev and American figure skater Alexander Zverev medaled. In the women's competition in 1920, the Russian team won three gold medals, the Canadian team won four silver medals, and the Canadian team won three bronze medals.", "prediction 4": "There are several people who have medaled in the men's figure skating events at the Olympic Games. In the men's event, the Netherlands won a gold, a silver, and a bronze medal, while in the men's event, the Spain won a bronze, a silver, and a bronze. The 2018 slalom champion, Javier Fern\u00e1ndez, won a bronze, while a Canadian figure skater Patrick Lewis Wai-Kuan Chan won a silver, and a 2018 s and a silver medalist in the men's and team events.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 92 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": " Javier Fern\u00e1ndez L\u00f3pez, a Spanish figure skater, is the 2018 Olympic bronze medalist, a two-time World champion, a six-time consecutive European champion, a three-time Grand Prix Final medalist, and an eight-time Spanish national champion. Patrick Lewis Wai-Kuan Chan, a Canadian former competitive figure skater, is a 2018 Olympic gold medalist in the team event, the 2014 Olympic silver medalist in the men's and team events, a three-time World champion, a two-time Grand Prix Final champion, a three-time Four Continents champion, and a ten-time Canadian national champion." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who keeps private key in asymmetric key cryptography?", "passages": [ [ "Public-key cryptography", "Public-key cryptography\n\nPublic-key cryptography, or asymmetric cryptography, is any cryptographic system that uses pairs of keys: \"public keys\" which may be disseminated widely, and \"private keys\" which are known only to the owner.", "This accomplishes two functions: authentication, where the public key verifies that a holder of the paired private key sent the message, and encryption, where only the paired private key holder can decrypt the message encrypted with the public key.", "In a public key encryption system, any person can encrypt a message using the receiver's public key.", "That encrypted message can only be decrypted with the receiver's private key.", "To be practical, the generation of a public and private key -pair must be computationally economical.", "The strength of a public key cryptography system relies on the computational effort (\"work factor\" in cryptography) required to find the private key from its paired public key.", "Effective security only requires keeping the private key private; the public key can be openly distributed without compromising security.", "Public key cryptography systems often rely on cryptographic algorithms based on mathematical problems that currently admit no efficient solution, particularly those inherent in certain integer factorization, discrete logarithm, and elliptic curve relationships." ], [ "Public-key cryptography", "Public key algorithms, unlike symmetric key algorithms, do \"not\" require a secure channel for the initial exchange of one or more secret keys between the parties.", "Because of the computational complexity of asymmetric encryption, it is usually used only for small blocks of data, typically the transfer of a symmetric encryption key (e.g. a session key).", "This symmetric key is then used to encrypt the rest of the potentially long message sequence.", "The symmetric encryption/decryption is based on simpler algorithms and is much faster.", "In a public key signature system, a person can combine a message with a private key to create a short \"digital signature\" on the message.", "Anyone with the corresponding public key can combine a message, a putative digital signature on it, and the known public key to verify whether the signature was valid, i.e. made by the owner of the corresponding private key.", "Changing the message, even replacing a single letter, will cause verification to fail.", "In a secure signature system, it is computationally infeasible for anyone who does not know the private key to deduce it from the public key or any number of signatures, or to find a valid signature on any message for which a signature has not hitherto been seen." ], [ "Public-key cryptography", "The sender computes a digital signature for the message to be sent, then sends the signature (together with the message) to the intended receiver.", "Digital signature schemes have the property that signatures can be computed only with the knowledge of the correct private key.", "To verify that a message has been signed by a user and has not been modified, the receiver needs to know only the corresponding public key.", "In some cases (e.g., RSA), a single algorithm can be used to both encrypt and create digital signatures.", "In other cases (e.g., DSA), each algorithm can only be used for one specific purpose.", "To achieve both authentication and confidentiality, the sender should include the recipient's name in the message, sign it using his private key, and then encrypt both the message and the signature using the recipient's public key.", "These characteristics can be used to construct many other (sometimes surprising) cryptographic protocols and applications, such as digital cash, password-authenticated key agreement, multi-party key agreement, time-stamping services, non-repudiation protocols, etc." ] ], "gold": "Public-key cryptography, or asymmetric cryptography, is a cryptographic system that uses pairs of keys. Each pair consists of a public key, which may be known to others, and a private key, which may not be known by anyone except the owner. The generation of such key pairs depends on cryptographic algorithms which are based on mathematical problems termed one-way functions. For encryption, the receiver keeps private key and in authentication the sender keeps the private key.", "prediction 1": "In asymmetric key cryptography, the private key of each pair is known only to the owner, and the public key verifies that the holder of the private key sent the message. In asymmetric cryptography, the private key of each pair is known only to the owner. Effective security only requires keeping the private key private, while the public key can be openly distributed without compromising security.", "prediction 2": "In asymmetric key cryptography, the owner of the private key has to keep his private key private. If he does not, he can decrypt the message with the public key.", "prediction 3": "In asymmetric key cryptography, the holder of both public and private keys keep the private key, while the sender keeps the public key. Effective security only requires keeping the private key private, as the public key can be openly distributed without compromising security.", "prediction 4": "In public key cryptography, the public key verifies that a holder of the paired private key sent the message, while the private key is known only to the owner. Effective security only requires keeping the private key private; the public key can be openly distributed without compromising security. In asymmetric key cryptography, the sender can combine a message with a private key to create a short digital signature on the message. Anyone with the corresponding public key can combine a message with a private key to create a short digital signature on the message.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 169 }, { "error type": "Redundant", "explanation": "In asymmetric key cryptography, the private key of each pair is known only to the owner, ", "start": 170, "end": 254 }, { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 398 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Public-key cryptography, or asymmetric cryptography, is a cryptographic system that uses pairs of keys: \"public keys\" which may be disseminated widely, and \"private keys\" which are known only to the owner. Public key cryptography systems often rely on cryptographic algorithms based on mathematical problems. In a public key encryption system, any person can encrypt a message using the receiver's public key. That encrypted message can only be decrypted with the receiver's private key." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who was the first prime minister of indian?", "passages": [ [ "Indira Gandhi", "Indira Gandhi\n\nIndira Priyadarshini Gandhi (; n\u00e9e Nehru; November 19, 1917 \u2013 October 31, 1984), was an Indian politician, stateswoman and a central figure of the Indian National Congress.", "She was the first and, to date, the only female Prime Minister of India.", "Indira Gandhi was the daughter of Jawaharlal Nehru, the first prime minister of India.", "She served as Prime Minister from January 1966 to March 1977 and again from January 1980 until her assassination in October 1984, making her the second longest-serving Indian Prime Minister after her father.", "Gandhi served as her father's personal assistant and hostess during his tenure as Prime Minister between 1947 and 1964.", "She was elected President of the Indian National Congress in 1959.", "Upon her father's death in 1964 she was appointed as a member of the Rajya Sabha (upper house) and became a member of Lal Bahadur Shastri's cabinet as Minister of Information and Broadcasting.", "In the Congress Party's parliamentary leadership election held in early 1966 (upon the death of Shastri), she defeated her rival Morarji Desai, to become leader, and thus succeeded Shastri as Prime Minister of India.", "As Prime Minister, Gandhi was known for her political intransigency and unprecedented centralisation of power." ], [ "Deputy Prime Minister of India", "Deputy Prime Minister of India\n\nThe Deputy Prime Minister of India is a member of the Union Council of Ministers in the Government of India.", "Not a constitutional office, it seldom carries any specific powers.", "A deputy prime minister usually also holds a cabinet portfolio such as home minister or finance minister.", "In the parliamentary system of government, the prime minister is treated as the \"first among equals\" in the cabinet; the position of deputy prime minister is used to bring political stability and strength within a coalition government or in times of national emergency, when a proper chain of command is necessary.", "The first Deputy Prime Minister of India was Vallabhbhai Patel, who was also home minister in Jawaharlal Nehru's cabinet.", "The office has since been only intermittently occupied.", "The seventh and last deputy prime minister was L. K. Advani, who took on the role in addition to his home ministership from 2002 to 2004 in Atal Bihari Vajpayee's government.", "The current government does not have a Deputy Prime Minister.", "On multiple occasions, proposals have arisen to make the post permanent, but without result.", "The same goes for the post of deputy chief minister at the state level.", "Keys" ], [ "Prime Minister of India", "Prime Minister of India\n\nThe Prime Minister of India is the leader of the executive of the Government of India.", "The prime minister is also the chief adviser to the President of India and head of the Council of Ministers.", "They can be a member of any of the two houses of the Parliament of India\u2014the Lok Sabha (House of the People) and the Rajya Sabha (Council of the States)\u2014but has to be a member of the political party or coalition, having a majority in the Lok Sabha.", "The prime minister is the senior-most member of cabinet in the executive of government in a parliamentary system.", "The prime minister selects and can dismiss members of the cabinet; allocates posts to members within the government; and is the presiding member and chairperson of the cabinet.", "The union cabinet headed by the prime minister is appointed by the President of India to assist the latter in the administration of the affairs of the executive.", "Union cabinet is collectively responsible to the Lok Sabha as per of the Constitution of India.", "The prime minister has to enjoy the confidence of a majority in the Lok Sabha and shall resign if they are unable to prove majority when instructed by the president.", "India follows a parliamentary system in which the prime minister is the presiding head of the government and chief of the executive of the government." ] ], "gold": "Since 1947 India has had 14 prime ministers, who is the chief executive of the Government of India, 15 including Gulzarilal Nanda who twice acted in the role, of which 6 having at least one full term, ruling country for about 60 years. The first was Jawaharlal Nehru of the Indian National Congress party, who was sworn in on 15 August 1947, when India gained independence from the British Raj, and served until his death in May 1964, remaining India's longest-serving prime minister. The Deputy Prime Minister of India, officially the Deputy Prime Minister of the Republic of India, is the deputy to the Prime Minister of India, who is head of the government of India. The first was Sardar Vallabhbhai Patel of the Indian National Congress party, who was sworn in on 15 August 1947, and served until his death in December 1950, remaining India's longest-serving deputy prime minister.", "prediction 1": "The first prime minister of India was Jawaharlal Nehru. Indira Priyadarshini Gandhi, the daughter of Jawaharlal Nehru, was the first prime minister of India. The first female prime minister of India was Narendra Modi in 2014. The first deputy prime minister of India was Vallabhbhai Patel, who was also home minister in Jawaharlal Nehru's cabinet. The first female prime minister of India was Indira Gandhi, the daughter of Jawaharlal Nehru. The first female prime minister was Indira Nehru in 1966.", "prediction 2": "The first prime minister of India was Jawaharlal Nehru in 1947. In 1966, Indira Priyadarshini Gandhi succeeded her father as prime minister. The first Deputy Prime Minister of India was Vallabhbhai Patel. The seventh and last Deputy Prime Minister of India was L. K. Advani.", "prediction 3": "The first prime minister of India was Jawaharlal Nehru in 1947. In 1966, Indira Priyadarshini Gandhi succeeded Shastri as the Prime Minister of India. The first Deputy Prime Minister of India was Vallabhbhai Patel who was also home minister in Jawaharlal Nehru's cabinet.", "prediction 4": "The first prime minister of India was Jawaharlal Nehru. He served as Prime Minister from 1947 to 1964. The first female prime minister of India was Indira Priyadarshini Gandhi from January 1966 to March 1977 and again from January 1980 until her assassination in October 1984.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 56, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 225 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Prime Minister of India is the leader of the executive of the Government of India. The first prime minister of India was Jawaharlal Nehru, who is also India's longest-serving prime minister. The first deputy prime minister of India was Vallabhbhai Patel." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang the christmas song with the pogues?", "passages": [ [ "Fairytale of New York", "Fairytale of New York\n\n\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals.", "The song is an Irish folk-style ballad and was written as a duet, with the Pogues' singer MacGowan taking the role of the male character and MacColl the female character.", "It was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album \"If I Should Fall from Grace with God\".", "Originally begun in 1985, the song had a troubled two-year development history, undergoing rewrites and aborted attempts at recording, and losing its original female vocalist along the way, before finally being completed in August 1987.", "Although the single never reached the coveted UK Christmas number one, being kept at number two on its original release in 1987 by the Pet Shop Boys' cover version of \"Always on My Mind\", it has proved enduringly popular with both music critics and the public: to date the song has reached the UK Top 20 on fifteen separate occasions since its original release in 1987, including every year since 2005, and was certified double platinum in the UK in 2016." ], [ "Fairytale of New York", "As of September 2017 the song has sold 1,217,112 copies in the UK, with an additional 249,626 streaming equivalent sales, for a total of 1,466,737 combined sales.", "In the UK, it is the most-played Christmas song of the 21st century.", "\"Fairytale of New York\" has been cited as the best Christmas song of all time in various television, radio and magazine related polls in the UK and Ireland.", "Although there is agreement among the band that \"Fairytale of New York\" was first written in 1985, the origins of the song are disputed.", "MacGowan insisted that it arose as a result of a wager made by the Pogues' producer at the time, Elvis Costello, that the band would not be able to write a Christmas hit single, while the Pogues' manager Frank Murray has stated that it was originally his idea that the band should try and write a Christmas song as he thought it would be \"interesting\".", "It was banjo player Finer who came up with the melody and the original concept for the song, which involved a sailor in New York looking out over the ocean and reminiscing about being back home in Ireland.", "Finer's wife Marcia did not like the original story, and suggested new lyrics regarding a conversation between a couple at Christmas." ] ], "gold": "\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. The song is an Irish folk-style ballad and was written as a duet, with the Pogues' singer MacGowan taking the role of the male character and MacColl the female character. It was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album If I Should Fall from Grace with God. In the UK, \"Fairytale of New York\" is the most-played Christmas song of the 21st century.", "prediction 1": "\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. The song is an Irish folk-style ballad and was written as a duet, with the Pogues' singer MacGowan taking the role of the male character and MacColl the female character. It was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album If I Should Fall from Grace with God.", "prediction 2": "\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. It was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album \"If I Should Fall from Grace with God\". The original female vocalist on the song was Kirsty MacColl.", "prediction 3": "\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. The song is an Irish folk-style ballad and was written as a duet, with the Pogues' singer MacGowan taking the role of the male character and MacColl the female character. Although the single never reached the coveted UK Christmas number one, being kept at number two on its original release in 1987 by the Pet Shop Boys' cover version of \"Always on My Mind\", it has proved enduringly popular with both music critics and the public: to date the most-played Christmas song of all time in various television, radio and magazine related polls in the UK.", "prediction 4": "The Pogues sang the duet song Fairytale of New York, written by Jem Finer and Shane MacGowan, and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. The song was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album \"If I Should Fall from Grace with God\".", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Fairytale of New York\" is a song written by Jem Finer and Shane MacGowan and recorded by their band the Pogues, featuring singer-songwriter Kirsty MacColl on vocals. The song is an Irish folk-style ballad and was written as a duet, with the Pogues' singer MacGowan taking the role of the male character and MacColl the female character. It was originally released as a single on 23 November 1987 and later featured on the Pogues' 1988 album If I Should Fall from Grace with God. In the UK, it is the most-played Christmas song of the 21st century." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Which one is the biggest airplane in the world?", "passages": [ [ "Airship", "Airship\n\nAn airship or dirigible balloon is a type of aerostat or lighter-than-air aircraft that can navigate through the air under its own power.", "Aerostats gain their lift from large gasbags filled with a lifting gas that is less dense than the surrounding air.", "In early dirigibles, the lifting gas used was hydrogen, due to its high lifting capacity and ready availability.", "Helium gas has almost the same lifting capacity and is not flammable, unlike hydrogen, but is rare and relatively expensive.", "Significant amounts were first discovered in the United States and for a while helium was only used for airships in that country.", "Most airships built since the 1960s have used helium, though some have used hot air.", "The envelope of an airship may form a single gasbag, or may contain a number of internal gas-filled cells.", "An airship also has engines, crew, and optionally also payload accommodation, typically housed in one or more \"gondolas\" suspended below the envelope.", "The main types of airship are non-rigid, semi-rigid, and rigid.", "Non-rigid airships, often called \"blimps\", rely on internal pressure to maintain their shape.", "Semi-rigid airships maintain the envelope shape by internal pressure, but have some form of supporting structure, such as a fixed keel, attached to it." ], [ "Rotorcraft", "Rotorcraft\n\nA rotorcraft or rotary-wing aircraft is a heavier-than-air flying machine that uses lift generated by wings, called rotary wings or rotor blades, that revolve around a mast.", "Several rotor blades mounted on a single mast are referred to as a rotor.", "The International Civil Aviation Organization (ICAO) defines a rotorcraft as \"supported in flight by the reactions of the air on one or more rotors\".", "Rotorcraft generally include those aircraft where one or more rotors are required to provide lift throughout the entire flight, such as helicopters, autogyros, and gyrodynes.", "Compound rotorcraft may also include additional thrust engines or propellers and static lifting surfaces.", "A helicopter is a rotorcraft whose rotors are driven by the engine(s) throughout the flight to allow the helicopter to take off vertically, hover, fly forwards, backwards and laterally, as well as to land vertically.", "Helicopters have several different configurations of one or more main rotors.", "Helicopters with a single shaft-driven main lift rotor require some sort of antitorque device such as a tail rotor, fantail, or NOTAR, except some rare examples of helicopters using tip jet propulsion, which generates almost no torque." ], [ "Fixed-wing aircraft", "Fixed-wing aircraft\n\nA fixed-wing aircraft is a flying machine, such as an airplane or aeroplane (see spelling differences), which is capable of flight using wings that generate lift caused by the aircraft's forward airspeed and the shape of the wings.", "Fixed-wing aircraft are distinct from rotary-wing aircraft (in which the wings form a rotor mounted on a spinning shaft or \"mast\"), and ornithopters (in which the wings flap in a manner similar to that of a bird).", "The wings of a fixed-wing aircraft are not necessarily rigid; kites, hang gliders, variable-sweep wing aircraft and aeroplanes that use wing morphing are all examples of fixed-wing aircraft.", "Gliding fixed-wing aircraft, including free-flying gliders of various kinds and tethered kites, can use moving air to gain altitude.", "Powered fixed-wing aircraft (aeroplanes) that gain forward thrust from an engine include powered paragliders, powered hang gliders and some ground effect vehicles.", "Most fixed-wing aircraft are flown by a pilot on board the craft, but some are specifically designed to be unmanned and controlled either remotely or autonomously (using onboard computers).", "Kites were used approximately 2,800 years ago in China, where materials ideal for kite building were readily available." ] ], "gold": "Various types of aircrafts exist, including aircrafts with fixed wing, such as an airplane, or rotary wing, such as helicopters, and airships. The biggest airplane in the world with fixed wing is the Antonov An-225 Mriya, while the biggest aircraft with rotary wing is the Mil Mi-26. The largest airship, which is a lighter-than-air aircraft that can navigate through the air under its own power, is His Majesty's Airship R100.", "prediction 1": "A fixed-wing aircraft is a flying machine, such as an airplane or aeroplane, which is capable of flight using wings that generate lift caused by the aircraft's forward airspeed and the shape of the wings. The largest airplane in terms of mass is a helicopter and the largest is a rotorcraft. The largest aircraft on the planet is a giant biplane, which uses a single wing and several rotor blades to generate lift.", "prediction 2": "The largest airplane in the world is a helicopter, also known as a rotorcraft, which is a heavier-than-air flying machine that uses lift generated by wings, called rotary wings or rotor blades, that revolve around a mast. The largest airplane in the world is a giant kite, which was used approximately 2,800 years ago in China, where materials ideal for kite building were readily available. The biggest airplane in the world by volume is a Cessna Citation Citation-XLargon, and its wings are the largest.", "prediction 3": "An airplane or aeroplane is a flying machine, such as an airplane or aeroplane, that is capable of flight using wings that generate lift caused by the aircraft's forward airspeed and the shape of the wings. The heaviest flying machine is a fixed-wing aircraft, in which the wings form a rotor mounted on a spinning shaft or \"mast\". The largest airplane in the world is a helicopter, which has two main rotors, and the longest is a rotorcraft.", "prediction 4": "The largest type of airplane is an aerostat, which is a lighter-than-air aircraft that can navigate through the air under its own power. The largest type of airplane by volume is a helicopter, which uses a single rotor to provide lift, while the largest by mass is a rotary-wing aircraft, which uses wings that generate lift caused by the aircraft's forward airspeed and the shape of the wings. The largest flying machine by volume is a rotorcraft, which is a heavier-than-air flying machine that uses lift generated by wings, called rotary wings or rotor blades, that revolve around a mast.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 42 }, { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 204 }, { "error type": "Unverifiable", "explanation": "", "start": 209, "end": 258 }, { "error type": "Unverifiable", "explanation": "", "start": 267, "end": 291 }, { "error type": "Unverifiable", "explanation": "", "start": 296, "end": 346 }, { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 414 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "A fixed-wing aircraft is things such as an airplane or aeroplane. Rotorcrafts include things such as helicopters. An airship or dirigible balloon is a type of aerostat or lighter-than-air aircraft that can navigate through the air under its own power. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When is the last episode of the haves and have nots?", "passages": [ [ "The Haves and the Have Nots (TV series)", "Described in her on-air role as a \" villainess,\" she was hailed as \"slowly becoming a household name and gaining a cult-like following from the hit series.\"", "\"The Haves and the Have Nots\" premiered on Tuesday, May 28, 2013, at 9/8c on the Oprah Winfrey Network.", "\"The Haves and the Have Nots\" is the first scripted television series to air on OWN.", "Both the show's first and second episodes aired back to back on its premiere night.", "Each episode of the series runs for an hour (42 minutes plus commercials).", "\"The Haves and the Have Nots\" set a record for OWN, scoring the highest ratings ever for a series premiere on the network.", "During the show's first season, \"The Haves and the Have Nots\" received numerous widely publicized series highs in ratings, including with its July 30 episode, its August 6 episode, its August 13 episode, its August 27 episode, and most notably with its season 1 finale on September 3.", "The season 1 finale of \"The Haves And the Have Nots\" was the third most watched telecast in OWN history, bested only by an interview with Whitney Houston's daughter Bobbi Kristina and episodes of \"Oprah's Next Chapter\" featuring Lance Armstrong." ], [ "If Loving You Is Wrong", "On February 27, 2015, the series was renewed for a second season with 22 more episodes.", "The second season premiered on September 22, 2015.", "The second half premiered on March 15, 2016.", "OWN renewed the series for a third season.", "The third season of the series premiered on September 13, 2016.", "The second half of season 3 premiered on March 21, 2017.", "On August 29, 2017, OWN announced the show's return for the fourth season, which premiered on September 19, 2017.", "The second half of season 4 premiered on January 10, 2018 and ended with the season finale on March 7, 2018.", "On November 28, 2018, OWN announced that the series would return with the fifth season set to premiere in January 2019." ], [ "The Haves and the Have Nots (TV series)", "The mid-season finale, aired on March 11, 2014, was the most watched broadcast in OWN's history, and also came in first among all of cable television and number 4 among all shows on television for the night it aired.", "The mid-season premiere aired on May 27, 2014.", "The third season of the series premiered on January 6, 2015.", "The second half premiered on June 30, 2015.", "The fourth season of the series premiered on January 5, 2016 and the second half premiered on June 21, 2016 and aired through September 6, 2016.", "The fifth season premiered on January 3, 2017 and ended with the mid-season finale on March 14, 2017.", "On January 30, 2017, the series was given an additional 44-episode order.", "The second half of season 5 premiered on June 20, 2017 and ended with the season finale on September 12, 2017.", "On November 21, 2017, the series was renewed for a sixth season, which premiered on January 9, 2018, and the 1st mid-season finale aired March 13, 2018 and on March 13, 2018, OWN also announced the second half of the season, which premiered on May 1, 2018 and with the 2nd mid-season finale July 17, 2018.", "On July 17, 2018, OWN announced the third half of the season, which premiered on August 14, 2018." ] ], "gold": "The Haves and the Have Nots premiered on May 28, 2013, and ran for 8 seasons on the Oprah Winfrey Network, for a total of 196 hour-long episodes. The series finale aired on July 20, 2021. The season 2 finale aired on September 22, 2015 and the season 3 finale aired on September 6, 2016. Episode 107 concluded season 4 on September 12, 2017, preceded by episode 106 on September 5, 2017, and episode 105 on August 29, 2017.", "prediction 1": "The last episode of the haves and the have nots was aired on July 20, 2019.", "prediction 2": "The last episode of the haves and the have nots was aired on September 12, 2017. The series has had several season finales. The series premiered on May 28, 2013, at 9/8c on the Oprah Winfrey Network. The last episode aired on August 27, 2018.", "prediction 3": "The last episode of the haves and the have nots, a television series created by Oprah Winfrey, aired on August 12, 2018. The show's mid-season finale aired on March 11, 2014. The last episode of the season ended on August 27, 2018.", "prediction 4": "The last episode of the show The Haves and the Have Nots aired on July 17, 2018. The last episode of the show's fifth season aired on September 12, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": " \"The Haves and the Have Nots\" premiered on Tuesday, May 28, 2013, at 9/8c on the Oprah Winfrey Network. On November 21, 2017, the series was renewed for a sixth season, which premiered on January 9, 2018, and the 1st mid-season finale aired March 13, 2018 and on March 13, 2018, OWN also announced the second half of the season, which premiered on May 1, 2018 and with the 2nd mid-season finale July 17, 2018. On July 17, 2018, OWN announced the third half of the season, which premiered on August 14, 2018." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Writer of the textbook fantastic beasts and where to find them?", "passages": [ [ "Fantastic Beasts and Where to Find Them", "Fantastic Beasts and Where to Find Them\n\nFantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling (under the pen name of the fictitious author Newt Scamander) about the magical creatures in the \"Harry Potter\" universe.", "The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in \"Harry Potter and the Philosopher's Stone\" (or \"Harry Potter and the Sorcerer's Stone\" in the US), the first novel of the \"Harry Potter\" series.", "It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including in-jokes relating to the original series.", "In a 2001 interview with publisher Scholastic, Rowling stated that she chose the subject of magical creatures because it was a fun topic for which she had already developed a lot of information in earlier books.", "Rowling's name did not appear on the cover of the first edition, the work being credited under the pen name \"Newt Scamander\", who, in the books, wrote this textbook as seen on Harry's supply list for his first year.", "The book benefits the charity Comic Relief." ] ], "gold": "Fantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling, under the pen name of \"Newt Scamander\". It is about the magical creatures in the Harry Potter universe. The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in Harry Potter and the Philosopher's Stone, the first novel of the Harry Potter series. It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including inside-jokes relating to the original series.", "prediction 1": "Fantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling (under the pen name of the fictitious author Newt Scamander) about the magical creatures in the Harry Potter universe. The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in Harry Potter and the Philosopher's Stone, the first novel of the Harry Potter series. It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including in-jokes relating to the original series.\n", "prediction 2": "British author J. K. Rowling wrote the 2001 guide book Fantastic Beasts and Where to Find Them about the magical creatures in the Harry Potter universe. Of the four published novels in the Harry Potter series, three are set in the Wizarding World of Harry Potter. Scamander, in the books, wrote the present day version of the textbook.", "prediction 3": "Fantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling, under the pen name of the fictitious author Newt Scamander, about the magical creatures in the Harry Potter universe. The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in \"Harry Potter and the Philosopher's Stone\", the first novel of the \"Harry Potter\" series. It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including in-jokes relating to the original series.", "prediction 4": "Fantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling under the pen name of the fictitious author Newt Scamander about the magical creatures in the Harry Potter universe. The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in Harry Potter and the Philosopher's Stone, the first novel of the Harry Potter series. It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including in-jokes relating to the original series.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Fantastic Beasts and Where to Find Them is a 2001 guide book written by British author J. K. Rowling (under the pen name of the fictitious author Newt Scamander) about the magical creatures in the Harry Potter universe. The original version, illustrated by the author herself, purports to be Harry Potter's copy of the textbook of the same name mentioned in Harry Potter and the Philosopher's Stone, the first novel of the Harry Potter series. It includes several notes inside it supposedly handwritten by Harry, Ron Weasley, and Hermione Granger, detailing their own experiences with some of the beasts described, and including in-jokes relating to the original series.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does war of the worlds take place?", "passages": [ [ "The War of the Worlds", "However, later critics point out that the supposed panic was exaggerated by newspapers of the time, seeking to discredit radio as a source of information or exploit racial stereotypes.", "According to research by A. Brad Schwartz, fewer than 50 Americans seems to have fled outside in the wake of the broadcast and it is not clear how many of them heard the broadcast directly.", "In 1953 came the first \"The War of the Worlds\" theatrical film produced by George Pal and directed by Byron Haskin, starring Gene Barry.", "Steven Spielberg directed a 2005 film adaptation starring Tom Cruise, which received generally positive reviews.", "In 1978 a best selling musical album of the story was produced by Jeff Wayne, with the voices of Richard Burton and David Essex.", "Two later, somewhat different live concert musical versions based on the original album have since been mounted by Wayne and toured throughout the UK.", "Both versions of this stage production utilized narration, lavish projected computer graphics, and a large Martian fighting machine on stage.", "In the 1980s a joint American-Canadian venture produced the television series \"War of the Worlds\" that ran for two seasons and was a direct sequel to George Pal's 1953 feature film.", "Its premise was that the Martians had not died off but were instead stored in suspension by the US government and that most people had just forgotten the previous invasion; the accidental awakening of the Martians results in another war." ], [ "The War of the Worlds", "A \"Hey Arnold!\"", "Halloween special was aired to parody \"The War of the Worlds\".", "The costumes that the main characters wore referenced a species from \"Star Trek\".", "A 2001 animated series of Justice League begins with a three-part saga called \"Secret Origins\" and features tripod machines invading and attacking the city.", "\"The Great Martian War 1913\u20131917\" is a 2013 made-for-television science fiction film docudrama that adapts \"The War of the Worlds\" and unfolds in the style of an episode of the History TV Channel.", "The film is an alternate history of World War I in which Europe and its allies, including America, fight the Martian invaders instead of Germany and its allies.", "The docudrama includes both new and digitally altered film footage shot during the War to End All Wars to establish the scope of the interplanetary conflict.", "The film's original 2013 UK broadcast was during the first year of the World War I centennial; the first US cable TV broadcast came in 2014, almost 10 months later.", "In the spring of 2017, the BBC announced that it will be producing in 2018 a Victorian period, three-episode mini-series adaptation of the Wells novel." ], [ "The War of the Worlds", "The War of the Worlds\n\nThe War of the Worlds is a science fiction novel by English author H. G. Wells, first serialised in 1897 by \"Pearson's Magazine\" in the UK and by \"Cosmopolitan\" magazine in the US.", "The novel's first appearance in hardcover was in 1898 from publisher William Heinemann of London.", "Written between 1895 and 1897, it is one of the earliest stories to detail a conflict between mankind and an extraterrestrial race.", "The novel is the first-person narrative of both an unnamed protagonist in Surrey and of his younger brother in London as southern England is invaded by Martians.", "The novel is one of the most commented-on works in the science fiction canon.", "The plot has been related to invasion literature of the time.", "The novel has been variously interpreted as a commentary on evolutionary theory, British imperialism, and generally Victorian superstitions, fears and prejudices.", "At the time of publication, it was classified as a scientific romance, like Wells' earlier novel \"The Time Machine\".", "\"The War of the Worlds\" has been both popular (having never been out of print) and influential, spawning half a dozen feature films, radio dramas, a record album, various comic book adaptations, a television series, and sequels or parallel stories by other authors." ] ], "gold": "The science fiction novel The War of the Worlds by H.G. Wells is set in the mid-1890s. The novel has been both popular and influential, spawning half a dozen feature films, radio dramas, a record album, various comic book adaptations, a number of television series and sequels. It was memorably dramatized on Sunday, October 30,1938, in a radio program directed by and starring Orson Welles that allegedly caused public panic among listeners who did not know the Martian invasion was fictional. In 1953 the first theatrical film of The War of the Worlds was produced by George Pal, directed by Byron Haskin and starred Gene Barry. This film changed the setting of the Wells novel to 1953 Southern California. In the 2005 movie adaptation of the H.G. Wells novel directed by Steven Spielberg, The War of the Worlds is set in the present day. In 2019, the BBC produced an adaptation of the Wells novel as an Edwardian period, three-episode mini-series.", "prediction 1": "The War of the Worlds is a science fiction novel by English author H. G. Wells first serialised in 1897 by Pearson's Magazine in the UK and by Cosmopolitan magazine in the US. Written between 1895 and 1897, it is one of the earliest stories to detail a conflict between mankind and an extraterrestrial race. In the 1950s a joint American-Canadian venture produced the television series War of the Worlds that ran for two seasons and was a direct sequel to George Pal's 1953 feature film. In the 1980s a joint American-Canadian venture produced the television series War of the Worlds.", "prediction 2": "The War of the Worlds is a science fiction novel by English author H. G. Wells, first serialised in 1897 by Pearson's Magazine in the UK and by Cosmopolitan magazine in the US. Written between 1895 and 1897, it is one of the earliest stories to detail a conflict between mankind and an extraterrestrial race. Written between 1895 and 1897, the novel is the first-person narrative of both an unnamed protagonist in Surrey and of his younger brother in London as southern England is invaded by Martians. In the 1980s a joint American-Canadian venture produced the television series called War of the Worlds that ran for two seasons and was a direct sequel to George Pal's 1953 feature film.", "prediction 3": "The War of the Worlds is a science fiction novel by English author H.G. Wells, first serialised in 1897 by Pearson's Magazine in the UK and by Cosmopolitan magazine in the US. Written between 1895 and 1897, it is one of the earliest stories to detail a conflict between mankind and an extraterrestrial race. In the 1950s a joint American-Canadian venture produced the television series War of the Worlds that ran for two seasons and was a direct sequel to George Pal's 1953 feature film. In the 1980s a joint American-Canadian venture produced the television series \"War of the Worlds\" that ran for two seasons and was a direct sequel to George Pal's 1953.", "prediction 4": "The War of the Worlds is a science fiction novel by English author H. G. Wells, first serialised in 1897 by \"Pearson's Magazine\" in the UK and by \"Cosmopolitan\" magazine in the US. Written between 1895 and 1897, it is one of the earliest stories to detail a conflict between mankind and an extraterrestrial race. In the 1950s, the first \"The War of the Worlds\" theatrical film produced by George Pal and directed by Byron Haskin, starring Gene Barry. In the 1980s a joint American-Canadian venture produced the television series called \"The War of the Worlds\" that ran for two seasons and was a direct sequel to George Pal's 1953 feature film. In the 1980s, a joint American-Canadian venture produced the television series called War of the Worlds that ran for two seasons and was a", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 307 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 315, "end": 320 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 487 }, { "error type": "Redundant", "explanation": "In the 1950s a joint American-Canadian venture produced the television series War of the Worlds that ran for two seasons and was a direct sequel to George Pal's 1953 feature film. ", "start": 488, "end": 584 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The War of the Worlds is a science fiction novel by English author H. G. Wells first serialised in 1897. It has been both popular and influential, spawning half a dozen feature films, radio dramas, a record album, various comic book adaptations, a television series, and sequels. In 1953 came the first \"The War of the Worlds\" theatrical film produced by George Pal and directed by Byron Haskin, starring Gene Barry. Steven Spielberg directed a 2005 film adaptation. \"The Great Martian War 1913\u20131917\" is a 2013 made-for-television science fiction film docudrama that is set in Europe during World War I. BBC announced that it will be producing in 2018 a Victorian period, three-episode mini-series adaptation of the Wells novel." }, "preference": [ 1, 1, 1, 0, 0, 1 ] }, { "question": "Red white and blue country flag with one star?", "passages": [ [ "Flag of Chile", "Flag of Chile\n\nThe flag of Chile consists of two equal horizontal bands of white and red, with a blue square the same height as the white band in the canton, which bears a white five-pointed star in the center.", "It was adopted on 18 October 1817.", "The Chilean flag is also known in Spanish as \"La Estrella Solitaria\" (\"The Lone Star\").", "It has a 3:2 ratio between length and width, it is divided horizontally into two bands of equal size (being the lower red).", "The upper area is divided once: in a square (blue), with a single centered white star; and rectangle (white), whose lengths are in proportion 1:2.", "The star may represent a guide to progress and honor while other interpretations refer to its reference to an independent state; blue symbolizes the sky and the Pacific Ocean, white is for the snow-covered Andes, and red stands for the blood spilled to achieve independence.", "According to the epic poem \"La Araucana\", the colors were derived from those from the flag flown by the Mapuche during the Arauco War.", "\"Flag Day\" is held each year on the ninth of July to commemorate the 77 soldiers who died in the 1882 Battle of La Concepci\u00f3n." ], [ "Flag of Cuba", "Flag of Cuba\n\nThe national flag of Cuba consists of five alternating stripes (three blue and two white) and a red equilateral triangle at the hoist, within which is a white five-pointed star.", "It was designed in 1849 and officially adopted May 20, 1902.", "It is one of the two flags of a currently socialist country (the other being Laos) that does not use any communist symbolism.", "After fighting for the Spanish Crown against the rebel armies of Venezuela, Narciso L\u00f3pez moved from his native Caracas to Havana, Cuba.", "His involvement in anti-colonial movements forced him into exile.", "In 1849 he moved to New York City, where he continued to advocate for an independent Cuba.", "The three blue stripes represent the three departments in which Cuba was divided at that time, the white purity of ideals, the light; the red triangle, originating from the French Revolution \u2013 and the three ideals of liberty, equality and fraternity: red for the blood and the courage; the star was the new state that should be added to the United States.", "The poet Miguel Teurbe Tol\u00f3n designed the flag alongside L\u00f3pez, based upon the story of L\u00f3pez's vision.", "Emilia Teurbe Tol\u00f3n, Miguel's wife, sewed the first flag." ], [ "Flag of Liberia", "Flag of Liberia\n\nThe Flag of Liberia or the Liberian flag bears a close resemblance to the flag of the United States, showing the freed American and ex-Caribbean slaves offspring and bloodline origins of the country.", "The Liberian flag has similar red and white stripes, as well as a blue square with a white star in the canton.", "It was adopted on July 26, 1847.", "The eleven stripes symbolize the signatories of the Liberian Declaration of Independence, red and white symbolizing courage and moral excellence.", "The white star represents the first independent western-styled republic in Africa, above the blue square representing the African continent.", "The Liberian flag is modeled after and resembles the American flag at the time in the 1820s and 1830s, (26 stars / states) because Liberia was founded, colonized, established, and controlled by freed African-American and Caribbean / West Indies slaves as settlers from the United States and the Caribbean with the help and support from the American Colonization Society (ACS), which was a private organization establishment that sent freed American and ex-Caribbean slaves as settlers from the United States and the Caribbean.", "When the freed American slaves arrived in Liberia in 1822, they identified themselves as Americo-Liberian, in which to separate themselves from the native tribal African-Liberians and other settlers." ] ], "gold": "The Liberian flag closely resembles the American flag, featuring red and white stripes and a blue square with a single white star in the canton. The Chilean flag consists of two equal horizontal bands of white and red, with a blue square the same height as the white band in the canton, which bears a white five-pointed star in the center. The Cuban flag consists of five alternating blue and white stripes and a red equilateral triangle at the hoist, within which is a white five-pointed star.", "prediction 1": "The flag of the Republic of Haiti is a red, white, and blue flag with a white star. It was adopted on 17 August 1817. The flag of the Republic of the Philippines is a blue flag with a white star in the center. The flag of the Republic of the Congo is a red and white flag with five stars. The flag of the Soviet Union's flag is a black flag with two stars.", "prediction 2": "The flag of China consists of two equal horizontal bands of white and red, with a blue square the same height as the white band in the canton, which bears a white five-pointed star in the center. The flag of Colombia has red and white stripes, as well as a blue square with a white star in the canton. The flag of Liberia has similar red and white stripes, as well as a blue square with a white star in the canton. The flag of the United States of America has 26 stars. The flag of Liberian flag bears a close resemblance to the flag of the flag of the flag of the United States, showing the freed African and ex-Caribbean slaves offspring and bloodline origins of the country.", "prediction 3": "The flag of Chile consists of two equal horizontal bands of white and red, with a blue square the same height as the white band in the canton, which bears a white five-pointed star in the center. The flag of Liberia bears a close resemblance to the flag of the United States, showing the freed American and ex-Caribbean slaves offspring and bloodline origins of the country. The flag of Liberia, known as the Liberian flag, has similar red and white stars, as the flag of the United States and the flag of the Liberian flag. The flag of Liberia bears a similar flag of the Flag of Liberia bears a blue square with a white star in the canton.", "prediction 4": "The flag of the United States of America has red, white, and blue stripes, and a blue square with a white star in the canton. The flag of the Republic of the Congo has red, white, and blue stripes, and a white star in the center. The flag of the Czech Republic has red, white, and blue stripes, as well as a blue square with a white star in the center.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 117 }, { "error type": "Unverifiable", "explanation": "", "start": 118, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 356 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Liberian flag bears a close resemblance to the flag of the United States, having similar red and white stripes, as well as a blue square with a white star in the canton. The Chilean flag consists of two equal horizontal bands of white and red, with a blue square the same height as the white band in the canton, which bears a white five-pointed star in the center. The Cuban flag consists of five alternating blue and white stripes and a red equilateral triangle at the hoist, within which is a white five-pointed star." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Where did the vegas hockey team come from?", "passages": [ [ "Vegas Golden Knights", "At the league owners' meeting on June 22, 2016, in Las Vegas, the Las Vegas expansion bid was approved by a unanimous vote, with play to begin in the 2017\u201318 NHL season.", "The team became the first major professional sports franchise to be based in Las Vegas, and the first NHL expansion team since 2000.", "Foley committed to pay the league's $500 million expansion fee and began the process of hiring the team's principal staff and determining its official identity.", "Foley announced that former Washington Capitals general manager George McPhee would be the franchise's first general manager.", "On November 22, 2016, the name was revealed as the Vegas Golden Knights.", "On March 1, 2017 (coinciding with the league's trade deadline), the team completed its expansion fee payments and filings, making it eligible to formally begin operations such as free agent acquisition, and participation in league meetings.", "Five days later, the Golden Knights made their first personnel move by signing Reid Duke to a three-year entry-level contract.", "The team announced inaugural head coach Gerard Gallant on April 13, 2017.", "Over the next two months, the Golden Knights developed their farm system, announcing affiliations with the Chicago Wolves of the American Hockey League and the Quad City Mallards of the ECHL." ], [ "Vegas Golden Knights", "Vegas Golden Knights\n\nThe Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season.", "They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL).", "The team is owned by Black Knight Sports & Entertainment, a consortium led by Bill Foley and the Maloof family.", "The team plays its home games at T-Mobile Arena on the Las Vegas Strip in Paradise, Nevada.", "The NHL has had a presence in Las Vegas since 1991; that year, the city hosted the first outdoor game between two NHL teams \u2013 a preseason exhibition between the Los Angeles Kings and New York Rangers outside Caesars Palace.", "The Kings would subsequently organize \"Frozen Fury\" \u2013 a series of annual preseason games in Las Vegas against the Colorado Avalanche.", "The NHL Awards ceremonies have been held in Las Vegas since 2009.", "In 2009, the media speculated about a plan involving Hollywood producer Jerry Bruckheimer to move the Phoenix Coyotes to Nevada.", "Rumors of a Las Vegas expansion team surfaced again in August 2014, pointing to a new indoor arena on the Strip (built as a joint venture between Anschutz Entertainment Group, owners of the Los Angeles Kings, and MGM Resorts International) as the potential home arena, although these rumors were denied by the league." ], [ "2018 Stanley Cup playoffs", "2018 Stanley Cup playoffs\n\nThe 2018 Stanley Cup playoffs was the playoff tournament of the National Hockey League (NHL).", "The playoffs began on April 11, 2018, after the 2017\u201318 regular season ended, and concluded on June 7, 2018, with the Washington Capitals winning their first Stanley Cup in franchise history defeating the Vegas Golden Knights four games to one in the Stanley Cup Finals.", "The Nashville Predators made the playoffs as the Presidents' Trophy winners with the most points (i.e. best record) during the regular season.", "The Pittsburgh Penguins increased their post-season appearance streak to twelve seasons, the current longest streak.", "The Vegas Golden Knights became the first team to make the playoffs in their inaugural season in the league since the 1979\u201380 Hartford Whalers and the Edmonton Oilers.", "They also became the first expansion team to make the playoffs in their inaugural season since the 1967 NHL expansion.", "From there, they eventually became the first team since the 1967\u201368 St. Louis Blues to win their respective conference, and reach the Stanley Cup Finals in their inaugural season.", "The only difference is that the 1967\u201368 season through to the 1969\u201370 season ensured that an expansion team would be able to reach the Stanley Cup Finals.", "For the fourth time in league history (2000, 2001, 2007), only two Original Six teams, the Boston Bruins and Toronto Maple Leafs, clinched a berth for the playoffs." ] ], "gold": "The Vegas Golden Knights joined the NHL as an expansion team in 2017 at the request of owner Bill Foley, after a season ticket drive held in 2015 to gauge local interest reached its goal of 10,000 deposits in just two months. The Golden Knights are one of the few expansion franchises to experience immediate success, reaching the Stanley Cup Finals in their first season.", "prediction 1": "The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL). They are also the first expansion team to make the playoffs in their inaugural season since the 1967 NHL expansion.", "prediction 2": "The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. They are members of the Pacific Division of the Western Conference of the National Hockey League, but originated in the Pacific Division of the NHL, where they were members of the Hartford Whalers and the Edmonton Oilers.", "prediction 3": "The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. They are members of the Pacific Division of the Western Conference of the National Hockey League. The team is owned by Black Knight Sports & Entertainment, a consortium led by Bill Foley and the Maloof family. The team came from the 1967 NHL expansion to the Pacific Division.", "prediction 4": "The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season. They are members of the Pacific Division of the Western Conference of the National Hockey League (NHL). They are owned by Black Knight Sports & Entertainment, a consortium led by Bill Foley and the Maloof family.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 247 } ], "missing-info": [], "corrected-prediction": "The Vegas Golden Knights are a professional ice hockey team based in the Las Vegas metropolitan area that began play in the 2017\u201318 NHL season." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Most tds in one game by a player?", "passages": [ [ "Comparisons between the National Football League and NCAA football", "Comparisons between the National Football League and NCAA football\n\nThe National Football League (NFL) and the National Collegiate Athletic Association (NCAA) are respectively the most popular professional and amateur football organizations in the United States.", "The National Football League was founded in 1920 and has since become the largest and most popular sport in the United States.", "The NFL has the highest average attendance of any sporting league in the world, with an average attendance of 66,960 persons per game during the 2011 NFL season.", "The NFL championship game, the Super Bowl, is among the biggest events in club sports worldwide.", "It is played between the champions of the National Football Conference (NFC) and the American Football Conference (AFC), and its winner is awarded the Vince Lombardi Trophy.", "Collegiate football ranks third in overall popularity in the United States, behind baseball and pro football.", "The NCAA, the largest collegiate organization, is divided into three Divisions: Division I, Division II and Division III.", "Division I football is further divided into two subdivisions: the Football Bowl Subdivision (FBS) and the Football Championship Subdivision (FCS).", "The champions of Division I-FCS, Division II and Division III are determined through playoff systems, and the Division I-FBS champion was determined through the Bowl Championship Series (BCS).", "Division I-FBS switched to a four-team playoff system in 2014." ], [ "Hughie O'Reilly", "Half backs place forward with clearance \n7.", "Backs meet in coming forwards \n8.", "Always mark free kicks \n9.", "Never let the ball hop \n10.", "Never turn your back on the ball \n11.", "Two kicks are greater than one \n12.", "Get in front of your opponent \n13.", "When not in possession, get into position \n14.", "Keep up pressure \n15.", "Don't hesitate to shoot inside 30 yards \n16.", "Shoot for points, goals will follow \n17.", "Move into position for pass \n18.", "Full forwards remember half forwards \n19.", "Play ball on the ground \n20.", "Go forward to meet the ball \n21.", "Kick ball before being tackled \n22.", "Always play the ball \n23.", "Avoid clashing \n24.", "Keep trying \n25.", "Remember your opponent is getting it as hard as yourself \n26.", "Keep moving all during game and take deep breaths \n27.", "Get off the ground when about to receive a knock \n28.", "Go out and win but for God's sake, play the game" ] ], "gold": "The highest number of touchdowns earned by one football player during a game is 6 for the NFL, and 11 for the NCAA. NLF players who earned 6 touchdowns in one game include Ernie Nevers in 1929, William Augustus \"Dub\" Jones in 1951, and Gale Sayers in 1965. In the National Collegiate Athletic Association, football player David Klingler set the record for earning the most touchdowns in one game.", "prediction 1": "The National Football League and the National Collegiate Athletic Association are respectively the most popular professional and amateur football organizations in the United States. The most touchdowns in one game by a player is 10.", "prediction 2": "The National Football League and the National Collegiate Athletic Association are respectively the most popular professional and amateur football organizations in the United States. The most touchdowns in one game by a player is 59.", "prediction 3": "The National Football League and the National Collegiate Athletic Association are respectively the most popular professional and amateur football organizations in the United States. The National Football League has the highest average attendance of any sporting league in the world, with an average attendance of 66,960 persons per game during the 2011 NFL season. The NCAA, the largest collegiate organization, is divided into three Divisions: Division I, Division II and Division III. The most tds in one game by a player is 108.", "prediction 4": "The National Football League (NFL) and the National Collegiate Athletic Association (NCAA) are respectively the most popular professional and amateur football organizations in the United States. In the 2011 season, Hughie O'Reilly tallied a team-high 14 tackles for loss, while Brandon Marshall tallied a team-high 22 tackles for loss.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 181 }, { "error type": "Unverifiable", "explanation": "", "start": 182, "end": 232 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Who writes the headlines to a news story?", "passages": [ [ "Headline", "Headline\n\nThe headline is the text indicating the nature of the article below it.", "The large type \"front page headline\" did not come into use until the late 19th century when increased competition between newspapers led to the use of attention-getting headlines.", "It is sometimes termed a news \"hed\", a deliberate misspelling that dates from production flow during hot type days, to notify the composing room that a written note from an editor concerned a headline and should not be set in type.", "Headlines in English often use a set of grammatical rules known as headlinese, designed to meet stringent space requirements by, for example, leaving out forms of the verb \"to be\" and choosing short verbs like \"eye\" over longer synonyms like \"consider\".", "A headline's purpose is to quickly and briefly draw attention to the story.", "It is generally written by a copy editor, but may also be written by the writer, the page layout designer, or other editors.", "The most important story on the front page above the fold may have a larger headline if the story is unusually important.", "\"The New York Times\"'s 21 July 1969 front page stated, for example, that \"MEN WALK ON MOON\", with the four words in gigantic size spread from the left to right edges of the page." ] ], "gold": "The headline of an article is the text that indicates the article's nature and its purpose is to quickly and briefly draw attention to the story. The headline of a news story is generally written by a copy editor, but when the copy editor doesn't write it, it may instead be written by the writer, the page layout designer, or other editors.", "prediction 1": "The headline is the text indicating the nature of the article below it. The large type \"front page headline\" did not come into use until the late 19th century when increased competition between newspapers led to the use of attention-getting headlines. It is sometimes termed a news \"hed\", a deliberate misspelling that dates from production flow during hot type days, to notify the composing room that a written note from an editor concerned a headline and should not be set in type.", "prediction 2": "The headline is the text indicating the nature of the article below it. It is usually written by a copy editor, but may also be written by the writer, the page layout designer, or other editors. The headlines to news stories are usually written by the writer, the page layout designer, or other editors. In magazines, the headlines are often written by the writer, the page layout designer, or other editors.", "prediction 3": "The headline is the text indicating the nature of the article below it. It is sometimes termed a news \"hed\", a deliberate misspelling that dates from production flow during hot type days, to notify the composing room that a written note from an editor concerned a headline and should not be set in type. A copy editor generally writes the headlines to a news story, but it may also be written by the writer, the page layout designer, or other editors.", "prediction 4": "The headline is the text indicating the nature of the article below it. The large type \"front page headline\" did not come into use until the late 19th century when increased competition between newspapers led to the use of attention-getting headlines. A headline's purpose is to quickly and briefly draw attention to the story. It is generally written by a copy editor, but may also be written by the writer, the page layout designer, or other editors.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 483 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The headline is the text indicating the nature of the article below it, and its purpose is to quickly and briefly draw attention to the story. It is generally written by a copy editor, but may also be written by the writer, the page layout designer, or other editors." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who is the parent company of dunkin donuts?", "passages": [ [ "Dunkin' Brands", "Dunkin' Brands\n\nDunkin' Brands Group, Inc. is an American restaurant holding company which runs two chains of fast-food restaurants: Dunkin' Donuts and Baskin-Robbins.", "It is headquartered in Canton, Massachusetts.", "In 1973, British food company J. Lyons and Co. purchased Baskin-Robbins from United Brands.", "J. Lyons and Co. then merged with Allied Breweries, becoming Allied-Lyons in 1978.", "Allied-Lyons acquired Dunkin' Donuts in 1990.", "The same year, Allied-Lyons acquired Mister Donut.", "In 1994, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq.", "The restaurant operations were merged under a subsidiary named Allied Domecq Quick Service Restaurants.", "In 1997, Togo's was acquired by Allied Domecq.", "In 2004, Allied Domecq Quick Service Restaurants was renamed Dunkin' Brands, Inc..\n\n", "On December 12, 2005, Pernod Ricard, which had just taken control of Allied Domecq, announced the sale of Dunkin' Brands to a consortium of private equity firms consisting of Bain Capital, The Carlyle Group and Thomas H. Lee Partners for $2.425 billion in cash.", "Dunkin' Brands, Inc. was renamed Dunkin' Brands Group, Inc. after the transaction." ], [ "Allied Domecq", "Allied Domecq\n\nAllied Domecq PLC was an international company, headquartered in Bristol, United Kingdom, that operated spirits, wine, and quick service restaurant businesses.", "It was once a FTSE 100 Index constituent but has been acquired by Pernod Ricard.", "Allied Domecq was the result of a 1994 merger between Allied Lyons and", "Pedro Domecq S.A.", "Allied Lyons itself was the result of a 1978 merger between Allied Breweries and the food and catering group J. Lyons and Co.", "In early 2005, a takeover bid for the company was launched by French-based rival Pernod Ricard S.A. Pernod Ricard successfully completed acquisition on 26 July 2005 and sold off the overlapping spirits brands to U.S.-based competitor Fortune Brands and British-based multinational Diageo.", "On 12 December 2005, Pernod Ricard announced that it had agreed to sell the restaurant businesses (Dunkin' Brands) to a consortium of three US private equity firms (Thomas H. Lee Partners, the Carlyle Group and Bain Capital LLP) for $2.43 billion.", "The closing of the sale occurred on 1 March 2006.", "Allied Domecq's spirits division operated a combination of nine core global brands, plus a selection of local market leaders.", "Their product portfolio included:\n\n\nBrands acquired by Fortune Brands:" ] ], "gold": "Dunkin' Donuts LLC is an American multinational coffee and doughnut company, as well as a quick service restaurant, that was founded by William Rosenberg in Quincy, Massachusetts, in 1950. In 1990, the chain was acquired by Baskin-Robbins's holding company Allied Lyons, which was involved in a merger with Pedro Domecq and later became known as Allied Domecq. Under the parent company Allied Lyons, the Mister Donut chain was acquired and the conversion of that chain to Dunkin Donuts facilitated the brand's growth in North America. Dunkin and Baskin-Robbins eventually became subsidiaries of parent company Dunkin Brands in 2004, until being purchased by Inspire Brands on December 15, 2020. ", "prediction 1": "Dunkin' Brands Group, Inc. is an American restaurant holding company which runs two chains of fast-food restaurants: Dunkin' Donuts and Baskin-Robbins. In 1973, British food company J. Lyons and Co. purchased Baskin-Robbins from United Brands. J. Lyons and Co. then merged with Allied Breweries, becoming Allied-Lyons in 1978. In 1994, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq. The restaurant operations were merged under a subsidiary, Allied Domecq Quick Service Restaurants. In 1997, Togo's was acquired by Allied Domecq.", "prediction 2": "Dunkin' Brands Group, Inc. is an American restaurant holding company which runs two chains of fast-food restaurants: Dunkin' Donuts and Baskin-Robbins. In 1973, British food company J. Lyons and Co. purchased Baskin-Robbins from United Brands. J. Lyons and Co. then merged with Allied Breweries, becoming Allied-Lyons in 1978. In 1994, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq. In 1997, Togo's was acquired by Allied Domecq.", "prediction 3": "In 1973, British food company J. Lyons and Co. purchased Baskin-Robbins from United Brands. J. Lyons and Co. then merged with Allied Breweries, becoming Allied-Lyons in 1978. In 1994, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq. The restaurant operations were merged under a subsidiary named Allied Domecq Quick Service Restaurants. In 2004, Allied Domecq was renamed Dunkin' Brands Group, Inc.", "prediction 4": "Dunkin' Brands Group, Inc. is an American restaurant holding company which runs two chains of fast food restaurants, Dunkin' Donuts and Baskin-Robbins. In 1973, British food company J. Lyons and Co. purchased Baskin-Robbins from United Brands. In 1990, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq. In 1997, Togo's was acquired by Allied Domecq. In 2004, Allied Domecq Quick Service Restaurants was renamed Dunkin' Brands Group, Inc.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 549 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Dunkin' Brands Group, Inc. is an American restaurant holding company which runs two chains of fast-food restaurants: Dunkin' Donuts and Baskin-Robbins. Allied-Lyons acquired Dunkin' Donuts in 1990. In 1994, Allied-Lyons merged with Pedro Domecq S.A., becoming Allied Domecq. The restaurant operations were merged under a subsidiary, Allied Domecq Quick Service Restaurants. In 2004, Allied Domecq Quick Service Restaurants was renamed Dunkin' Brands, Inc. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When did the book of acts take place?", "passages": [ [ "Acts of the Apostles", "He was educated, a man of means, probably urban, and someone who respected manual work, although not a worker himself; this is significant, because more high-brow writers of the time looked down on the artisans and small business people who made up the early church of Paul and were presumably Luke's audience.", "While no proposed date for the composition of Acts is universally accepted, the most common scholarly position is to date Luke\u2013Acts to 80-90 AD, on the grounds that it uses Mark as a source, looks back on the destruction of Jerusalem, and does not show any awareness of the letters of Paul (which began circulating late in the first century).", "The earliest possible date for the composition of Acts is set by the events with which it ends, Paul's imprisonment in Rome c.63 AD, but such an early dating is a minority position.", "The last possible date would be set by its first definite citation by another author, but there is no unanimity on this; some scholars find echoes of Acts in a work from c. 95 AD called I Clement, while others see no indisputable citation until the middle of the 2nd century.", "A minority of scholars, necessarily in the latter camp, conclude that Acts dates to the 2nd century, believing that it shows awareness of the letters of Paul, the works of Josephus, or the writings of Marcion." ], [ "Acts of the Apostles", "Acts of the Apostles\n\nActs of the Apostles (, \"Pr\u00e1xeis t\u00f4n Apost\u00f3l\u014dn\"; ), often referred to simply as Acts, is the fifth book of the New Testament; it tells of the founding of the Christian church and the spread of its message to the Roman Empire.", "Acts and the Gospel of Luke make up a two-part work, Luke\u2013Acts, by the same anonymous author, usually dated to around 80\u201390 AD.", "The first part, the Gospel of Luke, tells how God fulfilled his plan for the world's salvation through the life, death, and resurrection of Jesus of Nazareth, the promised Messiah.", "Acts continues the story of Christianity in the 1st century, beginning with Jesus's ascension to Heaven.", "The early chapters, set in Jerusalem, describe the Day of Pentecost (the coming of the Holy Spirit) and the growth of the church in Jerusalem.", "Initially, the Jews are receptive to the Christian message, but soon they turn against the followers of Jesus.", "Rejected by the Jews, under the guidance of the Apostle Peter the message is taken to the Gentiles.", "The later chapters tell of Paul's conversion, his mission in Asia Minor and the Aegean, and finally his imprisonment in Rome, where, as the book ends, he awaits trial." ] ], "gold": "The Book of Acts, also known as The Acts of the Apostles or simply Acts, took place in 80-90 AD according to most scholars. This theory is based on the grounds that Acts uses Mark as a source, looks back on the destruction of Jerusalem, and does not show any awareness of the letters of Paul, which began circulating late in the first century. The earliest possible date for the composition of Acts is set by the events with which it ends, Paul's imprisonment in Rome c. 63 AD, but such an early dating is a minority position.", "prediction 1": "Acts of the Apostles tells the story of the founding of the Christian church and the spread of its message to the Roman Empire. The book takes place around 63 AD when Paul was imprisoned in Rome.", "prediction 2": "Acts of the Apostles tells of the founding of the Christian church and the spread of its message to the Roman Empire. It is the fifth book of the New Testament, telling of the story of Christianity in the 1st century, beginning with Jesus's ascension to Heaven. Acts and the Gospel of Luke make up a two-part work, Luke\u2013Acts, by the same anonymous author, usually dated to around 80\u201390 AD.", "prediction 3": "Acts of the Apostles is often referred to simply as Acts, and is the fifth book of the New Testament. It tells of the founding of the Christian church and the spread of its message to the Roman Empire. The book is set in Jerusalem during the first year of the first century, beginning with Jesus's ascension to Heaven. The book is set in Asia Minor and the Aegean, with chapters set in Asia Minor.", "prediction 4": "Acts of the Apostles is the fifth book of the New Testament, telling of the founding of the Christian church and the spread of its message to the Roman Empire. The book's beginnings are in Jerusalem, as the Jewish community was welcoming the message of Jesus. The book's events are centered around Paul's imprisonment in Rome in 63 AD.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 127 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 132, "end": 155 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "While no proposed date for the composition of Acts is universally accepted, the most common scholarly position is to date Luke\u2013Acts to 80-90 AD, on the grounds that it uses Mark as a source, looks back on the destruction of Jerusalem, and does not show any awareness of the letters of Paul (which began circulating late in the first century). The earliest possible date for the composition of Acts is set by the events with which it ends, Paul's imprisonment in Rome c.63 AD, but such an early dating is a minority position. The last possible date would be set by its first definite citation by another author, but there is no unanimity on this; some scholars find echoes of Acts in a work from c. 95 AD called I Clement, while others see no indisputable citation until the middle of the 2nd century." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who appoints the chairman of the finance commission?", "passages": [ [ "Finance Commission", "Finance Commission\n\nThe First Finance Commission (IAST: \"Vitta \u0100yoga\") was established by the President of India in 1951 under \"Article 280\" of the Indian Constitution.", "It was formed to define the financial relations between the central government of India and the individual state governments.", "The Finance Commission (Miscellaneous Provisions) Act, 1951 additionally defines the terms of qualification, appointment and disqualification, the term, eligibility and powers of the Finance Commission.", "As per the Constitution, the Commission is appointed every five years and consists of a chairman and four other members.", "Since the institution of the First Finance Commission, stark changes in the macroeconomic situation of the Indian economy have led to major changes in the Finance Commission's recommendations over the years.", "There have been fifteen commissions to date.", "The most recent was constituted in 2017 and is chaired by N. K.Singh, a former member of the Planning Commission.", "As a federal nation, India suffers from both vertical and horizontal fiscal imbalances.", "Vertical imbalances between the central and state governments result from states incurring expenditures disproportionate to their sources of revenue, in the process of fulfilling their responsibilities.", "However, states are better able to gauge the needs and concerns of their inhabitants and therefore more efficient at addressing them.", "Horizontal imbalances among state governments result from differing historical backgrounds or resource endowments, and can widen over time." ], [ "2017 Indian presidential election", "2017 Indian presidential election\n\nA presidential election was held in India on 17 July 2017 with the votes counted and the results announced on 20 July 2017.", "Ram Nath Kovind became 14th President of India.", "President Pranab Mukherjee, whose term of office was due to expire on 24 July 2017, declined to seek re-election due to health concerns.", "Governor of Bihar Ram Nath Kovind of the Bharatiya Janata Party had the backing of the governing National Democratic Alliance coalition, and went up against opposition candidate Meira Kumar of the Indian National Congress in the vote.", "Kovind secured roughly two thirds of the votes from the electoral college of elected members of federal, state and union territory legislatures and was elected to a five-year term as President.", "Kovind's term of office began on 25 July 2017.", "There was initial speculation that the incumbent, Pranab Mukherjee, would seek re-election.", "However, he decided not to run again in 2017, meaning that his term in office ended on 24 July 2017.", "The President of India is indirectly elected by an electoral college consisting of the elected members of both houses of parliament, the elected members of the Legislative assemblies of the 29 states and the elected members of the legislative assemblies of the Union Territories of Delhi and Puducherry.", "As of 2017, the electoral college comprises 777 MPs and 4,120 MLAs." ], [ "President of India", "The Indian parliament has enacted the law\u2014\"The President (Discharge of Functions) Act, 1969\" \u2014 for the discharge of the functions of the president when vacancies occur in the offices of the president and of the vice-president simultaneously, owing to removal, death, resignation of the incumbent or otherwise.", "In such an eventuality, the chief justice\u2014or in his absence, the senior most judge of the Supreme Court of India available\u2014discharges the functions of the president until a newly elected President enters upon his office or a newly elected Vice-president begins to act as President under Article 65 of the constitution, whichever is the earlier.", "For example, in 1969, when President Zakir Husain died in Office, Vice-President V. V. Giri served as the acting President of India.", "However, later, V.V Giri resigned from both posts (Acting President of India and Vice-President of India) as he became a candidate in the 1969 Presidential election in India.", "In this event, the then Chief Justice of India, Justice Mohammad Hidayatullah served as the acting President of India until the next President was elected.", "The President's role as defender of the constitution and the powers as Head of State, especially in relation to those exercised by the prime minister as leader of the government, have changed over time." ] ], "gold": "The Finance Commissions are commissions periodically constituted by the President of India under Article 280 of the Indian Constitution to define the financial relations between the central government of India and the individual state governments. From 2007 to 2012, President Pratibha Devisingh Patil appointed the Chairman of the Finance Commission. From 2012 to 2017, President Pranab Mukherjee appointed the Chairman of the Finance Commission. After 2017, President Ram Nath Kovind appointed the Chairman of the Finance Commission.", "prediction 1": "President of India appoints the chairman of the Finance Commission, which is a constitutional body created by Article 280 of the Indian Constitution. The Chairman of the First Finance Commission was appointed by the President of India in 1951. The most recent Finance Commission, constituted in 2017 by N. K. Singh, is chaired by the Chief Justice of India, Justice Mohammad Hidayatullah. The finance commission was established to define the financial relations between the central government of India and the individual state governments.", "prediction 2": "The first finance commission was established by the president of India in 1951 under Article 280 of the Indian Constitution and was formed to define the financial relations between the central government of India and the individual state governments. The Finance Commission (Miscellaneous Provisions) Act, 1951 additionally defines the terms of qualification, appointment and disqualification, the term, eligibility and powers of the Finance Commission. Since the institution of the First Finance Commission, stark changes in the macroeconomic situation of the Indian economy have led to major changes in the Finance Commission's recommendations over the years. The most recent was constituted in 2017 and is chaired by N. K.Singh, a former member of the Planning Commission.", "prediction 3": "The finance commission is an executive committee that is created by the Indian constitution and appointed in accordance with the law. In the Indian Constitution, the president appoints the chairman of the commission. There have been fifteen commissions to date. The most recent was constituted in 2017 and is chaired by N. K. Singh. In the Indian Constitution, the president appoints the chairman of the commission.", "prediction 4": "The Finance Commission is an executive body of the Indian government, created by Article 280 of the Indian Constitution and set up to define the financial relations between the central government of India and the individual state governments. The Chairman of the Commission is appointed by the President, who, in turn, appoints the four other members. Since the institution of the First Finance Commission, stark changes in the macroeconomic situation of the Indian economy have led to major changes in the Commission's recommendations over the years. In 2017, the most recent commission was constituted and was chaired by N. K. Singh, a former member of the Planning Commission.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 67 }, { "error type": "Unverifiable", "explanation": "", "start": 150, "end": 243 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 316, "end": 388 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The finance commission is a constitutional body created by Article 280 of the Indian Constitution. The finance commission was established to define the financial relations between the central government of India and the individual state governments. The most recent Finance Commission, constituted in 2017 chaired by N. K. Singh. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sings standing in the hall of fame?", "passages": [ [ "Hall of Fame (song)", "Hall of Fame (song)\n\n\"Hall of Fame\" is a song by Irish pop rock band The Script.", "It is the lead single from their third studio album \"#3\".", "The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "The track was given its first radio play on Capital on 23 July 2012.", "Written and co-produced by the band, the song is about following dreams and making an impact on the world.", "The song has been licensed for use in various media since its release.", "The Script frontman Danny O'Donoghue first met will.i.am while they were both judges for \"The Voice UK\".", "O'Donoghue told: \"I played Will a few demos backstage early on in \"The Voice\".", "We got to Hall Of Fame and he immediately asked if he could have it for his new album, as it was exactly what he was looking for.", "I wasn\u2019t having it, it was our lead single", "but I asked if he\u2019d be on it.", "He agreed and we booked in time to record it.", "The problem is, he\u2019s either late or completely flakes, so it took four attempts to get to record his part.", "Eventually we put it together in his hotel room in 15 minutes.", "It\u2019s a classic duet, I do one line and he responds.\"" ] ], "gold": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album, \"#3\". The song features American hip-hop artist will.i.am of The Black Eyed Peas. The Script's frontman Danny O'Donoghue first met will.i.am while they were both judges for The Voice UK. O'Donoghue said, \"We went to the recording studio and an hour and a half later we had the song in its entirety.\"", "prediction 1": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album #3. The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "prediction 2": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album \"#3\". The track features American hip-hop artist will.i.am of The Black Eyed Peas. The Script frontman Danny O'Donoghue first met will.i.am while they were both judges for \"The Voice UK\".", "prediction 3": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album \"#3. It features American hip-hop artist will.i.am of The Black Eyed Peas. The song was given its first radio play on Capital on 23 July 2012. Written and co-produced by the band, the song is about following dreams and making an impact on the world.", "prediction 4": "\"Hall of Fame\" is a song by Irish pop rock band The Script, which is the lead single from their third studio album #3. The track features American hip-hop artist will.i.am of The Black Eyed Peas. The Script frontman Danny O'Donoghue first met will.i.am while they were both judges for \"The Voice UK\".", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album #3. The track features American hip-hop artist will.i.am of The Black Eyed Peas. The Script frontman Danny O'Donoghue first met will.i.am while they were both judges for \"The Voice UK\". O'Donoghue told: \"I played Will a few demos backstage early on in \"The Voice\"." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who won the battle of siege of leningrad?", "passages": [ [ "Siege of Leningrad", "A number of factories, schools, hospitals and other civil infrastructure were destroyed by air raids and long range artillery bombardment.", "The 872 days of the siege caused extreme famine in the Leningrad region through disruption of utilities, water, energy and food supplies.", "This resulted in the deaths of up to 1,500,000 soldiers and civilians and the evacuation of 1,400,000 more (mainly women and children), many of whom died during evacuation due to starvation and bombardment.", "Piskaryovskoye Memorial Cemetery alone in Leningrad holds half a million civilian victims of the siege.", "Economic destruction and human losses in Leningrad on both sides exceeded those of the Battle of Stalingrad, the Battle of Moscow, or the bombing of Tokyo.", "The siege of Leningrad ranks as the most lethal siege in world history, and some historians speak of the siege operations in terms of genocide, as a \"racially motivated starvation policy\" that became an integral part of the unprecedented German war of extermination against populations of the Soviet Union generally.", "Civilians in the city suffered from extreme starvation, especially in the winter of 1941\u201342.", "From November 1941 to February 1942 the only food available to the citizen was 125\u00a0grams of bread per day, of which 50\u201360% consisted of sawdust and other inedible admixtures." ], [ "Siege of Leningrad", "Siege of Leningrad\n\nThe Siege of Leningrad (\u0411\u043b\u043e\u043a\u0430\u0434\u0430 \u041b\u0435\u043d\u0438\u043d\u0433\u0440\u0430\u0434\u0430) was a prolonged military blockade undertaken from the south by the Army Group North of Nazi Germany against the Russian city of Leningrad (St. Petersburg) on the Eastern Front in World War II.", "The Finnish army invaded from the north, co-operating with the Germans until they had recaptured territory lost in the recent Winter War, but refused to make further approaches to the city.", "The siege started on 8 September 1941, when the last road to the city was severed.", "Although the Soviet forces managed to open a narrow land corridor to the city on 18 January 1943, the siege was not lifted until 27 January 1944, 872 days after it began.", "It was one of the longest and most destructive sieges in history, and possibly the costliest in casualties suffered.", "Some historians classify it as genocide.", "Leningrad's capture was one of three strategic goals in the German Operation Barbarossa and the main target of Army Group North.", "The strategy was motivated by Leningrad's political status as the former capital of Russia and the symbolic capital of the Russian Revolution, its military importance as a main base of the Soviet Baltic Fleet, and its industrial strength, housing numerous arms factories.", "By 1939, the city was responsible for 11% of all Soviet industrial output." ], [ "City of Military Glory", "It was lost to the Soviet Union after the Winter War according to Moscow Peace Treaty.", "In late August, Finland regained Vyborg essentially without a fight.", "On June 20, 1944, troops led by Marshal Leonid Govorov, as part of the Vyborg\u2013Petrozavodsk Offensive broke through the Mannerheim Line, and Vyborg was captured by the Soviet Union again.", "As a result of the offensive, the Moscow Armistice was signed between Finland and the Soviet Union, and ended hostilities between the two nations.", "Vyborg remained with Soviet Union.", "Some 23,500 Soviet troops lost their lives in the attack for Vyborg.", "Vyborg was conferred the status of \u201cCity of Military Glory\u201d by the President of the Russian Federation Dmitriy Anatolyevich Medvedev on March 25, 2010, for \u201ccourage, endurance and mass heroism, exhibited by defenders of the city in the struggle for the freedom and independence of the Motherland\u201d.", "A ceremony was held in the Moscow Kremlin on 4 May 2010 at which the city was represented by the Head of the Administration of Vyborgsky District Konstantin Patrayev." ] ], "gold": "Though the siege of Leningrad lasted for 872 days and caused extreme famine in the Leningrad region, it was ultimately a victory for the Soviet Union against the Nazi German army on the Eastern Front in World War II. Soviet Army commanders and leaders who broke the siege on January 27, 1944 include Kliment Voroshilov, Ivan Fedyuninsky, Kirill Meretskov, Georgy Zhukov, Markian Popov, Leonid Govorov, and Mikhail Khozin. The siege was one of the costliest in history due to the number of casualties suffered, and is classified a genocide by some historians.", "prediction 1": "The Battle of Siege of Leningrad was a prolonged military blockade undertaken from the south by the Army Group North of Nazi Germany against the Russian city of Leningrad on the Eastern Front in World War II. Although the Soviet forces managed to open a narrow land corridor to the city on 18 January 1943, the siege was not lifted until 27 January 1944, 872 days after it began. The Soviet Union won the battle of siege of leningrad after the Winter War according to the Moscow Armistice.\n", "prediction 2": "The Siege of Leningrad was a prolonged military blockade undertaken from the south by the Army Group North of Nazi Germany against the Russian city of Leningrad (St. Petersburg) on the Eastern Front in World War II. The Finnish army invaded from the north, co-operating with the Germans until they had recaptured territory lost in the recent Winter War, but refused to make further approaches to the city. On June 20, 1944, troops led by Marshal Leonid Govorov, as part of the Vyborg Offensive broke through the Mannerheim Line, and Vyborg was captured by the Soviet Union again.", "prediction 3": "The battle of Siege of Leningrad was a military blockade undertaken from the south by the Army Group North of Nazi Germany against the Russian city of Leningrad on the Eastern Front in World War II. While Finland was part of the army engaged in the siege, the Soviet Union was defeated, and Leningrad was retaken by Finland in April 1944.", "prediction 4": "The Battle of Siege of Leningrad was a prolonged military blockade undertaken from the south by the Army Group North of Nazi Germany against the Russian city of Leningrad (St. Petersburg) on the Eastern Front in World War II. Although the Soviet forces managed to open a narrow land corridor to the city on 18 January 1943, the siege was not lifted until 27 January 1944, 872 days after it began. In late August, Finland regained Vyborg essentially without a fight. On June 20, 1944, as part of the Vyborg Offensive broke through the Mannerheim Line, and Vyborg was captured by the Soviet Union again.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 306 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 479, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 78, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 170 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Battle of Siege of Leningrad was a prolonged military blockade undertaken by the Army Group North of Nazi Germany on the Eastern Front in World War II. The siege was not lifted until 27 January 1944, 872 days after it began. The Soviet Union won the battle of siege of leningrad after the Winter War according to the Moscow Peace Treaty. The siege caused extreme famine in the Leningrad region. It was possibly the costliest in casualties suffered in history, and is classified a genocide by some historians.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the new name of the czech republic?", "passages": [ [ "Name of the Czech Republic", "Name of the Czech Republic\n\nThe Czech Republic's official formal and short names at the United Nations are and in Czech, and the Czech Republic and Czechia in English.", "All these names derive from the name of the Czechs, the West Slavic ethnic group native to the Czech lands.", "\"Czechia\" (), the official English short name specified by the Czech government, is used by many international organisations and attested as early as 1841.", "However, most English speakers use \"[the] Czech Republic\" in all contexts.", "Other languages generally have greater official use of a short form analogous to \"\u010cesko\" or \"Czechia\" (such as French , or Korean /\"Cheko\") although forms equivalent to \"Czech Republic\" are not uncommon.", "The Czech name is from the same root but means Bohemia, the westernmost and largest historical region of the Czech lands and the modern Czech Republic.", "The name \"Bohemia\" is an exonym derived from the Boii, a Celtic tribe inhabiting the area before the early Slavs arrived.", "The Lands of the Bohemian Crown (1348\u20131918) were part of the Holy Roman Empire; often called \"the Czech lands\", they sometimes extended further, to all of Silesia, Lusatia, and various smaller territories.", "The Czech adjective means both \"Czech\" and \"Bohemian\"." ] ], "gold": "The Czech Republic's official formal and short names at the United Nations are \u010cesk\u00e1 republika and \u010cesko in Czech, and the Czech Republic and Czechia in English. All these names derive from the name of the Czechs, the West Slavic ethnic group native to the Czech lands. Czechia, the official English short name specified by the Czech government, is used by many international organizations and attested as early as 1841. However, most English speakers use Czech Republic in all contexts.", "prediction 1": "The Czech Republic's official formal and short names at the United Nations are and in Czech. The Czech Republic's new name is Czechia, which comes from the Czech word \"esko\".", "prediction 2": "The new name of the Czech Republic is esk\u00e9 Budjovice, which was adopted in 1915.", "prediction 3": "The new name of the Czech Republic started being used on August 25, 1871. The new name was changed to Czechia on June 2, 1863.", "prediction 4": "The Czech Republic has had several names. The Czech Republic's official formal and short names at the United Nations are and in Czech, and the Czech Republic and Czechia in English. All these names derive from the name of the Czechs, the West Slavic ethnic group native to the Czech lands. The original name of the country was Czechoslovakia, but the name was changed to Czechia after 1841.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 93, "end": 174 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Czech Republic's official formal and short names at the United Nations are and in Czech, and the Czech Republic and Czechia in English. All these names derive from the name of the Czechs, the West Slavic ethnic group native to the Czech lands. Czechia, the official English short name specified by the Czech government, is used by many international organizations and attested as early as 1841. However, most English speakers use Czech Republic in all contexts. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Where does the seine river start and end?", "passages": [ [ "Lac des Mille Lacs", "Lac des Mille Lacs\n\nLac des Mille Lacs is a lake in the western part of Thunder Bay District in northwestern Ontario, Canada.", "It is in the Nelson River drainage basin and is the source of the Seine River.", "The lake lies between Ontario Highway 17 on the north and Ontario Highway 11 on the south about west of the city of Thunder Bay.", "Lac des Mille Lacs has an area of and a drainage basin of .", "The named inflows are the Savanne River and McKay Creek at Sawmill Bay at the northeast, Joe's Creek at Baril Bay at the southwest, and Inwood Creek at the north.", "The only outflow, at the northwest tip of the lake, is the Seine River, which flows to Rainy Lake and eventually via the Nelson River to Hudson Bay.", "The lake has numerous arms, named bays and named islands.", "The lake is served by Lac des Mille Lacs Road, which connects the lake to Highway 17 near Upsala.", "The outflow to the Seine River is controlled by the Lac des Mille Lacs Dam, owned by the Ontario Ministry of Natural Resources (OMNR) and operated by the Valerie Falls Limited Partnership (Brookfield Renewable Power)." ], [ "Rainy Lake", "Rainy Lake\n\nRainy Lake (French: \"lac \u00e0 la Pluie\"; Ojibwe: \"gojiji-zaaga'igan\") is a relatively large freshwater lake () straddling the border between the United States and Canada.", "The Rainy River issues from the west side of the lake and is harnessed to make hydroelectricity for US and Canadian locations.", "The sister cities of International Falls, Minnesota, and Fort Frances, Ontario, are situated on either side of the outflow of the river from the lake.", "Rainy Lake and Rainy River establish part of the boundary between the US state of Minnesota and the Canadian province of Ontario.", "Voyageurs National Park is located on the southeastern corner of the lake, where it connects with Kabetogama and Namakan Lakes at Kettle Falls.", "Rainy Lake is part of an extremely large system of lakes forming the Hudson Bay drainage basin that stretches from west of Lake Superior north to the Arctic Ocean.", "The Rainy Lake watershed includes the Boundary Waters Canoe Area Wilderness (BWCA), portions of the Superior National Forest on the US side of the border, and the Quetico Provincial Park on the Canadian side of the border.", "For exploration and fur trade history see Winnipeg River and additional references below." ] ], "gold": "The Seine River starts at Lac des Mille Lacs and ends at Rainy Lake. The source of the Seine River, Lac des Mille Lacs is a lake in the western part of the Thunder Bay District in northwestern Ontario, Canada. This lake lies between Ontario Highway 17 on the north and Ontario Highway 11 on the south. Rainy Lake, at the end of the Seine River, is a freshwater lake with a surface area of 360 square miles. This lake straddles the border between the United States and Canada. Rainy Lake and Rainy River establish part of the boundary between the US state of Minnesota and the Canadian province of Ontario.", "prediction 1": "The Seine River begins and ends in Lac des Mille Lacs, Ontario, Canada. It is in the Nelson River drainage basin and is the source of the Seine River. The Seine River flows to Rainy Lake, a relatively large freshwater lake straddling the border between the United States and Canada.", "prediction 2": "La Seine River starts and ends in the northwestern part of Thunder Bay District, Ontario, Canada, where it flows into the Nelson River drainage basin. The lake that is the source of the Seine River is Lac des Mille Lacs. The river flows into Rainy Lake, Minnesota, where it is harnessed to make hydroelectricity for US and Canadian locations.", "prediction 3": "The Seine River originates in the Nelson River drainage basin and flows to Rainy Lake, Minnesota, and eventually via the Nelson River to Hudson Bay.", "prediction 4": "The Seine River originates and ends at Lac des Mille Lacs, a lake in the western part of Thunder Bay District in northwestern Ontario, Canada. The lake lies between Ontario Highway 17 on the north and Ontario Highway 11 on the south about west of the city of Thunder Bay. The Seine River flows to the west of Rainy Lake and eventually via the Nelson River to Hudson Bay. The River originates at the northwest tip of Rainy Lake, while the Seine River ends at Lake Ontario.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 27, "end": 31 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 72, "end": 77 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Seine River begins in Lac des Mille Lacs, Ontario, Canada and ends at the Rainy Lake, eventually the Hudson Bay by the Nelson River. It is a lake in the western part of Thunder Bay District in northwestern Ontario, Canada and is in the Nelson River drainage basin and is the source of the Seine River. The lake lies between Ontario Highway 17 on the north and Ontario Highway 11 on the south. Rainy Lake isa relatively large freshwater lake straddling the border between the United States and Canada. Rainy Lake and Rainy River establish part of the boundary between the US state of Minnesota and the Canadian province of Ontario." }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "When do new episodes of ever after high come out?", "passages": [ [ "Ever After High", "In October 2013, Mattel launched \"Ever After High\" globally, reaching 14 countries, with plans to reach 30 territories in 2014.", "Six fashion dolls were initially released, and related social media such as a website, YouTube channel, global Facebook, and an interactive music video directed by Wayne Isham.", "\"Ever After High\" has a series of animated shorts on YouTube.", "In June 2014, Netflix announced it was developing a series of episodes based on the webisodes - which was released on February 6, 2015.", "The theme song was composed by Gabriel Mann and Allison Bloom, and was performed by Keeley Bumford.", "A live-action music video was released on October 15, 2013, featuring Stevie Dore as a high school senior and four younger girls dancing at a campus.", "Little, Brown Books for Young Readers (LBYR) has developed a book series for \"Ever After High\".", "The company had worked on the \"Monster High\" book series, which had sold over two million copies.", "LBYR vice-president Erin Stein said in an interview for \"Publishers Weekly\" that when he was first exposed to the \"Ever After High\" franchise, \"immediately dozens of ideas were spinning in our heads...How could we resist publishing this?", "It was a no-brainer.\"" ], [ "The Ranch (TV series)", "The Ranch (TV series)\n\n", "The Ranch is an American sitcom web television series starring Ashton Kutcher, Danny Masterson, Debra Winger, Elisha Cuthbert, and Sam Elliott that debuted in 2016 on Netflix.", "The show takes place on the fictional Iron River Ranch in the fictitious small town of Garrison, Colorado; detailing the life of the Bennetts, a dysfunctional family consisting of two brothers, their rancher father, and his divorced wife and local bar owner.", "While the opening sequence shows scenes from Norwood and Ouray, Colorado and surrounding Ouray and San Miguel Counties, \"The Ranch\" is filmed on a sound stage in front of a live audience in Burbank, California.", "Each season consists of 20 episodes broken up into two parts, each containing 10 episodes.", "All episodes are named after American country music songs, predominantly Kenny Chesney in part one, George Strait in part two, Tim McGraw in part three, Garth Brooks in part four, Dolly Parton in part five, and Alabama in part six.", "The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016.", "In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017, and the second half was released on December 15, 2017." ], [ "Van Helsing (TV series)", "In Season Three, Vanessa and Scarlett begin hunting the Elders, the original vampires, in order to defeat them for good.", "Syfy acquired \"Van Helsing\" from Nomadic Pictures in November 2015, with a 13-episode order beginning production in January 2016, and a series premiere scheduled for Fall 2016.", "On October 14, 2016, Syfy renewed \"Van Helsing\" for a 13-episode second season, which premiered on October 5, 2017.", "On December 19, 2017, Syfy renewed \"Van Helsing\" for a 13-episode third season.", "It was revealed during San Diego Comic-Con 2017 that series star Kelly Overton was pregnant during the production of the second season of \"Van Helsing\".", "Syfy aired a commercial-free preview of the pilot on July 31, 2016; this was followed by the series premiere on September 23, 2016.", "The series was originally slated to premiere in Canada on Super Channel, but because of Super Channel's ongoing bankruptcy proceedings, the series was ultimately dropped from their schedule and instead premiered on Netflix on December 23, 2016.", "The series' pilot episode received 4.5 stars from \"Den of Geek\"." ] ], "gold": "The Ever After High doll franchise has spawned a web series whose episodes were released on their website and YouTube. Episode 66 of Ever After High came out on September 9, 2016. Episode 67 was released on September 23, 2016 and episode 68 was released on October 7, 2016.", "prediction 1": "Ever After High is an American sitcom web television series that premiered on Netflix on February 6, 2015. The first ten episodes of the series premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016.", "prediction 2": "Ever After High comes out in two different seasons. The first ten episodes of the first season were released on April 1, 2016, the second batch of ten arrived on October 7, 2016. The Ranch is a sitcom web television series starring Ashton Kutcher, Danny Masterson, Debra Winger, Elisha Cuthbert, and Sam Elliott that debuted in 2016 on Netflix.", "prediction 3": "Ever After High comes out in two different seasons. The first ten episodes of the first season premiered on April 1, 2016. The second batch of ten episodes premiered on October 7, 2016. The second half of the second season premiered on June 16, 2017 and the third half on December 15, 2017.", "prediction 4": "Ever After High is an American web television series that debuted in 2016 on Netflix. Each season consists of 20 episodes broken up into two parts, each containing 10 episodes. The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016. The first ten episodes of the 2016 season premiered on April 1, 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 107, "end": 234 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 0, "end": 106 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Ever After High doll franchise were initially released, and related social media such as a website and YouTube channel." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who did the cleveland browns beat last year?", "passages": [ [ "2017 Cleveland Browns season", "2017 Cleveland Browns season\n\nThe 2017 season was the Cleveland Browns' 69th as a professional sports franchise, their 65th season as a member of the National Football League, their second under head coach Hue Jackson and their second and final season under GM Sashi Brown.", "The Browns failed to improve upon their 1\u201315 record from the previous season, losing all sixteen games in 2017 and continuing a losing streak dating to the final game of the previous season.", "They became the second team in NFL history to go 0\u201316 after the 2008 Detroit Lions.", "The Browns became the twelfth NFL team to have gone winless playing eight games or more and the fourth since the AFL-NFL merger in 1970.", "In going 0\u201316, the Browns became the first franchise in NFL history to have multiple seasons with 15 or more losses and the first to start consecutive seasons with at least 14 losses.", "They were mathematically eliminated from the AFC North title contention in Week 11, extending an active NFL record drought of 25 consecutive seasons without a division title.", "They were then eliminated from playoff contention in Week 12, extending their franchise record playoff drought to 15 consecutive seasons.", "With the Buffalo Bills qualifying for the postseason for the first time since 1999, the Browns now have the longest postseason drought in the NFL and the second longest in the four major American sports leagues, only behind the Seattle Mariners of Major League Baseball." ], [ "2015 Cleveland Browns season", "With their seventh straight loss, the Browns dropped to 2-10 and became the first team in the league to be mathematically eliminated from playoff contention for the season.", "This marked the 13th straight year that the team missed the playoffs.", "It was also their 13th consecutive loss in the month of the December.", "The 34-point margin of defeat was the team's largest since Week 16 of the 2005 season, when they lost to the Pittsburgh Steelers by 41-0.", "With the win, the Browns snapped their 7-game losing streak and improved to 3-10.", "This is the Browns' last win until Week 16, 2016 against the San Diego Chargers.", "With the loss, the Browns fell to 3-11.", "The Browns fall to 3-12 with the loss.", "With the Ravens' win over the Steelers, they are assured last place in the AFC North for the season.", "The Steelers made the playoffs with a dominating 28-12 win over the Browns (coupled with a Jets loss to the Bills).", "The game was competitive for three quarters, but the Browns failed to get into the endzone, scoring 4 field goals and committing 3 turnovers (2 of them in the 4th quarter, both of which resulted in Steelers scores).", "The Browns finished the season with a 3-13 record, their worst record since the 2000 season (when they also went 3-13)." ], [ "2016 Cleveland Browns season", "After this game, the Browns would have a 19-game winless streak and would not win again until week 3 of the 2018 season.", "The Browns entered this game looking to win consecutive games for the first time since they won three in a row during Weeks 8 to 10 of the 2014 season.", "The Steelers entered the game locked into the AFC\u2019s #3 seed and rested most of their starters.", "However, the Browns would still fall to the Steelers, losing 27\u201324 in an overtime affair.", "With the loss, the Browns finished the season with a 1\u201315 record, their worst record in franchise history.", "The Browns also became the tenth team in NFL history, but the first since the 2009 Rams, to finish 1\u201315.", "They failed to win a division game for the first time since the 2011 season and extended their losing streak within the division to 11 games.", "The Browns also failed to win a road game in a season for only the second time in franchise history and the first since the 1975 season.", "They also extended their road losing streak to 13 games and failed to win a road game against the Steelers for the 13th consecutive season.", "The Browns finished with the worst record in the NFL and secured the #1 overall pick in the 2017 NFL Draft.", "This marked the beginning of a 17 game losing streak continuing through the 2017 season and ending with a tie in Week 1 of the 2018 season." ] ], "gold": "In 2017, the Cleveland Browns went winless. They became the second team in NFL history to go 0\u201316 in the regular season. The Browns finished the season with a losing record for the tenth consecutive season, extending a franchise record. However, the team had beaten the New Orleans Saints, New York Giants, Tampa Bay Buccaneers, and Chicago Bears in the 2017 preseason. In 2016, the Browns were winless in the preseason and then went 1-15 in the regular season, defeating only the San Diego Chargers. The Browns failed to make the playoffs for a franchise-record 14th straight season. In 2015, the Browns defeated the Tampa Bay Buccaneers in the preseason. The Browns then went 3-13 in the regular season, defeating only the Tennessee Titans, Baltimore Ravens, and San Francisco 49ers. The Browns tied for the worst record in the league and fired their coach and general manager at the end of the 2015 season. ", "prediction 1": "The Cleveland Browns have defeated several teams during the course of their careers. The Browns have lost all 16 games they have played since 2005 and finished the season losing to the Pittsburgh Steelers in Week 15. They finished the season losing to the Chiefs in Week 15 of the 2016 season. The Browns finished the season losing to the Atlanta Falcons in Week 17 of the 2017 season.", "prediction 2": "The Cleveland Browns have lost a total of 14 games last season. They lost 16 of those games to the Pittsburgh Steelers, and lost 14 of those to the Baltimore Ravens. The Browns are currently ranked #5 in the NFL by the number of wins.", "prediction 3": "The Cleveland Browns have lost 16 consecutive games to the Pittsburgh Steelers in the 2017 season and failed to improve on their 1\u201315 record from the previous season. The Browns have also lost to the New England Patriots in the 2015 season and in the 2016 season. The 2015 Cleveland Browns defeated the Baltimore Ravens in the 2016 season and the Cleveland Browns defeated the Seattle Seahawks in the 2017 season.", "prediction 4": "The Cleveland Browns have defeated various teams throughout their history. In 2017, the Browns lost all sixteen games and continued a losing streak dating to the final game of the previous season. In 2015, the Browns lost to the Baltimore Ravens, a team that is part of the National Football League. In 2016, the Browns lost to the Cleveland Browns in the divisional round of the playoffs, but they did so in the first round of the playoffs to the Indianapolis Colts.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 119, "end": 146 }, { "error type": "Unverifiable", "explanation": "", "start": 208, "end": 216 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4,5]}", "start": 256, "end": 273 }, { "error type": "Unverifiable", "explanation": "", "start": 339, "end": 365 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 12 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Cleveland Browns have defeated several teams during the course of their careers. The Browns have lost all 16 games in 2017. They became the second team in NFL history to go 0\u201316 after the 2008 Detroit Lions. They finished the 2016 season with a score of 1\u201315. They beat the San Diego Chargers. In 2015, the Browns finished the season with a 3-13 record. Their 2015 season was their 13th year of missing playoffs, 14 and 15 respectively for 2016 and 2017." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "How many soldiers can a blackhawk helicopter carry?", "passages": [ [ "Sikorsky UH-60 Black Hawk", "Sikorsky UH-60 Black Hawk\n\nThe Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft.", "Sikorsky submitted the S-70 design for the United States Army's Utility Tactical Transport Aircraft System (UTTAS) competition in 1972.", "The Army designated the prototype as the \"YUH-60A\" and selected the Black Hawk as the winner of the program in 1976, after a fly-off competition with the Boeing Vertol YUH-61.", "Named after the Native American war leader Black Hawk, the UH-60A entered service with the U.S. Army in 1979, to replace the Bell UH-1", "Iroquois as the Army's tactical transport helicopter.", "This was followed by the fielding of electronic warfare and special operations variants of the Black Hawk.", "Improved UH-60L and UH-60M utility variants have also been developed.", "Modified versions have also been developed for the U.S. Navy, Air Force, and Coast Guard.", "In addition to U.S. Army use, the UH-60 family has been exported to several nations.", "Black Hawks have served in combat during conflicts in Grenada, Panama, Iraq, Somalia, the Balkans, Afghanistan, and other areas in the Middle East." ], [ "VXX", "To do so, DOD asked bidders to begin development and production at the same time.", "AgustaWestland and Sikorsky responded to the RFP.", "Sikorsky proposed the VH-92, a variant of the H-92 Superhawk.", "On January 28, 2005 the Department of Defense announced that it had selected the US101 for the VXX program.", "The US101 team was awarded a US$1.7 billion contract for the VXX system development and demonstration (SDD) phase.", "The Lockheed Martin and AgustaWestland AW101-based US101 bid was given the military designation VH-71 Kestrel in mid-2005.", "The replacement cost of the fleet was estimated at $6.1 billion when the VH-71 contracts were signed in 2005.", "However, by March 2008 the cost of the new 28 helicopter fleet was projected to total US$11.2 billion, or roughly US$400 million per helicopter.", "Political controversy began in February 2009 amid calls for fiscal restraint, and, as a result, President Barack Obama announced that he had instructed Defense Secretary Robert Gates to review the helicopter situation and on 6 April 2009, Gates announced the ending of VH-71 funding, after nine aircraft had already been built at a cost of about US$600 million each." ], [ "Combat Aviation Brigade", "Thus all ARNG aviation brigades consist of attack reconnaissance battalion (24 AH-64 Apache), security and support battalion (three companies with 8 UH-72 Lakota each), assault helicopter battalion (30 UH-60 Black Hawk), general support aviation battalion (8 UH-60, 12 CH-47 Chinook and 15 HH-60M), UAV company (12 MQ-1C Gray Eagle), and aviation support battalion." ] ], "gold": "The Sikorsky UH-60 Black Hawk is a four-blade, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. Sikorsky submitted the S-70 design for the United States Army's Utility Tactical Transport Aircraft System (UTTAS) competition in 1972. A flight crew includes 4 soldiers, 2 flight crew and 2 loadmaster/gunners. As internal cargo, a Black Hawk can carry 11 soldiers, for a total of 15.", "prediction 1": "The Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. The 30-soldier Black Hawk has served in combat during conflicts in Grenada, Panama, Iraq, Somalia, the Balkans, Afghanistan, and other areas in the Middle East.", "prediction 2": "The Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. The US Army designated the prototype as the \"YUH-60A\" and selected the Black Hawk as the winner of the program in 1976, after a fly-off competition with the Boeing Vertol YUH-61. The Black Hawk entered service with the U.S. Army in 1979, to replace the Bell UH-1 Iroquois as the Army's tactical transport helicopter.", "prediction 3": "The Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. The US Army awarded the UH-60A the U.S. Army Utility Tactical Transport Aircraft System competition in 1972. The UH-60A entered service with the U.S. Army in 1979, to replace the Bell UH-1 Iroquois as the Army's tactical transport helicopter. The replacement cost of the fleet was estimated at $6.1 billion when the VH-71 contracts were signed in 2005. However, the cost of the new 28 helicopter fleet was projected to total US$11.7 billion, or roughly US$400 million per helicopter.", "prediction 4": "The Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. The number of soldiers a Blackhawk helicopter can carry is 30.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 131, "end": 141 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 287 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Sikorsky UH-60 Black Hawk is a four-bladed, twin-engine, medium-lift utility helicopter manufactured by Sikorsky Aircraft. Sikorsky submitted the S-70 design for the United States Army's Utility Tactical Transport Aircraft System (UTTAS) competition in 1972. The Black Hawk consists of 30 assault helicopter battalions. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who played lexie carver on days of our lives?", "passages": [ [ "Corday Productions", "Corday Productions\n\nCorday Productions is an American production company.", "The company was founded by Ted and Betty Corday in 1965.", "The company produces the NBC soap opera \"Days of Our Lives\" which they have produced since 1965.", "They are based in Burbank, California.", "The company is currently run by Ted and Betty Corday's son Ken Corday.", "Producer Ted Corday and his wife Betty were collaborating with William J. Bell to create a new soap opera.", "The concept of the soap would be centered around a family of doctors.", "The soap, named \"Days of Our Lives\" premiered on November 8, 1965.", "With the premiere of the soap also came the formation of Corday Productions.", "Initially, the series was just intended for the production of \"Days\".", "But the company did several different productions.", "The company is now run by the Corday's son Ken Corday.", "In April 2014, Corday Productions announced plans to team up with All Screens Media to form NetSoaps/Net Novellas.", "The website would be a joint venture between Corday executive Ken Corday and All Screens creator Peter Heumiller.", "Heumiller had worked as a digital media executive for Comcast.", "The online network is dedicated to the soap opera and telenovela format.", "Net Soaps is geared toward American and English speaking audiences while Net Novelas is targeted toward Latin American and Brazilian audiences." ], [ "Ren\u00e9e Jones", "Ren\u00e9e Jones\n\nRen\u00e9e Jones (born October 15, 1958) is a former American dramatic actress.", "Jones is best known for playing Lexie Carver on NBC's long-running soap opera \"Days of Our Lives\", a role she began in 1993.", "She has been nominated five times for the NAACP Image Award for Outstanding Actress in a Daytime Drama Series for the role.", "Born into a large family of five siblings, Jones grew up in Georgia and New York and worked as a secretary before signing with the prestigious Ford Modeling agency at the age of 19 and eventually making her acting debut on the prime time series \"The White Shadow\".", "Jones made her debut on \"Days of Our Lives\" in the early 1980s as Nikki Wade.", "She returned to the soap, taking on a new role, as Lexie Carver in February 1993.", "In April 2012, Jones confirmed in an interview with \"TV Guide\"'s Michael Logan that she would vacate the role of Lexie Carver after 20 years and would retire to a simpler life, revealing that she is not happy in acting." ], [ "Lexie Carver", "Lexie Carver\n\nDr. Alexandra \"Lexie\" Carver (n\u00e9e Brooks) is a fictional character on the NBC soap opera \"Days of Our Lives\", created by head writer Leah Laiman.", "The role has been played most notably by actress Ren\u00e9e Jones, who appeared in the role from 1993 until departing in 2012.", "She is the daughter of crime boss Stefano DiMera, and the psychic Celeste Perrault.", "She is the mother of Theo Carver, and the wife of mayor Abe Carver.", "The role was originated on July 30, 1987, by Cyndi James Gossett on a recurring basis.", "Gossett last appeared as Lexie on February 20, 1989.", "In 2011, an error listing Sheila DeWindt Wills as having portrayed Lexie was corrected by James Reynolds, who portrays Abe Carver: Sheila did not portray Lexie, she portrayed the role of nurse, Joan Hopkins, from 1982-83.", "The error occurred when Wills was mixed up with the second actress to portray Lexie, Angelique deWindt Francis (both having similar surnames).", "Francis portrayed the character from March 31, 1989, until August 2, 1990, and again from March 9 to December 12, 1992.", "Shellye Broughton appeared for two episodes on January 28 and 29, 1993, with Ren\u00e9e Jones taking over on February 2, 1993, and remaining until the character's exit." ] ], "gold": "Days of Our Lives is a long-running American television soap opera drama, airing on NBC, which first premiered on November 8, 1965. One of the characters is Lexie Carver, she was played by different actresses over the years. From 1989-92 Angelique Francis played Lexie, in 1993 Shellye Broughton and from 1993-2012 Ren\u00e9e Jones.", "prediction 1": "Lexie Carver, a fictional character on the NBC soap opera \"Days of Our Lives\", is played by different people. Ren\u00e9e Jones played Lexie until 1993. In 2011, an error listing Sheila DeWindt Wills as having portrayed Lexie was corrected by James Reynolds, who portrays Abe Carver. Angelique deWindt Francis portrayed the character from March 31, 1989, until August 2, 1990, and again from March 9 to December 12, 1992.", "prediction 2": "Ren\u00e9e Jones has played Lexie Carver on NBC's soap opera \"Days of Our Lives\" since 1993. Ren\u00e9e Jones first appeared in the role of Lexie Carver on Days of Our Lives in 1993, and then took over the role in 1993. A few other actors have played Lexie on Days of Our Lives, including Cyndi James Gossett, Angelique deWindt Francis, and Shellye Broughton. Jones first began playing Lexie Carver in 1993, and then a new role as Lexie Carver in 2015.", "prediction 3": "Ren\u00e9e Jones played Lexie Carver on Days of Our Lives from 1993 to 2012. In 2011, an error listing Sheila DeWindt Wills as having portrayed Lexie was corrected by James Reynolds, who portrays Abe Carver. Francis portrayed the character from March 31, 1989, until August 2, 1990, and again from March 9 to December 12, 1992. Jones took over the role in 1993.", "prediction 4": "Lexie Carver is a fictional character on the NBC soap opera Days of Our Lives created by head writer Leah Laiman. In the early 1990's, Cyndi James Gossett played Lexie. In 1993, actress Ren\u00e9e Jones played Lexie from 1993 to 2012. In 2012, Jones announced that she would be retiring from acting after 20 years and that she would retire to a simpler life.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 110, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 277 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "Lexie Carver, a fictional character on the NBC soap opera \"Days of Our Lives\", is played by different people. The show first premiered on November 8, 1965. Ren\u00e9e Jones played Lexie after February 2nd, 1993. Angelique deWindt Francis portrayed the character from March 31, 1989, until August 2, 1990, and again from March 9 to December 12, 1992. Shellye Broughton appeared for two episodes on January 28 and 29, 1993." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who is the new leader of the ontario conservative party?", "passages": [ [ "Progressive Conservative Party of Ontario", "Progressive Conservative Party of Ontario\n\nThe Progressive Conservative Party of Ontario (), often shortened to Ontario PC Party, PC, or Conservatives, is a centre-right to right wing conservative political party in Ontario, Canada.", "The party has been led by Premier Doug Ford since March 10, 2018.", "It has governed the province for 80 of the years since Confederation, including an uninterrupted run from 1943 to 1985.", "It currently holds a majority government in the 42nd Parliament of Ontario.", "The Ontario PC Party is a centre-right conservative political party.", "Its beliefs and policies have been described as fiscally conservative, capitalist and populist..", "The Ontario PC Party favors economic policies that center around lower taxes, lower government spending, balanced budgets and deregulation.", "Its economic policies are more capitalist than that of its main political opponents.", "The party supports reducing taxes for individuals and businesses.", "It is completely opposed to carbon taxes and cap-and-trade systems.", "The Ontario PC Party's policies on social issues do not follow a particular ideology.", "Its policies on issues involving morality, family and sexuality tend to favor less government intervention and more individual freedom.", "It has been described as both socially conservative and socially liberal.", "On drug policy, the PC Party supports the expansion of alcohol and cannabis sales to private retailers, but is skeptical of the benefits of supervised injection sites." ], [ "Progressive Conservative Party of Ontario", "Vic Fedeli, Nipissing MPP and former mayor of North Bay, was chosen as interim leader by caucus on January 26, 2018.", "The Party held a leadership convention on March 10, 2018.", "Fideli's first major task as interim leader was to investigate the allegations of questionable spending on lawsuits and unsubstantiated favours to allies during Brown's tenure.", "Party president Rick Dykstra resigned on January 28, 2018.", "He indicated that it was time for \"someone else to lead us through the hard work\".", "Shortly afterwards, \"Maclean's\" magazine revealed allegations of sexual assault against Dykstra, stemming from a 2014 incident when Dykstra was a federal MP.", "Several other key party and campaign staffers were dismissed or their positions eliminated due to a \"reorganization\" in the days after Brown's resignation.", "On March 10, 2018, Doug Ford, former city councillor and the brother of the late former Mayor of Toronto Rob Ford, was elected as leader of the PC Party, narrowly defeating runner-up Christine Elliott on the third ballot with 50.6% of allocated points, although Elliot had more votes.", "Due to not having a seat in the legislature, Ford chose to have Vic Fedeli remain as Leader of the Opposition prior to the 2018 election.", "The Ontario PC Party's 2018 platform was named the Plan For The People." ] ], "gold": "The Progressive Conservative Party of Ontario often shortened to the Ontario PC Party or simply the PCs, colloquially known as the Tories, is a centre-right political party in Ontario, Canada. The party has been led by Doug Ford since March 10, 2018. Other leaders prior to Doug Ford were Ken Zeise, RIchard Ciano and Rick Dykstra. ", "prediction 1": "The Progressive Conservative Party of Ontario, often shortened to PC, or Conservatives, is a centre-right conservative political party in Ontario, Canada. The party has been led by Premier Doug Ford since March 10, 2018. The new leader was Vic Fedeli, Nipissing MPP and former mayor of North Bay.", "prediction 2": "The Progressive Conservative Party of Ontario, often shortened to Ontario PC Party, PC, or Conservatives, is a centre-right conservative political party in Ontario, Canada. It has governed the province for 80 of the years since Confederation, including an uninterrupted run from 1943 to 1985. The party's beliefs and policies have been described as fiscally conservative, capitalist and populist. On January 26, 2018, Vic Fedeli was chosen as interim leader by caucus. On March 10, 2018, Doug Ford, former city councillor and the brother of the late former Mayor of Toronto Rob Ford, was elected as leader of the PC Party, narrowly defeating runner-up Christine Elliott on the third ballot with 50.", "prediction 3": "The Progressive Conservative Party of Ontario is a centre-right conservative political party whose beliefs and policies have been described as fiscally conservative, capitalist and populist. Its president Rick Dykstra resigned on January 28, 2018, indicating that it was time for \"someone else to lead us through the hard work\". On March 10, 2018, Doug Ford, former city councillor and the brother of the late former Mayor of Toronto Rob Ford, was elected as leader of the PC Party, narrowly defeating runner-up Christine Elliott on the third ballot with 50.6% of allocated points, although Elliot had more votes.", "prediction 4": "The Progressive Conservative Party of Ontario is a centre-right conservative political party with beliefs that have been described as fiscally conservative, capitalist and populist. The party's president, Rick Dykstra, resigned on January 28, 2018. He indicated that it was time for \"someone else to lead us through the hard work.\" On March 10, 2018, Doug Ford, former city councillor and the brother of the late former Mayor of Toronto Rob Ford, was elected as leader of the PC Party, narrowly defeating runner up Christine Elliott on the third ballot with 50.6% of allocated points.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 221, "end": 296 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Progressive Conservative Party of Ontario, often shortened to PC, or Conservatives, is a centre-right conservative political party in Ontario, Canada. The party has been led by Premier Doug Ford since March 10, 2018. Rick Dykstra was the president of the party who resigned on January 28, 2018." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who was known for having a sign on his desk that read the buck stops here?", "passages": [ [ "Buck passing", "Passing the buck in international relations theory involves the tendency of nation-states to refuse to confront a growing threat in the hopes that another state will.", "The most notable example of this was the refusal of the United Kingdom, United States, France, or the Soviet Union to effectively confront Nazi Germany during the 1930s.", "With the Munich Agreement, France and the United Kingdom successfully avoided armed confrontation with Germany, passing the buck to the Soviet Union.", "The Soviet Union then passed the buck back to the western powers by signing the Molotov\u2013Ribbentrop Pact.", "Similarly, John Mearsheimer argues that the delay of the Normandy invasion shows that a buck passing state can shift the balance of power in its favor: \"There is no question that the United States benefited greatly from delaying the Normandy invasion until late in the war, when both the German and the Soviet armies were battered and worn down.", "Not surprisingly, Joseph Stalin believed that the United Kingdom and the United States were purposely allowing Germany and the Soviet Union to bleed each other white, so that those offshore balancers [the United States and the United Kingdom] could dominate postwar Europe.\"", "\"The buck stops here\" is a phrase that was popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office." ], [ "Riding into the Sunset", "Carter was the first chairman of the university's board of regents when it was founded in 1923.", "The sculpture is located in what is now called Amon G. Carter Plaza at the university's main entrance.", "While visiting Lubbock in 1926, Rogers donated $200 to the Goin' Band from Raiderland to aid with travel expenses for the marching band to accompany the football team for a game against the TCU Horned Frogs in Fort Worth.", "At the sculpture's dedication on February 16, 1950, Carter was quoted as saying \"Will Rogers felt at home in the Lubbock area.", "His statue is a befitting monument to your students and faculty.\"", "In 1996, \"Riding into the Sunset\" was added to the National Register of Historic Places as a contributing object to the Texas Technological College Historic District.", "A campus legend holds that the sculpture was originally intended to be positioned with Will Rogers and Soapsuds facing due west, so that it would appear he was riding into the sunset.", "However, that position would cause Soapsuds's posterior to face due east, towards downtown Lubbock, potentially insulting the local business community.", "To address this issue, the sculpture was turned 23\u00a0degrees to the east in the late 1960s, supposedly causing Soapsuds's rear to face in the direction of the Texas A&M University in College Station." ] ], "gold": "There were several who were known for having a sign on their desk that read \"the buck stops here,\" a phrase popularized by U.S. President Harry S. Truman. Truman was originally known for it and kept a sign with that phrase on his desk in the Oval Office. President Jimmy Carter was known for having a borrowed sign on his desk that read the phrase.", "prediction 1": "\"The buck stops here\" is a phrase popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office. This phrase was popularized by a sculpture of Will Rogers called Riding into the Sunset, which is located in what is now called Amon G. Carter Plaza at the university's main entrance.", "prediction 2": "\"The buck stops here\" is a phrase that was popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office. The sign is located in what is now called Amon G. Carter Plaza at the university's main entrance.", "prediction 3": "\"The buck stops here\" is a phrase that was popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office.", "prediction 4": "\"The buck stops here\" is a phrase popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office. \"The buck stops here\" is also the name of a sculpture that commemorates Will Rogers, who was the first chairman of the university's board of regents when it was founded in 1923.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 146, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 329 } ], "missing-info": [], "corrected-prediction": "\"The buck stops here\" is a phrase popularized by U.S. President Harry S. Truman, who kept a sign with that phrase on his desk in the Oval Office. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the us adopt the electoral college?", "passages": [ [ "United States Electoral College", "Some delegates, including James Wilson and James Madison, preferred popular election of the executive.", "Madison acknowledged that while a popular vote would be ideal, it would be difficult to get consensus on the proposal given the prevalence of slavery in the South:\nThe Convention approved the Committee's Electoral College proposal, with minor modifications, on September 6, 1787.", "Delegates from states with smaller populations or limited land area such as Connecticut, New Jersey, and Maryland generally favored the Electoral College with some consideration for states.", "At the compromise providing for a runoff among the top five candidates, the small states supposed that the House of Representatives with each state delegation casting one vote would decide most elections.", "In \"The Federalist Papers\", James Madison explained his views on the selection of the president and the Constitution.", "In Federalist No. 39, Madison argued the Constitution was designed to be a mixture of state-based and population-based government.", "Congress would have two houses: the state-based Senate and the population-based House of Representatives.", "Meanwhile, the president would be elected by a mixture of the two modes.", "Alexander Hamilton in Federalist No. 68 laid out what he believed were the key advantages to the Electoral College.", "The electors come directly from the people and them alone for that purpose only, and for that time only." ], [ "United States Electoral College", "10, James Madison argued against \"an interested and overbearing majority\" and the \"mischiefs of faction\" in an electoral system.", "He defined a faction as \"a number of citizens whether amounting to a majority or minority of the whole, who are united and actuated by some common impulse of passion, or of interest, adverse to the rights of other citizens, or to the permanent and aggregate interests of the community.\"", "What was then called republican government (i.e., federalism, as opposed to direct democracy), with its varied distribution of voter rights and powers, would countervail against factions.", "Madison further postulated in the Federalist No. 10 that the greater the population and expanse of the Republic, the more difficulty factions would face in organizing due to such issues as sectionalism.", "Although the United States Constitution refers to \"Electors\" and \"electors\", neither the phrase \"Electoral College\" nor any other name is used to describe the electors collectively.", "It was not until the early 19th century the name \"Electoral College\" came into general usage as the collective designation for the electors selected to cast votes for president and vice president.", "The phrase was first written into federal law in 1845 and today the term appears in , in the section heading and in the text as \"college of electors.\"", "Historically, the state legislatures chose the electors in more than half the states." ], [ "United States Electoral College", "Polls since 1967 have shown that a majority of Americans favor the president and vice president being elected by the nationwide popular vote, instead of by the Electoral College.", "The Constitutional Convention in 1787 used the Virginia Plan as the basis for discussions, as the Virginia delegation had proposed it first.", "The Virginia Plan called for the Congress to elect the president.", "Delegates from a majority of states agreed to this mode of election.", "However, a committee formed to work out various details including the mode of election of the president, recommended instead the election be by a group of people apportioned among the states in the same numbers as their representatives in Congress (the formula for which had been resolved in lengthy debates resulting in the Connecticut Compromise and Three-Fifths Compromise), but chosen by each state \"in such manner as its Legislature may direct.\"", "Committee member Gouverneur Morris explained the reasons for the change; among others, there were fears of \"intrigue\" if the president were chosen by a small group of men who met together regularly, as well as concerns for the independence of the president if he were elected by the Congress.", "However, once the Electoral College had been decided on, several delegates (Mason, Butler, Morris, Wilson, and Madison) openly recognized its ability to protect the election process from cabal, corruption, intrigue, and faction." ] ], "gold": "The United States adopted the Electoral College at the Constitutional Convention on September 6, 1787. The Convention originally intended to follow the Virginia Plan, which called for Congress to elect the president, an idea that was dropped when delegates came to oppose nomination by Congress for the reason that it could violate the separation of powers. A committee was then formed to work out various details including the mode of election of the president, which came up with the electors, a group of people apportioned among the states in the same numbers as their representatives in Congress, but chosen by each state \"in such manner as its Legislature may direct\", forming an Electoral College system which the Convention ended up approving. Nonetheless, only variations of the word \"electors\" were mentioned in the Constitution, which wouldn't see the phrase \"Electoral College\" written on it, and therefore adopted into federal law, until the year 1845.", "prediction 1": "The United States adopted the electoral college on September 6, 1787. In the US Constitution, the Electoral College is a group of people selected by the states to cast votes for the president and vice president. The Electoral College was created to prevent the possibility of a popular vote. The term \"Electoral College\" was first written into federal law in 1845.", "prediction 2": "The US adopted the electoral college in 1787. The Electoral College was first proposed at the Convention in Philadelphia on July 31, 1787. In the United States, the electoral college was first proposed at the Constitutional Convention in Philadelphia on September 6, 1787.", "prediction 3": "The United States adopted the electoral college in 1787, after a committee formed to work out various details, which recommended instead of a congressional election, the election be by a group of people apportioned among the states in the same numbers as their representatives in Congress, but chosen by each state in such manner as its legislature may direct. The Electoral College law was first enacted on July 17, 1845, and it became effective on September 6, 1787.", "prediction 4": "The US adopted the electoral college at its first convention in 1787. Although the US Constitution refers to electors and electors, the phrase Electoral College nor any other name is used to describe the electors collectively. In the early 19th century, the name Electoral College came into general usage as the collective designation for the electors selected to cast votes for president and vice president.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 211 }, { "error type": "Unverifiable", "explanation": "", "start": 212, "end": 291 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The United States adopted the Electoral College at the Constitutional Convention on September 6, 1787. The Convention originally intended to follow the Virginia Plan, which called for Congress to elect the president, an idea that was dropped when delegates came to oppose nomination by Congress for the reason that it could violate the separation of powers. A committee formed to work out various details including the mode of election of the president, recommended instead the election be by a group of people apportioned among the states in the same numbers as their representatives in Congress, but chosen by each state \"in such manner as its Legislature may direct.\", forming an Electoral College system which the Convention ended up approving. Although the United States Constitution refers to \"Electors\" and \"electors\", neither the phrase \"Electoral College\" nor any other name is used to describe the electors collectively. The phrase was first written into federal law in 1845." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played billy abbott on young and the restless?", "passages": [ [ "Billy Abbott", "When Tom received the role, he said, \"She [Heather] was very excited.", "I probably won't have too many scenes with my sister.", "But it's great to be on the same show!\"", "Tom went on to receive a Daytime Emmy Award for Outstanding Younger Actor in 2000.", "In 2002, Tom opted not to renew his contract but agreed to stay until that August when Billy was written out, and was last seen on August 15, 2002.", "The character was absent from the series from August to December 2002; even though he was supposed to return much sooner, the casting department allegedly had trouble finding a suitable replacement for Tom.", "The role was recast with Ryan Brown, who debuted on December 26, 2002.", "During Brown's portrayal, rumors started circulating about his dismissal, but when Brown was actually fired, the producers said it was storyline dictated.", "He last aired on July 16, 2003.", "In 2006, it was announced that newcomer Scott Seymour would assume the role, debuting on August 15, 2006.", "However, Seymour was let go after only three months, and his final airdate was November 9, 2006.", "In 2008, Billy Miller assumed the role as the fourth actor to do so.", "He first aired on September 19, 2008.", "Miller won a Daytime Emmy Award for Outstanding Supporting Actor for his portrayal in 2010." ], [ "Billy Abbott", "Billy Abbott\n\nBilly Abbott is a fictional character from \"The Young and the Restless\", an American soap opera on the CBS network.", "Created by William J. Bell as the son of John Abbott (Jerry Douglas) and Jill Abbott (Jess Walton), the character is currently portrayed by Jason Thompson.", "He was born onscreen during the episode airing on July 7, 1993.", "For the character's first six-year period, he appeared as a minor, portrayed by various child actors.", "In 1999, David Tom began portraying Billy as a teenager.", "Tom was acclaimed for his portrayal, winning a Daytime Emmy Award in 2000.", "The character is known for being a \"spoiled rich boy\", a \"screw up\", and for his gambling addictions and consumption of alcohol.", "In 2002, Tom opted not to renew his contract with the series and the role was recast with Ryan Brown, who only portrayed the role for a year after he was let go in a storyline dictated departure.", "In 2006, Scott Seymour became a second recast for the character; however, he too was let go after three months.", "Two years later in 2008, Miller was cast in the role, who portrayed Billy until his exit in 2014." ], [ "Billy Abbott", "Miller's performance in the role was popular with audiences and critics, and garnered his two wins for the Daytime Emmy Award for Outstanding Supporting Actor in a Drama Series in 2010 and 2013, and one for the Daytime Emmy Award for Outstanding Lead Actor in a Drama Series in 2014.", "In 2014, Tom returned to the series following Miller's exit; his return was short-lived when he was replaced by Burgess Jenkins on June 24, 2014.", "In 2015, Jenkins announced his decision to depart the soap.", "Thompson first appeared in the role on January 13, 2016.", "Billy was born onscreen in July 1993 and grew up naturally until 1999, when the producers decided to revise the birth date to 1983.", "His birth date was later revised again to 1979, the same birth date as actor Billy Miller.", "Up to 1999, the character was portrayed by child actors, first by a set of twins named Katrin and Margret Ingimarsdottir, then by Brett Sherman, Shane Silver, Blake Pontello, Josh Michael Rose and Scotty Leavenworth.", "When the character was rapidly aged, the character was first portrayed by David Tom, brother of the acclaimed Heather Tom, who first aired on July 26, 1999.", "\"I auditioned five times,\" said Tom at the time.", "\"Every time, Heather would call and ask, 'How was it?", "Did you feel good about it?'\"" ] ], "gold": "Billy Abbott is a fictional character from American soap opera \"The Young and the Restless\", currently portrayed by Jason Thompson. David Tom began portraying the character from 1999 until 2002, when he was recast with Ryan Brown. The character was recast again in 2006 with Scott Seymour, but was let go after three months. In 2008, the character was recast with Billy Miller until 2014, when Burgess Jenkins took over the role. ", "prediction 1": "Billy Abbott is a fictional character from The Young and the Restless, an American soap opera on the CBS network. Created by William J. Bell as the son of John Abbott and Jill Abbott, the character is currently portrayed by Jason Thompson. Billy Abbott was born onscreen in July 1993 and grew up naturally until 1999, when the producers decided to revise the birth date to 1983. He was first portrayed by David Tom, brother of the acclaimed Heather Tom, who first aired on July 26, 1999. During Tom acclaimed for his portrayal, winning a Daytime Emmy Award for Outstanding Younger Actor for his portrayal in 2010.", "prediction 2": "Billy Abbott is a fictional character from The Young and the Restless, an American soap opera on the CBS network. Created by William J. Bell as the son of John Abbott (Jerry Douglas) and Jill Abbott (Jess Walton), the character is currently portrayed by Jason Thompson. In 1999, David Tom began portraying Billy as a teenager. Tom won a Daytime Emmy Award for Outstanding Younger Actor in 2000. In 2002, Tom opted not to renew his contract with the series and the role was recast with Ryan Brown, who debuted on December 26, 2002. In 2008, Billy Miller assumed the role as the fourth actor to do so. Miller assumed the role as the fourth actor to do so. In 2008, Billy Miller assumed the role as the fourth actor to do so. In 2009, Billy was cast in the role, who portrayed Billy until his exit in 2014.", "prediction 3": "Billy Abbott is a fictional character on the television series, The Young and the Restless, created by William J. Bell as the son of John Abbott and Jill Abbott. Billy Abbott started appearing onscreen in 1999 as a teenager. David Tom began portraying the character as a teenager and was acclaimed for his portrayal, winning a Daytime Emmy Award in 2000. In 2002, Tom opted not to renew his contract with the series and the role was recast with Ryan Brown, who debuted on December 26, 2002. In 2008, Billy Miller assumed the role as the fourth actor to do so. Miller assumed the role as the fourth actor to do so.", "prediction 4": "Billy Abbott is a fictional character from The Young and the Restless, an American soap opera on the CBS network. Created by William J. Bell as the son of John Abbott (Jerry Douglas) and Jill Abbott (Jess Walton), the character is currently portrayed by Jason Thompson. The role was first portrayed by David Tom in 1999. Tom's portrayal was acclaimed for his portrayal, winning a Daytime Emmy Award for Outstanding Younger Actor in 2000.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 283 }, { "error type": "Irrelevant", "explanation": "", "start": 284, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 378 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 487 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[14]}", "start": 488, "end": 613 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Billy Abbott is a fictional character from The Young and the Restless, an American soap opera, currently portrayed by Jason Thompson. Up to 1999, the character was portrayed by child actors, first by a set of twins named Katrin and Margret Ingimarsdottir, then by Brett Sherman, Shane Silver, Blake Pontello, Josh Michael Rose and Scotty Leavenworth. He was then portrayed by David Tom from 1999 until 2002, when he was recast with Ryan Brown. The character was recast again in 2006 with Scott Seymour, but was let go after three months. In 2008, the character was recast with Billy Miller until 2014, when Burgess Jenkins took over the role." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Where did the 2014 world cup take place?", "passages": [ [ "2014 FIFA World Cup group stage", "2014 FIFA World Cup group stage\n\nThe group stage of the 2014 FIFA World Cup took place in Brazil from 12 June 2014 to 26 June 2014: each team played three matches.", "The group stage was notable for a scarcity of draws and a large number of goals.", "The first drawn (and goalless) match did not occur until the 13th match of the tournament, between Iran and Nigeria: a drought longer than any FIFA World Cup since 1930.", "The group stage produced a total of 136 goals, nine fewer than were scored during the entire 2010 tournament.", "This is the largest number of goals in the group stage since the 32-team system was implemented in 1998 and the largest average in a group stage since 1958.", "After the second set of games, six teams had already guaranteed their progress into the knockout stage: Netherlands, Chile, Colombia, Costa Rica, Argentina and Belgium.", "In contrast, teams eliminated early after two losses included defending champions Spain and 1966 champions England, who were eliminated at the group stage for the first time since 1958.", "The 2006 champions, Italy were also eliminated who scored only two goals, their lowest tally since 1966.", "Spain became the fourth nation to be eliminated in the first round while holding the World Cup crown, the first one being Brazil in 1966, the second France in 2002 and the third Italy in 2010." ], [ "2014 Women's Hockey World Cup", "2014 Women's Hockey World Cup\n\nThe 2014 Women's Hockey World Cup was the 13th edition of the Women's Hockey World Cup field hockey tournament.", "It was held from 31 May to 14 June 2014 at the Kyocera Stadion in The Hague, Netherlands.", "simultaneously with the men's tournament.", "It was the third time that the Netherlands hosted the Women's World Cup after 1986 and 1998.", "The Netherlands won the tournament for a seventh time after defeating Australia 2\u20130 in the final.", "Defending champions Argentina won the third place match by defeating the United States 2\u20131.", "The host was announced on 11 November 2010 during the FIH Congress and Forum in Montreux, Switzerland after FIH received bids from The Hague and London.", "Each of the continental champions from five confederations and the host nation receive an automatic berth.", "In addition to the six highest placed teams at the Semifinals of the 2012\u201313 FIH Hockey World League not already qualified, the following twelve teams, shown with final pre-tournament rankings, competed in this tournament.", "18 umpires were appointed by the FIH for this tournament.", "\"All times are Central European Summer Time ()\"" ], [ "2014 FIBA Basketball World Cup", "2014 FIBA Basketball World Cup\n\nThe 2014 FIBA Basketball World Cup was the 17th edition of the FIBA Basketball World Cup, the tournament previously known as the FIBA World Championship.", "Hosted by Spain, it was the last tournament to be held on the then-current four-year cycle.", "The next FIBA World Cup will be held five years later, in 2019, to reset the four-year-cycle on a different year than the FIFA World Cup.", "The United States won their fifth world championship, after beating silver medal winning Serbia in the Final.", "France claimed the third place, while Lithuania finished fourth in the tournament.", "FIBA opened the bidding process on 10 January 2008 and all the letters of intent were submitted on 30 April 2008.", "Nine countries showed interest in hosting the event, as in order, they were Spain, France, Denmark, Russia, Saudi Arabia, Qatar, Italy, Greece, and China.", "Among the nine, only three were shortlisted by FIBA: China which would have hosted the 2009 FIBA Asia Championship later that year, Italy which last hosted a FIBA tournament in EuroBasket Women 2007, and FIBA EuroBasket 2007 host Spain.", "On 23 May 2009, after voting by the FIBA Central Board in Geneva in which the Chinese and Spanish representatives abstained, China was the first to be eliminated in the first round of voting." ], [ "2014 FIFA World Cup", "Host nation Brazil, who had won the 2013 FIFA Confederations Cup, lost to Germany 7\u20131 in the semi-finals and eventually finished in fourth place.", "In the final, Germany defeated Argentina 1\u20130 to win the tournament and secure the country's fourth world title, the first after the German reunification in 1990, when as West Germany they also beat Argentina in the World Cup final.", "Germany became the first European team to win a World Cup staged in the Americas, and this result marked the third consecutive title won by a European team, after Italy in 2006 and Spain in 2010.", "In March 2003, FIFA announced that the tournament would be held in South America for the first time since 1978, in line with its then-active policy of rotating the right to host the World Cup among different confederations.", "With the 2010 FIFA World Cup hosted in South Africa, it would be the second consecutive World Cup outside Europe, which was a first for the tournament.", "It was also second in the Southern Hemisphere.", "Only Brazil and Colombia formally declared their candidacy but, after the withdrawal of the latter from the process, Brazil was officially elected as host nation unopposed on 30 October 2007.", "Following qualification matches played between June 2011 and November 2013, the following 32 teams \u2013 shown with their last pre-tournament FIFA world ranking \u2013 qualified for the final tournament." ] ], "gold": "Different sports organized World Cups of their respective disciplines in 2014. The FIFA World Cup, for instance, took place in Brazil, where Germany defeated Argentina 1\u20130 in the final to crown themselves champions. 2014 was also the year when the 13th edition of the Women's Hockey World Cup field hockey tournament took place in The Hague, Netherlands, where the locals won the tournament for a seventh time after defeating Australia 2\u20130 in the final. The 2014 FIBA Basketball World Cup was organized in Spain, with the United States winning their fifth world championship after beating Serbia in the Final.", "prediction 1": "The 2014 FIFA Women's World Cup was the 13th edition of the Women's Hockey World Cup field hockey tournament. It was held from 31 May to 14 June 2014 at the Kyocera Stadion in The Hague, Netherlands. It was the third time that the Netherlands hosted the Women's World Cup after 1986 and 1998. The 2014 FIBA Basketball World Cup was the 17th edition of the FIBA Basketball World Cup, the tournament previously known as the FIBA World Championship. Hosted by Spain, it was the last tournament to be held on the then-current four-year cycle.\n", "prediction 2": "The 2014 FIFA World Cup was a football tournament that was part of the FIFA Confederations Cup series. The group stage took place in Brazil, and the final was held in Germany. The 2014 FIBA Basketball World Cup was the 17th edition of the FIBA Basketball World Cup, the tournament previously known as the FIBA World Championship.", "prediction 3": "The 2014 FIFA World Cup was held in Brazil, the host nation. The group stage of the 2014 FIFA World Cup took place in Brazil from 12 June 2014 to 26 June 2014: each team played three matches. The 2014 Women's Hockey World Cup was the 13th edition of the Women's Hockey World Cup field hockey tournament. It was held from 31 May to 14 June 2014 at the Kyocera Stadion in The Hague, Netherlands. It was the third time that the Netherlands hosted the Women's World Cup after 1986 and 1998.", "prediction 4": "The 2014 FIFA World Cup was the 17th edition of the FIFA Basketball World Cup, the tournament previously known as the FIBA World Championship. It was hosted by Spain, who had previously hosted the 2013 FIFA Confederations Cup. The 2014 Women's Hockey World Cup was the 13th edition of the Women's Hockey World Cup field hockey tournament. It was held from May 31, 2014 to June 14, 2014 in The Hague, The Netherlands. The group stage of the 2014 FIFA World Cup took place in Brazil from June 12, 2014 to June 26, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 172 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 292 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 31 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 446 }, { "error type": "Irrelevant", "explanation": "", "start": 464, "end": 539 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "The FIFA World Cup took place in Brazil, where Germany defeated Argentina 1\u20130. The 13th edition of the Women's Hockey World Cup field hockey tournament was held in The Hague, Netherlands. The Netherlands won tournament for a seventh time after defeating Australia 2\u20130 in the final. The 2014 FIBA Basketball World Cup was hosted by Spain, with the United States winning their fifth world championship after beating Serbia in the Final. \n" }, "preference": [ 1, 0, 2, 2, 2, 2 ] }, { "question": "No of seats of bjp in lok sabha?", "passages": [ [ "Member of parliament, Rajya Sabha", "Member of parliament, Rajya Sabha\n\nA member of parliament in the Rajya Sabha (abbreviated: MP) is the representative of the Indian states to the upper house of the Parliament of India (Rajya Sabha).", "Rajya Sabha MPs are elected by the electoral college of the elected members of the State Assembly with a system of proportional representation by a single transferable vote.", "Parliament of India is bicameral with two houses; Rajya Sabha (Upper house i.e. Council of States) and the Lok Sabha (Lower house i.e. House of the People).", "Total number of members of Rajya Sabha are lesser than member of parliament in the Lok Sabha and have more restricted power than the lower house (Lok Sabha).", "Unlike membership to the Lok Sabha, membership to the Rajya Sabha is permanent for a term of six years cannot be dissolved at any time.", "Broad responsibilities of the members of parliament of Rajya Sabha are; \n\nRajya Sabha enjoys certain special powers which in effect gives special powers and responsibilities to the Rajya Sabha MPs.", "The special powers are;\n\nUnlike membership to the Lok Sabha, membership to the Rajya Sabha is permanent for a term of six years cannot be dissolved at any time." ], [ "Bharatiya Janata Party", "Bharatiya Janata Party\n\nThe Bharatiya Janata Party (; translation: Indian People's Party; BJP) is one of the two major political parties in India, along with the Indian National Congress.", ", it is the country's largest political party in terms of representation in the national parliament and state assemblies, and it is the world's largest party in terms of primary membership.", "BJP is a right-wing party, and its policy has historically reflected Hindu-nationalist positions.", "It has close ideological and organisational links to the Rashtriya Swayamsevak Sangh.", "The BJP's origin lies in the Bharatiya Jana Sangh, formed in 1951 by Syama Prasad Mukherjee.", "After the State of Emergency in 1977, the Jana Sangh merged with several other parties to form the Janata Party; it defeated the incumbent Congress party in the 1977 general election.", "After three years in power, the Janata party dissolved in 1980 with the members of the erstwhile Jana Sangh reconvening to form the BJP.", "Although initially unsuccessful, winning only two seats in the 1984 general election, it grew in strength on the back of the Ram Janmabhoomi movement.", "Following victories in several state elections and better performances in national elections, the BJP became the largest party in the parliament in 1996; however, it lacked a majority in the lower house of Parliament, and its government lasted only 13 days." ] ], "gold": "The Lok Sabha, or House of the People, is the lower house of India's bicameral Parliament, with the upper house being the Rajya Sabha. The Bharatiya Janata Party, the \u2009Indian People's Party, is one of two major political parties in India, along with the Indian National Congress. In the 15th Lok Sabha, the Bharatiya Janata Party had 117 seats. In the 16th Lok Sabha, the number of seats held by the Bharatiya Janata Party was 266 + 1 Speaker. In the 46th Lok Sabha, the Bharatiya Janata Party had 130 seats.", "prediction 1": "The Bharatiya Janata Party is the country's largest political party in terms of representation in the national parliament and state assemblies, and it is the world's largest party in terms of primary membership. BJP has two seats in Lok Sabha. In 2014, BJP won two seats in Lok Sabha. In 2016, BJP won two seats in Lok Sabha.", "prediction 2": "A member of parliament in the Lok Sabha (abbreviated: MP) is the representative of the Indian states to the upper house of the Parliament of India (Rajya Sabha). Total number of members of the Rajya Sabha are lesser than member of parliament in the Lok Sabha and have more restricted power than the Lok Sabha.", "prediction 3": "A member of parliament in the Lok Sabha is the representative of the Indian states to the upper house of the Parliament of India (Rajya Sabha). Total number of members of Rajya Sabha are lesser than member of parliament in the Lok Sabha and have more restricted power than the lower house (Lok Sabha).", "prediction 4": "The Bharatiya Janata Party, or BJP, one of the two major political parties in India, is represented in both the Rajya Sabha and the Lok Sabha. The number of seats of BJP in the Lok Sabha is 76.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 27, "end": 211 }, { "error type": "Unverifiable", "explanation": "", "start": 216, "end": 229 }, { "error type": "Unverifiable", "explanation": "", "start": 244, "end": 284 }, { "error type": "Unverifiable", "explanation": "", "start": 285, "end": 325 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Bharatiya Janata Party is one of the two major political parties in India, along with the Indian National Congress. The upper bicameral house of the Parliament of India is the Rajya Sabha. Lok Sabha is the lower house, also known as the House of the People. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who plays king edward in the white queen?", "passages": [ [ "The White Queen (TV series)", "The White Queen (TV series)\n\nThe White Queen is a British television drama series in ten parts, based on Philippa Gregory's historical novel series \"The Cousins' War\" (\"The White Queen\", \"The Red Queen\", and \"The Kingmaker's Daughter\").", "The first episode was premiered on BBC One on 16 June 2013 in the United Kingdom.", "It was first broadcast in the United States on Starz on 9 August 2013.", "The series is set against the backdrop of the Wars of the Roses and presents the story of the women involved in the long conflict for the throne of England.", "It starts in 1464; the nation has been at war for nine years fighting over who is the rightful king as two sides of the same family, the House of York and the House of Lancaster, contest the throne.", "The story follows three women, Elizabeth Woodville, Margaret Beaufort and Anne Neville, who manipulate events behind the scenes of history to gain power.", "Elizabeth Woodville is the protagonist in the novel \"The White Queen\", and Margaret Beaufort and Anne Neville are the focus of the novels \"The Red Queen\" and \"The Kingmaker's Daughter\"; the three characters appear in the three novels that make up the television series." ] ], "gold": "The White Queen is a British historical television serial drama that was developed for BBC One. The drama takes place against the backdrop of the War of Roses, a long conflict for the throne of England. In the series, King Edward IV is played by Max Irons. The Prince of Wales, who later becomes King Edward V, is played by Sonny Ashbourne Serkis.", "prediction 1": "The White Queen is a British television drama series in ten parts, based on Philippa Gregory's historical novel series The Cousins' War. The White Queen is set against the backdrop of the Wars of the Roses and presents the story of the women involved in the long conflict for the throne of England. In the series, Elizabeth Woodville plays the protagonist in the novel The White Queen, and Margaret Beaufort plays the protagonist in the novels The Red Queen and The Kingmaker's Daughter.", "prediction 2": "The White Queen is a British television drama series in ten parts, based on Philippa Gregory's historical novel series The Cousins' War. The first episode was premiered on BBC One on 16 June 2013. It was first broadcast in the United States on Starz on 9 August 2013.", "prediction 3": "The White Queen is a British television drama series in ten parts, based on Philippa Gregory's historical novel series The Cousins' War. The first episode of season 2 was premiered on BBC One on 16 June 2013. The first episode of season 3 was premiered on Starz on 9 August 2013.", "prediction 4": "The White Queen is a British television drama series in ten parts, based on Philippa Gregory's historical novel series The Cousins' War. The Kingmaker's Daughter is the first American television film to ever be produced by Starz.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 487 } ], "missing-info": [], "corrected-prediction": "The White Queen is a British television drama series. The series is set against the backdrop of the Wars of the Roses and presents the story of the women involved in the long conflict for the throne of England. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Where does an embryo usually attach to its mother?", "passages": [ [ "Menstrual cycle", "If it is not fertilized by a sperm, the secondary oocyte will degenerate.", "The mature ovum has a diameter of about 0.2\u00a0mm.", "Which of the two ovaries\u2014left or right\u2014ovulates appears essentially random; no known left and right co-ordination exists.", "Occasionally, both ovaries will release an egg; if both eggs are fertilized, the result is fraternal twins.", "After being released from the ovary, the egg is swept into the fallopian tube by the fimbria, which is a fringe of tissue at the end of each fallopian tube.", "After about a day, an unfertilized egg will disintegrate or dissolve in the fallopian tube.", "Fertilization by a spermatozoon, when it occurs, usually takes place in the ampulla, the widest section of the fallopian tubes.", "A fertilized egg immediately begins the process of embryogenesis, or development.", "The developing embryo takes about three days to reach the uterus and another three days to implant into the endometrium.", "It has usually reached the blastocyst stage at the time of implantation.", "In some women, ovulation features a characteristic pain called \"mittelschmerz\" (German term meaning \"middle pain\")." ], [ "Umbilical cord", "The umbilical cord in some mammals, including cows and sheep, contains two distinct umbilical veins.", "There is only one umbilical vein in the human umbilical cord.", "In some animals, the mother will gnaw through the cord, thus separating the placenta from the offspring.", "The cord along with the placenta is often eaten by the mother, to provide nourishment and to dispose of tissues that would otherwise attract scavengers or predators.", "In chimpanzees, the mother leaves the cord in place and nurses her young with the cord and placenta attached until the cord dries out and separates naturally, within a day of birth, at which time the cord is discarded.", "(This was first documented by zoologists in the wild in 1974.)", "Some species of shark \u2014 hammerheads, requiems and smooth-hounds \u2014 are viviparous and have an umbilical cord attached to their placenta.", "Animals that lay eggs seem to have a false umbilical-cord that attaches the embryo and yolk together in much the same way.", "The term \"umbilical cord\" or just \"umbilical\" has also come to be used for other cords with similar functions, such as the hose connecting surface-supplied divers to their surface supply of air and/or heating, or space-suited astronauts to their spacecraft." ], [ "Human embryogenesis", "Human embryogenesis\n\nHuman embryogenesis refers to the development and formation of the human embryo.", "It is characterised by the process of cell division and cellular differentiation of the embryo that occurs during the early stages of development.", "In biological terms, human development entails growth from a one-celled zygote to an adult human being.", "Fertilisation occurs when the sperm cell successfully enters and fuses with an egg cell (ovum).", "The genetic material of the sperm and egg then combine to form a single cell called a zygote and the germinal stage of prenatal development commences.", "Embryogenesis covers the first eight weeks of development; at the beginning of the ninth week the embryo is termed a fetus.", "Human embryology is the study of this development during the first eight weeks after fertilisation.", "The normal period of gestation (pregnancy) is nine months or 38 weeks.", "The germinal stage refers to the time from fertilization through the development of the early embryo until implantation is completed in the uterus.", "The germinal stage takes around 10 days.", "During this stage, the zygote begins to divide, in a process called cleavage.", "A blastocyst is then formed and implanted in the uterus." ] ], "gold": "In humans, implantation is the stage of human reproduction at which the embryo adheres to the wall of the uterus. An embryo then attaches to the mother in the placenta through the umbilical cord.", "prediction 1": "The embryo usually attaches to its mother in the uterus, in the endometrium, or lining of the uterine cavity, at the endometrium. The umbilical cord is located in the lower part of the woman's body and is attached to the placenta.", "prediction 2": "The developing embryo usually takes about three days to reach the uterus and another three days to implant into the endometrium. In some animals, the mother will gnaw through the cord, thus separating the placenta from the offspring. Animals that lay eggs seem to have a false umbilical-cord that attaches the embryo and yolk together in much the same way.", "prediction 3": "The developing embryo takes about three days to reach the uterus and another three days to implant into the endometrium. Embryonic attachment is the process of attaching the embryo to its mother.", "prediction 4": "The umbilical cord is a tissue covering the base of the skull and pelvis of the body. The developing embryo takes about three days to reach the uterus and another three days to implant into the endometrium of the uterine wall. The placenta is attached to the umbilical cord by a false umbilical cord, which is found in some animals that lay eggs.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "in the endometrium, ", "start": 110, "end": 129 }, { "error type": "Unverifiable", "explanation": "", "start": 64, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 230 } ], "missing-info": [], "corrected-prediction": "The embryo usually attaches to its mother in the uterus, in the endometrium." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did nigeria become part of the commonwealth?", "passages": [ [ "Commonwealth of Nations", "Nigeria was suspended between 11 November 1995 and 29 May 1999, following its execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM.", "Pakistan was the second country to be suspended, on 18 October 1999, following the military coup by Pervez Musharraf.", "The Commonwealth's longest suspension came to an end on 22 May 2004, when Pakistan's suspension was lifted following the restoration of the country's constitution.", "Pakistan was suspended for a second time, far more briefly, for six months from 22 November 2007, when Musharraf called a state of emergency.", "Zimbabwe was suspended in 2002 over concerns regarding the electoral and land reform policies of Robert Mugabe's ZANU-PF government, before it withdrew from the organisation in 2003.", "On 15 May 2018, Zimbabwe applied to rejoin the Commonwealth.", "The declaration of a Republic in Fiji in 1987, after military coups designed to deny Indo-Fijians political power, was not accompanied by an application to remain.", "Commonwealth membership was held to have lapsed until 1997, after discriminatory provisions in the republican constitution were repealed and reapplication for membership made.", "Fiji has since been suspended twice, with the first imposed from 6 June 2000 to 20 December 2001 after another coup.", "Fiji was suspended yet again in December 2006, following the most recent coup." ], [ "Preamble to the Constitution of India", "External sovereignty or sovereignty in international law means the independence of a state of the will of other states, in her conduct with other states in the committee of nations.", "Sovereign in its relation between states and among states signifies independence.", "The external sovereignty of India means that it can acquire foreign territory and also cede any part of the Indian territory, subject to limitations (if any) imposed by the constitution.", "On the other hand, internal sovereignty refers to the relationship between the states and the individuals within its territory.", "Internal sovereignty relates to internal and domestic affairs, and is divided into four organs, namely, the executive, the legislature, the judiciary and the administrative.", "Though India became a sovereign country on 26 January 1950, having equal status with the other members of the international community, she decided to remain in the Commonwealth of Nations.", "Pandit Nehru declared that India will continue \u2013 \u201cher full membership of the Commonwealth games of Nations and her acceptance of the King as the symbol of the free association of the independent nations and as such the Head of the Commonwealth\u201d.", "Her membership of the Commonwealth of Nations and that of the United Nations Organization do not affect her sovereignty to any extent.", "It is merely a voluntary association of India and it is open to India to cut off this association at her will, and that it has no constitutional significance." ], [ "History of Nigeria", "Following World War II, in response to the growth of Nigerian nationalism and demands for independence, successive constitutions legislated by the British Government moved Nigeria toward self-government on a representative and increasingly federal basis.", "On 1 October 1954, the colony became the autonomous Federation of Nigeria.", "By the middle of the 20th century, the great wave for independence was sweeping across Africa.", "On 27 October 1958 Britain agreed that Nigeria would become an independent state on 1 October 1960.", "The Federation of Nigeria was granted full independence on 1 October 1960 under a constitution that provided for a parliamentary government and a substantial measure of self-government for the country's three regions.", "From 1959 to 1960, Jaja Wachuku was the First Nigerian Speaker of the Nigerian Parliament, also called the \"House of Representatives.\"", "Jaja Wachuku replaced Sir Frederick Metcalfe of Britain.", "Notably, as First Speaker of the House, Jaja Wachuku received Nigeria's Instrument of Independence, also known as Freedom Charter, on 1 October 1960, from Princess Alexandra of Kent, The Queen's representative at the Nigerian independence ceremonies.", "The Federal government was given exclusive powers in defence, foreign relations, and commercial and fiscal policy.", "The monarch of Nigeria was still head of state but legislative power was vested in a bicameral parliament, executive power in a prime minister and cabinet, and judicial authority in a Federal Supreme Court." ] ], "gold": "The Commonwealth of Nations is a voluntary association of 54 sovereign states. Nigeria became part of the commonwealth for the first time on 1 October 1960. Nigeria was suspended between 11 November 1995 and 29 May 1999, following its execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM. They became part of the commonwealth for the second time on 29 May 1999.", "prediction 1": "Nigeria became part of the Commonwealth on 1 October 1960. The Commonwealth of Nations was a body of states that included the Commonwealth of Nations and Commonwealth of Independent States. Nigeria's membership was suspended between 11 November 1995 and 29 May 1999, following its execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM.", "prediction 2": "On 1 October 1960, Nigeria became part of the Commonwealth of Nations under a constitution that provided for a parliamentary government and a substantial measure of self-government for the country's three regions. In contrast, India became a sovereign country on 26 January 1950. Although Nigeria became part of the Commonwealth of Nations on 1 October 1960, the Federal Republic of Nigeria was granted full independence on 1 October 1960.", "prediction 3": "In 1960, Nigeria became part of the Commonwealth of Nations. It was suspended between 11 November 1995 and 29 May 1999 following the execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM. Pakistan was the second country to be suspended, on 18 October 1999, following the military coup by Pervez Musharraf.", "prediction 4": "In 1961, Nigeria became a member of the Commonwealth of Nations by agreeing to join the Games of Nations. However, this was suspended for two years, from 11 November 1995 to 29 May 1999, following the execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM. In 1972, Nigeria became a member of the Commonwealth of Nations after being suspended for two consecutive years. In 2003, Nigeria applied to rejoin the Commonwealth.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 59, "end": 189 } ], "missing-info": [], "corrected-prediction": "Nigeria became part of the Commonwealth on 1 October 1960. Nigeria's membership was suspended between 11 November 1995 and 29 May 1999, following its execution of Ken Saro-Wiwa on the eve of the 1995 CHOGM." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the second most subscribed channel on youtube?", "passages": [ [ "PewDiePie", "A satirical video mocking PewDiePie's content highlighted his usage of such jokes.", "Shortly after, PewDiePie attracted criticism and controversy for the jokes, and in October 2012, he addressed the issue through a Tumblr post, writing, \"I just wanted to make clear that I'm no longer making rape jokes, as I mentioned before I'm not looking to hurt anyone and I apologise if it ever did.\"", "\"The Globe and Mail\" stated \"\"unlike\" many young gamers, he listened when fans and critics alike pointed out their harmful nature, and resolved to stop making rape jokes.\"", "On 18 February 2013, the PewDiePie channel reached 5 million subscribers, and in April, PewDiePie earned coverage on \"The New York Times\" after surpassing 6\u00a0million subscribers.", "In May, at the inaugural Starcount Social Stars Awards in Singapore PewDiePie won the award for Swedish Social Star.", "Competing against Jenna Marbles, Smosh and Toby Turner, PewDiePie also won the award for Most Popular Social Show.", "In July 2013, he overtook Jenna Marbles to become the second most-subscribed YouTube user, and reached 10 million subscribers on 9 July 2013.", "In August, PewDiePie signed with Maker's gaming sub-network, Polaris." ], [ "Smosh", "Smosh\n\nSmosh is an American sketch comedy YouTube channel created by Anthony Padilla and Ian Hecox.", "In 2002, Anthony Padilla created a website named \"smosh.com\" for making flash animations, and he was later joined by his friend Ian Hecox.", "Soon afterward, they began to post videos on Smosh's YouTube channel in the autumn of 2005 and quickly became one of the most popular channels on the site.", ", the Smosh channel has over 7 billion video views and over 23 million subscribers, making it the 31st most subscribed channel on YouTube.", "Since 2005, the Smosh brand has expanded to include other channels, including a channel for animated content (Shut Up!", "Cartoons), a Spanish channel (ElSmosh), a channel focusing on video gaming content (Smosh Games), and a variety channel (Smosh Pit).", "The sketches have also included more actors.", "After Padilla left Smosh to pursue his solo YouTube channel in June 2017, Hecox became the only co-founder that is currently an active member of the Smosh team.", "The Smosh channel has experienced three different spans as the most subscribed YouTube channel.", "The first period spanned from May to June 2006, the second spanned from April 2007 to September 2008, and the third span lasted from January to August 2013." ], [ "History of YouTube", "An algorithm change was made in 2012 that replaced the view-based system for a watch time-based one that is credited for causing a surge in the popularity of gaming channels.", "In October 2012, for the first-time ever, YouTube offered a live stream of the U.S. presidential debate and partnered with ABC News to do so.", "On , The YouTube slogan (Broadcast Yourself) was taken down due to the live stream of the U.S. presidential debate.", "YouTube relaunched its design and layout on December 4, 2012 to be very similar to the mobile and tablet app version of the site.", "On December 21, 2012, Gangnam Style became the first YouTube video to surpass one billion views.", "In March 2013, the number of unique users visiting YouTube every month reached 1 billion.", "In the same year, YouTube continued to reach out to mainstream media, launching YouTube Comedy Week and the YouTube Music Awards.", "Both events were met with negative to mixed reception.", "In November 2013, YouTube's own YouTube channel had surpassed Felix Kjellberg's PewDiePie channel to become the most subscribed channel on the website.", "This was due to auto-suggesting new users to subscribe to the channel upon registration.", "On April 3, 2018, a shooting took place at YouTube headquarters.", "On June 19, 2007, Google CEO Eric Schmidt was in Paris to launch the new localization system." ] ], "gold": "The second most subscribed channel on YouTube is PewDiePie, run by Felix Arvid Ulf Kjellberg. Justin Bieber has the second most subscribed channel on YouTube for an individual, not counting channels that have been made obsolete.", "prediction 1": "The second most subscribed channel on YouTube is Felix Kjellberg's PewDiePie channel. Smosh is an American sketch comedy channel created by Anthony Padilla and Ian Hecox. Smosh has over 7 billion video views and over 23 million subscribers, making it the 31st most subscribed channel on YouTube.", "prediction 2": "YouTube's own channel had surpassed Felix Kjellberg's PewDiePie channel to become the most subscribed channel on the website in November 2013. In July 2013, Smosh overtook PewDiePie to become the second most-subscribed YouTube user, and reached 10 million subscribers on 9 July 2013.", "prediction 3": "PewDiePie is the second most-subscribed user on YouTube. Felix Kjellberg's channel is the second most-subscribed channel on YouTube. Smosh is the American sketch comedy channel created by Anthony Padilla and Ian Hecox.", "prediction 4": "Felix Kjellberg's PewDiePie channel is the second most subscribed channel on YouTube. Smosh is an American sketch comedy channel created by Anthony Padilla and Ian Hecox. During the same period, the Smosh channel had 7 billion video views and over 23 million subscribers, making it the 31st most subscribed channel on YouTube.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 295 } ], "missing-info": [], "corrected-prediction": "The second most subscribed channel on YouTube is Felix Kjellberg's PewDiePie channel. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who plays caleb snyder on as the world turns?", "passages": [ [ "As the World Turns", "As the World Turns\n\nAs the World Turns (often referred to as ATWT) is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010.", "Irna Phillips created \"As the World Turns\" as a sister show to her other soap opera \"Guiding Light\".", "Running for 54 years, \"As the World Turns\" holds the third-longest continuous run of any daytime network soap opera on American television, surpassed only by \"General Hospital\" and \"Guiding Light\".", "\"As the World Turns\" was produced for the first 43 years in Manhattan and in Brooklyn from 2000 until 2010.", "Set in the fictional town of Oakdale, Illinois, the show debuted on April 2, 1956, at 1:30 pm EST.", "Prior to that date, all serials had been 15 minutes in length.", "\"As the World Turns\" and \"The Edge of Night\", which premiered on the same day at 4:30 pm EST, were the first two to be 30 minutes in length from their premiere.", "At first, viewers were indifferent to the new half-hour serial, but ratings picked up in its second year, eventually reaching the top spot in the daytime Nielsen ratings by fall 1958.", "In 1959, the show started a streak of weekly ratings wins that was not interrupted for over 12 years." ] ], "gold": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. Running for 54 years, As the World Turns holds the fourth-longest continuous run of any daytime network soap opera on American television, surpassed only by General Hospital, Guiding Light, and Days of Our Lives. The character of Caleb Snyder was played by Michael David Morrison from 1988-1993 and Graham WInton after 1993.", "prediction 1": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. It was created by Irna Phillips as a sister show to her other soap opera, Guiding Light. Caleb Snyder was played by John Culkin.", "prediction 2": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. Irna Phillips created As the World Turns as a sister show to her other soap opera Guiding Light. Running for 54 years, As the World Turns holds the third-longest continuous run of any daytime network soap opera on American television, surpassed only by \"General Hospital\" and \"Guiding Light\".", "prediction 3": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. The show is a sister show to Irna Phillips' other soap opera, \"Guiding Light\". Irna Phillips created As the World Turns as a sister show to her other soap opera and it aired on CBS for 54 years. Caleb Snyder was played by David L. Johnson.", "prediction 4": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. Irna Phillips created As the World Turns as a sister show to her other soap opera, \"Guiding Light.\" Running for 54 years, \"As the World Turns\" holds the third-longest continuous run of any daytime network soap opera on American television, surpassed only by \"General Hospital\" and \"Guiding Light\".", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 219, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 218 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "As the World Turns is an American television soap opera that aired on CBS for 54 years from April 2, 1956, to September 17, 2010. Running for 54 years, \"As the World Turns\" holds the third-longest continuous run of any daytime network soap opera on American television, surpassed only by \"General Hospital\" and \"Guiding Light\". " }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "The un recognises how many regions in asia?", "passages": [ [ "United Nations Regional Groups", "United Nations Regional Groups\n\nThe United Nations Regional Groups are the geopolitical regional groups of member states of the United Nations.", "Originally, UN member states were unofficially grouped into five geopolitical regional groups.", "What began as an informal means of sharing the distribution of posts for General Assembly committees has taken on a much more expansive role.", "Depending on the UN context, regional groups control elections to UN-related positions, on the basis of geographic representation, as well as coordinate substantive policy, and form common fronts for negotiations and voting.", "The groupings have changed over time.", "From the founding of the United Nations until 1966, the regional groups were: British Commonwealth, Eastern Europe and Asia, Latin America, Middle East and Western Europe.", "In 1966, in response to changes in the UN's membership, decolonisation and strategic realignment, the groups were reorganised as: Asia, Eastern Europe, Africa, Latin America and Caribbean, and Western Europe and Others.", "In 2011, the Asia Group was renamed Asia-Pacific.", "As of May 2014, 192 of the 193 UN member states are divided into five regional groups:\n\n\nKiribati is not included in any of the above-mentioned regional groups (see below for more details)." ], [ "United Nations Regional Groups", "In the rotation of the post of the President of the United Nations General Assembly, the group is eligible for having its nationals elected to this post in years ending with 4 and 9; most recently, Sam Kutesa of Uganda was elected to this position in 2014.", "Member states of the African Group, as of July 2011:\n\nThe Asia-Pacific Group (formerly the Asian Group) has 53 members (27.5% of all UN members) and is the second largest regional group by number of member states (one fewer than the African Group).", "Its territory is composed of much of the continents of Asia and Oceania.", "However, Russia and the Caucasian states are members of the Eastern European Group and Australia, New Zealand, Israel, and Turkey are all members of the Western European and Others Group.", "The Asia-Pacific Group has three seats on the Security Council:", "China's permanent seat, and two non-permanent seats.", "The Group also has 11 seats on the United Nations Economic and Social Council and 13 seats on the United Nations Human Rights Council.", "In the rotation of the post of the President of the United Nations General Assembly, the group is eligible for having its nationals elected to this post in years ending with 1 and 6; most recently, Peter Thomson of Fiji was elected to this position in 2016." ], [ "United Nations Economic and Social Commission for Asia and the Pacific", "United Nations Economic and Social Commission for Asia and the Pacific\n\nThe Economic and Social Commission for Asia and the Pacific (UNESCAP or ESCAP), located in the United Nations Building in Rajadamnern Nok Avenue in Bangkok, Thailand, is one of the five regional commissions of the United Nations Economic and Social Council, under the administrative direction of the United Nations headquarters.", "It was established in 1947 (then as the UN Economic Commission for Asia and the Far East, ECAFE) to encourage economic cooperation among its member states.", "The name was changed to the current in 1974.", "ESCAP has 53 member States and nine Associate members, home to more than two-third of the world population.", "As well as countries in Asia and the Pacific, it includes France, the Netherlands, the United Kingdom and the United States.", "ESCAP's regional focus is managing globalization through programs in environmentally sustainable development, trade, and human rights.", "ESCAP is headed by Executive Secretary Armida Alisjahbana of Indonesia, who succeeded Shamshad Akhtar of Pakistan in September 2018.", "ESCAP works to overcome some of the region's greatest challenges by providing results oriented projects, technical assistance and capacity building to member States in the following areas:" ] ], "gold": "The United Nations Regional Groups are the geopolitical regional groups of member states of the United Nations, which were originally unofficially grouped into five geopolitical regional groups. The UN identifies 1 regional group in Asia and recognizes 53 member states in Asia and the Pacific Group. It is the second largest regional group by number of member states after the African Group. Its territory is composed of much of the continents of Asia and Oceania with the exception of a few countries.", "prediction 1": "The United Nations recognises the number of regions in Asia. Originally, UN member states were unofficially grouped into five geopolitical regional groups. Then, in 1966, in response to changes in the UN's membership, decolonisation and strategic realignment, the groups were reorganised as: Asia, Eastern Europe, Africa, Latin America and Caribbean, and Western Europe and Others. In 2011, the Asia Group was renamed Asia-Pacific. As of May 2014, 192 of the 193 UN member states are divided into five regional groups.", "prediction 2": "There are currently 192 UN member states divided into five geopolitical regional groups of member states of the United Nations. In the past, the United Nations recognised five Asia-Pacific regions. As of May 2014, 192 of the 193 UN member states are divided into five regional groups. The United Nations Economic and Social Commission for Asia and the Pacific (UNESCAP), located in the United Nations Building in Rajadamnern Nok Avenue in Bangkok, Thailand, is one of the five regional commissions of the United Nations Economic and Social Council, under the administrative direction of the United Nations headquarters. The Asia was established in 1947.", "prediction 3": "The United Nations recognises several regions in Asia. The first was the Asia-Pacific region, established in 1947, the second was the Asia-Pacific region, located in the United Nations Building in Rajadamnern Nok Avenue in Bangkok, Thailand. The third is the Asian Economic and Social Commission, which was established in 1991, with six more regions to be added later.", "prediction 4": "The United Nations recognises five regional groups in Asia. As of May 2014, 192 of the 193 UN member states are divided into five regional groups. The ASEAN countries are currently divided into five regional groups. The Asia-Pacific region has 53 members. The United Nations Economic and Social Commission for Asia and the Pacific (UNESCAP), located in the United Nations Building in Rajadamnern Nok Avenue in Bangkok, Thailand, is one of the five regional commissions of the United Nations Economic and Social Council, under the administrative direction of United Nations headquarters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 518 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The United Nations Regional Groups are the geopolitical regional groups of member states of the United Nations, which were originally unofficially grouped into five geopolitical regional groups. The United Nations recognizes the Asian region as being made of 53 members, and it is the second largest regional group by number of member states after the African Group. Its territory is composed of much of the continents of Asia and Oceania." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When did beverly hills cop 2 come out?", "passages": [], "gold": "Beverly Hills Cop 2 premiered in Los Angeles on May 19, 1987. It came out across the United States on May 20, 1987.", "prediction 1": "In 2008, the sequel to the film Beverly Hills Cop 2 came out.", "prediction 2": "The movie Beverly Hills Cop 2 came out on August 27, 2012.", "prediction 3": "The movie Beverly Hills Cop 2 came out on DVD in April 2009.", "prediction 4": "In the UK, BBC Two's The Beverly Hills Cop 2 came out on 30th December 2000. The US version came out on 1st March 2000.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 61 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where is the oldest bristlecone pine tree located?", "passages": [ [ "Prometheus (tree)", "Prometheus (tree)\n\nPrometheus (recorded as WPN-114) was the oldest known non-clonal organism, a Great Basin bristlecone pine (\"Pinus longaeva\") tree growing near the tree line on Wheeler Peak in eastern Nevada, United States.", "The tree, which was at least 4,862 years old and possibly more than 5,000, was cut down in 1964 by a graduate student and United States Forest Service personnel for research purposes.", "Those involved did not know of its world-record age before the cutting, but the circumstances and decision-making process remain controversial.", "The tree's name refers to the mythological figure Prometheus, who stole fire from the gods and gave it to man.", "The designation WPN-114 was given by the original researcher, Donald Rusk Currey, and means it was the 114th tree he sampled in his research in Nevada's White Pine County.", "Prometheus was a living member of a population of bristlecone pine trees near the tree line on the lateral moraine of a former glacier on Wheeler Peak, in Great Basin National Park, eastern Nevada.", "Wheeler Peak is the highest mountain in the Snake Range, and the highest mountain entirely in the state of Nevada." ], [ "Wheeler Peak (Nevada)", "Wheeler Peak (Nevada)\n\nWheeler Peak is the tallest mountain in the Snake Range and in White Pine County, in Nevada, United States.", "The summit elevation of makes it the second-highest peak in Nevada, just behind Boundary Peak.", "With a topographic prominence of , Wheeler Peak is the most topographically prominent peak in White Pine County and the second-most prominent peak in Nevada, just behind Mount Charleston.", "The mountain is located in Great Basin National Park and was named for George Wheeler, leader of the Wheeler Survey of the late 19th century.", "Wheeler Peak has an impressive headwall above a large glacial cirque, large moraines and an active rock glacier.", "The top of the mountain is covered by deep snow most of the year.", "A paved road runs from the Great Basin National Park visitor center to several small camping areas, the highest more than halfway up the mountain.", "The mountain's prominence is due to a Miocene detachment fault that brought the deep Cambrian Prospect Mountain quartzite to the top of the mountain.", "Jeff Davis Peak stands about one mile to the east of Wheeler and reaches \n\nA well-maintained trail, the Wheeler Peak Summit Trail, leads from a trail-head near the end of Wheeler Peak Scenic Drive directly to the summit, making for a hike.", "Afternoon storms are likely during the summer." ] ], "gold": "Located in Wheeler Peak, the tallest mountain in the Snake Range, in Nevada, United States, the Great Basin bristlecone pine trees have been shown to be the oldest bristlecone pine trees. They are almost five millennia old.", "prediction 1": "The oldest known bristlecone pine tree is a tree growing near the tree line on Wheeler Peak in eastern Nevada. The tree was cut down in 1964 by a graduate student and United States Forest Service personnel for research purposes. The designation WPN-114 was given by the original researcher, Donald Rusk Currey, and means it was the 114th tree he sampled in his research in Nevada's White Pine County.", "prediction 2": "The oldest bristlecone pine tree in the world is a tree growing on Wheeler Peak in Great Basin National Park, eastern Nevada. Prometheus is recorded as WPN-114, which is the oldest known non-clonal organism. It was cut down in 1964 by a graduate student and United States Forest Service personnel for research purposes. The designation WPN-114 was given by the original researcher, Donald Rusk Currey, and means it was the 114th tree he sampled in his research in Nevada's White Pine County, in the state of Nevada.", "prediction 3": "The oldest bristlecone pine tree is located at the base of Mount Jefferson in western Wyoming, USA, located on Mount Jefferson. The tree is located in Great Basin National Park, in eastern Nevada. The oldest known non-clonal organism is a Great Basin bristlecone pine, Pinus longaeva, growing near the tree line on Wheeler Peak in eastern Nevada, United States.", "prediction 4": "The oldest known bristlecone pine tree is located near the tree line on Wheeler Peak in Great Basin National Park, eastern Nevada. The tree is at least 4,862 years old and possibly more than 5,000 years old when it was cut down in 1964 by a graduate student and United States Forest Service personnel for research purposes. The designation WPN-114 was given by the original researcher, Donald Rusk Currey, and means it was the 114th tree he sampled in his research in Nevada's White Pine County, in Nevada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 400 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The oldest known bristlecone pine tree is a tree growing near the tree line on Wheeler Peak in eastern Nevada, United States. The tree was at least 4,862 years old and possibly more than 5,000. " }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "Who plays the king of france in the borgias?", "passages": [ [ "Michel Muller", "Michel Muller\n\nMichel Muller (born 9 September 1966 in Vienna) is a French actor, screenwriter and director.", "He is most recently known for playing Charles VIII of France in the television series \"The Borgias\".", "Michel Muller was born 1966 in Vienna, Austria.", "He left graduate school to pursue a career in entertainment.", "He started as a one-man show performer, performing in theaters across France.", "He appeared in various French television series and in minor film roles.", "In 2001, he starred in \"Wasabi\", alongside Jean Reno and Ry\u014dko Hirosue.", "In 2011, he appeared in four episodes of \"The Borgias\", which was broadcast in the United States and Canada.", "He won a Genie Award for Best Supporting Actor in 2007 for his role in \"The Little Book of Revenge (Guide de la petite vengeance)\"." ], [ "The Borgias (2011 TV series)", "The Borgias (2011 TV series)\n\nThe Borgias is a historical-fiction drama television series created by Neil Jordan; it debuted in 2011 and was canceled in 2013.", "The series is set around the turn of the 16th century and follows the Borgia family.", "It stars Jeremy Irons as Pope Alexander VI with Fran\u00e7ois Arnaud as Cesare, Holliday Grainger as Lucrezia and David Oakes as Juan.", "Colm Feore also stars as Cardinal della Rovere (later Pope Julius II).", "It premiered on April 3, 2011, at 9\u00a0p.m. ET on Showtime in the United States and 10\u00a0p.m. Eastern () on Bravo!", "in Canada, and received its first major television network premiere on June 21, 2011, on Canada's CTV Television Network.", "The second season premiered on April 8, 2012.", "On May 4, 2012, Showtime ordered a third season of 10 episodes, which premiered on April 14, 2013.", "On June 5, 2013, Showtime canceled the series, a season short of Jordan's planned four-season arc for the series.", "The cancellation was implied to be due to the expense of production, with plans for a two-hour wrap-up finale also scrapped.", "A fan campaign was started in an attempt to convince Showtime to revive the series." ], [ "The Borgias (2011 TV series)", "On August 12, 2013, it was announced that the two-hour series finale script would be released as an e-book, after it was determined that a movie would be too expensive to produce.", "The series follows the rise of the Borgia family to the pinnacle of the Roman Catholic Church and their struggles to maintain their grip on power.", "The beginning of the first season depicts the election of Rodrigo Borgia to the papacy through simony and bribery, with the help of his sons, Cesare and Juan.", "Upon winning the election, Rodrigo Borgia becomes Pope Alexander VI, which then thrusts him and his family deep into the murky heart of politics in fifteenth-century Europe: from shifting loyalties within the College of Cardinals to the ambitions of the kings of Europe to the venomous rivalries between the noble families of Italy at the time.", "Meanwhile, enraged by his loss of the election to Borgia, Cardinal Giuliano della Rovere travels across Italy and France, seeking allies to depose or kill Alexander: this would force another papal conclave and race for Pope which della Rovere is convinced he would win without Borgia to oppose him.", "The series also follows the complicated sibling relationships between Cesare, Juan and Lucrezia.", "Between Cesare and Juan, there is deep rivalry, with jealousy and resentment on Cesare's side; inferiority and aggression on Juan's." ] ], "gold": "The Borgias, a 2011 historical-fiction drama television series, follows the rise of the Borgia family to the pinnacle of the Roman Catholic Church. To depict the family's struggles to maintain their grip on power, it also deals with several kings of Europe's ambitions, including Charles VIII and Louis XII of France. Michel Muller plays King Charles VIII of France, while King Louis XII of France is played by Serge Hazanavicius.", "prediction 1": "The Borgias is a historical-fiction drama television series created by Neil Jordan, set around the turn of the 16th century and follows the Borgia family and their struggles to maintain their grip on power. Jeremy Irons plays Pope Alexander VI in the first two seasons. In the third and final season, Fran\u00e7ois Arnaud plays Charles VIII of France. In the fourth and final season, Philippe Borgia plays the role of Charles VII of France.", "prediction 2": "There are several television series called The Borgias. The 2011 television series stars Jeremy Irons as Pope Alexander VI, with Fran\u00e7ois Arnaud playing the title role, Holliday Grainger as Lucrezia and David Oakes as Juan.", "prediction 3": "There are multiple \"Borgias\" television series, which are set in 15th-century France. Michel Muller played Charles VIII of France in the 2011 version of the series. He was a screenwriter, director and writer, and was most recently known for playing Charles VII of France in the 2012 adaptation of the television series.", "prediction 4": "The Borgias is a historical-fiction drama television series created by Neil Jordan. It follows the rise of the Borgia family to the pinnacle of the Roman Catholic Church and their struggles to maintain their grip of power. It stars Jeremy Irons as Pope Alexander VI with Fran\u00e7ois Arnaud as Cesare, Holliday Grainger as Lucrezia and David Oakes as Juan. The King of France is played by French actor Michel Muller.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 269 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 323, "end": 346 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 354, "end": 360 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 379, "end": 394 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Borgias is a historical-fiction drama television series and follows the Borgia family's rise to the pinnacle of the Roman Catholic Church. Michel Muller plays the role of Charles VII of France. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who was married to chris tate in emmerdale?", "passages": [ [ "Chris Tate", "Chris eventually formed a bond with Liam and was upset when he was shot dead by Zoe 'rescuing' Chris\n\nIn 2001 Chris married for a third time, to prostitute Charity Dingle.", "However, Zoe didn't like Charity and told Charity it was because of her history, but it soon transpired that Zoe fancied Charity herself.", "She offered Charity money to leave Chris and Charity responded by kissing her.", "The two then famously had a lesbian affair, which lasted for several months.", "Charity became alarmed by Zoe's obsessive behaviour and tried to end the fling, but Zoe secretly recorded Charity confessing to the affair on tape and blackmailed her into signing a prenuptial agreement, so she would always have a hold over her.", "Charity then confessed all to Chris, and he surprised her by forgiving her and ripping up the prenup.", "He later forgave Zoe after she was diagonised with Schizophrenia.", "In 2003 Chris discovered that Charity had had a baby when she was 13 and given it up adoption, after Emily and Paddy Kirk's 13-year-old foster child Debbie Jones claimed she was Charity's daughter.", "He was shocked to discover that Debbie's father was Charity's cousin Cain Dingle.", "In later 2003 he threw Charity out after discovering that she had been having an affair with Cain." ], [ "Chris Tate", "Chris Tate\n\nChris Tate is a fictional character from the British ITV soap opera, \"Emmerdale\", played by Peter Amory.", "The character made his first appearance on 14 November 1989, when he arrived in the village alongside the rest of the Tate family \u2013 his father Frank, stepmother Kim and younger sister, Zoe.", "Initially a decent man, Chris was left permanently resentful of his life after a plane crash in 1993 left him paralyzed from the waist down.", "His storylines on the show included his feuds with his father Frank and his stepmother Kim, as well as his marriages to Kathy Glover, Rachel Hughes and Charity Dingle.", "Chris later learned he had an inoperable brain tumour.", "The character made his final appearance on 18 September 2003, when he committed suicide so as to frame Charity for his murder.", "Chris was initially portrayed as a decent man, but was left permanently resentful of his life after a plane crash in 1993 left him paralyzed from the waist down.", "The character then became much more jaded and bitter, often using his intelligence and assets to exact revenge on those he perceived to have hurt him.", "\"Radio Times\" described Chris as a \"wealthy bad boy\" and \"one of the most complex, conniving characters in \"Emmerdale\" history.\"", "Chris first appeared in November 1989 when his father Frank and stepmother Kim bought Home Farm." ], [ "Chris Tate", "He was the managing director of his father's haulage firm.", "He had owned a flat in Skipdale, but moved into Home Farm soon afterwards to be closer to love interest Kathy Merrick.", "He had a tense relationship with his father Frank Tate (Norman Bowler), partly due to the death of Chris's mother Jean, who had died five years ago from cancer, and Frank's remarriage to his secretary Kim, who was only a few years older than Chris and had been having an affair with Frank whilst Jean was ill.", "Despite the turbulence between father and son, Chris was close to his younger sister, Zoe Tate.", "When Frank admitted he had helped Jean die when she was terminally ill, Chris initially accused Frank and Kim of plotting his mother's death.", "Chris was also unimpressed when Kim persuaded Frank to have an operation to reverse his vasectomy.", "Chris and Kathy began dating and Chris wrote a song for Kathy to sing at a village concert, 'Just This Side of Love' (which was released as a single sung by Malandra Burrows).", "They briefly split up over Chris's gambling habits after he lost his motorbike in a poker match to Alan Turner, but reunite and marry on 5 November 1991.", "The marriage began to break down a year later when Chris found out Kathy knew that Kim was having an affair with village toff", "Rt.", "Hon." ], [ "Tom King (Emmerdale)", "Tom ran King & Sons with his sons, Jimmy, Matthew and Carl, while Jimmy's ambitious wife Sadie (Patsy Kensit) would also prove influential.", "After the Kings established themselves as the new top dogs of the village, replacing the Tates, Tom began searching for a partner.", "He set his eyes on the much younger widow Charity Tate (Emma Atkins), and was overjoyed when she revealed she felt the same way.", "However, while Charity genuinely cared for Tom, he had trouble believing an attractive young woman was really interested in him and not his money - especially as most of the village believed Charity had married her late husband Chris Tate (Peter Amory) for the same reason.", "Things changed when Tom's close friend Roger Dyson (Malcolm Terris) died of a heart attack while playing golf, making him decide life was too short, Tom proposed to Charity and she accepted, and they held a massive engagement party in The Woolpack.", "However, Tom's family, particularly his daughter-in-law Sadie, wereless than impressed, fearing Tom would leave his fortune to Charity rather than them.", "When the day of the wedding eventually arrived, Sadie gave Tom photos of Charity kissing her cousin and lover Cain Dingle (Jeff Hordley)." ] ], "gold": "Christopher Francis \"Chris\" Tate is a fictional character from the British ITV soap opera, Emmerdale, played by Peter Amory. Chris was married three times in the show. He first married local villager Kathy Brookman, portrayed by Malandra Burrows, from 1991-1994. He then married her best-friend Rachel Hughes, portrayed by Glenda McKay, from 1995-1997. In 2001, he married for the third time to prostitute and scheming businesswoman, Charity Dingle, portrayed by Emma Atkins, from 2001-2003. ", "prediction 1": "Chris Tate is a fictional character from the British ITV soap opera Emmerdale. In 1991, Chris married his first wife Kathy Glover, and they had a son together, Jimmy. In 2001, Chris married for a third time, to prostitute Charity Dingle. However, Zoe didn't like Charity and told Charity it was because of her history, but it soon transpired that Zoe fancied Charity herself.\n", "prediction 2": "Chris Tate is a fictional character, who appeared in the British soap opera Emmerdale from November 1989 to September 2003. He was initially portrayed as a decent man, but was left permanently resentful of his life after a plane crash in 1993 left him paralyzed from the waist down. His storylines on the show included his feuds with his father Frank and stepmother Kim, as well as his marriages to Kathy Glover, Rachel Hughes and Charity Dingle. The character committed suicide on 18 September 2003, when he committed suicide so as to frame Charity for her murder. In 2001, Chris married for a third time, to prostitute Charity Dingle.", "prediction 3": "Chris Tate is a fictional character from the British ITV soap opera, Emmerdale, played by Peter Amory. Chris, originally portrayed as a decent man, was left permanently resentful of his life after a plane crash in 1993 left him paralyzed from the waist down. He had a tense relationship with his father Frank Tate and stepmother Kim, who was only a few years older than Chris and had been having an affair with Frank whilst Jean was ill. He had a lot with other characters who were married to Kathy Glover, Rachel Hughes and Charity Dingle.", "prediction 4": "Chris is a fictional character from the British ITV soap opera Emmerdale who was married three times. In 1991, Chris and Kathy Tate were married. In 2000, Chris and Kathy Tate were married to prostitutes Charity Dingle, Rachel Hughes and Anne Woodford.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 376 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 166 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Chris Tate is a fictional character from the British ITV soap opera Emmerdale, played by Peter Amory. In 1991, Chris married his first wife Kathy Glover. In between, he married Rachel Hughes. In 2001, Chris married for a third time, to prostitute Charity Dingle.\n" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who plays jack skeleton in nightmare before christmas?", "passages": [ [ "Jack Skellington", "While trying to save his friends, Jack manages to destroy Oogie and save Christmas.", "Tired of using the same old themes over and over on Halloween, Jack Skellington goes to Doctor Finkelstein, who gives him the Soul Robber, an invention that changes shape.", "Jack decided to leave Halloween Town to get new ideas for Halloween frights.", "When Jack comes back to town, he finds that Oogie Boogie has been resurrected.", "Now Jack has to set things right again.", "Jack dances, fights, and sings in this game to attack Oogie Boogie's minions.", "Jack is portrayed as inept to some degree in this game.", "Chris Sarandon did both the speaking and singing voice for Jack in this game.", "Jack Skellington features in the Nightmare Before Christmas downloadable expansion pack which includes Jack Skellington, Sally, Oogie-Boogie, Dr. Finklestein and the Mayor as in-game playable costumes.", "The downloadable content can be bought from console stores (e.g. the PlayStation Store).", "The package included the costumes of which some could be found in the downloaded level.", "Unlike the worlds originally in the game which all had 3 chapters, the Nightmare Before Christmas world only had 1 chapter called 'Halloween Graveyard'.", "Jack Skellington appears in four installments of the \"Kingdom Hearts\" video game series." ], [ "Jack Skellington", "Jack Skellington\n\nJack Skellington is a character and the main protagonist of the 1993 film \"The Nightmare Before Christmas\".", "Jack is the \"Pumpkin King\" of Halloween Town, a fantasy world based solely on the Halloween holiday.", "Jack is voiced by Chris Sarandon.", "Danny Elfman provided Jack's singing voice in the film, although Sarandon has sung as Jack in subsequent productions.", "His overall appearance is a skeleton dressed in a black pin-striped suit and a bow tie that strongly resembles a black bat.", "Originally, his suit was meant to be completely black, but it blended with the background too well, so it was changed.", "At the beginning of the film, Jack makes his grand entrance by emerging out of a fire-breathing dragon-themed fountain.", "His last name is based on the word \"skeleton\".", "He has a ghost dog named Zero for a pet, who has a small glowing nose that looks like a jack-o'-lantern.", "He is adored by Sally, a rag doll created by Dr. Finklestein.", "The character is a popular design on bags, hats, clothing, umbrellas, belt buckles, pet collars and other items.", "Jack Skellington is the patron spirit of Halloween, portrayed as being on par with Santa Claus and the Easter Bunny within his own holiday." ] ], "gold": "Jack Skellington, main protagonist of the 1993 film The Nightmare Before Christmas, is voiced by Chris Sarandon. Danny Elfman provided Jack's singing voice in the original film and soundtrack album, with Sarandon providing Jack's singing voice in subsequent productions.", "prediction 1": "Jack Skellington is the main protagonist of the 1993 film, The Nightmare Before Christmas. In the 1993 version of the film Jack is voiced by Chris Sarandon. Danny Elfman provided Jack's singing voice in the film, although Sarandon has sung as Jack in subsequent productions. In the 1993 version of the game Nightmare Before Christmas, Jack is voiced by Chris Sarandon.", "prediction 2": "Jack Skellington is the main protagonist of the 1993 film \"The Nightmare Before Christmas\". Jack's overall appearance is a skeleton dressed in a black pin-striped suit and a bow tie that strongly resembles a black bat. Chris Sarandon did both the speaking and singing voice for Jack in this game. Danny Elfman provided Jack's singing voice in the film. Sarandon has sung as Jack in subsequent productions.", "prediction 3": "Jack Skellington is the main protagonist of the 1993 horror film The Nightmare Before Christmas. The character is voiced by Chris Sarandon. Danny Elfman provided Jack's singing voice in the film, although Sarandon has sung as Jack in subsequent productions. Jack's overall appearance is a skeleton dressed in a black pin-striped suit and a bow tie that strongly resembles a black bat.", "prediction 4": "Jack Skellington is the main protagonist of the 1993 film The Nightmare Before Christmas. Jack is voiced by Chris Sarandon. Danny Elfman provided Jack's singing voice in the film, although Sarandon has sung as Jack in subsequent productions. In the 1993 video game Kingdom Hearts, Jack is portrayed as a skeleton dressed in a black pin-striped suit and a bow tie that strongly resembles a black bat. In the 1993 video game, Jack is also a skeleton dressed in a black bat. In the Game Boy Scouts, Jack is voiced by Chris Sarandon.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "In the 1993 version of the film Jack is voiced by Chris Sarandon. ", "start": 275, "end": 368 } ], "missing-info": [], "corrected-prediction": "Jack Skellington is the main protagonist of the 1993 film, The Nightmare Before Christmas. In the 1993 version of the film Jack is voiced by Chris Sarandon. Danny Elfman provided Jack's singing voice in the film, although Sarandon has sung as Jack in subsequent productions. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "The written plan of government for the united states is called the?", "passages": [ [ "United States Constitution", "The document is dated: \"the Seventeenth Day of September in the Year of our Lord\" 1787, and \"of the Independence of the United States of America the Twelfth.\"", "This two-fold epoch dating serves to place the Constitution in the context of the religious traditions of Western civilization and, at the same time, links it to the regime principles proclaimed in the Declaration of Independence.", "This dual reference can also be found in the Articles of Confederation and the Northwest Ordinance.", "The closing endorsement serves an authentication function only.", "It neither assigns powers to the federal government nor does it provide specific limitations on government action.", "It does however, provide essential documentation of the Constitution's validity, a statement of \"This is what was agreed to.\"", "It records who signed the Constitution, and when and where.", "The Constitution has twenty-seven amendments.", "Structurally, the Constitution's original text and all prior amendments remain untouched.", "The precedent for this practice was set in 1789, when Congress considered and proposed the first several Constitutional amendments.", "Among these, Amendments 1\u201310 are collectively known as the Bill of Rights, and Amendments 13\u201315 are known as the Reconstruction Amendments.", "Excluding the Twenty-seventh Amendment, which was pending before the states for , the longest pending amendment that was successfully ratified was the Twenty-second Amendment, which took .", "The Twenty-sixth Amendment was ratified in the shortest time, days." ], [ "History of the United States Constitution", "New Jersey ratified on December 19, 1787, and Georgia on January 2, 1788, both unanimously.", "The requirement of ratification by nine states, set by Article Seven of the Constitution, was met when New Hampshire voted to ratify, on June 21, 1788.", "In New York, fully two thirds of the convention delegates were at first opposed to the Constitution.", "Hamilton led the Federalist campaign, which included the fast-paced appearance of \"The Federalist Papers\" in New York newspapers.", "An attempt to attach conditions to ratification almost succeeded, but on July 26, 1788, New York ratified, with a recommendation that a bill of rights be appended.", "The vote was close \u2013 yeas 30 (52.6%), nays 27 \u2013 due largely to Hamilton's forensic abilities and his reaching a few key compromises with moderate anti-Federalists led by Melancton Smith.", "Following Massachusetts's lead, the Federalist minorities in both Virginia and New York were able to obtain ratification in convention by linking ratification to recommended amendments.", "A minority of the Constitution's critics continued to oppose the Constitution.", "Maryland's Luther Martin argued that the federal convention had exceeded its authority; he still called for amending the Articles." ] ], "gold": "The United States has had more than one written plan of government. The written plan of government for the 13 original states were the Articles of Confederation and Perpetual Union. Drafted after United States gained its independence, its written plan of government has been the United States Constitution, which has served as the supreme law of the United States since it took effect in 1789 and has been amended twenty-seven times.", "prediction 1": "The United States Constitution was ratified on December 19, 1787 and ratified on January 2, 1788, both unanimously. It has twenty-seven amendments, of which the Bill of Rights is the most important.", "prediction 2": "The document is dated: \"the Seventeenth Day of September in the Year of our Lord\" 1787, and \"of the Independence of the United States of America the Twelfth.\" This two-fold epoch dating serves to place the Constitution in the context of the religious traditions of Western civilization and, at the same time, links it to the regime principles proclaimed in the Declaration of Independence. The document has twenty-seven amendments. Structurally, the Constitution's original text and all prior amendments remain untouched.", "prediction 3": "The document is dated: \"the Seventeenth Day of September in the Year of our Lord\" 1787, and \"of the Independence of the United States of America the Twelfth.\" This two-fold epoch dating serves to place the Constitution in the context of the religious traditions of Western civilization and, at the same time, links it to the regime principles proclaimed in the Declaration of Independence. The Constitution has twenty-seven amendments. Structurally, the Constitution's original text and all prior amendments remain untouched.", "prediction 4": "The United States Constitution is the written plan of government for the United States. It is dated: The Seventeenth Day of September in the Year of our Lord 1787, and of the Independence of the United States of America the Twelfth. This two-fold epoch dating serves to place the Constitution in the context of the religious traditions of Western civilization and, at the same time, links it to the regime principles proclaimed in the Declaration of Independence.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,2]}", "start": 35, "end": 115 }, { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 198 } ], "missing-info": [], "corrected-prediction": "The United States Constitution has twenty-seven amendments.." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who played brian in father of the bride?", "passages": [ [ "Father of the Bride (1991 film)", "Father of the Bride (1991 film)\n\nFather of the Bride is a 1991 American comedy film starring Steve Martin, Diane Keaton, Kimberly Williams (in her film debut), George Newbern, Martin Short, B. D. Wong, and Kieran Culkin.", "It is a remake of the 1950 film of the same name.", "Martin portrays George Banks, a businessman and owner of an athletic shoe company (called Side Kicks), who, when he finds out his daughter is getting married, does not want to give her away.", "He eventually learns to live with his new son-in-law and realizes that as long as his daughter is happy, he is happy.", "The film opened to positive reviews, and became a major box office success, earning more than four times its budget.", "With its success, a sequel, \"Father of the Bride Part II\" was released in 1995.", "This was Nancy Meyers and Diane Keaton's second film together, the first being \"Baby Boom\" (1987); the others were \"Father of the Bride Part II\" (1995) and \"Something's Gotta Give\" (2003).", "George Banks is the owner of a successful athletic shoe company called Side Kicks in San Marino, California.", "George narrates what he had to go through with his daughter's wedding." ] ], "gold": "Father of the Bride is the 1991 American comedy film starring George Newbern as Bryan. With its success, a sequel with the same actor, Father of the Bride Part II, was released in 1995.", "prediction 1": "Father of the Bride is a 1991 American comedy film starring Steve Martin, Diane Keaton, Kimberly Williams (in her film debut), George Newbern, Martin Short, B. D. Wong, and Kieran Culkin. The film is a remake of the 1950 film of the same name. Martin plays businessman George Banks, who, when he finds out his daughter is getting married, does not want to give her away. He eventually learns to live with his new son-in-law and realizes that as long as his daughter is happy, he is happy.", "prediction 2": "Father of the Bride is a 1991 American comedy film starring Steve Martin, Diane Keaton, Kimberly Williams, George Newbern, Martin Short, B. D. Wong, and Kieran Culkin. It is a remake of the 1950 film of the same name.", "prediction 3": "The 1991 American comedy film Father of the Bride stars Steve Martin, Diane Keaton, Kimberly Williams in her film debut, George Newbern, Martin Short, B. D. Wong, and Kieran Culkin. The film is a remake of the 1950 film of the same name. Martin plays businessman and owner of an athletic shoe company.", "prediction 4": "There are multiple characters in the 1991 American comedy film Father of the Bride. The main character, Brian, is played by B. D. Wong. The film, which was a remake of the 1950 film of the same name, is directed by Nancy Meyers and directed by Diane Keaton. Martin Short plays Brian in the 1995 sequel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 488 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Father of the Bride is a 1991 American comedy film starring Steve Martin, Diane Keaton, Kimberly Williams (in her film debut), George Newbern, Martin Short, B. D. Wong, and Kieran Culkin. With its success, a sequel, \"Father of the Bride Part II\" was released in 1995." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does the grand canal start and finish?", "passages": [ [ "Grand Canal (China)", "Grand Canal (China)\n\nThe Grand Canal, known to the Chinese as the Beijing\u2013Hangzhou Grand Canal (\"J\u012bng-H\u00e1ng D\u00e0 Y\u00f9nh\u00e9\"), a UNESCO World Heritage Site, is the longest as well as the oldest canal or artificial river in the world and a famous tourist destination.", "Starting at Beijing, it passes through Tianjin and the provinces of Hebei, Shandong, Jiangsu and Zhejiang to the city of Hangzhou, linking the Yellow River and Yangtze River.", "The oldest parts of the canal date back to the 5th century BC, but the various sections were first connected during the Sui dynasty (581\u2013618 AD).", "Dynasties in 1271-1633 significantly rebuilt the canal and altered its route to supply their capital Beijing.", "The total length of the Grand Canal is .", "Its greatest height is reached in the mountains of Shandong, at a summit of 42\u00a0m (138\u00a0ft).", "Ships in Chinese canals did not have trouble reaching higher elevations after the pound lock was invented in the 10th century, during the Song dynasty (960\u20131279), by the government official and engineer Qiao Weiyue." ], [ "Grand Canal (China)", "The reopening of the Grand Canal also benefited Suzhou over Nanjing since the former was in a better position on the main artery of the Grand Canal, and so it became Ming China's greatest economic center.", "The only other viable contender with Suzhou in the Jiangnan region was Hangzhou, but it was located further down the Grand Canal and away from the main delta.", "Even the shipwrecked Korean Choe Bu (1454\u20131504)\u2014while traveling for five months throughout China in 1488\u2014acknowledged that Hangzhou served not as a competitor but as an economic feeder into the greater Suzhou market.", "Therefore, the Grand Canal served to make or break the economic fortunes of certain cities along its route, and served as the economic lifeline of indigenous trade within China.", "The scholar Gu Yanwu of the early Qing dynasty (1644\u20131912) estimated that the previous Ming dynasty had to employ 47,004 full-time laborers recruited by the \"lijia\" corv\u00e9e system in order to maintain the entire canal system.", "It is known that 121,500 soldiers and officers were needed simply to operate the 11,775 government grain barges in the mid-15th century.", "Besides its function as a grain shipment route and major vein of river borne indigenous trade in China, the Grand Canal had long been a government-operated courier route as well." ], [ "Grand Canal (Venice)", "Grand Canal (Venice)\n\nThe Grand Canal ( ; , anciently \"Cana\u0142asso\" ) is a channel in Venice, Italy.", "It forms one of the major water-traffic corridors in the city.", "One end of the canal leads into the lagoon near the Santa Lucia railway station and the other end leads into the basin at San Marco; in between, it makes a large reverse-S shape through the central districts (\"sestieri\") of Venice.", "It is 3.8\u00a0km long, and 30 to 90\u00a0m wide, with an average depth of five meters (16.5\u00a0ft).", "The banks of the Grand Canal are lined with more than 170 buildings, most of which date from the 13th to the 18th century, and demonstrate the welfare and art created by the Republic of Venice.", "The noble Venetian families faced huge expenses to show off their richness in suitable palazzos; this contest reveals the citizens\u2019 pride and the deep bond with the lagoon.", "Amongst the many are the Palazzi Barbaro, Ca' Rezzonico, Ca' d'Oro, Palazzo Dario, Ca' Foscari, Palazzo Barbarigo and to Palazzo Venier dei Leoni, housing the Peggy Guggenheim Collection.", "The churches along the canal include the basilica of Santa Maria della Salute." ] ], "gold": "There are multiple waterways named the Grand Canal. China's Grand Canal, the longest and oldest canal or artificial river in the world, starts in Beijing and finishes in Hangzhou. The Grand Canal in Ireland starts in Shannon Harbour and connects Dublin with the River Shannon, finishing in the Grand Canal Dock. The Grand Canal in Venice leads into the Venetian lagoon near the Santa Lucia railway station on one end and into the basin at San Marco on the other.", "prediction 1": "The Grand Canal, known to the Chinese as the Beijing\u2013Hangzhou Grand Canal, is the longest as well as the oldest canal or artificial river in the world and a famous tourist destination. Starting at Beijing, it passes through Tianjin and the provinces of Hebei, Shandong, Jiangsu and Zhejiang to the city of Hangzhou, linking the Yellow River and Yangtze River. The Grand Canal is also known to the Venetians as the Santa Lucia\u2013San Marco Canal. The Canal, which runs through the city of San Marco.", "prediction 2": "The Grand Canal is a canal in Venice, Italy, that runs from the Santa Lucia railway station to the San Marco basin. The oldest parts of the canal date back to the 5th century BC, but the various sections were first connected during the Sui dynasty (581\u2013618 AD).", "prediction 3": "The Grand Canal, known to the Chinese as the Beijing\u2013Hangzhou Grand Canal, is a UNESCO World Heritage Site. It is the longest as well as the oldest canal or artificial river in the world and a famous tourist destination. Starting at Beijing, it passes through Tianjin and the provinces of Hebei, Shandong, Jiangsu and Zhejiang to the city of Hangzhou, linking the Yellow River and Yangtze River.", "prediction 4": "The Grand Canal, also known to the Chinese as the Beijing\u2013Hangzhou Grand Canal, is the longest as well as the oldest canal or artificial river in the world. Starting at Beijing, it passes through Tianjin and the provinces of Hebei, Shandong, Jiangsu and Zhejiang to the city of Hangzhou, linking the Yellow River and Yangtze River. The most recent section of the Grand Canal began in Beijing in 1921, connecting Tianjin to Hangzhou. The oldest parts of the canal date back to the 5th century BC, but the various sections were first connected during the Song dynasty (960\u20131279\u20131269), by the government official and engineer Qiao Weiyuao Weiyue. The Grand Canal ends at Santa Lucia Railway Station and the other end leads into the basin at San Marco; in between, it forms one of", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 359 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Grand Canal, known to the Chinese as the Beijing\u2013Hangzhou Grand Canal, is the longest as well as the oldest canal or artificial river in the world. The Grand Canal is a channel in Venice. One end of the canal leads into the lagoon near the Santa Lucia railway station and the other end leads into the basin at San Marco." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who sings do you think im a nasty girl?", "passages": [ [ "Nasty Girl (Vanity 6 song)", "Nasty Girl (Vanity 6 song)\n\n\"Nasty Girl\" is a song written and composed by American musician Prince.", "The song was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version.", "Prince gave the songwriting credit to lead singer Vanity, although he was the writer and composer.", "Inaya Day recorded a hit cover version of the song in 2004 that reached number 9 in the UK Singles Chart.", "There have also been several other versions of this song.", "\"Nasty Girl\" was originally recorded by Vanity 6 on the Warner Bros. Records label for their self-titled debut studio album \"Vanity 6\".", "The song was produced by Prince and issued as the album's second single on September 24, 1982.", "Due to its explicit lyrics, \"Nasty Girl\" met with resistance on mainstream American radio, peaking within the US Bubbling Under Hot 100 Singles chart.", "It did, however, become a sizable hit on US R&B radio and it hit number one on the US Hot Dance Club Play chart for four weeks in November 1982.", "The song was knocked off the number one position by Prince's own \"1999.\"" ], [ "Nasty Girl (Nitty song)", "Nasty Girl (Nitty song)\n\n\"Nasty Girl\" is a hip hop song by American rapper Nitty.", "It is the third track on his album \"Player's Paradise\".", "It reached number one in Australia.", "There are four verses, including three similar verses and a different final verse.", "The chorus of the song is an interpolation of the 1969 hit song \"Sugar, Sugar\" by The Archies.", "The music video features Nitty driving his red Cadillac convertible to a gas station.", "Here, two girls fill his car while Nitty begins to sing.", "In the 2008 film, \"Sex Drive\", the song can be heard when Ian, played by Josh Zuckerman, find outs that Ms. Tasty, played by Katrina Bowden, \"wants the D\"." ], [ "Nitty (musician)", "Nitty (musician)\n\nFrank Ross (born December 23, 1977), better known by stage name Nitty, is an American hip hop recording artist from The Bronx, New York.", "He is perhaps best known for his debut single \"Nasty Girl\" and his pop rap style of hip hop, which he calls \"playboy rap\".", "His singles include \"Nasty Girl\" and \"Hey Bitty,\" the former reaching #1 in sales in the United States in October 2004, and also debuting at #1 in Australia in 2005.", "The following album, \"Player's Paradise\", was released in 2005.", "In an interview with the former Australian music television show \"So Fresh\", Nitty explained that he did not want to jump into rap as a mean, edgy type of rapper that is the current trend, but more of a nice-guy rapper, with lighthearted songs and videos.", "He calls this style \"playboy rap.\"", "Since \"Player's Paradise\" Nitty has gone on to continue his career as a producer.", "He is currently an independent artist.", "In the recent film \"Sex Drive\", his song \"Nasty Girl\" was on the soundtrack." ] ], "gold": "There are several \"Nasty Girl\" songs. One \"Nasty Girl\" is a song written and composed by American musician Prince. The song was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version. One \"Nasty Girl\" is a song by American rapper Nitty which was the third track on his second studio album, Player's Paradise (2005), on August 30, 2004. Another \"Nasty Girl\" is a song by rapper The Notorious B.I.G. that was released in 2005 in the US and on January 16, 2006 in the UK. Another \"Nasty Girl\" is a song by American recording group Destiny's Child from their third studio album, Survivor.", "prediction 1": "\"Nasty Girl\" is a song written and composed by American musician Prince. The song was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version. Nasty Girl is also a hip hop song by American rapper Nitty. It is the third track on his album Player's Paradise. There are four verses, including three similar verses and a different final verse. In the 2008 film, Sex Drive, the song can be heard when Ian, played by Josh Zuckerman, finds out that Ms. Tasty, played by Katrina Bowden, \"wants the D\".", "prediction 2": "\"Nasty Girl\" is a song written and composed by American musician Prince that was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version. Nasty Girl is also a hip hop song by American rapper Nitty. It is the third track on his album Player's Paradise, and reached number one in Australia. In the 2008 film, Sex Drive, the song can be heard when Ian, played by Josh Zuckerman, finds out that Ms. Tasty, played by Katrina Bowden, wants the D.", "prediction 3": "\"Nasty Girl\" is a song written and composed by American musician Prince. The song was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version. \"Nasty Girl\" is also a hip hop song by American rapper Nitty. It is the third track on his album Player's Paradise and reached number one in Australia. In the 2008 film, \"Sex Drive\", the song can be heard when Ian, played by Josh Zuckerman, finds out that Ms. Tasty, played by Katrina Bowden, wants the D.", "prediction 4": "\"Nasty Girl\" is a song by American hip hop recording artist Nitty. It is the third track on his album Player's Paradise. \"Nasty Girl\" is also a song by his prot\u00e9g\u00e9 girl group Vanity 6. Inaya Day recorded a hit cover version of the song in 2004 that reached number 9 in the UK Singles Chart. In the 2008 film, \"Sex Drive\", the song can be heard when Ian, played by Josh Zuckerman, finds outs that Ms. Tasty, played by Katrina Bowden, \"wants the D.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 423 }, { "error type": "Irrelevant", "explanation": "", "start": 424, "end": 577 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Nasty Girl\" is a song written and composed by American musician Prince. The song was first recorded by his prot\u00e9g\u00e9 girl group Vanity 6 in 1982, who charted at number one on the US Hot Dance Club Play chart with their version. Nasty Girl is also a hip hop song by American rapper Nitty. It is the third track on his album Player's Paradise (2005). " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When is the fractured but whole coming out?", "passages": [ [ "South Park: The Fractured but Whole", "The New Kid and up to three allies fight their enemies using attacks including melee, ranged, and powerful farts.", "Battles take place on a grid, around which participants can move freely.", "Attacks have specific areas of effect, requiring tactical positioning for attack and defense.", "Following Ubisoft's purchase of the rights to \"The Stick of Truth\" in 2013, the company moved development of the sequel from Obsidian Entertainment to Ubisoft San Francisco.", "\"South Park\" creators Trey Parker and Matt Stone were unsure whether to make a sequel to the 2014 game or work on a new film project, opting for the game.", "Parker and Stone were involved throughout the game's production; they wrote its script, consulted on the design, and voiced many of the characters.", "The show's composer Jamie Dunlap worked on the game's soundtrack alongside Ubisoft San Francisco, creating music that was heavily inspired by the scores of several superhero films.", "Like its predecessor, the release of \"The Fractured but Whole\" was subject to several delays.", "The game was initially set for release in December 2016 but it was postponed for nearly a year.", "It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017.", "The game received generally positive reviews, which praised the improvements and creativity of combat scenarios and faithfulness to the source material." ], [ "South Park: The Fractured but Whole", "Developed internally at Ubisoft as a joke about a fake prop the team would promote as real, the team decided to develop the item.", "Nosulus Rift, which was not released for sale publicly, would release a fart smell to create an olfactory-immersive experience.", "Ubisoft ran the worldwide \"I am the fart\" competition in October 2017; the jury, which included British flatulist Mr. Methane, judged videos of entrants farting and selected an overall winner, who would be flown to Ubisoft San Francisco to record their fart sound for inclusion into \"The Fractured but Whole\".", "A twelve-character series of collectible figures based on \"The Fractured but Whole\" cast was also released.", "A Nintendo Switch version, adapted by Ubisoft Pune, was released on April 24, 2018.", "First broadcast in October 2017, \"South Park\" episode \"Franchise Prequel\" serves as a narrative prequel to the game and features the characters wearing outfits and acting out roles similar to those in the game.", "In the episode, Coon and Friends attempt to launch their superhero media franchise but are derailed by Professor Chaos, who launches a plot to spread fake news on Facebook about the boys.", "Chaos is defeated but the boys are divided over their media franchise, leading into the events of \"The Fractured but Whole\"." ], [ "South Park: The Fractured but Whole", "South Park: The Fractured but Whole\n\nSouth Park: The Fractured but Whole is a 2017 role-playing video game developed by Ubisoft San Francisco and published by Ubisoft in collaboration with South Park Digital Studios.", "Based on the American adult animated television series \"South Park\", it is the sequel to the 2014 video game \"\".", "The game's narrative occurs one day after the events of its predecessor; it follows the New Kid, who has recently moved to South Park and becomes involved in an epic roleplay involving two rival superhero factions vying to create their own superhero media franchises.", "The superheroes' game unintentionally uncovers a conspiracy to raise crime in the town, bringing them into conflict with supervillains, genetically engineered monsters, the police, crime families, and the new kingpin of crime.", "The game is played from a 2.5D third-person perspective, replicating the aesthetic of the television series.", "The New Kid is able to freely explore South Park, interacting with characters, undertaking quests, and accessing new areas by progressing through the main story.", "The player can choose from up to ten superhero archetypes ranging from high-speed Speedsters, close-combat Brutalists, powerful Psychics, and healing Plantmancers; each offering unique abilities." ] ], "gold": "South Park: The Fractured but Whole is a role-playing video game published by Ubisoft, based on the American adult animated television series South Park and acting as the sequel to the 2014 video game South Park: The Stick of Truth. Like its predecessor, the release of \"The Fractured but Whole\" was subject to several delays. The game was initially set for release in December 2016 but it was postponed for nearly a year. It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017, and later in April 24, 2018 for the Nintendo Switch.", "prediction 1": "The South Park: The Fractured but Whole is a 2017 role-playing video game developed by Ubisoft San Francisco and published by Ubisoft in collaboration with South Park Digital Studios based on the American animated television series South Park. It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017.", "prediction 2": "The South Park: The Fractured but Whole is a 2017 role-playing video game. It was developed by Ubisoft San Francisco and published by Ubisoft in collaboration with South Park Digital Studios. The game's narrative occurs one day after the events of its predecessor. It follows the New Kid, who has recently moved to South Park and becomes involved in an epic roleplay involving two rival superhero factions vying to create their own superhero media franchises. The game's release date is October 17, 2017.", "prediction 3": "South Park: The Fractured but Whole is a 2017 role-playing video game developed by Ubisoft San Francisco and published by Ubisoft in collaboration with South Park Digital Studios. It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017.", "prediction 4": "The Fractured but Whole is a 2017 role-playing video game developed by Ubisoft San Francisco and published by Ubisoft in collaboration with South Park Digital Studios. It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 182 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The South Park: The Fractured but Whole is a 2017 role-playing video game developed by Ubisoft and is based on the American animated television series South Park. It is also the sequel to the 2014 game, \"The Stick of Truth\". Like its predecessor, the release of \"The Fractured but Whole\" was subject to several delays. The game was initially set for release in December 2016 but it was postponed for nearly a year. It was released worldwide for Microsoft Windows, PlayStation 4, and Xbox One on October 17, 2017. A Nintendo Switch version was released on April 24, 2018." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Where was legends of the fall movie filmed?", "passages": [ [ "Legends of the Fall", "\"Legends of the Fall\" was primarily filmed on location in Alberta and British Columbia, Canada.", "Principal photography began in mid-September 1993.", "The World War I battlefield scenes took two weeks to film and were shot near Morley, Alberta, with hundreds of locals and a few Canadian Forces soldiers recruited as extras.", "The Ghost River Wilderness Area in Alberta served as the filming location for the Ludlow ranch; additional outdoor scenes, as well as the funeral and cemetery scenes, were shot at the Bow River near Banff National Park.", "A historic harbour area in Vancouver called Gastown was augmented with period building facades for the Helena, Montana street scenes.", "Hotel scenes were shot at the Hotel Europe at 43 Powell Street in Vancouver.", "Additional scenes were shot at Maple Leaf Square in Gastown, Vancouver, and Ocho Rios in Saint Ann, Jamaica.", "Filming wrapped up around January 1994.", "The film opened in limited release on December 23, 1994, and expanded to a wide release on January 13, 1995.", "During its first weekend in wide release, which was a four-day weekend due to Martin Luther King, Jr. Day, the film reached number one at the domestic box office after grossing $14 million.", "After its initial run, the film brought in a final box office total of $160,638,883.", "Against its $30 million budget, the film was a financial success." ], [ "Legends of the Fall", "Legends of the Fall\n\nLegends of the Fall is a 1994 American epic historical drama film directed by Edward Zwick and starring Brad Pitt, Anthony Hopkins, Aidan Quinn, Julia Ormond and Henry Thomas.", "Based on the 1979 novella of the same title by Jim Harrison, the film is about three brothers and their father living in the wilderness and plains of Montana in the early 20th century and how their lives are affected by nature, history, war, and love.", "The film's time frame spans from World War I through the Prohibition era, ending with a brief scene set in 1963.", "The film was nominated for three Academy Awards and won for Best Cinematography (John Toll).", "Both the film and book contain occasional Cornish language terms, the Ludlows being a Cornish emigrant family.", "Sick of betrayals the United States government perpetrated on the Native Americans, Colonel William Ludlow leaves the Army and moves to a remote part of Montana.", "Along with One Stab, a Cree friend, he builds a ranch and raises his family.", "Accompanying them are hired hand and former outlaw Decker, Decker's Cree wife Pet, and daughter Isabel Two.", "William has three sons: Alfred, the eldest, is responsible and cautious; Tristan, the Colonel's favorite son, is wild and well-versed in American Indian traditions; Samuel, the youngest, is educated but naive and constantly watched over by his brothers." ] ], "gold": "Legends of the Fall is a 1994 American epic historical drama Western film about the Ludlow family who lived in the wilderness and plains of Montana in the early 20th Century. However, the film was primarily filmed in Alberta and British Columbia, Canada. The scenes of the Ludlow Ranch were filmed in the Ghost River Wilderness Area. Scenes that included period buildings were shot in historic Gastown, Vancouver, with the hotel scenes being shot at the Hotel Europe at 43 Powell Street in Vancouver. The World War One battlefield scenes were shot near Morley, Alberta.", "prediction 1": "Legends of the Fall movie was filmed primarily on location in Alberta and British Columbia, Canada. The World War I battlefield scenes took two weeks to film and were shot near Morley, Alberta, with hundreds of locals and a few Canadian Forces soldiers recruited as extras. Additional outdoor scenes, as well as the funeral and cemetery scenes, were shot at the Bow River near Banff National Park. A historic harbour area in Vancouver called Gastown was augmented with period building facades for the Helena, Montana street scenes. Hotel scenes were shot at the Hotel Europe at 43 Powell Street in Vancouver. Additional scenes were shot at Maple Leaf Square in Gastown, Vancouver, Vancouver, and Ocho Rios in Saint Ann, Jamaica.", "prediction 2": "Legends of the Fall is a 1994 American epic historical drama film directed by Edward Zwick and starring Brad Pitt, Anthony Hopkins, Aidan Quinn, Julia Ormond and Henry Thomas. Filming for the film began in mid-September 1993 and the World War I battlefield scenes took two weeks to film and were shot near Morley, Alberta, with hundreds of locals and a few Canadian Forces soldiers recruited as extras. Additional outdoor scenes, as well as the funeral and cemetery scenes, were shot at the Bow River near Banfffffffffffffffflin, Montana street scenes were shot at the Hotel Europe at 43 Powell Street in Vancouver. Additional scenes were shot at Maple Leaf Square in Gastown, Vancouver, Vancouver, Vancouver, and Ocho Rios in Saint Ann, Jamaica.", "prediction 3": "Legends of the Fall is a 1994 American epic historical drama film directed by Edward Zwick and starring Brad Pitt, Anthony Hopkins, Aidan Quinn, Julia Ormond and Henry Thomas. Filming for the film was primarily done on location in Alberta and British Columbia, Canada, with some scenes taking place in the Ghost River Wilderness Area in Alberta. Additional outdoor scenes were also filmed near Banff National Park, the Bow River, and the Bow River.", "prediction 4": "Legends of the Fall is a 1994 American epic historical drama film directed by Edward Zwick and starring Brad Pitt, Anthony Hopkins, Aidan Quinn, Julia Ormond and Henry Thomas. It was primarily filmed on location in Alberta and British Columbia, Canada. The World War I battlefield scenes took two weeks to film and were shot near Morley, Alberta, with hundreds of locals and a few Canadian Forces soldiers recruited as extras. Additional outdoor scenes, as well as the funeral and cemetery scenes, were shot at the Bow River near Banffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 397 }, { "error type": "Irrelevant", "explanation": "", "start": 609, "end": 728 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 273 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Legends of the Fall is a 1994 American epic historical drama Western film about the Ludlow family who lived in the wilderness and plains of Montana in the early 20th Century. Legends of the Fall movie was filmed primarily on location in Alberta and British Columbia, Canada. The Ghost River Wilderness Area in Alberta served as the filming location for the Ludlow ranch. The World War I battlefield scenes took two weeks to film and were shot near Morley, Alberta. A historic harbour area in Vancouver called Gastown was augmented with period building facades for the Helena, Montana street scenes. Hotel scenes were shot at the Hotel Europe at 43 Powell Street in Vancouver. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is the army navy game played in philadelphia?", "passages": [ [ "Army\u2013Navy Game", "Philadelphia is typically selected as the site due to the historic nature of the city and the fact that it is approximately halfway between West Point and Annapolis.", "For decades, the Pennsylvania Railroad and its successors offered game-day service to all Army\u2013Navy games in Philadelphia using a sprawling temporary station constructed each year near Municipal Stadium on the railroad's Greenwich freight yard.", "The service, with 40-odd trains serving as many as 30,000 attendees, was the single largest concentrated passenger rail movement in the country.", "All games contested in Philadelphia through 1935 were played at Franklin Field, the home field of the University of Pennsylvania.", "From 1936 through 1979, all games contested in Philadelphia were held in Municipal Stadium, renamed John F. Kennedy Stadium in 1964.", "From 1980-2001, all games contested in Philadelphia were hosted by Veterans Stadium.", "Since 2003, all games contested in Philadelphia have been played in Lincoln Financial Field.", "In these games, Navy holds a 10-2 advantage, although the last game was won by Army.", "Only six games have ever been held on the campus of either academy, primarily because neither team plays at an on-campus stadium large enough to accommodate the large crowds that attend the game.", "Army's Michie Stadium seats only 38,000, while Navy's Navy\u2013Marine Corps Memorial Stadium seats only 34,000." ], [ "Army\u2013Navy Game", "Army\u2013Navy Game\n\nThe Army-Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy (USNA) at Annapolis, Maryland.", "The Black Knights (alternatively, the \"Cadets\") and Midshipmen each represent their service's oldest officer commissioning sources.", "As such, the game has come to embody the spirit of the interservice rivalry of the United States Armed Forces.", "The game marks the end of the college football regular season and the third and final game of the season's Commander-in-Chief's Trophy series, which also includes the Air Force Falcons of the United States Air Force Academy (USAFA) near Colorado Springs, Colorado.", "The Army\u2013Navy game is one of the most traditional and enduring rivalries in college football.", "It has been frequently attended by sitting U.S. presidents.", "The game has been nationally televised each year since 1945 on either ABC, CBS, or NBC.", "CBS has televised the game since 1996 and has the rights to the broadcast through 2028.", "Instant replay made its American debut in the 1963 Army\u2013Navy game.", "Since 2009, the game has been held on the Saturday following FBS conference championship weekend." ], [ "Army\u2013Navy Game", "The game has been held in multiple locations, but outside the 1926 game in Chicago and 1983 game in Pasadena, California, it has been played in the Northeast megalopolis, most frequently in Philadelphia, followed by the New York area and the Baltimore\u2013Washington area.", "The series has been marked by several periods of domination by one team or the other, with Navy's 14-game winning streak from 2002 through 2015 being the longest for either side.", "Through the 2018 meeting, Navy leads the series 60\u201352\u20137, but has lost the last three games.", "Army and Navy first met on the field on November 29, 1890.", "They played 30 times between that date and November 26, 1927.", "The series has been renewed annually since 1930.", "The game has been held at several locations throughout its history, including Baltimore and New York City, but has most frequently been played in Philadelphia, roughly equidistant from the two academies.", "Historically played on the Saturday after Thanksgiving (a date on which most other major college football teams end their regular seasons), the game is now played on the second Saturday in December and is traditionally the last game of the season for both teams and the last regular-season game played in Division", "I FBS football." ] ], "gold": "The Army\u2013Navy Game is an college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy (USNA) at Annapolis, Maryland. They first met in 1890 and have been meeting annually since 1930. The most frequent location of play has been Philadelphia, which is roughly equidistant between the two academies. The game was played in Municipal stadium, renamed John F. Kennedy Stadium from 1936 to 1979. from 1980 to 2001 Veterans Stadium hosted. Since 2003 Lincoln Financial Field has been the location. ", "prediction 1": "The Army\u2013Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy (USNA) at Annapolis, Maryland. It is played in Lincoln Financial Field, near the University of Pennsylvania, and is typically selected as the site due to the historic nature of the city and the fact that it is approximately halfway between West Point and Annapolis. The game is typically played on Saturdays between December 2 and is traditionally the last game of the season for both teams and the last regular-season game played in Division I FBS football.", "prediction 2": "The Army\u2013Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy at Annapolis, Maryland. Historically played on the Saturday after Thanksgiving, the game is now played on the second Saturday in December and is traditionally the last game of the season for both teams and the last regular-season game played in Division I FBS football. For decades, the Pennsylvania Railroad and its successors offered game-day service to all Army\u2013Navy games in Philadelphia. For decades, the railroad and its successors offered game-day service to all Army\u2013Navy games in Philadelphia using a sprawling temporary station constructed each year near Municipal Stadium on the railroad's Greenwich freight yard. From 1936 through 1979, all games contested in Philadelphia were held in Municipal Stadium, renamed John F. Kennedy", "prediction 3": "The Army\u2013Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy (USNA) at Annapolis, Maryland. The Army\u2013Navy game is played in Philadelphia, Pennsylvania from November 29\u2013December 7, 2018.", "prediction 4": "Army\u2013Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy at West Point, New York, and the Navy Midshipmen of the United States Naval Academy at Annapolis, Maryland. Most frequently, the Army\u2013Navy Game is played in Philadelphia, roughly equidistant from the two academies. Army and Navy first met on the field on November 29, 1890. They played 30 times between that date and November 26, 1927. Historically played on the Saturday after Thanksgiving, the game is now played on the second Saturday in December, and is traditionally the last game of the season for both teams.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 489 }, { "error type": "Irrelevant", "explanation": "", "start": 490, "end": 682 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Army\u2013Navy Game is an American college football rivalry game between the Army Black Knights of the United States Military Academy (USMA) at West Point, New York, and the Navy Midshipmen of the United States Naval Academy (USNA) at Annapolis, Maryland. Army and Navy first met on the field on November 29, 1890. The series has been renewed annually since 1930. The most frequent location of play has been Philadelphia, which is roughly equidistant between the two academies. From 1936 through 1979, all games contested in Philadelphia were held in Municipal Stadium, renamed John F. Kennedy Stadium in 1964. From 1980-2001, all games contested in Philadelphia were hosted by Veterans Stadium. Since 2003, all games contested in Philadelphia have been played in Lincoln Financial Field. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who has won the european cup the most?", "passages": [ [ "Liverpool F.C. in European football", "Liverpool F.C. in European football\n\nLiverpool Football Club, an English professional association football club, is Britain's most successful team in Union of European Football Associations (UEFA) competitions.", "Since 1964, they have won eleven European trophies: the UEFA Champions League (formerly known as the European Cup) five times, the UEFA Europa League (formerly known as the UEFA Cup) three times, and the UEFA Super Cup three times.", "Qualification for European competitions is determined by a team's success in its domestic league and cup competitions from the previous season.", "Liverpool competed in European competitions for 21 consecutive seasons until the 1985 European Cup Final, the occasion of the Heysel Stadium disaster, following which the club was banned from European competitions for six seasons.", "Since being readmitted in 1991, they have qualified for the Champions League (the successor to the European Cup) nine times and the Europa League (the successor to the Uefa Cup) nine times.", "As a result of their victory in the 2005 UEFA Champions League Final, Liverpool won the European Champion Clubs' Cup trophy outright, and were awarded a multiple winner badge.", "Liverpool's total of three UEFA Cup wins has been bettered only by Sevilla, who have won the competition five times.", "They have also won the UEFA Super Cup on three occasions, a total only Milan and Barcelona (five titles each) have bettered." ], [ "Wales at the UEFA European Championship", "Wales at the UEFA European Championship\n\nThis is a record of Wales' results at the UEFA European Championship.", "The UEFA European Championship, previously known at European Nations' Cup, is an international association football competition contested by the men's national teams of the members of \"Union of European Football Associations\" (UEFA), the administrative body for association football in Europe.", "The championship has been awarded every four years, since the first tournament in 1960.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"UEFA Euro Finals\").", "The qualification phase, which currently take place over the three years preceding the Finals, is used to determine which teams qualify for the Finals.", "The current format of the Finals involves 24 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "Wales have only qualified once for a UEFA European Championship \u2014 the Euro 2016 tournament.", "They directly qualified after securing the second spot in their qualifying group, with one group match left.", "For the draw of the end stage that took place on 12 December 2015, they were seeded in Pot 4.", "In their first tournament, Wales reached the semi-finals before losing 0\u20132 to Portugal, who went on to win the final." ], [ "France national football team", "The France team won their first World Cup title in 1998.", "The tournament was played on home soil and France defeated Brazil 3\u20130 in the final match.", "In 2006, France finished as runners-up losing 5\u20133 on penalties to Italy.", "The team has also finished in third place on two occasions in 1958 and 1986 and in fourth place once in 1982.", "The team's worst results in the competition were first-round eliminations in 2002 and 2010.", "In 2002, the team suffered an unexpected loss to Senegal and departed the tournament without scoring a goal, while in 2010, a French team torn apart by conflict between the players and staff lost two of three matches and drew the other.", "In 2014, France advanced to the quarterfinal before losing to the eventual champion, Germany, 1\u20130.", "In 2018, France defeated Croatia 4\u20132 in the final match and won the World Cup for the second time.", "France is one of the most successful nations at the UEFA European Championship having won two titles in 1984 and 2000.", "The team is just below Spain and Germany who have won three titles each.", "France hosted the inaugural competition in 1960 and have appeared in nine UEFA European Championship tournaments, tied for fourth-best.", "The team won their first title on home soil in 1984 and were led by Ballon d'Or winner Michel Platini." ] ], "gold": "There are three similarly named European football tournaments organized by the UEFA and commonly known as the European Cup, the European Championship, the Champions League and the Europa League. The first one is contested by the men's national teams of the members of the UEFA and takes place every four years. Germany and Spain are the most successful teams in the history of the tournament, winning three times each. The Champions League and the Europa League are played annually among the clubs of each of the member countries and have Real Madrid as the team with most Champions League titles, with a total of 13, and Sevilla as the one with more Europa League championships, having won it 6 times.", "prediction 1": "The UEFA European Cup, previously known as the European Nations' Cup, is an international association football competition contested by the men's national teams of the members of the Union of European Football Associations (UEFA), the administrative body for association football in Europe. Spain has won the most UEFA European Cups, the most UEFA Champions Leagues, the most UEFA Europa Leagues, and the most UEFA Super Cups. England has won the most UEFA Super Cups, and France has won the most European Cups.", "prediction 2": "The UEFA European Cup, formerly known as the European Nations' Cup, is an international association football competition contested by the men's national teams of the members of the Union of European Football Associations (UEFA). The most successful team at the UEFA European Cup is France, with two titles in 1984 and 2000, just below Spain and Germany, who have won three titles each.", "prediction 3": "The UEFA European Cup, previously known at European Nations' Cup, is an international association football competition contested by the men's national teams of the members of the \"Union of European Football Associations\" (UEFA). The team that has won the most UEFA cups is France, with two titles in 1984 and 2000. The English professional association football club Liverpool has won the most UEFA Champions League trophies, five times, the UEFA Europa League, three times, and the UEFA Super Cup, three times.", "prediction 4": "The European Cup is an international association football competition contested by the men's national teams of the members of the \"Union of European Football Associations\", the administrative body for association football in Europe. England have won the most european cups; the England national football team has won the most European cups, with five titles. The most European Cup winners are: the UEFA Champions League, with five, the UEFA Europa League, with three, and the UEFA Super Cup, with three.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 290 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 9, "end": 22 }, { "error type": "Unverifiable", "explanation": "", "start": 367, "end": 396 }, { "error type": "Unverifiable", "explanation": "", "start": 305, "end": 333 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 469, "end": 511 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 427, "end": 468 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The UEFA European Championships, previously known as the European Nations' Cup, is an international association football competition contested by the men's national teams of the members of the Union of European Football Associations (UEFA). Spain has won the most UEFA Championships, tied with Germany, and the most UEFA Super Cups,tied with Italy. The most UEFA Cup wins has been by Sevilla, who have won the competition five times." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who has won the most trophies celtic or rangers?", "passages": [ [ "Football records in Scotland", "Football records in Scotland\n\nFootball in Scotland is a popular professional sport.", "Founded in 1873, Scotland has the second oldest national football association in the world.", "The national cup competition, the Scottish Cup, was started in the 1873\u201374 season.", "Its trophy is the oldest national sporting trophy in the world.", "A Scottish football league system was first instituted in 1890, with the creation of the Scottish Football League.", "A second national cup competition, the Scottish League Cup, was created in the 1946\u201347 season.", "This page details the team and individual records set in these competitions." ], [ "Celtic F.C. league record by opponent", "Celtic F.C. league record by opponent\n\nCeltic Football Club is a professional association football club based Glasgow, Scotland.", "The club was founded in 1887 and began playing league football in 1890 as founder members of the Scottish Football League.", "Since their first season Celtic have remained in the top division of the Scottish football league system: the Scottish Football League (1890\u201393), Scottish Football League Division One (1893\u20131975), Scottish Football League Premier Division (1975\u201398), Scottish Premier League (1998\u20132013) and Scottish Premiership (2013\u2013present).", "As of 2017\u201318 the club has completed 129 seasons of competitive football and have been Scottish football champions 49 times.", "Celtic played their inaugural league fixture as part of the 1890\u201391 Scottish Football League on 23 August 1890 against Heart of Midlothian.", "Since that game they have faced 45 different sides in league football with their most regular opponent having been their Old Firm rivals Rangers, whom they have played on 313 occasions since their first league meeting on 21 March 1891.", "They met their most recent different league opponent, Ross County, for the first time in the 2012\u201313 Scottish Premier League season.", "The club has won 167 of the league matches against Heart of Midlothian and Hibernian which represents the most Celtic have won against any club." ], [ "Rangers F.C.", "Rangers F.C. Rangers Football Club are a football club in Glasgow, Scotland, who play in the Scottish Premiership, the first tier of the Scottish Professional Football League.", "Although it is not part of the official name, they are occasionally referred to as Glasgow Rangers; their home ground, Ibrox Stadium, is in the south-west of the city in the Govan district.", "Rangers have won more league titles and trebles than any other club in the world, winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times.", "Rangers won the European Cup Winners' Cup in 1972 after being losing finalists twice, in 1961 (the first British club to reach a UEFA tournament final) and 1967.", "A third runners-up finish in Europe came in the UEFA Cup in 2008.", "Rangers have a long-standing rivalry with Celtic, the two Glasgow clubs being collectively known as the Old Firm, according to some one of the world's biggest football derbies.", "Founded in February 1872, Rangers were one of the 11 original members of the Scottish Football League and remained in the top division continuously until the liquidation of The Rangers Football Club PLC at the end of the 2011\u201312 season." ] ], "gold": "Rangers and Celtic are Scottish football clubs based in Glasgow. Celtic were founding members of the Scottish Football League in 1890, and the Scottish Premier League in 1998 as well as the Scottish Professional Football League in 2013. They won the most SC and UCL trophies. Rangers are the fourth oldest team and Scotland. They have the most LC and CWC, and total league trophies.", "prediction 1": "Rangers Football Club have won the most trophies in a single season, winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times. Celtic have won the most trophies against any team in Scottish football, beating Rangers on 107 occasions.", "prediction 2": "Celtic Football Club is a professional association football club based in Glasgow, Scotland, and has played against 45 different teams in league football. Their most regular opponent having been their Old Firm rivals Rangers. Rangers have won more league titles and trebles than any other club in the world, winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times, and achieving the treble of all three in the same season seven times.", "prediction 3": "Rangers have won the most league titles and trebles than any other club in the world, winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times. Celtic have won the most league matches against Heart of Midlothian, Hibernian, Ross County, Hibernian and Hibernian. Rangers have won the most trebles against any club in the world, winning the league title 54 times, the Scottish League Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times.", "prediction 4": "Rangers Football Club are a football club in Glasgow, Scotland, who play in the Scottish Premiership, the first tier of the Scottish Professional Football League. Celtic have won the most league titles and trebles, Celtic winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times, and achieving the treble of all three in the same season seven times. Rangers have won more league titles and trebles than any other club in the world, winning the league title 54 times, the Scottish Cup 33 times, and achieving the treble of all three in the same season seven times, and achieving the treble of all three in the same season. This is the most trebles for a team.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 237 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 238, "end": 310 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 344 }, { "error type": "Unverifiable", "explanation": "", "start": 22, "end": 68 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Rangers and Celtic are Scottish football clubs based in Glasgow. Rangers Football Club have won more league titles than any other club in the world, winning the league title 54 times, the Scottish Cup 33 times and the Scottish League Cup 27 times." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who sang i would do anything for love?", "passages": [ [ "I'd Do Anything for Love (But I Won't Do That)", "I'd Do Anything for Love (But I Won't Do That)\n\n\"I'd Do Anything for Love", "(But I Won't Do That)\" is a song written by Jim Steinman, and recorded by Meat Loaf with Lorraine Crosby.", "The song was released in 1993 as the first single from the album \".\"", "The last six verses feature a female singer who was credited only as \"Mrs. Loud\" in the album notes.", "She was later identified as Lorraine Crosby.", "However, she does not appear in the video, in which her vocals are lip-synched by Dana Patrick.", "Meat Loaf promoted the single with US vocalist Patti Russo.", "The power ballad was a commercial success, reaching number one in 28 countries.", "The single was certified platinum in the United States and became Meat Loaf's first and only number-one single on the \"Billboard\" Hot 100 chart and the UK Singles Chart, and was the best-selling single of 1993 in the United Kingdom.", "The song earned Meat Loaf a Grammy Award for Best Rock Vocal Performance, Solo.", "The timings in this article refer to the original album version.", "There are many shorter single and radio edits.", "The song opens with a guitar played to sound like a revving motorcycle.", "Roy Bittan's piano begins to play along with the guitars." ], [ "I'd Do Anything for Love (But I Won't Do That)", "Lorraine Crosby, a singer from England, was the guest singer, though AllMusic incorrectly attributes the female vocals to Ellen Foley.", "Crosby and her partner Stuart Emerson had moved to Los Angeles to work with Steinman, who became their manager.", "He secured them a contract with Meat Loaf's label MCA.", "While visiting the company's studios on Sunset Boulevard, Crosby was asked to provide guide vocals for Meat Loaf, who was recording \"I'd Do Anything for Love\".", "Crosby recalls, \"In I went and sang it twice and I never thought anything more of it until six months later when I got a phone call saying, 'Would you mind if we used your vocals?'\" As Crosby had recorded her part as guide vocals, she received no royalties from the song.", "Cher, Melissa Etheridge and Bonnie Tyler had been considered for the role.", "Tyler, who described Crosby as \"a great friend of mine from Newcastle\", said: \"Meat Loaf was naughty, really: he gave her no acknowledgement on the album but I think her part really made that song.\"", "Michael Bay directed the music video.", "He also directed the videos for \"Objects in the Rear View Mirror May Appear Closer than They Are\" and \"Rock and Roll Dreams Come Through\", also from \"Bat Out of Hell II\"." ] ], "gold": "\"I'd Do Anything for Love, But I Won't Do That\" is a song written by Jim Steinman, and recorded by Meat Loaf with Lorraine Crosby, released in August 1993 as the first single from the album Bat Out of Hell II: Back into Hell. The last six verses feature Lorraine Crosby who was credited only as \"Mrs. Loud\" in the album notes. Meat Loaf promoted the single with American singer Patti Russo. ", "prediction 1": "\"I'd Do Anything for Love (But I Won't Do That)\" is a song written by Jim Steinman, and recorded by Meat Loaf with Lorraine Crosby. The song was released in 1993 as the first single from the album \".\" The last six verses feature a female singer who was credited only as \"Mrs. Loud\" in the album notes. She was later identified as Lorraine Crosby. However, she does not appear in the video, in which her vocals are lip-synched by Dana Patrick.\n", "prediction 2": "\"I'd Do Anything for Love (But I Won't Do That)\" is a song written and recorded by Jim Steinman and recorded by Meat Loaf with Lorraine Crosby and featured a female vocals. However, in the version released by the band in 1993, Lorraine Crosby, a singer from England, sang lead vocals.", "prediction 3": "\"I'd Do Anything for Love (But I Won't Do That)\" is a song written by Jim Steinman, and recorded by Meat Loaf with Lorraine Crosby. The song was released in 1993 as the first single from the album \".\" The last six verses feature a female singer who was credited only as \"Mrs. Loud\" in the album notes. She was later identified as Lorraine Crosby. The video features her vocals lipsynched by Dana Patrick.", "prediction 4": "\"I'd Do Anything for Love (But I Won't Do That)\" is a song written by Jim Steinman and recorded by Meat Loaf with Lorraine Crosby. The song was released in 1993 as the first single from the album \".\" The last six verses feature a female singer who was credited only as \"Mrs. Loud\" in the album notes. She was later identified as Lorraine Crosby. However, she does not appear in the video, in which her vocals are lip-synched by Dana Patrick.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 443 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"I'd Do Anything for Love (But I Won't Do That)\" is a song written by Jim Steinman, and recorded by Meat Loaf with Lorraine Crosby. The song was released in 1993 as the first single from the album \".\" The last six verses feature a female singer who was credited only as \"Mrs. Loud\" in the album notes. She was later identified as Lorraine Crosby. Meat Loaf promoted the single with American singer Patti Russo.\n" }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who is jason's real mother on general hospital?", "passages": [ [ "Jason Morgan (General Hospital)", "Jason Morgan (General Hospital)\n\nJason Morgan is a fictional character on the ABC soap opera, \"General Hospital\".", "Created by Thom Racina and Leah Laiman, he is most notably played by Daytime Emmy Award-winning actor Steve Burton, who joined the cast in 1991 and vacated the role in 2012.", "Burton reprised the role in 2017.", "Jason was born offscreen in September 1981 and the character made his onscreen debut in November 1981 as the son of Dr. Alan Quartermaine (Stuart Damon) and his mistress, Susan Moore (Gail Ramsey), later adopted by Alan's wife Dr. Monica Quartermaine (Leslie Charleson).", "As one of the longest-running characters on the show, the role was played by various child actors from 1982 to 1986.", "In 2014, Billy Miller was cast in the role.", "With Burton's 2017 return, Miller's casting was later retconned as Jason's twin-brother, Andrew Cain.", "The role was originated on November 11, 1981, by Quinn Carlson until June 3, 1982.", "Child actor Bryan Beck stepped into the role on September 8, 1982 to 1986.", "On December 19, 1991, Burton stepped into the role on a contractual basis as a SORASed Jason Quartermaine.", "In November 1999, ABC confirmed that Burton had decided not to renew his contract which expired in December to pursue other opportunities." ], [ "Susan Pratt", "Susan Pratt\n\nSusan Pratt (born April 29, 1956) is an American actress.", "Pratt is best known for her roles in daytime television as Anne Logan on \"General Hospital\" (1978\u20131982), Claire Ramsey on \"Guiding Light\" (1983\u20131986, 2000\u20132002), and Barbara Montgomery on \"All My Children\" (1987\u20131991, 1995, 1997, 1998, February 9-July 12, 2007).", "She was also credited as \"Susan O'Hanlon\" in the role of Captain Nicole Davidoff (16 episodes, 1978\u20131980) in the Saturday morning series, \"Jason of Star Command\".", "Pratt started her career in 1976.", "Pratt is most known for her roles in Daytime Television as sweet nurse Anne Logan (Audrey Hardy's niece) on \"General Hospital\" (1978\u20131982), tough doctor Claire Ramsey (who had an affair with Ed Bauer, giving birth to his daughter, Michelle) on \"Guiding Light\" (1983\u20131986, 2000\u20132002), and ambitious businesswoman Barbara Montgomery (Travis's ex-wife who married Tom Cudahy but continued to sleep with Travis) on \"All My Children\" (1987\u20131991, 1995, 1997, 1998, February 9-July 12, 2007)." ] ], "gold": "The character of Susan Moore, portrayed by actress Gail Ramsey, was the real mother of the character Jason Morgan on ABC's soap opera General Hospital. Ramsey originated the role on March 24, 1978, and departed the series on February 11, 1983, as Susan is murdered. Susan Moore was the mistress of Jason Morgan's father, Dr. Alan Quartermaine, and Jason was adopted by Alan's wife, Dr. Monica Quartermaine.", "prediction 1": "Jason Morgan is a fictional character on the ABC soap opera, General Hospital. He is most notably played by Daytime Emmy Award-winning actor Steve Burton, who joined the cast in 1991 and vacated the role in 2012. Burton reprised the role in 2017. Jason was born offscreen in September 1981 and the character made his onscreen debut in November 1981 as the son of Dr. Alan Quartermaine and his mistress, Susan Moore (Gail Ramsey), later adopted by Alan's wife Dr. Monica Quartermaine (Leslie Charleson). As one of the longest-running character on the show, the role was played by various child actors from 1982 to 1986. In 2014, Billy Miller was cast in the role. With Burton's return in 2017, Miller's casting was later retconned as Jason's twin-brother, Andrew Cain.\n", "prediction 2": "Jason Morgan is a fictional character on the ABC soap opera, General Hospital. He was originally played by Child Actor Bryan Beck from 1982 to 1986. In 1991, Actor Steve Burton took over the part as a SORASed Jason Quartermaine. In 2012, Steve Burton reprised the role as Jason's twin-brother Andrew Cain. American actress Susan Pratt played Anna Maria, Jared's dogmaster, on the show.", "prediction 3": "As one of the longest-running characters on the show, Jason Morgan was initially played by child actors from 1981 to 1986, starting in 1981 with Quinn Carlson, and Bryan Beck in 1982. On December 19, 1991, Steve Burton stepped into the role as a SORASed Jason Quartermaine. In 2012, Burton reprised the role.", "prediction 4": "Jason Morgan, the main character and youngest child of Dr. Alan Quartermaine and his mistress, Susan Moore, is the son of Stuart Damon and Lisa Quartermaine, both on the ABC soap opera General Hospital. Susan Pratt plays the role of Jason's birth mother in the episode, \"Dateline\", called \"Armistice Day\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 27 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 246 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 348 }, { "error type": "Irrelevant", "explanation": "", "start": 483, "end": 502 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 618 }, { "error type": "Irrelevant", "explanation": "", "start": 619, "end": 662 }, { "error type": "Irrelevant", "explanation": "", "start": 663, "end": 768 } ], "missing-info": [], "corrected-prediction": "Jason Morgan is a character on ABC's soap opera General Hospital, and appears as the son of Dr. Alan Quartermaine and his mistress, Susan Moore (Gail Ramsey), later adopted by Alan's wife, Dr. Monica Quartermaine." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who's the actress that plays in tomb raider?", "passages": [ [ "Camilla Luddington", "Camilla Luddington\n\nCamilla Luddington (born 15 December 1983) is an English actress, known for her roles as Kate Middleton in the Lifetime TV film \"\" (2011) and as Jo Karev (Wilson) in the ABC medical drama \"Grey's Anatomy\".", "She provided the voice and motion capture work for the main character Lara Croft in three video games in the \"Tomb Raider\" series, the 2013 reboot and its sequels \"Rise of the Tomb Raider\" (2015) and \"Shadow of the Tomb Raider\" (2018).", "Luddington was born in Ascot, Berkshire, on 15 December 1983.", "She later attended the American School in England at Thorpe, Surrey.", "She moved to suburban Austin, Texas, United States when she was fourteen, and attended Westwood High School for one year.", "She returned to England after one year, and completed her education at the American School in July 2002.", "When she was nineteen, Luddington enrolled in Susquehanna University in Pennsylvania.", "However, she had not visited the university before she arrived as a student, and after six months she left and transferred to the New York Film Academy.", "In 2003, she was part of the school's first one-year acting class program.", "After training as an actor, Luddington then returned to England before moving to Los Angeles to pursue a career in acting." ], [ "Angelina Jolie", "Angelina Jolie\n\nAngelina Jolie ( ; born Angelina Jolie Voight, June 4, 1975) is an American actress, filmmaker, and humanitarian.", "She has received an Academy Award, two Screen Actors Guild Awards, and three Golden Globe Awards, and has been cited as Hollywood's highest-paid actress.", "Jolie made her screen debut as a child alongside her father, Jon Voight, in \"Lookin' to Get Out\" (1982).", "Her film career began in earnest a decade later with the low-budget production \"Cyborg 2\" (1993), followed by her first leading role in a major film, \"Hackers\" (1995).", "She starred in the critically acclaimed biographical cable films \"George Wallace\" (1997) and \"Gia\" (1998), and won an Academy Award for Best Supporting Actress for her performance in the drama \"Girl, Interrupted\" (1999).", "Jolie's starring role as the video game heroine Lara Croft in \"\" (2001) established her as a leading Hollywood actress." ], [ "Alicia Vikander", "Alicia Vikander\n\nAlicia Amanda Vikander (; ; born 3 October 1988) is a Swedish actress.", "Born and raised in Gothenburg, Vikander began acting as a child in minor stage productions at the Gothenburg opera house and trained as a ballet dancer at the Royal Swedish Ballet School in Stockholm and the School of American Ballet in New York.", "She began her professional acting career by appearing in Swedish short films and television series and first gained recognition for her role as Josefin Bj\u00f6rn-Tegebrandt in the drama series \"Andra Avenyn\" (2008\u20132010).", "Vikander made her feature film debut in \"Pure\" (2010), for which she won the Guldbagge Award for Best Actress.", "She gained wider recognition in 2012 for playing Kitty in Joe Wright's adaptation of \"Anna Karenina\" and Queen Caroline Mathilde in the Danish film \"A Royal Affair\".", "In 2014 and 2015, Vikander achieved global recognition for her roles as activist Vera Brittain in \"Testament of Youth\", a humanoid robot in \"Ex Machina\", for which she was nominated for the Golden Globe and BAFTA Award for Best Supporting Actress, and painter Gerda Wegener in \"The Danish Girl\", for which she received the Academy Award for Best Supporting Actress, Screen Actors Guild Award, and a Critics' Choice Movie Award." ] ], "gold": "Several actresses have played in Tomb Raider, including Angelina Jolie, Camilla Anne Luddington, and Alicia Amanda Vikander. Jolie played Lara Croft in the 2001 film Lara Croft: Tomb Raider. Luddington provided mo-cap and voice work for Lara Croft in the Tomb Raider video games from 2013 to 2018. Vikander played Lara Croft in the 2018 film Tomb Raider.", "prediction 1": "Camilla Luddington is an English actress known for her roles as Kate Middleton in the Lifetime TV film \"\" (2011) and as Jo Karev (Wilson) in the ABC medical drama \"Grey's Anatomy\". She provided the voice and motion capture work for the main character Lara Croft in three video games in the Tomb Raider series, the 2013 reboot and its sequels Rise of the Tomb Raider (2015) and Shadow of the Tomb Raider (2018). Swedish actress Alicia Vikander plays the character in the Tomb Raider: The Rise of the Tomb Raider (2018). American actress, filmmaker, and humanitarian, Jolie played the role of Lara Croft in the 2013 reboot and its sequels Rise of the Tomb Raider: Shadow of the Tomb Raider: The Tomb Raider: Legend of the Tomb Raider: The Runner, a role in the", "prediction 2": "In the Tomb Raider series, Camilla Luddington plays Lara Croft, the main character of the video game. Alicia Vikander plays Lara Croft, the main character of the video game.", "prediction 3": "There are several actresses in the Tomb Raider franchise. There is an American actress, American film actress, and Swedish actress, Alicia Vikander, who plays Lara Croft.", "prediction 4": "There are several actresses that play in the Tomb Raider series. There is Camilla Luddington, an English actress best known for her roles as Kate Middleton in the Lifetime TV film \"\" (2011) and as Jo Karev (Wilson) in the ABC medical drama \"Grey's Anatomy\". There is also a Swedish actress, Alicia Vikander, who plays Lara Croft in the video game series Tomb Raider.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 402 }, { "error type": "Unverifiable", "explanation": "", "start": 411, "end": 518 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 602, "end": 758 } ], "missing-info": [], "corrected-prediction": "Camilla Luddington provided the voice and motion capture work for the main character Lara Croft in three video games in the Tomb Raider series, from 2013 to 2018. Swedish actress Alicia Vikander plays the character in the Tomb Raider: The Rise of the Tomb Raider (2018). American actress, filmmaker, and humanitarian, Angelina Jolie played the role of Lara Croft in 2001. " }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who was the band in back to the future?", "passages": [ [ "Back to the Future (soundtrack)", "Back to the Future (soundtrack)\n\nBack to the Future: Music from the Motion Picture Soundtrack is the soundtrack album to the film of the same name.", "It was released on July 8, 1985 by MCA Records.", "The album included two tracks culled from Alan Silvestri's compositions for the film, two tracks from Huey Lewis and the News, two songs played by the fictional band Marvin Berry and The Starlighters, one played by Marty McFly and The Starlighters, and two pop songs that are only very briefly heard in the background of the film.", "\"The Power of Love\" was the first number-one single on the US \"Billboard\" Hot 100 for Huey Lewis and the News, certified Gold and nominated for an Academy Award for Best Original Song.", "The album spent 19 weeks on the \"Billboard\" 200, peaking at number 12 in October 1985.", "The Outatime Orchestra is named after the license plate of the DeLorean.", "Songs not included on the soundtrack album:\nTo put the tracks in the chronological order they first appear in the film, the listing would be as such: 1, 2, 7, the first 90 seconds of 6, 8, 9, 10, the remainder of 6, 4, 5, and 3." ], [ "Back to the Future Part II", "Back to the Future Part II\n\nBack to the Future Part II is a 1989 American science fiction film directed by Robert Zemeckis and written by Bob Gale.", "It is the sequel to the 1985 film \"Back to the Future\" and the second installment in the \"Back to the Future\" trilogy.", "The film stars Michael J. Fox, Christopher Lloyd, Thomas F. Wilson, and Lea Thompson.", "In the plot, Marty McFly (Fox) and his friend Dr. Emmett \"Doc\" Brown (Lloyd) travel to 2015, where bully Biff Tannen (Wilson) steals Doc's DeLorean time machine and uses it to alter history for the worse.", "The film was produced on a $40-million budget and was filmed back to back with its sequel, \"Part III\".", "Filming began in February 1989 after two years were spent building the sets and writing the scripts.", "Two actors from the first film, Crispin Glover and Claudia Wells, did not return.", "While Elisabeth Shue was recast in the role of Wells's character, Jennifer, Glover's character, George McFly, was not only minimized in the plot, but also was obscured and recreated with another actor.", "Glover successfully sued Zemeckis and Gale, changing how producers can deal with the departure and replacement of actors in a role." ], [ "Back to the Future (soundtrack)", "The memorable themes in his \"Back to the Future Overture\" have since been heard in the film's sequels (also scored by Silvestri), in , and as ambient music at the Universal Studios theme parks.", "A remix of the main theme was heard in the opening sequence for MCA-Universal Home Video from 1990 to 1997.", "The upbeat soundtrack, featuring two new songs by Huey Lewis and the News, also contributed to the film's popularity.", "\"The Power of Love\" became the band's first song to hit number one on the \"Billboard\" Hot 100 and was nominated for an Academy Award.", "Huey Lewis portrayed the high-school band audition judge who rejects Marty McFly's band, the Pinheads, as they perform the short instrumental hard-rock version of \"The Power of Love\".", "There is also another album version of the soundtrack, with only the original score by Silvestri.", "The only legitimate release was by independent label Intrada, but another so-called \"DeLorean\" version released in the 1990s was an unauthorized bootleg.", "In November 2009, Intrada released an official two-disc album containing Silvestri's complete score.", "The first disc contained the complete orchestral score as recorded for the finished film, along with two source cues that Silvestri wrote." ] ], "gold": "Back to the Future is a 1985 American science fiction film which follows Marty McFly, a teenager accidentally sent back to 1955 in a time-traveling DeLorean automobile built by his eccentric scientist friend Doctor Emmett \"Doc\" Brown. The soundtrack for he movie includes Back in Time and The Power of Love, two pop tracks from American rock band Huey Lewis and the News, a version of Earth Angel played by the fictional Marvin Berry and The Starlighters, and a version of Jhonny B' Good played by Marty McFly with The Starlighters. The movie also features Mr. Sandman by The Four Aces, which plays when Marty first realizes he is in 1955.", "prediction 1": "The Back to the Future soundtrack album was released on July 8, 1985 by MCA Records. It included songs culled from Alan Silvestri's compositions for the film, two tracks from Huey Lewis and the News, two songs played by the fictional band Marvin Berry and The Starlighters, one played by Marty McFly and The Starlighters, and two pop songs that are only very briefly heard in the background of the film. The Outatime Orchestra was also featured in the soundtrack and is named after the license plate of the DeLorean. The film was directed by Robert Zemeckis and written by Bob Gale. Back to the Future Part III was filmed back to back and the sequel to the 1985 film Back to the Future.", "prediction 2": "Marvin Berry and the Starlighters, played by Marty McFly and The Starlighters, were the band in Back to the Future. The music for the film's soundtrack was composed by Alan Silvestri and included tracks culled from Silvestri's compositions for the film, two tracks from Huey Lewis and the News, two songs played by the fictional band Marvin Berry and The Starlighters, and two pop songs that are only very briefly heard in the background of the film. The Outatime Orchestra was played by the fictional band Marvin Berry and The Starlighters, and The Starlighters, one played by Marty McFly and The Starlighters.", "prediction 3": "Back to the Future: Music from the Motion Picture Soundtrack is the soundtrack album to the 1985 film of the same name. It was released on July 8, 1985 by MCA Records. The album included two tracks culled from Alan Silvestri's compositions for the film, two tracks from Huey Lewis and the News, two songs played by the fictional band Marvin Berry and The Starlighters, one played by Marty McFly and The Starlighters, and two pop songs that are only very briefly heard in the background of the film.", "prediction 4": "Back to the Future: Music from the Motion Picture Soundtrack is the soundtrack album to the 1985 film of the same name. It was released on July 8, 1985 by MCA Records. The soundtrack album also included two songs played by the fictional band Marvin Berry and The Starlighters, two songs played by Marty McFly and The Starlighters, and two pop songs that are only very briefly heard in the background of the film. The Outatime Orchestra is named after the license plate of the DeLorean.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 403 }, { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 516 }, { "error type": "Irrelevant", "explanation": "", "start": 517, "end": 582 }, { "error type": "Irrelevant", "explanation": "", "start": 583, "end": 686 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The soundtrack included songs culled from Alan Silvestri's compositions for the film, two tracks from Huey Lewis and the News, two songs played by the fictional band Marvin Berry and The Starlighters, one played by Marty McFly and The Starlighters. Marty McFly's band was the Pinheads," }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the most world cups in soccer?", "passages": [ [ "National team appearances in the FIFA World Cup", "National team appearances in the FIFA World Cup\n\nThe FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the International Federation of Association Football (FIFA, F\u00e9d\u00e9ration Internationale de Football Association).", "The championship has been awarded every four years since the inaugural tournament in 1930, with the exception of 1942 and 1946 when it was not held due to the Second World War.", "The competition originally featured 16 teams, and later 24, before settling on its current format of 32 teams starting with the 1998 tournament.", "Teams initially compete in a group stage, with the final 16 progressing to knockout stages to decide the winner.", "As of the 2018 FIFA World Cup, 79 national teams have competed at the final tournaments.", "Brazil are the only team to have appeared in all 21 tournaments to date, with Germany having participated in 19, Italy in 18, Argentina in 17 and Mexico in 16.", "To date, eight nations have won the tournament.", "The inaugural winners in 1930 were Uruguay; the current champions are France.", "The most successful nation in the competition are currently Brazil, who have won the cup on five occasions.", "Five teams have appeared in FIFA World Cup finals without winning, while eleven more have appeared in semi-finals." ], [ "2015 FIFA Women's World Cup Final", "2015 FIFA Women's World Cup Final\n\nThe 2015 FIFA Women's World Cup Final was a professional women's football match that took place on 5 July 2015 at BC Place, in Vancouver, British Columbia, Canada, to determine the winner of the 2015 FIFA Women's World Cup.", "It was played between Japan and the United States, in a rematch of the 2011 final.", "The stakes were high for both sides: if the United States won the match, it would be the only country to have won in three Women's World Cup finals; if Japan had won instead, then it would be the first football team, men's or women's, to win twice under the same coach (Norio Sasaki for Japan) since Vittorio Pozzo led Italy to victory in the 1934 World Cup and the 1938 World Cup.", "Ultimately, the United States won 5\u20132, winning its first title in 16 years and becoming the first team to win three Women's World Cup finals.", "Because of the expanded competition format, it was the first time the finalists had played a seventh game in the tournament.", "The United States had previously reached the final game three times, winning twice (in 1991 and 1999) and placing as runners up in 2011." ], [ "\u00c9dson", "\u00c9dson\n\n\u00c9dson (Brazilian Portuguese:", "[\u02c8\u025bts\u00f5]) is a Brazilian name, often spelled Edson.", "The name is found as early as the 1920s, for example in the name of the businessman Edson Queiroz.", "The most famous holder of the name is the footballer Pel\u00e9, born Edson Arantes do Nascimento, although his name given as Edison on his birth certificate.", "The name \"\u00c9dson\" alone has been taken as a mononym by many Brazilian footballers, but most notably \u00c9dson Boaro (1959) from the 1986 World Cup squad.", "People with the name include:" ] ], "gold": "Soccer teams from eight different nations have won world cup tournaments, but with five wins, Brazil has won the most. Twenty different soccer coaches have won world cups, but coach Vittorio Pozzo of Italy has won two cups, which is the most a coach has won. The soccer player with the most world cup wins is Edson Arantes do Nascimento, who is also known as Pele.", "prediction 1": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the International Federation of Association Football. The most successful nation in the competition are currently Brazil, who have won the cup on five occasions. The most successful team in the competition are the United States, who have won the cup on 13 occasions.", "prediction 2": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the International Federation of Association Football. The most successful nation in the competition are currently Brazil, who have won the cup on five occasions. The United States has won the most world cups in women's football, with three, and the most overall.", "prediction 3": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the International Federation of Association Football (FIFA, F\u00e9d\u00e9ration Internationale de Football Association). The most successful nation in the competition are currently Brazil, who have won the cup on five occasions. The most successful team in the competition are Japan, who have won the cup on four occasions. The most successful team in the competition are France, who have won the cup on seven occasions.", "prediction 4": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the International Federation of Association Football (FIFA, F\u00e9d\u00e9ration Internationale de Football Association). The most successful nation in the competition are currently Brazil, who have won the cup on five occasions. The United States won the 2015 FIFA Women's World Cup Final, which was played between Japan and the United States, in a rematch of the 2011 final. Brazil are the only team to have appeared in all 21 tournaments to date, with Italy participating in 18, Germany, Italy in 18, Argentina in 17 and Mexico in 17.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 188 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 388, "end": 390 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "To date, eight nations have won the FIFA World Cup. The most successful nation in the competition are currently Brazil, who have won the cup on five occasions. The most successful team in the FIFA Women's Wolrd Cup are the United States, who have won the cup on 3 occasions. Pel\u00e9's birth name was Edson Arantes do Nascimento." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did singer start making electric sewing machines?", "passages": [ [ "Singer Corporation", "In 1885, Singer produced its first \"vibrating shuttle\" sewing machine, an improvement over contemporary transverse shuttle designs; (see bobbin drivers).", "Singer began to market its machines internationally in 1855 and won first prize at the Paris World's Fair.", "The company demonstrated the first workable electric sewing machine at the Philadelphia electric exhibition in 1889 and began mass-producing domestic electric machines in 1910.", "Singer was also a marketing innovator and was a pioneer in promoting the use of installment payment plans.", "Source:\n\nBy 1876, Singer was claiming cumulative sales of 2 million machines and displaying the 2 millionth in Philadelphia.", "In 1867, the Singer Company decided that the demand for their sewing machines in the UK was sufficiently high to open a local factory in Glasgow on John Street.", "Glasgow was selected for its iron making industries, cheap labour and possibly because at the time the General Manager of the US Singer Manufacturing Company was George McKenzie, who was of Scottish descent.", "Demand for sewing machines outstripped production at the new plant and by 1873, a new larger factory was completed on James Street, Bridgeton.", "By now, Singer employed over 2,000 people in Scotland, but they still could not produce enough machines.", "In 1882, George McKenzie, now President-elect of the Singer Manufacturing Company, undertook the ground breaking ceremony on 46 acres of farmland at Kilbowie, Clydebank." ], [ "Singer Corporation", "Singer Corporation\n\nSinger Corporation is an American manufacturer of sewing machines, first established as I. M. Singer & Co. in 1851 by Isaac Merritt Singer with New York lawyer Edward Clark.", "Best known for its sewing machines, it was renamed Singer Manufacturing Company in 1865, then The Singer Company in 1963.", "It is based in La Vergne, Tennessee, near Nashville.", "Its first large factory for mass production was built in Elizabeth, New Jersey, in 1863.", "Singer's original design, which was the first practical sewing machine for general domestic use, incorporated the basic eye-pointed needle and lock stitch developed by Elias Howe, who won a patent-infringement suit against Singer in 1854.", "Patent No. 8294, of August 12, 1851, introduced one of the most useful machines, and one of the most remarkable men, that have figured in the development of the sewing machine.", "Isaac Merritt Singer, strolling player, theater manager, inventor, and millionaire, brought into the business a new machine and novel methods of exploitation, which gave a powerful impulse to the youthful industry.", "The Singer improvements met the demand of the tailoring, and leather industries for a heavier and more powerful machine.", "Singer consolidated enough patents in the field to enable him to engage in mass production, and by 1860, his company was the largest manufacturer of sewing machines in the world." ] ], "gold": "The original Singer sewing machine was the first for general domestic use. The company introduced the first workable electric sewing machine at the Philadelphia electric exhibition in 1889. The machines were massed produced staring in 1910.", "prediction 1": "Singer began making domestic electric sewing machines in 1910, starting with the demonstration of the first workable electric sewing machine at the Philadelphia electric exhibition. In 1867, the Singer Company decided that the demand for their sewing machines in the UK was sufficiently high to open a local factory in Glasgow on John Street. Demand for sewing machines outstripped production at the new plant and by 1873, a new larger factory for mass production was built in Elizabeth, New Jersey, in 1863.", "prediction 2": "Singer Corporation is an American manufacturer of sewing machines, first established as I. M. Singer & Co. in 1851 by Isaac Merritt Singer with New York lawyer Edward Clark. The company demonstrated the first workable electric sewing machine at the Philadelphia Electric Exhibition in 1889 and began mass-producing domestic electric machines in 1910. Singer began to market its machines internationally in 1855 and won first prize at the Paris World's Fair. The company began mass-producing domestic electric machines in 1910.", "prediction 3": "Singer Corporation is an American manufacturer of sewing machines, first established as I. M. Singer & Co. in 1851 by Isaac Merritt Singer with New York lawyer Edward Clark. In 1889, the company demonstrated the first workable electric sewing machine at the Philadelphia electric exhibition and began mass-producing domestic electric machines in 1910. Singer began marketing its machines internationally in 1855 and won first prize at the Paris World's Fair. In 1867, the Singer Company decided that the demand for their sewing machines in the UK was sufficiently high to open a local factory in Glasgow on John Street. In 1873, a new larger factory was completed on James Street, Bridgeton, Bridgeton. In 1873, a new larger factory was completed on James Street, Bridgeton.", "prediction 4": "Singer Corporation is an American manufacturer of sewing machines, first established as I. M. Singer & Co. in 1851 by Isaac Merritt Singer with New York lawyer Edward Clark. Singer began marketing its machines internationally in 1855 and won first prize at the Paris World's Fair. In 1889, the company demonstrated the first workable electric sewing machine at the Philadelphia electric exhibition and began mass-producing domestic electric machines in 1910.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 508 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Singer's original design, which was the first practical sewing machine for general domestic use. Singer began mass-producing domestic electric sewing machines in 1910, starting with the demonstration of the first workable electric sewing machine at the Philadelphia electric exhibition, in 1889. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Current captain of the england mens test cricket team?", "passages": [ [ "Captain (cricket)", "Captain (cricket)\n\n", "The captain of a cricket team, often referred to as the skipper, is the appointed leader, having several additional roles and responsibilities over and above those of the other players.", "As in other sports, the captain is usually experienced and has good communication skills, and is likely to be one of the most regular members of the team, as the captain often has a say in team selection.", "Before the game the captains toss for innings.", "During the match the captain decides the team's batting order, who will bowl each over, and where each fielder will be positioned.", "While the captain has the final say, decisions are often collaborative.", "A captain's knowledge of the complexities of cricket strategy and tactics, and shrewdness in the field, may contribute significantly to the team's success.", "Due to the smaller coaching/management role played out by support staff, as well as the need for greater on-field decision-making, the captain of a cricket team typically shoulders more responsibility for results than team captains in other sports.", "Before the start of a match the home captain tosses a coin and the away captain calls heads or tails.", "The captain who wins the toss is given the choice of whether to bat or bowl first.", "The decision usually depends on the condition of the pitch and whether it is likely to deteriorate, the weather conditions and the weather forecast." ], [ "Joe Root", "Following the resignation of Alastair Cook, he was named as his replacement and the full-time Test captain on 13 February 2017 as the 80th captain of England.", "In his first match as the captain, on 6 July 2017, against South Africa at Lord's Root scored his 12th Test century with an innings of 190.", "He was the 6th (and highest scoring)", "England player to score a Test century on captaincy debut.", "He also had an influence on county teammate Gary Ballance's recall to the England squad.", "Root led what was regarded as a comparatively weak English team to Australia for the Ashes series of 2017\u20132018, the urn being ceded by the conclusion of the third game of the series.", "Root's decision to give Australia first use of the Adelaide pitch in the second Test was questioned by some commentators, while others acknowledged that giving his bowlers first use of the ball in this day-night match may have given his team their best chance.", "Perhaps a more telling criticism was that of Ian Chappell of the Australian television Channel Nine commentary team, who claimed that Root's captaincy was too defensive, more concerned with defending runs than taking wickets.", "The loss of the series led to media criticism." ], [ "Joe Root", "Joe Root\n\nJoseph Edward Root (born 30 December 1990) is an English international cricketer who is the current captain of the England Test team.", "He also represents Yorkshire domestically.", "He was originally a right-handed opening batsman and occasional off-spinner, with a similar playing style to former England captain Michael Vaughan.", "However, he has played the majority of his cricket for England in the middle order.", "He is often regarded as one of the best batsman in the world.", "He fields predominantly at second slip or mid-on.", "He made his debut for England in the 2012 Test series in India and made his ODI and Twenty20 International debuts on the same tour, before scoring his maiden Test century at his home ground of Headingley the following spring against New Zealand.", "He is currently ranked fourth in Test batting and fourth in ODI batting rankings according to the ICC Player Rankings, having previously been ranked the best Test batsman.", "Root is the elder son of Helen and Matt Root and grew up in Dore, near Sheffield.", "He has a younger brother Billy, who plays cricket for Nottinghamshire.", "Root became engaged to his girlfriend Carrie Cotterell in March 2016; their son, Alfred William Root, was born on 7 January 2017 and they married in December 2018.", "He supports football team Sheffield United.", "He attended King Ecgbert School, Sheffield and at 15, on a cricket sports scholarship, Worksop College as a weekly boarder." ] ], "gold": "The captain of a cricket team, often referred to as the skipper, is the appointed leader, having several additional roles and responsibilities over and above those of the other players. Kevin Pietersen was the 78th team captain for the England men's test cricket team, Alastair Cook was the 79th team captain, and Joe Root was the 80th team captain.", "prediction 1": "The current England Test captain is Joe Root who replaced Alastair Cook the same day as his replacement. Root had been the captain of the English test team since 2013. Root also currently represents Yorkshire domestically. Root is an English international cricketer who is the current captain of the England Test team.", "prediction 2": "The current England captain is Joe Root, who took over from Alastair Cook on 13 February 2017. Root was appointed captain of the England men's Test team in 2017 following the resignation of Cook. Root is also the current vice-captain of the England Test squad.", "prediction 3": "The current captain of the England Test team is Joe Root. Root was appointed as the new captain on 13 February 2017 as the 80th captain of England. Root has led England's Test team to a disappointing run of results in their Ashes series against Australia.", "prediction 4": "The captain of a cricket team, often referred to as the skipper, is the appointed leader, having several additional roles and responsibilities over and above those of the other players. Joe Root is the current captain of the England men's Test team. Root was named as his replacement and the full-time Test captain on 13 February 2017 as the 80th captain of England.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 72, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 161 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 162, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 222 }, { "error type": "Redundant", "explanation": "The current England Test captain is Joe Root who replaced Alastair Cook the same day as his replacement. ", "start": 223, "end": 318 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The captain of a cricket team, often referred to as the skipper, is the appointed leader, having several additional roles and responsibilities over and above those of the other players. The current England Test (80th) captain is Joe Root who replaced Alastair Cook after the latter's resignation. The 79th captain would thus be Alastair Cook. " }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "What are the five great lakes of north america called?", "passages": [ [ "Great Lakes", "Great Lakes\n\nThe Great Lakes (), also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border, which connect to the Atlantic Ocean through the Saint Lawrence River.", "They consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron.", "The lakes are interconnected by the Great Lakes Waterway.", "The Great Lakes are the largest group of freshwater lakes on Earth by total area, and second largest by total volume, containing 21% of the world's surface fresh water by volume.", "The total surface is , and the total volume (measured at the low water datum) is , slightly less than the volume of Lake Baikal (, 22\u201323% of the world's surface fresh water).", "Due to their sea-like characteristics (rolling waves, sustained winds, strong currents, great depths, and distant horizons) the five Great Lakes have also long been referred to as \"inland seas\".", "Not counting Lake Michigan-Huron, Lake Superior is the second largest lake in the world by area, and the largest freshwater lake by area.", "Lake Michigan is the largest lake that is entirely within one country." ], [ "Lake Erie", "Lake Erie\n\nLake Erie () is the fourth-largest lake (by surface area) of the five Great Lakes in North America, and the eleventh-largest globally if measured in terms of surface area.", "It is the southernmost, shallowest, and smallest by volume of the Great Lakes and therefore also has the shortest average water residence time.", "At its deepest point Lake Erie is deep.", "Situated on the International Boundary between Canada and the United States, Lake Erie's northern shore is the Canadian province of Ontario, specifically the Ontario Peninsula, with the U.S. states of Michigan, Ohio, Pennsylvania, and New York on its western, southern, and eastern shores.", "These jurisdictions divide the surface area of the lake with water boundaries.", "The lake was named by the Erie people, a Native American people who lived along its southern shore.", "The tribal name \"erie\" is a shortened form of the Iroquoian word \"erielhonan\", meaning \"long tail\".", "Situated below Lake Huron, Erie's primary inlet is the Detroit River.", "The main natural outflow from the lake is via the Niagara River, which provides hydroelectric power to Canada and the U.S. as it spins huge turbines near Niagara Falls at Lewiston, New York and Queenston, Ontario." ], [ "Name of Toronto", "The name York lived on through the name of York County (which was later split into Metropolitan Toronto and York Region), and continues to live on through the names of several districts within the city, including Yorkville, East York, and North York, the latter two suburbs that were formally amalgamated into the \"megacity\" of Toronto on January 1, 1998.", "Prior to the Iroquois inhabitation of the Toronto region, the Wyandot (Huron) people inhabited the region, later moving north to the area around Lake Huron and Georgian Bay.", "The word \"toronto\", meaning \"plenty\" appears in a French lexicon of the Huron language in 1632.", "Toronto however, did not appear on any map of the region before 1650.", "After 1650, and the destruction of Fort Sainte Marie, the Hurons left the region.", "The term \"Toronto\" became associated with Matchedash Bay, and was recorded with various spellings in French and English, including \"Tarento\", \"Tarontha\", \"Taronto\", \"Toranto\", \"Torento\", \"Toronto\", and \"Toronton\".", "\"Taronto\" later referred to \"The Narrows\", a channel of water through which Lake Simcoe discharges into Lake Couchiching." ] ], "gold": "The Great Lakes, also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes primarily in the upper mid-east region of North America, on the Canada\u2013United States border. The Great Lakes consist of Lakes Superior, Michigan, Huron, Erie and Ontario. Lake Erie's name comes from the Erie tribe, a shortened form of the Iroquoian word erielhonan meaning long tail. Lake Huron's name comes from the inhabitants of the area, the Wyandot or Hurons. Lake Michigan's name comes from the Ojibwe word mishi-gami meaning great water or large lake. Lake Ontario's name comes from the Wyandot word ontar\u00ed'io meaning lake of shining waters. Lake Superior's name is an English translation of the French term lac sup\u00e9rieur meaning upper lake, referring to its position north of Lake Huron.", "prediction 1": "The Great Lakes are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border. The lakes consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron. The lakes are interconnected by the Great Lakes Waterway.", "prediction 2": "The Great Lakes, also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border. They consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron.", "prediction 3": "The Great Lakes are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border. They consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron. The lakes are interconnected by the Great Lakes Waterway.", "prediction 4": "The Great Lakes, also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border, which connect to the Atlantic Ocean through the Saint Lawrence River. The Great Lakes are the largest group of freshwater lakes on Earth by total area, and the second largest by total volume, containing 21% of the world's surface fresh water by volume.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 387 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Great Lakes, also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border. The lakes consist of Lakes Superior, Michigan, Huron, Erie, and Ontario. The tribal name \"erie\" is a shortened form of the Iroquoian word \"erielhonan\", meaning \"long tail\". Lake Huron's name comes from the inhabitants of the area, the Wyandot or Hurons." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who sings vocals on go your own way?", "passages": [ [ "Go Your Own Way", "Go Your Own Way\n\n\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album \"Rumours\" (1977).", "It released as the album's first single in December 1976 on both sides of the Atlantic.", "Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States.", "The album spawned three additional top ten hits, including the band's sole number one hit, \"Dreams\".", "\"Rumours\" would go on to sell over 40 million units worldwide, 20 million of which were from the US alone.", "Recorded in three separate studios, the track was developed over a period of four months.", "Like most tracks off Rumours, none of the instruments were recorded live together; the tracks were instead arranged through a series of overdubs.", "Lyrically, \"Go Your Own Way\" is a breakup song, specifically directed at his bandmate and former lover, Stevie Nicks.", "\"Go Your Own Way\" has been well received by music critics, and is regarded by \"Rolling Stone\" as one of the greatest rock songs of all time.", "In between legs of their 1976 Fleetwood Mac Tour, the band retreated to a house in Florida to prepare new material." ], [ "Go Your Own Way", "Canadian post-hardcore band, Silverstein, included a live cover of the track on the deluxe edition of \"A Shipwreck in the Sand\".", "Lea Michelle of the American musical comedy-drama, Glee, sang the song on season two's Rumours episode.", "This cover would go on to peak at number 51 in the UK.", "A year later, American singer-songwriter Lissie, would also chart with her own cover of the song.", "Canadian post-grunge band Art of Dying recorded an acoustic rendition for their 2012 compilation album, \"Let the Fire Burn\".", "It has has also been covered by NOFX, The Lumineers, Vomit Launch, Seaweed, Boy George, Biffy Clyro,Jellyfish, Jennifer Brown, Wilson Phillips, Carrie Underwood, Kate Ceberano, Keane, Head and the Heart, Colbie Caillat, Kingswood and Rawr Vanity.", "Canadian artist Karl Wolf sampled the refrain from the song in his single \"Go Your Own Way\" with additional music and lyrics.", "The single appears on his album \"Stereotype\"." ], [ "Tia London", "Tia London\n\nTia London (born Latia Bell; July 22, 1988 in Chicago, Illinois, United States) is an American singer-songwriter and rapper.", "She is most known from her feature on Twista's \"It's Yours\" single from his 2014 \"Dark Horse\" album.", "She also appeared on the song \"2012\" from his \"The Perfect Storm\" album (2010).", "She was signed by The Legendary Traxster in 2010.", "She has released two full length projects, \"Love Junkie\" (2011) and \"The Overdose\" (2012), and many singles.", "In 2016 she released 30 songs plus an entire album \"2:44 am\".", "In 2017 Tia & her husband The Legendary Traxster started a new label Nothing But Dope.", "That same month they signed a deal with Priority Records.", "She has released several singles under the Nothing", "But Dope/Priority Imprint and a Self Titled Album \u201cTia London\u201d.", "In early 2015, she married musical collaborator and producer The Legendary Traxster and had their first child Akai King in July 2015.", "Named after the Akai MPC that Traxster has used throughout his career." ] ], "gold": "Several artists have recorded songs with the title Go Your Own Way. Released in 1976, Go Your Own Way is the title of a song by the British-American rock band Fleetwood Mac. Written and sung by lead vocalist Lindsey Buckingham, it became the band's first top ten hit in the United States. In 2011, Lea Michele of the American musical comedy-drama Glee sang this song on season two's Rumors episode. A year later, in 2012, the American singer-songwriter Lissie charted with her cover of Fleetwood Mac's Go Your Own Way. Lissie's rendition of Go Your Own Way was included on the Nicholas Sparks movie soundtrack for Safe Haven. Additionally, in late 2007, an EP titled Disco Abomination by Boy George included a cover of Fleetwood Mac's Go Your Own Way. It appeared on the internet, available for download on several underground outlets. Go Your Own Way is also the title of a song released by American singer-songwriter and rapper Tia London in 2016. Go Your Own Way is also the title of a song released in 2007 by Japanese R&B and pop singer Yumi Shizukusa. Released in October, this was her tenth single and was used in the Japanese anime Case Closed. Go Your Own Way was also the title of a song released in 2017 by Canadian singers Drake Jensen and Patrick Masse. ", "prediction 1": "Lea Michelle of the American musical comedy-drama, Glee, sang the song on season two's Rumours episode. American singer-songwriter Lissie, also charted with her own cover of the song. Canadian post-hardcore band, Silverstein included a live cover of the track on the deluxe edition of \"A Shipwreck in the Sand\". Canadian post-grunge band Art of Dying recorded an acoustic rendition for their 2012 compilation album, \"Let the Fire Burn\".", "prediction 2": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours in 1977. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Canadian post-hardcore band, Silverstein, included a live cover of the track on the deluxe edition of \"A Shipwreck in the Sand\". American singer-songwriter Lissie, sang the song on season two's Rumours episode of Glee.", "prediction 3": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours in 1977. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Canadian post-hardcore band, Silverstein, included a live cover of the track on the deluxe edition of A Shipwreck in the Sand. A year later, American singer-songwriter Lissie, would also chart with her own cover of the song. The song was also covered by Canadian post-grunge band Art of Dying, who recorded an acoustic version for their 2012 compilation album, Let the Fire Burn. The song was also covered by Canadian post-grunge band Art of Dying.", "prediction 4": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours in 1977. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Canadian post-hardcore band Silverstein included a live cover of the track on the deluxe edition of \"A Shipwreck in the Sand.\" American singer-songwriter Lissie recorded an acoustic rendition for their 2012 compilation album, Let the Fire Burn. Canadian post-grunge band Art of Dying recorded an acoustic rendition for their 2012 compilation album, \"Let the Fire Burn\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 312, "end": 436 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Go Your Own Way \"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac, released in 1976. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Lea Michelle of the American musical comedy-drama, Glee, sang the song on season two's Rumours episode. American singer-songwriter Lissie, also charted with her own cover of the song. It has has also been covered by NOFX, The Lumineers, Vomit Launch, Seaweed, Boy George, Biffy Clyro,Jellyfish, Jennifer Brown, Wilson Phillips, Carrie Underwood, Kate Ceberano, Keane, Head and the Heart, Colbie Caillat, Kingswood and Rawr Vanity. Silverstein included a live cover, and Karl Wolf sampled the refrain." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "Who will be the home team in the 2017 sec championship game?", "passages": [ [ "2017 SEC Championship Game", "2017 SEC Championship Game\n\nThe 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC).", "This was the first SEC Conference football championship at the Mercedes-Benz Stadium.", "The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, the 2017 Auburn Tigers football team.", "This championship game was a rematch of their rivalry game, played on November 11, 2017.", "In that earlier game, Auburn beat Georgia by a score of 40-17.", "In this rematch, Georgia won the SEC Championship by beating Auburn 28-7.", "This game marked the first time that any permanent cross division rivals faced off in the SEC Championship Game.", "This was also the first SEC Championship Game with new SEC on CBS announcer Brad Nessler replacing Verne Lundquist, who retired in 2016.", "The game was televised nationally by CBS.", "In the 2016 SEC Championship Game, the western division champion Alabama defeated the eastern division champion Florida 54\u201316 in a rematch of the 2015 SEC Championship Game.", "It was the last SEC title game to be held at the Georgia Dome, which was demolished shortly before the 2017 title game, following the opening of Mercedes-Benz Stadium." ], [ "2017 Southeastern Conference Baseball Tournament", "2017 Southeastern Conference Baseball Tournament\n\nThe 2017 Southeastern Conference Baseball Tournament was held from May 23 through May 28 at Hoover Metropolitan Stadium in Hoover, Alabama.", "The annual tournament determined the tournament champion of the Division I Southeastern Conference in college baseball.", "The tournament champion earned the conference's automatic bid to the 2017 NCAA Division I Baseball Tournament After a search for potential new sites, the SEC named Hoover the host for the 2017 and future events, with a specific term to be negotiated.", "The tournament has been held every year since 1977, with LSU claiming their twelfth championship against Arkansas, the most of any school.", "Original members Georgia and Kentucky along with 1993 addition Arkansas have never won the tournament.", "This is the nineteenth consecutive year and twenty-first overall that the event has been held at Hoover Metropolitan Stadium, known from 2007 through 2012 as Regions Park.", "Texas A&M joined in 2013, and won its first title in 2016.", "Missouri, which also joined in 2013, has yet to win the event.", "The regular season division winners claimed the top two seeds and the next ten teams by conference winning percentage, regardless of division, claimed the remaining berths in the tournament.", "The bottom eight teams played a single-elimination opening round, followed by a double-elimination format until the semifinals, when the format reverted to single elimination through the championship game.", "This is the fifth year of this format." ], [ "2016\u201317 Arkansas Razorbacks men's basketball team", "2016\u201317", "Arkansas Razorbacks men's basketball team\n\nThe 2016\u201317 Arkansas Razorbacks men's basketball team represents the University of Arkansas in the 2016\u201317 NCAA Division I men's basketball season.", "The team's head coach is Mike Anderson, who is in his sixth season.", "The team plays their home games at Bud Walton Arena in Fayetteville, Arkansas as a member of the SEC.", "Arkansas was unable to continue the momentum it had built in 2014\u201315, after finishing second to Kentucky in the SEC and winning a game in the NCAA Tournament for the first time in seven years.", "They lost Chicago Bulls forward Bobby Portis to the NBA and Michael Qualls also declared but wasn't drafted after sustaining a knee injury.", "Seniors Rashad Madden and Alandise Harris graduated, and Nick Babb elected to transfer to Iowa State.", "In the offseason, returning players Jacorey Williams and Anton Beard, along with Colorado transfer Dustin Thomas, were involved in a counterfeiting scandal and Williams was later kicked off the team.", "Beard was suspended for the first semester and Thomas had to sit out the season anyway as part of NCAA transfer rules.", "The Razorbacks lost to Florida in the second round of the SEC Tournament." ] ], "gold": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, the 2017 Auburn Tigers football team and determined the 2017 football champion of the Southeastern Conference. The 2016\u201317 Arkansas Razorbacks men's basketball team represented the University of Arkansas during the 2016\u201317 NCAA Division I men's basketball season and played their home games at Bud Walton Arena in Fayetteville, Arkansas as a member of the SEC. Bridgestone Arena in Nashville serves as a primary venue for the SEC Men's Basketball Tournament between 2015 and 2025, after the SEC signed a long-term agreement with the Nashville Sports Council in 2013. The Arkansas Razorbacks play baseball home games in Baum-Walker Stadium at George Cole Field, which holds 10,737 and has hosted NCAA regionals in 1999, 2004, 2006, 2007, 2010, 2017, 2018, and 2019, but the 2017 Southeastern Conference Baseball Tournament was held at Hoover Metropolitan Stadium in Hoover, Alabama, where Arkansas competed against Georgia and Kentucky.", "prediction 1": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC). This was the first SEC Conference football championship held at the Mercedes-Benz Stadium. The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, the 2017 Auburn Tigers football team.", "prediction 2": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC). This was the first SEC Conference football championship played at the Mercedes-Benz Stadium. The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team, against the Western Division Co-Champion, the 2017 Auburn Tigers football team.", "prediction 3": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC). The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, 2017 Auburn Tigers football team.", "prediction 4": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC). The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, the 2017 Auburn Tigers football team. The 2017 SEC Tournament determined the tournament champion of the Division I Southeastern Conference in college baseball.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 278 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2017 SEC Championship Game was played on December 2, 2017 at Mercedes-Benz Stadium in Atlanta, Georgia, and determined the 2017 football champion of the Southeastern Conference (SEC). The game featured the Eastern Division Champion, 2017 Georgia Bulldogs football team against the Western Division Co-Champion, the 2017 Auburn Tigers football team. The 2016\u201317 Arkansas Razorbacks men's basketball team represented the University of Arkansas during the 2016\u201317 NCAA Division I men's basketball season and played their home games at Bud Walton Arena in Fayetteville, Arkansas as a member of the SEC." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sang the wreck of the edmund fitzgerald?", "passages": [ [ "The Wreck of the Edmund Fitzgerald", "The Wreck of the Edmund Fitzgerald\n\n\"The Wreck of the \"Edmund Fitzgerald\"\" is a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS \"Edmund Fitzgerald\" on Lake Superior on November 10, 1975.", "Lightfoot drew his inspiration from \"Newsweek\" article on the event, \"The Cruelest Month\", which it published in its November 24, 1975, issue.", "Lightfoot considers this song to be his finest work.", "Appearing originally on Lightfoot's 1976 album \"Summertime Dream\", the single version hit number 1 in his native Canada (in the \"RPM\" national singles survey) on November 20, 1976, barely a year after the disaster.", "In the United States, it reached number 1 in \"Cashbox\" and number 2 for two weeks in the \"Billboard\" Hot 100 (behind Rod Stewart's \"Tonight's The Night\"), making it Lightfoot's second-most-successful single behind \"Sundown\".", "Overseas it was at best a minor hit, peaking at number 40 in the UK Singles Chart.", "The song is written in Dorian mode.", "Lightfoot re-recorded the song in 1988 for the compilation album \"Gord's Gold, Vol. 2\".", "The song contains a few artistic omissions and paraphrases." ], [ "The Wreck of the Edmund Fitzgerald", "In a later interview aired on Canadian commercial radio, Lightfoot recounted how he had agonised while trying to pen the lyrics over possible inaccuracies until Lenny Waronker, his long-time producer and friend, finally removed his writer's block simply by advising him to play to his artistic strengths and \"just tell a story\".", "On the other hand, Lightfoot's personal passion for recreational sailing on the Great Lakes informs his ballad's verses throughout.", "The song was recorded in December 1975 at Eastern Sound, a recording studio made out of two Victorian houses at 48 Yorkville Avenue in a then-beatnik district of downtown Toronto, Ontario, Canada.", "The famous studio, which also recorded Rush, Cat Stevens, Bruce Springsteen and Jimi Hendrix, was later torn down and replaced by a parking lot.", "The song was the first commercial early digital multi-track recording tracked on the prototype 3M 32-track digital recorder, a novel technology for the time.", "Pee Wee Charles and Terry Clements came up with \"the haunting guitar and steel riffs\" on a \"second take\" during the evening session.", "\"Lightfoot cleared the studio and killed all the lights save the one illuminating his parchment of scribbled words\" when recording his vocal part.", "The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album \"Melville.\"" ] ], "gold": "\"The Wreck of the Edmund Fitzgerald\" is a 1976 hit song written, composed and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album \"Melville\". NRBQ frequently performed \"The Wreck of the \"Edmund Fitzgerald\"\" live, though in a less than serious manner. Video shows vocalist Terry Adams, reading from a lyrics sheet, chuckling as his voice cracks, while audience members throw debris at the stage. In 2005, American metal band Jag Panzer released a cover of this song on a single. Nash the Slash released a cover of The Wreck of the Edmund Fitzgerald on his final studio album, \"In-A-Gadda-Da-Nash\" (2008).", "prediction 1": "\"The Wreck of the Edmund Fitzgerald\" is a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. The original version was recorded in December 1975 at Eastern Sound, a recording studio made out of two Victorian houses at 48 Yorkville Avenue in a then-beatnik district of downtown Toronto, Ontario, Canada. The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album Melville.", "prediction 2": "The Wreck of the Edmund Fitzgerald is a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. In 1976, Lightfoot recorded the song and it was released as a single on his 1976 album Summertime Dream. The song was re-recorded in 1988 for the compilation album God's Gold, Vol. 2.", "prediction 3": "The Wreck of the Edmund Fitzgerald was a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. The song was originally recorded by Lightfoot in 1976 and appeared on his 1976 album Summertime Dream in the United States. It reached number 1 in his native Canada on November 20, 1976, barely a year after the disaster. The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album Melville.", "prediction 4": "The Wreck of the Edmund Fitzgerald was a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. Lightfoot considered this song to be his finest work. The song was recorded in December 1975 at Eastern Sound, a recording studio made out of two Victorian houses at 48 Yorkville Avenue in a then-beatnik district of downtown Toronto, Ontario, Canada. The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album Melville.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 442 } ], "missing-info": [], "corrected-prediction": "\"The Wreck of the Edmund Fitzgerald\" is a song written, composed, and performed by Canadian singer-songwriter Gordon Lightfoot to commemorate the sinking of the bulk carrier SS Edmund Fitzgerald on Lake Superior on November 10, 1975. The Canadian art-rock group The Rheostatics recorded a version of the song for their 1991 album Melville." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who plays lee strobel in case for christ?", "passages": [ [ "The Case for Christ", "The Case for Christ\n\nThe Case for Christ is a 2017 American Christian drama film directed by Jon Gunn and written by Brian Bird, based on a true story that inspired the 1998 book of the same name by Lee Strobel.", "The film stars Mike Vogel, Erika Christensen, Faye Dunaway and Robert Forster, and follows an atheist journalist who looks to disprove his wife's Christian faith.", "The film was released on April 7, 2017 by Pure Flix Entertainment.", "In 1980, atheist and investigative journalist Lee Strobel applies his journalistic and legal skills to attempt to disprove his wife Leslie's newfound Christian faith, which creates a rift within his marriage.", "After completing a thorough investigation for almost two years he finds the historical evidence for Jesus, and then finds a new faith in Christ.", "In the United States and Canada, \"The Case for Christ\" was released on April 7, 2017 alongside \"Going in Style\" and \"\", and was projected to gross $5\u00a0million in its opening weekend from 1,174 theaters.", "It ended up debuting to $3.9\u00a0million, finishing 10th at the box office.", "In its second weekend the film grossed $2.8 million, dropping 30.5% and finishing 9th at the box office." ], [ "Lee Strobel", "Lee Strobel\n\nLee Patrick Strobel (born January 25, 1952) is an American Christian author and a former investigative journalist.", "He has written several books, including four which received ECPA Christian Book Awards (1994, 1999, 2001, 2005) and a series which addresses challenges to a Biblically inerrant view of Christianity.", "He also hosted a television program called \"Faith Under Fire\" on PAX TV and runs a video apologetics web site.", "Strobel has been interviewed on numerous national television programs, including ABC's \"20/20\", Fox News, and CNN.", "Strobel was born in Arlington Heights, Illinois.", "He received a journalism degree from University of Missouri and a Master of Studies in Law degree from Yale Law School, becoming a journalist for the \"Chicago Tribune\" and other newspapers for 14 years.", "In 1980, the UPI Illinois Editors Association newspaper award program gave him a first place for public service (the Len H. Small Memorial award) for his coverage of the Pinto crash trial of Ford Motor in Winamac, Indiana.", "Strobel states he was an atheist when he began investigating the Biblical claims about Christ after his wife's conversion.", "Prompted by the results of his investigation, he became a Christian on November 8, 1981." ] ], "gold": "In the 2017 American Christian drama film The Case for Christ, protagonist and real-life Christian author Lee Strobel is played by Mike Vogel. In scenes depicting Strobel's youth, the character is played by Michael Provost.", "prediction 1": "The Case for Christ is a 2017 American Christian drama film directed by Jon Gunn and written by Brian Bird that is based on the 1998 book of the same name by Lee Strobel. The film stars Mike Vogel, Erika Christensen, Faye Dunaway and Robert Forster, and follows an atheist journalist who looks to disprove his wife's Christian faith. In 1980, Lee Strobel applies his journalistic and legal skills to attempt to disprove his wife Leslie's newfound Christian faith, which creates a rift within his marriage. After completing a thorough investigation for almost two years, he finds the historical evidence for Jesus, and then finds a new faith in Christ.", "prediction 2": "Lee Strobel is an atheist journalist who looks to disprove his wife Leslie's newfound Christian faith. However, after completing a thorough investigation for almost two years, he finds the historical evidence for Jesus, and then finds a new faith in Christ. In the 2017 Christian drama movie, Mike Vogel plays Lee Strobel, Erika Christensen plays Lee Strobel, Faye Dunaway plays Lee Strobel, and Robert Forster plays Lee Strobel.", "prediction 3": "The Case for Christ is a 2017 American Christian drama film directed by Jon Gunn and written by Brian Bird, based on a true story that inspired the 1998 book of the same name by Lee Strobel. The film stars Mike Vogel, Erika Christensen, Faye Dunaway and Robert Forster, and follows an atheist journalist who looks to disprove his wife's Christian faith. After completing a thorough investigation for almost two years he finds the historical evidence for Jesus, and then finds a new faith in Christ.", "prediction 4": "The Case for Christ is a 2017 American Christian drama film directed by Jon Gunn and written by Brian Bird, based on a true story that inspired the 1998 book of the same name by Lee Strobel. Mike Vogel plays Lee Strobel. Erika Christensen plays Lee Strobel. Faye Dunaway plays Lee Strobel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 106 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 505 }, { "error type": "Irrelevant", "explanation": "", "start": 506, "end": 651 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Case for Christ is a 2017 American Christian drama film that is based on Lee Strobel, an American Christian author. The film stars Mike Vogel." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When do jim and pam kiss in the office?", "passages": [ [ "Pam Beesly", "Pam ultimately calls off her wedding to Roy, but they remain friendly and he is determined to win her back by being less of a jerk.", "She reconciles with Roy at Phyllis's wedding as a response to watching Jim date Karen.", "In an attempt at a fresh start with Roy, Pam comes clean about Jim kissing her during \"Casino Night\".", "Roy flies into a violent rage and Pam ends the relationship on the spot.", "The next day, Roy attempts to attack Jim in the office but is stopped by Dwight's pepper spray and is summarily fired.", "After losing his job, Roy meets Pam for coffee and says that even though Jim is dating Karen, she should at least make an effort to date him (in as much as she called off the wedding because of him).", "In season 5, Jim and Roy run into each other at a bar and Roy learns that Jim and Pam are engaged.", "The mood is somewhat awkward, but Roy is congratulatory, but then makes a somewhat passive-aggressive comment, seemingly meant to make Jim feel insecure about his current role in Pam's life, which tempts him to drive to Pratt, where she is attending art classes.", "Jim gets on the freeway, but changes his mind and remembers that he trusts Pam.", "Jim didn't want to treat Pam the same way Roy treated her." ], [ "Pam Beesly", "The office ultimately learns of their relationship in \"Dunder Mifflin Infinity\".", "In \"Chair Model\", after teasing Pam about his impending proposal, Jim tells the documentary crew he is not kidding around about an engagement and shows them a ring he bought a week after he and Pam started dating.", "In the next few episodes, Jim fake-proposes to Pam multiple times.", "In \"Goodbye, Toby\", Pam discovers she's been accepted at Pratt Institute, an art and design school in Brooklyn .", "In an interview later in the episode, Jim announces that he will propose to Pam that evening.", "Just as Jim is preparing to propose, however, Andy Bernard stands up and makes his own impromptu proposal to Angela.", "Having had his thunder stolen by Andy, Jim reluctantly puts the ring back in his jacket pocket, leaving Pam visibly disappointed as she was expecting Jim to propose that night.", "In the Season 5 premiere, \"Weight Loss\", Pam begins her three-month course at the Pratt Institute.", "In this episode, Jim proposes in the pouring rain at a rest stop, saying that he \"can't wait\".", "In \"Business Trip\", Pam learns that she is failing one of her classes and will have to remain in New York another three months to retake it." ], [ "Pam Beesly", "Pam Beesly\n\nPamela Morgan Halpert (n\u00e9e Beesly) is a fictional character on the U.S. television sitcom \"The Office\", played by Jenna Fischer.", "Her counterpart in the original UK series of \"The Office\" is Dawn Tinsley.", "Her character is initially the receptionist at the paper distribution company Dunder Mifflin, before becoming a saleswoman and eventually office administrator until she left in the series finale.", "Her character is shy, growing assertive but amiable, and artistically inclined, and shares romantic interest with Jim Halpert, whom she begins dating in the fourth season and marries and starts a family with as the series continues.", "The character was originally created to be very similar to the British counterpart, Dawn Tinsley.", "Even minute details, such as how Pam wore her hair each day, were considered by executive producer, Greg Daniels.", "\"When I went in for \"The Office\", the casting director said to me, 'Please look normal',\" recalls Jenna Fischer.", "\"Don't make yourself all pretty, and dare to bore me with your audition.", "Those were her words.", "Dare to bore me.\"", "Heeding the advice, Fischer said little during the auditions, during which she was interviewed in character by show producers, in an improvisational format, to imitate the show's documentary premise." ], [ "Casino Night", "Jim tells Jan that he's made a decision about the transfer.", "After Roy leaves, Jim tells Pam that he is in love with her.", "After a stunned pause, she states she cannot be with him.", "He tells her he wants to be more than friends, but she is sorry he \"misinterpreted things.\"", "Heartbroken, Jim apologizes for misinterpreting their friendship and discreetly wipes a tear from his cheek as he walks away.", "Jan leaves Michael and Carol, noticeably upset at the night's events, and it is revealed she packed an overnight bag in her car, implying she had planned to spend the night with Michael.", "Pam returns to the office and talks to her mother over the phone about Jim's statement.", "Jim enters the room and approaches her as she hastily hangs up.", "She begins to say something but Jim kisses her, and after hesitating, she returns the kiss, with the two staring at each other in silence.", "\"Casino Night\" was the first episode of the series written by Steve Carell.", "Initially, Carell suggested to executive producer Greg Daniels that an episode should revolve around a casino night.", "When it came time to plan the finale for the show, Daniels chose the idea and picked Carell to write the script." ], [ "Fun Run", "Fun Run\n\n\"Fun Run\" is the first and second episode of the fourth season of the American comedy television series \"The Office\", and the show's fifty-fourth and fifty-fifth episode overall.", "Written and directed by executive producer and showrunner Greg Daniels, the episode first aired on NBC in the United States on September 27, 2007.", "In the episode, Michael Scott (Steve Carell) believes the office is cursed after he accidentally hits Meredith Palmer (Kate Flannery) with his car.", "After being taken to the hospital, Meredith is found to have rabies.", "In an attempt to make amends with Meredith, Michael sponsors a fun run for rabies.", "Meanwhile, it is revealed that Jim Halpert (John Krasinski) and Pam Beesly (Jenna Fischer) are dating, while Angela Martin (Angela Kinsey) is mad at Dwight Schrute (Rainn Wilson) for killing her cat Sprinkles.", "The episode received mixed reviews from the varying critics, while most praised the episode for Jim and Pam's relationship.", "However, critics had differing opinions when it came to how Michael behaved throughout the episode." ], [ "Dunder Mifflin Infinity", "Dunder Mifflin Infinity\n\n\"Dunder Mifflin Infinity\" is the third and fourth episode of the fourth season of the American comedy television series \"The Office\", and the show's fifty-sixth and fifty-seventh episode overall.", "The episode was written by Michael Schur, who also acts in the show, and directed by Craig Zisk.", "It first aired in the United States on October 4, 2007 on NBC.", "In this episode, Ryan returns to his old office and reveals his plan to bring technology to Dunder Mifflin.", "Michael and Dwight try to prove that the personal touch is better than technology.", "Meanwhile, Jim and Pam reveal their relationship to the rest of the office, Kelly attempts to reunite with Ryan, and Dwight and Angela's relationship continues to plummet.", "Ryan Howard (B. J. Novak) returns to the Scranton, Pennsylvania branch of Dunder Mifflin for the first time since his promotion to the corporate headquarters.", "Although he sports a much more urbane look and attitude, he garners little respect from his former peers.", "Ryan introduces \"Dunder Mifflin Infinity,\" his initiative to revitalize the company with new technology." ] ], "gold": "Pamela Halpert is a fictional character on the U.S. television sitcom The Office, played by Jenna Fischer. Her character shares romantic interest with Jim Halpert, whom she begins dating in the fourth season. In episode 22 named Casino Night, Jim and Pam kiss after Jim tells Pam that he is in love with her. This episode aired on May 11, 2006. In the season 4 premiere Fun Run, Jim and Pam confess that they have started dating after the camera crew catches them kissing. The office ultimately learns of their relationship in Dunder Mifflin Infinity. Fun Run aired on September 27, 2007 and Dunder Mifflin Infinity aired on October 4, 2007.", "prediction 1": "Pam Beesly is a fictional character on the U.S. television sitcom The Office, played by Jenna Fischer. In season 5, Jim and Roy run into each other at a bar and Roy learns that Jim and Pam are engaged. In season 5 episode 5, \"Chair Model\", Jim proposes to Pam in the pouring rain at a rest stop.\n", "prediction 2": "In the U.S. television sitcom, The Office, actress Jenna Fischer plays Pam Beesly, a character from the original UK series. In season four, Jim and Pam run into each other at a bar and Roy learns that Jim and Pam are engaged. In season five, Jim and Pam run into each other at a bar and Roy learns that Jim and Pam are engaged.", "prediction 3": "In the US version of The Office, during episode 4, \"Goodbye, Toby,\" all three of Pam Beesly's boyfriends kiss. During season 5, \"Casino Night\", and \"Chair Model\", Jim proposes to Pam.", "prediction 4": "On the television sitcom The Office, the characters Pam Beesly and Jim Halpert kiss from time to time. Jim and Pam kiss at the end of an episode when she is on her way to staff dinner and Jim announces his engagement to her.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 296 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 2 ] } ], "corrected-prediction": "Pam Beesly is a fictional character on the U.S. television sitcom The Office, played by Jenna Fischer. Her character shares a romantic interest with Jim Halpert, whom she begins dating in the fourth season. In \"Casino Night\", Jim and Pam kiss after Jim tells Pam that he is in love with her. In \"Fun Run\",premiered on September 27, 2007, it is revealed that Jim and Pam are dating. The office ultimately learns of their relationship in Dunder Mifflin Infinity, which aired on October 4, 2007.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who were the four aces in the military's most wanted deck of cards?", "passages": [ [ "Most-wanted Iraqi playing cards", "Most-wanted Iraqi playing cards\n\nDuring the 2003 invasion of Iraq by a United States-led coalition, the U.S. military developed a set of playing cards to help troops identify the most-wanted members of President Saddam Hussein's government, mostly high-ranking members of the Iraqi Regional Branch of the Arab Socialist Ba'ath Party or members of the Revolutionary Command Council.", "The cards were officially named the \"personality identification playing cards\".", "As of 2018, all but 6 of the 52 most wanted have been captured.", "Each card contains the wanted person's address and, if available, the job performed by that individual.", "The highest-ranking cards, starting with the aces and kings, were used for the people at the top of the most-wanted list.", "The ace of spades is Saddam Hussein, the aces of clubs and hearts are his sons Qusay and Uday respectively, and the ace of diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti.", "This strict correspondence to the order of the most-wanted list was not carried through the entire deck, but some time later in 2003, the list itself was renumbered to conform (almost) to the deck of cards.", "The card backs feature a green military camouflage pattern." ] ], "gold": "In the most-wanted Iraqi deck of playing cards released by the U.S. Defense Intelligence Agency during the 2003 invasion of Iraq, President Saddam Hussein was depicted on the ace of spades. Hussein's sons Qusay Hussein and Uday Hussein were portrayed on the ace of clubs and ace of hearts respectively. Hussein's presidential secretary Abid Hamid Mahmud al-Tikriti appeared on the ace of diamonds.", "prediction 1": "The Ace of Spades is Saddam Hussein, the Aces of Clubs and Hearts are his sons Qusay and Uday respectively, and the Ace of Diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti. The ace of Diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti.", "prediction 2": "The four aces in the most wanted deck of cards are: Saddam Hussein, his sons Qusay and Uday, and his presidential secretary Abid Hamid Mahmud al-Tikriti.", "prediction 3": "The ace of spades is Saddam Hussein, the aces of clubs and hearts are his sons Qusay and Uday respectively, and the ace of diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti.", "prediction 4": "The four aces in the military's most wanted deck of cards are: the ace of spades is Saddam Hussein, the aces of clubs and hearts are his sons Qusay and Uday respectively, and the ace of diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Ace of Spades is Saddam Hussein, the Aces of Clubs and Hearts are his sons Qusay and Uday respectively, and the Ace of Diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti. ", "start": 197, "end": 281 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Most-wanted Iraqi playing cards During the 2003 invasion of Iraq by a United States-led coalition, the U.S. military developed a set of playing cards. The Ace of Spades is Saddam Hussein, the Aces of Clubs and Hearts are his sons Qusay and Uday respectively, and the Ace of Diamonds is Saddam's presidential secretary Abid Hamid Mahmud al-Tikriti. " }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "Where was the hindenburg scheduled to fly and how many passengers were on the british airship?", "passages": [ [ "Hindenburg disaster", "Hindenburg disaster\n\nThe \"Hindenburg\" disaster occurred on May 6, 1937, in Manchester Township, New Jersey, United States.", "The German passenger airship LZ 129 \"Hindenburg\" caught fire and was destroyed during its attempt to dock with its mooring mast at Naval Air Station Lakehurst.", "On board were 97 people (36 passengers and 61 crewmen); there were 36 fatalities (13 passengers and 22 crewmen, 1 worker on the ground).", "The disaster was the subject of spectacular newsreel coverage, photographs, and Herbert Morrison's recorded radio eyewitness reports from the landing field, which were broadcast the next day.", "A variety of hypotheses have been put forward for both the cause of ignition and the initial fuel for the ensuing fire.", "The event shattered public confidence in the giant, passenger-carrying rigid airship and marked the abrupt end of the airship era.", "After opening its 1937 season by completing a single round-trip passage to Rio de Janeiro, Brazil, in late March, the \"Hindenburg\" departed from Frankfurt, Germany, on the evening of May 3, on the first of 10 round trips between Europe and the United States that were scheduled for its second year of commercial service.", "American Airlines had contracted with the operators of the \"Hindenburg\" to shuttle the passengers from Lakehurst to Newark for connections to airplane flights." ], [ "Joint Base McGuire\u2013Dix\u2013Lakehurst", "It was then gained by the United States Army as Camp Kendrick during World War I.", "The United States Navy purchased the property in 1921 for use as an airship station and renamed it Naval Air Station Lakehurst.", "The Navy's lighter-than-air program was conducted at Lakehurst through the 1930s.", "It was the site of the 1937 LZ 129 Hindenburg airship disaster.", "During World War II, anti-submarine patrol blimps were operated from Lakehurst.", "Since the 1950s, Aviation Boatswain's Mates have been trained at Lakehurst to operate catapults and arresting systems on aircraft carriers.", "Lakehurst conducts the unique mission of supporting and developing the Aircraft Launch and Recovery Equipment and Support Equipment for naval aviation.", "The Electromagnetic Aircraft Launch System and the Advanced Arresting Gear system that will replace the existing steam catapults and the Mk-7 arresting gear are being developed and tested at Lakehurst at full-scale shipboard representative test facilities here.", "Source:\n\nThe Hindenburg disaster took place on Thursday, May 6, 1937, as the German passenger airship LZ 129 \"Hindenburg\" caught fire and was destroyed during its attempt to dock with its mooring mast at the Lakehurst Naval Air Station.", "In February 2004, installation commanders from the three installations formed a partnership to generate joint solutions for common problems between the three contiguous bases and their tenant commands." ] ], "gold": "The Hindenburg disaster was an airship accident that occurred on May 6, 1937, in Manchester Township, New Jersey, United States. The German passenger airship LZ 129 Hindenburg was scheduled to fly to Naval Air Station Lakehurst, where it then caught fire and was destroyed during its attempt to dock with its mooring mast. The accident caused 35 fatalities (13 passengers and 22 crewmen) from the 97 people on board (36 passengers and 61 crewmen), and an additional fatality on the ground.", "prediction 1": "The 1937 british passenger airship Hindenburg was scheduled to fly to the United States from Frankfurt, Germany on May 3, 1937, and passengers were supposed to be able to board in Newark, New Jersey. The German passenger airship caught fire and was destroyed during its attempt to dock with its mooring mast at Naval Air Station Lakehurst. On board were 97 people (36 passengers and 61 crewmen); there were 36 fatalities.", "prediction 2": "The passenger airship Hindenburg was scheduled to fly between Frankfurt, Germany and the United States on 10 round trips between Europe and the United States. There were 97 passengers on board the passenger airship in total. On May 6, 1937, the LZ 129 Hindenburg caught fire and was destroyed during its attempt to dock with its mooring mast at Naval Air Station Lakehurst. On board were 36 passengers and 61 crewmen; there were 36 fatalities.", "prediction 3": "The 1937 German passenger airship Hindenburg caught fire and was destroyed during its attempt to dock with its mooring mast at Naval Air Station Lakehurst, New Jersey. On board were 97 people (36 passengers and 61 crewmen), including 36 fatalities. American Airlines had contracted with the operators of the Hindenburg to shuttle the passengers from Lakehurst to Newark for connections to airplane flights.", "prediction 4": "The LZ 129 Hindenburg passenger airship caught fire and was destroyed during its attempt to dock with its mooring mast at the Lakehurst Naval Air Station on May 6, 1937. On board were 97 people (36 passengers and 61 crewmen); there were 36 fatalities. American Airlines had contracted with the operators of the Hindenburg to shuttle the passengers from Lakehurst to Newark for connections to airplane flights.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 199 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Hindenburg disaster was an airship accident that occurred on May 6, 1937, in Manchester Township, New Jersey, United States. The German passenger airship LZ 129 \"Hindenburg\" caught fire and was destroyed during its attempt to dock with its mooring mast at Naval Air Station Lakehurst. On board were 97 people (36 passengers and 61 crewmen); there were 36 fatalities (13 passengers and 22 crewmen, 1 worker on the ground)." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who is the current us army chief of staff?", "passages": [ [ "Raymond T. Odierno", "Raymond T. Odierno\n\nRaymond Thomas \"Ray\" Odierno (; born 8 September 1954) is a retired four-star general of the United States Army who served as the 38th Chief of Staff of the Army.", "Prior to his service as Chief of Staff, Odierno commanded United States Joint Forces Command from October 2010 until its disestablishment in August 2011.", "He served as Commanding General, United States Forces \u2013 Iraq and its predecessor, Multi-National Force \u2013 Iraq, from September 2008 through September 2010.", "Before then, he served as Commanding General, III Corps, from May 2006 to May 2008.", "Odierno is the twelfth American military officer to command at the Division, Corps, and Army level during the same conflict and only the second with this distinction since the Vietnam War.", "Before commanding III Corps, he served as Assistant to the Chairman of the Joint Chiefs of Staff in Washington, where he was the primary military adviser to Secretary of State Condoleezza Rice from 3 November 2004 to 1 May 2006.", "Odierno is the 2009 recipient of the Naval War College Distinguished Graduate Leadership Award for his strategic leadership and insight.", "Odierno, who is of Italian descent, grew up in Rockaway, New Jersey, where he attended Morris Hills High School, followed by the United States Military Academy at West Point.", "He graduated in June 1976 with a Bachelor of Science degree." ], [ "Raymond T. Odierno", "On 30 May 2011, Odierno was nominated to be Army Chief of Staff.", "He was confirmed to take over from General Martin E. Dempsey on 7 September 2011, and sworn in as 38th Army Chief of Staff later that day.", "In 2014, Odierno submitted a budget request for 520,000 active-duty soldiers, and said that the bare minimum was 450,000, which would, however, be at a \"high risk to meet one major war\".", "In August 2015, Odierno retired from the Army after 39 years of service.", "Odierno accepted a job by JP Morgan Chase & Co as a senior adviser on \"risks of doing business in various countries, technology and cybersecurity\" to start on September 1, 2015, per the Wall Street Journal.", "Odierno is now Chairman of Eastern Air Lines (new 2015) a charter airline based in Miami, FL which operates in Latin America, Caribbean and Continental US as a charter flight operation.", "United States Military Academy \u2013 Class of 1976\n\n", "On 19 March 2013, The Tragedy Assistance Program for Survivors (TAPS) presented General Odierno with the Military Leadership Award.", "General Odierno has been outspoken in his support for military families and those grieving the death of a loved one in service to country." ], [ "James C. McConville", "James C. McConville\n\nJames C. McConville is a United States Army general who serves as the 36th Vice Chief of Staff of the U.S. Army.", "He previously served as Deputy Chief of Staff G-1 Personnel of The United States Army.", "General James C. McConville of Quincy, Massachusetts graduated from the United States Military Academy and was commissioned as an Infantry officer in the regular Army in 1981.", "He holds a Bachelor of Science degree from the United States Military Academy, a Master of Science degree in Aerospace Engineering from Georgia Institute of Technology, and was a 2002 National Security Fellow at Harvard University.", "General McConville\u2019s command assignments include Commanding General of the 101st Airborne Division (Air Assault), where he also served as the Commanding General of Combined Joint Task Force-101, Operation Enduring Freedom; Deputy Commanding General (support) of Combined Joint Task Force-101, Operation Enduring Freedom; Commander of 4th Brigade, 1st Cavalry Division, Operation Iraqi Freedom; Commander of 2nd Squadron, 17th Cavalry Regiment, 101st Airborne Division (Air Assault); and Commander of C Troop, 2nd Squadron, 9th Cavalry Regiment, 7th Infantry Division (Light)." ] ], "gold": "The current US Army Chief of Staff is General James Charles McConville, who has been in the position since August 9, 2019. General Mark A. Milley served as the 39th US Army Chief of Staff prior to him. Other Chief of Staff includes General Raymond T. Odierno and General Martin E. Dempsey, who served as the 38th and 37th US Army Chief of Staff, respectively.", "prediction 1": "On 30 May 2011, Raymond T. Odierno was nominated to be Army Chief of Staff. He was confirmed to take over from General Martin E. Dempsey on 7 September 2011, and sworn in as the 38th Army Chief of Staff later that day. James C. McConville is a United States Army general who serves as the 36th Vice Chief of Staff of the United States Army. He previously served as Deputy Chief of Staff G-1 Personnel of The United States Army.", "prediction 2": "Raymond T. Odierno is a retired four-star general of the United States Army who served as the 38th Chief of Staff of the Army. Prior to his service as Chief of Staff, Odierno commanded United States Joint Forces Command from October 2010 until its disestablishment in August 2011. James C. McConville is a United States Army general who serves as the 36th Vice Chief of Staff of the United States Army.", "prediction 3": "The United States Army has had several Chief of Staffs. The current chief of staff is Raymond T. Odierno, who served as the 38th Chief of Staff from October 2010 until the end of the year 2011. Prior to his service as Chief of Staff, Odierno commanded United States Joint Forces Command from October 2010 until its disestablishment in August 2011. The current chief of staff is James C. McConville, who serves as the 36th Vice Chief of Staff of the US Army and is based in Fort Hood, Texas.", "prediction 4": "The United States Army has had several Chiefs of Staff since the end of the Vietnam War. Raymond T. Odierno, a retired four-star general, was nominated to be Army Chief of Staff on 30 May 2011. He was confirmed to take over from General Martin E. Dempsey on 7 September 2011, and sworn in as the 38th Army Chief of Staff on 30 September 2011. James C. McConville, a retired United States Army general, served as the 36th Vice Chief of Staff of The United States Army.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 15 }, { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 54 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 427 } ], "missing-info": [], "corrected-prediction": "Raymond T. Odierno was the 38th Army Chief of Staff. He take over from General Martin E. Dempsey, the previous Army Chief of Staff." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the army air corp become the air force?", "passages": [ [ "Army Air Forces School of Applied Tactics", "Army Air Forces School of Applied Tactics\n\nThe Army Air Forces School of Applied Tactics (known as AAFSAT) was a major command of the United States Army Air Forces.", "It was merged with Army Air Forces Proving Ground Command on 8 March 1946 at Orlando Army Air Base, Florida.", "The Army Air Forces School of Applied Tactics was a major command and military training organization of the United States Army Air Forces during World War II.", "Its function was to train cadres from newly formed units in combat operations under simulated field conditions as the cores around which new combat groups would be formed.", "The lack of a true tactical training center and the closure of the Air Corps Tactical School in 1940, coupled with the impracticality of further splitting of existing combat groups into cadre for new groups, made AAFSAT a necessity.", "The Commandant of AAFSAT was Brigadier General Hume Peabody, formerly assistant commandant of the ACTS.", "In addition to its training function, the school also developed as a tactical doctrine development center, assuming the functions formerly assigned the ACTS.", "In this function it also became known as the Army Air Forces Tactical Center (AAFTAC).", "At the entry of the United States into World War II on 7 December 1941, the USAAF had expanded to 67 groups from a pre-1939 total of 15, but approximately half were paper units just forming." ], [ "United States Army Air Corps", "United States Army Air Corps\n\nThe United States Army Air Corps (USAAC) was the aerial warfare service of the United States of America between 1926 and 1941.", "After World War I, as early aviation became an increasingly important part of modern warfare, a philosophical rift developed between more traditional ground-based army personnel and those who felt that aircraft were being underutilized and that air operations were being stifled for political reasons unrelated to their effectiveness.", "The USAAC was renamed from the earlier United States Army Air Service on 2 July 1926, and was part of the larger United States Army.", "The Air Corps became the United States Army Air Forces (USAAF) on 20 June 1941, giving it greater autonomy from the Army's middle-level command structure.", "During World War II, although not an administrative echelon, the Air Corps (AC) remained as one of the combat arms of the Army until 1947, when it was legally abolished by legislation establishing the Department of the Air Force.", "The Air Corps was renamed by the United States Congress largely as a compromise between the advocates of a separate air arm and those of the traditionalist Army high command who viewed the aviation arm as an auxiliary branch to support the ground forces." ] ], "gold": "The United States Army Air Corps served as the primary air arm of the U.S. Army from July 2, 1926 until June 20, 1941, when it was absorbed into the then-new United States Army Air Forces. USAAC remained one of the combat arms of the Army until September 18, 1947, when it was legally abolished by legislation establishing the Department of the Air Force.", "prediction 1": "The Army Air Corps was the aerial warfare service of the United States of America between 1926 and 1941. The Air Corps became the United States Army Air Forces (USAAF) on 20 June 1941, giving it greater autonomy from the Army's middle-level command structure.", "prediction 2": "The United States Army Air Corps was the aerial warfare service of the United States of America between 1926 and 1941. The Air Corps became the United States Army Air Forces on 20 June 1941, giving it greater autonomy from the Army's middle-level command structure. The Air Forces School of Applied Tactics was a major command and military training organization of the United States Army Air Forces during World War II. The lack of a true tactical training center and the closure of the Air Corps Tactical School in 1940, coupled with the impractical of further splitting of existing combat groups for new combat groups, made AAFSAT a necessity.", "prediction 3": "The Air Corps became the US Army Air Forces on 20 June 1941, giving it greater autonomy from the Army's middle-level command structure. The Air Corps was renamed by the United States Congress largely as a compromise between the advocates of a separate air arm and those of the traditionalist Army high command who viewed the aviation arm as an auxiliary branch to support the ground forces.", "prediction 4": "The United States Army Air Corps was the aerial warfare service of the United States of America between 1926 and 1941. It was renamed from the earlier United States Army Air Service on 2 July 1926, and was part of the larger United States Army. The Air Corps became the United States Army Air Forces (USAAF) on 20 June 1941, giving it greater autonomy from the Army's middle-level command structure.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 259 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Army Air Corps was the aerial warfare service of the United States of America between 1926 and 1941. The Air Corps became the United States Army Air Forces (USAAF) on 20 June 1941. The Air Corps (AC) remained as one of the combat arms of the Army until 1947, when it was legally abolished by legislation establishing the Department of the Air Force." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When was the last time england got through to the quarter finals in world cup?", "passages": [ [ "Video assistant referee", "Italy opened the world's first VAR training centre in Coverciano in January 2018.", "On 3 March 2018, the IFAB wrote the VARs into the Laws of the Game on a permanent basis.", "On 15 November 2018, Premier League teams voted in principle to bring Video Assistant Referees To the Premier League from the 2019/20 season onwards pending approval of IFAB and FIFA; this comes after a controversial decision from Referee Simon Hooper to disallow a goal scored by Southampton Football Club striker Charlie Austin.", "FIFA officially approved the use of VAR for the 2018 FIFA World Cup during the FIFA Council meeting on 16 March 2018 in Bogot\u00e1.", "This tournament became the first competition to use VAR in full (at all matches and in all venues).", "The 2018 FIFA World Cup marked the system's World Cup debut.", "A total of 335 incidents were checked by the VAR over the course of the group stage, averaging seven per match, and fourteen calls made by referees were changed or overruled after being reviewed by the VAR.", "According to FIFA, the VAR system had a success rate of 99.3 percent, up from the 95 percent of correct calls by referees without VAR.", "The first VAR decision at the World Cup came on 16 June in a group stage match between France and Australia, where referee Andres Cunha awarded a penalty to France after consulting with the VAR." ], [ "2019 FIFA Women's World Cup", "2019 FIFA Women's World Cup\n\nThe 2019 FIFA Women's World Cup will be the eighth edition of the FIFA Women's World Cup (formerly the Women's World Championship), the quadrennial international association football championship contested by the women's national teams of the member associations of the F\u00e9d\u00e9ration Internationale de Football Association (FIFA) between 7 June and 7 July 2019.", "In March 2015, France won the right to host the event; the first time the country will host the tournament, and the third time a European nation will.", "Matches are planned for nine cities across France.", "United States enters the competition as defending champions.", "On 6 March 2014, FIFA announced that bidding had begun for the 2019 FIFA Women's World Cup.", "Member associations interested in hosting the tournament had to submit a declaration of interest by 15 April 2014, and provide the complete set of bidding documents by 31 October 2014.", "In principle, FIFA prefer the 2019 FIFA Women's World Cup and the 2018 FIFA U-20 Women's World Cup to be hosted by the same member association, but if circumstances require, FIFA reserves the right to award the hosting of the events separately.", "Initially, five countries indicated interest in hosting the events: England, France, Korea Republic, New Zealand and South Africa." ], [ "Cricket World Cup", "New Zealand beat South Africa in a thrilling first semi-final to qualify for their maiden World Cup final.", "Australia defeated New Zealand by seven wickets in the final at Melbourne to lift the World Cup for the fifth time.", "The Test-playing nations qualify automatically for the World Cup main event while the other teams have to qualify through a series of preliminary qualifying tournaments.", "A new qualifying format was introduced for the 2015 Cricket World Cup.", "The top two teams of the 2011\u201313 ICC World Cricket League Championship qualify directly.", "The remaining six teams join the third and fourth-placed teams of 2011 ICC World Cricket League Division Two and the top two teams of the 2013 ICC World Cricket League Division Three in the World Cup Qualifier to decide the remaining two places.", "Qualifying tournaments were introduced for the second World Cup, where two of the eight places in the finals were awarded to the leading teams in the ICC Trophy.", "The number of teams selected through the ICC Trophy had varied throughout the years.", "The World Cricket League (administered by the International Cricket Council) is the qualification system provided to allow the Associate and Affiliate members of the ICC more opportunities to qualify.", "The name \"ICC Trophy\" has been changed to \"ICC World Cup Qualifier\".", "Under the current qualifying process, the World Cricket League, all Associate and Affiliate members of the ICC are able to qualify for the World Cup." ] ], "gold": "The last time England got through to the quarter finals in the FIFA world cup was 2018. They made it to the women's World Cup quarter finals in 2019. 2011 was England's last time to go to the quarter finals in the Cricket World Cup and Rigby World Cup.", "prediction 1": "There has been several World Cups in which England achieved the quarter finals. During the 2018 FIFA World Cup, England reached the quarter finals of the men's competition, and in the 2015 Cricket World Cup, the nation progressed to the final. During the 2018 FIFA World Cup, England reached the quarter finals. During the 2019 FIFA World Cup, England reached the final.", "prediction 2": "England last made the quarter finals of the men's World Cup in 1998, while in the women's World Cup they made the quarter finals in 2002. In the cricket World Cup, England made the quarter finals in 2010 and in 2014, they made the quarter finals in 2015.", "prediction 3": "England have reached the quarter finals of the Cricket World Cup six times. In the 2014 World Cup, they reached the final by defeating South Africa in the first semi-final. The last time England reached the last four of the World Cup was in 2018. The last time they reached the last four of the Cricket World Cup was in 1990.", "prediction 4": "England were last to qualify for the quarter-finals of the 2006 World Cup when they lost to South Africa. Then England reached the quarter-finals of the 2010 World Cup when they lost to South Africa. Then, in 2014, England got through to the quarter finals of the 2007 World Cup when they lost to South Africa.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 79 }, { "error type": "Unverifiable", "explanation": "", "start": 80, "end": 243 }, { "error type": "Unverifiable", "explanation": "", "start": 244, "end": 370 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When does greys anatomy come back on 2017?", "passages": [ [ "Grey's Anatomy (season 14)", "Grey's Anatomy (season 14)\n\nThe fourteenth season of the American television medical drama \"Grey's Anatomy\" was ordered on February 10, 2017, by American Broadcasting Company (ABC), and premiered on September 28, 2017 with a special two-hour premiere.", "The season consists of 24 episodes, with the season's seventh episode marking the 300th episode for the series overall.", "The season is produced by ABC Studios, in association with Shondaland Production Company and The Mark Gordon Company; the showrunners being Krista Vernoff and William Harper.", "The fourteenth season is the first not to feature Jerrika Hinton as Dr. Stephanie Edwards since her introduction in the ninth season, following her departure at the conclusion of the previous season.", "The season marks the last appearance of Martin Henderson, Jason George, Jessica Capshaw, and Sarah Drew as series regulars, as well as the first appearance of Jaina Lee Ortiz as Andy Herrera, the lead character of \"Grey's Anatomy\"'s second spin-off series, \"Station 19\".", "On April 20, 2018, ABC officially renewed \"Grey's Anatomy\" for a network primetime drama record-tying fifteenth season.", "The season follows the story of surgical residents, fellows, and attendings as they experience the difficulties of the competitive careers they have chosen." ], [ "Grey's Anatomy", "Since its inception, the show has been described by the media outlets as a television \"phenomenon\" or a \"juggernaut\", owing to its longevity and dominant ratings.", "It is considered to have had a significant effect on popular culture and has received numerous awards, including the Golden Globe Award for Best Television Series \u2013 Drama.", "It has received thirty-eight Primetime Emmy Award nominations, including two for Outstanding Drama Series.", "The cast members have also received several accolades for their respective performances.", "\"Grey's Anatomy\" is the longest-running scripted primetime show currently airing on ABC, the longest scripted primetime ABC show ever, and the second-longest primetime medical drama, after \"ER\".", "The series follows Meredith Grey (Ellen Pompeo), the daughter of an esteemed general surgeon named Ellis Grey, following her acceptance into the residency program at the fictional Seattle Grace Hospital.", "During her time as a resident, Grey works alongside her fellow doctors Cristina Yang (Sandra Oh), Izzie Stevens (Katherine Heigl), Alex Karev (Justin Chambers), and George O'Malley (T. R. Knight), who each struggle to balance personal lives with the hectic work and training schedules." ], [ "True Colors (Grey's Anatomy)", "True Colors (Grey's Anatomy)\n\n\"True Colors\" is the twenty-third episode of the thirteenth season of the American television medical drama \"Grey's Anatomy\", and is the 292nd episode overall.", "It aired on May 11, 2017 on ABC in the United States.", "The episode was written by William Harper and directed by Kevin McKidd.", "In the episode Owen Hunt (McKidd) is informed about the fate of his sister, Megan, who's Nathan Riggs' fianc\u00e9e and had been MIA.", "Alex Karev (Justin Chambers) discovers the identity of Jo Wilson's (Camilla Luddington) abusive ex-husband, meanwhile the Grey Sloan Memorial's doctors treat a couple from a car accident, only to later discover their true identities as a rapist and his victim.", "\"True Colors\" was conceived as a vehicle to set up the eventual exit of series regular Jerrika Hinton in the season finale.", "Upon release it garnered mostly positive reviews, with critics highlighting the performances of the cast, McKidd and Hinton's in particular, as among their best.", "They were also appreciative of the tense writing, and McKidd's direction.", "Although the storyline focusing on Chambers' character drew mixed response." ] ], "gold": "The fourteenth season of the American television medical drama Grey's Anatomy premiered on September 28, 2017 with a special 2-hour premiere. The season consists of 24 episodes, with the season's seventh episode marking the 300th episode for the series overall. Previous episodes that came out in 2017 include: \"Ring of Fire\" on May 18, 2017; \"True Colors\" on May 11, 2017; and \"Leave it Inside\" on May 4, 2017. Grey's Anatomy is the longest-running scripted primetime show currently airing on ABC, and the longest scripted primetime series carried by ABC.", "prediction 1": "Grey's Anatomy returned to the air on November 2, 2017 with the premiere of the 14th season. The episode True Colors aired on May 11, 2017 and was the 292nd episode of the thirteenth season.", "prediction 2": "Grey's Anatomy returned to the air on September 28, 2017 for a fourteenth season. The thirteenth season's episode, True Colors, aired on May 11, 2017.", "prediction 3": "Grey's Anatomy, an American television medical drama, returned to the airwaves on September 28, 2017 with the episode True Colors. The episode aired on May 11, 2017. The series returned to the airwaves on September 24, 2017 with the episode True Colors.", "prediction 4": "Grey's Anatomy is an American television medical drama that has aired on ABC since the start of the 1990s, and has received numerous awards for its outstanding performances. The series' fourteenth season was ordered on February 10, 2017 by American Broadcasting Company (ABC), and premiered on September 28, 2017 with a special two-hour premiere. The fifteenth season was officially renewed on April 20, 2018 for a network primetime drama record-tying fifteenth season.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 0, "end": 54 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 147, "end": 164 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The fourteenth season of the American television medical drama Grey's Anatomy premiered on September 28, 2017 with a special 2-hour premiere. The season consists of 24 episodes, with the season's seventh episode marking the 300th episode for the series overall. The episode True Colors aired on May 11, 2017 and was the twenty-third episode of the thirteenth season. \"Grey's Anatomy\" is the longest-running scripted primetime show currently airing on ABC, the longest scripted primetime ABC show ever." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was president during the bay of pigs invasion?", "passages": [ [ "Bay of Pigs Invasion", "Command and control ship and carrier were also reportedly active in the Caribbean at the time.", "was a Landing Ship Dock that carried three LCUs (Landing Craft Utility) which could accommodate the Brigades M41 Walker Bulldog tanks and four LCVPs (Landing Craft, Vehicles, Personnel).", "\"San Marcos\" had sailed from Vieques Island.", "At \"Point Zulu\", the seven CEF ships sailed north without the USN escorts, except for \"San Marcos\" that continued until the seven landing craft were unloaded when just outside the Cuban territorial limit.", "During the night of 16/17 April, a mock diversionary landing was organized by CIA operatives near Bah\u00eda Honda, Pinar del R\u00edo Province.", "A flotilla containing equipment that broadcast sounds and other effects of a shipborne invasion landing provided the source of Cuban reports that briefly lured Fidel Castro away from the Bay of Pigs battlefront area.", "At about 00:00 on 17 April 1961, the two CIA LCIs \"Blagar\" and \"Barbara J\", each with a CIA 'operations officer' and an Underwater Demolition Team (UDT) of five frogmen, entered the Bay of Pigs \"(Bah\u00eda de Cochinos)\" on the southern coast of Cuba." ], [ "Bay of Pigs Invasion", "It was after the Cuban Revolution of 1959, that Castro forged strong economic links with the Soviet Union, with which, at the time, the United States was engaged in the Cold War.", "US President Dwight D. Eisenhower was very concerned at the direction Castro's government was taking, and in March 1960 he allocated $13.1 million to the CIA to plan Castro's overthrow.", "The CIA proceeded to organize the operation with the aid of various Cuban counter-revolutionary forces, training Brigade 2506 in Guatemala.", "Eisenhower's successor, John F. Kennedy, approved the final invasion plan on 4 April 1961.", "Over 1,400 paramilitaries, divided into five infantry battalions and one paratrooper battalion, assembled in Guatemala before setting out for Cuba by boat on 13 April 1961.", "Two days later, on 15 April, eight CIA-supplied B-26 bombers attacked Cuban airfields and then returned to the US.", "On the night of 16 April, the main invasion landed at a beach named Playa Gir\u00f3n in the Bay of Pigs.", "It initially overwhelmed a local revolutionary militia.", "The Cuban Army's counter-offensive was led by Jos\u00e9 Ram\u00f3n Fern\u00e1ndez, before Castro decided to take personal control of the operation.", "As the US involvement became apparent to the world, and with the initiative turning against the invasion, Kennedy decided against providing further air cover." ] ], "gold": "Fidel Castro was Cuban President during the bay of pigs invasion, and JFK was United States President.", "prediction 1": "John F. Kennedy was president at the time of the Bay of Pigs invasion.", "prediction 2": "John F. Kennedy, president of the United States during the Bay of Pigs invasion, was the successor to Dwight D. Eisenhower. Kennedy approved the final invasion plan on April 4, 1961.", "prediction 3": "John F. Kennedy, the US President during the Bay of Pigs invasion, was President of the United States from 1961-1963.", "prediction 4": "John F. Kennedy was the president of the United States during the Bay of Pigs invasion, which started on 16 April 1961. Eisenhower had succeeded him, and in March 1960 he allocated $13.1 million to the CIA to plan Castro's overthrow. Kennedy's successor, Dwight D. Eisenhower, approved the final invasion plan on 4 April 1961.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Fidel Castro was Cuban President during the bay of pigs invasion, and John F. Kennedy was United States President. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who wrote the song be still and know i am?", "passages": [ [ "Be Still (Kelly Clarkson song)", "Be Still (Kelly Clarkson song)\n\n\"Be Still\" is a song by American recording artist Kelly Clarkson, from her third studio album, \"My December \" (2007).", "Written by Kelly Clarkson and Aben Eubanks, and produced by David Kahne, \"Be Still\" is an acoustic folk blues ballad set moderately slow acoustic and electric guitars.", "Clarkson wrote the song as an introspective ballad based on her exhaustive experience from touring and promoting her second studio album, \"Breakaway\" (2004).", "Inspired by one of her favorite Bible verses, (\"Be still, and know that I (God) am here\"), the song is about taking a break from everyday things and taking a moment to appreciate one life.", "\"Be Still\" has received positive critical reception from music critics, who praised it as one of the album's highlights.", "Clarkson has included the song in the touring set of her My December Tour from 2007-08.", "Due to the pressure from the music executives and heavy work schedule, Clarkson began to have erratic experience while performing in her Breakaway World Tour.", "She recalled,\n\"Everything caught up with me in a bad way.", "My body was wearing down, and my emotions were wearing down.", "I was trying to get over someone." ], [ "Speechless (Steven Curtis Chapman album)", "Speechless (Steven Curtis Chapman album)\n\n", "Speechless is the ninth studio album by the Christian singer Steven Curtis Chapman.", "It was released on June 15, 1999, by Sparrow Records.", "It was certified platinum by the RIAA on November 27, 2000.", "Chapman received the 2000 Grammy Award for Best Pop/Contemporary Gospel Album and Dove Awards for Pop/Contemporary Album of the Year and Pop/Contemporary Recorded Song of the Year (for \"Dive\").", "The album provided more No. 1 chart singles (seven) on Christian contemporary radio than any of Chapman's other albums: \"The Change\", \"Fingerprints of God\", \"The Invitation\", \"Great Expectations\", \"Be Still And Know\", \"Dive\" and the title song \"Speechless\".", "The album is considered one of Chapman's greater works by many and is recognized by many as being one of the best Christian albums of all time.", "The concert tour in support of \"Speechless\" featured Chapman's longtime friend and co-writer Geoff Moore.", "All songs were written by Steven Curtis Chapman, except where noted." ], [ "Be Still and Know... Hymns & Faith", "Barry Westman, rating the album four stars at \"Worship Leader\", says, \"\"Be Still and Know\" contains just the right mix of familiar songs and newer songs of faith, all featuring Amy's familiar, smooth vocals.\"", "Mark D. Geil, writing a four star review for Jesus Freak Hideout, describes, \"\"Be Still and Know\" showcases some of Amy Grant's finest work while reaffirming her staying power and continued songcraft.\"", "Rating the album three and a half stars from Louder Than the Music, Jono Davies says, it is \"a real treat.\"", "Joshua Andre, awarding the album four stars at 365 Days of Inspiring Media, writes, \"Well done Amy for creating an album that reminds us why she is one of the best female singer/songwriters currently\".", "Giving the album nine out of ten stars from The Front Row Report, Reggie Edwards states, \"Amy Grant has done what she\u2019s done all along and created an album that will suck you in, get you involved and move you beyond your expectations.\"", "The album debuted at No. 88 on Top Current Albums, selling 5,000 copies in the first week.", "It also debuted No. 7 on Christian Albums on its release, where peaked at No. 6 the following year on that chart." ] ], "gold": "There are several songs entitled Be Still And Know. The 2007 song, Be Still, based on Psalm 46:10 was written by Kelly Clarkson, Aben Eubanks. Amy Grant wrote the 2015 version of Be Still and Know. And, Steven Curtis Chapman wrote the 1999 version of the song. ", "prediction 1": "\"Be Still\" is a song by American recording artist Kelly Clarkson, from her third studio album, My December (2007). Written by Kelly Clarkson and Aben Eubanks, and produced by David Kahne, \"Be Still\" is an acoustic folk blues ballad set moderately slow acoustic and electric guitars. Inspired by one of her favorite Bible verses, (\"Be still, and know that I (God) am here\"), the song is about taking a moment to appreciate one life.", "prediction 2": "American recording artist Kelly Clarkson wrote the song \"Be Still and Know I Am\" in 2007. Written by Clarkson and Aben Eubanks, and produced by David Kahne, \"Be Still\" is an acoustic folk blues ballad set moderately slow acoustic and electric guitars.", "prediction 3": "\"Be Still\" is a song by American recording artist Kelly Clarkson, from her third studio album, My December, 2007. Written by Kelly Clarkson and Aben Eubanks, and produced by David Kahne, \"Be Still\" is an acoustic folk blues ballad set moderately slow acoustic and electric guitars.", "prediction 4": "\"Be Still\" is a song by American recording artist Kelly Clarkson, from her third studio album, \"My December\" (2007). Written by Kelly Clarkson and Aben Eubanks, and produced by David Kahne, \"Be Still\" is an acoustic folk blues ballad set moderately slow acoustic and electric guitars. Inspired by one of her favorite Bible verses, (\"Be still, and know that I (God) am here\"), the song is about taking a moment to appreciate one life.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 49 }, { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 106 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 329, "end": 431 }, { "error type": "Redundant", "explanation": "\"Be Still\" is a song by American recording artist Kelly Clarkson, from her third studio album, My December (2007). ", "start": 126, "end": 140 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2, 3, 6, 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Be Still\" is a 2007 song written by Kelly Clarkson and Aben Eubanks. It is inspired by one of her favorite Bible verses. In 1999, Steven Curtis Chapman released his song \"Be Still And Know\", which he wrote as well. Amy Grant also has a song with the same name. " }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "When was the national world war ii memorial built?", "passages": [ [ "National World War II Memorial", "Under each of the two memorial arches, the Pacific and Atlantic baldacchinos, four eagles carry an oak laurel wreath.", "Each of the 56 pillars bear wreaths of oak symbolizing military and industrial strength, and of wheat, symbolizing agricultural production.", "Over the next four years, St. Florian's design was altered during the review and approval process required of proposed memorials in Washington, D.C. Ambassador Haydn Williams guided the design development for ABMC.", "Ground was broken in September 2001.", "The construction was managed by the General Services Administration.", "The triumphal arches were crafted by Rock of Ages Corporation.", "Sculptor Raymond Kaskey created the bronze eagles and two wreaths that were installed under the arches, as well as 24 bronze bas-relief panels that depict wartime scenes of combat and the home front.", "The bronzes were cast over the course of two and a half years at Laran Bronze in Chester, Pennsylvania.", "The stainless-steel armature that holds up the eagles and wreaths was designed at Laran, in part by sculptor James Peniston, and fabricated by Apex Piping of Newport, Delaware.", "The twin bronze wreathes decorating the 56 granite pillars around the perimeter of the memorial \u2014 as well as the 4,048 gold-plated silver stars representing American military deaths in the war \u2014 were cast at Valley Bronze in Joseph, Oregon." ], [ "National World War II Memorial", "National World War II Memorial\n\nThe World War II Memorial is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II.", "Consisting of 56 pillars and a pair of small triumphal arches surrounding a square and fountain, it sits on the National Mall in Washington, D.C., on the former site of the Rainbow Pool at the eastern end of the Reflecting Pool, between the Lincoln Memorial and the Washington Monument.", "Opened on April 29, 2004, it was dedicated by President George W. Bush on May 29, 2004.", "The memorial is administered by the National Park Service under its National Mall and Memorial Parks group.", "As of 2009, more than 4.4 million people visit the memorial each year.", "The memorial consists of 56 granite pillars, each tall, arranged in a semicircle around a plaza with two triumphal arches on opposite sides.", "Two-thirds of the site is landscaping and water.", "Each pillar is inscribed with the name of one of the 48 U.S. states of 1945, as well as the District of Columbia, the Alaska Territory and Territory of Hawaii, the Commonwealth of the Philippines, Puerto Rico, Guam, American Samoa, and the U.S. Virgin Islands.", "The northern arch is inscribed with \"Atlantic\"; the southern one, \"Pacific.\"" ] ], "gold": "Ground broke on construction on September, 2001 for the national world war II museum, and it officially opened on April 29, 2004.", "prediction 1": "The World War II Memorial is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II. It is a memorial of national significance dedicated to those who served in the armed forces and as civilians during the war. It was opened on April 29, 2004 and was dedicated by President George W. Bush on May 29, 2004. Ground was broken in September 2001.", "prediction 2": "The World War II Memorial is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II. Consisting of 56 granite pillars, each tall, arranged in a semicircle around a plaza with two triumphal arches on opposite sides, it sits on the National Mall in Washington, D.C., on the former site of the Rainbow Pool at the eastern end of the Reflecting Pool between the Lincoln Memorial and the Washington Monument. The memorial was opened on April 29, 2004, and was dedicated by President George W. Bush on May 29, 2004.", "prediction 3": "The World War II Memorial is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II. It is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II. Ground was broken in September 2001. It was opened on April 29, 2004. It was dedicated by President George W. Bush on May 29, 2004.", "prediction 4": "The National World War II Memorial is a memorial of national significance dedicated to Americans who served in the armed forces and as civilians during World War II. It was opened on April 29, 2004, and was dedicated by President George W. Bush on May 29, 2004. The memorial consists of 56 granite pillars, each tall, arranged in a semicircle around a plaza with two triumphal arches on opposite sides.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 156 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 376 } ], "missing-info": [], "corrected-prediction": "Ground broke on construction on September, 2001 for the national world war II museum, and it officially opened on April 29, 2004." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who owns bass pro shops and cabela's?", "passages": [ [ "Bass Pro Shops", "Bass Pro Shops\n\nBPS Direct, LLC (doing business as Bass Pro Shops) is an American privately held retailer of hunting, fishing, camping and related outdoor recreation merchandise.", "Bass Pro Shops supports and sells merchandise for the National Audubon Society.", "The majority owner, John Morris, began his career in sporting goods with a fishing section in the back of a Brown Derby liquor store owned by his father, located in Springfield MO on the road to Table Rock Lake and Branson, Missouri.", "That small fishing department sold homemade bait and worms, proving popular enough that Bass Pro Shops was incorporated in 1971.", "These homemade baits were so popular that many people wanted the opportunity to buy these when they had returned home.", "Thus began the Bass Pro Shops catalog, first mailed in 1974.", "Soon, it became the world's largest mail order sporting goods store.", "In 1975, to meet the burgeoning demand for Bass Pro Shops exclusive products, American Rod and Gun was established.", "Acting as a separate wholesaling entity ARG serves more than 7,000 independently owned retail stores worldwide.", "In 1977, Bass Pro Shops introduced the first fish-ready complete boat motor and trailer package with the Bass Tracker.", "In 1984, construction began on the Outdoor World Catalog Showroom in Springfield, Missouri.", "Big Cedar Lodge opened in 1988 on Table Rock Lake." ] ], "gold": "Cabela's is owned by Bass Pro Shops. Bass Pro Shops is owned by John Luke Morris.", "prediction 1": "The majority owner of the American sports retailer, Bass Pro Shops, is John Morris.", "prediction 2": "The majority owner of both Bass Pro Shops and Cabela's is John Morris. Morris began his career in sporting goods with a fishing section in the back of a Brown Derby liquor store owned by his father, located in Springfield MO on the road to Table Rock Lake and Branson, Missouri. That small fishing department sold homemade bait and worms, proving popular enough that Bass Pro Shops was incorporated in 1971. These homemade baits were so popular that many people wanted the opportunity to buy these when they had returned home. Thus began the Bass Pro Shops catalog, first mailed in 1975.", "prediction 3": "The majority owner of Bass Pro Shops is John Morris. Bass Pro Shops is an American privately held retailer of hunting, fishing, camping and related outdoor recreation merchandise.", "prediction 4": "The majority owner of Bass Pro Shops is John Morris. The majority owner of Bass Pro Shops is American Rod and Gun Corporation, which serves as a separate wholesaling entity for more than 7,000 independently owned retail stores worldwide.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 22, "end": 51 } ], "missing-info": [], "corrected-prediction": "The majority owner of Bass Pro Shops is John Morris." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is the leader of ruling party in rajya sabha?", "passages": [ [ "Member of parliament, Rajya Sabha", "Member of parliament, Rajya Sabha\n\nA member of parliament in the Rajya Sabha (abbreviated: MP) is the representative of the Indian states to the upper house of the Parliament of India (Rajya Sabha).", "Rajya Sabha MPs are elected by the electoral college of the elected members of the State Assembly with a system of proportional representation by a single transferable vote.", "Parliament of India is bicameral with two houses; Rajya Sabha (Upper house i.e. Council of States) and the Lok Sabha (Lower house i.e. House of the People).", "Total number of members of Rajya Sabha are lesser than member of parliament in the Lok Sabha and have more restricted power than the lower house (Lok Sabha).", "Unlike membership to the Lok Sabha, membership to the Rajya Sabha is permanent for a term of six years cannot be dissolved at any time.", "Broad responsibilities of the members of parliament of Rajya Sabha are; \n\nRajya Sabha enjoys certain special powers which in effect gives special powers and responsibilities to the Rajya Sabha MPs.", "The special powers are;\n\nUnlike membership to the Lok Sabha, membership to the Rajya Sabha is permanent for a term of six years cannot be dissolved at any time." ], [ "Leader of the House (Rajya Sabha)", "Leader of the House (Rajya Sabha)\n\nThe Leader of the House is a Rajya Sabha member who is either a cabinet minister or another nominated minister.", "The Leader has a seat next to the Chairperson of the Rajya Sabha, in the front row.", "The following individuals have held the office of the Leader of the House in the Rajya Sabha:" ], [ "Jaswant Singh", "Jaswant Singh\n\nJaswant Singh (born 3 January 1938) is a retired officer of the Indian Army and a former cabinet minister.", "He is a founding member of the Bharatiya Janata Party.", "He is one of India's longest serving parliamentarians, having been a member of one or the other house almost continuously between 1980 and 2014.", "he was elected on a BJP ticket to the Rajya Sabha five times (1980, 1986, 1998, 1999, 2004) and to the Lok Sabha four times (1990, 1991, 1996, 2009).", "During the Vajpayee administration (1998-2004), he held some of the highest offices of the land, handling at various times the cabinet portfolios of Finance, External Affairs and Defence.", "He also served for a period as Deputy Chairman of the Planning Commission (1998\u201399).", "In the aftermath of India's nuclear tests of 1998, he was deputed by Prime Minister Vajpayee to act as India's single representative to hold repeated, long-term dialogue with the USA (represented by Strobe Talbott) on matters related to nuclear policy and strategy; the outcome of the sustained engagement was positive for both countries.", "After his party lost power in 2004, Jaswant Singh served as Leader of Opposition in the Rajya Sabha from 2004 to 2009." ], [ "Manmohan Singh", "Manmohan Singh\n\nManmohan Singh (; born 26 September 1932) is an Indian economist and politician who served as the Prime Minister of India from 2004 to 2014.", "The first Sikh in office, Singh was also the first prime minister since Jawaharlal Nehru to be re-elected after completing a full five-year term.", "Born in Gah (now in Punjab, Pakistan), Singh's family migrated to India during its partition in 1947.", "After obtaining his doctorate in economics from Oxford, Singh worked for the United Nations during 1966\u201369.", "He subsequently began his bureaucratic career when Lalit Narayan Mishra hired him as an advisor in the Ministry of Commerce and Industry.", "Over the 70s and 80s, Singh held several key posts in the Government of India, such as Chief Economic Advisor (1972\u201376), Reserve Bank governor (1982\u201385) and Planning Commission head (1985\u201387).", "In 1991, as India faced a severe economic crisis, newly elected Prime Minister P. V. Narasimha Rao surprisingly inducted the apolitical Singh into his cabinet as Finance Minister.", "Over the next few years, despite strong opposition, he as a Finance Minister carried out several structural reforms that liberalised India's economy." ], [ "National Democratic Alliance (India)", "National Democratic Alliance (India)\n\nThe National Democratic Alliance (NDA) is a centre-right coalition of political parties in India.", "At the time of its formation in 1998, it was led by the Bharatiya Janata Party (BJP) and had thirteen constituent parties.", "Its chairman was former Prime Minister Late.", "Atal Bihari Vajpayee.", "Also representing the alliance are L. K. Advani, former Deputy Prime Minister, who is the acting chairman of the Alliance, Narendra Modi, current Prime Minister and Leader of the House in Lok Sabha; and Arun Jaitley, Leader of the House in Rajya Sabha and Finance minister.", "The coalition was in power from 1998 to 2004.", "The alliance returned to power in the 2014 General election with a combined vote share of 38.5%.", "Its leader, Narendra Modi, was sworn in as Prime Minister of India on 26 May 2014.", "The National Democratic Alliance was formed in May 1998 as a coalition to contest the general elections.", "It was led by the Bharatiya Janata Party, and included several regional parties, including the Samta Party and the All India Anna Dravida Munnetra Kazhagam (AIADMK), as well as Shiv Sena, the only member which shared the Hindutva ideology of the BJP." ] ], "gold": "The Rajya Sabha or Council of States is the upper house of the bicameral Parliament of India. The Leader of the House in Rajya Sabha is the leader and parliamentary chairperson of the majority party in the Rajya Sabha and is normally either a cabinet minister or another nominated minister. From 1999 to 2004, Jaswant Singh was the leader of the ruling party, followed by Manmohan Singh, who also served as the 13th prime minister of India from 2004 to 2014. Arun Jaitley was the leader of the ruling party in 2014.", "prediction 1": "The leader of the ruling party in the Rajya Sabha is the representative of the Indian states to the upper house of the Parliament of India, the Rajya Sabha. The current leader of the ruling party is Manmohan Singh, who served as the Prime Minister of India from 2004 to 2014. Before him, the leader of the opposition party was Jaswant Singh, who served as the Prime Minister from 2004 to 2009.\n", "prediction 2": "There have been several leaders of the ruling parties in the Rajya Sabha. The incumbents are typically a member of Parliament, either a cabinet minister or another nominated minister. Before the BJP, the leader of the ruling party in the Rajya Sabha was Manmohan Singh, who served as the Prime Minister from 2004 to 2014.", "prediction 3": "The current leader of the ruling party in the Rajya Sabha is Sonia Gandhi (from 2004 to 2014). Former Indian Prime Minister Manmohan Singh was the Leader of the ruling party from 2004 to 2009. Former India Prime Minister A.C. Dhoni was the current Leader of the Opposition in the Rajya Sabha from 2009 to 2014.", "prediction 4": "The leaders of the ruling parties in the Rajya Sabha are the member of parliament in their respective constituencies and serve as the representative of the constituent states to the upper house of the Parliament of India, the Rajya Sabha. BJP founder Jaswant Singh served as the 2016-15 Rajya Sabha leader, while Manmohan Singh served as the 2017-18 Rajya Sabha leader.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 157, "end": 175 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[8]}", "start": 360, "end": 374 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Parliament of India is bicameral with two houses. The leader of the ruling party in the Rajya Sabha is the representative of the Indian states to the upper house of the Parliament of India, the Rajya Sabha. The Leader of the House is a Rajya Sabha member who is either a cabinet minister or another nominated minister. Jaswant Singh served as Leader of Opposition in the Rajya Sabha from 2004 to 2009. Arun Jaitley is another Leader of the House in the Rajya Sabha. Manmohan Singh served as the Prime Minister of India from 2004 to 2014.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where is the first stage of the tour de france?", "passages": [ [ "Tour de France", "Their position is logged by GPS and from an aircraft and organised on the road by the caravan director\u2014Jean-Pierre Lachaud\u2014an assistant, three motorcyclists, two radio technicians, and a breakdown and medical crew.", "Six motorcyclists from the Garde R\u00e9publicaine, the \u00e9lite of the gendarmerie, ride with them.", "The first three Tours from 1903\u20131905 stayed within France.", "The 1906 race went into Alsace-Lorraine, territory annexed by the German Empire in 1871 after the Franco-Prussian War.", "Passage was secured through a meeting at Metz between Desgrange's collaborator, Alphonse Stein\u00e8s, and the German governor.", "No teams from Italy, Germany, or Spain rode in 1939 because of tensions preceding the Second World War (after German assistance to the Nationalists in the Spanish Civil War it was widely expected Spain would join Germany in a European war, though this did not come to pass).", "Henri Desgrange planned a Tour for 1940, after war had started but before France had been invaded.", "The route, approved by military authorities, included a route along the Maginot Line.", "Teams would have been drawn from military units in France, including the British, who would have been organised by a journalist, Bill Mills.", "Then the Germans invaded and the race was not held again until 1947 (see Tour de France during the Second World War)." ], [ "Tour de France", "Tour de France\n\nThe Tour de France () is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries.", "Like the other Grand Tours (the Giro d'Italia and the Vuelta a Espa\u00f1a), it consists of 21 day-long stages over the course of 23 days.", "The race was first organized in 1903 to increase sales for the newspaper \"L'Auto\" and is currently run by the Amaury Sport Organisation.", "The race has been held annually since its first edition in 1903 except when it was stopped for the two World Wars.", "As the Tour gained prominence and popularity, the race was lengthened and its reach began to extend around the globe.", "Participation expanded from a primarily French field, as riders from all over the world began to participate in the race each year.", "The Tour is a UCI World Tour event, which means that the teams that compete in the race are mostly UCI WorldTeams, with the exception of the teams that the organizers invite.", "Traditionally, the race is held primarily in the month of July.", "While the route changes each year, the format of the race stays the same with the appearance of time trials, the passage through the mountain chains of the Pyrenees and the Alps, and the finish on the Champs-\u00c9lys\u00e9es in Paris." ] ], "gold": "The first stage of Tour de France is held at different locations each year in July, traditionally. The only exception to this since the conclusion of world war II is due to the COVID-19 pandemic, which delayed the race until August 29, 2020. In 2015, it was in Utrecht, Netherlands. 2016's Tour de France was in Mont Saint-Michel to Utah Beach, and 2017 it was in D\u00fcsseldorf.", "prediction 1": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The first three Tours from 1903\u20131905 stayed within France. The 1906 race went into Alsace-Lorraine, territory annexed by the German Empire in 1871 after the Franco-Prussian War. The route, approved by military authorities, included a route along the Maginot Line. Teams would have been drawn from military units in France, including the British, who would have been organised by a journalist, Bill Mills. The race was held annually since its first edition in 1903 except when it was stopped for the two World Wars.", "prediction 2": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The first three Tours from 1903\u20131905 stayed within France. The 1906 race went into Alsace-Lorraine, territory annexed by the German Empire in 1871 after the Franco-Prussian War. The route, approved by military authorities, included a route along the Maginot Line.", "prediction 3": "The first stage of the Tour de France is in Alsace-Lorraine, in Alsace-Lorraine, France. It is the first part of a long, 21-day race that is primarily held in France, while sometimes passing through nearby countries. The first three Tours from 1903\u20131905 stayed within France. The 1906 race went into Alsace-Lorraine, territory annexed by the German Empire in 1871 after the Franco-Prussian War.", "prediction 4": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France, while also occasionally passing through nearby countries. The first stage of the 1903 tour started in Alsace-Lorraine, territory annexed by the German Empire in 1871 after the Franco-Prussian War. The route, approved by military authorities, included a route along the Maginot Line. The race was not held again until 1947, when the Germans invaded France.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 413 }, { "error type": "Irrelevant", "explanation": "", "start": 414, "end": 554 }, { "error type": "Irrelevant", "explanation": "", "start": 582, "end": 664 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Tour de France is an annual men's multiple stage bicycle race primarily held in France during the month of July, while also occasionally passing through nearby countries. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who are the democrats running for governor of tennessee?", "passages": [ [ "2018 Tennessee gubernatorial election", "2018 Tennessee gubernatorial election\n\nThe 2018 Tennessee gubernatorial election took place on November 6, 2018, to elect the next Governor of Tennessee, concurrently with the election of Tennessee's Class I U.S. Senate seat, as well as other elections to the United States Senate in other states and elections to the United States House of Representatives and various statewide and local elections.", "The primaries took place on August 2, with Republican Bill Lee and Democrat Karl Dean winning their respective party nominations.", "Incumbent Republican Governor Bill Haslam is term-limited and is prohibited by the Constitution of Tennessee from seeking a third consecutive term.", "In addition to the establishment party nominees, there are 26 Independents running, causing this contest to have the greatest number of candidates for a regularly-scheduled statewide election in U.S. history.", "There are so many candidates because the Libertarian Party of Tennessee is drawing attention to the state's very restrictive ballot access law which has prevented any alternative party from getting on the ballot since 1968, whereas an Independent only needs 25 signatures.", "Fifteen of the Independent candidates are Libertarians.", "Despite a considerably more competitive contest for the U.S. Senate, Republican Bill Lee was elected was elected with nearly 60% of the vote." ], [ "2006 Tennessee gubernatorial election", "2006 Tennessee gubernatorial election\n\nThe Tennessee gubernatorial election of 2006 was held on November 7, 2006.", "The incumbent, Democrat Phil Bredesen, defeated Republican State Senator Jim Bryson to serve another term as Governor of Tennessee.", "As of 2019, this is the most recent election in which a member of the Democratic Party was elected Governor of Tennessee and this is also the last time a Democrat won a majority of counties in the state." ], [ "Mike McWherter", "Mike McWherter\n\nMichael Ray McWherter (born 1955) is an American lawyer, businessman and politician from the state of Tennessee.", "He was the Democratic nominee for Governor of Tennessee in 2010.", "The son of former Tennessee governor Ned McWherter, McWherter is a native of West Tennessee.", "He graduated from Union City High School.", "In 1981 McWherter earned his law degree from Vanderbilt University, after which he worked in private practice in Nashville.", "He later moved to Jackson to start his own business.", "McWherter operates the family's beer distribution business in Jackson.", "He is also the Chairman of the Board of First State Bank, headquartered in Union City, and serves on the board of directors for the Jackson Energy Authority.", "Although he has never held elected office, McWherter made an attempt to challenge Republican U.S. Senator Lamar Alexander in the 2008 election.", "He opted out over fund raising concerns and an intense campaign season.", "On April 23, 2009, he announced he would run for Governor of Tennessee in the 2010 election.", "McWherter said he will run on a platform of jobs, education and fiscal responsibility.", "Incumbent Tennessee governor, Phil Bredesen, endorsed McWherter's candidacy." ] ], "gold": "In 2018, Democrat Karl Dean was the party nominee to run for the office of Governor in the state of Tennessee against Republican Bill Lee. In 2006, Tim Sevier, John Jay Hooker, Phil Bredesen, and Walt Ward were the Democrats who ran for governor. In 2010, Mike McWherter was the lone Democrat who ran for governor. In 2014, Charles V. \"Charlie\" Brown, Ron Noonan, Wm H. \"John\" McKamey, and Kennedy Spellman Johnson all ran for the office of governor of Tennessee as Democrats.", "prediction 1": "In addition to the establishment party nominees, there are 26 independent candidates running for governor of Tennessee. In addition to the establishment party nominees, there are a total of 7 democrats running for governor of Tennessee. In 2010, Phil Bredesen was the Democratic nominee for Governor of Tennessee. In 2016, Democrat Jeanne McKinley was the Democratic nominee for Governor of Tennessee.", "prediction 2": "Democratic Party is composed of the Democratic Party of Tennessee and the Democratic Party of Virginia. Currently, the Democratic Party of Virginia holds the majority of the legislative delegation in the state while the Democratic Party of Tennessee holds the majority of the legislative delegation.", "prediction 3": "There are currently four Democrat candidates running for governor of Tennessee. In addition to the establishment party nominees, there are 26 Independent candidates running, causing this contest to have the greatest number of candidates for a regularly-scheduled statewide election in U.S. history. The most recent election in which a member of the Democratic Party was elected Governor of Tennessee is in 2020. In 2016, Democrat Mike McWherter was the Democratic nominee for Governor of Tennessee.", "prediction 4": "The Democrats running for governor of Tennessee are Karl Dean, Michael Ray McWherter, and Phil Bredesen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 }, { "error type": "Unverifiable", "explanation": "", "start": 190, "end": 209 }, { "error type": "Redundant", "explanation": "In addition to the establishment party nominees, there are 26 independent candidates running for governor of Tennessee. ", "start": 120, "end": 168 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,2]}", "start": 240, "end": 245 }, { "error type": "Unverifiable", "explanation": "", "start": 323, "end": 374 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In 2006, incumbent Phil Bredesen was the Democratic nominee for Governor of Tennessee. Michael McWherter was the Democratic nominee for Governor of Tennessee in 2010. Democrat Karl Dean was the 2018 nominee." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "The first 4 books of the new testament are called?", "passages": [ [ "New Testament", "Traditionalists (such as biblical commentators Albert Barnes and Matthew Henry) seem to support the idea that the writer of the Gospel of John himself claimed to be an eyewitness in their commentaries of John 21:24 and therefore the gospel was written by an eyewitness; however, this idea is rejected by the majority of modern scholars.", "A review of Richard Bauckham's book \"Jesus and the Eyewitnesses: The Gospels as Eyewitness Testimony\" states \"The common wisdom in the academy is that stories and sayings of Jesus circulated for decades, undergoing countless retellings and embellishments before being finally set down in writing.\"", "Most scholars hold to the two-source hypothesis, which claims that the Gospel of Mark was written first.", "According to the hypothesis, the authors of the Gospel of Matthew and the Gospel of Luke then used the Gospel of Mark and the hypothetical Q document, in addition to some other sources, to write their individual gospel accounts.", "These three gospels are called the Synoptic gospels because they include many of the same stories, often in the same sequence, and sometimes exactly the same wording.", "Scholars agree that the Gospel of John was written last, by using a different tradition and body of testimony.", "In addition, most scholars agree that the author of Luke wrote the Acts of the Apostles." ], [ "New Testament", "In the period extending roughly from 50 to 150 AD, a number of documents began to circulate among the churches, including epistles, gospel accounts, memoirs, prophecies, homilies, and collections of teachings.", "While some of these documents were apostolic in origin, others drew upon the tradition the apostles and ministers of the word had utilized in their individual missions, and still others represented a summation of the teaching entrusted to a particular church center.", "Several of these writings sought to extend, interpret, and apply apostolic teaching to meet the needs of Christians in a given locality.", "In general, among Christian denominations the New Testament canon came to be agreed-upon as a list of 27 books, although the order of the books can vary from one version of the printed scriptures to the next.", "The book order is the same in the Greek Orthodox, Roman Catholic, and Protestant traditions.", "The Slavonic, Armenian and Ethiopian traditions have different New Testament book orders.", "Each of the four gospels in the New Testament narrates the life, death, and resurrection of Jesus of Nazareth.", "The word \"gospel\" derives from the Old English \"g\u014dd-spell\" (rarely \"godspel\"), meaning \"good news\" or \"glad tidings\"." ], [ "British Library, Add. 14448", "Folio 64 is a restoration, on paper, supplied in the 13th century.", "The Gospel of Matthew is divided into 22 sections, Gospel of Mark into 13 sections, Gospel of Luke \u2013 23 sections, and Gospel of John \u2013 20 sections.", "The Book of Acts, Epistle of James, First Epistle of Peter, and First Epistle of John are divided into 32 sections.", "Number of section in the Pauline epistles 55.", "Total number of sections in the whole New Testament, 165.", "On the margins of some pages there are notes, in a later hand, referring chiefly to matters of pronunciation and accentuation, similar to those in the manuscript Add. 12138.", "It lacks the Pericope Adulterae (John 7:53-8:11).", "In the colophon on the folio 209 verso written: \"This New Testament was begun on the first Ilul, and finished when ten days of Shebat were passed; in the year 1012, according to the well-known era of Greeks, which is, according to that of the Arabs, 80; under the rule of the house of Marwan, in the days of ...", "[the Ishma]elites\"." ] ], "gold": "As a group, the first four books of the New Testament are called the Canonical Gospels. The first book of the New Testament is called the Gospel of Matthew. The second book of the New Testament is called the Gospel of Mark. The third book of the New Testament is called the Gospel of Luke. The fourth book of the New Testament is called the Gospel of John. Each of these four gospels narrates the life, death and resurrection of Jesus of Nazareth. ", "prediction 1": "The first 4 books of the new testament are called the Gospels, and the first three are the Synoptic gospels. According to the two-source hypothesis, the authors of the Gospel of Mark and the Gospel of Luke then used the Gospel of Mark and the hypothetical Q document in addition to some other sources, to write their individual gospel accounts. The first 3 are also called the Epistles, the first Epistle of John, and the second is the Gospel of Mark.", "prediction 2": "The first 4 gospels of the New Testament are called the Gospels. According to some scholars, the Gospel of Mark was written first. According to other scholars, the Gospel of Matthew and the Gospel of Luke were then used together in their individual gospel accounts. These three gospels are called the Synoptic gospels because they include many of the same stories, often in the same sequence, and sometimes exactly the same wording. In addition, most scholars agree that the Gospel of John was written last, by using a different tradition and body of testimony.", "prediction 3": "The gospels were written in order of the letter's order, which is called the Book order. The first four books of the new testament, the Gospels, are referred to as the Book of Acts, the first Epistle of Peter, the first Acts, and the first Gospel of John, which are called the First Epistles. These books were written in the order Mark, Luke, and Matthew wrote them, and were divided into 22 sections.", "prediction 4": "The first four books of the New Testament are called gospels. Based on tradition, the Gospel of Mark was written first. According to the two-source hypothesis, the authors of the Gospel of Matthew and the Gospel of Luke then used the Gospel of Mark and the hypothetical Q document, in addition to some other sources, to write their individual gospel accounts. The third and fourth gospels are called the Synoptic gospels because they include many of the same stories, often in the same sequence and sometimes exactly the same wording.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 62 }, { "error type": "Unverifiable", "explanation": "", "start": 71, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 344 }, { "error type": "Unverifiable", "explanation": "", "start": 349, "end": 386 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 391, "end": 413 }, { "error type": "Unverifiable", "explanation": "", "start": 436, "end": 451 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Each of the four gospels in the New Testament narrates the life, death, and resurrection of Jesus of Nazareth. The gospels are called the Gospel of Matthew, Gospel of Mark, Gospel of Luke, and Gospel of John." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What years have leinster won the heineken cup?", "passages": [ [ "European Rugby Champions Cup", "European Rugby Champions Cup\n\nThe European Rugby Champions Cup (known as the Heineken Champions Cup for sponsorship reasons) is an annual rugby union tournament organised by European Professional Club Rugby (EPCR).", "It is the top-tier competition for clubs whose countries' national teams compete in the Six Nations Championship.", "Clubs qualify for the Heineken Champions Cup via their final positions in their respective national/regional leagues (Gallagher Premiership, TOP 14, and Guinness Pro14) or via winning the second-tier Challenge Cup; those who do not qualify are instead eligible to compete in the second-tier Challenge Cup.", "Between 1995 and 2014, the competition was known as the Heineken Cup but was changed to European Rugby Champions Cup, following disagreements between its shareholders over the structure and governance of the competition.", "Heineken returned as sponsor for the 2018\u201319 season, running the competition alongside the EPCR, resulting in the competition being known as the Heineken Champions Cup.", "Leinster are the current holders of the title, having won their fourth title by beating Racing 92 in the 2018 final.", "Leinster Rugby and Toulouse have both won the competition a record four times.", "The Heineken Cup was launched in the summer of 1995 on the initiative of the then Five Nations Committee to provide a new level of professional cross border competition." ], [ "Leinster Rugby", "In the 2008\u201309 season, Leinster topped their European Cup pool despite away losses to French side Castres and English side Wasps.", "Victory over Harlequins in the quarter-finals followed, despite the Bloodgate Scandal.", "Leinster overcame Munster 25\u20136 in a semi-final in Dublin's Croke Park that broke the world record attendance for a \"club\" rugby union game with a crowd of over 82,200.", "Leinster won the 2009 European Cup Final in Murrayfield Stadium in Edinburgh, beating Leicester Tigers 19\u201316 to claim their first European crown.", "In 2009\u201310 Leinster was eliminated from the European Cup at the semi-final stage by eventual winners Toulouse.", "Also despite having topped the Pro12 league during the regular season, Leinster lost the first ever Play-off Final 17\u201312 on their home ground to the Ospreys.", "In the 2010\u201311 European Cup, Leinster defeated the top English teams (Leicester Tigers, Saracens & Northampton Saints), as well as top French sides, Toulouse (who were the defending European champions), Racing Metro & Clermont Auvergne, (the French Champions).", "to go on to regain their title as champions of Europe in the 2011 European Cup Final at the Millennium Stadium in Cardiff." ] ], "gold": "The European Rugby Champions Cup, also known as the Heineken Champions Cup, is an annual rugby union tournament organized by European Professional Club Rugby. Leinster won the title in 2009 in their first ever final. Then, Leinster won their second Heineken Cup in 2010-11, their third Heineken Cup in 2011-12 and their fourth Heineken Cup in 2017-18.", "prediction 1": "The Heineken Champions Cup is an annual rugby union tournament organised by European Professional Club Rugby (EPCR). It is the top-tier competition for clubs whose countries' national teams compete in the Six Nations Championship. Leinster have won the Heineken Cup in 2009, 2010 and 2011 respectively.", "prediction 2": "The European Rugby Champions Cup is an annual rugby union tournament organised by European Professional Club Rugby (EPCR). It is the top-tier competition for clubs whose countries' national teams compete in the Six Nations Championship. Between 1995 and 2014, the competition was known as the Heineken Cup but was changed to the European Rugby Champions Cup, following disagreements between its shareholders over the structure and governance of the competition. In 2018 Leinster won their fourth title by beating Racing 92 in the final. In 2009\u201310 Leinster was eliminated from the European Cup at the semi-final stage by eventual winners Toulouse. In 2011, Leinster won the Heineken Champions Cup Final at the Millennium Stadium in Cardiff.", "prediction 3": "The Heineken Champions Cup is an annual rugby union tournament organised by European Professional Club Rugby (EPCR). Leinster have won the Heineken Cup in 3 of the last 4 seasons. In the 2009, 2010 and 2011 seasons, Leinster won the Heineken Cup. In the 2015 and 2016, Leinster won the Heineken Cup in 2015 and 2016, and in 2016 they won it in 2017.", "prediction 4": "The European Rugby Champions Cup, also known as the Heineken Champions Cup for sponsorship reasons, is an annual rugby union tournament organised by European Professional Club Rugby (EPCR). Leinster won the 2009 European Cup Final in Murrayfield Stadium in Edinburgh, beating Leicester Tigers 19\u201316 to claim their first European crown. In the 2010\u201311 European Cup, Leinster defeated the top English teams (Leicester Tigers, Saracens & Northampton Saints), as well as top French sides, Toulouse (who were the defending champions) Racing 92 in the 2018 final.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 230 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 275, "end": 279 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Heineken Champions Cup, also known as the European Rugby Champions Cup, is an annual rugby union tournament organised by European Professional Club Rugby . Leinster have won the Heineken Cup in 2009, 2011, and 2018. In total, they have won four times." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What was the name of grizzly adams bear?", "passages": [ [ "The Life and Times of Grizzly Adams", "The Life and Times of Grizzly Adams\n\nThe Life and Times of Grizzly Adams is a 1974 independent feature film inspired by a 1972 historical fiction novella written by Charles E. Sellier Jr..", "The film's popularity led to an NBC television series of the same name.", "The title character, played by Dan Haggerty, was loosely based on California mountain man James \"Grizzly\" Adams (1812-1860).", "The film and TV series portrayed the fictional Grizzly Adams as a frontier woodsman who fled into the mountains after he was wrongly accused of murder.", "While struggling to survive, Adams saves an orphaned grizzly bear cub he adopts and names Ben.", "The bear, while growing to its huge adult size, becomes Adams' closest companion.", "Consistently kind and gentle, Adams discovers and demonstrates an uncanny ability to gain the trust of most of the indigenous wildlife of the region, and he helps, sometimes rescues, takes in and tames many species.", "Originally a hunter, with his learned affection for wildlife Adams resolves never to harm another animal whenever possible.", "In the television series, Adams had two human friends, an old mountain man trader named \"Mad Jack\" played by Denver Pyle who was often featured with his mule (\"Number Seven\"), and a Native American by the name of \"Nakoma\" played by Don Shanks." ], [ "The Life and Times of Grizzly Adams", "Adams, Mad Jack, and Nakoma helped myriad mountain visitors while protecting wildlife at the same time.", "NBC aired the series finale on February 21, 1982 by way of a two-hour TV movie called \"The Capture of Grizzly Adams\" where a bounty hunter used Adams' daughter, who was not seen or mentioned since the 1974 film, in a kidnap-extortion ploy to lure the fugitive mountain man back to civilization.", "In the end Adams proves his innocence.", "In addition to Ben, there were many other named animals in the TV series, the most prominent being \"Number 7\", Mad Jack's ornery mule.", "Bart the Bear, then a bear cub, made one of his first acting appearances in the series playing Ben as a cub.", "Gene Edwards\u2014a stunt double for Dan Haggerty\u2014later played Grizzly Adams in the otherwise unrelated 1990 film \"The Legend of Grizzly Adams.\"", "\"Grizzly Adams\" was created and produced by Schick Sunn Classic Pictures, a company based in Park City, Utah and operated by its founding executives, Patrick Frawley, Charles E. Sellier Jr., and Rayland Jenson.", "Parts of the film were shot in the Uinta National Forest, Wasatch National Forest, and Park City.", "The low-budget independent studio successfully introduced innovative marketing and promotional methods." ] ], "gold": "Grizzly Adams is a somewhat fictional character in the film The Life and Times of Grizzly Adams, and a television series by the same name. Grizzly Adams was a frontier man who rescued and adopted a grizzly bear that he named Ben, after Benjamin Franklin. Bozo was the name of the bear who played Ben in the shows, except for during scenes of Ben as a cub, which is when Bart the Bear played Ben.", "prediction 1": "The Life and Times of Grizzly Adams is a 1974 independent feature film inspired by a 1972 historical fiction novella written by Charles E. Sellier Jr. The film's popularity led to an NBC television series of the same name. The bear, while growing to its huge adult size, becomes Adams' closest companion. Consistently kind and gentle, Adams discovers and demonstrates an uncanny ability to gain the trust of most of the indigenous wildlife of the region, and he helps, sometimes rescues, takes in and a Native American by the name of Nakoma played by Don Shanks. There were many other named animals in the TV series, the most prominent being Number 7", "prediction 2": "The 1974 film, The Life and Times of Grizzly Adams, was inspired by a 1972 historical fiction novella written by Charles E. Sellier Jr. NBC television series of the same name followed, which portrayed the fictional Grizzly Adams as a frontier woodsman who fled into the mountains after he was wrongly accused of murder. While struggling to survive, Adams saves an orphaned grizzly bear cub he adopts and names Ben. The bear, while growing to its huge adult size, becomes Adams' closest companion.", "prediction 3": "In the 1974 film The Life and Times of Grizzly Adams, the title character is played by Dan Haggerty and was loosely based on California mountain man James \"Grizzly\" Adams (1812-1860). In the NBC television series of the same name, the bear, while growing to its huge adult size, becomes Adams' closest companion.", "prediction 4": "The Life and Times of Grizzly Adams, a 1974 independent feature film inspired by a 1972 historical fiction novella written by Charles E. Sellier Jr., was loosely based on California mountain man James \"Grizzly\" Adams. While struggling to survive, Adams saves an orphaned grizzly bear cub he adopts and names Ben. The bear, while growing to its huge adult size, becomes Adams' closest companion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 150 }, { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 562 }, { "error type": "Irrelevant", "explanation": "", "start": 563, "end": 650 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Life and Times of Grizzly Adams film and television series of the same name. Adams saves an orphaned grizzly bear cub he adopts and names Ben. Bart the Bear, then a bear cub, made one of his first acting appearances in the series playing Ben as a cub." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who was the song candle in the wind written about?", "passages": [ [ "Candle in the Wind", "Candle in the Wind\n\n\"Candle in the Wind\" is a threnody with music and lyrics by Elton John and Bernie Taupin.", "It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier.", "In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales.", "Candle in the Wind 1997 was released as a single and reached No. 1 in many countries, proving a much greater success than the original, officially being listed as the second best-selling single of all time, behind Bing Crosby's \"White Christmas (song)\".", "The original version in the key of E major appeared on John's 1973 album \"Goodbye Yellow Brick Road\" and was released as a single in 1974.", "The lyrics of the song are a sympathetic portrayal of the life of Marilyn Monroe.", "(The song's opening line \"Goodbye, Norma Jean\" refers to Monroe's real name, Norma Jeane [more commonly spelled Jean] Baker.)", "In the Eagle Vision documentary on the making of \"Goodbye Yellow Brick Road\", Taupin said the song is about \"the idea of fame or youth or somebody being cut short in the prime of their life." ], [ "Candle in the Wind 1997", "Candle in the Wind 1997\n\n\"Candle in the Wind 1997\" is a song by Bernie Taupin and Elton John, a re-written and re-recorded version of their 1974 song \"Candle in the Wind\".", "It was released on 13 September 1997 as a tribute single to Diana, Princess of Wales, with the global proceeds from the song going towards Diana's charities.", "In many countries, it was pressed as a double A-side with \"Something About the Way You Look Tonight\".", "The lyrics were written by Bernie Taupin, and the song produced by Sir George Martin.", "According to the \"Guinness Book of Records\", \"Candle in the Wind 1997\" is the second highest selling single of all time (behind Bing Crosby's \"White Christmas\" from 1942), and it is the highest selling single since charts began in the 1950s.", "After being released, \"Candle in the Wind 1997\" entered at number one in the UK Singles Chart, John's fourth UK number one single, and became the best-selling single in UK Chart history.", "In October it became John's ninth U.S. number one single, where it topped the \"Billboard\" Hot 100 for 14 weeks, and is the best-selling single in \"Billboard\" history, and was the first single certified Diamond in the U.S." ] ], "gold": "\"Candle in the Wind\" was originally written in 1973 with music and lyrics by Elton John and Bernie Taupin. It was written in honor of Marilyn Monroe, who had died 11 years earlier. In 1997, Elton John and Bernie Taupin created a re-written and re-recorded version which was called \"Candle in the Wind 1997\", also known as \"Goodbye England's Rose\" and \"Candle in the Wind '97.\" This version was released on September 13, 1997 and was a tribute single to Diana, Princess of Wales, with the global proceeds from the song going towards Diana's charities. ", "prediction 1": "The song \"Candle in the Wind\" was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, Elton John and Bernie Taupin performed a rewritten version of the song as a tribute to Diana, Princess of Wales. According to the Guinness Book of Records, Candle in the Wind 1997 is the second highest selling single of all time, behind Bing Crosby's \"White Christmas\" from 1942. The lyrics were written by Bernie Taupin, and the song produced by Sir George Martin.", "prediction 2": "In 1973, the song Candle in the Wind was written about Marilyn Monroe, the singer from the film The Artist. In 1997, Elton John and Bernie Taupin performed a rewritten version of the song as a tribute to Diana, Princess of Wales. According to the Guinness Book of Records, Candle in the Wind is the second highest selling single of all time, behind Bing Crosby's \"White Christmas\".", "prediction 3": "The song Candle in the Wind was written about Marilyn Monroe in 1973, and was released as a single in 1974. In 1997, the song was rewritten and re-recorded by Elton John and Bernie Taupin, and released as a tribute single to Diana, Princess of Wales. It was written by Bernie Taupin, and the lyrics were written by Bernie Taupin.", "prediction 4": "\"Candle in the Wind\" is a threnody with music and lyrics by Elton John and Bernie Taupin. It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales. In the Eagle Vision documentary on the making of Goodbye Yellow Brick Road, Taupin said the song is about \"the idea of fame or youth or somebody being cut short in the prime of their life.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 410 }, { "error type": "Irrelevant", "explanation": "", "start": 453, "end": 496 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The song \"Candle in the Wind\" was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, Elton John and Bernie Taupin performed a rewritten version of the song as a tribute to Diana, Princess of Wales. The lyrics were written by Bernie Taupin. It was released on 13 September 1997, with the global proceeds from the song going towards Diana's charities." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What type of book is the fault in our stars?", "passages": [ [ "The Fault in Our Stars", "In the piece, the plot of \"The Fault in Our Stars\" was described as \"mawkish at best, exploitative at worst\" and the book was characterized as belonging to the \"sick-lit\" young adult genre, together with other young-adult novels such as \"Never Eighteen\" and \"Before I Die\".", "This entire genre, as well as the genre of young-adult novels dealing with suicide and self-harm (the piece mentions \"Thirteen Reasons Why\", \"By the Time You Read This, I'll Be Dead\", \"The Lovely Bones\", and \"Red Tears\") was criticized as being \"distasteful\" and inappropriate for their target audience of teens.", "\"The Guardian\" criticized the piece, pointing out in particular that \"The Fault in Our Stars\" was chosen by \"The Guardian\" as that month's \"teen book club choice\" because \"it's a gripping read, featuring two compelling characters, that deals sensitively and even humorously with a difficult situation without descending into mawkishness.\"", "In general, \"The Guardian\" faulted the \"Daily Mail\" for suggesting that the issues of illness, depression, and sexuality are inappropriate precisely \"in the one place where difficult subjects have traditionally been most sensitively explored for teens: fiction written specifically for them.\"" ], [ "The Fault in Our Stars", "The Fault in Our Stars\n\nThe Fault in Our Stars, published in January 2012, is the sixth novel by author John Green.", "The title is inspired by Act 1, Scene 2 of Shakespeare's play \"Julius Caesar\", in which the nobleman Cassius says to Brutus: \"The fault, dear Brutus, is not in our stars, /", "But in ourselves, that we are underlings.\"", "The story is narrated by Hazel Grace Lancaster, a 16-year-old girl with thyroid cancer that has affected her lungs.", "Hazel is forced by her parents to attend a support group where she subsequently meets and falls in love with 17-year-old Augustus Waters, an ex-basketball player and amputee.", "A feature film adaptation of the novel directed by Josh Boone and starring Shailene Woodley, Ansel Elgort and Nat Wolff was released on June 6, 2014.", "Both the book and its film adaptation were met with strong critical and commercial success.", "Hazel Grace Lancaster, a 16-year-old with thyroid cancer that has spread to her lungs, attends a cancer patient support group at her mother's behest.", "At one meeting, Hazel meets a 17-year-old boy currently in remission named Augustus Waters, whose Osteosarcoma caused him to lose his right leg." ], [ "Julius Caesar (play)", "In the Ray Bradbury book \"Fahrenheit 451\", some of the character Beatty's last words are \"There is no terror, Cassius, in your threats, for I am armed so strong in honesty that they pass me as an idle wind, which I respect not!\"", "The play's line \"the fault, dear Brutus, lies not in our stars, but in ourselves\", spoken by Cassius in Act I, scene 2, is often referenced in popular culture.", "The line gave its name to the J.M. Barrie play \"Dear Brutus\", and also gave its name to the best selling young adult novel \"The Fault in Our Stars\" by John Green and its film adaptation.", "The same line was quoted in Edward R. Murrow's epilogue of his famous 1954 \"See It Now\" documentary broadcast concerning Senator Joseph R. McCarthy.", "This speech and the line were recreated in the 2005 film \"Good Night, and Good Luck\".", "It was also quoted by George Clooney's character in the Coen brothers film \"Intolerable Cruelty\".", "The line \"And therefore think him as a serpent's egg / Which hatch'd, would, as his kind grow mischievous; And kill him in the shell.\"" ] ], "gold": "The Fault in Our Stars is a realistic fiction, young adult novel about a 16-year-old girl with thyroid cancer who falls in love with a 17-year-old boy with osteosarcoma. It has been characterized as belonging to the \"sick-lit\" genre.", "prediction 1": "The Fault in Our Stars is a young adult novel that is set in a fictional world and is narrated by Hazel Grace Lancaster, a 16-year-old girl with thyroid cancer that has affected her lungs. The book was characterized as belonging to the \"sick-lit\" young adult genre and was criticized for being \"distasteful\" and inappropriate for their target audience of teens.", "prediction 2": "The Fault in Our Stars is a young adult novel that is characterized as belonging to the sick-lit genre. This genre includes books dealing with suicide and self-harm and books dealing with young-adult novels dealing with underlings. In the piece, the plot of The Fault in Our Stars was described as \"mawkish at best, exploitative at worst\" The book's film adaptation was released in June 2014.", "prediction 3": "The Fault in Our Stars, published in January 2012, is the sixth novel by author John Green. The book is characterized as belonging to the \"sick-lit\" young adult genre, together with other young-adult novels such as Never Eighteen and Before I Die. This entire genre, as well as the genre of young-adult novels dealing with suicide and self-harm, was criticized as being \"distasteful\" and inappropriate for their target audience of teens.", "prediction 4": "The Fault in Our Stars is the sixth novel by author John Green, and the sixth novel of his YA series. The book was criticized for being mawkish at best, exploitative at worst, and belongs to the \"sick-lit\" young adult genre, together with other young-adult novels such as \"Never Eighteen\" and \"Before I Die\". The Guardian criticized the piece for being \"distasteful\" and inappropriate for their target audience of teens, pointing out in particular that The Fault in Our Stars was chosen by The Guardian as that month's \"teen book club choice\" because \"it's a gripping read, featuring two compelling characters, that deals sensitively and even humorously with a difficult situation without descending into mawkishness.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 265, "end": 361 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Fault in Our Stars is a young adult novel that is set in a fictional world and is narrated by Hazel Grace Lancaster, a 16-year-old girl with thyroid cancer who falls in love with 17-year-old Augustus Waters. The book was characterized as belonging to the \"sick-lit\" young adult genre." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who is the mother in how i met?", "passages": [ [ "The Mother (How I Met Your Mother)", "The Mother (How I Met Your Mother)\n\nTracy McConnell (colloquial: \"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\".", "The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother.", "Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "The Mother is played by Cristin Milioti.", "The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment.", "Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in \"Last Forever\", the series finale.", "The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "An alternate ending was released in the ninth season DVD." ], [ "The Mother (How I Met Your Mother)", "She says that she is in the \"weirdest place on earth\" right now and that it is too soon for her to be dating.", "Ted walks her back to her apartment.", "They say goodnight and Ted begins to walk away.", "The Mother then stops him and asks him to finish the story he was telling her.", "When the story is over, they say goodnight again.", "The Mother takes a step towards Ted and they kiss for the first time, before deciding to carry on their date.", "In a flashforward in \"The Lighthouse\", Ted proposes to the Mother at the top of the lighthouse near Farhampton Inn.", "She immediately accepts.", "In another flashfoward in \"Unpause\", the Mother is revealed to be pregnant with their second child, Luke, in the year 2017.", "She goes into labor while she and Ted are staying at Farhampton.", "The Mother's real name is not revealed until the series finale, \"Last Forever\".", "When Ted meets her at the Farhampton train station, she reveals that her name is Tracy McConnell.", "In the season 1 episode \"Belly Full of Turkey\", Ted meets a stripper named Tracy and says \"...that, kids, is the true story of how I met your mother\"." ], [ "Cristin Milioti", "Cristin Milioti\n\nCristin Milioti (born August 16, 1985) is an American actress and vocalist.", "She has worked in Broadway theatre productions such as \"That Face\", \"Stunning\", and the Tony Award-winning musical \"Once\".", "She also played the titular Mother on the sitcom \"How I Met Your Mother\" from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film \"The Wolf of Wall Street\", and Betsy Solverson in the second season of \"Fargo\" (2015).", "She has won a Grammy Award and has been nominated for a Tony Award.", "Milioti was born on August 16, 1985 in Cherry Hill, New Jersey.", "She is of Italian descent, and calls her family \"Olive Garden Italian\".", "In middle school, she found her love of acting at Long Lake Camp for the Arts in New York state.", "She graduated in 2003 from Cherry Hill High School East, where she began performing in school plays.", "She took acting classes at New York University, but dropped out during her freshman year.", "However, she is listed in the university's advertising.", "Milioti's first acting roles were bit parts in national advertising campaign ads, notably one for the Ford Edge.", "She also appeared in television programs such as \"30 Rock\" and films such as \"Greetings from the Shore\"." ] ], "gold": "Tracy Mosby (n\u00e9e McConnell), also known as The Mother, is the title character from the CBS television sitcom How I Met Your Mother. Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers,\" as an unseen character. She was first fully seen in \"Something New\" and was promoted to a main character in season 9. The Mother's real name, Tracy McConnell, is not confirmed until the series finale, \"Last Forever\", when Ted meets her at the Farhampton train station. The name was hinted at in the season 1 episode \"Belly Full of Turkey.\" Tracy McConnell is played by American actress and singer Cristin Milioti.", "prediction 1": "The Mother in How I Met Your Mother is played by actress and vocalist Cristin Milioti. Milioti played the Mother from 2013 to 2014.", "prediction 2": "In the CBS sitcom How I Met Your Mother, the story of how Ted Mosby met The Mother is the framing device behind the show. Many facts about the Mother are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment. The Mother's real name is not revealed until the series finale, Last Forever. When Ted meets the Mother at the Farhampton train station, she reveals that her name is Tracy McConnell. American actress and vocalist Cristin Miliotiotiotiotiotiotiotiotiotiotiotiotioti played the Mother on the sitcom from 2013 to 2014.", "prediction 3": "The mother in the sitcom How I Met Your Mother is played by American actress and vocalist Cristin Milioti. The mother's real name is not revealed until the series finale, Last Forever.", "prediction 4": "\"How I Met Your Mother\" tells the story of how Ted Mosby, played by Josh Radnor, met The Mother. The Mother's real name is not revealed until the series finale, \"Last Forever.\" The Mother is played by American actress and vocalist Cristin Milioti. The show's narrator, Future Ted, is played by Bob Saget.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 131 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "Tracy McConnell (\"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\". Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9. Ted and The Mother meet at the Farhampton train station this scene is shown in \"Last Forever\", the series finale; her real name is revealed during it as well. The Mother is played by actress and vocalist Cristin Milioti. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When does the next season of fairy tail air?", "passages": [ [ "Fairy Tail", "On March 4, 2013, Mashima announced on his Twitter account that the anime would not end yet, and confirmed on July 11 that a sequel series was greenlit.", "The sequel series was officially confirmed in \"Weekly Shonen Magazine\" on December 28, 2013 with a special edition chapter.", "The sequel is produced by A-1 Pictures and Bridge, featuring character designs by Shinji Takeuchi; the original series' voice actors also returned to the project along with director Shinji Ishihira and writer Masashi Sogo.", "The official website for the sequel was launched on January 7, 2014.", "The series premiered on TV Tokyo on April 5, 2014, and was being simulcast by Funimation Entertainment.", "The second series concluded its run on March 26, 2016.", "On March 22, 2016, Mashima announced via Twitter that another \"Fairy Tail\" series was being developed.", "On July 20, 2017, Mashima confirmed on Twitter that the final season of \"Fairy Tail\" would air in 2018.", "The final season of \"Fairy Tail\" began airing on October 7, 2018.", "A-1 Pictures, CloverWorks, and Bridge have been confirmed to be producing and animating the final season, which is set to run for 51 episodes." ], [ "Fairy Tail", "The anime, also titled \"Fairy Tail\" and directed by Shinji Ishihira, premiered on TV Tokyo on October 12, 2009.", "The series ended its run on March 30, 2013, with reruns beginning to air on April 4, 2013 under the title \"Fairy Tail Best!\".", "Forty-one DVD volumes containing four episodes each have been released.", "The Southeast Asian network Animax Asia aired the series locally in English.", "On January 18, 2011, British anime distributor Manga Entertainment announced on Twitter that the company would release the anime series in bilingual format at the end of the year.", "On April 21, 2011, they had confirmed that the first volume with 12 episodes would be released in February 2012; however, they later announced that the first volume would be released on March 5, 2012.", "In 2011, North American anime distributor Funimation Entertainment announced that they had acquired the first season of the ongoing series.", "The series made its North American television debut on November 22, 2011 on the Funimation Channel.", "The anime is also licensed by Madman Entertainment, who streamed and simulcasted the series on AnimeLab in Australia and New Zealand Melanesian Region (Fiji, Papua New Guinea, Solomon Islands and Vanuatu), Polynesian Region (Cook Islands, Niue, Samoa, Tonga, and Tuvalu)." ] ], "gold": "The anime series Fairy Tail concluded its decade-long run in 2019. Season 5 premiered on April 14, 2012 and season 6 premiered on October 6, 2012. The series then went off the air for a year until season 7 premiered on April 5, 2014.", "prediction 1": "The next season of Fairy Tail began airing on October 7, 2018. The final season of Fairy Tail began airing on October 7, 2018 and the final season of the series will air in 2019.", "prediction 2": "The next season of Fairy Tail aired its last episode on October 7, 2018. The series ended its run on March 30, 2013, with reruns beginning to air on April 4, 2013 under the title \"Fairy Tail Best!\". North American anime distributor Funimation Entertainment announced that they had acquired the first season of the ongoing series. The series made its North American television debut on November 22, 2011 on the Funimation Channel.", "prediction 3": "The new season of the Japanese anime series Fairy Tail began airing on October 7, 2018 and the new season of the Japanese anime series Fairy Tail: The Ending began airing on November 4, 2019.", "prediction 4": "The next season of Fairy Tail began airing on October 7, 2018.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 4, "end": 8 }, { "error type": "Redundant", "explanation": "The next season of Fairy Tail began airing on October 7, 2018. ", "start": 63, "end": 125 }, { "error type": "Redundant", "explanation": "The final season of Fairy Tail began airing on October 7, 2018 and ", "start": 130, "end": 169 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 173, "end": 178 } ], "missing-info": [], "corrected-prediction": "The final season of \"Fairy Tail\" began airing on October 7, 2018." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When did the uk give hong kong back to china?", "passages": [ [ "Sino-British Joint Declaration", "Sino-British Joint Declaration\n\nThe Sino\u2013British Joint Declaration is an international bilateral treaty signed between the People's Republic of China and the United Kingdom on 19 December 1984 in Beijing.", "The Declaration stipulates the sovereign and administrative arrangement over Hong Kong after 1 July 1997, when the lease of the New Territories was set to expire according to the Convention for the Extension of Hong Kong Territory.", "The Declaration was signed by Premier Zhao Ziyang of the People's Republic of China (PRC) and Prime Minister Margaret Thatcher of the United Kingdom (UK) on behalf of their respective governments.", "It entered into force with the exchange of instruments of ratification on 27 May 1985, and was registered by the PRC and UK governments at the United Nations on 12 June 1985.", "In the Joint Declaration, the PRC Government stated that it had decided to resume the exercise of sovereignty over Hong Kong (including Hong Kong Island, Kowloon, and the New Territories) with effect from 1 July 1997, and the UK Government declared that it would hand over Hong Kong to the PRC with effect from 1 July 1997.", "The PRC Government also declared its basic policies regarding Hong Kong in the document." ], [ "1990s in Hong Kong", "In 1994, the PRC announced that it would terminate the Legislative Council (LegCo) in favour of the \"provisional legislative council\".", "In 1995, LegCo was passed and the Democratic Party denounced the provisional legislative council as illegal.", "The provisional legislative council operated from Shenzhen before the handover.", "At midnight on 1 July 1997, the handover ceremony was held at the new wing of the Hong Kong Convention and Exhibition Centre at Wan Chai North.", "The flag of the United Kingdom and the flag of the Crown colony were lowered.", "The flags of the Hong Kong Special Administrative Region and China were raised.", "This marked the transfer of sovereignty of Hong Kong from British colonial rule to Chinese rule.", "Participated guests in the ceremony included H.R.H. The Prince of Wales, Prime Minister of the United Kingdom Tony Blair, President of the People's Republic of China Jiang Zemin, Premier of the People's Republic of China Li Peng, the last Hong Kong Governor Chris Patten appointed by the United Kingdom, and Tung Chee Hwa, the first chief executive of Hong Kong elected from a Beijing-controlled election.", "The population of Hong Kong in 1995 and 1999 was 6.3 million and 6.9 million respectively.", "A total of 44,000 illegal immigrants from mainland China were arrested and deported in 1993, with the number decreased to 35,500 a year later." ], [ "Hong Kong handover ceremony", "Hong Kong handover ceremony\n\nThe handover ceremony of Hong Kong in 1997 officially marked the transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China.", "It was an internationally televised event with the ceremony commencing on the night of 30 June 1997 and finishing on 1 July 1997.", "The ceremony was held at the new wing of the Hong Kong Convention and Exhibition Centre (HKCEC) in Wan Chai.", "For the People's Republic of China\n\nFor the United Kingdom of Great Britain and Northern Ireland\n\n\n\nIn 2005, the British \"Mail on Sunday\" revealed Prince Charles's memorandum, of which \"Clarence House said only 11 copies were made, circulated to close friends\", where he referred to the transfer as the \"Great Chinese Takeaway\" and the Chinese officials as \"appalling old waxworks\".", "In another reported extract, Prince Charles described the ceremony as an \"awful Soviet-style\" performance and dismissed the speech by President Jiang Zemin as \"propaganda\", complete with loud cheering \"by the bussed-in party faithful at the suitable moment in the text.\"", "He also ridiculed the People's Liberation Army's goose-steps in the ceremony and claimed his trip on HMY \"Britannia\" out of Hong Kong was closely watched by Chinese warships." ] ], "gold": "The Sino-British Joint Declaration was a treaty signed by the governments of the United Kingdom and China in December 1984. This treaty set the conditions for the formal passing of the authority over the territory of the colony of Hong Kong from the United Kingdom to China at midnight on July 1, 1997. On the night of June 30, 1997, the handover ceremony between the United Kingdom and China was held at the new wing of the Hong Kong Convention and Exhibition Centre in Wan Chai.", "prediction 1": "The Hong Kong handover ceremony took place on the night of 30 June 1997 and finished on 1 July 1997. The transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China was televised internationally.", "prediction 2": "The handover of Hong Kong in 1997 officially marked the transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China. The handover ceremony of Hong Kong in 1997 officially marked the transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China. It was an internationally televised event with the ceremony commencing on the night of 30 June 1997 and finishing on 1 July 1997.", "prediction 3": "The UK officially gave Hong Kong back to the People's Republic of China following the signing of the Sino-British Joint Declaration in 1984. The handover ceremony of Hong Kong in 1997 officially marked the transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China. The handover ceremony of Hong Kong in 1997 was an internationally televised event with the ceremony commencing on the night of 30 June 1997 and finishing on 1 July 1997.", "prediction 4": "The Hong Kong handover ceremony took place in 1997. The handover ceremony of Hong Kong in 1997 officially marked the transfer of sovereignty over Hong Kong from the United Kingdom of Great Britain and Northern Ireland to the People's Republic of China. It was an internationally televised event with the ceremony commencing on the night of 30 June 1997 and finishing on 1 July 1997.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 270 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Sino\u2013British Joint Declaration is an international bilateral treaty signed between the People's Republic of China and the United Kingdom on 19 December 1984. The Hong Kong handover ceremony took place on the night of 30 June 1997 and finished on 1 July 1997. It was held at the new wing of the Hong Kong Convention and Exhibition Centre at Wan Chai North." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who is the girl wolverine fights in x2?", "passages": [ [ "X2 (film)", "X2 (film)\n\nX2 (often promoted as X2: X-Men United and internationally as X-Men 2) is a 2003 American superhero film based on the X-Men superhero team appearing in Marvel Comics.", "It is the sequel to 2000's \"X-Men\", and the second installment in the \"X-Men\" film series.", "The film was directed by Bryan Singer, written by Michael Dougherty, Dan Harris, and David Hayter, and features an ensemble cast including Hugh Jackman, Patrick Stewart, Ian McKellen, Halle Berry, Famke Janssen, James Marsden, Rebecca Romijn-Stamos, Brian Cox, Alan Cumming, Bruce Davison, Shawn Ashmore, Aaron Stanford, Kelly Hu, and Anna Paquin.", "The plot, inspired by the graphic novel \"\", pits the X-Men and their enemies, the Brotherhood, against the genocidal Colonel William Stryker (Brian Cox).", "He leads an assault on Professor Xavier's school to build his own version of Xavier's mutant-tracking computer Cerebro, in order to destroy every mutant on Earth and to save the human race from them.", "Development began shortly after \"X-Men\" (2000).", "David Hayter and Zak Penn wrote separate scripts, combining what they felt to be the best elements of both scripts into one screenplay." ], [ "X2 (film)", "Since the Liberty Island incident, Jean has been having premonitions and struggles to concentrate as her powers become increasingly difficult to control.", "Meanwhile, military scientist Colonel William Stryker approaches the president and receives approval to investigate Xavier's mansion for their ties to mutants.", "Stryker's forces invade the school and abduct some of the students.", "Colossus leads the remaining students to safety while Wolverine, Rogue, Iceman, and Pyro escape, and Stryker's assistant Yuriko Oyama captures Cyclops and Xavier.", "During the attack Wolverine confronts Stryker, who knows him by name.", "The shape-shifting Mystique gains information about Magneto's prison and helps him escape while also discovering schematics for a second Cerebro.", "Wolverine, Rogue, Iceman, and Pyro visit Iceman's parents in Boston and meet up with Storm, Jean, and Nightcrawler.", "The X-Jet is attacked by fighter jets while flying back to the mansion and is shot down, but Magneto saves them from crashing.", "Magneto explains to the group that Stryker has built the second Cerebro to use it, and Xavier, to telepathically kill every mutant on the planet.", "Stryker's son, Jason, is a mutant with mind-controlling powers, which Stryker will use to force Xavier to do this." ], [ "Lady Deathstrike", "Lady Deathstrike\n\nLady Deathstrike (Yuriko Oyama), occasionally spelled \"Deathstryke,\" is a fictional supervillain appearing in American comic books published by Marvel Comics.", "She is a foe of the X-Men, especially Wolverine.", "Her father Lord Dark Wind created the adamantium-bonding process that was forced on Wolverine by Weapon X.", "A self-styled warrior, Lady Deathstrike hired the villain Spiral\u2019s \"body shoppe\" to bond adamantium to her own skeleton in addition to other cyber-genetic enhancements.", "She has since worked as a mercenary and assassin and feels a need to prove herself by killing Wolverine.", "Lady Deathstrike is also the sister of Lord Deathstrike.", "A mutant version of Lady Deathstrike, played by Kelly Hu and without any of Deathstrike's backstory, appeared as a brainwashed henchman of William Stryker in the 2003 film \"X2.\"", "She also re-appeared in \"\", where she was revealed to be Silver Samurai's apprentice.", "In 2009, Lady Deathstrike was ranked as IGN's 78th Greatest Comic Book Villain of All Time.", "She first appeared as Yuriko Oyama in \"Daredevil\" #197 and later as Lady Deathstrike in \"Alpha Flight\" #33." ] ], "gold": "In the 2003 American superhero film, X2, Wolverine fights a female mutant who has a healing ability like Wolverine's and is controlled by Stryker. The character's name is Yuriko Oyama, who goes by Deathstrike, and is played by Kelly Ann Hu.", "prediction 1": "In the 2003 American superhero film X2, Wolverine fights a girl named Jean Grey. In the comic book series X-Men, Jean Grey is a mutant who is a foe of the X-Men, especially Wolverine. In the film, Jean Grey is a mutant who is a henchman for the villainous Colonel William Stryker. In the comic book series X-Men, Wolverine fights a girl named Jean Grey.\n", "prediction 2": "New Mutants in X-Men X2 is an American superhero film released on December 3, 2003. Wolverine fights Young Wolverine in costume in the movie. Young Wolverine is a member of the Brotherhood of Evil Dead. In the movie, she is represented by Mystique, a shape-shifting flying computer designed to assist naval scientist William Stryker in building a second version of Xavier's mutant-tracking computer Cerebro. In the movie, Wolverine is a girl who is Herbrine.", "prediction 3": "X2 (often promoted as X2: X-Men United and internationally as X-Men 2) is a 2003 American superhero film based on the X-Men superhero team appearing in Marvel Comics and the graphic novel X-Men. During the attack, Wolverine confronts genocidal Colonel William Stryker, who describes himself by name. Stryker then leads an assault on Professor Xavier's school to build his own version of Xavier's mutant-tracking computer Cerebro, in order to destroy every mutant on the planet and force the human race from them. A mutant version of Lady Deathstrike later appeared as henchman of Stryker in the video games.", "prediction 4": "In The X-Men: First Class and the X-Men United films, the girl Wolverine fights is Jean Spartacus, who is the mother of Wolverine. She is also the wife of Rex, Professor Xavier's former student and arch-enemy. In the 2003 film X2, Lady Deathstrike, a fictional supervillain appearing in American comic books published by Marvel Comics, is the main antagonist. Somewhat surprisingly, a female character named Jean is Wolverine's former girlfriend who also appears in the 2003 film. Another female Wolverine fights is Jean's new mother, who is the mother of Wolverine.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 80 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1,2]}", "start": 113, "end": 122 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 197, "end": 206 }, { "error type": "Redundant", "explanation": "In the 2003 American superhero film X2, Wolverine fights a girl named Jean Grey.", "start": 281, "end": 354 }, { "error type": "Unverifiable", "explanation": "", "start": 106, "end": 112 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the 2003 American superhero film X2, Wolverine fights Colonel William Stryker. In the comic book series, Lady Deathstrike (also called Yuriko Oyama) is a mutant who is a foe of the X-Men, especially Wolverine. In the film, Lady Deathstrike is a mutant who is a henchman for the villainous Colonel William Stryker. Kelly Hu plays the character." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who won between john cena and the rock?", "passages": [ [ "WrestleMania XXVII", "Later in a backstage segment Cena \"congratulated\" The Rock on his birthday, telling him to bring it on for WrestleMania while showing off the WWE Championship, implying that their match at WrestleMania XXVIII will be for the WWE Championship, continuing on with their feud.", "However, Cena would go on to lose the WWE title three times that year, twice to CM Punk, and once to Alberto Del Rio.", "In November, at Survivor Series, Cena teamed with the Rock, which would be the latter's first match since WrestleMania XX in 2004, and defeated the Miz and R-Truth, only for Rock giving a \"Rock Bottom\" on Cena after the match.", "The Rock defeated Cena at WrestleMania XXVIII, and, in 2013, a rematch at WrestleMania 29 took place, with The Rock's WWE Championship on the line, which saw Cena emerging victorious.", "On the April 11 \"Raw\", Edge retired due to a legit neck injury, marking his last match for the company against Del Rio at WrestleMania.", "Edge vacated the World Heavyweight Championship on the April 12 live edition of \"SmackDown\" (replayed on April 15), therefore retiring as world champion.", "Christian would win the title at Extreme Rules in a ladder match against Del Rio, only to lose it at the hands of Randy Orton, on the May 6 episode of \"SmackDown\"." ], [ "WrestleMania 29", "At the Elimination Chamber event on February 17, The Rock successfully defended the WWE Championship against the previous champion CM Punk.", "The next night on \"Raw\", Punk challenged Cena for his spot in the main event, and Cena accepted.", "Cena won the match on February 25, setting up a rematch of his \"Once in a Lifetime\" match from the previous year against Rock.", "Cena blamed Rock for sending his life into a downward spiral, citing events such as being attacked by Brock Lesnar on the post-WrestleMania Raw, Big Show turning heel on him, being embarrassed by John Laurinaitis at Over the Limit, failing to cash in his Money in the Bank, losing to CM Punk multiple times and losing to Dolph Ziggler at .", "He told Rock he would gain redemption by beating him at WrestleMania.", "At Elimination Chamber, World Heavyweight Champion Alberto Del Rio successfully retained his championship against Big Show.", "Returning superstars Jack Swagger, Chris Jericho, and Mark Henry earned spots in the six-man Elimination Chamber match, along with Daniel Bryan, Kane, and Randy Orton to become the number one contender for the World Heavyweight Championship.", "Swagger won the event, and challenged Del Rio for the title at WrestleMania." ] ], "gold": "At WrestleMania XXVII on April 3, 2011, The Rock defeated John Cena. However, at WrestleMania XXVIII on April 1, 2012, the two fought again and John Cena won the rematch in what he considered to be a redemptive victory.", "prediction 1": "During their feud, Cena repeatedly beat The Rock for the WWE title. On February 25, 2013, Cena defeated the Rock at WrestleMania XXVII, and in 2013, a rematch at WrestleMania 29 took place, with The Rock's WWE Championship on the line, which saw Cena emerging victorious.", "prediction 2": "In a backstage segment Cena told The Rock on his birthday, telling him to bring it on for WrestleMania while showing off the WWE Championship, implying that their match at WrestleMania XXVIII will be for the WWE Championship, continuing on with their feud. However, Cena would go on to lose the WWE title three times that year, twice to CM Punk, and once to Alberto Del Rio. In 2013, a rematch at WrestleMania 29 took place, with the Rock winning the WWE Championship on the line, with The Rock emerging victorious.", "prediction 3": "In their 2010 feud, John Cena beat The Rock in their once-in-a-lifetime match on February 25, 2010. The Rock then defeated Cena at WrestleMania XXVII. Cena then won the match at WrestleMania 29.", "prediction 4": "The Rock defeated John Cena at WrestleMania XXVII. In 2013, a rematch at WrestleMania 29 took place, with The Rock's WWE Championship on the line, which saw Cena emerging victorious.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 19, "end": 67 }, { "error type": "Unverifiable", "explanation": "", "start": 68, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 18 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Rock defeated Cena at WrestleMania XXVIII, and in 2013, a rematch at WrestleMania 29 took place, with The Rock's WWE Championship on the line, which saw Cena emerging victorious." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the tv show last man standing start?", "passages": [ [ "Last Man Standing (UK TV series)", "Last Man Standing (UK TV series)\n\n", "Last Man Standing and latterly Last Woman Standing (known in the United States as Last One Standing and also known by the Discovery Channel title of Six Versus the World) is a BBC reality TV show that was first aired on 26 June 2007.", "Each series featured a group of athletic individuals travelling around the globe to take part in different tribal or traditional sports.", "Whoever physically outperforms the rest in the most challenges is declared the winner.", "Series 1 was narrated by Richard Hammond, with series 2 being narrated by Ralf Little.", "1st", "Last Man Standing: Jason Bennett from the United States\n\n2nd", "Last Man Standing: Wol\u00e9 Adesemoye from the United Kingdom\n\nThe Last Woman Standing: Anna Campbell from Lamu, Kenya\n\nEach episode begins with the contestants being introduced to a new indigenous society, meeting the local elder or head man.", "The contestants are introduced to the sport they will be competing in.", "They must board and eat with the villagers, and help out with village chores while being trained by the villagers, both for general fitness, and in techniques required for the particular sport.", "Competitors often undertake local rituals or traditions, such as ceremonial dancing, the wearing of tribal clothing, body painting, medicinal treatments, ritual tests of strength or courage, and the offering up of prayers or offerings to local gods or spirits." ], [ "Last Man Standing (U.S. TV series)", "Last Man Standing (U.S. TV series)\n\n", "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd.", "Distributed by 20th Century Fox Television, the series originally ran on ABC from 2011 to 2017 for six seasons, and entered syndication in 2015.", "Despite being ABC's second-highest rated sitcom for the 2016\u201317 season, it was revealed in May 2017 that the network had declined to renew \"Last Man Standing\" for a seventh season.", "Media publications reported that ABC was unwilling to cover the production costs for a seventh season on behalf of 20th Century Fox Television.", "One year later, the studio's sibling network Fox announced it had picked up the show for a seventh season, which premiered on September 28, 2018.", "The series follows Mike Baxter, a senior executive and director of marketing for an outdoor sporting goods store chain based in Denver, Colorado.", "His home life is initially filled with his wife, three daughters and a grandson, but later extends to the young men who are married to or dating his daughters.", "Several notable guest stars have appeared throughout the series, including appearances made from cast members of Tim Allen's previous series, \"Home Improvement\"." ], [ "Last Man Standing (UK TV series)", "The third series of the programme featured five female contestants, and was entitled \"Last Woman Standing\".", "It consisted of six episodes produced by the BBC, and was broadcast in the UK on BBC Three from 9 February to 16 March 2010." ], [ "The Last Man on Earth (TV series)", "The Last Man on Earth (TV series)\n\nThe Last Man on Earth is an American post-apocalyptic comedy television series created by and starring Will Forte.", "It premiered on Fox on March 1, 2015.", "The pilot episode was written by Forte, and directed by Phil Lord and Christopher Miller.", "On April 8, 2015, the series was renewed for a second season, which premiered on September 27, 2015.", "On March 24, 2016, the show was renewed for a third season, which premiered on September 25, 2016.", "On May 10, 2017, Fox renewed the series for a fourth season, which premiered on October 1, 2017.", "On May 10, 2018, Fox cancelled the series after four seasons.", "Almost a year after a deadly virus sweeps Earth, Phil Miller (Will Forte) is seemingly the only human survivor in late 2020.", "As he searches for others and paints signs stating he is alive in his hometown of Tucson, Arizona, he finds no one.", "Before attempting suicide, he discovers another survivor, Carol Pilbasian (Kristen Schaal).", "Despite being annoyed by each other, Carol insists Phil marry her so their children will not be born out of wedlock.", "Although Phil thinks that it is ridiculous to hang on to traditions from the \"old world\", they marry for re-population purposes.", "Over the next several months, more survivors join them." ] ], "gold": "The BBC reality TV show Last Man Standing first aired on 26 June 2007 and ran for two seasons plus a third season, Last Woman Standing, featuring all female contestants. An entirely unrelated American sitcom also titled Last Man Standing first aired on October 11, 2011, airing on ABC for six seasons before being cancelled and picked up by Fox for three more seasons beginning on September 28, 2018.", "prediction 1": "Last Man Standing and latterly Last Woman Standing is a BBC reality TV show that was first aired on 26 June 2007. Each series featured a group of athletic individuals travelling around the globe to take part in different tribal or traditional sports. Whoever physically outperforms the rest in the most challenges is declared the winner. Last Man Standing is an American post-apocalyptic comedy television series created by and starring Will Forte. It premiered on Fox on March 1, 2015.", "prediction 2": "Last Man Standing is a reality television show that was first aired on BBC Three from 9 February to 16 March 2010 and the second and third series, which featured five female contestants, started airing from 26 June 2007. In the United States, Last One Standing is a sitcom that starred Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is married to three daughters and a grandfather to his oldest daughter's son, Boyd. In the United States, Last Man Standing is a post-apocalyptic comedy television series created by and starring Will Forte, which began airing on Fox on March 1, 2015, and finished airing on September 28, 2018. The third series featured five female contestants and was broadcast in the UK on BBC Three from 9 February to 16 March 2010.", "prediction 3": "Last Man Standing is a British reality TV show that was first aired on BBC Three from 9 February to 16 March 2010. Last Man Standing is also known as Last Woman Standing. In the United States, the show began airing on ABC from 2011 to 2017 for six seasons. It entered syndication in 2015 and was adapted into an American post apocalyptic comedy television series called Last Man on Earth.", "prediction 4": "Last Man Standing and laterly Last Woman Standing is a British reality TV show that was first aired on 26 June 2007. Each series featured a group of athletic individuals travelling around the globe to take part in different tribal or traditional sports. Whoever physically outperforms the rest in the most challenges is declared the winner. Last Man Standing is an American post-apocalyptic comedy television series created by and starring Will Forte. It premiered on Fox on March 1, 2015. The third series of the programme featured five female contestants, and was broadcast in the UK on BBC on BBC Three from 9 February to 16 March 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 486 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Last Man Standing and latterly Last Woman Standing is a BBC reality TV show that was first aired on 26 June 2007. There's an American version with the same name, the series originally ran on ABC from 2011 to 2017 for six seasons. Fox announced it had picked up the show for a seventh season, which premiered on September 28, 2018.\n" }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "Who wrote the song i kissed a girl?", "passages": [ [ "I Kissed a Girl", "I Kissed a Girl\n\n\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, \"One of the Boys\" (2008).", "It was released on April 28, 2008, by Capitol Records as the lead single from the record.", "Perry co-wrote the song with Max Martin, Cathy Dennis, and its producer Dr. Luke, with additional production from Benny Blanco.", "\"I Kissed a Girl\" is a pop rock song with elements of new wave.", "Perry stated its lyrics are \"about the magical beauty of a woman\".", "The song sparked controversy for its homosexual themes.", "The song topped the US \"Billboard\" Hot 100 chart for seven consecutive weeks, becoming the 1,000th number-one song of the rock era.", "The single has sold over 4.7 million digital copies in the US alone.", "\"I Kissed a Girl\" is one of eight songs by Perry to sell over 4 million digital copies in the US, the others being \"Hot n Cold\", \"California Gurls\", \"Firework\", \"E.T. \", \"Teenage Dream\", \"Roar\" and \"Dark Horse\"." ], [ "Jill Sobule (album)", "Jill Sobule (album)\n\n", "Jill Sobule is the second album by the American singer-songwriter Jill Sobule, released in April 7, 1995.", "The disc contained the singles \"Good Person Inside\", \"Supermodel\" and \"I Kissed a Girl\".", "The album sold 100,000 copies in the US, making it her most commercially successful record.", "The first release of the album does not contain \"Supermodel\".", "After \"Supermodel\" appeared on the \"Clueless\" film soundtrack and was released as a single, the album was reissued with the song.", "The singer Katy Perry used the title \"I Kissed a Girl\" for her own song, \"I Kissed a Girl\", which appeared on her 2008 album \"One of the Boys\".", "The song received a mixed reception, and was unfavourably compared to Sobule's original by some commentators: \"Hiponline.com\" wrote that the song is \"not nearly as interesting or exciting as you\u2019d expect.", "It\u2019s not even half as good as Jill Sobule\u2019s song 'I Kissed a Girl'\".", "\"Glitterati Gossip\" wrote that Sobule's song \"was ten times better, because there was actual emotional content to her lyrics\"." ] ], "gold": "\"I Kissed a Girl\", the first single of Katy Perry's second studio album, One of the Boys (2008), was written by Katy Perry, Lukasz Gottwald, Max Martin, Cathy Dennis. The 1995 song \"I Kissed the Girl\" was written by Jill Sobule, Robin Eaton and performed by Sobule. ", "prediction 1": "\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, One of the Boys, which was released on April 28, 2008. Perry co-wrote the song with Max Martin, Cathy Dennis, and its producer Dr. Luke, with additional production from Benny Blanco. The song topped the US Billboard Hot 100 chart for seven consecutive weeks, becoming the 1,000th number-one song of the rock era. The American singer-songwriter Jill Sobule wrote the song \"I Kissed a Girl\", which appeared on her 2008 album One of the Boys. The song received a mixed reception, and was unfavourably compared to Sobule's original.", "prediction 2": "\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, One of the Boys. Perry co-wrote the song with Max Martin, Cathy Dennis, and its producer Dr. Luke, with additional production from Benny Blanco. The song was released on April 28, 2008, by Capitol Records as the lead single from the record.", "prediction 3": "\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, One of the Boys (2008). Perry co-wrote the song with Max Martin, Cathy Dennis, and its producer Dr. Luke, with additional production from Benny Blanco. The song topped the US Billboard Hot 100 chart for seven consecutive weeks, becoming the 1,000th number-one song of the rock era. American singer Jill Sobule wrote the song for her second album, Jill Sobule, released in 1995.", "prediction 4": "\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, One of the Boys (2008). Perry co-wrote the song with Max Martin, Cathy Dennis, and its producer Dr. Luke, with additional production from Benny Blanco. The song received a mixed reception and was unfavourably compared to Sobule's original by some commentators.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 536, "end": 624 }, { "error type": "Irrelevant", "explanation": "", "start": 486, "end": 535 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I Kissed a Girl\" is a song recorded by American singer Katy Perry for her second studio album, One of the Boys, which was released on April 28, 2008. Perry co-wrote the song with Max Martin, Cathy Dennis. The American singer-songwriter Jill Sobule wrote the 1995 song \"I Kissed a Girl\". " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who publishes the cpt manual for procedure codes?", "passages": [ [ "Current Procedural Terminology", "Current Procedural Terminology\n\nThe Current Procedural Terminology (CPT) code set is a medical code set maintained by the American Medical Association through the CPT Editorial Panel.", "The CPT code set (copyright protected by the AMA) describes medical, surgical, and diagnostic services and is designed to communicate uniform information about medical services and procedures among physicians, coders, patients, accreditation organizations, and payers for administrative, financial, and analytical purposes.", "New editions are released each October.", "The current version is the CPT 2018.", "It is available in both a standard edition and a professional edition.", "CPT coding is similar to ICD-9 and ICD-10 coding, except that it identifies the services rendered, rather than the diagnosis on the claim (ICD-10-CM was created for diagnostic coding- it took the place of Volume 3 of the ICD-9).", "The ICD code sets also contain procedure codes (ICD-10-PCS codes), but these are only used in the inpatient setting.", "CPT is currently identified by the Centers for Medicare and Medicaid Services (CMS) as Level 1 of the Healthcare Common Procedure Coding System.", "The Current Procedural Terminology (CPT) was developed by the American Medical Association (AMA).", "There are three types of CPT code:", "Category I, Category II, and Category III.", "Category I CPT Code(s)." ], [ "Current Procedural Terminology", "Currently there are 11 Category II codes.", "They are:\n\n\nCPT II codes are billed in the procedure code field, just as CPT Category I codes are billed.", "Because CPT II codes are not associated with any relative value, they are billed with a $0.00 billable charge amount.", "The CPT code revisions that affect counselors are simple and straightforward.", "Here is a list of psychotherapy CPT codes that will be retired, and their 2013 comparables:\n\n90801 \u2013> \\\nFamily therapy codes (90847 and 90846) will remain unchanged, as will codes for psychological testing.", "CPT is a registered trademark of the American Medical Association.", "The AMA holds the copyright for the CPT coding system.", "However, in \"Practice Management v. American Medical Association\" the U.S. Court of Appeals for the Ninth Circuit held that while the AMA owned the copyright, it could not enjoin a competitor on the basis that the AMA had misused its copyright.", "Practice Management had argued that the publication of the CPT into federal regulation invalidated the copyright; the general debate around copyright and regulation access was revived in 2012 by a petition motivated by a Administrative Conference of the United States recommendation." ], [ "Current Procedural Terminology", "Despite the copyrighted nature of the CPT code sets, the use of the code is mandated by almost all health insurance payment and information systems, including the Centers for Medicare and Medicaid Services (CMS) and HIPAA, and the data for the code sets appears in the Federal Register.", "As a result, it is necessary for most users of the CPT code (principally providers of services) to pay license fees for access to the code.", "The AMA offers a limited search of the CPT manual for personal, non-commercial use on its web site." ] ], "gold": "The Current Procedural Terminology, or CPT, code set is a medical code set published by the American Medical Association through the CPT Editorial Panel. Developed by the American Medical Association, the CPT is copyright protected. Despite the copyrighted nature of the CPT code sets, the use of the code is mandated by almost all health insurance payment and information systems. CPT is a registered trademark of the American Medical Association and is its largest single source of income.", "prediction 1": "The Current Procedural Terminology (CPT) code set is a medical code set maintained by the American Medical Association through the CPT Editorial Panel. The CPT code set is copyright protected by the American Medical Association. The AMA holds the copyright for the CPT coding system.", "prediction 2": "The Current Procedural Terminology (CPT) code set is a medical code set maintained by the American Medical Association through the CPT Editorial Panel. The CPT code set is copyright protected by the American Medical Association.", "prediction 3": "The Current Procedural Terminology is a medical code set maintained by the American Medical Association, or AMA, through the CPT Editorial Panel. The AMA holds the copyright for the CPT coding system. The AMA offers a limited search of the CPT manual for personal, non-commercial use on its web site.", "prediction 4": "The Current Procedural Terminology (CPT) code set is a medical code set maintained by the American Medical Association through the CPT Editorial Panel. Copyright for the CPT coding system is held by the American Medical Association.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 283 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Current Procedural Terminology (CPT) code set is a medical code set maintained by the American Medical Association through the CPT Editorial Panel. The CPT code set is copyright protected by the American Medical Association. The Current Procedural Terminology (CPT) was developed by the American Medical Association (AMA). Despite the copyrighted nature of the CPT code sets, the use of the code is mandated by almost all health insurance payment and information systems. CPT is a registered trademark of the American Medical Association." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who did john fox coach before the bears?", "passages": [ [ "John Fox (American football)", "John Fox (American football)\n\nJohn Fox (born February 8, 1955) is a former American football coach and player.", "He was the head coach of the Carolina Panthers, Denver Broncos and Chicago Bears of the National Football League (NFL).", "He coached the Panthers to a NFC Championship and the Broncos to an AFC Championship.", "Fox played football at Castle Park High School in Chula Vista, California under local celebrated coaches Gil Warren and Reldon \"Bing\" Dawson, and Southwestern College also in Chula Vista from 1974\u20131975, before going to San Diego State, where he played defensive back with future NFL player and head coach Herman Edwards.", "Fox received a bachelor's degree in physical education and earned teaching credentials from San Diego State.", "He then proceeded to the NFL as a free agent and signed a two-year contract with the Tampa Bay Buccaneers.", "After that contract was over he retired from the NFL.", "Fox was defensive backs coach at U.S. International University.", "Sid Gillman, past head coach of the San Diego Chargers, was the athletic director at the time.", "In 1980, Fox was the defensive backs coach for the Boise State University Broncos when they won the NCAA Division I-AA Football Championship.", "In 1983, Fox was a member of Mike Gottfried's University of Kansas staff, as the secondary coach." ], [ "John Fox (American football)", "Fox followed Gottfried to the University of Pittsburgh when Gottfried became Head Coach at Pitt in 1986.", "Fox was first the Defensive Backs coach and then was promoted to Defensive Coordinator by Gottfried.", "While at Pitt, Fox made some contacts with Pittsburgh Steeler coaches and when Gottfried was let go by Pitt, Fox got his first NFL coaching gig with the Steelers.", "Fox began his first professional football coaching stint in the short-lived United States Football League with the Los Angeles Express in 1985.", "He entered the NFL in 1989 as the secondary coach of the Pittsburgh Steelers, later also holding this job with the San Diego Chargers.", "Fox was the defensive coordinator for the Los Angeles Raiders and later that of the New York Giants during Super Bowl XXXV, which they lost.", "In 2002, Fox was signed as the third head coach of the Carolina Panthers, whose previous coach George Seifert had led the team to a disastrous 1-15 record in 2001.", "Fox's first regular season game was a 10\u20137 victory over the Baltimore Ravens which ended the Panthers' 15-game losing streak dating to the previous season.", "Fox and the Panthers posted a 7\u20139 record for the 2002 season (his first with the team), demonstrating a drastic improvement over the previous season." ], [ "John Fox (American football)", "On January 16, 2015, Fox accepted a four-year deal to become head coach of the Chicago Bears.", "Fox led the Bears to a 6\u201310 record in his first season, only the second time in his career where he had double-digit losses.", "However, Fox finished his second season with the Bears with a 3\u201313 record, tied for the worst record for the Bears since the NFL changed to a 16-game season.", "After a 1\u20133 start in 2017, Fox benched quarterback Mike Glennon in favor of rookie Mitchell Trubisky in Week 5.", "With Trubisky, the Bears finished the season 5\u201311, and Fox was fired at the season's end.", "His overall record with the Bears was 14\u201334, the second-lowest win percentage in franchise history, as the team failed to record a winning streak longer than two games and finished last in the NFC North in all three seasons.", "\"Thank you to all the players, coaches, the city of Chicago and Bears fans everywhere, your passion for the game and this team is unmatched in the NFL,\" Fox stated in a team release.", "\"Today is the tough part of our results-oriented business but I wish the Bears organization the best for years to come.\"" ] ], "gold": "John Fox began his NFL coaching career in 1989 as the secondary coach for the Pittsburgh Steelers and, later, the San Diego Chargers, He was next hired as the defensive coordinator for the Los Angeles Raiders and the New York Giants, before taking his first head coaching job with the Carolina Panthers from 2002. Fox left the Panthers in 2010 for the Denver Broncos, where he coached the team to the playoffs every year until joining the Chicago Bears in 2015.", "prediction 1": "John Fox was the head coach of the Carolina Panthers, Denver Broncos and Chicago Bears of the National Football League. He coached the Panthers to a NFC Championship and the Broncos to an AFC Championship. Fox began his first professional football coaching stint in the short-lived United States Football League with the Los Angeles Express in 1985. He entered the NFL in 1989 as the secondary coach of the Pittsburgh Steelers, later also holding this job with the San Diego Chargers. Fox was the defensive coordinator for the Los Angeles Raiders and later that of the New York Giants during Super Bowl XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX", "prediction 2": "John Fox is a former American football coach and player who has coached the Carolina Panthers, the Denver Broncos, and the Chicago Bears in the National Football League. He played for the Panthers from 1976 to 1986 and for the Broncos from 1988 to 1993. On January 16, 2015, Fox accepted a four-year deal to become head coach of the Chicago Bears. Fox led the Bears to a 6\u201310 record in his first season, only the second time in his career where he had double-digit losses. However, his second season was a 3\u201313 record, tied for the worst record for the Bears since the NFL changed to a 16-game season, tied for the worst record for the Bears since the NFL changed to a 16-game season.", "prediction 3": "John Fox is a former American football coach and player who was the head coach of the Carolina Panthers, Denver Broncos and Chicago Bears of the National Football League (NFL). He coached the Panthers to a NFC Championship and the Broncos to an AFC Championship. Fox was the defensive coordinator for the Los Angeles Raiders and New York Giants before becoming the head coach of the Chicago Bears in 2015.", "prediction 4": "John Fox is a former American football coach who is currently the head coach of the Carolina Panthers, Denver Broncos and Chicago Bears of the National Football League. Fox coached the Carolina Panthers to a NFC Championship and the Denver Broncos to an AFC Championship. He was a defensive backs coach at U.S. International University and a member of Mike Gottfried's University of Pittsburgh staff as the secondary coach. Fox joined the NFL in 1989 as the secondary coach of the Pittsburgh Steelers, later also holding this job with the San Diego Chargers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 349 }, { "error type": "Irrelevant", "explanation": "", "start": 585, "end": 671 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "John Fox was the head coach of the Carolina Panthers, Denver Broncos and Chicago Bears of the National Football League. He entered the NFL in 1989 as the secondary coach of the Pittsburgh Steelers, later also holding this job with the San Diego Chargers. Fox was the defensive coordinator for the Los Angeles Raiders and later that of the New York Giants. In 2002, Fox was signed as the third head coach of the Carolina Panthers. On January 16, 2015, Fox accepted to become head coach of the Chicago Bears." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When is fairy tail coming out in 2018?", "passages": [ [ "Fairy Tail", "On March 4, 2013, Mashima announced on his Twitter account that the anime would not end yet, and confirmed on July 11 that a sequel series was greenlit.", "The sequel series was officially confirmed in \"Weekly Shonen Magazine\" on December 28, 2013 with a special edition chapter.", "The sequel is produced by A-1 Pictures and Bridge, featuring character designs by Shinji Takeuchi; the original series' voice actors also returned to the project along with director Shinji Ishihira and writer Masashi Sogo.", "The official website for the sequel was launched on January 7, 2014.", "The series premiered on TV Tokyo on April 5, 2014, and was being simulcast by Funimation Entertainment.", "The second series concluded its run on March 26, 2016.", "On March 22, 2016, Mashima announced via Twitter that another \"Fairy Tail\" series was being developed.", "On July 20, 2017, Mashima confirmed on Twitter that the final season of \"Fairy Tail\" would air in 2018.", "The final season of \"Fairy Tail\" began airing on October 7, 2018.", "A-1 Pictures, CloverWorks, and Bridge have been confirmed to be producing and animating the final season, which is set to run for 51 episodes." ], [ "Fairy Tail", "Fairy Tail\n\nThe manga has been adapted into an anime series produced by A-1 Pictures, Dentsu Inc., Satelight, Bridge, and CloverWorks which began broadcasting in Japan on October 12, 2009.", "Additionally, A-1 Pictures has developed seven original video animations and two animated feature films.", "The series ended its initial run on March 30, 2013.", "A second series premiered on TV Tokyo on April 5, 2014, and ended on March 26, 2016.", "A third series of the anime series began airing on October 7, 2018, and is slated to have 51 episodes.", "The series has also inspired numerous spin-off manga, including a sequel storyboarded by Mashima, titled \"Fairy Tail 100 Years Quest\", which launched on July 25, 2018.", "The manga series was originally licensed for an English language release in North America by Del Rey Manga, which began releasing the individual volumes on March 25, 2008 and ended its licensing with the 12th volume release in September 2010.", "In December 2010, Kodansha USA took over North American release of the series.", "The Southeast Asian network Animax Asia aired an English-language version of the anime for seven seasons from 2010 to 2015.", "The manga was also licensed in the United Kingdom by Turnaround Publisher Services and in Australia by Penguin Books Australia.", "The anime has been licensed by Funimation for an English-language release in North America." ] ], "gold": "The third and final series of the anime Fairy Tail premiered on October 7, 2018, released simultaneously in Japan on TV Tokyo and in North America on Funimation. The series continued throughout the remainder of the year, from October 7, 2018-December 23, 2018, before concluding in September 2019.", "prediction 1": "Fairy Tail is a Japanese manga series created by Mashima Mashima, released in 2012. The manga series has been adapted into an anime series produced by A-1 Pictures, Dentsu Inc., Satelight, Bridge, and CloverWorks, which began broadcasting in Japan on October 12, 2009. The series premiered on TV Tokyo on April 5, 2014, and ended its run on March 26, 2016. A third series of the anime series began airing on October 7, 2018, and is slated to have 51 episodes.", "prediction 2": "The manga series Fairy Tail was originally licensed for an English language release in North America by Del Rey Manga, which began releasing the individual volumes on March 25, 2008 and ended its licensing with the 12th volume release in September 2010. In 2018, the anime series began airing on October 7, 2018.", "prediction 3": "The first two seasons of the manga series Fairy Tail began airing in Japan on March 30, 2013. A third series of the anime series began airing on October 7, 2018, and is slated to have 51 episodes.", "prediction 4": "The Japanese manga series Fairy Tail came out in Japan on March 4, 2013. An English-language anime adaptation of the manga was released in Japan in February 2015. A third season of the anime series began airing on October 7, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 65 }, { "error type": "Unverifiable", "explanation": "", "start": 66, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 268 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 459 } ], "missing-info": [], "corrected-prediction": "A third series of the anime series began airing on October 7, 2018. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the current managing director of nnpc?", "passages": [ [ "Nigerian National Petroleum Corporation", "Nigerian National Petroleum Corporation\n\nThe Nigerian National Petroleum Corporation (NNPC) is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry.", "NNPC was established on 1 April 1977 as a merger of the Nigerian National Oil Corporation and the Federal Ministry of Mines and Steel.", "NNPC by law manages the joint venture between the Nigerian federal government and a number of foreign multinational corporations, which include Royal Dutch Shell, Agip, ExxonMobil, Total S.A, Chevron, and Texaco (now merged with Chevron).", "Through collaboration with these companies, the Nigerian government conducts petroleum exploration and production.", "In 2007, the head of the Nigerian wing of Transparency International said salaries for NNPC workers were too low to prevent graft.", "The NNPC Towers in Abuja is the headquarters of NNPC.", "Consisting of four identical towers, the complex is located on Herbert Macaulay Way, Central Business District Abuja.", "NNPC also has zonal offices in Lagos, Kaduna, Port Harcourt and Warri.", "It has an international office located in London, United Kingdom.", "Dr. Maikanti Baru is the current Group managing director." ], [ "Emmanuel Ibe Kachikwu", "Emmanuel Ibe Kachikwu\n\nEmmanuel Ibe Kachikwu (born December 18, 1956) is the Minister of State, Petroleum Resources and the immediate past Group Managing Director, Nigerian National Petroleum Corporation married to Elizabeth Kachikwu.", "Kachikwu is a graduate of Law from the University of Nigeria, Nsukka and Nigerian Law School.", "He thereafter obtained a Masters and Doctorate Degree in Law from Harvard University, with distinctions.", "He also has a Higher Diploma .T.L", "(H.DIP.T.L) from Georgetown University, USA.", "Kachikwu is married to Elizabeth Kachikwu.", "He was appointed as the Nigerian National Petroleum Corporation Chief Executive to wide public acclaim in August, 2015 under the presidency of Muhammadu Buhari.", "On November 11, 2015, Kachikwu was named the Minister of State, Petroleum Resources by the President.", "He was named as the Chairman of the Board of the Nigerian National Petroleum Corporation, as provided for under Section 1(2) of the Nigerian National Petroleum Corporation Act of 1997, as amended on 4th of July, 2016.", "He was removed as the GMD of the NNPC by President Muhammadu Buhari and replaced with Dr. Maikanti K. Baru on 4th of July, 2016." ] ], "gold": "The Nigerian National Petroleum Corporation is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry. Joseph Thlama Dawha was appointed as the managing director of Nigerian National Petroleum Corporation by president Goodluck Jonathan serving from August 2014 to 1 August 2015. This made him the 16th managing director. The 17th managing director, politician and engineer, Dr. Emmanuel Ibe Kachikwu was appointed as in August 2015 under the presidency of Muhammadu Buhari. The 18th group manager was Maikanti Kachalla Baru who served from July 2016 to July 2019.", "prediction 1": "The Nigerian National Petroleum Corporation is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry. Dr. Maikanti Baru is the current Group managing director of NNPC. Emmanuel Ibe Kachikwu, who was the immediate past GMD, was removed as the GMD by President Muhammadu Buhari and replaced by Dr. Maikanti K. Baru on 4th of July, 2016.", "prediction 2": "The Nigerian National Petroleum Corporation (NNPC) is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry. Emmanuel Ibe Kachikwu is the Minister of State, Petroleum Resources and the immediate past Group Managing Director, Nigerian National Petroleum Corporation married to Elizabeth Kachikwu. Dr. Maikanti Baru is the current Group managing director.", "prediction 3": "The Nigerian National Petroleum Corporation (NNPC) is the oil corporation through which the Federal Government of Nigeria regulates and participates in the country's petroleum industry. Emmanuel Ibe Kachikwu is the Minister of State, Petroleum Resources and the immediate past Group Managing Director of the Nigerian National Petroleum Corporation. Dr. Maikanti Baru is the current Group managing director of the NNPC.", "prediction 4": "The Nigerian National Petroleum Corporation (NNPC) is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry. Dr. Maikanti Baru is the current Group managing director of the NNPC. Before Baru, Emmanuel Ibe Kachikwu was the GMD of the NNPC.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Nigerian National Petroleum Corporation is the oil corporation through which the federal government of Nigeria regulates and participates in the country's petroleum industry. Dr. Maikanti Baru is the current Group managing director of NNPC. Emmanuel Ibe Kachikwu, who was the immediate past GMD, was removed as the GMD by President Muhammadu Buhari and replaced by Dr. Maikanti K. Baru on 4th of July, 2016." }, "preference": [ 1, 0, 0, 2, 2, 1 ] }, { "question": "Who nominates the chairman of the public accounts committee of the indian parliament?", "passages": [ [ "Public Accounts Committee (India)", "At present, the 16th Lok Sabha has no designated leader of opposition, however the Indian National Congress (INC) being largest opposition party has gotten the responsibility of heading the PAC.", "The current PAC is headed by Mallikarjun Kharge, who is leader of INC in the Lok Sabha.", "He was re-appointed to a second term in May 2018.", "The committee was first conceived in the year 1921 in the wake of Montagu-Chelmsford Reforms.", "During the initial days of British colonial government in India, the finance member of the executive council was the chairperson of the committee.", "Post independence, till 1950 the chairperson of the committee was the finance minister.", "However, in 1950, the country became republic and the committee became a parliamentary committee functioning under the control of the Speaker of Lok Sabha with a non-official chairperson.", "From 1950 to 1967, the chairperson was selected from the ruling party.", "Since 1967, the chairperson of the committee is selected from the opposition, usually the leader of opposition.", "Prior to the year 1954\u201355, the committee consisted of 15 members who were elected by Lok Sabha from amongst its members.", "But with effect from the year 1954\u201355, 7 members from the Rajya Sabha have also been elected to the committee." ], [ "Public Accounts Committee (India)", "Public Accounts Committee (India)\n\n", "The Public Accounts Committee (PAC) is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the Government of India.", "The check that parliament exercises over the executive stems from the basic principle that parliament embodies the will of the people.", "This committee along with the Estimates committee (EC) and Committee on Public Undertakings (COPU) are the three financial standing committees of the Parliament of India.", "It serves as a check on the government especially with respect to its expenditure bill and its primary function is to examine the audit report of Comptroller and Auditor General (C&AG) after it is laid in the Parliament.", "C&AG assists the committee during the course of investigation.", "None of the its members are allowed to be ministers in the government.", "The Public Accounts Committee consists of not more than twenty-two members, fifteen elected by Lok Sabha, the lower house of the Parliament, and not more than seven members of Rajya Sabha, the upper house of the Parliament.", "The members are elected every year from amongst its members of respective houses according to the principle of proportional representation by means of single transferable vote.", "The chairperson is appointed by the Lok Sabha speaker.", "The term of office of the members is one year." ] ], "gold": "The Public Accounts Committee (PAC) is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the Government of India. This committee along with the Estimates committee (EC) and Committee on Public Undertakings (COPU) are the three financial standing committees of the Parliament of India. Before 1950 the chairman of the committee was the finance minister. From 1950 to 1967, the chairperson was selected from the ruling party. Since 1967, the chairperson of the committee is selected from the opposition, usually the leader of opposition. ", "prediction 1": "The Public Accounts Committee is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the government of India. The Public Accounts Committee (PAC) is a committee of members of the Lok Sabha, the lower house of the Parliament, where members are elected every year from amongst their members according to the principle of proportional representation by means of single transferable vote. The chairman is appointed by the Lok Sabha speaker. The term of office of the members is one year.", "prediction 2": "The Public Accounts Committee (PAC) of the Indian Parliament is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the Government of India. The committee was first conceived in the year 1921 in the wake of Montagu-Chelmsford Reforms. During the initial days of British colonial government in India, the finance member of the executive council was the chairperson of the committee. However, in 1950, the country became republic and the committee became a parliamentary committee, with a non-official chairperson. From 1950 to 1967, the chairperson was selected from the ruling party. From 1967, the chairperson of the committee is selected from the opposition, usually the leader of opposition.", "prediction 3": "The Public Accounts Committee of the Indian parliament is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the Government of India. The current PAC is headed by Mallikarjun Kharge, who is leader of INC in the Lok Sabha. The current PAC is headed by Mallikarjun Kapoor, who is the leader of INC in the Lok Sabha and was re-appointed to a second term in May 2018.", "prediction 4": "The Public Accounts Committee (PAC) is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the Government of India. During the initial days of British colonial government in India, the finance member of the executive council was the chairperson of the committee. However, post independence, till 1950, the chairperson of the committee was the finance minister. In 1950, the committee became a parliamentary committee functioning under the control of the Speaker of Lok Sabha with a non-official chairperson. Since 1967, the chairperson of the committee is selected from the opposition, usually the leader of opposition. In 2005, the current PAC is headed by Mallikarjun Kharge, the leader of INC.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 482 }, { "error type": "Irrelevant", "explanation": "", "start": 483, "end": 534 }, { "error type": "Irrelevant", "explanation": "", "start": 535, "end": 581 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Public Accounts Committee is a committee of selected members of parliament, constituted by the Parliament of India, for the purpose of auditing the revenue and the expenditure of the government of India. This committee along with the Estimates committee (EC) and Committee on Public Undertakings (COPU) are the three financial standing committees of the Parliament of India. From 1950 to 1967, the chairperson was selected from the ruling party. Since 1967, the chairperson of the committee is selected from the opposition, usually the leader of opposition." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where does the winner of america's got talent perform?", "passages": [ [ "Got Talent", "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016.", "From season 12 (2017), the new host of AGT is Tyra Banks.", "The grand prize for the winner(s) is US$1 million, and, since season 3, a chance to headline a show on the Las Vegas Strip.", "\"America's Got Talent\" proved extremely successful for NBC, pulling in high ratings in both total viewers and the younger 18-49 demographic.", "The show's initial success in America is credited with the eventual launch of the British series, and the overall global launch of the \"Got Talent\" franchise.", "ITV eventually debuted \"Britain's Got Talent\" on 9 June 2007 with Cowell, Morgan and Amanda Holden as judges, and Ant & Dec as hosts of the show.", "For series 5, Morgan stepped down due to commitments hosting \"Piers Morgan Tonight\" on CNN, and Cowell only attended the live shows as he was busy launching \"The X Factor USA\", so Michael McIntyre and David Hasselhoff joined the panel with Holden." ], [ "Variety show", "Another popular variety show in Taiwan is Kangxi Lai Le, a talk show with variety show elements.", "The hosts and guests were associated with variety shows.", "Famous for its bantering, which was written before tapings.", "The first Chinese variety show to become a major success was Hong Kong's \"Enjoy Yourself Tonight\", which first aired in 1967 and ran for 27 years.", "In Hong Kong, variety shows are often combined with elements of a cooking show or a talent competition but end in various results.", "Variety programming has remained one of the dominant genres of television programming.", "While Japanese variety shows are famous abroad for their wild stunts, they vary from talk shows to music shows, from tabloid news shows to skit comedy.", "The prominent use of telop on screen has created a style that has influenced variety programming across Asia.", "One of the most popular variety shows in Japan includes \"Downtown no Gaki No Tsukai\".", "In South Korea, the hugely popular show \"Infinite Challenge\", has been broadcast by MBC from 2005 to 2018, was a new model of this, called \"Real Variety Show\".", "It combined comedy and variety scenes including unscripted stunts.", "Although many variety shows have existed in Korea long before the broadcast of \"Infinite Challenge\", this program has given a rise to a new page in the history of Korean variety shows by introducing unscripted stunts." ], [ "Terry Fator", "Terry Fator\n\nTerry Wayne Fator (; born June 10, 1965) is a ventriloquist, impressionist, comedian, and singer from Dallas, Texas.", "Fator does ventriloquial impersonations, and uses 15 different puppets in his act.", "He was the winner of season two of \"America's Got Talent\", and received the million dollar prize.", "The following year, he was signed on as the headliner at The Mirage hotel and casino in Las Vegas, Nevada with a five-year, $100 million contract.", "Terry Wayne Fator was born June 10, 1965, in Dallas, Texas, the son of Jephtha Wesley and Edith Marie Clifton, later known as Marie Sligh.", "He has an older brother, Jephtha Jr., and a younger sister, Deborah.", "Fator's second cousin is Chris Sligh, an \"American Idol\" season six finalist.", "Terry Fator says in his audio commentary of \"Terry Fator: Live from Las Vegas (2009)\" that he went to college at Liberty University in Lynchburg, Virginia.", "The beginning of Fator's ventriloquism career dates back to when he was in fifth grade." ] ], "gold": "America's Got Talent is a televised American talent show competition, that attracts a variety of participants, from across the United States and abroad, to take part in and compete with some form of talent, with acts ranging from singing, dancing, comedy, magic, stunts, variety, and other genres. For example, in 2015 the winner won with their comedy and ventriloquism performance, in 2016 the winning performance was singing and songwriting, and in 2017 another ventriloquism act won. ", "prediction 1": "The winner of America's Got Talent performs on a variety show. The show's initial success in America is credited with the eventual launch of the British series, and the overall global launch of the Got Talent franchise. The winner of season 2 of America's Got Talent performs on The Mirage hotel and casino in Las Vegas.", "prediction 2": "The winner(s) of America's Got Talent perform on various variety shows around the world. In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, Simon Cowell, and Nick Cannon. The grand prize for the winner(s) is US$1 million, and, since season 3, a chance to headline a show on the Las Vegas Strip.", "prediction 3": "The winner of America's Got Talent performs on the Las Vegas Strip. The winner of season 2 of America's Got Talent performs at The Mirage hotel and casino in Las Vegas, Nevada. The winner of season 3 performs at The MGM Grand in Orlando, Florida.", "prediction 4": "The winner of America's Got Talent performs in various shows, including a variety show in Las Vegas, a music show on the East Coast, a comedy show on the West Coast, and a variety show in Taiwan. The winner of America's Got Talent performs at the Hard Rock Hotel and Casino in Atlanta, Georgia, where he receives the $1 million prize.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 219 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The winner of America's Got Talent performs on a variety show. Since season 3 the winner wins a chance to headline a show on the Las Vegas Strip. The winner of season 2 of America's Got Talent performs on The Mirage hotel and casino in Las Vegas." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Backwards compatible xbox one games call of duty?", "passages": [ [ "Xbox One", "Since June 2017, games may be promoted with additional icons that denote compatibility with hardware enhancements found in newer Xbox One models, including support for high-dynamic-range (HDR) colors (on Xbox One S and Xbox One X), native rendering at 4K resolution (Xbox One X), and specific optimizations for Xbox One X. At its launch, the Xbox One did not have native backward compatibility with original Xbox or Xbox 360 games.", "It had been a desired launch feature by Microsoft and had been actively under developed as early as 2007 under the \"Trioxide\" program as to get Xbox 360 code to run on 64-bit hardware.", "Rather than going the route of the initial PlayStation 3 which included a core PlayStation 2 system-on-a-chip processor, the Xbox One hardware was designed to include support for Xbox 360 XMA and texture processing on hardware, knowing this would be difficult to replicate in software.", "Following criticism of its plan for an \"always on\" console from the May 2013 announcement, Microsoft had to put significant effort to prepare the Xbox One software for a revised approach, and the backwards compatibility development work were put on hold.", "Interim solutions were suggested: senior project management and planning director Albert Penello explained that Microsoft was initially considering a cloud gaming platform to enable backward compatibility, but he felt it would be \"problematic\" due to varying internet connection qualities." ], [ "Call of Duty", "The game is set in the European theatre, and is centered around a squad in the 1st Infantry Division, following their battles on the Western Front, and set mainly in the historical events of Operation Overlord.\n\n", "\"\" is the fourth installment of the main series, and was developed by Infinity Ward.", "It is the first game in the series not to be set during World War II, but set in the modern day.", "The game was released for Microsoft Windows, Nintendo DS, PlayStation 3, and Xbox 360 on November 7, 2007.", "Download and retail versions for Mac OS X were released by Aspyr in September 2008.", "As of May 2009, \"Call of Duty 4: Modern Warfare\" has sold over 13 million copies.", "\"Call of Duty: Modern Warfare Remastered\" is a remastered version of \"\" that was released alongside the Legacy Edition, Legacy Pro Edition and Digital Deluxe Edition of \"\" on November 4, 2016, for PlayStation 4, Xbox One, and PC.", "It was later released standalone on June 27, 2017, for PS4, and July 27, 2017, for Xbox One and PC.", "The game was developed by Raven Software and executive produced by Infinity Ward.\n\n", "\"\" is the sixth installment of the main series.", "It was developed by Infinity Ward and published by Activision.", "Activision Blizzard announced \"Modern Warfare 2\" on February 11, 2009." ] ], "gold": "Backwards compatible Call of Duty games for Xbox One as of 2020 are Advanced Warfare, Black Ops\tActivision, Black Ops II, Ghosts, Modern Warfare 2, Modern Warfare 3, World at War, Call of Duty 2, Call of Duty 3, Call of Duty 4: Modern Warfare.", "prediction 1": "Call of Duty games are compatible with the Xbox One. At the time of release, the Xbox One did not have native backward compatibility with original Xbox or Xbox 360 games. It had been a desired launch feature by Microsoft and had been actively under developed as early as 2007 under the Trioxide program as to get Xbox 360 code to run on 64-bit hardware. Microsoft had to put significant effort to prepare the Xbox One software for a revised approach, and the backwards compatibility development work were put on hold.", "prediction 2": "The Call of Duty series of video games has been in development for years. At launch, the Xbox One did not have native backward compatibility with original Xbox or Xbox 360 games. At its launch, Microsoft had put significant effort to prepare the Xbox One software for a revised approach, and the backwards compatibility development work were put on hold.", "prediction 3": "There are several Xbox One games called Call of Duty. The original Call of Duty game did not have backward compatibility, and the remastered version was released alongside the Legacy Edition, Legacy Pro Edition and Digital Deluxe Edition of the original game. Call of Duty 4: Modern Warfare and Call of Duty: Modern Warfare Remastered were the only two backwards compatible games for the Xbox One.", "prediction 4": "At its launch, the Xbox One did not have native backward compatibility with original Xbox or Xbox 360 games. It had been a desired launch feature by Microsoft and had been actively under developed as early as 2007 under the \"Trioxide\" program as to get Xbox 360 code to run on 64-bit hardware. Microsoft had to put significant effort to prepare the Xbox One software for a revised approach, and the backwards compatibility development work were put on hold.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 52 }, { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 517 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who won the first battle of the marne?", "passages": [ [ "First Battle of the Marne", "First Battle of the Marne\n\nThe Battle of the Marne (, also known as the Miracle of the Marne, \"Le Miracle de la Marne\") was a World War I battle fought from It resulted in an Allied victory against the German armies in the west.", "The battle was the culmination of the German advance into France and pursuit of the Allied armies which followed the Battle of the Frontiers in August and had reached the eastern outskirts of Paris.", "A counter-attack by six French armies and the British Expeditionary Force (BEF) along the Marne River forced the Imperial German Army to retreat northwest, leading to the First Battle of the Aisne and the Race to the Sea.", "The battle was a victory for the Allied Powers but led to four years of trench warfare stalemate on the Western Front.", "The battle of the Marne was a major turning point of World War I. By the end of August 1914, the whole Allied army on the Western Front had been forced into a general retreat back towards Paris.", "Meanwhile, the two main German armies continued through France.", "It seemed that Paris would be taken as both the French and the British fell back towards the Marne River.", "The war became a stalemate when the Allied Powers won the Battle of the Marne.", "It was the first major clash on the Western Front and one of the most important events in the war." ], [ "First Battle of the Marne", "That evening, the troops at Namur withdrew into French-held territory and at Dinant, 674 men, women and children were summarily executed by Saxon troops of the German 3rd Army; the first of several civilian massacres committed by the Germans in 1914.", "At the Battle of Mons (23 August), the BEF attempted to hold the line of the Mons\u2013Cond\u00e9 Canal against the advancing German 1st Army.", "The British were eventually forced to withdraw due to being outnumbered by the Germans and the sudden retreat of the French Fifth Army, which exposed the British right flank.", "Though planned as a simple tactical withdrawal and executed in good order, the British retreat from Mons lasted for two weeks, and covered .", "During the retreat, BEF commander Sir John French began to make contingency plans for a full retreat to the ports on the English Channel followed by an immediate British evacuation.", "On 1 September Lord Kitchener, the British Secretary of State for War, met with French (and French Prime Minister Viviani and War Minister Millerand), and ordered him not to withdraw to the Channel.", "The BEF retreated to the outskirts of Paris, before it counter-attacked in concert with the French, in the Battle of the Marne.", "The French First and Second Armies had been pushed back, by attacks of the German 7th and 6th Armies between St. Di\u00e9 and Nancy." ] ], "gold": "The United Kingdom and France won the first battle of the marne under the leadership of Fernand de Langle de Cary, Joseph Joffre, Joseph Gallieni, John French, Michel-Joseph Maunoury, Ferdinand Foch, Louis Franchet d'Esp\u00e8rey, and Maurice Sarrail.", "prediction 1": "The First Battle of the Marne was a World War I battle fought from France. It resulted in an Allied victory against the German armies in the west. The battle was the culmination of the German advance into France and pursuit of the Allied armies which followed the Battle of the Frontiers in August and had reached the eastern outskirts of Paris. A counter-attack by six French armies and the British Expeditionary Force (BEF) along the Marne River forced the Imperial German Army to retreat northwest, leading to the First Battle of the Aisne and the Race to the Sea. The battle was a victory for the Allied Powers but led to four years of trench warfare stalemate on the Western Front.\n", "prediction 2": "The First Battle of the Marne, also known as the Miracle of the Marne, was a World War I battle fought from March 16 to April 18, 1914 between the Allies and the Germans. The battle resulted in an Allied victory against the German armies in the west. The battle was the culmination of the German advance into France and pursuit of the Allied armies which followed the Battle of the Frontiers in August and had reached the eastern outskirts of Paris. A counter-attack by six French armies and the British Expeditionary Force (BEF) along the Marne River forced the Imperial German army to retreat northwest, leading to the First Battle of the Aisne and the Race to the Sea. The battle was won by the Allied Powers but led to four years of trench warfare stalemate on the Western Front.", "prediction 3": "The Battle of the Marne was a World War I battle fought from The Marne River and was led by six French armies and the British Expeditionary Force (BEF) along the Marne River. The battle was the culmination of the German advance into France and pursuit of the Allied armies which followed the Battle of the Frontiers in August and had reached the eastern outskirts of Paris. A counter-attack by six French armies and the BEF along the Marne River forced the Imperial German Army to retreat northwest, leading to the First Battle of the Aisne and the Race to the Sea. The battle was a victory for the Allied Powers but led to four years of trench warfare stalemate on the Western Front.", "prediction 4": "The First Battle of the Marne was a World War I battle fought from France between August 27, 1914, and September 1, 1914. It resulted in an Allied victory against the German armies in the west. The battle was the culmination of the German advance into France and pursuit of the Allied armies which followed the Battle of the Frontiers in August and had reached the eastern outskirts of Paris. A counter-attack by six French armies and the British Expeditionary Force (BEF) along the Marne River forced the Imperial German Army to retreat Northwest, leading to the First Battle of the Aisne and the Race to the Sea. The battle was a victory for the Allied Powers but led to four years of trench warfare stalemate on the Western Front.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 345 }, { "error type": "Irrelevant", "explanation": "", "start": 502, "end": 567 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The First Battle of the Marne resulted in an Allied victory against the German armies in the west. A counter-attack by six French armies and the British Expeditionary Force (BEF) along the Marne River forced the Imperial German Army to retreat northwest. The battle was a victory for the Allied Powers but led to four years of trench warfare stalemate on the Western Front. BEF commander Sir John French was one of the leaders in the battle." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was the first income tax law enacted?", "passages": [ [ "History of taxation in the United States", "The courts have generally held that direct taxes are limited to taxes on people (variously called \"capitation\", \"poll tax\" or \"head tax\") and property.", "All other taxes are commonly referred to as \"indirect taxes\".", "In order to help pay for its war effort in the American Civil War, Congress imposed its first personal income tax in 1861.", "It was part of the Revenue Act of 1861 (3% of all incomes over US $800; rescinded in 1872).", "Congress also enacted the Revenue Act of 1862, which levied a 3% tax on incomes above $600, rising to 5% for incomes above $10,000.", "Rates were raised in 1864.", "This income tax was repealed in 1872.", "A new income tax statute was enacted as part of the 1894 Tariff Act.", "At that time, the United States Constitution specified that Congress could impose a \"direct\" tax only if the law apportioned that tax among the states according to each state's census population.", "In 1895, the United States Supreme Court ruled, in \"Pollock v. Farmers' Loan & Trust Co.,\" that taxes on rents from real estate, on interest income from personal property and other income from personal property (which includes dividend income) were direct taxes on property and therefore had to be apportioned." ], [ "History of taxation in the United States", "Excise taxes are often, but not always, allocated to special funds related to the object or activity taxed.", "During the presidency of George Washington, Alexander Hamilton proposed a tax on distilled spirits to fund his policy of assuming the war debt of the American Revolution for those states which had failed to pay.", "After a vigorous debate, the House decided by a vote of 35-21 to approve legislation imposing a seven-cent-per-gallon excise tax on whiskey.", "This marks the first time in American history that Congress voted to tax an American product; this led to the Whiskey Rebellion.", "The history of income taxation in the United States began in the 19th century with the imposition of income taxes to fund war efforts.", "However, the constitutionality of income taxation was widely held in doubt [Pollock v. Farmers' Loan & Trust Company, 157 U.S. 429 (1895)] \" until 1913 with the ratification of the 16th Amendment.", "Article I, Section 8, Clause 1 of the United States Constitution assigns Congress the power to impose \"Taxes, Duties, Imposts and Excises,\" but Article I, Section 8 requires that, \"Duties, Imposts and Excises shall be uniform throughout the United States.\"" ], [ "Sixteenth Amendment to the United States Constitution", "Sixteenth Amendment to the United States Constitution\n\nThe Sixteenth Amendment (Amendment XVI) to the United States Constitution allows Congress to levy an income tax without apportioning it among the states on the basis of population.", "It was passed by Congress in 1909 in response to the 1895 Supreme Court case of \"Pollock v. Farmers' Loan & Trust Co.\"", "The Sixteenth Amendment was ratified by the requisite number of states on February 3, 1913, and effectively overruled the Supreme Court's ruling in \"Pollock\".", "Prior to the early 20th century, most federal revenue came from tariffs rather than taxes, although Congress had often imposed excise taxes on various goods.", "The Revenue Act of 1861 had introduced the first federal income tax, but that tax was repealed in 1872.", "During the late nineteenth century, various groups, including the Populist Party, favored the establishment of a progressive income tax at the federal level.", "These groups believed that tariffs unfairly taxed the poor, and they favored using the income tax to shift the tax burden onto wealthier individuals." ] ], "gold": "In 1861 the first income tax was imposed in the United States as part of the Revenue Act and was intended to help pay for the war effort in the American Civil War. However, the constitutionality of income taxation was widely held in doubt until the first income amendment was passed on February 3, 1913 with the 16th Amendment.", "prediction 1": "In order to help pay for its war effort in the American Civil War, Congress imposed its first personal income tax in 1861. It was part of the Revenue Act of 1861, the first federal income tax law. A new income tax statute was enacted as part of the 1894 Tariff Act, and it was passed by Congress on February 3, 1894.", "prediction 2": "The first federal income tax law in the United States was enacted in 1861. It was part of the Revenue Act of 1861. The Revenue Act of 1862 also imposed a tax on incomes above $600, rising to 5% for incomes above $10,000 and rates were raised in 1864. This income tax was repealed in 1872. A new income tax statute was enacted as part of the 1894 Tariff Act, which was enacted in response to the 1895 Supreme Court ruling in Polok v. Farmers' Loan & Trust Co.", "prediction 3": "The first federal income tax law in the United States was enacted in 1861 as part of the Revenue Act of 1861. The Revenue Act of 1862 was also enacted in 1861, but was repealed in 1872. In 1894, however, a new income tax statute was enacted as part of the Tariff Act. The Sixteenth Amendment to the United States Constitution allows Congress to levy an income tax without apportioning it among the states on the basis of population.", "prediction 4": "In order to help pay for its war effort in the American Civil War, Congress imposed its first personal income tax in 1861 as part of the Revenue Act of 1861. In 1862, Congress enacted the Revenue Act of 1862, which levied a 3% tax on incomes above $600, rising to 5% for incomes above $10,000. Rates were raised in 1864. In 1894, a new income tax statute was enacted as part of the 1894 Tariff Act. The history of income taxation in the United States began in the 19th century with the imposition of income taxes to fund war efforts. However, the constitutionality of income taxation was widely held in doubt.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 196 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "In order to help pay for its war effort in the American Civil War, Congress imposed its first personal income tax in 1861, as part of the Revenue Act. However, the constitutionality of income taxation was widely held in doubt until February 3 1913 with the ratification of the 16th Amendment." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who does lady gaga play in american horror story?", "passages": [ [ "American Horror Story", "He has become estranged from his wife Alex (Chloe Sevigny), who suffers from depression, and his daughter Scarlett (Shree Crooks), after the disappearance of their son Holden (Lennon Henry) five years earlier.", "As the season unfolds, the Lowes discover that the disappearance of Holden may be related to the strange activities at the hotel, led by March's fashionista widow Elizabeth Johnson (Lady Gaga), also known as the Countess\u2014who was turned into a vampire by her former lovers, actor Rudolph Valentino (Finn Wittrock) and his wife Natacha Rambova (Alexandra Daddario)\u2014and her current lover Donovan (Matt Bomer).", "Throughout his investigation, John also becomes entangled with the spirits of heroin junkie named Sally (Sarah Paulson), hotel maid Hazel Evers (Mare Winningham), and James March, who is looking for a protege to continue the violent acts he started when he was alive.", "The hotel's tireless staff includes the surly front desk manager Iris (Kathy Bates), Donovan's mother who took the job to be close to her son, and her best friend, the transgender bartender Liz Taylor (Denis O'Hare), both of whom hesitantly cater to Elizabeth and her vampiric children." ], [ "American Horror Story", "Elizabeth's relationship with Donovan becomes troubled with the arrival of male model and cocaine addict Tristan Duffy (Finn Wittrock), New York fashion designer Will Drake (Cheyenne Jackson), and her scorned ex-lover Ramona Royale (Angela Bassett), all of whom become entangled in her violent life.", "Set in the years 2014-2016, the season follows the supernatural events that occur in a renovated farmhouse in North Carolina, which is situated on the land where the Roanoke Colony moved after their infamous 1580s disappearance.", "In 2015, Shelby Miller (Lily Rabe), her husband Matt (Andr\u00e9 Holland), along with Matt's sister Lee Harris (Adina Porter) recount their harrowing experience living in the farmhouse a year prior in a popular documentary series titled \"My Roanoke Nightmare\", including their encounters with the ghosts of the house's previous residents, the violent ghosts of the Roanoke Colony, the cannibalistic Polk family who live nearby, and the beautiful, yet terrifying Celtic goddess, Sc\u00e1thach (Lady Gaga)." ] ], "gold": "Lady Gaga plays the role of The Countess in American Horror Story: Hotel. In American Horror Story: Roanoke, Lady Gaga plays the character Sc\u00e1thach.", "prediction 1": "Lady Gaga plays Elizabeth Johnson, the fashionista widow of March, in American Horror Story. She was turned into a vampire by her former lovers, actor Rudolph Valentino and his wife Natacha Rambova, and her current lover Donovan.", "prediction 2": "Lady Gaga plays Elizabeth Johnson, the fashionista widow of March who was turned into a vampire by her former lovers, Rudolph Valentino and Natacha Rambova.", "prediction 3": "Lady Gaga plays Elizabeth Johnson in American Horror Story. She is the fashionista widow Elizabeth Johnson, who was turned into a vampire by her former lovers, actor Rudolph Valentino (Finn Wittrock) and his wife Natacha Rambova (Alexandra Daddario).", "prediction 4": "Lady Gaga plays Elizabeth Johnson, the fashionista widow of March, in the television series American Horror Story. Lady Gaga plays Sc\u00e1thach, the Celtic goddess who turned Elizabeth into a vampire by her former lovers, actors Rudolph Valentino and Ninn Wittrock, and Natacha Rambova and her husband Alexandra Daddario.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 229 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lady Gaga plays Elizabeth Johnson, also known as Countess, the fashionista widow of March, in American Horror Story. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the snowman's name in frozen?", "passages": [ [ "Olaf (Frozen)", "And so when Elsa is singing \u201cLet It Go\u201d obviously the first thing she goes to is the last moment she was happy.", "And it was that moment.", "And so he\u2019s imbued with that.", "He\u2019s innocent love.\"", "The continuous themes that can be seen throughout the movie revolve around the power of love and fear.", "Olaf, on one end of that spectrum, represents the most innocent kind form of love.", "It is possible that he resembles some of the characteristics of Anna's younger self.", "This provides a connection between the sisters' happy past and their ability to remember that love in difficult times.", "Overall his character provides much of the comic relief found in the film, while conveying lovable innocence and purity.", "\"And so he was just a lot of fun, and emotionally he\u2019ll bring a lot that we weren\u2019t able to show you yet, too.", "So he\u2019s funny in the kids-state-the-obvious kind of way.\"", "(Lee) \"And he can say very poignant things too.\"", "(Buck)\n\n", "In very early versions of the film, Olaf was originally written as one of the guards at Elsa's castle when the concept of Elsa controlling a legion of menacing snowmen was still in the story.", "Buck talked on this scrapped character setting, \"We always talked about she was trying to learn about her powers." ], [ "Olaf (Frozen)", "This version was \"completely different\" from \"Frozen\"; it had a storyline that stuck much closer to the original material and featured an entirely different Olaf character, the role more resembling Marshmallow's.", "However, by early 2010, the project was scrapped again.", "On December 22, 2011, Disney announced a new title for the film, \"Frozen\", which would be released on November 27, 2013, and a different crew from the previous attempt.", "The new script, which employed \"the same concept but was completely rewritten\", finally solved the long-term problem with Andersen's story by depicting Anna and Elsa as sisters.", "Josh Gad, a Tony-nominated actor best known for his performance as Elder Cunningham in Broadway's \"The Book of Mormon\" (which was co-written by the film's co-songwriter Robert Lopez ), was cast to voice Olaf.", "Gad later expressed that getting a part in a Disney film was \"kind of a dream come true\" for him, as he has always been a fan of Disney films in general and their animated productions in particular.", "\"I grew up during the second golden age of Disney animation, when every movie that came out was an event \u2013 \"The Little Mermaid\", \"Beauty and the Beast\", \"Aladdin\", \"The Lion King\",\" he said." ], [ "Frozen (2013 film)", "Frozen (2013 film)\n\nFrozen is a 2013 American 3D computer-animated musical fantasy film produced by Walt Disney Animation Studios and released by Walt Disney Pictures.", "The 53rd Disney animated feature film, it is inspired by Hans Christian Andersen's fairy tale \"The Snow Queen\".", "It tells the story of a fearless princess who sets off on a journey alongside a rugged iceman, his loyal reindeer, and a naive snowman to find her estranged sister, whose icy powers have inadvertently trapped their kingdom in eternal winter.", "\"Frozen\" underwent several story treatments before being commissioned in 2011, with a screenplay written by Jennifer Lee, who also co-directed with Chris Buck.", "The film features the voices of Kristen Bell, Idina Menzel, Jonathan Groff, Josh Gad, and Santino Fontana.", "Christophe Beck was hired to compose the film's orchestral score, while Robert Lopez and Kristen Anderson-Lopez wrote the songs.", "\"Frozen\" premiered at the El Capitan Theatre in Hollywood, California, on November 19, 2013, had a limited release on November 22 and went into general theatrical release on November 27.", "It was met with positive reviews and praise for its visuals, screenplay, themes, music, and voice acting; some film critics consider \"Frozen\" to be the best Disney animated feature film since the studio's renaissance era." ] ], "gold": "Frozen is a 2013 American computer-animated musical fantasy film where a princess sets off on a journey to find her estranged sister, whose powers have inadvertently trapped their kingdom in eternal winter. In the movie, Josh Gad plays the character of Olaf, a snowman that helps the princess along her adventures.", "prediction 1": "In Frozen, the snowman is named Olaf. In the 2013 film, Olaf is called Kristoff.", "prediction 2": "The snowman in Frozen is called Olaf. In the film, he is portrayed as a young snowman who is the naive son of Anna, the fearless princess who sets off on a journey alongside a rugged iceman, his loyal reindeer, and a naive snowman to find her estranged sister, whose icy powers have inadvertently trapped their kingdom in eternal winter. The film was produced by Walt Disney Animation Studios and released by Walt Disney Pictures.", "prediction 3": "In the 2013 animated film Frozen, Olaf is the snowman. In the first two films, the snowman is called Kristoff, and the third is called Kristoff Jr. In the third movie, Kristoff is called Kristoff.", "prediction 4": "Frozen is a 2013 American 3D computer-animated musical fantasy film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The movie is inspired by Hans Christian Andersen's fairy tale \"The Snow Queen\". In very early versions, Olaf was originally written as one of the guards at Elsa's castle when the concept of Elsa controlling a legion of menacing snowmen was still in the story. In the new script, which employed \"the same concept but was completely rewritten\", the character was called Marshmallow. The character of Olaf in Frozen was voiced by Josh Gad.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 38, "end": 80 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Frozen is a 2013 American computer-animated musical fantasy film where a princess sets off on a journey to find her estranged sister, whose powers have inadvertently trapped their kingdom in eternal winter. In the movie, Josh Gad plays the character of Olaf, a snowman that helps the princess along her adventures." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who plays in this year's world series?", "passages": [ [ "2015 World Series", "2015 World Series\n\nThe 2015 World Series was the championship series of Major League Baseball's (MLB) 2015 season.", "The 111th edition of the World Series, it was a best-of-seven playoff between the National League (NL) champion New York Mets and the American League (AL) champion Kansas City Royals.", "The series was played between October 27 and November 1, with the Royals winning the series 4 games to 1.", "It was the first time since the 2010 World Series that the World Series extended into November.", "The Royals became the first team since the Oakland Athletics in the 1989 World Series to win the World Series after losing in the previous year.", "It was the first World Series to feature only expansion teams and the first since the 2007 World Series to not feature the Philadelphia Phillies, St. Louis Cardinals, or San Francisco Giants as the NL champions.", "The Royals had home field advantage for the first two games of the series because of the AL's 6\u20133 victory in the Major League Baseball All-Star Game.", "It was the 13th World Series in which home field advantage was awarded to the league that won the All-Star Game, a practice that was discontinued after the 2016 season." ], [ "2016 World Series", "2016 World Series\n\nThe 2016 World Series was the championship series of Major League Baseball's (MLB) 2016 season.", "The 112th edition of the World Series, it was a best-of-seven playoff between the National League (NL) champion Chicago Cubs and the American League (AL) champion Cleveland Indians, the first meeting of those franchises in postseason history.", "The series was played between October 25 and November 3.", "The Indians had home-field advantage because the AL had won the 2016 All-Star Game.", "It was also the last World Series to have home-field advantage determined by the All-Star Game results; since , home-field advantage has been awarded to the team with the better record.", "The Cubs defeated the Indians when they won 4 games to 3 to win their first World Series since 1908.", "Game 7, an 8\u20137 victory in extra innings, marked the fifth time that a Game 7 had gone past nine innings and the first since 1997 (which, coincidentally, also featured the Indians).", "It was also the first to have a rain delay which occurred as the tenth inning was about to start.", "The Cubs became the sixth team to come back from a 3-1 deficit to win a best-of-seven World Series, following the 1925 Pittsburgh Pirates, the 1958 New York Yankees, the 1968 Detroit Tigers, the 1979 Pittsburgh Pirates, and the 1985 Kansas City Royals." ], [ "2017 World Series", "2017 World Series\n\nThe 2017 World Series was the championship series of Major League Baseball's (MLB) 2017 season.", "The 113th edition of the World Series, it was played between October 24 and November 1.", "The series was a best-of-seven playoff between the National League (NL) champion Los Angeles Dodgers and the American League (AL) champion Houston Astros.", "It was sponsored by the Internet television service YouTube TV and officially known as the \"2017 World Series presented by YouTube TV\".", "The Astros defeated the Dodgers, four games to three, to win their first World Series in franchise history, also becoming the first team from Texas to do so.", "It was the first time since 2001-2002 when two consecutive World Series went to seven games.", "Both teams set a World Series record with a combined total of 25 home runs throughout the entire series, including a team record 15 home runs by the Astros, and hit a combined total of eight home runs in Game 2 to set the single game World Series mark.", "Houston outfielder George Springer was named as the World Series Most Valuable Player (MVP) after hitting five home runs in the series to tie a World Series record with Reggie Jackson in 1977 and Chase Utley in 2009.", "This was the first World Series in which home-field advantage was decided by the regular season record of the two pennant winners." ] ], "gold": "Recent World Series competitions have featured the Kansas City Royals defeating the New York Mets in 2015, the Chicago Cubs defeating the Cleveland Indians in 2016, and the Houston Astros defeating the Los Angeles Dodgers in 2017. The 2016 and 2017 were the first consecutive World Series to reach seven games since 2001 and 2002.", "prediction 1": "The 2018 World Series was the championship series of Major League Baseball's (MLB) 2018 season. In the 2018 World Series, the National League champions played against the American League champions. In the 2015 World Series, the National League champions played against the American League champions. In the 2016 World Series, the National League champions played against the American League champions. In the 2017 World Series, the National League champions played against the American League champions.", "prediction 2": "The 2015 World Series was the championship series of Major League Baseball's (MLB) 2015 season. The 111th edition of the World Series was between the National League champion New York Mets and the American League champion Kansas City Royals. The 113th edition of the World Series was between the National League champion Los Angeles Dodgers and the American League champion Houston Astros.", "prediction 3": "The 2015 World Series was the championship series of Major League Baseball's (MLB) 2015 season. The 111th edition of the World Series, it was a best-of-seven playoff between the National League champion New York Mets and the American League champion Kansas City Royals. The series was played between October 27 and November 1, with the Royals winning the series 4 games to 1. The 2017 World Series was the championship series of Major League Baseball's (MLB) 2017 season. The 113th edition of the World Series, it was a best-of-of-seven playoff between the National League champion Los Angeles Dodgers and the American League champion Houston Astros.", "prediction 4": "The 2015 World Series was the championship series of Major League Baseball's (MLB) 2015 season. The 111th edition of the World Series, it was a best-of-seven playoff between the National League (NL) champion New York Mets and the American League (AL) champion Kansas City Royals. The series was played between October 27 and November 1, with the Royals winning the series 4 games to 1. The 2017 World Series was the championship series of Major League Baseball's (MLB) 2017 season. The 113th edition of the World Series, it was played between October 24 and November 1.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 21 }, { "error type": "Unverifiable", "explanation": "", "start": 96, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 401 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 503 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The 2015 World Series had the New York Mets face off against the Kansas City Royals, with the Royals winning. The 2016 World Series had the Chicago Cubs beating the Cleveland Indians. The 201u World Series had the Los Angeles Dodgers and Houston Astros, with the Astros winning. It was the first time since 2001-2002 when two consecutive World Series went to seven games." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the united states start regulating immigration?", "passages": [ [ "Chinese Exclusion Act", "Chinese Exclusion Act\n\nThe Chinese Exclusion Act was a United States federal law signed by President Chester A. Arthur on May 6, 1882, prohibiting all immigration of Chinese laborers.", "Building on the 1875 Page Act, which banned Chinese women from immigrating to the United States, the Chinese Exclusion Act was the first law implemented to prevent all members of a specific ethnic or national group from immigrating.", "The act followed the Angell Treaty of 1880, a set of revisions to the U.S.\u2013China Burlingame Treaty of 1868 that allowed the U.S. to suspend Chinese immigration.", "The act was initially intended to last for 10 years, but was renewed in 1892 with the Geary Act and made permanent in 1902.", "It was repealed by the Magnuson Act on December 17, 1943, which allowed 105 Chinese to enter per year.", "Chinese immigration later increased with the passage of the Immigration and Nationality Act of 1952, which abolished direct racial barriers, and later by Immigration and Nationality Act of 1965, which abolished the National Origins Formula.", "The first significant Chinese immigration to North America began with the California Gold Rush of 1848\u20131855 and it continued with subsequent large labor projects, such as the building of the First Transcontinental Railroad.", "During the early stages of the gold rush, when surface gold was plentiful, the Chinese were tolerated by white people, if not well received." ] ], "gold": "The United States introduced in the House the first bill that ended up regulating immigration on April 12, 1882. The first bill which started regulating immigration was signed into law on May 6, 1882, when President Chester A. Arther signed the Chinese Exclusion Act which prohibited all immigration of Chinese laborers.", "prediction 1": "The United States started regulating immigration in 1880. In 1882, President Chester Arthur signed the Chinese Exclusion Act, a federal law prohibiting all immigration of Chinese laborers. The Act was initially intended to last for 10 years, but was renewed in 1892 with the Geary Act and made permanent in 1902. It was repealed by the Magnuson Act on December 17, 1943, which allowed 105 Chinese to enter per year. Chinese immigration later increased with the passage of the Immigration and Nationality Act of 1952, which abolished direct racial barriers, and later by the Immigration and Nationality Act of 1965, which abolished the National Origins Formula.", "prediction 2": "The first significant Chinese immigration to North America began with the California Gold Rush of 1848\u20131855 and it continued with subsequent large labor projects, such as the building of the First Transcontinental Railroad. The Chinese Exclusion Act was a United States federal law signed by President Chester A. Arthur on May 6, 1882, prohibiting all immigration of Chinese laborers. Building on the 1875 Page Act, which banned Chinese women from immigrating to the United States, the Chinese Exclusion Act was the first law implemented to prevent all members of a specific ethnic or national group from immigrating.", "prediction 3": "The United States started regulating immigration in 1882 with the signing of the Chinese Exclusion Act, a federal law signed by President Chester A. Arthur on May 6, 1882. Building on the 1875 Page Act, which banned Chinese women from immigrating to the United States, the Chinese Exclusion Act was the first law implemented to prevent all members of a specific ethnic or national group from immigrating.", "prediction 4": "The United States first started regulating immigration in 1870, when President Chester A. Arthur signed the Angell Treaty of 1880, a set of revisions to the U.S.\u2013China Burlingame Treaty of 1868 that allowed the U.S. to suspend Chinese immigration. The American Citizenship and Immigration Act of 1871 banned Chinese laborers from entering the United States. The Chinese Exclusion Act was a federal law signed by President Chester A. Arthur on May 6, 1882, prohibiting all immigration of Chinese laborers. The Immigration and Nationality Act of 1952 abolished direct racial barriers, and later by the Immigration and Nationality Act of 1965, which abolished direct racial barriers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 660 } ], "missing-info": [], "corrected-prediction": "The United States started regulating immigration in 1880. In 1882, President Chester Arthur signed the Chinese Exclusion Act, a federal law prohibiting all immigration of Chinese laborers. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When is the new south park episode coming out?", "passages": [ [ "Iraq disarmament timeline 1990\u20132003", "Iraq disarmament timeline 1990\u20132003\n\n24 July 1990\n2 August 1990\n6 August 1990\n8 August 1990\n29 November 1990\n\n12 January 1991\n17 January 1991\n22 February 1991\n24 February 1991\n26 February 1991\n28 February 1991\n3 March 1991\nMid March \u2013 Early April 1991\n3 April 1991\n4 April 1991\n5 April 1991\n6 April 1991\n8 April 1991\n18 April 1991\n19 April 1991\n", "15\u201321 May 1991\n9 June 1991\n17 June 1991\n23\u201328 June 1991\nSummer, 1991\n2 August 1991\n15 August 1991\nSeptember 1991\n21\u201330 September 1991\n11 October 1991\n\n18 February 1992\n19 March 1992\nApril 1992\nMay\u2013June 1992\nJuly 1992\n6\u201329 July 1992\n26 August 1992\n\nJanuary 1993\n19 January 1993\n13 April 1993 \n18 June 1993\n26 June 1993\n27 June 1993 \n5 July 1993\n26 November 1993\n\nJune 1994\nSeptember\u2013October 1994\n8 October 1994\n15 October 1994\n10 November 1994\n\nMarch 1995\n14 April 1995\nSummer, 1995\n1 July 1995\nJuly 1995\nNovember 1995\n10 November 1995\n16 December 1995\n\nFebruary 1996\nMarch 1996\n19 March 1996\n27 March 1996 \nMay\u2013June 1996\nJune 1996\n12 June 1996\n13 June 1996\n19\u201322 June 1996\nJuly 1996\nSummer, 1996\n31 August 1996 \n3 September 1996\nNovember 1996\n30 December 1996\n\n1 January 1997\nFebruary 1997\nJune 1997\n18 June 1997\n21 June 1997\nJuly 1997\nSeptember 1997\n13 September 1997\n17 September 1997\n25 September 1997\n23 October 1997\nOctober 1997\n29 October 1997\n2 November 1997\n12 November 1997\n13 November 1997\n18 November 1997\n20 November 1997\n24 November 1997\n12\u201316 December 1997\n22 December 1997\n\nJanuary 1998\n15 January 1998\nFebruary 1998\n18 February 1998\n20 February 1998\n23 February 1998\n2 March 1998\n20\u201323 March 1998\nApril 1998\n4 April 1998\n8 April 1998\n15 May 1998\nSpring, 1998\nJuly 1998\n3 August 1998\n5 August 1998\n26 August 1998\n9 September 1998\n29 September 1998 \n31 October 1998\n5 November 1998\n13\u201314 November 1998\n18 November 1998\n23\u201326 November 1998\n30 November 1998\n11 December 1998\n13 December 1998\n15 December 1998\n16\u201319 December 1998 \n19 December 1998\n21 December 1998\n\n4 January 1999\n17 December 1999\n\n2000\n1 March 2000\nNovember 2000\n\nFebruary 2001\n\n1 July 2001\n\n11 September 2001\n\n18 March 2002\n\n14 May 2002\n\n5 July 2002\n\n23 July 2002\n\nAugust 2002\n\n2 August 2002\n\n\n17 August 2002\n\n19 August 2002\n\n12 September 2002\n\n22 September 2002\n\n26 September 2002\n\n3 October 2002\n10 October 2002 \n\n8 November 2002\n13 November 2002\n\n7 December 2002\n19 December 2002\n\nJanuary 2003\n18 January 2003\nJanuary 2003\n25 January 2003\n27 January 2003\n31 January 2003\n\n5 February 2003\n7 February 2003\n8 February 2003\n10 February 2003 \n12 February 2003\n13 February 2003\n14 February 2003\n15 February 2003\n18 February 2003\n22 February 2003\n24 February 2003\n25 February 2003\n26 February 2003\n27 February 2003\n28 February 2003\n\n1 March 2003\n2 March 2003\n3 March 2003\n4 March 2003\n5 March 2003\n6 March 2003\n\n7 March 2003\n\n9 March 2003\n11 March 2003\n12 March 2003\n13 March 2003\n16 March 2003\n17 March 2003\n18 March 2003\n19 March 2003\n\n2003 Iraq war timeline" ], [ "South Park (season 8)", "South Park (season 8)\n\nSeason eight of \"South Park\", an American animated television series created by Trey Parker and Matt Stone, began airing on March 17, 2004.", "The eighth season concluded after 14 episodes on December 15, 2004, and was written and directed by Trey Parker.", "The season deals with various topics that were relevant at the time of release.", "The episodes portray a spectrum of topics, from effect of large scale retails corporations to immigration.", "On the DVD commentary for the episode \"Cartman's Incredible Gift\", series co-creator Trey Parker referred to the eighth season as \"the year from hell\", due to the grueling work schedule under which he and co-creator Matt Stone worked on both the series and their feature film \"\".", "" ] ], "gold": "South Park season 21 newest episodes were released on December 6, 2017, November 29, 2017, and on November 15, 2017. Season 23, which aired in 2019, released its newest episode on December 11, 2019. And the newest special episode, South ParQ Vaccination Special, aired on March 10, 2021.", "prediction 1": "Season eight of South Park, an American animated television series created by Trey Parker and Matt Stone, began airing on March 17, 2004. The eighth season concluded after 14 episodes on December 15, 2004, and was written and directed by Trey Parker. Season 9 of South Park came out on September 7, 2005. Season 10 came out on September 5, 2005.", "prediction 2": "The new episode of South Park, which is an American animated television series created by Trey Parker and Matt Stone, came out on September 19, 2003. Episodes from the upcoming season came out on September 22, 2003, and September 29, 2003. Episodes from the upcoming season came out on September 30, 2003, and September 30, 2003.", "prediction 3": "South Park is an American animated television series created by Trey Parker and Matt Stone. The series premiered on CBS television on March 17, 2004. The eighth season premiered on ABC on March 15, 2004.", "prediction 4": "The new episode of the American animated television series South Park, which is based on the comic strip, was released on March 17, 2004. The new episode of the seventh season came out on March 19, 2005.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 137 }, { "error type": "Unverifiable", "explanation": "", "start": 251, "end": 304 }, { "error type": "Unverifiable", "explanation": "", "start": 305, "end": 345 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 250 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where was the film high plains drifter filmed?", "passages": [ [ "High Plains Drifter", "After scouting locations alone in a pickup truck in Oregon, Nevada and California, he settled on the \"highly photogenic\" Mono Lake area.", "Over 50 technicians and construction workers built an entire town\u201414 houses, a church, and a two-story hotel\u2014in 18 days, using 150,000 feet of timber.", "Complete buildings, rather than facades, were built, so that Eastwood could shoot interior scenes on the site.", "Additional scenes were filmed at Reno, Nevada's Winnemucca Lake and California's Inyo National Forest.", "The film was completed in six weeks, two days ahead of schedule, and under budget.", "The character of Marshal Duncan was played by Buddy Van Horn, Eastwood's long-time stunt double, to suggest that he and the Stranger could be the same person.", "In an interview, Eastwood said that earlier versions of the script made the Stranger the dead marshal's brother.", "He favored a less explicit and more supernatural interpretation, and excised the reference.", "The Italian, Spanish, French and German dubbings restored it.", "\"It's just an allegory,\" he said, \"a speculation on what happens when they go ahead and kill the sheriff and somebody comes back and calls the town's conscience to bear.", "There's always retribution for your deeds.\"" ], [ "High Plains Drifter", "High Plains Drifter\n\nHigh Plains Drifter is a 1973 American Western film directed by and starring Clint Eastwood, written by Ernest Tidyman, and produced by Robert Daley for Malpaso Company and Universal Pictures.", "Eastwood plays a mysterious, prepotent stranger, meting out justice in a corrupt frontier mining town.", "The film was influenced by the work of Eastwood's two major collaborators, film directors Sergio Leone and Don Siegel.", "The film was shot on location on the shores of Mono Lake, California.", "Dee Barton wrote the film score.", "The film was critically acclaimed at the time of its initial release and remains popular today, holding a score of 96% at the review aggregate website Rotten Tomatoes.", "A mysterious stranger rides out of the desert into the isolated mining town of Lago, on the shore of a large lake in an unnamed western territory.", "Three men follow him into the saloon, taunting him, then follow him to the barbershop.", "When they challenge him, he kills all three with little effort.", "Attractive townswoman Callie Travers deliberately bumps into him in the street, knocks his cigar from his mouth, and loudly insults him.", "He drags her into the livery stable and rapes her.", "That night, in his hotel room, the Stranger dreams of a man being brutally whipped." ], [ "Mono County, California", "Mono County, California\n\nMono County (MOH-noh) is a county located in the east central portion of the U.S. state of California.", "As of the 2010 census, the population was 14,202.", "making it the fifth-least populous county in California.", "The county seat is Bridgeport.", "The county is located east of the Sierra Nevada between Yosemite National Park and Nevada.", "The only incorporated town in the county is Mammoth Lakes, which is located at the foot of Mammoth Mountain.", "Other locations, such as June Lake, are also famous as skiing and fishing resorts.", "Located in the middle of the county is Mono Lake, a vital habitat for millions of migratory and nesting birds.", "The lake is located in a wild natural setting, with pinnacles of tufa arising out of the salty and alkaline lake.", "Also located in Mono County is Bodie, the official state gold rush ghost town, which is now a California State Historic Park.", "Mono County was formed in 1861 from parts of Calaveras, Fresno and Mariposa counties.", "Parts of the county's territory were given to Inyo County in 1866.", "The county is named after Mono Lake which, in 1852, was named for a Native American Paiute tribe, the Mono people, who historically inhabited the Sierra Nevada from north of Mono Lake to Owens Lake." ] ], "gold": "High Plains Drifter is a 1973 American Western film where Clint Eastwood plays the role of a mysterious stranger who metes out justice in a corrupt frontier mining town. The movie was mainly shot in Mono Lake, California, but additional scenes were filmed at Reno, Nevada's Winnemucca Lake and California's Inyo National Forest.", "prediction 1": "High Plains Drifter is a 1973 American Western film directed by Clint Eastwood, written by Ernest Tidyman, and produced by Robert Daley for Malpaso Company and Universal Pictures. The film was shot on location on the shores of Mono Lake, California. Additional scenes were filmed at Reno, Nevada's Winnemucca Lake, and California's Inyo National Forest. The film was critically acclaimed at the time of its initial release and remains popular today, holding a score of 96% at the review aggregate website Rotten Tomatoes.", "prediction 2": "High Plains Drifter is a 1973 American Western film directed by Clint Eastwood, written by Ernest Tidyman, and produced by Robert Daley for Malpaso Company and Universal Pictures. The film was shot on location on the shores of Mono Lake, California. In addition to Mono Lake, additional scenes were filmed at Reno, Nevada's Winnemucca Lake, and California's Inyo National Forest. The film was critically acclaimed at the time of its initial release and remains popular today, holding a score by Dee Barton.", "prediction 3": "High Plains Drifter is a 1973 American Western film directed by Clint Eastwood, written by Ernest Tidyman, and produced by Robert Daley for Malpaso Company and Universal Pictures. The film was shot on location on the shores of Mono Lake, California.", "prediction 4": "High Plains Drifter is a 1973 American Western film directed by Clint Eastwood, written by Ernest Tidyman, and produced by Robert Daley for Malpaso Company and Universal Pictures. The film was shot on location on the shores of Mono Lake, California. Additional scenes were filmed at Reno, Nevada's Winnemucca Lake and California's Inyo National Forest.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 179 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 521 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "High Plains Drifter is a 1973 American Western film directed by Clint Eastwood. Eastwood plays a mysterious, prepotent stranger, meting out justice in a corrupt frontier mining town. The film was shot on location on the shores of Mono Lake, California. Additional scenes were filmed at Reno, Nevada's Winnemucca Lake, and California's Inyo National Forest. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who has won the most tennis matches in history?", "passages": [ [ "Serena Williams", "Serena Williams\n\nSerena Jameka Williams (born September 26, 1981) is an American professional tennis player.", "The Women's Tennis Association (WTA) ranked her world No. 1 in singles on eight separate occasions between 2002 and 2017.", "She reached the No. 1 ranking for the first time on July 8, 2002.", "On her sixth occasion, she held the ranking for 186 consecutive weeks, tying the record set by Steffi Graf.", "In total, she has been No. 1 for 319 weeks, which ranks third in the \"Open Era\" among female players behind Graf and Martina Navratilova.", "Williams holds the most Grand Slam titles in singles, doubles, and mixed doubles combined among active players.", "Her 39 major titles puts her joint-third on the all-time list and second in the Open Era: 23 in singles, 14 in women's doubles, and two in mixed doubles.", "She is the most recent female player to have held all four Grand Slam singles titles simultaneously (2002\u201303 and 2014\u201315) and the third player to achieve this twice, after Rod Laver and Graf.", "She is also the most recent player to have won a Grand Slam title on each surface (hard, clay and grass) in one calendar year.", "She is also, together with her sister Venus, the most recent player to have held all four Grand Slam women's doubles titles simultaneously (2009\u201310)." ], [ "Jimmy Connors", "Jimmy Connors\n\nJames Scott Connors (born September 2, 1952) is a retired American world No. 1 tennis player, often considered among the greatest in the history of the sport.", "He held the top ATP ranking for a then-record 160 consecutive weeks from 1974 to 1977 and a career total of 268 weeks.", "By virtue of his long and prolific career, Connors still holds three prominent Open Era men's singles records: 109 titles (he is the only man to win 100), 1535 matches played, and 1256 match wins.", "His titles include eight majors (five US Open, two Wimbledon, one Australian Open), three year-end championships, and 17 Grand Prix Super Series.", "In 1974, he became the second man in the Open Era to win three majors in a calendar year, and his total career match win rate remains in the top five of the era.", "Connors grew up in East St. Louis, Illinois, across the Mississippi River from St. Louis, and was raised Catholic.", "During his childhood he was coached and trained by his mother and grandmother.", "He played in his first U.S. Championship, the U.S. boys' 11-and-under of 1961, when he was nine years old.", "Connors' mother, Gloria, took him to Southern California to be coached by Pancho Segura, starting at age 16, in 1968." ] ], "gold": "Jimmy Connors is an American former world No. 1 tennis player. By virtue of his long and prolific career, Connors still holds three prominent Open Era men's singles records and has won the most tennis matches in history as a male. Serena Williams is an American professional tennis player. She has won 23 major singles titles, the most by any man or woman in the Open Era. She has also won the most tennis matches in history as a female.", "prediction 1": "For tennis players, the player who has won the most matches over a career is usually Jimmy Connors, who holds the record for the most matches played and wins, with 1256 matches. In total, the player who has won the most matches over a career is a total of 58,327 and is considered to be among the greatest in the history of the sport.", "prediction 2": "The tennis player who has won the most tennis matches in history is Jimmy Connors, a retired American professional tennis player ranked No. 1 in the world, often considered among the greatest in the history of the sport. Jimmy Connors holds the top ATP ranking for a then-record 160 consecutive weeks from 1974 to 1977 and a career total of 268 weeks.", "prediction 3": "Jimmy Connors has won the most tennis matches in a single career, with 150 wins. Serena Williams has won the most tennis matches in a single career, with 125 wins. In the women's game, the player who has won the most tennis matches is Steffi Graf with 186 wins.", "prediction 4": "James Scott Connors holds the record for most matches won in a career in men's tennis. He won a total of 1256 matches during his career, for a total of 268 weeks, from 1974 to 1977. American professional tennis player Serena Williams holds the record for most Grand Slam singles titles, and is the second most recent player to hold all four Grand Slam singles titles simultaneously.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 20, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 334 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "For tennis players, Jimmy Connors, a retired American world No. 1 tennis player, by virtue of his long and prolific career, still holds three prominent Open Era men's singles records. Serena Williams is an American professional tennis player. She holds the most titles among active players that includes 23 major singles titles." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does star wars land disney world open?", "passages": [ [ "Star Wars: Galaxy's Edge", "Star Wars: Galaxy's Edge\n\n\"Star Wars\": Galaxy's Edge is an upcoming \"Star Wars\"-themed area being developed in Disneyland Park at the Disneyland Resort in Anaheim, California, as well as in Disney's Hollywood Studios at Walt Disney World Resort in Orlando, Florida.", "It will encompass 14 acres at each park.", "The lands were announced on August 15, 2015 and construction at both parks began on April 14, 2016.", "The lands are scheduled to open at both locations in 2019, with the Disneyland version opening in the summer, followed by the Disney's Hollywood Studios version in the late fall.", "Walt Disney Imagineering executive Scott Trowbridge is supervising the development of the new land at both parks.", "\"Star Wars\": Galaxy's Edge was first publicly announced by The Walt Disney Company Chairman and CEO Bob Iger at the D23 Expo on August 15, 2015, though it did not have an official name at the time.", "According to Iger, it will be \"occupied by many inhabitants; humanoids, aliens and droids \u2026 the attractions, the entertainment, everything we create will be part of our storytelling.", "Nothing will be out of character or stray from the mythology.\"" ], [ "Disney's Hollywood Studios", "The main street of Grand Avenue leads into a recreation of the Figueroa Street Tunnel.", "Grand Avenue was originally planned as a themed area called Muppet Studios, following Disney's acquisition of the Jim Henson Company.", "In addition to Muppet*Vision 3D, this area was to include a themed restaurant and a Muppet dark ride parody of The Great Movie Ride.", "The deal fell through after Henson's death, and only Muppet*Vision 3D was developed.", "The Muppet-themed section became a part of the park's former Streets of America area, which encompassed several attractions, including an urban street amalgamation of New York City and San Francisco.", "The area's namesake street facades were formerly the park's working backlot set, which was originally a component of the park's inaugural Studio Backlot Tour, and opened to pedestrian park traffic in the mid-1990s; this area closed on April 2, 2016.", "The Muppet-themed areas and a single remaining block of Streets of America facades were reincorporated into Muppets Courtyard, which served as a placeholder designation until Grand Avenue was completed in September 2017.", "\"Toy Story\" Land is inspired by Pixar's \"Toy Story\" series.", "The area is themed to Andy's backyard with three attractions, each hosted by characters from the series." ], [ "Star Tours \u2013 The Adventures Continue", "Star Tours \u2013 The Adventures Continue\n\nStar Tours\u00a0\u2013 The Adventures Continue (also known as Star Tours 3-D and Star Tours - L'Aventure Continue) is a 3D motion simulator attraction located at Disney's Hollywood Studios, Disneyland, Tokyo Disneyland, and Disneyland Paris.", "Set in the \"Star Wars\" universe \"Star Tours\u00a0\u2013 The Adventures Continue\" takes guests on a turbulent excursion trip across the galaxy, as droids C-3PO and R2-D2 attempt to safely return a rebel spy to the Rebel Alliance.", "\"The Adventures Continue\" features locations and characters from \"\" through \"\", unlike its predecessor, which mostly took place after the events of the original trilogy (Episodes IV\u2013VI).", "The attraction opened on May 20, 2011 at Disney's Hollywood Studios, on June 3, 2011 at Disneyland, on May 7, 2013 at Tokyo Disneyland, and on March 26, 2017 at Disneyland Paris.", "In April 2005, at \"Star Wars\" Celebration III, creator George Lucas confirmed that a \"Star Tours II\" was in production.", "In May 2009, /Film reported that filming for the new version of Star Tours was underway in West Hollywood, California.", "During pre-production, one of the locations that Imagineers wanted guests to visit was the ice planet of Hoth while it was under siege by Imperial walkers." ] ], "gold": "Star Wars: Galaxy's Edge opened at Disneyland on May 31, 2019 and at Disneyworld on August 29, 2019. Star Wars: The Adventures Continue opened on May 20, 2011 at Disney's Hollywood Studios, on June 3, 2011 at Disneyland, on May 7, 2013 at Tokyo Disneyland, and on March 26, 2017 at Disneyland Paris.", "prediction 1": "Star Wars Land at Disney World opened on May 26, 2017 in Epcot, California. Star Tours \u2013 The Adventures Continue is a 3D motion simulator attraction located at Disney's Hollywood Studios, Disneyland Park, Tokyo Disneyland, and Disneyland Paris. Star Wars: Galaxy's Edge is an upcoming \"Star Wars\"-themed area being developed in Disneyland Park at the Disneyland Resort in Anaheim, California, as well as in Disney's Hollywood Studios at Walt Disney World Resort in Orlando, Florida.", "prediction 2": "Star Wars Land at Disney World opened on March 26, 2017. It is a themed area within Disney's Hollywood Studios and is set to open in both Disneyland Park in Anaheim and Disney's Hollywood Studios in Orlando, Florida. Star Tours \u2013 The Adventures Continue is a 3D motion simulator attraction located at Disneyland, Tokyo Disneyland, and Disney's Paris Resort. The land opened at Disneyland Park on May 20, 2011 and at Disney's Hollywood Studios on June 3, 2011 and on March 26, 2017 respectively.", "prediction 3": "Star Wars Land at Disney World opened in 2018, with Star Tours: The Adventures Continue opening in May 2019. Star Wars Land at Disneyland Park opened on December 20, 2018, with Star Tours: The Adventures Continue opening on December 3, 2019. Star Wars Land at Disney's Hollywood Studios opened in October 2017, with the rest of Disney's Star Wars Land opening in November 2020.", "prediction 4": "Star Wars Land in Disney World usually opens in the summer, while Star Tours \u2013 The Adventures Continue opens in the fall. Star Wars Land at Disneyland opened in the summer of 2011. Star Tours \u2013 The Adventures Continue is a 3D motion simulator attraction. Star Tours \u2013 The Adventures Continue opened in the fall of 2011.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 324 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 462, "end": 482 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Star Tours \u2013 The Adventures Continue opened on May 20, 2011 at Disney's Hollywood Studios, on June 3, 2011 at Disneyland, on May 7, 2013 at Tokyo Disneyland, and on March 26, 2017 at Disneyland Paris. Star Wars: Galaxy's Edge is scheduled to open at Disneyland Park and Walt Disney World Resort in 2019." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where was the opening ceremony of the rio paralympics 2016 held?", "passages": [ [ "2016 Summer Paralympics opening ceremony", "2016 Summer Paralympics opening ceremony\n\nThe opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan\u00e3 Stadium, Rio de Janeiro, starting at 18:30 BRT (21:30 UTC).", "The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7\u00e3o\" (\"Everybody Has a Heart\"); writer and director Marcelo Rubens Paiva stated that the ceremony would focus upon \"humanity, on the human condition, on feelings, difficulties, solidarity, love, heart\" and \"evoke emotion, laughs and tears\".", "At least 2,500 people were involved in the ceremony, including 500 creative professionals and 2,000 volunteers.", "On 2 September 2016, director Fred Gelli revealed that the ceremony would feature U.S. Paralympic snowboarder and \"Dancing with the Stars\" contestant Amy Purdy performing a contemporary, Samba-inspired dance routine with a \"surprise partner\".", "Amidst larger financial concerns surrounding the Games, fellow director Fl\u00e1vio Machado affirmed that the ceremony's budget was fiscally responsible and was \"enough to do what we wanted to create\", adding that \"It wasn't a problem and it's not going to be an excuse\".", "International Olympic Committee president Thomas Bach was absent from the opening ceremony, as he had prior obligations to attend the state funeral of former West German president Walter Scheel." ], [ "2016 Summer Paralympics", "2016 Summer Paralympics\n\nThe 2016 Summer Paralympics (), the 15th Summer Paralympic Games, were a major international multi-sport event for athletes with disabilities governed by the International Paralympic Committee, held in Rio de Janeiro, Brazil, from 7 September to 18 September 2016.", "The Games marked the first time a Latin American and South American city hosted the event, the second Southern Hemisphere city and nation, the first one being the 2000 Summer Paralympics in Sydney, and also the first time a Lusophone (Portuguese-speaking) country hosted the event.", "These Games saw the introduction of two new sports to the Paralympic program: canoeing and the paratriathlon.", "The lead-up to these Paralympics were met with financial shortcomings attributed to tepid sponsor interest and ticket sales, which resulted in cuts to volunteer staffing and transport, the re-location of events and the partial deconstruction of the Deodoro venue cluster.", "However, ticket sales began to increase as the Games drew nearer, and over 2\u00a0million tickets were sold in total\u2014overtaking Beijing 2008 as the second-most-attended Paralympic Games on record.", "The Russian doping scandal also affected these Paralympics; unlike the Olympics, which selectively allowed Russian athletes to participate, the entire Russian team was banned from the Paralympics.", "A team of two refugee athletes also participated in Rio, \"hosted\" by the Greek and American Paralympic Committees." ] ], "gold": "The opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan\u00e3 Stadium, Rio de Janeiro, in Brazil. The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7\u00e3o,\" meaning \"Everybody Has a Heart.\" Writer and director Marcelo Rubens Paiva stated that the ceremony would focus upon \"humanity, on the human condition, on feelings, difficulties, solidarity, love, heart\" and \"evoke emotion, laughs and tears.\" At least 2,500 people were involved in the ceremony, including 500 creative professionals and 2,000 volunteers.", "prediction 1": "The opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan Stadium, Rio de Janeiro, starting at 18:30 BRT (21:30 UTC). The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7o\" (\"Everybody Has a Heart\"); writer and director Marcelo Rubens Paiva stated that the ceremony would focus upon \"humanity, on the human condition, on feelings, difficulties, solidarity, love, heart\" and \"evoke emotion, laughs and tears\".", "prediction 2": "The Rio 2016 Summer Paralympics opening ceremony took place on the evening of 7 September 2016 at the Maracan Stadium, Rio de Janeiro, starting at 18:30 BRT (21:30 UTC). The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7o\", meaning \"Everybody Has a Heart\". The Games marked the first time a Latin American and South American city hosted the event, the second Southern Hemisphere city and nation, the first one being the 2000 Summer Paralympics in Sydney, and also the first time a Lusophone (Portuguese-speaking) country hosted the event.", "prediction 3": "The opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan Stadium, Rio de Janeiro, starting at 18:30 BRT (21:30 UTC). The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7o\" (\"Everyone Has a Heart\"); writer and director Marcelo Rubens Paiva stated that the ceremony would focus upon \"humanity, on the human condition, on feelings, difficulties, solidarity, love, heart\" and \"evoke emotion, laughs and tears\".", "prediction 4": "The opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan Stadium, Rio de Janeiro, starting at 18:30 BRT (21:30 UTC). The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7o\", the theme for this year's games was \"Everybody Has a Heart\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 172 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The opening ceremony of the 2016 Summer Paralympics took place on the evening of 7 September 2016 at the Maracan Stadium, Rio de Janeiro, Brazil. The theme of the ceremony was \"Todo Mundo tem um Cora\u00e7o\" (\"Everybody Has a Heart\"); writer and director Marcelo Rubens Paiva stated that the ceremony would focus upon \"humanity, on the human condition, on feelings, difficulties, solidarity, love, heart\" and \"evoke emotion, laughs and tears\". At least 2,500 people were involved in the ceremony, including 500 creative professionals and 2,000 volunteers." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the words to abide with me?", "passages": [ [ "Abide with Me, 'Tis Eventide", "Abide with Me, 'Tis Eventide\n\n\"Abide with Me, 'Tis Eventide\" is a 19th-century American Christian hymn written by Martin Lowrie Hofford (lyrics) and Harrison Millard in 1870 (music).", "The lyrics and music to the hymn were heavily influenced by the American Civil War.", "The hymn appears as number 46 in the \"Seventh-day Adventist Hymnal\" and number 165 of the hymnbook of The Church of Jesus Christ of Latter-day Saints.", "It has also been published in the 1978 \"Hymns of Praise\" edited by Reuel Lemmons; the 1971 \"Songs of the Church\" and the 1990 \"Songs of the Church 21st Century Edition\" both edited by Alton H. Howard; both the 1978 and 1983 \"Church Gospel Songs and Hymns\" edited by V. E. Howard; the 1992 \"Praise for the Lord\" edited by John P. Wiegand; the 2007 \"Sacred Songs of the Church\" edited by William D. Jeffcoat and the 2009 \"Favorite Songs of the Church\" edited by Robert J. Taylor Jr." ], [ "Abide with Me", "Abide with Me\n\n\"Abide with Me\" is a Christian hymn by Scottish Anglican Henry Francis Lyte most often sung to English composer William Henry Monk's tune entitled \"Eventide\".", "Written in Crossabeg, Wexford, Ireland in Artramon House.", "Lyte wrote the poem in 1847 and set it to music while he lay dying from tuberculosis; he survived only a further three weeks after its completion.", "The author of the hymn, Henry Francis Lyte, was an Anglican priest and vicar of All Saints' Church in Brixham, England.", "He was a curate in Wexford for three years \u2013 from 1815 to 1818.", "For most of his life Lyte suffered from poor health, and he would regularly travel abroad for relief, as was the tradition in that day.", "Due to a plaque erected in his memory in Taghmon church, he preached frequently in Killurin church, about nine miles from there.", "During that time the rector of Killurin parish, the Reverend Abraham Swanne, was a lasting influence on Lyte\u2019s life and ministry.", "There is some controversy to the exact dating of the text to \u201cAbide with Me.\u201d", "An article in \"The Spectator\", Oct. 3, 1925, says that Lyte composed the hymn in 1820 while visiting a dying friend." ] ], "gold": "\"Abide with Me\" is a Christian hymn by Scottish Anglican Henry Francis Lyte in 1847. The hymn is most often sung to the tune \"Eventide\" by William Henry Monk. However, there is also \"Abide with Me, 'Tis Eventide\" a 19th-century American Christian hymn written by Martin Lowrie Hofford, and Harrison Millard in 1870. The lyrics and music to the hymn were heavily influenced by the American Civil War.", "prediction 1": "\"Abide with Me\" is a Christian hymn by Scottish Anglican Henry Francis Lyte most often sung to English composer William Henry Monk's tune entitled \"Eventide\". The author of the hymn, Henry Francis Lyte, was an Anglican priest and vicar of All Saints' Church in Brixham, England. There is some controversy to the exact dating of the text to \"Abide with Me.\" An article in The Spectator, Oct. 3, 1925, says that Lyte composed the hymn in 1820 while visiting a dying friend.\n", "prediction 2": "There is some controversy to the exact dating of the text to Abide with Me. An article in The Spectator, Oct. 3, 1925, says that Lyte composed the hymn in 1820 while visiting a dying friend.", "prediction 3": "There is some controversy to the exact dating of the text to \"Abide with Me.\" An article in \"The Spectator\", Oct. 3, 1925, says that Lyte composed the hymn in 1820 while visiting a dying friend. The Scottish Anglican priest and vicar of All Saints' Church in Brixham, England who wrote the words and set them to music while he lay dying from tuberculosis, Henry Francis Lyte. The late Shakespeare and tractarian English poet, J.W. Lyte, an Anglican priest and vicar of All Saints' Church in Crossabeg, Wexford, Ireland in Artramon House. Abide is an Anglican Anglican Catholic hymn composed by English composer William Henry Monk's tune entitled \"Eventide\".", "prediction 4": "There is some controversy to the exact dating of the text to Abide with Me. An article in \"The Spectator\", Oct. 3, 1925, says that Lyte composed the text to \"Abide with Me\" in 1820 while visiting a dying friend. Abide with Me, 'Tis Eventide\" is a 19th-century American Christian hymn written by Martin Lowrie Hofford (lyrics) and Harrison Millard in 1870. The lyrics and music to the hymn were heavily influenced by the American Civil War.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 472 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Abide with Me\" is a Christian hymn by Scottish Anglican Henry Francis Lyte most often sung to William Henry Monk's tune entitled \"Eventide\". Besides, there is also Abide with Me, 'Tis Eventide\", a 19th-century American Christian hymn written by Martin Lowrie Hofford (lyrics) and Harrison Millard in 1870 (music). The lyrics and music to the hymn were heavily influenced by the American Civil War.\n" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did ready player one come to theaters?", "passages": [ [ "Ready Player One (film)", "\"Ready Player One\" was initially scheduled to be released on December 15, 2017, but was pushed back to March 30, 2018, to avoid competition with \"\".", "In January 2018, it was announced the film's release date had been moved up one day to March 29, 2018.", "The film had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 (as part of the South by Southwest Film Festival).", "Warner Bros. Pictures distributed the film worldwide, with Village Roadshow Pictures distributing in several overseas territories.", "\"Ready Player One\" was released on digital copy on July 3, 2018, and on 4K UHD Blu-ray, Blu-ray 3D, Blu-Ray, and DVD on July 24, 2018.", "The film debuted at the top of the \nNPD VideoScan First Alert chart for the week ending on July 27, 2018.", "It retained the No. 1 spot on the chart for the week ending on August 4, 2018.", "\"Ready Player One\" has grossed $137 million in the United States and Canada, and $445.2 million in other territories, for a worldwide total of $582.2 million.", "Made on a production budget of $175 million, with about $150 million more spent on global marketing costs, the film needed to gross at least $440 million in order to break-even." ], [ "Ready Player One (film)", "Ready Player One (film)\n\n", "Ready Player One is a 2018 American science fiction film produced and directed by Steven Spielberg, and written by Zak Penn and Ernest Cline, based on Cline's 2011 novel of the same name.", "The film stars Tye Sheridan, Olivia Cooke, Ben Mendelsohn, Lena Waithe, T.J. Miller, Simon Pegg, and Mark Rylance.", "The film takes place in 2045, when much of humanity uses the virtual reality software OASIS to escape the desolation of the real world.", "Orphaned teenager Wade Watts (Sheridan) discovers clues to a hidden game within the program that promises the winner full ownership of the OASIS, and joins several allies to try to complete the game before a large company run by businessman Nolan Sorrento (Mendelsohn) can do so.", "\"Ready Player One\" premiered at South by Southwest in Austin, Texas on March 11, 2018, was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018, in 2D, Real D 3D, IMAX and IMAX", "3D.", "It grossed $582 million worldwide, making it the tenth-highest-grossing film of 2018.", "The film received generally positive reviews, critics praised its visuals, brisk pacing, both Sheridan's and Rylance's performances, and the many cultural references from various media." ] ], "gold": "Ready Player One is a American science fiction adventure film based on Ernest Cline's novel of the same name that follows Wade Watts, an orphan who finds clues to a contest that promises the ownership of the virtual reality simulation OASIS to the winner, starting a quest where he and four allies try to complete it before a corporation run by businessman Nolan Sorrento can do so. The film had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 as part of the South by Southwest Film Festival., and was theatrically released in the United States on March 29, 2018.", "prediction 1": "Ready Player One is a 2018 American science fiction film which premiered at South by Southwest on March 11, 2018, and was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018.", "prediction 2": "Ready Player One is a 2018 American science fiction film produced and directed by Steven Spielberg, and written by Zak Penn and Ernest Cline, based on Cline's 2011 novel of the same name. The film premiered at the Paramount Theatre in Austin, Texas on March 11, 2018 as part of the South by Southwest Film Festival. The film was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018, in 2D, Real D 3D, IMAX and IMAX 3D.", "prediction 3": "Ready Player One is a 2018 American science fiction film produced and directed by Steven Spielberg and written by Zak Penn and Ernest Cline, based on Cline's 2011 novel of the same name. Ready Player One premiered at South by Southwest in Austin, Texas on March 11, 2018, was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018, in 2D, Real D 3D, IMAX and IMAX 3D. It grossed $582 million worldwide, making it the tenth-highest-grossing film of 2018.", "prediction 4": "Ready Player One is a 2018 American science fiction film produced and directed by Steven Spielberg and written by Zak Penn and Ernest Cline based on Cline's 2011 novel of the same name. The film premiered at the Paramount Theatre in Austin, Texas on March 11, 2018, and was theatrically released by Warner Bros. Pictures in the United States on March 29, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 22, "end": 26 }, { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 168 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Ready Player One is a American science fiction film based on Ernest Cline's novel of the same name that follows orphaned teenager Wade Watts discovers clues to a hidden game within the program that promises the winner full ownership of the OASIS, and joins several allies to try to complete the game before a large company run by businessman Nolan Sorrento can do so. The film had its world premiere at the Paramount Theatre in Austin, Texas on March 11, 2018 as part of the South by Southwest Film Festival, and was theatrically released in the United States on March 29, 2018." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who came up with the song amazing grace?", "passages": [ [ "Amazing Grace", "Amazing Grace\n\n\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton (1725\u20131807).", "Newton wrote the words from personal experience.", "He grew up without any particular religious conviction, but his life's path was formed by a variety of twists and coincidences that were often put into motion by others' reactions to what they took as his recalcitrant insubordination.", "He was pressed (conscripted) into service in the Royal Navy, and after leaving the service, he became involved in the Atlantic slave trade.", "In 1748, a violent storm battered his vessel off the coast of County Donegal, Ireland, so severely that he called out to God for mercy, a moment that marked his spiritual conversion.", "He continued his slave trading career until 1754 or 1755, when he ended his seafaring altogether and began studying Christian theology.", "Ordained in the Church of England in 1764, Newton became curate of Olney, Buckinghamshire, where he began to write hymns with poet William Cowper.", "\"Amazing Grace\" was written to illustrate a sermon on New Year's Day of 1773.", "It is unknown if there was any music accompanying the verses; it may have simply been chanted by the congregation.", "It debuted in print in 1779 in Newton and Cowper's \"Olney Hymns\" but settled into relative obscurity in England." ], [ "Chris Tomlin", "He released the live EP \"545\" in 2002, and the studio album \"Not to Us\" (2002).", "Although he is a solo artist, Tomlin uses a consistent band lineup.", "He writes many of his songs with the band members.", "The band consists of Daniel Carson (lead guitar, backing vocals), Matt Gilder (keyboards), backing vocals), Timmy Jones(drums) and Matthew Melton (bass, backing vocals).", "Tomlin plays guitar and piano.", "According to Christian Copyright Licensing International's list of the top 25 worship songs in the US in August 2007, Tomlin held five spots with songs he has either written, co-written or performed: \"How Great Is Our God\" (No. 1), \"Forever\" (No. 5), \"Holy Is the Lord\" (No. 7), \"We Fall Down\" (No. 12), and \"Indescribable\" (No. 22) (written by Laura Story).", "In 2008, Tomlin held 6 spots on \"20 The Countdown Magazine\"'s top 20 praise and worship songs: \"We Fall Down\" (No. 14), \"Forever\" (No. 10), \"Holy is the Lord\" (No. 8), \"Indescribable\" (No." ], [ "Amazing Grace (soundtrack)", "Amazing Grace (soundtrack)\n\n", "Amazing Grace: Music Inspired By the Motion Picture is a soundtrack for the movie \"Amazing Grace\" starring Ioan Gruffudd.", "The album features new versions of old hymns recorded by some of Christian music's more prominent artists as well as one of the most popular country artists around today.", "Some digital releases of the album omit the Jars of Clay and Bart Millard tracks.", "In 2008, the album was nominated for a Dove Award for Special Event Album of the Year at the 39th GMA Dove Awards.", "The song \"Amazing Grace (My Chains are Gone)\" by Chris Tomlin was also nominated for Song of the Year." ] ], "gold": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written in 1772 by the English poet and Anglican clergyman John Newton, who wrote from personal experience. He grew up without any particular religious conviction, but his life's path was formed by a variety of twists and coincidences that were often put into motion by others' reactions to what they took as his recalcitrant insubordination. \"Amazing Grace (My Chains are Gone)\" is a song by Chris Tomlin which reached number three on The Countdown Magazine's Top 20 Praise and Worship Songs in 2008, a list that Chris Tomlin's song held six spots on.", "prediction 1": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton (1725\u20131807). Newton wrote the words from personal experience. Chris Tomlin came up with the song Amazing Grace in 2002, with his band, The Amazing Graces, as his backing band and he sang it on stage. The soundtrack for the movie Amazing Grace also features new versions of old hymns recorded by some of Christian music's most prominent artists as well as one of the most popular country artists around today.", "prediction 2": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton (1725\u20131807). Newton grew up without any particular religious conviction, but his life's path was formed by a variety of twists and coincidences that were often put into motion by others' reactions to what they took as his recalcitrant insubordination. \"Amazing Grace\" was written to illustrate a sermon on New Year's Day of 1773.", "prediction 3": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton (1725\u20131807). Newton wrote the words from personal experience. \"Amazing Grace\" was written to illustrate a sermon on New Year's Day of 1773.", "prediction 4": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton (1725\u20131807). Newton grew up without any particular religious conviction, but his life's path was formed by a variety of twists and coincidences that were often put into motion by others' reactions to what they took as his recalcitrant insubordination. It was written to illustrate a sermon on New Year's Day of 1773. \"Amazing Grace\" was written to illustrate a sermon on New Year's Day of 1773. It is unknown if there was any music accompanying the verses; it may have simply been chanted by the congregation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 141 }, { "error type": "Unverifiable", "explanation": "", "start": 240, "end": 248 }, { "error type": "Unverifiable", "explanation": "", "start": 264, "end": 283 }, { "error type": "Unverifiable", "explanation": "", "start": 284, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 329, "end": 537 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Amazing Grace\" is a Christian hymn published in 1779, with words written by the English poet and Anglican clergyman John Newton. Newton wrote the words from personal experience. He grew up without any particular religious conviction, but his life's path was formed by a variety of twists and coincidences that were often put into motion by others' reactions to what they took as his recalcitrant insubordination. Chris Tomlin has a song called \"Amazing Grace (My Chains are Gone)\". In 2008, Tomlin held 6 spots on \"20 The Countdown Magazine\"'s top 20 praise and worship songs." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the greatest love of all written?", "passages": [ [ "The Greatest Love of All", "The song's music was composed by Michael Masser, and its lyrics were written by Linda Creed, in 1976 for \"The Greatest,\" a film based on the life of former heavyweight boxing champion Muhammad Ali.", "According to the \"Los Angeles Times,\" after he had been asked to write the song for the movie, Masser felt drawn to Jerusalem, even though he was not a religious man, \"to get the feelings--not just my own.\"", "Masser also told the \"L. A. Times\" his special feelings about Ali:\n\nHere was a man who wanted to change his name and religion.", "That's all.", "Ali hadn't believed in the war in Vietnam and had refused to fight in it.", "He won that battle through the legal system.", "Still, he lost everything--including his title.", "But Ali retained the most important thing of all--his dignity.", "In an interview with \"Ocala Star-Banner\" in 1988, similarly, Masser said that \"He (Ali) represented to me a tremendous athlete who suffered prejudice from the white man's world.", "He didn't give up what he believed even though he lost his title.\"", "Masser also told the \"L. A." ], [ "The Greatest Love of All (TV series)", "The Greatest Love of All (TV series)\n\nThe Greatest Love of All (Chinese: \u7231\u00b7\u7279\u522b\u7684\u4f60) is a Singaporean Chinese drama which was telecast on Singapore's free-to-air channel, MediaCorp Channel 8.", "It made its debut on 29 May 2007, and ended on 25 June 2007.", "This drama serial consists of 20 episodes, and was screened on every weekday night at 2100h.", "This drama serial mainly showcases cases of children who are autistic and those suffering from dyslexia.", "Through these cases, the drama hopes to reiterate to the audience to give children suffering from these type of illnesses a little more respect and care.", "When Wenxin (Joanne Peh) was a child, she had severe dyslexia and was kept out of all mainstream educational institutions.", "However, her parents' unfailing love and support gave her the strength to complete her studies and graduate from university.", "She then becomes a social worker to help more disabled children lead healthy lives.", "Kaixin (Fu Fangrong) is a little girl with a slightly lower I.Q. and is enrolled into a school for students with special needs.", "Her parents, Yingxiong (Huang Yiliang) and Lihua (Aileen Tan) are not highly educated and do not know how to cope with a child like her." ] ], "gold": "Various artistic products sharing the name \"The Greatest Love of All\" have been released thoughout the years. One of them is a 2007 Singaporean Chinese drama TV series which was written in between 29 May \u2013 25 June 2007 and telecast on Singapore's free-to-air channel, MediaCorp Channel 8. There is also a song by the same name that was composed by Michael Masser and had its lyrics written by Linda Creed in 1976 for \"The Greatest\", a film based on the life of former heavyweight boxing champion Muhammad Ali.", "prediction 1": "The Greatest Love of All, a song composed by Michael Masser and its lyrics written by Linda Creed, was written in 1976 for The Greatest, a film based on the life of former heavyweight boxing champion Muhammad Ali. The Greatest Love of All is a Singaporean Chinese drama which was telecast on Singapore's free-air channel, MediaCorp Channel 8. The first episode aired on 29 May 2007 and ended on 25 June 2007.", "prediction 2": "The greatest love of all was written in 1976 for the film The Greatest, a biopic about former heavyweight boxing champion Muhammad Ali. The song's music was composed by Michael Masser, and its lyrics were written by Linda Creed, in 1976 for The Greatest, a documentary about Muhammad Ali. The Greatest Love of All is also the title of a TV series which was telecast on Singapore's free-to-air channel, MediaCorp Channel 8. The series made its debut on 29 May 2007, and ended on 25 June 2007.", "prediction 3": "The greatest love of all's music was composed by Michael Masser, and its lyrics were written by Linda Creed, in 1976 for The Greatest, a movie based on the life of former heavyweight boxing champion Muhammad Ali. The Greatest Love of All is also the title of a television series that was telecast on MediaCorp Channel 8, which mainly showcases cases of children who are autistic and those suffering from dyslexia. The Greatest Love of All is a Singaporean Chinese drama serial which was telecast on MediaCorp Channel 8. It made its debut on 29 May 2007, and ended on 25 June 2007 and ended on 25 June 2007.", "prediction 4": "The greatest love of all is a song that was written by Linda Creed and composed by Michael Masser for the film The Greatest, which is based on the life of former heavyweight boxing champion Muhammad Ali. It was adapted for a Chinese television series, The Greatest Love of All. The song was originally composed and released in 1976.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Greatest Love of All, a song composed by Michael Masser and its lyrics written by Linda Creed, was written in 1976 for The Greatest, a film based on the life of former heavyweight boxing champion Muhammad Ali. The Greatest Love of All is a Singaporean Chinese drama which was telecast on Singapore's free-air channel, MediaCorp Channel 8. The first episode aired on 29 May 2007 and ended on 25 June 2007." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where does the show death in paradise take place?", "passages": [ [ "Saint Marie (fictional island)", "Saint Marie (fictional island)\n\nSaint Marie is a fictional island in the Lesser Antilles which serves as the setting for the BBC crime drama television series \"Death in Paradise\".", "Saint Marie is described in Episode 3.3 as a \"pretty island\" that is \"situated in the Eastern Caribbean Sea\" and \"one-tenth the size of its north-west neighbour Guadeloupe\", which would make Saint Marie about in size.", "It is described in Episode 4.5 as being 70 miles from Martinique.", "The island is a British Overseas Territory, but was handed over to the British from the French only in the 1970s, so that about 30% of its people are French citizens, with the French language still widely spoken.", "The back-story appears to be a blend of two real-world islands near to Guadeloupe, with size and location aligning with Marie-Galante (in real-life politically affiliated with Guadeloupe, not independent of it), and history and language aligning with Dominica.", "Another possible basis is \u00celet Sainte Marie \"The is an island located on the northeast coast of Martinique, right in front of the small town of Sainte-Marie, known in the North Atlantic region.", "Very popular with tourists, it is a geological curiosity of nature, as connected to the rest of the island by a tombolo.\"" ], [ "Death in Paradise (TV series)", "Death in Paradise (TV series)\n\nDeath in Paradise is a British-French crime drama television series created by Robert Thorogood, starring Ben Miller (series 1\u20133), Kris Marshall (series 3\u20136) and Ardal O'Hanlon (series 6\u2013present).", "The programme is a joint UK and French production filmed on the French Caribbean island of Guadeloupe and broadcast on BBC One in the United Kingdom and France 2 in France.", "\"Death in Paradise\" has enjoyed high ratings, leading to repeated renewals.", "A seventh series began broadcasting on 4 January 2018, with an eighth for 2019 already commissioned, with O'Hanlon and Jobert confirmed to return.", "British detective Richard Poole (Ben Miller) is assigned to investigate the murder of a British police officer on the fictional Caribbean island of Saint Marie.", "After he successfully finds the murderer, he is reluctantly required by his supervisors to replace the victim and stay on as the detective inspector (DI) of the island, solving new cases as they appear, and being the object of many fish-out-of-water jokes.", "At the start of Series 3, Poole is killed and uncoordinated London detective Humphrey Goodman (Kris Marshall) arrives to investigate the death of his strait-laced predecessor.", "He then stays in the job as chief investigator on the island." ] ], "gold": "Death in Paradise is a British- french crime drama about British detective Richard Poole, assigned to investigate the murder of a British police officer on the fictional Caribbean island of Saint Marie. The show is filmed on the French Caribbean island of Guadeloupe. ", "prediction 1": "Death in Paradise is a British-French crime drama television series created by Robert Thorogood, starring Ben Miller (series 1\u20133), Kris Marshall (series 3\u20136) and Ardal O'Hanlon (series 6\u2013present) and broadcast on BBC One in the United Kingdom and France 2 in France.", "prediction 2": "Death in Paradise is a crime drama television series created by Robert Thorogood and filmed on the French Caribbean island of Guadeloupe. The show is a joint UK and French production, and takes place in Saint Marie, a fictional island in the Lesser Antilles.", "prediction 3": "Death in Paradise is a British-French crime drama television series created by Robert Thorogood, starring Ben Miller in the first three series and Kris Marshall in the final six. The show takes place on Saint Marie, a fictional island in the Lesser Antilles that is the setting for the BBC crime drama television series.", "prediction 4": "Death in Paradise is a British-French crime drama television series created by Robert Thorogood, starring Ben Miller (series 1\u20133), Kris Marshall (series 3\u20136) and Ardal O'Hanlon (series 6\u2013present). The programme is a joint UK and French production, filmed on the French Caribbean island of Guadeloupe and broadcast on BBC One in the United Kingdom and France 2 in France. The show takes place on Saint Marie, a fictional island in the Lesser Antilles which serves as the setting for the BBC crime drama television series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 266 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Death in Paradise is a British-French crime drama television series. It is filmed on the French Caribbean island of Guadeloupe. British detective Richard Poole is assigned to investigate the murder of a British police officer on the fictional Caribbean island of Saint Marie." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where is st lawrence river located in canada?", "passages": [ [ "Saint Lawrence River", "Saint Lawrence River\n\nThe Saint Lawrence River (; Tuscarora: \"Kahnaw\u00e1\u02bckye\"; Mohawk: \"Kaniatarowanenneh\", meaning \"big waterway\") is a large river in the middle latitudes of North America.", "The Saint Lawrence River flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin.", "It traverses the Canadian provinces of Quebec and Ontario, and is part of the international boundary between Ontario, Canada, and the U.S. state of New York.", "This river also provides the basis of the commercial Saint Lawrence Seaway.", "The Saint Lawrence River begins at the outflow of Lake Ontario and flows adjacent to Gananoque, Brockville, Morristown, Ogdensburg, Massena, Cornwall, Montreal, Trois-Rivi\u00e8res, and Quebec City before draining into the Gulf of Saint Lawrence, the largest estuary in the world.", "The estuary begins at the eastern tip of \u00cele d'Orl\u00e9ans, just downstream from Quebec City.", "The river becomes tidal around Quebec City.", "The Saint Lawrence River runs from the farthest headwater to the mouth and from the outflow of Lake Ontario.", "These numbers include the estuary; without the estuary the length from Lake Ontario is ca.", "500 km (ca. 300 mi)." ], [ "Saint Lawrence River", "The farthest headwater is the North River in the Mesabi Range at Hibbing, Minnesota.", "Its drainage area, which includes the Great Lakes, the world's largest system of freshwater lakes, is , of which is in Canada and is in the United States.", "The basin covers parts of Ontario and Quebec in Canada, parts of Illinois, Indiana, Minnesota, New York, Ohio, Pennsylvania, Vermont, and Wisconsin, and nearly the entirety of the state of Michigan in the United States.", "The average discharge below the Saguenay River is .", "At Quebec City, it is .", "The average discharge at the river's source, the outflow of Lake Ontario, is .", "The Saint Lawrence River includes Lake Saint-Louis south of Montreal, Lake Saint Francis at Salaberry-de-Valleyfield and Lac Saint-Pierre east of Montreal.", "It encompasses four archipelagoes: the Thousand Islands chain near Alexandria Bay, New York and Kingston, Ontario; the Hochelaga Archipelago, including the Island of Montreal and \u00cele J\u00e9sus (Laval); the Lake St.\u00a0Pierre Archipelago (classified biosphere world reserve by the UNESCO in 2000) and the smaller Mingan Archipelago.", "Other islands include \u00cele d'Orl\u00e9ans near Quebec City and Anticosti Island north of the Gasp\u00e9.", "It is the second longest river in Canada." ] ], "gold": "The St. Lawrence River is a large river in the middle latitudes of North America. The St. Lawrence flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. It traverses the Canadian provinces of Ontario and Quebec, and is part of the international boundary between Ontario, Canada, and the U.S. state of New York. This river provides the basis for the commercial St. Lawrence Seaway. Today, the Saint Lawrence River begins at the outflow of Lake Ontario and flows adjacent to Gananoque, Brockville, Morristown, Ogdensburg, Massena, Cornwall, Montreal, Trois-Rivi\u00e8res, and Quebec City before draining into the Gulf of Saint Lawrence, the largest estuary in the world.", "prediction 1": "The Saint Lawrence River is a large river in the middle latitudes of North America. It flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. The Saint Lawrence River runs from the farthest headwater to the mouth and from the outflow of Lake Ontario.", "prediction 2": "The Saint Lawrence River, or Saint Lawrence River, is a large river in the middle latitudes of North America. The river flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin.", "prediction 3": "Saint Lawrence River is a large river in the middle latitudes of North America, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. It is located in Quebec and Ontario, Canada. The river flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. The Saint Lawrence River runs from the farthest headwater to the mouth and from the outflow of Lake Ontario, and then drains into the Gulf of Saint Lawrence, the largest estuary in the world.", "prediction 4": "The Saint Lawrence River is a large river in the middle latitudes of North America, which flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. It traverses the Canadian provinces of Quebec and Ontario, and is part of the international boundary between Ontario, Canada, and the U.S. state of New York. It flows adjacent to Gananoque, Brockville, Morristown, Ogdensburg, Massena, Cornwall, Montreal, Trois-Rivi\u00e8res, and Quebec City before draining into the Gulf of Saint Lawrence, the largest estuary in the world. The length is ca. 500 km (ca. 300 mi).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 358 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Saint Lawrence River is a large river in the middle latitudes of North America. It flows in a roughly north-easterly direction, connecting the Great Lakes with the Atlantic Ocean and forming the primary drainage outflow of the Great Lakes Basin. It traverses the Canadian provinces of Quebec and Ontario, and is part of the international boundary between Ontario, Canada, and the U.S. state of New York. This river also provides the basis of the commercial Saint Lawrence Seaway. The Saint Lawrence River begins at the outflow of Lake Ontario and flows adjacent to Gananoque, Brockville, Morristown, Ogdensburg, Massena, Cornwall, Montreal, Trois-Rivi\u00e8res, and Quebec City before draining into the Gulf of Saint Lawrence, the largest estuary in the world. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who sang background vocals on my sweet lord?", "passages": [ [ "My Sweet Lord", "My Sweet Lord\n\n\"My Sweet Lord\" is a song by English musician George Harrison, released in November 1970 on his triple album \"All Things Must Pass\".", "It was also released as a single, Harrison's first as a solo artist, and topped charts worldwide; it was the biggest-selling single of 1971 in the UK.", "In America and Britain, the song was the first number-one single by an ex-Beatle.", "Harrison originally gave the song to his fellow Apple Records artist Billy Preston to record; this version, which Harrison co-produced, appeared on Preston's \"Encouraging Words\" album in September 1970.", "Harrison wrote \"My Sweet Lord\" in praise of the Hindu god Krishna, while intending the lyrics as a call to abandon religious sectarianism through his blending of the Hebrew word \"hallelujah\" with chants of \"Hare Krishna\" and Vedic prayer.", "The recording features producer Phil Spector's Wall of Sound treatment and heralded the arrival of Harrison's slide guitar technique, which one biographer described as \"musically as distinctive a signature as the mark of Zorro\".", "Preston, Ringo Starr, Eric Clapton, and the group Badfinger are among the other musicians on the recording." ], [ "My Sweet Lord", "Recording took place at Olympic Studios in London, in January 1970,\"Encouraging Words\", Apple Records (retrieved 18 February 2012). with Preston as principal musician, supported by the guitarist, bass player and drummer from the Temptations' backing band.", "The Edwin Hawkins Singers happened to be on tour in the UK as well, so Harrison invited them to participate; Hawkins' gospel group also overdubbed vocals onto the Harrison\u2013Preston collaboration \"Sing One for the Lord\" at this time.", "Preston's version of \"My Sweet Lord\" differs from Harrison's later reading in that the \"\"hallelujah\"\" refrain appears from the start of the song and, rather than the full mantra section, the words \"\"Hare Krishna\"\" are sung only twice throughout the whole track.", "With the Vedic prayer likewise absent, Simon Leng views this original recording as a possible \"definitive 'roots' take'\" of the song, thanks to its \"pure gospel groove\" and Hawkins' participation.", "In his review of \"Encouraging Words\", Bruce Eder of AllMusic describes \"My Sweet Lord\" and \"All Things Must Pass\" (another Harrison composition originally given to Preston to record) as \"stunning gospel numbers\u00a0... that make the Harrison versions seem pallid\"." ], [ "My Sweet Lord", "With Phil Spector co-producing the sessions at Abbey Road Studios, Preston again played on the track, along with Clapton, Ringo Starr, Jim Gordon and all four members of Badfinger.", "The identity of the remaining musicians has traditionally been open to question, with drummer Alan White once claiming he played on the song, with Carl Radle on bass, Starr on tambourine and John Lennon among the rhythm guitarists.", "The common view, following research by Simon Leng, is that Harrison and Spector chose from a number of rhythm tracks before selecting the master take, which featured, among others, Klaus Voormann on bass and Gary Wright on a second keyboard; Bruce Spizer suggests that Peter Frampton may have added acoustic guitar after the main session.", "Harrison's original vocal appears to have been acceptable, according to notes written by Spector in August, but the chorus vocals (all sung by Harrison and credited to \"the George O'Hara-Smith Singers\"), his harmonised slide guitar parts, and John Barham's orchestral arrangement were overdubbed during the next two months, partly at Trident Studios in central London.", "Leng describes the recording as a \"painstakingly crafted tableau\" of sound, beginning with a bank of \"chiming\" acoustic guitars and the \"flourish\" of zither strings that introduces Harrison's slide-guitar motif." ] ], "gold": "\"My Sweet Lord\" is a song by English musician George Harrison, released first as a single and then on his triple album \"All Things Must Pass\" in November 1970. It was also Harrison's first single as a solo artist, and topped charts worldwide, particularly being the biggest-selling single of 1971 in the UK. Principal recording took place at EMI Studio, where the chorus and background vocals were recorded by George Harrison, Phil Spector, Eric Clapton, Bobby Whitlock, Cyril, Betty. Nonetheless, they were later credited to the \"George O\u2019Hara-Smith Singers\".", "prediction 1": "\"My Sweet Lord\" is a song by English musician George Harrison, released in November 1970 on his triple album All Things Must Pass. The song was also released as a single, Harrison's first as a solo artist, and topped charts worldwide; it was the biggest-selling single of 1971 in the UK. The Edwin Hawkins Singers happened to be on tour in the UK as well, so Harrison invited them to participate; Hawkins' gospel group also overdubbed vocals onto the Harrison\u2013Preston collaboration \"Sing One for the Lord\" at this time.", "prediction 2": "\"My Sweet Lord\" is a song by English singer-songwriter George Harrison, released in November 1970 on his triple album All Things Must Pass. It was also released as a single, Harrison's first as a solo artist, and topped charts worldwide; it was the biggest-selling single of 1971 in the UK. Hawkins' gospel group also overdubbed vocals onto the Harrison\u2013Preston collaboration \"Sing One for the Lord\" at this time.", "prediction 3": "There are several versions of George Harrison's song My Sweet Lord. The Edwin Hawkins Singers sang the background vocals on the song. Harrison originally gave the song to fellow Apple Records artist Billy Preston to record. Harrison's original vocal appears to have been acceptable, according to notes written by Spector in August, but the chorus vocals (all sung by Harrison and credited to \"the George O'Hara-Smith Singers\"), his harmonised slide guitar parts, and John Barham's orchestral arrangement were overdubbed during the next two months, partly at Trident Studios in central London.", "prediction 4": "\"My Sweet Lord\" is a song by English musician George Harrison, released in November 1970 on his triple album All Things Must Pass. Harrison originally gave the song to his fellow Apple Records artist Billy Preston to record; this version, which Harrison co-produced, appeared on Preston's Encouraging Words album in September 1970. The backing vocals on My Sweet Lord were sung by Harrison, with backing vocals credited to \"the George O'Hara-Smith Singers\" and harmonised slide guitar parts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 519 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"My Sweet Lord\" is a song by English musician George Harrison, released in November 1970 on his triple album All Things Must Pass. The song was also released as a single, Harrison's first as a solo artist, and topped charts worldwide; it was the biggest-selling single of 1971 in the UK. Recording took place at Olympic Studios in London, where George Harrison, Phil Spector, Eric Clapton, Bobby Whitlock, Cyril, Betty are among the other musicians on the recording. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has a grammy oscar tony and emmy?", "passages": [ [ "Triple Crown of Acting", "Triple Crown of Acting\n\nThe Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Academy Award, Emmy Award, and Tony Award in the acting categories.", "As of June 2018, twenty-four people have achieved the triple crown of acting (15 women, 9 men).", "Helen Hayes's Emmy Award win on February 5, 1953, made her the first person to achieve the triple crown.", "Thomas Mitchell became the first man to achieve the triple crown with his Tony Award win later the same year on March 29, 1953.", "Hayes and Rita Moreno are the only triple crown winners in competitive acting categories who have also won a Grammy Award to complete the EGOT.", "American actress Helen Hayes (1900\u20131993) was the first performer to achieve the triple crown of acting.", "She completed the triple crown in 1953.", "Hayes was a 9-time Emmy (1), 3-time Tony (2), and 2-time Oscar (2) nominee, for a total of 14 TC nominations.", "She won two Oscars, two Tonys and an Emmy for a total of five competitive triple crown awards.", "She also won a Grammy in 1977 for Best Spoken Word Recording to complete the EGOT, for competitive Emmy, Grammy, Oscar and Tony wins.", "Hayes is one of only two Triple Crown winners (along with Rita Moreno) to have achieved the EGOT." ] ], "gold": "A small group of people have won awards for their work in television, recording, movie, and theatre, for which they received four different awards. They each received an Emmy, a Grammy, an Oscar, and a Tony Award. The people who have won all four awards, all in competitive categories, are Richard Rodgers, Helen Hayes, Rita Moreno, John Gielgud, Audrey Hepburn, Marvin Hamlisch, Jonathan Tunick, Mel Brooks, Mike Nichols, Whoopi Goldberg, Scott Rudin, Robert Lopez, John Legend, Andrew Lloyd Webber, Tim Rice. The people who won all four awards, which includes non-competitive categories, are Barbra Streisand, Liza Minelli, James Earl Jones, Alan Menken, Harry Belafonte, Quincy Jones.", "prediction 1": "The Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Oscar, Emmy Award, and Tony Award in the acting categories. As of June 2018, twenty-four people have achieved the triple crown of acting (15 women, 9 men). Helen Hayes' Emmy Award win on February 5, 1953, made her the first person to achieve the triple crown. Thomas Mitchell became the first man to achieve the triple crown with his Tony Award win later the same year on March 29, 1953. Rita Moreno are the only triple crown winners in competitive acting categories who have also won a Grammy Award to complete the EGOT.", "prediction 2": "The Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Emmy Award, Tony Award, and Oscar Award in the acting categories. Helen Hayes and Rita Moreno are the only triple crown winners in competitive acting categories who have also won a Grammy Award to complete the EGOT, for competitive triple crown awards. Thomas Mitchell became the first man to achieve the triple crown with his Tony Award win later the same year on March 29, 1953.", "prediction 3": "The Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Academy Award, Emmy Award, and Tony Award in the acting categories. Helen Hayes was the first performer to achieve the triple crown, completing the triple crown in 1953. Rita Moreno was the only triple crown winner in competitive acting categories who also won a Grammy Award to complete the EGOT. Hayes and Rita Moreno are the only triple crown winners in competitive acting categories who have also won a Grammy Award to complete the EGOT, for competitive triple crown wins.", "prediction 4": "The Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Oscar, Emmy, and Tony Award in the acting categories. Helen Hayes completed the triple crown in 1953 and was the first performer to achieve the triple crown and also won a Grammy Award. Rita Moreno is the only triple crown winner in the competitive acting categories who has also won a Grammy Award to complete the EGOT, for competitive Emmy, Grammy, Oscar and Tony wins.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Triple Crown of Acting is a term used in the American entertainment industry to describe actors who have won a competitive Oscar, Emmy Award, and Tony Award in the acting categories. As of June 2018, twenty-four people have achieved the triple crown of acting (15 women, 9 men). Helen Hayes' Emmy Award win on February 5, 1953, made her the first person to achieve the triple crown. Thomas Mitchell became the first man to achieve the triple crown with his Tony Award win later the same year on March 29, 1953. Rita Moreno are the only triple crown winners in competitive acting categories who have also won a Grammy Award to complete the EGOT." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When was five nights at freddy's 2 made?", "passages": [ [ "Five Nights at Freddy's 2", "Five Nights at Freddy's 2\n\nFive Nights at Freddy's 2 (often abbreviated to FNaF2) is an indie point-and-click survival horror video game created by Scott Cawthon.", "It is the second installment in the \"Five Nights at Freddy's\" series, and is chronologically set before the events of the first game.", "The game was released on Steam on November 10, 2014, earlier than its two planned dates of sometime in 2015 and December 25, 2014, respectively, with the latter due to issues with releasing the demo.", "Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively.", "Similar to the previous game, \"Five Nights at Freddy's 2\" centers around the fictional Freddy Fazbear's Pizza, where the player acts as a security guard and must defend himself from the restaurant's animatronic mascots, who are possessed by the souls of murdered children out for revenge on their murderer.", "The game also introduces several new gameplay components, such as a flashlight and 8-bit minigames.", "The game received mixed to positive reviews from critics, praising the new mechanics but criticizing its difficulty in comparison with its predecessor.", "A sequel to the game, \"Five Nights at Freddy's 3\", was released on March 2, 2015." ] ], "gold": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game developed and published by Scott Cawthon. The second installment in the Five Nights at Freddy's series, the game is chronologically set before the events of the first game, making it a prequel to the series. It was made available on Steam on November 11, 2014 and followed by a release on Android on November 15, 2014 and iOS on November 20, 2014. The title finally arrived on consoles when a port was made available for the Nintendo Switch, PlayStation 4 and Xbox One on November 29, 2019.", "prediction 1": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game created by Scott Cawthon. It is the second installment in the Five Nights at Freddy's series, and is chronologically set before the events of the first game. The game was released on Steam on November 10, 2014, earlier than its two planned dates of sometime in 2015 and December 25, 2014, respectively, with the latter due to issues with releasing the demo. Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively.", "prediction 2": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game created by Scott Cawthon. The game was released on Steam on November 10, 2014, earlier than its two planned dates of sometime in 2015 and December 25, 2014, respectively, with the latter due to issues with releasing the demo. Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively.", "prediction 3": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game created by Scott Cawthon. It is the second installment in the \"Five Nights at Freddy's\" series, and is chronologically set before the events of the first game. The game was released on Steam on November 10, 2014, earlier than its two planned dates of sometime in 2015 and December 25, 2014, respectively, with the latter due to issues with releasing the demo. Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively, and November 13, 2014, respectively, and November 13, 2014, respectively.", "prediction 4": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game created by Scott Cawthon. It is the second installment in the Five Nights at Freddy's series, and is chronologically set before the events of the first game. The game was released on Steam on November 10, 2014, earlier than its two planned dates of sometime in 2015 and December 25, 2014, respectively, with the latter due to issues with releasing the demo. Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively, and November 13, 2014, respectively.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 438 } ], "missing-info": [], "corrected-prediction": "Five Nights at Freddy's 2 is an indie point-and-click survival horror video game created by Scott Cawthon. It is the second installment in the Five Nights at Freddy's series, and is chronologically set before the events of the first game. The game was released on Steam on November 10, 2014. Mobile ports for Android and iOS were released on November 13, 2014, and November 20, 2014, respectively." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who scored 300 runs in test match for india?", "passages": [ [ "Virender Sehwag", "Sehwag continued his good form against South Africa, in the home series in April 2008, scoring 319 in the first Test at M. A. Chidambaram Stadium in Chennai, having reached 300 off just 278 balls, the fastest triple century in test history.", "Sehwag became only the third batsman after Sir Donald Bradman and Brian Lara to score 2 triple centuries in Test Cricket.", "He scored 257 runs the third day of the match, which was the most runs scored by an individual batsman on a single day of a Test match since 1954, when Dennis Compton made 273 runs on the second day of the Nottingham Test against Pakistan.", "He has a habit of making big centuries, with his last eleven centuries having all been over 150, including two triple centuries and further three double centuries which surpassed Sir Donald Bradman's record of having seven consecutive centuries beyond 150.", "In the first test against England in Chennai in December 2008, Sehwag's rapid 83 off just 68 balls, in the last session of the fourth day, set India up for its record run-chase of 4/387, the highest successful target on Indian soil.", "He got the man-of-the-match award despite Sachin Tendulkar scoring an unbeaten century later in the same innings and Andrew Strauss scoring a century in each of England's innings." ], [ "Virender Sehwag", "Virender Sehwag\n\nVirender Sehwag (born 20 October 1978) is a former Indian cricketer.", "Widely regarded as one of the most destructive batsmen of all time, Sehwag played as an aggressive right-handed opening batsman and also bowled part-time right-arm off-spin.", "He played his first One Day International in 1999 and joined the Indian test side in 2001.", "In April 2009, Sehwag became the first Indian to be honoured as the Wisden Leading Cricketer in the World for his performance in 2008, subsequently becoming the first player of any nationality to retain the award for 2009.", "He is the former Occasional captain of India, former Vice-Captain of India, former captain of Delhi Daredevils and former captain of Delhi Ranji Team.", "Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai)." ], [ "Virender Sehwag", "In Tests, Sehwag has scored centuries against all the Test-cricket playing nations except Bangladesh and Zimbabwe, and is sixth on the list of leading Test century makers for India.", "In 2001, he became the eleventh Indian player to score a century on Test debut, with 105 runs against South Africa.", "His centuries have been scored at fourteen cricket grounds, eight of which were outside India.", "He has made six scores of 200 runs or more, the most by an Indian batsman, of which a record three have come against Pakistan.", "Sehwag is the only Indian to have scored a triple century (300 or more runs), and has done so twice\u2014309 against Pakistan in Multan in 2004 and 319 against South Africa in Chennai in 2008, the later being the fastest triple century in Test cricket with 300 coming up off just 278 balls.", "In ODIs, Sehwag's maiden century was made against New Zealand at the Sinhalese Sports Club, Colombo in 2001.", "His highest score of 219, the highest ODI score ever, was made against the West Indies at the Holkar Cricket Stadium in Indore.", "He has been dismissed five times in the nineties." ] ], "gold": "A triple century, which is an individual score of 300 or more, in Test cricket has been scored on 31 occasions by 27 batsmen from eight of the twelve Test-cricket playing nations. Former cricketer Virender Sehwag, became one of three people to reach 300 more than once in 2008 and 2009, and he was the first Indian to be honored as the Wisden Leading Cricketer in the World both years in a row. Karun Nair made his Test cricket debut in 2016 against England and became the third player in international cricket to convert his maiden century into a triple century, by scoring an unbeaten 303 against England in his third Test.", "prediction 1": "Virender Sehwag scored 300 runs in a Test match for India in April 2008. Sehwag scored 319 runs in the first Test against South Africa in April 2008. Sehwag's fastest triple century in Test history came off just 278 balls. Sehwag's 257 runs on the third day of the match was the most runs scored by an individual batsman on a single day of a Test match since 1954, when Dennis Compton made 273 runs on the second day of the Nottingham Test against Pakistan.", "prediction 2": "Virender Sehwag scored a triple century in a Test match for India in April 2008, in the first Test against South Africa at M. A. Chidambaram Stadium in Chennai. Sehwag has also scored 257 runs on the third day of the match, which was the most runs scored by an individual batsman on a single day of a Test match since 1954, when Dennis Compton made 273 runs on the second day of the Nottingham Test against Pakistan.", "prediction 3": "Virender Sehwag scored 319 runs in a Test match for India against South Africa in April 2008. Sehwag is the only Indian to have scored a triple century (300 or more runs) and has done so twice\u2014309 against Pakistan in Multan in 2004 and 319 against South Africa in Chennai in 2008.", "prediction 4": "Virender Sehwag scored 300 runs in a Test match for India against South Africa in 2008. Sehwag became only the third batsman after Sir Donald Bradman and Brian Lara to score 2 triple centuries in Test cricket.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 61, "end": 72 }, { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 457 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Virender Sehwag scored 300 runs in a Test match for India in 2004 and 2008. Sehwag became the first Indian to be honoured as the Wisden Leading Cricketer in the World for two years in a row. Sehwag became only the third batsman to score 2 triple centuries in Test Cricket. A triple century is 300 or more runs." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Billy from days of our lives real name?", "passages": [ [ "Billie Reed", "Billie Reed\n\nBillie Reed is a fictional character from the NBC soap opera, \"Days of Our Lives\".", "Created by writer Sheri Anderson, Billie did not know her mother was Kate Roberts until a court hearing after being accused of murdering her father, Curtis Reed.", "Billie's relationship with Bo Brady was famous to the character, and was a key reason she became such a popular character.", "The two share a daughter, Chelsea Brady.", "The role of Billie Reed was originated by actress Lisa Rinna.", "She first aired on September 18, 1992.", "After three years, Rinna vacated the role on September 28, 1995.", "The show recast the role, which led to Krista Allen assuming the role from September 6, 1996 to November 5, 1999.", "When Allen vacated the role, rumors arose that ex-Port Charles actress Julie Pinson would claim the role of Billie.", "However, Rinna was announced to reprise the role for a short-term stint.", "Rinna returned to the role in July 3, 2002 and once again vacated in January 8, 2003.", "In 2004, two years following the online rumors, Pinson was hired into the role.", "She accepted after Rinna declined to return to the show.", "Pinson debuted as Billie on September 13, 2004 and vacated the role four years later on February 5, 2008." ] ], "gold": "Billie Reed, a fictional character from the NBC soap opera Days of Our Lives, was most notably played by Lisa Rinna, who originated the role on September 18, 1992, and departed on September 28, 1995, leading the show to recast with Krista Allen from September 6, 1996 to November 5, 1999. When Allen left the show, rumors arose that ex-Port Charles actress, Julie Pinson, would take over however, Rinna was announced as returning for a short-term stint beginning July 3, 2002, until January 8, 2003, until 2004, when Pinson was hired after Rinna declined another return, and she played Billie from September 13, 2004 until February 5, 2008. In 2011, it was announced that Rinna would reprise the role of Billie once again, and she returned on March 9, 2012, only to leave again to develop a panel-focused talk show, and her final episode aired on January 30, 2013. Rinna made one more return from February 13 to 22, 2018.", "prediction 1": "The character Billie Reed is a fictional character created by writer Sheri Anderson and appeared on the NBC soap opera, Days of Our Lives. Her real name is Kate Roberts.", "prediction 2": "Billie Reed is a fictional character from the NBC soap opera, Days of Our Lives. Created by writer Sheri Anderson, Billie did not know her mother was Kate Roberts until a court hearing after being accused of murdering her father, Curtis Reed.", "prediction 3": "After being accused of murdering her father, Curtis Reed, in a court hearing, Billie Reed did not know her mother was Kate Roberts until a court hearing after being accused of murdering her father, Curtis Reed. When Krista Allen vacated the role of Billie Reed, rumors arose that ex-Port Charles actress Julie Pinson would claim the role of Billie. However, Rinna was announced to reprise the role for a short-term stint. Pinson debuted as Billie on September 13, 2004 and vacated the role four years later on February 5, 2008.", "prediction 4": "Billie Reed is a fictional character created by writer Sheri Anderson for the NBC soap opera, \"Days of Our Lives.\" Billie did not know her mother was Kate Roberts until a court hearing after being accused of murdering her father, Curtis Reed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 138 }, { "error type": "Unverifiable", "explanation": "", "start": 139, "end": 169 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 14 ] } ], "corrected-prediction": "Billie Reed, a fictional character from the NBC soap opera Days of Our Lives. The role of Billie Reed was originated by actress Lisa Rinna. She first aired on September 18, 1992. After three years, Rinna vacated the role on September 28, 1995. The show recast the role, which led to Krista Allen assuming the role from September 6, 1996 to November 5, 1999. When Allen vacated the role, rumors arose that ex-Port Charles actress Julie Pinson would claim the role of Billie. Rinna returned to the role in July 3, 2002 and once again vacated in January 8, 2003. In 2004, two years following the online rumors, Pinson was hired into the role. Pinson debuted as Billie on September 13, 2004 and vacated the role four years later on February 5, 2008." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When was television introduced to the general public?", "passages": [ [ "Television", "Since human faces had inadequate contrast to show up on his primitive system, he televised a ventriloquist's dummy named \"Stooky Bill\", whose painted face had higher contrast, talking and moving.", "By 26 January 1926, he demonstrated the transmission of the image of a face in motion by radio.", "This is widely regarded as the first television demonstration.", "The subject was Baird's business partner Oliver Hutchinson.", "Baird's system used the Nipkow disk for both scanning the image and displaying it.", "A bright light shining through a spinning Nipkow disk set with lenses projected a bright spot of light which swept across the subject.", "A Selenium photoelectric tube detected the light reflected from the subject and converted it into a proportional electrical signal.", "This was transmitted by AM radio waves to a receiver unit, where the video signal was applied to a neon light behind a second Nipkow disk rotating synchronized with the first.", "The brightness of the neon lamp was varied in proportion to the brightness of each spot on the image.", "As each hole in the disk passed by, one scan line of the image was reproduced.", "Baird's disk had 30 holes, producing an image with only 30 scan lines, just enough to recognize a human face.", "In 1927, Baird transmitted a signal over of telephone line between London and Glasgow." ], [ "History of television", "In 1931, he made the first outdoor remote broadcast, of The Derby.", "In 1932, he demonstrated ultra-short wave television.", "Baird's mechanical system reached a peak of 240 lines of resolution on BBC television broadcasts in 1936, though the mechanical system did not scan the televised scene directly.", "Instead, a 17.5mm film was shot, rapidly developed and then scanned while the film was still wet.", "An American inventor, Charles Francis Jenkins, also pioneered the television.", "He published an article on \"Motion Pictures by Wireless\" in 1913, but it was not until December 1923 that he transmitted moving silhouette images for witnesses.", "On June 13, 1925, Jenkins publicly demonstrated the synchronized transmission of silhouette pictures.", "In 1925, Jenkins used a Nipkow disk and transmitted the silhouette image of a toy windmill in motion, over a distance of five miles (from a naval radio station in Maryland to his laboratory in Washington, D.C.), using a lensed disk scanner with a 48-line resolution.", "He was granted U.S. patent 1,544,156 (Transmitting Pictures over Wireless) on June 30, 1925 (filed March 13, 1922).", "On December 25, 1925, Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan." ], [ "History of television", "This small tube could amplify a signal reportedly to the 60th power or better and showed great promise in all fields of electronics.", "A problem with the multipactor, unfortunately, was that it wore out at an unsatisfactory rate.", "At the Berlin Radio Show in August 1931, Manfred von Ardenne gave a public demonstration of a television system using a CRT for both transmission and reception.", "However, Ardenne had not developed a camera tube, using the CRT instead as a flying-spot scanner to scan slides and film.", "Philo Farnsworth gave the world's first public demonstration of an all-electronic television system, using a live camera, at the Franklin Institute of Philadelphia on August 25, 1934, and for ten days afterwards.", "In Britain the EMI engineering team led by Isaac Shoenberg applied in 1932 for a patent for a new device they dubbed \"the Emitron\", which formed the heart of the cameras they designed for the BBC.", "On November 2, 1936, a 405-line broadcasting service employing the Emitron began at studios in Alexandra Palace, and transmitted from a specially built mast atop one of the Victorian building's towers.", "It alternated for a short time with Baird's mechanical system in adjoining studios, but was more reliable and visibly superior.", "This was the world's first regular high-definition television service." ], [ "John Logie Baird", "John Logie Baird\n\nJohn Logie Baird (; 13 August 188814 June 1946) was a Scottish engineer, innovator, one of the inventors of the mechanical television, demonstrating the first working television system on 26 January 1926, and inventor of both the first publicly demonstrated colour television system, and the first purely electronic colour television picture tube.", "In 1928 the Baird Television Development Company achieved the first transatlantic television transmission.", "Baird's early technological successes and his role in the practical introduction of broadcast television for home entertainment have earned him a prominent place in television's history.", "Baird was ranked number 44 in the BBC's list of the 100 Greatest Britons following a UK-wide vote in 2002.", "In 2006, Baird was named as one of the 10 greatest Scottish scientists in history, having been listed in the National Library of Scotland's 'Scottish Science Hall of Fame'.", "In 2015 he was inducted into the Scottish Engineering Hall of Fame.", "Baird was born on 13 August 1888 in Helensburgh, Dunbartonshire, and was the youngest of four children of the Reverend John Baird, the Church of Scotland's minister for the local St Bride's Church and Jessie Morrison Inglis, the orphaned niece of a wealthy family of shipbuilders from Glasgow." ], [ "Cathode-ray tube", "Cathode-ray tube\n\nThe cathode-ray tube (CRT) is a vacuum tube that contains one or more electron guns and a phosphorescent screen, and is used to display images.", "It modulates, accelerates, and deflects electron beam(s) onto the screen to create the images.", "The images may represent electrical waveforms (oscilloscope), pictures (television, computer monitor), radar targets, or other phenomena.", "CRTs have also been used as memory devices, in which case the visible light emitted from the fluorescent material (if any) is not intended to have significant meaning to a visual observer (though the visible pattern on the tube face may cryptically represent the stored data).", "In television sets and computer monitors, the entire front area of the tube is scanned repetitively and systematically in a fixed pattern called a raster.", "An image is produced by controlling the intensity of each of the three electron beams, one for each additive primary color (red, green, and blue) with a video signal as a reference." ] ], "gold": "On March 25, 1925, Scottish inventor and innovator John Baird gave the first public demonstration of televised silhouette images in motion. A few months later, on June 13, 1925, American inventor Charles Francis Jenkins publicly demonstrated the synchronized transmission of silhouette pictures. As television technology advanced, more innovations were added to the television system. As such, Manfred von Ardenne gave a public demonstration in August 1931 of a television system using a cathode-ray tube (CRT) for both transmission and reception. On August 25, 1934, Philo Farnsworth gave the world's first public demonstration of an all-electronic television system, using a live camera. This would also coincide with the date when all-electric television were introduced to the general public.", "prediction 1": "John Logie Baird, an engineer from Glasgow, Scotland, was the first to demonstrate the mechanical television. He demonstrated the transmission of the image of a face in motion by radio, and by 26 January 1926, he demonstrated the transmission of the image of a face in motion by radio. This is widely regarded as the first television demonstration. Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan. On December 25, 1925, Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan. On June 13, 1925, Jenkins publicly demonstrated the synchronized transmission of moving silhouette images for witnesses.\n", "prediction 2": "John Logie Baird, the inventor of the mechanical television, demonstrated television with a dummy. But, by January 26, 1926, he demonstrated the transmission of the image of a face in motion by radio. This is widely regarded as the first television demonstration. Charles Francis Jenkins, the American pioneer, demonstrated television with a growing range of features, including motion pictures, but neither he nor his co-inventor John Logie Baird could create an effect that could match that of an actual television. Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and a CRT display at Hamamatsu Industrial High School in Japan.", "prediction 3": "John Logie Baird was a Scottish engineer, innovator, and one of the inventors of the mechanical television. He demonstrated its operation in June 1925 on BBC television broadcasts with the help of a live camera. On January 26, 1926, he demonstrated the transmission of the image of a face in motion by radio. Charles Francis Jenkins was also an early pioneer of the television. On June 13, 1925, Jenkins publicly demonstrated the synchronized transmission of moving silhouette images for witnesses. Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan. On December 25, 1925, Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display.", "prediction 4": "On June 13, 1925, Charles Francis Jenkins publicly demonstrated the synchronized transmission of silhouette pictures for witnesses. But it wasn't until December 23, 1923 that he transmitted moving silhouette images for witnesses. John Logie Baird, an innovator and Scottish engineer, first demonstrated the mechanical television system using a Nipkow disk set and CRT display at the Berlin Radio Show in August 1931. Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nippon disk scanner and CRT display at Hamamatsu Industrial High School in Japan. Original demonstrations were broadcasting at the Berlin Radio Show in January 1934.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "John Logie Baird, an engineer from Glasgow, Scotland, was the first to demonstrate the mechanical television. He demonstrated the transmission of the image of a face in motion by radio, ", "start": 210, "end": 285 }, { "error type": "Redundant", "explanation": "Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan.", "start": 547, "end": 722 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "John Logie Baird, an engineer from Glasgow, Scotland, was the first to demonstrate the mechanical television transmission of the image of a face in motion by radio, on 26 January 1926. This is widely regarded as the first television demonstration. Kenjiro Takayanagi demonstrated a television system with a 40-line resolution that employed a Nipkow disk scanner and CRT display at Hamamatsu Industrial High School in Japan on December 25, 1925. On June 13, 1925, American inventor, Charles Francis Jenkins publicly demonstrated the synchronized transmission of moving silhouette images for witnesses. Manfred von Ardenne gave a public demonstration in August 1931 of a television system using a cathode-ray tube (CRT) for both transmission and reception. On August 25, 1934, Philo Farnsworth gave the world's first public demonstration of an all-electronic television system, using a live camera.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who dies at the end of big little lies?", "passages": [ [ "Big Little Lies (novel)", "With the information Jane gives, Celeste and Madeline realize that the father is Perry's cousin, Saxon Banks, but decide to keep it from Jane for the time being.", "Meanwhile, Celeste's marriage becomes even more violent and she starts meeting a counselor and rents an apartment for herself, without Perry's knowledge.", "Ziggy is once again accused of bullying Amabella, though he denies it.", "Jane finds out that Ziggy is keeping a secret about who is hurting Amabella and persuades him to write down the name of the child, and it turns out to be Max, one of Celeste's twins, but she isn't sure how to broach the subject with Celeste.", "On the night of Pirriwee Public's Trivia Night, Josh tells Celeste that it is Max, not Ziggy, who is bullying the other children.", "She realizes that Max is mimicking Perry and finally decides to leave him.", "Perry finds out about Celeste's apartment, and despite being shaken, the couple still goes to the Trivia Night.", "Once they reach the school, Jane sees Perry and realizes that he is, in fact, \"Saxon Banks\" and confronts him in front of Madeline and Celeste.", "Celeste recalls Perry's childhood stories where he used his cousin's name to avoid trouble for himself.", "Perry admits to raping Jane but shows no remorse." ], [ "Big Little Lies (TV series)", "Big Little Lies (TV series)\n\nBig Little Lies is an American drama television series, based on the novel of the same name by Liane Moriarty, that premiered on February 19, 2017, on HBO.", "Created and written by David E. Kelley, the series' seven-episode first season was directed by Jean-Marc Vall\u00e9e.", "\"Big Little Lies\" stars Nicole Kidman, Reese Witherspoon and Shailene Woodley and tells the story of three emotionally troubled women in Monterey, California, who become embroiled in a murder investigation.", "Alexander Skarsg\u00e5rd, Laura Dern, Jeffrey Nordling, Adam Scott, Zo\u00eb Kravitz, and James Tupper feature in supporting roles.", "Critically acclaimed, the series garnered several accolades.", "It received 16 Emmy Award nominations and won eight, including Outstanding Limited Series and acting awards for Kidman, Skarsg\u00e5rd, and Dern.", "The trio also won Golden Globe Awards in addition to a Golden Globe Award for Best Miniseries or Television Film win for the series.", "Kidman and Skarsg\u00e5rd also received Screen Actors Guild Awards for their performances.", "Despite originally being billed as a miniseries, HBO renewed the series for a second season.", "Production on the second season began in March 2018 and is set to premiere in 2019.", "All seven episodes are being written by Kelley and directed by Andrea Arnold." ], [ "Crystal R. Fox", "Fox has received positive reviews for her performance in the show.", "In 2018, Fox was cast in a series regular role for the second season of HBO drama series \"Big Little Lies\" as Zo\u00eb Kravitz\u2019s character mother Elizabeth Howard." ] ], "gold": "Big Little Lies is an American drama television series based on the 2014 novel of the same name by Liane Moriarty, which premiered on HBO on February 19, 2017, and concluded on July 21, 2019, encompassing 14 episodes and two seasons. On the show, Bonnie's mother, Elizabeth Howard, played by Crystal R. Fox, dies in the very last episode. Perry Wright dies near the end of Big Little Lies after being pushed. Alexander Skarsg\u00e5rd portrayed Perry Wright, an abusive husband who had internal conflicts involving his insecurities about needing his wife, which earned him a Primetime Emmy Award, a Golden Globe Award, a Critics' Choice Television Award, and a Screen Actors Guild Award. ", "prediction 1": "Big Little Lies is an American television series based on the novel of the same name by Liane Moriarty. It is a murder mystery television series that aired on HBO from 2017 to 2021. The murder of Elizabeth Howard is shown at the end of the first season.", "prediction 2": "In the 2017 American drama television series Big Little Lies, the lead character, Jane Howard, dies at the end of the series. In the novel of the same name, Liane Moriarty writes of the death of Perry's cousin, Saxon Banks. In the television series, Celeste and Madeline realize that the father is Perry's cousin, Saxon Banks.", "prediction 3": "In the American TV series Big Little Lies, Perry dies while Celeste dies in a car accident. Celeste dies in a car accident during the episode \"Big Little Lies\" which is the final episode of the first season.", "prediction 4": "Big Little Lies is an American crime drama television series, based on the novel of the same name by Liane Moriarty, that premiered on February 19, 2017. The characters of the show die during the final episode of the first season, when Celeste is killed by a dog, and Perry is killed by a cat.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 173, "end": 181 }, { "error type": "Unverifiable", "explanation": "", "start": 112, "end": 126 }, { "error type": "Unverifiable", "explanation": "", "start": 186, "end": 253 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "Big Little Lies is an American drama television series based on the novel of the same name by Liane Moriarty, that premiered on February 19, 2017, on HBO. The show has a second season set to premiere in 2019. Crystal R. Fox was cast in 2018 to play as Elizabeth Howard, in the second season.\n" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who played fred claus in the 2007 film?", "passages": [ [ "Fred Claus", "Fred Claus\n\nFred Claus is a 2007 American fantasy comedy adventure film directed by David Dobkin, written by Dan Fogelman and Jessie Nelson, and starring Vince Vaughn and Paul Giamatti.", "The film was released on November 9, 2007, in the US and later released in the UK on November 30, 2007, by Warner Bros. Pictures.", "It is loosely based on the poem \"A legend of Santa and his brother Fred\" written by Donald Henkel.", "A baby is born, and within a few minutes of his birth, he starts saying: \"Ho, ho, ho!\".", "Mother Claus calls her son, Frederick, over to meet his new brother, whom she has decided to name Nicholas.", "Mother Claus lovingly refers to the new baby as her little Saint Nick.", "During Christmas, when Nick opens his gifts including Fred's, he decides to give them away to orphans which makes Fred angry.", "Mother Claus advises Fred to be a better person by stating he should be more like his brother; this in turn causes Fred to resent Nick.", "Feeling isolated, Fred often climbs a tree to confide his problems in a bird.", "On one occasion, Nick cuts down the tree, saying that now Fred can bring it inside since he liked it so much." ], [ "Fred Claus", "However, the birdhouse Fred's confidant lived in is smashed, causing the bird to leave; this causes a permanent rift between Fred and Nick.", "In the present day, it is revealed that when Nick becomes a saint due to all his good deeds, he, Fred, and Mother and Father Claus become frozen in time, never to age.", "Nick has become the modern-day Santa Claus, giving gifts to people and Fred works as a repossession agent in Chicago to take them away.", "His girlfriend, Wanda, gets mad at him for forgetting that her birthday was the next day.", "Wanda refers to a previous birthday where Fred promised to take her to France.", "When Fred gets back to his own apartment, he watches TV when a young orphan boy named Samuel \"Slam\" Gibbons comes in.", "Slam talks about wanting a puppy named Macaroni for Christmas.", "Fred is attacked by countless men dressed up as Santa and after he gets arrested, he calls his brother for $5,000 bail money.", "He also asks for an additional $50,000 for a get-rich-quick scheme.", "Nick agrees to give him the bail money, but tells him that if he wants the $50,000, he has to come to the North Pole and work for it.", "Soon after, an elf named Willie shows up to take Fred to the North Pole." ], [ "Jeremy Renner", "He starred with Minnie Driver in \"Take\" and guest starred as a patient in an episode of \"House\" as a reckless rock musician.", "Renner had a role in the pilot of \"The Oaks\" but the series was not picked up.", "After starring with Dallas Roberts in the comedy-drama \"Ingenious\" and starring in the short-lived television series \"The Unusuals\", Renner went on to achieve critical success for his portrayal of bomb disposal expert, Sergeant William James in the 2009 Iraq war thriller \"The Hurt Locker\" (directed by Kathryn Bigelow).", "The role earned him several awards in the Best Actor category and his first Academy Award nomination for Best Actor as well a Screen Actors Guild Award nomination.", "In 2010, Renner's performance in Ben Affleck's \"The Town\" alongside Jon Hamm, Blake Lively, Slaine and Michael Yebba garnered him rave reviews and his second Academy Award nomination for Best Supporting Actor.", "He also gained his first Golden Globe nomination for Best Supporting Actor and his second Screen Actors Guild nomination.", "\"The Hollywood Reporter\" named Renner as one of the young male actors who are \"pushing\u00a0\u2013 or being pushed\" into taking over Hollywood as the new \"A-List\"." ] ], "gold": "Fred Claus is the title character of the 2007 American Christmas fantasy comedy film of the same name. It is loosely based on the poem \"A legend of Santa and his brother Fred\" written by Donald Henkel. As a child, Frederick \"Fred\" Claus grew up in the shadow of his younger brother Nicholas \"Nick\". In the present, Nick has become the modern-day Santa Claus, delivering gifts to the children of the world. Fred has become a repossession agent in Chicago. Vince Vaughn plays adult Fred while Liam James plays the young character. ", "prediction 1": "Fred Claus is a 2007 American fantasy comedy adventure film directed by David Dobkin, written by Dan Fogelman and Jessie Nelson, and starring Vince Vaughn and Paul Giamatti. Vince Vaughn plays Fred Claus in the film. Jeremy Renner plays Fred Claus in the 2010 Iraq war thriller The Hurt Locker.", "prediction 2": "Fred Claus is a 2007 American fantasy-comedy film directed by David Dobkin, written by Dan Fogelman and Jessie Nelson, and starring Vince Vaughn and Paul Giamatti. It is loosely based on the poem A legend of Santa and his brother Fred written by Donald Henkel. Fred, who is an orphan, is played by Jeremy Renner. He was previously portrayed by Tom Cruise in the 1999 film The Little Mermaid.", "prediction 3": "Fred Claus is a 2007 American fantasy comedy adventure film. It is loosely based on the poem \"A legend of Santa and his brother Fred\" written by Donald Henkel. In the film, Vince Vaughn plays Fred Claus, the younger brother of Santa Claus, and Paul Giamatti plays the older brother of Santa Claus. Jeremy Renner plays Fred Claus, the older brother, in the 2009 Iraq war thriller The Hurt Locker, and his performance in Ben Affleck's The Town garnered him rave reviews and his second Academy Award nomination for Best Supporting Actor and his second nomination for Best Supporting Actor as well as well as well as well as well as well as well as well as well as his second Academy Award nomination for Best Actor and Screen Actors Guild nomination and his second Academy Award nomination for Best Supporting Actor.", "prediction 4": "Fred Claus is a 2007 American fantasy comedy adventure film directed by David Dobkin, written by Dan Fogelman and Jessie Nelson, and starring Vince Vaughn and Paul Giamatti. Vince Vaughn plays Fred Claus in the film. Jeremy Renner plays Fred Claus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 173 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 44 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 237, "end": 250 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Fred Claus is a 2007 American fantasy comedy adventure film and the character's name in the film. It is loosely based on the poem \"A legend of Santa and his brother Fred\" written by Donald Henkel. Nick has become the modern-day Santa Claus, giving gifts to people and Fred works as a repossession agent in Chicago. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is roger in daddy's home 2?", "passages": [ [ "Daddy's Home 2", "Brad enters Don into the improv show, and Dusty chooses a topic of a husband confronting his cheating wife as the subject of an improv skit, intentionally pulling at what he feels is a sore spot for Don.", "As the skit progresses, it is revealed that Don has separated from his wife in real life.", "The audience believes that this is all part of the show, even when Brad tries to tell the audience that it is not.", "The next day, Brad confronts Dusty.", "Dusty reveals that he chose the infidelity subject for the improv game because he wanted to get back at Brad, because of how Brad has a good relationship with Don.", "Inside, Sara comforts Don about his divorce in front of an eggnog bowl.", "When they leave, Megan and Adrianna take cups of alcoholic eggnog to drink.", "Brad says he knows that is why Dusty chose that particular topic, and to get back at Dusty, Brad has invited Adrianna's real dad, Roger (John Cena), to the cabin for Christmas.", "That evening, the entire family takes part in a Christmas manger representation.", "Brad gets into a fight with Dusty because he wants to play Joseph, which Dusty is currently playing.", "When Megan begins to swear, and Adrianna falls from being drunk, the crowd breaks up." ], [ "Daddy's Home 2", "In April 2016, the sequel was announced, with Will Ferrell and Mark Wahlberg reprising their roles, Sean Anders and John Morris writing the script, and Anders directing.", "In January 2017, it was reported that Mel Gibson and John Lithgow were being sought to play the main characters' fathers in the film.", "The two were later confirmed to star, along with Linda Cardellini, John Cena, Owen Vaccaro and Scarlett Estevez, reprising their roles.", "Principal photography began on March 20, 2017.", "Scenes were filmed in Concord, Massachusetts,Clinton, Massachusetts,Framingham, Massachusetts, Lawrence, Massachusetts and Great Barrington, Massachusetts.", "The film was released in the United States on November 10, 2017.", "\"Daddy's Home 2\" was released on Digital HD on February 6, 2018, and was released on Blu-ray and DVD on February 20, 2018.", "\"Daddy's Home 2\" grossed $103.8 million in the United States and Canada, and $76.6 million in other territories, for a worldwide total of $180.4 million, against a production budget of $69 million.", "In the United States and Canada, \"Daddy's Home 2\" opened alongside \"Murder on the Orient Express\", and was projected to gross around $20 million from 3,575 theaters in its opening weekend." ], [ "Daddy's Home 2", "Daddy's Home 2\n\nDaddy's Home 2 is a 2017 American Christmas comedy film directed by Sean Anders and written by Anders and John Morris.", "A sequel to \"Daddy's Home\" (2015), it stars Will Ferrell, Mark Wahlberg, Linda Cardellini, John Cena, with John Lithgow and Mel Gibson.", "The plot follows now reformed-fathers Brad and Dusty (Ferrell and Wahlberg), now co-parenting Dusty's kids, who have to deal with their own fathers (Lithgow and Gibson) visiting for the holidays.", "Principal photography on the film began in Massachusetts in March 2017 and it was released in the United States by Paramount Pictures on November 10, 2017.", "Although the film received generally negative reviews from critics, it grossed over $180 million worldwide on a $70 million budget.", "After finally becoming friends at the end of the first film, Brad Whittaker (Will Ferrell) and Dusty Mayron (Mark Wahlberg) have a co-dad system where their two children, Megan (Scarlett Estevez) and Dylan (Owen Vaccaro), take turns at each father's house.", "Dusty has also remarried, this time to Karen (Alessandra Ambrosio), a writer, and is stepdad to Adrianna (Didi Costine), Karen's daughter." ] ], "gold": "Daddy's Home 2 (known in-film as Daddy's Home Two) is a 2017 American Christmas comedy film which stars\u00a0Will Ferrell,\u00a0Mark Wahlberg,\u00a0Linda Cardellini,\u00a0John Cena, with\u00a0John Lithgow\u00a0and\u00a0Mel Gibson. Cena plays the father of Wahlberg's characters stepdaughter, Adrianna.", "prediction 1": "Roger is the character of Roger in Daddy's Home 2 and is played by John Cena. Roger is a fictional character in the 2016 film Daddy's Home. Roger is played by Brandon Sanderson in Daddy's Home 2 and by Mark Wahlberg in Daddy's Home.", "prediction 2": "Roger is a character in the 2017 American Christmas comedy film Daddy's Home 2. The character's real dad is played by John Cena. In the original 2015 film, Roger is played by Will Ferrell and Dusty Mayron.", "prediction 3": "In the 2017 American Christmas comedy film Daddy's Home 2, Roger is played by John Cena. Roger is Brad Whittaker's stepdad in the film.", "prediction 4": "Roger is the fictional character in Daddy's Home 2. John Cena plays Roger in Daddy's Home 2.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 78, "end": 139 }, { "error type": "Redundant", "explanation": "Roger", "start": 9, "end": 31 }, { "error type": "Redundant", "explanation": "Roger in Daddy's Home 2 and is played by John Cena", "start": 140, "end": 194 }, { "error type": "Unverifiable", "explanation": "", "start": 195, "end": 232 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Daddy's Home 2 is a 2017 American Christmas comedy film which stars Will Ferrell, Mark Wahlberg, Linda Cardellini, John Cena, with John Lithgow and Mel Gibson. Roger is a character in Daddy's Home 2 and is played by John Cena. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the beatles first perform in america?", "passages": [ [ "Beatlemania", "Beatlemania\n\nBeatlemania was the intense fan frenzy directed towards the English rock band the Beatles in the 1960s.", "Their popularity started growing in the United Kingdom in late 1963.", "By the next year, their worldwide tours were characterised by intense levels of hysteria and high-pitched screaming by female fans, both at concerts and during the band's travels.", "In February 1964, the Beatles arrived in the US, and their televised performances on \"The Ed Sullivan Show\" were viewed by approximately 73 million people.", "In addition to establishing the Beatles' international stature, their arrival changed attitudes to popular music in the US, whose own Memphis-driven musical evolution had made it a global trend-setter.", "From 1964 to 1970, the Beatles had the top-selling US single one out of every six weeks, and the top-selling US album one out of every three weeks.", "In 1966, the frenzy became so much that they stopped touring and became a studio-only band.", "The use of the word \"mania\" to describe fandom predates the Beatles by more than 100 years.", "It has continued to be used to describe the popularity of musical acts, as well as popularity of public figures and trends outside the music industry." ], [ "Beatlemania", "When the group arrived at New York's newly renamed John\u00a0F.\u00a0Kennedy\u00a0Airport, they were greeted by a second large crowd, with Beatles fans again estimated to number four thousand, and journalists, two hundred.", "From having so many people packed in a little space, a few people in the crowd got injured.", "The airport had not previously experienced such a large crowd.", "After a press conference, where they first met disc jockey Murray the K, the Beatles were put into limousines\u2014one per Beatle\u2014and driven to New York City.", "On the way, McCartney turned on a radio and listened to a running commentary: \"They have just left the airport and are coming to New York City ...\"", "After reaching the Plaza Hotel, the Beatles were besieged by fans and reporters.", "On 9 February, the Beatles made their first live US television appearance.", "73\u00a0million viewers\u2014about two-fifths of the total American population\u2014watched the group perform on \"The Ed Sullivan Show\" at 8 pm.", "According to the Nielsen ratings audience measurement system, the show had the largest number of viewers that had been recorded for a US television program.", "On 11 February, the Beatles' first US concert took place, at Washington Coliseum, a sports arena in Washington, D.C.", "The concert was attended by 8,000 fans." ], [ "The Beatles", "The Beatles\n\nThe Beatles were an English rock band formed in Liverpool in 1960.", "With members John Lennon, Paul McCartney, George Harrison and Ringo Starr, they became widely regarded as the foremost and most influential music band in history, integral to pop music's evolution into an art form and to the development of the counterculture of the 1960s.", "Rooted in skiffle, beat and 1950s rock and roll, the group later experimented with several musical styles, ranging from pop ballads and Indian music to psychedelia and hard rock, often incorporating classical elements and unconventional recording techniques in innovative ways.", "Led by primary songwriters Lennon and McCartney, the Beatles built their reputation playing clubs in Liverpool and Hamburg over a three-year period from 1960, with Stuart Sutcliffe initially serving as bass player.", "The core trio of Lennon, McCartney and Harrison, together since 1958, went through a succession of drummers, including Pete Best, before asking Starr to join them in 1962.", "Manager Brian Epstein moulded them into a professional act, and producer George Martin guided and developed their recordings, greatly expanding the group's popularity in the United Kingdom after their first hit, \"Love Me Do\", in late 1962.", "These and other members of the band's entourage are sometimes given the informal title of \"fifth Beatle\"." ] ], "gold": "The Beatles were an English rock band formed in Liverpool in 1960, comprised of John Lennon, Paul McCartney, George Harrison and Ringo Starr, and are regarded as the most influential band of all time. The Beatles made their first live US television appearance on 9 February 1964, when 73 million viewers watched them perform on The Ed Sullivan Show at 8 pm, which is about two-fifths of the American population. The Beatles performed their first live American concert on 11 February 1964 at Washington Coliseum, a sports arena in Washington, DC, attended by 8,000. They performed a second concert the next day at New York's Carnegie Hall, which was attended by 2,000, and both concerts were well received.", "prediction 1": "The Beatles were an English rock band formed in Liverpool in 1960. The Beatles performed in America for the first time on 11 February 1964. The Beatles first concert in America took place at the Washington Coliseum, a sports arena in Washington, D.C. The first concert was televised on 9 February 1964 and viewed by approximately 73 million people.", "prediction 2": "The Beatles were an English rock band formed in Liverpool in 1960. Rooted in skiffle, beat and 1950s rock and roll, the group later experimented with several musical styles, ranging from pop ballads and Indian music to psychedelia and hard rock, often incorporating classical elements and unconventional recording techniques in innovative ways. On 11 February 1964, the Beatles' first US concert took place, at Washington Coliseum, a sports arena in Washington, D.C. The concert was attended by 8,000 fans.", "prediction 3": "In February 1964, the Beatles arrived in the US and their televised performances on The Ed Sullivan Show were viewed by approximately 73 million people. The concert was held at Washington Coliseum in Washington, D.C., attended by 8,000 fans.", "prediction 4": "In February 1964, the English rock band the Beatles made their first live US television appearance. On 9 February, 73 million viewers watched the group perform on The Ed Sullivan Show at 8 pm. On 11 February, the Beatles' first US concert took place, at Washington Coliseum, a sports arena in Washington, D.C. The concert was attended by 8,000 fans.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Beatles were an English rock band formed in Liverpool in 1960. With members John Lennon, Paul McCartney, George Harrison and Ringo Starr, they became widely regarded as the foremost and most influential music band in history. In February 1964, the Beatles arrived in the US, and their televised performances on \"The Ed Sullivan Show\" were viewed by approximately 73 million people. The Beatles performed in America for the first time on 11 February 1964. The Beatles first concert in America took place at the Washington Coliseum, a sports arena in Washington, D.C. The concert was attended by 8,000 fans." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When was the reflecting pool in washington dc built?", "passages": [ [ "Lincoln Memorial Reflecting Pool", "Lincoln Memorial Reflecting Pool\n\nThe Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington, D.C., United States.", "It is a long and large rectangular pool located on the National Mall, directly east of the Lincoln Memorial, with the Washington Monument to the east of the reflecting pool.", "Part of the iconic image of Washington, the reflecting pool hosts many of the 24 million visitors a year who visit the National Mall.", "It is lined by walking paths and shade trees on both sides.", "Depending on the viewer's vantage point, it dramatically reflects the Washington Monument, the Lincoln Memorial, the Mall's trees, and/or the expansive sky.", "The Lincoln Memorial Reflecting Pool was designed by Henry Bacon, and was constructed in 1922 and 1923, following the dedication of the Lincoln Memorial.", "It is approximately long (over a third of a mile) and wide.", "The perimeter of the pool is therefore , about 0.83 miles around.", "It has a depth of approximately on the sides and in the center.", "It holds approximately 6,750,000 U.S.\u00a0gallons (25,500,000\u00a0L) of water.", "Using funding from the American Recovery and Reinvestment Act of 2009, the National Park Service reconstructed the Lincoln Memorial Reflecting Pool." ], [ "Capitol Reflecting Pool", "(Other elements of the plan were the creation of the Third Street tunnel under the Mall and the relocation of a memorial to Civil War General George G. Meade from the northwest section of Union Square; that memorial now stands near the intersection of Constitution Avenue and Pennsylvania Avenue, NW.)", "The new pool was designed to serve as a counterpart to the one at the western end of the Mall, between the Lincoln Memorial and the Washington Monument.", "Since its completion in 1971, it has been a popular attraction.", "The broad, gently sloped limestone coping and the steps that lead down from ground level afford seating for visitors as they enjoy the reflections of the Capitol, the surrounding sights, and the sky as well as the ducks and seagulls that often swim in the pool." ], [ "Rainbow Pool", "Rainbow Pool\n\nThe Rainbow Pool was a reflecting pool located on the National Mall in Washington D.C., USA.", "It was designed by landscape architect Frederick Law Olmsted, Jr., and was situated between the Lincoln Memorial Reflecting Pool (to the west), and 17th Street NW (to the east).", "The pool was renamed the Rainbow Pool on October 15, 1924 after it was noticed that its 124 nozzles created a \"perfect rainbow\" when turned on.", "In 2001 it was integrated into the National World War II Memorial, which features the pool located in roughly the same spot.", "The builders of the National World War II Memorial asserted that the memorial would not destroy the Rainbow pool; rather it would be sunk lower into the ground to better fit the structure of the World War II Memorial.", "This was a controversial development, as the Rainbow Pool has a central, visible location between the Washington Monument and Lincoln Memorial.", "The debate over the World War II Memorial's occupation of the space had to be resolved by legislation from the U.S. Congress in 2001 which allowed the building of the memorial to continue." ] ], "gold": "There are several reflecting pools in Washington, DC. The Lincoln Memorial Reflecting Poof was built in 1922 and 1923 following the dedication of the Lincoln Memorial. The Capital Reflecting Pool was completed in 1971 and has been a popular attraction. The Rainbow Pool was incorporated into the World War II Memorial in 2001 in roughly the same spot. It was renamed the Rainbow Pool in 1924 after it was noticed that its 124 nozzles created a \"perfect rainbow\" when turned on.", "prediction 1": "The Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington, D.C., the United States. It was designed by Henry Bacon, and was constructed in 1922 and 1923, following the dedication of the Lincoln Memorial. The Rainbow Pool was a reflecting pool located on the National Mall in Washington D.C., USA. It was renamed the Rainbow Pool on October 15, 1924, after it was noticed that its 124 nozzles created a \"perfect rainbow\" when turned on. The debate over the National World War II Memorial was resolved by legislation from the U.S Congress in 2001, which allowed the building to continue.", "prediction 2": "The Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington DC. It is a long and large rectangular pool located on the National Mall, directly east of the Lincoln Memorial, with the Washington Monument to the east of the reflecting pool. The Rainbow Pool was a reflecting pool located on the National Mall in Washington D.C., USA. It was designed by landscape architect Frederick Law Olmsted, Jr., and was situated between the Lincoln Memorial Reflecting Pool (to the west), and 17th Street NW (to the east).", "prediction 3": "The Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington, D.C., United States. It is a long and large rectangular pool located on the National Mall, directly east of the Lincoln Memorial, with the Washington Monument to the east of the reflecting pool. It was designed by Henry Bacon, and was constructed in 1922 and 1923, following the dedication of the Lincoln Memorial. The Rainbow Pool was a reflecting pool located on the National Mall in Washington D.C., USA. It was designed by landscape architect Frederick Law Olmsted, Jr., and was situated between the Lincoln Memorial Reflecting Pool and 17th Street NW (to the west). The pool was renamed the Rainbow Pool on October 15, 1924 after it was noticed that its 124 nozzles created a \"perfect rainbow\" when turned on. In 2001 it was integrated into the National World War II Memorial, which features the pool located in roughly", "prediction 4": "The Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington D.C., USA. It is a long and large rectangular pool located on the National Mall, directly east of the Lincoln Memorial, with the Washington Monument to the east of the reflecting pool. The Rainbow Pool, an outdoor reflecting pool located on the National Mall, was built on October 15, 1924. However, the National Park Service reconstructed the pool in 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 160 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 336 }, { "error type": "Irrelevant", "explanation": "", "start": 473, "end": 622 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Lincoln Memorial Reflecting Pool is the largest of the many reflecting pools in Washington, D.C., the United States. It was constructed in 1922 and 1923, following the dedication of the Lincoln Memorial. The Rainbow Pool was renamed the Rainbow Pool on October 15, 1924, after it was noticed that its 124 nozzles created a \"perfect rainbow\" when turned on. In 2001 it was integrated into the National World War II Memorial, which features the pool located in roughly the same spot. Since its completion in 1971, The Capital Reflecting Pool has been a popular attraction." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "How many times has cristiano ronaldo won world best player?", "passages": [ [ "Cristiano Ronaldo", "Cristiano Ronaldo\n\nCristiano Ronaldo dos Santos Aveiro (; born 5 February 1985) is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team.", "Often considered the best player in the world and regarded by many as one of the greatest players of all time, Ronaldo has a record-tying five Ballon d'Or awards, the most for a European player, and is the first player to win four European Golden Shoes.", "He has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship.", "A prolific goalscorer, Ronaldo holds the records for most official goals scored in Europe's top-five leagues (405), the UEFA Champions League (121), the UEFA European Championship (9), as well as those for most assists in the UEFA Champions League (34) and the UEFA European Championship (6).", "He has scored over 680 senior career goals for club and country.", "Born and raised on the Portuguese island of Madeira, Ronaldo was diagnosed with a racing heart at age 15.", "He underwent an operation to treat his condition, and began his senior club career playing for Sporting CP, before signing with Manchester United at age 18 in 2003." ], [ "Cristiano Ronaldo", "At the close of 2008, Ronaldo helped United win the FIFA Club World Cup in Japan, assisting the final-winning goal against Liga de Quito and winning the Silver Ball in the process.", "He subsequently became United's first Ballon d'Or winner since George Best in 1968, and the first Premier League player to be named the FIFA World Player of the Year.", "His match-winning goal in the second leg against Porto, a 40-yard strike, earned him the inaugural FIFA Pusk\u00e1s Award, presented by FIFA in recognition of the best goal of the year; he later called it the best goal he had ever scored.", "United advanced to the final in Rome, where he made little impact in United's 2\u20130 defeat to Barcelona.", "Ronaldo ended his time in England with nine trophies, as United claimed their third successive Premier League title and a Football League Cup.", "He finished the campaign with 26 goals in all competitions, 16 goals fewer than the previous season, in four more appearances.", "His final ever goal for Manchester United came on 10 May 2009 with a free kick in the Manchester derby at Old Trafford.", "Ahead of the 2009\u201310 season, Ronaldo joined Real Madrid for a world record transfer fee at the time, of \u00a380\u00a0million (\u20ac94\u00a0million)." ], [ "Cristiano Ronaldo", "Having received a yellow card for taking his shirt off during his goal celebration, he was sent off for a second yellow card offence minutes later before he shoved the referee lightly to depict his dissatisfaction.", "He was issued a five-match suspension following the match.", "In his 400th game for Real Madrid, Ronaldo scored two goals away to Borussia Dortmund in the Champions League, taking his club tally to 411 goals.", "On 23 October, his performances in the first half of 2017 saw him claim his fifth FIFA Player of the Year award by receiving The Best FIFA Men's Player award for the second consecutive year.", "On 6 December, he became the first player to score in all six Champions League group stage matches with a curling strike at home to Borussia Dortmund.", "A day later, Ronaldo won the Ballon d'Or for a fifth time, receiving the award on the Eiffel Tower in Paris.", "On 3 March 2018, he scored two goals in a 3\u20131 home win over Getafe, his first being his 300th La Liga goal in his 286th La Liga appearance, making him the fastest player to reach this landmark and only the second player to do so after Lionel Messi.", "On 18 March, he reached his 50th career hat-trick, scoring four goals in a 6\u20133 win against Girona." ] ], "gold": "Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward for Premier League club Manchester United and captains the Portugal national team. Ronaldo won FIFA World Player of the Year, 1 time in 2008 and became the first Premier League player to be named the FIFA World Player of the Year. He also won the Best FIFA Men's Player Award 2 consecutive years, in 2016 and 2017. He won FIFPRO World Player of the Year award 1 time also.", "prediction 1": "Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team. Ronaldo has been awarded the world's best player five times. His five Ballon d'Or awards are the most for a European player, and he has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship.", "prediction 2": "Cristiano Ronaldo is considered the best player in the world and is regarded by many as one of the greatest players of all time. He has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship. His match-winning goal in the second leg against Porto, a 40-yard strike, earned him the inaugural FIFA Pusk\u00e1s Award, presented by FIFA in recognition of the best goal of the year. His final ever goal for Manchester United came on 10 May 2009 with a free kick in the league.", "prediction 3": "Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team. Ronaldo has won the Ballon d'Or five times, including in 2008, 2009, 2010, 2011, 2014, 2015, 2016, 2017 and 2018. In 2018, Ronaldo won the Ballon d'Or for a fifth time, receiving the award on the Eiffel Tower in Paris. In 2017, in 2018, in 2019, and in 2021, Ronaldo won the Ballon d'Or for a total of 5 times.", "prediction 4": "Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team. Ronaldo has won the Ballon d'Or a record-tying five times, the most for a European player, and has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship. His match-winning goal in the second leg against Porto, a 40-yard strike, earned him the inaugural FIFA Pusk\u00e1s Award, presented by FIFA in recognition of the best goal of the year, as well as those for most assists in the UEFA Champions League (34) and the UEFA European Championship, as well as those for most assists in the UEFA Champions League (34) and the UEFA Champions League (9).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 106 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward and captains the Portugal national team. Ronaldo has been awarded the world's best player, or FIFA's Player of the Year, five times, including in 2008 and 2017. He was the first Premier League player to earn the title. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played jason dilaurentis in pretty little liars?", "passages": [ [ "Pretty Little Liars (season 2)", "Annabeth Gish appears as Anne Sullivan, a therapist whom the girls' parents feel can help them on their problems.", "Andrea Parker will play Jessica DiLaurentis, Alison's mother, who returns to Rosewood to help out with a fashion show being held in Alison's honour.", "Actor Drew Van Acker also joined the cast playing Jason DiLaurentis, replacing Parker Bagley." ] ], "gold": "Jason is the half-brother of Alison, Spencer and Melissa on Pretty Little Liars. He is portrayed by Parker Bagley in Season 1 and Drew Van Acker in Season 2-7.", "prediction 1": "Drew Van Acker played Jason DiLaurentis in Pretty Little Liars Season 2 replacing Parker Bagley.", "prediction 2": "Drew Van Acker plays Jason DiLaurentis, in Pretty Little Liars season 2 episode 4, replacing Parker Bagley.", "prediction 3": "Drew Van Acker plays Jason DiLaurentis in Pretty Little Liars. Parker Bagley plays Jason DiLaurentis in the first season.", "prediction 4": "Drew Van Acker also joined the cast as Jason DiLaurentis, replacing Parker Bagley.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Drew Van Acker played Jason DiLaurentis in Pretty Little Liars Season 2 replacing Parker Bagley." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When will the new $20 bill be released?", "passages": [ [ "EURion constellation", "The mere presence of five of these circles on a page is sufficient for some colour photocopiers to refuse processing.", "Some banks integrate the constellation tightly with the remaining design of the note.", "On 50 DM German banknotes, the EURion circles formed the innermost circles in a background pattern of fine concentric circles.", "On the front of former Bank of England Elgar \u00a320 notes, they appear as green heads of musical notes; however, on the Smith \u00a320 notes of 2007 the circles merely cluster around the \"\u00a320\" text.", "On some U.S. bills, they appear as the digit zero in small, yellow numbers matching the value of the note.", "On Japanese yen, these circles sometimes appear as flowers.", "Technical details regarding the EURion constellation are kept secret by its inventors and users.", "A 1995 patent application suggests that the pattern and detection algorithm were designed at Omron Corporation, a Japanese electronics company.", "It is also not clear whether the feature has any official name.", "The term \"Omron anti-photocopying feature\" appeared in an August 2005 press release by the Reserve Bank of India.", "In 2007 the term \"Omron rings\" was used in an award announcement by a banknote collectors society.", "The following table lists the banknotes on which the EURion constellation has been found so far.", "Countries where all recent banknotes use the constellation are in bold." ], [ "Australian twenty-dollar note", "Australian twenty-dollar note\n\nThe Australian twenty-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar on 14 February 1966.", "It replaced the \u00a310 note which had similar orange colouration.", "There have been only two different issues of this denomination: a paper note which had a gradient of yellow and red, with a distinct orange background, and a polymer note which can be recognised for its distinct red-orange colouration.", "The polymer note was issued on 31 October 1994.\n\n", ", 164 million $20 banknotes were in circulation, 11% of the total notes in circulation; worth $3,286 million, or 4% of the total value for all denominations.", "Since the start of issuance there have been 14 signature combinations, of which the 1967 issue is of the greatest value, issued for one year only; and the 1989 Phillip/Fraser being issued for less than a year.", "From 1966 to 1974 the main title identifying the country was Commonwealth of Australia, there were 146,960,000 notes issued in its life.", "This was subsequently changed to Australia until the end of the issuance of paper currency for this denomination in 1994 with 1,661,970,048 of these notes being issued." ], [ "Canadian National Vimy Memorial", "The memorial is featured on the reverse of the Frontier Series Canadian polymer $20 banknote, which was released by the Bank of Canada on 7 November 2012." ] ], "gold": "The current series of US 20 dollar bills is released on October 9, 2003 with light background shading in green and yellow, and no\u00a0oval\u00a0around\u00a0Andrew Jackson's portrait ; the back is the same view of the\u00a0White House, but without the oval around it. The first issue's series date is 2004 with\u00a0Marin-Snow\u00a0signatures.The Series 1996 $20 note was completely redesigned for the first time since 1929 to further deter counterfeiting", "prediction 1": "The new $20 bill is expected to be released on 20 February 2020. The new $20 note will be released on 20 September 2020.", "prediction 2": "The new $20 bill was released on 14 February 2016, the same date as the first $20 note, the Australian $20 note, and the Canadian $20 note. The Canadian $20 note was released on 7 November 2012, the Australian $20 note was released on 14 February 1966, and the Canadian $20 note was released on 31 October 1994.", "prediction 3": "In the United States, the new $20 bill was released on 7 November 2012 while in Canada it was released on 7 November 2012. It is not known when the new $20 bill will be released. The EURion constellation appears on the back of some $20 notes.", "prediction 4": "The new $20 note will not be released until 2021. The new $20 note will not include the EURion constellation. Instead, the $20 note will have a background pattern of fine concentric circles.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 64 }, { "error type": "Redundant", "explanation": "The new $20 bill is expected to be released on 20 February 2020. ", "start": 65, "end": 98 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who plays belle's father in the beauty and the beast?", "passages": [ [ "Beauty and the Beast (2017 film)", "The Beast shows Belle a gift from the enchantress, a book that transports readers wherever they want.", "Belle uses the book to visit her childhood home in Paris, where she discovers a plague doctor mask and realizes that she and her father were forced to leave when her mother succumbed to the plague.", "In Villeneuve, Maurice tries to convince the other villagers of the Beast and Belle's imprisonment but no one believes him.", "Gaston, seeing rescuing Belle as an opportunity to win her hand in marriage, agrees to help Maurice.", "When Maurice learns of his ulterior motive and rejects him, Gaston abandons him to be eaten by the wolves.", "Maurice is rescued by the hermit Agathe, but when he tells the townsfolk of Gaston's crime and is unable to provide solid evidence, Gaston convinces them to send Maurice to an insane asylum.", "After sharing a romantic dance with the Beast, Belle discovers her father's predicament using a magic mirror.", "The Beast places Belle's happiness before his own releases her to save Maurice, giving her the mirror to remember him with leaving him and his servants heartbroken.", "At Villeneuve, Belle reveals the Beast in the mirror to the townsfolk, proving her father's sanity." ], [ "Beauty and the Beast (musical)", "Notable Broadway cast replacements (approximate dates given where available)\n\n\n", "The Original Broadway Cast Recording was released on April 26, 1994.", "The CD included Susan Egan as Belle, Terrence Mann as Beast, Burke Moses as Gaston, Gary Beach as Lumi\u00e8re and Beth Fowler as Mrs. Potts.", "The Original Australian Cast Recording was released in 1995.", "The principal cast included Rachael Beck as Belle, Michael Cormick as Beast, Hugh Jackman as Gaston, Ernie Bourne as Maurice, Toni Lamond as Madame de la Grande Bouche, Grant Smith as Lumi\u00e8re, Robyn Arthur as Mrs. Potts and Bert Newton as Cogsworth.", "The Original Vienna Cast Recording was released in 1996.", "The principal cast included Ethan Freeman as Beast, Caroline Vasicek as Belle, Kevin Tarte as Gaston, Viktor Gernot as Lumi\u00e8re, Ann Mandrella as Babette, and Rosita Mewis as Mrs. Potts.", "The Original London Cast Recording was released in 1997.", "The principal cast included Julie-Alanah Brighten as Belle, Alasdair Harvey as Beast, Burke Moses as Gaston, Derek Griffiths as Lumi\u00e8re and Mary Millar as Mrs. Potts.", "The Original Stuttgart Cast Recording was released in 1998." ], [ "Rex Everhart", "Rex Everhart\n\nRex Everhart (June 13, 1920 \u2013 March 13, 2000) was an American film and musical theatre actor and singer.", "Everhart appeared in such films as \"Superman\", in 1978.", "He was also known for his role as Enos the Truck-Driver in the horror film, \"Friday the 13th\" (1980) and its sequel.", "He provided the voice of Maurice, Belle's father, in the 1991 musical animated Disney film, \"Beauty and the Beast\".", "Everhart performed in numerous roles on Broadway including \"1776\", \"Chicago\", \"Woman of the Year\" and the revival of \"Anything Goes\".", "He was nominated for a 1978 Tony Award as Best Actor (Featured Role - Musical) for \"Working\".", "Everhart was born on June 13, 1920, in Watseka, Illinois to Dr. Arthur Mark Everhart and Jeanette M. (n\u00e9e Dodson) Everhart.", "His mother died when Everhart was 15.", "Everhart attended Western Military Academy in 1935 and graduated in 1938.", "Everhart studied at the University of Missouri.", "He received a degree in theater at the Pasadena Playhouse and a bachelor's and master's degrees at New York University.", "He studied acting in Manhattan with Paul Mann, Martin Ritt and Curt Conway." ] ], "gold": "There are several Beauty and the Beast musicals and films, including a 1946, 1991, 2014, and 2017 film and a 1994 musical. Belle's father was played by Kevin Kline in the 2017 film, by Andr\u00e9 Dussollier in the 2014 film, by Rex Everhart in the 1991 film, by Marcel Andr\u00e9 in the 1946 film, and by Tom Bosley in the 1994 musical.", "prediction 1": "Rex Everhart, an American film and musical theatre actor and singer, provided the voice of Maurice, Belle's father, in the 1991 musical animated Disney film, \"Beauty and the Beast\". In the 2017 film version of the Disney animated film, Maurice is voiced by Terrence Mann as the Beast and Gaston is voiced by Burke Moses as Gaston. In the 2017 film of the 1991 animated film, Maurice is voiced by William Hurt as Maurice. In the 2017 film of the 1991 animated film, Maurice is voiced by Rex Everhart as the Beast.", "prediction 2": "Rex Everhart provided the voice of Maurice, Belle's father, in the 1991 musical animated Disney film \"Beauty and the Beast\". He provided the voice of Maurice in the 2007 film. In the 2017 film, Maurice is voiced by Ernie Bourne.", "prediction 3": "Maurice, Belle's father, is voiced by Rex Everhart in the 1991 animated Disney film Beauty and the Beast. In the 2017 film, the character was played by Lily James, with the 2017 film starring Vivica A. Fox and the 2017 film starring Emma Stone.", "prediction 4": "In the 1991 film Beauty and the Beast, American film and musical theatre actor and singer Rex Everhart provided the voice of Maurice, Belle's father, in the animated Disney film. In the 2017 film, the character is played by Nicole Kidman. In the 2017 version, the character is played by Danielle McCartney.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 68 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,2,3]}", "start": 182, "end": 235 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 236, "end": 243 }, { "error type": "Redundant", "explanation": "In the 2017 film version of the Disney animated film, Maurice is voiced by Terrence Mann as the Beast and Gaston is voiced by Burke Moses ", "start": 320, "end": 330 }, { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 319 }, { "error type": "Unverifiable", "explanation": "", "start": 396, "end": 408 }, { "error type": "Redundant", "explanation": " In the 2017 film of the 1991 animated film, Maurice is voiced by William Hurt ", "start": 409, "end": 420 }, { "error type": "Redundant", "explanation": "In the 2017 film of the 1991 animated film, Maurice is voiced by William Hurt as Maurice. ", "start": 421, "end": 464 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 486, "end": 498 }, { "error type": "Irrelevant", "explanation": "", "start": 499, "end": 512 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Rex Everhart provided the voice of Maurice, Belle's father, in the 1991 musical animated Disney film, \"Beauty and the Beast\". The Original Australian Cast Recording, for the Beauty and Beast musical, had Ernie Bourne as Maurice." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is let's make a deal recorded?", "passages": [ [ "Let's Make a Deal", "When the current version debuted in 2009 at Las Vegas, Alison Fiori was the show's original model, lasting for much of the first season in Las Vegas before the show moved to Los Angeles.", "During the 2013-14 season, Danielle Demski was the show's model for most of the season while Tiffany Coyne was on maternity leave.", "The original daytime series was recorded at NBC Studios in Burbank, California and then at ABC Television Center in Los Angeles once the program switched networks in 1968.", "The weekly syndicated series also taped at ABC Television Center, doing so for its first five seasons.", "After ABC cancelled the daytime series in 1976, production of the syndicated series ceased there as well and the sixth and final season was recorded in the ballroom of the Las Vegas Hilton hotel in Las Vegas, Nevada.", "The 1980 Canadian series taped at Panorama Studios in Vancouver, BC, which production company Catalena Productions used as its base of operations.", "\"The All-New Let's Make a Deal\" taped its first season of episodes in Burbank at NBC Studios, then moved to Hollywood Center Studios in Hollywood, California for the second and final season.", "The 1990 NBC daytime series was recorded at Disney-MGM Studios on the grounds of Walt Disney World in Orlando, Florida.", "The 2003 revival returned production to Burbank." ], [ "Let's Make a Deal", "The current edition of the series originally emanated from the Tropicana in Las Vegas.", "The show returned to Hollywood in 2010, first at Sunset Bronson Studios and later at Raleigh Studios.", "Each episode of \"Let's Make a Deal\" consists of several \"deals\" between the host and a member (or members, generally a married couple) of the audience, referred to as \"traders.\"", "Audience members are picked at the host's whim as the show moves along, and couples are often selected to play together as traders.", "The deals are mini-games within the show that take several formats.", "In the simplest format, a trader is given a prize of medium value (such as a television set or a few hundred dollars in cash), and the host offers them the opportunity to trade for another prize.", "However, the offered prize is unknown.", "It might be concealed on the stage behind one of three curtains, or behind \"boxes\" onstage (large panels painted to look like boxes), within smaller boxes brought out to the audience, or occasionally in other formats.", "The initial prize given to the trader may also be concealed, such as in a box, wallet or purse, or the trader might be initially given a box, envelope or curtain.", "The format varies widely." ] ], "gold": "The American TV show \"Let's Make a Deal\" has been recorded in Raleigh Studios Hollywood since 2014. Before that, the show was recorder in Sunset Bronson Studios from 2010 to 2014, marking the show's return to Hollywood. In 2009 and 2010, it was recorded at the Tropicana Resort & Casino in Las Vegas. ", "prediction 1": "Let's Make a Deal is a television show that consists of several episodes that consist of several \"deals\" between the host and a member (or members, generally a married couple) of the audience, referred to as \"traders.\" The original Let's Make a Deal daytime series was recorded at NBC Studios in Burbank, California, and then at ABC Television Center in Los Angeles once the program switched networks in 1968. The weekly syndicated series also taped at ABC Television Center, doing so for its first five seasons, then moved to Hollywood Center Studios in Hollywood, California for the second and final season. The 2003 revival returned production to Burbank, California, while the original Let's Make A Deal moved to the Las Vegas, Nevada, where the show moved to Las Vegas.\n", "prediction 2": "Let's Make a Deal is an American light entertainment show that aired on NBC from 1968-2003, which originally aired on NBC and was filmed in Los Angeles, CA. The original episode was taped at NBC Studios in Burbank, California. The series moved to Hollywood Center Studios for its second and final season in March 2019.", "prediction 3": "Let's Make a Deal is a television mini-games show that consists of several \"deals\" between the host and a member (or members, generally a married couple) of the audience, referred to as \"traders\". Each episode of the show consists of several \"deals\" between the host and a member (or members, generally a married couple), referred to as \"traders,\" of the audience. The original daytime show was recorded at NBC Studios in Burbank, California and then at ABC Television Center in Los Angeles once the program switched networks in 1968. The weekly syndicated series taped in Los Angeles once the network switched networks in 1968. The first season was recorded in the ballroom of the Las Vegas Hilton hotel in Las Vegas Hilton hotel in Las Vegas. The current season was recorded at the Tropicante at the Hilton hotel in Las Vegas.", "prediction 4": "Let's Make a Deal is a mini-game show that's filmed all over the world. Episodes are recorded in Los Angeles, to Hollywood Center Studios in Los Angeles, to the Tropicana in Las Vegas, and to various locations in between. Episodes are recorded in Las Vegas at the Tropicana Hotel and Casino in Las Vegas, Nevada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 218 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 410, "end": 512 }, { "error type": "Redundant", "explanation": "Let's Make A Deal moved to the Las Vegas, Nevada", "start": 750, "end": 775 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The original Let's Make a Deal daytime series was recorded at NBC Studios in Burbank, California, and then at ABC Television Center in Los Angeles once the program switched networks in 1968. The All-New Let's Make a Deal taped its first season of episodes in Burbank at NBC Studios, then moved to Hollywood Center Studios in Hollywood, California for the second and final season. The 2003 revival returned production to Burbank, California, while the original Let's Make A Deal moved to the Las Vegas, Nevada. The show returned to Hollywood in 2010, first at Sunset Bronson Studios and later at Raleigh Studios. The current edition of the series originally emanated from the Tropicana in Las Vegas.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the 4th of july become a federal holiday?", "passages": [ [ "Independence Day (United States)", "Independence Day (United States)\n\nIndependence Day (colloquial: the Fourth of July) is a federal holiday in the United States commemorating the adoption of the Declaration of Independence on July 4, 1776.", "The Continental Congress declared that the thirteen American colonies regarded themselves as free and independent states, the United States of America, and were no longer connected to the British Crown.", "The Congress actually voted to declare independence two days earlier, on July 2.", "Independence Day is commonly associated with fireworks, parades, barbecues, carnivals, fairs, picnics, concerts, baseball games, family reunions, and political speeches and ceremonies, in addition to various other public and private events celebrating the history, government, and traditions of the United States.", "Independence Day is the National Day of the United States.", "During the American Revolution, the legal separation of the Thirteen Colonies from Great Britain in 1776 actually occurred on July 2, when the Second Continental Congress voted to approve a resolution of independence that had been proposed in June by Richard Henry Lee of Virginia declaring the United States independent from Great Britain's rule.", "After voting for independence, Congress turned its attention to the Declaration of Independence, a statement explaining this decision, which had been prepared by a Committee of Five, with Thomas Jefferson as its principal author.", "Congress debated and revised the wording of the Declaration, finally approving it two days later on July 4." ], [ "Federal holidays in the United States", "In 1888 and 1894, respectively, Decoration Day (now Memorial Day) and Labor Day were created.", "In 1938, Armistice Day (now Veterans Day) was created to mark the end of World War I.", "The scope and the name of the holiday was expanded in 1954 to honor Americans who fought in World War II and the Korean War.", "In 1968, the Monday Holiday Act of 1968 shifted several holidays to always fall on a Monday and saw the establishment of Columbus Day.", "In 1983, the birthday of Martin Luther King Jr. became the nation's most recently established holiday.", "Most of the ten U.S. federal holidays are also state holidays.", "A holiday that falls on a weekend is usually observed on the closest weekday (e.g. a holiday falling on a Saturday is observed on the preceding Friday, while a holiday falling on a Sunday is observed on the succeeding Monday).", "The official names came from the laws that define holidays for federal employees.", "New Year's Day, Independence Day, Veterans Day, and Christmas Day are observed on the same calendar date each year.", "Holidays that fall on a Saturday are observed by federal employees who work a standard Monday to Friday week on the previous Friday.", "Federal employees who work on Saturday will observe the holiday on Saturday; Friday will be a regular work day.", "Holidays that fall on a Sunday are observed by federal workers the following Monday." ], [ "Federal holidays in the United States", "Federal holidays in the United States\n\nIn the United States, a federal holiday is an authorized holiday which has been recognized by the US government.", "Every year on a U.S. federal holiday, non-essential federal government offices are closed, and every federal employee is paid for the holiday.", "Private-sector employees required to work on a legal holiday may receive holiday pay in addition to their ordinary wages.", "Federal holidays are designated by the United States Congress in Title V of the United States Code ().", "Congress has authority to create holidays only for federal institutions (including federally owned properties) and employees, and for the District of Columbia.", "However, as a general rule other institutions, including banks, post offices, and schools, may be closed on those days.", "In various parts of the country, state and city holidays may be observed in addition to the federal holidays.", "The history of federal holidays in the United States dates back to June 28, 1870, when Congress created federal holidays \"to correspond with similar laws of States around the District ... and ... in every State of the Union.\"", "Although at first applicable only to federal employees in the District of Columbia, Congress extended coverage in 1885 to all federal employees.", "The original four holidays were:\n\nGeorge Washington's Birthday became a Federal holiday in 1880." ] ], "gold": "Independence Day, or the Fourth of July, is the national day of the United States, commemorating the Declaration of Independence. Congress voted to declare the nation's independence two days earlier but it was not declared until July 4, 1776. The Fourth of July became an unpaid federal holiday in 1870. Later, in 1938, it became a paid federal holiday.", "prediction 1": "Independence Day is a federal holiday in the United States commemorating the adoption of the Declaration of Independence on July 4, 1776. The holiday was first established on the 28th of June 1870 by Congress. It was renamed in 1889 to the fourth of July. It was first observed on the 4th of July in 1891. It was reestablished on the 4th of July in 1921.", "prediction 2": "In the United States, a federal holiday is an authorized holiday which has been recognized by the US government. Every year on a US federal holiday, non-essential federal government offices are closed, and every federal employee is paid for the holiday. George Washington's Birthday became a Federal holiday in 1880. Decoration Day became a federal holiday on July 4, 1844. The Fourth of July became a federal holiday on July 4, 1888.", "prediction 3": "The first federal holiday observed by the United States on July 4 was the George Washington's Birthday, which was first observed on June 28, 1870. Congress then extended coverage of the holiday to all federal employees in 1885.", "prediction 4": "The history of federal holidays in the United States dates back to June 28, 1870, when Congress created federal holidays \"to correspond with similar laws of States around the District... and... in every State of the Union.\" The 4th of July became a federal holiday in the United States commemorating the adoption of the Declaration of Independence on July 4, 1776. The original four holidays were George Washington's Birthday, Labor Day, Decoration Day, and Memorial Day. The birthday of Martin Luther King Jr. became the nation's most recently established federal holiday. In 1968, the Monday Holiday Act of 1968 shifted several holidays to always fall on a Monday and saw the establishment of Veterans Day.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 138, "end": 209 }, { "error type": "Unverifiable", "explanation": "", "start": 210, "end": 255 }, { "error type": "Unverifiable", "explanation": "", "start": 256, "end": 305 }, { "error type": "Unverifiable", "explanation": "", "start": 306, "end": 354 } ], "missing-info": [], "corrected-prediction": "Independence Day is a federal holiday in the United States commemorating the adoption of the Declaration of Independence on July 4, 1776. The Congress actually voted to declare independence two days earlier, on July 2. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the new owner of rajasthan royals?", "passages": [ [ "Rajasthan Royals", "Rajasthan Royals\n\nThe Rajasthan Royals (often abbreviated as RR) are a cricket team in the Indian Premier League from the city of Jaipur.", "Founded in 2008 as one of the initial eight IPL franchises, the Royals are owned by Manoj Badale.", "The team played its home matches at the Sawai Mansingh Stadium in Jaipur and also had secondary home grounds at the Sardar Patel Stadium at Ahmedabad and the Brabourne Stadium at Mumbai.", "The Royals are sometimes considered the \"moneyball\" team of the IPL.", "The Royals are known to unearth obscure, high potential talent, as well as the involvement in a number of controversies and scandals.", "The team won the inaugural edition of the IPL under the captaincy of Shane Warne, despite being written off as a title contender by the media and fans.", "The Royals were also the runners-up of the 2013 Champions League Twenty20 under Rahul Dravid's captaincy.", "On 14 July 2015 the verdict reached by a panel appointed by India's Supreme Court suspended Rajasthan Royals and Chennai Super Kings for two years over a corruption and match fixing scandal, meaning they could not participate in both the 2016 and 2017 IPL tournaments.", "They returned to the competition for the 2018 season." ], [ "Rajasthan Royals", "The team's record run-scorer and current captain is Ajinkya Rahane, with 2705 runs , while the leading wicket-taker is Shane Watson, with 67 .", "The Board of Control for Cricket in India (BCCI) announced in September 2007 the establishment of the Indian Premier League, a Twenty20 competition to be started in 2008.", "In January 2008, the BCCI unveiled the owners of eight city-based franchises.", "The team is one of the eight founding members of the IPL in 2008.", "The Jaipur franchise was sold to the Emerging Media for $67 million, making it the least expensive team in the league.", "The franchise is currently owned and chaired by Manoj Badale.", "Other investors include Lachlan Murdoch, Aditya S Chellaram, and Suresh Chellaram.", "The Group acquired the franchise for $67million.", "There have been past controversies regarding the ownership of the franchise, leading to their explusion from the league in 2010.", "Incidentally, this was the least expensive franchise in the Indian Premier League and probably the least fancied team in the league at the beginning of the tournament.", "It made a pre-tax profit of $7.5 million in 2009.", "In 2010, the BCCI decided to expel Kings XI Punjab and Rajasthan Royals from the IPL." ] ], "gold": "The Rajasthan Royals are a franchise cricket team founded in 2008 and based in Jaipur, Rajasthan. There have been past controversies regarding the franchise's ownership, leading to a brief expulsion of the team from the league in 2010. The franchise's new owners include Amisha Hathiramani, who has 44% ownership; Manoj Badale, who has 32% ownership; Lachlan Murdoch, who has 11% ownership; and Shane Warne, who has 3% ownership.", "prediction 1": "The Rajasthan Royals are a cricket team in the Indian Premier League from the city of Jaipur. Founded in 2008 as one of the initial eight IPL franchises, the Royals are owned by Manoj Badale. Lachlan Murdoch, Aditya S Chellaram, and Suresh Chellaram are the new owners of the team.", "prediction 2": "The Rajasthan Royals are a cricket team in the Indian Premier League from the city of Jaipur. Founded in 2008 as one of the initial eight IPL franchises, the Royals are owned by Manoj Badale. The franchise is currently owned and chaired by Badale. Other investors include Lachlan Murdoch, Aditya S Chellaram, and Suresh Chellaram. The Group acquired the franchise for $67 million.", "prediction 3": "The Rajasthan Royals are a cricket team in the Indian Premier League from the city of Jaipur. Founded in 2008 as one of the initial eight IPL franchises, the Royals are owned by Manoj Badale. Other investors include Lachlan Murdoch, Aditya S Chellaram, and Suresh Chellaram. The Emerging Media Group acquired the franchise for $67 million.", "prediction 4": "The Rajasthan Royals are a cricket team in the Indian Premier League from the city of Jaipur. Founded in 2008 as one of the initial eight IPL franchises, the Royals are owned by Manoj Badale.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 68 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 153 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 258, "end": 268 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Rajasthan Royals are a cricket team from the city of Jaipur. Founded in 2008, the Royals are owned by Manoj Badale. Lachlan Murdoch, Aditya S Chellaram, and Suresh Chellaram are other investors of the franchise. There have been past controversies regarding the ownership of the franchise, leading to their expulsion from the league in 2010." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Amino acids that you obtain from eating foods are classified as?", "passages": [ [ "Essential amino acid", "Essential amino acid\n\nAn essential amino acid, or indispensable amino acid, is an amino acid that cannot be synthesized \"de novo\" (from scratch) by the organism, and thus must be supplied in its diet.", "The nine amino acids humans cannot synthesize are phenylalanine, valine, threonine, tryptophan, methionine, leucine, isoleucine, lysine, and histidine.", "Recently, it's been found that histadine can be made in the body if the other eight essential amino acids are supplied.", "Six other amino acids are considered conditionally essential in the human diet, meaning their synthesis can be limited under special pathophysiological conditions, such as prematurity in the infant or individuals in severe catabolic distress.", "These six are arginine, cysteine, glycine, glutamine, proline, and tyrosine.", "Five amino acids are dispensable in humans, meaning they can be synthesized in sufficient quantities in the body.", "These five are alanine, aspartic acid, asparagine, glutamic acid and serine.", "(*) Pyrrolysine, sometimes considered the \"22nd amino acid\", is not used by humans." ], [ "Complete protein", "Complete protein\n\nA complete protein or whole protein is a food source of protein that contains an adequate proportion of each of the nine essential amino acids necessary in the human diet.", "Examples of single-source complete proteins are red meat, poultry, fish, eggs, milk, cheese, yogurt, soybeans and quinoa.", "The concept does not include whether or not the food source is high in total protein, or any other information about that food's nutritious value.", "It was once thought that plant sources of protein are deficient in one or more amino acids, and so vegetarian diets had to specifically combine foods during meals, which would create a complete protein.", "However, the most recent position of the Academy of Nutrition and Dietetics is that protein from a variety of plant foods eaten during the course of a day supplies enough essential amino acids when caloric requirements are met.", "Normal physiological functioning of the body is possible if one obtains enough protein and sufficient amounts of each amino acid from a plant-based diet.", "In fact, the highest PDCAAS scores are not given to commonly eaten meat products, but rather to animal-derived vegetarian foods like milk and eggs and the vegan food soy protein isolate." ] ], "gold": "Amino acids that cannot be synthesized and must be obtained from food are classified as essential amino acids, and if they can be found in the smallest quantity in foods, they are also considered limiting amino acids. Of the 21 amino acids common to all life forms, nine are essential amino acids. A further six amino acids are classified as conditionally essential, meaning that they can be synthesized in a limited way in the body, while the remaining six amino acids are classified as non-essential, meaning that they are synthesized in sufficient quantities in the body.", "prediction 1": "A food source that contains an adequate proportion of each of the nine essential amino acids necessary in the human diet, called a food source of protein, is called a food source of protein. A food source of protein that contains an adequate proportion of each of the nine essential amino acids necessary in the human diet, called a food source of protein, is called a food source of protein. Each of the nine essential amino acids obtained from eating foods are categorized differently, as essential, dispensable, dispensable, and dispensable.", "prediction 2": "An essential amino acid, or indispensable amino acid, is an amino acid that cannot be synthesized \"de novo\" by the organism, and thus must be supplied in its diet. Six other amino acids are considered conditionally essential in the human diet, meaning their synthesis can be limited under special pathophysiological conditions, such as prematurity in the infant or individuals in severe catabolic distress. Five amino acids are dispensable in humans, meaning they can be synthesized in sufficient quantities in the body. These five are alanine, aspartic acid, asparagine, glutamic acid, and serine.", "prediction 3": "An amino acid that you obtain from eating foods is classified as an essential amino acid, or indispensable amino acid, or an amino acid that cannot be synthesized \"de novo\" by the organism, and thus must be supplied in its diet. Six other amino acids are considered conditionally essential in the human diet, meaning their synthesis can be limited under special pathophysiological conditions, such as prematurity in the infant or individuals in severe catabolic distress. Five amino acids are dispensable in humans, meaning they can be synthetained in sufficient quantities in the body.", "prediction 4": "An essential amino acid, or indispensable amino acid, is an amino acid that cannot be synthesized \"de novo\" by the organism, and thus must be supplied in its diet. Six other amino acids are considered conditionally essential in the human diet, meaning their synthesis can be limited under special pathophysiologic conditions, such as prematurity in the infant or individuals in severe catabolic distress. Five amino acids are dispensable in humans, meaning they can be synthesized in sufficient quantities in the body. These five are alanine, aspartic acid, asparagine, glutamic acid, and serine.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "A food source that contains an adequate proportion of each of the nine essential amino acids necessary in the human diet, called a food source of protein, ", "start": 155, "end": 190 }, { "error type": "Redundant", "explanation": "A food source that contains an adequate proportion of each of the nine essential amino acids necessary in the human diet, called a food source of protein, is called a food source of protein. ", "start": 191, "end": 392 }, { "error type": "Redundant", "explanation": "Each of the nine essential amino acids obtained from eating foods are categorized differently, as essential, dispensable, dispensable, and ", "start": 532, "end": 544 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4,5,6]}", "start": 459, "end": 487 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 154 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "An essential amino acid, or indispensable amino acid, is an amino acid that cannot be synthesized by the organism, and thus must be supplied in its diet. Six other amino acids are considered conditionally essential in the human diet, meaning their synthesis can be limited under special pathophysiological conditions. Five amino acids are dispensable in humans, meaning they can be synthesized in sufficient quantities in the body." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Where does the woman in gold painting reside?", "passages": [ [ "Maria Altmann", "The painting \"Portrait of Adele Bloch-Bauer I\" (1907) was sold to cosmetics heir Ronald Lauder for $135 million, at the time the highest sum ever paid for a painting.", "Since July 13, 2006, the painting has been on public display in the Neue Galerie in New York City, which was established by Lauder in 2001.", "The four additional works by Klimt were also exhibited at the Neue Gallerie for several weeks in 2006.", "In November 2006, \"Adele Bloch-Bauer II\" (1912) was sold at auction at Christie's in New York fetching almost $88 million.", "In total, the four remaining paintings sold at auction for $192.7 million; coupled with the Lauder-bought painting the sum total was approximately $325 million.", "The proceeds were divided up among several heirs.", "A share of the money earned through the sale of the pictures was used to found the Maria Altmann Family Foundation, which supports the Los Angeles Museum of the Holocaust and other public and philanthropic institutions.", "Altmann died on February 7, 2011 at her home in the Cheviot Hills neighborhood of Los Angeles, shortly before her 95th birthday.", "Obituaries appeared in \"The New York Times\", \"The Guardian\", and many other publications internationally.", "Altmann's story has been recounted in three documentary films." ], [ "\u00d6sterreichische Galerie Belvedere", "\u00d6sterreichische Galerie Belvedere\n\nThe \u00d6sterreichische Galerie Belvedere is a museum housed in the Belvedere palace, in Vienna, Austria.", "The Belvedere palaces were the summer residence of Prince Eugene of Savoy (1663\u20131736).", "The ensemble was built in the early eighteenth century by the famous Baroque architect, Johann Lucas von Hildebrandt, and comprises the Upper and Lower Belvedere, with the Orangery and Palace Stables, as well as extensive gardens.", "As one of Europe's most stunning Baroque landmarks, it is listed as a UNESCO World Heritage Site.", "Today, the Belvedere houses the greatest collection of Austrian art dating from the Middle Ages to the present day, complemented by the works of international artists.", "At the Upper Belvedere, visitors not only encounter artworks drawn from over five hundred years of art history but can also experience the magnificent staterooms.", "In addition to the Lower and Upper Belvedere, the museum has further sites at Prince Eugene's town palace and the 21er", "Haus as well as the Gustinus Ambrosi Museum.", "The Belvedere's art collection presents an almost complete overview of the development of art in Austria and, thus, an insight into the country's history." ], [ "Neue Galerie New York", "Neue Galerie New York\n\nThe Neue Galerie New York (German for: \"\"New Gallery\"\") is a museum of early twentieth-century German and Austrian art and design located in the William Starr Miller House at 86th Street and Fifth Avenue in New York City.", "Established in 2001, it is one of the most recent additions to New York City's famed Museum Mile, which runs from 83rd to 105th streets on Fifth Avenue in the Upper East Side of Manhattan.", "The museum was first conceived by two close friends: art dealer and museum exhibition organizer Serge Sabarsky, and entrepreneur, philanthropist, and art collector Ronald S. Lauder.", "The two men shared a passionate commitment to early twentieth-century German and Austrian art and design.", "They met in 1967, just before Sabarsky opened his Serge Sabarsky Gallery at 987 Madison Avenue.", "Almost immediately, the gallery earned a reputation as New York\u2019s leading gallery for Austrian and German Expressionist art.", "Lauder was a frequent visitor and client.", "Over the years, the two men discussed opening a museum to showcase the very best work from the period.", "When Sabarsky died in 1996, Lauder chose to carry on the task of creating Neue Galerie New York, as a tribute to his friend.", "The collection of the Neue Galerie is divided into two sections." ] ], "gold": "Since it was purchased by Ronald Lauder in 2006, the Woman in Gold painting by Gustav Klimt has resided in the Neue Galerie, a museum in New York City. After being stolen by the Nazis in 1941, it resided in the \u00d6sterreichische Galerie Belvedere, a museum housed in the Belvedere palace in Vienna, Austria.", "prediction 1": "The painting entitled \"Portrait of Adele Bloch-Bauer I\" was sold to cosmetics heir Ronald Lauder for $135 million, at the time the highest sum ever paid for a painting. Since July 13, 2006, the painting has been on public display in the Neue Galerie in New York City, which was established by Lauder in 2001. The Neue Galerie New York is a museum of early twentieth-century German and Austrian art and design located in the William Starr Miller House at 86th Street and Fifth Avenue in New York City.", "prediction 2": "The woman in gold painting is in the collection of the Neue Galerie in New York City, which was established in 2001 by art collector Ronald Lauder. The painting has been on public display since July 13, 2006, in the Neue Galerie in New York City since 2001. The Belvedere palaces were the summer residence of Prince Eugene of Savoy (1663\u20131736). The Belvedere palace contains the largest collection of Austrian art dating from the Middle Ages to the present day, complemented by the works of international artists.", "prediction 3": "The painting \"Portrait of Adele Bloch-Bauer I\" was sold to cosmetics heir Ronald Lauder for $135 million, at the time the highest sum ever paid for a painting. Since July 13, 2006, the painting has been on public display in the Neue Galerie in New York City, which was established by Lauder in 2001. The Neue Galerie New York is a museum of early twentieth-century German and Austrian art and design located in the William Starr Miller House at 86th Street and Fifth Avenue in New York. The painting was sold to Lauder for $135 million, at the time the highest sum ever paid for a painting.", "prediction 4": "The woman in gold painting is located in the sterreichische Galerie Belvedere, which is a museum housed in the Belvedere palace, in Vienna, Austria. The painting, Portrait of Adele Bloch-Bauer I, was sold to cosmetics heir Ronald Lauder for $135 million, at the time the highest sum ever paid for a painting. The Neue Galerie New York, which was established by Lauder in 2001, is a museum of early twentieth-century German and Austrian art and design located in the William Starr Miller House at 86th Street and Fifth Avenue in New York City.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 408 } ], "missing-info": [], "corrected-prediction": "The painting entitled \"Portrait of Adele Bloch-Bauer I\" was sold to Ronald Lauder. Since July 13, 2006, the painting has been on public display in the Neue Galerie in New York City. The Neue Galerie New York is a museum located in the William Starr Miller House at 86th Street and Fifth Avenue in New York City." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who owned the farmhouse where the two commanders of the civil war met to end the war?", "passages": [ [ "McLean House (Appomattox, Virginia)", "In the fall of 1867 the McLeans left Appomattox Court House was returned to Mrs. McLean's estate in Prince William County, Virginia.", "The banking house of Harrison, Goddin, and Apperson of Richmond, Virginia, obtained a judgment against Wilmer McLean when he defaulted on loans against the property.", "The house, by then known as the \"Surrender House\", was sold at public auction on November 29, 1869, and purchased by John L. Pascoe.", "Records show he then rented it to the Ragland family of Richmond, Virginia.", "The renter Nathaniel H. Ragland then purchased the property for $1,250 in 1872.", "After Nathaniel died in 1888, his widow Martha sold the property in 1891 for $10,000 to a Captain Myron Dunlap of Niagara Falls, New York.", "Dunlap and some other investors who participated devised a few plans intending to capitalize on the historical significance of the property.", "One idea was to completely take apart the wooden house and move it to Chicago as an exhibit for the World's Columbian Exposition of 1893.", "This plan fell through due to lack of total interest of all the investors involved.", "Another scheme they came up with later was to move the disassembled house to Washington, D.C. to become a permanent display as a Civil War museum." ], [ "McLean House (Appomattox, Virginia)", "McLean House (Appomattox, Virginia)\n\n", "The McLean House in Appomattox, Virginia is within the Appomattox Court House National Historical Park.", "Then owned by Wilmer McLean and his wife Virginia, the house near the end of the American Civil War served as the location of the surrender of the Confederate army of Robert E. Lee on April 9, 1865, after a nearby battle.", "The reconstructed house was registered in the National Park Service's database of Official Structures on June 26, 1989.", "The McLean House was originally built by Charles Raine in 1848.", "Eliza D. Raine's estate sold the house to Wilmer McLean in 1863.", "It had formerly been a tavern (not to be confused with the nearby Clover Hill Tavern, which Raine had previously owned).", "One of the first battles of the American Civil War took place on the farm of Wilmer McLean at Bull Run, Virginia, the First Battle of Bull Run (First Battle of Manassas).", "Soon after that battle the McLeans, seeking to avoid the war, moved to the village of Clover Hill, Virginia (the name of which was changed to \"Appomattox Court House,\" having just become the county seat).", "Because of the name of the village, many mistakenly think the surrender was signed in the courthouse building." ], [ "Appomattox Court House National Historical Park", "Appomattox Court House National Historical Park\n\nThe Appomattox Court House is a National Historical Park of original and reconstructed 19th century buildings in Appomattox County, Virginia.", "The village is famous as the site of the Battle of Appomattox Court House and containing the house of Wilmer McLean, where the surrender of the Confederate army under Robert E. Lee to Union commander Ulysses S. Grant took place on April 9, 1865, effectively ending the American Civil War.", "The McLean House was the site of the surrender conference, but the village itself is named for the presence nearby of what is now preserved as the Old Appomattox Court House.", "The park was established August 3, 1935.", "The village was made a national monument in 1940 and a national historical park in 1954.", "It is located about three miles (5\u00a0km) east of Appomattox, Virginia, the location of the Appomattox Station and the \"new\" Appomattox Court House.", "It is in the center of the state about east of Lynchburg, Virginia.", "The historical park was described in 1989 as having an area of .", "The antebellum village started out as \"Clover Hill\" named after its oldest existing structure, the Clover Hill Tavern (c. 1819).", "The village was a stagecoach stop along the Richmond-Lynchburg stage road." ] ], "gold": "The McLean House near Appomattox, Virginia is where two commanders of the Civil War, Ulysses S. Grant and Robert E. Lee, met to end the war. This house was owned by Wilmer McLean and his wife Virginia near the end of the Civil War. It served as the location for the surrender of the Confederate army by General Robert E. Lee on April 9, 1865, after a nearby battle. Then, in 1867, a judgment was issued against Wilmer McLean when he defaulted on loans against this property. The house, by then known as the Surrender House, was sold at a public auction on November 29, 1869, and purchased by John L. Pascoe. Records show Pascoe then rented the house to the Ragland family of Richmond, Virginia. The renter Nathaniel H. Ragland then purchased the property for $1,250 in 1872. After Nathaniel died in 1888, his widow Martha sold the property in 1891 for $10,000 to Captain Myron Dunlap of Niagara Falls, New York. Dunlap and additional investors devised a few plans intending to capitalize on the historical significance of the property. One idea was to completely take apart the wooden house and move it to Chicago as an exhibit. Eventually, the investors involved ran out of money and legal problems came about. The house then became just a heaping pile of boards and bricks, sitting prey to vandals, collectors and the environment for fifty years. Ultimately, Appomattox Court House National Historical Park was created by Congress on April 10, 1940 to reconstruct and preserve this historical site. ", "prediction 1": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer McLean and his wife Virginia. After the end of the war, the farmhouse was returned to Mrs. McLean's estate in Prince William County, Virginia and was purchased by John L. Pascoe on November 29, 1869. Then owned by Wilmer McLean and his wife Virginia, the farmhouse near the end of the American Civil War served as the location of the surrender of the Confederate army of Robert E. Lee on April 9, 1865, after a nearby battle. Captain Myron Dunlap of Niagara Falls, New York, and other investors tried to capitalize on the historical significance of the property.", "prediction 2": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer McLean and his wife Virginia. The farmhouse was originally built by Charles Raine in 1848. Eliza D. Raine's estate sold the house to Wilmer McLean in 1863. On April 9, 1865, the surrender of the Confederate army under Robert E. Lee to Union commander Ulysses S. Grant took place, effectively ending the American Civil War. The house, by then known as the \"Surrender House\", was purchased by John L. Pascoe.", "prediction 3": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer McLean and his wife Virginia. The McLean House in Appomattox, Virginia is within the Appomattox Court House National Historical Park. The house near the end of the American Civil War served as the location of the surrender of the Confederate army of Robert E. Lee on April 9, 1865, after a nearby battle. The house was originally built by Charles Raine in 1848. Eliza D. Raine's estate sold the house to Wilmer McLean in 1865.", "prediction 4": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer and Virginia McLean, who lived in the house during the Civil War. The farmhouse was owned by John L. Pascoe, John L. Pascoe rented it to the Ragland family of Richmond, Virginia, and Nathaniel H. Ragland purchased it for $1,250 in 1872. After Nathaniel died in 1888, his widow Martha sold the property in 1891 for $10,000 to a Captain Myron Dunlap of Niagara Falls, New York. The reconstructed house was recorded in the National Park Service's database of Official Structures on June 26, 1989.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 240 }, { "error type": "Redundant", "explanation": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer McLean and his wife Virginia. ", "start": 295, "end": 497 }, { "error type": "Irrelevant", "explanation": "", "start": 498, "end": 520 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The farmhouse where the two commanders of the Civil War met to end the war was owned by Wilmer McLean and his wife Virginia. After the end of the war Wilmer McLean defaulted on his loans against the property. The house, by then known as the \"Surrender House\", was sold at public auction on November 29, 1869, and purchased by John L. Pascoe. Records show he then rented it to the Ragland family of Richmond, Virginia. The renter Nathaniel H. Ragland then purchased the property for $1,250 in 1872. After Nathaniel died in 1888, his widow Martha sold the property in 1891 for $10,000 to a Captain Myron Dunlap of Niagara Falls, New York. He and other investors tried to capitalize on the historical significance of the property. One idea was to completely take apart the wooden house and move it to Chicago as an exhibit. Appomattox Court House National Historical Park reconstructed the house and registered it in 1989." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the movie the greatest show man come out?", "passages": [ [ "The Greatest Showman", "The cast album is now at 910,000 combined units, according to the Official Charts Company, made up of 420,000 physical copies, 186,000 downloads and 186,000 streaming.", "On November 16, 2018.", "20th Century Fox released a cover album entitled \"The Greatest Showman: Reimagined\", featuring a variety of artists.", "\"The Greatest Showman\" held its premiere on December 8, 2017, aboard the RMS \"Queen Mary 2\", while it was docked in New York City.", "The film was then released in the United States on December 20, 2017.", "Like Disney's live-action \"Beauty and the Beast\", a sing-along version of the film was released in the United Kingdom on February 23, 2018.", "The film had a limited IMAX release on February 2.", "On June 28, 2017, 20th Century Fox released the first international trailer to promote the film.", "On November 13, 2017, the second trailer was released.", "On December 17, 2017, Fox televised a live performance of \"Come Alive\" from Warner Bros.", "Studios during its live musical special \"A Christmas Story Live!\"", "(which was based on fellow Pasek and Paul work \"\").", "The number featured the film's stars and a cast of 150 dancers." ], [ "The Greatest Showman", "In the United States, the film was released via digital download on March 20, 2018, and was released on Blu-ray, DVD and 4K Ultra HD on April 10, 2018.", "In the United Kingdom, the film was released first on digital download on April 27, 2018, while Blu-ray, 4K Ultra HD and DVD copies went on sale on May 14.", "These versions include the sing-along version, two hours of behind-the-scenes footage and music machine jukebox features.", "\"The Greatest Showman\" spent 219 days in release, closing on July 26, 2018, having grossed $174.3million in the United States and Canada, and $260.7million in other territories, for a worldwide total of $435million, against a production budget of $84million.", "It is the third highest grossing musical ever in North America and globally, respectively, and \"Deadline Hollywood\" estimated the film would turn a profit between $50\u2013100 million.", "In the United States and Canada, \"The Greatest Showman\" was released alongside \"\", and was projected to gross around $21million from 3,006 theaters over its first six days.", "It took in $2million on its first day and $2million on its second." ], [ "RMS Queen Mary 2", "RMS Queen Mary 2\n\nRMS \"Queen Mary 2 (also referred to as the QM2\") is a transatlantic ocean liner.", "She is the largest passenger ship built for the Cunard Line since \"Queen Elizabeth 2\" in 1969, the vessel she succeeded as flagship of the line.", "As of 2018, \"Queen Mary 2\" is the only passenger ship operating as an ocean liner.", "The new ship was named \"Queen Mary 2\" by Queen Elizabeth II in 2004 after the first of 1936.", "\"Queen Mary\" was in turn named after Mary of Teck, consort of King George V. With the retirement of \"Queen Elizabeth 2\" in 2008, \"Queen Mary 2\" is the only transatlantic ocean liner in line service between Southampton, England, and New York City, United States, operating for a part of each year.", "The ship is also used for cruising, including an annual world cruise.", "She was designed in 2003 by a team of British naval architects led by Stephen Payne, and was constructed in France by Chantiers de l'Atlantique.", "At the time of her construction, \"Queen Mary 2\" held the distinctions of being the longest, at , and largest, with a gross tonnage of , passenger ship ever built.", "She no longer holds this distinction after the construction of Royal Caribbean International's in April 2006, but remains the largest ocean liner ever built." ] ], "gold": "The Greatest Showman held its premiere on December 8, 2017 aboard the RMS Queen Mary 2 while the ship was docked in New York City. The film was then released in the United States on December 20, 2017. Additionally, a sing-along version of the film was released in the United Kingdom on February 23, 2018. In the United States, the film was then released via digital download on March 20, 2018 and on DVD, Blu-ray and 4K Ultra HD on April 10, 2018.", "prediction 1": "The Greatest Showman came out on December 8, 2017 aboard the RMS Queen Mary 2 while it was docked in New York City. The film was released in the United States on December 20, 2017.", "prediction 2": "The Greatest Showman came out on December 8, 2017. The film was released in the United States on December 20, 2017. In the United Kingdom, the film came out on February 23, 2018, with a sing-along version released in the United Kingdom on February 23, 2018.", "prediction 3": "The Greatest Showman came out in the United States on December 20, 2017, and in the United Kingdom on February 23, 2018. The film was released internationally on June 28, 2017, and was projected to gross around $21million from 3,006 theaters over its first six days. The film held its premiere on December 8, 2017, aboard the RMS Queen Mary 2 while it was docked in New York City. The United Kingdom released the film on digital download on April 27, 2018, while Blu-ray, DVD and 4K Ultra HD copies went on sale on May 14.", "prediction 4": "The Greatest Showman is a 2017 American musical drama film starring Tom Hanks and the cast of the Royal Ballet of Great Britain. The movie came out in theaters on December 8, 2017 aboard the RMS Queen Mary 2 while it was docked in New York City. The film was then released in the United States on December 20, 2017.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Greatest Showman came out on December 8, 2017 aboard the RMS Queen Mary 2 while it was docked in New York City. The film was released in the United States on December 20, 2017. A sing-along version of the film was released in the United Kingdom on February 23, 2018. The film had a limited IMAX release on February 2. In the United Kingdom, the film was released first on digital download on April 27, 2018, while Blu-ray, 4K Ultra HD and DVD copies went on sale on May 14. In the United States, the film was released via digital download on March 20, 2018, and was released on Blu-ray, DVD and 4K Ultra HD on April 10, 2018." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Most points scored in a premier league season?", "passages": [ [ "Pep Guardiola", "The following campaign, he led Barcelona to four trophies, including winning his second Spanish league title as manager.", "In 2011, after leading the club to another La Liga and Champions League double, Guardiola was awarded the Catalan Parliament's Gold Medal, their highest honour.", "The same year, he was also named the FIFA World Coach of the Year.", "In Guardiola's final season at Barcelona, he again won four trophies, before departing in 2012.", "He ended his four-year Barcelona stint with 14 honours, a club record.", "After a sabbatical period, Bayern Munich announced Guardiola would join the club as manager in 2013.", "In his first season at the club, he won four trophies, including a double of Bundesliga and DFB-Pokal.", "Guardiola won seven trophies during his three-year tenure in Germany; winning the Bundesliga every season he was there, as well as two domestic doubles.", "He left the \"Bavarians\" for English club Manchester City in 2016, and guided them to a Premier League title in his second campaign in charge, breaking numerous domestic records as the team became the first to attain 100 league points.", "Guardiola is regarded to be one of the greatest and most successful managers of all time.", "He also holds the record for the most consecutive league wins in La Liga, Bundesliga and Premier League." ], [ "2014\u201315 Premier League", "2014\u201315 Premier League\n\n", "The 2014\u201315 Premier League (known as the Barclays Premier League for sponsorship reasons) was the 23rd season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The fixtures were announced on 18 June 2014.", "The season started on 16 August 2014 and concluded on 24 May 2015.", "Manchester City came into the season as defending champions of the 2013\u201314 season.", "Leicester City, Burnley and Queens Park Rangers entered as the three promoted teams.", "On 3 May 2015, Chelsea won the title with three games to spare after a 1\u20130 home win over Crystal Palace.", "It was their first league title since 2010, their fourth Premier League title and their fifth English league title overall.", "Holders Manchester City eventually finished second, after a short drop to fourth a few weeks before the final match.", "Burnley were the first team to be relegated despite beating Hull City 1\u20130, while Queens Park Rangers suffered the same fate after a 6\u20130 demolition by Manchester City the next day.", "Hull City were the third and final team to be relegated after a draw against Manchester United on the final day of the season.", "Manchester City's Sergio Ag\u00fcero won the Golden Boot with 26 goals, with his teammate Joe Hart clinching a record fourth Golden Glove, having kept 14 clean sheets." ] ], "gold": "Manchester City holds the record for the most points scored in a Premier League Season with 100. Under the management of Pep Guardiola, Manchester City won the Premier League in 2018, becoming the only Premier League team to attain 100 points in a single season.", "prediction 1": "In the premier league, the most points scored in a season is 100. In the 2013-2014 season, the most points scored in a Premier League season was 102. In the 2014-2015 season, the most points scored were 104.", "prediction 2": "The most points scored in a premier league season by a player is 113, with 77 goals scored by a team in the 2015/16 season. The record for most points scored in a premier league season by a player is 125, with 84 in the 2015/16 season.", "prediction 3": "In the 2014-2015 season, Manchester City scored the most points in a Premier League season. The team also finished the season with the most goals (101), and the most goals conceded (115).", "prediction 4": "The most most goals scored in a Premier League season is 138, in the 2015/16 season it was 134 points. The record for most points scored in a season is 134, in the 2013-14 season it was 124. In the 2015/16 season it was 123, while the 2013-14 season record was 134 points.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 150, "end": 207 }, { "error type": "Unverifiable", "explanation": "", "start": 66, "end": 149 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In the premier league, the most points scored in a season is 100. Under the management of Pep Guardiola, Manchester City won the Premier League in 2018, becoming the only Premier League team to attain 100 points in a single season." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who wrote the night the lights went out in georgia?", "passages": [ [ "The Night the Lights Went Out in Georgia (Vicki Lawrence album)", "The Night the Lights Went Out in Georgia (Vicki Lawrence album)\n\n", "The Night the Lights Went Out in Georgia is the 1973 debut album by Vicki Lawrence, recorded and released on Bell Records.", "It features the Billboard Hot 100 #1 pop hit in the U.S. and Canada, The Night the Lights Went Out in Georgia\", written by Bobby Russell.", "Another song, \"He Did With Me,\" reached #1 in Australia.", "This album also features a few cover songs, such as Cher's \"Gypsys, Tramps & Thieves\", Roger Miller's \"Little Green Apples\" and Lori Lieberman's \"Killing Me Softly with His Song\".", "All songs written by Bobby Russell except where noted." ], [ "The Night the Lights Went Out in Georgia", "The Night the Lights Went Out in Georgia\n\n\"The Night the Lights Went Out in Georgia\" is a Southern Gothic song, written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence, an American pop music singer, actress, author, and comedienne.", "Lawrence's version, from her 1973 Bell Records album of the same name, was a number one hit on the \"Billboard\" Hot 100 after its release.", "In addition to several other renditions, the song was again a hit in 1991 when Reba McEntire recorded it for her album \"For My Broken Heart\".", "McEntire's version was a single, as well, reaching number 12 on Hot Country Songs.", "Returning home from a two-week trip to a place called Candletop, a man, identified only as \"Brother\", stops for a drink at Webb's Bar before going home to his wife.", "While there, he encounters his friend Andy, who informs him that while he was gone his wife has been having an affair with another man, \"that Amos boy, Seth\"; Andy then admits that he himself had been with her as well.", "Brother leaves the bar angry, and a frightened Andy makes his way home.", "Assuming his wife had left town, Brother goes home to find his gun and quietly makes his way through the woods to Andy's house." ], [ "The Night the Lights Went Out in Georgia (film)", "The Night the Lights Went Out in Georgia (film)\n\n", "The Night the Lights Went Out in Georgia is a 1981 American musical drama film starring Kristy McNichol, Dennis Quaid, Mark Hamill and Don Stroud, directed by Ronald F. Maxwell.", "It was very loosely inspired by the 1973 Vicki Lawrence song of the same name (it shares almost no plot elements with the original song).", "In 1981, Tanya Tucker recorded a different version for the film's soundtrack and new lyrics related to the plot of the film were written.", "These altered lyrics were based on the plot line of the movie, which is not the same as the story of the original song.", "A young singer and his sister/manager travel to Nashville in search of stardom.", "As they journey from one grimy hotel to another, it becomes increasingly obvious that only one of them has what it takes to become a star.", "Travis Child (Quaid) is a country singer who had one hit song and then faded from the scene.", "His ambitious younger sister, Amanda (McNichol), is determined to get them to Nashville where Travis can once again become a star.", "Her plans are derailed by Travis's lack of ambition and easy distraction by women and booze." ] ], "gold": "The 1972 Southern Gothic song \"The Night the Lights Went Out in Georgia\" was written by Bobby Russell and performed by Vicki Lawrence. The 1981 movie loosely inspired by the show was directed by Ronald F. Maxwell and written by Bob Bonney.", "prediction 1": "The Night the Lights Went Out in Georgia is a Southern Gothic song written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence. Lawrence's version, from her 1973 Bell Records album of the same name, was a number one hit on the Billboard Hot 100 after its release. In 1981, Tanya Tucker recorded a different version for the film's soundtrack and new lyrics related to the plot of the film were written. These altered lyrics were based on the plot line of the movie, which is not the story of the original song.", "prediction 2": "The Night the Lights Went Out in Georgia is a Southern Gothic song, written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence. In 1981, Tanya Tucker recorded a different version for the film's soundtrack and new lyrics related to the plot of the movie were written. These altered lyrics were based on the plot line of the movie, which is not the same as the story of the original song.", "prediction 3": "The Night the Lights Went Out in Georgia is a Southern Gothic song, written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence. It also appeared on the soundtrack to the 1981 musical drama film The Night the Lights Went Out in Georgia, which was loosely inspired by the 1973 Vicki Lawrence song of the same name. In 1981, Tanya Tucker recorded a different version for the film's soundtrack and new lyrics related to the plot of the film were written. These altered lyrics were based on the plot line of the movie, which is not the story of the original song.", "prediction 4": "\"The Night the Lights Went Out in Georgia\" is a Southern Gothic song, written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence, an American pop music singer, actress, author, and comedienne. In 1981, Tanya Tucker recorded a different version for the film's soundtrack and new lyrics related to the plot of the movie were written. These altered lyrics were based on the plot line of the movie, which is not the same as the story of the original song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 412 }, { "error type": "Irrelevant", "explanation": "", "start": 413, "end": 520 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Night the Lights Went Out in Georgia is a Southern Gothic song written in 1972 by songwriter Bobby Russell and sung by Vicki Lawrence. In 1981, Tanya Tucker recorded a different version for the film, that was loosely inspired by the song and directed by Ronald F. Maxwell." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "When does breaking benjamin's new album release?", "passages": [ [ "We Are Not Alone (Breaking Benjamin album)", "We Are Not Alone (Breaking Benjamin album)\n\n", "We Are Not Alone is the second studio album by American rock band Breaking Benjamin.", "It was released June 29, 2004.", "Three singles were released from the album, \"So Cold\", \"Sooner or Later\", and the full-band version of \"Rain\", as opposed to the original version in which the only instrument used is an acoustic guitar, which came out near the end of June 2005.", "\"We Are Not Alone\" sold 48,000 copies on its first week and was certified platinum by the RIAA on June 13, 2005.", "A \"Live EP\" was released with limited editions of the album, containing live recorded versions of \"Sugarcoat,\" \"Water,\" \"Medicate,\" and \"Next to Nothing\" from their first album \"Saturate.\"", "\"We Are Not Alone\" is the last studio album to feature drummer Jeremy Hummel.", "The track \"Firefly\" was featured in the 2004 video games \"WWE SmackDown!", "vs. Raw\" and \"WWE Day of Reckoning\".", "According to AllMusic critic Johnny Loftus, the album stylistically incorporates early Tool's sound through post-grunge's more accessible melodics." ], [ "Dark Before Dawn", "Dark Before Dawn\n\nDark Before Dawn is the fifth studio album by American rock band Breaking Benjamin, released on June 23, 2015 by Hollywood Records.", "It is the group's first studio album following the band's hiatus lasting from early 2010 to late 2014, and the first album to feature an entirely different lineup alongside founder and frontman Benjamin Burnley.", "Produced and composed by Burnley, the album took shape towards the end of the hiatus and was mostly written before the new lineup \"even played a single note together.\"", "The recording process took place afterwards at both a personal studio of Burnley's and at the same studio \"Phobia\" (2006) was recorded, with all of the band members performing their respective instruments, including background vocals performed by guitarist Keith Wallen and bassist Aaron Bruch, making the record their first to feature vocals other than Burnley's.", "The album was a critical and commercial success.", "It garnered mostly positive reception, many critics praising the album for staying true to the group's established sound, although others criticized it for sounding too similar to previous material.", "Burnley described that he did not want to \"reinvent the wheel\" with the album.", "It debuted at No." ], [ "Breaking Benjamin discography", "Breaking Benjamin discography\n\nThe American rock band Breaking Benjamin has released six studio albums, one compilation album, three extended plays, twenty singles and fifteen music videos.", "The group has sold over seven million units in the United States alone, with three platinum records, two gold records, two multi-platinum singles, two platinum singles, and five gold singles as designated by the RIAA.", "The band signed with Hollywood Records in 2002 following the success of their independently-released eponymous EP, and began recording their first full-length major-label debut \"Saturate\" shortly thereafter.", "The record peaked at No. 2 on the US Top Heatseekers chart and No. 136 on the US \"Billboard\" 200.", "It was certified gold more than thirteen years later.", "The band's sophomore effort, \"We Are Not Alone\", released in 2004, peaked at No. 20 on the US \"Billboard\" 200, and was later certified platinum in the United States and gold in New Zealand.", "Breaking Benjamin's third studio album \"Phobia\" was released in 2006 and reached No. 2 on the US \"Billboard\" 200, No. 1 on the US Digital Albums chart, No. 1 on the US Top Rock Albums chart, and was certified platinum nearly three years after its release.", "Breaking Benjamin released their fourth record in late 2009 titled \"Dear Agony\", reaching No." ] ], "gold": "The American rock band Breaking Benjamin has released six studio albums. In order of date released, the albums are Saturate, released August 27, 2002, We Are Not Alone, released June 29, 2004, Phobia, released August 8, 2006, Dear Agony, released September 29, 2009, Dark Before Dawn, released June 23, 2015, and Ember, released April 13, 2018.", "prediction 1": "Breaking Benjamin has released six studio albums, one compilation album, three extended plays, twenty singles and fifteen music videos. Their latest album, Dark Before Dawn, was released on June 23, 2015. Breaking Benjamin's previous album, We Are Not Alone, was released on June 29, 2004. Breaking Benjamin's third album Phobia was released in 2006 and reached No. 2 on the US Billboard 200, No. 1 on the US Digital Albums chart, No. 1 on the US Top Rock Albums chart, and was certified platinum nearly three years after its release. Their fourth album, Dear Agony, reached No. 2 on the US Billboard 200 and was certified platinum nearly three years after its release. Breaking Benjamin released their fourth record in late 2009.", "prediction 2": "Breaking Benjamin's new album, Dark Before Dawn, was released on June 23, 2015. It was released simultaneously with their fourth studio album, Dear Agony, which debuted at No. 1. The band also released their fifth studio album, Dark Before Dawn, on June 23, 2015.", "prediction 3": "Breaking Benjamin's new album Dark Before Dawn was released on June 23, 2015. It is the group's first studio album following the band's hiatus lasting from early 2010 to late 2014, and the first album to feature an entirely different lineup alongside founder and frontman Benjamin Burnley. Breaking Benjamin has released six studio albums, one compilation album, three extended plays, twenty singles and fifteen music videos to date.", "prediction 4": "Breaking Benjamin has released six studio albums, one compilation album, three extended plays, twenty singles and fifteen music videos. The band's fourth record was released in late 2009 titled Dear Agony and their fifth studio album Dark Before Dawn was released on June 23, 2015. Breaking Benjamin's new album was released on August 28, 2015 by Hollywood Records.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 135 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 142, "end": 148 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 225, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 534 }, { "error type": "Unverifiable", "explanation": "", "start": 567, "end": 669 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The American rock band Breaking Benjamin has released six studio albums. Their fifth album, Dark Before Dawn, was released on June 23, 2015. Breaking Benjamin's second album, We Are Not Alone, was released on June 29, 2004. Breaking Benjamin's third album Phobia was released in 2006. Their fourth album, Dear Agony was released in late 2009." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who sings the song it never rains in california?", "passages": [ [ "It Never Rains (In Southern California)", "It Never Rains (In Southern California)\n\n\"It Never Rains (In Southern California)\" is a 1990 song recorded by the American R&B group Tony!", "Toni! Ton\u00e9!.", "This song peaked at number one on the \"Billboard\" Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100.", "The music video to \"It Never Rains (In Southern California)\" was directed by actress Lisa Bonet." ], [ "It Never Rains in Southern California", "It Never Rains in Southern California\n\n\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter.", "Instrumental backing was provided by L.A. session musicians from the Wrecking Crew.", "The song appears on Hammond's album \"It Never Rains in Southern California\" and peaked at number five on the U.S. \"Billboard\" Hot 100 chart.", "In the UK, the song is perhaps the quintessential example of a turntable hit: a song that, although very frequently played and requested on radio, never makes it into the charts.", "Through the 1970s, the record was reissued at least five times by various labels but never charted, despite yet more airplay, and is still frequently heard on UK radio.", "The song concerns the struggles of an actor who moves to California to pursue a career in Hollywood but does not have any success and deteriorates in the process.", "In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya.", "It pours, man, it pours.\"", "In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation." ] ], "gold": "There are several songs entitled It Never Rains In Southern California. The 1972 song, It Never Rains In Southern California, was sung by Albert Hammond. The 1990 song, It Never Rains(In Southern California), was sung by R&B group Tony! Toni! Ton\u00e9!.", "prediction 1": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. Instrumental backing was provided by L.A. session musicians from the Wrecking Crew. In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation.", "prediction 2": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya. It pours, man, it pours.\" In 1990, Tony! Toni! Ton\u00e9! recorded a song titled It Never Rains (In Southern California), which peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks and thirty-four on the Hot 100. In 1989, Hammond re-re-re-re-re-re-songwriter for his \"Best of Me\" greatest hits compilation.", "prediction 3": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya. It pours, man, it pours.\" This song peaked at number one on the \"Billboard\" Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100. In 1989, Hammond re-re-re-re-re-re-recorded the song for his \"Best of Me\" greatest hits compilation.", "prediction 4": "It Never Rains in Southern California is a song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. In 1972, the song was written by Hammond and Mike Hazlewood, and sung by Hammond. In 1990, the song was recorded by the American R&B group Tony! Toni! Ton\u00e9!.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 324 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "\"It Never Rains in Southern California\" is a 1972 song sung by Albert Hammond. The 1990 song, It Never Rains(In Southern California), was sung by R&B group Tony! Toni! Ton\u00e9!." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "The little girl who voiced ducky in the land before time?", "passages": [ [ "The Land Before Time VIII: The Big Freeze", "The Land Before Time VIII: The Big Freeze\n\nThe Land Before Time VIII: The Big Freeze is a 2001 direct-to-video animated adventure musical film and the eighth film in \"The Land Before Time\" series.", "Ducky's relationship with her brother Spike becomes rambunctious and turbulent when he repeatedly keeps her awake at night with his snoring and after he ate her tree stars (which their mother packed specifically for her on their first day of school).", "She tells Cera about her feelings, and confides that she does not know how to express them; Cera agrees to teach her.", "Meanwhile, the children are attending a school in which they are taught by an old \"Pachyrhinosaurus\" named Mr. Thicknose, who professes to have been everywhere and seen everything.", "Littlefoot eagerly questions the topics they cover, to the old dinosaur's irritation.", "Eventually, Mr. Thicknose complains to Grandpa Longneck about Littlefoot's behavior.", "Grandpa, knowing Littlefoot meant no harm, explains to him why he must be more respectful to Mr. Thicknose.", "Meanwhile, as Ducky treats Spike coldly, Spike meets and befriends Tippy, a young dinosaur from a migrating Spiketail herd that has recently arrived in the Great Valley." ], [ "The Land Before Time (franchise)", "The Land Before Time (franchise)\n\nThe Land Before Time, is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs.", "The series began in 1988 with the eponymous \"The Land Before Time\", directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg.", "It was followed by a total of thirteen direct-to-video musical sequels, TV series, video games, soundtracks and related merchandising.", "Neither the sequels nor the series involve the participation of Bluth, Lucas, or Spielberg.", "All 14 films were released in a Complete Collection DVD set on June 14, 2016.", "The films follow a friendship of a group of young dinosaurs by the names of Littlefoot (Apatosaurus), Cera (Triceratops), Petrie (Pteranodon), Ducky (Saurolophus), and Spike (Stegosaurus).", "After finding The Great Valley, they raise a carnivorous baby who they name Chomper, survive a drought, a cold snap, encounter aliens, and witness a solar eclipse.", "Throughout all films, they embark upon adventures, learning lessons about life and friendship along the way.", "The following is a list of the fourteen films in \"The Land Before Time\" series.", "A television series based on the films began airing on YTV in Canada on January 5, 2007." ], [ "Judith Barsi", "Judith Barsi\n\nJudith Eva Barsi (June 6, 1978 \u2013 July 25, 1988) was an American child actress of the 1980s.", "She began her career in television, making appearances in commercials and television shows, and later appeared in the films \"\", \"The Land Before Time\", and \"All Dogs Go to Heaven\", providing the voice for animated characters in the latter two.", "She and her mother, Maria, were both killed in July 1988 as a result of a double murder\u2013suicide perpetrated by her father, J\u00f3zsef.", "Barsi\u2019s father, J\u00f3zsef, fled Communist Hungary after the 1956 Soviet occupation.", "He relocated to New York in 1964, and then to California, where he met Maria Virovacz, also a Hungarian immigrant escaping the Soviet occupation.", "They married and moved to Los Angeles, California where, on June 6, 1978, Barsi was born.", "Maria Barsi began grooming her daughter to become an actress, and at the age of five, she was discovered at a skating rink.", "Barsi's first role was in \"Fatal Vision\", playing Kimberley MacDonald.", "She went on to appear in more than seventy commercials and guest roles on television." ], [ "Judith Barsi", "As well as her career in television, she appeared in several films, including \"\", and provided the voices of Ducky in \"The Land Before Time\", and Anne-Marie in \"All Dogs Go to Heaven\".", "By the time she started fourth grade, Barsi was earning an estimated $100,000 a year, which helped her family buy a three-bedroom house in West Hills, Los Angeles.", "As she was short for her age (she stood at age 10), she began receiving hormone injections at UCLA to encourage her growth.", "Her petiteness led casting directors to cast her as children that were younger than her actual age.", "Her agent was quoted in \"The Los Angeles Times\" as saying that when she was ten, \"she was still playing 7, 8.\"", "As Barsi\u2019s career success increased, J\u00f3zsef became increasingly angry and would routinely threaten to kill himself and his wife and daughter.", "His alcoholism worsened, causing the police to arrest him three separate times for drunk driving.", "In December 1986, Maria reported his threats and physical violence toward her to the police.", "After police found no physical signs of abuse, she decided not to press charges against him.", "After the incident with police, J\u00f3zsef Barsi reportedly stopped drinking, but continued to threaten Maria and Judith.", "His various threats included cutting their throats as well as burning down the house." ], [ "Aria Curzon", "Aria Curzon\n\nAria Noelle Curzon (born December 8, 1987) is an American actress.", "Her most famous voice roles are Ducky in \"The Land Before Time\" video series, Teresa (\"The Cornchip Girl\") in \"Recess\", and Mandy Straussberg in the radio drama \"Adventures in Odyssey\".", "She has received 3 Young Artist of Hollywood Awards, (5 nominations) 2 CARE Awards, and one CLIO Award (The CLIO being for a PSA she voiced).", "At age six, Curzon realized her interest in acting and performing while watching one of her favorite Shirley Temple videos.", "With her mother\u2019s help and care, she began auditioning, and by age six, she began her acting career in a Crayola commercial.", "In addition to acting, she is also a musician, singing and learning both guitar and fiddle, and a prize-winning Irish dancer.", "She has guest starred on many television shows, including \"Gigantic\", \"Without A Trace\", \"JAG\", \"The Pretender\", and \"Sabrina, the Teenage Witch\".", "Her credits include \"Treehouse Hostage\" (with Jim Varney) and \"Santa With Muscles\", starring Hulk Hogan, Adam Wylie, and Mila Kunis, and the 2011 film \"The Muppets." ], [ "The Land Before Time", "The artists had to create a credible landscape and animals.", "Animators made more than 600 background images for the film.", "Littlefoot was originally going to be called \"Thunderfoot\", until it was found out that a Triceratops in a children's book already had that name.", "It was Lucas's idea to make Cera a female Triceratops, when she was in mid-animation as a male named Bambo.", "Judith Barsi, the voice of Ducky, was killed by her father, J\u00f3zsef in a murder-suicide four months prior to the film's release.", "After voicing Digit in \"An American Tail\", Will Ryan performed the voice of Petrie.", "The idea was brought up by Spielberg's son, Max.", "The character of Spike was inspired by Don Bluth's pet Chow Chow, Cubby.", "Throughout production, \"The Land Before Time\" underwent a severe cutting and editing of footage.", "Spielberg and Lucas thought that some scenes in the movie would appear too dark and intense for young children.", "Spielberg told Bluth while looking at the scenes from the film, \"It's too scary.", "We'll have kids crying in the lobby, and a lot of angry parents.", "You don't want that.\"" ] ], "gold": "The Land Before Time is an American children's franchise of animated adventure films that began in 1988 with the eponymous The Land Before Time and was followed by 13 direct-to-video musical sequels, a TV series, video games, soundtracks, and related merchandising. The voice of Ducky in The Land Before Time I was provided by Judith Barsi, who was tragically killed, along with her mother, by her abusive father the year the film was released. Heather Hogan voiced the character of Ducky in The Land Before Time II-IV. American actress Aria Noelle Curzon, who received 3 Young Artist of Hollywood Awards, 2 CARE Awards, and one CLIO Award, voiced the role of Ducky in The Land Before Time video series, V-XIV.", "prediction 1": "The Land Before Time is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs. The series began in 1988 with the eponymous The Land Before Time, directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg. The films follow a friendship of a group of young dinosaurs by the names of Littlefoot, Apatosaurus, Cera, Petrie, Saurolophus, Ducky, and Spike. Ducky is voiced by actress Judith Barsi.\n", "prediction 2": "The Land Before Time is a franchise of animated adventure films by Universal Pictures that centers on dinosaurs. The franchise began in 1988 with the eponymous The Land Before Time. The Land Before Time franchise has since undergone several revisions. Clipper, Cate Blanchett and Kirsten Taylor are the two actors who voiced the characters in the films. The voice of Ducky in the 1998 film The Land Before Time was Louise Wagner. A little girl named Judith Barsi voiced the characters Ducky and Anne-Marie in the 2017 film The Land Before Time.", "prediction 3": "There are several The Land Before Time films written and directed by Don Bluth. The little girl who voiced Ducky in the films was Judith Barsi. Cute baby Ducky voiced by Yvonne De Castree.", "prediction 4": "There are several The Land Before Time films. In 1988, the film The Land Before Time was previewed by Don Bluth, while George Lucas directed the film. In 2001, the film The Land Before Time VIII: The Big Freeze was previewed by Judith Barsi, who was an American child actress of the 1980s. Throughout the series, Ducky received a few different voices. The baby duck was voiced by Retyana Gatkin in 1993 and Ella Fuller in 1997.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 280 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 426 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Land Before Time is an American franchise of animated adventure films. The series began in 1988 with the eponymous. It was followed by a total of thirteen direct-to-video musical sequels, TV series, video games, soundtracks and related merchandising. Ducky is voiced by actress Judith Barsi, who was tragically killed, along with her mother, by her father, four months prior to the film's release. American actress Aria Noelle Curzon, who received 3 Young Artist of Hollywood Awards, 2 CARE Awards, and one CLIO Award, voiced the role of Ducky in The Land Before Time video series.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the hymn on christ the solid rock i stand?", "passages": [ [ "My Hope Is Built on Nothing Less", "My Hope Is Built on Nothing Less\n\n\"My Hope Is Built on Nothing Less\" is a Christian hymn written by Edward Mote, a pastor at Rehoboth Baptist Church in Horsham, West Sussex.", "Mote wrote around 100 hymns, this one, which he wrote in 1834, being the best known of his.", "The hymn \"My Hope Is Built on Nothing Less\" was published anonymously in several hymn collections before first being attributed to Edward Mote in a collection of approximately 100 of his hymns published in 1837 under the title \"Hymns of Praise, A New Selection of Gospel Hymns, Combining All the Excellencies of our Spiritual Poets, with Many Originals\".", "Mote's original title was \"The Immutable Basis for a Sinner's Hope\" in this collection.", "The refrain of \"My Hope Is Built on Nothing Less\" refers to the Parable of the Wise and the Foolish Builders and builds around the metaphor of Christ as a rock with a firm basis in Scripture (1 Corinthians 10:4).", "\"My Hope Is Built on Nothing Less\" is part of the gospel hymns genre.", "The first stanza declare's God's grace; stanzas 2 and 3 concern the application of that grace in times of trouble.", "In the final stanza, Mote brings his hymn full circle with the ultimate realization of God's grace." ], [ "My Hope Is Built on Nothing Less", "The lyrics vary somewhat among various hymnals, but customarily the phraseology adheres to Mote's original.", "The hymn became very popular and has been subject of many interpretations and covers.", "\"My Hope Is Built on Nothing Less\" has served as basis of other hymns such as \"Solid Rock\" that use the same refrain.", "The tune SOLID ROCK to which Mote's words are most commonly set was composed by William B. Bradbury in 1863.", "Many times, both \"My Hope Is Built on Nothing Less\" and \"Solid Rock\" hymns are sung together as a medley.", "\"Solid Rock\" has also been sung as a medley with \"In Christ Alone\" written by Keith Getty and Stuart Townend.", "Desperation Band released a similarly-titled song \"Solid Rock\" on their 2009 album \"Light Up the World\".", "But the track is a completely different song (both in lyrics and in music) using the expression \"On Christ this solid rock I stand /", "All other ground is sinking sand\" in a musical bridge (or breakstrain).", "Hillsong Music released in 2012 a worship song as the title track to \"Cornerstone\", which uses the lyrics of \"My Hope Is Built on Nothing Less\" but with a different refrain and melody." ] ], "gold": "The text of the hymn My Hope Is Built on Nothing Less was written by Edward Mote, and melody by William B. Bradbury. 1 Corinthians 10:4, On Christ the Solid Rock I stand All other ground is sinking sand, is the basis of the refrain of the hymn.", "prediction 1": "On Christ the solid rock i stand is a Christian hymn written by Edward Mote, a pastor at Rehoboth Baptist Church in Horsham, West Sussex. Mote wrote around 100 hymns, this one, which he wrote in 1834, being the best known of his. The tune SOLID ROCK to which Mote's words are most commonly set was composed by William B. Bradbury in 1863. Hillsong Music released in 2012 a worship song as the title track to \"Cornerstone\". Hillsong Music released in 2012 a worship song using the lyrics and in both in lyrics and in music using the expression \"On Christ this solid rock I stand\" in a completely different song (both in lyrics and in lyrics and in lyrics and in lyrics and in both in lyrics and in lyrics and in music using the expression \"On Christ this solid rock I stand\" in a musical bridge (both in", "prediction 2": "On Christ this solid rock I stand is a Christian hymn written by Edward Mote, a pastor at Rehoboth Baptist Church in Horsham, West Sussex. Mote wrote around 100 hymns, this one, which he wrote in 1834, being the best known of his. The lyrics of the hymn \"My Hope Is Built on Nothing Less\" were published anonymously in several hymn collections before first being attributed to Edward Mote in a collection of approximately 100 of his hymns published in 1837 under the title \"Hyns of Praise, A New Selection of Gospel Hymns, Combining All the Excellencies of our Spiritual Poets, with Many Originals\". The tune \"Solid Rock\", to which Mote's words are most commonly set, was composed by William B. Bradbury in 1863.", "prediction 3": "\"My Hope Is Built on Nothing Less\" is a Christian hymn written by Edward Mote, a pastor at Rehoboth Baptist Church in Horsham, West Sussex. Mote wrote around 100 hymns, this one, which he wrote in 1834, being the best known of his. The refrain of My Hope Is Built on Nothing Less refers to the Parable of the Wise and the Foolish Builders and builds around the metaphor of Christ as a rock with a firm basis in Scripture. The tune SOLID ROCK to which Mote's words are most commonly set was composed by William B. Bradbury in 1863.", "prediction 4": "\"My Hope Is Built on Nothing Less\" is a Christian hymn written by Edward Mote, a pastor at Rehoboth Baptist Church in Horsham, West Sussex. Mote wrote around 100 hymns, this one, which he wrote in 1834, being the best known of his. The refrain of \"My Hope Is Built on Nothing Less\" refers to the Parable of the Wise and the Foolish Builders and builds around the metaphor of Christ as a rock with a firm basis in Scripture (1 Corinthians 10:4). The tune SOLID ROCK to which Mote's words are most commonly set was composed by William B. Bradbury in 1863.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 338 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 802 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 0, "end": 32 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"My Hope Is Built on Nothing Less\" is a Christian hymn written by Edward Mote. The tune SOLID ROCK to which Mote's words are most commonly set was composed by William B. Bradbury. Christ as a rock with a firm basis in Scripture (1 Corinthians 10:4)." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When was the european research laboratory (columbus) launched?", "passages": [ [ "Columbus (ISS module)", "During cryo-filling of the space shuttle External Tank (ET) with liquid hydrogen and liquid oxygen prior to the first launch attempt on December 6, 2007, two of four LH2 ECO sensors failed a test.", "Mission rules called for at least three of the four sensors to be in working order for a launch attempt to proceed.", "As a result of the failure, the Launch Director Doug Lyons postponed the launch, initially for 24 hours.", "This was later revised into a 72-hour delay, resulting in a next launch attempt set for Sunday December 9, 2007.", "This launch attempt was scrubbed when one of the ECO sensors again failed during fuelling.", "The ECO sensors external connector was changed on the space shuttle external tank, causing a two-month delay in the launch.", "\"Columbus\" was finally launched successfully on the third attempt at 2:45pm EST, February 7, 2008.", "Once at the station, Canadarm2 removed \"Columbus\" from the docked shuttle's cargo bay\nand attached it to the starboard hatch of \"Harmony\" (also known as Node 2),\nwith the cylinder pointing outwards on February 11, 2008.", "Activities in the lab are controlled on the ground by the Columbus Control Center (at DLR Oberpfaffenhofen in Germany) and by the associated User Support Operations Centres throughout Europe." ], [ "Columbus (ISS module)", "Columbus (ISS module)\n\nColumbus is a science laboratory that is part of the International Space Station (ISS) and is the largest single contribution to the ISS made by the European Space Agency (ESA).", "Like the \"Harmony\" and \"Tranquility\" modules, the \"Columbus\" laboratory was constructed in Turin, Italy by Thales Alenia Space.", "The functional equipment and software of the lab was designed by EADS in Bremen, Germany.", "It was also integrated in Bremen before being flown to the Kennedy Space Center (KSC) in Florida in an Airbus Beluga.", "It was launched aboard Space Shuttle \"Atlantis\" on February 7, 2008 on flight STS-122.", "It is designed for ten years of operation.", "The module is controlled by the Columbus Control Centre, located at the German Space Operations Centre, part of the German Aerospace Center in Oberpfaffenhofen near Munich, Germany.", "The European Space Agency has spent \u20ac1.4 billion (about US$2 billion) on building \"Columbus\", including the experiments that will fly in it and the ground control infrastructure necessary to operate them.", "The laboratory is a cylindrical module with two end cones.", "It is in external diameter and in overall length, excluding the projecting external experiment racks." ] ], "gold": "The European research laboratory, Columbus, launched successfully after the third attempt, behind a two month delay, on February 7, 2008 at 2:45pm EST.", "prediction 1": "The European research laboratory, Columbus, is part of the International Space Station and was launched on February 7, 2008, on board Space Shuttle Atlantis.", "prediction 2": "The European research laboratory (columbus) is part of the International Space Station (ISS) and was launched on February 7, 2008 on flight STS-122 aboard Space Shuttle Atlantis. It was launched successfully on the third attempt at 2:45pm EST on Sunday January 31, 2009. Once at the station, Canadarm2 removed \"Columbus\" from the docked shuttle's cargo bay and attached it to the starboard hatch of \"Harmony\", also known as Node 2, with the cylinder pointing outwards on February 11, 2008 on February 11, 2008.", "prediction 3": "The European research laboratory, or ISS module, Columbus was launched on February 7, 2008. It is part of the International Space Station and is the largest single contribution to the ISS made by the European Space Agency. It was launched aboard Space Shuttle Atlantis on February 7, 2008 on flight STS-122.", "prediction 4": "The European research laboratory Columbus was launched from Cape Canaveral on February 7, 2008, aboard the Space Shuttle Atlantis. It is part of the International Space Station (ISS).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 86 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The European research laboratory, Columbus, launched successfully after the third attempt, behind a two month delay, on February 7, 2008, on board Space Shuttle Atlantis at 2:45pm EST." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "India which is the largest state of india?", "passages": [ [ "Rajasthan", "Rajasthan\n\nRajasthan ( ; literally, \"Land of Kings\") is a state in northern India.", "The state covers an area of or 10.4 percent of the total geographical area of India.", "It is the largest Indian state by area and the seventh largest by population.", "Rajasthan is located on the northwestern side of India, where it comprises most of the wide and inhospitable Thar Desert (also known as the \"Rajasthan Desert\" and \"Great Indian Desert\") and shares a border with the Pakistani provinces of Punjab to the northwest and Sindh to the west, along the Sutlej-Indus river valley.", "Elsewhere it is bordered by five other Indian states:", "Punjab to the north;", "Haryana and Uttar Pradesh to the northeast; Madhya Pradesh to the southeast; and Gujarat to the southwest.", "Major features include the ruins of the Indus Valley Civilisation at Kalibanga; the Dilwara Temples, a Jain pilgrimage site at Rajasthan's only hill station, Mount Abu, in the ancient Aravalli mountain range; and, in eastern Rajasthan, the Keoladeo National Park near Bharatpur, a World Heritage Site known for its bird life.", "Rajasthan is also home to three national tiger reserves, the Ranthambore National Park in Sawai Madhopur, Sariska Tiger Reserve in Alwar and Mukundra Hill Tiger Reserve in Kota." ], [ "Uttar Pradesh", "Uttar Pradesh\n\nUttar Pradesh (; IAST: \"Uttar Prade\u015b\" ) is a state in northern India.", "Abbreviated as UP, it is the most populous state in the Republic of India as well as the most populous country subdivision in the world.", "It is located in the northern region of the Indian subcontinent, has over 200 million inhabitants.", "It was created on 1 April 1937 as the United Provinces of Agra and Oudh during British rule, and was renamed \"Uttar Pradesh\" in 1950.", "The state is divided into 18 divisions and 75 districts with the capital being Lucknow.", "The main ethnic group is the Hindavi people, forming the demographic plurality.", "On 9 November 2000, a new state, Uttarakhand, was carved out from the state's Himalayan hill region.", "The two major rivers of the state, the Ganges and Yamuna, join at Allahabad (Prayagraj) and then flow as the Ganges further east.", "Hindi is the most widely spoken language and is also the official language of the state.", "The state is bordered by Rajasthan to the west, Haryana, Himachal Pradesh and Delhi to the northwest, Uttarakhand and Nepal to the north, Bihar to the east, Madhya Pradesh to the south, and touches the states of Jharkhand and Chhattisgarh to the southeast." ] ], "gold": "In India, the largest state by population is Uttar Pradesh, which has over 200 million inhabitants, while the largest state by area is Rajasthan, which covers an area of 342,239 square kilometers.", "prediction 1": "The largest state of India by area is Rajasthan with a total area of 9,449 square kilometres. The largest state by population is Uttar Pradesh with a population of 205 million people.", "prediction 2": "The largest state in India by area is Rajasthan with a total area of 68,357 km2. The largest state by population is Uttar Pradesh with over 200 million people. The state covers 10.4 percent of the total geographical area of India.", "prediction 3": "The state of Rajasthan is the largest state in India by area and the seventh largest by population.", "prediction 4": "The largest state in the Republic of India by area is Rajasthan, which covers 10.4 percent of the total geographical area of India, and the seventh largest by population. The most populous state in the Republic of India by population is Uttar Pradesh, which is located in the northern region of the Indian subcontinent and has over 200 million inhabitants.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 164, "end": 183 }, { "error type": "Unverifiable", "explanation": "", "start": 69, "end": 93 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The largest state of India by area is Rajasthan, which covers an area of or 10.4 percent of the total geographical area of India. The largest state by population is Uttar Pradesh with a population of over 200 million people." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When did silence of the lambs come out?", "passages": [ [ "The Silence of the Lambs (novel)", "The Silence of the Lambs (novel)\n\n", "The Silence of the Lambs is a novel by Thomas Harris.", "First published in 1988, it is the sequel to Harris' 1981 novel \"Red Dragon\".", "Both novels feature the cannibalistic serial killer Dr. Hannibal Lecter, this time pitted against FBI Special Agent Clarice Starling.", "Its film adaptation directed by Jonathan Demme was released in 1991 to box office success and critical acclaim.", "Clarice Starling, a young FBI trainee, is asked to carry out an errand by Jack Crawford, the head of the FBI division that draws up psychological profiles of serial killers.", "Starling is to present a questionnaire to the brilliant forensic psychiatrist and cannibalistic serial killer, Hannibal Lecter.", "Lecter is serving nine consecutive life sentences in a Maryland mental institution for a series of murders.", "Crawford's real intention, however, is to try to solicit Lecter's assistance in the hunt for a serial killer dubbed \"Buffalo Bill\", whose modus operandi involves kidnapping overweight women, starving them for up to two weeks, killing and skinning them, and dumping the remains in nearby rivers.", "The nickname was started by Kansas City Homicide, as a sick joke that \"he likes to skin his humps.\"" ], [ "The Silence of the Lambs (film)", "The Silence of the Lambs (film)\n\nThe Silence of the Lambs is a 1991 American psychological horror-thriller film directed by Jonathan Demme from a screenplay written by Ted Tally, adapted from Thomas Harris's 1988 novel of the same name.", "The film stars Jodie Foster, Anthony Hopkins, Scott Glenn, Ted Levine, and Anthony Heald.", "In the film, Clarice Starling, a young FBI trainee, seeks the advice of the imprisoned Dr. Hannibal Lecter, a brilliant psychiatrist and cannibalistic serial killer to apprehend another serial killer, known only as \"Buffalo Bill\", who skins his female victims' corpses.", "The novel was Harris's first and second respectively to feature the characters of Starling and Lecter, and was the second adaptation of a Harris novel to feature Lecter, preceded by the Michael Mann-directed \"Manhunter\" (1986).", "\"The Silence of the Lambs\" was released on February 14, 1991, and grossed $272.7 million worldwide against its $19 million budget, becoming the fifth-highest grossing film of 1991 worldwide.", "The film premiered at the 41st Berlin International Film Festival, where it competed for the Golden Bear, while Demme received the Silver Bear for Best Director." ], [ "Akira (1988 film)", "GKIDS later announced that it would distribute the film within North America, with a theatrical release scheduled for December 2018.", "VHS releases included the initial Streamline Video offering (May 1991), later wider distribution by MGM/UA Home Video, and a subtitled edition from Orion Home Video (September 1993).", "In the UK, \"Akira\" was released on video by Island World Communications in 1991.", "The film went on to gross over $80million worldwide from its theatrical and VHS releases.", "The success of this release led to the creation of Manga Entertainment, who later took over the release.", "The original VHS release of \"Akira\" started up Manga Entertainment Australia and VHS distribution was handled by Ronin Films and PolyGram until 1994 when Siren Entertainment took over all of Manga Entertainment Australia's distribution including \"Akira\" under a special license from PolyGram, who handled Island's video distribution.", "\"Akira\" was re-released on video in 1994, and again on DVD in 2001 and distributed by Madman Entertainment and The AV Channel.", "Pioneer Entertainment issued a DVD and a VHS with a new English dub (the dub produced by Animaze) in 2001.", "This was one of the few releases from Geneon to feature THX-certified audio and video." ] ], "gold": "The Silence of the Lambs is the title of both a 1988 Thomas Harris novel and a 1991 film adapted from Harris' 1988 novel. The novel first came out on May 19, 1988. The film came out as a world premiere on January 30, 1991, and came out in theaters in the US on February 14, 1991. The film was later released on VHS in October 1991.", "prediction 1": "The Silence of the Lambs is a novel by Thomas Harris. First published in 1988, it is the sequel to Harris' 1981 novel Red Dragon. Its film adaptation directed by Jonathan Demme was released in 1991 to box office success and critical acclaim. The film, based on Harris's 1988 novel, was released on February 14, 1991.", "prediction 2": "The Silence of the Lambs is a novel by Thomas Harris. First published in 1988, it is the sequel to Harris' 1981 novel Red Dragon. The Silence of the Lambs is also a 1991 psychological horror-thriller film directed by Jonathan Demme from a screenplay written by Ted Tally, adapted from Harris' 1988 novel. The film grossed $272.7 million worldwide against its $19 million budget, becoming the fifth-highest grossing film of 1991 worldwide. In the UK, Akira was released on video by Island World Communications in 1991. In the US, Silence of the Lambs was released on VHS on VHS in 1994, and again on DVD in 2001.", "prediction 3": "The Silence of the Lambs is a 1991 American psychological horror-thriller film based on the novel of the same name by Thomas Harris. The film's release date was February 14, 1991. The film grossed $272.7 million worldwide against its $19 million budget, becoming the fifth-highest grossing film of 1991 worldwide.", "prediction 4": "There were several Silence of the Lambs novels. The first, The Silence of the Lambs, was published in 1988. The second, The Silence of the Lambs, was a 1991 psychological horror film directed by Jonathan Demme and based on the 1988 novel by Thomas Harris. The third, The Silence of the Lambs, is the sequel to Harris' 1981 novel Red Dragon. The fourth, The Silence of the Lambs, was adapted from the 1988 novel by Thomas Harris and released on February 14, 1991.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 241 }, { "error type": "Redundant", "explanation": "Its film adaptation directed by Jonathan Demme was released in 1991", "start": 242, "end": 316 } ], "missing-info": [], "corrected-prediction": "The Silence of the Lambs is a novel by Thomas Harris. First published in 1988, it is the sequel to Harris' 1981 novel Red Dragon. The film, based on Harris's 1988 novel, was released on February 14, 1991." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is the princess in prince of persia?", "passages": [ [ "Prince of Persia: The Sands of Time (film)", "When filming began, the film's release date was postponed to May 28, 2010, with the studio seeking enough time for the post-production process in designing the film's special effects.", "The profit margin on the \"Pirates of the Caribbean\" films was compromised by overspending as special effects teams rushed to complete the films for their release dates.", "\"Variety\" also ascribed the postponement to avoiding the potential 2008 Screen Actors Guild strike so the studio could ensure that the film leads to a \"mega-franchise\" similar to its successful \"Pirates of the Caribbean\" series.", "Other reasons for the release date change were that the film was originally scheduled a week before \"\", and Disney needed more time to co-ordinate its marketing campaign.", "Gyllenhaal claims he \"over-prepared\" for the role, gaining five or six pounds of muscle.", "The actor says, \"I never knew how much they were going to ask me to do, so I just made sure I'd be hopefully able to do anything.\"", "Gemma Arterton was announced to play the role of protagonist Tamina, and Arterton reported she practiced horse back riding in Madrid before filming.", "Ben Kingsley was to portray the film's antagonist, Nizam.", "Alfred Molina was to portray a character named Sheik Amar, who becomes a mentor to the prince." ], [ "Prince of Persia: The Sands of Time (film)", "Prince of Persia: The Sands of Time (film)\n\nPrince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell.", "The film was written by Jordan Mechner, Boaz Yakin, Doug Miro, and Carlo Bernard, produced by Jerry Bruckheimer, and released by Walt Disney Pictures on May 28, 2010.", "The film stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina, Ben Kingsley as Nizam, and Alfred Molina as Sheik Amar.", "The film has the same title as the video game \"\" developed and published by Ubisoft, and is primarily based on it.", "Elements from \"\" and \"\", the two other titles from the \"Sands of Time\" trilogy of the \"Prince of Persia\" video game franchise, are also incorporated.", "The film was premiered in London on May 5, 2010 and was officially released on May 28, 2010 in the United States.", "The film received generally mixed reviews from critics, who shared the consensus that the film was an improvement over other video game adaptations and giving praise to the score, action scenes, humor and the acting performances (particularly those of Gyllenhaal, Kingsley, Molina and Toby Kebbell), while showing negative attention towards the screenplay and departure from the source material." ], [ "Vita and Virginia", "Vita and Virginia\n\nVita and Virginia is a 2018 British biographical romance drama film directed by Chanya Button.", "The screenplay, written by Button and Eileen Atkins, is adapted from the 1992 play \"Vita & Virginia\" by Atkins.", "The film stars Gemma Arterton, Elizabeth Debicki, and Isabella Rossellini.", "Set in the 1920s, \"Vita and Virginia\" tells the story of the love affair between Vita Sackville-West and Virginia Woolf.", "The film had its world premiere as a Special Presentation at the Toronto International Film Festival on 7 September 2018.", "On 30 June 2016, \"Deadline Hollywood\" reported that British director Chanya Button was to direct \"Vita and Virginia\" from a script by Eileen Atkins, with Evangelo Kioussis of Mirror Productions and Katie Holly of Bl!nder Films as producers.", "The screenplay is based on Atkins' stage play \"Vita & Virginia\".", "Gemma Arterton, who also became an executive producer of the film, had received the first draft from Atkins years before and showed it to Button; and Button subsequently co-wrote the final script with Atkins.", "On 8 February 2017, it was announced that Eva Green and Gemma Arterton had been cast in the film.", "In May 2017, it was reported that Green had left the project due to scheduling conflicts.", "Green was replaced by Andrea Riseborough." ] ], "gold": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell. The film was written by Jordan Mechner, Boaz Yakin, Doug Miro, and Carlo Bernard, produced by Jerry Bruckheimer, and released by Walt Disney Pictures on May 28, 2010. The name of the character of the princess in the film is Tamina, Princess of Alamut, who is played by English actress and film producer, Gemma Arterton. Jake Gyllenhaal also stars in the film, as Prince Dastan.", "prediction 1": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell that stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina, and Ben Kingsley as Nizam. In the 2016 British biographical romance film Vita and Virginia, the role of Tamina was shifted to Eva Green, who was cast as Tamina in the film. In the 2019 American television film, Princess Tamina is played by Rachel McAdams, while in the 2010 American television series Prince of Persia: The Sands of Time, Gemma Arterton plays Princess Tamina. In the 2012 American television series, Princess Tamina is played by Emily Hayley.", "prediction 2": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell. Gemma Arterton plays the role of Princess Tamina in the film. Princess Vita and Virginia is a 2018 British biographical romance drama film directed by Chanya Button.", "prediction 3": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell. It stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina, Ben Kingsley as Nizam, and Alfred Molina as Sheik Amar. The 2018 British biographical romance drama film Vita and Virginia stars Gemma Arterton as Tamina.", "prediction 4": "Prince of Persia is a 2010 American action fantasy film directed by Mike Newell. The film stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina, Ben Kingsley as Nizam, and Alfred Molina as Sheik Amar. The 2018 British biographical romance drama film Vita and Virginia is adapted from the 1992 play Vita & Virginia by Eileen Atkins.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 351 }, { "error type": "Unverifiable", "explanation": "", "start": 352, "end": 434 }, { "error type": "Redundant", "explanation": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell that stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina, ", "start": 435, "end": 554 }, { "error type": "Unverifiable", "explanation": "", "start": 555, "end": 637 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Prince of Persia: The Sands of Time is a 2010 American action fantasy film directed by Mike Newell that stars Jake Gyllenhaal as Prince Dastan, Gemma Arterton as Princess Tamina. The film was written by Jordan Mechner, Boaz Yakin, Doug Miro, and Carlo Bernard, produced by Jerry Bruckheimer, and released by Walt Disney Pictures on May 28, 2010. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Whats the latest episode of the walking dead?", "passages": [ [ "The Walking Dead (season 2)", "The Walking Dead (season 2)\n\nThe second season of \"The Walking Dead\", an American post-apocalyptic horror television series on AMC, premiered on October 16, 2011, and concluded on March 18, 2012, consisting of 13 episodes.", "Developed for television by Frank Darabont, the series is based on the eponymous series of comic books by Robert Kirkman, Tony Moore, and Charlie Adlard.", "It was executive produced by Darabont, Kirkman, Glen Mazzara, David Alpert, and Gale Anne Hurd, with Mazzara assuming the role of showrunner after Darabont's departure from the series.", "The season was well received by critics.", "It won Best Television Presentation at the 38th Saturn Awards and Outstanding Prosthetic Makeup for a Series, Miniseries, Movie, or Special at the 64th Primetime Creative Arts Emmy Awards.", "The season finale was viewed by 9 million viewers, making it the highest-rated episode of the series up to that point and the most viewed episode of an original series on AMC in history, up until the premiere of the series' third season, which was watched by 10.9 million viewers.", "This season adapts material from issues #7\u201312 of the comic book series and introduces notable comic characters Hershel Greene (Scott Wilson) and his daughter, Maggie (Lauren Cohan)." ] ], "gold": "The Walking Dead is an American post-apocalyptic television series based on the comic book of the same name by Robert Kirkman, Tony Moore and Charlie Adlard, and developed for television by Frank Darabont. The latest episode is episode 139, titled \"The World Before\".", "prediction 1": "The Walking Dead released its second season on October 16, 2011, with the season finale being viewed by 9 million viewers, making it the highest-rated episode of the series up to that point. The season finale was also the most viewed episode of an original series on AMC in history, up until the premiere of the series' third season, which was watched by 10.9 million viewers.", "prediction 2": "The Walking Dead is an American post-apocalyptic horror television series that premiered on October 16, 2011 and concluded on March 18, 2012. The season finale was viewed by 9 million viewers, making it the highest-rated episode of the series up to that point and the most viewed episode of an original series on AMC in history.", "prediction 3": "The latest episode of The Walking Dead, an American post-apocalyptic horror television series on AMC, was the episode titled \"The Walking Dead: Season Two,\" which premiered on October 16, 2011.", "prediction 4": "The Walking Dead is an American post-apocalyptic horror television series based on the eponymous series of comic books by Robert Kirkman, Tony Moore, and Charlie Adlard that first aired on September 7, 2001. The latest episode of season 2 was released on October 16, 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 191, "end": 376 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Walking Dead is an American post-apocalyptic television series based on the comic book of the same name by Robert Kirkman, Tony Moore and Charlie Adlard, and developed for television by Frank Darabont. " }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who has become the new member of upsc?", "passages": [ [ "Bhim Sain Bassi", "Bhim Sain Bassi\n\nBhim Sain Bassi or more commonly B.S. Bassi (born 20 February 1956) is an Indian Police Service(IPS) officer and is currently a member of the Union Public Service Commission since 31 May 2016.", "He served as the Commissioner of Police, Delhi from August 2013 to February 2016.", "He previously served as the Special Commissioner of Police (Administration) of Delhi Police (2012\u201313), Special Commissioner of Police (Traffic) of Delhi Police (2011-2012), Director General of Police of Goa Police (2009-2011) and Inspector General of Police of Chandigarh Police (2000-2002).", "When Bassi took over Delhi the crime was less because most of the cases got unreported so he made sure that all the cases get reported the result was that there was an increase of 250 % of crime reporting especially against women in Delhi.", "Most of the time in India, the crimes get unreported, giving a false impression that the crime rate is low\n\nBassi, a 1977 batch Indian Police Service officer, began his police career as an assistant superintendent of police in Pondicherry.", "Since then he has served in various capacities in Delhi and other parts of the India, including Arunachal Pradesh, Chandigarh and Goa.", "Bassi was born on 20 February 1956." ], [ "Union Public Service Commission", "Union Public Service Commission\n\nThe Union Public Service Commission (UPSC; ) is India's premier central recruiting agency.", "It is responsible for appointments to and examinations for All India services and group A & group B of Central services.", "While Department of Personnel and Training is the central personnel agency in India.", "The agency's charter is granted by Part XIV of the Constitution of India, titled as \"Services Under the Union and the States.\"", "The commission is mandated by the Constitution for appointments to the services of the Union and All India Services.", "It is also required to be consulted by the Government in matters relating to the appointment, transfer, promotion and disciplinary matters.", "The commission reports directly to the President and can advise the Government through him.", "Although, such advice is not binding on the Government.", "Being a constitutional authority, UPSC is amongst the few institutions which function with both autonomy and freedom, along with the country\u2019s higher judiciary and lately the Election Commission.", "The commission is headquartered at Dholpur House, in New Delhi and functions through its own secretariat.", "Arvind Saxena is its current Chairman of UPSC.", "Established on as Public Service Commission, it was later reconstituted as Federal Public Service Commission by the Government of India Act, 1935; only to be renamed as today's Union Public Service Commission after the independence." ], [ "Pradeep Kumar (IAS)", "Pradeep Kumar (IAS)\n\n", "Pradeep Kumar is a former Indian Administrative Service (IAS) officer, 1972 batch, of the Haryana cadre, who served as Defense Secretary, in the Ministry of Defence, Government of India, for a term of two years, from August 2009 to July 2011.", "He succeed Vijay Singh, IAS, 1970 batch, who, on superannuation, was appointed as member of the UPSC.", "In July 2011, on superannuation, he was appointed as chief vigilance commissioner of India.", "Pradeep Kumar obtained a graduate degree in Electrical Engineering from the Indian Institute of Technology, Delhi, and Masters in Economics and Social Studies from the University of Wales, United Kingdom.", "On superannuation Pradeep Kumar was appointed as chief vigilance commissioner(CVC) of India, a statutory appointment, who is head of the Central Vigilance Commission.", "He assumed the office from 31 July 2011.", "The CVC has a fixed term of four years or till that age of 65, whichever is earlier." ] ], "gold": "The Union Public Service Commission, commonly abbreviated as UPSC, is India's premier central recruiting agency for central government public servants. Pradeep Kumar Joshi became a new member of UPSC in 2015 and has been the Chairman of UPSC since August 2020. In 2016, Bhim Sain Bassi became a new member of UPSC. He previously served as the Commissioner of Police in Delhi. In 2017, Air Marshal Ajit Bhonsle, Manoj Soni, Smita Nagaraj and Sujata Mehta became new members of UPSC. Previously, Sujata Mehta served in the Indian Foreign Service, and she also served as Ambassador and Permanent Representative of India to the United Nations Conference on Disarmament, Geneva. In 2018, Bharat Bhushan Vyas became a new member of UPSC, while T. C. A. Anant and Rajiv Nayan Choubey became new members in 2019. Dr. Pradeep Kumar Joshi became a new member of UPSC in 2020.", "prediction 1": "The Union Public Service Commission (UPSC) is India's premier central recruiting agency. In 2013, Bhim Sain Bassi became the new member of the upsc on 31 May 2016. In 2017, Pradeep Kumar became the new member of the upsc after Vijay Singh, IAS, 1970 batch, who, on superannuation, was appointed as member of the upsc. In 2016, Nitish Kumar became the new member of the upsc after completing his five-year term as the new chief vigilance commissioner of India.", "prediction 2": "The Union Public Service Commission (UPSC) is India's premier central recruiting agency. The new member of UPSC was Bhim Sain Bassi, who is an Indian Police Service officer and has been with the commission since 31 May 2016. On superannuation, Pradeep Kumar was appointed as chief vigilance commissioner of India.", "prediction 3": "The Union Public Service Commission (UPSC, formerly known as the Public Service Commission of India) is India's premier central recruiting agency and is responsible for appointments to and examinations for All India services and group A & group B of Central services. On 31 May 2016, Bhim Sain Bassi, an Indian Police Service officer and is currently a member of the Union Public Service Commission since 31 May 2016. On superannuation, Pradeep Kumar, an IAS officer from the Haryana cadre, became the new member of the UPSC. On superannuation, he was appointed as chief vigilance commissioner of India, a statutory appointment, who is also head of the Central Vigilance Commission.", "prediction 4": "The Union Public Service Commission (UPSC) is India's premier central recruiting agency, responsible for appointments to and examinations for All India services and group A & group B of Central services. In August 2013, Bhim Sain Bassi, an Indian Police Service officer, was appointed as the new member of the UPSC. Pradeep Kumar, an IAS officer from the 1972 batch, who served as the defense secretary, in the Ministry of Defense, Government of India for a term of two years from August 2009 to July 2011, was appointed as chief vigilance commissioner of India. In July 2011, Pradeep Kumar was appointed as the new chief vigilance commissioner of India.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 167, "end": 172 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 173, "end": 226 }, { "error type": "Incoherent", "explanation": "", "start": 89, "end": 97 }, { "error type": "Unverifiable", "explanation": "", "start": 318, "end": 459 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Union Public Service Commission (UPSC) is India's premier central recruiting agency. Bhim Sain Bassi became the new member of the upsc on 31 May 2016. He previously served as the Commissioner of Police in Delhi. In 2011, Vijay Singh was appointed as member of the upsc. Arvind Saxena is its current Chairman of UPSC." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When's the next episode of shadowhunters coming out?", "passages": [ [ "Shadowhunters", "Shadowhunters\n\nShadowhunters, also known as Shadowhunters: The Mortal Instruments, is an American supernatural drama television series developed by Ed Decter, based on the popular book series \"The Mortal Instruments\" written by Cassandra Clare.", "It premiered in North America on Freeform on January 12, 2016.", "Primarily filmed in Toronto, Ontario, Canada, the series follows Clary Fray (Katherine McNamara), who finds out on her eighteenth birthday that she is not who she thinks she is, but rather comes from a long line of Shadowhunters, human-angel hybrids who hunt down demons.", "It is the second adaptation of the novel series, after the 2013 film \"\", which like the series was produced by Constantin Film.", "The debut season of \"Shadowhunters\" has received mixed responses from critics.", "The pilot episode attracted the largest audience for Freeform in more than two years.", "The show has received numerous award nominations, winning one GLAAD Award and four Teen Choice Awards.", "The series was renewed for a second season of 20 episodes, which premiered on January 2, 2017.", "In August 2016, showrunner Ed Decter exited the series over \"creative differences\".", "Todd Slavkin and Darren Swimmer were named as Decter's replacements.", "In April 2017, Freeform renewed the show for a third season of 20 episodes, which premiered on March 20, 2018." ] ], "gold": "Supernatural drama TV series Shadowhunters premiered on January 12, 2016, running for 55 episodes over three seasons. The second season premiered on January 2, 2017, and the third premiered on March 20, 2018.", "prediction 1": "Shadowhunters is an American supernatural drama television series that premiered in the United States on Freeform on January 12, 2016. Episode 2 came out on January 2, 2017. Episode 3 came out on March 21, 2019.", "prediction 2": "Shadowhunters is an American supernatural drama television series developed by Ed Decter, based on the popular book series The Mortal Instruments written by Cassandra Clare. The series premiered in North America on Freeform on January 12, 2016. Shadowhunters' first episode came out on January 12, 2016.", "prediction 3": "Shadowhunters, also known as Shadowhunters: The Mortal Instruments, is an American supernatural drama television series developed by Ed Decter, based on the popular book series \"The Mortal Instruments\" written by Cassandra Clare. The series premiered in North America on Freeform on January 12, 2016. The series was renewed for a second season of 20 episodes, which premiered on January 2, 2017.", "prediction 4": "Shadowhunters is an American supernatural drama television series developed by Ed Decter, based on the popular book series The Mortal Instruments written by Cassandra Clare. The series premiered in North America on Freeform on January 12, 2016. The series was renewed for a second season of 20 episodes, which premiered on January 2, 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 135, "end": 142 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[11]}", "start": 174, "end": 183 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "Shadowhunters is an American supernatural drama television series that premiered in the United States on Freeform on January 12, 2016. The second season premiered on January 2, 2017, and the third premiered on March 20, 2018." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does emily come back in criminal minds?", "passages": [ [ "Criminal Minds (season 11)", "Cook appears in the first episode \"The Job\" holding her sleeping baby Michael, played by Phoenix Andersen, her child in real life.", "According to Matthew Gray Gubler, he will be directing an episode in which another BAU member will be leaving the cast this season, that member being Derek Morgan (Shemar Moore).", "Shemar Moore left the show as Derek Morgan, which aired on March 23, 2016.", "On February 10, 2016, it was announced that Paget Brewster would return as Emily Prentiss for one episode later in season 11 episode 19, titled \"Tribute\".", "The season ended on May 4, 2016, with the show's first cliffhanger finale since the fifth season.", "Messer said she felt it was time for another cliffhanger and thought that it served as a \"really fun launch pad\" into the twelfth season, which was officially ordered two days later.", "Jennifer Love Hewitt was announced to be leaving the show after the season ten finale.", "Her character, Kate Callahan, handed in her resignation at the end of the season ten finale, due to her real-life pregnancy and decision to devote the next year to her newborn baby.", "A. J. Cook was also revealed to be pregnant, a fact that was carried over to her character Jennifer \"JJ\" Jareau as well." ], [ "Emily Prentiss", "While still pondering her decision on the offer, Prentiss decides to leave the BAU.", "In the season eight premiere, Morgan and Garcia mention seeing her while they were in London and that Emily is doing fine.", "Brewster returned for guest appearances in the season 9 episode \"200\" in 2014 and the season 11 episode \"Tribute\" in early 2016 before returning as a regular cast member in the season 12 episode \"Taboo\" later in the year.", "She is now the Unit Chief of the BAU, following the departure of Aaron Hotchner." ], [ "Emily Prentiss", "Emily Prentiss\n\nEmily Prentiss is a fictional character on the CBS crime drama \"Criminal Minds\", portrayed by Paget Brewster.", "Prentiss first appeared in \"The Last Word\" (episode nine of season two), replacing Agent Elle Greenaway, who had quit in \"The Boogeyman\".", "Her role in the show's sixth season was reduced, for what Brewster believed to be financial reasons.", "Brewster returned to her role for the show's seventh season.", "Her final episode as a main cast member was the May 16, 2012 episode \"Run\".", "Brewster reprised the role again in 2014 for the 200th episode.", "She returned as Prentiss following the departure of co-star Shemar Moore for the season 11 episode \"Tribute\".", "Brewster returned as series regular in season 12.", "She was brought back soon after co-star Thomas Gibson had been dismissed from the show.", "Prentiss was born to her unnamed father and Elizabeth, a US Ambassador.", "Due to her mother's job postings, Prentiss spent her childhood in numerous places, including Ukraine, France, Italy, and various countries in the Middle East.", "Her father has never been referred to in any way.", "She graduated from Chesapeake Bay University with a B.A." ] ], "gold": "The Criminal Minds character Supervisory Special Agent Emily Prentiss, played by Paget Brewster, made her first appearance in the show's second season and left the main cast in the season 7 episode \"Run\". Prentiss returned as a special guest in the season 9 episode \"200\" and the season 11 episode \"Tribute\", before rejoining the main cast in the season 12 episode \"Taboo\".", "prediction 1": "On the CBS crime drama Criminal Minds, Emily Prentiss is portrayed by Paget Brewster. In season 11, episode 19, it was announced that Brewster would return as Emily Prentiss for one episode later in the season 11 episode 19, titled Tribute. In season 12, episode 14 she reprised the role as Prentiss following the departure of co-star Shemar Moore for the season 11 episode Tribute.", "prediction 2": "Emily Prentiss is a fictional character on the CBS crime drama Criminal Minds, which is portrayed by Paget Brewster. Prentiss first appeared in The Last Word (episode nine of season two), replacing Agent Elle Greenaway, who had quit in The Boogeyman. She returned as Prentiss following the departure of co-star Shemar Moore for the season 11 episode Tribute. It was announced on February 10, 2016 that Brewster would return as Emily Prentiss for one episode later in the season 11 episode 19 titled Tribute. The season ended on May 4, 2016, with the show's first cliffhanger finale since the fifth season.", "prediction 3": "Emily Prentiss is a fictional character on the CBS crime drama Criminal Minds. Prentiss first appeared in Season 2 Episode 9: The Last Word as Elle Greenaway. She returned to the show in 2014 for the 200th episode. In 2016, she returned as a regular cast member in the season 12 episode Taboo.", "prediction 4": "Emily Prentiss is a fictional character on the CBS crime drama Criminal Minds, portrayed by Paget Brewster. In the show, she originally appeared in the episode The Last Word of season two. She returned in the episode Tribute of season 11 in February 2016. In the show's tenth season, she first appeared in the episode Run on May 16, 2012. On February 10, 2016, it was announced that Brewster would return as Emily Prentiss for one episode later in season 11 episode 19 titled Tribute. Prentiss came back in season 11, episode Tribute. In the show ended on May 4, 2016, with the first cliffhanger finale since the fifth season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 133 }, { "error type": "Unverifiable", "explanation": "", "start": 255, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 382 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4, 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "On the CBS crime drama Criminal Minds, Emily Prentiss is portrayed by Paget Brewster. She made her first appearance in the show's second season and left the main cast in the season 7 episode \"Run\". Prentiss returned as a special guest in the season 9 episode \"200\". Brewster would return as Emily Prentiss for one episode later in the season 11 episode 19, titled Tribute. In season 12, she reprised the role as Prentiss, returning as a regular cast member in the episode \"Taboo\"." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When does the season finale of the bachelorette air?", "passages": [ [ "The Bachelorette (season 13)", "The Bachelorette (season 13)\n\n", "The 13th season of \"The Bachelorette\" premiered on May 22, 2017.", "This season featured Rachel Lindsay, a 32-year-old attorney from Dallas, Texas.", "The season concluded on August 7, 2017.", "Lindsay attended the University of Texas at Austin where she graduated with a bachelor's degree in 2007 and Marquette University Law School where she graduated with a Juris Doctor in 2011.", "Lindsay was the second runner-up on the 21st season of \"The Bachelor\" featuring Nick Viall.", "Lindsay is the first African-American in the lead role on \"The Bachelor\" franchise.", "The season concluded when 37-year-old chiropractor Bryan Abasolo was named the winner, they live in Lindsay's hometown of Dallas.", "Casting began during season twelve of \"The Bachelorette\".", "Lindsay was named as the bachelorette during \"Jimmy Kimmel Live!\".", "This season's cast includes pro wrestler Kenny Layne.", "Destinations for this season were South Carolina, Norway, Denmark, Switzerland and Spain, with appearances including actors Mila Kunis and Ashton Kutcher, former NBA player Kareem Abdul-Jabbar, actress and television host Ellen DeGeneres and country singer Russell Dickerson.", "The season began with 31 contestants." ], [ "The Bachelorette (season 12)", "The Bachelorette (season 12)\n\n", "The twelfth season of \"The Bachelorette\", an American reality competition television series premiered on ABC on May 23, 2016, and concluded on August 1, 2016.", "The show featured Joelle \"JoJo\" Fletcher, a real estate developer from Dallas, Texas and former runner-up on the 20th season of \"The Bachelor\", in the title role where she is courted by 26 men.", "Former pro quarterback Jordan Rodgers won the competition.", "Casting began during season eleven of \"The Bachelorette\".", "Days before the official announcement, Fletcher's fellow \"The Bachelor\" season 20 contestant and second runner-up Caila Quinn was originally selected to be in the lead role, but she was dropped at the last minute for Fletcher by the producers in response to the popularity of Fletcher.", "Filming commenced on March 16, 2016 shortly after the twentieth season of \"The Bachelor\".", "Destinations including Pittsburgh in Pennsylvania, Uruguay, Thailand, and Argentina with appearances from Dan + Shay, All-4-One, Max Kellerman and Marcellus Wiley.", "The cast includes former American football quarterback Jordan Rodgers, the younger brother of Green Bay Packers quarterback Aaron Rodgers.", "Season 3\n\nChristian Bishop, Chad Johnson, Daniel Maguire, Evan Bass, Grant Kemp, Vinny Venteria, and Wells Adams were all chosen for the third season of \"Bachelor in Paradise\"." ], [ "The Bachelorette (season 11)", "The Bachelorette (season 11)\n\nThe eleventh season of \"The Bachelorette\" features, for the first time ever, two Bachelorettes during the first episode.", "Kaitlyn Bristowe is a 29-year-old spin-class instructor from Vancouver, British Columbia, and Britt Nilsson is a 27-year-old waitress from California.", "Both Bachelorettes were on the 19th season of \"The Bachelor\", featuring Chris Soules.", "This season premiered on May 18, 2015 and concluded on July 27, 2015 in which 28-year-old personal trainer Shawn Booth was named the winner.", "On November 2, 2018, the couple announced they ended their relationship.", "Casting began during the tenth season of \"The Bachelorette\".", "During the first episode, the Bachelors decide which of the ladies they would like to have as the Bachelorette for season 11.", "In the second episode, which aired on May 19, 2015, it was revealed that Kaitlyn Bristowe was selected as the new Bachelorette.", "It began filming shortly after the finale of the nineteenth season of \"The Bachelor\" with the locale destinations including New York City, San Antonio and Ireland with appearances from Laila Ali, Amy Schumer, Doug E. Fresh and The Cranberries.", "Contestant Ryan McDill is the ex-boyfriend of \"Bachelor 18\" winner Nikki Ferrell." ] ], "gold": "The Bachelorette is an American reality television dating game show that debuted on ABC on January 8, 2003. In March 2021, the show announced it would air two seasons for the first time, with the seventeenth season debuting on June 7, 2021, while the eighteenth season is set to premiere on October 19, 2021. The finales of the thirteenth, twelfth, and eleventh seasons aired on August 7, 2017, August 1, 2016, and July 27, 2015, respectively. ", "prediction 1": "The season finale of The Bachelorette airs on Tuesday, September 10, 2019. The season finale of The Bachelor was broadcast on Fox News Channel on September 13, 2017.", "prediction 2": "The Bachelorette is an American reality television series that first aired in 2013 and has since been renewed several times. The season finale for the thirteenth season aired on May 22, 2017. The season finale for the eleventh season aired on May 19, 2015, and the season finale for the 12th season aired on August 1, 2016.", "prediction 3": "Season finale of The Bachelorette first aired on September 24, 2017 and season finale of The Bachelor took place on September 15, 2017. Season finale of The Bachelorette season 13 aired on August 7, 2017. Season finale of The Bachelorette season 10 aired on November 2, 2018.", "prediction 4": "Season finale of the Bachelorette aired on August 1, 2016. Season 11 finale aired on May 19, 2015. Season 13 finale aired on August 7, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 165 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 46, "end": 74 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Bachelorette (season 11) concluded on July 27, 2015. The season 12 finale of The Bachelorette, an American reality competition television series airs on ABC and concluded on August 1, 2016. The thirteenth season concluded on August 7, 2017." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who wrote the christmas song do you hear what i hear?", "passages": [ [ "Do You Hear What I Hear?", "Do You Hear What I Hear?", "\"Do You Hear What I Hear?\" is a song written in October 1962, with lyrics by No\u00ebl Regney and music by Gloria Shayne Baker.", "The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis.", "Regney had been invited by a record producer to write a Christmas song, but he was hesitant due to the commercialism of the Christmas holiday.", "It has sold tens of millions of copies and has been covered by hundreds of artists.", "Regney wrote the lyrics for the song, while Shayne composed the music in October 1962.", "This was an unusual arrangement for the two writers.", "Usually it was Shayne who wrote the lyrics for their songs while Regney composed the music, as they did when they wrote a song based on the classic children's song \"Rain Rain Go Away\".", "Regney was inspired to write the lyrics \"Said the night wind to the little lamb, 'Do you see what I see?'\" and \"Pray for peace, people everywhere\" after watching babies being pushed in strollers on the sidewalks of New York City.", "Shayne stated in an interview years later that neither could personally perform the entire song at the time they wrote it because of the emotions surrounding the Cuban Missile Crisis.", "\"Our little song broke us up." ] ], "gold": "\"Do You Hear What I Hear?\" is a song written in October 1962, with lyrics by No\u00ebl Regney and music by Gloria Shayne. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis. It has sold tens of millions of copies and has been covered by hundreds of artists.", "prediction 1": "\"Do You Hear What I Hear?\" is a song written in October 1962, with lyrics by Nol Regney and music by Gloria Shayne Baker. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis. It has sold tens of millions of copies and has been covered by hundreds of artists.\n", "prediction 2": "\"Do You Hear What I Hear?\" is a song written in October 1962, with lyrics by Nol Regney and music by Gloria Shayne Baker. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis. It has sold tens of millions of copies and has been covered by hundreds of artists. Regney wrote the lyrics for the song, while Shayne composed the music in October 1962.", "prediction 3": "Do You Hear What I Hear? is a Christmas song written in October 1962, with lyrics by Nol Regney and music by Gloria Shayne Baker. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis.", "prediction 4": "Nol Regney and Gloria Shayne Baker wrote the song Do You Hear What I Hear? for the 1962 Christmas song, \"Pray for Peace, People Everywhere.\" Regney was inspired to write the lyrics, \"Said the night wind to the little lamb, 'Do you see what I see?'\" and \"Pray for peace, people everywhere,\" after watching babies being pushed in strollers on the sidewalks of New York City.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "\"Do You Hear What I Hear?\" is a song written in October 1962, with lyrics by Nol Regney and music by Gloria Shayne Baker. The pair, married at the time, wrote it as a plea for peace during the Cuban Missile Crisis. It has sold tens of millions of copies and has been covered by hundreds of artists.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did o canada become canada's national anthem?", "passages": [ [ "O Canada", "O Canada\n\n\"O Canada\" () is the national anthem of Canada.", "The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint-Jean-Baptiste Day ceremony; Calixa Lavall\u00e9e composed the music, after which, words were written by the poet and judge Sir Adolphe-Basile Routhier.", "The original lyrics were in French; an English translation was published in 1906.", "Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament.", "Weir's lyrics have been revised three times, most recently when \"An Act to amend the National Anthem Act (gender)\" was enacted in 2018.", "The French lyrics remain unaltered.", "\"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's National Anthem Act received royal assent and became effective on July 1 as part of that year's Dominion Day (now known as Canada Day) celebrations." ], [ "O Canada", "In 1967, the Prime Minister advised Governor General Georges Vanier to appoint the Special Joint Committee of the Senate and House of Commons on the National and Royal Anthems; the group first met in February and, within two months, on April 12, 1967, presented its conclusion that \"O Canada\" should be designated as the national anthem and \"God Save the Queen\" as the royal anthem of Canada, one verse from each, in both official languages, to be adopted by parliament.", "The group was then charged with establishing official lyrics for each song.", "For \"O Canada\", the Robert Stanley Weir version of 1908 was recommended for the English words, with a few minor changes: two of the \"stand on guard\" phrases were replaced with \"from far and wide\" and \"God keep our land\".", "In 1970 the Queen in Right of Canada purchased the right to the lyrics and music of \"O Canada\" from Gordon V. Thompson Music for $1.", "The song finally became the official national anthem in 1980 with the passage of the National Anthem Act.", "The act replaced two of the repetitions of the phrase \"We stand on guard\" in the English lyrics, as had been proposed by the Senate Special Joint Committee.", "This change was controversial with traditionalists and, for several years afterwards, it was not uncommon to hear people still singing the old lyrics at public events." ] ], "gold": "\"O Canada\" is the national anthem of Canada. \"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's \"National Anthem Act\" received royal assent and became effective on July 1 as part of that year's Dominion Day (today's Canada Day) celebrations.", "prediction 1": "\"O Canada\" is the national anthem of Canada. The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint-Jean-Baptiste Day ceremony. The original lyrics were in French; an English translation was published in 1906. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. \"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's National Anthem Act received royal assent and became effective on July 1 as part of that year's Dominion Day celebrations.", "prediction 2": "\"O Canada\" is the national anthem of Canada. The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint-Jean-Baptiste Day ceremony. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. The song finally became the official national anthem in 1980 with the passage of the National Anthem Act.", "prediction 3": "\"O Canada\" is the national anthem of Canada. The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint Jean-Baptiste Day ceremony. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament. \"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's National Anthem Act received royal assent and became effective on July 1 as part of the same year's Dominion Day celebrations.", "prediction 4": "\"O Canada\" is the national anthem of Canada. The song was originally commissioned by Lieutenant Governor of Quebec Th\u00e9odore Robitaille for the 1880 Saint-Jean-Baptiste Day ceremony. The original lyrics were in French; an English translation was published in 1906. Multiple English versions ensued, with Robert Stanley Weir's version in 1908 gaining the most popularity, eventually serving as the basis for the official lyrics enacted by Parliament.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 448 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"O Canada\" is the national anthem of Canada. \"O Canada\" had served as a \"de facto\" national anthem since 1939, officially becoming the country's national anthem in 1980 when Canada's National Anthem Act received royal assent and became effective on July 1 as part of that year's Dominion Day (now known as Canada Day) celebrations." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When does winter occur in the northern hemisphere?", "passages": [ [ "Winter solstice", "Although the winter solstice itself lasts only a moment in time, the term sometimes refers to the day on which it occurs.", "Other names are \"midwinter\", the \"extreme of winter\" (Dongzhi), or the \"shortest day\".", "In some cultures it is seen as the middle of winter, while in others it is seen as the beginning of winter.", "In meteorology, winter in the Northern Hemisphere spans the entire period of December through February.", "The seasonal significance of the winter solstice is in the reversal of the gradual lengthening of nights and shortening hours of daylight during the day.", "The earliest sunset and latest sunrise dates differ from winter solstice, however, and these depend on latitude, due to the variation in the solar day throughout the year caused by the Earth's elliptical orbit (see earliest and latest sunrise and sunset).", "Worldwide, interpretation of the event has varied across cultures, but many have held a recognition of rebirth, involving holidays, festivals, gatherings, rituals or other celebrations around that time.", "The solstice may have been a special moment of the annual cycle for some cultures even during neolithic times.", "Astronomical events were often used to guide activities such as the mating of animals, the sowing of crops and the monitoring of winter reserves of food.", "Many cultural mythologies and traditions are derived from this." ], [ "Winter", "Winnipeg on the Great Plains at a relative distance from large bodies of water has a January high of and a low of .", "In comparison, Vancouver on the coast with a marine influence from moderating Pacific winds has a January low of with days well above freezing at .", "Both areas are on the 49th parallel north and in the same western half of the continent.", "A similar effect, although with less extreme differentials, is found in Europe where in spite of the northerly latitude of the islands, the British Isles has not a single non-mountain weather station with a below-freezing mean temperature.", "Meteorological reckoning is the method of measuring the winter season used by meteorologists based on \"sensible weather patterns\" for record keeping purposes, so the start of meteorological winter varies with latitude.", "Winter is often defined by meteorologists to be the three calendar months with the lowest average temperatures.", "This corresponds to the months of December, January and February in the Northern Hemisphere, and June, July and August in the Southern Hemisphere.", "The coldest average temperatures of the season are typically experienced in January or February in the Northern Hemisphere and in June, July or August in the Southern Hemisphere.", "Nighttime predominates in the winter season, and in some regions winter has the highest rate of precipitation as well as prolonged dampness because of permanent snow cover or high precipitation rates coupled with low temperatures, precluding evaporation." ], [ "Winter", "In the Northern Hemisphere, some authorities define the period of winter based on astronomical fixed points (i.e. based solely on the position of the Earth in its orbit around the sun), regardless of weather conditions.", "In one version of this definition, winter begins at the winter solstice and ends at the vernal equinox.", "These dates are somewhat later than those used to define the beginning and end of the meteorological winter \u2013 usually considered to span the entirety of December, January, and February in the Northern Hemisphere and June, July, and August in the Southern.", "Astronomically, the winter solstice, being the day of the year which has fewest hours of daylight, ought to be in the middle of the season, but seasonal lag means that the coldest period normally follows the solstice by a few weeks.", "In some cultures, the season is regarded as beginning at the solstice and ending on the following equinox \u2013 in the Northern Hemisphere, depending on the year, this corresponds to the period between 21 or 22 December and 19, 20 or 21 March.", "In the UK, meteorologists consider winter to be the three coldest months of December, January and February.", "In Scandinavia, winter in one tradition begins on 14 October and ends on the last day of February." ] ], "gold": "As often defined by meteorologists, winter occurs in the three calendar months with the lowest average temperatures. This corresponds to the months of December, January and February in the Northern Hemisphere. However, in the Northern Hemisphere, some authorities define the period of winter based on astronomical fixed points, or points based solely on the position of the Earth in its orbit around the Sun, regardless of weather conditions. In one version of this definition, winter begins at the Winter Solstice, which usually occurs around December 21st, and ends at the March Equinox, which usually occurs around March 20th. Therefore, based on this definition, the winter season in the Northern Hemisphere would be from approximately December 21 - March 20.", "prediction 1": "In the Northern Hemisphere, winter occurs on the winter solstice, which is the day on which the longest day of the year occurs. In meteorology, winter in the Northern Hemisphere spans the entire period of December through February. astronomically, the winter solstice, being the day of the year which has fewest hours of daylight, ought to be in the middle of the season, but seasonal lag means that the coldest period normally follows the solstice by a few weeks. However, in some cultures, the season is regarded as beginning at the solstice and ending on the following equinox.", "prediction 2": "In the Northern Hemisphere, winter occurs at the winter solstice, which is the day on which the fewest hours of daylight in the year occur, and ends at the vernal equinox, which is the date that the shortest day of the year occurs.", "prediction 3": "Winter is often defined by meteorologists to be the three calendar months with the lowest average temperatures. This corresponds to the months of December, January and February in the Northern Hemisphere and June, July and August in the Southern Hemisphere. The coldest average temperatures of the season are typically experienced in January or February in the Northern Hemisphere and in June, July or August in the Southern. The winter solstice itself lasts only a moment in time, the term sometimes refers to the day on which it occurs.", "prediction 4": "In the northern hemisphere, winter occurs at the winter solstice, or the day when the fewest hours of daylight are available. Typically, the coldest average temperatures of the season are typically experienced in January or February in the Northern Hemisphere and in June, July or August in the Southern Hemisphere. Other dates include the earliest sunset and latest sunrise, the coldest day of the year, and the coldest day of the month.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": " In the Northern Hemisphere, winter occurs on the winter solstice, which is the day on which the longest day of the year occurs. In meteorology, Winter, often defined by to be the three calendar months with the lowest average temperatures,in the Northern Hemisphere spans the entire period of December through February. Some authorities define the period of winter based on astronomical fixed points (i.e. based solely on the position of the Earth in its orbit around the sun), regardless of weather conditions. In some cultures, the season is regarded as beginning at the solstice and ending on the following equinox. This corresponds to the period between 21 or 22 December and 19, 20 or 21 March." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What was the name of the t rex in land of the lost?", "passages": [ [ "Land of the Lost (film)", "Land of the Lost (film)\n\nLand of the Lost is a 2009 American adventure comedy film directed by Brad Silberling, written by Chris Henchy and Dennis McNicholas and starring Will Ferrell, Danny McBride and Anna Friel, loosely based on the 1974 Sid and Marty Krofft television series of the same name.", "The film was theatrically released on June 5, 2009 by Universal Pictures.", "The film received generally negative reviews from critics and was a box office bomb, grossing just $68 million against its a $100 million budget.", "It received seven Golden Raspberry Award nominations, including Worst Picture, winning Worst Prequel, Remake, Rip-off or Sequel.", "Pompous paleontologist Rick Marshall has a low-level job at the La Brea Tar Pits, three years after a disastrous interview with Matt Lauer of \"Today\" became a viral video and ruined his career.", "Doctoral candidate Holly Cantrell tells him that his controversial theories combining time warps and paleontology inspired her.", "She shows him a fossil with an imprint of a cigarette lighter that he recognizes as his own along with a crystal made into a necklace that gives off strong tachyon energy.", "She convinces him to finish his tachyon amplifier and come help her on a seemingly routine expedition to the cave where Holly found the fossil, which is in the middle of nowhere." ], [ "Land of the Lost (1991 TV series)", "Land of the Lost (1991 TV series)\n\nLand of the Lost is a half-hour Saturday-morning children's series that debuted on ABC in the fall of 1991.", "Re-runs were later picked up by Nickelodeon from 1995 to 1997.", "Tiger Toys received the license to produce a toyline based on the series, which included regular and \"talking\" action figures, several dinosaurs and playsets, an electronic Crystal Sword, as well as an electronic LCD game and a board game.", "Motivated by the success in syndication of the cult 1974 series \"Land of the Lost\", Sid and Marty Krofft created a new version of it.", "The new \"Land of the Lost\" had advanced special effects and a lighter, less survivalist-oriented tone.", "Frequent writers Len Janson and Chuck Menville had previously crafted numerous scripts for assorted Filmation series, while producer Jerry Golod had earlier collaborated with George A. Romero on \"Tales from the Darkside\".", "The series ran for 26 episodes spread over two seasons, with each season consisting of thirteen episodes.", "It featured the Porter family - father Tom, son Kevin and daughter Annie - trapped in a parallel universe after their Jeep Cherokee fell through a time portal while exploring the back country.", "They soon meet another human, a \"beautiful\" jungle girl named Christa who came from 1960s San Francisco." ], [ "Land of the Lost (1974 TV series)", "Land of the Lost (1974 TV series)\n\nLand of the Lost (1974\u20131976) is a children's adventure television series created (though uncredited) by David Gerrold and produced by Sid and Marty Krofft, who co-developed the series with Allan Foshko.", "During its original run, it was broadcast on the NBC television network.", "It later aired in daily syndication from 1978 to 1985 as part of the \"Krofft Superstars\" package.", "In 1985, it returned to late Saturday mornings on CBS as a replacement for the canceled \"Pryor's Place\" - also a Krofft production, followed by another brief return to CBS in the Summer of 1987.", "It was later shown in reruns on the Sci Fi Channel in the 1990s.", "Reruns of this series were aired on Saturday mornings on Me-TV and are streamed online at any time on their website.", "It has since become a cult classic and is now available on DVD.", "Krofft Productions remade the series in 1991, also titled \"Land of the Lost\", and a big budget film adaptation was released in 2009." ] ], "gold": "The 1974 children's adventure TV series Land of the Lost features a stop-motion animated T-Rex named Grumpy. The 2009 science fiction comedy film loosely based on the original series also includes Grumpy, but the 1991 remake series replaced him with a different T-Rex named Scarface.", "prediction 1": "The t-rex in the 1974 children's television series Land of the Lost was named 'The T-Rex.' It was a fictional creature created by David Gerrold. The T-Rex was later renamed to the T-Rex in the 1991 children's TV series Land of the Lost.", "prediction 2": "Land of the Lost is a children's television series that ran from 1974 to 1991. It featured the Porter family - father Tom, son Kevin and daughter Annie - trapped in a parallel universe after their Jeep Cherokee fell through a time portal while exploring the back country. The t-rex is one of the recurring characters in the series. In the 2009 American adventure comedy film, Land of the Lost, the t-rex is named after the movie.", "prediction 3": "The t rex in the 1974 television series Land of the Lost is named the T-Rex in the series. It was portrayed by Christopher Peck. In the 2009 American adventure comedy film Land of the Lost, the t-rex is portrayed by Will Ferrell.", "prediction 4": "Land of the Lost is a children's television series that ran from 1974 to 1991. In the 1974 series, T rex was the main animal. In the 1991 version, T rex was the main animal. In the 2009 American adventure comedy film, Land of the Lost, T rex was the main character.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 90 }, { "error type": "Unverifiable", "explanation": "", "start": 91, "end": 144 }, { "error type": "Unverifiable", "explanation": "", "start": 145, "end": 236 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was van halen's first album released?", "passages": [ [ "Van Halen (album)", "Van Halen (album)\n\nVan Halen is the debut studio album by American hard rock band Van Halen.", "Released on February 10, 1978, the album peaked at #19 on the \"Billboard\" 200.", "The album became widely recognized as the band's popularity grew, selling more than 10 million copies in the United States by August 7, 1996 and being certified Diamond.", "\"Van Halen\" contains many of Van Halen's signature songs, including \"Runnin' with the Devil,\" the guitar solo \"Eruption,\" their remake of The Kinks hit \"You Really Got Me,\" \"Ain't Talkin' 'bout Love,\" \"Jamie's Cryin',\" \"Feel Your Love Tonight\" and their remake of John Brim's \"Ice Cream Man.\"", "Van Halen began recording demos in 1976.", "However, a three-track tape financed by Gene Simmons attracted no interest from record labels.", "Guitarist Eddie Van Halen was not convinced of the quality of the material because they could not make the recordings with their own equipment.", "Simmons left to tour with Kiss after recording the demos, but said he would try to secure Van Halen a record deal afterwards.", "After recording the demos, Van Halen was offered several concerts." ], [ "Live: Right Here, Right Now", "Live:", "Right Here, Right Now\n\nLive:", "Right Here, Right Now.", "is the first live album by American hard rock band Van Halen, released in 1993.", "It is the band's only live album featuring Sammy Hagar, and the only live album by Van Halen until the release of \"Tokyo Dome Live in Concert\" in 2015.", "The album combines songs performed over two nights in May 1992 at the Selland Arena in Fresno, CA.", "Most of the songs on this album were from the first night, such as the solos performed by Eddie Van Halen and Sammy Hagar.", "There is much debate as to whether or not the songs on this album have been doctored in the studio, as the original 1992 broadcast of these songs from Cabo Wabo were much rawer and unmixed-sounding and sounded truer to the band's live sound than the recording that was ultimately released.", "The album contained only four David Lee Roth-era songs (including Van Halen's arrangement of \"You Really Got Me\" by The Kinks), and two songs from Sammy Hagar solo years.", "It also featured drum and bass solos and a cover of a song by The Who.", "As was the case with all tours with Hagar, the band focused on songs from the new album, Hagar's solo material and covers for the tour's duration." ], [ "Best Of \u2013 Volume I (Van Halen album)", "Best Of \u2013 Volume I (Van Halen album)\n\n", "Best Of \u2013 Volume I is the first greatest hits album by American hard rock band Van Halen, released in 1996.", "The album does not contain any songs from the band's 1982 album \"Diver Down\".", "\"Best Of \u2013 Volume I\" also features \"Humans Being,\" the band's contribution to the \"Twister\" soundtrack.", "The two newly recorded songs, \"Can't Get This Stuff", "No More\" and \"Me Wise Magic,\" at the end of the album are with original lead vocalist David Lee Roth.", "These two songs were released as singles to promote this compilation.", "They are also the last songs recorded by the original Van Halen lineup of Eddie Van Halen, Alex Van Halen, Roth and Michael Anthony.", "The Van Halen brothers would not record again with Roth until the album \"A Different Kind of Truth\", released in 2012.", "Anthony has not played with Van Halen since the band's 2004 tour.", "Initial pressings of the album contained an alternate edit of \"Runnin' with the Devil\" where the verses, chorus and solos were arranged in a different order than that of the original album version.", "It was reported that this was accidental and subsequent pressings have replaced this version with the one found on \"Van Halen\"." ] ], "gold": "American hard rock band Van Halen released their self-titled debut studio album on February 10, 1978. The group's first live album, Live: Right Here, Right Now, was released over a decade later on February 23, 1993, featuring songs performed over two nights in May 1992 at the Selland Arena in Fresno, CA. Van Halen's first compilation album, Best Of \u2013 Volume I, was released on October 22, 1996.", "prediction 1": "Van Halen is the debut studio album by American hard rock band Van Halen. It was released on February 10, 1978 and peaked at #19 on the Billboard 200. There was also an album titled Live: Right Here, Right Now, which was released in 1993. Best Of \u2013 Volume I was the first greatest hits album by Van Halen, released in 1996.", "prediction 2": "Van Halen is the debut studio album by American hard rock band Van Halen. Released on February 10, 1978, the album peaked at #19 on the Billboard 200. Best Of \u2013 Volume I is the first greatest hits album by American hard rock band Van Halen, released in 1996. It features songs performed over two nights in May 1992 at the Selland Arena in Fresno, CA. Best of \u2013 Volume I does not contain any songs from the band's 1982 album Diver Down.", "prediction 3": "Van Halen was the debut studio album by American hard rock band Van Halen. It was released on February 10, 1978. The band began recording demos in 1976. However, a three-track tape financed by Gene Simmons attracted no interest from record labels. Simmons left to tour with Kiss after recording the demos and said he would try to secure Van Halen a record deal afterwards. Live: Right Here, Right Now was the first live album by Van Halen, released in 1993. The album combines songs performed over two nights in May 1992 at the Selland Arena in Fresno, CA.", "prediction 4": "Van Halen's first album was released on February 10, 1978. It contains many of Van Halen's signature songs, including \"Runnin' with the Devil,\" \"Eruption,\" their remake of The Kinks hit \"You Really Got Me,\" \"Ain't Talkin' 'bout Love,\" \"Feel Your Love Tonight\", and their remake of John Brim's \"Ice Cream Man.\" Live: Right Here, Right Now, the band's first live album featuring Sammy Hagar, was released on April 9, 1993.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 150 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Van Halen is the debut studio album by American hard rock band Van Halen. It was released on February 10, 1978. There was also an album titled Live: Right Here, Right Now, which was released in 1993. The album combines songs performed over two nights in May 1992 at the Selland Arena in Fresno, CA. Best Of \u2013 Volume I was the first greatest hits album by Van Halen, released in 1996." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays lori loughlin's husband on garage sale mystery?", "passages": [ [ "Garage Sale Mystery", "Garage Sale Mystery\n\nGarage Sale Mystery is an American/Canadian mystery film series starring Lori Loughlin as Jennifer Shannon.", "It airs on Hallmark Movies & Mysteries in the US, Bravo in Canada and Channel 5 in the UK occasionally as part of the weekday films.", ", 15 films have aired since the 2013 debut.", "It is executive produced by Loughlin, Michael Shepard, and Peter DeLuise, who are also executive producers on the Hallmark television series \"When Calls the Heart\".", "The series follows the story of antiques dealer Jennifer (Loughlin) who has a knack for finding crimes.", "Her eye for details leads her to help solving these crimes even if it puts her own life in danger.", "The series started an adaptation of a two-part book series by author Suzi Weinert: \"Garage Sale Stalker\" and \"Garage Sale Diamonds\".", "The films were originally Hallmark Channel projects until broadcast on other stations.", "Bravo (Canada) aired the entire hexalogy in July 2016 and the expanded entire eleven movies in September 2017.", "Channel 5 (UK) broadcast the 7th film." ] ], "gold": "Garage Sale Mystery is an American/Canadian mystery film series based on the book series written by Suzi Weinert. The series stars Lori Loughlin as Jennifer Shannon, whose husband was in turn played by Rick Ravanello in the first film of the series and by Steve Bacic in the rest of the movies.", "prediction 1": "Garage Sale Mystery is an American/Canadian mystery film series starring Lori Loughlin as Jennifer Shannon. It airs on Hallmark Movies & Mysteries in the US, Bravo in Canada and Channel 5 in the UK occasionally as part of the weekday films. Lori Loughlin plays Loughlin's husband on the series.", "prediction 2": "Garage Sale Mystery is an American/Canadian mystery film series starring Lori Loughlin as Jennifer Shannon. 15 films have aired since the series' 2013 debut, and 15 more are in the works. Lori Loughlin's husband is played by Jason Alexander.", "prediction 3": "Garage Sale Mystery is an American/Canadian mystery film series starring Lori Loughlin as Jennifer Shannon, and it airs on Hallmark Movies & Mysteries in the US, Bravo in Canada and Channel 5 in the UK occasionally as part of the weekday films. In the early part of the series, Lori Loughlin, played Jennifer Shannon's husband, Jack, while Christopher McDaniel played Jennifer Shannon's husband John.", "prediction 4": "Garage Sale Mystery is an American/Canadian mystery film series starring Lori Loughlin as Jennifer Shannon, who helps solve crimes even if it puts her own life in danger. It airs on Hallmark Movies & Mysteries in the US, Bravo in Canada and Channel 5 in the UK occasionally as part of the weekday movies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 240 }, { "error type": "Unverifiable", "explanation": "", "start": 241, "end": 294 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Garage Sale Mystery is an American/Canadian mystery film series, based on the book series written by Suzi Weinert. It stars Lori Loughlin as Jennifer Shannon." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who plays stifler's mom in american pie?", "passages": [ [ "Jennifer Coolidge", "Coolidge is known for her supporting roles in several comedy movies and guest roles on television.", "She made her first appearance on TV in the \"Seinfeld\" episode \"The Masseuse\".", "Before gaining recognition, she received small roles, appearing in such films as \"A Bucket of Blood\", \"Plump Fiction\", and \"A Night at the Roxbury\".", "She also voiced Luanne's beauty school teacher Miss Kremzer in a recurring role on \"King of the Hill\".", "In 1999, Coolidge got her big break playing Jeanine Stifler, or \"Stifler's mom\" in \"American Pie\".", "The film was a box-office hit and took in a gross worldwide revenue of $235,483,004.", "In 2001, she reprised her role in \"American Pie 2\".", "Later in that same year, she had a supporting role in \"Legally Blonde\" as Paulette Bonafont\u00e9 Parcelle the manicurist.", "\"Legally Blonde\" was a box-office hit, grossing US$96 million domestically.", "The film's box-office success led to her reprising the role in its 2003 sequel, \"\", but the movie was not as financially successful as the first film and generated mostly negative reviews.", "In 2003, she again played Jeanine Stifler in \"American Wedding\"." ], [ "Jennifer Coolidge", "In , the film entered pre-production, and in May 2011, Coolidge signed on to reprise her role of Stifler's Mom.", "\"American Reunion\" opened in North America on April 6, 2012.", "In June 2011, Coolidge curated a Blake Nelson Boyd art show in New Orleans.", "In the same month Coolidge began to do standup comedy.", "She hosted the \u201cWomen in Film\u201d at the Beverly Hills Hotel.", "It went over so well, that she decided to take an act on the road.", "Coolidge ended up doing shows all over the country and the world for two years, Scotland included.", "Coolidge told Australian radio show \"The Kyle & Jackie O Show\" that she would be touring Australia as part of her \"Yours for the Night\" stand-up tour.", "In October 2011, Coolidge began a recurring role in the CBS sitcom \"2 Broke Girls\" as Sophie Kaczynski, a Polish neighbor of the two lead characters.", "She was later promoted to main cast from season 2 up until the shows cancellation in 2017.", "During 2013, additional voice cast members were announced for \"\", including Coolidge as Carol Sue, a transitions-relations officer." ], [ "Jennifer Coolidge", "Jennifer Coolidge\n\nJennifer Audrey Coolidge (born August 28, 1961) is an American actress, comedian and activist.", "She is best known for playing Jeanine Stifler, (Stifler's Mom), in the \"American Pie\" franchise (1999\u20132012), Sophie in the CBS sitcom \"2 Broke Girls\" (2011\u20132017), Bobbie in the sitcom \"Joey\" (2004\u20132006), Paulette Bonafont\u00e9 Parcelle in \"Legally Blonde\" (2001) and its , Hilary Duff's character's evil stepmother in \"A Cinderella Story\" (2004) and Betty in \"The Secret Life of the American Teenager\" (2008\u20132012).", "She is also a regular actor in Christopher Guest's mockumentary films.", "Coolidge is an alumna of The Groundlings, an improv and sketch comedy troupe based in Los Angeles.", "Coolidge was born in Boston, Massachusetts, to Gretchen (n\u00e9e Knauff) and Paul Constant Coolidge, a plastics manufacturer.", "She was raised in Norwell, Massachusetts, and is one of four children, with a brother, Andrew, and two sisters, Elizabeth and Susannah.", "Coolidge attended Norwell High School, the Cambridge School of Weston, Emerson College in Boston and the American Academy of Dramatic Arts in New York City." ] ], "gold": "Jennifer Audrey Coolidge plays Stifler's mom, or Jeanine Stifler, in the American Pie film series. In 1999, Coolidge got her big break playing Jeanine Stifler, or Stifler's mom, in the film American Pie. This film was a box-office hit and took in a gross worldwide revenue of $235,483,004. In 2001, Coolidge reprised her role as Stifler's mom in the American Pie sequel, American Pie 2. Then, in 2003, Coolidge again played Stifler's mom in American Wedding. Finally, in 2012, Coolidge reprised her role as Stiffler's mom in the film American Reunion, the latest film released in the American Pie series.", "prediction 1": "Jennifer Coolidge plays Jeanine Stifler's mom in American Pie. In the 1999 film, American Pie, Coolidge plays Stifler's mom while Hilary Duff plays Stifler's evil stepmother in A Cinderella Story and Hilary Duff plays Stifler's stepmother in The Secret Life of the American Teenager. The role was reprised in 2011 by Coolidge.", "prediction 2": "Jennifer Coolidge plays Jeanine Stifler's mom in the American Pie franchise from 1999-2012. She was also known for playing Jeanine Stifler's mom in the 2003 American Wedding sequel.", "prediction 3": "Jennifer Coolidge plays Jeanine Stifler's mom in the American Pie movies. The film was a box office hit and took in a gross worldwide revenue of $235,483,004. She reprised her role in American Pie 2 in 2001, and in May 2011, Coolidge signed on to reprise her role.", "prediction 4": "In the American Pie franchise, Jeanine Stifler's mom is played by Jennifer Coolidge. The 1999 film was a box office hit and took in a gross worldwide revenue of $235,483,004. The 2001 sequel to the 1999 film, American Pie 2, featured a cast that included Paulette Bonafont\u00e9 Parcelle as the manicurist. In 2012, a new cast member was added to the American Pie cast in the role of Stifler's mom, played by Jennifer Coolidge.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 32, "end": 45 }, { "error type": "Redundant", "explanation": "Jennifer Coolidge plays Jeanine Stifler's mom in American Pie. ", "start": 95, "end": 123 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 130, "end": 176 }, { "error type": "Redundant", "explanation": "In the 1999 film, American Pie, Coolidge plays Stifler's mom while Hilary Duff plays Stifler's evil stepmother in A Cinderella Story and ", "start": 200, "end": 238 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 242, "end": 283 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "Jennifer Audrey Coolidge plays Jeanine Stifler or Stifler's mom in American Pie. It was her big break to play the character in the 1999 film. The film was a box-office hit and took in a gross worldwide revenue of $235,483,004. In 2001, she reprised her role in \"American Pie 2\". In 2003, she again played Jeanine Stifler in \"American Wedding\". Coolidge signed on to reprise her role of Stifler's Mom for \"American Reunion\", the 2012 film." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the ethiopian and eritrean war start?", "passages": [ [ "Eritrean\u2013Ethiopian War", "Writing after the war had finished, Jon Abbink postulated that President Isaias Afewerki of Eritrea, realising that his influence over the government in Ethiopia was slipping and given that \"the facts on the ground, in the absence of a concrete border being marked\u2014which anyhow lost much of its relevance after 1962 when Eritrea was absorbed by Ethiopia\u2014have eminent relevance to any borderline decision of today\" calculated that Eritrea could annex Badme.", "If successful, this acquisition could be have been used to enhance his reputation and help maintain Eritrea's privileged economic relationship with Ethiopia.", "However, because Badme was in the province of Tigray, the region from which many of the members of the Ethiopian government originated (including Meles Zenawi, the former Ethiopian prime minister), the Ethiopian government came under political pressure from within the EPRDF as well as from the wider Ethiopian public to meet force with force.", "After a series of armed incidents in which several Eritrean officials were killed near Badme, on 6 May 1998, a large Eritrean mechanized force entered the Badme region along the border of Eritrea and Ethiopia's northern Tigray Region, resulting in a firefight between the Eritrean soldiers and the Tigrayan militia and security police they encountered." ], [ "Declaration of war", "Writing in 1880, William Edward Hall judged that \"any sort of previous declaration therefore is an empty formality unless the enemy must be given time and opportunity to put himself in a state of defence, and it is needless to say that no one asserts such a quixotism to be obligatory.\"", "The Hague Convention (III) of 1907 called \"Convention Relative to the Opening of Hostilities\" gives the international actions a country should perform when opening hostilities.", "The first two Articles say:\n\nIn 1989, Panama declared itself to be in a state of war with the United States.", "On 13 May 1998, at the outbreak of the Eritrean\u2013Ethiopian War, Ethiopia, in what Eritrean radio described as a \"total war\" policy, mobilized its forces for a full assault against Eritrea.", "The Claims Commission found that this was in essence an affirmation of the existence of a state of war between belligerents, not a declaration of war, and that Ethiopia also notified the United Nations Security Council, as required under Article 51 of the UN Charter.", "In December 2005, the government of Chad declared that a state of war existed with Sudan, after Sudan hosted Chadian rebel groups that were behind fatal cross border raids." ], [ "Eritrean\u2013Ethiopian War", "Eritrean\u2013Ethiopian War\n\nThe Eritrean\u2013Ethiopian War, one of the conflicts in the Horn of Africa, took place between Ethiopia and Eritrea from May 1998 to June 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation.", "Eritrea and Ethiopia, two of the world's poorest countries, spent hundreds of millions of dollars on the war and suffered tens of thousands of casualties as a direct consequence of the conflict.", "Only minor border changes resulted.", "According to a ruling by an international commission in The Hague, Eritrea broke international law and triggered the war by invading Ethiopia.", "At the end of the war, Ethiopia held all of the disputed territory and had advanced into Eritrea.", "After the war ended, the Eritrea\u2013Ethiopia Boundary Commission, a body founded by the UN, established that Badme, the disputed territory at the heart of the conflict, belongs to Eritrea.", ", Ethiopia still occupies the territory near Badme, including the town of Badme.", "On 5 June 2018, the ruling coalition of Ethiopia, headed by Prime Minister Abiy Ahmed, agreed to fully implement the peace treaty signed with Eritrea in 2000, with peace declared by both parties in July 2018.", "From 1961 until 1991, Eritrea had fought a long war of independence against Ethiopia." ] ], "gold": "The Eritrean\u2013Ethiopian War was a conflict that took place from May 1998 to June 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation. Some measure the start of the war when a large Eritrean mechanized force entered the Badme region along the border of Eritrea and Ethiopia's northern Tigray Region after a series of armed incidents in which several Eritrean officials were killed near Badme on 6 May 1998, resulting in a firefight between the Eritrean soldiers and the Tigrayan militia and security police they encountered. The beginning of the conflict can also be traced to 13 May 1998, when Ethiopia mobilized its forces for a full assault against Eritrea in what Eritrean radio described as a \"total war\" policy. The Claims Commission found that this was, in essence, an affirmation of the existence of a state of war between belligerents, not a declaration of war and that Ethiopia also notified the United Nations Security Council, as required under Article 51 of the UN Charter.", "prediction 1": "The Eritrean\u2013Ethiopian War started on 13 May 1998, when Ethiopia mobilized its forces for a full assault against Eritrea. The final peace treaty was signed with Eritrea in 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation. The conflict began in 1962, when Eritrea attempted to regain its independence from Ethiopia.", "prediction 2": "The Eritrean\u2013Ethiopian War, one of the conflicts in the Horn of Africa, took place between Ethiopia and Eritrea from May 1998 to June 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation. According to a ruling by an international commission in The Hague, Eritrea broke international law and triggered the war by invading Ethiopia.", "prediction 3": "On 13 May 1998, at the outbreak of the Eritrean\u2013Ethiopian War, Ethiopia mobilized its forces for a full assault against Eritrea. The final peace was only agreed to in 2018, twenty years after the initial confrontation. The conflict started when Eritrea broke international law and triggered the war by invading Ethiopia.", "prediction 4": "The Eritrean\u2013Ethiopian War, one of the conflicts in the Horn of Africa, took place between Ethiopia and Eritrea from May 1998 to June 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation. Eritrea broke international law and triggered the war by invading Ethiopia. According to a ruling by an international commission in The Hague, Eritrea broke international law and triggered the war by invading Ethiopia.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 122, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 361 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": " After a series of armed incidents in which several Eritrean officials were killed near Badme, on 6 May 1998, a large Eritrean mechanized force entered the Badme region along the border of Eritrea and Ethiopia's northern Tigray Region, resulting in a firefight between the Eritrean soldiers and the Tigrayan militia and security police they encountered.The Eritrean\u2013Ethiopian War started on 13 May 1998, when Ethiopia mobilized its forces for a full assault against Eritrea, in what Eritrean radio described as a \"total war\" policy. The Claims Commission found that this was in essence an affirmation of the existence of a state of war between belligerents, not a declaration of war, and that Ethiopia also notified the United Nations Security Council, as required under Article 51 of the UN Charter. The conflict ended in 2000, with the final peace only agreed to in 2018, twenty years after the initial confrontation. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Meaning of od and bd in medical term?", "passages": [ [ "Medical prescription", "Some abbreviations that are ambiguous, or that in their written form might be confused with something else, are not recommended and should be avoided.", "These are included in a separate list in Appendix 1.", "However, all abbreviations carry an increased risk for confusion and misinterpretation and should be used cautiously.", "In continental Europe, prescriptions differ from their counterparts in the English-speaking world.", "With the exception of patient directions, they are written out entirely in abbreviations deriving from the Latin language.", "Furthermore, a larger proportion of prescriptions are compounded, and appropriate abbreviations and phrases exist for this.", "Many medical schools require up to two years of Latin as part of the curriculum for medical doctors and pharmacists.", "A continental European prescription consists of three parts:\n\n\nShould a patient require a dosage in excess of the maximum as established by the appropriate governmental body, this is marked by an exclamation mark and the highest recommended dosage in Latin.", "If this is not done, it is the responsibility of the pharmacist to contact the doctor as to dose requirements, or amend the dose to the highest recommended one.", "In emergency situations, a prescription pad may not be available.", "In this situation, any piece of paper will do, provided it is marked \"Periculum in mora!" ], [ "Paroxysmal dyskinesia", "PKD is more prevalent in boys, usually as high as 3.75:1.", "PNKD has a set guideline for diagnosis that is slightly different from PKD.", "PNKD usually occurs unexpectedly, and is not brought on by sudden movements or exercise.", "Instead the attacks are brought on by stresses such as emotional stress, fatigue, alcohol, or caffeine consumption.", "Just like PKD, PNKD also shows autosomal dominance in family history.", "Physical examination and brain imaging examinations show normal results, and EEG shows no specific abnormalities as well.", "PNKD is more prevalent in boys, with ratios of 1.4:1.", "PED has a set guideline for diagnosis that is similar, but slightly different from both PKD and PNKD.", "PED attacks consist of dystonic and bilateral movements usually in the lower limbs of the body.", "These attacks are usually brought about only by exercise and physical exhaustion.", "PED patients do not feel an aura-like sensation before an attack occurs, unlike PKD and PNKD.", "These attacks usually last from 5 to 30 minutes, and can occur once a day or once a month.", "Physical examination and brain imaging examinations show normal results, and EEG shows no specific abnormalities as well." ] ], "gold": "Abbreviations are often used in medical prescriptions. The meaning of omne in die in medical terms means once a day. The meaning of oculus dexter in medical terms means right eye. The meaning of bd in medical terms means twice a day.", "prediction 1": "In medical term, some abbreviations that are ambiguous, or that in their written form might be confused with something else, are not recommended and should be avoided. Furthermore, all abbreviations carry an increased risk for confusion and misinterpretation and should be used cautiously. In continental Europe, prescriptions differ from their counterparts in the English-speaking world. With the exception of patient directions, they are written out entirely in abbreviations deriving from the Latin language.", "prediction 2": "Medical term OD and BD are abbreviations that are ambiguous, or that in their written form might be confused with something else, are not recommended and should be avoided. However, all abbreviations carry an increased risk for confusion and misinterpretation and should be used cautiously. In continental Europe, prescriptions differ from their counterparts in the English-speaking world. With the exception of patient directions, they are written out entirely in abbreviations deriving from the Latin language. Furthermore, a larger proportion of prescriptions are compounded, and appropriate abbreviations and phrases exist for this.", "prediction 3": "In medical term, od and bd means \"odd\" and \"bad\" respectively. In medical term, bd means \"bad\" and od means \"bad\".", "prediction 4": "The meaning of od and bd in medical term is characterized by ambiguity. Some abbreviations that in their written form might be confused with something else, are not recommended and should be avoided. However, all abbreviations carry an increased risk for confusion and misinterpretation and should be used cautiously. In continental Europe, prescriptions differ from their counterparts in the English-speaking world. With the exception of patient directions, they are written out entirely in abbreviations deriving from the Latin language.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 435 }, { "error type": "Irrelevant", "explanation": "", "start": 478, "end": 511 } ], "missing-info": [], "corrected-prediction": "In medical term, prescriptions are written out entirely in abbreviations." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where do beans in baked beans come from?", "passages": [ [ "Baked beans", "Baked beans\n\nBaked beans is a dish containing beans, sometimes baked but, despite the name, usually stewed, in a sauce.", "Most commercially canned baked beans are made from haricot beans, also known as navy beans (a variety of \"Phaseolus vulgaris\") in a sauce.", "In Ireland and the United Kingdom, a tomato sauce is most commonly used, and they are commonly eaten on toast or as part of a full English, Scottish, or Irish breakfast.", "American Boston baked beans use a sauce prepared with molasses and salt pork, the popularity of which has led to the city's being nicknamed \"Beantown\".", "Beans in a tomato and brown sugar, sugar, or corn syrup sauce are widely available throughout the US.", "Canada's Quebec-style beans often use maple syrup.", "This style is also popular in states bordering Canada's eastern provinces.", "Canned baked beans are used as a convenience food.", "They may be eaten hot or cold, straight from the can, as they are already fully cooked.", "The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528.", "The dish is commonly described as having a savory-sweet flavor and a brownish- or reddish-tinted white bean once baked, stewed, canned or otherwise cooked." ], [ "American cuisine", "Most of the initial colonists came from East Anglia in England, with other groups following them over the ages like francophone regions of Canada (this was especially true of Northern New England, where there are still many speakers of a dialect of French), from Ireland, from Southern Italy, and most recently from Haiti, Brazil, the Dominican Republic, and Portugal.", "The oldest forms of the cuisine date to the early 17th century and in the case of Massachusetts, out of the entire country only the state of Virginia can claim recipes that are older.", "East Anglian cookery would have included recipes for dishes like suet puddings, wheaten breads, and a few shellfish delicacies, like winkles, and would have been at the time of settlement simple Puritan fare quite in contrast to the fineries and excesses expected in London cavalier circles.", "Most of the cuisine started with one-pot cookery, which resulted in such dishes as succotash, chowder, baked beans, and others.", "Starches are fairly simple, and typically encompass just a handful of classics like potatoes and cornmeal, and a few native breads like Anadama bread, johnnycakes, bulkie rolls, Parker house rolls, popovers, and New England brown bread." ] ], "gold": "Baked beans is a dish traditionally containing white beans that are parboiled and then, in the US, baked in sauce at low temperature for a lengthy period. Baked beans originate in Native American cuisine, and are made from beans indigenous to the Americas. The dish was adopted and adapted by English colonists in New England in the 17th century and, through cookbooks published in the 19th century, spread to other regions of the United States and into Canada.", "prediction 1": "Most commercially canned baked beans are made from haricot beans, also known as navy beans, in a sauce. In Ireland and the United Kingdom, a tomato sauce is most commonly used, and they are commonly eaten on toast or as part of a full English, Scottish, or Irish breakfast. The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528.", "prediction 2": "Baked beans are a dish containing beans, sometimes baked but, despite the name, usually stewed, in a sauce. The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528. The beans in baked beans are usually made from haricot beans, also known as navy beans, in a sauce. The beans in the sauce are sometimes prepared from a variety of \"Phaseolus vulgaris\", a variety of \"Phaseolus vulgaris\".", "prediction 3": "The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528. Most commercially canned baked beans are made from haricot beans, also known as navy beans, in a sauce. In Ireland and the United Kingdom, a tomato sauce is most commonly used, and they are commonly eaten on toast or as part of a full English, Scottish, or Irish breakfast.", "prediction 4": "Most commercially canned baked beans are made from haricot beans, also known as navy beans, in a sauce. In Ireland and the United Kingdom, a tomato sauce is most commonly used, and they are commonly eaten on toast or as part of a full English, Scottish, or Irish breakfast. American Boston baked beans use a sauce prepared with molasses and salt pork, the popularity of which has led to the city's being nicknamed \"Beantown\". The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528. The oldest forms of the cuisine date to the early 17th century and in the case of Massachusetts, out of the entire country only the state of Virginia can claim recipes that are older.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 273 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Baked beans Baked beans is a dish containing beans, sometimes baked but, despite the name, usually stewed, in a sauce. Most commercially canned baked beans are made from haricot beans, also known as navy beans, in a sauce. The beans presently used to make baked beans are all native to South America and were introduced to Europe around 1528." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Most of the earth's fresh water is found in?", "passages": [ [ "Fresh water", "Fresh water habitats are classified as either lentic systems, which are the still-waters including ponds, lakes, swamps and mires ; lotic which are running-water systems; or groundwaters which flow in rocks and aquifers.", "There is, in addition, a zone which bridges between groundwater and lotic systems, which is the hyporheic zone, which underlies many larger rivers and can contain substantially more water than is seen in the open channel.", "It may also be in direct contact with the underlying underground water.", "The majority of fresh water on Earth is in ice caps.", "The source of almost all fresh water is precipitation from the atmosphere, in the form of mist, rain and snow.", "Fresh water falling as mist, rain or snow contains materials dissolved from the atmosphere and material from the sea and land over which the rain bearing clouds have traveled.", "In industrialized areas rain is typically acidic because of dissolved oxides of sulfur and nitrogen formed from burning of fossil fuels in cars, factories, trains and aircraft and from the atmospheric emissions of industry.", "In some cases this acid rain results in pollution of lakes and rivers.", "In coastal areas fresh water may contain significant concentrations of salts derived from the sea if windy conditions have lifted drops of seawater into the rain-bearing clouds.", "This can give rise to elevated concentrations of sodium, chloride, magnesium and sulfate as well as many other compounds in smaller concentrations." ], [ "Fresh water", "Fresh water\n\nFresh water (or freshwater) is any naturally occurring water except seawater and brackish water.", "Fresh water includes water in ice sheets, ice caps, glaciers, icebergs, bogs, ponds, lakes, rivers, streams, and even underground water called groundwater.", "Fresh water is generally characterized by having low concentrations of dissolved salts and other total dissolved solids.", "Though the term specifically excludes seawater and brackish water, it does include mineral-rich waters such as chalybeate springs.", "Fresh water is not the same as potable water (or drinking water).", "Much of the earth's fresh water (on the surface and groundwater) is unsuitable for drinking without some treatment.", "Fresh water can easily become polluted by human activities or due to naturally occurring processes, such as erosion.", "Water is critical to the survival of all living organisms.", "Some organisms can thrive on salt water, but the great majority of higher plants and most mammals need fresh water to live.", "Fresh water can be defined as water with less than 500 parts per million (ppm) of dissolved salts.", "Other sources give higher upper salinity limits for fresh water, e.g. 1000 ppm\nor 3000 ppm." ], [ "Glacier", "Glacier\n\nA glacier ( or ) is a persistent body of dense ice that is constantly moving under its own weight; it forms where the accumulation of snow exceeds its ablation (melting and sublimation) over many years, often centuries.", "Glaciers slowly deform and flow due to stresses induced by their weight, creating crevasses, seracs, and other distinguishing features.", "They also abrade rock and debris from their substrate to create landforms such as cirques and moraines.", "Glaciers form only on land and are distinct from the much thinner sea ice and lake ice that form on the surface of bodies of water.", "On Earth, 99% of glacial ice is contained within vast ice sheets (also known as \"continental glaciers\") in the polar regions, but glaciers may be found in mountain ranges on every continent including Oceania's high-latitude oceanic island countries such as New Zealand and Papua New Guinea.", "Between 35\u00b0N and 35\u00b0S, glaciers occur only in the Himalayas, Andes, Rocky Mountains, a few high mountains in East Africa, Mexico, New Guinea and on Zard Kuh in Iran.", "Glaciers cover about 10 percent of Earth's land surface.", "Continental glaciers cover nearly or about 98 percent of Antarctica's , with an average thickness of .", "Greenland and Patagonia also have huge expanses of continental glaciers.", "Glacial ice is the largest reservoir of fresh water on Earth." ] ], "gold": "Fresh water or freshwater is any naturally occurring liquid/solid water containing low concentrations of dissolved salts and other total dissolved solids. Precipitation from the atmosphere is the original source of almost all fresh water in the form of mist, rain and snow. Icecaps and glaciers contain most of the earths fresh water, with glaciers holding 69 percent. Brazil is the country with the most fresh water in the world. It is estimated that about 12% of the world's surface water resources are located in the country. The Amazon river basin accounts for 75% of Brazil's freshwater resources ", "prediction 1": "The majority of the Earth's fresh water is found in ice caps, which are bodies of dense ice covered by ice sheets. Glaciers are the largest reservoirs of fresh water on Earth.", "prediction 2": "The majority of the Earth's fresh water is found in ice caps, which are huge body of dense ice that are constantly moving under their own weight. The source of almost all fresh water is precipitation from the atmosphere, in the form of mist, rain and snow. The majority of the Earth's fresh water is found in glaciers.", "prediction 3": "The most fresh water on Earth is found in ice caps. The source of almost all fresh water is precipitation from the atmosphere in the form of mist, rain and snow. Fresh water includes water in ice sheets, ice caps, glaciers, icebergs, bogs, ponds, lakes, rivers, streams, and even underground water called groundwater. The majority of fresh water on Earth is in ice caps. The majority of fresh water on Earth is found in ice caps.", "prediction 4": "The majority of the Earth's fresh water is found in ice caps. The source of almost all fresh water is precipitation from the atmosphere, in the form of mist, rain and snow. Fresh water includes water in ice sheets, ice caps, glaciers, icebergs, bogs, ponds, lakes, rivers, streams, and even underground water called groundwater. Glaciers cover about 10 percent of the Earth's land surface.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Fresh water or freshwater is any naturally occurring liquid/solid water containing low concentrations of dissolved salts and other total dissolved solids. The source of almost all fresh water is precipitation from the atmosphere, in the form of mist, rain and snow. The majority of the Earth's fresh water is found in ice caps, which are bodies of dense ice covered by ice sheets. Glaciers are the largest reservoirs of fresh water on Earth." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "In what city does the equalizer take place?", "passages": [ [ "The Equalizer 2", "The Equalizer 2\n\nThe Equalizer 2 (sometimes promoted as The Equalizer II or EQ2) is a 2018 American thriller film directed by Antoine Fuqua.", "It is the sequel to the 2014 film \"The Equalizer\", which was based on the TV series of the same name.", "The film stars Denzel Washington, Pedro Pascal, Ashton Sanders, Melissa Leo, and Bill Pullman.", "It follows retired United States Marine and ex-DIA agent Robert McCall as he sets out on a path of revenge after one of his friends is killed.", "The film is the fourth collaboration between Washington and Fuqua, following \"Training Day\" (2001), \"The Equalizer\" (2014), and \"The Magnificent Seven\" (2016).", "Talks of an \"Equalizer\" sequel began seven months prior to the release of the first film.", "The project was officially announced in April 2015.", "Filming began in September 2017, and took place in Boston as well as other areas around Massachusetts.", "It also marks the first time Washington has starred in a sequel to one of his films.", "\"The Equalizer 2\" was released in the United States on July 20, 2018 by Sony Pictures Releasing.", "The film has grossed $190.5 million worldwide and received mixed reviews, with critics praising Washington's performance and the film's action sequences, but criticizing the pacing and number of subplots." ], [ "The Equalizer 2", "Filming also took place on Lynn Shore Drive in Lynn, Massachusetts, the Powder Point Bridge, as well as in Brant Rock, Massachusetts.", "While Sony and other publications reported the film was made on a net production budget of $62 million, \"Deadline Hollywood\" stated their sources insisted the cost was \"in the high [$70 million]\" range after Massachusetts tax credits.", "Harry Gregson-Williams returned to score this film.", "The soundtrack was released by Sony Classical.", "\"The Equalizer 2\" was released on July 20, 2018, by Sony Pictures.", "Sony had originally scheduled the film for a September 29, 2017 release, and later pushed it back a year to September 14, 2018, then brought it forward to August 3, 2018, before settling on its July 20 date.", "\"The Equalizer 2\" has grossed $102.1 million in the United States and Canada, and $88.4 million in other territories, for a total worldwide gross of $190.5 million, against a production budget of $62 million.", "In the United States and Canada, \"The Equalizer 2\" was released alongside \"Mamma Mia!", "Here We Go Again\" and \"\", and was projected to gross $27\u201332 million from 3,388 theaters in its opening weekend." ], [ "The Equalizer (film)", "Filming began in June 2013 with locations in Salisbury, Hamilton, Chelsea, Haverhill, and Boston, Massachusetts.", "On June 21, 2013, Harry Gregson-Williams was hired to compose the music for the film.", "Var\u00e8se Sarabande released a soundtrack album for \"The Equalizer\" on September 23, 2014.", "The song \"Guts Over Fear\" by rapper Eminem and featuring Sia with production by Emile Haynie premiered in trailers for the film.", "The song also plays over the closing credits.", "The first official image from the film was released on December 6, 2013.", "Sony originally planned on an April 11, 2014 release date, but pushed it back to September 26, 2014.", "The first official poster for the film was released on April 16, 2014.", "On April 22, \"USA Today\" revealed photos from the film.", "On May 24, the trailer for the film was released.", "On June 12, another official trailer for the film was released.", "On July 16, the IMAX poster for the film was released.", "The film had a premiere at the 2014 Toronto International Film Festival on September 7, 2014.", "Sony released the film in IMAX screen theaters worldwide on September 26, 2014." ], [ "The Equalizer (film)", "The Equalizer (film)\n\nThe Equalizer is a 2014 American vigilante action thriller film directed by Antoine Fuqua, loosely based on the 1980s TV series of the same name.", "It stars Denzel Washington, Marton Csokas, Chlo\u00eb Grace Moretz, David Harbour, Bill Pullman and Melissa Leo.", "Principal photography began in June 2013 in Massachusetts.", "It was the first film to have Village Roadshow Pictures co-finance the deal with Sony Pictures since \"Saving Silverman\" in 2001.", "The film had its world premiere at 2014 Toronto International Film Festival on September 7, 2014, and was released worldwide on September 26 2014.", "The film received mixed reviews from critics, who praised the visual style, acting, soundtrack and action sequences but criticized its violence and plot.", "Nonetheless, it became a commercial success with a worldwide gross of over $192 million.", "A sequel was released on July 20, 2018, with Washington and Fuqua returning.", "Robert McCall is a retired Marine and Defense Intelligence Agency operative who, after promising his recently deceased wife that he would leave his former activities behind, lives quietly in Boston and works at a Home Mart hardware store.", "McCall befriends many of his co-workers and helps a security guard trainee named Ralph pass his qualification exam." ] ], "gold": "The 2014 Equalizer filming took place in Salisbury, Hamilton, Chelsea, Haverhill, and Boston, Massachusetts. The Equalizer 2 filming in 2018 took place in Roxbury, Boston, Massachusetts, Lynn, Massachusetts, and Brant Rock, Massachusetts.", "prediction 1": "The Equalizer is a 2014 American action thriller film directed by Antoine Fuqua, loosely based on the 1980s TV series of the same name. Principal photography for the film began in June 2013 in Boston. Filming for the 2018 sequel, The Equalizer 2, took place in Boston as well as other areas around Massachusetts. The film follows retired United States Marine and ex-DIA agent Robert McCall as he sets out on a path of revenge after one of his friends is killed. Principal photography for the 2014 Equalizer took place in Salisbury, Hamilton, Chelsea, Haverhill, Lynn, Boston, Massachusetts. The 2018 film follows retired United States Marine and ex-DIA agent Robert McCall as he sets out on a path of revenge after one of his friends is killed.\n", "prediction 2": "The Equalizer is a 2014 American vigilante action thriller film directed by Antoine Fuqua loosely based on the 1980s TV series of the same name. Principal photography for the film began in June 2013, taking place in Lynn, Massachusetts with locations in Salisbury, Hamilton, Chelsea, Haverhill, and Boston. On June 21, 2013, Harry Gregson-Williams was hired to play the music for the film. Production for the sequel, The Equalizer 2, began in September 2017 and took place in Boston as well as other areas around Massachusetts. The 2018 movie was released in the United States on July 20, 2018.", "prediction 3": "The Equalizer is a 2014 American action thriller comedy film directed by Antoine Fuqua loosely based on the 1980s TV series of the same name that premiered at the 2014 Toronto International Film Festival on September 7, 2014. Principal photography took place in Boston, Massachusetts, starting with the Longwood neighborhood. In September 2017, filming began in Salisbury, Hamilton, Chelsea, Haverhill, and Lynn, Massachusetts, where the film was filmed as well as other areas around Massachusetts. In 2016, the film was filmed in Brant Rock, Massachusetts. It follows retired United States Marine and ex-DEA Agent Robert McCall as he sets out on a path of revenge after one of his friends is killed. Principal photography began in June 2013 in Boston, Massachusetts.", "prediction 4": "The Equalizer is a 2014 American action thriller film directed by Antoine Fuqua, loosely based on the 1980s TV series of the same name. Principal photography for the film began in June 2013 in Boston, Massachusetts. Filming also took place in Boston as well as other areas around Massachusetts. In 2018, the film The Equalizer 2 was released in the United States as a sequel to the 2014 film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 591, "end": 745 }, { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 53 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 189 }, { "error type": "Redundant", "explanation": "Principal photography for the film began in June 2013 in", "start": 462, "end": 520 }, { "error type": "Redundant", "explanation": "Boston", "start": 568, "end": 575 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2014 Equalizer's principal photography took place in Boston, Salisbury, Hamilton, Chelsea, and Haverhill, Massachusetts. Filming for the 2018 sequel, The Equalizer 2, took place in Boston, Lynn, and Brant Rock, Massachusetts." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Most goals in one nhl game by a player?", "passages": [ [ "History of the National Hockey League", "After unsuccessfully resolving disputes with Eddie Livingstone, owner of the Toronto Blueshirts, executives of the three other NHA franchises\u2014the Montreal Canadiens, Montreal Wanderers and Ottawa Senators\u2014suspended the NHA, and formed the NHL, replacing Livingstone's team with a temporary team in Toronto, the Arenas.", "While new, the NHL was a continuation of the NHA.", "The NHL adopted the NHA's constitution, its rules, playing with six men to a side rather than the then-traditional seven and the NHA's split-season schedule.", "The owners originally intended the NHL to only operate for one season.", "However, the NHA was suspended permanently in 1918 and ceased to be an organisation in 1920.", "In 1921, the NHA championship trophy O'Brien Cup was adopted as the championship trophy of the NHL.", "One of the NHL's first superstars was the prolific goal-scorer Joe Malone, who scored 44 goals in 20 games in the NHL's first season, of which five were netted on the NHL's opening night.", "He also set the record for the most goals in a game that season, with seven.", "Six games into the season, the Montreal Wanderers were forced to permanently withdraw from the league, as a fire left them without an arena." ], [ "Joe Malone (ice hockey)", "In 1917 Joe scored 41 goals in 19 games for Quebec.", "When the NHL was founded in 1917, Quebec did not operate a team its first season and the team's players were dispersed amongst the other teams.", "Malone was claimed by the Montreal Canadiens.", "Playing on what was one of the most powerful forward lines of all time with Newsy Lalonde and Didier Pitre, Malone shifted to left wing to accommodate the great Lalonde, and was the NHL's first scoring leader, registering 44 goals in 20 games, a record total that would stand as the NHL's single season goal scoring mark until 1945 and a record per-game average that stands to this day.", "(If such an average was sustained over today's 82-game schedule, it would result in 180 goals, nearly double Wayne Gretzky's record of 92.)", "Malone scored at least one goal (and a total of 35 goals) in his first 14 NHL games to set the record for the longest goal-scoring streak to begin an NHL career.", "This streak still stands as the second-longest goal-scoring streak in NHL history." ], [ "Joe Malone (ice hockey)", "Joe Malone (ice hockey)\n\nMaurice Joseph \"Phantom Joe\" Malone (February 28, 1890 \u2013 May 15, 1969) was a Canadian professional ice hockey centre who played in the National Hockey Association and National Hockey League.", "He was notable for his scoring feats and his clean play.", "He scored the third-most career goals of any player in major hockey's first half-century (behind Newsy Lalonde and Nels Stewart) and is the only player in the history of the NHL to score seven goals in a single game.", "Malone broke in at the age of 19 for the Quebec Bulldogs of the Eastern Canada Hockey Association in the 1909 season, scoring eight goals in 12 games.", "The next season the NHA formed, but Quebec was left out of the loop, so he played for the Waterloo Colts in the Ontario Professional Hockey League.", "Rejoining Quebec in 1911, he was named the team captain and so served for the Bulldogs' seven NHA seasons.", "Centering linemates such as Eddie Oatman and Jack Marks, he led the Bulldogs to the Stanley Cups in 1912 and 1913 - rampaging for a career-best nine goals in a Cup match against Sydney - while recording remarkable scoring marks of 43 goals in 20 games in 1913.", "His brother Jeff Malone was also played for Quebec in 1913 when they won the Stanley Cup." ] ], "gold": "The first player to score five or more goals in a single game so was Joe Malone, with the Montreal Canadiens, in the first NHL game, on December 19, 1917. He is the only player in the history of the NHL to score seven goals in a single game, accomplishing the feat in 1920.", "prediction 1": "The record for most goals in one NHL game is held by Joe Malone, who scored 44 goals in 20 games in the NHL's first season, of which five were netted on the NHL's opening night. The record for most goals in a game that season, with seven, stood until 1945.\n", "prediction 2": "Joe Malone, a centre for the Quebec Bulldogs of the Eastern Hockey Association, set the record for the most goals in a single NHL game in 1917-1918. Malone was also the first player to score 50 goals in the NHL's first season in 1917-1918. The record then stood until 1945, when it was surpassed by Norval Lechler, who scored 58 goals in the NHL's second season. Malone also set the record for the most goals in a single NHL game in 1919, when he scored 37 goals in the first season.", "prediction 3": "Maurice Joseph \"Phantom Joe\" Malone, a Canadian professional ice hockey centre that played in the National Hockey Association and National Hockey League, is the player that set the record for most goals in a single NHL game. The record for most goals in a NHL game is held by Joe Malone, who also holds the record for most goals in a game with seven, according to the National Hockey League website.", "prediction 4": "Montreal native Joe Malone is the first goal-scorer in NHL history to have scored at least one goal in all 14 games of his NHL career, setting a record that still stands today, with seven goals in his NHL debut. Head Coach Paul Durand played for Joe Malone during his 18 season NHL career when the company was called The Heavy Metals Operation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 257 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The record for most goals in one NHL game is held by Joe Malone, who set the record for the most goals in a game in the NHL's first season with seven.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When does the new season of midsomer murders start?", "passages": [ [ "Midsomer Murders", "Midsomer Murders\n\nMidsomer Murders is a British television detective drama that has aired on ITV since 1997.", "The show is based on Caroline Graham's \"Chief Inspector Barnaby\" book series, as originally adapted for television by Anthony Horowitz.", "A major success in viewership since its first episode, the series has been marketed worldwide in more than 200 countries.", "Set within small English country villages, the show has an unusual identity as a crime drama peppered with both lighthearted whimsy and dark humour.", "The first 13 seasons starred John Nettles as Detective Chief Inspector (DCI) Tom Barnaby.", "The character's younger cousin, DCI John Barnaby (played by Neil Dudgeon), took over his position when Nettles retired from the show in 2011.", "Despite the change of lead character (and numerous changes among secondary players), the show has retained its popularity and has completed its 20th season.", "\"Midsomer Murders\" is a detective drama set in modern-day England.", "The stories revolve around the efforts of Detective Chief Inspector Tom Barnaby (and later his successor, John Barnaby) to solve numerous murders that take place in the picturesque but deadly villages of the fictional county of Midsomer." ], [ "Written in Blood (novel)", "Written in Blood (novel)\n\nWritten in Blood is a crime novel by English author Caroline Graham, the fourth book in her popular Chief Inspector Barnaby series, which has been adapted into the equally successful ITV drama \"Midsomer Murders\".", "The Midsomer Worthy Writer's Circle, a group of amateur novelists, invite celebrated author Max Jennings along as a special guest.", "However, host Gerald Hadleigh is vehemently opposed to the idea but refuses to explain why, so he is promptly overruled by his peers.", "After the somewhat uncomfortable event, Hadleigh's companion Rex St. John is tricked into departing, leaving Hadleigh alone with Jennings.", "The next morning Gerald is found savagely murdered with a candlestick, his corpse stripped and all his clothes stolen, with no sign of Max.", "A dark and compelling mystery with horrific overtones, \"Written in Blood\" explores several challenging themes, including child abuse, transvestism, insanity and the nature of unconditional love.", "Written in Blood was adapted on 22 March 1998 as the second episode of Midsomer Murders, the first being \"The Killings at Badger's Drift\".", "The two-hour film starred Anna Massey, Una Stubbs and David Troughton, alongside John Nettles and Daniel Casey in their usual roles of Barnaby and Troy." ], [ "Sherlock (TV series)", "The episode was simulcast in British cinemas on 1 January, and was shown on 5 and 6 January 2016 in selected cinemas throughout the US.", "Exclusive bonus material in the cinema presentation included a guided tour of 221B Baker Street from Steven Moffat and a look behind the scenes at how the special episode was made featuring all the lead cast and crew.", "By October 2013, a fourth series was commissioned, with scripts planned.", "Moffat told \"The Telegraph\" in January 2014, \"we're all keen to continue\", but said it had been difficult to co-ordinate the lead actors' schedules.", "Filming began on 4 April 2016 at Pinewood Studio Wales, and lasted until 5 August.", "In May 2016 it was announced that Toby Jones had been cast as a villain from Sherlock Holmes lore.", "The fourth series premiered on 1 January 2017, with \"The Six Thatchers\".", "The second episode \"The Lying Detective\" aired on 8 January 2017; the last episode \"The Final Problem\" aired on 15 January 2017.", "In January 2014, Moffat stated that a fifth series had been plotted by himself and Gatiss; however, by the release of the fourth series in January 2017, they had not yet decided whether to produce it.", "Cumberbatch and Moffat in particular have expressed interest in continuing at some point in the future, but there are no immediate plans." ], [ "Last Tango in Halifax", "\"Last Tango in Halifax\" accrued four nominations for the 2013 British Academy Television Awards and won the British Academy Television Award for Best Drama Series.", "The United States broadcast television network PBS began airing the first series in September 2013.", "A second series was commissioned, and filming began in summer 2013.", "It was broadcast on BBC One from 19 November 2013 to 24 December 2013.", "A third series was commissioned prior to the final episode of the second, aired between 28 December 2014 and 1 February 2015.", "Immediately following the end of Series Three, the BBC announced that a fourth series had been commissioned.", "The fourth series consists of only two episodes, described as \"Christmas Specials\".", "They were broadcast on 19 and 20 December 2016.", "Celia Dawson and Alan Buttershaw are both widowed and in their seventies.", "They were attracted to each other in the 1950s, but never expressed their feelings, and Celia moved away with her parents.", "In the present day, they are reunited after being persuaded to join Facebook by their respective grandchildren.", "Alan has loved Celia since he was 16 years old, whilst Celia is described as a woman who is \"unfulfilled\" and was unhappily married to a man she grew to hate.", "After their reunion, Alan and Celia discover that they still feel as passionately for each other as they did when they were teenagers." ] ], "gold": "Midsomer Murders is a British crime drama television series which, as of October 2020, has begun filming its 22nd season. Filming for each season begins several months before the season starts being aired. For example, the start of filming for season 16 was June/July 2013, and the season started being aired on 24 December 2013. Filming for season 17 started April/May 2014, and the season began airing on 28 January 2015. The filming of season 18 began March/April 2015, and the season's airing started on 6 January 2016.", "prediction 1": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The show is based on Caroline Graham's Chief Inspector Barnaby book series, as originally adapted for television by Anthony Horowitz. The first 13 seasons starred John Nettles as Detective Chief Inspector Tom Barnaby. The character's younger cousin, DCI John Barnaby, took over his position when Nettles retired from the show in 2011. The second season aired from January 1, 2017 to January 1, 2016. The third series premiered on January 1, 2017.\n", "prediction 2": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The show is based on Caroline Graham's Chief Inspector Barnaby book series, as originally adapted for television by Anthony Horowitz. The first 13 seasons starred John Nettles as Detective Chief Inspector Tom Barnaby, whose brother is played by Neil Dudgeon. The fourth book in the Chief Inspector Barnaby series, Written in Blood, was adapted into the equally successful ITV drama Midsomer Murders in Blood. The second episode was simulcast in British cinemas on 1 January 2016, and was shown in selected theaters throughout the US. The fourth series premiered on 1 January 2017 with The Six Thatchers. The second episode, The Lying Detective, aired on January 2016 and the last episode, The Final Problem, aired on January 2017.", "prediction 3": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The show is based on Caroline Graham's Chief Inspector Barnaby book series, as originally adapted for television by Anthony Horowitz. The latest season started on January 1, 2017, the episode \"The Lying Detective\" aired January 8, 2017, and the episode \"The Final Problem\" aired January 15, 2017.", "prediction 4": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The show is based on Caroline Graham's Chief Inspector Barnaby book series, as originally adapted for television by Anthony Horowitz. Season 20 started on January 1, 2020. Season 31 started on January 8, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 78 }, { "error type": "Unverifiable", "explanation": "", "start": 426, "end": 490 }, { "error type": "Unverifiable", "explanation": "", "start": 491, "end": 538 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Midsomer Murders is a British television detective drama that has aired since 1997, and has completed its 20th season. \n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where is the new york comic con held?", "passages": [ [ "New York Comic Con", "Only single day Thursday, Friday, Saturday, Sunday, and Sunday kids tickets would be sold for the event.", "In 2018, the event organizers announced a partnership with Anime Expo for show called Anime Fest @ NYCC X Anime Expo.", "The four-day event would be held at Pier 94 in New York City, concurrent with the NYCC convention dates.", "The New York Anime Festival was an anime and manga convention held annually from 2007 to 2011 at the Jacob K. Javits Convention Center on the West Side of Manhattan in New York City.", "Produced by Reed Exhibitions, the people behind New York Comic Con, the inaugural event was held from December 7 through December 9, 2007.", "Starting in 2010 the New York Anime Festival has been held with the New York Comic Con, bringing the two cultures together.", "In 2012, the New York Anime festival was absorbed into Comic Con.", "The Eastern Championships of Cosplay have been held at New York Comic Con since 2014.", "They are one of the stops in ReedPOP's global Crown Championships of Cosplay circuit.", "The top three winning cosplayers receive cash prizes and the overall winner, the Eastern Champion, is entered into the final held at Chicago Comic & Entertainment Expo.", "Costumes are judged in four skill categories and then in an overall category.", "The skill categories are:" ], [ "New York Comic Con", "New York Comic Con\n\nThe New York Comic Con is an annual New York City fan convention dedicated to Western comics, graphic novels, anime, manga, video games, cosplay, toys, movies, and television.", "It was first held in 2006.", "The New York Comic Con is a for-profit event produced and managed by ReedPOP, a division of Reed Exhibitions and Reed Elsevier, and is not affiliated with the long running non-profit San Diego Comic-Con, nor the Big Apple Convention, later known as the Big Apple Comic-Con, owned by Wizard Entertainment.", "ReedPOP is involved with other events, including Chicago Comic & Entertainment Expo (C2E2) and PAX Dev/PAX East/PAX Prime.", "ReedPop and New York Comic Con were founded by Greg Topalian, former senior vice president of Reed Exhibitions.", "The first con was held in 2006 at the Jacob K. Javits Convention Center.", "Due to Reed Exhibitions' lack of experience with comic conventions (they primarily dealt with professional trade shows prior to 2006), attendance was far more than anticipated, and the main exhibition hall could only hold 10,000.", "Despite crowding on Friday afternoon, tickets continued to be sold due to low pre-reg numbers (4,500), and the non-counting of professionals and exhibitors." ], [ "Javits Center", "Javits Center\n\nThe Jacob K. Javits Convention Center, commonly known as the Javits Center, is a large convention center located on Eleventh Avenue, between 34th and 40th streets, in Hell's Kitchen, Manhattan, New York City.", "It was designed by architect James Ingo Freed of Pei Cobb Freed & Partners.", "The controversial and revolutionary space frame structure was begun in 1980, finished in 1986, and named for United States Senator Jacob Javits, who died that year.", "The Center is operated and maintained by the New York Convention Center Operating Corporation, a New York State public-benefit corporation.", "The convention center has a total area space of and has of total exhibit space.", "When the Center opened, it replaced the New York Coliseum as the city's major convention facility, making way for the demolition of the Coliseum and future construction of the Time Warner Center at Columbus Circle.", "Today, it hosts events such as the New York International Auto Show and the New York Comic Con.", "It is billed as one of the busiest convention centers in the United States, but it is only the twelfth-largest." ] ], "gold": "The New York Comic Con, an annual fan convention, was held from 2015 to 2017 at the Jacob K. Javits Convention Center, a convention center on Eleventh Avenue between 34th Street and 38th Street in Hell's Kitchen, Manhattan, New York City.", "prediction 1": "The New York Comic Con is an annual New York City fan convention dedicated to Western comics, graphic novels, anime, manga, video games, cosplay, toys, movies, and television. The first New York Comic Con was held in 2006. From 2007 to 2011, the event was held annually at the Jacob K. Javits Convention Center on the West Side of Manhattan in New York City. Starting in 2010 the New York Anime Festival has been held with the New York Comic Con, bringing the two cultures together.", "prediction 2": "The New York Comic Con is an annual New York City fan convention dedicated to Western comics, graphic novels, anime, manga, video games, cosplay, toys, movies, and television. It was first held in 2006 at the Jacob K. Javits Convention Center on the West Side of Manhattan in New York City. The New York Anime Festival was an anime and manga convention held annually from 2007 to 2011 at the Jacob K. Javits Convention Center on the West Side of Manhattan in New York City. The Eastern Championships of Cosplay have been held at the New York Comic Con since 2014.", "prediction 3": "The first New York Comic Con was held in 2006 at the Jacob K. Javits Convention Center in Hell's Kitchen, Manhattan.", "prediction 4": "The New York Comic Con is an annual New York City fan convention dedicated to Western comics, graphic novels, anime, manga, video games, cosplay, toys, movies, and television. The convention is held at the Jacob K. Javits Convention Center in Manhattan. The New York Anime Festival was an anime and manga convention held annually from 2007 to 2011 at the Jacob K. Javits Convention Center on the West Side of Manhattan in New York City. Starting in 2010, the New York Anime Festival has been held with the New York Comic Con, bringing the two cultures together. The Eastern Championships of Cosplay have been held at New York Comic Con since 2014. The Eastern Championships of Cosplay have been held at New York Comic Con since 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 49 }, { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 222 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 246, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 482 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The New York Comic Con is an annual fan convention. In 2006, it was held at the Jacob K. Javits Convention Center and still holds it today." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "How much did titanic make at the box office?", "passages": [ [ "Titanic (1953 film)", "Titanic (1953 film)\n\n", "Titanic is a 1953 American drama film directed by Jean Negulesco.", "Its plot centers on an estranged couple sailing on the ill-fated maiden voyage of the , which took place in April 1912.", "The film was released a day after the 41st anniversary of the sinking of the ocean liner.", "At the last minute, a wealthy American expatriate in Europe, Richard Sturges (Clifton Webb), buys a steerage-class ticket (the lowest class) for the maiden voyage of the RMS \"Titanic\" from a Basque immigrant.", "Once aboard he seeks out his runaway wife, Julia (Barbara Stanwyck).", "He discovers she is trying to take their two unsuspecting children, 18-year-old Annette (Audrey Dalton) and ten-year-old Norman (Harper Carter), to her hometown of Mackinac, Michigan, to raise as down-to-earth Americans rather than rootless elitists like Richard himself.", "As the ship prepares for departure, her captain, E. J. Smith (Brian Aherne), receives a hint from the shipping company representative that a record-setting speedy passage would be welcomed." ], [ "Titanic (1997 film)", "Titanic (1997 film)\n\n", "Titanic is a 1997 American epic romance and disaster film directed, written, co-produced and co-edited by James Cameron.", "A fictionalized account of the sinking of the RMS \"Titanic\", it stars Leonardo DiCaprio and Kate Winslet as members of different social classes who fall in love aboard the ship during its ill-fated maiden voyage.", "Cameron's inspiration for the film came from his fascination with shipwrecks; he felt a love story interspersed with the human loss would be essential to convey the emotional impact of the disaster.", "Production began in 1995, when Cameron shot footage of the actual \"Titanic\" wreck.", "The modern scenes on the research vessel\" \"were shot on board the \"Akademik Mstislav Keldysh\", which Cameron had used as a base when filming the wreck.", "Scale models, computer-generated imagery, and a reconstruction of the \"Titanic\" built at Baja Studios, at Playas de Rosarito in Baja California were used to re-create the sinking.", "The film was partially funded by Paramount Pictures and 20th Century Fox; the former handled distribution in North America while Fox released the film internationally.", "It was the most expensive film ever made at the time, with a production budget of $200\u00a0million.", "Upon its release on December 19, 1997, \"Titanic\" achieved critical and commercial success." ], [ "Titanic (1997 film)", "20th Century Fox and Paramount Pictures co-financed \"Titanic\", with Paramount handling the North American distribution and Fox handling the international release.", "They expected Cameron to complete the film for a release on July 2, 1997.", "The film was to be released on this date \"in order to exploit the lucrative summer season ticket sales when blockbuster films usually do better\".", "In April, Cameron said the film's special effects were too complicated and that releasing the film for summer would not be possible.", "With production delays, Paramount pushed back the release date to December 19, 1997.", "\"This fueled speculation that the film itself was a disaster.\"", "A preview screening in Minneapolis on July 14 \"generated positive reviews\" and \"[c]hatter on the internet was responsible for more favorable word of mouth about the [film]\".", "This eventually led to more positive media coverage.", "The film premiered on November 1, 1997, at the Tokyo International Film Festival, where reaction was described as \"tepid\" by \"The New York Times\".", "Positive reviews started to appear back in the United States; the official Hollywood premiere occurred on December 14, 1997, where \"the big movie stars who attended the opening were enthusiastically gushing about the film to the world media\"." ] ], "gold": "There are several movies based on the ill-fated maiden voyage of the RMS Titanic and named after the ship. One of them was directed by Jean Negulesco, starred Clifton Webb and Barbara Stanwyck and was released in 1953, making a total of $2,250,000 at the box office. In 1997, James Cameron directed an epic romance and disaster film starring Leonardo DiCaprio and Kate Winslet as members of different social classes who fall in love aboard the ship. The film premiered on November 1, 1997, at the Tokyo International Film Festival and received a steady attendance after opening in North America, where, by the end of that same weekend, theaters were beginning to sell out, ultimately leading to the movie making a grand total of $2.187 billion on the box office throughout its original release.", "prediction 1": "Titanic is a 1953 American drama film directed by Jean Negulesco. Its plot centers on an estranged couple sailing on the ill-fated maiden voyage of the RMS Titanic, which took place in April 1912. The film was released a day after the 41st anniversary of the sinking of the ocean liner. It was the most expensive film ever made at the time, with a production budget of $200 million. The 1997 American epic romance film Titanic achieved critical and commercial success.", "prediction 2": "Titanic was a 1953 American drama film directed by Jean Negulesco, whose plot centers on an estranged couple sailing on the ill-fated maiden voyage of the RMS Titanic. The film was released on the 41st anniversary of the sinking of the ocean liner, and made $80 million in North America. The 1997 American epic romance and disaster film, Titanic, was released on December 19, 1997, and made $85 million worldwide.", "prediction 3": "Titanic is a 1953 American drama film directed by Jean Negulesco. Its plot centers on an estranged couple sailing on the ill-fated maiden voyage of the RMS Titanic, which took place in April 1912. The film was released a day after the 41st anniversary of the sinking of the ocean liner. In 1997, James Cameron directed the epic romance and disaster film, Titanic, which was the most expensive film ever made at the time, with a production budget of $200 million. The film made over $800 million at the worldwide box office. In the United States, it grossed $800 million at the domestic box office.", "prediction 4": "Titanic is a 1953 American drama film directed by Jean Negulesco. The film's plot centers on an estranged couple sailing on the ill-fated maiden voyage of the RMS Titanic. The 1997 American epic romance and disaster film Titanic was released on December 19, 1997. It was the most expensive film ever made at the time, with a production budget of $200 million.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 196 }, { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 382 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "Titanic is a 1953 American drama film directed by Jean Negulesco. Its plot centers on an estranged couple sailing on the ill-fated maiden voyage of the RMS Titanic, and starred Clifton Webb and Barbara Stanwyck. The 1997 American epic romance film Titanic, directed by James Cameron, achieved critical and commercial success. A fictionalized account of the sinking of the RMS \"Titanic\", it stars Leonardo DiCaprio and Kate Winslet as members of different social classes who fall in love aboard the ship during its ill-fated maiden voyage. The film premiered on November 1, 1997, at the Tokyo International Film Festival." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "How many types of mangoes are grown in india?", "passages": [ [ "Mango", "Mango\n\nMangoes are juicy stone fruit (drupe) from numerous species of tropical trees belonging to the flowering plant genus \"Mangifera\", cultivated mostly for their edible fruit.", "The majority of these species are found in nature as wild mangoes.", "The genus belongs to the cashew family Anacardiaceae.", "Mangoes are native to South Asia, from where the \"common mango\" or \"Indian mango\", \"Mangifera indica\", has been distributed worldwide to become one of the most widely cultivated fruits in the tropics.", "Other \"Mangifera\" species (e.g. horse mango, \"Mangifera foetida\") are grown on a more localized basis.", "It is the national fruit of India, Pakistan, and the Philippines, and the national tree of Bangladesh.", "The English word \"mango\" (plural \"mangoes\" or \"mangos\") originated from the Malayalam word \"m\u0101\u1e45\u1e45a\" (or \"mangga\") via Dravidian \"mankay\" and Portuguese \"manga\" during the spice trade period with South India in the 15th and 16th centuries.", "Mango is mentioned by Hendrik van Rheede, the Dutch commander of the Malabar region in his 1678 book, \"Hortus Malabaricus\", about plants having economic value." ], [ "Saigon (mango)", "Saigon (mango)\n\nThe 'Saigon' mango is a seedling race of mango cultivars originally introduced to the United States via seed from Southeast Asia.", "Saigon seeds were shipped to the United States from Saigon, Cochinchina, in 1902 and planted at the USDA's plant introduction station in Miami, Florida, for observation.", "Edward Simmonds, the station's director, found the fruit to be of good quality\n\nSaigon trees mostly came true from seed, though there were some variation.", "This meant that multiple types of Saigon came into existence, and thus the name covers several varieties.", "Because of the positive qualities of the fruit, Saigon was utilized in Edward Simmonds hybridization experiment, which resulted in a cross between a Saigon and the Indian 'Amini' cultivar.", "The resulting cross was named 'Samini'.", "Saigon was also a parent of other mangoes in Florida as well, including the Florigon, whose name is a cross between the words \"Florida\" and \"Saigon\".", "Saigon was also claimed to be a parent of the 'Glenn' mango.", "Saigon trees are planted in the collections of the USDA's germplasm repository in Miami and the University of Florida's Tropical Research and Education Center in Homestead, Florida.", "The fruit have an oval to ovate shape with a pointed apex and often have a small lateral beak." ], [ "Plant variety (law)", "Plant variety (law)\n\nPlant variety is a legal term, following the International Union for the Protection of New Varieties of Plants (UPOV) Convention.", "Recognition of a cultivated plant (a cultivar) as a \"variety\" in this particular sense provides its breeder with some legal protection, so-called plant breeders' rights, depending to some extent on the internal legislation of the UPOV signatory countries, such as the Plant Variety Protection Act in the US.", "This \"variety\" (which will differ in status according to national law) should not be confused with the international\ntaxonomic rank of \"variety\" (regulated by the \"International Code of Nomenclature for algae, fungi, and plants\"), nor with the term \"cultivar\" (regulated by the \"International Code of Nomenclature for Cultivated Plants\").", "Some horticulturists use \"variety\" imprecisely; for example, viticulturists almost always refer to grape cultivars as \"grape varieties\"." ] ], "gold": "There are 283 types of mango in India, though only 30 are well-known. As the country's national fruit, mangoes have been cultivated in India since ancient times. \"Indian type\" mangoes make up one of two distinct types of modern mango cultivars, or cultivated varieties.", "prediction 1": "There are numerous varieties of mangoes in India, including the common mango and the Saigon mango. The Saigon mango is a seedling race of mango cultivars originally introduced to the United States via seed from Southeast Asia. Edward Simmonds, the station's director, found the fruit to be of good quality; this meant that multiple types of Saigon came into existence, and thus the name covers several varieties.", "prediction 2": "The number of mangoes in India varies, from one variety to more than 100 varieties. In India, there are six main types: Indian mango, Indian saigon, and Indian Amini. In South Asia, there are five major varieties of mango, from which one is called the Indian mango.", "prediction 3": "There are several different types of mangoes grown in India, including common mango, Saigon, Amini, Golden, and Golden Delicious. The common mango, also known as the Indian Mango, is the most widely used fruit in India and is considered to be the national fruit of South Asia. In contrast, the variety known as the Indian Mango, or the Indian Mango indica, is a seedling race of mango cultivars originally introduced to the United States via seed from Southeast Asia. This meant that multiple types of Saigon came into existence, and thus the name covers several varieties.", "prediction 4": "There are several types of mangoes in India. The common mango is the most commonly grown variety, while the Saigon variety is a seedling race of mango cultivars originally introduced to the United States via seed from Southeast Asia. The Indian Amini mango is a cross between a Saigon and the Saigon cultivar, which results in the name Samini.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 412 }, { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 98 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "There are numerous varieties of mangoes in India. It is the national fruit of India" }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who is number 10 on england soccer team?", "passages": [ [ "Wayne Rooney", "In his 106th England appearance, he equalled Charlton's record of 49 goals (also in 106 matches) on 5 September 2015 by scoring a penalty against San Marino.", "On 8 September 2015, Rooney broke Charlton's England goalscoring record, netting his 50th international goal from a penalty in a Euro 2016 qualifying match against Switzerland, at Wembley, in his 107th appearance for England, also equalling Ashley Cole as his country's fifth-highest capped player; this was also his 300th professional career goal.", "In England's opening match of Euro 2016 against Russia at the Stade V\u00e9lodrome in Marseille on 11 June, Rooney was selected to start in central midfield and was named man of the match by the BBC after a 1\u20131 draw.", "On 27 June, he scored the opening goal in a 2\u20131 defeat to Iceland from a penalty in the round of 16, which saw England eliminated from the tournament.", "On 4 September 2016, Rooney earned his 116th appearance for England in 1\u20130 away win over Slovakia in the 2018 FIFA World Cup qualifiers, making him the nation's most-capped outfield player of all time, and England's second highest appearance maker behind Peter Shilton.", "A few days earlier, he had confirmed that he would retire from international football after the finals in Russia." ], [ "Wayne Rooney", "Wayne Rooney\n\nWayne Mark Rooney (born 24 October 1985) is an English professional footballer who plays for Major League Soccer club D.C. United.", "He has played much of his career as a forward, and he has also been used in various midfield roles.", "He is the record goalscorer for the England national team and for Manchester United.", "At club level, he has won every honour available in English, European and Continental football, with the exception of the European Super Cup.", "Along with Michael Carrick, he is the only English player to win the Premier League, FA Cup, UEFA Champions League, League Cup, UEFA Europa League and FIFA Club World Cup.", "Rooney joined the Everton youth team at the age of 9, and made his professional debut for the club in 2002 at the age of 16.", "He spent two seasons at the Merseyside club, before moving to Manchester United for \u00a325.6\u00a0million in the 2004 summer transfer window.", "He won 16 trophies with the club, including five Premier League titles, the FA Cup and the Champions League in 2008.", "He scored 253 goals for United in all competitions to make him their top goalscorer of all time, with 183 Premier League goals being the most scored by a player for any single club.", "Rooney's 208 Premier League goals make him the Premier League's second top scorer of all time behind only Alan Shearer." ], [ "Wayne Rooney", "In the same month, Rooney scored two goals in an 8\u20133 aggregate Champions League quarter-final win over Roma and two more in the same competition at the end of April, in a 3\u20132 semi-final first leg victory over Milan.", "Rooney collected his first Premier League title winner's medal at the end of the 2006\u201307 season.", "He scored 14 league goals that season.", "In June 2007, Rooney was given squad number 10, last worn by Ruud van Nistelrooy.", "Rooney reasoned that he always loved that number.", "He fractured his left metatarsal in United's opening-day goalless draw against Reading on 12 August, the same injury he had suffered to his right foot in 2004.", "After being sidelined for six weeks, he returned and scored in United's 1\u20130 Champions League group stage win over Roma on 2 October.", "Rooney was again injured on 9 November, hurting his ankle during a training session and missing an additional two weeks.", "His next match after injury was against Fulham on 3 December, in which he played 70 minutes.", "Rooney missed ten games and finished the 2007\u201308 season with 18 goals (12 of them in the league), as United clinched the Premier League.", "In the Champions League's first-ever all-English final, United defeated league rivals Chelsea to win another trophy." ] ], "gold": "Wayne Rooney is an English professional football manager and former player. He spent much of his playing career as a forward while also being used in various midfield roles. Widely considered to be one of the best players of his generation, Rooney is the record goalscorer for both the England national team and Manchester United. Rooney was given the number 10 squad number because he loved the number and wore it in the 2008 European Championships, the 2010 FIFA World Cup, the 2012 European Championships, the 2014 FIFA World Cup, and the 2016 European Championships. Michael Owen wore the number 10 shirt in the 2006 FIFA World Cup.", "prediction 1": "Wayne Mark Rooney is an English professional footballer who plays for Major League Soccer club D.C. United. He is the record goalscorer for the England national team and for Manchester United. In June 2007, Rooney was given squad number 10, last worn by Ruud van Nistelrooy. Rooney reasoned that he always loved that number.", "prediction 2": "Wayne Rooney is a professional English footballer who plays for Major League Soccer club D.C. United and was selected to start in central midfield for the England national team. The number 10 jersey was last worn by Ruud van Nistelrooy during the 2007\u201308 season.", "prediction 3": "In June 2007, Wayne Rooney was given squad number 10 last worn by Ruud van Nistelrooy. In 2018, Wayne Rooney earned his 116th appearance for England in 1\u20130 away win over Slovakia in the 2018 FIFA World Cup qualifiers. In 2019, Ruud van Nistelrooy was given squad number 11 on england soccer team.", "prediction 4": "Wayne Rooney is the number 10 player on the England national soccer team. He is the record goalscorer for the national team and for Manchester United. In June 2007, Rooney was given squad number 10, last worn by Ruud van Nistelrooy. Rooney reasoned that he always loved that number.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 274 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Wayne Mark Rooney is an English professional footballer who plays for Major League Soccer club D.C. United. He has played much of his career as a forward, and he has also been used in various midfield roles. He is the record goalscorer for the England national team and for Manchester United. In June 2007, Rooney was given squad number 10, Rooney reasoned that he always loved that number." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did george gershwin write rhapsody in blue?", "passages": [ [ "Rhapsody in Blue", "He told his first biographer Isaac Goldberg in 1931:\nIt was on the train, with its steely rhythms, its rattle-ty bang, that is so often so stimulating to a composer\u00a0\u2013 I frequently hear music in the very heart of the noise...", "And there I suddenly heard, and even saw on paper\u00a0\u2013 the complete construction of the \"Rhapsody\", from beginning to end.", "No new themes came to me, but I worked on the thematic material already in my mind and tried to conceive the composition as a whole.", "I heard it as a sort of musical kaleidoscope of America, of our vast melting pot, of our unduplicated national pep, of our metropolitan madness.", "By the time I reached Boston I had a definite plot of the piece, as distinguished from its actual substance.", "Gershwin began his work on January 7 as dated on the original manuscript for two pianos.", "The piece was titled \"\"American Rhapsody\"\" during composition.", "The title \"Rhapsody in Blue\" was suggested by Ira Gershwin after his visit to a gallery exhibition of James McNeill Whistler paintings, which bear titles such as \"\" and \"Arrangement in Grey and Black\" (better known as \"Whistler's Mother\")." ], [ "Rhapsody in Blue", "Rhapsody in Blue\n\nRhapsody in Blue is a 1924 musical composition by American composer George Gershwin for solo piano and jazz band, which combines elements of classical music with jazz-influenced effects.", "The composition was commissioned by bandleader Paul Whiteman.", "It was orchestrated by Ferde Grof\u00e9 several times, including the original 1924 scoring, the 1926 \"theater orchestra\" setting, and the 1942 symphony orchestra scoring, though completed earlier.", "The piece received its premiere in the concert, \"An Experiment in Modern Music\", which was held on February 12, 1924, in Aeolian Hall, New York, by Whiteman and his band with Gershwin playing the piano.", "The editors of the Cambridge Music Handbooks opined that \"The \"Rhapsody in Blue\" (1924) established Gershwin's reputation as a serious composer and has since become one of the most popular of all American concert works.\"", "After the success of an experimental classical-jazz concert held with French-Canadian singer Eva Gauthier at Aeolian Hall (New York) on November 1, 1923, band leader Paul Whiteman decided to attempt something more ambitious.", "He asked Gershwin to contribute a concerto-like piece for an all-jazz concert he would give in Aeolian Hall in February 1924." ] ], "gold": "\"Rhapsody in Blue\" is a musical composition written by George Gershwin for solo piano and jazz band, which combines elements of classical music with jazz-influenced effects. Commissioned by Paul Whiteman, Gershwin began his work on January 7, 1924 as dated on the original manuscript for two pianos, finishing his composition after a few weeks and passing the score to Whiteman's arranger Ferde Grof\u00e9, who orchestrated the piece, finishing it on February 4. It premiered eight days later in a concert titled \"An Experiment in Modern Music\" in Aeolian Hall, New York City.", "prediction 1": "George Gershwin wrote Rhapsody in Blue on January 7, 1924. The piece was commissioned by bandleader Paul Whiteman and received its premiere in the concert, An Experiment in Modern Music, which was held on February 12, 1924, in Aeolian Hall, New York, by Whiteman and his band with Gershwin playing the piano. The composer used a combination of classical music and jazz-influenced effects to create a musical kaleidoscope of American life.", "prediction 2": "Rhapsody in Blue is a musical composition by American composer George Gershwin for solo piano and jazz band, which combines elements of classical music with jazz-influenced effects. The piece received its premiere in the concert, An Experiment in Modern Music, which was held on February 12, 1924, in Aeolian Hall, New York, by Whiteman and his band with Gershwin playing the piano. After the success of an experimental classical-jazz concert held with French-Canadian singer Eva Gauthier at Aeolian Hall, New York, band leader Paul Whiteman asked Gershwin to contribute a concerto-like piece for an all-jazz concert he would give in Aeolian Hall in Aeolian Hall in February 1924.", "prediction 3": "George Gershwin wrote Rhapsody in Blue in 1924, for piano and jazz band. The composition was commissioned by Paul Whiteman and combines elements of classical music with jazz-influenced effects. The piece received its premiere in the concert, An Experiment in Modern Music, which was held on February 12, 1924, in Aeolian Hall, New York, by Whiteman and his band with Gershwin playing the piano.", "prediction 4": "George Gershwin wrote Rhapsody in Blue in 1924, for solo piano and jazz band. The musical composition was commissioned by bandleader Paul Whiteman. The piece received its premiere at an all-jazz concert given by Whiteman and his band on February 12, 1924.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 16, "end": 21 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 438 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "George Gershwin began Rhapsody in Blue on January 7, 1924, as dated on the original manuscript for two pianos. It was for solo piano and jazz band, which combines elements of classical music with jazz-influenced effects. The piece was commissioned by bandleader Paul Whiteman and received its premiere in the concert, An Experiment in Modern Music, which was held on February 12, 1924, in Aeolian Hall, New York. It was orchestrated by Ferde Grof\u00e9." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What type of stone did the romans use?", "passages": [ [ "Ancient Roman architecture", "From Augustus' reign the quarries at Carrara were extensively developed for the capital, and other sources around the empire exploited, especially the prestigious Greek marbles like Parian.", "Travertine limestone was found much closer, around Tivoli, and was used from the end of the Republic; the Colosseum is mainly built of this stone, which has good load-bearing capacity, with a brick core.", "Other more or less local stones were used around the empire.", "The Romans were extremely fond of luxury imported coloured marbles with fancy veining, and the interiors of the most important buildings were very often faced with slabs of these, which have usually now been removed even where the building survives.", "Imports from Greece for this purpose began in the 2nd century BC.", "The Romans made fired clay bricks from about the beginning of the Empire, replacing earlier sun-dried mud-brick.", "Roman brick was almost invariably of a lesser height than modern brick, but was made in a variety of different shapes and sizes.", "Shapes included square, rectangular, triangular and round, and the largest bricks found have measured over three feet in length.", "Ancient Roman bricks had a general size of 1\u00bd Roman feet by 1 Roman foot, but common variations up to 15 inches existed.", "Other brick sizes in ancient Rome included 24\" x 12\" x 4\", and 15\" x 8\" x 10\"." ] ], "gold": "Marble is not found especially close to Rome, and was only rarely used there before Augustus, who famously boasted that he had found Rome made of brick and left it made of marble, though this was mainly as a facing for brick or concrete. Travertine limestone was found much closer, around Tivoli, and was used from the end of the Republic. The Colosseum is mainly built of this stone, which has good load-bearing capacity, with a brick core.", "prediction 1": "The Romans used a variety of stone types in their architecture, including: marble, travertine, limestone, and other imported materials. Stones used in the Colosseum included Travertine and a variety of local stones.", "prediction 2": "The Romans made fired clay bricks from about the beginning of the Empire, replacing earlier sun-dried mud-brick. The Colosseum is mainly built of Travertine limestone from the end of the Republic. Other more or less local stones were used around the empire.", "prediction 3": "The Romans used a variety of stone types, but the majority was travertine which was used from the end of the Republic. Travertine limestone was found much closer, around Tivoli, and was used from the end of the Republic; the Colosseum is mainly built of this stone, which has good load-bearing capacity, with a brick core. Other more or less local stones were used around the empire. The Romans were extremely fond of luxury imported coloured marbles with fancy veining, and the interiors of the most important buildings were very often faced with slabs of these, which have usually now removed even where the building survives.", "prediction 4": "The Romans used a variety of stone types in their architecture, including: marble, limestone, travertine, limestone with fancy veining, and brick. The Colosseum is mainly built of this stone.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 215 } ], "missing-info": [], "corrected-prediction": "The Romans used a variety of stone types in their architecture, including: marble, travertine, limestone, and other imported materials. Travertine limestone was found much closer, around Tivoli, and was used from the end of the Republic; the Colosseum is mainly built of this stone, which has good load-bearing capacity, with a brick core." }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "Where does one look to find the powers of a corporation?", "passages": [ [ "United States corporate law", "United States corporate law\n\nUnited States corporate law regulates the governance, finance and power of corporations in US law.", "Every state and territory has its own basic corporate code, while federal law creates minimum standards for trade in company shares and governance rights, found mostly in the Securities Act of 1933 and the Securities and Exchange Act of 1934, as amended by laws like the Sarbanes-Oxley Act of 2002 and the Dodd-Frank Act of 2010.", "The US Constitution was interpreted by the US Supreme Court to allow corporations to incorporate in the state of their choice, regardless of where their headquarters are.", "Over the 20th century, most major corporations incorporated under the Delaware General Corporation Law, which offered lower corporate taxes, fewer shareholder rights against directors, and developed a specialized court and legal profession.", "Nevada has done the same.", "Twenty-four states follow the Model Business Corporation Act, while New York and California are important due to their size.", "At the Declaration of Independence, corporations had been unlawful without explicit authorization in a Royal Charter or an Act of Parliament of the United Kingdom.", "Since the world's first stock market crash (the South Sea Bubble of 1720) corporations were perceived as dangerous.", "This was because, as the economist Adam Smith wrote in \"The Wealth of Nations\" (1776), directors managed \"other people's money\" and this conflict of interest meant directors were prone to \"negligence and profusion\"." ], [ "History of corporate law in the United States", "History of corporate law in the United States\n\nThe history of corporate law in the United States concerns the development of the corporation, primarily as a business organization, under the different United States corporate law, including federal regulation.", "Prior to the late 19th century, most companies were incorporated by a special bill adopted by legislature.", "By the end of the 18th century, there were about 300 incorporated companies in the United States, most of them providing public services, and only eight manufacturing companies.", "The formation of a corporation usually required an act of legislature.", "State enactment of corporation laws, which was becoming more common by the 1830s, allowed companies to incorporate without securing the adoption of a special legislative bill.", "However, given the restrictive nature of state corporation laws, many companies preferred to seek a special legislative act for incorporation to attain privileges or monopolies, even until the late nineteenth century.", "In 1819, the U.S. Supreme Court granted corporations rights they had not previously recognized in \"Trustees of Dartmouth College v. Woodward\".", "The Supreme Court declared that a corporation is not transformed into civil institution just because the government commissioned its corporate charter; and, accordingly, it deemed corporate charters \"inviolable\" and not subject to arbitrary amendment or abolition by state governments.", "New York was the first state to enact a corporate statute in 1811." ] ], "gold": "Generally, in all parts of the world, one look to find the powers of a corporation in Corporate law, but in the United States it can be found in the United states corporate law.", "prediction 1": "The United States corporate law regulates the governance, finance and power of corporations in US law. Every state and territory has its own basic corporate code, while federal law creates minimum standards for trade in company shares and governance rights, found mostly in the Securities Act of 1933 and the Securities and Exchange Act of 1934, as amended by laws like the Sarbanes-Oxley Act of 2002 and the Dodd-Frank Act of 2010. The US Constitution was interpreted by the US Supreme Court to allow corporations to incorporate in the state of their choice, regardless of where their headquarters are.", "prediction 2": "In the United States, corporate law regulates the governance, finance and power of corporations in US law. Every state and territory has its own basic corporate code, while federal law creates minimum standards for trade in company shares and governance rights, found mostly in the Securities Act of 1933 and the Securities and Exchange Act of 1934, as amended by laws like the Sarbanes-Oxley Act of 2002 and the Dodd-Frank Act of 2010. The US Constitution was interpreted by the US Supreme Court to allow corporations to incorporate in the state of their choice, regardless of where their headquarters are located.", "prediction 3": "Every state and territory has its own basic corporate code, and federal law creates minimum standards for trade in company shares and governance rights, found mostly in the Securities Act of 1933 and the Securities and Exchange Act of 1934, as amended by laws like the Sarbanes-Oxley Act of 2002 and the Dodd-Frank Act of 2010. The US Constitution was interpreted by the US Supreme Court to allow corporations to incorporate in the state of their choice, regardless of where their headquarters are. The history of corporate law in the United States concerns the development of the corporation, primarily as a business organization, primarily as a business organization, under the different United States corporate law, including federal regulation. The history of corporate law in the United States concerns the development of the corporation, primarily as a business organization, primarily as a business organization, primarily as a business organization,", "prediction 4": "Every state and territory has its own basic corporate code, while federal law creates minimum standards for trade in company shares and governance rights, found mostly in the Securities Act of 1933 and the Securities and Exchange Act of 1934, as amended by laws like the Sarbanes-Oxley Act of 2002 and the Dodd-Frank Act of 2010. The US Constitution was interpreted by the US Supreme Court to allow corporations to incorporate in the state of their choice, regardless of where their headquarters are. Twenty-four states follow the Model Business Corporation Act, while New York and California are important due to their size. The history of corporate law in the United States concerns the development of the development of the corporation, primarily as a business organization, primarily as a business organization, primarily as a business organization, primarily as a business organization, primarily as a business organization, primarily as a business organization,", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 432 }, { "error type": "Irrelevant", "explanation": "", "start": 433, "end": 603 } ], "missing-info": [], "corrected-prediction": "The United States corporate law regulates the governance, finance and power of corporations in US law. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "What was the great pyramid of giza made out of?", "passages": [ [ "Great Pyramid of Giza", "The Great Pyramid consists of an estimated 2.3\u00a0million blocks which most believe to have been transported from nearby quarries.", "The Tura limestone used for the casing was quarried across the river.", "The largest granite stones in the pyramid, found in the \"King's\" chamber, weigh 25 to 80 tonnes and were transported from Aswan, more than away.", "Traditionally, ancient Egyptians cut stone blocks by hammering into them wooden wedges, which were then soaked with water.", "As the water was absorbed, the wedges expanded, causing the rock to crack.", "Once they were cut, they were carried by boat either up or down the Nile River to the pyramid.", "It is estimated that 5.5\u00a0million tonnes of limestone, 8,000 tonnes of granite (imported from Aswan), and 500,000 tonnes of mortar were used in the construction of the Great Pyramid.", "At completion, the Great Pyramid was surfaced by white \"casing stones\"\u2014slant-faced, but flat-topped, blocks of highly polished white limestone.", "These were carefully cut to what is approximately a face slope with a seked of 5 palms to give the required dimensions.", "Visibly, all that remains is the underlying stepped core structure seen today." ] ], "gold": "The Great Pyramid of Giza's internal structure was made out of Granite while the outside was made of White Limestone.", "prediction 1": "The Great Pyramid of Giza consists of an estimated 2.3 million blocks, which most believe to have been transported from nearby quarries. The Tura limestone used for the casing was quarried across the river. The largest granite stones in the pyramid, found in the \"King's\" chamber, weigh 25 to 80 tonnes and were transported from Aswan, more than away.", "prediction 2": "The Great Pyramid consists of an estimated 2.3 million blocks which most believe to have been transported from nearby quarries. The Tura limestone used for the casing was quarried across the river. The largest granite stones in the pyramid, found in the \"King's\" chamber, weigh 25 to 80 tonnes and were transported from Aswan, more than away.", "prediction 3": "The Great Pyramid of Giza is constructed of 5.3 million tonnes of limestone, 8,000 tonnes of granite, and 500,000 tonnes of mortar. The Tura limestone used for the casing was quarried across the river. At completion, the Great Pyramid was surfaced by white \"casing stones\"\u2014slant-faced, but flat-topped, blocks of highly polished white limestone. These were carefully cut to what is approximately a face slope with a seked of 5 palms to give the required dimensions.", "prediction 4": "The Great Pyramid of Giza is the largest pyramid in the world made out of stone, whose interior consists of 2.3 million blocks. At completion, the Great Pyramid was surfaced by white \"casing stones\"\u2014slant-faced, but flat-topped, blocks of highly polished white limestone. Tura limestone used for the casing was quarried across the river. The largest granite stones in the pyramid, found in the \"King's\" chamber, weigh 25 to 80 tonnes and were transported from Aswan, more than away.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 351 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Great Pyramid of Giza consists of the Tura (white) limestone used for the casing and granite stones found in the pyramid. It is estimated that 5.5 million tonnes of limestone, 8,000 tonnes of granite and 500,000 tonnes of mortar were used in the construction of the Great Pyramid." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who sings the original some kind of wonderful?", "passages": [ [ "Some Kind of Wonderful (The Drifters song)", "Some Kind of Wonderful (The Drifters song)\n\n\"Some Kind of Wonderful\" is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961.", "(It is not related to another song of the same name which was written by John Ellison and first released by Soul Brothers Six in 1967).", "The Drifters' original recording of the Goffin/King song reached No. 32 on the US \"Billboard\" pop chart and No. 6 on the US \"Billboard\" R&B chart.", "Notable covers include versions by Marvin Gaye (1967), Jay and the Americans (1970), Carole King (1971), Peter Cincotti (2004), Aled Jones featuring Cerys Matthews (2007), and Michael Bubl\u00e9 on the deluxe editions of his fourth studio album, \"Crazy Love\" (2010).", "On the double album \"The Drifters 24 Original Hits\" (UK, 1975, Atlantic Records), the song is mistakenly credited to John Ellison.", "Conversely, on the Q-Tips' self-titled debut album (UK, 1980, Chrysalis Records), the Ellison song is mistakenly credited to Goffin and King" ], [ "Some Kind of Wonderful (Soul Brothers Six song)", "Some Kind of Wonderful (Soul Brothers Six song)\n\n\"(She's) Some Kind of Wonderful\" is a song written by John Ellison and first recorded by his group, Soul Brothers Six, in 1967, peaking at number 91 on the U.S. \"Billboard\" Hot 100.", "The best known version is by Grand Funk Railroad from 1974 which reached number 3 on the same chart.", "In 1974, Grand Funk Railroad recorded the song for the group's album \"All the Girls in the World Beware!!!\"", "Reaching number three on the \"Billboard\" Hot 100 on February 22, 1975, it was an indisputable hit and thusly became one of the band's best known songs.", "It also ranked number 74 on Billboard's Hot 100 year-end chart for 1975 (but the December 27, 1975, print edition of \"Billboard\", which contained the Hot 100 for 1975 that Casey Kasem followed, erred in placing it at #6 and in placing all the songs from #6 through #73 one position lower apiece).", "Their version of the song appeared in the video game \"\" on the fictitious radio station K-DST." ] ], "gold": "\"Some Kind of Wonderful\" is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961. The Drifters' original recording of the Goffin/King song reached No. 32 on the US Billboard pop chart and No. 6 on the US Billboard R&B chart. \"(She's) Some Kind of Wonderful\" is also a song written by John Ellison and first recorded by his group, Soul Brothers Six, in 1967, peaking at number 91 on the U.S. Billboard Hot 100. The best known version is by Grand Funk Railroad from 1974 which reached number 3 on the same chart.", "prediction 1": "\"Some Kind of Wonderful\" is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961. It is not related to another song of the same name, which was written by John Ellison and first released by Soul Brothers Six in 1967. Notable covers include versions by Marvin Gaye in 1967, Jay and the Americans in 1970, Carole King in 1971, Peter Cincotti in 2004, and Aled Jones featuring Cerys Matthews in 2007.", "prediction 2": "The Drifters sing the original Some Kind of Wonderful. The original Some Kind of Wonderful is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961. It is not related to another song of the same name that was written by John Ellison and first released by Soul Brothers Six in 1967. The best known version is by Grand Funk Railroad from 1974 which reached number 3 on the same chart.", "prediction 3": "The Drifters released the original \"Some Kind of Wonderful\" in 1961. In 1967, \"(She's) Some Kind of Wonderful\" was a song written by John Ellison and first recorded by his group, Soul Brothers Six, peaking at number 91 on the U.S. Billboard Hot 100. The best known version of this song is by Grand Funk Railroad in 1974, peaking at number 3 on the same chart.", "prediction 4": "The Drifters released some kind of wonderful in 1961. Also, \"(She's) Some Kind of Wonderful\" is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961. The best known version is by Grand Funk Railroad from 1974 which reached number 3 on the same chart.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 431 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Some Kind of Wonderful\" is a song by Gerry Goffin and Carole King that was first released by the Drifters in 1961. The Drifters' original recording of the Goffin/King song reached No. 32 on the US \"Billboard\" pop chart and No. 6 on the US \"Billboard\" R&B chart. It is not related to another song of the same name, which was written by John Ellison and first released by Soul Brothers Six in 1967. \"(She's) Some Kind of Wonderful\" peaked at number 91 on the U.S. \"Billboard\" Hot 100. The best known version is by Grand Funk Railroad from 1974 which reached number 3 on the same chart." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "In a republican state the head of the state is?", "passages": [ [ "Head of state", "Head of state\n\nA head of state (or chief of state) is the public persona that officially represents the national unity and legitimacy of a sovereign state.", "Depending on the country's form of government and separation of powers, the head of state may be a ceremonial figurehead or concurrently the head of government.", "In the parliamentary system the head of state is the \"de jure\" leader of the nation, because the leader \"de facto\" is the prime minister.", "In contrast, the semi-presidential system has both heads of state and government as the leaders \"de facto\" of the nation (in practice they divide the leadership of the nation among themselves).", "In countries with parliamentary systems, the head of state is typically a ceremonial figurehead that does not actually guide day-to-day government activities or is not empowered to exercise any kind of political authority.", "In countries where the head of state is also the head of government, the head of state serves as both a public figurehead and the actual highest-ranking political leader who oversees the executive branch (e.g., the President of Brazil).", "Former French president Charles de Gaulle, while developing the current Constitution of France (1958), said the head of state should embody \"\" (\"the spirit of the nation\").", "Some academic writers discuss states and governments in terms of \"models\"." ], [ "Republic", "These states are parliamentary republics and operate similarly to constitutional monarchies with parliamentary systems where the power of the monarch is also greatly circumscribed.", "In parliamentary systems the head of government, most often titled prime minister, exercises the most real political power.", "Semi-presidential systems have a president as an active head of state, but also have a head of government with important powers.", "The rules for appointing the president and the leader of the government, in some republics permit the appointment of a president and a prime minister who have opposing political convictions: in France, when the members of the ruling cabinet and the president come from opposing political factions, this situation is called cohabitation.", "In some countries, like Switzerland, Bosnia and Herzegovina and San Marino, the head of state is not a single person but a committee (council) of several persons holding that office.", "The Roman Republic had two consuls, elected for a one-year term by the \"comitia centuriata\", consisting of all adult, freeborn males who could prove citizenship.", "In liberal democracies presidents are elected, either directly by the people or indirectly by a parliament or council.", "Typically in presidential and semi-presidential systems the president is directly elected by the people, or is indirectly elected as done in the United States." ], [ "Republic", "The 20th century saw republicanism become an important idea in much of the Middle East, as monarchies were removed in many states of the region.", "Iraq became a secular state.", "Some nations, such as Indonesia and Azerbaijan, began as secular.", "In Iran, the 1979 revolution overthrew the monarchy and created an Islamic republic based on the ideas of Islamic democracy.", "With no monarch, most modern republics use the title president for the head of state.", "Originally used to refer to the presiding officer of a committee or governing body in Great Britain the usage was also applied to political leaders, including the leaders of some of the Thirteen Colonies (originally Virginia in 1608); in full, the \"President of the Council\".", "The first republic to adopt the title was the United States of America.", "Keeping its usage as the head of a committee the President of the Continental Congress was the leader of the original congress.", "When the new constitution was written the title of President of the United States was conferred on the head of the new executive branch.", "If the head of state of a republic is also the head of government, this is called a presidential system.", "There are a number of forms of presidential government.", "A full-presidential system has a president with substantial authority and a central political role.", "In other states the legislature is dominant and the presidential role is almost purely ceremonial and apolitical, such as in Germany and India." ] ], "gold": "A head of state is the public persona who officially embodies a state in its unity and legitimacy. In most republics the President is the head of state. In republics with a non-dominant executive role, the head of state is usually the Prime Minister. In some republics without a single leader, consuls may form the head of state.", "prediction 1": "A head of state is the public persona that officially represents the national unity and legitimacy of a sovereign state. In a republic the head of state is the \"de jure\" leader of the nation, while in a semi-presidential system the head of state is simultaneously the head of government.", "prediction 2": "In republics, the head of state is the presiding officer of a committee or governing body. In parliamentary republics, the head of state is the \"de jure\" leader of the nation, because the leader \"de facto\" is the prime minister. In countries where the head of state is also the head of government, the head of state serves as both a public figurehead and the actual highest-ranking political leader who oversees the executive branch. In the United States, the head of state is the President of the new constitution.", "prediction 3": "A head of state is a public persona that officially represents the national unity and legitimacy of a sovereign state. Depending on the country's form of government and separation of powers, the head of state may be a ceremonial figurehead or concurrently the head of government. In parliamentary republics, the head of state is the \"de jure\" leader of the nation, because the leader \"de facto\" is the prime minister. In countries where the head of state is also the head of government, the head of state serves as both a public figurehead and the actual highest-ranking political leader who oversees the executive branch. In countries where the head of state is not a single person but a committee (council) of several persons holding that office, the head of state is not a single person but a single person but a committee (council) of several persons holding that office.", "prediction 4": "The head of state of a republic may be a ceremonial figurehead or concurrently the head of government. In a parliamentary republic, the head of state is the \"de jure\" leader of the nation, while in a semi-presidential republic the head of state is the head of government. In a republic, the head of state is a committee of several persons holding that office. In a republican state, the head of state is the head of the executive branch.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "A head of state is the public persona that officially represents the national unity and legitimacy of a sovereign state. In a republic the head of state is the \"de jure\" leader of the nation, while in a semi-presidential system the head of state is simultaneously the head of government. In some countries, the head of state is not a single person but a committee (council) of several persons holding that office." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How many seasons of andy griffith show are there?", "passages": [ [ "The Andy Griffith Show", "The Andy Griffith Show\n\nThe Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons\u2014159 in black and white and 90 in color.", "The series partially originated from an episode of \"The Danny Thomas Show\".", "The show starred Andy Griffith in the role of Andy Taylor, the widowed sheriff of the fictional small community of Mayberry, North Carolina.", "Other major characters include Andy's inept but well-meaning deputy, Barney Fife (Don Knotts); Andy's spinster aunt and housekeeper, Bee Taylor (Frances Bavier), and Andy's precocious young son, Opie (Ron Howard).", "Eccentric townspeople and temperamental girlfriends complete the cast.", "Regarding the tone of the show, Griffith said that despite a contemporary setting, the show evoked nostalgia, saying in a \"Today Show\" interview: \"Well, though we never said it, and though it was shot in the '60s, it had a feeling of the '30s.", "It was, when we were doing it, of a time gone by.\"", "The show also avoided unfavorable cultural aspects of this period, such as racism and segregation, by simply avoiding these topics with the all-white cast never encountering such situations." ], [ "Mayberry R.F.D.", "Mayberry R.F.D. Mayberry R.F.D. is an American television series produced as a spin-off and direct continuation of \"The Andy Griffith Show\".", "When star Andy Griffith decided to leave his series, most of the supporting characters returned for the retitled program, which ran for three seasons (78 episodes) on the CBS Television Network from 1968\u20131971.", "During the final season of \"The Andy Griffith Show\", widower farmer Sam Jones (Ken Berry) and his young son Mike (Buddy Foster) are introduced and gradually become the show's focus.", "Sheriff Andy Taylor takes a backseat in the storylines, establishing the new premise.", "The show's first episode, \"Andy and Helen's Wedding\", had the highest ratings in recorded television history (up to premiere date in 1968).", "Sheriff Taylor and newlywed wife Helen make guest appearances on \"Mayberry R.F.D.\" until late 1969 and then relocate with Opie.", "\"Mayberry R.F.D.\" (which stands for Rural Free Delivery) was popular throughout its entire run, but was canceled after its third season in CBS's \"rural purge\" of 1971.", "Father and son stories involving Sam and Mike Jones are reminiscent of the episodes that starred Andy Griffith." ] ], "gold": "The original The Andy Griffith Show ran from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning 8 seasons. Mayberry R.F.D. is a spin-off continuation of The Andy Griffith Show, which ran for 3 seasons (78 episodes) from 1968 to 1971. The show didn't star Andy Griffith, but most of the supporting characters returned for the retitled program. Together, The Andy Griffith Show and Mayberry R.F.D. ran for 11 seasons.", "prediction 1": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons. There are several other Andy Griffith shows. The Andy Griffith Show had eight seasons. The Andy Griffith Show had three seasons.\n", "prediction 2": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons, 159 in black and white and 90 in color. The show starred Andy Griffith in the role of Andy Taylor, the widowed sheriff of the fictional small community of Mayberry, North Carolina. During the final season of \"The Andy Griffith Show\", widower farmer Sam Jones (Ken Berry) and his young son Mike (Buddy Foster) are introduced and gradually become the show's focus.", "prediction 3": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons. There are a total of 3 spin offs and a total of 38 episodes in black and white. The first spin off, Mayberry R.F.D., followed Andy Griffith's death in April 1968 at age 49.", "prediction 4": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons\u2014159 in black and white and 90 in color. The show starred Andy Griffith in the role of Andy Taylor, the widowed sheriff of the fictional small town Mayberry, North Carolina. Mayberry R.F.D. is an American television series produced as a spin-off and direct continuation of The Andy Griffith Show that ran for three seasons (1968) on the CBS Television Network from 1968-1971.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 23, "end": 73 }, { "error type": "Redundant", "explanation": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons. ", "start": 227, "end": 268 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 296, "end": 311 }, { "error type": "Unverifiable", "explanation": "", "start": 192, "end": 205 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons. Mayberry R.F.D. is an a spin-off and direct continuation of \"The Andy Griffith Show\". It ran for three seasons (78 episodes) from 1968 to 1971. When star Andy Griffith decided to leave his series, most of the supporting characters returned for the retitled program. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When's the last time dallas won a playoff game?", "passages": [], "gold": "The last time the Dallas Cowboys won a playoff game was on January 5, 2019. The last time the Dallas Stars won a playoff game was April 22, 2019. ", "prediction 1": "The last time Dallas won a playoff game was on September 19, 1996.", "prediction 2": "The last time Dallas won a playoff game was in 2009.", "prediction 3": "The last time Dallas won a playoff game was in 2008.", "prediction 4": "Since the last time Dallas won a playoff game, it has been on or about April 23, 2010.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 66 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who won the men's college basketball championship last year?", "passages": [ [ "NCAA Division I Men's Basketball Tournament", "NCAA Division I Men's Basketball Tournament\n\nThe NCAA Division I Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship.", "The tournament was created in 1939 by the National Association of Basketball Coaches, and was the idea of The Ohio State University coach Harold Olsen.", "Played mostly during March, it has become one of the most famous annual sporting events in the United States.", "The tournament teams include champions from 32 Division I conferences (which receive automatic bids), and 36 teams which are awarded at-large berths.", "These \"at-large\" teams are chosen by an NCAA selection committee, then announced in a nationally televised event on the Sunday preceding the \"First Four\" play-in games, currently held in Dayton, Ohio, and dubbed \"Selection Sunday\".", "The 68 teams are divided into four regions and organized into a single-elimination \"bracket\", which pre-determines, when a team wins a game, which team it will face next.", "Each team is \"seeded\", or ranked, within its region from 1 to 16.", "After the First Four, the tournament occurs during the course of three weekends, at pre-selected neutral sites across the United States." ], [ "Mike Krzyzewski", "Mike Krzyzewski\n\nMichael William Krzyzewski ( ; nicknamed \"Coach K\"; born February 13, 1947) is an American college basketball coach and former player.", "Since 1980, he has served as the head men's basketball coach at Duke University, where he has led the Blue Devils to five NCAA Championships, 12 Final Fours, 12 ACC regular season titles, and 14 ACC Tournament championships.", "Among men's college basketball coaches, only UCLA's John Wooden, with 10, has won more NCAA Championships.", "Krzyzewski was also the coach of the United States men's national basketball team, which he has led to three gold medals at the 2008 Summer Olympics, 2012 Summer Olympics, and 2016 Summer Olympics.", "He served as the head coach of the American team that won gold medals at the 2010 and the 2014 FIBA World Cup.", "He was also an assistant coach for the 1992 \"Dream Team\".", "Krzyzewski was a point guard at Army from 1966 to 1969 under coach Bob Knight.", "From 1975 to 1980, he was the head basketball coach for his alma mater.", "He is a two-time inductee into the Naismith Memorial Basketball Hall of Fame, in 2001 for his individual coaching career and in 2010 as part of the collective induction of the \"Dream Team\"." ], [ "Mike Krzyzewski", "On January 25, 2015, Krzyzewski won his 1,000th game, when Duke defeated St. John's in Madison Square Garden.", "He is the first men's coach to win 1,000 NCAA Division I basketball games.", "On April 6, 2015, Krzyzewski won his 5th NCAA championship, when Duke defeated Wisconsin in the title game.", "Winning against Yale in the 2016 NCAA tournament on March 19, Krzyzewski became the all-time winningest coach in the NCAA Division I tournament with 90 total wins.", "On November 11, 2017, Krzyzewski won his 1,000th game with the Duke Blue Devils, making him the first head coach to win 1,000 games with one NCAA Division I men's basketball program.", "On March 17, 2018, Krzyzewski won his 1,099th game in his career, passing Pat Summitt for most wins by a Division I coach, male or female.", "Krzyzewski has won three consecutive gold medals in the Olympics among several appearances as head coach of the USA men's national team." ] ], "gold": "The National Collegiate Athletic Association Division I Men's Basketball Tournament is a single-elimination tournament for men's college basketball teams in the United States which determines the champion of Division I, the top level of play in the NCAA. In 2015, the tournament was won by Duke, led by coach Mike Krzyzewski, has led the team to five NCAA Division I titles, 12 Final Fours, 15 ACC Men's Basketball Tournament championships, and 12 ACC regular season titles. In 2016, Villanova won the championship, led by coach Jay Wright, who led the team to a total of 14 NCAA Tournament appearances in his 19 seasons as head coach and also helped them win the 2018 NCAA Championship. In 2017, North Carolina won the championship, led by coach Roy Williams, who is one of six NCAA Men's Division I college basketball coaches to have won at least three national championships.", "prediction 1": "The NCAA Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States. The 2014 NCAA Men's Basketball Championship was won by the Iowa State Wildcats, while the 2015 NCAA Men's Basketball Championship was won by the Georgia Bulldogs.", "prediction 2": "The NCAA Division I Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship. In 2013, the Duke Blue Devils defeated the Wisconsin Badgers in the title game. In 2014, the Kentucky Wildcats defeated the Kentucky Wildcats in the championship game. In 2015, the Duke Blue Devils won the men's NCAA championship. In 2013, the Kentucky Sparts defeated the University Bulldogs in the championship. In 2016, the Duke Blue Devils defeated the University of Michigan State in the championship.", "prediction 3": "The NCAA Division I Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship. Mike Krzyzewski, who has been the head men's basketball coach at Duke University since 1980, won the men's basketball championship in 2017, 2018, and 2019. On January 25, 2015, Krzyzewski won his 5th NCAA Championship, when Duke defeated St. John's in the title game. On April 6, 2015, Krzyzewski won his 5th NCAA championship, when Duke defeated Wisconsin in the title game. On April 6, 2015, Krzyzewski won his 6th NCAA championship, when Duke defeated St. John Wooden, in the final Four. On April 6, 2015", "prediction 4": "The NCAA Division I Men's Basketball Tournament, also known and branded as NCAA March Madness, is a tournament played each spring in the United States, featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship. In 2019, Wisconsin defeated Michigan State, Indiana defeated Kentucky, and Kentucky defeated Indiana. In 2018, the University of Tennessee defeated the University of Minnesota and Iowa defeated the University of South Dakota.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 83 }, { "error type": "Unverifiable", "explanation": "", "start": 160, "end": 239 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 305, "end": 322 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The NCAA Division I Men's Basketball Tournament, is a single-elimination tournament played each spring in the United States to determine the national Division I championship. The 2015 NCAA Men's Basketball Championship was won by by Duke, led by coach Mike Krzyzewski, who has led the team to five NCAA Division I titles, 12 Final Fours, 14 ACC Men's Basketball Tournament championships, and 12 ACC regular season titles." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "How long does a self-winding watch stay wound?", "passages": [ [ "Automatic watch", "When fully wound, Harwood's watch would run for 12 hours autonomously.", "It did not have a conventional stem winder, so the hands were moved manually by rotating a bezel around the face of the watch.", "The watches were first produced with the help of Swiss watch manufacturer Fortis and went on sale in 1928.", "30,000 were made before the Harwood Self-Winding Watch Company collapsed in 1931 in the Great Depression.", "'Bumper' watches were the first commercially successful automatic watches; they were made by several high grade watch manufacturers during the 1930s and 1940s.", "The Rolex Watch Company improved Harwood's design in 1930 and used it as the basis for the Rolex Oyster Perpetual, in which the centrally mounted semi-circular weight could rotate through a full 360\u00b0 rather than the about 200\u00b0 of the 'bumper' winder.", "Rolex's version also increased the amount of energy stored in the mainspring, allowing it to run autonomously for up to 35 hours.", "Information about 18th century rotor watches was not published until 1949.", "Although the Oyster Perpetual was probably an original invention, the company may have known of Coviot's 1893 patent that re-invented the 18th century design.", "The next development for automatic watches came in 1948 from Eterna Watch.", "To wind a watch effectively, one of the chief requirements of a rotor is heft." ], [ "Chinese standard movement", "On any day there are thousands of Standard movement watches for sale on the internet and in shopping malls throughout the developed world.", "The standard movement was designed to have fewer parts than other similar movements, so that it was easier to produce and service, while at the same time maintaining high accuracy and reliability.", "The basic specification of the Standard wristwatch caliber is a minimum of 17 jewels, 21,600 bph (beats per hour) escapement, a minimum 40-hour power reserve and an average rate within +/-30 seconds per day.", "The movement is manufactured in a number of grades (from high to low) in both automatic and manual-winding or automatic forms.", "Initially manufactured exclusively by Chinese companies (i.e. state-controlled watch manufacturers), variants of the Chinese Standard Movement can be found in all grades and both forms, including in a number of watches whose marques are not Chinese but are still manufactured in China." ] ], "gold": "The length a self-winding watch can stay wound depends on the type of watch. When fully wound, Harwood's watch would run for 12 hours autonomously. Rolex Oyster Perpetual from 1930 self-winding watch can stay wound for up to 35 hours. A Chinese standard movement self-winding watch can stay wound for a minimum 40-hour. Miyota 8215 self-winding watch can stay wound for over 40 hours. ", "prediction 1": "When fully wound, Harwood's watch would run for 12 hours autonomously. It did not have a conventional stem winder, so the hands were moved manually by rotating a bezel around the face of the watch. Rolex improved Harwood's design in 1930 and used it as the basis for the Rolex Oyster Perpetual, in which the centrally mounted semi-circular weight could rotate through a full 360\u00b0 rather than the about 200\u00b0 of the 'bumper' winder. Rolex's version also increased the amount of energy stored in the mainspring, allowing the watch to run autonomously for up to 35 hours.", "prediction 2": "The self-winding watch is a watch that automatically runs for 12 hours when fully wound. It did not have a conventional stem winder, so the hands were moved manually by rotating a bezel around the face of the watch.", "prediction 3": "When fully wound, Harwood's watch would run for 12 hours autonomously. It did not have a conventional stem winder, so the hands were moved manually by rotating a bezel around the face of the watch. Rolex improved Harwood's design in 1930 and used it as the basis for the Rolex Oyster Perpetual, in which the centrally mounted semi-circular weight could rotate through a full 360\u00b0 rather than the about 200\u00b0 of the 'bumper' winder. Rolex's version also increased the amount of energy stored in the mainspring, allowing it to run autonomously for up to 35 hours.", "prediction 4": "When fully wound, Harwood's watch would run for 12 hours autonomously. It did not have a conventional stem winder, so the hands were moved manually by rotating a bezel around the face of the watch. Rolex improved Harwood's design in 1930 and used it as the basis for the Rolex Oyster Perpetual, in which the centrally mounted semi-circular weight could rotate through a full 360\u00b0 rather than the about 200\u00b0 of the 'bumper' winder. Rolex's version increased the amount of energy stored in the mainspring, allowing it to run autonomously for up to 35 hours.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 197 }, { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 430 }, { "error type": "Irrelevant", "explanation": "", "start": 431, "end": 530 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 266 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "When fully wound, Harwood's watch would run for 12 hours autonomously. The 1930 Rolex Oyster Perpetual watch will run autonomously for up to 35 hours. A Chinese standard movement self-winding watch can stay wound for a minimum 40-hour. Miyota 8215 self-winding watch can stay wound for over 40 hours." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "What makes the oak think it is better than the reed?", "passages": [ [ "The Oak and the Reed", "The Oak and the Reed\n\nThe Oak and the Reed is one of Aesop's Fables and is numbered 70 in the Perry Index.", "It appears in many versions: in some it is with many reeds that the oak converses and in a late rewritten version it disputes with a willow.", "There are early Greek versions of this fable and a 5th-century Latin version by Avianus.", "They deal with the contrasting behaviour of the oak, which trusts in its strength to withstand the storm and is blown over, and the reed that 'bends with the wind' and so survives.", "Most early sources see it as a parable about pride and humility, providing advice on how to survive in turbulent times.", "This in turn gave rise to various proverbs such as 'Better bend than break' and 'A reed before the wind lives on, while mighty oaks do fall', the earliest occurrence of which is in Geoffrey Chaucer's \"Troilus and Criseyde\" (II.1387-9).", "It so happens that there is an overlap here with the old Chinese proverb 'A tree that is unbending is easily broken'.", "The saying originally occurred in the religious classic, the \"Tao Te Ching\", with the commentary that 'The hard and strong will fall, the soft and weak will overcome'." ], [ "The Oak and the Reed", "This is then put to the test when a storm breaks and brings the oak's 'head that was neighbour to the sky' on a level with the roots 'that touched the empire of the dead'.", "Written in the autocratic time of Louis XIV of France, this was so successfully achieved that it appeared to teach the value of humility at the same time as suggesting that rulers may not be as powerful as they think themselves.", "So current did that sly interpretation become that Achille Etna Michallon's later painting of \"The Oak and the Reed\", now in the Fitzwilliam Museum (1816, see left), could easily be seen as a reference to the recent fall of the Emperor Napoleon I.", "In democratic times, the conduct of the reed came to be seen as cowardly and self-serving and the fable began to be rewritten from this point of view.", "In Robert Dodsley's collection of 1761 it appears as \"The Oak and the Willow\", in which the willow challenges the oak to a trial of strength in withstanding a storm.", "The oak puts up a heroic fight and, after it falls, condemns the willow's conduct as mean and cowardly.", "An 1802 American rhymed version of this draws the political conclusion even more strongly." ], [ "The Oak and the Reed", "One of the first appeared among the seven published in 1945 by Bernard Gelval which afterwards became part of the sung repertoire of the actor .", "It was followed in 1947 by the second volume of \"15 fables c\u00e9l\u00e8bres racont\u00e9es en argot\" (famous fables in slang) by 'Marcus', in which \"Le Ch\u00eane et le Roseau\" was included.", "While this keeps fairly closely to La Fontaine's text, Pierre Perret's 1990 rap version is a looser adaptation of the fable into a series of quatrains with a refrain in between.", "The mighty oak 'stacked like the Himalayas' talks down to the reed in its marsh where 'up there the winds whizz and down 'ere's rheumatiz' (\"En haut t'as le mistral en bas les rhumatismes\") but his pity is rejected and the fate soon to overtake him foretold.", "Cartoons were eventually made of these versions and released on DVD under the title \"\"; \"The oak and the reed\" appeared in volume 3 of the series (Les Chiffres, 1991).", "In 1965 a poetic version by Peter Westmore was included as the last piece in Edward Hughes' \"Songs from Aesop's Fables\" for children's voices and piano." ] ], "gold": "There are many versions of Aesop's The Oak and the Reed. In the early Greek versions and the 5th-century Latin version by Avianus, the oak thinks that it is better than the reed because it has the strength to withstand the storm. In version titled Le Ch\u00eane et le Roseau, the oak has compassion for the reed, but the reed has its own strategy for survival; This is then put to the test when a storm breaks and brings the oak's \"head that was neighbour to the sky\" on a level with the roots \"that touched the empire of the dead.\" In Pierre Perret's 1990 rap version, the oak thinks that it is better than the reed because it is stacked like the Himalayas.", "prediction 1": "The Oak and the Reed is one of Aesop's Fables and is numbered 70 in the Perry Index. The fable deals with the contrasting behaviour of the oak, which trusts in its strength to withstand the storm and is blown over, and the reed that bends with the wind and so survives. This is then put to the test when a storm breaks and brings the oak's 'head that was neighbour to the sky' on a level with the roots'that touched the empire of the dead. The oak puts up a heroic fight and, after it falls, condemns the willow's conduct as cowardly and, after it falls, condemns the willow's conduct as mean and condemns the willow's conduct as cowardly and draws the political conclusion even more strongly. In democratic times, the conduct of the reed came to", "prediction 2": "The Oak and the Reed is one of Aesop's Fables and is numbered 70 in the Perry Index. The contrasting behaviour of the oak, which trusts in its strength to withstand the storm and is blown over, and the reed that 'bends with the wind' and so survives, are the reasons given for this fable's popularity. The oak put up a heroic fight and condemns the reed's conduct as mean and cowardly. The reed becomes more popular with the rap version in 1990 and rap version from the fable by Pierre Perret. The fable began to be rewritten from this point of view.", "prediction 3": "The Oak and the Reed is one of Aesop's Fables and is numbered 70 in the Perry Index. It appears in many versions: in some it is with many reeds that the oak converses and in a late rewritten version it disputes with a willow. There are early Greek versions of this fable and a 5th-century Latin version by Avianus. They deal with the contrasting behaviour of the oak, which trusts in its strength to withstand the storm.", "prediction 4": "The Oak and the Reed is one of Aesop's Fables and is numbered 70 in the Perry Index. Several versions have been published of this fable, including an early Greek version and a 5th-century Latin version by Avianus. They deal with the contrasting behaviour of the oak, which trusts in its strength to withstand the storm and is blown over, and the reed that 'bends with the wind' and so survives. However, the oak's head that was neighbour to the sky' on a level with the roots that touched the empire of the dead.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 440, "end": 533 }, { "error type": "Redundant", "explanation": "The oak puts up a heroic fight and, after it falls, condemns the willow's conduct as cowardly and, ", "start": 539, "end": 638 }, { "error type": "Irrelevant", "explanation": "", "start": 643, "end": 693 }, { "error type": "Irrelevant", "explanation": "", "start": 694, "end": 746 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3, 4 ] } ], "corrected-prediction": "The Oak and the Reed is one of Aesop's Fables. The fable deals with the contrasting behaviour of the oak, which trusts in its strength to withstand the storm and is blown over, and the reed that bends with the wind and so survives. This is then put to the test when a storm breaks and brings the oak's 'head that was neighbour to the sky' on a level with the roots'that touched the empire of the dead. Pierre Perret's 1990 rap version has the mighty oak 'stacked like the Himalayas'." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does episode 13 of handmaids tale come out?", "passages": [ [ "The Handmaid's Tale (TV series)", "The Handmaid's Tale (TV series)\n\nThe Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood.", "It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016.", "The plot features a dystopian future following a Second American Civil War wherein a totalitarian society subjects fertile women, called \"Handmaids\", into child-bearing servitude.", "The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday.", "In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "\"The Handmaid's Tale\" has received widespread critical acclaim and its first season won eight Primetime Emmy Awards from thirteen nominations, including Outstanding Drama Series.", "It is the first show produced by Hulu to win a major award as well as the first series on a streaming service to win an Emmy for Outstanding Series.", "It also became the first streaming series to win the Golden Globe Award for Best Television Series \u2013 Drama.", "Elisabeth Moss was also awarded the Golden Globe for Best Actress.", "In May 2018, Hulu announced that the series had been renewed for a third season." ], [ "Margaret Atwood", "Activists, dressed in red cloaks and white hats as described in \"The Handmaid's Tale\", lobby and protest in order to bring awareness to politicians and laws that discriminate against women and women's rights.", "The novel \"Surfacing\" (1972) was adapted into an eponymous 1981 film, written by Bernard Gordon and directed by Claude Jutra.", "The film received poor reviews and suffers from making \"little attempt to find cinematic equivalents for the admittedly difficult subjective and poetic dimensions of the novel.\"", "The novel \"The Handmaid's Tale\" (1985) has been adapted into several eponymous works.", "A 1990 film, directed by Volker Schl\u00f6ndorff, with a screenplay by Harold Pinter, received mixed reviews.", "A musical adaptation resulted in the 2000 opera, written by Poul Ruders, with a libretto by Paul Bentley.", "It premiered at the Royal Danish Opera in 2000, and was staged in 2003 at London's English National Opera and the Minnesota Opera.", "A television series by Bruce Miller began airing on the streaming service Hulu in 2017.", "The first season of the show earned eight Emmy's in 2017, including Outstanding Drama Series.", "Season two premiered on April 25, 2018, and it was announced on May 2, 2018 that Hulu had renewed the series for a third season." ] ], "gold": "The Handmaid's Tale is an American dystopian television series , based on the 1985 novel of the same name by Canadian author Margaret Atwood. The series was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The shows 13th episode aired May 2, 2018. The 13th episode of season 2 aired July 11, 2018. the 13th episode of season 3 aired August 14, 2019.", "prediction 1": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Episode 13 of the series came out on March 9, 2019. Episode 13 of the second season came out on March 9, 2019.", "prediction 2": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Episode 13 came out on April 26, 2017, and the subsequent seven episodes came out on a weekly basis every Wednesday.", "prediction 3": "The Handmaid's Tale is an American dystopian television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Episode 13 of the series first aired on April 26, 2017, and the subsequent seven episodes aired on a weekly basis every Wednesday. Season two came out on April 25, 2018, and it was announced on May 2, 2018 that Hulu had renewed the series for a third season.", "prediction 4": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Episode 13 of the series premiered on April 26, 2017 and the subsequent seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 93 }, { "error type": "Unverifiable", "explanation": "", "start": 155, "end": 206 }, { "error type": "Redundant", "explanation": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. Episode 13 of the series came out on March 9, 2019. ", "start": 207, "end": 265 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "What are the pixies names in winx club?", "passages": [ [ "Winx Club", "Season 7 aired on Nickelodeon UK and Ireland from July 4, 2015 and on Nick Jr. in the U.S from January 10, 2016, with a new dub by DuArt Film and Video.", "The series is broadcast in over 150 countries worldwide and is Straffi's most successful creation.", "Its continuing popularity spawned a franchise, which also consists of three theatrically-released films, four TV movies, two spin-off series, a comic book serial, lines of fashion dolls and clothing, books, multiple platform video games and other merchandise.", "Bloom, a red-haired, sixteen-year-old girl from Earth, discovers she has magical abilities when she saves Stella, a 17-year-old fairy princess from Solaria.", "Stella persuades Bloom to enroll in Alfea, a school for fairies in the Magical Dimension.", "There, she meets roommate Flora and apartment mates Tecna and Musa; together they form the \"Winx Club\".", "They encounter and befriend the boys from the Red Fountain school of Specialists, named: Sky, Brandon, Timmy and Riven.", "They also encounter enemies, mainly the Trix, a trio made up of witches Icy, Darcy, and Stormy.", "Together, the Winx go through many adventures and discover many secrets about Bloom's childhood past and obscure origins, while fighting their enemies and studying at Alfea College for Fairies as freshmen students." ] ], "gold": "The Winx Club is led by Bloom, a student from Earth who thought she was an average human until discovering her flame-based powers. The other pixies are Stella, the Fairy of the Shining Sun; Flora, the Fairy of Nature; Musa, the Fairy of Music; Tecna, the Fairy of Technology; Aisha, The Fairy of Waves; and Roxy, the Fairy of Animals. The names of the pixies from the first three seasons of Winx Club are Bloom, Stella, Flora, Musa, Tecna, and Aisha. The names of the pixies since season 4 of the Winx Club are Bloom, Stella, Flora, Musa, Tecna, Aisha, and Roxy, who joined in season 4.", "prediction 1": "In Winx Club, there are several pixies. The Tecna and Musa are pixies who appear in a variety of roles.", "prediction 2": "In Winx Club, there are various pixies called the Winx. In the show, the pixies are called the Winx. The names of the Fairies in the show are: Icy, Darcy, Stormy, and Icy.", "prediction 3": "The Winx Club is an American animated television series created by Straffi for Nickelodeon that aired from 2012 to 2017. The pixies of the show are named Winx, Tecna, Musa and Brandon.", "prediction 4": "In the TV series Winx Club, the pixies are named in the episode \"Darcy and Stormy\".", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Bloom, a red-haired, sixteen-year-old girl from Earth, discovers she has magical abilities. Stella persuades Bloom to enroll in Alfea, a school for fairies in the Magical Dimension. There, she meets roommate Flora and apartment mates Tecna and Musa; together they form the \"Winx Club\"." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did the us last host the olympics?", "passages": [ [ "2002 Winter Olympics", "2002 Winter Olympics\n\nThe 2002 Winter Olympics, officially the XIX Olympic Winter Games and commonly known as Salt Lake 2002, was a winter multi-sport event that was celebrated from 8 to 24 February 2002 in and around Salt Lake City, Utah, United States.", "Approximately 2,400 athletes from 78 nations participated in 78 events in fifteen disciplines, held throughout 165 sporting sessions.", "The 2002 Winter Olympics and the 2002 Paralympic Games were both organized by the Salt Lake Organizing Committee (SLOC).", "Utah became the fifth state in the United States to host the Olympic Games and the 2002 Winter Olympics were the last Olympics to be held in the United States until the 2028 Summer Olympics in Los Angeles.", "These were the first Olympic Games under the IOC presidency of Jacques Rogge.", "The opening ceremony was held on February 8, 2002, and sporting competitions were held up until the closing ceremony on February 24, 2002.", "Production for both ceremonies was designed by Seven Nielsen, and music for both ceremonies was directed by Mark Watters.", "Salt Lake City became the most populous area ever to have hosted the Winter Olympics, although the two subsequent host cities' populations were larger.", "Following a trend, the 2002 Olympic Winter Games were also larger than all prior Winter Games, with 10 more events than the 1998 Winter Olympics in Nagano, Japan.", "Norway won the most gold medals while Germany won the most number of medals." ], [ "1996 Summer Olympics", "1996 Summer Olympics\n\nThe 1996 Summer Olympics, officially known as the Games of the XXVI Olympiad, commonly known as Atlanta 1996, and also referred to as the Centennial Olympic Games, were an international multi-sport event that was held from July 19 to August 4, 1996, in Atlanta, Georgia, United States.", "These Games, which were the fourth Summer Olympics to be hosted by the United States, marked the centenary of the 1896 Summer Olympics in Athens\u2014the inaugural edition of the modern Olympic Games.", "They were also the first since 1924 to be held in a different year from a Winter Olympics, under a new IOC practice implemented in 1994 to hold the Summer and Winter Games in alternating, even-numbered years.", "More than 10,000 athletes from 197 National Olympic Committees competed in 26 sports, including the Olympic debuts of beach volleyball, mountain biking, and softball, as well as the new disciplines of lightwight rowing and women's football (soccer).", "24 countries made their Summer Olympic debut in Atlanta, which included a number of former republics of the Soviet Union (which had competed in 1992 under the Olympic flag as the Unified Team) participating for the first time as independent nations." ], [ "Olympic Games", "During the interview process the candidate city must also guarantee that it will be able to fund the Games.", "After the work of the evaluation commission, a list of candidates is presented to the General Session of the IOC, which must assemble in a country that does not have a candidate city in the running.", "The IOC members gathered in the Session have the final vote on the host city.", "Once elected, the host city bid committee (together with the NOC of the respective country) signs a Host City Contract with the IOC, officially becoming an Olympic host nation and host city.", "By 2016, the Olympic Games will have been hosted by 44 cities in 23 countries, but by cities outside Europe and North America on only eight occasions.", "Since the 1988 Summer Olympics in Seoul, South Korea, the Olympics have been held in Asia or Oceania four times, a sharp increase compared to the previous 92\u00a0years of modern Olympic history.", "The 2016 Games in Rio de Janeiro were the first Olympics for a South American country.", "No bids from countries in Africa have succeeded.", "The United States has hosted eight Olympic Games, four Summer and four Winter, more than any other nation.", "The British capital London holds the distinction of hosting three Olympic Games, all Summer, more than any other city.", "The other nations hosting the Summer Games twice are Germany, Australia, France and Greece.", "The other cities hosting the Summer Games twice are Los Angeles, Paris and Athens." ] ], "gold": "The United States has hosted more Olympic Games than any other country, including both summer and winter games. The last Summer Olympics hosted by the US were the Atlanta 1996 Centennial Olympic Games, held on July 19-August 4. The last winter games that were held in the US were the 2002 Winter Olympics, which ran from February 8-February 24 in and around Salt Lake City, Utah.", "prediction 1": "The United States has hosted eight Olympic Games, four Summer and four Winter, more than any other nation. The 1996 Summer Olympics were the fourth Summer Olympics to be hosted by the United States and marked the centenary of the 1896 Summer Olympics in Athens\u2014the inaugural edition of the modern Olympic Games. The 2002 Winter Olympics were the last Olympics to be held in the United States until the 2028 Summer Olympics in Los Angeles.", "prediction 2": "The United States last hosted the olympics in 1980, when it hosted the winter multi-sport event at the Summer Olympics. The summer multi-sport event was held in 1996 with the Summer Olympics being held from July 19 to August 4, 1996 in Atlanta, Georgia. The 2002 Winter Olympics were the last Olympics to be held in the United States until the 2028 Summer Olympics in Los Angeles.", "prediction 3": "The Summer Olympics are an international multi-sport event that are held every four years. The United States last hosted the Summer Olympics in 1996, the 2004 Winter Olympics in Vancouver, Canada, and the 2008 Summer Olympics in Sochi, Russia. The 1996 Summer Olympics were also known as the Games of the XXVI Olympiad, Commonly known as Atlanta 1996, and also referred to as the Centennial Olympic Games. Then, in 2002, the US hosted the Winter Olympics in Salt Lake City, Utah, United States.", "prediction 4": "The United States has hosted eight Olympic Games, four Summer and four Winter, more than any other nation. The United States last hosted the Summer Olympics in 1992. In 2002, Salt Lake City hosted the Winter Olympics. In 1996, the Summer Olympics were held in Atlanta, Georgia, United States. The 2002 Winter Olympics were the last Olympic Games to be held in the United States until the 2028 Summer Olympics in Los Angeles.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 392, "end": 438 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States has hosted eight Olympic Games, four Summer and four Winter, more than any other nation. The 1996 Summer Olympics, also known as the Centennial Olympic Games, were the fourth Summer Olympics to be hosted by the United States on July 19 to August 4, 1996. The 2002 Winter Olympics were the last Olympics to be held in the United States. It ran from 8 to 24 February 2002, in and around Salt Lake City, Utah." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When did the new season of rick and morty start?", "passages": [ [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ], [ "Rick and Morty", "Rick and Morty\n\nRick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim.", "The series follows the misadventures of cynical mad scientist Rick Sanchez and his good-hearted but fretful grandson Morty Smith, who split their time between domestic life and interdimensional adventures.", "The series premiered on December 2, 2013, and the third season concluded on October 1, 2017.", "In May 2018, the series was picked up for an additional 70 episodes over an unspecified number of seasons.", "Roiland voices the eponymous characters, with Chris Parnell, Spencer Grammer and Sarah Chalke voicing the rest of the family.", "The series originated from an animated short parody film of \"Back to the Future\", \"The Real Animated Adventures of Doc and Mharti,\" created by Roiland for Channel 101, a short film festival co-founded by Harmon.", "When Adult Swim approached Harmon for television show ideas, he and Roiland decided to develop a program based on the short.", "The series has received universal acclaim for its originality, creativity and humor.", "The show revolves around the adventures of the members of the Smith household, which consists of parents Jerry and Beth, their children Summer and Morty, and Beth's father, Rick Sanchez, who lives with them as a guest." ], [ "Rick and Morty (season 3)", "Rick and Morty (season 3)\n\n", "The third season of \"Rick and Morty\", an American animated television series created by Dan Harmon and Justin Roiland, originally aired on Cartoon Network's late night programming block, Adult Swim.", "It premiered with \"The Rickshank Rickdemption\", which aired unannounced on April 1, 2017, as part of Adult Swim's annual April Fools' prank.", "As a result of production delays, the remaining episodes began airing weekly nearly four months later, on July 30, 2017.", "The season comprised ten episodes, and its initial airing concluded on October 1, 2017.", "The premiere picks up where the second-season finale left off, as the show continues to follow the adventures of the members of the Smith household.", "When Jerry asks Beth to choose between him and Rick, the strength of their marriage is tested.", "Jerry is confronted with the loss of his family, while Beth begins to discover her independence again.", "Morty and Summer deal with their parents' separation by seeking more control over their lives.", "Rick's nihilistic way of life continues to prevent him from bonding with his family, as he remains unable to change his self-destructive behavior.", "The third season of \"Rick and Morty\" delivered the highest ratings in Adult Swim's history and was the top-rated comedy among millennials on television." ] ], "gold": "There are several seasons of Rick and Morty. The sitcom's fifth season premiered on June 20, 2021, while the first five episodes of its fourth season aired from November 10, 2019, to December 15, 2019. Rick and Morty's Season 3 started on April 1, 2017, while its Season 2 started on July 26, 2015, and its Season 1 started on December 2, 2013.", "prediction 1": "The new season of Rick and Morty began airing on Cartoon Network's late night programming block Adult Swim on January 2, 2019. The series originally aired on Cartoon Network's late night programming block Adult Swim. It premiered on December 2, 2013. The sixth season began airing on June 19, 2018. The seventh season began airing on April 18, 2018.", "prediction 2": "Rick and Morty is an American adult animated television series created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Season 3 of the show started airing on Cartoon Network on June 30, 2017. Season 4 started airing on June 6, 2018. Season 5 started airing on June 27, 2019.", "prediction 3": "Rick and Morty is an American adult animated television series created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. The show follows the misadventures of cynical mad scientist Rick Sanchez and his good-hearted but fretful grandson Morty Smith, who split their time between domestic life and interdimensional adventures. The first episode of the fifth season aired on 4 April 2017, the sixth season aired on 19 June 2018, and the seventh season aired on April 22, 2019.", "prediction 4": "The third season of Rick and Morty, an American adult animated television series created by Dan Harmon and Justin Roiland, originally aired on Cartoon Network's late night programming block Adult Swim. The new season premiered on October 1, 2017 and the fourth season started airing on December 2, 2013. The fifth season began airing on April 4, 2017, and season six started airing on January 10, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 216 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 33, "end": 126 }, { "error type": "Redundant", "explanation": "The new season of Rick and Morty began airing on Cartoon Network's late night programming block Adult Swim on January 2, 2019. ", "start": 251, "end": 298 }, { "error type": "Redundant", "explanation": "The new season of Rick and Morty began airing on Cartoon Network's late night programming block Adult Swim on January 2, 2019. ", "start": 299, "end": 349 } ], "missing-info": [], "corrected-prediction": "The new season of Rick and Morty (season 3) began airing on April 1, 2017 . The series premiered on December 2, 2013. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who won last year's women's ncaa tournament?", "passages": [ [ "2017 NCAA Division I Women's Basketball Tournament", "2017 NCAA Division I Women's Basketball Tournament\n\nThe 2017 NCAA Women's Division I Basketball Tournament was played from Friday, March 17 to Sunday, April 2, 2017, with the Final Four played at the American Airlines Center in Dallas, Texas on March 31 and April 2.", "This was the first time that the women's Final Four was played in Dallas and the first time since 2002 that the Final Four games were played on Friday and Sunday, rather than Sunday and Tuesday.", "South Carolina defeated Mississippi State to win the championship.", "Tennessee continued its record streak of making every NCAA Women's Basketball Tournament at 36 consecutive appearances.", "Connecticut also continued its record streak of 10 consecutive Final Four appearances.", "The first two rounds, also referred to as the subregionals, were played at the sites of the top 16 seeds, as was done in 2016.", "The following are the sites that hosted each round of the 2017 tournament.", "First and Second Rounds\n\nRegional Semifinals and Finals (Sweet Sixteen and Elite Eight)\n\n\nNational Semifinals and Championship (Final Four and Championship)\n\nSelections for the 2017 NCAA Division I Women\u2019s Basketball Championship were announced at 7 p.m. Eastern time, Monday, March 13 via ESPN.", "The basis for the subregionals returned to the approach used between 1982 and 2002; the top sixteen teams, as chosen in the bracket selection process, hosted the first two rounds on campus." ], [ "2020 NCAA Division I Women's Basketball Tournament", "2020 NCAA Division I Women's Basketball Tournament\n\nThe 2020 NCAA Division I Women's Basketball Tournament will be played in March and April 2020, with the Final Four played Friday, April 3 and Sunday, April 5.", "The Final Four will be played at the Smoothie King Center in New Orleans, Louisiana, with the University of New Orleans, Tulane University and the Sun Belt Conference serving as hosts.", "This is the fourth time the women's Final Four will be played in New Orleans (previously, in 1991, 2004 and 2013).", "The first two rounds, also referred to as the subregionals, will be played at the sites of the top 16 seeds, as was done in 2016\u20132019.", "Regional Semifinals and Finals (Sweet Sixteen and Elite Eight)\nNational Semifinals and Championship (Final Four and Championship)" ], [ "Pac-12 Conference Women's Basketball Tournament", "Pac-12 Conference Women's Basketball Tournament\n\nThe Pac-12 Conference Women's Basketball Tournament, otherwise known as the Pac-12 Tournament, is the annual concluding tournament for the NCAA college basketball in the Pac-12.", "After a six-year run at KeyArena in Seattle from 2013 to 2018, the tournament will move to Las Vegas, already the site for the Pac-12 men's tournament, for at least 2019 and 2020.", "Seeding is based on regular season records.", "The Tournament has been held every year since 2002.", "On March 5, 2016, the Pac-12 announced that it had agreed to extend its contract to keep the women's tournament in Seattle until 2019.", "However, the conference ended the contract a season early, moving the women's tournament to Las Vegas for 2019 and 2020.", "The 2019 tournament will be held at MGM Grand Garden Arena, and the 2020 edition at Mandalay Bay Events Center.", "Tournament champions receive an automatic bid to the year's NCAA Division I Women's Basketball Tournament.", "Numbers in parentheses refer to each team's finish/seed in the tournament for that year." ] ], "gold": "The NCAA announced that the 2020 NCAA Division I Women's Basketball Tournament was canceled due to the COVID-19 pandemic. Previously, the South Carolina Gamecocks won the 2017 women's NCAA tournament, while the Connecticut Huskies won the 2016 and 2015 women's NCAA tournaments.", "prediction 1": "The women's Division I Women's Basketball Tournament, also known as the NCAA Women's Basketball Tournament, is the annual concluding tournament for the NCAA college basketball in the Pacific-12. Last year's champion was South Carolina. The winner of last year's NCAA Women's Division II Women's Basketball Tournament was Tennessee.", "prediction 2": "The NCAA Women's Division I Women's Basketball Tournament is the annual concluding tournament for NCAA college basketball in the Pacific-12. The 2017 women's division I women's basketball tournament was won by South Carolina. The 2018 women's division I women's basketball tournament was won by Kansas.", "prediction 3": "The 2017 NCAA Women's Division I Basketball Tournament was played from Friday, March 17 to Sunday, April 2, 2017. South Carolina defeated Mississippi State to win the title. The 2020 NCAA Division I Women's Basketball Tournament will be played in March and April 2020, with the Final Four played Friday, April 3 and Sunday, April 5.", "prediction 4": "The NCAA Women's Division I Basketball Tournament, commonly known as the Ncaa Women's Tournament, is the concluding tournament for the NCAA college basketball in the United States each year. In 2017, South Carolina defeated Mississippi State to win the championship. The Pac-12 Conference Women's Basketball Tournament, otherwise known as the Pac-12 Tournament, is the annual concluding tournament for the NCAA college basketball in the Pacific-12.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 194 }, { "error type": "Unverifiable", "explanation": "", "start": 236, "end": 331 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "South Carolina won the 2017 women's NCAA tournament." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What's the lowest minimum wage in america?", "passages": [ [ "Minimum wage in the United States", "Minimum wage in the United States\n\nThe minimum wage in the United States is set by US labor law and a range of state and local laws.", "Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law.", "Since July 24, 2009, the federal government has mandated a nationwide minimum wage of $7.25 per hour.", "As of January 2018, there were 29 states with a minimum wage higher than the federal minimum.", "From 2017 to 2018, eight states increased their minimum wage levels through automatic adjustments, while increases in eleven other states occurred through referendum or legislative action.", "Using 2018 inflation-adjusted dollars, the federal minimum wage peaked at $11.77 per hour in 1968.", "If the minimum wage in 1968 had kept up with labor's productivity growth, it would have reached $19.33 in 2017.", "There is a racial difference in support for a higher minimum wage with most Black and Latino individuals supporting a $15.00 federal minimum wage, and 54% of Whites opposing it.", "In 2015, about 3% of White, Asian, and Latino workers earned the federal minimum wage or less.", "Amongst Black workers, the percentage was about 4%.", "Minimum wage legislation emerged at the end of the nineteenth century from the desire to end sweated labor which had developed in the wake of industrialization." ], [ "Minimum wage in the United States", "Persons under the age of 20 may be paid $4.25 an hour for the first 90 calendar days of employment (sometimes known as a youth, teen, or training wage) unless a higher state minimum exists.", "The 2009 increase was the last of three steps of the Fair Minimum Wage Act of 2007, which was signed into law as a rider to the U.S. Troop Readiness, Veterans' Care, Katrina Recovery, and Iraq Accountability Appropriations Act, 2007, a bill that also contained almost $5 billion in tax cuts for small businesses.", "Some politicians in the United States advocate linking the minimum wage to the consumer price index, thereby increasing the wage automatically each year based on increases to the consumer price index.", "Linking the minimum wage to the consumer price index avoids the erosion of the purchasing power of the minimum wage with time because of inflation.", "In 1998 Washington state became the first state to approve consumer price indexing for its minimum wage.", "In 2003 San Francisco, California and Santa Fe, New Mexico were the first cities to approve consumer price indexing for their minimum wage.", "Oregon and Florida were the next states to link their minimum wages to the consumer price index.", "Later in 2006, voters in six states (Arizona, Colorado, Missouri, Montana, Nevada, and Ohio) approved statewide increases in the state minimum wage." ] ], "gold": "Since July 24, 2009, the federal minimum wage in the US has been $7.25 per hour, with a few exemptions. The minimum wage for tipped labor is $2.13 per hour, as long as the hour wage plus tip income equals at least the minimum wage. Persons under the age of 20 can also be paid what's called a youth, teen, or training wage for the first 90 calendar days of their employment, which is $4.25 an hour.", "prediction 1": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. As of January 2018, there were 29 states with a minimum wage higher than the federal minimum. The federal minimum wage peaked at $11.77 per hour in 1968.\n", "prediction 2": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. As of January 2018, there were 29 states with a minimum wage higher than the federal minimum. The federal minimum wage peaked at $11.77 per hour in 1968. If the minimum wage in 1968 had kept up with labor's productivity growth, it would have reached $19.33 in 2017.", "prediction 3": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. The federal minimum wage peaked at $11.77 an hour in 1968. Persons under the age of 20 may be paid $4.25 an hour for the first 90 calendar days of employment unless a higher state minimum exists.", "prediction 4": "The minimum wage in the United States is set by US labor law and a range of state and local laws. Employers generally have to pay workers the highest minimum wage prescribed by federal, state, and local law. Prior to July 24, 2009 the federal government had stated a nationwide minimum wage of $7.25 per hour for all workers. As of January 2018, there were 29 states with a minimum wage higher than the federal minimum. If the federal minimum wage in 1968 had kept up with labor's productivity growth, it would have reached $19.33 in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 301 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 337, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 207 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The federal minimum wage, since July 24, 2009, has been $7.25 per hour. The lowest, for persons under the age of 20, is $4.25 an hour for the first 90 calendar days of employment (sometimes known as a youth, teen, or training wage). \n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When does the next step new season start?", "passages": [ [ "The Next Step (2013 TV series)", "The Next Step (2013 TV series)\n\n", "The Next Step is a Canadian teen drama series.", "It follows the members of a troupe from the titular dance studio, as they train for and compete in various championships, and their members deal with rivalries with other dance schools.", "The series is shot in a mockumentary style influenced by reality television.", "The series premiered on Family Channel on March 8, 2013; the series has also spawned digital content, as well as live touring shows featuring its cast members.", "In February 24, 2012, Family Channel announced that it had ordered 26 half-hour episodes (including S1 and S1.5), and a four episode season finale.", "Special content was also going to be available, including \"The Next Step Interactive\".", "Filming began July 12, 2012 in Toronto, Ontario.", "On April 9, 2013, Family announced that it had renewed the series for a second season.", "On May 5, 2014, the series was renewed for a third season, which premiered on March 16, 2015.", "On April 16, 2015, it was announced that the series would return for a fourth season, which premiered on February 15, 2016.", "On March 21, 2016, Frank van Keeken announced on Instagram that \"The Next Step\" would return for a fifth season, which premiered on May 26, 2017." ], [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ] ], "gold": "There are several seasons of the Canadian teen drama series The Next Step. The series' seventh season premiered on April 10, 2020, while its sixth season premiered on September 29, 2018. The Next Step Seasons 5, 4, and 3 started on May 26, 2017, February 15, 2016, and March 16, 2015, respectively.", "prediction 1": "The Next Step is a Canadian teen drama series. It follows the members of a troupe from the titular dance studio, as they train for and compete in various championships, and their members deal with rivalries with other dance schools. Filming began July 12, 2012 in Toronto, Ontario. Filming ended on June 3, 2017. The new season started airing on 9 May 2017.", "prediction 2": "The Next Step is a Canadian teen drama series which follows a troupe of dancers from the titular dance studio as they train for and compete in various championships, and their members deal with rivalries with other dance schools. Filming began July 12, 2012 in Toronto, Ontario. On April 9, 2013, Family announced that it had renewed the series for a second season. On May 5, 2014, the series was renewed for a third season, which premiered on March 16, 2015. On April 16, 2015, it was announced that the series would return for a fifth season, which premiered on May 26, 2017. On March 21, 2016, Frank van Keeken announced on Instagram that \"The Next Step\" would return for a fifth season, which premiered on May 26, 2017. On March 21, 2016, Frank van Keeken announced on Instagram that \"The Next Step\" would return for a sixth season, which premiered on May 26, 2017.", "prediction 3": "The Next Step is a Canadian teen drama series that follows the members of a troupe from the titular dance studio, as they train for and compete in various championships, and their members deal with rivalries with other dance schools. Filming began on July 12, 2012 in Toronto, Ontario. On April 9, 2013, Family announced that it had renewed the series for a second season. On May 5, 2014, the series was renewed for a third season, which premiered on March 16, 2015. On April 16, 2015, it was announced that the series would return for a fifth season, which premiered on May 26, 2017. On March 21, 2016, Frank van Keeken announced on Instagram that \"The Next Step\" would return for a fifth season, which premiered on May 26, 2017. On March 21, 2016, Frank van Keeken announced on Instagram that \"The Next Step\" would return for a sixth season, which premiered on April 20, 2017.", "prediction 4": "The Next Step is a Canadian teen drama series which follows the members of a troupe from the titular dance studio, as they train for and compete in various championships and deal with rivalries with other dance schools. Filming began July 12, 2012, and the first season started airing on Family Channel on March 8, 2013. The third season started airing on Family Channel on May 5, 2014, the fourth season started airing on February 15, 2016 and the fifth season started airing on May 26, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 281 }, { "error type": "Unverifiable", "explanation": "", "start": 282, "end": 312 }, { "error type": "Unverifiable", "explanation": "", "start": 313, "end": 357 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "On 9 May 2017, Showcase announced that Canadian teen drama series The Next Step has been renewed for a sixth season, which premiered on 19 June 2018. A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who are the 2 guys that do the sonic commercials?", "passages": [ [ "Peter Grosz", "Peter Grosz\n\nPeter Grosz (born January 11, 1974) is an American actor and television writer.", "Grosz was born New York City, New York, and was raised in Scarsdale.", "Grosz is Jewish.", "He has worked both as an actor and as a producer.", "He is most recognizable for appearing in Sonic's \"two guys\" commercials, in which he appears as the straight man in a double act with improvisational comedian T. J. Jagodowski, with whom he also worked in the movie \"Stranger Than Fiction\".", "Grosz is a graduate of Northwestern University, where he worked with Seth Meyers of \"Saturday Night Live\".", "He worked as a writer for \"The Colbert Report\" from 2007 to 2010, where he has appeared on screen at least four times: once as the Time-Travelling Brandy Thief, once as a version of himself on September 23, 2008, once on May 13, 2010 to interrupt Stephen Colbert's attempt to introduce guest band The Hold Steady, only to perform the introduction himself, and on January 9, 2013 as McGnaw the Gluten-Free Beaver.", "In addition, the May 13, 2010 episode ended with Colbert wishing farewell to the Time-Travelling Brandy Thief; Grosz confirmed on his Facebook page that this was his last episode of the Colbert Report as a writer." ] ], "gold": "The two guys that do the Sonic commercials are Peter Grosz, who plays the straight man, and T. J. Jagodowski, who plays the funny man. Grosz is an American actor and television writer, and Jagodowski is an improvisational comedian.", "prediction 1": "Sonic's commercials for the Sonic Boom Boom Boom feature two men in a double act. Peter Grosz appears as the straight man in a double act with improvisational comedian T. J. Jagodowski.", "prediction 2": "Sonic is a music streaming service that is owned by Sonic and produced by Sonic, which has various commercials that use actors Peter Grosz and improv comedian T. J. Jagodowski. Grosz plays the straight man in a double act with Jagodowski.", "prediction 3": "Sonic advertises its Sonic Music Service with \"two guys\" commercials. Peter Grosz appears as the straight man in a double act with improvisational comedian T.J. Jagodowski, with whom he also worked in the movie Stranger Than Fiction. T. J. Jagodowski and Peter Grosz were both writers for The Colbert Report.", "prediction 4": "Sonic commercials feature a double act of Peter Grosz and improvisational comedian T. J. Jagodowski. Grosz is the straight man in the double act, while Jagodowski is the improvised comedian.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sonic's commercials for the Sonic Boom Boom Boom feature two men in a double act. Peter Grosz appears as the straight man in a double act with improvisational comedian T. J. Jagodowski. Grosz is an American actor and television writer." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who sings backup on thank you led zeppelin?", "passages": [ [ "Thank You (Led Zeppelin song)", "Thank You (Led Zeppelin song)\n\n\"Thank You\" is a song by the English rock band Led Zeppelin from their second studio album \"Led Zeppelin II\" (1969).", "It was written by Robert Plant and Jimmy Page, and produced by Page.", "\"Thank You\" signaled a deeper involvement in songwriting by singer Robert Plant: it was the first Led Zeppelin song for which he wrote all the lyrics.", "According to various Led Zeppelin biographies, this is also the song that made Jimmy Page realise that Plant could now handle writing the majority of the lyrics for the band's songs.", "Plant wrote the song as a tribute to his then-wife Maureen.", "The song features Hammond organ playing by John Paul Jones, which fades into a false ending before concluding with a crescendo roughly ten seconds later.", "For the recording of this track, Page played on a Vox 12-string guitar.", "\"Thank You\" is written in the key of D major in common time with a tempo of 78 beats per minute.", "Plant's vocals span from B to F#.", "In a retrospective review of \"Led Zeppelin II (Deluxe Edition)\" (2014), Michael Madden of \"Consequence of Sound\" praised the remastering of \"Thank You\", believing the track now sounds \"mellow and well-balanced\"." ], [ "Tangerine (Led Zeppelin song)", "Plant then sings the first verse accompanied by the backing guitar chords:\n\nBassist John Paul Jones complements Page on mandolin.", "The second verse contains the chorus, at the beginning of which Jones on bass and drummer John Bonham come in \u2013 Jones follows the chord changes and Bonham plays a straight-forward, backing beat.", "Through the use of double tracking, Plant provides a harmony vocal line.", "Page also adds pedal steel guitar fills; however, he departs from the typical American country music approach by adding a wah-wah pedal tonal effect.", "For the third verse, Plant returns to singing accompanied by guitar chording.", "The verses are broken up with an instrumental middle section with Page, Jones, and Bonham.", "Page solos on a heavily sustained Gibson Les Paul Standard electric guitar, which is also double tracked.", "Led Zeppelin biographer Dave Lewis calls it \"a smooth woman-tone solo\" After a second chorus, the song winds down with pedal steel fills and ends with an acoustic guitar figure.", "Led Zeppelin recorded the song at Headley Grange, Headley, East Hampshire, using the Rolling Stones Mobile Studio.", "The song was engineered and later mixed by Andy Johns at Olympic Studios in London.", "Although writers do not question who composed the music for the song, However, there is some disagreement over who wrote the lyrics." ] ], "gold": "Several sing backup on the song Thank You by English rock band Led Zeppelin, including John Bonham, who plays drums for the band, John Paul Jones, who plays bass guitar for the band, and Jimmy Page, who plays theremin for the band.", "prediction 1": "\"Thank You\" is a song by the English rock band Led Zeppelin from their second studio album Led Zeppelin II, released in 1969. The song was written by Robert Plant and Jimmy Page, and produced by Page. Plant sings the first verse accompanied by the backing guitar chords, then Jones on bass and drummer John Bonham come in.", "prediction 2": "\"Thank You\" is a song by the English rock band Led Zeppelin from their second studio album Led Zeppelin II in 1969. It was written by Robert Plant and Jimmy Page, and produced by Page. In the song, bassist John Paul Jones complements Page on mandolin. In the song's second verse, drummer John Bonham comes in \u2013 Jones follows the chord changes and Bonham plays a straight-forward, backing beat.", "prediction 3": "\"Thank You\" is a song by the English rock band Led Zeppelin from their second studio album \"Led Zeppelin II\" (1969). It was written by Robert Plant and Jimmy Page, and produced by Page. \"Thank You\" signaled a deeper involvement in songwriting by singer Robert Plant: it was the first Led Zeppelin song for which Plant wrote all the lyrics. Bassist John Paul Jones complements Page on mandolin. The second verse contains the chorus, at the beginning of which Jones follows the chord changes and drummer John Bonham plays a straight-forward, backing beat. Through the use of double tracking, Plant provides a harmony vocal line.", "prediction 4": "\"Thank You\" is a song by the English rock band Led Zeppelin from their second studio album, Led Zeppelin II. It was written by Robert Plant and Jimmy Page, and produced by Page. The backing singers on \"Thank You\" include bassist John Paul Jones and drummer John Bonham.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 125 }, { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 200 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 201, "end": 228 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Thank You\" is a song by the English rock band Led Zeppelin. John Paul Jones is the bassist. John Bonham is the drummer. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Muslim population in india according to 2011 census?", "passages": [ [ "2011 Census of India", "There are six religions in India that have been awarded \"National Minority\" status - Muslims, Christians, Sikhs, Jains, Buddhists and Parsis.", "Sunnis, Shias, Bohras, Agakhanis and Ahmadiyyas were identified as sects of Islam in India.", "As per 2011 census, six major faiths- Hindus, Muslims, Christians, Sikhs, Buddhists, Jains make up over 99.4% of India's 1.21 billion population, while \"other religions, persuasions\" (ORP) count is 8.2 million.", "Among the ORP faiths, six faiths- 4.957 million-strong Sarnaism, 1.026 million-strong Gond, 506,000-strong Sari, Donyi-Polo (302,000) in Arunachal Pradesh, Sanamahism (222,000) in Manipur, Khasi (138,000) in Meghalaya dominate.", "Maharashtra is having the highest number of atheists in the country with 9,652 such people, followed by Kerala.", "Hindi is the most widely spoken language in northern parts of India.", "The Indian census takes the widest possible definition of \"Hindi\" as a broad variety of \"Hindi languages\"." ] ], "gold": "The 2011 India Census religious data was released by the Government of India on 25 August 2015. Hindus are 79.8% with 966.3 million, Muslims are 14.23% with 172.2 million, and Christians 2.3% with 28.7 million. ", "prediction 1": "Islam is the religion of the majority population in India. According to the 2011 census, Muslims comprise 52% of the population.", "prediction 2": "The Muslim population of India is estimated to be 1.1 million, while the number of Christians in India is 2.2 million. The percentage of Muslims in India is around 3.5 million, and the percentage of Muslims in India is around 3.8 million.", "prediction 3": "There are 57,431 Muslims in India, of which 87,265 are Muslims. The number of Muslims living in India according to the 2011 census was 4,379,468. The number of Hindu population in India was 8,859,973. The number of Muslims living in India according to this census was 7,817.", "prediction 4": "As per 2011 census, Muslims, Christians, Sikhs, Buddhists, Jains make up over 99.4% of India's 1.21 billion population.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 58 }, { "error type": "Unverifiable", "explanation": "", "start": 59, "end": 128 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "As per 2011 census, six major faiths- Hindus, Muslims, Christians, Sikhs, Buddhists, Jains make up over 99.4% of India's 1.21 billion population," }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who became the president of syria in 2000?", "passages": [ [ "Abdul Halim Khaddam", "On 7 January 1976, Khaddam argued that Lebanon was part of Syria.", "During his visit to Tehran in August 1979 following the Iranian Revolution, he publicly stated that the Syrian government backed the revolution before and after the revolutionary process.", "He then served as Vice President from 11 March 1984 to 2005.", "He was responsible for political and foreign affairs as Vice President.", "Khaddam was also chief mediator during the Lebanon Civil War, thus giving him the unofficial titles of \"High Commissioner\" or \"Godfather\" of Lebanon.", "After the death of Hafez Assad in 2000, a 9-member committee was founded, which was headed by Khaddam, to oversee the transition period.", "He was appointed by this committee as interim President of Syria on 10 June and he was in office until 17 July 2000 when Bashar Assad was elected as the new president.", "At the time, there were rumours in Damascus that Khaddam would try to seize power, as he was the constitutional successor to the presidency.", "Khaddam was slightly injured in an attack in Damascus in December 1976.", "In October 1977, Khaddam again survived an assassination attempt at the Abu Dhabi International Airport.", "However, Saif Ghobash, the United Arab Emirates' first Minister of State for Foreign Affairs was killed in the attack instead.", "The Syrian authorities argued that it had been planned and carried out by Iraq." ] ], "gold": "After the death of Syrian President Hafez Assad in 2000, a 9-member committee was founded to oversee the transition period. This committee was headed by the Vice President of Syria, Abdul Halim Khaddam. Khaddam was then appointed by this committee as the interim President of Syria on June 10, 2000. Khaddam was in consideration to be Assad's permanent successor, but instead he helped Assad's son, Bashar al-Assad, assume the role of President of Syria on July 17, 2000.", "prediction 1": "Bashar Assad was elected as the new Syrian president on 17 July 2000. Khaddam was appointed by this committee as interim President of Syria on 10 June and he was in office until 17 July 2000.", "prediction 2": "Bashar Assad became the new president of Syria in 2000. Khaddam was the vice president of Syria from 1984 to 2005. Khaddam was the interim president of Syria from 10 June 2000 to 17 July 2000.", "prediction 3": "Bashar Assad became the new president of Syria on 17 July 2000.", "prediction 4": "Bashar Assad was elected as the new Syrian president on 17 July 2000.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "After the death of Hafez Assad in 2000, a 9-member committee was founded, which was headed by Khaddam, to oversee the transition period. He was appointed by this committee as interim President of Syria on 10 June and he was in office until 17 July 2000 when Bashar Assad was elected as the new president. At the time, there were rumours in Damascus that Khaddam would try to seize power, as he was the constitutional successor to the presidency." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who has won the most old firm games?", "passages": [ [ "Old Firm", "Since the administration and liquidation of \"The Rangers Football Club plc\", the clubs have faced each other fourteen times.", "Celtic have won eleven of these matches, with Rangers winning a single match via a penalty shootout.", "The remaining two fixtures were drawn.", "\"Updated following match on 2 September 2018\"\n\nThere are a number of matches between the two clubs that are not recognised in the official records, such as their first competitive meeting in the 1888\u201389 Glasgow Cup, in which Celtic defeated Rangers 6\u20131.", "During the Second World War, the Scottish Football League and Scottish Cup were suspended and in their place unofficial regional league competitions were set up (these were dominated by Rangers).", "One of these games was a New Year's Day derby in 1943 which Rangers won 8\u20131.", "* \n\n\n\n\n\nThe ferocity of the rivalry has made it rare for a player to represent both teams during his career.", "Players who played for both sides of the Old Firm included Alec Bennett, Scott Duncan, Robert Campbell, and George Livingstone, who all played before the intensity of the rivalry had started prior to 1912, as well as later players: Alfie Conn, Maurice Johnston, Kenny Miller, Steven Pressley and Mark Brown (none of whom moved directly between the two clubs).", "\"As of end of season 2017\u201318.", "Any current players in bold.\"" ], [ "Old Firm", "Old Firm\n\nThe Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, which are both based in Glasgow.", "The two clubs are by far the most successful and popular in Scotland, and the rivalry between them has become deeply embedded in Scottish culture.", "It has reflected, and contributed to, political, social, and religious division and sectarianism in Scotland.", "As a result, the fixture has had an enduring appeal around the world.", "Between them the two clubs have won 103 Scottish League championships (Rangers with 54 and Celtic with 49), 71 Scottish Cups, and 45 Scottish League Cups.", "Interruptions to their ascendancy have occurred rarely, most recently with the challenge of the New Firm of Aberdeen and Dundee United in the first half of the 1980s.", "Since the 1985\u201386 season, one half of the Old Firm has won the Scottish League consistently and in all but one of seventeen seasons between 1995\u201396 and 2011\u201312, both clubs finished in the top two places.", "In recent years Rangers have endured financial difficulties, and were liquidated in 2012.", "Subsequently, they were re-established as a new company and entered the fourth tier of the Scottish league.", "Celtic have won the last seven consecutive Scottish championships.", "Celtic and Rangers have played each other 414 times in major competitions: Rangers have won 159 matches, Celtic 156 matches, and 99 ended in a draw." ], [ "Bill Struth", "Bill Struth\n\nWilliam Struth (16 June 1875 \u2013 21 September 1956) was the second manager of Rangers Football Club, leading the club for 34 years between 1920 and 1954, as well as being the holder of a number of other positions, including director.", "Struth is one of the most successful managers in Scottish and British football history, winning 30 major trophies in his career; a record 18 Scottish league championships, 10 Scottish Cups and two Scottish League Cups.", "Struth was born in Leith, Edinburgh, the eldest child of William Struth senior, a stonemason, and Isabella Cunningham.", "Struth grew up in Edinburgh and Milnathort (his father's birthplace) in Kinross-shire.", "Struth worked as a stonemason, but he also competed as a professional runner until he was in his 30s.", "In the early 1900s he began helping to train the players at his local football club, Heart of Midlothian F.C., and in 1908 he moved to Glasgow to become the trainer at Clyde.", "Struth moved to Rangers in 1914 to take up the position of assistant manager.", "At the age of 45, in 1920, he took over as manager after his predecessor William Wilton was drowned in a boating accident off Gourock." ] ], "gold": "The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, which are both based in Glasgow. The two clubs are by far the most successful and popular in Scotland, and the rivalry between them has become deeply embedded in Scottish culture. Celtic and Rangers have played each other 426 times in major competitions with Rangers winning 167 matches, and Celtic's 159 matches, and 100 ended in a draw. William Struth was the second manager of Rangers Football Club, leading the club for 34 years between 1920 and 1954, as well as being the holder of a number of other positions, including director, Struth is one of the most successful managers in Scottish and British football history, winning 30 major trophies in his career, a record 18 Scottish league championships, and 10 Scottish Cups and two Scottish League Cups.", "prediction 1": "The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, both based in Glasgow. Between them the two clubs have won 103 Scottish League championships, with Celtic winning 49 and Rangers winning 54. Celtic have won 11 of these games, with Rangers winning one via penalty shootout. The remaining two fixtures were drawn.", "prediction 2": "The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, both based in Glasgow. The two clubs are by far the most successful and popular in Scotland, and the rivalry between them has become deeply embedded in Scottish culture. Celtic have won the most Old Firm games with 139, followed by Rangers with 119, and Rangers with 119.", "prediction 3": "The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, which are both based in Glasgow. Celtic have won the most Old Firm games, Celtic the most Old Firm games. Rangers have won the most Old Firm games, Celtic the most Old Firm games.", "prediction 4": "Celtic have won the most Old Firm games with 159. Rangers have won the most Old Firm games with 156. The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, which are both based in Glasgow. The rivalry between the two clubs has become deeply embedded in Scottish culture and has reflected, and contributed to, political, social, and religious division and sectarianism in Scotland. As a result, the fixture has had an enduring appeal around the world.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 310 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 349 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Old Firm is the collective name for the Scottish football clubs Celtic and Rangers, both based in Glasgow. The two clubs are by far the most successful and popular in Scotland, and the rivalry between them has become deeply embedded in Scottish culture. Celtic and Rangers have played each other 414 times in major competitions: Rangers have won 159 matches, Celtic 156 matches, and 99 ended in a draw.William Struth was the second manager of Rangers Football Club, leading the club for 34 years between 1920 and 1954, as well as being the holder of a number of other positions, including director. Struth is one of the most successful managers in Scottish and British football history, winning 30 major trophies in his career; a record 18 Scottish league championships, 10 Scottish Cups and two Scottish League Cups." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who narrates the dukes of hazzard tv show?", "passages": [ [ "Waylon Jennings", "The following year, RCA issued \"Ol' Waylon\", an album that produced a hit duet with Nelson, \"Luckenbach, Texas\".", "The album \"Waylon and Willie\" followed in 1978, producing the hit single \"Mammas Don't Let Your Babies Grow Up to Be Cowboys\".", "Jennings released \"I've Always Been Crazy\", also in 1978.", "The same year, at the peak of his success, Jennings began to feel limited by the outlaw movement.", "Jennings referred to the overexploitation of the image in the song \"Don't You Think This Outlaw Bit Has Done Got Out of Hand?", "\", claiming that the movement had become a \"self-fulfilling prophecy\".", "In 1979, he released \"Greatest Hits\", which was certified gold the same year, and quintuple platinum in 2002.", "Also in 1979, Jennings joined the cast of the CBS series \"The Dukes of Hazzard\" as the Balladeer, the narrator.", "The only episode to feature him in person was \"Welcome, Waylon Jennings\", during the seventh season.", "Jennings played himself, presented as an old friend of the Duke family.", "For the show, he also wrote and sang the theme song \"Good Ol' Boys\", which became the biggest hit of his career." ] ], "gold": "The Balladeer, voiced by Waylon Jennings, sings and plays the Dukes of Hazzard theme song, Good Ol' Boys, and also serves as the show's narrator. During each episode, he provides an omniscient viewpoint of the situations presented and regularly interjects comical asides during crucial plot points. After numerous requests from fans to see the Balladeer on-screen, Jennings finally appeared in one episode, the seventh season's aptly titled Welcome, Waylon Jennings, in which he was presented as an old friend of the Dukes.", "prediction 1": "The Dukes of Hazzard has had several narrators. Waylon Jennings, who narrates the show as the Balladeer, was the one who first narrated the show as the Balladeer.", "prediction 2": "The Dukes of Hazzard is an American family comedy television series. The narrator of the show is Waylon Jennings.", "prediction 3": "The Dukes of Hazzard TV show is narrated by Waylon Jennings, who plays himself. The show was created by Bob and Mary Hazzard and first aired on CBS in 1981.", "prediction 4": "The Dukes of Hazzard television show is narrated by Waylon Jennings, who serves as the Balladeer.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 47 }, { "error type": "Unverifiable", "explanation": "", "start": 121, "end": 126 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Waylon Jennings, who narrates the show as the Balladeer, was the one who narrated the show as the Balladeer. The only episode to feature Jennings in person was \"Welcome, Waylon Jennings\", during the seventh season." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the new england patriots change their logo?", "passages": [ [ "New England Patriots", "The Patriots became the first team to reach nine Super Bowls in the 2016\u201317 playoffs and faced the Atlanta Falcons in Super Bowl LI, which ended up paving the way for their fifth Super Bowl victory, tying them with the Dallas Cowboys and the San Francisco 49ers for the second-most in NFL history, 1 behind the Pittsburgh Steelers with 6; the game was also the first Super Bowl to go into overtime.", "The Patriots became the first team to reach ten Super Bowls in the 2017\u201318 playoffs but lost to the Philadelphia Eagles in Super Bowl LII, on February 4, 2018, at U.S. Bank Stadium in Minneapolis, Minnesota.", "The Patriots original helmet logo was a simple tricorne hat, used only for the 1960 season.", "From 1961 to 1992, the Patriots used a logo of a Revolutionary War minuteman hiking a football.", "The Patriots script logo during this time consisted of a western-style font.", "The minuteman logo became known as the \"Pat Patriot\" logo, which later became the name of the team's mascot.", "In 1979, the Patriots worked with NFL Properties to design a new, streamlined logo, to replace the complex Pat Patriot logo.", "The new logo featured the blue and white profile of a minuteman in a tricorne hat set against a flag showing three red stripes separated by two white stripes." ], [ "New England Patriots", "Following their Super Bowl loss, they returned to the playoffs in 1986, but lost in the first round.", "The team would not make the playoffs again for eight more years.", "During the 1990 season, the Patriots went 1\u201315.", "They changed ownership three times in the ensuing 14 years, being purchased from the Sullivan family first by Victor Kiam in 1988, who sold the team to James Orthwein in 1992.", "Orthwein intended to move the team to his native St. Louis, Missouri (where it would have been renamed as the St. Louis Stallions), but instead sold the team in 1994 to its current owner Robert Kraft.", "Though Orthwein's period as owner was short and controversial, he did oversee major changes to the team, first with the hiring of former New York Giants coach Bill Parcells in 1993.", "Orthwein and his marketing team also commissioned the NFL to develop a new visual identity and logo, and changed their primary colors from the traditional red, white and blue to blue and silver for the team uniforms.", "Parcells would bring the Patriots to two playoff appearances, including Super Bowl XXXI, which they lost to the Green Bay Packers by a score of 35\u201321.", "Pete Carroll, Parcells's successor, would also take the team to the playoffs twice in 1997 & 1998 before being dismissed as head coach after the 1999 season." ], [ "New England Patriots", "Team owner Billy Sullivan decided to put the new logo up to a vote against Pat Patriot with the fans at the September 23rd home game against the San Diego Chargers, using a sound level meter to judge the crowd's reaction.", "The new logo was decidedly rejected by the crowd in favor of Pat, and the concept was shelved.", "In 1993, a new logo was unveiled involving the gray face of a minuteman wearing a red, white and blue hat that begins as a tricorne and transitions into a flowing banner-like design.", "The logo bears some superficial resemblance to the aborted 1979 logo.", "It became popularly known as the \"Flying Elvis\" due to many observing its resemblance to the profile of a young Elvis Presley.", "In 2000, the blue color was darkened.", "On July 3, 2013, the Patriots unveiled a new logo, which replaced the script of their previous wordmark with block letters and modified the tricorne hat.", "The Patriots originally wore red jerseys with white block numbering at home, and white jerseys with red block numbering on the road.", "Both uniforms used white pants and white helmets, first with the hat logo over the player's number, then with the \"Pat Patriot\" logo starting in 1961.", "A blue stripe was added to the two red helmet stripes in 1964.", "The numbers on both the home and away jerseys gained a blue outline in 1973." ] ], "gold": "The Patriots original helmet logo was a simple tricorne hat. This logo was used only for the 1960 season. From 1961 to 1992, the Patriots used a logo of a Revolutionary War minuteman hiking a football. The Patriots script logo during this time consisted of a western-style font. The minuteman logo became known as the \"Pat Patriot\" logo, which later became the name of the team's mascot. Phil Bissell of the Boston Globe developed this \"Pat Patriot\" logo. Then, in 1993, the New England Patriots unveiled a new logo that featured the gray face of a minuteman wearing a red, white and blue hat that begins as a tricorne and transitions into a flowing banner-like design. Thus, the Patriots changed their primary colors from the traditional red, white and blue to blue and silver. Then, on July 3, 2013, for the third time in franchise history, the Patriots unveiled a new logo. This new logo replaced the script of their previous wordmark with block letters and modified the tricorne hat.", "prediction 1": "In 1979, the New England Patriots worked with NFL Properties to design a new, streamlined logo, to replace the complex Pat Patriot logo. The logo featured the blue and white profile of a minuteman in a tricorne hat set against a flag showing three red stripes separated by two white stripes. On July 3, 2013, the Patriots unveiled a new logo, which replaced the script of their previous wordmark with block letters and modified the tricorne hat.", "prediction 2": "On July 3, 2013, the New England Patriots unveiled a new logo, which replaced the script of their previous wordmark with block letters and modified the tricorne hat. The logo was first introduced in 1961, and was used until 1979, when the team worked with NFL Properties to design a new, streamlined logo, to replace the complex Pat Patriot logo. The new logo featured the blue and white profile of a minuteman in a tricorne hat set against a flag showing three red stripes separated by two white stripes.", "prediction 3": "The New England Patriots changed their logo three times, beginning with the 1993 logo, which replaced the complex Pat Patriot logo. From 1961 to 1992, the Patriots used a logo of a Revolutionary War minuteman hiking a football. In 1979, the Patriots worked with NFL Properties to design a new, streamlined logo, to replace the complex Pat Patriot logo. The new logo featured the blue and white profile of a minuteman in a tricorne hat set against a flag showing three red stripes separated by two white stripes. The team lost to the Philadelphia Eagles in Super Bowl LII, on February 4, 2018, at U.S.", "prediction 4": "In 1979, the New England Patriots worked with NFL Properties to design a new, streamlined logo, to replace the complex Pat Patriot logo. The new logo featured the blue and white profile of a minuteman in a tricorne hat set against a flag showing three red stripes separated by two white stripes. The new logo was finally approved by the New England Patriots on July 3, 2013, replacing the script of their previous wordmark with block letters and modified the tricorne hat.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 291 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Patriots original helmet logo was a simple tricorne hat, used only for the 1960 season. From 1961 to 1992, the Patriots used a logo of a Revolutionary War minuteman hiking a football. The Patriots script logo during this time consisted of a western-style font. The minuteman logo became known as the \"Pat Patriot\" logo, which later became the name of the team's mascot. In 1993, a new logo was unveiled involving the gray face of a minuteman wearing a red, white and blue hat that begins as a tricorne and transitions into a flowing banner-like design. Thus they changed their primary colors from the traditional red, white and blue to blue and silver. On July 3, 2013, the Patriots unveiled a new logo, which replaced the script of their previous wordmark with block letters and modified the tricorne hat." }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "When did the ranch season 2 come out?", "passages": [ [ "The Ranch (TV series)", "The Ranch (TV series)\n\n", "The Ranch is an American sitcom web television series starring Ashton Kutcher, Danny Masterson, Debra Winger, Elisha Cuthbert, and Sam Elliott that debuted in 2016 on Netflix.", "The show takes place on the fictional Iron River Ranch in the fictitious small town of Garrison, Colorado; detailing the life of the Bennetts, a dysfunctional family consisting of two brothers, their rancher father, and his divorced wife and local bar owner.", "While the opening sequence shows scenes from Norwood and Ouray, Colorado and surrounding Ouray and San Miguel Counties, \"The Ranch\" is filmed on a sound stage in front of a live audience in Burbank, California.", "Each season consists of 20 episodes broken up into two parts, each containing 10 episodes.", "All episodes are named after American country music songs, predominantly Kenny Chesney in part one, George Strait in part two, Tim McGraw in part three, Garth Brooks in part four, Dolly Parton in part five, and Alabama in part six.", "The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016.", "In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017, and the second half was released on December 15, 2017." ] ], "gold": "The Ranch is an American streaming television comedy/drama that debuted in 2016 on Netflix, which ran for four season's that were split into 8 parts. Each season consisted of 20 episodes broken up into two parts, each containing 10 episodes, the episodes are approximately 30 minutes in length. The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016. In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017, and the second half was released on December 15, 2017.", "prediction 1": "The Ranch is an American sitcom web television series that aired on Netflix from 2016 to 2022. Season 2 premiered on October 7, 2016 and was renewed for a second season by Netflix in April 2016. Season 2 premiered on June 16, 2017, and the second half was released on December 15, 2017.", "prediction 2": "The Ranch is an American sitcom web television series starring Ashton Kutcher, Danny Masterson, Debra Winger, Elisha Cuthbert, and Sam Elliott that debuted in 2016 on Netflix. In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017, and the second half was released on December 15, 2017.", "prediction 3": "The Ranch is an American sitcom web television series that debuted in 2016 on Netflix. The show takes place on the fictional Iron River Ranch in the fictitious small town of Garrison, Colorado. Each season consists of 20 episodes broken up into two parts, each containing 10 episodes. The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016. In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017. As of which premiered on June 15, 2017, the second half was released on December 15, 2017.", "prediction 4": "The Ranch is an American sitcom web television series starring Ashton Kutcher, Danny Masterson, Debra Winger, Elisha Cuthbert, and Sam Elliott that debuted in 2016 on Netflix. Season 2 of the show premiered on June 16, 2017 and the second half came out on December 15, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 86, "end": 94 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Ranch is an American sitcom web television series that aired on Netflix from 2016. Each season consists of 20 episodes broken up into two parts, each containing 10 episodes. The first ten episodes premiered on April 1, 2016, the second batch of ten episodes premiered on October 7, 2016. In April 2016, Netflix renewed \"The Ranch\" for a second season of 20 episodes, the first half of which premiered on June 16, 2017, and the second half was released on December 15, 2017." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "Who won the ladies roar of the rings?", "passages": [ [ "Canadian Olympic Curling Trials", "Canadian Olympic Curling Trials\n\nThe Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games.", "They are held to determine the men's and women's representatives at the next year's Olympic Games.", "The system of qualification for the Curling Trials varies for each event, and can be quite complicated.", "One main reason for an Olympic qualifying event apart from the national championships (The Brier and the Scotties) is that provincial residency rules do not apply to the Olympic team.", "Curling was added to the Olympic programme in 1998, and a Canadian Olympic Trials have been held the year prior since 1997.", "There were also Olympic Trials held in 1987 for the curling demonstration event at the 1988 Winter Olympics.", "The 1987 Trials were known as the Labatt National Curling Trials and were held April 19\u201325, 1987 in Calgary, the same site of the 1988 Winter Olympics.", "Linda Moore would skip the women's winning team and Ed Lukowich skipped the men's winner.", "There were no trials for the 1992 Winter Olympics curling demonstration event.", "The winner of the 1991 Scott Tournament of Hearts (Julie Sutton) and the 1991 Labatt Brier (Kevin Martin) got to represent Canada at the event." ] ], "gold": "The Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games. In 2009, the winners of the ladies Roar of the Rings were: Cheryl Bernard, Susan O'Connor, Carolyn Darbyshire, Cori Bartel, Kristie Moore. 2013's winners were: Jennifer Jones, Kaitlyn Lawes, Jill Officer, Dawn McEwen, Kirsten Wall. In 2017, the winners were: Rachel Homan, Emma Miskew, Joanne Courtney, Lisa Weagle, Cheryl Kreviazuk.", "prediction 1": "The Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games. They are held to determine the men's and women's representatives at the next year's Olympic Games. The 1991 Scott Tournament of Hearts winner was Julie Sutton. The 1991 Labatt Brier winner was Kevin Martin.", "prediction 2": "The Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games. They are held to determine the men's and women's representatives at the next year's Olympic Games. The female winner was Linda Moore. The male winner was Kevin Martin.", "prediction 3": "The women's Tim Hortons Roar of the Rings in curling, commonly known as the Canadian Olympic Curling Trials, are held every four years, in the year preceding the Winter Olympic Games. The winners in the ladies' Roar of the Rings are Linda Moore and Julie Sutton. The men's Roar of the Rings is Kevin Martin.", "prediction 4": "The Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games. They are held to determine the men's and women's representatives at the next year's Olympic Games.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 286 } ], "missing-info": [], "corrected-prediction": "The Canadian Olympic Curling Trials, known as the Tim Hortons Roar of the Rings since 2005 for sponsorship reasons, occur every four years, in the year preceding the Winter Olympic Games. The 1991 Scott Tournament of Hearts winner was Julie Sutton. The 1991 Labatt Brier winner was Kevin Martin." }, "preference": [ 0, 0, 1, 1, 1, 1 ] }, { "question": "Who sings ain't nothing wrong with the radio?", "passages": [ [ "There Ain't Nothin' Wrong with the Radio", "There Ain't Nothin' Wrong with the Radio\n\n\"There Ain't Nothin' Wrong with the Radio\" is a song co-written and recorded by American country music artist Aaron Tippin.", "It was released in February 1992 as the first single from his album \"Read Between the Lines\".", "The song is not only his first Number One hit on the country music charts but also his longest-lasting at three weeks.", "\"There Ain't Nothin' Wrong with the Radio\" is a moderate up-tempo novelty song.", "In it, the male narrator describes how old and run-down his car is but explains that he continues to drive it because \"there ain't nothin' wrong with the radio\" \u2014 specifically, \"there ain't a country station that [he] can't tune in\".", "The song features electric guitar and fiddle accompaniments.", "The music video was directed by John Lloyd Miller and premiered in early-1992.", "It shows Tippin performing at a concert sporting a mullet.", "Tippin performed the song with Alvin and the Chipmunks on their 1992 album \"Chipmunks in Low Places\".", "In this version, Simon repeatedly attempts to correct the song's grammar, singing \"there isn't anything wrong with the radio\".", "Tippin then explains that the song is supposed to have grammatical errors because it is country." ] ], "gold": "\"There Ain't Nothin' Wrong with the Radio\" is a country song by American country music artist Aaron Dupree Tippin. Aaron Tippin performed the song with Alvin and the Chipmunks on their 1992 album Chipmunks in Low Places with Simon, a member of the Chipmunks, attempting to correct the song's grammar by singing there isn\u2019t instead of there ain\u2019t but Tippin explains that the song is supposed to have grammatical errors because it is country.", "prediction 1": "There Ain't Nothing Wrong with the Radio is a song co-written and recorded by American country music artist Aaron Tippin. It was released in February 1992 as the first single from his album Read Between the Lines. In this version, Simon repeatedly attempts to correct the song's grammar, singing \"there isn't anything wrong with the radio\".\n", "prediction 2": "\"There Ain't Nothin' Wrong with the Radio\" is a song co-written and recorded by American country music artist Aaron Tippin. He released it in February 1992 as the first single from his album Read Between the Lines.", "prediction 3": "\"There Ain't Nothin' Wrong with the Radio\" is a song co-written and recorded by American country music artist Aaron Tippin. It was released in February 1992 as the first single from his album \"Read Between the Lines\". In this version, Simon repeatedly attempts to correct the song's grammar, singing \"there isn't anything wrong with the radio\".", "prediction 4": "There's a song entitled There Ain't Nothing Wrong with the Radio. The song was co-written and recorded by Aaron Tippin with his band the Chipmunks. In this version, Simon repeatedly attempts to correct the song's grammar, singing \"there isn't anything wrong with the radio\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 213 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "There Ain't Nothing Wrong with the Radio is a song co-written and recorded by American country music artist Aaron Tippin. Tippin performed the song with Alvin and the Chipmunks on their 1992 album \"Chipmunks in Low Places\". In this version, Simon repeatedly attempts to correct the song's grammar, singing \"there isn't anything wrong with the radio\". Tippin then explains that the song is supposed to have grammatical errors because it is country.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played in the 1998 afl grand final?", "passages": [ [ "1998 AFL Grand Final", "1998 AFL Grand Final\n\n", "The 1998 AFL Grand Final was an Australian rules football game contested between the Adelaide Crows and the North Melbourne Kangaroos, held at the Melbourne Cricket Ground in Melbourne on 26 September 1998.", "It was the 102nd annual Grand Final of the Australian Football League (formerly the Victorian Football League), staged to determine the premiers for the 1998 AFL season.", "The match, attended by 94,431 spectators, was won by Adelaide by a margin of 35 points marking that club's second consecutive premiership victory, and second premiership overall.", "This Grand Final saw the Kangaroos playing in their second Grand Final in three years, after their triumph in the 1996 AFL Grand Final.", "The Crows were competing in their second consecutive Grand Final, and were seeking back-to-back premierships after winning the 1997 AFL Grand Final.", "Craig Sholl for the Kangaroos was to play his 200th game.", "At the conclusion of the home and away season, North Melbourne had finished first on the AFL ladder with 16 wins and 6 losses, winning the McClelland Trophy.", "They had won their last nine matches.", "Adelaide had finished fifth with 13 wins and 9 losses.", "Adelaide fell to a heavy loss in its qualifying final against Melbourne at the MCG by 48 points, but still progressed to play a semi-final against Sydney at the SCG, which they won by 27 points." ], [ "Adelaide Football Club", "Adelaide Football Club\n\nThe Adelaide Football Club, nicknamed the Crows, is a professional Australian rules football club that competes in the Australian Football League (AFL).", "The club is based in Adelaide, South Australia, playing its home matches at Adelaide Oval.", "The club has its training and administration base at Football Park in West Lakes, where it previously played home matches between 1991 and 2013.", "The club song is \"The Pride of South Australia\", to the tune of the Marines' Hymn.", "The Crows were formed in 1990 after a supreme court injunction to halt The Port Adelaide Football Club from entering the AFL and instead the Crows were, effectively, meant to be the 'state team' that was going to represent South Australia in the AFL.", "They are a composite team originally owned by the SANFL (later gaining independence) and played their first season in 1991.", "They won both the 1997 and 1998 Grand Finals, and have appeared in 15 finals series in their 27-year history.", "The club is currently captained by Taylor Walker and coached by Don Pyke.", "Walker was appointed captain prior to the 2015 season, while Pyke permanently succeeded the late Phil Walsh as head coach in October 2015.", "After the VFL was renamed the AFL for the 1990 season, the SANFL clubs unanimously resolved, in May 1990, that a team would not be entered into the AFL until season 1993." ] ], "gold": "The 1998 AFL Grand Final was an Australian rules football game contested between the North Melbourne Kangaroos and the defending AFL Grand Final winners the Adelaide Crows. This match was held at the Melbourne Cricket Ground in Melbourne on 26 September 1998. This 1998 AFL Grand Final was won by Adelaide by a margin of 35 points. ", "prediction 1": "The 102nd annual Grand Final of the Australian Football League, staged to determine the premiers for the 1998 AFL season, was contested between the Adelaide Crows and the North Melbourne Kangaroos on 26 September 1998. This Grand Final saw the Kangaroos playing in their second Grand Final in three years, after their triumph in the 1996 AFL Grand Final. The Adelaide Crows were competing in their second consecutive Grand Final, and were seeking back-to-back premierships after winning the 1997 AFL Grand Final.", "prediction 2": "The 1998 AFL Grand Final was an Australian rules football game contested between the Adelaide Crows and the North Melbourne Kangaroos, held at the Melbourne Cricket Ground in Melbourne on 26 September 1998. The match was attended by 94,431 spectators and was won by Adelaide by a margin of 35 points marking that club's second consecutive premiership victory, and second premiership overall. The Kangaroos were playing in their second Grand Final in three years, after their triumph in the 1996 AFL Grand Final.", "prediction 3": "The 1998 AFL Grand Final was an Australian rules football game contested between the Adelaide Crows and the North Melbourne Kangaroos, held at the Melbourne Cricket Ground in Melbourne on 26 September 1998. The match, attended by 94,431 spectators, was won by Adelaide by a margin of 35 points marking that club's second consecutive premiership victory, and second premiership overall. The North Melbourne Kangaroos played in their second Grand Final in three years, after their triumph in the 1996 AFL Grand Final. The Adelaide Crows were competing in their second consecutive Grand Final, and were seeking back-to-to-to-to-back premierships after winning the 1997 AFL Grand Final.", "prediction 4": "The 1998 AFL Grand Final was an Australian rules football game contested between the Adelaide Crows and the North Melbourne Kangaroos, held at the Melbourne Cricket Ground in Melbourne on 26 September 1998. The match, attended by 94,431 spectators, was won by Adelaide by a margin of 35 points marking that club's second consecutive premiership victory, and second premiership overall. Craig Sholl for the Kangaroos was to play his 200th game in the match.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 512 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1998 AFL Grand Final was an Australian rules football game contested between the Adelaide Crows and the North Melbourne Kangaroos, held at the Melbourne Cricket Ground in Melbourne on 26 September 1998. This 1998 AFL Grand Final was won by Adelaide by a margin of 35 points." }, "preference": [ 0, 0, 1, 1, 1, 1 ] }, { "question": "Who won the nba mvp of the regular season?", "passages": [ [ "NBA Most Valuable Player Award", "Both Bill Russell and Michael Jordan won the award five times, while Wilt Chamberlain and LeBron James won the award four times.", "Russell and James are the only players to have won the award four times in five seasons.", "Moses Malone, Larry Bird and Magic Johnson each won the award three times, while Bob Pettit, Karl Malone, Tim Duncan, Steve Nash and Stephen Curry have each won it twice.", "Only two rookies have won the award: Wilt Chamberlain in the and Wes Unseld in the 1968\u201369 season.", "Hakeem Olajuwon of Nigeria, Tim Duncan of the U.S. Virgin Islands, Steve Nash of Canada and Dirk Nowitzki of Germany are the only MVP winners considered \"international players\" by the NBA.", "Stephen Curry in 2015\u201316 is the only player to have won the award unanimously.", "Shaquille O'Neal in 1999\u20132000 and LeBron James in 2012\u201313 are the only two players to have fallen one vote shy of a unanimous selection, both receiving 120 of 121 votes.", "Russell Westbrook, is the first to have played for a team that failed to win at least 50 regular-season games since the .", "Every player to have won the award has made at least one appearance as a player in the NBA Finals, with the exceptions of Steve Nash and Derrick Rose." ], [ "NBA Most Valuable Player Award", "NBA Most Valuable Player Award\n\nThe National Basketball Association Most Valuable Player Award (MVP) is an annual National Basketball Association (NBA) award given since the 1955\u201356 season to the best performing player of the regular season.", "The winner receives the Maurice Podoloff Trophy, which is named in honor of the first commissioner (then president) of the NBA, who served from 1946 until 1963.", "Until the , the MVP was selected by a vote of NBA players.", "Since the , the award is decided by a panel of sportswriters and broadcasters throughout the United States and Canada.", "Each member of the voting panel casts a vote for first to fifth place selections.", "Each first-place vote is worth 10 points; each second-place vote is worth seven; each third-place vote is worth five, fourth-place is worth three and fifth-place is worth one.", "Starting from 2010, one ballot was cast by fans through online voting.", "The player with the highest point total wins the award.", ", the current holder of the award is James Harden of the Houston Rockets.", "Every player who has won this award and has been eligible for the Naismith Memorial Basketball Hall of Fame has been inducted.", "Kareem Abdul-Jabbar won the award a record six times.", "He is also the only player to win the award despite his team not making the playoffs back in the season." ], [ "Point guard", "Point guards are expected to be vocal floor leaders.", "A point guard needs always to have in mind the times on the shot clock and the game clock, the score, the numbers of remaining timeouts for both teams, etc.", "Among the taller players who have enjoyed success at the position is Ben Simmons, who at 6\u2019 10\u201d won the 2018 National Basketball Association Rookie of the Year Award.", "Behind him is Magic Johnson, who at 6\u2019 9\u201d (2.06 m) won the National Basketball Association Most Valuable Player Award three times in his career.", "Other point guards who have been named NBA MVP include Russell Westbrook, Bob Cousy, Oscar Robertson, Allen Iverson, Derrick Rose and two-time winners Steve Nash and Stephen Curry.", "In the NBA, point guards are usually about 6' 4\" (1.93 m) or shorter, and average about 6' 2\" (1.88 m)", "whereas in the WNBA, point guards are usually 5' 9\" (1.75 m) or shorter.", "Having above-average size (height, muscle) is considered advantageous, although size is secondary to situational awareness, speed, quickness, and ball handling skills.", "Shorter players tend to be better dribblers since they are closer to the floor, and thus have better control of the ball while dribbling." ] ], "gold": "The National Basketball Association Most Valuable Player Award (MVP) is an annual National Basketball Association (NBA) award given since the 1955\u201356 season to the best performing player of the regular season. The NBA MVP of the 2015 and 2016 season was Stephen Curry. The NBA MVP of the 2017 season was Russell Westbrook.", "prediction 1": "The National Basketball Association Most Valuable Player Award is given since the 1955\u201356 season to the best performing player of the regular season. Until the, the award was selected by a vote of NBA players. Since the, the award is decided by a panel of sportswriters and broadcasters throughout the United States and Canada. In the 2015\u201316 season, Stephen Curry was the only player to win the award unanimously, while in 1999\u20132000, Shaquille O'Neal was the only player to win the award.", "prediction 2": "The National Basketball Association Most Valuable Player Award (MVP) is an annual award given since the 1955\u201356 season to the best performing player of the regular season. The award was first awarded by a vote of NBA players. From 1955\u201356 onwards, the award has been decided by a panel of sportswriters and broadcasters throughout the United States and Canada. The player with the highest point total wins the award.", "prediction 3": "The National Basketball Association Most Valuable Player Award is an annual award given since the 1955\u201356 season to the best performing player of the regular season. The winner receives the Maurice Podoloff Trophy, which is named in honor of the first commissioner of the NBA, who served from 1946 until 1963. The most recent NBA MVP winner was LeBron James on April 9, 2017.", "prediction 4": "The National Basketball Association Most Valuable Player Award (MVP) is an annual National Basketball Association (NBA) award given since the 1955\u201356 season to the best performing player of the regular season. Until the, the award was selected by a vote of NBA players. Since the, the award is decided by a panel of sportswriters and broadcasters throughout the United States and Canada. Since 2010, the award has been decided by fans through online voting.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 460, "end": 471 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 209 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The National Basketball Association Most Valuable Player Award is given since the 1955\u201356 season to the best performing player of the regular season. In the 2015\u201316 season, Stephen Curry won the award, while in 1999\u20132000, Shaquille O'Neal was the winner. 2012-2013 season was won by Lebron James. The current holder is James Harden." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who plays the big deer on open season?", "passages": [ [ "Open Season (film series)", "Open Season (film series)\n\nThe Open Season film series from Sony Pictures Animation consists of four films: \"Open Season\" (2006), \"Open Season 2\" (2008), \"Open Season 3\" (2010), and \"\" (2015), along with a short film \"Boog and Elliot's Midnight Bun Run\" (2007).", "In the tranquil town of Timberline, a 900-pound grizzly bear named Boog has his perfect world turned upside down after he meets Elliot, a one-antlered mule deer.", "After Elliot messes up Boog's nature show, they end up tranquilized by Boog's owner Ranger Beth and then her friend Sheriff Gordy tells her to release them into the Timberline National Forest before open season for only 3 days.", "But when hunting season comes, it is up to Boog and Elliot to rally all the other forest animals and turn the tables on the hunters.", "In the end, Boog decides to stay in the forest and says goodbye to Beth (who had returned to take Boog home).", "One fine spring morning, Elliot gets all prepared for his big wedding with Giselle." ], [ "Open Season (video game)", "Open Season (video game)\n\nOpen Season is a video game, based on the movie of the same name.", "It was released for Wii, PlayStation 2, PlayStation Portable, Microsoft Windows, Game Boy Advance, Xbox 360, Xbox, Nintendo DS, and Nintendo GameCube.", "The Nintendo DS version supports the Nintendo Wi-Fi Connection.", "While Patrick Warburton, Matthew W. Taylor, Nika Futterman and Danny Mann reprise their roles from the movie, most of the original voice actors were replaced (for example, Chris Williams and Matthew W. Taylor are the voices of Boog and Elliot in this game).", "Boog (Chris Williams) is a 900-pound grizzly who is the star of the town Timberline's nature show (using the nickname \"The Mighty Grizzly\").", "In a dream, Boog chases after a giant version of his teddy bear Dinkleman, but he soon wakes up and he's woken by Beth (Kari Wahlgren), who takes him to the town center for Boog's performance.", "But Beth finds that Shaw, the town's nastiest hunter, has already hunted a buck (open season is about 3 days away) and she goes in Sheriff Gordy's police department to confront Shaw.", "The buck (Matthew W. Taylor) wakes up and introduces himself, his name being Elliot." ], [ "Open Season (2006 film)", "Open Season (2006 film)\n\nOpen Season is a 2006 American computer-animated buddy comedy film directed by Jill Culton, Roger Allers and Anthony Stacchi, and written by Steve Bencich and Ron J. Friedman.", "It follows Boog, a domestic bear who teams up with a one-antlered deer named Elliot and other woodland animals to defeat human hunters.", "The film stars the voices of Martin Lawrence, Ashton Kutcher, Gary Sinise, Debra Messing, Billy Connolly, Jon Favreau, Georgia Engel, Jane Krakowski, Gordon Tootoosis and Patrick Warburton.", "It was produced by Sony Pictures Animation as its first theatrical film, and was released by Columbia Pictures on September 29, 2006.", "It has also been released in the IMAX 3D format.", "A video game for the film was released on multiple platforms.", "\"Open Season\" earned $197.3 million on an $85 million budget, and was followed by three direct-to-video sequels: \"Open Season 2\" (2008), \"Open Season 3\" (2010), and \"\" (2015)." ] ], "gold": "The Open Season film series from Sony Pictures Animation consists of the animated film Open Season, released in 2006, and its three direct-to-video sequels Open Season 2, Open Season 3, and Open Season: Scared Silly along with a short film Boog and Elliot's Midnight Bun Run. Ian the big deer is played by Patrick Warburton in the original, Matthew W. Taylor in Open Season 2 and Open Season 3, and Brian Drummond in Open Season: Scared Silly. ", "prediction 1": "Open Season is a 2006 American computer-animated buddy comedy film directed by Jill Culton, Roger Allers and Anthony Stacchi, and written by Steve Bencich and Ron J. Friedman. It follows Boog, a domestic bear who teams up with a one-antlered deer named Elliot and other woodland animals to defeat human hunters. In the film, Chris Williams plays Elliot, the big deer, and in the video game, Matthew W. Taylor plays Elliot. In the open season, the big deer, Matthew W. Taylor plays the big deer.", "prediction 2": "The Open Season film series consists of four films: Open Season (2006), Open Season 2 (2008), Open Season 3 (2010), and Open Season (2015), along with a short film titled \"Boog and Elliot's Midnight Bun Run\" (2007). In the tranquil town of Timberline, a 900-pound grizzly bear named Boog has his perfect world turned upside down after he meets Elliot, a one-antlered mule deer. Chris Williams plays Elliot, and other woodland animals to defeat human hunters. Matthew W. Taylor plays the big deer.", "prediction 3": "Open Season is a 2006 American computer-animated buddy comedy film produced by Sony Pictures Animation and released by Columbia Pictures as its first theatrical film. It follows Boog, a domestic bear who teams up with a one-antlered deer named Elliot and other woodland animals to defeat human hunters. In the film, Matthew W. Taylor plays the voice of the big deer, Elliot. In the video game, the voice of Elliot is provided by Chris Williams.", "prediction 4": "Open Season is a 2006 American computer-animated buddy comedy film directed by Jill Culton, Roger Allers and Anthony Stacchi, and written by Steve Bencich and Ron J. Friedman. It follows Boog, a domestic bear who teams up with a one-antlered deer named Elliot and other woodland animals to defeat human hunters. In the film, Matthew W. Taylor plays the big deer, Elliot. In the video game, Patrick Warburton plays the deer, and Matthew W. Taylor plays Elliot. In the video game, Matthew W. Taylor plays both the big deer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 311 }, { "error type": "Unverifiable", "explanation": "", "start": 312, "end": 367 }, { "error type": "Redundant", "explanation": "Open Season is a 2006 American computer-animated buddy comedy film directed by Jill Culton, Roger Allers and Anthony Stacchi, and written by Steve Bencich and Ron J. Friedman. It follows Boog, a domestic bear who teams up with a one-antlered deer named Elliot and other woodland animals to defeat human hunters. In the film, Chris Williams plays Elliot, the big deer, and in the video game, Matthew W. Taylor plays Elliot. ", "start": 423, "end": 494 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Open Season is a 2006 American computer-animated buddy comedy film from Sony Pictures Animation that was followed by three direct-to-video sequels: \"Open Season 2\", \"Open Season 3\" and the 2015 film, along with a short film \"Boog and Elliot's Midnight Bun Run\". In the video game, Matthew W. Taylor plays Elliot." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did basketball become a sport in the olympics?", "passages": [ [ "Basketball at the Summer Olympics", "Basketball at the Summer Olympics\n\nBasketball at the Summer Olympics has been a sport for men consistently since 1936.", "Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904.", "Women's basketball made its debut in the Summer Olympics in 1976.", "The United States is by far the most successful country in Olympic basketball, with United States men's teams having won 15 of 18 tournaments in which they participated, including seven consecutive titles from 1936 through 1968.", "United States women's teams have won 8 titles out of the 10 tournaments in which they competed, including six in a row from 1996 to 2016.", "Besides the United States, Argentina is the only nation still in existence who has won either the men's or women's tournament.", "The Soviet Union, Yugoslavia and the Unified Team are the countries no longer in existence who have won the tournament.", "The United States are the defending champions in both men's and women's tournaments.", "On June 9, 2017, the Executive Board of the International Olympic Committee announced that 3x3 basketball would become an official Olympic sport as of the 2020 Summer Olympics in Tokyo, Japan, for both men and women.", "Basketball was invented by James Naismith in Springfield, Massachusetts, in 1891.", "Within a few decades, the new game became popular throughout the United States as an indoor sport." ] ], "gold": "Basketball at the Summer Olympics has been a sport for men consistently since 1936. Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904. Women's basketball made its debut in the Summer Olympics in 1976.", "prediction 1": "Basketball has been a sport in the Olympics since 1936. Women's basketball made its debut in the Olympics in 1976. From 1936 to 2020, basketball was a sport in the Olympic Games.", "prediction 2": "Basketball at the Summer Olympics has been a sport for men consistently since 1936. Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904. Women's basketball made its debut in the Summer Olympics in 1976. On June 9, 2017, the Executive Board of the International Olympic Committee announced that 3x3 basketball would become an official Olympic sport as of the 2020 Summer Olympics in Tokyo, Japan, for both men and women.", "prediction 3": "Basketball at the Summer Olympics has been a sport for men consistently since 1936. Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904. Women's basketball made its debut in the Summer Olympics in 1976.", "prediction 4": "Basketball at the Summer Olympics has been a sport for men consistently since 1936. Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904. Women's basketball made its debut in the Summer Olympics in 1976. The United States is by far the most successful country in Olympic basketball, with the United States men's teams having won 15 of 18 tournaments in which they participated, including seven consecutive titles from 1936 through 1968. The United States women's teams have won 8 titles out of the 10 tournaments in which they competed, including six in a row from 1996 to 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 178 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Basketball has been a sport in the Olympics since 1936. Prior to its inclusion as a medal sport, basketball was held as a demonstration event in 1904. Women's basketball made its debut in the Olympics in 1976. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "What type of car was christine in the movie?", "passages": [ [ "Christine (1983 film)", "Christine (1983 film)\n\n", "Christine is a 1983 American psychological horror film directed by John Carpenter and starring Keith Gordon, John Stockwell, Alexandra Paul, Robert Prosky and Harry Dean Stanton.", "The film also features supporting performances from Roberts Blossom and Kelly Preston.", "Written by Bill Phillips and based on Stephen King\u2019s 1983 novel of the same name, the movie follows the changes in the lives of Arnie Cunningham, his friends, his family, and his teenage enemies after Arnie buys a vintage 1958 Plymouth Fury named Christine.", "Strange things happen and the viewers learn the car's secret: That it is possessed by a malign spirit out to even the score with anyone who does the car \u2013 or its owner \u2013 wrong.", "Upon its release, the film grossed $21 million at the US box office.", "Despite a lukewarm reception among critics, the film has become a cult classic.", "In September 1957, at a Chrysler Corporation assembly plant in Detroit, the hood of a newly assembled, custom-painted 1958 Plymouth Fury slams down without warning and crushes the hand of a line worker inspecting its front end.", "Another worker climbs in to sit behind the wheel, letting the ash from his cigar fall on the front seat.", "At the end of the shift, the line supervisor notices the worker slumped in the seat and opens the door; the worker falls to the floor dead, a look of terror on his face." ], [ "Christine (novel)", "Christine (novel)\n\nChristine is a horror novel written by Stephen King, published in 1983.", "It tells the story of a 1958 Plymouth Fury apparently possessed by supernatural forces.", "A film adaptation, directed by John Carpenter, was released in the same year; this adaptation starred Keith Gordon, John Stockwell, Alexandra Paul and Harry Dean Stanton.", "In April 2013, PS Publishing released \"Christine\" in a limited 30th Anniversary Edition.", "In the summer of 1978, while high school student Dennis Guilder is riding home from work with his friend, nerdy teen Arnold \"Arnie\" Cunningham, Arnie spots a dilapidated red and white 1958 Plymouth Fury parked behind a house.", "Arnie makes Dennis stop so he can examine the car, despite Dennis' attempts to talk him out of it.", "Roland D. LeBay, an elderly man wearing a back brace, sells the car\u2014which he had named \"Christine\"\u2014to Arnie for $250.", "While waiting for Arnie to finish the paperwork, Dennis sits inside Christine and has a vision of the car and the surroundings as they were twenty years ago previously, when the car was new.", "Frightened, Dennis decides he dislikes Christine .", "Arnie brings Christine to a do-it-yourself garage run by Will Darnell, who is suspected of using the garage as a front for illicit operations." ], [ "Christine (1983 film)", "Nineteen-year-old Alexandra Paul was cast in the film after audition in New York City; according to Carpenter, Paul was an \"untrained, young actress\" at the time, but brought a \"great quality\" about the character of Leigh.", "According to Paul, she had not read any of King's books or seen Carpenter's films, and read the novel in preparation.", "\"Christine\" was shot largely in Los Angeles, California, while the location for Darnell's garage was located in Santa Clarita.", "Filming began in April 1983, merely days after the King novel had been published.", "The film's stunts were primarily completed by stunt coordinator Terry Leonard, who was behind the wheel of the car during the high-speed chase scenes, as well as the scene in which the car drives down a highway engulfed in flames.", "Although the car in the film is identified as a 1958 Plymouth Fury\u2014and in 1983 radio ads promoting the film, voiceover artists announced, \"she's a '57 Fury\"\u2014two other Plymouth models, the Belvedere and the Savoy, were also used to portray the malevolent automobile onscreen.", "John Carpenter placed ads throughout Southern California searching for models of the car, and was able to purchase twenty-four of them in various states of disrepair, which were used to build a total of seventeen copies of the film car." ] ], "gold": "Although Christine in the film is identified as a classic red and white 1958 Plymouth Fury full-size car, two other Plymouth models, the Belvedere and the Savoy, were also used to portray the malevolent automobile in the 1983 American supernatural horror film Christine.", "prediction 1": "Christine is a psychological horror film directed by John Carpenter and based on Stephen King\u2019s 1983 novel of the same name. The film adaptation of King's novel has become a cult classic. The car in the movie is a 1958 Plymouth Fury, although other Plymouth models were used to portray Christine, including the Belvedere and the Savoy.", "prediction 2": "Christine is a psychological horror movie directed by John Carpenter and starring Keith Gordon, John Stockwell, Alexandra Paul, Robert Prosky and Harry Dean Stanton. The film follows the changes in the lives of Arnie Cunningham, his friends, his family, and his teenage enemies after Arnie buys a vintage 1958 Plymouth Fury named Christine. Although the car in the film is identified as a 1958 Plymouth Fury, two other Plymouth models, the Belvedere and the Savoy, were also used to portray the malevolent automobile onscreen.", "prediction 3": "Christine is a psychological horror film directed by John Carpenter and based on Stephen King's 1983 novel of the same name. It tells the story of a 1958 Plymouth Fury that is possessed by a spirit who wants to even the score with anyone who does the car \u2013 or its owner \u2013 wrong. The car in the movie was a 1958 Plymouth Fury, although two other Plymouth models, the Belvedere and the Savoy, were also used to portray the malevolent automobile onscreen.", "prediction 4": "Christine is a psychological horror film directed by John Carpenter and starring Keith Gordon, John Stockwell, Alexandra Paul, Robert Prosky and Harry Dean Stanton. The movie follows the changes in the lives of Arnie Cunningham, his friends, his family, and his teenage enemies after Arnie buys a vintage 1958 Plymouth Fury named Christine. Christine is a horror novel written by Stephen King, published in 1983. It tells the story of a 1958 Plymouth Fury apparently possessed by supernatural forces. A film adaptation, directed by Carpenter, was released in the same year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 124 } ], "missing-info": [], "corrected-prediction": "Christine is a 1983 psychological horror film. The car in the movie is a 1958 Plymouth Fury, although other Plymouth models were used to portray Christine, including the Belvedere and the Savoy." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "How did the atlanta falcons owner make his money?", "passages": [ [ "Arthur Blank", "Arthur Blank\n\nArthur M. Blank (born September 27, 1942) is an American businessman and a co-founder of The Home Depot.", "Today he is known for his ownership of the Atlanta Falcons in the National Football League, and Atlanta United in Major League Soccer.", "Arthur Blank was born to a Jewish family in Flushing, New York.", "His father, Max Blank, was a pharmacist and his mother, Molly Blank, was a mother of two sons, Arthur and his older brother Michael.", "Blank graduated from Stuyvesant High School in New York City.", "After graduating from Babson College, Blank was hired by Arthur Young and Company, where he was a senior accountant.", "He later joined the Daylin Corporation, where he rose to become president of Elliott's Drug Stores/Stripe Discount Stores, a division of Daylin.", "When Daylin decided to sell off that division, Blank moved to another division, Handy Dan Home Improvement Centers.", "Bernard Marcus was CEO of Handy Dan and Blank was vice president of finance when both were fired in 1978 as part of an internal power struggle.", "In 1978, Blank co-founded Home Depot with Marcus.", "New York investment banker Ken Langone assembled the initial group of investors and merchandising expert Patrick Farrah helped founders realize their vision of one-stop shopping for the do-it-yourselfer." ], [ "Bernard Marcus", "Bernard Marcus\n\nBernard \"Bernie\" Marcus (born May 12, 1929) is an American billionaire businessman.", "He co-founded Home Depot and was the company's first CEO; he served as Chairman of the Board until retiring in 2002.", "Bernard Marcus was born to Russian Jewish immigrant parents in Newark, New Jersey.", "He grew up in a tenement and graduated from South Side High School in 1947.", "Marcus wanted to become a doctor but could not afford the tuition, so he worked for his father as a cabinet maker enlist studying at Rutgers University for a pharmacy degree.", "While there he joined the Alpha Epsilon Pi fraternity.", "Later, Marcus worked at a drugstore as a pharmacist but became more interested in the retailing side of the business.", "He worked at a cosmetics company and various other retail jobs, eventually reaching a position as CEO of Handy Dan Improvement Centers, a Los Angeles-based chain of home improvement stores.", "In 1978 both he and future Home Depot co-founder Arthur Blank were fired during a corporate power struggle at Handy Dan.", "In 1979 they founded the home-improvement retailer The Home Depot, with the help of merchandising expert Pat Farrah and New York investment banker Ken Langone who assembled a group of investors.", "The store revolutionized the home improvement business with its warehouse concept.", "Blank, Marcus, and Langone became billionaires." ] ], "gold": "Arthur M. Blank, owner of the Atlanta Falcons, is an American businessman who co-founded Home Depot. After graduating from Babson Institute in 1963, Blank was hired by Arthur Young and Company, where he was a senior accountant. He later joined the Daylin corporation, where he rose to become president of Elliott's Drug Stores, a division of Daylin. When Daylin decided to sell off that division, Blank moved to another division, Handy Dan Home Improvement Centers. Bernard Marcus was CEO of Handy Dan and Blank was vice president of finance when both were fired in 1978 as part of an internal power struggle. In 1978, Blank co-founded Home Depot with Marcus. The store revolutionized the home improvement business with its warehouse concept and Blank and Marcus became billionaires as a result.", "prediction 1": "Arthur Blank is an American businessman and a co-founder of The Home Depot, a home improvement retailer that revolutionized the home improvement business with its warehouse concept. As a result, Arthur Blank is known for his ownership of the Atlanta Falcons in the National Football League and Atlanta United in Major League Soccer. In 1978, Blank co-founded Home Depot with Bernard Marcus, a billionaire businessman. Marcus is CEO of Handy Dan Home Improvement Centers and Blank is vice president of finance when both were fired in 1978 as part of an internal power struggle.", "prediction 2": "Arthur Blank is an American businessman and a co-founder of The Home Depot. Arthur Blank is known for his ownership of the Atlanta Falcons in the National Football League, and Atlanta United in Major League Soccer. Blank was also an early investor in The Home Depot, which revolutionized the home improvement business with its warehouse concept.", "prediction 3": "Arthur M. Blank is an American businessman and a co-founder of The Home Depot. He is known for his ownership of the Atlanta Falcons in the National Football League, and Atlanta United in Major League Soccer. Blank was fired in 1978 during a corporate power struggle at Handy Dan. He co-founded Home Depot and was the company's first CEO.", "prediction 4": "Arthur M. Blank is an American businessman and a co-founder of The Home Depot. He is best known for his ownership of the Atlanta Falcons in the National Football League, and Atlanta United in Major League Soccer. Blank and Bernard Marcus are billionaires who co-founded Home Depot in 1978.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 332 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 12 ] } ], "corrected-prediction": "Arthur Blank is an American businessman and a co-founder of The Home Depot. After graduating from Babson College, Blank was hired by Arthur Young and Company, where he was a senior accountant. He later joined the Daylin Corporation, where he rose to become president of Elliott's Drug Stores/Stripe Discount Stores, a division of Daylin. When Daylin decided to sell off that division, Blank moved to another division, Handy Dan Home Improvement Centers. Bernard Marcus was CEO of Handy Dan and Blank was vice president of finance when both were fired in 1978 as part of an internal power struggle. In 1978, Blank co-founded Home Depot with Marcus. The store revolutionized the home improvement business with its warehouse concept. Blank, Marcus, and Langone became billionaires. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did they change the name of mount mckinley to denali?", "passages": [ [ "Denali\u2013Mount McKinley naming dispute", "In 1975, the Alaska Board of Geographic Names changed the name of the mountain to Denali, and, at Governor Jay Hammond's behest, the Alaska Legislature officially requested that the United States Board on Geographic Names (BGN), the federal governmental body responsible for naming geographic features in the United States, change the name of the mountain from \"Mount McKinley\" to \"Mount Denali\".", "Ohio congressman Ralph Regula (whose district included Canton, where McKinley spent much of his life) opposed action by the U.S. Board and was able to prevent it.", "At first, the Board consideration was delayed by opposition from Secretary of the Interior Rogers Morton, under whose purview the board fell, as he personally did not favor a change of the mountain's name.", "Later, in 1977, with Secretary Morton no longer at the helm of the Department of the Interior, the Board again prepared to consider the name change, but Regula gathered signatures from every member of the Ohio congressional delegation against renaming Mount McKinley, and no ruling was made.", "On December 2, 1980, with President Jimmy Carter's signing into law of the Alaska National Interest Lands Conservation Act (ANILCA), McKinley National Park\u2014which had been created on February 26, 1917\u2014was incorporated into a larger protected area named Denali National Park and Preserve." ], [ "Denali\u2013Mount McKinley naming dispute", "Despite efforts in Alaska, Ohio Representatives Betty Sutton and Tim Ryan assumed Regula's role as congressional guardians of the Mount McKinley name and introduced H.R. 229 which reads: \"Notwithstanding any other authority of law, the mountain located 63 degrees 04 minutes 12 seconds north, by 151 degrees 00 minutes 18 seconds west shall continue to be named and referred to for all purposes as Mount McKinley.\"", "A January 2015 bill submitted by Alaska Senator Lisa Murkowski re-proposed renaming North America's highest peak as Denali.", "In June 2015 testimony to Congress, the National Park Service's associate director stated that the NPS \"has no objection to adopting the name of Denali for Mt. McKinley\".", "On August 30, 2015, Sally Jewell announced that the mountain would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a \"reasonable\" period of time.", "In media interviews, Jewell cited the board's failure to act on the state's four-decade-old request, saying \"I think any of us would think that 40 years is an unreasonable amount of time.\"", "Ohio Republicans were critical of the renaming." ], [ "Denali\u2013Mount McKinley naming dispute", "Denali\u2013Mount McKinley naming dispute\n\nThe name of the highest mountain in North America became a subject of dispute in 1975, when the Alaska Legislature asked the U.S. federal government to officially change its name from \"Mount McKinley\" to \"Denali\".", "The mountain had been unofficially named Mount McKinley in 1896 by a gold prospector, and officially by the Federal government of the United States in 1917 to commemorate William McKinley, who was President of the United States from 1897 until his assassination in 1901.", "The name \"Denali\" is based on the Koyukon name of the mountain, \"Deenaalee\" (\"the high one\").", "The Koyukon are a people of Alaskan Athabaskans settling in the area north of the mountain.", "Alaska in 1975 requested that the mountain be officially recognized as Denali, as it was still the common name used in the state.", "Attempts by the Alaskan state government to have Mount McKinley's name changed by the federal government were blocked by members of the congressional delegation from Ohio, the home state of the mountain's presidential namesake.", "In August 2015, Secretary of the Interior Sally Jewell announced the name would officially be changed in all federal documents.", "While on an Alaskan visit in the first week of September 2015, President Barack Obama announced the renaming of the mountain." ] ], "gold": "The name of the highest mountain in North America became a subject of dispute in 1975 when the Alaska Legislature asked the U.S. federal government to officially change its name from Mount McKinley to Denali. Attempts by the Alaskan state government to have Mount McKinley's name changed by the federal government were blocked by members of the congressional delegation from Ohio, the home state of the mountain's presidential namesake. However, on August 30, 2015, Sally Jewell announced that the mountain would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a reasonable period of time. In media interviews, Jewell cited the board's failure to act on the state's four-decade-old request, saying \"I think any of us would think that 40 years is an unreasonable amount of time.\" Then, while on an Alaskan visit in the first week of September 2015, President Barack Obama announced the renaming of the mountain.", "prediction 1": "The name of the highest mountain in North America became a subject of dispute in 1975, when the Alaska Legislature asked the U.S. federal government to officially change its name from \"Mount McKinley\" to \"Denali\". In August 2015, Secretary of the Interior Sally Jewell announced the name would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a \"reasonable period of time\".", "prediction 2": "The name of the highest mountain in North America became a subject of dispute in 1975, when the Alaska Legislature asked the U.S. federal government to officially change its name from \"Mount McKinley\" to \"Denali\". In June 2015 testimony to Congress, the National Park Service's associate director stated that the NPS \"has no objection to adopting the name of Denali for Mt. McKinley\". In August 2015, Secretary of the Interior Sally Jewell announced the name would be officially changed in all federal documents.", "prediction 3": "The state of Alaska requested in 1975 that the name of the highest mountain in North America be officially changed from Mount McKinley to Denali, and on December 2, 1980, with President Jimmy Carter's signing into law of the Alaska National Interest Lands Conservation Act, the name was changed to Denali. A January 2015 bill submitted by Alaska Senator Lisa Murkowski re-proposed renaming North America's highest peak as Denali. On August 30, 2015, Secretary of the Interior Sally Jewell announced the mountain would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a reasonable period of time.", "prediction 4": "In 1975, the Alaska Board of Geographic Names changed the name of the mountain to Denali, and at Governor Jay Hammond's behest, the Alaska Legislature officially requested that the United States Board on Geographic Names, the federal government governmental body responsible for naming geographic features in the United States, change the name of the mountain from Mount McKinley to Mount Denali. On August 30, 2015, Secretary of the Interior Sally Jewell announced that the mountain would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a reasonable period of time.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The name of the highest mountain in North America became a subject of dispute in 1975, when the Alaska Legislature asked the U.S. federal government to officially change its name from \"Mount McKinley\" to \"Denali\". Attempts by the Alaskan state government to have Mount McKinley's name changed by the federal government were blocked by members of the congressional delegation from Ohio, the home state of the mountain's presidential namesake. On August 30, 2015, Sally Jewell announced that the mountain would be renamed Denali, under authority of federal law which permits her as Secretary of the Interior to name geographic features if the Board of Geographic Names does not act within a \"reasonable\" period of time. In media interviews, Jewell cited the board's failure to act on the state's four-decade-old request, saying \"I think any of us would think that 40 years is an unreasonable amount of time.\" While on an Alaskan visit in the first week of September 2015, President Barack Obama announced the renaming of the mountain. " }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When was the last time the pittsburgh steelers went to the super bowl?", "passages": [ [ "Pittsburgh Steelers", "Cowher's career record with Pittsburgh was 149\u201390\u20131 in the regular season and 161\u201399\u20131 overall, including playoff games.", "On January 7, 2007, Cowher resigned from coaching the Steelers, citing a need to spend more time with his family.", "He did not use the term \"retire\", leaving open a possible return to the NFL as coach of another team.", "A three-man committee consisting of Art Rooney II, Dan Rooney, and Kevin Colbert was set up to conduct interviews for the head coaching vacancy.", "The candidates interviewed included: offensive coordinator Ken Whisenhunt, offensive line coach Russ Grimm, former offensive coordinator Chan Gailey, Minnesota Vikings defensive coordinator Mike Tomlin, and Chicago Bears defensive coordinator Ron Rivera.", "On January 22, 2007, Mike Tomlin was announced as Cowher's successor as head coach.", "Tomlin is the first African-American to be named head coach of the Pittsburgh Steelers in its 75-year history.", "Tomlin became the third consecutive Steelers Head Coach to go to the Super Bowl, equaling the Dallas Cowboys (Tom Landry, Jimmy Johnson and Barry Switzer) in this achievement.", "He was named the Motorola 2008 Coach of the Year.", "On February 1, 2009, Tomlin led the Steelers to their second Super Bowl of this decade, and went on to win 27\u201323 against the Arizona Cardinals." ], [ "Pittsburgh Steelers", "Pittsburgh Steelers\n\nThe Pittsburgh Steelers are a professional American football team based in Pittsburgh, Pennsylvania.", "The Steelers compete in the National Football League (NFL), as a member club of the league's American Football Conference (AFC)", "North division.", "Founded in , the Steelers are the oldest franchise in the AFC.", "In contrast with their status as perennial also-rans in the pre-merger NFL, where they were the oldest team never to win a league championship, the Steelers of the post-merger (modern) era are one of the most successful NFL franchises.", "Pittsburgh has won more Super Bowl titles (6) and both played in (16) and hosted more conference championship games (11) than any other NFL team.", "The Steelers have won 8 AFC championships, tied with the Denver Broncos, but behind the New England Patriots' record 10 AFC championships.", "The Steelers share the record for second most Super Bowl appearances with the Broncos, and Dallas Cowboys (8).", "The Steelers lost their most recent championship appearance, Super Bowl XLV, on February 6, 2011.", "The Steelers, whose history traces to a regional pro team that was established in the early 1920s, joined the NFL as the Pittsburgh Pirates on July 8, 1933, owned by Art Rooney and taking its original name from the baseball team of the same name, as was common practice for NFL teams at the time." ] ], "gold": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh. The team is tied with the New England Patriots for the most Super Bowl titles at six, and they have both played in (16 times) and hosted (11 times) more conference championship games than any other team in the NFL. They lost their most recent championship appearance, Super Bowl XLV, on February 6, 2011.", "prediction 1": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh. They compete in the National Football League as a member club of the league's American Football Conference North division. The last time the Steelers went to the Super Bowl was in 2002.", "prediction 2": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh. They are the youngest team in the National Football League (NFL) and the oldest franchise in the American Football Conference. They compete in the league as a member club of the league's American Football Conference North division. They were last at the Super Bowl on February 6, 2011. They lost their most recent championship appearance, Super Bowl XLV, on February 6, 2011.", "prediction 3": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh. They compete in the National Football League as a member club of the league's American Football Conference North division. They have made two Super Bowl appearances. Last time they went to the Super Bowl was on February 6, 2011.", "prediction 4": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh, Pennsylvania. They compete in the National Football League as a member club of the league's American Football Conference North division. On January 7, 2007, Jim Cowher resigned from coaching the Steelers, citing a need to spend more time with his family. On February 1, 2009, Mike Tomlin led the Steelers to their second Super Bowl of this decade, and went on to win 27\u201323 against the Arizona Cardinals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 209 }, { "error type": "Unverifiable", "explanation": "", "start": 210, "end": 272 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Pittsburgh Steelers are a professional American football team based in Pittsburgh. Pittsburgh has won more Super Bowl titles (6) and both played in (16) and hosted more conference championship games (11) than any other NFL team. They compete in the National Football League as a member club of the league's American Football Conference North division. The Steelers lost their most recent championship appearance, Super Bowl XLV, on February 6, 2011." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won maximum medal in asian games 2018?", "passages": [ [ "2018 Asian Games medal table", "2018 Asian Games medal table\n\nThe 2018 Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by Olympic Council of Asia (OCA).", "It was held at Jakarta and Palembang, Indonesia between 18 August \u2013 2 September 2018, with 465 events in 40 sports and disciplines featured in the Games.", "This resulted in 465 medal sets being distributed.", "Two bronze medals were awarded in some sports: all events in badminton (7), boxing (10), bridge (6), fencing (12), judo (15), jujitsu (8), kabaddi (2), karate (12), kurash (7), Ssambo (4), sepak takraw (6), soft tennis (5), squash (4), table tennis (5), taekwondo (14), tennis (5) and wrestling (18), most events in pencak silat (10) and some events in wushu (6).", "Furthermore, there was a third-place tie in athletics men's high jump event, giving a total of 157 additional bronze medals.", "As a result, a total of 1,552 medals comprising 465 gold medals, 465 silver medals, and 622 bronze medals were awarded to athletes." ], [ "Sumit Malik", "Sumit Malik\n\nSumit Malik (born 9 January 1993) is a freestyle wrestler from India who competes in 125\u00a0kg category.", "He was gold medallist at the 2018 Commonwealth Games.", "He has also been silver medalist at both the Asian Wrestling Championships and the Commonwealth Wrestling Championship in 2017.", "Malik was born on 9 January 1993 in Karor village of Haryana's Rohtak district.", "His mother died when he was young, after which his maternal grandparents took him to his maternal home in Delhi.", "There his maternal uncle was a wrestler in Chhatrasal Stadium, from whom he got inspiration to become wrestler.", "He has been training at Chhatrasal Stadium since the age of 13.", "Malik's first bout at the 2017 Asian Wrestling Championships was in quarterfinals where he defeated Japan's Taiki Yamamoto by 6\u20133.", "After winning his next bout against Tajikistan's Farkhod Anakulov by 7\u20132, he lost in the final to Iran's Yadollah Mohebbi by 6\u20132.", "Later in the year, he participated in the 2017 World Wrestling Championships, where he lost in the opening bout to Russia's Anzor Khizriev.", "As Khizriev did not become finalist, Malik did not get another chance to make comeback via repechage.", "In November, he won 2017 National wrestling championships after defeating Hitender in the final." ], [ "India at the 2018 Asian Games", "India at the 2018 Asian Games\n\nIndia competed at the 2018 Asian Games in Jakarta and Palembang, Indonesia, from 18th August to 2nd September.", "Neeraj Chopra was the flag bearer for the opening ceremony while Rani Rampal was named as the flag bearer for the closing ceremony.", "India bettered its previous best medal haul achieved 8 years earlier at the 2010 Asian Games in Guangzhou, China.", "The following is a list of the number of competitors representing India in each sport at the Games:\n\n\nThe Swimming Federation of India (SFI) announced the Diving team for the Games as follows:\n\nThe Swimming Federation of India (SFI) selected an 10-member swimming squad as follows for the Asian Games:\n\n\n\n\n\n\n\n\nThe Badminton Association of India (BAI) announced a 20-member squad for the Asian Games.", "India women's team drawn in group X at the Games.", "Indian boxer Amit Panghal defeated reigning Olympic champion & World Championship silver medalist Hasanboy Dusmatov to clinch the Gold medal in Boxing at the 2018 Asian Games \u2013 Men's 49 kg\n\nBoxer Vikas Krishnan become the first Indian boxer to win medals in three successive editions of the Boxing at the Asian Games\n\nThe Bridge Federation of India picked a 24-member squad along with six reserves for the Asian Games.", "India put up a men's and a women's team of a total of 32 athletes (16 men and 16 women)." ] ], "gold": "The 2018 Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by Olympic Council of Asia (OCA). The most total medals in the Asian Games was won by the People's Republic of China. The People's Republic of China also won the most gold and silver medals at the games. Japan won the most bronze medals.", "prediction 1": "The Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by Olympic Council of Asia (OCA). At the 2018 Asian Games, Sumit Malik, who competes in freestyle wrestling in 125 kg category, won the maximum number of medals at the Games. Amit Panghal, an Indian boxer, won the maximum number of medals at the Games. Vikas Krishnan, a Indian wrestler, won the maximum number of medals at the Games.", "prediction 2": "The 2018 Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by Olympic Council of Asia (OCA). It was held at Jakarta and Palembang, Indonesia between 18 August \u2013 2 September 2018, with 465 events in 40 sports and disciplines featured in the Games. As a result, a total of 1,552 medals comprising 465 gold medals, 465 silver medals, and 622 bronze medals were awarded to athletes. Indian boxer Amit Panghal defeated reigning Olympic champion & World Championship silver medalist Hasanboy Dusmatov to clinch the Gold medal in Boxing at the Asian Games.", "prediction 3": "The Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by the Olympic Council of Asia (OCA). It was held at Jakarta and Palembang, Indonesia between 18 August \u2013 2 September 2018. Total number of medals won by Indian athletes in Asian Games 2018 was 1,652. Indian boxer Amit Panghal won the gold medal in Boxing and women's 49 kg boxer Vikas Krishnan won the most medals in the Asian Games.", "prediction 4": "The Asian Games was the largest sporting event in Asia governed by Olympic Council of Asia. Sumit Malik, a freestyle wrestler from India, won the maximum gold medal in wrestling at the 2018 Commonwealth Games. Amit Panghal, a boxer and former Olympian and World Champion, won the maximum silver medal in boxing at the 2018 Asian Games. Vikas Krishnan won the maximum bronze medal in wrestling.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 275 }, { "error type": "Unverifiable", "explanation": "", "start": 276, "end": 353 }, { "error type": "Unverifiable", "explanation": "", "start": 354, "end": 435 } ], "missing-info": [], "corrected-prediction": "The Asian Games, officially known as the XVIII Asiad, is the largest sporting event in Asia governed by Olympic Council of Asia (OCA)." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "A person who speaks several languages is called?", "passages": [ [ "Polyglotism", "Polyglotism\n\nPolyglotism or polyglottism is knowledge of several languages, consisting of the ability to understand, speak, read, or write these languages.", "The word is a synonym of multilingualism, but in recent usage polyglot is sometimes used to refer to a person who learns multiple languages as an avocation.", "The term \"hyperpolyglot\" was coined in 2008 by linguist Richard Hudson to describe individuals who speak\u2014to some degree\u2014dozens of languages.", "Multilingualism, including multilingual societies as well as individuals who speak more than one language, is common.", "Individual polyglots or hyperpolyglots speak, study, or use large numbers of languages.", "In rare cases, polyglot savants have mental disabilities, but are able to learn many languages.", "Most nation states are home to multiple ethnic groups and multiple languages, and most of the world's population is bilingual or multilingual.", "In other words, only a minority of the world's peoples are monolingual Informal surveys suggest that the number of languages spoken in multilingual societies is typically between two and six languages.", "However, there is a lack of consensus on such numbers due to the lack of shared definitions of multilingualism and the difficulty of differentiating among language varieties.", "Some individuals speak, study, or otherwise use large numbers of languages." ] ], "gold": "A person who has a command of several languages is called a polyglot, while a person or a community that uses several languages is called multilingual, as that term is used for communities as well as individuals.", "prediction 1": "Individual polyglots or polyglots speak, study, or otherwise use large numbers of languages. Hyperpolyglots are individuals who speak, study, or otherwise use large numbers of languages. In rare cases, polyglot savants have mental disabilities, but are able to learn many languages.", "prediction 2": "Polyglotism, or polyglottism, is knowledge of several languages, consisting of the ability to understand, speak, read, or write these languages. The word is a synonym of multilingualism, but in recent usage polyglot is sometimes used to refer to a person who learns multiple languages as an avocation. The term \"hyperpolyglot\" was coined in 2008 by linguist Richard Hudson to describe individuals who speak\u2014to some degree\u2014dozens of languages.", "prediction 3": "Polyglot or polyglottism is the ability to understand, speak, read, or write several languages. The word multilingualism is a synonym of multilingualism, but in recent usage polyglot is sometimes used to refer to a person who learns multiple languages as an avocation. The term hyperpolyglot was coined in 2008 by linguist Richard Hudson to describe individuals who speak\u2014to some degree\u2014dozens of languages.", "prediction 4": "Polyglotism is knowledge of several languages, consisting of the ability to understand, speak, read, or write these languages. The term \"hyperpolyglot\" was coined in 2008 by linguist Richard Hudson to describe individuals who speak\u2014to some degree\u2014dozens of languages.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 282 }, { "error type": "Incoherent", "explanation": "", "start": 51, "end": 60 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 186 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Individual polyglots or polyglots speak, study, or otherwise use large numbers of languages. Multilingualism, including multilingual societies as well as individuals who speak more than one language, is common." }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "My little pony with white flower cutie mark?", "passages": [ [ "My Little Pony (2010 toyline)", "My Little Pony (2010 toyline)\n\n", "In 2010, American toy company Hasbro relaunched its My Little Pony toyline and media franchise originally created in the 1980s, with the animated television series \"\" as a flagship non-toy media.", "This generation is not given any name by Hasbro, but some of later releases of toys are labeled with the subtitle \"Friendship Is Magic\".", "It is unofficially referred to the \"Fourth Generation\", \"Generation Four\" or \"G4\" by collectors.", "It takes place in the fictional location named Equestria, a society inhabited by three kinds of ponies (earth ponies, unicorns and pegasi) and other species, with winged unicorns \u2013 named \"alicorns\" in later releases despite the word's origin \u2013 having royal status.", "With the success of the \"Friendship Is Magic\" television series, it also generated a .", "The line grossed over US$650 million in retail sales in 2013, and $1 billion annually in retail sales in 2014, and 2015.", "This particular era has an anthropomorphic spin-off, subtitled ." ], [ "My Little Pony (1982 toyline)", "Mail-order ponies were generally reissues like Majesty, which was previously available only with the Dream Castle Playset, or unique ponies such as the first boy pony, Lucky the stallion.", "Another line of exclusively mail-order ponies was the Birthflower ponies, which featured a pony for every month of the year.", "All had white bodies with pink hair and tails; their names were Carnation, Violet, Daffodil, Daisy, Lily of the Valley, Rose, Water Lily, Poppy, Morning Glory, Cosmos, Chrysantheum and Holly.", "Special baby ponies, such as the Pearlized Baby Ponies and Twice-As-Fancy babies, were also available by mail order.", "Some mail-order ponies, such as Sweet Scoops, Goldilocks and Rapunzel are rare and sought after by collectors.", "Some companies were licensed under Hasbro to produce their own line of ponies instead of shipping them from China or Hong Kong, where the vast majority of ponies were produced; these companies were located in Argentina, Brazil, France, Greece, India, Italy, Macau, Mexico and Spain.", "Some of these ponies are very similar to their Asian counterparts.", "For example, the Italian Clio looks very similar to Glory, with the most obvious difference being a non-glittery symbol." ] ], "gold": "In the My Little Pony franchise, the Earth ponies are ponies without a horn or wings. They were the first ponies to come out in 1983. They lack the ability to cast magic spells like unicorns, or the ability to stand on clouds like the pegasi. Usually, they are the basic form of the My Little Pony toys. Both Flower Wishes and Daisyjo have white daisies in their cutie marks, but Daisyjo has green leaves on her cutie mark as well.", "prediction 1": "In 2010, American toy company Hasbro relaunched its My Little Pony toyline and media franchise originally created in the 1980s, with the animated television series \"Friendship Is Magic\" as a flagship non-toy media. This generation is not given any name by Hasbro, but some of later releases of toys are labeled with the subtitle \"Friendship Is Magic\". It is unofficially referred to the \"Fourth Generation\", \"Generation Four\" or \"G4\" by collectors.\n", "prediction 2": "There have been many My Little Pony toys released since the 1980s, with the white milky ponies having the flower cutie marks resembling a flower. The line originally spawned in 1982 in the US and later in Europe. In 2010, American toy company Hasbro relaunched the toyline, with the animated television series My Little Pony as a flagship non-toy media. Some of later releases of toys are labeled with the subtitle \"Friendship Is Magic\". This generation is not given any name by Hasbro, but some of later releases are labeled with the subtitle \"Friendship Is Magic\". This particular era has an anthropomorphic spin-off, which first directed by Hasbro.", "prediction 3": "In October 2010, Hasbro relaunched its My Little Pony toyline and media franchise originally created in the 1980s, with the animated television series \"My Little Pony\" as a flagship non-toy media. This generation is not given any name by Hasbro, but some of later releases of toys are labeled with the subtitle \"Friendship Is Magic\". It is unofficially referred to the \"Fourth Generation\", \"Generation Four\" or \"G4\" by collectors. The toys were all white bodies with pink hair and tails; their names were Carnation, Violet, Daffodil, Daisy, Daisy, Rose, Water Lily, Poppy, Morning Glory, Cosmos, Chrysantheum and Holly.", "prediction 4": "American toy company Hasbro relaunched its My Little Pony toyline and media franchise originally created in the 1980s, with the animated television series \"\" as a flagship non-toy media. The line grossed over US$650 million in retail sales in 2013, and $1 billion annually in retail sales in 2014, and 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 351 }, { "error type": "Irrelevant", "explanation": "", "start": 352, "end": 449 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the circle of life at the beginning of the lion king?", "passages": [ [ "Circle of Life", "Circle of Life\n\n\"Circle of Life\" is a song from Disney's 1994 animated film \"The Lion King\".", "Composed by Elton John, with lyrics by Tim Rice, the song was performed by Carmen Twillie (the deep female lead vocals) and Lebo M. (opening Zulu vocals) as the film's opening song.", "In an interview, Rice said he was amazed at the speed with which John composed: \"I gave him the lyrics at the beginning of the session at about two in the afternoon.", "By half-past three, he'd finished writing and recording a stunning demo.\"", "Elton John sang a pop version (with alternative lyrics) of the song with the London Community Gospel Choir, which was included in the film's soundtrack and made into a music video.", "\"Circle of Life\" was nominated for the Academy Award for Best Original Song in 1994, along with two other songs from \"The Lion King\": \"Hakuna Matata\" and \"Can You Feel the Love Tonight,\" the latter of which won the award.", "The song reached No. 11 in the UK and No. 18 in the United States and is featured frequently in attractions based on \"The Lion King\", such as Disney theme parks and parades.", "Michael Crawford sang it as part of a medley for \"The Disney Album\" in 2001." ], [ "Circle of Life", "The song will be featured in Disney's 2019 photorealistic computer-animated remake of \"The Lion King\" and was used in the first trailer of the film, a near shot-for-shot remake of the opening of the original animated film.", "In the theatrical adaption, the opening sequence is noticeably different from the opening of the film.", "For example, the song is sung by Rafiki instead of an off-screen female narrator.", "With the sun rising over the Pride Lands, Rafiki commences the start of the production by singing the opening chant of the song and summoning the animals of the Pride Lands for the presentation of baby Simba.", "As the first two verses of the musical number end, a representation of Pride Rock appears on stage carrying its two reigning rulers, Sarabi cradling the small puppet representing her son in her arms with Mufasa alongside her.", "As the choir chants excitedly in the background, Rafiki accompanies the two monarchs to the top of Pride Rock to bless the cub before raising him high in the air, singing joyfully alongside the chorus as the gathered animals bow before their new prince.", "At the end of Act II, Simba's friends and family acknowledge him as the rightful king after Scar's defeat.", "Rafiki crowns Simba with the mantle of kingship after his victory and Simba ascends Pride Rock." ] ], "gold": "There were several films entitled The Lion King, including a 1994 film and a 2019 film. Carmen Twillie sings Circle of Life as deep female lead vocals at the beginning of the 1994 film, while Brown Lindiwe Mkhize does at the beginning of the 2019 film. Lebohang \"Lebo M\" Morake sings the song as Zulu vocals at the beginning of the 1994 film. The 2019 film retained the original Zulu opening vocals by Lebo M from the 1994 film.", "prediction 1": "\"Circle of Life\" is a song from Disney's 1994 animated film The Lion King. Composed by Elton John, with lyrics by Tim Rice, the song was performed by Carmen Twillie - the deep female lead vocals - and Lebo M. - the opening Zulu vocals - as the film's opening song. Elton John sang a pop version of the song with the London Community Gospel Choir, which was included in the film's soundtrack and made into a music video.", "prediction 2": "There are several songs that open Disney's 1994 animated film titled \"The Lion King\". In the opening of the 1994 film, Carmen Twillie sings the deep female lead vocals and Lebo M. sings the opening Zulu vocals. Elton John sang a pop version of the song with the London Community Gospel Choir.", "prediction 3": "In the 1994 animated film The Lion King, Carmen Twillie sings the deep female lead vocals while Lebo M. sings the opening Zulu vocals. Elton John sang a pop version (with alternative lyrics) of the song with the London Community Gospel Choir. Michael Crawford sang it as part of a medley for The Disney Album in 2001. The song is sung by Rafiki instead of an off-screen female narrator.", "prediction 4": "The opening song to Disney's 1994 film The Lion King is the circle of life. Composed by Elton John with lyrics by Tim Rice, the song was performed by Carmen Twillie (the deep female lead vocals) and Lebo M. (opening Zulu vocals) as the film's opening song. Elton John sang a pop version of the song with the London Community Gospel Choir, which was included in the film's soundtrack and made into a music video.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 265, "end": 419 }, { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 123 } ], "missing-info": [], "corrected-prediction": "\"Circle of Life\" is a song from Disney's 1994 animated film The Lion King. The song was performed by Carmen Twillie - the deep female lead vocals - and Lebo M. - the opening Zulu vocals - as the film's opening song. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "The barkana waterfalls is located in which state?", "passages": [ [ "Mysore district", "Mysore district\n\nMysore", "[officially known as 'Mysuru'] District is an administrative district located in the southern part of the state of Karnataka, India.", "The district is bounded by Mandya district to the east and northeast, Chamrajanagar district to the southeast, Kerala state to the south, Kodagu district to the west, and Hassan district to the north.", "It features many tourist destinations, from Mysore Palace to Nagarhole National Park.", "This district has a prominent place in the history of Karnataka; Mysore was ruled by the Wodeyars from the year 1399 till the independence of India in the year 1947.", "Mysore's prominence can be gauged from the fact that the Karnataka state was known previously as Mysore state.", "It is the third-most populous district in Karnataka (out of 30), after Bangalore Urban.", "Mysore district gets its name from the city of Mysore which is also the headquarters of the district.", "The original name of this city was Mahishapura derived from a demon named Mahishasura.", "A statue of Mahishasura, after whom the city is named, and a temple dedicated to Goddess Chamundeshwari on the top of Chamundi Hill near Mysore city, relate to the legend of its origin." ], [ "Barkana Falls", "Barkana Falls\n\nThe Barkana Falls, formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India and the water falls is among the ten highest waterfalls in India.", "The water falls is filled with water only during rainy season.", "Barkana falls is located at a distance of 10\u00a0km from Agumbe and has a height of about 500 feet and the area is surrounded by thick forest of Western Ghats." ] ], "gold": "The Barkana Falls, formed by Seetha River, is a water falls located in the state of Karnataka, India and the water falls is among the ten highest waterfalls in India. Karnataka State was originally known as the State of Mysore.", "prediction 1": "The Barkana Falls, formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India and the water falls is among the ten highest waterfalls in India. It is located in Mysore district, which is an administrative district in the southern part of the state.", "prediction 2": "The Barkana Falls, which is formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India. The water falls is among the ten highest waterfalls in India. Mysore district is an administrative district located in the southern part of the state of Karnataka, India.", "prediction 3": "The Barkana Falls, formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India. The water falls is among the ten highest waterfalls in India. The water falls is filled with water only during rainy season.", "prediction 4": "The Barkana Falls, formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India and the water falls is among the ten highest waterfalls in India. The falls is located at a distance of 10 km from Agumbe and has a height of about 500 feet and the area is surrounded by thick forest of Western Ghats. The Barkana falls is one of the most popular tourist destinations in Karnataka, where tourists can visit the Barkana Falls is situated in Shimoga district of the southern part of the state of Karnataka, India.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 195, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 299 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Barkana Falls, formed by Seetha River, is a water falls located near Agumbe in Shimoga district of state of Karnataka, India and the water falls is among the ten highest waterfalls in India. Karnataka State was originally known as the State of Mysore." }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "What pink floyd album is wish you were here on?", "passages": [ [ "Wish You Were Here (Pink Floyd song)", "Wish You Were Here (Pink Floyd song)\n\n", "\"Wish You Were Here\" is the title track on Pink Floyd's 1975 album \"Wish You Were Here\".", "David Gilmour and Roger Waters collaborated to write the music, and Gilmour sang the lead vocal.", "In 2011, the song was ranked No. 324 on Rolling Stone's 500 Greatest Songs of All Time.", "In the original album version, the song segues from \"Have a Cigar\" as if a radio had been tuned away from one station, through several others (including a radio play and one playing the opening of the finale movement of Tchaikovsky's Fourth Symphony), and finally to a new station where \"Wish You Were Here\" is beginning.", "The radio was recorded from Gilmour's car radio.", "He performed the intro on a twelve-string guitar, processed to sound like it was playing through an AM radio, and then overdubbed a fuller-sounding acoustic guitar solo.", "This passage was mixed to sound as though a guitarist were listening to the radio and playing along.", "As the acoustic part becomes more complex, the 'radio broadcast' fades away and Gilmour's voice enters, becoming joined by the full band.", "The intro riff is repeated several times, before Gilmour plays further solos with scat singing accompaniment." ], [ "Wish You Were Here (Pink Floyd song)", "Mason discussed the alternative version on the BBC Radio 4 Front Row program and revealed that Yehudi Menuhin, who was recording with Grappelli in Abbey Road's Studio Two, was also invited to play on \"Wish You Were Here\" but declined, as he wasn't as comfortable as Grappelli at improvising.", "\"Wish You Were Here (Live)\" is a live recording of Pink Floyd's title track off their ninth studio album \"Wish You Were Here\", recorded by the band for their third live album, \"Pulse\".", "\"Wish You Were Here (Live)\" was released as a single on 20 July 1995 in the United Kingdom and Europe, notably the very last single released by the band until October 2014.", "\"Wish You Were Here\" served as the fourth and final single from Wyclef Jean's second studio album, \"\".", "It was released in December 2001, peaking at #28 on the UK Singles Chart." ], [ "Wish You Were Here (Pink Floyd album)", "Wish You Were Here (Pink Floyd album)\n\n", "Wish You Were Here is the ninth studio album by the English rock band Pink Floyd.", "It was released on 12 September 1975 in the United Kingdom by Harvest Records and a day later in the United States by Columbia Records, their first American release for the label.", "Based on material Pink Floyd composed while performing in Europe, \"Wish You Were Here\" was recorded over numerous sessions at Abbey Road Studios in London.", "Two songs criticise the music business, another expresses alienation, and the multi-part composition \"Shine On You Crazy Diamond\" is a tribute to Pink Floyd founder Syd Barrett, who left seven years earlier due to mental health problems.", "As with their previous album \"The Dark Side of the Moon\" (1973), Pink Floyd used studio effects and synthesizers, and brought in guest singers: Roy Harper, who provided the lead vocals on \"Have a Cigar\", and Venetta Fields, who added backing vocals to \"Shine On You Crazy Diamond\".", "\"Wish You Were Here\" topped record charts in the United Kingdom and the United States, and Harvest Records' parent company EMI was unable to print enough copies to meet demand." ] ], "gold": "The song \"Wish you were here\" by English Rock band Pink Floyd originally appeared in the album Wish You Were Here. The album was released on 12 September 1975. A live version of the song is included on Pulse, released on 29 May 1995. The song was arranged more closely to the original album version. ", "prediction 1": "Wish You Were Here is the title track on Pink Floyd's 1975 album \"Wish You Were Here\". David Gilmour and Roger Waters collaborated to write the music, and Gilmour sang the lead vocal. \"Wish You Were Here (Live)\" is a live recording of Pink Floyd's title track off their ninth studio album \"Wish You Were Here\", recorded by the band for their third live album, \"Pulse\". \"Wish You Were Here (Live)\" was released as a single on 20 July 1995 in the United Kingdom and Europe, notably the last single released by the band until October 2014.", "prediction 2": "Wish You Were Here is the title track on Pink Floyd's 1975 album Wish You Were Here. David Gilmour and Roger Waters collaborated to write the music, and Gilmour sang the lead vocal. In 2011, the song was ranked No. 324 on Rolling Stone's 500 Greatest Songs of All Time. Wish You Were Here (Live) is a live recording of Pink Floyd's title track off their ninth studio album Wish You Were Here, recorded by the band for their third live album, Pulse. \"Wish You Were Here (Live)\" was released as a single on 20 July 1995 in the United Kingdom and Europe, notably the last single released by the band until October 2014.", "prediction 3": "Wish You Were Here is the title track on Pink Floyd's 1975 album \"Wish You Were Here\". David Gilmour and Roger Waters collaborated to write the music, and Gilmour sang the lead vocal. \"Wish You Were Here (Live)\" is a live recording of Pink Floyd's title track off their ninth studio album \"Wish You Were Here\", recorded by the band for their third live album, \"Pulse\". \"Wish You Were Here (Live)\" was released as a single on 20 July 1995 in the United Kingdom and Europe, notably the very last single released by the band until October 2014. \"Wish You Were Here\" served as the fourth and final single from Wyclef Jean's second studio album, \"Wish You Were Here\" which was released in December 2001, peaking at #28 on the UK Singles Charts.", "prediction 4": "\"Wish You Were Here\" is the title track on Pink Floyd's 1975 album Wish You Were Here. David Gilmour and Roger Waters collaborated to write the music, and Gilmour sang the lead vocal. \"Wish You Were Here (Live)\" is a live recording of Pink Floyd's title track off their ninth studio album Wish You Were Here, recorded by the band for their third live album, Pulse.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 438, "end": 536 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Wish You Were Here is the title track on Pink Floyd's 1975 album \"Wish You Were Here\". The album was released on 12 September 1975. \"Wish You Were Here (Live)\" was released as a single on 20 July 1995." }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "What is the latest episode of sister wives?", "passages": [ [ "Sister Wives", "Sister Wives\n\nSister Wives is an American reality television series broadcast on TLC that premiered on September 26, 2010.", "The show documents the life of a polygamist family, which includes patriarch Kody Brown, his four wives, and their 18 children.", "The family began the series living in Lehi, Utah, but has since moved to Las Vegas, Nevada in 2011, and the unincorporated township of Baderville, Arizona, (northwest of Flagstaff, Arizona) in mid-2018.", "Brown and his four wives have stated they participated in the show to make the public more aware of polygamist families and to combat societal prejudices.", "Brown believes his polygamist arrangement is legal because he is legally married only to one woman, and the other marriages are spiritual unions.", "The series led to the Brown family being investigated for possible prosecution.", "This resulted in a federal judge declaring Utah laws that guard against polygamy to be unconstitutional; citing that state may still outlaw plural marriages, but it cannot prohibit polygamous cohabitation.", "The show follows the lives of advertising salesman Kody Brown, his wives Meri, Janelle, Christine, and Robyn, and their 18 children.", "In the first season the show televised Brown's courting of and marriage to his fourth wife, Robyn Sullivan, in 2010.", "Sullivan was the first new wife to enter the family in 16 years." ] ], "gold": "Sister Wives is a reality show that follows the Browns, a polygamist family. January 15, 2017 episode 123, The Newlyweds vs The Browns, aired. January 22 and 29 2017, Tell All parts 1and 2 aired. They were episodes 124 and 125.", "prediction 1": "Sister Wives is an American reality television show that premiered on TLC on September 26, 2010. The show documents the life of a polygamist family, which includes patriarch Kody Brown, his four wives, and their 18 children.", "prediction 2": "Sister Wives is an American reality television series broadcast on TLC that premiered on September 26, 2010. The show documents the life of a polygamist family, which includes patriarch Kody Brown, his four wives, and their 18 children. In the first season, the show televised Brown's courting of and marriage to his fourth wife, Robyn Sullivan, in 2010.", "prediction 3": "The American reality television show Sister Wives has had various episodes. The latest episode was released on October 5, 2019.", "prediction 4": "The American reality television series Sister Wives broadcast on TLC that premiered on September 26, 2010. The show documents the life of a polygamist family, which includes patriarch Kody Brown, his four wives, and their 18 children.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 224 } ], "missing-info": [], "corrected-prediction": "Sister Wives is an American reality television show that documents the life of a polygamist family." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When was ben simmons drafted to the nba?", "passages": [ [ "Ben Simmons", "Ben Simmons\n\nBenjamin David Simmons (born 20 July 1996) is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association (NBA).", "He played college basketball for one season with the Louisiana State University (LSU) Tigers, when he was named a consensus first-team All-American and the USBWA National Freshman of the Year.", "He was selected with the first overall pick in the 2016 NBA draft by the 76ers.", "After sitting out a year due to an injured right foot, he was named the NBA Rookie of the Year in 2018.", "Simmons attended Box Hill Senior Secondary College before moving to the United States to attend Montverde Academy in Montverde, Florida.", "In his only season in college, LSU began the season with high expectations, but failed to qualify for the NCAA Tournament.", "He left school to enter the NBA draft, becoming the third Melbourne-born number one overall pick (following Andrew Bogut and Kyrie Irving) in 11 years.", "Simmons is the son of an American-born father, Dave, who played pro basketball in Australia.", "A dual citizen with the United States, Simmons has played for the Australian national team.", "Simmons was born in the Melbourne suburb of Fitzroy, to American-born father Dave Simmons and Australian mother Julie.", "When his parents met in 1991, Julie was a divorced single mother with four children\u2014Melissa, Emily, Liam and Sean." ], [ "Mark Termini", "Just prior to the 2015-16 season, Termini and Paul negotiated a five-year, $82 million contract for restricted free agent Tristan Thompson.", "That deal made Thompson the sixth-highest-paid power forward in the NBA for the 2015-16 season In 2015, Termini also negotiated a four-year, $33 million free agent contract for his client Kosta Koufos, along with deals for several other Klutch clients including Cory Joseph (four years, $30 million).", "Termini represented his long-time friend Flip Saunders, who coached 17 seasons in the NBA and won 654 career games.", "Saunders died in 2015 at age 60 of Hodgkin's lymphoma.", "Termini and Paul collaborated on an endorsement contract that their client Ben Simmons signed with Nike on June 6, 2016.", "Simmons' five-year, guaranteed $20 million contract with Nike includes performance bonuses that could increase the value above $40 million.", "On June 23, 2016, Simmons became the first overall selection in the 2016 NBA Draft by the Philadelphia 76ers.", "During the 2016 offseason, Termini and Paul negotiated a three-year, $100 million contract for LeBron James, which made him the highest paid player in the NBA for the first time in his career." ], [ "Ben Simmons", "Following the announcement of the NCAA tournament field, with LSU failing to earn a bid, Tigers head coach Johnny Jones announced that the team would not play in any postseason tournament.", "On 21 March 2016, Simmons declared for the 2016 NBA draft, forgoing his final three years of college eligibility.", "He withdrew from school at the conclusion of the season with plans to move immediately to Phoenix, Arizona in advance of the NBA draft.", "He also signed with American sports agency Klutch Sports, which is primarily owned by Rich Paul.", "In the week leading up to the 2016 NBA draft, Simmons' attitude and character were questioned by a number of NBA media analysts.", "Philadelphia 76ers head coach Brett Brown, former Australian national team coach and a friend of the Simmons family, repudiated the claims being made and was content with Simmons' pre-draft behaviour.", "On 23 June, he was selected by Brown and the 76ers with the number one overall pick in the 2016 draft, becoming the third Melbourne-born number one overall pick in 11 years (Andrew Bogut in 2005 and Kyrie Irving in 2011).", "He was also the first college player in the modern era to be selected with the first overall pick despite never playing in the NCAA Tournament.", "On 3 July 2016, Simmons signed his rookie scale contract with the 76ers and joined the team for the 2016 NBA Summer League." ] ], "gold": "Benjamin Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association (NBA). He played college basketball for one season with the Louisiana State University (LSU) Tigers, after which he was named a consensus first-team All-American and the USBWA National Freshman of the Year. Simmons was selected with the first overall pick in the 2016 NBA draft on June 23, 2016.", "prediction 1": "Ben Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association. He was selected with the first overall pick in the 2016 NBA Draft by the Philadelphia 76ers. In the 2016 NBA Draft, Simmons was selected with the first overall pick.", "prediction 2": "Ben Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association. He was selected with the first overall pick in the 2016 NBA Draft by the Philadelphia 76ers.", "prediction 3": "Ben Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association. He was selected with the first overall pick in the 2016 NBA draft by the Philadelphia 76ers. On June 23, 2016, Simmons became the first overall selection in the 2016 NBA Draft by the Philadelphia 76ers.", "prediction 4": "Ben Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association. On June 23, 2016, Simmons became the first overall selection in the 2016 NBA Draft by the Philadelphia 76ers. Then, on 3 July 2016, Simmons signed his rookie scale contract with the 76ers and joined the team for the 2016 NBA Summer League.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Ben Simmons is an Australian professional basketball player for the Philadelphia 76ers of the National Basketball Association. He was selected with the first overall pick in the 2016 NBA Draft by the Philadelphia 76ers. He played college basketball for one season with the Louisiana State University (LSU) Tigers, when he was named a consensus first-team All-American and the USBWA National Freshman of the Year. In the 2016 NBA Draft, Simmons was selected with the first overall pick." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does the regular season start for nfl?", "passages": [ [ "2015 NFL season", "2015 NFL season\n\nThe 2015 NFL season was the 96th season in the history of the National Football League (NFL), and the 50th of the Super Bowl era.", "The season began on Thursday, September\u00a010, 2015, with the annual kickoff game featuring the defending Super Bowl XLIX champion New England Patriots hosting the Pittsburgh Steelers.", "The season concluded with Super Bowl 50, the league's championship game, on Sunday, February\u00a07, 2016, at Levi's Stadium in Santa Clara, California, with the Denver Broncos defeating the Carolina Panthers 24\u201310.", "During the 2015 season, the Oakland Raiders, the St. Louis Rams, and the San Diego Chargers announced their intentions to relocate back to Los Angeles in the ensuing offseason (all three teams had previously resided in the city at various points in their history).", "NFL owners eventually only approved the relocation of the Rams, by a vote of 30\u20132 on January 12, 2016.", "Thus, 2015 ended up being the Rams' last season in St. Louis.", "The 2015 NFL League Year began on Tuesday, March 10, 2015 at 4:00\u00a0p.m. ET.", "On Saturday, March 7, clubs started to contact and enter into contract negotiations with the certified agents of players who became unrestricted free agents upon the expiration of their 2014 contracts at 4:00\u00a0p.m. ET on March 10." ], [ "2016 NFL season", "2016 NFL season\n\nThe 2016 NFL season was the 97th season in the history of the National Football League (NFL).", "The season began on September 8, 2016, with the defending Super Bowl 50 champion Denver Broncos defeating the Carolina Panthers 21\u201320 in the NFL Kickoff Game.", "The season concluded with Super Bowl LI, the league's championship game on February 5, 2017, at NRG Stadium in Houston with the New England Patriots defeating the Atlanta Falcons 34\u201328 in overtime.", "For the first time since the Houston Oilers relocated to Tennessee in , an NFL team relocated to another state, as the former St. Louis Rams moved out of St. Louis, Missouri and returned to Los Angeles, its home from 1946 to 1994.", "For the first time since the 2003 NFL season, neither of the previous season's Super Bowl participants made the playoffs.", "The 2016 season also was the last season for the San Diego Chargers after playing in San Diego for fifty-six years before their return to the city of Los Angeles for 2017, where the franchise was based in for their first season in 1960.", "The 2016 NFL league year began on March 9, 2016 at 4:00\u00a0p.m. ET.", "On March 7 clubs started to contact and enter into contract negotiations with the certified agents of players who became unrestricted free agents upon the expiration of their 2015 contracts two days later." ], [ "2017 NFL season", "2017 NFL season\n\nThe 2017 NFL season was the 98th season in the history of the National Football League (NFL).", "The season began on September 7, 2017, with the Kansas City Chiefs defeating the defending Super Bowl LI champion New England Patriots 42\u201327 in the NFL Kickoff Game.", "The season concluded with Super Bowl LII, where the National Football Conference (NFC) champion Philadelphia Eagles faced the American Football Conference (AFC) champion New England Patriots.", "The Philadelphia Eagles defeated the New England Patriots 41\u201333 to win their first title in franchise history.", "It was also a rematch of Super Bowl XXXIX, where the Patriots won 24\u201321 to win their third title.", "For the second consecutive year, a team relocated to the Los Angeles metropolitan area, as the former San Diego Chargers announced their intent to do so in January 2017.", "The 2017 NFL League year began on March 9 at 4:00\u00a0p.m. ET.", "On March 7, clubs were allowed to contact and enter into contract negotiations with the agents of players who became unrestricted free agents upon the expiration of their contracts two days later." ] ], "gold": "The 2015 NFL season began on Thursday, September 10, 2015, with the annual kickoff game featuring the defending Super Bowl XLIX champion New England Patriots defeating the Pittsburgh Steelers, 28\u201321. The 2016 NFL season began on September 8, 2016, with the defending Super Bowl 50 champion Denver Broncos defeating the Carolina Panthers 21\u201320. The 2017 NFL season began on September 7, 2017, with the Kansas City Chiefs defeating the defending Super Bowl LI champion New England Patriots 42\u201327 in the NFL Kickoff Game.", "prediction 1": "The regular season for the National Football League (NFL) in the United States begins on the first day of August, each year. Historically, the season started on Thursday, September 10, 2015, with the annual kickoff game featuring the defending Super Bowl XLIX champion New England Patriots hosting the Pittsburgh Steelers. The 2015 NFL League Year began on Tuesday, March 10, 2015 at 4:00 p.m. ET.", "prediction 2": "The regular season for the National Football League began in 1969 with the regular season beginning in 1921. The regular season for the 2015 season began on Thursday, September 10, 2015, with the annual kickoff game featuring the defending Super Bowl XLIX champion New England Patriots hosting the Pittsburgh Steelers. The regular season for the 2016 season started on September 8, 2016 with the defending Super Bowl 50 champion Denver Broncos defeating the Carolina Panthers 21\u201320 in the NFL Kickoff Game. The regular season for the 2017 NFL season began on March 9, 2016 at 4:00 p.m. ET.", "prediction 3": "On September 8, 2016 the regular season for the National Football League began with the New England Patriots hosting the Pittsburgh Steelers at the NRG Stadium in Houston. Then, on March 9, 2017 the regular season for the National Football League started with the Kansas City Chiefs defeating the New England Patriots 42\u201327 in the NFL Kickoff Game. On March 7, clubs started to contact and enter into contract negotiations with the certified agents of players who became unrestricted free agents upon the expiration of their 2015 contracts at 4:00 p.m. On March 9, 2016, the NFL League Year began at 4:00 p.m. ET.", "prediction 4": "The regular season for the National Football League first started on Thursday, September 10, 1995, and the regular season for the National Football League first started on Thursday, September 12, 1995. The 2016 NFL regular season began on September 9, 2016, and the 2017 NFL regular season started on September 7, 2017, and the 2017 NFL League year started on March 9, 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 0, "end": 124 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 397 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": " Historically, the 2015 season started on Thursday, September 10, 2015, with the annual kickoff game featuring the defending Super Bowl XLIX champion New England Patriots hosting the Pittsburgh Steelers. The 2016 NFL season began on September 8, 2016, with the defending Super Bowl 50 champion Denver Broncos defeating the Carolina Panthers 21\u201320. The 2017 NFL season began on September 7, 2017, with the Kansas City Chiefs defeating the defending Super Bowl LI champion New England Patriots 42\u201327 in the NFL Kickoff Game." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "How many acres is the great smoky mountains national park?", "passages": [ [ "Great Smoky Mountains National Park", "Great Smoky Mountains National Park\n\nGreat Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains, part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain.", "The border between Tennessee and North Carolina runs northeast to southwest through the centerline of the park.", "Great Smoky Mountains is the most visited national park in the United States with over 11.3 million recreational visitors in 2016.", "The Appalachian Trail passes through the center of the park on its route from Maine to Georgia.", "The park was chartered by the United States Congress in 1934 and officially dedicated by President Franklin D. Roosevelt in 1940.", "The park encompasses , making it one of the largest protected areas in the eastern United States.", "The main park entrances are located along U.S. Highway 441 (Newfound Gap Road) at the towns of Gatlinburg, Tennessee, and Cherokee, North Carolina.", "Great Smoky Mountains was the first national park whose land and other costs were paid for in part with federal funds; previous parks were funded wholly with state money or private funds.", "Before the arrival of European settlers, the region was part of the homeland of the Cherokees.", "Frontiers people began settling the land in the 18th and early 19th century." ], [ "Appalachian Plateau", "The Appalachian Plateau has many landmarks and public spaces to camp out, go hiking, and sight see.", "The Cloudland Canyon State Park is a prominent landmark in the Appalachian Plateau.", "At 3,485 acres, the Cloudland Canyon State Park is one of the largest and most scenic parks throughout the Appalachian Plateau.", "Its rugged geology offers a wide range of activities for tourists and campers to take part in.", "Spacious views of the canyon can be seen anywhere from the midst of the trail, to picnic tables at resting areas.", "Another well-known landmark in the Appalachian Plateau is The Great Smoky Mountains.", "The Smoky Mountains are an estimated 187,000 acres and consist of old growth forests.", "The name \u201cSmoky\u201d comes from the natural fog that sometimes hangs over the mountain range and looks like a cloud of smoke from a distance.", "The Hocking Hills are deeply dissected in the Appalachian Plateau area.", "The hills themselves feature cliffs, gorges, waterfalls and even rock shelters.", "It is a very historic landmark and many tourists along with campers and hikers come to see the beauty and serenity of the hills.", "The hills are known to be thick, hard and weather resistant, which in turn builds deep gorges and very high cliffs." ] ], "gold": "Great Smoky Mountains National Park is an American national park in the southeastern United States, with parts in Tennessee and North Carolina. The park straddles the ridgeline of the Great Smoky Mountains, part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. The park is 522,419 acres in total, with 187,000 acres estimated to be old growth forest.", "prediction 1": "The Great Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains. It is part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. The park encompasses, making it one of the largest protected areas in the eastern United States.", "prediction 2": "Great Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains, part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. The Smoky Mountains are an estimated 187,000 acres and consist of old growth forests. The Cloudland Canyon State Park is a prominent landmark in the Appalachian Plateau. At 3,485 acres, the Cloudland Canyon State Park is one of the largest and most scenic parks throughout the Appalachian Plateau.", "prediction 3": "The Great Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains, part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. At 187,000 acres, the Smoky Mountains are an estimated 187,000 acres and consist of old growth forests. The Cloudland Canyon State Park is a prominent landmark in the Appalachian Plateau and is one of the largest and most scenic parks throughout the Appalachian Plateau. At 3,485 acres, the Cloudland Canyon State Park is one of the largest and most scenic parks throughout the Appalachian Plateau and one of the largest and most scenic parks throughout the Appalachian Plateau.", "prediction 4": "The Great Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains, part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. It\u2019s 187,000 acres make it one of the largest protected areas in the eastern United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 360 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Great Smoky Mountains National Park is an American national park and a UNESCO World Heritage Site that straddles the ridgeline of the Great Smoky Mountains. It is part of the Blue Ridge Mountains, which are a division of the larger Appalachian Mountain chain. The Smoky Mountains are an estimated 187,000 acres and consist of old growth forests." }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "What type of dog was eddie on frasier?", "passages": [ [ "Moose (dog)", "Moose spent the last six and a half years of his life in retirement in West Los Angeles with son Enzo, their trainer Mathilda DeCagny, her husband Michael Halberg and Jill, the dog from \"As Good as It Gets\".", "In his last year of life, suffering from dementia and deafness, he retired from TV.", "He died of natural causes at home at the age of years on June 22, 2006.", "Moose's son Enzo (July 1995 \u2013 June 23, 2010) was also a Parson Russell Terrier canine actor.", "Enzo was one of a few puppies bred specifically as possible replacements for Eddie as it became clear that \"Frasier\" was a hit and would enjoy a long run.", "A daughter, Miko, was considered but never grew large enough (she was given to a technician); a son, Moosie, lived with Peri Gilpin, the actress who played Roz Doyle.", "Enzo, born to mother Chelsea Marvin (also a Jack Russell) was a closer match and turned out to have unusually similar facial markings to his father; later in the series, he was used as a stunt double to perform the more physically challenging tricks for his aging father.", "Enzo and Moose took turns playing the role after the eighth season.", "Enzo was also used as one of the puppies that \"Eddie\" had fathered during the show." ], [ "Moose (dog)", "Moose (dog)\n\nMoose (December 24, 1990 \u2013 June 22, 2006) was a Parson Russell Terrier who portrayed Eddie Crane on the television sitcom \"Frasier\".", "Moose was born on Christmas Eve, 1990 in Florida, the youngest littermate.", "He was the largest puppy in the litter.", "Like Pal, the original Lassie, the rambunctious puppy was too much for his original owner.", "According to an article by Lori Golden:\n\nMoose won the role on \"Frasier\" after only six months of training.", "Moose had the ability to fix Kelsey Grammer with a long hard stare; this became a running sight gag on the show.", "When Moose had to lick his co-stars, however, sardine oil was applied upon the actors' faces.", "John Mahoney once revealed liver p\u00e2t\u00e9 was dabbed behind the actor's ears to make Moose nuzzle the actors.", "Moose has numerous television appearances and several magazine covers to his credit.", "There is an official Moose calendar and an \"autobiography\", \"My Life as a Dog\", which was written by Brian Hargrove, husband of actor David Hyde Pierce who portrays Niles Crane in \"Frasier\"." ] ], "gold": "There are two dogs that played Eddie on the American sitcom Frasier and they were both Jack Russell Terriers. A dog named Moose won the role after only six months of training, by having the ability to fix Kelsey Grammer with a long hard stare, which became a running sight gag on the show. Moose played the role from 1993-2000, when one of a few puppies bred specifically as possible replacements for Moose took over. His name was Enzo and he was Moose's son. Enzo was a Jack Russell Terrier canine actor who portrayed Eddie Crane on the American television sitcom Frasier. Eddie was originally portrayed by Enzo\u2019s father, Moose; Enzo was one of a few puppies bred specifically as possible replacements for Moose, as it became clear that Frasier was a hit and would enjoy a long run.", "prediction 1": "Moose Crane, portrayed by Moose on the television sitcom Frasier, is a Parson Russell Terrier. Moose dated actress Peri Gilpin while Enzo Crane dated actress Chelsea Marvin and was the youngest littermate. Moose was also used as one of the puppies that \"Eddie\" had fathered during the show.", "prediction 2": "The dog that played Eddie Crane on Frasier was a Parson Russell Terrier named Enzo who played Eddie on the show. Moose played Eddie Crane from 1990 until 2006.", "prediction 3": "Eddie Crane is the character of Eddie on the television sitcom Frasier, and his dog is Moose. Moose played the character for six and a half years, and was the father of Enzo, the show's dog. Enzo was a Parson Russell Terrier who was used as one of the puppies that Eddie had fathered during the show.", "prediction 4": "Eddie Crane, played by Moose, was played by Enzo, who was also a Parson Russell Terrier. Enzo was also used as one of the puppies that Eddie had fathered during the show. Moose spent the last six and a half years of his life in retirement in West Los Angeles with son Enzo and trainer Mathilda DeCagny, along with Jill, the dog from As Good as It Gets.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 12 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 101, "end": 126 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 144, "end": 172 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 205 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 206, "end": 211 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Eddie Crane, portrayed by Moose on the television sitcom Frasier, is a Parson Russell Terrier. He got the role after just 6 months of training. Moose had the ability to fix Kelsey Grammer with a long hard stare; this became a running sight gag on the show. Enzo, Moose's son and also a Parson Russell Terrier, was also used as one of the puppies that \"Eddie\" had fathered during the show." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who played the black girl in imitation of life?", "passages": [ [ "Louise Beavers", "She once received a review which stated, \"Personally, Miss Beavers is just splendid, just as fine as she appears on screen, but she also has a charm all her own, which needs no screen role for recognition.", "She has a very pleasing personality, one that draws people to her instantly and makes them feel that they are meeting a friend instead of a Hollywood Star.\"", "Beavers had an attractive personality, and often played roles in which she helps a white protagonist mature in the course of the movie.", "In 1934, Beavers played Delilah in \"Imitation of Life\" in a dramatic role.", "Her character again plays a black maid, but instead of the usual stereotypical comedic or purely functional role, Delilah's story line is a secondary parallel plot.", "The public reacted positively to Beavers' performance.", "It was not only a breakthrough for Beavers, but was also \"the first time in American cinema history that a black woman's problems were given major emotional weight in a major Hollywood motion picture\".", "Some in the media recognized the unfairness of Hollywood's double standard regarding race.", "For example, \"California Graphic Magazine\" wrote, \"the Academy could not recognize Miss Beavers.", "She is black!\"" ], [ "Imitation of Life (1934 film)", "Bea finds it difficult to make a living selling maple syrup, as her husband had done.", "Using her wiles to get a storefront on the busy Atlantic City boardwalk refurbished for practically nothing, she opens a pancake restaurant, where Delilah cooks in the front window.", "Five years later, Bea makes her last payment to the furniture man and is debt-free.", "Jessie (Marilyn Knowlden) and Peola (Dorothy Black) have proven to be challenging children to raise: Jessie is demanding, not particularly studious, relying instead on her charm.", "She is the first person to call Peola \"black\" in a hurtful way, hinting that their childhood idyll is doomed.", "Peola does not tell her classmates at school that she is \"colored\" and is humiliated when her mother shows up one day, revealing her secret.", "Later, at the suggestion of a passerby, Elmer Smith (Ned Sparks), Bea sets up an even more successful pancake flour corporation, marketing Delilah as an Aunt Jemima-like product mascot.", "She offers Delilah a 20% interest in her family recipe, but childlike, Delilah refuses and continues to act as Bea's housekeeper and factotum, the shares held presumably in trust.", "Bea becomes wealthy from her business.", "Ten years later, the two older women are confronted with problems." ], [ "Imitation of Life (1934 film)", "Imitation of Life (1934 film)\n\nImitation of Life is a 1934 American drama film directed by John M. Stahl.", "The screenplay by William Hurlbut, based on Fannie Hurst's 1933 novel of the same name, was augmented by eight additional uncredited writers, including Preston Sturges and Finley Peter Dunne.", "The film stars Claudette Colbert, Warren William and Rochelle Hudson and features Louise Beavers and Fredi Washington.", "The film was originally released by Universal Pictures on November 26, 1934, and later re-issued in 1936.", "A 1959 remake with the same title was directed by Douglas Sirk.", "In 2005, \"Imitation of Life\" was selected for preservation in the United States National Film Registry being deemed \"culturally, historically, or aesthetically significant\".", "It was also named by \"Time\" in 2007 as one of \"The 25 Most Important Films on Race\".", "White widow Bea Pullman (Claudette Colbert) and her toddler daughter Jessie (Juanita Quigley), take in black housekeeper Delilah Johnson (Louise Beavers) and her daughter Peola (Sebie Hendricks), whose fair complexion conceals her mixed-race ancestry.", "Bea exchanges room and board for work, although struggling to make ends meet.", "Delilah and Peola quickly become like family to Jessie and Bea.", "They particularly enjoy Delilah's pancakes, made from a special family recipe." ] ], "gold": "Imitation of Life is a 1934 American drama film directed by John M. Stahl, which was based on Fannie Hurst's 1933 novel of the same name. Louise Beavers played a black housekeeper, a secondary parallel plot role that exhibited \"the first time in American cinema history that a black woman's problems were given major emotional weight in a major Hollywood motion picture.\" Fredi Washington played the role of the housekeeper's daughter Peola, who is a young light skinned woman that decides to pass as white and Dorothy Black played the younger version of her. There was also a second adaptation of Hurst's book released in 1959 in which Juanita Moore played the role of the black housekeeper and Susan Kohner played the role of her daughter, with Karin Dicker playing the younger version. ", "prediction 1": "In the 1934 American drama film Imitation of Life, black housekeeper Delilah Johnson is played by Louise Beavers. Sebie Hendricks plays the role of Delilah in the 1959 remake of the film.", "prediction 2": "In the 1934 American drama film Imitation of Life, the black housekeeper Delilah Johnson is played by Louise Beavers. In the 1959 remake of the film, the black housekeeper Peola is played by Sebie Hendricks.", "prediction 3": "In 1934's Imitation of Life, Louise Beavers played the role of Delilah Johnson. The film's screenplay was based on Fannie Hurst's 1933 novel of the same name. The film stars Claudette Colbert as Bea Pullman, the housekeeper to Jessie and her toddler daughter, Peola. In the 1959 remake, Dorothea Black played the role of Peola.", "prediction 4": "In the 1934 film Imitation of Life, black housekeeper Delilah Johnson is played by Louise Beavers. In the 1959 remake of the film, the character of the black girl is played by Dorothy Black.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[8]}", "start": 148, "end": 174 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the 1934 American drama film Imitation of Life, directed by John M. Stahl and based on Fannie Hurst's 1933 novel of the same name, black housekeeper Delilah Johnson is played by Louise Beavers. Delilah's storyline is a secondary parallel plot role that exhibited \"the first time in American cinema history that a black woman's problems were given major emotional weight in a major Hollywood motion picture.\" Her daughter Peola, whose fair complexion conceals her mixed-race ancestry, is played by Sebie Hendricks. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who has the most super bowl losses in nfl history?", "passages": [ [ "Glenn Parker", "Glenn Parker\n\nGlenn Andrew Parker (born April 22, 1966 in Westminster, California) is a former American football offensive lineman in the National Football League who played for the Buffalo Bills, the Kansas City Chiefs, and the New York Giants.", "After his retirement, he became a television NFL analyst.", "Parker attended Edison High School in Huntington Beach, but was not in the athletics programs.", "He first played for Golden West College, a junior college in Huntington Beach.", "That led him to Arizona, where he played for the University of Arizona and was drafted in the third round of the 1990 NFL Draft by the Buffalo Bills.", "He played for the Bills until 1997, playing in all four Super Bowls the team lost from 1990-1993.", "He then went to play three years for the Chiefs, then was released during the 2000 offseason.", "He was picked up as a free agent by the Giants, where he played two more seasons, and was an integral part of the Super Bowl XXXV team.", "He retired after the 2001 season after being released by the Giants, being one of only three players (along with Cornelius Bennett and Gale Gilbert) to play in, and be on the losing team in five separate Super Bowls.", "He started in 141 of the 174 games he played, as well as all 16 of his postseason appearances." ], [ "History of the Denver Broncos", "History of the Denver Broncos\n\nThe history of the Denver Broncos American football club began when the team was chartered a member of the American Football League in 1960.", "The Broncos have played in the city of Denver, Colorado throughout their entire history.", "The Broncos did not win any titles as members of the AFL.", "Since the 1970 AFL\u2013NFL merger, the Broncos have won 15 division titles, and played in eight Super Bowls, following the 1977, 1986, 1987, 1989, 1997, 1998, 2013, and 2015 seasons.", "They won Super Bowl XXXII, Super Bowl XXXIII and Super Bowl 50.", "Their most famous player is former quarterback John Elway, starting quarterback in five Super Bowls and holder of many NFL records.", "The Broncos currently play in the National Football League's AFC West division.", "Their current leadership includes owner Pat Bowlen, CEO Joe Ellis, VP John Elway, and head coach Vance Joseph.", "For much of their first 3 decades, excluding teams in Texas, they were the only major pro football team between Kansas City and California (and the only team in the Interior West).", "This distinction ended in 1988, when the Cardinals moved from St. Louis to Phoenix.", "The Broncos remain the only current AFC West (formerly AFL West) team to never relocate or change its name." ], [ "Super Bowl LI", "By advancing to play in Super Bowl LI, the Patriots earned their NFL-record ninth Super Bowl appearance, as well as their seventh in the past 16 years under Brady and head coach Bill Belichick.", "The Patriots have also participated in the only other Super Bowl to be held at NRG Stadium; they won Super Bowl XXXVIII over the Carolina Panthers by a 32\u201329 score thirteen years earlier.", "The Patriots entered Super Bowl LI with an overall record of 4\u20134 in their previous eight Super Bowl appearances, with all four of their wins and two of their four losses coming under the leadership of Belichick and Brady.", "With his appearance in Super Bowl LI, Belichick broke the tie of six Super Bowls as a head coach that he had shared with Don Shula.", "It was also his record tenth participation in a Super Bowl in any capacity, which overtook the mark of nine that he had shared with Dan Reeves.", "This was also Brady's seventh Super Bowl appearance, the most appearances by a player in Super Bowl history.", "The Atlanta Falcons, under second-year head coach Dan Quinn, finished the 2016 season with an 11\u20135 record, earning them the No. 2 seed in the NFC playoffs.", "It was a big reversal of declining fortunes for the team, who had failed to qualify to play in the playoffs in each of the last three seasons." ] ], "gold": "The two teams with the most Super Bowl losses in NFL history are the Denver Broncos and the New England Patriots, each with five losses. Offensive line Glenn Parker, linebacker Cornelius Bennett and quarterback Gale Gilbert were the only three players in NFL history to play in and be on the losing team in five separate Super Bowls. NFL coaches Don Shula, Bud Grant, Dan Reeves and Marv Levy tied for leading in the most Super Bowl losses with four each.", "prediction 1": "The Super Bowls are played in the month of February, January, February, and March each year. The most losses in a Super Bowl history are by the New England Patriots in Super Bowl XXXII, by the Kansas City Chiefs in Super Bowl XXXIII, and by the Los Angeles Rams in Super Bowl XXXV. The Los Angeles Rams have the most Super Bowl losses in a Super Bowl history by the number of games played. The most Super Bowl wins by a team by a Super Bowl is Super Bowl XXXXXXXXXXXXXXXXXXXXXXXV.", "prediction 2": "The New England Patriots have the most losses in a Super Bowl. In all NFL history, the Los Angeles Rams have the most losses in a Super Bowl. The Atlanta Falcons have the most losses in a Super Bowl.", "prediction 3": "The Los Angeles Rams have the most super bowl losses in NFL history. The Los Angeles Rams have the most losses in Super Bowl history. The Los Angeles Chargers have the most losses in Super Bowl history.", "prediction 4": "The team with the most Super Bowl losses is the New England Patriots. The team with the most Super Bowl wins is the New York Giants. The team with the most Super Bowl losses is the Dallas Cowboys.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 61 }, { "error type": "Redundant", "explanation": "The Super Bowls are played in the month of February, January, ", "start": 62, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 92 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 193, "end": 211 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 245, "end": 261 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4,5]}", "start": 144, "end": 164 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4,5]}", "start": 308, "end": 334 }, { "error type": "Redundant", "explanation": "The Los Angeles Rams have the most Super Bowl losses in a Super Bowl history ", "start": 359, "end": 389 }, { "error type": "Incoherent", "explanation": "", "start": 425, "end": 480 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4, 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Denver Broncos have played in eight Super Bowls and have won 3 of them, making them have the most losses with 5. The New England Patriots, with their record 9th Super Bowl appearance, is close with 4 losses by Super Bowl LI. Glenn Andrew Parker is a former American football offensive lineman. Parker, Cornelius Bennett and Gale Gilbert are the three players who have lost 5 separate Super Bowls each. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is on the $10 note australia?", "passages": [ [ "Australian ten-dollar note", "Australian ten-dollar note\n\nThe Australian ten-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar on 14 February 1966; it replaced the \u00a35 note which had similar blue colouration.", "There have been four different issues of this denomination, a paper banknote, a commemorative hipolymer note to celebrate the bicentennial of Australian settlement (the first polymer banknote of its kind), the 1993-2017 polymer note, and from September 2017 a polymer note featuring a transparent window.", "According to Reserve Bank of Australia statistics, as at June 2017 there were 128 million $10 notes in circulation, with a net value of $1.284 billion.", "This was 2% of the cash value of all banknotes in circulation, and 8% of the number of all banknotes in circulation.", "Since the start of issue of $10 notes, there have been eleven signature combinations, of which the 1967 issue is the most valued.", "It was issued for one year only, along with the Coombs/Wilson issue of 1966.", "Following the issue of a new $5 note in September 2016, the RBA revealed the design for the $10 note and was issued on the 20th of September, 2017.", "From 1966\u20131974 the main title identifying the country was \"Commonwealth of Australia\"; there were 470,000,000 notes issued in this period." ], [ "Australian ten-dollar note", "This was subsequently changed to \"Australia\" until the end of issue of paper currency for this denomination in 1993, with 1,265,959,091 of these notes being printed.", "In the 1988 polymer issue 17,500,000 banknotes were printed and was the new Australia's 10 dollar note.", "The people depicted on the paper note issue were Francis Greenway on the obverse along with public building he helped construct, and Henry Lawson on the reverse with his poetry and scenes of the outback gold mining town of Gulgong in the 19th century including the Times Bakery.", "The polymer note, designed by Max Robinson, features Andrew Barton (Banjo) Paterson on the obverse with a horse from the Snowy Mountains region, and a wattle plant, also included is his signature.", "His poetry is in the background.", "Dame Mary Gilmore is on the reverse with 19th-century heavy transport with horse and cart and verses from her poetry.", "Her signature is included.", "A windmill is in the clear window with the raised wavy lines.", "The $10 note of 2017 retains the themes of the original, with this issue featuring the Bramble Wattle (\"Acacia victoriae\") and the Sulphur-crested Cockatoo (\"Cacatua galerita\").", "Obverse design included the sailing ship HMS \"Supply\" anchored at Sydney Cove with the early colony in the background." ], [ "Australian ten-dollar note", "Above are people who symbolise all who have contributed to Australia, from left the early settlers to right the modern working man.", "Reverse includes portraits of the aboriginal population, the main picture is a young native youth with ceremonial paint, and in the background is a Morning Star Pole, other \"Aboriginal artworks commissioned by the Bank\" and a human like figure from Dreamtime.", "The paper design included a watermark in the white field of Captain James Cook, the watermark was also used in the last issue of pound banknotes.", "A metallic strip, first near the centre of the note, then from 1976 moved to the left side on the obverse of the note.", "Polymer issue includes a shadow image of the coat of arms which is printed over.", "Embossing or a raised image in the clear window of wavy lines.", "Also for this issue fluorescent colouring was added to the serial numbers.", "A star with four points on the obverse and three on the reverse which join under light.", "Raised print and micro printing of the poem \"The Man from Snowy River\" and the denomination value are included.", "\"1988 Commemorative\"\nThis issue includes an optically variable device of Captain James Cook, who first mapped Botany Bay." ] ], "gold": "The Australian ten-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar on 1966, and there has been four different issues of this denomination. There is a paper banknote, with Francis Greenway on the obverse, Henry Lawson on the reverse. The 1993-2017 polymer note with Andrew Barton Paterson on the obverse, Mary Gilmore on the reverse; and from September 2017 the note retained the themes of the original, with this issue featuring the Bramble Wattle and the Sulphur-crested Cockatoo. There has also been one commemorative hipolymer note to celebrate the bicentennial of Australian settlement with the sailing ship HMS on the obverse and the Australian Aboriginal culture and peoples on the reverse.", "prediction 1": "The Australian ten-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar on 14 February 1966. It replaced the \u00a35 note which had similar blue colouration. There have been four different issues of this denomination, a paper banknote, a commemorative hipolymer note to celebrate the bicentennial of Australian settlement, the 1993-2017 polymer note, and from September 2017 a polymer note featuring a transparent window. The people depicted on the paper note issue were Francis Greenway on the obverse along with public building he helped construct, and Henry Lawson on the reverse with his poetry and scenes of the outback gold mining town of Gulgong in the 19th century including the Times Bakery.\n", "prediction 2": "The Australian ten-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar on 14 February 1966. It replaced the \u00a35 note which had similar blue colouration. There have been four different issues of this denomination, a paper banknote, a commemorative hipolymer note to celebrate the bicentennial of Australian settlement, the 1993-2017 polymer note, and from September 2017 a polymer note featuring a transparent window. The 2017 issue retains the themes of the original with this issue featuring the Bramble Wattle (\"Acacia victoriae\") and the Sulphur-crested Cockatooooooooooooooooooooogans in the background.", "prediction 3": "The Australian $10 note was issued when the currency was changed from the Australian pound to the Australian dollar on 14 February 1966. In this issue, the person depicted is Francis Greenway, whose name is on the obverse of the note. Henry Lawson is on the reverse with his poetry and scenes of the outback gold mining town of Gulgong in the 19th century including the Times Bakery. The polymer $10 note was designed by Max Robinson and features Andrew Barton, whose name is on the obverse with a horse from the Snowy Mountains region, and a wattle plant, and his signature.", "prediction 4": "There are several versions of the Australian ten-dollar note. The paper $50 note featured illustrations celebrating the 1980s, the 1988 Commemorative 10-dollar polymer note featuring Captain James Cook, and the 2017 Polymer $10 note featuring a transparent window with wavy lines. The polymer $10 note featured the Bramble Wattle, a wattle plant, and poems by Henry Lawson and Francis Greenway.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 549, "end": 596 }, { "error type": "Irrelevant", "explanation": "", "start": 629, "end": 747 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 467 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Australian ten-dollar note was issued when the currency was changed from the Australian pound to the Australian dollar. There have been four different issues of this denomination, a paper banknote, a commemorative hipolymer note to celebrate the bicentennial of Australian settlement, the 1993-2017 polymer note, and from September 2017 a polymer note. The people depicted on the paper note issue were Francis Greenway on the obverse and Henry Lawson on the reverse. The 1993-2017 polymer note features Andrew Barton Paterson on the obverse and Mary Gilmore is on the reverse. The 2017 polymer note retains the themes of the original, with this issue featuring the Bramble Wattle and the Sulphur-crested Cockatoo. Another design had, on its obverse design, the sailing ship HMS \"Supply\" and on its reverse, the aboriginal population and their culture.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What's the abv of pabst blue ribbon?", "passages": [ [ "Pabst Blue Ribbon", "Pabst Blue Ribbon\n\nPabst Blue Ribbon is an American lager beer sold by Pabst Brewing Company, established in Milwaukee, Wisconsin in 1844 and currently based in Los Angeles.", "Originally called Best Select, and then Pabst Select, the current name comes from the blue ribbons tied around the bottle neck between 1882 and 1916.", "Gottlieb and Frederika Pabst and their twelve-year-old son Frederick arrived in the United States in 1848 and settled in Chicago where Frederick eventually found work on the ships of Lake Michigan.", "In 1862, Frederick married Maria Best, daughter of the founder and owner of the Best Brewing Company, and in 1863 became a brewer at his father-in-law's brewery.", "When Philip Best retired to Germany in 1867, Pabst and Emil Schandein\u2014his sister-in-law's husband and the vice-president of Best Brewery\u2014worked to transform the company into one of the nation's largest brewers, capitalizing on, among other things, the Great Chicago Fire of 1871 that destroyed nineteen Chicago breweries and helped position Milwaukee as the leading beer-producing city in the United States.", "In 1889, Schandein died, leaving Pabst as president and his widow, Lisette Schandein, as vice-president." ], [ "Alcohol by volume", "Alcohol by volume\n\nAlcohol by volume (abbreviated as ABV, abv, or alc/vol) is a standard measure of how much alcohol (ethanol) is contained in a given volume of an alcoholic beverage (expressed as a volume percent).", "It is defined as the number of millilitres (mL) of pure ethanol present in 100\u00a0mL of solution at .", "The number of millilitres of pure ethanol is the mass of the ethanol divided by its density at 20\u00a0\u00b0C, which is 0.78924 g/mL. The ABV standard is used worldwide.", "The International Organization of Legal Metrology has tables of density of water\u2013ethanol mixtures at different concentrations and temperatures.", "In some countries, e.g., France, alcohol by volume is often referred to as degrees Gay-Lussac (after the French chemist Joseph Louis Gay-Lussac), although there is a slight difference since the Gay-Lussac convention uses the International Standard Atmosphere value for temperature, .", "Mixing two solutions of alcohol of different strengths usually causes a change in volume.", "Mixing pure water with a solution less than 24% by mass causes a slight increase in total volume, whereas the mixing of two solutions above 24% causes a decrease in volume.", "The phenomenon of volume changes due to mixing dissimilar solutions is called \"partial molar volume\"." ], [ "Cassa di Risparmio della Provincia dell'Aquila", "In December 2004 both Finbanche d'Abruzzo and Carispaq proposed a capital increases, making the foundation hold 25.991% shares of Finbanche d'Abruzzo, as well as maintaining 17.5% direct ownership on Carispaq .", "In 2005 BPER owned 100% shares of Finbanche d'Abruzzo by acquiring the remaining 25.991% shares from the banking foundation for about \u20ac73 million.", "Due to another capital increases, Finbanche d'Abruzzo owned 79.922% shares of Carispaq (decreased from 82.5%), and the foundation owned 16.953%, with the rest (3.125%) was owned by others.", "in 2008 Finbanche d'Abruzzo was absorbed into BPER.", "In 2011 BPER offered to the public to acquire all the remaining shares of the bank from the minority shareholders.", "The foundation received 1,915,453 number of new shares of BPER by selling 11.853% shares of Carispaq.", "The remaining 5.1% was sold in 2013 for about \u20ac7.26 million from the foundation." ] ], "gold": "Pabst Blue Ribbon, commonly abbreviated PBR, is an American lager beer sold by Pabst Brewing Company, established in Milwaukee, Wisconsin, in 1844 and currently based in San Antonio. The ABV of Pabst Blue Ribbon Beer is 3.8-6.5%. The ABV of the brand's hard coffee is 5%, the ABV of their hard seltzer is 8% and the ABV of their whiskey is 40%. ABV stands for alcohol by volume, which is a standard measure of how much alcohol is contained in a given volume of an alcoholic beverage. ", "prediction 1": "Alcohol by volume or abv of Pabst Blue Ribbon is a standard measure of how much alcohol (ethanol) is contained in a given volume of an alcoholic beverage, expressed as a volume percent. It is defined as the number of millilitres (mL) of pure ethanol present in 100 mL of solution at 20 \u00b0C, which is 0.78924 g/mL. The abv standard is used worldwide.", "prediction 2": "Alcohol by volume is an abbreviation for alcohol by volume. It is defined as the number of millilitres (mL) of pure ethanol present in 100 mL of solution at 20 \u00b0C. The current abv for Pabst Blue Ribbon is 0.78924 g/mL. The current abv for Pabst Blue Ribbon is 0.959 g/l.", "prediction 3": "Alcohol by volume of Pabst Blue Ribbon is 0.78924 g/mL. It is a standard measure of how much alcohol is contained in a given volume of an alcoholic beverage, expressed as a volume percent. Pabst Blue Ribbon has an abv of 12.5%.", "prediction 4": "Pabst Blue Ribbon is an American lager beer sold by Pabst Brewing Company, established in Milwaukee, Wisconsin in 1844, and currently based in Los Angeles. Alcohol by volume, abbreviated as ABV, abv, or alc/vol, is a standard measure of how much alcohol is contained in a given volume of an alcoholic beverage, expressed as a volume percent. The abv of Pabst Blue Ribbon is 0.7983 g/l, which is equivalent to 0.78924 g/mL of pure ethanol. The abv of Pabst Blue Ribbon is 0.69 g/l.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 348 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Alcohol by volume, or ABV is a standard measure of how much alcohol (ethanol) is contained in a given volume of an alcoholic beverage, expressed as a volume percent. Pabst Blue Ribbon is an American lager beer sold by Pabst Brewing Company, established in Milwaukee, Wisconsin in 1844 and currently based in Los Angeles." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Fairground ride where you stick to the wall?", "passages": [ [ "Rotor (ride)", "Rotor (ride)\n\nThe Rotor is an amusement park ride, designed by German engineer Ernst Hoffmeister in the late 1940s.", "The ride was first demonstrated at Oktoberfest 1949, and was exhibited at fairs and events throughout Europe during the 1950s and 1960s.", "The ride still appears in numerous amusement parks, although travelling variants have been surpassed by the Gravitron.", "The Rotor is a large, upright barrel, rotated at 33 revolutions per minute.", "The rotation of the barrel creates a centrifugal effect equivalent to almost 3 \"g\".", "Once the barrel has attained full speed, the floor is retracted, leaving the riders stuck to the wall of the drum.", "At the end of the ride cycle, the drum slows down and gravity takes over.", "The riders slide down the wall slowly.", "Most Rotors were constructed with an observation deck.", "Although Hoffmeister was the designer, most Rotors were constructed under license.", "In Australia, the Rotors were built by Ted Hopkins of Luna Park Milsons Point.", "In the United States, two main companies were responsible for production; the Velare Brothers and the Anglo Rotor Corporation.", "A dispute between these two companies was resolved when the construction rights to touring Rotors were assigned to the Velare Brothers, while permanent-standing Rotors (later becoming known as Chance Rotors) became the domain of ARC." ], [ "Psyclone (Canada's Wonderland)", "Psyclone (Canada's Wonderland)\n\n", "Psyclone is a ride at Canada's Wonderland.", "On May 5, 2002, this Mondial ride was opened to the public at the park.", "The 1 minute and 54 second ride features 40 seats facing outwards which rotate from a central pendulum as the ride reaches its maximum arc angle of 120 degrees.", "Even though the ride height is , when the ride reaches the top of its swing, the height becomes high.", "The rider's experience depends on where they are seated on the ride.", "Before the ride begins, the floor under the riders' feet descends lower (almost like going deeper in the ground) due to how the pendulum swings.", "If the floor did not move, serious injury to riders' legs and bodies would occur.", "Due to the way in which the seats rotate, all riders face different angles of the ride.", "Depending on where the rider is seated, they may experience some air-time as the swing reaches its maximum angle.", "When the ride cycle ends, the pendulum returns to the 'loading position' and the floor rises to the riders' feet, allowing riders to exit and enter the ride." ] ], "gold": "The ride called The Rotor is a large, upright barrel which is rotated at 33 revolutions per minute. Once the barrel has attained full speed, the floor is retracted, leaving the riders stuck to the wall of the drum. At the end of the ride cycle, the drum slows down and gravity takes over and the riders slide down the wall slowly. The Gravitron is a modification of The Rotor, where riders lean back against angled back, padded panels in an enclosed space and as the ride rotates, at a maximum speed of 24 rpm, the rider is removed from the floor. ", "prediction 1": "The Rotor is an amusement park ride designed by German engineer Ernst Hoffmeister in the late 1940s. Once the barrel has attained full speed, the floor is retracted, leaving the riders stuck to the wall of the drum. At the end of the ride cycle, the drum slows down and gravity takes over. The riders slide down the wall slowly.", "prediction 2": "The Rotor is an amusement park ride designed by German engineer Ernst Hoffmeister in the late 1940s. The Rotor was first demonstrated at Oktoberfest 1949, and was exhibited at fairs and events throughout Europe during the 1950s and 1960s. The floor is retracted, leaving the riders stuck to the wall of the drum. At the end of the ride cycle, the drum slows down and gravity takes over. The riders slide down the wall slowly.", "prediction 3": "The Rotor is an amusement park ride designed by German engineer Ernst Hoffmeister in the late 1940s. The Rotor is a large, upright drum rotating at 33 revolutions per minute. Once the barrel has attained full speed, the floor is retracted, leaving the riders stuck to the wall of the drum. At the end of the ride cycle, the drum slows down and gravity takes over. The riders slide down the wall slowly.", "prediction 4": "In the late 1940s, the floor of the Rotor, an amusement park ride designed by German engineer Ernst Hoffmeister, was retracted to keep the riders stuck to the drum wall.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 10, "end": 100 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Rotor is a large, upright barrel, rotated at 33 revolutions per minute. Once the barrel has attained full speed, the floor is retracted, leaving the riders stuck to the wall of the drum. At the end of the ride cycle, the drum slows down and gravity takes over. The riders slide down the wall slowly." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who scored the last goal in 1970 world cup?", "passages": [ [ "1970 FIFA World Cup", "1970 FIFA World Cup\n\nThe 1970 FIFA World Cup was the ninth FIFA World Cup, the quadrennial international football championship for men's national teams.", "Held from 31 May to 21 June in Mexico, it was the first World Cup tournament staged in North America, and the first held outside Europe and South America.", "Teams representing 75 nations from all six populated continents entered the competition, and its qualification rounds began in May 1968.", "Fourteen teams qualified from this process to join host nation Mexico and defending champions England in the sixteen-team final tournament.", "El Salvador, Israel and Morocco made their first appearances at the final stage.", "The tournament was won by Brazil, which defeated another two-time former champion, Italy, 4\u20131 in the final in Mexico City.", "The win gave Brazil its third World Cup title, which allowed them to permanently keep the Jules Rimet Trophy, and a new trophy was introduced in 1974.", "The victorious team, led by Carlos Alberto and featuring players such as Pel\u00e9, G\u00e9rson, Jairzinho, Rivellino, and Tost\u00e3o, is often cited as the greatest-ever World Cup team.", "They achieved a perfect record of wins in all six games in the finals, as well as winning all their qualifying fixtures." ], [ "1970 FIFA World Cup", "Having led from the eighth minute through Roberto Boninsegna's strike, Italy were pegged back in injury time when sweeper Karl-Heinz Schnellinger scored his only international goal.", "Extra-time brought five more goals as the lead swung between the two sides until Gianni Rivera gave the \"Azzurri\" a decisive 4\u20133 lead.", "The match subsequently became known as the \"Game of the Century\", and today has a monument outside the Estadio Azteca to commemorate it.", "West Germany went on to defeat Uruguay 1\u20130 in the third-place match.", "In the final, Brazil opened the scoring when Pel\u00e9 headed in a cross from Rivellino in the 18th minute, but Roberto Boninsegna equalised for Italy after a series of blunders in the Brazilian defence.", "The match remained level until the 66th minute when a powerful shot from G\u00e9rson restored the Brazilians' lead.", "Further goals from Jairzinho and Carlos Alberto rewarded Brazil's attacking play and secured a 4\u20131 victory and a record third World Cup triumph, which earned them the right to permanently keep the Jules Rimet Trophy.", "Both the Brazilian team that were crowned champions of the 1970 World Cup and the tournament itself have become regarded as among the very finest in the history of the FIFA World Cup." ], [ "History of the Brazil national football team", "Brazil also lost this match and was eliminated in the first round of the World Cup for the first time since 1934.", "After the tournament, Pel\u00e9 declared that he did not wish to play in the World Cup again.", "Nonetheless, he returned in 1970.", "Brazil won its third World Cup in Mexico, with the 1970 World Cup.", "It fielded what has since then often been considered the best football squad ever, led by Pel\u00e9 in his last World Cup finals, captain Carlos Alberto Torres, Jairzinho, Tost\u00e3o, G\u00e9rson and Rivellino.", "Brazil's results in 1970 were as follows:\n\nThey won all six of their games, with all but two of their matches were won by two or more goals.", "The speedy Jairzinho was the second top scorer with seven goals (he had scored in all six games), while Pel\u00e9 finished with four goals.", "Brazil played all six of their matches \u2013 with the exception of the final \u2013 in Guadalajara, the final being played in Mexico City.", "As a result, Brazil lifted the Jules Rimet trophy for the third time (the first nation to do so), which meant that they were allowed to keep it, as had been stipulated at the time of the World Cup's inception in 1930.", "A replacement was then commissioned, though it would be 24 years before Brazil next won it." ] ], "gold": "The 1970 FIFA World Cup was the ninth edition of the FIFA World Cup, the quadrennial international football championship for men's senior national teams. The last goal of the championship was scored by Carlos Alberto \"Capita\" Torres. The team that scored the last goal was Brazil's national football team.", "prediction 1": "The 1970 FIFA World Cup was the quadrennial international football championship for men's national teams, held from 31 May to 21 June in Mexico City. The final goal of the tournament was scored by Karl-Heinz Schnellinger, whose goal was the last he scored for Italy in the final match of the World Cup. The team that won the tournament, led by Carlos Alberto, is often cited as the greatest-ever World Cup team.", "prediction 2": "The 1970 FIFA World Cup was the quadrennial international football championship for men's national teams. In the final match of the tournament, Italy were defeated 4\u20133 by Brazil, and Karl-Heinz Schnellinger scored the last goal.", "prediction 3": "There was no goal in the 1970 World Cup. Italy scored the last goal in the second half, but it was Karl-Heinz Schnellinger.", "prediction 4": "The 1970 FIFA World Cup was the quadrennial international football championship for men's national teams. Held from 31 May to 21 June in Mexico, it was the first World Cup tournament staged in North America, and the first held outside Europe and South America. Having led from the eighth minute through Roberto Boninsegna's strike, Italy were pegged back in injury time when sweeper Karl-Heinz Schnellinger scored his only international goal. Brazil defeated another two-time former champion, Italy, 4\u20131 in the final in Mexico City. The win gave Brazil its third World Cup title, which allowed them to permanently keep the Jules Rimet Trophy, and a new trophy was introduced in 1974.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 197, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 411 } ], "missing-info": [], "corrected-prediction": "The 1970 FIFA World Cup was the quadrennial international football championship for men's national teams. The final goals of the tournament was scored by Brazil's Jairzinho and Carlos Alberto." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where was cecil b demille's ten commandments filmed?", "passages": [ [ "The Ten Commandments (1956 film)", "Filmed on location in Egypt, Mount Sinai and the Sinai Peninsula, the film was DeMille's last and most successful work.", "It is a partial remake of his 1923 silent film of the same title, and features one of the largest sets ever created for a film.", "The film was released to cinemas in the United States on November 8, 1956 and, at the time of its release, was the most expensive film ever made.", "In 1957, the film was nominated for seven Academy Awards, including Best Picture, winning the Academy Award for Best Visual Effects (John P. Fulton, A.S.C.).", "Charlton Heston was nominated for a Golden Globe Award for Best Performance by an Actor in a Motion Picture (Drama) for his role as Moses.", "Yul Brynner won the National Board of Review Award for Best Actor for his role as Rameses and his other roles in \"Anastasia\" and \"The King and I\".", "It is also one of the most financially successful films ever made, grossing approximately $122.7 million at the box office during its initial release; it was the most successful film of 1956 and the second-highest-grossing film of the decade.", "According to \"Guinness World Records\", in terms of theatrical exhibition it is the seventh most successful film of all-time when the box office gross is adjusted for inflation." ], [ "The Ten Commandments (1956 film)", "This effect took about six months of VistaVision filming, and combined scenes shot on the shores of the Red Sea in Egypt, with scenes filmed at Paramount Studios in Hollywood of a huge water tank split by a U-shaped trough, into which approximately 360,000 gallons of water were released from the sides, as well as the filming of a giant waterfall also built on the Paramount backlot to create the effect of the walls of the parted sea out of the turbulent backwash.", "All of the multiple elements of the shot were then combined in Paul Lerpae's optical printer, and matte paintings of rocks by Jan Domela concealed the matte lines between the real elements and the special effects elements.", "Unlike the technique used by ILM for \"Raiders of the Lost Ark\" and \"\"Poltergeist\"\" of injecting poster paints into a glass tank containing a salt water inversion layer, the cloud effects for \"The Ten Commandments\" were formed with white Britt smoke filmed against a translucent sky backing, and colors were added optically.", "Striking portraits of Charlton Heston as Moses and three women in front of menacing clouds were photographed by Wallace Kelly, A.S.C. in Farciot Edouart\u2019s process (rear projection) department, in what are still considered unforgettable scenes." ], [ "The Ten Commandments (1923 film)", "Rumor had it that after the filming was complete, the massive sets \u2013 which included four Pharaoh statues, 21 sphinxes, and gates reaching a height of 110 feet, which were built by a small army of 1,600 workers \u2013 were dynamited and buried in the sand.", "Instead, the wind, rain and sand at the Guadalupe-Nipomo Dunes likely collapsed and buried a large part of the set under the ever-shifting dunes.", "The statues and sphinxes are in roughly the same place they were during filming.", "In 2012, archaeologists uncovered the head of one of the prop sphinxes; a 2014 recovery effort showed the body of that sphinx to have deteriorated significantly, but a second better-preserved sphinx was discovered and excavated.", "The parting of the Red Sea scene was shot in Seal Beach, California.", "The visual effect of keeping the walls of water apart while the Israelites walked through was accomplished with a slab of Jell-O that was sliced in two and filmed close up as it jiggled.", "This shot was then combined with live-action footage of Israelites walking into the distance to create the illusion.", "Portions of the modern story were filmed in San Francisco, with the cathedral building sequence filmed at the then under construction Sts.", "Peter and Paul Church on Filbert Street and the adjoining Washington Square." ] ], "gold": "Cecil B. DeMille made two movies called The Ten Commandments. The first one was a silent movie that was filmed in 1923 at Seal Beach, California, San Francisco, California, and the Guadalupe-Nipomo Dunes. Then, in 1956, Cecil B. DeMille directed a partial remake the 1923 movie The Ten Commandments and gave it the same title. The 1956 movie was filmed at the Red Sea in Egypt and at the Paramount Studios in Hollywood.", "prediction 1": "The film Ten Commandments was filmed on location in Egypt, Mount Sinai and the Sinai Peninsula. It was Cecil B. DeMille's last and most successful work. Filming for The Ten Commandments took place on locations in the country of Egypt and the United States. The effects were made in the United States at Paramount Studios.", "prediction 2": "The Ten Commandments was filmed on location in Egypt, Mount Sinai and the Sinai Peninsula. It was Cecil B. DeMille's last and most successful work. It is a partial remake of his 1923 silent film of the same title, and features one of the largest sets ever created for a film. The film was released to cinemas in the United States on November 8, 1956 and, at the time of its release, was the most expensive film ever made. The parting of the Red Sea scene was shot in Seal Beach, California.", "prediction 3": "The film, a partial remake of Cecil B. DeMille's 1923 silent film of the same title, was shot on location in Egypt, Mount Sinai and the Sinai Peninsula. During filming, scenes for the parting of the Red Sea were shot in Seal Beach, California, while a scene for the wall of water was filmed in El Dorado, California.", "prediction 4": "Cecil B. DeMille's film The Ten Commandments was filmed in various locations around the world, including Egypt, Mount Sinai and the Sinai Peninsula. It was a partial remake of his 1923 silent film of the same title and features one of the largest sets ever created for a film. The film was released to cinemas in the United States on November 8, 1956 and, at the time of its release, was the most expensive film ever made. It is also one of the most financially successful films ever made, grossing approximately $122.7 million at the box office during its initial release.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 152 }, { "error type": "Redundant", "explanation": "The film Ten Commandments was filmed on location in Egypt,", "start": 153, "end": 233 }, { "error type": "Redundant", "explanation": "The film Ten Commandments was filmed on location in Egypt, Mount Sinai and the Sinai Peninsula. It was Cecil B. DeMille's last and most successful work. Filming for The Ten Commandments took place on locations in the country of Egypt and the United States. ", "start": 257, "end": 299 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The film Ten Commandments was a 1956 partial remake of DeMille's 1923 silent film of the same name. It was filmed on location in Egypt, Mount Sinai and the Sinai Peninsula and and combined scenes shot on the shores of the Red Sea in Egypt, with scenes filmed at Paramount Studios and backlot in Hollywood. Filming for the 1923 Ten Commandments took place at the Guadalupe-Nipomo Dunes, in Seal Beach, California, in San Francisco at the St. Peter and Paul Church on Filbert Street and the adjoining Washington Square." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who played the angel in angels in the outfield?", "passages": [ [ "Angels in the Outfield (1994 film)", "Angels in the Outfield (1994 film)\n\nAngels in the Outfield is a 1994 American family sports fantasy comedy-drama film that is a remake of the 1951 film of the same name.", "The film stars Danny Glover, Tony Danza and Christopher Lloyd (the two latter actors previously worked together on \"Taxi\"), and features several future stars, including Joseph Gordon-Levitt (in the lead), Adrien Brody, Matthew McConaughey, and Neal McDonough.", "It spawned two direct-to-video sequels, \"Angels in the Endzone\" and \"Angels in the Infield\".", "The film was released less than a month before the 1994 MLB Baseball Players Strike, which forced the league to cancel the playoffs and the World Series.", "Young foster child Roger and his friend J.P. love to sneak into baseball games of the hopelessly dreadful California Angels.", "Still in limited contact with his widower father, Roger asks when they will be a family again.", "His father replies sarcastically, \"I'd say when the Angels win the pennant.\"", "Taking his father's words literally, Roger prays for God to help the Angels win.", "After he prays, a star, unseen by Roger, twinkles in the sky." ], [ "Christopher Lloyd", "Christopher Lloyd\n\nChristopher Allen Lloyd (born October 22, 1938) is an American actor, voice actor, and comedian.", "Lloyd came to public attention in Northeastern theater productions during the 1960s and early 1970s, earning an Obie Award and a Drama Desk Award for his work.", "He made his screen debut in \"One Flew Over the Cuckoo's Nest\" (1975), and gained widespread recognition as Jim Ignatowski in the comedy series \"Taxi\" (1978\u20131983), for which he won two Emmy Awards.", "Lloyd also starred as Emmett \"Doc\" Brown in the \"Back to the Future\" trilogy, Judge Doom in \"Who Framed Roger Rabbit\" (1988), and Uncle Fester in \"The Addams Family\" (1991) and its sequel \"Addams Family Values\" (1993).", "Lloyd earned a third Emmy for his 1992 guest appearance in \"Road to Avonlea\", and won an Independent Spirit Award for his performance in \"Twenty Bucks\" (1993).", "He has done extensive voice work, including Merlock in \"\" (1990), Grigori Rasputin in \"Anastasia\" (1997), The Woodsman in Cartoon Network miniseries \"Over the Garden Wall\" (2014), and the Hacker in PBS Kids series \"Cyberchase\" (2002\u2013present), which earned him two further Emmy nominations." ], [ "Angels in the Outfield (1951 film)", "Angels in the Outfield (1951 film)\n\nAngels in the Outfield is a 1951 American comedy film produced and directed by Clarence Brown and starring Paul Douglas and Janet Leigh.", "Based on a story by Richard Conlin, the film is about a young woman reporter who blames the Pittsburgh Pirates' losing streak on their abusive manager, who begins hearing the voice of an angel promising to help the team if he changes his ways.", "The film was released by Metro-Goldwyn-Mayer on October 19, 1951.", "With baseball's Pittsburgh Pirates in last place, their combative, foul-mouthed manager Guffy McGovern has plenty to complain about.", "All this changes when, while wandering through Forbes Field in search of his good luck charm one night, Guffy is accosted by the voice of an angel (voice of James Whitmore), who hints at having been a ballplayer during his earthly life.", "As the spokes-angel for the Heavenly Choir Nine, a celestial team of deceased ballplayers, he begins bestowing \"miracles\" upon the Pirates\u2014but only on the condition that McGovern put a moratorium on swearing and fighting.", "With the help of the invisible ghosts of past baseball greats, the Pirates make it into the pennant race." ] ], "gold": "There are several \"Angels in the Outfield\" films. James Whitmore played the Angel in the 1951 film. In the 1994 film, which was a remake of the 1951 film, the Boss Angel was played by American actor Christopher Lloyd.", "prediction 1": "Angels in the Outfield is a 1951 American comedy film produced and directed by Clarence Brown and starring Paul Douglas and Janet Leigh. Based on a story by Richard Conlin, the film is about a young woman reporter who blames the Pittsburgh Pirates' losing streak on their abusive manager, who begins hearing the voice of an angel promising to help the team if he changes his ways. As the spokes-angel for the Heavenly Choir Nine, a celestial team of deceased ballplayers, Guffy McGovern begins hearing the voice of an angel.", "prediction 2": "Angels in the Outfield is a 1951 American comedy film produced and directed by Clarence Brown and starring Paul Douglas and Janet Leigh. Based on a story by Richard Conlin, the film is about a young woman reporter who blames the Pittsburgh Pirates' losing streak on their abusive manager, who begins hearing the voice of an angel promising to help the team if he changes his ways. As the spokes-angel for the Heavenly Choir Nine, a celestial team of deceased ballplayers, Guffy McGovern comes to the Angel.", "prediction 3": "The 1951 movie Angels in the Outfield is about a young reporter who blames the Pittsburgh Pirates' losing streak on their abusive manager, who begins hearing the voice of an angel promising to help the team if he changes his ways. As the spokes-angel for the Heavenly Choir Nine, a celestial team of deceased ballplayers, he begins bestowing miracles upon the Pirates. The film stars Danny Glover, Tony Danza and Christopher Lloyd, who also voice the angel in the 1994 remake, which was a remake of the 1951 film.", "prediction 4": "Angels in the Outfield is a 1951 American comedy film produced and directed by Clarence Brown and starring Paul Douglas and Janet Leigh. Based on a story by Richard Conlin, the film is about a young woman reporter who blames the Pittsburgh Pirates' losing streak on their abusive manager, who begins hearing the voice of an angel promising to help the team if he changes his ways. As the spokes-angel for the Heavenly Choir Nine, a celestial team of deceased ballplayers, Guffy McGovern begins hearing the voice of an angel who hints at having been a baseball player during his earthly life.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 501 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Angels in the Outfield is a 1951 American comedy film starring James Whitmore as the voice of an angel." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played harry in bigfoot and the hendersons?", "passages": [ [ "Harry and the Hendersons", "Harry and the Hendersons\n\nHarry and the Hendersons is a 1987 American fantasy comedy film directed and produced by William Dear and starring John Lithgow, Melinda Dillon, Don Ameche, David Suchet, Margaret Langrick, Joshua Rudoy, Lainie Kazan, and Kevin Peter Hall.", "Steven Spielberg served as its uncredited executive producer, while Rick Baker provided the makeup and the creature designs for Harry.", "It is the story of a Seattle family's encounter with the cryptozoological creature Bigfoot, partially inspired by the numerous claims of sightings in the Pacific Northwest, California, and other parts of both the United States and Canada since the late 1960s.", "The film won an Academy Award for Best Makeup, and inspired a follow-up TV series of the same name.", "In the United Kingdom, the film was originally released as Bigfoot and the Hendersons, though the TV series retained the American title.", "The DVD and all current showings of the movie in the UK now refer to the movie by its original title.", "In conjunction with the film's setting, shooting took place at several locations in the Cascade Range of Washington state near I-90 and the town of Index near US 2 as well as Seattle's Wallingford, Ballard and Beacon Hill neighborhoods and other locations in or around Seattle's I-5 corridor.", "The film grossed $50 million worldwide." ], [ "Harry and the Hendersons (TV series)", "Harry and the Hendersons (TV series)\n\nHarry and the Hendersons is an American sitcom based on the film of the same name, produced by Amblin Television for Universal Television.", "The series aired in syndication from January 13, 1991 to June 18, 1993, with 72 half-hour episodes produced.", "The series is about a family who adopts a Bigfoot called Harry.", "Bruce Davison and Molly Cheek played the parents (in the film, they were played by John Lithgow and Melinda Dillon respectively) with Carol-Ann Plante and Zachary Bostrom as the children (in the film, they were played by Margaret Langrick and Joshua Rudoy respectively).", "Kevin Peter Hall played the role of Harry in both the film and TV series, until his death late in the production of the first season.", "He was replaced first by Dawan Scott and then by Brian Steele in the third season (Steele had filled in for Scott in the Harry costume for numerous scenes during season two, before taking over the role full-time).", "Harry's vocal effects were provided by Patrick Pinney where the vocal effects were previously provided by Fred Newman in the film.", "In the series, George and Nancy were an upwardly mobile two-career couple, with the former working for a sporting goods company." ] ], "gold": "Harry and the Hendersons is a 1987 American fantasy comedy film. The film tells the story of a Seattle family's encounter with the creature Bigfoot, partially inspired by the numerous claims of sightings in the Pacific Northwest, California. In the film, Kevin Peter Hall played the character Harry in a suit while Fred Newman provided the voice. Rick Baker, Tom Hester, and Tim Lawrence played Harry as puppeteers.", "prediction 1": "Harry and the Hendersons is a 1987 American fantasy comedy film directed and produced by William Dear and starring John Lithgow, Melinda Dillon, Don Ameche, David Suchet, Margaret Langrick, Joshua Rudoy, Lainie Kazan, Kevin Peter Hall, and Steven Spielberg. It is the story of a Seattle family's encounter with the cryptozoological creature Bigfoot, partially inspired by the numerous claims of sightings in the Pacific Northwest, California, and other parts of both the United Kingdom, the film was originally released as Bigfoot and the Hendersons, though the American series retained the title.", "prediction 2": "Harry and the Hendersons is a 1987 American fantasy comedy film directed and produced by William Dear and starring John Lithgow, Melinda Dillon, Don Ameche, David Suchet, Margaret Langrick, Joshua Rudoy, Lainie Kazan, and Kevin Peter Hall. In the United Kingdom, the film was originally released as Bigfoot and the Hendersons, though the TV series retained the American title. In the American sitcom Harry and the Hendersons, Dawan Scott played the role of Harry, while Brian Steele played the role of Harry in the third season. Harry's vocal effects were provided by Patrick Pinney where the vocal effects were previously provided by Fred Newman in the film.", "prediction 3": "Harry and the Hendersons is a 1987 American fantasy comedy film directed and produced by William Dear and starring John Lithgow, Melinda Dillon, David Suchet, Margaret Langrick, Joshua Rudoy, Lainie Kazan, and Kevin Peter Hall. The film inspired a follow-up TV series called Harry and the Hendersons. Kevin Peter Hall played the role of Harry in both the film and TV series, until his death late in the production of the first season. He was replaced first by Dawan Scott and then by Brian Steele in the third season (Steele had filled in for Scott in the Harry costume for numerous scenes during season two, before taking over the role full-time).", "prediction 4": "Harry and the Hendersons is a 1987 American fantasy comedy film directed and produced by William Dear and starring John Lithgow, Melinda Dillon, Don Ameche, David Suchet, Margaret Langrick, Joshua Rudoy, Lainie Kazan, and Kevin Peter Hall. In the United Kingdom, the film was originally released as Bigfoot and the Hendersons, though the TV series retained the American title. Harry and the Hendersons is an American sitcom based on the 1987 film produced by Amblin Television for Universal Television. Brian Steele played the character Harry in the third season, after being replaced by Dawan Scott and then by Dawan Scott and then by Brian Steele in the series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 597 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 486 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Harry and the Hendersons is a 1987 American fantasy comedy film starring Kevin Peter Hall. It is the story of a Seattle family's encounter with the cryptozoological creature Bigfoot, partially inspired by the numerous claims of sightings in the Pacific Northwest, California. Hall played the role of Harry in both the film and TV series, until his death late in the production of the first season. He was replaced first by Dawan Scott and then by Brian Steele in the third season. Harry's vocal effects were provided by Patrick Pinney where the vocal effects were previously provided by Fred Newman in the film." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings with every beat of my heart?", "passages": [ [ "Every Beat of My Heart (song)", "Every Beat of My Heart (song)\n\n\"Every Beat of My Heart\" is a rhythm and blues song by Johnny Otis.", "It was first recorded in 1954 by his group, The Royals (later to be known as The Midnighters).", "In 1961 Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label.", "Credited to The Pips, it was the first of eleven releases by the group to make it to number one on the R&B/soul chart.", "It was also the group's first top ten on the \"Billboard\" Hot 100.", "\"Every Beat of My Heart\" was first recorded for the Huntom label, who later sold the master to Vee-Jay.", "At the time of the song's release, The Pips were on the Fury label where they re-recorded the song without piano.", "In an unusual occurrence, the Fury recording of the song also made the top twenty on the R&B Sides chart and also made the Hot 100.", "James Brown recorded an instrumental version of \"Every Beat of My Heart\" with his band which was released as the B-side of his 1963 single \"Like a Baby\" and charted #99 Pop." ] ], "gold": "Every Beat of My Heart is a rhythm and blues song by Johnny Otis. It was first recorded in 1954 by his group, The Royals (later to be known as The Midnighters). In 1961 Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label. Credited to The Pips, it was the first of eleven releases by the group to make it to number one on the R&B/soul chart. It was also the group's first top ten on the Billboard Hot 100. James Brown recorded an instrumental version of Every Beat of My Heart with his band which was released as the B-side of his 1963 single Like a Baby and charted #99 Pop.", "prediction 1": "Every Beat of My Heart is a rhythm and blues song by Johnny Otis. It was first recorded in 1954 by his group, The Royals. In 1961 Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label. James Brown recorded an instrumental version of Every Beat of My Heart with his band which was released as the B-side of his 1963 single \"Like a Baby\" and charted #99 Pop.", "prediction 2": "Johnny Otis sings \"Every Beat of My Heart.\" It was first recorded in 1954 by his group, The Royals, later to be known as The Midnighters. Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label in 1961.", "prediction 3": "\"Every Beat of My Heart\" is a rhythm and blues song written by Johnny Otis. It was first recorded in 1954 by his group, The Royals (later to be known as The Midnighters). Gladys Knight & the Pips recorded the song for their debut single in 1961 for the Vee-Jay label. James Brown also recorded an instrumental version of \"Every Beat of My Heart\" with his band in 1963.", "prediction 4": "\"Every Beat of My Heart\" is a rhythm and blues song by Johnny Otis. It was first recorded in 1954 by his group, The Royals. In 1961 Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label. It was also the group's first top ten on the Billboard Hot 100.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Every Beat of My Heart is a rhythm and blues song by Johnny Otis. It was first recorded in 1954 by his group, The Royals (later to be known as The Midnighters). In 1961 Gladys Knight & the Pips recorded the song for their debut single on the Vee-Jay label. Credited to The Pips, it was the first of eleven releases by the group to make it to number one on the R&B/soul chart. It was also the group's first top ten on the \"Billboard\" Hot 100. James Brown recorded an instrumental version of Every Beat of My Heart with his band which was released as the B-side of his 1963 single \"Like a Baby\" and charted #99 Pop." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What are the neighboring countries of dominican republic?", "passages": [ [ "Dominican Republic", "They worked on sugarcane plantations and docks and settled mainly in the cities of San Pedro de Macor\u00eds and Puerto Plata.", "Puerto Rican, and to a lesser extent, Cuban immigrants fled to the Dominican Republic from the mid-1800s until about 1940 due to a poor economy and social unrest in their respective home countries.", "Many Puerto Rican immigrants settled in Hig\u00fcey, among other cities, and quickly assimilated due to similar culture.", "Before and during World War II, 800 Jewish refugees moved to the Dominican Republic.", "Numerous immigrants have come from other Caribbean countries, as the country has offered economic opportunities.", "There are about 32,000 Jamaicans living in the Dominican Republic.", "There is an increasing number of Puerto Rican immigrants, especially in and around Santo Domingo; they are believed to number around 10,000.", "There are over 700,000 people of Haitian descent, including a generation born in the Dominican Republic.", "Haiti is the neighboring nation to the Dominican Republic and is considerably poorer, less developed and is additionally the least developed country in the western hemisphere.", "In 2003, 80% of all Haitians were poor (54% living in abject poverty) and 47.1% were illiterate.", "The country of nine million people also has a fast growing population, but over two-thirds of the labor force lack formal jobs." ], [ "Dominican Republic", "Dominican Republic\n\nThe Dominican Republic ( ) is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region.", "It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti, making Hispaniola one of two Caribbean islands, along with Saint Martin, that are shared by two sovereign states.", "The Dominican Republic is the second-largest Caribbean nation by area (after Cuba) at , and third by population with approximately 10 million people, of which approximately three million live in the metropolitan area of Santo Domingo, the capital city.", "Christopher Columbus landed on the island on December 5, 1492, which the native Ta\u00edno people had inhabited since the 7th century.", "The colony of Santo Domingo became the site of the first permanent European settlement in the Americas, the oldest continuously inhabited city, and the first seat of the Spanish colonial rule in the New World.", "After more than three hundred years of Spanish rule the Dominican people declared independence in November 1821.", "The leader of the independence movement Jos\u00e9 N\u00fa\u00f1ez de C\u00e1ceres, intended the Dominican nation to unite with the country of Gran Colombia, but no longer under Spain's custody the newly independent Dominicans were forcefully annexed by Haiti in February 1822.", "Independence came 22 years later after victory in the Dominican War of Independence in 1844." ], [ "Turks and Caicos Islands", "Turks and Caicos Islands\n\nThe Turks and Caicos Islands ( and ), or TCI for short, are a British Overseas Territory consisting of the larger Caicos Islands and smaller Turks Islands, two groups of tropical islands in the Lucayan Archipelago of the Atlantic Ocean and northern West Indies.", "They are known primarily for tourism and as an offshore financial centre.", "The resident population is 31,458 of whom 23,769 live on Providenciales in the Caicos Islands.", "The Turks and Caicos Islands lie southeast of Mayaguana in the Bahamas island chain, northeast of Cuba, and of the island of Hispaniola (Haiti and the Dominican Republic) and the other Antilles archipelago islands.", "Cockburn Town, the capital since 1766, is situated on Grand Turk Island about east-southeast of Miami, United States.", "The islands have a total land area of .", "The first recorded European sighting of the islands now known as the Turks and Caicos occurred in 1512.", "In the subsequent centuries, the islands were claimed by several European powers with the British Empire eventually gaining control.", "For many years the islands were governed indirectly through Bermuda, the Bahamas, and Jamaica.", "When the Bahamas gained independence in 1973, the islands received their own governor, and have remained a separate autonomous British Overseas Territory since." ] ], "gold": "The Dominican Republic is a country located on the island of Hispaniola, which it shares with Haiti, bordering the Dominican Republic to the West, where the US also neighbors the country. To the east, it is neighbored by The Bahamas as well as by Britain as the Turks and Caicos Islands are under their control as a British Overseas Territory.", "prediction 1": "The Dominican Republic is located on the island of Hispaniola in the Greater Antilles archipelago of the Caribbean region. It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti. The Turks and Caicos Islands are a British Overseas Territory consisting of the larger Caicos Islands and smaller Turks Islands, two groups of tropical islands in the Lucayan Archipelago of the Atlantic Ocean and northern West Indies.", "prediction 2": "The Dominican Republic is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region. It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti, making Hispaniola one of two Caribbean islands, along with Saint Martin, that are shared by two sovereign states. The Turks and Caicos Islands, or TCI for short, are a British Overseas Territory consisting of the larger Caicos Islands and smaller Turks Islands, two groups of tropical islands in the Atlantic Ocean and northern West Indies. The Turks and Caicos Islands lie southeast of Mayaguanaguanaguanaguanaguanaguana in the Bahamas island chain, northeast of Cuba, and of the island of Hispaniola (Haiti and the Dominican Republic).", "prediction 3": "The Dominican Republic is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region. It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti. The Turks and Caicos Islands and the Dominican Republic are neighboring nations.", "prediction 4": "The Dominican Republic is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region. It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti, making Hispaniola one of two Caribbean islands, along with Saint Martin, that are shared by two sovereign states. The Turks and Caicos Islands are a British Overseas Territory consisting of the larger Caicos Islands and smaller Turks Islands, two groups of tropical islands in the Lucayan Archipelago of the Atlantic Ocean and northern West Indies. The Turks and Caicos Islands are known primarily for tourism and as an offshore financial centre. The Turks and Caicos Islands lie southeast of Mayaguanaguanaguanaguanaguanaguanaguanaguanaguan", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 216 }, { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 451 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Dominican Republic is located on the island of Hispaniola. Haiti is the neighboring nation to the Dominican Republic." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When was taarak mehta ka ooltah chashmah started?", "passages": [ [ "Taarak Mehta Ka Ooltah Chashmah", "Taarak Mehta Ka Ooltah Chashmah\n\nTaarak Mehta Ka Ooltah Chashmah (English: Taarak Mehta's Inverted Spectacles) is one of the India's longest running sitcoms.", "It is produced by Neela Tele Films Private Limited.", "The show went on air on July 28, 2008.", "It airs from Monday to Friday on SAB TV.", "Reruns of the show started on Sony Pal from November 2, 2015.", "The show is based on the column \"Duniya Ne Undha Chashma\" written by real-life columnist and journalist/playwright Taarak Mehta for Gujarati weekly magazine \"Chitralekha\".", "Gokuldham Society is a residential society in Powder Galli, Goregaon, Mumbai with four wings: A Wing, B Wing, C Wing and D Wing.", "Although the society has 17 flats, the show revolves around the lives of eight families:\n\n\n\n\n\n\n\n\n\nThere are also other recurring characters including Sundarlal (brother of Jethalal's wife Daya, from Ahmedabad, Gujarat) and his friends." ], [ "Asit Kumarr Modi", "Modi handled production, creative and marketing for the serial \"Rajni\" (1995\u201396); marketing for a Marathi serial \"Kondmara\" for DD Marathi (1996\u201397); and marketing and executive production for \"Kabhi Yeh Kabhi Woh\", a sitcom for DD II.", "He has also produced and marketed the Gujarati serials \"Miyan Fuski\", a comedy serial based on characters created by Jivram Joshi; \"Parinam\", a suspense thriller for DD Mumbai and Ahmedabad; and \"Aahwan\", a family drama.", "Modi founded the television production company Neela Tele Films Private Limited in 1995, starting with the show \"Hum Sab Ek Hain\", followed by shows in other genres including comedy, drama, poetry series and reality game shows.", "The Hindi sitcom \"Taarak Mehta Ka Ooltah Chashmah\" (SAB TV) is based on Gujarati humorist Taarak Mehta's weekly column \u201cDuniya Ne Undha Chashma\u201d published in the Gujarati magazine \"Chitralekha\".", "Modi modified the show's story for a present-day audience.", "The show has been running for over ten years and has completed 2,600 episodes as on November 13, 2018." ] ], "gold": "Taarak mehta ka ooltah chashmah went on air on 28 July 2008. It took eight years to get this show on air. Asit Kumarr Modi said, originally, it was a column in a Gujarati magazine, and he bought its rights in 2001. He further stated that finally, in 2008, Taarak Mehta... came on air.", "prediction 1": "Taarak Mehta Ka Ooltah Chashmah is one of the India's longest running sitcoms. It is produced by Neela Tele Films Private Limited and started airing on July 28, 2008. The show has completed 2,600 episodes as of November 13, 2018.", "prediction 2": "Taarak Mehta Ka Ooltah Chashmah is one of the India's longest running sitcoms, produced by Neela Tele Films Private Limited. The show went on air on July 28, 2008. It airs from Monday to Friday on SAB TV. Reruns of the show started on Sony Pal from November 2, 2015.", "prediction 3": "Taarak Mehta Ka Ooltah Chashmah is one of India's longest running sitcoms. It is produced by Neela Tele Films Private Limited. The show started airing on July 28, 2008. Reruns of the show started on Sony Pal from November 2, 2015.", "prediction 4": "Taarak Mehta Ka Ooltah Chashmah is one of the longest running sitcoms of India. It is produced by Neela Tele Films Private Limited and it started airing on July 28, 2008. Modi founded the television production company Neela Tele Films Private Limited in 1995, starting with the show \"Hum Sab Ek Hain\", followed by shows in other genres including comedy, drama, poetry series and reality game shows. Modi modified the show's story for a present-day audience.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 229 } ], "missing-info": [], "corrected-prediction": "Taarak Mehta Ka Ooltah Chashmah started airing on July 28, 2008. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "The central meeting place for government officials in ancient greece was?", "passages": [ [ "Pnyx", "Pnyx\n\nThe Pnyx (; ; , \"Pnyka\") is a hill in central Athens, the capital of Greece.", "Beginning as early as 507 BC (Fifth-century Athens), the Athenians gathered on the Pnyx to host their popular assemblies, thus making the hill one of the earliest and most important sites in the creation of democracy.", "The Pnyx is located less than west of the Acropolis and 1.6\u00a0km south-west of the centre of Athens, Syntagma Square.", "The Pnyx was used for popular assemblies in Athens as early as 507 BC, when the reforms of Cleisthenes transferred political power to the citizenry.", "It was then outside the city proper, but close enough to be convenient.", "It looks down on the ancient Agora, which was the commercial and social centre of the city.", "At this site all the great political struggles of Athens of the \"Golden Age\" were fought out.", "Pericles, Aristides and Alcibiades spoke here, within sight of the Parthenon, temple of Athena.", "Here Demosthenes delivered his vilifications of Philip of Macedon, the famous Philippics.", "The Pnyx is a small, rocky hill surrounded by parkland, with a large flat platform of eroded stone set into its side, and by steps carved on its slope." ], [ "Pnyx", "The right of \"is\u0113gor\u00eda\" was expressed by the presiding officer of the Pnyx assembly, who formally opened each debate with the open invitation \"\"T\u00eds agore\u00faein bo\u00faletai?\"\" (Greek: \"\"\u03a4\u03af\u03c2 \u1f00\u03b3\u03bf\u03c1\u03b5\u03cd\u03b5\u03b9\u03bd \u03b2\u03bf\u03cd\u03bb\u03b5\u03c4\u03b1\u03b9;\"\", \"Who wishes to speak to the Popular Assembly?\").", "The Pnyx was protected by a defense wall built in the fourth century BC and reconstructed a century later.", "The new walls, made of almost solid masonry and ashlar blocks, were two-meter thick.", "The stretch began on a northern end with a tower that stood south of the Melitides Gate of the Themistoclean Wall and ended at the western end of the summit where it joined the Diateichisma.", "The wall featured seven towers set with 40-meter interval while the connecting walls were strengthened by buttresses.", "The Pnyx was the official meeting place of the Athenian democratic assembly ().", "In the earliest days of Athenian democracy (after the reforms of Kleisthenes in 508 B.C. ), the ekklesia met in the Agora.", "Sometime in the early 5th century, the meeting place was moved to a hill south and west of the Acropolis." ] ], "gold": "The central meeting place for government officials in ancient Greece was a hill in central Athens, called, the Pnyx.", "prediction 1": "The Pnyx is a hill in central Athens, the capital of Greece. Beginning as early as 507 BC, the Athenians gathered on the Pnyx to host their popular assemblies, thus making the hill one of the earliest and most important sites in the creation of democracy. In the early days of Athenian democracy, the ekklesia met in the Agora. In the early 5th century, the meeting place was moved to a hill south and west of the Acropolis. In the earliest days of Athenian democracy, the ekklesia. Sometime in the early 5th century, the meeting place was moved to a hill south and west of the Acropolis.", "prediction 2": "The Pnyx was the central meeting place for government officials in ancient Greece. Beginning as early as 507 BC, the Athenians gathered on the Pnyx to host their popular assemblies, thus making the hill one of the earliest and most important sites in the creation of democracy. The Pnyx was also the meeting place of the Athenian ekklesia. The meeting place for government officials in ancient Greece was also the central meeting place for government officials in the 5th century.", "prediction 3": "The Pnyx was the central meeting place for government officials in ancient Greece, beginning as early as 507 BC. The Athenians gathered on the Pnyx to host their popular assemblies, thus making the hill one of the earliest and most important sites in the creation of democracy.", "prediction 4": "The Pnyx was the official meeting place of the Athenian democratic assembly. Originally, the ekklesia met in the Agora in Athens, but in the early 5th century, the meeting place was moved to a hill south and west of the Acropolis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 331, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 482 }, { "error type": "Irrelevant", "explanation": "", "start": 483, "end": 588 } ], "missing-info": [], "corrected-prediction": "The Pnyx is a hill in central Athens, the capital of Greece. The Athenians gathered on the Pnyx to host their popular assemblies." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who dies first in lord of the rings?", "passages": [ [ "The Lord of the Rings: The Fellowship of the Ring", "The Lord of the Rings: The Fellowship of the Ring\n\nThe Lord of the Rings: The Fellowship of the Ring is a 2001 epic fantasy adventure film directed by Peter Jackson based on the first volume of J. R. R. Tolkien's \"The Lord of the Rings\" (1954\u20131955).", "It is the first instalment in \"The Lord of the Rings series\", and was followed by \"\" (2002) and \"\" (2003), based on the second and third volumes of \"The Lord of the Rings\".", "Set in Middle-earth, the story tells of the Dark Lord Sauron (Sala Baker), who is seeking the One Ring.", "The Ring has found its way to the young hobbit Frodo Baggins (Elijah Wood).", "The fate of Middle-earth hangs in the balance as Frodo and eight companions who form the Fellowship of the Ring begin their journey to Mount Doom in the land of Mordor, the only place where the Ring can be destroyed.", "Released on 10 December 2001, the film was highly acclaimed by critics and fans alike who considered it to be a landmark in film-making and an achievement in the fantasy film genre.", "It has continued to be featured on critic lists of the greatest fantasy films ever made, ." ], [ "Of the Rings of Power and the Third Age", "Years pass, and Sauron, who had renewed his might, decides to attack the new realms while they were still weak.", "His onslaught fails, however, and Elendil, his sons, and the Elven kings fight back.", "For many years the great coalition (The Last Alliance of Elves and Men, as it became known) besiege Mordor.", "At last the host breaks through into Sauron's fortress of Barad-d\u00fbr.", "An\u00e1rion died first before Sauron broke the siege and the mighty king of the Elves, Gil-galad, challenges Sauron to a duel, and is slain in combat.", "Finally Elendil fights Sauron, and though he is mortally wounded he manages to overcome Sauron before he dies.", "Isildur, Elendil's son, approaches Sauron's body and cuts off his finger with the One Ring, breaking Sauron's power and causing his spirit to depart from his body.", "Sauron later returns as the Necromancer in \"The Hobbit\", and returns later to Barad-d\u00fbr by the time of the \"Lord of the Rings\"." ] ], "gold": "The Lord of the Rings: The Fellowship of the Ring is a 2001 epic fantasy adventure film directed by Peter Jackson, based on the 1954 novel The Fellowship of the Ring, the first volume of J. R. R. Tolkien's The Lord of the Rings. The film is the first installment in the Lord of the Rings trilogy. Two characters in the Lord of the Rings, are Gil-galad and Elendil. Gil-galad died first offscreen and Elendil was the first to die on screen. ", "prediction 1": "The Lord of the Rings: The Fellowship of the Ring is a 2001 epic fantasy adventure film directed by Peter Jackson based on the first volume of J. R. R. Tolkien's The Lord of the Rings (1954\u20131955). In the film, Sauron dies first, before the mighty king of the Elves, Gil-galad, is slain in combat. Finally, Elendil fights Sauron, and though he is mortally wounded he manages to overcome Sauron before he dies.\n", "prediction 2": "The Lord of the Rings: The Fellowship of the Ring is a 2001 epic fantasy adventure film directed by Peter Jackson based on the first volume of J. R. R. Tolkien's The Lord of the Rings. In the film, Sauron dies first in order to break the siege of Barad-d\u00fbr. In the second volume, Sauron dies in order to break the siege of Mordor.", "prediction 3": "The Lord of the Rings: The Fellowship of the Ring is the first film in The Lord of the Rings series and the inspiration for the controversial film franchise. In the film, Sauron dies first after the mighty king of the Elves, Gil-galad, battles Sauron in combat and Frodo Baggins, accompanied by eight companions, dies first after they battle him.", "prediction 4": "In The Lord of the Rings, Sauron dies first in order to break the siege of Barad-d\u00fbr. In this film, the name of the character used is An\u00e1rion, who dies first in order to stop Sauron's plan to smash through the fortress.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 197, "end": 209 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 210, "end": 296 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Lord of the Rings: The Fellowship of the Ring is a 2001 epic fantasy adventure film directed by Peter Jackson based on the first volume of J. R. R. Tolkien's The Lord of the Rings (1954\u20131955). It is the first instalment in \"The Lord of the Rings series\". In the story, An\u00e1rion died first before Sauron broke the siege. The mighty king of the Elves, Gil-galad, challenges Sauron to a duel, and is slain in combat. Finally Elendil fights Sauron, and though he is mortally wounded he manages to overcome Sauron before he dies." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the fifth biggest state in the united states?", "passages": [ [ "Economy of the United States", "Although the amount of R&D spending increased in 2011, it was still below the level of 2008 expenditure.", "By 2012, the growth rate of business-funded R&D had recovered.", "Whether this continues will be contingent on the pursuit of economic recovery and growth, levels of federal research funding and the general business climate.", "The level of research spending varies considerably from one state to another.", "Six states (New Mexico, Maryland, Massachusetts, Washington, California and Michigan) each devoted 3.9% or more of their GDP to R&D in 2010, together contributing 42% of national research expenditure.", "In 2010, more than one quarter of R&D was concentrated in California (28.1%), ahead of Massachusetts (5.7%), New Jersey (5.6%), Washington State (5.5%), Michigan (5.4%), Texas (5.2%), Illinois (4.8%), New York (3.6%) and Pennsylvania (3.5%).", "Seven states (Arkansas, Nevada, Oklahoma, Louisiana, South Dakota and Wyoming) devoted less than 0.8% of GDP to R&D. California is home to Silicon Valley, the name given to the area hosting the leading corporations and start-ups in information technology." ] ], "gold": "The fifth biggest state in the United States by area is New Mexico. While Pennsylvania is the fifth largest state by population.", "prediction 1": "The fifth largest state in the United States, by population, is California.", "prediction 2": "The fifth largest state in the United States by area is California. On the national level, New Mexico has the fifth largest economy.", "prediction 3": "In 2010, more than one quarter of the country's research spending was concentrated in California. Massachusetts is the fifth largest state in the United States, followed by New Jersey, New York, Pennsylvania, Texas and Illinois.", "prediction 4": "The fifth largest state in the United States by area is Louisiana.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who is the secretary of state for transport?", "passages": [ [ "Jake Berry", "Jake Berry\n\nJames Jacob Gilchrist Berry (born 29 December 1978) is a British Conservative Party politician and former solicitor.", "He is the Member of Parliament (MP) for Rossendale and Darwen, having won the seat at the 2010 General Election, defeating the sitting Labour Party MP Janet Anderson by a majority of 4,493 votes.", "Berry was born in Liverpool on the 29 December 1978 and educated at Liverpool College, before studying for a Law degree at Sheffield University.", "He trained at Chester College and in the City of London, before becoming a solicitor in 2003.", "He worked for a number of legal practices, specialising in housing and development law.", "Berry was elected in the 2010 General Election as MP for Rossendale and Darwen.", "He won against incumbent MP Janet Anderson, who held the position for eighteen years, in an 8.9% swing to the Conservatives.", "Berry overturned a Labour majority of 3,616 to win by 4,493 votes.", "In 2010, he was appointed as the Parliamentary Private Secretary (PPS) to Grant Shapps, the Minister for Housing and Local Government at the Department of Communities and Local Government, following Shapps to the Cabinet Office in 2012.", "In April 2013, the Prime Minister, David Cameron, asked Berry to join the Number 10 Policy Unit, headed by Jo Johnson." ], [ "Secretary of State for the Environment, Transport and the Regions", "Secretary of State for the Environment, Transport and the Regions\n\nThe Secretary of State for the Environment, Transport and the Regions was a United Kingdom Cabinet position created in 1997, with responsibility for the Department of the Environment, Transport and the Regions (DETR).", "The position and department were created for John Prescott by merging the positions and responsibilities of the Secretary of State for Environment, the Secretary of State for Transport and some other functions.", "Frank Dobson, who had been Shadow Secretary of State for the Environment prior to the 1997 General Election, was made Secretary of State for Health, while Andrew Smith, who had been Shadow Secretary of State for Transport, was made a junior minister at the Department for Education and Employment.", "Michael Meacher, who had been Shadow Minister for Environmental Protection within the Shadow Cabinet, was given the non cabinet position of Minister of State for the Environment, and attended cabinet meetings where the Environment was discussed, and a position of Minister of State for Transport was similarly created, initially held by Gavin Strang.", "In June 2001, the department was renamed the Department for Transport, Local Government and the Regions (DTLR), with the Environment portfolio being merged with the Ministry of Agriculture, Fisheries and Food into the Department of Environment, Food and Rural Affairs.", "All departments were given their own Secretaries of State." ], [ "Cheryl Gillan", "In a parliamentary debate before the 2010 election, Gillan said that she agreed with neighbouring MP David Lidington who described the planned route as an \"outrage\".", "When campaigning for re-election, Gillan said that High Speed 2 would be \"a lot more than just the blight on the properties nearby... the implications for the area will be absolutely phenomenal\".", "She also described High Speed 2 as a project that would \"threaten the quality of our lives \u2013 not just now but for generations to come\" and stated that she \"would defy the party whip \u2013 be very, very sure of that\".", "On 12 January 2012, Secretary of State for Transport Justine Greening confirmed in a House of Commons statement that High Speed 2 would go ahead and in responding to questions stated that it was her understanding that \"the Welsh Secretary is already on side...", "I thoroughly agree with her (Cheryl Gillan) that we have ended up with the right line, with the right mitigation\".", "In an interview with the Bucks Free Press following the announcement, Gillan stated \"we've got already got some changes, good changes and I'm looking at what further possibilities there will be\".", "When asked whether she would remain in the Cabinet, Gillan stated \"I am not resigning.", "The speculation on my resignation has always come from the press and my political opponents..." ] ], "gold": "The UK secretary of state for transport, also referred to as the Transport Secretary, position has been filled by several appointees. Most recently, in 2011, Justine Greening was secretary. Followed by Patrick McLoughlin in 2012. Then, Chris Grayling took over in 2016 until Grant Shapps was appointed in 2019.", "prediction 1": "The Secretary of State for the Environment, Transport and the Regions was a United Kingdom Cabinet position created in 1997, with responsibility for the Department of the Environment, Transport and the Regions. The position was created for John Prescott by merging the positions and responsibilities of the Secretary of State for Environment, the Secretary of State for Transport and some other functions. In 2017, the Secretary of State for Transport was Justine Greening. In 2016, the Secretary of State for Transport was Chris Grayling.", "prediction 2": "The Secretary of State for Transport, as well as the Secretary of State for the Environment, was created in 1997. The position and department were created for John Prescott by merging the positions and responsibilities of the Secretary of State for Environment, the Secretary of State for Transport and some other functions. Justine Greening became the Secretary of State for Transport on 12 January 2012.", "prediction 3": "The Secretary of State for the Environment, Transport and the Regions is a United Kingdom Cabinet position created in 1997. It was created for John Prescott by merging the positions and responsibilities of the Secretary of State for Environment, the Secretary of State for Transport and some other functions. In 2010, the Prime Minister, David Cameron, asked Jake Berry to join the Number 10 Policy Unit, headed by Jo Johnson. On 12 January 2012, Secretary of State for Transport Justine Greening confirmed in a House of Commons statement that High Speed 2 would go ahead.", "prediction 4": "The Secretary of State for the Environment, Transport and the Regions was a United Kingdom Cabinet position created in 1997, with responsibility for the Department of the Environment, Transport and the Regions. The Secretary of State for the Environment, Transport and the Regions is Jake Berry, who was elected in the 2010 General Election as MP for Rossendale and Darwen. On 12 January 2012, Secretary of State for Transport Justine Greening confirmed in a House of Commons statement that High Speed 2 would go ahead and in responding to questions stated that it was her understanding that \"the Welsh Secretary is already on side\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 405 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 210 }, { "error type": "Unverifiable", "explanation": "", "start": 409, "end": 414 }, { "error type": "Unverifiable", "explanation": "", "start": 524, "end": 539 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "In 2012, the Secretary of State for Transport was Justine Greening. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was charlie and the chocolate factory movie made?", "passages": [ [ "Charlie and the Chocolate Factory (film)", "Elfman also wrote and performed the vocals for four songs, with pitch changes and modulations to represent different singers.", "The lyrics to the Oompa-Loompa songs are adapted from the original book, and are thus credited to Roald Dahl.", "Following Burton's suggestion, each song in the score is designed to reflect a different archetype.", "\"Wonka's Welcome Song\" is a maddeningly cheerful theme park ditty, \"Augustus Gloop\" a Bollywood spectacle (per Deep Roy's suggestion), \"Violet Beauregarde\" is 1970s funk, \"Veruca Salt\" is 1960s bubblegum pop / psychedelic pop, and \"Mike Teavee\" is a tribute to late 1970s hard rock (such as Queen) and early 1980s hair bands.", "The original motion picture soundtrack was released on July 12, 2005 by Warner Bros. Records.", "\"Charlie and the Chocolate Factory\" had its premiere at the Grauman's Chinese Theatre, on July 10, 2005, where money for the Make-a-Wish Foundation was raised.", "The film was released in the United States on July 15, 2005 in 3,770 theaters (including IMAX theaters).", "Early in the development of \"Charlie and the Chocolate Factory\" in February 2000, Warner Bros. announced their intention of marketing the film with a Broadway theatre musical after release." ], [ "Charlie and the Chocolate Factory (franchise)", "Filming took place in Munich in 1970, and the film was released on June 30, 1971.", "It received positive reviews, but it was a box office disappointment despite the fact that it recouped its budget.", "However, it developed into a cult film due to its repeated television airings and home video sales.", "In 1972, the film received an Academy Award nomination for Best Original Score.", "\"Charlie and the Chocolate Factory\" is a 2005 film adaptation of the 1964 book of the same name by Roald Dahl.", "The film was directed by Tim Burton.", "The film stars Freddie Highmore as Charlie Bucket and Johnny Depp as Willy Wonka.", "The storyline concerns Charlie, who takes a tour he has won, led by Wonka, through the most magnificent chocolate factory in the world.", "Development for another adaptation of \"Charlie and the Chocolate Factory\", filmed previously as \"Willy Wonka & the Chocolate Factory\", began in 1991, 20 years after the first film version, which resulted in Warner Bros. providing the Dahl Estate with total artistic control.", "Prior to Burton's involvement, directors such as Gary Ross, Rob Minkoff, Martin Scorsese and Tom Shadyac had been involved, while Warner Bros. either considered or discussed the role of Willy Wonka with Nicolas Cage, Jim Carrey, Michael Keaton, Brad Pitt, Will Smith and Adam Sandler." ], [ "Charlie and the Chocolate Factory (film)", "Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom.", "\"Charlie and the Chocolate Factory\" was released to positive critical reception and was a box office success, grossing $475 million worldwide.", "Charlie Bucket (Freddie Highmore) is a poor boy who lives near the Wonka Candy Company.", "The company's owner, Willy Wonka (Johnny Depp), has for long closed access to his factory due to problems concerning industrial espionage that led him to fire all his employees, among them", "Charlie's Grandpa Joe (David Kelly).", "One day, Wonka announces a contest, in which Golden Tickets have been placed in five random Wonka Bars worldwide, and the winners will be given a full tour of the factory as well as a lifetime supply of chocolate, while one ticketholder will be given a special prize at the end of the tour.", "Wonka's sales subsequently skyrocket, and the first four tickets are found fairly quickly.", "The recipients are Augustus Gloop (Philip Wiegratz), a gluttonous German boy; Veruca Salt (Julia Winter), a very spoiled English girl; Violet Beauregarde (AnnaSophia Robb), a competitive gum chewer, and Mike Teavee (Jordan Fry), an arrogant television and video game addict." ] ], "gold": "Willy Wonka and the Chocolate Factory was filmed in 1970 and released on June 30, 1971. The movie Charlie and the Chocolate Factory directed by Tim Burton was based on Willy Wonka and the Chocolate Factory. It was filmed in 2004 and premiered in the US on July 10, 2005.", "prediction 1": "Charlie and the Chocolate Factory is a 1964 animated novel by Roald Dahl that is adapted into a film in 2005 by Tim Burton. Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom. The film was released on June 30, 1971.", "prediction 2": "Charlie and the Chocolate Factory is a 1964 children's book adaptation of the book by Roald Dahl starring Freddie Highmore as Charlie Bucket and Johnny Depp as Willy Wonka. Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom. The film premiered at the Grauman's Chinese Theatre, on July 10, 2005, where money for the Make-a-Wish Foundation was raised. The film was released in the United States on July 15, 2005 in 3,770 theaters.", "prediction 3": "Charlie and the Chocolate Factory is a 2005 film adaptation of the 1964 book of the same name by Roald Dahl. Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom. The film was released on June 30, 1971. The first two films were released simultaneously on June 1, 1970 and June 30, 1971.", "prediction 4": "Charlie and the Chocolate Factory is a 1964 American musical comedy film directed by Tim Burton, based on the book by the same name by Roald Dahl. Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom. The film premiered at the Grauman's Chinese Theatre, on July 10, 2005, where money for the Make-A-Wish Foundation was raised. The original motion picture soundtrack was released on July 12, 2005 by Warner Bros. Records.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 52 }, { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 72 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Charlie and the Chocolate Factory is a novel that was adapted into a film in 2005 by Tim Burton. Filming took place from June to December 2004 at Pinewood Studios in the United Kingdom. The first film was released on June 30, 1971 and filming for it took place in Munich in 1970." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the great pacific garbage patch found?", "passages": [ [ "Great Pacific garbage patch", "Great Pacific garbage patch\n\nThe Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean.", "It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N.", "The collection of plastic and floating trash, which comes primarily from countries in Asia, lies halfway between Hawaii and California and extends over an indeterminate area of widely varying range, depending on the degree of plastic concentration used to define it.", "The patch is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre.", "Despite the common public image of islands of floating rubbish, its low density (4 particles per cubic meter) prevents detection by satellite imagery, or even by casual boaters or divers in the area.", "It consists primarily of an increase in suspended, often microscopic, particles in the upper water column.", "The patch is not easily seen from the sky, because the plastic is dispersed over a large area.", "Researchers from The Ocean Cleanup project claimed that the patch covers 1.6 million square kilometers.", "The plastic concentration is estimated to be up to 100 kilograms per square kilometer in the center, going down to 10 kilograms per square kilometer in the outer parts of the patch." ], [ "Indian Ocean garbage patch", "Indian Ocean garbage patch\n\nThe Indian Ocean garbage patch, discovered in 2010, is a gyre of marine litter suspended in the upper water column of the central Indian Ocean, specifically the Indian Ocean Gyre, one of the five major oceanic gyres.", "The patch does not appear as a continuous debris field.", "As with other patches in each of the five oceanic gyres, the plastics in it break down to ever smaller particles, and to constituent polymers.", "As with the other patches, the field constitutes an elevated level of pelagic plastics, chemical sludge, and other debris; primarily particles that are invisible to the naked eye.", "The concentration of particle debris has been estimated to be approximately 10,000 particles per square kilometer.", "A similar patch of floating plastic debris in the Pacific Ocean, the Great Pacific garbage patch, was predicted in 1985, and discovered in 1997 by Charles J. Moore as he passed through the North Pacific Gyre on his return from the Transpacific Yacht Race.", "The North Atlantic garbage patch was discovered in 2010.", "The existence of the Great Pacific garbage patch, the first to be discovered, was predicted in a 1988 paper published by the National Oceanic and Atmospheric Administration (NOAA) of the United States.", "The prediction was based on results obtained by several Alaska-based researchers between 1985 and 1988 that measured neustonic plastic in the North Pacific Ocean." ] ], "gold": "The great pacific garbage patch is a gyre of marine debris particles in the central North Pacific Ocean. It was found to exist by hypothesis in 1988, and in person in 1997.", "prediction 1": "The Great Pacific garbage patch, also known as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The patch is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre. The Indian Ocean garbage patch, discovered in 2010, is a gyre of marine litter suspended in the upper water column of the Indian Ocean Gyre, one of the five major oceanic gyre. The existence of the Great Pacific garbage patch, the first to be discovered, was predicted in 1985, and discovered in 1997 by Charles J. Moore as he passed through the North Pacific Gyre on his return from the Transpacific Yacht Race.", "prediction 2": "The Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. The patch is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre. The Indian Ocean garbage patch, discovered in 2010, is a gyre of marine litter suspended in the upper water column of the Indian Ocean Gyre, one of the five major oceanic gyre. The existence of the Great Pacific garbage patch, the first to be discovered, was predicted in a 1988 paper published by the National Oceanic and Atmospa", "prediction 3": "The Great Pacific garbage patch, also described as the Pacific trash vortex, is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. It is characterized by exceptionally high relative pelagic concentrations of plastic, chemical sludge, and other debris that have been trapped by the currents of the North Pacific Gyre. The Indian Ocean garbage patch, discovered in 2010, is a gyre of marine litter suspended in the upper water column of the central Indian Ocean Gyre, specifically the Indian Ocean Gyre, one of the five major oceanic gyre.", "prediction 4": "The Great Pacific garbage patch is a gyre of marine debris particles in the central North Pacific Ocean. It is located roughly from 135\u00b0W to 155\u00b0W and 35\u00b0N to 42\u00b0N. Researchers from The Ocean Cleanup project claimed that the Great Pacific garbage patch covers 1.6 million square kilometers. The Indian Ocean garbage patch was discovered in 2010. The existence of the Great Pacific garbage patch, the first to be discovered, was predicted in a 1988 paper published by the National Oceanic and Atmospheric Administration (NOAA) of the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 72 }, { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 398 }, { "error type": "Irrelevant", "explanation": "", "start": 399, "end": 575 }, { "error type": "Irrelevant", "explanation": "", "start": 700, "end": 811 } ], "missing-info": [], "corrected-prediction": "The Great Pacific garbage patch is a gyre of marine debris particles in the central North Pacific Ocean. The existence of the Great Pacific garbage patch, the first to be discovered, was predicted in 1985, and discovered in 1997." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Where will be the 2022 fifa world cup held?", "passages": [ [ "2022 FIFA World Cup", "2022 FIFA World Cup\n\nThe 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA.", "It is scheduled to take place in Qatar in 2022.", "This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country.", "This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan (the 2018 competition in Russia featured one geographically Asian venue, Yekaterinburg).", "In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament.", "The reigning World Cup champions are France.", "This will also mark the first World Cup not to be held in May, June, or July; the tournament is instead scheduled for late November until mid-December.", "It is to be played in a reduced timeframe of around 28 days, with the final being held on 18 December 2022, which is also Qatar National Day.", "Accusations of corruption have been made relating to how Qatar won the right to host the event." ] ], "gold": "The 2022 fifa world cup will be held in the cities Lusail, Al Khor, Al Rayyan, Al Wakrah, Doha in Qatar.", "prediction 1": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 2": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan. The 2018 competition in Russia featured one geographically Asian venue, Yekaterinburg.", "prediction 3": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan. In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament.", "prediction 4": "The 2022 FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA, is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 444 }, { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 319 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 208 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2022 fifa world cup is scheduled to take place in Qatar in 2022." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did university of georgia start playing football?", "passages": [ [ "History of Georgia Bulldogs football", "History of Georgia Bulldogs football\n\nThe Georgia Bulldogs football team represents the University of Georgia in American football.", "Georgia's football program began in 1892, when Dr. Charles Herty, a chemistry professor and former player at Johns Hopkins, assembled a team and arranged a game against Mercer University on January 30, 1892.", "This was the first intercollegiate football game played in the deep south.", "Playing on what would later be called Herty Field, Georgia beat Mercer 7\u20136.", "Georgia's second game was on February 20, 1892, against Auburn University, inaugurating what would come to be known as the Deep South's Oldest Rivalry.", "From 1892 to 1909, the Georgia Bulldogs changed head coaches frequently, with 14 different coaches in a 17-year period.", "Their combined record was 47\u201352\u201310 (.477 winning percentage).", "During its early years, Georgia's greatest success came during Glenn \"Pop\" Warner's tenure from 1895-1896.", "It is thought that the first forward pass in football occurred in 1895 in a game between Georgia and North Carolina when, out of desperation, the ball was thrown by the North Carolina quarterback instead of punted and a North Carolina player caught the ball." ], [ "Georgia Bulldogs football", "Georgia was a founding member of the Southern Intercollegiate Athletic Association, one of the first collegiate athletic conferences formed in the United States.", "Georgia participated in the SIAA from its establishment in 1895 until 1921.", "During its tenure in the SIAA, Georgia was conference co-champion in two years, 1896 and 1920.", "In 1921, the Bulldogs, along with 12 other teams, left the SIAA and formed the Southern Conference.", "During its time in the Southern Conference, the team never won a conference championship.", "In 1932, the Georgia Bulldogs left the Southern Conference to form and join the SEC, where Georgia has won the second-most SEC football championships, with 13, behind Alabama (24) and tied with Tennessee.", "Head coaches of the Bulldogs dating from 1892.", "The first mention of \"Bulldogs\" in association with Georgia athletics occurred on November 28, 1901, at the Georgia-Auburn football game played in Atlanta.", "The Georgia fans had a badge saying \"Eat `em Georgia\" and a picture of a bulldog tearing a piece of cloth\"; however, it was not until 1920 that the nickname \"Bulldog\" was used to describe the athletic teams at the University of Georgia.", "Traditionally, the choice of a Bulldog as the UGA mascot was attributed to the alma mater of its founder and first president, Abraham Baldwin, who graduated from Yale University." ], [ "Florida\u2013Georgia football rivalry", "Florida\u2013Georgia football rivalry\n\nThe Florida\u2013Georgia football rivalry is an American college football rivalry game played annually by the University of Florida Gators and the University of Georgia Bulldogs.", "The game was first played in 1915, and has been played every season since 1926, except for a war-time interruption in 1943.", "This match-up between Southeastern Conference opponents is one of the most prominent rivalry games in college football, and has been held in Jacksonville, Florida since 1933, with only two exceptions, making it one of the few remaining neutral-site rivalries in college football.", "The game attracts huge crowds to Jacksonville, and the associated tailgating and other events earned it the nickname of the \"World's Largest Outdoor Cocktail Party\", although that name is no longer used officially.", "This high-intensity rivalry has gone through several periods in which one team has been dominant for a decade or more.", "Georgia dominated the early rivalry, while Florida held an advantage in the 1950s and 1960s.", "Georgia won most of the games in the 1970s and 80s under coach Vince Dooley, and Florida dominated the 1990s and 2000s, mostly under coach Steve Spurrier.", "The years since 2010 (inclusive) have been unusually even, with Georgia holding a 5-4 edge in the decade as of the 2018 contest.", "The two universities do not agree on when the rivalry began." ] ], "gold": "The University of Georgia started playing intercollegiate football in 1892. They played in the Southern Intercollegiate Athletic Association in 1896. Then , in 1921, it was the Southern Conference. And, finally, the Southeastern Conference in 1933.", "prediction 1": "The University of Georgia has had a football program since 1892, when Dr. Charles Herty, a chemistry professor and former player at Johns Hopkins, assembled a team and arranged a game against Mercer University on January 30, 1892. This was the first intercollegiate football game played in the deep south. The first mention of \"Bulldogs\" in association with Georgia athletics occurred on November 28, 1901, at the Georgia-Auburn football game played in Atlanta. The University of Georgia Bulldogs football rivalry was first played in 1915, and has been played every season since 1926, except for a war-time interruption in 1943. The University of Georgia Bulldogs football team has represented the University of Georgia in American football since 1926.", "prediction 2": "The University of Georgia started playing football in 1892 and is represented by the Georgia Bulldogs football team in American football. The first mention of \"Bulldogs\" in association with Georgia athletics occurred on November 28, 1901, at the Georgia-Auburn football game played in Atlanta. The Florida\u2013Georgia football rivalry is an American college football rivalry game played annually by the University of Florida Gators and the University of Georgia Bulldogs. This high-intensity rivalry has gone through several periods in which one team has been dominant for a decade or more.", "prediction 3": "The University of Georgia started playing football in 1892 when Professor Charles Herty assembled a team and arranged a game against Mercer University on January 30, 1892. This was the first intercollegiate football game played in the deep south. From 1892 to 1909, the Georgia Bulldogs changed head coaches frequently, with 14 different coaches in a 17-year period. From 1892 to 1909, the Georgia Bulldogs changed head coaches frequently, with 14 different coaches in a 17-year period.", "prediction 4": "The Georgia Bulldogs football team represents the University of Georgia in American football. Georgia's football program began in 1892, when Dr. Charles Herty, a chemistry professor and former player at Johns Hopkins, assembled a team and arranged a game against Mercer University on January 30, 1892. This was the first intercollegiate football game played in the deep south. The first mention of \"Bulldogs\" in association with Georgia athletics occurred on November 28, 1901, at the Georgia-Auburn football game played in Atlanta. It was not until 1920 that the nickname \"Bulldogs\" was used to describe the athletic teams at the University of Georgia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 462, "end": 628 }, { "error type": "Irrelevant", "explanation": "", "start": 629, "end": 752 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The University of Georgia has had a football program since 1892. Georgia participated in the SIAA from its establishment in 1895 until 1921 when the Bulldogs left the SIAA and formed the Southern Conference. In 1932, the Georgia Bulldogs left the Southern Conference to form and join the SEC." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "When was the american war of independence fought?", "passages": [ [ "American Revolutionary War", "American Revolutionary War\n\nThe American Revolutionary War (17751783), also known as the American War of Independence, was an 18th-century war between Great Britain and its Thirteen Colonies (allied with France) which declared independence as the United States of America.", "After 1765, growing philosophical and political differences strained the relationship between Great Britain and its colonies.", "Patriot protests against taxation without representation followed the Stamp Act and escalated into boycotts, which culminated in 1773 with the Sons of Liberty destroying a shipment of tea in Boston Harbor.", "Britain responded by closing Boston Harbor and passing a series of punitive measures against Massachusetts Bay Colony.", "Massachusetts colonists responded with the Suffolk Resolves, and they established a shadow government which wrested control of the countryside from the Crown.", "Twelve colonies formed a Continental Congress to coordinate their resistance, establishing committees and conventions that effectively seized power.", "British attempts to disarm the Massachusetts militia in Concord led to open combat on April 19, 1775.", "Militia forces then besieged Boston, forcing a British evacuation in March 1776, and Congress appointed George Washington to command the Continental Army.", "Concurrently, the Americans failed decisively in an attempt to invade Quebec and raise insurrection against the British.", "On July 2, 1776, the Second Continental Congress voted for independence, issuing its declaration on July\u00a04.", "Sir William Howe launched a British counter-offensive, capturing New York City and leaving American morale at a low ebb." ], [ "American Revolutionary War", "In early 1782, Parliament voted to end all offensive operations in North America, but the war continued in Europe, India and the Caribbean.", "In the latter the British scored a major victory over the French navy, and then later defeated Spanish and French attempts to seize Gibraltar.", "On September 3, 1783, the belligerent parties signed the Treaty of Paris in which Great Britain agreed to recognize the sovereignty of the United States and formally end the war.", "French involvement had proven decisive, but France made few gains and incurred crippling debts.", "Spain made some territorial gains but failed in its primary aim of recovering Gibraltar.", "The Dutch were defeated on all counts and were compelled to cede territory to Great Britain.", "In India, the war against Mysore and its allies concluded in 1784 without any territorial changes.", "Parliament passed the Stamp Act in 1765.", "Colonists condemned the tax because their rights as Englishmen protected them from being taxed by a Parliament in which they had no elected representatives.", "Parliament argued that the colonies were \"represented virtually\", an idea that was criticized throughout the Empire.", "Parliament did repeal the act in 1766; however, it also affirmed its right to pass laws that were binding on the colonies.", "From 1767, Parliament began passing legislation to raise revenue for the salaries of civil officials, ensuring their loyalty while inadvertently increasing resentment among the colonists, and opposition soon became widespread.", "Enforcing the acts proved difficult." ] ], "gold": "The American war of independence began April 19, 1775 and ended on September 3, 1783.", "prediction 1": "The American Revolutionary War was fought between Great Britain and its Thirteen Colonies (allied with France) on July 2, 1776, and July 4, 1783. The war was fought over the issue of independence from Great Britain on July 2, 1776 and the issue of independence on July 4, 1783. The war continued over the rest of the 18th century, with major victories recorded in Europe, India, and the Caribbean. On September 3, 1783, the belligerent parties signed the Treaty of Paris in which Great Britain agreed to recognize the sovereignty of the United States of America and formally ended the war on September 3, 1783.", "prediction 2": "The American Revolutionary War was an 18th-century war between Great Britain and its Thirteen Colonies (allied with France) which declared independence as the United States of America. It started on April 19, 1775 and lasted until July 4, 1783, when the belligerent parties signed the Treaty of Paris, in which Great Britain agreed to recognize the sovereignty of the United States and formally end the war.", "prediction 3": "The American Revolutionary War was an 18th-century war between Great Britain and its Thirteen Colonies (allied with France) which declared independence as the United States of America. The war started on April 19, 1775 and was completed on July 4, 1783. The American Revolutionary War was also known as the American War of Independence.", "prediction 4": "The American Revolutionary War, also known as the American War of Independence, was an 18th-century war between Great Britain and its Thirteen Colonies (allied with France) which declared independence as the United States of America. The war started on April 19, 1775, which led to open combat on April 19, 1775, and lasted until July 4, 1783, when Parliament voted to end all offensive operations in North America, but the war continued in Europe, India and the Caribbean.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 110 }, { "error type": "Incoherent", "explanation": "", "start": 215, "end": 277 }, { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 278, "end": 397 }, { "error type": "Redundant", "explanation": "On September 3, 1783, ", "start": 589, "end": 610 }, { "error type": "Unverifiable", "explanation": "", "start": 111, "end": 145 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The war started when British attempts to disarm the Massachusetts militia in Concord led to open combat on April 19, 1775. On September 3, 1783, the belligerent parties signed the Treaty of Paris in which Great Britain agreed to recognize the sovereignty of the United States of America and formally ended the war." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who wrote the song in the end by linkin park?", "passages": [ [ "Hybrid Theory", "Although \"Runaway\", \"Points of Authority\", and \"My December\" from the special edition bonus disc album were not released as singles, they were minor hits on alternative rock radio stations thanks to the success of all of the band's singles and the album.", "At the 2002 Grammy Awards, \"Hybrid Theory\" was nominated for Best Rock Album.", "The album is listed in the book \"1001 Albums You Must Hear Before You Die\".", "It was ranked number 11 on \"Billboard\"'s \"200 Albums of the Decade\".", "A special edition of \"Hybrid Theory\" was released March 11, 2002, a year and a half after its original pressing.", "Linkin Park performed the album in its entirety at the Download Festival on June 14, 2014 and on August 12, 2014 it was released as a live CD titled \"Hybrid Theory: Live at Download Festival 2014\".", "Linkin Park was founded in 1996 as the rap rock band Xero: lead guitarist Brad Delson, vocalist and rhythm guitarist Mike Shinoda, drummer Rob Bourdon, turntablist Joe Hahn, lead vocalist Mark Wakefield and bassist Dave Farrell (who subsequently left to tour with Tasty Snax).", "In 1999, after Wakefield's departure, lead vocalist Chester Bennington joined the five members of Xero and the band was renamed Linkin Park." ] ], "gold": "Linkin Park band members Mike Shinoda, Brad Delson, Joe Hahn, and Rob Bourdon, along with former band member Chester Bennington wrote the song In The End.", "prediction 1": "Linkin Park are an American rock band that has released several studio albums, including the album Hybrid Theory and its live CD version. The song End by Linkin Park was written by Chester Bennington and was released on February 1, 2015.", "prediction 2": "The song The End by Linkin Park was written by Chester Bennington. It was written by Chester Bennington.", "prediction 3": "The song \"The End of Linkin Park\" is the final song on the band's album Hybrid Theory.", "prediction 4": "The song in the end by Linkin Park was written by Chester Bennington.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 138, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 137 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays leonard snart in legends of tomorrow?", "passages": [ [ "Legends of Tomorrow (season 1)", "\n\nIn January 2015, co-creator Greg Berlanti stated that there were \"very early\" preliminary talks for an additional spin-off series centered on Ray Palmer / Atom (Brandon Routh), from \"Arrow\" and \"The Flash\".", "In February 2015, it was reported that a spin-off series, described as a superhero team-up show, was in discussion by The CW for a possible 2015\u201316 midseason release.", "Berlanti, Andrew Kreisberg, Marc Guggenheim, and Sarah Schechter would serve as executive producers.", "The potential series would be headlined by several recurring characters from both \"Arrow\" and \"The Flash\", including Palmer, Leonard Snart (Wentworth Miller), and Martin Stein (Victor Garber).", "Caity Lotz was also mentioned to be among the main cast.", "There would be potential for other \"Arrow\"/\"Flash\" characters to cross over to the new series, and the series would be casting \"three major DC Comics characters who have never appeared in a TV series\".", "In March 2015, Stephen Amell, who portrays Oliver Queen / Green Arrow on \"Arrow\", confirmed the series would air in the 2015\u201316 midseason." ] ], "gold": "Legends of tomorrow character Leonard Snart was played by several actors. The young Snart was played by Trestyn Zradicka, while the adult character was portrayed by Wentworth Miller.", "prediction 1": "Leonard Snart is a fictional character who appears in the television series Legends of Tomorrow and is played by Wendworth Miller. In the first season, the character first appears in the episode \"The Warrior\", before he is replaced by Victor Garber.", "prediction 2": "Leonard Snart is a fictional character in the CW television series Legends of Tomorrow. William Trenworth Miller plays Leonard Snart.", "prediction 3": "Legends of Tomorrow is an American superhero television series created by Greg Berlanti and based on the DC Comics character Ray Palmer. Leonard Snart is played by Wentworth Miller.", "prediction 4": "Leonard Snart is a central character in the TV series Legends of Tomorrow. Wendworth Miller plays Snart in Season 1 of Legends of Tomorrow.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 131, "end": 249 } ], "missing-info": [], "corrected-prediction": "Leonard Snart is a fictional character who appears in the television series Legends of Tomorrow and is played by Wendworth Miller. " }, "preference": [ 1, 1, 1, 0, 2, 0 ] }, { "question": "Who sings the only fools and horses theme?", "passages": [ [ "Only Fools and Horses", "The original theme tune was produced by Ronnie Hazlehurst and recorded on 6 August 1981 at Lime Grove Studios.", "Alf Bigden, Paul Westwood, Don Hunt, John Dean, Judd Proctor, Eddie Mordue, and Rex Morris were hired to play the music.", "The tune was changed after the first series, and the new one was written by John Sullivan (he disliked the tune for the first series, and his new one explained the show's title), and Hazlehurst conducted it.", "It was recorded at Lime Grove on 11 May 1982, with musicians John Horler, Dave Richmond, Bigden, and Proctor.", "Sullivan had intended Chas & Dave to sing it because they had enjoyed success with the \"Rockney\" style, a mixture of rock n' roll and traditional Cockney music.", "Sullivan was persuaded to do it himself by Ray Butt.", "Despite the creation of a new theme tune, the original one remained in occasional use.", "Chas & Dave did later contribute to the show, performing the closing credits song for the 1989 episode \"The Jolly Boys' Outing\".", "Both songs are performed by Sullivan himself, and not \u2013 as is sometimes thought \u2013 by Nicholas Lyndhurst.", "The opening credits see images of the three principal actors peel on and off the screen sequentially.", "These appear over a background of still photographs of everyday life in South London." ] ], "gold": "Only Fools and Horses has two separate theme songs for the opening and closing credits. John Sullivan had intended Chas & Dave to sing the opening theme song, but sang it himself. Chas & Dave did later contribute to the show, performing the closing credits song for the 1989 episode \"The Jolly Boys' Outing\".", "prediction 1": "The original theme tune was produced by Ronnie Hazlehurst and recorded on 6 August 1981 at Lime Grove Studios. Alf Bigden, Paul Westwood, Don Hunt, John Dean, Judd Proctor, Eddie Mordue, and Rex Morris were hired to play the music. The new one was written by John Sullivan and was recorded on 11 May 1982, with musicians John Horler, Dave Richmond, Bigden, and Proctor. Sullivan had intended Chas & Dave to sing it because they had enjoyed success with the \"Rockney\" style, a mixture of rock n' roll and traditional Cockney music. Sullivan was persuaded to do it himself by Ray Butt. Despite the creation of a new theme tune, the original one remained in occasional use. The original one was performed by Sullivan himself, and not \u2013 as is sometimes thought \u2013 as is sometimes believed \u2013 as", "prediction 2": "The original theme tune was produced by Ronnie Hazlehurst and recorded on 6 August 1981 at Lime Grove Studios. Alf Bigden, Paul Westwood, Don Hunt, John Dean, Judd Proctor, Eddie Mordue, and Rex Morris were hired to play the music. The new one was written by John Sullivan, who disliked the original one for the first series, and his new one explained the show's title. Sullivan had intended Chas & Dave to sing it because they had enjoyed success with the \"Rockney\" style, a mixture of rock n' roll and traditional Cockney music. He was persuaded to do it himself by Ray Butt. Despite the creation of Sullivan was persuaded to do it himself by Ray Butt, and despite the new one remained in occasional use.", "prediction 3": "The original theme tune for Only Fools and Horses was produced by Ronnie Hazlehurst and recorded on 6 August 1981 at Lime Grove Studios. Chas & Dave sang the theme on 11 May 1982, and Sullivan intended them to sing it because they had enjoyed success with the \"Rockney\" style, a mixture of rock n' roll and traditional Cockney music. Sullivan was persuaded to do it himself by Ray Butt. Sullivan did later contribute to the show, performing the closing credits song for the 1989 episode \"The Jolly Boys' Outing\". Both songs are performed by Sullivan himself, and not \u2013 as is sometimes thought \u2013 as is sometimes thought \u2013 as is sometimes thought \u2013 by Nicholas Lyndhurst.", "prediction 4": "The original theme tune was produced by Ronnie Hazlehurst and recorded on 6 August 1981 at Lime Grove Studios. Chas & Dave performed the theme for the 11 May 1982 episode of the first series of Only Fools and Horses.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 584, "end": 670 }, { "error type": "Unverifiable", "explanation": "", "start": 671, "end": 788 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 272 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Alf Bigden, Paul Westwood, Don Hunt, John Dean, Judd Proctor, Eddie Mordue, and Rex Morris were hired to play the music for the original theme of Only Fools and Horses. The new theme was recorded on 11 May 1982, with musicians John Horler, Dave Richmond, Bigden, and Proctor. Sullivan had intended Chas & Dave to sing it because they had enjoyed success with the \"Rockney\" style, a mixture of rock n' roll and traditional Cockney music. Sullivan was persuaded to do it himself by Ray Butt. Chas & Dave did later contribute to the show, performing the closing credits song for the 1989 episode \"The Jolly Boys' Outing\"." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who sang the song a change is going to come?", "passages": [ [ "A Change Is Gonna Come", "A Change Is Gonna Come\n\n\"A Change Is Gonna Come\" is a song by American recording artist Sam Cooke.", "It initially appeared on Cooke's album \"Ain't That Good News\", released March 1, 1964 by RCA Victor; a slightly edited version of the recording was released as a single on December 22, 1964.", "Produced by Hugo & Luigi and arranged and conducted by Ren\u00e9 Hall, the song was the B-side to \"Shake\".", "The song was inspired by various personal events in Cooke's life, most prominently an event in which he and his entourage were turned away from a whites-only motel in Louisiana.", "Cooke felt compelled to write a song that spoke to his struggle and of those around him, and that pertained to the Civil Rights Movement and African Americans.", "The song contains the refrain, \"It's been a long time coming, but I know a change is gonna come.\"", "Though only a modest hit for Cooke in comparison with his previous singles, \"A Change Is Gonna Come\" is widely considered Cooke's best composition and has been voted among the best songs ever released by various publications.", "In 2007, the song was selected for preservation in the Library of Congress, with the National Recording Registry deeming the song \"culturally, historically, or aesthetically important.\"" ], [ "A Change Is Gonna Come", "It was also sung by Joshua Ledet during the Top 7 episode of season 11 (2012), for which he received a standing ovation from the audience.", "After winning the 2008 United States presidential election, Barack Obama referred to the song, stating to his supporters in Chicago, \"It's been a long time coming, but tonight, change has come to America.\"", "A duet of the song by Bettye LaVette and Jon Bon Jovi was included in .", "In Washington DC, in the days leading up to the Inauguration of Barack Obama, this song could be heard played constantly in the city centre.", "In 2004, Patti LaBelle performed the song on the annual Nobel Peace Prize Concert to a standing ovation.", "Julian Casablancas, lead singer of popular rock band The Strokes, has cited \"A Change Is Gonna Come\" as his favorite song of all time.", "In 2009, Aaron Neville, along with the Mt. Zion Mass Choir, released a version of the song \u201cA Change Is Gonna Come\u201d on the compilation album \"\".", "\"American Idol\" creator/producer Simon Fuller selected the song for contestant Adam Lambert to sing in the season 8 finale in May, 2009.", "It was also covered by season 9 semifinalist Lilly Scott in March 2010." ], [ "A Change Is Gonna Come", "As Knowles performed, the screen behind her displayed photos of Detroit's landmarks and icons including Aretha Franklin, Aaliyah, Eminem, Anita Baker, Bob Seger, Kid Rock, The White Stripes, Berry Gordy, Jr, Joe Louis.", "The montage ended with the declaration \"Nothing Stops Detroit!\"", "and Knowles closed the performance by saying \"I love you, Detroit\".", "A spokesperson for the singer described the performance as a \"unique tribute to the history of an incredible city and a celebration of the strong spirit of its people\".", "A black-and-white video of the cover was uploaded on Knowles' official YouTube channel on July 30, 2013.", "It closes with a quote from Henry Ford: \u201cFailure is simply the opportunity to start over, this time more intelligently.\"", "A reporter for \"The Huffington Post\" reported that the singer's \"heartfelt\" cover of the song \"touched\" her fans and the people who loved Detroit.", "Latifah Muhammad of the Black Entertainment Television wrote that Knowles' \"powerful\" rendition of the song came right on time.", "An editor for \"Essence\" described Knowles' cover as a \"moving tribute to Detroit\"." ], [ "From the Fires", "From the Fires\n\nFrom the Fires is the second EP by American rock band Greta Van Fleet.", "It is a double EP consisting of eight songs; four from their debut EP, \"Black Smoke Rising\", and four new tracks.", "It was released on November 10, 2017 through Republic Records.", "\"From the Fires\" was first announced on October 25, 2017, to be released on November 10, 2017.", "The release is a double EP, consisting of eight songs; four being newly recorded by the band, four songs originally found from their prior EP, \"Black Smoke Rising\".", "Having chosen songs for \"Black Smoke Rising\" that would demonstrate their range and variety, the band felt that it was \"simply just not finished.\"", "As a result, they compiled four more songs that they felt tied up loose ends for \"From the Fires\".", "Too busy to design the cover art like they did for \"Black Smoke Rising\", they hired an artist for \"From the Fires\" and made suggestions.", "The album was released physically and digitally, the latter being available for a discount on iTunes if the account has already purchased \"Black Smoke Rising\".", "The song \"Highway Tune\" topped the \"Billboard\" Mainstream Rock and Active Rock charts in 2017, while \"Safari Song\" had peaked at number 1 on the same chart in February 2018." ], [ "Day Dreaming (Aretha Franklin song)", "Rapper Cam'Ron interpolated and covered the song in his single \"Daydreaming\" from \"Come Home with Me\".", "On August 1, 2006, American singer Natalie Cole released her version of \"Day Dreaming\" as a single from her 12th studio album \"Leavin\"'.", "A video accompanying the song was directed by Doug Biro, and features Cole singing with her band in front of a white background.", "The cover earned Cole a nomination at the 49th Annual Grammy Awards for Best Female R&B Vocal Performance, but she lost to Mary J. Blige for her 2005 single \"Be Without You\".", "Cole said she \"added a little bit of a hip-hop feel\" to her interpretation of the song.", "Cole performed \"Day Dreaming\" at the BET special \"An Evening of Stars: Tribute to Aretha Franklin\" along with an arrangement of Franklin's 1970 single \"Call Me\"." ] ], "gold": "\"A Change Is Gonna Come\" is a song by American artist Sam Cooke that initially appeared on Cooke's album \"Ain't That Good News\" and was later performed in a number of events. For instance, the track was sang at both the 2004 Nobel Peace Prize Concert, performed by Patti LaBelle, and Obama's inaguration, where Bettye LaVette and Jon Bon Jovi were the artists that sang it. At the 2013 Sound of Change Concert, Beyonc\u00e9 Knowles performed it, with C\u00e9line Dion doing it during a 2019 tribute to Aretha Franklin. In 2017, \"A Change is Gonna Come\" was also covered by Greta Van Fleet and released on their double EP \"From the Fires\".", "prediction 1": "American singer and songwriter, Sam Cooke, has sung the song \"A Change Is Gonna Come\" several times. In 2009, Aaron Neville, along with the Mt. Zion Mass Choir, released a version of the song \"A Change Is Gonna Come\" on the compilation album \"\". In 2010, American Idol contestant Adam Lambert sang the song in the season 8 finale. In 2017, American rock band Greta Van Fleet released the song \"From the Fires\", a double EP consisting of eight songs, four from their debut EP, and four new tracks.\n", "prediction 2": "The recording of A Change Is Gonna Come by Sam Cooke originally appeared on his album Ain't That Good News on March 1, 1964. It was also covered by Joshua Ledet during the Top 7 episode of season 11 (2012), for which he received a standing ovation from the audience. American rock band Greta Van Fleet released a version of Athena Buress's 1992 song A Change Is Gonna Come on their second studio album, From the Fires. A black-and-white video of the cover of the song from Ledeta Rock band that was released on July 30, 2017's album, On January 26, 2018, The Corporation released the song on its second album, which includes four new tracks, and four of eight songs to be released on November 10th. The song was released on a double EP, debut album titled This Cara Change Was A Change Is Gonna Come.", "prediction 3": "\"A Change Is Gonna Come\" is a 1964 song by American recording artist Sam Cooke, initially appearing on Cooke's album Ain't That Good News, released March 1, 1964 by RCA Victor and a slightly edited version of the recording was released as a single on December 22, 1964. American rock band Greta Van Fleet has released an eighth studio album, \"From the Fires\", on November 10, 2017, featuring four new songs. Joshua Ledet performed the song during the Top 7 episode of season 11 (2012). In 2009, Aaron Neville, along with the Mt. Zion Mass Choir, released a version of the song on the compilation album \"The Strokes\" and in 2008.", "prediction 4": "\"A Change Is Gonna Come\" is a song by American recording artist Sam Cooke. It initially appeared on Cooke's album \"Ain't That Good News\", released March 1, 1964 by RCA Victor. It was sung by Joshua Ledet during the Top 7 episode of season 11 (2012), for which he received a standing ovation from the audience. It was sung by Sister Sledge during the season 9 semifinalist Lilly Scott's performance in March 2010. Black Idol Contestant Adam Lambert sang the song in the season 8 finale in May, 2009, and in the season 10 finale of the season 9 semifinalist Lilly Scott sang in March 2010. And, Ford quote between the same line and creates its people.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 43, "end": 100 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 249, "end": 254 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 497 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"A Change Is Gonna Come\" is a song by American recording artist Sam Cooke. It initially appeared on Cooke's album \"Ain't That Good News\". The song has been performed a number of times. It was also sung by Joshua Ledet during the Top 7 episode of season 11. There is a duet of the song by Bettye LaVette and Jon Bon Jovi. In 2004, Patti LaBelle performed the song on the annual Nobel Peace Prize Concert. In the days leading up to the Inauguration of Barack Obama, this song could be heard. In 2009, Aaron Neville, along with the Mt. Zion Mass Choir, released a version of the song \"A Change Is Gonna Come\" on the compilation album \"\". In 2009, American Idol contestant Adam Lambert sang the song in the season 8 finale. Season 9 semifinalist Lilly Scott also covered the song. Knowles performed the song as a tribute to Detroit. In 2017, American rock band Greta Van Fleet released their double EP, \"From the Fires\"." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who was the first writer of fiction in indian english literature?", "passages": [ [ "Rabindranath Tagore", "Rabindranath Tagore\n\nRabindranath Tagore FRAS (; 7 May 1861\u00a0\u2013 7 August 1941), sobriquet Gurudev, was a Bengali polymath from the Indian subcontinent, a poet, musician and artist.", "He reshaped Bengali literature and music, as well as Indian art with Contextual Modernism in the late 19th and early 20th centuries.", "Author of \"Gitanjali\" and its \"profoundly sensitive, fresh and beautiful verse\", he became in 1913 the first non-European to win the Nobel Prize in Literature.", "Tagore's poetic songs were viewed as spiritual and mercurial; however, his \"elegant prose and magical poetry\" remain largely unknown outside Bengal.", "He is sometimes referred to as \"the Bard of Bengal\".", "A Pirali Brahmin from Calcutta with ancestral gentry roots in Jessore, Tagore wrote poetry as an eight-year-old.", "At the age of sixteen, he released his first substantial poems under the pseudonym \"Bh\u0101nusi\u1e43ha\" (\"Sun Lion\"), which were seized upon by literary authorities as long-lost classics.", "By 1877 he graduated to his first short stories and dramas, published under his real name.", "As a humanist, universalist, internationalist, and ardent anti-nationalist, he denounced the British Raj and advocated independence from Britain." ], [ "Indian English literature", "Bankim Chandra Chattopadhyay (1838\u20131894) wrote \"Rajmohan's Wife\" and published it in 1864; it is the first Indian novel written in English.", "Raja Rao (1908\u20132006), Indian philosopher and writer, authored \"Kanthapura\" and \"The Serpent and the Rope\", which are Indian in terms of their storytelling qualities.", "Kisari Mohan Ganguli translated the Mahabharata into English, the only time the epic has ever been translated in its entirety into a European language.", "Rabindranath Tagore (1861\u20131941) wrote in Bengali and English and was responsible for the translations of his own work into English.", "Dhan Gopal Mukerji (1890\u20131936) was the first Indian author to win a literary award in the United States.", "Nirad C. Chaudhuri (1897\u20131999), a writer of non-fiction, is best known for his \"The Autobiography of an Unknown Indian\" (1951), in which he relates his life experiences and influences.", "P. Lal (1929\u20132010), a poet, translator, publisher and essayist, founded a press in the 1950s for Indian English writing, Writers Workshop." ] ], "gold": "Rabindranath Tagore was the first writer of fictional poetry and text in Indian English literature. However, the first published fictional novel in Indian English literature was written by Bankim Chandra Chattopadhyay.", "prediction 1": "The first Indian writer of fiction in Indian English literature was Rabindranath Tagore, who was responsible for the translations of his own work into English. Bankim Chandra Chattopadhyay, who wrote \"Rajmohan's Wife\" and published it in 1864, was the first Indian novel written in English. Raja Rao, an Indian philosopher and writer, wrote \"Kanthapura\" and \"The Serpent and the Rope\", which are Indian in terms of their storytelling qualities. Raja Rabindranath Tagore, who was responsible for the translations of his own work into English.", "prediction 2": "Bankim Chandra Chattopadhyay (1838\u20131894) wrote \"Rajmohan's Wife\" and published it in 1864; it is the first Indian novel written in English. Dhan Gopal Mukerji (1890\u20131936) was the first Indian author to win a literary award in the United States. P. Lal founded a press in the 1950s for Indian English writing, Writers Workshop.", "prediction 3": "Bankim Chandra Chattopadhyay (1838\u20131894) wrote \"Rajmohan's Wife\" and published it in 1864; it is the first Indian novel written in English. Dhan Gopal Mukerji (1890\u20131936) was the first Indian author to win a literary award in the United States. P. Lal (1929\u20132010), a poet, translator, publisher and essayist, founded a press in the 1950s for Indian English writing, Writers Workshop.", "prediction 4": "The first writer of fiction in Indian English literature was Rabindranath Tagore. Bankim Chandra Chattopadhyay (1838\u20131894) wrote Rajmohan's Wife and published it in 1864. Raja Rao (1908\u20132006), Indian philosopher and writer, authored \"Kanthapura\" and \"The Serpent and the Rope\", which are Indian in terms of their storytelling qualities. Dhan Gopal Mukerji (1890\u20131936) was the first Indian author to win a literary award in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 444 }, { "error type": "Irrelevant", "explanation": "", "start": 445, "end": 541 } ], "missing-info": [], "corrected-prediction": "The first Indian writer of fiction in Indian English literature was Rabindranath Tagore. Bankim Chandra Chattopadhyay wrote the first Indian novel written in English. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "The two basic types of medical insurance in japan are?", "passages": [ [ "National Health Insurance (Japan)", "This is required if a person moves to the municipality from another municipality or overseas and isn\u2019t covered by Employees' Health Insurance, withdraws from Employees' Health Insurance (for example, due to job loss), stops receiving public assistance, or is born (and not covered under parents Employees Health Insurance).", "Those who do not register when they become eligible and register later, can be charged for up to two years of back payments.", "A person applies to their local ward office or city office, which issues them with a NHI card, and invoices for the NHI premiums.", "The insured person then pays the premiums, and is now covered.", "When the insured person uses a medical facility that accepts NHI, they will only need to pay part of the cost.", "The medical facility will then send invoices for the remaining amount to the National Health Insurance Federation, which reviews and pays the medical facility.", "After this, the NHIF reports on the invoices to the municipal office, which reimburses the NHIF.", "There are several different grounds for withdrawing from NHI.", "Insured people are required to notify the city if they change their address, their name, the head of household, lose their NHI card, or the NHI members covered under the card have changed.134\n\nIn 2013 the calculation method for premiums changed." ], [ "National Health Insurance (Japan)", "National Health Insurance (Japan)\n\n.", "National Health insurance is designed for people who are not eligible to be members of any employment-based health insurance program.", "Although private insurance is also available, all Japanese citizens, permanent residents, and any non-Japanese residing in Japan with a visa lasting three months or longer are required to be enrolled in either National Health Insurance or Employees' Health Insurance.", "On July 9, 2012, the alien registration system was abolished and foreigners are now able to apply as part of the Basic Resident Registration System.", "Foreigners who reside in Japan for more than three months need to register for national health insurance.", "REGISTRO CIVIL - 16KokuminKenkouHokenEn.pdf\n", "It is defined by the National Health Care Act of 1958.", "Japan\u2019s first health insurance system was introduced in 1922.", "It took effect in 1927 to cover laborers, and in 1938 was extended to cover farmers also.", "The system originated from labor unions representing workers in dangerous industries, and over time was gradually extended so that currently all Japanese citizens and residents should be covered.", "The current NHI system, which is managed by local municipal governments, was introduced in 1961.", "The information in this article relates to Minato Ward in Tokyo, and NHI conditions in other municipalities may differ.", "People are required to join the NHI within two weeks of becoming eligible." ] ], "gold": "The two basic types of medical insurance plans in Japan are Employees' Health Insurance for employees, and National Health Insurance for non employees.", "prediction 1": "The two basic types of medical insurance in Japan are National Health Insurance and Employees' Health Insurance. The system was introduced in 1922 and took effect in 1927 to cover laborers, and in 1938 was extended to cover farmers also. The current NHI system, which is managed by local municipal governments, was introduced in 1961.", "prediction 2": "Japanese citizens, permanent residents, and any non-Japanese residing in Japan with a visa lasting three months or longer are required to be enrolled in either National Health Insurance or Employees' Health Insurance.", "prediction 3": "The two basic types of medical insurance in Japan are National Health Insurance and Employees' Health Insurance.", "prediction 4": "The two basic types of medical insurance in Japan are National Health Insurance and Employees' Health Insurance. In Japan, the main type of insurance is National Health Insurance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 334 } ], "missing-info": [], "corrected-prediction": "The two basic types of medical insurance in Japan are National Health Insurance and Employees' Health Insurance. " }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "What came out first mr pibb or dr pepper?", "passages": [ [ "Pibb Xtra", "Pibb Xtra\n\nPibb Xtra, formerly called Mr. Pibb (sometimes styled as Mr. PiBB), is a soft drink marketed by The Coca-Cola Company.", "As of 2012, it is sold only in the United States, except in areas where Dr Pepper is distributed by the local Coca-Cola bottler.", "It is available in Canada through Coca-Cola Freestyle machines.", "First introduced as \"Peppo\" to compete against Dr Pepper, the name was changed to \"Mr. Pibb\" after Dr Pepper sued The Coca-Cola Company for trademark infringement.", "The original test markets for Mr. Pibb in 1972 were located in Waco, Texas, the birthplace of Dr Pepper, before the company moved to Dallas, Texas.", "In 1980, Mr. Pibb was reformulated and marketed with the words \"New Taste\" printed prominently on the products.", "In 2001, a new formula called Pibb Xtra added cinnamon flavor, replacing the original formula in many parts of the United States.", "Today Pibb Xtra is labeled as \"artificially flavored spicy cherry soda\".", "In 2011, Pibb Xtra expanded to two new flavors.", "Released for Coca-Cola Freestyle machines, the first is Pibb Xtra Cherry, the other Pibb Xtra Cherry-Vanilla.", "Both of these new flavors were also released for Pibb Zero." ], [ "Dr Pepper", "Dr Pepper\n\nDr Pepper is a carbonated soft drink marketed as having a unique flavor.", "The drink was created in the 1880s by pharmacist Charles Alderton in Waco, Texas and first served around 1885.", "Dr Pepper was first nationally marketed in the United States in 1904, and is now also sold in Europe, Asia, North and South America, and Australia, as well as New Zealand and South Africa as an imported good.", "Variants include a version without high fructose corn syrup, Diet Dr Pepper, as well as a line of additional flavors, first introduced in the 2000s.", "The name \"Dr. Pepper\" was first used commercially in 1885.", "It was introduced nationally in the United States at the 1904 Louisiana Purchase Exposition as a new kind of soda pop, made with 23 flavors.", "Its introduction in 1885 preceded the introduction of Coca-Cola by one year.", "It was formulated by Brooklyn-born pharmacist Charles Alderton in Morrison's Old Corner Drug Store in Waco, Texas.", "To test his new drink, he first offered it to store owner Wade Morrison, who also found it to his liking.", "Patrons at Morrison's soda fountain soon learned of Alderton's new drink and began ordering a \"Waco\".", "Alderton gave the formula to Morrison, who named it Dr. Pepper (later stylized as \"Dr Pepper\")." ] ], "gold": "Dr Pepper was invented and introduced almost a century before Mr. Pibb when pharmacist Charles Alderton created it in the 1880s in Waco, Texas. It was also first served around 1885, preceding the introduction of Coca-Cola by one year. The Coca-Cola Company would introduce Mr. Pibb with the intention to compete with Dr Pepper in the latter half of the 20th century. The drink was originally test marketed in 1972 and would be renamed Pibb Xtra in 2001, when a new formula was introduced in many parts of the United States.", "prediction 1": "Mr. Pibb was introduced as \"Peppo\" to compete against Dr. Pepper in the 1880s and first served around 1885. Mr. Pibb Xtra, formerly called Mr. Pibb, is a soft drink marketed by The Coca-Cola Company. The drink was created in the 1880s by pharmacist Charles Alderton in Morrison's Old Corner Drug Store in Waco, Texas and first served around 1885. Dr. Pepper was first nationally marketed in the United States in 1904, and today is sold in Europe, Asia, North and Australia, as an imported good.", "prediction 2": "Mr. Pibb, formerly called Mr. Pibb, is a soft drink marketed by The Coca-Cola Company. It was first introduced as \"Peppo\" to compete against Dr. Pepper, the name was changed to \"Mr. Pibb\" after Dr. Pepper sued The Coca-Cola Company for trademark infringement. Dr. Pepper was first nationally marketed in the United States in 1904, and is now also sold in Europe, Asia, North and South America, and Australia, as well as an imported good.", "prediction 3": "Mr. Pibb is a soft drink marketed by The Coca-Cola Company. Originally introduced as \"Peppo\" to compete against Dr. Pepper, the name was changed to \"Mr. Pibb\" after Dr. Pepper sued The Coca-Cola Company for trademark infringement. Mr. Pibb Xtra was introduced in 1972 and is sometimes styled as Mr. PiBB. In 2001, a new formula called Pibb Xtra added cinnamon flavor, replacing the original formula in many parts of the United States. Dr. Pepper is now sold in Europe, Asia, North and South America, as well as an imported good.", "prediction 4": "Pibb Xtra, formerly called Mr. Pibb, is a soft drink marketed by The Coca-Cola Company. Mr. Pibb, or Dr. Pepper, originated in the 1880s as a competition drink between Peppo and Dr. Pepper. The name was changed to Mr. Pibb after Dr. Pepper sued The Coca-Cola Company for trademark infringement. In 2001, a new formula called Pibb Xtra added cinnamon flavor, replacing the original formula in many parts of the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 34 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 65, "end": 107 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 108, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 301 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 494 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Mr. Pibb was introduced to compete against Dr. Pepper in the latter half of the 20th century. The drink was originally test marketed in 1972 and would be renamed Pibb Xtra in 2001, when a new formula was introduced in many parts of the United States, and marketed by The Coca-Cola Company. Dr. Pepper was created in the 1880s by pharmacist Charles Alderton in Waco, Texas and first served around 1885, preceding the introduction of Coca-Cola by one year. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When was the first government formed in the world?", "passages": [ [ "Political history of the world", "Political history of the world\n\nThe political history of the world is the history of the various political entities created by the human race throughout their existence and the way these states define their borders.", "Throughout history, political entities have expanded from basic systems of self-governance and monarchy to the complex democratic and totalitarian systems that exist today.", "In parallel, political systems have expanded from vaguely defined frontier-type boundaries, to the national definite boundaries existing today.", "In ancient history, civilizations did not have definite boundaries as states have today, and their borders could be more accurately described as frontiers.", "Early dynastic Sumer, and early dynastic Egypt were the first civilizations to define their borders.", "Moreover, for the past 200,000 years and up to the twentieth century, many people have lived in non-state societies.", "These range from relatively egalitarian bands and tribes to complex and highly stratified chiefdoms.", "The first states of sorts were those of early dynastic Sumer and early dynastic Egypt, which arose from the Uruk period and Predynastic Egypt respectively at approximately 3000BCE.", "Early dynastic Egypt was based around the Nile River in the north-east of Africa, the kingdom's boundaries being based around the Nile and stretching to areas where oases existed." ], [ "Government", "Government\n\nA government is the system or group of people governing an organized community, often a state.", "In the case of its broad associative definition, government normally consists of legislature, executive, and judiciary.", "Government is a means by which organizational policies are enforced, as well as a mechanism for determining policy.", "Each government has a kind of constitution, a statement of its governing principles and philosophy.", "Typically the philosophy chosen is some balance between the principle of individual freedom and the idea of absolute state authority (tyranny).", "While all types of organizations have governance, the word \"government\" is often used more specifically to refer to the approximately 200 independent national governments on Earth, as well as subsidiary organizations.", "Historically prevalent forms of government include monarchy, aristocracy, timocracy, oligarchy, democracy, theocracy and tyranny.", "The main aspect of any philosophy of government is how political power is obtained, with the two main forms being electoral contest and hereditary succession.", "A government is the system to govern a state or community.", "The word \"government\" derives, ultimately, from the Greek verb \u03ba\u03c5\u03b2\u03b5\u03c1\u03bd\u03ac\u03c9", "[\"kubern\u00e1o\"] (meaning \"to steer\" with gubernaculum (rudder), the metaphorical sense being attested in Plato's Ship of State)." ] ], "gold": "A government is the system, or group of people, governing an organized community, which is generally a state. The first government in the world was formed in approximately 3000BCE. The communities that are considered to have been the first states with governments are early dynastic Sumer, which arose from the Uruk period, and early dynastic Egypt, which arose from Predynastic Egypt period.", "prediction 1": "The first government formed in the world was the state of Sumer in the early dynastic period, or Early dynastic Egypt, formed during the Uruk period and Predynastic Egypt at approximately 3000 BCE.", "prediction 2": "The first government formed in the world was the government of early dynastic Sumer, which arose from the Uruk period and Predynastic Egypt respectively at approximately 3000BCE.", "prediction 3": "The first government formed in the world is the system or group of people governing an organized community, often a state. The first states of sorts were those of early dynastic Sumer and early dynastic Egypt, which arose from the Uruk period and Predynastic Egypt respectively at approximately 3000BCE.", "prediction 4": "The first government in the world was formed in approximately 3000 BCE. The political history of the world is the history of the various political entities created by the human race throughout their existence and the way these states define their borders. In parallel, political systems have expanded from vaguely defined frontier-type boundaries, to the national definite boundaries existing today. In ancient history, civilizations did not have definite boundaries as states have today, and their borders could be more accurately described as frontiers. Nevertheless, for the past 200,000 years and up to the twentieth century, many people have lived in non-state societies.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "A government is the system or group of people governing an organized community, often a state. The first government formed in the world was the state of Sumer in the early dynastic period, or Early dynastic Egypt, formed during the Uruk period and Predynastic Egypt at approximately 3000 BCE." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "How many core editions are there of windows server 2012?", "passages": [ [ "Windows Server 2012", "However, unlike Windows 8, the developer preview of Windows Server 2012 was only made available to MSDN subscribers.", "It included a graphical user interface (GUI) based on Metro design language and a new Server Manager, a graphical application used for server management.", "On February 16, 2012, Microsoft released an update for developer preview build that extended its expiry date from April 8, 2012 to January 15, 2013.", "Before Windows Server 2012 was finalized, two test builds were made public.", "A public beta version of Windows Server 2012 was released along with the Windows 8 Consumer Preview on February 29, 2012.", "The release candidate of Windows Server 2012 was released on May 31, 2012, along with the Windows 8 Release Preview.", "The product was released to manufacturing on August 1, 2012 and became generally available on September 4, 2012.", "However, not all editions of Windows Server 2012 were released at the same time.", "Windows Server 2012 Essentials was released to manufacturing on October 9, 2012 and was made generally available on November 1, 2012.", "As of September 23, 2012, all students subscribed to DreamSpark program can download Windows Server 2012 Standard or Datacenter free of charge.", "Unlike its predecessor, Windows Server 2012 can switch between \"Server Core\" and \"Server with a GUI\" installation options without a full reinstallation." ] ], "gold": "Windows server 2012 was released to manufacturing on August 1, 2012 (along with Windows 8) and became generally available on September 4, that year. There is 1 32 GB and 64 GB core editions. There is 2 4TB editions.", "prediction 1": "There are several core editions of Windows Server 2012, including Server Core, Server with a GUI, and Server with a GUI. However, not all editions of Windows Server 2012 were released at the same time, for example, Windows Server 2012 Essentials was released to manufacturing on October 9, 2012 and was made generally available on November 1, 2012.", "prediction 2": "There are several core editions of Windows Server 2012. Windows Server 2012 Core Edition contains the Windows Server 2012 Operating System, Windows Server 2012 Business Edition, and Windows Server 2012 Enterprise Edition.", "prediction 3": "Windows Server 2012 has 3 different core editions. There are 2 Windows Server 2012 Core editions and 1 Windows Server 2012 Core edition with a GUI.", "prediction 4": "Windows Server 2012 has two core editions, Server Core and Server with a GUI. There was also a public beta version of Windows Server 2012 released along with the Windows 8 Consumer Preview on February 29, 2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 348 }, { "error type": "Redundant", "explanation": "Server with a GUI, and ", "start": 102, "end": 120 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 97 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Windows server 2012 was released to manufacturing on August 1, 2012 (along with Windows 8) and became generally available on September 4, that year. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Season 1 winner of so you think you can dance?", "passages": [ [ "So You Think You Can Dance Australia (season 1)", "So You Think You Can Dance Australia (season 1)\n\nSeason one of So You Think You Can Dance Australia, the Australian version of the American reality dance-off series \"So You Think You Can Dance\", is hosted by Rogue Traders vocalist Natalie Bassingthwaighte, with Jason Coleman, Matt Lee and Bonnie Lythgoe acting as the judges.", "The series began airing on Sunday 3 February 2008 at 7.30\u00a0pm and continued on Sundays and Mondays until the final on 27 April 2008.", "Jack Chambers was the inaugural winner of \"So You Think You Can Dance Australia\" 2008 taking home $200,000.", "From October to November 2007, auditions for contestants were held in Perth, Brisbane, Melbourne, Adelaide and Sydney.", "After being selected, through either an impressive initial audition or after a choreography workshop, the top 100 finalists spent a week in Sydney for more auditions, ultimately forming a group of 20.", "A 600-seat arena was constructed in Sydney for the finals.", "Several finalists later performed during the 2007 \"Australian Idol\" grand final, as well as Ten's New Year's Eve broadcast.", "The song played after each female and male elimination differs each week.", "From over 3000 contestants, 20 dancers (10 males and 10 females) were chosen to compete in the elimination series, which began on 17 February 2008." ], [ "So You Think You Can Dance (Malaysia, season 1)", "So You Think You Can Dance (Malaysia, season 1)\n\n", "So You Think You Can Dance is a dance reality show and competition aired on 8TV.", "Premiered on 5 April 2007, it is based on the original United States version of the same name.", "It has a similar premise to the American Idol series of singing competitions, with nationwide auditions leading to the discovery of the next big star.", "The organizers of \"So You Think You Can Dance\" held one audition in Kuala Lumpur.", "The contestants that are picked go through callbacks and the Top 20 perform on a live show.", "This follows a weekly elimination hereafter.", "The Malaysian version of \"So You Think You Can Dance\" had completed its inaugural season with Muhammad Haslam Abdul Rahman Rubaee as the champion.", "The show was hosted by Juliana Ibrahim and Jehan Miskin; the latter only joined the cast since episode 9.", "The following is the list of choreographers whose involvement in the competition are as shown on TV, followed by their specialties.", "Auditions were held on 16 and 17 March the same year, with Pat, Judimar and guest Jeff Thacker to judge the participants' dancing skills." ], [ "So You Think You Can Dance (Belgium and the Netherlands, season 1)", "So You Think You Can Dance (Belgium and the Netherlands, season 1)\n\nThe first season of So You Think You Can Dance, a Dutch adaptation of the American show by the same name, premiered on RTL4 on September 4, 2008.", "Unlike following seasons of the show, the first was broadcast in the Netherlands only and features only Dutch contestants.", "The finale aired December 11, 2008 and concluded with latin dancer Ivan Paulovich as champion.", "Paulovich won a choice of free dance study opportunities in the U.S., \u20ac20.000, and a role in the musical Footloose.", "The first season featured permanent judges Jaakko Toivonen, Euvgenia Parakhina, and Dan Karaty.", "Additional guest judges included Albert Verlinde, Penny de Jager, Kim-Lian van der Meij, Wendy van Dijk, and Eszteca Noya.", "Open auditions for the first season were held exclusively in Amsterdam.", "Those dancers which impressed a panel of judges were sent forward to a \"bootcamp,\" a several-day-long series of dance workshops (held in London, England for the first season)." ] ], "gold": "So You Think You Can Dance is a franchise of dancing reality television shows that has more than 30 localized adaptations throughout the world, each one with their particular seasons and winners. In the first season of the USA's version, the competitor that ultimately resulted victorious was Nick Lazzarini, while Nicolas Archambault and Jack Chambers shared the distinction in the editions produced in Canada and Australia respectively. The Malaysian version of the show had completed its inaugural season with Muhammad Haslam Abdul Rahman Rubaee as the champion, and Ivan Paulovich achieved the title in the adaptation based on the Netherlands and Belgium.", "prediction 1": "So You Think You Can Dance is a dance reality show and competition aired on 8TV. The Malaysian version of the show has finished its first season with Muhammad Haslam Abdul Rahman Rubaee as the winner. The first season of So You Think You Can Dance, a Dutch adaptation of the American show by the same name, premiered on RTL4 on September 4, 2008. The winner of Season 1 of So You Think You Can Dance Australia was latin dancer Ivan Paulovich.", "prediction 2": "So You Think You Can Dance is a dance reality show and competition aired on 8TV. Season 1 winner of the Australian version of the American So You Think You Can Dance was Jack Chambers. The Malaysian version of the show had completed its inaugural season with Muhammad Haslam Abdul Rahman Rubaee as the champion. Season 1 winner of the Dutch version of the American So You Think You Can Dance was latin dancer Ivan Paulovich.", "prediction 3": "The first winner of season 1 of So You Think You Can Dance Australia is Jack Chambers, who won the first season. In the Netherlands, the first winner of season 1 is latin dancer Ivan Paulovich, who won a choice of free dance study opportunities in the U.S., \u20ac20.000, and a role in the musical Footloose.", "prediction 4": "The Malaysian version of So You Think You Can Dance, an American dance reality show and competition aired on 8TV, finished its inaugural season with Muhammad Haslam Abdul Rahman Rubaee as the champion. The Dutch version of So You Think You Can Dance, an American reality dance-off series based on the American show by the same name, finished with latin dancer Ivan Paulovich as the champion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 346 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 414, "end": 442 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "So You Think You Can Dance is a dance reality show and competition aired on 8TV. The Malaysian version of the show has finished its first season with Muhammad Haslam Abdul Rahman Rubaee as the winner. The winner of Season 1, So You Think You Can Dance (Belgium and the Netherlands), a Dutch adaptation of the American show by the same name, was latin dancer Ivan Paulovich. The winner of Season 1 for So You Think You Can Dance Australia was Jack Chambers. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When was the last time liverpool got relegated?", "passages": [ [ "History of Liverpool F.C. (1892\u20131959)", "Integral to their success were their captain Alex Raisbeck, and striker Sam Raybould.", "Raisbeck, a centre-half, had been signed from Hibernian in 1898.", "He became club captain a year later, and was often the focal point of the team, as an important defensive player and the instigator of many of Liverpool's attacks.", "Raybould was signed from local club New Brighton Tower, and in the 1899\u20131900 season scored seven times as the club won nine of their last eleven matches, to finish in tenth place.", "He would go on to score 128 goals in 226 matches for Liverpool.", "Success in the 1900\u201301 season looked unlikely in February, at which point Liverpool had lost eight games and conceded 31 goals.", "However, they won nine and drew three of their next twelve matches, while only conceding four goals, to achieve their first League title.", "They were less successful in the following two seasons, finishing in eleventh and fifth places respectively.", "The 1903\u201304 season saw the club relegated to the Second Division; like the previous relegation it was only for one year as they won the division the following season.", "On their return in the 1905\u201306 season they became the first team to win the Second and First Division in successive seasons." ], [ "History of Liverpool F.C. (1892\u20131959)", "This did not hinder their progress in the FA Cup, as they reached their second final (their first at Wembley), against Arsenal.", "They were unable to win their first FA Cup; two goals from Arsenal striker Reg Lewis meant Liverpool lost 2\u20130.", "After their FA Cup final appearance, Liverpool's fortunes declined steadily.", "Kay resigned through ill-health, and was replaced by Don Welsh.", "Welsh's first season did not go smoothly, as Liverpool were knocked out of the FA Cup in the third round by Norwich City of the Third Division South.", "The following year, 61,905 spectators watched Liverpool beat Wolverhampton Wanderers 2\u20131 in the fourth round of the FA Cup, the biggest attendance ever recorded at Anfield.", "Under Welsh's stewardship the club gradually slipped further down the table, and were relegated to the Second Division in the 1953\u201354 season, after finishing in bottom place.", "Their relegation came after 50 uninterrupted years in the top division of English football.", "Liverpool's first season in the Second Division in 1954\u201355 brought them an 11th-place finish.", "During this season the club suffered the biggest defeat in its history, a 9\u20131 loss to Birmingham City." ], [ "History of Liverpool F.C. (1892\u20131959)", "History of Liverpool F.C. (1892\u20131959)\n\nThe history of Liverpool Football Club from 1892 to 1959 covers the period from the club's foundation, through their first period of success from 1900 to the 1920s, to the appointment of Bill Shankly as manager.", "Liverpool Football Club was formed on 15 March 1892 following a disagreement between the directors of Everton Football Club and its president, John Houlding, who owned the club's ground, Anfield.", "A dispute over rent resulted in Everton moving to Goodison Park, which left Houlding with an empty stadium.", "Thus, he founded Liverpool F.C., and they joined the Lancashire League.", "After winning the league title in their first season, Liverpool were accepted into the Football League for the 1893\u201394 season, following the resignations of Accrington and Bootle.", "The appointment of Tom Watson as the club's manager in 1896 led to the club's first period of sustained success.", "Liverpool consolidated their position in the Football League following promotion to the First Division, and won their first League championship in 1901.", "A further championship followed in 1906, and in 1914 the club reached their first FA Cup final, losing to Burnley.", "Watson died suddenly in 1915 of pneumonia after the outbreak of the First World War." ] ], "gold": "Liverpool Football Club was formed on 15 March 1892 and were accepted into the Football League for the 1893\u201394 season. The 1894\u201395 season was the first time the Liverpool F.C was relegated. During The 1903\u201304 season the club was relegated to the Second Division. This was due to their eleventh and fifth place finishes, this was their second relegation. It lasted for one season. They were relegated to the Second Division again in The 1953\u201354 season, after finishing in bottom place. ", "prediction 1": "Liverpool Football Club were relegated to the Second Division in the 1953\u201354 season, after finishing in bottom place. This was the last time the club got relegated in the top division of English football, in the league. The last time Liverpool were relegated was in the league in 1903, in 1903, and then again in 1903.", "prediction 2": "Liverpool were relegated to the Second Division in the 1953\u201354 season, after finishing in bottom place. Their relegation came after 50 uninterrupted years in the top division of English football. The last time Liverpool were relegated to the Second Division was in 1903.", "prediction 3": "The last time Liverpool Football Club was relegated was in 1954. They were relegated to the Second Division in the 1953-54 season, after finishing in bottom place. The club's last time Liverpool were relegated was in 1921.", "prediction 4": "Liverpool F.C. was relegated to the Second Division in the 1953-54 season, after finishing in bottom place. The club was relegated to the Second Division for the second time on January 19, 1954. The last time Liverpool were relegated was the 1902-03 season, when they were relegated to the Second Division and relegated for the second time on January 4, 1955.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 118, "end": 219 }, { "error type": "Unverifiable", "explanation": "", "start": 220, "end": 285 }, { "error type": "Incoherent", "explanation": "", "start": 286, "end": 318 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Liverpool Football Club was formed on 15 March 1892 and were accepted into the Football League for the 1893\u201394 season. The 1903\u201304 season saw the club relegated to the Second Division. Liverpool Football Club were relegated to the Second Division in the 1953\u201354 season, after finishing in bottom place. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What year did the movie the sound of music come out?", "passages": [ [ "The Sound of Music (film)", "Bosley Crowther, in \"The New York Times\", criticized the film's \"romantic nonsense and sentiment\", the children's \"artificial roles\", and Robert Wise's \"cosy-cum-corny\" direction.", "Judith Crist, in a biting review in the \"New York Herald Tribune\", dismissed the movie as \"icky sticky\" and designed for \"the five to seven set and their mommies\".", "In her review for \"McCall's\" magazine, Pauline Kael called the film \"the sugar-coated lie people seem to want to eat\", and that audiences have \"turned into emotional and aesthetic imbeciles when we hear ourselves humming the sickly, goody-goody songs\".", "Wise later recalled, \"The East Coast, intellectual papers and magazines destroyed us, but the local papers and the trades gave us great reviews\".", "Indeed, reviewers such as Philip K. Scheuer of the \"Los Angeles Times\" described the film as \"three hours of visual and vocal brilliance\", and \"Variety\" called it \"a warmly-pulsating, captivating drama set to the most imaginative use of the lilting R-H tunes, magnificently mounted and with a brilliant cast\"." ], [ "The Sound of Music (film)", "In November 1969, \"The Sound of Music\" completed its initial four-and-a-half year theatrical release run in the United States, having earned $68,313,000 in North American (United States and Canada) rentals and $44,168,000 in foreign rentals, for a worldwide total of $112,481,000 in gross returns.", "It was the first film to gross over $100 million.", "The film was re-released in 1973, and increased its North American rentals to $78.4 million.", "By the end of the 1970s, it was ranked seventh in all time North American rentals, having earned $79 million.", "The film's re-release in 1990 increased the total North American admissions to 142,415,400\u2014the third highest number of tickets sold behind \"Gone with the Wind\" and \"Star Wars\"\u2014and about 283.3 million admissions worldwide.", "\"The Sound of Music\" eventually earned a total domestic gross of $163,214,076, and a total worldwide gross of $286,214,076.", "Adjusted for inflation, the film earned about $2.366 billion at 2014 prices\u2014the fifth highest-grossing film of all time.", "\"The Sound of Music\" film, like the stage musical, presents a history of the von Trapp family that is not completely accurate." ], [ "The Sound of Music (film)", "During most of its run on NBC, the film was heavily edited to fit a three-hour time slot\u2014approximately 140 minutes without commercials.", "The thirty minutes edited out of the original film included portions of the \"Morning Hymn and Alleluia\" sung by the nuns, part of the dialogue between Mother Abbess and Maria in the abbey, part of Liesl and Rolfe's dialogue preceding \"Sixteen Going on Seventeen\", Liesl's verse of \"Edelweiss\" sung with the Captain, the Captain and Baroness waltzing at the party, and minor dialogue cuts within existing scenes.", "The film aired in its uncut form (minus the entr'acte) on April 9, 1995, on NBC.", "Julie Andrews hosted the four-hour telecast which presented the musical numbers in a letterbox format.", "As the film's home video availability cut into its television ratings, NBC let their contract lapse in 2001.", "That year, the film was broadcast one time on the Fox network, in its heavily edited 140-minute version.", "Since 2002, the film has aired on ABC, generally during Christmas week, and has been broadcast on its sister cable network, Freeform, periodically around Easter and other holidays.", "Most of its more recent runs have been the full version in a four-hour time slot, complete with the entr'acte." ] ], "gold": "The Sound of Music is a 1965 American musical drama film produced and directed by Robert Wise, and starring Julie Andrews and Christopher Plummer, with Richard Haydn, Peggy Wood, Charmian Carr, and Eleanor Parker. The film had its opening premiere on March 2, 1965 at the Rivoli Theater in New York City. The film was re-released in 1973, and increased its North American rentals to $78.4 million. The first American television transmission of \"The Sound of Music\" was on February 29, 1976 on ABC. The film's re-release in 1990 increased the total North American admissions to 142,415,400, the third highest number of tickets sold behind \"Gone with the Wind\" and \"Star Wars\", and about 283.3 million admissions worldwide. The film aired in its uncut form (minus the entr'acte) on April 9, 1995, on NBC.", "prediction 1": "The Sound of Music was first released in November 1969. It was re-released in 1973 and increased its North American rentals to $78.4 million. The film aired in its uncut form on April 9, 1995, on NBC.", "prediction 2": "The Sound of Music was released in November 1969. It was re-released in 1973, increasing its North American rentals to $78.4 million. It was also ranked seventh in all time North American rentals, having earned $79 million. In its uncut form, the film was aired on April 9, 1995, on NBC.", "prediction 3": "The Sound of Music was released in November 1969. It was re-released in 1973, and increased its North American rentals to $78.4 million. The film's re-release on NBC aired in its uncut form on April 9, 1995, and featured the original cast in their full roles.", "prediction 4": "The Sound of Music completed its initial four-and-a-half year theatrical release run in November 1969. The film was re-released in 1973, increasing its North American rentals to $78.4 million. The film aired in its uncut form (minus the entr'acte) on April 9, 1995, on NBC.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "In November 1969, \"The Sound of Music\" completed its initial four-and-a-half year theatrical release run in the United States. It was re-released in 1973 and increased its North American rentals to $78.4 million. The film's re-release in 1990 increased the total North American admissions to 142,415,400\u2014the third highest number of tickets sold behind \"Gone with the Wind\" and \"Star Wars\"\u2014and about 283.3 million admissions worldwide. The film aired in its uncut form on April 9, 1995, on NBC." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Gonna wash that man right outa my hair commercial?", "passages": [ [ "I'm Gonna Wash That Man Right Outa My Hair", "I'm Gonna Wash That Man", "Right Outa My Hair\n\n\"I'm Gonna Wash", "That Man", "Right Outa My Hair\" is a song from the musical \"South Pacific\", sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production.", "Her character, fed up with a man (Emile De Becque) and singing energetically in the shower, claims that she will forget about him.", "The song was written by Rodgers and Hammerstein in response to Martin's request.", "She had starred on Broadway for years and Martin suggested that she wash her hair on stage during the performance.", "\"I'm Gonna Wash That Man", "Right Outa My Hair\" was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "PJ Harvey referenced the song in her 1992 single \"Sheela-Na-Gig\" with the repeated lyric \"gonna wash that man right outa my hair\".", "50 Foot Wave's song \"Bone China\" also references this song in the lyric, \"Gonna wash that man right out of my head / and soap him into my eyes\".", "The song was covered in the 2004 film Connie and Carla by the title characters (portrayed by Nia Vardalos & Toni Collette)." ], [ "Clairol", "Clairol\n\nClairol is a personal care-product division of company Coty, specializing in hair coloring and hair care, that was begun in 1931 by Americans Joan Gelb and her husband Lawrence M. Gelb, along with business partner and lifelong friend James Romeo, after discovering hair-coloring preparations while traveling in France.", "The company was widely recognized in its home country, the United States, for its \"Miss Clairol\" home hair-coloring kit introduced in 1956.", "By 1959, Clairol was considered the leading company in the U.S. hair-coloring industry.", "In 2004, Clairol registered annual sales worth about US$1.6 billion from the sale of its hair-care products.", "As of 2014, Clairol manufactures hair-coloring products sold under the brand names \"Natural Instincts\", \"Nice 'n Easy\", and \"Perfect Lights\".", "The Clairol hair-coloring line includes permanent hair color, semipermanent hair color, and highlighting and blonding products.", "As of 2014, Clairol's hair-color products are sold under these brands:\n\nThe company's website includes a link to discontinued products.", "In 1949, the single-step Miss Clairol Hair Color Bath was introduced to the U.S. beauty industry." ] ], "gold": "A commercial with I'm Gonna Wash That Man Right Outa My Hair, a song from the musical South Pacific, was made in the 1970s by the company Clairol, an American personal care-product division of company Coty, for Clairol hair coloring.", "prediction 1": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. \"I'm Gonna Wash That Man Right Outa My Hair\" was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "prediction 2": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical \"South Pacific\", sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. It was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "prediction 3": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request that she wash her hair on stage during the performance. It was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "prediction 4": "\"I'm Gonna Wash That Man Right Outa My Hair\" is a song from the musical South Pacific, sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. The jingle was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 191 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific. \"I'm Gonna Wash That Man Right Outa My Hair\" was adapted for a commercial jingle for Clairol hair coloring in the 1970s. Clairol is an American personal care-product division of company Coty, for Clairol hair coloring." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who sang lead vocals on go your own way?", "passages": [ [ "Go Your Own Way", "Go Your Own Way\n\n\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album \"Rumours\" (1977).", "It released as the album's first single in December 1976 on both sides of the Atlantic.", "Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States.", "The album spawned three additional top ten hits, including the band's sole number one hit, \"Dreams\".", "\"Rumours\" would go on to sell over 40 million units worldwide, 20 million of which were from the US alone.", "Recorded in three separate studios, the track was developed over a period of four months.", "Like most tracks off Rumours, none of the instruments were recorded live together; the tracks were instead arranged through a series of overdubs.", "Lyrically, \"Go Your Own Way\" is a breakup song, specifically directed at his bandmate and former lover, Stevie Nicks.", "\"Go Your Own Way\" has been well received by music critics, and is regarded by \"Rolling Stone\" as one of the greatest rock songs of all time.", "In between legs of their 1976 Fleetwood Mac Tour, the band retreated to a house in Florida to prepare new material." ], [ "Determination (God Forbid album)", "Determination (God Forbid album)\n\nDetermination is the second full-length studio album by the New Jersey heavy metal quintet God Forbid.", "It was released on April 17, 2001, through Century Media Records." ], [ "Tia London", "Tia London\n\nTia London (born Latia Bell; July 22, 1988 in Chicago, Illinois, United States) is an American singer-songwriter and rapper.", "She is most known from her feature on Twista's \"It's Yours\" single from his 2014 \"Dark Horse\" album.", "She also appeared on the song \"2012\" from his \"The Perfect Storm\" album (2010).", "She was signed by The Legendary Traxster in 2010.", "She has released two full length projects, \"Love Junkie\" (2011) and \"The Overdose\" (2012), and many singles.", "In 2016 she released 30 songs plus an entire album \"2:44 am\".", "In 2017 Tia & her husband The Legendary Traxster started a new label Nothing But Dope.", "That same month they signed a deal with Priority Records.", "She has released several singles under the Nothing", "But Dope/Priority Imprint and a Self Titled Album \u201cTia London\u201d.", "In early 2015, she married musical collaborator and producer The Legendary Traxster and had their first child Akai King in July 2015.", "Named after the Akai MPC that Traxster has used throughout his career." ] ], "gold": "Go Your Own Way is a song by British-American rock band Fleetwood Mac with Lindsey Buckingham singing lead vocals. The song was released in December 1976. Go Your Own Way has been well-received by music critics and was ranked number 120 by Rolling Stone magazine on their list of 500 greatest songs of all time. Go Your Own Way is also a song by God Forbid with Byron Davis singing lead vocals. This song was a track on their Determination album which was released on April 17, 2001. Go Your Own Way is also the title of a song by Latia Lindley. Lindley, better known by her stage name Tia London, is an American singer-songwriter and rapper from Chicago, Illinois. Lindley sang lead vocals on her 2016 recording of Go Your Own Way. ", "prediction 1": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Lyrically, \"Go Your Own Way\" is a breakup song, specifically directed at his bandmate and former lover, Stevie Nicks. American singer-songwriter and rapper Tia London sang the lead vocals on Go Your Own Way.", "prediction 2": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours in 1977. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Recorded in three separate studios, the track was developed over a period of four months. American singer-songwriter and rapper Tia London sang lead vocals on the song.", "prediction 3": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours, which was released on December 26, 1977. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States.", "prediction 4": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours. Written and sung by Lindsey Buckingham, it became the band's first top ten hit in the United States. Recorded in three separate studios, the track was developed over a period of four months. American singer-songwriter and rapper Tia London sang lead vocals on \"Go Your Own Way.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 336 }, { "error type": "Unverifiable", "explanation": "", "start": 337, "end": 426 } ], "missing-info": [], "corrected-prediction": "\"Go Your Own Way\" is a song by the British-American rock band Fleetwood Mac from their eleventh studio album Rumours. Written and sung by Lindsey Buckingham, \"Go Your Own Way\" has been well received by music critics, and is regarded by \"Rolling Stone\" as one of the greatest rock songs of all time. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who won the most recent world series game?", "passages": [ [ "Milwaukee Brewers", "Milwaukee Brewers\n\nThe Milwaukee Brewers are an American professional baseball team based in Milwaukee, Wisconsin.", "The Brewers compete in Major League Baseball (MLB) as a member club of the National League (NL) Central division.", "The team is named for the city's association with the brewing industry.", "Since 2001, the Brewers have played their home games at Miller Park, which has a seating capacity of 41,900.", "The team was founded in 1969 as the Seattle Pilots, an expansion team of the American League (AL), in Seattle, Washington.", "The Pilots played their home games at Sick's Stadium.", "After only one season, the team relocated to Milwaukee, becoming known as the Brewers and playing their home games at Milwaukee County Stadium.", "In , the Brewers joined the National League.", "They are the only franchise to play in four divisions since the advent of divisional play in Major League Baseball in 1969.", "They are also one of two current MLB franchises to switch leagues in their history, the other one being the Houston Astros.", "The team's only World Series appearance came in .", "After winning the ALCS against the California Angels, the Brewers faced off against the St. Louis Cardinals in the World Series, losing 4\u20133.", "In 2011, the Brewers defeated the Arizona Diamondbacks to win the NLDS 3\u20132, but lost in the NLCS to the eventual World Series champion Cardinals 4\u20132." ], [ "Houston Astros", "Verlander won each of his 5 regular season starts with the Astros, yielding only 4 runs over this stretch.", "He carried his success into the playoffs, posting a record of 4\u20131 in his 6 starts, and throwing a complete game in Game 2 of the ALCS.", "Verlander was named the 2017 ALCS MVP.", "The Astros clinched their first division title as a member of the American League West division, and first division title overall since 2001.", "They also became the first team in Major League history to win three different divisions: National League West in 1980 and 1986, National League Central from 1997 to 1999 and 2001, and American League West in 2017.", "On September 29, the Astros won their 100th game of the season, the second time the Astros finished a season with over 100 wins, the first being in 1998.", "They finished 101\u201361, with a 21-game lead in the division, and faced the Red Sox in the first round of the AL playoffs.", "The Astros defeated the Red Sox three games to one, and advanced to the American League Championship Series against the New York Yankees.", "The Astros won the ALCS four games to three, and advanced to the World Series to play against the Los Angeles Dodgers.", "The Astros defeated the Dodgers in the deciding seventh game of the World Series, winning the first championship in franchise history." ], [ "2005 World Series", "2005 World Series\n\nThe 2005 World Series was the championship series of Major League Baseball's (MLB) 2005 season.", "The 101st edition of the World Series, it was a best-of-seven playoff between the American League (AL) champion Chicago White Sox and the National League (NL) champion Houston Astros; the White Sox swept the Astros in four games, winning their third World Series championship and their first in 88 seasons.", "Although the series was a sweep, all four games were quite close, being decided by two runs or fewer.", "The series was played between October 22\u201326, 2005.", "Home-field advantage was awarded to Chicago by virtue of the AL's 7\u20135 victory over the NL in the 2005 MLB All-Star Game.", "The Astros were attempting to become the fourth consecutive wild card team to win the Series, following the Anaheim Angels (2002), Florida Marlins (2003) and Boston Red Sox (2004).", "Both teams were attempting to overcome decades of disappointment, with a combined 132 years between the two teams without a title.", "The Astros were making their first Series appearance in 44 years of play, while the White Sox had waited exactly twice as long for a title, having last won the Series in 1917, and had not been in the Series since 1959, three years before the Astros' inaugural season." ], [ "2017 American League Championship Series", "2017 American League Championship Series\n\nThe 2017 American League Championship Series was a best-of-seven playoff pitting the Houston Astros against the New York Yankees for the American League pennant and the right to face the Los Angeles Dodgers in the 2017 World Series.", "The Astros defeated the Yankees in 7 games after falling behind 3 games to 2.", "The home team won every game in the series.", "This was the first time in history that the ALCS and NLCS teams were from the four most populous U.S. cities: New York, Los Angeles, Chicago, and Houston.", "For the first time, Major League Baseball sold presenting sponsorships to all of its postseason series; this ALCS was sponsored by Camping World and was officially known as the American League Championship Series presented by Camping World.", "The Astros would go on to defeat the Los Angeles Dodgers in the World Series in seven games, winning their first World Series championship in franchise history.", "The Astros defeated the Boston Red Sox 3\u20131 in the 2017 American League Division Series (ALDS).", "This is the Astros' fifth appearance in a League Championship Series, and their first since transferring from the National League to the American League.", "Their only previous LCS win came in the 2005 National League Championship Series; they lost in 1980, 1986, and 2004.", "They are also the first AL West team to make it to the ALCS since 2011." ], [ "2017 World Series", "2017 World Series\n\nThe 2017 World Series was the championship series of Major League Baseball's (MLB) 2017 season.", "The 113th edition of the World Series, it was played between October 24 and November 1.", "The series was a best-of-seven playoff between the National League (NL) champion Los Angeles Dodgers and the American League (AL) champion Houston Astros.", "It was sponsored by the Internet television service YouTube TV and officially known as the \"2017 World Series presented by YouTube TV\".", "The Astros defeated the Dodgers, four games to three, to win their first World Series in franchise history, also becoming the first team from Texas to do so.", "It was the first time since 2001-2002 when two consecutive World Series went to seven games.", "Both teams set a World Series record with a combined total of 25 home runs throughout the entire series, including a team record 15 home runs by the Astros, and hit a combined total of eight home runs in Game 2 to set the single game World Series mark.", "Houston outfielder George Springer was named as the World Series Most Valuable Player (MVP) after hitting five home runs in the series to tie a World Series record with Reggie Jackson in 1977 and Chase Utley in 2009.", "This was the first World Series in which home-field advantage was decided by the regular season record of the two pennant winners." ] ], "gold": "The World Series is the annual championship series of Major League Baseball, and concludes the MLB postseason. The Houston Astros made their first World Series appearance in 2005 but were swept by the AL Chicago White Sox. The Astros won the 2017 World Series, their first championship, against the Los Angeles Dodgers in seven games in the wake of Hurricane Harvey. The series was played between October 24 and November 1, and The Astros defeated the Dodgers, four games to three, to win their first World Series in franchise history, also becoming the first team from Texas to do so. ", "prediction 1": "The most recent World Series game won by the Houston Astros was in 2017. The Astros defeated the Los Angeles Dodgers in the deciding seventh game of the World Series, winning the first championship in franchise history. The most recent World Series game won by the Milwaukee Brewers was in 2017.\n", "prediction 2": "The 2019 National League Central champion Milwaukee Brewers defeated the St. Louis Cardinals 4\u20133 in the World Series after winning the ALCS. The April 15, 2019 Houston Astros won the American League Championship Series 4\u20133 against the New York Yankees, and the May 16, 2019 ALCS victory gave Houston a 3-0 series lead over the Los Angeles Dodgers.", "prediction 3": "The most recent World Series game won by the Milwaukee Brewers occurred on April 24, 2019. Prior to that, the Brewers competed in the National League as a member club of the National League Central division. The most recent World Series game won by the Houston Astros occurred on April 20, 2017.", "prediction 4": "The 880th World Series game was won by the Houston Astros on May 12, 2019. The 1014th World Series game was won by the Chicago White Sox on August 13, 2005. The 1116th World Series game was won by the Milwaukee Brewers on June 28, 2016. The 1117th World Series game was won by the Houston Astros on June 17, 2019.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The most recent World Series ", "start": 146, "end": 166 }, { "error type": "Unverifiable", "explanation": "", "start": 220, "end": 296 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 13 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The most recent World Series game won by the Houston Astros was in 2017. It was played between October 24 and November 1. The Astros defeated the Los Angeles Dodgers in the deciding seventh game, winning the first championship in franchise history, also becoming the first team from Texas to do so The most recent World Series game won by the Milwaukee Brewers was in 2017. The 2011 World Series champions were the St. Louis Cardinals. Astros made their World Series appearance in 2005 but were swept by the AL Chicago White Sox, who had not won a series since 1917. Series winners include the Anaheim Angels (2002), Florida Marlins (2003) and Boston Red Sox (2004).\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does new season of jersey shore start?", "passages": [ [ "Jersey Shore (TV series)", "On July 20, 2010, MTV announced that the cast would return for a third season, with the exception of Pivarnick.", "Season 3 returned to the original Jersey Shore summer setting, and replaced Angelina with Deena Nicole Cortese, a longtime friend of Polizzi.", "The season's January 6, 2011 premiere was viewed by a record 8.45 million viewers, making it MTV's most viewed series telecast ever.", "The second episode of the season once again set a series and MTV high at the time, with 8.56 million viewers, only to set another record with the airing of the fourth episode, which garnered 8.87 million viewers.", "On January 25, 2011, it was confirmed that the show had been renewed for a fourth season, to be filmed in Italy during the first half of 2011.", "The fourth season premiered August 4, 2011.", "MTV confirmed in June 2011 that the fifth season would return to Seaside Heights.", "Believed complications caused by Nicole Polizzi's pregnancy, and several cast members (including Polizzi, DelVecchio, and Farley) receiving spin-offs sparked talk about the future of the series past the fifth season, however on March 19, 2012, MTV officially confirmed that the series would return for a sixth season, with all cast members returning." ], [ "Jersey Shore: Family Vacation", "Jersey Shore: Family Vacation\n\nJersey Shore: Family Vacation is an American reality television series that premiered on MTV globally on April 5, 2018.", "The series follows seven housemates from the original \"Jersey Shore\" as they spend a month living together in Miami, Florida.", "On February 28, 2018, a second season was ordered ahead of the series premiere, which filmed in Las Vegas, Seaside Heights, Neptune City and Atlantic City.", "The season premiered on August 23, 2018.", "On December 13, 2018, a third season was confirmed for 2019.", "In the first season, the cast of Jersey Shore swore they would always do a vacation together.", "Five years, five kids, three marriages and who knows how many GTL sessions later, Nicole, Jenni, Mike, Pauly D, Vinny, Angelina, Deena and Ronnie are back together and on vacation in a swanky house in Miami Beach.", "In the second season, The gang kicks it off by heading to Las Vegas; after partying through Sin City, they head back to the East Coast, celebrating milestones in Atlantic City and settling in for an extended summer stay at the Shore.", "On November 27, 2017, MTV announced that the cast (with the exception of Sammi) would be reuniting in Miami, Florida for a new reunion season titled \"Jersey Shore: Family Vacation\".", "The series premiered globally on April 5, 2018." ], [ "Jersey Shore (TV series)", "Jersey Shore (TV series)\n\nJersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States.", "The series follows the lives of eight housemates who spend their summer together at a vacation home: in Seaside Heights, New Jersey in seasons one, three, five and six, and in South Beach, Florida and Florence, Italy in seasons two and four, respectively.", "The show debuted amid controversy regarding its use of the terms \"Guido/Guidette\", its portrayal of Italian-Americans and allegations of perpetuating stereotypes, as well as scrutiny from locals of the cast who were not residents of the area.", "The show became a pop culture phenomenon, with classes and conferences at universities about the show, and journalists listing it as one of the most notable shows of the time.", "The \"Shore\" franchise spawned several international adaptations in other countries.", "Four of the \"Jersey Shore\" cast members received spin-off shows on MTV, with the most successful being \"Snooki & JWOWW\".", "Most of the cast would go on to appear in other reality programs or receive their own shows on various networks.", "On August 20, 2017, a one-off television special called \"Reunion Road Trip: Return to the Jersey Shore\" aired on the E! network." ] ], "gold": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009, to December 20, 2012, in the United States. Season 11 started on August 4, 2011 and Season 12 started on January 5, 2012. Season 13 started on October 4, 2012. Jersey Shore: Family Vacation is an American reality television series that premiered globally, April 5, 2018 on MTV that follows seven housemates from the original Jersey Shore as they spend a month on vacation together in Miami, Florida. Season 1 started on April 5, 2018 and Season 2 started on August 23, 2018. Season 3 started on August 22, 2019.", "prediction 1": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States. The show follows the lives of eight housemates who spend their summer together at a vacation home: in Seaside Heights, New Jersey in seasons one, three, five and six, and in South Beach, Florida and Florence, Italy in seasons two and four, respectively. Season 3 returned to the original Jersey Shore summer setting, and replaced Angelina with Deena Nicole Cortese, a long-time friend of Polizzi. Season 5 began on August 23, 2018 in Europe and was scheduled to air in 2020.", "prediction 2": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States. The series follows the lives of eight housemates who spend their summer together at a vacation home. In the second and third seasons, the gang head to Las Vegas for a party and then head back to the East Coast for an extended summer stay at the Shore. In the fourth season, the gang travel to Italy for a week to meet up with a host of Italian guests. The new season of the show started on April 5, 2018. In the fifth season, the sixth season started on August 23, 2018. In the fifth and sixth season was ordered ahead of the series premiere, a second season was ordered ahead of the series premiere, which filmed in Las Vegas, Seaside Heights, Neptune City and Atlantic City. The season premiered globally on August 23, 2018 and the series premiered globally on April 5, 2018. In the seventh season", "prediction 3": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States. The show follows the lives of eight housemates who spend their summer together at a vacation home in Seaside Heights, New Jersey, in seasons one, three, five, and six, and in South Beach, Florida and Florence, Italy in seasons two and four, respectively. Season 6 started on January 6, 2011 and the new season started on January 6, 2012. Season 7 started on January 4, 2018, and the new season started on January 6, 2019. Season 8 ended on February 28, 2018, and the series ended on August 23, 2018.", "prediction 4": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States. The series follows the lives of eight housemates who spend their summer together at a vacation home in Seaside Heights, New Jersey in seasons one, three, five and six, as well as in South Beach, Florida and Florence, Italy in seasons two and four, respectively. Season 5 of the series started on August 3, 2015. Season 6 started on January 6, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 388 }, { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 531 }, { "error type": "Unverifiable", "explanation": "", "start": 532, "end": 609 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Jersey Shore is an American reality television series that ran on MTV from December 3, 2009 to December 20, 2012 in the United States. Jersey Shore: Family Vacation Jersey Shore: Family Vacation is an American reality television series that premiered on MTV globally on April 5, 2018. The series follows seven housemates from the original \"Jersey Shore\" as they spend a month living together in Miami, Florida. Season 2 started on August 23, 2018. On December 13, 2018, a third season was confirmed for 2019." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Which two plates meet along the west coast of the usa?", "passages": [ [ "San Andreas Fault", "The Elkhorn Scarp defines the fault trace along much of its length within the plain.", "The southern segment, which stretches from Parkfield in Monterey County all the way to the Salton Sea, is capable of an 8.1-magnitude earthquake.", "At its closest, this fault passes about to the northeast of Los Angeles.", "Such a large earthquake on this southern segment would kill thousands of people in Los Angeles, San Bernardino, Riverside, and surrounding areas, and cause hundreds of billions of dollars in damage.", "The Pacific Plate, to the west of the fault, is moving in a northwest direction while the North American Plate to the east is moving toward the southwest, but relatively southeast under the influence of plate tectonics.", "The rate of slippage averages about a year across California.", "The southwestward motion of the North American Plate towards the Pacific is creating compressional forces along the eastern side of the fault.", "The effect is expressed as the Coast Ranges.", "The northwest movement of the Pacific Plate is also creating significant compressional forces which are especially pronounced where the North American Plate has forced the San Andreas to jog westward.", "This has led to the formation of the Transverse Ranges in Southern California, and to a lesser but still significant extent, the Santa Cruz Mountains (the location of the Loma Prieta earthquake in 1989)." ], [ "San Andreas Fault", "San Andreas Fault\n\nThe San Andreas Fault is a continental transform fault that extends roughly through California.", "It forms the tectonic boundary between the Pacific Plate and the North American Plate, and its motion is right-lateral strike-slip (horizontal).", "The fault divides into three segments, each with different characteristics and a different degree of earthquake risk.", "The slip rate along the fault ranges from /yr.", "The fault was identified in 1895 by Professor Andrew Lawson of UC Berkeley, who discovered the northern zone.", "It is often described as having been named after San Andreas Lake, a small body of water that was formed in a valley between the two plates.", "However, according to some of his reports from 1895 and 1908, Lawson actually named it after the surrounding San Andreas Valley.", "Following the 1906 San Francisco earthquake, Lawson concluded that the fault extended all the way into southern California.", "In 1953, geologist Thomas Dibblee concluded that hundreds of miles of lateral movement could occur along the fault.", "A project called the San Andreas Fault Observatory at Depth (SAFOD) near Parkfield, Monterey County, was drilled through the fault during 2004 - 2007 to collect material and make physical and chemical observations to better understand fault behavior ." ], [ "1906 San Francisco earthquake", "1906 San Francisco earthquake\n\nThe 1906 San Francisco earthquake struck the coast of Northern California at 5:12\u00a0a.m. on Wednesday, April\u00a018 with an estimated moment magnitude of 7.9 and a maximum Mercalli intensity of XI (\"Extreme\").", "High intensity shaking was felt from Eureka on the North Coast to the Salinas Valley, an agricultural region to the south of the San Francisco Bay Area.", "Devastating fires soon broke out in the city and lasted for several days.", "Thousands of homes were dismantled.", "As a result, up to 3,000 people died and over 80% of the city of San Francisco was destroyed.", "The events are remembered as one of the worst and deadliest earthquakes in the history of the United States.", "The death toll remains the greatest loss of life from a natural disaster in California's history and high in the lists of American disasters.", "The San Andreas Fault is a continental transform fault that forms part of the tectonic boundary between the Pacific Plate and the North American Plate.", "The strike-slip fault is characterized by mainly lateral motion in a dextral sense, where the western (Pacific) plate moves northward relative to the eastern (North American) plate.", "This fault runs the length of California from the Salton Sea in the south to Cape Mendocino in the north, a distance of about ." ] ], "gold": "The Pacific Plate and the North American Plate are the two plates that meet along the West Coast of the United States. The San Andraes Fault forms the tectonic boundary between these two plates. The Pacific Plate is to the west of the San Andraes Fault, while the North American Plate is to the east of the San Andraes Fault. The San Andreas Fault is an active transform boundary; therefore, the Pacific Plate, carrying the city of Los Angeles, is moving northwards with respect to the North American Plate.", "prediction 1": "The Pacific Plate and the North American Plate meet roughly along the west coast of the United States. The San Andreas Fault is part of the tectonic boundary between the two plates. It forms the right-lateral strike-slip fault, where the western (Pacific) plate moves northward relative to the eastern (North American) plate. The San Andreas Fault runs roughly through California, and is part of the tectonic boundary between the two plates.", "prediction 2": "The San Andreas Fault is a continental transform fault that forms the tectonic boundary between the Pacific Plate and the North American Plate, and its motion is right-lateral strike-slip. The Pacific Plate, to the west of the fault, is moving in a northwest direction while the North American Plate to the east is moving towards the southwest, but relatively southeast under the influence of plate tectonics. The 1906 San Francisco earthquake struck the coast of Northern California at 5:12 a.m. on Wednesday, April 1885, and is remembered as one of the worst and deadliest earthquake in the history of the history of the history of the United States.", "prediction 3": "The San Andreas Fault is a continental transform fault that forms part of the tectonic boundary between the Pacific Plate and the North American Plate. The Pacific Plate, to the west of the fault, is moving in a northwest direction while the North American Plate to the east is moving toward the southwest, but relatively southeast under the influence of plate tectonics. The 1906 San Francisco earthquake struck the coast of Northern California at 5:12 a.m. on Wednesday, April 18 with an estimated moment magnitude of 7.9 and a maximum Mercalli intensity of XI (\"Extreme\").", "prediction 4": "The San Andreas Fault is a continental transform fault that forms the tectonic boundary between the Pacific Plate and the North American Plate. The western plate of the two plates, known as the Pacific Plate, moves northward relative to the eastern plate, known as the North American Plate.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 325 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Pacific Plate and the North American Plate meet roughly along the west coast of the United States. The San Andreas Fault is part of the tectonic boundary between the two plates. The Pacific Plate, to the west of the fault, is moving in a northwest direction while the North American Plate to the east is moving toward the southwest, but relatively southeast under the influence of plate tectonics." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the most medals in the olympics?", "passages": [ [ "2018 Winter Olympics medal table", "Going in, Canada held the record for most gold medals won at a single Winter Olympics with 14, which it won in Vancouver in 2010.", "This mark was equalled by both Norway and Germany at these Olympics.", "Norway set the record for most total medals at a single Winter Olympics with 39, surpassing the 37 medals of the United States won at the 2010 Winter Olympics.", "The mark of 30 NOCs winning medals is the highest for any Winter Olympic Games.", "Hungary won its first Winter Olympic gold medal ever.", "Norwegian cross-country skier Marit Bj\u00f8rgen (two gold, one silver, and two bronze) achieved five medals, more than any other athlete.", "With 15 medals, she became the most decorated athlete in Winter Olympics history.", "Swedish cross-country skier Charlotte Kalla finished with four medals (one gold, three silver), as did her compatriot and fellow cross-country skier Stina Nilsson (one gold, two silvers, one bronze) and Russian cross-country skier Alexander Bolshunov (three silver, one bronze) who was competing for the Olympic Athletes from Russia at the 2018 Olympics.", "Norwegian cross-country skier Johannes H\u00f8sflot Kl\u00e6bo and French biathlete Martin Fourcade tied for the most gold medals, with three each." ], [ "Michael Phelps", "Michael Phelps\n\nMichael Fred Phelps II (born June 30, 1985) is an American retired competitive swimmer and the most successful and most decorated Olympian of all time, with a total of 28 medals.", "Phelps also holds the all-time records for Olympic gold medals (23), Olympic gold medals in individual events (13), and Olympic medals in individual events (16).", "When he won eight gold medals at the 2008 Beijing Games, Phelps broke fellow American swimmer Mark Spitz's 1972 record of seven first-place finishes at any single Olympic Games.", "At the 2004 Summer Olympics in Athens, Phelps had already tied the record of eight medals of any color at a single Games by winning six gold and two bronze medals.", "At the 2012 Summer Olympics in London, Phelps won four gold and two silver medals, and at the 2016 Summer Olympics in Rio de Janeiro, he won five gold medals and one silver.", "This made him the most successful athlete of the Games for the fourth Olympics in a row.", "Phelps is the long course world record holder in the men's 100 meter butterfly, 200 meter butterfly, and 400 meter individual medley as well as the former long course world record holder in the 200 meter freestyle and 200 meter individual medley." ], [ "Marit Bj\u00f8rgen", "Bj\u00f8rgen won gold at the 2014 Winter Olympics in Sochi in the 15 km skiathlon, the Team sprint and the 30km freestyle race.", "These three Olympic medals brought her total up to ten, equaling the record for most Winter Olympic medals held by a woman, already achieved by Stefania Belmondo and Raisa Smetanina; but of the three record holders at the time, Bj\u00f8rgen had the most golds.", "Bj\u00f8rgen is a five-time Olympian, having competed in every Winter Olympics since Salt Lake City in 2002 where she won her first silver medal.", "At the 2018 Winter Olympics in Pyeongchang she won her 11th\u201315th Olympic medals, the highest number of medals won by any athlete in Winter Olympics history.", "Bj\u00f8rgen won the women's 30\u00a0km event at the Holmenkollen ski festival in 2005.", "She won the same event five years later in 2010.", "This was the first World Cup event to be held at Holmenkollen since the completion of the new ski jumping hill.", "For her win in both the 30\u00a0km and the sprint event, along with her successes at the 2010 Games in Vancouver, Bj\u00f8rgen was awarded the Holmenkollen medal.", "On 11 March 2018, Bj\u00f8rgen won a record seventh 30 km in Holmenkollen." ] ], "gold": "Michael Phelps is an American former competitive swimmer. He is the most successful and most decorated Olympian of all time with a total of 28 medals. Phelps also holds the all-time records for Olympic gold medals with 23, Olympic gold medals in individual events with 13 and Olympic medals in individual events with 16. Phelps won the most medals of any athlete in the Summer Olympic games in 2004, 2008, 2012 and 2016. In the Winter Olympics, Marit Bj\u00f8rgen is a is a Norwegian cross-country skier. A five-time Olympian, her five Olympic medals at the 2018 Pyeongchang Games brought her total number of medals up to a record 15, the most by any athlete in Winter Olympics history. American athletes have won a total of 2,673 medals, 1,075 of them gold, at the Summer Olympic Games and another 307, 105 of them gold, at the Winter Olympic Games, making the United States the most prolific medal-winning nation in the history of the Olympics. Additionally, the United States has won the most medals of any nation in Summer Olympics history. At the Winter Olympic Games, Norway has won 368 total medals including 132 gold medals, more than any other nation in Winter Olympics history. More than half of Norway's medals have come from cross-country skiing and speed skating. ", "prediction 1": "In the 2018 Winter Olympics, Norwegian cross-country skier Marit Bjrgen won the most medals, with five, more than any other athlete. At the 2014 Winter Olympics in Sochi she won gold in the 15 km skiathlon, the Team sprint and the 30 km freestyle race. At the 2008 Summer Olympics in Athens, Michael Phelps won the most gold medals, with eight, and at the 2012 Summer Olympics in London he won four gold and two silver medals. In the 2010 Winter Olympics in Vancouver, Canada held the record for most total medals won at a single Winter Olympics with 14.", "prediction 2": "At the 2018 Winter Olympics, Norwegian cross-country skier Marit Bjrgen won the most medals, with five, and was followed by Swiss cross-country skier Stina Nilsson with one gold, two silvers, and two bronzes. At the 2014 Winter Olympics in Sochi, Bjrgen won the most medals, with two gold, one silver, and two bronze. At the 2016 Summer Olympics in Rio de Janeiro, Russian cross-country skier Alexander Bolshunov won the most medals, with 16 total of the most medals won by any athlete in Olympic Games.", "prediction 3": "The most Olympic medals won by a country in a single olympic year are gold, silver, and bronze. In 2018, Norway won the most total medals with 39, while Norway won the most total medals with 35. Norwegian cross-country skier Marit Bjrgen won the most Olympic golds with five, making her the most decorated Olympian in Winter Olympics history. Swedish cross-country skier Charlotte Kalla won the most Olympic medals in 2018, with four, and Russian cross-country skier Alexander Bolshunov finished with three silver, and one bronze.", "prediction 4": "The athlete with the most Olympic medals is Michael Phelps, who has won a total of 28 medals. Marit Bjrgen has won the most Olympic medals in the women's cross-country ski event at the 2018 Winter Olympics. Norwegian cross-country skier Johannes Hsflot Klbo and French biathlete Martin Fourcade tied for the most Olympic gold medals in the individual events at the 2018 Winter Olympics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 252 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 260, "end": 264 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 338, "end": 344 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 426 }, { "error type": "Irrelevant", "explanation": "", "start": 455, "end": 468 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 501, "end": 506 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 4, 5, 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the 2018 Winter Olympics, Norwegian cross-country skier Marit Bjrgen won the most medals, with five, more than any other athlete in Winter Olympics history. Michael Fred Phelps II is an American retired competitive swimmer and the most successful and most decorated Olympian of all time, with a total of 28 medals. He holds the all-time records for Olympic gold medals (23), Olympic gold medals in individual events (13), and Olympic medals in individual events (16). He was the most successful Olympian at the 2004, 2008, 2012, and 2016 Olympic games. In the 2010 Winter Olympics, Canada held the record for most gold medals won at a single Winter Olympics with 14. Norway set the record for most total medals at a single Winter Olympics with 39" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who organized the native resistance to the british?", "passages": [ [ "Racism in Australia", "The British navigator James Cook claimed the east coast of Australia for Britain in 1770, without conducting negotiations with the existing inhabitants.", "The first Governor of New South Wales, Arthur Phillip, was expressly instructed to establish friendship and good relations with the Aborigines and interactions between the early settlers and the indigenous people varied considerably throughout the colonial period \u2014 from the mutual curiosity displayed by the early interlocutors Bennelong and Bungaree of Sydney, to outright hostility of Pemulwuy and Windradyne of the Sydney region, and Yagan around Perth.", "Bennelong and a companion became the first Australians to sail to Europe, where they met King George III.", "Bungaree accompanied the explorer Matthew Flinders on the first circumnavigation of Australia.", "Pemulwuy was accused of the first killing of a white settler in 1790, and Windradyne resisted early British expansion beyond the Blue Mountains.", "With the establishment of European settlement and its subsequent expansion, the indigenous populations were progressively forced into neighbouring territories, or subsumed into the new political entities of the Australian colonies.", "Violent conflict between Indigenous peoples and European settlers, described by some historians as frontier wars, arose out of this expansion: by the late 19th century, many indigenous populations had been forcibly relocated to land reserves and missions." ], [ "Jandamarra", "Jandamarra\n\nJandamarra or Tjandamurra (c. 1873\u20141 April 1897), known to European settlers as Pigeon, was an Indigenous Australian of the Bunuba tribe who led one of many organised armed insurrections against European colonisation of Australia\nThe Bunuba land was positioned in the southern part of the Kimberley region in the far north of the state of Western Australia, and stretched from the town of Fitzroy Crossing to the King Leopold Ranges; it included the Napier and Oscar Ranges.", "From about the age of 11, Jandamarra was working for the settlers as a slave.", "In his teens, he was initiated into the law of the Bunuba.", "When Jandamarra's close friend, an Englishman named Richardson, joined the police force in the 1890s, Jandamarra, a skilled horseman and marksman, was employed as his native tracker.", "Unusually for the time, Jandamarra was treated as an equal and the pair gained a reputation as the \"most outstanding\" team in the police force at that time.", "Aboriginal people were spearing stock, an effective form of resistance against the settlers.", "Jandamarra was ordered to track down his own people.", "The captives, among them his uncle, chief Ellemarra, were taken to Lillimooloora Station." ], [ "Pontiac's War", "Pontiac's War\n\nPontiac's War (also known as Pontiac's Conspiracy or Pontiac's Rebellion) was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatisfied with British postwar policies in the Great Lakes region after the British victory in the French and Indian War (1754\u20131763).", "Warriors from numerous tribes joined the uprising in an effort to drive British soldiers and settlers out of the region.", "The war is named after the Odawa leader Pontiac, the most prominent of many native leaders in the conflict.", "The war began in May 1763 when Native Americans, offended by the policies of British General Jeffrey Amherst, attacked a number of British forts and settlements.", "Eight forts were destroyed, and hundreds of colonists were killed or captured, with many more fleeing the region.", "Hostilities came to an end after British Army expeditions in 1764 led to peace negotiations over the next two years.", "Native Americans were unable to drive away the British, but the uprising prompted the British government to modify the policies that had provoked the conflict.", "Warfare on the North American frontier was brutal, and the killing of prisoners, the targeting of civilians, and other atrocities were widespread.", "The ruthlessness and treachery of the conflict was a reflection of a growing divide between the separate populations of the British colonists and Native Americans." ] ], "gold": "There were several Native resistances to the British. In 1797 in Australia, Pemulwuy was an indigenous Australian who resisted the European colonization of Australia. From 1894-1897, Jandamarra was the first Indigenous Australian to use firearms and conduct organized warfare in battle against settlers and lead a war against Euro-Australian settlers for three years, from 1894 to 1897. In the Great Lakes region, Pontiac's War was launched in 1763 by a loose confederation of American Indians dissatisfied with British rule in the Great Lakes region following the French and Indian War. The Native resistance was organized by Pontiac and Guyasuta.", "prediction 1": "The Pontiac's War or Pontiac's Rebellion was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatisfied with British postwar policies in the Great Lakes region after the British victory in the French and Indian War (1754\u20131763). In the 1890s, Jandamarra, an Indigenous Australian of the Bunuba tribe, led one of many organised armed insurrections against the British. In the early coloniation, the early resistance to the British was organized by a loose confederation of elements of British, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatis with British postwar policies in the Great Lakes region after the British victory in the French and Indian War. Two hundred or tribes joined the", "prediction 2": "There were many Native Australian armed resistances to the British in Australia. The first was the Pontiac's War, a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, which was launched in May 1763 by a loose confederation of elements of the Bunuba tribe. There was also the Pontiac's Conspiracy and the Pontiac's Rebellion that was launched in 1764 by a loose confederation of elements of Native Americans, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, who were dissatis with British postwar policies in the Great Lakes region, and Ohio Country. Native Americans were spearing stock, which was an effective form of resistance against the settlers. Jandamarra was known to European settlers as Pigeon, known to European settlers as", "prediction 3": "The Australian indigenous resistance to the British was called the Pontiac's Rebellion, which was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, and was led by Jandamarra. The war was mainly led by warriors from numerous tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatisfied with British postwar policies in the Great Lakes region. The Pontiac's Conspiracy or Pontiac's Rebellion was led by a close friend, an Englishman named Richardson.", "prediction 4": "There were several indigenous resistance movements to the British. The Pontiac's War, also known as Pontiac's Conspiracy or Pontiac's Rebellion, was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, who were dissatisfied with British postwar policies in the Great Lakes region after the British victory in the French and Indian War. The uprising was organised by elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, the United States, and Ohio Country, the Great Lakes region. A loose confederation of elements of Native Americans, primarily from the Great Lakes region, the Illinois Country, and Ohio Country, were dissatis with British postwar policies.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Pontiac's War or Pontiac's Rebellion was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatisfied with British postwar policies in the Great Lakes region after the British victory in the French and Indian War (1754\u20131763). ", "start": 489, "end": 821 }, { "error type": "Irrelevant", "explanation": "", "start": 822, "end": 854 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "In 1790 Pemulwuy and Windradyne resisted early British expansion beyond the Blue Mountains. The Pontiac's War or Pontiac's Rebellion was launched in 1763 by a loose confederation of elements of Native American tribes, primarily from the Great Lakes region, the Illinois Country, and Ohio Country who were dissatisfied with British postwar policies in the Great Lakes region after the British victory in the French and Indian War (1754\u20131763). In the 1890s, Jandamarra, an Indigenous Australian of the Bunuba tribe, led one of many organised armed insurrections against the British. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who sings i just want to use your love?", "passages": [ [ "Sweet Kisses", "\"Betcha She Don't Love You\" is an uptempo pop-rock track, which also features influences of Hip-Hop and R&B. The songs lyrics see Simpson trying to convince a boy that she could love him more than his current girlfriend, as Simpson feels that nobody could love him the way she does.", "'My Wonderful' is a love ballad, which is moderately paced through the verses, while slow at the chorus.", "The song speaks of Simpson talking about how much she loves her boyfriend, and how he must have been \"sent from above just for [her].\"", "\"Sweet Kisses\", the album's title track, is a love ballad similar to the previous song.", "The song features an acoustic guitar playing over a soft R&B inspired beat.", "The song lyrically deals with how Simpson loves her boyfriend's \"sweet kisses\", and how he does not even need to say he loves her, because his kisses \"move her.\"", "\"Your Faith In Me\" is another pop ballad, which plays with many instruments such as a violin and piano.", "Lyrically, the song sees Simpson stating she doesn't need love, but she just needs her lover's \"faith in her\"." ], [ "Ur So Gay (EP)", "Ur So Gay (EP)\n\n", "Ur So Gay is the debut extended play (EP) by American singer Katy Perry.", "It was released digitally on November 20, 2007 by Capitol Records.", "A physical edition of the EP was released on January 15, 2008.", "The EP contains four tracks: the title track \"Ur So Gay\", a remix of the title track by American DJ Junior Sanchez, \"Use Your Love\" (a remake of The Outfield's 1986 song \"Your Love\"), and \"Lost\".", "\"Ur So Gay\" and \"Lost\" would later appear on Perry's second studio album, \"One of the Boys\" (2008).", "According to Perry, she had a couple of different choices in mind for covers.", "She initially wanted to record a Queen song, but could not think of one that was particularly club-worthy.", "While at a club with her friends, The Outfield's song \"Your Love\" was played.", "Perry said that when the song came on, every girl there went onto the dance floor and had \"the best time\", which is something that she wanted to capture on the EP.", "The EP was not expected to be a huge seller and only \"a few thousand\" copies were sold." ] ], "gold": "Your Love is a 1986 song by the English rock band The Outfield. This song is an up-tempo new wave, power pop and pop rock song sung by lead vocalist Tony Lewis. The song's lyrics are vague but imply that the narrator is interested in an older girl with whom he isn't in a relationship. The narrator asks the older girl to let him use her love; or have a one night stand with him, while his current girlfriend, Josie, is on vacation. In the end, the older girl declines because she wants him to be faithful to Josie. Additionally, Ur So Gay, the first extended play by American singer Katy Perry, includes the song Use Your Love, a remake of The Outfield's 1986 song. Perry's remake, Use Your Love, was released digitally on November 20, 2007.", "prediction 1": "American singer Katy Perry sang \"I Just Want to Use Your Love\", a cover of The Outfield's 1986 song Your Love.", "prediction 2": "\"Ur So Gay\" is the debut extended play (EP) by American singer Katy Perry. The EP contains 4 tracks: the title track, a remix of the title track by American DJ Junior Sanchez, \"Use Your Love\" (a remake of The Outfield's 1986 song \"Your Love\"), and \"Lost\".", "prediction 3": "The Outfield sang \"I just want to use your love\" in 1986, while Katy Perry sang \"I Just Want To Use Your Love\" in 1986.", "prediction 4": "American singer Katy Perry sings the song i just want to use your love in her debut extended play. The song is a remake of The Outfield's 1986 song, Your Love. American singer Junior Sanchez sings the song.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "American singer Katy Perry sang \"I Just Want to Use Your Love\", a cover of The Outfield's 1986 song Your Love. It was released digitally on November 20, 2007 by Capitol Records." }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "In the united states the most common form of child mistreatment involves?", "passages": [ [ "Child neglect", "Child neglect is one of the most common forms of child maltreatment, and it continues to be a serious problem for many children.", "Child neglect tremendously affects the physical development, mental development, and emotional development of a child causing long term consequences, such as poor academic achievement, depression (mood), and personality disorders.", "These consequences also impact society, since it is more likely that children who suffered from child neglect will have drug abuse problems and educational failure when they grow up.", "There are various types of child neglect.", "Child neglect can also be described by degrees of severity and the responses considered warranted by communities and government agencies.", "Children may be left at home alone, which can result in negative consequences.", "Being left at home alone can leave young people feeling scared, vulnerable and not knowing when their parents are going to return.", "The frequency and duration of being left at home alone may range from every evening, to several days or even weeks at a time.", "Also, young children may not be provided with a suitable amount of decent food to eat, which is another form of neglect.", "Children have reported being provided with moldy food, or not having any food in the house, or they were given an insufficient amount of food.", "The causes of child neglect are complex and can be attributed to three different levels: an intrapersonal, an inter-personal/family, and a social/economic level." ] ], "gold": "Child neglect is one of the most common forms of child maltreatment, and it continues to be a serious problem for many children. Child neglect tremendously affects the physical development, mental development, and emotional development of a child causing long term consequences, such as poor academic achievement, depression (mood), and personality disorders. Most specifically, child mistreatment involves physical neglect, medical neglect, emotional neglect and educational/developmental neglect.", "prediction 1": "Child neglect in the United States is one of the most common forms of child maltreatment, and continues to be a serious problem for many children. Children may be left at home alone, which can result in negative consequences. Also, young children may not be provided with a suitable amount of decent food to eat, which is another form of neglect.", "prediction 2": "Child neglect is one of the most common forms of child maltreatment, and it continues to be a serious problem for many children. Child neglect tremendously affects the physical development, mental development, and emotional development of a child causing long term consequences, such as poor academic achievement, depression (mood), and personality disorders. Also, young children may not be provided with a suitable amount of decent food to eat, which is another form of child neglect.", "prediction 3": "In the United States the most common form of child maltreatment involves leaving children at home alone. Also, children may not be provided with a suitable amount of decent food to eat, which is another form of neglect. Children have reported being provided with moldy food, or not having any food in the house, or they were given an insufficient amount of food.", "prediction 4": "Child neglect is one of the most common forms of child maltreatment, and it continues to be a serious problem for many children. In the United States the most common form of child maltreatment involves leaving a child at home alone, or not being provided with a suitable amount of decent food to eat.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 225 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 346 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Child neglect in the United States is one of the most common forms of child maltreatment, and continues to be a serious problem for many children. Child neglect tremendously affects the physical development, mental development, and emotional development of a child causing long term consequences, such as poor academic achievement, depression (mood), and personality disorders. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is the upper most layer of soil?", "passages": [ [ "Topsoil", "Topsoil\n\nTopsoil is the upper, outermost layer of soil, usually the top to .", "It has the highest concentration of organic matter and microorganisms and is where most of the Earth's biological soil activity occurs.", "Topsoil is composed of mineral particles, organic matter, water, and air.", "Organic matter varies in quantity on different soils.", "The strength of soil structure decreases with the presence of organic matter, creating weak bearing capacities.", "Organic matter condenses and settles in different ways under certain conditions, such as roadbeds and foundations.", "The structure becomes affected once the soil is dewatered.", "The soil's volume substantially decreases.", "It decomposes and suffers wind erosion.", "Plants generally concentrate their roots in and obtain most of their vital nutrients from this layer.", "Actual depth of the topsoil layer can be measured as the depth from the surface to the first densely packed soil layer known as subsoil.", "In soil classification systems, topsoil is known as the \"O Horizon or A Horizon,\" therefore, it is the very top layer.", "Commercially available topsoil (manufactured or naturally occurring) in the United Kingdom should be classified to British Standard BS 3882 with the current version dated 2015." ], [ "Topsoil", "To calculate the amount of topsoil you will need, \"simply take your length (in feet) multiplied by your width (in feet) multiplied by your depth (in feet", "so if you wanted 5 inches that would be 5/12) then divide the total by 27.", "This will give you your cubic yards needed for the project.", "Ex: 10L x 10W x (5/12) = 41.66/27 = 1.54 cubic yards of topsoil needed.", "\"." ] ], "gold": "Topsoil is the upper, outermost layer of soil, usually the top 5 to 10 inches. In soil classification systems, topsoil is known as the O Horizon or A Horizon; therefore, it is the very top layer. Topsoil has the highest concentration of organic matter and microorganisms and is where most of the Earth's biological soil activity occurs. Topsoil is composed of mineral particles, organic matter, water, and air. ", "prediction 1": "Topsoil is the upper, outermost layer of soil, usually the top to. Topsoil has the highest concentration of organic matter and microorganisms and is where most of the Earth's biological soil activity occurs.", "prediction 2": "The top layer of soil is the outermost layer of the soil. In soil classification systems, topsoil is known as the \"O Horizon or A Horizon,\" therefore, it is the very top layer.", "prediction 3": "The topmost layer of soil is the topsoil. In soil classification systems, topsoil is known as the \"O Horizon or A Horizon,\" therefore, it is the very top layer.", "prediction 4": "Topsoil is the upper, outermost layer of soil, usually the top to. It has the highest concentration of organic matter and microorganisms and is where most of the Earth's biological soil activity occurs. Topsoil is the topmost layer of soil in the United Kingdom.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Topsoil is the upper, outermost layer of soil, usually the top to. In soil classification systems, topsoil is known as the \"O Horizon or A Horizon,\" therefore, it is the very top layer. Topsoil has the highest concentration of organic matter and microorganisms and is where most of the Earth's biological soil activity occurs. Topsoil is composed of mineral particles, organic matter, water, and air." }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "Who got the most followers on instagram in the world?", "passages": [ [ "Cristiano Ronaldo", "He topped the list for the second straight year with earnings of $93\u00a0million in 2016\u201317.", "Ronaldo is one of the world's most marketable athletes: \"SportsPro\" rated him the fifth most marketable athlete in 2012, and eighth most marketable athlete in 2013, with Brazilian footballer Neymar topping both lists.", "Sports market research company Repucom named Ronaldo the most marketable and most recognised football player in the world in May 2014.", "He was additionally named in the 2014 Time 100, \"Time\"s annual list of the most influential people in the world.", "ESPN named Ronaldo the world's most famous athlete in 2016, 2017 and 2018.", "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158\u00a0million total followers across Facebook, Twitter and Instagram by June 2015.", ", he has the world's biggest Facebook fanbase with 103\u00a0million followers: he became the first sportsperson to reach 50\u00a0million followers in August 2010, and in October 2014, he became the first sportsperson, and the second person after Shakira, to reach 100\u00a0million followers.", "By June 2017, Ronaldo had 277\u00a0million followers across social media.", "His sponsors earned $936\u00a0million in media value across his social media accounts between June 2016 to June 2017." ], [ "Celebrity branding", "Companies can simply tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click.", "The culture of advertising on Instagram came naturally when businesses realized that celebrities have a direct means of communication to their target demographic.", "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers.", "By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people.", "Many of America's top-earning celebrities Instagram accounts are continually promoting products such as health supplements, vitamins and detox teas.", "These aren't spontaneous proclamations, but rather posts paid for by brands to advertise products to the celebrities' sizable following.", "On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram.", "At the top end of the digital celebrity pay scale some posts can earn around $300,000, especially when Instagram pictures can be easily linked to other social media platforms such as Facebook or Twitter.", "One of the celebrities that is most well known for promoting brands on her Instagram page is Kim Kardashian." ] ], "gold": "Currently, the account with the overall most followers on Instagram is @instagram, the brand's own account, with over 424 million followers. The individual person with the most followers is Portuguese footballer Cristiano Ronaldo, with over 347 million.", "prediction 1": "The most-followed person on Instagram in the world is footballer Cristiano Ronaldo, with a total of 277 million followers as of June 2017.", "prediction 2": "The person with the most followers on Instagram in the world is Brazilian footballer Neymar. The person with the most followers on Instagram in the world is footballer Cristiano Ronaldo.", "prediction 3": "Instagram is a photo and video platform that allows users to share photos and videos with their friends and followers on the social network. In 2017, the person with the most followers on Instagram was Cristiano Ronaldo. Cristiano Ronaldo got the most followers on Instagram in the world in 2016. Kim Kardashian got the most followers in 2017.", "prediction 4": "Instagram is a photo and video-sharing social platform. Its users can tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click. In 2018, the person who got the most followers on Instagram was Brazilian footballer Neymar. In 2015, the person who got the most Instagram followers was American footballer Cristiano Ronaldo.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 138 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158 million total followers across Facebook, Twitter and Instagram by June 2015." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "What happened to doc in the cars 2 movie?", "passages": [ [ "Doc Hudson", "Pixar decided having Doc appear in \"Cars 2\" would not be a good idea.", "A conversation between McQueen and Mater indicates that Doc died before the second film.", "Doc's memory lives on, as the Piston Cup was renamed after him.", "During the Japan leg of the World Grand Prix, one of the commentators notes that Doc was one of the best dirt-track racers of all time.", "Herb Thomas' 1952 Fabulous Hudson Hornet is currently displayed in the Ypsilanti Automotive Heritage Museum in Michigan; Tim Flock's car is in the Memory Lane Museum in Mooresville, North Carolina.", "Herb Thomas entered NASCAR's hall of fame for 2013 as the first to win two NASCAR premier series championships (1951 and 1953)." ], [ "Cars 2", "Cars 2\n\nCars 2 is a 2011 American computer-animated action-adventure comedy film produced by Pixar Animation Studios for Walt Disney Pictures.", "It is the sequel to 2006's \"Cars\", and features the voices of Owen Wilson, Larry the Cable Guy, Michael Caine, Emily Mortimer, John Turturro, and Eddie Izzard.", "In the film, race car Lightning McQueen and tow truck Mater head to Japan and Europe to compete in the World Grand Prix, but Mater becomes sidetracked with international espionage.", "The film was directed by John Lasseter, written by Ben Queen, and produced by Denise Ream.", "With Lasseter's exit from Pixar in 2018, it marks the final film directed by him.", "\"Cars 2\" was released in the United States on June 24, 2011.", "The film was presented in Disney Digital 3D and IMAX 3D, as well as traditional two-dimensional and IMAX formats.", "The film was first announced in 2008, alongside \"Up\", and \"Brave\", and it is the 12th animated film from the studio.", "It received mixed reviews from critics and grossed $562 million worldwide.", "A sequel, \"Cars 3\", was released on June 16, 2017.", "Finn McMissile, a British spy, infiltrates the world's largest untapped oil reserves owned by a group of lemon cars." ] ], "gold": "Cars 2 is a 2011 American 3D computer animated comedy film and is a sequel to the 2006 Cars movie and the second film in the Cars franchise. The character Doc Hudson does not appear in Cars 2 because his voice actor, Paul Newman, died from lung cancer in 2008. Information included in the Cars 2 narrative was that Doc died before the events of the film, Piston Cup was renamed in his honor, and his clinic being converted into a museum.", "prediction 1": "In the 2011 American computer-animated action comedy film Cars 2, Doc Hudson is a character who is played by Owen Wilson. Lightning McQueen and Mater are involved in a race to win the World Grand Prix, but Mater gets sidetracked with international espionage.", "prediction 2": "The 2011 American computer-animated action comedy film Cars 2 is the sequel to 2006's Cars. Doc Hudson is portrayed as an engineer in the film and later in the sequel, Doc Hudson is killed off by Lightning McQueen.", "prediction 3": "Doc Hudson appeared in the 2011 American computer-animated action comedy film Cars 2. However, during the film's final scene, Lightning McQueen and tow truck Mater speak about Doc's death before the film.", "prediction 4": "Doc Hudson is a character in the 2011 American computer-animated action comedy film Cars 2, which is the sequel to the 2006 Cars film. A conversation between Lightning McQueen and Mater indicates that Doc died before the second film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 258 }, { "error type": "Unverifiable", "explanation": "", "start": 66, "end": 121 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Cars 2 is a 2011 American 3D computer animated comedy film and is a sequel to the 2006 Cars movie and the second film in the Cars franchise. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where does sniper ghost warrior 3 take place?", "passages": [ [ "Sniper: Ghost Warrior 3", "Sniper: Ghost Warrior 3\n\nSniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One, and was released worldwide on 25 April 2017.", "It is also the first game in the series to feature an open world environment.", "The player takes the role of Marine Captain Jonathan \"Jon\" North, who, along with his brother Robert, is sent to the Russian-Ukrainian border to destroy an abandoned stockpile of Soviet-era bio-weapons before they're stolen by terrorists.", "The two succeed in their mission, but are ambushed by an unidentified group of special forces soldiers, led by a man named Vasilisk who plays a game of Russian roulette with Jon before knocking him out and capturing Robert.", "Two years later, Jon is sent to Georgia to help destabilize the local Georgian Separatist cells, who are reported to be receiving an abnormally high level of funding and resources.", "Jon accepted the assignment with the hidden agenda of locating his brother Robert, after hearing intelligence chatter placing him in the region." ], [ "Sniper: Ghost Warrior 3", "He is assisted by his JSOC handler Frank Simms, a Georgian Loyalist ex-special forces sniper named Lydia with whom he was formerly in a romantic relationship, and Israeli Mossad agent Raquel, who is in the region looking to capture and recruit a Russian scientist named Sergei Flostov whom she believes is being held by the Separatists.", "The Separatists are led by a pair of twins, Davit and Tomas, and a woman named Inna, whom Tomas is scheduled to marry.", "Jon infiltrates the wedding in hopes of gathering intel to help him assassinate Tomas later, but the wedding is interrupted when Tomas' bodyguard guns him down at the altar before being killed himself by an unseen sniper.", "Continuing other missions against the Separatists, Jon learns that events in Georgia are being manipulated by an international conspiracy known as the 23 Society, whose forces are equipped with high-tech experimental weaponry and led by a mysterious soldier with seemingly superhuman abilities known as Armazi.", "In the process of destabilizing the Separatists, Jon is sent to kill a local crime lord doing business with the Separatists, who turns out to be Vasilisk, who is revealed as a member of the 23 Society." ] ], "gold": "Sniper Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One, and was released worldwide on 25 April 2017. The player takes the role of U.S. Marine Captain Jonathan \"Jon\" North, who, along with his brother Robert, is sent to the Russian-Ukrainian border to destroy an abandoned stockpile of Soviet-era bio-weapons before they can be stolen by terrorists. Two years later, Jon is sent to Georgia to help destabilize the local Georgian separatist cells, who are reported to be receiving an abnormally high level of funding and resources.", "prediction 1": "Sniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One, and was released worldwide on 25 April 2017. The game takes place in the Russian-Ukrainian border, where Jon North is sent with his brother Robert to destroy an abandoned stockpile of Soviet-era bio-weapons before they're stolen by terrorists. Two years later, Jon is sent to Georgia to help destabilize the local Georgian Separatist cells, who are reported to be receiving an abnormally high level of funding and resources.", "prediction 2": "Sniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games and was released worldwide on 25 April 2017. The game takes place in the fictional Georgian republic of Georgia, an area controlled by the separatists. It is also the first game in the series to feature an open world environment.", "prediction 3": "Sniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One that is set in the Russian-Ukrainian border and was released worldwide on 25 April 2017. It is also the first game in the series to feature an open world environment. The game takes place in Georgia and is set in the fictional Republic of Georgia.", "prediction 4": "Sniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One, and was released worldwide on 25 April 2017. The player takes the role of Marine Captain Jonathan \"Jon\" North, who, along with his brother Robert, is sent to the Russian-Ukrainian border to destroy an abandoned stockpile of Soviet-era bio-weapons before they're stolen by terrorists. Two years later, Jon is sent to Georgia to help destabilize the local Georgian Separatist cells, who are reported to be receiving an abnormally high level of funding and resources.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Sniper: Ghost Warrior 3 is a tactical shooter video game developed and published by CI Games for Microsoft Windows, PlayStation 4 and Xbox One, and was released worldwide on 25 April 2017. The player takes the role of Marine Captain Jonathan \"Jon\" North, who, along with his brother Robert, is sent to the Russian-Ukrainian border to destroy an abandoned stockpile of Soviet-era bio-weapons before they're stolen by terrorists. Two years later, Jon is sent to Georgia to help destabilize the local Georgian Separatist cells, who are reported to be receiving an abnormally high level of funding and resources. =" }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "When did you lost that loving feeling come out?", "passages": [ [ "You've Lost That Lovin' Feelin'", "Black remade \"You've Lost That Lovin' Feelin'\" for her 1985 \"Surprisingly Cilla\" album.", "In 1969, American singer Dionne Warwick recorded a cover version of \"You've Lost That Lovin' Feeling\" for her studio album \"Soulful\".", "Her version was the only single released from the album and it was aimed to showcase Warwick as more of an R&B singer than was evidenced by her work with Burt Bacharach.", "Co-produced by Warwick and Chips Moman and recorded at American Sound Studios in Memphis, Tennessee, \"Soulful\" was one of Warwick's most successful albums peaking at number 11 on the Billboard 200 album chart.", "The single \"You've Lost That Lovin' Feeling\" reached number 16 on the \"Billboard\" Hot 100 chart, and charted at number 13 on the \"Billboard\" R&B singles chart.", "In Australia the \"Go-Set\" Top 40 chart ranked Warwick's version of \"You've Lost That Lovin' Feeling\" with a number 34 peak in January 1970.", "In Warwick's version of the song, she spells the last word of the title out fully as \"feeling\" rather than the usual \"feelin." ], [ "You've Lost That Lovin' Feelin'", "You've Lost That Lovin' Feelin'\n\n\"You've Lost That Lovin' Feelin'\" is a song written by Phil Spector, Barry Mann, and Cynthia Weil.", "It was first recorded by the Righteous Brothers in 1964, produced by Phil Spector.", "Their recording is considered by some music critics to be the ultimate expression and illustration of Spector's \"Wall of Sound\" recording technique.", "It has also been described by various music writers as \"one of the best records ever made\" and \"the ultimate pop record\".", "The original Righteous Brothers version was a critical and commercial success on its release, becoming a number-one hit single in both the United States and the United Kingdom in February 1965.", "It was the fifth best selling song of 1965 in the US.", "It also entered the Top 10 in the UK chart on an unprecedented three separate occasions.", "\"You've Lost That Lovin' Feelin'\" has been covered successfully by numerous artists.", "In 1965, Cilla Black's recording reached number two in the UK Singles Chart.", "Dionne Warwick took her version to number 16 on the \"Billboard\" Hot 100 chart in 1969.", "A 1971 duet version by singers Roberta Flack and Donny Hathaway peaked at number 30 on the \"Billboard\" R&B singles chart." ], [ "(There's) Always Something There to Remind Me", "(There's)", "Always Something There to Remind Me\n\n\"(There's)", "Always Something There to Remind Me\" is a song written in the 1960s by songwriting team Burt Bacharach and Hal David.", "The lyrics are from the point of view of a man who has just broken up with his lover.", "He would prefer to forget about her, but everywhere he goes there is always something there to remind him.", "Originally recorded as a demo by Dionne Warwick in 1963, \"(There's)", "Always Something There to Remind Me\" first charted for Lou Johnson whose version reached No. 49 on the \"Billboard\" Hot 100 in the summer of 1964.", "British impresario Eve Taylor heard Johnson's version while on a US visit scouting for material for her recent discovery Sandie Shaw, who consequently covered the song for the UK market.", "Rush-released in September 1964, the song was premiered by Shaw with a performance on \"Ready Steady Go!", "\", the pop music TV program.", "The first week after its release, the single sold 65,000 copies.", "Shaw's version reached No. 1 on the UK Singles Chart, spending three weeks at the top of that lisiting in November 1964, and that same month it debuted on the \"Billboard\" Hot 100." ] ], "gold": "The Righteous Brothers recorded \"You've Lost That Lovin' Feelin'\" in November 1964. It was written by Phil Spector, Barry Mann and Cynthia Weil. Phil Spector also produced the song. The song is cited by some music critics as the ultimate expression and illustration of his Wall of Sound recording technique. Dionne Warwick recorded a cover version of \"You've Lost That Lovin' Feeling\" for her studio album Soulful September 1969. She spells the last word of the title out fully as \"feeling\" rather than the usual \"feelin'\".", "prediction 1": "You've Lost That Lovin' Feelin' is a song written by Phil Spector, Barry Mann, and Cynthia Weil. It was first recorded by the Righteous Brothers in 1964, produced by Phil Spector. Rush-released in September 1964, the song was premiered by Sandie Shaw, who consequently covered the song for the UK market. In 1969, American singer Dionne Warwick recorded a cover version of You've Lost That Lovin' Feelin' for her studio album Soulful. Her version was the only single released from the album.\n", "prediction 2": "You've Lost That Lovin' Feelin' is a song written by Phil Spector, Barry Mann, and Cynthia Weil. Your version of the song came out on the album Your Soulful in 1968, in 1970, and in April 2128 on the album Love Forever. In August 1966, You've Lost That Lovin' Feelin' came out on the album Funny in Love. In January 1970, You've Lost That Lovin' Feelin' came out on the album That's Life, and in August 1968, the single, You've Lost That Lovin's Fire among others.", "prediction 3": "\"You've Lost That Lovin' Feelin'\" is a song written by Phil Spector, Barry Mann, and Cynthia Weil. It was first recorded by the Righteous Brothers in 1964, produced by Phil Spector. This version also became a number-one hit single in both the United States and the United Kingdom in February 1965. The original version was a critical and commercial success on its release, becoming a number-one hit single in both the United States and the United Kingdom in February 1965. Learn more about You've Lost That Lovin' Feelin' Feelin' is an R&B song written by Burt Bacharach and Hal David in the 1960s. A 1964 version of You've Lost That Lovin' Feelin' instead was released as the TCF in June 1965.", "prediction 4": "You've Lost That Lovin' Feelin' is a song written by Phil Spector, Barry Mann, and Cynthia Weil. It was first recorded by the Righteous Brothers in 1964. It was a critical and commercial success on its release, becoming a number-one hit single in both the United States and the United Kingdom in February 1965. In September 1964, the song was premiered by Sandie Shaw on the pop music TV show Ready Steady Go! The first week after its release, the single sold 65,000 copies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 435, "end": 492 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "You've Lost That Lovin' Feelin' is a song written by Phil Spector, Barry Mann, and Cynthia Weil. It was first recorded by the Righteous Brothers in 1964, produced by Phil Spector. In 1969, American singer Dionne Warwick recorded a cover version of You've Lost That Lovin' Feelin' for her studio album Soulful. In Warwick's version of the song, she spells the last word of the title out fully as \"feeling\" rather than the usual \"feelin.\n\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played lionel in all in the family?", "passages": [ [ "Lionel Jefferson", "Lionel Jefferson\n\nLionel Jefferson is a supporting character from the hit sitcoms \"All in the Family\" and \"The Jeffersons\".", "He is the son of George and Louise Jefferson.", "He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans.", "He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series.", "On \"All in the Family\", Lionel was portrayed by Mike Evans from 1971 to 1975.", "Lionel was born in New York City on October 18, 1953.", "His character is significant for being one of the first TV portrayals of a young, opinionated black man.", "Lionel is introduced in the first episode (and, in fact, appears on screen before Archie Bunker does).", "In one of the early episodes, the Jeffersons move into a house down the block from the Bunkers (later, the house is said to be next door).", "This event creates tension for Archie, though it elates Michael and Gloria.", "As Lionel's parents and uncle Henry appear more frequently, Lionel's role becomes less significant.", "Archie considers himself to be Lionel's good friend and even mentor.", "For his part, Lionel remains unfazed by Archie's racism and unrelenting condescension." ] ], "gold": "Lionel Jefferson is the character of the son of George and Louise Jefferson from the hit sitcoms All in the Family and The Jeffersons. He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans, who held the role from 1971-1975. He was later played by Damon Evans from 1975-1978, though Mike Evans eventually returned to the role before the end of the series. Jovan Adepo portrayed the character for the television special Live in Front of a Studio Audience: Norman Lear's All in the Family and The Jeffersons in 2019.", "prediction 1": "Lionel Jefferson is a supporting character from the hit sitcoms All in the Family and The Jeffersons. He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans. He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series. Lionel was portrayed by Mike Evans from 1971 to 1975.", "prediction 2": "Lionel Jefferson is a supporting character from the hit sitcoms All in the Family and The Jeffersons. He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans. He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series. On All in the Family, Lionel was portrayed by Mike Evans from 1971 to 1975.", "prediction 3": "Lionel Jefferson is a supporting character from the hit sitcoms \"All in the Family\" and \"The Jeffersons\". He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans. He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series. On \"All in the Family\", Lionel was portrayed by Mike Evans from 1971 to 1975.", "prediction 4": "Lionel Jefferson is a supporting character from the hit sitcoms All in the Family and The Jeffersons. Lionel was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans. He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series. Lionel was portrayed by Mike Evans from 1971 to 1975.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Lionel Jefferson is a supporting character from the hit sitcoms All in the Family and The Jeffersons. He was originally portrayed by D'Urville Martin for two unaired pilots, before the role was recast with Mike Evans. He was later played by Damon Evans (no relation), though Mike Evans eventually returned to the role before the end of the series. Lionel was portrayed by Mike Evans from 1971 to 1975." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "How much was an iphone 6 when it came out?", "passages": [ [ "IPhone 6", "IPhone 6\n\nThe iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by", "Apple Inc.", "It is the eighth generation of the iPhone, succeeding the iPhone 5S that were announced on September 9, 2014, and released on September 19, 2014.", "The iPhone 6 and iPhone 6 Plus jointly were themselves replaced as the flagship devices of the iPhone series by the iPhone 6S and iPhone 6S Plus on September 9, 2015.", "The iPhone 6 and 6 Plus include larger displays, a faster processor, upgraded cameras, improved LTE and Wi-Fi connectivity and support for a near field communications-based mobile payments offering.", "The iPhone 6 and 6 Plus received positive reviews, with critics regarding their improved design, specifications, camera, and battery life as being improvements over previous iPhone models.", "However, aspects of the design of iPhone 6 were also panned, including plastic strips on the rear of the device for its antenna that disrupted the otherwise metal exterior, and the screen resolution of the standard-sized iPhone 6 being lower than other devices in its class.", "Pre-orders of the iPhone 6 and iPhone 6 Plus exceeded four million within its first 24 hours of availability\u2014an Apple record.", "More than ten million iPhone 6 and iPhone 6 Plus devices were sold in the first three days, another Apple record." ], [ "IPhone 6", "The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014; pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749.", "In China, where the iPhone 5c and 5s were the first models in the iPhone series to be released in the country on the same day as their international launch, Apple notified local wireless carriers that it would be unable to release the iPhone 6 and iPhone 6 Plus on the 19th because there were \"details which are not ready\"; local media reported that the devices had not yet been approved by the Ministry of Industry and Information Technology, and earlier in the year, a news report by state broadcaster China Central Television alleged that iPhone devices were a threat to national security because iOS 7's \"frequent locations\" function could expose \"state secrets.\"", "In August 2015, Apple admitted that some iPhone 6 Plus models may have faulty cameras that could be causing photos to look blurry and initiated a replacement program.", "On September 9, 2015, with the release of the iPhone 6S and iPhone 6S Plus, the iPhone 6 and 6 Plus were moved to the mid-range of the iPhone lineup." ] ], "gold": "The iPhone 6 and iPhone 6 Plus are the eighth generation of the iPhone smartphone series. Designed and marketed by Apple Inc., they were announced on September 9, 2014, and released on September 19, 2014. The iPhone 6's original price at launch was $649, while the iPhone 6 Plus' one was $749.", "prediction 1": "The iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by Apple Inc. The official release dates for the iPhone 6 and iPhone 6 Plus were September 9, 2014, September 19, 2014, and October 9, 2014. The pre-orders for the iPhone 6 and iPhone 6 Plus began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749.", "prediction 2": "The iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by Apple Inc. It is the eighth generation of the iPhone, succeeding the iPhone 5S that were announced on September 9, 2014, and released on September 19, 2014. The first pre-orders for the iPhone 6 and iPhone 6 Plus started on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749.", "prediction 3": "The iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by Apple Inc. on September 9, 2014, and were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California. Pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749.", "prediction 4": "The iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by Apple Inc., the maker of the iPhone and the successor to the iPhone 5S, the iPhone 6S, and the iPhone 5C. The iPhone 6 and iPhone 6 Plus jointly were themselves replaced as the flagship devices of the iPhone series by the iPhone 6S and iPhone 6S Plus on September 9, 2015.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 83, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 288 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The iPhone 6 and iPhone 6 Plus are smartphones designed and marketed by Apple Inc. It is the eighth generation of the iPhone series that were announced on September 9, 2014, and released on September 19, 2014. The iPhone 6 starting price is US$649 and the iPhone 6 Plus starting at US$749." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who is the real villain in iron fist?", "passages": [ [ "Steel Serpent", "Steel Serpent\n\nSteel Serpent (Davos) is a fictional character, a supervillain appearing in American comic books published by Marvel Comics.", "The character is usually depicted as an enemy of Iron Fist.", "Davos is portrayed by Sacha Dhawan in the Netflix television series \"Iron Fist\", set in the Marvel Cinematic Universe.", "The first, otherwise unnamed, Steel Serpent appeared in \"The Deadly Hands of Kung Fu\" #10 (1974), his only appearance, and was created by Tony Isabella and Frank McLaughlin.", "The second Steel Serpent, Davos, debuted in \"Iron Fist\" #1 (1975) and was created by Chris Claremont and John Byrne.", "The Steel Serpent is a native of K'un-L'un named Davos, the son of Lei Kung the Thunderer.", "A gifted student of the martial arts, Davos was one of the final two candidates for the right to challenge for the power of the Iron Fist but was defeated in single combat by Wendell Rand, adopted son of K'un-L'un's ruler, Lord Tuan.", "Davos accused Tuan of unfairly favoring his son and left the city without permission to confront the dragon Shou-Lao.", "Failing to defeat the dragon, he returned to K'un L'un in disgrace and was exiled to Earth." ], [ "Iron Fist (TV series)", "Iron Fist (TV series)\n\nMarvel's Iron Fist, or simply Iron Fist, is an American web television series created for Netflix by Scott Buck, based on the Marvel Comics character of the same name.", "It is set in the Marvel Cinematic Universe (MCU), sharing continuity with the films of the franchise and is the fourth in a series of shows that lead to \"The Defenders\" crossover miniseries.", "The series is produced by Marvel Television in association with ABC Studios, with Devilina Productions and showrunner Buck for the first season.", "Raven Metzner took over as showrunner for the second season.", "Finn Jones stars as Danny Rand / Iron Fist, a martial arts expert with the ability to call upon a mystical power known as the \"Iron Fist\".", "Jessica Henwick, Tom Pelphrey, Jessica Stroup, and Sacha Dhawan also star, with Ram\u00f3n Rodr\u00edguez, Rosario Dawson and David Wenham joining them for the first season, Simone Missick and Alice Eve joining the cast for season two.", "After a film based on the character spent over a decade in development at Marvel Studios, development for the series began in late 2013 at Marvel Television, with Buck hired as the series showrunner in December 2015 and Jones cast as Rand in February 2016.", "Metzner was revealed as the series' new showrunner in July 2017.", "Filming for the series takes place in New York City." ], [ "Iron Fist (season 2)", "The season begins after the events of \"The Defenders\", and sees Rand fulfill his promise to protect New York following the supposed death of Matt Murdock at the end of that miniseries.", "For the season, Metzner also wanted to explore more of the mythology of K'un-Lun than was shown in the first season by spending more time there.", "Each episode is named after the issue title of various comics Danny Rand has appeared in, after the first season named each episode after Shaolin Kung Fu sequences.", "When asked how the season would be influenced by the criticisms of the first, Metzner said that Marvel had allowed him to tell his own story rather than follow on from the first season and so he just approached the project as a fan of the comics and characters.", "He described the second season as an \"evolution\" of the first.", "Jones felt that Rand would be more relatable for the audience in the second season after moving in with his girlfriend and spending less time around Rand Enterprises.", "Metzner described this approach as \"holistic\", wanting the series to feel like being on the streets of New York.", "Finn Jones, Jessica Henwick, Tom Pelphrey, Jessica Stroup, and Sacha Dhawan reprise their roles as Danny Rand / Iron Fist, Colleen Wing, Ward Meachum, Joy Meachum, and Davos, respectively." ] ], "gold": "Iron Fist is an American television series created by Scott Buck for the streaming service Netflix, based on the Marvel Comics character of the same name and set in the Marvel Cinematic Universe, sharing continuity with the rest of the franchise's films. The character of Davos, played by Sacha Dhawan, makes an appearance in the ninth episode of the first season and is ultimately revealed to be the real villain of the series.", "prediction 1": "Iron Fist is a fictional superhero storyline that is usually depicted as the opponent of Iron Fist. The real villain in Iron Fist is the Steel Serpent, a supervillain appearing in American comic books published by Marvel Comics. The Steel Serpent is played by Sacha Dhawan. The Netflix television series Iron Fist is based on the Marvel Cinematic Universe character of the same name.", "prediction 2": "There are several villains in Iron Fist. In the comics, Steel Serpent is the villain, which is usually depicted as an enemy of Iron Fist. In the Netflix television series Iron Fist, Sacha Dhawan plays Steel Serpent. In the Netflix television series Iron Fist, the villain is Wendell Rand, a martial arts expert with the ability to call upon a mystical power known as the Iron Fist.", "prediction 3": "The villain in Iron Fist, Steel Serpent, is usually depicted as an enemy of Iron Fist. The Steel Serpent, originally known as Davos, is a fictional character appearing in American comic books published by Marvel Comics. However, in the Netflix television series Iron Fist, Sacha Dhawan plays Davos, a supervillain who is the adopted son of King Tuan and is portrayed by Finn Jones.", "prediction 4": "There are several villains in the Marvel comic book Iron Fist, but there is a real villain called Steel Serpent. The Steel Serpent is portrayed by Sacha Dhawan in the Netflix television series Iron Fist, set in the Marvel Cinematic Universe. Wendell Rand is a martial arts expert with the ability to call upon a mystical power known as the Iron Fist.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 99 }, { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 129 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Iron Fist is an American television series created by Scott Buck for the streaming service Netflix, based on the Marvel Comics character of the same name and set in the Marvel Cinematic Universe, sharing continuity with the rest of the franchise's films. Steel Serpent Steel Serpent (Davos) is a fictional character, a supervillain appearing in American comic books published by Marvel Comics. The Steel Serpent (Davos) is played by Sacha Dhawan. " }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "Who sang lead vocals on twist and shout by the beatles?", "passages": [ [ "Twist and Shout", "Loosely based on the Isley Brothers version, \"Twist and Shout\", with John Lennon on lead vocals, was the last song recorded; producer George Martin knew Lennon's voice would suffer from the performance, so he left it until last, with only 15 minutes of scheduled recording time remaining.", "Lennon was suffering from a cold, and was drinking milk and sucking on cough drops to soothe his throat.", "His coughing is audible on the album, as is the cold's effect on his voice.", "Even so, he produced a memorable vocal performance: a raucous, dynamic rocker.", "He later said his voice was not the same for a long time afterward, and that \"every time [he] swallowed, it felt like sandpaper\".", "A second take was attempted, but Lennon had nothing left and it was abandoned.", "George Martin said, \"I did try a second take ... but John's voice had gone.\"", "Released as a single in the US on March 2, 1964, with \"There's a Place\" as its B-side, by Chicago-based Vee-Jay Records on the Tollie label, it reached number 2 on April 4, 1964, during the week that the top five places on the chart were all Beatles singles (in the \"Cashbox\" singles chart for the same week, \"Twist and Shout\" was No. 1)." ], [ "Twist and Shout (EP)", "Twist and Shout (EP)\n\nThe Twist and Shout EP by the Beatles is the band's first British EP, released by Parlophone (catalogue number GEP 8882) on 12 July 1963.", "It was also released in Germany, Spain, New Zealand, Australia and Argentina.", "All four tracks on the EP were originally released on their debut album \"Please Please Me\"." ], [ "Twist and Shout (album)", "Twist and Shout (album)\n\nTwist and Shout was the Beatles' second album released in Canada, in mono by Capitol Records (catalogue number T-6054) on February 3rd, 1964.", "It consists of songs mostly drawn from \"Please Please Me\", their first LP released in the United Kingdom.", "This album, like its parent album, contains both original Beatles songs, as well as covers (including its namesake, \"Twist and Shout\"), denoted in the track listing.", "Twist and Shout received miscellaneous reissues since the initial release date.", "The initial release was exclusively mono audio, because stereo record players were not popular in Canada at the time of release and therefore not profitable.", "Early copies of the record were manufactured with a limited edition 8x10 inch poster of the Beatles.", "The subsequent reissues attributed Parr's, the printer commissioned by Capitol to create the cardboard record jackets as well as other minor variations in the label, font size, and catalogue numbers.", "\"Twist and Shout\" was eventually reissued in stereo in the 1970's, bearing catalogue number ST-6054 to denote stereo audio; all tracks were in stereo except for \"Love Me Do\", \"P.S. I Love You\", and \"She Loves You\", which remained mono.", "The stereo reissue is considered to be the definitive version." ] ], "gold": "John Lennon sang lead vocals on the song, Twist and Shout, which was included on the Beatles' first studio album, Please Please Me, which was released in March 1963. Twist and Shout is also the title of the first UK extended play record by the Beatles and features lead vocals by John Lennon, Paul McCartney, and George Harrison. It was released in July 1963. The Beatles also released an album called Twist and Shout in 1964 which included songs with lead vocals by Ringo Starr, George Harrison, John Lennon, and Paul McCartney.", "prediction 1": "Twist and Shout is the second album by the English rock band the Beatles. It consists of songs mostly drawn from their debut album Please Please Me. The vocals on Twist and Shout are performed by John Lennon, a ten-year-old boy from Durham, North Carolina. It was the last song recorded by the band.", "prediction 2": "The Twist and Shout EP by the Beatles contains songs mostly drawn from their debut album Please Please Me as well as covers of songs, such as \"Twist and Shout\", which was originally released in the United Kingdom on March 2, 1964. John Lennon sang lead vocals on the album.", "prediction 3": "Twist and Shout is a song by the British rock band the Beatles written and performed by John Lennon. The song was recorded on March 2, 1964, and was released as a single on March 2, 1964.", "prediction 4": "The Beatles' second album Twist and Shout, released in mono by Capitol Records on February 3rd, 1964, consists of songs mostly drawn from their debut album Please Please Me. In the original version, John Lennon sang lead vocals. In the stereo version, George Martin sang lead vocals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 148 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Twist and Shout is the second album by the English rock band the Beatles, released in 1964. It is also the title of the first UK extended play record by the Beatles, that released in July 1963. The vocals on Twist and Shout, which was released as a single in the US on March 2, 1964, are performed by John Lennon. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where do you get a letter of administration?", "passages": [ [ "Letters of Administration", "Letters of Administration\n\nLetters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living (and willing and able to act) having been validly appointed under the deceased's will.", "Traditionally, letters of administration granted to a representative of a testate estate are called \"letters of administration with the will annexed\" or \"letters of administration \"cum testamento annexo\"\" or \"c.t.a.\".", "Essentially, this document is issued to the person who will administer the estate of someone who dies without a will.", "As outlined by the Cornell Legal Information Institute, \"The letters authorize the administrator to settle the deceased person's estate according to the state's intestate succession laws.", "Banks, brokerages, and government agencies often require a certified copy of the letters before accepting the administrator's authority to collect the deceased person's assets.\"", "If a decedent has a surviving spouse, this individual will have priority in receiving a letter of administration over others, including children; age alone does not render an individual ineligible to serve as a fiduciary." ], [ "The Honourable", "The presiding officers of the parliaments of the Commonwealth, the states and the Northern Territory are also styled \"the Honourable\", but normally only during their tenure of office.", "Special permission is sometimes given for a former presiding officer to retain the style after leaving office, as is the case in the Northern Territory.", "The style \"Honourable\" is not acquired through membership of either the House of Representatives or the Senate (see Parliament of Australia).", "A member or senator may have the style if they have acquired it separately, e.g. by being a current or former minister.", "During proceedings within the chambers, forms such as \"the honourable Member for ...\", \"the honourable the Leader of the Opposition\", or \"My honourable colleague\" are used.", "This is a parliamentary courtesy and does not imply any right to the style.", "Traditionally, members of the legislative councils of the states have been styled \"the Honourable\" for the duration of their terms.", "This practice is still followed in New South Wales, Western Australia, South Australia and Tasmania.", "In Victoria the practice was abolished in 2003.", "Judges of all superior courts are also referred to formally by the style \"the Honourable\", both during and after holding the office.", "In People's Republic of Bangladesh, ministers and members of parliaments are entitled to the style \"Honorable\"." ] ], "gold": "Letters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living having been validly appointed under the deceased's will. In the UK, one would get a letter of administration from the High Court of Justice Family Division. In New Brunswick, Canada, an individual would get a letter of administration from the Probate Court of New Brunswick, and in Novia Scotia, Canada, they would go to the Probate Court of Nova Scotia. In providences in Canada other than Novia Scotia or New Brunswick, one would receive it from superior courts.", "prediction 1": "If you are a surrogate court or probate registry, you can get a letter of administration anywhere. If you are a representative of a testate estate, you can get an \"administration with the will annexed\" or an \"administration with the will annexed\" or \"administration c.t.a.\" Essentially, this document is issued to the person who will administer the estate of someone who dies without a will.", "prediction 2": "Letters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living (and willing and able to act) having been validly appointed under the deceased's will. Essentially, this document is issued to the person who will administer the estate of someone who dies without a will. Banks, brokerages, and government agencies often require a certified copy of the letters before accepting the administrator's authority to collect the deceased person's assets.", "prediction 3": "Letters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living (and willing and able to act) having been validly appointed under the deceased's will. Traditionally, letters of administration granted to a representative of a testate estate are called \"letters of administration with the will annexed\" or \"letters of administration \"cum testamento annexo\" or \"c.ta.\" or \"c.ta.\"", "prediction 4": "Letters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living (and willing and able to act) having been validly appointed under the deceased's will. The Honourable is the style of the presiding officers of the parliaments of the Commonwealth, the states, and the Northern Territory. If a decedent has a surviving spouse, this individual will have priority in receiving a letter of administration over others, including children.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 391 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Letters of Administration are granted by a Surrogate Court or probate registry to appoint appropriate people to deal with a deceased person's estate where property will pass under Intestacy Rules or where there are no executors living having been validly appointed under the deceased's will. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When is the movie thor ragnarok coming out?", "passages": [ [ "Thor: Ragnarok", "Ruffalo joined the cast reprising the role of Hulk from previous MCU films, which allowed elements of the 2006 comic storyline \"Planet Hulk\" to be adapted for \"Ragnarok\".", "The rest of the cast, including Blanchett as Hela, was confirmed in May 2016, with Pearson's involvement revealed at the start of filming that July.", "Principal photography took place in Brisbane and Sydney, Australia, with the film also having exclusive use of Village Roadshow Studios in Oxenford, concluding in October 2016.", "\"Thor: Ragnarok\" premiered in Los Angeles on October 10, 2017, and was released in the United States on November 3, in 3D, IMAX, and", "IMAX 3D.", "The film received praise for its acting, direction, action sequences, soundtrack, and humor, with many critics considering it the best of the \"Thor\" trilogy.", "It grossed $854\u00a0million, becoming the highest-grossing film of the trilogy and the ninth-highest-grossing film of 2017.", "Two years after the battle of Sokovia, Thor is imprisoned by the fire demon Surtur in Muspelheim, who reveals that Thor's father Odin is no longer on Asgard." ], [ "Thor: Ragnarok", "The film was released in the United States and Canada on November 3, in 4,080 theaters, of which over 3,400 were 3D, 381 were IMAX and IMAX 3D, and 204 were D-Box.", "The film opened in 1,187 IMAX theaters globally, which was a November opening weekend record.", "It was originally scheduled for release on July 28, 2017.", "\"Thor: Ragnarok\" was released on digital download by Walt Disney Studios Home Entertainment on February 20, 2018, and on Ultra HD Blu-ray, Blu-ray, DVD and On-Demand on March 6.", "The digital and Blu-ray releases include behind-the-scenes featurettes; audio commentary; deleted scenes; a blooper reel; and \"Team Darryl\", a continuation of the \"mockumentary\" short films \"Team Thor\" and \"Team Thor: Part 2\", in which the Grandmaster moves in with Darryl after Thor leaves.", "In one of the deleted scenes, Michael Rooker makes an appearance as Yondu, reprising the role from the first two \"Guardians of the Galaxy\" films." ], [ "Thor: Ragnarok", "Thor: Ragnarok\n\nThor: Ragnarok is a 2017 American superhero film based on the Marvel Comics character Thor, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures.", "It is the sequel to 2011's \"Thor\" and 2013's \"\", and is the seventeenth film in the Marvel Cinematic Universe (MCU).", "The film is directed by Taika Waititi from a screenplay by Eric Pearson and the writing team of Craig Kyle and Christopher L. Yost, and stars Chris Hemsworth as Thor alongside Tom Hiddleston, Cate Blanchett, Idris Elba, Jeff Goldblum, Tessa Thompson, Karl Urban, Mark Ruffalo, and Anthony Hopkins.", "In \"Thor: Ragnarok\", Thor must escape the alien planet Sakaar in time to save Asgard from Hela and the impending Ragnar\u00f6k.", "A third \"Thor\" film was confirmed in January 2014, with Kyle and Yost beginning work on the screenplay.", "The involvement of Hemsworth and Hiddleston was announced that October.", "Waititi joined the film as director a year later, after \"Thor: The Dark World\" director Alan Taylor chose not to return." ] ], "gold": "Thor: Ragnarok is a 2017 American superhero film based on the Marvel Comics character Thor, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. \"Thor: Ragnarok\" had its world premiere at the El Capitan Theatre in Los Angeles on October 10, 2017, and its Australian premiere took place on October 13, 2017, on the Gold Coast. It was released in the United Kingdom on October 24, 2017, with additional international releases on October 25, and in Australia on October 26, 2017. The film was released in the United States and Canada on November 3, 2017, in 4,080 theaters, of which over 3,400 were 3D, 381 were IMAX and IMAX 3D, and 204 were D-Box.", "prediction 1": "Thor Ragnarok, a superhero film based on the Marvel Comics character Thor, is a sequel to the 2011 and 2013 Thor films, and is the seventeenth film in the Marvel Cinematic Universe (MCU). The film premiered in Los Angeles on October 10, 2017 and was released in the United States and Canada on November 3, in 3,080 theaters, of which over 3,400 were 3D, IMAX, and IMAX 3D. The film was released on digital download by Walt Disney Studios Home Entertainment on February 20, 2018 and on Ultra HD Blu-ray, Blu-ray, DVD and On-Deman on March 6.", "prediction 2": "Thor Ragnarok is a 2017 American superhero film based on the Marvel Comics character Thor, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. The film premiered in Los Angeles on October 10, 2017. It was released in the United States and Canada on November 3, in 3,080 theaters, of which over 3,400 were 3D, IMAX, and IMAX 3D, and 204 were D-Box.", "prediction 3": "Thor: Ragnarok is a 2017 American superhero film based on the Marvel Comics character Thor, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. It is the sequel to 2011's Thor and 2013's Thor, and is the seventeenth film in the Marvel Cinematic Universe (MCU). It premiered in Los Angeles on October 10, 2017 and was released in the United States on November 3, in 3D, IMAX, and IMAX 3D.", "prediction 4": "Thor Ragnarok was premiered in Los Angeles on October 10, 2017, and was released in the United States and Canada on November 3, in 3,080 theaters, of which over 3,400 were 3D, 381 were IMAX, and IMAX 3D, and 204 were D-Box. The film is directed by Taika Waititi from a screenplay by Eric Pearson and the writing team of Craig Kyle and Christopher L. Yost, and stars Chris Hemsworth as Thor alongside Tom Hiddleston as Loki and Hela.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 187 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Thor: Ragnarok is a 2017 American superhero film based on the Marvel Comics character Thor, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. The film premiered in Los Angeles on October 10, 2017 and was released in the United States and Canada on November 3, in 3,080 theaters, of which over 3,400 were 3D, IMAX, and IMAX 3D. The film was released on digital download by Walt Disney Studios Home Entertainment on February 20, 2018 and on Ultra HD Blu-ray, Blu-ray, DVD and On-Deman on March 6." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the count of monte cristo set?", "passages": [ [ "The Count of Monte Cristo", "The Count of Monte Cristo\n\nThe Count of Monte Cristo () is an adventure novel by French author Alexandre Dumas (\"p\u00e8re\") completed in 1844.", "It is one of the author's most popular works, along with \"The Three Musketeers\".", "Like many of his novels, it was expanded from plot outlines suggested by his collaborating ghostwriter Auguste Maquet.", "Another important work by Dumas, written prior to his work with Maquet, was the short novel \"Georges\"; this novel is of particular interest to scholars because Dumas reused many of the ideas and plot devices later in \"The Count of Monte Cristo\".", "The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration through the reign of Louis-Philippe of France.", "It begins just before the Hundred Days period (when Napoleon returned to power after his exile).", "The historical setting is a fundamental element of the book, an adventure story primarily concerned with themes of hope, justice, vengeance, mercy, and forgiveness.", "It centres on a man who is wrongfully imprisoned, escapes from jail, acquires a fortune, and sets about exacting revenge on those responsible for his imprisonment.", "His plans have devastating consequences for both the innocent and the guilty.", "The book is considered a literary classic today." ], [ "The Count of Monte Cristo (1943 film)", "The Count of Monte Cristo (1943 film)\n\nThe Count of Monte Cristo is a 1943 French-Italian film directed by Robert Vernay with Ferruccio Cerio as the supervising director.", "Based on the classic novel \"Le Comte de Monte Cristo\" by Alexandre Dumas p\u00e8re, this two-part film stars Pierre Richard-Willm in the title role." ], [ "The Count of Monte Cristo (2002 film)", "The Count of Monte Cristo (2002 film)\n\nThe Count of Monte Cristo is a 2002 adventure drama film produced by Roger Birnbaum, Gary Barber, and Jonathan Glickman that was directed by Kevin Reynolds.", "An international co-production between the United States, the United Kingdom, and Ireland, the film is an adaptation of the book of the same name by Alexandre Dumas, p\u00e8re and stars Jim Caviezel, Guy Pearce, and Richard Harris.", "It follows the general plot of the novel (the main storyline of imprisonment and revenge is preserved); but many aspects, including the relationships between major characters and the ending, have been changed, simplified, or removed; and action scenes have been added.", "The film met with modest box office success.", "In 1815, Edmond Dant\u00e8s, Second Mate of a French merchant vessel, and his friend Fernand Mondego, representative of the shipping company, seek medical help at Elba for their ailing captain.", "Napoleon Bonaparte, having kept his guardians from killing the pair, exchanges his physician\u2019s services with Edmond for the delivery of a letter.", "Edmond is sworn to its secrecy, but the exchange is witnessed by Fernand." ] ], "gold": "The Count of Monte Cristo is an adventure novel written by French author Alexandre Dumas completed in 1844, that has spawned several adaptations. The original book takes place on takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration, while the 2002 American adaptation takes place in the island of Elba and the mainland city of Marseille, during the same time frame. Alternatively, the 1999 version called Forever Mine is mostly set in Miami in the year 1987. In 1986, an Indian take on the story was released with the movie Veta, which takes place in India in 1939.", "prediction 1": "The Count of Monte Cristo is an adventure novel by French author Alexandre Dumas completed in 1844. The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration through the reign of Louis-Philippe of France. The 1943 French-Italian film The Count of Monte Cristo, is also considered a classic. The Count of Monte Cristo is also considered an international co-production between the United States, the United Kingdom, and Ireland.", "prediction 2": "The Count of Monte Cristo is an adventure novel by French author Alexandre Dumas, completed in 1844. The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration through the reign of Louis-Philippe of France. It begins just before the Hundred Days period, when Napoleon returned to power after his exile. The 1943 French-Italian film, The Count of Monte Cristo, is an adaptation of the book by Alexandre Dumas p\u00e8re and stars Pierre Richard-Willm in the title role. The 2002 film is an adaptation of the book of the same name by Alexandre Dumas p\u00e8re and stars Guy Pearce, Richard Harris, and Jim Caviezel.", "prediction 3": "The Count of Monte Cristo is an adventure novel by French author Alexandre Dumas, \"p\u00e8re\", completed in 1844. It is one of the author's most popular works, along with \"The Three Musketeers\". The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration through the reign of Louis-Philippe of France. The Count of Monte Cristo is also the title of a 1943 French-Italian film that was directed by Kevin Reynolds.", "prediction 4": "The Count of Monte Cristo is a novel by French author Alexandre Dumas. It was completed in 1844. The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839. The 1943 French-Italian film version of the novel is an adaptation of the book and is based on the 1815 story.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 297 }, { "error type": "Irrelevant", "explanation": "", "start": 298, "end": 383 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 519 } ], "missing-info": [], "corrected-prediction": "The Count of Monte Cristo is an adventure novel by French author Alexandre Dumas completed in 1844. The story takes place in France, Italy, and islands in the Mediterranean during the historical events of 1815\u20131839: the era of the Bourbon Restoration. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who designed the holocaust museum in washington dc?", "passages": [ [ "United States Holocaust Memorial Museum", "Special Police Officer Johns later died of his injuries; he is permanently honored in an official memorial at the USHMM.", "Von Brunn, who had a previous criminal record, had been disowned by his family.", "He was being tried in federal court when he died on January 6, 2010, in Butner federal prison in North Carolina.", "Designed by the architect James Ingo Freed of Pei Cobb Freed & Partners, in association with Finegold Alexander + Associates Inc, the USHMM is created to be a \"resonator of memory\".", "(Born to a Jewish family in Germany, Freed came to the United States at the age of nine in 1939 with his parents, who fled the Nazi regime.)", "The outside of the building disappears into the neoclassical, Georgian, and modern architecture of Washington, D.C.", "Upon entering, each architectural feature becomes a new element of allusion to the Holocaust.", "In designing the building, Freed researched post-World War II German architecture and visited Holocaust sites throughout Europe.", "The Museum building and the exhibitions within are intended to evoke deception, fear, and solemnity, in contrast to the comfort and grandiosity usually associated with Washington, D.C. public buildings." ], [ "United States Holocaust Memorial Museum", "United States Holocaust Memorial Museum\n\nThe United States Holocaust Memorial Museum (USHMM) is the United States' official memorial to the Holocaust.", "Adjacent to the National Mall in Washington, D.C., the USHMM provides for the documentation, study, and interpretation of Holocaust history.", "It is dedicated to helping leaders and citizens of the world confront hatred, prevent genocide, promote human dignity, and strengthen democracy.", "The museum has an operating budget, as of 2015, of $104.6 million.", "In 2008, the Museum had a staff of about 400 employees, 125 contractors, 650 volunteers, 91 Holocaust survivors, and 175,000 members.", "It had local offices in New York City, Boston, Boca Raton, Chicago, Los Angeles, and Dallas.", "Since its dedication on April 22, 1993, the Museum has had nearly 40 million visitors, including more than 10 million school children, 99 heads of state, and more than 3,500 foreign officials from over 211 countries.", "The Museum's visitors came from all over the world, and less than 10 percent of the Museum's visitors are Jewish.", "Its website had 25 million visits in 2008 from an average of 100 different countries daily.", "35% of these visits were from outside the United States." ] ], "gold": "The United States Holocaust Memorial Museum (USHMM) is the United States' official memorial to the Holocaust. Designed by the architect James Ingo Freed of Pei Cobb Freed & Partners, in association with Finegold Alexander & Associates Inc., the USHMM is created to be a \"resonator of memory\".", "prediction 1": "The United States Holocaust Memorial Museum is the United States' official memorial to the Holocaust. Ingo Freed, who was born in Germany, designed the building.", "prediction 2": "The United States Holocaust Memorial Museum in Washington D.C. was designed by the architect James Ingo Freed of Pei Cobb Freed & Partners, in association with Finegold Alexander + Associates Inc.", "prediction 3": "The United States Holocaust Memorial Museum in Washington D.C. was designed by the architect James Ingo Freed of Pei Cobb Freed & Partners in association with Finegold Alexander + Associates Inc. The USHMM is dedicated to the memory of those who perished in the Holocaust, with the outside of the building disappearing into the neoclassical, Georgian, and modern architecture of Washington, D.C. In designing the building, Freed researched post-World War II German architecture and visited Holocaust sites throughout Europe. In designing the USHMM, the building is intended to evoke deception, fear, and solemnity, in contrast to the comfort and grandiosity usually associated with Washington, D.C.", "prediction 4": "The United States Holocaust Memorial Museum (USHMM) is the United States' official memorial to the Holocaust. Designed by the architect James Ingo Freed of Pei Cobb Freed & Partners, in association with Finegold Alexander + Associates Inc., the museum is created to be a \"resonator of memory\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 138 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The United States Holocaust Memorial Museum is the United States' official memorial to the Holocaust. It was designed by the architect James Ingo Freed of Pei Cobb Freed & Partners, in association with Finegold Alexander + Associates Inc, the USHMM is created to be a \"resonator of memory\"." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "What are the functions of tendon and ligament?", "passages": [ [ "Tendon", "Tendon\n\nA tendon or sinew is a tough band of fibrous connective tissue that usually connects muscle to bone and is capable of withstanding tension.", "Tendons are similar to ligaments; both are made of collagen.", "Ligaments join one bone to bone, while tendons connect muscle to bone for a proper functioning of the body.", "Histologically, tendons consist of dense regular connective tissue fascicles encased in dense irregular connective tissue sheaths.", "Normal healthy tendons are composed mostly of parallel arrays of collagen fibers closely packed together.", "They are anchored to bone by Sharpey's fibres.", "The dry mass of normal tendons, which makes up about 30% of their total mass, is composed of about 86% collagen, 2% elastin, 1\u20135% proteoglycans, and 0.2% inorganic components such as copper, manganese, and calcium.", "The collagen portion is made up of 97\u201398% type I collagen, with small amounts of other types of collagen." ], [ "Ligament", "Ligament\n\nA ligament is the fibrous connective tissue that connects bones to other bones.", "It is also known as \"articular ligament\", \"articular larua\", \"fibrous ligament\", or \"true ligament\".", "Other ligaments in the body include the:\n\nLigaments are similar to tendons and fasciae as they are all made of connective tissue.", "The differences in them are in the connections that they make: ligaments connect one bone to another bone, tendons connect muscle to bone, and fasciae connect muscles to other muscles.", "These are all found in the skeletal system of the human body.", "Ligaments cannot usually be regenerated naturally; however, there are periodontal ligament stem cells located near the periodontal ligament which are involved in the adult regeneration of periodontal ligament.", "The study of ligaments is known as (from Greek , \"desmos\", \"bond\"; and , \"-logia\").", "\"Ligament\" most commonly refers to a band of dense regular connective tissue bundles made of collagenous fibers, with bundles protected by dense irregular connective tissue sheaths.", "Ligaments connect bones to other bones to form joints, while tendons connect bone to muscle.", "Some ligaments limit the mobility of articulations or prevent certain movements altogether." ] ], "gold": "A tendon or sinew is a tough, high-tensile-strength band of dense fibrous connective tissue that connects muscle to bone. It is able to efficiently transmit the mechanical forces of muscle contraction to the skeletal system without sacrificing its ability to withstand significant amounts of tension. Tendons are similar to ligaments; both are made of collagen. Ligaments connects bones to other bones, while tendons connect muscle to bone.", "prediction 1": "Tendons and ligaments are similar in that they are both made of connective tissue. Ligaments connect one bone to another bone, while tendons connect muscle to bone for a proper functioning of the body.", "prediction 2": "A tendon or sinew is a tough band of fibrous connective tissue that usually connects muscle to bone and is capable of withstanding tension. Both tendons and ligaments are made of collagen. Ligaments join one bone to bone, while tendons connect muscle to bone for a proper functioning of the body. Tendons are similar to ligaments; both are made of collagen.", "prediction 3": "A tendon or sinew is a tough band of fibrous connective tissue that usually connects muscle to bone and is capable of withstanding tension. Ligaments join one bone to bone, while tendons connect muscle to bone for a proper functioning of the body. Ligaments cannot usually be regenerated naturally, however, there are periodontal ligament stem cells located near the periodontal ligament which are involved in the adult regeneration of periodontal ligament.", "prediction 4": "A tendon is a tough band of fibrous connective tissue that usually connects muscle to bone and is capable of withstanding tension. Ligaments join one bone to bone, while tendons connect muscle to bone for a proper functioning of the body. Ligaments can be regenerated naturally, however, there are periodontal ligament stem cells located near the periodontal ligament which are involved in the adult regeneration of periodontal ligament.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 56, "end": 82 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Tendons and ligaments are similar in that they are both made of collagen. Ligaments connect one bone to another bone, while tendons connect muscle to bone for a proper functioning of the body. A tendon or sinew is a tough band of fibrous connective tissue that usually connects muscle to bone and is capable of withstanding tension." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Where does the first name cole come from?", "passages": [ [ "Cole (name)", "Cole (name)\n\nCole is a surname of English origin, and is much less frequently a given name.", "It is of Middle English origin, and its meaning is \"swarthy, coal-black, charcoal\".", "The Cole family originated in Cornwall, South West England.", "The first recorded spelling of the family name is shown to be that of Randolphi Cole, appearing in the Winton Rolls of Hampshire in 1148.", "It is also an Americanized spelling of the German name 'Kohl', and of the Scottish and Irish name 'McCool'." ], [ "Cox (surname)", "Alric was said to have been a \"a strutting {as a rooster struts} Norman soldier ... who was nicknamed 'le coq' and his children 'little cockes.'\"", "Le Coq could easily have been Anglicized to Cox as seen in the previous possibility.", "The surname Cox is also native to Belgian and Dutch Limburg.", "This name, like the related Cockx, is a degenerate form of Cocceius, a latinization of \"Kok\" (English: cook).", "Noticeably similar surnames include Cock, Cocks, Coxe, Coxen and Coxon.", "There is no evidence beyond similar spellings and phonetics that these surnames are related.", "Given that the origins of the Cox surname are uncertain, it is possible that these names developed as spelling variations, or that each of these names has an origin in a separate word and language.", "The origins of the surname in North America are speculated across several written accounts, with most sources pointing toward three distinct families arriving from England in the 17th and 18th Centuries: in 1690, brothers Thomas, William, and Walter Cocke originally of Surry; in 1705, the family of Dr. Wilham Cocke of Williamsburg; and at an unknown time before 1658, Nicholas Cocke of Middlesex." ] ], "gold": "Cole is a name of Middle English origin, meaning \"swarthy, coal-black, charcoal.\" The name is also an abbreviation of \"Nicholas\" and an Americanized spelling of the German name \"Kohl,\" of the Dutch name \"Kool,\" and of the Scottish and Irish name \"McCool.\"", "prediction 1": "The Cole family originated in Cornwall, South West England. The first recorded spelling of the family name is shown to be that of Randolphi Cole, appearing in the Winton Rolls of Hampshire in 1148. It is also an Americanized spelling of the German name Kohl, and of the Scottish and Irish name McCool.", "prediction 2": "The first recorded spelling of the family name is Randolphi Cole, appearing in the Winton Rolls of Hampshire in 1148. It is also an Americanized spelling of the German name Kohl, and of the Scottish and Irish name McCool. The surname Cox is also native to Belgian and Dutch Limburg. Notable similar surnames include Cock, Cocks, Coxe, Coxen and Coxon. Given that the origins of the Cox surname in North America are uncertain, it is possible that these names developed as spelling variations, or that each of these names has an origin in a separate word and language.", "prediction 3": "The first recorded spelling of the family name is shown to be that of Randolphi Cole, appearing in the Winton Rolls of Hampshire in 1148. It is also an Americanized spelling of the German name Kohl, and of the Scottish and Irish name McCool. The surname Cox is also native to Belgian and Dutch Limburg. Noticeably similar surnames include Cock, Cocks, Coxe, Coxen and Coxon.", "prediction 4": "The first recorded spelling of the family name is shown to be that of Randolphi Cole, appearing in the Winton Rolls of Hampshire in 1148. Cole is a surname of English origin, and is much less frequently a given name. It is of Middle English origin, and its meaning is \"swarthy, coal-black, charcoal\". The Cole family originated in Cornwall, South West England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 59 }, { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 197 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Cole is a name of Middle English origin, meaning \"swarthy, coal-black, charcoal.\" It is also an Americanized spelling of the German name Kohl, and of the Scottish and Irish name McCool." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who does the voice of the aflac duck?", "passages": [ [ "Aflac", "Celebrities have starred in the Aflac ads, including Chevy Chase (2003); Yogi Berra; Yao Ming; Donald Trump's wife and current First Lady, Melania Trump (2005); NASCAR Cup Series driver Carl Edwards (2008\u20132014); the United States Olympic synchronized swimming team (2004); and Wayne Newton playing at Stardust Hotel and Casino for the 2003 commercial.", "The duck also appeared with Bugs Bunny, Daffy Duck, Wile E. Coyote and The Road Runner, and Rudolph the Red-Nosed Reindeer.", "In 2005, the company logo was changed to incorporate the duck.", "The first commercial using the new logo featured Gilbert Gottfried at a pet store because the duck kept saying, \"Aflac!\"", "and he had to trade in the duck for a parrot, saying, \"If you're hurt and can't work\".", "The duck was originally voiced by comedian Gilbert Gottfried, who also voiced Digit on the PBS Kids series \"Cyberchase\" and Iago in the Disney film \"Aladdin\".", "After 11 years as the voice of the Aflac duck, Gottfried was dismissed on March 14, 2011, due to jokes on Gottfried's Twitter account referencing the T\u014dhoku earthquake and tsunami." ], [ "Aflac", "The company's chief marketing officer stated that \"Gilbert's recent comments about the crisis in Japan were lacking in humor, and certainly do not represent the thoughts and feelings of anyone at Aflac.\"", "On March 23, 2011, Aflac announced that the company was taking applications for the new voice of the Aflac Duck through QuackAflac.com until April 1.", "Commercials requesting the submissions, first aired in 2006 but updated, resemble a silent movie.", "On April 26, 2011, it was announced that Daniel McKeague, a television advertising sales manager from Hugo, Minnesota, would be the new voice of the Aflac duck.", "The first Aflac commercial featuring the duck's new voice aired May 1, 2011.", "In 2018, an Aflac ad inserted an animated Aflac duck into the opening credits of the \"DuckTales\" reboot.", "The company states that through a partnership with Children's Healthcare of Atlanta, Aflac has contributed more than $100 million to childhood cancer research and treatment.", "Aflac employees are formally involved in an array of charitable organizations such as Habitat for Humanity International, the Easter Seals, and the United Way.", "Aflac's stated objectives include the decrease of its environmental impact, for which the company is into a partnership with the Clean Air Campaign to encourage employees to engage with greater frequency in alternate commuting methods." ], [ "Aflac", "Aflac\n\nAflac Inc. (American Family Life Assurance Company) is an American insurance company and is the largest provider of supplemental insurance in the United States.", "The company was founded in 1955 and is based in Columbus, Georgia.", "In the U.S., Aflac underwrites a wide range of insurance policies, but is perhaps more known for its payroll deduction insurance coverage, which pays cash benefits when a policyholder has a covered accident or illness.", "The company states it \"provides financial protection to more than 50 million people worldwide\".", "In 2009, Aflac acquired Continental American Insurance Company for $100 million; this enabled Aflac to sell supplemental insurance on both the individual and group platform.", "As of June 30, 2012, Aflac was represented by approximately 19,300 sales agencies in Japan, and 76,900 licensed sales associates in the U.S.", "The company was founded by brothers John, Paul (died 2014), and William Amos in Columbus, Georgia, in 1955, as American Family Life Insurance Company of Columbus.", "In 1964, the company name was changed to American Family Life Assurance Company of Columbus.", "The company, in 1990, adopted the Aflac acronym, although the official name of the underwriting subsidiary remains American Family Life Assurance Company of Columbus.", "Aflac announced the appointment of Frederick J. Crawford as Chief Financial Officer, as well as Executive Vice President in June 2015." ], [ "Aflac", "It sold the broadcasting division (including flagship station WTVM) to what became Raycom Media in 1997.", "Aflac is ranked 137th in the Fortune 500 list of largest United States corporations by revenue.", "Consumer groups and some government officials say that cancer insurance returns fewer premium dollars to policyholders than standard insurance.", "A United States General Accounting Office study found that the policies paid back as little as 35% of premiums (Aflac said its cancer insurance paid back 62.4%).", "In comparison, New York State requires most major-medical policies to pay back 82% and group policies to pay back 75%.", "New York State does not allow stand-alone cancer policies.", "In 1997, AFLAC spent $175,000 on lobbyists and campaign contributions to change the law.", "New York State lifted its ban in 1998, for purchasers who already have basic coverage.", "Consumer Reports recommended that policyholders use the money instead to buy lower-deductible insurance.", "Insurance claims by line appear on the Annual Statement filed with each state.", "Loss claims are a percent of total premium before commissions.", "Since December 1999, the company's identity and brand has become more widely recognized in the United States as the result of TV commercials featuring the Aflac Duck, who frustratedly quacks the company's name to unsuspecting prospective policy holders." ] ], "gold": "The American Family Life Assurance Company is an American insurance company whose identity and brand has become more widely recognized as the result of TV commercials featuring the Aflac Duck. More than one person has voiced the Aflac Duck. Comedian Gilbert Gottfried was the original voice actor for the duck until he was dismissed on March 14, 2011. In April 2011, Daniel McKeague, a television advertising sales manager from Minnesota, was hired to replace Gottfried.", "prediction 1": "Aflac Inc. is an American insurance company and is the largest provider of supplemental insurance in the United States. The duck was originally voiced by comedian Gilbert Gottfried, who also voiced Digit on the PBS Kids series \"Cyberchase\" and Iago in the Disney film \"Aladdin\". After 11 years as the voice of the Aflac duck, Gottfried was dismissed on March 14, 2011, due to jokes on Gottfried's Twitter account referencing the Thoku earthquake and tsunami. Daniel McKeague, a television advertising sales manager from Hugo, Minnesota, was announced that the new voice of the Aflac commercial featuring the new voice of the Aflac duck aired May 1, 2011. The first Aflac commercial featuring the new voice aired on May 1, 2011.\n", "prediction 2": "Aflac is an American insurance company that is the largest provider of supplemental insurance in the United States. The duck was originally voiced by comedian Gilbert Gottfried and was given a new identity in 2011. After 11 years as the voice of the Aflac duck, Gottfried was dismissed on March 14, 2011, due to jokes on Gottfried's Twitter account referencing the Thoku earthquake and tsunami. Daniel McKeague, a television advertising sales manager from Hugo, Minnesota, was chosen as the new voice of the Aflac Duck in April 26, 2011, and in 2012.", "prediction 3": "Aflac Inc. (American Family Life Assurance Company) is an American insurance company and is the largest provider of supplemental insurance in the United States. The duck was originally voiced by comedian Gilbert Gottfried, who also voiced Digit on the PBS Kids series \"Cyberchase\" and Iago in the Disney film \"Aladdin\". After 11 years as the voice of the Aflac duck, Gottfried was dismissed on March 14, 2011, due to jokes on Gottfried's Twitter account referencing the Thoku earthquake and tsunami. Gottfried was dismissed on March 14, 11 years as the voice of the Aflac Duck was replaced by television advertising sales manager from Hugo, Minnesota and the first Aflac commercial featuring the new voice aired May 1, 2011. In 2018, an Aflac inserted an animated Aflac duck into the opening credits of the DuckTales reboot.", "prediction 4": "Aflac is an American insurance company that provides supplemental health insurance to individuals and families based in Columbus, Georgia. Gilbert Gottfried does the voice of the Aflac duck in various commercials, including those for the 1996 commercial, the 2004 commercial, the 2005 commercial, the 2009 commercial, the 2010 commercial, the 2011 commercial, and the 2018 Aflac ad inserted an animated Aflac duck into the opening credits of the DuckTales reboot.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 325 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 458 }, { "error type": "Irrelevant", "explanation": "", "start": 520, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 583, "end": 654 }, { "error type": "Irrelevant", "explanation": "", "start": 655, "end": 728 } ], "missing-info": [], "corrected-prediction": "Aflac Inc. is an American insurance company. The duck was originally voiced by comedian Gilbert Gottfried, who was dismissed on March 14, 2011. Daniel McKeague, a television advertising sales manager from Minnesota, was announced to be the new voice of the Aflac duck." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sings she's got bette davis eyes?", "passages": [ [ "Kim Carnes", "In 1981, Carnes recorded the Jackie DeShannon and Donna Weiss song \"Bette Davis Eyes,\" which had originally been written and composed in 1974.", "As the first single released from the album \"Mistaken Identity,\" it spent nine weeks at number one on the US singles charts and became a worldwide hit.", "The song's success propelled the album to number one for four weeks.", "The single became the biggest hit of the entire year for 1981, and is second only to Olivia Newton-John's \"Physical\" as the biggest hit of the 1980s in the USA, according to Billboard.", "The song earned both the Record of the Year and Song of the Year awards at the 1982 Grammy Awards.", "Carnes was nominated for Best Pop Female, and \"Mistaken Identity\" also earned a nomination for Album of the Year.", "Two follow-up singles were released from the album, the title track and \"Draw of the Cards,\" which also charted in the UK and Australia.", "Carnes and her band rehearsed \"Bette Davis Eyes\" in the studio for three days to take the melody and overall sound of the record to a darker, more haunting place.", "Keyboard player Bill Cuomo came up with the signature instrumental lick and together with the band and producer Val Garay created a completely new arrangement of the song, which was recorded the next day with no overdubs." ], [ "Bette Davis Eyes", "Bette Davis Eyes\n\n\"Bette Davis Eyes\" is a song written and composed by Donna Weiss and Jackie DeShannon, and made popular by American singer Kim Carnes.", "DeShannon recorded it in 1974; Carnes's 1981 version spent nine weeks at No. 1 on the \"Billboard\" Hot 100 and was \"Billboard\"s biggest hit of 1981.", "The song was written in 1974 by Donna Weiss and Jackie DeShannon.", "DeShannon recorded the song that same year on her album \"New Arrangement.\"", "In this original incarnation, the track is performed in an \"R&B lite\" arrangement, featuring a prominent uptempo piano part, as well as flourishes of pedal steel guitar and horns.", "However, it was not until 1981, when Kim Carnes recorded her version of the song in a radically different synthesizer-based arrangement, that \"Bette Davis Eyes\" became a commercial success.", "The Carnes version spent nine non-consecutive weeks on top of the US \"Billboard\" Hot 100 (interrupted for one week by the \"Stars on 45 Medley\") and was \"Billboard\"s biggest hit of the year for 1981.", "The single also reached No. 5 on Billboard's Top Tracks charts and No. 26 on the Dance charts.", "The song won the Grammy Awards for Song of the Year and Record of the Year." ], [ "Duets (film)", "The CD contained twelve tracks, including the original music composed for the film by David Newman.", "The actors who sang their own tunes in the film, and included on the CD, are: Huey Lewis, Gwyneth Paltrow, Paul Giamatti, and Maria Bello.", "Arnold McCuller sings all of Andre Braugher's songs including Lynyrd Skynyrd's \"Free Bird\", performed \"a cappella\".", "The soundtrack spawned two hit singles in Australasia, with Gwyneth Paltrow and Huey Lewis' \"Cruisin'\" spending two weeks at No. 1 in Australia and five weeks at No. 1 in New Zealand, with Paltrow's \"Bette Davis Eyes\" also becoming a top 3 hit in Australia.", "Michael Bubl\u00e9 has a cameo singing \"Strangers in the Night\", but the song is not included on the soundtrack." ] ], "gold": "Bette Davis Eyes is a song first recorded by Jackie DeShannon in 1974. The song was made popular by American singer Kim Carnes in 1981. Carnes's 1981 version spent nine non-consecutive weeks at number one on the Billboard Hot 100 and was Billboard's biggest hit of 1981. Additionally, the song won the Grammy Awards for Song of the Year and Record of the Year. American actress Gwyneth Paltrow also recorded a cover of Bette Davis Eyes that was included on the soundtrack to the 2000 road trip film Duets.", "prediction 1": "\"Bette Davis Eyes\" is a song written and composed in 1974 by Donna Weiss and Jackie DeShannon, and made popular by American singer Kim Carnes. DeShannon recorded the song that same year on her album New Arrangement; Carnes's 1981 version spent nine non-consecutive weeks on top of the US Billboard Hot 100 and was Billboard's biggest hit of 1981. The song won the Grammy Awards for Song of the Year and Record of the Year.\n", "prediction 2": "\"Bette Davis Eyes\" is a song written and composed in 1974 by Donna Weiss and Jackie DeShannon, and made popular by American singer Kim Carnes. In this original incarnation, the track is performed in an \"R&B lite\" arrangement, featuring a prominent uptempo piano part, as well as flourishes of pedal steel guitar and horns. However, it was not until 1981, when Carnes recorded her version of the song in a radically different synthesizer-based arrangement, that the song became a commercial success. In the movie \"Duets\", Michael Buble has a cameo singing \"Strangering\", but the song is not included on the soundtrack.", "prediction 3": "\"Bette Davis Eyes,\" a song written and composed by Donna Weiss and Jackie DeShannon, is sung by several individuals and was made popular by American singer Kim Carnes. DeShannon recorded the song in 1974, but it wasn't until 1981, when Carnes recorded her version in a radically different synthesizer-based arrangement, that \"Bette Davis Eyes\" became a commercial success.", "prediction 4": "\"Bette Davis Eyes\" is a song written and composed by Donna Weiss and Jackie DeShannon, and made popular by American singer Kim Carnes. DeShannon recorded the song in 1974, but Carnes's 1981 version spent nine non-consecutive weeks on top of the US Billboard Hot 100 and was \"Billboard's biggest hit of 1981.\" The film and video for the song \"My Life Is Such A Beautiful Thing\" have been in the public domain ever since, and the video for several years later.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 215 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Bette Davis Eyes\" is a song first recorded by Jackie DeShannon in 1974, and made popular by American singer Kim Carnes in 1981. Carnes's 1981 version spent nine non-consecutive weeks on top of the US Billboard Hot 100 and was Billboard's biggest hit of 1981. The song won the Grammy Awards for Song of the Year and Record of the Year. The actress Gwyneth Paltrow also recorded the song that was included on the soundtrack to the film Duets.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What's the zip code for saugus mass?", "passages": [ [ "Saugus, Massachusetts", "Saugus, Massachusetts\n\nSaugus is a town in Essex County, Massachusetts, United States, in the Greater Boston area.", "The population was 26,628 at the 2010 census.", "Saugus was first settled in 1629.", "Saugus is a Native American (Algonquin) name believed to mean \"great\" or \"extended\".", "In 1637, the territory known as Saugus (which also contained the present day cities and towns of Swampscott, Nahant, Lynn, Lynnfield, Reading, and Wakefield) was renamed Lin or Lynn, after King's Lynn in Norfolk, England.", "In 1646, the Saugus Iron Works, then called Hammersmith, began operations.", "It was the first integrated iron works in North America as well as one of the most technologically advanced in the world.", "The Iron Works produced over one ton of iron a day, but was not financially successful.", "It closed around 1670.", "In September 1687, Major Samuel Appleton was said to have given a speech from a rocky cliff near the Iron Works denouncing the tyranny of Colonial Governor Sir Edmund Andros.", "The place where he is said to have delivered the speech became known as Appleton's Pulpit.", "Nearly 100 men from Saugus fought in the American Revolutionary War." ], [ "Saugus, Santa Clarita, California", "Saugus, Santa Clarita, California\n\nSaugus is a neighborhood in Santa Clarita, California.", "Saugus was one of four communities (along with Valencia, Newhall, and Canyon Country) that merged in 1987, to create the city of Santa Clarita.", "Saugus is named after the town of Saugus, Massachusetts, the hometown of Henry Newhall, upon whose land the town was originally built.", "The Saugus Cafe, on San Fernando Road, was established in 1887 and is among the oldest restaurants in Los Angeles County.", "Saugus was first named Newhall by Henry M. Newhall, who had bought the eastern half of the Del Valle family\u2019s Rancho San Francisco from a series of speculators.", "After he moved the town south in 1879, he renamed its original site for his birthplace, Saugus, Massachusetts.", "In 2000, the total population of Saugus was 41,743, and its population density was 218 persons per square mile.", "The median age is 32.8 years.", "Average number of people per household is 3.1.", "66.7% of the population is married; 33.3% are single.", "Median household income is $80,940; per capita income is $29,816.", "Median home value is $532,700." ] ], "gold": "Saugus is a town in Essex County, Massachusetts in the Greater Boston area. The zip code for Saugus, Massachusetts is 01906. Saugus is also a neighborhood in Santa Clarita, California. The zip codes for the Saugus neighborhood in Santa Clarita, California are 91350, 91390.", "prediction 1": "Saugus is a town in Essex County, Massachusetts, United States, in the Greater Boston area. The town was first settled in 1629. Saugus is a Native American (Algonquin) name believed to mean \"great\" or \"extended\".", "prediction 2": "Saugus, Massachusetts is a town in Essex County, Massachusetts, United States, in the Greater Boston area. It is a Native American (Algonquin) name believed to mean \"great\" or \"extended\". The village of Saugus was first settled in 1629. The town was first named Newhall by Henry M. Newhall, upon whose land the town was originally built. The village of Saugus is named after Henry Newhall, upon whose land the town was originally built. The city of Saugus, California is a neighborhood in Santa Clarita, which merged in 1987, to create the city of Santa Clarita.", "prediction 3": "Saugus, Massachusetts is a town in Essex County, Massachusetts, United States, in the Greater Boston area. The population was 26,628 at the 2010 census.", "prediction 4": "Saugus is a town in Essex County, Massachusetts, United States, in the Greater Boston area. The population was 26,628 at the 2010 census. The town was first settled in 1629 and is named after Henry Newhall, upon whose land the town was originally built. Saugus is also the name of a neighborhood in Santa Clarita, California.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 212 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Saugus is a town in Essex County, Massachusetts, United States, in the Greater Boston area. Saugus is also a neighborhood in Santa Clarita, California." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "How many books in the wizard of oz?", "passages": [ [ "Dorothy and the Wizard in Oz", "Dorothy and the Wizard in Oz\n\nDorothy and the Wizard in Oz is the fourth book set in the Land of Oz written by L. Frank Baum and illustrated by John R. Neill.", "It was published on June 18, 1908 and reunites Dorothy with the humbug Wizard from \"The Wonderful Wizard of Oz\" (1900).", "This is one of only two of the original fourteen Oz books (the other being \"The Emerald City of Oz\" (1910), to be illustrated with watercolor paintings.", "Baum, having resigned himself to writing a series of Oz books, set up elements of this book in the prior \"Ozma of Oz\" (1907).", "He was not entirely pleased with this, as the introduction to \"Dorothy and the Wizard of Oz\" opens with the protest that he knows many tales of many lands, and hoped that children would permit him to tell them those tales.", "Written shortly after the 1906 San Francisco earthquake and around the time Baum moved to California, the book starts with an earthquake in California.", "Dorothy and others are swallowed up by cracks in the earth, and fall into an underground cavern, where they begin their adventures.", "Very little of the story\u2014six of the twenty chapters\u2014actually takes place in Oz." ], [ "John Dough and the Cherub", "The Great Elixir is comparable to the Powder of Life that is a key element in Baum's fantasy domain.", "Baum mixes technology into his Oz fantasies and into \"John Dough\" as well; aircraft and incubators were recent developments in 1906.", "The divided country of Hiland and Loland foreshadows the similarly divided country of \"Sky Island\" (1912).", "The \"fairy beavers\" are a kind of animal spirit Baum employs in his \"The Life and Adventures of Santa Claus\".", "The gem-encrusted underground realm of the fairy beavers resembles the domain of the Nome King in the Oz books.", "John Dough, Chick the Cherub, and Para Bruin make cameo appearances in the fifth Oz book, \"The Road to Oz\" (1909).", "A mifket makes a brief appearance in the tenth Oz book, \"Rinkitink in Oz\" (1916).", "Jack Snow used characters from the story of \"John Dough\" in his 1949 book \"The Shaggy Man of Oz\".", "The novel has been adapted into film twice, both under the direction of Otis Turner, first as a 40-minute segment of \"The Fairylogue and Radio-Plays\" (1908), then again as a ten-minute short in 1910.", "Both of these films are lost." ], [ "Evan Dahm", "In this series, Dahm and his colleagues aim to present the works of various webcomic creators specifically.", "In an interview with \"Comics Alliance\", Dahm stated that he had difficulty working together with people to get these books published, as he has gotten used to publishing his own work without any interference.", "In 2014, Evan Dahm illustrated a new edition of L. Frank Baum \"The Wonderful Wizard of Oz\".", "Funded through a Kickstarter campaign, this edition includes a hundred of illustrations, among which 24 full-page illustrations.", "In an interview with \"io9\", Dahm stated that he had been thinking of doing illustrations for a public domain book for a while at that point and wanted to create drawings that support the text rather than being the \"main thing\".", "Dahm first read the book one or two years before starting the campaign.", "Dahm noted that the setting is often the most important part of a story to him, and while the places in \"The Wonderful Wizard of Oz\" aren't well-described, Dahm stated that capturing the atmosphere of them was a \"fun challenge\".", "In 2016, Dahm started a new Kickstarter campaign to give Herman Melville's \"Moby-Dick\" a similar treatment, incorporating 53 full-page ink illustrations into the novel." ] ], "gold": "The original and canonical Oz books by L. Frank Baum include 14 full-length Oz books, beginning with The Wonderful Wizard of Oz. Including compilations, there are 18 books in the Wizard of Oz. In addition to the canonical Oz books, several of Baum's works that are not Oz stories are set in the same fictional universe as the Oz books, and include character crossovers and including these works, there are 24 books in the Wizard of Oz. These compilations include: Queen Zixi of Ix, The Magical Monarch of Mo, The Sea Fairies, Sky Island, The Life and Adventures of Santa Claus, and John Dough and the Cherub.", "prediction 1": "There are 14 books in The Wizard of Oz, published by L. Frank Baum and illustrated by John R. Neill. The first two are Dorothy and the Wizard of Oz and the third is The Wonderful Wizard of Oz.", "prediction 2": "There are several books in the book series The Wizard of Oz. The first four books were published in 1900, and the fifth was published in 1909.", "prediction 3": "The Wonderful Wizard of Oz is a book series written by L. Frank Baum and illustrated by John R. Neill. There are 14 books in the series, which includes Dorothy and the Wizard in Oz. In 2014, Evan Dahm illustrated a new edition of the book. Funded through a Kickstarter campaign, this edition includes 200 illustrations, among which 24 full-page illustrations.", "prediction 4": "There are a total of 14 books in the Wizard of Oz. There are three books set in the Land of Oz, and there are five books set in the Land of Oz. The first book, The Wonderful Wizard of Oz, was written and illustrated by L. Frank Baum. There are also several books set in the Land of Oz.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 100 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 105, "end": 114 }, { "error type": "Unverifiable", "explanation": "", "start": 156, "end": 161 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 22, "end": 35 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "There are 14 original books in the Oz series, published by L. Frank Baum. Books like John Dough has characters featured in the Oz books as well." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Where is yale university located city and state?", "passages": [ [ "Yale University", "Yale University\n\nYale University is an American private Ivy League research university in New Haven, Connecticut.", "Founded in 1701, it is the third-oldest institution of higher education in the United States and one of the nine Colonial Colleges chartered before the American Revolution.", "Chartered by Connecticut Colony, the \"Collegiate School\" was established by clergy to educate Congregational ministers.", "It moved to New Haven in 1716 and shortly after was renamed Yale College in recognition of a gift from British East India Company governor Elihu Yale.", "Originally restricted to theology and sacred languages, the curriculum began to incorporate humanities and sciences by the time of the American Revolution.", "In the 19th century, the college expanded into graduate and professional instruction, awarding the first Ph.D. in the United States in 1861 and organizing as a university in 1887.", "Its faculty and student populations grew after 1890 with rapid expansion of the physical campus and scientific research.", "Yale is organized into fourteen constituent schools: the original undergraduate college, the Yale Graduate School of Arts and Sciences and twelve professional schools.", "While the university is governed by the Yale Corporation, each school's faculty oversees its curriculum and degree programs.", "In addition to a central campus in downtown New Haven, the University owns athletic facilities in western New Haven, a campus in West Haven, Connecticut and forest and nature preserves throughout New England." ], [ "New Haven, Connecticut", "The city served as co-capital of Connecticut from 1701 until 1873, when sole governance was transferred to the more centrally located city of Hartford.", "New Haven has since billed itself as the \"Cultural Capital of Connecticut\" for its supply of established theaters, museums, and music venues.", "New Haven had the first public tree planting program in America, producing a canopy of mature trees (including some large elms) that gave New Haven the nickname \"The Elm City\".", "Before Europeans arrived, the New Haven area was the home of the Quinnipiac tribe of Native Americans, who lived in villages around the harbor and subsisted off local fisheries and the farming of maize.", "The area was briefly visited by Dutch explorer Adriaen Block in 1614.", "Dutch traders set up a small trading system of beaver pelts with the local inhabitants, but trade was sporadic and the Dutch did not settle permanently in the area.", "In 1637 a small party of Puritans reconnoitered the New Haven harbor area and wintered over.", "In April 1638, the main party of five hundred Puritans who had left the Massachusetts Bay Colony under the leadership of the Reverend John Davenport and London merchant Theophilus Eaton sailed into the harbor." ] ], "gold": "Yale University is a private Ivy League research university in New Haven, Connecticut. New Haven had the first public tree planting program in America, producing a canopy of mature trees, including some large elms, that gave the city the nickname \"The Elm City\". ", "prediction 1": "Yale University is an American private Ivy League research university in New Haven, Connecticut. The university was founded in 1701 and is the third-oldest institution of higher education in the United States and one of the nine Colonial Colleges chartered before the American Revolution. Chartered by Connecticut Colony, the \"Collegiate School\" was established by clergy to educate Congregational ministers. It moved to New Haven in 1716 and shortly after was renamed Yale College in recognition of a gift from British East India Company governor Elihu Yale.", "prediction 2": "Yale University is an American private Ivy League research university located in New Haven, Connecticut. Founded in 1701, it is the third-oldest institution of higher education in the United States and one of the nine Colonial Colleges chartered before the American Revolution. Founded in 1716, Yale College was renamed in recognition of a gift from British East India Company governor Elihu Yale. The university owns athletic facilities in western New Haven, a campus in West Haven, Connecticut and forest and nature preserves throughout New England.", "prediction 3": "The Yale University campus is located in New Haven, Connecticut, which is also the city and state of Connecticut. Yale University is a private Ivy League research university that was founded in 1701. The university is headquartered in New Haven, Connecticut, which is part of the state of Connecticut and serves as the co-capital of Connecticut from 1701 until 1873, when sole governance was transferred to the more centrally located city of Hartford.", "prediction 4": "Yale is an American private Ivy League research university located in New Haven, Connecticut. Founded in 1701, it is the third-oldest institution of higher education in the United States and one of the nine Colonial Colleges chartered before the American Revolution. In addition to a central campus in downtown New Haven, the University owns athletic facilities in western New Haven, a campus in West Haven, Connecticut and forest and nature preserves throughout New England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 559 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Yale University is an American private Ivy League research university in New Haven, Connecticut. New Haven had the first public tree planting program in America, producing a canopy of mature trees (including some large elms) that gave New Haven the nickname \"The Elm City\"." }, "preference": [ 0, 2, 2, 2, 2, 0 ] }, { "question": "Where was the creature from the black lagoon made?", "passages": [ [ "Creature from the Black Lagoon", "Many of the on-top of the water scenes were filmed at Rice Creek near Palatka, Florida.", "The costume made it impossible for Chapman to sit for the 14 hours of each day that he wore it, and it overheated easily, so he stayed in the back lot's lake, often requesting to be hosed down.", "He also could not see very well while wearing the headpiece, which caused him to scrape Julie Adams' head against the wall when carrying her in the grotto scenes.", "Ricou Browning played the Gill-Man in the underwater shots, which were filmed by the second unit in Wakulla Springs, Florida.", "\"Creature from the Black Lagoon\" received positive reviews from critics upon its release and is now considered a classic.", "Leonard Maltin awarded the film three out of a possible four stars, writing, \"Archetypal '50s monster movie has been copied so often that some of the edge is gone, but ... is still entertaining, with juicy atmosphere and luminous underwater photography sequences.\"", "Film review aggregator Rotten Tomatoes reports an approval rating of 84%, based on , with an overall rating average of 6.9/10." ], [ "Creature from the Black Lagoon: The Musical", "Creature from the Black Lagoon:", "The Musical\n\nCreature From the Black Lagoon:", "The Musical was a live performance show formerly located at the Universal Studios Hollywood theme park in Los Angeles, California.", "It debuted on July 1, 2009, replacing \"Fear Factor LIVE\".", "As of March 9, 2010, this show was officially closed.", "The musical at Universal Studios Hollywood was loosely based on the basic plot of the 1954 Universal film.", "The show began with a clip from \"The Today Show\" with Matt Lauer, talking about the Creature.", "The premise was that Universal made the film based on a real creature, and a new team of explorers were on a second expedition to investigate, the principals being Kay, Mark & David (all characters which also appeared in the original film).", "Aboard the Rita, the Captain (which in this version, is an Amazonian woman - a voo-doo Shirley Bassey) leads the cast in the opening number, \u201cBlack Lagoon\".", "Kay vents her romantic frustrations with her fianc\u00e9 in the second song, \u201cSlay Me\".", "The song recreates the famous \"swimming sequence\" from the original movie, in which Kay swims while the Creature observes her below, tantalized.", "The next song is \u201cPrime Evil\", in which everyone sings about the Creature." ], [ "Creature from the Black Lagoon", "Creature from the Black Lagoon\n\nCreature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International, produced by William Alland, directed by Jack Arnold, that stars Richard Carlson, Julia Adams, Richard Denning, Antonio Moreno and Whit Bissell.", "The Creature was played by Ben Chapman on land and by Ricou Browning underwater.", "The film premiered in Detroit on February 12 and was released on a regional basis, opening on various dates.", "\"Creature from the Black Lagoon\" was filmed in 3D and originally projected by the polarized light method.", "The audience wore viewers with gray polarizing filters, similar to the viewers most commonly used today.", "Because the brief 1950s 3D film fad had peaked in mid-1953 and was fading fast in early 1954, many audiences actually saw the film \"flat\", in 2D. Typically, the film was shown in 3D in large downtown theaters and flat in smaller neighborhood theaters.", "In 1975 \"Creature from the Black Lagoon\" was re-released to theaters in the inferior red-and-blue-glasses anaglyph 3D format, which was also used for a 1980 home video release on Beta and VHS videocassettes.", "For marketing reasons, a comedic appearance with Abbott and Costello on an episode of \"The Colgate Comedy Hour\" aired prior to the film's release." ] ], "gold": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International. Many of the on-water scenes were filmed at Rice Creek near Palatka, Florida. Ben Chapman portrayed the Gill-Man for the majority of the scenes shot at Universal City, California. Ricou Browning played the Gill-Man in the underwater shots, which were filmed by the second unit in Wakulla Springs, Florida. Creature From the Black Lagoon: The Musical was a live performance show formerly located at the Universal Studios Hollywood theme park in Los Angeles, California.", "prediction 1": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International. The movie premiered in Detroit on February 12, 1954. Many of the on-top of the water scenes were filmed at Rice Creek near Palatka, Florida. The film was filmed in 3D in a facility on the Hollywood peninsula called The Studios and in Florida on a second property called Wakulla Springs, Florida. The live performance show Creature From the Black Lagoon: The movie was filmed in Wakulla Springs, Florida.", "prediction 2": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International. The film was made in the United States and was shot on location at Rice Creek near Palatka, Florida. The live performance show Creature from the Black Lagoon: The Musical was formerly located at the Universal Studios Hollywood theme park in Los Angeles, California. The musical was loosely based on the basic plot of the 1954 Universal monster film.", "prediction 3": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International, produced by William Alland and directed by Jack Arnold. The film was originally made in Michigan and was later released in 3D in various theaters throughout the United States. The live performance show Creature From the Black Lagoon: The Musical was formerly located at the Universal Studios Hollywood theme park in Los Angeles, California. The show was loosely based on the basic plot of the 1954 Universal film.", "prediction 4": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International, produced by William Alland, directed by Jack Arnold, that stars Richard Carlson, Julia Adams, Richard Denning, Antonio Moreno and Whit Bissell. The film premiered in Detroit on February 12, 1954 and was released on a regional basis, opening on various dates. The film was filmed in 3D and originally projected by the polarized light method, and the audience wore viewers with gray polarizing filters, similar to today.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 171 }, { "error type": "Incoherent", "explanation": "", "start": 415, "end": 522 }, { "error type": "Unverifiable", "explanation": "", "start": 260, "end": 414 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Creature from the Black Lagoon is a 1954 American black-and-white 3D monster horror film from Universal-International. Many of the on-top of the water scenes were filmed at Rice Creek near Palatka, Florida. The Creature was played by Ben Chapman on land. Ricou Browning played the Gill-Man in the underwater shots, which were filmed by the second unit in Wakulla Springs, Florida. The Musical was a live performance show formerly located at the Universal Studios Hollywood theme park in Los Angeles, California. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is the chief judge of gujarat high court?", "passages": [ [ "Ramayyagari Subhash Reddy", "Ramayyagari Subhash Reddy\n\nRamayyagari Subhash Reddy is the judge of Supreme Court of India since 2 November 2018.", "Prior to his elevation to the bench of Supreme Court, he was the Chief Justice of the of the Gujarat High Court.", "He is set to retire on 4 January 2022.", "Shri Justice Ramayyagari Subhash Reddy, B.Sc., LL.B., was born on 5 January 1957.", "He was enrolled as an Advocate on 30 October 1980 and practiced at Tribunals, Civil Courts and Andhra Pradesh High Court including before the Supreme Court in Civil, Criminal, Constitutional, Revenue, Taxation, Labour, Company and Service matters in both original and appellate side.", "His field of specialization is in Constitutional Law.", "He was appointed as an Additional Judge of the Andhra Pradesh High Court on 2 December 2002.", "He was appointed as Permanent Judge on 24 June 2004.", "He was appointed as Chief Justice of Gujarat High Court on 13 February 2016.", "He was appointed as Judge of Supreme Court of India on 2 November 2018." ], [ "Bhaskar Bhattacharya", "Bhaskar Bhattacharya\n\nBhaskar Bhattacharya ((born: 29 September 1952) is a former Chief Justice of Gujarat High Court.", "Bhattacharya passed B.Sc. and LL.B. from the Jogesh Chandra Chaudhuri Law College, University of Calcutta.", "He was enrolled as an Advocate on 14 March 1975 and started practise in civil matters in the Calcutta High Court.", "He became senior Advocate in 1994.", "Bhattacharya was appointed as a permanent Judge of the Calcutta High Court on 17 July 1997.", "He was transferred to Gujarat High Court and joined there on 8 November 2011 and became the Chief Justice on 18 July 2012.", "He retired on 28 September 2014 from the post." ] ], "gold": "R. Subhash Reddy was appointed the 24th Chief Justice of Gujarat High Court on 13 February 2016. Reddy succeeded the 23rd Chief Justice Bhaskar Bhattacharya. Bhattacharya was preceded by the 22nd Chief Justice S J Mukhopadhaya. ", "prediction 1": "Ramayyagari Subhash Reddy was the chief justice of the Gujarat High Court from January 1957 to July 2012. He retired on August 2014, and was succeeded on August 2015 by Bhaskar Bhattacharya.", "prediction 2": "Ramayyagari Subhash Reddy is the judge of Supreme Court of India since 2 November 2018. He was the Chief Justice of the Gujarat High Court from 2013-2017. Bhaskar Bhattacharya was the former Chief Justice of the Gujarat High Court, from 2011-2012.", "prediction 3": "Chief justice of Gujarat High Court was Ramayyagari Subhash Reddy, who served from January 1, 1957 to July 31, 2012. Ramayyagari Subhash Reddy, born on 5 January 1957, is the judge of Supreme Court of India since 2 November 2018.", "prediction 4": "Shri Justice Ramayyagari Subhash Reddy is the judge of Supreme Court of India since 2 November 2018. Prior to his elevation to the bench of Supreme Court, he was the Chief Justice of the Gujarat High Court. He is set to retire on 4 January 2022. Former Chief Justice Bhaskar Bhattacharya was the Chief Justice of Gujarat High Court.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 74, "end": 105 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 141, "end": 165 } ], "missing-info": [], "corrected-prediction": "Ramayyagari Subhash Reddy was the chief justice of the Gujarat High Court, appointed on 13 February 2016. He succeeded Bhaskar Bhattacharya." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who voices beast in beauty and the beast 2017?", "passages": [ [ "Evan Spiliotopoulos", "Evan Spiliotopoulos\n\nEvan Spiliotopoulos is a Greek-American screenwriter, best known for writing \"Hercules\", \"Tinker Bell and the Lost Treasure\" and \"Beauty and the Beast\".", "He also wrote the script for the film \"\".", "Spiliotopoulos was born in Greece, and graduated from high school there.", "Soon after, he moved to the United States and attended the University of Delaware to get an undergraduate degree in film theory; he then attended American University for a master's degree in Screenwriting.", "After moving to Los Angeles in 1995, his first job in the industry was in a television film \"Trial by Fire\" as an intern.", "In 2014, Spiliotopoulos re-wrote the screenplay for the action-adventure fantasy film \"Hercules\", original written by Ryan J. Condal.", "Brett Ratner directed the film which released on July 25, 2014 by Paramount Pictures.", "Spiliotopoulos wrote the screenplay of action-adventure fantasy film \"\", along with Craig Mazin, and rewritten by Frank Darabont.", "Cedric Nicolas-Troyan directed the film, which was released on April 22, 2016 by Universal Pictures.", "Spiliotopoulos and Stephen Chbosky wrote Walt Disney Pictures' live action musical romantic fantasy film \"Beauty and the Beast\", which was directed by Bill Condon." ], [ "Jonathan Jackson (actor)", "Jonathan Jackson (actor)\n\nJonathan Stevens Jackson (born May 11, 1982) is an American actor, musician (see Enation) and author.", "His first well known character was Lucky Spencer on the ABC Daytime soap opera \"General Hospital\", a role that has won him five Emmy Awards.", "In 2002, he played Jesse Tuck in the film \"Tuck Everlasting\".", "In 2004 he started the band Enation with his brother, actor and drummer Richard Lee Jackson and friend Daniel Sweatt.", "From 2012\u20132018, he portrayed Avery Barkley in the ABC/CMT musical drama series, \"Nashville\".", "Jackson was born in Orlando, Florida, the son of Jeanine (n\u00e9e Sharp), an amateur ventriloquist and businesswoman, and Dr. Rick \"Ricky Lee\" Jackson, a family physician, country musician and Congressional candidate in the state of Washington.", "Jackson was raised in Battle Ground, Washington with his brother Richard Lee Jackson, now an actor and musician, and his sister Candice Jackson, now a lawyer, author, and official in the Trump administration.", "Jonathan attended Meadow Glade Elementary school.", "In 1991, Jackson's family took a trip to Universal Studios Hollywood, where both Richard and Jonathan decided to pursue acting.", "The brothers took acting lessons in nearby Portland, Oregon, before moving part-time to Burbank, California with their mother in 1993." ], [ "Days in the Sun", "It is performed by Adam Mitchell as the young Beast, Emma Watson as Belle, and Stanley Tucci, Ewan McGregor, Gugu Mbatha-Raw, Ian McKellen, Emma Thompson, Audra McDonald, and Clive Rowe as the Beast's enchanted servants.", "\"Days in the Sun\" is played three times during the film.", "It is first heard performed by Audra McDonald as part of a debutante ball.", "Director Bill Condon identified it as a lullaby the Beast's mother sang for him and said the court had chosen its most celebrated diva to appeal to the Beast.", "The song, which Menken called \"a combination of a lullaby and a remembrance of happier days for everybody\", is performed again by Belle and the servants as they go to bed.", "Its opening lyrics explores the Beast's childhood.", "In the scene, the young Prince\u2014before he becomes the Beast\u2014sings \"Days in the Sun\" for his dying mother.", "The lyrics include the lines: \"Days in the sun / When my life has barely begun / Not until my whole life is done /", "Will I ever leave you\".", "The song progresses to his servants discussing what they miss about their lives as humans, and their guilt for not preventing the Beast from being spoiled and eventually cursed." ] ], "gold": "Beauty and the Beast is a 2017 American musical romantic fantasy film directed by Bill Condon from a screenplay by Stephen Chbosky and Evan Spiliotopoulos. British actor Daniel Jonathan Stevens voiced the older Beast. Adam Mitchell voiced the young Beast.", "prediction 1": "Adam Mitchell voices the young Beast in the 2017 version of Beauty and the Beast. He is joined by Emma Watson as Belle and the Beast's enchanted servants, who are played by Stanley Tucci, Ewan McGregor, Gugu Mbatha-Raw, Emma Thompson, Audra McDonald, and Clive Rowe.", "prediction 2": "In 2017 the role of Beast is voiced by Adam Mitchell. In the 2017 version of the film, the Beast is voiced by Jonathan Jackson.", "prediction 3": "In 2017 the Beast is voiced by Adam Mitchell. In 2017 the Beast is voiced by Jonathan Jackson.", "prediction 4": "Adam Mitchell voices the young Beast in Beauty and the Beast 2017. The Beast is voiced by Emma Watson and is portrayed by Jonathan Jackson.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 81 }, { "error type": "Unverifiable", "explanation": "", "start": 82, "end": 266 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Spiliotopoulos and Stephen Chbosky wrote Walt Disney Pictures' live action musical romantic fantasy film \"Beauty and the Beast\". " }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When did the buffalo bills last make the playoffs?", "passages": [ [ "Buffalo Bills", "Buffalo Bills\n\nThe Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area.", "The Bills compete in the National Football League (NFL), as a member club of the league's American Football Conference (AFC) East division.", "The team plays their home games at New Era Field in Orchard Park, New York.", "The Bills are the only NFL team that plays its home games in the state of New York.", "The Bills conduct summer training camp at St. John Fisher College in Pittsford, New York, an eastern suburb of Rochester.", "The Bills began play as an original franchise of the American Football League (AFL) in 1960.", "The club joined the NFL as a result of the AFL\u2013NFL merger for the 1970 season.", "The 1964 and 1965 Bills were the only teams representing Buffalo that won major league professional sports championships (\"back-to-back\" American Football League Championships).", "The Bills are the only team to win four consecutive conference championships and are the only NFL team to lose four consecutive Super Bowl games.", "The team was owned by Ralph Wilson from the team's founding in 1960, until his death in 2014 at the age of 95.", "After his death, Wilson's estate reached an agreement to sell the team to Terry and Kim Pegula, which was approved by the other NFL team owners on October 8, 2014." ], [ "1966 Buffalo Bills season", "1966 Buffalo Bills season\n\nThe 1966 Buffalo Bills season was the team\u2019s seventh season in the American Football League.", "It was the first season for head coach Joe Collier, who had been the Bills' defensive coordinator for the previous four seasons.", "It ended with a loss in the AFL Championship Game to the Kansas City Chiefs, ending the team's two-year reign as league champions.", "The score was 31-7 during the time.", "The Bills allowed the fewest points in the AFL for the third consecutive year.", "Although defensive tackle Tom Sestak hampered by a bad knee, defensive linemen Jim Dunaway and Ron McDole took a leadership position.", "Linebackers Mike Stratton, Harry Jacobs and John Tracey, and defensive backs George Saimes, Butch Byrd, Hagood Clarke and Tom Janik provided a strong defensive foundation.", "Halfback Bobby Burnett and split end Bobby Crockett joined long-time Bills running back Wray Carlton and quarterback Jack Kemp, leading Buffalo's offense to scoring 358 points, second-most in the AFL in 1966.", "Burnett's 1,185 total yards from scrimmage were 5th in the AFL, and garnered AFL Rookie of the Year honors for Burnett.", "Lou Saban, who had coached the Bills to consecutive AFL Championships, left the team after the 1965 season to coach at the University of Maryland." ], [ "Buffalo Bills", "The Bills' uniform received minor alterations as part of the league's new uniform contract with Nike.", "The new Nike uniform was unveiled on April 3, 2012.", "On November 12, 2015, the Bills and the New York Jets became the first two teams to participate in the NFL's Color Rush uniform initiative, with Buffalo wearing an all-red combination for the first time in team history.", "A notable use of the Bills' uniforms outside of football was in the 2018 World Junior Ice Hockey Championships, when the United States men's national junior ice hockey team wore Bills-inspired uniforms in their outdoor game against Team Canada on December 29, 2017.", "The Bills have rivalries with their three AFC East opponents, and also have had occasional or historical rivalries with other teams such as the Baltimore/Indianapolis Colts (a former divisional rival), Kansas City Chiefs, Houston Oilers/Tennessee Titans, Cleveland Browns, and Dallas Cowboys.", "They also play an annual preseason game against the Detroit Lions.", "This is often considered Buffalo's most famous rivalry.", "Though the Bills and Dolphins both originated in the American Football League, the Dolphins did not start playing until 1966 as an expansion team while the Bills were one of the original eight teams.", "The rivalry first gained prominence when the Dolphins won every match-up against the Bills in the 1970s for an NFL-record 20 straight wins against a single opponent." ] ], "gold": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area who made it to the playoffs several times. They lost 1966 AFL to the Kansas City Chiefs ending the team's two-year reign as league champions. They possessed the longest active playoff drought: they did not qualify to play in the NFL playoffs from 1999 until 2017\u201318 NFL playoffs. Since then, the Bills have reached the playoffs in two of the past three NFL seasons and also clinched their first 10-win season in two decades in December 2019.", "prediction 1": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area. They compete in the National Football League (NFL) as a member club of the league's American Football Conference East division. The team last made the playoffs in the 2017 season. The team last made the playoffs in the 2018 season.", "prediction 2": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area. They compete in the National Football League (NFL) as a member club of the league's American Football Conference East division. The last time the Buffalo Bills made the playoffs was in 1974.", "prediction 3": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area. The team competes in the National Football League, as a member club of the league's American Football Conference East division. The last time the Buffalo Bills made the playoffs was in 2007.", "prediction 4": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area. The team competes in the National Football League as a member club of the league's American Football Conference East division. The team last made the playoffs in 2018. The team last made the playoffs in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 241 }, { "error type": "Unverifiable", "explanation": "", "start": 242, "end": 293 }, { "error type": "Unverifiable", "explanation": "", "start": 294, "end": 345 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Buffalo Bills are a professional American football team based in the Buffalo\u2013Niagara Falls metropolitan area. They lost 1966 AFL to the Kansas City Chiefs ending the team's two-year reign as league champions. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "When was the last honda civic hatchback made?", "passages": [ [ "Honda Civic", "In Japan, as customers increasingly shifted to minivans and compact cars like the Fit, production of the non-hybrid Civic ended in August 2010 when it no longer complied with Japanese government dimension regulations in the width category.", "However, the Civic was reintroduced into the Japanese market with the launch of the tenth-generation model in 2017.", "After a period of developing idiosyncratic automobiles such as the lukewarmly received domestic Honda 1300, Honda considered pulling out of automobile manufacturing altogether by the early 1970s.", "However, the more conventional Civic's release in 1972 immediately changed things, thanks to its economy, reliability and low cost in an era of rising fuel prices.", "Honda's CVCC technology helped it make it affordable, meeting 1970s and early 1980s emission standards without an expensive catalytic converter.", "The first generation Honda Civic was introduced on 11 July 1972, but sold as a 1973 model in Japan.", "It was equipped with a four-cylinder water-cooled engine and featured front power disc brakes, reclining vinyl bucket seats, simulated wood trim on the dashboard, as well as optional air conditioning and an AM/FM radio.", "The Civic was available as a coupe, both a three- and a five-door hatchback, as well as a five-door station wagon." ], [ "Honda Civic (ninth generation)", "The new Honda Civic Type R posted a 7:50.63, beating the Renault by over three seconds, but the record was soon broken by VW GTI again \n\nAs Honda's Research and Development Centre at Tochigi, Japan was damaged in the March 2011 earthquake, designers of the European Civic were transferred to the Swindon plant in the UK, where all European Civic hatchbacks are built, to ensure the development is not delayed.", "Production at Swindon, UK, was disrupted by supply chain disruption caused by the 2011 Japanese tsunami and flooding in Thailand.", "Normal production of Civic did not start until December 2011, causing the new Civic to not be available on the market until February 2012.", "The Automobile R&D Center of Honda R&D Co., Ltd. developed the engine for 2013 Honda Civic WTCC, while M-TEC Co., Ltd. manufactured and maintained 2013 Honda Civic WTCC.", "JAS Motorsport of Italy, was responsible for vehicle body development and manufacturing, as well as team operations.", "Production of Civic 5-door hatchback began at Honda of the UK Manufacturing Limited by in November 2011.", "Civic Tourer was built at Honda of the UK Manufacturing Ltd in Swindon alongside the Civic hatchback variant.", "The 1.6 and 2.2 i-DTEC engines used in Honda Civic were built at Honda's Swindon plant in the UK." ], [ "Honda Civic Type R", "In 2001 Honda introduced the next generation of the Civic Type R as a unique 3-door hatchback to the UK market, which was manufactured in Swindon, England.", "This European Domestic Market Civic Type R featured a 2.0L i-VTEC engine (K20A2) and the regular Type R treatment of seam welding, close ratio 6-speed transmission and uprated brakes, but did not include some of the other higher-end features, such as the helical LSD and red Recaro race-seats, that were standard in the previous generation EK9.", "However, Honda of Japan marketed a JDM (Japanese domestic market) version of the EP3 (which was exclusively manufactured in Swindon, UK and was shipped to Japan), which retained the highly renowned helical LSD similar to that of the EK9 and red Recaro race-seats.", "Other differences included a more track-oriented chassis/undercarriage settings as compared to the EDM, as well as a i-VTEC engine (K20A) had a fully balanced crankshaft assembly with different intake manifold, exhaust manifold, higher-lift camshafts, higher-compression pistons, chrome-moly flywheel and ECU programming." ] ], "gold": "The Honda Civic is a series of automobiles manufactured by Honda since 1972. The Honda Civic 5-door Liftback-Hatchback was last made in 2001. The Honda Civic 3-door Hatchback was last made in 2011. The Honda Civic 5-door Hatchback is still currently being made.", "prediction 1": "The last honda civic hatchback was made in October 2001. The last five-door Honda Civic was made on October 29, 2001. The last four-door Honda Civic was made on October 7, 2001.", "prediction 2": "The last honda civic hatchback was produced on January 31, 2014 and was the 1.6-litre K20 A2 model. The second generation of the Civic hatchback was produced on April 19, 2013 and was sold in Japan in April 2014, and in the US in June 2017. The sixth generation of the Civic hatchback was produced from November 2011 to December 2012, and the seventh generation was manufactured in April 2015 to October 2016.", "prediction 3": "Honda's Research and Development Centre at Tochigi, Japan was damaged in the March 2011 earthquake, so designers of the European Civic were transferred to the Swindon plant in the UK, where all European Civic hatchbacks are built, to ensure the development is not delayed. Normal production of Civic did not start until December 2011, causing the new Civic not be available on the market until February 2012. In 2001 Honda introduced the next generation of the Civic Type R as a unique 3-door hatchback to the UK market, which was manufactured in Swindon, England.", "prediction 4": "The last honda civic hatchback was made in November 2011. The last honda civic hatchback was manufactured in August 10, 2010, in Japan. The last honda civic hatchback was manufactured in September 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 57, "end": 117 }, { "error type": "Unverifiable", "explanation": "", "start": 118, "end": 177 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Honda Civic is a series of automobiles manufactured by Honda since 1972. Production of Civic 5-door hatchback began at Honda of the UK Manufacturing Limited by in November 2011. In 2001 Honda introduced the next generation of the Civic Type R as a unique 3-door hatchback." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who developed the first widely used system for naming plants and animals?", "passages": [ [ "Binomial nomenclature", "Binomial nomenclature\n\nBinomial nomenclature (\"two-term naming system\") also called nomenclature (\"two-name naming system\") or binary nomenclature, is a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages.", "Such a name is called a binomial name (which may be shortened to just \"binomial\"), a binomen, name or a scientific name; more informally it is also called a Latin name.", "The first part of the name \u2013 the \"generic name\" \u2013 identifies the genus to which the species belongs, while the second part \u2013 the specific name or specific epithet \u2013 identifies the species within the genus.", "For example, humans belong to the genus \"Homo\" and within this genus to the species \"Homo sapiens\".", "\"Tyrannosaurus rex\" is probably the most widely known binomial.", "The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753.", "But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinax theatri botanici\" (English, \"Illustrated exposition of plants\") many names of genera that were later adopted by Linnaeus." ], [ "Carl Linnaeus", "Carl Linnaeus\n\nCarl Linnaeus (; 23 May 1707 \u2013 10 January 1778), also known after his ennoblement as Carl von Linn\u00e9 (), was a Swedish botanist, physician, and zoologist who formalised binomial nomenclature, the modern system of naming organisms.", "He is known as the \"father of modern taxonomy\".", "Many of his writings were in Latin, and his name is rendered in Latin as (after 1761 Carolus a Linn\u00e9).", "Linnaeus was born in the countryside of Sm\u00e5land in southern Sweden.", "He received most of his higher education at Uppsala University and began giving lectures in botany there in 1730.", "He lived abroad between 1735 and 1738, where he studied and also published the first edition of his \" in the Netherlands.", "He then returned to Sweden where he became professor of medicine and botany at Uppsala.", "In the 1740s, he was sent on several journeys through Sweden to find and classify plants and animals.", "In the 1750s and 1760s, he continued to collect and classify animals, plants, and minerals, while publishing several volumes.", "He was one of the most acclaimed scientists in Europe at the time of his death.", "Philosopher Jean-Jacques Rousseau sent him the message: \"Tell him I know no greater man on earth.\"" ], [ "Binomial nomenclature", "For example, Gerard's herbal (as amended by Johnson) describes various kinds of spiderwort: \"The first is called \"Phalangium ramosum\", Branched Spiderwort; the second, \"Phalangium non ramosum\", Unbranched Spiderwort.", "The other ... is aptly termed \"Phalangium Ephemerum Virginianum\", Soon-Fading Spiderwort of Virginia\".", "The Latin phrases are short descriptions, rather than identifying labels.", "The Bauhins, in particular Caspar Bauhin (1560\u20131624), took some important steps towards the binomial system, by pruning the Latin descriptions, in many cases to two words.", "The adoption by biologists of a system of strictly binomial nomenclature is due to Swedish botanist and physician Carl von Linn\u00e9, more commonly known by his Latinized name Carl Linnaeus (1707\u20131778).", "It was in his 1753 \"Species Plantarum\" that he first began consistently using a one-word \"trivial name\" together with a generic name in a system of binomial nomenclature.", "This trivial name is what is now known as a specific epithet (\"ICNafp\") or specific name (\"ICZN\")." ] ], "gold": "The individuals who introduced many names of genera that were later adopted in the first widely used system for naming plants an animals were Caspar Bauhin, who is known for pruning the Latin descriptions, and Gaspard Bauhin, who is known for his book Pinax theatri botanici that featured many names of genera that were later adopted by Carl Linnaeus. Carl Linnaeus is credited with the formal introduction of the first widely used system for naming plants and animals, as he was a Swedish botanist, zoologist, taxonomist, and physician who formalized binomial nomenclature, which is the modern system of naming organisms. He is known as the \"father of modern taxonomy\". ", "prediction 1": "The first widely used system for naming plants and animals is binomial nomenclature, also known as nomenclature or binary nomenclature, a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages. The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work \"Species Plantarum\" in 1753. But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinatri botanici\", which later adopted many names of genera that were later adopted by Linnaeus.", "prediction 2": "The first widely used system for naming plants and animals is binomial nomenclature, which is a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages. Gaspard Bauhin introduced in 1623 some names of genera that were later adopted by Linnaeus. Swedish botanist, physician, and zoologist Carl Linnaeus is known as the \"father of modern taxonomenclature\".", "prediction 3": "The first widely used system for naming plants and animals is binomial nomenclature. This system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms, although they can be based on words from other languages. Carl Linnaeus, the Swedish botanist, physician, and zoologist who developed this system of naming species, is credited with inventing the two-term naming system. This system of naming species is known as binomial nomenclature, the modern system of naming organisms. Gaspard Bauhin, in as early as 1623, had introduced in his book Pinax theatriatrivial name, which identifies the genus to which the species belongs, while the specific name or specific epithet identifies the species within the genus.", "prediction 4": "The system of strictly binomial nomenclature is due to Swedish botanist and physician Carl von Linn\u00e9, more commonly known by his Latinized name Carl Linnaeus, who in 1753 developed a system for consistently using a one-word \"trivial name\" together with a generic name in a system of binomial nomenclature. Gaspard Bauhin had introduced in 1623 many names of genera that were later adopted by Linnaeus. The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, effectively beginning with his work Species Plantarum in 1753. But Bauhin, in as early as 1623, had introduced in his book Pinax theatri botatriatri exposition of plants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 486 }, { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 21 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 332 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The system for naming plants and animals is binomial nomenclature, also known as nomenclature or binary nomenclature, a formal system of naming species of living things by giving each a name composed of two parts, both of which use Latin grammatical forms. The \"formal\" introduction of this system of naming species is credited to Carl Linnaeus, a Swedish botanist, physician, and zoologist. He is known as the \"father of modern taxonomy\". But Gaspard Bauhin, in as early as 1623, had introduced in his book \"Pinatri botanici\", which later adopted many names of genera that were later adopted by Linnaeus." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What year is it according to persian calendar?", "passages": [ [ "Iranian calendars", "Iranian calendars\n\nThe Iranian calendars ( \"G\u00e2h-Shom\u00e2riye \u012ar\u00e2ni\") are a succession of calendars invented or used for over two millennia in Iran and formerly Persia.", "One of the longest chronological records in human history, the Iranian calendar has been modified time and time again during its history to suit administrative, climatic, and religious purposes.", "The modern Iranian calendar is currently the official calendar in Iran.", "It begins at the midnight nearest to the instant of the vernal equinox as determined by astronomical calculations for the Iran Standard Time meridian (52.5\u00b0E or GMT+3.5h).", "It is, therefore, an observation-based calendar, unlike the Gregorian, which is rule-based.", "The Iranian year usually begins within a day of 21 March of the Gregorian calendar.", "To find the corresponding year of the Gregorian calendar, add 621 or 622 (depending on the time of the year) to a solar hijri year.", "A short table of year correspondences between the Persian and Gregorian calendars is provided below.", "Although the earliest evidence of Iranian calendrical traditions is from the second millennium BCE, predating the appearance of the Iranian prophet Zoroaster, the first fully preserved calendar is that of the Achaemenids.", "Throughout recorded history, Persians have been keen on the idea and importance of having a calendar." ] ], "gold": "The Persian Calendars are a succession of calendars invented or used for over two millennia in Iran and one of the longest chronological records in human history. The year 2017 was equivalent to the year 1395 on the Persian Calendar, meaning that 2016 and 2015 were equivalent to 1394 and 1393 respectively. ", "prediction 1": "The Iranian calendars are a succession of calendars invented or used for over two millennia in Iran and formerly Persia. According to the Persian calendar, the year 2019 is the first year, 2021 the second year, and 2022 the third year.", "prediction 2": "The Persian calendars are a succession of calendars invented or used for over two millennia in Iran and formerly Persia. The modern Iranian calendar is currently the official calendar in Iran. The Iranian year usually begins within a day of 21 March of the Gregorian calendar. To find the corresponding year of the Gregorian calendar, add 621 or 622 (depending on the time of the year) to a solar hijri year.", "prediction 3": "The Persian calendars are a succession of calendars invented or used for over two millennia in Iran and formerly Persia. It was created by the ancient Persians and evolved over time to suit administrative, climatic, and religious purposes. The year in the Persian calendar is the solar hijri year, which begins on the last day of December and ends on the first day of January.", "prediction 4": "The Persian calendars are a succession of calendars invented or used for over two millennia in Iran and formerly Persia. Throughout recorded history, Persians have been keen on the idea and importance of having a calendar. The modern Iranian calendar, which is currently the official calendar in Iran, begins at the midnight nearest to the instant of the vernal equinox as determined by astronomical calculations for the Iran Standard Time meridian. To find the corresponding year of the Gregorian calendar, add 621 or 622 (depending on the time of a solar hijri year) to a solar hijri year.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 121, "end": 235 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Iranian calendars are a succession of calendars invented or used for over two millennia in Iran and formerly Persia and one of the longest chronological records in human history. second year, and 2022 the third year." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What is nota in indian election in hindi?", "passages": [ [ "None of the above", "In the 2014 general election, NOTA polled 1.1% of the votes, counting to over 6,000,000.", "The specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015.", "The symbol is designed by National Institute of Design, Ahmedabad.", "The Indonesian Law 10 of 2016 regulates local elections, and includes provisions for elections in which there is only one candidate.", "In such cases, the candidate contests the election against a NOTA option (commonly referred to as \"kotak kosong\"/empty box), and is declared the winner if they manage to secure a majority of the valid votes.", "Otherwise, the election will be postponed to the next occurrence; the government of Indonesia appoints an acting office holder until the new election, in which the losing candidate is eligible to stand again.", "There were 3 uncontested seats in the 2015 local elections, nine in the 2017 local elections, and at least 13 in the 2018 local elections (including the mayoral elections for Tangerang and Makassar).", "In the 2018 election for mayor of Makassar, the NOTA option received over 300,000 votes, 35,000 more than the sole candidate, forcing a repeat election in 2020.", "UK electoral counting procedures require that all votes be counted and announced, including 'rejected' votes." ], [ "None of the above (India)", "None of the above (India)\n\nNOTA or 'None of the Above' has been provided as an option to the voters of India in most elections.", "Through the usage of NOTA, a citizen can choose not to vote for any candidates who are contesting the elections.", "However, NOTA in India does not guarantee dismissal of the winning candidate.", "Therefore, it\u2019s only a method to give a negative feedback.", "NOTA does not hold any electoral value even if the maximum votes are for NOTA, the candidate with maximum vote share will still be the winner.", "A writ petition was filed by People's Union for Civil Liberties (PUCL).", "The Supreme Court of India judgment said, \"\"We direct the Election Commission to provide necessary provision in the ballot papers/EVMs and another button called \u201cNone of the Above\u201d (NOTA) may be provided in EVMs so that the voters, who come to the polling booth and decide not to vote for any of the candidates in the fray, are able to exercise their right not to vote while maintaining their right of secrecy\".\"", "The Supreme Court also observed that it is essential that people of high moral and ethical values are chosen as people's representatives for proper governance of the country, and NOTA button can compel political parties to nominate a sound candidate." ], [ "Election Commission of India", "However ration cards have been allowed for election purposes in certain situations.", "In 1998, the commission decided on a programme for the 'computerisation' of the electoral rolls.", "The introduction of Voter-verified paper audit trail (VVPAT) in eight Lok Sabha constituencies in 2014 Indian General Elections was a big achievement for the Election Commission.", "This Voter-verified paper audit trail (VVPAT) system was first used with EVMs in a by-poll in September 2013 in Noksen (Assembly Constituency) in Nagaland.", "and eventually in all elections from September 2013 onwards in various Legislative elections in the country.", "In 2014, None of the above or NOTA was also added as an option on the voting machines which is now a mandatory option to be provided in any election.", "The specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015.", "The symbol has been designed by National Institute of Design, Ahmedabad.", "With the Bihar Legislative Assembly election, 2015, the state became the first to have photo electoral rolls, with photographs of the candidates on the EVMs.", "The Election Commission of India came under severe criticism when an RTI application filed by activist Dr Satendra Singh revealed the commission's ill-preparedness to safeguard electors with disabilities in the 2014 Lok Sabha elections." ] ], "gold": "\"None of the Above\" (or NOTA) has been provided as an option to the voters of India in most elections since 2009. The specific symbol for NOTA in India, a ballot paper with a black cross across it, was introduced on 18 September 2015. ", "prediction 1": "In India, the specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015. The specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015.\n", "prediction 2": "In the 2014 Indian General Elections None of the above option was also added as an option on the voting machines, which is now a mandatory option to be provided in any election. In Indonesia's 2015 local elections, *None of the Above* or NUTA for \u2018No Vote Above\u2019 was introduced with the ballot paper, and the specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015. *None of the Above in India does not guarantee dismissal of the winning candidate.", "prediction 3": "In Indian elections, there is a policy called \"None of the Above\" or \"None of the Above\". It is a list of election conditions and is an alternative to mandatory electoral participation. In 1996, the law was amended to include an option called \"None of the Above,\" which is a voting paper with a black cross across it, which is also known as \"empty box\".", "prediction 4": "In Indian elections, the specific option NOTA was introduced as a ballot paper with a cross across it on 18 September 2015. This was after the election in 2014 where it polled 1.1% of the votes, counting to over 6,000,000. The specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "In India, the specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015. ", "start": 122, "end": 234 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "None of the above (India) NOTA or 'None of the Above' has been provided as an option to the voters of India in most elections. The specific symbol for NOTA, a ballot paper with a black cross across it, was introduced on 18 September 2015.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where is handmaid's tale supposed to take place?", "passages": [ [ "The Handmaid's Tale", "The Handmaid's Tale\n\nThe Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985.", "It is set in a near-future New England, in a totalitarian state resembling a theonomy, which has overthrown the United States government.", "The novel focuses on the journey of the handmaid Offred.", "Her name derives from the possessive form \"of Fred\"; handmaids are forbidden to use their birth names and must echo the male, or master, whom they serve.", "\"The Handmaid's Tale\" explores themes of women in subjugation in a patriarchal society and the various means by which these women attempt to gain individualism and independence.", "The novel's title echoes the component parts of Geoffrey Chaucer's \"The Canterbury Tales\", which is a series of connected stories (\"The Merchant's Tale\", \"The Parson's Tale\", etc.).", "\"The Handmaid's Tale\" is structured into two parts, night and other various events.", "This novel can be interpreted as a double narrative, Offred's tale and the handmaids' tales.", "The night sections are solely about Offred, and the other sections (shopping, waiting room, household, etc.)" ] ], "gold": "The Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, published in 1985. It is set in a near-future New England, in a strongly patriarchal, totalitarian state resembling a theonomy, known as Republic of Gilead, that has overthrown the United States government. The central character and narrator is a woman named Offred, one of the group known as \"handmaids\", who are forcibly assigned to produce children for the \"commanders,\" who are the ruling class of men.", "prediction 1": "The Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985. It is set in a near-future New England, in a totalitarian state resembling a theonomy, which has overthrown the United States government. The novel focuses on the journey of the handmaid Offred, whose name derives from the possessive form \"of Fred\". Handmaids are forbidden to use their birth names and must echo the male, or master, whom they serve.", "prediction 2": "The handmaid's tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985. The novel is set in a near-future New England in a totalitarian state resembling a theonomy, which has overthrown the United States government. The novel focuses on the journey of the handmaid Offred.", "prediction 3": "The Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985. It is set in a near-future New England, in a totalitarian state resembling a theonomy, which has overthrown the United States government. The novel focuses on the journey of the handmaid Offred.", "prediction 4": "The Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985. The novel is set in a near-future New England, in a totalitarian state resembling a theonomy, which has overthrown the United States government. The novel focuses on the journey of the handmaid Offred, whose name derives from the possessive form \"of Fred\"; handmaids are forbidden to use their birth names and must echo the male, or master, whom they serve.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 457 } ], "missing-info": [], "corrected-prediction": "The Handmaid's Tale is a dystopian novel by Canadian author Margaret Atwood, originally published in 1985. It is set in a near-future New England, in a totalitarian state resembling a theonomy, which has overthrown the United States government. The novel focuses on the journey of the handmaid Offred, whose name derives from the possessive form \"of Fred\". " }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "Who is the current leader of the official opposition in ontario?", "passages": [ [ "Andrea Horwath", "Andrea Horwath\n\nAndrea Horwath, (; born October 24, 1962) is a Canadian politician and community development coordinator who is the Leader of the Official Opposition in Ontario and Leader of the Ontario New Democratic Party.", "She is a member of the Legislative Assembly of Ontario, representing the riding of Hamilton Centre, and was chosen as the party's leader at its 2009 leadership convention.", "She is the first woman to lead the Ontario New Democratic Party, and one of only three women to serve as leader of a political party with representation in the provincial legislature (former Ontario Liberal Party leaders Kathleen Wynne and Lyn McLeod are the other two).", "Horwath was born and raised in Hamilton, Ontario, and has a Bachelor of Arts degree in Labour Studies from McMaster University.", "She worked part-time as a waitress to pay her way through university.", "Her father Andrew, an ethnic Hungarian, had immigrated to Canada from Slovakia, and worked on the assembly line at the Ford Motor Company plant in Oakville, Ontario.", "Her mother, Diane, is of French and Irish descent.", "She worked closely with the Hamilton labour movement for several years, programming and providing literacy, numeracy and ESL training for workers." ], [ "Vic Fedeli", "Vic Fedeli\n\nVictor Anthony \"Vic\" Fedeli (born August 8, 1956) is a Canadian politician who is currently serving as the Minister of Finance of Ontario since June 29, 2018, and served as Leader of the Official Opposition in Ontario from January to June 2018.", "Fedeli became interim leader of the Progressive Conservative Party of Ontario and Leader of the Official Opposition in Ontario in January 2018 and continued to serve as Leader of the Opposition after Doug Ford became party leader at the Progressive Conservative Party leadership election on March 10, 2018, as Ford did not have a seat in the Ontario legislature at that time.", "Fedeli was unanimously chosen as interim leader by the PC caucus on January 26, 2018, one day after the resignation of Patrick Brown due to sexual misconduct allegations.", "Fedeli has been the Member of Provincial Parliament (MPP) representing Nipissing since his election in the 2011 general election, the party's Finance Critic, and was mayor of North Bay, Ontario, from 2003 to 2010.", "In 2014, he announced his candidacy for the 2015 Ontario PC leadership race but later withdrew and endorsed Christine Elliott.", "In June 2018 he was sworn in as Ontario's Minister of Finance in the new Ford Administration.", "Fedeli was born and raised in North Bay, to Lena (n\u00e9e Fava) Fedeli and Hub Fedeli." ], [ "Progressive Conservative Party of Ontario", "Other party members, such as former Mike Harris chief of staff Guy Giorno and interim Leader of the Opposition Bob Runciman, supported John Tory, saying that his opponents should accept the results and move on.", "John Tory announced his pending resignation as leader on March 6, 2009; the day following his defeat in a by-election for Haliburton\u2014Kawartha Lakes\u2014Brock.", "On June 27, 2009, party members elected Tim Hudak as the party's new leader.", "Christine Elliott, Frank Klees, and Randy Hillier were the unsuccessful candidates.", "Hudak led the Tories through two elections.", "In the 2011 provincial election, the McGuinty Liberal government was reduced to a minority.", "Hudak's Tories were widely expected to win the 2014 provincial election but the Liberals, now led by Kathleen Wynne, were returned with a majority government largely due to Hudak's campaign pledge to cut 100,000 public service jobs by attrition rather than by layoffs.", "Hudak resigned in the aftermath.", "On July 2, 2014, Jim Wilson was chosen by the Progressive Conservative caucus to be its interim leader until the 2015 leadership election.", "The Ontario PC Party's 2014 platform promised the following policies:\n\n\nOn May 9, 2015, the membership elected Patrick Brown, a federal Conservative MP from Barrie, as the leader of the party." ] ], "gold": "The current and 38th Leader of the Official Opposition in Ontario is Andrea Horwath of the New Democratic Party, who has held the position since 2018. Prior to Horwath, the title belonged to a series of Progressive Conservative Party leaders, including 37th Opposition Leader Vic Fedeli, 36th Opposition Leader Patrick Brown, 35th Opposition Leader Jim Wilson, and 34th Opposition Leader Tim Hudak.", "prediction 1": "On July 2, 2014, Jim Wilson was chosen by the Progressive Conservative caucus to be its interim leader until the 2015 leadership election. On June 29, 2018, Victor Anthony \"Vic\" Fedeli became interim leader of the Progressive Conservative Party of Ontario and Leader of the Official Opposition in Ontario in January 2018.", "prediction 2": "The leader of the Official Opposition in Ontario is Andrea Horwath, a Canadian politician and community development coordinator who is the current leader. The current Leader of the Opposition is Victor Fedeli, who served as the Leader of the Opposition from January to June 2018.", "prediction 3": "On June 10, 2018, Doug Ford became leader of the Progressive Conservative Party of Ontario and Leader of the Official Opposition in Ontario. The Progressive Conservative Party of Ontario is the party that is currently leading Ontario's legislative body. In 2014, Jim Wilson was chosen by the Progressive Conservative caucus to be its interim leader until the 2015 leadership election. In 2018, Andrea Horwath was named Leader of the Official Opposition in Ontario and Leader of the Ontario New Democratic Party.", "prediction 4": "The current leader of the official opposition in Ontario is Andrea Horwath, former leader of the Progressive Conservative Party of Ontario and current leader of the Ontario New Democratic Party. The current leader of the opposition is Vic Fedeli, who has been leader of the opposition since June 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 138 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 139, "end": 156 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "On July 2, 2014, Jim Wilson was chosen by the Progressive Conservative caucus to be its interim leader. Patrick Brown was elected leader in 2015. Victor Anthony \"Vic\" Fedeli became interim leader of the Progressive Conservative Party of Ontario and Leader of the Official Opposition in Ontario in January 2018. Tim Hudak was the leader in 2009. Andrea Horwath is the leader now." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who demonstrated that a reflex could be conditioned to a neutral stimulus?", "passages": [ [ "Conditioned emotional response", "Conditioned emotional response\n\nThe term conditioned emotional response \"(CER)\" can refer to a specific learned behavior or a procedure commonly used in classical or Pavlovian conditioning research.", "It may also be called \"conditioned suppression\" or \"conditioned fear response (CFR).\"", "It is an \"emotional response\" that results from classical conditioning, usually from the association of a relatively neutral stimulus with a painful or fear-inducing unconditional stimulus.", "As a result, the formerly neutral stimulus elicits fear.", "For example, if seeing a dog (a neutral stimulus) is paired with the pain of being bitten by the dog (unconditioned stimulus), seeing a dog may become a conditioned stimulus that elicits fear (conditioned response).", "In 1920 John B. Watson and Rosalie Rayner demonstrated such fear conditioning in the Little Albert experiment.", "They started with a 9-month boy called \u201cAlbert\u201d, who was unemotional but was made to cry by the loud noise (unconditioned stimulus) of a hammer striking a steel bar.", "Albert initially showed no fear of a white rat (neutral stimulus), but after the sight of the rat had been accompanied five times by the loud noise, he cried and tried to escape the rat, showing that the rat had become a conditioned stimulus for fear." ], [ "Ivan Pavlov", "Ivan Pavlov\n\nIvan Petrovich Pavlov (; 27 February 1936) was a Russian physiologist known primarily for his work in classical conditioning.", "From his childhood days Pavlov demonstrated intellectual curiosity along with an unusual energy which he referred to as \"the instinct for research\".", "Inspired by the progressive ideas which D. I. Pisarev, the most eminent of the Russian literary critics of the 1860s, and I. M. Sechenov, the father of Russian physiology, were spreading, Pavlov abandoned his religious career and devoted his life to science.", "In 1870, he enrolled in the physics and mathematics department at the University of Saint Petersburg in order to study natural science.", "Pavlov won the Nobel Prize for Physiology or Medicine in 1904, becoming the first Russian Nobel laureate.", "A survey in the \"Review of General Psychology\", published in 2002, ranked Pavlov as the 24th most cited psychologist of the 20th century.", "Pavlov's principles of classical conditioning have been found to operate across a variety of behavior therapies and in experimental and clinical settings, such as educational classrooms and even reducing phobias with systematic desensitization.", "Ivan Pavlov, the eldest of eleven children, was born in Ryazan, Russian Empire." ], [ "Classical conditioning", "Pavlov concluded that if a particular stimulus in the dog's surroundings was present when the dog was given food then that stimulus could become associated with food and cause salivation on its own.", "In Pavlov's experiments the unconditioned stimulus (US) was the dog food because its effects did not depend on previous experience.", "The metronome's sound is originally a neutral stimulus NS because it does not elicit salivation in the dogs.", "After conditioning, the metronome's sound becomes the conditioned stimulus (CS)\" or conditional stimulus; because its effects depend on its association with food.", "Likewise, the responses of the dog follow the same conditioned-versus-unconditioned arrangement.", "The conditioned response (CR) is the response to the conditioned stimulus, whereas the unconditioned response (UR)\"' corresponds to the unconditioned stimulus.", "Pavlov reported many basic facts about conditioning; for example, he found that learning occurred most rapidly when the interval between the CS and the appearance of the US was relatively short.", "As noted earlier, it is often thought that the conditioned response is a replica of the unconditioned response, but Pavlov noted that saliva produced by the CS differs in composition from that produced by the US." ] ], "gold": "might become a conditioned stimulus when used together with an unconditioned stimulus. Russian physiologist Ivan Pavlov is best-known for demonstrating that a reflex could be conditioned to a neutral stimulus. He conducted multiple experiments investigating digestion in dogs in which neutral, unconditioned, and conditioned stimuli were used. Edwin Burket Twitmyer, a professor of Psychology and director of the Psychological Laboratory and Clinic at the University of Pennsylvania, independently discovered classical conditioning at approximately the same time as the Pavlov, but this achievement is typically unrecognized.", "prediction 1": "John B. Watson and Rosalie Rayner demonstrated that a reflex can be conditioned to a neutral stimulus. The results of their study were published in the journal Physiological Journal. In 1920, John B. Watson and Rosalie Rayner demonstrated such fear conditioning in the Little Albert experiment. The experiment involved a 9-month-old boy called Albert, who was unemotional but was made to cry by the loud noise of a hammer striking a steel bar. After conditioning, the metronome's sound becomes the conditioned stimulus (CS), or conditional stimulus.", "prediction 2": "In 1920 John B. Watson and Rosalie Rayner demonstrated that a reflex could be conditioned to a neutral stimulus in the Little Albert experiment. They started with a 9-month boy called Albert, who was unemotional but was made to cry by the loud noise of a hammer striking a steel bar. After conditioning, the metronome's sound became the conditioned stimulus, or conditional stimulus. In 1890, Ivan Ivan Petrovich Pavlov demonstrated that a reflex could be conditioned to a neutral stimulus. In 1920, John B. Watson and Rosalie Rayner demonstrated such fear conditioning in the Little Albert experiment.", "prediction 3": "In 1920 John B. Watson and Rosalie Rayner demonstrated that a reflex could be conditioned to a neutral stimulus in the Little Albert experiment. They started with a 9-month-old boy called Albert who was unemotional but was made to cry by the loud noise of a hammer striking a steel bar. After conditioning, the metronome's sound became the conditioned stimulus (CS) or conditional stimulus. Pavlov concluded that if a particular stimulus in the dog's surroundings was present when the dog was given food then that stimulus could become associated with food and cause salivation on its own.", "prediction 4": "In 1920 John B. Watson and Rosalie Rayner demonstrated that a reflex could be conditioned to a neutral stimulus in the Little Albert experiment. They started with a 9-month boy called Albert, who was unemotional but was made to cry by the loud noise of a hammer striking a steel bar. After conditioning, the metronome's sound became the conditioned stimulus (CS) or conditional stimulus, because its effects depend on its association with food. Pavlov concluded that if a particular stimulus in the dog's surroundings was present when the dog was given food then that stimulus could become associated with food and cause salivation on its own.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 182 }, { "error type": "Redundant", "explanation": "John B. Watson and Rosalie Rayner demonstrated that a reflex can be conditioned to a neutral stimulus. ", "start": 192, "end": 261 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2,3]}", "start": 468, "end": 485 }, { "error type": "Irrelevant", "explanation": "", "start": 486, "end": 549 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 463 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2, 3, 4, 5, 6 ] } ], "corrected-prediction": "John B. Watson and Rosalie Rayner demonstrated that a reflex can be conditioned to a neutral stimulus, in the 1920 Little Albert experiment. The experiment involved a 9-month-old boy called Albert, who was unemotional but was made to cry by the loud noise of a hammer striking a steel bar. Ivan Petrovich Pavlov was a Russian physiologist known primarily for his work in classical conditioning. He performed experiments on dog salivation to show neutral, conditioned and unconditioned stimuli effects. " }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When did arsenal won the premier league at white hart lane?", "passages": [ [ "North London derby", "Emmanuel Adebayor who played for both Tottenham and Arsenal is the top scorer of the North London derby with 10 goals scored (8 in the Premier League).", "Arsenal play their home games at the Emirates Stadium in Islington, while Tottenham Hotspur previously played their home games at White Hart Lane in Haringey until the end of the 2016\u201317 season.", "Spurs played their home games at Wembley Stadium for the 2017\u201318 campaign and will move into their new home, the Tottenham Hotspur Stadium, during the 2018\u201319 season.", "The first meeting between the two teams was a friendly on 19 November 1887, when Arsenal were located in Plumstead (then part of Kent but now in Greater London), and known as Royal Arsenal.", "The match, played at the then Spurs ground at Tottenham Marshes, was abandoned 15 minutes before it was due to end \"owing to darkness\" with Spurs leading 2\u20131.", "The first completed match between the two teams was held the following February in Plumstead; Tottenham could only field nine players, and were thus beaten 6\u20132.", "Another notable match was in 1898 played at the Spurs ground at Northumberland Park." ], [ "North London derby", "North London derby\n\nThe North London derby is the name of the association football local derby in England between two teams based in North London \u2013 Arsenal and Tottenham Hotspur.", "Both Arsenal and Tottenham fans have recognised each other as one of their biggest rivals, and the derby is one of the fiercest in world football.", "Although the two teams first played each other in 1887, the rivalry did not begin until 1913 when Arsenal moved their ground to north London.", "As of 19 December 2018, 184 games have been played between the two teams since their first game in the Football League in 1909, with 77 wins for Arsenal, 58 wins for Tottenham and 49 games drawn.", "When games played before Football League are included, 197 games have been played, with Arsenal winning 82, Tottenham 64, and 51 draws.", "Notable matches of the North London derby include the games where Arsenal won the league at White Hart Lane in 1971 and 2004, Tottenham beating Arsenal 5\u20130 at home in 1983 and Arsenal winning by the same score away in 1978, and Tottenham beating Arsenal 3\u20131 at the semi-final of the 1990\u201391 FA Cup which they went on to win.", "The highest-scoring game in the North London derby is the 5\u20134 win by Arsenal at White Hart Lane in November 2004." ] ], "gold": "Arsenal most recently won the Premier League at rival club Tottenham Hotspur's home stadium White Hart Lane on April 25, 2004. The only previous time Arsenal won the Premier League title at their rivals' home ground was on May 3, 1971.", "prediction 1": "The North London derby is an association football local derby in England between two teams based in North London \u2013 Arsenal and Tottenham Hotspur. Notable matches of the North London derby include the games where Arsenal won the league at White Hart Lane in 1971 and 2004, Tottenham beating Arsenal 5\u20130 at home in 1983 and Arsenal winning by the same score away in 1978, and Arsenal winning by the same score away in 1990\u201391 FA Cup which they went on to win.", "prediction 2": "The North London derby is an association football local derby in England between two teams based in North London, between Arsenal and Tottenham Hotspur. The 1971 premier league at White Hart Lane was won by Arsenal. The 2004 league was won by Arsenal. The 2017 league was won by Arsenal by Tottenham.", "prediction 3": "The North London derby is an association football local derby in England between two teams based in North London \u2013 Arsenal and Tottenham Hotspur. Notable matches of the North London derby include the games where Arsenal won the league at White Hart Lane in 1971 and 2004, Tottenham beating Arsenal 5\u20130 at home in 1983 and Arsenal winning by the same score away in 1978, and Arsenal winning by the same score away in 1979. The highest-scoring game in the North London derby is the 5\u20134 win by Arsenal at White Hart Lane in November 2004.", "prediction 4": "The North London derby is an association football local derby in England between two teams based in North London, Arsenal and Tottenham Hotspur. The North London derby is one of the fiercest in world football and the premier league is one of the fiercest in the world. The most recent time Arsenal have won the league at White Hart Lane was in November of 2004. Previous winners include the games where Arsenal won the league at White Hart Lane in 1971 and in 2004.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 145 }, { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 457 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": " Arsenal won the league at Tottenham Hotspur's home stadium, White Hart Lane, in 1971 and most recently 2004." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where does gluconeogenesis take place in eukaryotic cells?", "passages": [ [ "Metabolic pathway", "Metabolic pathway\n\nIn biochemistry, a metabolic pathway is a linked series of chemical reactions occurring within a cell.", "The reactants, products, and intermediates of an enzymatic reaction are known as metabolites, which are modified by a sequence of chemical reactions catalyzed by enzymes.", "In most cases of a metabolic pathway, the product of one enzyme acts as the substrate for the next.", "However, side products are considered waste and removed from the cell.", "These enzymes often require dietary minerals, vitamins, and other cofactors to function.", "Different metabolic pathways function based on the position within a eukaryotic cell and the significance of the pathway in the given compartment of the cell.", "For instance, the citric acid cycle, electron transport chain, and oxidative phosphorylation all take place in the mitochondrial membrane.", "In contrast, glycolysis, pentose phosphate pathway, and fatty acid biosynthesis all occur in the cytosol of a cell.", "There are two types of metabolic pathways that are characterized by their ability to either synthesize molecules with the utilization of energy (anabolic pathway) or break down of complex molecules by releasing energy in the process (catabolic pathway).", "The two pathways complement each other in that the energy released from one is used up by the other." ], [ "Gluconeogenesis", "Gluconeogenesis\n\nGluconeogenesis (GNG) is a metabolic pathway that results in the generation of glucose from certain non-carbohydrate carbon substrates.", "From breakdown of proteins, these substrates include glucogenic amino acids (although not ketogenic amino acids); from breakdown of lipids (such as triglycerides), they include glycerol, odd-chain fatty acids (although not even-chain fatty acids, see below); and from other steps in metabolism they include pyruvate and lactate.", "Gluconeogenesis is one of several main mechanisms used by humans and many other animals to maintain blood glucose levels, avoiding low levels (hypoglycemia).", "Other means include the degradation of glycogen (glycogenolysis) and fatty acid catabolism.", "Gluconeogenesis is a ubiquitous process, present in plants, animals, fungi, bacteria, and other microorganisms.", "In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys.", "In ruminants, this tends to be a continuous process.", "In many other animals, the process occurs during periods of fasting, starvation, low-carbohydrate diets, or intense exercise." ] ], "gold": "Gluconeogenesis is a metabolic pathway that results in the generation of glucose from certain non-carbohydrate carbon substrates. In vertebrates, this process can occur in both the kidneys and the liver. However, in mammals it can also take place within a muscle, the intestine and the astrocytes of the brain. Inside the eukaryotic cell itself, all this happens in the mitochondrion and cytosol.", "prediction 1": "In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys.", "prediction 2": "In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys. In ruminants, this tends to be a continuous process. In mammals, gluconeogenesis takes place in the spleen. In humans, gluconeogenesis takes place in the cytosol.", "prediction 3": "Gluconeogenesis is a metabolic pathway that results in the generation of glucose from certain non-carbohydrate carbon substrates. From breakdown of proteins, these substrates include glucogenic amino acids (although not ketogenic amino acids); from breakdown of lipids, they include glycerol, odd-chain fatty acids, and from other steps in metabolism they include pyruvate and lactate. In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys. In ruminants, this tends to be a continuous process.", "prediction 4": "Gluconeogenesis is a metabolic pathway that results in the generation of glucose from certain non-carbohydrate carbon substrates. In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys. In ruminants, this tends to be a continuous process.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Gluconeogenesis is a metabolic pathway that results in the generation of glucose from certain non-carbohydrate carbon substrates. In vertebrates, gluconeogenesis takes place mainly in the liver and, to a lesser extent, in the cortex of the kidneys." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What kind of car is in national lampoon's vacation?", "passages": [ [ "National Lampoon's Vacation", "The movie's popularity gave rise to an ongoing cultural running gag of using the name \"Wally World\" (spelled as \"Wally\" without an \"e\") as a nickname for real-life retailer Walmart.", "The Wagon Queen Family Truckster station wagon was created specifically for the film.", "It is based on a 1979 Ford LTD Country Squire station wagon.", "The car was designed by George Barris, and it lampooned American cars of the late 1970s.", "The Truckster features a pale avocado metallic green paint scheme; extensive imitation wood-paneling decals; eight headlights (the second pair was taken from another Crown Victoria/Country Squire and mounted upside-down below the stock pair); a grille area largely covered by bodywork with only two small openings close to the bumper; an oddly-placed fuel filler door; and an airbag made from a trashcan liner.", "In the 2015 film \"Vacation\" (a sequel to the original), the Wagon Queen Family Truckster reappears at the bed-and-breakfast garage of Clark and Ellen Griswold.", "The Truckster used in this later film is the creation of Lisa and Steve Griswold, a real-life family living in Atlanta, who created the replica wagon to take family trips with their two daughters." ], [ "National Lampoon's Vacation", "National Lampoon's Vacation\n\nNational Lampoon's Vacation, sometimes referred to as Vacation, is a 1983 American road comedy film directed by Harold Ramis and starring Chevy Chase, Beverly D'Angelo, Randy Quaid, Dana Barron, and Anthony Michael Hall.", "John Candy, Imogene Coca, Christie Brinkley, and a young Jane Krakowski appear in supporting roles.", "The screenplay was written by John Hughes, based on his short story \"Vacation '58\" which appeared in \"National Lampoon.", "The film was a box-office hit, earning more than $60 million in the US with an estimated budget of $15 million, and received positive reviews from critics.", "As a result of its success, four sequels have been produced: \"European Vacation\" (1985), \"Christmas Vacation\" (1989), \"Vegas Vacation\" (1997), and most recently, \"Vacation\" (2015) which serves as both a reboot and a continuation.", "In 2000, readers of \"Total Film\" voted it the 46th greatest comedy film of all time.", "It continues to be a cult film and a staple on cable television." ] ], "gold": "National Lampoon's Vacation, sometimes referred to as Vacation, is a 1983 American road comedy film directed by Harold Ramis, starring Chevy Chase, Beverly D'Angelo, Imogene Coca, Randy Quaid, John Candy, and Christie Brinkley in her acting debut. The Wagon Queen Family Truckster station wagon was created specifically for the film. It is based on a 1979 Ford LTD Country Squire station wagon. ", "prediction 1": "The National Lampoon's Vacation is a 1983 American road comedy film directed by Harold Ramis and starring Chevy Chase, Beverly D'Angelo, Randy Quaid, and Anthony Michael Hall. In the movie, the Wagon Queen Family Truckster station wagon was created specifically for the film. It is based on a 1979 Ford LTD Country Squire station wagon. In the 2015 sequel to the film, The Vacation, the Wagon Queen Family Truckster reappears at the bed-and-breakfast garage of Clark and Ellen Griswold. In the 2015 sequel, the Wagon Queen Family Truckster reappears at the bed-and-and-breakfast garage of Clark and Ellen Griswold. In the later film, the replica wagon reappears at the bed-and-and-breakfast garage of Clark and Ellen Griswold. In the 2015 film \"Vacation,\" the Truckster reappears", "prediction 2": "The 1983 American road comedy film National Lampoon's Vacation is based on the short story Vacation '58, which appeared in the National Lampoon magazine. The Wagon Queen Family Truckster station wagon was created specifically for the film. It is based on a 1979 Ford LTD Country Squire station wagon. The car was designed by George Barris, and it lampooned American cars of the late 1970's.", "prediction 3": "The 1983 American road comedy film National Lampoon's Vacation features a variety of cars, including the Wagon Queen Family Truckster, a station wagon created specifically for the film, and the 1979 Ford LTD Country Squire station wagon. In the 2015 film Vacation, a sequel to the original, the Wagon Queen Family Truckster reappears at the bed-and-breakfast garage of Clark and Ellen Griswold. In this sequel, the Wagon Queen Family Truckster is used as a recreation of the real-life Griswold, a real-life family living in Atlanta, who created the replica wagon to take family trips with their two daughters.", "prediction 4": "National Lampoon's Vacation is a 1983 American road comedy film directed by Harold Ramis and starring Chevy Chase, Beverly D'Angelo, Randy Quaid, Dana Barron, and Anthony Michael Hall. The movie lampoons American cars of the late 1970s, and features a Wagon Queen Family Truckster station wagon, which is based on a 1979 Ford LTD Country Squire station wagon. The truck features a pale avocado metallic green paint scheme, extensive imitation wood-paneling decals, an eight headlights, an oddly-placed fuel filler door and an airbag made from a trashcan liner. The Wagon Queen Family Truckster featured in the 2015 sequel to the original, the replica wagon was created by Lisa and Steve Griswold, a real-life family living in Atlanta, who created the replica wagon to take family trips with their two daughters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 337, "end": 486 }, { "error type": "Redundant", "explanation": "In the 2015 sequel to the film, The Vacation, the Wagon Queen Family Truckster reappears at the bed-and-breakfast garage of Clark and Ellen Griswold. ", "start": 487, "end": 614 }, { "error type": "Redundant", "explanation": "In the 2015 sequel to the film, The Vacation, the Wagon Queen Family Truckster reappears at the bed-and-breakfast garage of Clark and Ellen Griswold. ", "start": 615, "end": 726 }, { "error type": "Redundant", "explanation": "In the 2015 sequel to the film, The Vacation, the Wagon Queen Family Truckster reappears ", "start": 727, "end": 779 } ], "missing-info": [], "corrected-prediction": "The National Lampoon's Vacation is a 1983 American road comedy film directed by Harold Ramis and starring Chevy Chase, Beverly D'Angelo, Randy Quaid, and Anthony Michael Hall. In the movie, the Wagon Queen Family Truckster station wagon was created specifically for the film. It is based on a 1979 Ford LTD Country Squire station wagon. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who has the biggest ballpark in the mlb?", "passages": [ [ "Dodger Stadium", "Prior to 1976, the Dodgers were rained out only once, against the St. Louis Cardinals, on April 21, 1967, ending a streak of 737 consecutive games without a postponement.", "On April 12, 1976, the second home rainout ended a streak of 724 straight games.", "April 19\u201321, 1988 saw three consecutive rainouts, the only time consecutive games have been rained out at Dodger Stadium.", "No rainouts occurred between April 21, 1988 and April 11, 1999 \u2013 a major league record of 856 straight home games without a rainout.", "That record has since been broken, with no rainouts since April 17, 2000, 1,471 consecutive games through April 15th, 2018 \n\n", "In order to comply with a conditional-use permit limiting Dodger Stadium's seating capacity to 56,000 it was the only current MLB park (through 2005 ) that had never increased its capacity.", "Whenever higher revenue lower seats were added some in the upper deck or pavilion were removed to keep the number the same.", "Through the sale of standing room only tickets, the Dodgers' 2009 home opener drew 57,099 fans, the largest crowd in stadium history.", "Following a number of incidents in the early 1970s in which fans showered Cincinnati Reds left fielder Pete Rose with beer, bottles, cups, and trash, the sale of beer was discontinued in both pavilions." ], [ "Minute Maid Park", "Minute Maid Park\n\nMinute Maid Park, previously known as The Ballpark at Union Station, Enron Field, and Astros Field, is a ballpark in Downtown Houston, Texas, United States, that opened in 2000 to house the Houston Astros of Major League Baseball (MLB).", "The ballpark is Houston's first retractable-roofed stadium, and features a natural grass playing field.", "The ballpark was built as a replacement of the Astrodome, the first domed sports stadium ever built, which opened in 1965.", "It is named for beverage brand Minute Maid, a subsidiary of The Coca-Cola Company, which acquired naming rights in 2002 for $100 million over 30 years.", "As of 2016, Minute Maid Park has a seating capacity of 41,168, which includes 5,197 club seats and 63 luxury suites.", "In 1909, during the time when West End Park was Houston's premier ballpark, the Houston Belt and Terminal Railway Company commissioned the design of a new union station for the city from New York City-based architects Warren and Wetmore.", "The location called for the demolition of several structures of Houston prominence.", "Horace Baldwin Rice's residence and Adath Yeshurun Congregation's synagogue among other structures were removed.", "With an original estimated cost of $1 million USD, Union Station was constructed by the American Construction Company for an eventual total of five times that amount." ], [ "Dodger Stadium", "Dodger Stadium\n\nDodger Stadium, occasionally called by the metonym Chavez Ravine, is a baseball park located in the Elysian Park neighborhood of Los Angeles, California, the home field to the Los Angeles Dodgers, the city's National League franchise of Major League Baseball (MLB).", "Opened on April 10, 1962, it was constructed in less than three years at a cost of US$23 million, financed by private sources.", "Dodger Stadium is currently the oldest ballpark in MLB west of the Mississippi River, and third-oldest overall, after Fenway Park in Boston (1912) and Wrigley Field in Chicago (1914) and is the world's largest baseball stadium by seat capacity.", "Often referred to as a \"pitcher's ballpark\", the stadium has seen twelve no-hitters, two of which were perfect games.", "The stadium hosted the Major League Baseball All-Star Game in 1980 - and will host in 2020 - as well as games of 10 World Series (1963, 1965, 1966, 1974, 1977, 1978, 1981, 1988, 2017, and 2018).", "It also hosted the semifinals and finals of the 2009 and 2017 World Baseball Classics.", "It also hosted exhibition baseball during the 1984 Summer Olympics.", "It will also host baseball and softball during the 2028 Summer Olympics." ] ], "gold": "The biggest ballpark in the MLB by capacity is the Dodgers Stadium with a capacity of 56,000 people. The biggest ballpark in the MLB by field dimensions is the Houston Astros Stadium, currently called Minute Maid Park.", "prediction 1": "The world's largest baseball stadium by seat capacity is at Dodger Stadium located in Los Angeles, California, and is the home field of the Los Angeles Dodgers. Prior to 1976, the Dodgers were rained out only once, against the St. Louis Cardinals, on April 21, 1967, ending a streak of 737 consecutive games without a postponement. As of 2016, Minute Maid Park has a seating capacity of 41,168, which includes 5,197 club seats and 63 luxury suites.", "prediction 2": "The world's largest baseball stadium by seat capacity is the Dodger Stadium in Los Angeles, California, USA. As of June 30, 2016, Minute Maid Park has a seating capacity of 42,168, which includes 5,197 club seats and 63 luxury suites. The ballpark was built in 2000 to house the Houston Astros of Major League Baseball. The stadium is the oldest in MLB west of the Mississippi River and third-oldest overall, after Fenway Park in Boston (1912) and Wrigley Field in Chicago (1914).", "prediction 3": "The MLB currently has 17 stadiums with the largest seats, and the stadium with the largest capacity is the Dodger Stadium in Los Angeles. The other major league baseball stadiums with the largest seats are Minute Maid Park and the Chase Field in Chicago.", "prediction 4": "The world's largest baseball stadium by seat capacity is Dodger Stadium in Los Angeles. It is also the oldest ballpark in MLB west of the Mississippi River, and third-oldest overall, after Fenway Park in Boston in 1912 and Wrigley Field in Chicago in 1914. Minute Maid Park, previously known as The Ballpark at Union Station, Enron Field, and Astros Field, is a ballpark in Downtown Houston, Texas, United States, that opened in 2000 to house the Houston Astros of Major League Baseball. The stadium has a seating capacity of 41,168.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 160 }, { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 331 }, { "error type": "Irrelevant", "explanation": "", "start": 332, "end": 448 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The world's largest baseball stadium by seat capacity is at Dodger Stadium with a seating capacity to 56,000. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "What is the primary type of mining that takes place under the bolivian mountain?", "passages": [ [ "Cerro Rico", "Cerro Rico\n\nCerro Rico (Spanish for \"rich mountain\"), Cerro Potos\u00ed (\"Potos\u00ed mountain\") or Sumaq Urqu (Quechua \"sumaq\" beautiful, good, pleasant, \"urqu\" mountain, \"beautiful (good or pleasant) mountain\") is a mountain in the Andes near the Bolivian city of Potos\u00ed.", "Cerro Rico, which is popularly conceived of as being \"made of\" silver ore, was famous for providing vast quantities of silver for Spain during the period of the New World Spanish Empire.", "It is estimated that eighty-five percent of the silver produced in the central Andes during this time came from Cerro Rico.", "As a result of mining operations in the mountain, the city of Potos\u00ed became one of the largest cities in the New World.", "After 1800, the silver mines were depleted, leaving far less valuable tin as the mine's main product.", "This eventually led to a slow economic decline.", "At the start of the 20th century, liberal reforms and an increase in government policies favoring foreign investment led to a decrease in nationalization of natural resources and an increase in ownership by private companies.", "Almost immediately following the change in Peruvian mining code in 1901 that allowed for the privatization of mines, a New York-based company purchased \"80 per cent of the mines in the Cerro de Pasco region of the central andes\"." ], [ "Cerro Rico", "The newly formed Cerro de Pasco Corporation pursued immediate large-scale extractive mining, which contributed to a long-term change in the local eco-system.", "The need for large quantities of timber to build the mining infrastructure necessary to extract minerals, also caused high amounts of erosion and deforestation.", "Dams needed to produce electricity for this massive private project caused floods, which altered the land and damaged the natural environment.", "After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day.", "Due to poor worker conditions, such as a lack of protective equipment against the constant inhalation of dust, many of the miners contract silicosis and have a life expectancy of around 40 years.", "The mountain is still a significant contributor to the city's economy, employing some 15,000 miners.", "It is known as 'mountain that eats men' because of the large number of workers who died in the mines.", "Some writers such as Eduardo Galeano, in his work Open Veins of Latin America, estimates that up to 8 million have died in the Cerro Rico since the 16th century.", "Though this number has been attributed to the entirety of the Viceroyalty of Peru by Josiah Conder, who added that these numbers also take into account any depopulation of areas around mines." ] ], "gold": "The Andes Mountains in Bolivia were famous for providing vast quantities of silver for Spain during the period of the New World Spanish Empirel, with Cerro Rico being one of the most popular sites. It is estimated that eighty-five percent of the silver produced in the central Andes during this time came from this particular mountain. Nonetheless, after the 1800s, primary type of mining that takes place in Bolivia is that of tin.", "prediction 1": "The Cerro Rico mountain in Bolivia, popularly conceived of as being \"made of\" silver ore, was famous for providing vast quantities of silver for Spain during the period of the New World Spanish Empire. After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day. After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day.", "prediction 2": "Cerro Rico is a mountain in the Andes near the Bolivian city of Potos. The mountain is popularly conceived of as being \"made of\" silver ore. It is famous for providing vast quantities of silver for Spain during the period of the New World Spanish Empire. After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day.", "prediction 3": "The mountain in the Andes near the Bolivian city of Potos is known as Cerro Rico, Spanish for \"rich mountain\". The newly formed Cerro de Pasco Corporation pursued immediate large-scale extractive mining, which contributed to a long-term change in the local eco-system. The need for large quantities of timber to build the mining infrastructure necessary to extract minerals, also caused high amounts of erosion and deforestation. Dams needed to produce electricity for this massive private project caused floods, which altered the land and damaged the natural environment. After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to this day.", "prediction 4": "Cerro Rico is a mountain in the Andes near the Bolivian city of Potos. The primary mining method under the mountain is extractive mining. However, after centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 89 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 345 }, { "error type": "Redundant", "explanation": " After centuries of extractive mining methods that severely damaged the local ecology the mountain continues to be mined for silver to this day. ", "start": 346, "end": 489 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Cerro Rico mountain in Bolivia, popularly conceived of as being \"made of\" silver ore, was famous for providing vast quantities of silver for Spain during the period of the New World Spanish Empire. It is estimated that eighty-five percent of the silver produced in the central Andes during this time came from Cerro Rico. After 1800, the silver mines were depleted, leaving far less valuable tin as the mine's main product. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What was the writing system of the minoan called?", "passages": [ [ "Minoan civilization", "Through their traders and artists, the Minoans' cultural influence reached beyond Crete to the Cyclades, the Old Kingdom of Egypt, copper-bearing Cyprus, Canaan and the Levantine coast and Anatolia.", "Some of the best Minoan art is preserved in the city of Akrotiri on the island of Santorini, which was destroyed by the Minoan eruption.", "The Minoans primarily wrote in the undeciphered Linear A, encoding a language hypothetically labelled Minoan.", "The reasons for the slow decline of the Minoan civilization, beginning around 1550 BCE, are unclear; theories include Mycenaean invasions from mainland Greece and the major volcanic eruption of Santorini.", "The term \"Minoan\" refers to the mythical King Minos of Knossos.", "Its origin is debated, but it is commonly attributed to archeologist Arthur Evans (1851\u20131941).", "Minos was associated in Greek mythology with the labyrinth, which Evans identified with the site at Knossos.", "However, Karl Hoeck had already used the title \"Das Minoische Kreta\" in 1825 for volume two of his \"Kreta\"; this appears to be the first known use of the word \"Minoan\" to mean \"ancient Cretan\"." ], [ "Minoan language", "Minoan language\n\nThe Minoan language is the language (or languages) of the ancient Minoan civilization of Crete written in the Cretan hieroglyphs and later in the Linear A syllabary.", "As the Cretan hieroglyphs are undeciphered and Linear A only partly deciphered, the Minoan language is unknown and unclassified: indeed, with the existing evidence, it seems impossible to be certain that the two scripts record the same language, or even that a single language is recorded in each.", "The Eteocretan language, attested in a few alphabetic inscriptions from Crete 1,000 years later, is possibly a descendant of Minoan, but it is itself unclassified.", "Minoan is mainly known from the inscriptions in Linear A, which are fairly legible by comparison with Linear B.", "The Cretan hieroglyphs are dated from the first half of the 2nd millennium BCE.", "The Linear A texts, mostly written in clay tablets, are spread all over Crete with more than 40 localities on the island.", "From the 18th dynasty of Egypt there are four texts containing names and sayings in the Keftiu language ().", "They are, as usual in non-Egyptian texts, written in Egyptian hieroglyphs, which allow a more precise pronunciation." ], [ "Linear A", "Linear A\n\nLinear A is a writing system used by the Minoans (Cretans) from 2500 to 1450 BCE.", "Along with Cretan hieroglyphic, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples.", "Linear A was the primary script used in palace and religious writings of the Minoan civilization.", "It was discovered by archaeologist Sir Arthur Evans.", "It is related to the Linear B script, which succeeded the Linear A and was used by the Mycenaean civilization.", "In the 1950s, Linear B was largely deciphered and found to encode an early form of Greek.", "Although the two systems share many symbols, this did not lead to a subsequent decipherment of Linear A. Using the values associated with Linear B in Linear A mainly produces unintelligible words.", "If Linear A uses the same or similar syllabic values as Linear B, then its associated language, dubbed \"Minoan\", appears unrelated to any known language.", "Many scholars who study Linear A believe it was used primarily for accounting purposes.", "Linear A has hundreds of signs, believed to represent syllabic, ideographic, and semantic values in a manner similar to Linear B." ] ], "gold": "The Minoan language is the language of the ancient Minoan civilization of Crete written in Cretan hieroglyphs and later in Linear A. Since the Cretan hieroglyphs are undeciphered and Linear A only partly deciphered, the Minoan language is unknown and unclassified.", "prediction 1": "Linear A is a writing system used by the Minoans (Cretans) from 2500 to 1450 BCE. Along with Cretan hieroglyphic, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. Linear A was the primary script used in palace and religious writings of the Minoan civilization. Along with Linear B, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples.", "prediction 2": "The Minoans primarily wrote in the undeciphered Linear A, encoding a language hypothetically labelled Minoan. Along with Cretan hieroglyphic, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. Linear A was the primary script used in palace and religious writings of the Minoan civilization. Along with Linear B script, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples.", "prediction 3": "The Minoan civilization used the undeciphered writing system Linear A for palace and religious writings from 2500 to 1450 BCE. Along with the Cretan hieroglyphic, Linear A is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. The Minoan language is the language (or languages) of the ancient Minoan civilization of Crete written in the Cretan hieroglyphs and later in the Linear A syllabary.", "prediction 4": "The Minoan civilization used the undeciphered writing system Linear A from 2500 to 1450 BCE, along with the Cretan hieroglyphic, which is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. Along with Linear B, which succeeded the Linear A and was used by the Mycenaean civilization, Linear A was the primary script used in palace and religious writings of the Minoan civilization.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 304 }, { "error type": "Redundant", "explanation": "Linear A is a writing system used by the Minoans (Cretans) from 2500 to 1450 BCE. Along with Cretan hieroglyphic, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. ", "start": 305, "end": 418 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Linear A is a writing system used by the Minoans (Cretans). Along with Cretan hieroglyphic, it is one of two undeciphered writing systems used by ancient Minoan and peripheral peoples. As the Cretan hieroglyphs are undeciphered and Linear A only partly deciphered, the Minoan language is unknown and unclassified." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Name of dog in as good as it gets?", "passages": [ [ "As Good as It Gets", "As Good as It Gets\n\nAs Good as It Gets is a 1997 American romantic comedy-drama film directed by James L. Brooks.", "It stars Jack Nicholson as a misanthropic and obsessive-compulsive novelist, Helen Hunt as a single mother with a chronically ill son, and Greg Kinnear as a gay artist.", "The screenplay was written by Mark Andrus and Brooks.", "The paintings were created for the film by New York artist Billy Sullivan.", "Nicholson and Hunt won the Academy Award for Best Actor and Best Actress, respectively, making \"As Good As It Gets\" the most recent film to win both of the lead acting awards, and the first since 1991's \"The Silence of the Lambs\".", "It is ranked 140th on \"Empire\" magazine's \"The 500 Greatest Movies of All Time\" list.", "Melvin Udall is a misanthrope who works at home as a best-selling novelist in New York City.", "He has obsessive\u2013compulsive disorder which, paired with his misanthropy, alienates nearly everyone with whom he interacts." ], [ "As Good as It Gets", "He avoids stepping on sidewalk cracks while walking through the city due to a superstition of bad luck, and eats breakfast at the same table in the same restaurant every day using disposable plastic utensils he brings with him due to his pathological fear of germs.", "He takes an interest in his waitress, Carol Connelly, the only server at the restaurant who can tolerate his behavior.", "One day, Melvin's apartment neighbor, a gay artist named Simon Bishop, is assaulted and nearly killed during a robbery.", "Melvin is intimidated by Simon's agent, Frank Sachs, into caring for Simon's dog, Verdell, while Simon is hospitalized.", "Although he initially does not enjoy caring for the dog, Melvin becomes emotionally attached to it.", "He simultaneously receives more attention from Carol.", "When Simon is released from the hospital, Melvin is unable to cope emotionally with returning the dog.", "Melvin's life is further altered when Carol decides to work closer to her home in Brooklyn so she can care for her acutely asthmatic son Spencer (\"Spence\").", "Unable to adjust to another waitress, Melvin arranges through his publisher, whose husband is a doctor, to pay for her son's considerable medical expenses as long as Carol agrees to return to work.", "She is overwhelmed at his generosity." ] ], "gold": "As Good as It Gets is a 1997 American romantic comedy-drama film. In the movie, the main character, Melvin Udall, cares for a Griffon Bruxellois named Verdell. The dog was played by multiple actual dogs: Timer, Sprout, Debbie, Billy, Parfait, Jill. ", "prediction 1": "As Good as It Gets is a 1997 American romantic comedy-drama film directed by James L. Brooks starring Jack Nicholson as a misanthropic and obsessive-compulsive novelist, Helen Hunt as a single mother with a chronically ill son, and Greg Kinnear as a gay artist. Verdell is Simon Bishop's dog.", "prediction 2": "As Good as It Gets is a 1997 American romantic comedy-drama film directed by James L. Brooks. The story is set in Brooklyn, where Melvin Udall, a best-selling novelist, is intimidated by Simon Bishop's agent, Frank Sachs, into caring for Simon's dog, Verdell, while Simon is hospitalized. Melvin initially does not enjoy caring for the dog, but Melvin becomes emotionally attached to it. He simultaneously receives more attention from Carol. When Simon is released from the hospital, Melvin is unable to cope emotionally with returning the dog.", "prediction 3": "As Good as It Gets is a 1997 American romantic comedy-drama film directed by James L. Brooks. The film stars Jack Nicholson as a misanthropic and obsessive-compulsive novelist, Helen Hunt as a single mother with a chronically ill son, and Greg Kinnear as a gay artist. The dog in the film is named Verdell, and Melvin becomes emotionally attached to it.", "prediction 4": "As Good as It Gets is a 1997 American romantic comedy-drama film directed by James L. Brooks. The film stars Jack Nicholson as a misanthropic and obsessive-compulsive novelist, Helen Hunt as a single mother with a chronically ill son, and Greg Kinnear as a gay artist. Verdell is Simon Bishop's dog.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 261 } ], "missing-info": [], "corrected-prediction": "As Good as It Gets is a 1997 American romantic comedy-drama film. Verdell is Simon Bishop's dog." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "What star wars movie came out before the last jedi?", "passages": [ [ "Star Wars: The Last Jedi", "Star Wars: The Last Jedi\n\nStar Wars: The Last Jedi (also known as Star Wars: Episode VIII \u2013 The Last Jedi) is a 2017 American space opera film written and directed by Rian Johnson.", "It is the second installment of the \"Star Wars\" sequel trilogy and the eighth installment of the main \"Star Wars\" film franchise, following \"\" (2015).", "It was produced by Lucasfilm and distributed by Walt Disney Studios Motion Pictures.", "The film's ensemble cast includes Daisy Ridley, John Boyega, Oscar Isaac, Adam Driver, Mark Hamill, Carrie Fisher, Andy Serkis, Lupita Nyong'o, Domhnall Gleeson, Anthony Daniels, Gwendoline Christie, and Frank Oz in returning roles, with Kelly Marie Tran, Laura Dern and Benicio del Toro joining the cast.", "It features the first posthumous film performance by Fisher, who died in December 2016, and the film is dedicated to her memory.", "The plot follows Rey as she receives Jedi training from Luke Skywalker, in hopes of turning the tide for the Resistance in the fight against Kylo Ren and the First Order, while General Leia Organa, Finn, and Poe Dameron attempt to escape a First Order attack on the dwindling Resistance fleet." ], [ "Star Wars: Episode III \u2013 Revenge of the Sith", "Star Wars: Episode III \u2013 Revenge of the Sith\n\nStar Wars: Episode III \u2013 Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas.", "It is the sixth entry in the \"Star Wars\" film series and stars Ewan McGregor, Natalie Portman, Hayden Christensen, Ian McDiarmid, Samuel L. Jackson, Christopher Lee, Anthony Daniels, Kenny Baker, and Frank Oz.", "A sequel to \"\" (1999) and \"\" (2002), it is the third and final installment in the \"Star Wars\" prequel trilogy.", "The film begins three years after the onset of the Clone Wars.", "The Jedi Knights are spread across the galaxy, leading a massive war against the Separatists.", "The Jedi Council dispatches Jedi Master Obi-Wan Kenobi to eliminate the notorious General Grievous, the leader of the Separatist Army.", "Meanwhile, Jedi Knight Anakin Skywalker grows close to Palpatine, the Supreme Chancellor of the Galactic Republic and, secretly, a Sith Lord known as Darth Sidious.", "Their deepening friendship threatens the Jedi Order, the Republic, and Anakin's best interest.", "Lucas began writing the script before production of \"Attack of the Clones\" ended." ], [ "Star Wars: The Force Awakens", "Star Wars: The Force Awakens\n\nStar Wars: The Force Awakens (also known as Star Wars: Episode VII \u2013 The Force Awakens) is a 2015 American epic space opera film produced, co-written and directed by J. J. Abrams.", "It is the first installment of the \"Star Wars\" sequel trilogy and the seventh installment of the main \"Star Wars\" film franchise, following \"Return of the Jedi\" (1983).", "The film stars Harrison Ford, Mark Hamill, Carrie Fisher, Adam Driver, Daisy Ridley, John Boyega, Oscar Isaac, Lupita Nyong'o, Andy Serkis, Domhnall Gleeson, Anthony Daniels, Peter Mayhew, and Max von Sydow, and was produced by Lucasfilm Ltd. and Abrams's production company Bad Robot Productions.", "\"The Force Awakens\" is the first \"Star Wars\" film to not involve franchise creator George Lucas.", "Set 30 years after \"Return of the Jedi\", the film follows Rey, Finn, and Poe Dameron's search for Luke Skywalker and their fight alongside the Resistance, led by General Leia Organa and veterans of the Rebel Alliance, against Kylo Ren and the First Order, a successor to the Galactic Empire.", "\"The Force Awakens\" was announced after The Walt Disney Company's acquisition of Lucasfilm in October 2012." ] ], "gold": "Star Wars: The Last Jedi, also known as Star Wars: Episode VIII \u2013 The Last Jedi, is a 2017 American epic space opera film that is the second installment of the Star Wars sequel trilogy, following Episode VII \u2013 The Force Awakens released in 2015 as part of the nine-part \"Skywalker saga\". It was preceded by the release of Star Wars: Episode I \u2013 The Phantom Menace released in 1999, Star Wars: Episode II \u2013 Attack of the Clones released in 2002, and Star Wars: Episode III \u2013 Revenge of the Sith released in 2005.", "prediction 1": "Star Wars: Episode VIII \u2013 The Last Jedi is a 2017 American epic space opera film written and directed by Rian Johnson. It is the second installment of the \"Star Wars\" sequel trilogy and the eighth installment of the main \"Star Wars\" film franchise, following \"\" (2015). Star Wars: Episode III \u2013 Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas. It is the sixth entry in the \"Star Wars\" film series and stars Ewan McGregor, Natalie Portman, Hayden Christensensensensensensensensensensensens, Samuel L. Jackson, Christopher Lee, Anthony Daniels, Kenny Baker, and Frank Oz. J. J. Abrams's is the first installment of the \"Star Wars\" sequel trilogy and the seventh installment of the main \"Star Wars\" film.\n", "prediction 2": "The second Star Wars film released before The Last Jedi was The Force Awakens. The third Star Wars film released before The Last Jedi was Star Wars: Episode III \u2013 Revenge of the Sith. Solid gold tickets to see The Last Jedi are available to purchase at your local theater.", "prediction 3": "Star Wars: The Last Jedi is a 2017 American epic space opera film written and directed by Rian Johnson. We know several names for the film before the last Jedi. George Lucas wrote the script for Episode III - Revenge of the Sith in 2005, and J. J. Abrams produced the Star Wars: The Force Awakens in 2015. Star Wars: Episode VII - The Last Jedi premiered on December 28, 2015 and was followed in April 20, 2015 by Star Wars: Episode VIII - The Last Jedi.", "prediction 4": "Star Wars: Episode VIII \u2013 The Last Jedi came out earlier than 2017's film. In 2005, George Lucas released Episode III - Revenge of the Sith, the sixth film in the Star Wars film series. In 2015, J. J. Abrams released Star Wars: The Force Awakens, the first film in the Star Wars sequel trilogy, as well as the seventh installment of the Star Wars film franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 350 }, { "error type": "Irrelevant", "explanation": "", "start": 356, "end": 393 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 619 }, { "error type": "Irrelevant", "explanation": "", "start": 620, "end": 752 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 261 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "Star Wars: The Last Jedi, also known as Star Wars: Episode VIII \u2013 The Last Jedi is a 2017 American epic space opera film. It is the second installment of the \"Star Wars\" sequel trilogy. Episode VII \u2013 The Force Awakens is the first installment of the \"Star Wars\" sequel trilogy. Additionally, Star Wars: Episode III \u2013 Revenge of the Sith is a 2005 film." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the girl from the trivago ad?", "passages": [ [ "Trivago", "\"I think that was probably the best break we could have gotten.\"", "Following the large response for the U.S. Trivago guy, the company decided to create French and Spanish Trivago guys.", "From 2016 until June 2017, the French actor Mehdi Nebbou was the German Trivago guy.", "In the UK, Trivago's advertisements are fronted by Australian actress and musician Gabrielle Miller.", "In Germany, the Trivago girl is German actress and model Anna Puck (since June 2017).", "In Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States.", "In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements.", "Trivago states that it attempts to recruit tech and business employees that are \"willing to cross borders\".", "Trivago's first employees were hired via Skype interview from Spain, Italy and Canada, and today 90% of its staff is recruited internationally.", "The company operates with virtually no hierarchies or titles, instead using a model called swarm intelligence.", "It also does not have fixed working hours, and offers employees a four-day surprise holiday each year and one month working in Mallorca." ] ], "gold": "There are different actresses in the Trivago ads based on the country the ad is shown in. In the UK, Trivago's advertisements are fronted by Australian actress and musician Gabrielle Miller. In Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States. In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements.", "prediction 1": "In the trivago ad, the girl from the ad is German actress and model Anna Puck, as of June 2017.", "prediction 2": "The Trivago girl is German actress and model Anna Puck, who appears in the company's ad on television since June 2017.", "prediction 3": "In the American version of the Trivago ad, the girl is American actress and model Laura Sutton. The German version of the ad features German actress and model Anna Puck, and is fronted by Australian actress and musician Gabrielle Miller.", "prediction 4": "The girl from the Trivago ad is German actress and model Anna Puck. In the U.S., the girl from the Trivago ad is French actress and singer Gabrielle Miller. In Germany, the Trivago girl is German actress and model Anna Puck.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 95 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the UK, Trivago's advertisements are fronted by Australian actress and musician Gabrielle Miller. In Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States. In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements. " }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Where was the nuclear test ban treaty signed?", "passages": [ [ "Partial Nuclear Test Ban Treaty", "Partial Nuclear Test Ban Treaty\n\nThe Partial Test Ban Treaty (PTBT) is the abbreviated name of the 1963 Treaty Banning Nuclear Weapon Tests in the Atmosphere, in Outer Space and Under Water, which prohibited all test detonations of nuclear weapons except for those conducted underground.", "It is also abbreviated as the Limited Test Ban Treaty (LTBT) and Nuclear Test Ban Treaty (NTBT), though the latter may also refer to the Comprehensive Nuclear-Test-Ban Treaty (CTBT), which succeeded the PTBT for ratifying parties.", "Negotiations initially focused on a comprehensive ban, but this was abandoned due to technical questions surrounding the detection of underground tests and Soviet concerns over the intrusiveness of proposed verification methods.", "The impetus for the test ban was provided by rising public anxiety over the magnitude of nuclear tests, particularly tests of new thermonuclear weapons (hydrogen bombs), and the resulting nuclear fallout.", "A test ban was also seen as a means of slowing nuclear proliferation and the nuclear arms race.", "Though the PTBT did not halt proliferation or the arms race, its enactment did coincide with a substantial decline in the concentration of radioactive particles in the atmosphere.", "The PTBT was signed by the governments of the Soviet Union, United Kingdom, and United States in Moscow on 5 August 1963 before being opened for signature by other countries.", "The treaty formally went into effect on 10 October 1963." ], [ "Threshold Test Ban Treaty", "Threshold Test Ban Treaty\n\nThe Treaty on the Limitation of Underground Nuclear Weapon Tests, also known as the Threshold Test Ban Treaty (TTBT), was signed in July 1974 by the United States and Soviet Union.", "It establishes a nuclear \"threshold,\" by prohibiting tests of nuclear devices having a yield exceeding 150 kilotons (equivalent to 150,000 tons of TNT).", "The threshold is militarily important since it removes the possibility of testing new or existing nuclear weapons going beyond the fractional-megaton range.", "In the 1960s, many tests above 150 kilotons were conducted by both countries.", "The mutual restraint imposed by the Treaty reduced the explosive force of new nuclear warheads and bombs which could otherwise be tested for weapons systems.", "Of particular significance was the relationship between explosive power of reliable, tested warheads and first-strike capability.", "Agreement on the Threshold Test Ban Treaty was reached during the summit meeting in Moscow in July 1974.", "The treaty included a protocol which detailed technical data to be exchanged and which limited weapon testing to specific designated test sites to assist verification.", "The data to be exchanged included information on the geographical boundaries and geology of the testing areas.", "Geological data\u2014including such factors as density of rock formation, water saturation, and depth of the water table\u2014are useful in verifying test yields because the seismic signal produced by a given underground nuclear explosion varies with these factors at the test location." ], [ "Comprehensive Nuclear-Test-Ban Treaty", "Comprehensive Nuclear-Test-Ban Treaty\n\nThe Comprehensive Nuclear-Test-Ban Treaty (CTBT) is a multilateral treaty that bans all nuclear explosions, for both civilian and military purposes, in all environments.", "It was adopted by the United Nations General Assembly on 10 September 1996, but has not entered into force, as eight specific states have not ratified the treaty.", "The movement for international control of nuclear weapons began in 1945, with a call from Canada and United Kingdom for a conference on the subject.", "In June 1946, Bernard Baruch, an emissary of President Harry S. Truman, proposed the Baruch Plan before the United Nations Atomic Energy Commission, which called for an international system of controls on the production of atomic energy.", "The plan, which would serve as the basis for United States nuclear policy into the 1950s, was rejected by the Soviet Union as a US ploy to cement its nuclear dominance.", "Between the Trinity nuclear test of 16 July 1945 and the signing of the Partial Test Ban Treaty (PTBT) on 5 August 1963, 499 nuclear tests were conducted.", "Much of the impetus for the PTBT, the precursor to the CTBT, was rising public concern surrounding the size and resulting nuclear fallout from underwater and atmospheric nuclear tests, particularly tests of powerful thermonuclear weapons (hydrogen bombs)." ] ], "gold": "The Partial Test Ban Treaty, which prohibited all test detonations of nuclear weapons except for those conducted underground, was signed in 1963. In July 1974, the United States and Soviet Union signed the Threshold Test Ban Treaty to establish a nuclear \"threshold,\" by prohibiting nuclear tests of devices having a yield exceeding 150 kilotons. Both of these treaties were signed in Moscow, Soviet Union. The Comprehensive Nuclear-Test-Ban Treaty, a multilateral treaty that bans all nuclear tests for both civilian and military purposes was adopted by the United Nations General Assembly on 10 September 1996 in New York City, but has not entered into force, as eight specific nations have not ratified the treaty.", "prediction 1": "There were several nuclear test ban treaties. The Partial Test Ban Treaty was signed in Moscow on 5 August 1963 by the governments of the Soviet Union, United Kingdom, and United States. The Threshold Test Ban Treaty was signed in July 1974 by the United States and Soviet Union. The Comprehensive Nuclear-Test Ban Treaty was signed on 10 October 1996 in New York.", "prediction 2": "The nuclear test ban treaty was signed in Moscow, Russia, on 5 August 1963 by the governments of the Soviet Union, United Kingdom, and United States, before being opened for signature by other countries. The Test Ban Treaty was also signed in July 1974 by the United States and Soviet Union. The Comprehensive Test Ban Treaty was signed in New York on 16 September 1996 by the United States and Japan, and was signed in New York City on 5 August 1995.", "prediction 3": "The nuclear test ban treaty was signed in Moscow, Soviet Union, United Kingdom, and the United States on 5 August 1963. The treaty banned all test detonations of nuclear weapons except for those conducted underground. The treaty was also signed in July 1974 by the United States and Soviet Union. The Comprehensive Nuclear-Test-Ban Treaty, or CTBT, was adopted by the United Nations General Assembly on 10 September 1996, but has not entered into force as eight specific states have not ratified it.", "prediction 4": "The nuclear test ban treaty was signed in the Soviet Union, United Kingdom, and the United States on 5 August 1963. The treaty was then opened for signature by other countries. The treaty formally went into effect on 10 October 1963. The Comprehensive Nuclear-Test Ban Treaty bans all nuclear explosions, for both civilian and military purposes, in all environments. The test ban treaty was signed in the United States on 10 September 1996.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 322, "end": 364 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There were several nuclear test ban treaties. The Partial Test Ban Treaty, which prohibited all test detonations of nuclear weapons except for those conducted underground, was signed in Moscow on 5 August 1963 by the governments of the Soviet Union, United Kingdom, and United States. The Threshold Test Ban Treaty establishes a nuclear \"threshold,\" by prohibiting tests of nuclear devices having a yield exceeding 150 kilotons and was signed, in Moscow, in July 1974 by the United States and Soviet Union. The Comprehensive Nuclear-Test Ban Treaty is a multilateral treaty that bans all nuclear explosions, for both civilian and military purposes, in all environments. It was adopted by the United Nations General Assembly on 10 September 1996, but has not entered into force, as eight specific states have not ratified the treaty." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Around what time period did western art begin to influence chinese art?", "passages": [ [ "Chinese painting", "However, similar to the phenomenon of key lineages producing, many well-known artists came from established artistic families.", "Such families were concentrated in the Jiangnan region and produced painters such as Ma Quan, Jiang Tingxi, and Yun Zhu.", "In the late 19th and 20th centuries, Chinese painters were increasingly exposed to Western art.", "Some artists who studied in Europe rejected Chinese painting; others tried to combine the best of both traditions.", "Among the most beloved modern painters was Qi Baishi, who began life as a poor peasant and became a great master.", "His best-known works depict flowers and small animals.", "Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques.", "Prominent Chinese artists who studied Western painting include Li Tiefu, Yan Wenliang, Xu Beihong, Lin Fengmian, Fang Ganmin and Liu Haisu.", "In the early years of the People's Republic of China, artists were encouraged to employ socialist realism.", "Some Soviet Union socialist realism was imported without modification, and painters were assigned subjects and expected to mass-produce paintings.", "This regimen was considerably relaxed in 1953, and after the Hundred Flowers Campaign of 1956\u201357, traditional Chinese painting experienced a significant revival.", "Along with these developments in professional art circles, there was a proliferation of peasant art depicting everyday life in the rural areas on wall murals and in open-air painting exhibitions." ] ], "gold": "After the end of the last feudal dynasty in China, with the rise of the new cultural movement, Chinese artists began to be influenced by Western art and began to integrate Western art into Chinese culture. At the beginning of the 20th century, oil paintings were introduced to China, and more and more Chinese painters began to touch Western painting techniques and combine them with traditional Chinese painting. Meanwhile, a new form of painting, comics, has also begun to rise. It was popular with many people and became the most affordable way to entertain at the time.", "prediction 1": "Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques. Prominent Chinese artists who studied Western painting include Li Tiefu, Yan Wenliang, Xu Beihong, Lin Fengmian, Fang Ganmin and Liu Haisu.", "prediction 2": "Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques. Prominent Chinese artists who studied Western painting include Li Tiefu, Yan Wenliang, Xu Beihong, Lin Fengmian, Fang Ganmin and Liu Haisu. During the late 19th and 20th centuries, Chinese painters were increasingly exposed to Western art.", "prediction 3": "In the late 19th and 20th centuries, Chinese painters were increasingly exposed to Western art. Some artists who studied in Europe rejected Chinese painting; others tried to combine the best of both traditions. Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques. Prominent Chinese artists who studied Western painting include Li Tiefu, Yan Wenliang, Xu Beihong, Lin Fengmian, Fang Ganmin and Liu Haisu.", "prediction 4": "Chinese art began to influence Western art in the late 19th and 20th centuries. In the late 19th and 20th centuries, Chinese painters were increasingly exposed to Western art. Some artists who studied in Europe rejected Chinese painting, while others tried to combine the best of both traditions. Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques. Prominent Chinese artists who studied Western painting include Li Tiefu, Yan Wenliang, Xu Beihong, Lin Fengmian, Fang Ganmin and Liu Haisu Haisu Haisu Haisu Haisu Haisu.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 239 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the late 19th and 20th centuries, Chinese painters were increasingly exposed to Western art. Some artists who studied in Europe rejected Chinese painting; others tried to combine the best of both traditions. Beginning with the New Culture Movement, Chinese artists started to adopt using Western techniques. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "America's best dance crew season 6 winners?", "passages": [ [ "America's Best Dance Crew (season 6)", "America's Best Dance Crew (season 6)\n\nThe sixth season of \"America's Best Dance Crew\", also known as America's Best Dance Crew: Season of the Superstars, premiered on April 7, 2011.", "Taking a different route from past seasons, the crews performed to the music of one specific artist each week, including Rihanna, Lil Wayne, and other stars.", "The season also featured special guest appearances by various music celebrities including Justin Bieber, The Black Eyed Peas, Katy Perry, Kesha, Nicki Minaj, and Kanye West.", "Dominic \"D-Trix\" Sandoval, a former member of Quest Crew, the winner of the third season of \"America's Best Dance Crew\", joined returning judges Lil Mama and JC Chasez as the newest judge.", "In the season finale, which aired on June 5, 2011, I.aM.mE was declared the winner.", "For the sixth season of \"America's Best Dance Crew\", auditions were held in four cities: Chicago, Houston, New York City, and Los Angeles.", "The age requirement for auditioning, used in the previous five seasons, was dropped.", "A total of ten dance crews were selected to compete.", "This was the first season to showcase a crew from the Pacific region." ], [ "I.aM.mE", "I.aM.mE\n\nI.aM.mE (which stands for inspire, motivate, and energize) is an American hip-hop dance crew from Houston, Texas.", "The group rose to prominence after being crowned champions in the sixth season of \"America's Best Dance Crew\".", "The three founding members, Phillip Chbeeb, Di Moon Zhang and Brandon Harrell, formed I.aM.mE after Marvelous Motion Crew disbanded.", "Three additional members, Chachi Gonzales, Emilio Dosal, and D\u017eajna \"jaja\" Va\u0148kov\u00e1, joined later after an audition.", "The new and present roster of I.aM.mE includes members of dance crews who have competed in past seasons of \"ABDC\", Tamara \"Tam\" Rapp (from 8 Flavahz, season 7), Jean \"B-Boy Bebo\" Lloret (from Phunk Phenomenon, season 6), Scarlett Nabil (from Funkdation, season 7), and sole newcomer to the show, Liza Riabinina.", "Before coming together to form I.aM.mE, the members had all achieved considerable success by themselves.", "Di \"Moon\" Zhang posted many of his tutting videos onto YouTube before he met Phillip \"Pacman\" Chbeeb and created Marvelous Motion Crew, which also included Brandon \"747\" Harrell." ], [ "Chachi Gonzales", "Chachi Gonzales\n\nOlivia Irene Gonzales (born January 23, 1996), better known as Chachi Gonzales, is an American dancer, choreographer and actress.", "She was a member of the dance crew I.aM.mE, which won the sixth season of \"America's Best Dance Crew\" in 2011.", "Olivia Irene \"Chachi\" Gonzales was born in Houston, Texas.", "At the age of 6, Gonzales enrolled at a local dance studio and was trained as a ballet dancer.", "Three years later at a dance event she attended, Gonzales witnessed a hip hop dance crew for the first time.", "One of the crews there was Marvelous Motion, whose members (Phillip Chbeeb, Di Zhang and Brandon Harrell) would later become her fellow crew members in I.aM.mE. Gonzales became immediately intrigued and decided to participate in hip hop from then on.", "She enrolled at Lanier Middle School where hip hop was one of the dance styles taught.", "She was reserved at first, but after months of training Gonzales honed her skills and became more confident.", "Eventually, Gonzales' dance teacher, impressed with Gonzales' skill, asked her to lead the group she was being taught in.", "Shortly after, her mother located the Marvelous Motion Studios and enrolled her in a few classes.", "From then on, Gonzales continued to dance as much as possible, honing her skills." ] ], "gold": "The sixth season of America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, premiered on April 7, 2011. The winning group from the the season's dance crew was I.aM.mE, which stands for inspire, motivate, and energize, an American hip-hop dance crew from Houston, Texas. The dancers names are Phillip Chbeeb, Di Moon Zhang and Brandon Harrell.", "prediction 1": "America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, is an American hip-hop dance competition competition. The sixth season featured the winner of the dance competition I.aM.mE, an American hip-hop dance crew from Houston, Texas. The fifth season featured the winner of the dance competition Fancy Fancy, an American dance team from San Antonio, Texas. The sixth season featured the winner of the dance competition Fancy Fancy: The Dance Battle of the Superstars, aM.mE, and the winners of America's Best Dance Crew.", "prediction 2": "America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, was a reality dance competition competition televised by NBC's ABC Television Network. The sixth season of America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, premiered on April 7, 2011. The American hip hop dance crew I.aM.mE was crowned the winner of the sixth season. The group rose to prominence after being crowned champions in the sixth season.", "prediction 3": "America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, premiered on April 7, 2011. I.aM.mE, an American hip-hop dance crew formed after the disbandment of Marvelous Motion Crew, was crowned the winner of the sixth season.", "prediction 4": "America's Best Dance Crew is an American hip-hop dance competition competition. The six-member dance crew I.aM.mE emerged as the crowned champions of America's Best Dance Crew in Season 6. Also known as America's Best Dance Crew: Season of the Superstars, the dance crews performed to the music of one specific artist each week, including Rihanna, Lil Wayne, and other stars.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 147 }, { "error type": "Irrelevant", "explanation": "", "start": 271, "end": 393 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 557 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "America's Best Dance Crew, also known as America's Best Dance Crew: Season of the Superstars, premiered on April 7, 2011.. The sixth season featured the winner of the dance competition I.aM.mE, an American hip-hop dance crew from Houston, Texas. The dancers Phillip Chbeeb, Di Moon Zhang and Brandon Harrell." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Greatest number of tour de france stage wins?", "passages": [ [ "Mark Cavendish", "Mark Cavendish\n\nMark Simon Cavendish (born 21 May 1985) is a British professional road racing cyclist who currently rides for UCI ProTeam .", "As a track cyclist he specialises in the madison, points race, and scratch race disciplines and as a road racer he is a sprinter.", "In his first years as an elite track rider, Cavendish won gold in the madison at the 2005 and 2008 world championships riding for Great Britain, with Rob Hayles and Bradley Wiggins respectively, and in the scratch race at the 2006 Commonwealth Games riding for Isle of Man.", "After not winning a medal at the 2008 Summer Olympics he did not compete on track until 2015, subsequently winning with Wiggins in 2016 a third world championship title in the madison, and individually a silver medal in the Omnium at the 2016 Summer Olympics.", "As a road cyclist, Cavendish turned professional in 2005, and achieved a record eleven wins in his first professional season.", "Cavendish has won thirty Tour de France stages, putting him second on the all-time list, contributing to a joint third-highest total of forty-eight Grand Tour stage victories.", "He won the road race at the 2011 road world championships, becoming the second British rider to do so after Tom Simpson in 1965." ], [ "Tour de France", "Three riders have won 8 stages in a single year: Charles P\u00e9lissier (1930), Eddy Merckx (1970, 1974), and Freddy Maertens (1976).", "Mark Cavendish has the most mass finish stage wins with 30 as of stage 14 in 2016, ahead of Andr\u00e9 Darrigade and Andr\u00e9 Leducq with 22, Fran\u00e7ois Faber with 19, and Eddy Merckx with 18.", "The youngest Tour de France stage winner is Fabio Battesini, who was 19 when he won one stage in the 1931 Tour de France.", "The fastest massed-start stage was in 1999 from Laval to Blois (), won by Mario Cipollini at .", "The fastest time-trial is Rohan Dennis' stage 1 of the 2015 Tour de France in Utrecht, won at an average of .", "The fastest stage win was by the 2013 Orica GreenEDGE team in a team time-trial.", "It completed the in Nice (stage 5) at .", "The longest successful post-war breakaway by a single rider was by Albert Bourlon in the 1947 Tour de France.", "In the Carcassone-Luchon stage, he stayed away for .", "It was one of seven breakaways longer than , the last being Thierry Marie's escape in 1991.", "Bourlon finished 16\u00a0m 30s ahead.", "This is one of the biggest time gaps but not the greatest." ] ], "gold": "Eddy Merckx is tied with Mark Cavendish for the greatest number of stage wins ever in the Tour de France with 34. Three riders have won 8 stages in a single year: Charles P\u00e9lissier, Eddy Merckx, Freddy Maetens. Overall, the country with the most stage wins is France.", "prediction 1": "There are a total of 59 Tour de France stage wins, which contribute to a total of 428 Grand Tour stage victories. The greatest number of stage wins by a British professional road racing cyclist is 30 as of stage 14 in 2016. The greatest number of Tour de France stage wins by a French professional road racing cyclist is 61 as of stage 7 in 2015.", "prediction 2": "The greatest number of Grand Tour stage wins is 44, including the 1987, 2011 and 2012 Tour de France. The greatest number of stage wins by a rider in the history of the Tour de France is 66, with the number of stage wins by a rider in the Tour de France being the greatest number of victories.", "prediction 3": "The greatest number of stage wins in the history of the Tour de France is 40. Since the Tour began in 1937, the greatest number of stage wins in the history of the Tour are 43. The greatest number of Grand Tour stage wins in the history of the Tour is 44. The greatest number of Grand Tour stage wins in the history of the Tour is 43. The greatest number of Grand Tour stage wins in the history of the Tour is 43.", "prediction 4": "The greatest number of Tour de France stage wins is 30. The greatest number of Tour de France stage wins is 41. The greatest number of Grand Tour stage wins is 48. The greatest number of Grand Tour stage wins is 57. In total, the greatest number of Tour de France stage wins is 61.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 113 }, { "error type": "Unverifiable", "explanation": "", "start": 224, "end": 346 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Three riders have won 8 stages in a single year: Charles P\u00e9lissier (1930), Eddy Merckx (1970, 1974), and Freddy Maertens (1976). Mark Cavendish has the most mass finish stage wins with 30 as of stage 14 in 2016, ahead of Andr\u00e9 Darrigade and Andr\u00e9 Leducq with 22, Fran\u00e7ois Faber with 19, and Eddy Merckx with 18." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "The truth about the harry quebert affair tv show release date?", "passages": [ [ "The Truth About the Harry Quebert Affair (miniseries)", "Alongside the initial series order announcement, it was confirmed that Patrick Dempsey, Ben Schnetzer, Damon Wayans Jr., Virginia Madsen, Kristine Froseth, Colm Feore, Josh Close, Matt Frewer, Craig Eldridge, Connor Price, Victoria Clark, Tessa Mossey, Kurt Fuller, Don Harvey, Felicia Shulman, and Wayne Knight had been cast in the series.", "Principal photography for the series began in the fall of 2017 in Montreal, Quebec, Canada.", "On April 6, 2018, a \"sneak peek\" 35 minute presentation of select scenes from the series were debuted at international television festival Canneseries in Cannes, France.", "Those cast and crew members in attendance included Jean-Jacques Annaud, Patrick Dempsey, Ben Schnetzer, and Kristine Froseth.", "In the United Kingdom, the series premiered on Sky Witness on September 4, 2018.", "In Denmark, the series premiered on C More on November 1, 2018.", "In Switzerland, the series premiered on the French speaking channel RTS Un on November 20, 2018.", "In France, the series premiered on TF1 on Novembre 21, 2018.", "In Australia, the series is set to premiere on Stan." ], [ "The Truth About the Harry Quebert Affair (miniseries)", "The Truth About the Harry Quebert Affair (miniseries)\n\n", "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries, based on the novel of the same name by Jo\u00ebl Dicker, that is set to premiere on Epix.", "The series was directed by Jean-Jacques Annaud and stars Patrick Dempsey, Ben Schnetzer, Damon Wayans Jr., and Virginia Madsen.", "Prior to its debut in the United States, the series was sold and premiered in international markets.", "\"The Truth About the Harry Quebert Affair\" follows \"a young writer who heads to Harry Quebert\u2019s home for some inspiration.", "Instead, he finds that Harry\u2019s been accused of murdering 15-year-old Nola Kellergan, who went missing years prior.\"", "On August 15, 2017, it was announced that Epix had given the production a series order consisting of ten episodes.", "The series will be entirely directed by Jean-Jacques Annaud.", "The pilot episode was written by Lyn Greene and Richard Levine who also wrote additional episodes as well.", "Executive producers include Annaud, Greene, Levine, Tarak Ben Ammar, and Fabio Conversi.", "Production companies involved with the series include MGM Television, Eagle Pictures, and Barbary Films." ] ], "gold": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries, based on the 2014 novel of the same name by Jo\u00ebl Dicker, that premiered on Epix. On April 6, 2018, a \"sneak peek\" 35 minute presentation of select scenes from the series were debuted at international television festival Canneseries in Cannes, France. The full release date for the show was September 4, 2018.", "prediction 1": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries that is set to premiere on Epix. The series follows a young writer who heads to Harry Quebert's home for some inspiration. Instead, he finds that Harry's been accused of murdering 15-year-old Nola Kellergan, who went missing years prior. The series premiered in the United Kingdom on Sky Witness on September 4, 2018, in Denmark on C More on November 1, 2018, and in France on TF1 on Novembre 21, 2018. In Australia, the series is set to premiere on Stan.", "prediction 2": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries and is based on the novel of the same name by Jol Dicker. The series was directed by Jean-Jacques Annaud and stars Patrick Dempsey, Ben Schnetzer, Damon Wayans Jr., Virginia Madsen, Colm Feore, Josh Close, Matt Frewer, Craig Eldridge, Victoria Clark, Tessa Mossey, Kurt Fuller, Don Harvey, Felicia Shulman, and Wayne Knight. Australia is set to premiere on Stan.", "prediction 3": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries, based on the novel of the same name by Jol Dicker, that is set to premiere on Epix. The series premiered in the United Kingdom on Sky Witness on September 4, 2018. In Denmark, the series premiered on C More on November 1, 2018. In France, the series premiered on TF1 on Novembre 21, 2018. In Australia, the series is set to premiere on Stan.", "prediction 4": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries, based on the novel of the same name by Jol Dicker, that is set to premiere on Epix. In the United Kingdom, the series premiered on Sky Witness on September 4, 2018. In Denmark, the series premiered on C More on November 1, 2018. In France, the series premiered on TF1 on Novembre 21, 2018. In Australia, the series is set to premiere on Stan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 329 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Truth About the Harry Quebert Affair is an American mystery drama television miniseries, based on the novel of the same name by Jo\u00ebl Dicker, that is set to premiere on Epix. On April 6, 2018, a \"sneak peek\" 35 minute presentation of select scenes from the series were debuted at international television festival Canneseries in Cannes, France. The series premiered in the United Kingdom on Sky Witness on September 4, 2018, in Denmark on C More on November 1, 2018, and in France on TF1 on Novembre 21, 2018. In Australia, the series is set to premiere on Stan." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "Who plays lara croft in the new tomb raider?", "passages": [ [ "Tomb Raider (film)", "\"Deadline Hollywood\" had previously reported that Daisy Ridley was considered for the role, though she later stated in an interview that it was just a \"crazy rumor.\"", "Walton Goggins was announced to play the villain in December 2016, and much of the rest of the cast was revealed in early 2017.", "Principal photography on the film began on January 23, 2017, in Cape Town, South Africa, and ended on June 9, 2017, at Warner Bros. Studios, Leavesden.", "Wilton House near Salisbury in Wiltshire was the location for exterior shots for Croft Manor.", "The waterfall sequence involving the plane was filmed at a waterpark at Lee Valley, outside of London, at a venue that had been built for the 2012 Summer Olympics, and was combined with footage filmed in South Africa.", "On September 11, 2017, It was announced that Junkie XL signed on as the film's composer after being removed from Justice League.", "The soundtrack was released in digital and physical formats on March 9, 2018 by Sony Classical Records with the Vinyl being released later on August 24, 2018.", "\"Tomb Raider\" premiered on March 2, 2018, in Berlin, Germany, at an exclusive preview with invited guests and cosplaying fans.", "It was released in the United States on March 16, 2018, by Warner Bros. Pictures, days after the fifth anniversary of the franchise's video game reboot." ], [ "Tomb Raider (film)", "Tomb Raider (film)\n\nTomb Raider is a 2018 action-adventure film directed by Roar Uthaug, with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet.", "An American and British co-production, it is based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the \"Tomb Raider\" film series.", "The film stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of his disappearance.", "Dominic West, Walton Goggins, Daniel Wu, and Kristin Scott Thomas appear in supporting roles.", "Principal photography took place from January to June 2017 at the Warner Bros. Studios in the United Kingdom, and in Cape Town, South Africa.", "The first \"Tomb Raider\" film not to be distributed by Paramount Pictures, it was released in the United Kingdom on March 14, 2018, and in the United States on March 16, 2018, by Warner Bros. Pictures, in RealD 3D, IMAX 3D, IMAX and 4DX.", "The film grossed $273 million worldwide, just below the $274 million made by Angelina Jolie's but more than its ." ], [ "Lara Croft: Tomb Raider", "Lara Croft:", "Tomb Raider\n\nLara Croft:", "Tomb Raider (also known as simply Tomb Raider) is a 2001 action-adventure film based on the \"Tomb Raider\" video game series featuring the character Lara Croft, portrayed by Angelina Jolie.", "An international co-production between the United States, the United Kingdom, Japan and Germany, it was directed by Simon West and revolves around Lara Croft trying to obtain ancient artifacts from the Illuminati.", "The film was released on June 15, 2001, and received generally negative reviews from critics for its stylized action and bland plot, although Angelina Jolie was praised for her performance.", "\"Tomb Raider\" was the highest-grossing film on its opening weekend.", "A sequel, titled \"\", was released in 2003.", "In pursuit of a diamond, Lara Croft (Angelina Jolie) battles a large robot in an Egyptian tomb; she disables it by ripping out its circuits.", "The diamond, revealed to be a memory card, is inserted into a laptop computer inside the robot to play music.", "The fight took place in a practice area of Lara's home and the robot was programmed by her technical assistant Bryce (Noah Taylor) to challenge her in combat.", "The first phase of a planetary alignment, culminating in a solar eclipse, arrives." ] ], "gold": "Tomb Raider is a 2018 action adventure film directed by Roar Uthaug, that is based on the 2013 video game of the same name. The film stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of his disappearance. Maisy De Freitas plays a 7 year old Lara Croft in the film and Emily Carey plays a 14 year old Lara Croft in the film. In the 2001 movie Lara Croft: Tomb Raider, Angelina Jolie plays the role of Lara Croft.", "prediction 1": "Lara Croft: Tomb Raider is a 2018 action-adventure film directed by Roar Uthaug, based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the Tomb Raider film series. The film stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of her disappearance. Dominic West, Walton Goggins, Daniel Wu, and Kristin Scott Thomas appear in supporting roles.", "prediction 2": "Lara Croft: Tomb Raider is a 2018 action adventure film directed by Roar Uthaug, with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet. It stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of her disappearance. Dominic West, Walton Goggins, Daniel Wu, and Kristin Scott Thomas appear in supporting roles. The 2018 Tomb Raider reboot of the 2001 film was released in the United States on March 16, 2018, by Warner Bros. Pictures. and in the United Kingdom on March 2, 2018, and in the United States on March 16, 2018, by Warner Bros.", "prediction 3": "Lara Croft: Tomb Raider is a new film based on the 2001 video game series Tomb Raider, where she becomes the character Lara Croft, played by Angelina Jolie. In the 2018 version, Alicia Vikander plays Lara Croft, a teenage girl who sets out to find her father's missing artifacts. Dominic West plays Lara Croft, and Walton Goggins plays the villain. In the 2019 version, Alicia Vikander plays Lara Croft, although it is voiced by Sam.", "prediction 4": "Lara Croft: Tomb Raider is a 2018 action-adventure film directed by Roar Uthaug, with a screenplay by Geneva Robertson-Dworet and Alastair Siddons, from a story by Evan Daugherty and Robertson-Dworet. American and British co-production, it is based on the 2013 video game of the same name, with some elements of its sequel by Crystal Dynamics, and is a reboot of the Tomb Raider franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 493 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Lara Croft: Tomb Raider is a 2018 action-adventure film directed by Roar Uthaug, based on the 2013 video game of the same name. The film stars Alicia Vikander as Lara Croft, who embarks on a perilous journey to her father's last-known destination, hoping to solve the mystery of her disappearance. In the 2001 movie Lara Croft: Tomb Raider, Angelina Jolie plays the role of Lara Croft." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What order do the flowers in the attic books go?", "passages": [ [ "Garden of Shadows", "Garden of Shadows\n\nGarden of Shadows is a novel by V. C. Andrews and was first published in 1987.", "V. C. Andrews died in 1986, and her estate commissioned ghostwriter Andrew Neiderman to continue writing novels under her name developed from plot outlines originally written by Andrews.", "There is some dispute over whether this particular novel was written in part by Andrews before she died, or whether it was written entirely by Neiderman.", "This is the fifth novel of the Dollanganger series.", "The novel explains the origin of Olivia Winfield (the grandmother from \"Flowers in the Attic\") and the events that cause her to become the cold, domineering mistress of Foxworth Hall and how Corinne's childhood and eventual betrayal come about.", "The story takes place between the years of 1918-1957.", "Tall, plain Olivia is rescued from spinsterhood by the smart and handsome Malcolm Foxworth.", "She thinks she has found \"the one\" since this is the first man to ever show interest in her.", "Malcolm, who is taken by her forthright manner and impressed with her intelligence, proposes after only two days' acquaintance.", "They marry two weeks later, and Olivia leaves her family home in New London, Connecticut and moves to the family's mansion, Foxworth Hall, in Charlottesville, Virginia.", "Olivia starts to discover the dark secrets about Malcolm eventually diminishing her love for him." ] ], "gold": "V.C. Andrews's first series of novels, The Dollanganger Series, was published between 1979 and 1986. The order of the titles in the series is: Flowers in the Attic, Petals on the Wind, If There Be Thorns, Seeds of Yesterday, Garden of Shadows, Christopher's Diary: Secrets of Foxworth, Christopher's Diary: Echoes of Dollanganger and Christopher's Diary: Secret Brother. Not including the Christopher's Diary spin-offs, the order of books in the series is: Flowers in the Attic, Petals on the Wind, If There Be Thorns, Seeds of Yesterday, and Garden of Shadows.", "prediction 1": "The Flowers in the Attic books are in chronological order. They are in the order of the first and third published books in the series.", "prediction 2": "The Flowers in the Attic books go in the following order.", "prediction 3": "Flowers in the Attic books are organized into 5 parts. The first 4 parts are called the Flowers in the Attic volumes 1 to 4 that follow the order the flowers in the attic books were written in.", "prediction 4": "The books in Flowers in the Attic are in chronological order. In the order the books are published, they are arranged chronologically.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 58 }, { "error type": "Incoherent", "explanation": "", "start": 59, "end": 134 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Garden of Shadows Garden of Shadows is a novel by V. C. Andrews and was first published in 1987. It is the fifth novel of the Dollanganger series." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who sings take me out to the ball game?", "passages": [ [ "Take Me Out to the Ball Game", "Take Me Out to the Ball Game\n\n\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Jack Norworth and Albert Von Tilzer which has become the unofficial anthem of North American baseball, although neither of its authors had attended a game prior to writing the song.", "The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game.", "Fans are generally encouraged to sing along, and at some ballparks, the words \"home team\" are replaced with the team name.", "Jack Norworth, while riding a subway train, was inspired by a sign that said \"Baseball Today \u2013 Polo Grounds\".", "In the song, Katie's beau calls to ask her out to see a show.", "She accepts the date, but only if her date will take her out to the baseball game.", "The words were set to music by Albert Von Tilzer.", "(Norworth and Von Tilzer finally saw their first Major League Baseball games 32 and 20 years later, respectively.)", "The song was first sung by Norworth's then-wife Nora Bayes and popularized by many other vaudeville acts.", "It was played at a ballpark for the first known time in 1934, at a high-school game in Los Angeles; it was played later that year during the fourth game of the 1934 World Series." ], [ "Jack Norworth", "Jack Norworth\n\nJack Norworth (January 5, 1879 \u2013 September 1, 1959) was an American songwriter, singer and vaudeville performer.", "Norworth is credited as co-writer of a number of Tin Pan Alley hits.", "He wrote the lyrics to \"Take Me Out to the Ball Game\" (music by Albert Von Tilzer) in 1908, his most long lasting hit.", "It wasn't until 1940 that he witnessed a Major League Baseball game, the song was placed at number 8 on the \"Songs of the Century\" list selected by the National Endowment for the Arts and the Recording Industry Association of America.", "His \"Shine On, Harvest Moon\" was a bigger hit at the time.", "There is some disagreement about his involvement in its creation.", "Broadway historian John Kenrick credits Edward Madden and Gus Edwards, while the family of Follies songwriter Dave Stamper claims he wrote the song while working as pianist for Nora Bayes, who is the officially credited co-writer with Norworth.", "Another possibility for the music could lie with George Gershwin, who was also a piano player for this vaudeville troupe.", "Albert Koch, of Wisconsin, also an accomplished songwriter, claims to have written the song himself, and sold it outright for $50, forfeiting the rights to the song." ] ], "gold": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Albert Von Tilzer and John Godfrey Knauff, who was professionally known as Jack Norworth. The song has become the official anthem of North American baseball, although neither of its authors had attended a game prior to writing the song. The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game. Fans are generally encouraged to sing along, and at most ballparks, the words \"home team\" are replaced with the home team's name.", "prediction 1": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Jack Norworth and Albert Von Tilzer which has become the unofficial anthem of North American baseball, although neither of its authors had attended a game prior to writing the song. The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game. The words were set to music by Albert Von Tilzer.", "prediction 2": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song that was written by Jack Norworth and Albert Von Tilzer. The chorus of the song is traditionally sung during the middle of the seventh inning of a baseball game. It was first sung by Norworth's then-wife Nora Bayes and popularized by many other vaudevillian acts.", "prediction 3": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Jack Norworth and Albert Von Tilzer which has become the unofficial anthem of North American baseball. The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game.", "prediction 4": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Jack Norworth and Albert Von Tilzer which has become the unofficial anthem of North American baseball. The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game. Jack Norworth's then-wife Nora Bayes sung the chorus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 345, "end": 394 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Take Me Out to the Ball Game\" is a 1908 Tin Pan Alley song by Jack Norworth and Albert Von Tilzer which has become the unofficial anthem of North American baseball, although neither of its authors had attended a game prior to writing the song. The song's chorus is traditionally sung during the middle of the seventh inning of a baseball game. Fans are generally encouraged to sing along, and at some ballparks, the words \"home team\" are replaced with the team name." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the last time roe v wade was challenged?", "passages": [ [ "Roe v. Wade", "Roe v. Wade\n\nRoe v. Wade, 410 U.S. 113 (1973), is a landmark decision issued in 1973 by the United States Supreme Court on the issue of the constitutionality of laws that criminalized or restricted access to abortions.", "The Court ruled 7\u20132 that a right to privacy under the Due Process Clause of the 14th Amendment extended to a woman's decision to have an abortion, but that this right must be balanced against the state's interests in regulating abortions: protecting women's health and protecting the potentiality of human life.", "Arguing that these state interests became stronger over the course of a pregnancy, the Court resolved this balancing test by tying state regulation of abortion to the third trimester of pregnancy.", "Later, in \"Planned Parenthood v. Casey\" (1992), the Court rejected \"Roe\"s trimester framework while affirming its central holding that a woman has a right to abortion until fetal viability.", "The \" Roe\" decision defined \"viable\" as \"potentially able to live outside the mother's womb, albeit with artificial aid.\"", "Justices in \"Casey\" acknowledged that viability may occur at 23 or 24 weeks, or sometimes even earlier, in light of medical advances." ], [ "Roe v. Wade", "In the case of \"Whole Woman's Health v. Hellerstedt\", the most significant abortion rights case before the Supreme Court since \"Planned Parenthood v. Casey\" in 1992, the Supreme Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function.", "The Texas legislature enacted in 2013 restrictions on the delivery of abortions services that created an undue burden for women seeking an abortion by requiring abortion doctors to have difficult-to-obtain \"admitting privileges\" at a local hospital and by requiring clinics to have costly hospital-grade facilities.", "The Court struck down these two provisions \"facially\" from the law at issue \u2013 that is, the very words of the provisions were invalid, no matter how they might be applied in any practical situation.", "According to the Supreme Court the task of judging whether a law puts an unconstitutional burden on a woman's right to abortion belongs with the courts and not the legislatures.", "Norma McCorvey became a member of the anti-abortion movement in 1995; she supported making abortion illegal until her death in 2017.", "In 1998, she testified to Congress:\nAs a party to the original litigation, she sought to reopen the case in U.S. District Court in Texas to have \"Roe v. Wade\" overturned." ] ], "gold": "Roe v. Wade, 410 U.S. 113, was a landmark decision of the U.S. Supreme Court in 1973 in which the Court ruled that the Constitution of the United States protects a pregnant woman's liberty to choose to have an abortion without excessive government restriction. Roe v Wade was challenged last in the case of Whole Woman's Health v. Hellerstedt, where the Supreme Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function. The Texas legislature enacted in 2013 restrictions on the delivery of abortions services that created an undue burden for women seeking an abortion by requiring abortion doctors to have difficult to obtain \"admitting privileges\" at a local hospital and by requiring clinics to have costly hospital grade facilities.", "prediction 1": "Roe v. Wade is a landmark 1973 United States Supreme Court decision that addresses the constitutionality of laws that criminalize or restrict access to abortions. The Supreme Court ruled 7\u20132 that a right to privacy under the Due Process Clause of the 14th Amendment extended to a woman's decision to have an abortion, but that this right must be balanced against the state's interests in regulating abortions: protecting women's health and protecting the potentiality of human life. In the case of Whole Woman's Health v. Hellerstedt, the most significant abortion rights case before the Supreme Court since Planned Parenthood v. Casey in 1992, the Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function. The Texas legislature enacted in 2013 restrictions on the way abortions services that created an undue burden for women", "prediction 2": "Roe v. Wade, 410 U.S. 113, is a landmark 1973 decision by the United States Supreme Court on the issue of the constitutionality of laws that criminalized or restricted access to abortions. The Court ruled 7\u20132 that a right to privacy under the Due Process Clause of the 14th Amendment extended to a woman's decision to have an abortion, but that this right must be balanced against the state's interests in regulating abortions: protecting women's health and protecting the potentiality of human life. In the case of Whole Woman's Health v. Hellerstedt, the most significant abortion rights case before the Supreme Court since Planned Parenthood v. Casey in 1992, the Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function. The Texas legislature enacted in 2013 restrictions on the", "prediction 3": "Roe v. Wade is a landmark 1973 decision issued by the United States Supreme Court on the issue of the constitutionality of laws that criminalized or restricted access to abortions. This decision recognized a right to privacy under the Due Process Clause of the 14th Amendment extended to a woman's decision to have an abortion, but this right must be balanced against the state's interests in regulating abortions: protecting women's health and protecting the potentiality of human life. The Supreme Court in a 5-3 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function.", "prediction 4": "Roe v. Wade is a landmark 1973 U.S. Supreme Court decision on the issue of the constitutionality of laws that criminalized or restricted access to abortions. The Court ruled 7\u20132 that a right to privacy under the Due Process Clause of the 14th Amendment extended to a woman's decision to have an abortion, but that this right must be balanced against the state's interests in regulating abortions: protecting women's health and protecting the potentiality of human life. In the case of Whole Woman's Health v. Hellerstedt, the most significant abortion rights case before the Supreme Court since Planned Parenthood v. Casey in 1992, the Supreme Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function. The Texas legislature enacted in 2013 restrictions on the delivery of abortions services that created an und", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 482 }, { "error type": "Irrelevant", "explanation": "", "start": 535, "end": 644 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Roe v. Wade is a landmark 1973 United States Supreme Court decision that addresses the constitutionality of laws that criminalize or restrict access to abortions. In the case of Whole Woman's Health v. Hellersted the Court in a 5\u20133 decision on June 27, 2016, swept away forms of state restrictions on the way abortion clinics can function. The Texas legislature enacted in 2013 restrictions on the delivery of abortions services that created an undue burden for women seeking an abortion by requiring abortion doctors to have difficult-to-obtain \"admitting privileges\" at a local hospital and by requiring clinics to have costly hospital-grade facilities." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Name of spider from lord of the rings?", "passages": [ [ "Shelob", "Shelob\n\nShelob is a fictional demon in the form of a giant spider from J. R. R. Tolkien's Middle-earth legendarium.", "She appears at the end of the fourth book, second volume (\"The Two Towers\"), of \"The Lord of the Rings\".", "Her lair lies in Cirith Ungol (\"the pass of the spider\") leading into Mordor.", "Gollum deliberately leads Frodo Baggins there in hopes of recovering the One Ring when Shelob attacks Frodo.", "The plan is foiled when Samwise Gamgee greatly injures Shelob with Frodo's Elvish dagger, Sting, and the Phial of Galadriel.", "Shelob was an \"evil thing in spider-form...", "[the] last child of Ungoliant to trouble the unhappy world\", living high in the Ephel D\u00faath mountains on the borders of Mordor.", "There are numerous references to her predating the events of \"The Lord of the Rings\" by many ages.", "Although she resided in Mordor and was unrepentantly evil, she was independent of Sauron and his influence." ], [ "Ungoliant", "Ungoliant\n\nUngoliant is a fictional character in J. R. R. Tolkien's legendarium, described as an evil spirit in the form of a spider.", "She is mentioned briefly in \"The Lord of the Rings\", and plays a supporting role in \"The Silmarillion\".", "Her origins are unclear, as Tolkien's writings do not explicitly reveal her nature, other than that she is from \"before the world\".", "She is one of a few instances, along with Tom Bombadil and the Cats of Queen Ber\u00fathiel, where Tolkien does not provide a clear background for an element of his fiction.", "\"Ungoliant\" means \"dark spider\" in Tolkien's invented language of Sindarin.", "It is a loan word from .", "She is also known as \"Gloomweaver\" (Sindarin: ' , Quenya: ' ).", "Tolkien's original writings say that Ungoliant was a primeval spirit of night, named M\u00f3ru, who aided Melkor in his attack upon the Two Trees of Valinor, draining them of their sap after Melkor had injured them.", "She also consumed the reserves of light from the wells of Varda.", "Afterward the light of the trees persisted only within the Silmarils of F\u00ebanor." ] ], "gold": "The spider in the Lord of the Rings is a demon and evil spirit. Shelob is a fictional demon in the form of a giant spider from J. R. R. Tolkien's Middle-earth legendarium. She appears at the end of the fourth book, second volume \"The Two Towers\", of \"The Lord of the Rings\". Ungoliant is a fictional character in J. R. R. Tolkien's legendarium, described as an evil spirit in the form of a spider. Tolkien's original writings say that Ungoliant was a primeval spirit of night, named M\u00f3ru, who aided Melkor in his attack upon the Two Trees of Valinor, draining them of their sap after Melkor had injured them.", "prediction 1": "There are several spiders from The Lord of the Rings. Shelob is a fictional demon in the form of a giant spider from J. R. R. Tolkien's Middle-earth legendarium. Shelob appears at the end of the fourth book, second volume, of The Lord of the Rings. Ungoliant is a fictional character in J. R. R. Tolkien's legendarium, described as an evil spirit in the form of a spider. She is mentioned briefly in The Lord of the Rings.\n", "prediction 2": "Various fictional spiders and demons from The Lord of the Rings have been described in J. R. R. Tolkien's middle-earth legendarium. One such demon is Shelob, who appears at the end of The Lord of the Rings, volume 4, book 2, and is known as a female spider. Another death-monster is Ungoliant, a female spider described as an \"evil spirit in the form of a spider\". Ungoliant means \"dark spider\" in Tolkien's invented language of Sindarin, which is a loan word from others.", "prediction 3": "A spider from The Lord of the Rings is a fictional demon in the form of a giant. Her name is Shelob. In the book The Lord of the Rings, The Return of the King, the spider is Ungoliant.", "prediction 4": "There are several descriptions of the spider that appear in The Lord of the Rings. Shelob is a fictional demon in the form of a giant spider from J. R. R. Tolkien's Middle-earth legendarium and is described as 'an evil spirit in the form of a spider'. Ungoliant is a fictional character in J. R. R. Tolkien's legendarium, described as an evil spirit in the form of a spider. Shelob is briefly in The Lord of the Rings and plays a supporting role in The Silmarillion. Ungoliant is described as \"the last child of Ungoliant to trouble the unhappy world\".", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 53 }, { "error type": "Irrelevant", "explanation": "", "start": 372, "end": 423 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Shelob is a fictional demon in the form of a giant spider from J. R. R. Tolkien's Middle-earth legendarium. Shelob appears at the end of the fourth book, second volume (\"The Two Towers\"), of \"The Lord of the Rings\". Ungoliant is a fictional character in J. R. R. Tolkien's legendarium, described as an evil spirit in the form of a spider. Tolkien's original writings say that Ungoliant was a primeval spirit of night, named M\u00f3ru, who aided Melkor in his attack upon the Two Trees of Valinor, draining them of their sap after Melkor had injured them." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What is the current population of the uk?", "passages": [ [ "Demography of the United Kingdom", "Demography of the United Kingdom\n\nAccording to the 2011 census, the total population of the United Kingdom was around 63,182,000.", "It is the 21st-most populated country in the world.", "Its overall population density is 259 people per square kilometre (671 people per sq mi), with England having a significantly higher population density than Wales, Scotland and Northern Ireland.", "Almost one-third of the population lives in England's southeast, which is predominantly urban and suburban, with about 9 million in the capital city of London, the population density of which is just over 5,200 per square kilometre (13,468 per sq mi).", "The population of the United Kingdom is considered an example of a population that has undergone demographic transition \u2013 that is, the transition from a (typically) pre-industrial population with high birth and mortality rates and slow population growth, through a stage of falling mortality and faster rates of population growth, to a stage of low birth and mortality rates with, again, lower rates of population growth.", "This population growth through 'natural change' has been accompanied in the past two decades by growth through net international migration into the United Kingdom.", "The United Kingdom's high literacy rate (99% at age 15 and above) is attributable to universal public education introduced for the primary level in 1870 (Scotland 1872, free 1890) and secondary level in 1900." ], [ "Demography of the United Kingdom", "These projections do not allow for any possible effects of the UK leaving the European Union.", "There are 13 urban areas that exceed 500,000 inhabitants: they are centred on London, Birmingham, Glasgow, Leeds and Bradford, Southampton and Portsmouth, Sheffield, Liverpool, Leicester, Manchester, Belfast, Bristol, Newcastle upon Tyne and Nottingham.", "The population of the UK in the 2011 census was 63 million, of whom 31 million were male and 32 million female.", "The 2011 census recorded the population of England as 53.0 million, Scotland as 5.3 million, Wales as 3.1 million, and Northern Ireland as 1.8 million.", "The following table shows the total UK population estimated at census dates.", "Pre 1901 figures include the whole of Ireland, whereas from 1901 onwards only the population of Northern Ireland is included.", "* and possibly other changes\n\nPopulation density based on:\n\n\nIn 2015, there were 777,165 recorded live births in the UK.", "The crude birth rate was 11.9 per 1,000 population.", "The total fertility rate was 1.80.", "Also in 2015, 602,782 deaths were recorded, with the crude death rate being 9.3 per 1,000.", "The infant mortality rate was 3.9 per 1,000 live births.", "The total fertility rate is the number of children born per woman." ] ], "gold": "The current population of the United Kingdom is 67.08 million. It is the 21st most populated country in the world and has a population density of 700 people per square mile. The population of the UK in 2011 was 63,182,000, of whom 31 million were male and 32 million female according to the 2011 census. In 2001, the population of the UK was reported as 59,113,000 and in 1991, the population was 57,439,000. ", "prediction 1": "The population of the United Kingdom, as of the 2011 census, was 63 million, of whom 31 million were male and 32 million female.", "prediction 2": "The population of the UK in the 2011 census was 63 million, of whom 31 million were male and 32 million female. The following table shows the population of the UK estimated at census dates. The population was 63.0 million in 2011.", "prediction 3": "According to the 2011 census, the population of the UK was around 63,182,000. It is the 21st-most populated country in the world. The UK is considered an example of a population that has undergone demographic transition \u2013 that is, the transition from a (typically) pre-industrial population with high birth and mortality rates and slow population growth, to a stage of low birth and mortality rates with, again, lower rates of population growth. The population growth through 'natural change' has been accompanied in the past two decades by growth through net international migration into the UK.", "prediction 4": "According to the 2011 census, the total population of the United Kingdom was around 63,182,000. It is the 21st-most populated country in the world. The population of the UK is considered an example of a population that has undergone demographic transition. The transition occurs from a (typically) pre-industrial population with high birth and mortality rates and slow population growth, through a stage of falling mortality and faster rates of population growth, to a stage of low birth and mortality rates with, again, lower rates of population growth.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The population of the United Kingdom, as of the 2011 census, was 63 million, of whom 31 million were male and 32 million female. It is the 21st-most populated country in the world. Its overall population density is 259 people per square kilometre (671 people per sq mi)." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sang the theme song to beauty and the beast?", "passages": [ [ "Beauty and the Beast (Disney song)", "Celine and Peabo also duetted at the Grammys, World Music Awards, AMA's, \"Wogan\", \"The Tonight Show\", and \"Top of the Pops\" later that year.", "The duo reunited in 1996 to perform the song for the television special \"Oprah in Disneyland\", while Lansbury provided an encore performance at the 25th Anniversary screening of the film.", "Each of the 3 respective artists have performed the song in concerts later in their careers, outside the context of Disney's \"Beauty and the Beast\".", "For example, Lansbury sang it at the 2002 Christmas concert with Mormon Tabernacle Choir.", "Similarly, Dion and Bryson duetted at the JT Super Producers 94 tribute concert to David Foster, and as part of Dion's 1994-95 The Colour of My Love Tour, though they have also often sung with different duet partners.", "Dion has sung with Tommy K\u00f6rberg, Brian McKnight, Terry Bradford, Maurice Davis, Barnev Valsaint, and Ren\u00e9 Froger among others; Peabo has sung with Coko and Regine Velasquez.", "Ariana Grande and John Legend covered \"Beauty and the Beast\" for the 2017 live-action adaption of the same name.", "The accompanying music video, directed by Dave Meyers premiered on Freeform on March 5, 2017." ], [ "Beauty and the Beast (Disney song)", "Filmtracks.com wrote that Dion's performance \"made many fans wish that she had been given it as a solo.\"", "Arion Berger of \"Entertainment Weekly\" praised Dion's vocals, describing \"Beauty and the Beast\" as \"a perfect showcase for what she's best at.\"", "Describing the duet as \"extremely effective,\" Sputnikmusic's Irving Tan lauded the single, writing, \"As the entirety of the film's poignancy is hinged on the chemistry between Bryson and Dion, having the pair pull their assignment off beautifully is ultimately a fantastic conclusion to events.\"", "Jeff Benjamin of Fuse described the song as \"a fantastic duet.\"", "However, the \"Chicago Tribune\"'s Brad Webber panned the rendition as a \"sickly sweet, by-the-book ... standard\" that \"belie[s]", "[Dion's] talent\", while \"The Star\"'s Michael Cheang accused the single of being \"over-wrought.\"", "Critics have been vocal in their preference for Lansbury's rendition; while praising the film version, \"Spin\"s Andrew Unterberger dismissed the single as \"unbearably cloying.\"" ], [ "Beauty and the Beast (Disney song)", "While the Dion-Bryson version received mixed reviews from critics who felt that it was inferior to Lansbury's original, the single became a commercial success, peaking at number nine on the \"Billboard\" Hot 100 and becoming the better-known of the two renditions.", "In addition to returning Disney songs to the pop charts after a thirty-year absence, the success of \"Beauty and the Beast\" also launched Dion's career and established her as a bankable recording artist.", "After \"Beauty and the Beast\" became the first Disney song to undergo a complete pop transformation, several contemporary artists were inspired to release their own radio-friendly renditions of Disney songs throughout the decade.", "Considered to be among Disney's best and most popular songs, \"Beauty and the Beast\" has since been covered by numerous artists.", "In 2004, the American Film Institute officially recognized \"Beauty and the Beast\" as one of the greatest songs in film history, ranking it 62nd.", "The song is also featured in the 2017 live-action adaptation; sung by Emma Thompson as Mrs. Potts during the film and also as a duet cover version by Ariana Grande and John Legend during the end credits.", "Grande and Legend's version of the song is an homage to the cover performed by Dion and Bryson for the 1991 film." ] ], "gold": "\"Beauty and the Beast\" is a song that was written in 1991 by lyricist Howard Ashman and composer Alan Menken for the Disney animated feature film Beauty and the Beast. The film's theme song was first recorded by British-American actress Angela Lansbury in her role as the voice of the character Mrs. Potts, and essentially describes the relationship between its two main characters Belle and the Beast, specifically how the couple has learned to accept their differences and in turn change each other for the better. \"Beauty and the Beast\" was subsequently recorded as a pop duet by Canadian singer Celine Dion and Peabo Bryson, and released as the only single from the film's soundtrack on November 25, 1991. The song is also featured in the 2017 live-action adaptation; sung by Emma Thompson as Mrs. Potts during the film and also as a duet cover version by Ariana Grande and John Legend during the end credits.", "prediction 1": "There are several different renditions of \"Beauty and the Beast\". In 1991, the theme song for the film Beauty and the Beast was performed by Angelina Jolie and Angelina Bryson. In 1996, Celine and Peabo sang the song for the television special Oprah in Disneyland, while Lansbury provided an encore performance at the 25th Anniversary screening of the film. Ariana Grande and John Legend covered the song for the 2017 live-action adaptation of the same name.", "prediction 2": "The theme song to the 1991 Disney film Beauty and the Beast was sung by Angelina Jolie, Angelina Lansbury, and Celine Dion. The songs theme was sung by the Duo in 1996 for the television special Oprah in Disneyland. Ariana Grande and John Legend covered the song for the 2017 live-action adaptation of the same name.", "prediction 3": "There are several artists who have sung the theme song to the 1991 film Beauty and the Beast. Celine and Peabo duetted at the Grammys, World Music Awards, AMA's, \"Wogan\", \"The Tonight Show\", and \"Top of the Pops\" later that year. There is also a version by Emma Thompson as Mrs. Potts in the 2017 live-action adaptation of the movie. Ariana Grande and John Legend also covered the song for the 2017 live-action adaptation of the same name.", "prediction 4": "There are several Disney songs titled Beauty and the Beast, including the theme song \"Beauty and the Beast\" and the end credits song. In 1991, Celine and Peabo sang the theme song at the Grammys, World Music Awards, AMA's, \"Wogan\", \"The Tonight Show\", and \"Top of the Pops\" later that year, while Lansbury provided an encore performance at the 25th Anniversary screening of the film. In 2017, Ariana Grande and John Legend covered the theme song \"Beauty and the Beast\" for the live-action adaptation of the same name and also as a duet cover version by Grande and Legend during the end credits.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 141, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 357 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "There are several different renditions of \"Beauty and the Beast\". In 1991, the theme song for the film Beauty and the Beast was performed by Celine Dion and Peabo Bryson. Ariana Grande and John Legend covered the song for the 2017 live-action adaptation of the same name during the end credits. Lansbury sang the original version. In the 2017 live-action adaptation; sung by Emma Thompson as Mrs. Potts during the film." }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "In which city did organized option markets originate?", "passages": [ [ "Chicago Board Options Exchange", "Chicago Board Options Exchange\n\nThe Chicago Board Options Exchange, located at 400 South LaSalle Street in Chicago, is the largest U.S. options exchange with annual trading volume that hovered around 1.27 billion contracts at the end of 2014.", "CBOE offers options on over 2,200 companies, 22 stock indices, and 140 exchange-traded funds (ETFs).", "The Chicago Board of Trade established the Chicago Board Options Exchange in 1973.", "The first exchange to list standardized, exchange-traded stock options began its first day of trading on April 26, 1973, in celebration of the 125th birthday of the Chicago Board of Trade.", "The CBOE is regulated by the Securities and Exchange Commission and owned by Cboe Global Markets.", "The CBOE (and other national options exchanges) offers options on the following, and others:\n\nThe CBOE calculates and disseminates the CBOE Volatility Index (VIX), the CBOE S&P 500 BuyWrite Index (BXM), and other indices." ], [ "Futures exchange", "When the harvest-time came, and a sharp increase in demand for the use of the olive presses outstripped supply (availability of the presses), he sold his future use contracts of the olive presses at a rate of his choosing, and made a large quantity of money.", "This is a very loose example of futures trading and, in fact, more closely resembles an option contract, given that Thales was not obliged to use the olive presses if the yield was poor.", "The first modern organized futures exchange began in 1710 at the Dojima Rice Exchange in Osaka, Japan.", "The London Metal Market and Exchange Company (London Metal Exchange) was founded in 1877, but the market traces its origins back to 1571 and the opening of the Royal Exchange, London.", "Before the exchange was created, business was conducted by traders in London coffee houses using a makeshift ring drawn in chalk on the floor.", "At first only copper was traded.", "Lead and zinc were soon added but only gained official trading status in 1920.", "The exchange was closed during World War II and did not re-open until 1952.", "The range of metals traded was extended to include aluminium (1978), nickel (1979), tin (1989), aluminium alloy (1992), steel (2008), and minor metals cobalt and molybdenum (2010).", "The exchange ceased trading plastics in 2011." ] ], "gold": "Organized primary option markets originated in London while organized secondary option markets originated in Chicago. The Chicago Board of Trade established the Chicago Board Options Exchange in 1973. This was the first exchange to list standardized, exchange-traded stock options, and it began its first day of trading on April 26, 1973, in celebration of the 125th birthday of the Chicago Board of Trade.", "prediction 1": "The first modern organized option markets originated in the United States in 1973. The first modern organized futures exchange originated in 1710 at the Dojima Rice Exchange in Osaka, Japan. The first modern organized options market originated in the United States in 1973.", "prediction 2": "The first modern organized option markets originated in New York City in 1927. The first modern organized futures exchange originated in 1710 at the Dojima Rice Exchange in Osaka, Japan. The London Metal Market and Exchange Company (London Metal Exchange) was founded in 1877, but the market traces its origins back to 1571 and the opening of the Royal Exchange, London. The Chicago Board of Trade established the Chicago Board Options Exchange in 1973. The first exchange to list standardized, exchange-traded stock options began its first day of trading on April 26, 1973, in celebration of the 125th birthday of the Chicago Board of Trade.", "prediction 3": "The first modern organized stock options exchange began in 1973 at the Chicago Board Options Exchange. The first modern organized futures market began in 1710 at the Dojima Rice Exchange in Osaka, Japan. The London Metal Market and Exchange Company (London Metal Exchange) was founded in 1877, but the market traces its origins back to 1571 and the opening of the Royal Exchange, London. The first modern organized options market originated in 1710 at the Dojima Rice Exchange in Osaka, Japan. The first modern organized futures exchange began in 1710 at the Dojima Rice Exchange in Osaka, Japan.", "prediction 4": "The first modern organized options markets originated in New York City, New York, in 1973. The first modern organized options market originated in London in 1877, and the first modern organized options market originated in Tokyo in 1710.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 190 }, { "error type": "Redundant", "explanation": "The first modern organized option markets originated in the United States in 1973. ", "start": 191, "end": 273 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Organized primary option markets originated in London, while the first modern organized option markets originated in the United States in 1973, in Chicago, when The Chicago Board of Trade established the Chicago Board Options Exchange. The first exchange to list standardized, exchange-traded stock options began its first day of trading on April 26, 1973, in celebration of the 125th birthday of the Chicago Board of Trade. " }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "Who played stefano on days of our lives?", "passages": [ [ "Stefano DiMera", "In the early 1980s, then head writer, Pat Falken Smith created the role specifically for Mascolo after seeing his performance as real-life crime boss, Salvatore Maranzano on the NBC miniseries, \"The Gangster Chronicles\" in 1981.", "Mascolo first appeared as Stefano on January 18, 1982.", "He departed from the series on March 8, 1983, and returned a year later on March 2, 1984 before briefly departing on May 11, 1984 only to return on October 19 and depart again on February 22, 1985.", "Mascolo briefly returned to the series from November 4 to December 19, 1988.", "Actor Frank Fata appeared in the role of Stefano for two episodes which aired on December 3 and 4, 1991. Mascolo reclaimed the role on a contractual basis on September 17, 1993.", "He departed from the show on December 24, 1996, and re-appeared for a few episodes from February 7 to 13, 1997.", "Mascolo returned to the show full-time once again on June 13, 1997.", "In late February 2001, a post on Mascolo's official website revealed that contract negotiations were not going well and Mascolo was expected to last appear in May.", "However, a representative of Mascolo's took to the website to deny the reports." ], [ "Andr\u00e9 DiMera", "Andr\u00e9 DiMera\n\nAndr\u00e9 DiMera is a fictional character from the NBC Daytime soap opera, \"Days of Our Lives\".", "The role was originated in 1983 by Thaao Penghlis when Andr\u00e9 was introduced as the nephew of Stefano DiMera (Joseph Mascolo).", "Having undergone plastic surgery to look identical to Stefano's stepson, Tony (also Penghlis), Andr\u00e9\u2014on Stefano's behalf\u2014sets out to frame Roman Brady (Wayne Northrop) for a series of murders.", "However, plans go awry as Andr\u00e9 claims several victims including Stefano's daughter Ren\u00e9e DuMonde (Philece Sampler).", "Andr\u00e9's later plans to help Stefano heal his brain tumor and get revenge on their enemies culminates in Andr\u00e9's presumed death in November 1984.", "While Penghlis would return to the series for several stints, between 1993 and 2007, it was in the role of Tony.", "However, in 2007, the character's history is retconned and it is revealed that Andr\u00e9 was very much alive and had been masquerading as Tony since 1993.", "The character's return in 1993 saw him feud with John Black (Drake Hogestyn) for the affections of Stefano's adopted daughter Kristen Blake (Eileen Davidson)." ], [ "Joseph Mascolo", "Joseph Mascolo\n\nJoseph Peter Mascolo (March 13, 1929 \u2013 December 8, 2016) was an American musician and dramatic actor.", "During his long career, he acted in numerous motion pictures and television series.", "He was best known for playing supervillain Stefano DiMera, a role he originated in 1982 on NBC's \"Days of Our Lives\".", "Mascolo was born on March 13, 1929, and raised in West Hartford, Connecticut.", "His parents, Anna Mascolo (n\u00e9e DeTuccio; 1910\u20132010) and Peter Mascolo (1901\u20132008), were immigrants from Naples, Italy, and had their 80th wedding anniversary shortly before his father died.", "Mascolo had one sister, Marie LaVoie.", "He attended the United States Military Academy after graduating high school.", "Mascolo attended the University of Miami.", "To support himself financially, he studied acting under famed acting coach Stella Adler in New York City.", "He originally was trained in classical music and opera.", "Mascolo was in the 1962 production of \"Night Life\" as Kazar and the understudy of Neville Brand.", "He was in the 1966 production of \"Dinner at Eight\" as Ricci.", "Mascolo was in the 1969 production of \"The Time of Your Life\" as Blick.", "His final theatrical appearance was in 1972's \"That Championship Season\" as Phil Romano." ] ], "gold": "Stefano DiMera is a fictional character from the NBC soap opera Days of Our Lives, who was introduced on January 18, 1982 as the father of Tony DiMera, looking to expand his criminal empire to Salem. American musician and dramatic actor Joseph Mascolo played the character of Stephano from 1982-1988 and 1993-2016. Actor Frank Fata appeared in the role of Stefano for two episodes which aired on December 3 and 4, 1991 and Davide Shiavone played the role in 2007. Although the character was shot and killed in 2012, in 2019, \"Stefano\" returned to Salem, with the assistance of \"Princess Gina\" and Dr. Rolf, who transferred Stefano's \"essence\" - his memories, beliefs, and personality traits - into a computer chip which he has since implanted in character Steve Johnson's neck, effectively turning Steve into \"the new Stefano,\" who has been played by Stephen Nichols from 2019-present.", "prediction 1": "Stefano DiMera, a fictional character from the NBC soap opera, Days of Our Lives, was played by actor Joseph Mascolo from 1981 to 1991. The role was originally played by Thaao Penghlis when Andr\u00e9 was introduced as the nephew of Stefano's stepson, Tony. However, the character's history was retconned and it was revealed that Andr\u00e9 was very much alive and had been masquerading as Tony since 1993. The character's return in 1993 saw him feud with John Black for the affections of Stefano's adopted daughter Kristen Blake (Eileen Davidson).", "prediction 2": "The role of Stefano on Days of Our Lives was originally played by Joseph Mascolo in 1982. Then, head writer Pat Falken Smith created the role specifically for Mascolo after seeing his performance as real-life crime boss, Salvatore Maranzano on the NBC miniseries, The Gangster Chronicles in 1981. Actor Frank Fata appeared in the role of Stefano for two episodes which aired on December 3 and 4, 1991. Mascolo reclaimed the role on a contractual basis on September 17, 1993. He reclaimed the role on a contractual basis on September 17, 1993. He departed from the show on December 24, 1996, and re-appea few episodes from February 7 to 13, 1997.", "prediction 3": "Stefano DiMera is a fictional character from the NBC Daytime soap opera, Days of Our Lives. The role was originated in 1983 by Thaao Penghlis when Andr\u00e9 was introduced as the nephew of Stefano DiMera. While Penghlis would return to the series for several stints, between 1993 and 2007, it was in the role of Tony. However, in 2007, the character's history is retconned and it is revealed that Andr\u00e9 was very much alive and had been masquerading as Tony since 1993.", "prediction 4": "On the NBC soap opera Days of Our Lives, Stefano DiMera is played by a number of different actors. The first time Stefano DiMera was on the show was on January 18, 1982. Then, in 1983, the role was originated in 1983 by Thaao Penghlis when Andr\u00e9 was introduced as the nephew of Stefano DiMera. Andr\u00e9 has a long career in acting and has starred in numerous motion pictures and television series.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2,3,4,5]}", "start": 122, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 538 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Stefano DiMera, a fictional character from the NBC soap opera, Days of Our Lives, who was introduced on January 18, 1982. He was played by American musician and dramatic actor Joseph Mascolo until 1985. He returned briefly in 1988. Actor Frank Fata appeared in the role of Stefano in 1991 and Mascolo reclaimed the role on a contractual basis in 1993. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sings the theme song for the jeffersons?", "passages": [ [ "The Jeffersons", "Evans and Tolbert appeared in the two-part episode together; Evans made his final appearance in two episodes during the series' eleventh and final season.", "Tolbert became a regular guest star throughout the rest of the series.", "In the spring of 1981, Paul Benedict left the show for a season and a half, returning in the final two seasons of the series.", "However, the ratings sank below the top 30, and \"The Jeffersons\" aired its last episode, \"Red Robins\", on July 2, 1985.", "Source\n\n\"The Jeffersons\" had many two-part episodes, either over two consecutive weeks, or aired as an hour-long episode.", "Ja'net Dubois and Jeff Barry co-wrote \"The Jeffersons\" theme song, \"Movin' on Up\", which was sung by Dubois with a gospel choir.", "Sammy Davis, Jr. recorded a cover version of the song in 1978.", "\"The Jeffersons\" changed time slots at least 15 different times during its 11-year run, unusual for a popular long running series.", "The most common time slot was on Sunday night.", "In its first season (1974\u201375), the show ranked at number four, surpassed by its parent series \"All in the Family\" (which landed at number one for the fifth year in a row)." ], [ "Ja'Net DuBois", "Ja'Net DuBois\n\nJeannette Dubois (born August 5, 1938 or 1945) , known professionally as Ja'Net DuBois, Ja'net DuBois, and Ja'Net Du Bois (), is an American actress, singer\u2013songwriter and dancer.", "DuBois is best known for her portrayal of Willona Woods, the neighborhood gossip maven and the Evans' family friend on the sitcom \"Good Times\", which originally aired from 1974 to 1979.", "DuBois additionally co\u2013wrote and sang the theme song \"Movin' on Up\" for \"The Jeffersons\" which originally aired from 1975 until 1985.", "Born in the Brooklyn borough of New York City, (sources differ), the daughter of Lillian Dubois, DuBois began her acting career in theater during the early 1960s, appearing in \"Golden Boy\" with Sammy Davis Jr. and Louis Gossett Jr. and \"A Raisin in the Sun\".", "DuBois' early television acting credits include the 1969 television movie \"J.T.\" and the long\u2013television soap opera \"Love of Life\", on which her 1970\u20131972 role as Loretta Allen made her the first African\u2013American female as a regular cast-member on a daytime serial.'", "In 1970, DuBois appeared in her first film, playing Vera in \"Diary of a Mad Housewife\"." ] ], "gold": "Ja'net DuBois and Jeff Barry co-wrote \"The Jeffersons\" theme song, \"Movin' on Up\", which was sung by DuBois with a gospel choir. Sammy Davis, Jr. recorded a cover version of the song in 1978. DuBois is best known for her portrayal of Willona Woods, the neighborhood gossip maven and a friend of the Evans family on the CBS sitcom Good Times.", "prediction 1": "The theme song for the television show The Jeffersons was sung by several artists, including Ja'Net DuBois, Jeff Barry, and a gospel choir. Sammy Davis, Jr. recorded a cover of the song in 1978.", "prediction 2": "The theme song for the sitcom The Jeffersons was sung by Ja'Net DuBois with a gospel choir from 1975 to 1985. Jeff Barry and Ja'Net DuBois co-wrote the theme song for the show, which was sung by Dubois with a gospel choir from 1975 to 1985. Sammy Davis, Jr. recorded a cover version of the song in 1978.", "prediction 3": "American actress, singer and dancer Ja'Net DuBois sings the theme song for the television show The Jeffersons. Jeff Barry, Ja'Net DuBois, and Sammy Davis Jr. sing the original version of \"Movin' On Up\".", "prediction 4": "The theme song for The Jeffersons was sung by Ja'Net Dubois, a singer, songwriter and dancer. DuBois additionally co\u2013wrote and sang the theme song \"Movin' on Up\" for \"The Jeffersons\", which originally aired from 1975 until 1985. Sammy Davis, Jr. recorded a cover version of the song in 1978.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 108, "end": 119 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Ja'net DuBois and Jeff Barry co-wrote the theme song for the television show, \"Movin' on Up\", which was sung by DuBois with a gospel choir. Sammy Davis, Jr. recorded a cover of the song in 1978. DuBois is best known for her portrayal of Willona Woods, the neighborhood gossip maven and the Evans' family friend on the sitcom \"Good Times\"," }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who won the us open men\u2019s and women\u2019s singles in 2017?", "passages": [ [ "2017 US Open \u2013 Men's Singles", "2017 US Open \u2013 Men's Singles\n\nStan Wawrinka was the defending champion, but was unable to defend the title due to a knee injury that ended his season prematurely.", "Wawrinka's withdrawal ended his streak of 50 consecutive grand slam appearances, dating back to the 2005 French Open.", "Rafael Nadal won his 16th Major title and 3rd US Open title, defeating first time Major Title finalist Kevin Anderson, 6\u20133, 6\u20133, 6\u20134.", "Nadal retained the ATP No. 1 singles ranking after Roger Federer lost in the quarterfinals.", "It was also Nadal's first hard court title since January 2014.", "Anderson was the first South African man to reach the US Open singles final since 1965 and any Grand Slam singles final since the 1984 Australian Open, as well as the lowest-ranked male player to reach the US Open singles final since the ATP rankings began in 1973.", "Anderson was also the tallest Grand Slam finalist in history.", "Novak Djokovic withdrew due to an elbow injury that ended his tennis season, ending his streak of 51 consecutive grand slam appearances, dating back to the 2005 Australian Open.", "Accordingly, this was the first men's singles draw at the US Open since 1971 to include neither finalist from the previous year's tournament." ], [ "2017 US Open \u2013 Women's Singles", "2017 US Open \u2013 Women's Singles\n\nAngelique Kerber was the defending champion, but was defeated in the first round by Naomi Osaka.", "Kerber became the second US Open defending champion to lose in the first round after Svetlana Kuznetsova in 2005.", "Sloane Stephens won her first Grand Slam title, defeating Madison Keys in the final, 6\u20133, 6\u20130.", "It was the first all-American women's final at the US Open since 2002, and the second time in three years that the final featured two first-time Grand Slam singles finalists from the same country.", "Stephens became the second unseeded woman in the Open Era to win the US Open after Kim Clijsters in 2009.", "For the first time since 1981 at the US Open\u2014and at any Grand Slam event since the 1985 Wimbledon Championships\u2014all four semifinalists were American.", "Both occasions were also the last time that four players from the same country accomplished these feats.", "In addition, Kaia Kanepi became the first qualifier to reach the US Open quarterfinals since Barbara Gerken, also in 1981.", "This was Maria Sharapova's first Grand Slam appearance since the 2016 Australian Open, following a suspension for violating the anti-doping rules." ], [ "Molla Mallory", "Molla Mallory\n\nAnna Margrethe \"Molla\" Bjurstedt Mallory (n\u00e9e Bjurstedt; March 6, 1884 \u2013 November 22, 1959) was a Norwegian tennis player, naturalized American.", "She won a record eight singles titles at the U.S. Championships.", "Although she had won a bronze medal in singles for Norway at the 1912 Summer Olympics in Stockholm, and was the many-time champion of her homeland, Mallory was relatively unknown when she arrived in New York City to begin work as a masseuse in 1915.", "She entered the U.S. Indoor Championships that year unheralded and beat three-time defending champion Marie Wagner 6\u20134, 6\u20134, which was the first of her five singles titles at that tournament.", "She also won the singles title in Cincinnati in 1915.", "Mallory had less in the way of stroke equipment than most tennis champions.", "But the sturdy, Norwegian-born woman, the daughter of an army officer, was a fierce competitor, running with limitless endurance.", "Robert (Bob) Kelleher, a former president of the United States Tennis Association (USTA) and a ball boy during Mallory's era, once said, \"She looked and acted tough when she was on the court hitting tennis balls.", "She walked around in a manner that said you'd better look out or she'd deck you." ] ], "gold": "In 2017, Rafael Nadal won the US Open Men's Singles title, and Sloane Stephens won the US Open Women's Singles title. This was the 16th Major title and 3rd US Open title for Nadal. It was Stephens' first Grand Slam title. Molla Mallory holds the record for most US Open Singles titles with eight.", "prediction 1": "Stan Wawrinka was the defending champion of the 2017 US Open, but was unable to defend the title due to a knee injury that ended his season prematurely. Rafael Nadal won his 16th Major title and 3rd US Open title, defeating first time Major Title finalist Kevin Anderson, 6\u20133, 6\u20133, 6\u20134. Sloane Stephens won her first Grand Slam title, defeating Madison Keys in the final, 6\u20133, 6\u20130.", "prediction 2": "Stan Wawrinka was the defending champion of the 2017 US Open Men's Singles, while Rafael Nadal was the winner of the 2017 US Open Women's Singles. Sloane Stephens won her first Grand Slam title, defeating Madison Keys in the final, 6\u20133, 6\u20130.", "prediction 3": "Stan Wawrinka won the US Open Men's Singles in 2017, while Rafael Nadal won the US Open Women's. Sloane Stephens also won the US Open Women's.", "prediction 4": "Stan Wawrinka was the defending champion of the men's singles at the 2017 US Open, but with a knee injury, he was unable to defend the title. Rafael Nadal won his 16th Major title and 3rd US Open title, defeating first time Major Title finalist Kevin Anderson, 6\u20133, 6\u20133, 6\u20134. Sloane Stephens won her first Grand Slam title, defeating Madison Keys in the final, 6\u20133, 6\u20130. Anna Margrethe \"Molla\" Bjurstedt Bjurstedt Mallory won a record eight singles titles at the US Indoor Championships.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 335, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 286 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the 2017 US Open \u2013 Men's Singles, Rafael Nadal won his 16th Major title and 3rd US Open title and in the Women's Singles Sloane Stephens won her first Grand Slam title. Molla Mallory won a record eight singles titles at the U.S. Championships." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who sings i can't drink you away?", "passages": [ [ "Drink You Away", "Drink You Away\n\n\"Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album, \"The 20/20 Experience \u2013 2 of 2\" (2013).", "It was written and produced by Timberlake, Timothy \"Timbaland\" Mosley and Jerome \"J-Roc\" Harmon, with additional writing from James Fauntleroy.", "It was sent to US country radio stations on November 23, 2015 as the fourth and final single from the album.", "Musically, it was defined by critics as a multi-genre song including classic rock, country pop, gospel blues and Memphis soul.", "Lyrically, on the track, Timberlake compares love to alcoholism while making references to several alcoholic brands including Jack Daniel's and Jim Beam.", "As of May 2016, the song has sold over 600,000 copies in the US.", "\"Drink You Away\" received generally positive response from contemporary critics, with some of them labeling the song as a highlight and one of the most impressive moments on the album.", "Timberlake performed the song at the 2013 American Music Awards and it was part of the set list of The 20/20 Experience World Tour (2013\u201315)." ], [ "David Fanning (singer)", "David Fanning (singer)\n\n", "David Fanning is an American country music singer, songwriter, and record producer.", "He is one-fourth of the production team New Voice Entertainment, which has produced for Parmalee and Thompson Square and serves as Jason Aldean's road band.", "David Fanning has produced multiple hits (including 10 top 40s and 2 #1s) for the Thompson Square and Parmalee.", "These hits include three #1's (\"Are You Gonna Kiss Me or Not\", \"If I Didn't Have You\", and \"Carolina\").", "In 2014, Fanning signed to Red Bow Records, a division of Broken Bow Records.", "He released his solo debut single \"Drink You Away\", a cover of a Justin Timberlake song.", "Markos Papadatos of Digital Journal gave the song 4.5 stars out of 5.", "The song debuted at number 60 on the Country Airplay chart dated for the week ending May 24, 2014, and peaked at number 58.", "Two more singles followed in 2015, \"Doin' Country Right\" and \"What's Next,\" before Fanning parted ways with Red Bow in 2016.", "Fanning released his debut EP \"First\" on September 23, 2016 via MV2 Entertainment." ] ], "gold": "\"Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album in 2013. Country singer David Fanning released a cover of the song as his solo debut single in 2014. At the Country Music Association Awards in 2015, Justin Timberlake and Chris Stapleton performed a rendition of the song together.", "prediction 1": "\"I Can't Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album, The 20/20 Experience \u2013 2 of 2. It was written and produced by Timberlake, Timothy \"Timbaland\" Mosley and Jerome \"J-Roc\" Harmon, with additional writing from James Fauntleroy. \"Drink You Away\" was sent to US country radio stations on November 23, 2015 as the fourth and final single from the album. David Fanning sang the original song \"I Can't Drink You Away\".", "prediction 2": "\"Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album, \"The 20/20 Experience \u2013 2 of 2\". It was written and produced by Timberlake, Timothy \"Timbaland\" Mosley and Jerome \"J-Roc\" Harmon, with additional writing from James Fauntleroy. David Fanning, an American country music singer, songwriter, and record producer, sings \"I Can't Drink You Away\".", "prediction 3": "\"I Can't Drink You Away\" is a song by American singer and songwriter Justin Timberlake for his fourth studio album, The 20/20 Experience \u2013 2 of 2. It was written and produced by Timberlake, Timothy \"Timbaland\" Mosley, and Jerome \"J-Roc\" Harmon, with additional writing from James Fauntleroy. The song was sent to US country radio stations on November 23, 2015 as the fourth and final single from the album. American country music singer, songwriter, and record producer David Fanning sang the song.", "prediction 4": "\"Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album, The 20/20 Experience \u2013 2 of 2 (2013). It was written and produced by Timberlake, Timothy \"Timbaland\" Mosley and Jerome \"J-Roc\" Harmon, with additional writing from James Fauntleroy. David Fanning, an American country music singer, songwriter, and record producer, sings \"I Can't Drink You Away\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 422 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "\"I Can't Drink You Away\" is a song recorded by American singer and songwriter Justin Timberlake for his fourth studio album. David Fanning sang the original song \"I Can't Drink You Away\" in 2014." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "A test for cranial nerve vi would be?", "passages": [ [ "Abducens nerve", "Abducens nerve\n\nThe abducens nerve is a nerve that controls the movement of the lateral rectus muscle in humans, responsible for outward gaze.", "It is also known as the abducent nerve, the sixth cranial nerve, sixth nerve, or simply CNVI.", "It is a somatic efferent nerve.", "The abducens nerve leaves the brainstem at the junction of the pons and the medulla, medial to the facial nerve.", "It runs upwards and forwards from this position to reach the eye.", "The nerve enters the subarachnoid space when it emerges from the brainstem.", "It runs upward between the pons and the clivus, and then pierces the dura mater to run between the dura and the skull through Dorello's canal.", "At the tip of the petrous temporal bone it makes a sharp turn forward to enter the cavernous sinus.", "In the cavernous sinus it runs alongside the internal carotid artery.", "It then enters the orbit through the superior orbital fissure and innervates the lateral rectus muscle of the eye.", "The abducens nucleus is located in the pons, on the floor of the fourth ventricle, at the level of the facial colliculus." ] ], "gold": "Several tests can be used to assess carnial nerve vi, or the abducens nerve, that controls movement of the lateral rectus muscle, responsible for outward gaze. Ocular movements are tested by following a target with the eyes. The optokinetic nystagmus test can also be used. This involves looking at a strip of vertical lines. Additionally, extraocular movements are tested by inspecting the eyes and measuring the pupil. Pupillary light reflexes are also tested using a pen light.", "prediction 1": "A test for cranial nerve vi would be a pulse oximetry test.", "prediction 2": "The sixth cranial nerve, or CNVI, is a somatic efferent nerve that controls the movement of the lateral rectus muscle in humans, responsible for outward gaze. It is also known as the abducent nerve, the sixth cranial nerve, sixth nerve, or simply CNVI. The test for cranial nerve vi would be a CT scan of the face.", "prediction 3": "The abducens nerve is a nerve that controls the movement of the lateral rectus muscle in humans, responsible for outward gaze. It is also known as the abducent nerve, the sixth cranial nerve, the sixth nerve, or simply CNVI. It is a somatic efferent nerve.", "prediction 4": "The abducens nerve is a nerve that controls the movement of the lateral rectus muscle in humans, responsible for outward gaze. It is also known as the abducent nerve, the sixth cranial nerve, sixth nerve, or simply CNVI. It is a somatic efferent nerve.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 59 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The abducens nerve is a nerve that controls the movement of the lateral rectus muscle in humans, responsible for outward gaze." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "When was the song stacy's mom released?", "passages": [ [ "Stacy's Mom", "Stacy's Mom\n\n\"Stacy's Mom\" is a pop rock song recorded by the American rock band Fountains of Wayne for their third studio album, \"Welcome Interstate Managers\".", "\"Stacy's Mom\" was released to radio on May 20, 2003.", "The song was released as the lead single from \"Welcome Interstate Managers\" on September 29, 2003 through S-Curve Records and Virgin Records.", "\"Stacy's Mom\" was written by bassist Adam Schlesinger and vocalist Chris Collingwood, both of whom produced the song alongside Mike Denneen.", "Its subject matter was inspired by a friend of Schlesinger's when he was young who had a crush on his grandmother.", "A power pop song, the group hoped to emulate the sound of The Cars with the track.", "\"Stacy's Mom\" reached number 21 on the \"Billboard\" Hot 100, becoming the band's highest-charting hit in the United States.", "Additionally, the song peaked within the top 10 in Ireland, and the top 20 in the United Kingdom, Canada, and Australia.", "The single was certified gold by the Recording Industry Association of America for sales of over 500,000 copies.", "It was nominated for a Grammy Award for Best Vocal Pop Performance.", "The song was accompanied with a music video in which model Rachel Hunter plays the titular role." ], [ "Stacy's Mom", "The Cars' frontman Ric Ocasek thought that the intro was a sample from \"Just What I Needed\" but the band says they performed it in the studio and just \"got it right.\"", "\"Stacy's Mom\" debuted on the \"Billboard\" Hot 100 the week of October 11, 2003 at number 59, making this their first song to appear on that chart.", "It entered the top 40 the week after by moving twenty-one spots to number 38 and moved nine spots to number 31 on the week of October 25, 2003.", "It peaked at number 21 the week of November 21, 2003 and stayed there for two weeks.", "It stayed on the chart for seventeen weeks.", "It was one of the first songs to reach the No. 1 spot on the \"Most Downloaded Songs\" list of the iTunes Music Store.", "It reached No. 11 in the UK Singles Chart.", "It was nominated for a Grammy Award for Best Vocal Pop Performance at the 2004 awards.", "The single's sales were last estimated at 888,000, according to Nielsen SoundScan, in 2011.", "Richard Harrington of \"The Washington Post\" dubbed it \"nicely naughty.\"", "Ben Greenman, writing for \"The New Yorker\", considered it the \"second-catchiest song ever written about a girlfriend's parent,\" after \"Mrs. Robinson\".", "The song ranks No." ], [ "Stacy's Mom", "In multiple interviews, Bowling for Soup bandleader Jaret Reddick has said that he regularly encountered fans at their concerts who mistakenly thought \"Stacy's Mom\" was a Bowling for Soup song.", "In 2011, they recorded and released a cover version of the song.", "Reddick said that by finally releasing their own version of the song, \"I\u2019ve basically just taken care of a large part of the population that\u2019s been wrong for years, and I\u2019ve made them right.\"", "Alluding to the mistaken identity issue, the cover art for the song release reads: \"Finally you can say this is your favorite song by BFS and not look like an idiot!\"", "Bowling for Soup has since made the song part of their live set list.", "The song was included on the setlist for \"\" as a guest act.", "It also appeared in the 4th episode of the 1st season of the television series \"Psych, Woman Seeking Dead Husband, Smokers Ok, No Pets\".", "The song was parodied on \"The Howard Stern Show\" to mock Wack Pack character Hanzi (Imran Kahn).", "It has also been performed by \"Postmodern Jukebox\" ft.", "Casey Abrams.", "A cover of the song by the Northeastern University pep band has become an unofficial theme song for the Northeastern Huskies men's ice hockey team." ] ], "gold": "\"Stacy's Mom\" is a pop rock song by American rock band Fountains of Wayne. It was first released on radio on May 20, 2003 and then as the lead single of the album \"Welcome Interstate Managers\" on September 29, 2003. The song also became available for digital download on September 29, 2003 in the US and on October 7, 2003 in the UK, followed by its commercialization in the 7\" format on March 8, 2004. Years later, the American rock band Bowling for Soup covered the song and released their version on October 10, 2011.", "prediction 1": "Stacy's Mom is a pop rock song recorded by the American rock band Fountains of Wayne for their third studio album, Welcome Interstate Managers. The song was released to radio on May 20, 2003. It was released as the lead single from the album on September 29, 2003 through S-Curve Records and Virgin Records. Bowling for Soup also recorded and released a cover of the song in 2011, which they released in their entirety on February 12, 2014.", "prediction 2": "The pop rock song Stacy's Mom was released to radio on May 20, 2003. The song was released as the lead single from Fountains of Wayne's third studio album, Welcome Interstate Managers, on September 29, 2003 through S-Curve Records and Virgin Records. In 2011, Bowling for Soup released a cover of the song.", "prediction 3": "Stacy's Mom is a pop rock song recorded by the American rock band Fountains of Wayne for their third studio album, Welcome Interstate Managers. The song was released to radio on May 20, 2003. It was released as the lead single from the album on September 29, 2003. In 2011, Bowling for Soup released a cover version of the song.", "prediction 4": "In 2003, the pop rock song Stacy's Mom was released to radio on May 20, 2003. Stacy's Mom was released as the lead single from Fountains of Wayne's third studio album, Welcome Interstate Managers on September 29, 2003 through S-Curve Records and Virgin Records. In 2011, Bowling for Soup recorded and released a cover version of the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 307 }, { "error type": "Unverifiable", "explanation": "", "start": 381, "end": 440 } ], "missing-info": [], "corrected-prediction": "Stacy's Mom is a pop rock song recorded by the American rock band Fountains of Wayne for their third studio album, Welcome Interstate Managers. The song was released to radio on May 20, 2003. It was released as the lead single from the album on September 29, 2003 through S-Curve Records and Virgin Records. Bowling for Soup also recorded and released a cover of the song in 2011." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When was martin luther king jr speech i have a dream given?", "passages": [ [ "I Have a Dream", "I Have a Dream\n\n\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States.", "Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement.", "Beginning with a reference to the Emancipation Proclamation, which freed millions of slaves in 1863, King said \"one hundred years later, the Negro still is not free\".", "Toward the end of the speech, King departed from his prepared text for a partly improvised peroration on the theme \"I have a dream\", prompted by Mahalia Jackson's cry: \"Tell them about the dream, Martin!\"", "In this part of the speech, which most excited the listeners and has now become its most famous, King described his dreams of freedom and equality arising from a land of slavery and hatred.", "Jon Meacham writes that, \"With a single phrase, Martin Luther King Jr. joined Jefferson and Lincoln in the ranks of men who've shaped modern America\".", "The speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of public address." ], [ "I Have a Dream", "The rhetoric of King's speech can be compared to the rhetoric of Old Testament prophets.", "During King's speech, he speaks with urgency and crisis giving him a prophetic voice.", "The prophetic voice must \"restore a sense of duty and virtue amidst the decay of venality.\"", "An evident example is when King declares that, \"now is the time to make justice a reality for all of God's children.\"", "Why King's speech was powerful is debated, but essentially, it came at a point of many factors combining at a key cultural turning point.", "Executive speechwriter Anthony Trendl writes, \"The right man delivered the right words to the right people in the right place at the right time.\"", "\"Given the context of drama and tension in which it was situated\", King's speech can be classified as a dynamic spectacle.", "A dynamic spectacle is dependent on the situation in which it is used.", "It can be considered a dynamic spectacle because it happened at the correct time and place: during the Civil Rights Movement and the March on Washington.", "The speech was lauded in the days after the event, and was widely considered the high point of the March by contemporary observers.", "James Reston, writing for \"The New York Times\", said that \"Dr. King touched all the themes of the day, only better than anybody else." ] ], "gold": "Martin Luther King Jr. delivered his famous \"I Have a Dream\" speech during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement and among the most iconic speeches in American history.", "prediction 1": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. King's rhetoric can be compared to the rhetoric of Old Testament prophetic voice. The speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of scholars of public address. King's speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of public address.", "prediction 2": "The speech, I Have a Dream, by American civil rights activist Martin Luther King Jr., was given at the March on Washington for Jobs and Freedom on August 28, 1963. King spoke to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., in which he called for civil and economic rights and an end to racism in the United States. The speech was ranked as the top American speech of the 20th century in a 1999 poll of scholars of public address.", "prediction 3": "I Have a Dream is the name of a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. The rhetoric of King's speech can be compared to the rhetoric of Old Testament prophetic voice.", "prediction 4": "The speech I Have a Dream was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. The rhetoric of King's speech can be compared to the rhetoric of Old Testament prophets. King spoke with urgency and crisis giving him a prophetic voice.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 449, "end": 530 }, { "error type": "Irrelevant", "explanation": "", "start": 597, "end": 654 }, { "error type": "Redundant", "explanation": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. King's rhetoric can be compared to the rhetoric of Old Testament prophetic voice. The speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of scholars of public address. ", "start": 655, "end": 769 } ], "missing-info": [], "corrected-prediction": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. The speech was ranked the top American speech of the 20th century." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Who wrote i am a woman in love?", "passages": [ [ "I Am a Woman", "I Am a Woman\n\nI Am a Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon (pseudonym of Ann Weldy).", "It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles.", "It was originally published in 1959 by Gold Medal Books, again in 1983 by Naiad Press, and again in 2002 by Cleis Press.", "Its original title with Gold Medal Books was \"I Am a Woman In Love With A Woman Must Society Reject Me?\"", "Bannon wanted the title to be \"Strangers in this World\"(from a conversation the main character has with a stranger who tells her that everyone is a stranger until she finds someone to love), but as Bannon explained in the 2001 edition forward of \"Odd Girl Out\", Gold Medal publishers had control over the cover art and the title.", "Bannon's editor titled the book.", "Lesbian pulp fiction books usually showed suggestive art with obscure titles that hinted at what the subject matter was inside.", "For the 1983 and 2002 editions, the title was shorted to \"I Am A Woman\".", "It is followed in the series by \"Women In The Shadows\", also published in 1959.", "Bannon was inspired to write after reading \"The Well of Loneliness\" and \"Spring Fire\"." ] ], "gold": "The 1959 lesbian pulp fiction novel I Am a Woman was written by Ann Weldy under the pseudonym Ann Bannon. Originally titled I Am a Woman In Love With A Woman Must Society Reject Me?, the novel is the second in a series that eventually came to be known as The Beebo Brinker Chronicles.", "prediction 1": "I Am a Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon. It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles. It was originally published in 1959 by Gold Medal Books. It was again published in 1983 by Naiad Press, and again in 2002 by Cleis Press.\n", "prediction 2": "I Am a Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon, pseudonym of Ann Weldy. It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles. The original title with Gold Medal Books was \"I Am a Woman In Love With A Woman Must Society Reject Me?\". For the 1983 and 2002 editions, the title was shorted to \"I Am A Woman\".", "prediction 3": "I Am a Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon (pseudonym of Ann Weldy). It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles. In the original 1959 edition, the title of the book had to be I Am a Woman In Love With A Woman Must Society Reject Me?. Bannon thought a man could write an interesting love story about a woman and her role, but her editor tried to shortensing the title. In the 1983 and the 2002 editions, the title was changed to I Am A Woman. I Am a Woman's original title with Gold Medal Books was to I Am A Woman.", "prediction 4": "I Am A Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon (pseudonym of Ann Weldy). It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles. It was originally published in 1959 by Gold Medal Books with the original title being \"I Am A Woman In Love With A Woman Must Society Reject Me?\", although for the 1983 and 2002 editions it was shorted to \"I Am A Woman In Love.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 332 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "I Am a Woman is a lesbian pulp fiction novel written in 1959 by Ann Bannon. Its original title with Gold Medal Books was \"I Am a Woman In Love With A Woman Must Society Reject Me?\". It is the second in a series of pulp fiction novels that eventually came to be known as The Beebo Brinker Chronicles. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the last song of ice and fire book come out?", "passages": [ [ "Themes in A Song of Ice and Fire", "Themes in A Song of Ice and Fire\n\n\"A Song of Ice and Fire\" is an ongoing series of epic fantasy novels by American novelist and screenwriter George R. R. Martin.", "The first installment of the series, \"A Game of Thrones\", which was originally planned as a trilogy, was published in 1996.", "The series now consists of five published volumes, and two more volumes are planned.", "The series is told in the third-person through the eyes of a number of point of view characters.", "A television series adaptation, \"Game of Thrones\", premiered on HBO in 2011.", "\"A Song of Ice and Fire\" takes place in a fictional world, primarily on a continent called Westeros, and additionally on a large landmass to the east, known as Essos.", "Three main story lines become increasingly interwoven: a dynastic civil war for control of Westeros among several competing families; the rising threat of the Others, who dwell beyond the immense wall of ice that forms Westeros's northern border; and the ambitions of Daenerys Targaryen, exiled daughter of the deposed king, to return to Westeros and claim her throne.", "Martin has said he believes in \"judicious use of magic\" in epic fantasy." ], [ "A Storm of Swords", "A Storm of Swords\n\nA Storm of Swords is the third of seven planned novels in \"A Song of Ice and Fire\", a fantasy series by American author George R. R. Martin.", "It was first published on August 8, 2000, in the United Kingdom, with a United States edition following in November 2000.", "Its publication was preceded by a novella called \"Path of the Dragon\", which collects some of the Daenerys Targaryen chapters from the novel into a single book.", "At the time of its publication, \"A Storm of Swords\" was the longest novel in the series.", "It was so long that in the UK, Australia, and Israel, its paperback edition was split in half, Part 1 being published as \"Steel and Snow\" in June 2001 (with the one-volume cover) and Part 2 as \"Blood and Gold\" in August 2001 (with a specially-commissioned new cover).", "The same division was used in the Polish and Greek editions.", "In France, the decision was made to cut the novel into four separate volumes.", "\"A Storm of Swords\" won the 2001 Locus Award, the 2002 Geffen Award for Best Novel and was nominated for the 2001 Nebula Award for Best Novel." ], [ "A Feast for Crows", "A Feast for Crows\n\nA Feast for Crows is the fourth of seven planned novels in the epic fantasy series \"A Song of Ice and Fire\" by American author George R. R. Martin.", "The novel was first published on October 17, 2005, in the United Kingdom, with a United States edition following on November 8, 2005.", "In May 2005, Martin announced that the \"sheer size\" of his still-unfinished manuscript for \"A Feast for Crows\" had led him and his publishers to split the narrative into two books.", "Rather than divide the text in half chronologically, Martin opted to instead split the material by character and location, resulting in \"two novels taking place simultaneously\" with different casts of characters.", "\"A Feast for Crows\" was published months later, and the concurrent novel \"A Dance with Dragons\" was released on July 12, 2011.", "Martin also noted that the \"A Song of Ice and Fire\" series would now likely total seven novels.", "\"A Feast for Crows\" was the first novel in the series to debut at number one on \"The New York Times\" Best Seller list, a feat among fantasy writers only previously achieved by Robert Jordan and Neil Gaiman.", "In 2006 the novel was nominated for the Hugo Award, the Locus Award, and the British Fantasy Society Award." ] ], "gold": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. Book 3 of the A Song of Ice and Fire series was released in the US on November 2000. Book 3 was released in the UK on August 8, 2000. Book 4 of the A Song of Ice and Fire series was released in the US on October 17, 2005 and in the UK on November 8, 2005. Book 5 of the A Song of Ice and Fire series was released on July 12, 2011.", "prediction 1": "The last book in the epic fantasy series A Song of Ice and Fire was A Feast for Crows, which came out on October 17, 2005. The second book in the series, A Storm of Swords, came out on August 8, 2000, in the United Kingdom, with a United States edition coming out on November 8, 2005. The third book, A Feast for Crows, came out on August 9, 2000, in the United States. The fifth book, A Dance with Dragons, came out on July 12, 2011.", "prediction 2": "A Song of Ice and Fire is an ongoing series of epic fantasy novels by American novelist and screenwriter George R. R. Martin. The last book in the series, A Feast for Crows, came out on July 12, 2011. A Storm of Swords is the first of seven planned novels in A Song of Ice and Fire, a fantasy series by American author George R. R. Martin. A Feast for Crows was first published on October 17, 2005, in the United Kingdom, with a United States edition following on November 8, 2005. A Feast for Crows was published on July 15, 2012.", "prediction 3": "The last book in the Song of Ice and Fire series, A Game of Thrones, came out on December 8, 2016. A Feast for Crows came out on July 12, 2011 and A Storm of Swords came out on August 8, 2000.", "prediction 4": "A Song of Ice and Fire is an ongoing series of epic fantasy novels by American novelist and screenwriter George R. R. Martin. The first installment of the series, A Game of Thrones, was originally planned as a trilogy, and was published in 1996. The second installment, A Feast for Crows, was published on October 17, 2005. The third installment, A Storm of Swords, was published on August 8, 2000, in the United Kingdom, with a United States edition following in November 2000. A Dance with Dragons was released on July 12, 2011 and the fourth novel was released on July 12, 2011. The final volume was published on September 10, 2011 in the United States in July 12, 2011, with a concurrent novel called A Feast for Crows, which was published on August 8, 2001.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 4, "end": 8 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 267, "end": 284 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 289, "end": 294 }, { "error type": "Redundant", "explanation": "The last book in the epic fantasy series A Song of Ice and Fire was A Feast for Crows, which came out on October 17, 2005. ", "start": 303, "end": 331 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 332, "end": 369 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"A Song of Ice and Fire\" is an ongoing series of epic fantasy novels by American novelist and screenwriter George R. R. Martin. The fourth book in the epic fantasy series A Song of Ice and Fire was A Feast for Crows, which came out on October 17, 2005 in the United Kingdom, with a United States edition following on November 8, 2005. The second book in the series, A Storm of Swords, came out on August 8, 2000, in the United Kingdom, with a United States edition following in November 2000. The fifth book, A Dance with Dragons, came out on July 12, 2011." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the ipad pro 12.9 inch come out?", "passages": [ [ "IPad Pro", "IPad Pro\n\nThe iPad Pro family is a line of iPad tablet computers designed, developed, and marketed by Apple Inc., that runs the iOS mobile operating system.", "Its current generation is available in two screen sizes, and , each with four options for internal storage capacities: 64, 256, 512 GB, or 1 TB.", "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015.", "It is larger than all previous iPad models and the first iPad tablet to feature LPDDR4 RAM.", "The 12.9-inch tablet was later followed by the smaller 9.7-inch version, which was announced on March 21, 2016, and released on March 31 that same year.", "On June 5, 2017, a second generation of iPad Pro was announced, which features A10X Fusion processors, with basic storage of 64 GB, and optional 512 GB.", "Upgraded displays include a new 10.5-inch version to replace the 9.7-inch model, while the 12.9-inch version was refreshed.", "Following this announcement, the first generation iPad Pros, both 9.7 and 12.9 inch, were discontinued.", "The third generation of iPad Pro was announced on October 30, 2018.", "It is available in two screen sizes: and ." ], [ "IPad Mini 4", "IPad Mini 4\n\nThe iPad Mini 4 (stylized and marketed as iPad mini 4) is the fourth-generation iPad Mini tablet computer designed, developed and marketed by", "Apple Inc.", "It was announced along with the iPad Pro on September 9, 2015, and released the same day.", "The iPad Mini 4, which replaced the iPad Mini 3, is the only iPad Mini currently sold by Apple solely as a 128GB model as of March 21, 2017, when the iPad Mini 2 was discontinued.", "The iPad Mini 4 was announced during the \"Hey Siri\" Apple Special Event on September 9, 2015, alongside other new or refreshed products, including the iPad Pro, the iPhone 6s and the Apple TV.", "However, there was minimal focus directly on the new device, with only a brief mention at the end of the iPad Pro portion of the keynote.", "During Apple's October 2018 keynote CEO Tim Cook mentioned the iPad Mini in the current lineup, possibly hinting that the device is still relevant and that it may eventually see a successor.", "The iPad Mini 4 ships with the iOS 9 operating system pre-installed, and was the first device to do so.", "With an additional 1 GB of RAM compared to the previous generations' Mini, the iPad Mini 4 is capable of utilizing the Slide Over, Split View and Picture in Picture multitasking functions in iOS 9." ], [ "IPad Pro", "The redesigned 2018 models feature new edge-to-edge Liquid Retina displays, Face ID, improved 12MP cameras, USB-C connectors, and Apple A12X Bionic processors.", "The tablets are offered in 11-inch and 12.9-inch sizes, and are the first models to offer tap-to-wake LCD displays (following the iPhone XR), and up to 1TB of internal storage.", "Additionally, the third generation tablets lack both Touch ID and a headphone jack; the former having been superseded by Face ID.", "They were released on November 7, 2018.", "There are four accessories made specifically for iPad Pro, all of which are sold separately: a \"smart\" screen cover; an attachable keyboard, Smart Keyboard; an active bluetooth tracking stylus, Apple Pencil; and a form-fitted silicone case that is compatible with the Smart Keyboard.", "Smart Keyboard docks with iPad Pro using the Smart Connector, a magnetic connection that provides data transfer and power.", "Smart Keyboard, which doubles as a kickstand, is comparable to that of the competing Microsoft Surface Pro.", "The design of the Smart Keyboard is similar to the design of the Smart Cover accessory.", "The first generation Apple Pencil is a precision stylus exclusive to the iPad Pro and the iPad 2018.", "The accessory is rechargeable via the Lightning port on the tablet itself." ] ], "gold": "Each generation of the iPad Pro series of tablet computers includes a model with a 12.9 inch screen. Apple released the1st generation of the tablet on November 11, 2015, the 2nd generation on June 13, 2017, the 3rd generation on November 7, 2018, and the 4th generation on March 25, 2020. A 5th generation iPad Pro was announced on April 20, 2021.", "prediction 1": "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015. The current generation of the iPad Pro is available in two screen sizes, and each with four options for internal storage capacities: 64, 256, 512 GB, or 1 TB. The first generation iPad Pro was announced on September 9, 2015, and released the same day. The second generation was announced on June 5, 2017, and featured A10X Fusion processors, with basic storage of 64 GB, and optional 512 GB of the display. The third generation of the iPad Pro was announced on October 30, 2018, and released the same day.", "prediction 2": "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015. It is larger than all previous iPad models and the first iPad tablet to feature LPDDR4 RAM. The 12.9-inch tablet was later followed by the smaller 9.7-inch version, which was announced on March 21, 2016, and released on March 31 that same year. On June 5, 2017, a second generation of iPad Pro was announced, which features A10X Fusion processors, with basic storage of 64 GB, and optional 512 GB. The third generation of iPad Pro was announced on October 30, 2018, and is available in two screen sizes: and.", "prediction 3": "The first iPad Pro, the 12.9-inch version of the iPad Pro, was announced on September 9, 2015, and released on November 11, 2015. It was later followed by the smaller 9.7-inch version, which was announced on March 21, 2016, and released on March 31 that same year. The iPad Mini 4, the fourth-generation iPad Mini tablet computer designed, developed and marketed by Apple Inc., was announced along with the iPad Pro on September 9, 2015, and released the same day. The third generation of iPad Pro was announced on October 30, 2018, and was released the same day.", "prediction 4": "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015. The 12.9-inch version was later followed by the smaller 9.7-inch version, which was announced on March 21, 2016, and released on March 31 that same year. On June 5, 2017, a second generation of iPad Pro was announced, which features A10X Fusion processors, with basic storage of 64 GB, and optional 512 GB. The third generation of iPad Pro was announced on October 30, 2018, and is available in two screen sizes: and.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 272 }, { "error type": "Redundant", "explanation": "The first iPad Pro, the 12.9-inch version, was announced on September 9, 2015, and released on November 11, 2015.", "start": 273, "end": 338 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 343, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 520 }, { "error type": "Irrelevant", "explanation": "", "start": 521, "end": 592 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 597, "end": 619 } ], "missing-info": [], "corrected-prediction": "The first iPad Pro, the 12.9-inch version was released on November 11, 2015. The first generation iPad Pro was announced on September 9, 2015, and released the same day. The third generation was released on November 7, 2018. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who has kicked the most goals in a game of afl?", "passages": [ [ "Tony Lockett", "Tony Lockett\n\nAnthony Howard \"Tony\" Lockett (born 9 March 1966) is a former Australian rules football player.", "Nicknamed \"Plugger\", Lockett is the highest goalscorer in the history of the VFL/AFL with 1,360 goals in a career of 281 games, starting in 1983 with the St Kilda Football Club and ending in 2002 with the Sydney Swans.", "Lockett won the Brownlow Medal in 1987, becoming the first and only full forward to ever win the award.", "He is a four-time Coleman Medallist, kicked more than 100 goals in a season on six occasions (an AFL record) and is a member of the Australian Football Hall of Fame.", "In 1999, Lockett broke the all-time goals record when he kicked his 1300th goal, surpassing Gordon Coventry's record of 1299 which had stood for 62 years.", "Lockett's new record remains unbeaten.", "At 191\u00a0cm tall and weighing 118\u00a0kg, Lockett was a unique footballer.", "His aggression, strong hands, acceleration, high leap and accurate kicking made him a formidable player.", "Tony Lockett was born in Ballarat, Victoria, to his father Howard (a country footballer who played over 500 games and a North Ballarat Football Club Hall of Famer and his mother Liz.", "He was educated at Ballarat Secondary College and Ballarat Grammar School." ], [ "Harry Davie", "Harry Davie\n\nHenry John Davie (30 March 1905 - 17 March 1968) was an Australian rules footballer who played for Melbourne and Carlton in the Victorian Football League (VFL) during the 1920s.", "Born in England, Davie was very lightly built but could play in the key forward positions as well as in the pockets.", "He holds the record for most goals on debut by a Melbourne footballer, with a bag of six against Richmond when he played his first game in 1924.", "In Melbourne's Round 14, encounter with Carlton the following season at Princes Park, Davie kicked 13 goals and 5 behinds.", "It remains the most ever goals kicked by an individual in a game at the ground and the equal most by a player against Carlton anywhere with both Tony Lockett and Tony Modra kicking 13 goals against Carlton in the 1990s.", "His haul was also a club record until 1947 when Fred Fanning bagged 18.", "Davie twice kicked over 50 goals in a season and topped Melbourne's goalkicking in 1925 and 1927.", "He missed out on his club's 1926 premiership through injury.", "He crossed to Carlton in 1927 and played there for a season before finishing his career in the Victorian Football Association (VFA) with Preston.", "He was often used as a centreman at Preston but also spent time up forward." ] ], "gold": "The player that holds the record of most goals in a single AFL game is Fred Fanning. Alternatively, the record of most goals kicked on their debut match in the AFL is held by John Coleman.", "prediction 1": "There are several players who have kicked the most goals in a game of Australian rules football. The player who has kicked the most goals is Harry Davie, who played for Melbourne and Carlton in the Victorian Football League (VFL) during the 1920s. He holds the record for most goals on debut by a Melbourne footballer, with a bag of six against Richmond when he played his first game in 1924.", "prediction 2": "Tony Lockett, nicknamed Plugger, is the highest goalscorer in the history of the VFL/AFL with 1,360 goals in a career of 281 games, starting in 1983 with the St Kilda Football Club and ending in 2002 with the Sydney Swans. Harry Davie, an Australian rules footballer who played for Melbourne and Carlton in the Victorian Football League (VFL) during the 1920s, kicked the most goals in a game of the AFL in 1927. Tony Lockettttts has kicked the most goals in a game of the AFL with 13 goals against Carlton anywhere. Tony Modra has kicked the most goals in a game of the Australian Football Hall of Fame.", "prediction 3": "There was a time when Australian footballers kicked the most goals in a game, but the record for the most goals in a game was broken by Harry Davie in 1924. However, in 1999, Tony Lockett broke the all time goals record when he kicked his 1300th goal, surpassing Gordon Coventry's record of 1299 which had stood for 62 years. Tony Lockett has the highest goalscorer in the history of the AFL with 1,360 goals in a career of 281 games, starting in 1983 with the St Kilda Football Club and ending in 2002 with the Sydney Swans.", "prediction 4": "In the history of the Australian Football League, Tony Lockett has kicked the most goals in a game, while Harry Davie has kicked the most. Lockett kicked 1,360 goals in 281 games, starting in 1983 with the St Kilda Football Club and ending in 2002 with the Sydney Swans.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 247 }, { "error type": "Redundant", "explanation": "There are several players who have kicked the most goals in a game of Australian rules football. The player who has kicked the most goals is Harry Davie, who played for Melbourne and Carlton in the Victorian Football League (VFL) during the 1920s. ", "start": 248, "end": 392 } ], "missing-info": [], "corrected-prediction": " Fred Fanning has kicked the most goals in a game of Australian rules football. Harry Davie holds the record for most goals on debut." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When did 1 and 2 cent coins stop in australia?", "passages": [ [ "Australian five-cent coin", "Australian five-cent coin\n\nThe Australian five-cent coin is the lowest-denomination circulating coin of the decimal Australian dollar introduced in 14 February 1966, replacing the pre-decimal sixpence.", "It has been the lowest-denomination coin in general circulation since the withdrawal of the one-cent and two-cent coins in 1992.", "Due to inflation, the purchasing power of the five-cent coin continues to drop, and as of 2018 represents 0.27% of the country's minimum hourly wage for workers age 21 or over.", "The coin was introduced into circulation on 14 February 1966.", "In its first year of minting, 30 million were struck at the British Royal Mint (then in London), in addition to 45.4 million at the Royal Australian Mint in Canberra.", "Since then, with the exception of 1981, the coin has been produced exclusively in Canberra.", "In 1981, 50.3 million were produced at the Royal Mint's new headquarters in Llantrisant, Wales, and 50 million at the Royal Canadian Mint in Winnipeg, in addition to 62 million in Canberra.", "The reverse side depicts an echidna and the obverse side the head of state, Queen Elizabeth II.", "The only commemorative coin in this denomination was issued in 2016 to commemorate the 50th anniversary of decimal currency." ], [ "Australian fifty-cent coin", "Australian fifty-cent coin\n\nThe twelve-sided Australian fifty-cent coin is the third-highest denomination coin of the Australian dollar and the largest in terms of size in circulation.", "It is the only 12-sided coin of its size in the southern hemisphere.", "It was introduced in 1969 to replace the round fifty-cent coin issued in 1966.", "The original, round, 50-cent coin was made of 80% silver and 20% copper; but as the value of a free-floating silver price became higher, the coin's bullion value became more valuable than its face value; so that version was withdrawn from circulation and replaced with the dodecagonal cupro-nickel version.", "It is by diameter the largest Australian coin currently issued and second largest after the Crown of 1937\u201338.", "It is also the heaviest Australian coin in common circulation.", "Many commemorative designs have been issued, the large size allowing for detailed content.", "With a diameter of 31.65\u00a0mm (1.25\u00a0in), the 50-cent coin is one of the largest in volume among those currently circulating in the world.", "Coins of larger diameter include the Costa Rican five-hundred-colones and the fifty-CFP Franc, both 32.9\u00a0mm.", "Five-cent, ten-cent, twenty-cent, and fifty-cent coins are legal tender up to the sum of $5." ] ], "gold": "Both the one-cent and two-cent coins were introduced in 1966 during the decimalisation of Australian currency. They were the two lower denomination coins in the country until they stopped circulating in 1992, although none had been minted for circulation since 1990.", "prediction 1": "The Australian one-cent and two-cent coins stopped in circulation in Australia in 1992. The Australian two-cent coin stopped in circulation in Australia in 1993.", "prediction 2": "The 1 and 2 cent coins stopped in circulation in australia in 1992. The Australian five-cent coin is the lowest-denomination circulating coin of the decimal Australian dollar introduced in 14 February 1966, replacing the pre-decimal sixpence. It has been the lowest-denomination coin in general circulation since the withdrawal of the one-cent and two-cent coins in 1992. The twelve-sided Australian fifty-cent coin is the third-highest denomination coin of the Australian dollar and the largest in terms of size in circulation. It was introduced in 1969 to replace the round fifty-cent coin issued in 1966.", "prediction 3": "The one-cent and two-cent coins in Australia stopped in circulation in 1992. The five-cent coin was introduced into circulation on 14 February 1966, replacing the pre-decimal sixpence. Since then, with the exception of 1981, the five-cent coin has been produced exclusively in Canberra. The twelve-sided Australian fifty-cent coin was introduced in 1969 to replace the round fifty-cent coin issued in 1966. It was introduced to replace the round fifty-cent coin issued in 1966.", "prediction 4": "The Australian one cent coin was introduced into circulation on 14 February 1966, replacing the pre-decimal sixpence. The Australian two cent coin was introduced in 1992, replacing the one cent coin. The Australian five-cent coin has been the lowest-denomination coin in general circulation since the withdrawal of the one cent and two cent coins in 1992.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Australian one-cent and two-cent coins stopped in circulation in Australia in 1992. ", "start": 88, "end": 161 } ], "missing-info": [], "corrected-prediction": "The Australian one-cent and two-cent coins stopped in circulation in Australia in 1992." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who played ryan's brother in the oc?", "passages": [ [ "Ryan Atwood", "Ryan and Seth are often able to finish each other's sentences, according to Summer, \"like they're composing a lie on the spot\" and read each other's body language and facial expressions.", "When Ryan and his brother Trey are caught attempting to steal a car, his mother Dawn kicks him out.", "His attorney, Sandy Cohen, takes him into his home in Newport Beach, California, despite objections from Sandy's wife, Kirsten.", "Sandy takes note of Ryan's high test scores in spite of his poor grades, which was more likely due to inconsistent attendance rather than Ryan's lack of intelligence.", "Initially Kirsten is wary of him and insisted Sandy take him back to juvie but, after witnessing him being physically assaulted in juvie for defending her from an unruly inmate, she takes him home.", "She subsequently welcomes him to stay permanently upon seeing that Dawn was incapable of adequately caring for Ryan due to her alcohol problem.", "In the episode \"The Debut\", Sandy and Kirsten become his legal guardians, after Dawn leaves him at the Cohens' in the previous episode.", "Ryan becomes part of the Cohen family, living in their pool house, and becomes a brother to Sandy and Kirsten's son, Seth Cohen; even Sandy and Kirsten consider him their second son, referring to him as such rather than the more legally accurate term \"ward\"." ], [ "Ryan Atwood", "Having quit school and working in construction, Ryan lives with Theresa, but she realizes he is unhappy and encourages him to visit Seth in Portland, Oregon, where he ran away following Ryan's departure.", "He hesitantly goes, hoping to convince his friend to go home to his parents before the fall semester starts, but while he stays in Portland, Theresa notifies him through the telephone she has miscarried.", "Although Ryan is devastated and wants to return to her, Theresa tells him he needs to go back to Newport with Seth.", "Ryan returns to school and is still uncertain about his plans beyond high school.", "By chance, he catches Sandy and Kirsten's contractor cutting corners and quickly points out discrepancies in the floor plan and finished product.", "The school counselor discovers some technical drawings and sketches of the lower floor of the Cohens' home in his notebook and advises him to consider architecture as a career.", "As part of Seth's idea of a reunion of the \"Fab Four\" (consisting of Ryan, Marissa, Seth and his girlfriend Summer Roberts), Ryan and Marissa are pulled closer together.", "When he overhears Marissa admitting to Summer that Ryan is the only one she ever loved and she misses him every day, he confesses his own lingering feelings for her.", "The two get back together, just as Ryan's brother Trey is released from jail." ], [ "The O.C. (season 2)", "Ryan's brother Trey Atwood also returned, but Logan Marshall-Green replaced Bradley Stryker in portraying him.", "Other guest stars in new recurring roles included Billy Campbell, as magazine editor Carter Buckley, Kim Delaney, as Sandy's ex-fianc\u00e9e Rebecca Bloom, Johnny Messner, as Julie's ex-boyfriend Lance Baldwin, Kathleen York, as mother of Caleb's illegitimate child Renee Wheeler, Nikki Griffin as party girl and drug addict Jess Sathers and Marguerite Moreau, as Reed Carlson the Vice President of a graphic novel company, and Max Burkholder as a child in airport, with a toy similar to Captain Oats, in \"The Rainy Day Women\" \n\nThe second season was widely received as inferior to the first, but it has been noted that this may be slightly unfair.", "The show moved to \"ultra-competitive Thursday\" nights which Schwartz described as a \"real vote of confidence [from] the network\", but many attributed placing \"The O.C.\" against the likes of \"Survivor\", \"Joey\" and \"Will & Grace\" as part of \"The O.C. \"'s decline in popularity.", "The move improved FOX's performance at the new time slot, but lost the show viewers.", "The season premiere attracted 8.6 million viewers, but average viewing figures decreased thirty percent from the previous season to 7 million." ] ], "gold": "Bradley Stryker played Ryan's brother, Trey Atwood, in the first season of the OC, including when Ryan and Trey are caught attempting to steal a car. Logan Marshall-Green then played Trey in seasons 2 and 3 of the series when Trey is released from jail. ", "prediction 1": "Trey Atwood also returned to the show for Season 2 of The OC, but Logan Marshall-Green replaced Bradley Stryker in portraying him. Brady Stryker was played by the late actor Michael Strahan.", "prediction 2": "Trey Atwood, played by Bradley Stryker on the FOX crime drama The O.C., was played by Logan Marshall-Green.", "prediction 3": "Ryan's brother Trey Atwood also returned to the O.C. in Season 2. Logan Marshall-Green replaced Bradley Stryker in portraying him.", "prediction 4": "Trey Atwood, played by Bradley Stryker, is a character on the TV show The O.C. Ryan's brother Trey is played by Logan Marshall-Green. Trey's character is portrayed by John Goodman in the second season of The O.C.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 131, "end": 190 } ], "missing-info": [], "corrected-prediction": "Trey Atwood also returned to the show for Season 2 of The OC, but Logan Marshall-Green replaced Bradley Stryker in portraying him. " }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "What is the population of pawleys island sc?", "passages": [ [ "Pawleys Island, South Carolina", "Pawleys Island, South Carolina\n\nPawleys Island is a town in Georgetown County, South Carolina, United States, and the Atlantic coast barrier island on which the town is located.", "Pawleys Island's population was 103 at the 2010 census, down from 138 in 2000.", "The post office address also includes an unincorporated area on the mainland adjacent to the island, which includes a commercial district along the Ocean Highway (US Route 17) and a residential area between the highway and the Waccamaw River.", "The island is on the southern end of The Grand Strand and is one of the oldest resort areas of the US East Coast.", "The town of Pawleys Island, though, is only on the island.", "The island lies off the Waccamaw Neck, a long, narrow peninsula between the ocean and the river, and is connected to the mainland by two bridges, the North Causeway and the South Causeway.", "The earliest known inhabitants of the Pawleys Island area were Waccamaw and Winyah Native Americans.", "They called the area \"Chiquola\" or \"Chicora\", meaning \"the land\".", "The Waccamaw tribe got its name from the nearby Waccamaw river.", "The river is referred to the natives as \"coming and going\" which influenced their name.", "These tribes lived off of the land and the sea." ] ], "gold": "Pawley's Island in Georgetown County, South Carolina, has an official population of 103 as of the 2010 census, a significant decrease from the population of 138 reported in the 2000 census. The population was estimated to be 105 in 2015 and 106 in 2016 and 2017.", "prediction 1": "Pawleys Island is a town in Georgetown County, South Carolina, United States and the Atlantic coast barrier island on which the town is located. Pawleys Island's population was 103 at the 2010 census, down from 138 in 2000. The population of Pawleys Island in 2000 was 139.", "prediction 2": "Pawleys Island is a town in Georgetown County, South Carolina, United States, and the Atlantic coast barrier island on which the town is located. Its population was 103 at the 2010 census, down from 138 in 2000.", "prediction 3": "Pawleys Island is a town in Georgetown County, South Carolina, United States, and the Atlantic coast barrier island on which the town is located. Pawleys Island's population was 103 at the 2010 census, down from 138 in 2000.", "prediction 4": "Pawleys Island is a town in Georgetown County, South Carolina, United States, and the Atlantic coast barrier island on which the town is located. The population of Pawleys Island was 103 at the 2010 census, down from 138 in 2000.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 144 }, { "error type": "Redundant", "explanation": "Pawleys Island is a town in Georgetown County, South Carolina, United States and the Atlantic coast barrier island on which the town is located. Pawleys Island's population was 103 at the 2010 census, down from 138 in 2000. ", "start": 224, "end": 273 } ], "missing-info": [], "corrected-prediction": "Pawleys Island is a town in Georgetown County, South Carolina. Pawleys Island's population was 103 at the 2010 census, down from 138 in 2000." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Which team won first world cup in cricket?", "passages": [ [ "Cricket World Cup", "India volunteered to host the third Cricket World Cup, but most ICC members preferred England as the longer period of daylight in England in June meant that a match could be completed in one day.", "The 1987 Cricket World Cup was held in India and Pakistan, the first hosted outside England.", "Many of the tournaments have been jointly hosted by nations from the same geographical region, such as South Asia in 1987, 1996 and 2011, Australasia in 1992 and 2015, Southern Africa in 2003 and West Indies in 2007.", "Twenty nations have qualified for the Cricket World Cup at least once.", "Seven teams have competed in every tournament, five of which have won the title.", "The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "The West Indies (1975 and 1979) and Australia (1999, 2003 and 2007) are the only teams to have won consecutive titles.", "Australia has played in seven of the eleven finals (1975, 1987, 1996, 1999, 2003, 2007, 2015).", "England has yet to win the World Cup, but has been runners-up three times (1979, 1987, 1992)." ], [ "1973 Women's Cricket World Cup", "1973 Women's Cricket World Cup\n\nThe 1973 Women's Cricket World Cup was the first tournament of its kind, held two years before the first limited overs World Cup for men in 1975.", "The competition was won by the hosts, England.", "The competition was the brainchild of businessman Sir Jack Hayward, who contributed \u00a340,000 towards its costs.", "England, Australia, New Zealand, Trinidad and Tobago and Jamaica were joined by an International XI and a Young England side in a round robin league which saw the top team win the World Cup.", "England topped the group with 20 points from their six matches, including five victories and one defeat, while Australia were runners up posting 17 points with four wins.", "The final round robin match, held at Edgbaston on 28 July, was distinguished by a commanding century by Enid Bakewell of England, whose 118 formed the bedrock of England's imposing 279-3 in their 60 overs, with captain Rachel Heyhoe-Flint scoring 64.", "Australia were restricted by tight England bowling and fell well short of their target, scoring 187-9.", "The cup was presented by Princess Anne and the winning England team were hosted at a reception at 10 Downing Street by Prime Minister Edward Heath ." ], [ "1975 Cricket World Cup", "Australia defeated England and the West Indies beat New Zealand, before the West Indies, the pre-tournament favourites, defeated Australia in the final at Lord's by 17 runs to become the first World Cup winners.", "The opening match of the tournament featured one of the most bizarre batting efforts in one-day history, by India's Sunil Gavaskar.", "After England scored 334/4, with Dennis Amiss making 137, Gavaskar batted through the full 60 overs for 36 not out, prompting several pitch invasions from unhappy Indian fans.", "The format of the first world cup was 2 groups of four teams each, and each team playing each other.", "The top two team from each group then advance to the semi-finals, where the winners then advance (qualified) for the finals.", "The first Cricket World Cup was played in England on seven different venues.", "A total of 16 matches were played in the 1975 Cricket World Cup, including two semi-finals and a final.", "The following 8 teams qualified for the final tournament.", "Sri Lanka and East Africa were the only two teams without Test status.", "In the best World Cup performance to date by a bowler, Gary Gilmour took 6/14, as England were bowled out for 93 (36.2 overs), after having fallen to 37/7." ] ], "gold": "In 1975, West Indies defeated Australia in the first Men's Cricket World Cup at Lord's by 17 runs. The first Women's Cricket World Cup was won in 1973 by the tournament hosts, England. The 1973 Women's Cricket World Cup was the first tournament of its kind, held two years before the first Men's Cricket World Cup in1975.", "prediction 1": "The first cricket world cup was held in 1975, when Australia beat England in the semi-finals, and the West Indies defeated Australia in the final at Lord's by 17 runs to become the first World Cup winners. The West Indies won the first two tournaments, the West Indies won the first two tournaments, and Australia won five of the six. The first women's cricket world cup was held in 1973, when the West Indies defeated Australia in the final at Lord's by 17 runs.", "prediction 2": "The first cricket world cup was held in 1975, when Australia defeated England in the semi-finals, and the West Indies defeated Australia in the final to become the first World Cup winners. The West Indies won the first two tournaments, Australia has won five, India has won two, and Sri Lanka has each won once. The first Women's Cricket World Cup was held in 1973, and was won by the hosts, England.", "prediction 3": "The first Cricket World Cup was held in 1975, where England were the hosts. The 1973 Women's Cricket World Cup was the first tournament of its kind, held two years before the first limited overs World Cup for men in 1975. The competition was won by the hosts, England. The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "prediction 4": "The first World Cup in Cricket was the one held in England in 1975. The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once. Twenty nations have qualified for the Cricket World Cup at least once. Seven teams have competed in every tournament, five of which have won the title. The 1973 Women's Cricket World Cup was the first tournament of its kind, held two years before the first limited overs World Cup for men in 1975. The competition was won by the West Indies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 334 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 389, "end": 463 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first cricket world cup was held in 1975, when the West Indies defeated Australia in the final at Lord's by 17 runs to become the first World Cup winners. The 1973 Women's Cricket World Cup was the first tournament of its kind. The competition was won by the hosts, England." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "In december of 1941 who commanded the allied forces in the philippines?", "passages": [ [ "Edwin Ramsey", "He had been on the Oklahoma Military Academy polo team and played on the losing side of a polo match in the Philippines the day before Japan attacked Pearl Harbor; the umpire was Major General Jonathan M. Wainwright (who would assume command of the South West Pacific Area after General Douglas MacArthur was evacuated to Australia).", "As a first lieutenant during the withdrawal to Corregidor in the Philippines Campaign, he was in command of the 27-man, mostly Filipino G Troop when they encountered the enemy in the village of Morong on the Bataan peninsula on January 16, 1942.", "Despite being heavily outnumbered by an infantry force supported by tanks, Ramsey ordered the last cavalry charge in American military history.", "The surprised Japanese broke and fled.", "Ramsey and his men held their position for five hours under heavy fire, until reinforcements could be brought up.", "He would later be awarded the Silver Star and the Purple Heart for this action.", "After the fall of Bataan, Ramsey and Captain Joseph Barker made their way to central Luzon and joined Lieutenant Colonel Claude Thorp, who had been given the task of organizing guerrilla resistance by MacArthur.", "Luzon was divided into four regions, and Barker was given responsibility for the East Central Luzon Guerrilla Area (ECLGA), extending from Manila to the Lingayen Gulf.", "After Thorp was captured by the Japanese in October 1942, Barker took his place, putting Ramsey in charge of the ECLGA." ], [ "Douglas MacArthur in World War II", "On July 26, 1941 Roosevelt federalized the Philippine Army, recalled MacArthur to active duty in the U.S. Army as a two star/major general, and named him commander of U.S. Army Forces in the Far East (USAFFE).", "MacArthur was promoted to lieutenant general the following day, and then to general on December 20.", "At the same time, Sutherland was promoted to major general, while Marshall, Spencer B. Akin, and Hugh John Casey were all promoted to brigadier general.", "On July 31, 1941 the Philippine Department had 22,000 troops assigned, 12,000 of whom were Philippine Scouts.", "The main component was the Philippine Division, under the command of Major General Jonathan M. Wainwright.", "Between July and December 1941 the garrison received 8,500 reinforcements.", "After years of parsimony, much equipment was shipped.", "By November, a backlog of 1,100,000 shipping tons of equipment intended for the Philippines had accumulated in U.S. ports and depots awaiting vessels.", "At 0330 local time on December 8, 1941, Sutherland learned of the attack on Pearl Harbor and informed MacArthur.", "At 0530, Chief of Staff of the United States Army General George Marshall ordered MacArthur to execute the existing war plan, Rainbow Five.", "MacArthur did nothing." ], [ "Douglas MacArthur in World War II", "Douglas MacArthur in World War II\n\nGeneral of the Army Douglas MacArthur (January 26, 1880 \u2013 April 5, 1964) was an American general and field marshal of the Philippine Army.", "He was a Chief of Staff of the United States Army during the 1930s and played a prominent role in the Pacific theater during World War II.", "He received the Medal of Honor for his service in the Philippines Campaign.", "MacArthur was recalled to active duty in 1941 as commander of U.S. Army Forces in the Far East.", "A series of disasters followed, starting with the destruction of his air force on December 8, 1941, and the invasion of the Philippines by the Japanese.", "MacArthur's forces were soon compelled to withdraw to Bataan, where they held out until May 1942.", "In March 1942, MacArthur, his family and his staff left Corregidor in PT boats, and escaped to Australia, where MacArthur became Supreme Commander, Southwest Pacific Area.", "For his defense of the Philippines, MacArthur was awarded the Medal of Honor.", "After more than two years of fighting in the Pacific, he fulfilled a promise to return to the Philippines.", "He officially accepted Japan's surrender on September 2, 1945." ] ], "gold": "General of the Army, Douglas MacArthur was an American general and field marshal of the Philippine Army. MacArthur was recalled to active duty in 1941 as commander of U.S. Army Forces in the Far East. As the senior field commander of Filipino and US forces under General Douglas MacArthur, Jonathan M. Wainwright was responsible for resisting the Japanese invasion of the Philippines, which began in December 1941. ", "prediction 1": "In December 1941, the United States commanded the allied forces in the Philippines. The Philippine Division was under the command of Major General Jonathan M. Wainwright.", "prediction 2": "In December 1941, Major General Jonathan M. Wainwright commanded the allied forces in the Philippines. MacArthur, who served as an American general and field marshal of the Philippines, was appointed as commander of U.S. Army Forces in the Far East.", "prediction 3": "In December of 1941, Jonathan M. Wainwright commanded the allied forces in the philippines. He had replaced the late Major General Douglas MacArthur as the commander of U.S. Army Forces in the Far East. MacArthur had been recalled to active duty on December 8, 1941, and was named as commander of U.S. Army Forces in the Far East.", "prediction 4": "In the Philippines in December, 1941, Major General Jonathan M. Wainwright commanded the allied forces. Ramsey was a first lieutenant during the withdrawal to Corregidor in the Philippines Campaign. On January 16, 1942, he was in command of the 27-man, mostly Filipino G Troop when they encountered the enemy in the village of Morong on the Bataan peninsula. After the fall of Bataan, Ramsey and Captain Joseph Barker made their way to central Luzon and joined Lieutenant Colonel Claude Thorp, who had been given the task of organizing guerrilla resistance by MacArthur. After Thorp was captured by the Japanese in October 1942, Barker took his place, putting Ramsey in charge of the East Central Luzon Guerrilla Area (ECLGA), extending from Manila to the Lingayen Gulf. At 0330, Chief of Staff of Staff of Staff of Staff of the United", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "General of the Army Douglas MacArthur was an American general and field marshal of the Philippine Army. MacArthur was recalled to active duty in 1941 as commander of U.S. Army Forces in the Far East. In December 1941, the United States commanded the allied forces in the Philippines. The Philippine Division was under the command of Major General Jonathan M. Wainwright." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Where did they film some like it hot?", "passages": [ [ "Some Like It Hot (2016 film)", "Some Like It Hot (2016 film)\n\n", "Some Like It", "Hot is a 2016 Chinese romantic comedy film directed by Song Xiaofei and Dong Xu and starring Xiao Yang, Yan Ni, Xiaoshenyang, Qiao Shan and Ailun.", "It was released in China on December 30, 2016.", "It won the Outstanding Film Contribution Award at the Hengdian Film and TV Festival of China\n\nXiao Han, a man with deep anxiety caused by the tragic death of one of his schoolmates, Queen Wang.", "He leads a boring life for forty years.", "The married man then decides to make himself feel young and vibrant again.", "In order for him to do that, he has to pursue beauty where he then chooses to chase after this gorgeous woman named Yoyo, who is a Korean model.", "He does this with his three friends which turns out to be a crazy hilarious endeavour towards fulfillment.", "In the midst of his pursuit after Yoyo, he unwittingly created a love interest misunderstanding with his superior, Miss Ma Lilian whom his buddy, Ai Mu has a crush on.", "The film has grossed in China.", "The movie with a running time of 173 minutes was co-produced by the following companies:\n\n\nand distributed by the following companies:" ], [ "Some Like It Hot", "Some Like It Hot\n\nSome Like It Hot is a 1959 American black and white romantic comedy film set in 1929, directed and produced by Billy Wilder, starring Marilyn Monroe, Tony Curtis, and Jack Lemmon.", "The supporting cast includes George Raft, Pat O'Brien, Joe E. Brown, Joan Shawlee, and Nehemiah Persoff.", "The screenplay by Billy Wilder and I.A.L. Diamond is based on a screenplay by Robert Thoeren and Michael Logan from the French film \"Fanfare of Love\".", "The film is about two musicians who dress in drag in order to escape from mafia gangsters whom they witnessed commit a crime inspired by the Saint Valentine's Day Massacre.", "Despite Monroe's contract requiring the film to be in color, she agreed to it being filmed in black and white after seeing that Curtis and Lemmon's makeup gave them a \"ghoulish\" appearance on color film.", "\"Some Like It Hot\" opened to largely positive reviews and is today considered to be one of the greatest films of all time.", "It was voted as the top comedy film by the American Film Institute on their list on AFI's \"100 Years... 100 Laughs\" poll in 2000.", "In 2017, the film was voted the best comedy of all time in a poll of 253 film critics from 52 countries conducted by the BBC in 2017." ], [ "Kambakkht Ishq", "Prashant Shah, line producer of \"Kambakkht Ishq\" in L.A. commented, \"We are in talks with Beyonc\u00e9 and we have also received a letter from Arnold's office...", "Things will be confirmed shortly and we will be making a formal announcement when that happens.\"", "It was later reported that neither star would be appearing in the film.", "In March 2008, Nadiadwala announced that \"this would be the first Indian film to be shot within Universal Studios.\"", "However, when a fire broke out on the backlot of Universal Studios on 1 June 2008, the shooting of the film was expected to be delayed.", "But the producer indicated, \"so far the area where we are supposed to shoot remains unaffected.", "So for now, we are proceeding on schedule.\"", "Later that month, the cast finally began filming for the project in Los Angeles, California, where pivotal scenes were shot at the Kodak Theatre and Universal Studios.", "In August 2008, reports had indicated that the film was 50\u201360% complete and the cast would continue filming for the project in Venice, Italy.", "After completing their overseas schedule, the production team later headed to shoot in Mumbai, India.", "During December 2008, reports surfaced indicating that Kumar and Kapoor would appear alongside Carmen Electra in a promotional music video for the film." ] ], "gold": "There is more than one movie called Some Like It Hot. The 1959 film, Some Like It Hot, is an American romantic comedy starring Marilyn Monroe, Tony Curtis, and Jack Lemmon. Many of the scenes were filmed at Hotel del Coronado in San Diego, California. The 2016 film, Some Like It Hot, is a Chinese romantic comedy that was filmed in China. It won the Outstanding Film Contribution Award at the Hengdian Film and TV Festival of China.", "prediction 1": "There are several movies entitled \"Some Like It Hot\". The 1959 American black and white romantic comedy film \"Some Like It Hot\" was directed by Billy Wilder and produced by I.A.L. Diamond. The 2016 Chinese romantic comedy \"Some Like It Hot\" was directed by Song Xiaofei and Dong Xu and starred Xiao Yang, Yan Ni, Xiaoshenyang, Qiao Shan and Ailun.", "prediction 2": "The 1959 American black and white romantic comedy film Some Like It Hot is filmed in Los Angeles, California. Some Like It Hot is released in China on December 30, 2016. The 2016 Chinese romantic comedy movie Some Like It Hot is filmed in Shanghai and was released on December 30, 2016.", "prediction 3": "Some Like It Hot is a 1959 American black and white romantic comedy film set in 1929, directed and produced by Billy Wilder. The cast finally began filming for the project in Los Angeles, California, where pivotal scenes were shot at the Kodak Theatre and Universal Studios. Later that month, the cast finally began filming for the project in Venice, Italy, where the film's final scenes were shot. The film was then headed to Mumbai, India, where the production team later headed to shoot.", "prediction 4": "Some Like It Hot is a 1959 American black and white romantic comedy film set in 1929, directed and produced by Billy Wilder, starring Marilyn Monroe, Tony Curtis, and Jack Lemmon. In 2017, the cast finally began filming for the project in Los Angeles, California, where pivotal scenes were shot at the Kodak Theatre and Universal Studios. In 2008, the cast continued filming for the project in Venice, Italy. After completing their overseas schedule, the production team later headed to Mumbai, India to shoot some like it hot. In 2016, a 2016 Chinese romantic comedy film directed by Song Xiaofei and Dong Xu directed by Song Xiaofei and Dong Xu and Dong Xu, it was released in China on December 30, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 347 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "There are several movies entitled \"Some Like It Hot\". The 1959 American romantic comedy film \"Some Like It Hot\" starred Marilyn Monroe, Tony Curtis, and Jack Lemmon. The 2016 Chinese romantic comedy \"Some Like It Hot\" won the Outstanding Film Contribution Award at the Hengdian Film and TV Festival of China." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When do new episodes of the price is right start?", "passages": [ [ "2017\u201318 United States network television schedule", "2017\u201318 United States network television schedule\n\nThe 2017\u201318 network television schedule for the five major English-language commercial broadcast networks in the United States covers prime time hours from September 2017 to August 2018.", "The schedule is followed by a list per network of returning series, new series, and series canceled after the 2016\u201317 season.", "NBC was the first to announce its fall schedule, on May 14, 2017, followed by Fox on May 15, ABC on May 16, CBS on May 17, and The CW on May 18, 2017.", "NBC adjusted its schedule on May 30, 2017.", "PBS is not included; member television stations have local flexibility over most of their schedules and broadcast times for network shows may vary.", "Ion Television and MyNetworkTV are also not included since the majority of both networks' schedules consist of syndicated reruns (with limited original programming on the former).", "The CW is not included on weekends since it does not carry network programming on those days.", "However, it will return to programming a two-hour Sunday night schedule next season.", "New series are highlighted in bold.", "All times are U.S. Eastern and Pacific Time (except for some live sports or events).", "Subtract one hour for Central, Mountain, Alaska, and Hawaii-Aleutian times." ], [ "The Price Is Right (U.S. game show)", "The Price Is Right (U.S. game show)\n\n", "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman.", "The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes.", "Contestants are selected from the studio audience when the announcer states the show's famous catchphrase, \"Come on down!\"", "The program premiered on September 4, 1972, on CBS.", "Bob Barker was the series' longest-running host from its 1972 debut until his retirement in June 2007, when Drew Carey took over.", "Barker was accompanied by a series of announcers, beginning with Johnny Olson, followed by Rod Roddy and then Rich Fields.", "In April 2011, George Gray became the announcer.", "The show has used several models, most notably Anitra Ford, Janice Pennington, Dian Parkinson, Holly Hallstrom and Kathleen Bradley.", "While retaining some elements of the original version of the show, the 1972 version has added many new distinctive gameplay elements.", "\"The Price Is Right\" has aired over 8,000 episodes since its debut and is one of the longest-running network series in United States television history.", "In a 2007 article, \"TV Guide\" named \"The Price Is Right\" the \"greatest game show of all time.\"" ] ], "gold": "The Price Is Right is an American television game revolving around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. Contestants are selected from the studio audience when the announcer states the show's famous catchphrase, \"Come on down!\" The program premiered on September 4, 1972, on CBS The Price Is Right and has aired over 9,000 episodes since its debut with new seasons premiering in September each year, for example September, 2015, September, 2016, September, 2017 and it's 50th season recently airing on September 13, 2021. ", "prediction 1": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. New episodes of the show typically start on September 4, 1972.", "prediction 2": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes.", "prediction 3": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. New episodes of the series started airing on September 10, 2017, and they continued to air in 2017 and 2018.", "prediction 4": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. The first episode of season 1 of season 2 of season 3 of the series started on September 6, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 108 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 227, "end": 289 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Price Is Right is an American television game show that revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. Contestants are selected from the studio audience when the announcer states the show's famous catchphrase, \"Come on down!\". The program premiered on September 4, 1972, on CBS. \"The Price Is Right\" has aired over 8,000 episodes since its debut " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When was the ukraine taken over by russia?", "passages": [ [ "Russia\u2013Ukraine relations", "Russia\u2013Ukraine relations\n\nThe bilateral relationship between Russia and Ukraine formally started in the 1990s immediately upon the dissolution of the Soviet Union, of which both Russia and Ukraine had been founding constituent republics.", "Interactions between the two areas of Russia and Ukraine developed on a formal basis from the 17th century (note the Treaty of Pereyaslav between Moscow and Bohdan Khmelnytsky's cossacks in 1654), but international-level relations ceased when Catherine the Great liquidated the autonomy of the Cossack Hetmanate in 1764.", "For a short period of time soon after the communist 1917 October Revolution two states interacted again.", "In 1920 Soviet Russian forces overran Ukraine and relations between the two states transitioned from international to internal ones within the Soviet Union, founded in 1922.", "After the Soviet Union's dissolution in 1991, Russia and Ukraine have undergone periods of ties, tensions, and outright hostility.", "On 1 March 2014 the Federation Council of the Russian parliament voted unanimously to allow the President of Russian Federation enter Russian Armed Forces on territory of Ukraine due to refusal of the latter from the Agreement of 21 February 2014.", "On 3 March 2014, the Russian representative to the United Nations, Vitaly Churkin showed a letter signed by former President of Ukraine Viktor Yanukovych on 1 March 2014 and addressed to President of the Russian Federation Vladimir Putin with a request to enter Russian Armed Forces on territory of Ukraine." ], [ "History of Russia (1991\u2013present)", "On the same day, according to Russian president Vladimir Putin, he called an all-night meeting of his military leaders, at the end of which he ordered them to \u201cbegin the work to bring Crimea back into Russia.\u201d", "By February 27, unmarked Russian troops in Ukraine were establishing a blockade of the borders and Ukrainian military bases in the Autonomous Republic of Crimea, and took armed control of its regional parliament.", "A new Ukrainian government was formed and scheduled new elections for May 2014.", "On 1 March, from exile, Viktor Yanukovych requested that Russia use military forces \"to establish legitimacy, peace, law and order, stability and defending the people of Ukraine\".", "On the same day, Vladimir Putin requested and received authorization from the Russian Parliament to deploy Russian troops to Ukraine in response to the crisis and gained complete control over Crimean Peninsula within a day.", "On 6 March 2014, the Crimean Parliament voted to \"enter into the Russian Federation with the rights of a subject of the Russian Federation\" and later held a referendum asking the people of these regions whether they wanted to join Russia as a federal subject, or if they wanted to restore the 1992 Crimean constitution and Crimea's status as a part of Ukraine.", "Though passed with an overwhelming majority, the results are contested by some and approved by others." ], [ "Russia\u2013Ukraine relations", "After the 2014 Ukrainian Revolution, which saw the pro-Russian Yanukovych ousted on 21 February 2014, relations between Russia and Ukraine deteriorated rapidly: significant corruption of pro-Russian government members, forced one-decade russification and pressure on Ukrainian language in eastern parts of Ukraine and Crimea have been uncovered; Throughout March and April 2014, pro-Russian unrest spread in Ukraine, with pro-Russian groups proclaiming \"People's Republics\" in the oblasts of Donetsk and Luhansk, both partially outside the control of the Ukrainian government.", "In response, Ukraine initiated multiple international-court litigations against Russia, as well as suspending all types of military cooperation and military exports.", "On 20 April 2016 Ukraine established a separate government department - the Ministry of Temporarily Occupied Territories and Internally displaced persons.", "Many countries and international organizations applied sanctions against the Russian Federation and against Ukrainian citizens involved in and responsible for the escalation.", "Military clashes between pro-Russian rebels (backed by Russian military) and the Armed Forces of Ukraine began in the east of Ukraine in April 2014.", "On 5 September 2014 the Ukrainian government and representatives of the self-proclaimed Donetsk People's Republic and Luhansk People's Republic signed a tentative truce (ceasefire - the agreement).", "The ceasefire imploded amidst intense new fighting in January 2015." ], [ "Vladimir Putin", "And in some cases, such as the Russia\u2013Ukraine gas disputes, the economic conflicts affected other European countries, for example when a January 2009 gas dispute with Ukraine led state-controlled Russian company Gazprom to halt its deliveries of natural gas to Ukraine, which left a number of European states, to which Ukraine transits Russian gas, with serious shortages of natural gas in January 2009.", "The plans of Georgia and Ukraine to become members of NATO have caused some tensions between Russia and those states.", "In 2010, Ukraine did abandon these plans.", "Putin allegedly declared at a NATO-Russia summit in 2008 that if Ukraine joined NATO Russia could contend to annex the Ukrainian East and Crimea.", "At the summit he told US President George W. Bush that \"Ukraine is not even a state!\"", "while the following year Putin referred to Ukraine as \"Little Russia\".", "Following the 2014 Ukrainian revolution in March 2014, the Russian Federation annexed Crimea.", "According to Putin this was done because \"Crimea has always been and remains an inseparable part of Russia\".", "After the Russian annexion of Crimea he said that Ukraine includes \"regions of Russia's historic south\" and \"was created on a whim by the Bolsheviks\".", "He went on to declare that the February 2014 ousting of Ukrainian President Viktor Yanukovych had been orchestrated by the West as an attempt to weaken Russia." ] ], "gold": "The modern bilateral relationship between Russia and Ukraine formally started during the World War I as the former Russian Empire was going through its political reform. In 1920 the bilateral relationship between two countries was changed as Ukraine was conquered by the Russian Red Army. Currently, the two countries are engaged in the Russo-Ukrainian War which started in 2014 following Russian annexation of Crimea from Ukraine. During the 2014 Crimean crisis Ukraine lost control of its government buildings, airports and military bases in Crimea to unmarked soldiers and local pro-Russian militias. This started on 27 February 2014 when unmarked armed men seized the Crimean parliamentary building. On 18 March 2014, a treaty on incorporating Crimea and Sevastopol into Russia was signed in Moscow. Throughout March and April 2014, pro-Russian unrest spread in Ukraine, with pro-Russian groups proclaiming \"People's Republics\" in the oblasts of Donetsk and Luhansk, both partially outside the control of the Ukrainian government. ", "prediction 1": "The bilateral relationship between Russia and Ukraine formally started in the 1990s immediately upon the dissolution of the Soviet Union, of which both Russia and Ukraine had been founding constituent republics. In 1920 Soviet Russian forces overran Ukraine and relations between the two states transitioned from international to internal ones within the Soviet Union, founded in 1922. On 1 March 2014 the Federation Council of the Russian parliament voted unanimously to allow the President of Russian Federation enter Russian Armed Forces on territory of Ukraine due to refusal of the latter from the Agreement of 21 February 2014.\n", "prediction 2": "A number of events led to the occupation of Ukraine by the Russian Federation, most notably the 2014 Ukrainian Revolution overthrew the pro-Russian government of Viktor Yanukovych and on March 1, 2014, Russia gained complete control over the Crimean Peninsula within a day. The Ukrainian government and representatives of the self-proclaimed Donetsk People's Republic and Luhansk People's Republic signed a tentative truce (the agreement) on September 5, 2014, but intense new fighting ensued in January 2015.", "prediction 3": "The bilateral relationship between Russia and Ukraine formally started in the 1990s immediately upon the dissolution of the Soviet Union, of which both Russia and Ukraine had been founding constituent republics. In 1920 Soviet Russian forces overran Ukraine and relations between the two states transitioned from international to internal ones within the Soviet Union, founded in 1922. The Progressive Demilitarization Act of 2014 effectively abolished the Internal Security Council of the Soviet Union. As of March 1,2016, unarmed pro-Russian forces occupying the Ukrainian territory left the country.", "prediction 4": "The bilateral relationship between Russia and Ukraine formally started in the 1990s immediately upon the dissolution of the Soviet Union, of which both Russia and Ukraine had been founding constituent republics. In 1920 Soviet Russian forces overran Ukraine and relations between the two states transitioned from international to internal ones within the Soviet Union, founded in 1922. On 1 March 2014 the Federation Council of the Russian parliament voted unanimously to allow the President of Russian Federation enter Russian Armed Forces on territory of Ukraine due to refusal of the latter from the Agreement of 21 February 2014. On 6 March 2014, the Crimean Parliament voted to enter the Russian Federation with the rights of a subject of the Russian Federation and gained complete control over the Crimean Peninsula within a day.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 385 }, { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 634 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The bilateral relationship between Russia and Ukraine formally started in the 1990s immediately upon the dissolution of the Soviet Union. In 1920 Soviet Russian forces overran Ukraine and relations between the two states transitioned from international to internal ones within the Soviet Union. In 2014, unmarked Russian troops in Ukraine were establishing a blockade of the borders and Ukrainian military bases in the Autonomous Republic of Crimea, and took armed control of its regional parliament. Throughout March and April 2014, pro-Russian unrest spread in Ukraine, with pro-Russian groups proclaiming \"People's Republics\" in the oblasts of Donetsk and Luhansk, both partially outside the control of the Ukrainian government.\n" }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who did otto go with to north korea?", "passages": [ [ "Otto Warmbier", "Non-invasive internal scans did not find any signs of fractures to his skull.", "Otto Warmbier was born on December 12, 1994, the eldest of three children of Fred and Cindy Warmbier (\"n\u00e9e\" Garber), and was raised in Cincinnati, Ohio.", "He attended Wyoming High School, where he was considered popular and studious, and graduated in 2013 as salutatorian, the second-highest ranking student in his class.", "He would go on to enroll at the University of Virginia, where he was studying for a double major degree in commerce and economics and did a foreign exchange at the London School of Economics.", "His minor was in global sustainability.", "Warmbier's father stated that his son, en route to Hong Kong to complete a study abroad program, was traveling in China at the end of 2015 when he saw a company offering trips to North Korea.", "He decided to go because he was adventurous, according to his father.", "The senior Warmbier said that the China-based tour operator, Young Pioneer Tours, appealed to young Westerners with slogans such as \"This is the trip your parents don't want you to take!\" and advertised the trip as safe for U.S. citizens.", "Warmbier traveled to North Korea for a five-day New Year's tour of the country." ], [ "Otto Warmbier", "Otto Warmbier\n\nOtto Frederick Warmbier (December 12, 1994\u00a0\u2013 June 19, 2017) was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment.", "He was traveling to Hong Kong for a study abroad program when he decided to visit North Korea on a guided tour.", "While there, he allegedly attempted to steal a propaganda poster, for which he was arrested and sentenced to 15 years' imprisonment with hard labor.", "Shortly after his sentencing, Warmbier suffered severe neurological injury from an unknown cause.", "North Korean authorities did not disclose his medical condition until June 2017, when they announced he had fallen into a coma as a result of botulism and a sleeping pill.", "He was freed in June 2017, still in a comatose state after 17 months in captivity.", "He was repatriated to the United States, arriving in Cincinnati, Ohio, on June 13.", "He was taken to University of Cincinnati Medical Center for immediate evaluation and treatment, where physicians found no evidence of botulism.", "Warmbier never regained consciousness and died on June 19, 2017, six days after his return to the United States after his parents requested his feeding tube be removed.", "A coroner's report was unable to identify the cause of the injury, finding no obvious evidence of torture." ], [ "Otto Warmbier", "Ten other U.S. citizens were in his tour group.", "The tour group celebrated New Year's Eve by carousing in Pyongyang's Kim Il-sung Square before returning to their accommodations at the Yanggakdo International Hotel, where they continued drinking alcohol.", "Early in the morning of New Year's Day, Warmbier allegedly tried to steal a propaganda poster from a staff-only area of the hotel.", "The poster stated, \"Let's arm ourselves strongly with Kim Jong-il's patriotism!\"", "Harming or stealing such items with the name or image of a North Korean leader is considered a serious crime by the North Korean government.", "On January 2, 2016, Warmbier was arrested at Pyongyang International Airport while awaiting departure from North Korea.", "Danny Gratton, a British member of Warmbier's tour group, witnessed the arrest.", "He said: \n\nWhen the group's plane was about to leave the terminal, an official came aboard and announced \"Otto is very sick and has been taken to the hospital.\"", "Some media reports indicated that Warmbier spoke by phone to a Young Pioneer tour guide following his arrest, but this was denied by a Young Pioneer spokesman who told BBC News that \"none of its employees had direct contact with Otto after he was escorted away.\"" ] ], "gold": "Otto Frederick Warmbier was an American college student who entered North Korea on December 29, 2015 as part of a guided tour group with Young Pioneer Tours, a China-based budget tour operator. He was arrested on January 2, 2016 and convicted for attempting to steal a propaganda poster from his hotel, for which he was sentenced to 15 years of imprisonment with hard labor. He was released from North Korea in June 2017, in a vegetative state and died soon after.", "prediction 1": "Otto Warmbier was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment. While there, he allegedly tried to steal a propaganda poster, for which he was arrested and sentenced to 15 years' imprisonment with hard labor. North Korean authorities did not disclose his medical condition until June 2017, when they announced he had fallen into a coma as a result of botulism and a sleeping pill. Warmbier never regaine consciousness and died on June 19, 2017, six days after his return to the United States after his return to the United States.", "prediction 2": "Otto Warmbier was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment. While there, he allegedly attempted to steal a propaganda poster, for which he was arrested and sentenced to 15 years' imprisonment with hard labor. Shortly after his sentencing, Warmbier suffered severe neurological injury from an unknown cause. North Korean authorities did not disclose his medical condition until June 2017, when they announced he had fallen into a coma result of botulism and a sleeping pill. Warmbier never regained consciousness and died on June 19, 2017, six days after his return to the United States.", "prediction 3": "Otto Warmbier was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment. While there, he allegedly attempted to steal a propaganda poster, for which he was arrested and sentenced to 15 years' imprisonment with hard labor. While there, he allegedly attempted to steal a propaganda poster, for which he was sentenced to 15 years' imprisonment with hard labor. North Korean authorities did not disclose his medical condition until June 2017, when they announced he had fallen into a coma result of botulism and a sleeping pill. Warmbier never regained consciousness and died on June 19, 2017.", "prediction 4": "Otto Warmbier, an American college student who was arrested in North Korea in January 2016, went on a five-day New Year's tour of North Korea with a tour guide from China-based Young Pioneer Tours, who appealed to young Westerners with slogans such as \"This is the trip your parents don't want you to take!\" and advertised the trip as safe for U.S. citizens. Warmbier died on June 19, 2017, six days after his return to the United States after his parents requested his feeding tube be removed.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Otto Warmbier was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment. ", "start": 169, "end": 313 }, { "error type": "Redundant", "explanation": "Otto Warmbier was an American college student who was arrested in North Korea in January 2016 for attempted theft, for which he was sentenced to 15 years' imprisonment. While there, he allegedly tried to steal a propaganda poster, for which he was arrested and sentenced to 15 years' imprisonment with hard labor. North Korean authorities did not disclose his medical condition until June 2017, when they announced he had fallen into a coma as a result of botulism and a sleeping pill. Warmbier never regaine consciousness and died on June 19, 2017, six days after his return to the United States ", "start": 597, "end": 635 }, { "error type": "Irrelevant", "explanation": "", "start": 441, "end": 485 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Otto Warmbier was an American college student, who was part of a guided tour group with Young Pioneer Tours, a China-based tour operator, who was arrested in North Korea on January 2, 2016 for allegedly trying to steal a propaganda poster from his hotel, for which he was sentenced to 15 years' imprisonment with hard labor. North Korean authorities announced he had fallen into a coma. He was freed in June 2017. Warmbier never regained consciousness and died on June 19, 2017, six days after his return to the United States." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When does the next magic the gathering set release?", "passages": [ [ "Magic: The Gathering core sets, 2009\u20132015", "Magic:", "The Gathering core sets, 2009\u20132015\n\nSeven \"\" core sets have been released since 2009:", "Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic 2015, and Magic Origins.", "Unlike \"10th Edition\" and previous core sets, roughly half of each core set was entirely new cards.", "Beginning with \"Magic 2010\", Wizards decided to introduce new cards into the Core Set so that they could be relevant for both new players as well as veterans.", "Starting with \"Magic 2011\", core sets have included \"returning mechanics\", or non-evergreen keywords with cards printed in just one core set.", "All of these core sets were released in the summer of the year prior to the year in the title - for example, \"Magic 2010\" was released in 2009.", "After \"Magic Origins\", Wizards of the Coast stopped production of core sets, opting for a new model where two blocks with two sets each are made each year, rather than one block of three sets and a core set.", "\"Magic\" head designer Mark Rosewater wrote that the Core Set's dual identity of needing to interest established players while being simple enough for new players leading to \"odd compromises\", and cited the potential and upsides of doing two blocks per year, such as visiting new settings and revisiting old ones faster." ], [ "Magic: The Gathering core sets, 2009\u20132015", "The new border will make it easier for machines to read the cards, helping to prevent mispackaging.", "Advertising for the set featured the planeswalker Garruk Wildspeaker, with a tagline of \"Hunt Bigger Game.\"", "\"Magic 2015\" includes the mechanic \"Convoke\", which originally appeared in \"\".", "This mechanic allows a player to use their creatures to help cast spells with Convoke.", "It also includes 15 cards designed by notable non-employee \"Magic\" fans, such as Richard Garriott, George Fan, and Notch, some of which also appear in \"Duels of the Planeswalkers 2015.", "Magic Origins was released on July 17, 2015.", "\"Magic Origins\" told the origin stories for 5 planeswalkers who are featured in sets after \"Origins\".", "It featured a cycle of double-faced cards (originally used in \"Innistrad\") that have a legendary creature on one side representing the character before their transformation, and a planeswalker on the reverse face that represents them after gaining their new power.", "The set introduced the mechanics of renown, spell mastery, and menace.", "It also features cards with the prowess mechanic, which was introduced in \"Khans of Tarkir\" block, and the scry mechanic, which was introduced in \"Mirrodin\" block." ], [ "Magic: The Gathering core sets, 2009\u20132015", "Slivers also received an art redesign that de-emphasized their original beak-headed, one-clawed, one-tailed insect-like appearance, and instead became monstrous humanoids whose appearance varied heavily by card, but had \"normal\" features such as faces and eyes.", "This redesign proved controversial; one reviewer noted \"slivers are one of the most iconic designs in all of \"Magic: The Gathering\".", "To essentially muddle them down into just another humanoid monster thing is really disappointing.\"", "Wizards of the Coast acknowledged the negative feedback, noting that some players disliked the new art style, and included a card in \"Magic 2015\" that used the original Sliver appearance in .", "Magic 2015 was released on July 18, 2014.", "\"Magic 2015\" made the second major change to the card frame in \"Magic's\" history (the first being in \"\").", "Changes include a slight font change (Starting with \"Magic 2015\", an in-house font known as Beleren will be used rather than the Matrix Bold font), the addition of a holofoil stamp in the bottom center of all rare and mythic rare cards, a slightly narrower black border, and a redesign of the collector's info at the bottom of each card." ] ], "gold": "Seven Magic: The Gathering core sets have been released since 2009. The latest set, Magic Origins, was released on July 17, 2015 following the set's pre-release on July 11, 2015. Magic Origins tells the origin stories of 5 planeswalkers who are featured in sets after Origins. Magic 2015 was released on July 18, 2014 following the set's pre-release on July 12, 2014. Magic 2015 made the second major change to the card frame in Magic's history. Magic 2014 was released on July 19, 2013 following the set's pre-release on July 13, 2013. The tagline for this set is \"Ignite your Spark.\"", "prediction 1": "Magic: The Gathering core sets have been released since 2009: Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic Origins, and Magic 2015, with the last one releasing on July 18, 2014.", "prediction 2": "Magic: The Gathering core sets, 2009\u20132015, have been released in seven \"\" core sets since 2009: Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic Origins, and Magic 2015. The Magic: The Gathering Core Sets series has been released in seven different years. The first core set released in 2009 was Magic 2010 while the second and final core set released in 2015 was Magic 2015, which was released on July 18, 2014.", "prediction 3": "Magic: The Gathering core sets, 2009\u20132015, released in seven different sets. Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic Origins, and Magic 2015, were all released in the summer of the year prior to the year in the title. Magic 2015 was released on July 18, 2014, and Magic Origins was released on July 17, 2015.", "prediction 4": "Magic: The Gathering core sets, 2009\u20132015, include Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic Origins, and Magic 2015, while several other core sets have been released since 2009. Magic Origins, for example, was released on July 17, 2015. Magic 2015 was released on July 18, 2014.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 153, "end": 198 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Magic: The Gathering core sets have been released since 2009: Magic 2010, Magic 2011, Magic 2012, Magic 2013, Magic 2014, Magic Origins, and Magic 2015. Magic Origins\" told the origin stories for 5 planeswalkers who are featured in sets after \"Origins\". Magic 2015 was released on July 18, 2014. \"Magic 2015\" made the second major change to the card frame in \"Magic's\" history. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who was the original singer of green green grass of home?", "passages": [ [ "Curly Putman", "Curly Putman\n\nClaude Putman Jr. (November 20, 1930 \u2013 October 30, 2016) professionally known as Curly Putman was an American songwriter.", "Born in Princeton, Alabama, his greatest success was \"Green, Green Grass of Home\" (1964, sung by Porter Wagoner), which was covered by Roger Miller, Elvis Presley, Kenny Rogers, Don Williams, Johnny Paycheck, Burl Ives, Johnny Darrell, Gram Parsons, Joan Baez, Jerry Lee Lewis, The Grateful Dead, Johnny Cash, Roberto Leal, Dean Martin, George Jones, Merle Haggard, Bobby Bare, Joe Tex, Nana Mouskouri, Charley Pride and Tom Jones.", "Putman was the son of a sawmill worker.", "He joined the Navy and spent four years on the aircraft carrier .", "He married Bernice Soon in 1956.", "Putman worked several jobs in different places in the late 1950s and early 60s, inspiring his later hit \"My Elusive Dreams\".", "He penned his first big hit, \"Green, Green Grass of Home\", when working in Nashville plugging songs for Tree Records.", "Putman died of congestive heart failure and kidney failure at his home in Lebanon, Tennessee at age 85.", "Alabama State Route 65 through the Paint Rock Valley in North Alabama is named in his honor, as well as the community park in Princeton." ], [ "Distant Drums (song)", "However, following Reeves' death, the track was overdubbed with an orchestral backing and released to the public as the version that later climbed up the music charts in both the United States and the UK.", "Perhaps because of the timing of the song's release (during the summer of 1966), Distant Drums attracted attention to the continuation of hostilities in the Vietnam War and an increased public awareness (both in the United Kingdom and the United States) of the difficult conditions faced by U.S. armed personnel fighting in that conflict.", "This is due to the lyrics implying the wishes of a soldier who wants to marry his beloved (called \"Mary\" in the song) before he answers the call of battle in some far away land; the \"Distant Drums\" which make up the song's title.", "\"Distant Drums\" first entered the UK Singles Chart during the summer of 1966, before reaching the No. 1 position on 22 September, where it remained for five weeks.", "It was named the UK's \"song of the year\" and Reeves became the first overseas performer to receive this special award.", "\"Distant Drums\" remained at No. 1 on the UK Singles Chart for a total of five weeks.", "Only Tom Jones with his recording of \"Green, Green Grass of Home\" (which stayed at No." ], [ "Porter Wagoner", "Among his hit duets with Dolly Parton were a remake of Tom Paxton's \"The Last Thing on My Mind\" (1967), \"We'll Get Ahead Someday\" (1968), \"Just Someone I Used to Know\" (1969), \"Daddy Was An Old Time Preacher Man\", (1970), \"Better Move it on Home\" (1971), \"The Right Combination\" (1972), \"Please Don't Stop Loving Me\" (No. 1, 1974) and \"Making Plans\" (No. 2, 1980).", "He also won three Grammy Awards for gospel recordings.", "His syndicated television program, \"The Porter Wagoner Show\", aired from 1960 to 1981.", "There were 686 30-minute episodes taped; the first 104 (1960\u201366) in black-and-white and the remainder (1966\u201381) in color.", "At its peak, his show was featured in over 100 markets, with an average viewership of over three million.", "Reruns of the program air on the rural cable network RFD-TV and its sister channel in the UK Rural TV.", "The shows usually featured opening performances by Wagoner with performances by Norma Jean, or later Parton, and comedic interludes by Speck Rhodes.", "During Parton's tenure, she and Wagoner usually sang a duet." ] ], "gold": "Green, Green Grass of Home was first recorded by singer Johnny Darrell in 1965. This country song was then made popular by Porter Wagoner, host of the syndicated program The Porter Wagoner Show, the same year, when Porter's recording of the song reached number 4 on the Country chart. Then, in 1966, Tom Jones recorded and released the song in the UK, where it reached number 1 that December.", "prediction 1": "The original singer of Green, Green Grass of Home was Porter Wagoner. The song was first released on July 20, 1964. It was covered by numerous artists, including Elvis Presley, Johnny Paycheck, Burl Ives, Johnny Darrell, Gram Parsons, Johnny Cash, Jerry Lee Lewis, The Grateful Dead, Johnny Cash, George Jones, Merle Haggard, Bobby Bare, Joe Tex, Charley Pride, Tom Jones, Norma Jean, Mary Ann Williams, Don Williams, Johnny Paycheck, Johnny Paycheck, Johnny Paycheck, Johnny Paycheck, Johnny Darrell, Johnny Paycheck, Johnny Paycheck, Johnny Darrell, Johnny Paycheck, Johnny Paycheck, Johnny Paycheck, Johnny Darrell, Burl Ives, Johnny Paycheck, Johnny Paycheck, Johnny Paycheck, Johnny Paycheck, Johnny Darrell, Burl Ives,", "prediction 2": "Porter Wagoner was the original singer of the song Green, Green Grass of Home. The song was originally sung by Curly Putman and Norma Jean. However, following Reeves' death, the track was overdubbed with an orchestral backing and released to the public as the version that later climbed up the music charts in both the United States and the UK. Tom Jones then sung the original version, which was released in 1964 and was sung by Curly Putman.", "prediction 3": "Porter Wagoner originally sang the song \"Green, Green Grass of Home\" in 1964. The song was covered by Elvis Presley, Roger Miller, Elvis Presley, Kenny Rogers, Johnny Paycheck, Johnny Darrell, Gram Parsons, Johnny Darrell, Johnny Paycheck, Burl Ives, Burl Ives, Johnny Darrell, Gram Parsons, Jerry Lee Lewis, The Grateful Dead, Johnny Cash, George Jones, Merle Haggard, Bobby Bare, Joe Tex, The Right Combination, \"Green, Green, Green Green, Green, Green, Grass of Home.\"", "prediction 4": "Porter Wagoner sang the original version of \"Green, Green Grass of Home\", which was first released on July 10, 1964. However, after Reeves' death, the track was overdubbed with an orchestral backing and released to the public as the version that later climbed up the music charts in both the United States and the United Kingdom. Only Tom Jones with his recording of \"Green, Green Grass of Home\" remained at No. 1.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 115 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 373, "end": 434 }, { "error type": "Redundant", "explanation": "The original singer of Green, Green Grass of Home was Porter Wagoner. The song was first released on July 20, 1964. It was covered by numerous artists, including Elvis Presley, Johnny Paycheck, Burl Ives, Johnny Darrell, Gram Parsons, Johnny Cash, Jerry Lee Lewis, The Grateful Dead, Johnny Cash, George Jones, Merle Haggard, Bobby Bare, Joe Tex, Charley Pride, Tom Jones, Norma Jean, Mary Ann Williams, Don Williams, Johnny Paycheck, ", "start": 435, "end": 724 } ], "missing-info": [], "corrected-prediction": "The original singer of Green, Green Grass of Home was Porter Wagoner. It was covered by numerous artists including Johnny Darrell and Tom Jones." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who was the singing voice of elsa in frozen?", "passages": [ [ "Frozen (soundtrack)", "Frozen (soundtrack)\n\nFrozen: Original Motion Picture Soundtrack is the soundtrack to the 2013 Disney animated film, \"Frozen\".", "The soundtrack features 10 original songs written and composed by Kristen Anderson-Lopez and Robert Lopez, and 22 score pieces composed by Christophe Beck.", "It features the critically acclaimed song \"Let It Go\"\u2014film version performed by Idina Menzel; single version performed by Demi Lovato\u2014which won the Academy Award for Best Original Song, the Grammy Award for Best Song Written for Visual Media, and the Critics' Choice Award for Best Song, and was nominated for the Golden Globe Award for Best Original Song.", "Two editions of the soundtrack were released by Walt Disney Records on November 25, 2013: a single-disc regular edition, and a two-disc digipak deluxe edition, containing original demo recordings of songs and score compositions, unused outtake recordings, and instrumental versions of the film's main songs.", "On October 21, 2013, the soundtrack's lead single, Lovato's cover of \"Let It Go\" was released.", "Subsequent releases have been accompanied by foreign language translations of \"Let It Go\".", "The album debuted at number 18 on the \"Billboard\" 200 chart.", "The soundtrack has topped the \"Billboard\" album chart for thirteen non-consecutive weeks, and has sold 4 million copies in the U.S." ], [ "Elsa (Frozen)", "All over the world, Elsa was dubbed in 46 languages.", "Dutch singer and actress Willemijn Verkaik dubbed Elsa in Dutch (both speaking and singing) and German (singing only), Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions and French singer Ana\u00efs Delva's singing lines were also used in the Canadian French version.", "Both Ana\u00efs Delva (French) and Jelena Gavrilovi\u0107 (Serbian) had originally auditioned for Anna's role, but were eventually called back to dub Elsa instead.", "Just like Idina Menzel, four of Elsa's dubbers also played the role of Elphaba in the Musical \"Wicked\", that is: Maria Lucia Rosenberg (Danish), Willemijn Verkaik (Dutch and German), Mona Mor (Hebrew) and (Korean).", "Since 2013, some local TV stations have been dubbing the movie in their local languages, creating some unofficial dubs (namely: Albanian, Arabic TV, Karachay-Balkar, Persian and Tagalog).", "Following the casting of Idina Menzel, Elsa's characterization underwent several alterations.", "According to Menzel, she was originally scripted as a one-dimensional antagonist but was gradually revised as a more vulnerable, multifaceted figure.", "Menzel further described her character as \"extremely complicated and misunderstood\"." ], [ "Elsa (Frozen)", "Elsa (Frozen)\n\nQueen Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film \"Frozen\".", "She is voiced primarily by Broadway actress and singer Idina Menzel.", "At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager.", "Created by directors Chris Buck and Jennifer Lee, Elsa is loosely based on the title character of \"The Snow Queen\", a Danish fairytale by Hans Christian Andersen.", "In the Disney film adaptation, she is introduced as the princess of the fictional Scandinavian kingdom of Arendelle, heiress to the throne and the elder sister of Princess Anna (Kristen Bell).", "Elsa has the magical ability to create and manipulate ice and snow.", "She inadvertently sends Arendelle into an eternal winter on the evening of her coronation.", "Throughout the film, she struggles first with controlling and concealing her abilities and then with liberating herself from her fears of unintentionally harming others, especially her younger sister.", "The Snow Queen character, neutral but cold-hearted in the original fairytale and villain in numerous adaptations of the character, proved difficult to adapt to film due to her transparent depiction." ] ], "gold": "Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen (2013) and its sequel Frozen II (2019). She is voiced mainly by Broadway actress and singer Idina Menzel, with Eva Bella as a young child and by Spencer Ganus as a teenager in Frozen. In Frozen II, young Elsa is voiced by Mattea Conforti (at the start of the film) and Eva Bella (archive audio). Dutch singer and actress Willemijn Verkaik dubbed Elsa in Dutch (both speaking and singing) and German (singing only), Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions and French singer Ana\u00efs Delva's singing lines were also used in the Canadian French version. In the Latin American Spanish version of Frozen, the singing voice of Elsa was by Carmen Sarah\u00ed.", "prediction 1": "Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen. She is voiced by Broadway actress and singer Idina Menzel. Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions of the soundtrack while French singer Anas Delva sang her lines in the Canadian French version.", "prediction 2": "Elsa is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen. The character is voiced primarily by Broadway actress and singer Idina Menzel. Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions, and French singer Anas Delva sang the lines used in the Canadian French version of the soundtrack.", "prediction 3": "In the 2013 Disney animated film Frozen, the Queen Elsa of Arendelle is voiced primarily by Broadway actress and singer Idina Menzel. French singer Anas Delva was the singing voice of Elsa throughout the film, although Spanish singer Gisela also sang during the Spanish and Catalan versions, and French singer Anas Delva sang during the Canadian version.", "prediction 4": "Elsa is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen. She is voiced primarily by Broadway actress and singer Idina Menzel. Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions of the soundtrack, while French singer Anas Delva sang the same lines in both the English and Canadian French versions.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen (2013). She is voiced by Broadway actress and singer Idina Menzel. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager. Dutch singer and actress Willemijn Verkaik dubbed Elsa in Dutch (both speaking and singing) and German (singing only), Spanish singer Gisela sang both for the Castilian Spanish and Catalan versions and French singer Ana\u00efs Delva's singing lines were also used in the Canadian French version. Jelena Gavrilovi\u0107 (Serbian), Maria Lucia Rosenberg (Danish), and Mona Mor (Hebrew) and (Korean) have also dubbed the character Elsa. A single version of Elsa's \"Let it Go\" is performed by Demi Lovato" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the stratosphere in las vegas open?", "passages": [ [ "Red Rock Casino, Resort & Spa", "Station Casinos hosted 3,800 special guests at the resort on the night of April 18, 2006, prior to the public unveiling at midnight.", "Former Nevada governor and U.S. senator Richard Bryan attended the opening, as did Andre Agassi and officials from rival casino companies.", "Singer Sting held a one-hour concert at the resort's pool area as part of the grand opening celebration, which also included a six-minute fireworks show.", "Built at a cost of $925 million, the Red Rock Resort was Station Casinos' most expensive property.", "Approximately 80 percent of revenue was expected to come from local residents.", "The resort had a modern design with a desert-themed influence, and it included blown glass, polished sandstone, and of multicolored onyx imported from India and Italy.", "The resort also featured numerous chandeliers in various shapes and sizes, containing three million pieces of crystal.", "Station Casinos executives Frank Fertitta III and his brother Lorenzo Fertitta chose to include the chandeliers, having been inspired by older Las Vegas resorts such as the Desert Inn and the Sands Hotel and Casino.", "The chandeliers cost over $6 million.", "The resort opened with 415 of its ultimate 850 hotel rooms; the remaining 435 rooms, part of an expansion to the hotel tower, were expected to be open by December 2006." ], [ "Jane Wells", "Jane Wells\n\nJane Wells (born March 31, 1961) is a CNBC special correspondent, based in Los Angeles, where she covers stories about funny business, strange success and special assignments.", "Wells writes offbeat stories for CNBC.com and serves as a contributor for radio stations.", "One recent story was about a 34-year-old Portland woman who got paid for cuddling people and a college student who invented a special beer shelf that made him a millionaire.", "She has worked for CNBC for more than 20 years, including earlier stints covering retail, agriculture and defense as well as news about the California economy, West Coast real estate and Las Vegas trends.", "Wells came from CNBC's \"Upfront Tonight\" where she was senior correspondent.", "Wells was a correspondent for the Fox News Channel and Los Angeles reporter for NBC's flagship television station, WNBC, New York City.", "She then joined CNBC in 1996, where she provided special coverage of the O.J. Simpson civil case for \"Rivera Live\" starring Geraldo Rivera.", "Her career includes reporter positions with KTTV, Los Angeles; WTVJ, Miami; and, KOB, Albuquerque.", "She has also taken part in several international reports for CNN.", "Wells started as a news writer for KTLA in Los Angeles." ], [ "Stratosphere Las Vegas", "Shortly after opening, the Stratosphere Corporation was forced to file bankruptcy.", "This caused construction on the second tower to stop, with only a few stories partially built, and it allowed Carl Icahn to gain control through one of his companies by buying a majority of the outstanding bonds.", "A major addition was completed in June 2001 for $1 billion that included finishing the 1000-room second hotel tower.", "In the early 2000s, the company attempted to get approval for a roller coaster that would run from several hundred feet up the tower and, in the last proposal, across Las Vegas Boulevard.", "Part of that last proposal included an entry monument on the ride over Las Vegas Boulevard welcoming people to the City of Las Vegas.", "The Las Vegas City Council did not approve the project due to objections from the neighbors over possible noise from the enclosed cars on the proposed ride.", "In January 2010, American Casino & Entertainment Properties announced a new thrill ride for the top of the tower:", "SkyJump, a controlled-descent, bungee jumping\u2013like ride that will allow riders to plummet attached to a high-speed descent wire.", "It opened on April 20, 2010.", "Radio stations KOAS 105.7 (FM) and KVGS 107.9 (FM) have on-channel FM boosters broadcasting from an antenna at the top of the tower's structure." ] ], "gold": "The Stratosphere in Las Vegas officially opened on April 30, 1996; however, more than 8,000 VIP guests visited the resort for a premiere party on the night of April 29, 1996, hours before its midnight opening. Media from around the world also attended this opening event, which was broadcast live by CNBC as well as television stations in Las Vegas and Los Angeles. The Stratosphere's SkyJump, a controlled-descent, Bungee-jumping-like ride that allows riders to plummet 855 feet attached to a high-speed descent wire, opened on April 20, 2010. Insanity, the third highest thrill ride in the world, opened at The Stratosphere in 2005. Insanity dangles riders over the edge of the tower and then spins in a circular pattern at approximately forty miles per hour. In an incident shortly after opening, riders were left dangling several hundred feet for nearly an hour and a half when Insanity shut down. ", "prediction 1": "The Stratosphere in Las Vegas opened on April 18, 2006. It is a luxury hotel and casino resort in the heart of Las Vegas, Nevada. The Stratosphere Hotel & Casino opened on April 18, 2006, and has 11 floors. The Stratosphere Las Vegas opened with 415 hotel rooms. The second hotel tower was completed in June 2001, with 435 rooms added.", "prediction 2": "The Stratosphere in Las Vegas opened on April 18, 2006, as part of Station Casinos' Red Rock Resort. This was the first of two towers at the Stratosphere casino resort. The second tower, the Stratosphere Hotel & Spa, opened on April 20, 2010. The third tower, the Stratosphere SkyRide, opened on April 20, 2010.", "prediction 3": "The Stratosphere in Las Vegas opened in mid-2006 and has since been expanded to include a 1000-room hotel tower. The hotel tower and casino was originally planned to have a roller coaster on the top of it. However, construction halted in 2008 and only the first floor was completed in 2010.", "prediction 4": "The Stratosphere in Las Vegas opened in 2006, but was forced to file bankruptcy the following year. This caused construction on the second tower to stop, with only a few stories partially built, and it allowed Carl Icahn to gain control through one of his companies by buying a majority of the outstanding bonds. American Casino & Entertainment Properties announced a new thrill ride for the top of the tower: SkyJump, a controlled-descent, bungee jumping\u2013like ride that will allow riders to plummet attached to a high-speed descent wire. SkyJump opened on April 20, 2010.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 55 }, { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 129 }, { "error type": "Redundant", "explanation": "The Stratosphere in Las Vegas opened on April 18, 2006. ", "start": 130, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 335 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "SkyJump, a controlled-descent, bungee jumping\u2013like ride that will allow riders to plummet attached to a high-speed descent wire.It opened on April 20, 2010." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Where was the winter olympics held in the united states?", "passages": [ [ "2028 Summer Olympics", "This is the third time that Los Angeles will have hosted the Summer Olympics, making it the third city after London (1908, 1948, and 2012) and Paris (1900, 1924, and 2024) to host the Games three times and the first American city to do so.", "These will be the fifth Summer Olympic Games to be hosted in the United States, the previous four occasions being St. Louis 1904, Los Angeles 1932, Los Angeles 1984, and Atlanta 1996.", "These will be the ninth Olympics to be held in the U.S. (taking both summer and winter Games into account; the four winter editions being Lake Placid 1932, Squaw Valley 1960, Lake Placid 1980, and Salt Lake City 2002).", "On September 16, 2015, the International Olympic Committee announced five candidate cities for the 2024 Games: Budapest, Hamburg, Los Angeles, Paris, and Rome.", "The candidature process was announced at the same time.", "Budapest, Hamburg, and Rome eventually withdrew their bids, leaving only Los Angeles and Paris.", "A similar situation had already occurred during the bidding for the 2022 Winter Olympics when Krakow, Lviv, Oslo and Stockholm withdrew, resulting in a two-way race between Beijing, China and Almaty, Kazakhstan, where Beijing was ultimately declared the winner." ], [ "Lake Placid (New York)", "Lake Placid (New York)\n\n", "The body of water named Lake Placid is a lake in the Adirondack Mountains in northern New York, the United States.", "It is on the northern side of the Village of Lake Placid.", "Fender guitars has named a color for their guitars after this lake with guitars available in \"Lake Placid Blue\".", "The lake is approximately , and has an average depth of about .", "It is located in the towns of North Elba and St. Armand, both in Essex County.", "There are three islands on Lake Placid, named Buck, Moose, and Hawk.", "The lake borders the northern part of the village of Lake Placid, and is a source of drinking water for the town.", "Maintaining water quality in the lake is a major local issue.", "The lake is fed by springs and Adirondacks mountain streams.", "There are nearly 300 houses on the lake shore.", "Because most of the houses are unoccupied much of the year, the water usually remains clean.", "Local efforts to combat aquatic invasive species have been successful.", "They are supported by a boat cleaning station where powerboats are put into the water.", "The lake has produced record lake trout." ], [ "Squaw Valley, Placer County, California", "Squaw Valley, Placer County, California\n\nOlympic Valley, California (also known as Squaw Valley) is an unincorporated community located in Placer County northwest of Tahoe City along California State Highway 89 on the banks of the Truckee River near Lake Tahoe.", "It is home to Squaw Valley Ski Resort, the site of the 1960 Winter Olympics.", "Olympic Valley is the smallest resort area to host the Olympic Winter Games.", "The English word Squaw is an ethnic and sexual slur, historically used for indigenous North American women.", "The town of Claraville, formerly located at the mouth of Squaw Valley was once among the biggest mining operations in the Lake Tahoe region.", "There were rumors that the mine was salted with ore brought in from Virginia City, Nevada.", "George Wharton James, author of the book \"The Lake of the Sky\" doubts the mines were salted with ore and suggests that the energetic prospector Shannon Knox started the mine with good faith.", "He writes about the History of the Tahoe Region (pre 1915) in many of the chapters of his book.", "The Squaw Valley Mining boom was short lived and by 1863\u201364 the valley had lost almost all of its inhabitants to the Comstock lode in Virginia City." ] ], "gold": "Three locations have hosted the Winter Olympics in the United States. Lake Placid, a village in the Adirondack Mountains in Essex County, New York hosted the Winter Olympics in 1932 and in 1980. Squaw Valley, a ski resort in Olympic Valley, California, located northwest of Tahoe City in the Sierra Nevada mountain range, hosted the Winter Olympics in 1960. Salt Lake City, the capital and most populous city of Utah, hosted the Winter Olympics in 2002.", "prediction 1": "The 1960 Winter Olympics were held at Olympic Valley, California. In 1932, the Winter Games were held in Lake Placid, New York. In 1980, the Winter Olympics were held in Lake Placid, Utah. The Winter Olympics were held in Salt Lake City, Utah.", "prediction 2": "There were several Winter Olympic Games held in the United States. The 1960 Winter Olympics were held at Olympic Valley, California.", "prediction 3": "In the 1960 Winter Olympics, the Winter Olympic Games were held in Lake Placid, New York. Squaw Valley, California was the site of the 1960 Winter Olympics. Salt Lake City hosted the 2002 Olympics.", "prediction 4": "The 1960 Winter Olympics were held in Squaw Valley, California, and were held at the Olympic Village. The 2012 Summer Olympics were held in Minneapolis, Minnesota, and the 2016 Winter Olympics were held in Salt Lake City. The 2016 Winter Olympics were held in Lake Placid, New York.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 183, "end": 188 }, { "error type": "Unverifiable", "explanation": "", "start": 238, "end": 243 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 1960 Winter Olympics were held at Squaw Valley, a ski resort in Olympic Valley, California, located northwest of Tahoe City. In 1932, the Winter Games were held in Lake Placid. Lake Placid is a village in the Adirondack Mountains in Essex County, New York. In 1980, the Winter Olympics were held in Lake Placid. The Winter Olympics were held in Salt Lake City, in 2002." }, "preference": [ 1, 0, 2, 2, 2, 2 ] }, { "question": "Where does the dark knight rises take place?", "passages": [ [ "The Dark Knight Rises", "Other partners include Jakks Pacific, who created novelty and large-scale figures and plush toys, and PPW Toys, who created a Batman themed Mr. Potato Head.", "Various clothing items including shoes, T-shirts, hats and wallets were also produced.", "A video game of the same name was released on the same day as the release of the film for the iOS and Android devices for promoting the movie.", "The game features an open world with primary focus on stealth and combat.", "The combat system of the game is inspired from and .", "It takes place in Gotham City, with a somewhat similar but still significantly different plot from that of the movie.", "IGN gave it a mediocre score of 5.5/10.", "The film novelization, written by author Greg Cox and published by Titan Books, was released alongside the film on July 24, 2012.", "Warner Bros. partnered with Mountain Dew to do a cross-promotion that included a special paint scheme on the number 88 Chevrolet Impala owned by Hendrick Motorsports and driven by Dale Earnhardt, Jr. in the NASCAR Sprint Cup Series.", "On June 17, 2012, the car won the 2012 Quicken Loans 400 at Michigan International Speedway." ], [ "The Dark Knight Rises", "With Wayne presumed dead as well, Wayne Manor becomes an orphanage, and his remaining estate is left to Alfred.", "Gordon finds the previously destroyed Bat Signal repaired, while Lucius Fox discovers that Wayne had fixed the previously malfunctioning auto-pilot on the Bat.", "While visiting Florence, Alfred discovers that Wayne is alive, and in a relationship with Kyle.", "Blake resigns from the police force and, in accordance with Wayne's will, inherits the Batcave.", "Matthew Modine appears as Peter Foley, Gordon's second-in-command that disdains Batman.", "Ben Mendelsohn portrays John Daggett, a rival billionaire socialite who employs Bane in his plan to take control of Wayne Enterprises, and Burn Gorman appears as Daggett's assistant and Senior Executive Vice President Philip Stryver.", "Alon Abutbul portrays Leonid Pavel, a Russian nuclear physicist who is kidnapped from Uzbekistan by Bane and forced to convert the new Wayne Enterprises reactor core into a bomb.", "Juno Temple plays Jen, Kyle's friend and accomplice, and Daniel Sunjata portrays Mark Jones, a U.S. Special Ops officer who leads a task force into Gotham to assist Gordon and the GCPD in freeing the city from Bane's rule.", "Chris Ellis appears as Father Reilly, a priest at the orphanage that Blake grew up in." ], [ "The Dark Knight Rises", "The Dark Knight Rises\n\nThe Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer.", "Featuring the DC Comics character Batman, the film is the final installment in Nolan's \"The Dark Knight Trilogy\", and the sequel to \"The Dark Knight\" (2008).", "Christian Bale reprises the lead role of Bruce Wayne/Batman, with a returning cast of allies: Michael Caine as Alfred Pennyworth, Gary Oldman as James Gordon, and Morgan Freeman as Lucius Fox.", "The film introduces Selina Kyle (Anne Hathaway) and Bane (Tom Hardy).", "Eight years after the events of \"The Dark Knight\", merciless revolutionary Bane forces an older Bruce Wayne to resume his role as Batman and save Gotham City from nuclear destruction.", "Christopher Nolan was hesitant about returning to the series for a second time, but agreed after developing a story with his brother and Goyer that he felt would conclude the series on a satisfactory note.", "Nolan drew inspiration from Bane's comic book debut in the 1993 \"\" storyline, the 1986 series \"The Dark Knight Returns\", and the 1999 storyline \"\"." ] ], "gold": "The Dark Knight Rises is a 2012 superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. Based on the DC Comics character Batman, it is the final installment in Nolan's The Dark Knight Trilogy, and the sequel to The Dark Knight (2008). The film primarily takes place in Gotham City in the U.S. state of New Jersey. The secondary scenes with Bane takes place in Uzbekistan. The part of the film where Alfred is vacationing takes place in Florence.", "prediction 1": "The Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. The film takes place in Gotham City, with a somewhat similar but still significantly different plot from that of the movie. The 2012 Batman video game, Dark Knight: Rises: A Game for Android and iOS devices, takes place in Gotham City and features an open-world with primary focus on stealth and combat system.", "prediction 2": "The 2012 American-British superhero film The Dark Knight Rises takes place in Gotham City. It's the final installment in Christopher Nolan's The Dark Knight Trilogy and the sequel to 2008's The Dark Knight.", "prediction 3": "The Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. It takes place in Gotham City, with a somewhat similar but still significantly different plot from that of the movie. The film's novelization, written by author Greg Cox and published by Titan Books, was released alongside the film on July 24, 2012.", "prediction 4": "The Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. It takes place in Gotham City, with a somewhat similar but still significantly different plot from that of the movie. The film was made in 2012 in collaboration with Warner Bros. Entertainment.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 315, "end": 501 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. Featuring the DC Comics character Batman, the film is the final installment in Nolan's \"The Dark Knight Trilogy\", and the sequel to \"The Dark Knight\" (2008). The film takes place in Gotham City." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who won the popular vote in the 2012 presidential race?", "passages": [ [ "2012 United States presidential election in Nevada", "2012 United States presidential election in Nevada\n\nThe 2012 United States presidential election in Nevada took place on November 6, 2012, as part of the 2012 General Election in which all 50 states plus The District of Columbia participated.", "Nevada voters chose six electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "Nevada has voted for the winner in every presidential election from 1912 onwards, except in 1976 when it voted for Gerald Ford over Jimmy Carter and in 2016 when it voted for Hillary Clinton over the eventual winner Donald Trump.", "Candidate Ballot Access:\n\nNevada has historically been a swing state.", "It has voted for the winner of every presidential election since 1912, except for 1976 and 2016.", "From 1992 to 2004, the margin of victory was always under five points.", "In 2008, however, the state swung over dramatically to support Obama, who carried it by 12.49%.", "In 2012, Obama held onto Nevada, though by a considerably narrower margin of 6.68%.", "This was due almost entirely to Obama carrying the state's two largest counties--Clark County, home to Las Vegas, and Washoe County, home to Reno.", "These two counties account for 85 percent of Nevada's population." ], [ "2012 United States presidential election in Virginia", "2012 United States presidential election in Virginia\n\nThe 2012 United States presidential election in Virginia took place on November 6, 2012, as part of the 2012 General Election in which all 50 states plus The District of Columbia participated.", "Virginia voters chose 13 electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "Virginia was won by President Barack Obama with 51.16% of the vote to Mitt Romney's 47.28%, a 3.88% margin of victory.", "In 2008, Obama won the state by 6.3%, becoming the first Democratic presidential candidate to win Virginia since the nationwide Democratic landslide of 1964, but it had otherwise been a reliably Republican state prior to this.", "Much of the Democratic gains can be attributed to the growth of progressive suburban Northern Virginia, particularly in Fairfax County, Prince William County, and Loudoun County, all of which voted for Obama twice.", "Obama's increased strength in this heavily populated region more than canceled out his weakness across rural Virginia.", "On the other hand, Obama suffered a historically poor showing even in traditionally Democratic counties of Southwest Virginia, similar to his weak performance in neighboring West Virginia." ], [ "2012 United States presidential election in Florida", "2012 United States presidential election in Florida\n\nThe 2012 United States presidential election in Florida took place on November 6, 2012, as part of the 2012 General Election in which all 50 states plus The District of Columbia participated.", "Florida voters chose 29 electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "Several counties in the state suffered delays in finalizing their votes.", "This was caused in part by a high turnout, as well as a large number of absentee ballots to count, though some (international) media responded that 'foul play' might be involved.", "As of November 8, the voting had still not concluded.", "However, with much of the remaining vote still coming in was from heavily Democratic areas, Mitt Romney's Florida campaign acknowledged that Romney had lost the state to Barack Obama.", "In order to certify the election in Florida, the ballots continued to be counted.", "Both Miami-Dade and Broward County completed their ballot counts on November 8, leaving Palm Beach and Duval counties as the only two that did not have a final count at the end of the day." ] ], "gold": "The 2012 United States presidential election was the 57th quadrennial presidential election, held on Tuesday, November 6, 2012. Obama defeated Romney, winning a majority of both the Electoral College and the popular vote. Obama won 332 electoral votes and 51.1% of the popular vote compared to Romney's 206 electoral votes and 47.2%. In the 2012 presidential race, Barack Obama won the popular vote in Nevada, Virginia, Florida, Kentucky, and Iowa.", "prediction 1": "The 2012 US presidential election was won by President Barack Obama in the popular vote. The 2012 popular vote was pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan. The popular vote in the 2012 US presidential race was won by President Barack Obama with 51.16% of the vote to Mitt Romney's 47.28%, a 3.88% margin of victory.", "prediction 2": "The 2012 United States presidential election in Nevada took place on November 6, 2012, as part of the 2012 General Election in which all 50 states plus The District of Columbia participated. Voters chose 6 electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "prediction 3": "The 2012 American presidential election was won by incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan. The popular vote in the 2012 American presidential race was won by Democratic President Barack Obama with 51.16% of the vote to Mitt Romney's 47.28%, a 3.88% margin of victory. In the 2012 American presidential election, voters chose 29 electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "prediction 4": "The 2012 United States presidential election took place on November 6, 2012, as part of the 2012 General Election in which all 50 states plus The District of Columbia participated. Nevada voters chose six electors to represent them in the Electoral College via a popular vote pitting incumbent Democratic President Barack Obama and his running mate, Vice President Joe Biden, against Republican challenger and former Massachusetts Governor Mitt Romney and his running mate, Congressman Paul Ryan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 335 }, { "error type": "Unverifiable", "explanation": "", "start": 336, "end": 495 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The 2012 US presidential election took place on November 6, 2012. was won by President Barack Obama in the popular vote, in the states of Florida, Virginia, and Nevada." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who was the man who escaped from alcatraz?", "passages": [ [ "June 1962 Alcatraz escape attempt", "The U.S. Marshals Service case file remains open and active, however.", "Morris and the Anglin brothers remain on its wanted list.", "Circumstantial evidence uncovered in the early-2010s seemed to suggest that the men had survived, and that contrary to the official FBI report of the escapee's raft never being recovered and no car thefts being reported, a raft was discovered on nearby Angel Island with footprints leading away, and a car had been stolen on the night of the escape by three men, who could have been Morris and the Anglins, and that officials then engaged in a cover-up.", "Relatives of the Anglin brothers presented further circumstantial evidence in the mid-2010s in support of a longstanding rumor that the Anglin brothers had fled to Brazil following the escape; a facial recognition analyst concluded that the one piece of physical evidence, a 1975 photograph of two men resembling John and Clarence Anglin, did support that conclusion.", "Of the 36\u00a0inmates who staged 14\u00a0escape attempts over the 29\u00a0years that Alcatraz served as a federal penitentiary, 23 were recaptured, six were shot and killed, two drowned, and five (three being Morris and the Anglins and the other two being Theodore Cole and Ralph Roe) are listed as \"missing and presumed drowned\"." ], [ "Alcatraz Federal Penitentiary", "Alcatraz Federal Penitentiary\n\nThe Alcatraz Federal Penitentiary or United States Penitentiary, Alcatraz Island (often just referred to as Alcatraz or The Rock) was a maximum high-security federal prison on Alcatraz Island, off the coast of San Francisco, California, which operated from August 11, 1934, until March 21, 1963.", "The main prison building was built in 1910\u20131912 during its time as a United States Army military prison; Alcatraz had been the site of a citadel since the 1860s.", "The United States Disciplinary Barracks, Pacific Branch on Alcatraz had been acquired by the United States Department of Justice on October 12, 1933, and the island became a prison of the Federal Bureau of Prisons in August 1934 after the buildings were modernized to meet the requirements of a top-notch security prison.", "Given this high security and the location of Alcatraz in the cold waters and strong currents of San Francisco Bay, the prison operators believed Alcatraz to be escape-proof and America's strongest prison.", "Alcatraz was designed to hold prisoners who continuously caused trouble at other federal prisons." ], [ "June 1962 Alcatraz escape attempt", "June 1962 Alcatraz escape attempt\n\nThe June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin.", "Behind the prisoners' cells in Cell Block B (where the escapees were interned) was an unguarded wide utility corridor.", "The prisoners chiselled away the moisture-damaged concrete from around an air vent leading to this corridor, using tools such as a metal spoon soldered with silver from a dime and an electric drill improvised from a stolen vacuum cleaner motor.", "The noise was disguised by accordions played during music hour, and the progress was concealed by false walls which, in the dark recesses of the cells, fooled the guards.", "The escape route led up through a fan vent; the prisoners removed the fan and motor, replacing them with a steel grill and leaving a shaft large enough for a prisoner to enter.", "Stealing a carborundum abrasive cord from the prison workshop, the prisoners then removed the rivets from the grill.", "In their beds, they placed papier-m\u00e2ch\u00e9 dummies made with human hair stolen from the barber shop." ] ], "gold": "The June 1962 Alcatraz escape was a prison break from Alcatraz Federal Penitentiary, a maximum-security facility located on Alcatraz Island in San Francisco Bay. Of the 36 inmates who staged 14 escape attempts over the 29 years that Alcatraz served as a federal penitentiary, twenty-three were recaptured, six were shot and killed, two drowned, and five (Frank Morris, Clarence Anglin, John Aglin, Theodore Cole, and Ralph Roe) are listed as \"missing and presumed drowned\". Frank Morris and brothers John and Clarence Anglin escaped in June 1962 and Theodore Cole and Ralph Roe escaped in June 1937.", "prediction 1": "The June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin. The escape route led up through a fan vent, and the prisoners removed the fan and motor, replacing them with a steel grill and leaving a shaft large enough for a prisoner to enter. The escape route led up through a steel grill and left a shaft large enough for a prisoner to enter. Morris and the Anglin brothers were wanted for their involvement in a cover-up.", "prediction 2": "The June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin. The escapees were held at the United States Penitentiary on Alcatraz Island, off the coast of San Francisco, California, for up to 84 days.", "prediction 3": "The June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin. On the night of the escape, the raft was discovered on nearby Angel Island with footprints leading away, and a car had been stolen on the night of the escape by three men, who could have been Morris and the Anglins, and that officials then engaged in a cover-up. Relatives of the Anglin brothers presented further circumstantial evidence in support of a longstanding rumor that the Anglin brothers had fled to Brazil following the escape.", "prediction 4": "The Alcatraz Federal Penitentiary, also known as Alcatraz or The Rock, was a maximum high-security federal prison off the coast of San Francisco, California. In the June 1962 escape attempt, inmates Frank Morris, John Anglin, and Clarence Anglin successfully escaped from Alcatraz.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 359 }, { "error type": "Redundant", "explanation": "The June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin. The escape route led up through a fan vent, and the prisoners removed the fan and motor, replacing them with a steel grill and leaving a shaft large enough for a prisoner to enter. ", "start": 360, "end": 460 }, { "error type": "Irrelevant", "explanation": "", "start": 461, "end": 540 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The June 1962 Alcatraz escape attempt was an escape attempt from Alcatraz Federal Penitentiary, a maximum high-security federal prison on Alcatraz Island, off the coast of San Francisco, successfully carried out by inmates Frank Morris, John Anglin, and Clarence Anglin. Of the 36 inmates who staged 14 escape attempts over the 29 years that Alcatraz served as a federal penitentiary, 23 were recaptured, six were shot and killed, two drowned, and five (three being Morris and the Anglins and the other two being Theodore Cole and Ralph Roe) are listed as \"missing and presumed drowned\". " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays barnaby's wife in midsomer murders?", "passages": [ [ "Midsomer Murders", "Midsomer Murders\n\nMidsomer Murders is a British television detective drama that has aired on ITV since 1997.", "The show is based on Caroline Graham's \"Chief Inspector Barnaby\" book series, as originally adapted for television by Anthony Horowitz.", "A major success in viewership since its first episode, the series has been marketed worldwide in more than 200 countries.", "Set within small English country villages, the show has an unusual identity as a crime drama peppered with both lighthearted whimsy and dark humour.", "The first 13 seasons starred John Nettles as Detective Chief Inspector (DCI) Tom Barnaby.", "The character's younger cousin, DCI John Barnaby (played by Neil Dudgeon), took over his position when Nettles retired from the show in 2011.", "Despite the change of lead character (and numerous changes among secondary players), the show has retained its popularity and has completed its 20th season.", "\"Midsomer Murders\" is a detective drama set in modern-day England.", "The stories revolve around the efforts of Detective Chief Inspector Tom Barnaby (and later his successor, John Barnaby) to solve numerous murders that take place in the picturesque but deadly villages of the fictional county of Midsomer." ], [ "Painted in Blood (Midsomer Murders)", "Painted in Blood (Midsomer Murders)\n\nPainted in Blood is the third episode of the sixth season of British television show Midsomer Murders and the thirty first episode overall.", "It stars John Nettles as Detective Chief Inspector Tom Barnaby and Daniel Casey as Detective Sergeant Gavin Troy.", "While Joyce Barnaby joins a painting society, her husband DCI Barnaby is concerned with Operation Pondlife, a local initiative designed to clamp down on bag snatching.", "When Joyce finds the body of Ruth Fairfax, an elderly lady who is part of her art class, almost as soon as she is identified DCI Barnaby is pulled off the case replaced by members of the National Intelligence Squad.", "At first Troy is dazzled by the visiting detectives who take him under their wing, but eventually he becomes disillusioned and helps Barnaby solve the case.", "There is only one murder committed in this episode.", "However, throughout the episode, there are various crimes committed including 2 attempted bank robberies in the episode's conclusion, taking place within minutes of each other.", "Ruth Fairfax (also known as Angela Browning): Stabbed in the back on the village green with a chisel whilst painting." ], [ "Fiona Dolman", "Fiona Dolman\n\nFiona Dolman (born 30th January 1970) is a Scottish actress best known for playing Miss Pamela Andrews in the ITV daytime drama series and spinoff to \"The Royal\", \"The Royal Today\", and for the role of Jackie Rosemary Lambert Bradley, PC Mike Bradley's solicitor wife in \"Heartbeat\".", "In the series, her character Jackie drove a blue Hillman Imp (129 EWR) and then a green Sunbeam Alpine (LVY666F).", "She left at the end of series 10 when she confessed to Mike that she\u2019d met someone else.", "She also featured in Channel 4's vampire serial \"Ultraviolet\".", "Dolman featured briefly in the BBC show \"Paradox\".", "She also appeared in the BBC series \"Waterloo Road\" in August 2010 as a Police sergeant.", "From April 2011 Dolman appears as Sarah Barnaby, wife of DCI John Barnaby and new head teacher at Causton Comprehensive School, in \"Midsomer Murders\".", "She has also appeared on Lily Savage's Blankety Blank." ] ], "gold": "In Midsomer Murders series 1-13, protagonist Tom Barnaby's wife is played by Jane Wymark. As Joyce Barnaby, she plays the long-suffering wife of a workaholic detective. In series 14, Tom Barnaby retires and is replaced by his cousin, John Barnaby, whose wife Sarah Barnaby is played by Fiona Dolman.", "prediction 1": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The show is based on Caroline Graham's \"Chief Inspector Barnaby\" book series, as originally adapted for television by Anthony Horowitz. From April 2011 Dolman appears as Sarah Barnaby, wife of DCI John Barnaby and new head teacher at Causton Comprehensive School, in Midsomer Murders.\n", "prediction 2": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. It's based on Caroline Graham's \"Chief Inspector Barnaby\" book series and is marketed worldwide in more than 200 countries. In the show's third season, Midsomer Murders new star Fiona Dolman plays Sarah Barnaby, the wife of Detective Chief Inspector John Barnaby.", "prediction 3": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. From April 2011 - September 2015, Fiona Dolman plays Sarah Barnaby, wife of DCI John Barnaby and new head teacher at Causton Comprehensive School in Midsomer Murders.", "prediction 4": "Midsomer Murders is a British television detective drama that has aired on ITV since 1997. The character of Sarah Barnaby played by Fiona Dolman first appeared as a child in episode 6 of the sixth season. Fiona Dolman played the role from April 2011 to June 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 376 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 242 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The first 13 seasons had Tom Barnaby. Tom Barnaby's wife is Joyce Barnaby. DCI John Barnaby took over Tom's position after he retired. Fiona Dolman plays Sarah Barnaby, wife of John Barnaby." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does chromosome replication occur in eukaryotic cell?", "passages": [ [ "Eukaryotic DNA replication", "In G phase of the cell cycle, many of the DNA replication regulatory processes are initiated.", "In eukaryotes, the vast majority of DNA synthesis occurs during S phase of the cell cycle, and the entire genome must be unwound and duplicated to form two daughter copies.", "During G, any damaged DNA or replication errors are corrected.", "Finally, one copy of the genomes is segregated to each daughter cell at mitosis or M phase.", "These daughter copies each contain one strand from the parental duplex DNA and one nascent antiparallel strand.", "This mechanism is conserved from prokaryotes to eukaryotes and is known as semiconservative DNA replication.", "The process of semiconservative replication for the site of DNA replication is a fork-like DNA structure, the replication fork, where the DNA helix is open, or unwound, exposing unpaired DNA nucleotides for recognition and base pairing for the incorporation\nof free nucleotides into double-stranded DNA.", "Initiation of eukaryotic DNA replication is the first stage of DNA synthesis where the DNA double helix is unwound and an initial priming event by DNA polymerase \u03b1 occurs on the leading strand.", "The priming event on the lagging strand establishes a replication fork." ] ], "gold": "In a eukaryotic cell, chromosome replication begins on the G1 phase. In eukaryotes, the vast majority of DNA synthesis occurs during S phase of the cell cycle, and the entire genome must be unwound and duplicated to form two daughter copies. Any damaged DNA or replication errors are corrected in the G2 phase. One copy of the genome is segregated to each daughter cell at mitosis or M phase.", "prediction 1": "In eukaryotic cell, the vast majority of DNA synthesis occurs during S phase of the cell cycle, and the entire genome must be unwound and duplicated to form two daughter copies. During G, any damaged DNA or replication errors are corrected. Finally, one copy of the genomes is segregated to each daughter cell at mitosis or M phase.", "prediction 2": "Initiation of eukaryotic DNA replication is the first stage of DNA synthesis where the DNA double helix is unwound and an initial priming event by DNA polymerase occurs on the leading strand. Then, the entire genome must be unwound and duplicated to form two daughter copies. During G, any damaged DNA or replication errors are corrected. Finally, one copy of the genomes is segregated to each daughter cell at mitosis or M phase.", "prediction 3": "In eukaryotic cell, the vast majority of DNA synthesis occurs during S phase of the cell cycle, and the entire genome must be unwound and duplicated to form two daughter copies. During G, any damaged DNA or replication errors are corrected. Finally, one copy of the genomes is segregated to each daughter cell at mitosis or M phase. Initiation of eukaryotic DNA replication is the first stage of DNA synthesis where the DNA double helix is unwound, exposing unpaired DNA nucleotides for recognition and base pairing for the incorporation of free nucleotides into double-stranded DNA.", "prediction 4": "Initiation of eukaryotic DNA replication is the first stage of DNA synthesis where the DNA double helix is unwound and an initial priming event by DNA polymerase occurs on the leading strand. Then the entire genome must be unwound and duplicated to form two daughter copies.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "In eukaryotic cell, the vast majority of DNA synthesis occurs during S phase of the cell cycle, and the entire genome must be unwound and duplicated to form two daughter copies. During G, any damaged DNA or replication errors are corrected. Finally, one copy of the genomes is segregated to each daughter cell at mitosis or M phase." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where does the perks of being a wallflower take place?", "passages": [ [ "Mr. Mudd", "Mr. Mudd\n\nMr. Mudd is a film production company founded in 1998 by Lianne Halfon, John Malkovich, and Russell Smith.", "The production company is also well known for producing the films \"Ghost World\", \"Juno\" and \"The Perks of Being a Wallflower\", all three of which received critical acclaim.", "The company is named for a Thai man (and convicted murderer) named Mr. Mudd who acted as Malkovich's driver while he was making \"The Killing Fields\" in 1983.", "Malkovich met Russell Smith in high school, where Smith was a star basketball player for the Lanphier High School Lions in Springfield, Illinois.", "The two later became freshman roommates at Eastern Illinois University.", "Malkovich later co-founded the Steppenwolf Theater Company, and invited Smith to become a writer for the troupe.", "Smith later produced a number of Steppenwolf plays, then moved into film production.", "Malkovich and Smith formed the Smith-Malkovich film production company in 1994.", "Malkovich met Lianne Halfon in the late 1980s while she was an executive at A&M Films.", "Malkovich and Halfon were both bidding for the film rights to author Don DeLillo's 1988 novel about Lee Harvey Oswald, \"Libra\".", "A&M films won the auction, and Halfon asked Malkovich to help develop the property." ], [ "The Perks of Being a Wallflower", "The Perks of Being a Wallflower\n\nThe Perks of Being a Wallflower is a coming-of-age epistolary novel by American writer Stephen Chbosky, which was first published on February 1, 1999, by Pocket Books.", "Set in the early 1990s, the novel follows Charlie, an introverted teenager, through his freshman year of high school in a Pittsburgh suburb.", "The novel details Charlie\u2019s unconventional style of thinking as he navigates between the worlds of adolescence and adulthood, and attempts to deal with poignant questions spurred by his interactions with both his friends and family.", "Chbosky took five years to develop and publish \"The Perks of Being a Wallflower\" , creating the characters and other aspects of the story from his own memories.", "The novel addresses themes permeating adolescence, including introversion, sexuality, drug use, and mental health, while also making several references to other literary works, films, and pop culture in general.", "Because of the mentioned themes, it was banned in some American schools for its content.", "In 2012, Chbosky himself adapted and directed a film version starring Logan Lerman, Emma Watson and Ezra Miller.", "The film boosted the novel's sales, and the book reached \"The New York Times\" Best Seller list." ], [ "The Perks of Being a Wallflower (film)", "The Perks of Being a Wallflower (film)\n\nThe Perks of Being a Wallflower is a 2012 American coming-of-age drama film written and directed by Stephen Chbosky, based on Chbosky\u2019s 1999 novel of the same name.", "Logan Lerman stars as a teenager named Charlie who writes to an unnamed friend, and these epistles chronicle his trials, tribulations, and triumphs as he goes through his first year of high school.", "The film depicts his depression and anxiety as he goes through his journey in high school making new friends.", "The film's ensemble cast also features Emma Watson, Ezra Miller, Mae Whitman, Kate Walsh, Dylan McDermott, Nina Dobrev, Johnny Simmons, Erin Wilhelmi, Melanie Lynskey, Paul Rudd and Joan Cusack.", "John Hughes originally read the novel and attempted to write a screenplay after he got the rights from Chbosky; however, he never finished writing the screenplay.", "Mr. Mudd Productions wanted Chbosky to adapt his own novel; after he finished writing the screenplay, production was approved.", "Filming began in Pittsburgh, Pennsylvania on May 2011 and lasted approximately fifty days." ] ], "gold": "The Perks of Being a Wallflower is a young adult coming-of-age epistolary novel by American writer Stephen Chbosky, which was first published on February 1, 1999. Set in the early 1990s, the novel follows Charlie, an introverted observing teenager, through his freshman year of high school in a Pittsburgh suburb. The novel details Charlie's unconventional style of thinking as he navigates between the worlds of adolescence and adulthood, and attempts to deal with poignant questions spurred by his interactions with both his friends and family. Stephen Chbosky wrote and directed a film based on the novel in 2012, in which the story was set and filmed in Pittsburgh, Pennsylvania.", "prediction 1": "The Perks of Being a Wallflower is a coming-of-age epistolary novel by American writer Stephen Chbosky, set in the early 1990s, which follows Charlie, an introverted teenager, through his freshman year of high school in Pittsburgh, Pennsylvania. The film adaptation of the novel took place in San Francisco and Los Angeles in 2011. It took place in New York City in 2014, in San Francisco in 2015, and in New York City in 2016. The Perks of Being a Wallflower is an American coming-of-of-age drama film written and directed by Stephen Chbosky. It is set in San Francisco in the early 1990s, Pennsylvania.", "prediction 2": "The Perks of Being a Wallflower is a coming-of-age epistolary novel by American writer Stephen Chbosky that was first published on February 1, 1999 by Pocket Books. Set in the early 1990s, the novel follows Charlie, an introverted teenager, through his freshman year of high school in a Pittsburgh suburb. The Perks of Being a Wallflower is a 2012 American coming-of-age drama film written and directed by Stephen Chbosky, based on Chbosky's 1999 novel of Being a Wallflower.", "prediction 3": "The Perks of Being a Wallflower is a coming-of-age epistolary novel by American writer Stephen Chbosky, which was first published on February 1, 1999, by Pocket Books. Set in the early 1990s, the novel follows Charlie, an introverted teenager, through his freshman year of high school in a Pittsburgh suburb. The 2012 American coming-of-age drama film based on Chbosky\u2019s 1999 novel stars Logan Lerman as Charlie who writes to an unnamed friend, and chronicles chronicle his trials, tribulations, and triumphs as he goes through his freshman year of high school making new friends.", "prediction 4": "The Perks of Being a Wallflower is a coming-of-age epistolary novel written by American writer Stephen Chbosky, which was first published on February 1, 1999 by Pocket Books. The novel follows Charlie, an introverted teenager, through his freshman year of high school in a Pittsburgh suburb. In 2012, American filmmaker Stephen Chbosky himself adapted and directed a remake of the novel, starring Logan Lerman, Emma Watson, and Ezra Miller.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 246, "end": 331 }, { "error type": "Unverifiable", "explanation": "", "start": 332, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 543 }, { "error type": "Unverifiable", "explanation": "", "start": 544, "end": 604 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Perks of Being a Wallflower is a coming-of-age epistolary novel by American writer Stephen Chbosky, set in the early 1990s, which follows Charlie, an introverted teenager, through his freshman year of high school in Pittsburgh, Pennsylvania. The novel details Charlie\u2019s unconventional style of thinking as he navigates between the worlds of adolescence and adulthood, and attempts to deal with poignant questions spurred by his interactions with both his friends and family. Stephen Chbosky wrote and directed a film based on the novel in 2012, in which the story was set and filmed in Pittsburgh, Pennsylvania. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where is jamaica located in the caribbean sea?", "passages": [ [ "Jamaica", "Jamaica\n\nJamaica () is an island country situated in the Caribbean Sea.", "Spanning in area, it is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean.", "Jamaica lies about south of Cuba, and west of Hispaniola (the island containing the countries of Haiti and the Dominican Republic).", "Previously inhabited by the indigenous Arawak and Ta\u00edno peoples, the island came under Spanish rule following the arrival of Christopher Columbus in 1494.", "Many of the indigenous people died of disease, and the Spanish transplanted African slaves to Jamaica as labourers.", "The island remained a possession of Spain until 1655, when England (later Great Britain) conquered it and renamed it Jamaica.", "Under British colonial rule Jamaica became a leading sugar exporter, with its plantation economy highly dependent on African slaves.", "The British fully emancipated all slaves in 1838, and many freedmen chose to have subsistence farms rather than to work on plantations.", "Beginning in the 1840s, the British utilized Chinese and Indian indentured labour to work on plantations.", "The island achieved independence from the United Kingdom on 6 August 1962.", "With /1e6 round 1 million people, Jamaica is the third-most populous Anglophone country in the Americas (after the United States and Canada), and the fourth-most populous country in the Caribbean." ] ], "gold": "Jamaica is located in the Greater Antilles, 145 kilometres south of Cuba, and 191 kilometres west of Hispaniola.", "prediction 1": "Jamaica is an island country situated in the Caribbean Sea. Spanning in area, it is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean. Jamaica lies about south of Cuba, and west of Hispaniola, the island containing the countries of Haiti and the Dominican Republic.", "prediction 2": "Jamaica is an island country situated in the Caribbean Sea. It is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean. Jamaica is situated about south of Cuba, and west of Hispaniola (the island containing the countries of Haiti and the Dominican Republic).", "prediction 3": "Jamaica is an island country situated in the Caribbean Sea. Spanning in area, it is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean. Jamaica lies about south of Cuba, and west of Hispaniola (the island containing the countries of Haiti and the Dominican Republic).", "prediction 4": "Jamaica is an island country situated in the Caribbean Sea. Spanning in area, it is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean. It lies about south of Cuba, and west of Hispaniola, the island containing the countries of Haiti and the Dominican Republic.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 319 }, { "error type": "Incoherent", "explanation": "", "start": 60, "end": 77 } ], "missing-info": [], "corrected-prediction": "Jamaica is an island country situated in the Caribbean Sea. It is the third-largest island of the Greater Antilles and the fourth-largest island country in the Caribbean. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where does the cumberland river begin and end?", "passages": [ [ "Cumberland River", "Cumberland River\n\nThe Cumberland River is a major waterway of the Southern United States.", "The river drains almost of southern Kentucky and north-central Tennessee.", "The river flows generally west from a source in the Appalachian Mountains to its confluence with the Ohio River near Paducah, Kentucky, and the mouth of the Tennessee River.", "Major tributaries include the Obey, Caney Fork, Stones, and Red rivers.", "Although the Cumberland River basin is predominantly rural, there are also some large cities on the river, including Nashville and Clarksville, both in Tennessee.", "In addition, the river system has been extensively developed for flood control, with major dams impounding both the main stem and many of its important tributaries.", "Its headwaters are three separate forks that begin in Kentucky and converge in Baxter, KY, located in Harlan County.", "Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter.", "Clover Fork starts on Black Mountain in Holmes Mill, near the Virginia border, and flows west in parallel with Kentucky Route 38 until it reaches Harlan.", "Clover Fork once flowed through downtown Harlan and merged with Martins Fork at the intersection of Kentucky Route 38 and US Route 421 until a flood control project began in 1992 diverted it through a tunnel under Little Black Mountain from which it emerges in Baxter and converges with Martins Fork." ] ], "gold": "The cumberland river's headwater begins as three separate forks that begin in Kentucky. Martin's Fork, Clover Fork, and Poor Fork, are the three forks that all merge in Baxter, KY. It ends at the Ohio River near Paducah, Kentucky, and the mouth of the Tennessee River.", "prediction 1": "The Cumberland River is a major waterway of the Southern United States. The river drains almost of southern Kentucky and north-central Tennessee. It flows generally west from a source in the Appalachian Mountains to its confluence with the Ohio River near Paducah, Kentucky, and the mouth of the Tennessee River. Its headwaters are three separate forks that begin in Kentucky and converge in Baxter, KY, located in Harlan County. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter, while Clover Fork starts on Black Mountain in Holmes Mill, near the Virginia border, and flows west in parallel with Kentucky Route 38 until it reaches Harlan.", "prediction 2": "The Cumberland River is a major waterway of the Southern United States. The river drains almost of southern Kentucky and north-central Tennessee. The river flows generally west from a source in the Appalachian Mountains to its confluence with the Ohio River near Paducah, Kentucky, and the mouth of the Tennessee River. Its headwaters are three separate forks that begin in Kentucky and converge in Baxter, KY, located in Harlan County. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter, KY, located in Harlan County. Clover Fork starts on Black Mountain in Holmes Mill, near the Virginia border, and flows west in parallel with Kentucky Route 38 until it converges with Martins Fork at the intersection of US Route 421 until it emerges in Baxter and converges with Martin", "prediction 3": "The Cumberland River is a major waterway of the Southern United States, originating from the Appalachian Mountains. Its headwaters are three separate forks that begin in Kentucky and converge in Baxter, KY, located in Harlan County. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Clover Fork starts on Black Mountain in Holmes Mill, near the Virginia border, and flows west in parallel with Kentucky Route 38 until it reaches Harlan. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Martin's Fork starts near Hensley Settlement on Brush Mountain in", "prediction 4": "The Cumberland River is a major waterway of the Southern United States. The river drains almost of southern Kentucky and north-central Tennessee. Its headwaters are three separate forks that begin in Kentucky and converge in Baxter, KY, located in Harlan County. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Clover Fork starts on Black Mountain in Holmes Mill, near the Virginia border, and flows west in parallel with Kentucky Route 38 until it reaches Harlan. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Martin's Fork starts near Hensley Settlement on Brush Mountain in Bell County and snakes its way north through the mountains to Baxter. Martins Fork starts near Hensley Settlement on", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 565 }, { "error type": "Irrelevant", "explanation": "", "start": 584, "end": 725 } ], "missing-info": [], "corrected-prediction": "The river drains almost of southern Kentucky and north-central Tennessee. It flows generally west from a source in the Appalachian Mountains to its confluence with the Ohio River near Paducah, Kentucky, and the mouth of the Tennessee River. Its headwaters are three separate forks, Martin's Fork and Clover Fork, that begin in Kentucky and converge in Baxter, KY, located in Harlan County. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who did john stape kill in coronation st?", "passages": [ [ "John Stape", "John Stape\n\nJohn Stape is a fictional character from the British ITV soap opera, \"Coronation Street\", played by actor Graeme Hawley.", "He made his first on-screen appearance during the episode airing on 6 May 2007.", "The character departed on 3 June 2011 after four years on the show.", "Hawley made a short return to \"Coronation Street\" from 21 October 2011 until 28 October 2011 when he was killed off.", "The character has been at the centre of some major storylines such as the kidnap of local teenager Rosie Webster (Helen Flanagan), covering up Colin Fishwick's (David Crellin) death from a heart attack, the manslaughter of Joy Fishwick (Doreen Mantle) and the murder of Charlotte Hoyle (Becky Hindley).", "The character was married to Fiz Brown (Jennie McAlpine) with whom he has a daughter called Hope.", "John died in October 2011 after crashing his car into the back of a lorry, during a car chase with Kevin Webster (Michael Le Vell).", "The actor Graeme Hawley also appeared in 1998 as a policeman who questioned Steve McDonald about Jim McDonald's fall off the scaffolding.", "John is organising a school play rehearsal, when he encounters his former girlfriend, Fiz Brown (Jennie McAlpine).", "John and Fiz begin dating." ] ], "gold": "Joy Fishwick is who John Stape killed by manslaughter in Coronation St. and Charlotte Hoyle is his murder victim.", "prediction 1": "John Stape is a fictional character from the British ITV soap opera, Coronation Street, played by actor Graeme Hawley. He made his first on-screen appearance during the episode airing on 6 May 2007. John killed four people in Coronation Street. John killed Joy Fishwick in Coronation Street and Charlotte Hoyle in Coronation Street.", "prediction 2": "John Stape is a fictional character from the British ITV soap opera, Coronation Street, played by actor Graeme Hawley. He made his first on-screen appearance during the episode airing on 6 May 2007. Hawley made a short return to Coronation Street from 21 October 2011 until 28 October 2011 when he was killed off.", "prediction 3": "John Stape is a fictional character from the British ITV soap opera, Coronation Street, played by actor Graeme Hawley. He made his first on-screen appearance during the episode airing on 6 May 2007. Hawley made a short return to Coronation Street from 21 October 2011 until 28 October 2011 when he was killed off. John died in October 2011 after crashing his car into the back of a lorry, during a car chase with Kevin Webster (Michael Le Vell).", "prediction 4": "John Stape is a fictional character from the British ITV soap opera \"Coronation Street\". He was killed off in October 2011 after crashing his car into the back of a lorry, during a car chase with Kevin Webster.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 198 }, { "error type": "Unverifiable", "explanation": "", "start": 199, "end": 244 } ], "missing-info": [], "corrected-prediction": "John Stape is a fictional character from the British ITV soap opera, Coronation Street, played by actor Graeme Hawley. He made his first on-screen appearance during the episode airing on 6 May 2007. John killed Joy Fishwick in Coronation Street and Charlotte Hoyle in Coronation Street." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who played prudence on nanny and the professor?", "passages": [ [ "Nanny and the Professor", "Nanny and the Professor\n\nNanny and the Professor is an American sitcom created by AJ Carothers and Thomas L. Miller for 20th Century-Fox Television.", "During pre-production, the proposed title was \"Nanny Will Do\".", "Playing upon the popularity of \"Mary Poppins\" and other magical nannies of literature, this TV series posited another ostensibly magical British nanny taking care of a family in need of guidance.", "Unlike the candid \"magicality\" of its forebears, this Nanny's paranormal nature was less overt and only implied.", "The Nanny's young wards, as well as the audience, were left intentionally uncertain of the nature of Nanny's \"powers\", if any.", "The series starred Juliet Mills as Nanny Phoebe Figalilly, Richard Long as Professor Harold Everett, and in season 3 Elsa Lanchester in the recurring role of Aunt Henrietta.", "Figalilly was housekeeper for Professor Everett as well as nanny to his three children: Hal, the intellectual tinkerer, played by David Doremus; Butch, the middle child, played by Trent Lehman; and Prudence, the youngest, played by Kim Richards.", "Nanny was apparently psychic, and had regular flashes of what was often more than intuition (accented by a musical tinkling sound effect); she frequently knew who was at the door before the doorbell even rang." ], [ "Nanny and the Professor (film)", "Nanny and the Professor (film)\n\nNanny and the Professor is a 1972 American animated comedy TV Movie based on the sitcom by the same name.", "The series' original cast returned reprised their roles from the live action series.", "Unlike in the television series, Nanny openly performs magic, while in the TV series it was only implied." ] ], "gold": "Nanny and the Professor is an early 1970's American sitcom about a magical British nanny taking care of a family in need of guidance. In 1972, a TV movie was made based on the sitcom using the same name and original cast. Kim Richards played Prudence, the youngest child, in both versions.", "prediction 1": "On the 1972 American animated comedy TV Movie Nanny and the Professor, Prudence, the youngest of the three children, is played by Kim Richards.", "prediction 2": "On Nanny and the Professor, Prudence is played by Kim Richards. In the 1972 American animated comedy TV Movie based on the sitcom by the same name, Kim Richards played Prudence.", "prediction 3": "Nanny and the Professor is an American sitcom created by AJ Carothers and Thomas L. Miller for 20th Century Fox Television. During pre-production, the proposed title was \"Nanny Will Do\". Playing upon the popularity of \"Mary Poppins\" and other magical nannies of literature, this TV series posited another ostensibly magical British nanny taking care of a family in need of guidance.", "prediction 4": "Prudence is a character on Nanny and the Professor, an American sitcom created by AJ Carothers and Thomas L. Miller for 20th Century-Fox Television. Kim Richards played Prudence on the show. Prudence on Nanny and the Professor is also a character in the 1972 American animated comedy TV Movie based on the sitcom by the same name.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Nanny and the Professor is an early 1970's American sitcom about a magical British nanny taking care of a family in need of guidance. In 1972, a TV movie was made based on the sitcom using the same name and original cast. Prudence, the youngest of the three children, is played by Kim Richards." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who recorded i can't make you love me?", "passages": [ [ "I Can't Make You Love Me", "I Can't Make You Love Me\n\n\"I Can't Make You Love Me\" is a song written by Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album \"Luck of the Draw\" (1991).", "Released as the album's third single in 1991, \"I Can't Make You Love Me\" became one of Raitt's most successful singles, reaching the top-twenty on the \"Billboard\" Hot 100 chart and the top-ten on the Adult Contemporary.", "In August 2000, \"Mojo\" magazine voted \"I Can't Make You Love Me\" the eighth best track on its The 100 Greatest Songs of All Time list.", "The song is ranked at number 339 on the \"Rolling Stone\" magazine's list of The 500 Greatest Songs of All Time.", "On 27 November 2016, the Grammy Hall of Fame announced its induction, along with that of another 24 songs.", "\"I Can't Make You Love Me\" was written by Nashville writers Mike Reid and Allen Shamblin, who were well-noted for their successes in the country music arena.", "The song was rewritten many times before being finalized, months later.", "\"We wrote, most every week, in Mike's basement,\" Shamblin told Peter Cooper in an interview with the Nashville Tennessean." ], [ "I Can't Make You Love Me", "In New Zealand, the song was Raitt's highest charting-single, reaching number 22, while in Netherlands, the song charted moderately at number 43.", "Although Bruce Hornsby had no hand in writing the song, his piano part on it became associated with him.", "Phil Collins described it as instantly recognizable as Hornsby's work.", "Hornsby's own publicity material mentions his role on the \"classic\".", "On his own subsequent tours, Hornsby included the song in a number of his set lists.", "He sometimes let a female backing singer in his band take on the vocal.", "Other times, he sang the song himself.", "English singer George Michael covered \"I Can't Make You Love Me\" and released as a B-side of his single, \"Older\", which was released on 20 January 1997 as the fourth single from the album of the same name.", "Michael's version was also included on his compilation, \"\" (1998).", "\"Older\" and \"I Can't Make You Love Me\" both reached number 3 on the UK Singles Chart.", "After the release of his second studio album, \"Listen Without Prejudice Vol. 1\" (1990), George Michael started a legal battle with his label, Sony Music, declaring his contract was financially inequitable and creatively stifling." ], [ "I Can't Make You Love Me", "Their version was released as the album's first single on October 27, 2009.", "Having a more R&B approach, \"I Can't Make You Love Me\" received generally favorable reviews from music critics, while it has achieved minor success on the \"Billboard's\" Hot R&B/Hip-Hop Songs chart.", "After releasing their second cover album in 2007, \"\", which was well received by critics, but failed to produce a successful single, the band announced plans for a new cover album, that features cover versions of songs by \"artists I don't think people would expect us to cover,\" according to member Shawn Stockman.", "On October 23, 2009, \"I Can't Make You Love Me\" was announced as \"Love\"'s lead-single.", "The song was later released on October 27, 2009 through iTunes store.", "For the band members, \"We wanted to stay true to our roots, and it's a very beautiful song.", "And with our sound, we gave it an R&B twist.", "It's always been a favorite of ours, and we hope people will fall in love with it again.\"", "A writer for \"Soul Bounce\" wrote that \"The biggest surprise on this album is the bluesy interpretation of Bonnie Rait's country hit, 'I Can't Make You Love Me.'" ] ], "gold": "\"I Can't Make You Love Me\" is a song written by Mike Reid and Allen Shamblin that was first recorded by American singer Bonnie Raitt with Bruce Hornsby on the piano in 1991. Additional versions of \"I Can't Make You Love Me\" have been recorded by George Michael in 1997, Boyz II Men in 2009, Adele in 2011 and Priyanka Chopra in 2014.", "prediction 1": "I Can't Make You Love Me was a song written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album Luck of the Draw in 1991. English singer George Michael covered I Can't Make You Love Me and released as a B-side of his single, Older, which was released on 20 January 1997 as the fourth single from the album of the same name. Having a more R&B approach, \"I Can't Make You Love Me\" received generally favorable reviews from music critics, while it has achieved minor success on the Billboard's Hot R&B's Hot R&B/Hip-Hop Songs chart.", "prediction 2": "Bonnie Raitt recorded I Can't Make You Love Me in 1991, when she released her eleventh studio album Luck of the Draw. George Michael also released a cover of I Can't Make You Love Me, which was released as a B-side of his single Older which was released on January 22, 1997 as the fourth single from the album of the same name. The song was covered by The Band Perry, who released their version as the album's first single on October 27, 2009.", "prediction 3": "Bonnie Raitt recorded I Can't Make You Love Me in 1991, writing the lyrics and using their voices. The song was originally written by Mike Reid and Allen Shamblin, and was released as the album's third single in 1991. English singer George Michael later covered I Can't Make You Love Me and released it as a B-side of his single Older on January 20, 1997. A new cover album titled Love, released in 2009, featuring covers of songs by artists they didn't think people would expect them to cover, was released in 2009.", "prediction 4": "Bonnie Raitt recorded I Can't Make You Love Me in 1991. The song was written by Nashville writers Mike Reid and Allen Shamblin and released as the album's third single in 1991. English singer George Michael covered the song and released it as a B-side of his single Older, which was released on 20 January 1997. The band Soul Bounce also released a version of I Can't Make You Love Me as their first single on October 27, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 602 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 304 } ], "missing-info": [], "corrected-prediction": "I Can't Make You Love Me was a song written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album Luck of the Draw in 1991. English singer George Michael covered I Can't Make You Love Me, which was released on 20 January 1997. " }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "What is the name of the largest lake in canada?", "passages": [ [ "Great Bear Lake", "Great Bear Lake\n\nThe Great Bear Lake (; Slavey: \"Saht\u00fa\"; ) is the largest lake entirely in Canada (Lake Superior and Lake Huron straddling the Canada\u2013US border are larger), the fourth-largest in North America, and the eighth-largest in the world.", "The lake is in the Northwest Territories, on the Arctic Circle between 65 and 67 degrees of northern latitude and between 118 and 123 degrees western longitude, above sea level.", "The name originated from the D\u00ebnes\u0173\u0142in\u00e9 word \"satudene\", meaning \"grizzly bear water people.\"", "The Sahtu Dene people are named after the lake.", "Grizzly Bear Mountain on the shore of the lake also comes from Denesuline, meaning, \"bear large hill.\"", "The Sahoyue (Grizzly Bear Mountain) peninsula on the south side of the lake and the Edacho (Scented Grass Hills) peninsula on the west side form the Saoy\u00fa-\u0294ehdacho National Historic Site of Canada.", "The lake has a surface area of and a volume of .", "Its maximum depth is and average depth .", "The shoreline is and the catchment area of the lake is .", "Great Bear Lake is covered with ice from late November to July." ], [ "Great Lakes", "Great Lakes\n\nThe Great Lakes (), also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border, which connect to the Atlantic Ocean through the Saint Lawrence River.", "They consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron.", "The lakes are interconnected by the Great Lakes Waterway.", "The Great Lakes are the largest group of freshwater lakes on Earth by total area, and second largest by total volume, containing 21% of the world's surface fresh water by volume.", "The total surface is , and the total volume (measured at the low water datum) is , slightly less than the volume of Lake Baikal (, 22\u201323% of the world's surface fresh water).", "Due to their sea-like characteristics (rolling waves, sustained winds, strong currents, great depths, and distant horizons) the five Great Lakes have also long been referred to as \"inland seas\".", "Not counting Lake Michigan-Huron, Lake Superior is the second largest lake in the world by area, and the largest freshwater lake by area.", "Lake Michigan is the largest lake that is entirely within one country." ] ], "gold": "Great Bear Lake, which is located in the boreal forest of Canada, is the largest lake entirely in Canada, the fourth-largest in North America, and the eighth-largest in the world. Lake Superior and Lake Huron are larger but straddle the Canada\u2013US border. Lake Superior is the largest and northernmost of the Great Lakes of North America, and among freshwater lakes, it is the world's largest by surface area and the third-largest by volume.", "prediction 1": "The Great Bear Lake, also called the Laurentian Great Lakes and the Great Lakes of North America, are a series of interconnected freshwater lakes located primarily in the upper mid-east region of North America, on the Canada\u2013United States border, which connect to the Atlantic Ocean through the Saint Lawrence River. They consist of Lakes Superior, Michigan, Huron, Erie, and Ontario, although hydrologically, there are four lakes, Superior, Erie, Ontario, and Michigan-Huron.", "prediction 2": "The Great Bear Lake is the largest lake entirely in Canada (Lake Superior and Lake Huron straddling the Canada\u2013US border are larger), the fourth-largest in North America, and the eighth-largest in the world. It is located in the Northwest Territories, on the Arctic Circle between 65 and 67 degrees of northern latitude and between 118 and 123 degrees western longitude, above sea level. The Sahtu Dene people are named after the lake.", "prediction 3": "The Great Bear Lake is the largest lake entirely in Canada. The lakes Superior, Michigan, Huron, Ontario, and Michigan-Huron are the largest.", "prediction 4": "The Great Bear Lake is the largest lake entirely in Canada. Lakes Superior, Michigan, Huron, Erie, and Ontario make up the Great Lakes Waterway.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 476 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Great Bear Lake, which is located in the boreal forest of Canada, is the largest lake entirely in Canada (Lake Superior and Lake Huron straddling the Canada\u2013US border are larger), the fourth-largest in North America, and the eighth-largest in the world. Lake Superior is the second largest lake in the world by area, and the largest freshwater lake by area. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the potato come to north america?", "passages": [ [ "History of the potato", "In India, Edward Terry mentioned the potato in his travel accounts of the banquet at Ajmer by Asaph Khan to Sir Thomas Roe, the British Ambassador in 1675.", "The vegetables gardens of Surat and Karnataka had potatoes as mentioned in Fyer's travel record of 1675.", "The Portuguese introduced potatoes, which they called 'Batata', to India in the early seventeenth century when they cultivated it along the western coast.", "British traders introduced potatoes to Bengal as a root crop, 'Alu'.", "By the end of the 18th century, it was cultivated across northern hill areas of India.", "Potatoes were introduced to Tibet by the 19th century through the trade route from India.", "Early colonists in Virginia and the Carolinas may have grown potatoes from seeds or tubers from Spanish ships, but the earliest certain potato crop in North America was in Londonderry, New Hampshire in 1719.", "The plants were from Ireland, so the crop became known as the \"Irish potato\".", "Potatoes were planted in Idaho as early as 1838; by 1900 the state's production exceeded a million bushels (about 27,000\u00a0tonnes).", "Before 1910, the crops were stored in barns or root cellars, but, by the 1920s, potato cellars or barns came into use." ], [ "Religions of the Discworld", "Novices of this order travel thousands of miles to the home of Mrs. Cosmopilite in order to mediate upon whatever wisdom she bestows upon them, which generally consists of such phrases as \"clear off, you!\"", "and \"if I see another one of you orange buggers around here, I'll call the Watch on you, see if I don't!\"", "The Way of Mrs. Cosmopilite is evidence of the phenomenon that wisdom is one of the few things which looks bigger the further away you are from it.", "The most notable follower, and probably its tongue in cheek inventor, is History Monk Lu-Tze.", "Probably an Uberwaldaen religion, the Potato Church is split between the Plain Potato Church and the Ancient and Orthodox Potato Church.", "Moist von Lipwig was raised in it.", "Its only apparent tenet is that as long as you have a potato with you when you die, you will go on to somewhere butter.", "The religion is first mentioned in \"The Truth\", where it appeared to originate from Mr Tulip's memory of someone saying that they will be all right as long as they have a potato.", "There is an implication that they actually meant that as long as you have a potato you won't starve, and that this was misunderstood." ] ], "gold": "Early colonists in Virginia and the Carolinas may have grown potatoes from seeds or tubers from Spanish ships, but the earliest certain potato crop in North America was in Londonderry, New Hampshire in 1719. The plants were from Ireland, so the crop became known as the \"Irish potato\". Thomas Jefferson says of the white potato, \"You say the potato is a native of the US. I presume you speak of the Irish potato. I have enquired much into this question, and think I can assure you that plant is not a native of North America. It came from Ireland.\"", "prediction 1": "The potato first started to come to North America in the early seventeenth century when the Portuguese introduced potatoes, which they called 'Batata', to India in the early seventeenth century. The potato's earliest certain crop in North America was in Londonderry, New Hampshire in 1719. Potatoes were planted in Idaho as early as 1838; by 1900 the state's production exceeded a million bushels (about 27,000 tonnes).", "prediction 2": "In North America, the potato first came to North America in the early 17th century. The earliest certain potato crop in North America was in Londonderry, New Hampshire in 1719 when the plants were from Ireland, so the crop became known as the Irish potato. Potatoes were planted in Idaho as early as 1838; by 1900 the state's production exceeded a million bushels (about 27,000 tonnes).", "prediction 3": "The earliest certain potato crop in North America was in Londonderry, New Hampshire in 1719. The plants were from Ireland, so the crop became known as the Irish potato. The potato came to Idaho as early as 1838.", "prediction 4": "The potato came to North America for the first time in 1719, when it was planted in Londonderry, New Hampshire. It was introduced to Tibet by the 19th century through the trade route from India.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 419 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Early colonists in Virginia and the Carolinas may have grown potatoes from seeds or tubers from Spanish ships. The potato's earliest certain crop in North America was in Londonderry, New Hampshire in 1719. The plants were from Ireland, so the crop became known as the \"Irish potato\"." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who sang the song god's not dead?", "passages": [ [ "God's Not Dead (Like a Lion)", "God's Not Dead (Like a Lion)\n\n", "\"God's Not Dead (Like a Lion)\" is single from the album \"God's Not Dead\" by the Newsboys.", "The song appeared on charts during its release in 2012.", "The song charted in 2014, after the release of the film, \"God's Not Dead\".", "The band performs the song, in a concert sequence, at the end of the film.", "The song was released through Inpop Records.", "The song was written by Daniel Bashta.", "The lead vocals are performed by Michael Tait and features fellow DC Talk member Kevin Max.", "It was first released as a single on 12 October 2011, peaking at No. 2 on 9 June 2012 after spending 22 weeks on the \"Billboard\" Hot Christian Songs.", "and then again when the film of the same name was released in 2014.", "It helped to propel \"We Believe\", from \"Restart\", to the No. 2 position on the chart as well.", "In the United States, the single reached gold sales in June 2014, and by May 2015 it became the band's first platinum single, selling more than 1 million.", "The music video for the song was published on 6 January 2012.", "The video is shot in much of New York City, and also shows many views of the Hudson River." ] ], "gold": "Like a Lion is song written by Daniel Bashta that was originally performed by Passion with David Crowder on the 2010 album Passion: Awakening. In 2011, this song was covered by Newsboys as God's Not Dead (Like a Lion) and released as a single from their album God's Not Dead. In the Newsboys' version, the lead vocals are performed by Michael Tait and Kevin Max is featured. The Newsboys' version charted in 2014 after the release of the film God's Not Dead. The band performs the song in a concert sequence at the end of the film.", "prediction 1": "\"God's Not Dead (Like a Lion)\" is a single from the album God's Not Dead by the Newsboys. The song appeared on charts during its release in 2012. The song charted in 2014, after the release of the film, God's Not Dead. The lead vocals are performed by Michael Tait and features fellow DC Talk member Kevin Max.", "prediction 2": "The song, \"God's Not Dead (Like a Lion),\" is single from the album \"God's Not Dead\" by the Newsboys. The song appeared on charts during its release in 2012. The song charted in 2014, after the release of the film, \"God's Not Dead\".", "prediction 3": "\"God's Not Dead (Like a Lion)\" is a song from the album \"God's Not Dead\" by the Newsboys. The song appeared on charts during its release in 2012. The song charted in 2014, after the release of the film, \"God's Not Dead\". The band performs the song, in a concert sequence, at the end of the film. The lead vocals are performed by Michael Tait and features fellow DC Talk member Kevin Max. It was first released as a single on 12 October 2011.", "prediction 4": "The Newsboys sang the song, \"God's Not Dead (Like a Lion)\" from the album God's Not Dead. The song appeared on charts during its release in 2012. The song charted in 2014, after the release of the film, \"God's Not Dead\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 145 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"God's Not Dead (Like a Lion)\" is a single from the album God's Not Dead by the Newsboys. The song was written by Daniel Bashta. The song charted in 2014, after the release of the film, God's Not Dead. The lead vocals are performed by Michael Tait and features fellow DC Talk member Kevin Max. The band performs the song, in a concert sequence, at the end of the film." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who is the most followed user on instagram?", "passages": [ [ "Cristiano Ronaldo", "He topped the list for the second straight year with earnings of $93\u00a0million in 2016\u201317.", "Ronaldo is one of the world's most marketable athletes: \"SportsPro\" rated him the fifth most marketable athlete in 2012, and eighth most marketable athlete in 2013, with Brazilian footballer Neymar topping both lists.", "Sports market research company Repucom named Ronaldo the most marketable and most recognised football player in the world in May 2014.", "He was additionally named in the 2014 Time 100, \"Time\"s annual list of the most influential people in the world.", "ESPN named Ronaldo the world's most famous athlete in 2016, 2017 and 2018.", "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158\u00a0million total followers across Facebook, Twitter and Instagram by June 2015.", ", he has the world's biggest Facebook fanbase with 103\u00a0million followers: he became the first sportsperson to reach 50\u00a0million followers in August 2010, and in October 2014, he became the first sportsperson, and the second person after Shakira, to reach 100\u00a0million followers.", "By June 2017, Ronaldo had 277\u00a0million followers across social media.", "His sponsors earned $936\u00a0million in media value across his social media accounts between June 2016 to June 2017." ], [ "Celebrity branding", "Companies can simply tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click.", "The culture of advertising on Instagram came naturally when businesses realized that celebrities have a direct means of communication to their target demographic.", "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers.", "By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people.", "Many of America's top-earning celebrities Instagram accounts are continually promoting products such as health supplements, vitamins and detox teas.", "These aren't spontaneous proclamations, but rather posts paid for by brands to advertise products to the celebrities' sizable following.", "On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram.", "At the top end of the digital celebrity pay scale some posts can earn around $300,000, especially when Instagram pictures can be easily linked to other social media platforms such as Facebook or Twitter.", "One of the celebrities that is most well known for promoting brands on her Instagram page is Kim Kardashian." ] ], "gold": "Instagram's own brand account is the most followed on Instagram with 424 million followers. Football player Cristiano Ronaldo is the most followed individual on istagram with 347 million followers.", "prediction 1": "The most followed user on Instagram is Portuguese footballer Cristiano Ronaldo.\n", "prediction 2": "The most followed user on Instagram by far is Brazilian footballer Cristiano Ronaldo.", "prediction 3": "Throughout the years, many celebrities have utilized Instagram as a means to promote their brands and monetize their followings. The Facebook star has 30 million followers on his Instagram account and two million followers on his Twitter account. Ronaldo is the most followed user on Instagram (update: 27 June 2018).", "prediction 4": "Cristiano Ronaldo is the most followed user on Instagram with a total of 277 million followers by the end of the year.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 39, "end": 80 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "What does the e stand for in wile e coyote?", "passages": [ [ "Wile E. Coyote and the Road Runner", "To date, 49 cartoons have been made featuring these characters (including the four CGI shorts), the majority by Chuck Jones.", "\"TV Guide\" included Wile E. Coyote in its 2013 list of The 60 Nastiest Villains of All Time.", "Jones based the Coyote on Mark Twain's book \"Roughing It\", in which Twain described the coyote as \"a long, slim, sick and sorry-looking skeleton\" that is \"a living, breathing allegory of Want.", "He is \"always\" hungry.\"", "Jones said he created the Coyote-Road Runner cartoons as a parody of traditional \"Cat And Mouse\" cartoons such as MGM's \"Tom and Jerry,\" which Jones would work on as a director later in his career.", "Jones modelled the Coyote's appearance on fellow animator Ken Harris.", "The Coyote's name of Wile E. is a pun of the word \"wily.\"", "The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book.", "The Coyote's surname is routinely pronounced with a long \"e\" ( ), but in one cartoon short, \"To Hare Is Human\", Wile E. is heard pronouncing it with a diphthong ( )." ], [ "Wile E. Coyote and the Road Runner", "Wile E. Coyote and the Road Runner\n\nWile E. Coyote (also known simply as \"The Coyote\") and the Road Runner are a duo of characters from the \"Looney Tunes\" and \"Merrie Melodies\" series of cartoons.", "In the cartoons, the Coyote repeatedly attempts to catch and subsequently eat the Road Runner, a fast-running ground bird, but is never successful.", "Instead of his animal instincts, the Coyote uses absurdly complex contraptions (sometimes in the manner of Rube Goldberg) to pursue his prey, which comically backfire with the Coyote often getting injured in slapstick fashion.", "Many of the items for these contrivances are mail-ordered from a variety of companies all named Acme.", "One running gag involves the Coyote trying in vain to shield himself with a little parasol against a great falling boulder that is about to crush him.", "Another running gag involves the coyote falling from a high cliff.", "After he goes over the edge, the rest of the scene, shot from a bird\u2019s-eye view, shows the coyote falling into a canyon so deep, that his figure is eventually lost to sight.", "This is followed a second or two later by the rising of a dust cloud from the canyon floor as the coyote hits." ] ], "gold": "Wile E. Coyote and the Road Runner are a duo of cartoon characters from the Looney Tunes and Merrie Melodies series of animated cartoons. In each episode, the cunning, devious and constantly hungry Coyote repeatedly attempts to catch the Road Runner, but is successful only on extremely rare occasions. The Coyote's name of Wile E. is a pun of the word \"wily.\" The \"E\" stands for \"Ethelbert\" according to an issue of a Looney Tunes comic book.", "prediction 1": "Wile E. Coyote and the Road Runner are duo of characters from the Looney Tunes and Merrie Melodies series of cartoons. In the cartoons, the Coyote's name of Wile E. is a pun of the word \"wily.\" The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book. In the cartoons, the \"E\" stands for \"Frankie\" in the Looney Tunes series of cartoons.", "prediction 2": "Wile E. Coyote is a pun of the word \"wily.\" The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book. The Coyote's surname is routinely pronounced with a long \"e\" ( ), but in one cartoon short, \"To Hare Is Human\", Wile E. is heard pronouncing it with a diphthong ( ).", "prediction 3": "Wile E. Coyote, also known simply as \"The Coyote\", is a pun of the word \"wily.\" The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book. The Coyote's surname is routinely pronounced with a long \"e\" ( ), but in one cartoon short, \"To Hare Is Human\", Wile E. is heard pronouncing it with a diphthong ( ).", "prediction 4": "Wile E. Coyote is a pun on \"wily\" and the word \"Ethelbert\" in one issue of a Looney Tunes comic book. In the cartoons Wile E. is known simply as the Coyote and the Road Runner is a duo of characters from the Looney Tunes and Merrie Melodies series of cartoons. The Coyote's name of Wile E. is a pun on the word \"wily.\" The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book. In the cartoons, Wile E stands for \"Ethelbert\" in the comic book. In the cartoon, Wile E. is heard pronouncing it with a diphthong ( ). The Coyote's surname is routinely pronounced with", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 268, "end": 353 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Wile E. Coyote and the Road Runner are duo of characters from the Looney Tunes and Merrie Melodies series of cartoons. In the cartoons, the Coyote repeatedly attempts to catch and subsequently eat the Road Runner, a fast-running ground bird, but is never successful. In the cartoons, the Coyote's name of Wile E. is a pun of the word \"wily.\" The \"E\" stands for \"Ethelbert\" in one issue of a Looney Tunes comic book. " }, "preference": [ 1, 0, 1, 0, 1, 1 ] }, { "question": "What's the population of walnut grove minnesota?", "passages": [ [ "Walnut Grove, Minnesota", "Walnut Grove, Minnesota\n\nWalnut Grove is a city in Redwood County, Minnesota, United States.", "The population was 871 at the 2010 census.", "Another name formerly associated with the area is \"Walnut Station\".", "Walnut Grove was platted in 1874.", "It was named for a grove of black walnut trees near the original town site.", "It was incorporated in 1879.", "Walnut Grove is the home of the Laura Ingalls Wilder Museum, dedicated to the author of the \"Little House on the Prairie\" books.", "Wilder and her family lived in the area for a part of her childhood and the location is used as the setting for the \"Plum Creek\" part of the \"Little House\" book series.", "Charles Ingalls, her father, was the community's first justice and her only brother, Charles Frederick 'Freddy' Ingalls (November 1, 1875 \u2013 August 27, 1876), was born in Walnut Grove.", "The name \"Walnut Grove\" was also used in the \"Little House on the Prairie\" television series; however, the program was filmed in California.", "Walnut Grove gained more than 250 new residents between 2001 and 2006.", "The new residents are Hmong immigrants and their families.", "The influx of people has increased the population to nearly 900, and Hmong now comprise 42 percent of the students in the Westbrook-Walnut Grove School District." ], [ "Walnut Grove, Minnesota", "The median age in the city was 36.8 years.", "31.3% of residents were under the age of 18; 7.9% were between the ages of 18 and 24; 18.3% were from 25 to 44; 23.1% were from 45 to 64; and 19.3% were 65 years of age or older.", "The gender makeup of the city was 50.3% male and 49.7% female.", "As of the census of 2000, there were 599 people, 291 households, and 178 families residing in the city.", "The population density was 577.7 people per square mile (222.4/km\u00b2).", "There were 341 housing units at an average density of 328.9 per square mile (126.6/km\u00b2).", "The racial makeup of the city was 97.66% White, 0.67% African American, 0.17% Native American, 0.17% Asian, 1.17% Pacific Islander, and 0.17% from two or more races.", "Hispanic or Latino of any race were 0.17% of the population.", "There were 291 households out of which 21.3% had children under the age of 18 living with them, 53.3% were married couples living together, 6.5% had a female householder with no husband present, and 38.8% were non-families." ], [ "Walnut Grove, Minnesota", "According to the United States Census Bureau, the city has a total area of , all of it land.", "Walnut Grove lies along U.S. Route 14, which connects it with Tracy to the west and Revere to the east.", "The town is located on Plum Creek.", "As of the census of 2010, there were 871 people, 313 households, and 210 families residing in the city.", "The population density was .", "There were 367 housing units at an average density of .", "The racial makeup of the city was 63.4% White, 0.5% Native American, 35.0% Asian, 1.0% from other races, and 0.1% from two or more races.", "Hispanic or Latino of any race were 2.1% of the population.", "There were 313 households of which 30.7% had children under the age of 18 living with them, 55.9% were married couples living together, 6.7% had a female householder with no husband present, 4.5% had a male householder with no wife present, and 32.9% were non-families.", "30.0% of all households were made up of individuals and 17.9% had someone living alone who was 65 years of age or older.", "The average household size was 2.78 and the average family size was 3.53." ] ], "gold": "Walnut Grove is a city in Redwood County, Minnesota, in the United States. At the 2000 census, the city had 599 people, 291 households, and 178 families. Between 2001 and 2006 Walnut Grove gained more than 250 residents. As of the 2010 census, the population had grown to 871 people, 313 households, and 210 families.", "prediction 1": "Walnut Grove, Minnesota is a city in Redwood County, Minnesota, United States. The population was 871 at the 2010 census. The city is the home of the Laura Ingalls Wilder Museum and the setting for the Little House on the Prairie television series. As of the census of 2000, there were 599 people, 291 households, and 178 families residing in the city. The racial makeup of the city was 97.66% White, 0.67% African American, 0.17% Native American, 1.17% Asian, and 0.17% from two or more races. Hispanic or Latino of any race were 0.17% of the population. Hispanic or Latino of any race were 2.1% of the population.", "prediction 2": "Walnut Grove is a city in Redwood County, Minnesota, United States. The population was 871 at the 2010 census. The population density was 577.7 people per square mile (223.2/km2).", "prediction 3": "Walnut Grove, Minnesota is a city in Redwood County, Minnesota, United States. The population was 871 at the 2010 census. The city gained more than 250 new residents between 2001 and 2006. The new residents are Hmong immigrants and their families. The influx of people has increased the population to nearly 900, and Hmong now comprise 42 percent of the students in the Westbrook-Walnut Grove School District.", "prediction 4": "Walnut Grove is a city in Redwood County, Minnesota, United States. The population was 871 at the 2010 census. The city gained more than 250 new residents between 2001 and 2006. The new residents are Hmong immigrants and their families.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 23 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 248 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 494 }, { "error type": "Irrelevant", "explanation": "", "start": 495, "end": 555 }, { "error type": "Redundant", "explanation": "Hispanic or Latino of any race", "start": 556, "end": 586 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 592, "end": 615 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Walnut Grove is a city in Redwood County, Minnesota, United States. As of the census of 2000, there were 599 people, 291 households, and 178 families residing in the city. Walnut Grove gained more than 250 new residents between 2001 and 2006. As of the census of 2010, there were 871 people, 313 households, and 210 families." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who has played will horton on days of our lives?", "passages": [ [ "Will Horton", "After he nearly murders Abigail and Chad, Ben is arrested and publicly revealed as the Necktie Killer.", "In 2017, it is revealed that Will (now Chandler Massey) did not die when he was strangled.", "When Will had entered Ben's apartment, he was being followed by Susan Banks (Eileen Davidson), who was planning to abduct Will in an act of revenge against Sami, whom she blamed for her son EJ's death.", "When Ben slipped out after strangling Will, Susan and her associate Dr Wilhelm Rolf (who had revived Sami's step-dad John back when he was thought to be dead) secretly entered, and Dr Rolf found Will to be unconscious but breathing.", "He then injected Will with something that would make him appear to be dead.", "After Lucas and Sami had viewed Will in the morgue, Dr Rolf (William Utay) revived Will.", "It turns out that Will's family unwittingly buried an empty coffin at his funeral, and Will, who had lost all his memories, was taken by Susan, who took care of him, but made him believe that he was her son EJ.", "In the fall of 2017, Sonny and Paul are to marry, and Ben escapes from Bayview Sanatarium, and crashes their double wedding with Chad and Abigail to announce that Will is alive." ], [ "Will Horton", "Will Horton\n\nWill Horton is a fictional character from the American daytime TV soap opera \"Days of Our Lives\", known for award-winning drama including a highly praised coming out story, award-winning performances by actor Chandler Massey, and as one half of US daytime drama's first male gay wedding and marriage.", "The character first appeared on November 16, 1995, as the newborn child of mom Sami Brady (Alison Sweeney).", "Initially he is called Will Reed, as Sami has Austin Reed (Austin Peck) believing he is Will's father, as she hopes Austin will marry her; and when Sami later realizes that Will must actually be the son of Lucas Roberts (Bryan Dattilo), she tries to prevent others finding out.", "Two years later the truth comes out, and Will, who is renamed Will Roberts, has a \"tumultuous upbringing\" due to his parents fighting each other for custody and their ever-changing love lives.", "As a child, Will endeavours to bring his parents together; whereas his grandma Kate Roberts (Lauren Koslow) schemes to keep his parents apart.", "In 2007, Lucas, now in love with Sami and angry at Kate's interference, changes his and Will's family name to Horton (from Lucas's father, Bill Horton)." ], [ "Dylan Patton", "Dylan Patton\n\nDylan Michael Patton (born July 13, 1992) is an American former actor and former model.", "He is best known for portraying the role of Will Horton on the NBC soap opera \"Days of Our Lives\" from February 27, 2009 to January 20, 2010.", "He currently plays Ultimate Frisbee for the Los Angeles Organization of Ultimate Teams called Kong and does production assistant work in art department.", "In early 2009, he was cast in the role of Will Horton on the NBC soap opera \"Days of Our Lives for 4 years, but due to the change in story line, after playing the role for eleven and a half months, the role was recast and he was let go from the show.", "In 2010, he was nominated for an award at the 37th annual Daytime Emmy Awards in the Outstanding Younger Actor category for his role in Days of Our Lives.", "Patton currently plays Ultimate Frisbee for the Los Angeles Organization of Ultimate Teams team \"Kong\".", "In January 2016, he participated in an American Ultimate Disc League team \"Los Angeles Aviators\" Tryouts session in Group C in hopes to get to play for \"2016 Los Angeles Aviators Roster\", but did not make it through.", "Dylan was born in Texas, United States on July 13, 1992.", "His family consists of his parents David Patton, Deborah Patton and younger brother Julian.", "He studied at Agoura High School." ] ], "gold": "Will Horton from the TV show \"Days of Our Lives\" was initially played by a series of child actors and then, as he grew, adult actors. Child actors Shawn and Taylor Carpenter portrayed the character from 1995-2002. Then Darian Weiss (2002-2003), Christopher Gerse (2003-2008), and Dylan Patton (2009-2010). Then he was portrayed by adult actors Chandler Massey, who played the character from 2010-2014 and 2017 to the present day, and Guy Wilson, who played the character from 2014-2015.", "prediction 1": "Will Horton is a fictional character from the American daytime TV soap opera Days of Our Lives. American actor Dylan Patton played the role of Will Horton from February 27, 2009 to January 20, 2010. American actor Erica DeVine played the role of Will Horton from September 7, 2005 to November 7, 2009. American actor Chandler Massey played the role of Will Horton from November 15, 2008 to January 20, 2010.", "prediction 2": "Will Horton is a fictional character from the American daytime TV soap opera Days of Our Lives. American actor and former model Dylan Patton played Will Horton from February 27, 2009 to January 20, 2010. He was best known for portraying the role of Will Horton on the NBC soap opera from February 27, 2009 to January 20, 2010.", "prediction 3": "Will Horton is a fictional character from the American daytime TV soap opera Days of Our Lives. Will Horton is portrayed by numerous actors, including Dylan Patton, Ashley Woodrow Wilson, and William Utay.", "prediction 4": "Will Horton is a fictional character from the American daytime soap opera Days of Our Lives. American actor and former model Dylan Patton played the role of Will Horton on Days of Our Lives from 2009-2010. Bryan Dattilo played the role of Will Horton from 2010-2014.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 199, "end": 301 }, { "error type": "Unverifiable", "explanation": "", "start": 364, "end": 407 } ], "missing-info": [], "corrected-prediction": "Will Horton is a fictional character from the American daytime TV soap opera Days of Our Lives. American actor Dylan Patton played the role of Will Horton from February 27, 2009 to January 20, 2010. . American actor Chandler Massey played the role of Will Horton." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Smallest continent of world in terms of area other than australia is?", "passages": [ [ "Continent", "Continent\n\nA continent is one of several very large landmasses of the world.", "Generally identified by convention rather than any strict criteria, up to seven regions are commonly regarded as continents.", "Ordered from largest in area to smallest, they are: Asia, Africa, North America, South America, Antarctica, Europe, and Australia.", "Geologically, the continents largely correspond to areas of continental crust that are found on the continental plates.", "However, some areas of continental crust are regions covered with water not usually included in the list of continents.", "Zealandia is one such area (see submerged continents below).", "Islands are frequently grouped with a neighbouring continent to divide all the world's land into geopolitical regions.", "Under this scheme, most of the island countries and territories in the Pacific Ocean are grouped together with the continent of Australia to form a geopolitical region called \"Oceania\".", "By convention, \"continents are understood to be large, continuous, discrete masses of land, ideally separated by expanses of water.\"", "Several of the seven conventionally recognized continents are not discrete landmasses separated completely by water.", "The criterion \"large\" leads to arbitrary classification: Greenland, with a surface area of is considered the world's largest island, while Australia, at is deemed the smallest continent." ], [ "History of Seoul", "These include tens of thousands of English teachers from the United States, Canada, United Kingdom, Australia, New Zealand, and other English-speaking countries as well as laborers from Bangladesh, China, India, Indonesia, Mongolia, Nigeria, Pakistan, the Philippines, Uzbekistan, and Vietnam.", "In 1995, the boundary between Seoul and Gwangmyeong rearrangement was implemented, merging parts of Cheolsan 3-dong, Gwangmyeong in the Geumcheon District of Seoul.", "Around the time of the 1995 municipal annexation in South Korea, the government once seriously considered a division of Seoul into several municipal or metropolitan cities, but the division plan foundered as it would be expected to cause serious problems in aspects of metropolitan governance in Seoul.", "In addition, there are many language instructors from English-speaking countries such as Canada, Australia, New Zealand, South Africa, United States, and the UK, as a major business and financial center, Seoul also has many executives and analysts from North America, Europe, and Japan.", "Seoul ranks seventh in the world in terms of the number of Fortune 500 transnational companies headquartered there.", "It is also the world's second most expensive city, ahead of Tokyo and Hong Kong (ranked 3rd and 4th, respectively)." ], [ "Eurasia", "Eurasia\n\nEurasia is a combined continental landmass of Europe and Asia.", "The term is a portmanteau of its constituent continents (Europe and Asia).", "Located primarily in the Northern and Eastern Hemispheres, it is bordered by the Atlantic Ocean to the west, the Pacific Ocean to the east, the Arctic Ocean to the north, and by Africa, the Mediterranean Sea, and the Indian Ocean to the south.", "The division between Europe and Asia as two different continents is a historical social construct, with no clear physical separation between them; thus, in some parts of the world, Eurasia is recognized as the largest of the six, five, or even four continents on Earth.", "In geology, Eurasia is often considered as a single rigid megablock.", "However, the rigidity of Eurasia is debated based on paleomagnetic data.", "Eurasia covers around , or around 36.2% of the Earth's total land area.", "The landmass contains well over 5 billion people, equating to approximately 70% of the human population.", "Humans first settled in Eurasia between 60,000 and 125,000 years ago.", "Some major islands, including Great Britain, Iceland, and Ireland, and those of Japan, the Philippines and Indonesia, are often included under the popular definition of Eurasia, in spite of being separate from the contiguous landmass." ] ], "gold": "Which is the smallest continent of the world in terms of area other than Australia depends on the model used. Using the seven-continent model, which is usually taught in most English-speaking countries, it's Europe. Using the six-continent model, in which Europe and Asia are combined, it's Antarctica. The six-continent combined-Eurasia model is mostly used in Russia, Eastern Europe, and Japan.", "prediction 1": "A continent is one of several very large landmasses of the world. Generally identified by convention rather than any strict criteria, up to seven regions are commonly regarded as continents. Ordered from largest in area to smallest, they are: Asia, Africa, North America, South America, Antarctica, Europe, and Australia. Greenland, with a surface area of is considered the world's largest island, while Australia, at is deemed the smallest continent.", "prediction 2": "A continent is one of several very large landmasses of the world. Ordered from largest in area to smallest, they are: Asia, Africa, North America, South America, Antarctica, Europe, and Australia. By convention, \"continents are understood to be large, continuous, discrete masses of land, ideally separated by expanses of water,\" however, several of the seven conventionally recognized continents are not discrete landmasses separated completely by water. Greenland is considered the world's largest island, while Australia is deemed the smallest continent.", "prediction 3": "A continent is one of several very large landmasses of the world. Generally identified by convention rather than any strict criteria, up to seven regions are commonly regarded as continents. Ordered from largest in area to smallest, they are Asia, Africa, North America, South America, Antarctica, Europe, and Australia. The smallest continent by area is Australia, at 3.7% of the Earth's surface.", "prediction 4": "A continent is one of several very large landmasses of the world. Geographically, the continents are known to be large, continuous masses of land, ideally separated by expanses of water. Greenland is the largest island in the world, while Australia is the smallest continent.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 451 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": " Generally identified by convention rather than any strict criteria, up to seven regions are commonly regarded as continents. Ordered from largest in area to smallest Europe is next before Australia. Using the six-continent model, in which Europe and Asia are combined, it's Antarctica." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who did the usa fight in world war 2?", "passages": [ [ "Military history of the United States during World War II", "American mercenary Colonel Charles Sweeny living in London began recruiting American citizens to fight as a U.S. volunteer detachment in the French Air force, however France fell before this was implemented.", "During the Battle of Britain, 11 American pilots flew in the RAF, one of whom was killed.", "Charles Sweeney's nephew, also called Charles formed a Home Guard unit from American volunteers living in London.", "One notable example was the Eagle Squadrons, these being RAF Squadrons made up of American volunteers and British personnel.", "The first was formed; No. 71 Squadron on 19 September 1940 by followed by No. 121 Squadron on 14 May 1941 and No. 133 Squadron on 1 August 1941.", "6,700 Americans applied to join but only 244 Americans got to serve with the three Eagle Squadrons,16 Britons also served as squadron and flight commanders.", "The first became operational in February 1941 and the Squadrons scored their first kill in July 1941.", "On 29 September 1942, the three squadrons were officially turned over by the RAF to the Eighth Air Force of the U.S. Army Air Forces and became the 4th Fighter Group.", "In their time with the RAF the squadrons claim to have shot 73\u00bd German planes; 77 Americans and 5 Britons were killed." ], [ "World War II", "The United States started strategic planning to prepare for a full-scale offensive against Germany.", "At the end of September 1940, the Tripartite Pact formally united Japan, Italy and Germany as the Axis Powers.", "The Tripartite Pact stipulated that any country, with the exception of the Soviet Union, which attacked any Axis Power would be forced to go to war against all three.", "The Axis expanded in November 1940 when Hungary, Slovakia and Romania joined.", "Romania and Hungary would make major contributions to the Axis war against the Soviet Union, in Romania's case partially to recapture territory ceded to the Soviet Union.", "In early June 1940 the Italian \"Regia aeronautica\" attacked and besieged Malta, a British possession.", "In late summer through early autumn Italy conquered British Somaliland and made an incursion into British-held Egypt.", "In October Italy attacked Greece, but the attack was repulsed with heavy Italian casualties; the campaign ended within days with minor territorial changes.", "Germany started preparation for an invasion of the Balkans to assist Italy, to prevent the British from gaining a foothold there, which would be a potential threat for Romanian oil fields, and to strike against the British dominance of the Mediterranean.", "In December 1940, British Empire forces began counter-offensives against Italian forces in Egypt and Italian East Africa." ], [ "History of United States foreign policy", "The same pattern which emerged with the first world war continued with the second: warring European powers, blockades, official U.S. neutrality but this time President Roosevelt tried to avoid all of Wilson's mistakes.", "American policy substantially favored Britain and its allies, and the U.S. getting caught up in the war.", "Unlike the loans in World War I, the United States made large-scale grants of military and economic aid to the Allies through Lend-Lease.", "Industries greatly expanded to produce war materials.", "The United States officially entered World War II against Germany, Japan, and Italy in December 1941, following the Japanese surprise attack on Pearl Harbor.", "This time the U.S. was a full-fledged member of the Allies of World War II, not just an \"associate\" as in the first war.", "During the war, the U.S. conducted military operations on both the Atlantic and Pacific fronts.", "After the war and devastation of its European and Asian rivals, the United States found itself in a uniquely powerful position due to the lack of damage to its domestic industries.", "After 1945, the isolationist pattern characterizing the inter-war period had ended for good.", "It was Franklin Roosevelt policy to establish a new international organization that would be much more effective than the old League of Nations, and avoid its flaws.", "He successfully sponsored the formation of the United Nations." ] ], "gold": "In World War 2, the USA fought both a group of nations called The Axis powers and the countries of Germany, Japan, and Italy, which the Tripartite Pact united as the Axis powers in September 1940. The Axis expanded in November 1940 when Hungary, Slovakia, and Romania joined.", "prediction 1": "The United States fought in World War 2 against Germany, Japan, and Italy. The war was fought on both the Atlantic and Pacific fronts. The United States participated in the Normandy landings, the invasion of Normandy and the Battle of Britain.", "prediction 2": "The United States entered World War II against Germany, Japan, and Italy in December 1941, following the Japanese surprise attack on Pearl Harbor. The United States participated in operations in the Pacific and Atlantic. During the war, the United States conducted military operations on both the Atlantic and Pacific fronts.", "prediction 3": "The United States fought in World War II against Japan, Germany and Italy, forming the Axis Powers, the Axis. They fought against Japan, Italy, and Germany and were credited with killing over 1,600 Japanese and Italian aircraft, 77 Americans and 5 Britons. The aircraft were credited with killing over 1,600 Germans and 1,300 Italians, including two American bombers, one American bomber and one German rocket. The United States also fought against the Japanese in the Pacific and in the Mediterranean.", "prediction 4": "The United States in World War II fought against Japan, Italy and Germany, as the Axis Powers. In World War II, the US fought against the Germans, the Japanese, and the French.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 134 }, { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 243 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The United States fought in World War 2 against Germany, Japan, and Italy, which the Tripartite Pact united as the Axis powers in September 1940. The Axis expanded in November 1940 when Hungary, Slovakia and Romania joined. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "How many episodes are in series 4 of shetland?", "passages": [ [ "Shetland (TV series)", "Shetland (TV series)\n\nShetland is a British television crime drama television series, made by ITV Studios for the BBC and broadcast on BBC One, that first broadcast on 10 March 2013.", "Initially based upon the novels of Ann Cleeves, the series was brought to screen by David Kane, who has remained a principal writer through all four series.", "The series stars Douglas Henshall as Jimmy Perez, a detective inspector working for the Shetland police, Alison O'Donnell as Detective Sergeant Alison \"Tosh\" Macintosh, and Steven Robertson as Detective Constable Sandy Wilson.", "Mark Bonnar, Lewis Howden, Erin Armstrong, Julie Graham, and Anne Kidd are also credited as principal members of the cast.", "The story takes place largely on the eponymous Scottish archipelago, although much of the series' filming takes place on the Scottish mainland, with only some location filming actually taking place on Shetland.", "Four series have been broadcast to date.", "Douglas Henshall won the 2016 BAFTA Scotland award for best actor for his role as Jimmy Perez, and the series received the award for Best TV Drama.", "The first series consists of two episodes; a single two-part story based on the novel \"Red Bones \" by Ann Cleeves.", "This series was broadcast across two nights on 10 and 11 March 2013 and was produced by Sue De Beauvoir.", "Subsequently, a second series was commissioned by the BBC." ], [ "Shetland (TV series)", "Series two was extended to contain six episodes.", "These were filmed in 2013 and screened in 2014.", "This series features three two-part stories based on Cleeves' novels \"Raven Black\", \"Dead Water\", and \"Blue Lightning\".", "This series was produced by Peter Gallagher.", "Filming began in April 2015 for a third series, which began screening in January 2016.", "This series saw a change in format; with all six episodes covering a single story, written exclusively for television.", "This was the first series not to adapt any of Cleeves' novels.", "Ciar\u00e1n Hinds and Anna Chancellor were among the new cast members for this series.", "A fourth series was announced by the BBC in July 2016.", "Again, this series is a single story played out across six episodes and written exclusively for television.", "Stephen Walters and Neve McIntosh were among the new cast members announced for the series.", "It was broadcast on BBC One beginning on 13 February 2018.", "In July 2018, Henshall confirmed that filming for series five would take place over the following four months.", "During the filming of the programme, the cast and crew are usually based in Glasgow and other areas of mainland Scotland." ] ], "gold": "Shetland is a Scottish crime drama television series made by ITV Studios for BBC Scotland and first broadcast on 10 March 2013. The series was initially based upon the novels of Ann Cleeves, but the series was brought to screen by David Kane, who has remained the principal writer throughout the series. Series 1 of Shetland had 2 episodes, while series 4 had 6. ", "prediction 1": "Shetland is a British television crime drama television series that has been broadcast in series four. The series first aired on 10 March 2013. The second series aired on 10 March 2014.", "prediction 2": "Shetland is a British television crime drama television series made by ITV Studios for the BBC and broadcast on BBC One, that first broadcast on 10 March 2013. The series stars Douglas Henshall as Jimmy Perez, a detective inspector working for the Shetland police. The series is a single story played out across six episodes and written exclusively for television.", "prediction 3": "Shetland is a British crime drama television series, made by ITV Studios for the BBC and broadcast on BBC One. The series first aired on 10 March 2013. The second series aired on 10 and 11 March 2014. There were also six episodes in the third series.", "prediction 4": "Shetland is a British television crime drama television series made by ITV Studios for the BBC and broadcast on BBC One, that first broadcast on 10 March 2013. The series stars Douglas Henshall as Jimmy Perez, a detective inspector working for the Shetland police. There are 6 episodes in series 4.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 185 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Shetland is a British crime drama television series made by ITV Studios for BBC Scotland and first broadcast on 10 March 2013. Initially based upon the novels of Ann Cleeves, the series was brought to screen by David Kane, who has remained a principal writer through all four series. The first series consists of two episodes. Series two was extended to contain six episodes." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When was pride and prejudice written and published?", "passages": [ [ "Pride and Prejudice", "Austen is known to use irony throughout the novel especially from viewpoint of the character of Elizabeth Bennet.", "She conveys the \"oppressive rules of femininity that actually dominate her life and work, and are covered by her beautifully carved trojan horse of ironic distance.\".", "Beginning with a historical investigation of the development of a particular literary form and then transitioning into empirical verifications, it reveals Free Indirect Discourse as a tool that emerged over time as practical means for addressing the physical distinctness of minds.", "Seen in this way, Free Indirect Discourse is a distinctly literary response to an environmental concern, providing a scientific justification that does not reduce literature to a mechanical extension of biology, but takes its value to be its own original form.", "Austen began writing the novel after staying at Goodnestone Park in Kent with her brother Edward and his wife in 1796.", "It was originally titled \"First Impressions\", and was written between October 1796 and August 1797.", "On 1 November 1797 Austen's father sent a letter to London bookseller Thomas Cadell to ask if he had any interest in seeing the manuscript, but the offer was declined by return post.", "The militia were mobilised after the French declaration of war on Britain in February 1793, and there was initially a lack of barracks for all the militia regiments, requiring the militia to set up huge camps in the countryside, which the novel refers to several times." ], [ "Pride and Prejudice", "Austen sold the copyright for the novel to Thomas Egerton from the Military Library, Whitehall in exchange for \u00a3110 (Austen had asked for \u00a3150).", "This proved a costly decision.", "Austen had published \"Sense and Sensibility\" on a commission basis, whereby she indemnified the publisher against any losses and received any profits, less costs and the publisher's commission.", "Unaware that \"Sense and Sensibility\" would sell out its edition, making her \u00a3140, she passed the copyright to Egerton for a one-off payment, meaning that all the risk (and all the profits) would be his.", "Jan Fergus has calculated that Egerton subsequently made around \u00a3450 from just the first two editions of the book.", "Egerton published the first edition of \"Pride and Prejudice\" in three hardcover volumes on 27 January 1813.", "It was advertised in \"The Morning Chronicle\", priced at 18s.", "Favourable reviews saw this edition sold out, with a second edition published in November that year.", "A third edition was published in 1817.", "Foreign language translations first appeared in 1813 in French; subsequent translations were published in German, Danish, and Swedish.", "\"Pride and Prejudice\" was first published in the United States in August 1832 as \"Elizabeth Bennet or, Pride and Prejudice\".", "The novel was also included in Richard Bentley's Standard Novel series in 1833." ], [ "Pride and Prejudice", "Pride and Prejudice\n\nPride and Prejudice is an 1813 romantic novel by Jane Austen.", "It charts the emotional development of protagonist Elizabeth Bennet, who learns the error of making hasty judgments and comes to appreciate the difference between the superficial and the essential.", "The comedy of the writing lies in the depiction of manners, education, marriage, and money during the British Regency period.", "Mr. Bennet of the Longbourn estate has five daughters, but his property is entailed, meaning that none of the girls can inherit it.", "His wife has no fortune, so it is imperative that at least one of the girls marry well in order to support the others upon his death.", "Jane Austen's opening line, \"It is a truth universally acknowledged, that a single man in possession of a good fortune, must be in want of a wife\", is a sentence filled with irony and playfulness.", "The novel revolves around the importance of marrying for love, not simply for money, despite the social pressures to make a good (i.e., wealthy) match.", "\"Pride and Prejudice\" has long fascinated readers, consistently appearing near the top of lists of \"most-loved books\" among both literary scholars and the general public.", "It has become one of the most popular novels in English literature, with over 20 million copies sold, and paved the way for many archetypes that abound in modern literature." ] ], "gold": "Pride and Prejudice is an 1813 romantic novel of manners written by Jane Austen. Jane Austen wrote the book between October 1796 and August 1797, and it was published on 28 January 1813. Though it is mainly called a romantic novel, it can also be considered a satirical book. ", "prediction 1": "Pride and Prejudice is an 1813 romantic novel written by Jane Austen and first published in England in January 1813. The novel was also published in the United States in August 1832. Austen sold the copyright for the novel to Thomas Egerton from the Military Library, Whitehall in exchange for \u00a3110, whereby she indemnified the publisher against any losses and received any profits, less costs and the publisher's commission.", "prediction 2": "Pride and Prejudice is an 1813 romantic novel by Jane Austen. It charts the emotional development of protagonist Elizabeth Bennet, who learns the error of making hasty judgments and comes to appreciate the difference between the superficial and the essential. The novel was originally titled First Impressions, and was written between October 1796 and August 1797. It was first published in the United States in August 1832, followed by a third edition on August 18, 1833.", "prediction 3": "Pride and Prejudice is a romantic novel by English novelist Jane Austen, which charts the emotional development of protagonist Elizabeth Bennet, who learns the error of making hasty judgments and comes to appreciate the difference between the superficial and the essential. It was originally titled First Impressions, and was written between October 1796 and August 1797. The first edition of the novel was published in Britain on 27 January 1813. It was published in the United States on August 1832 as Elizabeth Bennet or, Pride and Prejudice.", "prediction 4": "Pride and Prejudice is an 1813 romantic novel written by Jane Austen. The novel charts the emotional development of protagonist Elizabeth Bennet, who learns the error of making hasty judgments and comes to appreciate the difference between the superficial and the essential. It was first published in the United States in August 1832 as Elizabeth Bennet or, Pride and Prejudice.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 425 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Pride and Prejudice is an 1813 romantic novel written by Jane Austen and first published in England in January 1813. It was originally titled \"First Impressions\", and was written between October 1796 and August 1797. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When was the last time fulham played at wembley?", "passages": [ [ "2018 EFL Championship play-off Final", "2018 EFL Championship play-off Final\n\nThe 2018 EFL Championship play-off Final was played on 26 May 2018 at Wembley Stadium, London.", "The winner earned promotion to the Premier League for the 2018\u201319 season.", "The top two teams of the 2017\u201318 EFL Championship season gained automatic promotion to the Premier League, whilst the teams placed between third and sixth place in the league table played two initial matches in a series of play-offs, and the top two teams of the play-offs play for the final place for the 2018\u201319 season in the Premier League.", "Winning the game has been estimated by accountants Deloitte to be worth \u00a3160m to the winners, rising to \u00a3280m should they survive at least one season in the Premier League.", "Fulham won 1\u20130, the only goal of the game being scored by Tom Cairney in the 23rd minute.", "It was their first game at Wembley for 43 years since losing the 1975 FA Cup Final.", "\"Note: In all results below, the score of the finalist is given first (H: home; A: away).\"", "" ], [ "1975 FA Cup Final", "1975 FA Cup Final\n\nThe 1975 FA Cup Final was the 94th final of the FA Cup.", "It took place on 3 May 1975 at Wembley Stadium and was contested by London clubs West Ham United and Fulham.", "The Fulham team contained two former England captains in former West Ham captain Bobby Moore, making his last appearance at Wembley, and Alan Mullery.", "West Ham won 2\u20130, with both goals scored by Alan Taylor.", "The first came in the 60th minute when Fulham goalkeeper Peter Mellor parried Billy Jennings' shot into Taylor's path; the second came four minutes later when Taylor capitalised after Mellor failed to hold on to Graham Paddon's shot.", "The 1975 West Ham team remains the last all-English team to win the FA Cup.", "It also remains the only occasion that Fulham have appeared in an FA Cup final, and it was their last major final for 35 years, until the 2010 UEFA Europa League Final." ], [ "Fulham F.C.", "Fulham F.C. Fulham Football Club () is a professional association football club based in Fulham, West London, England.", "Founded in 1879, they currently compete in the Premier League, the top tier of English football, following their promotion from the EFL Championship in the 2017\u201318 season.", "They are the oldest football team from London to play in the Football League.", "The club has spent 27 seasons in English football's top division, the majority of these in two spells during the 1960s and 2000s.", "The latter spell was associated with former chairman Mohamed Al-Fayed, after the club had climbed up from the fourth tier in the 1990s.", "Fulham have never won a major honour, although they have reached two major finals: in 1975, as a Second Division team, they contested the FA Cup Final for the only time in their history, losing 2\u20130 to West Ham United, and in 2010 they reached the final of the UEFA Europa League, which they contested with Atl\u00e9tico Madrid in Hamburg, losing 2\u20131 after extra time.", "Fulham were formed in 1879 as Fulham St Andrew's Church Sunday School F.C., founded by worshipers (mostly adept at cricket) at the Church of England on Star Road, West Kensington (St Andrew's, Fulham Fields).", "Fulham's mother church still stands today with a plaque commemorating the team's foundation." ] ], "gold": "Fulham Football Club is an English professional association football club based in Fulham, London. Founded in 1879, Fulham is London's oldest professionally playing football club. Fulham played at Wembley Stadium during the 1975 FA Cup Final which took place on 3 May 1975. The team also played in the 2018 EFL Championship play-off Final at Wembley Stadium where they defeated Aston Villa.", "prediction 1": "The last time Fulham played at Wembley was on 21 May 1972. The 2018 EFL Championship play-off Final was played on 26 May 2018, the last time the football team played there was on 23 May 2017.", "prediction 2": "Fulham Football Club is a professional association football club based in Fulham, West London, England. Founded in 1879, they currently compete in the Premier League, the top tier of English football, following their promotion from the EFL Championship in the 2017\u201318 season. The last time Fulham played at Wembley was on 23 May 1975, the last time they played there was on 2 May 1975.", "prediction 3": "Fulham Football Club is a professional association football club based in Fulham, West London, England. The last time the club played at Wembley was on 3 May 1975. The 94th final of the FA Cup was on 3 May 1975 and was contested by London clubs West Ham United and Fulham. The 1975 FA Cup Final was the only occasion that the Fulham team have appeared in an FA Cup final, and it was their last major final for 35 years, until the 2010 UEFA Europa League Final.", "prediction 4": "Fulham Football Club are a professional association football club based in Fulham, West London, England. The last time the team played at Wembley was on 25 April 1975. The last time they played at Wembley was on 3 May 1975.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 58 }, { "error type": "Redundant", "explanation": "The last time Fulham played at Wembley ", "start": 127, "end": 191 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Fulham Football Club is a professional association football club based in Fulham, West London, England. Founded in 1879, they are the oldest football team from London to play in the Football League. On 3 May 1975, they played the FA Cup Final at Wembley. They again played at Wembley Stadium at the 2018 EFL Championship play-off Final that was played on 26 May 2018." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who makes the engine for the smart car?", "passages": [ [ "Smart Fortwo", "The range received a minor interior facelift for model year 2011 with standard knee airbags, new instrument cluster, more extensive cloth trimming for the top of the instrument panel, circular rather than rectangular outboard dash vents, optional multimedia system with a 6.5\" display, and optional surround-sound audio system.", "For model year 2013 all Fortwo's received a minor exterior facelift with revised lower facias, front and rear, and a relocated brand emblem located inside rather than above the front grille.", "The second generation Fortwo remained the lightest production car on sale in Europe.", "The 999\u00a0cc I3 Mitsubishi 3B2 engine (2007 onwards) is offered in normally aspirated and turbo versions.", "German tuner company Brabus, in a joint venture with Smart, has developed a high powered version of the 1.0-litre turbo, producing , originally available only in Europe, but now available elsewhere.", "A small 0.8-litre three-cylinder turbo diesel common rail engine made by Mercedes was available in most European markets.", "European Union (EU) fuel consumption testing for the combined cycle rates the 1.0-litre mhd at , the turbo at and for the diesel.", "The U.S. Environmental Protection Agency (EPA) rates the 1.0-litre mhd at combined (the EPA does not offer a rating for the diesel engine)." ], [ "Smart Fortwo", "Smart Fortwo\n\nThe Smart Fortwo (stylized as \"smart fortwo\") is a rear-engine, rear-wheel-drive, 2-seater hatchback city car manufactured and marketed by the Smart division of Daimler AG, introduced in 1998, now in its third generation.", "Marketed in 46 countries worldwide, Fortwo production had surpassed 1.7 million by early 2015.", "The brand name \"Smart\" derives from its early history as a cooperative venture between Swatch and Mercedes:", "Swatch Mercedes ART.", "The \"Fortwo\" nameplate derives from its two-person seating capacity.", "Until 2004, the Fortwo had been marketed as the \"smart City-Coup\u00e9.\"", "The developments started before 1993 originally as \"Swatch car\" of Nicolas Hayek in co-operation with Volkswagen.", "The idea was to design a modern microcar with an electric or hybrid drive.", "VW, however, could not decide to production, which led to disputes with Hayek.", "Hayek then turned to Mercedes.", "The company MCC (Micro Compact Car AG) was founded in 1994 by Hayek in Biel as a joint subsidiary of Daimler-Benz and SMH SA (Soci\u00e9t\u00e9 Suisse de Micro\u00e9lectronique et d'Horlogerie).", "When MCC abandoned the original concept and the planned electric or hybrid drive, both Hayek and senior development team members left the project." ] ], "gold": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-passenger hatchback microcar manufactured and marketed by the Smart division of the German multinational Daimler AG. Mitsubishi makes the engine for the normally aspirated and turbo versions of the smart car. Brabus makes the high-powered engine for the smart car.", "prediction 1": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-seater city car manufactured and marketed by the Smart division of Daimler AG, introduced in 1998, now in its third generation. The engine is made by Mitsubishi, Brabus and Mercedes-Benz. The 999 cc I3 Mitsubishi 3B2 engine is offered in normally aspirated and turbo versions. The 0.8-litre three-cylinder turbo diesel common rail engine made by Mercedes was available in most European markets.", "prediction 2": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-seater hatchback city car manufactured and marketed by the Smart division of Daimler AG. The 999 cc I3 Mitsubishi 3B2 engine is offered in normally aspirated and turbo versions. German tuner company Brabus, in a joint venture with Smart, has developed a high powered version of the 1.0-litre turbo, producing, originally available only in Europe, but now available elsewhere. A small 0.8-litre three-cylinder turbo diesel common rail engine made by Mercedes was available in most European markets. The 0.8-litre three-cylinder turbo diesel common rail engine made by Mercedes was available in most European markets.", "prediction 3": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-seater hatchback city car manufactured and marketed by the Smart division of Daimler AG, introduced in 1998, now in its third generation. The 999 cc I3 Mitsubishi 3B2 engine is offered in normally aspirated and turbo versions. German tuner company Brabus, in a joint venture with Smart, has developed a high powered version of the 1.0-litre turbo, producing, originally available only in Europe, but now available elsewhere. A small 0.8-litre three-cylinder turbo diesel common rail engine made by Mercedes was available in most European markets.", "prediction 4": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-seater hatchback city car manufactured and marketed by the Smart division of Daimler AG, introduced in 1998, now in its third generation. The 999 cc I3 Mitsubishi 3B2 engine for the Smart car was made by Mitsubishi in 2007. German tuner company Brabus, in a joint venture with Smart, developed a high powered version of the 1.0-litre turbo, producing, originally available only in Europe, but now available elsewhere. The 0.8-litre turbo diesel common rail engine for the Smart car was made by Mercedes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 182 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 228, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 332, "end": 449 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Smart Fortwo is a rear-engine, rear-wheel-drive, 2-seater city car manufactured and marketed by the Smart division of Daimler AG. The engine is made by Mitsubishi, Brabus and Mercedes. The 999 cc I3 Mitsubishi 3B2 engine is offered in normally aspirated and turbo versions. German tuner company Brabus, has developed a high powered version of the 1.0-litre turbo." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "How many episodes in a season of vampire diaries?", "passages": [ [ "The Vampire Diaries", "The Vampire Diaries\n\nThe Vampire Diaries is an American supernatural drama television series developed by Kevin Williamson and Julie Plec, based on the popular book series of the same name written by L. J. Smith.", "The series premiered on The CW on September 10, 2009, and concluded on March 10, 2017, airing 171 episodes over eight seasons.", "The pilot episode attracted the largest audience for The CW of any series premiere since the network began in 2006; the first season averaged 3.60 million viewers.", "It was the most-watched series on the network before being supplanted by \"Arrow\".", "The show has received numerous award nominations, winning four People's Choice Award and many Teen Choice Awards.", "On April 26, 2013, The CW officially announced that the spin-off \"The Originals\", which focuses on the Original family of vampires, had been ordered to series, and the show began airing during the 2013\u201314 American television season.", "On April 6, 2015, lead actress Nina Dobrev confirmed via Instagram that she and co-star Michael Trevino (who plays Tyler Lockwood) would be leaving the show after its sixth season.", "Dobrev returned to record a voiceover for the seventh-season finale.", "Trevino appeared as a guest star in season seven and returned for season 8." ], [ "The Vampire Diaries (season 8)", "The Vampire Diaries (season 8)\n\n\"The Vampire Diaries\", an American supernatural drama, was renewed for an eighth season by The CW on March 11, 2016.", "On July 23, 2016, the CW announced that the upcoming season would be the series' last and would consist of 16 episodes.", "The season premiered on October 21, 2016 and concluded on March 10, 2017.", "\n\nFilming for the season began on July 20, 2016.", "It was announced on July 23, 2016, that season 8 of \"The Vampire Diaries\" would be the series' last.", "The season would contain 16 episodes.", "Filming for the season ended on February 8, 2017.", "On January 26, 2017, it was announced that Nina Dobrev would return as Elena Gilbert in the series finale.", "At the end of the episode, \"It's Been a Hell of a Ride\" on February 24, 2017, it was revealed that Dobrev would reprise her role of Katherine Pierce as well." ], [ "The Vampire Diaries (season 1)", "The Vampire Diaries (season 1)\n\n\"The Vampire Diaries\" is an American supernatural horror romance television series created by Kevin Williamson based on the novels of the same name by author L. J. Smith.", "It was officially picked up for the 2009\u201310 season on May 19, 2009.", "It premiered on September 10, 2009, on The CW and received the highest ratings for a series premiere in the networks history scoring 4.91 million live viewers.", "The series focuses on the fictional town of Mystic Falls, Virginia, that is charged with supernatural history.", "It follows Elena Gilbert portrayed by Nina Dobrev as she begins to get over her parents' death and two vampire brothers, Stefan and Damon Salvatore, portrayed by Paul Wesley and Ian Somerhalder, respectively.", "Kayla Ewell portrayed Vicki Donovan for the first seven episodes until her character was killed off.", "Matt Davis was later cast as a history teacher in a recurring role to fill the void.", "He was later upgraded to series regular status.", "The season concluded on May 13, 2010, comprising 22 episodes.", "\n\nOn February 6, 2009, \"Variety\" announced that The CW had greenlit the pilot for \"The Vampire Diaries\" with Kevin Williamson and Julie", "Plec set as the head writers and executive producers." ] ], "gold": "The number of episodes in the American supernatural teen drama television series, Vampire Diaries, varies between seasons. Seasons 1-3 had 22 episodes each. Season 4 had 23 episodes. Seasons 5-7 had 22 episodes each, and season 8, the final season, had 16 episodes.", "prediction 1": "During the 2008-2009 season of The Vampire Diaries, there were eight seasons. Seasons 1 to 8 were made up of 20 episodes each. Seasons 9 to 12 were made up of 22 episodes each.", "prediction 2": "The Vampire Diaries is an American supernatural horror romance television series created by Kevin Williamson based on the popular book series of the same name written by L. J. Smith. The series premiered on The CW on September 10, 2009, and concluded on March 10, 2017, airing 171 episodes over eight seasons. The upcoming season of the series, which began airing on September 8, 2016, would contain 16 episodes. Filming for the season ended on February 8, 2017.", "prediction 3": "The Vampire Diaries is an American supernatural horror romance television series created by Kevin Williamson based on the popular book series of the same name written by L. J. Smith. The series premiered on The CW on September 10, 2009, and concluded on March 10, 2017, airing 171 episodes over eight seasons. The series premiered on October 21, 2016 and concluded on March 10, 2017.", "prediction 4": "The Vampire Diaries is an American supernatural horror romance television series developed by Kevin Williamson and Julie Plec, based on the popular book series of the same name written by L. J. Smith. There are 18 episodes in each season of The Vampire Diaries. Season 1 had 11 episodes, season 2 had 16 and season 3 had 13 episodes.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 86, "end": 92 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 109, "end": 126 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 135, "end": 142 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 11, "end": 20 }, { "error type": "Incoherent", "explanation": "", "start": 63, "end": 77 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2, 6 ] } ], "corrected-prediction": "The amount of episodes in a season vary. Season 1 of The Vampire Diaries had 22 episodes. Season 8 had 16 episodes." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where is the mercedes benz stadium located in atlanta?", "passages": [ [ "Mercedes-Benz Stadium", "Mercedes-Benz Stadium\n\nThe Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia.", "The home of the Atlanta Falcons of the National Football League (NFL) and Atlanta United FC of Major League Soccer (MLS), it replaced the now-demolished Georgia Dome, the Falcons' home stadium from 1992 through 2016.", "Mercedes-Benz stadium holds the record of the world's largest halo board and is one of few American football stadiums with retractable roofs, and one of five in the NFL that has such a roof.", "The stadium is owned by the state of Georgia through the Georgia World Congress Center Authority, and operated by AMB Group, the parent organization of the Falcons and Atlanta United.", "The total cost was estimated at $1.6 billion, as of June 2016.", "The stadium officially opened on August 26, 2017 with a Falcons preseason game against the Arizona Cardinals, despite the retractable roof system being incomplete at the time.", "Work on the retractable roof was completed on July 14, 2018.", "In May 2010, it was reported by multiple news outlets that the Atlanta Falcons were interested in demolishing the Georgia Dome and replacing it with a newly constructed open-air stadium.", "The team was pursuing a new stadium because of the team's desire to play outdoors, as well as Falcons team owner Arthur Blank's interest in hosting another Super Bowl." ] ], "gold": "Mercedes-Benz Stadium, also known as simply \"The Benz\" is a multi-purpose stadium located in Atlanta, Georgia, United States. The coordinates for the stadium are 33\u00b045\u203220\u2033N 84\u00b024\u203200\u2033W.", "prediction 1": "The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. It is the home of the Atlanta Falcons of the National Football League (NFL) and Atlanta United FC of Major League Soccer. It replaced the now-demolished Georgia Dome, the Falcons' home stadium from 1992 through 2016.\n", "prediction 2": "The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. It is the home of the Atlanta Falcons of the National Football League (NFL) and Atlanta United FC of Major League Soccer (MLS). The stadium replaces the now-demolished Georgia Dome, the Falcons' home stadium from 1992 through 2016.", "prediction 3": "The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. It replaces the now-demolished Georgia Dome, the Falcons' home stadium from 1992 through 2016.", "prediction 4": "In Atlanta, Georgia, the Mercedes-Benz Stadium is located in the Buckhead Athletic Commons, near Harbor-City-Highway 190. The stadium is owned by the state of Georgia through the Georgia World Congress Center Authority and operated by AMB Group, the parent organization of the Atlanta Falcons and Atlanta United FC.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 316 } ], "missing-info": [], "corrected-prediction": "The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What is the age limit for nysc in nigeria?", "passages": [ [ "National Youth Service Corps", "There is an \"orientation\" period of approximately three weeks spent in a military controlled \"camp\" away from family and friends.", "There is also a \"passing out ceremony\" at the end of the three weeks orientation camp after which corp members are posted to their Place of Primary Assignment (PPA).", "They are expected to work as full time staff at their PPA with exception of one working day devoted for the execution of community development service.", "After eleven months at their PPA, corp member are allowed a one month of vacation before their final passing out ceremony where they would be issued certificates of completion.", "Nigerian graduates are ineligible for employment in governmental establishments (and most private establishments) until they have completed the mandatory one year service or obtained the relevant exemptions.", "Graduates who are exempted from the service include those above the age of thirty and those with physical disability.", "During the service year, Corps members have the opportunity to learn the cultures of other people.", "The objectives of the National Youth Service Corps Scheme are clearly enumerated in Decree No.51 of 16th June 1993 as follows:\n\n", "The program has been met with criticism from a large portion of the country and complaints from Corps members about their remuneration.", "Several youth carrying out the NYSC program have been killed in the regions where they were sent due to religious, ethnic or political violence." ], [ "National Youth Service Corps", "National Youth Service Corps\n\nThe National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country.", "There is no military conscription in Nigeria, but since 1973 graduates of universities and later polytechnics have been required to take part in the National Youth Service Corps program for one year.", "This is known as national service year.", "Ahmadu Ali served as the first Director-General of the NYSC until 1975.", "The incumbent Director-General is Brig.", "Gen. Sule Zakari Kazaure.", "NYSC was created on 22 May, 1973 as an avenue for the reconciliation, reconstruction, and rebuilding of the nation after the civil war.", "It was established based on decree No. 24 that stated that the scheme was created \"with a view to the proper encouragement and development of common ties among the youths of Nigeria and the promotion of national unity\".", "Corps members (participants in the National Youth Service Scheme) are posted to states other than their state of origin where they are expected to mix with people from different ethnic groups, social and family backgrounds, and learn the culture of the indigenes in the location they are posted to.", "This action is aimed at bringing about unity in the country and help the youths appreciate other ethnic groups." ] ], "gold": "The National Youth Service Corps, or NYSC, is a program set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. To be eligible to participate in the compulsory one year service, a graduate must be below the age of 30 years upon graduation, or else they will be given a Certificate of Exemption, which is also equivalent to the NYSC Discharge Certificate. A graduate who graduated before 30 years but skipped the service year, will still be eligible to serve even if he wants at the age of 60, since his certificate of graduation was dated before he clocked 30 years of age. Graduates of the country can't request for exemption by themselves, unless they are disabled, have served in the military or paramilitary for a period of more than one year or have exceeded the age of 30 years when they graduated and part-time graduates are given an Exemption Letter, since they're not allowed to serve.", "prediction 1": "The National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. There is no military conscription in Nigeria, but graduates of universities and later polytechnics have been required to take part in the National Youth Service Corps program for one year. This is known as national service year.", "prediction 2": "The National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. There is no military conscription in Nigeria, but since 1973 graduates of universities and later polytechnics have been required to take part in the National Youth Service Corps program for one year. The age limit for NYSC in Nigeria is 22.", "prediction 3": "The National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. There is no military conscription in Nigeria, but since 1973 graduates of universities and later polytechnics have been required to take part in the National Youth Service Corps program for one year. This is known as national service year. Corps members are posted to states other than their state of origin where they are expected to mix with people from different ethnic groups, social and family backgrounds, and learn the culture of the indigenes in the location they are posted to.", "prediction 4": "The National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. There is no military conscription in Nigeria, but since 1973 graduates of universities and later polytechnics have been required to take part in the National Youth Service Corps program for one year. This is known as national service year. The age limit for the NYSC in Nigeria is 18 years, the upper age limit is 21 years and the lower age limit is 25 years.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The National Youth Service Corps (NYSC) is a scheme set up by the Nigerian government to involve Nigerian graduates in nation building and the development of the country. Graduates who are exempted from the service include those above the age of thirty and those with physical disability." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who sings where in the world is carmen sandiego?", "passages": [ [ "Rockapella", "Rockapella\n\nRockapella is an American a cappella musical group formed in 1986 in New York City.", "Their name is a portmanteau of \"rock\" and \"a cappella\".", "Rockapella sings original vocal music and a cappella covers of pop and rock songs; over time, their sound has evolved from high-energy pop and world music toward a more R&B-style sound.", "Rockapella originally found their biggest success in Japan throughout their career.", "In the 1990s, they are best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show \"Where in the World Is Carmen Sandiego?", "\", based on the classic computer game of the same name published by Broderbund.", "Rockapella has released 19 albums in Japan and the United States, and 3 compilation albums in Japan.", "The text \"All sounds provided by the voices and appendages of Rockapella\", the central idea of the band, has appeared on all of their CDs since the addition of their vocal percussionist.", "The founding members of Rockapella consisted of Brown University alumni Sean Altman, Elliott Kerman, Steve Keyes, and David Stix.", "They had each been in an a cappella group at Brown called High Jinks, but not all at the same time." ], [ "Where in the World Is Carmen Sandiego? (album)", "Where in the World Is Carmen Sandiego?", "(album)\n\nWhere in the World Is Carmen Sandiego?", "is the soundtrack to the PBS children's geography game show of the same name that ran between 1991 and 1996.", "It was released on November 10, 1992 by BMG Kidz, Fight Records and Zoom Express.", "Rockapella, the house band on the show throughout its entire run, sings six of the ten songs on the soundtrack.", "The group had been around for about 5.5 years before being contracted to work for the World gameshow.", "The producer of that series saw the group on the Spike Lee & Co.:", "Do It A Capella show and felt their sound could appeal to a young audience.", "The group were surprised by their success due to believing their target market were 20-40s as it had previously been.", "The group become unexpectedly popular in Japan.", "In November 1992, the group capitalised on their success by releasing Where in the World Is Carmen Sandiego?", "-", "The Album.", "Fans were able to get a preview of the album at a concert in Scera Shell.", "The content matches the Carmen Sandiego educational slant like Capital which lists every capital in the US.", "However, they also contain witty humour appealing to adults." ] ], "gold": "Where in the World Is Carmen Sandiego? is the soundtrack to the game show of the same name that ran from 1991 to 1995. Rockapella is an American a cappella musical group formed in 1986 in New York City. In the 1990s, they are best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show \"Where in the World Is Carmen Sandiego?\", based on the classic computer game of the same name developed and published by Broderbund. On the album, Where in the World Is Carmen Sandiego?, Rockapella, Urban Blight, The Persuasions, Tito Puente, Brian Dewan, Eileen Ivers, and the 3 Brave Woodsmen all sing.", "prediction 1": "Rockapella is an American a cappella musical group formed in 1986 in New York City. Rockapella sings original vocal music and a cappella covers of pop and rock songs, while their sound has evolved over time from high-energy pop and world music toward a more R&B-style sound. In the 1990s, they are best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show, Where in the World Is Carmen Sandiego?, based on the classic computer game of the same name published by Broderbund. The album was released on November 10, 1992 by BMG Kidz, Fight Records and Zoom Express. The group capitalised on their success by releasing Where in the World Is Carmen Sandiego? - The Album.", "prediction 2": "Rockapella are an American a cappella musical group formed in 1986 in New York City. They sing original vocal music and a cappella covers of pop and rock songs. The group is best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show Where in the World is Carmen Sandiego?, based on the classic computer game of the same name published by Broderbund. Rockapella sings six of the ten songs on the soundtrack to the PBS children's geography game show, which ran between 1991 and 1996.", "prediction 3": "Rockapella is an American a cappella musical group formed in 1986 in New York City. Their name is a portmanteau of \"rock\" and \"a cappella\". Rockapella sings original vocal music and a cappella covers of pop and rock songs. In the 1990s, they are best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show \"Where in the World Is Carmen Sandiego?\", based on the classic computer game of the same name published by Broderbund.", "prediction 4": "Rockapella is an American a cappella musical group formed in 1986 in New York City. Their name is a portmanteau of \"rock\" and \"a cappella\". Rockapella sings original vocal music and a cappella covers of pop and rock songs. Rockapella is best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show \"Where in the World Is Carmen Sandiego? \", based on the classic computer game of the same name published by Broderbund. The group has released 19 albums in Japan and 3 compilation albums in Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 538, "end": 626 }, { "error type": "Irrelevant", "explanation": "", "start": 627, "end": 730 } ], "missing-info": [], "corrected-prediction": "Rockapella is an American a cappella musical group formed in 1986 in New York City. In the 1990s, they are best remembered for their role as a vocal house band and resident comedy troupe on the PBS children's geography game show, Where in the World Is Carmen Sandiego?, based on the classic computer game of the same name published by Broderbund." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where is e3 2019 going to be held?", "passages": [ [ "Electronic Entertainment Expo 2018", "Electronic Entertainment Expo 2018\n\nThe Electronic Entertainment Expo 2018 (E3 2018) was the 24th Electronic Entertainment Expo, during which hardware manufacturers, software developers, and publishers from the video game industry presented new and upcoming products to the attendees, primarily retailers and members of the video game press.", "The event, organized by the Entertainment Software Association (ESA), took place in Los Angeles, California, US, from June 12\u201314, 2018, at the Los Angeles Convention Center, with many companies holding press conferences in the days prior.", "With the industry still in the middle of the eighth generation of video game consoles, no new hardware was introduced, and publishers and developers principally focused on new games to be released in 2018 and beyond.", "The event drew 69,200 attendees, the largest since 2005.", "E3 2018 took place from June 12 to 14, 2018 in the Los Angeles Convention Center.", "In the days prior, major publishers hold press conferences, typically as a live presentation in a large theater with streaming broadcast, or through streaming pre-recorded segments, highlighting the new games that are planned for the next year.", "During the show proper, developers and publishers run exhibition booths to allow industry members, the press, retail representatives, and the public to try out the new games and talk with the creators.", "Several side events were also held in nearby venues, including video game tournaments." ], [ "E3 BinckBank Classic", "E3 BinckBank Classic\n\nE3 BinckBank Classic, previously known as E3 Harelbeke, Harelbeke\u2013Antwerp\u2013Harelbeke and E3-Prijs Vlaanderen, is an annual road cycling race in Flanders, Belgium.", "The race starts and finishes in Harelbeke, covering 203 kilometres, mainly in the Flemish Ardennes.", "First raced in 1958, it is one of the more recently founded one-day classics, but has developed into a prestigious and desirable event.", "It is on the UCI World Tour calendar, as part of a series of cobbled classics in Belgium and Northern France in March and April.", "Belgian Tom Boonen holds the record of victories with five wins, trailed by cycling icon Rik Van Looy who won four times.", "E3 Harelbeke is held on the last Friday of March and marks the start of the Flemish Cycling Week, starting a fortnight of WorldTour racing on the cobbles and bergs of Flanders.", "It is the second in the series of cobbled races in Belgium and northern France that take place over a two-week period from the Wednesday after Milan\u2013San Remo until Paris\u2013Roubaix.", "E3 Harelbeke is the race that resembles the Tour of Flanders the most." ] ], "gold": "There are several events title \"E3 2019\". The Electronic Entertainment Expo 2019, E3 2019, was the 25th Electronic Entertainment Expo, during which hardware manufacturers, software developers, and publishers from the video game industry presented new and upcoming products to the attendees, primarily retailers and members of the video game press. The event, organized by the Entertainment Software Association (ESA), took place at the Los Angeles Convention Center from June 11\u201313, 2019. The 2019 E3 BinckBank Classic is a road cycling one-day race, scheduled to be held on 29 March 2019 in Belgium.", "prediction 1": "Electronic Entertainment Expo 2019 is an annual video game convention and road cycling race that takes place in Flanders, Belgium. E3 Harelbeke is held on the last Friday of March and marks the start of the Flemish Cycling Week, starting a fortnight of WorldTour racing on the cobbles and bergs of Flanders. The 2019 E3 Harelbeke is being held in Aalborg, Denmark, on April 8\u201310, 2021. The 2019 E3 Harelbeke is going to be held in Aalborg, Germany, on June 12\u201314, 2019 in Aals.", "prediction 2": "Electronic Entertainment Expo 2019 is a video game industry trade show that takes place between June 24 \u2013 27, 2019 in Los Angeles, California, US. The show, organized by the Entertainment Software Association (ESA), took place in Los Angeles, California, US, from June 12 \u2013 14, 2019, at the Los Angeles Convention Center. The E3 BinckBank Classic, previously known as E3 Harelbeke, Harelbeke\u2013Antwerp\u2013Harelbeke and E3-Prijs Vlaanderen, is a cycling race that starts and finishes in Harelbeke, covering 203 mainly in the Flemish Ardennes.", "prediction 3": "The Electronic Entertainment Expo 2019, also known as E3 2019 and E3 BinckBank Classic, is an annual road cycling race in Flanders, Belgium. The event was held from June 12 to 14, 2019, at the Los Angeles Convention Center.", "prediction 4": "Electronic Entertainment Expo 2019 is a video game industry event that is organized by the Entertainment Software Association and will take place in Los Angeles, California, US. Electronic Entertainment Expo 2019 is a game industry event that takes place in Paris, France, from June 11 to 15, 2019, and will be held at the Parc des Expositions de Paris. Electronic Entertainment Expo 2019 is also a road cycling race that starts and finishes in Harelbeke, covering 203 kilometres, mainly in the Flemish Ardennes.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 30, "end": 34 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 74, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 307 }, { "error type": "Unverifiable", "explanation": "", "start": 347, "end": 385 }, { "error type": "Redundant", "explanation": "The 2019 E3 Harelbeke is being held in Aalborg, Denmark, on April 8\u201310, 2021. The ", "start": 390, "end": 439 }, { "error type": "Unverifiable", "explanation": "", "start": 440, "end": 477 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Electronic Entertainment Expo 2018 is an annual video game convention. During which hardware manufacturers, software developers, and publishers from the video game industry presented new and upcoming products to the attendees, primarily retailers and members of the video game press. The event, organized by the Entertainment Software Association (ESA), took place in Los Angeles, California, US, from June 12\u201314, 2018, at the Los Angeles Convention Center. E3 BinckBank Classic is an annual road cycling race in Flanders, Belgium. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who did the voice of mumble in happy feet?", "passages": [ [ "Happy Feet Two", "Steve Irwin, who voiced Trev the elephant seal and an albatross, died of a stingray injury on September 4, 2006.", "Pink replaced Murphy's roles (Pink had already contributed a song \"Tell Me Something Good\" to the soundtrack of the first film).", "Brad Pitt and Matt Damon voiced the tiny krill, Will and Bill.", "Hank Azaria also signed on to voice The Mighty Sven.", "E.G. Daily, who played young Mumble in the previous film, played the vocals for Mumble's choreophobic son Erik and the daughter of Miss Viola, Boadicea, as well as additional voices.", "Sof\u00eda Vergara appears in the film as a new character.", "There is a live action scene in the movie as in the first \"Happy Feet\".", "Mitchell Hicks signed up as the movie's choreographer.", "The DVD, Blu-ray, and 3D Blu-ray release of \"Happy Feet Two\" were released on March 13, 2012 from Warner Home Video.", "The film grossed $64 million in the United States along with $86 million in other territories, for a worldwide total of $150.4 million.", "Produced on a budget of $135 million, the film ended up losing the studio around $40 million.", "On its opening weekend, \"Happy Feet Two\" earned $21,237,068 while playing on 3,606 screens." ], [ "Happy Feet", "Happy Feet\n\nHappy Feet is a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller.", "It stars Elijah Wood, Robin Williams, Brittany Murphy, Hugh Jackman, Nicole Kidman, Hugo Weaving, and E.G. Daily.", "It was produced at Sydney-based visual effects and animation studio Animal Logic for Warner Bros., Village Roadshow Pictures, and Kingdom Feature Productions, and was released in North American theaters on November 17, 2006.", "It is the first animated film produced by Kennedy Miller and Animal Logic.", "Though primarily an animated film, the film does incorporate motion capture of live action humans in certain scenes.", "The film was simultaneously released in both conventional theatres and in IMAX 2D format.", "The studio had hinted that a future IMAX 3D release was a possibility.", "However, Warner Bros., the film's production company, was on too tight a budget to release Happy Feet in IMAX digital 3D. \"Happy Feet\" received generally positive reviews from critics, and won the Academy Award for Best Animated Feature, a first for Warner Bros., as well as the BAFTA Award for Best Animated Film.", "It was nominated for the Annie Award for Best Animated Feature and the Saturn Award for Best Animated Film.", "A sequel, \"Happy Feet Two\", was released on November 18, 2011." ], [ "Happy Feet", "Every emperor penguin sings a unique song called a \"heartsong\" to attract a mate.", "If the male penguin's heartsong matches the female's song, the two penguins mate.", "Norma Jean, a female penguin, falls for Memphis, a male penguin and they become mates.", "They lay an egg, which is left in Memphis' care, while Norma Jean leaves with the other females to fish.", "While the males struggle through the harsh winter, Memphis briefly drops the egg.", "As a result, their son, Mumble, is unable to sing, but he can tap dance instead.", "Nevertheless, he is enamored with Gloria, a female penguin who is regarded as the most talented of her age.", "One day, Mumble encounters a group of hostile skua, with a leader who is tagged with a yellow band, which he says is from an alien abduction.", "Mumble narrowly escapes the hungry birds by falling into a crevice.", "Now a young adult, Mumble is frequently ridiculed by the elders.", "After escaping from a leopard seal attack, Mumble befriends a group of Adelie penguins called \"the Amigos\", who embrace Mumble's dance moves and assimilate him into their group.", "After seeing a hidden human excavator in an avalanche, they opt to ask Lovelace, a rockhopper penguin, about its origin." ] ], "gold": "Happy Feet is a 2006 computer-animated musical comedy film directed, produced, and co-written by George Miller and has a 2011 sequel called Happy Feet Two. In the film, every emperor penguin sings a unique song to attract a mate, but the character of Mumble cannot sing, only tap dance. In the film, the voice of baby Mumble is acted out by American actress and singer E.G. Daily, who also voiced Tommy in Rugrats, Buttercup in Powerpuff Girls, and Bamm-Bamm Rubble in the Flintstones. The voice of adult Mumble, in both the original movie and its sequel, is performed by American actor Elijah Wood, who is best known for his role in the Lord of the Rings trilogy.", "prediction 1": "Happy Feet was a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller. The children's film's voice actor was Brittany Murphy, who voiced Mumble in the original film. The character's voice was voiced by E.G. Daily, who was the young Mumble in the original film.", "prediction 2": "Happy Feet is a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller. Brittany Murphy played the role of Mumble in the first film. E.G. Daily, who played young Mumble in the previous film, played the vocals for Mumble's choreophobic son Erik and the daughter of Miss Viola, Boadicea, as well as additional voices.", "prediction 3": "Happy Feet is a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller. Brittany Murphy played the role of Mumble in the first Happy Feet. E.G. Daily, who played young Mumble in the previous film, played the vocals for Mumble's choreophobic son Erik and the daughter of Miss Viola, Boadicea, as well as additional voices. Hugo Weaving also appeared in the sequel, Happy Feet Two, which was released on November 18, 2011.", "prediction 4": "Happy Feet is a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller. Brittany Murphy did the voice of Mumble in Happy Feet Two. E.G. Daily, who played young Mumble in the previous film, played the vocals for Mumble's choreophobic son Erik and the daughter of Miss Viola, Boadicea, as well as additional voices. Hugo Weaving did the voice of Mumble in Happy Feet Two. E.G. Daily, who played the role of Mumble, did the voice of Mumble.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 140, "end": 234 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Happy Feet was a 2006 Australian-American computer-animated musical family comedy film directed, produced, and co-written by George Miller. A sequel, \"Happy Feet Two\", was released on November 18, 2011. In the film, every emperor penguin sings a unique song to attract a mate, but the character of Mumble cannot sing, only tap dance. The character's voice was voiced by E.G. Daily, who was the young Mumble in the original film." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who plays max on one day at a time?", "passages": [ [ "One Day at a Time", "One Day at a Time\n\nOne Day at a Time is an American sitcom that aired on CBS from December 16, 1975, until May 28, 1984.", "It starred Bonnie Franklin as a divorced mother raising two teenaged daughters in Indianapolis.", "The daughters were played by Mackenzie Phillips and Valerie Bertinelli.", "The series was created by Whitney Blake and Allan Manings, a husband-and-wife writing duo who were both actors in the 1950s and 1960s.", "The series was based on Whitney Blake's own life as a single mother, raising her three children (including future actress Meredith Baxter) after her divorce from her first husband.", "Ann Romano, a divorced mother, moves from their home in Logansport, Indiana, to Indianapolis with her daughters, the rebellious Julie and the wisecracking Barbara.", "Ann frequently struggles with maintaining her role as mother while affording her daughters the freedom she never had as a young woman.", "Ann begins dating her divorce lawyer, David Kane (Richard Masur).", "They become engaged and call it off on their wedding day, when David says he wants kids, but Ann does not.", "Dwayne Schneider, the building's quirky superintendent (most often referred to only by his last name), provides usually unwanted advice to the tenants." ], [ "Michael Lembeck", "Michael Lembeck\n\nMichael Lembeck (born June 25, 1948) is an American actor and television and film director.", "Lembeck was born in Brooklyn, New York, the son of Caroline Dubs and Harvey Lembeck, an actor and comedian.", "He began acting in the late 1960s and directing in the 1970s.", "His most notable acting role was as Julie Cooper (Mackenzie Phillips)'s husband, Max Horvath, on the sitcom \"One Day at a Time\".", "He played newscaster Clete Meizenheimer on the series \"Mary Hartman, Mary Hartman\".", "In 1975, he appeared on \"Barney Miller\" in the episode \"Hair\" as Officer Guardeno.", "He also played \"Kaptain Kool\" of \"Kaptain Kool and the Kongs\" on \"The Krofft Supershow\" from 1976 to 1978.", "He is also known for his role as Vinnie Fazio in \"The Boys in Company C\" in 1978.", "He was a member of the cast of the 1985\u20131986 situation comedy \"Foley Square\".", "He appeared with his father, actor Harvey Lembeck, in an episode of \"The Partridge Family\" in 1971.", "Lembeck has had collaborations with the late actor Peter Boyle in both \"The Santa Clause 2\", and its sequel \"\"." ], [ "One Day at a Time (2017 TV series)", "One Day at a Time (2017 TV series)\n\nOne Day at a Time is an American comedy web television series based on Norman Lear's 1975\u20131984 sitcom of the same name.", "It was Lear\u2019s company, Act III Productions, that approached Sony with the idea of reimagining the original series with a Latino family.", "It was developed by Gloria Calderon Kellett and Mike Royce, with Lear and his producing partner, Brent Miller as executive producers.", "The series features an ensemble cast starring Justina Machado, Todd Grinnell, Isabella Gomez, Marcel Ruiz, Stephen Tobolowsky, and Rita Moreno.", "The show revolves around a Cuban-American family living in Los Angeles, focusing on a single mom who is an Army veteran dealing with PTSD, her kids and her Cuban mother.", "The re-imagination of the original CBS sitcom tackles important issues like mental illness, immigration, sexism, homophobia, and racism that face Latinos living in the United States.", "The first season consisted of thirteen episodes and it was released on January 6, 2017.", "On March 4, 2017, Netflix renewed the series for a second season.", "On January 26, 2018, the second season premiered on the streaming service with thirteen episodes.", "On March 26, 2018, a third season was ordered." ] ], "gold": "One Day at a Time is an American television sitcom that aired on CBS from December 16, 1975, to May 28, 1984. American actor and television and film director Michael Lembeck played Max on the series. The 2017 series, One Day at a Time, is an American sitcom based on the 1975 series of the same title. Arthur Edward Quinn, an American actor, model and musician, played Max on the 2017 series.", "prediction 1": "Max Horvath is a character on the American sitcom One Day at a Time. Max is played by Mackenzie Phillips. In the 2017 reimagining of the sitcom, actor Michael Lembeck plays Max, Julie's husband.", "prediction 2": "One Day at a Time is an American sitcom that aired on CBS from December 16, 1975, until May 28, 1984. Max Horvath is played by Max Fletcher, Marc Jacobs, and Todd Grinnell. American actor and television and film director Michael Lembeck plays Max Horvath.", "prediction 3": "One Day at a Time is an American sitcom that aired on CBS from December 16, 1975, until May 28, 1984. It stars Bonnie Franklin as a divorced mother raising two teenaged daughters in Indianapolis. Max Horvath, played by Mackenzie Phillips, is the character played by American actor and television and film director Michael Lembeck.", "prediction 4": "One Day at a Time is an American sitcom that aired on CBS from December 16, 1975, until May 28, 1984. It starred Bonnie Franklin as a divorced mother raising two teenaged daughters in Indianapolis. The daughters were played by Mackenzie Phillips and Valerie Bertinelli. American actor and television and film director Michael Lembeck played Max Horvath on the original sitcom. In the 2017 version, Lembeck played Max, while Todd Grinnell played Max.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 69, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 68 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 106, "end": 144 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "One Day at a Time is an American television sitcom that aired on CBS from December 16, 1975, to May 28, 1984. American actor and television and film director Michael Lembeck played Max on the series." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "How many books left in game of thrones?", "passages": [ [ "A Song of Ice and Fire", "A Song of Ice and Fire\n\nA Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin.", "He began the first volume of the series, \"A Game of Thrones,\" in 1991, and it was published in 1996.", "Martin, who initially envisioned the series as a trilogy, has published five out of a planned seven volumes.", "The fifth and most recent volume of the series published in 2011, \"A Dance with Dragons\", took Martin six years to write.", "He is currently writing the sixth novel, \"The Winds of Winter\".", "\"A Song of Ice and Fire\" takes place on the fictional continents Westeros and Essos.", "The point of view of each chapter in the story is a limited perspective of a range of characters growing from nine, in the first novel, to 31 characters by the fifth novel.", "Three main stories interweave: a dynastic war among several families for control of Westeros, the rising threat of the supernatural Others in the northernmost reaches of Westeros, and the ambition of Daenerys Targaryen, the deposed king's exiled daughter, to assume the Iron Throne.", "Martin's inspirations included the Wars of the Roses and the French historical novels \"The Accursed Kings\" by Maurice Druon." ], [ "A Song of Ice and Fire", "However, planned release dates were repeatedly pushed back.", "Meanwhile, HBO acquired the rights to turn \"A Song of Ice and Fire\" into a dramatic series in 2007 and aired the first of ten episodes covering \"A Game of Thrones\" in April 2011.", "With around 1600 pages in manuscript length, \"A Dance with Dragons\" was eventually published in July 2011 after six years of writing, longer in page count and writing time than any of the preceding four novels.", "The story of \"A Dance with Dragons\" catches up with and goes beyond \"A Feast for Crows\" around two-thirds into the book, but nevertheless covers less story than Martin had intended, omitting at least one planned large battle sequence and leaving several character threads ending in cliff-hangers.", "Martin attributed the delay mainly to his untangling \"the Meereenese knot\", which the interviewer understood as \"making the chronology and characters mesh up as various threads converged on [Daenerys]\".", "Martin also acknowledged spending too much time on rewriting and perfecting the story, but soundly rejected the theories of some of his critics that he had lost interest in the series or would bide his time to make more money.", "Martin believes the last two volumes of the series will be big books of 1500 manuscript pages each." ] ], "gold": "A Game of Thrones is the first book in the A Song of Fire and Ice series by George R.R. Martin. Martin has currently published five of the seven books in this series and has two books remaining. The fifth and most recent book in the series, A Dance with Dragons, was published in 2011 and took Martin six years to write. He is currently writing the sixth novel in the series, The Winds of Winter. A seventh novel, A Dream of Spring, is planned.", "prediction 1": "The Game of Thrones series is a fictionalized saga that began with the first book in the series, A Game of Thrones, in 1991 and concluded with the fifth book in the series, A Dance with Dragons, in 2011. The series has seven volumes, with the last two volumes being big books, each of 1500 manuscript pages.", "prediction 2": "A Song of Ice and Fire is the fifth and most recent volume of A Game of Thrones. The last two volumes will be big books of 1500 manuscript pages each.", "prediction 3": "A Game of Thrones is a series of epic fantasy novels written by the American novelist and screenwriter George R. R. Martin. The series has eight books in total. The last two books are A Dance with Dragons and The Winds of Winter. Martin believes the last two volumes of the series will be big books of 1500 manuscript pages each.", "prediction 4": "There are currently seven volumes of the HBO series A Game of Thrones. The last two are thought to be big books. A Song of Ice and Fire is part of the series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 123 }, { "error type": "Unverifiable", "explanation": "", "start": 128, "end": 203 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "A Game of Thrones is the first book in the A Song of Fire and Ice series by George R.R. Martin. Martin, who initially envisioned the series as a trilogy, has published five out of a planned seven volumes. The fifth and most recent volume of the series published in 2011, \"A Dance with Dragons\", took Martin six years to write. He is currently writing the sixth novel, \"The Winds of Winter\"" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Which state has the most coastline in the us?", "passages": [ [ "East Coast of the United States", "East Coast of the United States\n\nThe East Coast of the United States, also known as the Eastern Seaboard, the Atlantic Coast, and the Atlantic Seaboard, is the coastline along which the Eastern United States meets the North Atlantic Ocean.", "The coastal states that have shoreline on the Atlantic Ocean are, from north to south, Maine, New Hampshire, Massachusetts, Rhode Island, Connecticut, New York, New Jersey, Delaware, Maryland, Virginia, North Carolina, South Carolina, Georgia, and Florida.", "The place name \"East Coast\" derives from the idea that the contiguous 48 states are defined by two major coastlines, one at the western edge and one on the eastern edge.", "Other terms for referring to this area include the \"Eastern Seaboard\" (\"seaboard\" being American English for coast), \"Atlantic Coast\", and \"Atlantic Seaboard\" (because the coastline lies along the Atlantic Ocean).", "The fourteen states that have a shoreline on the Atlantic Ocean are, from north to south, the U.S. states of Maine, New Hampshire, Massachusetts, Rhode Island, Connecticut, New York, New Jersey, Delaware, Maryland, Virginia, North Carolina, South Carolina, Georgia, and Florida.", "In addition, Pennsylvania and the District of Columbia border tidal arms of the Atlantic (the Delaware River and the Potomac River, respectively)." ], [ "West Coast of the United States", "West Coast of the United States\n\nThe West Coast or Pacific Coast is the coastline along which the continental Western United States meets the North Pacific Ocean.", "As a region, this term most often refers to the coastal states of California, Oregon, Washington, and Alaska.", "More specifically, it refers to an area defined on the east by the Alaska Range, Cascade Range, Sierra Nevada, and Mojave Desert, and on the west by the Pacific Ocean.", "The United States Census groups the five states of California, Oregon, Washington, Alaska, and Hawaii together as the Pacific States division.", "As of the 2010 Census, the estimated population of the Census Bureau's Pacific Region was approximately 47.8 million \u2013 about 15.3% of U.S. population.", "The largest city on the west coast of the United States is Los Angeles.", "Major cities and metropolitan areas on the West Coast include (from north to south):\n\nHowever, of these aforementioned cities and metropolitan areas, only Los Angeles, Long Beach, San Francisco, and San Diego are directly on the open Pacific Ocean." ], [ "California", "California\n\nCalifornia is a state in the Pacific Region of the United States.", "With 39.5 million residents, California is the most populous U.S. state and the third-largest by area.", "The state capital is Sacramento.", "The Greater Los Angeles Area and the San Francisco Bay Area are the nation's second- and fifth-most populous urban regions, with 18.7 million and 8.8 million residents respectively.", "Los Angeles is California's most populous city, and the country's second-most populous, after New York City.", "California also has the nation's most populous county, Los Angeles County; its largest county by area, San Bernardino County; and its second most densely populated city and fifth most densely populated county, San Francisco.", "California's $2.9 trillion economy is larger than that of any other state, larger than those of Texas and Florida combined, and the largest sub-national economy in the world.", "If it were a country, California would be the 5th largest economy in the world (larger than the U.K., France, or India), and the 36th most populous .", "The Greater Los Angeles Area and the San Francisco Bay Area are the nation's second- and third-largest urban economies ($1.253 trillion and $878 billion respectively ), after the New York City metropolitan area." ] ], "gold": "In the United States, 30 states have a coastline: 23 with a coastline on the Arctic Ocean, Atlantic Ocean (including the Gulf of Mexico), and/or Pacific Ocean, and eight with a Great Lakes shoreline. In the continental US, Alaska has the most coastline. In the contiguous US, Florida has the most coastline.", "prediction 1": "The East Coast of the United States, also known as the Eastern Seaboard, the Atlantic Coast, and the Atlantic Seaboard, is the coastline along which the Eastern United States meets the North Atlantic Ocean. The westernmost state on the east coast of the United States is California, followed by Oregon, Washington, and Alaska, and the northernmost state is New York.", "prediction 2": "The East Coast of the United States, also known as the Eastern Seaboard, the Atlantic Coast, and the Atlantic Seaboard, is the coastline along which the Eastern United States meets the North Atlantic Ocean. The 14 states that have shoreline on the Atlantic Ocean are, from north to south, the U.S. states of Maine, New Hampshire, Massachusetts, Rhode Island, Connecticut, New York, New Jersey, Delaware, Maryland, Virginia, North Carolina, South Carolina, and Florida. The West Coast or Pacific Coast is the coastline along which the continental Western United States meets the North Pacific Ocean.", "prediction 3": "The East Coast of the United States, also known as the Eastern Seaboard, the Atlantic Coast, and the Atlantic Seaboard, is the coastline along which the Eastern United States meets the North Atlantic Ocean. The fourteen states that have a shoreline on the Atlantic Ocean are, from north to south, the U.S. states of Maine, New Hampshire, Massachusetts, Rhode Island, Connecticut, New York, New Jersey, Delaware, Maryland, Virginia, North Carolina, South Carolina, Georgia, and Florida. The West Coast or Pacific Coast is the coastline along which the continental Western United States meets the North Pacific Ocean. California is the most populous state and the second-largest by area. The largest city on the Pacific Coast is San Diego, with 29.5 million residents, and 5 million residents.", "prediction 4": "The East Coast of the United States, also known as the Eastern Seaboard, the Atlantic Coast, and the Atlantic Seaboard, is the coastline along which the Eastern United States meets the North Atlantic Ocean. The fourteen states that have shoreline on the Atlantic Ocean are, from north to south, the U.S. states of Maine, New Hampshire, Massachusetts, Rhode Island, Connecticut, New York, New Jersey, Delaware, Maryland, Virginia, North Carolina, South Carolina, Georgia, and Florida. As a region, this term most often refers to the coastal states of California, Oregon, Washington, Washington, and Alaska.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 366 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": " Fourteen states have a shoreline on the Atlantic Ocean. Five states have a coastline on the Pacific Ocean." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Little house on the prairie christmas blizzard episode?", "passages": [ [ "Little House on the Prairie", "Little House on the Prairie\n\nThe \"Little House\" Books is a series of American children's novels written by Laura Ingalls Wilder, based on her childhood and adolescence in the American Midwest (Wisconsin, Kansas, Minnesota, South Dakota, and Missouri) between 1870 and 1894.", "Eight of the novels were completed by Wilder, and published by Harper & Brothers.", "The appellation \"Little House\" books comes from the first and third novels in the series of eight published in her lifetime.", "The second novel was about her husband's childhood.", "The first draft of a ninth novel was published posthumously in 1971 and is commonly included in the series.", "The \"Little House\" books have been adapted for stage or screen more than once, most successfully as the American television series \"Little House on the Prairie\", which ran from 1974 to 1983.", "As well as an anime, and many different kinds of books, such as cookbooks, there are also many licensed objects to buy that are representative of the books.", "A tenth book, the non-fiction \"On the Way Home\", is Laura Ingalls Wilder's diary of the years after 1894, when she, her husband and their infant daughter moved from De Smet, South Dakota to Mansfield, Missouri, where they settled permanently.", "It was published in 1962 and includes commentary by Rose Wilder Lane." ], [ "The Long Winter (novel)", "The Long Winter (novel)\n\nThe Long Winter is a historical fiction children's novel written by Laura Ingalls Wilder and published in 1940, the sixth of nine books in her \"Little House\" series.", "It is set in southeastern Dakota Territory during the severe winter of 1880\u20131881, when she turned 14 years old.", "The novel was one runner-up for the Newbery Medal in 1941, as all the fourth to eighth \"Little House\" books were from 1938 to 1943.", "In retrospect they are called Newbery Honor Books.", "On a hot August day in the 1880s, at the Ingalls' homestead in Dakota Territory, Laura offers to help Pa stack hay to feed their stock in the winter.", "As they work, she notices a muskrat den in the nearby Big Slough.", "Upon inspecting it, Pa notes that its walls are the thickest he has ever seen and fears the upcoming winter will be a hard one.", "In mid-October, the Ingalls wake to an unusually early blizzard howling around their poorly insulated claim shanty.", "Soon afterward, Pa receives another warning from an unexpected source: an old Native American man comes to the general store in town to warn the white settlers that there will be seven months of blizzards.", "Pa decides to move his family into his store building in town for the winter." ], [ "Mid-December 2007 North American winter storms", "Mid-December 2007 North American winter storms\n\nThe Mid-December 2007 North American winter storms were a series of winter storms that affected much of central and eastern North America, from December 8 to December 18, 2007.", "The systems affected areas from Oklahoma to Newfoundland and Labrador with freezing rain, thunderstorms, sleet, snow, damaging winds, and blizzard-like conditions in various areas.", "The first two storms produced copious amounts of ice across the Midwestern United States and Great Plains from December 8 to December 11, knocking out power to approximately 1.5\u00a0million customers from Oklahoma north to Iowa.", "The second storm moved northeast, producing heavy snow across New York and New England.", "A third storm was responsible for a major winter storm from Kansas to the Canadian Maritimes, bringing locally record-breaking snowfalls to Ontario, an icestorm across the Appalachians, and thunderstorms and tornadoes to the Southeastern United States.", "The ice storms were responsible for at least 22 deaths across three states.", "At least 25 additional deaths were blamed on the December 15\u201316 Midwest and Eastern snowstorm, and its aftermath across six US States and three Canadian provinces; 1 additional death was caused by the severe weather outbreak in the Southeast.", "Much of the affected areas were already hit by a significant winter storm during the weekend of December 1 and December 2." ] ], "gold": "Season 3 Episode 11 of Little House on the Prairie, titled Blizzard, originally aired on Januare 3, 1977. The Little House on the Prairie television series was based on The Little House Books by Laura Ingles Wilder. One of the books in the Little House series, The Long Winter, is an autobiographical children's novel that is set in the southeastern Dakota Territory during the severe winter of 1880 to1881, when Wilder turned 14 years old.", "prediction 1": "Little House on the Prairie aired a blizzard episode on Christmas Day, December 24, 2007.", "prediction 2": "The Christmas episode of the American television series Little House on the Prairie depicts a blizzard in mid-October, the episode of the show is titled \"The Christmas Blizzard\".", "prediction 3": "In the episode Little House on the Prairie's Christmas blizzard episode, the episode The Christmas Story, Pa wakes up to an unusually early blizzard howling around their poorly insulated claim shanty. Soon afterward, Pa receives another warning from an unexpected source: an old Native American man comes to the general store in town to warn the white settlers that there will be seven months of blizzards. Pa decides to move his family into his store building in town for the winter. Episode 2 of the series, was set in southeastern Dakota Territory during the severe winter of 1880\u20131881, when she turned 14 years old. Episode 3 of the blizzard was broadcast on the American television series.", "prediction 4": "Little House on the Prairie is an American television series that aired from 1974 to 1983, based on the children's book series Little House, as well as a series of American television shows that ran from 1974 to 1983. In the Christmas episode of the show, the blizzard in the house was caused by Mid-December 2007 North American winter storms.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 89 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "One of the books in the Little House series, The Long Winter, is an autobiographical children's novel that is set in the southeastern Dakota Territory during the severe winter of 1880 to1881, when Wilder turned 14 years old." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who prepared the first draft constitution of india?", "passages": [ [ "Constitution of India", "Benegal Narsing Rau, a civil servant who became the first Indian judge in the International Court of Justice and was president of the United Nations Security Council, was appointed as the assembly's constitutional adviser in 1946.", "Responsible for the constitution's general structure, Rau prepared its initial draft in February 1948.", "At 14 August 1947 meeting of the assembly, committees were proposed.", "Rau's draft was considered, debated and amended by the eight-person drafting committee, which was appointed on 29 August 1947 with B. R. Ambedkar as chair.", "A revised draft constitution was prepared by the committee and submitted to the assembly on 4 November 1947.", "While deliberating the revised draft constitution, the assembly moved, discussed and disposed off 2,473 amendments out of a total of 7,635.", "Before adopting the constitution, the assembly held eleven sessions in 165 days.", "On 26 November 1949 it adopted the constitution, which was signed by 284 members.", "The day is celebrated as National Law Day, or Constitution Day.", "The assembly's final session convened on 24 January 1950.", "Each member signed two copies of the constitution, one in Hindi and the other in English.", "The original constitution is hand-written, with each page decorated by artists from Shantiniketan including Beohar Rammanohar Sinha and Nandalal Bose." ], [ "Constitution of India", "Constitution of India\n\nThe Constitution of India (IAST: ) is the supreme law of India.", "The document lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens.", "It is the longest written constitution of any country on earth.", "B. R. Ambedkar, chairman of the drafting committee, is widely considered to be its chief architect.", "It imparts constitutional supremacy (not parliamentary supremacy, since it was created by a constituent assembly rather than Parliament) and was adopted by its people with a declaration in its preamble.", "Parliament cannot override the constitution.", "It was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950.", "The constitution replaced the Government of India Act, 1935 as the country's fundamental governing document, and the Dominion of India became the Republic of India.", "To ensure constitutional autochthony, its framers repealed prior acts of the British parliament in Article 395.", "India celebrates its constitution on 26 January as Republic Day.", "The constitution declares India a sovereign, socialist, secular, democratic republic, assuring its citizens justice, equality and liberty, and endeavours to promote fraternity.", "Most of the Indian subcontinent was under British rule from 1857 to 1947." ], [ "B. R. Ambedkar", "B. R. Ambedkar\n\nBhimrao Ramji Ambedkar (14 April 1891\u00a0\u2013 6 December 1956), popularly known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), while also supporting the rights of women and labour.", "He was independent India's first law and justice minister, the principal architect of the Constitution of India, and a founding father of the Republic of India.", "Ambedkar was a prolific student earning doctorates in economics from both Columbia University and the London School of Economics and gained a reputation as a scholar for his research in law, economics, and political science.", "In his early career he was an economist, professor, and lawyer.", "His later life was marked by his political activities; he became involved in campaigning and negotiations for India's independence, publishing journals, advocating political rights and social freedom for Dalits, and contributing significantly to the establishment of the state of India.", "In 1956, he converted to Buddhism initiating mass conversions of Dalits.", "In 1990, the Bharat Ratna, India's highest civilian award, was posthumously conferred upon Ambedkar.", "Ambedkar's legacy includes numerous memorials and depictions in popular culture." ] ], "gold": "The Constitution of India is the supreme law of India. The principal preparer of the first draft of the constitution of India was Bhimrao Ramji Ambedkar, an Indian jurist, economist, politician and social reformer, who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (Dalits). A revised draft constitution was prepared by the committee and submitted to the assembly on 4 November 1947.Dr B. R. Ambedkar in his concluding speech in Constituent Assembly on November 25, 1949.", "prediction 1": "The Constitution of India is the supreme law of India and lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens. Benegal Narsing Rau prepared the first draft of the constitution in February 1948. The constitution was considered, debated and amended by the eight-person drafting committee, which was appointed on 29 august 1947 with B. R. Ambedkar as chair.", "prediction 2": "The first draft constitution of India was prepared by Benegal Narsing Rau, a civil servant who became the first Indian judge in the International Court of Justice and was president of the United Nations Security Council. After this initial draft, the constitution was considered, debated and amended by the eight-person drafting committee, which was appointed on 29 August 1947 with B. R. Ambedkar as chair. The revised draft constitution was submitted to the assembly on 4 November 1947. The constitution was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950. It was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950. The first constitution was sent to the Constituent Assembly of India on 26 November 1949, and became effective on 26 January 1950.", "prediction 3": "The constitution of India is the supreme law of India and is the most widely recognized document in the world. It was prepared by Benegal Narsing Rau, a civil servant who became the first Indian judge in the International Court of Justice and was president of the United Nations Security Council. In February 1948, Rau prepared the initial draft of the constitution. B. R. Ambedkar, chairman of the eight-member drafting committee, prepared a revised draft constitution and submitted it to the assembly on 4 November 1947. The assembly passed it on 26 November 1949 and it became effective on 26 January 1950.", "prediction 4": "The Constitution of India is the supreme law of India. Benegal Narsing Rau, a civil servant who became the first Indian judge in the International Court of Justice and was president of the United Nations Security Council, was appointed as the assembly's constitutional adviser in 1946. Responsible for the constitution's general structure, Rau prepared the initial draft in February 1948. The draft was considered, debated and amended by the eight-person drafting committee, which was appointed on 29 August 1947 with B. R. Ambedkar as chair. A revised draft constitution was prepared by the committee and submitted to the assembly on 4 November 1947.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 517 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Constitution of India is the supreme law of India. Bhimrao Ramji Ambedkar, an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), was the principal architect of the Constitution of India. Benegal Narsing Rau prepared the first draft of the constitution. A revised draft constitution was prepared by the committee and submitted to the assembly on 4 November 1947. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who won the women's curling in sochi?", "passages": [ [ "Curling at the 2014 Winter Olympics \u2013 Women's tournament", "Curling at the 2014 Winter Olympics \u2013 Women's tournament\n\nThe women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014.", "Ten nations competed in the round robin preliminary round, and the top four nations at the conclusion of the round robin qualified for the medal round.", "South Korea made their Olympic debut in curling.", "A new Olympic record was established when Great Britain scored seven points in one end against the United States.", "Great Britain also equalled the record for total points scored in one game, scoring twelve points against the United States and against Japan.", "Canada, skipped by Jennifer Jones, became the first women's rink to go through an Olympic tournament undefeated.", "Great Britain, by winning the bronze medal became the youngest rink to ever step onto an Olympic curling podium.", "The teams are listed as follows:\nAll draw times are listed in Moscow Time (UTC+4)." ], [ "Anna Hasselborg", "Anna Hasselborg\n\nAnna Ellinor Hasselborg (born 5 May 1989) is a Swedish curler from Stockholm.", "She is the 2018 Olympic Champion in women's curling, and a former World Junior Champion skip.", "Hasselborg made her international debut at the 2008 European Mixed Curling Championship, playing third for Niklas Edin, winning a bronze medal.", "In 2009, Hasselborg played in her first World Juniors, skipping Sweden to a 6th-place finish.", "At the 2010 World Junior Curling Championships, Hasselborg upset the Canadian rink skipped by Rachel Homan in the final by a score of 8-3.", "Hasselborg skipped Sweden at the 2013 Winter Universiade, leading her country to a 5th-place finish.", "Hasselborg has now graduated from the junior level and skips her team on the World Curling Tour.", "She has won three tour events in her career, the 2011 Glynhill Ladies International, the 2016 Oakville OCT Fall Classic, and the 2016 Stockholm Ladies Curling Cup.", "Hasselborg skipped the Swedish national women's team at the 2014 European Curling Championships, leading her team to a 5th-place finish.", "In March 2018, she skipped the Swedish national women's team at the 2018 Ford World Women's Curling Championship, falling to the Canadian team in an extra end to take home the silver medal." ] ], "gold": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. Canada won the gold medal with a team consisting of Jennifer Jones, Kaitlyn Lawes, Jill Officer, Dawn McEwen, and Kirsten Wall. Sweden won the silver medal, with a team consisting of Maria Prytz, Christina Bertrup, Maria Wennerstr\u00f6m, Margaretha Sigfridsson, and Agnes Knochenhauer. Great Britain won the bronze medal, with a team consisting of Eve Muirhead, Anna Sloan, Vicki Adams, Claire Hamilton, and Lauren Gray.", "prediction 1": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. Ten nations competed in the round robin preliminary round, and the top four nations at the conclusion of the round robin qualified for the medal round. Great Britain, by winning the bronze medal, became the youngest rink to ever step onto an Olympic curling podium. Anna Hasselborg, the 2018 Olympic Champion in women's curling, and a former World Junior Champion skip.", "prediction 2": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. The women's curling tournament of the 2016 Summer Olympics was held in the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2016.", "prediction 3": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. Great Britain won the women's gold medal on February 11, 2014 and will now compete in the men's.", "prediction 4": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. Canada, skipped by Jennifer Jones, became the first women's rink to go through an Olympic tournament undefeated. Great Britain, by winning the bronze medal, became the youngest rink to ever step onto an Olympic curling podium.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 509 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 405 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The women's curling tournament of the 2014 Winter Olympics was held at the Ice Cube Curling Center in Sochi, Russia on 10\u201320 February 2014. Canada, skipped by Jennifer Jones, became the first women's rink to go through an Olympic tournament undefeated. Great Britain, by winning the bronze medal." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Game of thrones the hound's real name?", "passages": [ [ "Sandor Clegane", "Sandor Clegane\n\nSandor Clegane, nicknamed The Hound, is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation \"Game of Thrones\".", "Introduced in 1996's \"A Game of Thrones\", Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard.", "He subsequently appeared in Martin's \"A Clash of Kings\" (1998), \"A Storm of Swords\" (2000) and \"A Feast for Crows\" (2005).", "Sandor is not a point of view character in the novels, so his actions are witnessed mainly through the eyes of Sansa Stark and Arya Stark, with some narrations from other characters such as Ned Stark, Tyrion Lannister, and possibly Brienne of Tarth.", "Sandor Clegane is portrayed by Scottish actor Rory McCann in the HBO television adaptation.", "Sandor Clegane, known as the Hound, is a retainer to House Lannister and the younger brother of Gregor Clegane, a.k.a.", "The Mountain.", "He is regarded as one of the most dangerous and skilled fighters in Westeros." ], [ "Rory McCann", "Rory McCann\n\nRory McCann (born 24 April 1969) is a Scottish actor, best known for portraying Sandor \"The Hound\" Clegane on the HBO series \"Game of Thrones\" and Michael in Edgar Wright's crime-comedy \"Hot Fuzz\".", "McCann was born in Glasgow, Scotland.", "He has a sister, Sally-Gay McCann, born in 1972.", "Before becoming an actor, McCann was a painter who studied at the Scottish School of Forestry near Inverness.", "He also worked as a bridge painter (on the Forth Road Bridge), landscape gardener and carpenter.", "Rory McCann was first trained as an actor by writer-artist Robert Parsifal Finch in The Actor's Workshop, Glasgow in 1998.", "McCann's first acting job was as an extra on the film \"Willow\" (1988).", "He was fired because he laughed during the takes.", "He appeared in an advertisement for Scott's Porage Oats, dressed in a vest and kilt.", "As his first major acting role, McCann played a disabled personal trainer in the 2002 television comedy drama \"The Book Group\", winning the Scottish BAFTA for the best television performance of 2002.", "Since then, he has taken television roles as Detective Inspector Stuart Brown in \"State of Play\", Peter the Great in \"Peter in Paradise\", and a priest in the award-winning British comedy drama series \"Shameless\"." ] ], "gold": "The Game of Thrones character, the Hound, who serves as King Joffrey Baratheon's personal bodyguard, is named Sandor Clegane. The actor who plays the role of the Hound in Game of Thrones is Rory McCann, a Scottish actor born in Glasgow, Scotland.", "prediction 1": "Sandor Clegane, nicknamed The Hound, is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard. He is regarded as one of the most dangerous and skilled fighters in Westeros. He is regarded as one of the most dangerous and skilled fighter in Westeros. He is regarded as one of the most dangerous and skilled fighters in Westeros.\n", "prediction 2": "Sandor Clegane is character in the A Song of Ice and Fire series of fantasy novels and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, who serves as Joffrey Baratheon's personal bodyguard. He is regarded as one of the most dangerous and skilled fighters in Westeros. Sandor is a retainer to House Lannister and the younger brother of Ser Gregor Clegane, a.k.a.a.k.a. He is a.k.a. Afandom who played the character in Live Aidenable's 1996 HBO vampire comedy drama series.", "prediction 3": "Sandor \"The Hound\" Clegane, nicknamed The Hound, is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard. Actor Rory McCann plays Sandor in the HBO TV show.", "prediction 4": "Sandor Clegane is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Sandor is the younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard. Scottish actor Rory McCann is best known for portraying Sandor \"The Hound\" Clegane on the HBO television adaptation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 410, "end": 487 }, { "error type": "Redundant", "explanation": "He is regarded as one of the most dangerous and skilled fighters in Westeros. ", "start": 488, "end": 564 }, { "error type": "Redundant", "explanation": " He is regarded as one of the most dangerous and skilled fighters in Westeros. ", "start": 565, "end": 643 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Sandor Clegane, nicknamed The Hound, is a fictional character in Game of Thrones. Sandor serves as King Joffrey Baratheon's personal bodyguard. Sandor Clegane is portrayed by Scottish actor Rory McCann. McCann was born in Glasgow, Scotland.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "In what order did the pirates of the caribbean movies come out?", "passages": [ [ "Pirates of the Caribbean: The Curse of the Black Pearl", "Pirates of the Caribbean: The Curse of the Black Pearl\n\nPirates of the Caribbean: The Curse of the Black Pearl is a 2003 American fantasy swashbuckler film directed by Gore Verbinski and the first film in the \"Pirates of the Caribbean\" film series.", "Produced by Walt Disney Pictures and Jerry Bruckheimer, the film is based on Walt Disney's \"Pirates of the Caribbean\" attraction at Disney theme parks.", "The story follows pirate Jack Sparrow (Johnny Depp) and blacksmith Will Turner (Orlando Bloom) as they rescue the kidnapped Elizabeth Swann (Keira Knightley) from the cursed crew of the \"Black Pearl\", captained by Hector Barbossa (Geoffrey Rush), who become undead skeletons at night.", "Jay Wolpert developed a script in 2001, and Stuart Beattie rewrote it in early 2002.", "Around that time, producer Jerry Bruckheimer became involved in the project; he had Ted Elliott and Terry Rossio work on the script, adding the plot device of a supernatural curse to the story to bring it in line with the original theme park ride.", "Filming took place from October 2002 to March 2003 in Saint Vincent and the Grenadines and on sets constructed around Los Angeles, California.", "It was also significant in being the first film released under the Walt Disney Pictures banner to be rated PG-13 by the MPAA." ], [ "Pirates of the Caribbean: Dead Man's Chest", "Pirates of the Caribbean: Dead Man's Chest\n\nPirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy swashbuckler film, the second installment of the \"Pirates of the Caribbean\" film series and the sequel to \"\" (2003).", "It was directed by Gore Verbinski, written by Ted Elliott and Terry Rossio, and produced by Jerry Bruckheimer.", "In the film, the wedding of Will Turner (Orlando Bloom) and Elizabeth Swann (Keira Knightley) is interrupted by Lord Cutler Beckett (Tom Hollander), who wants Turner to acquire the compass of Captain Jack Sparrow (Johnny Depp) in a bid to find the Dead Man's Chest.", "Sparrow discovers his debt to Davy Jones (Bill Nighy) is due.", "Two sequels to \"Pirates of the Caribbean: The Curse of the Black Pearl\" were conceived in 2004, with Elliott and Rossio developing a story arc that would span both films.", "Filming took place from February to September 2005 in Palos Verdes, Saint Vincent and the Grenadines, Dominica, and The Bahamas, as well as on sets constructed at Walt Disney Studios.", "It was shot back-to-back with the third film of the series, \"\"." ], [ "Pirates of the Caribbean: At World's End", "Pirates of the Caribbean: At World's End\n\nPirates of the Caribbean: At World's End is a 2007 American epic fantasy swashbuckler film directed by Gore Verbinski, the third in the \"Pirates of the Caribbean\" film series and the sequel to \"\" (2006).", "The plot follows Will Turner, Elizabeth Swann, Hector Barbossa, and the crew of the \"Black Pearl\" rescuing Captain Jack Sparrow from Davy Jones' Locker, and then preparing to fight the East India Trading Company, led by Cutler Beckett, who controls Davy Jones and plans to extinguish piracy forever.", "It is the last film in the series to be directed by Verbinski.", "It was filmed in two shoots during 2005 and 2006, the former simultaneously with \"Dead Man's Chest\".", "With an estimated production budget of $300 million, \"Pirates of the Caribbean: At World's End\" was the most expensive film ever made at the time of its release, even after adjusting for inflation.", "Walt Disney Pictures released the film in the United States on May 25, 2007.", "Critical reviews were mixed; the film was praised for its performances, musical score, action scenes, humor, and special effects, but was criticized for its plot and running time." ] ], "gold": "The first film in the Pirates of the Caribbean series, \"The Curse of the Black Pearl\", was released on 2003. That film was followed by two back-to-back sequels, Dead Man's Chest\" and \"At World's End\", released in 2006 and 2007 respectively. The fourth film of the series was \"On Stranger Tides\", released on 2011. Finally, the fifth film on the franchise was \"Dead Men Tell No Tales\" released on 2017.", "prediction 1": "Pirates of the Caribbean movies came out in the following order: The Curse of the Black Pearl, At World's End, and At Pirates' End.", "prediction 2": "Pirates of the Caribbean movies were released in the order they came out, from the Curse of the Black Pearl in 2003, to the sequel to the Curse of the Black Pearl in 2006. The Pirates of the Caribbean films were released in the order they came out, with the Curse of the Black Pearl coming out first, then the sequel, and then finally the sequel.", "prediction 3": "Pirates of the Caribbean movies came out in the following order: The Curse of the Black Pearl, The Curse of the Black Pearl 2, The Curse of the Black Pearl 3, At World's End, and At World's End.", "prediction 4": "Pirates of the Caribbean films came out in chronological order, from the first to the last. The film series started with the 2003 film, followed by the 2005 film and the 2007 film. The films are called the \"Pirates of the Caribbean\" series, and are directed by Gore Verbinski.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 131 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first film in the Pirates of the Caribbean series, \"The Curse of the Black Pearl\", was released on 2003. Two back-to-back sequels, Dead Man's Chest\" and \"At World's End\", released in 2006 and 2007 respectively. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When did the kokoda war start and end?", "passages": [ [ "Battle of Buna\u2013Gona", "The first part of this plan, codenamed Operation Mo, was an amphibious landing to capture Port Moresby, capital of the Australian Territory of Papua.", "This was frustrated by the Japanese defeat in the Battle of the Coral Sea and postponed indefinitely after the Battle of Midway.", "The Japanese then planned an overland attack to capture the town by advancing from the north coast.", "Having already captured much of the Territory of New Guinea earlier that year, they landed on 21 July 1942, to established beachheads at Buna, Gona and Sanananda.", "This marked the beginning of the Kokoda Track campaign.", "The South Seas Detachment, under command of Major General Tomitar\u014d Horii, advanced using the Kokoda Track to cross the rugged Owen Stanley Range.", "As the Kokoda Track campaign was taking place, a Japanese invasion force made up of Japanese Special Naval Landing Force units attempted to capture the strategically valuable Milne Bay area in August 1942.", "The Battle of Milne Bay, fought from 25 August to 7 September 1942, resulted in a Japanese defeat.", "This was the first notable Japanese land defeat and raised Allied morale across the Pacific Theatre.", "Allied forces identified a Japanese airfield under construction at Guadalcanal, and 19,000 US Marines were embarked to capture the airfield.", "An amphibious landing was made on 7 August." ], [ "Kokoda Track campaign", "The Japanese advanced to within sight of Port Moresby but withdrew on 26 September.", "They had outrun their supply line and had been ordered to withdraw in consequence of reverses suffered at Guadalcanal.", "The Australian pursuit encountered strong opposition from well-prepared positions around Templeton's Crossing and Eora Village from 11 to 28 October.", "Following the unopposed recapture of Kokoda, a major battle was fought around Oivi and Gorari from 4 to 11 November, resulting in a victory for the Australians.", "By 16 November, two brigades of the Australian 7th Division had crossed the Kumusi River at Wairopi, and advanced on the Japanese beachheads in a joint Australian and United States operation.", "The Japanese forces at Buna\u2013Gona held out until 22 January 1943.", "Australian reinforcement was hampered by the logistical problems of supporting a force in isolated, mountainous, jungle terrain.", "There were few planes available for aerial resupply, and techniques for it were still primitive.", "Australian command considered that the Vickers machine gun and medium mortars were too heavy to carry and would be ineffective in the jungle terrain.", "Without artillery, mortars or medium machine guns, the Australians faced an opponent equipped with mountain guns and light howitzers that had been carried into the mountains and proved to be a decisive advantage." ], [ "Order of battle for the Kokoda Track campaign", "Order of battle for the Kokoda Track campaign\n\nThis is an order of battle listing the Australian and Japanese forces involved in the Kokoda Track campaign from 21 July \u2013 16 November 1942.", "Source:\n\n\nSource:" ] ], "gold": "The Kokoda Track Campaign began on 21 July 1942 when Japanese forces landed and established beachheads near Gona and Buna. The campaign ended on 16 November 1942 when two brigades of the Australian 7th Division crossed the Kumusi River at Wairopi, and advanced on the Japanese beachheads in a joint Australian and United States operation.", "prediction 1": "The Kokoda war started on 21 July 1942, when the Japanese invaded the territory of New Guinea to capture Port Moresby. They then planned an overland attack to capture the town by advancing from the north coast. After capturing much of the territory of New Guinea earlier that year, the Japanese then planned an overland attack to capture the town by advancing from the north coast. The battles that followed involved the landings at Buna, Gona and Sanananda, and the battles that followed included the Allied forces that came to capture of the Owen Stanley Range.", "prediction 2": "The Kokoda war started and ended when the Japanese forces at Buna\u2013Gona held out until 22 January 1943. The Koreans were advancing towards the town of Kokoda and attempting to capture Port Moresby. However, they outran their supply lines and were ordered to withdraw. So, the Japanese landed on 21 July 1942, to established beachheads at Buna, Gona and Sanananda, marking the beginning of the Kokoda Track campaign.", "prediction 3": "The Kokoda war started and ended on 21 July 1942, when the South Seas Detachment under command of Major General Tomitar Horii advanced using the Kokoda Track to cross the rugged Owen Stanley Range. The battle for Kokoda was fought from 21 July 1942, to 16 November 1942, when two brigades of the Australian 7th Division crossed the Kumusi River at Wairopi, and advanced on the Japanese beachheads in a joint Australian and United States operation.", "prediction 4": "The Kokoda war started on 21 July 1942. The first part of this plan, codenamed Operation Mo, was an amphibious landing to capture Port Moresby, capital of the Australian Territory of Papua. This was frustrated by the Japanese defeat in the Battle of the Coral Sea and postponed indefinitely after the Battle of Midway. The Japanese then planned an overland attack to capture the town by advancing from the north coast. This marked the beginning of the Kokoda Track campaign.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 563 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Kokoda war started on 21 July 1942 when Japanese forces landed and established beachheads near Gona and Buna. By 16 November, two brigades of the Australian 7th Division had crossed the Kumusi River at Wairopi, and advanced on the Japanese beachheads in a joint Australian and United States operation. " }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When does the flash season 4 episode 9 come out?", "passages": [ [ "The Flash (season 4)", "Collider's Allison Keene also noted Iris \"getting an actual storyline\" with Barry gone, and similarly presumed that he \"[would] be back in the fold by the end of the first episode\" alike to Flashpoint in the third season.", "She added, \"There are some new foes, lots of action, plenty of tech\u00a0\u2014 it's great!\"", "The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired.", "It will be released on Blu-ray on August 28, 2018.", "The review aggregator website Rotten Tomatoes reported a 76% approval rating with an average rating of 6.65/10 based on 17 reviews.", "The website's consensus reads, \"After an unsteady turn in season three, \"The Flash\" returns to its roots with a fourth season packed with humor, spectacle, and a whole lot of heart.\"", "Reviewing the first two episodes of the season, Allison Keene writing for Collider.com, felt the premiere \"wipes the slate clean, fixing a lot of the issues that plagued the end of the last season, and setting up a much more toned-down storyline.", "Most importantly, it's brought back some fun.\"", "She added that with a \"streamlined team,\" the core characters now have time to interact and have meaningful plot lines." ], [ "The Flash (season 4)", "The Flash (season 4)\n\nThe fourth season of the American television series \"The Flash\", which is based on the DC Comics character Barry Allen / Flash, premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018.", "The season follows a crime scene investigator with superhuman speed who fights criminals, including others who have also gained superhuman abilities.", "It is set in the Arrowverse, sharing continuity with the other television series of the universe, and is a spin-off of \"Arrow\".", "The season is produced by Berlanti Productions, Warner Bros. Television, and DC Entertainment, with Andrew Kreisberg and Todd Helbing serving as showrunners.", "The season was ordered in January 2017, and filming began that July.", "Grant Gustin stars as Barry, with principal cast members Candice Patton, Danielle Panabaker, Carlos Valdes, Keiynan Lonsdale, Tom Cavanagh, and Jesse L. Martin also returning from previous seasons, and are joined by Neil Sandilands.", "\n\n", "The series was renewed for a fourth season on January 8, 2017, earlier than usual for the series." ] ], "gold": "The fourth season of the American television series The Flash, which is based on the DC Comics character Barry Allen / Flash, premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018. Episode 9 of Season 4 came out on December 5, 2017. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It was released on Blu-ray on August 28, 2018.", "prediction 1": "The Flash is an American television series that is based on the DC Comics character Barry Allen / Flash and is a spin-off of the Arrowverse. The season finale was broadcast on The CW on October 10, 2017. The season was made available for streaming on Netflix in late May 2018, shortly after the season finale aired.", "prediction 2": "The Flash, a television series based on the DC Comics character Barry Allen, premiered a fourth season on October 10, 2017, and ran for 23 episodes. As of May 22, 2018, episode 9 of season 4 of The Flash came out on Netflix in late May 2018, shortly after the season finale aired.", "prediction 3": "The Flash is an American television series based on the DC Comics character Barry Allen / Flash. The season premiered on The CW on October 10, 2017. The remaining episodes were released on September 24, 2019.", "prediction 4": "The Flash is an American television series that is based on the DC Comics character Barry Allen / Flash. It premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The fourth season of the American television series The Flash, which is based on the DC Comics character Barry Allen / Flash, premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It will be released on Blu-ray on August 28, 2018." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who has won the australian grand prix this year?", "passages": [ [ "2017 Australian Grand Prix", "2017 Australian Grand Prix\n\nThe 2017 Australian Grand Prix (formally known as the 2017 Formula 1 Rolex Australian Grand Prix) was a Formula One motor race that took place on 26 March 2017 in Melbourne.", "The race was contested over fifty-seven laps of the Melbourne Grand Prix Circuit and was the first round of the 2017 FIA Formula One World Championship.", "The race marked the eighty-first race in the combined history of the Australian Grand Prix \u2013 which dates back to the 100 Miles Road Race of 1928 \u2013 and the twenty-second time the event was held at the Melbourne Grand Prix Circuit.", "The reigning World Champion Nico Rosberg was the winner of the 2016 race, but he did not defend his win as he retired from the sport after the 2016 season.", "Mercedes driver Lewis Hamilton started the race from pole, matching Ayrton Senna's record of six pole positions in Australia.", "Sebastian Vettel won the race, which was his and Ferrari's first win since the 2015 Singapore Grand Prix.", "Hamilton finished second, with Valtteri Bottas completing the podium in third on his d\u00e9but for Mercedes.", "The race was also Ferrari's first win at the track since the 2007 edition.", "With the technical regulations undergoing a revision for the 2017 season, the FIA requested that every circuit on the calendar undergo revisions to update safety features." ], [ "Australian Grand Prix", "Australian Grand Prix\n\nThe Australian Grand Prix is a motor race held annually in Australia currently under contract to host Formula One until 2023.", "The Grand Prix is the second oldest surviving motor racing competition held in Australia, after the Alpine rally first held in 1921, having been contested 83 times since it was first run at Phillip Island in 1928.", "It is currently sponsored with naming rights by the Swiss watchmaker Rolex.", "Prior to its inclusion in the World Championship, it was held at a multitude of venues in every state of Australia.", "It was a centrepiece of the Tasman Series in most years between 1964 and 1972 and was a round of the Australian Drivers' Championship on many occasions between 1957 and 1983.", "Unusual, even for a race of such longevity, as of 2018 the location of the Grand Prix has moved frequently with 23 different venues having been used over its life, a number eclipsing the 16 venues used for the French Grand Prix since its own 1906 start.", "The race became part of the Formula One World Championship in 1985 and was held at the Adelaide Street Circuit in Adelaide, South Australia, from that year to 1995.", "From 1996 it has been held at the Melbourne Grand Prix Circuit at Albert Park in Melbourne." ], [ "Lewis Hamilton", "Lewis Hamilton\n\nLewis Carl Davidson Hamilton (born 7 January 1985) is a British racing driver who races in Formula One for Mercedes AMG Petronas.", "A five-time Formula One World Champion, he is often considered the best driver of his generation and widely regarded as one of the greatest drivers in the history of the sport.", "He won his first World Championship title with McLaren in , then moved to Mercedes where he won back-to-back titles in and before winning back-to-back titles again in and .", "Statistically the most successful British driver in the history of the sport, Hamilton has more World Championship titles (5) and more race victories () than any other British driver in Formula One.", "He also holds records for the all-time most career points (), the most wins at different circuits (26), the all-time most pole positions () and the most grand slams in a season (3).", "Born and raised in Stevenage, Hertfordshire, Hamilton's interest in racing started when his father bought him a radio-controlled car when he was six.", "He was signed to McLaren's young driver support programme in 1998, after he approached McLaren team principal Ron Dennis at an awards ceremony three years earlier and said \"one day I want to be racing your cars\"." ] ], "gold": "The Australian Grand Prix, is an annual motor racing event, which is currently under contract to host Formula One until 2025. Lewis Hamilton, a British racing driver, won the 2015 Australian Grand Prix. The reigning World Champion Nico Rosberg was the winner of the 2016 Australian Grand Prix, but he did not defend his win as he retired from the sport after the 2016 season. Sebastian Vettel won the 2017 Australian Grand Prix, which was his and Ferrari's first win since the 2015 Singapore Grand Prix.", "prediction 1": "The Australian Grand Prix is a motor race held annually in Australia under contract to host Formula One until 2023. The reigning World Champion Nico Rosberg was the winner of the 2016 Australian Grand Prix, but he retired from the sport after the 2016 season. In 2017, Sebastian Vettel won the race, which was his and Ferrari's first win since the 2015 Singapore Grand Prix. Hamilton finished second, with Valtteri Bottas completing the podium in third on his debut for Mercedes.", "prediction 2": "The Australian Grand Prix is an annual motor race held annually in Australia currently under contract to host Formula One until 2023. The reigning World Champion Nico Rosberg was the winner of the 2016 race, but he did not defend his win as he retired from the sport after the 2016 season. Mercedes driver Lewis Hamilton started the race from pole, matching Ayrton Senna's record of six pole positions in Australia. Sebastian Vettel won the race, which was his and Ferrari's first win since the 2015 Singapore Grand Prix. Hamilton finished second, with Valtteri Bottas completing the podium in third. Hamilton finished second, with Valtteri Bottas completing the race in third.", "prediction 3": "The Australian Grand Prix is a motor race held annually in Australia under contract to host Formula One until 2023. The 2017 Australian Grand Prix was won by Mercedes driver Lewis Hamilton, who started the race from pole, matching Ayrton Senna's record of six pole positions in Australia. The 2016 Australian Grand Prix was won by Nico Rosberg, who retired from the sport after the 2016 season. The 2017 Australian Grand Prix was won by Sebastian Vettel, who won the race, which was his and Ferrari's first win since the 2015 Singapore Grand Prix.", "prediction 4": "The Australian Grand Prix is a motor race held annually in Australia currently under contract to host Formula One until 2023. This year's winner was Sebastian Vettel, while Lewis Hamilton won in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 479 } ], "missing-info": [], "corrected-prediction": "The Australian Grand Prix is a motor race held annually in Australia under contract to host Formula One until 2023. The reigning World Champion Nico Rosberg was the winner of the 2016 Australian Grand Prix, but he retired from the sport after the 2016 season. In 2017, Sebastian Vettel won the race, which was his and Ferrari's first win since the 2015 Singapore Grand Prix. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What is the temperature of vy canis majoris?", "passages": [ [ "VY Canis Majoris", "Despite the mass and very large size, VY CMa has an average density of 5.33 to 8.38\u00a0mg/m (0.00000533 to 0.00000838\u00a0kg/m), it is over 100,000 times less dense than Earth's atmosphere at sea level (1.2\u00a0kg/m).", "VY Canis Majoris has been known to be an extreme object since the middle of the 20th century, although its true nature was uncertain.", "In the late 20th century, it was accepted that it was a post-main sequence red supergiant.", "Its angular diameter had been measured and found to be significantly different depending on the observed wavelength.", "The first meaningful estimates of its properties showed a very large star, well in excess of .", "In contrast to prevailing opinion, a 2006 study, ignoring the effects of the circumstellar envelope in the observed flux of the star, derived a luminosity of , suggesting an initial mass of and radius of based on an assumed effective temperature of 3,650 K and distance of .", "On this basis they considered VY CMa and another notable extreme cool hypergiant star, NML Cygni, as normal early-type red supergiants." ], [ "VY Canis Majoris", "VY Canis Majoris\n\nVY Canis Majoris (abbreviated to VY CMa) is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star located at away from Earth in the constellation of Canis Major.", "It is one of the largest known stars by radius, and is also one of the most luminous and massive red supergiants, as well as one of the most luminous stars in the Milky Way.", "VY CMa is a single star with a large infrared (IR) excess, making it one of the brightest objects in the sky at wavelengths of between 5 and 20 microns (\u00b5m) and indicating a dust shell or disk heated by the star.", "It is about times the mass of the Sun ().", "It is also surrounded by a complex asymmetric circumstellar envelope (CSE) caused by mass loss from the star itself.", "It produces strong molecular maser emission and was one of the first radio masers discovered.", "VY CMa is embedded within the large molecular cloud Sharpless 310 (Sh2-310), one of largest star-forming H\u00a0II region with a diameter of 480 arcminutes (') or ." ] ], "gold": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star 1.2 kiloparsecs, 3,900 light-years, from the solar system in the slightly southern constellation of Canis Major. The generally accepted temperature of Vy Canis Majoris is 3,490\u00b190 K. According to a 2006 study, the temperature of Vy Canis Majoris is 3,650 K. according to a study which derived a luminosity of 430,000 L, the temperature of Vy Canis Majoris is 3,450\u20133,535 K.", "prediction 1": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star located at away from Earth in the constellation of Canis Major. It is one of the largest known stars by radius, as well as one of the most luminous and massive red supergiants, as well as one of the most luminous stars in the Milky Way. The star has an effective temperature of 3,650 K, with a radius of.", "prediction 2": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star located at away from Earth in the constellation of Canis Major. The star has an effective temperature of 3,650 K. The temperature of its dust shell or disk is interpreted as 5,800 K. The star has an average density of 5.33 to 8.38 mg/m.", "prediction 3": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star located at away from Earth in the constellation of Canis Major. It is one of the largest known stars by radius, and is also one of the most luminous and massive red supergiants, as well as one of the most luminous stars in the Milky Way. The temperature of the star is calculated to be 3,650 K in a distance of.", "prediction 4": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant or red supergiant (RSG) and pulsating variable star located away from Earth in the constellation of Canis Major. It is one of the largest known stars by radius, and is also one of the most luminous and massive red supergiants, as well as one of the most luminous stars in the Milky Way. The temperature is 3,650 K. The radius is 3 million light years and the mass is about three million light years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 361 }, { "error type": "Incoherent", "explanation": "", "start": 412, "end": 429 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "VY Canis Majoris is an extreme oxygen-rich (O-rich) red hypergiant (RHG) or red supergiant (RSG) and pulsating variable star located at away from Earth in the constellation of Canis Major. A 2006 study, ignoring the effects of the circumstellar envelope in the observed flux of the star, derived a luminosity of , suggesting an initial mass of and radius of based on an assumed effective temperature of 3,650 K." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "What was the name of the book darwin published?", "passages": [ [ "Charles Darwin", "Charles Darwin\n\nCharles Robert Darwin, (; 12\u00a0February 1809\u00a0\u2013 19\u00a0April 1882) was an English naturalist, geologist and biologist, best known for his contributions to the science of evolution.", "His proposition that all species of life have descended over time from common ancestors is now widely accepted, and considered a foundational concept in science.", "In a joint publication with Alfred Russel Wallace, he introduced his scientific theory that this branching pattern of evolution resulted from a process that he called natural selection, in which the struggle for existence has a similar effect to the artificial selection involved in selective breeding.", "Darwin published his theory of evolution with compelling evidence in his 1859 book \"On the Origin of Species\", overcoming scientific rejection of earlier concepts of transmutation of species.", "By the 1870s, the scientific community and a majority of the educated public had accepted evolution as a fact.", "However, many favoured competing explanations and it was not until the emergence of the modern evolutionary synthesis from the 1930s to the 1950s that a broad consensus developed in which natural selection was the basic mechanism of evolution.", "Darwin's scientific discovery is the unifying theory of the life sciences, explaining the diversity of life.", "Darwin's early interest in nature led him to neglect his medical education at the University of Edinburgh; instead, he helped to investigate marine invertebrates.", "Studies at the University of Cambridge (Christ's College) encouraged his passion for natural science." ], [ "Charles Darwin", "His five-year voyage on established him as an eminent geologist whose observations and theories supported Charles Lyell's uniformitarian ideas, and publication of his journal of the voyage made him famous as a popular author.", "Puzzled by the geographical distribution of wildlife and fossils he collected on the voyage, Darwin began detailed investigations, and in 1838 conceived his theory of natural selection.", "Although he discussed his ideas with several naturalists, he needed time for extensive research and his geological work had priority.", "He was writing up his theory in 1858 when Alfred Russel Wallace sent him an essay that described the same idea, prompting immediate joint publication of both of their theories.", "Darwin's work established evolutionary descent with modification as the dominant scientific explanation of diversification in nature.", "In 1871 he examined human evolution and sexual selection in \"The Descent of Man, and Selection in Relation to Sex\", followed by \"The Expression of the Emotions in Man and Animals\" (1872).", "His research on plants was published in a series of books, and in his final book, \"The Formation of Vegetable Mould, through the Actions of Worms\" (1881), he examined earthworms and their effect on soil.", "Darwin has been described as one of the most influential figures in human history, and he was honoured by burial in Westminster Abbey." ], [ "Geological Observations on South America", "Geological Observations on South America\n\nGeological Observations on South America is a book written by the English naturalist Charles Darwin.", "The book was published in 1846, and is based on his travels during the second voyage of HMS Beagle, commanded by captain Robert FitzRoy.", "HMS Beagle arrived in South America to map out the coastlines and islands of the region for the British Navy.", "On the journey, Darwin collected fossils and plants, and recorded the continent's geological features.", "It is the third book in a series of geology books written by Darwin, which also includes \"The Structure and Distribution of Coral Reefs\", published in 1842, and \"Geological Observations on the Volcanic Islands visited during the Voyage of H.M.S. Beagle\", published in 1844.", "It took Darwin four years to write and complete the entire series, from 1842 to 1846.", "According to his diaries, \"Geological Observations of South America\" was written between July 1844 to April 1845.", "The text contains eight chapters along with appendices on Darwin's Mesozoic and Tertiary fossils.", "It describes his travels through the regions of modern Chile, Brazil, and Argentina, including the Pampas, Patagonia, and the Andes.", "With this book Darwin became the first to describe and name Navidad Formation, the reference unit for the marine Neogene in Chile." ] ], "gold": "Charles Robert Darwin was an English naturalist, geologist and biologist, best known for his contributions to the science of evolution. Darwin published his theory of evolution with compelling evidence in his 1859 book \"On the Origin of Species\". Darwin also published other books throughout his life including the following: \"Geological Observations on the Volcanic Islands\" in 1844; \"The Descent of Man, and Selection in Relation to Sex\" in 1871; \"The Effects of Cross and Self Fertilisation in the Vegetable Kingdom\" in 1876; and \"The Different Forms of Flowers on Plants of the Same Species\" in 1877. ", "prediction 1": "Geological Observations on South America is a book written by the English naturalist Charles Darwin. The book was published in 1846, and is based on his travels during the second voyage of HMS Beagle, commanded by captain Robert FitzRoy. It was the third book in a series of geology books written by Darwin that also includes The Structure and Distribution of Coral Reefs, published in 1842, and Geological Observations on the Volcanic Islands visited during the Voyage of H.M.S. Beagle, published in 1845.", "prediction 2": "Charles Darwin was an English naturalist, geologist, and biologist best known for his contributions to the science of evolution. His proposition that all species of life have descended over time from common ancestors is now widely accepted, and considered a foundational concept in science. Darwin published his theory of evolution with compelling evidence in his 1859 book On the Origin of Species, overcoming scientific rejection of earlier concepts of transmutation of species. Geological Observations on South America is a book written by the English naturalist Charles Darwin. The book was published in 1846, and is based on his travels during the second voyage of HMS Beagle, commanded by captain Robert FitzRoy. It took Darwin four years to complete the entire series, from 1842 to complete the entire series, and is based on his travels during the Volcanic Islands visited during the Voyage of HMS Beagle", "prediction 3": "The book written by the English naturalist Charles Darwin, entitled Geological Observations on South America, was published in 1846. It is the third book in a series of geology books written by Darwin, which also includes the book The Structure and Distribution of Coral Reefs, published in 1842, and the book Geological Observations on the Volcanic Islands visited during the Voyage of H.M.S. Beagle, published in 1844.", "prediction 4": "Geological Observations on South America was the third book in a series of geology books written by the English naturalist Charles Darwin. The book was published in 1846, and is based on his travels during the second voyage of HMS Beagle, commanded by captain Robert FitzRoy. According to his diaries, \"Geological Observations of South America\" was written between July 1844 to April 1845.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 237 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Charles Robert Darwin was an English naturalist, geologist and biologist, best known for his contributions to the science of evolution. Darwin published his theory of evolution with compelling evidence in his 1859 book \"On the Origin of Species\". Geological Observations on South America is a book written by the English naturalist Charles Darwin published in 1846. It was the third book in a series of geology books written by Darwin that also includes The Structure and Distribution of Coral Reefs, published in 1842, and Geological Observations on the Volcanic Islands visited during the Voyage of H.M.S. Beagle, published in 1845." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did the us first start using drones?", "passages": [ [ "History of unmanned aerial vehicles", "It was at the Van Nuys Radioplane factory that in 1944 that Army photographer David Conover saw a young lady named Norma Jeane, and thought she had potential as a model.", "This \"discovery\" led to fame for Jeane, who soon changed her name to Marilyn Monroe.", "The true inventor of a radio-controlled aircraft that could fly out of sight was Edward M. Sorensen as evidenced by his US patents.", "His invention was the first to be able to know from a ground terminal, what the airplane was doing, such as climbing, altitude, banking, direction, rpm and other instrumentation.", "Without these patents the early radio-controlled aircraft could only operate within visual sight of the ground pilot.", "The US Navy began experimenting with radio-controlled aircraft during the 1930s as well, resulting in the Curtiss N2C-2 drone in 1937.", "The N2C-2 was remotely controlled from another aircraft, called a TG-2.", "N2C-2 anti-aircraft target drones were in service by 1938.", "The US Army Air Forces (USAAF) adopted the N2C-2 concept in 1939.", "Obsolescent aircraft were put into service as \"A-series\" anti-aircraft target drones.", "Since the \"A\" code would be also used for \"Attack\" aircraft, later \"full-sized\" targets would be given the \"PQ\" designation." ], [ "History of unmanned aerial vehicles", "History of unmanned aerial vehicles\n\nAn Unmanned aerial vehicle (UAV) is a Unmanned Aerial Vehicle.", "UAVs include both autonomous (means they can do it alone) drones and remotely piloted vehicles (RPVs).", "A UAV is capable of controlled, sustained level flight and is powered by a jet, reciprocating, or electric engine.", "In the 21st century, technology reached a point of sophistication that the UAV is now being given a greatly expanded role in many areas of aviation.", "A UAV differs from a cruise missile in that a UAV is intended to be recovered after its mission, while a cruise missile impacts its target.", "A military UAV may carry and fire munitions on board, while a cruise missile is a munition.", "The earliest recorded use of an unmanned aerial vehicle for warfighting occurred on July 1849, serving as a balloon carrier (the precursor to the aircraft carrier) in the first offensive use of air power in naval aviation.", "Austrian forces besieging Venice attempted to float some 200 incendiary balloons each carrying at 24-30 pound bomb that was to be dropped from the balloon with a time fuse over the besieged city.", "The balloons were launched mainly from land, however some were also launched from the Austrian ship SMS Vulcano.", "The Austrians used smaller pilot balloons to determine the correct fuse settings." ] ], "gold": "Unmanned Aerial Vehicles or UAVs include both autonomous, capable of operating without human input, drones and remotely piloted vehicles or RPVs. A UAV is capable of controlled, sustained level flight and is powered by a jet, reciprocating, or electric engine. In the twenty first century, technology reached a point of sophistication that the UAV is now being given a greatly expanded role in many areas of aviation. The US Navy began experimenting with radio-controlled aircraft during the 1930s, resulting in the Curtiss N2C-2 drone in 1937. N2C-2 anti-aircraft target drones were in service by 1938.", "prediction 1": "An Unmanned Aerial Vehicle (UAV) is a Unmanned Aerial Vehicle. The US first started using drones in the early 1990s, when the US Navy began experimenting with radio-controlled aircraft during the 1930s as well. The earliest recorded use of an unmanned aerial vehicle for warfighting occurred on July 1849, serving as a balloon carrier in the first offensive use of air power in naval aviation.", "prediction 2": "The US first started using drones in the year 1945. The earliest recorded use of an unmanned aerial vehicle for warfighting occurred on July 1849, serving as a balloon carrier in the first offensive use of air power in naval aviation. The first commercially-available unmanned aerial vehicle was the USS Curtiss N2C-2 drone in 1937. The military first started using remotely-piloted vehicles in the year 2000.", "prediction 3": "An Unmanned aerial vehicle (UAV) is a Unmanned Aerial Vehicle. The first recorded US use of an unmanned aerial vehicle for warfighting occurred on July 1849, serving as a balloon carrier in the first offensive use of air power in naval aviation. The first US Army Air Forces adopted the N2C-2 concept in 1939.", "prediction 4": "The US first started using drones in the mid-1960s. The US Navy began experimenting with radio-controlled aircraft during the 1930s as well, resulting in the Curtiss N2C-2 drone in 1937. The US Army Air Forces (USAAF) adopted the N2C-2 concept in 1939. The earliest recorded use of an unmanned aerial vehicle for warfighting occurred on July 1849, serving as a balloon carrier in the first offensive use of air power in naval aviation.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 63, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 393 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "An Unmanned Aerial Vehicle (UAV) is a Unmanned Aerial Vehicle. UAVs include both autonomous (means they can do it alone) drones and remotely piloted vehicles (RPVs). A UAV is capable of controlled, sustained level flight and is powered by a jet, reciprocating, or electric engine. In the 21st century, technology reached a point of sophistication that the UAV is now being given a greatly expanded role in many areas of aviation. The US Navy began experimenting with radio-controlled aircraft during the 1930s as well, resulting in the Curtiss N2C-2 drone in 1937. N2C-2 anti-aircraft target drones were in service by 1938. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the movie dog days come out?", "passages": [ [ "Dog Days (2018 film)", "Dog Days (2018 film)\n\nDog Days is a 2018 American romantic comedy film directed by Ken Marino and written by Elissa Matsueda and Erica Oyama.", "It stars Eva Longoria, Nina Dobrev, Vanessa Hudgens, Lauren Lapkus, Thomas Lennon, Adam Pally, Ryan Hansen, Rob Corddry, Tone Bell, Jon Bass and Finn Wolfhard.", "The plot follows the intertwining lives of various dogs and their owners around Los Angeles.", "The movie was released on August 8, 2018, by LD Entertainment, and received mixed reviews from critics.", "In August 2017, it was announced Ken Marino would direct the film, from a screenplay by Elissa Matsueda and Erica Oyama, with Mickey Liddell, Jennifer Monroe and Pete Shilaimon producing under their LD Entertainment banner.", "In September 2017, Finn Wolfhard, Vanessa Hudgens, Tone Bell, Adam Pally, Eva Longoria, and Jon Bass joined the cast of the film.", "In October 2017, Tig Notaro, Rob Corddry, Michael Cassidy, Jasmine Cephas Jones, Ron Cephas Jones, John Gemberling, Ryan Hansen, Thomas Lennon, Lauren Lapkus, Jessica Lowe, Toks Olagundoye, Jessica St. Clair and David Wain joined the cast of the film.", "Principal photography began in October 2017, in Los Angeles, California." ], [ "Dog Days (1925 film)", "Dog Days (1925 film)\n\nDog Days is a 1925 short silent comedy film directed by Robert F. McGowan.", "It was the 36th \"Our Gang\" short subject released.", "The boys are showing off their dogs to each other when little rich girl Mary Kornman rides by in her pony-drawn cart.", "When the pony shies and runs away, Mickey comes to the rescue with his dog.", "In gratitude, Mary invites all the boys and their dogs to her party, much to the chagrin of her wealthy mother (Lyle Tayo)." ], [ "Dog Days (2001 film)", "Dog Days (2001 film)\n\nDog Days () is a 2001 Austrian feature film directed by Ulrich Seidl.", "It is characterized by a disturbing naturalistic style which is a trademark of Seidl's directing.", "The film stars a mix of professional and amateur actors and it became mildly controversial for its depiction of unsimulated sex.", "The film follows six interwoven stories set in suburban Vienna over the course of a summer weekend.", "The film premiered at the 2001 Venice Film Festival where it went on to win the Silver Lion Jury's Special Award.", "John Waters has professed his admiration for the film, and selected it as a favorite to present within Maryland Film Festival 2004." ] ], "gold": "There is more than one movie called Dog Days. Dog Days released March 8, 1925 is an Our Gang short. Dog Days released in September 2, 2001 is an Australian film which follows six interwoven stories set in suburban Vienna over the course of a summer weekend. Dog Days released August 8, 2018 is an American romantic comedy that follows the intertwining lives of various dogs and their owners around Los Angeles.", "prediction 1": "Dog Days is a movie that follows the lives of various dogs and their owners in Los Angeles. In 1925, a short silent comedy film directed by Robert F. McGowan is released as Dog Days. In 2001, a feature film directed by Ulrich Seidl is released as Dog Days. The movie premiered at the 2001 Venice Film Festival where it went on to win the Silver Lion Jury's Special Award. In 2018, a romantic comedy film, Dog Days: The Movie, was released on August 8, 2018, by LD Entertainment.", "prediction 2": "The movie Dog Days was released on August 8, 2018, by LD Entertainment. The movie was adapted from the 1925 short silent comedy Dog Days and is set in suburban Vienna over the course of a summer weekend. The film premiered at the 2001 Venice Film Festival and went on to win the Silver Lion Jury's Special Award.", "prediction 3": "Dog Days is a movie that is a mix of comedy, drama, and a love story. In the United States, the movie was released on August 8, 2018. In the United Kingdom, the movie was released on August 8, 2016.", "prediction 4": "Dog Days is a movie that is based on the fictional character of Mary Kornman. The 1925 short silent comedy film directed by Robert F. McGowan was released on January 18, 1925. The 2001 Austrian feature film Dog Days was released on July 11, 2001 at the Venice Film Festival where it went on to win the Silver Lion Jury's Special Award. The 2018 American romantic comedy movie Dog Days was released on August 8, 2018 by LD Entertainment and received mixed reviews from critics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 371 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 231 }, { "error type": "Irrelevant", "explanation": "", "start": 458, "end": 478 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 157 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "In 1925, a short silent comedy film is released as Dog Days. In 2001, a feature Australian film is released as Dog Days. The film follows six interwoven stories set in suburban Vienna over the course of a summer weekend. In 2018, a romantic comedy film, Dog Days, was released on August 8, 2018. The plot follows the intertwining lives of various dogs and their owners around Los Angeles." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the song don't worry be happy made?", "passages": [ [ "Don't Worry, Be Happy", "Linda Goldstein, the song's producer, said the song gave McFerrin \"the freedom to explore,\" adding, \"He is a man of infinite, unfathomable, boundless voices and everything he has ever heard has gone into his brain, from the Mickey Mouse Club theme to the Metropolitan Opera.\"", "The \"instruments\" in the \"a cappella\" song are entirely overdubbed voice parts and other sounds made by McFerrin, using no instruments at all; McFerrin also sings with an affected accent.", "The comedic original music video for the song stars McFerrin, Robin Williams, and Bill Irwin, and is somewhat shorter than the album version.", "Originally released in conjunction with the film \"Cocktail\" in 1988, the song originally peaked at No. 88 on the \"Billboard\" Hot 100.", "The song was re-released the same year and peaked at No. 1 on September 24, 1988 displacing \"Sweet Child o' Mine\" by Guns N' Roses.", "The song also peaked at No. 11 on the \"Billboard\" Hot R&B/Hip-Hop Tracks chart and No. 7 on the \"Billboard\" Hot Adult Contemporary Tracks chart." ], [ "Don't Worry Be Happy (Guy Sebastian song)", "Don't Worry Be Happy (Guy Sebastian song)\n\n\"Don't Worry Be Happy\" is a pop song written and performed by Australian recording artist Guy Sebastian.", "It is the lead single from Sebastian's seventh album \"Armageddon\".", "\"Don't Worry Be Happy\" was released digitally in Australia on 18 November 2011.", "It peaked at number five on the ARIA Singles Chart, and has reached 4\u00d7 platinum certification.", "It was Sebastian's eighth of 11 top ten singles in Australia.", "In 2012 \"Don't Worry Be Happy\" was nominated for the ARIA Music Award for Single of the Year and was shortlisted for the APRA Song of the Year.", "It has received 2013 APRA nominations for Most Played Australian Work and Pop Work of the Year.", "\"Don't Worry Be Happy\" is an uptempo pop song Sebastian said he was inspired to write after experiencing the anger of a fellow motorist while driving in Los Angeles.", "He told \"The Daily Telegraph\" music editor Kathy McCabe, \"I thought I knew the guy so as he pulled alongside me, I smiled and copped a tirade of abuse.", "I was in a really good mood because I was on the way to play cricket and while we were batting, I wrote the song." ], [ "Don't Worry, Be Happy", "Don't Worry, Be Happy\n\n\"Don't Worry, Be Happy\" is a popular worldwide hit song by musician Bobby McFerrin.", "Released in September 1988, it became the first \"a cappella\" song to reach number one on the \"Billboard\" Hot 100 chart, a position it held for two weeks.", "The Indian mystic and sage Meher Baba (1894\u20131969) often used the expression \"Don't worry, be happy\" when cabling his followers in the West.", "In the 1960s, the expression was printed up on inspirational cards and posters of the era.", "In 1988, McFerrin noticed a similar poster in the apartment of the jazz duo Tuck & Patti in San Francisco.", "Inspired by the expression's charm and simplicity, McFerrin wrote the now famous song, which was included in the soundtrack of the movie \"Cocktail\", and became a hit single the next year.", "In an interview by Bruce Fessier for \"USA Weekend\" magazine in 1988 McFerrin said, \"Whenever you see a poster of Meher Baba, it usually says 'Don't worry, be happy,' which is a pretty neat philosophy in four words, I think.\"" ] ], "gold": "\"Don't Worry, Be Happy\", a song by American musician Bobby McFerrin, was released in September 1988. It was the first a cappella song to reach number-one on the Billboard Hot 100 chart, a position it held for two weeks. The lead single from Guy Sebastian's seventh album Armageddon, \"Don't Worry, Be Happy\", was released digitally in Australia on 18 November 2011.", "prediction 1": "Don't Worry Be Happy is a song made popular by singer Bobby McFerrin. It was released in conjunction with the film Cocktail in 1988. The song was re-released the same year and peaked at No.1 on the Billboard Hot 100, a position it held for two weeks. Don't Worry Be Happy was released digitally in Australia on 18 November 2011. It is the lead single from Australian recording artist Guy Sebastian's seventh album Armageddon.", "prediction 2": "\"Don't Worry Be Happy\" is a pop song written and performed by Australian recording artist Guy Sebastian. It is the lead single from Sebastian's seventh album Armageddon. Don't Worry Be Happy was released digitally in Australia on 18 November 2011.", "prediction 3": "\"Don't Worry, Be Happy\" is a popular worldwide hit song by musician Bobby McFerrin. Released in September 1988, it became the first \"a cappella\" song to reach number one on the Billboard Hot 100, a position it held for two weeks. \"Don't Worry Be Happy\" is also the lead single from Australian recording artist Guy Sebastian's seventh album Armageddon and was released digitally in Australia on 18 November 2011.", "prediction 4": "\"Don't Worry Be Happy\" is a pop song written and performed by Australian recording artist Guy Sebastian. The song, released in conjunction with the film Cocktail in 1988, became the first a cappella song to reach number one on the Billboard Hot 100. Sebastian said he was inspired to write the song after experiencing the anger of a fellow motorist while driving in Los Angeles. \"Don't Worry Be Happy\" is also a pop song written and performed by Australian recording artist Guy Sebastian.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 146, "end": 157 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Don't Worry, Be Happy\", a song by American musician Bobby McFerrin, was released in September 1988. It was the first a cappella song to reach number-one on the Billboard Hot 100 chart, a position it held for two weeks. Don't Worry Be Happy was released digitally in Australia on 18 November 2011. It is the lead single from Australian recording artist Guy Sebastian's seventh album Armageddon." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When is diving on in the commonwealth games?", "passages": [ [ "Diving at the 2018 Commonwealth Games", "Diving at the 2018 Commonwealth Games\n\nThe diving competitions at the 2018 Commonwealth Games in the Gold Coast, Australia was held from 10 to 14 April at the \nGold Coast Aquatic Centre.", "A total of ten events was contested (five for men and five for women).", "There were 11 participating nations in diving with a total of 69 athletes.", "The number of athletes a nation entered is in parentheses beside the name of the country." ], [ "Diving at the 2014 Commonwealth Games", "Diving at the 2014 Commonwealth Games\n\nThe diving competitions at the 2014 Commonwealth Games in Glasgow, Scotland took place between 30 July and 2 August at the Royal Commonwealth Pool in Edinburgh.", "It was one of two aquatic sports at the Games, along with swimming.", "The 2014 Games featured competitions in ten events (men and women events each of): 1m springboard, 3m springboard, synchronised 3m springboard, 10m platform, and synchronised 10m platform.", "Nine nations competed in diving at the 2014 Commonwealth Games." ], [ "Aquatics at the 2010 Commonwealth Games", "Aquatics at the 2010 Commonwealth Games\n\n", "The aquatics events at the 2010 Commonwealth Games took place at the SPM Swimming Pool Complex, Talkatora Gardens, Delhi from 4\u201313 October 2010.", "Events in the aquatic disciplines of swimming (long course), and diving were contested, with 46 sets of medals being competed for in total." ], [ "Diving at the 2018 Commonwealth Games \u2013 Men's 10 metre platform", "Diving at the 2018 Commonwealth Games \u2013 Men's 10 metre platform\n\nThe men's 10 metre platform was part of the Diving at the 2018 Commonwealth Games program.", "The competition was held on 14 April 2018 at Gold Coast Aquatic Centre in Gold Coast.", "The competition was held in two rounds:\n\nResults:\n\n\"Green denotes finalists\"" ] ], "gold": "Diving has been featured in many Commonwealth Games. The aquatics events at the 2010 Commonwealth Games took place at the SPM Swimming Pool Complex, Talkatora Gardens, Delhi from 4\u201313 October 2010. The diving competitions at the 2014 Commonwealth Games in Glasgow, Scotland took place between 30 July and 2 August at the Royal Commonwealth Pool in Edinburgh, while the diving competitions at the 2018 Commonwealth Games in the Gold Coast, Queensland was held from 10 to 14 April at the Gold Coast Aquatic Centre.", "prediction 1": "Diving is included in the aquatic sport program of the Commonwealth Games. It was included in the diving events of the 2010 Commonwealth Games, the 2010 Commonwealth Games and the 2014 Commonwealth Games. The diving competitions at the 2010 Commonwealth Games took place at the SPM Swimming Pool Complex, Talkatora Gardens, Delhi from 4\u201313 October 2010. At the 2014 Commonwealth Games it was included in the diving events of the Glasgow 2014 Commonwealth Games which took place between 30 July and 2 August at the Royal Commonwealth Pool in Edinburgh.", "prediction 2": "Diving is one of the two aquatic sports on offer at the Commonwealth Games, along with swimming. Throughout the games, diving was on in several events, including men's 10-metre platform and women's 10-metre platform. The diving competitions at the 2018 Commonwealth Games in the Gold Coast, Australia were held from 10 to 14 April at the Gold Coast Aquatic Centre.", "prediction 3": "Diving is one of two aquatic sports at the Commonwealth Games, along with swimming. It was on at the 2010 Commonwealth Games, and at the 2010 Commonwealth Games. In the 2010 Commonwealth Games, diving was on at the SPM Swimming Pool Complex, Talkatora Gardens, Delhi. In the 2018 Commonwealth Games, diving was on at the Gold Coast Aquatic Centre.", "prediction 4": "The diving competitions at the 2018 Commonwealth Games were held from 10 to 14 April at the Gold Coast Aquatic Centre. A total of ten events was contested (five for men and five for women), and 11 participating nations entered with a total of 69 divers. The diving competitions at the 2014 Commonwealth Games were held between 30 July and 2 August at the Royal Commonwealth Pool in Edinburgh.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Diving is included in the aquatic sport program of the Commonwealth Games.", "start": 354, "end": 421 }, { "error type": "Redundant", "explanation": "Diving is included in the aquatic sport program of the Commonwealth Games. ", "start": 75, "end": 204 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Diving is included in the aquatic sport program of the Commonwealth Games. The diving competitions at the 2010 Commonwealth Games took place at the SPM Swimming Pool Complex, Talkatora Gardens, Delhi from 4\u201313 October 2010, at the Glasgow 2014 Commonwealth Games which took place between 30 July and 2 August at the Royal Commonwealth Pool in Edinburgh, and at the 2018 Commonwealth Games, in the Gold Coast, Australia, held from 10 to 14 April, at the Gold Coast Aquatic Centre." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Player with most own goals in premier league?", "passages": [ [ "Football DataCo", "Football DataCo\n\nFootball DataCo is a British company in the football industry that grants licences to third parties (such as newspapers) allowing them to reproduce certain intellectual property (such as fixture lists and statistics) owned by the UK's three professional football leagues: the Premier League, The Football League and the Scottish Professional Football League.", "Many of Football DataCo's activities are contracted out to the Press Association (PA).", "Thus, PA Sport handles applications for and distributes fixture lists and produces the ACTIM statistics service on behalf of Football DataCo.", "Football DataCo is wholly owned by Premier League and The Football League.", "Football DataCo charges a standard fee for the reproduction of fixture lists, which currently stands at: \u00a3266 plus VAT to print the fixtures of one English club.", "Newspapers printing the fixtures of all clubs are charged around \u00a33,931 plus VAT by DataCo for a date ordered listing.", "The money accrued by Football DataCo for the rights to this data is distributed to league clubs on an egalitarian basis, approximately:\n\n\nThe company has been racked by controversy in the UK media, after a 2004 European Court of Justice ruling that the Premier League and Football League cannot use the European Database Directive to demand payment from media and pools companies for the publication of fixture lists." ], [ "Richard Dunne", "Richard Dunne\n\nRichard Patrick Dunne (born 21 September 1979) is an Irish former footballer and current television pundit for BT Sport, who played as a defender.", "He has made 431 Premier League appearances, including 253 for Manchester City.", "Dunne began his professional career at Everton.", "He later spent nearly a decade at Manchester City before joining Aston Villa in 2009.", "In July 2013, he signed for Queens Park Rangers.", "He has also played internationally for the Republic of Ireland from 2000 until 2014.", "With Ireland he was a member of the 2002 FIFA World Cup squad and played in UEFA Euro 2012.", "Dunne announced his retirement from football in November 2015 after being released by Queens Park Rangers.", "Dunne holds the Premier League record of being sent off \u2013 joint eight times along with Patrick Vieira and Duncan Ferguson.", "He also holds the Premier League record of scoring 10 own goals.", "Having played schoolboy football in Dublin for Home Farm, Dunne joined Everton as a 15-year-old schoolboy in the 1994\u201395 season.", "The next season, he started to play for Everton reserves and in early 1997, Dunne signed a 5-year professional contract.", "He was part of the successful 1998 FA Youth Cup squad along with Tony Hibbert and Leon Osman.", "Dunne made his debut under then manager Joe Royle in 1997, at the age of seventeen." ], [ "Martin \u0160krtel", "Martin \u0160krtel\n\nMartin \u0160krtel (; born 15 December 1984) is a Slovak professional footballer who plays as a centre back for Fenerbah\u00e7e and captains the Slovakia national team.", "He previously played for Tren\u010d\u00edn and Zenit Saint Petersburg, before joining Liverpool for \u00a36.5\u00a0million in January 2008.", "After eight-and-a-half years with Liverpool, where he played 319 official games and scored 18 goals, he joined Fenerbah\u00e7e.", "He has won the Russian Premier League and the League Cup, as well as being named Slovak Footballer of the Year four times.", "\u0160krtel made his international debut for Slovakia in 2004, and has since earned more than 100 caps.", "He represented the country as they reached the last 16 at both the 2010 FIFA World Cup and UEFA Euro 2016.", "\u0160krtel started his professional career at Tren\u010d\u00edn, where he played 44 games for them between 2001 and 2004.", "\u0160krtel made his debut for Zenit Saint Petersburg in a Russian Cup match on 31 July 2004.", "He said that the presence of Slovak and Czech players helped him to adjust to his new team.", "He played 113 times and scored 5 goals for the club, winning the Russian Premier League title in the 2007 season." ], [ "Lewis Dunk", "Lewis Dunk\n\nLewis Carl Dunk (born 21 November 1991) is an English professional footballer who plays as a centre back for club Brighton & Hove Albion and the England national team.", "Dunk was born in Brighton, East Sussex.", "On 30 April 2010, Dunk signed a two-year professional contract with Brighton & Hove Albion following impressive performances captaining the club's youth team.", "The following day, Dunk made his first professional appearance starting in the 0\u20130 draw at Milton Keynes Dons.", "On 31 January 2011, Dunk signed a one-year extension on his contract keeping him at the club until the summer of 2013.", "Dunk made eight appearances in the 2010\u201311 season as Brighton gained promotion to the Championship as League One champions.", "With fellow defenders Tommy Elphick and Adam El-Abd sidelined by injury, Dunk started the 2011\u201312 season alongside captain Gordon Greer, playing in Brighton's first ever match at Falmer Stadium versus Doncaster Rovers.", "On 4 October 2013, Dunk joined League One club Bristol City on a one-month loan deal, to gain some first-team football.", "On 25 July 2014, Dunk signed a new four-year contract with Brighton & Hove Albion which kept him at the club until the end of the 2017\u201318 season." ], [ "2009\u201310 Premier League", "The Premier League Player of the Season award was won by Wayne Rooney of Manchester United.", "The PFA Players' Player of the Year was awarded to Wayne Rooney.", "Goalkeeper: Joe Hart (Birmingham City)Defence: Patrice Evra (Manchester United), Branislav Ivanovi\u0107 (Chelsea), Thomas Vermaelen (Arsenal), Richard Dunne (Aston Villa)Midfield: James Milner (Aston Villa), Antonio Valencia, Darren Fletcher (both Manchester United), Cesc F\u00e0bregas (Arsenal)Attack: Wayne Rooney (Manchester United), Didier Drogba (Chelsea)\n\n", "The PFA Young Player of the Year was awarded to James Milner for the first time.", "Chelsea striker Didier Drogba won the Premier League Golden Boot award, scoring 29 goals in 32 appearances; this was the second time he won the award.", "The Premier League Fair Play Award was given to Arsenal, the team deemed to have been the most sporting and best behaved.", "Sunderland occupied last place as the least sporting side\n\nThe Public Fair Play League was again given to Chelsea for the third consecutive year.", "Chelsea collected the Premier League Merit Award for being the first team to score 100 goals in a Premier League season." ] ], "gold": "The Premier League is an English professional league for association football clubs. Richard Dunne, an Irish former footballer and current television pundit for BT Sport, who played as a defender, has the most own goals in the Premier League. Martin \u0160krtel, a Slovak professional footballer who plays as a centre back for Slovak Super Liga side FC Spartak Trnava, and Lewis Dunk, an English professional footballer who plays as a centre-back for Premier League club Brighton & Hove Albion, which he captains, and the England national team, have the most own goals in a season in the Premier League.", "prediction 1": "The player with the most own goals in the Premier League is Lewis Dunk of Brighton & Hove Albion. Lewis Dunk has scored 10 own goals in the Premier League in the 2017-18 season. Martin krtel of Fenerbah\u00e7e holds the record for most own goals in the Premier League.\n", "prediction 2": "Most own goals scored in the Premier League for any player is 10 by Duncan Ferguson of Arsenal, while Martin krtel of Fenerbah\u00e7e holds the record with eight. Lewis Dunk of Brighton & Hove Albion holds the record for the most own goals in the Premier League for a centre back.", "prediction 3": "United States professional footballer Shawn Matthias holds the record for the most own goals scored in the Premier League in the 2010\u201311 season. Aly Navratilov has scored the most own goals in the 2015-16 season in the Premier League. Dan Rather has scored the most own goals in the 2016-17 Premier League season. Lewis Dunk holds the record for the most own goals in the 2011\u201312 season for Brighton & Hove Albion.", "prediction 4": "In the Premier League, players with most own goals include Patrick Vieira, Mark Noble, and Duncan Ferguson. There is also Martin krtel, Lewis Dunk, and Patrick Vieira. All three players have goalscoring records for the premier league.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 98, "end": 177 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[10]}", "start": 215, "end": 240 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[10]}", "start": 60, "end": 97 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The player with the most own goals in the Premier League is Richard Dunne. He is an Irish former footballer and current television pundit for BT Sport, and played as a defender." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sings love you like there's no tomorrow?", "passages": [ [ "Love Me Like There's No Tomorrow", "Love Me Like There's No Tomorrow\n\n\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury, released in 1985 as the fourth and final single from his debut solo album \"Mr. Bad Guy\".", "It was written by Mercury, and produced by Reinhold Mack and Mercury.", "\"Love Me Like There's No Tomorrow\" reached No. 76 on the UK Singles Chart and remained in the Top 100 for two weeks.", "According to Peter Freestone, in his book \"Freddie Mercury: An Intimate Memoir by the Man Who Knew Him Best\", \"Love Me Like There's No Tomorrow\" was inspired by Mercury's relationship with the Austrian actress Barbara Valentin.", "Upon release, Peter Martin of \"Smash Hits\" described the song as \"one of [Mercury's] propping-up-the-piano-in-the-smoky-bar routines\".", "Tim Parker of \"Number One\" commented: \"Freddie Mercury tries his hand at a romantic George Michael ballad but ends up doing a Liberace.", "The king of camp should stick to high energy.\"", "In a retrospective review of \"Mr. Bad Guy\", Eduardo Rivadavia of AllMusic considered the song one of the album's \"winners\", \"help[ing] make this an outstanding record from start to finish\"." ] ], "gold": "Aaron and Thea Tippin sing the song Love Like There's No Tomorrow, and Freddie Mercury sings Love Me Like There's No Tomorrow.", "prediction 1": "\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury, released in 1985 as the fourth and final single from his debut solo album \"Mr. Bad Guy\". It was written by Mercury, and produced by Reinhold Mack and Mercury.\n", "prediction 2": "\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury, released in 1985 as the fourth and final single from his debut solo album Mr. Bad Guy. According to Peter Freestone, in his book \"Freddie Mercury: An Intimate Memoir by the Man Who Knew Him Best\", the song was inspired by Mercury's relationship with the Austrian actress Barbara Valentin.", "prediction 3": "\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury, released in 1985 as the fourth and final single from his debut solo album \"Mr. Bad Guy\". It was written by Mercury, and produced by Reinhold Mack and Mercury. The video for \"Love Me Like There's No Tomorrow\" was released on September 30, 2015.", "prediction 4": "\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury, released in 1985 as the fourth and final single from his debut solo album \"Mr. Bad Guy\". The song was written by Mercury, and produced by Reinhold Mack and Mercury.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 153 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 224 } ], "missing-info": [], "corrected-prediction": "\"Love Me Like There's No Tomorrow\" is a song by Freddie Mercury." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Where was the first st patrick's day parade held?", "passages": [ [ "Saint Patrick's Day", "Patrick's efforts against the druids were eventually turned into an allegory in which he drove \"snakes\" out of Ireland (Ireland never had any snakes).", "Tradition holds that he died on 17 March and was buried at Downpatrick.", "Over the following centuries, many legends grew up around Patrick and he became Ireland's foremost saint.", "Today's St Patrick's Day celebrations have been greatly influenced by those that developed among the Irish diaspora, especially in North America.", "Until the late 20th century, St Patrick's Day was often a bigger celebration among the diaspora than it was in Ireland.", "Celebrations generally involve public parades and festivals, Irish traditional music sessions (c\u00e9ilithe), and the wearing of green attire or shamrocks.", "There are also formal gatherings such as banquets and dances, although these were more common in the past.", "St Patrick's Day parades began in North America in the 18th century but did not spread to Ireland until the 20th century.", "The participants generally include marching bands, the military, fire brigades, cultural organisations, charitable organisations, voluntary associations, youth groups, fraternities, and so on.", "However, over time, many of the parades have become more akin to a carnival.", "More effort is made to use the Irish language, especially in Ireland, where the week of St Patrick's Day is \"Irish language week\"." ], [ "Saint Patrick's Day", "O'Mara later introduced the law which required that public houses be shut on 17 March after drinking got out of hand, a provision that was repealed in the 1970s.", "The first St Patrick's Day parade in Ireland was held in Waterford in 1903.", "The week of St Patrick's Day 1903 had been declared Irish Language Week by the Gaelic League and in Waterford they opted to have a procession on Sunday 15 March.", "The procession comprised the Mayor and members of Waterford Corporation, the Trades Hall, the various trade unions and bands who included the 'Barrack St Band' and the 'Thomas Francis Meagher Band'.", "The parade began at the premises of the Gaelic League in George's St and finished in the Peoples Park, where the public were addressed by the Mayor and other dignitaries.", "On Tuesday 17 March, most Waterford businesses\u2014including public houses\u2014were closed and marching bands paraded like they had two days previously.", "The Waterford Trades Hall had been emphatic that the National Holiday be observed.", "On St Patrick's Day 1916, the Irish Volunteers\u2014an Irish nationalist paramilitary organisation\u2014held parades throughout Ireland.", "The authorities recorded 38 St Patrick's Day parades, involving 6,000 marchers, almost half of whom were said to be armed.", "The following month, the Irish Volunteers launched the Easter Rising against British rule." ], [ "Saint Patrick's Day", "This marked the beginning of the Irish revolutionary period and led to the Irish War of Independence and Civil War.", "During this time, St Patrick's Day celebrations in Ireland were muted, although the day was sometimes chosen to hold large political rallies.", "The celebrations remained low-key after the creation of the Irish Free State; the only state-organized observance was a military procession and trooping of the colours, and an Irish-language mass attended by government ministers.", "In 1927, the Irish Free State government banned the selling of alcohol on St Patrick's Day, although it remained legal in Northern Ireland.", "The ban was not repealed until 1961.", "The first official, state-sponsored St Patrick's Day parade in Dublin took place in 1931.", "In Northern Ireland, the celebration of St Patrick's Day was affected by sectarian divisions.", "A majority of the population were Protestant Ulster unionists who saw themselves as British, while a substantial minority were Catholic Irish nationalists who saw themselves as Irish.", "Although it was a public holiday, Northern Ireland's unionist government did not officially observe St Patrick's Day.", "During the conflict known as the Troubles (late 1960s\u2013late 1990s), public St Patrick's Day celebrations were rare and tended to be associated with the Catholic community." ] ], "gold": "St Patrick's Day parades began in North America in the 18th century but did not spread to Ireland until the 20th century. Although the first Irish St. Patrick's Day parade was held in Waterford in 1903, the first state-sponsored iteration of the celebration took place in Dublin in 1931. Internationally, St. Patrick's Day parades first took place in 1992 in Moscow, Russia, and Tokyo, Japan, as well as in 1976 in Itaewon and Daehangno, Seoul, South Korea.", "prediction 1": "The first official, state-sponsored St Patrick's Day parade in Ireland was held in Waterford in 1903. The parade began at the premises of the Gaelic League in George's St and finished in the Peoples Park, where the public were addressed by the Mayor and other dignitaries. The first official, state-sponsored St Patrick's Day parade in Dublin took place in 1931.", "prediction 2": "The first St Patrick's Day parade in Ireland was held in Waterford in 1903. The week of St Patrick's Day 1903 had been declared Irish Language Week by the Gaelic League and in Waterford they opted to have a procession on Sunday 15 March. The parade began at the premises of the Gaelic League in George's St and finished in the Peoples Park, where the public were addressed by the Mayor and other dignitaries.", "prediction 3": "The first official, state-sponsored St. Patrick's Day parade in Ireland was held in Waterford in 1903. It was held in the grounds of the Gaelic League in George's St. in Waterford, Ireland. The parade began at the premises of the Gaelic League in George's St and finished in the Peoples Park, where the public were addressed by the Mayor and other dignitaries. The first official, state-sponsored St. Patrick's Day parade in Dublin was held in 1931.", "prediction 4": "The first official St. Patrick's Day parade in Ireland was held in Waterford in 1903. The parade began at the premises of the Gaelic League in George's St and finished in the Peoples Park, where the public were addressed by the Mayor and other dignitaries.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 272 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "St Patrick's Day parades began in North America in the 18th century but did not spread to Ireland until the 20th century. The first official, state-sponsored St Patrick's Day parade in Ireland was held in Waterford in 1903. The first official, state-sponsored St Patrick's Day parade in Dublin took place in 1931." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Where does eastern time zone change to central?", "passages": [], "gold": "Some states observe both the eastern time zone and the central time zone. In the Midwest, the Midway through Kentucky and Tennessee observe the eastern time zone change to central. In the south, midway through Florida also experience both the eastern time zone and the central time zone and in the north, between Michigan and Wisconsin, they observe their time zone change from eastern time zone to central. ", "prediction 1": "Eastern time zone changes to central on Wednesdays.", "prediction 2": "Eastern time zone changes to central on the day that the East Time Zone changes to Eastern.", "prediction 3": "Eastern time zone changes to central at 12:01 am on December 11, 2013 at 12:01 pm Pacific Time.", "prediction 4": "Eastern time zone changes to central from Eastern.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 51 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played the cowbell on don't fear the reaper?", "passages": [ [ "(Don't Fear) The Reaper", "\u2018The legendary once-in-a-lifetime groove!\u2019", "\u2026 What evolved in the studio was the extended solo section; it took them nearly as long to edit the five-minute track down to manageable length as it did to record it.\"", "The song features prominent use of the cowbell percussion instrument, overdubbed on the original recording.", "Bassist Joe Bouchard remembered the producer requesting his brother, drummer Albert Bouchard, play the cowbell: \"Albert thought he was crazy.", "But he put all this tape around a cowbell and played it.", "It really pulled the track together.\"", "However, producer David Lucas says that he played it, a claim supported by bandmember Eric Bloom.", "The song was on the \"Billboard\" Hot 100 chart for 20 weeks, reaching number 12 for the weeks beginning November 6 and November 13 in 1976.", "It was B\u00d6C's highest-charting U.S. song and helped \"Agents of Fortune\" reach number 29 on the \"Billboard\" 200.", "\"(Don't Fear)", "The Reaper\" charted even higher in Canada, peaking at number 7.", "The single edit was released in the UK in July 1976 (CBS 4483) but failed to chart." ], [ "(Don't Fear) The Reaper", "(Don't Fear)", "The Reaper\n\n\"(Don't Fear)", "The Reaper\" is a song by American rock band Blue \u00d6yster Cult from the band's 1976 album \"Agents of Fortune.\"", "The song, written and sung by lead guitarist Donald \"Buck Dharma\" Roeser, deals with eternal love and the inevitability of death.", "Dharma wrote the song while picturing an early death for himself.", "Released as an edited single (omitting the slow building interlude in the original), the song was Blue \u00d6yster Cult's highest chart success, reaching #7 in \"Cash Box\" and #12 on the \"Billboard\" Hot 100 in late 1976.", "Critical reception was mainly positive, and in 2004, \"(Don't Fear)", "The Reaper\" was listed at number 405 on the \"Rolling Stone\" list of the top 500 songs of all time.", "The song is about the inevitability of death and the foolishness of fearing it, and was written when Dharma was thinking about what would happen if he died at a young age.", "Lyrics such as \"Romeo and Juliet are together in eternity\" have led many listeners to interpret the song to be about a murder-suicide pact, but Dharma says the song is about eternal love, rather than suicide." ], [ "(Don't Fear) The Reaper", "In 1997 \"Mojo\" listed the song as the 80th best single of all time, while \"Q\" ranked \"(Don't Fear)", "The Reaper\" number 404 in its 2003 countdown of the \"1001 Best Songs Ever.\"", "When \"The Guardian\" released its unranked list of the \"1000 Songs Everyone Must Hear\" in 2009, the song was included.", "The publication wrote that the song's charm \"lies in the disjuncture between its gothic storyline and the sprightly, Byrdsian guitar line that carries it.\"", "In his book \"The Heart of Rock and Soul: The 1001 Greatest Singles Ever Made,\" rock critic Dave Marsh ranked the song at number 997.", "Blue \u00d6yster Cult performed a live version of \"(Don't Fear) The Reaper\" on the band's 1978 album \"Some Enchanted Evening\".", "A live version appears on their 1982 album \"Extraterrestrial Live\".", "Blue \u00d6yster Cult's 1991 live album \"Live 1976\" features \"(Don't Fear)", "The Reaper\".", "A live version appears on their 2002 album \"A Long Day's Night\".", "Buck Dharma released an acoustic version of the song on the 1994 various artists compilation album \"Guitar Practicing Musicians 3\".", "Gus Black covered the song in 1996 for the \"Scream\" soundtrack." ] ], "gold": "There is some dispute among members of American rock band Blue \u00d6yster Cult as to who played the cowbell overdubbed on their original recording of the 1976 song \"(Don't Fear) The Reaper\". Bassist Joe Bouchard remembered his brother, drummer Albert Bouchard playing the instrument, while produced David Lucas and guitarist Eric Bloom remember Lucas doing it instead.", "prediction 1": "(Don't Fear) The Reaper is a song by American rock band Blue yster Cult from the band's 1976 album Agents of Fortune. The song features prominent use of the cowbell percussion instrument, overdubbed on the original recording. Producer David Lucas says he played it, a claim supported by bandmember Eric Bloom.", "prediction 2": "Blue yster Cult's song \"(Don't Fear) The Reaper\" features prominent use of the cowbell percussion instrument, overdubbed on the original recording. Producer David Lucas says that he played the cowbell, a claim supported by bandmember Eric Bloom. Blue yster Cult performed a live version of \"(Don't Fear) The Reaper\" on their 1978 album \"Some Enchanted Evening\". A live version appears on their 1982 album \"Extraterrestrial Live.\"", "prediction 3": "The 1976 song (Don't Fear) The Reaper features prominent use of the cowbell percussion instrument, overdubbed on the original recording. Bassist Joe Bouchard remembered the producer requesting his brother, drummer Albert Bouchard, play the cowbell. However, producer David Lucas says that he played it, a claim supported by bandmember Eric Bloom. Blue yster Cult performed a live version of ((Don't Fear) The Reaper) on their 1978 album Some Enchanted Evening.", "prediction 4": "(Don't Fear) The Reaper is a song by American rock band Blue yster Cult from the band's 1976 album Agents of Fortune. The song features prominent use of the cowbell percussion instrument, overdubbed on the original recording. Producer David Lucas says that he played the cowbell, a claim supported by bandmember Eric Bloom.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "(Don't Fear) The Reaper is a song by American rock band Blue \u00d6yster Cult from the band's 1976 album Agents of Fortune. The song features prominent use of the cowbell percussion instrument, overdubbed on the original recording. Producer David Lucas says he played it, a claim supported by bandmember Eric Bloom. Bassist Joe Bouchard remembered the producer requesting his brother, drummer Albert Bouchard, play the cowbell. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who did the us support in the bosnian war?", "passages": [ [ "Bosnia and Herzegovina\u2013United States relations", "Bosnia and Herzegovina\u2013United States relations\n\nThe 1992-95 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement.", "The United States maintains command of the NATO headquarters in Sarajevo.", "The United States has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia.", "The U.S. Agency for International Development (USAID) and Support for Eastern European Democracies (SEED) has played a large role in post-war Bosnia and Herzegovina, including programs in economic development and reform, democratic reform (media, elections), infrastructure development, and training programs for Bosnian professionals, among others.", "Additionally, there are many non-governmental organizations (NGOs) that have likewise played significant roles in the reconstruction.", "According to the 2012 U.S. Global Leadership Report, 33% of Bosnia and Herzegovina's people approve of U.S. leadership, with 49% disapproving and 18% uncertain.", "The U.S. Embassy in Bosnia and Herzegovina is in Sarajevo.", "Bosnia and Herzegovina has an embassy in Washington, D.C.", "The US Ambassador is Maureen Cormack." ], [ "Women in Bosnia and Herzegovina", "Women in Bosnia and Herzegovina\n\nWomen in Bosnia and Herzegovina are European women who live in and are from Bosnia and Herzegovina.", "According to International Fund for Agricultural Development (IFAD), women of Bosnia and Herzegovina have been affected by three types of transition after the Bosnian War (1992-1995): the \"transition from war to peace\", economic transition, and political transition.", "Bosnia and Herzegovina declared sovereignty in 1991 and independence from the former SFR Yugoslavia in 1992.", "The Bosnian War (1992-1995) was responsible for extreme acts of violence (ethnic cleansing in the Bosnian War) and an economic collapse.", "Today Bosnia and Herzegovina is a multi-ethnic and multi-religious society - the population consists of: Bosniaks 48.4%, Serbs 32.7%, Croats 14.6%, and others 4.3%; while the religious makeup is: Muslim 40%, Orthodox 31%, Roman Catholic 15%, and other 14% (as of 2013).", "Most of the population is rural: only 39.8% of total population is urban.", "The literacy rate for age 15 and over is higher for males (99.5%) than females (97.5%) - 2015 est.", "Guided by the constitution of Bosnia and Herzegovina, the country's Gender Equality Law of 2003 was passed to promote and advance the equality between men and women." ], [ "Radovan Karad\u017ei\u0107", "It declared that the state's territory included Serb autonomous regions, municipalities, and other Serbian ethnic entities in Bosnia and Herzegovina, as well as \"all regions in which the Serbian people represent a minority due to the Second World War genocide\" (although how this was established was never specified), and that it was to be a part of the federal Yugoslav state.", "On 29\u00a0February and 1\u00a0March 1992 a referendum on the independence of Bosnia and Herzegovina from Yugoslavia was held.", "Many Serbs boycotted the referendum and pro-independence Bosniaks (Muslims) and Croats turned out.", "On 6\u00a0and 7\u00a0April 1992, Bosnia was recognized as an independent state by the European Community and the US.", "It was admitted to the UN on 22\u00a0May 1992.", "Karad\u017ei\u0107 was voted President of Republika Srpska, the Bosnian Serb administration, in Pale on about 13\u00a0May 1992 after the breakup of the Socialist Federal Republic of Yugoslavia.", "At the time he assumed this position, his \"de jure\" powers, as described in the constitution of the Bosnian Serb administration, included commanding the army of the Bosnian Serb administration in times of war and peace, and having the authority to appoint, promote and discharge officers of the army.", "Karad\u017ei\u0107 made three trips to the UN in New York in February and March\u00a01993 for negotiations on the future of Bosnia." ] ], "gold": "The Bosnian War took place in 1992-95 in Bosnia and Herzegovina, a former Ottoman province that has historically been a multi-ethnic state. The war was a result of the breakup of the Socialist Federal Republic of Yugoslavia. The United States supported the Bosnian Army through the CIA, and also supported the international organization, NATO, during the war.", "prediction 1": "The 1992-95 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement. The US has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia. Additionally, the US Agency for International Development (USAID) and Support for Eastern European Democracies (SEED) has played a large role in post-war Bosnia and Herzegovina, including programs in economic development and reform, democratic reform, infrastructure development, and training programs for Bosnian professionals, among others. Additionally, there are many non-governmental organizations that have likewise played significant roles in the reconstruction.", "prediction 2": "The 1992-1995 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement. The US has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia. Additionally, the US Agency for International Development and Support for Eastern European Democracies has played a large role in post-war Bosnia and Herzegovina, including programs in economic development and reform, democratic reform, infrastructure development, and training programs for Bosnian professionals, among others. Additionally, there are many non-governmental organizations that have likewise played significant roles in the reconstruction.", "prediction 3": "The 1992-1995 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement. The US has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia. The US Agency for International Development and Support for Eastern European Democracies has played a large role in post-war Bosnia and Herzegovina, including programs in economic development and reform, democratic reform, infrastructure development, and training programs for Bosnian professionals, among others.", "prediction 4": "The 1992-95 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement. The US has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia. The US Agency for International Development and Support for Eastern European Democracies (SEED) has played a large role in post-war Bosnia and Herzegovina, including programs in economic development and reform, democratic reform (media, elections), infrastructure development, and training programs for Bosnian professionals, among others.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 661 }, { "error type": "Irrelevant", "explanation": "", "start": 662, "end": 788 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The 1992-95 war in Bosnia and Herzegovina was ended with the help of participation by the United States in brokering the 1995 Dayton Agreement. The war was a result of the breakup of the Socialist Federal Republic of Yugoslavia. The US has donated hundreds of millions of dollars to help with infrastructure, humanitarian aid, economic development, and military reconstruction in Herzegovina and Bosnia. " }, "preference": [ 0, 2, 2, 2, 2, 0 ] }, { "question": "Who wrote the song the little drummer boy?", "passages": [ [ "The Little Drummer Boy", "The Little Drummer Boy\n\n\"The Little Drummer Boy\" (originally known as \"Carol of the Drum\") is a popular Christmas song written by the American classical music composer and teacher Katherine Kennicott Davis in 1941.", "First recorded in 1951 by the Trapp Family Singers, the song was further popularized by a 1958 recording by the Harry Simeone Chorale; the Simeone version was re-released successfully for several years and the song has been recorded many times since.", "In the lyrics the singer relates how, as a poor young boy, he was summoned by the Magi to the Nativity of Jesus.", "Without a gift for the infant the little drummer boy played his drum with Jesus' mother, Mary's approval; recalling, \"I played my best for him\" and \"He smiled at me.\"", "The content of the song \u2014 encouraging a boy to bang a drum to please a newborn \u2014 is one reason it was selected for the song-avoidant Little Drummer Boy Challenge in 2010.", "The song was originally titled \"Carol of the Drum\" and was published by Davis based upon a traditional Czech song \"Tlu\u010de buben\u00ed\u010dek\"." ], [ "The Little Drummer Boy", "Davis's interest was in producing material for amateur and girls' choirs: Her manuscript is set as a chorale, in which the tune is in the soprano melody with alto harmony, tenor and bass parts producing the \"drum rhythm\" and a keyboard accompaniment \"for rehearsal only\".", "It is headed \"Czech Carol freely transcribed by K.K.D. \", these initials then deleted and replaced with \"C.R.W. Robinson\", a name under which Davis sometimes published.", "The Czech original of the carol has never been identified.", "\"Carol of the Drum\" appealed to the Austrian Trapp Family Singers, who first brought the song to wider prominence when they recorded it for Decca Records in 1951 on their first album for Decca.", "Their version was credited solely to Davis and published by Belwin-Mills.", "In 1957 it was recorded, with a slightly altered arrangement, by the Jack Halloran Singers for their album \"Christmas Is A-Comin\"' on Dot Records.", "Dot's Henry Onorati introduced the song to his friend Harry Simeone and the following year, when 20th Century Fox Records contracted him to make a Christmas album, Simeone, making further small changes to the Halloran arrangement and retitling it \"The Little Drummer Boy\", recorded it with the Harry Simeone Chorale on the album \"Sing We Now of Christmas\"." ] ], "gold": "Popular Christmas song \"The Little Drummer Boy\" was written by the American classical music composer and teacher Katherine Kennicott Davis in 1941. Davis published the song as \"Czech Carol freely transcribed by K.K.D.\", although her initials were later replaced with her pseudonym C.R.W. Robinson. The version of the song most commonly sung today was arranged by Jack Halloran for Dot Records, which led to Dot producer Henry Onorati and his friend Harry Simeone releasing a near-identical version of the song for which they claimed and received joint composition credits with Davis, despite never composing, writing, or arranging the piece.", "prediction 1": "The popular Christmas song \"The Little Drummer Boy\" was written by the American classical music composer and teacher Katherine Kennicott Davis in 1941 and first recorded in 1951 by the Trapp Family Singers. It was further popularized by a 1958 recording by the Harry Simeone Chorale, in which Simeone performed the chorus.", "prediction 2": "\"The Little Drummer Boy\" is a popular Christmas song written by the American classical music composer Katherine Kennicott Davis in 1941. First recorded in 1951 by the Trapp Family Singers, the song was further popularized by a 1958 recording by the Harry Simeone Chorale. The Simeone version was re-released successfully for several years and the song has been recorded many times since.", "prediction 3": "\"The Little Drummer Boy\" is a popular Christmas song that was written by the American classical music composer and teacher Katherine Kennicott Davis in 1941. First recorded in 1951 by the Trapp Family Singers, the song was further popularized by a 1958 recording by the Harry Simeone Chorale and has been recorded many times since. The Czech original of the song, Tlue bubenek, was first heard in Czech by the Austrian Trapp Family Singers and has never been identified.", "prediction 4": "The popular Christmas song The Little Drummer Boy was written by the American classical music composer and teacher Katherine Kennicott Davis in 1941. First recorded in 1951 by the Trapp Family Singers, the song was further popularized by a 1958 recording by the Harry Simeone Chorale. The Simeone version was re-released successfully for several years and the song has been recorded many times since. The original Czech version of the song was called a Tlue bubenek and is a version of a song written by Davis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 322 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The popular Christmas song \"The Little Drummer Boy\" was written by the American classical music composer and teacher Katherine Kennicott Davis in 1941. It is headed \"Czech Carol freely transcribed by K.K.D. \", these initials then deleted and replaced with \"C.R.W. Robinson\". It was recorded by the Jack Halloran Singers on Dot Records." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did cars start to have air conditioning?", "passages": [ [ "Automobile air conditioning", "Automobile air conditioning\n\nAutomobile air conditioning (also called A/C) systems use air conditioning to cool the air in a vehicle.", "A company in New York City in the United States first offered installation of air conditioning for cars in 1933.", "Most of their customers operated limousines and luxury cars.", "In 1939, Packard became the first automobile manufacturer to offer an air conditioning unit in its cars.", "These were manufactured by Bishop and Babcock Co, of Cleveland, Ohio.", "The \"Bishop and Babcock Weather Conditioner\" also incorporated a heater.", "Cars ordered with the new \"Weather Conditioner\" were shipped from Packard's East Grand Boulevard facility to the B&B factory where the conversion was performed.", "Once complete, the car was shipped to a local dealer where the customer would take delivery.", "Packard fully warranted and supported this conversion, and marketed it well.", "However, it was not commercially successful for a number of reasons:\n\n", "The option was discontinued after 1941.", "The 1953 Chrysler Imperial was one of the first production cars in twelve years to offer modern automobile air conditioning as an option, following tentative experiments by Packard in 1940 and Cadillac in 1941.", "Walter Chrysler had seen to the invention of Airtemp air conditioning in the 1930s for the Chrysler Building, and had offered it on cars in 1941-42, and again in 1951-52." ], [ "Automobile air conditioning", "Although air conditioners use significant power; the drag of a car with closed windows is less than if the windows are open to cool the occupants.", "There has been much debate on the effect of air conditioning on the fuel efficiency of a vehicle.", "Factors such as wind resistance, aerodynamics and engine power and weight must be considered, to find the true difference between using the air conditioning system and not using it, when estimating the actual fuel mileage.", "Other factors can affect the engine, and an overall engine heat increase can affect the cooling system of the vehicle.", "The innovation was adopted quickly and new features to air conditioning like the Cadillac Comfort Control which was a completely automatic heating and cooling system set by dial thermostat was introduced as an industry first in the 1964 model year.", "By 1960 about 20% of all cars in the U.S. had air-conditioning, with the percentage increasing to 80% in the warm areas of the Southwest.", "American Motors made air conditioning standard equipment on all AMC Ambassadors starting with the 1968 model year, a first in the mass market, with a base price starting at $2,671.", "By 1969, 54% of domestic automobiles were equipped with air conditioning, with the feature needed not only for passenger comfort, but also to increase the car's resale value.", "A car cooler is an automobile evaporative cooler, sometimes referred to as a swamp cooler." ], [ "Nash Rambler", "Nash Rambler\n\nThe Nash Rambler is a North American automobile that was produced by the Nash Motors division of Nash-Kelvinator Corporation from 1950 to 1954.", "On May 1, 1954, Nash-Kelvinator merged with the Hudson Motor Car Company to form American Motors Corporation (AMC).", "The Nash Rambler was then built by AMC in Kenosha, Wisconsin through 1955.", "The Nash Rambler established a new segment in the automobile market and is widely acknowledged to be the first successful modern American compact car.", "The 1950\u20131955 Nash Rambler was the first model run for this automobile platform.", "Using the same tooling, AMC reintroduced an almost identical \"new\" 1958 Rambler American for a second model run.", "This was a rare feat of having two distinct and successful model runs, an almost unheard of phenomenon in automobile history.", "Nash-Kelvinator's President George W. Mason saw that the company needed to compete more effectively and insisted a new car had to be different from the existing models in the market offered by the \"Big Three\" U.S. automakers.", "The Rambler was designed to be smaller than contemporary cars, yet still accommodate five passengers comfortably.", "Nash engineers had originally penned the styling during World War II.", "The new model was the company's entry in the lower-price segment dominated by models from Chevrolet, Ford, and Plymouth." ] ], "gold": "In 1933, a company in the United States first started offering the installation of air conditioning in cars. Most of their customers operated limousines and luxury cars. It wasn't until 1968 that American Motors, the first automobile manufacturing company to do so, made air conditioning part of the standard features of a car, starting with their AMC Ambassadors model.", "prediction 1": "Automobile air conditioning systems use air conditioning to cool the air in a vehicle. A company in New York City in the United States first offered installation of air conditioning for cars in 1933. In 1939, Packard became the first automobile manufacturer to offer an air conditioning unit in its cars. The 1953 Chrysler Imperial was one of the first production cars in twelve years to offer modern automobile air conditioning as an option, following tentative experiments by Packard in 1940 and Cadillac in 1941. American Motors made air conditioning standard equipment on all AMC Ambassadors starting with the 1968 model year, a first in the mass market, with a base price starting at $2,671. In 1968, 54% of domestic automobiles were equipped with air conditioning, with the feature needed not only for passenger comfort, but also to increase the car's resa feature needed not only for passenger comfort, but also to increase the car's resa feature needed not only for passenger", "prediction 2": "Automobile air conditioning systems use air conditioning to cool the air in a vehicle. A company in New York City in the United States first offered installation of air conditioning for cars in 1933. In 1939, Packard became the first automobile manufacturer to offer an air conditioning unit in its cars. These were manufactured by Bishop and Babcock Co, of Cleveland, Ohio. The 1953 Chrysler Imperial was one of the first production cars in twelve years to offer modern automobile air conditioning as an option, following tentative experiments by Packard in 1940 and Cadillac in 1941. American Motors made air conditioning standard equipment on all Ambassadors starting with the 1968 model year, a first in the mass market, with a base price starting at $2,671.", "prediction 3": "Automobile air conditioning systems use air conditioning to cool the air in a vehicle. A company in New York City, United States first offered installation of air conditioning for cars in 1933. In 1939, Packard became the first automobile manufacturer to offer an air conditioning unit in its cars. These were manufactured by Bishop and Babcock Co, of Cleveland, Ohio. By 1960 about 20% of all cars in the U.S. had air conditioning as an option, with the percentage increasing to 80% in the warm areas of the Southwest. American Motors made air conditioning standard equipment on all AMC Ambassadors starting with the 1968 model year, a first in the mass market, a first in the mass market, with a base price starting at $2,671. By 1969, 54% of domestic automobiles were equipped with air conditioning, with the feature needed not only for passenger comfort, but also to increase the car's resa", "prediction 4": "Automobile air conditioning systems use air conditioning to cool the air in a vehicle. A company in New York City in the United States first offered installation of air conditioning for cars in 1933. In 1939, Packard became the first automobile manufacturer to offer an air conditioning unit in its cars. The 1953 Chrysler Imperial was one of the first production cars in twelve years to offer modern automobile air conditioning as an option, following tentative experiments by Packard in 1940 and Cadillac in 1941. American Motors made air conditioning standard equipment on all AMC Ambassadors starting with the 1968 model year, a first in the mass market, with a base price starting at $2,671. By 1969, 54% of domestic automobiles were equipped with air conditioning, with the feature needed not only for passenger comfort, but also to increase the car's resa feature needed not only for passenger comfort, but also to increase the car's resa great increase the car's", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 86 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 515 }, { "error type": "Irrelevant", "explanation": "", "start": 659, "end": 696 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 700, "end": 705 }, { "error type": "Irrelevant", "explanation": "", "start": 706, "end": 826 }, { "error type": "Incoherent", "explanation": "", "start": 827, "end": 870 }, { "error type": "Redundant", "explanation": "needed not only for passenger comfort, ", "start": 871, "end": 909 }, { "error type": "Incoherent", "explanation": "", "start": 910, "end": 983 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A company in the United States first offered installation of air conditioning for cars in 1933. Most of their customers operated limousines and luxury cars. American Motors made air conditioning standard equipment on all AMC Ambassadors starting with the 1968 model year, a first in the mass market. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Where did australia come in the world cup?", "passages": [ [ "Australia at the FIFA World Cup", "Australia at the FIFA World Cup\n\nThe Australia national soccer team, nicknamed the Socceroos, has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018.", "In Australia's first appearance, representing OFC, a team made up entirely of amateurs secured a scoreless draw against Chile, though eventually departed from the 1974 tournament without a goal to show from their inaugural appearance.", "Australia made up for lost time at Germany 2006 and qualified for the Round of 16 before narrowly falling to eventual champions Italy.", "The German theme continued at South Africa 2010 although this time Australia, now representing the AFC, suffered a 4-0 loss against the European giants in a scoreline which ultimately scuppered their progress.", "A ten-man 1\u20131 draw against Ghana and a 2\u20131 win against Serbia saw Australia eliminated on goal difference, three goals off the Africans.", "Australia were to lose all three games in a tough group at Brazil 2014.", "Correct as of 27 June 2018 (vs. )\n\n\n", "Note : \u0160imuni\u0107 was given three yellow cards in the match: the referee (Graham Poll) failed to send him off the pitch after the second yellow, and was only red carded after the third yellow." ], [ "Mark Viduka", "In the 47th minute of the game Archie Thompson crossed to Viduka, who controlled the ball, thought about appealing for handball but then had time to crash the ball into the net.", "Viduka thrived under Guus Hiddink's tenure as coach of the national squad and led Australia as it qualified for the 2006 FIFA World Cup in Germany over a two-leg qualifier against Uruguay.", "In the second leg, during the first half a swift flick kick from Viduka found Harry Kewell inside the box.", "Kewell scuffed his shot but the ball bounced kindly to Mark Bresciano who went on to score the goal that forced the Qualifier to go to a penalty shoot out.", "Viduka would go on to miss his penalty, however Australia went on to win the shootout anyway.", "It was the first time in 32 years that Australia qualified to participate in the World Cup.", "On 21 May 2006, he was named as the Australian captain for the World Cup.", "In a lead up to the World Cup, Viduka captained Australia to friendly matches against the Netherlands and Greece.", "The Greece game was played at the Melbourne Cricket Ground.", "Australia won 1-0.", "Australia's game with the Netherlands ended with a 1-1 draw.", "After trailing 1-0 Australia earned a penalty in the second half." ], [ "Australia at the Cricket World Cup", "Australia at the Cricket World Cup\n\nThe Australian cricket team is the most successful team in the Cricket World Cup winning the 1987, 1999, 2003, 2007 and 2015 editions.", "This also makes them the only team to have won the world cup in all the regions (group of countries) that have hosted the world cup till now.", "Besides, Australia had reached the finals of the 1975 and 1996 World cups losing to West Indies and Sri Lanka respectively.", "They also reached quarterfinals of 2011 Cricket World Cup, and were knocked out in first round three times : 1979, 1983 and 1992.", "Though they have won world cup record five times, they are also the only team considered as tournament favorites for every world cup, right from 1975 to present.", "The team has played total 85 world cup matches, the highest of any team.", "Its overall win-loss record is 61-21 (which gives it the highest win percentage among all teams playing the world cup), with one tied match and two being abandoned due to rain.", "White: Group/Round-Robin Stage\n\n\nThe 1975 Cricket World Cup was the first Cricket World Cup.", "It was held in England in June 1975 and consisted of two weeks of one-day matches played 60-overs-a-side.", "The format consisted of a group stage, in which each team played the other three teams in its group of four." ] ], "gold": "Australia came in 30th in the 2018 FIFA world cup in Group Stage level. In the 2015 Women's FIFA world cup, they made it to the Quarter-finals. In 2018, they came in 7th place. And, in the 2019 Women's FIFA world cup, they made it to Round of 16.", "prediction 1": "The Australian national soccer team, nicknamed the Socceroos, has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018. In Australia's first appearance, representing OFC, a team made up entirely of amateurs secured a scoreless draw against Chile, though ultimately departed from the 1974 tournament without a goal to show from their inaugural appearance. In the 2006 FIFA World Cup, Australia qualified for the Round of 16 before narrowly falling to eventual champions Italy. In the 2011 FIFA World Cup, Australia were to lose all three games in a tough group at Brazil 2014 and were to win the shootout anyway. In the 2015, Australia reached the quarterfinals and were knocked out in the first round three times : 1979, 1983 and 1992.", "prediction 2": "The Australia national soccer team, nicknamed the Socceroos, has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018. In the 2010 FIFA World Cup, Australia lost 1-0 to eventual champions Italy, while in the 2006 Cricket World Cup, Australia lost 1-0 to West Indies.", "prediction 3": "The Australian national soccer team, nicknamed the Socceroos, has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018. In the Cricket World Cup, Australia came in Group D as the second-place team, after the Netherlands and the Netherlands' 1-0 victory over Australia in the first match. In the FIFA World Cup, Australia came in Group D as the third-place team, after South Africa's defeat to India and Brazil's 1\u20131 loss to Italy. In the Cricket World Cup, Australia reached the quarterfinals of the 2011 Cricket World Cup and were knocked out in the first round after 1-0 in the second leg in the World Cup.", "prediction 4": "In the World Cup, the Australia national soccer team has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018. In the Cricket World Cup, the Australian cricket team is the most successful team in the Cricket World Cup winning the 1987, 1999, 2003, 2007 and 2015. In the FIFA World Cup, the Australian soccer team has represented Australia at the FIFA World Cup finals on five occasions: in 1974, 2006, 2010, 2014 and 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 627, "end": 663 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 171 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 671, "end": 676 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": " In Australia's first appearance, representing OFC, a team made up entirely of amateurs secured a scoreless draw against Chile, though ultimately departed from the 1974 tournament without a goal to show from their inaugural appearance. In the 2006 FIFA World Cup, Australia qualified for the Round of 16 before narrowly falling to eventual champions Italy. In the 2011 FIFA World Cup, Australia were to lose all three games in a tough group at Brazil 2014. The Australian cricket team is the most successful team in the Cricket World Cup winning the 1987, 1999, 2003, 2007 and 2015 editions. Australia had reached the finals of the 1975 and 1996 World cups, and also reached quarter finals of 2011 Cricket World Cup, and were knocked out in first round three times : 1979, 1983 and 1992." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who were the survivors of the sosoliso plane crash?", "passages": [ [ "Sosoliso Airlines Flight 1145", "At first Loyola Jesuit College students from Port Harcourt traveled between school and their homes via buses using the roads.", "Rising crime along roads during the 1990s made parents believe that road travel was too dangerous.", "In 2001, when Sosoliso Airlines began services between Port Harcourt and Abuja parents placed their children on the flights.", "Among the victims were two volunteers for Medecins Sans Frontieres/Doctors Without Borders en route to work in Port Harcourt, Hawah Kamara and Thomas Lamy, as well as televangelist Bimbo Odukoya, pastor of the Fountain of Life Church, who succumbed to her injuries the day after the accident.", "Pastor Odukoya's personal assistant, Bunmi Amusan (now Bunmi Adams) survived the plane crash and got married a year later.", "Another victim was Okoloma Maduewesi, a childhood friend of Nigerian writer Chimamanda Ngozi Adichie, who she fondly remembers as the first person to call her a feminist.", "The other survivor, Okwuchi, was badly burned and treated at Milpark Hospital in Johannesburg, South Africa as of 14 December 2005, and at Shriners Hospitals for Children in Galveston, Texas, United States as of 6 September 2007." ], [ "Loyola Jesuit College", "The school is one of the most noted in the annual Cowbell Mathematics Competition.", "Most of the groups at Loyola Jesuit College were formed and are student run.", "At first students from Port Harcourt travelled between school and their homes via buses on the roads.", "Rising crime along roads during the 1990s made parents believe that road travel was too dangerous.", "In 2001, when Sosoliso Airlines began services between Port-Harcourt and Abuja, parents placed their children on the flights.", "On December 10, 2005, Loyola Jesuit College lost 60 students in the crash of Sosoliso Airlines Flight 1145.", "Among the many students who lost their lives was a family of three siblings and the Head Boy of the school at the time.", "The crash claimed 107 lives with two survivors, one of whom was Kechi Okwuchi, a student at Loyola Jesuit College.", "Kechi was treated at Milpark Hospital in Johannesburg, South Africa, and at Shriners Hospitals for Children in Galveston, Texas, United States.", "A new multi-purpose auditorium, Memorial Hall, was built in memory of the students who died in the crash." ], [ "Sosoliso Airlines Flight 1145", "Sosoliso Airlines Flight 1145\n\nSosoliso Airlines Flight 1145 (SO1145/OSL1145) was a scheduled domestic passenger flight between the Nigerian cities of Abuja (ABV) and Port Harcourt (PHC).", "At about 14:08 local time (13:08 UTC) on 10 December 2005, Flight 1145 from Abuja crash-landed at Port Harcourt International Airport.", "The plane, a McDonnell Douglas DC-9-32 with 110 people on board, slammed into the ground and burst into flames.", "Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived.", "It was the second air disaster to occur in Nigeria in less than three months, after Bellview Airlines Flight 210, which crashed on 22 October 2005 for reasons unknown, killing all 117 people on board.", "It was the company's first and only fatal accident.", "The aircraft departed Abuja's Nnamdi Azikiwe International Airport at 12:25 p.m UTC (Coordinated Universal Time).", "The route had a scheduled time enroute of 2 hours and 40 minutes.", "About 90 miles from the airport, the aircraft contacted ATC (Air Traffic Control) for initial descent clearance and was cleared by ATC to FL160." ] ], "gold": "Sosoliso Airlines Flight 1145 was a scheduled domestic passenger flight between the Nigerian cities Abuja and Port Harcourt that crash-landed on December 10, 2005. Out of 110 people on board the flight, seven people were recovered from the crash site and taken to hospitals, but only two survived their injuries. One of the survivors was Bunmi Amusan, a volunteer for Doctors Without Borders. The other was Kechi Okwuchi, a secondary school student at Ignatius Loyola Jesuit College, a boarding school in Abuja.", "prediction 1": "Sosoliso Airlines Flight 1145 was a scheduled domestic passenger flight between the Nigerian cities of Abuja and Port Harcourt. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived. Among the victims of the plane crash were two volunteers for Medecins Sans Frontieres/Doctors Without Borders en route to work in Port Harcourt, Hawah Kamara and Thomas Lamy, as well as televangelist Bimbo Odukoya, pastor of the Fountain of Life Church, who succum of her injuries the day after the accident. Pastor Odukoya's personal assistant, Bunmi Amusan, who survived the plane crash and got married a year later.", "prediction 2": "Sosoliso Airlines Flight 1145 crashed on December 10, 2005, while it was travelling between the Nigerian cities of Abuja and Port Harcourt. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived. One of them was Kechi Okwuchi, a student at Loyola Jesuit College.", "prediction 3": "Sosoliso Airlines Flight 1145 crashed on 10 December 2005, killing 107 people and injuring 84. Two survivors were identified as Kechi Okwuchi, a student at Loyola Jesuit College, and two others. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived.", "prediction 4": "There were 7 survivors of the Sosoliso plane crash, and two people survived. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived. Among the victims were two volunteers for Medecins Sans Frontieres/Doctors Without Borders en route to work in Port Harcourt, Hawah Kamara and Thomas Lamy, as well as televangelist Bimbo Odukoya, pastor of the Fountain of Life Church, who succumbed to her injuries the day after the accident. Another victim was Okoloma Maduewesi, a childhood friend of Nigerian writer Chimamanda Ngozi Adichie. Another student, Kechi Okwuchi, was treated at Milpark Hospital in Johannesburg, South Africa, and at Shriners Hospitals for Children in Galveston, Texas, United States.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Sosoliso Airlines Flight 1145 was a scheduled domestic passenger flight between the Nigerian cities of Abuja and Port Harcourt. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived. ", "start": 242, "end": 355 }, { "error type": "Irrelevant", "explanation": "", "start": 356, "end": 664 }, { "error type": "Irrelevant", "explanation": "", "start": 745, "end": 774 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Sosoliso Airlines Flight 1145 was a scheduled domestic passenger flight between the Nigerian cities of Abuja and Port Harcourt that crash-landed on 10 December 2005, with 110 people on board. Immediately after the crash, seven survivors were recovered and taken to hospitals, but only two people survived, one of whom was Kechi Okwuchi, a student at Loyola Jesuit College, the other a Pastor's personal assistant named Bunmi Amusan." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Understanding poetry by brooks and warren encapsulates the principles of?", "passages": [ [ "Understanding Poetry", "Understanding Poetry\n\nUnderstanding Poetry was an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938.", "The book influenced New Criticism and went through its fourth edition in 1976.", "The textbook \"widely influenced ... the study of poetry at the college level in America.\"", "The Intercollegiate Studies Institute has named the book one of the \"Fifty best books of the century.\"", "\"Understanding Poetry\", according to an article at the \"Modern American Poetry\" Web site, \"codified many of the so-called New Critical ideas into a coherent approach to literary study.", "Their book, and its companion volume, Understanding Fiction (1943), revolutionized the teaching of literature in the universities and spawned a host of imitators who dominated English departments well into the 1960s.\"", "Even those who are highly critical of the textbook's approach to poetry have acknowledged the reach and influence of the volume.", "Poet Ron Silliman has called it \"the hegemonic poetry textbook of the period.\"", "According to Warren's obituary in \"The New York Times\": \"\"Understanding Poetry\" and \"Understanding Fiction\", which he wrote with Mr. Brooks, taught an entire generation how to read a work of literature and helped make the New Criticism dominant in the decade surrounding World War II." ], [ "New Criticism", "New Criticism\n\nNew Criticism was a formalist movement in literary theory that dominated American literary criticism in the middle decades of the 20th century.", "It emphasized close reading, particularly of poetry, to discover how a work of literature functioned as a self-contained, self-referential aesthetic object.", "The movement derived its name from John Crowe Ransom's 1941 book \"The New Criticism\".", "The work of Cambridge scholar I. A. Richards, especially his \"Practical Criticism\" and \"The Meaning of Meaning\", which offered what was claimed to be an empirical scientific approach, were important to the development of New Critical methodology.", "Also very influential were the critical essays of T. S. Eliot, such as \"Tradition and the Individual Talent\" and \"Hamlet and His Problems\", in which Eliot developed his notion of the \"objective correlative\".", "Eliot's evaluative judgments, such as his condemnation of Milton and Dryden, his liking for the so-called metaphysical poets and his insistence that poetry must be impersonal, greatly influenced the formation of the New Critical canon.", "New Criticism developed as a reaction to the older philological and literary history schools of the US North, which, influenced by nineteenth-century German scholarship, focused on the history and meaning of individual words and their relation to foreign and ancient languages, comparative sources, and the biographical circumstances of the authors." ] ], "gold": "Understanding Poetry by Cleanth Brooks and Robert Penn Warren, first published in 1938, focuses on the study of poetry and encapsulates the principles of the New Criticism formalist literary theory movement. New Criticism dominated American literary criticism in the middle of the 20th century and emphasized close readings of poetry to discover how a work functioned as a self-contained, self-referential aesthetic object.", "prediction 1": "Understanding Poetry is an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938. The book influenced New Criticism and went through its fourth edition in 1976. Understanding Poetry codified many of the so-called New Critical ideas into a coherent approach to literary study. Their book, and its companion volume, Understanding Fiction, revolutionized the teaching of literature in the universities and spawned a host of imitators who dominated English departments well into the 1960s.", "prediction 2": "Understanding Poetry was an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938. The book influenced New Criticism and went through its fourth edition in 1976. New Criticism was a formalist movement in literary theory that dominated American literary criticism in the middle decades of the 20th century. It emphasized close reading, particularly of poetry, to discover how a work of literature functioned as a self-contained, self-referential aesthetic object. The book, along with its companion volume, Understanding Fiction, revolutionized the teaching of literature in the universities and spawned a host of imitators who dominated English departments well into the 1960s.", "prediction 3": "Understanding Poetry was an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938. The book influenced New Criticism and went through its fourth edition in 1976. The book codified many of the so-called New Critical ideas into a coherent approach to literary study. Their book, and its companion volume, Understanding Fiction (1943), revolutionized the teaching of literature in the universities and spawned a host of imitators who dominated English departments well into the 1960s.", "prediction 4": "Understanding Poetry is an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938. The book influenced New Criticism and went through its fourth edition in 1976. The book codified many of the so-called New Critical ideas into a coherent approach to literary study. Understanding Poetry is currently in its fourth edition and is presently in its fifth printing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 334 }, { "error type": "Irrelevant", "explanation": "", "start": 335, "end": 544 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Understanding Poetry is an American college textbook and poetry anthology by Cleanth Brooks and Robert Penn Warren, first published in 1938. The book influenced New Criticism and went through its fourth edition in 1976. New Criticism was a formalist movement in literary theory that dominated American literary criticism in the middle decades of the 20th century. It emphasized close reading, particularly of poetry, to discover how a work of literature functioned as a self-contained, self-referential aesthetic object." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When does hotel transylvania part 3 come out?", "passages": [ [ "Hotel Transylvania 3: Summer Vacation", "Hotel Transylvania 3: Summer Vacation\n\nHotel Transylvania 3: Summer Vacation (known internationally as Hotel Transylvania 3: A Monster Vacation) is a 2018 American 3D computer-animated comedy film produced by Sony Pictures Animation and distributed by Sony Pictures Releasing.", "The third installment in the \"Hotel Transylvania\" franchise, it is directed by Genndy Tartakovsky and written by Tartakovsky and Michael McCullers, and features Adam Sandler, Andy Samberg, Selena Gomez, Kevin James, David Spade, Steve Buscemi, Keegan-Michael Key, Molly Shannon, Fran Drescher, and Mel Brooks reprising their roles, as well as new additions to the cast including Kathryn Hahn and Jim Gaffigan.", "In the film, Dracula finds love with a ship captain named Ericka Van Helsing while on a vacation on a cruise with his family and friends, but Mavis discovers that Ericka is actually the great-granddaughter of Abraham Van Helsing, Dracula's arch-enemy.", "\"Hotel Transylvania 3: Summer Vacation\" premiered at the Annecy International Animated Film Festival on June 13, 2018, and was theatrically released in the United States on July 13, 2018.", "Like its predecessors, the film received mixed reviews from critics but was a box office success, grossing over $527 million worldwide, against a budget of $80 million." ], [ "Hotel Transylvania 3: Summer Vacation", "Dutch DJ Ti\u00ebsto also provided music for the film's final battle.", "DNCE's song \"Cake by the Ocean\" and Pitbull's song Shake Senora were used in promotional material.", "I See Love performed by Jonas Blue ft. Joe Jonas was featured in the film's end-credits.", "Eric Nam recorded the song Float for the film.", "Joe Jonas also recorded It's Party Time for the film while he was voicing Kraken the sea monster.", "\"Summer Vacation\" was originally scheduled for release on September 21, 2018, a date that was later moved up two months, to July 13, 2018.", "A video game adaptation, titled \"Hotel Transylvania 3: Monsters Overboard\", was released for the PlayStation 4, Xbox One, Nintendo Switch and Microsoft Windows on July 10, 2018.", "On June 21, 2018, Amazon announced it was offering its Amazon Prime members an early showing of the film on June 30, at about 1,000 theaters, similar to fellow Sony release \"\" the previous December.", "While most territories released the film on July release dates, the film was released in China on August 17, 2018.", "Similarly, Italy and the Philippines didn't see the film until late August as well while Japan and Poland have October release dates." ], [ "Trolls (film)", "DreamWorks Trolls:", "The Experience was the first of multiple properties mobile pop-up attractions Feld Entertainment and Universal Brand Development had agreed to develop in April 2018.", "The pop-up attraction opening in New York City on October 22, 2018.", "On February 28, 2017, Universal Pictures, the studio's new distributor and parent company since 2016, and DreamWorks Animation announced that a sequel titled \"Trolls 2\" would be released on April 10, 2020, with Kendrick and Timberlake reprising their roles of Poppy and Branch.", "On October 4, 2017, the release date for the sequel was moved up to February 14, 2020, as \"Fast & Furious 9\" took its original April 10, 2020 slot.", "Along with the new release date, it was announced that Dohrn will be returning to direct and Shay will return to produce the sequel.", "On December 6, 2017, the film was pushed back to an April 17, 2020 release.", "In May 2018, it was confirmed that Sam Rockwell, Chance the Rapper, Anthony Ramos, Karan Soni, Flula Borg, and Jamie Dornan joined the cast.", "Corden, Icona Pop, Funches, and Nayyar will also reprise their roles.", "In October 2018, it was confirmed that Kelly Clarkson had joined the cast, and will perform an original song." ] ], "gold": "Hotel Transylvania 3, released internationally as Hotel Transylvania 3: A Monster Vacation or simply Hotel Transylvania 3 as marketed on home release, is a 2018 American computer-animated monster comedy film produced by Sony Pictures Animation and distributed by Sony Pictures Releasing. \"Summer Vacation\" premiered at the Annecy International Animated Film Festival on June 13, 2018, and was theatrically released in the United States on July 13, 2018. A video game adaptation, titled \"Hotel Transylvania 3: Monsters Overboard\", was released for the PlayStation 4, Xbox One, Nintendo Switch and Microsoft Windows on July 10, 2018. While most territories released the film on July release dates, the film was released in China on August 17, 2018. Similarly, Italy and the Philippines didn't see the film until late August 2018 as well while Japan and Poland have October release dates. The film came out in Japan and Poland in October 2018.", "prediction 1": "Hotel Transylvania 3: Summer Vacation is a 2018 American computer-animated comedy film produced by Sony Pictures Animation and distributed by Sony Pictures Releasing. It is the third installment in the Hotel Transylvania franchise. The film features Adam Sandler, Andy Samberg, Selena Gomez, Kevin James, David Spade, Steve Buscemi, Keegan-Michael Key, Molly Shannon, Fran Drescher, and Mel Brooks reprising their roles, as well as well as new additions to the cast including Kathryn Hahn and Jim Gaffigan.\n", "prediction 2": "Hotel Transylvania 3: Summer Vacation is an American computer-animated comedy film produced by Sony Pictures Animation and distributed by Sony Pictures Releasing. The third installment in the Hotel Transylvania franchise, Hotel Transylvania 3: Summer Vacation premiered at the Annecy International Animated Film Festival on June 13, 2018. The film was theatrically released in the U.S. on July 13, 2018. A video game adaptation, titled Hotel Transylvania 3: Monsters Overboard, was released for the PlayStation 4, Xbox One, Xbox One, PlayStation 4, Xbox One, Nintendo Switch and Microsoft Windows on July 10, 2018.", "prediction 3": "Hotel Transylvania 3: Summer Vacation is a 2018 American computer-animated comedy film, which originally was scheduled for release on September 21, 2018, but was later moved up two months, to July 13, 2018. It was theatrically released in the United States on July 13, 2018 and in Japan and Poland on October 10, 2018. It was later due for a February 2020 release, but on December 4, 2017, the film's co-production partners DreamWorks Animation and Universal Pictures both announced a sequel, Hotel Transylvania 2: Tumuls Diets at the Beijing International Film Festival. Hotel Transylvania 3: Summer Vacation was released in China on August 17, 2018.", "prediction 4": "The third installment in the Hotel Transylvania franchise, Hotel Transylvania 3: Summer Vacation, premiered at the Annecy International Animated Film Festival on June 13, 2018. The film was theatrically released in the United States on July 13, 2018. A video game adaptation, titled Hotel Transylvania 3: Monsters Overboard, was released for the PlayStation 4, Xbox One, Nintendo Switch and Microsoft Windows on July 10, 2018. It was then released worldwide in selected countries on November 29, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 231 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 507 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "Hotel Transylvania 3: Summer Vacation, known internationally as Hotel Transylvania 3: A Monster Vacation, is a 2018 American computer-animated comedy film produced by Sony Pictures Animation and distributed by Sony Pictures Releasing. It premiered at the Annecy International Animated Film Festival on June 13, 2018, and was theatrically released in the United States on July 13, 2018. A video game adaptation, titled \"Hotel Transylvania 3: Monsters Overboard\", was released for the PlayStation 4, Xbox One, Nintendo Switch and Microsoft Windows on July 10, 2018. On June 21, 2018, Amazon announced it was offering its Amazon Prime members an early showing of the film on June 30. While most territories released the film on July release dates, the film was released in China on August 17, 2018. Similarly, Italy and the Philippines didn't see the film until late August as well while Japan and Poland have October release dates." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the us department of labor created?", "passages": [ [ "United States Department of Labor", "United States Department of Labor\n\nThe United States Department of Labor (DOL) is a cabinet-level department of the U.S. federal government responsible for occupational safety, wage and hour standards, unemployment insurance benefits, reemployment services, and some economic statistics; many U.S. states also have such departments.", "The department is headed by the U.S. Secretary of Labor.", "The purpose of the Department of Labor is to foster, promote, and develop the wellbeing of the wage earners, job seekers, and retirees of the United States; improve working conditions; advance opportunities for profitable employment; and assure work-related benefits and rights.", "In carrying out this mission, the Department of Labor administers and enforces more than 180 federal laws and thousands of federal regulations.", "These mandates and the regulations that implement them cover many workplace activities for about 10\u00a0million employers and 125\u00a0million workers.", "The department's headquarters is housed in the Frances Perkins Building, named in honor of Frances Perkins, the Secretary of Labor from 1933 to 1945.", "In 1884 the U.S.\u00a0Congress first established a Bureau of Labor Statistics with the Bureau of Labor Act, to collect information about labor and employment.", "This bureau was under the Department of the Interior.", "The Bureau started collecting economic data in 1884, and published their first report in 1886." ], [ "United States Department of Labor", "Later, in 1888, the Bureau of Labor became an independent Department of Labor, but lacked executive rank.", "In February 1903, it became a bureau again when the Department of Commerce and Labor was established.", "United States President William Howard Taft signed the March 4, 1913 bill (the last day of his presidency), establishing the Department of Labor as a cabinet-level department.", "William B. Wilson was appointed as the first Secretary of Labor on March 5, 1913, by President Wilson.", "In October 1919, Secretary Wilson chaired the first meeting of the International Labour Organization even though the U.S. was not yet a member.", "In September 1916, the Federal Employees' Compensation Act introduced benefits to workers who are injured or contract illnesses in the workplace.", "The act established an agency responsible for federal workers\u2019 compensation, which was transferred to the Labor Department in the 1940s and has become known as the Office of Workers' Compensation Programs.", "Frances Perkins, the first female cabinet member, was appointed to be Secretary of Labor by President Roosevelt on March 4, 1933.", "Perkins served for 12 years, and became the longest-serving Secretary of Labor.", "During the John F. Kennedy Administration, planning was undertaken to consolidate most of the department's offices, then scattered around more than 20 locations.", "in the mid\u20111960s construction on the \"New Labor Building\" began and finished in 1975." ] ], "gold": "In 1884, the U.S. Congress first established a Bureau of Labor Statistics with the Bureau of Labor Act, to collect information about labor and employment. This bureau was under the Department of the Interior, and in 1888, the Bureau of Labor became an independent Department of Labor, but lacked executive rank. In February 1903, it became a bureau again when the Department of Commerce and Labor was established. United States President William Howard Taft signed the March 4, 1913, bill, the last day of his presidency, establishing the Department of Labor as a Cabinet-level department. ", "prediction 1": "The United States Department of Labor is a cabinet-level department of the U.S. federal government responsible for occupational safety, wage and hour standards, unemployment insurance benefits, reemployment services, and some economic statistics. The purpose of the Department of Labor is to foster, promote, and develop the wellbeing of the wage earners, job seekers, and retirees of the United States; improve working conditions; advance opportunities for profitable employment; and assure work-related benefits and rights. The department's headquarters is housed in the Frances Perkins Building, named in honor of Frances Perkins, the Secretary of Labor from 1933 to 1945.", "prediction 2": "The United States Department of Labor is a cabinet-level department of the U.S. federal government responsible for occupational safety, wage and hour standards, unemployment insurance benefits, reemployment services, and some economic statistics. The purpose of the department is to foster, promote, and develop the wellbeing of the wage earners, job seekers, and retirees of the United States; improve working conditions; advance opportunities for profitable employment; and assure work-related benefits and rights. The department's headquarters are housed in the Frances Perkins Building, named in honor of Frances Perkins, the Secretary of Labor from 1933 to 1945.", "prediction 3": "The United States Department of Labor is a cabinet-level department of the U.S. federal government responsible for occupational safety, wage and hour standards, unemployment insurance benefits, reemployment services, and some economic statistics. The purpose of the department is to foster, promote, and develop the wellbeing of the wage earners, job seekers, and retirees of the United States; improve working conditions; advance opportunities for profitable employment; and assure work-related benefits and rights.", "prediction 4": "The United States Department of Labor is a cabinet-level department of the U.S. federal government responsible for occupational safety, wage and hour standards, unemployment insurance benefits, reemployment services, and some economic statistics. It was created on March 4, 1913, and was headed by the U.S. Secretary of Labor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 246 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 675 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In 1884 the U.S. Congress first established a Bureau of Labor Statistics with the Bureau of Labor Act, to collect information about labor and employment. This bureau was under the Department of the Interior and in 1888, the Bureau of Labor became an independent Department of Labor, but lacked executive rank. In February 1903, it became a bureau again when the Department of Commerce and Labor was established.United States President William Howard Taft signed the March 4, 1913 bill (the last day of his presidency), establishing the Department of Labor as a cabinet-level department. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where does canal du midi start and finish?", "passages": [ [ "Canal du Midi", "The design canal depth is 2 m with a minimum of 1.80 m. The draft allowed is 1.50 m", "although regular users advise that even with 1.40 m boats will occasionally touch the bottom because of silt deposits in many places.", "The width on the surface is 20 m on average with variations between 16 m and 20 m. Finally, the width of the canal bed is 10 m.\n\n", "This longitudinal profile of the Canal du Midi shows it rising from Toulouse (1) to the Seuil de Naurouze (2), then dropping down to Castelnaudary (3), Carcassonne (4) and Tr\u00e8bes (5).", "The canal continues to B\u00e9ziers after the passing through the Fonserannes Locks (6), then Agde (7), to finish at S\u00e8te on the \u00e9tang de Thau (8).", "The longest canal pound is 53.87 kilometres between Argens Lock and the Fonserannes Locks, while the shortest Canal pound is 105 m between the two Fresquel locks.", "For historical reasons, the Canal du Midi has a unique legal status, which was codified in 1956 in the \"Public Code of waterways and inland navigation\", then in the \"General code of the property of public persons\"." ], [ "Canal du Midi", "Canal du Midi\n\nThe (, meaning \"canal of the two seas\") is a long canal in Southern France ().", "Originally named the \"Canal royal en Languedoc\" (Royal Canal in Languedoc) and renamed by French revolutionaries to \"Canal du Midi\" in 1789, the canal was at the time considered one of the greatest construction works of the 17th century.", "The canal connects the Garonne to the on the Mediterranean and along with the long Canal de Garonne forms the Canal des Deux Mers, joining the Atlantic to the Mediterranean.", "The canal runs from the city of Toulouse down to the \u00c9tang de Thau near the Mediterranean.", "Strictly speaking, \"\"Canal du Midi\"\" refers to the portion initially constructed from Toulouse to the Mediterranean \u2014 the Deux-Mers canal project aimed to link together several sections of navigable waterways to join the Mediterranean and the Atlantic: first the Canal du Midi, then the Garonne which was more or less navigable between Toulouse and Bordeaux, then the Garonne Lateral Canal built later, and finally the Gironde estuary after Bordeaux.", "Jean-Baptiste Colbert authorized the start of work by royal edict in October, 1666, with the aim of developing the wheat trade, under the supervision of Pierre-Paul Riquet, and construction lasted from 1666 to 1681, during the reign of Louis XIV." ], [ "Canal du Midi", "The Canal du Midi is one of the oldest canals of Europe still in operation (the prototype being the Briare Canal).", "The challenges in these works are closely related to the challenges of inland water transport today.", "The key challenge, raised by Pierre-Paul Riquet, was to convey water from the Montagne Noire (Black Mountains) to the Seuil de Naurouze, the highest point of the canal.", "The Canal du Midi was inscribed as a UNESCO World Heritage Site in 1996.", "The Canal du Midi is located in the south of France, in the departments of H\u00e9rault, Aude, and Haute-Garonne.", "Its course runs for 240 kilometres between Marseillan, at a place called \"Les Onglous,\" where the canal opens into the \u00e9tang de Thau near S\u00e8te and Toulouse at Port de l'Embouchure.", "The Canal du Midi is a summit-level canal, climbing from Toulouse on the Atlantic side over a distance of 52 km to the Seuil de Naurouze or summit level, where the feeder canal enters.", "The total rise is 57.18 m, and the summit level is at an altitude of 189.43 m. This difference in level down to the sea is covered over the remaining distance of 188\u00a0km from Naurouze to Les Onglous on the \u00c9tang de Thau." ] ], "gold": "The Canal du Midi is a 240 km, 150 mi, long canal in Southern France connecting the Garonne to the \u00c9tang de Thau on the Mediterranean, and along with the 193 km, 120 mi, long Canal de Garonne forms the Canal des Deux Mers, joining the Atlantic to the Mediterranean. Strictly speaking, \"Canal du Midi\" refers to the portion initially constructed from Toulouse to the Mediterranean \u2013 the Deux-Mers canal project aimed to link together several sections of navigable waterways to join the Mediterranean and the Atlantic, first the Canal du Midi, then the Garonne which was more or less navigable between Toulouse and Bordeaux, then the Garonne Lateral Canal built later, and finally the Gironde estuary after Bordeaux.", "prediction 1": "The Canal du Midi is a long canal in Southern France. The canal connects the Garonne to the Mediterranean and along with the long Canal de Garonne forms the Canal des Deux Mers, joining the Atlantic to the Mediterranean. The canal runs from the city of Toulouse down to the \u00e9tang de Thau near the Mediterranean. The canal's course runs for 240 kilometres between Marseillan, at a place called \"Les Onglous,\" where the canal opens into the \u00e9tang de Thau near S\u00e8te.", "prediction 2": "The Canal du Midi, which means \"canal of the two seas\", is one of the oldest canals of Europe still in operation. Its course runs for 240 kms between Marseillan, at a place called \"Les Onglous,\" where the canal opens into the \u00e9tang de Thau near S\u00e8te. The canal's starting point is located in Toulouse. The Canal du Midi begins at Marseillan and ends at Les Onglous on the \u00c9tang de Thau near S\u00e8te.", "prediction 3": "The Canal du Midi is a long canal in Southern France and started and ended in Toulouse, France. The canal runs from the city of Toulouse down to the \u00e9tang de Thau near the Mediterranean. The Canal du Midi is a summit-level canal, climbing from Toulouse on the Atlantic side over a distance of 52 km to the Seuil de Naurouze or summit level, where the feeder canal enters.", "prediction 4": "The Canal du Midi is a canal in Southern France that runs from the city of Toulouse down to the \u00c9tang de Thau near the Mediterranean. Its course runs for 240 kilometres between Marseillan, at a place called \"Les Onglous,\" where the canal opens into the \u00e9tang de Thau near S\u00e8te, and Toulouse at Port de l'Embouchure.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 463 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Canal du Midi is a long canal in Southern France. The canal connects the Garonne to the Mediterranean and along with the long Canal de Garonne forms the Canal des Deux Mers, joining the Atlantic to the Mediterranean. The canal runs from the city of Toulouse down to the \u00e9tang de Thau near the Mediterranean. Strictly speaking, \"\"Canal du Midi\"\" refers to the portion initially constructed from Toulouse to the Mediterranean \u2014 the Deux-Mers canal project aimed to link together several sections of navigable waterways to join the Mediterranean and the Atlantic: first the Canal du Midi, then the Garonne which was more or less navigable between Toulouse and Bordeaux, then the Garonne Lateral Canal built later, and finally the Gironde estuary after Bordeaux. The canal's course runs for 240 kilometres." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the bribery act implemented in the uk?", "passages": [ [ "Bribery Act 2010", "Following a white paper in March 2009, the Bribery Bill, based on the Law Commission's 2008 report \"Reforming Bribery\", was announced in the Queen's Speech.", "Initially given all-party support after its introduction by Jack Straw in 2009, the Bill was, according to \"The Guardian\", subject to an attempted filibuster by Members of Parliament from the Conservative Party.", "This followed pressure from the Confederation of British Industry, who worried that the Bill in its original form would hamper the competitiveness of British industry.", "The Bill was given Royal Assent on 8 April 2010, becoming the Bribery Act 2010, and was expected to come into force immediately.", "The government instead chose to hold several rounds of public consultations before announcing that it would come into force in April 2011.", "Following the publication of guidance by the Ministry of Justice, the act came into effect on 1 July 2011.", "The Ministry of Justice also released a Quick Start Guide, which highlights some key points of the Act.", "The Quick Start Guide also suggests companies to consult relevant bodies for advice, including the UK Trade and Investment, and the government sponsored Business Anti-Corruption Portal.", "In October 2011 Munir Patel, a clerk at Redbridge Magistrates Court, became the first person to be convicted under the Bribery Act, along with misconduct in a public office.", "Sections 1 to 5 of the Act cover \"general bribery offences\"." ], [ "Bribery Act 2010", "Bribery Act 2010\n\nThe Bribery Act 2010 (c.23) is an Act of the Parliament of the United Kingdom that covers the criminal law relating to bribery.", "Introduced to Parliament in the Queen's Speech in 2009 after several decades of reports and draft bills, the Act received the Royal Assent on 8 April 2010 following cross-party support.", "Initially scheduled to enter into force in April 2010, this was changed to 1 July 2011.", "The Act repeals all previous statutory and common law provisions in relation to bribery, instead replacing them with the crimes of bribery, being bribed, the bribery of foreign public officials, and the failure of a commercial organisation to prevent bribery on its behalf.", "The penalties for committing a crime under the Act are a maximum of 10 years' imprisonment, along with an unlimited fine, and the potential for the confiscation of property under the Proceeds of Crime Act 2002, as well as the disqualification of directors under the Company Directors Disqualification Act 1986.", "The Act has a near-universal jurisdiction, allowing for the prosecution of an individual or company with links to the United Kingdom, regardless of where the crime occurred.", "Described as \"the toughest anti-corruption legislation in the world\", concerns have been raised that the Act's provisions criminalise behaviour that is acceptable in the global market, and puts British business at a competitive disadvantage." ] ], "gold": "The Bribery Act of 2010, an Act of Parliament covering the criminal law relating to bribery in the United Kingdom, was given Royal Assent on 8 April 2010 and came into effect on 1 July 2011. The Act has near-universal jurisdiction and has been described as \"the toughest anti-corruption legislation in the world\". ", "prediction 1": "Introduced to Parliament in the Queen's Speech in 2009, the Bribery Bill, based on the Law Commission's 2008 report \"Reforming Bribery\", was announced in the Queen's Speech. The Act received the Royal Assent on 8 April 2010, becoming the Bribery Act 2010 and was expected to come into force immediately. Instead, the government chose to hold several rounds of public consultations before announcing that it would come into force on 1 July 2011.", "prediction 2": "The Bribery Act 2010 is an Act of the Parliament of the United Kingdom that covers the criminal law relating to bribery. Introduced to Parliament in the Queen's Speech in 2009 after several decades of reports and draft bills, the Act received the Royal Assent on 8 April 2010 following cross-party support. Initially scheduled to enter into force in April 2010, this was changed to 1 July 2011.", "prediction 3": "The Bribery Act 2010 is an Act of the Parliament of the United Kingdom that covers the criminal law relating to bribery. Introduced to Parliament in the Queen's Speech in 2009, the Bribery Bill was based on the Law Commission's 2008 report Reforming Bribery and was announced in the Queen's Speech in March 2009. It was intended to come into force immediately. Instead, the government held several rounds of public consultations before announcing that it would come into force on 1 July 2011.", "prediction 4": "Introduced to Parliament in the Queen's Speech in 2009 after several decades of reports and draft bills, the Bribery Bill was given Royal Assent on 8 April 2010, becoming the Bribery Act 2010. The government instead chose to hold several rounds of public consultations before announcing that it would come into force in April 2011. Following the publication of guidance by the Ministry of Justice, the act came into effect on 1 July 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 303 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Bribery Act of 2010, an Act of Parliament covering the criminal law relating to bribery in the United Kingdom. The Act received the Royal Assent on 8 April 2010 and come into force on 1 July 2011. The Act has near-universal jurisdiction and has been described as \"the toughest anti-corruption legislation in the world\"." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who wrote have yourself a merry little christmas?", "passages": [ [ "Have Yourself a Merry Little Christmas", "Have Yourself a Merry Little Christmas\n\n\"Have Yourself a Merry Little Christmas\", a song written by Hugh Martin and Ralph Blane, was introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\".", "Frank Sinatra later recorded a version with modified lyrics.", "In 2007, ASCAP ranked it the third most performed Christmas song during the preceding five years that had been written by ASCAP members.", "In 2004 it finished at No. 76 in AFI's 100 Years...100 Songs rankings of the top tunes in American cinema.", "The song was written while Martin was vacationing in a flat in the neighborhood of Southside in Birmingham, Alabama, that his father Hugh Martin designed for his mother as a honeymoon cottage.", "Located at 1919 South 15th Avenue (just down the street from his birthplace at 1900 South 14th Avenue), the house became the home of Martin and his family in 1923.", "The song first appeared in a scene in \"Meet Me in St. Louis\", in which a family is distraught by the father's plans to move to New York City for a job promotion, leaving behind their beloved home in St. Louis, Missouri, just before the long-anticipated 1904 World's Fair begins." ], [ "Have Yourself a Merry Little Christmas", "The lyrics Garland sang in \"Meet Me in St. Louis\" have been recorded with only slight variations by a number of artists, including Sinatra (in 1950 and 1963 single recordings), Bing Crosby (in \"I Wish You a Merry Christmas\"), Doris Day (in \"The Doris Day Christmas Album\"), Ella Fitzgerald (in \"Ella Wishes You a Swinging Christmas\"), The Pretenders (in the first \"A Very Special Christmas\" compilation), James Taylor (in \"October Road\"), and Luther Vandross (in \"This Is Christmas\").", "In 1963, Frank Sinatra's third recording of the song, backed by popular Hollywood arranger Gus Levene and his orchestra, was controversially used by director Carl Foreman in his anti-war film \"The Victors\" as the soundtrack backdrop (along with the carol \"Hark!", "The Herald Angels Sing\") to the execution by firing squad of a G.I. deserter in a bleak, snowy field on Christmas Eve \u2013 a scene inspired by the real-life execution of Pvt.", "Eddie Slovik in 1945.", "\"The New York Times\" film reviewer, while recognising the power of the scene, complained that \"the device itself is almost as specious and sentimental as what [Foreman] is trying to mock\"." ] ], "gold": "\"Have Yourself a Merry Little Christmas\" is a 1943 song composed by Hugh Martin and written by Ralph Blane for the MGM musical \"Meet Me in St. Louis\". It was later covered by various artists and even ranked in 2007 by ASCAP as the third most performed Christmas song during the preceding five years.", "prediction 1": "Hugh Martin wrote Have Yourself a Merry Little Christmas. It was introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\". Frank Sinatra later recorded a version of the song with modified lyrics.", "prediction 2": "\"Have Yourself a Merry Little Christmas\", a song written by Hugh Martin and Ralph Blane, was introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\". In 1950 and 1963, Frank Sinatra recorded a version with modified lyrics.", "prediction 3": "Hugh Martin and Ralph Blane wrote the song Have Yourself a Merry Little Christmas, which was first introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\".", "prediction 4": "Hugh Martin and Ralph Blane wrote the song Have Yourself a Merry Little Christmas. The song was introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\". In 1950, Frank Sinatra's third recording of the song was controversially used by director Carl Foreman in his anti-war film The Victors as the soundtrack backdrop to the execution by firing squad of a G.I. deserter in a bleak, snowy field on Christmas Eve \u2013 a scene inspired by the real-life execution of Pvte Slovik in 1945. It was introduced by Garland in the 1944 MGM musical \"Meet Me in St. Louis\". In 1973, it was ranked as the third most performed Christmas song during the preceding five years that had been written by ASCAP members.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 212 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Hugh Martin and Ralph Blane wrote Have Yourself a Merry Little Christmas. It was introduced by Judy Garland in the 1944 MGM musical \"Meet Me in St. Louis\". In 2007, ASCAP ranked it the third most performed Christmas song during the preceding five years. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When did low down dirty shame come out?", "passages": [ [ "A Low Down Dirty Shame", "A Low Down Dirty Shame\n\nA Low Down Dirty Shame is a 1994 American action comedy film written, directed by, and starring Keenen Ivory Wayans.", "The film also stars Charles S. Dutton, Jada Pinkett, and Salli Richardson.", "Former LAPD detective Andre Shame is a private investigator who owns A Low Down Dirty Shame Investigations.", "He runs it with Peaches, whom he arrested six years before and has romantic feelings for him.", "Despite the high-risk jobs, Shame is unable to keep the firm afloat, and may be forced to close.", "Five years earlier, Shame and a team of detectives went into Mexico to apprehend drug lord Ernesto Mendoza.", "Though Shame seemingly shot and killed Mendoza in a shoot-out, the other detectives were killed, with Shame and Sonny Rothmiller being the only survivors.", "This caused Shame to leave the force in disgrace.", "In the present day, Rothmiller, who is now working for the DEA, tells him that Mendoza is still alive.", "He hires Shame to find the only witness who would testify against him...his ex-girlfriend Angela, who was caught in the middle of a love triangle with the two men.", "Angela escaped from the Witness Protection Program in New York and is in LA.", "Shame is hesitant at first, but seeing this as a chance to arrest the man who took everything from him, decides to take the case." ], [ "A Low Down Dirty Shame", "She attempts to kill Shame, but Peaches beats her in a fistfight.", "Nunez threatens to arrest Shame, but Shame reminds Nunez that he helped take down a drug lord, find a federal witness and recover $15 million in stolen drug money.", "Shame keeps $5 million for expenses, with Peaches getting perks of a romantic relationship with Shame.", "A soundtrack containing hip hop and R&B music was released on November 8, 1994, by Hollywood Records and Jive Records.", "It peaked at #70 on the \"Billboard\" 200 and #14 on the Top R&B/Hip-Hop Albums.", "Rotten Tomatoes, a review aggregator, reports that 0% of 21 surveyed critics gave the film a positive review; the average rating is 3.6/10." ] ], "gold": "A Low Down Dirty Shame is an American action comedy film written, directed by, and starring Keenen Ivory Wayans. The movie follows Andre Shame, a former LAPD detective turned private investigator in risk of being forced to close down his own firm. The movie was released on November 23, 1994, shortly after its soundtrack came out on November 8, 1994. The album contained hip hop and R&B music and peaked at #70 on the Billboard 200 and #14 on the Top R&B/Hip-Hop Albums.", "prediction 1": "A Low Down Dirty Shame is a 1994 American action comedy film written, directed, and starring Keenen Ivory Wayans. The film also stars Charles S. Dutton, Jada Pinkett, and Salli Richardson. The film's soundtrack containing hip hop and R&B music was released on November 8, 1994, by Hollywood Records and Jive Records.", "prediction 2": "A Low Down Dirty Shame is a 1994 American action comedy film written, directed by, and starring Keenen Ivory Wayans. The film stars Charles S. Dutton, Jada Pinkett, and Salli Richardson. The film's soundtrack containing hip hop and R&B music was released on November 8, 1994, by Hollywood Records and Jive Records.", "prediction 3": "A Low Down Dirty Shame is a 1994 American action comedy film written, directed by, and starring Keenen Ivory Wayans. The film also stars Charles S. Dutton, Jada Pinkett, and Salli Richardson. The film stars former LAPD detective Andre Shame and former ex-girlfriend Peaches, whom he arrested six years before and has romantic feelings for him. The soundtrack containing hip hop and R&B music was released on November 8, 1994, by Hollywood Records and Jive Records. It peaked at #70 on the \"Billboard\" 200 and #14 on the Top R&B/Hip-Hip-Hip-Hop-Hip-Hop-Hop-Hip-Hop-Hip-Hop Albums.", "prediction 4": "A Low Down Dirty Shame is a 1994 American action comedy film written, directed by, and starring Keenen Ivory Wayans. The film also stars Charles S. Dutton, Jada Pinkett, and Salli Richardson. The soundtrack containing hip hop and R&B music was released on November 8, 1994, by Hollywood Records and Jive Records.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 278, "end": 316 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A Low Down Dirty Shame is a 1994 American action comedy film written, directed, and starring Keenen Ivory Wayans. The film follows Former LAPD detective, Andre Shame, who is a private investigator at risk of being forced to close down his own firm. The film's soundtrack containing hip hop and R&B music was released on November 8, 1994. It peaked at #70 on the \"Billboard\" 200 and #14 on the Top R&B/Hip-Hop Albums." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When did the welfare system began in the us?", "passages": [ [ "Social programs in the United States", "The severe Depression of the 1930s made Federal action necessary, as neither the states and the local communities, businesses and industries, nor private charities had the financial resources to cope with the growing need among the American people.", "Beginning in 1932, the Federal Government first made loans, then grants, to states to pay for direct relief and work relief.", "After that, special Federal emergency relief like the Civilian Conservation Corps and other public works programs were started.", "In 1935, President Franklin D. Roosevelt's administration proposed to Congress federal social relief programs and a federally sponsored retirement program.", "Congress followed by the passage of the 37 page Social Security Act, signed into law August 14, 1935 and \"effective\" by 1939\u2014just as World War II began.", "This program was expanded several times over the years.", "Economic historians led by Price Fishback have examined the impact of New Deal spending on improving health conditions in the 114 largest cities, 1929\u20131937.", "They estimated that every additional $153,000 in relief spending (in 1935 dollars, or $ million in dollars) was associated with a reduction of one infant death, one suicide, and 2.4 deaths from infectious disease.", "Virtually all food stamp costs are paid by the federal government.", "In 2008, 28.7 percent of the households headed by single women were considered poor." ], [ "Social programs in the United States", "In these estimates of private social welfare expenditures, Hacker included mandatory private provisions (less than 1% of GDP), subsidized and/or regulated private provisions (9\u201310% of GDP), and purely private provisions (3\u20134% of GDP).", "Colonial legislatures and later State governments adopted legislation patterned after the English \"poor\" laws.", "Aid to veterans, often free grants of land, and pensions for widows and handicapped veterans, have been offered in all U.S. wars.", "Following World War I, provisions were made for a full-scale system of hospital and medical care benefits for veterans.", "By 1929, workers' compensation laws were in effect in all but four states.", "These state laws made industry and businesses responsible for the costs of compensating workers or their survivors when the worker was injured or killed in connection with his or her job.", "Retirement programs for mainly State and local government paid teachers, police officers, and fire fighters\u2014date back to the 19 century.", "All these social programs were far from universal and varied considerably from one state to another.", "Prior to the Great Depression the United States had social programs that mostly centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs.", "The misery and poverty of the great depression threatened to overwhelm all these programs." ] ], "gold": "Laws that made industry and businesses responsible for the costs of compensating workers or their survivors when the worker was injured or killed in connection with his or her job where in effect in all but four states by 1929. Adding to this, the first welfare system in the US began during the Great Depression, when widespread misery and poverty threatened to overwhelm the existing social programs that existed in the US, most of which centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs. Due to this , in 1935, President Franklin D. Roosevelt's administration proposed to Congress federal social relief programs and a federally sponsored retirement program that was followed by the passage of the Social Security Act, signed into law August 14, 1935.", "prediction 1": "The social welfare system in the United States began in 1932. The severe Depression of the 1930s made Federal action necessary, as neither the states and the local communities, businesses and industries, nor private charities had the financial resources to cope with the growing need among the American people. The Social Security Act was enacted on August 14, 1935 and became effective on August 15, 1939.", "prediction 2": "The welfare system in the United States began in 1932. Prior to the Great Depression, the social programs in the US were mostly centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs. The misery and poverty of the Great Depression threatened to overwhelm all these programs. The Federal Government made loans, then grants, to states to pay for direct relief and work relief.", "prediction 3": "The Federal Social Security Act was passed by Congress in 1935 and formally began operation on August 14, 1935. The Welfare System in the US was first introduced in 1932, but it has been expanded several times since then. During the Great Depression, the social programs in the US mostly centered around individuals, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs.", "prediction 4": "The social welfare system in the United States began in the 1930s, and it primarily centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs. Prior to the great depression, the United States had social programs that mostly centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs. The misery and poverty of the great depression threatened to overwhelm all these programs. Social Security was signed into law on August 14, 1935 and \"effective\" by 1939.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 390, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 310 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 4, "end": 25 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "By 1929, workers' compensation laws were in effect in all but four states. These state laws made industry and businesses responsible for the costs of compensating workers or their survivors when the worker was injured or killed in connection with his or her job. Prior to the Great Depression the United States had social programs that mostly centered around individual efforts, family efforts, church charities, business workers compensation, life insurance and sick leave programs along with some state tax supported social programs. In 1935, President Franklin D. Roosevelt's administration proposed to Congress federal social relief programs and a federally sponsored retirement program. The Social Security Act was enacted on August 14, 1935 and became effective on 1939. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Another name of x axis and y axis?", "passages": [ [ "Abscissa and ordinate", "Abscissa and ordinate\n\nIn mathematics, the abscissa (; plural \"abscissae\" or \"absciss\u00e6\" or \"abscissas\") and the ordinate are respectively the first and second coordinate of a point in a coordinate system.", "The abscissa of a point is the signed measure of its projection on the primary axis, whose absolute value is the distance between the projection and the origin of the axis, and whose sign is given by the location on the projection relative to the origin (before: negative; after: positive).", "The ordinate of a point is the signed measure of its projection on the secondary axis, whose absolute value is the distance between the projection and the origin of the axis, and whose sign is given by the location on the projection relative to the origin (before: negative; after: positive).", "Usually these are the horizontal and vertical coordinates of a point in a two-dimensional rectangular Cartesian coordinate system.", "The terms can also refer to the horizontal and vertical axes respectively (typically \"x\"-axis and \"y\"\u2013axis) of a two-dimensional graph." ], [ "Cartesian coordinate system", "Cartesian coordinate system\n\nA Cartesian coordinate system is a coordinate system that specifies each point uniquely in a plane by a set of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length.", "Each reference line is called a \"coordinate axis\" or just \"axis\" (plural \"axes\") of the system, and the point where they meet is its \"origin\", at ordered pair .", "The coordinates can also be defined as the positions of the perpendicular projections of the point onto the two axes, expressed as signed distances from the origin.", "One can use the same principle to specify the position of any point in three-dimensional space by three Cartesian coordinates, its signed distances to three mutually perpendicular planes (or, equivalently, by its perpendicular projection onto three mutually perpendicular lines).", "In general, \"n\" Cartesian coordinates (an element of real \"n\"-space) specify the point in an \"n\"-dimensional Euclidean space for any dimension \"n\".", "These coordinates are equal, up to sign, to distances from the point to \"n\" mutually perpendicular hyperplanes.", "The invention of Cartesian coordinates in the 17th century by Ren\u00e9 Descartes (Latinized name: \"Cartesius\") revolutionized mathematics by providing the first systematic link between Euclidean geometry and algebra." ] ], "gold": "A Cartesian coordinate system in a plane is a coordinate system that specifies each point uniquely by a pair of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length. The two lines that make it up are the x-axis, also known as abscissa, and the y-axis, also known as ordinate.", "prediction 1": "In mathematics, the abscissa and the ordinate are respectively the first and second coordinate of a point in a coordinate system. In general, the horizontal and vertical axes of a two-dimensional graph are called x axis and y axis, respectively.", "prediction 2": "A Cartesian coordinate system is a coordinate system that specifies each point uniquely in a plane by a set of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length. Each reference line is called a coordinate axis (plural \"axes\") of the system, and the point where they meet is its \"origin\".", "prediction 3": "In mathematics, the abscissa and the ordinate are respectively the first and second coordinates of a point in a coordinate system. A Cartesian coordinate system is a coordinate system that specifies each point uniquely in a plane by a set of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length. Each reference line is called a coordinate axis or just \"axis\" of the system, and the point where they meet is its \"origin\".", "prediction 4": "A Cartesian coordinate system is a coordinate system that specifies each point uniquely in a plane by a set of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length. Each reference line is called a coordinate axis or just \"axis\" of the system. The horizontal and vertical axes respectively (typically \"x\"-axis and \"y\"\u2013axis) of a two-dimensional graph.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 245 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "A Cartesian coordinate system in a plane is a coordinate system that specifies each point uniquely by a pair of numerical coordinates, which are the signed distances to the point from two fixed perpendicular oriented lines, measured in the same unit of length. In mathematics, the abscissa and the ordinate are respectively the first and second coordinate of a point in a coordinate system. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who has conceded the most goals in the premiership?", "passages": [ [ "Tim Krul", "Tim Krul\n\nTimothy Michael Krul (; born 3 April 1988) is a Dutch professional footballer who plays as a goalkeeper for Norwich City.", "Krul represented the Netherlands at every level between 2002 and 2011.", "He made his debut for the full national team in July 2011 and was part of the team that came third at the 2014 FIFA World Cup.", "Krul began his career at hometown club RAS and later local Eredivisie club ADO Den Haag.", "He joined Premier League club Newcastle United in the summer of 2005 on a three-year deal after failing to sign professional terms.", "ADO demanded a compensation fee and objected to the FIFA Dispute Resolution Chamber (DRC).", "The DRC denied the claim and ADO took the case to the Court of Arbitration for Sport (CAS).", "CAS ruled in February 2007 in favour of ADO, ordering Newcastle to pay \u20ac220,000 as compensation for the transfer.", "He made his first senior appearance for Newcastle in a pre-season defeat to PSV Eindhoven on 29 July 2006.", "Following an injury to Newcastle's first-choice goalkeeper Shay Given, Krul appeared on the bench as back-up to second-choice Steve Harper.", "Krul made his Newcastle debut in the UEFA Cup on 2 November 2006 against Palermo." ], [ "2018\u201319 in English football", "Among other Championship action, newly-promoted Wigan defeat Shefffield Wednesday 3-2, and Graham Potter make a winning start as Swansea manager by beating Sheffield United 2-1 away.", "In League One, Sunderland come from behind to defeat Charlton 2-1 in their first game at this level in 30 years, and in League Two, Swindon Town stun newly-promoted Macclesfield 3-2 with two stoppage-time penalties.", "6 August 2018:", "Blackpool manager Gary Bowyer becomes the first managerial casualty of the new season when handing in his resignation after just one game played.", "The Seasiders had travelled to Wycombe Wanderers for their season opener just a few days before and shared out a goalless draw in Buckinghamshire.", "31 August 2018:", "The first month of the new season sees Liverpool leading the Premier League on goal difference; three games in, the Merseysiders, Tottenham Hotspur, Chelsea, and Watford all hold 100% records.", "Reigning champions Manchester City are in fifth, ahead of Bournemouth on goal difference, and Leicester City are seventh.", "West Ham United, the only Premier League team without a point, prop up the table.", "Newcastle United and Southampton are clear ahead of Burnley and Huddersfield Town in the relegation zone on goal difference." ] ], "gold": "The Premier League teas that has conceded the most goals is Tottenham Hotspur. Similarly, the title of goalkeeper who's conceded the most goals falls in the hands of Tim Krul, Norwich City's goalkeeper.", "prediction 1": "Tim Krul has conceded the most goals in the Premier League in both the season ending and the 2017/18 season. In the 2017/18 season, Newcastle United have conceded the most goals, while Newcastle United have conceded the most goals in both the 2017/18 and 2018/19 seasons.", "prediction 2": "The player who has conceded the most goals in the premiership is Tim Krul, playing as a goalkeeper for Norwich City. The player who has conceded the most goals in the Premiership is Harry Maguire, whose record for most goals conceded in a season is 58.", "prediction 3": "There are several players who have conceded the most goals in the Premier League. Tim Krul, a professional goalkeeper with Norwich City, has been the player to concede the most goals in the Premiership. In the Premier League, Arsenal have been the team to concede the most goals while in the league, Manchester City have conceded the most. During the 2014\u201315 season, Crystal Palace have conceded the most goals.", "prediction 4": "Tim Krul has conceded the most goals in the Premier League. Newcastle United's Kevin De Bruyne has the most goals conceded in a season, while Leicester City's Kevin De Bruyne has the most goals conceded in a season.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 108 }, { "error type": "Unverifiable", "explanation": "", "start": 109, "end": 178 }, { "error type": "Redundant", "explanation": "Tim Krul has conceded the most goals in the Premier League in both the season ending and the 2017/18 season. In the 2017/18 season, Newcastle United have conceded the most goals, ", "start": 179, "end": 271 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What teams did patriots lose to in super bowls?", "passages": [ [ "Ravens\u2013Patriots rivalry", "The Ravens played the Patriots for the third consecutive season in the 2012 AFC championship game, which the Ravens lost 23\u201320.", "The rivalry reached a new level of friction with this, the second career playoff game between the two clubs.", "The Ravens clawed to a 20\u201316 lead in the fourth quarter, but Patriots quarterback Tom Brady dove into the end zone to make the score 23\u201320 with around 11 minutes remaining; this proved to be the winning touchdown.", "On the Ravens' last possession of the game, quarterback Joe Flacco threw a pass to wide receiver Lee Evans in the corner of the end zone that would have been the game-winning touchdown, but a last-second strip by Patriots corner Sterling Moore forced the ball from the hands of Evans, forcing the game to be decided on a last-minute field goal by Ravens placekicker Billy Cundiff.", "With 11 seconds remaining on the clock, Cundiff missed the 32-yard field goal attempt, allowing the Patriots to kill the clock on their way to Super Bowl XLVI for a rematch with the New York Giants.", "The Ravens' first regular-season win over the Patriots came on September 23, 2012.", "The game was emotional as receiver Torrey Smith was competing following the death of his brother in a motorcycle accident just the night before." ], [ "New England Patriots", "Following their Super Bowl loss, they returned to the playoffs in 1986, but lost in the first round.", "The team would not make the playoffs again for eight more years.", "During the 1990 season, the Patriots went 1\u201315.", "They changed ownership three times in the ensuing 14 years, being purchased from the Sullivan family first by Victor Kiam in 1988, who sold the team to James Orthwein in 1992.", "Orthwein intended to move the team to his native St. Louis, Missouri (where it would have been renamed as the St. Louis Stallions), but instead sold the team in 1994 to its current owner Robert Kraft.", "Though Orthwein's period as owner was short and controversial, he did oversee major changes to the team, first with the hiring of former New York Giants coach Bill Parcells in 1993.", "Orthwein and his marketing team also commissioned the NFL to develop a new visual identity and logo, and changed their primary colors from the traditional red, white and blue to blue and silver for the team uniforms.", "Parcells would bring the Patriots to two playoff appearances, including Super Bowl XXXI, which they lost to the Green Bay Packers by a score of 35\u201321.", "Pete Carroll, Parcells's successor, would also take the team to the playoffs twice in 1997 & 1998 before being dismissed as head coach after the 1999 season." ], [ "2011 New England Patriots season", "The Patriots, as was the case in their previous appearance against these same Giants in Super Bowl XLII, had a chance to join the San Francisco 49ers, the Dallas Cowboys, the Pittsburgh Steelers, and the Green Bay Packers as the only teams to win at least four Super Bowls (the Packers, who had entered the 2011 season as the defending champions, had not yet won a fourth Super Bowl when the Patriots had last appeared).", "Instead, the Patriots tied a then-NFL record for most losses in a Super Bowl that had been set by the Minnesota Vikings and tied by the Denver Broncos and Buffalo Bills, each of whom had lost four.", "With the loss, along with losses in 1985, 1996, and 2007, the Patriots tied with the Denver Broncos, Buffalo Bills and Minnesota Vikings for most Super Bowl losses at four (although the Broncos would lose their fifth against the Seattle Seahawks two years later, and the Patriots would lose their fifth six years later).", "The Patriots traded their original seventh-round pick to the Atlanta Falcons for offensive lineman Quinn Ojinnaka in August 2010.", "The Patriots also acquired the Denver Broncos' fourth-round selection in exchange for a sixth-round selection and running back Laurence Maroney.", "The Patriots acquired the sixth-round selection from the New Orleans Saints in a September 2009 trade for tight end David Thomas." ] ], "gold": "The New England Patriots have made 11 Super Bowl appearances, 6 of which were wins and 5 of which were losses. The losses occurred in Super Bowl LII to the Philadelphia Eagles, in Super Bowls XLVI and XLII to the New York Giants, in Super Bowl XXXI to the Green Bay Packers, and in Super Bowl XX to the Chicago Bears. ", "prediction 1": "New England Patriots have lost four Super Bowls to teams. The Patriots lost to the Green Bay Packers in Super Bowl XXXI in 1985, to the Minnesota Vikings in 1996, and to the Seattle Seahawks in 2007.", "prediction 2": "The New England Patriots have lost four Super Bowls. They have lost to the New Orleans Saints, the Philadelphia Eagles, the Chicago Bears, and the Seattle Seahawks.", "prediction 3": "The New England Patriots have lost four Super Bowls. In 1985, 1986, and 2007, the Patriots lost to the Minnesota Vikings. In 1986, they lost to the Ravens in the first round. In 1992, they lost to the Packers in the first round.", "prediction 4": "The New England Patriots have lost four Super Bowls, including two in 1985. The Patriots lost to the Minnesota Vikings and the Green Bay Packers in 1985 and 2007. The Patriots also lost to the New Orleans Saints in 2009. The Patriots have also lost to the San Francisco 49ers and the New York Giants in Super Bowls XLVI and XXXI.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 128 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 31, "end": 35 }, { "error type": "Unverifiable", "explanation": "", "start": 129, "end": 162 }, { "error type": "Unverifiable", "explanation": "", "start": 163, "end": 199 } ], "missing-info": [], "corrected-prediction": "New England Patriots have lost five Super Bowls to teams. The Patriots lost to the Green Bay Packers in Super Bowl XXXI." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did apple stop supporting safari for windows?", "passages": [ [ "Safari (web browser)", "This move triggered negative feedback in community.", "Safari Technology Preview was first released alongside OS X El Capitan 10.11.4.", "Safari Technology Preview releases include the latest version of WebKit, incorporating Web technologies to be incorporated in future stable releases of Safari, so that developers and users can install the Technology Preview release on a Mac, test those features, and provide feedback.", "On macOS, Safari is a Cocoa application.", "It uses Apple's WebKit for rendering web pages and running JavaScript.", "WebKit consists of WebCore (based on Konqueror's KHTML engine) and JavaScriptCore (originally based on KDE's JavaScript engine, named KJS).", "Like KHTML and KJS, WebCore and JavaScriptCore are free software and are released under the terms of the GNU Lesser General Public License.", "Some Apple improvements to the KHTML code are merged back into the Konqueror project.", "Apple also releases additional code under an open source 2-clause BSD-like license.", "Until Safari 6.0, it included a built-in web feed aggregator that supported the RSS and Atom standards." ], [ "Safari (web browser)", "Together with Mac OS X 10.7 Lion, Apple released Safari 5.1 for both Windows and Mac on July 20, 2011, with the new function 'Reading List' and a faster browsing experience.", "Apple simultaneously released Safari 5.0.6 for Mac OS X 10.5 Leopard, excluding Leopard users from the new functions in Safari 5.1.", "Safari 5.1.7 has become the last version of Safari developed for Windows.", "Safari 5 includes the following new features:\n\nAdditionally, the blue inline progress bar has returned to the address bar, in addition to the spinning bezel and loading indicator introduced in Safari 4.", "Top Sites view now has a button to switch to Full History Search.", "Other features include Extension builder for developers of Safari Extensions, which are built using web standards such as HTML5, CSS3, and JavaScript.", "Safari 6.0 was previously known as Safari 5.2 until Apple announced the change at WWDC 2012.", "The stable release of Safari 6 coincided with the release of OS X Mountain Lion on July 25, 2012, and is integrated into the OS.", "As Apple integrated it with Mountain Lion, it is no longer available for download from the Apple website or other sources.", "Apple released Safari 6 via Software Update for users of OS X Lion.", "It has not been released for OS X versions prior to Lion or for Windows." ] ], "gold": "Safari is a graphical web browser developed by Apple, mostly based on open-source software such as WebKit. A Windows version was available from 2007 to 2012. Apple released their last version before stopping support for Safari on Windows on May 9, 2012.", "prediction 1": "Apple stopped supporting Safari for Windows in 2012. The stable release of Safari 6 coincided with the release of OS X Mountain Lion. It has not been released for OS X versions prior to Lion or for Windows. Safari 6.0 was previously known as Safari 5.2 until Apple announced the change at WWDC 2012. The last supported version of Safari for Windows was Safari 5.1.7.", "prediction 2": "Apple stopped supporting Safari for Windows on Windows 8.1 and Windows 10 on October 16, 2010. This move triggered negative feedback in the community. Safari 5.1.7 has become the last version of Safari developed for Windows. The stable release of Safari 6 coincided with the release of OS X Mountain Lion on July 25, 2012, and is integrated into the OS. As Apple integrated it with Mountain Lion, it is no longer available for download from the Apple website or other sources.", "prediction 3": "Apple stopped supporting Safari for Windows in August 2013, when it stopped developing Safari for Windows. Safari was discontinued in July 2016 and Apple stopped supporting Safari for Windows in August 2017.", "prediction 4": "Apple stopped supporting Safari for Windows in 2012. In July 2012, the stable release of Safari 6 coincided with the release of OS X Mountain Lion. The stable release of Safari 5 coincided with the release of OS X Lion. In December 2015, Apple stopped supporting Safari for Windows in January 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 52 }, { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 299 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 300, "end": 366 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " Safari 5.1.7, released on July 20, 2011, has become the last version of Safari developed for Windows." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who won the battle of sullivan's island?", "passages": [ [ "Charles Lee (general)", "Charles Lee (general)\n\nCharles Lee (\u00a0\u2013 2 October 1782) served as a general of the Continental Army during the American War of Independence.", "He also served earlier in the British Army during the Seven Years War.", "He sold his commission after the Seven Years War and served for a time in the Polish army of King Stanislaus II.", "Lee moved to North America in 1773 and bought an estate in Virginia.", "When the fighting broke out in the American War of Independence in 1775, he volunteered to serve with rebel forces.", "Lee's ambitions to become Commander in Chief of the Continental Army were thwarted by the appointment of George Washington to that post.", "During 1776, forces under his command repulsed a British attempt to capture Charleston, which boosted his standing with the army and Congress.", "Later that year, he was captured by British cavalry under Banastre Tarleton; he was held by the British as a prisoner until exchanged in 1778.", "During the Battle of Monmouth later that year, Lee led an assault on the British that miscarried.", "He was subsequently court-martialed and his military service brought to an end.", "He died in Philadelphia in 1782.", "Lee was born on in Darnhall, Cheshire, England, the son of Major General John Lee and his wife Isabella Bunbury (daughter of Sir Henry Bunbury, 3rd Baronet)." ], [ "William Moultrie", "William Moultrie\n\nWilliam Moultrie (; November 23, 1730 \u2013 September 27, 1805) was a South Carolina planter and politician who became a general in the American Revolutionary War.", "As colonel leading a state militia, in 1776 he prevented the British from taking Charleston, and Fort Moultrie was named in his honor.", "After independence, Moultrie advanced as a politician; he was elected by the legislature twice within a decade as Governor of South Carolina (1785\u201387, 1792\u201394), serving two terms.", "(The state constitution kept power in the hands of the legislature and prohibited governors from serving two terms in succession.)", "Moultrie was born in Charlestown in the Province of South Carolina.", "His parents were Dr. John and Lucretia (Cooper) Moultrie, and he was educated as a planter.", "Moultrie fought in the Anglo-Cherokee War (1761).", "Before the advent of the American Revolution, he was elected to the colonial assembly representing St. Helena Parish.", "In 1775, Moultrie was commissioned as colonel of the 2nd South Carolina Regiment in the state militia.", "In December of that year, he led a raid on an encampment of runaway slaves on Sullivan's Island, killing 50 and capturing the rest." ], [ "Battle of Sullivan's Island", "Battle of Sullivan's Island\n\nThe Battle of Sullivan's Island or the Battle of Fort Sullivan was fought on June 28, 1776, during the American Revolutionary War.", "It took place near Charleston, South Carolina, during the first British attempt to capture the city from American forces.", "It is also sometimes referred to as the First Siege of Charleston, owing to a more successful British siege in 1780.", "The British organized an expedition in early 1776 for operations in the rebellious southern colonies of North America.", "Delayed by logistical concerns and bad weather, the expedition reached the coast of North Carolina in May 1776.", "Finding conditions unsuitable for their operations, General Henry Clinton and Admiral Sir Peter Parker decided instead to act against Charleston.", "Arriving there in early June, troops were landed on Long Island (now called Isle of Palms), near Sullivan's Island where Colonel William Moultrie commanded a partially constructed fort, in preparation for a naval bombardment and land assault.", "General Charles Lee, commanding the southern Continental theater of the war,\nwould provide supervision.", "The land assault was frustrated when the channel between the two islands was found to be too deep to wade, and the American defenses prevented an amphibious landing.", "The naval bombardment had little effect due to the sandy soil and the spongy nature of the fort's palmetto log construction." ] ], "gold": "The side of South Carolina and leaders Charles Lee and William Moultrie won the battle of Sullivan's Island during the American Revolutionary War. Lee served as a general of the Continental Army during the American Revolutionary War, and Moultrie was a South Carolina planter and politician who became a general in the same war.", "prediction 1": "The Battle of Sullivan's Island or the Battle of Fort Sullivan was fought on June 28, 1776, during the American Revolutionary War. It took place near Charleston, South Carolina, during the first British attempt to capture the city from American forces. The victor was General Charles Lee, who led the Continental Army during the American War of Independence and George Washington, who led the Continental Army during the American Revolutionary War. The victor was Colonel William Moultrie, a South Carolina planter and politician who became a general in the American Revolutionary War.\n", "prediction 2": "The Battle of Sullivan's Island or the Battle of Fort Sullivan was fought on June 28, 1776, during the American Revolutionary War. It took place near Charleston, South Carolina, during the first British attempt to capture the city from American forces. General Charles Lee led the Continental Army during the war and was subsequently court-martialed and his military service brought to an end. William Moultrie led the South Carolina militia and prevented the British from taking Charleston.", "prediction 3": "The Battle of Sullivan's Island or the Battle of Fort Sullivan was fought on June 28, 1776, during the American Revolutionary War. Valiant American forces defeated a British army in an ambush on a British fort on Sullivan's Island, and the battle is sometimes referred to as the First Siege of Charleston owing to a more successful British siege in 1780. Recently, historians have been able to pinpoint the generals who led the victory in this war, considering both General Charles Lee and General William Moultrie and Colonel William Moultrie.", "prediction 4": "The battle of Sullivan's Island or battle of Fort Sullivan was fought on June 28, 1776, during the American Revolutionary War. It took place near Charleston, South Carolina, during the first British attempt to capture the city from American forces.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 91 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 293, "end": 296 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 448 } ], "missing-info": [], "corrected-prediction": "The Battle of Sullivan's Island was fought during the American Revolutionary War. The victor was General Charles Lee, who served as a general in the Continental Army and Colonel William Moultrie, a South Carolina planter and politician who became a general.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who does the voice of alex in madagascar?", "passages": [ [ "Ben Stiller", "He also made extended guest appearances on \"Curb Your Enthusiasm\" and \"Arrested Development\" in the same year.", "In 2005, Stiller appeared in \"Madagascar\", which was his first experience as a voice actor in an animated film.", "\"Madagascar\" was a massive worldwide hit, and spawned the sequels \"\" in 2008 and \"\" in 2012.", "In 2006, Stiller had cameo roles in \"School for Scoundrels\" and \"Tenacious D in The Pick of Destiny\"; he was executive producer of the latter.", "In December 2006, he had the lead role in \"Night at the Museum\".", "Although not a critical favorite, it earned over $115 million in ten days.", "In 2007, Stiller starred alongside Malin \u00c5kerman in the romantic comedy \"The Heartbreak Kid\".", "The film earned over $100 million worldwide despite receiving mostly negative reviews.", "In 2008, Stiller directed, co-wrote, co-produced, and starred in the film \"Tropic Thunder\", with Robert Downey Jr. and Jack Black; Stiller had originally conceived of the film's premise while filming \"Empire of the Sun\" in 1987.", "In 2009, he starred with Amy Adams in \"\", sequel to \"Night at the Museum\"." ], [ "Madagascar (franchise)", "\"The Madagascar Penguins in a Christmas Caper\" is a computer-animated short film, which premiered in theaters on October 7, 2005 with the stop-motion film, \"\".", "The short was directed by animation veteran Gary Trousdale, produced by Teresa Cheng, and written by Michael Lachance.", "Set on Christmas Eve, the 12-minute film features four penguins from Central Park Zoo who discover that one of them has gone missing.", "\"Madly Madagascar\" is a Valentine's Day-themed short film, It was released on DVD on January 29, 2013, and starred all the main characters from the \"Madagascar\" film series.", "The story appears to take place sometime between the second and third films.", "It featured many of the same voice actors as the films, including Ben Stiller, Chris Rock, David Schwimmer, and Jada Pinkett Smith.", "However, voice actor Danny Jacobs once again replaced Sacha Baron Cohen as the voice of the character King Julien.", "King Julien finds a love potion and starts selling it to members of the watering hole, making Marty attractive to all the animals.", "Skipper and the penguins organise a rescue mission for his doll girlfriend.", "\"Merry Madagascar\" is a Christmas special first broadcast on the NBC network in November 2009, which starred the characters from the \"Madagascar\" film series.", "The story appears to takes place sometime between the first and second films." ], [ "Madagascar (franchise)", "Madagascar (franchise)\n\nMadagascar is a computer-animated franchise produced by DreamWorks Animation.", "Voices of Ben Stiller, Chris Rock, David Schwimmer and Jada Pinkett Smith are featured in the films.", "It began with the 2005 film \"Madagascar\", the 2008 sequel \"\", and the third film \"\" in 2012.", "A spin-off film featuring the penguins, titled \"Penguins of Madagascar\", was released in 2014.", "A fourth film, \"Madagascar 4\", was announced for 2018, but has since been removed from its schedule due to the studio's restructuring.", "The overall plot through the series follows the adventures of four Central Park Zoo animals who have spent their lives in blissful captivity and are unexpectedly shipped back to Africa.", "Now they must struggle to survive while attempting to return to New York City with the help of a crafty cadre of penguins and with many other characters along the way.", "\"Madagascar\" is a 2005 computer-animated comedy film and the first film in the series.", "Directed by Eric Darnell and Tom McGrath, the film tells the story of four Central Park Zoo animals: Alex the Lion (Ben Stiller), Marty the Zebra (Chris Rock), Melman the Giraffe (David Schwimmer), and Gloria the Hippo (Jada Pinkett Smith)." ] ], "gold": "Ben Stiller does the voice of Alex the lion in the film Madagascar and the movie's sequels, Madagascar: Escape 2 Africa and Madagascar 3: Europe's Most Wanted. However, in Madagascar Escape 2 Africa, Quinn Dempsey Stiller, Declan Swift do the voice of Alex as a cub with Quinn Dempsey Stiller being Ben Stiller's real life son. Ben Stiller also does the voice of Alex the lion in Merry Madagascar, a 2009 television Christmas special that aired on NBC and Madly Madagascar, a direct-to-DVD Valentine's Day-themed short film that was released in 2013. Wally Wingert does the voice of Alex in the first Madagascar video game, The Penguins of Madagascar, and its spin-off, The Penguins of Madagascar: Dr. Blowhole Returns \u2013 Again!. Crispin Freeman plays Alex the lion in All Hail King Julien, an American computer-animated 3D streaming television series that is a prequel to the first Madagascar film.", "prediction 1": "Alex the Lion is voiced by Ben Stiller in the 2005 film Madagascar. Chris Rock voiced the character Alex in the 2008 sequel Madagascar and in 2012's Madagascar 3. Danny Jacobs voiced Alex in Madagascar 4 and in Madly Madagascar, a Valentine's Day-themed short film, but replaced Sacha Baron Cohen as the voice of King Julien.", "prediction 2": "In the 2005 film Madagascar, Ben Stiller voices Alex the Lion. In the 2008 sequel Madagascar, David Schwimmer voices Alex the Giraffe. In the 2009 Christmas special Madly Madagascar, Danny Jacobs voices Marty, and in 2010 Danny Jacobs voices Alex the Lion.", "prediction 3": "Alex the Lion is voiced by Ben Stiller in the 2005 film Madagascar, which was a huge worldwide hit. Chris Rock voices Alex in the 2008 sequel and 2012 remake of the film. The 2007 animated short film Madly Madagascar is based on the 2005 film, but features many of the same voices. Danny Jacobs voices Marty in Madly Madagascar.", "prediction 4": "In the Madagascar animated series, Ben Stiller is the voice of Alex the Lion. Chris Rock voices Alex and David Schwimmer voices Marty the Zebra. Danny Jacobs voices Alex in Madagascar.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 100, "end": 104 }, { "error type": "Unverifiable", "explanation": "", "start": 112, "end": 162 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 183, "end": 187 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 191, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 325 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "Alex the Lion is voiced by Ben Stiller in the 2005 film Madagascar. \"Madly Madagascar\" is a Valentine's Day-themed short film, It was released on DVD on January 29, 2013. Ben Stiller reprises his role as Alex here. \"Merry Madagascar\" is a 2009 Christmas special first broadcast on the NBC." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the virgin islands become part of the united states?", "passages": [ [ "History of the United States Virgin Islands", "Von Scholten would later be summoned before a commission of enquiry for his action and deprived of his pension but he was eventually exonerated by the Supreme Court.", "The United States' first secretary in London, Henry White attempted to purchase the islands from Denmark in 1899 to resist European incursions into the Americas.", "The sale was unsuccessful and White attributed the failure to the influence of Kaiser Wilhelm II of the ascendent German Empire.", "During World War I, the fear of rising German influence in the Caribbean region prompted the President Woodrow Wilson to assert the Roosevelt Corollary in Haiti and the Dominican Republic.", "In 1917 a treaty was concluded in which the United States purchased the islands for $25,000,000 (about $390,000,000 in 2010 dollars).", "After the United States bought what is now known as the United States Virgin Islands from the Danish, the islands officially became an unincorporated U.S. territory in 1927.", "Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens." ], [ "History of the United States Virgin Islands", "Early inhabitants of the Virgin Islands included the Ciboney, Arawaks, and Island Caribs.", "The first documented Europeans to visit the islands arrived with Christopher Columbus.", "The islands were occupied by several nations over the next century, including England, the Dutch Republic, France, and Denmark.", "In 1733, the Danish West India Company purchased Saint Croix from the French and brought together Saint Thomas, Saint Croix, and Saint John as the Danish West Indies.", "Danish trading posts were set up on the islands, trading in sugar, slaves and other goods.", "Sugar cane cultivation was a major economic activity for many years, with slaves used as one of the labor sources.", "However, following increasing humanitarian awareness, laws against slavery and a slave rebellion in 1848, the governor Peter von Scholten officially freed the last slaves the same year.", "The islands were purchased from the Danish by the United States in 1917 under the Treaty of the Danish West Indies.", "Although not much is known about the Guanahatabey people who inhabited the islands during the Stone Age, archaeological evidence seems to indicate that they were hunter-gatherers.", "They made tools of stone and flint but left few other artifacts behind.", "Experts at canoe building and seamanship, the Arawaks migrated from the Amazon River Valley and Orinoco regions of Venezuela and Brazil, settling on the islands near coasts and rivers." ] ], "gold": "After the United States bought what is now known as the United States Virgin Islands from the Danish in 1917 under the Treaty of the Danish West Indies, the islands officially became an unincorporated U.S. territory in 1927. Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens.", "prediction 1": "The Virgin Islands were acquired from Denmark in 1917, when the United States bought them for $25 million. They officially became part of the United States in 1927. Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens.", "prediction 2": "The Virgin Islands were part of the United States from 1733 to 1867, but they became part of the United States in 1927 when the United States purchased them from Denmark under a treaty. Most residents of the islands were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens.", "prediction 3": "The islands were bought from Denmark in 1917 and became part of the United States on September 7, 1917. They became part of the United States on September 19, 1927, and were part of the United States until 1936. Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens.", "prediction 4": "The United States purchased the Virgin Islands from Denmark for $25,000,000 in 1917, and the islands became part of the United States in 1927. Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 106 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Virgin Islands were acquired from Denmark in 1917, when the United States bought them under the Treaty of the Danish West Indies. They officially became part of the United States in 1927. Most residents were granted U.S. citizenship in 1936, and an act of 1932 provided that all natives of the Virgin Islands who on the date of the act were residing in the continental United States or any of its insular possessions or territories were U.S. citizens." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "How many siberian tigers are in the wild?", "passages": [ [ "Siberian tiger", "Siberian tiger\n\nThe Siberian tiger (\"Panthera tigris tigris\", syn.", "\"Panthera tigris altaica\") is a tiger population in the Far East, particularly the Russian Far East and Northeast China.", "This population inhabits mainly the Sikhote Alin mountain region in southwest Primorye Province in the Russian Far East.", "The Siberian tiger once ranged throughout Korea, north China, Russian Far East, and eastern Mongolia.", "In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals.", "The population had been stable for more than a decade due to intensive conservation efforts, but partial surveys conducted after 2005 indicate that the Russian tiger population was declining.", "An initial census held in 2015 indicated that the Siberian tiger population had increased to 480\u2013540 individuals in the Russian Far East, including 100 cubs.", "This was followed up by a more detailed census which revealed there was a total population of 562 wild Siberian tigers in Russia.", "Results of a phylogeographic study comparing mitochondrial DNA from Caspian tigers and living tiger subspecies indicate that the common ancestor of the Siberian and Caspian tigers colonized Central Asia from eastern China, via the Gansu\u2212Silk Road corridor, and then subsequently traversed Siberia eastward to establish the Siberian tiger population in the Russian Far East." ] ], "gold": "The Siberian tiger population currently inhabits mainly the Sikhote-Alin mountain region in southwest Primorye Province in the Russian Far East. In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals. The population had been stable for more than a decade because of intensive conservation efforts, but partial surveys conducted after 2005 indicate that the Russian tiger population was declining. An initial census held in 2015 indicated that the Siberian tiger population had increased to 480\u2013540 individuals in the Russian Far East, including 100 cubs.", "prediction 1": "The Siberian tiger is a tiger population in the Far East, particularly the Russian Far East and Northeast China. In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals. In 2016, the population had increased to 560 individuals in the Russian Far East, including 100 cubs. This was followed up by a more detailed census, which revealed there was a total population of 562 wild Siberian tigers in Russia. In 2016, there were 480\u2013540 individuals in the Russian Far East, including 100 cubs.", "prediction 2": "The Siberian tiger, also known as Panthera tigris altaica, is a tiger population in the Far East, particularly the Russian Far East and Northeast China. In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals. An initial census held in 2015 indicated that the Siberian tiger population had increased to 480\u2013540 individuals in the Russian Far East, including 100 cubs. This was followed up by a more detailed census which revealed there were 562 wild Siberian tigers in Russia, including 100 cubs. This was followed up by a more detailed census which revealed there was a total population of 562 wild Siberian tigers in Russia.", "prediction 3": "In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals. This was followed up by a more detailed census which revealed there was a total population of 562 wild Siberian tigers in Russia.", "prediction 4": "The Siberian tiger is a tiger population in the Far East, particularly the Russian Far East and Northeast China. This population inhabits mainly the Sikhote Alin mountain region in southwest Primorye Province in the Russian Far East. In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 112 }, { "error type": "Unverifiable", "explanation": "", "start": 251, "end": 352 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 483 }, { "error type": "Unverifiable", "explanation": "", "start": 484, "end": 492 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Siberian tiger population currently inhabits mainly the Sikhote-Alin mountain region in southwest Primorye Province in the Russian Far East. In 2005, there were 331\u2013393 adult and subadult Siberian tigers in this region, with a breeding adult population of about 250 individuals. The population had been stable for more than a decade due to intensive conservation efforts, but partial surveys conducted after 2005 indicate that the Russian tiger population was declining. An initial census held in 2015 indicated that the Siberian tiger population had increased to 480\u2013540 individuals in the Russian Far East, including 100 cubs. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where does the book the last song take place?", "passages": [ [ "The Last Song (novel)", "The Last Song (novel)\n\n", "The Last Song is a 2009 novel by American author Nicholas Sparks.", "\"The Last Song\" is Sparks' fourteenth published novel (fifteenth published book), and was written specifically as the basis for the film adaptation by the same name.", "It was released on September 1, 2009 by Grand Central Publishing.", "The story revolves around the summer of Ronnie (Veronica) Miller's seventeenth year, during which she is sent to stay with her estranged father.", "Through their shared love of music, the duo reconnect.", "17-year-old Veronica \"Ronnie\" Miller is a troubled teenager who is wanting to live her own life and is trying her very best to ignore her divorced parents: Kim, her mother with whom she lives in New York, and Steve, her father who lives in his hometown of Wrightsville Beach, NC.", "Her mother decides that it would be in everyone's best interest if Ronnie and her 10-year-old brother, Jonah, spent the summer in Wrightsville Beach with Steve.", "Jonah is excited, while Ronnie can only wonder why her parents hate her so much as to send her there for the summer.", "Once they arrive, Kim leaves and Ronnie runs off to the carnival down at the beach, where she watches a volleyball game in the crowd." ] ], "gold": "The Last Song is a 2009 novel by American author Nicholas Sparks that was written specifically as the basis for the film adaptation by the same name. The story revolves around the summer of Ronnie \"Veronica\" Miller's seventeenth year, during which she leaves her home in New York to stay with her estranged father in Wrightsville Beach, NC. Her and her father reconnect over their shared love of music.", "prediction 1": "The Last Song is a 2009 novel by American author Nicholas Sparks. The story revolves around the summer of Ronnie Miller's seventeenth year, during which she is sent to stay with her estranged father. Through their shared love of music, the duo reconnect.", "prediction 2": "The Last Song is a 2009 novel by American author Nicholas Sparks. It takes place in Wrightsville Beach, North Carolina, and revolves around the summer of Ronnie (Veronica) Miller's seventeenth year, during which she is sent to stay with her estranged father. Through their shared love of music, the duo reconnect.", "prediction 3": "The book The Last Song is a 2009 novel by American author Nicholas Sparks. The story revolves around the summer of Ronnie Miller's seventeenth year, during which she is sent to stay with her estranged father. Through their shared love of music, the duo reconnect.", "prediction 4": "The story of The Last Song is set in 2009 and takes place in Wrightsville Beach, NC. It is the fourteenth published novel by American author Nicholas Sparks.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Last Song is a 2009 novel by American author Nicholas Sparks that was written specifically as the basis for the film adaptation by the same name. The story revolves around the summer of Ronnie Miller's seventeenth year, during which she leaves her home in New York to stay with her estranged father in Wrightsville Beach, NC.. Through their shared love of music, the duo reconnect." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who sang the duet at the end of beauty and the beast?", "passages": [ [ "Beauty and the Beast (Disney song)", "While the Dion-Bryson version received mixed reviews from critics who felt that it was inferior to Lansbury's original, the single became a commercial success, peaking at number nine on the \"Billboard\" Hot 100 and becoming the better-known of the two renditions.", "In addition to returning Disney songs to the pop charts after a thirty-year absence, the success of \"Beauty and the Beast\" also launched Dion's career and established her as a bankable recording artist.", "After \"Beauty and the Beast\" became the first Disney song to undergo a complete pop transformation, several contemporary artists were inspired to release their own radio-friendly renditions of Disney songs throughout the decade.", "Considered to be among Disney's best and most popular songs, \"Beauty and the Beast\" has since been covered by numerous artists.", "In 2004, the American Film Institute officially recognized \"Beauty and the Beast\" as one of the greatest songs in film history, ranking it 62nd.", "The song is also featured in the 2017 live-action adaptation; sung by Emma Thompson as Mrs. Potts during the film and also as a duet cover version by Ariana Grande and John Legend during the end credits.", "Grande and Legend's version of the song is an homage to the cover performed by Dion and Bryson for the 1991 film." ] ], "gold": "In the 2017 version of \"Beauty and the Beast\", the song \"Beauty and the Beast\" is performed by actress Emma Thompson in her role as Mrs. Potts during the film, and by Ariana Grande and John Legend as a duet during the end credits of the movie.", "prediction 1": "There are two versions of \"Beauty and the Beast.\" The 1991 version performed by Dion Bryson was a commercial success while the 2017 live-action adaptation featured Emma Thompson as Mrs. Potts and a duet cover version of the song performed by Ariana Grande and John Legend during the end credits.", "prediction 2": "The 1991 film version of \"Beauty and the Beast\" featured the singing duet between Dion and Bryson, while the 2017 live-action adaptation featured Emma Thompson singing as Mrs. Potts, while Ariana Grande and John Legend sang the duet during the end credits.", "prediction 3": "The 1991 film Beauty and the Beast features a duet between Dion and Bryson, featuring Emma Thompson as Mrs. Potts, and a cover version by Ariana Grande and John Legend at the very end of the movie.", "prediction 4": "The ending credits of Beauty and the Beast include a duet performance by Ariana Grande and John Legend. The 1991 remake featured Dion and Bryson singing the song.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "There are two versions of \"Beauty and the Beast.\" The 1991 version performed by Dion Bryson was a commercial success while the 2017 live-action adaptation featured Emma Thompson as Mrs. Potts and a duet cover version of the song performed by Ariana Grande and John Legend during the end credits." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sings my future's so bright i gotta wear shades?", "passages": [ [ "The Future's So Bright, I Gotta Wear Shades", "The Future's So Bright, I Gotta Wear Shades\n\n\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3.", "It is the opening track from their debut album, \"Greetings from Timbuk3\".", "Released as the album's first single in 1986, it was the band's only significant mainstream hit.", "The inspiration for the song, and the title specifically, came when Barbara MacDonald said to her husband singer/songwriter Pat MacDonald, \"The future is looking so bright, we'll have to wear sunglasses!\"", "But, while Barbara had made the comment in earnest \u2013 it was the early '80s, the two had met and married and were starting a family, their first EP was coming, their book was filling up with gigs \u2013 Pat heard the comment as an ironic quip and wrote down instead, \"The future's so bright, I gotta wear shades.\"", "From there, the lyrics to the song were born, but not the song as it ended up in the minds of popular culture.", "While Pat wrote a song of a young nuclear scientist and his rich future, listening audiences heard a graduation theme song." ] ], "gold": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk 3. It is the opening track from their debut album, \"Greetings from Timbuk3\". Released as the album's first single in 1986, it was the band's only significant mainstream hit. The inspiration for the song, and the title specifically, came when Barbara MacDonald said to her husband singer/songwriter Pat MacDonald, \"The future is looking so bright, we'll have to wear sunglasses!\" ", "prediction 1": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3. It is the opening track from their debut album, \"Greetings from Timbuk3\". Released as the album's first single in 1986, it was the band's only significant mainstream hit.", "prediction 2": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3. It is the opening track from their debut album, Greetings from Timbuk3. Released as the album's first single in 1986, it was the band's only significant mainstream hit. The inspiration for the song, and the title specifically, came when Barbara MacDonald said to her husband singer/songwriter Pat MacDonald, \"The future is looking so bright, we'll have to wear shades!\"", "prediction 3": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3. It is the opening track from their debut album, Greetings from Timbuk3. Released as the album's first single in 1986, it was the band's only significant mainstream hit.", "prediction 4": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3. It is the opening track from their debut album, \"Greetings from Timbuk3\". Released as the album's first single in 1986, it was the band's only significant mainstream hit. The inspiration for the song, and the title specifically, came when Barbara MacDonald said to her husband singer/songwriter Pat MacDonald, \"The future is looking so bright, we'll have to wear sunglasses!\"", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"The Future's So Bright, I Gotta Wear Shades\" is a song by Timbuk3. It is the opening track from their debut album, \"Greetings from Timbuk3\". Released as the album's first single in 1986, it was the band's only significant mainstream hit. The inspiration for the song, and the title specifically, came when Barbara MacDonald said to her husband singer/songwriter Pat MacDonald, \"The future is looking so bright, we'll have to wear sunglasses!\"" }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "Where was the movie treasure of the sierra madre filmed?", "passages": [ [ "The Treasure of the Sierra Madre (film)", "In an opening cameo, director John Huston is pestered for money by Bogart's character.", "The scene was directed by Bogart himself.", "Actor Robert Blake also appears as a young boy selling lottery tickets.", "A photograph included in the documentary accompanying the DVD release shows Ann Sheridan in streetwalker costume, with Bogart and Huston on the set.", "Many film-history sources credit Sheridan for a part.", "Co-star Tim Holt's father, Jack Holt, a star of silent and early sound Westerns and action films, makes a one-line appearance at the beginning of the film as one of the men down on their luck.", "\"The Treasure of the Sierra Madre\" was one of the first Hollywood films to be filmed on location outside the United States (in the state of Durango and street scenes in Tampico, Mexico), although many scenes were filmed back in the studio and elsewhere in the US.", "Filming took five and a half months to shoot.", "The first scene in the film with Bogart and Holt was the first to be shot.", "The opening scenes, filmed in longshot on the Plaza de la Libertad in Tampico, show contemporary (i.e. of the 1940s) cars and buses, even though the story opens in 1925, as evidenced by the lottery number's poster." ], [ "The Treasure of the Sierra Madre (film)", "The Treasure of the Sierra Madre (film)\n\nThe Treasure of the Sierra Madre is a 1948 American dramatic adventurous neo-western written and directed by John Huston.", "It is an adaptation of B. Traven's 1927 novel of the same name, set in the 1920s, in which, driven by their desperate economic plight, two young men, Fred C. Dobbs (Humphrey Bogart) and Bob Curtin (Tim Holt), join old-timer Howard (Walter Huston, the director's father) in Mexico to prospect for gold.", "\"The Treasure of the Sierra Madre\" was one of the first Hollywood productions to be shot on location outside the United States (in the state of Durango and street scenes in Tampico, Mexico), although many scenes were filmed back in the studio and elsewhere in the US.", "The movie is quite faithful to the source novel.", "In 1990, the film was selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant\".", "In 1925 in the Mexican oil-town of Tampico, Fred C. Dobbs (Humphrey Bogart) and Bob Curtin (Tim Holt), two unemployed American drifters, survive by bumming for spare change." ] ], "gold": "The Treasure of the Sierra Madre is a 1948 American Western adventure drama film written and directed by John Huston. It is an adaptation of B. Traven's 1927 novel of the same name, set in the 1920s, and follows two downtrodden men who join forces with a grizzled old prospector, in searching for gold in Mexico. The Treasure of the Sierra Madre was one of the first Hollywood productions to be shot on location outside the United States, in the state of Durango with street scenes in Tampico, Mexico. Other scenes were filmed back in the studio and elsewhere in the United States.", "prediction 1": "The Treasure of the Sierra Madre is a 1948 American dramatic adventure western film, written and directed by John Huston. It is an adaptation of B. Traven's 1927 novel of the same name, set in the 1920s, in which two young men, Fred C. Dobbs (Humphrey Bogart) and Bob Curtin (Tim Holt), join old-timer Howard (Walter Huston, the director's father), in Mexico to prospect for gold. The opening scenes of the movie were filmed in longshot on the Plaza de la Libertad in Tampico, Mexico, which show contemporary (i.e.e.e.", "prediction 2": "The Treasure of the Sierra Madre is a 1948 American dramatic adventurous neo-western written and directed by John Huston. Filming took five and a half months to shoot. Filming took place in the state of Durango and in Tampico, Mexico. The film's opening scenes were filmed in longshot on the Plaza de la Libertad in Tampico.", "prediction 3": "The Treasure of the Sierra Madre is a 1948 American dramatic adventure neo-western written and directed by John Huston. It is an adaptation of B. Traven's 1927 novel of the same name, set in the 1920s, in which, driven by their desperate economic plight, two young men, Fred C. Dobbs (Humphrey Bogart) and Bob Curtin (Tim Holt), join old-timer Howard (Walter Huston, the director's father) in the city of Durango, Mexico), although many scenes were filmed back in the studio and elsewhere in the US.", "prediction 4": "The 1948 American dramatic adventure western film The Treasure of the Sierra Madre was one of the first Hollywood films to be filmed on location outside the United States, in the state of Durango and street scenes in Tampico, Mexico. Filming took five and a half months to shoot. The opening scenes, filmed in longshot on the Plaza de la Libertad in Tampico, show contemporary (i.e. of the 1940s) cars and buses, even though the story opens in 1925, as evidenced by the lottery number's poster. The film's opening scenes, filmed in longshot on the Plaza de la Libertad in Tampico, Mexico, show contemporary (i.e.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Treasure of the Sierra Madre is a 1948 American dramatic adventure western film, written and directed by John Huston. It is an adaptation of B. Traven's 1927 novel of the same name, set in the 1920s, in which two young men, Fred C. Dobbs and Bob Curtin, join old-timer Howard, in Mexico to prospect for gold. \"The Treasure of the Sierra Madre\" was one of the first Hollywood productions to be shot on location outside the United States (in the state of Durango and street scenes in Tampico, Mexico), although many scenes were filmed back in the studio and elsewhere in the US. The opening scenes of the movie were filmed in longshot on the Plaza de la Libertad in Tampico, Mexico, which show contemporary." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the #1 listened to artist on spotify?", "passages": [ [ "Spotify", "In October 2015, \"Thinking Out Loud\" by Ed Sheeran became the first song to pass 500 million streams.", "A month later, Spotify announced that \"Lean On\" by Major Lazer and DJ Snake featuring M\u00d8 was its most streamed song of all time with over 525 million streams worldwide.", "In April 2016, Rihanna overtook Justin Bieber to become the biggest artist on Spotify, with 31.3 million monthly active listeners.", "In May 2016, Rihanna was overtaken by Drake with 3.185 billion total streams.", "In December 2016, Drake's just-under 26 million monthly listeners were overtaken by the Weeknd's 36.068 million.", "Later that month, Drake's song \"One Dance\" became the first song to hit one billion streams on Spotify.", "Upon its release in August 2017, the single \"Look What You Made Me Do\" by Taylor Swift earned over eight million streams within 24 hours, breaking the record for the most single-day streams for a track.", "On June 19, 2018, XXXTentacion's hit single \"Sad!\" broke Swift's single-day streaming record, amassing 10.4 million streams the day after he was fatally shot in Florida.", "In March 2011, Spotify announced a customer base of one million paying subscribers across Europe, and by September 2011, the number of paying subscribers had doubled to two million." ], [ "The Weeknd", "The Weeknd\n\nAbel Makkonen Tesfaye (born 16 February 1990), better known by his stage name The Weeknd, is a Canadian singer, songwriter, and record producer.", "Tesfaye has helped broadened R&B's musical palette to incorporate indie and electronic styles; his work has been categorized with the alternative R&B tag.", "Tesfaye anonymously uploaded several songs to YouTube under the name \"The Weeknd\" in 2010 and released the critically acclaimed mixtapes \"House of Balloons\", \"Thursday\", and \"Echoes of Silence\" in 2011.", "The mixtapes were later remastered and rereleased on the compilation album \"Trilogy\" (2012), after he signed with Republic Records and created his own record label XO.", "Tesfaye has had three No. 1 releases (\"Beauty Behind the Madness\" in 2015, \"Starboy\" in 2016, and \"My Dear Melancholy\" in 2018) and a No. 2 release (\"Kiss Land\" in 2013) on the US \"Billboard\" 200." ], [ "Ed Sheeran", "Ed Sheeran\n\nEdward Christopher Sheeran, (; born 17 February 1991) is an English singer, songwriter, guitarist, record producer, and actor.", "Sheeran was born in Halifax, West Yorkshire, and raised in Framlingham, Suffolk.", "He attended the Academy of Contemporary Music in Guildford as an undergraduate from the age of 18 in 2009.", "In early 2011, Sheeran independently released the extended play, \"No. 5 Collaborations Project\".", "After signing with Asylum Records, his debut album, \"+\" (pronounced \"plus\"), was released in September 2011.", "It topped the UK and Australian charts, reached number five in the US, and has since been certified seven-times platinum in the UK.", "The album contains the single \"The A Team\", which earned him the Ivor Novello Award for Best Song Musically and Lyrically.", "In 2012, Sheeran won the Brit Awards for Best British Male Solo Artist and British Breakthrough Act.", "\"The A Team\" was nominated for Song of the Year at the 2013 Grammy Awards, where he performed the song with Elton John.", "His second studio album, \"x\" (pronounced \"multiply\"), was released in June 2014.", "It peaked at number one in the UK and the US." ] ], "gold": "As of August 2021, Justin Bieber has the most monthly listeners on Spotify for a male artist, and Dua Lipa has the most monthly listeners on Spotify for a female artist, while Ed Sheeran is the most-followed male artist, and Ariana Grande is the most-followed female artist. The #1 listened to artist on Spotify from May 2016 to November 2016 was Drake, who has topped Spotify's chart a record of 3 times. The #1 listened to artist on Spotify from December 2016 to January 2017 was The Weeknd, also known as Abel Makkonen Tesfaye, who is a Canadian singer, song writer and record producer. The #1 listened to artist on Spotify from February 2017 to February 2018 was English singer-songwriter Ed Sheeran, who has sold more than 150 million records worldwide. ", "prediction 1": "In October 2015, Thinking Out Loud by Ed Sheeran became the first song to pass 500 million streams. A month later, Spotify announced that \"Lean On\" by Major Lazer and DJ Snake featuring M was its most streamed song of all time with over 525 million streams worldwide. In April 2016, Rihanna overtook Justin Bieber to become the biggest artist on Spotify, with 31.3 million monthly active listeners. In May 2016, Rihanna was overtaken by Drake with 3.185 billion total streams. In December 2016, Drake's just-under 26 million monthly listeners were overtaken by the Weeknd's 36.068 million.", "prediction 2": "The Spotify chart lists the music artists that have the most streams on Spotify. In October 2015, \"Thinking Out Loud\" by Ed Sheeran became the first song to pass 500 million streams. In April 2016, Rihanna overtook Justin Bieber to become the biggest artist on Spotify, with 31.3 million monthly active listeners. In May 2016, Rihanna was overtaken by Drake with 3.185 billion total streams. In December 2016, Drake's just-under 26 million monthly listeners were overtaken by the Weeknd with 36.068 million.", "prediction 3": "On Spotify, the most-listened-to artist is The Weeknd, who has the most streams per month. On the website, Spotify also lists Rihanna as the most-listened artist.", "prediction 4": "In October 2015, \"Thinking Out Loud\" by Ed Sheeran became the first song to pass 500 million streams. A month later, Spotify announced that \"Lean On\" by Major Lazer and DJ Snake featuring M was its most streamed song of all time with over 525 million streams worldwide. In April 2016, Rihanna overtook Justin Bieber to become the biggest artist on Spotify, with 31.3 million monthly active listeners. In May 2016, Rihanna was overtaken by Drake with 3.185 billion total streams. In December 2016, Drake's just-under 26 million monthly listeners were overtaken by The Weeknd's 36.068 million. Later that month, Drake's just-under 26 million monthly listeners were overtaken by the Weeknd's 36.068 million.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 398 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 476 }, { "error type": "Irrelevant", "explanation": "", "start": 574, "end": 589 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 542 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "In October 2015, Thinking Out Loud by English singer, songwriter, Ed Sheeran had the most streams. A month later, Spotify announced that \"Lean On\" by Major Lazer and DJ Snake featuring M was its most streamed song of all time. In April 2016, Rihanna overtook Justin Bieber to become the biggest artist on Spotify. In May 2016, Rihanna was overtaken by Drake. In December 2016, Drake was overtaken by Canadian singer, song writer and record producer Abel Makkonen Tesfaye, who is better known as the Weeknd. In August 2017, the single \"Look What You Made Me Do\" by Taylor Swift broke the record for the most single-day streams for a track. On June 19, 2018 Swifts record was broke by XXXTentacion's hit single \"Sad!\"." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When was the star wars theme song composed?", "passages": [ [ "Star Wars (Main Title)", "Star Wars (Main Title)\n\n\"Star Wars (Main Title)\" is a 1977 instrumental hit single composed and conducted by John Williams.", "It is the main musical theme of \"Star Wars\".", "It was performed by the London Symphony Orchestra.", "The track became a hit in the United States (#10) and Canada (#13) during the fall of that year.", "The composition draws influence from Erich Wolfgang Korngold's score for the 1942 film \u201cKings Row\".", "The B side featured the original movie score of Cantina Band.", "\"Star Wars (Main Title)\" was the lesser of two hits featuring music from \"Star Wars\".", "Meco's disco version of \"Star Wars Theme/Cantina Band\" reached number one concurrently with the chart run of Williams' original movie score version.", "The Star Wars main title theme was covered by Patrick Gleeson a month after the release of the London Symphony Orchestra performance.", "His version was released in France." ] ], "gold": "Star Wars (Main Title) is a musical theme composed and conducted by John Williams. It is the main musical theme of Star Wars and is also considered the primary leitmotif for Luke Skywalker, the protagonist of the original Star Wars trilogy. The original July 1977 recording was performed by the London Symphony Orchestra. The song Star Wars Theme/Cantina Band was also released in 1977.", "prediction 1": "\"Star Wars (Main Title)\" is a 1977 instrumental hit single composed and conducted by John Williams. It is the main musical theme of \"Star Wars\". It was performed by the London Symphony Orchestra.", "prediction 2": "The star wars theme song Star Wars (Main Title) was composed and conducted by John Williams in 1977. It was performed by the London Symphony Orchestra. The score draws influence from Erich Wolfgang Korngold's score for the 1942 film King's Row.", "prediction 3": "\"Star Wars (Main Title)\" is a 1977 instrumental hit single composed and conducted by John Williams. It is the main musical theme of \"Star Wars.\" It was performed by the London Symphony Orchestra.", "prediction 4": "The star wars theme song \"Star Wars (Main Title)\" was composed in 1977 and was conducted by John Williams. The track was performed by the London Symphony Orchestra. It became a hit in the United States (#10) and Canada (#13) during the fall of that year.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "\"Star Wars (Main Title)\" is a 1977 instrumental hit single composed and conducted by John Williams. It is the main musical theme of \"Star Wars\". It was performed by the London Symphony Orchestra." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who won the most gold medals in the 2014 commonwealth games?", "passages": [ [ "2014 Commonwealth Games medal table", "2014 Commonwealth Games medal table\n\nThe 2014 Commonwealth Games (officially known as the XX Commonwealth Games), was a multi-sport event held in Glasgow, Scotland from 23 July to 3 August 2014.", "It was the first time that Glasgow hosted the games, and the third time it was hosted in Scotland after Edinburgh hosted in 1970 and 1986.", "A total of 4,947 athletes from 71 Commonwealth Games Associations (CGAs) competed in 261 events in 17 sports.", "Athletes from 37 participating CGAs won at least one medal; athletes from 21 CGAs won at least one gold medal.", "England led the medal table for the first time since 1986, winning 58 golds and 174 medals overall.", "Australia came second, after leading the medal table for the last six consecutive games, while Canada came third.", "Hosts Scotland enjoyed their best-ever performance by finishing in fourth place with a record 19 gold medals and 53 overall.", "Kiribati won its first-ever Commonwealth Games medal, a gold in the men's 105 kg weightlifting competition.", "Grenada won its first Commonwealth Games gold medal in the men's 400 metres.", "South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze.", "Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal." ], [ "Patricia Bezzoubenko", "Patricia Bezzoubenko\n\nPatricia Bezzoubenko (born 21 February 1997) is a Canadian individual rhythmic gymnast.", "She is the 2015 Pan American Games All-around bronze medalist, in the National level, she is a three-time Canadian Senior National champion.", "She holds dual citizenship with Canada and Russia.", "Now Patricia is coaching at Excellence RG Club in Toronto, Canada\n\nBezzoubenko was born in Canada but moved to Russia at the age of four with her parents and began training in Moscow.", "When her coaches learned she possessed dual citizenship with Canada, they arranged for her to work with Canadian coach Svetlana Joukova in Toronto.", "Bezzoubenko spends about half of the year training in Moscow as well as several months in Canada.", "Bezzoubenko appeared in international junior competitions in 2010.", "She won bronze medal in ball at the 2012 Pesaro Junior World Cup.", "At the Junior Pacific Rim Championships in Everett, Washington, Bezzoubenko won the all-around gold, at the event finals: she won 2 golds (clubs and hoop), a silver in ribbon, and bronze in ball.", "She then won the all-around gold at the Junior Pan American Championships in Cordoba, Argentina.", "Bezzoubenko debuted as a Senior in the 2013 Season, she competed in the Grand Prix and World Cup Rhythmic Gymnastics Series." ] ], "gold": "At the 2014 Commonwealth Games, England was the country that won the most gold medals with 58. Canadian rhythmic gymnast Patricia Bezzoubenko was the athlete who won the most gold medals with 5, including gold medals in ball, hoop and clubs.", "prediction 1": "The 2014 Commonwealth Games, officially known as the XX Commonwealth Games, was a multi-sport event held in Glasgow, Scotland, from 23 July to 3 August 2014. South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze. Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal. South African swimmer Chad Le Clos won the most medals, a total of seven including two gold, a total of a total of 174 medals overall. South African swimmer Chad le Clos won the most medals, a total of seven including two gold, a total of seven including two gold and a total of seven.", "prediction 2": "The 2014 Commonwealth Games was a multi-sport event held in Glasgow, Scotland from 23 July to 3 August 2014. South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze. Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal. South African swimmer Chad Le Clos won the most medals, a total of seven including two gold, one silver and four bronze.", "prediction 3": "The 2014 Commonwealth Games was a multi-sport event held in Glasgow, Scotland from 23 July to 3 August 2014. South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze. Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal.", "prediction 4": "The 2014 Commonwealth Games were a multi-sport event held in Glasgow, Scotland from 23 July to 3 August 2014. South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze medals. Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 278 }, { "error type": "Redundant", "explanation": "South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze. ", "start": 392, "end": 484 }, { "error type": "Incoherent", "explanation": "", "start": 485, "end": 526 }, { "error type": "Redundant", "explanation": " South African swimmer Chad le Clos won the most medals, a total of seven including two gold, one silver and four bronze. ", "start": 527, "end": 677 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "England led the medal table for the first time since 1986, winning 58 golds and 174 medals overall. Canadian rhythmic gymnast Patricia Bezzoubenko won the most gold medals with five in addition to a bronze medal. " }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Who sang i saw mama kissing santa claus?", "passages": [ [ "I Saw Mommy Kissing Santa Claus", "A less successful version of the song was released in 1952 by Spike Jones (with vocal by George Rock in the little boy voice used in Spike's hit \"All I Want For Christmas Is My Two Front Teeth\").", "Jones also recorded a parody for his personal pleasure titled \"I Saw Mommy Screwing Santa Claus.\"", "Popular versions of the song were released by the Ronettes, Molly Bee, Bobby Sherman, Andy Williams, The Beverley Sisters, The Four Seasons, The Jackson 5, Reba McEntire, Homer and Jethro, Amy Winehouse, John Mellencamp, Mitch Miller, John Prine, Sammi Sanchez, Tiny Tim, The Cheetah Girls, Bif Naked, Jessica Simpson, Teresa Brewer, Rica Fukami, Secret Chiefs 3 and Dionne Bromfield have also covered it.", "The Dollyrots recorded a variation (titled \"I Saw Mommy Biting Santa Claus\") with humorous lyrics.", "RuPaul and Kip Addotta both recorded versions with changed lyrics titled \"I Saw Daddy Kissing Santa Claus.\"", "Twisted Sister recorded their own variation of the song onto their album \"A Twisted Christmas\".", "John Mellencamp also filmed a music video to promote his recording for the 1987 Special Olympics charity album, \"A Very Special Christmas\".", "A made-for-television movie based on the song was released in 2001." ], [ "Jackson 5 Christmas Album", "Jackson 5 Christmas Album\n\nJackson 5 Christmas Album is the first Christmas studio album (and fourth overall) by Motown family quintet the Jackson 5, released in October 1970.", "Included on the \"Christmas Album\" is the Jackson 5's hit single version of \"Santa Claus Is Coming to Town\".", "The Jackson 5's versions of \"I Saw Mommy Kissing Santa Claus\" and \"Santa Claus Is Coming to Town\" remain frequent radio requests during the Christmas season.", "The album spent all four weeks at the number one position on \"Billboard\" magazine's special Christmas Albums chart that the magazine published in December 1970, making it the best-selling Christmas album of that year and also year 1972.", "This album was a top seller and would have charted high on the Billboard 200 but from 1963 to 1973, holiday albums were not allowed to chart.", "It has sold over 3.5 million copies worldwide.", "The album has also been praised by critics.", "In 2003, Universal Motown re-released the album with \"Little Christmas Tree\" (from \"A Motown Christmas\").", "In 2009, this configuration was released as Ultimate Christmas Collection with Christmas messages, remixes, and a Christmas medley, and again as Merry Christmas Jackson 5.", "The release of \"Jackson 5 Christmas Album\" in October 1970 marked the end of a successful year for the band." ], [ "Jimmy Boyd", "Jimmy Boyd\n\nJimmy Devon Boyd (January 9, 1939 \u2013 March 7, 2009) was an American singer, musician, and actor known for his recording of the song \"I Saw Mommy Kissing Santa Claus\".", "Boyd was born near Jayess, Mississippi to father Leslie and mother Winnie Boyd.", "His father was a farmer and picked cotton to help support the family that eventually included twenty-one children.", "When Boyd was two years old, his father put Boyd, a brother, and his mother on a train to Riverside, California.", "Not having enough money to buy tickets for himself, Boyd's father was a stowaway on freight trains west to join his family.", "Boyd's grandfather, William Boyd (known as \"Fiddler Bill\"), played at dances and family gatherings in Mississippi.", "Along with all of father's siblings, Leslie Boyd played guitar and harmonica and started teaching Boyd to play guitar when he was nine years old.", "Leslie had been a farmer when a drought hit and there were no more crops, so he picked cotton.", "Because his father was a cotton farmer and there was no cotton in California to pick, finding work was difficult.", "His father eventually got work cleaning up construction sites, and ended up becoming a finish carpenter.", "Boyd's parents would take their children to country and western dances held in a barn in Colton, California outside of Riverside." ], [ "Spike Jones", "Spike Jones\n\nLindley Armstrong \"Spike\" Jones (December 14, 1911\u00a0\u2013 May 1, 1965) was an American musician and bandleader specializing in satirical arrangements of popular songs and classical music.", "Ballads receiving the Jones treatment were punctuated with gunshots, whistles, cowbells and outlandish and comedic vocals.", "From the early 1940s to the mid-1950s, Jones and his band recorded under the title Spike Jones and his City Slickers and toured the United States and Canada as \"The Musical Depreciation Revue.\"", "Jones' father was a Southern Pacific railroad agent.", "Young Lindley Jones got his nickname by being so thin that he was compared to a railroad spike.", "At age 11 he got his first set of drums.", "As a teenager he played in bands that he formed himself; Jones' first band was called Spike Jones and his Five Tacks.", "A railroad restaurant chef taught him how to use pots and pans, forks, knives and spoons as musical instruments.", "Jones frequently played in theater pit orchestras.", "In the 1930s he joined the Victor Young orchestra and got many offers to appear on radio shows, including Al Jolson's \"Lifebuoy Program\", \"Burns and Allen\", and Bing Crosby's \"Kraft Music Hall\".", "Jones became bored playing the same music each night with the orchestras." ] ], "gold": "There are several singers of I Saw Mama Kissing Santa Claus. American singer Jimmy Boyd most notably sung it in 1952, while American musician Spike Jones and George Rock sang a less successful version of it in 1952. In 1970, it was sung by the Motown family quintet the Jackson 5.", "prediction 1": "There are several versions of the song. The original version was sang by Jimmy Boyd, and a less successful version was released in 1952 by Spike Jones. The Jackson 5 Christmas Album is the first Christmas studio album (and fourth overall) by the Motown family quintet the Jackson 5, released in October 1970. The song was covered by the Ronettes, Molly Bee, Bobby Sherman, Andy Williams, The Beverley Sisters, The Four Seasons, The Jackson 5, The Cheetah Girls, Jessica Simpson, Teresa Brewer, Secret Chiefs 3 and Dionne Bromfield.\n", "prediction 2": "Various artists have sang I Saw Mama Kissing Santa Claus. Jimmy Boyd, Spike Jones, Patsy Cline, The Monkees, The Four Seasons, The Jackson 5, and The Dollyrots sang versions of the song.", "prediction 3": "On Christmas Eve 1999, the song \"I Saw Mommy Kissing Santa Claus\" first became a hit in the United States after it was covered by A Little Christmas Thing Called Christmas by American singer Jimmy Boyd. Then, in 1952, Spike Jones and George Rock sang a less successful version of the song. And on Christmas Eve 2000, the song was reprised by Amy Winehouse and the Jackson 5 on their fourth studio album \"Christmas Album\".", "prediction 4": "There have been multiple versions of the song. The song was sang by The Ronettes, Molly Bee, Bobby Sherman, Andy Williams, The Beverley Sisters, The Jackson 5 and by RuPaul and Kip Addotta. The honor was given to Jimmy Boyd for singing the song. And Spike Jones and The Jackson 5 sang the song on their first Christmas studio album in October 1970.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 40, "end": 60 }, { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 241 }, { "error type": "Redundant", "explanation": "The Jackson 5 Christmas Album is the first Christmas studio album (and fourth overall) by the Motown family quintet the Jackson 5, released in October 1970. ", "start": 428, "end": 442 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "There are several versions of the song. It was sung by American singer Jimmy Boyd, and a less successful version was released in 1952 by American musicians Spike Jones and George Rock. The Motown family quintet the Jackson 5 also released the song in 1970. The song was covered by the Ronettes, Molly Bee, Bobby Sherman, Andy Williams, The Beverley Sisters, The Four Seasons, The Jackson 5, The Cheetah Girls, Jessica Simpson, Teresa Brewer, Secret Chiefs 3, Dionne Bromfield, Reba McEntire, Homer and Jethro, Amy Winehouse, John Mellencamp, Mitch Miller, John Prine, Sammi Sanchez, Bif Naked, and Rica Fukami,\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is anna devane daughter on general hospital?", "passages": [ [ "Anna Devane", "Anna gives birth to daughter Leora Devane Hayward on February 26, 2003, named after David's late brother, Leo du Pres (Josh Duhamel).", "When Leora's condition worsens, Joe Martin (Ray MacDonnell) convinces Anna to agree to another surgery.", "Leora does not survive and David lashes out accusing him of killing Leora for revenge.", "Anna in turns finds comfort with district attorney Jackson Montgomery (Walt Willey).", "Anna reaches out to David only to find him trying to poison the Martins with an amnesia drug.", "Anna locks David in his cabin until he accepts Leora's death as an accident.", "In the summer of 2003, Anna oversees the investigation into the murder of Michael Cambias (William deVry).", "Michael's supposed wife Kendall Hart (Alicia Minshew) is the prime suspect but Anna discovers finds evidence implicating David and Kendall's mother Erica Kane (Susan Lucci).", "Realizing she couldn't remain objective, Anna leaves the evidence at David's cabin with a letter.", "She reveals she is going to Paris to with Robin and does not want David to follow \n\nAnna resurfaces in 2006 when she runs into Robin and a very much alive Robert in the Markham Islands." ], [ "Anna Devane", "However, instead during contract negotiations, she took advantage of an out clause to work on another project.", "Hughes last taped scenes aired during December 16, last airing on December 17, 1991.", "If negotiations went well, Hughes was slated to return by the spring of 1992.", "In the interim, she was replaced by Camilla Moore who made her first appearance December 20, 1991.", "Moore last appeared on January 20, 1992 and Hughes returned to the role for one episode on February 25, 1992.", "Hughes briefly returned from November 13 to 22, 1995 as Anna's spirit to comfort the character's daughter Robin Scorpio (Kimberly McCullough), who is dealing with the loss of her boyfriend to AIDS-related illness and is herself HIV-positive.", "On \"All My Children\", when Hughes reprised the role of Alex in February 2001 after her maternity leave, Hughes also made her first appearance as Anna on March 2, 2001.", "In late July 2003, \"All My Children\" announced that Hughes would exit in the role of Anna when her contract expired.", "Hughes made her final appearance on September 11, 2003.", "An ABC spokesperson hinted that Hughes could return to the series in a recurring capacity but she never did.", "Rumors immediately followed that Hughes would return to \"GH\".", "However, Hughes later revealed in an interview that she was open to a return, but had not been contacted by the series." ], [ "General Hospital", "General Hospital\n\nGeneral Hospital (commonly abbreviated GH) is an American daytime television medical drama.", "It is listed in \"Guinness World Records\" as the longest-running American soap opera in production and the second longest-running drama in television in American history after \"Guiding Light\".", "Concurrently, it is the world's third longest-running scripted drama series in production after British serials \"The Archers\" and \"Coronation Street\", as well as the world's second-longest-running televised soap opera still in production.", "\"General Hospital\" premiered on the ABC television network on April 1, 1963.", "Same-day broadcasts as well as classic episodes were aired on SOAPnet from January 20, 2000, to December 31, 2013, following Disney-ABC's decision to discontinue the network.", "\"General Hospital\" is the longest-running serial produced in Hollywood, and the longest-running entertainment program in ABC television history.", "It holds the record for most Daytime Emmy Awards for Outstanding Drama Series, with 13 wins.", "The show was created by husband-and-wife soap writers Frank and Doris Hursley, who originally set it in a general hospital (hence the title), in an unnamed fictional city.", "In the 1970s, the city was named Port Charles, New York." ] ], "gold": "In 1985, Kimberly Anne McCullough plays the character of Robin Scorpio, the daughter of Robert Scorpio and Anna Devane, in the American soap opera General Hospital. On February 26, 2003, Anna Devane and David Hayward have a daugher together named Leora Devane Hayward.", "prediction 1": "Anna Devane is a fictional character on the American daytime television medical drama, General Hospital. Her daughter, Leora Devane Hayward, was born on February 26, 2003. The character first appeared on General Hospital in the summer of 2003, when she oversees the investigation into the murder of Michael Cambias.", "prediction 2": "General Hospital is an American daytime television medical drama. In the show, Anna has a daughter whose name is Leora Devane Hayward. On the show, a young Anna is a patient named Robin Scorpio who is the mother of Robin.", "prediction 3": "General Hospital is an American daytime television medical drama. The show is listed in Guinness World Records as the longest-running American soap opera in production and the second longest-running drama in television in American history after Guiding Light. In the summer of 2003, Anna oversees the investigation into the murder of Michael Cambias. Michael's supposed wife Kendall Hart is the prime suspect. Anna discovers evidence implicating David and Kendall's mother Erica Kane. In the same season, Anna gives birth to a daughter, Leora Devane Hayward.", "prediction 4": "General Hospital is an American daytime television medical drama that premiered on the ABC television network on April 1, 1963. In the show, Anna is the mother of Leora Devane Hayward, played by Kimberly McCullough, and Anna's spirit to comfort Robin Scorpio, played by Kimberly McCullough, who is dealing with the death of her boyfriend to AIDS-related illness and is herself HIV-positive. In later seasons, Anna is the mother of Robin Scorpio, played by Kimberly McCullough, while Hughes played the mother of the character of Anna Devane.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 315 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 221, "end": 243 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 172, "end": 220 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Anna Devane is a fictional character on the American daytime television medical drama, General Hospital. Her daughter, Leora Devane Hayward, was born on February 26, 2003. In 1995, Robin Scorpio (played by Kimberly McCullough) was Anne's daughter. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "How does the temperature of venus compare to that of earth?", "passages": [ [ "Super-Earth", "It is the greenhouse gases that keep the Earth warmer.", "Venus has a black-body temperature of only 184.2 K (\u221289\u00a0\u00b0C or \u2212128\u00a0\u00b0F ) even though Venus has a true temperature of 737 K (464\u00a0\u00b0C or 867\u00a0\u00b0F ).", "Though the atmosphere of Venus traps more heat than Earth's, NASA lists the black-body temperature of Venus based on the fact that Venus has an extremely high albedo (Bond albedo 0.90, Visual geometric albedo 0.67), giving it a lower black body temperature than the more absorbent (lower albedo) Earth.", "Earth's magnetic field results from its flowing liquid metallic core, but in super-Earths the mass can produce high pressures with large viscosities and high melting temperatures which could prevent the interiors from separating into different layers and so result in undifferentiated coreless mantles.", "Magnesium oxide, which is rocky on Earth, can be a liquid metal at the pressures and temperatures found in super-Earths and could generate a magnetic field in the mantles of super-Earths.", "That said, super-Earth magnetic fields are yet to be detected observationally.", "According to one hypothesis, super-Earths of about two Earth masses may be conducive to life." ] ], "gold": "From 1961-1990, the mean surface temperature of Earth was 57.2 \u00b0F (14.0 \u00b0C). The highest surface temperature on Earth was 134.3 \u00b0F (56.9 \u00b0C) and the lowest surface temperature on Earth was \u2212128.5 \u00b0F (\u221289.2 \u00b0C). The mean surface temperature of Venus is 867 \u00b0F (464 \u00b0C).", "prediction 1": "It is the greenhouse gases that keep the Earth warmer. Venus has a black-body temperature of only 184.2 K even though Venus has a true temperature of 737 K (464 \u00b0C or 867 \u00b0F ). NASA lists the black-body temperature of Venus based on the fact that Venus has an extremely high albedo, giving it a lower black body temperature than the more absorbent (lower albedo) Earth.", "prediction 2": "The average black-body temperature of Venus is 184.2 K, but the true temperature of Venus is 737 K.", "prediction 3": "On Earth, the temperature of the black body of Venus is about 400 K, while the true temperature of Venus is about 737 K. On Venus, the black body temperature is 184.2 K, while the true temperature is about 737 K.", "prediction 4": "On Earth, Venus has a black-body temperature of 184.2 K, while on Venus, it is 737 K (464 \u00b0C or 867 \u00b0F). NASA lists the black-body temperature of Venus based on the fact that Venus has an extremely high albedo, giving it a lower black body temperature than the more absorbent (lower albedo) Earth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 54 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 369 } ], "missing-info": [], "corrected-prediction": "Venus has a black-body temperature of only 184.2 K even though Venus has a true temperature of 737 K (464 \u00b0C or 867 \u00b0F ). " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When does the 2018 formula one season start?", "passages": [ [ "Formula One", "Formula One\n\nFormula One (also Formula 1 or F1) is the highest class of single-seater auto racing sanctioned by the F\u00e9d\u00e9ration Internationale de l'Automobile (FIA) and owned by the Formula One Group.", "The FIA Formula One World Championship has been one of the premier forms of racing around the world since its inaugural season in 1950.", "The word \"formula\" in the name refers to the set of rules to which all participants' cars must conform.", "A Formula One season consists of a series of races, known as \"Grands Prix\" (), which take place worldwide on purpose-built circuits and on public roads.", "The results of each race are evaluated using a points system to determine two annual World Championships: one for drivers, the other for constructors.", "Drivers must hold valid Super Licences, the highest class of racing licence issued by the FIA.", "The races must run on tracks graded \"1\" (formerly \"A\"), the highest grade-rating issued by the FIA.", "Most events occur in rural locations on purpose-built tracks, but several events take place on city streets.", "Formula One cars are the fastest regulated road-course racing cars in the world, owing to very high cornering speeds achieved through the generation of large amounts of aerodynamic downforce." ] ], "gold": "Formula One is the highest class of international auto racing for single-seater formula racing cars sanctioned by the F\u00e9d\u00e9ration Internationale de l'Automobile, or FIA. In 2015, the season started on March 15, 2015. For 2016, the season started on March 20, 2016. 2017's beginning of the season was on March 26, 2017.", "prediction 1": "The Formula One season consists of a series of races, known as Grands Prix, which take place worldwide on purpose-built circuits and on public roads. The results of each race are evaluated using a points system to determine two annual World Championships: one for drivers, the other for constructors. The races must run on tracks graded \"1\" (formerly \"A\"), the highest grade-rating issued by the FIA.", "prediction 2": "Formula One is the highest class of single-seater auto racing sanctioned by the F\u00e9d\u00e9ration Internationale de l'Automobile (FIA) and owned by the Formula One Group. The FIA Formula One World Championship has been one of the premier forms of racing around the world since its inaugural season in 1950. The 2018 season started on May 8, 2018.", "prediction 3": "Formula One is the highest class of single-seater auto racing sanctioned by the F\u00e9d\u00e9ration Internationale de l'Automobile (FIA) and owned by the Formula One Group. The FIA Formula One World Championship has been one of the premier forms of racing around the world since its inaugural season in 1950. The 2018 season started on August 5, 2018.", "prediction 4": "The 2018 Formula One season began on September 5, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 400 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Formula One is the highest class of international auto racing for single-seater formula racing cars sanctioned by the F\u00e9d\u00e9ration Internationale de l'Automobile, or FIA. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who won the last 20 over world cup?", "passages": [ [ "ICC T20 World Cup", "The third tournament was held in 2010, hosted by the countries making up the West Indies cricket team.", "England defeated Australia in the final in Barbados, which was played at Kensington Oval, winning its first and the only international tournament to date.", "The fourth tournament, the 2012 World Twenty20, was held in Asia for the first time, with all matches played in Sri Lanka.", "The West Indies won the tournament by defeating Sri Lanka in the final, winning its first international tournament since the 2004 Champions Trophy.", "The fifth tournament, the 2014 ICC World Twenty20, was hosted by Bangladesh, and was won by Sri Lanka defeating India, who became the first team to play in three finals.", "West Indies are the current World T20I holders, beating England in the 2016 final, winning their second title.", "When the Benson & Hedges Cup ended in 2002, the ECB needed another one day competition to fill its place.", "Cricketing authorities were looking to boost the game's popularity with the younger generation in response to dwindling crowds and reduced sponsorship.", "It was intended to deliver fast-paced, exciting cricket accessible to thousands of fans who were put off by the longer versions of the game.", "Stuart Robertson, the marketing manager of the ECB, proposed a 20 over per innings game to county chairmen in 2001 and they voted 11\u20137 in favour of adopting the new format." ], [ "History of the ICC World Twenty20", "History of the ICC World Twenty20\n\nThe ICC T20 World Cup was first held in 2007.", "It was first decided that every two years an ICC T20 World Cup tournament is to take place, except in the event of an ICC Cricket World Cup being scheduled in the same year, in which case it will be held the year before.", "The first tournament was in 2007 in South Africa where India defeated Pakistan in the final.", "Two Associate teams had played in the first tournament, selected through the 2007 ICC World Cricket League Division One, a 50-over competition.", "In December 2007 it was decided to hold a qualifying tournament with a 20-over format to better prepare the teams.", "With six participants, two would qualify for the 2009 World Twenty20 and would each receive $250,000 in prize money.", "The second tournament was won by Pakistan who beat Sri Lanka by 8 wickets in England on 21 June 2009.", "The 2010 ICC World Twenty20 tournament was held in West Indies in May 2010, where England defeated Australia by 7 wickets.", "The 2012 ICC World Twenty20 was won by the West-Indies, by defeating Sri Lanka at the finals.", "For the first time, a host nation competed in the final of the ICC World Twenty20.", "There were 12 participants for the title including Ireland and Afghanistan as 2012 ICC World Twenty20 Qualifier.", "It was the first time the World Twenty20 tournament took place in an Asian country." ], [ "2020 ICC T20 World Cup Qualifier", "2020 ICC T20 World Cup Qualifier\n\nThe 2020 ICC T20 World Cup Qualifier is an upcoming cricket tournament to determine which teams will qualify for the 2020 ICC T20 World Cup tournament in Australia.", "While no dates are yet confirmed, it is expected to take place in October 2019.", "Qualification groups began on 26 February 2018 in Argentina, with a total of 61 Associate Member teams out of originally scheduled 62 teams competing.", "Of these teams, 25 of them progressed to the regional finals in 2019, with the top eight teams progressing to the qualifier tournament.", "They will be joined by the top six teams from the 2015 qualifier that are outside the top ten places in the ICC T20I Championship by the cut-off date of 31 December 2018.", "In February 2018, in the opening round of sub-regional qualifiers in the Americas group, both the Cayman Islands and Bermuda registered wins against Argentina.", "In April 2018, the International Cricket Council (ICC) granted full international status to Twenty20 mens' matches played between member sides from 1 January 2019 onwards.", "Therefore, all the matches in the Regional Finals and the Qualifier itself, will be played as full Twenty20 Internationals (T20Is).", "Host nation, Australia, and the nine best team teams on 31 December 2018 who played in last edition of ICC Twenty20", "World Cup, are automatically entered for the final tournament." ] ], "gold": "The ICC Men's T20 World Cup is the international championship of Twenty20 International cricket. The 2012 ICC World T20 took place in Sri Lanka from 18 September to 7 October 2012 and was won by the West Indies. In the 2014 ICC World T20, which took place in Bangladesh, Sri Lanka beat India by 6 wickets. In the final of the 2016 ICC World T20, the West Indies defeated England by four wickets. ", "prediction 1": "The ICC World Twenty20 was first held in 2007 with England winning the first and only World Twenty20. The second and third ICC World Twenty20 were won by India and Pakistan respectively. The last ICC World Twenty20 was won by the West Indies, by defeating Sri Lanka at the finals.", "prediction 2": "The last 20 over world cup was won by England in Barbados on May 21, 2010. Then, in 2012, the West Indies won the tournament by defeating Sri Lanka in the final, winning its first international tournament since the 2004 Champions Trophy. Then, in 2014, the ICC World Twenty20 was held in Asia for the first time, with all matches played in Sri Lanka. During the 2014 ICC World Twenty20, Sri Lanka defeated India, who became the first team to play in three finals.", "prediction 3": "The ICC World Twenty20 cricket tournament is an annual cricket competition based on the format of Twenty20 overs. The last 20 over cricket tournament was hosted by the West Indies and won by them. The fifth and latest 20 over cricket tournament was won by India, with the West Indies winning the tournament by defeating Sri Lanka in the final. In 2016 and 2017 the West Indies won the tournament by defeating Sri Lanka in the final.", "prediction 4": "The last 20-over cricket world cup was held in 2017. The winning team in the 2010 and 2012 World T20s were England and Australia. The winning team in the 2012 World Twenty20 was the West Indies. The winning team in the 2014 and 2015 World T20s were the Sri Lankans. The winning team in the 2016 World T20I was the West Indies, who defeated Sri Lanka in the final. The winning team in the 2017 World T20I was the West Indies.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3,7]}", "start": 51, "end": 101 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7,8]}", "start": 154, "end": 172 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 256, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 280 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The ICC World Twenty20 was first held in 2007 with India winning. The second and third ICC World Twenty20 were won by Pakistan and England respectively. The last ICC World Twenty20 was won by the West Indies, defeating England in 2016. The 2012 World Twenty20, was held in Sri Lanka and with the West Indies winning. The 2014 ICC World Twenty20, was hosted by Bangladesh, and was won by Sri Lanka defeating India." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When is the last time the eagles won the superbo?", "passages": [ [ "History of the National Football League championship", "The first four Super Bowls served as inter-league championship games because of these inter-league championship games this created some confusion amongst football fans that there was a special World Championship series in the pre-merger era.", "After the merger, the Super Bowl became the NFL's championship game.\"", "\"The number in the parentheses is the total number of Super Bowl championships and the bolded number in parentheses is the total number of NFL championships.)\"", "In the sortable table below, teams are ordered first by number of appearances, then by number of wins, and finally by year of first appearance.", "Does not include the AFL or NFL championships won during the same seasons as the AFL\u2013NFL Super Bowl championships before the 1970 AFL\u2013NFL merger.", "Does not include AFL titles won from 1960\u20131965 or AAFC titles won from 1946\u20131949.", "Does not include folded NFL teams with zero \"Appearances/Top 2 Finishes.\"", "In the \"Seasons\" column, bold years indicate NFL championships won.", "(*) Because the NFL did not count tied games in league standings until 1972 (when ties were added to past standings retroactively), these seasons were considered to be \"perfect\" at the time they finished." ], [ "The Lombardi Curse", "The Lombardi Curse\n\nThe Lombardi Curse was an alleged sports-related curse that supposedly prevented the National Football League (NFL)'s Philadelphia Eagles franchise from winning the Super Bowl for as long as the game's trophy is named after Vince Lombardi.", "Its origin is traced to the Eagles upsetting the Green Bay Packers in the 1960 NFL Championship Game.", "This game ended up being the lone playoff defeat in Lombardi's coaching career as his Packers would go on to establish a dynasty that would win five NFL championships in the next seven seasons, including the first two Super Bowls.", "Meanwhile, the Eagles had not won another league championship since, including having never won the Super Bowl since the game started being played annually in 1966.", "They appeared in Super Bowl XV in the 1980 season and Super Bowl XXXIX in the 2004 season, but lost both times.", "In 1970, the Super Bowl trophy was officially named the Vince Lombardi trophy when the league decided to honor Lombardi by naming the trophy after him following his death in 1970.", "This renaming of the Super Bowl trophy combined with the Eagles inability to win the championship game has led some Eagles fans to believe that the franchise is cursed by Vince Lombardi; that beating Lombardi meant never winning the trophy named after him." ] ], "gold": "The Philadelphia Eagles had never won a Super Bowl until they won Super Bowl LII on February 4, 2017.", "prediction 1": "The Eagles have never won the Super Bowl. Instead, they have appeared in Super Bowl XV in the 1980 season and Super Bowl XXXIX in the 2004 season, but lost both times. The Lombardi Curse was an alleged sports-related curse that supposedly prevented the National Football League's Philadelphia Eagles franchise from winning the Super Bowl for as long as the game's trophy is named after Vince Lombardi. This renaming of the Super Bowl trophy combined with the Eagles inability to win the Super Bowl has led some Eagles fans to believe that the franchise is cursed by Vince Lombardi; that beating Lombardi meant never winning the trophy named after him. This renaming the Super Bowl trophy was officially named the Vince Lombardi trophy when the league decided to honor Lombardi trophy after him. In 1970, the Super Bowl trophy was named the Vince Lomb", "prediction 2": "The last time The Philadelphia Eagles won the Super Bowl was in 2006. The alleged sports-related curse The Lombardi Curse was an alleged sports-related curse that allegedly prevented the National Football League's Philadelphia Eagles franchise from winning the Super Bowl for as long as the game's trophy is named after Vince Lombardi. Its origin is traced to the Philadelphia Eagles upsetting the Green Bay Packers in the 1960 NFL Championship Game.", "prediction 3": "The Philadelphia Eagles have never won the Super Bowl. Instead, they appeared in Super Bowl XV in the 1980 season and Super Bowl XXXIX in the 2004 season, but lost both times.", "prediction 4": "The Philadelphia Eagles have not won the Super Bowl since the game started being played annually in 1966. The Lombardi Curse is an alleged sports-related curse that supposedly prevented the National Football League's Philadelphia Eagles franchise from winning the Super Bowl for as long as the game's trophy is named after Vince Lombardi. In 1970, the Super Bowl trophy was officially named the Vince Lombardi trophy when the league decided to honor Lombardi by naming the trophy after him following his death in 1970.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 401 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 651 }, { "error type": "Redundant", "explanation": "This renaming of the Super Bowl trophy combined with the Eagles inability to win the Super Bowl has led some Eagles fans to believe that the franchise is cursed by Vince Lombardi; that beating Lombardi meant never winning the trophy named after him. ", "start": 652, "end": 794 }, { "error type": "Irrelevant", "explanation": "", "start": 795, "end": 850 } ], "missing-info": [], "corrected-prediction": "The Eagles have never won the Super Bowl." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Where was tiger spy in the jungle filmed?", "passages": [ [ "Orange County Choppers bikes", "Season 1, Episodes 1&2 Original Airdates 03/31/03", "04/07/03\nPaul Teutul Jr. was the primary designer and fabricator on this bike.", "The \"Black Widow Bike\" was the bike central to the first two episodes of \"American Chopper\".", "This bike was the first sign to fans of the show of Paul Jr.'s obsession with spiders and spider webs as well as the capabilities of OCC.The bike is now at home at Paul Jr. Designs.", "This was also the first bike Vinny and Paul Jr. worked on together.", "Season 1, Episodes 5,6,&7, Original Airdates 04/28/03", "06/02/03", "06/09/03\n\nThe \"Fire Bike\" was created by everyone at OCC, the project holding more emotional weight with its ties to the 9/11 terrorist attacks.", "It was, as Paul Teutul Sr. put it, \"not just an Orange County Chopper, it's a New York City Chopper.\"", "This bike follows Orange County Choppers around to most of their shows and is consistently a big hit.", "The chopper was built as a tribute to the firefighters who died in the World Trade Center disaster on September 11, 2001." ], [ "Pench National Park", "Open jeep safaris are allowed from each of the gates twice in a day, with a fixed quota for each gate, for each schedule.", "Elephant safaris used to be conducted at one time, but have been discontinued these days.", "Pench forest reserve, is one of the places that may have inspired Rudyard Kipling's \"The Jungle Book\".", "The Pench National Park provided the location used by the BBC for the innovative wildlife series \"\", a three-part documentary narrated by Sir David Attenborough which used concealed cameras, placed by elephants, in order to capture intimate tiger behavior.", "The programme aired for the first time in April 2008." ] ], "gold": "Tiger: Spy in the Jungle was a BBC Wildlife Special that aired three episodes in 2008. The Pench National Park in India's Madhya Pradesh state provided the location used by the BBC for the innovative wildlife series", "prediction 1": "Pench National Park, which is one of the places that may have inspired Rudyard Kipling's The Jungle Book, was the location used by the BBC for the innovative wildlife series Tiger spy in the jungle, a three-part documentary narrated by Sir David Attenborough, which used concealed cameras, placed by elephants, in order to capture intimate tiger behavior.", "prediction 2": "The Pench National Park provided the location used by the BBC for the innovative wildlife series Tiger spy in the jungle, a three-part documentary narrated by Sir David Attenborough which used concealed cameras, placed by elephants, in order to capture intimate tiger behavior. The programme aired for the first time in April 2008.", "prediction 3": "Pench National Park, in the Indian state of Andhra Pradesh, was also the location for the three-part documentary Tiger Snoop in the Jungle, which was narrated by Sir David Attenborough. The series was filmed at the nearby Pench National Park, which is one of the places that may have inspired Rudyard Kipling's The Jungle Book.", "prediction 4": "The Pench National Park provided the location used by the BBC for the innovative wildlife series Tiger Sniper in the Jungle, a three-part documentary narrated by Sir David Attenborough that used concealed cameras, placed by elephants, in order to capture intimate tiger behavior. The Pench National Park provided the location used by the BBC for the innovative wildlife series Tiger Sniper in the Jungle, a three-part documentary narrated by Sir David Attenborough which used concealed cameras, placed by elephants, in order to capture intimate tiger behavior.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 355 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Pench National Park, which is one of the places that may have inspired Rudyard Kipling's The Jungle Book, was the location used by the BBC for the innovative wildlife series. The programme aired for the first time in April 2008." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Most sixes by team in ipl all time?", "passages": [ [ "Royal Challengers Bangalore", "Royal Challengers Bangalore\n\nThe Royal Challengers Bangalore(often abbreviated as RCB) are a franchise cricket team based in Bangalore, Karnataka, that plays in the Indian Premier League (IPL).", "One of the original eight teams in the IPL, the team has made three final appearances in the IPL, losing all (in 2009 to the Deccan Chargers, in 2011 to the Chennai Super Kings and in 2016 to the Sunrisers Hyderabad).", "The team also finished runners-up in the 2011 CLT20, losing the final against the Mumbai Indians.", "The home ground of the Royal Challengers is the M. Chinnaswamy Stadium in Bangalore.", "The team is currently captained by Virat Kohli and coached by Gary Kirsten .", "The team holds the records of both the highest and the lowest total in the IPL (263/5 and 49).", "In September 2007, the Board of Control for Cricket in India (BCCI) announced the establishment of the Indian Premier League, a Twenty20 competition to be started in 2008.", "The teams for the competition, representing 8 different cities of India, including Bangalore, were put up on auction in Mumbai on 20 February 2008.", "The Bangalore franchise was purchased by Vijay Mallya, who paid 111.6\u00a0million for it." ], [ "Sandeep Sharma", "Sandeep Sharma\n\nSandeep Sharma (born 18 May 1993) is an Indian cricketer who plays domestic cricket for Punjab.", "He is a right-arm medium pace bowler.", "Sharma has represented India at two Under-19 World Cups - 2010 and 2012.", "He was also part Under-19 team that won Under-19 World Cup in 2012.", "He was signed up by Kings XI Punjab in 2013.", "Sharma took three wickets for 21 runs in his IPL debut match when he played for Kings XI Punjab against Sunrisers Hyderabad on 11 May 2013.", "In the 2017 edition of the IPL, Sharma claimed 3/22 from his four overs against Royal Challengers Bangalore and in the process became the first bowler to get the renowned trio of Chris Gayle, Virat Kohli and AB de Villiers out in the same game.", "In January 2018, he was bought by the Sunrisers Hyderabad in the 2018 IPL auction.", "After his impressive domestic season with Punjab and Kings XI Punjab Sharma was picked in the 15-man squad for the limited overs tour of Zimbabwe in July 2015.", "He made his Twenty20 International debut against Zimbabwe on 17 July 2015." ] ], "gold": "The all-time record for most sixes by a team in the IPL is 1130, set by the Royal Challengers Bangalore. One of the original eight teams in the IPL, the Royal Challengers have never won the IPL but finished runners-up on three occasions between 2009 and 2016. Their lack of success over the years despite the presence of various notable players has earned them the tag of \"underachievers\".", "prediction 1": "Royal Challengers Bangalore are a franchise cricket team based in Bangalore that plays in the Indian Premier League (IPL). One of the original eight teams in the IPL, the team has made three final appearances in the IPL, losing all (in 2009 to the Deccan Chargers, in 2011 to the Chennai Super Kings and in 2016 to the Sunrisers Hyderabad). Sandeep Sharma, an Indian cricketer who plays domestic cricket for Punjab, holds the records of both the highest and the lowest total in the IPL (263/5 and 49).", "prediction 2": "The Royal Challengers Bangalore are a franchise cricket team based in Bangalore, Karnataka, that plays in the Indian Premier League (IPL). The RCB hold the records of both the highest and the lowest total in the IPL (263/5 and 49).", "prediction 3": "The list below includes the teams that have scored the most sixes in the IPL all time. In the 2017 edition of the IPL, Royal Challengers Bangalore claimed 3/22 from their four overs against the Royal Challengers Bangalore and in the process became the first bowler to get the renowned trio of Chris Gayle, Virat Kohli and AB de Villiers out in the same game.", "prediction 4": "The Royal Challengers Bangalore is an Indian franchise cricket team based in Bangalore, Karnataka, that plays in the Indian Premier League. One of the original eight teams in the IPL, the team holds the record for the most sixes by team in each edition (263/5 and 49).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 341, "end": 501 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who wrote the song why not take all of me?", "passages": [ [ "Take All of Me (song)", "Take All of Me (song)\n\n\"Take All of Me\" is a worship song written by Marty Sampson and recorded by the band Hillsong United for their album, \"More Than Life\".", "In 2005, Rebecca St. James covered the song on her album, \"If I Had One Chance to Tell You Something\", and it was released as the fourth single from the album in October 2006.", "The song is based on the Scripture Verse Psalm 146:5: \"Put your hope in God.\"" ], [ "All of Me (jazz standard)", "All of Me (jazz standard)\n\n\"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931.", "First performed by Belle Baker over the radio and recorded in December 1931 by Ruth Etting, it has become one of the most recorded songs of its era, with notable versions by Russ Columbo, Bing Crosby, Billie Holiday, Louis Armstrong, Mildred Bailey, Benny Goodman, Teddy Wilson in 1941, the Count Basie Orchestra, Harry James, Ella Fitzgerald, Sarah Vaughan (for the 1957 album, Swingin' Easy), Dean Martin, Frank Sinatra, Frankie Laine in 1947, Dinah Washington at the 1958 Newport Jazz Festival, Shirley Bassey in 1962, The Blue Diamonds, Della Reese, Johnnie Ray, Django Reinhardt, Erroll Garner, Willie Nelson, Ronnie Dove, Jean Frye Sidwell, Jo\u00e3o Gilberto (Disse Algu\u00e9m), Michael Bubl\u00e9, Miss Montreal in 2012 and The Rockin' Berries.", "Ani DiFranco sang the song in 2012 for the documentary, Love, Marilyn.", "It is also recorded by Eric Clapton on his 2013 album \"Old Sock\" with Paul McCartney.", "The first line of the song was sung by Eddie Cantor in the 1933 motion picture \"Roman Scandals\" which also starred Ruth Etting who first recorded it." ] ], "gold": "There all multiple songs that mention \"all of me\" in the title. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. \"Take All of Me\" is a 2006 worship song written by Marty Sampson and recorded by the band Hillsong United for their album, \"More Than Life\". \"All of Me\" sung by John Legend was written by John Stephens and Toby Gad.", "prediction 1": "\"Why not take all of me?\" is a worship song written by Marty Sampson and recorded by the band Hillsong United for their album, More Than Life. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. First performed by Belle Baker over the radio and recorded in December 1931 by Ruth Etting, it has become one of the most recorded songs of its era, with notable versions by Russ Columbo, Bing Crosby, Louis Armstrong, Benny Goodman, Mildred Bailey, Benny Goodman, the Count Basie Orchestra, Harry James, Harry James, Harry James, Ella Fitzgerald, Harry James, Harry James, Harry James, and it was released as the fourth single from the album in October 2006.", "prediction 2": "\"Why not take all of me\" is a worship song written by Marty Sampson and recorded by the band Hillsong United for their album More Than Life. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. First performed by Belle Baker over the radio and recorded in December 1931 by Ruth Etting, it has become one of the most recorded songs of its era.", "prediction 3": "\"Why Not Take All of Me\" is a worship song written by Marty Sampson and recorded by the band Hillsong United for their album More Than Life. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. First performed by Belle Baker over the radio and recorded in December 1931 by Ruth Etting. It has become one of the most recorded songs of its era, with notable versions by Russ Columbo, Bing Crosby, Billie Holiday, Louis Armstrong, Benny Goodman, Mildred Bailey, Benny Goodman, Lou Wilson in 1941, the Count Basie Orchestra, Harry James, Ella Fitzgerald, Harry James, Harry James, Harry James, Ella Fitzgerald, Harry James, Harry James, Ella Fitzgerald, Frank Sinatra, Harry James, Harry James, and Harry James.", "prediction 4": "\"Why not take all of me?\" is a song written by Marty Sampson and recorded by the band Hillsong United for their album More Than Life. It was first performed by Belle Baker over the radio and recorded in December 1931 by Ruth Etting. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. It has also become one of the most recorded songs of its era, with notable versions by Russ Columbo, Bing Crosby, Louis Armstrong, Benny Goodman, Mildred Bailey, Benny Goodman, Louis Armstrong, Benny Goodman, Benny Goodman, Louis Armstrong, Mildred Bailey, Benny Goodman, Billie Holiday, Louis Armstrong, Mildred Bailey, Benny Goodman, and Count Basie Orchestra.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 701 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 0, "end": 25 } ], "missing-info": [], "corrected-prediction": "\"Take All of Me\" is a worship song written by Marty Sampson and recorded by the band Hillsong United for their album, More Than Life. \"All of Me\" is a popular song and jazz standard written by Gerald Marks and Seymour Simons in 1931. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is the president of south africa now?", "passages": [ [ "Cyril Ramaphosa", "Cyril Ramaphosa\n\nMatamela Cyril Ramaphosa (born 17 November 1952) is a South African politician and the fifth and current President of South Africa.", "He became President following the resignation of Jacob Zuma.", "Previously an anti-apartheid activist, trade union leader, and businessman, Ramaphosa served as the Deputy President of South Africa from 2014 to 2018.", "He was elected President of the African National Congress (ANC) at the ANC National Conference in December 2017.", "He is also the former Chairman of the National Planning Commission, which is responsible for strategic planning for the future of the country, with the goal of rallying South Africa \"around a common set of objectives and priorities to drive development over the longer term\".", "He has been called a skillful negotiator and strategist who acted as the ANC's Chief Negotiator during South Africa's transition to democracy.", "Ramaphosa built up the biggest and most powerful trade union in the country \u2013 the National Union of Mineworkers (NUM).", "He played a crucial role, with Roelf Meyer of the National Party, during the negotiations to bring about a peaceful end to apartheid and steer the country towards its first fully democratic elections in April 1994.", "Ramaphosa was Nelson Mandela's choice for future president." ], [ "History of South Africa (1994\u2013present)", "From 2015, Jacob Zuma was understood to favour his ex-wife, Nkosazana Dlamini-Zuma, to succeed him both as President of the African National Congress and as President of South Africa, in order to retain his control of the ANC and the state through her, and to avoid prosecution for still pending criminal charges.", "In December 2017, Dlamini-Zuma was defeated by Cyril Ramaphosa in the election for the ANC Presidency at the ANC Conference at Nasrec, Johannesburg.", "Following the end of Zuma's term as ANC President, pressure grew for Zuma to be replaced as President of South Africa.", "The annual State of the Nation Address scheduled for 8 February was postponed indefinitely 2 days beforehand.", "After a week of discussions within ANC structures and between Ramaphosa and Zuma, the ANC announced on 13 February that Zuma had been requested to resign, but had refused, and that the ANC was therefore \"recalling\" him from the Presidency.", "Facing a motion of no confidence in Parliament scheduled for 15 February, Jacob Zuma announced his resignation with immediate effect in a late night address on 14 February.", "Following Zuma's resignation, Acting President Cyril Ramaphosa of the ruling African National Congress was elected unopposed as President of South Africa by the National Assembly on 15 February 2018.." ], [ "Kgalema Motlanthe", "Kgalema Motlanthe\n\nKgalema Petrus Motlanthe (; born 19 July 1949) is a South African politician who served as interim President of South Africa between 25 September 2008 and 9 May 2009, following the resignation of Thabo Mbeki.", "After the end of his presidency, Motlanthe was appointed as the Deputy President of South Africa by his successor, Jacob Zuma.", "Motlanthe served as Deputy President of the African National Congress (ANC) from 2007 until 2012, when he declined to run for a second term.", "At the 53rd National Conference of the African National Congress, Motlanthe ran for the position of President of the ANC but was soundly defeated by Zuma, who won re-election.", "He was succeeded as Deputy President of the ANC by Cyril Ramaphosa in 2014.", "Motlanthe, who had maintained a low public profile, was elected in 2008 to the presidency of South Africa by the South African National Assembly following the resignation of Mbeki, and he was widely considered to be acting as a \"caretaker president\" on behalf of Zuma.", "Zuma succeeded Motlanthe on 9 May 2009 in a presidential election held by the South African National Assembly, following the 2009 general election which had been won by the ANC." ] ], "gold": "Matamela Cyril Ramaphosa is a South African politician who has been serving as the President of South Africa since 2018. He succeeded Jacob Zuma in this position. Zuma was the fourth President of South Africa and served in this office from 2009 to 2018. Zuma was preceded by Kgalema Petrus Motlanthe. Motlanthe served as President of South Africa between September 25, 2008 and May 9, 2009, following the resignation of Thabo Mbeki. ", "prediction 1": "Cyril Ramaphosa, the fifth and current President of South Africa, took office on 15 February 2018, following the resignation of Jacob Zuma. Previously an anti-apartheid activist, trade union leader, and businessman, Ramaphosa served as the Deputy President of South Africa from 2014 to 2018. He was elected President of the African National Congress (ANC) at the ANC National Conference in December 2017.", "prediction 2": "Cyril Ramaphosa is the fifth and current President of South Africa. He became President following the resignation of Jacob Zuma. Previously an anti-apartheid activist, trade union leader, and businessman, Ramaphosa served as the Deputy President of South Africa from 2014 to 2018. He was elected President of the African National Congress (ANC) at the ANC National Conference in December 2017.", "prediction 3": "Cyril Ramaphosa became President of South Africa following the resignation of Jacob Zuma. Previously an anti-apartheid activist, trade union leader, and businessman, Ramaphosa served as the Deputy President of South Africa from 2014 to 2018.", "prediction 4": "Cyril Ramaphosa became President of South Africa following the resignation of Jacob Zuma. Previously an anti-apartheid activist, trade union leader, and businessman, Ramaphosa served as the Deputy President of South Africa from 2014 to 2018. He was elected President of the African National Congress (ANC) at the ANC National Conference in December 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 404 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Cyril Ramaphosa, the fifth and current President of South Africa, took office on 15 February 2018, following the resignation of Jacob Zuma. Zuma succeeded Motlanthe on 9 May 2009 as President of South Africa. Motlanthe served as President of South Africa between September 25, 2008 and May 9, 2009, following the resignation of Thabo Mbeki." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who plays janet in rocky horror picture show?", "passages": [ [ "The Rocky Horror Picture Show", "In 2015, O'Brien produced \"Shock Treatment\" for the theatrical stage.", "The production premiered at the King\u2019s Head theatre in Islington, London in the United Kingdom in the spring of 2015.", "\"The Rocky Horror Glee Show\" aired on 26 October 2010, as part of the second season of the TV series \"Glee\", which recreated several scenes from the film, including the opening credits.", "It featured Barry Bostwick and Meat Loaf in cameo roles.", "On 10 April 2015, it was announced that the Fox Broadcasting Company would air a modern-day reimagining of the film, titled \"The Rocky Horror Picture Show: Let's Do the Time Warp Again\".", "On 22 October 2015, it was announced that the role of Dr. Frank N. Furter would be played by actress Laverne Cox.", "Ryan McCartan and Victoria Justice play the roles of Brad and Janet, alongside Reeve Carney as Riff Raff and singer/model Staz Nair as Rocky.", "Adam Lambert portrays Eddie.", "Tim Curry, who portrayed Dr. Frank N. Furter in the film, portrays the Criminologist.", "On 1 February 2016, it was announced that Broadway veteran Annaleigh Ashford would portray Columbia.", "On 5 February 2016, Ben Vereen joined the cast as Dr. Everett von Scott." ], [ "The Rocky Horror Picture Show", "The Rocky Horror Picture Show\n\nThe Rocky Horror Picture Show is a 1975 musical science-fiction horror-comedy film by 20th Century Fox produced by Lou Adler and Michael White and directed by Jim Sharman.", "The screenplay was written by Sharman and actor Richard O'Brien, who is also a member of the cast.", "The film is based on the 1973 musical stage production \"The Rocky Horror Show\", with music, book, and lyrics by O'Brien.", "The production is a parody tribute to the science fiction and horror B movies of the 1930s through to the early 1960s.", "Along with O'Brien, the film stars Tim Curry, Susan Sarandon, and Barry Bostwick and is narrated by Charles Gray with cast members from the original Royal Court Theatre, Roxy Theatre, and Belasco Theatre productions.", "The story centres on a young engaged couple whose car breaks down in the rain near a castle where they seek a telephone to call for help.", "The castle or country home is occupied by strangers in elaborate costumes celebrating an annual convention.", "They discover the head of the house is Dr. Frank N. Furter, an apparent mad scientist who actually is an alien transvestite who creates a living muscle man in his laboratory.", "The couple are seduced separately by the mad scientist and eventually released by the servants who take control." ] ], "gold": "Susan Sarandon plays Janet in the 1975 film The Rocky Horror Picture Show. In The Rocky Horror Picture Show: Let's Do the Time Warp Again, a modern-day reimagining of the film, Victoria Justice played Janet.", "prediction 1": "The Rocky Horror Picture Show is a 1975 musical horror comedy film produced by 20th Century Fox that is a parody tribute to the science fiction and horror B movies of the 1930s through the early 1960s. In the film, Janet is played by Sydney Pollack, Sydney McManus, and Victoria Justice, and in the stage production, Janet is played by Ryan McCartan and Victoria Justice, respectively.", "prediction 2": "The Rocky Horror Picture Show is a 1975 musical horror-comedy film directed by Jim Sharman and produced by Lou Adler and Michael White and produced by Jim Sharman. The film is based on the 1973 musical stage production The Rocky Horror Show, with music, book, and lyrics by O'Brien. Ryan McCartan and Victoria Justice play the roles of Brad and Janet, alongside Reeve Carney as Riff Raff and singer/model Staz Nair as Rocky.", "prediction 3": "The Rocky Horror Picture Show is a 1975 musical comedy horror film that is a parody of the science fiction and horror B movies of the 1930s through to the early 1960s. In the movie, Janet is played by Victoria Justice.", "prediction 4": "The Rocky Horror Picture Show is a 1975 musical science-fiction horror-comedy film by 20th Century Fox that is a parody tribute to the horror B movies of the 1930s through to the early 1960s. In the film Janet is played by Victoria Justice and Brad McCartan. In the 2015 adaptation of the film, Janet is played by Victoria Justice.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 201 }, { "error type": "Unverifiable", "explanation": "", "start": 202, "end": 287 } ], "missing-info": [], "corrected-prediction": "In the rocky horror picture show, Ryan McCartan and Victoria Justice play the roles of Brad and Janet." }, "preference": [ 1, 2, 0, 2, 0, 1 ] }, { "question": "When did i can only imagine get released?", "passages": [ [ "MercyMe discography", "MercyMe discography\n\nThe discography of MercyMe, an American Christian rock band, includes nine studio albums, two compilation albums, two video albums, and 24 singles.", "MercyMe, formed in 1994, released six independent albums from 1995\u20132000 before signing with INO Records and releasing their major label debut album, \"Almost There\" (2001).", "\"Almost There\" peaked at number 37 on the \"Billboard\" 200 and number one on the \"Billboard\" Christian Albums chart.", "The band released \"Spoken For\", their second studio album, in 2002; it peaked at number two on the \"Billboard\" Christian Albums chart and number 41 on the \"Billboard\" 200.", "Its second single, \"Word of God Speak\", spent a record 23 weeks atop the \"Billboard\" Christian Songs chart.", "The album has been certified Gold by the Recording Industry Association of America (RIAA), and has sold over 550,000 copies.", "In 2003, mainstream radio interest in \"I Can Only Imagine\", the band's second single from \"Almost There\", caused sales of the album to surge.", "\"I Can Only Imagine\" would peak at number five on the \"Billboard\" Adult Contemporary chart and number 71 on the \"Billboard\" Hot 100." ], [ "I Can Only Imagine (David Guetta song)", "I Can Only Imagine (David Guetta song)\n\n\"I Can Only Imagine\" is a song performed by French DJ David Guetta, featuring vocals from American singer Chris Brown and rapper Lil Wayne, from Guetta's fifth studio album \"Nothing but the Beat\".", "It was released as the sixth single from the album on April 23, 2012.", "Prior to its official release, the song charted in the lower regions of the charts in Canada, France, Germany, Netherlands, the United Kingdom, and the United States.", "Guetta, Brown and Wayne performed the song live for the first time at the 54th Grammy Awards on February 12, 2012.", "The video was filmed on May 29, 2012, and premiered on July 2, 2012.", "It was directed by Colin Tilley.", "Guetta said how the video focuses more on futuristic images rather than on a plot as some of Guetta's other videos played out.", "It first opens up with Guetta walking into a room, and Brown appears in a mask as his eyes light up.", "As Brown starts singing in another scene, he is in a light-up suit.", "As the chorus plays, Brown is seen in a zero-gravity room.", "Guetta also then seen in the zero-gravity room.", "Wayne then is seen with a skateboard with a few other skateboarders in the background." ], [ "I Can Only Imagine (film)", "I Can Only Imagine (film)\n\nI Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time.", "The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid).", "Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "\"I Can Only Imagine\" was released in the United States on March 16, 2018.", "It was a massive box office success, grossing $85 million worldwide against a production budget of $7 million, becoming the fourth highest-grossing music biopic of all-time in the United States.", "Some critics praised it as inspiring and noted it as an improvement compared to other faith-based films, while others called it flat and by-the-numbers.", "At the 2018 Dove Awards, the film won \"Inspirational Film of the Year\".", "10-year-old Bart Millard lives with his mother and abusive father Arthur in Texas.", "One day his mother drops him off at a Christian camp where he meets Shannon.", "Upon his return from camp, Bart finds his mother has left and movers are removing her belongings." ], [ "I Can Only Imagine (film)", "It is the fourth-highest grossing music biopic of all-time in the United States, behind \"Bohemian Rhapsody\", \"Straight Outta Compton\" and \"Walk the Line\".", "It is also the highest-grossing independent film of 2018.", "\"I Can Only Imagine\" was released on March 16, 2018, alongside \"Tomb Raider\" and \"Love, Simon\", and was originally projected to gross $2\u20134 million from 1,620 theaters in its opening weekend.", "However, after making $6.2 million on its first day (including $1.3 million from Thursday night previews), weekend estimates were increased to $14 million.", "It ended up grossing $17.1 million, exceeding expectations and finishing third at the box office behind \"Black Panther\" and \"Tomb Raider\".", "67% of the opening weekend audience was female while 80% was over the age of 35.", "It was the fourth best-ever opening for a faith-based film, following \"The Passion of the Christ\" ($83.8 million), \"Son of God\" ($25.6 million) and \"Heaven Is for Real\" ($22.5 million).", "In its second weekend the film was added to 624 additional theaters and dropped just 19% to $13.8 million, again finishing third." ] ], "gold": "There are a number of songs by the name \"i can only imagine\". The Christian rock band MercyMe released a hit song of the same name on October 12, 2001 which went on to become the most-played Christian single of 2002. Years later, on March 16, 2018, a film based on the story behind this song was released in the United States. A different song by the same title was released on April 23, 2012 by French DJ David Guetta, featuring vocals from American singer Chris Brown and rapper Lil Wayne. This same song was released on May 2, 2012 in Australia, Austria, Belgium, Finland, Germany, Italy, Japan, the Netherlands, New Zealand, Norway, and Switzerland. ", "prediction 1": "I Can Only Imagine is a song by American Christian rock band MercyMe released in 2001. The song was released as the sixth single from David Guetta's fifth studio album Nothing but the Beat on April 23, 2012. The film based on the story behind the song was released in the United States on March 16, 2018. It was a massive box office success, grossing $85 million worldwide against a production budget of $7 million, becoming the fourth highest-grossing music biopic of all time in the United States.\n", "prediction 2": "\"I Can Only Imagine\" is a song performed by French DJ David Guetta featuring vocals from American singer Chris Brown and rapper Lil Wayne, from Guetta's fifth studio album \"Nothing but the Beat\". It was released as the sixth single from the album on April 23, 2012. \"I Can Only Imagine\" is a 2018 American Christian drama film based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. \"I Can Only Imagine\" was released in the United States on March 16, 2018.", "prediction 3": "This is the discography of the Christian rock band MercyMe, featuring nine studio albums, two compilation albums, two video albums, and 24 singles. The song, I Can Only Imagine, of David Guetta's Nothing but the Beat album, was released as the sixth single from the album on April 23, 2012. The movie, I Can Only Imagine, about a 10-year-old boy's relationship with his abusive father Arthur, was released in the United States on March 16, 2018.", "prediction 4": "I Can Only Imagine is a song by the Christian rock band MercyMe. Released as a single from their fifth studio album Nothing but the Beat on April 23, 2012, the song was first heard by mainstream radio stations across the US. The video for the song was filmed in France on May 29, 2012 and premiered on July 2, 2012. Same as the song, this film told the story behind the best-selling Christian single of all time, I Can Only Imagine. It was then released in the United States on March 16, 2018. It was a huge box office success, grossing a massive box office success, grossing $85 million worldwide against a production budget of $7 million and becoming the fourth highest-grossing music biopic of all-time in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 500 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "I Can Only Imagine is a song by American Christian rock band MercyMe released in 2001 and is the best-selling Christian single of all time. The film based on the story behind the song was released in the United States on March 16, 2018. Another song with the same name is by French DJ David Guetta, featuring vocals from American singer Chris Brown and rapper Lil Wayne. It was released on April 23, 2012." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does the ohio river start and finish?", "passages": [ [ "Ohio River", "The course forms the northern borders of West Virginia and Kentucky; and the southern borders of Ohio, Indiana and Illinois, until it joins the Mississippi River at the city of Cairo, Illinois.", "Where the Ohio joins the Mississippi is the lowest elevation in the state of Illinois, at .", "The Ohio River, which flows westward from Pittsburgh, Pennsylvania, to Cairo, Illinois, is the largest tributary, by volume, of the Mississippi River in the United States.", "At the confluence, the Ohio is considerably bigger than the Mississippi.", "Measured by long-term mean discharge in cubic feet per second and cubic meters per second, the Ohio River at Cairo: 281,500\u00a0cu\u00a0ft/s (7,960\u00a0m/s); and the Mississippi River at Thebes, Illinois, which is upstream of the confluence: 208,200\u00a0cu\u00a0ft/s (5,897\u00a0m/s).", "In both measures, the Ohio River water flow is higher than that of the Mississippi River.", "From a hydrographic perspective, the Ohio River is the main stream of the whole river system.", "Major tributaries of the river, indicated by the location of the mouths, include:\n\n\nThe Ohio's drainage basin covers , encompassing the easternmost regions of the Mississippi Basin.", "The Ohio drains parts of 15 states in four regions." ], [ "Ohio River", "The bridge had been built in 1929, and by 1967 was carrying too heavy a load for its design.", "The bridge was rebuilt about one mile downstream and in service as the Silver Memorial Bridge in 1969.", "In the early 1980s, the Falls of the Ohio National Wildlife Conservation Area was established at Clarksville, Indiana.", "The Ohio River as a whole is ranked as the most polluted river in the US based on 2009 and 2010 data although the more industrial and regional Ohio tributary, Monongahela River, ranked behind 16 other American rivers for pollution at number 17.", "The Ohio River was polluted with hundreds of thousands of pounds of PFOA by DuPont chemical company, from an outflow pipe, for several decades beginning in the 1950s.", "The Ohio River is formed by the confluence of the Allegheny and Monongahela rivers at Point State Park in Pittsburgh, Pennsylvania.", "From there, it flows northwest through Allegheny and Beaver counties, before making an abrupt turn to the south-southwest at the West Virginia\u2013Ohio\u2013Pennsylvania triple-state line (near East Liverpool, Ohio; Chester, West Virginia; and Ohioville, Pennsylvania).", "From there, it forms the border between West Virginia and Ohio, upstream of Wheeling, West Virginia.", "The river then follows a roughly southwest and then west-northwest course until Cincinnati, before bending to a west-southwest course for most of its length." ] ], "gold": "The Ohio River is the third largest river by discharge volume in the United States and the largest tributary by volume. The river starts at the Allegheny and Monongahela rivers at what is now Point State Park in Pittsburgh, Pennsylvania, and finishes mouth on the Mississippi River at the southern tip of Illinois. The river flows through or along the border of six states, and its drainage basin includes parts of 14 states. It is 981 miles long.", "prediction 1": "The Ohio River, which flows westward from Pittsburgh, Pennsylvania, to Cairo, Illinois, is the largest tributary, by volume, of the Mississippi River in the United States. From a hydrographic perspective, the Ohio River is the main stream of the whole river system.", "prediction 2": "The Ohio River is formed by the confluence of the Allegheny and Monongahela rivers at Point State Park in Pittsburgh, Pennsylvania. From there, it flows northwest through Allegheny and Beaver counties, before making an abrupt turn to the south-southwest at the West Virginia\u2013Ohio\u2013Pennsylvania triple-state line. From there, it forms the border between West Virginia and Ohio, upstream of Wheeling, West Virginia. The Ohio River then follows a roughly southwest course until Cincinnati, before bending to a west-southwest course for most of its length.", "prediction 3": "The Ohio River is a river in the United States. It is formed by the confluence of the Allegheny and Monongahela rivers at Point State Park in Pittsburgh, Pennsylvania. The Ohio River flows westward from Pittsburgh, Pennsylvania, to Cairo, Illinois. At the confluence, the Ohio is considerably bigger than the Mississippi. From a hydrographic perspective, the Ohio River is the main stream of the whole river system.", "prediction 4": "The Ohio River is the largest tributary, by volume, of the Mississippi River in the United States. It starts and finishes in Pittsburgh, Pennsylvania and continues northwest through Allegheny and Beaver counties, before turning to the south-southwest at the West Virginia\u2013Ohio\u2013Pennsylvania triple-state line. It then follows a roughly southwest and then west-northwest course until Cincinnati, before bending to a west-southwest course for most of its length.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Ohio River, which flows westward from Pittsburgh, Pennsylvania, to Cairo, Illinois, is the largest tributary, by volume, of the Mississippi River in the United States. The course forms the northern borders of West Virginia and Kentucky; and the southern borders of Ohio, Indiana and Illinois, until it joins the Mississippi River at the city of Cairo, Illinois." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who has won the second most nba championships?", "passages": [ [ "Gatorade shower", "The phenomenon gained national attention in the 1986 Giants season.", "Parcells was doused after 17 victories that season, culminating with Super Bowl XXI.", "Boston Celtics coach Doc Rivers was reported to be the first NBA coach to receive a Gatorade shower when his team won the 2008 NBA Finals.", "Paul Pierce dumped a cooler of red Gatorade over Rivers as the Celtics closed out Game 6 to clinch their first NBA title in 22 years.", "Then-Los Angeles Lakers coach Phil Jackson is the only NBA head coach to receive a Gatorade shower twice, as the Lakers won back-to-back NBA Finals in 2009 (at Amway Arena in Orlando, Florida) and 2010.", "Dallas Mavericks coach Rick Carlisle likewise received the honors when Mavericks celebrated their first NBA championship in 2011.", "Miami Heat head coach Erik Spoelstra received the same treatment from Udonis Haslem when the Heat won the 2012 NBA Finals at the American Airlines Arena in 2012.", "George Allen, coach of the Long Beach State football team and a former Hall of Fame NFL head coach, was doused with ice water from a Gatorade bucket as his team celebrated its victory over the University of Nevada on November 17, 1990.", "Allen became ill shortly afterward and died of ventricular fibrillation six weeks later.", "Kentucky Wildcats coach Guy Morriss is one of few coaches ever to receive a Gatorade shower and lose a game." ], [ "Sam Jones (basketball)", "Sam Jones (basketball)\n\nSamuel Jones (born June 24, 1933) is an American retired professional basketball player at shooting guard.", "He was known for his quickness and game-winning shots, especially during the NBA Playoffs.", "He has the second most NBA championships of any player (10), behind his teammate Bill Russell (11).", "He was also one of only 3 Boston Celtics (along with teammates Bill Russell and K.C. Jones) to be part of the Celtics's 8 consecutive championships from 1959 to 1966.", "He is a member of the Naismith Memorial Basketball Hall of Fame.", "Jones attended and graduated from North Carolina Central University (then North Carolina College), where he was a four-year letterwinner for Hall of Fame coach John McLendon and coach Floyd Brown.", "Jones scored 1,745 points, which is still second in school history.", "He was a three-time All-CIAA league selection.", "His jersey, no. 41, is retired and hangs in the Eagles' arena.", "Jones was 6-foot-4 (1.93 m) and weighed 200\u00a0lb (90\u00a0kg).", "Boston Celtics Hall of Fame coach Red Auerbach took a trip south to scout North Carolina players who had just won the national championship." ], [ "NBA Finals", "The following three are played at each team's home arena alternately.", "A total of 19 franchises have won the NBA Finals, with the Golden State Warriors the current champion.", "The Boston Celtics hold the record for the most victories, having won the competition 17 times, as well as winning the competition the most times in a row, winning it eight times from 1959 to 1966.", "The Los Angeles Lakers have contested the NBA Finals the most times, with 31 appearances.", "The Eastern Conference has provided the most champions, with 38 wins from ten franchises; the Western Conference has 32, from nine franchises.", "The Boston Celtics went 11\u20131 in the NBA Finals during 13 seasons (1956\u201357 to 1968\u201369).", "They won eight straight NBA championships from 1959 through 1966.", "This period marks the largest stretch of seasons that a single team made up over 65% of Finals appearances, and also includes the only ever time the NBA Finals was decided in double overtime.", "With the establishment of the Celtics dynasty in 1957 spearheaded by center Bill Russell, the team saw great success, only ever encountering difficulty when up against teams led by Wilt Chamberlain.", "However, for most of the late 1950s and 1960s, the Celtics and Russell managed to have an upper hand on Chamberlain's teams." ] ], "gold": "Sam Jones, an American former professional basketball player and shooting guard, has won the 2nd most NBA Championships. The Los Angeles Lakers have won the 2nd most NBA Championships. Head Coach Red Auerbach has won the 2nd most NBA Championships.", "prediction 1": "Samuel Jones, an American former professional basketball player, has won the second most NBA championships of any player (10). He has been second only to his teammate Bill Russell with 11.", "prediction 2": "Bill Russell, a former professional basketball player and Hall of Fame coach of the Boston Celtics, has the most NBA championships. Sam Jones, an American retired professional basketball player and former professional basketball player, has the second most NBA championships. The Boston Celtics hold the record for the most victories, having won the competition 17 times. The Los Angeles Lakers have contested the NBA Finals the most times, with 31 appearances. The Eastern Conference has provided the most champions, with 38 wins from 10 franchises; the Western Conference has 32, from nine franchises.", "prediction 3": "The player with the second most nba championships is Sam Jones, who has won 10 nba championships. The player with the second most nba championships is Bill Russell.", "prediction 4": "Samuel Jones, a retired American professional basketball player at shooting guard, has the second most NBA championships of any player (10), behind his teammate Bill Russell (11). He has won the second most NBA championships of any coach (10), behind Doc Rivers. The Boston Celtics hold the record for the most victories, having won the competition 17 times. The Boston Celtics also hold the record for the most wins in a row, having won the competition the most times in a row, winning it eight times from 1959 to 1966.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 188 } ], "missing-info": [], "corrected-prediction": "Samuel Jones, an American former professional basketball player, has won the second most NBA championships of any player (10)." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who is the chairman of the federal reserve?", "passages": [ [ "Chair of the Federal Reserve", "Chair of the Federal Reserve\n\nThe Chair of the Board of Governors of the Federal Reserve System is the head of the Federal Reserve, which is the central banking system of the United States.", "The position is known colloquially as \"Chair of the Fed\" or \"Fed Chair\".", "The chair is the \"active executive officer\" of the Board of Governors of the Federal Reserve System.", "The chair is chosen by the President of the United States from among the members of the Board of Governors; and serves for four-year-terms after appointment.", "A chair may be appointed for several consecutive terms.", "William Martin was the longest serving chair, holding the position from 1951 to 1970.", "The current Chairman is Jerome Powell, who was sworn in on February 5, 2018.", "He was nominated to the position by President Donald Trump on November 2, 2017, and was later confirmed by the United States Senate.", "Section 203 of the Banking Act of 1935 changed the name of the \"Federal Reserve Board\" to the \"Board of Governors of the Federal Reserve System.\"", "The directors' salaries were significantly lower (at $12,000 when first appointed in 1914) and their terms of office were much shorter prior to 1935.", "In effect, the Federal Reserve Board members in Washington, D.C., were significantly less powerful than the presidents of the regional Federal Reserve Banks prior to 1935." ], [ "Janet Yellen", "Janet Yellen\n\nJanet Louise Yellen (born August 13, 1946) is an American economist.", "She served as the Chair of the Board of Governors of the Federal Reserve System from 2014\u20132018, previously serving as Vice Chair from 2010 to 2014.", "Previously, she was President and Chief Executive Officer of the Federal Reserve Bank of San Francisco; Chair of the White House Council of Economic Advisers under President Bill Clinton; and business professor at the University of California, Berkeley, Haas School of Business.", "Yellen was nominated by President Obama to succeed Ben Bernanke as Chairwoman of the United States Federal Reserve.", "On January 6, 2014, the U.S. Senate confirmed Yellen's nomination.", "She was sworn in on February 3, 2014, making her the first woman to hold the position.", "Yellen was born to a Polish Jewish family in New York City's Brooklyn borough, as the daughter of Anna Ruth (n\u00e9e Blumenthal; 1907\u20131986), an elementary school teacher and Julius Yellen (1906\u20131975), a family physician, who worked from the ground floor of their home.", "Her mother quit her job to take care of Janet and her older brother, John.", "She graduated from Fort Hamilton High School in the Bay Ridge section of Brooklyn as a valedictorian.", "She graduated \"summa cum laude\" from Pembroke College in Brown University with a degree in economics in 1967." ], [ "Ben Bernanke", "Ben Bernanke\n\nBen Shalom Bernanke ( ; born December 13, 1953) is an American economist at the Brookings Institution who served two terms as Chair of the Federal Reserve, the central bank of the United States, from 2006 to 2014.", "During his tenure as chair, Bernanke oversaw the Federal Reserve's response to the late-2000s financial crisis.", "Before becoming Federal Reserve chair, Bernanke was a tenured professor at Princeton University and chaired the department of economics there from 1996 to September 2002, when he went on public service leave.", "From August 5, 2002 until June 21, 2005, he was a member of the Board of Governors of the Federal Reserve System, proposed the Bernanke Doctrine, and first discussed \"the Great Moderation\" \u2014 the theory that traditional business cycles have declined in volatility in recent decades through structural changes that have occurred in the international economy, particularly increases in the economic stability of developing nations, diminishing the influence of macroeconomic (monetary and fiscal) policy.", "Bernanke then served as chairman of President George W. Bush's Council of Economic Advisers before President Bush nominated him to succeed Alan Greenspan as chairman of the United States Federal Reserve.", "His first term began February 1, 2006." ] ], "gold": "The current and 16th Chair of the Federal Reserve is Jerome Powell, who has held the position since 2018 after a nomination from President Trump. Powell replaced Janet Yellen, who was appointed by President Obama in 2014. Previously, the office was held by Ben Bernanke, who was first appointed by President Bush in 2006 and Alan Greenspan, who was first appointed by President Reagan in 1987.", "prediction 1": "The Chair of the Board of Governors of the Federal Reserve System is the head of the Federal Reserve, which is the central banking system of the United States. The current Chairman of the Federal Reserve is Jerome Powell. The position was first held by William Martin from 1951 to 1970. The current chair is Janet Yellen, who served as the Chair of the Board of Governors of the Federal Reserve System from 2014\u20132018, previously serving as Vice Chair from 2010\u20132014.", "prediction 2": "The Chair of the Board of Governors of the Federal Reserve System is the head of the Federal Reserve, which is the central banking system of the United States. The current Chair of the Federal Reserve is Jerome Powell, who was sworn in on February 5, 2018. Ben Bernanke served two terms as chair of the Federal Reserve, the central bank of the United States, from 2006 to 2014.", "prediction 3": "The Chair of the Board of Governors of the Federal Reserve System is the head of the Federal Reserve, which is the central banking system of the United States. The current chair is Jerome Powell, who was sworn in on February 5, 2018. The current chair is Janet Yellen, who served as the chair of the Board of Governors of the Federal Reserve System from 2014\u20132018. Ben Bernanke was the last person to serve as chair of the Federal Reserve.", "prediction 4": "The position is known colloquially as \"Chair of the Fed\" or \"Fed Chair\". The current Chairman is Jerome Powell, who was sworn in on February 5, 2018. Ben Bernanke was the first chairman of the Federal Reserve, and Ben Shalom Bernanke was the second.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 466 }, { "error type": "Unverifiable", "explanation": "", "start": 291, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 222, "end": 286 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The current Chairman of the Federal Reserve is Jerome Powell, who has held the position since 2018 after a nomination from President Trump. Janet Yellen served as the Chair of the Board of Governors of the Federal Reserve System from 2014\u20132018. Ben Bernanke served as the chair of Federal reserve from 2006 to 2014." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang the theme song to scooby doo?", "passages": [ [ "I'd Do Anything (Simple Plan song)", "I'd Do Anything (Simple Plan song)\n\n\"I'd Do Anything\" is a song by Canadian rock band Simple Plan.", "It was released in October 2002 as the second single from their debut album, \"No Pads, No Helmets...", "Just Balls\".", "It features vocals from Mark Hoppus (blink-182 and +44).", "The song is mostly about a relationship breakup and the desperate attempts to get the person back.", "During an episode of What's New Scooby-Doo?", "this Song appeared in the Episode \"It's Mean", "It's Green", "It's The Mystery Machine\" but only a minute version of the Song was heard.", "The music video for the song revolves around kids trying to get into a Simple Plan concert by first impressing the doorman.", "Mark Hoppus is also featured in the video." ], [ "Scooby-Doo, Where Are You!", "The main concept was as follows:\n\n\nThe second season featured bubblegum \"chase scene\" songs produced by La La Productions (which had originally been contracted to create the music for \"Josie and the Pussycats\", the first of many animated series made from the same mold as \"Scooby-Doo, Where Are You!\").", "These songs were written by Danny Janssen and Austin Roberts, and were performed by Roberts, who also made a new recording of the \"Scooby Doo, Where Are You!\"", "theme song for the second season.", "The series' theme song has been covered by several subsequent artists, including Matthew Sweet for the 1995 TV special and album \"\"; Third Eye Blind for the 1998 film \"Scooby-Doo on Zombie Island\"; Billy Ray Cyrus for \"Scooby-Doo! and the Witch's Ghost\" (1999); Jennifer Love Hewitt for \"Scooby-Doo and the Alien Invaders\" (2000); the B-52's (Cindy, Kate and Fred) for \"Scooby-Doo and the Cyber Chase\" (2001); MxPx for the live-action \"Scooby-Doo\" film (2002); and Krystal Harris for \"Scooby-Doo! and the Legend of the Vampire\" (2003)." ], [ "Chuck Comeau", "Chuck Comeau\n\nCharles-Andr\u00e9 \"Chuck\" Comeau (born 17 September 1979) is a Canadian musician and drummer, best known for being the drummer of the rock band Simple Plan.", "He also founded the apparel company Role Model Clothing along with his bandmate Pierre Bouvier and the band's best friend, Patrick Langlois.", "He is also former drummer for the punk rock band Reset from 1993 to 1999, which he quit to form Simple Plan with his Reset bandmate who also left Reset, Pierre Bouvier.", "Comeau was born to Fran\u00e7oise and Andr\u00e9 Comeau, his brother's name is Louis.", "Comeau attended Beaubois high school in Montreal, Quebec, along with bandmates Pierre Bouvier, S\u00e9bastien Lefebvre, and Jeff Stinco, where they formed Simple Plan.", "Comeau originally studied law at McGill University in Montreal, but left to pursue his music career.", "Comeau start his music career in 1993, when he was 13 years old along with bandmate Pierre Bouvier.", "Comeau left Reset in 1998 to study law on McGill University, and left to pursue music career, he later reunited with Bouvier at a Sugar Ray concert, they later formed Simple Plan in 1999 along with old schoolmates S\u00e9bastien Lefebvre and Jeff Stinco." ] ], "gold": "Scooby-Doo, Where Are You! is an American animated mystery comedy television series produced by Hanna-Barbera for CBS. From 1969-1970, Larry Marks sang the theme song for the series. In 1970, George A. Robertson, Jr. sang the theme song. In 2002, Canadian rock band Simple Plan recorded the theme song for a rebooted installment of the Scooby-Doo franchise called What's New, Scooby-Doo? and in that same year American punk band MxPx were sang the Scooby Doo, Where Are You! theme song for the soundtrack to the 2002 movie Scooby Doo.", "prediction 1": "\"I'd Do Anything\" is a song by Canadian rock band Simple Plan. It was released in October 2002 as the second single from their debut album, \"No Pads, No Helmets... Just Balls\". It features vocals from Mark Hoppus (blink-182 and +44).", "prediction 2": "The theme song to the Canadian animated series Scooby Doo was sung by the rock band Simple Plan. The song was released in October 2002 as the second single from their debut album, No Pads, No Helmets... Just Balls. Mark Hoppus sang the song on an episode of What's New Scooby-Doo? The theme song was also sung by Austin Roberts, who also made a new recording of the theme song for the second season.", "prediction 3": "The theme song to the animated series Scooby Doo, Where Are You? was sung by Canadian rock band Simple Plan. The song was released in October 2002 as the second single from their debut album, No Pads, No Helmets... Just Balls. It features vocals from Mark Hoppus, from blink-182 and +44.", "prediction 4": "The theme song to Scooby Doo was originally sang by Canadian rock band Simple Plan, featuring vocals by Mark Hoppus. Comeau was a drummer for the rock band Simple Plan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 233 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": " Danny Janssen and Austin Roberts made a new recording of the \"Scooby Doo, Where Are You!\" theme song for the second season. The series' theme song has been covered by several subsequent artists, including Matthew Sweet for the 1995 TV special and album \"\"; Third Eye Blind for the 1998 film \"Scooby-Doo on Zombie Island\"; Billy Ray Cyrus for \"Scooby-Doo! and the Witch's Ghost\" (1999); Jennifer Love Hewitt for \"Scooby-Doo and the Alien Invaders\" (2000); the B-52's (Cindy, Kate and Fred) for \"Scooby-Doo and the Cyber Chase\" (2001); MxPx for the live-action \"Scooby-Doo\" film (2002); and Krystal Harris for \"Scooby-Doo! and the Legend of the Vampire\" (2003)." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When did the first answering machine come out?", "passages": [ [ "Answering machine", "Many claim it was William Muller in 1935, but it could have been created already in 1931 by William Schergens whose device used phonographic cylinders.", "Ludwig Blattner promoted a telephone answering machine in 1929 based on his Blattnerphone magnetic recording technology.", "In 1935 inventor Benjamin Thornton developed a machine to record voice messages from the caller.", "The device reportedly also was able to keep track of the time the recordings were made.", "Although many sources maintain that he invented it in 1935, Thornton had actually filed a patent in 1930 (Number 1831331) for this machine, which utilized a phonographic record as the recording medium.", "A commercial answering machine, the \"Tel-Magnet\", offered in the United States in 1949, played outgoing messages and recorded incoming messages on a magnetic wire.", "It was priced at $200 but was not a commercial success.", "In 1949 the first commercially successful answering machine was the \"Electronic Secretary\" created by inventor Joseph Zimmerman and businessman George W. Danner, who founded Electronic Secretary Industries in Wisconsin.", "The Electronic Secretary used the then state-of-the-art technology of a 45\u00a0rpm record player for announcements and a wire recorder for message capture and playback.", "Electronic Secretary Industries was purchased in 1957 by General Telephone and Electronics." ] ], "gold": "One of the first answering machines, the Blattnerphone, came out in 1930. In 1949, the first commercially successful answering machine was the \"Electronic Secretary\" created by inventor Joseph Zimmerman and businessman George W. Danner, who founded Electronic Secretary Industries in Wisconsin. ", "prediction 1": "The first answering machine came out in 1935. In 1929, Ludwig Blattner promoted a telephone answering machine based on his Blattnerphone magnetic recording technology. In 1935 inventor Benjamin Thornton developed a machine to record voice messages from the caller. The device reportedly also was able to keep track of the time the recordings were made. A commercial answering machine, the Tel-Magnet, was offered in the United States in 1949, played outgoing messages and recorded incoming messages on a magnetic wire.", "prediction 2": "The first answering machine came out in 1935, but it could have been created already in 1931 by William Schergens whose device used phonographic cylinders. Ludwig Blattner promoted a telephone answering machine in 1929 based on his Blattnerphone magnetic recording technology. Benjamin Thornton developed a machine to record voice messages from the caller. Although many sources maintain that he invented it in 1935, Thornton had actually filed a patent in 1930 for this machine, which utilized a phonographic record as the recording medium. A commercial answering machine, the \"Tel-Magnet\", offered in the United States in 1949, played outgoing messages and recorded incoming messages on a magnetic wire. The Tele-Magnet was priced at $200 but was not a commercial success. The first commercially successful answering machine was the \"Electronic Secretary\" created by inventor Joseph Zimmerman and businessman George W. Danner, who founded", "prediction 3": "The first answering machine came out in 1935, according to many sources. Although many sources maintain that he invented it in 1935, Benjamin Thornton developed a machine to record voice messages from the caller.", "prediction 4": "In 1935 inventor Benjamin Thornton developed a machine to record voice messages from the caller. The device reportedly also was able to keep track of the time the recordings were made. A commercial answering machine, the Tel-Magnet, was offered in the United States in 1949, played outgoing messages and recorded incoming messages on a magnetic wire. It was priced at $200 but was not a commercial success. In 1949 the first commercially successful answering machine was the Electronic Secretary created by inventor Joseph Zimmerman and businessman George W. Danner, who founded Electronic Secretary Industries in Wisconsin. Electronic Secretary Industries was purchased by General Telephone and Electronic Secretary Industries in 1957 by General Telephone and Electronic Secretary Industries.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 264 }, { "error type": "Irrelevant", "explanation": "", "start": 265, "end": 352 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 518 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 45 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "In 1929, Ludwig Blattner promoted a telephone answering machine based on his Blattnerphone magnetic recording technology. In 1949 the first commercially successful answering machine was the \"Electronic Secretary\" created by inventor Joseph Zimmerman and businessman George W. Danner, who founded Electronic Secretary Industries in Wisconsin." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When do new episodes of riverdale come out?", "passages": [ [ "Riverdale (2017 TV series)", "Riverdale (2017 TV series)\n\n", "Riverdale is an American teen drama television series based on the characters of Archie Comics.", "The series was adapted for The CW by Archie Comics' chief creative officer Roberto Aguirre-Sacasa, and is produced by Warner Bros. Television and CBS Television Studios, in association with Berlanti Productions and Archie Comics.", "Originally conceived as a feature film adaptation for Warner Bros. Pictures, the idea was re-imagined as a television series for Fox.", "In 2015, development on the project moved to The CW, where the series was ordered for a pilot.", "Filming takes place in Vancouver, British Columbia.", "The series features an ensemble cast based on the characters of Archie Comics, with KJ Apa in the role of Archie Andrews; Lili Reinhart as Betty Cooper, Camila Mendes as Veronica Lodge, and Cole Sprouse as Jughead Jones, the series' narrator.", "The cast also features Madelaine Petsch as Cheryl Blossom, Ashleigh Murray as Josie McCoy, Casey Cott as Kevin Keller, Charles Melton and Ross Butler as Reginald \"Reggie\" Mantle and Vanessa Morgan as Toni Topaz." ], [ "Riverdale (2017 TV series)", "Alongside a one-shot pilot issue, illustrated by Alitha Martinez, released in March 2017, the first issue of the ongoing \"Riverdale\" comic book series was set to release starting April 2017.", "In addition to the adaptation, Archie Comics are releasing a series of compilation graphic novels branded under the title \"Road to Riverdale\".", "This series features early issues from the \"New Riverdale\" reboot line, introducing the audience of the TV series to the regular ongoing comic series that inspired it.", "Archie Comics plans to re-print the volumes of \"Road to Riverdale\" in subsequent months as digest magazines.", "The first volume was released in March 2017.", "The first season of \"Riverdale\" received a generally positive response from critics.", "On Rotten Tomatoes, it has a fresh rating of 88% based on 61 reviews, with a weighted average of 7.27/10.", "The site's critical consensus reads, \"\"Riverdale\" offers an amusingly self-aware reimagining of its classic source material that proves eerie, odd, daring, and above all addictive.\"", "On Metacritic, the season has a score of 68 out of 100 based on 36 critics, indicating \"generally favorable reviews\"." ], [ "Riverdale (2017 TV series)", "Other characters in the series include the parents of the main characters: Luke Perry as Fred Andrews, M\u00e4dchen Amick as Alice Cooper, Marisol Nichols and Mark Consuelos as Hermione and Hiram Lodge, and Skeet Ulrich as FP Jones.", "The series debuted on January 26, 2017 to positive reviews.", "A 22-episode second season premiered on October 11, 2017, and concluded on May 16, 2018.", "On April 2, 2018, The CW renewed the series for a third season, which premiered on October 10, 2018.", "The series follows Archie Andrews' life in the small town of Riverdale and explores the darkness hidden behind its seemingly perfect image.", "Warner Bros. began development on an \"Archie\" feature film in 2013, after a pitch from writer Roberto Aguirre-Sacasa and director Jason Moore that would place Archie's gang into a teen comedy feature film in the John Hughes tradition.", "The duo brought the project to Warner Bros., where a VP recommended a more high-concept direction involving time travel or interdimensional portals, suggesting Louis C. K. to portray an older Archie.", "Dan Lin and Roy Lee became producers on the project, which eventually stalled as priorities shifted at the studio towards larger tentpole films and was reimagined as a television series." ] ], "gold": "Riverdale is an American teen drama television series based on the characters of Archie Comics. Riverdale debuted on January 26, 2017, to positive reviews. Season 3 came out on October 10, 2018 and Season 4 came out on October 9, 2019.", "prediction 1": "Riverdale is an American teen drama television series based on the characters of Archie Comics, adapted for The CW by Archie Comics' chief creative officer Roberto Aguirre-Sacasa, and is produced by Warner Bros. Television and CBS Television Studios, in association with Berlanti Productions and Archie Comics. Originally conceived as a feature film adaptation for Warner Bros. Pictures, the idea was re-imagined as a television series for Fox. The first season premiered on January 26, 2017, and the final 22-episode second season premiered on October 11, 2017, and concluded on May 16, 2018. The series premiered on January 6, 2017.", "prediction 2": "Riverdale is an American teen drama television series based on the characters of Archie Comics. The series was adapted for The CW by Archie Comics' chief creative officer Roberto Aguirre-Sacasa, and is produced by Warner Bros. Television and CBS Television Studios, in association with Berlanti Productions and Archie Comics. Season 2 episodes were first released on October 11, 2017, and season 3 came out on September 13, 2019.", "prediction 3": "Riverdale is an American teen drama television series based on the characters of Archie Comics. The series was adapted for The CW by Archie Comics' chief creative officer Roberto Aguirre-Sacasa, and is produced by Warner Bros. Television and CBS Television Studios, in association with Berlanti Productions and Archie Comics. Each episode comes out on a different date, though most episodes come out on the same date.", "prediction 4": "Riverdale is an American teen drama television series based on the characters of Archie Comics. The series was adapted for The CW by Archie Comics' chief creative officer Roberto Aguirre-Sacasa, and is produced by Warner Bros. Television and CBS Television Studios, in association with Berlanti Productions and Archie Comics. Originally conceived as a feature film adaptation for Warner Bros. Pictures, the idea was re-imagined as a television series for Fox.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 310 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 444 }, { "error type": "Unverifiable", "explanation": "", "start": 594, "end": 634 }, { "error type": "Unverifiable", "explanation": "", "start": 501, "end": 517 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Riverdale is an American teen drama television series based on the characters of Archie Comics. The first season premiered on January 26, 2017 to positive reviews. The second season premiered on October 11, 2017, and concluded on May 16, 2018. The series premiered on January 6, 2017." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who was the nba rookie of the year last year?", "passages": [ [ "NBA Rookie of the Year Award", "NBA Rookie of the Year Award\n\nThe National Basketball Association's Rookie of the Year Award is an annual National Basketball Association (NBA) award given to the top rookie(s) of the regular season.", "Initiated following the 1952\u201353 NBA season, it confers the Eddie Gottlieb Trophy, named after the former Philadelphia Warriors head coach.", "The winner is selected by a panel of United States and Canadian sportswriters and broadcasters, each casting first, second, and third place votes (worth five points, three points, and one point respectively).", "The player(s) with the highest point total, regardless of the number of first-place votes, wins the award.", "The most recent Rookie of the Year winner is Ben Simmons.", "Twenty-one winners were drafted first overall.", "Sixteen winners have also won the NBA Most Valuable Player (MVP) award in their careers; Wilt Chamberlain and Wes Unseld earning both honors the same season.", "Nineteen of the forty two non-active winners have been elected to the Naismith Memorial Basketball Hall of Fame.", "Three seasons had joint winners\u2014Dave Cowens and Geoff Petrie in the , Grant Hill and Jason Kidd in the , and Elton Brand and Steve Francis in the 1999\u20132000 season." ], [ "NBA draft", "In 2002, the Houston Rockets selected Yao Ming from China first in the draft.", "In 2005, the Milwaukee Bucks picked Andrew Bogut, from Australia by way of the University of Utah, #1.", "The next year, the Toronto Raptors drafted Andrea Bargnani from Italy, making him the second foreign player without U.S. college experience and the first European to be selected number 1 overall.", "In 2011, Australian born Kyrie Irving was selected by the Cleveland Cavaliers after having played one year at Duke.", "In 2013, the Cleveland Cavaliers selected Anthony Bennett, who played at UNLV, first overall and making Bennett the first Canadian to be drafted at #1.", "In the 2014 NBA draft, the Cleveland Cavaliers, again picking #1, selected Canadian shooting guard/small forward Andrew Wiggins.", "During the 2015 NBA draft, the Minnesota Timberwolves selected American / Dominican Center Karl-Anthony Towns as the first player from the Dominican Republic to become the #1 selection, teaming up with Andrew Wiggins in the process.", "During the 2016 NBA draft, the Philadelphia 76ers selected Australian Forward Ben Simmons to be the #1 selection, the first time the franchise got one in 20 years since the 1996 NBA draft when they selected the first overall pick Allen Iverson, a sophomore from Georgetown." ], [ "Tony Bennett (basketball, born 1969)", "Bennett's methods of recruiting and development have been compared to the San Antonio Spurs (because of that NBA franchise's commitment to unselfishness and \"team\" success under Coach Popovich).", "Malcolm Brogdon, an unheralded college recruit, was named NBA Rookie of the Year in 2017 after five years (with an injury redshirt) under Bennett.", "In total, seven of Bennett's players at Virginia and Washington State have been drafted into the NBA.", "Of these, \"none\" were consensus top 40 recruits or McDonald's All-Americans before playing for Bennett.", "Undrafted Bennett players to play full-time in the NBA include Aron Baynes of the San Antonio Spurs, Detroit Pistons, and Boston Celtics.", "Bennett players to play in professional basketball leagues around the globe include Darion Atkins, Mustapha Farrakhan Jr., Anthony Gill, Sylven Landesberg, Jerome Meyinsse, Laurynas Mikalauskas, Akil Mitchell, Austin Nichols, London Perrantes, Taylor Rochestie, Mike Tobey, and Sammy Zeglinski.", "Five Virginia Cavaliers have developed under Bennett into winning NCAA All-America honors or nationwide defensive player of the year awards." ] ], "gold": "The National Basketball Association's Rookie of the Year Award is an annual award given to the top rookie's of the regular season. The winner is selected by a panel of United States and Canadian sportswriters and broadcasters, each casting first, second, and third place votes, the player or players, with the highest point total, regardless of the number of first place votes, wins the award. In the 2014-2015 season, Andrew Wiggins was rookie of the year, 2015-2017 Karl-Anthony Towns, and the 2016-2017 Malcolm Brogdon. ", "prediction 1": "The National Basketball Association's Rookie of the Year Award is an annual award given to the top rookie(s) of the regular season. The most recent Rookie of the Year winner is Ben Simmons. Malcolm Brogdon, an unheralded college recruit, was named NBA Rookie of the Year in 2017 after five years (with an injury redshirt) under Bennett.", "prediction 2": "The National Basketball Association's Rookie of the Year Award is an annual award given to the top rookie(s) of the regular season. Malcolm Brogdon was the 2017 rookie of the year, and in 2018, Anthony Bennett was the 2016 rookie of the year.", "prediction 3": "The National Basketball Association's Rookie of the Year Award is an annual National Basketball Association award given to the top rookie(s) of the regular season. The most recent Rookie of the Year winner is Australian forward Ben Simmons. Malcolm Brogdon, an unheralded college recruit, was named NBA Rookie of the Year in 2017 after five years (with an injury redshirt).", "prediction 4": "The National Basketball Association's Rookie of the Year Award is an annual National Basketball Association award given to the top rookie(s) of the regular season. Initiated following the 1952\u201353 NBA season, it confers the Eddie Gottlieb Trophy, named after the former Philadelphia Warriors head coach. In 2016, the Philadelphia 76ers selected Australian Forward Ben Simmons to be the #1 selection, making Bennett the first Canadian to be drafted at #1. In 2018, the Philadelphia 76ers selected Anthony Bennett, who played at UNLV, to be the #1 selection, making Bennett the first Canadian to be selected at #1. In 2017, the Philadelphia 76ers selected Australian Forward Ben Simmons to be the #1 selection, making Bennett the first Canadian to be drafted at #1.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 336 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The National Basketball Association's Rookie of the Year Award is an annual award given to the top rookie(s) of the regular season. The winner is selected by a panel of United States and Canadian sportswriters and broadcasters, each casting first, second, and third place votes, the player or players, with the highest point total, regardless of the number of first place votes, wins the award. The most recent Rookie of the Year winner is Ben Simmons. Malcolm Brogdon, an unheralded college recruit, was named NBA Rookie of the Year in 2017." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who sits next to the speaker of the house during the state of the union?", "passages": [ [ "State of the Union", "Both the Speaker and the Vice President sit at the Speaker's desk, behind the President for the duration of the speech.", "If either is unavailable, the next highest-ranking member of the respective house substitutes.", "Once the chamber settles down from the President's arrival, the Speaker officially presents the President to the joint session of Congress.", "The President then delivers the speech from the podium at the front of the House Chamber.", "In the State of the Union the President traditionally outlines the administration's accomplishments over the previous year, as well as the agenda for the coming year, often in upbeat and optimistic terms.", "Since the 1982 address, it has also become common for the President to honor special guests sitting in the gallery, such as American citizens or visiting heads of state.", "During that 1982 address, President Ronald Reagan acknowledged Lenny Skutnik for his act of heroism following the crash of Air Florida Flight 90.", "Since then, the term \"Lenny Skutniks\" has been used to refer to individuals invited to sit in the gallery, and then cited by the President, during the State of the Union.", "State of the Union speeches usually last a little over an hour, partly because of the large amounts of applause that occur from the audience throughout.", "The applause is often political in tone, with many portions of the speech being applauded only by members of the President's own party." ], [ "State of the Union", "State of the Union\n\nThe State of the Union Address is an annual message presented by the President of the United States to a joint session of the United States Congress, except in the first year of a new president's term.", "The message includes a budget message and an economic report of the nation, and also allows the President to propose a legislative agenda (for which the cooperation of Congress is needed) and national priorities.", "The address fulfills rules in of the U.S. Constitution, requiring the President to periodically \"give to the Congress Information of the State of the Union, and recommend to their Consideration such measures as he shall judge necessary and expedient.\"", "During most of the country's first century, the President primarily only submitted a written report to Congress.", "After 1913, Woodrow Wilson, the 28th U.S. President, began the regular practice of delivering the address to Congress in person as a way to rally support for the President's agenda.", "With the advent of radio and television, the address is now broadcast live across the country on many networks.", "The practice arises from a duty given to the president in the Constitution of the United States:\nAlthough the language of this \"State of the Union Clause\" of the Constitution is not specific, since the 1930s, the President makes this report annually in late January or early February." ], [ "State of the Union", "Between 1934 and 2013 the date has been as early as January 3, and as late as February 12.", "While not required to deliver a speech, every president since Woodrow Wilson, with the notable exception of Herbert Hoover, has made at least one State of the Union report as a speech delivered before a joint session of Congress.", "Before that time, most presidents delivered the State of the Union as a written report.", "Since Franklin Roosevelt, the State of the Union is given typically each January before a joint session of the United States Congress and is held in the House of Representatives chamber of the United States Capitol.", "Newly inaugurated presidents generally deliver an address to Congress in February of the first year of their term, but this speech is not officially considered to be a \"State of the Union\".", "What began as a communication between president and Congress has become in effect a communication between the president and the people of the United States.", "Since the advent of radio, and then television, the speech has been broadcast live on most networks, preempting scheduled programming.", "To reach the largest audience, the speech, once given during the day, is now typically given in the evening, after 9pm\u00a0ET\u00a0(UTC-5).", "George Washington delivered the first regular annual message before a joint session of Congress on January 8, 1790, in New York City, then the provisional U.S. capital." ] ], "gold": "The State of the Union Address is an annual message delivered by the president of the United States to the U.S. Congress near the beginning of each calendar year on the current condition of the nation. The event follows a series of formalities, such as having the Speaker of the House sitting behind the President and next to the Vice President. If the latter is not available, the next highest-ranking member of the respective house occupies the seat.", "prediction 1": "The State of the Union Address is an annual message presented by the President of the United States to a joint session of the United States Congress, except in the first year of a new president's term. Both the Speaker and the Vice President sit at the Speaker's desk, behind the President for the duration of the speech. If either is unavailable, the next highest-ranking member of the respective house substitutes.", "prediction 2": "The State of the Union Address is an annual message presented by the President of the United States to a joint session of the United States Congress, except in the first year of a new president's term. The Speaker of the House sits next to the President, and the Vice President sits next to the Speaker. If either is unavailable, the next highest-ranking member of the respective house substitutes.", "prediction 3": "The State of the Union Address is an annual message presented by the President of the United States to a joint session of the United States Congress, except in the first year of a new president's term. The Speaker and the Vice President sit at the Speaker's desk behind the President for the duration of the speech. If either is unavailable, the next highest-ranking member of the respective house substitutes.", "prediction 4": "The State of the Union Address is an annual message presented by the President of the United States to a joint session of the United States Congress. The Speaker and the Vice President sit at the Speaker's desk, behind the president, for the duration of the speech. If either is unavailable, the next highest-ranking member of the respective house substitutes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 201 } ], "missing-info": [], "corrected-prediction": "The State of the Union Address is an annual message presented by the President of the United States. Both the Speaker and the Vice President sit at the Speaker's desk, behind the President for the duration of the speech. If either is unavailable, the next highest-ranking member of the respective house substitutes." }, "preference": [ 1, 0, 2, 2, 2, 2 ] }, { "question": "Where does ford rank in the auto industry?", "passages": [ [ "Ford Motor Company", "Ford Motor Company\n\nFord Motor Company is an American multinational automaker headquartered in Dearborn, Michigan, a suburb of Detroit.", "It was founded by Henry Ford and incorporated on June 16, 1903.", "The company sells automobiles and commercial vehicles under the Ford brand and most luxury cars under the Lincoln brand.", "Ford also owns Brazilian SUV manufacturer Troller, an 8% stake in Aston Martin of the United Kingdom, and a 49% stake in Jiangling Motors of China.", "It also has joint-ventures in China (Changan Ford), Taiwan (Ford Lio Ho), Thailand (AutoAlliance Thailand), Turkey (Ford Otosan), and Russia (Ford Sollers).", "The company is listed on the New York Stock Exchange and is controlled by the Ford family; they have minority ownership but the majority of the voting power.", "Ford introduced methods for large-scale manufacturing of cars and large-scale management of an industrial workforce using elaborately engineered manufacturing sequences typified by moving assembly lines; by 1914, these methods were known around the world as Fordism.", "Ford's former UK subsidiaries Jaguar and Land Rover, acquired in 1989 and 2000 respectively, were sold to Tata Motors in March 2008.", "Ford owned the Swedish automaker Volvo from 1999 to 2010." ], [ "Big Three (automobile manufacturers)", "As of 2007 it edged out Ford to rank third in the world after General Motors and Toyota.", "It is also the parent group of Audi, Porsche, SEAT, \u0160koda, Bugatti, Lamborghini and Bentley.", "Daimler AG holds major stakes in other automakers including Mitsubishi Fuso.", "BMW also produces Mini branded vehicles, and has been the parent company of Rolls-Royce Motor Cars since 1998.", "BMW, Mercedes-Benz and Audi make up about 80% of the global luxury market.", "Renault , Peugeot and Citro\u00ebn are often referred to as France's Big Three although the latter is part of the PSA Group along with Peugeot.", "France is home to two major automaking companies :\n\n- PSA Group (owner of the Peugeot, Citro\u00ebn, DS and Opel/Vauxhall brands) the 2nd-largest automaker in Europe and the 10th-largest of the world in 2016.", "- Renault Group (owner of the Renault, Alpine, Dacia, Renault Samsung Motors brands and 43% of Nissan) the 3rd-largest automaker in Europe and the 9th-largest of the world in 2016.", "France was a pioneer in the automotive industry and is the 11th-largest automobile manufacturer in the world by 2015 unit production and the third-largest in Europe (after Germany and Spain)." ], [ "Automotive industry by country", "80 000 people were directly employed in the automotive industry in 2014.This number will be even increased when Jaguar Land Rover starts production in Nitra in 2018.", "Having some small auto production in socialist Yugoslavia, Slovenia became one of the new Central European car making countries and now produces near 200,000 per year, mainly for export.", "After WWII Franco's Spain lagged behind main European auto manufacturing countries for decades.", "Only at the end of the 1970s it was able to produce more than one million vehicles and was 5th in Europe and 9th in the world.", "Then significant growth allows Spain to overtake the United Kingdom, Italy and achieve the 3 million output (for export partially), 3rd place in Europe, 6th place in the World at 2000.", "Since that time, due to East-European and Asian competitors on European market, auto exports from Spain have slowed and annual production decreased to 2.4 million, although Spain beat France and became the second auto power in Europe (after Germany) but 9th in the world.", "In 2009, the automotive industry generated 3.5 percent of the country's GDP and gave employment to about nine percent of the working population.", "Spain is in eighth place in car manufacturing countries, but 2008 and 2009 showed a decrease in car production.", "The downward spiral started about ten years ago, with an abandoning policy of many consecutive governments." ] ], "gold": "The Ford Motor Company is an American multinational automobile manufacturer headquartered in Dearborn, Michigan, United States. It was founded by Henry Ford and incorporated on June 16, 1903. Based on 2015 vehicle production, Ford is the 5th largest automaker in the world and the 2nd one in the United States. During 2007, the company also ranked 3rd in North American Sales.", "prediction 1": "Ford Motor Company is an American multinational automaker headquartered in Dearborn, Michigan, a suburb of Detroit. As of 2007, it edged out Ford to rank third in the world after General Motors and Toyota. For the years 2000\u20132010, Ford ranked 5th in the world in terms of output, while for 2015\u20132016, Ford ranked 11th.", "prediction 2": "Ford Motor Company is an American multinational automaker headquartered in Dearborn, Michigan, a suburb of Detroit. As of 2007 it edged out Ford to rank third in the world after General Motors and Toyota.", "prediction 3": "Ford Motor Company is an American multinational automaker headquartered in Dearborn, Michigan, a suburb of Detroit. As of 2007, it edged out Ford to rank third in the world after General Motors and Toyota. As of 2015 unit production, France was a pioneer in the automotive industry and is the 11th-largest automobile manufacturer in the world.", "prediction 4": "Ford Motor Company is an American multinational automaker headquartered in Dearborn, Michigan, a suburb of Detroit. It sells automobiles and commercial vehicles under the Ford brand and most luxury cars under the Lincoln brand. As of 2007 it edged out Ford to rank third in the world after General Motors and Toyota. France was a pioneer in the automotive industry and is the 11th-largest automobile manufacturer in the world by 2015 unit production and the third-largest in Europe. Renault, Peugeot and Citron are often referred to as France's Big Three.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 115 }, { "error type": "Unverifiable", "explanation": "", "start": 206, "end": 279 }, { "error type": "Unverifiable", "explanation": "", "start": 280, "end": 318 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Ford Motor Company is an American multinational automaker headquartered in Dearborn, Michigan. It was founded by Henry Ford and incorporated on June 16, 1903. As of 2007, it edged out Ford to rank third in the world after General Motors and Toyota. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does new york city drinking water come from?", "passages": [ [ "Delaware River", "In southwestern Delaware County it flows in an increasingly winding course through the mountains, generally southwest.", "At Stilesville the West Branch was impounded in the 1960s to form the Cannonsville Reservoir, the westernmost of the reservoirs in the New York City water system.", "It is the most recently constructed New York City reservoir and began serving the city in 1964.", "Draining a large watershed of , the reservoir's capacity is .", "This water flows over halfway through the reservoir to enter the West Delaware Tunnel in Tompkins, New York.", "Then it flows through the aqueduct into the Rondout Reservoir, where the water enters the Delaware Aqueduct, that contributes to roughly 50% of the city's drinking water supply.", "At Deposit, on the border between Broome and Delaware counties, it turns sharply to the southeast and is paralleled by New York State Route\u00a017.", "It joins the East Branch at above sea level at Hancock to form the Delaware.", "Similarly, the East Branch begins from a small pond south of Grand Gorge in the town of Roxbury in Delaware County, flowing southwest toward its impoundment by New York City to create the Pepacton Reservoir, the largest reservoir in the New York City water supply system.", "Its tributaries are the Beaver Kill River and the Willowemoc Creek which enter into the river ten miles (16\u00a0km) before the West Branch meets the East Branch." ], [ "New York City water supply system", "A computer system then analyzes the measurements and makes predictions for the water quality.", "In 2015, the buoys took 1.9 million measurements of the water in the reservoirs.", "The water from the reservoirs flows down to the Catskill-Delaware Water Ultraviolet Disinfection Facility, located in Westchester.", "The facility was built because chlorinated water might have unintended side effects when mixed with certain organic compounds, and ultraviolet was seen as the least risky way to clean the water of any microorganisms.", "The UV facility opened on October 8, 2013, and was built at a cost of $1.6 billion.", "The compound is the largest ultraviolet germicidal irradiation plant in the world; it contains 56 UV reactors that could treat per day.", "The Croton Filtration Plant, which was completed in 2015 at a cost of over $3 billion, was built under Van Cortlandt Park in the Bronx and filters water from the Croton River.", "The plant, which is bigger than Yankee Stadium, is New York City's first water filtration plant.", "It was built after a 1998 lawsuit by the presidential administration of Bill Clinton, which Mayor Rudy Giuliani settled under the condition that the city of New York would build the plant by 2006." ], [ "Catskill Mountains", "Catskill Mountains\n\nThe Catskill Mountains, also known as the Catskills, are a physiographic province of the larger Appalachian Mountains, located in southeastern New York.", "As a cultural and geographic region, the Catskills are generally defined as those areas close to or within the borders of the Catskill Park, a forest preserve forever protected from many forms of development under New York state law.", "Geologically, the Catskills are a mature dissected plateau, a once-flat region subsequently uplifted and eroded into sharp relief by watercourses.", "The Catskills form the northeastern end of the Allegheny Plateau (also known as the Appalachian Plateau).", "The Catskills are well known in American culture, both as the setting for films and works of art, including many 19th-century Hudson River School paintings, as well as for being a favored destination for vacationers from New York City in the mid-20th century.", "The region's many large resorts gave countless young stand-up comedians an opportunity to hone their craft.", "In addition, the Catskills have long been a haven for artists, musicians, and writers, especially in and around the towns of Phoenicia and Woodstock.", "Nicolaes Visscher I's 1656 map of New Netherland located the ' at the mouth of Catskill creek." ] ], "gold": "New York City drinking water comes from several rivers, a reservoir, a region, and a province. The part of the state it comes from is the region of Upstate New York. New York City drinking water that flows through the city's first water filtration plant comes from the Croton River, that flows through the Delaware Aqueduct comes from the Delaware River, that flows through the New Croton Aqueduct comes from the New Croton Reservoir, and that flows through the Catskill Aqueduct comes from the province of the Catskill Mountains.", "prediction 1": "The water from the water supply system in New York City comes from several sources. The water comes from the aquifers in the Catskill Mountains, the Delaware River, the Hudson River, and the West Branch of the Delaware River. The water from the aquifers in the Catskill Mountains flows southeast toward its impoundment by New York City to create the Pepacton Reservoir, the largest reservoir in the New York City water supply system. The water from the aquifers also flow into the Delaware Aqueduct, where it enters the Delaware Aqueduct, which contributes to roughly 50% of the city's drinking water supply.", "prediction 2": "The water for New York City's drinking water comes from four sources. The water from the Delaware River, the Hudson River, the Catskill Mountains, and the East Branch of the Delaware.", "prediction 3": "The drinking water for New York City comes from various watercourses, including the Delaware River, Catskill Mountains, and the Croton River.", "prediction 4": "The water supply system for New York City, or NYC, comes from several sources. Water is derived from the Catskill Mountain Range, which is a physiographic province of the larger Appalachian Mountains, located in southeastern New York. It originates from the West Branch of the Delaware River, which flows through the town of Stilesville, in Delaware County. The water then flows through the aqueduct into the Rondout Reservoir, where the water enters the Delaware Aqueduct, that contributes to roughly 50% of the city's drinking water supply system.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 109, "end": 117 }, { "error type": "Unverifiable", "explanation": "", "start": 165, "end": 182 }, { "error type": "Redundant", "explanation": "The water from the aquifers also flow into the Delaware Aqueduct, ", "start": 500, "end": 538 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The water from the water supply system in New York City comes from several sources. The water comes from the reservoirs such as the ones in the Catskill Mountains, the Delaware River, and the West Branch of the Delaware River. Water from the Croton River is another source. The water from the aquifers in the Catskill Mountains flows southeast toward its impoundment by New York City to create the Pepacton Reservoir, the largest reservoir in the New York City water supply system. The water from the aquifers also flow into the Delaware Aqueduct, which contributes to roughly 50% of the city's drinking water supply." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who plays spider man in the amazing spider man?", "passages": [ [ "The Amazing Spider-Man (2012 film)", "The Amazing Spider-Man (2012 film)\n\n", "The Amazing Spider-Man is a 2012 American superhero film based on the Marvel Comics character Spider-Man, and sharing the title of the character's longest-running comic book.", "It is the fourth theatrical \"Spider-Man\" film produced by Columbia Pictures and Marvel Entertainment, and a reboot of Sam Raimi's \"Spider-Man\" 2002\u20132007 trilogy preceding it.", "The film was directed by Marc Webb.", "It was written by James Vanderbilt, Alvin Sargent and Steve Kloves, and it stars Andrew Garfield as Peter Parker / Spider-Man, alongside Emma Stone, Rhys Ifans, Denis Leary, Campbell Scott, Irrfan Khan, Martin Sheen and Sally Field.", "The film tells the story of Peter Parker, an introverted teenager from New York City, who takes up the alias of a masked vigilante: Spider-Man, after being bitten by a genetically engineered spider, and gaining spider-like superhuman abilities as a result, in order to hunt down his adoptive father/uncle's murderer." ], [ "The Amazing Spider-Man (2012 film)", "Sony and Gameloft teamed up again to create an official mobile game for the film.", "Sky Betting and Gaming's online casino website Sky Vegas created a related casino game.", "The comic was released in June, named \"Amazing Spider-Man: The Movie\" #1\u20132, written by Tom Cohen and illustrated by Neil Edwards.", "A trade paperback was published collecting the two-parter a week before the film's release, entitled \"Amazing Spider-Man: The Movie Prelude\", which also included \"The Amazing Spider-Man\" issues #75\u201377.", "The soundtrack album of the film was released the same day as the film, under the Sony Classical banner.", "\"The Amazing Spider-Man\" was originally reported as being the first of at least three planned sequels to the original trilogy.", "The second sequel, \"The Amazing Spider-Man 2\" was released on May 2, 2014.", "On June 17, 2013 Sony announced two more sequels to follow \"The Amazing Spider-Man 2\", which were scheduled to release on June 10, 2016 and May 4, 2018, respectively.", "However, in July 2014, the third film was delayed to an unspecified date in 2018.", "In November 2013, Sony Pictures Entertainment chief Michael Lynton told analysts, \"We do very much have the ambition about creating a bigger universe around Spider-Man." ], [ "The Amazing Spider-Man (TV series)", "The Amazing Spider-Man (TV series)\n\nThe Amazing Spider-Man is the first live-action television series about the Marvel Comics hero of the same name, although it is not the first live-action portrayal of the character, since Spider-Man was featured in a series of comedic short skits called Spidey Super Stories beginning in the 1974 season of PBS' \"The Electric Company\" children's educational program.", "\"The Amazing Spider-Man\" was shown in the United States from September 19, 1977 to July 6, 1979.", "Though it was a considerable ratings success, the CBS series was cancelled after just 13 episodes, which included a pilot film airing in autumn of 1977.", "None of the episodes were released on DVD, but almost all of them have been released on VHS.", "Despite its storylines being set in New York City (the character's hometown), the series was mostly filmed in Los Angeles.", "The only characters to appear regularly in both the television series and comics were Peter Parker/Spider-Man, J. Jonah Jameson, and Aunt May.", "Joe \"Robbie\" Robertson (played by Hilly Hicks) also appeared, but only in the pilot.", "Farley Stillwell, a scientist in the Marvel universe, makes a cameo in Wolfpack.", "A different actress played Aunt May in each episode in which she appeared." ], [ "Spider-Man in other media", "Spider-Man in other media\n\nSpider-Man is a fictional character who has been adapted in various media including television shows, films, toys, stage shows, books, and video games.", "Spider-Man has been adapted to television many times, as a short-lived live-action television series, a Japanese tokusatsu series, and several animated cartoon series.", "There were also the \"Spidey Super Stories\" segments on the PBS educational series \"The Electric Company\", which featured a Spider-Man (played by Danny Seagren) who did not speak out loud but instead used only word balloons.", "Nicholas Hammond portrayed Peter Parker / Spider-Man on-screen in the 1970s \"The Amazing Spider-Man tv series\", and in three films which were released theatrically in Europe.", "On February 9, 2015, it was announced that Sony and Disney made a deal for Spider-Man to appear in the Marvel Cinematic Universe with a new film to be released on July 7, 2017.", "The companies announced on June 23, 2015 that after many auditions, Tom Holland had been cast to play Spider-Man within the MCU.", "In November 2016, Holland announced that he's signed for 6 films in the MCU." ] ], "gold": "Several adaptations of Marvel Comic's Spider-Man have shared the title \"The Amazing Spider-Man\" or similar, where different people have played the character. In 2012, a reboot of the series following Sam Raimi's 2002\u20132007 Spider-Man trilogy was released, where a genetically altered spider bites Peter Parker as he gains newfound, spider-like powers, venturing out to save the city from the machinations of a mysterious reptilian foe. Andrew Garfield plays Spiderman-Man both in this movie and its sequel, \"The Amazing Spider-Man 2,\" released on May 2, 2014. The name also refers to a 1977 series, the first live-action TV show featuring Spider-Man, portrayed by Nicholas Hammond.", "prediction 1": "The Amazing Spider-Man is a fictional character who has been adapted in various media including television shows, films, toys, stage shows, books, and video games. In the 2012 film The Amazing Spider-Man, Andrew Garfield plays the role of Peter Parker, an introverted teenager from New York City who takes up the alias of a masked vigilante: Spider-Man, after being bitten by a genetically engineered spider and gaining spider-like superhuman abilities as a result, in order to hunt down his adoptive father/uncle's murderer. In the 1974 television series The Amazing Spider-Man was played by Nicholas Hammond.\n", "prediction 2": "The Amazing Spider-Man is a fictional hero who has been adapted in various media, including television shows, movies, toys, stage shows, books, and video games. In the show The Amazing Spider-Man (1977\u20131983), Danny Seagren portrayed the web-slinger. But in the 2012 film they left Seagren out of the picture to allow Nick Fury to play it.", "prediction 3": "The Amazing Spider-Man is a fictional character who has been adapted in various media including television shows, films, toys, stage shows, comic books, and video games. Andrew Garfield plays the character of Peter Parker in the 2012 film The Amazing Spider-Man. Several actors and actresses have played the character, including Emma Stone in the 2001 film The Amazing Spider-Man and Sam Raimi in the 2012 film The Amazing Spider-Man 2. In the television series The Amazing Spider-Man, who originally debuted on August 19, 1976, is played by Chris Cooper and Ben Carnes.", "prediction 4": "The Amazing Spider-Man is a fictional superhero who has been adapted in various media including television shows, films, toys, stage shows, books, and video games. In the 2011 The Amazing Spider-Man comic book adaptation, Spider-Man was played by John Lasseter. In the 2012 The Amazing Spider-Man American superhero film adaption, Andrew Garfield plays Peter Parker/Spider-Man. In the 2012 film adaptation, Andrew Garfield plays the role of Peter Parker and in the 2013 television adaptation, Peter Parker was played by Nicholas Hammond. In the 2012 film, Andrew Garfield plays the role of Peter Parker. It is an adaptation of the 2004 comic book.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 466, "end": 525 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Amazing Spider-Man is a fictional character who has been adapted in various media. In the 2012 film The Amazing Spider-Man, Andrew Garfield plays the role of Peter Parker, after being bitten by a genetically engineered spider and gaining spider-like superhuman abilities as a result. It is also a reboot of Sam Raimi's \"Spider-Man\" 2002\u20132007 trilogy. It has a sequel called \"The Amazing Spider-Man 2\" that was released on May 2, 2014. In the 1974 television series The Amazing Spider-Man, the character was played by Nicholas Hammond.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who was the leader of the revolt of 1857 in bihar?", "passages": [ [ "Kunwar Singh", "Kunwar Singh\n\nBabu Veer Kunwar Singh (1777 \u2013 26 April 1858) (also known as Babu Kunwar Singh and Kuer Singh) was a notable leader during the Indian Rebellion of 1857.", "He belonged to a zamindar family of Jagdispur, currently a part of Bhojpur district, Bihar, India.", "At the age of 80, he led a select band of armed soldiers against the troops under the command of the British East India Company.", "He was the chief organiser of the fight against the British in Bihar.", "He is popularly known as Veer Kunwar Singh.", "Kunwar Singh was born on November 1777 to Maharaja Shahabzada Singh and Maharani Panchratan Devi, in Jagdispur of the Shahabad (now Bhojpur) District, in the state of Bihar.", "He belonged to the Ujjainiya Rajput clan.", "He married the daughter of Raja Fateh Naraiyan Singh (a Mewari Sisodiya Rajput), a wealthy zamindar of Gaya district, Bihar, and a descendant of Maharana Pratap of Mewar.", "Singh led the Indian Rebellion of 1857 in Bihar.", "He was nearly eighty and in failing health when he was called upon to take up arms.", "He gave a good fight and harried British forces for nearly a year and remained invincible until the end." ], [ "Kunwar Singh", "In October 1859, Amar Singh II joined the rebel leaders in the Nepal Terai.", "In his last battle, fought on 23 April 1858, near Jagdispur, the troops under the control of the East India Company were completely routed.", "On 22 and 23 April being injured he fought bravely against the British Army and with the help of his army drove away the British Army, brought down the Union Jack from Jagdishpur Fort and hoisted his flag.", "He returned to his palace on 23 April 1858 and soon died on 26 April 1858.", "To honour his memory and his contribution to India\u2019s freedom movement, the Republic of India issued a commemorative stamp on 23 April 1966.", "Named after him, Government of Bihar established Veer Kunwar Singh University, Arrah in 1992.", "A play by Jagdish Chandra Mathur titled \"Vijay Ki Vela\" (Moment of Victory) is based on the later part of Kunwar Singh's life.", "He is also mentioned in the poem \"Jhansi Ki Rani\" by Subhadra Kumari Chauhan." ], [ "Bihari languages", "Bihari languages\n\nBihari is the western group of Eastern Indo-Aryan languages, mainly spoken in the Indian states of Bihar, Jharkhand, West Bengal and Uttar Pradesh and also in Nepal.", "Despite the large number of speakers of these languages, only Maithili has been constitutionally recognised in India, which gained constitutional status via the 92nd amendment to the Constitution of India, of 2003 (gaining assent in 2004).", "Both Maithili and Bhojpuri have constitutional recognition in Nepal.", "In Bihar, Hindi is the language used for educational and official matters.", "These languages were legally absorbed under the overarching label Hindi in the 1961 Census.", "Such state and national politics are creating conditions for language endangerments.", "After independence Hindi was given the sole official status through the Bihar Official Language Act, 1950.", "Hindi was displaced as the sole official language of Bihar in 1981, when Urdu was accorded the status of the second official language.", "The number of speakers of Bihari languages is difficult to indicate because of unreliable sources.", "In the urban region most educated speakers of the language name Hindi as their language because this is what they use in formal contexts and believe it to be the appropriate response because of unawareness.", "The educated and the urban population of the region return Hindi as the generic name for their language." ] ], "gold": "Babu Veer Kunwar Singh was the given name of the leader of the 1857 revolt in Bihar, while Veer Kunwar Singh was his popular name. He was the chief organiser of the fight against the British in Bihar, a state in eastern India.", "prediction 1": "The leader of the Indian Rebellion of 1857 in Bihar was Kunwar Singh, who belonged to a zamindar family of Jagdispur, currently a part of Bhojpur district, Bihar, India. At the age of 80, he led a select band of armed soldiers against the troops under the command of the British East India Company. He was the chief organiser of the fight against the British in Bihar. Veer Kunwar Singh was the second leader of the revolt of 1857 in Bihar.", "prediction 2": "During the Indian Rebellion of 1857, Kunwar Singh was the leader of the resistance. He belonged to a zamindar family of Jagdispur, currently a part of Bhojpur district, Bihar. He was nearly eighty and in failing health when he was called upon to take up arms. He gave a good fight and harried British forces for nearly a year and remained invincible until the end. He is popularly known as Veer Kunwar Singh.", "prediction 3": "Kunwar Singh was a notable leader during the Indian Rebellion of 1857 in Bihar. He belonged to a zamindar family of Jagdispur, currently a part of Bhojpur district, Bihar, India. He led a select band of armed soldiers against the troops under the command of the British East India Company. Kunwar was nearly eighty and in failing health when he was called upon to take up arms. He gave a good fight and harried British forces for nearly a year and remained invincible until the end. He died on 26 April 1858.", "prediction 4": "Kunwar Singh was the leader of the Indian Rebellion of 1857 in Bihar. He was nearly eighty and in failing health when he was called upon to take up arms. The rebel leader was also known as Babu Kunwar Singh and Kuer Singh.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 298 }, { "error type": "Unverifiable", "explanation": "", "start": 369, "end": 440 } ], "missing-info": [], "corrected-prediction": "The leader of the Indian Rebellion of 1857 in Bihar was Kunwar Singh. He was the chief organiser of the fight against the British in Bihar. " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Where does lymph fluid drain in order to go back into the cardiovascular system?", "passages": [ [ "Lymph", "Lymph\n\nLymph is the fluid that circulates throughout the lymphatic system.", "It is formed when the interstitial fluid (the fluid which lies in the interstices of all body tissues) is collected through lymph capillaries.", "It is then transported through larger lymphatic vessels to lymph nodes, where it is cleaned by lymphocytes, before emptying ultimately into the right or the left subclavian vein, where it mixes back with the blood.", "Since the lymph is derived from the interstitial fluid, its composition continually changes as the blood and the surrounding cells continually exchange substances with the interstitial fluid.", "It is generally similar to blood plasma, which is the fluid component of blood.", "Lymph returns proteins and excess interstitial fluid to the bloodstream.", "Lymph may pick up bacteria and bring them to lymph nodes, where they are destroyed.", "Metastatic cancer cells can also be transported via lymph.", "Lymph also transports fats from the digestive system (beginning in the lacteals) to the blood via chylomicrons.", "The word \"lymph\" is derived from the name of the ancient Roman deity of fresh water, Lympha.", "Lymph has a composition comparable to that of blood plasma, but it may differ slightly." ], [ "Lymph", "Lymph that enters the lymph vessels from the interstitial spaces usually does not flow backwards along the vessels because of the presence of valves.", "If excessive hydrostatic pressure develops within the lymph vessels, though, some fluid can leak back into the interstitial spaces and contribute to formation of oedema.", "Flow of the lymph in the thoracic duct in an average resting person usually approximates 100ml per hour.", "Accompanied by another ~25ml per hour in other lymph vessels, total lymph flow in the body is about 4 to 5 liters per day.", "This can be elevated several folds while exercising.", "Thus it can be estimated that without lymphatic flow, an average resting person would die within 24 hours.", "The word \"lymph\" is derived from the name of the ancient Roman deity of fresh water, Lympha.", "In 1907 the zoologist Ross Granville Harrison demonstrated the growth of frog nerve cell processes in a medium of clotted lymph.", "It is made up of lymph nodes and vessels.", "In 1913, E. Steinhardt, C. Israeli, and R. A. Lambert grew vaccinia virus in fragments of tissue culture from guinea pig corneal grown in lymph." ] ], "gold": "In order to return to the cardiovascular system, lymph fluid flows through the lymphatic system, in a process that takes it though the thoracic duct, from where it then drains into the right or the left subclavian vein, where it finally mixes with central venous blood.", "prediction 1": "Lymph is the fluid that circulates throughout the lymphatic system. It is formed when the interstitial fluid, the fluid which lies in the interstices of all body tissues, is collected through lymph capillaries. It is then transported through larger lymphatic vessels to lymph nodes, where it is cleaned by lymphocytes, before emptying ultimately into the right or the left subclavian vein, where it mixes back with the blood. Lymph that enters the lymph vessels from the interstitial spaces usually does not flow backwards along the vessels because of the presence of valves. However, if excessive hydrostatic pressure develops within the lymph vessels, some fluid can leak back into the interstitial spaces and contribute to formation of oedema.", "prediction 2": "Lymph fluid circulates throughout the lymphatic system. It is formed when the interstitial fluid (the fluid which lies in the interstices of all body tissues) is collected through lymph capillaries. It is then transported through larger lymphatic vessels to lymph nodes, where it is cleaned by lymphocytes, before emptying ultimately into the right or the left subclavian vein, where it mixes back with the blood.", "prediction 3": "Lymph is the fluid that circulates throughout the lymphatic system. It is formed when the interstitial fluid is collected through lymph capillaries. It is then transported through larger lymphatic vessels to lymph nodes, where it is cleaned by lymphocytes, before emptying ultimately into the right or the left subclavian vein, where it mixes back with the blood.", "prediction 4": "The lymph fluid that circulates throughout the lymphatic system drains from the lymph nodes into the right or left subclavian vein, where it mixes back with the blood. If excessive hydrostatic pressure develops within the lymph vessels, some fluid can leak back into the interstitial spaces and contribute to formation of oedema.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 575 }, { "error type": "Irrelevant", "explanation": "", "start": 576, "end": 746 } ], "missing-info": [], "corrected-prediction": "Lymph is the fluid that circulates throughout the lymphatic system. It is formed when the interstitial fluid, the fluid which lies in the interstices of all body tissues, is collected through lymph capillaries. It is then transported through larger lymphatic vessels to lymph nodes, where it is cleaned by lymphocytes, before emptying ultimately into the right or the left subclavian vein, where it mixes back with the blood. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "When did the blue jays win their last world series?", "passages": [ [ "Toronto Blue Jays", "In the late 1970s and early 1980s, the Blue Jays went through struggles typical of an expansion team, frequently finishing in last place in its division.", "In 1983, the team had its first winning season and two years later, they became division champions.", "From 1985 to 1993, they were an AL East powerhouse, winning five division championships in nine seasons, including three consecutive from 1991 to 1993.", "During that run, the team also became back-to-back World Series champions in 1992 and 1993, led by a core group of award-winning All-Star players, including Hall of Famer Roberto Alomar, Joe Carter, John Olerud, and Devon White.", "The Blue Jays became the first (and, to date, only) team outside the US to appear in and win a World Series, and the fastest AL expansion team to do so, winning in its 16th year.", "After 1993, the Blue Jays failed to qualify for the playoffs for 21 consecutive seasons, until clinching a playoff berth and division championship in 2015.", "The team clinched a second consecutive playoff berth in 2016, after securing an AL wild card position.", "Both years, the Jays won the AL Division Series but lost the AL Championship Series.", "The Blue Jays are one of two MLB teams under corporate ownership, with the other being the Atlanta Braves (Liberty Media)." ], [ "Toronto Blue Jays", "Toronto Blue Jays\n\nThe Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario.", "The Blue Jays compete in Major League Baseball (MLB) as a member club of the American League (AL) East division.", "The team plays its home games at the Rogers Centre.", "The \"Blue Jays\" name originates from the bird of the same name, and blue is also the traditional colour of two of Toronto's other professional sports teams: the Maple Leafs (ice hockey) and the Argonauts (Canadian football).", "In addition, the team was originally owned by the Labatt Brewing Company, makers of the popular beer Labatt's Blue.", "Colloquially nicknamed the \"Jays\", the team's official colours are royal blue, navy blue, red, and white.", "An expansion franchise, the club was founded in Toronto in 1977.", "Originally based at Exhibition Stadium, the team began playing its home games at the SkyDome upon its opening in 1989.", "Since 2000, the Blue Jays have been owned by Rogers Communications and in 2004, the SkyDome was purchased by that company, which renamed it Rogers Centre.", "They are the second MLB franchise to be based outside the United States, and currently the only team based outside the U.S. after the first Canadian franchise, the Montreal Expos, became the Washington Nationals in 2005." ] ], "gold": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, who compete in Major League Baseball as a member club of the American League East division. The team won back to back World Series champions in 1992 and 1993, led by a core group of award-winning All-Star players, including Hall of Famer Roberto Alomar, Joe Carter, John Olerud, and Devon White. The Blue Jays became the first and only team outside the U.S. to appear in and win a World Series. As of 2015-17, 1993 was the last time they won a World Series.", "prediction 1": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario. Since 1993, the Blue Jays have won four World Series, including the 2015 World Series and the 2016 World Series. From 1990 to 1993, they were AL East powerhouses, winning five division championships in nine seasons, including three consecutive from 1991 to 1993. During that run, they also became back-to-back World Series champions in 1992 and 1993, led by a core group of award-winning All-Star players, including Hall of Famer Roberto Alomar, Joe Carter, John Olerud, and Devon White. From 1993 to 2015, the Blue Jays won their last World Series.", "prediction 2": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario. They were the last Canadian team to win a World Series in 1993. They were the last Canadian team to appear in and win a World Series in 1992 and 1993.", "prediction 3": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario. An expansion franchise, the club was founded in Toronto in 1977. Their last World Series victory came in 1993.", "prediction 4": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario. In 1993, they became the first team outside the US to appear in and win a World Series, and the fastest AL expansion team to ever do so, winning in its 16th year. In 2018, they won the World Series in 2015.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 91, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 353 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Toronto Blue Jays are a Canadian professional baseball team based in Toronto, Ontario. The Blue Jays compete in Major League Baseball (MLB) as a member club of the American League (AL) East division. During that run, they also became back-to-back World Series champions in 1992 and 1993, led by a core group of award-winning All-Star players, including Hall of Famer Roberto Alomar, Joe Carter, John Olerud, and Devon White. The Blue Jays became the first and only team outside the U.S. to appear in and win a World Series. From 1993 to 2015, the Blue Jays won their last World Series." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When did the song copperhead road come out?", "passages": [ [ "Copperhead Road (song)", "Copperhead Road (song)\n\n\"Copperhead Road\" is a song written and recorded by American country music artist Steve Earle.", "It was released in 1988 as the first single and title track from his third studio album of the same name.", "The song reached number 10 on the U.S. \"Billboard\" Mainstream Rock Tracks chart, and was Earle's highest-peaking song to date on that chart in the United States.", "The song has sold 1.04 million digital copies in the US as of September 2015.", "The song's narrator is named John Lee Pettimore III, whose father and grandfather were both active in moonshine making and bootlegging in rural Johnson County, Tennessee.", "Pettimore's grandfather visited town only rarely, in order to buy supplies for a still he had set up in a hollow along Copperhead Road.", "Pettimore's father hauled the moonshine to Knoxville each week in an old police cruiser he bought at a surplus auction.", "According to a story the narrator heard (it had happened before he was born), a Revenue Man wanted John Sr.", "\"Real Bad\" and confronted John Sr. on Copperhead Road, and one of the two \"never came back.\"", "John Jr. himself is killed in a fiery car crash on the same road while driving to Knoxville with a weekly shipment." ], [ "Copperhead Road (song)", "Pettimore enlists in the Army on his birthday, believing he will soon be drafted (\"They draft the white trash first 'round here anyway\"), and serves two tours of duty in Vietnam.", "Once he returns home, he decides to use the Copperhead Road land to grow marijuana, rather than produce moonshine (\"I take the seed from Colombia and Mexico\").", "Having learned a few tricks from the Viet Cong (\"I learned a thing or two from Charlie\") while fighting overseas, he resolves not to be caught by the DEA by setting up booby traps of the kind employed by the Communist enemy.", "Copperhead Road was an actual road near Mountain City, Tennessee, although it has since been renamed Copperhead Hollow Road, owing to theft of road signs bearing the song's name.", "The song also inspired a popular line dance, timed to the same beat, and has been used as the theme music for the Discovery Channel reality series \"Moonshiners\".", "The music video was directed by Tony Vanden Ende and premiered in early 1988.", "In 1994 German rock band Torfrock recorded a German version of the song with the name \"Kettenhemd\" (engl.", "Mail (armour)) which is about vikings.", "The band plays this song regularly in concerts." ] ], "gold": "The song Copperhead Road by Steve Earle came out in 1988. In 1994 a German rock band named Torfrock did a German cover of the song.", "prediction 1": "The song Copperhead Road is a song written and recorded by American country music artist Steve Earle. It was released in 1988 as the first single and title track from his third studio album of the same name. The song reached number 10 on the U.S. Billboard Mainstream Rock Tracks chart, and was Earle's highest-peaking song to date on that chart in the United States. The music video for the song was directed by Tony Vanden Ende and premiered in early 1988. In 1994 German rock band Torfrock recorded a German version of the song with the name \"Kettenhemd\" (eng.", "prediction 2": "The song Copperhead Road is a song written and recorded by American country music artist Steve Earle. It was released in 1988 as the first single and title track from his third studio album of the same name. In 1994 German rock band Torfrock recorded a German version of the song with the name \"Kettenhemd\" which is about vikings.", "prediction 3": "\"Copperhead Road\" is a song written and recorded by American country music artist Steve Earle. It was released in 1988 as the first single and title track from his third studio album of the same name. The song reached number 10 on the U.S. Billboard Mainstream Rock Tracks chart, and was Earle's highest-peaking song to date on that chart in the United States. In 1994 German rock band Torfrock recorded a German version of the song with the name \"Kettenhemd\" which is about vikings. In 1996 the song was released.", "prediction 4": "\"Copperhead Road\" is a song written and recorded by American country music artist Steve Earle. It was released in 1988 as the first single and title track from his third studio album of the same name. It reached number 10 on the U.S. Billboard Mainstream Rock Tracks chart, and was Earle's highest-peaking song to date on that chart in the United States. The song's narrator is named John Lee Pettimore III, whose father and grandfather were both active in moonshine making and bootlegging in rural Johnson County, Tennessee. The song inspired a popular line dance, timed to the same beat, and has been used as the theme music for the Discovery channel reality series Moonshiners.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 458 }, { "error type": "Irrelevant", "explanation": "", "start": 531, "end": 563 } ], "missing-info": [], "corrected-prediction": "The song Copperhead Road is a song written and recorded by American country music artist Steve Earle, that was released in 1988. In 1994 German rock band Torfrock recorded a German version of the song." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who does the voice of the rabbit in hoodwinked?", "passages": [ [ "Hoodwinked!", "Hoodwinked!", "Hoodwinked!", "(alternatively styled Hoodwinked) is a 2005 American computer-animated family comedy film.", "It retells the folktale \"Little Red Riding Hood\" as a police investigation, using flashbacks to show multiple characters' points of view.", "It was produced independently by Blue Yonder Films with Kanbar Entertainment, directed and written by Cory Edwards, Todd Edwards, and Tony Leech, and produced by Katie Hooten, Maurice Kanbar, David K. Lovegren, Sue Bea Montgomery, and Preston Stutzman.", "The film was released by The Weinstein Company in Los Angeles, California, on December 16, 2005 for a one-week engagement before expanding nationwide on January 13, 2006.", "The cast features Anne Hathaway, Glenn Close, Jim Belushi, Patrick Warburton, Anthony Anderson, David Ogden Stiers, Xzibit, Chazz Palminteri and Andy Dick.", "\"Hoodwinked!\" was among the earliest computer-animated films to be completely independently funded.", "Working apart from a major studio allowed the filmmakers greater creative control, but also restrained them economically.", "Due to the film's small budget, its animation was produced in the Philippines, with a less-realistic design inspired by stop motion films." ], [ "Hoodwinked!", "When questioned, the Woodsman, Kirk, reveals that he is in fact an aspiring actor who was only trying out for the part of a woodsman in a commercial.", "After his schnitzel truck was robbed by the Goody Bandit, he went out into the woods to get in character for his role and spent the rest of the day chopping trees.", "A large tree rolled after him and pushed him through the window of Granny's home.", "The investigation then turns to Granny, who reveals that, unbeknownst to her family, she is an extreme sports enthusiast.", "During a ski race earlier that day, she was attacked by the opposing team, but got away safely after learning that they were hired by the Goody Bandit.", "Despondent over her Granny's lack of honesty, Red wanders off alone.", "Meanwhile, Nicky Flippers realizes that the one commonality between all four stories is a bunny named Boingo (Andy Dick) and concludes that he is the Goody Bandit.", "However, Boingo has already sneaked into the home and stolen Granny's recipes.", "Red sees Boingo and follows him to his hideout at a cable car station, but the police pursue him in the wrong direction.", "Granny, the Wolf, and Kirk manage to locate Boingo as he is explaining his evil scheme to Red." ], [ "Hoodwinked Too! Hood vs. Evil", "The plan goes wrong however and Granny is kidnapped as well.", "Meanwhile, Red (Hayden Panettiere) is in training with a mysterious group called the Sisters of the Hood where she learns that a secret all powerful truffle recipe has been stolen.", "She is assigned by detective Nicky Flippers (David Ogden Stiers) with Wolf and Twitchy to find the recipe and save her grandma.", "While getting info at the Giant's (Brad Garrett) nightclub and interrogating his harp, Red and company learn that an incarcerated Boingo the Bunny (Andy Dick) has been having specific ingredients sent to Verushka, (who was also at the prison and narrowly escapes the team.)", "Red and Wolf argue over who let her get away and the team split up.", "Meanwhile, Verushka, who stole the truffle recipe, tries to force Granny into making it for her.", "Granny escapes and finds Hansel and Gretel, but learns that they are actually the masterminds behind the plot.", "Granny is recaptured and learns that Verushka was an old classmate of hers when they were both in training with the Sisters of the Hood; Verushka was always second best behind Granny's accomplishments and grew jealous of her and teamed up with Hansel and Gretel to get revenge." ] ], "gold": "Hoodwinked! (alternatively styled Hoodwinked) is a 2005 American computer-animated musical comedy thriller film. It retells the folktale Little Red Riding Hood as a police investigation, using backstories to show multiple characters' points of view. In the film, Boingo the rabbit was voiced by Andy Dick. Dick reprised his role as Boingo in Hoodwinked Too! Hood vs. Evil.", "prediction 1": "In the 2005 American computer-animated comedy film Hoodwinked, the rabbit is voiced by Andy Dick.", "prediction 2": "Hoodwinked! is a 2005 American computer-animated family comedy film based on the story Little Red Riding Hood and uses flashbacks to show multiple characters' points of view. In the film Andy Dick does the voice of the rabbit, Boingo, the piglet who is being held by the Goody Bandit.", "prediction 3": "Hoodwinked! is a 2005 American computer-animated family comedy film. It retells the folktale \"Little Red Riding Hood\" as a police investigation, using flashbacks to show multiple characters' points of view. Andy Dick voices the rabbit in the film, while Hayden Panettiere voices the rabbit in the original TV series A Christmas Story.", "prediction 4": "Hoodwinked is a 2005 American computer-animated family comedy film based on the folktale \"Little Red Riding Hood\" about a family trying to save their grandma from a villain known as the Goody Bandit. In the film, Andy Dick voices the bunny Boingo the Bunny, who is incarcerated after stealing Granny's recipes.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Hoodwinked! (alternatively styled Hoodwinked) is a 2005 American computer-animated comedy film. It retells the folktale \"Little Red Riding Hood\" as a police investigation, using flashbacks to show multiple characters' points of view. In the film, the rabbit is voiced by Andy Dick." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When did make it or break it come out?", "passages": [ [ "Make It or Break It", "Make It or Break It\n\nMake It or Break It ( \"MIOBI)\" is an American teen/family comedy-drama television series that focused on the lives of teen gymnasts who strived to make it to the Olympic Games.", "The series was inspired by Touchstone's 2006 teen comedy-drama film \"Stick It\".", "It premiered on ABC Family on June 22, 2009, with 2.5 million viewers.", "The show was picked up for an additional 10 episodes on July 27, 2009, which started airing on January 4, 2010, bringing the total number of episodes in the first season to 20.", "In January 2010, the show was renewed for a second season, which premiered on June 28, 2010 at 10 pm.", "Starting on July 13, 2010, new episodes aired following \"Pretty Little Liars\".", "The show's second season resumed after a six-month hiatus on March 28, 2011.", "The series was renewed for a third season on September 16, 2011, which premiered on March 26, 2012.", "It was announced on April 26, 2012, that the series had ended and the third season would be the final season.", "The series finale aired on May 14, 2012." ], [ "Make It or Break It", "The season three finale culminates with the five girls, Payson, Lauren, Kaylie, plus Jordan, and finally Colleen, being chosen to represent the U.S. in the Olympics.", "The following is a table with the average estimated number of viewers per episode, each season of \"Make It or Break It\" on ABC Family.", "Walt Disney Studios Home Entertainment released the first ten episodes in a set entitled \"Make It or Break It \u2013 Volume 1: Extended Edition\".", "Bonus material includes deleted scenes, the never-before-seen extended finale, and the featurette, \"Making It\", which shows how the stars manage the acting with the difficult stunts they do." ] ], "gold": "Teen comedy-drama television series Make It or Break It aired on ABC Family for three seasons from June 22, 2009 \u2013 May 14, 2012. The series focused on the lives of teen gymnasts who strived to make it to the Olympic Games in 2012, and ended with several of characters being selected to represent the United States.", "prediction 1": "Make It or Break It is an American teen/family comedy-drama television series that focused on the lives of teen gymnasts who strive to make it to the Olympic Games. It premiered on ABC Family on June 22, 2009, with 2.5 million viewers. It was picked up for an additional 10 episodes on July 27, 2009, which started airing on January 4, 2010, bringing the total number of episodes in the first season to 20. In January 2010, the show was renewed for a second season, which premiered on June 28, 2010 at 10 pm.", "prediction 2": "Make It or Break It is an American teen comedy-drama television series that focused on the lives of teen gymnasts who strived to make it to the Olympic Games. The series premiered on ABC Family on June 22, 2009, with 2.5 million viewers. It was picked up for an additional 10 episodes on July 27, 2009, which started airing on January 4, 2010.", "prediction 3": "Make It or Break It is an American teen comedy-drama television series that focused on the lives of teen gymnasts who strived to make it to the Olympic Games. It premiered on ABC Family on June 22, 2009 and was picked up for an additional 10 episodes on July 27, 2009. The first season's final episode came out on May 14, 2012.", "prediction 4": "Make It or Break It is an American teen comedy-drama television series that focused on the lives of teen gymnasts who strive to make it to the Olympic Games. Made for ABC Family, it came out on June 22, 2009, with 2.5 million viewers. The first ten episodes were released as a set entitled Make It or Break It \u2013 Volume 1: Extended Edition.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 235 }, { "error type": "Irrelevant", "explanation": "", "start": 407, "end": 508 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 406 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Make It or Break It is an American teen/family comedy-drama television series. It premiered on ABC Family for three seasons from June 22, 2009 \u2013 May 14, 2012. The series focused on the lives of teen gymnasts who strived to make it to the Olympic Games, and culminates with several of characters being chosen to represent the U.S. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who wrote the book of philippians in the bible?", "passages": [ [ "Epistle to the Philippians", "Epistle to the Philippians\n\nThe Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament.", "Paul and Silas first visited Philippi in Greece during Paul's second missionary journey, which occurred between approximately 49 and 51 AD.", "Philippi was the location of the first Christian community established in Europe.", "Biblical scholars are in general agreement that the letter was indeed written by Paul of Tarsus.", "Although some consider that the letter was written from Ephesus in 52\u201355 AD or Caesarea Maritima in 57\u201359, the most likely city of provenance was Rome, which would make the date of the letter around 62 AD, about 10 years after Paul's first visit to Philippi.", "The historical background of Philippians is traditionally gathered from two main primary New Testament sources: informative internal data from the letter itself, and related information garnered from the rest of the New Testament Canon, especially from the Acts of the Apostles and the other Pauline Epistles.", "Other primary information is also derived from external historical sources related to the chronological connections between Paul's association with Philippi, its political and economic setting, and its social and religio-philosophical context." ], [ "Paul the Apostle", "Paul the Apostle\n\nPaul the Apostle (; ; ; c. 5\u00a0\u2013 c. 64 or 67), commonly known as Saint Paul and also known by his Jewish name Saul of Tarsus (; ), was an apostle (though not one of the Twelve Apostles) who taught the gospel of Christ to the first-century world.", "Paul is generally considered one of the most important figures of the Apostolic Age and in the mid-30s to the mid-50s AD he founded several churches in Asia Minor and Europe.", "He took advantage of his status as both a Jew and a Roman citizen to minister to both Jewish and Roman audiences.", "According to writings in the New Testament and prior to his conversion, Paul was dedicated to persecuting the early disciples of Jesus in the area of Jerusalem.", "In the narrative of the Acts of the Apostles (often referred to simply as Acts), Paul was traveling on the road from Jerusalem to Damascus on a mission to \"arrest them and bring them back to Jerusalem\" when the resurrected Jesus appeared to him in a great light.", "He was struck blind, but after three days his sight was restored by Ananias of Damascus and Paul began to preach that Jesus of Nazareth is the Jewish Messiah and the Son of God.", "Approximately half of the book of Acts deals with Paul's life and works." ], [ "Saint Timothy", "Saint Timothy\n\nTimothy (Greek: ; \"Tim\u00f3theos\", meaning \"honouring God\" or \"honoured by God\") was an early Christian evangelist and the first first-century Christian bishop of Ephesus, who tradition relates died around the year AD 97.", "Timothy was from the Lycaonian city of Lystra in Asia Minor, born of a Jewish mother who had become a Christian believer, and a Greek father.", "The Apostle Paul met him during his second missionary journey and he became Paul\u2019s companion and co-worker along with Silas.", "The New Testament indicates that Timothy traveled with Saint Paul, who was also his mentor.", "Paul entrusted him with important assignments.", "He is addressed as the recipient of the First and Second Epistles to Timothy.", "Timothy was a native of Lystra in Lycaonia (Anatolia).", "When Paul and Barnabas first visited Lystra, Paul healed one crippled from birth, leading many of the inhabitants to accept his teaching.", "When he returned a few years later with Silas, Timothy was already a respected member of the Christian congregation, as were his grandmother Lois and his mother Eunice, both Jews.", "In , his mother and grandmother are noted as eminent for their piety and faith.", "Timothy is said to have been acquainted with the Scriptures since childhood." ] ], "gold": "The Epistle to the Philippians, commonly referred to as Philippians, is a Pauline epistle of the New Testament of the Christian Bible. The epistle is attributed to Paul the Apostle, commonly known as Saint Paul and also known by his Hebrew name Saul of Tarsus, and a co-author named Timothy, from the Lycaonian city of Lystra, and is addressed to the Christian church in Philippi.", "prediction 1": "The Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament. Biblical scholars are in general agreement that the letter was indeed written by Paul of Tarsus. Paul and Silas first visited Philippi in Greece during Paul's second missionary journey, which occurred between approximately 49 and 51 AD. Paul and Silas became acquainted with the Scriptures since childhood.", "prediction 2": "The Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament. Biblical scholars agree that the letter was indeed written by Paul of Tarsus. Although some consider that the letter was written from Ephesus in 52\u201355 AD or Caesarea Maritima in 57\u201359, the most likely city of provenance was Rome, which would make the date of the letter around 62 AD, about 10 years after Paul's first visit to Philippi.", "prediction 3": "The Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament. The Epistle of Paul to the Philippians was written in the second half of the first century by Paul and Silas, who visited Philippi in Greece during Paul's second missionary journey. Although some consider that the letter was written from Ephesus in 52\u201355 AD or Caesarea Maritima in 57\u201359, the most likely city of provenance was Rome, which would make the date of provenance was Rome, approximately 10 years after Paul's first visit to Philippi. The Epistle of Paul of Tarsus was an apostle (though not one of the Twelve Apostle) who taught the gospel of Christ to the first-century world.", "prediction 4": "The Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament. Biblical scholars are in general agreement that the letter was indeed written by Paul of Tarsus. Several scholars have suggested that the letter was written elsewhere, but Biblical scholars agree that it was written by Paul of Tarsus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 430 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Epistle of Paul to the Philippians, often referred to simply as Philippians, is the eleventh book in the New Testament. Biblical scholars are in general agreement that the letter was indeed written by Paul of Tarsus, commonly known as Saint Paul and also known by his Hebrew name Saul of Tarsus." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where is tunisia football team ranked in the world?", "passages": [ [ "Tunisia at the FIFA World Cup", "Tunisia at the FIFA World Cup\n\nThe FIFA World Cup, sometimes called the Football World Cup or the Soccer World Cup, but usually referred to simply as the World Cup, is an international association football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the first tournament in 1930, except in 1942 and 1946, due to World War II.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the Finals, is used to determine which teams qualify for the Finals.", "The current format of the Finals involves 32 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1 million people watching the 2006 tournament final.", "Tunisia have appeared in the finals of the FIFA World Cup on five occasions, the first being at the 1978 FIFA World Cup where they finished in ninth position.", "Between 1998 and 2006 they had a streak of three World Cup qualifications.", "They have made their fifth appearance at the finals in the 2018 FIFA World Cup in Russia." ], [ "Tunisia national football team", "Georges Leekens was appointed coach in early 2014 to try and revive the team's fortunes.", "Early results were positive, including a (1-1) draw against Colombia and a 1-0 win over South Korea, both in friendly matches.", "Under Leekens, the team climbed from 49th to 22nd in few months in the FIFA rankings so the team regained its continental luster.", "Tunisia qualified for the 2015 African Cup of Nations and finished top of their group, but were eliminated in the quarter-finals after a controversial 2-1 defeat to Equatorial Guinea.", "In July 2015, Henryk Kasperczak returned as coach after 17 years, but was sacked after yet another quarter-final defeat at the 2017 Africa Cup of Nations, this time 2-0 against Burkina Faso despite the good start in the World Cup qualification.", "On 27 April 2017, Nabil Ma\u00e2loul returned as coach and succeeded in bringing his team back to the 2018 FIFA World Cup for the first time since 2006.", "Tunisia's qualification for the 2018 FIFA World Cup and its positive results in the friendlies against Iran and Costa Rica led to its rise to 14th place in the FIFA World Rankings for the first time ever, after being first in African teams and surpassing teams like Italy and Netherlands." ] ], "gold": "Tunisia's men's football team is ranked 27 in the world, and their women's football team is ranked 78.", "prediction 1": "The Tunisian national football team has appeared in the finals of the FIFA World Cup on five occasions, the first being at the 1978 FIFA World Cup where they finished in ninth position. The team climbed from 49th to 22nd in the FIFA rankings in few months as it regained its continental luster. Tunisia's qualification for the 2018 FIFA World Cup and its positive results in the friendlies against Iran and Costa Rica led to its rise to 14th place in the FIFA World Rankings for the first time ever.", "prediction 2": "Tunisia football team is ranked 14th in the FIFA World Rankings. Their team has appeared in the finals of the FIFA World Cup on five occasions, the first being at the 1978 FIFA World Cup where they finished in ninth position. In the 2018 FIFA World Cup, Tunisia qualified for the finals after finishing top of their group but were eliminated in the quarter-finals after a controversial 2-1 defeat to Equatorial Guinea.", "prediction 3": "Tunisia's football team has appeared in the final five times of the FIFA World Cup, the first being at the 1978 FIFA World Cup where they finished in ninth position. They have made their fifth appearance at the finals in the 2018 FIFA World Cup in Russia.", "prediction 4": "The Tunisia national football team has appeared at five FIFA World Cup finals. They finished in ninth place at the 1978 FIFA World Cup. In the 2018 FIFA World Rankings the Tunisia football team ranked 14th.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 185 } ], "missing-info": [], "corrected-prediction": "The Tunisian national football team climbed from 49th to 22nd in the FIFA rankings in few months as it regained its continental luster. Tunisia's qualification for the 2018 FIFA World Cup and its positive results in the friendlies against Iran and Costa Rica led to its rise to 14th place in the FIFA World Rankings for the first time ever." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who played in the nfc championship game last year?", "passages": [ [ "History of the Washington Redskins", "History of the Washington Redskins\n\nThe Washington Redskins have played over 1,000 games.", "In those games, the club has won five professional American football championships including two NFL Championships and three Super Bowls.", "The franchise has also captured 15 NFL divisional titles and five NFC championships.", "The Redskins won the 1937 and 1942 Championship games, as well as Super Bowl XVII, XXII, and XXVI.", "They also played in and lost the 1936, 1940, 1943, and 1945 Championship games, as well as Super Bowl VII and XVIII.", "They have made 24 postseason appearances, and have an overall postseason record of 23 wins and 19 losses.", "Only five teams have appeared in more Super Bowls than the Redskins: the New England Patriots (nine), Dallas Cowboys (eight), Pittsburgh Steelers (eight), Denver Broncos (eight), and the San Francisco 49ers (six); the Redskins\u2019 five appearances are tied with the Oakland Raiders, Miami Dolphins, New York Giants, and Green Bay Packers.", "All of the Redskins\u2019 league titles were attained during two ten-year spans.", "From 1936 to 1945, the Redskins went to the NFL Championship six times, winning two of them.", "The second period lasted between 1982 and 1991 where the Redskins appeared in the postseason seven times, captured four Conference titles, and won three Super Bowls out of four appearances in that time frame.", "The Redskins have also experienced failure in their history." ] ], "gold": "The 2015 NFC championship game was won by the Carolina Panthers over the Arizona Cardinals. The 2016 NFC championship was won by Atlanta Falcons over Green Bay Packers. And the Philadelphia Eagles won over Minnesota Vikings in the 2017 championship game. The 2018 NFC championship game was won by the Los Angeles Rams over the New Orleans Saints. San Fransisco 49ers won the 2019 championship over the Green Bay Packers, and the 2020 championship game was Tampa Bay Buccaneers over Green Bay Packers.", "prediction 1": "The Washington Redskins have played over 1,000 games. In those games, the club has won five professional American football championships including two NFL Championships and three Super Bowls. From 1936 to 1945 the Redskins went to the NFC Championship six times, winning two of them. From 1940 to 1945 the Redskins went to the NFL Championship six times, winning two of them.", "prediction 2": "The Washington Redskins have played over 1,000 games. During that time, the club has won five professional American football championships including two NFL Championships and three Super Bowls. Last year, the 49ers played in the nfc championship game against the Philadelphia Eagles. In 2016, the New York Giants played in the nfc championship game against the Baltimore Ravens.", "prediction 3": "The Washington Redskins have played over 1,000 games and have won five professional American football championships including two NFL Championships and three Super Bowls. From 1936 to 1945, they went to the NFC Championship six times, winning two of them. The team that played in the nfc championship game in 2015 was the Dallas Cowboys.", "prediction 4": "The Redskins participated in the nfc championship game last year, playing with the New York Jets and the New England Patriots. The New York Giants and the San Francisco 49ers also played in the game last year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 53 }, { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 283 }, { "error type": "Redundant", "explanation": "From 1936 to 1945 the Redskins went to the NFC Championship six times, winning two of them. ", "start": 284, "end": 375 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "How many jury members in a criminal trial?", "passages": [ [ "Jury", "A trial without a jury (in which both questions of fact and questions of law are decided by a judge) is known as a bench trial.", "The \"petit jury\" (or \"trial jury\", sometimes \"petty jury\") hears the evidence in a trial as presented by both the plaintiff (petitioner) and the defendant (respondent).", "After hearing the evidence and often jury instructions from the judge, the group retires for deliberation, to consider a verdict.", "The majority required for a verdict varies.", "In some cases it must be unanimous, while in other jurisdictions it may be a majority or supermajority.", "A jury that is unable to come to a verdict is referred to as a hung jury.", "The size of the jury varies; in criminal cases involving serious felonies there are usually 12 jurors.", "In civil cases many trials require fewer than twelve jurors.", "A grand jury, a type of jury now confined almost exclusively to federal courts and some state jurisdictions in the United States, determines whether there is enough evidence for a criminal trial to go forward.", "Grand juries carry out this duty by examining evidence presented to them by a prosecutor and issuing indictments, or by investigating alleged crimes and issuing .", "A grand jury is traditionally larger than and distinguishable from the petit jury used during a trial, usually with 12 jurors." ], [ "Jury", "In \"Williams v. Florida\", , the Supreme Court of the United States ruled that a Florida state jury of six was sufficient, that \"the 12-man panel is not a necessary ingredient of \"trial by jury,\" and that respondent's refusal to impanel more than the six members provided for by Florida law \"did not violate petitioner's Sixth Amendment rights as applied to the States through the Fourteenth.\"", "In \"Ballew v. Georgia\", , the Supreme Court ruled that the number of jurors could not be reduced below six.", "In \"Brownlee v The Queen\" (2001) 207 CLR 278, the High Court of Australia unanimously held that a jury of 12 members was not an essential feature of \"trial by jury\" in section 80 of the Australian Constitution.", "In Scotland, a jury in a criminal trial consists of 15 jurors, which is thought to be the largest in the world.", "In 2009 a review by the Scottish Government regarding the possibility of reduction led to the decision to retain 15 jurors, with the Cabinet Secretary for Justice stating that after extensive consultation, he had decided that Scotland had got it \"uniquely right\".", "Trials in the Republic of Ireland which are scheduled to last over 2 months can, but do not have to, have 15 jurors." ], [ "Jury", "Its aim was to prevent middle-class citizens from evading their responsibilities by financially putting into question the neutrality of the under-sheriff, the official entrusted with impaneling juries.", "Prior to the Act, the main means of ensuring impartiality was by allowing legal challenges to the sheriff's choices.", "The new provisions did not specifically aim at establishing impartiality but had the effect of reinforcing the authority of the jury by guaranteeing impartiality at the point of selection.", "The example of early 18th century England legal reform shows how civic lotteries can be used to organize the duties and responsibilities of the citizen body in relation to the state.", "It established the impartiality and neutrality of juries as well as reiterating the dual nature of the citizen-state relationship.", "The need for a leader/organizer in a jury is very important, in order to get a proper and agreed verdict.", "The size of the jury is to provide a \"cross-section\" of the public." ] ], "gold": "The \"petit jury\", or \"trial jury\", sometimes \"petty jury\", hears the evidence in a trial as presented by both the plaintiff (petitioner) and the defendant (respondent). The size of the jury is to provide a \"cross-section\" of the public. The size of the jury varies; in criminal cases involving serious felonies there are usually 12 jurors. In Williams v. Florida, 399 U.S. 78 (1970), the Supreme Court of the United States ruled that a Florida state jury of 6 was sufficient. In Scotland, a jury in a criminal trial consists of 15 jurors, which is thought to be the largest in the world. Trials in the Republic of Ireland which are scheduled to last over 2 months can, but do not have to, have 15 jurors. In England and Wales during the Second World War, the Administration of Justice (Emergency Provisions) Act 1939 authorized trials with only 7 jurors, except for treason or murder.", "prediction 1": "The size of the jury varies. In criminal cases involving serious felonies there are usually 12 jurors. In civil cases many trials require fewer than 12 jurors. In Scotland, a jury in a criminal trial consists of 15 jurors, which is thought to be the largest in the world.", "prediction 2": "In the United States, a jury in a criminal trial is normally composed of 6 members, while in Scotland, a jury in a criminal trial consists of 15 jurors, which is thought to be the largest jury in the world.", "prediction 3": "In most countries, a jury consists of 12 members, but in Scotland, a jury in a criminal trial consists of 15 members, which is thought to be the largest jury in the world. There are two types of jury, the petit jury and the trial jury. In the US, there are 6 jurors in a criminal trial, with 5 in a misdemeanor trial.", "prediction 4": "In the United States, the jury size varies from state to state. In Scotland, the jury size is 15 and is thought to be the largest in the world.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 159 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The \"petit jury\" (or \"trial jury\", sometimes \"petty jury\") hears the evidence in a trial as presented by both the plaintiff (petitioner) and the defendant (respondent). The size of the jury is to provide a \"cross-section\" of the public. The size of the jury varies. In criminal cases involving serious felonies there are usually 12 jurors. In Scotland, a jury in a criminal trial consists of 15 jurors, which is thought to be the largest in the world. Trials in the Republic of Ireland which are scheduled to last over 2 months can, but do not have to, have 15 jurors." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who played luna on the big comfy couch?", "passages": [ [ "The Big Comfy Couch", "Radical Sheep Productions and Amity Entertainment, in association with Treehouse TV and Nashville Public Television, produced 22 additional episodes, which debuted on American Public Television in 2006.", "Loonette is the lead character, portrayed by Alyson Court from 1992 to 2002 and Ramona Gilmour-Darling in 2006.", "She is a young clown living with her doll, Molly, in their house, on the eponymous Big Comfy Couch, an oversized green couch with flower patterns on it.", "She wears a pink (briefly red in seasons 5-6) jumpsuit and a pink shirt with yellow clown suns and moons with purple sleeves.", "She also wears a purple hat on her head with her pigtails sticking out and wears black and white stockings with black shoes with clown sun straps on her feet.", "She frequently reads stories to Molly, always performs a Clock Rug Stretch, and likes to visit Granny Garbanzo.", "Auntie Macassar or Uncle Chester frequently send Loonette postcards which Major Bedhead delivers on his unicycle.", "Her parents were never seen or mentioned although it was implied in \u201cWhere Do Clowns Come From?\u201d that she was adopted by Granny, Auntie Macassar, and Uncle Chester after the event of the \u201cSecret Circus\u201d and Fool Moon.", "Loonette is gifted in the art of classical dance and runs Miss Loonette's Dance Academy." ], [ "The Big Comfy Couch", "The Big Comfy Couch\n\nThe Big Comfy Couch is a Canadian comedy children's television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch.", "It aired from March 2, 1992 until December 29, 2006.", "It was produced by Cheryl Wagner and Robert Mills, directed by Wayne Moss, Robert Mills and Steve Wright.", "It premiered on March 2, 1992 in Canada and on January 9, 1995 in the United States on public television stations across the country.", "Each episode contains several common elements that take place throughout the episode.", "Early in each show, Loonette performs an exercise routine she calls the Clock Rug Stretch, and toward the end, she asks, \"WHO made this BIG MESS?!\"", "and she performs a high-speed clean-up routine called the Ten-Second Tidy.", "Other oft-repeated elements include reading a story to Molly, who sometimes either chooses a story to hear, gives Loonette a book and oversized glasses, or turning on the lights for Loonette; encounters with the dust bunnies who live under the couch; visits to various places in Clowntown, songs that emphasize the episode's lessons or themes, and a trip to Granny Garbanzo's garden and house." ] ], "gold": "The Big Comfy Couch is a Canadian children's television series, which is about a clown named Loonette and her doll Molly who solve everyday problems on their eponymous couch. It aired from March 2, 1992, until December 29, 2006. Loonette is the hostess of the series, portrayed by Alyson Court from 1992 to 2002 and Ramona Gilmour-Darling in 2006.", "prediction 1": "The Big Comfy Couch is a Canadian comedy children's television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch. From 1992 to 2002, Alyson Court played Loonette, and Ramona Gilmour-Darling played Loonette from 2002 to 2006.\n", "prediction 2": "The Big Comfy Couch is a Canadian children's television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch. From 1992 to 2002, Alyson Court and Ramona Gilmour Darling played Loonette.", "prediction 3": "The Big Comfy Couch is a Canadian children's comedy children's television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch. Loonette was played by Alyson Court from 1992 to 2002, and Ramona Gilmour-Darling from 2006 to 2007. There were also several comedic outtakes.", "prediction 4": "The Big Comfy Couch is a Canadian children's comedy television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch. From 1992 to 2006, Alyson Court played Loonette and Ramona Gilmour-Darling played Luna.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Big Comfy Couch is a Canadian comedy children's television series about Loonette and Molly a Clown and her Dolly, who solve everyday problems on their Big Comfy Couch. It aired from March 2, 1992 until December 29, 2006. From 1992 to 2002, Alyson Court played Loonette, and Ramona Gilmour-Darling played Loonette from 2002 to 2006.\n" }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who is lion of judah in the bible?", "passages": [ [ "Lion of Judah", "Lion of Judah\n\nThe Lion of Judah ( \"Aryeh Yehudah\") is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah.", "According to the Torah, the tribe consists of the descendants of Judah, the fourth son of Jacob.", "The association between Judah and the lion can first be found in the blessing given by Jacob to his son Judah in the Book of Genesis.", "The Lion of Judah is also mentioned in the Book of Revelation, as a term representing Jesus, according to Christian theology.", "The lion of Judah was also one of the titles of the Solomonic Emperors of Ethiopia.", "It was depicted on a map of the Upper Nile published in 1683 by the Italian Jobi Ludolfi describing the Lion of Judah symbol as the Royal Insignia of the Ethiopian empire.", "The Solomonic dynasty of Ethiopia lasted three thousand years according and has its patrilineal origin in the Israelite Royal House of Judah.", "The Lion of Judah served as the hereditary title of the Solomonic Ethiopian emperors including Menelik and Haile Selassie and was depicted on the flag of Ethiopia from 1897 to 1974.", "Due to its association with Haile Selassie, it continues to be an important symbol among members of the Rastafari movement." ], [ "Lion of Judah", "The biblical Judah (in Hebrew: \"Yehuda\") is the eponymous ancestor of the Tribe of Judah, which is traditionally symbolized by a lion.", "In Genesis, the patriarch Jacob (\"Israel\") gave that symbol to this tribe when he refers to his son Judah as a \"Gur Aryeh\" \u05d2\u05bc\u05d5\u05bc\u05e8 \u05d0\u05b7\u05e8\u05b0\u05d9\u05b5\u05d4 \u05d9\u05b0\u05d4\u05d5\u05bc\u05d3\u05b8\u05d4, \"Young Lion\" (Genesis 49:9) when blessing him.", "In Jewish naming tradition the Hebrew name and the substitute name are often combined as a pair, as in this case.", "The Lion of Judah was used as a Jewish symbol for many years, and as Jerusalem was the capital of the Kingdom of Judah, in 1950 it was included in the Emblem of Jerusalem.", "Ethiopia's history as recorded and elaborated in a 13th-century treatise, the \"Kebre Negest\", asserts descent from a retinue of Israelites who returned with Makeda, the Queen of Sheba from her visit to King Solomon in Jerusalem, by whom she had conceived the Solomonic dynasty's founder Menelik I. As Solomon was of the tribe of Judah, his son Menelik I would continue the line, which according to Ethiopian history was passed directly down from king to king until Emperor Haile Selassie I (ostensibly the 225th king from King David) was deposed in 1974." ] ], "gold": "The Lion of Judah, \"Aryeh Yehudah,\" is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah. According to the Torah, the tribe consists of the descendants of Judah, the fourth son of Jacob. The biblical Judah is the eponymous ancestor of the Tribe of Judah, which is traditionally symbolized by a lion. In Genesis, the patriarch Jacob gave that symbol to this tribe when he refers to his son Judah as a \"Young Lion\" (Genesis 49:9) when blessing him.", "prediction 1": "The lion of Judah is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah, the eponymous ancestor of the Tribe of Judah, traditionally symbolized by a lion. The Lion of Judah is also mentioned in the Book of Revelation, as a term representing Jesus, according to Christian theology. The Lion of Judah served as the hereditary title of the Solomonic Ethiopian emperors including Menelik and Haile Selassie Selassie.", "prediction 2": "The Lion of Judah is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah. According to the Torah, the tribe consists of the descendants of Judah, the fourth son of Jacob. The association between Judah and the lion can first be found in the blessing given by Jacob to his son Judah in the Book of Genesis. The Lion of Judah is also mentioned in the Book of Revelation, as a term representing Jesus, according to Christian theology.", "prediction 3": "The Hebrew name of the tribe of Judah, \"Judah\", is \"Gur Aryeh Yehudah.\" The lion is regarded as the national and cultural symbol of the Ethiopian emperors Menelik and Haile Selassie.", "prediction 4": "The Lion of Judah is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah. According to the Torah, the tribe consists of the descendants of Judah, the fourth son of Jacob. The Lion of Judah is also mentioned in the Book of Revelation, as a term representing Jesus, according to Christian theology.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 469 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The lion of Judah is a Jewish national and cultural symbol, traditionally regarded as the symbol of the Israelite tribe of Judah, the eponymous ancestor of the Tribe of Judah, traditionally symbolized by a lion. According to the Torah, the tribe consists of the descendants of Judah, the fourth son of Jacob. In Genesis, the patriarch Jacob gave that symbol to this tribe when he refers to his son Judah as a \"Young Lion\" (Genesis 49:9) when blessing him. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "When did rolls royce start making jet engines?", "passages": [ [ "Rolls-Royce Limited", "Rolls-Royce Limited\n\nRolls-Royce was a British luxury car and later an aero engine manufacturing business established in 1904 by the partnership of Charles Rolls and Henry Royce.", "Building on Royce's reputation established with his cranes they quickly developed a reputation for superior engineering by manufacturing the \"best car in the world\".", "The First World War brought them into manufacturing aero engines.", "Joint development of jet engines began in 1940 and they entered production.", "Rolls-Royce has built an enduring reputation for development and manufacture of engines for defence and civil aircraft.", "In the late 1960s Rolls-Royce became hopelessly crippled by its mismanagement of development of its advanced RB211 jet engine and the consequent cost over-runs, though it ultimately proved a great success.", "In 1971 the owners were obliged to liquidate their business.", "The useful portions were bought by a new government-owned company named Rolls-Royce (1971) Limited which continued the core business but sold the holdings in British Aircraft Corporation (BAC) almost immediately and transferred ownership of the profitable but now financially insignificant car division to Rolls-Royce Motors Holdings Limited.", "This it sold to Vickers in 1980.", "Rolls-Royce obtained consent to drop 1971 from its name in 1977.", "The Rolls-Royce business remained nationalised until 1987 when, renaming the owner Rolls-Royce plc, the government sold it to the public." ], [ "Rolls-Royce Limited", "However, this position was quickly reversed and Rolls-Royce was persuaded by the War Office to manufacture fifty air-cooled V8 engines under licence from Renault.", "Meanwhile, the Royal Aircraft Factory asked Rolls-Royce to design a new engine.", "Despite initial reluctance they agreed, and during 1915 developed Rolls-Royce's first aero engine, the twelve-cylinder Eagle.", "This was quickly followed by the smaller six-cylinder Hawk, the Falcon and, just before the end of the war, the larger Condor.", "Throughout World War I, Rolls-Royce struggled to build aero engines in the quantities required by the War Office.", "However, with the exception of Brazil Straker in Bristol Rolls-Royce resisted pressure to license production to other manufacturers, fearing that the engines' much admired quality and reliability would risk being compromised.", "Instead the Derby factory was extended to enable Rolls-Royce to increase its own production rates.", "By the late 1920s, aero engines made up most of Rolls-Royce's business.", "Henry Royce's last design was the Merlin aero engine, which was first flown in prototype form in 1935, although he had died in 1933.", "This was developed from the R engine, which had powered a record-breaking Supermarine S.6B seaplane to almost in the 1931 Schneider Trophy." ], [ "Rolls-Royce Limited", "It is now Bentley Crewe\n\nIn 1940 a contract was signed with the Packard Motor Car Company in Detroit, Michigan, for the production of Merlin aero engines in the USA.", "Production focussed on aero engines but a variant of the Merlin engine, known as the Meteor, was developed for the Cromwell tank.", "The Meteor's development completed in 1943 the same team at the Belper foundry restarted work on an eight-cylinder car engine widening its uses and it became the pattern for the British Army's B range of petrol engines for post war combat vehicles in particular in Alvis's FV600 range, Daimler's Ferret, Humber's Hornet and Pig and Austin's Champ.", "After the war, in 1946, Rolls-Royce and Bentley car production moved to Crewe where they began to assemble complete Bentley cars with body pressings made by Pressed Steel Company.", "Previously they had built only the chassis, leaving the bodies to specialist coach-builders.", "In 1939 Rolls-Royce brought one of the specialist coachbuilders completely in-house by buying the remaining capital of Park Ward Limited which since 1936 in conjunction with Rolls-Royce had been building short production runs of all-metal saloon bodies on Bentley chassis.", "In 1959 Rolls-Royce bought coachbuilder H J Mulliner and the two businesses were put together as H J Mulliner Park Ward." ] ], "gold": "When World War I broke out in August 1914, Rolls-Royce initially decided not to seek government work making aero enginesinitially decided not to seek government work making aero engines but soon changed their minds and during 1915, developed Rolls-Royce's first aero engine, the twelve-cylinder\u00a0Eagle. In 1940, a contract was signed with the\u00a0Packard Motor Car Company\u00a0in Detroit, Michigan, for the production of Merlin aero-engines for\u00a0World War II\u00a0in the USA.There was also joint development of jet engines.", "prediction 1": "Rolls-Royce was a British luxury car and later an aero engine manufacturing business established in 1904 by the partnership of Charles Rolls and Henry Royce. Joint development of jet engines began in 1940 and they entered production. Rolls-Royce has built an enduring reputation for development and manufacture of engines for defence and civil aircraft. In the late 1960s Rolls-Royce became hopelessly crippled by its mismanagement of development of its advanced RB211 jet engine and the consequent cost over-runs, though it ultimately proved a great success.", "prediction 2": "In 1940, Rolls-Royce began joint development of jet engines. The company entered production in 1940. Throughout World War I, Rolls-Royce struggled to build aero engines in the quantities required by the War Office. However, with the exception of Brazil Straker in Bristol Rolls-Royce resisted pressure to license production to other manufacturers, fearing that the engines' much admired quality and reliability would risk being compromised. Instead they extended the Derby factory to enable Rolls-Royce to increase its own production rates.", "prediction 3": "Rolls-Royce was a British luxury car and later an aero engine manufacturing business established in 1904 by the partnership of Charles Rolls and Henry Royce. Joint development of jet engines began in 1940 and they entered production. Rolls-Royce has built an enduring reputation for development and manufacture of engines for defence and civil aircraft. In the late 1960s Rolls-Royce became hopelessly crippled by its mismanagement of development of its advanced RB211 jet engine and the consequent cost over-runs, though it ultimately proved a great success. The company was bought by a new government-owned company named Rolls-Royce Limited.", "prediction 4": "Rolls-Royce was a British luxury car and aero engine manufacturing business established in 1904 by the partnership of Charles Rolls and Henry Royce. Joint development of jet engines began in 1940 and they entered production. Rolls-Royce has built an enduring reputation for development and manufacture of engines for defence and civil aircraft. In the late 1960s Rolls-Royce became hopelessly crippled by its mismanagement of development of its advanced RB211 jet engine and the consequent cost over-runs, though it ultimately proved a great success.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 559 }, { "error type": "Irrelevant", "explanation": "", "start": 12, "end": 157 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Rolls-Royce, despite initial reluctance agreed to the government's request for a new engine and during 1915 developed Rolls-Royce's first aero engine, the twelve-cylinder Eagle. Joint development of jet engines began in 1940 and they entered production, after a contract was signed with the Packard Motor Car Company in Detroit, Michigan, for the production of Merlin aero engines in the USA. " }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "All 5 layers of the earth's atmosphere?", "passages": [ [ "Atmosphere of Earth", "It extends from the exobase, which is located at the top of the thermosphere at an altitude of about 700\u00a0km above sea level, to about 10,000\u00a0km (6,200\u00a0mi; 33,000,000\u00a0ft) where it merges into the solar wind.", "This layer is mainly composed of extremely low densities of hydrogen, helium and several heavier molecules including nitrogen, oxygen and carbon dioxide closer to the exobase.", "The atoms and molecules are so far apart that they can travel hundreds of kilometers without colliding with one another.", "Thus, the exosphere no longer behaves like a gas, and the particles constantly escape into space.", "These free-moving particles follow ballistic trajectories and may migrate in and out of the magnetosphere or the solar wind.", "The exosphere is located too far above Earth for any meteorological phenomena to be possible.", "However, the aurora borealis and aurora australis sometimes occur in the lower part of the exosphere, where they overlap into the thermosphere.", "The exosphere contains most of the satellites orbiting Earth.", "The thermosphere is the second-highest layer of Earth's atmosphere.", "It extends from the mesopause (which separates it from the mesosphere) at an altitude of about up to the thermopause at an altitude range of ." ], [ "Atmosphere of Earth", "Atmosphere of Earth\n\nThe atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity.", "The atmosphere of Earth protects life on Earth by creating pressure allowing for liquid water to exist on the Earth's surface, absorbing ultraviolet solar radiation, warming the surface through heat retention (greenhouse effect), and reducing temperature extremes between day and night (the diurnal temperature variation).", "By volume, dry air contains 78.09% nitrogen, 20.95% oxygen, 0.93% argon, 0.04% carbon dioxide, and small amounts of other gases.", "Air also contains a variable amount of water vapor, on average around 1% at sea level, and 0.4% over the entire atmosphere.", "Air content and atmospheric pressure vary at different layers, and air suitable for use in photosynthesis by terrestrial plants and breathing of terrestrial animals is found only in Earth's troposphere and in artificial atmospheres.", "The atmosphere has a mass of about 5.15\u00a0kg, three quarters of which is within about of the surface.", "The atmosphere becomes thinner and thinner with increasing altitude, with no definite boundary between the atmosphere and outer space.", "The K\u00e1rm\u00e1n line, at , or 1.57% of Earth's radius, is often used as the border between the atmosphere and outer space." ], [ "Atmosphere of Earth", "Various industrial pollutants also may be present as gases or aerosols, such as chlorine (elemental or in compounds), fluorine compounds and elemental mercury vapor.", "Sulfur compounds such as hydrogen sulfide and sulfur dioxide (SO) may be derived from natural sources or from industrial air pollution.", "The relative concentration of gases remains constant until about .", "In general, air pressure and density decrease with altitude in the atmosphere.", "However, temperature has a more complicated profile with altitude, and may remain relatively constant or even increase with altitude in some regions (see the temperature section, below).", "Because the general pattern of the temperature/altitude profile is constant and measurable by means of instrumented balloon soundings, the temperature behavior provides a useful metric to distinguish atmospheric layers.", "In this way, Earth's atmosphere can be divided (called atmospheric stratification) into five main layers.", "Excluding the exosphere, the atmosphere has four primary layers, which are the troposphere, stratosphere, mesosphere, and thermosphere.", "From highest to lowest, the five main layers are:\n\n", "The exosphere is the outermost layer of Earth's atmosphere (i.e. the upper limit of the atmosphere)." ] ], "gold": "The atmosphere of Earth, commonly known as air, is the layer of gases retained by Earth's gravity that surrounds the planet and forms its planetary atmosphere. Earth's atmosphere can be divided into 5 layers according to their altitude: Troposhere, 0-7 miles; Stratosphere, 7-31 miles; Mesosphere, 31-50 miles; Thermosphere, 50-440 miles; and Exosphere, 440-6200 miles. The atmosphere of Earth protects life on Earth by creating pressure allowing for liquid water to exist on the Earth's surface, absorbing ultraviolet solar radiation, warming the surface through heat retention, and reducing temperature extremes between day and night.", "prediction 1": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. Excluding the exosphere, the atmosphere is divided into five main layers. From highest to lowest, the five main layers are: The troposphere, stratosphere, mesosphere, and thermosphere.", "prediction 2": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. The Earth's atmosphere protects life on Earth by creating pressure allowing for liquid water to exist on the Earth's surface, absorbing ultraviolet solar radiation, warming the surface through heat retention (greenhouse effect), and reducing temperature extremes between day and night (the diurnal temperature variation). The exosphere is the outermost layer of Earth's atmosphere, located at a height of about 700 km above sea level, and is located at a height of about 600 a height of about a height of about 700 kilometres above sea level, at an altitude of about 700 kilometer above the mesopause, at an altitude of about 700 km above the thermopause at an altitude range of. The thermosphere is located in the second-highest layer of Earth", "prediction 3": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. The five main layers of the atmosphere are: The troposphere, stratosphere, mesosphere, and thermosphere.", "prediction 4": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. The exosphere is the outermost layer of Earth's atmosphere. The thermosphere is the second highest layer of Earth's atmosphere. It extends from the mesopause (which separates it from the mesosphere) at an altitude of about up to the thermopause at an altitude range of.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The atmosphere of Earth is the layer of gases, commonly known as air, that surrounds the planet Earth and is retained by Earth's gravity. Excluding the exosphere, the atmosphere is divided into five main layers. From highest to lowest, the five main layers are: The troposphere, stratosphere, mesosphere, and thermosphere and Exosphere. The atmosphere of Earth protects life on Earth by creating pressure allowing for liquid water to exist on the Earth's surface, absorbing ultraviolet solar radiation, warming the surface through heat retention, and reducing temperature extremes between day and night." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When does the new set of hearthstone come out?", "passages": [ [ "Hearthstone", "Hearthstone\n\nHearthstone, originally Hearthstone: Heroes of Warcraft, is a free-to-play online collectible card video game developed and published by Blizzard Entertainment.", "Having been released worldwide on March 11, 2014, \"Hearthstone\" builds upon the existing lore of the \"Warcraft\" series by using the same elements, characters, and relics.", "It was first released for Microsoft Windows and macOS, with support for iOS and Android devices being added later.", "The game features cross-platform play, allowing players on any supported device to compete with one another, restricted only by geographical region account limits.", "The game is a turn-based card game between two opponents, using constructed decks of 30 cards along with a selected hero with a unique power.", "Players use their limited mana crystals to play abilities or summon minions to attack the opponent, with the goal of destroying the opponent's hero.", "Winning matches and completing quests earn in-game gold, rewards in the form of new cards, and other in-game prizes.", "Players can then buy packs of new cards through gold or microtransactions to customize and improve their decks.", "The game features several modes of play, including casual and ranked matches, drafted arena battles, and single-player adventures." ] ], "gold": "Hearthstone is a free-to-play online digital collectible card game developed and published by Blizzard Entertainment. Originally subtitled Heroes of Warcraft, Hearthstone builds upon the existing lore of the Warcraft series by using the same elements, characters, and relics. New sets of Hearthstone cards were released in 2015, 2016, and 2017. The following is a list of the dates the new sets were released: in 2015 - April 2, 2015, August 24, 2015, and November 12, 2015; in 2016 - April 26, 2016, August 11, 2016, and December 1, 2016; and in 2017 - April 6, 2017, August 10, 2017, and December 7, 2017.", "prediction 1": "Hearthstone, originally Hearthstone: Heroes of Warcraft, is a free-to-play online collectible card video game developed and published by Blizzard Entertainment that builds upon the existing lore of the Warcraft series by using the same elements, characters, and relics. The game's new set came out on March 11, 2014.", "prediction 2": "Hearthstone is an online multiplayer card game developed and published by Blizzard Entertainment that was released worldwide on March 11, 2014, with a new set of cards coming out every week. The new set of cards for the game was released to retail on March 14, 2014, with the new set of cards coming out every week on March 11, 2015.", "prediction 3": "Hearthstone is a free-to-play online collectible card video game developed and published by Blizzard Entertainment. The new set of Hearthstone came out worldwide on March 11, 2014. The new set of Hearthstone came out in Japan on August 25, 2017, while the new set of Hearthstone came out in the United States on September 25, 2017. The new set of Hearthstone came out in the United States on October 27, 2017.", "prediction 4": "Hearthstone, originally Hearthstone: Heroes of Warcraft, is a free-to-play online collectible card video game developed and published by Blizzard Entertainment. The new set of Hearthstone came out worldwide on March 11, 2014. The new set of Hearthstone came out in the United States on March 16, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 270, "end": 316 } ], "missing-info": [], "corrected-prediction": "Hearthstone, originally Hearthstone: Heroes of Warcraft, is a free-to-play online collectible card video game developed and published by Blizzard Entertainment that builds upon the existing lore of the Warcraft series by using the same elements, characters, and relics. " }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Power rangers spd cast pink ranger real name?", "passages": [ [ "Power Rangers S.P.D.", "Power Rangers S.P.D. Power Rangers S.P.D. is an American television series and the thirteenth season of the \"Power Rangers\" franchise, based on the Super Sentai series, \"Tokusou Sentai Dekaranger\".", "It debuted on February 5, 2005, on ABC Family.", "New episodes continued to debut on ABC Family until the episode \"Messenger, Part 1\".", "Starting with \"Messenger, Part 2\" episodes began to debut on Toon Disney.", "It is also the title for the Korean dub of \"Dekaranger\" in South Korea, whose logo is similar to the American series.", "S.P.D. stands for \"Space Patrol Delta\"; in \"Dekaranger\", it stood for \"Special Police Dekaranger\", and in the South Korean dub of \"Dekaranger\", it stood for \"Special Police Delta\".", "A Japanese dub of \"S.P.D.\" started airing on Toei's digital television channel in Japan starting in August 2011, with two DVD volumes released on August 5.", "It features the original \"Dekaranger\" cast members dubbing over the voices of their American counterparts (with the exception of Mako Ishino, who is the series' narrator rather than voicing her character's counterpart).", "\"Power Rangers S.P.D.\"" ], [ "Power Rangers S.P.D. (video game)", "Power Rangers S.P.D. (video game)\n\nPower Rangers S.P.D. is a side-scrolling beat-em-up video game developed by Natsume and published by THQ for the Game Boy Advance on September 6, 2005.", "It was the sixth \"Power Rangers\" video game to be published by THQ, and also the last.", "Six different rangers are playable, each with their own unique abilities.", "The Red Ranger, has the power to walk through enemies and obstacles, Blue Ranger, creates a force field to block attacks and stop enemies from approaching, Green Ranger, tracks energy signatures to find missing objects, Yellow Ranger, creates three duplicates of herself to triple her attack power, Pink Ranger, turns her hand into iron to punch through walls or eliminate a minor enemy with one hit and finally Shadow Ranger, creates an energy blade that harms several enemies at once.", "The 6 rangers fight minor enemies until they encounter the main boss.", "There are racing levels which involve piloting the Red, Yellow, or Pink Delta Runners, a targeting game (similar to Space Invaders) with the Green Delta Runner, a racing level involving R.I.C. (the Rangers' robotic dog), and Megazord battle levels.", "\"Power Rangers S.P.D.\"" ] ], "gold": "Power Rangers S.P.D. is the thirteenth season of the American television series, Power Rangers, and is based on the 28th Super Sentai series Tokusou Sentai Dekaranger. Sydney \"Syd\" Drew, played by Alycia Purrott, is the S.P.D. Pink Ranger. When unmorphed, her genetic ability allows her to change her hand into any material she needs.", "prediction 1": "Pink Ranger is a fictional character in the Power Rangers television series and the thirteenth season of the Power Rangers franchise, based on the Super Sentai series, Tokusou Sentai Dekaranger. In the Power Rangers video game, the Pink Ranger is actually a reincarnation of her character from the manga of the same name.", "prediction 2": "Power Rangers S.P.D. is an American television series and the thirteenth season of the Power Rangers franchise, based on the Super Sentai series, Tokusou Sentai Dekaranger. Pink Ranger is another one of the six rangers playable in the Power Rangers video game, and her real name is Yukiya Ogawa.", "prediction 3": "Power Rangers S.P.D. is an American television series and the thirteenth season of the Power Rangers franchise, based on the Super Sentai series, Tokusou Sentai Dekaranger. It debuted on February 5, 2005, on ABC Family. The original \"Dekaranger\" cast members dubbing over the voices of their American counterparts (with the exception of Mako Ishino, who is the series' narrator rather than voicing her character's counterpart). The original \"Dekaranger\" cast Pink Ranger, turns her hand into iron to punch through walls or eliminate a minor enemy with one hit and finally, creates an energy blade that harm several enemies at once. The Pink Ranger turns her hand into iron to punch through walls or eliminate a minor enemy with one hit and finally Shadow Ranger, creates an energy blade that harms several enemies at", "prediction 4": "Power Rangers S.P.D. is an American television series and the thirteenth season of the Power Rangers franchise based on the Super Sentai series, Tokusou Sentai Dekaranger which debuted on February 5, 2005, on ABC Family. The character Pink Ranger is played by Ai Haruki Yamazaki in the American series and in the side-scrolling beat-em-up video game Power Rangers S.P.D., with Mako Ishino dubbing over the voices of their respective American counterparts, with the exception of Mako Ishino, who is the series' narrator rather than voicing her counterpart.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 195, "end": 321 } ], "missing-info": [], "corrected-prediction": "Pink Ranger is a fictional character in the Power Rangers television series and the thirteenth season of the Power Rangers franchise, based on the Super Sentai series, Tokusou Sentai Dekaranger. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How much damage did hurricane katrina cause in new orleans?", "passages": [ [ "Effects of Hurricane Katrina in New Orleans", "Effects of Hurricane Katrina in New Orleans\n\nAs the center of Hurricane Katrina passed southeast of New Orleans on August 29, 2005, winds downtown were in the Category\u00a01 range with frequent intense gusts and tidal surge.", "Hurricane-force winds were experienced throughout the city, although the most severe portion of Katrina missed the city, hitting nearby St. Bernard and Plaquemines parishes.", "Hurricane Katrina made its final landfall in eastern St. Tammany Parish.", "The western eye wall passed directly over St. Tammany Parish, Louisiana as a Category 3 hurricane at about 9:45\u00a0am Central Time, August 29, 2005.", "The communities of Slidell, Avery Estates, Lakeshore Estates, Oak Harbor, Eden Isles and Northshore Beach were inundated by the storm surge that extended over six miles inland.", "The storm surge affected all of St. Tammany Parish\u2019s coastline, including Lacombe, Mandeville and Madisonville.", "The storm surge in the area of the Rigolets Pass was estimated to be 16 feet, not including wave action, declining to at Madisonville.", "The surge had a second peak in eastern St. Tammany as the westerly winds from the southern eye wall pushed the surge to the east, backing up at the bottleneck of the Rigolets Pass." ], [ "Effects of Hurricane Katrina in New Orleans", "In the City of New Orleans, the storm surge caused approximately 23 breaches in the drainage canal and navigational canal levees and floodwalls.", "As mandated in the Flood Control Act of 1965, responsibility for the design and construction of the city's levees belongs to the United States Army Corps of Engineers and responsibility for their maintenance belongs to the Orleans Levee Board.", "The failures of levees and floodwalls during Katrina are considered by experts to be the worst engineering disaster in the history of the United States.", "By August 31, 2005, 80% of New Orleans was flooded, with some parts under of water.", "The famous French Quarter and Garden District escaped flooding because those areas are above sea level.", "The major breaches included the 17th Street Canal levee, the Industrial Canal levee, and the London Avenue Canal floodwall.", "These breaches caused the majority of the flooding, according to a June 2007 report by the American Society of Civil Engineers.", "The flood disaster halted oil production and refining which increased oil prices worldwide.", "Between 80 and 90 percent of the residents of New Orleans were evacuated before the hurricane struck, testifying to some of the success of the evacuation measures.", "Despite this, many remained in the city, mainly those who did not have access to personal vehicles or who were isolated from the dissemination of news from the local governments." ], [ "Effects of Hurricane Katrina in New Orleans", "Local television stations, and newspapers moved quickly to sister locations in nearby cities.", "New Orleans CBS-affiliate WWL-TV was the only local station to remain on the air during and after the storm, broadcasting from Baton Rouge.", "Broadcasting and publishing on the Internet became an important means of distributing information to evacuees and the rest of the world, with news networks citing blogs like Interdictor and Gulfsails for reports of what was happening in the city.", "Amateur radio provided tactical and emergency communications and handled health-and-welfare enquiries.", "By September 4, a temporary communications hub was set up at the Hyatt Hotel in downtown New Orleans.", "The first television pictures out of New Orleans shown on national TV were from Houston's ABC owned and operated KTRK which flew its helicopter to New Orleans in the days after the storm.", "Most of the city's major roads were damaged.", "The only route out of the city was east to the east bank of New Orleans on the Crescent City Connection bridge.", "The I-10 Twin Span Bridge traveling east towards Slidell, suffered severe damage; 473 spans were separated from their supports and 64 spans dropped into the lake.", "The long Lake Pontchartrain Causeway escaped unscathed but was only carrying emergency traffic." ] ], "gold": "As the center of Hurricane Katrina passed southeast of New Orleans on August 29, 2005, winds downtown were in the Category 1 range with frequent intense gusts. The storm surge caused approximately 23 breaches in the drainage canal and navigational canal levees and flood walls, and by August 31, 2005, 80% of New Orleans was flooded, with some parts under 15 feet of water. Most of the city's major roads were damaged; the I-10 Twin Span Bridge traveling east towards Slidell suffered severe damage; 473 spans were separated from their supports and 64 spans dropped into the lake. Hurricane Katrina caused about $70 billion (2005 USD) in monetary damage and up to 1,464 total fatalities. ", "prediction 1": "Hurricane Katrina caused approximately 23 breaches in the drainage canal and navigational canal levees and floodwalls in New Orleans, Louisiana. The storm surge affected all of St. Tammany Parish\u2019s coastline, including Lacombe, Mandeville and Madisonville. The 17th Street Canal levee, the Industrial Canal levee, and the London Avenue Canal floodwall all caused significant damage, with 473 spans separated from their supports, and 64 spans dropped into the lake.", "prediction 2": "The damage caused by Hurricane Katrina in New Orleans was estimated at $18 billion, including $2 billion in property damage, $2 billion in property damage, and $5 billion in economic damage.", "prediction 3": "Hurricane Katrina caused approximately 23 breaches in the drainage canal and navigational canal levees and floodwalls in the City of New Orleans. The storm surge affected all of St. Tammany Parish\u2019s coastline, including Lacombe, Mandeville and Madisonville. Between 80 and 90 percent of the residents of New Orleans were evacuated before the hurricane struck, testifying to some of the success of the evacuation measures. Most of the city's major roads were damaged. The I-10 Twin Span Bridge traveling towards Slidell, suffered severe damage. The I-10 Twin Span Bridge traveling towards Slidell suffered severe damage; 473 spans were separated from their supports and 64 spans dropped into the lake. The I-10 Twin Span Bridge traveling towards Slidell, suffered severe damage; 473 spans were separated from their supports and 64 spans dropped into the lake. The I-10 Twin Span Bridge traveling towards Slidell, suffered severe", "prediction 4": "Hurricane Katrina caused significant damage to New Orleans during its path from tropical storm Ike to Category 5 storm. The storm surge caused approximately 23 breaches in the drainage canal and navigational canal levees and floodwalls in the city. The resulting flooding caused damage to a number of public infrastructure, including the I-10 Twin Span Bridge and the Crescent City Connection Bridge.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 256 }, { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 382 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "As the center of Hurricane Katrina passed southeast of New Orleans on August 29, 2005, winds downtown were in the Category 1 range with frequent intense gusts. Hurricane Katrina caused approximately 23 breaches in the drainage canal and navigational canal levees and floodwalls in New Orleans, Louisiana. By August 31, 2005, 80% of New Orleans was flooded, with some parts under of water. Most of the city's major roads were damaged. The I-10 Twin Span Bridge traveling east towards Slidell suffered severe damage; 473 spans were separated from their supports and 64 spans dropped into the lake. " }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Most goals scored by a single player in an nhl game?", "passages": [ [ "Joe Malone (ice hockey)", "Joe Malone (ice hockey)\n\n", "Maurice Joseph \"Phantom Joe\" Malone (February 28, 1890 \u2013 May 15, 1969) was a Canadian professional ice hockey centre who played in the National Hockey Association and National Hockey League.", "He was notable for his scoring feats and his clean play.", "He scored the third-most career goals of any player in major hockey's first half-century (behind Newsy Lalonde and Nels Stewart) and is the only player in the history of the NHL to score seven goals in a single game.", "Malone broke in at the age of 19 for the Quebec Bulldogs of the Eastern Canada Hockey Association in the 1909 season, scoring eight goals in 12 games.", "The next season the NHA formed, but Quebec was left out of the loop, so he played for the Waterloo Colts in the Ontario Professional Hockey League.", "Rejoining Quebec in 1911, he was named the team captain and so served for the Bulldogs' seven NHA seasons.", "Centering linemates such as Eddie Oatman and Jack Marks, he led the Bulldogs to the Stanley Cups in 1912 and 1913 - rampaging for a career-best nine goals in a Cup match against Sydney - while recording remarkable scoring marks of 43 goals in 20 games in 1913.", "His brother Jeff Malone was also played for Quebec in 1913 when they won the Stanley Cup." ], [ "1919\u201320 NHL season", "The Montreal Canadiens had their home opener January 10 in brand new Mount Royal Arena and Newsy Lalonde used the occasion to celebrate with six goals in a 14\u20137 drubbing of the Toronto St. Patricks.", "The combined total of 21 goals by both teams set the NHL record.", "Jack Darragh of Ottawa had a chance to play in goal when Toronto defeated Ottawa 5\u20133 on January 24.", "He took over when Clint Benedict was penalized.", "He did not surrender any goals during the two minutes.", "Despite a dismal record of 2\u201310 in both halves of the season, the Quebec Athletics' Joe Malone scored seven goals in one game on January 31, 1920.", ", it is still the NHL record for most goals in one game.", "An eighth goal was disallowed on an off-side call.", "Malone was later quoted \"the thing I recall most vividly is that it was bitterly cold.\"", "He nearly equalled the record on March 10 when he scored six goals in a 10\u20134 win over the Ottawa Senators.", "Malone led the league in goals with 39.", "But by surrendering 7.18 goals against per game, a record that stands today, Quebec finished dead last.", "With the war now over, players came home and fans were now coming in larger numbers to see games." ] ], "gold": "The most goals scored by a single player in an NHL game is 7. The player who scored the most goals in a single NHL game was Joe Malone, a Canadian professional ice hockey centre, known as \"Phantom Joe\".", "prediction 1": "Maurice Joseph \"Phantom Joe\" Malone was a Canadian professional ice hockey centre who played in the National Hockey Association and National Hockey League. He was notable for his scoring feats and his clean play. He scored the third-most career goals of any player in major hockey's first half-century (behind Newsy Lalonde and Nels Stewart) and is the only player in the history of the NHL to score seven goals in a single game.", "prediction 2": "The player with the most goals in a single game in NHL history is Joe Malone, who scored seven goals in one game in 1920.", "prediction 3": "Maurice Joseph \"Phantom Joe\" Malone was a Canadian professional ice hockey centre who played in the National Hockey Association and National Hockey League. He scored the third-most career goals of any player in major hockey's first half-century, behind Newsy Lalonde and Nels Stewart, and is the only player in the history of the NHL to score seven goals in a single game. On January 31, 1920, the Quebec Athletics' Joe Malone scored seven goals in one game, which is still the NHL record for most goals in one game.", "prediction 4": "There are several players who have scored the most goals in an NHL game, the most being Joe Malone, who scored seven goals in one game on January 31, 1920.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 212 } ], "missing-info": [], "corrected-prediction": "Maurice Joseph \"Phantom Joe\" Malone was a Canadian professional ice hockey centre who played in the National Hockey Association and National Hockey League. He scored the third-most career goals of any player in major hockey's first half-century and is the only player in the history of the NHL to score seven goals in a single game." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does danganronpa v3 come out in america?", "passages": [ [ "Danganronpa V3: Killing Harmony", "As with previous games in the series, the game's original score was composed and produced by Masafumi Takada.", "The existence of a third \"Danganronpa\" title was first teased in September 2013 with the announcement of \"\".", "In March 2015, Kodaka revealed that \"Danganronpa 3\" was in early development.", "The game was announced at Sony's Tokyo Game Show presentation.", "The game was released for PlayStation 4 and PlayStation Vita in January 12, 2017 in Japan.", "A playable demo featuring Makoto Naegi and Hajime Hinata, the protagonists of \"\" and \"\", was released on December 20, 2016.", "The limited edition of the game will include an original video animation based on \"Goodbye Despair\", titled \"Super Danganronpa 2.5: Komaeda Nagito to Sekai no Hakaisha\".", "Coinciding with the game's Japanese release, \"Danganronpa V3\"-themed PlayStation 4 and PlayStation Vita consoles will be released in Japan.", "NIS America released the game in English on September 26, 2017.", "Two multiple-disc soundtrack albums containing music from the game were released on February 24, 2017, both through composer Masafumi Takada's music label, Sound Prestige Records." ] ], "gold": "Danganronpa v3 original was released in America for Playstation 4, Playstation Vita, and Microsoft Windows on September 26, 2017. Danganronpa v3 trilogy was released for Playstation 4 on March 26, 2019.", "prediction 1": "The game was released for PlayStation 4 and PlayStation Vita in January 12, 2017 in Japan. NIS America released the game in English on September 26, 2017. Two multiple-disc soundtrack albums containing music from the game were released on February 24, 2017.", "prediction 2": "The game was released for PlayStation 4 and PlayStation Vita in January 12, 2017 in Japan and in English on September 26, 2017. The two multiple-disc soundtrack albums containing music from the game were released on February 24, 2017 through composer Masafumi Takada's music label, Sound Prestige Records.", "prediction 3": "The American version of Danganronpa V3, Killing Harmony, originally came out on September 26, 2017, while the Japanese version was released on September 12, 2017.", "prediction 4": "Danganronpa V3 is a game series developed and published by Kodaka and was released in September 2016 in Japan. The US version of the game came out on September 26, 2017, while the Japanese version came out on September 12, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 257 } ], "missing-info": [], "corrected-prediction": "NIS America released the game in English on September 26, 2017. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sang the song like a rhinestone cowboy?", "passages": [ [ "Rhinestone Cowboy", "Rhinestone Cowboy\n\n\"Rhinestone Cowboy\" is a song written by Larry Weiss and most famously recorded by American country music singer Glen Campbell.", "The song enjoyed huge popularity with both country and pop audiences when it was released in 1975.", "Weiss wrote and recorded \"Rhinestone Cowboy\" in 1974, and it appeared on his 20th Century Records album \"Black and Blue Suite\".", "It did not, however, have much of a commercial impact as a single.", "In late 1974, Campbell heard the song on the radio, and during a tour of Australia, decided to learn the song.", "Soon after his return to the United States, Campbell went to Al Coury's office at Capitol Records, where he was approached about \"a great new song\"\u00a0\u2014 \"Rhinestone Cowboy\".", "Several music writers noted that Campbell identified with the subject matter of \"Rhinestone Cowboy\"\u00a0\u2014 survival and making it, particularly when the chips are down\u00a0\u2014 very strongly.", "As Steven Thomas Erlewine of AllMusic put it, the song is about a veteran artist \"who's aware that he's more than paid his dues during his career\u00a0... but is still surviving, and someday, he'll shine just like a rhinestone cowboy.\"", "Released in May 1975, \"Rhinestone Cowboy\" immediately caught on with both country and pop audiences." ], [ "Rhinestone Cowboy", "The song was also the sole Glen Campbell track in a promotional-only compilation album issued by Capitol records titled \"The Greatest Music Ever Sold\" (Capitol SPRO-8511/8512), that was distributed to record stores during the 1976 holiday season as part of Capitol's \"Greatest Music Ever Sold\" campaign, which promoted 15 \"Best Of\" albums released by the record label.", "After Glen Campbell died in August 2017, \"Rhinestone Cowboy\" charted in Country Digital Song chart at No. 12.", "The song has sold a total of 368,000 downloads in the digital era in the United States as of August 2017.", "Glen Campbell recorded a new version of the song in 2013 on his final studio album titled, \"See You There\".", "\"Rhinestone Cowboy\" was certified gold for sales of 1 million units by the Recording Industry Association of America.", "The song became one of Glen Campbell's signature songs and won numerous awards from the Country Music Association, Academy of Country Music, and American Music Awards.", "It also obtained nominations for a Grammy Award for Best Country Song as well as for Record of the Year, but did not win." ] ], "gold": "Glen Campbell sang both the 1975 and 2013 released versions of the song Like A Rhinestone Cowboy.", "prediction 1": "\"Rhinestone Cowboy\" is a song written by Larry Weiss and most famously recorded by American country music singer Glen Campbell. Released in May 1975, \"Rhinestone Cowboy\" immediately caught on with both country and pop audiences. In early 1975, Weiss wrote and recorded the song, which appeared on Weiss' album Black and Blue Suite. Then, in late 1974, Campbell heard the song on the radio and during a tour of Australia, decided to learn the song.", "prediction 2": "\"Rhinestone Cowboy\" is a song written and recorded by Larry Weiss and most famously recorded by American country music singer Glen Campbell. Released in May 1975, \"Rhinestone Cowboy\" immediately caught on with both country and pop audiences. In 2013, Glen Campbell recorded a new version of the song on his final studio album, \"See You There\".", "prediction 3": "\"Rhinestone Cowboy\" is a song written by Larry Weiss and most famously recorded by American country music singer Glen Campbell. The song enjoyed huge popularity with both country and pop audiences when it was released in 1975. In late 1974, Campbell heard the song on the radio, and during a tour of Australia, decided to learn the song. He went to Al Coury's office at Capitol Records, where he was approached about \"a great new song\" \u2014 \"Rhinestone Cowboy\".", "prediction 4": "\"Rhinestone Cowboy\" is a song written by Larry Weiss and most famously recorded by American country music singer Glen Campbell. The song enjoyed huge popularity with both country and pop audiences when it was released in 1975. In late 1974, Campbell heard the song on the radio, and during a tour of Australia, decided to learn the song. Later, while in Australia, he learned the song and he recorded his own version in 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 332, "end": 447 }, { "error type": "Irrelevant", "explanation": "", "start": 30, "end": 52 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 331 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Rhinestone Cowboy\" is a song most famously recorded by American country music singer Glen Campbell, which is released in May 1975. Glen Campbell recorded a new version of the song in 2013." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Which type of cable might be required for installation in a drop ceiling?", "passages": [ [ "Dropped ceiling", "In older buildings the space above the dropped ceiling was often used as a plenum space for ventilation systems, requiring only enclosed ducts that deliver fresh air into the room below, with return air entering the ceiling space through open grilles across the ceiling.", "This practice is now used less frequently in new construction.", "In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low-smoke and low-toxicity wire insulation which will tend to char and stop burning on its own.", "This helps to protect building occupants so that they are not poisoned with toxic chemicals sucked through the ventilation system in the event of a fire, and helps to prevent fires from spreading inside the hidden plenum space.", "This special low-smoke cable is typically referred to as plenum cable or Low Smoke Zero Halogen (LSZH or LS0H) cable.", "While twisted pair cable for networking and telephone service is the most common form of plenum cable, coaxial cable also needs to be plenum-rated for safety.", "High-voltage electrical equipment (generally regarded as being over 50 volts) is not permitted to be exposed in the plenum space above a drop ceiling.", "High voltage wiring must be enclosed in conduit or raceways, and must be physically isolated from low-voltage wiring." ] ], "gold": "A special low-smoke and low-toxicity wire insulation might be required for installation in a drop ceiling. And, for network or phone installation, a twisted pair cable may be required in a drop ceiling.", "prediction 1": "In older buildings the space above the dropped ceiling was often used as a plenum space for ventilation systems, requiring only enclosed ducts that deliver fresh air into the room below, with return air entering the ceiling space through open grilles across the ceiling. In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low-smoke and low-toxicity wire insulation which will tend to char and stop burning on its own.", "prediction 2": "In older buildings the space above the dropped ceiling was often used as a plenum space for ventilation systems, requiring only enclosed ducts that deliver fresh air into the room below, with return air entering the ceiling space through open grilles across the ceiling. In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low-smoke and low-toxicity wire insulation which will tend to char and stop burning on its own. This helps to protect the building occupants so that they are not poisoned with toxic chemicals sucked through the ventilation system in the event of a fire, and helps to prevent fires from spreading inside the hidden plenum space.", "prediction 3": "In older buildings the space above the dropped ceiling was often used as a plenum space for ventilation systems, requiring only enclosed ducts that deliver fresh air into the room below, with return air entering the ceiling space through open grilles across the ceiling. In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low smoke and low-toxicity wire insulation which will tend to char and stop burning on its own. This helps to protect building occupants so that they are not poisoned with toxic chemicals sucked through the ventilation system in the event of a fire, and helps to prevent fires from spreading inside the hidden plenum space. While twisted pair cable for networking and telephone service is the most common form of plenum cable, coaxial cable also needs to be plenum-rated for safety.", "prediction 4": "In older buildings the space above the dropped ceiling was often used as a plenum space for ventilation systems, requiring only enclosed ducts that deliver fresh air into the room below, with return air entering the ceiling space through open grilles across the ceiling. In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low-smoke and low-toxicity wire insulation which will tend to char and stop burning on its own. While twisted pair cable for networking and telephone service is the most common form of plenum cable, coaxial cable also needs to be plenum-rated for safety.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 270 }, { "error type": "Irrelevant", "explanation": "", "start": 454, "end": 506 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In the event that the dropped ceiling is used as a plenum, low-voltage cables and wiring not installed inside conduit need to use a special low-smoke and low-toxicity wire insulation which will tend to char and stop burning on its own. While twisted pair cable for networking and telephone service is the most common form of plenum cable." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did johnny galecki first appear on roseanne?", "passages": [ [ "Johnny Galecki", "On April 28, 2017, it was reported that a revival of \"Roseanne\" was in the works with most of the original cast, including Galecki, returning for the eight part mini-series.", "On May 16, 2017, it was confirmed that the eight episodes would air mid-season in 2018 on ABC.", "On December 1, 2017, it was announced that he would reprise his role of David Healy for one episode.", "In May 2018, ABC cancelled \"Roseanne\" following racist remarks made by Roseanne Barr on social media.", "A while later, that June, the other cast members (except Galecki due to his work on \"Big Bang\") came to a deal for a spin-off program featuring their characters without any involvement from Barr.", "The new program entitled \"The Conners\" premiered in October 2018; Galecki will appear as David in at least one episode.", "While working on \"The Big Bang Theory\", Galecki dated co-star Kaley Cuoco for about two years until December 2009 while the two also played a couple on the show.", "Cuoco told \"CBS Watch\" that they have remained on good terms since ending their relationship.", "Analogously, Galecki dated Sara Gilbert in the 1990s while their characters were a couple on \"Roseanne\".", "Galecki owns of land in Santa Margarita, California.", "His property included vineyards and a log cabin." ], [ "Roseanne", "Dan and Roseanne begin their new motorcycle repair shop business, Lanford Custom Cycle, while Roseanne continues working at Rodbell's luncheonette.", "Darlene meets David Healy (Johnny Galecki), Mark's younger brother (in his first appearance, the character named Kevin).", "After a brief stint working at Rodbell's perfume counter, Jackie decides to become a truck driver.", "Nancy (Sandra Bernhard) is introduced as Arnie's fiancee.", "After a night of heavy drinking, Jackie discovers she slept with the newly engaged Arnie.", "Darlene's personality shifts into a sullen goth teen.", "Jackie's former boyfriend, Booker, makes a surprise appearance at a Halloween party.", "Roseanne's neighbors, Kathy and Jerry Bowman, move back to Chicago.", "Roseanne gets breast reduction surgery.", "Crystal gives birth to Dan's new half-brother, \"Little Ed\".", "Roseanne and Dan accompany Arnie and Nancy to their wedding in Las Vegas.", "At the end of the season, Lanford Custom Cycle fails, and Rodbell's Luncheonette closes.", "Nancy is left alone after Arnie claims to be \"abducted by aliens\"." ] ], "gold": "Johnny Galecki first appeared on Roseanne on January 21, 1992 in episode 86. This episode marks the first appearance of Johnny Galecki as David (referred to as Kevin in this episode) Healey, Darlene's boyfriend and later husband, and Mark's brother. Galecki appeared in one more episode of the 2018 revival of Roseanne on ABC. ", "prediction 1": "Johnny Galecki first appeared on Roseanne on April 28, 2017, in episode 57 of the eighth season, which aired on ABC. On December 1, 2017, it was announced that he would reprise his role as David Healy for one episode.\n", "prediction 2": "Johnny Galecki played David Healy on the 2018 TV show Roseanne. In the 2019 version of the show, Galacki first appeared as a guest star.", "prediction 3": "Johnny Galecki first appeared on the show Roseanne on April 28, 2017, when he was introduced as a waiter. He later returned in 2018 as a character named David Healy, an older brother of Mark Healy.", "prediction 4": "Johnny Galecki first appeared on Roseanne on December 9, 2017 when he portrayed David Healy on small screen drama Baltimore Invasion. On April 28, 2017, it was reported that a revival of Roseanne was in the works with most of the original cast, including Galecki, returning for the eight part mini-series. On May 16, 2017, it was confirmed that the eight episodes would air mid-season in 2018 on ABC. On December 1, 2017, it was announced that he would reprise his role of David Healy for one episode. In May 2018, ABC cancelled Roseanne after racist remarks made by Roseanne Barr on social media. One year later, the new spin-off program featuring their characters without any involvement from Barr.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 15, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 218 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does the new atari console come out?", "passages": [ [ "Atari VCS (2019 console)", "Atari VCS (2019 console)\n\nAtari VCS (Code named Ataribox) is an upcoming home video game console produced by Atari, SA.", "The system was first revealed in June 2017 and pre-orders began on May 30, 2018.", "While its physical design is intended to pay homage to the Atari 2600, the new Atari VCS is expected to play modern games and streaming entertainment via a Linux-based operating system that will allow users to download and install other compatible games onto it.", "The system shares a name with Atari, Inc.'s 1977 Video Computer System, usually shortened to VCS, which was renamed to the Atari 2600 in late 1982.", "Atari Corporation left the hardware business around 1996, after it released the Atari Jaguar CD video game console, and was liquidated in 1998, with Hasbro Interactive purchasing the intellectual property of the brand.", "In 2001, Infogrames Entertainment, SA purchased Hasbro Interactive.", "Infogrames would later renamed itself Atari, SA, while the Hasbro Interactive subsidiary was renamed Atari Interactive.", "Atari Interactive provided licensing for the various Atari Flashback dedicated consoles produced since 2004, but has never been directly involved in their production.", "The concept of the Atari VCS came from Feargal Mac Conuladh, who joined Atari and became general manager to oversee the Ataribox release." ] ], "gold": "Pre orders for the new Atari console begins on May 30, 2018, with shipping to begin in March 2020.", "prediction 1": "The system was first revealed in June 2017 and pre-orders began on May 30, 2018.", "prediction 2": "Atari VCS (Code named Ataribox) is an upcoming home video game console produced by Atari, SA. The system was first revealed in June 2017 and pre-orders began on May 30, 2018. While its physical design is intended to pay homage to the Atari 2600, the new Atari VCS is expected to play modern games and streaming entertainment via a Linux-based operating system that will allow users to download and install other compatible games onto it.", "prediction 3": "Atari VCS is an upcoming home video game console produced by Atari, SA. The system was first revealed in June 2017 and pre-orders began on May 30, 2018. While its physical design is intended to pay homage to the Atari 2600, the new Atari VCS is expected to play modern games and streaming entertainment via a Linux-based operating system that will allow users to download and install other compatible games onto it.", "prediction 4": "The new Atari video game console, Atari VCS, was first revealed in June 2017 and pre-orders began on May 30, 2018.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The system was first revealed in June 2017 and pre-orders began on May 30, 2018." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When did the smoking ban come in in england?", "passages": [ [ "Smoking ban in England", "Smoking ban in England\n\nA smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006.", "Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007.", "Before the ban many businesses voluntarily introduced bans on smoking mainly as a result of public feedback.", "The pub chain Wetherspoons was the first major chain to introduce a complete ban on indoor smoking, doing so in May 2006.", "Tobacco advertising had been banned in England gradually starting with a ban on Television Advertising of cigarettes in 1965 to a complete ban on all Tobacco Advertising in 2005.", "On 16 November 2004 a Public Health white paper proposed a smoking ban in almost all public places in England and Wales.", "Smoking restrictions would be phased in, with a ban on smoking in NHS and government buildings by 2006, in enclosed public places by 2007, and pubs, bars and restaurants (except pubs not serving food) by the end of 2008.", "On 26 October 2005, after external challenge and debates within the Cabinet, the government announced that it would continue with its plans." ], [ "Smoking ban in England", "On 14 February 2006, the House of Commons first voted on the amendment to the original compromise plan, to extend the ban to all enclosed public places except private members' clubs.", "The amendment was carried with a large majority.", "MPs then voted on a further amendment to ban smoking in all enclosed public places including private members' clubs.", "Again this amendment gained significant support and was carried with a large majority.", "This therefore replaced the earlier successful amendment which would have allowed smoking only in private members' clubs.", "The legislation was passed by the House of Lords, allowing a total smoking ban in enclosed public places to come into force in England.", "Political opposition did not entirely disappear at this point, the House of Lords Economic Affairs Committee accused the Government of overreacting to the threat posed by passive smoking and said that the smoking ban was symptomatic of MPs' failure to understand risk on 7 June 2006.", "The ban came into force on 1 July 2007, as announced on 30 November 2006 by former Secretary of State for Health Patricia Hewitt, who called it \"a huge step forward for public health\".", "On 30 June 2010, the recently formed Coalition Government announced that it would not be reviewing the ban.", "An attempt in October 2010 by Conservative MP David Nuttall to amend the law to exempt private members' clubs and pubs from the smoking ban was defeated in the House of Commons on its first reading." ] ], "gold": "On 16 November 2004 a Public Health white paper proposed a smoking ban in almost all public places in England and Wales, thus making it the first time smoking ban was taken into consideration. The smoking ban in England came into force at 06:00 BST on 1 July 2007. Before the ban many businesses voluntarily introduced bans on smoking mainly as a result of public feedback. The pub chain Wetherspoons was the first major chain to introduce a complete ban on indoor smoking, doing so in May 2006.", "prediction 1": "A smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007.", "prediction 2": "Smoking bans have come in in England since 2004. In England, the smoking ban came into force on 1 July 2007 as a consequence of the Health Act 2006. In Wales, the smoking ban came into force on 2 April 2007 and in Scotland, it came into force on 16 November 2004. In England, the smoking ban came in on 1 July 2007 as a consequence of the Environment and Food Safety Act 2005.", "prediction 3": "The smoking ban in England, making it illegal to smoke in all enclosed work places in England, came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007. Before the ban many businesses voluntarily introduced bans on smoking mainly as a result of public feedback.", "prediction 4": "The smoking ban in England came into force on 1 July 2007 as a consequence of the Health Act 2006. Similar bans had already been introduced by the rest of the United Kingdom: in Scotland on 26 March 2006, Wales on 2 April 2007 and Northern Ireland on 30 April 2007. The legislation was passed by the House of Lords, allowing a total smoking ban in enclosed public places to come into force in England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 331 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "On 16 November 2004 a Public Health white paper proposed a smoking ban in almost all public places in England and Wales. The smoking ban in England came into force on 1 July 2007. Before the ban many businesses voluntarily introduced bans on smoking mainly as a result of public feedback. The pub chain Wetherspoons was the first major chain to introduce a complete ban on indoor smoking, doing so in May 2006. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When was the first road to key west built?", "passages": [ [ "Key West", "The southernmost location that the public can visit is the beach at Fort Zachary Taylor park.", "The actual southernmost point of the contiguous United States is Ballast Key, a privately owned island just south and west of Key West.", "The claim \"90 Miles to Cuba\" on the monument is close to correct; Cuba at its closest point has been measured at from Key West.", "Several U.S. presidents have visited Key West with the first being Ulysses S. Grant in 1880, followed by Grover Cleveland in 1889, and William Howard Taft in 1912.", "Taft was the first president to use the first officer's quarters that would later be known as the Little White House.", "Franklin D. Roosevelt visited the Florida Keys many times, beginning in 1917.", "Harry S. Truman visited Key West for a total of 175 days on 11 visits during his presidency and visited five times after he left office.", "His first visit was in 1946.", "The Little White House and Truman Annex take their names from his frequent and well-documented visits.", "The residence is also known as the Winter White House as Truman stayed there mostly in the winter months, and used it for official business such as the Truman Doctrine.", "Dwight D. Eisenhower stayed at the Little White House following a heart attack in 1955.", "John F. Kennedy visited Key West in March 1961, and in November 1962, a month after the resolution of the Cuban Missile Crisis." ], [ "Overseas Railroad", "Overseas Railroad\n\nThe Overseas Railroad (also known as Florida Overseas Railroad, the Overseas Extension, and Flagler's Folly) was an extension of the Florida East Coast Railway to Key West, a city located 128 miles (204.8\u00a0km) beyond the end of the Florida peninsula.", "Work on the line started in 1905 and it operated from 1912 to 1935, when it was partially destroyed by the Labor Day Hurricane.", "Henry Flagler (1830\u20131913) was a principal in Rockefeller, Andrews & Flagler and later a founder of Standard Oil during the Gilded Age in the United States.", "The wealthy man took an interest in Florida while seeking a warmer climate for his ailing first wife in the late 1870s.", "Returning to Florida in 1881, he became the builder and developer of resort hotels and railroads along the east coast of Florida.", "Beginning with St. Augustine, he moved progressively south.", "Flagler helped develop Ormond Beach, Daytona Beach, and Palm Beach, and became known as the Father of Miami, Florida.", "Flagler's rail network became known as the Florida East Coast Railway (FEC).", "By 1904, the FEC had reached Homestead, south of Miami.", "After the United States announced in 1905 the construction of the Panama Canal, Flagler became particularly interested in linking Key West to the mainland." ] ], "gold": "The first road to key west started being built in 1905, and was finished in 1912.", "prediction 1": "The first road to Key West was built in 1905. The Overseas Railroad was an extension of the Florida East Coast Railway. It was built from 1912 to 1935.", "prediction 2": "The first road to Key West was the Overseas Railroad, a link to the Florida East Coast Railway. Work on the line started in 1905 and it operated from 1912 to 1935, when it was partially destroyed by the Labor Day Hurricane.", "prediction 3": "The first road to Key West was built in 1905. The Overseas Railroad was an extension of the Florida East Coast Railway to Key West, a city located 128 miles (204.8 km) beyond the end of the Florida peninsula. Work on the line started in 1905 and it operated from 1912 to 1935, when it was partially destroyed by the Labor Day Hurricane.", "prediction 4": "The first road to Key West was built in 1905. The Overseas Railroad was an extension of the Florida East Coast Railway to Key West, a city located 128 miles (204.8 km) beyond the end of the Florida peninsula. Work on the line started in 1905 and it operated from 1912 to 1935, when it was partially destroyed by the Labor Day Hurricane. The railroad was named for its designer, Henry Flagler, who designed the railroad system and the buildings on the line.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 119 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 127, "end": 132 } ], "missing-info": [], "corrected-prediction": "The first road to Key West was built in 1905 and it operated from 1912 to 1935." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played celie in the color purple on broadway?", "passages": [ [ "LaChanze", "LaChanze played the role of \"Ti Moune\" in the Lynn Ahrens and Stephen Flaherty musical \"Once on This Island\" in 1990 and received nominations for the Tony Award as Best Featured Actress in a Musical and Drama Desk Award as Outstanding Actress in a Musical.", "She was a replacement \"Sarah\" in the Ahrens and Flaherty and Terrence McNally Broadway musical \"Ragtime\", starting in December 1998.", "She played the role of \"Viveca\" in the Playwrights Horizons Off-Broadway production of the musical \"The Bubbly Black Girl Sheds Her Chameleon Skin\", which opened in June 2000.", "She received a Drama Desk nomination, Actress (Musical), for her performance.", "LaChanze participated in an Actors Fund of America benefit concert of \"Funny Girl\", with many performers portraying the character of \"Fanny Brice\", in September 2002.", "In 2005 she played a runaway slave in the Ahrens and Flaherty musical \"Dessa Rose\".", "The musical opened Off-Broadway at the Mitzi Newhouse Theatre at Lincoln Center in March 2005.", "LaChanze received an Obie Award for Performance for \"Dessa Rose\".", "LaChanze appeared as \"Celie\" in the Broadway musical \"The Color Purple\", from its opening in 2005 to November 2006." ], [ "The Color Purple (musical)", "The musical opened on Broadway at The Broadway Theatre on December 1, 2005.", "It was directed by Gary Griffin, produced by Scott Sanders, Quincy Jones and Oprah Winfrey, with choreography by Donald Byrd and musical direction by Linda Twine.", "The musical closed on February 24, 2008, after 30 previews and 910 regular performances.", "The Broadway production recouped its $11 million investment within its first year on Broadway, and had grossed over $103 million by the time it closed.", "The original Broadway production starred LaChanze as Celie, Brandon Victor Dixon as Harpo, Felicia P. Fields as Sofia, Ren\u00e9e Elise Goldsberry as Nettie, Kingsley Leggs as Mister, Krisha Marcano as Squeak, and Elisabeth Withers-Mendes as Shug Avery.", "The First National tour began on April 17, 2007, starting with an extended run at the Cadillac Palace Theatre in Chicago, Illinois.", "The company includes LaToya London as Nettie, Michelle Williams as Shug Avery, Felicia P. Fields as Sofia, and Jeannette Bayardelle as Celie, Stephanie St. James as Squeak.", "Bayardelle and Fields both are reprising their roles from Broadway.", "The show exceeded expectations, which necessitated a four-week extension of its Chicago engagement until September 30, 2007.", "The original expectation was that the show would run in Chicago until November." ], [ "African-American literature", "In the 1970s novelist and poet Alice Walker wrote a famous essay that brought Zora Neale Hurston and her classic novel \"Their Eyes Were Watching God\" back to the attention of the literary world.", "In 1982, Walker won both the Pulitzer Prize and the American Book Award for her novel \"The Color Purple\".", "An epistolary novel (a book written in the form of letters), \"The Color Purple\" tells the story of Celie, a young woman who is sexually abused by her stepfather and then is forced to marry a man who physically abuses her.", "The novel was later made into a film by Steven Spielberg.", "The 1970s also saw African-American books topping the bestseller lists.", "Among the first to do so was \"\" by Alex Haley.", "A fictionalized account of Haley's family history\u2014beginning with the kidnapping of his ancestor Kunta Kinte in Gambia through his life as a slave in the United States\u2014 \"Roots\" won the Pulitzer Prize and became a popular television miniseries.", "Haley also wrote \"The Autobiography of Malcolm X\" in 1965.", "Other important writers in recent years include literary fiction writers Gayl Jones, Rasheed Clark, Ishmael Reed, Jamaica Kincaid, Randall Kenan, and John Edgar Wideman.", "African-American poets have also garnered attention." ] ], "gold": "The Color Purple is a 1982 epistolary novel by American author Alice Walker which won the 1983 Pulitzer Prize for Fiction and the National Book Award for Fiction and was later adapted into a film and musical of the same name, with the musical being performed in Broadway several times. The original Broadway production starred LaChanze as Celie, a poor, uneducated 14-year-old girl living in the Southern United States in the early 1900s. Cynthia Erivo reprised the role for the revival of the musical from 2015 to 2017.", "prediction 1": "The Color Purple is a musical written in the form of a novel, told in the form of letters, and tells the story of Celie, a young woman who is sexually abused by her stepfather and then is forced to marry a man who physically abuses her. The original Broadway production starred LaChanze as Celie, Brandon Victor Dixon as Harpo, Felicia P. Fields as Sofia, Ren\u00e9e Elise Goldsberry as Nettie, Kingsley Leggs as Mister, and Jeannette Bayardelle as Celie, Stephanie St. James as Squeak. Bayardelle and Fields both are reprising their roles from Broadway.", "prediction 2": "On Broadway, the character of Celie is played by Jeannette Bayardelle. She played the character from 2005 to 2008. On Off-Broadway, LaChanze played the role of Celie in the production of The Color Purple from 2006 to 2009, and from 2010 to 2013.", "prediction 3": "The Color Purple is an American musical musical based on the 1982 novel by Alice Walker. The musical stars LaChanze as Celie, a young woman who is sexually abused by her stepfather and then is forced to marry a man who physically abuses her. On the original Broadway production, Jeannette Bayardelle played Celie, while Brandon Victor Dixon played Harpo.", "prediction 4": "The Color Purple is a musical musical about a young woman named Celie, who is sexually abused by her stepfather and then is forced to marry a man who physically abuses her. The original Broadway production starred LaChanze as Celie, Brandon Victor Dixon as Harpo, Felicia P. Fields as Sofia, Ren\u00e9e Elise Goldsberry as Nettie, Kingsley Leggs as Mister, Krisha Marcano as Squeak, and Elisabeth Withers-Mendes as Celie. Bayardelle played Celie, and Stephanie St. James as Squeak.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2,3]}", "start": 22, "end": 61 }, { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 481 }, { "error type": "Irrelevant", "explanation": "", "start": 482, "end": 549 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Color Purple is a 1982 epistolary novel by author Alice Walker, she won both the Pulitzer Prize and the American Book Award for it as well. It was turned into a film and Broadway show. The original Broadway production starred LaChanze as Celie." }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "Player who scored most goals in premier league?", "passages": [ [ "Harry Kane", "On 23 December, Kane equalled Alan Shearer's record of 36 Premier League goals in a calendar year, having scored a hat-trick in a 0\u20133 away win to Burnley.", "He surpassed Shearer's record the following game with another hat-trick in the 5\u20132 home win against Southampton, ending the year with 39 Premier League goals.", "The hat-trick, his sixth of the year in the Premier League (eighth in all competitions), also made him the first player in Premier League history to score six hat-tricks in a year.", "With a total of 56 goals scored in all competitions for the year, he also became Europe's top goal scorer of 2017, breaking the seven-year dominance of Lionel Messi and Cristiano Ronaldo as Europe's top goalscorer in a calendar year.", "In January 2018, he scored twice in the 4\u20130 home win against Everton, and became Tottenham's top goalscorer in the Premier League era, breaking Teddy Sheringham's record of 97 Premier League goals for the club.", "On 4 February, Kane scored an added-time penalty to equalise in a 2\u20132 draw with Liverpool at Anfield for his 100th Premier League goal; he achieved the century of league goals in 141 games, beaten only by Alan Shearer's 124." ], [ "Thierry Henry", "Henry was also the top goalscorer in the Premier League for a record four seasons (2002, 2004, 2005, 2006).", "In 2006, he became the first player to score more than 20 goals in the league for five consecutive seasons (2002 to 2006).", "With 175, Henry is currently fifth in the list of all-time Premier League goalscorers, behind Alan Shearer, Andy Cole, Wayne Rooney and Frank Lampard.", "All of his Premier League goals were for Arsenal, giving him the record for most goals in the competition for one club, until it was broken by Rooney in 2016.", "France's all-time record goalscorer was, in his prime in the mid 2000s, regarded by many coaches, footballers and journalists as one of the best players in the world.", "In November 2007, he was ranked 33rd on the Association of Football Statisticians' compendium for \"Greatest Ever Footballers.\"", "Arsenal fans honoured their former player in 2008, declaring Henry the greatest Arsenal player.", "In two other 2008 surveys, Henry emerged as the favourite Premier League player of all time among 32,000 people surveyed in the Barclays 2008 Global Fan Report.", "In 2009, Henry was voted the best Premier League player of the 2000s." ] ], "gold": "There are several players who scored most goals in premier league, based on different criteria. Alan Shearer scored most goals overall, Wayne Rooney scored the most goals for at one club, and Harry Kane scored the most goals in a calendar year.", "prediction 1": "There are several players who have scored the most goals in Premier League. Harry Kane scored the most goals in 2018-2019 season, scoring a total of 61 goals. Thierry Henry scored the most goals in all competitions for Arsenal. Thierry Henry was the top goalscorer in the Premier League for a record four seasons, scoring a total of 175. Henry is currently fifth in the list of all-time Premier League goalscorers, behind Alan Shearer, Andy Cole, Wayne Rooney and Frank Lampard.", "prediction 2": "Harry Kane scored the most goals in a season in the premier league in 2018. He scored 321 goals in a season in the Premier League. Alan Shearer scored the most goals in the Premier League in a calendar year in 2002. Thierry Henry scored the most goals in a season in 2002.", "prediction 3": "The player who scored the most goals in the Premier League is Harry Kane, with a total of 39 goals. Harry Kane's record for most goals in a calendar year is 36, equalling Alan Shearer's record for most goals in a calendar year. Thierry Henry scored the most goals in a calendar year in a record four seasons, scoring a total of 175, and is currently fifth in the list of all-time Premier League goalscorers.", "prediction 4": "The player who scored the most goals in Premier League in any season is Harry Kane, who scored a total of 164 goals in the league in 2017. Kane also became Europe's top goal scorer of 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2,4]}", "start": 112, "end": 121 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 140, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 322, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 313 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3,4]}", "start": 159, "end": 172 }, { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 478 } ], "missing-info": [], "corrected-prediction": "There are several players who have scored the most goals in Premier League. Harry Kane scored the most goals in the 2017 season, scoring 39 goals in the Premier League calendar year. Wayne Rooney scored the most goals in all competitions for a club. The all-time Premier League goalscorers is Alan Shearer." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does the amazon river start and end?", "passages": [ [ "Amazon River", "Amazon River\n\nThe Amazon River (, ; Spanish and ) in South America is the largest river by discharge volume of water in the world, and by some definitions it is the longest.", "The headwaters of the Apur\u00edmac River on Nevado Mismi had been considered for nearly a century as the Amazon's most distant source, until a 2014 study found it to be the Cordillera Rumi Cruz at the headwaters of the Mantaro River in Peru.", "The Mantaro and Apur\u00edmac join, and with other tributaries form the Ucayali River, which in turn meets the Mara\u00f1\u00f3n River upstream of Iquitos, Peru, to form what countries other than Brazil consider to be the main stem of the Amazon.", "Brazilians call this section the Solim\u00f5es River above its confluence with the Rio Negro to form what Brazilians call the Amazon at the Meeting of Waters () at Manaus, the river's largest city.", "At an average discharge of about \u2014approximately , greater than the next seven largest independent rivers combined\u2014the Amazon represents 20% of the global riverine discharge to the ocean.", "The Amazon basin is the largest drainage basin in the world, with an area of approximately .", "The portion of the river's drainage basin in Brazil alone is larger than any other river's basin." ] ], "gold": "Prior to 2014, it was understood that the amazon river started at the headwaters of the Apur\u00edmac River on Nevado Mismi. In 2014,based on a new study, it was discovered that the amazon river starts at the headwaters of the Mantaro River on the Cordillera Rumi Cruz in Peru. It ends at the Atlantic Ocean off of Brazil.", "prediction 1": "The Amazon River in South America is the largest river by discharge volume of water in the world, and by some definitions it is the longest. The headwaters of the Apurmac River on Nevado Mismi had been considered for nearly a century as the Amazon's most distant source, until a 2014 study found it to be the Cordillera Rumi Cruz at the headwaters of the Mantaro River in Peru. The Mantaro and Apurmac join, and with other tributaries form the Ucayali River, which in turn meets the Mara\u00f3n River upstream of Iquitos, Peru, to form what other than Brazil consider to be the main stem of the Amazon at the Meeting of Waters () at Manaus, the Amazon at the meeting of Waters () at the Rio Negro to form what Brazilians call the Amazon at the Meeting of Waters ()", "prediction 2": "The Amazon River, or Amazon, in South America is the largest river by discharge volume of water in the world, and by some definitions it is the longest. The headwaters of the Apurmac River on Nevado Mismi had been considered for nearly a century as the Amazon's most distant source, until a 2014 study found it to be the Cordillera Rumi Cruz at the headwaters of the Mantaro River in Peru. The Mara\u00f3n River, which in turn meets the Ucayali River, which in turn meets the Ucayali River, which in turn forms what countries other than Brazil consider to be the main stem of the Amazon at the Meeting of Waters () at Manaus, the river's largest city. The Amazon River starts and ends at the Meeting of Waters () at the city of Manaus, the Amazon at the Meeting of Waters () at the Amazon", "prediction 3": "The Amazon River in South America is the largest river by discharge volume of water in the world and by some definitions it is the longest. The headwaters of the Apurmac River on Nevado Mismi had been considered for nearly a century as the Amazon's most distant source, until a 2014 study found it to be the Cordillera Rumi Cruz at the headwaters of the Mantaro River in Peru. The Mantaro and Apurmac join, and with other tributaries form the Ucayali River, which in turn meets the Mara\u00f3n River upstream of Iquitos, Peru, to form what countries other than Brazil consider to be the main stem of the Amazon at the Meeting of Waters (.", "prediction 4": "The Amazon River in South America is the largest river by discharge volume of water in the world and by some definitions it is the longest. It originates at the Cordillera Rumi Cruz in the Cordillera Rumi Cruz Mountains, at the headwaters of the Mantaro River in Peru.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 378, "end": 596 }, { "error type": "Incoherent", "explanation": "", "start": 597, "end": 759 } ], "missing-info": [], "corrected-prediction": "The headwaters of the Apurmac River on Nevado Mismi had been considered for nearly a century as the Amazon's most distant source, until a 2014 study found it to be the Cordillera Rumi Cruz at the headwaters of the Mantaro River in Peru. " }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Cavs vs warriors regular season head to head?", "passages": [ [ "Cavaliers\u2013Warriors rivalry", "Cavaliers\u2013Warriors rivalry\n\nThe Cavaliers\u2013Warriors rivalry is a National Basketball Association (NBA) rivalry between the Cleveland Cavaliers and the Golden State Warriors.", "While the two teams have played each other since the Cavaliers joined the league in 1970, their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018.", "Prior to the streak beginning, no pair of teams had faced each other in more than two consecutive Finals.", "Of these four series, the Warriors have won three championships (2015, 2017, and 2018), and the Cavaliers won in 2016.", "The Warriors dominated the early series, going 37\u201322 () from 1970 to 1991.", "The Cavaliers would win 10 straight games from 1992 to 1996 to reduce Golden State's lead to 37\u201332 ().", "The two teams played each other close during LeBron James' first stint with the Cavaliers in the 2000s.", "From 2010 to 2014, James left the Cavaliers to play for the Miami Heat while the Warriors were a lottery team.", "The Warriors led the head-to-head series 53\u201350 () through the end of the 2013\u201314 season.", "James returned to the Cavaliers during the 2014 off-season.", "The Cavaliers then acquired All-Star power forward Kevin Love for Andrew Wiggins and other assets." ], [ "Cavaliers\u2013Warriors rivalry", "Curry was improving off of last year's All-Star season.", "Klay Thompson became one of the best shooting guards, three-point shooters, and two-way players in the league.", "Draymond Green averaged about 12 points, 8 rebounds, and 4 assists per game.", "Rookie head coach Steve Kerr was a candidate for Coach of the Year.", "The two teams split their head-to-head meetings that season, each winning on its home court.", "Irving, James, Curry, and Thompson were all named to their respective NBA All Star teams, with Curry finishing first in the all-star voting (1,513,324), and LeBron James finishing in second (1,470,483).", "Curry won the NBA MVP Award, averaging 23.8 points, 7.7 assists, and 2.0 steals per game, and shot 44.3% from three-point territory.", "James was third in MVP voting.", "He averaged 25.3 PPG, 6.0 RPG, and 7.4 APG.", "They were featured on the All-NBA First Team.", "Irving and Thompson made the All-NBA team as well.", "The Cavaliers finished the season with a record of 53\u201329, and the Warriors finished the season with a record of 67\u201315.", "The Warriors and the Cavaliers only lost five games combined in the first three rounds of the playoffs." ] ], "gold": "The Cavaliers\u2013Warriors rivalry is an NBA rivalry between the Cleveland Cavaliers and the Golden State Warriors that primarily focuses on the four consecutive NBA Finals between the teams from 2015 to 2018. The Warriors led the head-to-head series 53\u201350 (.515) through the end of the 2013\u201314 season, while both two teams split their head-to-head meetings during the 2014\u20132015 season, each winning on its home court.", "prediction 1": "The Cavaliers\u2013Warriors rivalry is a National Basketball Association rivalry between the Cleveland Cavaliers and the Golden State Warriors. While the two teams have played each other since the Cavaliers joined the league in 1970, their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018. Prior to the streak beginning, no pair of teams had faced each other in more than two consecutive Finals.", "prediction 2": "The Cavaliers\u2013Warriors rivalry is a National Basketball Association (NBA) rivalry between the Cleveland Cavaliers and the Golden State Warriors. While the two teams have played each other since the Cavaliers joined the league in 1970, their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018. Prior to the streak beginning, no pair of teams had faced each other in more than two consecutive Finals.", "prediction 3": "The Cavaliers\u2013Warriors rivalry is an NBA rivalry between the Cleveland Cavaliers and the Golden State Warriors. The two teams have played each other since the Cavaliers joined the league in 1970, but their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018. Prior to the streak beginning, no pair of teams had faced each other in more than two consecutive Finals.", "prediction 4": "While the two teams have played each other since the Cavaliers joined the league in 1970, their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018. The regular season head-to-head between the Cavaliers and Warriors was held on January 24, 2014, December 4, 2014, and January 5, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 466 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Cavaliers\u2013Warriors rivalry is a National Basketball Association rivalry between the Cleveland Cavaliers and the Golden State Warriors. Their rivalry began to develop in the 2014\u201315 season, when they met in the first of four consecutive NBA Finals, from 2015 to 2018. The Warriors led the head-to-head series 53\u201350 (.515) through the end of the 2013\u201314 season. The two teams split their head-to-head meetings that season, each winning on its home court. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the state minister for primary education in uganda?", "passages": [ [ "Rosemary Seninde", "Rosemary Seninde\n\nRosemary Nansubuga Seninde, also Rosemary Nansubuga Sseninde (n\u00e9e Rosemary Nansubuga) (born 7 January 1965), is a Ugandan educator and politician.", "She is the State Minister for Primary Education in the Ugandan Cabinet.", "She was appointed to that position on 6 June 2016, replacing John Chrysostom Muyingo who became State Minister for Higher Education.", "She concurrently serves as the Wakiso District Women's Representative in the Parliament of Uganda.", "Rosemary Nansubuga was born in Wakiso District on 7 January 1965.", "She went to St. Agnes Boarding Primary School in Naggalama for her early elementary schooling.", "She then attended St. Joseph's Senior Secondary School in Nsambya for her O-Level studies, graduating in 1982.", "She studied at Trinity College Nabbingo for her A-Level education, graduating in 1985.", "In 1997 she obtained a Teaching Certificate from Lady Irene College, in Ndejje, now a component of Ndejje University.", "The following year, she attended a 10-week course at the \"National Institute of Small Industries Extension Training\" (NISIET), in Hyderabad, India, graduating with a certificate." ], [ "John Chrysestom Muyingo", "John Chrysestom Muyingo\n\nJohn Chrysestom Muyingo is a Ugandan educator and politician.", "He is the State Minister for Higher Education in the Ugandan Cabinet.", "He was appointed to that position on 6 June 2016.", "He previously served as the Stat Minister for Primary Education from 1 March 2015 until 5 June 2016.", "Before that, from 27 May 2011 until 1 March 2015, he served as the State Minister for Higher Education, having replaced Mwesigwa Rukutana in May 2011.", "Muyingo is also the elected Member of Parliament for Bamunanika County, Luweero District.", "Muyingo was born on 22 February 1960 to John Chrysestom Ssekidde of Kakoola Village, Bamunanika County, Luwero District and Victoria Nakiwala of Naakulabye, Lubaga Division, in Kampala, Uganda's capital.", "He attended the Mulajje Primary School, Kisubi Seminary, and Makerere College School, before joining Makerere University in 1983.", "He graduated in 1986 with a Bachelor of Science with a Diploma in Education.", "He also holds a Master of Arts in Educational Management, obtained in 1996, and a Doctor of Philosophy obtained in 2004, both from Makerere University.", "The dissertation for his doctorate focused on the financing of university education in Uganda." ], [ "Ministry of Education and Sports (Uganda)", "Ministry of Education and Sports (Uganda)\n\nThe Ministry of Education and Sports (MES), is a cabinet-level ministry of Uganda.", "It is mandated \"to provide technical support, guide, coordinate, regulate and promote quality education, training and sports to all persons in Uganda for national integration, development and individual advancement\", according to the website of the ministry.", "The headquarters of the ministry are located in Embassy House, on King George VI Way, at the corner with Parliament Avenue, in the Central Division of Kampala, Uganda's capital and largest city.", "The coordinates of the ministry headquarters are:0\u00b018'50.0\"N, 32\u00b035'15.0\"E (Latitude:0.313889; Longitude:32.587500).", "The ministry is overseen by a cabinet minister, currently Janet Museveni, since 6 June 2016.", "She is assisted by three ministers of state; (a) Rosemary Seninde serves as Minister of State for Primary Education, (b)", "John Chrysestom Muyingo serves as Minister of State for Secondary Education, and Charles Bakkabulindi serves as Minister of State for sports." ] ], "gold": "Uganda has had several State Ministers for Primary Education. Rosemary Seninde is the State Minister for Primary Education in the Ugandan Cabinet. She was appointed to that position on 6 June 2016, replacing John Chrysostom Muyingo who previously served as the State Minister for Primary Education from 1 March 2015 until 5 June 2016.", "prediction 1": "There are several officials in Uganda's government who are the State Ministers of Education. Rosemary Seninde is the State Minister for Primary Education in the Ugandan Cabinet. John Chrysestom Muyingo is the State Minister for Higher Education. Charles Bakkabulindi is the Minister of State for sports.", "prediction 2": "Rosemary Annunsubuga Seninde, also Rosemary Nansubuga Sseninde, is the State Minister for Primary Education in Uganda. She was appointed to that position on 6 June 2016 replacing John Chrysostom Muyingo, who became State Minister for Higher Education.", "prediction 3": "The state minister for primary education in Uganda is Rosemary Nansubuga Seninde. She has held the position since June 6, 2016. John Chrysestom Muyingo is the state minister for higher education in Uganda. Charles Bakkabulindi serves as the state minister for sports.", "prediction 4": "Currently, Rosemary Seninde is the State Minister for Primary Education in Uganda. She was appointed to that position on June 6, 2016, replacing John Chrysestom Muyingo, who became State Minister for Higher Education. Charles Bakkabulindi is the Minister of State for sports.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 303 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "There are several officials in Uganda's government who are the State Ministers of Education. Rosemary Seninde is the State Minister for Primary Education in the Ugandan Cabinet. She was appointed to that position on 6 June 2016, replacing John Chrysostom Muyingo who previously served as the State Minister for Primary Education from 1 March 2015 until 5 June 2016." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does the revolutionary war start and end?", "passages": [ [ "American Revolutionary War", "In early 1782, Parliament voted to end all offensive operations in North America, but the war continued in Europe, India and the Caribbean.", "In the latter the British scored a major victory over the French navy, and then later defeated Spanish and French attempts to seize Gibraltar.", "On September 3, 1783, the belligerent parties signed the Treaty of Paris in which Great Britain agreed to recognize the sovereignty of the United States and formally end the war.", "French involvement had proven decisive, but France made few gains and incurred crippling debts.", "Spain made some territorial gains but failed in its primary aim of recovering Gibraltar.", "The Dutch were defeated on all counts and were compelled to cede territory to Great Britain.", "In India, the war against Mysore and its allies concluded in 1784 without any territorial changes.", "Parliament passed the Stamp Act in 1765.", "Colonists condemned the tax because their rights as Englishmen protected them from being taxed by a Parliament in which they had no elected representatives.", "Parliament argued that the colonies were \"represented virtually\", an idea that was criticized throughout the Empire.", "Parliament did repeal the act in 1766; however, it also affirmed its right to pass laws that were binding on the colonies.", "From 1767, Parliament began passing legislation to raise revenue for the salaries of civil officials, ensuring their loyalty while inadvertently increasing resentment among the colonists, and opposition soon became widespread.", "Enforcing the acts proved difficult." ], [ "American Revolution", "American Revolution\n\nThe American Revolution was a colonial revolt that took place between 1765 and 1783.", "The American Patriots in the Thirteen Colonies won independence from Great Britain, becoming the United States of America.", "They defeated the British in the American Revolutionary War (1775\u20131783) in alliance with France and others.", "Members of American colonial society argued the position of \"no taxation without representation\", starting with the Stamp Act Congress in 1765.", "They rejected the authority of the British Parliament to tax them because they lacked members in that governing body.", "Protests steadily escalated to the Boston Massacre in 1770 and the burning of the \"Gaspee\" in Rhode Island in 1772, followed by the Boston Tea Party in December 1773, during which Patriots destroyed a consignment of taxed tea.", "The British responded by closing Boston Harbor, then followed with a series of legislative acts which effectively rescinded Massachusetts Bay Colony's rights of self-government and caused the other colonies to rally behind Massachusetts.", "In late 1774, the Patriots set up their own alternative government to better coordinate their resistance efforts against Great Britain; other colonists preferred to remain aligned to the Crown and were known as \"Loyalists\" or \"Tories\".", "Tensions erupted into battle between Patriot militia and British regulars when the king's army attempted to capture and destroy Colonial military supplies at Lexington and Concord on April 19, 1775." ] ], "gold": "The American Revolutionary War started and ended on April 19, 1775 and September 3, 1783. And The French Revolutionary War started and ended on 20 April 1792 and 25 March 1802.", "prediction 1": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The American Patriots in the Thirteen Colonies won independence from Great Britain, becoming the United States of America. They defeated the British in the American Revolutionary War (1775\u20131783) in alliance with France and others. The war started in early 1782, and ended in September 3, 1783.", "prediction 2": "The American Revolution was a colonial revolt that took place between 1765 and 1783. At the beginning of the war, Parliament voted to end all offensive operations in North America, but the war continued in Europe, India and the Caribbean. On September 3, 1783, the belligerent parties signed the Treaty of Paris in which Great Britain agreed to recognize the sovereignty of the United States and formally end the war.", "prediction 3": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The American Patriots in the Thirteen Colonies won independence from Great Britain, becoming the United States of America. They defeated the British in the American Revolutionary War (1775\u20131783) in alliance with France and others. The war started in early 1782, but continued in Europe, India and the Caribbean. In Europe, the British scored a major victory over the French navy, and then later defeated Spanish and French attempts to seize Gibraltar. In the Caribbean, the French defeated Spanish and French attempts to seize Gibraltar. In India, the war against Mysore and its allies ended in 1784 without any territorial changes.", "prediction 4": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The Revolution was a war between the British and French between 1775 and 1783. The war started in 1765 with the Stamp Act Congress, which was the first major rebellion for the American people. The war ended on September 3, 1783 with the Treaty of Paris, which recognized the sovereignty of the United States and formally ended the war.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 315 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 341, "end": 346 } ], "missing-info": [], "corrected-prediction": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The war started in early 1775, and ended in September 3, 1783." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the care bears movie come out?", "passages": [ [ "The Care Bears Movie", "At the time, the North American film industry was bereft of children's and family fare; with \"The Care Bears Movie\", Hirsh said, \"There's such a large audience for a film that appeals primarily to 6-year-olds.\"", "He remarked later on, \"What we've done [at Nelvana] is tailor the film to a pre-literate audience, the very young.", "It's interesting to see the audience.", "The kids are fixated on the screen.", "[It's] awesome to them.\"", "Clive A. Smith observed that some children came to showings with their Bears; long line-ups held back its audience in several cities.", "Among those attending the matinee screenings was John Waters, a filmmaker known for \"Pink Flamingos\" and \"Polyester\".", "The film made an appearance at the USA Film Festival in Dallas, Texas, during its release.", "When shown in theatres, the feature was immediately followed by Nelvana's TV special, \"Strawberry Shortcake Meets the Berrykins\".", "It was directed by Laura Shepherd and produced by Nelvana's founders along with Lenora Hume." ], [ "Care Bears Movie II: A New Generation", "It was distributed in the United States by The Samuel Goldwyn Company, an independent outfit, and grossed US$22.9 million at the North American box-office, the largest amount for a non-Disney animated film at the time.", "This success guaranteed production of a second film, which was in consideration by May 1985.", "As with the original, production took place at Nelvana's facilities and Taiwan's Wang Film Productions; the Canadian studio also hired South Korean personnel to handle inking and painting.", "This time, over one hundred Nelvana animators worked on the film over a seven-month period that lasted until February 1986; the company itself received credit for the story development.", "American Greetings and Kenner commissioned Nelvana to make the sequel on contract; television syndicator LBS Communications, a co-financier of the first one, became the producer and presenter.", "\"Care Bears Movie II\" was Nelvana's third animated feature film, after 1983's \"Rock & Rule\" and \"The Care Bears Movie\".", "It marked the directorial debut of Dale Schott, a Nelvana staff member who served as assistant director on the first \"Care Bears Movie\", as well as the Nelvana/Lucasfilm TV series \"\"." ], [ "Care Bears Movie II: A New Generation", "Care Bears Movie II: A New Generation\n\nCare Bears Movie II:", "A New Generation is a 1986 Canadian-American animated fantasy film produced by LBS Communications and Nelvana.", "The third animated feature from Nelvana, it was directed by Dale Schott, written by Peter Sauder and produced by Nelvana's three founders (Michael Hirsh, Patrick Loubert and Clive A. Smith).", "It stars the voices of Alyson Court, Cree Summer, Maxine Miller and Hadley Kay.", "In the second film based on the Care Bears franchise, a character called The Great Wishing Star (voiced by Chris Wiggins) tells the origins of the Care Bears, and the story of their first Caring Mission.", "True Heart Bear and Noble Heart Horse lead the other Care Bears and Care Bear Cousins, as they come to the aid of Christy, a young orphan camper who is tempted by an evil shape-shifting figure named Dark Heart.", "This is also the first appearance of the Care Bear Cubs, who also had their own line of toys.", "\"A New Generation\" was made over a seven-month period at Nelvana's Toronto facilities, with additional work handled by Taiwan's Wang Film Productions, and involved several crew members who had worked on the original \"Care Bears Movie\"." ] ], "gold": "There are several Care Bears movies. The 1985 film The Care Bears Movie came out in Washington DC on March 24, 1985, when it premiered as part of a Special Olympics benefit and came out in full release on March 29, 1985. Care Bears Movie II: A New Generation came out for limited release on March 7, 1986, and came out in full release on March 21, 1986.", "prediction 1": "The Care Bears Movie came out on March 26, 1983 in the United States. The following year, the Care Bears Movie II came out in Canada on March 27, 1986. The Care Bears Movie II: A New Generation was released on April 7, 1986.", "prediction 2": "The Care Bears Movie came out on December 14, 1983 in North America. Its sequel was released on February 26, 1986.", "prediction 3": "The Care Bears Movie was a 1983 children's animated film produced by Nelvana. It was released on March 14, 1983. The Care Bears Movie II was released on February 16, 1986. The Care Bears Movie II: A New Generation is a 1986 Canadian-American animated fantasy film produced by LBS Communications and Nelvana. It marked the directorial debut of Dale Schott, a Nelvana staff member who served as assistant director on the first Care Bears Movie.", "prediction 4": "The Care Bears Movie came out on March 19, 1983. It was followed by the sequel, Care Bears Movie II: A New Generation, which was released on March 13, 1986.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 136, "end": 145 }, { "error type": "Incoherent", "explanation": "", "start": 74, "end": 89 }, { "error type": "Redundant", "explanation": "The following year, the Care Bears Movie II came out in Canada on March 27, 1986. ", "start": 152, "end": 206 }, { "error type": "Unverifiable", "explanation": "", "start": 210, "end": 224 }, { "error type": "Unverifiable", "explanation": "", "start": 33, "end": 42 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several Care Bear movies. The Care Bears Movie came out in 1983. The Care Bears Movie II: A New Generation came out in Canada on 1986. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "How long has beasley been with the cowboys?", "passages": [ [ "Cole Beasley", "With leading receiver Dez Bryant injured for most of the season, he finished with 52 receptions (tied for second on the team) for 537 receiving yards and five receiving touchdowns (led the team), while playing with four different starting quarterbacks with varying degrees of knowledge of the team's offense.", "At the beginning of the year he was used to fill in as a punt returner, due to his ball security ability.", "He was eventually replaced by rookie Lucky Whitehead after having poor return averages and a critical muffed punt in a loss against the New York Giants.", "Beasley posted career highs in receptions and yards, catching 75 passes for 833 yards and five touchdowns on 98 targets.", "His 76.5% catch rate ranked second among NFL wide receivers in 2016.", "In the 2017 season, Beasley finished with 36 receptions for 314 receiving yards and four receiving touchdowns.", "Beasley started the 2018 season with seven receptions for 73 yards in a 16\u20138 loss to the Carolina Panthers.", "In Week 6, against the Jacksonville Jaguars, he had nine receptions for 101 yards and two touchdowns in the 40\u20137 victory.", "Beasley released the single \"80 Stings\" in 2017.", "In 2018, he released his debut rap album \"The Autobiography\"." ], [ "Cole Beasley", "Beasley went undrafted in the 2012 NFL Draft because of his size and was signed by the Dallas Cowboys.", "He left abruptly during training camp, stating he was dealing with \"personal stuff\", and even considered retiring from professional football.", "He went on to have a sudden change of heart, returning and making the final 53-man roster.", "In 10 games of his rookie year, he made 15 receptions for 98 receiving yards.", "Beasley found ways to be productive while being surrounded by a solid corps of wide receivers, having the highest completion percentage of any receiver in the NFL with more than 10 targets.", "He was targeted by quarterback Tony Romo on third down, especially in spread formations.", "Much of this became attributed to Beasley's very good route running.", "He posted 39 receptions for 368 receiving yards and 2 touchdowns.", "He also returned 10 punts for 68 yards, along with one kickoff for 11 yards.", "Beasley posted 37 receptions (fourth on the team), 420 yards (fourth on the team) and four touchdowns.", "He averaged nearly 50 yards per game during the final six contests of the season.", "In the Wild Card playoff win against the Detroit Lions, he made four catches - three for first downs- for 63 yards and recovered a critical Romo fumble.", "On March 3, the Cowboys signed Beasley for an additional four years, with a total contract value of $13.6 million." ] ], "gold": "Beasley signed with the Cowboys in 2012 and played a total of seven seasons with them.", "prediction 1": "Cole Beasley went undrafted in the 2012 NFL Draft because of his size and was signed by the Dallas Cowboys. He left abruptly during training camp, stating he was dealing with \"personal stuff\", and even considered retiring from professional football. On March 3, the Cowboys signed Beasley for an additional four years, with a total contract value of $13.6 million.\n", "prediction 2": "Cole Beasley, a wide receiver for the Dallas Cowboys since 2012, signed a four-year contract with the team, which was valued at $13.6 million. He was drafted in the 2012 NFL Draft because of his size and originally signed in July 2012. On March 3, 2013, the Cowboys signed Beasley for an additional four years, which was valued at $13.6 million.", "prediction 3": "Cole Beasley initially signed with the Dallas Cowboys as a free agent in 2012. Beasley played with the team from 2013 to 2017, and was signed for four more years in 2014 and 2015.", "prediction 4": "Cole Beasley started two seasons with the Dallas Cowboys in 2016, and has been with the team since 2017. While with the Cowboys from 2012-16, he also filled in as a punt returner in 2016 and 2017. He also made an NFL roster in 2017 after leaving abruptly during training camp and considered retiring. On March 3, 2013, the Cowboys agreed to an additional four seasons with a total contract worth $13.6 million.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 365 } ], "missing-info": [], "corrected-prediction": "Beasley played for the Cowboys for at least four years.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Kareem abdul jabbar most points in one game?", "passages": [ [ "Kareem Abdul-Jabbar", "Kareem Abdul-Jabbar\n\nKareem Abdul-Jabbar (born Ferdinand Lewis Alcindor Jr.; April 16, 1947) is an American retired professional basketball player who played 20 seasons in the National Basketball Association (NBA) for the Milwaukee Bucks and the Los Angeles Lakers.", "During his career as a center, Abdul-Jabbar was a record six-time NBA Most Valuable Player (MVP), a record 19-time NBA All-Star, a 15-time All-NBA selection, and an 11-time NBA All-Defensive Team member.", "A member of six NBA championship teams as a player and two more as an assistant coach, Abdul-Jabbar twice was voted NBA Finals MVP.", "In 1996, he was honored as one of the 50 Greatest Players in NBA History.", "NBA coach Pat Riley and players Isiah Thomas and Julius Erving have called him the greatest basketball player of all time.", "After winning 71 consecutive basketball games on his high school team in New York City, Alcindor was recruited by Jerry Norman, the assistant coach of UCLA, where he played for coach John Wooden on three consecutive national championship teams and was a record three-time MVP of the NCAA Tournament.", "Drafted with the first overall pick by the one-season-old Bucks franchise in the 1969 NBA draft, Alcindor spent six seasons in Milwaukee." ], [ "1980 NBA Finals", "In the Eastern Conference Finals, the 76ers faced NBA Rookie of the Year Award winner Larry Bird and the 61\u2013win Celtics, and owing to the core's three consecutive playoff appearances, the more experienced 76ers were favored to win the series.", "Proving the prognosticators right, Philadelphia won in five games, preventing the first Celtics\u2013Lakers final since 1969.", "The 76ers were the first of the four Philadelphia professional sports teams to play for their respective sports' championships in the 1980 season.", "The Flyers lost the Stanley Cup Finals against the New York Islanders in overtime of Game 6, eight days after the 76ers fell to the Lakers in their Game 6.", "The Phillies beat the Kansas City Royals, themselves in six games, in the World Series.", "The Eagles lost Super Bowl XV to the Oakland Raiders in January 1981.", "Of note, this marked the first of the ten NBA Finals played in the 1980s, all of which featured either the Boston Celtics or the Los Angeles Lakers (three Finals featured both teams).", "Both teams split the two meetings, each won by the home team:\n\nKareem Abdul-Jabbar, playing on a mission and finally with an effective supporting cast around him, scored 33 points, pulled down 14 rebounds, and had six blocks and five assists on the way to a 109\u2013102 win in the Forum." ] ], "gold": "Kareem Abdul-Jabbar is an American former professional basketball player who played 20 seasons in the National Basketball Association (NBA) for the Milwaukee Bucks and the Los Angeles Lakers. During his career as a center, Abdul-Jabbar was a record six-time NBA Most Valuable Player (MVP), a record 19-time NBA All-Star, a 15-time All-NBA selection, and an 11-time NBA All-Defensive Team member. He scored the most points in a regular season NBA game with 55 points, the most points in a NBA playoff game with 46 points, and the most points in a NCAA game with 61 points.", "prediction 1": "Kareem Abdul-Jabbar scored the most points in a single game in NBA history on March 8, 1980 against the Los Angeles Lakers. Abdul-Jabbar, playing on a mission and finally with an effective supporting cast around him, scored 33 points, pulled down 14 rebounds, had six blocks and five assists on the way to a 109\u2013102 win in the Forum.", "prediction 2": "In the 1980 NBA Finals, Kareem Abdul-Jabbar scored the most points in one game in NBA history in a game against the Los Angeles Lakers. In this game, Kareem scored 33 points, pulled down 14 rebounds, had six blocks and five assists and won 109-102.", "prediction 3": "Kareem Abdul-Jabbar scored the most points in one game in NBA history on April 16, 1981, in a game he played for the Philadelphia 76ers.", "prediction 4": "Kareem Abdul-Jabbar scored the most points in one game in NBA history in the 1980s, when he scored 33 points against the Los Angeles Lakers. The record for the most points in a game was set in the 1977-78 game between the Milwaukee Bucks and the Portland Trail Blazers.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 333 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Kareem Abdul-Jabbar is an American former professional basketball player who played 20 seasons in the National Basketball Association (NBA) for the Milwaukee Bucks and the Los Angeles Lakers. During his career as a center, Abdul-Jabbar was a record six-time NBA Most Valuable Player (MVP), a record 19-time NBA All-Star, a 15-time All-NBA selection, and an 11-time NBA All-Defensive Team member. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the last time australia held the commonwealth games?", "passages": [ [ "Commonwealth Games", "Commonwealth Games\n\nThe Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations.", "The event was first held in 1930, and has taken place every four years since then.", "The Commonwealth Games were known as the British Empire Games from 1930 to 1950, the British Empire and Commonwealth Games from 1954 to 1966, and British Commonwealth Games from 1970 to 1974.", "It is the world's first multi-sport event which inducted equal number of women\u2019s and men\u2019s medal events and was implemented recently in the 2018 Commonwealth Games.", "Their creation was inspired by the Inter-Empire Championships, as a part of the Festival of Empire, which were held in London, United Kingdom in 1911.", "Melville Marks Robinson founded the games as the British Empire Games which were first hosted in Hamilton in 1930.", "During the 20th and 21st centuries, the evolution of the games movement has resulted in several changes to the Commonwealth Games.", "Some of these adjustments include the creation of the Commonwealth Winter Games for snow and ice sports for the commonwealth athletes, the Commonwealth Paraplegic Games for commonwealth athletes with a disability and the Commonwealth Youth Games for commonwealth athletes aged 14 to 18.", "The first edition of the winter games and paraplegic games were held in 1958 and 1962 respectively, with their last edition held in 1966 and 1974 respectively and the first youth games were held in 2000." ], [ "Commonwealth Games", "The 1942 and 1946 Commonwealth Games were cancelled because of the second world war.", "The Commonwealth Games are overseen by the Commonwealth Games Federation (CGF), which also controls the sporting programme and selects the host cities.", "The games movement consists of international sports federations (IFs), (CGAs), and organising committees for each specific Commonwealth Games.", "There are several rituals and symbols, such as the Commonwealth Games flag and Queen's Baton, as well as the opening and closing ceremonies.", "Over 5,000 athletes compete at the Commonwealth Games in more than 15 different sports and more than 250 events.", "The first, second, and third-place finishers in each event receive Commonwealth Games medals: gold, silver, and bronze, respectively.", "Apart from many Olympic sports, the games also include some sports that are played predominantly in Commonwealth countries but which are not part of the Olympic programme, such as lawn bowls, netball and squash.", "Although there are currently 53 members of the Commonwealth of Nations, 71 teams currently participate in the Commonwealth Games, as a number of dependent territories compete under their own flags.", "The four Home Nations of the United Kingdom\u2014England, Scotland, Wales, and Northern Ireland\u2014also send separate teams.", "Nineteen cities in nine countries (counting England, Wales, and Scotland separately) have hosted the event." ] ], "gold": "The Commonwealth Games is an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and, with the exception of 1942 and 1946, has taken place every four years since then. Although there are currently 54 members of the Commonwealth of Nations, 72 teams currently participate in the Commonwealth Games, as a number of dependent territories compete under their own flags. Australia has held the Commonwealth Games several times. The last time they held the games in Sydney was on 5 February - 12 February 1938. The last time they held the games in Perth was on 22 November - 1 December 1962. The last time they held the games in Brisbane was on 30 September - 9 October 1982. The last time they held the games in Melbourne was on 15 March - 26 March 2006. The last time they held the games in Gold Coast was on 4 April - 15 April 2018.", "prediction 1": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. The last time Australia held the commonwealth games was in 2018.", "prediction 2": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. In the 20th and 21st centuries, the evolution of the games movement has resulted in several changes to the Commonwealth Games. Some of these adjustments include the creation of the Commonwealth Winter Games for snow and ice sports for the commonwealth athletes, the Commonwealth Paraplegic Games for commonwealth athletes with a disability and the first Youth Games for commonwealth athletes aged 14 to 18.", "prediction 3": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. During the 20th and 21st centuries, the evolution of the games movement has resulted in several changes to the Commonwealth Games, including the creation of the Commonwealth Winter Games for snow and ice sports for the commonwealth athletes, the Commonwealth Paraplegic Games for commonwealth athletes with a disability and the Commonwealth Youth Games for commonwealth athletes aged 14 to 18.", "prediction 4": "The Commonwealth Games are an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and has taken place every four years since then. The Commonwealth Games were known as the British Empire Games from 1930 to 1950, the British Empire and Commonwealth Games from 1954 to 1966, and British Commonwealth Games from 1970 to 1974. The 2018 Commonwealth Games were the first time that Australia held the commonwealth games.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 198, "end": 262 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Commonwealth Games is an international multi-sport event involving athletes from the Commonwealth of Nations. The event was first held in 1930, and, with the exception of 1942 and 1946, has taken place every four years since then. Although there are currently 53 members of the Commonwealth of Nations, 71 teams currently participate in the Commonwealth Games, as a number of dependent territories compete under their own flags. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who sings the song it never rains in southern california?", "passages": [ [ "It Never Rains (In Southern California)", "It Never Rains (In Southern California)\n\n\"It Never Rains (In Southern California)\" is a 1990 song recorded by the American R&B group Tony!", "Toni! Ton\u00e9!.", "This song peaked at number one on the \"Billboard\" Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100.", "The music video to \"It Never Rains (In Southern California)\" was directed by actress Lisa Bonet." ], [ "It Never Rains in Southern California", "It Never Rains in Southern California\n\n\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter.", "Instrumental backing was provided by L.A. session musicians from the Wrecking Crew.", "The song appears on Hammond's album \"It Never Rains in Southern California\" and peaked at number five on the U.S. \"Billboard\" Hot 100 chart.", "In the UK, the song is perhaps the quintessential example of a turntable hit: a song that, although very frequently played and requested on radio, never makes it into the charts.", "Through the 1970s, the record was reissued at least five times by various labels but never charted, despite yet more airplay, and is still frequently heard on UK radio.", "The song concerns the struggles of an actor who moves to California to pursue a career in Hollywood but does not have any success and deteriorates in the process.", "In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya.", "It pours, man, it pours.\"", "In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation." ] ], "gold": "It Never Rains in Southern California is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. The song appears on Hammond's album It Never Rains in Southern California and peaked at number five on the U.S. Billboard Hot 100 chart. It Never Rains (In Southern California) is a 1990 song recorded by the American R&B group Tony! Toni! Ton\u00e9!. This song peaked at number one on the Billboard Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100.", "prediction 1": "It Never Rains in Southern California is sung by Albert Hammond, a British-born singer-songwriter. The 1972 song was written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. The 1990 song \"It Never Rains (In Southern California)\" was recorded by the American R&B group Tony! Toni! Ton\u00e9!", "prediction 2": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by British-born singer-songwriter Hammond. Instrumental backing was provided by L.A. session musicians from the Wrecking Crew. In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya. It pours, man, it pours.\" In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation.", "prediction 3": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. The song appeared on Hammond's album \"It Never Rains in Southern California\" and peaked at number five on the U.S. Billboard Hot 100. In 1989, Hammond re-recorded the song for his \"Best of Me\" greatest hits compilation. In 1990, Tony! Toni! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Toni! Toni! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Toni! Ton\u00e9! Ton\u00e9! Ton\u00e9! Toni! Toni! Ton\u00e9! Ton\u00e9! Ton\u00e9! Toni! Ton\u00e9! Ton\u00e9! Ton\u00e9! Ton\u00e9! Toni! Toni!", "prediction 4": "\"It Never Rains in Southern California\" is a 1972 song written by Albert Hammond and Mike Hazlewood and sung by Hammond, a British-born singer-songwriter. In the chorus, Hammond sings: \"It never rains in California, but girl don't they warn ya. It pours, man, it pours.\" In 1990, the song was recorded by the American R&B group Tony! Toni! Ton\u00e9!.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "It Never Rains in Southern California is sung by Albert Hammond, a British-born singer-songwriter. ", "start": 162, "end": 216 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "It Never Rains in Southern California is sung by Albert Hammond, a British-born singer-songwriter. The 1972 song was written by Albert Hammond and Mike Hazlewood. The song appears on Hammond's album \"It Never Rains in Southern California\" and peaked at number five on the U.S. \"Billboard\" Hot 100 chart. The 1990 song \"It Never Rains (In Southern California)\" was recorded by the American R&B group Tony! Toni! Ton\u00e9! This song peaked at number one on the \"Billboard\" Hot R&B Singles chart in 1990 for two weeks, and thirty-four on the Hot 100." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the song grandma got run over?", "passages": [ [ "Grandma Got Run Over by a Reindeer", "But this time, Oink chose to handle all nationwide product distribution themselves, ending the old NSD-Soundwaves agreement.", "Re-recorded Oink #2984 45 copies appeared on a white label, not a cream-colored label, however.", "That is the easiest way (aside from listening to the 45 itself) to differentiate between the original, 1979 Oink #2984 recording and its now-much-more familiar, 1982 re-recording.", "An entire LP, named after their hit song, was also recorded in 1982, and was initially released as Oink #8223.", "In 1984, with the song now a big hit nationally, CBS Records was interested in re-issuing both the 1982 Oink 45 re-recording, and the 1982 Oink LP.", "Soon after, Epic Records acquired the rights to both, from Elmo and Patsy.", "The Epic #04703 45 opted to replace the Oink 45's B-side, \"Christmas\", with a track from the LP, (\"Percy, the Puny Poinsettia\").", "Epic's 1984 re-release of the 1982 Oink LP was a straight re-issue, on Epic #39931." ], [ "Grandma Got Run Over by a Reindeer", "Grandma Got Run Over by a Reindeer\n\n\"Grandma Got Run Over by a Reindeer\" is a novelty Christmas song.", "Written by Randy Brooks, the song was originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979.", "In the lyrics, a grandmother is celebrating at a Christmas Eve party with her family when, while off her medication and drunk on spiked eggnog, she staggers outside into a snowstorm against the pleas of everyone in the room.", "She is found the next day, trampled; Santa Claus and his reindeer are determined to be the culprit when \"incriminating Claus marks\" are found on Grandma's back.", "The second and third verses describe the Christmas gathering where \"all the family's dressed in black\" and the family wonders if all the Christmas gifts they bought for her should be returned (the consensus is a firm yes)." ], [ "Grandma Got Run Over by a Reindeer", "Christmas dinner otherwise goes on as normal, with a centerpiece of roast goose, figgy pudding for dessert, and \"blue and silver candles\" to match Grandma's hairpiece; the newly widowed Grandpa seems completely unfazed by his wife's demise and spends the holiday \"watching football, drinking beer and playing cards with Cousin Mel\" (who, while not stated as such in the lyrics, is an attractive and much younger woman in the music video and animated film).", "The upshot is a warning to the listener to be aware, because \"a man who drives a sleigh and plays with elves\" should never receive a driver's license.", "In the music video, in which Elmo plays both Grandma and Grandpa while Patsy plays Cousin Mel, Grandma survives the attack and makes a triumphant return through the chimney.", "According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn.", "A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as \"Grandma\"." ] ], "gold": "Grandma Got Run Over by a Reindeer is a novelty Christmas song. Written by Randy Brooks, the song was originally performed by the husband-and-wife duo of Elmo Shropshire and Patsy Trigg in 1979. According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn. A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as Grandma. In 1982, the duo both re-recorded and re-released the song as a single with Oink Records. Epic Records acquired the rights to the song in 1984 and re-released the 1982 Oink LP.", "prediction 1": "Grandma Got Run Over by a Reindeer is a novelty Christmas song written by Randy Brooks that was originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979. In 1982, with the song now a big hit nationally, CBS Records was interested in re-issuing both the 1982 Oink 45 re-recording, and the 1982 Oink LP. Soon after, Epic Records acquired the rights to both, from Elmo and Patsy Trigg Shropshire.", "prediction 2": "\"Grandma Got Run Over by a Reindeer\" is a novelty Christmas song written by Randy Brooks that was originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979. According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn. A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as Grandma.", "prediction 3": "The novelty Christmas song \"Grandma Got Run Over by a Reindeer\" was originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979. According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn. A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as \"Grandma.\"", "prediction 4": "\"Grandma Got Run Over by a Reindeer\" is a novelty Christmas song written by Randy Brooks and originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979. According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn. A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as Grandma.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 337, "end": 428 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Grandma Got Run Over by a Reindeer is a novelty Christmas song written by Randy Brooks that was originally performed by the husband-and-wife duo of Elmo and Patsy Trigg Shropshire in 1979. According to Brooks, he played the song while sitting in with Elmo and Patsy at the Hyatt Lake Tahoe in December 1978, and after the show they had him make a cassette of the song for them to learn. A year later, they were selling 45s of the song from the stage, with Elmo himself appearing in drag on the album cover as \"Grandma\". In 1982, with the song now a big hit nationally, CBS Records was interested in re-issuing both the 1982 Oink 45 re-recording, and the 1982 Oink LP. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When do the live shows start for agt?", "passages": [ [ "Got Talent", "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016.", "From season 12 (2017), the new host of AGT is Tyra Banks.", "The grand prize for the winner(s) is US$1 million, and, since season 3, a chance to headline a show on the Las Vegas Strip.", "\"America's Got Talent\" proved extremely successful for NBC, pulling in high ratings in both total viewers and the younger 18-49 demographic.", "The show's initial success in America is credited with the eventual launch of the British series, and the overall global launch of the \"Got Talent\" franchise.", "ITV eventually debuted \"Britain's Got Talent\" on 9 June 2007 with Cowell, Morgan and Amanda Holden as judges, and Ant & Dec as hosts of the show.", "For series 5, Morgan stepped down due to commitments hosting \"Piers Morgan Tonight\" on CNN, and Cowell only attended the live shows as he was busy launching \"The X Factor USA\", so Michael McIntyre and David Hasselhoff joined the panel with Holden." ], [ "America's Got Talent (season 11)", "After the Judge Cuts, three wildcards were selected to compete in the live shows: FLIP, Steven Brundage and Sila Sveta (who did not perform in the Judge Cuts round).", "Guest judge: Ne-Yo\n\nDate: July 12, 2016\n\n", "This was the first Judge Cuts not to feature any acts getting four red buzzers.", "Although Hara is a multimedia illusionist, his act he performed did not include any multimedia.", "Guest judge: Reba McEntire\n\nDate: July 13, 2016\n\nGuest judge:", "George Lopez\n\nDate: July 19, 2016\n\nGuest judge: Louis Tomlinson\n\nDate: July 20, 2016\n\n", "This was the only episode of Judge Cuts this season in which acts received four red buzzers.", "Note\n\n\nThe live quarterfinals were held at the Dolby Theatre, starting on July 26, 2016.", "They featured the nine golden buzzer acts, the 24 acts passed through during the Judge Cuts round, and three wildcard acts chosen by the producers and judges.", "Twelve acts performed each week.", "Seven acts made it through to the semi-finals, while five were eliminated.", "Outlawz, ThroWings, Vello Vaher, and Alla and Daniel received an \"X\" in the live shows." ], [ "America's Got Talent (season 12)", "Guest judge: Seal\n\nDate: August 8, 2017\n\n", "The quarterfinals were broadcast live from the Dolby Theatre in Los Angeles starting on August 15, 2017.", "They featured the nine golden buzzer acts, the 24 other acts promoted during the Judge Cuts round, and three wildcard acts chosen by the producers and judges.", "Twelve acts performed each week, with results announced the on following nights; each week seven acts were sent through to the semifinals.", "Puddles Pity Party and Mirror Image received an \"X\" from Cowell in the Quarterfinals.", "Demian Aditya received \"X's\" by Mel B and Cowell in the second Quarterfinals.", "Guests: Grace VanderWaal, August 16\n\nGuests: Circus 1903 \n\nGuests: Mat Franco, Piff the Magic Dragon, and Jon Dorenbos, August 30\n", "The live semifinals started on September 5, 2017.", "They featured the 21 acts voted to the semifinals, plus the judges' semifinal wildcard pick.", "Each week, eleven acts performed; five went through to the finals, and six were eliminated.", "No acts were buzzed.", "Guests: The Clairvoyants\n\nGuests: Absinthe\n\nThe final performances took place on September 19, followed by the final results show on September 20, 2017.", "No acts were buzzed.", "The season finale took place on September 20, 2017." ] ], "gold": "When the live shows start for AGT, the televised talent show America's Got Talent, depends on the year. The live shows started for AGT in 2017 on August 15, 2017, in 2016 on July 26, 2016, and in 2015 on August 11, 2015.", "prediction 1": "America's Got Talent has had live shows since season 11, starting on July 26, 2016. The live quarterfinals were held at the Dolby Theatre, starting on July 26, 2016, the live semifinals were broadcast live from the Dolby Theatre in Los Angeles starting on August 5, 2017 and the live results show started on September 20, 2017.", "prediction 2": "America's Got Talent's live shows started on July 26, 2016 for the quarterfinals, and on August 15, 2017 for the semifinals. For the season finale, the live shows started on September 20, 2017. The live shows for the season finale started on September 20, 2017.", "prediction 3": "America's Got Talent's live shows start on the day they finish airing the episode they finished airing on July 26, 2016. The live quarterfinals for the season 11 and the live semifinals for the season 12 started on the day they finished airing, which was August 15, 2017. The live finals for the season 2017 started on September 5, 2017.", "prediction 4": "The live shows for America's Got Talent start on the dates specified below. The live quarterfinals were broadcast live from the Dolby Theatre in Los Angeles starting on July 26, 2016. The live semifinals were broadcast live from the Dolby Theatre in Las Vegas starting on September 5, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 83 } ], "missing-info": [], "corrected-prediction": "The live quarterfinals were held at the Dolby Theatre, starting on July 26, 2016, the live semifinals were broadcast live from the Dolby Theatre in Los Angeles starting on August 5, 2017 and the live results show started on September 20, 2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the language in the dominican republic?", "passages": [ [ "Dominican Republic", "Ethnic immigrant groups in the country include West Asians\u2014mostly Lebanese, Syrians, and Palestinians.", "East Asians, primarily ethnic Chinese and Japanese, can also be found.", "Europeans are represented mostly by Spanish whites but also with smaller populations of German Jews, Italians, Portuguese, British, Dutch, Danes, and Hungarians.", "Some converted Sephardic Jews from Spain were part of early expeditions; only Catholics were allowed to come to the New World.", "Later there were Jewish migrants coming from the Iberian peninsula and other parts of Europe in the 1700s.", "Some managed to reach the Caribbean as refugees during and after the Second World War.", "Some Sephardic Jews reside in Sos\u00faa while others are dispersed throughout the country.", "Self-identified Jews number about 3,000; other Dominicans may have some Jewish ancestry because of marriages among converted Jewish Catholics and other Dominicans since the colonial years.", "Some Dominicans born in the United States now reside in the Dominican Republic, creating a kind of expatriate community.", "The population of the Dominican Republic is mostly Spanish-speaking.", "The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and the Canarian Spanish.", "In addition, it has influences from African languages and borrowed words from indigenous Caribbean languages particular to the island of Hispaniola." ], [ "Dominican Republic", "Schools are based on a Spanish educational model; English and French are mandatory foreign languages in both private and public schools, although the quality of foreign languages teaching is poor.", "Some private educational institutes provide teaching on other languages, notably Italian, Japanese, and Mandarin.", "Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants.", "There is a community of a few thousand people whose ancestors spoke Saman\u00e1 English in the Saman\u00e1 Peninsula.", "They are the descendants of formerly enslaved African Americans who arrived in the nineteenth century, but only a few elders speak the language today.", "Tourism, American pop culture, the influence of Dominican Americans, and the country's economic ties with the United States motivate other Dominicans to learn English.", "The Dominican Republic is ranked 2nd in Latin America and 23rd in the World on English proficiency.", "95.0% Christians
\n2.6%", "No religion
\n2.2% Other religions \n\n, 57% of the population (5.7 million) identified themselves as Roman Catholics and 23% (2.3 million) as Protestants (in Latin American countries, Protestants are often called \"Evangelicos\" because they emphasize personal and public evangelising and many are Evangelical Protestant or of a Pentecostal group)." ], [ "Dominican Republic", "Dominican Republic\n\nThe Dominican Republic ( ) is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region.", "It occupies the eastern five-eighths of the island, which it shares with the nation of Haiti, making Hispaniola one of two Caribbean islands, along with Saint Martin, that are shared by two sovereign states.", "The Dominican Republic is the second-largest Caribbean nation by area (after Cuba) at , and third by population with approximately 10 million people, of which approximately three million live in the metropolitan area of Santo Domingo, the capital city.", "Christopher Columbus landed on the island on December 5, 1492, which the native Ta\u00edno people had inhabited since the 7th century.", "The colony of Santo Domingo became the site of the first permanent European settlement in the Americas, the oldest continuously inhabited city, and the first seat of the Spanish colonial rule in the New World.", "After more than three hundred years of Spanish rule the Dominican people declared independence in November 1821.", "The leader of the independence movement Jos\u00e9 N\u00fa\u00f1ez de C\u00e1ceres, intended the Dominican nation to unite with the country of Gran Colombia, but no longer under Spain's custody the newly independent Dominicans were forcefully annexed by Haiti in February 1822.", "Independence came 22 years later after victory in the Dominican War of Independence in 1844." ] ], "gold": "The Dominican Republic is a country located on the island of Hispaniola in the Greater Antilles archipelago of the Caribbean region. The official language of the country is Spanish. The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and has similarities to Canarian Spanish. Haitian Creole, which is a French-based creole language spoken by 10\u201312 million people worldwide, is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants. ", "prediction 1": "The population of the Dominican Republic is mostly Spanish-speaking. The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and the Canarian Spanish. Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants. Haitian Creole is also the largest language spoken in the Dominican Republic by descendants of formerly enslaved African Americans who arrived in the nineteenth century.", "prediction 2": "The population of the Dominican Republic is mostly Spanish-speaking. The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and the Canarian Spanish. Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants. Haitian Creole is also the language of the largest minority in the Dominican Republic and is spoken by Haitian immigrants and their descendants.", "prediction 3": "The population of the Dominican Republic is mostly Spanish-speaking. The local variant of Spanish is called Dominican Spanish. Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants. There is also a community of a few thousand people whose ancestors spoke Saman\u00e1 English in the Saman\u00e1 Peninsula.", "prediction 4": "The population of the Dominican Republic is mainly Spanish-speaking. The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and the Canarian Spanish. Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 522 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Dominican Republic is a country located in the island of Hispaniola, in the Greater Antilles archipelago of the Caribbean region. The population of the Dominican Republic is mostly Spanish-speaking. The local variant of Spanish is called Dominican Spanish, which closely resembles other Spanish vernaculars in the Caribbean and the Canarian Spanish. Haitian Creole is the largest minority language in the Dominican Republic and is spoken by Haitian immigrants and their descendants." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Original singer of rock me mama like a wagon wheel?", "passages": [ [ "Wagon Wheel (song)", "The chorus and melody for the song come from a demo recorded by Bob Dylan during the \"Pat Garrett and Billy the Kid\" sessions in February 1973.", "Although never officially released, the Dylan song was released on a bootleg recording, usually named after the chorus and its refrain, \"Rock Me Mama\".", "Dylan left the song an unfinished sketch.", "Ketch Secor of Old Crow Medicine Show wrote verses for the song around Dylan's original chorus (and melody):\n\nChris \"Critter\" Fuqua, Secor's school friend and future bandmate, first brought home a Bob Dylan bootleg from a family trip to London containing the rough outtake called \"Rock Me, Mama\".", "Not \"so much a song as a sketch, crudely recorded featuring most prominently a stomping boot, the candy-coated chorus and a mumbled verse that was hard to make out\", the tune kept going through Secor's mind.", "A few months later, while attending Phillips Exeter Academy in New Hampshire, and \"feeling homesick for the South,\" he added verses about \"hitchhiking his way home full of romantic notions put in his head by the Beat poets and, most of all, Dylan.\"" ], [ "Wagon Wheel (song)", "Wagon Wheel (song)\n\n\"Wagon Wheel\" is a song co-written by Bob Dylan and Ketch Secor of Old Crow Medicine Show.", "Dylan recorded the chorus in 1973; Secor added verses 25 years later.", "Old Crow Medicine Show's final version was certified Platinum by the Recording Industry Association of America in April 2013.", "The song has been covered numerous times, notably by Nathan Carter in 2012 and Darius Rucker in 2013.", "Rucker's version reached No. 1 on the Hot Country Songs chart and was certified triple Platinum by the RIAA in March 2014.", "The song describes a hitchhiking journey south along the eastern coast of the United States, from New England in the northeast, through Roanoke, Virginia, with the intended destination of Raleigh, North Carolina, where the narrator hopes to see his lover.", "As the narrator is walking south of Roanoke, he catches a ride with a trucker who is traveling from Philadelphia through Virginia westward toward the Cumberland Gap and Johnson City, Tennessee.", "Old Crow Medicine Show's version of the song is in 2/4 time signature, with an approximate tempo of 76 half notes per minute.", "It uses the I\u2013V\u2013vi\u2013IV pattern in the key of A major, with the main chord pattern of A\u2013E\u2013Fm\u2013D. \"Wagon Wheel\" is composed of two different parts." ] ], "gold": "There are several original singers of \"rock me mama like a wagon wheel.\" The original singer of its chorus was Bob Dylan, who recorded the chorus to the song Wagon Wheel in 1973. The original singer of verses added to it was Old Crow Medicine Show's Ketch Secor, who added verses to Wagon Wheel 25 years later.", "prediction 1": "The chorus and melody for the song come from a demo recorded by Bob Dylan during the \"Pat Garrett and Billy the Kid\" sessions in February 1973. Ketch Secor of Old Crow Medicine Show wrote verses for the song around Dylan's original chorus and melody. Secor added verses 25 years later.", "prediction 2": "The chorus and melody for the song come from a demo recorded by Bob Dylan during the \"Pat Garrett and Billy the Kid\" sessions in February 1973. Ketch Secor of Old Crow Medicine Show wrote verses for the song around Dylan's original chorus and melody. Secor added verses 25 years later while attending Phillips Exeter Academy in New Hampshire, and \"feeling homesick for the South,\" he added verses about hitchhiking his way home full of romantic notions put in his head by the Beat poets and, most of all of all, Dylan. Secor added verses about \"hitchhiking his way home full of romantic notions put in his head by the Beat poets and, most of all of all, Dylan.\"", "prediction 3": "\"Wagon Wheel\" is a song co-written by Bob Dylan and Ketch Secor of Old Crow Medicine Show. The chorus and melody for the song come from a demo recorded by Bob Dylan during the \"Pat Garrett and Billy the Kid\" sessions in February 1973. Secor wrote verses for the song around Dylan's original chorus and melody.", "prediction 4": "The chorus and melody came from a demo recorded by Bob Dylan during the \"Pat Garrett and Billy the Kid\" sessions in February 1973. Ketch Secor of Old Crow Medicine Show wrote verses for the song around Dylan's original chorus and melody. Secor added verses 25 years later.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 125 } ], "missing-info": [], "corrected-prediction": "The chorus and melody for the song come from a demo recorded by Bob Dylan in February 1973. Ketch Secor of Old Crow Medicine Show wrote verses for the song around Dylan's original chorus and melody. Secor added verses 25 years later." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What territory did us gain from spanish-american war?", "passages": [ [ "Puerto Rico", "U.S. military installations in Puerto Rico were part of the U.S. Atlantic Command (LANTCOM after 1993 USACOM), which had authority over all U.S. military operations that took place throughout the Atlantic.", "Puerto Rico had been seen as crucial in supporting LANTCOM's mission until 1999, when U.S. Atlantic Command was renamed and given a new mission as United States Joint Forces Command.", "Puerto Rico is currently under the responsibility of United States Northern Command.", "Both the Naval Forces Caribbean (NFC) and the Fleet Air Caribbean (FAIR) were formerly based at the Roosevelt Roads Naval Station.", "The NFC had authority over all U.S. Naval activity in the waters of the Caribbean while FAIR had authority over all U.S. military flights and air operations over the Caribbean.", "With the closing of the Roosevelt Roads and Vieques Island training facilities, the U.S. Navy has basically exited from Puerto Rico, except for the ships that steam by, and the only significant military presence in the island is the U.S. Army at Ft Buchanan, the Puerto Rican Army and Air National Guards, and the U.S. Coast Guard.", "Protests over the noise of bombing practice forced the closure of the naval base.", "This resulted in a loss of 6,000 jobs and an annual decrease in local income of $300 million." ], [ "Treaty of Paris (1898)", "Treaty of Paris (1898)\n\n", "The Treaty of Paris of 1898 (Filipino: \"Kasunduan sa Paris ng 1898;\" Spanish: \"Tratado de Par\u00eds (1898)\") was an agreement made in 1898 that involved Spain relinquishing nearly all of the remaining Spanish Empire, especially Cuba, and ceding Puerto Rico, Guam, and the Philippines to the United States.", "The cession of the Philippines involved a payment of $20 million from the United States to Spain.", "The treaty was signed on December 10, 1898, and ended the Spanish\u2013American War.", "The Treaty of Paris came into effect on April 11, 1899, when the documents of ratification were exchanged.", "The Treaty of Paris marked the end of the Spanish Empire (apart from some small holdings in Northern Africa as well as several islands and territories around the Gulf of Guinea, also in Africa).", "It marked the beginning of the age of the United States as a world power.", "Many supporters of the war opposed the treaty, and it became one of the major issues in the election of 1900 when it was opposed by Democrat William Jennings Bryan because he opposed imperialism.", "Republican President William McKinley upheld the treaty and was easily reelected." ], [ "Estado Libre Asociado de Puerto Rico", "Estado Libre Asociado de Puerto Rico\n\nEstado Libre Asociado de Puerto Rico is the official name of the Commonwealth of Puerto Rico.", "Literally translated, it means \"\"Associated Free State of Puerto Rico\"\".", "The official name was adopted in 1952.", "Puerto Rico is an unincorporated territory of the United States.", "Some authorities have stated that the official name \"Estado Libre Asociado\" constitutes an euphemism, that is, a term intended to give positive appearances to negative events or even mislead entirely, and have charged that the official name in English of \"Commonwealth\" constitutes a fig leaf, i.e., a term used figuratively and associated with the covering up of an act that is actually embarrassing or distasteful with something of innocuous appearance." ] ], "gold": "The US gained several territories from the Spanish-American War, including the island of Puerto Rico in the Atlantic Ocean and, in the Pacific Ocean, the Philippine Islands and Guam, an island in Micronesia. In the Treaty of Paris of 1898, which ended the Spanish-American War, Spain ceded Puerto Rico, Guam, and the Philippines to the United States.", "prediction 1": "The United States gained Puerto Rico and Guam in the Spanish-American War. The Treaty of Paris was an agreement made in 1898 that involved Spain relinquishing nearly all of the remaining Spanish Empire, especially Cuba, and ceding Puerto Rico, Guam, and the Philippines to the United States. The cession of the Philippines involved a payment of $20 million from the United States to Spain. The Estado Libre Asociado de Puerto Rico is the official name of the Commonwealth of Puerto Rico.", "prediction 2": "There were several territories gained by the United States from the Spanish\u2013American War. Puerto Rico was part of the United States Atlantic Command (LANTCOM after 1993 USACOM), which had authority over all U.S. military operations that took place throughout the Atlantic. The Treaty of Paris of 1898 was an agreement made in 1898 that involved Spain relinquishing nearly all of the remaining Spanish Empire, especially Cuba, and ceding Puerto Rico, Guam, and the Philippines to the United States. The cession of the Philippines involved a payment of $20 million from the United States to Spain.", "prediction 3": "Puerto Rico was part of the United States Atlantic Command until 1999, when the command was renamed and given a new mission as United States Joint Forces Command. With the closing of the Roosevelt Roads Naval Station, the U.S. Navy has basically exited from Puerto Rico, except for the ships that steam by, and the only significant military presence in the island is the U.S. Army at Ft Buchanan, the Puerto Rican Army and Air National Guards, and the U.S. Coast Guard. Puerto Rico is an unincorporated territory of the United States.", "prediction 4": "The United States gained territory from the Spanish-American War by ceding Puerto Rico, Guam, and the Philippines to the United States. The United States gained Puerto Rico, Guam, and the Philippines by signing the Treaty of Paris. The United States gained Puerto Rico, Guam, and the Philippines by paying $20 million to Spain for their holdings in Northern Africa.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 487 }, { "error type": "Redundant", "explanation": "The United States gained Puerto Rico and Guam in the Spanish-American War. ", "start": 231, "end": 249 } ], "missing-info": [], "corrected-prediction": "The Treaty of Paris was an agreement made in 1898 that involved Spain ceding Puerto Rico, Guam, and the Philippines to the United States. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played elizabeth bennet in pride and prejudice?", "passages": [ [ "Pride and Prejudice (1995 TV series)", "Pride and Prejudice (1995 TV series)\n\nPride and Prejudice is a six-episode 1995 British television drama, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name.", "Jennifer Ehle and Colin Firth starred as Elizabeth Bennet and Mr. Darcy.", "Produced by Sue Birtwistle and directed by Simon Langton, the serial was a BBC production with additional funding from the American A&E Network.", "BBC1 originally broadcast the 55-minute episodes from 24 September to 29 October 1995.", "The A&E Network aired the series in double episodes on three consecutive nights beginning 14 January 1996.", "Critically acclaimed and a popular success, \"Pride and Prejudice\" was honoured with several awards, including a BAFTA Television Award for Jennifer Ehle for \"Best Actress\" and an Emmy for \"Outstanding Individual Achievement in Costume Design for a Miniseries or a Special\".", "The role of Mr Darcy elevated Colin Firth to stardom.", "A scene showing Firth in a wet shirt was recognised as \"one of the most unforgettable moments in British TV history\".", "\"The New York Times\" called the adaptation \"a witty mix of love stories and social conniving, cleverly wrapped in the ambitions and illusions of a provincial gentry\"." ], [ "Pride and Prejudice (1995 TV series)", "The president of the Jane Austen Society of North America noted in an otherwise positive review that the casting of the 2005 leads was \"arguably a little more callow than Firth and Ehle\" and that \"Knightley is better looking than Lizzy should strictly be\".", "The critical reception of MacFadyen's Darcy, whose casting had proven difficult because \"Colin Firth cast a very long shadow\", ranged from praise to pleasant surprise and dislike.", "Several critics did not observe any significant impact of Macfadyen's Darcy in the following years.", "Garth Pearce of \"The Sunday Times\" noted in 2007 that \"Colin Firth will forever be remembered as the perfect Mr. Darcy\", and Gene Seymour stated in a 2008 \"Newsday\" article that Firth was \"'universally acknowledged' as the definitive Mr. Darcy\"." ], [ "Pride and Prejudice (1967 TV series)", "Pride and Prejudice (1967 TV series)\n\nPride and Prejudice is a 1967 BBC television serial, based on Jane Austen's novel of the same name, originally published in 1813.", "This production marked the 150th anniversary of the death of Jane Austen.", "It was directed by Joan Craft and starred Celia Bannerman and Lewis Fiander as the protagonists Elizabeth Bennet and Mr. Darcy.", "This version omits the middle Bennet sister, Mary.", "Original air dates:" ], [ "Elizabeth Garvie", "Elizabeth Garvie\n\nElizabeth Garvie (born 1957 in Bristol) is an English actress best known for her role as Elizabeth Bennet in the 1980 BBC dramatisation of \"Pride and Prejudice\".", "Garvie was married to the actor Anton Rodgers until his death on 1 December 2007.", "She survives him with their three sons.", "They appeared together in the Thames Television serial 'Something In Disguise', written and dramatised by Elizabeth Jane Howard.", "Miss Garvie is a Trustee of The Actors' Children's Trust (helping children of actors)." ] ], "gold": "There has been a 1980 TV series, a 1995 TV series, and a 2005 film all entitled Pride and Prejudice. English actress Elizabeth Garvie played Elizabeth Bennet in the 1980 TV series, while English-American actress Jennifer Ehle did in the 1995 TV series. In the 2005 film, English actress Keira Knightley played Bennet, the protagonist in the 1813 novel Pride and Prejudice.", "prediction 1": "The 1967 Pride and Prejudice television series was based on Jane Austen's novel of the same name, originally published in 1813. In the 1980 BBC dramatisation of Pride and Prejudice, Elizabeth Garvie played Elizabeth Bennet. In the 1995 television series, Jennifer Ehle and Colin Firth starred as Elizabeth Bennet and Mr. Darcy.", "prediction 2": "Pride and Prejudice is a British period drama television series, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name. It starred Jennifer Ehle as Elizabeth Bennet and Colin Firth starred as Mr. Darcy. There was also a 1967 version of the serial with Celia Bannerman and Lewis Fiander playing the characters. Elizabeth Garvie played Elizabeth Bennet in the 1980 BBC dramatisation of Pride and Prejudice.", "prediction 3": "Pride and Prejudice is a 1995 British television drama, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name. Jennifer Ehle and Colin Firth starred as Elizabeth Bennet and Mr. Darcy. In the 1967 BBC television serial, Elizabeth Bennet was played by Celia Bannerman and Lewis Fiander. Elizabeth Garvie played Elizabeth Bennet in the 1980 BBC dramatisation of Pride and Prejudice.", "prediction 4": "Pride and Prejudice is a British romantic comedy television serial, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name. In the 1965 adaptation, Jennifer Ehle played Ethel Bennet, while in the 1967 adaptation, Celia Bannerman played Elizabeth Bennet. In the 1980 adaptation, Elizabeth Garvie played Elizabeth Bennet. In the 1995 edition, Jennifer Ehle played Elizabeth Bennet and in the 2005 adaptation, Jennifer Ehle played Elizabeth Bennet.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 327 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 1967 Pride and Prejudice television series was based on Jane Austen's novel of the same name, originally published in 1813. It starred Celia Bannerman as the protagonists Elizabeth Bennet. In the 1980 BBC dramatisation of Pride and Prejudice, Elizabeth Garvie played Elizabeth Bennet. In the 1995 television series, Jennifer Ehle starred as Elizabeth Bennet." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was involved in the ww1 christmas truce?", "passages": [ [ "Christmas truce", "One unusual phenomenon that grew in intensity was music; in peaceful sectors, it was not uncommon for units to sing in the evenings, sometimes deliberately with an eye towards entertaining or gently taunting their opposite numbers.", "This shaded gently into more festive activity; in early December, Sir Edward Hulse of the Scots Guards wrote that he was planning to organise a concert party for Christmas Day, which would \"give the enemy every conceivable form of song in harmony\" in response to frequent choruses of \"Deutschland \u00dcber Alles\".", "Roughly 100,000 British and German troops were involved in the unofficial cessations of hostility along the Western Front.", "The first truce started on Christmas Eve 1914, when German troops decorated the area around their trenches in the region of Ypres, Belgium and particularly in Saint-Yvon (called Saint-Yves, in Plugstreet/Ploegsteert \u2013 Comines-Warneton), where Capt. Bruce Bairnsfather described the truce.", "The Germans placed candles on their trenches and on Christmas trees, then continued the celebration by singing Christmas carols.", "The British responded by singing carols of their own.", "The two sides continued by shouting Christmas greetings to each other." ], [ "Christmas truce", "In the Comines sector of the front there was an early fraternization between German and French soldiers in December 1914, during a short truce, and there are at least two other testimonials, from French soldiers, of similar behaviours in sectors where German and French companies opposed each other.", "Gervais Morillon wrote to his parents: \u2018The Boches waved a white flag and shouted \"Kamarades, Kamarades, rendez-vous.\"", "When we didn\u2019t move they came towards us unarmed, led by an officer.", "Although we are not clean they are disgustingly filthy.", "I am telling you this but don\u2019t speak of it to anyone.", "We must not mention it even to other soldiers.\u2019", "Gustave Berthier wrote: \u2018On Christmas day the Boches made a sign showing they wished to speak to us.", "They said they didn\u2019t want to shoot...", "They were tired of making war, they were married like me, they didn\u2019t have any differences with the French but with the English.\u2019\n\n", "In sections of the front where German and Belgian troops faced each other in December 1914, there was at least one such instance when a truce was achieved at the request of Belgian soldiers who wished to send letters back to their families, over the German-occupied parts of their own country." ], [ "Christmas truce", "He asked \"that the guns may fall silent at least upon the night the angels sang.\"", "This attempt was officially rebuffed.", "Fraternisation\u2014peaceful and sometimes friendly interactions between opposing forces\u2014was a regular feature in quiet front-line sectors of the Western Front.", "In some areas, it manifested as a passive inactivity, where both sides would refrain from overtly aggressive or threatening behaviour, while in other cases it extended to regular conversation or even visits from one trench to another.", "Truces between British and German units can be dated to early November 1914, around the time opposing armies had begun static trench warfare.", "At this time, both sides' rations were brought up to the front line after dusk, and soldiers on both sides noted a period of peace while they collected their food.", "By 1 December, a British soldier could record a friendly visit from a German sergeant one morning \"to see how we were getting on\".", "Relations between French and German units were generally more tense, but the same phenomenon began to emerge.", "In early December, a German surgeon recorded a regular half-hourly truce each evening to recover dead soldiers for burial, during which French and German soldiers exchanged newspapers." ] ], "gold": "The Christmas truce was a series of widespread unofficial ceasefires during WWI around Christmas 1914. Over the Western Front of the War, roughly 100,000 British and German troops ceased hostilities when the Germans started decorating the areas around the trenches. Similar events of fraternization happened over in the Comines sector of the front between German and French soldiers and between Austro-Hungarians and Russians over in the Eastern Front.", "prediction 1": "Roughly 100,000 British and German troops were involved in the unofficial cessations of hostility along the Western Front. The first truce started on Christmas Eve 1914, when German troops decorated the area around their trenches in the region of Ypres, Belgium and particularly in Saint-Yvon. The Germans placed candles on their trenches and on Christmas trees, then continued the celebration by singing Christmas carols. The British responded by singing carols of their own. The two sides continued by shouting Christmas greetings to each other.", "prediction 2": "Roughly 100,000 British and German troops were involved in the unofficial cessations of hostility along the Western Front. The first truce started on Christmas Eve 1914, when German troops decorated the area around their trenches in the region of Ypres, Belgium and particularly in Saint-Yvon (called Saint-Yves, in Plugstreet/Ploegsteert \u2013 Comines-Warneton), where Capt. Bruce Bairnsfather described the truce. The truce was between German and French soldiers.", "prediction 3": "Roughly 100,000 British and German troops were involved in the unofficial cessations of hostility along the Western Front. The first truce started on Christmas Eve 1914, when German troops decorated the area around their trenches in the region of Ypres, Belgium and particularly in Saint-Yvon, in Plugstreet/Ploegsteert \u2013 Comines-Warneton, where Capt. Bruce Bairnsfather described the truce. The Germans placed candles on their trenches and on Christmas trees, then continued the celebration by singing Christmas carols. The British responded by singing carols of their own. The two sides continued by shouting Christmas greetings to each other.", "prediction 4": "There was a Christmas truce in WW1, in which 100,000 British and German troops were involved. The truce started on Christmas Eve 1914, when German troops decorated the area around their trenches in the region of Ypres, Belgium and particularly in Saint-Yvon, in Plugstreet/Ploegsteert \u2013 Comines-Warneton, where Capt. Bruce Bairnsfather described the truce. The Germans placed candles on their trenches and on Christmas trees, then continued the celebration by singing Christmas carols. The British responded by singing carols of their own.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 293 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 476 }, { "error type": "Irrelevant", "explanation": "", "start": 477, "end": 547 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Roughly 100,000 British and German troops were involved in the unofficial cessations of hostility along the Western Front. The first truce started on Christmas Eve 1914, when German troops decorated the area around their trenches. In the Comines sector of the front there was an early fraternization between German and French soldiers in December 1914." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Number of branches of jammu and kashmir bank?", "passages": [ [ "Jammu & Kashmir Bank", "Jammu & Kashmir Bank\n\nJammu and Kashmir Bank (J&K Bank) is a J&K -based private sector banking and financial services company.", "It is a Private-owned bank with state share with its headquarters in Srinagar, Jammu and Kashmir.", "J&K Bank, incorporated on October 1, 1938, was the first bank in the country to emerge as a state\u2013owned bank.", "On November 22 2018, the Governor-led State Administrative Council (SAC) had approved the proposal for treating Jammu and Kashmir Bank Limited as a Public Sector Undertaking (PSU).", "The SEC also comprises the four state advisers and the J&K Chief Secretary.", "However the move was criticised by all regional parties of the state.", "The Jammu and Kashmir Bank was founded on 1 October 1938 under letters patent issued by the Maharaja of Jammu and Kashmir, Maharaja Hari Singh.", "The Maharaja had invited eminent investors to become the founding directors and shareholders of the bank.", "The most notable of which were Pandit Sriniwas Magotra, Abdul Aziz Mantoo, Pesten jee and the Bhaghat Family, all of whom acquired major shareholdings.", "The bank commenced the banking business on 4 July 1939 and was considered the first of its nature and composition as a State owned bank in the country." ], [ "Bank of Azad Jammu & Kashmir", "Bank of Azad Jammu & Kashmir\n\nBank of Azad Jammu & Kashmir is the state-owned bank of Government of Azad Kashmir which is based in Muzafarabad, Azad Kashmir.", "It was founded in 2005.", "The bank has network of almost 65 branches all of which are located in territory of Azad Kashmir." ], [ "Jammu & Kashmir Bank", "The bank was established as a semi-State Bank with participation in capital by State and the public under the control of State Government.", "In year 1971, the bank had acquired the status of a scheduled bank and was declared as an \"A\" Class bank by the Reserve Bank of India in 1976.", "The bank had to face serious problems at the time of independence when out of its total of ten branches two branches of Muzaffarabad, Rawalakot and Mirpur fell to the other side of the line of control (now Pakistan administered Kashmir) along with cash and other assets.", "Following the extension of Central laws to the state of Jammu & Kashmir, the bank was defined as a government company as per the provisions of Indian companies act 1956.", "The bank celebrated its platinum jubilee in the year 2013.", "To make the year remarkable, the bank achieved a total business of Rs 1000\u00a0billion and earned a net profit of Rs 10\u00a0billion.", "On 1 April 2013 the bank surpassed the target of promised Rs 1000\u00a0billion business and is confident of meeting its other annual targets as well in its Platinum Jubilee year.", "On 15 May 2013, bank announced that it has achieved the target of promised Rs 10\u00a0billion profit for the FY 2012\u201313.", "The bank posted net profit of Rs 10551\u00a0million and business turnover of Rs 1034\u00a0billion for the FY 2012\u201313." ] ], "gold": "Jammu & Kashmir Bank Limited is a nationalized bank under the ownership of the Ministry of Finance, Government of India. When it was incorporated back in 1938, the bank had a total of 10 branches. Another bank with similar name is the Bank of Azad Jammu & Kashmir, a state-owned bank of the Government of Azad Kashmir, which was founded in 2005 and has 65 branches.", "prediction 1": "The Jammu and Kashmir Bank was founded on October 1, 1938, under letters patent issued by the Maharaja of Jammu and Kashmir, Maharaja Hari Singh. It was the first bank in the country to emerge as a state-owned bank. Bank of Azad Jammu & Kashmir is the state-owned bank of Government of Azad Kashmir which is based in Muzafarabad, Azad Kashmir. It was founded in 2005.\n", "prediction 2": "Jammu and Kashmir Bank is a private sector banking and financial services company based in Srinagar, Jammu and Kashmir. The bank was incorporated on October 1, 1938 and became the first bank in the country to emerge as a state-owned bank. Bank of Azad Jammu & Kashmir is the state-owned bank of Government of Azad Kashmir which is based in Muzafarabad, Azad Kashmir. Established in 2005. The bank has network of almost 65 branches all of which are located in territory of Azad Kashmir. The oldest branch of the bank was started operating on February 2016-W.", "prediction 3": "Jammu and Kashmir Bank is a J&K -based private sector banking and financial services company. It is a Private-owned bank with State share with its headquarters in Srinagar, Jammu and Kashmir. Bank of Azad Jammu & Kashmir is the state-owned bank of Government of Azad Kashmir which is based in Muzafarabad, Azad Kashmir. It was founded in 2005. The bank has network of almost 65 branches all of which are located in territory of Azad Kashmir.", "prediction 4": "Jammu and Kashmir Bank, incorporated on October 1, 1938, was the first bank in the country to emerge as a state-owned bank. Bank of Azad Jammu & Kashmir is the state-owned bank of Government of Azad Kashmir which is based in Muzafarabad, Azad Kashmir. It was founded in 2005. Bank of Azad Jammu & Kashmir has network of almost 65 branches all of which are located in territory of Azad Kashmir.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 145 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 343 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Jammu and Kashmir Bank was founded in 1938. It was the first bank in the country to emerge as a state-owned bank and had a total of 10 branches. Another bank with similar name is Bank of Azad Jammu & Kashmir, a state-owned bank of Government of Azad Kashmir. It was founded in 2005. The bank has network of almost 65 branches.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did bill knapps go out of business?", "passages": [ [ "Bill Knapp's", "In 2001, Bill Knapp's tried to reverse course by announcing that \"The Tradition is Back,\" restoring the original menu and some original d\u00e9cor, but by then it was too late.", "On Tuesday May 21, 2002, Bill Knapp\u2019s filed for voluntary Chapter 11 protection in U.S. Bankruptcy Court for the Western District of Michigan.", "At the time company operated 29 restaurants.", "By the end of 2002, the chain's last restaurant had closed.", "Bill Knapp's 6-inch chocolate birthday cakes, officially known as Bill Knapp's Celebration Cakes, were regarded as one of the chain's dearest features.", "Because of the popularity of the cakes, Awrey's Bakery purchased the rights to make them, following Bill Knapp's original recipe.", "The cakes are available from Awrey's in-store bakery and at many Kroger Stores as well.", "Winn-Dixie and Kroger now also carry Bill Knapp's Chocolate, Nutty, and Glazed Dunkers." ], [ "Bill Knapp's", "Bill Knapp's\n\nBill Knapp's was an American family restaurant chain.", "It was founded by\nClinton B. Knapp (March 13, 1907 \u2013 October 15, 1974), in Battle Creek, Michigan, in 1948.", "The chain operated in Michigan, Ohio, Florida, Illinois and Indiana, with more than 60 locations at its peak.", "Bill Knapp's featured a menu primarily filled with typical family dining items.", "The menu included a limited breakfast, sandwiches, baskets, and luncheon and dinner plates.", "A children's menu, featuring meals named for animals, was also offered.", "Recipes for their fried chicken, bean soup, ham croquettes, vegetable soup, onion rings, au gratin potatoes, and chocolate cakes (later purchased by Awrey Bakeries) were also featured.", "Locations replenished inventory on a daily basis from the commissary in Battle Creek, Mich. with their own fleet of trucks.", "Bill Knapp placed great emphasis on the quality and freshness of the food, with added emphasis on preparing the food \"from scratch.\"", "Bill Knapp \"was interested in providing decent food for a reasonable price with friendly service.\"", "The target clientele of his restaurants was families, often three generations eating together at long tables pushed together." ] ], "gold": "Bill Knapp's was an American family restaurant chain that was founded by Clinton B. Knapp in Battle Creek, Michigan in 1948. It featured a menu filled with typical family fare as well as a children's menu. Bill Knapp placed great emphasis on the quality and freshness of the food served in his restaurant, which was prepared from scratch. Bill Knapp's filed for Chapter 11 bankruptcy on May 21, 2002, and by the end of 2002, the last restaurant in the chain closed.", "prediction 1": "Bill Knapp's was an American family restaurant chain that was founded by Clinton B. Knapp, March 13, 1907 \u2013 October 15, 1974, in Battle Creek, Michigan, in 1948. The company operated in Michigan, Ohio, Florida, Illinois and Indiana, with more than 60 locations at its peak. In 2002, Bill Knapp's filed for voluntary Chapter 11 protection in U.S. Bankruptcy Court for the Western District of Michigan. In 2001, the company tried to reverse course by announcing that \"The Tradition is Back.\" But by then it was too late.", "prediction 2": "Bill Knapp's was an American family restaurant chain which operated in Michigan, Ohio, Florida, Illinois and Indiana. At its peak, the chain operated in more than 60 locations in ten states and two Canadian provinces. The chain went out of business on May 21, 2002 when the company filed for voluntary Chapter 11 protection in U.S. Bankruptcy Court for the Western District of Michigan.", "prediction 3": "Bill Knapp's was an American family restaurant chain. It was founded by Clinton B. Knapp on March 13, 1907 and operated in Michigan, Ohio, Florida, Illinois and Indiana, with more than 60 locations at its peak. On May 21, 2002, the restaurant filed for voluntary Chapter 11 protection in U.S. Bankruptcy Court for the Western District of Michigan.", "prediction 4": "Bill Knapp's was an American family restaurant chain, founded by Clinton B. Knapp in 1948 in Battle Creek, Michigan. The chain operated in Michigan, Ohio, Florida, Illinois and Indiana, with more than 60 locations at its peak. Bill Knapp's was interested in providing decent food for a reasonable price with friendly service. It was filed for Chapter 11 protection in U.S. Bankruptcy Court for the Western District of Michigan on May 21, 2002.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 401, "end": 518 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Bill Knapp's was an American family restaurant chain that was founded by Clinton B. Knapp, March 13, 1907 \u2013 October 15, 1974, in Battle Creek, Michigan, in 1948. Bill Knapp's featured a menu primarily filled with typical family dining items. Bill Knapp placed great emphasis on the quality and freshness of the food, with added emphasis on preparing the food \"from scratch.\" In May 21, 2002, Bill Knapp's filed for voluntary Chapter 11 protection in U.S. Bankruptcy Court. By the end of 2002, the chain's last restaurant had closed." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who was the first person to win a million on who wants to be a millionaire?", "passages": [ [ "John Carpenter (game show contestant)", "John Carpenter (game show contestant)\n\nJohn Carpenter (born c. 1968) is an American game show contestant and IRS agent.", "He is best known for becoming the first top prize winner on the United States version of \"Who Wants to Be a Millionaire\".", "He held the record for the largest single win in United States game show history, until it was broken by Rahim Oberholtzer who won $1.12\u00a0million on another U.S. quiz show, \"Twenty One\".", "Carpenter was also the first top prize winner among all international versions of the \"Who Wants to Be a Millionaire?\" series.", "On the November 19, 1999 episode of \"Millionaire\", Carpenter proceeded to advance to the million-dollar question without using any lifelines.", "He then used his Phone-A-Friend to call his father not for help, but rather to tell him he was going to win the game.", "Carpenter answered the question correctly and became the show's first millionaire.", "His win gave him national recognition and led to multiple talk show appearances, as well as reappearances on \"Millionaire\" himself.", "Carpenter is from Northampton, Massachusetts.", "His father, Tom, worked as a computer program analyst for the Department of Veterans Affairs, while his mother, Gail, served as an administrative assistant for the Massachusetts Audubon Society." ], [ "Judith Keppel", "Judith Keppel\n\nJudith Cynthia Aline Keppel (born 18 August 1942) was the first one-million-pound winner on the television game show \"Who Wants to Be a Millionaire?\" in the United Kingdom.", "She is the first person to have won a million pounds or more on a British television game show.", "She has appeared on the BBC Two quiz show \"Eggheads\" since 2003.", "Keppel's father Hon Walter Arnold Crispian Keppel (1914\u20131996) was a lieutenant commander in the Fleet Air Arm, who moved with the family to various naval postings around Britain until they settled in London when she was 17.", "She took A-levels at St Mary's School, Wantage, and completed a secretarial course, and married her first husband Desmond Corcoran, an art dealer.", "The couple went on to have three children, Sibylla, Alexander, and Rosie, but divorced in 1980.", "In 1985 she married comedy script writer Neil Shand.", "They separated in 1987.", "Keppel is the granddaughter of Walter, 9th Earl of Albemarle.", "Her great-grandfather, the 8th Earl, was elder brother to George Keppel and brother-in-law of Alice Keppel (the mistress of King Edward VII), and the great-granduncle of Camilla, Duchess of Cornwall.", "The Duchess of Cornwall is therefore her third cousin." ], [ "Who Wants to Be a Millionaire?", "Who Wants to Be a Millionaire?", "Who Wants to Be a Millionaire?", "(abbreviated WWTBAM and informally known as simply Millionaire) is an international television game show franchise of British origin, created by David Briggs, Mike Whitehill and Steven Knight.", "In its format, currently owned and licensed by Sony Pictures Television, contestants tackle a series of multiple-choice questions to win large cash prizes, with the format being a twist on the game show genre \u2013 only one contestant plays at a time, similar to radio quizzes; contestants are given the question before attempting an answer, and have no time limit to answer questions; and the amount offered increases as they tackle questions that become increasingly difficult.", "The maximum cash prize offered in most versions of the format is one million of the local currency.", "The original British version debuted on 4 September 1998, and was aired until its final episode on 11 February 2014; a revived series of seven episodes to commemorate its 20th anniversary in 2018, were aired from 5 to 11 May.", "Since its debut, international variants of the game show have been aired in around 160 countries worldwide.", "The format of the show was created by David Briggs, Mike Whitehill and Steven Knight, who had earlier created a number of the promotional games for Tarrant's morning show on Capital FM radio, such as the bong game." ] ], "gold": "Who Wants to Be a Millionaire? is an international television game show franchise of British origin, created by David Briggs, Mike Whitehill and Steven Knight where contestants tackle a series of multiple-choice questions to win large cash prizes in a format contestants are given the question before attempting an answer, and have no time limit to answer questions; and the amount offered increases as they tackle questions that become increasingly difficult. The first person to win a million on the show was John Carpenter, who won the prize on the American version in November 1999 and did not use a lifeline until the final question, using his Phone-a-Friend not for help but to call his father to tell him he was about to win the million. Chimuanya Aroma Ufodike was the first person to win 10 million on the Nigerian version of the show in 2009. Other notable top-prize winners include Judith Keppel, the first winner of the original British version, and Rob \"Coach\" Fulton who was the first person to win a million on the Australian version of the show on October 17, 2005.", "prediction 1": "Who Wants to Be a Millionaire? (abbreviated WWTBAM and informally known as simply Millionaire) is an international television game show franchise of British origin, created by David Briggs, Mike Whitehill and Steven Knight. It is a twist on the game show genre in that contestants tackle a series of multiple-choice questions to win large cash prizes. John Carpenter was the first top prize winner on the United States version of Who Wants to Be a Millionaire. Rahim Oberholtzer won $1.12 million on another U.S quiz show, Twenty One.", "prediction 2": "The game show Who Wants to Be a Millionaire is an international television game show franchise of British origin, created by David Briggs, Mike Whitehill and Steven Knight. The first person to win a million on the show was American contestant John Carpenter in 1999. He was also the first person to win a million pounds on the show. Judith Keppel in the United Kingdom was the first person to win a million pounds or more on a British television game show.", "prediction 3": "The international television game show Who Wants to Be a Millionaire? has been aired in 160 countries. The first person to win a million on the game show is John Carpenter, an American game show contestant and IRS agent. On the November 19, 1999 episode of Millionaire, Carpenter proceeded to advance to the million-dollar question without using any lifelines. He then used his Phone-A-Friend to call his father not for help, but rather to tell him he was going to win the game. He answered the question correctly, and became the show's first millionaire.", "prediction 4": "John Carpenter, an American game show contestant, was the first person to win a million on Who Wants to Be a Millionaire. The first one million-pound winner on the television game show \"Who Wants to Be a Millionaire?\" was Judith Keppel, a British citizen, who also won a million dollars.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 461, "end": 534 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Who Wants to Be a Millionaire? (abbreviated WWTBAM and informally known as simply Millionaire) is an international television game show franchise of British origin, created by David Briggs, Mike Whitehill and Steven Knight. It is a twist on the game show genre in that where contestants tackle a series of multiple-choice questions to win large cash prizes, in a format contestants are given the question before attempting an answer, and have no time limit to answer questions; and the amount offered increases as they tackle questions that become increasingly difficult. John Carpenter was the first top prize winner on the United States version of Who Wants to Be a Millionaire. On the November 19, 1999 episode of \"Millionaire\", Carpenter proceeded to advance to the million-dollar question without using any lifelines. He then used his Phone-A-Friend to call his father not for help, but rather to tell him he was going to win the game. Judith Keppel was the first winner of the original British version." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was the forbidden city opened to the public?", "passages": [ [ "Forbidden City F.C.", "Forbidden City F.C.", "Forbidden City Football Club (FC FC) (Simplified Chinese: \u7d2b\u7981\u57ce\u8db3\u7403\u4ff1\u4e50\u90e8) is a Chinese amateur Association Football (soccer) based in Beijing.", "The club was founded in 2004 and is a not-for profit Voluntary association social club, playing 11 a-side competitive football in the IFFC.", "Members of the club are national Chinese as well as from other countries, representing a wide expatriate contingent as common in Beijing.", "Before joining the IFFC League in August 2004, members of Forbidden City FC played for various amateur football clubs in the Beijing Club football 11-aside League, which was disbanded in 2003 during the SARS outbreak, and because Clubfootball decided to concentrate on 5-aside football.", "FCFC's inaugural match was on tour to Shanghai, to participate in the bi-annual Shanghai Shooters 7-aside competition, where FCFC picked up their first silverware, winning the Plate competition.", "In their inaugural year 2004/05, Forbidden City FC finished 4th in the First Division of the IFFC League with 27 points after playing 18 competitive matches, winning 8, drawing 3 and losing 7.In 2005/06 FCFC were champions of the First Division with 46 points, playing 18 games, winning 15, drawing 1 and losing 2.", "FCFC therefore gained promotion to the IFFC Premiere Division." ], [ "History of the Forbidden City", "History of the Forbidden City\n\nThe history of the Forbidden City begins in the 15th century when it was built as the palace of the Ming emperors of China.", "It is located in the centre of Beijing, China, and was the Chinese imperial palace from the mid-Ming Dynasty to the end of the Qing Dynasty in 1912.", "It has been a museum since the 1920s.", "Built from 1406 to 1420, the palace complex has undergone many changes.", "After serving as the imperial palace for some five hundred years, the Forbidden City became a museum, the Palace Museum, in 1925.", "In 1987, it was declared a World Heritage Site by UNESCO.", "The site of the Forbidden City was situated on the Imperial city during the Mongol Yuan Dynasty.", "After the collapse of the Yuan Dynasty, the Hongwu Emperor of the Ming Dynasty moved the capital from Beijing in the north to Nanjing in the south, and in 1369 ordered that the Yuan palaces be razed.", "His son Zhu Di was created Prince of Yan with his seat in Beijing.", "In 1402, Zhu Di usurped the throne and became the Yongle Emperor.", "He made Beijing a secondary capital of the Ming empire, and construction began in 1406 of what would become the Forbidden City.", "The Forbidden City's plan was designed by many architects and designers, and then it was examined by the Emperor's Ministry of Work." ], [ "Forbidden City", "After being the home of 24 emperors \u2013 14 of the Ming dynasty and 10 of the Qing dynasty \u2013 the Forbidden City ceased being the political centre of China in 1912 with the abdication of Puyi, the last Emperor of China.", "Under an agreement with the new Republic of China government, Puyi remained in the Inner Court, while the Outer Court was given over to public use, until he was evicted after a coup in 1924.", "The Palace Museum was then established in the Forbidden City in 1925.", "In 1933, the Japanese invasion of China forced the evacuation of the national treasures in the Forbidden City.", "Part of the collection was returned at the end of World War II, but the other part was evacuated to Taiwan in 1948 under orders by Chiang Kai-shek, whose Kuomintang was losing the Chinese Civil War.", "This relatively small but high quality collection was kept in storage until 1965, when it again became public, as the core of the National Palace Museum in Taipei.", "After the establishment of the People's Republic of China in 1949, some damage was done to the Forbidden City as the country was swept up in revolutionary zeal.", "During the Cultural Revolution, however, further destruction was prevented when Premier Zhou Enlai sent an army battalion to guard the city." ] ], "gold": "The Forbidden City is a palace complex that served as the Chinese imperial palace and winter residence of the Emperor of China from 1420 to 1924. The Palace Museum was later established on the site after Puyi, the last Emperor of China, was evicted from the place, opening the city to the public in 1925", "prediction 1": "The Forbidden City was opened to the public on 2 June 1995, and has been a museum since the 1920s. After being the home of 24 emperors, the Forbidden City ceased being the political centre of China in 1912 with the abdication of Puyi, the last Emperor of China. The Forbidden City became a museum in 1925, and was declared a World Heritage Site by UNESCO in 1987.", "prediction 2": "The history of the Forbidden City begins in the 15th century when it was built as the palace of the Ming emperors of China. It is located in the centre of Beijing, China, and was the Chinese imperial palace from the mid-Ming Dynasty to the end of the Qing Dynasty in 1912. It has been a museum since the 1920s. In 2005, FCFC won the first IFFC Premiere Division championship in the 11-a-side competition and finished in the top team finished fourth in the IFFC League.", "prediction 3": "The history of the Forbidden City begins in the 15th century when it was built as the palace of the Ming emperors of China. The palace complex has undergone many changes. After serving as the imperial palace for some five hundred years, the Forbidden City became a museum, the Palace Museum, in 1925. In 1987, it was declared a World Heritage Site by UNESCO. The Forbidden City Football Club is a Chinese amateur association football club, playing 11 a-side competitive football in the IFFC League.", "prediction 4": "The Forbidden City is a palace complex in Beijing, China, that was built from 1406 to 1420, with many changes, including the eviction of the last emperor, Puyi, in 1912. Its former use as the Chinese imperial palace was ceased in 1912 and the building was turned into a museum in 1925, and the Forbidden City Football Club was founded in 2004.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 30, "end": 53 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 92, "end": 98 }, { "error type": "Redundant", "explanation": "The Forbidden City was opened to the public on 2 June 1995, and has been a museum since the 1920s. ", "start": 262, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 205 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4, 5 ] } ], "corrected-prediction": "The Forbidden City was turned into a museum, the Palace Museum, in 1925. Puyi, the last Emperor of China abdicated and was evicted from it in 1924. It was built by 1420, the palace complex was the Chinese imperial palace." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who played the lead in the movie i can only imagine?", "passages": [ [ "I Can Only Imagine (film)", "I Can Only Imagine (film)\n\nI Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time.", "The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid).", "Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "\"I Can Only Imagine\" was released in the United States on March 16, 2018.", "It was a massive box office success, grossing $85 million worldwide against a production budget of $7 million, becoming the fourth highest-grossing music biopic of all-time in the United States.", "Some critics praised it as inspiring and noted it as an improvement compared to other faith-based films, while others called it flat and by-the-numbers.", "At the 2018 Dove Awards, the film won \"Inspirational Film of the Year\".", "10-year-old Bart Millard lives with his mother and abusive father Arthur in Texas.", "One day his mother drops him off at a Christian camp where he meets Shannon.", "Upon his return from camp, Bart finds his mother has left and movers are removing her belongings." ] ], "gold": "I Can Only Imagine is a 2018 American Christian biographical drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the group MercyMe's song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father. Brody Rose played young Bart Millard.", "prediction 1": "I Can Only Imagine is a 2018 American Christian drama film based on the story behind the best-selling Christian single of all time, the MercyMe song of the same name. It stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "prediction 2": "I Can Only Imagine is a 2018 American Christian drama film based on the story behind the best-selling MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father, Dennis Quaid. Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "prediction 3": "I Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "prediction 4": "I Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins, Brody Rose also stars.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 392 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "I Can Only Imagine is a 2018 American Christian biographical drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the group MercyMe's song of the same name, the best-selling Christian single of all time. It stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was the people's republic of china recognized?", "passages": [ [ "Dates of establishment of diplomatic relations with the People's Republic of China", "Dates of establishment of diplomatic relations with the People's Republic of China\n\nSince its founding in 1949, the People's Republic of China (PRC) has had a diplomatic tug-of-war with its rival in Taiwan, the Republic of China (ROC).", "Throughout the Cold War, both governments claimed to be the sole legitimate government of all China and allowed countries to recognize either one or the other.", "Until the 1970s, most Western countries recognized the ROC while the communist bloc and third world countries generally recognized the PRC.", "This gradually shifted and today only while the PRC is recognized by the United Nations, 176 UN member states and 1 UN observer around the world.", "Both the ROC and the PRC maintain the requirement of recognizing its view of the One-China policy to establish or maintain diplomatic relations.", "The PRC was established on 1 October 1949, when the Chinese Civil War was still underway, and the seat of Government of the Republic of China was not relocated to Taipei until December 1949.", "All the countries that recognized the new PRC government in 1949 were communist states.", "The Republic of China, which had occupied China's seat at the United Nations since 1945, was effectively expelled on 25 October 1971." ], [ "Dates of establishment of diplomatic relations with the People's Republic of China", "Its seat was taken over by the People's Republic of China from 15 November 1971, and the migration of relations to the PRC soon followed among members of the Western Bloc, except for the United Kingdom, France, Canada, Italy and the Scandinavian Countries which had previously established diplomatic relations." ] ], "gold": "The People's Republic of China was established and recognized by communist states on 1 October 1949, while the Chinese Civil War was still underway. The Republic of China, which had occupied China's seat at the United Nations since 1945, was expelled on 25 October 1971, and then China's UN seat was taken over by the People's Republic of China on 15 November 1971.", "prediction 1": "Since its founding in 1949, the People's Republic of China (PRC) has had a diplomatic tug-of-war with its rival in Taiwan, the Republic of China (ROC). From 1949 to 1990, the PRC was recognized by 192 countries, 132 of which were members of the Soviet Union and 176 of which were member states. The Republic of China, which had occupied China's seat at the United Nations since 1945, was effectively expelled on 25 October 1971. The seat was taken over by the People's Republic of China from 15 November 1971, and the migration of relations to the PRC soon followed among members of the Western Bloc.", "prediction 2": "The People's Republic of China was recognized on 1 October 1949, when the Chinese Civil War was still underway, and the seat of Government of the Republic of China was not relocated to Taipei until December 1949. Its seat was taken over by the People's Republic of China from 15 November 1971, and the migration of relations to the PRC soon followed among members of the Western Bloc, except for the United Kingdom, France, Canada, Italy and the Scandinavian Countries which had previously established diplomatic relations.", "prediction 3": "The People's Republic of China was established on 1 October 1949, when the Chinese Civil War was still underway, and the seat of Government of the Republic of China was not relocated to Taipei until December 1949. The Republic of China, which had occupied China's seat at the United Nations since 1945, was effectively expelled on 25 October 1971.", "prediction 4": "The PRC was established on 1 October 1949, when the Chinese Civil War was still underway, and the seat of Government of the Republic of China was not relocated to Taipei until December 1949. On 15 November 1971, it took over China's seat at the United Nations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 152, "end": 294 }, { "error type": "Irrelevant", "explanation": "", "start": 510, "end": 600 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The People's Republic of China was established and recognized by communist states on 1 October 1949, while the Chinese Civil War was still underway. The Republic of China, which had occupied China's seat at the United Nations since 1945, was effectively expelled on 25 October 1971. The seat was taken over by the People's Republic of China from 15 November 1971." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who played gaston in the movie beauty and the beast?", "passages": [ [ "Gaston (Beauty and the Beast)", "In the film, Gaston plays out the same role as in the animated movie, though with a few differences.", "Bored with his peaceful life after returning from the war, Gaston pursues Belle, determined to marry her, as she is the most beautiful girl in the village and the only one good enough for him.", "He also finds her independence to be a thrilling challenge, and shows obvious disgust with the bimbettes who constantly fawn over him purely because of his appearance.", "He accosts her at her home, subtly offering his hand in marriage for when Maurice dies, but she turns him down.", "Gaston sulks in the tavern until LeFou cheers him up with a song.", "Maurice appears, claiming that Belle has been imprisoned by the Beast.", "Intrigued, Gaston offers to help Maurice free her as means of gaining both Maurice and Belle's favor.", "Gaston comes to doubt Maurice's claims and reveals the only reason for helping him was so he could give Gaston Belle's hand in marriage.", "When Maurice refuses to allow Gaston to marry Belle, Gaston ties him to a tree, leaving him to the wolves.", "He hopes by doing this, it would coerce Belle into marrying him, as he tells Lefou that after Maurice dies there will be no one to take care of Belle except for him." ], [ "Gaston (Beauty and the Beast)", "Gaston (Beauty and the Beast)\n\nGaston is a fictional character who appears in Walt Disney Pictures' 30th animated feature film \"Beauty and the Beast\" (1991).", "Voiced by American actor and singer Richard White, Gaston is an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast, once he realizes she cares for him instead.", "Gaston serves as a foil personality to the Beast, who was once as vain as Gaston prior to his transformation.", "An original character who is not present in the \"Beauty and the Beast\" fairy tale by Jeanne-Marie Leprince de Beaumont upon which the film is based, Gaston was inspired by Avenant, a character filmmaker Jean Cocteau created specifically for his 1946 film adaptation of the story.", "Created by screenwriter Linda Woolverton, who based the character on some of the ex-boyfriends she dated in her past, Gaston was developed specifically for Disney's adaptation of \"Beauty and the Beast\" because the studio felt that the film could benefit from a strong villain, who is lacking in the original fairy tale.", "As the character evolved from a nonthreatening aristocrat into an arrogant man relentlessly seeking Belle's hand in marriage, Gaston ultimately replaced a female relative of Belle's who the filmmakers had originally created to serve as the film's villain." ] ], "gold": "Gaston is a fictional character who appears in Walt Disney Pictures' 1991, 30th animated feature film \"Beauty and the Beast\". Voiced by American actor and singer Richard White, Gaston is an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast, once he realizes she cares for him instead. Gaston also appears in the 2017 remake, and is played by Welsh actor Luke Evans. ", "prediction 1": "Gaston is a fictional character who appears in Walt Disney Pictures' 30th animated feature film Beauty and the Beast. He is voiced by American actor and singer Richard White. In the 1991 animated film, Gaston also appears as a character in the book Beauty and the Beast, a version of the classic fairy tale that was originally written for children.", "prediction 2": "Gaston is a fictional character who appears in Walt Disney Pictures' 30th animated feature film Beauty and the Beast (1991). American actor and singer Richard White voices Gaston, an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast. Gaston serves as a foil personality to the Beast, who was once as vain as Gaston prior to his transformation. Gaston serves as a foil personality to the Beast, who was once as vain as Gaston prior to his transformation.", "prediction 3": "Gaston is a fictional character who appears in Walt Disney's 30th animated feature film Beauty and the Beast. He is voiced by American actor Richard White. Gaston is an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast.", "prediction 4": "Gaston is a fictional character who appears in Walt Disney Pictures' 30th animated feature film Beauty and the Beast. He is voiced by American actor and singer Richard White. Gaston is an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast, once he realizes she cares for him instead. The 1991 film adapted the classic fairy tale into a movie starring Robert Downey Jr. and Al Pacino.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 175, "end": 348 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Gaston is a fictional character who appears in Walt Disney Pictures' 30th animated feature film Beauty and the Beast. He is voiced by American actor and singer Richard White, Gaston is an arrogant hunter whose unrequited feelings for the intellectual Belle drive him to murder his adversary, the Beast, once he realizes she cares for him instead. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "How many articles are there in the indian constitution?", "passages": [ [ "Constitution of India", "Constitution of India\n\nThe Constitution of India (IAST: ) is the supreme law of India.", "The document lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens.", "It is the longest written constitution of any country on earth.", "B. R. Ambedkar, chairman of the drafting committee, is widely considered to be its chief architect.", "It imparts constitutional supremacy (not parliamentary supremacy, since it was created by a constituent assembly rather than Parliament) and was adopted by its people with a declaration in its preamble.", "Parliament cannot override the constitution.", "It was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950.", "The constitution replaced the Government of India Act, 1935 as the country's fundamental governing document, and the Dominion of India became the Republic of India.", "To ensure constitutional autochthony, its framers repealed prior acts of the British parliament in Article 395.", "India celebrates its constitution on 26 January as Republic Day.", "The constitution declares India a sovereign, socialist, secular, democratic republic, assuring its citizens justice, equality and liberty, and endeavours to promote fraternity.", "Most of the Indian subcontinent was under British rule from 1857 to 1947." ], [ "Constitution of India", "Its calligrapher was Prem Behari Narain Raizada.", "The constitution was published in Dehradun and photolithographed by the Survey of India.", "Production of the original constitution took nearly five years.", "Two days later, on 26 January 1950, it became the law of India.", "The estimated cost of the Constituent Assembly was 6.3 crore (63 million).", "The constitution has had a number of amendments since it was enacted.", "The original 1950 constitution is preserved in a helium-filled case at the Parliament House in New Delhi.", "The Indian constitution is the world's longest for a sovereign nation.", "At its enactment, it had 395 articles in 22 parts and 8 schedules.", "At about 145,000 words, it is the second-longest active constitution \u2013 after the Constitution of Alabama \u2013 in the world.", "The constitution has a preamble and 448 articles, which are grouped into 25 parts.", "With 12 schedules and five appendices, it has been amended 101 times; the latest amendment became effective on 1 July 2017.", "The constitution's articles are grouped into the following parts:\n\nSchedules are lists in the constitution which categorise and tabulate bureaucratic activity and government policy.", "The executive, legislative and judicial branches of government receive their power from the constitution and are bound by it." ] ], "gold": "The Constitution of India is the supreme law of India which lays down the framework that demarcates fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens. It is the longest written constitution of any country. The draft of the Indian constitution consisted of 243 articles and 13 schedules which came to 395 articles and 8 schedules after discussions, debates and amendments.", "prediction 1": "The Indian constitution is the longest written constitution of any country on earth. It lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens. It was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950. At its enactment, it had 395 articles in 22 parts and 8 schedules. The constitution has a preamble and 448 articles, which are grouped into 25 parts. With 12 schedules and five appendices, it has been amended 101 times.", "prediction 2": "The constitution of India, the supreme law of India, has 448 articles, which are grouped into 25 parts. The articles are grouped into the following parts: Schedules: These are lists in the constitution which categorise and tabulate bureaucratic activity and government policy. The preamble of the constitution contains 395 articles in 22 parts and 8 schedules.", "prediction 3": "The Indian constitution is the longest written constitution of any country on earth. It lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens. The constitution was adopted by the Constituent Assembly of India on 26 November 1949 and became effective on 26 January 1950. It has a preamble and 448 articles, which are grouped into 25 parts.", "prediction 4": "The Indian constitution is the world's longest for a sovereign nation. At its enactment, it had 395 articles in 22 parts and 8 schedules. It has 448 articles, which are grouped into 25 parts. The constitution's appendices include lists in the constitution which categorise and tabulate bureaucratic activity and government policy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 304, "end": 416 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Constitution of India is the supreme law of India. It lays down the framework demarcating fundamental political code, structure, procedures, powers, and duties of government institutions and sets out fundamental rights, directive principles, and the duties of citizens. The Indian constitution is the longest written constitution of any country on earth. At its enactment, it had 395 articles in 22 parts and 8 schedules. The constitution has a preamble and 448 articles, which are grouped into 25 parts. With 12 schedules and five appendices, it has been amended 101 times." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Where does the show the office take place?", "passages": [ [ "The Office (U.S. TV series)", "Despite the strict nature in the early years of the series, later seasons seem to have loosened the rules on the format, with the camera crew often going into places that actual documentary crews would not, which also changed the writing and comedy style of the series.", "This inconsistency has received criticism from critics and fans.", "The theme song for \"The Office\" was written by Jay Ferguson and performed by The Scrantones.", "It is played over the title sequence, which features scenes of Scranton, various tasks around the office and the main cast members.", "Some episodes of the series use a shortened version of the theme song.", "Starting with the fourth season, the theme song is played over the closing credits, which previously rolled in silence.", "The exteriors of buildings in the title sequence are actual buildings in Scranton, Pennsylvania, and were shot by cast member John Krasinski.", "The mockumentary format of the show contains no laugh track, and most of the music is diegetic, with songs either sung or played by the characters or heard on radios, computers, or other devices.", "However, songs have been played during montages or the closing credits, such as \"Tiny Dancer\" by Elton John (\"The Dundies\") and \"Islands in the Stream\" by Kenny Rogers and Dolly Parton (\"E-mail Surveillance\")." ], [ "The Office (U.S. TV series)", "The Office (U.S. TV series)\n\nThe Office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons.", "It is an adaptation of the original BBC series of the same name and was adapted for American television by Greg Daniels, a veteran writer for \"Saturday Night Live\", \"King of the Hill\", and \"The Simpsons\".", "It was co-produced by Daniels's Deedle-Dee Productions, and Reveille Productions (later Shine America), in association with Universal Television.", "The original executive producers were Greg Daniels, Howard Klein, Ben Silverman, Ricky Gervais, and Stephen Merchant, with numerous others being promoted in later seasons.", "The series depicts the everyday lives of office employees in the Scranton, Pennsylvania, branch of the fictional Dunder Mifflin Paper Company.", "To simulate the look of an actual documentary, it was filmed in a single-camera setup, without a studio audience or a laugh track.", "The series debuted on NBC as a midseason replacement and aired 201 episodes over the course of its run.", "\"The Office\" initially featured Steve Carell, Rainn Wilson, John Krasinski, Jenna Fischer, and B. J. Novak as the main cast; the series experienced numerous changes to its ensemble cast during its run." ], [ "The Office (UK TV series)", "The Office (UK TV series)\n\nThe Office is a British television mockumentary sitcom, first broadcast in the UK on BBC Two on 9 July 2001.", "Created, written and directed by Ricky Gervais and Stephen Merchant, the program is about the day-to-day lives of office employees in the Slough branch of the fictional Wernham Hogg Paper Company.", "Gervais also stars in the series, playing the central character, David Brent.", "Two six-episode series were made, along with a pair of 58-minute Christmas specials.", "When it was first shown on BBC Two, it was nearly cancelled due to low ratings, but it has since become one of the most successful of all British comedy exports.", "As well as being shown internationally on BBC Worldwide, channels such as BBC Prime, BBC America and BBC Canada, the series has been sold to broadcasters in over 80 countries, including ABC1 in Australia, The Comedy Network in Canada, TVNZ in New Zealand and the pan-Asian satellite channel STAR World, based in Hong Kong.", "The show began airing in The United States on Cartoon Network's late night programing block, Adult Swim on 18 September 2009 until 2012.", "The show centres on themes of social clumsiness, the trivialities of human behaviour, self-importance and conceit, frustration, desperation and fame." ] ], "gold": "The American version of The Office mockumentary sitcom television series depicts the everyday work lives of office employees in the Scranton, Pennsylvania, branch of the fictional Dunder Mifflin Paper Company. It aired on NBC from March 24, 2005, to May 16, 2013, spanning a total of nine seasons. The British version of The Office sitcom, which was created, written and directed by Ricky Gervais and Stephen Merchant and produced by Ash Atalla, follows the day-to-day lives of office employees in the Slough branch of the fictional Wernham Hogg paper company in Berkshire. It first broadcast in the UK on BBC Two on July 9, 2001.", "prediction 1": "The office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons. It is an adaptation of the original BBC series of the same name that was adapted for American television by Greg Daniels, a veteran writer for Saturday Night Live, King of the Hill, and The Simpsons. The show depicts the everyday lives of office employees in the Scranton, Pennsylvania branch of the fictional Dunder Mifflin Paper Company. The Office is a British television mockumentary sitcom, first broadcast in the UK on BBC Two on 9 July 2001.", "prediction 2": "The Office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons. It is an adaptation of the original BBC series of the same name and was adapted for American television by Greg Daniels. The series depicts the everyday lives of office employees in the Scranton, Pennsylvania, branch of the fictional Dunder Mifflin Paper Company. To simulate the look of an actual documentary, it was filmed in a single-camera setup, without a studio audience or a laugh track.", "prediction 3": "The Office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons. The English version was broadcast on BBC Two on 9 July 2001. The American version was broadcast on ABC from March 5, 2006, to March 10, 2007, lasting eight seasons. The British version was broadcast on BBC Two from 9 July 2001 to 6 July 2002, and began airing in the UK on BBC Two on 9 July 2002.", "prediction 4": "The Office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons. It is an adaptation of the original BBC series of the same name and was adapted for American television by Greg Daniels, a veteran writer for Saturday Night Live, King of the Hill, and The Simpsons. The mockumentary format of the show contains no laugh track, and most of the music is diegetic, with songs either sung or played by the characters or heard on radios, computers, or other devices.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 321 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The office is an American television sitcom that aired on NBC from March 24, 2005, to May 16, 2013, lasting nine seasons. The show depicts the everyday lives of office employees in the Scranton, Pennsylvania branch of the fictional Dunder Mifflin Paper Company. The Office is a British television mockumentary sitcom, first broadcast in the UK on BBC Two on 9 July 2001. Created, written and directed by Ricky Gervais and Stephen Merchant, the program is about the day-to-day lives of office employees in the Slough branch of the fictional Wernham Hogg Paper Company." }, "preference": [ 1, 1, 1, 0, 0, 1 ] }, { "question": "Meaning of the moon and star in islam?", "passages": [ [ "Star and crescent", "Star and crescent\n\nThe star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world.", "It develops in the iconography of the Hellenistic period (4th\u20131st centuries BCE) in the Kingdom of Pontus, the Bosporan Kingdom and notably the city of Byzantium by the 2nd century BCE.", "It is the conjoined representation of the crescent and a star, both of which constituent elements have a long prior history in the iconography of the Ancient Near East as representing either Sun and Moon or Moon and Morning Star (or their divine personifications).", "Coins with crescent and star symbols represented separately have a longer history, with possible ties to older Mesopotamian iconography.", "The star, or Sun, is often shown within the arc of the crescent (also called star in crescent, or star within crescent, for disambiguation of depictions of a star and a crescent side by side);", "In numismatics in particular, the term crescent and pellet is used in cases where the star is simplified to a single dot.", "The combination is found comparatively rarely in late medieval and early modern heraldry." ] ], "gold": "The star and crescent is an iconographic symbol used in various historical contexts, but is best known as a symbol of the Ottoman Empire. It is often considered as a symbol of Islam by extension. It is the conjoined representation of a crescent and a star, both elements have a long prior history in the iconography of the Ancient Near East as representing either the Sun and Moon or the Moon and Morning Star, or their divine personifications.", "prediction 1": "The star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world. It develops in the iconography of the Hellenistic period as representing Sun and Moon or Moon and Morning Star or their divine personifications.", "prediction 2": "The star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world. It develops in the iconography of the Hellenistic period in the Kingdom of Pontus, the Bosporan Kingdom and notably the city of Byzantium by the 2nd century BCE. It is the conjoined representation of the crescent and a star, both of which constituent elements have a long prior history in the iconography of the Ancient Near East as representing either Sun and Moon and Morning Star (or their divine personifications).", "prediction 3": "The star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world. It develops in the iconography of the Hellenistic period (4th\u20131st centuries BCE) in the Kingdom of Pontus, the Bosporan Kingdom and notably the city of Byzantium by the 2nd century BCE. It is the conjoined representation of the crescent and a star, both constituent elements have a long prior history in the iconography of the Ancient Near East as representing either Sun and Moon and Morning Star or Moon and Morning Star and Morning Star (or their divine personifications).", "prediction 4": "The star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world. It develops in the iconography of the Hellenistic period (4th\u20131st centuries BCE) in the Kingdom of Pontus, the Bosporan Kingdom and notably the city of Byzantium by the 2nd century BCE. It is the conjoined representation of the crescent and a star, both of which constituent elements have a long prior history in the iconography of the Ancient Near East as representing either Sun and Moon and Morning Star or Moon and Morning Star (or their divine personifications).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 253 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The star and crescent is an iconographic symbol used in various historical contexts but most well known today as a symbol of the former Ottoman Empire and, by popular extension, the Islamic world. It is the conjoined representation of a crescent and a star, both elements have a long prior history in the iconography of the Ancient Near East as representing either the Sun and Moon or the Moon and Morning Star, or their divine personifications." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When did derek shepherd leave grey's anatomy?", "passages": [ [ "Grey's Anatomy (season 11)", "Grey's Anatomy (season 11)\n\nThe eleventh season of the American television medical drama \"Grey's Anatomy\" premiered on September 25, 2014 in the United States on the American Broadcasting Company (ABC) and consists of 25 episodes.", "The season was produced by ABC Studios, in association with Shondaland Production Company and The Mark Gordon Company; the showrunners being Stacy McKee and William Harper.", "The season commenced airing with the episode \"I Must Have Lost it on the Wind\" and concluded with the season finale \"You're My Home\" airing on May 14, 2015.", "The season was officially released on DVD as a six-disc boxset under the title of \"Grey's Anatomy: The Complete Eleventh Season \u2013 Life Changes\" on August 18, 2015 by Buena Vista Home Entertainment.", "The season is the first in which Dr. Cristina Yang, portrayed by Sandra Oh, is not included in the main cast of characters following her departure in previous season's finale.", "The season's main storylines include Meredith Grey (Ellen Pompeo) dealing with \"her person's\" departure, her problematic love-life with her husband Derek Shepherd (Patrick Dempsey), and the arrival of Dr. Maggie Pierce (Kelly McCreary), whom Meredith learns is her half-sister." ] ], "gold": "Derek Shepherd left Grey's Anatomy on May 14, 2015, in episode 11.25, \"You're My Home\".", "prediction 1": "Derek Shepherd left Grey's Anatomy in season 10 episode 5 on Friday, November 4, 2010. He was replaced by Patrick Dempsey in the same episode. Shepherd also left the show following Meredith's departure in season 10 episode 5.", "prediction 2": "Derek Shepherd was a character on the American television medical drama Grey's Anatomy from 2007-2012. Shepherd left the show in Season 10 episode 81, which aired on May 11, 2012.", "prediction 3": "Derek Shepherd departed the series Grey's Anatomy on April 9, 2016, and was replaced by James McKinnon.", "prediction 4": "Derek Shepherd left Grey's Anatomy in the eleventh season on May 14, 2015. The season was produced by ABC Studios, in association with Shondaland Production Company and The Mark Gordon Company, the showrunners being Stacy McKee and William Harper. The episode \"I Must Have Lost it on the Wind\" was the last episode of the season, airing on September 25, 2014.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 86 }, { "error type": "Unverifiable", "explanation": "", "start": 87, "end": 142 }, { "error type": "Unverifiable", "explanation": "", "start": 143, "end": 225 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "What channel is the new yellowstone series going to be on?", "passages": [ [ "Showtime Networks", "Showtime Networks\n\nShowtime Networks Inc. (SNI) is an American entertainment company that oversees the company's premium cable television channels, including its flagship service Showtime.", "It is a subsidiary of media conglomerate CBS Corporation.", "The company was established in 1983 as Showtime/The Movie Channel, Inc. after Viacom and Warner-Amex Satellite Entertainment (now Viacom Media Networks) merged their premium channels, Showtime and The Movie Channel respectively, into one division.", "In 1984, American Express sold their interest in Warner-Amex to Warner Communications (now Warner Media) making Warner the new half-owner of Showtime/TMC.", "In 1985, Warner sold its half-interest to Viacom, making the company a wholly owned subsidiary of Viacom.", "In 1988, the company was renamed Showtime Networks Inc.\n\nSNI, along with CBS, The CW Television Network (formerly UPN), Viacom Outdoor, Spelling Television, CBS Television Studios (formerly CBS Productions, Paramount Television and CBS Paramount Television), CBS Television Distribution (formerly Paramount Domestic Television, CBS Paramount Domestic Television and King World), CBS Studios International (formerly CBS Paramount International Television), Simon & Schuster and other entities became part of CBS Corporation when CBS officially split from Viacom in December 2005.", "SNI managed the CBS, Robert Redford and NBC Universal joint venture Sundance Channel until 2008, when it was sold to Rainbow Media (now AMC Networks)." ], [ "Yellowstone (UK TV series)", "Yellowstone (UK TV series)\n\nYellowstone is a BBC nature documentary series broadcast from 15 March 2009.", "Narrated by Peter Firth, the series takes a look at a year in the life of Yellowstone National Park, examining how its wildlife adapts to living in one of the harshest wildernesses on Earth.", "Yellowstone debuted on BBC Two at 8:00pm on Sunday 15 March 2009 and has three episodes.", "Each 50-minute episode was followed by a ten-minute film called \"Yellowstone People\", featuring visitors to the Park and locals who had assisted the production team.", "The series was the channel's highest-rated natural history documentary in over five years with audiences peaking at over four million.", "In the United States, an edited version of the series was broadcast under the title Yellowstone: Battle for Life.", "It aired as a two-hour TV special, and premiered on Animal Planet on 22 March 2009.", "The series was one of the most popular titles at BBC Worldwide's annual market for international clients with pre-sales to nine territories including Spain (Canal+), Germany (WDR), Russia (Channel 1) and Italy (RTI).", "\"Yellowstone\" was commissioned by Roly Keating, then Controller of BBC Two, as a follow-up to the award-winning series \"Gal\u00e1pagos\" which aired in autumn 2006." ], [ "Clarks Fork Yellowstone River", "Clarks Fork Yellowstone River\n\nThe Clarks Fork of the Yellowstone River (sometimes called the Clark's Fork River) is a tributary of the Yellowstone River, 150\u00a0mi (241\u00a0km) long in the U.S. states of Montana and Wyoming.", "It rises in southern Montana, in the Gallatin National Forest in the Beartooth Mountains, approximately 4\u00a0mi (6\u00a0km) northeast of Cooke City and southwest of Granite Peak.", "It flows southeast into the Shoshone National Forest in northwest Wyoming, east of Yellowstone National Park, then northeast back into Montana.", "It passes Belfry, Bridger, Fromberg, and Edgar, and joins the Yellowstone approximately 2\u00a0mi (3\u00a0km) southeast of Laurel.", "The Clarks Fork of the Yellowstone River should not be confused with the Clark Fork River, which is located in Montana and Idaho." ] ], "gold": "Yellowstone National Park is an American national park located in the western United States. There are various series about the park, like Yellowstone, an American television series that premiered on June 20, 2018, on the Paramount Network. Yellowstone is also a British nature documentary series by BBC, broadcast from 15 March 2009.", "prediction 1": "The new BBC nature documentary series Yellowstone debuted on BBC Two at 8:00pm on Sunday 15 March 2009 and has three episodes. In the United States, an edited version of the series was broadcast under the title Yellowstone: Battle for Life. It aired as a two-hour TV special, and premiered on Animal Planet on 22 March 2009.\n", "prediction 2": "The TV series Yellowstone was a BBC Two broadcast from March 15 to March 29, 2009. It will air on BBC Two at 8:00pm, the channel at which it was originally airing in the UK. In the United States, the series has been aired as a two-hour TV special on March 22 and March 23 on Animal Planet.", "prediction 3": "Yellowstone is a BBC nature documentary series that premiered on BBC Two at 8:00pm on Sunday 15 March 2009. In the United States, an edited version of the series was broadcast under the title Yellowstone: Battle for Life. Yellowstone was the channel's highest-rated natural history documentary in over five years with audiences peaking at over four million.", "prediction 4": "Yellowstone, a BBC television series, debuted on BBC Two at 8:00pm on Sunday 15 March 2009. In the UK, Yellowstone is a BBC nature documentary series broadcast from March 15 to October 12, 2009. In the United States, an edited version of the series was broadcast under the title Yellowstone: Battle for Life. There was also a five-episode special which premiered on Animal Planet on March 22, 2009.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The new BBC nature documentary series Yellowstone debuted on BBC Two at 8:00pm on Sunday 15 March 2009 and has three episodes. In the United States, an edited version of the series was broadcast under the title Yellowstone: Battle for Life. It aired as a two-hour TV special, and premiered on Animal Planet on 22 March 2009.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does new bob's burgers come out?", "passages": [ [ "Bob's Burgers", "On October 7, 2015, Fox renewed the series for the seventh and eighth production cycles.", "On March 27, 2018, Fox renewed the series for a ninth season, which premiered on September 30, 2018.", "A feature film of the animated television series is in the works and is scheduled for a July 17, 2020 release.", "The show centers on the Belcher family\u2014Bob, Linda, and their children Tina, Gene, and Louise; who run a burger restaurant on Ocean Avenue in an unnamed seaside community (informally known as \"Seymour's Bay\" among the show's writing staff).", "While series creator Loren Bouchard has said that the show's location was an indeterminate Northeastern United States shore town (calling the setting a \"semi-Springfield)\", some critics, particularly after the episode \"It Snakes a Village\", have deduced that the unidentified setting appears to actually be southern New Jersey.", "A bus driver in the episode \"Eat, Spray, Linda\" references a stop at Wildwood Wharf, which may refer to Wildwood, New Jersey, a city on the southeastern coast of the state.", "Bob's Burgers is located in a green two-story building which features an apartment on the second floor where the Belcher family lives." ], [ "Bob's Burgers", "Bob's Burgers\n\nBob's Burgers is an American animated sitcom created by Loren Bouchard that premiered on Fox on January 9, 2011.", "The series centers on the Belcher family \u2013 parents Bob and Linda and their children Tina, Gene and Louise \u2013 who run a hamburger restaurant.", "The show was conceived by Bouchard after he developed \"Home Movies\".", "It is produced and distributed in association with 20th Century Fox Television.", "While reviews for the first season were mixed, feedback for subsequent seasons has been much more positive.", "The series premiere, \"Human Flesh\", drew in 9.39 million viewers, making it the highest-rated series premiere of the season and finishing ninth in the ratings for the week it aired.", "Reruns began airing on Cartoon Network's late night programming block Adult Swim on June 23, 2013 and began airing in syndication on local stations in September 2015.", "A comic book series based on the show, published by Dynamite Entertainment, began in September 2014 and a soundtrack album was released on May 12, 2017.", "In 2013, \"TV Guide\" ranked \"Bob's Burgers\" as one of the top 60 Greatest TV Cartoons of All Time.", "The series has been nominated for several awards, including the Emmy Award for Outstanding Animated Program seven consecutive times, winning in 2014 and 2017." ] ], "gold": "The twelfth season of the American animated television series Bob's Burgers will debut on Fox on September 26, 2021. However, the feature film based on this series that was set to be released on July 17, 2020 been postponed to May 27, 2022 due to the effects of the COVID-19 pandemic.", "prediction 1": "Bob's Burgers is an American animated sitcom created by Loren Bouchard that premiered on Fox on January 9, 2011 and centers on the Belcher family \u2013 parents Bob and Linda and their children Tina, Gene and Louise \u2013 who run a hamburger restaurant. The series premiered on January 9, 2011, and reruns began airing on Cartoon Network's late night programming block Adult Swim on June 23, 2013 and began airing in syndication on local stations in September 2015. On October 7, 2015, Fox renewed the series for the seventh and eighth production cycles, which premiered on September 30, 2018. A feature film of the animated television series is in the works and is scheduled for a July 17, 2020 release.\n", "prediction 2": "Bob's Burgers is an American animated comedy television series created by Loren Bouchard, that premiered on Fox on January 9, 2011 and aired for 10 seasons on Fox until March 27, 2018. On November 27, 2014, the series was renewed for the sixth and seventh seasons, respectively, which premiered on September 30, 2014-January 9, 2015. A feature film of the animated television series is in the works and is scheduled for a July 17, 2020 release.", "prediction 3": "The American animated sitcom Bob's Burgers premiered on Fox in 2011 and ran for seven seasons between January 9, 2011 and May 7, 2015. The series was renewed by Fox for a ninth season on September 30, 2018 and a feature film premiered on July 17, 2020. Episode 16, \"BB's Hockey,\" aired on April 18, 2019, and aired on September 23, 2018.", "prediction 4": "Cuts of episodes from the American animated sitcom Bob's Burgers that aired on Fox from 2011 to 2018 went live on September 23, 2018. The season seven premiere was on August 21, 2012 and the season eight premiere was on September 30, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 456 }, { "error type": "Irrelevant", "explanation": "", "start": 457, "end": 545 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The series premiered on January 9, 2011. The ninth season premiered on September 30, 2018. A feature film of the animated television series is in the works and is scheduled for a July 17, 2020 release.\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who plays the oldest sister on last man standing?", "passages": [ [ "Last Man Standing (U.S. TV series)", "On June 19, 2012, it was also announced that twins Luke and Evan Kruntchev, who played the role of Boyd in season 1, would not be returning; they were replaced by Flynn Morrison in season 2.", "The character of Boyd was also age-advanced from two years old to five years old.", "Jordan Masterson plays Ryan, Boyd's father, in a recurring role beginning in season 2.", "The role was previously played by Nick Jonas, who guest-starred in one episode in season 1.", "The second season initially received a 13-episode order.", "ABC announced on November 12, 2012, that an additional three scripts had been ordered.", "On November 27, five more episodes were ordered to bring the second-season episode total to 18.", "On May 10, 2013, the series was renewed for a third season, which premiered on September 20, 2013, and ended on April 25, 2014, after 22 episodes.", "On May 10, 2014, ABC renewed \"Last Man Standing\" for a fourth season, which premiered on October 3, 2014.", "Allen and Elizondo guest-starred as their \"Last Man Standing\" characters in a crossover episode with the fellow ABC Friday sitcom \"Cristela\".", "On May 10, 2015, ABC announced the show had been renewed for a fifth season." ], [ "Last Man Standing (U.S. TV series)", "Last Man Standing (U.S. TV series)\n\n", "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd.", "Distributed by 20th Century Fox Television, the series originally ran on ABC from 2011 to 2017 for six seasons, and entered syndication in 2015.", "Despite being ABC's second-highest rated sitcom for the 2016\u201317 season, it was revealed in May 2017 that the network had declined to renew \"Last Man Standing\" for a seventh season.", "Media publications reported that ABC was unwilling to cover the production costs for a seventh season on behalf of 20th Century Fox Television.", "One year later, the studio's sibling network Fox announced it had picked up the show for a seventh season, which premiered on September 28, 2018.", "The series follows Mike Baxter, a senior executive and director of marketing for an outdoor sporting goods store chain based in Denver, Colorado.", "His home life is initially filled with his wife, three daughters and a grandson, but later extends to the young men who are married to or dating his daughters.", "Several notable guest stars have appeared throughout the series, including appearances made from cast members of Tim Allen's previous series, \"Home Improvement\"." ], [ "Alexandra Krosney", "Alexandra Krosney\n\nAlexandra Benjamin Krosney (born January 28, 1988) is an American actress.", "She is best known for her role as Kristin Baxter on the ABC sitcom \"Last Man Standing\" during the show's first season.", "Some of Krosney's other television roles include \"Bones\", \"Lost\", \"Cory in the House\", \"ER\", \"Nikita\", \"Numb3rs\", \"NCIS\" and the computer animated series \"\".", "Krosney also appeared in the television films such as the Disney Channel Original Movie \"Read It and Weep\", Nickelodeon original movies \"Shredderman Rules\" and \"The Last Day of Summer\".", "From 2011 to 2012, she co-starred in the ABC sitcom \"Last Man Standing\" starring Tim Allen.", "On June 11, 2012, it was announced that Krosney was let go from the sitcom for unspecified creative reasons.", "The role has been played by Amanda Fuller from season 2 onward." ] ], "gold": "In the American sitcom Last Man Standing, the character of Kristin Beth Baxter Vogelson, eldest daughter of the show's central family, was initially played by Alexandra Krosney. Due to creative reasons, Krosney left the show after the first season and Amanda Fuller took over the role of Kristin for the remaining eight seasons.", "prediction 1": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. On June 19, 2012, it was announced that twins Luke and Evan Kruntchev, who played the role of Boyd in season 1, would not be returning; they were replaced by Flynn Morrison in season 2. On June 9, 2013, it was announced that Amanda Fuller, who plays the role of Kristin Baxter on the show's first season, was played by Alexandra Benjamin Krosney. She is best known for her role as Kristin Baxter on the ABC sitcom, which was played by Amanda Fuller during the show's first season.", "prediction 2": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. American actress Alexandra Krosney plays Kristin Baxter on the ABC sitcom Last Man Standing during the show's first season. Amanda Fuller plays Kristin Baxter during the second and third seasons.", "prediction 3": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. In season 1, twins Luke and Evan Kruntchev played the role of Boyd, while Flynn Morrison played the role. From season 2 onward, Amanda Fuller played the role of Kristin, the oldest sister of Mike Baxter.", "prediction 4": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. Flynn Morrison plays the role of the oldest sister on the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 420 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 421, "end": 539 }, { "error type": "Irrelevant", "explanation": "", "start": 582, "end": 649 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 660, "end": 715 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Last Man Standing is an American television sitcom. The character of Kristin Baxter was initially played by Alexandra Benjamin Krosney during the show's first season. Due to creative reasons, Krosney left the show after the first season and Amanda Fuller took over the role of Kristin from season 2 onward." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who is the current forest minister of punjab?", "passages": [ [ "Muhammad Sibtain Khan", "Muhammad Sibtain Khan\n\nMuhammad Sibtain Khan is a Pakistani politician who is the current Provincial Minister of Punjab for Forestry, Wildlife and Fisheries, in office since 29 August 2018.", "He has been a member of the Provincial Assembly of the Punjab, since August 2018.", "Previously he was a member of the Provincial Assembly of the Punjab between 1990 and May 2018.", "He was born on 30 August 1958 in Mianwali.", "He has the degree of Master of Arts in Political Science which he obtained in 1982 from University of the Punjab.", "He was elected to the Provincial Assembly of the Punjab as an independent candidate from Constituency PP-39 (Mianwali-IV) in Pakistani general election, 1990.", "He received 29,582 votes and defeated a candidate of Islami Jamhoori Ittehad (IJI). He served a Provincial Minister of Punjab for Prison from 1990 to 1993.", "He ran for the seat of the Provincial Assembly of the Punjab as an independent candidate from Constituency PP-39 (Mianwali-IV) in Pakistani general election, 1997, but was unsuccessful.", "He received 15,390 votes and lost the seat to a candidate of Pakistan Muslim League (N)." ], [ "Sadhu Singh Dharamsot", "Sadhu Singh Dharamsot\n\nSadhu Singh Dharamsot is a Minister of Forests, Social Welfare in Government of Punjab, India and member of the Indian National Congress.", "Dharamsot was elected to the Punjab Legislative Assembly from the Nabha constituency of Punjab." ] ], "gold": "Muhammad Sibtain Khan is a Pakistani politician who has been the Provincial Minister of Punjab for Forestry, Wildlife and Fisheries since August 29,2018. Sadhu Singh Dharamsot is a Minister of Forests, Social Welfare in Government of Punjab, India and member of the Indian National Congress.", "prediction 1": "The current forest minister of Punjab is Md Muhammad Sibtain Khan. The current Forest Minister of Punjab for Punjab is Md Sadhu Singh Dharamsot. The previous forest minister of Punjab was Md Azam Khan, who served from 1990 to 1993.", "prediction 2": "Muhammad Sibtain Khan is the current Provincial Minister of Punjab for Forestry, Wildlife and Fisheries, in office since 29 August 2018. Former Minister of Punjab for Prisons Sadhu Singh Dharamsot, served as the current Provincial Minister of Punjab for Forests, Social Welfare from 2010 to 2014.", "prediction 3": "Muhammad Sibtain Khan is the current Provincial Minister of Punjab for Forestry, Wildlife and Fisheries, in office since 29 August 2018. He has been a member of the Provincial Assembly of the Punjab, since August 2018. Previously, he was a member of the Provincial Assembly of the Punjab between 1990 and May 2018.", "prediction 4": "Muhammad Sibtain Khan is the current Minister of Forestry, Wildlife and Fisheries of Punjab, in office since 29 August 2018. Sadhu Singh Dharamsot is the current Minister of Forests and Social Welfare of Punjab.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 145, "end": 231 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Muhammad Sibtain Khan is a Pakistani politician who is the current Provincial Minister of Punjab for Forestry, Wildlife and Fisheries, in office since 29 August 2018. Sadhu Singh Dharamsot is a Minister of Forests, Social Welfare in Government of Punjab, India and member of the Indian National Congress." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who came up with the facial feedback hypothesis?", "passages": [ [ "Facial feedback hypothesis", "Facial feedback hypothesis\n\nThe facial feedback hypothesis states that facial movement can influence emotional experience.", "For example, an individual who is forced to smile during a social event will actually come to find the event more of an enjoyable experience.", "Charles Darwin was among the first to suggest that physiological changes caused by an emotion had a direct impact \"on\", rather than being just the consequence \"of\" that emotion.", "He wrote:\n\nThe free expression by outward signs of an emotion intensifies it.", "On the other hand, the repression, as far as this is possible, of all outward signs softens our emotions...", "Even the simulation of an emotion tends to arouse it in our minds.", "Following on this idea, William James proposed that, contrary to common belief, awareness of bodily changes activated by a stimulus \"\"is\" the emotion\".", "If no bodily changes are felt, there is only an intellectual thought, devoid of emotional warmth.", "In \"The Principles of Psychology\", James wrote: \"Refuse to express a passion, and it dies\".", "This proved difficult to test, and little evidence was available, apart from some animal research and studies of people with severely impaired emotional functioning.", "The facial feedback hypothesis, \"that skeletal muscle feedback from facial expressions plays a causal role in regulating emotional experience and behaviour\", developed almost a century after Darwin." ] ], "gold": "The facial feedback hypothesis, rooted in the conjectures of Charles Darwin and William James, is that one's facial expression directly affects their emotional experience. Specifically, physiological activation of the facial regions associated with certain emotions holds a direct effect on the elicitation of such emotional states, and the lack of or inhibition of facial activation will result in the suppression or absence of corresponding emotional states.", "prediction 1": "The facial feedback hypothesis states that facial movement can influence emotional experience. For example, an individual who is forced to smile during a social event will actually come to find the event more of an enjoyable experience. The theory was developed almost a century after Charles Darwin.", "prediction 2": "The facial feedback hypothesis states that facial movement can influence emotional experience, like a person who is forced to smile during a social event will actually come to find the event more of an enjoyable experience. The facial feedback hypothesis, \"that skeletal muscle feedback from facial expressions plays a causal role in regulating emotional experience and behaviour\", developed almost a century after Darwin.", "prediction 3": "Charles Darwin was among the first to suggest that physiological changes caused by an emotion had a direct impact \"on\", rather than being just the consequence \"of\" that emotion. Following on this idea, William James proposed that, contrary to common belief, awareness of bodily changes activated by a stimulus \"\"is\" the emotion\". If no bodily changes are felt, there is only an intellectual thought, devoid of emotional warmth. This proved difficult to test, and little evidence was available, apart from some animal research and studies of people with severely impaired emotional functioning. The facial feedback hypothesis, \"that skeletal muscle feedback from facial expressions plays regulating emotional experience and behaviour\", developed almost a century after Darwin.", "prediction 4": "The facial feedback hypothesis states that facial movement can influence emotional experience. Charles Darwin was among the first to suggest that physiological changes caused by an emotion had a direct impact \"on\", rather than being just the consequence \"of\" that emotion. William James proposed that, contrary to common belief, awareness of bodily changes activated by a stimulus \"\"is\" the emotion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 236 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The facial feedback hypothesis states that facial movement can influence emotional experience. Charles Darwin was among the first to suggest that physiological changes caused by an emotion had a direct impact \"on\", rather than being just the consequence \"of\" that emotion.. The theory was developed almost a century after Charles Darwin." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where did the mom go in that's so raven?", "passages": [ [ "That's So Raven", "That's So Raven\n\nThat's So Raven is an American supernatural sitcom that originally ran on Disney Channel from January 17, 2003 to November 10, 2007.", "Set in San Francisco, the series starred Raven-Symon\u00e9 as Raven Baxter, a teenager with psychic abilities who draws on her ingenuity, talent as a fashion designer, and a variety of disguises to get in and out of amusing adolescent and pre-adolescent situations.", "Orlando Brown and Anneliese van der Pol co-starred as her best friends, Eddie Thomas and Chelsea Daniels, alongside Kyle Massey as her mischievous younger brother Cory and T'Keyah Crystal Keym\u00e1h and Rondell Sheridan as her parents, Tanya and Victor Baxter, respectively.", "\"That's So Raven\" was the highest-rated program on Disney Channel during its initial run, and was the first series in the network's history to produce at least 100 episodes.", "It was nominated for numerous accolades, including two Primetime Emmy Award nominations for Outstanding Children's Programming in 2005 and 2007.", "Since its conclusion, \"That's So Raven\" has inspired two spin-offs: \"Cory in the House\" starring Kyle Massey, which ran from 2007 to 2008, and \"Raven's Home\" starring Raven-Symon\u00e9 and Anneliese van der Pol as Raven and Chelsea raising their children together, which began airing in 2017." ], [ "T'Keyah Crystal Keym\u00e1h", "One of the original cast members of Fox Television's Emmy winning variety show, \"In Living Color\", for five seasons Keym\u00e1h played a number of characters, including Cryssy, the central character of her self written signature piece, \"In Black World\".", "She also sang and danced on the show.", "After \"In Living Color\", she played contractor Scotti Decker in \"On Our Own\"; played comedy show writer Denise Everett in \"The Show\"; and provided the voices for Roz, Shavonne, Aki, Mrs. LaSalle, and many others in \"Waynehead\".", "For four years, Keym\u00e1h was a series regular on \"Cosby\", where she played flight attendant-lawyer-pastry chef-teacher Erica Lucas Hall.", "Following \"Cosby\", she appeared for three seasons on the Disney series \"That's So Raven\" as Raven's mother, Tanya Baxter.", "In season four her character was written out of the plot so that Keym\u00e1h could care for her ailing grandmother.", "Keym\u00e1h co-wrote and co-starred in a two-person stage show with music, called \"Sellout!?!", "\", with fellow FAMU alumnus Bryan C. Jones, who was also one of the many guests to appear in her hit variety show \"T'Keyah Live!\"" ], [ "T'Keyah Crystal Keym\u00e1h", "T'Keyah Crystal Keym\u00e1h\n\nT'Keyah Crystal Keym\u00e1h (born Crystal Walker; October 13, 1962) is an American actress and singer.", "In addition to her status as an original cast member of the Fox sketch comedy series \"In Living Color\" (1990\u20131994), she is also known for her roles as Erica Lucas on the CBS sitcom \"Cosby\" (1996\u20132000), and as Tanya Baxter on the Disney Channel sitcom \"That's So Raven\" (2003\u20132005).", "Keym\u00e1h was born Crystal Walker in 1962, in Chicago.", "Since the age of three, she has enjoyed entertaining her family \u2013 singing, dancing, and reciting original poems and stories.", "She wrote her first play and her first song in elementary school.", "She performed with Ali LeRoi and Lance Crouther in the Mary Wong Comedy Group in high school, before she enrolled in Florida A&M University (FAMU) at the School of Business and Industry.", "Her brother is Commander of the DC US Army National Guard, Major General William J. Walker.", "During college and after graduating from FAMU, Keym\u00e1h taught theater, dance, and mime.", "She has also done many theater performances, and produced and directed films." ] ], "gold": "That's So Raven is an American supernatural sitcom that originally ran on Disney Channel from January 17, 2003 to November 10, 2007. In season 4, Raven's mother, Tanya Baxter is written out of the show so she could attend law school in England. The American actress and singer, T'Keyah Crystal Keym\u00e1h, who portrayed Tanya Baxter left the show to become a caregiver for her grandmother.", "prediction 1": "In the American supernatural sitcom That's So Raven, the mother is Tanya Baxter. In the previous season, the mom went to the hospital with her daughter, Chelsea. In the current season, the mom went to the hospital with her daughter and daughter, Victoria and Victor Baxter.", "prediction 2": "In the American supernatural sitcom That's So Raven, the mother of the show's main character, Raven Baxter, is Tanya Baxter. In season 4, her character was written out of the plot so that Keym\u00e1h could care for her ailing grandmother.", "prediction 3": "In That's So Raven, the mother of Raven, Tanya Baxter, is portrayed by actress and singer T'Keyah Crystal Keym\u00e1h. The mother of Raven's in the show is portrayed in a variety of disguises, including a dress made of silk, an outfit made from a hat made of a leather, and a belt made of leather. The mom goes to visit her ailing grandmother.", "prediction 4": "In That's So Raven, American supernatural sitcom, Tanya Baxter goes on a number of adventures to visit her mother, Victor Baxter. In season 4, Tanya Baxter's character is written out of the plot so that T'Keyah Crystal Keym\u00e1h can care for her ailing grandmother.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 81, "end": 161 }, { "error type": "Unverifiable", "explanation": "", "start": 162, "end": 273 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "That's So Raven is an American supernatural sitcom that originally ran on Disney Channel from January 17, 2003 to November 10, 2007. In the American supernatural sitcom That's So Raven, the mother is Tanya Baxter. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did ed sheeran song perfect come out?", "passages": [ [ "Perfect (Ed Sheeran song)", "Perfect (Ed Sheeran song)\n\n\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album, \"\u00f7\" (2017).", "After the album's release it charted at number four on the UK Singles Chart.", "On 21 August 2017, \"Billboard\" announced that \"Perfect\" would be the fourth single from the album.", "The song was serviced to pop radio on 26 September 2017, as the third single from the album in the United States (fourth overall).", "The song eventually reached number one on the UK Singles Chart and the US \"Billboard\" Hot 100 in December 2017.", "\"Perfect\" became the UK Christmas number-one song for 2017, and also peaked at number one in sixteen other countries, including Australia, Canada, Ireland and New Zealand.", "The second version of the single, titled \"Perfect Duet\", with American singer Beyonc\u00e9 was released on 1 December 2017.", "Another duet with Italian singer Andrea Bocelli, titled \"Perfect Symphony\", was released on 15 December 2017.", "The song and its official music video received three nominations at the 2018 MTV Video Music Awards.", "\"Perfect\" was the first track Sheeran wrote for his third studio album \"\u00f7\".", "The song is a romantic ballad written about his girlfriend Cherry Seaborn, whom he knew from school and reconnected with when she was working in New York." ], [ "Perfect (Ed Sheeran song)", "scope=\"row\"| Portugal (AFP)\n\n", "An operatic version of \"Perfect\" with Andrea Bocelli, titled \"Perfect Symphony\" and sung partly in Italian, was released on 15 December 2017.", "A fully orchestral version of the song was recorded at Abbey Road Studios although only parts of it were used in the original release of the song.", "The full orchestral version was used in the duet with Andrea Bocelli.", "On 15 December 2017, a music video for \"Perfect Symphony\" (duet with Andrea Bocelli) was also released." ] ], "gold": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album, \u00f7. The song was released on 26 September 2017. The song eventually reached number one on the UK Singles Chart and the US Billboard Hot 100 in December 2017. The second version of the single, titled \"Perfect Duet\", with American singer Beyonc\u00e9, was released on 1 December 2017. Another duet with Italian singer Andrea Bocelli, titled \"Perfect Symphony\", was released on 15 December 2017. The music video for \"Perfect Symphony\" was released on the same day.", "prediction 1": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album,. After the album's release it charted at number four on the UK Singles Chart. On 21 August 2017, \"Billboard\" announced that \"Perfect\" would be the fourth single from the album. The song was serviced to pop radio on 26 September 2017, as the third single from the album in the United States.", "prediction 2": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album \"\" released in 2017. The song originally came out on November 13, 2017 in the UK and on November 28, 2017 in the U.S. An operatic version of \"Perfect\" with Italian singer Andrea Bocelli, titled \"Perfect Symphony\", released on 15 December 2017, was also released.", "prediction 3": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album, (2017). After the album's release, it charted at number four on the UK Singles Chart. On 26 September 2017, the song was serviced to pop radio as the third single from the album in the United States. The single eventually reached number one on the UK Singles Chart and the US Billboard Hot 100 in December 2017.", "prediction 4": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album,. The song came out on 21 August 2017, Billboard announced that \"Perfect\" would be the fourth single from the album. The song was serviced to pop radio on 26 September 2017, as the third single from the album in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 166 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 379 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Perfect\" is a song by English singer-songwriter Ed Sheeran from his third studio album. The song eventually reached number one on the UK Singles Chart and the US \"Billboard\" Hot 100 in December 2017. The second version of the single, titled \"Perfect Duet\", with American singer Beyonc\u00e9 was released on 1 December 2017. Another duet with Italian singer Andrea Bocelli, titled \"Perfect Symphony\", was released on 15 December 2017. The music video for \"Perfect Symphony\" was released on the same day." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When does season 3 star vs the forces of evil come out?", "passages": [ [ "Star vs. the Forces of Evil", "The show's title sequence was promoted at Comic-Con 2014 six months prior to its scheduled broadcast premiere.", "As a result, the footage was uploaded by fans to YouTube who then started generating fan art and fan fiction.", "The first episode premiered on Disney Channel in January 2015.", "The positive reaction on social media prompted Disney XD to order a second season of the series in February 2015, six weeks ahead of its launch of the series on Disney XD in March.", "Disney sitcom actors Olivia Holt and Kelli Berglund participated in promoting the series the weeks before its Disney XD premiere, with Holt dressing up as Star.", "The second season premiered on July 11, 2016, The show's third season was ordered ahead in March 2016.", "It premiered on July 15, 2017 with a two-hour long television movie entitled \"The Battle for Mewni\" and consisted of the first four episodes.", "A live chat featuring Star and Marco was aired on Disney XD on July 17.", "The remaining third-season episodes started airing on November 6, 2017.", "A fourth season was also ordered ahead of the third season premiere.", "\"Star vs. the Forces of Evil\" premiered in Canada on the DHX-owned Disney XD on April 6, 2015, and was later moved to the Corus-owned Disney XD on December 1." ], [ "Star vs. the Forces of Evil", "Star vs. the Forces of Evil\n\nStar vs. the Forces of Evil is an American animated television series created by Daron Nefcy and developed by Jordana Arkin and Dave Wasson, which airs on Disney XD.", "The first Disney XD series created by a woman, and the third overall for Disney Television Animation (following \"Pepper Ann\" and \"Doc McStuffins\"), it follows the adventures of Star Butterfly (voiced by Eden Sher), the turbulent young heir to the royal throne in the dimension of Mewni, who is sent to Earth so she can complete her education and learn to be a worthy princess, and Marco Diaz (Adam McArthur), a human teenager who becomes her roommate and best friend, as they live their daily lives, and go on adventures in other dimensions.", "\"Star vs. the Forces of Evil\" typically follows a format of two 11-minutes long independent \"segments\" per episode.", "The first episode aired on January 18, 2015 on Disney XD and became the most-watched animated series debut in Disney XD\u2019s history.", "The fourth season is to premiere in 2019.", "Star Butterfly is a magical princess from the dimension of Mewni, and the heir to the royal throne of the Butterfly Kingdom.", "As per tradition, she is given the family heirloom wand on her 14th birthday." ] ], "gold": "Star vs. the Forces of Evil is an American animated magical girl television series which aired on Disney Channel and Disney XD. Greenlit for Disney Channel in 2013, the first episode aired there on January 18, 2015, as a preview, then the series moved over to Disney XD on March 30, 2015. Season 3 ran from July 15, 2017 - April 7, 2018. The series ended on May 19, 2019.", "prediction 1": "Star vs. the Forces of Evil is an American animated television series created by Daron Nefcy and developed by Jordana Arkin and Dave Wasson, which airs on Disney XD. The third season of the series started airing on July 15, 2017 and the fourth season is to premiere in 2019.", "prediction 2": "Star vs. the Forces of Evil is an American animated television series created by Daron Nefcy and developed by Jordana Arkin and Dave Wasson, which airs on Disney XD. The third season came out on July 15, 2017 with a two-hour long television movie entitled The Battle for Mewni, consisting of the first four episodes, and a live chat featuring Star and Marco was aired on Disney XD on July 17. The remaining third-season episodes started airing on November 6, 2017.", "prediction 3": "Star vs. the Forces of Evil is an American animated television series created by Daron Nefcy and developed by Jordana Arkin and Dave Wasson, which airs on Disney XD. The first episode aired on January 18, 2015 on Disney XD. The second season premiered on July 11, 2016. The third season was ordered ahead in March 2016. The third season premiered on July 15, 2017, with a two-hour long television movie entitled \"The Battle for Mewni\" and consisted of the first four episodes. The remaining three-season episodes started airing on November 6, 2017. A fourth season was also ordered ahead of the third season premiere.", "prediction 4": "Star vs the Forces of Evil is an American animated television series created by Daron Nefcy and developed by Jordana Arkin and Dave Wasson, which airs on Disney XD. Season 2 came out on January 18, 2015, and the third came out on July 15, 2017. Season 3 came out on Disney XD in the US on October 31, 2017 and in the UK on November 6, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 140 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Star vs. the Forces of Evil is an American animated television series , which airs on Disney XD. The first episode premiered on Disney Channel in January 2015. The third season of the series started airing on July 15, 2017 and the fourth season is to premiere in 2019." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who is the father of emma on friends?", "passages": [ [ "Friends", "Friends\n\nFriends is an American television sitcom, created by David Crane and Marta Kauffman, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons.", "With an ensemble cast starring Jennifer Aniston, Courteney Cox, Lisa Kudrow, Matt LeBlanc, Matthew Perry and David Schwimmer, the show revolves around six friends in their 20s and 30s who live in Manhattan, New York City.", "The series was produced by Bright/Kauffman/Crane Productions, in association with Warner Bros. Television.", "The original executive producers were Kevin S. Bright, Marta Kauffman, and David Crane.", "Kauffman and Crane began developing \"Friends\" under the title \"Insomnia Cafe\" between November and December 1993.", "They presented the idea to Bright, and together they pitched a seven-page treatment of the show to NBC.", "After several script rewrites and changes, including a title change to \"Six of One\", and, \"Friends Like Us\", the series was finally named \"Friends\".", "Filming of the show took place at Warner Bros. Studios in Burbank, California.", "All ten seasons of \"Friends\" ranked within the top ten of the final television season ratings; it ultimately reached the number-one spot in its eighth season." ], [ "Rachel Green", "Rachel Green\n\nRachel Karen Green is a fictional character, one of the six main characters who appeared in the American sitcom \"Friends\".", "Portrayed by actress Jennifer Aniston, the character was created by show creators David Crane and Marta Kauffman, and appeared in each of the show's 236 episodes during its decade-long run, from its premiere on September 22, 1994 to its finale on May 6, 2004.", "Introduced in the show's pilot as a naive runaway bride who reunites with her childhood best friend Monica Geller and relocates to New York City, Rachel gradually evolves from a spoiled, inexperienced \"daddy's girl\" into a successful businesswoman.", "During the show's second season, the character becomes romantically involved with her friend, Monica's older brother Ross, with whom she maintains a complicated on-again, off-again relationship throughout the entire series.", "Together, the characters have a daughter, Emma.", "The role of Rachel was originally offered to actresses T\u00e9a Leoni, the producer's first choice, and Courteney Cox, both of whom declined, Leoni in favor of starring in the sitcom \"The Naked Truth\", and Cox in favor of playing Rachel's best friend Monica in \"Friends\"." ], [ "Helen Baxendale", "Later in the same year, she starred as DCI Marion Bettany in Val McDermid's radio crime drama \"Village SOS\".", "In 2010 Helen Baxendale appeared in the pilot episode of \"Dirk Gently\" as Susan Harmison.", "In 2012 she reprised her role in the second episode of the commissioned first and only series.", "She then appeared in the \"Inspector George Gently\" episode \"The Lost Child\" alongside Mark Gatiss.", "She currently stars in \"Cuckoo\" as Lorna, the mother in-law of the titular Dale 'Cuckoo' Ashbrick.", "Baxendale has been with her boyfriend David L. Williams since her Glasgow days and together they have three children.", "Her first pregnancy was written into \"An Unsuitable Job for a Woman\" and her second was written into the fourth series of \"Cold Feet\".", "Her first pregnancy (coupled with the fact that her country of residence was Britain, rather than the USA) meant that her character was written out of \"Friends\" earlier than the writers had originally intended.", "Baxendale appeared in only 14 episodes, despite her character dating, marrying, and then divorcing Ross Geller (David Schwimmer), one of the show's main characters." ] ], "gold": "Friends is an American television sitcom, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. The characters of Ross and Rachel maintain a complicated on-off relationship throughout the series. Ross, portrayed by actor David Schwimmer, and Rachel, portrayed by actress Jennifer Aniston, have a daughter Emma.", "prediction 1": "There are multiple characters named Emma on the television show Friends. The character of Rachel Green is played by Jennifer Aniston. The show revolves around six friends in their 20s and 30s who live in Manhattan, New York City. Ross Geller is the fictional father of Emma's character on the show.", "prediction 2": "Rachel Green is one of the six main characters who appeared in the American television sitcom, Friends. Portrayed by actress Jennifer Aniston, the character was created by show creators David Crane and Marta Kauffman, and appeared in each of the show's 236 episodes during its decade-long run, from its premiere on September 22, 1994, to its finale on May 6, 2004. The father of Emma on Friends is played by David Schwimmer.", "prediction 3": "The character of Emma on Friends is played by Rachel Green. The character of Rachel is married to David Schwimmer and the couple have a daughter together titled Emma. Ross Geller is the father of Emma on the show.", "prediction 4": "Friends is an American television sitcom, created by David Crane and Marta Kauffman, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. Ross Geller, the older brother of Rachel and friend Monica, is the father of Emma. Ross is the father of a daughter, Emma.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 229 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 40 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 258 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 269, "end": 285 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Friends is an American television sitcom, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. The character of Rachel Green is played by Jennifer Aniston. Together they have a daughter named Emma. Ross Geller is the father of Emma. Ross is played by David Schwimmer. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where are the queen's royal hussars based?", "passages": [ [ "Queen's Royal Hussars", "The regiment, in January 1996, became the first to be deployed in Challenger 1 tanks to Bosnia with NATO's British-led Implementation Force IFOR.", "In August 1996 the regiment deployed to Northern Ireland on Operation Banner and then moved to Athlone Barracks at Sennelager as armoured regiment for 20th Armoured Brigade in January 1998.", "An independent tank squadron deployed to Kosovo in 2001, with the rest of the regiment deploying later that year in the dismounted role.", "December 2003 saw the regiment deploy once again, this time to Iraq on Operation Telic 3.", "The regiment saw its first Military Cross awarded to Lance corporal Christopher Balmforth of B Squadron for his actions during an ambush in Basra.", "April 2006 saw the regiment deploy once again to Iraq on Operation Telic 8 and December 2008 saw the regiment deployed to Iraq on Operation Telic 13.", "As the final Operation Telic the Queen's Royal Hussars were intimately involved in the drawdown from the main British base and spent many hours escorting convoys to and from Kuwait.", "In 2011 the regiment deployed on Operation Herrick 15 as a ground holding Battle Group to Afghanistan in the infantry role: they worked with the Afghan National Police handing over control of checkpoints.", "On return from Afghanistan in 2012 the regiment was called on to support the security for the London Olympic Games.", "The remainder of the year was used to return to the armoured role." ], [ "Queen's Royal Hussars", "Queen's Royal Hussars\n\nThe Queen's Royal Hussars (The Queen's Own and Royal Irish) (QRH) is the senior United Kingdom armoured regiment.", "It was formed on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars.", "The regiment and its antecedents have been awarded 172 Battle Honours and eight Victoria Crosses.", "The regiment is currently based in Sennelager, Germany, where it is the armoured regiment for 20th Armoured Brigade, part of British Forces Germany.", "The Queen's Royal Hussars was formed in Fallingbostel on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars.", "The Queen's Own Hussars, normally referred to by the abbreviation QOH, was a cavalry regiment of the British Army, formed from the amalgamation of 3rd", "The King's Own Hussars and the 7th Queen's Own Hussars at Candahar Barracks, Tidworth in 1958.", "The Queen's Royal Irish Hussars, abbreviated as QRIH, was a cavalry regiment of the British Army formed from the amalgamation of the 4th Queen's Own Hussars and the 8th King's Royal Irish Hussars in Hohne, West Germany in 1958." ] ], "gold": "The Queen's Royal Irish Hussars, abbreviated as QRIH, was a cavalry regiment of the British Army formed from the amalgamation of the 4th Queen's Own Hussars and the 8th King's Royal Irish Hussars in Hohne, West Germany in 1958. In August 1996 the regiment deployed to Northern Ireland on Operation Banner, and then moved to Athlone Barracks at Sennelager as armored regiment for 20th Armored Brigade in January 1998. ", "prediction 1": "The Queen's Royal Hussars (The Queen's Own and Royal Irish) is the senior United Kingdom armoured regiment. It was formed on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars. The regiment is currently based in Sennelager, Germany, where it is the armoured regiment for 20th Armoured Brigade, part of British Forces Germany.", "prediction 2": "The Queen's Royal Hussars is the senior United Kingdom armoured regiment. It was formed on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars. The regiment is currently based in Germany, where it is the armoured regiment for 20th Armoured Brigade, part of British Forces Germany.", "prediction 3": "The Queen's Royal Hussars is the senior United Kingdom armoured regiment, formed on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars. It is based at Athlone Barracks at Sennelager, Germany, and acts as the armoured regiment for 20th Armoured Brigade, part of British Forces Germany.", "prediction 4": "Queen's Royal Hussars is the senior United Kingdom armoured regiment. It was formed on 1 September 1993 from the amalgamation of the Queen's Own Hussars and the Queen's Royal Irish Hussars. The regiment is currently based in Sennelager, Germany, where it is the armoured regiment for 20th Armoured Brigade, part of British Forces Germany.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 227 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Queen's Royal Hussars the regiment deployed to Northern Ireland on Operation Banner, in August 1996, and then moved to Athlone Barracks at Sennelager, Germany, as armoured regiment for 20th Armoured Brigade in January 1998. The regiment is currently based in Sennelager, Germany. The Queen's Own and Royal Irish was a cavalry regiment of the British Army formed from the amalgamation of the 4th Queen's Own Hussars and the 8th King's Royal Irish Hussars in Hohne, West Germany in 1958." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the houston astros start playing baseball?", "passages": [ [ "History of the Houston Astros", "General manager Spec Richardson also continued with the organization as business manager, but was later promoted again to the same position with the Astros from 1967 until 1975.", "Although most players for the major league franchise were obtained through the 1961 Major League Baseball expansion draft, Buffs players J.C. Hartman, Pidge Browne, Jim Campbell, Ron Davis, Dave Giusti, and Dave Roberts were chosen to continue as major league ball players.", "Similarly, the radio broadcasting team remained with the new Houston major league franchise.", "Loel Passe worked alongside Gene Elston as a color commentator until he retired from broadcasting in 1976.", "Elston continued with the Astros until 1986.", "The Colt .45s started their inaugural season on April 10, 1962 against the Chicago Cubs.", "Harry Craft was named Houston's first manager.", "The Colt .45s finished eighth among the National League's ten teams.", "To get an idea of how the first season was for Houston, look at the team's best pitcher, Richard \"Turk\" Farrell.", "A starter for the Colt .45s, he was primarily a relief pitcher when he was with the Los Angeles Dodgers and Philadelphia Phillies.", "Turk lost 20 games in 1962, but had an ERA of 3.02.", "Turk was selected to both All-Star games that year.", "There was a bright spot in the line up in 1962." ], [ "History of the Houston Astros", "History of the Houston Astros\n\nThe Houston Astros are an American professional baseball team based in Houston,Texas that competes in Major League Baseball (MLB).", "The Astros are a member of the MLB's American League, having moved from the National League in 2013.", "The Astros are one of two MLB teams based out of Texas, the other being the Texas Rangers.", "The team began with the name Colt .45s in 1962 and changed their name to the Houston Astros in 1965 when they began playing in the Astrodome.", "The team has played in three ballparks in Houston, Colt .45 Stadium (1962-1964), the Astrodome (1965-1999), and, currently, Minute Maid Park, a stadium with a retractable roof.", "The Astros hold one World Series title and one national league title.", "From 1888 until 1961, Houston's professional baseball club was the minor league Houston Buffaloes.", "Although expansion from the National League eventually brought a Major League team to Texas in 1962, Houston officials had been making efforts to do so for years prior.", "There were four men chiefly responsible for bringing Major League Baseball to Houston:", "George Kirksey and Craig Cullinan, who had led a futile attempt to purchase the St. Louis Cardinals in 1952; R.E." ], [ "History of the Houston Astros", "The Judge called the new domed stadium the Astrodome.", "The name was in honor of Houston's importance to the country's space program and to match with the meaning of the name, the Colt .45s were renamed the Astros.", "The new park, coined as the \"Eighth Wonder of the World\" did little to help the play on the field.", "While several \"indoor\" firsts were accomplished, the team still finished ninth in the standings.", "The attendance was high not because of the team accomplishments, but because people came from miles around to see the Astrodome.", "Just as the excitement was settling down over the Astrodome, the 1966 season found something new to put the domed stadium in the spotlight once again; the field.", "Grass would not grow in the new park, since the roof panels had been painted to reduce the glare that was causing players on both the Astros and the visiting team to miss routine pop flies.", "A new artificial turf was created called \"AstroTurf\" and once again Houston would be involved in yet another change in the way the game was played.", "With new manager Grady Hatton the Astros got hot right away.", "By May they were in second place in the National League and looked like a team that could contend." ] ], "gold": "The Houston Astros are an American professional baseball team based in Houston, Texas that competes in Major League Baseball. The team was originally known as the Colt .45s and started their inaugural season on April 10, 1962 against the Chicago Cubs. They changed their name to the Houston Astros in 1965 due to playing in a domed stadium called the Astrodome, which was in honor of Houston's importance to the country's space program. They played their first exhibition game as the Astros on April 9, 1965 and their first official game as the Astros on April 12, 1965.", "prediction 1": "The Houston Astros are an American professional baseball team based in Houston, Texas that competes in Major League Baseball. The team began with the name Colt.45s in 1962 and changed their name to the Houston Astros in 1965 when they began playing in the Astrodome.", "prediction 2": "The Houston Astros are an American professional baseball team based in Houston, Texas that competes in Major League Baseball. The team began with the name Colt.45s in 1962, and changed their name to the Houston Astros in 1965 when they began playing in the Astrodome. The team has played in three ballparks in Houston, Colt.45 Stadium (1962-1964), the Astrodome (1965-1999), and, currently, Minute Maid Park, a stadium with a retractable roof. The Astros have played in three ballparks in Houston, Colt.45 Stadium (1962-1964) and the Astros began playing in the Astros in the Astros.", "prediction 3": "The Houston Astros are an American professional baseball team based in Houston,Texas that competes in Major League Baseball. The team began with the name Colt.45s in 1962 and changed their name to the Houston Astros in 1965 when they began playing in the Astrodome. The first game was played in the Colt.45 Stadium on April 10, 1962 against the Chicago Cubs.", "prediction 4": "The Houston Astros started playing baseball on April 10, 1962 against the Chicago Cubs. The team began with the name Colt.45s in 1962 and changed their name to the Houston Astros in 1965 when they began playing in the Astrodome.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Houston Astros are an American professional baseball team based in Houston, Texas that competes in Major League Baseball. The team began with the name Colt.45s started their inaugural season on April 10, 1962 against the Chicago Cubs. They changed their name to the Houston Astros in 1965 when they began playing in the Astrodome. The name was in honor of Houston's importance to the country's space program. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When is the lodge coming to the us?", "passages": [ [ "The Lodge (TV series)", "The Lodge (TV series)\n\nThe Lodge is a British musical drama and mystery television series that premiered in the United Kingdom on Disney Channel on 23 September 2016 and in the United States on Disney Channel on 17 October 2016.", "The series is based on the Israeli series \"North Star\" and stars Sophie Simnett, Luke Newton, Thomas Doherty, Bethan Wright, Jayden Revri, Jade Alleyne, Joshua Sinclair-Evans, and Mia Jenkins.", "Fifteen-year-old Skye moves with her father from the big city to rural Northern Ireland, where they take over a local hotel called \"North Star Lodge\", which was previously owned and managed by Skye's grandfather.", "At their new home, Skye tries to build a life, but this new life is far from complication free as she must navigate through the everyday stresses of life as a teenager.", "She struggles to integrate into a group of teenagers who live and work in the hotel, but discovers that most of them do not have good intentions.", "When she discovers that her father is planning to sell the hotel, Skye becomes upset as she has developed an emotional attachment to it.", "Skye decides to convince her father not to sell the hotel only to discover that the man wanting to buy it is her new friend's father.", "Skye receives the support of her friends, but not everyone is as interested as she is in saving it." ], [ "The Lodge (film)", "The Lodge (film)\n\n", "The Lodge is an upcoming American horror film, directed by Veronika Franz and Severin Fiala, from a screenplay by Franz, Fiala, and Sergio Casci.", "It stars Riley Keough, Jaeden Lieberher, Richard Armitage, Alicia Silverstone, Lia McHugh, Katelyn Wells, and Daniel Keough.", "It will have its world premiere at the Sundance Film Festival on January 25, 2019.", "In October 2017, Riley Keough joined the cast of the film, with Veronika Franz and Severin Fiala directing from a screenplay they wrote alongside Sergio Casci.", "FilmNation Entertainment and Hammer Films will produce and finance the film.", "In February 2018, Jaeden Lieberher, Richard Armitage and Lia McHugh joined the cast of the film, with production beginning that same day.", "Katelyn Wells signed on to the film at the beginning of March 2018, and began work on the project the very next day.", "It will have its world premiere at the Sundance Film Festival on January 25, 2019." ], [ "Still Alice", "Eshkeri wrote the score to be performed on piano, which he intended to represent Alice's family life, and by a string trio, of which he thought the challenge of composition was similar to \"the challenge of coping with the disease\".", "\"Still Alice\" had its world premiere at the Toronto International Film Festival on September 8, 2014.", "Sony Pictures Classics, which bought the U.S. distribution rights for the film, gave it a one-week release in December 2014 so that it would qualify for that year's Academy Awards.", "After making the deal with Sony, Westmoreland and Glatzer were eager to have the film released as early as possible, partly because of Glatzer's declining health.", "The film began its proper theatrical run with a limited release on January 16, 2015, earning $197,000 from 12 locations on its opening weekend.", "On February 20, it was given a wide release, expanding to 765 theaters across the U.S.", "Overall, the film grossed $18,754,371 over 14 weeks in American theaters.", "It earned $25,130,281 in other countries for a worldwide gross of $43,884,652." ], [ "United States", "United States\n\nThe United States of America (USA), commonly known as the United States (U.S. or US) or America, is a country composed of 50 states, a federal district, five major self-governing territories, and various possessions.", "At 3.8\u00a0million square miles (9.8\u00a0million km), the United States is the world's third- or fourth-largest country by total area and slightly smaller than the entire continent of Europe's 3.9\u00a0million square miles (10.1\u00a0million km).", "With a population of over 325 million people, the U.S. is the third most populous country.", "The capital is Washington, D.C., and the largest city by population is New York City.", "Forty-eight states and the capital's federal district are contiguous in North America between Canada and Mexico.", "The State of Alaska is in the northwest corner of North America, bordered by Canada to the east and across the Bering Strait from Russia to the west.", "The State of Hawaii is an archipelago in the mid-Pacific Ocean.", "The U.S. territories are scattered about the Pacific Ocean and the Caribbean Sea, stretching across nine official time zones.", "The extremely diverse geography, climate, and wildlife of the United States make it one of the world's 17 megadiverse countries." ] ], "gold": "There was both a British musical drama and mystery TV series and a 2019 psychological horror thriller film entitled The Lodge. The TV series came to the US on October 17, 2016, when it premiered on the Disney Channel in the United States. The film came to the US on February 7, 2020, when it was given a limited release in the United States.", "prediction 1": "The Lodge is a British musical drama and mystery television series that premiered in the United Kingdom on Disney Channel on 23 September 2016 and in the United States on Disney Channel on 17 October 2016. The series is based on the Israeli series North Star. The Lodge is an upcoming American horror film, directed by Veronika Franz and Severin Fiala, from a screenplay by Franz, Fiala, and Sergio Casci. It stars Riley Keough, Jaeden Lieberher, Richard Armitage, Alicia Silverstone, Lia McHugh, Katelyn Wells, and Daniel Keough. It will have its world premiere at the Sundance Film Festival on January 25, 2019.\n", "prediction 2": "The Lodge is a 2016 British musical drama and mystery television series that premiered in the United Kingdom on Disney Channel on 23 September 2016 and in the United States on Disney Channel on 17 October 2016. The production was opposed by the US government to carrying out a screening in the country. In February 2018, Riley Keough joined the cast of the film, with production beginning that same day. The film had its world premiere at the Sundance Film Festival on January 25, 2019. The second film, The Lodge, was released in the United States in select theaters in limited release in September 8, 2014 and then a wide release in 765 theaters across the country.", "prediction 3": "In the United States, The Lodge is a crime-thriller film that is set in the 1970s. It premiered in the United States on Disney Channel on 17 October 2016. In the UK, The Lodge is a musical drama and mystery television series that premiered in the United Kingdom on Disney Channel on 23 September 2016. In the US, The Lodge is an upcoming American horror film that premiered at the Sundance Film Festival on January 25, 2019. In the UK, The Lodge is a scary comedy television series that premiered in the United Kingdom on Disney Channel on 17 October 2016.", "prediction 4": "The Lodge is a series of British musical drama and mystery television shows that premiered in the United Kingdom on Disney Channel on 23 September 2016 and in the United States on Disney Channel on 17 October 2016. The Lodge is an upcoming American horror film, directed by Veronika Franz and Severin Fiala, from a screenplay they wrote alongside Sergio Casci. It will have its world premiere at the Sundance Film Festival on January 25, 2019.. Still Alice had its world premiere at the Toronto International Film Festival on September 8, 2014 and on February 20, 2015. In the U.S., The film's world premiere at the Sundance Film Festival on January 19, in Glendale and is scheduled for the festival.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 405 }, { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 530 }, { "error type": "Irrelevant", "explanation": "", "start": 563, "end": 592 } ], "missing-info": [], "corrected-prediction": "The Lodge is a British musical drama and mystery television series that premiered in the United States, on the Disney Channel, on 17 October 2016. The Lodge is also the name of an upcoming American horror film with its world premiere on January 25, 2019.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How old you have to be to buy a gun in texas?", "passages": [ [ "Gun laws in Texas", "Gun laws in Texas\n\nGun laws in Texas regulate the sale, possession, and use of firearms and ammunition in the U.S. state of Texas.", "\n\nTexas has no laws regarding possession of any firearm regardless of age; all existing restrictions in State law mirror Federal law except for the prohibition of zip guns.", "A person of any age may possess a firearm such as at a firing range.", "Texas and Federal law only regulate the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers.", "However, a private citizen may sell, gift, lease etc.", "a handgun to anyone over 18 who is not Felon or is a Felon that is 5 years removed from Felony infraction of probation or parole end date and is now a law abiding citizen.", "NFA weapons are also only subject to Federal restrictions; no State regulations exist.", "Municipal and county ordinances on possession and carry are generally overridden (preempted) due to the wording of the Texas Constitution, which gives the Texas Legislature (and it alone)", "the power to \"regulate the wearing of arms, with a view to prevent crime\".", "Penal Code Section 1.08 also prohibits local jurisdictions from enacting or enforcing any law that conflicts with State statute." ] ], "gold": "Texas has no laws regarding possession of any firearm regardless of age; all existing restrictions in State law mirror Federal law except for the prohibition of zip guns. A person of any age may possess a firearm such as at a firing range. Texas and Federal law only regulate the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers. However, a private citizen may sell, gift, lease etc. a handgun to anyone over 18 who is not Felon or is a Felon that is 5 years removed from Felony infraction of probation or parole end date and is now a law abiding citizen. ", "prediction 1": "Texas have no laws regarding possession of any firearm regardless of age, and all existing restrictions in State law mirror Federal law except for the prohibition of zip guns. Federal law only regulates the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers. However, a private citizen may sell, gift, lease etc. a handgun to anyone over 18 who is not a Felon or is a Felon that is 5 years removed from Felon that is no longer Felon or is a Felon that is 5 years removed from Felon that is now a Felon that is not a Felon that is not a Felon that is not a Felon that is a Felon that is not a a a Felon that is a Felon that is now", "prediction 2": "The Texas law regarding the sale of firearms makes it illegal for anyone under the age of 18 to purchase a gun in Texas.", "prediction 3": "In Texas, there are no laws regarding the possession or ownership of firearms regardless of age. A person of any age may possess a firearm such as at a firing range. Texas and Federal law only regulate the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers. However, a private citizen may sell, gift, lease etc. a handgun to anyone over 18 who is not a Felon or is a Felon that is 5 years removed from Felon that is no longer a Felon that is 6 years removed from Felon that is 5 years removed from Felon that is now a law abiding citizen and is now a law abiding citizen.", "prediction 4": "Texas and Federal law only regulate the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers. However, a private citizen may sell, gift, lease etc. a handgun to anyone over 18 who is not a Felon or is a Felon that is 5 years removed from Felony infraction of probation or parole end date and is now a law abiding citizen.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 468, "end": 707 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Texas have no laws regarding possession of any firearm regardless of age, and all existing restrictions in State law mirror Federal law except for the prohibition of zip guns. A person of any age may possess a firearm such as at a firing range. Federal law only regulates the ownership of all firearms to 18 years of age or older, and regulate the transfer of handguns to 21 years or older by FFL dealers. However, a private citizen may sell, gift, lease etc. a handgun to anyone over 18 who is not Felon or is a Felon that is 5 years removed from Felony infraction of probation or parole end date and is now a law abiding citizen." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who sang i've been thinking about you?", "passages": [ [ "I've Been Thinking About You", "I've Been Thinking About You\n\n\"I've Been Thinking About You\" is a song by British-American band Londonbeat from their second studio album \"In the Blood\" (1990).", "It was released in 1990 as the lead single from \"In the Blood\".", "It hit number one on the US \"Billboard\" Hot 100 on April 13, 1991, having hit number two in the United Kingdom the previous year.", "The song also topped the singles charts in Australia, Austria, Belgium, Canada, Finland, Germany, Israel, Italy, the Netherlands, Spain, Sweden, Switzerland and Zimbabwe as well.", "\"Music & Media\" wrote about the song: \"A C&W-tinged pop number underpins the band's characteristic massed gospel vocal style complete with jangling, melodic guitars and she sort of chorus which they patently lacked on their debut LP Speak.", "The first release from the forthcoming second LP In The Blood shows a definite maturity.\"", "Dave Sholin from the \"Gavin Report\" wrote about the song: \"It's always a treat when a song comes along that I can't wait to review.", "Impossible not to detect a Fine Young Cannibals influence on this production that's been the biggest buzz record for the past couple of weeks." ], [ "T.P.E. Featuring Adam Marano", "T.P.E. Featuring Adam Marano\n\nT.P.E. Featuring Adam Marano is the debut album of the dance-pop and freestyle project T.P.E. created by music producer Adam Marano.", "The album was released in 1992 by Micmac Records.", "Of the four singles released from the album, the only one to succeed was \"Then Came You\", which reached No. 91 on the \"Billboard\" Hot 100 in 1991.", "Other singles of this album were \"Forever and a Day\", released in 1992, \"Sex U Down\", released in 1993 and \"Dance with Me\", released in 1994.", "The album also contains the participation of freestyle singers that were already popular locally in Philadelphia such as Denine and Jade Starling, a member of the group Pretty Poison." ], [ "Luke Gower", "Luke Gower\n\nLuke Erin Gower is a member of the Australian progressive rock band Cog (1998\u20132010, 2016\u2013present).", "He plays bass and sings background vocals.", "Gower's oldest brother, Flynn Gower, is their lead singer and guitarist.", "Gower and Flynn formed a group, the Occupants, which issued a single, \"I've Been Thinking\" (April 2013) and an extended play, \"Hindsight\" (November 2014).", "Luke Gower grew up in Sydney and is the youngest of three brothers; Flynn Gower is the oldest.", "Gower joined his brother's progressive rock band, Cog, in 2000, initially as their live bass guitarist.", "He later joined as permanent bassist and played on two of their albums, \"The New Normal\" (2005) and \"Sharing Space\" (2008) and some of their extended plays including, \"Open Up\" (2003).", "The latter includes the band's cover version of the 1993 song by Leftfield featuring John Lydon.", "Cog disbanded in 2010.", "On 24 April 2013 Luke and Flynn Gower released a new single, \"I've Been Thinking\", under a project name, the Occupants.", "It was recorded late 2012 at Rocking Horse Studios in Byron Bay; Forrester Savell produced the track with Troy Wright on drums." ] ], "gold": "I've Been Thinking About You by the British -American Band, Londonbeat appeared on their second studio album, In the Blood. The song has been covered many times. In 1991 a cover of the song was released by Camille on Martru Records and on the compilation album Micmac Dance Party on Micmac Records. In 2016 EDM South African band Goodluck and singer Juliet Harding released versions. Dutch pop band Bounty Island, released a cover version of the song on their 2017 EP\u00a0Forbidden Dance.", "prediction 1": "\"I've Been Thinking About You\" is a song by British-American band Londonbeat from their second studio album In the Blood in 1990. It hit number one on the US Billboard Hot 100 on April 13, 1991, having hit number two in the United Kingdom the previous year. The song also topped the singles charts in Australia, Austria, Belgium, Canada, Finland, Germany, Israel, Italy, the Netherlands, Sweden, Switzerland and Zimbabwe as well. Australian pop-rock band T.P.E. Featuring Adam Marano released their debut album in 1992 by music producer Adam Marano, which featured the lead singer and guitarist Flynnnn Gower.", "prediction 2": "\"I've Been Thinking About You\" is a song by British-American group Londonbeat from their second studio album In the Blood in 1990. It was released in 1990 as the lead single from In the Blood, hitting number one on the US Billboard Hot 100 on April 13, 1991. Luke Gower sang the lead vocals for the song. Gower's brother, Flynn, is the lead singer and guitarist of the progressive rock band Cog.", "prediction 3": "\"I've Been Thinking About You\" is a song by British-American band Londonbeat from their second studio album In the Blood, which was released in 1990 as the lead single from In the Blood. It hit number one on the US Billboard Hot 100 on April 13, 1991, having hit number two in the United Kingdom the previous year. The song also topped the singles charts in Australia, Austria, Belgium, Canada, Finland, Germany, Israel, Italy, the Netherlands, Spain, Sweden, Switzerland and Zimbabwe as well. The song hit number one on the US Billboard Hot 100, having hit number one on the UK the previous year.", "prediction 4": "\"I've Been Thinking About You\" is a song by British-American band Londonbeat from their second studio album \"In the Blood\" released in 1990. It hit number one on the US Billboard Hot 100 on April 13, 1991, having hit number two in the United Kingdom the previous year. Australian progressive rock band, Cog and Luke Gower released a new single, \"I've Been Thinking\", under a project name, the Occupants, which issued a single, \"I've Been Thinking\" on 24 April 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 429 }, { "error type": "Irrelevant", "explanation": "", "start": 550, "end": 609 } ], "missing-info": [], "corrected-prediction": "\"I've Been Thinking About You\" is a song by British-American band Londonbeat from their second studio album In the Blood in 1990. Australian pop-rock band T.P.E. Featuring Adam Marano released their debut album in 1992 by music producer Adam Marano." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who wrote nobody knows you when you're down and out?", "passages": [ [ "Nobody Knows You When You're Down and Out", "Nobody Knows You When You're Down and Out\n\n\"Nobody Knows You When You're Down and Out\" is a blues standard written by Jimmy Cox in 1923.", "Its lyric, told from the point of view of a one-time millionaire during the Prohibition era, reflects on the fleeting nature of material wealth and the friendships that come and go with it.", "As a vaudeville-style blues, it was popularized by Bessie Smith, the preeminent female blues singer of the 1920s and 1930s.", "Since her 1929 recording, it has been interpreted by numerous musicians in a variety of styles.", "When \"Nobody Knows You When You're Down and Out\" was composed in 1923 by Jimmy Cox, the \"Roaring Twenties\" were coming into full swing.", "After the post-World War I recession, a new era of prosperity was experienced in the U.S. and elsewhere.", "However, in the face of all the optimism, Cox wrote a cautionary tale about the fickle nature of fortune and its attendant relationships:\nThe song is a moderate-tempo blues with ragtime-influences, which follows an eight-bar progression:\n\n", "Although \"Nobody Knows You When You're Down and Out\" was published in 1923, the first known recording did not appear until 1927." ], [ "Nobody Loves You (When You're Down and Out)", "Nobody Loves You (When You're Down and Out)\n\n\"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album \"Walls and Bridges\".", "The song is included on the 1986 compilation \"Menlove Ave.", "\", the 1990 boxset \"Lennon\", the 1998 boxset \"John Lennon Anthology\", the 2005 two-disc compilation \"\", and the 2010 boxset \"Gimme Some Truth\".", "Lennon wrote \"Nobody Loves You (When You're Down and Out)\" early in his time in Los Angeles during his separation from wife Yoko Ono, often called his \".\"", "The song reflects his feelings of depression and loneliness during that time.", "Lennon recorded an acoustic demo as early as October 1973.", "Besides his separation from Ono, the lyrics are also influenced by Lennon's disappointment at the negative reception his recent work had received from critics and the public, and his feelings of having been cheated by the music industry.", "The lyrics describe the emptiness he felt as well as his disillusionment with show business.", "Various lines could be taken as cynical responses to Ono, or to Lennon's audience and music critics.", "In response to the question of whether he loves someone, the singer responds \"it's all showbiz.\"" ] ], "gold": "\"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges. A song with a similar title, \"Nobody Knows You When You're Down and Out\", is a blues standard written by pianist Jimmie Cox in 1923 and originally performed in a Vaudeville-blues style.", "prediction 1": "\"Nobody Knows You When You're Down and Out\" is a blues standard written by Jimmy Cox in 1923. Its lyric, told from the point of view of a one-time millionaire during the Prohibition era, reflects on the fleeting nature of material wealth and the friendships that come and go. \"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges and Bridges. \"Nobody Loves You (When You're Down and Out)\" is a song written by John Lenon released on his 1974 album Walls and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and Bridges and", "prediction 2": "\"Nobody Knows You When You're Down and Out\" is a blues standard written by Jimmy Cox in 1923. The song's lyric, told from the point of view of a one-time millionaire during the Prohibition era, reflects on the fleeting nature of material wealth and the friendships that come and go. \"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges.", "prediction 3": "Nobody Knows You When You're Down and Out is a blues standard written by Jimmy Cox in 1923. Its lyric, told from the point of view of a one-time millionaire during the Prohibition era, reflects on the fleeting nature of material wealth and the friendships that come and go. Nobody Loves You (When You're Down and Out) is a song written by John Lennon released on his 1974 album Walls and Bridges. It was written early in his time in his time in Los Angeles during his separation from wife Yoko Ono. The song reflects his feelings of depression and loneliness during that time. John Lenon wrote a song called Nobody Loves You (When You're Down and Out) early in his separation from wife Yoko Ono. The song reflects his feelings of depression and loneliness during that time.", "prediction 4": "\"Nobody Knows You When You're Down and Out\" is a blues standard written by Jimmy Cox in 1923. The song reflects on the fleeting nature of material wealth and the friendships that come and go with it. John Lennon wrote Nobody Loves You (When You're Down and Out) early in his time in Los Angeles during his separation from wife Yoko Ono, often called his \".\" The song reflects his feelings of depression and loneliness during that time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 275 }, { "error type": "Redundant", "explanation": "\"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges ", "start": 400, "end": 412 }, { "error type": "Redundant", "explanation": "\"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges and Bridges. ", "start": 413, "end": 719 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Nobody Knows You When You're Down and Out\" is a blues standard written by Jimmy Cox in 1923. It was a vaudeville-style blues. \"Nobody Loves You (When You're Down and Out)\" is a song written by John Lennon released on his 1974 album Walls and Bridges. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who is the host of the price is right?", "passages": [ [ "The Price Is Right", "It is played after the first three players have completed their pricing games to select one player from this set, and again after the last three.", "In the Showdown, each player is given two chances to spin a wheel which displays every monetary amount from 5\u00a2 to $1.00 in 5\u00a2 increments.", "The player may either stop after the first spin or take the second one, with the values from both spins being added together in the latter case to determine their score.", "The player who comes the closest to $1.00 without going over, either on the first spin alone or the sum of both, advances to the Showcase.", "A score of exactly $1.00 awards a cash bonus and gives the player a chance to win larger amounts in a bonus spin.", "The series debuted September 4, 1972, in two forms: a daily version on CBS with Bob Barker as host, and a weekly version, eventually dubbed \"the nighttime \"Price Is Right\",\" hosted by Dennis James and airing in first-run syndication.", "Barker took over the nighttime version in 1977 (which remained a half-hour in length throughout its existence) and hosted both until the nighttime version was discontinued in 1980.", "The syndicated nighttime version returned five years later, with Tom Kennedy as host and running five days a week.", "This version ran for one season.", "Barker hosted the program from its debut until June 15, 2007." ], [ "The Price Is Right (U.S. game show)", "The Price Is Right (U.S. game show)\n\n", "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman.", "The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes.", "Contestants are selected from the studio audience when the announcer states the show's famous catchphrase, \"Come on down!\"", "The program premiered on September 4, 1972, on CBS.", "Bob Barker was the series' longest-running host from its 1972 debut until his retirement in June 2007, when Drew Carey took over.", "Barker was accompanied by a series of announcers, beginning with Johnny Olson, followed by Rod Roddy and then Rich Fields.", "In April 2011, George Gray became the announcer.", "The show has used several models, most notably Anitra Ford, Janice Pennington, Dian Parkinson, Holly Hallstrom and Kathleen Bradley.", "While retaining some elements of the original version of the show, the 1972 version has added many new distinctive gameplay elements.", "\"The Price Is Right\" has aired over 8,000 episodes since its debut and is one of the longest-running network series in United States television history.", "In a 2007 article, \"TV Guide\" named \"The Price Is Right\" the \"greatest game show of all time.\"" ], [ "The Price Is Right Live!", "After the bids are checked to ensure neither is duplicated, the contestant closer to the actual retail price of the showcase wins a pre-determined prize from the showcase.", "The contestant must be within $100 of the actual price of the showcase to win the entire showcase, which typically includes a car, the only time a car is given away on the live show.", "The production features a rotating series of hosts.", "Hosts have included Todd Newton, Marc Summers, David Ruprecht, Pat Finn, Mark L. Walberg, Roger Lodge, Michael Burger, JD Roberto, George Hamilton, Doug Davidson, Bob Goen, Chuck Woolery, Marco Antonio Regil, Alan Thicke, Drew Lachey, Jerry Springer, Joey Fatone, and current television announcer George Gray.", "Newton, Summers, Regil, Davidson, and Hamilton were contenders to replace Bob Barker, a job that ultimately went to Drew Carey.", "Davidson was also the host of a short-lived syndicated spinoff of the show known as \"The New Price Is Right\", which ran for four months in 1994.", "Regil, who is bilingual, hosted the Mexican version of the show (\"Atinale al Precio\"), which has aired at various times since 1997, including the current Warman-style UK Showcase format that debuted in April 2010." ] ], "gold": "The Price Is Right is an American television game show revolving around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. The series debuted September 4, 1972, in two forms, a daily version on CBS with Bob Barker as host, and a weekly version, eventually dubbed \"the nighttime \"Price Is Right\",\" hosted by Dennis James and airing in first-run syndication. Tom Kennedy hosted the nighttime Price is Right from 1985-86, Doug Davidson from 1994-1995 ad Drew Carey from 2007 to the present. ", "prediction 1": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. Various hosts have hosted the show over the years, including Bob Barker, Marc Summers, David Ruprecht, Pat Finn, Mark L. Walberg, Roger Lodge, Michael Burger, JD Roberto, George Hamilton, Doug Davidson, Bob Goen, Chuck Woolery, Marco Antonio Regil, Alan Thicke, Jerry Springer, Joey Fatone and Jerry Springer.", "prediction 2": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. The host of the show has been Bob Barker since its 1972 debut, and the current host has been Marco Antonio Regil since 1996.", "prediction 3": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman, which revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. The show has featured a number of host since its inception, including Bob Barker from its 1972 debut until his retirement in June 2007. The nighttime version, dubbed The Price Is Right: The Nighttime Game, is hosted by Dennis James and airs in first-run syndication.", "prediction 4": "The Price Is Right is an American television game show created by Bob Stewart, Mark Goodson and Bill Todman. The show revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. The show premiered on September 4, 1972, on CBS with Bob Barker as host. The nighttime version was hosted by Dennis James from 1977 to 1980, with Barker hosting from 1977 to 1980. The syndicated nighttime version returned five years later, with Tom Kennedy as host and running five days a week. The nighttime version returned five years later, with Tom Kennedy as host and George Gray taking over as the announcer. In April 2011, George Gray took over as the nighttime version of the show, before relaunch in syndication.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 108 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Price Is Right is an American television game show that revolves around contestants competing by identifying accurate pricing of merchandise to win cash and prizes. Various hosts have hosted the show over the years, including Bob Barker, who was the host when the show premiered on CBS on September 4, 1972, Dennis James, who at the same time hosted a weekly version, eventually dubbed \"the nighttime \"Price Is Right\" that aired in first-run syndication, Tom Kennedy, who hosted the syndicated nighttime version after its return, Marc Summers, David Ruprecht, Pat Finn, Mark L. Walberg, Roger Lodge, Michael Burger, JD Roberto, George Hamilton, Doug Davidson, who hosted in 1994, Bob Goen, Chuck Woolery, Marco Antonio Regil, Alan Thicke, Jerry Springer, Joey Fatone and Jerry Springer and current television announcer George Gray, and Drew Carey took over in 2007." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is playing in the peach bowl this year?", "passages": [ [ "2014 Peach Bowl", "2014 Peach Bowl\n\nThe 2014 Peach Bowl was a college football bowl game that was played on December 31, 2014, at the Georgia Dome in Atlanta, Georgia.", "The 47th Peach Bowl was one of the \"New Year's Six\" bowl games in the College Football Playoff.", "It was one of the 2014\u201315 bowl games that concluded the 2014 FBS football season.", "The game started at 12:30 PM.", "It was televised on ESPN and ESPN Deportes, and broadcast on ESPN Radio and XM Satellite Radio.", "The 2014 Peach Bowl featured the TCU Horned Frogs of the Big 12 Conference against the Ole Miss Rebels of the Southeastern Conference.", "TCU defeated Ole Miss by a score of 42\u20133.", "Sponsored by the Chick-fil-A restaurant franchise, the game was officially known as the Chick-fil-A Peach Bowl.", "This was the first time since 2005 that the game was called the Peach Bowl.", "Between 2006 and 2013 it was known as the Chick-fil-A Bowl.", "The College Football Playoff Selection Committee selected #6 TCU Horned Frogs and the #9 Ole Miss Rebels to participate in the game.", "TCU was the Big 12 Conference Co-Champions, while Ole Miss was an at-large team, finishing in 3rd place in the SEC West.", "This was the seventh overall meeting between these two teams, with Ole Miss previously leading the series 5\u20131." ], [ "Peach Bowl", "Peach Bowl\n\nThe Peach Bowl is an annual college football bowl game played in Atlanta since December 1968.", "Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl.", "From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl.", "The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta.", "Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game.", "Between 1993 and 2016, the Georgia Dome played host.", "The bowl then moved to Mercedes-Benz Stadium starting in 2017.", "Since the 2014 season, the Peach Bowl has featured College Football Playoff matchups, with the 2016, 2019, 2022, and 2025 games hosting a national semifinal.", "Seven of the first ten meetings (all but the 1968, 1971, and 1974 games) pitted an Atlantic Coast Conference team against an at-large opponent.", "The bowl had no automatic berths prior to 1993, but usually featured an ACC team or a team from the Southeastern Conference.", "From 1993 until 2013, the game matched a SEC team against one from the ACC.", "From 1993 to 2005, this matchup was the third selection from the ACC against the fourth from the SEC.", "In 2005, the bowl hosted its first-ever matchup of top 10 ranked teams." ], [ "2018 Peach Bowl (January)", "2018 Peach Bowl (January)\n\nThe 2018 Peach Bowl was a college football bowl game played on January 1, 2018, between the UCF Knights and the Auburn Tigers.", "It was the 50th edition of the Peach Bowl, and the first Peach Bowl to be played in Mercedes-Benz Stadium, after spending the previous 25 editions in the now demolished Georgia Dome.", "The 50th Peach Bowl was one of the College Football Playoff New Year's Six bowl games, and was one of the 2017\u201318 bowl games concluding the 2017 FBS football season.", "Sponsored by the Chick-fil-A restaurant franchise, the game was officially known as the Chick-fil-A Peach Bowl.", "The game was televised on ESPN and ESPN Deportes, and broadcast on ESPN Radio and XM Satellite Radio.", "The two participants for the game were the UCF Knights (automatically qualifying as the highest ranked conference champion team from the \"Group of Five\" conferences) and the Auburn Tigers.", "Entering the game, the Tigers led the all-time series with the Knights, 3\u20130; the most recent matchup saw the Tigers defeat the Golden Knights (as the Knights were then known as) by a score of 28\u201310 on November 6, 1999, in Auburn.", "McKenzie Milton had a breakout game for the UCF Knights with 245 passing yards throwing for two touchdowns and a rushing touchdown." ] ], "gold": "Cincinnati and Georgia were selected by the College Football Playoff selection committee to participate in the 2021 Peach Bowl. Previously, LSU and Oklahoma played in the 2019 Peach Bowl, while the UCF Knights and Auburn Tigers did in the January 2018 Peach Bowl, and the Michigan Wolverines and Florida Gators did in the December 2018 Peach Bowl. Washington and Alabama played in the Peach Bowl in 2016, while Florida State and Houston did in 2015, and TCU and Mississippi did in 2014.", "prediction 1": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. The 2015 Peach Bowl featured the TCU Horned Frogs of the Big 12 Conference against the Ole Miss Rebels of the Southeastern Conference. The 2016 Peach Bowl featured the UCF Knights and the Auburn Tigers. The 2017 Peach Bowl featured the Georgia Bulldogs and the Texas A&M Aggies. The 2018 Peach Bowl featured the UCF Knights and the Auburn Tigers.", "prediction 2": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. This was the first time since 2005 that the game was called the Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl. The 2018 Peach Bowl was a college football bowl game played on January 1, 2018, between the UCF Knights and the Auburn Tigers. The 2018 Peach Bowl was the first Peach Bowl to be played in Mercedes-Benz Stadium, after spending the previous 25 editions in the now demolished Georgia Dome.", "prediction 3": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. The 2018 Peach Bowl was a college football bowl game played on January 1, 2018, between the UCF Knights and the Auburn Tigers. The 2014 Peach Bowl featured the TCU Horned Frogs of the Big 12 Conference against the Ole Miss Rebels of the Southeastern Conference. Since 2013, it has been officially referred to as the Chick-fil-A Peach Bowl. Since 2005 it has been sponsored by Chick-fil-fil-fil-A Peach Bowl.", "prediction 4": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997 it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. The 2014 Peach Bowl featured the TCU Horned Frogs of the Big 12 Conference against the Ole Miss Rebels of the Southeastern Conference. The 2018 Peach Bowl was a college football bowl game played on January 1, 2018, between the UCF Knights and the Auburn Tigers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 93 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 98, "end": 102 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 228 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 233, "end": 237 }, { "error type": "Unverifiable", "explanation": "", "start": 330, "end": 372 }, { "error type": "Redundant", "explanation": "The 2016 Peach Bowl featured the UCF Knights and the Auburn Tigers. ", "start": 373, "end": 440 } ], "missing-info": [], "corrected-prediction": "The 2014 Peach Bowl featured the TCU against the Ole Miss. The 2018 Peach Bowl featured the UCF Knights and the Auburn Tigers. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who sang on evanescence bring me to life?", "passages": [ [ "Bring Me to Life", "In 2010, German band Gregorian released a cover version of the song on their album \"Dark Side of the Chant\".", "In 2016 Chris Daughtry of American rock band Daughtry covered the song for the soundtrack of \"\".", "\"Bring Me to Life\" was included in the games \"Rock Band\", \"Rock Band Unplugged\", \"Band Hero\", DLC for SingStar, and \"Fight Girl Battle World\".", "The song was used during the Calgary Flames' run in the 2004 Stanley Cup playoffs.", "The song served as the official theme song of the WWE pay-per-view event No Way Out (2003).", "Welsh classical singer Katherine Jenkins recorded a cover version of \"Bring Me to Life\" on her 2009 album \"Believe\".", "Jenkins said: \"I'd mentioned that I wanted to try Evanescence's Bring Me to Life and David [Foster] said 'you can't sing that'.", "I came out there questioning my vocal abilities.", "I'm just not used to being told that.", "I went home that night and I just thought to myself 'you have to pull yourself together, he's worked with so many incredible artists you have to step up the plate.'", "I did talk myself round and I went in there the next day on a mission." ], [ "Bring Me to Life", "The \"Synthesis\" version of \"Bring Me to Life\" is a stripped-down one, as it replaces the drums and the guitars from the original version with a strings arrangement accompanied by crashing cymbals, \"tension-building\" timpani drums and various electronic elements throughout.", "Several critics have described its new arrangement as \"dramatic\", with \"Billboard\"s Sadie Bell calling it \"just as rich\" as the original and \"Rolling Stone\"s Brittany Spanos calling it a \"cinematic take\".", "Lee has described the song as \"new\" to her again due to the fact that she incorporated musical elements and vocals which she had \"heard in [her] head\" since its release.", "Mixtery used up-beat samplings of the song in a hit also titled \"Bring Me to Life\" featuring Nigerian Eurodance artist Eddy Wata.", "American pianist John Tesh released an instrumental version of the song on his albums \"A Deeper Faith, Vol. 2\" (2003) and \"A Passionate Life\" (2007).", "In 2003, Kidz Bop Kids covered the song on their fourth studio album, \"Kidz Bop 4\".", "In 2008, black metal band Wykked Wytch covered the song and produced an accompanying music video.", "Their version was digitally released in October of that year on iTunes Store." ] ], "gold": "The song Bring Me To Life was a song performed by Evanescence's Amy Lee and Paul McCoy. The song has been sung as a cover by several artist's over the years, in 2008 it was performed by Wykked Wytch, in 2009 Katherine Jenkins, 2010 Gregorian, and in 2016 Daughtry. ", "prediction 1": "There are several artists who have covered Evanescence's Bring Me To Life. Welsh classical singer Katherine Jenkins recorded a cover version of Bring Me To Life on her 2009 album Believe. Kidz Bop Kids covered the song on their 2004 album Kidz Bop 4, Black metal band Wykked Wytch covered the song on their 2008 album Wykked Wytch, and black metal band Wykked Wytch produced an accompanying music video for their version.", "prediction 2": "In 2010, German band Gregorian released a cover version of the song on their album Dark Side of the Chant. In 2016 Chris Daughtry of American rock band Daughtry covered the song for the soundtrack of \". Welsh classical singer Katherine Jenkins recorded a cover version of \"Bring Me to Life\" on her 2009 album Believe. American pianist John Tesh released an instrumental version of the song on his albums A Deeper Faith, Vol. 2 and A Passionate Life, respectively. In 2003, Kidz Bop Kids covered the song on their fourth studio album Kidz Bop 4. In 2004, Kidz Bop Kids covered the song on their fourth studio album Wykked Wytch covered the song and produced an accompanying music video. Black metal band Wykked Wytch covered the song and produced a digitally released an accompanying music video. In 2010, German band Gregorian released a cover of the song on their", "prediction 3": "Evanescence's Bring Me to Life is a song that was written in 2007. The band Evanescence sang on the song. Welsh classical singer Katherine Jenkins recorded a cover version of Bring Me to Life on her 2009 album Believe. American pianist John Tesh released an instrumental version of the song on his albums A Deeper Faith, Vol. 2 and A Passionate Life (2007). In 2010, German band Gregorian released a cover version of the song on their album Dark Side of the Chant. In 2016, Chris Daughtry of American rock band Daughtry covered the song for the soundtrack of \"Diet\". In 2016, American rock band Daughtry covered the song for the soundtrack of \"Daughtry\".", "prediction 4": "Evanescence's Bring Me to Life was sung by David Foster and Katherine Jenkins. The band Gregorian also sang on the album Dark Side of the Chant in 2010. Black metal band Wykked Wytch also sang on the album Bring Me to Life. The song was included in the games Rock Band, Rock Band Unplugged, Band Hero, and Fight Girl Battle World.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 187 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 228, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 250 }, { "error type": "Unverifiable", "explanation": "", "start": 298, "end": 331 }, { "error type": "Redundant", "explanation": "Black metal band Wykked Wytch covered the song on their 2008 album Wykked Wytch, ", "start": 336, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 421 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "There are several artists who have covered Evanescence's Bring Me To Life. Welsh classical singer Katherine Jenkins recorded a cover version of Bring Me To Life. Kidz Bop Kids covered the song in 2003. Black metal band Wykked Wytch covered the song in 2008. In 2010, German band Gregorian released a cover version and in 2016 Chris Daughtry covered the song." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When did the cabbage patch dolls come out?", "passages": [ [ "Cabbage Patch Kids", "Otis Lee is the leader of the gang of Cabbage Patch Kids that befriended Xavier.\n\n", "The name change to Cabbage Patch Kids was made in 1982 when Xavier's company, Original Appalachian Artworks, began to license a smaller version of the handmade creations to a toy manufacturer named Coleco which began mass production the same year.", "The Coleco Cabbage Patch Kids had large, round vinyl heads (originally of a different, hard plastic), and soft fabric bodies, and were produced from 1982 to 1989, many at a factory in Amsterdam, New York.", "The first two years production was all from the Far East, with nine head variations produced and computer-matched with bodies to ensure each doll was \"different\".", "It was, in fact, a marketing ploy that worked quite well as a wide range of variations resulted.", "(Source: Larry Moniz, then senior account supervisor for the Coleco account at Richard Weiner Public Relations in NYC.)", "At the peak of their popularity, the dolls were a must-have toy for Christmas.", "Parents across the United States flocked to stores to try to obtain one of the Cabbage Patch Kids for their children, with fights occasionally erupting between parents over the hard-to-find dolls.", "In later years, Coleco introduced variants on the original Cabbage Patch Kids, and derivatives of the original line of dolls continued to be marketed." ], [ "Arnold Greenberg (Coleco)", "Greenberg aggressively developed new games and hired talent from rival companies, keeping Coleco competitive through the 1970s.", "Near the end of the decade, Greenberg decided to develop a home console that could play a variety of arcade-quality games.", "In 1981, Coleco began producing tabletop versions of arcade titles.", "The home ColecoVision console was released the following year.", "Greenberg also moved into third-party game development for systems from rivals Atari and Intellivision.", "His biggest coup was winning the license to \"Donkey Kong\" from Nintendo, although this eventually got him embroiled in a court case.", "After the video game crash of 1983, Greenberg decided to move into home computing.", "He put all hope in the Adam Computer.", "Greenberg rushed the product through development in order to ship in 1983.", "As a result, many of the units were defective and had to be returned.", "Coleco shares fell 22 points.", "Greenberg swore to rectify the situation, but the damage had already been done.", "Meanwhile, in 1983, Greenberg had obtained the license to produce Xavier Roberts's Little People dolls, which Coleco renamed Cabbage Patch Kids.", "The company produced 2.5 million dolls that year, not anticipating the huge rush for the toys that holiday season.", "The Cabbage Patch fad lasted until 1985 but was unable to rescue the ailing toymaker." ] ], "gold": "Cabbage Patch Kids\u00a0are a line of one-of-a-kind cloth dolls with plastic heads. Original Appalachian Artworks, Inc. signed an agreement to produce them in August 1982, and they were introduced at the International Toy Fair in 1983.", "prediction 1": "The Cabbage Patch Kids came out in 1983, but they didn't catch on until 1985, when the fad lasted until the company's rescue. The first batch of Coleco Cabbage Patch Kids were made in 1984, and were first produced in 1985 by the company's subsidiary, Xavier Roberts's Little People.", "prediction 2": "The Cabbage Patch Kids came out in 1982, when Xavier Roberts' company, Original Appalachian Artworks, began to license a smaller version of the handmade creations to a toy manufacturer named Coleco which began mass production the same year. The Coleco Cabbage Patch Kids had large, round vinyl heads and soft fabric bodies, and were produced from 1982 to 1989, many at a factory in Amsterdam, New York.", "prediction 3": "The Cabbage Patch Kids came out in three distinct versions: the original Cabbage Patch dolls in 1973 and the Coleco Cabbage Patch Kids in 1982. The original Cabbage Patch Kids came out in 1973, the Coleco Cabbage Patch Kids in 1982, and the original Cabbage Patch Kids in 1989. In later years, Coleco introduced variants on the original Cabbage Patch Kids, and derivatives of the original line of dolls continued to be marketed.", "prediction 4": "Cabbage Patch Kids, popularly known as \"The Cabbage Patch Dolls\", came out from 1983 to 1989. In 1982, Xavier Roberts' company, Original Appalachian Artworks, began to license a smaller version of the handmade creations to a toy manufacturer named Coleco, which began mass production the same year. The Coleco Cabbage Patch Kids had large, round vinyl heads, and soft fabric bodies, and were produced from 1982 to 1989, many at a factory in Amsterdam, New York.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[15]}", "start": 41, "end": 125 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 130, "end": 189 }, { "error type": "Redundant", "explanation": "The first batch of Coleco Cabbage Patch Kids were made in 1984, ", "start": 194, "end": 221 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 251, "end": 282 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 35, "end": 40 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Cabbage Patch Kids had large, round vinyl heads (originally of a different, hard plastic). Original Appalachian Artworks, began to license to a toy manufacturer named Coleco which began mass production in 1982." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "What geological feature is a fracture in earth's crust?", "passages": [ [ "Fracture (geology)", "Fracture (geology)\n\nA fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces.", "A fracture will sometimes form a deep fissure or crevice in the rock.", "Fractures are commonly caused by stress exceeding the rock strength, causing the rock to lose cohesion along its weakest plane.", "Fractures can provide permeability for fluid movement, such as water or hydrocarbons.", "Highly fractured rocks can make good aquifers or hydrocarbon reservoirs, since they may possess both significant permeability and fracture porosity.", "Fractures are forms of brittle deformation.", "There are two types of primary brittle deformation processes.", "Tensile fracturing results in \"joints\".", "\"Shear fractures\" are the first initial breaks resulting from shear forces exceeding the cohesive strength in that plane.", "After those two initial deformations, several other types of secondary brittle deformation can be observed, such as \"frictional sliding\" or \"cataclastic flow\" on reactivated joints or faults.", "Most often, fracture profiles will look like either a blade, ellipsoid, or circle.", "Fractures in rocks can be formed either due to compression or tension.", "Fractures due to compression include thrust faults.", "Fractures may also be a result from shear or tensile stress.", "Some of the primary mechanisms are discussed below." ], [ "Material failure theory", "The quantity formula_13 is postulated as a material parameter called the fracture toughness.", "The mode I fracture toughness for plane strain is defined as\nwhere formula_4 is a critical value of the far field stress and formula_16 is a dimensionless factor that depends on the geometry, material properties, and loading condition.", "The quantity formula_17 is related to the stress intensity factor and is determined experimentally.", "Similar quantities formula_18 and formula_19 can be determined for mode II and model III loading conditions.", "The state of stress around cracks of various shapes can be expressed in terms of their stress intensity factors.", "Linear elastic fracture mechanics predicts that a crack will extend when the stress intensity factor at the crack tip is greater than the fracture toughness of the material.", "Therefore, the critical applied stress can also be determined once the stress intensity factor at a crack tip is known.", "The linear elastic fracture mechanics method is difficult to apply for anisotropic materials (such as composites) or for situations where the loading or the geometry are complex.", "The strain energy release rate approach has proved quite useful for such situations." ], [ "Fault (geology)", "Fault (geology)\n\n", "In geology, a fault is a planar fracture or discontinuity in a volume of rock, across which there has been significant displacement as a result of rock-mass movement.", "Large faults within the Earth's crust result from the action of plate tectonic forces, with the largest forming the boundaries between the plates, such as subduction zones or transform faults.", "Energy release associated with rapid movement on active faults is the cause of most earthquakes.", "A \"fault plane\" is the plane that represents the fracture surface of a fault.", "A \"fault trace \" or \"fault line\" is a place where the fault can be seen or mapped on the surface.", "A fault trace is also the line commonly plotted on geologic maps to represent a fault.", "Since faults do not usually consist of a single, clean fracture, geologists use the term fault zone when referring to the zone of complex deformation associated with the fault plane.", "Because of friction and the rigidity of the constituent rocks, the two sides of a fault cannot always glide or flow past each other easily, and so occasionally all movement stops.", "The regions of higher friction along a fault plane, where it becomes locked, are called \"asperities\"." ] ], "gold": "A crack in the Earth's crust with no movement is the geological feature called a fracture, whereas one with movement is the geological feature called a fault. A fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces. A fault is a planar fracture or discontinuity in rock across which there has been significant displacement.", "prediction 1": "A fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces. Fractures are commonly caused by stress exceeding the rock strength, causing the rock to lose cohesion along its weakest plane. The most common geological feature found in earth's crust is a planar fracture, while a fault is a planar discontinuity in a volume of rock across which there has been significant displacement as a result of rock-mass movement.", "prediction 2": "A fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces. In geology, a fault is a planar fracture or discontinuity in a volume of rock across which there has been significant displacement as a result of rock-mass movement. Large faults within the Earth's crust result from the action of plate tectonic forces, with the largest forming the boundaries between the plates, such as subduction zones or transform faults.", "prediction 3": "A fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces. A fracture will sometimes form a deep fissure or crevice in the rock. Fractures are commonly caused by stress exceeding the rock strength, causing the rock to lose cohesion along its weakest plane.", "prediction 4": "In geology, a fracture is any separation in a geologic formation that divides the rock into two or more pieces, such as a joint or a fault. A fracture will sometimes form a deep fissure or crevice in the rock.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 255 }, { "error type": "Unverifiable", "explanation": "", "start": 260, "end": 271 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 355, "end": 375 } ], "missing-info": [], "corrected-prediction": "A fracture is any separation in a geologic formation, such as a joint or a fault that divides the rock into two or more pieces. A fault is a planar fracture or discontinuity in a volume of rock, across which there has been significant displacement as a result of rock-mass movement." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was contracted to design golden gate park?", "passages": [ [ "Golden Gate Park", "Golden Gate Park\n\nGolden Gate Park, located in San Francisco, California, United States, is a large urban park consisting of of public grounds.", "It is administered by the San Francisco Recreation & Parks Department, which began in 1871 to oversee the development of Golden Gate Park.", "Configured as a rectangle, it is similar in shape but 20 percent larger than Central Park in New York, to which it is often compared.", "It is over three miles () long east to west, and about half a mile () north to south.", "With 13 million visitors annually, Golden Gate is the fifth most-visited city park in the United States after Central Park in New York City, Lincoln Park in Chicago, and Balboa and Mission Bay Parks in San Diego.", "In the 1860s, San Franciscans began to feel the need for a spacious public park similar to Central Park, which was then taking shape in New York City.", "Golden Gate Park was carved out of unpromising sand and shore dunes that were known as the Outside Lands, in an unincorporated area west of San Francisco's then-current borders.", "Conceived ostensibly for recreation, the underlying purpose of the park was housing development and the westward expansion of the city.", "The tireless field engineer William Hammond Hall prepared a survey and topographic map of the park site in 1870 and became its commissioner in 1871." ], [ "Golden Gate Park", "Stanford, who was president of the Southern Pacific Railroad, was also one of the owners of the Ocean Railroad Company, which ran from Haight Street across the park to its south border, then out to the beach and north to a point near Cliff House.", "It was Gus Mooney who claimed land adjacent to the park on Ocean Beach.", "Many of Mooney's friends also staked claims and built shanties on the beach to sell refreshments to the patrons of the park.", "Hall resigned, and the remaining park commissioners followed.", "In 1882 Governor George C. Perkins appointed Frank M. Pixley, founder and editor of The Argonaut, to the board of commissioners of San Francisco's Golden Gate Park.", "Pixley was adamant that the Mooney's shanties be eliminated, and he found support with the San Francisco Police for park security.", "Pixley favored Stanford's company by granting a fifty-year lease on the route that closed the park on three sides to competition.", "The original plan, however, was back on track by 1886, when streetcars delivered over 47,000 people to Golden Gate Park on one weekend afternoon (out of a population of 250,000 in the city).", "The first stage of the park's development centered on planting trees in order to stabilize the dunes that covered three-quarters of the park's area." ], [ "John McLaren (horticulturist)", "He built two windmills to pump water to his park and had the sweepings from San Francisco streets delivered as fertilizer.", "When ocean waves and wind piled sand on the west end of the park, he began a forty-year effort to pile branches, clippings and laths on the shore to capture sand and build the great berm that now holds the Great Highway.", "He had a shrewd and aggressive style of management but was so highly respected that, at the age of 70, he was given lifetime tenure over the park and his salary doubled.", "An avenue in the Seacliff District of San Francisco was named after him during his lifetime, and he was awarded an honorary doctorate by the University of California at Berkeley.", "He is credited with planting two million trees during his lifetime.", "The McLaren Park in the southern part of San Francisco is named after John McLaren, as is McLaren Lodge in Golden Gate Park, where he lived until his death.", "East Bay's Tilden Park also has a meadow named after him.", "A small statue of McLaren was erected in the park which he had hidden away only to be discovered after his death.", "After his death at the age of 96, McLaren's body lay in state in the San Francisco City Hall Rotunda.", "Afterwards, the funeral cortege drove his casket through Golden Gate Park as a special honor." ] ], "gold": "William Hammond Hall along with his assistant, John McLaren, designed Golden Gate Park in San Francisco. John McLaren would go on to serve as superintendent of Golden Gate Park for 56 years and is credited with planting more than two million trees during his lifetime. William Hammond Hall would later be named California's first state engineer.", "prediction 1": "The construction of Golden Gate Park began in 1870 by the tireless field engineer William Hammond Hall. In 1882, Governor George C. Perkins appointed Frank M. Pixley to the board of commissioners of San Francisco's Golden Gate Park. Pixley was a founder and editor of The Argonaut, who was appointed to the board of commissioners of San Francisco's Golden Gate Park. John McLaren was contracted to design the park's layout and design the buildings.", "prediction 2": "The tireless field engineer William Hammond Hall prepared a survey and topographic map of the park site in 1870 and became its commissioner in 1871. The tireless John McLaren, a landscape architect, was contracted to design Golden Gate Park. He lived in the park for forty years and was credited with planting two million trees. Frank M. Pixley, founder and editor of The Argonaut, was appointed to the board of commissioners of San Francisco's Golden Gate Park.", "prediction 3": "The tireless field engineer William Hammond Hall prepared a survey and topographic map of the park site in 1870 and became its commissioner in 1871. The underlying purpose of the park was housing development and the westward expansion of the city. In 1882 Governor George C. Perkins appointed Frank M. Pixley, founder and editor of The Argonaut, to the board of commissioners of San Francisco's Golden Gate Park. Pixley was adamant that the Mooney's shanties be eliminated, and his salary doubled. He was so highly respected and was so highly respected that, at the age of 70, he was given lifetime tenure over the park and his salary doubled.", "prediction 4": "Golden Gate Park is a large urban park consisting of public grounds located in San Francisco, California, United States. It is administered by the San Francisco Recreation & Parks Department, which began in 1871 to oversee the development of Golden Gate Park. William Hammond Hall, who prepared a survey and topographic map of the park site in 1870, became its commissioner in 1871. Frank M. Pixley, founder and editor of The Argonaut, was appointed to the board of commissioners of San Francisco's Golden Gate Park in 1882.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 366 }, { "error type": "Unverifiable", "explanation": "", "start": 380, "end": 448 } ], "missing-info": [], "corrected-prediction": "The construction of Golden Gate Park began by the tireless field engineer William Hammond Hall. John McLaren was given lifetime tenure over the park. He is credited with planting two million trees during his lifetime." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did sound become a regular part of the motion picture viewing experience?", "passages": [ [ "Sound film", "On June 9, 1922, he gave the first reported U.S. demonstration of a sound-on-film motion picture to members of the American Institute of Electrical Engineers.", "As with Lauste and Tigerstedt, Tykociner's system would never be taken advantage of commercially; however, De Forest's soon would.", "On April 15, 1923, at New York City's Rivoli Theater, came the first commercial screening of motion pictures with sound-on-film, the future standard: a set of shorts under the banner of De Forest Phonofilms, accompanying a silent feature.", "That June, De Forest entered into an extended legal battle with an employee, Freeman Harrison Owens, for title to one of the crucial Phonofilm patents.", "Although De Forest ultimately won the case in the courts, Owens is today recognized as a central innovator in the field.", "The following year, De Forest's studio released the first commercial dramatic film shot as a talking picture\u2014the two-reeler \"Love's Old Sweet Song\", directed by J. Searle Dawley and featuring Una Merkel.", "However, phonofilm's stock in trade was not original dramas but celebrity documentaries, popular music acts, and comedy performances." ], [ "Sound film", "Sound film\n\nA sound film is a motion picture with synchronized sound, or sound technologically coupled to image, as opposed to a silent film.", "The first known public exhibition of projected sound films took place in Paris in 1900, but decades passed before sound motion pictures were made commercially practical.", "Reliable synchronization was difficult to achieve with the early sound-on-disc systems, and amplification and recording quality were also inadequate.", "Innovations in sound-on-film led to the first commercial screening of short motion pictures using the technology, which took place in 1923.", "The primary steps in the commercialization of sound cinema were taken in the mid- to late 1920s.", "At first, the sound films which included synchronized dialogue, known as \"talking pictures\", or \"talkies\", were exclusively shorts.", "The earliest feature-length movies with recorded sound included only music and effects.", "The first feature film originally presented as a talkie was \"The Jazz Singer\", released in October 1927.", "A major hit, it was made with Vitaphone, which was at the time the leading brand of sound-on-disc technology.", "Sound-on-film, however, would soon become the standard for talking pictures.", "By the early 1930s, the talkies were a global phenomenon." ], [ "Movie theater", "Sound-on-film, however, would soon become the standard for talking pictures.", "By the early 1930s, the talkies were a global phenomenon.", "In the United States, they helped secure Hollywood's position as one of the world's most powerful cultural/commercial systems (see Cinema of the United States).", "In Europe (and, to a lesser degree, elsewhere), the new development was treated with suspicion by many filmmakers and critics, who worried that a focus on dialogue would subvert the unique aesthetic virtues of soundless cinema.", "In Japan, Philippines, where the popular film tradition integrated silent movie and live vocal performance, talking pictures were slow to take root.", "In India, sound was the transformative element that led to the rapid expansion of the nation's film industry.", "Traditionally a movie theater, like a stage theater, consists of a single auditorium with rows of comfortable padded seats, as well as a foyer area containing a box office for buying tickets.", "Movie theaters also often have a concession stand for buying snacks and drinks within the theater's lobby.", "Other features included are film posters, arcade games and washrooms.", "Stage theaters are sometimes converted into movie theaters by placing a screen in front of the stage and adding a projector; this conversion may be permanent, or temporary for purposes such as showing arthouse fare to an audience accustomed to plays." ] ], "gold": "In 1900, short films of of theater, opera, and ballet excerpts presented at the Paris Exposition appear to be the first publicly exhibited films with projection of both image and recorded sound. In 1923, the first commercial screening of motion pictures with sound-on-film came in New York City at Rivoli Theater. However, at first, the sound films which included synchronized dialogue, known as talking pictures, or talkies, were exclusively shorts. In October 1927, the first feature film originally presented as a talkie, The Jazz Singer, was released. The movie was a major hit and by the early 1930s talkies were a global phenomenon.", "prediction 1": "The first known public exhibition of projected sound films took place in Paris in 1900. But the next decade passed before sound motion pictures were made commercially practical. The primary steps in the commercialization of sound cinema were taken in the mid- to late 1920s. Sound-on-film, however, would soon become the standard for talking pictures. By the early 1930s, the talkies were a global phenomenon.", "prediction 2": "A sound film is a motion picture with synchronized sound, or sound technologically coupled to image, as opposed to a silent film. The first known public exhibition of projected sound films took place in Paris in 1900, but decades passed before sound motion pictures were made commercially practical. On April 15, 1923, at New York City's Rivoli Theater, came the first commercial screening of motion pictures with sound-on-film, the future standard: a set of shorts under the banner of De Forest Phonofilms, accompanying a silent feature film. By the early 1930s, the talkies were a global phenomenon. Sound-on-film, however, would soon become the standard for talking pictures.", "prediction 3": "A sound film is a motion picture with synchronized sound, or sound technologically coupled to image, as opposed to a silent film. The first known public exhibition of projected sound films took place in Paris in 1900, but decades passed before sound motion pictures were made commercially practical. On April 15, 1923, at New York City's Rivoli Theater, came the first commercial screening of motion pictures with sound-on-film, the future standard: a set of shorts under the banner of De Forest Phonofilms, accompanying a silent feature film. By the early 1930s, the talkies were a global phenomenon.", "prediction 4": "The first known public exhibition of projected sound films took place in Paris in 1900, but decades passed before sound motion pictures were made commercially practical. The prime steps in the commercialization of sound cinema were taken in the mid- to late 1920s. Innovations in sound-on-film led to the first commercial screening of short motion pictures using the technology, which took place in 1923. Sound-on-film, however, would soon become the standard for talking pictures. By the early 1930s, the talkies were a global phenomenon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 351 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The first known public exhibition of projected sound films took place in Paris in 1900. On April 15, 1923, at New York City's Rivoli Theater, came the first commercial screening of motion pictures with sound-on-film. At first, the sound films which included synchronized dialogue, known as \"talking pictures\", or \"talkies\", were exclusively shorts. The first feature film originally presented as a talkie was \"The Jazz Singer\", released in October 1927. It was a major hit and by the early 1930s, the talkies were a global phenomenon." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "When did michael jordan stop playing for the chicago bulls?", "passages": [ [ "Michael Jordan", "Although Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season.", "Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Wizards.", "Jordan's individual accolades and accomplishments include six NBA Finals Most Valuable Player (MVP) Awards, ten scoring titles (both all-time records), five MVP Awards, ten All-NBA First Team designations, nine All-Defensive First Team honors, fourteen NBA All-Star Game selections, three All-Star Game MVP Awards, three steals titles, and the 1988 NBA Defensive Player of the Year Award.", "He holds the NBA records for highest career regular season scoring average (30.12 points per game) and highest career playoff scoring average (33.45 points per game).", "In 1999, he was named the greatest North American athlete of the 20th century by ESPN, and was second to Babe Ruth on the Associated Press' list of athletes of the century." ] ], "gold": "Michael Jordan retired from the Chicago Bulls in January 1999, after leading the team to their third consecutive championship in the 1997-1998 season. Jordan later returned to the NBA as a member of the Washington Wizards for the 2001-2002 and 2002-2003 seasons.", "prediction 1": "Michael Jordan played for the Chicago Bulls from 1993 to 1999. He then retired from the NBA for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.\n", "prediction 2": "Michael Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, hoping to start a new career in Minor League Baseball. However, he returned to the Chicago Bulls in 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Jordan later retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.", "prediction 3": "Michael Jordan played with the Chicago Bulls for one season in 1993-94 before he abruptly retired from playing professionally, yet returned to basketball with the Bulls in 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. He retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.", "prediction 4": "Michael Jordan played for the Chicago Bulls from 1993 to 1994 at the age of 33. He abruptly retired from basketball before the start of the 1993\u201394 NBA season. He returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Michael Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Michael Jordan played for the Chicago Bulls from 1993 to 1999. He then retired from the NBA for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.\n" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does the united states energy come from?", "passages": [ [ "Energy in the United States", "Energy in the United States\n\nThe United States was the second-largest energy consumer in 2010 (after China) considering total use.", "The nation is ranked seventh in energy consumption per-capita after Canada and several small nations.", "Not included is the significant amount of energy used overseas in the production of retail and industrial goods consumed in the U.S. Most of this energy comes from fossil fuels: in 2010, data showed that 25% of the nation's energy originates from petroleum, 22% from coal, and 22% from natural gas.", "Nuclear power supplied 8.4% and renewable energy supplied 8%, mainly from hydroelectric dams and biomass; however, this also includes other renewable sources like wind power, geothermal, and solar energy.", "As of 2006, energy consumption had increased more rapidly than domestic energy production over the last 50 years in the nation (when they were roughly equal).", "This difference was largely met through imports.", "According to the Energy Information Administration's statistics, the per-capita energy consumption in the US has somewhat been consistent from the 1970s to the present time.", "The average was about 334 million British thermal units (BTUs) per person from 1980 to 2010." ] ], "gold": "Energy in the United States comes mostly from fossil fuels. In 2010, data showed that 69% of the nation's energy originates from petroleum, coal, and natural gas. Nuclear energy supplied 8.4%, while renewable energy supplied 8%, mainly from hydroelectric dams and biomass, wind, geothermal and solar energy sources. The data also showed that the United States was the second-largest energy consumer in 2010 after China. ", "prediction 1": "The United States' energy comes from a large variety of sources. Most of this energy comes from fossil fuels. In 2010, data showed that 25% of the nation's energy originates from petroleum, 22% from coal, and 22% from natural gas. Nuclear power supplied 8.4% and renewable energy supplied 8%. However, this also includes other renewable sources like wind power, geothermal, and solar energy.", "prediction 2": "The United States energy comes from fossil fuels. In 2010, data showed that 25% of the nation's energy originates from petroleum, 22% from coal, and 22% from natural gas. Nuclear power supplied 8.4% and renewable energy supplied 8%, mainly from hydroelectric dams and biomass. However, this also includes other renewable sources like wind power, geothermal, and solar energy.", "prediction 3": "The United States energy comes mainly from fossil fuels, which includes petroleum, coal, and natural gas. Renewable energy comes from hydroelectric dams and biomass.", "prediction 4": "The United States energy comes from fossil fuels, mainly petroleum, coal, and natural gas. Additionally, solar energy comes from the United States and wind energy comes from the United States.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States' energy comes from a large variety of sources. Most of this energy comes from fossil fuels. In 2010, data showed that 25% of the nation's energy originates from petroleum, 22% from coal, and 22% from natural gas. Nuclear power supplied 8.4% and renewable energy supplied 8% mainly from hydroelectric dams and biomass. However, this also includes other renewable sources like wind power, geothermal, and solar energy. The United States was the second-largest energy consumer in 2010 (after China) considering total use." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "How many bouncers are allowed in an over in odis?", "passages": [ [ "Bouncer (cricket)", "Bouncer (cricket)\n\n", "In the sport of cricket, a bouncer (or bumper) is a type of delivery, usually bowled by a fast bowler.", "Bouncers are used to drive the batsman back on to his back foot if he has been freely playing front foot scoring shots, such as drives.", "To this end, bouncers are usually directed more or less at the line of the batsman's body.", "Aiming at the batsman is legal provided the ball bounces on the pitch; or upon reaching the batsman, the ball is below the batsman's waist.", "Aiming at the batsman's head without bouncing on the pitch, known as a beamer, is illegal.", "A batsman may play a bouncer in either a defensive or an attacking way.", "If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball.", "For a head-high bouncer, these goals are achieved most easily by ducking under the ball.", "If the ball is at chest height, the batsman's best defence is to move on to his back foot, raise his bat vertically to chest height, and attempt to block the ball and direct it downwards to the pitch so as to avoid presenting a catch to a fielder.", "Sometimes the batsman will need to jump into the air to gain the necessary height to defend with the bat." ], [ "One Day International", "One Day International\n\nA One Day International (ODI) is a form of limited overs cricket, played between two teams with international status, in which each team faces a fixed number of overs, usually 50.", "The Cricket World Cup is played in this format, which is generally held every four years.", "One Day International matches are also called Limited Overs Internationals (LOI), although this generic term may also refer to Twenty20 International matches.", "They are major matches and considered the highest standard of List A, limited overs competition.", "The international one-day game is a late-twentieth-century development.", "The first ODI was played on 5 January 1971 between Australia and England at the Melbourne Cricket Ground.", "When the first three days of the third Test were washed out officials decided to abandon the match and, instead, play a one-off one-day game consisting of 40 eight-ball overs per side.", "Australia won the game by 5 wickets.", "ODIs were played in white kits with a red ball.", "In the late 1970s, Kerry Packer established the rival World Series Cricket competition, and it introduced many of the features of One Day International cricket that are now commonplace, including coloured uniforms, matches played at night under floodlights with a white ball and dark sight screens, and, for television broadcasts, multiple camera angles, effects microphones to capture sounds from the players on the pitch, and on-screen graphics." ] ], "gold": "In the sport of cricket, a bouncer (or bumper) is a type of short-pitched delivery, usually bowled by a fast bowler, which bounces once and then reaches the batsman at head-height. Between 2001 and 2011, only one bouncer was allowed per over in One Day International (ODI) cricket. Since 2012, two bouncers are allowed per over in ODI cricket.", "prediction 1": "In the sport of cricket, a bouncer is a type of delivery, usually bowled by a fast bowler. Bouncers are used to drive the batsman back on to his back foot if he has been freely playing front foot scoring shots, such as drives. To this end, bouncers are usually directed more or less at the line of the batsman's body. A batsman may play a bouncer in either a defensive or an attacking way. If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball.", "prediction 2": "In the sport of cricket, a bouncer (or bumper) is a type of delivery, usually bowled by a fast bowler. Bouncers are used to drive the batsman back on to his back foot if he has been freely playing front foot scoring shots, such as drives. A batsman may play a bouncer in either a defensive or an attacking way. If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball.", "prediction 3": "In the sport of cricket, a bouncer is a type of delivery, usually bowled by a fast bowler, used to drive the batsman back on to his back foot if he has been freely playing front foot scoring shots, such as drives. To this end, bouncers are usually directed more or less at the line of the batsman's body. A batsman may play a bouncer in either a defensive or an attacking way. If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball. Aiming at the batsman is illegal, known as a beamer, is illegal. Aiming at the batsman's head without bouncing on the pitch, known as a beamer, is illegal.", "prediction 4": "In the sport of cricket, a bouncer is a type of delivery, usually bowled by a fast bowler, that is used to drive the batsman back on to his back foot if he has been freely playing front foot scoring shots, such as drives. Bouncers are also known as bumpers, and are used to drive the batsman back onto his back foot if he has been freely playing front foot scoring shots, such as drives. A batsman may play a bouncer in either a defensive or an attacking way. If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball. If the batsman plays it defensively he aims primarily to avoid getting out, and secondarily to avoid being hit by the ball.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 513 } ], "missing-info": [], "corrected-prediction": "In the sport of cricket, a bouncer is a type of delivery, usually bowled by a fast bowler. Bouncers are usually directed more or less at the line of the batsman's body. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "What is the flavor in earl grey tea?", "passages": [ [ "Earl Grey tea", "Earl Grey tea\n\nEarl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot.", "Bergamot is a variety of orange that is often grown in Italy and France.", "The rind's fragrant oil is added to black tea to give Earl Grey its unique taste.", "Traditionally, Earl Grey was made from black teas, but tea companies have since begun to offer Earl Grey in other varieties as well, such as green or oolong.", "Tea flavoured with bergamot, which was used to imitate the more expensive types of Chinese tea, has been known in England since at least the 1820s.", "In 1837 there is a record of court proceedings against Brocksop & Co. who were found to have supplied tea \"artificially scented, and, drugged with bergamot in this country.\"", "A \"Grey's Tea\" is known from the 1850s, but the first known published references to an \"Earl Grey\" tea are advertisements by Charlton & Co. of Jermyn Street in London in the 1880s.", "The Earl Grey blend, or \"Earl Grey's Mixture\", is assumed to be named after Charles Grey, 2nd Earl Grey, British Prime Minister in the 1830s and author of the Reform Bill of 1832.", "He reputedly received a gift, probably a diplomatic perquisite, of tea flavoured with bergamot oil." ], [ "Bergamot essential oil", "Bergamot essential oil\n\nBergamot essential oil is a cold-pressed essential oil produced by cells inside the rind of a bergamot orange fruit.", "It is a common flavoring and top note in perfumes.", "The scent of bergamot essential oil is similar to a sweet light orange peel oil with a floral note.", "The \"sfumatura\" or slow-folding process was the traditional technique for manually extracting the bergamot oil.", "By more modern methods, the oil is extracted mechanically with machines called \"peelers\", which \"scrape\" the outside of the fruit under running water to get an emulsion channeled into centrifuges for separating the essence from the water.", "The rinds of 100 bergamot oranges yield about of bergamot oil.", "Bergamot essential oil has been used in cosmetics, aromatherapy, and as a flavoring in food and beverages.", "Historically, bergamot essential oil was an important ingredient in Eau de Cologne, a perfume originally concocted by Johann Maria Farina at the beginning of the 18th century.", "The first record of bergamot oil used as a fragrance in perfume is from 1714, found in the Farina Archive in Cologne." ], [ "Earl Grey tea", "A 2010 survey found that a significant minority of people in the United Kingdom associate drinking Earl Grey tea with being \"posh\" or upper class.", "\"Earl Grey\" as applied to tea is not a registered trademark, and numerous tea companies produce their own versions of Earl Grey tea, using a wide variety of tea leaves and additives.", "Bergamot orange (\"Citrus bergamia\") is a small citrus tree which blossoms during the winter and is grown commercially in Calabria, Italy.", "It is probably a hybrid of \"Citrus limetta\" (sweet lime) and \"Citrus aurantium\" (bitter orange).", "Twinings reformulated their Earl Grey tea in April 2011, claiming to have added \"an extra hint of bergamot and citrus\".", "The overwhelmingly negative comments on the Web site were picked up by the press, who drew attention to the establishment of a related protest group on Facebook.", "Earl Grey tea is used as a flavouring for many types of cakes and confectionery, such as chocolates, as well as savoury sauces.", "For sauces, the flavour is normally created by adding tea bags to the basic stock, boiling for a few minutes and then discarding the bags.", "For sweet recipes, loose tea is often added to melted butter or hot cream and strained after the flavour is infused." ] ], "gold": "The flavor of Earl Grey tea tastes like citrus and comes from oil of bergamot. Bergamot essential oil is an essential oil produced inside a bergamot orange fruit's rind. The oil is added to black tea to give Earl Grey its unique taste.", "prediction 1": "Earl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot. Bergamot is a variety of orange that is often grown in Italy and France. The rind's fragrant oil is added to black tea to give Earl Grey its unique taste. Tea flavoured with bergamot, which was used to imitate the more expensive types of Chinese tea, has been known in England since at least the 1820s.", "prediction 2": "Earl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot. Bergamot is a variety of orange that is often grown in Italy and France. The rind's fragrant oil is added to black tea to give Earl Grey its unique taste.", "prediction 3": "Earl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot. Bergamot is a variety of orange that is often grown in Italy and France. The rind's fragrant oil is added to black tea to give Earl Grey its unique taste. Earl Grey is a combination of black tea and green tea. The flavor of bergamot is usually added to the brewed tea, followed by a short steep in hot water.", "prediction 4": "Earl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot. Bergamot is a variety of orange that is often grown in Italy and France. The rind's fragrant oil is added to black tea to give Earl Grey its unique taste. The Earl Grey blend, or Earl Grey's Mixture, is assumed to be named after Charles Grey, 2nd Earl Grey, British Prime Minister in the 1830s and author of the Reform Bill of 1832.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 394 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 164 } ], "missing-info": [], "corrected-prediction": "Earl Grey tea is a tea blend which has been flavoured with the addition of oil of bergamot. Bergamot is a variety of orange. The rind's fragrant oil is added to black tea to give Earl Grey its unique taste." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who were the two superpowers during the cold war space race?", "passages": [ [ "Militarisation of space", "As the Cold War ended with the implosion of the Soviet Union the space race between the two superpowers ended.", "The United States of America was left as the only superpower on Earth with a large concentration of the world's wealth and technological advancement.", "Despite the United States' new status in the world, the monopoly of space militarisation is in no way certain.", "Countries such as China, Japan, and India have begun their own space programmes, while the European Union collectively works to create satellite systems to rival those of the United States.", "The USSR Space Forces were established as the Ministry of Defense Space Units in 1982.", "In 1991 the Soviet Union disintegrated.", "The Russian Armed Forces were established on 7 May 1992, enabling the creation of Russian Space Forces later that year on 10 August.", "In July 1997 the Space Force was dissolved as a separate service arm and incorporated to the Strategic Rocket Forces along with the Space Missile Defense Forces, which previously were part of the Troops of Air Defense.", "The Russian Space Forces were officially reborn on June 1, 2001 as an independent section of the Russian military.", "Post Cold War space militarisation seems to revolve around three types of applications." ], [ "Militarisation of space", "The first A4 flew in March 1942, flying about 1.6\u00a0km and crashing into the water.", "The second launch reached an altitude of 11\u00a0km before exploding.", "The third rocket, launched on October 3, 1942, changed things by following its trajectory perfectly.", "It landed 193\u00a0km away, and became the first man-made object to enter space.", "Production started in 1943 on the wonder weapon \"Vergeltungswaffe 2\" (reprisal weapon 2), or the V-2 as it became better known, at the insistence of Goebbels' propaganda ministry.", "During the Cold War, the world's two great superpowers \u2014 the Soviet Union and the United States of America \u2014 spent large proportions of their GDP on developing military technologies.", "The drive to place objects in orbit stimulated space research and started the Space Race.", "In 1957, the USSR launched the first artificial satellite, \"Sputnik 1\".", "By the end of the 1960s, both countries regularly deployed satellites.", "Reconnaissance satellites were used by militaries to take accurate pictures of their rivals' military installations.", "As time passed the resolution and accuracy of orbital reconnaissance alarmed both sides of the iron curtain.", "Both the United States and the Soviet Union began to develop anti-satellite weapons to blind or destroy each other's satellites." ], [ "Militarisation of space", "Militarisation of space\n\nThe militarisation of space is the placement and development of weaponry and military technology in outer space.", "The early exploration of space in the mid-20th century had, in part, a military motivation, as the United States and the Soviet Union used it as an opportunity to demonstrate ballistic missile technology and other technologies having the potential for military application.", "Outer space has since been used as an operating location for military spacecraft such as imaging and communications satellites, and some ballistic missiles pass through outer space during their flight.", "As yet, however, weapons are not known to have been stationed in space, with the exception of the Almaz space station and the TP-82 Cosmonaut survival pistol (for post-landing, pre-recovery use).", "As early as 1927, members of the \"Verein f\u00fcr Raumschiffahrt (VfR)\" (\"Spaceflight Society\") had started experimenting with liquid-fuel rockets.", "Rockets using a solid propellant had been used as weapons by all sides in World War I, and as a result, the Treaty of Versailles forbade solid fuel rocket research in Germany.", "By 1932 the Reichswehr started taking notice of their developments for potential long-range artillery use, and a team led by General Walter Dornberger was shown a test vehicle designed and flown by Wernher von Braun." ] ], "gold": "During the cold war, the world's two great superpowers, the Eurasian Soviet Union and the North American United States, spent large proportions of their wealth on developing military technologies. A rush to place that weaponry and military technology into outer space became known as the Space Race. The Soviet Union launched the first artificial satellite into space in 1957.", "prediction 1": "The space race between the two superpowers was initiated by the drive to place objects in orbit, which stimulated space research and started the Cold War. The United States and the Soviet Union spent large proportions of their GDP on developing military technologies. During the Cold War, the world's two great superpowers \u2014 the Soviet Union and the United States of America \u2014 spent large proportions of their GDP on developing military technologies. The drive to place objects in orbit stimulated space research and started the Cold War. By the end of the 1960s, both countries regularly deployed satellites.", "prediction 2": "The Cold War space race was a race between the world's two great superpowers, the USSR and the Soviet Union. The USSR launched the first artificial satellite in March 1942, Sputnik 1 in 1957 and the Soviet Union launched the first chemical weapon in October 1942, V-2. The space race was a race between the USSR and the USSR for the first artificial satellite in space. The USSR Space Forces were established as the Ministry of Defense Space Units in 1982.", "prediction 3": "The Cold War space race was a two-way competition between the world's two great superpowers, the United States and the Soviet Union. The two superpowers spent large proportions of their GDP on developing military technologies. The drive to place objects in orbit stimulated space research and started the Space Race. The USSR launched the first artificial satellite, Sputnik 1 in 1957, and the USSR launched the first artificial satellite in October 1942. The two superpowers finished the race in 1962, and in 1970, the United States was left as the only superpower on Earth with a large concentration of the world's wealth and technological advancement.", "prediction 4": "There was a Cold War Space Race between the United States and the Soviet Union. In this race, the two superpowers spent large proportions of their GDP on developing military technologies. The drive to place objects in orbit stimulated space research and started the Space Race. The USSR launched the first artificial satellite, Sputnik 1. By the end of the 1960s, both countries regularly deployed satellites.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 145, "end": 154 }, { "error type": "Redundant", "explanation": "The United States and the Soviet Union spent large proportions of their GDP on developing military technologies. ", "start": 325, "end": 450 }, { "error type": "Redundant", "explanation": "The space race between the two superpowers was initiated by the drive to place objects in orbit, which stimulated space research and started the Cold War. ", "start": 451, "end": 538 }, { "error type": "Irrelevant", "explanation": "", "start": 539, "end": 609 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The space race between the two superpowers was initiated by the drive to place objects in orbit, which stimulated space research. During the Cold War, the world's two great superpowers, the United States and the Soviet Union spent large proportions of their GDP on developing military technologies. In 1957, the USSR launched the first artificial satellite, \"Sputnik 1\"." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How many seasons are there of america's got talent?", "passages": [ [ "Got Talent", "In 2016, the judging panel consisted of Howie Mandel, Heidi Klum, Melanie Brown, and Simon Cowell, and hosted by Nick Cannon, who was the presenter from 2009-2016.", "From season 12 (2017), the new host of AGT is Tyra Banks.", "The grand prize for the winner(s) is US$1 million, and, since season 3, a chance to headline a show on the Las Vegas Strip.", "\"America's Got Talent\" proved extremely successful for NBC, pulling in high ratings in both total viewers and the younger 18-49 demographic.", "The show's initial success in America is credited with the eventual launch of the British series, and the overall global launch of the \"Got Talent\" franchise.", "ITV eventually debuted \"Britain's Got Talent\" on 9 June 2007 with Cowell, Morgan and Amanda Holden as judges, and Ant & Dec as hosts of the show.", "For series 5, Morgan stepped down due to commitments hosting \"Piers Morgan Tonight\" on CNN, and Cowell only attended the live shows as he was busy launching \"The X Factor USA\", so Michael McIntyre and David Hasselhoff joined the panel with Holden." ], [ "America's Got Talent: The Champions", "America's Got Talent: The Champions\n\nAmerica's Got Talent:", "The Champions is an upcoming reality television series spin-off set to air on NBC.", "The show will air in between seasons of \"The Voice\", during the 2018\u201319 television season and premiere on January 7, 2019.", "It will feature notable contestants from season 13 and previous seasons of \"America's Got Talent\" alongside acts from \"Got Talent\" franchises worldwide.", "The series is expected to contain seven episodes.", "Simon Cowell has been confirmed as a judge.", "On July 27, 2018, it was confirmed that Mel B would be a judge on the spin-off show.", "On September 27, 2018, it was announced that Terry Crews would host the show and that Heidi Klum and Howie Mandel would be joining as judges, bringing all four current judges from the main series.", "\"Note: All contestants below have previously competed in America's Got Talent unless otherwise noted\"." ], [ "America's Got Talent (season 10)", "America's Got Talent (season 10)\n\nSeason Ten of the reality competition television series \"America's Got Talent\" was the 10th annual installment of the series and premiered on May 26, 2015.", "It concluded on September 16, 2015.", "Nick Cannon returned as host for his seventh season.", "Howie Mandel returned for his sixth season as a judge, and Howard Stern returned for his fourth and final season.", "Mel B and Heidi Klum both returned for their third seasons on the judging panel.", "On July 29, the show aired a special two-hour tenth anniversary retrospective episode.", "The series returned to Radio City Music Hall in New York for the live shows, which began, 2015.", "Dunkin' Donuts replaced Snapple as sponsor of the show after three seasons.", "Four guest judges were invited to judge during the judge's cuts round: actor Neil Patrick Harris, singer Michael Bubl\u00e9, actor Marlon Wayans and former judge Piers Morgan.", "This was the first season to have an all-male finale and the first where at least four magicians competed in the finals.", "Ventriloquist Paul Zerdin was voted the winner for the season on September 16, 2015.", "Comedian Drew Lynch was the runner-up, and magician Oz Pearlman came in at third place." ] ], "gold": "America's Got Talent is a televised American talent show competition. Since July 2021, the program has run for a total of sixteen seasons, and has spawned two spin-off competitions: America's Got Talent: The Champions, which premiered in January 2019; and upcoming series AGT: Extreme which will premiere in midseason of summer 2021. Season 10 aired in 2015, season 11 aired in 2016, and season 12 aired in 2017.", "prediction 1": "America's Got Talent is an American reality competition television series with 13 seasons. The show originally aired in 2005. It began in 2006 and ended in 2017. The show has been rerun on a number of platforms with an estimated number of 30 episodes per season. The show has also been rerun on satellite television with 24 episodes per season.", "prediction 2": "America's Got Talent is a reality competition television series that premiered on May 26, 2015 and concluded on September 16, 2015. There were 10 seasons of the show. The show was hosted by Nick Cannon for seven of those seasons. Howie Mandel for six of those seasons, Howard Stern for four of them, and Mel B for three. There were also 10 episodes of the America's Got Talent: The Champions spin-off that aired on NBC between seasons of The Voice and The Voice Live.", "prediction 3": "America's Got Talent was created by Simon Cowell in 1997, and became a reality competition television series in the United States in 1998. The show has had multiple seasons. Season 10 was the 10th annual installment of the series and premiered on May 26, 2015. Season 11 was the 11th annual installment of the series and premiered on September 16, 2015.", "prediction 4": "America's Got Talent is a reality competition television series that began airing on NBC on May 26, 2015. There are currently 13 seasons of the series. Season Ten of the series, the 10th annual installment, premiered on May 26, 2015. Season 11 was the 11th annual installment, the 12th annual installment, and concluded on September 16, 2015.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 74, "end": 90 }, { "error type": "Unverifiable", "explanation": "", "start": 91, "end": 125 }, { "error type": "Unverifiable", "explanation": "", "start": 126, "end": 161 }, { "error type": "Unverifiable", "explanation": "", "start": 162, "end": 262 }, { "error type": "Unverifiable", "explanation": "", "start": 263, "end": 344 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "America's Got Talent is an American reality competition television series. Season 10 aired in 2015 and season 12 aired in 2017." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "When is season 3 of fuller house coming out?", "passages": [ [ "Fuller House (TV series)", "Fuller House (TV series)\n\n", "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series, and is a sequel to the 1987\u20131995 television series \"Full House\".", "It centers around D.J. Tanner-Fuller, a veterinarian and widowed mother of three sons, whose sister Stephanie and best friend Kimmy\u2014along with her teenage daughter\u2014live together at the Tanners' childhood home in San Francisco, California.", "Most of the original series ensemble cast have reprised their roles on \"Fuller House\", either as regular cast members or in guest appearances, with the exception of Mary-Kate and Ashley Olsen, who alternated the role of Michelle Tanner in \"Full House.\"", "Netflix ordered an initial thirteen episodes which were released on February 26, 2016, worldwide.", "The third season is split into two parts, with the first half of nine episodes being released on September 22, 2017, and the second half on December 22, 2017.", "While the first season reception was generally negative, the second and third seasons received mostly positive reviews.", "On January 29, 2018, Netflix renewed \"Fuller House\" for a fourth season, which was released on December 14, 2018.", "Like the original series, the show is set in the same house in San Francisco, California.", "Recently widowed D.J." ], [ "Fuller House (TV series)", "On March 2, 2016, the series was renewed for a second season, and production for the second season began on May 5, 2016.", "Thirteen new episodes were ordered and were released on December 9, 2016.", "On December 24, 2016, the series was renewed for a third season, to be released in 2017.", "and On December 31, 2016, it was confirmed that the season was given an 18-episode order.", "Production for the third season began on March 18, 2017, and ended on September 2, 2017.", "It was announced on June 26, 2017 that the third season would be split into two parts, with the release of the first part on September 22, 2017 to consist of nine episodes.", "It was announced on November 13, 2017 that the second half, also consisting of nine episodes, would be released on December 22, 2017.", "On January 29, 2018, the series was renewed for a fourth season of thirteen episodes.", "The fourth season was released on December 14, 2018.", "In addition to Cameron Bure, Sweetin, and Barber reprising their roles, the other main roles went to Michael Campion, Elias Harger, and Soni Bringas, as their children: Jackson and Max Fuller, and Ramona Gibbler, respectively.", "It was disclosed that John Stamos would have a recurring role as Jesse Katsopolis and would also be producing." ] ], "gold": "Fuller House is an American family sitcom and sequel to the 1987\u201395 television series Full House, airing as a Netflix original series. The first nine episodes of season 3 of Fuller House came out on September 22, 2017. The second nine episodes of season 3 came out on December 22, 2017.", "prediction 1": "On December 24, 2016, the series was renewed for a third season, to be released in 2017. The third season was split into two parts, with the first half of nine episodes being released on September 22, 2017 and the second half on December 22, 2017.", "prediction 2": "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series, and is a sequel to the 1987-1995 television series Full House. The third season is split into two parts, with the first half of nine episodes being released on September 22, 2017 and the second half being released on December 22, 2017. The production for the third season began on March 18, 2017, and ended on September 2, 2017. The fourth season was released on December 14, 2018.", "prediction 3": "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series and is a sequel to the 1987\u20131995 television series Full House. The third season of Fuller House has been split into two parts, with the first half of nine episodes being released on September 22, 2017, and the second half being released on December 22, 2017.", "prediction 4": "Season 3 of Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series and is a sequel to the 1987\u20131995 television series Full House. The original series premiered on November 7, 1987. The second season premiered on September 2, 2017, and the third season premiered on November 5, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 88 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Fuller House is an American sitcom that airs as a Netflix original series, and is a sequel to the 1987\u20131995 television series \"Full House\". The third season was split into two parts, with the first half of nine episodes being released on September 22, 2017 and the second half on December 22, 2017." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Who was the captain of the flying dutchman?", "passages": [ [ "Flying Dutchman", "The Efteling amusement park in the Netherlands has a roller coaster called The Flying Dutchman which features the captain named Willem van der Decken ().", "Worlds of Fun amusement park in Kansas City, Missouri has a swinging boat ride called The Flying Dutchman.", "Six Flags over Georgia, an amusement park located in Austell, Georgia also had a swinging boat ride called The Flying Dutchman which was added in 1980.", "The Haunted Mansion attraction in Disneyland features a painting of the \"Flying Dutchman\" before it became a ghost ship that transforms into a ship with torn sails sailing during a storm.", "In Disneyland Shanghai, the park's Pirates of the Caribbean Ride features a battle between ships under the sea; one of which is the \"Flying Dutchman\".", "The Dutch aviation pioneer and an aircraft manufacturer Anthony Fokker was nicknamed \"The Flying Dutchman\".", "KLM Royal Dutch Airlines references the endless traveling aspect of the story by having \"The Flying Dutchman\" painted on the rear sides of on all its aircraft with regular livery.", "The nickname of Lebanon Valley College is \"The Flying Dutchmen\", and its mascot \"The Flying Dutchman\".", "The nickname references the college's location in the Pennsylvania Dutch Country.", "Hofstra University in Long Island, New York was unofficially named \"The Flying Dutchman\" and has many references to Dutch culture around the university including residence halls." ], [ "Flying Dutchman", "Flying Dutchman\n\nThe Flying Dutchman () is a legendary ghost ship that can never make port and is doomed to sail the oceans forever.", "The myth is likely to have originated from the 17th-century golden age of the Dutch East India Company (VOC).", "The oldest extant version has been dated to the late 18th century.", "Sightings in the 19th and 20th centuries reported the ship to be glowing with ghostly light.", "If hailed by another ship, the crew of the \"Flying Dutchman\" will try to send messages to land, or to people long dead.", "In ocean lore, the sight of this phantom ship is a portent of doom." ], [ "Flying Dutchman (sternwheeler)", "Flying Dutchman (sternwheeler)\n\n", "The Flying Dutchman was a 19th-century steamship in British Columbia and the Pacific Northwest.", "It was the first steamboat to enter the Stikine River, in 1862, and the first vessel to take a cargo of lumber from Burrard Inlet (Vancouver harbour), in August 1863, under Captain William Moore." ] ], "gold": "There are several \"Flying Dutchman\" ships. The Flying Dutchman is a legendary ghost ship which was said to never be able to make port, doomed to sail the oceans forever. The captain of the ghost ship was Willem van der Decken. The Flying Dutchman was also a 19th-century steamship in British Columbia and the Pacific Northwest. It was the first steamboat to enter the Stikine River, in 1862, and the first vessel to take a cargo of lumber from Burrard Inlet, in August 1863, under Captain William Moore.", "prediction 1": "The Flying Dutchman is a legendry ghost ship that can never make port and is doomed to sail the oceans forever. The legend has origins in the 17th-century golden age of the Dutch East India Company. Captain William Moore was the captain of the 19th-century steamship, the Flying Dutchman. In the 20th century, the captain was named Willem van der Decken.", "prediction 2": "The Flying Dutchman is a legendary ghost ship that can never make port and is doomed to sail the oceans forever. The myth is likely to have originated from the 17th-century golden age of the Dutch East India Company (VOC). The first steamboat to enter the Stikine River, in 1862, and the first vessel to take a cargo of lumber from Burrard Inlet (Vancouver harbour), in August 1863, under Captain William Moore. Worlds of Fun amusement park in Kansas City, Missouri also has a swinging boat ride called The Flying Dutchman. Six Flags over Georgia also had a swinging boat ride called The Flying Dutchman which was added in 1980.", "prediction 3": "The Flying Dutchman is a legend that a ghost ship that can never make port and is doomed to sail the oceans forever. Several amusement parks have rides called The Flying Dutchman, including the Efteling amusement park in the Netherlands, and Worlds of Fun amusement park in Kansas City, Missouri, which had a swinging boat ride called The Flying Dutchman. The Flying Dutchman was also a 19th-century steamship in British Columbia and the Pacific Northwest, where it was first steamboat to enter the Stikine River, and the first vessel to take a cargo of lumber from Vancouver Harbour, in August 1863, under Captain William Moore.", "prediction 4": "The Flying Dutchman is a legend that the Dutch East India Company once owned a ship called the Flying Dutchman, which is a legendary ghost ship that can never make port and is doomed to sail the oceans forever. The Flying Dutchman was a 19th-century steamship in British Columbia and the Pacific Northwest. It was the first steamboat to enter the Stikine River, in 1862, and the first vessel to take a cargo of lumber from Burrard Inlet (Vancouver harbour), in August 1863, under Captain William Moore.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 239 } ], "missing-info": [], "corrected-prediction": "The Flying Dutchman is a legendry ghost ship that can never make port and is doomed to sail the oceans forever. The legend has origins in the 19th-century steamship, the Flying Dutchman. In the 20th century, the captain was named Willem van der Decken." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "When was if i were a boy released?", "passages": [ [ "If I Were a Boy", "If I Were a Boy\n\n\"If I Were a Boy\" is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album \"I Am...", "Sasha Fierce\" (2008).", "\"If I Were a Boy\" was written by BC Jean and Toby Gad, who also handled its production alongside Beyonc\u00e9.", "Inspired by the difficult break-up of a romantic relationship, the song was initially recorded by Jean, whose record company rejected it.", "Beyonc\u00e9 then recorded her own version.", "Jean was upset when she learned that Beyonc\u00e9 was releasing it as a single, but eventually, they reached an agreement.", "Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008, as a double A-side single album's alongside \"Single Ladies (Put a Ring on It)\" as the lead singles.", "The two songs showcased the contrast between Beyonc\u00e9's personality and her aggressive onstage persona, Sasha Fierce.", "A Spanish version of the song, titled \"Si Yo Fuera un Chico\", was digitally released in Mexico and Spain.", "\"If I Were a Boy\" is a pop and R&B introspective ballad which draws influences from folk rock through its instrumentation of which includes acoustic guitars, drums and strings.", "The song's lyrics lament the misunderstandings between the genders and indict the male side of relationships." ], [ "If I Were a Boy", "\"If I Were a Boy\" and \"Single Ladies (Put a Ring on It)\" were released simultaneously as the double album's two lead singles.", "The songs were taken from different discs of the album to demonstrate Beyonc\u00e9's conflicting personalities, the album's central theme.", "This motif was demonstrated by placing the ballads on a separate disc from the uptempo tracks.", "\"If I Were a Boy\" and \"Single Ladies\" were initially planned to debut on US radio stations on October 7, 2008, but both premiered the following day.", "\"If I Were a Boy\" debuted on Z100's \"Elvis Duran and the Morning Show\", while \"Single Ladies\" first aired on New York mainstream urban radio station Power 105.1.", "Both singles were added to rhythmic contemporary radio on October 13, 2008.", "That same day, \"If I Were a Boy\" was sent to contemporary hit radio, and \"Single Ladies\" was sent to urban contemporary radio.", "On November 24, 2008, \"If I Were a Boy\" was sent to US urban radio.", "Two digital EPs, each containing seven dance remixes of \"If I Were a Boy\" were released on February 10, 2009, in the US.", "The ballad was first released internationally as a stand-alone digital download in Oceania and most European countries on October 17, 2008." ], [ "If I Were a Boy", "In France and the United Kingdom, \"If I Were a Boy\" was serviced digitally on October 26, 2008.", "On November 7, 2008, a two-track CD single, including \"Single Ladies (Put a Ring on It)\" as the B-side, went on sale in all European countries, Oceania, and in Canada.", "In Canada two different digital EPs were made available on February 3 and 10, 2009.", "A Spanish version of \"If I Were a Boy\" was translated by Rudy P\u00e9rez and mixed by Andr\u00e9s Berm\u00fadez at The Beach House in Miami.", "Titled \"Si Yo Fuera un Chico (If I Were a Boy)\", this version was only included on copies of \"I Am...", "Sasha Fierce\" in Mexico as well as iTunes Stores in Latin America and Spain, where it was released as a stand-alone single on February 3, 2009.", "\"If I Were a Boy\" was widely acclaimed by contemporary music critics, who applauded Beyonc\u00e9's vocal performance and called the song her best yet.", "\"Billboard\" magazine's critic Chuck Taylor wrote that \"If I Were a Boy\" is Beyonc\u00e9's \"most affecting offering\" since \"Listen\" (2006)." ] ], "gold": "If I Were a Boy is a song performed by American singer Beyonc\u00e9, from her third studio album I Am... Sasha Fierce (2008). Columbia Records released If I Were a Boy to US radio on October 8, 2008. It was released on an album on October 13, 2008. The ballad was first released internationally as a stand-alone digital download in Oceania and most European countries on October 17, 2008. In France and the United Kingdom, If I Were a Boy was serviced digitally on October 26, 2008. The song's lyrics lament the misunderstandings between the genders and indict the male side of relationships. If I Were a Boy was well received by critics, who complimented Beyonc\u00e9's tormented and emotive vocal performance and called the song her best work to date.", "prediction 1": "If I Were a Boy is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album, I Am... Sasha Fierce. The song was originally recorded by BC Jean and Toby Gad, who also handled its production alongside Beyonc\u00e9. Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008, as a double A-side single album's alongside \"Single Ladies (Put a Ring on It)\" as the album's two lead singles. Two digital EPs, each containing seven dance remixes of \"If I Were a Boy\" were released on February 3, 2009, in the US.", "prediction 2": "\"If I Were a Boy\" is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album, I Am... Sasha Fierce. Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008, as a double A-side single album's alongside \"Single Ladies (Put a Ring on It)\" as the lead singles. Two digital EPs, each containing seven dance remixes of \"If I Werelonc\u00e9, were released on February 3, 2009, in the US. Two digital EPs, each containing seven dance remixes of \"If I Were a Boy\" were released on February 10, 2009, in Latin America and Spain, where it was released as a stand-alone single on February 3, 2009.", "prediction 3": "\"If I Were a Boy\" is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album I Am... Sasha Fierce. Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008, as a double A-side single album's alongside \"Single Ladies (Put a Ring on It)\" as the lead singles. Two digital EPs, each containing seven dance remixes of \"If I Were\" were released on February 10, 2009.", "prediction 4": "\"If I Were a Boy\" is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album, I Am... Sasha Fierce. Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008, as a double A-side single album's alongside \"Single Ladies (Put a Ring on It)\" as the lead singles. A Spanish version of the song, titled \"Si Yo Fuera un Chico\", was digitally released in Mexico and Spain, where it was released as a stand-alone single on February 3, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 545 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "If I Were a Boy is a song performed by American singer and songwriter Beyonc\u00e9 from her third studio album, I Am... Sasha Fierce. Columbia Records released \"If I Were a Boy\" to US radio on October 8, 2008. The ballad was first released internationally as a stand-alone digital download in Oceania and most European countries on October 17, 2008. In France and the United Kingdom, \"If I Were a Boy\" was serviced digitally on October 26, 2008. The song's lyrics lament the misunderstandings between the genders and indict the male side of relationships. \"If I Were a Boy\" was widely acclaimed by contemporary music critics, who applauded Beyonc\u00e9's vocal performance and called the song her best yet. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Member of the cat family is largest in term of length and weight?", "passages": [ [ "Felidae", "Some are adapted to desert environments, some to wetlands, some to high altitude mountainous terrain.", "Those cat species living in forests are generally agile climbers.", "All cat species are obligate carnivores and require meat.", "Apart from the lion, wild cats are generally solitary and secretive.", "Feral domestic cats form colonies.", "Cheetah males are known to live and hunt in groups.", "Activity pattern of cat species ranges from nocturnal to crepuscular and diurnal, depending on their preferred prey species.", "All members of the cat family have the following characteristics in common:\n\nThe colour, length and density of their fur are highly variable.", "Fur colour varies from brown to golden, and fur pattern from distinctive small spots, stripes, to small blotches and rosettes.", "Those living in cold environments have thick fur with long hair, like the snow leopard and the Pallas's cat.", "Those living in tropical and hot climate zones have short fur.", "The only cat species lacking significant markings are the lion, cougar, caracal, jungle cat and jaguarundi.", "Several species exhibit melanism with all-black individuals.", "In the great majority of species, the tail is between a third and a half of the body length, although with some exceptions, like the \"Lynx\" species and margay." ], [ "Liger", "It has a somewhat lion-like head, and the tail is more like that of a lion than of a tiger.", "On the other hand, it has no trace of mane.", "It is a huge and very powerful beast.", "In 1935, four ligers from two litters were reared in the Zoological Gardens of Bloemfontein, South Africa.", "Three of them, a male and two females, were still living in 1953.", "The male weighed and stood a foot and a half (45\u00a0cm) taller than a full grown male lion at the shoulder.", "Although ligers are more commonly found than tigons today, in \"At Home In The Zoo\" (1961), Gerald Iles wrote \"For the record I must say that I have never seen a liger, a hybrid obtained by crossing a lion with a tigress.", "They seem to be even rarer than tigons.\"", "The liger is often believed to represent the largest known cat in the world.", "Males reach a total length of , which means that they rival even large male lions and tigers in length.", "Imprinted genes may be a factor contributing to the large size of ligers.", "These are genes that may or may not be expressed on the parent they are inherited from, and that occasionally play a role in issues of hybrid growth." ], [ "Feliformia", "The range in size is as diverse as the range in form, with smaller species at less than 500 g (1\u00a0lb) and the largest species at up to 12\u00a0kg (26\u00a0lb).", "Some have retractile or semi-retractile claws (the fossa and the Malagasy civet) and others do not (the falanouc and Malagasy mongooses).", "They all tend to have slender bodies and pointed rostra (except the fossa, which has a blunt snout).", "Diet varies with size and form of the species and, like their mainland counterparts, ranges from small mammals, insects and invertebrates through to crustaceans and molluscs.", "Family Felidae (cats) are the best-known of \"cat-like\" carnivorans.", "There are 41 extant species, and all but a few have retractile claws.", "This family is represented on all continents except Australia (where domestic cats have been introduced) and the Antarctic.", "The species vary in size from the tiny black-footed cat (\"Felis nigripes\") at only 2\u00a0kg (4.5\u00a0lb) to the tiger (\"Panthera tigris\") at 300\u00a0kg (660\u00a0lb).", "Diet ranges from large to small mammals, birds and insects (depending on species size.)" ] ], "gold": "Wild cats occur in Africa, Europe, Asia and the Americas. Some wild cat species are adapted to forest habitats, some to arid environments, and a few also to wetlands and mountainous terrain. The largest cat in Asia is the tiger, the largest cat in Africa is the lion, and the largest cat in Europe is the Eurasian lynx.", "prediction 1": "The family Felidae is the best-known of \"cat-like\" carnivorans. There are 41 extant species, and all but a few have retractile claws. In 1935, four ligers from two litters were reared in the Zoological Gardens of Bloemfontein, South Africa. Three of them, a male and two females, were still living in 1953. The male weighed and stood a foot and a half (45 cm) taller than a full grown male lion at the shoulder. The females were still living in 1959. The male liger is often believed to represent the largest known cat in the world.", "prediction 2": "In terms of length and weight, the largest member of the cat family is the tiger. In 1935, four ligers from two litters were reared in the Zoological Gardens of Bloemfontein, South Africa. The male weighed and stood a foot and a half (45 cm) taller than a full grown male lion at the shoulder. The tiger's tail is usually between a third and a half of the body length, but in some species it can exceed a foot and a half of the body length.", "prediction 3": "In terms of length and weight, the largest member of the cat family is the liger, also known as a \"lion cat\". In 1935, four ligers from two litters were reared in the Zoological Gardens of Bloemfontein, South Africa. Three of them, a male and two females, were still living in 1953. The male weighed and stood a foot and a half (45 cm) taller than a full grown male lion at the shoulder. The liger is often believed to represent the largest known cat in the world.", "prediction 4": "In terms of length and weight, the largest member of the cat family is the tiger, which is about 300 g in length and 660 lb in weight. The Liger is the largest tiger by length and weight, with a total length of over 6.5 feet, and a total weight of over 22 kilos. The largest liger is an African cat that can grow to a length of up to 6.5 feet and a total weight of 27 kilos.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 63 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 240 }, { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 411 }, { "error type": "Irrelevant", "explanation": "", "start": 412, "end": 450 }, { "error type": "Unverifiable", "explanation": "", "start": 455, "end": 459 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Some wild cat species are adapted to desert environments, some to wetlands, some to high altitude mountainous terrain. The liger is often believed to represent the largest known cat in the world." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When was the first personal computer sold to the public?", "passages": [ [ "History of personal computers", "A personal computer is one intended for interactive individual use, as opposed to a mainframe computer where the end user's requests are filtered through operating staff, or a time sharing system in which one large processor is shared by many individuals.", "After the development of the microprocessor, individual personal computers were low enough in cost that they eventually became affordable consumer goods.", "Early personal computers \u2013 generally called microcomputers\u2013 were sold often in electronic kit form and in limited numbers, and were of interest mostly to hobbyists and technicians.", "Computer terminals were used for time sharing access to central computers.", "Before the introduction of the microprocessor in the early 1970s, computers were generally large, costly systems owned by large corporations, universities, government agencies, and similar-sized institutions.", "End users generally did not directly interact with the machine, but instead would prepare tasks for the computer on off-line equipment, such as card punches.", "A number of assignments for the computer would be gathered up and processed in batch mode.", "After the job had completed, users could collect the results.", "In some cases, it could take hours or days between submitting a job to the computing center and receiving the output.", "A more interactive form of computer use developed commercially by the middle 1960s.", "In a time-sharing system, multiple computer terminals let many people share the use of one mainframe computer processor." ], [ "Personal computer", "Personal computer\n\nA personal computer (PC) is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use.", "PCs are intended to be operated directly by an end user, rather than by a computer expert or technician.", "Computer time-sharing models that were typically used with larger, more expensive minicomputer and mainframe systems, to enable them be used by many people at the same time, are not used with PCs.", "Early computer owners in the 1960s, invariably institutional or corporate, had to write their own programs to do any useful work with the machines.", "In the 2010s, personal computer users have access to a wide range of commercial software, free-of-charge software (\"freeware\") and free and open-source software, which are provided in ready-to-run form.", "Software for personal computers is typically developed and distributed independently from the hardware or OS manufacturers.", "Many personal computer users no longer need to write their own programs to make any use of a personal computer, although end-user programming is still feasible.", "This contrasts with mobile systems, where software is often only available through a manufacturer-supported channel, and end-user program development may be discouraged by lack of support by the manufacturer.", "Since the early 1990s, Microsoft operating systems and Intel hardware have dominated much of the personal computer market, first with MS-DOS and then with Windows." ], [ "History of personal computers", "The very first Microsoft product was a 4 kilobyte paper tape BASIC interpreter, which allowed users to develop programs in a higher-level language.", "The alternative was to hand-assemble machine code that could be directly loaded into the microcomputer's memory using a front panel of toggle switches, pushbuttons and LED displays.", "While the hardware front panel emulated those used by early mainframe and minicomputers, after a very short time I/O through a terminal was the preferred human/machine interface, and front panels became extinct.", "Simon was a project developed by Edmund Berkeley and presented in a thirteen articles series issued in \"Radio-Electronics\" magazine, from October 1950.", "Although there were far more advanced machines at the time of its construction, the Simon represented the first experience of building an automatic simple digital computer, for educational purposes.", "In fact, its ALU had only 2 bits, and the total memory was 12 bits (2bits x6).", "In 1950, it was sold for US$600.", "The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957.", "Although it was faulted for its speed, the IBM 610 handled floating-point arithmetic naturally." ] ], "gold": "A personal computer (PC) is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957. With a price tag of $55,000, only 180 units were produced. As a mass-market device, three machines, the Apple II, PET 2001 and TRS-80 were all released in 1977, becoming the most popular by late 1978.", "prediction 1": "The first personal computer sold to the public was the Simon in October 1950. The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957. Before the introduction of the microprocessor in the early 1970s, computers were generally large, costly systems owned by large corporations, universities, government agencies, and similar-sized institutions. A more interactive form of computer use developed commercially by the middle 1960s. In a time-sharing system, multiple computer terminals let many people share the use of one large processor.", "prediction 2": "A personal computer is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. The first personal computer sold to the public was the Simon, a project developed by Edmund Berkeley and presented in a thirteen articles series issued in Radio-Electronics magazine, from October 1950. The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957. The Atari 286 is the first personal computer that was sold to the public in March 1970. The first Atario-based personal computer was the IBM 610 Auto-Point, a 64-bit 256-bit-bit automatic digital computer. The A personal computer that was the Simon was sold to the public on February 1967.", "prediction 3": "A personal computer is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. The first personal computer sold to the public was the Simon microcomputer, developed by Edmund Berkeley and presented in a thirteen articles series issued in Radio-Electronics magazine, from October 1950. The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC). In 1959, the first personal computer sold to the public was the IBM 610 Auto-Point, which was sold for US$600. The first personal computer sold to the public was the IBM 610, which was designed between 1948 and 1957 by John Lentz at the Watson Lab at the Watson Lab at the Watson Lab at the Watson Lab at the Watson Lab at the Watson Lab at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957", "prediction 4": "A personal computer is one intended for interactive individual use, rather than a mainframe computer where the end user's requests are filtered through operating staff, or a time sharing system in which one large processor is shared by many individuals. In the 1960s, the first personal computer sold to the public was the Simon, which was a project developed by Edmund Berkeley and presented in a thirteen articles series issued in Radio-Electronics magazine, from October 1950. In the 1990s, Microsoft operating systems and Intel hardware have dominated much of the personal computer market, first with MS-DOS and then with Windows. The IBM 610 Auto-Point was designed between 1948 and 1957 by John Lentz at the Watson Lab at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 481 }, { "error type": "Irrelevant", "explanation": "", "start": 482, "end": 565 }, { "error type": "Irrelevant", "explanation": "", "start": 566, "end": 673 } ], "missing-info": [], "corrected-prediction": "The first personal computer sold to the public was the Simon in October 1950. The IBM 610 was designed between 1948 and 1957 by John Lentz at the Watson Lab at Columbia University as the Personal Automatic Computer (PAC) and announced by IBM as the 610 Auto-Point in 1957. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who owns the property in a life estate?", "passages": [ [ "Marital life estate", "Marital life estate\n\n", "A marital life estate is, in the common law tradition of the United States and Great Britain, a life estate held by the spouse (husband or wife) or widowed spouse, for the duration of that spouse's life.", "The marital life estate may be created by operation of law, agreement, contract, will, deed, or court order, such as a divorce decree or judgment." ], [ "Life estate", "Life estate\n\nIn common law and statutory law, a life estate is the ownership of land for the duration of a person's life.", "In legal terms, it is an estate in real property that ends at death when ownership of the property may revert to the original owner, or it may pass to another person.", "The owner of a life estate is called a \"life tenant\".", "In the combined jurisdiction of England and Wales since 1925 a freehold estate intended to be 'held' as a life interest takes effect only as an interest enjoyed in equity, specifically as an interest in possession trust.", "The other type of land ownership is leasehold and although most long leases are for a period of between 99 and 999 years 'leases for life' will be interpreted in often unpredictable ways as either as a licence or a lease.", "The ownership of a life estate is of limited duration because it ends at the death of a person.", "Its owner is the life tenant (typically also the 'measuring life') and it carries with it right to enjoy certain benefits of ownership of the property, chiefly income derived from rent or other uses of the property and the right of occupation, during his or her possession." ] ], "gold": "The owner of a regular life estate, referred to as a \"life tenant\", owns a property for the duration of their life. A marital life estate, on the other hand, is held by a living or widowed spouse for the duration of that spouse's life.", "prediction 1": "In common law and statutory law, a life estate is the ownership of land for the duration of a person's life. In legal terms, it is an estate in real property that ends at death when ownership of the property may revert to the original owner, or it may pass to another person. The owner of a life estate is called a \"life tenant\".\n", "prediction 2": "In common law and statutory law, a life estate is the ownership of land for the duration of a person's life. Its owner is often the property's leaseholder. The life tenant is the owner of the property.", "prediction 3": "In common law and statutory law, a life estate is the ownership of land for the duration of a person's life, but only if the decedent dies before the end of the life of the personal owner; otherwise, ownership passes to the surviving spouse. The term \"life estate\" can refer to different types of property ownership, such as freehold estates and leasehold estates. The term \"life tenant\" is more often used to describe a person who lives without a house.", "prediction 4": "In common law and statutory law, a life estate is the ownership of land for the duration of a person's life. The owner of a life estate is called a life tenant.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 275 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In common law and statutory law, a life estate is the ownership of land for the duration of a person's life. The owner of a life estate is called a \"life tenant\". A marital life estate, on the other hand, is held by a living or widowed spouse for the duration of that spouse's life.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who does jeff bridges play in only the brave?", "passages": [ [ "Only the Brave (2017 film)", "Only the Brave (2017 film)\n\nOnly the Brave is a 2017 American biographical drama film directed by Joseph Kosinski and written by Ken Nolan and Eric Warren Singer, based on the \"GQ\" article \"No Exit\" by Sean Flynn.", "The film tells the story of the Granite Mountain Hotshots, an elite crew of firefighters who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013, and is dedicated to their memory.", "It features an ensemble cast, including Josh Brolin, James Badge Dale, Jeff Bridges, Miles Teller, Alex Russell, Taylor Kitsch, Ben Hardy, Thad Luckinbill, Geoff Stults, Scott Haze, Andie MacDowell and Jennifer Connelly.", "Principal photography began in New Mexico in June 2016.", "\"Only the Brave\" was released in the United States by Columbia Pictures on October 20, 2017.", "It received positive reviews from critics, with praise aimed at the cast and the film's touching tribute to its subjects.", "Eric Marsh, superintendent of Fire and Rescue Crew 7 in Prescott, Arizona, receives a call to the Cave Creek Complex Wildfire.", "Due to Crew 7's status as municipal firefighters, Eric's prediction that the fire will threaten a nearby neighborhood is ignored by a hotshot crew from California.", "The fire behaves as Eric anticipated and the neighborhood is destroyed." ] ], "gold": "Only the Brave is a 2017 American biographical drama film based on the GQ article No Exit by Sean Flynn. The film tells the story of the Granite Mountain Hotshots, an elite crew of firefighters from Prescott, Arizona who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013, and is dedicated to their memory. Jeff Bridges plays the role of Duane Steinbrink, the city fire chief.", "prediction 1": "Only the Brave is a 2017 American biographical drama film directed by Joseph Kosinski and written by Ken Nolan and Eric Warren Singer, based on the GQ article \"No Exit\" by Sean Flynn, dedicated to the memory of the Granite Mountain Hotshots, an elite crew of firefighters who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013. Jeff Bridges plays a character called Eric Marsh, superintendent of Fire and Rescue Crew 7 in Prescott, Arizona.", "prediction 2": "The 2017 American biographical drama film Only the Brave is dedicated to the memory of the Granite Mountain Hotshots, an elite crew of firefighters who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013. Jeff Bridges plays Eric Marsh, superintendent of Fire and Rescue Crew 7 in Prescott, Arizona.", "prediction 3": "Jeff Bridges plays the character of Eric Marsh in Only the Brave. Bridges played Eric Marsh in the 2011 film.", "prediction 4": "Only the Brave is a 2017 American biographical drama film directed by Joseph Kosinski and written by Ken Nolan and Eric Warren Singer, based on the \"GQ\" article \"No Exit\" by Sean Flynn. It tells the story of the Granite Mountain Hotshots, an elite crew of firefighters who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013. Jeff Bridges plays Granite Mountain Hotshot Captain Eric Marsh.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 134 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 183 }, { "error type": "Unverifiable", "explanation": "", "start": 349, "end": 461 } ], "missing-info": [], "corrected-prediction": "Only the Brave is a 2017 American biographical drama film based on the GQ article \"No Exit\". The film tells the story of the Granite Mountain Hotshots, an elite crew of firefighters who lost 19 of 20 members while fighting the Yarnell Hill Fire in June 2013, and is dedicated to their memory. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did new orleans jazz move to utah?", "passages": [ [ "Utah Jazz", "Utah Jazz\n\nThe Utah Jazz are an American professional basketball team based in Salt Lake City, Utah.", "The Jazz compete in the National Basketball Association (NBA) as a member club of the league's Western Conference Northwest Division.", "Since 1991, the team has played its home games at Vivint Smart Home Arena.", "The franchise began play in 1974 as the New Orleans Jazz (as a tribute to New Orleans' history of originating Jazz music), an expansion team based in New Orleans; the Jazz moved to Salt Lake City in 1979.", "The Jazz were one of the least successful teams in the league in their early years.", "Although 10 seasons elapsed before the Jazz qualified for their first playoff appearance in 1984, they did not miss the playoffs again until 2004.", "During the late 1980s, John Stockton and Karl Malone arose as the franchise players for the team, and formed one of the most famed point guard\u2013power forward duos in NBA history.", "Led by coach Jerry Sloan, who took over from Frank Layden in 1988, they became one of the powerhouse teams of the 1990s, culminating in two NBA Finals appearances in 1997 and 1998, where they lost both times to the Chicago Bulls, led by Michael Jordan.", "Both Stockton and Malone moved on in 2003.", "After missing the playoffs for three consecutive seasons the Jazz returned to prominence under the on-court leadership of point guard Deron Williams." ], [ "Utah Jazz", "However, their finances collapsed in their last two seasons, and they were shut down by the league 16 games into the 1975\u201376 season after missing payroll.", "Although Salt Lake City was not known for its jazz culture, the team decided to keep the name, as there was not enough time before the start of the 1979\u201380 season to receive league approval for a name change.", "The Jazz also preserved the original Mardi Gras-themed colors: green, purple and gold.", "The Jazz's attendance declined slightly after the team's move from New Orleans to Utah, partly because of a late approval for the move (June 1979) and also poor marketing in the Salt Lake City area.", "The team's management made the first of several moves in 1979, bringing high-scoring forward Adrian Dantley to Utah in exchange for Spencer Haywood.", "Dantley averaged 28 points per game during the 1979\u201380 season, allowing the team to waive Pete Maravich early in the year.", "The team struggled to a 24\u201358 mark, but was rewarded with the second overall pick in the 1980 NBA draft, which they used to pick Darrell Griffith of Louisville, another piece of the rebuilding puzzle.", "During the 1980\u201381 NBA season, the Jazz struggled financially as well as on the court." ] ], "gold": "The Jazz moved to Salt Lake City, Utah in 1979. The NBA franchise began play as an expansion team in 1974 as the New Orleans Jazz in a tribute to New Orleans' history of originating jazz music. Although Salt Lake City is not known for its jazz culture, the team decided to keep the name because there was not enough time before the start of the 1979\u201380 season to receive league approval for a name change. ", "prediction 1": "The New Orleans Jazz began play in 1974 as the New Orleans Jazz, an expansion team based in New Orleans. The Jazz moved to Salt Lake City in 1979. The Jazz were one of the least successful teams in the league in their early years. Their attendance declined slightly after the team's move from New Orleans to Utah, partly because of a late approval for the move (June 1979) and also poor marketing in the Salt Lake City area. However, their finances collapsed in their last two seasons, and they were shut down by the league 16 games into the 1975\u201376 season after missing payroll.", "prediction 2": "The New Orleans Jazz were an expansion team based in New Orleans that began play in 1974. They moved to Salt Lake City in 1979 when they were one of the least successful teams in the league in their early years. However, their finances collapsed in their last two seasons, and they were shut down by the league 16 games into the 1975\u201376 season after missing payroll. The team's management made the first of several moves in 1979, bringing high-scoring forward Adrian Dantley to Utah in exchange for Spencer Haywood.", "prediction 3": "The New Orleans Jazz, an expansion team based in New Orleans that began play in 1974, moved to Salt Lake City in 1979. While the team was one of the least successful teams in the league in its early years, they were led by coach Jerry Sloan from 1988-1999, and became one of the powerhouse teams of the 1990s. Led by Stockton and Malone, the Jazz were one of the most famed point guard\u2013power forward duos in NBA history. However, their finances collapsed in their last two seasons, and they lost both times to the Chicago Bulls, led by Michael Jordan.", "prediction 4": "The New Orleans Jazz were an expansion basketball team based in New Orleans that moved to Salt Lake City in 1979. However, their finances collapsed in their last two seasons, and they were shut down by the league 16 games into the 1975\u201376 season after missing payroll. The team's management made the first of several moves in 1979, bringing high-scoring forward Adrian Dantley to Utah in exchange for Spencer Haywood.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 579 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The New Orleans Jazz began play in 1974 as the New Orleans Jazz, an expansion team based in New Orleans as a tribute to New Orleans' history of originating Jazz music. The Jazz moved to Salt Lake City in 1979. Although Salt Lake City was not known for its jazz culture, the team decided to keep the name, as there was not enough time before the start of the 1979\u201380 season to receive league approval for a name change. " }, "preference": [ 2, 0, 2, 1, 2, 2 ] }, { "question": "First country to declare independence from the soviet union?", "passages": [ [ "Post-Soviet states", "Estonia, Latvia, and Lithuania primarily use fossil fuels for energy including imported gas, oil, and petroleum products.", "The Baltic States use fuels with high amounts of sulfur and pollutants, which has had a negative effect on the environment.", "Power plants constructed in the Baltic States under the USSR are inefficient as they were designed to power the northwestern region of Soviet territory.", "During this time, environmental monitoring and regulation was controlled at the local level, but the Baltic States had little influence over the state-managed industrial activities of their area.", "Concern for the environment fueled a desire for independence from the USSR.", "Since declaring independence, the energy consumption of the Baltic States has declined due to a decrease in industrial activity, and each nation created its own environmental oversight body: the Ministry of Environment in Estonia, the Environmental Protection Committee in Latvia, and the Environmental Protection Department in Latvia, all of which were under \u00a0the legislative branch but independent from executive government.", "Air pollution was high in the Baltic States due to the high sulfur content and other pollutants emitted from their fuel sources.", "Water pollution was also considerable due to agricultural and industrial activity, as well as Soviet military installations.", "Emission charges were enacted in the Baltic States to reduce pollution levels.", "Northeastern Estonia and the Narva region in particular was the site of an oil-shale industry which provided electricity and heat." ], [ "Post-Soviet states", "Although Kyrgyzstan's accession treaty will not come into force until May 2015, provided it has been ratified, it will participate in the EAEU from the day of its establishment as an acceding state.", "Moldova and Tajikistan are prospective members.", "Seven CIS member states, namely Russia, Belarus, Kazakhstan, Kyrgyzstan, Tajikistan, Uzbekistan and Armenia, have enhanced their military cooperation, establishing the Collective Security Treaty Organization (CSTO), this being an expansion of the previous Collective Security Treaty (CST).", "Uzbekistan which (alongside Georgia and Azerbaijan) withdrew from the CST in 1999, joined GUAM.", "Then in 2005 it withdrew from GUAM and joined the CSTO in 2006.", "On 28 June 2012, Uzbekistan suspended its membership in the CSTO.", "Three former Soviet states are members of NATO: Estonia, Latvia, and Lithuania.", "Poland, a former socialist nation, is also a NATO member.", "Georgia, where both public opinion and the ruling government favor NATO membership, is in the Intensified Dialogue program with NATO.", "Ukraine also declared joining NATO as its geopolitical goal once again in 2017 (first time being right after the Orange revolution and in the beginning of presidency of Viktor Yushchenko), after the presidency of Viktor Yanukovych, during which the government officially declared neutrality and ceased to seek NATO membership." ], [ "Estonia", "Reformist Vaino V\u00e4ljas became the first secretary of Estonian Communist Party, and under his leadership on 16 November 1988 Estonian Supreme Soviet issued Sovereignty Declaration asserting the primacy of Estonian laws over Union laws.", "Over the next two years almost all other Soviet Republics followed the Estonian lead issuing similar declarations.", "On 23 August 1989 about 2 million Estonians, Latvians and Lithuanians participated in a mass demonstration forming a Baltic Way human chain across the three republics.", "In 1990 the Congress of Estonia was formed as representative body of Estonian citizens.", "In March 1991 a referendum was held where 77.7% of voters supported independence, and during the coup attempt in Moscow Estonia declared restoration of independence on 20 August, which is now the Day of Restoration of Independence, a national holiday.", "Soviet authorities recognized Estonian independence on 6 September, and on 17 September Estonia was admitted into the United Nations.", "The last units of the Russian army left Estonia in 1994.", "In 1992 radical economic reforms were launched for switching over to a market economy, including privatisation and currency reform.", "Estonian foreign policy since independence has been orientated towards the West, and in 2004 Estonia joined both the European Union and NATO." ] ], "gold": "The Republic of Estonia was the first country to declare independence from the Soviet Union, but did not actually achieve independence for quite some time. The Republic of Lithuania declared independence from the Soviet Union, and, without a period of transition like Estonia, became the first country to officially receive their independence on March 11, 1990. Soviet authorities recognized Estonian independence on September 6, 1992.", "prediction 1": "Estonia was the first Soviet state to declare independence from the USSR and the second to declare independence from the Soviet Union. Latvia and Lithuania also declared independence in 1992 and Estonia joined both the European Union and NATO in 2004.", "prediction 2": "Estonia is the first country to declare its independence from the Soviet Union. In March 1991 a referendum was held in which 77.7% of voters supported independence, and during the coup attempt in Moscow Estonia declared restoration of independence on 20 August, which is now the Day of Restoration of Independence, a national holiday. The last Soviet troops left Estonia in 1994. In 2004, Estonia joined both the European Union and NATO. Concern for the environment fueled a desire for independence from the USSR.", "prediction 3": "Estonia was the first Soviet republic to declare independence from the Soviet Union and the first Baltic state to declare independence from the USSR. In March 1991, a referendum was held where 77.7% of voters supported independence, and during the coup attempt in Moscow Estonia declared restoration of independence on 20 August, which is now the Day of Restoration of Independence, a national holiday. Estonian officials recognized Estonian independence on 6 September, and Estonia was admitted into the United Nations on 17 September. However, in 2004 the Baltic states joined both the European Union and NATO.", "prediction 4": "Estonia became the first country to declare independence from the Soviet Union on August 20, 1991, and Latvia the first country to declare independence from the Soviet Union on August 20, 1991. Latvia's independence was recognized on August 5, 1991. Estonia, Latvia, and Lithuania primarily use fossil fuels for energy including imported gas, oil, and petroleum products.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Estonia was the first Soviet state to declare independence from the USSR ", "start": 73, "end": 134 }, { "error type": "Unverifiable", "explanation": "", "start": 183, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 251 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "Estonia was the first Soviet state to declare independence from the Soviet Union. Latvia and Lithuania also declared independence. Soviet authorities recognized Estonian independence on 6 September, 1991." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When did the philadelphia eagles enter the nfl?", "passages": [ [ "History of the Philadelphia Eagles", "Lud Wray's half-interest in the team was purchased by Art Rooney, who had just sold the Pittsburgh Steelers to Alexis Thompson.", "Soon thereafter, Bell/Rooney and Thompson swapped franchises, but not teams.", "Bell/Rooney's entire Eagles' corporate organization, including most of the players, moved to Pittsburgh (The Steelers' corporate name remained \"Philadelphia Football Club, Inc.\" until 1945) and Thompson's Steelers moved to Philadelphia, leaving only the team nicknames in their original cities.", "Since NFL franchises are territorial rights distinct from individual corporate entities, the NFL does not consider this a franchise move and considers the current Philadelphia Eagles as a single unbroken entity from 1933.", "After assuming ownership, Thompson promptly hired Greasy Neale as the team's head coach.", "In its first years under Neale, the team continued to struggle.", "In 1943, when manpower shortages stemming from World War II made it impossible to fill the roster, the team temporarily merged with the Steelers to form a team popularly known as the \"Steagles.\"", "The merger, never intended as a permanent arrangement, was dissolved at the end of the 1943 season.", "This season saw the team's first winning season in its 11-year history, with a finish of 5-4-1." ], [ "History of the Philadelphia Eagles", "Neither the Eagles nor the NFL officially regard the two franchises as the same, citing the aforementioned period of dormancy.", "The Eagles simply inherited the NFL rights to the Philadelphia area.", "Further, Wray and Bell assembled an almost entirely new team; only a single player from the 1931 Yellow Jackets ended up with the 1933 Eagles.", "The new team played its first game on October 15, 1933, against the New York Giants at the Polo Grounds in New York City.", "They lost the game 56-0.", "The Eagles struggled over the course of their first decade, never winning more than four games.", "Their best finish was in their second season, 1934, when they finished tied for third in the East.", "For the most part, the Eagles' early rosters were composed of former Penn, Temple and Villanova players who put in a few years before going on to other things.", "In 1935, Bell proposed an annual college draft to equalize talent across the league.", "The draft was a revolutionary concept in professional sports.", "Having teams select players in inverse order of their finish in the standings, a practice still followed today, strove to increase fan interest by guaranteeing that even the worst teams would have the opportunity for annual infusions of the best college talent." ], [ "History of the Philadelphia Eagles", "History of the Philadelphia Eagles\n\nThe history of the Philadelphia Eagles begins in 1933.", "In their history, the Eagles have appeared in the Super Bowl three times, losing in their first two appearances but winning the third, in 2018.", "They won three NFL Championships, the precursor to the Super Bowl, in four appearances.", "The beginning era of the Eagles history, 1933 to 1939, was influenced by its owner, and then also coach, Bert Bell.", "After Bell ostensibly sold the team, to Alexis Thompson in 1940, the second era of the Eagles history was largely directed by their coach and future Hall of Famer, Greasy Neale.", "In 1931, Philadelphia's NFL franchise, the Frankford Yellow Jackets, who had won the NFL Championship in 1926, went bankrupt and ceased operations midway through the season.", "After more than a year searching for a suitable replacement, the NFL granted an expansion franchise to a syndicate headed by former University of Pennsylvania teammates Lud Wray and Bert Bell.", "In exchange for an entry fee of $2,500, the Bell-Wray group was awarded the assets of the failed Yellow Jackets organization.", "Drawing inspiration from the insignia of the centerpiece of President Franklin D. Roosevelt's New Deal, specifically the National Recovery Act's \"blue eagle,\" Bell and Wray named the new franchise the Philadelphia Eagles, with Bell as president and general manager and Wray as head coach." ] ], "gold": "The Philadelphia Eagles originally entered the NFL in 1933, though the team struggled throughout their first decade and never won more than four games. In 1943, World War II manpower shortages made filling football rosters difficult, so the Eagles merged with the Pittsburgh Steelers to create the \"Steagles\". The \"Steagles\" dissolved at the end of the season and the Eagles independently re-entered the NFL in 1944.", "prediction 1": "The Philadelphia Eagles entered the NFL in 1933. As a franchise, the Philadelphia Eagles inherited the rights to the Philadelphia area and played their first game on October 15, 1933 against the New York Giants.", "prediction 2": "The Philadelphia Eagles have appeared in the Super Bowl three times, losing in their first two appearances but winning the third, in 2018. The team entered the NFL in 1933, when they entered the league as an expansion franchise for the Frankford Yellow Jackets. The team played its first game on October 15, 1933, against the New York Giants at the Polo Grounds in New York City.", "prediction 3": "The Philadelphia Eagles entered the NFL in 1933 and played their first game on October 15, 1933. They were initially owned by Bert Bell and Lud Wray, who were teammates at the University of Pennsylvania. In 1931, the team was sold to Alexis Thompson, who became the team's owner. The team continued to struggle and in 1943, when manpower shortages stemming from World War II made it impossible to fill the roster, the team temporarily merged with the Steelers to form a team popularly known as the \"Steagles.\"", "prediction 4": "In 1933, the Philadelphia Eagles entered the NFL as an expansion franchise after the Frankford Yellow Jackets, who had won the NFL Championship in 1926, went bankrupt and ceased operations midway through the season. In exchange for an entry fee of $2,500, the Bell-Wray group was awarded the assets of the failed Yellow Jackets organization. The team played its first game on October 15, 1933, against the New York Giants at the Polo Grounds in New York City, losing the game 56-0. In 1943, when manpower shortages stemm the team temporarily merged with the Steelers to form a team popularly known as the Steelers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 211 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Philadelphia Eagles entered the NFL in 1933. The Eagles struggled over the course of their first decade, never winning more than four games. In 1943, when manpower shortages stemming from World War II made it impossible to fill the roster, the team temporarily merged with the Steelers to form a team popularly known as the \"Steagles.\" The merger, never intended as a permanent arrangement, was dissolved at the end of the 1943 season. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does to catch a thief take place?", "passages": [ [ "Alfred Hitchcock's unrealized projects", "Sossen was also in communication with Laurens van der Post who gave him a signed copy of the book \"Flamingo Feather\" during a visit to the Falls (staying at the Victoria Falls Hotel).", "Sossen's daughter Marion is in possession of the book today and a number of letters between her father and van der Post.", "\"No Bail for the Judge\" was to be an adaptation of a thriller novel by Henry Cecil about a London barrister who, with the assistance of a gentleman thief, has to defend her father, a High Court judge, when he is accused of murdering a prostitute.", "In a change of pace from his usual blonde actresses, Audrey Hepburn would have played the barrister, with Laurence Harvey as the thief, and John Williams as the Hepburn character's father.", "Some sources, including \"Writing with Hitchcock\" author Steven DeRosa say that Hitchcock's interest in the novel started in the summer of 1954 while filming \"To Catch a Thief\", and that Hitchcock hoped to have John Michael Hayes write the screenplay.", "Hepburn was an admirer of Hitchcock's work and had long wanted to appear in one of his films.", "Samuel A. Taylor, scenarist for \"Vertigo\" and \"Topaz\", wrote the screenplay after Ernest Lehman rejected it." ], [ "To Catch a Thief", "To Catch a Thief\n\nIn May 2018, it was announced that Viacom was set to adapt the film as a Spanish-language television series.", "The pattern of a string of jewel robberies on the French Riviera causes the police to believe that the infamous jewel thief John \"The Cat\" Robie (Cary Grant) has left his comfortable retirement of growing grapes and flowers.", "He gives the police the slip at his hilltop villa.", "Robie visits a restaurant.", "The staff are his old gang, paroled for their work in the French Resistance during World War II as long as they keep clean.", "Bertani, Foussard, and the others angrily blame Robie because they are all under suspicion so long as the new Cat is active.", "When the police arrive at Bertani's restaurant looking for Robie, Foussard's teenage daughter Danielle (Brigitte Auber), who has a crush on him, spirits him to safety.", "Robie recognizes he can prove his innocence by catching the new Cat in the act.", "He enlists the aid of an insurance man, H. H. Hughson (John Williams), who reluctantly obtains a list of the most expensive jewelry owners currently on the Riviera.", "Tourists Jessie Stevens (Jessie Royce Landis), a wealthy nouveau riche widow, and her daughter Frances (Grace Kelly), top the list." ] ], "gold": "To Catch a Thief is a 1955 American black comedy romantic thriller film directed by Alfred Hitchcock, from a screenplay by John Michael Hayes based on the 1952 novel of the same name by David Dodge. It was filmed in Cannes, Nice and the surrounding countryside of France. The plot takes place in the French Riviera.", "prediction 1": "To Catch a Thief takes place on the French Riviera in 1954. The film's setting is in Nice, France. Some sources say that Alfred Hitchcock's interest in the novel started in the summer of 1954 while filming To Catch a Thief. Hitchcock hoped to have John Michael Hayes write the screenplay, and that Hepburn was an admirer of Hitchcock's work and had long wanted to appear in one of his films.", "prediction 2": "To Catch a Thief takes place on the French Riviera. In the movie, the thief is played by Laurence Harvey.", "prediction 3": "The film To Catch a Thief takes place on the French Riviera. The story of the film takes place in Nice, France.", "prediction 4": "In the 1954 film To Catch A Thief, a series of jewel robberies on the French Riviera take place. The film's plot revolves around the infamous jewel thief John \"The Cat\" Robie, played by Cary Grant. The film's filming location was in Nice, France.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 60, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 391 } ], "missing-info": [], "corrected-prediction": "To Catch a Thief takes place on the French Riviera in 1954. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Whos next in line for the royal family?", "passages": [ [ "Succession to the British throne", "Succession to the British throne\n\nSuccession to the British throne is determined by descent, sex (for people born before October 2011), legitimacy, and religion.", "Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line.", "The Bill of Rights 1689 and the Act of Settlement 1701 restrict succession to the throne to the legitimate Protestant descendants of Sophia of Hanover that are in \"communion with the Church of England\".", "Spouses of Roman Catholics were disqualified from 1689 until the law was amended in 2015.", "Protestant descendants of those excluded for being Roman Catholics are eligible.", "Queen Elizabeth II is the sovereign, and her heir apparent is her eldest son, Charles, Prince of Wales.", "Next in line after him is Prince William, Duke of Cambridge, the Prince of Wales's elder son.", "Third in line is Prince George, the eldest child of the Duke of Cambridge, followed by his sister, Princess Charlotte and younger brother, Prince Louis.", "Sixth in line is Prince Harry, Duke of Sussex, the younger son of the Prince of Wales.", "Under the Perth Agreement, which came into effect in 2015, only the first six in line of succession require the sovereign's consent before they marry; without such consent, they and their children would be disqualified from succession." ], [ "House of Orange-Nassau", "On April 30, 1980, Queen Juliana abdicated in favor of her daughter, Beatrix.", "In the early years of the twenty-first century, the Dutch monarchy remained popular with a large part of the population.", "Beatrix's eldest son, Willem-Alexander, was born on April 27, 1967; the first immediate male heir to the Dutch throne since the death of his great-granduncle, Prince Alexander, in 1884.", "Willem-Alexander married M\u00e1xima Zorreguieta, an Argentine banker, in 2002; the first commoner to ever marry an heir apparent to the Dutch throne.", "They are parents of three daughters: Catharina-Amalia, Alexia, and Ariane.", "After a long struggle with neurological illness, Queen Juliana died on March 20, 2004, and her husband, Prince Bernhard, died on December 1 of that same year.", "Upon Beatrix's abdication on April 30, 2013, the Prince of Orange was inaugurated as King Willem-Alexander, becoming the Netherlands' first male ruler since 1890.", "His eldest daughter, Catharina-Amalia, as heiress apparent to the throne, became Princess of Orange in her own right." ], [ "Victoria, Crown Princess of Sweden", "Victoria, Crown Princess of Sweden\n\nVictoria, Crown Princess of Sweden, Duchess of V\u00e4sterg\u00f6tland (Victoria Ingrid Alice D\u00e9sir\u00e9e; born 14 July 1977) is the heir apparent to the Swedish throne, as the eldest child of King Carl XVI Gustaf.", "If she ascends to the throne as expected, she will be Sweden's fourth queen regnant (after Margaret, Christina and Ulrika Eleonora) and the first since 1720.", "Victoria was born on 14 July 1977 at 21:45 CET at the Karolinska Hospital in Solna, Stockholm County, Sweden, and is the oldest child of King Carl XVI Gustaf and Queen Silvia.", "She is a member of the Royal House of Bernadotte.", "Born as a Princess of Sweden, she was designated Crown Princess in 1979 (SFS 1979:932) ahead of her younger brother.", "Her place as first in the line of succession formally went into effect on 1 January 1980 with the parliamentary change to the Act of Succession that introduced absolute primogeniture.", "Her given names honour various relatives.", "Her first name comes primarily from her great-great-grandmother Victoria of Baden, queen consort of Sweden." ] ], "gold": "In the British Royal family, Queen Elizabeth II is the sovereign, and her heir apparent is her eldest son, Charles, Prince of Wales, with next in line after him being Prince William, Duke of Cambridge, the Prince of Wales's elder son, as the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. In the Dutch royal family, Catharina-Amalia, Princess of Orange and eldest daughter of the eldest child of King Willem-Alexander and Queen M\u00e1xima, is the heir apparent to the throne of the Kingdom of the Netherlands. Her father ascended the throne on 30 April 2013. In the Swedish royal family, Crown Princess Victoria, Duchess of V\u00e4sterg\u00f6tland, is the heir apparent to the Swedish throne, as the eldest child of King Carl XVI Gustaf and if she ascends to the throne as expected, she would be Sweden's fourth queen regnant and the first since 1720.", "prediction 1": "In the United Kingdom, the next in line for the throne is Charles, Prince of Wales, and in the Netherlands the next in line is William, Prince of Cambridge, and the next in line is Prince George, who is the eldest child of the Duke of Cambridge, and the third in line is Princess Charlotte, the eldest daughter of the Duke of Cambridge, and the sixth in line is Prince Harry, Duke of Sussex. The Swedish heir apparent to the throne is Victoria, Crown Princess of Sweden, Duchess of V\u00e4sterg\u00f6tland, and is the youngest child of King Carl XVI Gustaf.", "prediction 2": "The heir apparent for the British monarchy is Charles, Prince of Wales. Next in line after him is Prince William, Duke of Cambridge, the Prince of Wales' elder son. Third in line is Prince George, the eldest child of the Duke of Cambridge, followed by his sister, Princess Charlotte and younger brother, Prince Louis. Sixth in line is Prince Harry, Duke of Sussex, the younger son of the Prince of Wales.", "prediction 3": "In the United Kingdom, Charles is the heir apparent, second in line after his father and third in line after his mother. In the Netherlands, Charles is the eldest son of Queen Beatrix and the eldest son of Prince Willem-Alexander. In Sweden, Victoria is the heir apparent, third in line after her father and youngest son and the third in line after her younger brother, Prince Louis. In Australia and New Zealand, Prince Harry is the sixth in line.", "prediction 4": "In common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. Charles, the eldest son of Queen Elizabeth II, is the heir apparent of her son, Prince Charles, and Charles is followed by Prince William, Duke of Cambridge, the elder son of the Prince of Wales, and then finally Prince George, the eldest child of the Duke of Cambridge, followed by his sister, Princess Charlotte, and younger brother, Prince Louis.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 88, "end": 110 }, { "error type": "Unverifiable", "explanation": "", "start": 291, "end": 310 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 345, "end": 391 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 245 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 508, "end": 516 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "In the United Kingdom, the next in line for the throne is Charles, Prince of Wales, and next in line is William, Prince of Cambridge,the Prince of Wales's elder son. Queen Elizabeth II is the sovereign. Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. The Swedish heir apparent to the throne is Victoria, Crown Princess of Sweden, Duchess of V\u00e4sterg\u00f6tland, and is the eldest child of King Carl XVI Gustaf. If she ascends to the throne as expected, she will be Sweden's fourth queen regnant and the first since 1720. Willem-Alexander ascended the Dutch throne on April 30, 2013. His eldest daughter, Catharina-Amalia, the Princess of Orange, is the heiress apparent to the throne." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who plays lilly on the young and the restless?", "passages": [ [ "Lily Winters", "The producers tried unsuccessfully to convince Khalil to stay, and recast her role with Sherwood.", "Sherwood said that while the character Lily was the same, she and Khalil were not the same actress so it would be \"a little different\".", "Although she replaced a popular actress, Sherwood said she felt no anxiety over the recasting because Khalil chose to leave the part.\n\nAfter leaving the series, Khalil and the producers began discussing her possible return.", "In 2006 she agreed to come back, and Sherwood was released from her contract. Former executive producer and head writer Lynn Marie Latham said she was happy with the casting change; she was impressed by Khalil's work, saying that she is a \"brilliant actress\".", "Latham noted that Sherwood did a \"fine job\" as the character, but \"shows generally prefer to have original players back when they can get them\".", "On her MySpace blog, Sherwood said she felt negativity from others on the set of the soap opera before her replacement; she was not told the reason for her firing, which she thought neither right nor fair." ], [ "Lily Winters", "Lily Winters\n\nLily Winters is a fictional character from the American CBS soap opera \"The Young and the Restless\".", "Created by William J. Bell, the character appeared as a child for her first five-year period.", "In 2002, Christel Khalil began portraying Lily as a teenager after the character rapidly aged.", "In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood; however, Sherwood's portrayal was brief when Khalil asked to return the following year.", "Khalil began playing the character as a \"rebellious, yet naive teenager\", later becoming one of the soap opera's heroines.", "Winters is the daughter of supermodel-turned-executive Drucilla Winters (Victoria Rowell) born in the midst of a questioned paternity storyline, with Neil Winters (Kristoff St. John) believing he was her father.", "Eleven years later, the storyline was readdressed with the revelation that Malcolm Winters (Shemar Moore) is her biological father.", "Lily later began a relationship with Daniel Romalotti (Michael Graziadei), a romance inspired by \"Romeo and Juliet\".", "The couple were popular with viewers, who were saddened at their separation (because of Daniel's addiction to pornography)." ], [ "Brooke Marie Bridges", "Brooke Marie Bridges\n\nBrooke Marie Bridges (born August 5, 1991, in Los Angeles, California) is an American actress.", "She is best known for playing the young Lily Winters on \"The Young and the Restless\" from 1996 to 1998 and again in 2000.", "She is the daughter of Jimmy Bridges and the niece of actor Todd Bridges and Verda Bridges.", "She is currently working a full-time job and preparing for college.", "She is trying to pursue her dream as a singer/songwriter as well as a fashion model.", "She has two sisters, Penny Bridges and Rachel Bridges.", "She is also cousin of Spencir Bridges.", "She's known for her recurring role as Claire Sawyer, Future Lawyer on \"Ned's Declassified School Survival Guide\" from 2004 to 2007.", "She has also appeared in the Steven Soderbergh directed feature film \"The Limey\" as well as television shows \"Touched by an Angel\", \"LAX\", \"First Monday\" and \"The District\".", "Currently she runs and writes her own recipe blog at http://www.the-babbling-brooke.com/." ] ], "gold": "Lily Winters is a fictional character from the American CBS soap opera The Young and the Restless. Winters was first portrayed as a child by Vanessa Carson in 1996, followed by Brooke Marie Bridges from 1998 to 2000. In 2002, Christel Khalil began portraying Lily as a teenager after the character rapidly aged. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood; however, Sherwood's portrayal was brief when Khalil was asked to return the following year.", "prediction 1": "Christel Khalil began playing Lily as a teenager on the CBS soap opera The Young and the Restless in 2002. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood. Brooke Marie Bridges played Lily from 1996 to 1998 and again in 2000.", "prediction 2": "Lily Winters is a fictional character from the American CBS soap opera The Young and the Restless created by William J. Bell. Christel Khalil began portraying Lily as a teenager after the character rapidly aged. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood. Brooke Marie Bridges played Lily from 1996 to 1998 and again in 2000.", "prediction 3": "Lily Winters is a fictional character on the American television soap opera \"The Young and the Restless\". In 2002, Christel Khalil began portraying Lily as a teenager after the character rapidly aged. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood. Brooke Marie Bridges played Lily from 1996 to 1998 and again from 2000 to 2010.", "prediction 4": "Lily Winters is a fictional character from the American television soap opera The Young and the Restless. In 2002, Christel Khalil began portraying Lily as a teenager after the character rapidly aged. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood. However, Sherwood's portrayal of the character was brief when Khalil asked to return the following year. American actress Brooke Marie Bridges is best known for playing the young Lily Winters on The Young and the Restless from 1996 to 1998 and again in 2000.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Lily Winters is a fictional character from the American CBS soap opera \"The Young and the Restless\". Christel Khalil began playing Lily as a teenager on the CBS soap opera The Young and the Restless in 2002. In 2005, Khalil left the series, resulting in the character's recasting with Davetta Sherwood; however, Sherwood's portrayal was brief when Khalil asked to return the following year. Brooke Marie Bridges played Lily from 1996 to 1998 and again in 2000." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where did henry go on grounded for life?", "passages": [ [ "Grounded for Life", "The following day he went missing, and was later discovered to have sneaked back into school.", "Jimmy has been bullied at school; once he fought back and was accused of being the bully.", "He was also bullied by a girl, although it turned out that she actually liked him.", "Henry (Jake Burbage) the Finnertys' younger son, is the family optimist.", "A little wild, sometimes annoying, and unfortunately gullible, he is kindhearted and gentle.", "Jake Burbage left the show at the end of season four (in the summer of 2004) to move back east which is why he was never seen in season five although he was mentioned.", "Gracie, the youngest Finnerty, was born in the last episode.", "Claudia discovered she was pregnant at the start of season five, and in the season finale\u2014at Lily's graduation\u2014she went into labor and delivered Gracie at the hospital.", "Originally they were going to call her Rose, but when too many people mistakenly thought the name was a reference to \"Titanic\", they decide to rename her Gracie.", "Walt and his fianc\u00e9e then say they will name their child Rose.", "Eddie (Kevin Corrigan) is Sean's younger brother, a conniving, womanizing weirdo who can never give a straight answer to any question.", "Claudia and Eddie often had their differences throughout the series run." ] ], "gold": "Henry Finnerty, played by Jake Burbage, is the youngest son of the family in the Show Grounded for life. Henry disappeared at the beginning of the fifth season when actor Jake Burbage left to move back east with his family.", "prediction 1": "Henry is Henry Finnerty's younger son. Jake Burbage left the show at the end of season four to move back east. That's why he was never seen in season five although he was mentioned. In Season Five, Henry goes to the hospital with his parents for his first birthday, a day after going missing.", "prediction 2": "Henry Finnerty goes missing on the show and is later discovered to have sneaked back into school. Jake Burbage plays Henry, the younger brother of Mary and Walt Finnerty. Henry is a little wild, sometimes annoying, and unfortunately gullible, but is kindhearted and gentle. Jake Burbage left the show at the end of season four to move back east which is why he was never seen in season five although he was mentioned.", "prediction 3": "Henry Finnerty goes missing and is discovered to have sneaked back into school. He is the younger son of the Finnertys and is the family optimist. He is a little wild, sometimes annoying, and unfortunately gullible, but kindhearted and gentle. Jake Burbage left the show at the end of season four to move back east which is why he was never seen in season five although he was mentioned.", "prediction 4": "Henry, played by Jake Burbage, went missing the day he went missing, and was later discovered to have sneaked back into school. Jimmy Finnerty, played by Kevin Corrigan, is the Finnertys' younger son. He was discovered to have sneaked back into school.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 182, "end": 292 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 181 } ], "missing-info": [], "corrected-prediction": "Henry is Henry Finnerty's younger son played by Jake Burbage. Jake Burbage left the show at the end of season four to move back east. " }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "When will the next world series game be played?", "passages": [ [ "World Series", "The labor dispute lasted into the spring of 1995, with owners beginning spring training with replacement players.", "However, the MLBPA returned to work on April 2, 1995 after a federal judge, future U.S. Supreme Court justice Sonia Sotomayor, ruled that the owners had engaged in unfair labor practices.", "The season started on April 25 and the 1995 World Series was played as scheduled, with Atlanta beating Cleveland four games to two.", "The 2001 World Series was the first World Series to end in November, due to the week-long delay in the regular season after the September 11 attacks.", "Game 4 had begun on Oct. 31 but went into extra innings and ended early on the morning of Nov. 1, the first time the Series had been played in November.", "Yankee shortstop Derek Jeter won the game with a 12th inning walk-off home run and was dubbed \"Mr. November\" by elements of the media \u2013 echoing the media's designation of Reggie Jackson as \"Mr. October\" for his slugging achievements during the 1977 World Series.", "With the 2006 World Series victory by the St. Louis Cardinals, Tony La Russa became the second manager to a win a World Series in both the American and National Leagues.", "Prior to 2003, home-field advantage in the World Series alternated from year to year between the NL and AL." ] ], "gold": "In 2017, 2016 and 2015 the World Series ended in November. The 2017 World Series was played from October 24 - November 1. The 2016 World Series was played from October 25 \u2013 November 2. The 2015 World Series was played from October 27 \u2013 November 1.The 2009 World Series was the first World Series regularly scheduled to be played into the month of November, ending on November 4, which remains the latest calendar date on which a World Series game has been played. The 2001 World Series was the first World Series to end in November, due to the week-long delay in the regular season after the September 11 attacks. ", "prediction 1": "The next World Series game will be played in the year 2021. In 2026, the World Series was played in the year 2027. The World Series in 2001 ended in November. Game 4 had begun on Oct. 31 but went into extra innings and ended early on the morning of Nov. 1, the first time the Series had been played in November.", "prediction 2": "World Series games are played on different dates. In 2001, the World Series was the first World Series to end in November, due to the week-long delay in the regular season after the September 11 attacks. Game 4 had begun on Oct. 31 but went into extra innings and ended early on the morning of Nov. 1, the first time the Series had been played in November. In 2006, the World Series game was played on Oct. 31, 2006, and 2012.", "prediction 3": "The World Series is a professional baseball championship game played in the United States. The game involving the American League teams is played on April 1, 2019.", "prediction 4": "The next World Series game will be played on July 17, 2023.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 59 }, { "error type": "Unverifiable", "explanation": "", "start": 60, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 311 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 2001 World Series was the first World Series to end in November, due to the week-long delay in the regular season after the September 11 attacks." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time the giants went to the playoffs?", "passages": [ [ "San Francisco Giants", "San Francisco Giants\n\nThe San Francisco Giants are an American professional baseball team based in San Francisco, California.", "Founded in 1883 as the New York Gothams, and renamed three years later the New York Giants, the team eventually moved to San Francisco in 1958.", "The Giants compete in Major League Baseball (MLB) as a member club of the National League (NL) West division.", "As one of the longest-established and most successful professional baseball teams, the franchise has won the most games of any team in the history of American baseball.", "The team was the first major league team based in New York City, most memorably playing at the legendary Polo Grounds.", "They have won 23 NL pennants and have played in 20 World Series competitions \u2013 both NL records.", "The Giants' eight World Series championships rank second in the National League and fourth overall (the New York Yankees are first with 27, then the St. Louis Cardinals (the National League record-holders) with 11, and the Oakland Athletics and the Boston Red Sox both with 9).", "The Giants have played in the World Series 20 times \u2013 14 times in New York, six in San Francisco \u2013 but boycotted the event in 1904." ], [ "2016 New York Giants season", "The Giants offense got going, but failed to convert on their scoring opportunities.", "Four Robbie Gould field goals weren't enough, and the Giants fell to the Eagles 24\u201319, dropping them 10\u20135.", "The Giants also allowed the Dallas Cowboys to clinch the NFC East and clinch home field advantage through the playoffs.", "Despite the loss, the Giants clinched a playoff trip when the Tampa Bay Buccaneers fell to the New Orleans Saints 31\u201324 two days later.", "The Giants enter 2017 bouncing back from Week 16's loss against the Eagles.", "With this win, the Redskins were eliminated from the playoffs after previously winning the NFC East last season.", "The Giants finish 11-5 for the first time since the 2005 season and finish with at least 11 wins for the first time since 2008.", "As the Green Bay Packers defeated the Detroit Lions, the Giants Wildcard match was set to be against them at Lambeau Field.", "This game was fiercely competitive in a first half littered with warning signs.", "The Giants dominated the pace early, but couldn't capitalize due to critical wide receiver drops and could only muster a 6-0 lead.", "The Packers were up 7-6 going into halftime while those warning signs came to fruition; a last second hail mary from Aaron Rodgers to Randall Cobb increased the lead from 14-6.", "The second half was a disaster." ], [ "Super Bowl XLVI", "This would be the fourth time in the Giant's five Super Bowl appearances that they faced their AFC opponent earlier during the regular season.", "In every season in which the Giants have won the Super Bowl they have faced their AFC Super bowl counterpart previously during the regular season.", "The Giants are now 4\u20130 in Super Bowls in which Bill Belichick has been on the sidelines.", "Belichick was the Giants' defensive coordinator for their first two Super Bowl victories, and the opposing head coach in their last two.", "Three of the Giants' victories have come against AFC East teams, with the Giants having defeated the Buffalo Bills and Patriots twice.", "The Giants continued their winning streak in road playoff games with their win in Super Bowl XLVI.", "The team won every playoff game they played away from their home stadium (Giants Stadium and MetLife Stadium) from 2007-2011.", "Prior to this run, last time the Giants were defeated in a game away from the Meadowlands was in 2006, when they were defeated by the Philadelphia Eagles in the Wild Card round.", "This streak came to an end in the 2016\u201317 NFL playoffs, where the Giants were defeated 38-13 by the Green Bay Packers at Lambeau Field in the Wild Card round.", "Two of the Giants' road playoff victories during this streak occurred at Lambeau." ] ], "gold": "The San Francisco Giants are an American professional baseball team based in San Francisco who compete in Major League Baseball as a member club of the National League West division. The team was founded in 1883 as the New York Gothams, and renamed three years later the New York Giants, before moving to San Francisco in 1958, where they established their current name. The last time the Giants baseball team went to the playoffs was in 2016. The last time the New York Giants football team made it to the playoffs was 2016, where they were subsequently knocked out in the wild card round, despite dominating the pace early.", "prediction 1": "The New York Giants are an American professional baseball team based in San Francisco, California. The team competes in Major League Baseball (MLB) as a member club of the National League West division. In the 2016 season, the Giants went to the playoffs for the first time in five seasons. In 2015, the Giants went to the playoffs for the first time in six seasons. In 2016, the Giants went to the playoffs for the second time in seven seasons. The last time the Giants went to the playoffs for the third time was in the 2017 season. In 2016, the Giants went to the playoffs for the first time in their second time in the history of American baseball.", "prediction 2": "The New York Giants are an American professional baseball team based in San Francisco, California and compete in Major League Baseball as a member club of the National League West division. The last time the Giants went to the playoffs was in 2006, when they were defeated by the Philadelphia Eagles in the Wild Card round. This streak came to an end in the 2016\u201317 NFL playoffs, where the Giants were defeated 38-13 by the Green Bay Packers at Lambeau Field in the Wild Card round.", "prediction 3": "The New York Giants are an American professional baseball team based in San Francisco. Their last trip to the playoffs was in 2016\u201317, when they were defeated 38-13 by the Green Bay Packers at Lambeau Field in the Wild Card round.", "prediction 4": "The New York Giants are an American professional baseball team based in San Francisco. They compete in Major League Baseball as a member club of the National League West division. The last time the Giants went to the playoffs was in 2016, when they were defeated 38-13 by the Green Bay Packers at Lambeau Field in the Wild Card round.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 4, "end": 19 }, { "error type": "Unverifiable", "explanation": "", "start": 203, "end": 290 }, { "error type": "Unverifiable", "explanation": "", "start": 291, "end": 366 }, { "error type": "Unverifiable", "explanation": "", "start": 367, "end": 445 }, { "error type": "Unverifiable", "explanation": "", "start": 446, "end": 534 }, { "error type": "Unverifiable", "explanation": "", "start": 535, "end": 652 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The San Francisco Giants are an American professional baseball team based in San Francisco, California. The team competes in Major League Baseball (MLB) as a member club of the National League West division. The team was founded in 1883 as the New York Gothams, and renamed three years later the New York Giants, before moving to San Francisco in 1958. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang groovy kind of love in the 60s?", "passages": [ [ "A Groovy Kind of Love", "Jack McGraw, who ran the Screen Gems offices in London, thought the Wine/Bayer-Sager song was a perfect match for the new group The Mindbenders (previously the backing group for Wayne Fontana, who had recently left the band) and especially their guitarist, who now became their new lead vocalist, Eric Stewart.", "The band recorded their version of \"A Groovy Kind of Love\" in 1965.", "They liked the result so much that they included the song on their first album without Fontana, \"The Mindbenders\" (US title \"A Groovy Kind of Love\") and released the song to radio as their debut single.", "It reached No. 2 in the UK the week of January 19\u201326, 1966, and it also reached No. 2 in the United States on the Billboard Hot 100 for two weeks in late May and early June 1966.", "When a Man Loves a Woman by Percy Sledge kept the song from No.!", "The song features a female backing chorus, and they sing the words \"You and me\" and the repeated title towards the end of each verse of the song.", "Eric Stewart went on to co-found the British art pop band, 10cc.", "Phil Collins recorded a new version of \"A Groovy Kind of Love\" in 1988." ], [ "Make Me Your Baby", "Make Me Your Baby\n\n\"Make Me Your Baby\" is a song written by Helen Miller and Roger Atkins which was a hit for Barbara Lewis in 1965.", "The demo for \"Make Me Your Baby\" was cut by journeyman session singer Jean Thomas on 22 January 1965 at the behest of Atlantic Records president Jerry Wexler, who wanted to offer the song to Patti LaBelle and the Bluebelles, then a Cameo-Parkway act Wexler was hoping to woo over to Atlantic.", "Patti Labelle and the Bluebelles did eventually sign to Atlantic, but only after protracted negotiations (their debut label session being on October 7, 1965), which meant \"Make Me Your Baby\" was still unrecorded in the summer of 1965 when the success of \"Baby I'm Yours\" alerted Wexler to the suitability of \"Make Me Your Baby\" as a vehicle for the singer of \"Baby I'm Yours,\" Barbara Lewis.", "\"Make Me Your Baby\" was recorded by Lewis in a July 1, 1965 session at Atlantic Records Recording Studios (NYC) in which Lewis also recorded the B-side \"Love to Be Loved\" and a third track, \"I'm So Afraid.\"" ], [ "The Mindbenders", "The Mindbenders\n\nThe Mindbenders were an English beat group from Manchester, England.", "Originally the backing group for Wayne Fontana, they were one of several acts that were successful in the mid-1960s British Invasion of the US charts, achieving major chart hits with \"Game of Love\" (a number-one single with Fontana) in 1965 and \"A Groovy Kind of Love\" in 1966.", "Wayne Fontana founded the band in 1963 with Bob Lang, Ric Rothwell, and Eric Stewart.", "The group was later joined by Grahame Foote.", "The name of the group was inspired by the title of a 1963 UK feature film, starring the British actor Dirk Bogarde, called \"The Mind Benders\".", "Wayne Fontana & the Mindbenders released a number of singles before recording \"Um Um Um Um Um Um\" in 1964, which was to be their first major hit in Britain and led to a tour with Brenda Lee.", "They also had a No.1 hit in the United States with \"Game of Love\" in 1965 (which also reached No.2 on the UK singles chart).", "After a tour of America and some more singles that were less successful than \"Game of Love\", Fontana left the band in the middle of a concert in 1965.", "Stewart became the lead singer of the band, which henceforward was known simply as the Mindbenders." ] ], "gold": "There were several singers of Groovy Kind of Love in the 60s. American singing duo Diane & Annita sang it on a French EP in 1965, and Patti Labelle and the Bluebelles recorded it on October 7, 1965. English beat group The Mindbenders sang it in 1965 with a female backing chorus.", "prediction 1": "There were several groups that sang A Groovy Kind of Love in the 60s. The Mindbenders were an English beat group from Manchester, England. Originally the backing group for Wayne Fontana, they were one of several acts that were successful in the mid-1960s British Invasion of the US charts, achieving major chart hits with \"Game of Love\" in 1965 and \"A Groovy Kind of Love\" in 1966. The song features a female backing chorus, and they sing the words \"You and me\" and the repeated title towards the end of each verse of the song.\n", "prediction 2": "There were several musicians who sang groovy kind of love in the 60s. The Mindbenders were an English beat group from Manchester, England that originally formed as the backing group for Wayne Fontana. In 1965, Fontana had a No.1 hit in the United States with \"Game of Love.\" Eric Stewart then went on to co-found the British art pop band 10cc. In 1988, Phil Collins recorded a new version of groovy kind of love.", "prediction 3": "A Groovy Kind of Love was sung by different artists in the 60s. The group who sang the song in the 1960s was The Mindbenders, who were originally the backing group for Wayne Fontana. But Fontana left the group in 1965 and Stewart, the lead singer, left the group. And, in 1988, the band 10cc recorded their own version of the song.", "prediction 4": "The 60s saw many singers sing \"A Groovy Kind of Love.\" In the 60s, a number of artists sang the song. In 1965, The Mindbenders, a.k.a. The Beatmen, or Eric Stewart and Bob Lang, sang the song.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 69 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 344 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 528 } ], "missing-info": [], "corrected-prediction": "The Mindbenders sang \"A Groovy Kind of Love\" in 1966 with a female backing chorus." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where is st. jude's hospital located at?", "passages": [ [ "St. Jude Children's Research Hospital", "St. Jude Children's Research Hospital\n\nSt. Jude Children's Research Hospital, founded in 1962, is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers.", "The hospital costs about $2.4 million a day to run, and there is no cost to the patient to be treated.", "It is located in Memphis, Tennessee, and is a nonprofit medical corporation designated as a 501(c)(3) tax-exempt organization by the Internal Revenue Service.", "St. Jude was founded by entertainer Danny Thomas in 1962, with help from Lemuel Diggs and Thomas' close friend from Miami, automobile dealer Anthony Abraham.", "The hospital was founded on the premise that \"no child should die in the dawn of life\".", "This idea resulted from a promise that Thomas, a Maronite Catholic, had made to a saint years before the hospital was founded.", "Thomas was a comedian who was struggling to get a break in his career and living paycheck to paycheck.", "When his first child was about to be born, he attended Mass in Detroit and put his last $7.00 in the offering bin.", "He prayed to St. Jude Thaddeus for a means to provide for his family, and about a week later, he obtained a gig that paid 10 times what he had put in the offering bin." ], [ "St. Jude Medical Center", "St. Jude Medical Center\n\nSt. Jude Medical Center is a faith-based, not-for-profit hospital, located in Fullerton, California, which was established by the Sisters of St. Joseph of Orange in 1957.", "Part of the St. Joseph Health System, St. Jude Medical Center serves as a quaternary and referral center for a variety of patient services, including one of California's only accredited programs in spinal cord injury, brain injury, and comprehensive stroke rehabilitation.", "Other areas of specialty include: high- and low-risk maternity, digestive diseases and GI surgery, orthopedics and joint replacement, neurosciences, women's health, rehabilitation, cardiac care, robotic and minimally-invasive surgery, and cancer care.", "In 2014, the hospital opened the $255 million Northwest Tower, which along with the Southwest Tower built several years earlier, created beautifully-designed, private patient rooms.", "Key areas of expansion included three entire floors dedicated to maternity services and another floor encompassing 14 \"smart\" surgical suites, including a \"hybrid\" cardiovascular suite with robotic c-arm imaging, and a dedicated neurosurgery suite with intraoperative MRI.", "Additional surgical technology includes da Vinci surgical robots as well as the superDimension robotic system for lung cancer treatment." ], [ "Jude the Apostle", "The Church also wanted to encourage veneration of this \"forgotten\" apostle, and maintained that Saint Jude would intercede in any lost cause to prove his sanctity and zeal for Christ.", "Saint Jude is the patron saint of the Chicago Police Department and of Clube de Regatas do Flamengo (a soccer team in Rio de Janeiro, Brazil).", "His other patronages include desperate situations and hospitals.", "One of his namesakes is St. Jude Children's Research Hospital in Memphis, Tennessee, which has helped many children with terminal illnesses and their families since its founding in 1962.", "Many countries venerate the Apostle Jude and have constructed shrines or churches dedicated to his memory.", "Such sites include those in Australia, Brazil, Sri Lanka, Cuba, India, Iran, the Philippines, the United Kingdom, the United States and Lebanon.", "The National Shrine of St. Jude in Chicago, Illinois was founded in 1929 by the Claretian Missionaries.", "The Nationwide Center of St. Jude Devotions in Baltimore was founded in 1917 by the Pallottines.", "The National Shrine of Saint Jude Thaddeus in the Philippines was erected by the Archdiocese of Manila in 1954 as Esp\u00edritu Santo Chinese Parish.", "The Shrine holds the saint's novena liturgy every Thursday, and is now under the Society of the Divine Word that also runs the attached Saint Jude Catholic School." ] ], "gold": "There are several St. Jude's Hospitals. St. Jude Children's Research Hospital, founded in 1962, is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. It is located in Memphis, Tennessee, and is a nonprofit medical corporation designated as a 501(c)(3) tax-exempt organization by the Internal Revenue Service. St. Jude's Midwest affiliate hospital is in Peoria, Illinois. There is also a St. Jude Medical Center, which is a faith-based, not-for-profit hospital, located in Fullerton, California, which was established by the Sisters of St. Joseph of Orange in 1957.", "prediction 1": "The St. Jude Children's Research Hospital is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. It was founded by comedian Danny Thomas in 1962, with help from Lemuel Diggs and Thomas' close friend from Miami, automobile dealer Anthony Abraham. St. Jude Medical Center is a faith-based, not-for-profit hospital, located in Fullerton, California, which was established by the Sisters of St. Joseph of Orange in 1957.", "prediction 2": "St. Jude Children's Research Hospital, founded in 1962, is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. The hospital costs about $2.4 million a day to run, and there is no cost to the patient to be treated. St. Jude Medical Center is a faith-based, not-for-profit hospital, located in Fullerton, California, which was established by the Sisters of St. Joseph of Orange in 1957. St. Jude Children's Research Hospital has helped many children with terminal illnesses and their families since its founding in 1962. Jude Children's Research Hospital has helped many children with terminal illnesses and their families since its founding in 1962.", "prediction 3": "St. Jude Children's Research Hospital is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. The hospital costs about $2.4 million a day to run, and there is no cost to the patient to be treated. The hospital is located in Memphis, Tennessee and is a nonprofit medical corporation designated as a 501(c)(3) tax-exempt organization by the Internal Revenue Service.", "prediction 4": "St. Jude Children's Research Hospital, founded in 1962, is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. The hospital costs about $2.4 million a day to run, and there is no cost to the patient to be treated. It is located in Memphis, Tennessee, and is a nonprofit medical corporation designated as a 501(c)(3) tax-exempt organization by the Internal Revenue Service.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 323 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The St. Jude Children's Research Hospital is a pediatric treatment and research facility focused on children's catastrophic diseases, particularly leukemia and other cancers. It is located in Memphis, Tennessee, and is a nonprofit medical corporation designated as a 501(c)(3) tax-exempt organization by the Internal Revenue Service. St. Jude Medical Center is a faith-based, not-for-profit hospital, located in Fullerton, California, which was established by the Sisters of St. Joseph of Orange in 1957." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who sings never say never with justin bieber?", "passages": [ [ "Never Say Never (Justin Bieber song)", "Never Say Never (Justin Bieber song)\n\n\"Never Say Never\" is a song by Canadian recording artist Justin Bieber.", "The song is used as the theme song for \"The Karate Kid\", and features rap interludes from the film's star, Jaden Smith.", "Originally a risque demo with sexual lyrics performed by American singer Travis Garland, it was written and produced by The Messengers, and Omarr Rambert.", "However, for unknown reasons, Bieber was tapped to record the song for the film.", "He re-wrote the song with The Messengers, Rambert, Smith, and his vocal producer Kuk Harrell, to feature inspirational lyrics to foil the film's theme.", "The song contains R&B and pop elements while merging hip-hop.", "The song was released for digital download in the United States on June 8, 2010.", "The song was later included as an acoustic track on the remix album \"My Worlds Acoustic\" (2010) and both the acoustic and single versions were on the compilation album \"\" (2010).", "To promote Bieber's , the song was released as the lead single and the only single from Bieber's second remix album, \"\"." ], [ "Justin Bieber: Never Say Never", "Justin Bieber:", "Never Say Never\n\nJustin Bieber:", "Never Say Never is a 2011 American 3-D concert film centering on singer Justin Bieber.", "It was released in the United States on February 11, 2011 and grossed $99 million worldwide.", "A sequel was released on December 25, 2013, entitled \"Justin Bieber's Believe\".", "The film follows the pop star Justin Bieber during 10 days counting down to what is considered his biggest performance, that of August 31, 2010 in Madison Square Garden, which sold out in 22 minutes.", "It shows footage of the performances during this period from his My World Tour.", "It shows excited female fans, and several instances of the \"One Less Lonely Girl\" routine of inviting a girl on stage for him to serenade and give flowers to, and of surprising random girls with free tickets to his concerts.", "The main people around Bieber, being like family and good friends to him, are interviewed, but Bieber himself is not.", "Various instances of praying together before a show are shown.", "The film also includes a visit Bieber made to his hometown while being in Canada for the tour.", "He is scolded for having damaged his voice while having fun with his old friends.", "Reluctantly he accepts the postponement of a performance in Syracuse." ], [ "The Karate Kid (2010 film)", "The Karate Kid (2010 film)\n\nThe Karate Kid (known as The Kung Fu Dream in China) is a 2010 family martial arts drama film directed by Harald Zwart, and part of \"The Karate Kid\" series.", "It stars Jaden Smith, Taraji P. Henson and Jackie Chan in lead roles, and it was produced by Jerry Weintraub, James Lassiter, Ken Stovitz and Jaden's parents Will Smith and Jada Pinkett Smith.", "The screenplay by Christopher Murphey was from the story written by Robert Mark Kamen for the original \"The Karate Kid\".", "Unlike the original, this remake is set in China, and features Kung Fu instead of Japanese-Okinawan Karate.", "The film's music was composed by James Horner.", "It is an international co-production between China, Hong Kong, and the United States.", "Principal photography took place in Beijing, China, and filming began in July 2009 and ended on October 16, 2009.", "\"The Karate Kid\" was released theatrically worldwide on June 11, 2010 by Sony Pictures.", "\"The Karate Kid\" received mixed reviews and it earned $359.1 million on a $40 million budget." ] ], "gold": "Justin Bieber's song Never Say Never is used as the theme song for the 2010 film The Karate Kid and features rap interludes from the film's star, Jaden Smith. The 2011 American 3-D concert film entitled Justin Bieber: Never Say Never features singers and rappers such as Sean Kingston and Jessica Jarrell, Iyaz, Boyz II Men, Usher, Miley Cyrus, Ludacris and Jaden Smith.", "prediction 1": "The song \"Never Say Never\" is a song by Canadian recording artist Justin Bieber which is used as the theme song for the movie \"The Karate Kid\". Originally a risque demo with sexual lyrics performed by American singer Travis Garland, it was written and produced by The Messengers, and Omarr Rambert. However, for unknown reasons, Bieber was tapped to record the song for the film. He re-wrote the song with The Messengers, Rambert, Smith, and his vocal producer Kuk Harrell, to feature inspirational lyrics to foil the film's theme.", "prediction 2": "\"Never Say Never\" is a song by Canadian recording artist Justin Bieber. The song is used as the theme song for \"The Karate Kid\", and features rap interludes from the film's star, Jaden Smith. The Messengers, Omarr Rambert, Smith, and his vocal producer Kuk Harrell, re-wrote the song to feature inspirational lyrics to foil the film's theme.", "prediction 3": "Justin Bieber sang Never Say Never in a film and TV show. The song was used as the theme song for The Karate Kid, and features rap interludes from the film's star, Jaden Smith.", "prediction 4": "Never Say Never is a song by Canadian recording artist Justin Bieber. The song is used as the theme song for \"The Karate Kid\" and features rap interludes from the film's star, Jaden Smith. Originally a risque demo with sexual lyrics performed by American singer Travis Garland, it was written and produced by The Messengers, and Omarr Rambert, but for unknown reasons, Bieber was tapped to record the song for the film. He re-wrote the song with The Messengers, Rambert, Smith, and his vocal producer Kuk Harrell, to feature inspirational lyrics to foil the film's theme.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 531 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The song \"Never Say Never\" is a song by Canadian recording artist Justin Bieber which is used as the theme song for the movie \"The Karate Kid\" and features rap interludes from the film's star, Jaden Smith. Never Say Never is a 2011 American 3-D concert film centering on singer Justin Bieber. " }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Who are the candidates running for governor of maine?", "passages": [ [ "2010 Maine gubernatorial election", "2010 Maine gubernatorial election\n\nThe 2010 Maine gubernatorial election took place on November 2, 2010.", "Incumbent Democratic Governor John Baldacci was term-limited and unable to seek re-election.", "Primary elections took place on June 8, 2010.", "The candidates who appeared on the November ballot were (in alphabetical order by last name): Eliot Cutler (Independent), Paul LePage (Republican), Libby Mitchell (Democrat), Shawn Moody (Independent), and Kevin Scott (Independent).", "With 94% of precincts reporting on the day after the election, the \"Bangor Daily News\" declared LePage the winner, carrying 38.1% of the votes.", "Cutler was in second place with 36.7% of the votes (less than 7,500 votes behind LePage), while Mitchell was a distant third with 19%.", "Moody and Scott had 5% and 1%, respectively.", "Two days after the election, with 99% of precincts reporting, LePage's lead over Cutler had widened to more than 10,000 votes.", "At 11:32\u00a0p.m. EDT, WCSH declared Libby Mitchell the winner of the Democratic primary.", "At 11:19\u00a0p.m. EDT, WCSH declared Paul LePage the winner of the GOP primary." ], [ "2014 Maine gubernatorial election", "2014 Maine gubernatorial election\n\nThe 2014 Maine gubernatorial election took place on November 4, 2014, to elect the Governor of Maine.", "Incumbent Republican Governor Paul LePage ran for re-election to a second term in office, against sitting congressman from the second district, Mike Michaud, and second-place finisher from the 2010 gubernatorial election, attorney Eliot Cutler.", "The primary elections were held on June 10, 2014.", "LePage was initially considered vulnerable in this race, due to persistent approval ratings below 50%.", "The consensus among \"The Cook Political Report\", \"Governing\" and \"The Rothenberg Political Report\" was that the race was a \"tossup\" and \"Daily Kos Elections\" and \"Sabato's Crystal Ball\" rated the race as \"lean Democratic\".", "At 12:04 AM on November 5, the Bangor Daily News declared that Paul LePage had won re-election to a second term.", "After a close three-way election in 2010, Republican Paul LePage, the Mayor of Waterville, was elected Governor with 38% of the vote.", "He beat Independent candidate Eliot Cutler, who won 36%, and Democrat Libby Mitchell, the President of the Maine Senate, who won 19%.", "Republican gubernatorial nominees in Maine have failed to win a majority of the vote in 12 consecutive cycles over the last 50+ years \u2013 the longest such GOP streak in the nation." ], [ "2018 Maine gubernatorial election", "The Democratic candidate was Attorney General Janet Mills.", "State Treasurer Terry Hayes and businessman Alan Caron had qualified for the ballot as independents, though Caron dropped out on October 29 and endorsed Mills.", "Former State Senator and former mayor of Lewiston and Auburn John Jenkins and perennial candidate Kenneth Capron ran write-in campaigns.", "Mills defeated Moody and Hayes to become the first female Governor of Maine.", "She also became the first gubernatorial candidate to win at least 50% of the vote since Angus King in 1998, and the first non-incumbent to do so since Kenneth M. Curtis in 1966.", "Mills also became the first Maine gubernatorial candidate to earn 300,000 votes.", "Incumbent Republican Paul LePage is term-limited, having been elected twice consecutively in 2010 and 2014.", "LePage did not win a majority of the vote either time (receiving 37.6% in a crowded four-way race in 2010 and 48.2% in a three-way race in 2014), with Democrats accusing independent candidate Eliot Cutler of splitting the anti-LePage vote in both instances, though Cutler finished closer to LePage than Democratic candidate Libby Mitchell in the 2010 election.", "Maine's history of governors elected without majorities, including LePage, was one impetus for the citizen's referendum to implement ranked choice voting." ] ], "gold": "Candidates confirmed for the 2022 Maine gubernatorial election include Democratic incumbent governor Janet Mills, Republican former governor Paul LePage, and Independent activist Michael Heath. The 2018 gubernatorial election featured candidates Janet Mills, Shawn Moody, Terry Hayes and Alan Caron, while the 2014 election featured candidates Eliot Cutler, Mike Michaud, and Paul LePage, the 2010 election featured candidates Kevin Scott, Libby Mitchell, Eliot Cutler, Shawn Moody, and Paul LePage, and the 2006 election featured candidates Barbara Merrill, Phillip Morris Napier, Pat LaMarche, Chandler Woodcock, and John Baldacci.", "prediction 1": "Maine has had several election for governor. In 2010, John Baldacci was elected as governor and was term-limited, so the candidates running for governor were: Eliot Cutler, Paul LePage, Libby Mitchell, Shawn Moody, Kevin Scott, and Mike Michaud. In 2014, Republican Governor Paul LePage ran for re-election to a second term in office, against sitting congressman Mike Michaud and second-place finisher from the 2010 gubernatorial election, Eliot Cutler, and Democrat Libby Mitchell, with 36% of the vote.", "prediction 2": "The 2010 Maine gubernatorial election took place on November 2, 2010. The candidates who appeared on the November ballot were (in alphabetical order by last name): Eliot Cutler (Independent), Paul LePage (Republican), Libby Mitchell (Democrat), Shawn Moody (Independent), Kevin Scott (Independent).", "prediction 3": "The 2010 Maine gubernatorial election took place on November 2, 2010. The candidates appearing on the November ballot were: Eliot Cutler, Paul LePage, Libby Mitchell, Shawn Moody, Kevin Scott and Kenneth Capron. The 2014 Maine gubernatorial election took place on November 4, 2014, to elect the Governor of Maine.", "prediction 4": "The 2010 Maine gubernatorial election took place on November 2, 2010. The candidates who appeared on the November ballot were (in alphabetical order by last name): Eliot Cutler (Independent), Paul LePage (Republican), Libby Mitchell (Democrat), Shawn Moody (Independent), and Kevin Scott (Independent). In the 2014 Maine gubernatorial election took place on November 4, 2014, to elect the Governor of Maine.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 68, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 439 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 483, "end": 504 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7,8]}", "start": 458, "end": 482 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 2, 3 ] } ], "corrected-prediction": "Maine has had several election for governor. In 2010, the candidates running for governor were: Eliot Cutler, Paul LePage, Libby Mitchell, Shawn Moody, Kevin Scott, and Mike Michaud. In 2014, Republican Governor Paul LePage ran against Mike Michaud and Eliot Cutler. 2018 Maine gubernatorial election had janet Mills, Terry Hayes, Alan Caron, John Jenkins and Kenneth Capron running. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What is lo mein noodles made out of?", "passages": [ [ "Lo mein", "Lo mein\n\nLo mein () is a Chinese dish with egg noodles.", "It often contains vegetables and some type of meat or seafood, usually beef, chicken, pork, shrimp or wontons.", "It can also be eaten with just vegetables.", "Traditionally this is a dry variation of wonton noodle soup.", "The soup is simply separated from the noodles and other ingredients, and served on the side.", "The term \"lo mein\" comes from the Cantonese \"lou1 min6\" (\u6488\u9eb5), meaning \"stirred noodles\".", "The Cantonese usage of the character \u6488, pronounced \"lou1\" and meaning \"to stir\", differs from the character's usual meaning of \"to dredge\" or \"to scoop out of water\" in Mandarin, in which case it would be pronounced as \"laau4\" or \"lou4\" in Cantonese (\"l\u0101o\" in Mandarin).", "In Mandarin, the dish is called \"l\u0101o mi\u00e0n\".", "In its country of origin, it is made of thin flour and egg noodles which are notable for their elastic texture.", "In American Chinese restaurants, lo mein is a popular take-out food and is sometimes considered synonymous with chow mein.", "The dish is distinct from both Cantonese lo mein and Cantonese crispy chow mein.", "Cantonese lo mein is stirred with a thin sauce and items such as wonton or beef brisket added on top." ], [ "Yi mein", "Yi mein\n\nYi mein () is a variety of flat Cantonese egg noodles made from wheat flour.", "They are known for their golden yellow color and chewy characteristics.", "The slightly chewy and slightly spongy texture of the noodles is due to the soda water used in making the dough (as opposed to regular non-carbonated water), which is then fried and dried into flat patty-like dried bricks.", "The Yi mein noodles available at grocery stores were pre-cooked by machines the same way as the modern instant noodles are made.", "The noodles may be cooked a number of ways.", "They are boiled first, then can be stir fried, or used in soups or salads.", "Good noodles maintain their elasticity, allowing the noodles to stretch and remain chewy.", "\"Yi mein\" noodles can be consumed directly or used in various dishes:\n\n\nWhen Yi mein is consumed on birthdays, it is generally referred to as Longevity noodles or Sau mein (\u58fd\u9eb5/\u5bff\u9762).", "The Chinese character for \"long\" (\u9577\u58fd\u9eb5/\u957f\u5bff\u9762) is also added as a prefix to represent \"long life\".", "Usually it is consumed with longevity buns during birthday celebrations." ] ], "gold": "The noodles most commonly used in the Chinese dish lo mein are made of thin wheat flour and egg noodles, which are notable for their elastic texture. The dish often combines the noodles with vegetables and some type of meat or seafood.", "prediction 1": "Lo mein noodles are made of thin flour and egg noodles, which are notable for their elastic texture. In its country of origin, it is made of egg noodles, which are slightly chewy and slightly spongy due to the soda water used in making the dough, which is then fried and dried into flat patty-like dried bricks.", "prediction 2": "Lo mein is a Chinese dish with egg noodles. It often contains vegetables and some type of meat or seafood, usually beef, chicken, pork, shrimp or wontons. It can also be eaten with just vegetables. In China, it is made of thin flour and egg noodles which are notable for their elastic texture. In the United States, it is a popular take-out food and is sometimes considered synonymous with chow mein. Yi mein noodles are a variety of flat Cantonese egg noodles made from wheat flour. They are known for their golden yellow color and chewy characteristics.", "prediction 3": "Lo mein, in Chinese, is a dish with egg noodles which is often accompanied by vegetables and some type of meat or seafood, usually beef, chicken, pork, shrimp or wontons. Traditionally this is a dry variation of wonton noodle soup. In its country of origin, it is made of thin flour and egg noodles which are notable for their elastic texture. Yi mein, in Cantonese, is a variety of flat Cantonese egg noodles made from wheat flour.", "prediction 4": "Lo mein is a Chinese dish with egg noodles. It often contains vegetables and some type of meat or seafood, usually beef, chicken, pork, shrimp or wontons. Traditionally this is a dry variation of wonton noodle soup. The term \"lo mein\" comes from the Cantonese \"lou1 min6\" (), meaning \"stirred noodles\". In its country of origin, it is made of thin flour and egg noodles which are notable for their elastic texture.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 311 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lo mein noodles are made of thin flour and egg noodles, which are notable for their elastic texture. It often contains vegetables and some type of meat or seafood." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where does the savannah river begin and end?", "passages": [ [ "Savannah River", "Savannah River\n\nThe Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia.", "Two tributaries of the Savannah, the Tugaloo River and the Chattooga River, form the northernmost part of the border.", "The Savannah River drainage basin extends into the southeastern side of the Appalachian Mountains just inside North Carolina, bounded by the Eastern Continental Divide.", "The river is around long.", "It is formed by the confluence of the Tugaloo River and the Seneca River.", "Today this confluence is submerged beneath Lake Hartwell.", "The Tallulah Gorge is located on the Tallulah River, a tributary of the Tugaloo River that forms the northwest branch of the Savannah River.", "Two major cities are located along the Savannah River: Savannah, and Augusta, Georgia.", "They were nuclei of early English settlements during the Colonial period of American history.", "The Savannah River is tidal at Savannah proper.", "Downstream from there, the river broadens into an estuary before flowing into the Atlantic Ocean.", "The area where the river's estuary meets the ocean is known as \"Tybee Roads\".", "The Intracoastal Waterway flows through a section of the Savannah River near the city of Savannah.", "The name \"Savannah\" comes from a group of Shawnee who migrated to the Piedmont region in the 1680s." ] ], "gold": "The Savannah River begins at the confluence of the Tugaloo River and the Seneca River beneath Lake Hartwell and flows for 301 miles through the southeastern United States, forming most of the border between South Carolina and Georgia. The river ends in an area known as \"Tybee Roads\", where it broadens into an estuary before flowing into the Atlantic Ocean.", "prediction 1": "The Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia. The river begins in the city of Savannah and ends in the city of Augusta.", "prediction 2": "The Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia. Two tributaries of the Savannah, the Tugaloo River and the Chattooga River, form the northernmost part of the border. It is formed by the confluence of the Tugaloo River and the Seneca River. The Tallulah Gorge is located on the Tallulah River, a tributary of the Tugaloo River that forms the Northwest Branch of the Savannah River.", "prediction 3": "The Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia. It is formed by the confluence of the Tugaloo River and the Seneca River, which is today submerged beneath Lake Hartwell. The Tallulah Gorge is located on the Tallulah River, a tributary of the Tugaloo River that forms the northwest branch of the Savannah River.", "prediction 4": "The Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia. Two tributaries of the Savannah, the Tugaloo River and the Chattooga River, form the northernmost part of the border.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 221 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 12 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Savannah River is a major river in the southeastern United States, forming most of the border between the states of South Carolina and Georgia. It is formed by the confluence of the Tugaloo River and the Seneca River. Today this confluence is submerged beneath Lake Hartwell. Downstream from there, the river broadens into an estuary before flowing into the Atlantic Ocean. The area where the river's estuary meets the ocean is known as \"Tybee Roads\"." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "When did they put gates on downing street?", "passages": [ [ "Downing Street", "Barriers were erected at the St James's Park end of the street for the unveiling of the Cenotaph on 11 November 1920.", "They were a public safety measure intended to prevent the crowds in Whitehall becoming too dense.", "When the movement for Irish independence became increasingly violent, it was decided to retain the barriers, which were raised and strengthened.", "On 26 November 1920 construction commenced on a wooden barricade, high at the end of the street.", "They were described as being of a \"substantial character\" mounted on proper foundations and incorporated vehicle gates.", "The barriers were taken down in 1922 when the Irish Free State was created.", "Vehicle access was curtailed in 1973 when metal barriers were placed across the entrance to the street.", "In 1974, the Metropolitan Police proposed erecting a semi-permanent barrier between the pavement and carriageway on the Foreign Office side to keep pedestrians off the main part of the street.", "The proposal came with assurances that tourists would still be permitted to take photographs at the door of Number 10.", "The Prime Minister, Harold Wilson, rejected the proposal, feeling that it would appear to be an unacceptable restriction of the freedom of the public.", "Wilson's private secretary wrote \"I much regret this further erosion of the Englishman's right to wander at will in Downing Street.\"", "In 1982 access was further restricted by railings and a demountable gate." ], [ "Downing Street", "They were replaced by black steel gates in 1989.", "The increase in security was due to an increase in violence, particularly by the IRA during The Troubles.", "The Thatcher ministry was particularly moved to increase security after the 1979 assassination of Lord Mountbatten.", "The public right of way along Downing Street has not been extinguished nor subject to a gating order and the road retains the status of a public highway maintained by Westminster City Council.", "Public access was curtailed by relying on common law powers to prevent breach of the peace (although its legality has been questioned by a correspondent for \"New Statesman\" magazine).", "In 2005, Westminster City Council used anti-terrorism powers contained in the Civil Contingencies Act 2004 to formalise the restrictions by means of a traffic management order.", "This by implication results in Downing Street being inaccesible to the general public as admittance is only granted by the Police to scheduled visitors, Parliamentary pass holders and members of the accredited press.", "Although the Downing Street government buildings and grounds are a designated site under the Serious Organised Crime and Police Act 2005 for criminal trespass, the street was not included in the boundaries of the designated area.", "Since 1989, entering Downing Street has required passing through a security checkpoint.", "The street is patrolled by armed police from the Diplomatic Protection Group, and there is usually at least one police officer outside the front door of Number 10." ], [ "Plebgate", "Plebgate\n\nThe \"Plebgate\" (or \"Plodgate\", \"Gategate\") scandal in the United Kingdom concerns an altercation between Conservative MP Andrew Mitchell, the Government Chief Whip at the time (who later resigned because of the incident), and the police, which took place on 19 September 2012.", "It gained notoriety initially for the conduct claimed of Mitchell and again two months later when, subsequent to Mitchell's resignation, CCTV and other evidence was revealed which appeared to call into question some of the evidence against Mitchell.", "Leaked police logs, later apparently backed up by eyewitness evidence, suggested that Mitchell had sworn at police officers on duty at Downing Street and called them \"plebs\" (a pejorative word signifying someone of low social class) when they refused to open the main gate for him as he attempted to leave with his bicycle.", "Mitchell apologised but denied using the words claimed and in particular calling police officers \"plebs\".", "However, finding his position untenable amid the media storm surrounding the incident, he resigned from office a month later." ] ], "gold": "Over the course of history, several security measures have been taken on Downing Street. Barriers were erected at the St James's Park end of Downing Street for the unveiling of the Cenotaph on 11 November 1920. These barriers were a public safety measure intended to prevent the crowds in Whitehall from becoming too dense. Then, when the movement for Irish independence became increasingly violent, it was decided to retain the barriers, which were raised and strengthened. Additionally, on 26 November 1920 construction commenced on a wooden barricade, high at the end of Downing Street. This wooden barricade was described as being of a \"substantial character\" since it was mounted on proper foundations and incorporated vehicle gates. These barriers were then taken down in 1922 when the Irish Free State was created. Later, in 1973, vehicle access on Downing Street was curtailed when metal barriers were placed across the entrance to the street. Then, in 1974, the Metropolitan Police proposed erecting a semi-permanent barrier between the pavement and carriageway on the Foreign Office side to keep pedestrians off the main part of Downing Street. The proposal came with assurances that tourists would still be permitted to take photographs at the door of Number 10. The Prime Minister, Harold Wilson, rejected the proposal, feeling that it would appear to be an unacceptable restriction of the freedom of the public. Wilson's private secretary wrote, \"I much regret this further erosion of the Englishman's right to wander at will in Downing Street.\" Then, in 1982, access to Downing Street was further restricted by railings and a demountable gate. Then, in 1989, these were replaced by black steel gates. This increase in security was due to an increase in violence, particularly by the IRA during The Troubles. The Thatcher ministry was moved to increase security after the 1979 assassination of Lord Mountbatten. In September 2012, access through these gates led to a political scandal known as Plebgate, or Gategate. The trigger was an altercation between Conservative Chief Whip Andrew Mitchell, and the police officers on duty at these gates. Mitchell had to resign as the Government Chief Whip because of the incident.", "prediction 1": "The entrance to Downing Street was first covered in barriers on 11 November 1920, as a public safety measure, and then on 26 November 1920 construction commenced on a wooden barricade, high at the end of the street. On 26 November 1920 construction commenced on a wooden barricade, high at the end of the street. They were described as being of a \"substantial character\", mounted on proper foundations and incorporated vehicle gates. The increase in security was due to an increase in violence, particularly by the IRA during The Troubles.", "prediction 2": "On 11 November 1920 barriers were erected at the St James' Park end of the street for the unveiling of the Cenotaph. They were a public safety measure intended to prevent the crowds in Whitehall becoming too dense. When the movement for Irish independence became increasingly violent, it was decided to retain the barriers, which were raised and strengthened. They were replaced by black steel gates in 1989.", "prediction 3": "Downing Street is a British residential street in London. It is a public highway maintained by Westminster City Council. The first gates were erected on November 26, 1920, at the St James's Park end of the street, for the unveiling of the Cenotaph. The barriers were taken down in 1922 when the Irish Free State was created. In 1973, the Metropolitan Police proposed erecting a semi-permanent barrier between the pavement and carriageway on the Foreign Office side to keep pedestrians off the main part of the street. In 1982, access was further restricted by railings and a demountable gate.", "prediction 4": "Barriers were erected at the St James's Park end of the street for the unveiling of the Cenotaph on 11 November 1920. They were a public safety measure intended to prevent the crowds in Whitehall becoming too dense. When the movement for Irish independence became increasingly violent, it was decided to retain the barriers, which were raised and strengthened. On 26 November 1920 construction commenced on a wooden barricade, high at the end of the street. They were described as being of a \"substantial character\" mounted on proper foundations and incorporated vehicle gates. They were replaced by black steel gates in 1989. The increase in security was due to an increase in violence, particularly by the IRA during The Troubles.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The entrance to Downing Street was first covered in barriers on 11 November 1920, as a public safety measure, and then on 26 November 1920 construction commenced on a wooden barricade, high at the end of the street. ", "start": 216, "end": 312 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] } ], "corrected-prediction": "The entrance to Downing Street was first covered in barriers on 11 November 1920, as a public safety measure, and then on 26 November 1920 construction commenced on a wooden barricade, high at the end of the street. They were described as being of a \"substantial character\", mounted on proper foundations and incorporated vehicle gates. The barriers were taken down in 1922 when the Irish Free State was created. Vehicle access was curtailed in 1973 when metal barriers were placed across the entrance to the street. In 1974, the Metropolitan Police proposed erecting a semi-permanent barrier between the pavement and carriageway on the Foreign Office side to keep pedestrians off the main part of the street. In 1982 access was further restricted by railings and a demountable gate. The increase in security was due to an increase in violence, particularly by the IRA during The Troubles." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Which person or group brought polyphonic music into the christian church?", "passages": [ [ "Polyphony", "According to the Evolutionary Model, the origins of polyphonic singing are much deeper, and are connected to the earlier stages of human evolution; polyphony was an important part of a defence system of the hominids, and traditions of polyphony are gradually disappearing all over the world.", "Although the exact origins of polyphony in the Western church traditions are unknown, the treatises \"Musica enchiriadis\" and \"Scolica enchiriadis\", both dating from \"c\".", "900, are usually considered the oldest extant written examples of polyphony.", "These treatises provided examples of two-voice note-against-note embellishments of chants using parallel octaves, fifths, and fourths.", "Rather than being fixed works, they indicated ways of improvising polyphony during performance.", "The \"Winchester Troper\", from \"c\". 1000, is the oldest extant example of notated polyphony for chant performance, although the notation does not indicate precise pitch levels or durations.", "European polyphony rose out of melismatic organum, the earliest harmonization of the chant.", "Twelfth-century composers, such as L\u00e9onin and P\u00e9rotin developed the organum that was introduced centuries earlier, and also added a third and fourth voice to the now homophonic chant." ], [ "Polyphony", "The oldest extant polyphonic setting of the mass attributable to one composer is Guillaume de Machaut's Messe de Nostre Dame, dated to 1364, during the pontificate of Pope Urban V.\n\nMore recently, the Second Vatican Council (1962\u20131965) stated: \"Gregorian chant, other things being equal, should be given pride of place in liturgical services.", "But other kinds of sacred music, especially polyphony, are by no means excluded...", "Religious singing by the people is to be skillfully fostered, so that in devotions and sacred exercises, as also during liturgical services, the voices of the faithful may ring out\u201d.", "English Protestant west gallery music included polyphonic multi-melodic harmony, including fuguing tunes, by the mid-18th century.", "This tradition passed with emigrants to North America, where it was proliferated in tunebooks, including shape-note books like \"The Southern Harmony\" and \"The Sacred Harp\".", "While this style of singing has largely disappeared from British and North American sacred music, it survived in the rural Southern United States, until it again began to grow a following throughout the United States and even in places such as Ireland, the United Kingdom, Poland, Australia and New Zealand, among others.", "Polyphonic singing in the Balkans is traditional folk singing of this part of southern Europe." ], [ "Musica enchiriadis", "Musica enchiriadis\n\nMusica enchiriadis is an anonymous musical treatise of the 9th century.", "It is the first surviving attempt to set up a system of rules for polyphony in western art music.", "The treatise was once attributed to Hucbald, but this is no longer accepted.", "Some historians once attributed it to Odo of Cluny (879-942).", "It has also been attributed to Abbot Hoger (d. 906).", "This music theory treatise, along with its companion text, \"Scolica enchiriadis\", was widely circulated in medieval manuscripts, often in association with Boethius' \"De institutione musica\".", "It consists of nineteen chapters; the first nine are devoted to notation, modes, and monophonic plainchant.", "Chapters 10-18 deal with polyphonic music.", "The author here shows how consonant intervals should be used to compose or improvise the type of early-medieval polyphonic music called organum, an early style of note-against-note polyphony several examples of which are included in the treatise.", "(\"Scolica enchiriadis\" also observes that some melodies should be sung \"more quickly\" (\"celerius\"), others \"more slowly\" (\"morosius\").)" ] ], "gold": "The exact origins of polyphony in the Western church traditions are unknown, in part because the oldest extant written examples of polyphony were composed anonymously. However, the first instance of polyphonic church music attributed to a single named composer occurred when Guillaume de Machaut wrote Messe de Nostre Dame in 1364, during the pontificate of Pope Urban V.", "prediction 1": "The first known attempt to set up rules for polyphony in western art music is the Musica enchiriadis, an anonymous musical treatise of the 9th century. It is the first surviving attempt to set up a system of rules for polyphony in western art music. The music theory treatise, Scolica enchiriadis, is widely circulated in medieval manuscripts, often in association with Boethius' De institutione musica. Abbot Hoger is credited with introducing polyphonic music into the christian church music into the christian church. The oldest extant polyphony attributable to one composer is Guillaume de Machaut's Messe de Nostre Dame, dated to 1364, during the pontificate of Pope Urban V.", "prediction 2": "Musica enchiriadis is an anonymous musical treatise of the 9th century that is considered to be the first surviving attempt to set up a system of rules for polyphony in western art music. It is also credited to Abbot Hoger, who wrote the music theory treatise Scolica enchiriadis, which was widely circulated in medieval manuscripts, often in association with Boethius' De institutione musica. These treatises provided examples of two-voice note-against-note embellishments of chants using parallel oct-note embellishments of chants using parallel octaves, fifths, and fourths.", "prediction 3": "In the 9th century, an anonymous musical treatise, Musica enchiriadis, was published to set up a system of rules for polyphony in western art music. It is considered the first surviving attempt to set up a system of rules for polyphony in western art music. The oldest extant polyphonic setting of the mass attributable to one composer is Guillaume de Machaut's Messe de Nostre Dame, dated to 1364, during the pontificate of Pope Urban V.", "prediction 4": "Musica enchiriadis is an anonymous musical treatise of the 9th century, which is considered to be the first surviving attempt to set up a system of rules for polyphony in western art music. It is the first surviving attempt to set up a system of rules for polyphony in western art music. The treatise, along with its companion text, Scolica enchiriadis, was widely circulated in medieval manuscripts, often in association with Boethius' De institutione musica.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 403 }, { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 520 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The exact origins of polyphony in the Western church traditions are unknown. The first known attempt to set up rules for polyphony in western art music is the Musica enchiriadis, an anonymous musical treatise of the 9th century. The oldest extant polyphony attributable to one composer is Guillaume de Machaut's Messe de Nostre Dame, dated to 1364, during the pontificate of Pope Urban V." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "What war was the movie the patriot based on?", "passages": [ [ "The Patriot (2000 film)", "The Patriot (2000 film)\n\n", "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs.", "The film mainly takes place in rural Berkeley County, South Carolina, and depicts the story of an American Colonist, nominally loyal to the British Crown, who is swept into the American Revolutionary War when his family is threatened.", "Benjamin Martin is a composite figure the scriptwriter claims is based on four factual figures from the American Revolutionary War: Andrew Pickens, Francis Marion, Daniel Morgan, and Thomas Sumter.", "The film takes place during the events of the Southern theater of the American Revolutionary War but attracted controversy over its fictional portrayal of historical British figures and atrocities.", "Professor Mark Glancy, teacher of film history at Queen Mary, University of London has said: \"It's horrendously inaccurate and attributes crimes committed by the Nazis in the 1940s to the British in the 1770s.\"", "While it is clear that the actions of then-Colonel Banastre Tarleton were certainly despicable, they were nowhere near the atrocities in the film, especially with the infamous \"Burning church\" scene, of which there is no historical or written record." ], [ "The Patriot (1998 film)", "The Patriot (1998 film)\n\nThe Patriot is a 1998 American action drama film loosely based on the novel \"The Last Canadian\" by William C. Heine.", "The film stars Steven Seagal and is directed by Dean Semler.", "The plot involves an American patriot who has to foil the plot of a militia to release a deadly virus.", "It is Seagal's first direct-to-video film.", "Near the town of Ennis, Montana, local doctor and former government research immunologist Wesley McClaren (Steven Seagal) who has an interest in herbal medicine and is also a weapons and self-defense expert, is called to a hospital when people start dying from an unknown but very deadly disease.", "He determines that the cause is a highly dangerous airborne virus and calls in a Biological Response team, who seal off the town while doctors start treating sufferers with a vaccine.", "Unfortunately for them, several have already died.", "The source of the virus is traced to a local self-styled rebel militia leader, Floyd Chisholm (Gailard Sartain), who has given himself up after a long siege and has been arrested on weapons charges.", "In court, having ingested the virus himself (believing that he also possesses the vaccine) he spits at the judge, and starts the rapid spread of the disease." ], [ "The Last Canadian", "The Last Canadian\n\nThe Last Canadian is a 1974 science fiction novel by William C. Heine about the adventures of Eugene Arnprior after North America is devastated by a plague.", "The U.S. release of the novel was titled Death Wind.", "A 1970s Cold War apocalyptic story where Eugene Arnprior, an engineer living in Montreal, who after learning of a fast spreading airborne virus (released by the Soviets) in the American Rockies moves his wife and two sons to an isolated cabin in Northern Quebec.", "Arnprior\u2019s family is wiped out when a virus carrier nears their camp - Arnprior is immune but also carries the virus now.", "The story continues as he travels the dead cities and meets various groups of survivors on the east coast of America and makes contact with a US destroyer off the coast of Florida which is being followed by an eavesdropping Soviet submarine.", "Though the 1998 movie \"The Patriot\" is credited as an adaptation of William C. Heine's novel \"The Last Canadian\", it shares virtually no similarities with the novel except the idea of a deadly virus.", "No character names, events, or even locations appear in both the book and the film.", "Eugene Arnprior had just received in the mail a notice of his Canadian citizenship when the plague struck.", "Therefore, he considered himself \"The Last Canadian\"." ] ], "gold": "The 2000 film The Patriot, starring Mel Gibson, Chris Cooper, Heath Ledger and Jason Isaacs, is based on the American Revolutionary War. The 1998 film The Patriot is an action thriller film that stars Steven Segal. This film is loosely based on the novel The Last Canadian by William C. Heine. This novel is a 1970s Cold War apocalyptic story about Eugene Arnprior. Arnprior is an engineer who lives in Montreal. However, after learning of a fast spreading airborne virus, he moves his wife and two sons to an isolated cabin in Northern Quebec.", "prediction 1": "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs. The Patriot is loosely based on the 1974 science fiction novel The Last Canadian by William C. Heine. The 1998 American action drama film The Patriot stars Steven Seagal and is directed by Dean Semler. The movie shares virtually no similarities with the novel except the idea of a deadly virus.", "prediction 2": "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs. The Patriot is loosely based on the 1974 science fiction novel The Last Canadian by William C. Heine. The 1998 American action drama film The Patriot stars Steven Seagal and is directed by Dean Semler. The plot involves an American patriot who has to foil the plot of a militia to release a deadly virus. While the 1998 American action drama movie The Patriot is loosely based on the novel The Last Canadian by William C. Heine. Heine, The Patriot is a 1998 American action thriller film loosely based on the 1970s Cold War apocalyptic story where Eugene Arnprior after North America is devastated by a plague.", "prediction 3": "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs. The Patriot is also the title of a 1998 American action drama film loosely based on the 1974 science fiction novel The Last Canadian by William C. Heine. Though the 1998 movie The Patriot is credited as an adaptation of William C. Heine's novel The Last Canadian, it shares virtually no similarities with the novel except the idea of a deadly virus.", "prediction 4": "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs. The Patriot is also a 1998 American action drama film loosely based on the 1974 novel The Last Canadian by William C. Heine. The film stars Steven Seagal and is directed by Dean Semler. Though the 1998 movie The Patriot is credited as an adaptation of William C. Heine's novel, it shares virtually no similarities with the novel except the idea of a deadly virus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 391, "end": 483 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 390 }, { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 117 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Patriot is a 2000 American epic historical fiction war film starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs, is based on the American Revolutionary War. The 1998 film The Patriot is an action thriller film that stars Steven Segal. The Patriot is loosely based on the 1974 science fiction novel The Last Canadian by William C. Heine. A 1970s Cold War apocalyptic story where Eugene Arnprior, an engineer living in Montreal, who after learning of a fast spreading airborne virus (released by the Soviets) in the American Rockies moves his wife and two sons to an isolated cabin in Northern Quebec." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "How many seasons are there for walker texas ranger?", "passages": [ [ "Walker, Texas Ranger", "Walker, Texas Ranger\n\nWalker, Texas Ranger is an American action crime television series created by Leslie Greif and Paul Haggis.", "It was inspired by the film \"Lone Wolf McQuade\", with both this series and that film starring Chuck Norris as a member of the Texas Ranger Division.", "The show aired on CBS in the spring of 1993, with the first season consisting of three pilot episodes.", "Eight full seasons followed with new episodes airing from September 25, 1993, to May 19, 2001, and reruns continuing on CBS until July 28, 2001.", "It has been broadcast in over 100 countries and has since spawned a 2005 made-for-television movie entitled \"\".", "The movie ended on a cliffhanger, which was never resolved.", "DVD sets of all seasons have been released (with the three pilots packaged with the first regular season).", "At various times since 1997, reruns of the show have aired, in syndication, on the USA Network and Action in Canada.", "Reruns can currently be seen on CBS Action, WGN America, INSP and Grit and One, being part of Network Ten in Australia.", "The series was noted for its moralistic style.", "The characters refrained from the use of drugs, and they participated in community service." ] ], "gold": "American action crime TV series Walker, Texas Ranger ran for eight full seasons airing from April 21 1993 to May 19, 2001, in addition to one partial season comprised of three pilot episodes airing in the spring of 1993.", "prediction 1": "Walker, Texas Ranger is an American action crime television series created by Leslie Greif and Paul Haggis. It was inspired by the film \"Lone Wolf McQuade\", with both this series and that film starring Chuck Norris as a member of the Texas Ranger Division. The first season was three pilot episodes and there were 8 full seasons. New episodes were airing from September 25, 1993, to May 19, 2001, and reruns continued on CBS until July 28, 2001.", "prediction 2": "Walker, Texas Ranger is an American action crime television series created by Leslie Greif and Paul Haggis. It was inspired by the film \"Lone Wolf McQuade\", with both this series and that film starring Chuck Norris as a member of the Texas Ranger Division. Eight full seasons followed with new episodes airing from September 25, 1993, to May 19, 2001, and reruns continuing on CBS until July 28, 2001.", "prediction 3": "Walker, Texas Ranger is an American action crime television series created by Leslie Greif and Paul Haggis. It was inspired by the film Lone Wolf McQuade, with both this series and that film starring Chuck Norris as a member of the Texas Ranger Division. Eight full seasons followed with new episodes airing from September 25, 1993, to May 19, 2001, and reruns continuing on CBS until July 28, 2001. DVD sets of all seasons have been released.", "prediction 4": "Walker, Texas Ranger is an American action crime television series created by Leslie Greif and Paul Haggis. The show aired on CBS in the spring of 1993, with the first season consisting of three pilot episodes. Eight full seasons followed with new episodes airing from September 25, 1993, to May 19, 2001, and reruns continuing on CBS until July 28, 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 256 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Walker, Texas Ranger is an American action crime television series. The show aired on CBS in the spring of 1993, with first season was three pilot episodes and there were 8 full seasons. New episodes were airing from September 25, 1993, to May 19, 2001, and reruns continued on CBS until July 28, 2001." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What was the former name of st petersburg russia?", "passages": [ [ "Saint Petersburg", "In the 1830s Alexander Pushkin translated the \"foreign\" city name of \"Saint Petersburg\" to the more Russian \"Petrograd\" in one of his poems.", "However, it was only on , after the war with Germany had begun, that tsar Nicholas II renamed the capital to Petrograd.", "Since the prefix 'Saint' was omitted, this act also changed the eponym and the \"patron\" of the city, from Apostle Peter to Peter the Great, its founder.", "After the October Revolution the name \"Red Petrograd\" (\"\u041a\u0440\u0430\u0441\u043d\u044b\u0439 \u041f\u0435\u0442\u0440\u043e\u0433\u0440\u0430\u0434\") was often used in newspapers and other prints until the city was renamed \"Leningrad\" in January 1924.", "A referendum on reversing the renaming of \"Leningrad\" was held on 12 June 1991, with 54.86% of voters (with a turnout of 65%) supporting \"\"Saint Petersburg\"\".", "Renaming the city \"Petrograd\" was not an option.", "This change officially took effect on 6 September 1991.", "Meanwhile, the oblast whose administrative center is also in Saint Petersburg is still named Leningrad.", "Having passed the role of capital to Petersburg, Moscow never relinquished the title of \"capital\", being called \"pervoprestolnaya\" (\"first-throned\") for 200 years." ], [ "Saint Petersburg", "An admirer of everything German, Peter the Great originally named the city, Sankt-Peterburg (; note that the Russian name lacks the letter \"s\" between \"Peter\" and \"burg\").", "On 1 September 1914, after the outbreak of World War I, the Imperial government renamed the city Petrograd (), meaning \"Peter's city\", in order to expunge the German name \"Sankt\" and \"Burg\".", "On 26 January 1924, shortly after the death of Lenin, it was renamed to Leningrad (), meaning \"Lenin's City\".", "On 6 September 1991, the original name, Sankt-Peterburg, was returned.", "Today, in English the city is known as \"Saint Petersburg\".", "Local residents often refer to the city by its shortened nickname, Piter ().", "The city's traditional nickname among Russians is the \"Window to the West\".", "Swedish colonists built Nyenskans, a fortress at the mouth of the Neva River in 1611, in what was then called Ingermanland, which was inhabited by Finnic tribe of Ingrians.", "The small town of Nyen grew up around it.", "At the end of the 17th century, Peter the Great, who was very interested in seafaring and maritime affairs, wanted Russia to gain a seaport in order to trade with the rest of Europe." ], [ "History of Saint Petersburg", "The city's proximity to anti-Soviet armies forced communist leader Vladimir Lenin to move his government to Moscow on 5 March 1918.", "The move was disguised as temporary, but Moscow has remained the capital ever since.", "On 24 January 1924, three days after Lenin's death, Petrograd was renamed \"Leningrad\".", "The Communist party's reason for renaming the city again was that Lenin had led the revolution.", "After the Civil War, and murder of the Tsar Nicholas II and his family, as well as millions of anti-Soviet people, the renaming to Leningrad was designed to destroy last hopes among the resistance, and show strong dictatorship of Lenin's communist party and the Soviet regime.", "St. Petersburg was devastated by Lenin's Red Terror then by Stalin's Great Purge in addition to crime and vandalism in the series of revolutions and wars.", "Between 1917 and 1930s, about two million people fled the city, including hundreds of thousands of educated intellectuals and aristocracy, who emigrated to Europe and America.", "At the same time many political, social and paramilitary groups had followed the communist government in their move to Moscow, as the benefits of capital status had left the city.", "In 1931 Leningrad administratively separated from Leningrad Oblast.", "In 1934 the popular governor of Leningrad, Kirov, was assassinated, because Stalin apparently became increasingly paranoid about Kirov's growth." ] ], "gold": "Saint Petersburg, originally named it Sankt-Pieter-Burch in the Dutch manner and later its spelling was standardized as Sankt-Peterburg, was renamed to Leningrad on 26 January 1924 shortly after the death of Vladimir Lenin. On 6 September 1991, the original name, Sankt-Peterburg, was returned by citywide referendum.", "prediction 1": "In the 1830s Alexander Pushkin translated the \"foreign\" city name of Saint Petersburg to the more Russian \"Petrograd\" in one of his poems. However, it was only on, after the war with Germany had begun, that tsar Nicholas II renamed the capital to Petrograd. After the October Revolution the name \"Red Petrograd\" was often used in newspapers and other prints until the city was renamed \"Leningrad\" in January 1924. On 6 September 1991, the original name, Sankt-Peterburg, was returned. Today, in English, the city is known as Saint Petersburg.\n", "prediction 2": "In the 1830s Alexander Pushkin translated the \"foreign\" city name of Saint Petersburg to the more Russian \"Petrograd\" in one of his poems. However, on, after the war with Germany had begun, that tsar Nicholas II renamed the capital to Petrograd, thus changing the eponym and the \"patron\" of the city, from Apostle Peter to Peter the Great, its founder. On 24 January 1924, three days after Lenin's death, Petrograd was renamed to Leningrad. On 6 September 1991, the original name, Sankt-Peterburg, was returned and the city is now known as Saint Petersburg.", "prediction 3": "The former capital of Russia, Saint Petersburg, was originally named Petrograd, moving the city's name from Peterburg to Leningrad upon Vladimir Lenin's death in January 1924. On 6 September 1991, the original name, Sankt-Peterburg, was returned.", "prediction 4": "The City of Saint Petersburg is the capital of Russia. Starting in 1830s, Alexander Pushkin translated the \"foreign\" city name of Saint Petersburg to the more Russian \"Petrograd\" in one of his poems. It was only on, after the war with Germany had begun, that tsar Nicholas II renamed the capital to Petrograd. Renaming the city to \"Leningrad\" in January 1924 was designed to destroy last hopes among the resistance, and show strong dictatorship of Lenin and the Soviet regime. In January 1991, the original name, Sankt-Peterburg, shortened nickname, the \"Window to the West\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 485, "end": 543 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Peter the Great originally named the city, Sankt-Peterburg. However, after the war with Germany had begun, tsar Nicholas II renamed the capital to Petrograd. The city was renamed \"Leningrad\" on 26 January 1924, shortly after the death of Vladimir Lenin. On 6 September 1991, the original name, Sankt-Peterburg, was returned by city wide referendum. \n" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who is broadcasting the super bowl in 2019?", "passages": [ [ "Super Bowl XLV", "Sirius XM Satellite Radio carried 14 feeds in ten languages to Sirius subscribers, as well as to XM subscribers with the \"Best of Sirius\" package.", "In addition to the Westwood One and local team broadcasts, Sirius carried the following international feeds:\n\n\nFieldPass, the subscription Internet radio service provided by the league at NFL.com, also carried most of these feeds.", "Due to contractual restrictions, only Sirius XM and FieldPass were permitted to carry the local team broadcasts along with WTAQ, WIXX, WTMJ, WDVE and WBGG, with the teams' other network radio affiliates instead airing the Westwood One feed.", "Cowboys Stadium installed 15,000 temporary seats and utilized its standing room to increase its capacity to over 105,000 fans.", "If the stadium had been filled to capacity (its record for an NFL game is 105,121 spectators), it would have set a record for Super Bowl attendance, breaking the previous record of 103,985 fans for Super Bowl XIV in the Rose Bowl; however the actual attendance of 103,219 fell 766 fans short.", "League officials had indicated that they would also count spectators watching the game on large television screens from outside the stadium in the tally, which generally is not allowed in official attendance counts.", "However, Super Bowl XLV was the first Super Bowl game to break the 100,000 threshold in attendance since Super Bowl XXI in 1987." ], [ "Super Bowl LIII", "Super Bowl LIII\n\nSuper Bowl LIII, the 53rd Super Bowl and the 49th modern-era National Football League (NFL) championship game, will decide the league champion for the 2018 NFL season.", "The game is scheduled to be played on February 3, 2019, at Mercedes-Benz Stadium in Atlanta, Georgia.", "This will be the third Super Bowl in Atlanta, having previously hosted Super Bowl XXVIII in 1994 and Super Bowl XXXIV in 2000 at the Georgia Dome.", "On May 19, 2015, the league announced the four finalists that will compete to host Super Bowl LIII in 2019, LIV in 2020, and LV in 2021.", "NFL owners voted on these cities on May 24, 2016, with the first round of voting determining the host for Super Bowl LIII, the second round deciding a different site for Super Bowl LIV, and the third round deciding the site for Super Bowl LV.", "The four finalists for Super Bowl LIII, all in the Southeastern United States, were:\n\n\nAfter three votes, Atlanta was awarded Super Bowl LIII at the NFL owners' meeting on May 24, 2016.", "The losing candidates, except for New Orleans which removed itself from the voting for all games except Super Bowl LIII due to event conflicts in 2020 and 2021, were then pitted against Los Angeles Stadium at Hollywood Park in Inglewood, California for Super Bowl LIV and Super Bowl LV hosting rights." ], [ "Super Bowl LIII", "CBS will broadcast Super Bowl LIII, as part of an annual cycle between the three main broadcast television partners of the NFL.", "As with CBS's previous Super Bowl (Super Bowl 50), ESPN Deportes will air a Spanish-language broadcast of the game.", "On September 19, 2018, it was reported that the American pop rock band, Maroon 5, will headline the game's halftime show, though neither the NFL nor Maroon 5 have confirmed the reports." ] ], "gold": "Super Bowl LIII was an American football game played to determine the champion of the National Football League (NFL) for the 2018 season. The broadcast of the game on CBS, along with the halftime show headlined by U.S. pop group Maroon 5, saw the smallest Super Bowl audience in 10 years. Jim Nantz did the play by play broadcast, and Tony Romo did the color commentary broadcast. Westwood One carried the Super Bowl on the radio, and Kevin Harlin did the radio play by play broadcast. Kurt Warner and Mike Holmgren did the radio color commentary.", "prediction 1": "Super Bowl LIII, the 53rd Super Bowl and the 49th modern-era National Football League championship game, will decide the league champion for the 2018 NFL season. CBS will broadcast Super Bowl LIII, as part of an annual cycle between the three main broadcast television partners of the NFL. ESPN Deportes will air a Spanish-language broadcast of the game.", "prediction 2": "Super Bowl XLV was broadcast in April 2000 from Cowboys Stadium in Dallas, Texas. The 53rd Super Bowl and the 49th modern-era championship game of the National Football League will be played in Atlanta, Georgia on February 3, 2019. CBS will broadcast Super Bowl LIII, as part of an annual cycle between the three main broadcast television partners of the NFL. ESPN Deportes will air a Spanish-language broadcast of the game.", "prediction 3": "Super Bowl XLV was the 59th Super Bowl and the 49th modern-era National Football League championship game. On May 19, 2015, the league announced the four finalists that will compete to host Super Bowl LIII in 2019, LIV in 2020, and LV in 2021. CBS, ESPN Deportes, and Univision will broadcast the game in English, Spanish, and French.", "prediction 4": "Super Bowl XLV was broadcast from Cowboys Stadium in Dallas, Texas from February 3-4, 2019. Super Bowl LIII was broadcast from Mercedes-Benz Stadium in Atlanta, Georgia from February 3-4, 2019. ESPN Deportes was broadcast from Inglewood, California from February 5-10, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 17, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 289 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Super Bowl LIII will decide the league champion for the 2018 NFL season. CBS will broadcast Super Bowl LIII and Maroon 5, will headline the game's halftime show. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who is the actress that does the trivago advert?", "passages": [ [ "Gabrielle Miller (Australian actress)", "Gabrielle Miller (Australian actress)\n\nGabrielle Miller (born July 1986) is an Australian actress, performance artist, musician, tap dancer, mime and puppeteer.", "She is well-known for her appearances in advertisements for the German-based hotel website trivago, which are seen in Australia, New Zealand, United Kingdom, Ireland, United States and South Africa.", "Born in the New South Wales coastal city of Coffs Harbour, Miller spent her childhood traveling in a caravan with her two brothers, accompanying her parents whose job as screeners for breast cancer took them to remote communities around Australia.", "The family ultimately settled in Cairns where she finished school and lived until age 17.", "Miller became a performer when she was about 20 and described, in an interview, that her \"proudest self-devised work includes \"WunderWagon\", a visual anthology starring objects that I created in Papua New Guinea; AC/DC meets Rocky Horror cabaret, \"If You Want Blood\"; the dementia dissecting comedic tragedy, \"Baba\"; my swing-jazz band Zap, an absurd mixture of sounds and performance\".", "She also mentioned that \"I did a terrible audition\" for her favorite TV series, \"Home & Away\"." ], [ "Trivago", "\"I think that was probably the best break we could have gotten.\"", "Following the large response for the U.S. Trivago guy, the company decided to create French and Spanish Trivago guys.", "From 2016 until June 2017, the French actor Mehdi Nebbou was the German Trivago guy.", "In the UK, Trivago's advertisements are fronted by Australian actress and musician Gabrielle Miller.", "In Germany, the Trivago girl is German actress and model Anna Puck (since June 2017).", "In Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States.", "In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements.", "Trivago states that it attempts to recruit tech and business employees that are \"willing to cross borders\".", "Trivago's first employees were hired via Skype interview from Spain, Italy and Canada, and today 90% of its staff is recruited internationally.", "The company operates with virtually no hierarchies or titles, instead using a model called swarm intelligence.", "It also does not have fixed working hours, and offers employees a four-day surprise holiday each year and one month working in Mallorca." ], [ "Sagara Sanosuke", "He also said that he would have liked to see more fights involving Sanosuke in the original video animations, but was happy to see that Sanosuke had matured as a character.", "Lex Lang, the voice actor of Sanosuke in the English adaptation of the anime, commented that his first impression of Sanosuke was as a fight-driven character motivated by anger, but as the story continued Sanosuke became friendly and more likable.", "Because his voice is noticeably different from Ueda's, Lang tries to create his own interpretation of Sanosuke's character.", "Lang has noted that the scene of the episode 22 of the anime, in which Sanosuke is afraid of a train because he believes it is a demon, was the most enjoyable scene for him to record; he added \"I recently saw it and had some big laughs.\"", "In producing the English dub version of the series, Media Blasters chose Lex Lang as Sanosuke's voice actor.", "When writing Sanosuke's dialogue, Clark Cheng, the writer of the English dub script, noted that the character was smarter than he would have liked in the first few episodes, so Cheng tried slowly to change the character's dialogue to make Sanosuke seem less intelligent so he would be more similar to the equivalent in the Japanese version of the series." ] ], "gold": "Gabrielle Miller, an Australian actress and musician, does the Trivago advertisements that are seen in Australia, New Zealand, Hong Kong, the United Kingdom, Ireland, the United States, South Africa and the Arab states of the Persian Gulf. However, in Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym Strae in the United States. When these Trivago commercials first aired in Japan, there was some misconception that the Japanese dialogue was dubbed; however, it was Emmons' own voice. In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements.", "prediction 1": "In the UK, Trivago's advertisements are fronted by Australian actress and musician Gabrielle Miller. In Germany, the Trivago girl is German actress and model Anna Puck. In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements. Lex Lang, the voice actor of Sanosuke in the English dub version of the anime, was chosen to create his own interpretation of Sanosuke's character.", "prediction 2": "In Japan, Trivago is represented in their commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States. In Australia, Australian actress, performance artist, musician, tap dancer, mime and puppeteer Gabrielle Miller is the actress that does the trivago advert. In France, German actress Anna Puck does the trivago advert. In Malaysia, actress and TV host Dahlia Shazwan does the trivago advert.", "prediction 3": "In Australia, American actress Gabrielle Miller, who has starred in many trivago advertisements, does the Trivago commercials for the UK. In Germany, Austrian actress Anna Puck does the Trivago commercial for Germany. Malaysian actress Dahlia Shazwan stars in Trivago ads.", "prediction 4": "There are many actresses that do Trivago advertisements. Australian actress Gabrielle Miller is the one who is featured as the Trivago girl in the UK, Germany and Japan. Australian actress and musician Anna Puck is the one who is featured in Germany's Trivago ads. American actress Natalie Emmons is the one who is currently doing the US Trivago girl. Singapore actress and TV host Dahlia Shazwan is the one who is appearing in Malaysia's Trivago ads.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 405 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the UK, Trivago's advertisements, which are seen in Australia, New Zealand, United Kingdom, Ireland, United States and South Africa, are fronted by Australian actress and musician Gabrielle Miller. In Germany, the Trivago girl is German actress and model Anna Puck. In Malaysia, actress and TV host Dahlia Shazwan has starred in Trivago's advertisements. In Japan, Trivago is represented in their TV commercials by singer/songwriter Natalie Emmons, who uses the pseudonym \"Strae\" in the United States. " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Who wrote the music and lyrics for sound of music?", "passages": [ [ "The Sound of Music (film)", "The names and ages of the children were changed, in part because the third child (who would be portrayed as \"Louisa\") was also named Maria, and producers thought that it would be confusing to have two characters called Maria in the film.", "The von Trapp family had no control over how they were depicted in the film and stage musical, having given up the rights to their story to a German producer in the 1950s who then sold the rights to American producers.", "Robert Wise met with Maria von Trapp and made it clear, according to a memo to Richard Zanuck, that he was not making a \"documentary or realistic movie\" about her family, and that he would make the film with \"complete dramatic freedom\" in order to produce a \"fine and moving film\"\u2014one they could all be proud of.", "The soundtrack to \"The Sound of Music\" was written by Richard Rodgers and Oscar Hammerstein II, and arranged and conducted by Irwin Kostal, who also adapted the instrumental underscore passages.", "The soundtrack album was released by RCA Victor in 1965 and is one of the most successful soundtrack albums in history, having sold over 20 million copies worldwide.", "The album reached the number one position on the \"Billboard\" 200 that year in the United States." ], [ "The Sound of Music", "The Sound of Music\n\nThe Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse.", "It is based on the memoir of Maria von Trapp, \"The Story of the Trapp Family Singers\".", "Set in Austria on the eve of the \"Anschluss\" in 1938, the musical tells the story of Maria, who takes a job as governess to a large family while she decides whether to become a nun.", "She falls in love with the children, and eventually their widowed father, Captain von Trapp.", "He is ordered to accept a commission in the German navy, but he opposes the Nazis.", "He and Maria decide on a plan to flee Austria with the children.", "Many songs from the musical have become standards, such as \"Edelweiss\", \"My Favorite Things\", \"Climb Ev'ry Mountain\", \"Do-Re-Mi\", and the title song \"The Sound of Music\".", "The original Broadway production, starring Mary Martin and Theodore Bikel, opened in 1959 and won five Tony Awards, including Best Musical, out of nine nominations.", "The first London production opened at the Palace Theatre in 1961.", "The show has enjoyed numerous productions and revivals since then." ] ], "gold": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II, and a book by Howard Lindsay and Russel Crouse. It is based on the memoir of Maria von Trapp. Set in Austria on the eve of the Anschluss in 1938, the musical tells the story of Maria, who takes a job as governess to a large family while she decides whether to become a nun. She falls in love with the children, and eventually their widowed father, Captain von Trapp. He is ordered to accept a commission in the German navy, but he opposes the Nazis. He and Maria decide on a plan to flee Austria with the children.", "prediction 1": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. The songs in the musical were written by Maria von Trapp, the governess of a large family who falls in love with the children, and eventually their widowed father, Captain von Trapp, who is ordered to accept a commission in the German navy, but he opposes the Nazis. The original Broadway production of the musical, set in Austria on the eve of the \"The Story of the Trapp Family Singers\", which was written by Richard Rodgers and Oscar Hammerstein II. The Sound of Music was written by Richard Rodgers and Oscar Hammerstein II, and arranged and conducted by Irwin Kostal, who also adapted the instrumental underscore passages and adapted the instrumental underscore passages. The Sound of Music was released by", "prediction 2": "The sound of music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. The von Trapp family had no control over how they were depicted in the film and stage musical, having given up the rights to their story to a German producer in the 1950s who then sold the rights to American producers. The soundtrack to The Sound of Music was written by Richard Rodgers and Oscar Hammerstein II, and arranged and conducted by Irwin Kostal, who also adapted the instrumental underscore passages.", "prediction 3": "The music for The Sound of Music was written by Richard Rodgers, the lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. The von Trapp family had no control over how they were depicted in the film and stage musical, having given up the rights to their story to a German producer in the 1950s who then sold the rights to American producers. The soundtrack to The Sound of Music was written by Richard Rodgers and Oscar Hammerstein II, and arranged and conducted by Irwin Kostal, who also adapted the instrumental underscore passages. The album was released by RCA Victor in 1965 and is one of the most successful soundtrack albums in history, having sold over 20 million copies worldwide.", "prediction 4": "The music and lyrics for The Sound of Music were written by Richard Rodgers and Oscar Hammerstein II, and arranged and conducted by Irwin Kostal.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 231 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 594 }, { "error type": "Irrelevant", "explanation": "", "start": 595, "end": 818 }, { "error type": "Irrelevant", "explanation": "", "start": 819, "end": 853 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Sound of Music is a musical with music by Richard Rodgers, lyrics by Oscar Hammerstein II and a book by Howard Lindsay and Russel Crouse. It is based on the memoir of Maria von Trapp, \"The Story of the Trapp Family Singers\". Set in Austria on the eve of the \"Anschluss\" in 1938, the musical tells the story of Maria, who takes a job as governess to a large family while she decides whether to become a nun. she falls in love with the children, and eventually their widowed father, Captain von Trapp, who is ordered to accept a commission in the German navy, but he opposes the Nazis. He and Maria decide on a plan to flee Austria with the children. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang where were you when i needed you?", "passages": [ [ "Superwoman (Where Were You When I Needed You)", "Superwoman (Where Were You When I Needed You)\n\n\"Superwoman (Where Were You When I Needed You)\" is a 1972 soul track by Stevie Wonder.", "It was the second track on Wonder's \"Music of My Mind\" album, and was also released as the first single.", "In essence a two-part song, there is a coherence in that it tells a story of the singer's relationship with \"Mary\".", "The first part covers her desire to be a star, and to leave behind her old life to become a movie star.", "The second part covers the narrator's wondering why she hadn't come back as soon as he had hoped.", "The second part of the song is also a reworking of the song \"Never Dreamed You'd Leave in Summer\" from the 1971 album \"Where I'm Coming From\".", "The song, both in its sound and length, was a change of pace for Wonder, who was trying to establish his own identity outside of the Motown sound.", "Besides its floaty ambience, it featured the singer as a virtual one-man band.", "The song reached a peak of #33 on the \"Billboard\" Pop charts.", "\"Superwoman\" chronicles the relationship Stevie had with his first wife, Syreeta Wright, a Motown singer and composer who entered the company as a secretary." ] ], "gold": "Superwoman (Where Were You When I Needed You) is a 1972 soul track by Stevie Wonder. It was the second track on Wonder's Music of My Mind album, and was also released as the first single. The Main Ingredient covered the song in 1973. Quincy Jones and Patti Austin sang the song in 1978 for their album Sounds...and Stuff Like That?", "prediction 1": "Superwoman (Where Were You When I Needed You) is a 1972 soul track by Stevie Wonder. It was the second track on Wonder's Music of My Mind album, and was also released as the first single. It featured Stevie Wonder as a virtual one-man band.", "prediction 2": "\"Where Were You When I Needed You\" is a 1972 soul track by Stevie Wonder, released as the second track on his Music of My Mind album, and released as the first single. \"Superwoman\" chronicles the relationship Stevie Wonder had with his first wife, Syreeta Wright, a Motown singer and composer who entered the company as a secretary.", "prediction 3": "\"Superwoman (Where Were You When I Needed You)\" is a 1972 soul track by Stevie Wonder. It was the second track on Wonder's Music of My Mind album, and was also released as the first single. The song, both in its sound and length, was a change of pace for Wonder, who was trying to establish his own identity outside of the Motown sound. The song reached a peak of #33 on the Billboard Pop charts.", "prediction 4": "\"Superwoman (Where Were You When I Needed You)\" is a 1972 soul track by Stevie Wonder. It was the second track on Wonder's \"Music of My Mind\" album, and was also released as the first single.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 240 } ], "missing-info": [], "corrected-prediction": "Superwoman (Where Were You When I Needed You) is a 1972 soul track by Stevie Wonder. It was the second track on Wonder's Music of My Mind album, and was also released as the first single. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who does the voice of sally from cars?", "passages": [ [ "Cars 3", "Cars 3\n\nCars 3 is a 2017 American 3D computer-animated comedy-adventure film produced by Pixar Animation Studios and released by Walt Disney Pictures.", "Directed by Brian Fee in his directorial debut, written by Kiel Murray, Bob Peterson and Mike Rich, and executive-produced by John Lasseter, who directed the previous \"Cars\" films, the film is the third installment of the \"Cars\" franchise and a sequel to \"Cars 2\" (2011).", "The returning voices of Owen Wilson, Bonnie Hunt and Larry the Cable Guy are joined by Cristela Alonzo, Chris Cooper, Armie Hammer, Nathan Fillion, Kerry Washington and Lea DeLaria, in addition to a dozen NASCAR personalities.", "In the film, Lightning McQueen sets out to prove to a new generation of high tech race cars that he is still the best race car in the world.", "Released worldwide on June 16, 2017, the film grossed $383 million worldwide and received generally positive reviews from critics, with many calling it an improvement over its predecessor and praising it for its emotional story and animation.", "Lightning McQueen and the other veteran racers of the Piston Cup suddenly find themselves struggling to win against next-generation rookies like Jackson Storm who utilize advanced technology and modern training methods.", "As Storm's breakout success attracts other rookies to the series, most of the veterans either retire or are fired to make way for the new generation." ], [ "Cars (franchise)", "Cars (franchise)\n\nCars is a CGI-animated film series and Disney media franchise set in a world populated by anthropomorphic automobiles created by John Lasseter.", "The franchise began with the 2006 film of the same name, produced by Pixar and released by Walt Disney Pictures.", "The film was followed by a sequel in 2011.", "A third film was released in 2017.", "The now defunct Disneytoon Studios produced the spin-off films \"Planes\" (2013) and \"\" (2014).", "The first two \"Cars\" films were directed by John Lasseter, then-chief creative officer of Pixar, Walt Disney Animation Studios, and Disneytoon Studios, while \"Cars 3\" was directed by Brian Fee, a storyboard artist on the previous installments.", "Lasseter served as executive producer of \"Cars 3\" and the \"Planes\" films.", "Together, the first two \"Cars\" films have accrued over $1 billion in box office revenue worldwide while the franchise has amassed over $10 billion in merchandising sales within the last 10 years.", "The \"Cars\" franchise began with the 2006 Pixar film, \"Cars\".", "The film was Pixar's least well received by reviewers with a 74% on Rotten Tomatoes, until the sequel was released and received a 40%." ], [ "Sally Carrera", "Sally is instrumental in convincing the local judge to direct McQueen to repair the town's Main Street, a section of the now-bypassed U.S. Route 66, as a community service obligation upon his conviction in traffic court.", "Sally often calls Lightning McQueen \"Stickers\", at first because of his fake headlights and later as a friendly nickname.", "Her desire that McQueen stay to assist in rebuilding the town places her at odds with Doc's intransigence that \"I want him out of my courtroom.", "I want him out of our town!", "\", motivated by his desire to break all ties with a racing community which once abandoned him.", "Sally leads McQueen on a leisurely drive on picturesque but serpentine mountain roads through Tailfin Pass to the vacant Wheel Well Motel, an abandoned motor court and filling station near a scenic lookout point with a wide panoramic view of Ornament Valley, Radiator Springs and the entire surrounding region (including US\u00a066 and I-40).", "Surrounding scenery strongly resembles Arizona landmarks such as Havasu Falls near Grand Canyon National Park or Monument Valley.", "She also appears to be able to speak Italian at least when she sometimes talks to Guido." ] ], "gold": "Cars is a CGI-animated film series and Disney media franchise set in a world populated by anthropomorphic vehicles created by John Lasseter. Sally, the love interest of Lightning McQueen, is voiced by Bonnie Hunt in Cars (2006), Cars 2 (2011), and Cars 3 (2017). In the 2017 video game, Sofie Volez voices Sally.", "prediction 1": "Cars is a CGI-animated film series and Disney media franchise set in a world populated by anthropomorphic automobiles created by John Lasseter. In the 2006 film, Sally Carrera was voiced by Cristela Alonzo. In 2017, Sally Carrera was voiced by Kerry Washington.", "prediction 2": "Cars is a CGI-animated film series and Disney media franchise set in a world populated by anthropomorphic automobiles created by John Lasseter. The franchise began with the 2006 film of the same name, produced by Pixar and released by Walt Disney Pictures. The film was Pixar's least well received by reviewers with a 74% on Rotten Tomatoes, until the sequel was released and received a 40% on Rotten Tomatoes. Cristela Alonzo, Chris Cooper, Armie Hammer, Kerry Washington, Kerry Washington, and Lea DeLaria, in addition to a dozen NASCAR personalities, in addition to a dozen NASCAR personalities in addition to a dozen NASCAR personalities.", "prediction 3": "In the American animated film Cars, Sally, the character voiced by Carrie Fisher, is portrayed by Cristela Alonzo, Chris Cooper, Armie Hammer, Kerry Washington and Lea DeLaria.", "prediction 4": "The Cars franchise is a CGI-animated film series created by John Lasseter. The 2006 film Cars was Pixar's least well received film, and Sally Carrera is voiced by Cristela Alonzo. In 2017, the voice of Sally is provided by Kristen Stewart. In 2018, the voice of Sally is by Kristen Stewart.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 144, "end": 206 }, { "error type": "Unverifiable", "explanation": "", "start": 207, "end": 261 } ], "missing-info": [], "corrected-prediction": "Cars is a CGI-animated film series and Disney media franchise set in a world populated by anthropomorphic automobiles created by John Lasseter. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does daphne find out she's pregnant?", "passages": [ [ "Frasier (season 11)", "Frasier (season 11)\n\nThe eleventh and final season of the American sitcom television series \"Frasier\" originally aired from September 23, 2003 to May 13, 2004 on NBC.", "\n\nThe season ranked 35th in the seasonal ratings and had an average viewership of 10.920 million viewers." ], [ "Frasier", "Frasier\n\nFrasier is an American sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004.", "The program was created and produced by David Angell, Peter Casey, and David Lee (as Grub Street Productions) in association with Grammnet (2004) and Paramount Network Television.", "The series was created as a spin-off of \"Cheers\", continuing the story of psychiatrist Frasier Crane as he returned to his hometown of Seattle and started building a new life as a radio advice show host while reconnecting with his father and brother.", "\"Frasier\" stars Kelsey Grammer, Jane Leeves, David Hyde Pierce, Peri Gilpin, and John Mahoney.", "The show was critically acclaimed, with the show itself and the cast winning thirty-seven Emmy Awards, a record at the time for a scripted series.", "It also won the Emmy for Outstanding Comedy Series for five consecutive years.", "Psychiatrist Dr. Frasier Crane (Grammer) returns to his home town of Seattle, Washington, following the end of his marriage and his life in Boston (as seen in \"Cheers\")." ], [ "Something Borrowed, Someone Blue", "Frasier is left to comfort Daphne, and Daphne reveals that she knows about Niles' seven-year crush on her.", "She has tormented herself about her own feelings towards Niles, and believes that she has fallen in love with him in return.", "Despite her impending marriage, Frasier urges her to confront Niles and discuss this with him before her marriage.", "When Niles returns, however, he has exciting news: he has, on impulse, eloped with Mel and married her.", "Frasier arrives at the luxurious hotel where Daphne and Donny's wedding will take place, hoping to speak to Daphne about recent events.", "Daphne brushes the matter off, dismissing her feelings as just nerves, and gives Frasier the bottle of wine to thank him for all his kindness and support.", "They are interrupted by the arrival of Daphne's overbearing and hypercritical mother, Gertrude.", "That night following the rehearsal dinner, Frasier and Martin discuss Daphne and Niles.", "Frasier confesses that he does not believe either Daphne or Niles when they claim to be happy, leading Martin to warn him about interfering; two marriages are at stake.", "Meanwhile, Niles and Daphne join each other for a dance, and Frasier watches them as they dance close together." ], [ "Criminal Minds (season 11)", "Cook appears in the first episode \"The Job\" holding her sleeping baby Michael, played by Phoenix Andersen, her child in real life.", "According to Matthew Gray Gubler, he will be directing an episode in which another BAU member will be leaving the cast this season, that member being Derek Morgan (Shemar Moore).", "Shemar Moore left the show as Derek Morgan, which aired on March 23, 2016.", "On February 10, 2016, it was announced that Paget Brewster would return as Emily Prentiss for one episode later in season 11 episode 19, titled \"Tribute\".", "The season ended on May 4, 2016, with the show's first cliffhanger finale since the fifth season.", "Messer said she felt it was time for another cliffhanger and thought that it served as a \"really fun launch pad\" into the twelfth season, which was officially ordered two days later.", "Jennifer Love Hewitt was announced to be leaving the show after the season ten finale.", "Her character, Kate Callahan, handed in her resignation at the end of the season ten finale, due to her real-life pregnancy and decision to devote the next year to her newborn baby.", "A. J. Cook was also revealed to be pregnant, a fact that was carried over to her character Jennifer \"JJ\" Jareau as well." ] ], "gold": "Frasier is an American television sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004. The series was created as a spin-off of Cheers, continuing the story of psychiatrist Frasier Crane, Kelsey Grammer, as he returned to his hometown of Seattle and started building a new life as a radio advice show host while reconnecting with his father Martin, John Mahoney, a retired police officer, and younger brother Niles, David Hyde Pierce, a fellow psychiatrist, while making new friends. Rounding out the cast is Peri Gilpin as Roz Doyle, Frasier's call screener on his radio show, and Jane Leeves as Daphne Moon, Martin's live-in caretaker. Niles marry's Daphne, and on September 23, 2003, season 11 episode 1, Daphne finds out she is pregnant. ", "prediction 1": "Frasier is an American sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004. In the eleventh and final season, Daphne finds out she's pregnant. In the season finale, Daphne finds out she's pregnant.", "prediction 2": "Frasier is an American sitcom that was broadcast on NBC for 11 seasons. The series was created as a spin-off of Cheers, continuing the story of psychiatrist Frasier Crane as he returned to his hometown of Seattle, Washington, following the end of his marriage and his life in Boston. In the first episode of Season 11, Daphne discovers that she is pregnant.", "prediction 3": "Daphne discovers she's pregnant in the episode Something Borrowed, Someone Blue of the American sitcom Frasier. Daphne and Niles learn of Daphne's pregnancy in the episode \"The Job\", which was aired in the US on September 16, 1993.", "prediction 4": "Frasier is an American sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004. Daphne finds out she's pregnant in the fourth episode of Season 11 of Frasier, entitled Something Borrowed, Someone Blue.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 138, "end": 259 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Frasier is an American sitcom that was broadcast on NBC for 11 seasons, premiering on September 16, 1993, and concluding on May 13, 2004. The series was created as a spin-off of \"Cheers\", continuing the story of psychiatrist Frasier Crane as he returned to his hometown of Seattle and started building a new life as a radio advice show host while reconnecting with his father and brother. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is the current receiver general of canada?", "passages": [ [ "Receiver General for Canada", "Receiver General for Canada\n\nThe Receiver General for Canada () is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada.", "The Receiver General deposits and withdraws funds from the Consolidated Revenue Fund of Canada.", "The Minister of Public Works and Government Services is the Receiver General for Canada.", "The Department of Public Works and Government Services Act, 1996 states: \"In the Minister's capacity as Receiver General, the Minister shall exercise all the powers and perform all the duties and functions assigned to the Receiver General by law.\"", "The position of Receiver General existed in the United Kingdom and in various Commonwealth countries, and still exists in Massachusetts and provincially within Canada." ], [ "Consolidated Revenue Fund of Canada", "Consolidated Revenue Fund of Canada\n\nThe Consolidated Revenue Fund of Canada () is the account into which taxes and revenue are deposited, and from which funds are withdrawn in order to defray the costs of public services.", "Funds are deposited and withdrawn by the Receiver General for Canada.", "Payments to and from the Consolidated Revenue Fund of Canada are made by the Receiver General, currently the Hon.", "Carla Qualtrough.", "By convention, one becomes the Receiver General by virtue of also being the Minister of Public Works and Government Services.", "Cheques distributed by the Government of Canada to citizens and organizations are made in the name of the Receiver General, just as payments to the Government are made out to the same.", "The Receiver General by convention, however, never exercises any degree of discretion over payments to or from the Consolidated Revenue Fund, other than by following whatever directives might exist in relevant statutes and regulations.", "The Consolidated Revenue Fund of Canada is established by Section 102 of the \"Constitution Act, 1867\".", "The Act went on to stipulate several charges to be made to the fund, some of which were recurring charges, and continue to be withdrawn from the fund today, in accordance with the Act.", "The original balance of the fund was created from the consolidated financial resources of whatever revenue and taxation could be lawfully appropriated by the Legislatures of the provinces of Ontario, Quebec, New Brunswick and Nova Scotia." ] ], "gold": "The Receiver General for Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada. The Minister of Public Services and Procurement is also the Receiver General of Canada. Diane Finley was the 10th Receiver General of Canada, and Judy Foote was the 11th Receiver General. The 12th Receiver General was Carla Qualtrough.", "prediction 1": "The Receiver General for Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada. The position of Receiver General existed in the United Kingdom and in various Commonwealth countries, and still exists in Massachusetts and provincially within Canada. The current Receiver General is the Hon. Carla Qualtrough.", "prediction 2": "The Receiver General of Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada. The position of Receiver General existed in the United Kingdom and in various Commonwealth countries, and still exists in Massachusetts and provincially within Canada. The current Receiver General is the Hon. Carla Qualtrough.", "prediction 3": "The Receiver General for Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada. The Receiver General deposits and withdraws funds from the Consolidated Revenue Fund of Canada. The current Receiver General is the Hon. Carla Qualtrough.", "prediction 4": "The Receiver General for Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, which contain annual audited financial statements of the Government of Canada. The Minister of Public Works and Government Services is the current Receiver General for Canada. The Hon. Carla Qualtrough is the current Receiver General of Canada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 448 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Receiver General for Canada is responsible for making payments to the Government of Canada each fiscal year, accepting payments from financial institutions and preparing the Public Accounts of Canada, containing annual audited financial statements of the Government of Canada. The Minister of Public Works and Government Services is the Receiver General for Canada. The current Receiver General is the Hon. Carla Qualtrough." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is the name of the restaurant that insults you?", "passages": [ [ "Dick's Last Resort", "Dick's Last Resort\n\nDick's Last Resort is a bar and restaurant chain in The United States, known for its intentional employment of an obnoxious staff.", "The chain consists of thirteen restaurants.", "The restaurant has its origins in the owners' original opening of a \"fine-dining\" establishment.", "The establishment was a failure, which resulted in bankruptcy.", "Rather than continue with the upscale restaurant motif, the owners retooled their efforts and decided to \"go sloppy\".", "The end result was a success, leading to the creation of more locations.", "In 1995, the company attempted to expand to Europe and opened a restaurant in London, but the effort was abandoned and the restaurant was sold in early 1996.", "Dick's Last Resort teaches its servers to be obnoxious.", "In addition to the staff, the decor is considered to be \"wacky\".", "The restaurant uses picnic-style tables and no tablecloths.", "Patrons of Dick's are expected to be insulted, or placed in uncomfortable situations.", "Adult bibs and large, hand-made, paper hats are given to diners to wear during their stay.", "There are no napkins on the tables: they are generally thrown at the customers by the serving staff.", "Dick's menu is influenced by Southern cuisine, consisting of hamburgers, barbecue, and seafood items." ], [ "The Wieners Circle", "The Wieners Circle\n\nThe Wieners Circle is a hot dog stand on Clark Street in the Lincoln Park neighborhood of Chicago, Illinois, United States.", "It is known for its Maxwell Street Polish, Char-dogs, hamburgers, cheese fries, and the mutual verbal abuse between the employees and the customers during the late-weekend hours.", "The establishment is known for its char-grilled food, especially its hot dogs and hamburgers (commonly called char-dogs and char-burgers).", "A Wiener Circle char dog with \"the works\" is a grilled Vienna Beef hot dog on a warm poppy seed bun, topped with mustard, onions, relish, dill pickle spears, tomato slices, sport peppers and a dash of celery salt.", "The Weiners Circle opened for business in 1983.", "Sometime in the early 1990s (circa 1992)", "Larry Gold, one of the proprietors, called a drunk and distracted customer an \"asshole\" in order to get his attention.", "This set off the late-night abuse culture of the restaurant.", "The atmosphere can range from playful to hostile.", "The language used by both the staff and customers during these hours is notoriously foul and aggressive.", "On the weekends, the establishment stays open as late as 5:00\u00a0am, drawing many drunken customers who have arrived from bars and clubs." ], [ "Cencio la Parolaccia", "Cencio la Parolaccia\n\nCencio la Parolaccia is a restaurant in the rione Trastevere of Rome.", "It is mostly famous for the behaviour of its waiters, who curse at or otherwise verbally abuse the diners, including tourists.", "The restaurant was established in 1941 by Vincenzo \"Cencio\" de Santis and Renata de Santis, who decided to combine a traditional restaurant with elements of folk entertainment based on foul language in Romanesco dialect.", "The restaurant has been used as the setting for some Italian films, including the 1981 comedy film Fracchia la belva umana." ] ], "gold": "There are several restaurants that intentionally insult you. Dick's Last Resort is a bar and restaurant chain in The United States, known for its intentional employment of an obnoxious staff and funny shenanigans. The Wieners Circle is a hot dog stand on Clark Street in the Lincoln Park neighborhood of Chicago, Illinois that is known for the mutual verbal abuse between the employees and the customers during the late-weekend hours. Cencio la Parolaccia, Cencio's Profanities, is a restaurant in the Trastevere rione of Rome that is mostly famous for the behaviour of its waiters, who curse at or otherwise verbally abuse the diners, including tourists. Wong Kei is a Chinese restaurant in London's Chinatown, once described as \"the rudest restaurant in London\".", "prediction 1": "The restaurant that insults you is Dick's Last Resort, which is a bar and restaurant chain in the United States, known for its intentional employment of an obnoxious staff. The restaurant The Wieners Circle is a hot dog stand on Clark Street in the Lincoln Park neighborhood of Chicago, Illinois, United States. Sometime in the early 1990s, one of the proprietors, Larry Gold, called a drunk and distracted customer an \"asshole\" in order to get his attention. This set off the late-night abuse culture of the restaurant. The restaurant Cencio la Parolaccia is mostly famous for the behaviour of its waiters, who curse at or otherwise verbally abuse the diners, including tourists.", "prediction 2": "In the United States, there are several restaurants that expect their patrons to be insulted, or placed in uncomfortable situations. Dick's Last Resort is a bar and restaurant chain known for its intentional employment of an obnoxious staff. The Wieners Circle is a hot dog stand on Clark Street in the Lincoln Park neighborhood of Chicago, Illinois, United States. In the late-night hours of the restaurant, the waiters curse at or otherwise verbally abuse the diners, including tourists. The restaurant usually has a wacky decor and no tablecloths.", "prediction 3": "The restaurant that insults you is Dick's Last Resort, which is a bar and restaurant chain in The United States known for its intentional employment of an obnoxious staff. Cencio la Parolaccia, a restaurant in Rome, is also known for its abuse of diners. The Wieners Circle, a hot dog stand in the Lincoln Park neighborhood of Chicago, Illinois, is known for its Maxwell Street Polish, Char-dogs, hamburgers, cheese fries, and the mutual verbal abuse between the staff and the customers during the late-weekend hours.", "prediction 4": "There are several restaurants that use abusive language towards customers. One restaurant that is known to insult customers is Dick's Last Resort, which is a bar and restaurant chain in The United States, known for its intentional employment of an obnoxious staff. Cencio la Parolaccia, a restaurant in the rione Trastevere of Rome, is also known for its abusive language towards tourists. The restaurant has its origins in the owners' original opening of a \"fine-dining\" establishment.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 312, "end": 459 }, { "error type": "Irrelevant", "explanation": "", "start": 460, "end": 520 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The restaurant that insults you is Dick's Last Resort, which is a bar and restaurant chain in the United States, known for its intentional employment of an obnoxious staff. The restaurant The Wieners Circle is a hot dog stand on Clark Street in the Lincoln Park neighborhood of Chicago, Illinois, United States that is known for the mutual verbal abuse between the employees and the customers during the late-weekend hours. Cencio la Parolaccia is a restaurant in the rione Trastevere of Rome that is mostly famous for the behaviour of its waiters, who curse at or otherwise verbally abuse the diners, including tourists." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the lg g6 phone come out?", "passages": [ [ "LG G6", "LG G6\n\nThe LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series.", "It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5.", "The G6 is distinguished by its 5.7 display, which features a taller, (marketed as 18:9), than the aspect ratio of most smartphones.", "A variant, called the LG G6+ was announced on June 19, 2017 with 128\u00a0GB storage and a Hi-Fi Quad DAC.", "The LG G6 utilizes a metal chassis with a glass backing, and is IP68-rated for water and dust-resistance.", "It is available in black, white, and silver-color finishes.", "The G6 features a 1440p \"FullVision\" IPS LCD display, with a diagonal size of 5.7 inches.", "LG stated that it intended for the G6 to be a large-screened phone that would still be compact and feasible for one-handed use; the display uses a 2:1 aspect ratio that is taller than the displays used by the majority of smartphones.", "The G6 was also designed with slim bezels, and is slightly smaller in size than the G5.", "To allow for reinforcement around the corners of the display, the display panel itself has rounded edges." ] ], "gold": "The LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series. It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5. A variant, called the LG G6+ was announced on June 19, 2017 with 128 GB storage and a Hi-Fi Quad DAC.", "prediction 1": "LG's flagship smartphone, the G6, was announced at Mobile World Congress 2017 on February 26, 2017. It was designed and developed with a large-screen phone in mind, but still small enough for one-handed use.", "prediction 2": "The LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series. It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5. The phone was released as part of the LG G series for the 2018 model year.", "prediction 3": "The LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series. It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5. The G6 is distinguished by its 5.7 display, which features a taller, (marketed as 18:9), than the aspect ratio of most smartphones. A variant, called the LG G6+ was announced on June 19, 2017 with 128 GB storage and a Hi-Fi Quad DAC.", "prediction 4": "The LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series. It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5. The G6 is distinguished by its 5.7 display, which features a taller, (marketed as 18:9), than the aspect ratio of most smartphones.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 207 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "LG G6 The LG G6 is an Android smartphone developed by LG Electronics as part of the LG G series. It was announced during Mobile World Congress on February 26, 2017, as the successor to the 2016 LG G5. A variant, called the LG G6+ was announced on June 19, 2017 with 128 GB storage and a Hi-Fi Quad DAC." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who presides over the texas house of representatives?", "passages": [ [ "Speaker of the Texas House of Representatives", "Speaker of the Texas House of Representatives\n\nThe Speaker of the Texas House of Representatives is the presiding officer of the Texas House of Representatives.", "The Speaker's main duties are to conduct meetings of the House, appoint committees, and enforce the Rules of the House.", "The current speaker is Joe Straus, a Republican from San Antonio, who was first elected Speaker on January 13, 2009.", "The speaker is elected from the legislature of Texas, by a vote of its fellow members.", "On the first day of each regular session, the members may nominate a fellow member, and a record vote is held to determine who the speaker will be.", "The Secretary of State calls the House to order, and presides over the chamber until a speaker is elected.", "The speaker is the presiding officer of the House of Representatives.", "The\nTexas Constitution requires the House of Representatives, each time a new\nlegislature convenes, to choose one of its own members to serve as Speaker.", "As presiding officer, the Speaker maintains order during floor debate,\nrecognizing legislators who wish to speak and ruling on procedural matters.", "The constitution also requires the Speaker to sign all bills and joint\nresolutions passed by the legislature.", "As a member of the House of\nRepresentatives, the Speaker may vote on all questions before the House." ], [ "Joe Straus", "Joe Straus\n\nJoseph Richard Straus III, known as Joe Straus (born September 1, 1959), is the current Speaker of the Texas House of Representatives.", "He is a Republican and represents District 121, which comprises northeastern Bexar County, including part of San Antonio, Texas, and several surrounding communities.", "Straus was elected to the Texas House in 2005.", "Straus was first elected Speaker on January 13, 2009.", "In October 2017, Straus announced that he would not seek re-election in 2018.", "His mother, Jocelyn Levi Straus, was a Republican Party fund-raiser and close friend of President George H.W. Bush and his wife, Barbara, during Bush's two U.S. Senate races and his bids for the White House.", "Straus is a San Antonio native and a fifth-generation Texan.", "A graduate of Vanderbilt University, he has an insurance, investment, and executive benefit practice.", "He was former spokesman for the Retama Development Corporation, a development company that built the Retama Racetrack in San Antonio, which was for betting on horse racing.", "Straus has previously served on the Management Committee of the Bexar County Republican Party, as a precinct chairman, and on numerous campaign committees for federal, state, and local candidates." ], [ "Tom Craddick", "Tom Craddick\n\nThomas Russell Craddick, Sr., known as Tom Craddick (born September 19, 1943), is member of the Texas House of Representatives representing the 82nd district.", "Craddick was Speaker of the Texas House of Representatives from January 2003 to January 2009.", "He was the first Republican to have served as Speaker since Reconstruction.", "Craddick resides in Midland, the largest city in his district.", "Craddick was first elected in 1968 at the age of twenty-five.", "By 2012, he was already the longest-serving member of the Texas state legislature and the second-longest-serving representative in the history of the state.", "In the general election held on November 6, 2018, Craddick won his 26th term in the legislature.", "With 37,504 votes (80.3 percent), he defeated the Democratic candidate, Spencer Bounds, who polled 9,207 votes (19.7 percent).", "In this same election, Craddick's daughter, Christi Craddick, won her second term as a Republican member of the Texas Railroad Commission.", "While he was a doctoral student at Texas Tech University in Lubbock, Craddick decided to run for the legislature to succeed the incumbent Republican Frank Kell Cahoon of Midland, who was not seeking a third two-year term." ] ], "gold": "The Speaker of the Texas House of Representatives is the presiding officer over the Texas House of Representatives, with the current speaker being Republican Dade Phelan who was elected January 2021. Republican Joe Straus was the Speaker of the Texas House of Representatives from 2009 to 2019, when he retired. Thomas Russell Craddick Sr., known as Tom Craddick, was Speaker of the Texas House of Representatives from January 2003 to January 2009 and was the first Republican to have served as Speaker since Reconstruction. James Earl Laney, known as Pete Laney, who was a member of the Texas House of Representatives from 1973 to 2007, served as House Speaker from 1993 to 2003 and is the most recent Democrat to serve.", "prediction 1": "The Texas House of Representatives is composed of seven members. The current Speaker is Joe Straus, a Republican from San Antonio, who was first elected Speaker on January 13, 2009. The Texas Constitution requires the House of Representatives, each time a new legislature convenes, to choose one of its own members to serve as speaker. Tom Craddick served as Speaker of the Texas House of Representatives from 2003 to 2009.", "prediction 2": "The Speaker of the Texas House of Representatives is the presiding officer of the Texas House of Representatives. The speaker is elected from the legislature of Texas, by a vote of its fellow members. The Secretary of State calls the House to order, and presides over the chamber until a speaker is elected. The current speaker is Joe Straus, a Republican from San Antonio, who was first elected Speaker on January 13, 2009. The Texas Constitution requires the House of Representatives, each time a new legislature convenes, to choose one of its own members to serve as Speaker.", "prediction 3": "The Texas House of Representatives is a Texas legislature. The Speaker is elected from the Texas legislature by a vote of its fellow members. The Secretary of State calls the House to order, and presides over the chamber until a speaker is elected. The current speaker is Joe Straus, a Republican from San Antonio, who was first elected Speaker on January 13, 2009.", "prediction 4": "The Texas House of Representatives is a legislative body in the state of Texas. The speaker is elected from the legislature of Texas each time a new legislature convenes, by a vote of its fellow members. The Texas Constitution requires the House of Representatives, each time a new legislature convenes, to choose one of its own members to serve as speaker. The current speaker of the Texas House of Representatives is Joe Straus, a Republican from San Antonio, who was first elected Speaker on January 13, 2009. Thomas Russell Craddick was Speaker of the Texas House of Representatives from January 2003 to January 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 64 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Speaker of the Texas House of Representatives is the presiding officer of the Texas House of Representatives. The current Speaker is Joe Straus, who was first elected Speaker on January 13, 2009. Tom Craddick served as Speaker of the Texas House of Representatives from 2003 to 2009. He was the first Republican to have served as Speaker since Reconstruction. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "What is the name of the latest pirates of the caribbean movie?", "passages": [ [ "Pirates of the Caribbean (film series)", "On September 10, 2013, Disney pushed back the film's initial 2015 release, with sources indicating that a Summer 2016 release is likely.", "Producer Jerry Bruckheimer revealed that script issues were behind the delay, and that Jeff Nathanson was at work on a second attempt based on a well-received outline.", "While Disney originally announced a release on July 7, 2017, \"Dead Men Tell No Tales\" was released on May 26, 2017.", "A spokesman for the Australian Arts Minister confirmed that the fifth installment was set to shoot in Australia after the government agreed to repurpose $20 million of tax incentives originally intended for the remake of \"20,000 Leagues Under the Sea\".", "Disney and Ian Walker the Queensland Arts Minister, confirmed on October 2, 2014, that filming was expected to start in February 2015, stating that filming will take place exclusively in Australia, being the largest production to ever shoot in the country.", "Village Roadshow Studios and Port Douglas were officially confirmed as filming locations.", "Production began in Australia on February 17, 2015 and wrapped on July 9, 2015.", "The \"Pirates of the Caribbean\" film series was successful at the box office, with each film grossing over $650\u00a0million, and all but \"Dead Men Tell No Tales\" at some point ranking among the fifty highest-grossing films of all time." ], [ "Pirates of the Caribbean: On Stranger Tides", "Pirates of the Caribbean: On Stranger Tides\n\nPirates of the Caribbean: On Stranger Tides is a 2011 American fantasy swashbuckler film, the fourth installment in the \"Pirates of the Caribbean\" film series and the sequel to \"\" (2007).", "It is the first film in the series not to be directed by Gore Verbinski, being replaced by Rob Marshall.", "Jerry Bruckheimer again served as producer.", "The film is technically a stand-alone sequel to the previous installments.", "In the film, which draws its plot loosely from the novel \"On Stranger Tides\" by Tim Powers, Captain Jack Sparrow (Johnny Depp) is joined by Angelica (Pen\u00e9lope Cruz) in his search for the Fountain of Youth, confronting the infamous pirate Blackbeard (Ian McShane).", "The film was produced by Walt Disney Pictures and released in the United States on May 20, 2011.", "It was the first film in the series to be released in the Disney Digital 3-D and IMAX 3D formats.", "Writers Ted Elliott and Terry Rossio first learned of Powers' novel \"On Stranger Tides\" during the back-to-back production of \"\" (2006) and \"\", and considered it a good starting point for a new film in the series." ], [ "Pirates of the Caribbean: Dead Men Tell No Tales", "Along with sea footage filmed in both the Australian sets and Key West, Florida, there was extensive usage of water simulations, with the artists using the Beaufort scale to ensure the waves and wind realistically matched.", "\"Dead Men Tell No Tales\" had its world premiere at the Shanghai Disney Resort on May\u00a011, 2017.", "In several countries, including the United Kingdom, the film was released as \"Pirates of the Caribbean: Salazar's Revenge\", a decision that the directors were not informed about.", "It was released at cinemas in Italy and Norway on May\u00a024, and in the United States, Canada, and China on May\u00a026.", "It is the first Hollywood feature to be released in the United States for the new panorama-like ScreenX format, which played in two locations in the U.S.\u2014CGV Buena Park and CGV Cinemas\u2014both in Los Angeles, California.", "Additionally, it played in 81 screens at select theaters in Korea, China, Thailand, Vietnam, Turkey and Indonesia.", "The film also played in 4D on 373 4DX screens worldwide.", "The film was released in IMAX in an expanded 1.9:1 aspect ratio.", "It was Disney's third wide release of the year, following \"Beauty and the Beast\" and \"Guardians of the Galaxy Vol. 2\"." ] ], "gold": "The latest \"Pirates of the Caribbean\" movie was \"Dead Men Tell no Tales\", which was released on May 11, 2017 in Shanghai before being released in the United States on May 26. Prior to 2017, the latest movie in the series was \"On Stranger Tides\", which was released on May 20, 2011 in the United States.", "prediction 1": "The Pirates of the Caribbean film series was successful at the box office, with each film grossing over $650 million. The fourth installment in the Pirates of the Caribbean film series, Pirates of the Caribbean: On Stranger Tides, was released in the United States on May 20, 2011. The latest installment in the Pirates of the Caribbean film series, Pirates of the Caribbean: Dead Men Tell No Tales, was released on May 26, 2017.\n", "prediction 2": "The pirates of the caribbean film series brought together three different films. The fourth installment was Pirates of the Caribbean: On Stranger Tides, released in the U.S. on May 20, 2011, and the fifth installment was Pirates of the Caribbean: Dead Men Tell No Tales, released on May 26, 2017. The latest installment in the Pirates of the Caribbean franchise was Pirates of the Caribbean: Dead Men Tell No Tales, which was released on May 26, 2017.", "prediction 3": "The Pirates of the Caribbean movie series is a series of fantasy swashbuckler films produced by Walt Disney Pictures. Pirates of the Caribbean: On Stranger Tides is the fourth installment in the Pirates of the Caribbean film series and the sequel to Pirates of the Caribbean: Dead Men Tell No Tales, released on May 24, 2011. The \"Dead Men Tell No Tales\" film was released on May 26, 2017 as a re-release exclusive to the China market and was the first Hollywood feature to be released in the United States for the new ScreenX format. While Disney originally announced a release on July 7, 2017, Pirates of the Caribbean: Dead Men Tell No Tales was released on May 26, 2017.", "prediction 4": "The Pirates of the Caribbean film series was very successful at the box office, with each film grossing over $650 million, with Pirates of the Caribbean: On Stranger Tides being the fourth installment. The latest installment in the series, Pirates of the Caribbean: Dead Men Tell No Tales, was released on May 26, 2017. In several countries, including the United Kingdom, the film was released as Pirates of the Caribbean: Salazar's Revenge.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The latest installment in the Pirates of the Caribbean film series, Pirates of the Caribbean: Dead Men Tell No Tales, was released on May 26, 2017. It had its world premiere in Shanghai, on May 11, 2017. Prior to 2017, the latest movie in the series was \"On Stranger Tides\", which was released on May 20, 2011 in the United States.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "How long has the show blue bloods been on tv?", "passages": [ [ "Blue Bloods (TV series)", "Blue Bloods (TV series)\n\nBlue Bloods is an American police procedural fictional drama series that airs on CBS.", "The series is filmed on location in New York City with occasional references to nearby suburbs.", "The series debuted on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00\u00a0p.m. Eastern and Pacific time and 9:00\u00a0p.m. Central and Mountain time for a four-week tryout.", "After four weeks, it returned to its original Friday 10:00\u00a0p.m. Eastern time slot, where it has remained since.", "On April 18, 2018, CBS renewed the series for a ninth season, which premiered on September 28, 2018.", "The series follows the Reagan family of police officers with the New York City Police Department (NYPD).", "Francis Xavier \"Frank\" Reagan is the Police Commissioner.", "Frank's oldest son Danny is an NYPD detective, his youngest son Jamie is an NYPD police officer (later sergeant), and his daughter Erin is an assistant district attorney.", "Frank's second-oldest son Joe was murdered by a crooked cop in the line of duty in events that pre-date the series, when he was involved with the Federal Bureau of Investigation (FBI) investigating a group of corrupt NYPD cops known as the Blue Templar." ] ], "gold": "Blue Bloods is an American police procedural drama tv series that has been on air for 10 years, with 10 seasons, and a total of 214 episodes.", "prediction 1": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. The series was first broadcast on CBS on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00 p.m. Eastern and Pacific time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since. Blue Bloods debuted on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 9:00 p.m. Eastern and Pacific time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since.", "prediction 2": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. It debuted on September 24, 2010 with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00 p.m. Eastern and Pacific time and 9:00 p.m. Central and Mountain time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since. CBS renewed the series for a ninth season, which premiered on September 28, 2018.", "prediction 3": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. The series debuted on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00 p.m. Eastern and Pacific time and 9:00 p.m. Central and Mountain time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since. On April 18, 2018, CBS renewed the series for a ninth season, which premiered on September 28, 2018.", "prediction 4": "Blue Bloods is an American police procedural fictional drama series that airs on CBS and is filmed on location in New York City with occasional references to nearby suburbs. The series debuted on September 24, 2010, with episodes airing on Fridays following \"\", before being moved to Wednesdays at 10:00 p.m. Eastern and Pacific time and 9:00 p.m. Central and Mountain time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since. On April 18, 2018, CBS renewed the series for a ninth season, which premiered on September 28, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 399 }, { "error type": "Redundant", "explanation": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. The series was first broadcast on CBS on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00 p.m. Eastern and Pacific time for a four-week tryout. After four weeks, it returned to its original Friday 10:00 p.m. Eastern time slot, where it has remained since. ", "start": 400, "end": 694 }, { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 85 } ], "missing-info": [], "corrected-prediction": "Blue Bloods is an American police procedural fictional drama series." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "How many games did chelsea win in a row last season?", "passages": [ [ "2016\u201317 Chelsea F.C. season", "2016\u201317", "Chelsea F.C. season\n\nThe 2016\u201317 season was Chelsea's 103rd competitive season, 28th consecutive season in the top flight of English football, 25th consecutive season in the Premier League, and 111th year in existence as a football club.", "They entered this season looking to rebound from a disappointing 2015\u201316 campaign, when they finished 10th in the table.", "Chelsea also participated in the FA Cup and League Cup, but they were not participating in any UEFA competition for the first time since the 1996\u201397 season.", "The season covers the period from 1 July 2016 to 30 June 2017.", "Chelsea won their fifth Premier League title with a 1\u20130 win away to West Bromwich Albion on 12 May.", "Chelsea lost the FA Cup Final to Arsenal after a 2\u20131 loss on 27 May.", "This season was the last for John Terry, who announced he will leave when his contract ends at the end of the season after Chelsea's final game.\n\n", "The season saw Chelsea equal the Premier League records for consecutive wins in a season (13), fewest draws in a season (3), fewest home draws in a season (0), and home and away wins against different sides (12)." ] ], "gold": "The number of games Chelsea has won in a row varies between preseason and regular season as well as throughout the years. During the regular 2017-2018 season, the team achieved 3 victories in a row, but only 2 during the preseason. The regular 2015-2016 season saw the team achieving the same number of matches won in a row as in the 2017-2018 edition, but also saw 0 during the preseason. During the regular 2016-2017 season, the team achieved the impressive figure of 13 victories in a row, but only a fraction of that, 3, during the preseason. ", "prediction 1": "In the 2016\u201317 season, Chelsea won a total of 13 games in a row. This was Chelsea's 103rd competitive season, 28th consecutive season in the top flight of English football, 25th consecutive season in the Premier League, and 111th year in existence as a football club.", "prediction 2": "Chelsea won 13 consecutive games in a row last season. This was the most games they have ever won in a row. This was the most games they have won in a row in the Premier League.", "prediction 3": "The 2016\u201317 season was Chelsea's 103rd competitive season, 28th consecutive season in the top flight of English football, 25th consecutive season in the Premier League, and 111th year in existence as a football club. The team won 13 consecutive games in a row and also equaled the Premier League records for consecutive wins in a season, fewest draws in a season, fewest home draws in a season, and home and away wins against different sides.", "prediction 4": "During the 2016-17 season, Chelsea won 13 games in a row.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 267 } ], "missing-info": [], "corrected-prediction": "In the 2016\u201317 season, Chelsea won a total of 13 games in a row. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "What channel did fresh prince of bel air air on?", "passages": [ [ "Lois & Clark: The New Adventures of Superman", "The series premiered on BBC One on Saturday, January 8, 1994, with repeat showings until 2002.", "In the UK the series was retitled \"The New Adventures of Superman\".", "The BBC held the rights to premiere the first three seasons.", "It also aired on CBBC's Saturday Aardvark strand (later known as Planet Saturday) at 8:30 am.", "BBC Two has also repeated the series at tea times alongside \"The Simpsons\", \"The Fresh Prince of Bel-Air\" and many others.", "Sky One held the premiere rights to the fourth season in 1997 and broadcast the show under the original full title.", "The BBC broadcast the episodes a few weeks later.", "Sky One broadcast seasons one, two and three just before the premiere of season four in early 1997.", "UK Gold, Sky Living, Bravo, Channel One and ITV2 have also repeated the series.", "BBC2 last repeated season one in late 2005.", "Satellite channel Syfy repeated the first two seasons and the first half of season three in 2012, before replacing it with \"Smallville\".", "Warner Home Video has released all four seasons of \"Lois & Clark:", "The New Adventures of Superman\" on DVD in Regions 1, 2, and 4." ], [ "Susan Borowitz", "Susan Borowitz\n\nSusan Stevenson Borowitz is an American writer and producer.", "She is best known for her work on \"Family Ties, The Fresh Prince of Bel-Air, Aliens in the Family\", and \"Pleasantville\"\".\"", "During her marriage to writer and comedian, Andy Borowitz (1982\u20132005), the two co-created \"The Fresh Prince of Bel-Air.\"", "This series ran from 1990\u20131996 and led to Will Smith's stardom.", "It won NAACP's Image Award for Outstanding Comedy Series in 1993.", "In addition, Susan and Andy co-created and produced many other television situation comedies.", "Susan is the author of the comedic novel, \"When We\u2019re in Public, Pretend You Don\u2019t Know Me: Surviving Your Daughter's Adolescence", "So You Don't Look Like an Idiot and She Still Talks to You,\" published in 2003.", "Susan Stevenson was born on March 6, 1959 in Lower Merion, Pennsylvania.", "She knew from a young age that she was passionate about writing and story creation.", "Both her parents, Robert Large Stevenson and Norma Willis Stevenson, were artists.", "As a result, there were many art artifacts scattered throughout Susan's family home.", "Growing up, she would often work on art projects, which later turned into illustrations in the form of books that she ultimately used to tell a story." ], [ "The Fresh Prince of Bel-Air", "The Fresh Prince of Bel-Air\n\nThe Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996.", "The show stars Will \"The Fresh Prince\" Smith as a fictionalized version of himself, a street-smart teenager from West Philadelphia who is sent to move in with his wealthy aunt and uncle in their Bel Air mansion after getting into a fight in his hometown.", "In the series, his lifestyle often clashes with the lifestyle of his relatives in Bel Air.", "The series ran for six seasons and aired 148 episodes.", "In 1990, music manager Benny Medina, along with his partner real estate mogul Jeff Pollack, decided to market a TV story based on Medina\u2019s life.", "Medina had grown up poor in East Los Angeles but his life changed when he befriended a rich white teenager, whose family lived in Beverly Hills and allowed Medina to live with them.", "Medina decided to use this part of his life as the main focus of the show.", "However, given that by then a black character living with a white family was a concept that had been done multiple times on TV, Medina decided to change the rich white family to a rich black family \u201cThat way we could explore Black-on-Black prejudice as well as Black class differences\u201c said Medina in an interview for \"Ebony\" magazine." ] ], "gold": "The Fresh Prince of Bel-Air is an American sitcom television series that was a top hit for NBC where it originally aired in America from 1990 to 1996. The series was also very popular in the United Kingdom, where it was first aired on BBC Two. The show was released to syndication in 1994 and reruns have been aired on several stations.", "prediction 1": "The Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996. The show stars Will \"The Fresh Prince\" Smith as a fictionalized version of himself, a street-smart teenager from West Philadelphia who is sent to move in with his wealthy aunt and uncle in their Bel Air mansion after getting into a fight in his hometown. The series originally aired on NBC from September 10, 1990 to May 20, 1996. The series was retitled The New Adventures of Superman and aired on CBBC's Saturday Aardvark strand (later known as Planet Saturday).", "prediction 2": "The Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996. It stars Will \"The Fresh Prince\" Smith as a fictionalized version of himself, a street-smart teenager from West Philadelphia who is sent to move in with his wealthy aunt and uncle in their Bel Air mansion after getting into a fight in his hometown. The series originally aired on NBC from September 10, 1990 to May 20, 1996.", "prediction 3": "The Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996. The series premiered on BBC One on Saturday, January 8, 1994, with repeat showings until 2002. In the UK the series was retitled The New Adventures of Superman. Sky One held the premiere rights to the fourth season in 1997 and broadcast the show under the original full title. NBC broadcast the episodes a few weeks later.", "prediction 4": "The Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996. The show stars Will \"The Fresh Prince\" Smith as a fictionalized version of himself, a street-smart teenager from West Philadelphia who is sent to move in with his wealthy aunt and uncle in their Bel Air mansion after getting into a fight in his hometown. NBC and CBS also air the series on Sundays and Saturdays. The series was retitled The New Adventures of Superman.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 374 }, { "error type": "Redundant", "explanation": "originally aired on NBC from September 10, 1990 to May 20, 1996. ", "start": 375, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 584 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Fresh Prince of Bel-Air is an American sitcom that originally aired on NBC from September 10, 1990 to May 20, 1996. The series premiered on BBC One on Saturday, January 8, 1994, with repeat showings until 2002." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When did the united states get involved in ww1?", "passages": [ [ "United States in World War I", "Under the leadership of President Woodrow Wilson, the war represented the climax of the Progressive Era as it sought to bring reform and democracy to the world, although there was substantial public opposition to U.S. entry into the war.", "The American entry into World War I came on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war.", "Apart from an Anglophile element urging early support for the British, American public opinion reflected that of the president: the sentiment for neutrality was particularly strong among Irish Americans, German Americans and Scandinavian Americans, as well as among church leaders and among women in general.", "On the other hand, even before World War I had broken out, American opinion had been more negative toward Germany than towards any other country in Europe.", "Over time, especially after reports of atrocities in Belgium in 1914 and following the sinking of the passenger liner \"RMS Lusitania\" in 1915, the American people increasingly came to see Germany as the aggressor in Europe." ], [ "American entry into World War I", "Until 1917, Wilson made minimal preparations for a land war and kept the United States Army on a small peacetime footing, despite increasing demands for enhanced preparedness.", "He did, however, expand the United States Navy.", "In 1917, with Russia experiencing political upheaval, and with Britain and France low on credit, Germany appeared to have the upper hand in Europe, In January 1917 Germany decided to resume unrestricted submarine warfare with no warning to passengers or crews.", "Its goal was to starve Britain into surrender.", "although it realized that it would almost certainly bring the United States into the war.", "Germany also made a secret offer to help Mexico regain territories lost in the Mexican\u2013American War in an encoded telegram known as the Zimmermann Telegram, which was intercepted by British Intelligence.", "Publication of that communique outraged Americans just as German U-boats started sinking American merchant ships in the North Atlantic.", "Wilson then asked Congress for \"a war to end all wars\" that would \"make the world safe for democracy\", and Congress voted to declare war on Germany on April 6, 1917.", "On December 7, 1917, the U.S. declared war on Austria-Hungary.", "U.S. troops began arriving on the Western Front in large numbers in 1918." ] ], "gold": "When WWI began, most of the American people and the American president, Woodrow Wilson, wanted to stay out of it. However, US sentiment changed after learning that Germany offered to help Mexico regain land that it had lost to America in the Mexican-American War, and German submarines started sinking American merchant ships. President Wilson then asked the US Congress for \"a war to end all wars\" and Congress declared war on Germany on April 6, 1917. American troops began combat operations on the Western Front of WWI in the summer of 1918.", "prediction 1": "The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. The entry into World War I came on April 6, 1917, after Congress voted to declare war on Germany on April 6, 1917. The war represented the climax of the Progressive Era as it sought to bring reform and democracy to the world, although there was substantial public opposition to U.S. entry into the war.", "prediction 2": "The United States entered World War I on April 6, 1917. The date the United States got involved in World War I was April 6, 1917.", "prediction 3": "The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. Until 1917, the United States had made minimal preparations for a land war and kept the United States Army on a small peacetime footing, despite increasing demands for enhanced preparedness. Until 1917, the United States entered World War I on June 16, 1918, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of efforts by President Woodrow Wilson to keep the United States out of efforts by President Woodrow Wilson to keep the United States out of the war.", "prediction 4": "The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. Until then, the United States was involved in minimal preparations for a land war and kept the United States Army on a small peacetime footing in the war. On December 7, 1917, the U.S. declared war on Austria-Hungary. The U.S. entry into World War I came on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 476 }, { "error type": "Redundant", "explanation": "The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. ", "start": 174, "end": 223 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6, 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The United States entered World War I on April 6, 1917, after more than two and a half years of efforts by President Woodrow Wilson to keep the United States out of the war. Germany offered Mexico to help regain lost territories as well as started sinking merchant ships. Wilson asked Congress for \"a war to end all wars\" that would \"make the world safe for democracy\", and afterwards Congress voted to declare war on Germany on April 6, 1917. U.S. troops began arriving on the Western Front in large numbers in 1918." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Where did it takes a village to raise a child come from?", "passages": [ [ "It takes a village", "It takes a village\n\nIt takes a village to raise a child is an African proverb which means that it takes an entire community of different people interacting with children in order for a child to experience and grow in a safe environment.", "The villagers would look out for the children.", "This does not mean an entire village is responsible for raising your children and/or the children of a crowd.", "The proverb has been attributed to African cultures.", "In 2016, NPR decided to research the origins of the proverb and concluded it was unable to pinpoint its origins, though academics said the proverb nevertheless holds the true spirits of some African cultures.", "Examples of African societies with proverbs which translate to 'It takes a village \u2026' include the following:" ] ], "gold": "\"It takes a village to raise a child\" is an African proverb that means that an entire community of people must provide for and interact positively with children for those children to experience and grow in a safe and healthy environment. It is attributed to the Nigerian Igbo culture, particularly related to the local saying \"Oran a azu nwa\".", "prediction 1": "It takes a village to raise a child comes from an African proverb. The proverb has been attributed to African cultures. In 2016, NPR decided to research the origins of the proverb and concluded it was unable to pinpoint its origins. Academics said the proverb nevertheless holds the true spirits of some African cultures.", "prediction 2": "It takes a village to raise a child is an African proverb that means that it takes an entire community of different people interacting with children in order for a child to experience and grow in a safe environment.", "prediction 3": "It takes a village to raise a child comes from an African proverb. This means it takes an entire community of different people interacting with children in order for a child to experience and grow in a safe environment. The villagers would look out for the children. The proverb has been attributed to African cultures.", "prediction 4": "It takes a village to raise a child is an African proverb that means that it takes an entire community of different people interacting with children in order for a child to experience and grow in a safe environment. The proverb has been attributed to African cultures. In 2016, NPR decided to research the origins of the proverb and concluded it was unable to pinpoint its origins, though academics said the proverb nevertheless holds the true spirits of some African cultures.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 321 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "It takes a village to raise a child comes from an African proverb which means that it takes an entire community of different people interacting with children in order for a child to experience and grow in a safe environment. The proverb has been attributed to African cultures. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who plays liam on season 8 of shameless?", "passages": [ [ "Shameless (UK TV series)", "Shameless (UK TV series)\n\nShameless is a British comedy-drama series set in Manchester on the fictional Chatsworth council estate.", "Produced by Company Pictures for Channel 4, the series aired from 13 January 2004 to 28 May 2013.", "The comedy drama, centred on British working class culture, was accorded critical acclaim by various sections of the British media, including \"The Sun\" newspaper and \"Newsnight Review\" on BBC Two.", "The programme was created and partially written by Paul Abbott, who is also the programme's executive producer.", "In 2005, the show won \"Best Drama Series\" at the BAFTA TV Awards and \"Best TV Comedy Drama\" at the British Comedy Awards.", "The network Showtime adapted the series into its own American version, which debuted in 2011.", "The first series of Shameless ran from 19 January to 24 February 2004.", "It consisted of seven episodes.", "The first series chronicled the life of the Noblett family and their neighbours.", "David Threlfall was cast as alcoholic father of six, Frank Gallagher.", "Anne-Marie Duff was cast as his eldest daughter and \"head\" of the family, Fiona.", "Jody Latham and Gerard Kearns played Gallagher brothers Lip and Ian." ], [ "Shameless (season 1)", "The season also follows Kev and Veronica, the Gallagher's neighbours, as they are forced to become foster parents due to fertility problems.", "The Gallagher patriarch, Frank meets Sheila Jackson, the mother of Lip's girlfriend Karen and the two become a couple.", "Lip also discovers that his closest brother, Ian is gay and having an affair with a married man.", "But this could soon change when Ian starts an affair of his own, with a local bad boy.", "The absent mother of the Gallagher clan, Monica returns with her lesbian lover Roberta and the couple want to take Liam to live with them.", "\n\nHBO began developing an American version of \"Shameless\" after striking a deal with John Wells in January 2009.", "By October 2009 the development had moved to Showtime.", "John Wells Productions filmed a pilot episode for the cable network in December 2009.", "William H. Macy stars in the lead role as Frank Gallagher.", "Also joining the cast were former \"Dragonball Evolution\" co-stars Emmy Rossum as Fiona and Justin Chatwin as Steve.", "Paul Abbott, whose semi-autobiographical telescript became the pilot episode for the original UK version, is credited as an executive producer on the U.S. version.", "In April 2010, Showtime green-lit the series with a twelve-episode order." ], [ "Johnny Bennett", "Johnny Bennett\n\nJonathan \"\"Johnny\"\" Kevin Bennett (born 10 June 1998) is an English-born Irish actor who played Liam Gallagher in \"Shameless\".", "He took over from Joseph Furnace from series 3 onwards and continued to play the role until series 8.", "He lives in Manchester but comes from an Irish family.", "Bennett, who can play the Balaika, is also an avid collector of paintings from Mancunian artist, Ian Jarman, according to the December 2006 article of The Art Observer, found online.", "Bennett regularly donates a portion of his wealth to charities that help blind children play video games." ] ], "gold": "Shameless is a British comedy drama television series set in Manchester on the fictional Chatsworth council estate and centered on British working-class culture, that was received with critical acclaim by the British media when it came out. The series inspired an American adaptation written by Paul Abbott, who also worked on the original. The character of Liam, the youngest of the Gallagher children, appears in both shows. He was originally played by Johnny Bennett on the British version and later portrayed by Christian Isaiah when the show was adapted in the US.", "prediction 1": "Kevin Bennett plays Liam Gallagher in the English television series Shameless. Bennett took over from English-born Irish actor Joseph Furnace from series 3 onwards and continued to play the role until series 8.", "prediction 2": "Kevin Bennett plays Liam Gallagher on the English-language television series Shameless. He took over from Joe Furnace from series 3 onwards and continued to play the role until series 8. Jonathan \"\"Johnny\"\" Bennett, an English-born Irish actor, played Liam on the English-language television series Shameless.", "prediction 3": "Kevin Bennett played Liam Gallagher on Shameless season 8 from season 3 to series 8. Bennett was an English-born Irish actor and took over from Joseph Furnace from series 3 onwards and continued to play the role until series 8.", "prediction 4": "Kevin Bennett is an English-born Irish actor who played Liam Gallagher in Shameless. He took over from Joseph Furnace from series 3 onwards and continued to play the role until series 8.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 210 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Shameless is a British comedy drama television series set in Manchester on the fictional Chatsworth council estate and centered on British working-class culture, that was received with critical acclaim by the British media when it came out. The network Showtime adapted the series into its own American version. Kevin Bennett plays Liam Gallagher in the English television series Shameless. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who came up with the five factor model?", "passages": [ [ "Big Five personality traits", "They reduced the lists of these descriptors (arbitrarily) by 5\u201310 fold and then used factor analysis to group the remaining traits (using data mostly based upon people's estimations, in self-report questionnaire and peer ratings) in order to find the underlying factors of personality.", "The initial model was advanced by Ernest Tupes and Raymond Christal in 1961, but failed to reach an academic audience until the 1980s.", "In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization.", "These five overarching domains have been found to contain and subsume most known personality traits and are assumed to represent the basic structure behind all personality traits.", "At least four sets of researchers have worked independently within lexical hypothesis in personality theory for decades on this problem and have identified generally the same five factors: Tupes and Christal were first, followed by Goldberg at the Oregon Research Institute, Cattell at the University of Illinois, and Costa and McCrae.", "These four sets of researchers used somewhat different methods in finding the five traits, and thus each set of five factors has somewhat different names and definitions.", "However, all have been found to be highly inter-correlated and factor-analytically aligned." ], [ "Big Five personality traits", "That these underlying factors can be found is consistent with the lexical hypothesis: personality characteristics that are most important in people's lives will eventually become a part of their language and, secondly, that more important personality characteristics are more likely to be encoded into language as a single word.", "The five factors are:\n\nPeople who do not exhibit a clear predisposition to a single factor in each dimension above are considered adaptable, moderate and reasonable, yet they can also be perceived as unprincipled, inscrutable and calculating.", "Depending on how much of each trait a person has, it could make someone more susceptible to participating in certain activities.", "Family life and the way someone was raised will also affect these traits.", "Twin studies and other research have shown that about half of the variation between individuals results from their genetics and half from their environments.", "Researchers have found conscientiousness, extraversion, openness to experience, and neuroticism to be relatively stable from childhood through adulthood.", "The Big Five personality traits was the model to comprehend the relationship between personality and academic behaviors.", "This model was defined by several independent sets of researchers who used factor analysis of verbal descriptors of human behavior.", "These researchers began by studying relationships between a large number of verbal descriptors related to personality traits." ] ], "gold": "The Big Five personality traits was the model to comprehend the relationship between personality and academic behaviors and was defined by several independent sets of researchers who used factor analysis of verbal descriptors of human behavior. The initial model was advanced by Ernest Tupes and Raymond Christal in 1961, but failed to reach an academic audience until the 1980s. In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization. These five overarching domains have been found to contain and subsume most known personality traits and are assumed to represent the basic structure behind all personality traits.", "prediction 1": "The initial model was advanced by Ernest Tupes and Raymond Christal in 1961, but failed to reach an academic audience until the 1980s. In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization.", "prediction 2": "Ernest Tupes and Raymond Christal developed the initial model of personality that was advanced in 1961, but failed to reach an academic audience until the 1980s. In 1990, J.M. Digman developed his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization. These five overarching domains have been found to contain and subsume most known personality traits, and are assumed to represent the basic structure behind all personality traits.", "prediction 3": "Ernest Tupes and Raymond Christal in 1961 advanced the initial model, which failed to reach an academic audience until the 1980s. In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization. These five overarching domains have been found to contain and subsume most known personality traits. These five factors have been found to represent the basic structure behind all personality traits, and thus, they have generally the same five factors. However, these four sets of researchers used somewhat different methods in finding the five factors, so that each set of five factors has somewhat different names and definitions, but they are highly inter-correlated and factor-analytically aligned.", "prediction 4": "The five factor model of personality was originally developed by Ernest Tupes and Raymond Christal in 1961, but failed to reach an academic audience until the 1980s. In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization. These five overarching domains have been found to contain and subsume most known personality traits and are assumed to represent the basic structure behind all personality traits.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Big Five personality traits was the model to comprehend the relationship between personality and academic behaviors. This model was defined by several independent sets of researchers who used factor analysis of verbal descriptors of human behavior. The initial model was advanced by Ernest Tupes and Raymond Christal in 1961, but failed to reach an academic audience until the 1980s. In 1990, J.M. Digman advanced his five-factor model of personality, which Lewis Goldberg extended to the highest level of organization. These five overarching domains have been found to contain and subsume most known personality traits and are assumed to represent the basic structure behind all personality traits." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "Who wants to be a millionaire american winner?", "passages": [ [ "Who Wants to Be a Millionaire? (UK game show)", "Although the Defence provided evidence claiming Whittock's coughing was a result of dust allergies and a hay fever he was suffering from, and Whittock himself testified against the accusations, the Prosecution refuted these claims with their evidence, including footage that showed Whittock stopped coughing when he became a contestant after Ingram.", "On 7 April 2003, the group were found guilty, with all three given suspended prison sentences and fines, with the Ingrams later ordered to pay legal costs within two months of the trial's conclusion.", "On 24 July 2003, the British Army ordered Charles Ingram to resign his commission as a Major, in the wake of the trial.", "In the aftermath of the trial, the scandal became the subject of a documentary entitled \"Millionaire: A Major Fraud\", presented by Martin Bashir and broadcast on 21 April 2003, with a follow-up two weeks later entitled \"Millionaire: The Final Answer\".", "The documentary featured excerpts from the recording that had been enhanced for the Ingrams' trial, footage of the actions made by Ingram's wife in the audience, and interviews with production staff and some of the contestants who had been present during the recording." ], [ "Who Wants to Be a Millionaire (U.S. game show)", "On November 11, Murray was asked approximately how many people had lived on Earth in its history and correctly guessed 100 billion.", "Murray was still atop the leaderboard entering the November 20 finale as he remained the only contestant to even attempt to answer his or her question.", "The only person who could defeat him was top seed and $250,000 winner Jehan Shamsid-Deen, who was asked a question regarding the Blorenge, cited as \"a rare example of a word that rhymes with orange\".", "Shamsid-Deen considered taking the risk, believing (correctly) that the name belonged to a mountain in Wales.", "However, she decided that the potential of losing $225,000 did not justify the risk and elected to walk away from the question, giving Murray the win and the million dollar prize.", "Since its introduction to the United States, GSN credited \"Who Wants to Be a Millionaire\" with not only single-handedly reviving the game show genre, but also breaking new ground for it.", "The series revolutionized the look and feel of game shows with its unique lighting system, dramatic music cues, and futuristic set." ], [ "Who Wants to Be a Millionaire (U.S. game show)", "Who Wants to Be a Millionaire (U.S. game show)\n\nWho Wants to Be a Millionaire (often informally called Millionaire) is an American television game show based on the same-titled British program and developed for the United States by Michael Davies.", "The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty (although, for a time, most of the questions were of random difficulty).", "The program has endured as one of the longest-running and most successful international variants in the \"Who Wants to Be a Millionaire?\" franchise.", "The original U.S. version aired on ABC from August 16, 1999, to June 27, 2002, and was hosted by Regis Philbin.", "The daily syndicated version of the show began airing on September 16, 2002, and was hosted for eleven seasons by Meredith Vieira until May 31, 2013.", "Later hosts included Cedric the Entertainer in the 2013\u201314 season, Terry Crews in the following season (2014\u201315), and Chris Harrison, who began hosting on September 14, 2015.", "As the first U.S. network game show to offer a million-dollar top prize, the show made television history by becoming one of the highest-rated game shows in the history of American television." ] ], "gold": "Who Wants to Be a Millionaire is an American television game show adapted from the same-titled British program that features a quiz competition with contestants attempting to win a top prize of $1,000,000 by answering a series of multiple-choice questions, usually of increasing difficulty. Many people have won the show throughout the years. John Carpenter became the first top prize winner in the show on November 19, 1999, while Kevin Smith was the first to do so during the syndicated version of the program on February 18, 2003. Nancy Christy is the most recent winner of a regular episode, also being the first and only woman to get the $1,000,000 prize, while Sam Murray was the winner during the Tournament of Ten edition.", "prediction 1": "Who Wants to Be a Millionaire is an American television game show that aired on ABC from August 16, 1999, to June 27, 2002. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The first American winner was Jehan Shamsid-Deen, who was asked a question regarding the Blorenge, cited as \"a rare example of a word that rhymes with orange\".", "prediction 2": "Who Wants to Be a Millionaire is an American television game show based on the same-titled British program and developed for the United States by Michael Davies. The program features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The show made television history by becoming one of the highest-rated game shows in the history of American television.", "prediction 3": "Who Wants to Be a Millionaire is an American television game show based on the same-titled British program and developed for the United States by Michael Davies. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The original U.S. version aired on ABC from August 16, 1999, to June 27, 2002, and was hosted by Regis Philbin.", "prediction 4": "Who Wants to Be a Millionaire is an American game show based on the same-titled British program and developed for the United States by Michael Davies. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. The first U.S. network game show to offer a million-dollar top prize, the show made television history by becoming one of the highest-rated game shows in the history of American television. The second year the game show aire winner was Jehan Shamsid-Deen. Ingram had won $250,000 prize when he had a million dollar win.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 123 }, { "error type": "Unverifiable", "explanation": "", "start": 300, "end": 349 }, { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 459 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Who Wants to Be a Millionaire is an American television game show based on the same-titled British program. The show features a quiz competition in which contestants attempt to win a top prize of $1,000,000 by answering a series of multiple-choice questions of increasing difficulty. Sam Murray was the winner. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who came in 2nd in the first presidential election?", "passages": [ [ "1800 United States presidential election", "1800 United States presidential election\n\nThe United States presidential election of 1800 was the fourth United States presidential election.", "It was held from Friday, October 31 to Wednesday, December 3, 1800.", "In what is sometimes referred to as the \"Revolution of 1800\", Vice President Thomas Jefferson of the Democratic-Republican Party defeated incumbent President John Adams of the Federalist Party.", "The election was a realigning election that ushered in a generation of Democratic-Republican rule.", "Adams had narrowly defeated Jefferson in the 1796 election.", "Under the rules of the electoral system that were in place prior to the 1804 ratification of the 12th Amendment, each member of the Electoral College cast two votes, with no distinction made between electoral votes for president and electoral votes for vice president.", "As Jefferson received the second-most votes in 1796, he was elected vice president.", "In 1800, unlike in 1796, both parties formally nominated tickets.", "The Democratic-Republicans nominated a ticket consisting of Jefferson and Aaron Burr, while the Federalists nominated a ticket consisting of Adams and Charles Pinckney.", "Each party formed a plan in which one of their respective electors would vote for a third candidate or abstain so that their preferred presidential candidate (Adams for the Federalists and Jefferson for the Democratic-Republicans) would win one more vote than the party's other nominee.", "The chief political issues revolved around the fallout from the French Revolution and the Quasi-War." ], [ "1952 Indian presidential election", "1952 Indian presidential election\n\nThe Election Commission of India held the first presidential elections of India on May 2, 1952.", "Dr. Rajendra Prasad won his first election with 507,400 votes (83.81%) over his nearest rival K. T. Shah who got 92,827 votes (15.3%).", "Source: Web archive of Election Commission of India website" ], [ "1800 United States presidential election", "In April, Burr's successful mobilization of the vote in New York City succeeded in reversing the Federalist majority in the state legislature to provide decisive support for the Democratic-Republican ticket.", "With the two parties tied 63\u201363 in the Electoral College in the autumn of 1800, the last state to vote, South Carolina, chose eight Democratic-Republicans to award the election to Jefferson and Burr.", "Under the United States Constitution as it then stood, each elector cast two votes, and the candidate with a majority of the votes was elected president, with the vice presidency going to the runner-up.", "The Federalists therefore arranged for one of their electors to vote for John Jay rather than for Pinckney.", "The Democratic-Republicans had a similar plan to have one of their electors cast a vote for another candidate instead of Burr, but failed to execute it, thus all of the Democratic-Republican electors cast their votes for both Jefferson and Burr, 73 in all for each of them.", "According to a provision of the United States Constitution, a tie in a case of this type had to be resolved by the House of Representatives, with each state casting one vote." ], [ "1911 Republic of China provisional presidential election", "1911 Republic of China provisional presidential election\n\nThe 1911 Republic of China Provisional Presidential and Vice-Presidential Election was the election held on 29 December 1911 during the Xinhai Revolution for the First Provisional President and Vice President of the Provisional Government of the Republic of China.", "Sun Yat-sen and Li Yuan-hung were elected as President and Vice-President respectively.", "Sun sworn in at midnight on 1 January 1912 and declared the official establishment of the Republic of China.", "One vote was given to each of the seventeen provinces presented in the assembly including Zhili, Henan, Shandong, Shanxi, Shaanxi, Hubei, Hunan, Guangdong, Guangxi, Sichuan, Yunnan, Guizhou, Jiangsu, Jiangxi, Zhejiang, Fujian, and Anhui." ] ], "gold": "Dr. Rajendra Prasad won the first presidential election of India, and K. T. Shah came in second place. In the first presidential election of China, Sun Yat-sen won first place, and Huang Hsing came in second. In the first presidential election of America, John Adams came in second place and served as the Vice President.", "prediction 1": "The first vice-presidential election was held in the United States in 1796, with John Adams coming in 2nd. In the first presidential election in the United States in 1800, Thomas Jefferson, of the Democratic-Republican Party, came in 2nd, and in the first presidential election in the United States in 1952, Rajendra Prasad, of the Republican Party, came in 2nd.", "prediction 2": "In the first presidential election, Thomas Jefferson came in 2nd, Aaron Burr came in 2nd, George Washington came in 3rd, and John Jay came in 4th. The second time Thomas Jefferson came in 2nd was in the second presidential election, the fourth one.", "prediction 3": "The first presidential election was held in 1796, when John Adams narrowly defeated Thomas Jefferson. In what is sometimes referred to as the \"Revolution of 1800\", vice president Thomas Jefferson of the Democratic-Republican Party defeated incumbent President John Adams of the Federalist Party. The Election Commission of India held the first presidential elections of India on May 2, 1952. Dr. Rajendra Prasad won his first election with 507,400 votes over his nearest rival K. T. Shah who got 92,827 votes (15.3%).", "prediction 4": "The first presidential election was held in 1796, when Thomas Jefferson of the Democratic-Republican Party came in second. In 1800, the next year, Vice President Thomas Jefferson of the Democratic-Republican Party came in second. The second presidential election was held in 1952, when Dr. Rajendra Prasad won his first election with 507,400 votes over his nearest rival K. T. Shah who got 92,827 votes. The second presidential election was held in 1912, where Sun Yat-sen came in the Republic of China.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 4, "end": 36 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 81, "end": 91 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 114, "end": 141 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 226, "end": 238 }, { "error type": "Redundant", "explanation": "In the first presidential election in the United States in 1800, Thomas Jefferson, of the Democratic-Republican Party, came in 2nd, and ", "start": 243, "end": 298 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 302, "end": 307 }, { "error type": "Unverifiable", "explanation": "", "start": 325, "end": 349 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 350, "end": 362 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "The first presidential elections of India had Dr. Rajendra Prasad win and K. T. Shah coming in second. In China's provisional election, Sun Yat-sen became the First Provisional President and Li Yuan-hung came in second, as the Vice President." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Most victories in ncaa division i men's college basketball?", "passages": [ [ "1992 NCAA Division I Men's Basketball Tournament", "1992 NCAA Division I Men's Basketball Tournament\n\nThe 1992 NCAA Division I Men's Basketball Tournament involved 64 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball.", "It began on March 19, 1992, and ended with the championship game on April 6 in Minneapolis, Minnesota.", "A total of 63 games were played.", "Duke, coached by Mike Krzyzewski, defeated the Michigan Wolverines, coached by Steve Fisher, 71\u201351 to claim their second consecutive national championship.", "Bobby Hurley of Duke was named the tournament's Most Outstanding Player.", "Michigan subsequently vacated its final two tournament games as part of the University of Michigan basketball scandal.", "This tournament is best remembered for the East regional final pitting Duke and Kentucky at The Spectrum in Philadelphia.", "With 2.1 seconds remaining in overtime, Duke trailed 103\u2013102.", "Grant Hill threw a pass the length of the court to Christian Laettner, who dribbled once, turned, and hit a jumper as time expired for the 104\u2013103 win.", "\"Sports Illustrated\" deemed it the greatest college basketball game of all time, and ESPN included it as number 17 on its list of top 100 sports moments of the past 25 years (see ESPN25).", "It is number one on the USA Today list of the greatest NCAA tournament games of all time." ], [ "Kentucky Wildcats men's basketball", "Kentucky Wildcats men's basketball\n\nThe Kentucky Wildcats men's basketball team is an American college basketball team that represents the University of Kentucky.", "Kentucky is the most successful NCAA Division I basketball program in history in terms of both all-time wins (2,263) and all-time winning percentage (.764).", "The Wildcats are currently coached by John Calipari.", "Kentucky leads all schools in total NCAA tournament appearances (58), NCAA tournament wins (126), NCAA Tournament games played (177), NCAA Sweet Sixteen appearances (43), NCAA Elite Eight appearances (37), and total postseason tournament appearances (65).", "Further, Kentucky has played in 17 NCAA Final Fours (tied for 2nd place all-time with UCLA), 12 NCAA Championship games, and has won 8 NCAA championships (second only to UCLA's 11).", "In addition to these titles, Kentucky won the National Invitation Tournament (NIT) in both 1946 and 1976, making it the only school to win multiple NCAA and NIT championships.", "Kentucky also leads all schools with sixty-two 20-win seasons, fifteen 30-win seasons, and six 35-win seasons.", "Throughout its history, the Kentucky basketball program has featured many notable and successful players, both on the collegiate level and the professional level." ], [ "Mike Krzyzewski", "He was inducted into the College Basketball Hall of Fame in 2006, and the United States Olympic Hall of Fame in 2009 (with the \"Dream Team\").", "On November 15, 2011, Krzyzewski led Duke to a 74\u201369 victory over Michigan State at Madison Square Garden to become the coach with the most wins in NCAA Division I men's basketball history.", "Krzyzewski's 903rd victory set a new record, breaking that held by his former coach, Bob Knight.", "On January 25, 2015, Duke defeated St. John's, 77\u201368, again at Madison Square Garden, as Krzyzewski became the first Division I men's basketball coach to reach 1,000 wins.", "Krzyzewski was born in Chicago, Illinois, the son of Polish American, Catholic parents Emily M. (n\u00e9e Pituch) and William Krzyzewski.", "Raised as a Catholic, Krzyzewski attended St. Helen Catholic School in Ukrainian Village, Chicago and, later, Archbishop Weber High School in Chicago, a Catholic prep school for boys.", "He graduated from the United States Military Academy at West Point, New York, in 1969, and played basketball under Bob Knight while training to become an officer in the United States Army." ] ], "gold": "The school with the most victories in NCAA Division I men's college basketball is the University of Kentucky. It's team, the Kentucky Wildcats, have an all-time wins record of 2320 . Alternatively, the coach with the most victories in the NCAA Division I is Mike Krzyzewski, who achieved the record on November 15, 2011, with a 74\u201369 victory over Michigan State. He later became the first Division I men's basketball coach to reach 1,000 wins on January 25, 2015, when he defeated St. John's 77\u201368.", "prediction 1": "There are several coaches who have won the most victories in NCAA Division I men's basketball history. In 1992, the most victories in NCAA Division I men's basketball history were by Mike Krzyzewski, with 94. Krzyzewski won the most victories in NCAA Division I men's basketball in 1991, followed by Bob Knight in 1992, and finally, on January 25, 2015, Krzyzewski became the first Division I men's basketball coach to reach 1,000 wins.", "prediction 2": "The most victories in NCAA Division I men's basketball history go to Mike Krzyzewski, who as a Duke coach has led the Blue Devils to ninety-three victories in total. The most victories in NCAA Division I men's basketball history go to Bob Knight, who held the record for most wins.", "prediction 3": "There are several men's NCAA Division I basketball coaches who have won the most victories. In 1992, Duke coached by Mike Krzyzewski defeated the Michigan Wolverines, coached by Steve Fisher, 71\u201351 to claim their second consecutive national championship. In 2015, Krzyzewski became the first Division I men's basketball coach to reach 1,000 wins.", "prediction 4": "In men's basketball, the 1992 NCAA Division I Men's Basketball Tournament involved 64 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball. The most victories for a coach in a single season are for Mike Krzyzewski, who led Duke to a 74\u201369 victory over Michigan State at Madison Square Garden to become the coach with the most victories in NCAA Division I men's basketball history. In the 1990s, the most victories for a single season is 10 wins. The most victories in a single-elimination play to determine the most victories in the history is 764. In the 2000, the University of Kentucky is the most successful NCAA Division I basketball program in terms of both all-time wins and all-time winning percentage.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 183, "end": 208 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 282, "end": 287 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 288, "end": 319 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several coaches who have won the most victories in NCAA Division I men's basketball history. Mike Krzyzewski won the most victories in NCAA Division I men's basketball. On November 15, 2011, Krzyzewski led Duke to a 74\u201369 victory over Michigan State, Krzyzewski's 903rd victory set a new record, breaking that held by his former coach, Bob Knight. On January 25, 2015, Krzyzewski became the first Division I men's basketball coach to reach 1,000 wins, defeating St. John's, 77\u201368. Kentucky Wildcats is the most successful NCAA Division I basketball program with 2,263 wins." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did witney carson start dancing with the stars?", "passages": [ [ "Witney Carson", "On October 3, 2015, Carson confirmed her engagement on Instagram to her boyfriend of four years, Carson McAllister.", "The couple married on January 1, 2016 in a private ceremony for The Church of Jesus Christ of Latter-Day Saints at the Salt Lake Temple in Salt Lake City.", "Fellow \"Dancing with the Stars\" dancers Brittany Cherry, Jenna Johnson, and Emma Slater were among her bridesmaids, with Lindsay Arnold serving as her matron of honor.", "At the age of 18, Carson auditioned for season nine of Fox network's hit show \"So You Think You Can Dance\".", "She made it through to the top twenty finalists.", "Her partner was ballet dancer and season winner Chehon Wespi-Tschopp.", "When only ten dancers remained, the contestants switched partners to a new all-star each week.", "As she proceeded to the top 6 dancers, Carson partnered with dancers Nick Lazzarini, Stephen \"Twitch\" Boss and Marko Germar before she was eliminated after the week-seven round which aired on September 2012.", "She returned as an all-star in season ten, partnering with top 6 dancer Paul Karmiryan and season winner, Du-shaunt \"Fik-shun\" Stegall.", "Witney was announced as a troupe dancer on reality television series, \"Dancing with the Stars\" in March 2013." ], [ "Witney Carson", "Witney Carson\n\nWitney Capri Carson McAllister (born October 17, 1993) is an American professional Latin ballroom dancer and choreographer.", "She first gained attention in 2012, when the 18-year-old finished ladies' second runner-up in season nine of \"So You Think You Can Dance\".", "Carson continued her professional dancing career in early 2013 as a troupe dancer in seasons 16 and 17 of \"Dancing with the Stars\".", "She was promoted to professional partner in season 18.", "In season 19, she and her partner Alfonso Ribeiro were announced the winners on November 25, 2014, making her one of six professional dancers to win the mirror ball trophy within their first two seasons.", "For that season, she received a nomination for the Primetime Emmy Award for Outstanding Choreography.", "Throughout her dance career, Carson has worked with dancers and choreographers such as Mia Michaels, Nappytabs, Travis Wall, Sonya Tayeh, Tyce Diorio, Mark Ballas, Derek Hough, and Stacey Tookey.", "Carson was born in American Fork, Utah.", "She is the oldest of four children.", "She has two brothers and a sister.", "She started her career as a dancer at the age of three, training in different dance styles including ballet, jazz, hip hop, ballroom and tap among many others.", "She has competed and performed around the world." ] ], "gold": "Witney Carson is an American professional Latin ballroom dancer and choreographer, who first gained attention in 2012, when the 18-year-old finished ladies' second runner-up in season nine of So You Think You Can Dance. Carson continued her professional dancing career in early 2013 as a troupe dancer in seasons 16 and 17 of Dancing with the Stars, and was promoted to professional partner in 2014 during season 18. In season 19, she and her partner Alfonso Ribeiro were announced the winners on November 25, 2014, making her one of six professional dancers to win the mirror ball trophy within their first two seasons. For that season, she received a nomination for the Primetime Emmy Award for Outstanding Choreography.", "prediction 1": "Witney Carson started dancing with the stars in 2012, when she auditioned for season nine of Fox network's hit show So You Think You Can Dance. She was promoted to professional partner in season 18 of the show.\n", "prediction 2": "Witney Carson started dancing with the stars in 2012, and finished as runner-up on the fourth season of So You Think You Can Dance. She was then announced as a troupe dancer on Seasons 16 and 17 of the show, and was promoted to professional partner in Season 18. Carson and her partner Alfonso Ribeiro were announced the winners of the competition in November 25, 2014, making her one of six professional dancers to win the mirror ball trophy within their first two seasons. She has since earned numerous scholarships to dancerar, and has also performed world-wide.", "prediction 3": "Witney Carson began dancing with the stars in 2013 and became a troupe dancer during seasons 16 and 17. She was promoted to professional partner in season 18. She won the competition on November 25,2014 with her partner, Alfonso Ribeiro.", "prediction 4": "Witney Carson started dancing with the stars in 2012 at the age of 18. She continued her professional dancing career in early 2013 as a troupe dancer in seasons 16 and 17 of Dancing with the Stars. She was promoted to professional partner in season 18. In season 19, she and her partner Alfonso Ribeiro were announced the winners on November 25, 2014.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Witney Carson is an American professional Latin ballroom dancer and choreographer, who first gained attention in 2012, when she auditioned for season nine of Fox network's hit show So You Think You Can Dance. Carson continued her professional dancing career in early 2013 as a troupe dancer in seasons 16 and 17 of Dancing with the Stars and was promoted to professional partner in season 18 of the show. In season 19, she and her partner Alfonso Ribeiro were announced the winners on November 25, 2014, making her one of six professional dancers to win the mirror ball trophy within their first two seasons. For that season, she received a nomination for the Primetime Emmy Award for Outstanding Choreography.\n" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who played gimli in the lord of the rings movies?", "passages": [ [ "Gimli (Middle-earth)", "Gimli was voiced by David Buck in Ralph Bakshi's 1978 animated version of \"The Lord of the Rings\".", "Here he is drawn as being almost as tall as the rest of the non-hobbit members of the Fellowship.", "Gimli does not appear in the 1980 animated version of \"The Return of the King\".", "He is portrayed by Tomi Salmela in the 1993 Finnish miniseries \"Hobitit\".", "In Peter Jackson's film trilogy (2001\u20132003) Gimli is played by John Rhys-Davies, who portrayed the character as having a Welsh accent.", "Rhys-Davies happened to be taller than the actors playing the Hobbits, who were only (actor Elijah Wood, playing Frodo Baggins) and (actors Sean Astin, Billy Boyd, and Dominic Monaghan, playing Sam Gamgee, Pippin Took, and Merry Brandybuck) while Rhys-Davies is .", "Thus in scenes where Gimli and the Hobbits appear together, their respective sizes remain in proportion, whereas in scenes where they have to interact with human-sized characters, tricks of scale had to be employed, especially since John Rhys-Davies is also taller than Viggo Mortensen and Orlando Bloom (who played Aragorn and Legolas respectively), both of whom are ." ], [ "The Lord of the Rings", "The Lord of the Rings\n\nThe Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien.", "The story began as a sequel to Tolkien's 1937 fantasy novel \"The Hobbit\", but eventually developed into a much larger work.", "Written in stages between 1937 and 1949, \"The Lord of the Rings\" is one of the best-selling novels ever written, with over 150 million copies sold.", "The title of the novel refers to the story's main antagonist, the Dark Lord Sauron, who had in an earlier age created the One Ring to rule the other Rings of Power as the ultimate weapon in his campaign to conquer and rule all of Middle-earth." ], [ "Gimli (Middle-earth)", "Gimli (Middle-earth)\n\nGimli is a fictional character from J. R. R. Tolkien's Middle-earth legendarium, featured in \"The Lord of the Rings\".", "A dwarf warrior, he is the son of Gl\u00f3in (a character from Tolkien's earlier novel, \"The Hobbit\").", "Gimli is chosen to represent the race of Dwarves in the Fellowship of the Ring.", "As such, he is one of the primary characters of the novel.", "In the course of the adventure, Gimli aids the Ring-bearer Frodo Baggins, participates in the War of the Ring, and becomes close friends with Legolas, overcoming an ancient enmity of Dwarves and Elves.", "Gimli was a member of Durin's Folk who volunteered to accompany Frodo Baggins as a member of the Fellowship of the Ring on the quest to destroy the One Ring.", "He was an honourable, wise, and stalwart warrior." ] ], "gold": "Gimli is a character from J.R.R. Tolkien's high-fantasy novel The Lord of the Rings that has appeared in different adaptations that the title has received. In 1978, Ralph Bakshi released an animated version where the character was voiced by David Buck. John Rhys-Davis portrayed the role in Peter Jackson's Lord of the Rings trilogy, widely regarded as one of the greatest and most influential film series ever made.", "prediction 1": "The Lord of the Rings is an epic high fantasy novel written by J. R. R. Tolkien. In the movies adaptation of the novel, Gimli is played by David Buck. In Peter Jackson's movie trilogy, Gimli is played by John Rhys-Davies, who portrayed the character as having a Welsh accent.", "prediction 2": "In the Lord of the Rings films, Gimli is played by a number of different people. In the 2001 version, John Rhys-Davies played the character with a Welsh accent. In the 2002 version, Gimli was played by Michael Pea. And in the 2003 version, Gimli was played by a number of different people.", "prediction 3": "The Lord of the Rings is a high fantasy novel written by J. R. R. Tolkien that was written as a sequel to the 1937 novel The Hobbit, but eventually developed into a much larger work. As of 2001, John Rhys-Davies played Gimli. In Peter Jackson's film trilogy, the role was portrayed by John Rhys-Davies, who portrayed the character as having a Welsh accent.", "prediction 4": "Gimli is a fictional character from J. R. R. Tolkien's Middle-earth legendarium, featured in The Lord of the Rings. In the Lord of the Rings movies, he was voiced by David Buck. In the Lord of the Rings film trilogy, he was played by John Rhys-Davies, who portrayed the character as having a Welsh accent.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Lord of the Rings is an epic high fantasy novel written by J. R. R. Tolkien. Gimli is played by David Buck in Ralph Bakshi's 1978 animated version of \"The Lord of the Rings\". In Peter Jackson's movie trilogy, Gimli is played by John Rhys-Davies, who portrayed the character as having a Welsh accent." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who holds the record of scoring the maximum number of runs in test cricket?", "passages": [ [ "Australia national cricket team", "The team was led by Bill Woodfull on his final tour and was notably dominated by Ponsford and Bradman, who twice put on partnerships of over 380 runs, with Bradman once again scoring a triple-century at Leeds.", "The bowling was dominated by the spin pair of Bill O'Reilly and Clarrie Grimmett, who took 53 wickets between them, with O'Reilly twice taking seven-wicket hauls.", "Sir Donald Bradman is widely considered the greatest batsman of all time.", "He dominated the sport from 1930 until his retirement in 1948, setting new records for the highest score in a Test innings (334 vs England at Headingley in 1930), the most number of runs (6996), the most number of centuries (29), the most number of double centuries and the highest Test and first-class batting averages.", "His record for the highest Test batting average \u2013 99.94 \u2013 has never been beaten.", "It is almost 40 runs per innings above the next highest average.", "He would have finished with an average of over 100 runs per innings if he had not been dismissed for a duck in his last Test.", "He was knighted in 1949 for services to cricket.", "He is generally considered one of Australia's greatest sporting heroes." ], [ "Sachin Tendulkar", "South Africa toured in March and April 2008 for a three-Test series.", "Tendulkar scored a five-ball duck in his only innings of the series; he sustained a groin strain in the match and as a result was forced not only to miss the second and third Tests, but also the tri-series involving Bangladesh, the 2008 Asia Cup, and the first half of the inaugural season of the IPL.", "Before the Indian cricket team's tour of Sri Lanka in July 2008, Tendulkar needed 177 runs to go past Brian Lara's record of Test 11,953 runs.", "However, he failed in all six innings, scoring a total of 95 runs.", "India lost the series and his average of 15.83 was his worst in a Test series with at least three matches.", "In the following ODI series against Sri Lanka, Tendulkar was sidelined due to injury.", "However, during the following Australia tour of India, he returned to fitness and form, scoring 13 and 49 in the first Test before making 88 in the first innings of the second Test, breaking the record for most number of Test runs held by Brian Lara.", "He also reached the 12,000 run mark when he was on 61.", "He described the achievement as the biggest in 19 years of his career on the day he achieved the record." ], [ "Graham Gooch", "His aggregate of 456 for the match remains a world record for a Test match, as does his aggregate of 753 for the 3-match series.", "Both series were won, and in 1990 Gooch was awarded Professional Cricketers' Association Player of the Year.", "The winter tour of Australia did not, however, go according to plan, England losing 3\u20130 despite holding first-innings leads in the first two tests (both of which were lost), although Gooch scored a marvellous hundred chasing an improbable total in the drawn 4th test.", "Gooch had a public falling-out with David Gower, the England batsman, particularly after Gower hired a vintage aircraft and 'buzzed' the ground where England was playing during the unsuccessful tour of Australia in 1990/91.", "Gooch contributed to the decision to omit Gower from England's tour of India in 1993, which proved so controversial that an extraordinary vote of no confidence in the selectors was passed at the MCC.", "Gower never played another Test, lending an ironic edge to Gooch's surpassing him as England's leading run scorer in the 1993 Ashes series." ] ], "gold": "Sachin Tendulkar holds the record for most runs scored in test cricket in a career with 11,953. Graham Gooch hold the record for most runs scored in a match in test cricket with 456. Donald Bradman has the record for most runs in a series with 974. Mohammad Yousuf has the record for most runs in a calendar year with 1788 in 2006.", "prediction 1": "Sir Donald Bradman is widely considered the greatest batsman of all time. He dominated the sport from 1930 until his retirement in 1948, setting new records for the highest score in a Test innings (334 vs England at Headingley in 1930), the most number of runs (6996), the most number of centuries (29), the most number of double centuries and the highest Test and first-class batting averages. Sachin Tendulkar holds the record for scoring the most number of Test runs in a Test innings, scoring a total of 12,5162 runs. His aggregate of 456 for the match remains a world record for a Test match, as does his aggregate of 753 for the 3-match series.", "prediction 2": "Sir Donald Bradman is widely considered the greatest batsman of all time. He dominated the sport from 1930 until his retirement in 1948, setting new records for the highest score in a Test innings (334 vs England at Headingley in 1930), the most number of runs (6996), the most number of centuries (29), the most number of double centuries and the highest Test and first-class batting averages. However, before the Indian cricket team's tour of Sri Lanka in July 2008, Sachin Tendulkar needed 177 runs to go past Brian Lara's record for most number of Test 11,953 runs. However, he failed in all six innings, scoring a total of 95 runs. He also reached the 12,000 run mark when he was on 61. Gooch broke the record for most number of Test runs held by David Gower.", "prediction 3": "The record for scoring the maximum number of runs in Test cricket is held by Sir Donald Bradman, who is widely considered to be the greatest batsman of all time. Brian Lara holds the record for the most number of Test runs scored in a single innings in Test cricket, with his total of 11,953 runs in one Test. However, Graham Gooch holds the record for scoring the maximum number of runs in a single innings in Test cricket.", "prediction 4": "Sir Donald Bradman is widely considered to be the greatest batsman of all time. He dominated the sport from 1930 until his retirement in 1948, setting new records for the highest score in a Test innings (334 vs England at Headingley in 1930), the most number of runs (6996), the most number of centuries (29), the most number of double centuries and the highest Test and first-class batting averages. His record for the highest Test batting average \u2013 99.94 \u2013 has never been beaten. It is almost 40 runs per innings above the next highest average. His record for the highest Test batting average \u2013 99.94 \u2013 has never been beaten. It is almost 40 runs per innings above the next highest average. It is almost 40 runs per innings above the next highest average. It is almost 40 runs per innings above the next highest average. It is almost 40 runs per innings above the next highest", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 394 }, { "error type": "Irrelevant", "explanation": "", "start": 522, "end": 650 }, { "error type": "Unverifiable", "explanation": "", "start": 470, "end": 521 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sir Donald Bradman has the most number of runs 6996 in a Test innings. Sachin Tendulkar holds the record for scoring the most number of Test runs. Graham Gooch's aggregate of 456 for the match remains a world record for a Test match, as does his aggregate of 753 for the 3-match series." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays the queen of hearts in alice and wonderland?", "passages": [ [ "Alice in Wonderland (1951 film)", "Alice in Wonderland (1951 film)\n\nAlice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll.", "the 13th release of Disney's animated features, the film premiered in London on July 26, 1951 and in New York City on July 28, 1951.", "The film features the voices of Kathryn Beaumont as Alice, Sterling Holloway as the Cheshire Cat, Verna Felton as the Queen of Hearts, and Ed Wynn as the Mad Hatter.", "Walt Disney first attempted unsuccessfully to adapt \"Alice\" into an animated feature film during the 1930s.", "However, he finally revived the idea in the 1940s.", "The film was originally intended to be a live-action/animated film; however, Disney decided to make it an all-animated feature in 1946.", "The film was considered a flop on its initial release, leading to Walt Disney showing it on television as one of the first episodes of his TV series Disneyland.", "It proved to be very successful on Television, especially during the psychedelic era.", "It was eventually re-released in theaters which proved to be massively successful.", "The film became even more successful though merchandising and subsequent home video releases.", "The theme song of the same name has since become a jazz standard." ], [ "Alice in Wonderland (1999 film)", "She comes across the small door and using her intelligence, succeeds in getting through it into the garden which is actually the labyrinth maze belonging to the Queen.", "The Queen of Hearts (Miranda Richardson) invites her to a bizarre game of croquet, but her love for decapitating people annoys Alice.", "The Cheshire Cat's head appears in the sky and is ordered to be executed, but reasoning from Alice stops the Queen.", "The Duchess arrives to answer the King's question of who the Cat's owner is, but the Cat has vanished.", "Alice leaves the croquet game, meeting the Gryphon (voiced by Donald Sinden) and the Mock Turtle (Gene Wilder).", "The two sing with Alice, teaching her the Lobster Quadrille and encouraging her.", "Alice then wanders into a darker area of Wonderland, meeting a White Knight (Christopher Lloyd) who encourages her to be brave and also shows her his newest invention.", "Alice meets some talking flowers: a Tiger-Lily (voiced by Joanna Lumley) who is the most sensible out of all of them, some Roses which are not too bothered about Alice being lost, and some Daisies who are rascals.", "Having the flowers helping her, Alice walks off." ], [ "Alice in Wonderland (1985 film)", "Alice in Wonderland (1985 film)\n\nAlice in Wonderland is a 1985 two-part made-for-television film adaptation of Lewis Carroll's books \"Alice's Adventures in Wonderland\" and \"Through the Looking-Glass\".", "An Irwin Allen production, it used a huge all-star cast of notable actors and actresses.", "The title role was played by Natalie Gregory, who wore a blonde wig for this miniseries.", "\"Alice in Wonderland\" was first telecast December 9, 1985, (part one) and December 10, 1985 (part two), at 8:00pm EST on CBS.", "It was filmed in Los Angeles at the MGM Studios (now known as Sony Pictures Studios) in Culver City over a 55-day period from March 12, 1985 to May 28 of that same year.", "Additional filming took place at Malibu Beach for the oysters scene, and establishing shots of Alice's house took place at the S. S. Hinds Estate, also in the Los Angeles area.", "The first part opens with Alice helping Mother set the table for tea time.", "Although thankful for her daughter's help, Mother tells Alice that she is still not grown-up enough to join the adults at tea.", "Alice goes outside to see her sister (played by Natalie's real-life older sister Sharee Gregory), but gets bored with reading a book with no pictures." ] ], "gold": "There have been various movies based on Lewis Carroll's book \"Alice in Wonderland\", where different actresses have played the character of the Queen of Hearts. In Disney's 1951 animated version, the role was voiced by Verna Felton and in the 1985 and 1986 made-for-television adaptations the character was played by Jayne Meadows and Miranda Richardson respectively. Helena Bonham Carter was cast for the role in the 2010 live-action feature directed by Tim Burton.", "prediction 1": "Alice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the Alice books by Lewis Carroll. The title role was played by Natalie Gregory as the Queen of Hearts.", "prediction 2": "Alice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the Alice books by Lewis Carroll. In the 1951 film, Verna Felton plays the Queen of Hearts, Miranda Richardson plays the Queen of Hearts, and Miranda Richardson plays the Queen of Hearts in the 1999 film. In the 1985 film, Alice in Wonderland, the Queen of Hearts is played by Natalie Gregory.", "prediction 3": "Alice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the Alice books by Lewis Carroll. The title character is played by Natalie Gregory in the 1951 film, while Verna Felton stars as the Queen of Hearts in the 1985 film. Miranda Richardson played the Queen of Hearts in the 1999 film.", "prediction 4": "In the 1951 film Alice in Wonderland, Verna Felton played the role of the Queen of Hearts, while Miranda Richardson played the role in 1999. In the 1985 and 1985 made-for-television miniseries Alice in Wonderland, Natalie Gregory played the role of the Queen of Hearts.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 162, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 161 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the 1951 Alice in Wonderland Disney film, the the queen of hearts was voiced by Verna Felton. In the 1999 Alice in Wonderland film, the queen of hearts was played by Miranda Richardson. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Last time england made the semis in the world cup?", "passages": [ [ "1966 FIFA World Cup", "London's Wembley Stadium was the venue for the final, and 98,000 people attended.", "After 12 minutes 32 seconds Helmut Haller put West Germany ahead, but the score was levelled by Geoff Hurst four minutes later.", "Martin Peters put England in the lead in the 78th minute; England looked set to claim the title when the referee awarded a free kick to West Germany with one minute left.", "The ball was launched goalward and Wolfgang Weber scored, with England appealing in vain for handball as the ball came through the crowded penalty area.", "With the score level at 2\u20132 at the end of 90 minutes, the game went to extra time.", "In the 98th minute, Hurst found himself on the scoresheet again; his shot hit the crossbar, bounced down onto the goal line, and was awarded as a goal.", "Debate has long raged over whether the ball crossed the line, with the goal becoming part of World Cup history.", "England's final goal was scored by Hurst again, as a celebratory pitch invasion began.", "This made Geoff Hurst the only player ever to have scored three times in a single World Cup final.", "BBC commentator Kenneth Wolstenholme's description of the match's closing moments has gone down in history: \"Some people are on the pitch." ], [ "Cricket World Cup", "The best result by a non-Test playing nation is the semi-final appearance by Kenya in the 2003 tournament; while the best result by a non-Test playing team on their debut is the Super 8 (second round) by Ireland in 2007.", "Sri Lanka as a co-host of the 1996 Cricket World Cup was the first host to win the tournament though the final was held in Pakistan.", "India won in 2011 as host and was the first team to win in a final played in their own country.", "Australia repeated the feat in 2015.", "England is the only other host to have made the final, in 1979.", "Other countries which have achieved or equalled their best World Cup results while co-hosting the tournament are New Zealand as finalists in 2015; Zimbabwe who reached the Super Six in 2003; and Kenya as semi-finalists in 2003.", "In 1987, co-hosts India and Pakistan both reached the semi-finals, but were eliminated by Australia and England respectively.", "Australia in 1992, England in 1999, South Africa in 2003, and Bangladesh in 2011 have been the host teams that were eliminated in the first round.", "An overview of the teams' performances in every World Cup:\n\nBefore the 1992 World Cup, South Africa was banned due to apartheid.", "The number of wins followed by Run-rate is the criteria for determining the rankings till the 1987 World Cup." ], [ "England at the FIFA World Cup", "England at the FIFA World Cup\n\nThe England national football team has competed at the FIFA World Cup since 1950.", "The FIFA World Cup is the premier competitive international football tournament, first played in 1930, whose finals stage has been held every four years since, except 1942 and 1946, due to the Second World War.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the finals, is used to determine which teams qualify for the finals.", "The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1\u00a0million people watching the 2006 Final.", "England did not enter the competition until 1950, but have entered all eighteen subsequent tournaments.", "They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States), and have failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup." ] ], "gold": "England has competed in the Rugby, Cricket and FIFA World Cups. The last time England made the semis in the FIFA World Cup was 2018. The last time they made the semis in the Cricket World Cup was 2019.", "prediction 1": "There have been several times when the England national football team has competed at the FIFA World Cup. In 1966, the team made the semis in the FIFA World Cup, and in 2003 they made the semis, and in 2007 they made the final. The team has made the semis in the cricket World Cup and in 2004 they made the final. In 2013, the team made the semis in the ice hockey World Cup, and in 2014 they made the final. England have failed to qualify for the finals on three occasions, 1974, 1978, and 1994.", "prediction 2": "The England national football team has competed at the FIFA World Cup since 1950. In 1966, the team made the semis in the FIFA World Cup, in 1966 they reached the final, in 1958 they reached the final, and in 2014 they reached the final.", "prediction 3": "The last time England made the semis in the World Cup was in 1966. The last time England made the semis in the World Cup was in 2006.", "prediction 4": "The last time England made the semis in the World Cup was in 1966. The last time England made the semis in the World Cup was in 1999 and they reached the final in 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 34 }, { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 161 }, { "error type": "Unverifiable", "explanation": "", "start": 162, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 313 }, { "error type": "Unverifiable", "explanation": "", "start": 314, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 496 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The England national football team has competed at the FIFA World Cup. England made the semifinals in the cricket World Cup of 1987." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "How many copies did back in black sell?", "passages": [ [ "Back in Black", "In the US, the single \"You Shook Me All Night Long\"/\"Have a Drink on Me\" became AC/DC's first Top 40 hit in the country, peaking at no. 35.", "On 13 December 2007, the album was certified 22\u00d7 multi-platinum by the RIAA, denoting 22 million American sales.", "This placed it sixth in the list of best-selling albums in the US.", "The album has also sold one million or more copies in Canada, Germany and France.", "Worldwide, it went on to sell 50 million copies, leading \"NME\" journalist Mark Beaumont to call it \"the biggest selling hard rock album ever made\"; rock historian Brock Helander said it was possibly \"the best-selling heavy-metal album in history\".", "Reviewing for \"Rolling Stone\" in 1980, David Fricke regarded \"Back in Black\" as \"not only the best of AC/DC's six American albums\" but \"the apex of heavy-metal art: the first LP since \"Led Zeppelin II\" that captures all the blood, sweat and arrogance of the genre.\"" ], [ "For Those About to Rock We Salute You", "For Those About to Rock We Salute You\n\nFor Those About to Rock (We Salute You) (referred to as For Those About to Rock on its cover) is the eighth studio album by Australian hard rock band AC/DC.", "It was the band's seventh internationally released studio album and the eighth to be released in Australia.", "It was released on November 23, 1981.", "Released in 1981, the album is a follow-up to their highly successful album \"Back in Black\".", "\"For Those About to Rock\" has sold over four million copies in the US.", "It would be AC/DC's first and only No. 1 album in the U.S. until the release of \"Black Ice\" in October 2008.", "In their original 1981 review, \"Rolling Stone\" magazine declared it to be their best album.", "In Australia, the album peaked at No. 3 on the Kent Music Report Albums Chart.", "The album, recorded in Paris, France; was the third and final produced for the band by Robert John \"Mutt\" Lange.", "The album was re-released in 2003 as part of the \"AC/DC remasters\" series.", "By the summer of 1981, \"Back in Black\", AC/DC's sixth international release, was nothing short of a phenomenon." ], [ "Thriller (Michael Jackson album)", "\"The Girl Is Mine\" was criticized as a poor choice of lead single, and its release led to predictions by critics that listeners would find the album disappointing and to suggestions that Jackson was bowing to a white audience.", "\"The Girl Is Mine\" was followed by the hit single \"Billie Jean\", which made \"Thriller\" a chart-topper.", "Success continued with the single \"Beat It\", which featured guitarists Eddie Van Halen and Steve Lukather.", "The title track was released as a single and also became a hit internationally.", "On December 16, 2015, \"Thriller\" was certified 30\u00d7 platinum by the Recording Industry Association of America, for shipments of at least 30 million units in the US.", "After the inclusion of streaming and tracks sales into the RIAA album awards in 2017, \"Thriller\" was certified 33\u00d7 platinum for a total of 33 million album-equivalent units.", "The album topped the charts in many countries, sold 4.2 million copies in the UK, 2.5 million in Japan, and was certified 15\u00d7 Platinum in Australia.", "\"Thriller\" sells an estimated 130,000 copies in the US per year; it reached number two in the US Catalog charts in February 2003 and number 39 in the UK in March 2007.", "It remains the best-selling album of all time, having sold over 66 million copies worldwide." ] ], "gold": "Back in Black is the seventh studio album by Australian rock band AC/DC. On 13 December 2007, the album was certified 22\u00d7 multi-platinum by the RIAA, denoting 22 million American sales. The album has also sold one million or more copies in Canada, Germany and France. Worldwide, it went on to sell 50 million copies, leading \"NME\" journalist Mark Beaumont to call it \"the biggest selling hard rock album ever made\". In their native Australia, Back in Black sold 3\u00d7 Platinum certified copies, and 600,000 in the UK.", "prediction 1": "Back in Black sold 50 million copies worldwide, with 17 million sold in the US. The band also released the follow-up album For Those About to Rock, which sold 4.2 million copies in the UK, 2.5 million in Japan, and 15 million in Australia. Thriller, their Michael Jackson album, sold 66 million copies worldwide.", "prediction 2": "Back in Black sold 50 million copies worldwide. It sold 22 million copies in the US alone. Back in Black's follow-up album, For Those About to Rock, sold four million copies in the US alone.", "prediction 3": "Back in Black sold approximately 66 million copies worldwide and it sold 22 million in the US. In addition, the band sold 4.2 million copies of the album in the UK and 2.5 million in Japan, and was certified 15 Platinum in Australia. The album was re-released in 2003 as part of the AC/DC remasters series.", "prediction 4": "Back in Black sold 58 million copies in the United States in 1981 and 50 million copies worldwide. It was the first of AC/DC's six international albums released on November 23, 1981. Back in Black was a follow-up to their highly successful 1981 album, Back in Black. For Those About to Rock, a follow-up to Back in Black, sold over four million copies in the US and was AC/DC's first and only No. 1 album in the United States until the release of Black Ice in October 2008. Thriller, produced by Robert John Muttttt Lange, was also certified 33 platinum in Australia.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 48, "end": 79 }, { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 239 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 147 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 312 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Back in Black sold 50 million copies worldwide, leading \"NME\" journalist Mark Beaumont to call it \"the biggest selling hard rock album ever made\". " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who played guitar on the beatles while my guitar gently weeps?", "passages": [ [ "While My Guitar Gently Weeps", "While My Guitar Gently Weeps\n\n\"While My Guitar Gently Weeps\" is a song by the English rock band the Beatles from their 1968 double album \"The Beatles\" (also known as \"the White Album\").", "It was written by George Harrison, the band's lead guitarist.", "The song serves as a comment on the disharmony within the Beatles following their return from studying Transcendental Meditation in India in early 1968.", "This lack of camaraderie was reflected in the band's initial apathy towards the composition, which Harrison countered by inviting his friend and occasional collaborator, Eric Clapton, to contribute to the recording.", "Clapton overdubbed a lead guitar part, although he was not formally credited for his contribution.", "Harrison wrote \"While My Guitar Gently Weeps\" as an exercise in randomness inspired by the Chinese \"I Ching\".", "The song conveys his dismay at the world's unrealised potential for universal love, which he refers to as \"the love there that's sleeping\".", "Harrison first recorded it with a sparse backing of acoustic guitar and harmonium \u2013 a version that appeared on the 1996 \"Anthology 3\" outtakes compilation and, with the addition of a string arrangement by George Martin, on the \"Love\" soundtrack album in 2006." ], [ "While My Guitar Gently Weeps", "Jagger said: \"It's lovely, plaintive.", "Only a guitar player could write that ...\"", "In 2018, the music staff of \"Time Out London\" ranked \"While My Guitar Gently Weeps\" at number 20 on their list of the best Beatles songs.", "Harrison played \"While My Guitar Gently Weeps\" at every one of his comparatively rare concerts as a solo artist.", "Writing for \"Mojo\" in 2003, Ashley Kahn attributed the track's \"classic\" status to its evocation of \"a band falling out of harmony\" and, with regard to the enduring musical bond between Harrison and Clapton, its standing as \"\"their\" song\".", "At Harrison's Concert for Bangladesh, held at Madison Square Garden in New York on 1 August 1971, Clapton performed the song on a Gibson Byrdland, a hollow-body guitar more suited to jazz or country music than rock." ], [ "Eric Clapton", "Eric Clapton\n\nEric Patrick Clapton, (born 1945), is an English rock and blues guitarist, singer, and songwriter.", "He is the only three-time inductee to the Rock and Roll Hall of Fame: once as a solo artist and separately as a member of the Yardbirds and of Cream.", "Clapton has been referred to as one of the most important and influential guitarists of all time.", "Clapton ranked second in \"Rolling Stone\" magazine's list of the \"100 Greatest Guitarists of All Time\" and fourth in Gibson's \"Top 50 Guitarists of All Time\".", "He was also named number five in \"Time\" magazine's list of \"The 10 Best Electric Guitar Players\" in 2009.", "In the mid-1960s Clapton left the Yardbirds to play with John Mayall & the Bluesbreakers.", "Immediately after leaving Mayall, Clapton formed the power trio Cream with drummer Ginger Baker and bassist Jack Bruce, in which Clapton played sustained blues improvisations and \"arty, blues-based psychedelic pop\".", "After Cream broke up, he formed blues rock band Blind Faith with Baker, Steve Winwood, and Ric Grech.", "Clapton's solo career began in the 1970s, where his work bore the influence of the mellow style of J. J. Cale and the reggae of Bob Marley.", "His version of Marley's \"I Shot the Sheriff\" helped reggae reach a mass market." ] ], "gold": "Several guitarists played the guitar on the English rock band The Beatles' song While My Guitar Gently Weeps. George Harrison, the band's lead guitarist, played guitar on it on an early attempt issued on Anthology 3, a 1996 compilation album by the Beatles. Rock and blues guitarist Eric Clapton played an overdubbed lead guitar part on it. John Lennon, the Beatles' rhythm guitarist, played guitar on it also but was only retained on the song's coda.", "prediction 1": "There are multiple recordings of While My Guitar Gently Weeps by the Beatles. At George Harrison's Concert for Bangladesh on August 1, 1971, Eric Clapton performed the song on a Gibson Byrdland.", "prediction 2": "While My Guitar Gently Weeps is a song by the English rock band the Beatles from their 1968 double album The Beatles. It was written by George Harrison, the band's lead guitarist. George first recorded it with a sparse backing of acoustic guitar and harmonium \u2013 a version that appeared on the 1996 Anthology 3 outtakes compilation and, with the addition of a string arrangement by George Martin, on the Love soundtrack album in 2006. While My Guitar Gently Weeps is acoustic guitar by Eric Clapton.", "prediction 3": "While My Guitar Gently Weeps is a song by the English rock band the Beatles from their 1968 double album The Beatles. It was written by George Harrison, the band's lead guitarist. It serves as a comment on the disharmony within the band following their return from studying Transcendental Meditation in India in early 1968. This lack of camaraderie was reflected in the band's initial apathy towards the composition, which Harrison countered by inviting his friend and occasional collaborator, Eric Clapton, to contribute to the recording.", "prediction 4": "While My Guitar Gently Weeps is a song by the English rock band the Beatles from their 1968 double album The Beatles. The song serves as a comment on the disharmony within the band following their return from studying Transcendental Meditation in India in early 1968. The song serves as a comment on the disharmony within the band following their return from studying Transcendental Meditation in India in early 1968. George Harrison played the song at every one of his rare concerts as a solo artist. Harrison recorded While My Guitar Gently Weeps with his friend and occasional collaborator, Eric Clapton, who overdubbed a lead guitar part.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 173, "end": 194 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "There are multiple recordings of While My Guitar Gently Weeps by the Beatles. At George Harrison's Concert for Bangladesh on August 1, 1971, Eric Clapton performed the song. Clapton overdubbed a lead guitar part as well. George Harrison, the band's lead guitarist, first recorded a version that appeared on the 1996 \"Anthology 3\" outtakes compilation. He also played it as a solo artist. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "With what are the german die br\u00fccke artists associated?", "passages": [ [ "Die Br\u00fccke", "Die Br\u00fccke\n\nDie Br\u00fccke (The Bridge) was a group of German expressionist artists formed in Dresden in 1905, after which the Br\u00fccke Museum in Berlin was named.", "Founding members were Fritz Bleyl, Erich Heckel, Ernst Ludwig Kirchner and Karl Schmidt-Rottluff.", "Later members were Emil Nolde, Max Pechstein and Otto Mueller.", "The seminal group had a major impact on the evolution of modern art in the 20th century and the creation of expressionism.", "Die Br\u00fccke is sometimes compared to the Fauves.", "Both movements shared interests in primitivist art.", "Both shared an interest in the expressing of extreme emotion through high-keyed color that was very often non-naturalistic.", "Both movements employed a drawing technique that was crude, and both groups shared an antipathy to complete abstraction.", "The Die Br\u00fccke artists' emotionally agitated paintings of city streets and sexually charged events transpiring in country settings make their French counterparts, the Fauves, seem tame by comparison.", "The founding members of Die Br\u00fccke in 1905 were four Jugendstil architecture students: Fritz Bleyl (1880\u20131966), Erich Heckel (1883\u20131970), Ernst Ludwig Kirchner (1880\u20131938) and Karl Schmidt-Rottluff (1884\u20131976)." ] ], "gold": "Die Br\u00fccke (The Bridge) was a group of German artists formed in Dresden in 1905, associated with the creation of expressionism. The group is sometimes compared to the roughly contemporary French group of the Fauves, since both movements shared interests in primitivist art and in the expressing of extreme emotion through high-keyed colors that were very often non-naturalistic.", "prediction 1": "The Die Br\u00fccke artists are German expressionist artists. The group was formed in Dresden in 1905, after which the Br\u00fccke Museum in Berlin was named. The founding members were Fritz Bleyl, Erich Heckel, Ernst Ludwig Kirchner and Karl Schmidt-Rottluff. Later members were Emil Nolde, Max Pechstein and Otto Mueller.", "prediction 2": "Die Br\u00fccke was a group of German expressionist artists formed in Dresden in 1905, after which the Br\u00fccke Museum in Berlin was named. The seminal group had a major impact on the evolution of modern art in the 20th century and the creation of expressionism. The artists' emotionally agitated paintings of city streets and sexually charged events transpiring in country settings make their French counterparts, the Fauves, seem tame by comparison.", "prediction 3": "Die Br\u00fccke was a group of German expressionist artists formed in Dresden in 1905, after which the Br\u00fccke Museum in Berlin was named. Founding members were Fritz Bleyl, Erich Heckel, Ernst Ludwig Kirchner and Karl Schmidt-Rottluff. Later members were Emil Nolde, Max Pechstein and Otto Mueller. Die Br\u00fccke is sometimes compared to the Fauves. Both movements shared interests in primitivist art. Both shared an interest in the expressing of extreme emotion through high-keyed color that was very often non-naturalistic. Both movements employed a drawing technique that was crude, and both groups shared an antipathy to complete abstraction.", "prediction 4": "Die Br\u00fccke (The Bridge) are a group of German expressionist artists formed in Dresden in 1905, after which the Br\u00fccke Museum in Berlin was named. Founding members were Fritz Bleyl, Erich Heckel, Ernst Ludwig Kirchner and Karl Schmidt-Rottluff. Later members were Emil Nolde, Max Pechstein and Otto Mueller. Die Br\u00fccke is sometimes compared to the Fauves because both movements shared interests in primitivist art. Both also shared an interest in the expressing of extreme emotion through high-keyed color that was very often non-naturalistic and both groups shared an antipathy to complete abstraction.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 313 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Die Br\u00fccke artists are German expressionist artists. The group was formed in Dresden in 1905. The seminal group had a major impact on the evolution of modern art in the 20th century and the creation of expressionism. Die Br\u00fccke is sometimes compared to the Fauves. Both movements shared interests in primitivist art. Both shared an interest in the expressing of extreme emotion through high-keyed color that was very often non-naturalistic. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "What year is the carrie diaries set in?", "passages": [ [ "The Carrie Diaries (TV series)", "Metacritic gave the first season a score of 57% based on 23 reviews, indicating \"mixed or average reviews,\" based on 23 critics.", "Rotten Tomatoes gave season 1 a score of 63% based on reviews from 30 critics.", "Gail Pennington of the \"St. Louis Post-Dispatch\" said \"The CW's attempt to capture the magic of \"Sex and the City\" in a prequel, set in 1984, could have gone very wrong.", "But \"The Carrie Diaries\" is surprisingly right.\"", "Marisa LaScala of PopMatters says \"The rest of the show goes on to prize sweetness over superficiality.\"", "Alan Sepinwall of Hitfix describes \"The new series succeeds on its own nostalgic terms.\"", "The second season opened with generally more favorable reviews.", "\"Rotten Tomatoes\" gave it score 100%, based on 5 reviews, and praised the introduction of Lindsey Gort as the iconic \"Sex and the City\" character, Samantha Jones.", "In the United States, on its first season, \"The Carrie Diaries\" aired on The CW on Mondays at 8:00 pm as a lead-in for \"90210\" and then streamed on The CW's website.", "The show moved to Fridays for its second season and it premiered on October 25, having been paired with \"America's Next Top Model\"." ], [ "The Carrie Diaries (TV series)", "The Carrie Diaries (TV series)\n\n", "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014.", "It is a prequel to the HBO television series \"Sex and the City\" and based on the 2010 book of the same name by Candace Bushnell.", "The first season focuses on Carrie Bradshaw (AnnaSophia Robb) during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company, while the second season focuses more on her expanding life in the city as well as the lives of her friends and boyfriend.", "The pilot was picked up by The CW to a series order of 13 episodes in May 2012.", "Four months into the first season, the network renewed \"The Carrie Diaries\" for a second season, which premiered in October 2013.", "In May 2014, The CW canceled the series after two seasons.", "In September 2011, it was officially announced that The CW was moving forward with a television series as a prequel to the original series, based on \"The Carrie Diaries\".", "The project is produced by \"Gossip Girl\" producers Josh Schwartz and Stephanie Savage.", "Former \"Sex and the City\" writer Amy B. Harris penned the adaptation." ] ], "gold": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. Season 1 of the series is set in 1984, and Season 2 is set in 1985.", "prediction 1": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013 to January 31, 2014. The first season focuses on Carrie Bradshaw during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company.", "prediction 2": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. It is a prequel to the HBO television series \"Sex and the City\" and based on the 2010 book of the same name by Candace Bushnell. The first season focuses on Carrie Bradshaw during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company, while the second season focuses more on her expanding life in New York City and the lives of her friends and boyfriend.", "prediction 3": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. It is a prequel to the HBO television series \"Sex and the City\" and based on the 2010 book of the same name by Candace Bushnell. The first season focuses on Carrie Bradshaw (AnnaSophia Robb) during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, while the second season focuses more on her expanding life in the city as well as her friendships and her expanding life in the city as well as the lives of her friends and boyfriend.", "prediction 4": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013, to January 31, 2014. It is a prequel to the HBO television series \"Sex and the City\" and based on the 2010 book of the same name by Candace Bushnell. The first season focuses on Carrie Bradshaw during her junior year of high school in 1984 as she explores life in New York City while interning at a law firm office, and also secretly working at a magazine company. The second season focuses on her expanding life in the city as well as the lives of her friends and boyfriend.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 364 } ], "missing-info": [], "corrected-prediction": "The Carrie Diaries is an American teen comedy-drama television series that aired for two seasons on The CW from January 14, 2013 to January 31, 2014. The first season focuses on Carrie Bradshaw during her junior year of high school in 1984." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who played boss hogg on the dukes of hazzard?", "passages": [ [ "The Dukes of Hazzard (film)", "The Dukes of Hazzard (film)\n\nThe Dukes of Hazzard is a 2005 American buddy comedy road film based on the television series, \"The Dukes of Hazzard\".", "The film was directed by Jay Chandrasekhar and released on August 5, 2005, by Warner Bros. Pictures.", "As in the television series, the film depicts the adventures of cousins Bo, Luke, and Daisy, and their Uncle Jesse, as they outfox crooked Hazzard County Commissioner Boss Hogg and Sheriff Rosco P. Coltrane.", "The film was the acting debut of pop singer Jessica Simpson.", "While financially successful, the film met with negative reviews from critics.", "The film was followed by a direct-to-video prequel titled \"\" (2007).", "Cousins Bo, Luke, and Daisy Duke run a moonshine business for their Uncle Jesse in Hazzard County, Georgia.", "The cousins' primary mode of transportation is an orange 1969 Dodge Charger that the boys affectionately refer to as the \"General Lee\".", "Along the way, the family is tormented by corrupt Hazzard County Commissioner Jefferson Davis Hogg, widely known as \"Boss Hogg\", and his willing but dimwitted henchman, Sheriff Rosco P. Coltrane." ], [ "Sorrell Booke", "Sorrell Booke\n\nSorrell Booke (January 4, 1930 \u2013 February 11, 1994) was an American actor who performed on stage, screen, and television.", "He is best known for his role as corrupt politician Jefferson Davis \"Boss\" Hogg in the television show \"The Dukes of Hazzard\".", "Booke was born in Buffalo, New York, a cousin of Max Yasgur.", "He earned degrees from both Columbia and Yale universities.", "He served in the United States Army during the Korean War as a counterintelligence officer.", "Booke came to Hollywood via a theatre degree from Yale University and a decade on the New York Stage.", "One prominent early role was that of Senator Billboard T. Rawkins in the 1960 revival of \"Finian's Rainbow\", a role foreshadowing his most famous character, that of Boss Hogg in \"The Dukes of Hazzard\".", "During his early Hollywood acting career, Booke gained acclaim for notable supporting parts in noteworthy 1960s films such as \"Black Like Me\", \"A Fine Madness\", and \"Fail-Safe\".", "In 1962, he was in \"Fiorello!\" and starred as the namesake's character.", "In 1965, he guest starred as Sgt." ], [ "Burt Reynolds", "Burt Reynolds\n\nBurton Leon Reynolds Jr. (February 11, 1936\u00a0\u2013 September 6, 2018) was an American actor, director and producer.", "He first rose to prominence starring in television series such as \"Gunsmoke\" (1962\u20131965), \"Hawk\" (1966), and \"Dan August\" (1970\u20131971).", "His breakout film role was as Lewis Medlock in \"Deliverance\" (1972).", "Reynolds played the leading role in a number of subsequent box office hits, such as \"The Longest Yard\" (1974), \"Smokey and the Bandit\" (1977), \"Semi-Tough\" (1977), \"Hooper\" (1978), \"Smokey and the Bandit II\" (1980), \"The Cannonball Run\" (1981) and \"The Best Little Whorehouse in Texas\" (1982).", "After a number of box office failures, Reynolds returned to television, starring in the sitcom \"Evening Shade\" (1990\u20131994).", "He was nominated for the Academy Award for Best Supporting Actor for his performance in \"Boogie Nights\" (1997).", "Burton Leon Reynolds Jr. was the son of Harriette Fernette \"Fern\" (\"n\u00e9e\" Miller; 1902\u20131992) and Burton Milo Reynolds (1906\u20132002).", "He had Dutch, English, Scots-Irish, and Scottish ancestry." ] ], "gold": "Several actors have played Boss Hogg in The Dukes of Hazzard. Sorrell Booke did in the original Dukes of Hazzard TV show and The Dukes of Hazzard cartoon called The Dukes. Burt Reynolds did in the 2005 movie The Dukes of Hazzard, while Chris McDonald did in the 2007 movie Dukes of Hazzard: The Beginning, a prequel to the 2005 movie. Wayne Powers did in The Dukes of Hazzard video game.", "prediction 1": "The Dukes of Hazzard is an American buddy comedy road film based on the television series The Dukes of Hazzard. The film was directed by Jay Chandrasekhar and released on August 5, 2005, by Warner Bros. Pictures. American actor, writer, director, and producer Burt Reynolds played the role of Boss Hogg on the show in 1997.", "prediction 2": "The Dukes of Hazzard is a 2005 American buddy comedy road film based on the television series, The Dukes of Hazzard. The film depicts the adventures of cousins Bo, Luke, and Daisy, and their Uncle Jesse, as they outfox crooked Hazzard County Commissioner Boss Hogg and Sheriff Rosco P. Coltrane. American actor Sorrell Booke played Boss Hogg in the television series. American actor Burt Reynolds played the role of Boss Hogg on the series. American actor, director, producer, director, and producer Burt Reynolds, who was nominated for the Academy Award for Best Supporting Actor for his performance in Boogie Nights, a musical comedy called The Dukes of Hazzard.", "prediction 3": "On the television series, The Dukes of Hazzard, corrupt politician Jefferson Davis \"Boss\" Hogg was played by American actor, director, and producer Burton Reynolds. In the 2005 American buddy comedy film, the character was played by American actor, singer, and writer Sorrell Booke. Also in the 2005 film, was British actor, director, and producer Peter Boyle.", "prediction 4": "There are several actors playing Boss Hogg on The Dukes of Hazzard. Sorrell Booke plays Boss Hogg in the 2005 film, and American actor Burt Reynolds plays Boss Hogg in the 2007 film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 212 }, { "error type": "Unverifiable", "explanation": "", "start": 213, "end": 323 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Sorrell Booke played Boss Hogg in the television show \"The Dukes of Hazzard\"." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played mildred on the jack benny show?", "passages": [ [ "The Jack Benny Program", "The Jack Benny Program\n\nThe Jack Benny Program, starring Jack Benny, is a radio-TV comedy series that ran for more than three decades and is generally regarded as a high-water mark in 20th-century American comedy.", "Other cast members include:\n\n\nJack Benny first appeared on radio as a guest of Ed Sullivan in March 1932.", "He was then given his own show later that year, with Canada Dry Ginger Ale as a sponsor \u2014The Canada Dry Ginger Ale Program, beginning May 2, 1932, on the NBC Blue Network and continuing there for six months until October 26, moving the show to CBS on October 30.", "With Ted Weems leading the band, Benny stayed on CBS until January 26, 1933.", "Arriving at NBC on March 17, Benny did The Chevrolet Program until April 1, 1934 with Frank Black leading the band.", "He continued with The General Tire Revue for the rest of that season, and in the fall of 1934, for General Foods as The Jell-O Program Starring Jack Benny (1934\u201342) and, when sales of Jell-O were affected by sugar rationing during World War II, The Grape Nuts Flakes Program Starring Jack Benny (later the Grape Nuts and Grape Nuts Flakes Program) (1942\u201344)." ], [ "Shirley Eaton", "Shirley Eaton\n\nShirley Eaton (born 12 January 1937) is an English actress, model and author.", "She was a sex symbol in the 1950s and 1960s, often dubbed the cockney Blonde bombshell for her London accent, blonde hair and sex appeal.", "Eaton appeared regularly in British films throughout the 1950s and 1960s, and achieved notability for her performance as Bond Girl Jill Masterson in the 1964 James Bond film \"Goldfinger\".", "Eaton also had notable roles in the early \"Carry On\" films.", "Preferring to devote herself to bringing up a family, Eaton retired from acting in 1969.", "Eaton was born on 12 January 1937 in Edgware General Hospital, Middlesex, and brought up in the suburb of Kingsbury.", "She attended Roe Green Primary School on Princes Avenue, and although living close to both Kingsbury County Grammar School and Tylers Croft Secondary Modern School, won a place at the Aida Foster Theatre School, a specialist drama school, and remained there until she was sixteen.", "Her stage debut was in Benjamin Britten's \"Let's Make an Opera!\"", "and her West End debut was in 1954 in \"Going to Town\".", "All through the 1950s, Shirley was a singing star both on the stage and on television, appearing with her own act in variety shows all over the country and starring at the Prince of Wales Theatre in London in her own solo singing act, as well as appearing in many films." ], [ "Barbara Nichols", "Barbara Nichols\n\nBarbara Marie Nickerauer (December 10, 1928 \u2013 October 5, 1976), better known as Barbara Nichols, was an American actress who often played brassy or comic roles in films in the 1950s and 1960s.", "Nichols was born Barbara Marie Nickerauer to George and Julia Nickerauer, and raised in Queens, New York.", "She began modeling for cheesecake magazines in the late 1940s, and eventually was considered a minor rival to Marilyn Monroe.", "On Broadway, she appeared in the 1952 revival of \"Pal Joey\" (she also appeared in the 1957 film version) and in \"Let It Ride\" (1961).", "In the mid-1950s, she moved to Hollywood and began appearing in showy supporting roles in A-films starring such actors as Clark Gable, Susan Hayward, Sophia Loren, and Doris Day in such films as \"Miracle in the Rain\" (1956), \"The King and Four Queens\" (1956), \"The Naked and the Dead\" (1958), \"The Pajama Game\" (1957), \"Sweet Smell of Success\" (1957), \"That Kind of Woman\" (1958), and \"Where the Boys Are\" (1960).", "One of her few starring roles was in the 1965 science-fiction film \"The Human Duplicators\"." ] ], "gold": "Mildred Meyerhauser is Jack Benny's brash, blonde bombshell date in The Jack Benny Program (a radio-TV comedy series that ran for more than three decades). In the show, she was played by different actresses. In the late 1950s, Shirley Mitchell appeared twice as Mildred; and Barbara Marie Nickerauer, professionally known as Barbara Nichols, played her 4 times, from 1958-1960.", "prediction 1": "The Jack Benny Program is a radio-TV comedy series that ran for more than three decades and is generally regarded as a high-water mark in 20th-century American comedy. Other cast members include: Jack Benny, Ed Sullivan, and Shirley Eaton. Jack Benny first appeared on radio as a guest of Ed Sullivan in March 1932. He was then given his own show later that year, with Canada Dry Ginger Ale as a sponsor \u2014The Canada Dry Ginger Ale Program, beginning May 2, 1932, on the NBC Blue Network and continuing there for six months until October 26, moving the show to CBS on October 30.", "prediction 2": "The Jack Benny Program, starring Jack Benny, was a radio-TV comedy series that ran for more than three decades and is generally regarded as a high-water mark in 20th-century American comedy. Among the cast members was Shirley Eaton, an English actress, model and author. Eaton appeared regularly in British films throughout the 1950s and 1960s, and achieved notability for her performance as Bond Girl Jill Masterson in the 1964 James Bond film Goldfinger. American actress Barbara Nichols, was an American actress who often played comic roles in films in the 1950s and 1960s.", "prediction 3": "The Jack Benny Program is a radio-TV comedy series that ran for more than three decades. It is generally regarded as a high-water mark in 20th-century American comedy. Other cast members include: Jack Benny, Shirley Eaton, Barbara Nichols, and Louise Sullivan.", "prediction 4": "The Jack Benny Program, starring Jack Benny, is a radio-TV comedy series that ran for more than three decades and is generally regarded as a high-water mark in 20th-century American comedy. The show first appeared on radio as a guest of Ed Sullivan in March 1932. He was then given his own show later that year, with Canada Dry Ginger Ale as a sponsor \u2014The Canada Dry Ginger Ale Program, beginning May 2, 1932, on the NBC Blue Network and continuing there for six months until October 30, moving the show to CBS on October 30, becoming The Grape Nuts Flakes Program Starring Jack Benny in April 1942 and, when sales of Jell-O were affected by sugar rationing during World War II, the Grape Nuts and Grape Nuts Flakes Program.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 578 } ], "missing-info": [], "corrected-prediction": "The Jack Benny Program is a radio-TV comedy series that ran for more than three decades." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has the highest batting average in baseball today?", "passages": [ [ "Ty Cobb", "Ty Cobb\n\nTyrus Raymond Cobb (December 18, 1886 \u2013 July 17, 1961), nicknamed The Georgia Peach, was an American Major League Baseball (MLB) outfielder.", "He was born in rural Narrows, Georgia.", "Cobb spent 22 seasons with the Detroit Tigers, the last six as the team's player-manager, and finished his career with the Philadelphia Athletics.", "In 1936 Cobb received the most votes of any player on the inaugural Baseball Hall of Fame ballot, receiving 222 out of a possible 226 votes (98.2%); no other player received a higher percentage of votes until Tom Seaver in 1992.", "In 1999, editors at the \"Sporting News\" ranked Ty Cobb third on their list of \"Baseball's 100 Greatest Players\".", "Cobb is widely credited with setting 90 MLB records during his career.", "His combined total of 4,065 runs scored and runs batted in (after adjusting for home runs) is still the highest ever produced by any major league player.", "He still holds several records as of the end of the 2018 season, including the highest career batting average (.366 or .367, depending on source) and most career batting titles with 11 (or 12, depending on source)." ], [ "Miguel Cabrera", "Miguel Cabrera\n\nJos\u00e9 Miguel Cabrera Torres (born April 18, 1983), commonly known as Miguel Cabrera and nicknamed \"Miggy\", is a Venezuelan professional baseball player.", "He is the first baseman for the Detroit Tigers of Major League Baseball (MLB).", "Since his debut in 2003 he has been a two-time\u00a0American League (AL)", "Most Valuable Player (MVP) award winner, a four-time AL batting champion, and an 11-time MLB All-Star.", "He has played at first and third base for most of his major league career, but primarily played left and right field before 2006.", "He claimed the 17th MLB Triple Crown in 2012, the first to do so in 45 seasons.", "In Venezuelan Winter League, Liga de Beisbol Profesional de Venezuela, Cabrera was signed by Tigres de Aragua at 16 years old.", "He batted his first hit in LVBP on December 1999.", "Cabrera was signed in 1999 as an amateur free agent by the Florida Marlins, and progressed through their minor league system.", "He made his MLB debut in mid-2003 at the age of 20, and contributed to the Marlins' World Series success later that year.", "Over the next four seasons, Cabrera was a regular player for the Marlins before being traded to the Detroit Tigers in late 2007." ], [ "Jos\u00e9 Altuve", "Jos\u00e9 Altuve\n\nJos\u00e9 Carlos Altuve (; born May 6, 1990) is a Venezuelan professional baseball second baseman for the Houston Astros of Major League Baseball (MLB).", "The Astros signed Altuve as an amateur free agent on March 6, 2007, and he made his major league debut on July 20, 2011.", "A right-handed batter and thrower, as of 2017, he is the shortest active MLB player at .", "His listed weight is .", "From 2014\u22122017, Altuve recorded at least 200 hits each season and led the American League (AL) in the category.", "He won three batting championships in that span.", "A six-time MLB All-Star, Altuve has been voted the starting second baseman for the AL in the All-Star Game four times.", "In 2017, he won the AL Most Valuable Player Award, the Hank Aaron Award, and became a World Series champion with the Astros, each for the first time.", "Also in 2017, Altuve was \"Sports Illustrateds co-Sportsperson of the Year with J. J. Watt of the NFL's Houston Texans for helping to lead relief efforts in the aftermath of Hurricane Harvey." ] ], "gold": "In baseball, the batting average is defined by the number of hits divided by at bats. Outfielder\u00a0Ty Cobb, whose career ended in 1928, has the highest batting average in\u00a0Major League Baseball\u00a0history. Miguel Cabrera, first baseman\u00a0and\u00a0designated hitter\u00a0for the\u00a0Detroit Tigers had the highest batting average in 2015. Jos\u00e9 Altuve,\u00a0second baseman\u00a0for the\u00a0Houston Astro had the highest batting average for the 2016 and 2017 seasons. ", "prediction 1": "The player with the highest batting average in MLB today is Ty Cobb, who holds the record for the highest combined total of runs scored and runs batted in in Major League Baseball history. Miguel Cabrera, a Venezuelan professional baseball player, holds the record for the highest career batting average with.367. Jos\u00e9 Altuve, a Venezuelan professional baseball second baseman for the Houston Astros, holds the record for the highest career batting average with.367.\n", "prediction 2": "The major league player with the highest batting average in baseball is Ty Cobb, who retired in 2017 after a career that spanned 80 seasons, and the Venezuelan professional baseball player Jos\u00e9 Altuve, who retired in 2018.", "prediction 3": "Ty Cobb has the highest career batting average in Major League Baseball. He is currently the leader in Major League Baseball behind the all-time leader Tony Soriano with a.366 average and three home runs at-bats. Jos\u00e9 Altuve has the highest career batting average in Major League Baseball.", "prediction 4": "As of 2018, several baseball players hold the record for the highest batting average in MLB, including Ty Cobb, Miguel Cabrera, and Jos\u00e9 Altuve. Ty Cobb set the record for the highest combined batting average and run-scored total in Major League Baseball with 4,065 runs in his MLB career.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 188 }, { "error type": "Unverifiable", "explanation": "", "start": 248, "end": 313 }, { "error type": "Unverifiable", "explanation": "", "start": 401, "end": 467 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The player with the highest batting average in MLB today is Ty Cobb, as of the end of the 2018 season, he has the highest career batting average (.366 or .367, depending on source). Miguel Cabrera, a Venezuelan professional baseball player, is the first baseman for the Detroit Tigers. Jos\u00e9 Altuve is a Venezuelan professional baseball second baseman for the Houston Astros.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the last year the honda element was made?", "passages": [ [ "Honda Civic (sixth generation)", "Other JDM Ferio models included a model with the RealTime 4wheel drive and a rear wiper in the back window of the sedan, which was not seen in other markets.", "Canadian trim packages were mostly similar to the United States, though with different designations.", "Canadian Civic sedans came in LX, EX and SE, which roughly correspond to the American DX and LX; there was no Honda-branded Canadian equivalent to the American EX sedan - the Canadian-market only Acura EL filled this spot.", "Canadian Civic coupes came in DX, Si, and SiR, the equivalent of the DX, EX, and Si in the United States.", "Only the EX sedan, Si coupe and SiR coupe had power locks and power windows, the Si and SiR coupes were the only Canadian Civic trims with a power moonroof.", "All sedans and coupes had a group option package available that added air conditioning and anti-lock brakes.", "The hatchbacks, available only in CX and DX trims, were sold as economy cars; as in the US, they had none of the amenities of other trims in the Civic lineup, not even as options.", "All sedans, coupes, and the hatchback DX had two front airbags; while the CX hatchback had the driver's side airbag only." ], [ "Honda Passport", "It will be built at their factory in Lincoln, Alabama, and will be available for the 2019 model year.", "The first generation Passport was offered in three trims, the base model DX, mid-range LX, and upscale EX.", "DX models had a 5-speed manual transmission, rear-wheel-drive (RWD) layout and a 2.6 L four-cylinder engine producing .", "LX models could be had with an optional 4-speed automatic transmission, optional four-wheel-drive (4WD) and a 3.2 L V6 engine producing as standard.", "The upscale EX offered the 3.2 L V6 engine and four-wheel-drive as standard.", "Some first generation Passports were equipped with a rear axle built by General Motors.", "Others had a Dana built \"Spicer 44\" rear axle.", "For the second generation model, two trim levels were offered: LX and upscale EX.", "EX had the spare tire below the cargo area and LX mounted in a swing carrier at rear.", "Minor changes for the 2000 model year included 2-tone exterior colors, and optional wheels for the LX trim.", "In 2010, a recall was issued for affected 1998-2002 Rodeo and Passport for frames with severe rust issues." ], [ "Honda Pilot", "Honda Pilot\n\nThe Honda Pilot is a mid-size crossover SUV manufactured by Honda and introduced in 2002.", "Primarily aimed at the North American market, the Pilot is the largest SUV from Honda and features three-row seating.", "Pilots are currently manufactured in Lincoln, Alabama, and the Pilot was produced in Alliston, Ontario until April 2007.", "The first generation Pilot was released in April 2002 as a 2003 model.", "The Pilot shares its platform with the Acura MDX, as well as the Odyssey minivan and the Accord sedan.", "The Pilot's unibody construction and independent suspension are designed to provide handling similar to that of a car, and it has integrated perimeter frame rails to allow towing and light off-road use.", "Prior to the introduction of the Pilot, Honda marketed the compact crossover CR-V, and the Honda Passport, (a rebadged Isuzu Rodeo) that was a pickup truck-based design.", "The Pilot is Honda's largest SUV, although the 2010 Crosstour surpassed the Pilot in length.", "The Pilot is sold in North America and the Middle East, while the Honda MDX (first generation Acura MDX) was marketed in Japan and Australia for several years.", "The second generation Pilot is also marketed in Russia, Ukraine, and in the Dominican Republic.", "The Pilot is also sold in the Philippines." ] ], "gold": "The Honda Element is a compact crossover SUV manufactured by Honda and marketed in North America over a single generation for model years 2003-2011, noted for its boxy exterior styling with bi-parting side doors and its boxy, flexible interior layout. In 2004 A mid-range LX trim level between the DX and the premium EX trim levels, For 2010, Honda Element offered LX, EX, EX with Navigation, and SC trim levels. 2011 was the last year for the Honda Element EX and LX.", "prediction 1": "The Honda Accord is a mid-size sedan manufactured by Honda and introduced in 2000. The last year the honda element was made in Canada was 2000. The last year the honda element was made in Canada was 2003.", "prediction 2": "The Honda Element was manufactured in Japan for the second and third generations of the Honda Civic. The Honda Passport is a mid-size crossover SUV manufactured by Honda that was marketed in the United States from 2002 to 2007. The last year the honda element was made in Japan was 2012.", "prediction 3": "The Honda Pilot is a mid-size crossover SUV manufactured by Honda and introduced in 2002. Primarily aimed at the North American market, the Pilot is the largest SUV from Honda and features three-row seating. The last year the Honda element was made was 2000.", "prediction 4": "The Honda element was made from 1995 to 1999, but was discontinued in 1999. The Honda Pilot is a mid-size crossover SUV manufactured by Honda and introduced in 2002. It was the last year the honda element was made from 1999 to 2002.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 83, "end": 143 }, { "error type": "Unverifiable", "explanation": "", "start": 144, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 82 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Honda Accord is a mid-size sedan manufactured by Honda marketed in North America and the first generation Pilot was released in April 2002 as a 2003 model. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who played hercules in jason and the argonauts?", "passages": [ [ "Charles H. Schneer", "\"Gentleman to China\" with Lloyd Nolan was announced but never made.", "Schneer had one of his biggest successes with \"Jason and the Argonauts\" (1963), again with Harryhausen; the script was written by Beverley Cross who would go on to do many screenplays for Schneer.", "Schneer produced a medieval swashbuckler, \"Siege of the Saxons\" (1963) then an Imperial adventure, \"East of Sudan\" (1963), both directed by Juran.", "He was reunited with Harryhausen for \"First Men in the Moon\" (1963), also from Juran.", "Schneer produced a \"swinging sixties\" comedy directed by Michael Winner, \"You Must Be Joking!\"", "(1965), and the film version of the stage musical \"Half a Sixpence\" (1967) starring Tommy Steele.", "\"Fifth Paw of the Lion\" was announced but not made.", "He went to Spain to do a Western, \"Land Raiders\" (1969), then went back to fantasy for \"The Valley of Gwangi\" (1969), with Harryhausen.", "\"The Executioner\" (1970), directed by Sam Wanamaker was a thriller." ], [ "Jason and the Argonauts (1963 film)", "Among them are Hercules (Nigel Green), Hylas (John Cairney), and Acastus (Gary Raymond), the son of Pelias, sent by his father to sabotage the voyage.", "Hera guides Jason to the Isle of Bronze, but warns him to take nothing but provisions.", "However, Hercules steals a brooch pin the size of a javelin from a treasure building, surmounted by a giant statue of Talos, which comes to life and attacks the Argonauts.", "Jason again turns to Hera, who tells him to open a large plug on Talos' heel to release the giant's bronze fluid, ichor.", "Talos falls to the ground, crushing Hylas, hiding his body.", "Hercules refuses to leave until he ascertains the fate of his friend.", "The other Argonauts refuse to abandon Hercules, so Jason calls upon Hera again.", "She informs them that Hylas is dead and that Hercules will not continue on with them.", "The Argonauts next reach the realm of King Phineus (Patrick Troughton), who has been blinded and is tormented by harpies for his transgressions against the gods." ], [ "Jason and the Argonauts (miniseries)", "Jason and the Argonauts (miniseries)\n\nJason and the Argonauts, (also known as Jason and the Golden Fleece) is a 2000 TV movie, directed by Nick Willing and produced by Hallmark Entertainment.", "It is based on the Greek myth of Jason and the Argonauts.", "The film opens as soldiers invade the city of Iolcus.", "King Aeson's (Ciar\u00e1n Hinds) brother Pelias (Dennis Hopper) is leading the charge.", "Inside the temple he goes to embrace his brother but produces a dagger and kills him during the embrace.", "This is witnessed by his wife Polymele (Diana Kent) and his son Jason (Jason London).", "He intends to do the same to Jason but one of the guards rescues him and takes him out of the palace through a secret tunnel.", "It is then revealed that this is a memory, experienced as a nightmare by an older Jason, who awakes.", "He is then ordered by his uncle to retrieve the golden fleece.", "He recruits a crew from the simple folk of Iolcus, including shepherds and farmers.", "He is joined by Hercules (Brian Thompson), Orpheus (Adrian Lester), Atalanta (Olga Sosnovska) and the brothers Castor and Pollux.", "Acastus stows away on the ship." ] ], "gold": "Jason and the Argonauts is a 1963 Anglo-American independent mythological fantasy adventure film produced by Charles H. Schneer and directed by Don Chaffey. In the film, Nigel Green played the role of Hercules. Jason and the Argonauts is also a 2000 American television film directed by Nick Willing and produced by Hallmark Entertainment. In this miniseries, Brian Thompson played the role of Hercules.", "prediction 1": "Jason and the Argonauts, also known as Jason and the Golden Fleece, is a 2000 American TV movie, directed by Nick Willing and produced by Hallmark Entertainment. It is based on the Greek myth of Jason and the Argonauts. The 1963 film starred Brian Thompson as Hercules. In the 2000 TV miniseries, Hercules is played by Brian Thompson.", "prediction 2": "Jason and the Argonauts is a 1963 film that is based on the Greek myth of Jason and the Argonauts. Hercules is played by Brian Thompson in the main part, while Nigel Green plays him in the miniseries.", "prediction 3": "Jason and the Argonauts is a 1963 movie that is based on the Greek myth of Jason and the Argonauts. In the 1963 film, Hercules is played by Nigel Green, Brian Thompson and Adrian Lester. In the 2000 TV movie, Jason and the Golden Fleece, Hercules is played by Brian Thompson and Brian Thompson plays Hercules.", "prediction 4": "Hercules is a character in the 1963 film Jason and the Argonauts, a mythical movie based on the ancient Greek myth. He is played by Nigel Green, John Cairney, Brian Thompson, and Gary Raymond. Jason and the Argonauts is a 2000 tv movie, directed by Nick Willing and produced by Hallmark Entertainment.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 219 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 220, "end": 269 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Jason and the Argonauts, also known as Jason and the Golden Fleece, is a 2000 American TV movie, directed by Nick Willing and produced by Hallmark Entertainment. It is based on the Greek myth of Jason and the Argonauts. In the 2000 TV miniseries, Hercules is played by Brian Thompson. In the 1963 film, Nigel Green played the role of Hercules." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When is my friend dahmer movie coming out?", "passages": [ [ "My Friend Dahmer (film)", "The closing credits note that Hicks was never seen again, and that Jeffrey Dahmer admitted to killing 17 men when he was finally arrested.", "The script appeared on 2014's Black List.", "Ross Lynch was cast as the teenage Dahmer in 2016.", "Later in the month Alex Wolff, Vincent Kartheiser and Anne Heche joined the cast, with Heche playing Dahmer's mother.", "Filming took place in Bath, Ohio and Middleburg Heights, Ohio.", "This movie was recorded at Jeffrey Dahmer\u2019s actual childhood home in Ohio.", "Actors of the movie said that it was very strange to be in the home where the serial killer lived.", "They also mentioned that the house is where Dahmer\u2019s mental disturbances and childhood struggles began, leading to his path of becoming one of Americans most infamous serial killers.", "\"My Friend Dahmer\" premiered at the 2017 Tribeca Film Festival on April 21, 2017.", "On May 15, 2017, FilmRise acquired distribution rights to the film, planning to release it in the fall.", "The film was released in limited theaters on November 3, 2017, with a wider release the following month.", "On the review aggregator website Rotten Tomatoes, the film has an 86% rating based on 88 reviews, with an average rating of 7/10." ], [ "My Friend Dahmer (film)", "My Friend Dahmer (film)\n\n", "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the American serial killer Jeffrey Dahmer.", "It is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree.", "The film stars Ross Lynch as Dahmer, and also stars Alex Wolff, Dallas Roberts, and Anne Heche.", "The film premiered at the 2017 Tribeca Film Festival and was released in the United States on November 3, 2017.", "In 1974, Jeffrey Dahmer is a high school freshman living in Bath, Ohio, with his parents, Lionel and Joyce, and his little brother, Dave.", "Jeffrey develops an obsession with a male jogger that he sees every day from his school bus.", "For a hobby, Jeffrey collects dead animals that he dissolves to the bones using chemicals provided by his father, who is a chemist.", "This hobby is initiated by his obsessive interest in how animals are \"fitted together\".", "In 1978, Lionel trashes Jeffrey's collection of bones and orders him to make friends at school." ] ], "gold": "My Friend Dahmer is a 2017 American biographical psychological drama film written and directed by Marc Meyers about American serial killer Jeffrey Dahmer. The film is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree in 1978. \"My Friend Dahmer\" premiered at the 2017 Tribeca Film Festival on April 21, 2017. On May 15, 2017, FilmRise acquired distribution rights to the film, planning to release it in the fall. The film was released in limited theaters on November 3, 2017, with a wider release the following month.", "prediction 1": "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the serial killer Jeffrey Dahmer. It is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree. The film premiered at the 2017 Tribeca Film Festival on April 21, 2017. The film was released in limited theaters on November 3, 2017, with a wider release the following month.", "prediction 2": "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the serial killer Jeffrey Dahmer. The film premiered at the 2017 Tribeca Film Festival on April 21, 2017. On May 15, 2017, FilmRise acquired distribution rights to the film, planning to release it in the fall. The film was released in limited theaters on November 3, 2017, with a wider release the following month.", "prediction 3": "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the American serial killer Jeffrey Dahmer, which is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree. The film premiered at the 2017 Tribeca Film Festival on April 21, 2017. The film was released in limited theaters on November 3, 2017, with a wider release the following month.", "prediction 4": "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the serial killer Jeffrey Dahmer. It is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree. My Friend Dahmer premiered at the 2017 Tribeca Film Festival on April 21, 2017. On May 15, 2017, FilmRise acquired distribution rights to the film, planning to release it in the fall. It was released in limited theaters on November 3, 2017 with a wider release the following month.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "My Friend Dahmer is a 2017 American biographical drama film written and directed by Marc Meyers about the serial killer Jeffrey Dahmer. It is based on the 2012 graphic novel of the same name by cartoonist John \"Derf\" Backderf, who had been friends with Dahmer in high school in the 1970s, until the time Dahmer began his killing spree. The film premiered at the 2017 Tribeca Film Festival on April 21, 2017. On May 15, 2017, FilmRise acquired distribution rights to the film, planning to release it in the fall. The film was released in limited theaters on November 3, 2017, with a wider release the following month." }, "preference": [ 1, 0, 2, 0, 2, 2 ] }, { "question": "When did the astros become an american league team?", "passages": [ [ "History of the Houston Astros", "On November 6, 2012, the Astros hired former Cleveland Indians director of baseball operations David Stearns as the team's new assistant general manager.", "The Astros would also go on to hire former St Louis Cardinals front office executive Jeff Luhnow as their general manager.", "The Houston Astros won their first American League game on March 31, 2013 against the Texas Rangers.", "The score was 8\u20132.", "On September 29, the Astros completed their first year in the American League, losing 5\u22121 in a 14 inning game to the New York Yankees.", "The Astros finished the season with a 51\u2212111 record (a franchise worst) with a season ending 15 game losing streak, again surpassing their worst record from last season.", "The team finished 45 games back out of the division winner Oakland Athletics, further adding to their futility.", "This marked three consecutive years that the Astros had lost more than 100 games in a single season.", "They also became the first team to have the first overall pick in the draft three years in a row.", "They improved on their season in 2014, going 70-92, finishing 28 games back over the division winner Los Angeles Angels of Anaheim, and placing fourth in the AL West over the Texas Rangers.", "After a slow start, the Astros took over first place in the AL West on April 19 and stayed there until shortly before the All-Star Break in mid-July." ], [ "Houston Astros", "During the summer of 2011, a frustrated Crane hinted that the delays might threaten the deal.", "In October 2011, Crane met personally with MLB Commissioner Bud Selig, in a meeting that was described as \"constructive\".", "On November 15, 2011, it was announced that Crane had agreed to move the franchise to the American League for the 2013 season.", "The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions.", "Crane was given a $70 million concession by MLB for agreeing to the switch; the move was a condition for the sale to the new ownership group.", "Two days later, the Astros were officially sold to Crane after the other owners unanimously voted in favor of the sale.", "It was also announced that 2012 would be the last season for the Astros in the NL.", "After over fifty years of the Astros being a part of the National League, this move was unpopular with many Astros fans.", "In 2012, the Astros were eliminated from the playoffs before September 5.", "On September 27, the Astros named Bo Porter to be the manager for the 2013 season.", "On October 3, the Astros ended over 50 years of NL play with a 5\u20134 loss to the Chicago Cubs and began to look ahead to join the American League." ], [ "Houston Astros", "Houston Astros\n\nThe Houston Astros are an American professional baseball team based in Houston, Texas.", "The Astros compete in Major League Baseball (MLB) as a member club of the American League (AL) West division, having moved to the division in 2013 after spending their first 51 seasons in the National League (NL).", "The Astros have played their home games at Minute Maid Park since 2000.", "The Astros were established as the Houston Colt .45s and entered the National League as an expansion team in along with the New York Mets.", "The current name\u2014reflecting Houston's role as the control center of the U.S. crewed space program\u2014was adopted three years later, when they moved into the Astrodome, the first domed sports stadium.", "The Astros played in the NL from 1962 to 2012, first in the West Division from 1969 to 1993, followed by the Central Division from 1994 to 2012.", "The team was reclassified to the American League West from 2013 onward.", "While a member of the NL, the Astros played in one World Series in 2005, losing in four games to the Chicago White Sox.", "In 2017, they became the first franchise in MLB history to have won a pennant in both the NL and the AL, when they defeated the New York Yankees in the ALCS." ] ], "gold": "The Houston Astros are an American professional baseball team based in Houston. The Astros compete in Major League Baseball (MLB) as a member club of the American League (AL) West division, having moved to the division in 2013 after spending their first 51 seasons in the National League (NL). On November 15, 2011, it was announced that Crane had agreed to move the franchise to the American League for the 2013 season. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions. The Houston Astros won their first American League game on March 31, 2013 against the Texas Rangers. The score was 8\u20132.", "prediction 1": "The Houston Astros are an American professional baseball team based in Houston, Texas and compete in Major League Baseball as a member club of the American League West division, having moved to the division in 2013 after spending their first 51 seasons in the National League. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions.", "prediction 2": "The Houston Astros are an American professional baseball team based in Houston, Texas. The team competed in MLB as a member club of the American League West division, having moved to the division in 2013. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions. The move was announced on November 15, 2011, it was announced that Crane had agreed to move the franchise to the American League for the 2013 season. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three consecutive years that the Astros had lost more than 100 games in a single season.", "prediction 3": "The Houston Astros are an American professional baseball team based in Houston, Texas. They compete in Major League Baseball as a member club of the American League West division. The Astros became an American league team on July 1, 2013, following a move made by MLB commissioner Bud Selig during a divisional realignment of MLB, which saw both the National and American leagues each have 15 teams in three geographically balanced divisions. The move was made as part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three consecutive years, further adding to their futility.", "prediction 4": "The Houston Astros are an American professional baseball team based in Houston, Texas. The Astros compete in Major League Baseball as a member club of the American League West division, having moved to the division in 2013. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions. In 2011, it was announced that Houston Astros owner John Crane had agreed to move the franchise to the American League for the 2013 season. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three consecutive years, further adding to their futility.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Houston Astros are an American professional baseball team based in Houston, Texas and compete in Major League Baseball as a member club of the American League West division, having moved to the division in 2013 after spending their first 51 seasons in the National League. On November 15, 2011, it was announced that Crane had agreed to move the franchise to the American League for the 2013 season. The move was part of an overall divisional realignment of MLB, with the National and American leagues each having 15 teams in three geographically balanced divisions. The Houston Astros won their first American League game on March 31, 2013 against the Texas Rangers. The score was 8\u20132." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "What is the term that refers to a sudden awareness?", "passages": [ [ "Peripeteia", "A character who becomes rich and famous from poverty and obscurity has undergone peripeteia, even if his character remains the same.", "When a character learns something he had been previously ignorant of, this is normally distinguished from peripeteia as anagnorisis or discovery, a distinction derived from Aristotle's work.", "Aristotle considered anagnorisis, leading to peripeteia, the mark of a superior tragedy.", "Two such plays are \"Oedipus Rex\", where the oracle's information that Oedipus had killed his father and married his mother brought about his mother's death and his own blindness and exile, and \"Iphigenia in Tauris\", where Iphigenia realizes that the strangers she is to sacrifice are her brother and his friend, resulting in all three of them escaping Tauris.", "These plots he considered complex and superior to simple plots without anagnorisis or peripeteia, such as when Medea resolves to kill her children, knowing they are her children, and does so.", "Aristotle identified \"Oedipus Rex\" as the principal work demonstrating peripety.", "(See Aristotle's \"Poetics\".)" ], [ "Kensh\u014d", "Kensh\u014d\n\nKensh\u014d (\u898b\u6027) is a Japanese term from the Zen tradition.", "\"Ken\" means \"seeing,\" \"sh\u014d\" means \"nature, essence\".", "It is usually translated as \"seeing one's (true) nature,\" that is, the Buddha-nature.", "Kensh\u014d is an \"initial\" insight or awakening, not full Buddhahood.", "It is to be followed by further training to deepen this insight, and learn to express it in daily life.", "The term kensh\u014d is often used interchangeably with satori, which is derived from the verb satoru, and means \"comprehension; understanding\".", "The Chinese Buddhist term \"jianxing\" () compounds:\n\nBuddhist monks who produced Sanskrit-Chinese translations of sutras faced many linguistic difficulties:\n", "Thus, \"jianxing\" was the translation for \"d\u1e5b\u1e63\u1e6di-svabh\u0101va\", \"view one's essential nature\".", "The (c. 8th century)", "Chinese \"Platform Sutra\" (2, Praj\u00f1\u0101 \"wisdom, understanding\") first records \"jianxing\".", "The Standard Chinese pronunciation \"jianxing\" historically derives from (c. 7th century CE) Middle Chinese \"kiensj\u00e4\u014b\".", "Sino-Xenic pronunciations of this term exist:\n\nTranslating \"kensh\u014d\" into English is semantically complex." ], [ "Satori", "Satori\n\nIn the Zen Buddhist tradition, \"satori\" refers to the experience of \"kensh\u014d\", \"seeing into one's true nature\".", "\"Ken\" means \"seeing,\" \"sh\u014d\" means \"nature\" or \"essence\".", "\"Satori\" and \"kensh\u014d\" are commonly translated as enlightenment, a word that is also used to translate bodhi, prajna and buddhahood.", "D. T. Suzuki, a Japanese author of books and essays on Buddhism, Zen and Shin that were influential in the West, described \"... looking into one's nature or the opening of satori\"; and said \"This acquiring of a new point of view in our dealings with life and the world is popularly called by Japanese Zen students 'satori' (\"wu\" in Chinese).", "It is really another name for Enlightenment (\"\"Annuttara-samyak-sambodhi\"\")\".", "\"Satori\" is often used interchangeably with \"kensh\u014d\".", "\"Kensh\u014d\" refers to the perception of the Buddha-Nature or emptiness.", "According to some authors, \"kensh\u014d\" is a brief glimpse, while \"satori\" is considered to be a deeper spiritual experience.", "Distinct from this first insight, daigo-tettei is used to refer to a \"deep\" or lasting realization of the nature of existence." ] ], "gold": "Anagnorisis is a moment in a play or other work when a character makes a critical discovery. Anagnorisis originally meant recognition in its Greek context, not only of a person but also of what that person stood for. Anagnorisis was the hero's sudden awareness of a real situation, the realisation of things as they stood, and finally, the hero's insight into a relationship with an often antagonistic character in Aristotelian tragedy. Satori is a Japanese Buddhist term for awakening, comprehension, and understanding. It is derived from the Japanese verb satoru. In the Zen Buddhist tradition, satori refers to a deep experience of kensh\u014d, seeing into one's true nature. Satori and kensh\u014d are commonly translated as enlightenment, a word that is also used to translate bodhi, praj\u00f1\u0101 and Buddhahood.", "prediction 1": "Peripeteia is the term that refers to a sudden awareness. In the Zen Buddhist tradition, Kensh is a Japanese term from the Zen tradition. \"Ken\" means \"seeing,\" \"sh\" means \"nature, essence\". Kensh and satori are commonly translated as enlightenment, a word that is also used to translate bodhi, prajna and Buddhahood. According to some authors, \"kensh\" is a brief glimpse, while \"satori\" is considered to be a deeper spiritual experience.", "prediction 2": "In the Zen tradition, the term peripeteia refers to a sudden awareness. In the Chinese Buddhist tradition, the term kensh refers to the experience of 'kensh,' or seeing into one's true nature. In the Greek and Roman tradition, the term peripeteia refers to a sudden realization that something is out of one's control, allowing one to become aware of one's true nature. In the Japanese tradition, the term kensh refers to a sudden awareness.", "prediction 3": "Peripeteia is the term used to refer to a sudden awareness. It is a Japanese term from the Zen tradition where \"kensh\" means \"seeing,\" \"sh\" means \"nature, essence\". \"Satori\" is derived from the verb satoru, and means \"comprehension; understanding\". The Buddhist term \"jianxing\" is used to refer to the experience of \"kensh\", \"seeing into one's true nature\".", "prediction 4": "Peripeteia is a Japanese term that refers to a sudden awareness of something. In the Zen Buddhism tradition, kensh refers to the experience of kensh, or \"seeing into one's true nature.\" Satori is a Japanese term from the Zen tradition. Aristotle considered anagnorisis, leading to peripeteia, the mark of a superior tragedy.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "When a character learns something he had been previously ignorant of, this is normally anagnorisis or discovery, a distinction derived from Aristotle's work. In the Zen Buddhist tradition satori\" refers to the experience of \"kensh\u014d\", \"seeing into one's true nature\". Kensh and satori are commonly translated as enlightenment, a word that is also used to translate bodhi, prajna and Buddhahood. Kensh\u014d is an \"initial\" insight or awakening. The term kensh\u014d is often used interchangeably with satori, which is derived from the verb satoru, and means \"comprehension; understanding\"." }, "preference": [ 1, 0, 0, 0, 0, 0 ] }, { "question": "Who built the bibi ka maqbara in aurangabad?", "passages": [ [ "Bibi Ka Maqbara", "Bibi Ka Maqbara\n\nThe Bibi Ka Maqbara (English:\"Tomb of the Lady\") is a tomb located in Aurangabad, Maharashtra, India.", "It was built by Mughal emperor Aurangzeb's son Azam Shah in the memory of his mother (posthumously known as Rabia-ud-Daurani).", "It bears a striking resemblance to the famous Taj Mahal, the mausoleum of wife of Shah Jahan.", "He had built the Badshahi Mosque at Lahore one of the largest Mosques in the world and the largest one at that time, as well as the small, but elegant, Pearl Mosque at Delhi.", "The comparison to the Taj Mahal has often obscured its very own considerable charm.", "Due to the strong resemblance, it is also called the \"Dakkhani Taj\" (Taj of the Deccan).", "The Bibi Ka Maqbara is the principal monument of Aurangabad and its historic city.", "An inscription found on the main entrance door mentions that this mausoleum was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively.", "Ata-ullah was the son of Ustad Ahmad Lahauri, the principal designer of the Taj Mahal." ], [ "Bibi Ka Maqbara", "An inscription found on the main entrance door mentions that this mausoleum was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively.", "The marble for this mausoleum was brought from mines near Jaipur.", "According to Tavernier, around three hundred carts laden with marble, drawn by at least 12 oxen, were seen by him during his journey from Surat to Golconda.", "The mausoleum was intended to rival the Taj Mahal, but the decline in architecture and proportions of the structure (both due to the severe budgetary constraints imposed by Aurangzeb) had resulted in a poor copy of the latter.", "The mausoleum is laid out in a Charbagh formal garden.", "It stands at the centre of a huge enclosure measuring approximately 458 m. N-S X 275 m. E-W. Baradaris or pillared pavilions are located at the centre of north, east and western part of the enclosure wall.", "The high enclosure wall is crenellated with pointed arched recesses and bastions at regular intervals.", "The recesses are divided by pilasters, crowned with small minarets.", "The mausoleum is built on a high square platform with four minarets at its corners, which is approached by a flight of steps from the three sides." ], [ "Dilras Banu Begum", "Zeb-un-Nissa doted on her brother a lot, and at the same time, Aurangzeb greatly indulged his motherless son and the prince soon became his best loved son.", "Three years after her death in 1660, Aurangzeb commissioned a mausoleum at Aurangabad to act as her final resting place, known as Bibi Ka Maqbara (\"Tomb of the Lady\").", "It is notable that Aurangzeb never raised monumental edifices during his half-a-century reign, but made just one exception, that is, to build the mausoleum of his wife.", "Here, Dilras was buried under the posthumous title of 'Rabia-ud-Daurani' (\"Rabia of the Age\").", "The Bibi Ka Maqbara bears a striking resemblance to the famous Taj Mahal, the mausoleum of Dilras' mother-in-law, Empress Mumtaz Mahal, who herself died in childbirth.", "Bibi Ka Maqbara was the largest structure that Aurangzeb had to his credit.", "In the following years, her tomb was repaired by her son, Azam Shah, under Aurangzeb's orders.", "Aurangzeb, himself, is buried a few kilometers away from her mausoleum in Khuldabad." ] ], "gold": "The Bibi Ka Maqbara is a tomb located in Aurangabad, Maharashtra, India. It was commissioned in 1660 by the Mughal emperor Aurangzeb in the memory of his first and chief wife Dilras Banu Begum. It bears a striking resemblance to the Taj Mahal, the mausoleum of Aurangzeb's mother, Mumtaz Mahal. Bibi Ka Maqbara is believed to have been built between 1668 and 1669 C.E. An inscription found on the main entrance door mentions that this mausoleum was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively.", "prediction 1": "The Bibi Ka Maqbara is a tomb in Aurangabad that was built by Mughal Emperor Aurangzeb's son Azam Shah in the memory of his mother, posthumously known as Rabia-ud-Daurani. The tomb was built by Mughal emperor Aurangzeb's son Azam Shah in the memory of his mother. The Bibi Ka Maqbara bears a striking resemblance to the famous Taj Mahal, the mausoleum was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively. Ata-ullah was the son of Ustad Ahmad Lahauri, the principal designer of the Taj Mahal. The marble for this mausoleum was brought from mines near Jaipur.", "prediction 2": "The building was built by Mughal emperor Aurangzeb's son Azam Shah in the memory of his mother, posthumously known as Rabia-ud-Daurani. According to the inscription on the main entrance door, the Bibi Ka Maqbara was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively.", "prediction 3": "The Bibi Ka Maqbara is a tomb located in Aurangabad that was built by Mughal emperor Aurangzeb's son Azam Shah in the memory of his mother, Rabia-ud-Daurani, who died in 1660. It bears a striking resemblance to the famous Taj Mahal, the mausoleum of wife of Shah Jahan. Ata-ullah, an architect, designed and erected this mausoleum. Hanspat Rai, an engineer, an engineer.", "prediction 4": "The Bibi Ka Maqbara is a tomb located in Aurangabad, Maharashtra, India. It was built by Mughal emperor Aurangzeb's son Azam Shah in the memory of his mother. The inscription on the main entrance door mentions that this mausoleum was designed and erected by Ata-ullah, an architect, and Hanspat Rai, an engineer respectively. Ata-ullah was the son of Ustad Ahmad Lahauri, the principal designer of the Taj Mahal.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 171 }, { "error type": "Redundant", "explanation": "The Bibi Ka Maqbara is a tomb in Aurangabad that was built by Mughal Emperor Aurangzeb's son Azam Shah in the memory of his mother, ", "start": 172, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 447, "end": 599 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Bibi Ka Maqbara is a tomb in Aurangabad that was built by Mughal Emperor Aurangzeb's son Azam Shah in the memory of his mother. It bears a striking resemblance to the Taj Mahal, the mausoleum of Aurangzeb's mother, Mumtaz Mahal. An inscription found on the main entrance door mentions that this mausoleum was designed and erected by Ata-ullah, an architect and Hanspat Rai, an engineer respectively. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did ghana won the under 20 world cup?", "passages": [ [ "Ghana national under-20 football team", "Ghana national under-20 football team\n\nGhana national U-20 football team known as the \"Black Satellites\", is considered to be the feeder team for the Ghana national football team.", "They are the former FIFA U-20 World Cup Champions and African Youth Champions, they have also been a three-time African Champion in 1995, 1999, 2009 and a two-time Runner-up at the FIFA World Youth Championship in 1993, 2001 and finished third in 2013.", "Ghana has participated in only six of the past 19 World Cup events starting with their first in Australia 1993 where they lost the World Cup final 1-2 to Brazil in Sydney and in Argentina 2001 where they lost the World Cup final 0-3 to Argentina in Buenos Aires.", "Incredibly, in 32 FIFA World Cup matches, Ghana has not lost a game in regulation below the Semi Final level of the FIFA U20 World Cup.", "They however failed to qualify for 3 consecutive events in UAE 2003, Netherlands 2005 and Canada 2007 until they made the Egypt 2009 Tournament.", "They won the 2009 FIFA U-20 World Cup in the Cairo International Stadium, Cairo, Egypt after defeating Brazil 4-3 on Penalties when the match ended (0-0) After Extra Time.", "The first time an African country won the FIFA U-20 World Cup Championship." ], [ "2009 FIFA U-20 World Cup", "2009 FIFA U-20 World Cup\n\nThe 2009 FIFA U-20 World Cup was the 17th U-20 tournament, which was hosted by Egypt from 24 September to 16 October, in the cities of Cairo, Alexandria, Port Said, Suez and Isma\u00eflia.", "The tournament was initially going to take place between 10\u201331 July, however the 2009 Confederations Cup was played mid year resulting in both the Under 20 World Cup and the Under 17 World Cup being played towards the end of the year.", "The cup was won by Ghana after they defeated Brazil on penalties in the final, becoming the first African team to have won the tournament.", "Only players born on or after 1 January 1989 were eligible to compete in the 2009 FIFA U-20 World Cup.", "Twenty-three teams qualified for the 2009 FIFA U-20 World Cup.", "As the host team, Egypt received automatic entry to the cup, bringing the total number of teams to twenty-four for the tournament.", "Teams were allocated to groups on the basis of geographical spread.", "Teams were placed in four pots, and one team was drawn from each pot for each group.", "Pot 1 contained the five African teams plus one from CONMEBOL; Pot 2 contained the remaining teams from the Americas excluding one CONCACAF team; Pot 3 consisted of teams from Asia and Oceania plus the remaining CONCACAF team; Pot 4 consisted of teams from the European confederation." ] ], "gold": "The Ghana national U-20 football team, known as the Black Satellites, is considered to be the feeder team for the Ghana national football team. They are the former FIFA U-20 World Cup Champions and African Youth Champions. They won the 17th edition 2009 FIFA U-20 World Cup in the Cairo International Stadium, Cairo, Egypt on 16 October 2009, which was the first time an African country won the FIFA U-20 World Cup Championship.", "prediction 1": "The 2009 FIFA U-20 World Cup was the 17th FIFA U-20 tournament, which was hosted by Egypt from 24 September to 16 October, in the cities of Cairo, Alexandria, Port Said, Suez and Ismalia. The first time an African country won the FIFA U-20 World Cup Championship.", "prediction 2": "The first time an African country won the FIFA U-20 World Cup Championship was in 2009. The 2009 FIFA U-20 World Cup was the 17th U-20 tournament, which was hosted by Egypt from 24 September to 16 October, in the cities of Cairo, Alexandria, Port Said, Suez and Ismalia. Ghana won the cup in the Cairo International Stadium, Cairo, Egypt after defeating Brazil 4-3 on Penalties when the match ended (0-0) After Extra Time.", "prediction 3": "Ghana won the Under 20 World Cup in the 2009 FIFA U-20 World Cup after defeating Brazil 4-3 on penalties in the final. The tournament was initially going to take place between 10\u201331 July, however the 2009 Confederations Cup was played mid year resulting in both the Under 20 World Cup and the Under 17 World Cup being played towards the end of the year. The 2009 FIFA U-20 World Cup was the 17th U-20 tournament, which was hosted by Egypt from 24 September to 16 October, in the cities of Cairo, Alexandria, Port Said, Suez and Ismalia.", "prediction 4": "The first time an African country won the FIFA U-20 World Cup was in 2009. The 2009 FIFA U-20 World Cup was the 17th U-20 tournament, which was hosted by Egypt from 24 September to 16 October, in the cities of Cairo, Alexandria, Port Said, Suez and Ismalia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 187 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Ghana national U-20 football team, known as the Black Satellites, is considered to be the feeder team for the Ghana national football team. They are the former FIFA U-20 World Cup Champions and African Youth Champions. They won the 2009 FIFA U-20 World Cup in the Cairo International Stadium, Cairo, Egypt. The first time an African country won the FIFA U-20 World Cup Championship." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "How many games did the cavs win in 2016?", "passages": [ [ "Cleveland Cavaliers", "Cleveland Cavaliers\n\nThe Cleveland Cavaliers, often referred to as the Cavs, are an American professional basketball team based in Cleveland, Ohio.", "The Cavs compete in the National Basketball Association (NBA) as a member of the league's Eastern Conference Central Division.", "The team began play as an expansion team in 1970, along with the Portland Trail Blazers and Buffalo Braves.", "Home games were first held at Cleveland Arena from 1970 to 1974, followed by the Richfield Coliseum from 1974 to 1994.", "Since 1994, the Cavs have played home games at Quicken Loans Arena in downtown Cleveland, which is shared with the Cleveland Gladiators of the Arena Football League and the Cleveland Monsters of the American Hockey League.", "Dan Gilbert has owned the team since March 2005.", "The Cavaliers opened their inaugural season losing their first 15 games and struggled in their early years, placing no better than sixth in the Eastern Conference during their first five seasons.", "The team won their first Central Division title in 1976, which also marked the first winning season and playoff appearance in franchise history, where they advanced to the Eastern Conference Finals.", "The franchise was purchased by Ted Stepien in 1980.", "Stepien's tenure as owner was marked by six coaching changes, questionable trades and draft decisions, and poor attendance, leading to $15 million in financial losses." ], [ "2016 NBA Playoffs", "On February 27, 2016, The Golden State Warriors became the first team to clinch a playoff spot.", "This was the earliest a team had clinched a playoff spot in February since the 1987\u201388 Los Angeles Lakers.", "The Cleveland Cavaliers became the first Eastern Conference team to clinch a playoff spot on March 18, 2016.", "Teams in bold advanced to the next round.", "The numbers to the left of each team indicate the team's seeding in its conference, and the numbers to the right indicate the number of games the team won in that round.", "The division champions are marked by an asterisk.", "Teams with home court advantage are shown in Italics.", "In Game 3, Kyrie Irving hit the tough corner 3 late in the 4th quarter, with only 0.7 seconds remaining on the shot clock.", "In Game 4, Irving also hit a three to give the Cavaliers a 4-point lead with less than a minute left.", "Reggie Jackson would then drive and dunk the ball to cut the lead to 2.", "As Irving attempted another clutch 3, it went short and the players scrambled for the ball until the Pistons came up with it.", "As they looked for a 3 to force Game 5, or a 2 to send it to overtime, they look to Reggie Jackson.", "He took a 3 over Irving, but that went short as well, and the Cavaliers move on to the second round." ], [ "2015\u201316 Cleveland Cavaliers season", "However, despite having the best record in their conference, the team fired head coach David Blatt on January 22, 2016.", "Assistant coach Tyronn Lue took over for the remainder of the season.", "The Cavaliers finished the regular season with a 57\u201325 record and obtained the number one seed in the Eastern Conference for the first time since 2010.", "In the first two rounds of the 2016 NBA playoffs, the Cavaliers swept the Detroit Pistons and the Atlanta Hawks, respectively.", "In the Eastern Conference Finals, the Cavaliers beat the Toronto Raptors in six games.", "The Cavaliers lost three of the first four games of the 2016 NBA Finals to the Golden State Warriors, who had defeated Cleveland in the finals the year before.", "In turn, the Cavaliers won Games 5 and 6 of the series to bring about a climactic Game 7 at Oracle Arena.", "With Game 7 tied at 89\u201389, LeBron James chased down and blocked Andre Iguodala's attempted lay-up in a play that became known as \"The Block.\"", "The Cavaliers ultimately won Game 7, 93\u201389, for the first NBA championship in franchise history.", "No team had ever before recovered from a 3\u20131 deficit in an NBA Finals series.", "James was named the unanimous NBA Finals MVP, receiving the award for the third time in his career." ] ], "gold": "The Cleveland Cavaliers is an American professional basketball team based in Cleveland that competes in the National Basketball Association and plays in regular season games and in playoff games if they qualify for a spot. The Cavaliers won 57 games during the regular 2015-2016 season, and their total winning games including the playoffs that season, was 73. During the 2016-2017 season, the Cavaliers won 51 games during the regular season, not including the playoffs. Combining their total wins in the 2016-2017 regular season with their playoff wins that season puts their total at 64.", "prediction 1": "The Cleveland Cavaliers, often referred to as the Cavs, are an American professional basketball team based in Cleveland, Ohio. In 2016, the Cavs won 9 games, while in 2015, they won 11 games. In 2016, the Cavs won 6 games, while in 2015, they won 3 and in 2016, they won 5 games.", "prediction 2": "The Cleveland Cavaliers are an American professional basketball team based in Cleveland, Ohio that competes in the National Basketball Association as a member of the league's Eastern Conference Central Division. The team won a total of 3 games in 2016, which was four more than they had won in 2016.", "prediction 3": "The Cleveland Cavaliers, often referred to as the Cavs, are an American professional basketball team based in Cleveland, Ohio and compete in the National Basketball Association as a member of the league's Eastern Conference Central Division. The team began play as an expansion team in 1970, losing their first 15 games and struggling in their early years, placing no better than sixth in the Eastern Conference during their first five seasons. On March 18, 2016, the Cavaliers became the first Eastern Conference team to clinch a playoff spot.", "prediction 4": "The Cleveland Cavaliers are an American professional basketball team based in Cleveland, Ohio. In the 2016 NBA season, the Cavaliers won 13 games. In the 2016 NBA playoffs, the Cavaliers won 15 games.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 55 }, { "error type": "Redundant", "explanation": "In 2016, the Cavs won 9 games, while in 2015, they won 11 games. ", "start": 192, "end": 279 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 182, "end": 191 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Cleveland Cavaliers are an American professional basketball team based in Cleveland, Ohio. They compete in the National Basketball Association (NBA). In 2015, they won 57 games in the regular season, they won a total of 73 after winning the NBA Finals. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who said love means never having to say you're sorry?", "passages": [ [ "Love means never having to say you're sorry", "Love means never having to say you're sorry\n\n\"Love means never having to say you're sorry\" is a catchphrase based on a line from the Erich Segal novel \"Love Story\" and was popularized by its 1970 film adaptation starring Ali MacGraw and Ryan O'Neal.", "The line is spoken twice in the film: once in the middle of the film, by Jennifer Cavalleri (MacGraw's character), when Oliver Barrett (O'Neal) apologizes to her for his anger; and as the last line of the film, by Oliver, when his father says \"I'm sorry\" after learning of Jennifer's death.", "In the script the line is phrased slightly differently: \"Love means not ever having to say you're sorry.\"", "The line proved memorable, and has been repeated in various contexts since.", "In 2005 it was voted #13 in the American Film Institute's list AFI's 100 Years... 100 Movie Quotes.", "The band Sounds of Sunshine had a Top 40 hit in the United States with a song titled \"Love Means You Never Have to Say You're Sorry\" in 1971." ], [ "AFI's 100 Years...100 Movie Quotes", "AFI's 100 Years...100 Movie Quotes\n\nPart of The American Film Institute (AFI 100 Years... series), AFI's 100 Years...", "100", "Movie Quotes is a list of the top 100 movie quotations in American cinema.", "The American Film Institute revealed the list on June 21, 2005, in a three-hour television program on CBS.", "The program was hosted by actor Pierce Brosnan and had commentary from many Hollywood actors and filmmakers.", "A jury consisting of 1,500 film artists, critics, and historians selected \"Frankly, my dear, I don't give a damn,\" spoken by Clark Gable as Rhett Butler in the 1939 American Civil War epic \"Gone with the Wind\" as the most memorable American movie quotation of all time.", "Jurors were asked to consider the following criteria in making their selections:\n\nThe table below reproduces the quotes as the AFI published them.", "With six movie quotes featured, \"Casablanca\" is by far the most represented film on this list.", "\"Gone with the Wind\" and \"The Wizard of Oz\" are tied for second, with three each.", "\"Sunset Boulevard\", \"A Streetcar Named Desire\", \"The Graduate\" and \"Jerry Maguire\" each have two quotes." ] ], "gold": "\"Love means never having to say you're sorry\" is a catchphrase based on a line from the Erich Segal novel \"Love Story\" and was popularized by its 1970 film adaptation. The line is spoken twice in the film, once by Jennifer Cavalleri to Oliver Barrett in the middle of the film, and once by Oliver to his father as the last line of the film. The line was so memorable that it was voted 13th in the AFI's list of the top 100 American movie quotes.", "prediction 1": "Love means never having to say you're sorry is a catchphrase based on a line from the Erich Segal novel \"Love Story\" popularized by its 1970 film adaptation starring Ali MacGraw and Ryan O'Neal. The band Sounds of Sunshine had a Top 40 hit in the United States with a song titled \"Love Means You Never Have to Say You're Sorry\" in 1971. In 2005 it was voted #13 in the American Film Institute's list AFI's 100 Years... 100 Movie Quotes, which is a list of the top 100 movie quotations in American cinema.", "prediction 2": "\"Love means never having to say you're sorry\" is a catchphrase based on a line from the Erich Segal novel \"Love Story\" and was popularized by its 1970 film adaptation starring Ali MacGraw and Ryan O'Neal. The band Sounds of Sunshine had a Top 40 hit in the United States with a song titled \"Love Means You Never Have to Say You're Sorry\" in 1971. In 2005 it was voted #13 in the American Film Institute's list AFI's 100 Years... 100 Movie Quotes.", "prediction 3": "Love means never having to say you're sorry is a catchphrase based on a line from the Erich Segal novel Love Story and was popularized by its 1970 film adaptation starring Ali MacGraw and Ryan O'Neal. The line is spoken two times in the film: once in the middle of the film, by Jennifer Cavalleri, when Oliver Barrett (O'Neal), apologizes to her for his anger; and as the last line of the film, by Oliver, when his father says \"I don't give a damn,\" spoken by Clark Gable as Rhett Butler in the 1939 American Civil War epic Gone with the Wind as the most memorable American movie quotation of all time.", "prediction 4": "Love means never having to say you're sorry is a catchphrase based on a line from the Erich Segal novel Love Story and was popularized by its 1970 film adaptation starring Ali MacGraw and Ryan O'Neal. In the script the line is phrased slightly differently: \"Love means never having to say you're sorry.\" In 2005 it was voted #13 in the American Film Institute's list AFI's 100 Years... 100 Movie Quotes. The band Sounds of Sunshine had a Top 40 hit in the United States with a song titled Love Means You Never Have to Say You're Sorry in 1971. A jury consisting of 1,500 film artists, critics, and historians selected \"Frankly, my dear, I don't give a damn,\" spoken by Clark Gable as Rhettttt Butler in the 1939 American Civil War epic Gone with", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 336 }, { "error type": "Irrelevant", "explanation": "", "start": 437, "end": 504 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Love means never having to say you're sorry is a catchphrase based on a line from the Erich Segal novel \"Love Story\" popularized by its 1970 film adaptation. The line is spoken twice in the film, once by Jennifer Cavalleri to Oliver Barrett in the middle of the film, and once by Oliver to his father as the last line of the film. The line was so memorable that it was voted 13th in the AFI's list of the top 100 American movie quotes." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When was the declaration of independence officially signed?", "passages": [ [ "Signing of the United States Declaration of Independence", "Signing of the United States Declaration of Independence\n\nThe signing of the United States Declaration of Independence occurred primarily on August 2, 1776 at the Pennsylvania State House, Independence Hall in Philadelphia, Pennsylvania.", "The 56 delegates to the Second Continental Congress represented the 13 former colonies which had declared themselves the \"United States of America,\" and they endorsed the Declaration of Independence which the Congress had approved on July 4, 1776.", "The Declaration proclaimed that the former Thirteen Colonies then at war with Great Britain were now a sovereign, independent nation and thus no longer a part of the British Empire.", "The signers\u2019 names are grouped by state, with the exception of President of the Continental Congress John Hancock; the states are arranged geographically from north to south.", "The final draft of the Declaration was approved by the Continental Congress on July 4, although the date of its signing has long been disputed.", "Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed.", "The Second Continental Congress adopted the Declaration of Independence on July 4, 1776, with 12 of the 13 colonies voting in favor and New York abstaining.", "The date that the Declaration was signed has long been the subject of debate." ] ], "gold": "It is commonly believed the Declaration of Independence was officially signed on July 4, 1776, but historians have concluded it was actually signed on August 2, 1776.", "prediction 1": "The signing of the Declaration of Independence by the 13 American colonies occurred primarily on August 2, 1776 at the Pennsylvania State House, Independence Hall in Philadelphia, Pennsylvania. The date that the Declaration was officially signed has long been disputed. Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed.", "prediction 2": "The United States Declaration of Independence was officially signed on August 2, 1776. The date that the Declaration was officially signed has long been disputed. Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed.", "prediction 3": "The American Declaration of Independence was officially signed on August 2, 1776, in Philadelphia, Pennsylvania. The date that the Declaration was signed has long been disputed by historians, who have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed.", "prediction 4": "The signing of the United States Declaration of Independence occurred primarily on August 2, 1776 at the Pennsylvania State House, Independence Hall in Philadelphia, Pennsylvania. The Second Continental Congress approved the Declaration of Independence on July 4, 1776. However, the date of its signing has long been disputed. Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 269 } ], "missing-info": [], "corrected-prediction": " Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "On what type of landform are north and south korea located?", "passages": [ [ "Korea", "The Proto\u2013Three Kingdoms period, sometimes called the Multiple States Period, is the earlier part of what is commonly called the Three Kingdoms Period, following the fall of Gojoseon but before Goguryeo, Baekje, and Silla fully developed into kingdoms.", "This time period saw numerous states spring up from the former territories of Gojoseon, which encompassed northern Korea and southern Manchuria.", "With the fall of Gojoseon, southern Korea entered the Samhan period.", "Located in the southern part of the Korean Peninsula, Samhan refers to the three confederacies of Mahan, Jinhan, and Byeonhan.", "Mahan was the largest and consisted of 54 states.", "Byeonhan and Jinhan both consisted of twelve states, bringing a total of 78 states within the Samhan.", "These three confederacies eventually developed into Baekje, Silla, and Gaya.", "The Three Kingdoms of Korea consisted of Goguryeo, Silla, and Baekje.", "Silla and Baekje controlled the southern half of the Korean Peninsula, maintaining the former Samhan territories, while Goguryeo controlled the northern half of the Korean Peninsula, Manchuria and the Liaodong Peninsula, uniting Buyeo, Okjeo, Dongye, and other states in the former Gojoseon territories." ], [ "Geography of North Korea", "Geography of North Korea\n\nNorth Korea is located in east Asia on the northern half of the Korean Peninsula.", "North Korea shares a border with three countries; China along the Amnok River, Russia along the Tumen River, and South Korea along the Korean Demilitarized Zone (DMZ).", "The Yellow Sea and the Korea Bay are off the west coast and the Sea of Japan (East Sea of Korea) is off the east coast.", "Most of North Korea is a series of medium-sized mountain ranges and large hills, separated by deep, narrow valleys.", "The highest peak, Paektu-san on the volcanic Baekdu Mountain, is located on its northern border with China, and rises 9,002\u00a0ft. (2,744 m).", "Along the west coast there are wide coastal plains, while along the Sea of Japan coastline (North Korea's lowest point at 0 m), narrow plains rise into mountains.", "Similar to South Korea, dozens of small islands dot the western coastline.", "North Korea's longest river is the Yulu (Yalu).", "Other large rivers include the Tumen, Taedong and Imjin.", "The terrain consists mostly of hills and mountains separated by deep, narrow valleys.", "The coastal plains are wide in the west and discontinuous in the east." ] ], "gold": "North and South Korea are primarily located on a peninsula. A small portion of each country is located on minor islands.", "prediction 1": "North Korea is located in east Asia on the northern half of the Korean Peninsula. The landform of the peninsula is mountainous, with mountains forming the highest peaks.\n", "prediction 2": "North Korea is located in east Asia on the northern half of the Korean Peninsula. Similar to South Korea, dozens of small islands dot the western coastline.", "prediction 3": "North Korea is located in east Asia on the northern half of the Korean Peninsula, which shares a border with three countries. The landform with the northern half of the Korean Peninsula is Linear Grain Coniferous Plain. The landform with the southern half of the Korean Peninsula is Samhan. It is a contiguous plateau with a high summit of Mount Paektu on the volcanic Baekdu mountain.", "prediction 4": "North Korea is located in east Asia on the northern half of the Korean Peninsula. The landform is mainly mountain plateau, with several drop-offs into the sea.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 35 }, { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 70 }, { "error type": "Incoherent", "explanation": "", "start": 128, "end": 170 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "North Korea is located on a peninsula. The landform of the peninsula is mountainous, separated by deep, narrow valleys. Coastal plains are wide in the west and discontinuous in the east.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played the father on father knows best?", "passages": [ [ "Father Knows Best", "She whines, cries and complains about her status in the family as being overlooked.", "She often is the source of money to her brother and sister, although she is in hock several years on her own allowance.", "In an interview published in the magazine \"Films of the Golden Age\" (Fall 2015), Young revealed about the radio program: \"I never quite liked it because it had to have laughs.", "And I wanted a warm relationship show...", "When we moved to TV I suggested an entirely new cast and different perspective.\"", "The May 27, 1954, episode of \"The Ford Television Theatre\" show was called \"Keep It in the Family.\"", "This 26-minute episode stars Robert Young as Jim Warren, head of the Warren family.", "With him was wife Grace (Ellen Drew), older daughter Peggy (Sally Fraser), younger daughter Patty (Tina Thompson), and son Jeff (Gordon Gebert).", "Developed by Young and his partner Eugene Rodney, it was intended as a pilot for a \"Father Knows Best\" television series.", "In the episode Peggy dreams of making it as an actress, but a talent scout who has raised her hopes just wants people for his acting school.", "Only Robert Young remained of the radio cast when the series moved to CBS Television:\n\n", "The series premiered October 3, 1954, on CBS where it aired Sundays at 10:00 pm (ET)." ], [ "Father Knows Best", "Father Knows Best\n\nFather Knows Best is an American sitcom starring Robert Young, Jane Wyatt, Elinor Donahue, Billy Gray, and Lauren Chapin.", "The series, which first began on radio in 1949, aired for six seasons with a total of 203 episodes.", "The series debuted on CBS in October 1954.", "It ran for one season and was canceled the following year.", "The series was picked up by NBC, where it remained for three seasons.", "After a second cancellation in 1958, the series was picked up yet again, by CBS, where it aired until May 1960.", "Created by Ed James, \"Father Knows Best\" follows the lives of the Andersons, a middle-class family living in the Midwestern town of Springfield.", "The series began August 25, 1949, on NBC Radio.", "Set in the Midwest, it starred Robert Young as the General Insurance agent Jim Anderson.", "His wife Margaret was first portrayed by June Whitley and later by Jean Vander Pyl.", "The Anderson children were Betty (Rhoda Williams), Bud (Ted Donaldson), and Kathy (Norma Jean Nilsson).", "Others in the cast were Eleanor Audley, Herb Vigran, and Sam Edwards.", "Sponsored through most of its run by General Foods, the series was heard Thursday evenings on NBC until March 25, 1954.", "On the radio program, the character of Jim differs from the later television character." ], [ "Robert Young (actor)", "Robert Young (actor)\n\nRobert George Young (February 22, 1907 \u2013 July 21, 1998) was an American film, television, and radio actor, best known for his leading roles as Jim Anderson, the father character in \"Father Knows Best\" (CBS, then NBC, then CBS again), and the physician Marcus Welby in \"Marcus Welby, M.D.\" (ABC).", "Born in Chicago, Young was the son of an Irish immigrant father, Thomas E. Young, and an American mother, Margaret Fyfe.", "When Young was young, the family moved to different locations within the U.S.:", "Seattle, followed by Los Angeles, where Young became a student at Abraham Lincoln High School.", "After graduation, he studied and performed at the Pasadena Playhouse while working at odd jobs and appearing in bit parts in silent films.", "While touring with a stock company producing \"The Ship\", Young was discovered by a Metro-Goldwyn-Mayer talent scout with whom he subsequently signed a contract.", "Young made his sound film debut for MGM in the 1931 Charlie Chan film \"Black Camel\".", "Young appeared in over 100 films between 1931 and 1952." ] ], "gold": "Father Knows Best is an American sitcom starring Robert Young, Jane Wyatt, Elinor Donahue, Billy Gray and Lauren Chapin. The series, which first began on radio in 1949, aired as a television show for six seasons with a total of 203 episodes. Created by Ed James, Father Knows Best follows the lives of the Andersons, a middle-class family living in the Midwestern town of Springfield. In both the television series and the radio series Robert Young plays the character of the father.", "prediction 1": "Father Knows Best is an American sitcom starring Robert Young as the General Insurance agent Jim Anderson and his wife Margaret was first portrayed by June Whitley and later by Jean Vander Pyl. The May 27, 1954, episode of the Ford Television Theatre show was called \"Keep It in the Family.\" This 26-minute episode stars Robert Young as Jim Warren, head of the Warren family. The May 25, 1949, episode of the Radio version of the show stars Robert Young as Jim Anderson.", "prediction 2": "Father Knows Best is an American sitcom that follows the lives of the Anderson family, a middle-class family living in the Midwestern town of Springfield. The radio program first aired on NBC in 1949 and was filmed in Chicago. Robert Young played Jim Anderson on the radio program. The television character was played by Ted Donaldson.", "prediction 3": "Father Knows Best is an American sitcom starring Robert Young, Jane Wyatt, Elinor Donahue, Billy Gray, and Lauren Chapin. The radio program first aired the show in 1949, and aired for six seasons. On the CBS version, Robert Young played the character of Jim Anderson.", "prediction 4": "On the radio version of the sitcom Father Knows Best, Robert Young played Jim Anderson, the father of Margaret and Bud Anderson. On the television version, Robert Young played Jim Anderson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 62, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 470 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Father Knows Best is an American sitcom starring Robert Young, Jane Wyatt, Elinor Donahue, Billy Gray and Lauren Chapin. The series, which first began on radio in 1949, aired for six seasons with a total of 203 episodes. Created by Ed James, \"Father Knows Best\" follows the lives of the Andersons, a middle-class family living in the Midwestern town of Springfield. In the series Robert Young plays the character of the father. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What kind of wood is a stradivarius violin made of?", "passages": [ [ "Stradivarius", "Stradivarius\n\nA Stradivarius is one of the violins, violas, cellos and other string instruments built by members of the Italian family Stradivari, particularly Antonio Stradivari (Latin: Antonius Stradivarius), during the 17th and 18th centuries.", "According to their reputation, the quality of their sound has defied attempts to explain or equal it, though this belief is disputed.", "The fame of Stradivarius instruments is widespread, appearing in numerous works of fiction.", "Stradivari made his instruments using an inner form, unlike the French copyists, such as Vuillaume, who employed an outer form.", "It is clear from the number of forms throughout his career that he experimented with some of the dimensions of his instruments.", "The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck.", "There has been conjecture that the wood used may have been treated with several types of minerals, both before and after construction of a violin.", "Scientists at National Taiwan University have detected trace amounts of aluminum, copper, and calcium in wood from Stradivari violins.", "The traces may have come from chemical preservatives applied by loggers to the wood they sold.", "As well, the violin makers applied varnishes to their instruments." ] ], "gold": "A Stradivarius is one of the violins, violas, cellos and other string instruments built by members of the Italian family Stradivari, during the 17th and 18th centuries, particularly Antonio Stradivari. The woods used included\u00a0spruce\u00a0for the top,\u00a0willow\u00a0for the internal blocks and linings, and\u00a0maple\u00a0for the back, ribs, and neck.", "prediction 1": "The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck. The instruments were made by members of the Italian family Stradivari, particularly Antonio Stradivari.", "prediction 2": "The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck. Scientists at National Taiwan University have detected trace amounts of aluminum, copper, and calcium in wood from Stradivarius violins.", "prediction 3": "A Stradivarius is one of the violins, violas, cellos and other string instruments built by members of the Italian family Stradivari, particularly Antonio Stradivari, during the 17th and 18th centuries. The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck.", "prediction 4": "A Stradivarius is one of the violins, violas, cellos and other string instruments built by members of the Italian family Stradivari, particularly Antonio Stradivari, during the 17th and 18th centuries. The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck. There has been conjecture that the wood used may have been treated with several types of minerals, both before and after construction of a violin.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 231 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "A Stradivarius is one of the violins, violas, cellos and other string instruments built by members of the Italian family Stradivari, during the 17th and 18th centuries, particularly Antonio Stradivari. The woods used included spruce for the top, willow for the internal blocks and linings, and maple for the back, ribs, and neck. " }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who won the big brother naija last year?", "passages": [ [ "Big Brother Naija", "Big Brother added another twist to the game on day 79 by cancelling the day's scheduled nominations and making the house mates believe they will instead be evicted based on their performances on assigned tasks while in reality no more evictions were held and viewers began voting for the winner who turned out to be 26-year-old Katung Aduwak.", "The second season of \"Big Brother Nigeria\" (entitled \"Big Brother Naija\") premiered 11 years after the first season.", "Efe Ejeba emerged winner of the second season in 2017.", "Miracle Igbokwe from Imo State emerged winner of the third season in 2018." ], [ "Big Brother Naija", "Big Brother Naija\n\nBig Brother Naija, formerly known as Big Brother Nigeria, is a Nigerian reality competition television series, based on the Big Brother television franchise, in which 12 contestants live in an isolated house and compete for a large cash prize worth $100,000 at the end of the show by avoiding being evicted from the house by viewers.", "The first season of the show first aired on DStv Channel 37 from March 5 to June 4, 2006.", "The voting results were verified by the auditing company of Alexander-Forbes.", "A second season of the series premiered on January 22, 2017, and a third season debuted on January 28, 2018.", "The first season of the show first aired on DStv Channel 37 from March 5 to June 4, 2006.", "In a twist to the game, two new contestants were introduced on Day 23, much to the excitement of the remaining house mates.", "Ebuka, the most popular house mate for several weeks into the show and widely believed to emerge winner was the seventh house mate to be evicted; many viewers blame the Joe's Fan Club (JFC) for his eviction.", "Joe himself was soon evicted from the show." ], [ "Big Brother Naija (season 2)", "Big Brother Naija (season 2)\n\nThe second season of Big Brother Naija, the Nigerian version of the reality show Big Brother began broadcasting on 22 January 2017 and is slated to end after 78 days.", "Ex-housemate Ebuka Obi-Uchendu from season one as the host.", "Two fake housemates, Jon Ogah and Ese Eriata were introduced halfway into the show to spice things up.", "The Winner of BBNaija 2017 is Efe as announced on Sunday April 9th 2017 during the ground Finale.", "Big Brother Naija 2017 is the second of Nigeria's version of the Big brother reality show, the organizers of the talent hunt show which lasts for complete three months originated from popular Big Brother Africa.", "Meanwhile the Top 5 Big Brother Naija 2017 Finalists are Efe, Bisola, TBoss, Debie-Rise, and Marvis.", "Other housemates in no particular order are Bally, Bassey, CoColce, Ese, Gifty, Jon, Kemen, Miyonse, Soma, Thin Tall Tony and Uriel." ] ], "gold": "The first season of Big Brother Naija first aired from 5 March to 4 June 2006 and the winner was Katung Aduwak. Michael Efe Ejeba won season 2 of the show, which aired in 2017, 11 years after season 1. ", "prediction 1": "Big Brother Naija, formerly known as Big Brother Nigeria, is a Nigerian reality competition television series in which 12 contestants live in an isolated house and compete for a large cash prize worth $100,000 at the end of the show by avoiding being evicted from the house by viewers. Efe Ejeba emerged winner of the second season in 2017. Miracle Igbokwe from Imo State emerged winner of the third season in 2018.", "prediction 2": "Big Brother Naija, formerly known as Big Brother Nigeria, is a Nigerian reality competition television series, based on the Big Brother television franchise, in which 12 contestants live in an isolated house and compete for a large cash prize worth $100,000 at the end of the show by avoiding being evicted from the house by viewers. In the first season, Efe Ejeba emerged winner of the second season in 2007, Miracle Igbokwe from Imo State emerged winner of the third season in 2018 and Ebuka Obi-Uchendu became the sixth housemate to be evicted from the house after a few days later. In 2019, Miracle Igbokwe from Imo State emerged winner of the fourth season of the series, in 2019.", "prediction 3": "Big Brother Naija is a Nigerian reality competition television series in which 12 contestants live in an isolated house and compete for a large cash prize worth $100,000 at the end of the show by avoiding being evicted from the house by viewers. The winner of the first season of Big Brother Naija was Efe Ejeba, who emerged winner of the second season in 2017. The winner of the second season was Miracle Igbokwe, who emerged winner of the third season in 2018.", "prediction 4": "The winner of Big Brother Naija in 2017 was Efe Ejeba. The winner of Big Brother Naija in 2018 was Miracle Igbokwe.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 285 }, { "error type": "Unverifiable", "explanation": "", "start": 341, "end": 415 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first season of the Big Brother Naija first aired 37 from March 5 to June 4, 2006 and the winner was Katung Aduwak. Efe Ejeba emerged winner of the second season in 2017. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What is the 8th state of the united states?", "passages": [ [ "Province of North-Carolina", "Province of North-Carolina\n\nThe Province of North-Carolina was a British colony that existed in North America from 1712 to 1776, created as a proprietary colony.", "The power of the British government was vested in a Governor of North-Carolina, but the colony declared independence from Great Britain in 1776.", "The Province of North-Carolina had four capitals: Bath (1712\u20131722), Edenton (1722\u20131743), Brunswick (1743\u20131770), and New Bern (after 1770).", "The colony later became the states of North Carolina and Tennessee, and parts of the colony combined with other territory to form the states of Georgia, Alabama, and Mississippi.", "\"For history prior to 1712, see Province of Carolina.\"", "King Charles II of England granted the Carolina charter in 1663 for land south of Virginia Colony and north of Spanish Florida.", "He granted the land to eight Lords Proprietors in return for their financial and political assistance in restoring him to the throne in 1660.", "The northern half of the colony differed significantly from the southern half, and transportation and communication were difficult between the two regions, so a separate deputy governor was named to administer the northern half of the colony starting in 1691.", "The division of the colony into north and south was completed at a meeting of the Lords Proprietors held at Craven House in London on December 7, 1710, although the same proprietors continued to control both colonies." ], [ "Delaware", "Delaware\n\nDelaware () is one of the 50 states of the United States, in the Mid-Atlantic or Northeastern region.", "It is bordered to the south and west by Maryland, to the north by Pennsylvania, and to the east by New Jersey and the Atlantic Ocean.", "The state takes its name from Thomas West, 3rd Baron De La Warr, an English nobleman and Virginia's first colonial governor.", "Delaware occupies the northeastern portion of the Delmarva Peninsula.", "It is the second smallest and sixth least populous state, but the sixth most densely populated.", "Delaware's largest city is Wilmington.", "The state is divided into three counties, the lowest number of any state.", "From north to south, they are New Castle County, Kent County, and Sussex County.", "While the southern two counties have historically been predominantly agricultural, New Castle County is more industrialized.", "Before its coastline was explored by Europeans in the 16th century, Delaware was inhabited by several groups of Native Americans, including the Lenape in the north and Nanticoke in the south.", "It was initially colonized by Dutch traders at Zwaanendael, near the present town of Lewes, in 1631.", "Delaware was one of the 13 colonies participating in the American Revolution.", "On December\u00a07, 1787, Delaware became the first state to ratify the Constitution of the United States, and has since been known as \"The First State\"." ] ], "gold": "The 8th state of the United States with respect to order of admission to the Union is South Carolina. South Carolina, which was originally known as Clarendon Province, was a province of Great Britain that existed in North America from 1712 to 1776 and was one of the five Southern colonies and one of the thirteen American colonies. The 8th state of the United States in alphabetical order is Delaware. Delaware is a state in the Mid-Atlantic region of the United States, bordering Maryland to its south and west; Pennsylvania to its north; and New Jersey and the Atlantic Ocean to its east, and takes its name from the nearby Delaware River named after Thomas West, 3rd Baron De La Warr, an English nobleman and Virginia's first colonial governor.", "prediction 1": "The 8th state of the United States is Delaware. Delaware is the second smallest state in the United States and the sixth most populous. Delaware was an early state of the United States and was one of the 13 colonies participating in the American Revolution. It was created in 1776 as a proprietary colony. Delaware is the 8th state in the United States and has a population of approximately 25 million.", "prediction 2": "The 8th state of the United States is Delaware. It was created in 1776 from the Province of North Carolina, a British colony that existed in North America from 1712 to 1776, created as a proprietary colony. The power of the British government was vested in a Governor of North-Carolina, but the colony declared independence from Great Britain in 1776.", "prediction 3": "The 8th state in the United States is Delaware. The state of Delaware is located in the Mid-Atlantic or Northeastern region. It took its name from Thomas West, 3rd Baron De La Warr, an English nobleman and Virginia's first colonial governor. Delaware is the second smallest and sixth least populous state, but the sixth most densely populated. Delaware was one of the 13 colonies participating in the American Revolution.", "prediction 4": "The 8th state of the United States is New York. The state of New Jersey is the 8th state of the United States, and the 8th state of New Jersey.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[13]}", "start": 0, "end": 47 }, { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 305 }, { "error type": "Redundant", "explanation": "The 8th state of the United States is Delaware. ", "start": 306, "end": 402 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What was executive order 9066 and what did it do?", "passages": [ [ "Executive Order 9066", "Executive Order 9066\n\nExecutive Order 9066 was a United States presidential executive order signed and issued during World War II by United States President Franklin D. Roosevelt on February 19, 1942.", "This order authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps.", "The text of Executive Order 9066 was as follows:\n\nOn March 21, 1942, Roosevelt signed Public Law 503 (approved after only an hour of discussion in the Senate and thirty minutes in the House) in order to provide for the enforcement of his executive order.", "Authored by War Department official Karl Bendetsen\u2014who would later be promoted to Director of the Wartime Civilian Control Administration and oversee the incarceration of Japanese Americans\u2014the law made violations of military orders a misdemeanor punishable by up to $5,000 in fines and one year in prison.", "As a result, approximately 122,000 men, women, and children of Japanese ancestry were evicted from the West Coast of the United States and held in American concentration camps and other confinement sites across the country.", "Japanese Americans in Hawaii were not incarcerated in the same way, despite the attack on Pearl Harbor." ] ], "gold": "Executive Order 9066 was a United States presidential executive order signed by United States president Franklin D. Roosevelt on February 19, 1942. The order authorized the secretary of war to prescribe certain areas as military zones, allowing for the incarceration of Japanese Americans during the war. ", "prediction 1": "Executive Order 9066 was a United States presidential executive order signed and issued during World War II by United States President Franklin D. Roosevelt on February 19, 1942. This order authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps. As a result, approximately 122,000 men, women, and children of Japanese ancestry were evicted from the West Coast of the United States and held in American concentration camps and other confinement sites across the country.", "prediction 2": "Executive Order 9066 was signed and issued by President Franklin D. Roosevelt on February 19, 1942 and authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps. This order also made violations of military orders a misdemeanor punishable by up to $5,000 in fines and one year in prison.", "prediction 3": "Executive Order 9066 was signed and issued during World War II by United States President Franklin D. Roosevelt on February 19, 1942. This order authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps. The text of Executive Order 9066 was as follows: On March 21, 1942, Roosevelt signed Public Law 503 (approved after only an hour of discussion in the Senate and thirty minutes in the House) to provide for the enforcement of his executive order.", "prediction 4": "Executive Order 9066 was a United States presidential executive order signed and issued during World War II by United States President Franklin D. Roosevelt on February 19, 1942. This order authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 399, "end": 622 } ], "missing-info": [], "corrected-prediction": "Executive Order 9066 was a United States presidential executive order signed and issued during World War II by United States President Franklin D. Roosevelt on February 19, 1942. This order authorized the Secretary of War to prescribe certain areas as military zones, clearing the way for the incarceration of Japanese Americans, German Americans, and Italian Americans in U.S. concentration camps. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who migrated to kansas during the kansas exodus?", "passages": [ [ "Exodusters", "Exodusters\n\nExodusters was a name given to African Americans who migrated from states along the Mississippi River to Kansas in the late nineteenth century, as part of the Exoduster Movement or Exodus of 1879.", "It was the first general migration of black people following the Civil War.", "The movement received substantial organizational support from prominent figures, Benjamin Singleton of Tennessee and Henry Adams of Louisiana.", "As many as forty thousand Exodusters left the South to settle in Kansas, Oklahoma and Colorado.", "The number one cause of black migration out of the South at this time was to escape racial violence or \"bulldozing\" by white supremacist groups such as the Ku Klux Klan and the White League, as well as widespread repression under the Black Codes, discriminatory laws that rendered blacks second-class citizens after Reconstruction.", "Vigilantes operated with almost total impunity, and no other issue was of more importance to the majority of southern blacks living in the countryside.", "Given the extreme level of discrimination and violent intimidation blacks faced in the rural South, the Exodusters can more accurately be described as refugees.", "Although blacks greatly outnumbered whites in Louisiana, black armed resistance was practically inconceivable." ] ], "gold": "African Americans, from states along the Mississippi River migrated to Kansas \u00a0in the late nineteenth century. They were called Exodusters and are part of the Exoduster Movement or Exodus of 1879. Causes were to escape racial violence or \"bulldozing\" by white supremacist groups such as the\u00a0Ku Klux Klan\u00a0and the\u00a0White League, as well as widespread repression under the\u00a0Black Codes, discriminatory laws that rendered blacks\u00a0second-class citizens\u00a0after\u00a0Reconstruction\u00a0ended. ", "prediction 1": "As many as forty thousand Exodusters left the South to settle in Kansas, Oklahoma and Colorado. The number one cause of black migration out of the South at this time was to escape racial violence or \"bulldozing\" by white supremacist groups such as the Ku Klux Klan and the White League, as well as widespread repression under the Black Codes, discriminatory laws that rendered blacks second-class citizens after Reconstruction. Given the extreme level of discrimination and violent intimidation blacks faced in the rural South, the Exodusters can more accurately be described as refugees.", "prediction 2": "The Exodusters was a name given to African Americans who migrated from states along the Mississippi River to Kansas in the late nineteenth century, as part of the Exodus of 1879. It was the first general migration of black people following the Civil War. As many as forty thousand Exodusters left the South to settle in Kansas, Oklahoma and Colorado.", "prediction 3": "Exodusters was a name given to African Americans who migrated from states along the Mississippi River to Kansas in the late nineteenth century, as part of the Exoduster Movement or Exodus of 1879. It was the first general migration of black people following the Civil War. As many as forty thousand Exodusters left the South to settle in Kansas, Oklahoma and Colorado. The number one cause of black migration out of the South at this time was to escape racial violence or \"bulldozing\" by white supremacist groups such as the Ku Klux Klan and the White League. The number one cause of black migration out of the South at this time was to escape racial violence or \"bulldozing\" by white supremacist groups such as the Ku Klux Klan and the White League, as well as widespread repression under the Black Codes, discriminatory laws that rendered blacks", "prediction 4": "Exodusters was a name given to African Americans who migrated from states along the Mississippi River to Kansas in the late nineteenth century, as part of the Exodus of 1879. It was the first general migration of black people following the Civil War. As many as 40 thousand Exodusters left the South to settle in Kansas, Oklahoma and Colorado.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 588 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "African Americans, from states along the Mississippi River migrated to Kansas in the late nineteenth century. They were called Exodusters and are part of the Exoduster Movement or Exodus of 1879. The number one cause of black migration out of the South at this time was to escape racial violence or \"bulldozing\" by white supremacist groups such as the Ku Klux Klan and the White League, as well as widespread repression under the Black Codes, discriminatory laws that rendered blacks second-class citizens after Reconstruction. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who won the ncaa men's championship game?", "passages": [ [ "NCAA Division I Men's Basketball Tournament", "NCAA Division I Men's Basketball Tournament\n\nThe NCAA Division I Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship.", "The tournament was created in 1939 by the National Association of Basketball Coaches, and was the idea of The Ohio State University coach Harold Olsen.", "Played mostly during March, it has become one of the most famous annual sporting events in the United States.", "The tournament teams include champions from 32 Division I conferences (which receive automatic bids), and 36 teams which are awarded at-large berths.", "These \"at-large\" teams are chosen by an NCAA selection committee, then announced in a nationally televised event on the Sunday preceding the \"First Four\" play-in games, currently held in Dayton, Ohio, and dubbed \"Selection Sunday\".", "The 68 teams are divided into four regions and organized into a single-elimination \"bracket\", which pre-determines, when a team wins a game, which team it will face next.", "Each team is \"seeded\", or ranked, within its region from 1 to 16.", "After the First Four, the tournament occurs during the course of three weekends, at pre-selected neutral sites across the United States." ], [ "2015 NCAA Division I Men's Basketball Championship Game", "Duke hit two foul shots and Wisconsin did not score again for a 68\u201363 final margin.", "The win gave Duke coach Mike Krzyzewski his fifth title, putting him in second place all-time for Division I Men's Basketball Titles.", "The 2015 NCAA Men's Division I Basketball Championship Game was played on April 6, 2015, at Lucas Oil Stadium in Indianapolis, Indiana.", "It featured the 2015 South regional champions, the first-seeded Duke Blue Devils, and the 2015 West regional champions, the first-seeded Wisconsin Badgers.", "This marked the first time since 2008 that the national title game was played between two #1 seeded teams.", "That year, Kansas defeated Memphis 75\u201368 in overtime.", "(Memphis' participation in the tournament was later officially vacated.)", "Duke head coach Mike Krzyzewski made his ninth title game appearance and was seeking his fifth Division I Championship.", "Wisconsin head coach Bo Ryan made his first Division I Championship Game appearance.", "He previously won four Division III titles with UW\u2013Platteville.", "The game was the first Championship Game appearance for the Badgers since they won the 1941 Championship in Kansas City.", "The Blue Devils last made the Finals in 2010, which they won in Indianapolis.", "Early in the 2014\u201315 season, Duke played Wisconsin in the 2014 ACC\u2013Big Ten Challenge." ], [ "2018 NCAA Division I Men's Basketball Championship Game", "2018 NCAA Division I Men's Basketball Championship Game\n\nThe 2018 NCAA Division I Men's Basketball Championship Game was the final game of the single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2017\u201318 season.", "The game was played on April 2, 2018, at the Alamodome in San Antonio, Texas, between the Michigan Wolverines and the Villanova Wildcats.", "Michigan last won the NCAA championship in 1989, while Villanova won the championship in 2016.", "Villanova defeated Michigan, 79\u201362.", "Donte DiVincenzo, a reserve player, scored 31 points for Villanova, and was named the NCAA Basketball Tournament Most Outstanding Player.", "The Michigan Wolverines last won the NCAA Tournament in 1989.", "Their most recent appearance in the championship game was in 2013.", "At one point unranked in the AP Poll, Michigan won their final 14 games before the title game to end the 2017\u201318 regular season with a 28\u20137 win-loss record after winning the 2018 Big Ten Conference Men's Basketball Tournament.", "They earned the No. 3 seed in the West Regional.", "Michigan defeated the No. 14 Montana Grizzlies in the first round by a score of 61\u201347.", "They then reached the Sweet 16 by defeating the No." ] ], "gold": "The National Collegiate Athletic Association (NCAA) Division I Men's Basketball Tournament is a single-elimination tournament for men's college basketball teams in the United States. The 2014-2015 Men's Championship game was won by Duke. The 2015-2016 Men's Championship game was won by Villanova. The 2016-2017 Men's Championship game was won by North Carolina.", "prediction 1": "The NCAA Men's Basketball Championship, also known as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship. The 2015 NCAA Men's Division I Basketball Championship Game was played on April 6, 2015, at Lucas Oil Stadium in Indianapolis, Indiana. It featured the 2015 South regional champions, the first-seeded Duke Blue Devils, and the 2015 West regional champions, the first-seeded Wisconsin Badgers. The game was played on April 2, 2018, at the Alamodome in San Antonio, Texas, between the Michigan Wolverines, 79\u201362.", "prediction 2": "The NCAA Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association, to determine the national championship. The 2015 NCAA Division I Men's Basketball Championship Game was played on April 6, 2015, at Lucas Oil Stadium in Indianapolis, Indiana. It featured the 2015 South regional champions, the Duke Blue Devils, and the 2015 West regional champions, the first-seeded Wisconsin Badgers. The game was played on April 2, 2018, at the Alamodome in San Antonio, Texas, between the Michigan Wolverines and the Villanova Wildcats.", "prediction 3": "The NCAA Men's Basketball Tournament is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association (NCAA), to determine the national championship. The 2015 NCAA Division I Men's Basketball Championship Game was played on April 6, 2015, at Lucas Oil Stadium in Indianapolis, Indiana. The 2018 NCAA Division I Men's Basketball Championship Game was played on April 2, 2018, at the Alamodome in San Antonio, Texas, between the Michigan Wolverines and the Villanova Wildcats. The 2016 NCAA Division I Men's Division I National Collegiate Athletic Association (NCAA) Men's College Basketball Championship was won the championship by 79\u201362.", "prediction 4": "The NCAA Men's Basketball Tournament, also known and branded as NCAA March Madness, is a single-elimination tournament played each spring in the United States, currently featuring 68 college basketball teams from the Division I level of the National Collegiate Athletic Association, to determine the national championship. The 2015 NCAA Men's Division I Basketball Championship Game was played on April 6, 2015, at Lucas Oil Stadium in Indianapolis, Indiana, featuring the first-seeded Duke Blue Devils, and the 2015 West regional champions, the first-seeded Wisconsin Badgers, and the second place all-time for Division I Men's Basketball Titles. The 2018 NCAA Men's Division I Men's NCAA Men's Basketball Championship Game was played between the Michigan Wolverines and the Villanova Wildcats, 79\u201362.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 319 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 455 }, { "error type": "Irrelevant", "explanation": "", "start": 456, "end": 611 }, { "error type": "Irrelevant", "explanation": "", "start": 612, "end": 729 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The NCAA Men's Basketball Championship, also known as NCAA March Madness, is a single-elimination tournament played each spring in the United States. The 2014-2015 Men's Championship game was won by Duke. The 2015-2016 Men's Championship game was won by Villanova. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who played diana in the movie lights out?", "passages": [ [ "Lights Out (2016 film)", "Lights Out (2016 film)\n\nLights Out is a 2016 American supernatural horror film directed by David F. Sandberg in his directorial debut, produced by Lawrence Grey, James Wan, and Eric Heisserer and written by Heisserer.", "It stars Teresa Palmer, Gabriel Bateman, Billy Burke, and Maria Bello.", "It is based on Sandberg's 2013 short film of the same name and features Lotta Losten, who starred in the short.", "The film had its world premiere at the Los Angeles Film Festival on June 8, 2016, and was released in the United States and Canada on July 22, 2016, by Warner Bros.", "The film received positive reviews and was a box office success, grossing $148 million against a budget of $4.9 million.", "In a textile factory, an employee named Esther encounters a silhouette of a woman when the lights are off, but cannot see it when the lights are on.", "She warns her boss Paul.", "After she leaves, Paul encounters the woman and is killed after she chases him through the factory.", "A short time later, a young woman named Rebecca is called into the school nurse\u2019s office because of her brother, Martin.", "Rebecca and Martin are half-siblings, sharing the same mom: Sophie.", "The nurse was unable to get in touch with Sophie to inform her that Martin has been falling asleep in class lately." ], [ "Diana Walter", "Diana Walter\n\nDiana Walter is a fictional character featured in the 2016 film \"Lights Out\", portrayed by Alicia Vela-Bailey and serving as the antagonist of the film.", "She is a vengeful ghost-like entity that attacks people in the dark.", "Diana is a mysterious figure that attacks people only in the dark.", "It is revealed she was a young teenager committed to a mental hospital, who also suffered from xeroderma pigmentosum, a serious skin condition that prevented her from being exposed to any light.", "She befriends teenaged Sophie, who was hospitalized for treatment for her depression.", "They take a picture together outside where she is covered in shadow by an umbrella.", "Doctors began performing experiments on Diana, but inadvertently killed her by exposing her to intense surgical-suite spotlights, instantly reducing her body to ashes.", "Diana then turns into a demonic, malevolent creature that can act only in the darkness.", "The creature latches onto Sophie, and kills anyone who tries to help or be with her.", "She interferes with Sophie's intentions of trying to get better, and frightens Sophie's young daughter Rebecca by taking her drawing of her family and inserting herself into it as a stick figure while rubbing out her father.", "Rebecca\u2019s father flees the family, and Rebecca moves out as soon as she is old enough." ] ], "gold": "Lights Out is a 2016 American supernatural horror film that includes a malevolent spirit\u00a0 named Diana. She is played as an adult by Alicia Vela-Bailey and as a child by Ava Cantrell.", "prediction 1": "Lights Out is a 2016 American supernatural horror film directed by David F. Sandberg in his directorial debut, produced by Lawrence Grey, James Wan, and Eric Heisserer, and written by Heisserer. It stars Teresa Palmer, Gabriel Bateman, Billy Burke, and Maria Bello. Diana Walter is a fictional character featured in the 2016 film Lights Out, portrayed by Alicia Vela-Bailey and serving as the antagonist of the film. Diana is a vengeful ghost-like entity that attacks people in the dark. She is a mysterious figure that attacks people only in the dark. She is an evil entity that attacks people only in the dark. She is a demonic, malevolent entity that attacks people only in the dark.", "prediction 2": "Lights Out is a 2016 American supernatural horror film directed by David F. Sandberg in his directorial debut, produced by Lawrence Grey, James Wan, Eric Heisserer, and written by Heisserer. The film stars Teresa Palmer, Gabriel Bateman, Billy Burke, and Maria Bello. The recurring character of Diana Walter is played by Alicia Vela-Bailey.", "prediction 3": "Lights Out is a 2016 American supernatural horror film directed by David F. Sandberg in his directorial debut and produced by Lawrence Grey, James Wan, and Eric Heisserer. It stars Teresa Palmer, Gabriel Bateman, Billy Burke, and Maria Bello. Diana Walter is a fictional character featured in the 2016 film Lights Out, portrayed by Alicia Vela-Bailey and serving as the antagonist of the film. She is a vengeful ghost-like entity that attacks people only in the dark.", "prediction 4": "Lights Out is a 2016 American supernatural horror film directed by David F. Sandberg in his directorial debut. It stars Teresa Palmer, Gabriel Bateman, Billy Burke, and Maria Bello. The film is based on Sandberg's 2013 short film of the same name and features Lotta Losten, who starred in the short. In the film, Diana Walter, a teenage girl who is in a mental hospital, is played by Alicia Vela-Bailey, who is a recurring character.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 374, "end": 416 }, { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 552 }, { "error type": "Irrelevant", "explanation": "", "start": 553, "end": 686 } ], "missing-info": [], "corrected-prediction": "Lights Out is a 2016 American supernatural horror film. Diana Walter is a fictional character featured in the 2016 film Lights Out, portrayed by Alicia Vela-Bailey " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won the afc championship game this year?", "passages": [ [ "AFC Championship Game", "Since the pre-merger NFL consisted of six more teams than the AFL, a realignment was required as part of the merger to create two conferences with an equal number of teams: The NFL's Baltimore Colts, the Cleveland Browns, and the Pittsburgh Steelers joined the ten former AFL teams to form the AFC; while the remaining 13 pre-merger NFL clubs formed the NFC.", "Every AFC team except the Houston Texans has played in an AFC Championship Game at least once.", "The Seattle Seahawks, who have been members in both the AFC and the NFC, hold the distinction of appearing in both conference title games, a loss in the AFC conference title game to the Los Angeles Raiders for Super Bowl XVIII and, in their first appearance in a NFC conference title game, a win over the Carolina Panthers for Super Bowl XL.", "The Pittsburgh Steelers have the most appearances in the AFC Championship Game at 16, with 11 of those games being in Pittsburgh, the most for either conference.", "The most AFC Conference Championships have been won by the New England Patriots winning 10 of them and going to 7 straight (2011\u2013present).", "At the end of each regular season, a series of playoff games involving the top six teams in the AFC are conducted." ], [ "AFC Championship Game", "AFC Championship Game\n\nThe AFC Championship Game is one of the two semi-final playoff games of the National Football League (NFL), the largest professional American football league in the United States.", "The game is played on the penultimate Sunday in January and determines the champion of the American Football Conference (AFC).", "The winner then advances to face the winner of the National Football Conference (NFC) Championship Game in the Super Bowl.", "The game was established as part of the 1970 merger between the NFL and the American Football League (AFL), with the merged league realigning into two conferences.", "Since 1984, each winner of the AFC Championship Game has also received the Lamar Hunt Trophy, named after the founder of the AFL and longtime owner of the Kansas City Chiefs, Lamar Hunt.", "The first AFC Championship Game was played following the 1970 regular season after the merger between the NFL and the American Football League.", "The game is considered the successor to the former AFL Championship, and its game results are listed with that of its predecessor in the annual \"NFL Record and Fact Book\"." ], [ "Bill Belichick", "They reached the AFC Championship, where they lost to the eventual Super Bowl 50 champion Denver Broncos by a score of 20\u201318.", "In the 2016 season, Belichick's Patriots recorded a 14-2 record, which was good for the #1 seed for the AFC playoffs.", "They reached Super Bowl LI, where they defeated the Atlanta Falcons in a comeback victory by a score of 34\u201328 in overtime.", "The Patriots were down 28\u20133 at one point in the third quarter.", "With the victory, Belichick won his record fifth Super Bowl title as a head coach.", "In the 2017 season, Belichick's Patriots went 13-3, setting an NFL record 8th consecutive 12-or-more win seasons, capturing their 9th consecutive AFC East title and their 15th of the last 17 seasons.", "They defeated the Tennessee Titans in the Divisional Round 35\u201314, and the Jacksonville Jaguars in the AFC Championship Game 24-20, claiming their second AFC title in two years, while also extending their record of consecutive AFC Championship appearances with seven.", "Super Bowl LII was Belichick's eighth title game as head coach and his eleventh overall in any capacity, which was also the Patriot's tenth appearance, all extending NFL records." ] ], "gold": "The AFC Championship Game is the annual championship game of the American Football Conference (AFC) and one of the two semi-final playoff games of the National Football League (NFL). The game was established as part of the\u00a01970 merger\u00a0between the NFL and the\u00a0American Football League\u00a0(AFL), with the merged league realigning into two\u00a0conferences.\u00a0 The 2016 and 2017 winner was the New England Patriots. The 2015 winner was the Denver Broncos. ", "prediction 1": "The AFC Championship Game is one of the two semi-final playoff games of the National Football League (NFL), the largest professional American football league in the United States. The 2017 winner was the New England Patriots, who defeated the Atlanta Falcons in the AFC Championship Game 24-20. The 2016 winner was the New England Patriots, who defeated the Atlanta Falcons in the AFC Championship Game 14-2.", "prediction 2": "The AFC Championship Game is one of the two semi-final playoff games of the National Football League (NFL), the largest professional American football league in the United States. Every AFC team except the Houston Texans has played in an AFC Championship Game at least once. During the 2017 season, the New England Patriots claimed the AFC Championship after defeating the Atlanta Falcons 24-20 in the AFC Championship Game.", "prediction 3": "The AFC Championship Game, one of the two semi-final playoff games of the National Football League, is played on the penultimate Sunday in January and determines the champion of the American Football Conference (AFC). The winner then advances to face the winner of the National Football Conference (NFC) Championship Game in the Super Bowl. In 2017, the New England Patriots won the AFC Championship Game 24-20 over the Atlanta Falcons, giving them their second AFC title in two years.", "prediction 4": "The AFC Championship Game is one of the two semi-final playoff games of the National Football League, the largest professional American football league in the United States. Every AFC team except the Houston Texans has played in an AFC Championship Game at least once. In 2017, the New England Patriots defeated the Atlanta Falcons in the AFC Championship Game 24-20, claiming their second AFC title in two years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 179 }, { "error type": "Unverifiable", "explanation": "", "start": 226, "end": 294 }, { "error type": "Unverifiable", "explanation": "", "start": 341, "end": 408 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The AFC Championship Game is one of the two semi-final playoff games of the National Football League (NFL). The game was established as part of the 1970 merger between the NFL and the American Football League (AFL), with the merged league realigning into two conferences. The most AFC Conference Championships have been won by the New England Patriots winning 10 of them and going to 7 straight (2011\u2013present). The 2017 winner was the New England Patriots. The 2016 winner was the New England Patriots." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who is the golem in the limehouse golem?", "passages": [ [ "The Limehouse Golem", "The Limehouse Golem\n\nThe Limehouse Golem is a 2016 British horror-mystery film directed by Juan Carlos Medina from a screenplay by Jane Goldman.", "The film, an adaptation of Peter Ackroyd's 1994 murder mystery novel \"Dan Leno and the Limehouse Golem\", stars Olivia Cooke, Bill Nighy, and Douglas Booth.", "The film had its world premiere at the Toronto International Film Festival on 10 September 2016.", "It was released in the United Kingdom on 1 September 2017, by Lionsgate.", "A series of murders has shaken the community of Limehouse in Victorian London to the point where people believe that only a legendary creature from dark times \u2013 the mythical so-called Golem \u2013 must be responsible.", "When music-hall star Elizabeth Cree is accused of poisoning her husband John on the same night as the last Golem murder, Inspector John Kildare discovers evidence linking John Cree to the Golem murders and finds himself determined to crack both cases before Elizabeth is hanged.", "Having found a diary of the Golem's crimes, written by the Golem in a book on the art of murder, kept in the reading room of the library, Kildare determines that the Golem must be one of the four men in the library on the date of the last entry; Dan Leno, Karl Marx, George Gissing and John Cree." ] ], "gold": "In the 2016 British horror-mystery film The Limehouse Golem, the titular serial killer Golem is revealed to be music-hall star Elizabeth Cree. Cree is portrayed by Olivia Cooke in adulthood and Amelia Crouch in childhood.", "prediction 1": "In the 2016 horror movie The Limehouse Golem, the mysterious spectre creature known as the Golem is Dan Leno, played by Karl Marx, who is the lead character.", "prediction 2": "The Limehouse Golem is a 2016 British horror-mystery film directed by Juan Carlos Medina from a screenplay by Jane Goldman. The film, an adaptation of Peter Ackroyd's 1994 murder mystery novel Dan Leno and the Limehouse Golem, stars Olivia Cooke, Bill Nighy, and Douglas Booth.", "prediction 3": "The Limehouse Golem is a 2016 British horror-mystery film, an adaptation of Peter Ackroyd's 1994 murder mystery novel Dan Leno and the Limehouse Golem. The film stars Olivia Cooke, Bill Nighy, and Douglas Booth.", "prediction 4": "The Limehouse Golem is a 2016 British horror mystery film directed by Juan Carlos Medina from a screenplay by Jane Goldman. In the film, an adaptation of Peter Ackroyd's 1994 murder mystery novel \"Dan Leno and the Limehouse Golem\", Olivia Cooke plays the golem. Dan Leno plays the golem.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 157 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When does minecraft season 2 episode 2 release?", "passages": [ [ "Minecraft", "The first mash-up pack (and by extension, the first texture pack) for the \"Xbox 360 Edition\" was released on 4 September 2013, and was themed after the \"Mass Effect\" franchise.", "Unlike the PC version, however, the \"Xbox 360 Edition\" does not support player-made mods or custom maps.", "A cross-promotional resource pack based on the \"Super Mario\" franchise by Nintendo was released for the \"Wii U Edition\" worldwide on 17 May 2016.", "A mash-up pack based on \"Fallout\" was announced for release on the \"Wii U Edition\".", "In June 2017, Mojang released an update known as the \"Discovery Update\".", "The update includes a new map, a new game mode, the \"Marketplace\", a catalogue of user-generated content that gives Minecraft creators \"another way to make a living from the game\", and more.", "\"Minecraft: Story Mode\", an episodic spin-off game developed by Telltale Games in collaboration with Mojang, was announced in December 2014.", "Consisting of five episodes plus three additional downloadable episodes, the standalone game is a narrative and player choice-driven, and it was released on Microsoft Windows, OS X, iOS, PlayStation 3, PlayStation 4, Xbox 360 and Xbox One via download on 13 October 2015." ], [ "Black Desert Online", "At the Taipei Games Show on January 20, 2017, Pearl Abyss stated a Xbox One and PlayStation 4 version of the game is in development.", "This was confirmed by Pearl Abyss in March.", "The Dark Knight class was published in Europe and North America in April 2017.", "The Striker class was released in Europe and North America in May 2017.", "At E3 2017, Microsoft announced that Black Desert will launch on Xbox One as a Console Launch Exclusive in early 2018.", "On August 15, 2017 Pearl Abyss has released an official teaser for Black Desert Mobile.", "On April 5, 2018, Pearl Abyss announced that it would be changing service providers on North American servers to improve stability.", "\"Black Desert Online\" has received generally favorable reviews from critics, currently holding a score of 73/100 on Metacritic and 8.6/10 on MMORPG.com.", "In April 2016, Kakao announced that the game had achieved sales of 400,000 copies in its first month on the European and North American markets, and was showing an average of 100,000 concurrent users.", "By March 2017, \"Black Desert Online\" had 3.4 million registered players in North America and Europe.", "As of September 2018, the game has over 10million registered users worldwide.", "In October 2015, Black Desert Online was published and localized in Russia by Cypriot publisher GameNet." ] ], "gold": "Minecraft: Story Mode is an episodic point-and-click graphic adventure video game developed and published by Telltale Games, based on Mojang Studios' sandbox video game Minecraft. Season 2 episode 2 released for PC, Mac, PS4, Xbox 360, Xbox One, iOS, and Windows 10 on August 15, 2017. It released for Android and Fire OS on August 17, 2017. It released for Nintendo Switch on November 6, 2018.", "prediction 1": "Season 2 episode 2 of the Minecraft television series premiered on October 2, 2016, and episode 2 of the Minecraft: Story Mode television series premiered on October 13, 2015. The series' second season premiered on October 4, 2016, and episode 2 of the Minecraft: Story Mode television series premiered on October 5, 2017.\n", "prediction 2": "Season 2 episode 2 of the video game series \"Minecraft\" released on 31 August 2017. Season 2 episode 2 of the mobile show \"Minecraft: Black Desert Online\", a spinoff of the video game series, released on 27 April 2019.", "prediction 3": "Season 2 episode 2 of the television series, Minecraft, aired on December 1, 2012 on Playstation Network, while its companion skybox version aired on March 19, 2014. The latest season of the game's spin-off, Minecraft: Story Mode, aired on October 13, 2015 on Xbox One and February 14, 2019, and season 2 episode 2 released on February 19, 2019.", "prediction 4": "Season 2 episode 2 of the Minecraft television series premiered in Russian on August 11, 2017. It was released in the United States on August 31, 2017. An episode of the Minecraft TV series premiered in London on October 29, 2017. A new episode of the Minecraft TV series premiered in Russia on October 31, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 175 }, { "error type": "Redundant", "explanation": "Season 2 episode 2 of the Minecraft television series premiered on October 2, 2016, and episode 2 of the Minecraft: Story Mode television series premiered on October 13, 2015. ", "start": 176, "end": 323 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Minecraft: Story Mode\", an episodic spin-off game developed by Telltale Games in collaboration with Mojang.\n" }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "Biuret test is used to test the presence of?", "passages": [ [ "Biuret test", "The reagent is commonly used in the biuret protein assay, a colorimetric test used to determine protein concentration by UV/VIS spectroscopy at wavelength 540\u00a0nm.", "Two major modifications of the biuret test are commonly applied in modern colorimetric analysis of peptides: the bicinchoninic acid (BCA) assay and the Lowry assay.", "In these tests, the Cu formed during the biuret reaction reacts further with other reagents, leading to a deeper color.", "In the BCA test, Cu forms a deep purple complex with bicinchoninic acid (BCA), which absorbs around 562\u00a0nm, producing the signature mauve color.", "The water-soluble BCA/copper complex absorbs much more strongly than the peptide/copper complex, increasing the sensitivity of the biuret test by a factor of around 100: the BCA assay allows to detect proteins in the range of 0.0005 to 2\u00a0mg/mL).", "Additionally, the BCA protein assay gives the important benefit of compatibility with substances such as up to 5% surfactants in protein samples.", "In the Lowry protein assay Cu is oxidized back to Cu by Mo in Folin-Ciocalteu's reagent, which forms molybdenum blue (Mo)." ], [ "Biuret test", "Biuret test\n\nThe biuret test (Piotrowski's test) is a chemical test used for detecting the presence of peptide bonds.", "In the presence of peptides, a copper(II) ion forms mauve-colored coordination complexes in an alkaline solution.", "Several variants on the test have been developed, such as the BCA test and the Modified Lowry test.", "The biuret reaction can be used to assess the concentration of proteins because peptide bonds occur with the same frequency per amino acid in the peptide.", "The intensity of the color, and hence the absorption at 540\u00a0nm, is directly proportional to the protein concentration, according to the Beer\u2013Lambert law.", "Despite its name, the reagent does not in fact contain biuret ((HN-CO-)NH).", "The test is named so because it also gives a positive reaction to the peptide-like bonds in the biuret molecule.", "In this assay, the copper(II) binds with nitrogens present in the peptides of proteins.", "In a secondary reaction, the copper(II) is reduced to copper(I).", "Buffers, such as Tris and ammonia interfere with this assay, therefore rendering this assay inappropriate for protein samples purified from ammonium sulfate precipitation." ] ], "gold": "The biuret test is also known as Piotrowski's test. It's a chemical test used for detecting the presence of peptide bonds. The biuret test can also be used to assess the concentration of protein compounds because peptide bonds occur with the same frequency per amino acid in the peptide.", "prediction 1": "The biuret test is a chemical test used for detecting the presence of peptide bonds. In the presence of peptides, a copper(II) ion forms mauve-colored coordination complexes in an alkaline solution. The intensity of the color, and hence the absorption at 540 nm, is directly proportional to the protein concentration, according to the Beer\u2013Lambert law.\n", "prediction 2": "The biuret protein assay is a colorimetric test used to determine protein concentration by UV/VIS spectroscopy at wavelength 540 nm. In the presence of peptides, a copper(II) ion forms mauve-colored coordination complexes in an alkaline solution. In reaction, the copper(II) binds with nitrogens present in the peptides of proteins.", "prediction 3": "The biuret test is a chemical test used for detecting the presence of peptide bonds. In the presence of peptides, a copper(II) ion forms mauve-colored coordination complexes in an alkaline solution. Two major modifications of the biuret test are commonly applied in modern colorimetric analysis of peptides: the bicinchoninic acid (BCA) assay and the Lowry assay. In the BCA protein assay, Cu forms a deep purple complex with bicinchoninic acid (BCA), producing the signature mauve color.", "prediction 4": "The Biuret test is a chemical test used for detecting the presence of peptide bonds. In the presence of peptides, a copper(II) ion forms mauve-colored coordination complexes in an alkaline solution. This reaction is also used to check the presence of cholesterol in a protein drug.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 353 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The biuret test, also known as Piotrowski's test, is a chemical test used for detecting the presence of peptide bonds. The biuret reaction can also be used to assess the concentration of proteins because peptide bonds occur with the same frequency per amino acid in the peptide." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who did boston beat in the 2004 world series?", "passages": [ [ "1986 World Series", "The Red Sox were the third professional sports team based in the Greater Boston area to compete for a championship in 1986.", "The NFL's New England Patriots lost to the Chicago Bears in Super Bowl XX and the Boston Celtics won the 1986 NBA Finals over the Houston Rockets.", "This was the last Red Sox loss in a World Series game until Game 2 of the 2013 World Series, when the Red Sox lost 4-2 to the St. Louis Cardinals after 9 consecutive wins in World Series play.", "Their intervening World Series appearances included their sweep against the St. Louis Cardinals, ending the Curse of the Bambino, their sweep against the Colorado Rockies, and their victory over the Cardinals in six games.", "The 2013 series marked the first time that the Red Sox won the clinching game at Fenway Park since 1918.\n\n, 1986 marks the most recent time the Red Sox have lost a World Series, as well as the most recent time the Mets have won a World Series.", "1986 World Series (4\u20133): New York Mets (N.L.) beat Boston Red Sox (A.L.) NBC's broadcast of Game\u00a07 (which went up against a \"Monday Night Football\" game between the Washington Redskins and New York Giants on ABC) garnered a Nielsen rating of 38.9 and a 55 share, making it the highest-rated single World Series game to date." ], [ "2004 World Series", "In the 12th, Edmonds won the game for the Cardinals with a walk-off home run.", "Trailing in the sixth inning of Game 7, a game-tying RBI double by Albert Pujols followed by a Scott Rolen two-run home run and then an RBI single by Larry Walker in the 8th inning helped the Cardinals to a 5\u20132 win and their first World Series berth in 17 years.", "By reaching the World Series with the Cardinals, Tony La Russa became the sixth manager to win pennants in both leagues.", "This was after La Russa had managed the Oakland Athletics to three straight pennants between 1988 and 1990 and winning the 1989 World Series.", "He would attempt to join Sparky Anderson as the only men to have managed teams to World Series championships in both leagues.", "He wore #10 in tribute to Anderson (who wore 10 while manager of the Cincinnati Reds) and to indicate he was trying to win the team's 10th championship.", "The series was heavily discussed and analyzed by the American media prior to it beginning.", "The \"Star-News\" of Wilmington, North Carolina, compared the Red Sox and Cardinals position by position and concluded that the Cardinals were stronger in eight positions, the Red Sox in four and both teams even in one.", "They predicted that the Cardinals would win the series in seven games." ], [ "2004 World Series", "Mart\u00ednez was the starting pitcher for the Red Sox, and in the bottom of the first inning, he allowed the Cardinals to load the bases with one out.", "Edmonds then hit a fly ball towards Ram\u00edrez in left field, who caught it on the run and threw to catcher Jason Varitek at home plate.", "Varitek tagged out Walker, who was attempting to score from third, ending the inning.", "In the bottom of the third inning, the Cardinals had two runners on base with no one out.", "Walker hit a ground ball towards first base, and Cardinals third base coach Jos\u00e9 Oquendo signalled to Suppan on third to run to home plate.", "However, halfway towards home, Suppan \"suddenly stopped\".", "\u00c9dgar Renter\u00eda, who had been running from second base towards third, was forced to return to second when he saw Suppan had stopped.", "After forcing out Walker at first base, David Ortiz began moving toward Suppan, who had turned back toward third, Ortiz threw to third baseman Mueller, who tagged Suppan out.", "After the next batter, Albert Pujols, was thrown out by Mueller, the inning ended.", "Trot Nixon extended the Red Sox lead to two in the top of the fourth, hitting a single to right field that scored Mueller, who had started the rally with a two-out double to left-center." ] ], "gold": "In the 2004 World Series, the Boston Red Sox beat the St. Louis Cardinals in four games, pitched by Juli\u00e1n Tav\u00e1rez, Matt Morris, Jeff Suppan, and Jason Marquis respectively. At the time, the Cardinals were managed by Tony La Russa. The Red Sox and Cardinals faced each other again in the 2013 World Series, which the Red Sox also won, this time four games to two.", "prediction 1": "Boston beat the St. Louis Cardinals in the 2004 World Series 5\u20132 on April 15, 2004. This was the second consecutive year that the Boston Red Sox lost the World Series. In the 1986 World Series, the Boston Red Sox lost 4-3 to the Chicago Bears. In the 2004 World Series, the Boston Red Sox lost 5\u20131 to the Arizona Diamondbacks.", "prediction 2": "Boston defeated the St. Louis Cardinals 5\u20132 in the 2004 World Series. In the 1986 World Series, Boston beat the New York Mets 4\u20133. In the 2004 World Series, Boston beat the Arizona Diamondbacks 5\u20132.", "prediction 3": "The 2004 World Series between the Boston Red Sox and the St. Louis Cardinals was played in Arlington, Virginia. The Red Sox defeated the Cardinals 5\u20132 in Game 7 of the Series. In the 1986 World Series, the Boston Red Sox lost in the first game, but they were outclassed in the second game, and in the third game, they lost in the fourth game. In the 2004 World Series, the Boston Red Sox beat the Colorado Rockies 5\u20132 in Game 6.", "prediction 4": "The Red Sox were the third professional sports team based in the Greater Boston area to compete for a championship in 1986. In the 2004 World Series, Boston defeated the St. Louis Cardinals 5\u20130 in Game 7 of the series. In the 1986 World Series, Boston defeated the Chicago Cubs 4\u20133.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 65, "end": 83 }, { "error type": "Unverifiable", "explanation": "", "start": 61, "end": 64 }, { "error type": "Unverifiable", "explanation": "", "start": 84, "end": 167 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 229, "end": 243 }, { "error type": "Unverifiable", "explanation": "", "start": 213, "end": 221 }, { "error type": "Unverifiable", "explanation": "", "start": 289, "end": 300 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 305, "end": 326 }, { "error type": "Unverifiable", "explanation": "", "start": 7, "end": 35 }, { "error type": "Redundant", "explanation": "Boston beat the St. Louis Cardinals in the 2004 World Series 5\u20132 on April 15, 2004. ", "start": 244, "end": 269 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Tony La Russa was the manager of the Cardinals in 2004, when they reached the World Series. The Red Sox and Cardinals faced off again in the 2013 World Series." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "How many cards are in a deck of phase 10?", "passages": [ [ "Phase 10", "Phase 10\n\nPhase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights from Fundex Games in 2010.", "Phase 10 is based on a variant of rummy known as Liverpool rummy, and is a member of the contract rummy family.", "It requires a special deck or two regular decks of cards; it can be played by two to six people.", "The game is named after ten phases (or melds) that a player must advance through in order to win.", "Phase 10 was Fundex's best selling product, selling over 32,600,000 units to date, making it the 2nd best-selling commercial card game behind Mattel's Uno.", "In December 2010, Fundex sold the rights to Phase 10 to Mattel, and now develops and markets a line of games based on brands and other IP formerly exclusive to Mattel as well as Fundex's own brands.", "There is a new version called \"Phase 10 Mod\" that comes in a yellow and white case or a newer case that is blue, a green and yellow stripe and bits of red on the front and back\nIf the player lays down their phase and are out of cards and a player has a phase after them, they can still lay that hand down.", "The person at the end of the game with the least points wins." ], [ "Phase 10", "2) Players working to complete any of the first seven phases can use the number card that matches the phase they are working to complete as a wild card.", "For example, ones are wild for all players during the first hand.", "During the second hand twos are wild for those players who completed phase one in the previous hand, while ones remain wild for any player not completing phase one.", "This adds the challenge of remembering the wild card of the person on your left so as to not discard cards that, for them are wild, but for you are not.", "This variation is called Postal Rules in honor of the group of postal employees who have played Phase 10 everyday during lunch since 1996.", "In 2007 Fundex and Magmic signed a deal that brought Phase 10 to BlackBerry devices.", "In 2009 Magmic released the title for iOS, with a Masters Edition in-app purchase available for download in February 2012.", "In March 2012 Magmic released both a free and paid version of Phase 10 for Android devices.", "The Google Play Store also has a scorekeeper app for Phase 10.", "In September 2013, Magmic released Phase 10 Dice in the iTunes App Store." ], [ "Contract rummy", "Contract rummy\n\nContract rummy is a Rummy card game, based on gin rummy played by 3 to 8 players.", "It is also known as Combination rummy, Deuces Wild Rummy, Joker rummy and Phase 10.", "Contract rummy is played with multiple decks of 54 standard playing cards, including the Jokers.", "Aces are high and low (above a King), and Jokers are wild cards.", "The number of decks varies from 2 to 4 and is based on the number of players (see chart).", "Each game is based on 7 rounds of hands, and the rules for each hand are unique.", "One person begins as dealer for the first hand, and then the person to the dealer's left becomes dealer for the next hand, and so on.", "Each player is dealt ten cards for the first four-round and then 12 for the last three.", "The rest of the deck is then placed face down in the middle of the players; this is referred to as the \"stock\".", "One card is taken from the top of the stock and placed face up next to it.", "This card is called the upcard and becomes the beginning of the \"discard pile\", other wise known as \"dead\", or no longer in the game.", "The first player to play is the player to the dealer's left.", "Play always progresses in this clockwise direction." ] ], "gold": "Phase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights from Fundex Games in 2010. In a deck of Phase 10, there are 96 numbered cards, with 24 numbered cards of each color. There are 8 wild cards and 4 skip cards.", "prediction 1": "Phase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights from Fundex Games in 2010. Phase 10 requires a special deck or two regular decks of cards; it can be played by two to six people. The number of decks varies from 2 to 4 and is based on the number of players. In Contract rummy, each player is dealt ten cards for the first four-round and then 12 for the last three.", "prediction 2": "There are 2 decks of Phase 10. Each player is dealt 10 cards for the first four rounds and then 12 for the last 3. Each player is dealt one card from the stock. Each deck is placed face down in the middle of the players, and the rest of the deck is then placed face down in the middle of the players. The player is dealt one card from the stock and placed face up next to it.", "prediction 3": "Phase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights from Fundex Games in 2010. The game is named after ten phases that a player must advance through in order to win. Each player is dealt ten cards for the first four-round and then 12 for the last three. The rest of the deck is then placed face down in the middle of the players; this is referred to as the \"stock\". One card is taken from the top of the stock and placed face up next to it.", "prediction 4": "Phase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights to Phase 10 from Fundex Games in 2010. A deck of Phase 10 consists of 54 standard playing cards, including the Jokers. Each player is dealt ten cards for the first four-round and then 12 for the last three. Each player is dealt 12 cards for the last three.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 235 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 313 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 420 } ], "missing-info": [], "corrected-prediction": "Phase 10 is a card game created in 1982 by Kenneth Johnson and sold by Mattel, which purchased the rights from Fundex Games in 2010. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where does chicago get its drinking water from?", "passages": [ [ "Water cribs in Chicago", "Water cribs in Chicago\n\n", "The water cribs in Chicago are structures built to house and protect offshore water intakes used to supply the City of Chicago with drinking water from Lake Michigan.", "Water is collected and transported through tunnels located close to beneath the lake, varying in shape from circular to oval, and ranging in diameter from .", "The tunnels lead from the water cribs to one of two water purification plants located onshore, the Jardine Water Purification Plant (the world's largest) and the Eugene Sawyer Water Purification Plant, where the water is then treated before being pumped to all parts of the city as well as 118 suburbs.", "The city has had nine permanent cribs of which six are still standing and two are in active use.", "The Two-Mile Crib was constructed as part of a scheme by Ellis S. Chesbrough in 1865, to help with the purification of the water because of damage caused by the city dumping sewage into the lake.", "Construction of the crib began in May 1864, miners and workers worked 24 hours a day and six days a week.", "The total completion of the project was in March 1867 and cost the city $380,784.", "Purified water was pumped to the Chicago Avenue Pumping Station which still stands to this day on North Michigan Avenue." ], [ "Chicago Sanitary and Ship Canal", "Chicago Sanitary and Ship Canal\n\nThe Chicago Sanitary and Ship Canal, historically known as the Chicago Drainage Canal, is a canal system that connects the Chicago River to the Des Plaines River.", "It reverses the direction of the Main Stem and the South Branch of the Chicago River, which now flows out of Lake Michigan rather than into it.", "The related Calumet-Saganashkee Channel does the same for the Calumet River a short distance to the south, joining the Chicago canal about half way along its route to the Des Plaines.", "The two provide the only navigation for ships between the Great Lakes Waterway and the Mississippi River system.", "The canal was primarily built as a sewage treatment scheme.", "Prior to its opening in 1900, sewage from the city of Chicago was dumped into the Chicago River and flowed into Lake Michigan.", "The city's drinking water supply was located offshore, and there were fears that the sewage could reach the intake and cause serious disease outbreaks.", "Since the sewer systems were already flowing into the river, the decision was made to dam the river and reverse its flow, thereby sending all the sewage inland where it could be treated before emptying it into the Des Plaines.", "A secondary goal was to replace the shallow and narrow Illinois and Michigan Canal (I&M), which had originally connected Lake Michigan with the Mississippi starting in 1848." ] ], "gold": "The water supply for the City of Chicago comes from Lake Michigan. Water is collected from the lake and stored in offshore water crib structures, before being transported through tunnels located beneath the lake that lead from the water cribs to pumping stations located onshore. The water then travels to water purification plants where it is treated before being pumped to all parts of the city as well as 118 suburbs.", "prediction 1": "The water cribs in Chicago are structures built to house and protect offshore water intakes used to supply the City of Chicago with drinking water from Lake Michigan. Water is collected and transported through tunnels located close to beneath the lake, varying in shape from circular to oval, and ranging in diameter from. The tunnels lead from the water cribs to one of two water purification plants located onshore, the Jardine Water Purification Plant and the Eugene Sawyer Water Purification Plant, where the water is then treated before being pumped to all parts of the city as well as well as well as 118 suburbs.", "prediction 2": "The Chicago Sanitary and Ship Canal is a canal system that connects the Chicago River to the Des Plaines River. It reverses the direction of the Main Stem and the South Branch of the Chicago River, which now flows out of Lake Michigan rather than into it. Prior to its opening in 1900, sewage from the city of Chicago was dumped into the Chicago River and flowed into Lake Michigan. The city's drinking water supply was located offshore, there were fears that the sewage could reach the intake and cause serious disease outbreaks.", "prediction 3": "The Chicago Sanitary and Ship Canal, historically known as the Chicago Drainage Canal, is a canal system that connects the Chicago River to the Des Plaines River. It reverses the direction of the Main Stem and the South Branch of the Chicago River, which now flows out of Lake Michigan rather than into it. Prior to its opening in 1900, sewage from the city of Chicago was dumped into the Chicago River and flowed into Lake Michigan. The city's drinking water supply was located offshore, and there were fears that the sewage could reach the intake and cause serious disease outbreaks.", "prediction 4": "The City of Chicago gets its drinking water from two sources. The water cribs in Chicago are structures built to house and protect offshore water intakes used to supply the City of Chicago with drinking water from Lake Michigan. Water is collected and transported through tunnels located close to beneath the lake, varying in shape from circular to oval, and ranging in diameter from. One of two water purification plants located onshore, the Jardine Water Purification Plant and the Eugene Sawyer Water Purification Plant, treat the water before it is pumped to all parts of the city as well as wells and 118 suburbs. The Chicago Drainage Canal is a canal system that connects the Chicago River to the Des Plaines River. It is a canal system that connects the Chicago River to the Des Plaines River.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 322 }, { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 502 } ], "missing-info": [], "corrected-prediction": "The water cribs in Chicago are structures built to house and protect offshore water intakes used to supply the City of Chicago with drinking water from Lake Michigan. Water is collected and transported through tunnels located close to beneath the lake. The tunnels lead from the water cribs to one of two water purification plants located onshore, where the water is then treated before being pumped to all parts of the city as well as well as well as 118 suburbs." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who played young eponine in les miserables movie?", "passages": [ [ "Adaptations of Les Mis\u00e9rables", "Adaptations of Les Mis\u00e9rables\n\nVictor Hugo's novel \"Les Mis\u00e9rables\" has been the subject of many adaptations in various media since its original publication in 1862.", "In 1980, a musical of the same name opened in Paris at the Palais des Sports.", "It has gone on to become one of the most successful musicals in history.", "It was directed by Robert Hossein, the music was composed by Claude-Michel Sch\u00f6nberg, and the libretto was written by Alain Boublil.", "An English-language version of Sch\u00f6nberg's work opened in London at the Barbican Arts Centre in 1985.", "It was produced by Cameron Mackintosh and adapted and directed by Trevor Nunn and John Caird.", "The lyrics were written by Herbert Kretzmer and additional material by James Fenton." ], [ "\u00c9ponine", "\u00c9ponine is also featured in the stage musical \"Les Mis\u00e9rables\".", "She is played by two actors, a young girl for Young \u00c9ponine in the Montfermeil scenes, and by a young woman for the adolescent \u00c9ponine in the later Parisian scenes.", "Actresses playing Young \u00c9ponine and Young Cosette sometimes interchange roles in different performances to equalize performance opportunities and vocal strain.", "The musical gives a pointedly sympathetic depiction of \u00c9ponine, which has made her one of the show's most popular characters.", "Throughout the musical, the ragged, independent, and tragic \u00c9ponine is starkly contrasted with the demure, innocent, and sheltered Cosette.", "There are some notable plot differences in the musical adaptation." ], [ "\u00c9ponine", "\u00c9ponine\n\n\u00c9ponine Th\u00e9nardier (; ), also referred to as the \"Jondrette girl\", is a fictional character in the 1862 novel \"Les Mis\u00e9rables\" by Victor Hugo.", "The character is introduced as a spoiled and pampered child, but appears later in the novel as a ragged and impoverished teenager who speaks in the argot of the Parisian streets, while retaining vestiges of her former charm and innocence.", "\u00c9ponine is born in 1815, the oldest child of the Th\u00e9nardiers.", "As children, \u00c9ponine and her younger sister Azelma are described as pretty, well-dressed, and charming.", "They are pampered and spoiled by their parents, the Th\u00e9nardiers, who run an inn in Montfermeil, France.", "In 1818, when Fantine and her illegitimate daughter Cosette come across the inn, Fantine sees \u00c9ponine and Azelma playing outside.", "Cosette joins the two sisters and the three play together.", "Fantine asks the Th\u00e9nardiers to take care of Cosette while she goes to look for work in her home town.", "The Th\u00e9nardiers abuse Cosette, dress her in rags and force her to work, while spoiling their daughters and letting them play." ] ], "gold": "Victor Hugo's novel Les Mis\u00e9rables has been the subject of many adaptations in various media since its original publication in 1862, with the character Eponine appearing in many of the movies based on the book. She is introduced as a spoiled and pampered child but appears later as a ragged and impoverished teenager who speaks in the argot of the Parisian streets while retaining vestiges of her former charm and innocence. In the 2012 adaptation directed by Tom Hooper, Natalya Wallace plays young Eponine, while Samantha Barks portrays the character in her teens. In the 1998 version starring Liam Neeson, Geoffrey Rush, Uma Thurman, and Claire Danes, the character is played by Sylvie Koblizkova, while Agathe Ladner and Candice Patou play the child and teen versions of the character in the 1982 French drama film directed by Robert Hossein.", "prediction 1": "In the 1862 novel Les Mis\u00e9rables, the character \u00c9ponine is played by two different young girls in two different movies. In the Montfermeil scenes, a young girl plays Young \u00c9ponine, and in the later Parisian scenes, a young woman plays Young \u00c9ponine, which is played by two different actors. In the 1985 British adaptation of the musical, Young \u00c9ponine is played by a young girl and in the 1989 film, a young woman plays Young \u00c9ponine.", "prediction 2": "Victor Hugo's novel Les Mis\u00e9rables has been the subject of many adaptations in various media since its original publication in 1862. In 1980, a musical of the same name opened in Paris at the Palais des Sports. It has gone on to become one of the most successful musicals in history. Actresses playing Young \u00c9ponine and Young Cosette sometimes interchange roles in different performances to equalize performance opportunities and vocal strain. In the 1983 film adaptation, a young girl plays Young \u00c9ponine, while a young woman plays Young \u00c9ponine.", "prediction 3": "Victor Hugo's 1862 novel Les Mis\u00e9rables has been the subject of many adaptations in various media since its original publication in 1862. In 1980, a musical of the same name opened in Paris at the Palais des Sports. It has gone on to become one of the most successful musicals in history. Actresses playing Young \u00c9ponine and Young Cosette sometimes interchange roles in different performances to equalize performance opportunities and vocal strain.", "prediction 4": "Victor Hugo's 1862 novel Les Mis\u00e9rables has been the subject of many adaptations in various media since its original publication in 1862. In 1980, a musical of the same name opened in Paris at the Palais des Sports. It has gone on to become one of the most successful musicals in history. In the English-language version of the musical, Young \u00c9ponine is played by a young girl in the Montfermeil scenes, and a young woman in the later Parisian scenes. Actresse playing Young \u00c9ponine in the later Parisian scenes, often interchange roles in different performances to equalize performance opportunities and vocal strain.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 291, "end": 434 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 }, { "error type": "Incoherent", "explanation": "", "start": 120, "end": 290 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Victor Hugo's novel Les Mis\u00e9rables has been the subject of many adaptations in various media since its original publication in 1862. The character Eponine is introduced as a spoiled and pampered child, but appears later in the novel as a ragged and impoverished teenager who speaks in the argot of the Parisian streets, while retaining vestiges of her former charm and innocence. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When does the us open air on tv?", "passages": [ [ "2015 U.S. Open (golf)", "2015 U.S. Open (golf)\n\nThe 2015 United States Open Championship was the 115th U.S. Open, played June 18\u201321, 2015 at Chambers Bay in University Place, Washington, southwest of Tacoma on the shore of Puget Sound.", "Jordan Spieth won his first U.S. Open and consecutive major titles, one stroke ahead of runners-up Dustin Johnson and Louis Oosthuizen.", "This was the first U.S. Open televised by Fox Sports 1 and Fox Sports, launching a 12-year contract with the United States Golf Association.", "Spieth, age 21, became the youngest U.S. Open champion in 92 years, since Bobby Jones in 1923.", "The reigning Masters champion, Spieth became the youngest to win the Masters and U.S. Open in the same year, passing Tiger Woods, who won both in 2002 at age 26.", "Others to win the first two majors of the year were Craig Wood (1941), Ben Hogan (1951, 1953), Arnold Palmer (1960), and Jack Nicklaus (1972).", "This was the first U.S. Open played in the Pacific Northwest and the third major played in the state of Washington, which hosted the PGA Championship in 1944 and 1998.", "Owned by Pierce County, the Chambers Bay course opened for play only eight years earlier in June 2007." ], [ "2016 U.S. Open (golf)", "2016 U.S. Open (golf)\n\nThe 2016 United States Open Championship was the 116th U.S. Open, held June 16\u201319 at Oakmont Country Club in Oakmont and Plum, Pennsylvania, suburbs northeast of Pittsburgh.", "Dustin Johnson won his first major championship.", "Play was delayed on the first day due to heavy rainfall, forcing most of the field to play half a round behind schedule.", "Andrew Landry was a surprise leader after the first round before Johnson led the field in the second.", "Shane Lowry carded a 65 in the third round to take the overall lead into the final round.", "Despite a controversial penalty on the 5th green, Johnson took the title three strokes ahead of runners-up Lowry, Jim Furyk and Scott Piercy.", "This was the ninth U.S. Open at Oakmont and its twelfth major championship.", "Lengths of the course for previous major championships:\n\n\n\nFor the second year, Fox Sports televised the championship in the United States.", "The first two rounds were on FS1 cable and over-the-air on Fox, with the last two rounds shown only on Fox.", "In the United Kingdom and Ireland, it was carried by Sky Sports.", "About half the field consisted of players who were exempt from qualifying for the U.S. Open." ], [ "2017 U.S. Open (golf)", "2017 U.S. Open (golf)\n\nThe 2017 U.S. Open Championship was the 117th U.S. Open, held June 15\u201318 at Erin Hills in Erin, Wisconsin, northwest of Milwaukee.", "Brooks Koepka claimed his first major title with a 16-under-par 272, four strokes ahead of runners-up Brian Harman and Hideki Matsuyama.", "Koepka's score matched the lowest ever at the championship, set in 2011 by Rory McIlroy.", "This was the first U.S. Open in Wisconsin, but marked its fifth major, following four editions of the PGA Championship.", "It was played in 1933 at Blue Mound in Wauwatosa, and at Whistling Straits near Kohler in 2004, 2010, and 2015.", "The purse was a record for a major at $12 million, and the winner's share exceeded $2 million for the first time, at $2.16 million.", "This was the first U.S. Open at Erin Hills, which opened in 2006 and hosted the U.S. Amateur in 2011.", "It was also the first U.S. Open since 1992 at par 72." ] ], "gold": "The term US Open can be applied to several sports or games, including tennis and golf. The 2015 tennis US Open aired on tv from August 31 \u2013 September 13, the 2016 tennis US Open aired on tv from August 29 \u2013 September 11, while the 2017 tennis US Open was from August 28 \u2013 September 10. The 2015 golf US Open played June 18\u201321, 2015, the 2016 golf US Open held June 16\u201319, while the 2017 golf US Open held June 15\u201318.", "prediction 1": "The US Open is televised in the United States on Fox Sports 1, Fox Sports 1, and Fox Sports 2 and is broadcast in the United States on Sundays at 8:00 am ET. The US Open is televised in the United Kingdom and Ireland at 10:00 am ET, and it is carried by Sky Sports in Ireland at 1:30 pm ET. The 2015 US Open Championship was the 115th US Open, played June 18\u201321, 2015 at Chambers Bay in University Place, Washington, southwest of Tacoma on the shore of Puget Sound. Dustin Johnson won his first major championship. The 2016 U.S. Open Championship was the 116th US Open, held June 16\u201319 at Oakmont Country Club in Oakmont and Plum, Pennsylvania, suburbs northeast of Pittsburgh.", "prediction 2": "The US Open is a major golf championship in the United States. The 2015 U.S. Open Championship was the 115th U.S. Open, played June 18\u201321, 2015 at Chambers Bay in University Place, Washington, southwest of Tacoma on the shore of Puget Sound. The 2016 U.S. Open Championship was the 116th U.S. Open, held June 16\u201319 at Oakmont Country Club in Oakmont and Plum, Pennsylvania, suburbs northeast of Pittsburgh. The 2017 U.S. Open was the 117th U. Open, held June 15\u201318 at Erin Hills in Erin, Wisconsin, northwest of Milwaukee. The 2018 U. Open was televised by Sky Sports.", "prediction 3": "The 2015, 2016 and 2017 US Opens were televised by Fox Sports 1, Fox Sports 1 and Fox Sports, launching a 12-year contract with the United States Golf Association. The 2016 US Open was televised by Fox Sports 1, FS1 cable and over-the-air on Fox, with the last two rounds shown only on Fox. The 2015 US Open was televised by Fox Sports 1 and Fox Sports, launching a 12-year contract with the United States Golf Association.", "prediction 4": "The United States Open Championship is an annual golf tournament held in the United States. The first two rounds were on FS1 cable and over-the-air on Fox, with the last two rounds shown only on Fox. The 2017 U.S. Open Championship was the 117th U.S. Open, held June 15\u201318 at Erin Hills in Erin, Wisconsin, northwest of Milwaukee. The 2018 U.S. Open Championship was the 123rd U.S. Open, played June 18\u201321, 2018, at Chambers Bay in University Place, Washington, southwest of Tacoma on the shore of Puget Sound.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 343 }, { "error type": "Unverifiable", "explanation": "", "start": 158, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 97 }, { "error type": "Unverifiable", "explanation": "", "start": 98, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 465 }, { "error type": "Irrelevant", "explanation": "", "start": 466, "end": 514 }, { "error type": "Irrelevant", "explanation": "", "start": 551, "end": 569 }, { "error type": "Irrelevant", "explanation": "", "start": 586, "end": 677 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10, 8, 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " The 2015 US Open Golf Championship was played June 18\u201321, 2015 and was televised. The 2016 U.S. Open Golf Championship was held June 16\u201319 and was televised " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who are the democrats running for governor in arizona?", "passages": [ [ "2014 Arizona gubernatorial election", "2014 Arizona gubernatorial election\n\nThe 2014 Arizona gubernatorial election was held on November 4, 2014, to elect the Governor of Arizona, concurrently with elections to the United States Senate in other states and elections to the United States House of Representatives and various state and local elections.", "Incumbent Republican Governor Jan Brewer was term-limited and could not run for re-election to a second full term in office.", "After a bitter six-candidate primary, Republicans nominated Arizona State Treasurer Doug Ducey; Democrat Fred DuVal, the former chairman of the Arizona Board of Regents, won his party's nomination unopposed.", "Ducey won the election with 53% of the vote.", "This election marked the first time since 1998 that no female gubernatorial candidate was on the ballot and the first time since 1994 that a man was elected as governor of the state of Arizona.", "Democratic Governor Janet Napolitano resigned on January 21, 2009, to be sworn in as Secretary of the Department of Homeland Security.", "Since Arizona does not have a lieutenant governor, Secretary of State Jan Brewer was first in the state's gubernatorial line of succession and was sworn in as governor on the same day.", "She was elected to a full term in 2010, defeating Democrat Terry Goddard, the Arizona Attorney General, by 54% to 42%.", "Brewer was term-limited in 2014, despite only serving one full term." ], [ "David Garcia (politician)", "David Garcia (politician)\n\nDavid Garcia is an American politician and education professor who was the Democratic Party's nominee in the 2018 Arizona gubernatorial election.", "Garcia is an associate professor at Arizona State University's Mary Lou Fulton Teachers College.", "He was the 2014 Democratic candidate for Superintendent of Public Instruction, but was defeated by the Republican Party's nominee, Diane Douglas.", "Garcia challenged Republican Governor Doug Ducey in the November 2018 Arizona gubernatorial election, but lost by a wide margin.", "Garcia, a fourth generation Mexican-American, was born and raised in Mesa, Arizona.", "He served as an infantryman in the United States Army.", "Garcia graduated from Arizona State University with a B.A. in communication in 1993.", "He also graduated from the University of Chicago with a M.A. in education research in 1997 and a Ph.D. in education research in 2002.", "An education researcher, Garcia previously worked in the Arizona Department of Education and currently works as an associate professor at ASU's Mary Lou Fulton Teachers College.", "In 2014, Garcia ran unsuccessfully for state superintendent against Republican Diane Douglas.", "Despite his loss to Douglas, who was considered a historically weak candidate, Garcia announced his plan to challenge incumbent Republican Governor Doug Ducey in April 2017.", "Garcia defeated state legislator Steve Farley in the August 2018 Democratic gubernatorial primary.", "While Garcia's 2014 bid attracted independent and Republican support, his 2018 campaign is progressive." ], [ "2006 Arizona gubernatorial election", "2006 Arizona gubernatorial election\n\nThe 2006 Arizona gubernatorial election was held on November 7, 2006.", "Incumbent Democratic Governor Janet Napolitano, was reelected without major opposition.", "The Governor's widespread popularity contributed to her easily won campaign for reelection; her general approval rating in October 2006, one month before the election, was at 58%.", "As of 2019, this is the most recent election in which a Democrat was elected Governor of Arizona." ] ], "gold": "During the 2018 Arizona gubernatorial election, the Democrat nominee was David Garcia, who lost by a margin of 14% to the Republican candidate, Doug Ducey. Previously, in 2014, Fred DuVal, the former chairman of the Arizona Board of Regents, won the Democratic nomination unopposed. In 2010, Terry Goddard, the Arizona Attorney General, won the Democrat nomination but later lost by 54% to 42% against Jan Brewer. In 2006, Janet Napolitano was the Democratic Party's candidate for the election.", "prediction 1": "There are several Democrats running for governor in Arizona. In the 2014 election, Democrat Jan Brewer won the primary and was sworn in as governor, defeating Republican Jan Brewer. In the 2018 election, Democrat David Garcia won the primary and was the party's nominee in the November election. In the 2006 election, Democrat Janet Napolitano won the primary and was reelected without major opposition. As of 2019, this is the most recent election in which a Democrat was elected Governor of Arizona.", "prediction 2": "There are currently three democrats running for governor in Arizona. In the 2014 Arizona gubernatorial election, which was held on November 4, 2014, the Democrat Fred DuVal, the former chairman of the Arizona Board of Regents, won his party's nomination unopposed. In the 2018 Arizona gubernatorial election, the Democrat David Garcia was the nominee for Governor and the Democrat Jeff Sessions was the candidate for Lieutenant Governor. In the 2006 Arizona gubernatorial election, Democratic Governor Janet Napolitano was re-elected with a majority.", "prediction 3": "In Arizona, the Democratic Party is seeking to elect a new governor. In 2018, American politician and education professor David Garcia was the party's nominee for Governor. Garcia challenged Republican Governor Doug Ducey in the November 2018 Arizona gubernatorial election, but lost by a wide margin. In 2016, Republican Governor Jan Brewer was elected to a second full term, while Democrat Fred DuVal, the former chairman of the Arizona Board of Regents, won his party's nomination unopposed.", "prediction 4": "In 2018, David Garcia was the Democratic Party's nominee in the 2018 Arizona gubernatorial election. He was the Democratic Party's nominee in the 2018 Arizona gubernatorial election. In 2006, Democratic Governor Janet Napolitano was reelected without major opposition. In 2016, Republican Gov. Jan Brewer was term-limited and could not run for re-election to a second full term in office. In 2019, this is the most recent election in which a Democrat was elected as governor of Arizona.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 501 }, { "error type": "Incoherent", "explanation": "", "start": 28, "end": 35 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 92, "end": 102 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 344, "end": 359 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3,4]}", "start": 123, "end": 181 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "There are several Democrats that ran for governor in Arizona. In the 2014 election, Democrat Fred DuVal won the Democrat primary unopposed. In the 2018 election, Democrat David Garcia won the Democrat primary and was the party's nominee in the November election but lost by a wide margin. In the 2006 election, Democrat Janet Napolitano was reelected without major opposition. " }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who built the first railroad in the united states?", "passages": [ [ "Boston and Lowell Railroad", "A portable temporary funicular cable railway was first employed in 1795 by Charles Bulfinch, architect of the State House and other prominent Boston properties, to reshape (raze and shave)", "Boston's \"Tri-mount\" \u2013 or \"the Tremont\" \u2013 which were the three peaks dominating the colonial era's goosenecked peninsula's eastern and northern topography.", "The hills' summits and sides were systematically cut down at different times before 1816, with the first cuttings occurring in 1795 to build the Massachusetts State House on Beacon Hill at a more desirable lower elevation.", "Fredrick Gamst believes the same hardware was then relocated and used again in 1799\u20131804 and 1809\u20131815 to transfer hilltop materials into land reclamation and real-estate speculation, that began creating Boston's famed Back Bay neighborhoods from the long mud flats of the Charles River by creation of the duck pond and public gardens near the Boston Common.", "The second operational and chartered \"meant to be permanent\" railway in the country was the Granite Railroad, chartered and built in 1826 in nearby Quincy.", "It was a , horse-powered railroad, built to move large granite stones from the quarries in Quincy to the Neponset River in Milton.", "As was believed to be the most sturdy method at the time, it was built on a deep foundation of granite, setting a precedent for all railroads that could afford it." ], [ "Leiper Railroad", "Leiper Railroad\n\nThe Leiper Railroad was a 'family business built' horse drawn railroad of three quarters of a mile constructed in 1810 after the quarry owner, Thomas Leiper, failed to obtain a charter with legal rights-of-way to instead build his desired canal along Crum Creek.", "The quarry man's 'make-do' railroad solution was the continent's \"first chartered railway, first operational non-temporary railway, first well documented railroad, \"and\" first constructed railroad\" also \"meant to be permanent\".", "The credit of constructing the first permanent tramway in America may therefore be rightly given to Thomas Leiper.", "He was the owner of a fine quarry not far from Philadelphia, and was much concerned to find an easy mode of carrying stone to tide-water.", "That a railway would accomplish this end he seem to have had no doubt.", "To test the matter, and at the same time afford a public exhibition of the merits of tramways, he built a temporary track in the yard of the Bull's Head Tavern in Philadelphia.", "The tramway was some sixty feet long, had a grade of one inch and a half to the yard, and up it, to the amazement of the spectators, one horse used to draw a four-wheeled wagon loaded with a weight of ten thousand pounds.", "This was the summer of 1809." ], [ "Thomas Leiper", "Thomas Leiper\n\nThomas Leiper (15 December 1745 \u2013 6 July 1825) was a Scottish American merchant and local politician who served in the American Revolutionary War.", "He was the first American to construct a permanent working railway by creating a short span on his property in Nether Providence Township, Delaware County, Pennsylvania.", "Born in Strathaven, Lanark, Scotland, Leiper was educated at Glasgow and Edinburgh, and emigrated to Maryland in 1763.", "In 1765 Leiper moved to Philadelphia, Pennsylvania and opened a business storing and exporting tobacco.", "When the American Revolution began, the leading tobacco house in the community was interdicted and legally prevented from trading.", "Leiper seized the opportunity and expanded his business, soon becoming the principal tobacco agent in Philadelphia, then the capital of the United States.", "Some years later Leiper built several large mills for the processing of tobacco and snuff in Delaware County, Pennsylvania.", "In 1780 he bought and operated quarries in the neighborhood of his mills, and provided stones for bridge and building construction.", "Granite from the Leiper quarry was cut for Philadelphia curbstones and door steps, and was used for buildings on the Swarthmore College campus, homes in Swarthmore, and the Leiper Presbyterian Church.", "Leiper built and rented out a Philadelphia home for the use of his friend Thomas Jefferson when Jefferson served as George Washington's Secretary of State." ] ], "gold": "Charles Bullfinch was the first to build a temporary funicular railway, while Thomas Leiper was the first to build a short temporary 60 yards (55 m) railroad test track in the yard of the Bull's Head Tavern in Philadelphia. Thomas Leiper was the first American to construct a permanent working railway in United States. ", "prediction 1": "The first permanent working railroad in the United States was the Boston and Lowell Railroad, which was built in 1795 by a contractor called Charles Bulfinch to raze and shave Boston's Tri-mount, or \"the Tremont\", in order to build the Massachusetts State House on Beacon Hill at a more desirable lower elevation. The first chartered, non-temporary railroad in the United States was the Granite Railroad, which was chartered and built in 1826 in nearby Quincy after the quarry owner, Thomas Leiper, a Scottish American merchant and local politician who served in the American Revolutionary War. The credit of constructing the first permanent tramway in America may therefore be rightly given to Thomas Leiper.", "prediction 2": "The first permanent working railroad in the United States was built in 1810 by Thomas Leiper, a Scottish American merchant and local politician who served in the American Revolutionary War. The Leiper Railroad was a 'family business built' horse drawn railroad of three quarters of a mile constructed in 1810 after the quarry owner, Thomas Leiper, failed to obtain a charter with legal rights-of-way to instead build his desired canal along Crum Creek.", "prediction 3": "The first permanent railroad in the United States was built by George Washington in 1793. The first chartered railroad in the United States was the Boston and Lowell Railroad. The first operational and chartered railroad in the United States was the Granite Railroad, chartered in 1826 in nearby Quincy. The first permanent tramway in America was built by Scottish American merchant and local politician Thomas Leiper.", "prediction 4": "The first permanent working railroad in the United States was constructed by Thomas Leiper in 1810, when the quarry owner, Thomas Leiper, failed to obtain a charter with legal rights-of-way to instead build his desired canal along Crum Creek. Leiper was a Scottish merchant and local politician who served in the American Revolutionary War. He was the first American to construct a permanent working railway by creating a short span on his property in Nether Providence Township, Delaware County, Pennsylvania. The second operational and chartered \"meant to be permanent\" railway in the country was the Granite Railroad, chartered and built in nearby Quincy in 1826.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 10, "end": 19 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 313 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 318, "end": 323 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 594 }, { "error type": "Irrelevant", "explanation": "", "start": 642, "end": 649 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Charles Bullfinch was the first to build a temporary funicular railway, while Thomas Leiper was the first to build a temporary track in the yard of the Bull's Head Tavern in Philadelphia. Thomas Leiper was the first American to construct a permanent working railway in United States." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who decided to use agent orange in vietnam?", "passages": [ [ "Agent Orange", "In mid-1961, President Ngo Dinh Diem of South Vietnam asked the United States to conduct aerial herbicide spraying in his country.", "In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help.", "But Diem's request launched a policy debate in the White House and the State and Defense Departments.", "However, U.S. officials considered using it, pointing out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s.", "In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. Air Force's herbicide program in Vietnam.", "During the Vietnam War, between 1962 and 1971, the United States military sprayed nearly of various chemicals \u2013 the \"rainbow herbicides\" and defoliants \u2013 in Vietnam, eastern Laos, and parts of Cambodia as part of the aerial defoliation program known as Operation Ranch Hand, reaching its peak from 1967 to 1969.", "For comparison purposes, an olympic size pool holds approximately .", "As the British did in Malaya, the goal of the US was to defoliate rural/forested land, depriving guerrillas of food and concealment and clearing sensitive areas such as around base perimeters." ], [ "Agent Orange", "Agent Orange\n\nAgent Orange is an herbicide and defoliant chemical, one of the \"tactical use\" Rainbow Herbicides.", "It is widely known for its use by the U.S. military as part of its herbicidal warfare program, Operation Ranch Hand, during the Vietnam War from 1961 to 1971.", "It is a mixture of equal parts of two herbicides, 2,4,5-T and 2,4-D.", "In addition to its damaging environmental effects, traces of dioxin (mainly TCDD, the most toxic of its type) found in the mixture have caused major health problems for many individuals who were exposed.", "Up to four million people in Vietnam were exposed to the defoliant.", "The government of Vietnam says as many as 3 million people have suffered illnesses because of Agent Orange.", "The Red Cross of Vietnam estimates that up to 1 million people are disabled or have health problems as a result of Agent Orange contamination.", "The United States government has challenged these figures as being unreliable.", "The chemical is capable of damaging genes, resulting in deformities among the offspring of exposed victims.", "The U.S. government has documented higher cases of leukemia, Hodgkin's lymphoma, and various kinds of cancer in exposed veterans.", "Agent Orange also caused enormous environmental damage in Vietnam." ] ], "gold": "Agent Orange is a herbicide and defoliant chemical widely known for its use by the United States as part of its herbicidal warfare program, Operation Ranch Hand, during the Vietnam War. In mid-1961, President Ngo Dinh Diem of South Vietnam asked the United States to conduct aerial herbicide spraying in his country, but Diem's request launched a policy debate in the White House and the State and Defense Departments. However, after U.S. officials pointed out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s, President John F. Kennedy authorized the start of Operation Ranch Hand in November 1961.", "prediction 1": "In mid-1961, South Vietnamese President Ngo Dinh Diem asked the United States to conduct aerial herbicide spraying in his country. In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help. However, U.S. officials considered using it, pointing out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s. In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. military's herbicide program in Vietnam, eastern Laos, and parts of Cambodia as part of the aerial defoliation program known as Operation Ranch Hand. Up to four million people in Vietnam were exposed to the chemical.", "prediction 2": "The United States used Agent Orange during the Vietnam War. In mid-1961, President Ngo Dinh Diem of South Vietnam asked the United States to conduct aerial herbicide spraying in his country. In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help. In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. Air Force's herbicide program in Vietnam.", "prediction 3": "In mid-1961, South Vietnamese President Ngo Dinh Diem asked the United States to conduct aerial herbicide spraying in his country. In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help. However, United States officials considered using it, pointing out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s. In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. Air Force's herbicide program in Vietnam. Up to four million people in Vietnam were exposed to the defoliant. The government of Vietnam says as 3 million people have suffered illnesses because of Agent Orange.", "prediction 4": "In mid-1961, South Vietnamese President Ngo Dinh Diem asked the United States to conduct aerial herbicide spraying in his country. In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help. However, U.S. officials considered using it, pointing out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s. In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. Air Force's herbicide program in Vietnam.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 667, "end": 733 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In mid-1961, South Vietnamese President Ngo Dinh Diem asked the United States to conduct aerial herbicide spraying in his country. In August of that year, the Republic of Vietnam Air Force conducted herbicide operations with American help. Diem's request launched a policy debate in the White House and the State and Defense Departments. However, U.S. officials considered using it, pointing out that the British had already used herbicides and defoliants during the Malayan Emergency in the 1950s. In November 1961, President John F. Kennedy authorized the start of Operation Ranch Hand, the codename for the U.S. military's herbicide program in Vietnam, eastern Laos, and parts of Cambodia as part of the aerial defoliation program known as Operation Ranch Hand. Agent Orange is an herbicide and defoliant chemical, widely known for its use by the U.S. military as part of its herbicidal warfare program." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who started the white out in college football?", "passages": [ [ "Victory (Pennsylvania State University fight song)", "Victory (Pennsylvania State University fight song)\n\n\"Victory\" is an old fight song of the Pennsylvania State University.", "It is most often sung by the Penn State Glee Club and performed by the Penn State Blue Band.", "While a Penn State student and Glee Club member in 1913, James Leyden began singing a song he had just created at the athletic Track House.", "His roommate, Albert A. Hansen, published the song in the fall semester of 1913.", "The Blue Band played an arrangement of the song as early as 1915.", "During a Penn State Nittany Lions football game at Beaver Field against Lehigh University, students held aloft blue and white streamers and alternated the colors with the beats of the song; the novel cheering method became popular with the spectators in the crowd.", "Leyden would later compose \"The Nittany Lion\" in the 1920s.", "The song's lyrics are:" ], [ "Beaver Stadium", "The student section was widely credited with aiding the defense, which kept the Buckeyes' future Heisman Trophy winning quarterback, Troy Smith, in check by intercepting a pass and recovering a decisive fumble in the final minutes.", "Smith was forced to call several timeouts during the game due to inability to communicate with his offense on the field.", "Former Ohio State Center Nick Mangold has openly admitted that Beaver Stadium was the toughest stadium he had ever played in .", "In 2007, for the Notre Dame game, a full-stadium \"White House\" was declared.", "While it is widely believed that this change was a result of the National Hockey League's Phoenix Coyotes notifying the university that the phrase \"White Out\" was trademarked by the franchise during their time as the Winnipeg Jets, the \"White House\" moniker was invented to remind the crowd that everyone, and not just the student section, was to wear white.", "The newly christened \"White House\" was also deemed a success, as nearly every Penn State fan in attendance wore white, and the Lions won, 31\u201310.", "In 2008, the White House was met with similar success, a 38\u201324 win over Illinois.", "Zombie Nation is a tradition carried out by the Nittany Lions usually after a big play." ] ], "gold": "The White Out is a tradition at the Pennsylvania State University during select Nittany Lions home football games, where all spectators come dressed in white. The White Out was started by the student section.", "prediction 1": "While a Penn State student and Glee Club member in 1913, James Leyden began singing a song he had just created at the athletic Track House. His roommate, Albert A. Hansen, published the song in the fall semester of 1913. The Blue Band played an arrangement of the song as early as 1915. During a Penn State Nittany Lions football game at Beaver Field against Lehigh University, students held aloft blue and white streamers and alternated the colors with the beats of the song. The novel cheering method became popular with the spectators in the crowd.", "prediction 2": "The \"White Out\" was first introduced to the Penn State football program in 1913 when James Leyden began singing a song he had just created at the athletic Track House. His roommate, Albert A. Hansen, published the song in the fall semester of 1913. The Blue Band played an arrangement of the song as early as 1915.", "prediction 3": "The White Out in college football began on January 1, 1973 and has continued since 1973. The phrase \"White Out\" was trademarked by the Winnipeg Jets, and it was invented to remind the crowd that everyone, and not just the student section, was to wear white. The name \"White House\" moniker was invented to remind the crowd that everyone, and not just the student section, was to wear white, and the Penn State Lions won, 31-10.", "prediction 4": "While a Penn State student and Glee Club member in 1913, James Leyden began singing a song he had just created at the athletic Track House. His roommate, Albert A. Hansen, published the song in the fall semester of 1913. The Blue Band played an arrangement of the song as early as 1915. During a Penn State Nittany Lions football game at Beaver Field against Lehigh University, students held aloft blue and white streamers and alternated the colors with the beats of the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 220 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 335, "end": 476 }, { "error type": "Irrelevant", "explanation": "", "start": 477, "end": 551 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "During a Penn State Nittany Lions football game, the student section was widely credited with aiding the defense. While it is widely believed that this change was a result of the National Hockey League's Phoenix Coyotes notifying the university that the phrase \"White Out\" was trademarked by the franchise during their time as the Winnipeg Jets, the \"White House\" moniker was invented to remind the crowd that everyone, and not just the student section, was to wear white." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When is the new episodes of wentworth coming out?", "passages": [ [ "Wentworth (TV series)", "Wentworth (TV series)\n\nWentworth is an Australian television drama programme.", "It was first broadcast on SoHo on 1 May 2013.", "The series serves as a contemporary reimagining of \"Prisoner\", which ran on Network Ten from 1979 to 1986.", "Lara Radulovich and David Hannam developed \"Wentworth\" from Reg Watson's original concept.", "The series is set in the modern day and initially focuses on Bea Smith's (Danielle Cormack) early days in prison and her subsequent rise to the top of the prison's hierarchy.", "Following Cormack's departure from the show at the end of the fourth season, the series shifted its focus onto a more ensemble format.", "For the first three seasons, \"Wentworth\" was filmed on purpose-built sets in the suburbs of Clayton, Victoria.", "Production moved to Newport, Victoria, starting with the fourth season.", "The show has received a mostly positive reception from critics, and the first episode became the most watched Australian drama series premiere in Foxtel history.", "The series was picked up by several countries, including New Zealand and the UK, where it has been retitled \"Wentworth Prison\".", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019." ], [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ], [ "Shark Tank (Australian TV series)", "The first adaptation, \"Dragons' Den\", was an unsuccessful 2005 series that aired on the Seven Network.", "\"Shark Tank\" premiered on 8 February 2015 and aired 15 episodes through to 7 June 2015 with a regular timeslot of 8:00pm Sunday.", "It was renewed for a second season in the season finale.", "Season 2 premiered in 2016 with Glen Richards replacing John McGrath as a panelist.", "The series was renewed for a third season which began airing on 20 June 2017." ] ], "gold": "Wentworth is an Australian television drama series that was first broadcast on SoHo on 1 May 2013, with the first part of its eighth and final season premiering on July 28, 2020 and the second half premiering August 2021. Episode 58 came out on 20 June 2017. Episode 57 came out on 13 June 2017. Episode 56 came out 6 June 2017. ", "prediction 1": "Wentworth is an Australian television drama programme. The series serves as a contemporary reimagining of the original Australian television drama Prisoner, which ran on Network Ten from 1979 to 1986. Episodes for the current series came out on 5 June 2013, 6 April 2017, and 10 May 2016. The new episodes for the next two seasons came out on 5 December 2018, and a further 20 episodes were commissioned.", "prediction 2": "Wentworth is an Australian television drama series that originally aired on Foxtel's SoHo channel from 2013 to 2019. According to the Showcase website, new episodes for the series began airing on 5 June 2013, and a further 20 episodes were commissioned in April 2018, with production beginning in September 2019.", "prediction 3": "Wentworth is an Australian television drama programme that ran from 2013 to 2021. The first episode of the first season came out on 1 May 2013. The second episode of the second season came out on 4 April 2017.", "prediction 4": "The new episodes of Wentworth were released on 6 June 2018, 19 June 2018, and 4 April 2019. The new episodes of the series were released on 5 December 2018 and 19 June 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 200 }, { "error type": "Unverifiable", "explanation": "", "start": 289, "end": 404 }, { "error type": "Unverifiable", "explanation": "", "start": 201, "end": 288 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Wentworth is an Australian television drama programme. It was first broadcast on SoHo on 1 May 2013. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who won last year's fa cup final?", "passages": [ [ "2017 FA Cup Final", "2017 FA Cup Final\n\nThe 2017 FA Cup Final was the 136th final of the FA Cup, the world's oldest football cup competition.", "It took place on 27 May 2017 at Wembley Stadium in London, England and was contested between London rivals Arsenal and Chelsea.", "Arsenal won the game 2\u20131 to secure a record 13th title, while manager Ars\u00e8ne Wenger became the most successful manager in the tournament's history with seven wins.", "The winners would enter the 2017\u201318 UEFA Europa League group stage, had they not already qualified for the UEFA Champions League via other competitions.", "This was a rematch of the 2002 FA Cup Final and the first final since 2003 in which both sides split the league games against each other during the course of the season, with a 3\u20130 victory by Arsenal in September 2016, and a 3\u20131 win by Chelsea in February 2017.", "The game was broadcast live in the United Kingdom by both BBC and BT Sport.", "BBC One provided the free-to-air coverage and BT Sport 2 was the pay-TV alternative.", "In North America, this was the first FA Cup Final to be televised by CTV in Canada and by FOX in the United States.", "Due to the circumstances surrounding his appearance, and performance on the day, Arsenal fans and former players have dubbed the game \"The Mertesacker Final\".", "In all results below, the score of the finalist is given first." ], [ "2015\u201316 FA Cup", "2015\u201316 FA Cup\n\nThe 2015\u201316 FA Cup (also known as the FA Challenge Cup) was the 135th edition of the oldest recognised football tournament in the world.", "It was sponsored by Emirates, and known as The Emirates FA Cup for sponsorship purposes.", "It began with the Extra Preliminary Round on 15 August 2015, and concluded with the final on 21 May 2016.", "The FA Cup winner qualifies for the 2016\u201317 UEFA Europa League Group Stage.", "Premier League side Arsenal were the defending champions after they beat Aston Villa 4\u20130 in the previous final on 30 May 2015, but were eliminated by Watford in the sixth round.", "The winners were Manchester United, who defeated Crystal Palace 2\u20131 in the final after extra time.", "The schedule are as follows.", "The qualifying competition began with the Extra Preliminary Round on 15 August 2015.", "All of the competing teams that were not members of either the Premier League or the Football League had to compete in the qualifying rounds to win a place in the first round proper.", "The final (fourth) qualifying round began on the weekend of 24 October.", "The First Round draw took place on 26 October at 7pm at the club house of the FA Charter Standard Community Club Thackley Juniors F.C." ], [ "Agnes Benidickson Tricolour Award", "2014-15\n\n\n2013-14\n\n\n2012-13\n\n\n2011-12\n\n\n2010-11\n\n\n2009-10\n\n\n2008-09\n\n\n2007-08\n\n\n2006-07\n\n\n2005-06\n\n\n2004-05\n\n\n2003-04\n\n\n2002-03\n\n\n2001-02\n\n\n2000-01\n\n\n1999-00\n\n\n1998-99\n\n\n1997-98\n\n\n1996-97\n\n\n1995-96\n\n\n1994-95\n\n\n1993-94\n\n\n1992-93\n\n\n1991-92\n\n\n1990-91\n\n\n1989-90\n\n\n1988-89\n\n\n1987-88\n\n\n1986-87\n\n\n1985-86\n\n\n1984-85\n\n\n1983-84\n\n\n1982-83\n\n\n1981-82\n\n\n1980-81\n\n\n1979-80\n\n\n1978-79\n\n\n1977-78\n\n\n1976-77\n\n\n1975-76\n\n\n1974-75\n\n\n1973-74\n\n\n1972-73\n\n\n1971-72\n\n\n1970-71\n\n\n1969-70\n\n\n1968-69\n\n\n1967-68\n\n\n1966-67\n\n\n1965-66\n\n\n1964-65\n\n\n1963-64\n\n\n1962-63\n\n\n1961-62\n\n\n1960-61\n\n\n1959-60\n\n\n1958-59\n\n\n1957-58\n\n\n1956-57\n\n\n1955-56\n\n\n1954-55\n\n\n1953-54\n\n\n1952-53\n\n\n1951-52\n\n\n1950-51\n\n\n1949-50\n\n\n1948-49\n\n\n1947-48\n\n\n1946-47\n\n\n1945-46\n\n\n1944-45\n\n\n1943-44\n\n\n1942-43\n\n\n1941-42\n\n\n1940-41\n\n\n1939-40" ], [ "Per Mertesacker", "As Mertesacker's great run continued, he was voted as a part of the Premier League Team of the Year, along with teammate Aaron Ramsey.", "On 13 January 2014, Mertesacker made his 100th official appearance for the \"Gunners\" in a 1\u20132 away win over Aston Villa.", "On 4 March 2014, Mertesacker signed a new contract with Arsenal.", "On 12 April 2014, Mertesacker scored an 82nd-minute equalising goal for Arsenal in the FA Cup semi-final against Wigan Athletic.", "The match finished 1\u20131 after extra time, with Arsenal winning 4\u20132 in a penalty shootout.", "He had earlier conceded the penalty that had put Wigan 1\u20130 up.", "On 17 May 2014, Mertesacker started in the 2014 FA Cup Final as Arsenal beat Hull City 3\u20132 at Wembley Stadium.", "After initially featuring sparingly due to injuries in the 2014\u201315, he returned to captain Arsenal in the 2015 FA Cup Final, scoring the third goal, a header in a 4\u20130 victory over Aston Villa at Wembley.", "After healing from injury, Mertesacker remained a mainstay in the Arsenal backline, playing alongside Laurent Koscielny.", "With Arsenal making a charge towards the title, Ars\u00e8ne Wenger singled out Mertesacker for praise, calling him an \"important leader in the dressing room and a respected one\"." ], [ "2014\u201315 FA Cup", "2014\u201315 FA Cup\n\nThe 2014\u201315 FA Cup, also called the 2014\u201315 FA Challenge Cup, was the 134th occurrence of the FA Cup, the main domestic cup in English football and the oldest knockout competition in the world.", "It was the first season when the BBC and BT Sport hosted televised matches, seven years after the BBC lost the rights to ITV.", "The 2014\u201315 season's Cup also marked the first time that 3G (third generation) artificial pitches were allowed in all rounds of the competition, designed to lower costs for maintenance.", "After Queens Park Rangers (the first English artificial pitch, from 1981 to 1988), Luton Town, Oldham Athletic and Preston North End trialled artificial pitches in the 1980s, they were made illegal in 1995.", "The defending champions were Premier League side Arsenal, after they beat Hull City 3\u20132 in the previous final on 17 May 2014.\n\n", "The semi-finals took place at Wembley Stadium, as they have since 2008, to offset the cost of the new stadium, despite protestations from some supporters.", "The stadium also hosted the final.", "The winner of the FA Cup earns automatic qualification to the 2015\u201316 UEFA Europa League group stages." ] ], "gold": "In 2017, Arsenal defeated Chelsea 2 to 1 in the FA Cup final to secure a record 13th FA Cup title. In 2016, Manchester United defeated Crystal Palace 2 to 1 in the FA Cup final after extra time. This was the 12th FA Cup title for Manchester United. In 2015, Arsenal entered the tournament as defending champions and retained the FA Cup trophy, beating Aston Villa 4 to 0 in the FA Cup final.", "prediction 1": "The 2017 FA Cup Final was the 136th final of the FA Cup, the oldest football cup competition in the world. It took place on 27 May 2017 at Wembley Stadium in London, England and was contested between London rivals Arsenal and Chelsea. Arsenal won the game 2\u20131 to secure a record 13th title, while manager Ars\u00e8ne Wenger became the most successful manager in the tournament's history with seven wins. The 2015\u201316 FA Cup was the 135th edition of the oldest football tournament in the world.\n", "prediction 2": "The oldest football competition in the world, the FA Cup, took place on 27 May 2017 at Wembley Stadium, London, England, between London rivals Arsenal and Chelsea. In the 2017 FA Cup Final, Arsenal won the game 2\u20131 to secure a record 13th title, while Arsene Wenger became the most successful manager in the tournament's history with seven wins. The 2015-2016 FA Cup was the 135th edition of the oldest football tournament in the world. Manchester United won the 2016-2017 FA Cup when they defeated Crystal Palace 2\u20131 in the final after extra time. In the 2015-2016 FA Cup Final against Wigan Athletic, Arsenal lost 2-0 to Wigan Athletic.", "prediction 3": "The FA Cup, the oldest football cup competition in the world, is a yearly competition that began on 1 December 1892. In the following year's FA Cup Final, Manchester United won it, beating Crystal Palace 2 to 1. The winner of the 2015-16 FA Cup was Arsenal, but Manchester United won it in 2016.", "prediction 4": "There are many FA Cup competitions. In the 2013-14 FA Cup, Wigan Athletic won the final after extra time, while Arsenal won the 2017 FA Cup Final, which was the 136th final of the FA Cup, the oldest football cup competition in the world. In the 2015-16 FA Cup, Manchester United won the final after extra time, while in the 2016-17 FA Cup, Wigan Athletic won the final after extra time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 106 }, { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 398 }, { "error type": "Irrelevant", "explanation": "", "start": 399, "end": 488 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "in 2017, Arsenal defeated Chelsea 2 to 1 in the FA Cup final to secure a record 13th title. In 2016, Manchester United defeated Crystal Palace 2 to 1 in the FA Cup final after extra time. Arsenal entered the tournament as defending champions , beating Aston Villa 4 to 0 in the FA Cup final." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the full name of bb t bank?", "passages": [ [ "BB&T", "BB&T\n\nBB&T Corporation (Branch Banking and Trust Company) is a bank holding company based in Winston-Salem, North Carolina.", "Its bank operates 2,049 branches in 15 states and Washington, D.C., and offers consumer and commercial banking, securities brokerage, asset management, mortgage, and insurance products and services.", "It is ranked 16th on the list of largest banks in the United States by assets.", "Its subsidiary, BB&T Insurance Services, is one of the largest insurance brokers in the world.", "In 1872, Alpheus Branch and Thomas Jefferson Hadley founded the Branch and Hadley merchant bank in their hometown of Wilson, North Carolina.", "After many transactions, mostly with local farmers, Branch bought out Hadley's shares in 1887 and renamed the company Branch and Company, Bankers.", "Two years later, Branch, his father-in-law Gen. Joshua Barnes, Hadley, and three other men secured a charter from the North Carolina General Assembly to operate the Wilson Banking and Trust Company.", "After many more name changes, the company finally settled on the name Branch Banking and Trust Company.", "Branch remained an active member in the company until his death in 1893.", "The 1903 Branch Banking and Trust Company Building at Wilson was listed on the National Register of Historic Places in 1978." ], [ "Central Carolina Bank and Trust", "The combination would give NCBC \"market capitalization of about $4.2 billion, combined assets of $15 billion, deposits of $11.3 billion and 370 branches in eight states\".", "NCBC had $7.3 billion in assets and 162 National Bank of Commerce (NBC) branches in Tennessee, Georgia, Mississippi, Virginia, West Virginia, Arkansas and North Carolina.", "The company was also buying Hillsborough Savings Bank, with 3 branches and $150 million in assets.", "Many of the NBC branches were in Kroger stores; CCB had nine Harris Teeter locations.", "The CCB name remained on banks in the Carolinas.", "As a result of the First Union-Wachovia merger, 25 branches of the former First Union and Wachovia banks became CCB locations on February 15, 2002.", "CCB would remain number three behind BB&T and Wachovia.", "National Commerce Financial (NCF), the newly named parent company, bought twelve other branches in Georgia and Virginia which would become NBC branches.", "First Bank bought the other branch, in Salisbury.", "In May 2004, NCF announced it would merge with SunTrust, making SunTrust the seventh-largest bank in the United States.", "CCB had 3189 employees at the time, with about 1300 of those in back office jobs which could be dropped after the merger." ] ], "gold": "Truist Financial Corporation is an American bank holding company headquartered in Charlotte, North Carolina. The company was formed in December 2019 as the result of the merger of BB&T, which stands for Branch Banking and Trust Company, and SunTrust Banks.", "prediction 1": "BB&T Corporation is a bank holding company based in Winston-Salem, North Carolina. In 1872, Alpheus Branch and Thomas Jefferson Hadley founded the Branch and Hadley merchant bank in their hometown of Wilson, North Carolina. Two years later, Branch, his father-in-law Gen. Joshua Barnes, Hadley, and three other men secured a charter from the North Carolina General Assembly to operate the Wilson Banking and Trust Company. After many more name changes, the company finally settled on the name Branch Banking and Trust Company.", "prediction 2": "BB&T is a bank holding company based in Winston-Salem, North Carolina. In 1872, Alpheus Branch and Thomas Jefferson Hadley founded the Branch and Hadley merchant bank in their hometown of Wilson, North Carolina. Two years later, Branch, his father-in-law Gen. Joshua Barnes, Hadley, and three other men secured a charter from the North Carolina General Assembly to operate the Wilson Banking and Trust Company. After many more name changes, the company finally settled on the name Branch Banking and Trust Company.", "prediction 3": "BB&T Bank is the full name of the bank holding company based in Winston-Salem, North Carolina. It operates 2,049 branches in 15 states and Washington, D.C. It offers consumer and commercial banking, securities brokerage, asset management, mortgage, and insurance products and services. The company's headquarters are in Winston-Salem, North Carolina. The full name of the bank holding company is BB&T Corporation (Branch Banking and Trust Company).", "prediction 4": "BB&T Bank and Trust is a bank holding company that operates 2,049 branches in 15 states and Washington, D.C. It offers consumer and commercial banking, securities brokerage, asset management, mortgage, and insurance products and services. In 1872, Alpheus Branch and Thomas Jefferson Hadley founded the Branch and Hadley merchant bank in their hometown of Wilson, North Carolina. Two years later, Branch, his father-in-law Gen. Joshua Barnes, Hadley, and three other men secured a charter from the North Carolina General Assembly to operate the Wilson Banking and Trust Company after many more name changes, the company finally settled on the name Branch Banking and Trust Company.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 526 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "BB&T Corporation (Branch Banking and Trust Company) is a bank holding company based in Winston-Salem, North Carolina. " }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "Once upon a time who wins the final battle?", "passages": [ [ "The Final Battle (Once Upon a Time)", "Snow then sees the \"Once Upon a Time\" storybook reappear.", "Henry looks at the final page of the storybook which suddenly writes itself with the words \"When both good and evil did the right thing, faith was restored and the final battle was won.\"", "Snow reminds everyone that the story isn\u2019t over.", "The Enchanted Forest, Neverland, Wonderland, Agrabah, Arendelle, the Land of Oz and all the other realms are restored and their residents obtain their happy beginnings, as does everyone in Storybrooke.", "Emma and Hook patrol as the town Sheriffs, Henry goes to school, Regina returns to her role as Mayor when dwarfs gave her title \"queen\" without \"evil\", David farms with a growing Neal, Zelena spends time with baby Robin, Gold and Belle renew their relationship and raise their son together, Snow White becomes a teacher again and Robin Hood propose to the Evil Queen in Regina's restored palace.", "They all gather together at Granny's to celebrate their lives together.", "Many \"Years Later\" in Seattle, Lucy arrives at the man's apartment by train.", "Lucy tells the man, who is revealed to be an adult Henry, that she is his daughter and that his family needs him, although Henry no longer remembers her." ], [ "Once Upon a Time (TV series)", "Once Upon a Time (TV series)\n\nOnce Upon a Time is an American fantasy drama television series on ABC which debuted on October 23, 2011, and concluded on May 18, 2018.", "The first six seasons are largely set in the fictitious seaside town of Storybrooke, Maine, with the characters of Emma Swan and Regina Mills serving as the leads, while the seventh and final season takes place in a Seattle, Washington neighborhood called Hyperion Heights, with a new main narrative led by Mills, and Swan and Mills son, Henry Mills.", "The show borrows elements and characters from the Disney universe and popular Western literature, folklore, and fairy tales.", "\"Once Upon a Time\" was created by \"Lost\" and \"\" writers Edward Kitsis and Adam Horowitz.", "A spin-off series, \"Once Upon a Time in Wonderland\", consisting of 13 episodes which followed the titular character from \"Alice in Wonderland\", premiered on October 10, 2013 and concluded on April 3, 2014." ], [ "Emma Swan", "Emma Swan\n\nEmma Swan is a fictional character in ABC's television series \"Once Upon a Time\".", "She is portrayed by Jennifer Morrison, by Abby Ross as a teenager, and Mckenna Grace as a child.", "Emma first appeared in the series's pilot as a bail bond agent in Boston, Massachusetts until she meets her biological son Henry, whom she gave up for adoption 10 years before, and learns she is the daughter of Snow White and Prince Charming.", "Henry urges Emma to go to the fictional town of Storybrooke, Maine, to break a curse enacted by the Evil Queen and to restore the fairy tale characters' happy endings.", "The daughter of Snow White and Prince Charming, an ex-bail bonds collector, town sheriff of Storybrooke and Henry Mills' biological mother.", "Morrison described her character at the beginning of the first season as \"broken, damaged and worldly\"." ] ], "gold": "Once Upon a Time is an American fantasy adventure drama television series that aired for seven seasons on ABC from October 23, 2011 to May 18, 2018. Emma Swan is a fictional character in ABC's television series Once Upon a Time. She wins the final battle by throwing down her sword. According to the storybook, good and evil win the final battle.", "prediction 1": "Once Upon a Time is an American fantasy drama television series which debuted on October 23, 2011 and concluded on May 18, 2018. The show borrows elements and characters from the Disney universe and popular Western literature, folklore, and fairy tales. The finale of the series focuses on the final battle between the Good and the Evil Queen. Emma Swan is played by Jennifer Morrison, Abby Ross as a teenager, and Mckenna Grace as a child.", "prediction 2": "Once Upon a Time is an American fantasy drama television series on ABC. The story is set in a fictitious seaside town called Storybrooke, Maine, and centers on Emma Swan, a bail bond agent and town sheriff of Storybrooke, Maine and the biological mother of Henry Mills. As the final battle plays out, the winner is Emma.", "prediction 3": "Once Upon a Time is an American fantasy drama television series on ABC which debuted on October 23, 2011, and concluded on May 18, 2018. The characters of Emma Swan and Regina Mills serve as the leads. The seventh and final season takes place in a Seattle, Washington neighborhood called Hyperion Heights, with a new main narrative led by Mills, and Swan and Mills son, Henry Mills.", "prediction 4": "Once Upon a Time is an American fantasy drama television series on ABC. In the first six seasons, Emma Swan and Regina Mills serve as the leads. In the seventh and final season, Henry Mills and Emma Swan lead the story. In the final episode of the series, the final battle is won by the good and evil.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 440 }, { "error type": "Unverifiable", "explanation": "", "start": 254, "end": 343 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Once Upon a Time is an American fantasy drama television series which debuted on ABC from October 23, 2011 and concluded on May 18, 2018. Emma Swan is a fictional character in ABC's television series \"Once Upon a Time\". According to the storybook, When both good and evil did the right thing, faith was restored and the final battle was won. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who has most technical fouls in nba history?", "passages": [ [ "Technical foul", "In the 2000\u201301 season, he received 41 technical fouls in 80 regular season and postseason games played.", "Wallace also holds the all-time mark for most technical fouls by a player in a career with 317, a record previously held by Dennis Rodman.", "There have been a few instances in the NBA when a team's entire bench has either been injured or fouled out, and one of the five remaining eligible players fouls out, resulting in the technical foul that effectively acts as a bonus free throw situation.", "The Atlanta Hawks' Cliff Levingston (fouled out, but one of the five remaining players was ejected) and the Los Angeles Lakers' Robert Sacre (fouled out) have both taken advantage of the disqualified player rule.", "Under NBA Rule 3-I-a (player fouls out) and 3-I-b (player injured or ejected), the player was assessed with a technical foul for remaining in the game or returning to the game after fouling out." ] ], "gold": "Rasheed Wallace holds the record for the most technical fouls received during one season in the NBA. In the 2000\u201301 season, he received 41 technical fouls in 80 regular season and postseason games played. Wallace also holds the all-time mark for most technical fouls by a player in a career with 317, a record previously held by Dennis Rodman.", "prediction 1": "In the history of the NBA, Dennis Rodman has the most technical fouls. In his career, Dennis Wallace has 317 technical fouls. In the 2000-2001 season, he received 41 technical fouls in 80 regular season and postseason games played.", "prediction 2": "There are various players with the most technical fouls in NBA history. The player who has the most technical fouls in NBA history is Dennis Rodman. The player with the most technical fouls in NBA history is DeAndre Jordan.", "prediction 3": "The player with the most technical fouls in a career is Dennis Rodman. Dennis Rodman has the record for most technical fouls in a career with 457.", "prediction 4": "In the history of the NBA, the player who has received the most technical fouls is Dennis Rodman. Dennis Rodman set the record for the most technical fouls in a career with 317. Dennis Wallace holds the record for most technical fouls by a player in a career with 317.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 27, "end": 40 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the history of the NBA, Wallace has the most technical fouls. In his career, Wallace has 317 technical fouls, a record previously held by Dennis Rodman. In the 2000-2001 season, he received 41 technical fouls in 80 regular season and postseason games played." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Where were the desert scenes in stargate filmed?", "passages": [ [ "Stargate (film)", "The film in its original cut plays out in chronological order, but when Devlin and Emmerich edited the film in the director's cut to tighten the narrative, they decided to change the first scene of the film into a flashback to show who the human host of Ra was before the aliens took him.", "Only Davidson's upper torso was filmed because Davidson had refused to take out his nipple rings.", "The first scene was a combination of model shots and a set in Yuma, Arizona where \"Rambo III\" had been filmed.", "The scene of the excavation of the Stargate was also filmed in three days in Arizona.", "A golden look was achieved by filming near the time of sunset.", "To keep within the limit of the budget, the producers put stick figures with cloth in the distant desert to appear as humans.", "The original Stargate was painted black, but it looked like a giant tire so it was repainted silver at the last moment.", "Daniel Jackson's lecture on his theories was filmed in a hotel in Los Angeles.", "The scene was originally much longer and delved more into the theories that aliens had built the Egyptian pyramids, but the scene was trimmed for time concerns for the release.", "The scenes with O'Neil at his house were the first scenes filmed with Kurt Russell; his hair was cut short afterwards.", "Russell requested his hair color to be brightened a little for the film." ], [ "Stargate SG-1 (season 8)", "The ventilation is questionable, and when the director decided to add smoke for the light to catch to give a dramatic dusty air feeling, the oxygen supply decreased, which made acting harder.", "Daniel's class room in \"Moebius\" were shot in the conference room of the \"Outer Limits\" production at Bridge Studios near the set of \"SG-1\".", "\"SG-1\" crew members had originally scouted a real school but lost that location.", "Carter's office room in the same episode was right down the hall from the conference room.", "\"Stargate SG-1\" was shot in Vancouver, British Columbia, Canada.", "As Vancouver is still developing, Tynehead Park is one of the few locations where the \"SG-1\" team can still film alien locations.", "Other Vancouver locations include a set of roads at a Vancouver airport for the episode \"Full Alert\".", "The roads were closed to regular traffic so that the filming could take place without police escorts and other difficulties that come from blocking traffic.", "Desert locations were shot at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand.", "What is seen in the \"Moebius\" desert is all that is left of the dune.", "The horse shoe form of the dune had been established by another television project called \"Legend of Earthsea\"." ] ], "gold": "In the TV series Stargate SG-1 all of the desert scenes were filmed in Vancouver, British Columbia. There was also a Stargate movie in 1994. The desert scenes for that film were shot in Yuma, AZ, Buttercup Dunes, the same place where Rambo III was filmed.", "prediction 1": "Stargate was originally shot in chronological order, but when Devlin and Emmerich edited the film in the director's cut to tighten the narrative, they decided to change the first scene of the film into a flashback to show who the human host of Ra was before the aliens took him. Desert locations were shot at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand.", "prediction 2": "Stargate was originally cut in chronological order and played out in chronological order, but when Devlin and Emmerich edited the film in the director's cut to tighten the narrative, they decided to change the first scene of the film into a flashback to show who the human host of Ra was before the aliens took him. Desert scenes were shot at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand.", "prediction 3": "Stargate was originally shot in three days in Yuma, Arizona where Rambo III had been filmed. Desert scenes were also filmed at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand.", "prediction 4": "The desert scenes in Stargate were filmed at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand. The first scene was a combination of model shots and a set in Yuma, Arizona where \"Rambo III\" had been filmed. The scene of the excavation of the Stargate was also filmed in three days in Arizona.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 278 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": " \"Stargate SG-1\" was shot in Vancouver, British Columbia, Canada. Desert locations were shot at the Richmond Sand Dunes, a cement factory that is slowly using up all the sand." }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "What episode does klaus appear in the vampire diaries?", "passages": [ [ "Klaus (The Vampire Diaries)", "Klaus (The Vampire Diaries)\n\n\"Klaus\" is the 19th episode of the second season of The CW television series, \"The Vampire Diaries\" and the 41st episode of the series overall.", "It originally aired on April 21, 2011.", "The episode was written by Kevin Williamson and Julie Plec and directed by Joshua Butler.", "Elijah (Daniel Gillies) wakes up in the Salvatore basement after Elena (Nina Dobrev) removes the dagger from his body.", "Elena tries to keep him quiet so Damon (Ian Somerhalder) and Stefan (Paul Wesley) will not hear him.", "Elijah needs to get out of the house since he is not invited in, and Elena, to convince him that he can trust her, hands him the dagger.", "Stefan wakes up the next morning and discovers that Elijah's body is gone while at the same time, Klaus needs his real body and asks Maddox (Gino Anthony Pesi) to take care of it.", "Stefan calls Elena to see if she is okay and asks her where Elijah is.", "Elena reassures him that she is fine and that Elijah is with her, asking Stefan to trust her and let her do what she thinks best.", "Stefan, even though he does not agree with her plan, agrees, making Damon unhappy.", "Elijah explains to Elena how he and Klaus met Katherine and that Klaus is his brother." ] ], "gold": "\"Klaus\" is the 19th episode of the second season of The CW television series, The Vampire Diaries and the 41st episode of the series overall. It originally aired on April 21, 2011. The episode was written by Kevin Williamson and Julie Plec and directed by Joshua Butler.", "prediction 1": "Klaus appears in the episode \"The Vampire Diaries: The Last Man on Earth\", which is the 19th episode of the second season of The CW television series, \"The Vampire Diaries.\"", "prediction 2": "Klaus is the character featured in the episode \"Klaus\", which is the 19th episode of Season 2 of The Vampire Diaries and the 41st episode of the series overall. Klaus appears in the episode \"Saul\" which was aired on April 21, 2011.", "prediction 3": "Klaus is a character in the second season of the television series The Vampire Diaries. He appears in the episode \"Klaus\", which was the 19th episode of the second season and the 41st episode of the series overall.", "prediction 4": "Klaus appears in the episode Klaus's Body, the 19th episode of Season 2 episode 5 of The Vampire Diaries and the 41st episode overall. Klaus is the brother of Elijah and the younger brother of Stefan. Klaus is the youngest brother of Stefan and the younger brother of Elijah.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Klaus\" is the 19th episode of the second season of The CW television series, The Vampire Diaries and the 41st episode of the series overall. It originally aired on April 21, 2011. The episode was written by Kevin Williamson and Julie Plec and directed by Joshua Butler." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "In which year there was a heavy landslide in nainital?", "passages": [ [ "Nainital", "The reason for this nomenclature by the locals was because there were minimal sun rays due to its location and dense forests) was being gradually planted and that the favourite sites were on the undulating tract of forest land which stretched back from the head of the lake to the base of China and Deopatta (Camel's Hump).", "The church, St. John(1846) in the Wilderness, was one of the earliest buildings in Nainital, followed by Belvedere, Alma lodge, Ashdale Cottage(1860)...\"", "Soon, the town became a health resort favoured by British soldiers and by colonial officials and their families trying to escape the heat of the plains.", "Later, the town became the summer residence of the governor of the United Provinces.", "In September 1882 a landslide ('the landslip of 1882') occurred at the north end of the town, burying 151 people.", "The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill, but \"the \"great slip\" occurred in the following year, on Saturday 18 September 1882.\"", "\"Two days preceding the slip there was heavy rain, ... to fell during the 40 hours ending on Saturday morning, and the downpour still lasted and continued for hours after the slip." ], [ "Nainital", "This heavy fall naturally brought down streams of water from the hill side, some endangering the Victoria Hotel, ... (which) was not the only building threatened ...", "Bell's shop, the Volunteer Orderly Room and the Hindu (Naina Devi) temple were scenes of labour with a view to diverting streams.", "At a quarter to two the landslip occurred burying those in and around the buildings mentioned above.\"", "The number of dead and missing were 108 Indian and 43 British nationals.", "(See poem by Hannah Battersby on the page Literary references to Nainital.)", "The Assembly Rooms and the Naina Devi Temple were destroyed in the disaster.", "A recreation area known as 'The Flats' was later built on the site and a new temple was erected.", "To prevent further disasters, storm water drains were constructed and building bylaws were made stricter.", "In the latter half of the 19th century a number of \"European\" schools for boys and girls were founded in Nainital.", "During the Victorian and Edwardian eras, students in these schools consisted largely of children of the British colonial officials or soldiers.", "The Diocesan Girls' High School, now known as All Saints' College, was established in 1869, near where the High Court of Uttarakhand stands today." ] ], "gold": "The first known heavy landslide in Nainital occurred in 1866. In 1879 there was a larger one at the same spot, Alma Hill. The greatest landslide in Nainital history occurred on 18 September 1880, on the slope that rises from the north of the flats ends at Alma peak. This landslide resulted in 151 people being buried under the debris. The number of dead and missing were 108 Indian and 43 Europeans, along with numerous people who narrowly escaped. Additionally, the Assembly Rooms and the Naina Devi Temple were destroyed in the disaster. Another heavy landslide occurred on 17 August 1898 outside the Nainital valley.", "prediction 1": "The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill, but \"the \"great slip\" occurred in the following year, on Saturday 18 September 1882.\" At a quarter to two the landslip occurred burying 151 people.", "prediction 2": "There was a heavy landslide in Nainital in 1882, buried 151 people. The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill. In September 1882 a landslide occurred at the north end of the town. The landslip occurred in the northern end of the town on Saturday 18 September 1882.", "prediction 3": "In September 1882, a landslide occurred at the north end of the town, burying 151 people. The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill, but \"the \"great slip\" occurred in the following year, on Saturday 18 September 1882.\"", "prediction 4": "In September 1882 a heavy landslide occurred in Nainital, Uttarakhand. The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill, but \"the \"great slip\" occurred in the following year, on Saturday 18 September 1882.\"", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The first known landslide had occurred in 1866, and in 1879 there was a larger one at the same spot, Alma Hill, but \"the \"great slip\" occurred in the following year, on Saturday 18 September 1882.\" At a quarter to two the landslip occurred burying 151 people. The number of dead and missing were 108 Indian and 43 British nationals. The Assembly Rooms and the Naina Devi Temple were destroyed in the disaster." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When does dragon ball super episode 95 come out?", "passages": [ [ "Dragon Ball", "\"Dragon Ball GT\" and \"Dragon Ball Heroes\" are not originated from any direct source material from Toriyama, being fully created by their respective animation studios.", "\"Dragon Ball Super\" was released parallel to (and many times ahead of) the manga of the same name, due to the fact that they were both based on the same outline by Toriyama for the story of \"Super\".", "Toei Animation produced an anime television series based on the first 194 manga chapters, also titled \"Dragon Ball\".", "The series premiered in Japan on Fuji Television on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes.", "Instead of continuing the anime as \"Dragon Ball\", Toei Animation decided to carry on with their adaptation under a new name and asked Akira Toriyama to come up with the title.", "picks up five years after the first series left off and adapts the final 325 chapters of the manga.", "It premiered in Japan on Fuji Television on April 26, 1989, taking over its predecessor's time slot, and ran for 291 episodes until its conclusion on January 31, 1996.", "Two television specials based on the \"Z\" series were aired on Fuji TV in Japan.", "The first, \"The One True Final Battle ~The Z Warrior Who Challenged Freeza -- Son Goku's Father~\", renamed \"\" by Funimation, was shown on October 17, 1990." ], [ "UFC 233", "UFC 233\n\nUFC 233 was a planned mixed martial arts event that was scheduled to be held by the Ultimate Fighting Championship on January 26, 2019 at Honda Center in Anaheim, California, United States.", "On December 12, 2018, the promotion announced that the event had been \"postponed\" and would be rescheduled for a later date.", "Initially, the promotion was planning a UFC Flyweight Championship bout between 2008 Olympic gold medalist in freestyle wrestling and current champion Henry Cejudo and current two-time UFC Bantamweight Champion T.J. Dillashaw to headline this event.", "If successful, Dillashaw will become the third man to be champion in two divisions simultaneously (after Conor McGregor at UFC 205 and Daniel Cormier at UFC 226).", "According to sources, the promotion is expected to dissolve the flyweight division at some point within 2019.", "However, on December 5, the pairing was moved and will take place a week earlier at UFC Fight Night 143, headlining the promotion's inaugural event on ESPN+.", "In turn, promotion officials tried to arrange a new pairing to anchor the event.", "However, the promotion announced plans in mid-December to postpone the event after they determined that they could not arrange a suitable headlining bout." ] ], "gold": "Dragon Ball Super is a Japanese anime television series produced by Toei Animation that began airing on July 5, 2015 on Fuji TV and is the first television series in the Dragon Ball franchise to feature a new story in 18 years. The Dragon Ball Super episode 95 came out in Japan June 18, 2017. The Dragon Ball Super episode 95 came out in the US on January 26, 2019.", "prediction 1": "Dragon Ball Super is a Japanese manga series that was released from 1996 to 2020. The anime television series was based on the manga and was released parallel to the manga of the same name. Episode 95 of the Dragon Ball Super anime came out on April 19, 2019 and was broadcast on Fuji Television in Japan on a limited broadcasting schedule.", "prediction 2": "Dragon Ball Super has a number of episodes. Episode 95 came out on December 5, 2019, the same date as the anime's finale.", "prediction 3": "Dragon Ball Super episode 95 came out on the air on March 6, 2015.", "prediction 4": "Dragon Ball Super is a Japanese manga series that was released from 1986 to 1996. Dragon Ball Super episode 95 was released on January 15, 1995.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 81 }, { "error type": "Unverifiable", "explanation": "", "start": 190, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 189 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "What do u mean by gram flour in kannada?", "passages": [ [ "Gram flour", "Gram flour\n\nGram flour or chickpea flour or besan (; ; ), is a pulse flour made from a variety of ground chickpea known as \"Bengal gram\".", "It is a staple ingredient in the cuisine of the Indian subcontinent, including in Indian, Bangladeshi, Burmese, Nepali, Pakistani and Sri Lankan cuisines.", "Gram flour can be made from either raw or roasted gram beans.", "The roasted variety is more flavourful, while the raw variety has a slightly bitter taste.", "Gram flour contains a high proportion of carbohydrates, higher fiber relative to other flours, no gluten, and a higher proportion of protein than other flours.", "Gram flour is in popular use in the Indian subcontinent, where it is used to make the following:\n", "In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura () and is eaten with Chapati or Puri, mostly during winter for breakfast.", "Chila (or chilla), a pancake made with gram flour batter, is a popular street food in India.", "Along the coast of the Ligurian Sea, flour made from garbanzo beans, which are a different variety of chickpea closely related to Bengal gram, is used to make a thin pancake that is baked in the oven." ] ], "gold": "Gram flour or besan is a pulse flour made from Bengal gram, a type of ground chickpea. This chickpea flour contains a high proportion of carbohydrates, higher fiber relative to other flours, no gluten, and a higher proportion of protein than other flours.", "prediction 1": "Gram flour is a pulse flour made from a variety of ground chickpea known as \"Bengal gram.\" In kannada, gram flour is called chickpea flour or besan. It is a staple ingredient in the cuisine of the Indian subcontinent, including in Indian, Bangladeshi, Burmese, Nepali, Pakistani and Sri Lankan cuisines. In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura and is eaten with Chapati or Puri, mostly during winter for breakfast.", "prediction 2": "Gram flour is a pulse flour made from a variety of ground chickpea known as \"Bengal gram\". It is a staple ingredient in the cuisine of the Indian subcontinent, including in Indian, Bangladeshi, Burmese, Nepali, Pakistani and Sri Lankan cuisines. It can be made from either raw or roasted gram beans. In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura (). In Kannada, gram flour pancakes made with gram flour batter, is a popular street food in India.", "prediction 3": "Gram flour, also known as chickpea flour or besan, is a pulse flour made from a variety of ground chickpea known as Bengal gram. It is a staple ingredient in the cuisine of the Indian subcontinent, including in Indian, Bangladeshi, Burmese, Nepali, Pakistani and Sri Lankan cuisines.", "prediction 4": "Gram flour, or chickpea flour or besan, is a pulse flour made from a variety of ground chickpea known as Bengal gram. It is a staple ingredient in the cuisine of the Indian subcontinent, including in Indian, Bangladeshi, Burmese, Nepali, Pakistani and Sri Lankan cuisines. In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura and is eaten with Chapati or Puri, mostly during winter for breakfast. In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura () and is eaten with Chapati or Puri, mostly during winter for breakfast. In Andhra Pradesh, it is used in a curry with gram flour cakes called Senaga Pindi Kura () and is eaten with Chapati or Puri,", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 303 }, { "error type": "Irrelevant", "explanation": "", "start": 304, "end": 462 }, { "error type": "Unverifiable", "explanation": "", "start": 91, "end": 148 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Gram flour is a pulse flour made from a variety of ground chickpea known as \"Bengal gram.\" Gram flour contains a high proportion of carbohydrates, higher fiber relative to other flours, no gluten, and a higher proportion of protein than other flours." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Where does vanilla come from in the world?", "passages": [ [ "Vanilla", "Portuguese sailors and explorers brought vanilla into Africa and Asia later that century.", "They called it \"vainilla\", or \"little pod\".", "The word vanilla entered the English language in 1754, when the botanist Philip Miller wrote about the genus in his \"Gardener\u2019s Dictionary\".", "\"Vainilla\" is from the diminutive of \"vaina\", from the Latin \"vagina\" (sheath) to describe the shape of the pods.", "The main species harvested for vanilla is \"V. planifolia\".", "Although it is native to Mexico, it is now widely grown throughout the tropics.", "Indonesia and Madagascar are the world's largest producers.", "Additional sources include \"V. pompona\" and \"V. tahitiensis\" (grown in Niue and Tahiti), although the vanillin content of these species is much less than \"V. planifolia\".", "Vanilla grows as a vine, climbing up an existing tree (also called a tutor), pole, or other support.", "It can be grown in a wood (on trees), in a plantation (on trees or poles), or in a \"shader\", in increasing orders of productivity.", "Its growth environment is referred to as its \"terroir\", and includes not only the adjacent plants, but also the climate, geography, and local geology." ], [ "Vanilla", "Vanilla\n\nVanilla is a flavoring derived from orchids of the genus \"Vanilla\", primarily from the Mexican species, flat-leaved vanilla (\"V.\u00a0planifolia\").", "The word \"vanilla\", derived from , the diminutive of the Spanish word ( itself meaning a sheath or a pod), is translated simply as \"little pod\".", "Pre-Columbian Mesoamerican people cultivated the vine of the vanilla orchid, called \"tlilxochitl\" by the Aztecs.", "Spanish conquistador Hern\u00e1n Cort\u00e9s is credited with introducing both vanilla and chocolate to Europe in the 1520s.", "Pollination is required to set the vanilla fruit from which the flavoring is derived.", "In 1837, Belgian botanist Charles Fran\u00e7ois Antoine Morren discovered this fact and pioneered a method of artificially pollinating the plant.", "The method proved financially unworkable and was not deployed commercially.", "In 1841, Edmond Albius, a slave who lived on the French island of R\u00e9union in the Indian Ocean, discovered at the age of 12 that the plant could be hand-pollinated.", "Hand-pollination allowed global cultivation of the plant.", "Three major species of vanilla currently are grown globally, all of which derive from a species originally found in Mesoamerica, including parts of modern-day Mexico.", "They are \"V. planifolia\" (syn." ], [ "Haiti", "Haiti\n\nHaiti (; ; ), officially the Republic of Haiti (; ) and formerly called Hayti, is a country located on the island of Hispaniola, east of Cuba in the Greater Antilles archipelago of the Caribbean Sea.", "It occupies the western three-eighths of the island, which it shares with the Dominican Republic.", "Haiti is in size and has an estimated /1e6 round 1 million people, making it the most populous country in the Caribbean Community (CARICOM) and the second-most populous country in the Caribbean as a whole.", "The region was originally inhabited by the indigenous Ta\u00edno people.", "Spain landed on the island on 5 December 1492 during the first voyage of Christopher Columbus across the Atlantic.", "When Columbus initially landed in Haiti, he had thought he had found India or China.", "On Christmas Day 1492, Columbus' flagship the \"Santa Maria\" ran aground north of what is now Limonade.", "As a consequence, Columbus ordered his men to salvage what they could from the ship, and he created the first European settlement in the Americas, naming it La Navidad after the day the ship was destroyed.", "The island was named \"La Espa\u00f1ola\" and claimed by Spain, which ruled until the early 17th century.", "Competing claims and settlements by the French led to the western portion of the island being ceded to France, which named it \"Saint-Domingue\"." ] ], "gold": "Vanilla is a spice derived from orchids of the genus Vanilla, primarily obtained from pods of the Mexican species, flat-leaved vanilla (V. planifolia). Although it is native to Mexico, it is now widely grown throughout the tropics. Indonesia and Madagascar are the world's largest producers. The third largest vanilla producer in the world is China.", "prediction 1": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla, which is native to Mexico. It is also grown in other parts of the world, including Indonesia and Madagascar, and Haiti. Three major species of vanilla currently are grown globally, all of which derive from a species originally found in Mesoamerica, including parts of modern-day Mexico. The main species harvested for vanilla is V. planifolia, although it is native to Mexico, but it is now widely grown throughout the tropics, including Indonesia and Madagascar, Indonesia and Madagascar are the world's largest producers. Additional sources include V. pompona and V. tahitiensis, grown in Niue and Tahiti.", "prediction 2": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla. Although it is native to Mexico, it is now widely grown throughout the tropics. Indonesia and Madagascar are the world's largest producers of vanilla. The three major species of vanilla currently are grown globally, all of which derive from a species originally found in Mesoamerica, including parts of modern-day Mexico. They are V. planifolia, V. pompona, and V. tahitiensis, which are grown in Niue and Tahiti.", "prediction 3": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla, known as V. planifolia. Although it is native to Mexico, it is now widely grown throughout the tropics, with Indonesia and Madagascar being the world's largest producers. The word vanilla originated from Portuguese sailors and explorers, who called it \"vainilla\", or \"little pod\".", "prediction 4": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla. Although it is native to Mexico, it is now widely grown throughout the tropics. Indonesia and Madagascar are the world's largest producers of vanilla. There are three major species of vanilla currently are grown globally, all of which derive from a species originally found in Mesoamerica, including parts of modern-day Mexico. They are V. planifolia, V. pompona, and V. tahitiensisis. pompona, V. tahitiensis, V. ta, V. tahitiensis", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla, which is native to Mexico.", "start": 410, "end": 499 }, { "error type": "Redundant", "explanation": "Vanilla is a flavoring derived from orchids of the genus Vanilla, primarily from the Mexican species, flat-leaved vanilla, which is native to Mexico. It is also grown in other parts of the world, including Indonesia and Madagascar,", "start": 500, "end": 586 } ], "missing-info": [], "corrected-prediction": "Vanilla is a flavoring derived from orchids of the genus Vanilla. The main species harvested for vanilla is flat-leaved vanilla, V. planifolia, although it is native to Mexico, but it is now widely grown throughout the tropics, including Indonesia and Madagascar, and Haiti. Indonesia and Madagascar are the world's largest producers. Three major species of vanilla currently are grown globally, all of which derive from a species originally found in Mesoamerica, including parts of modern-day Mexico. Additional sources include V. pompona and V. tahitiensis, grown in Niue and Tahiti." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who is the actor that plays professor snape?", "passages": [ [ "Severus Snape", "Snape then reveals that he, together with the fugitive Ron and Hermione Granger, maintain the last remnants of Dumbledore's Army \u2013 still waging hopeless resistance against the all-powerful Voldemort.", "In talking with Scorpius, Snape had learned that Harry would name his son \"Albus Severus\" and would regard Snape as \"probably the bravest man I ever knew\" \u2013 and is deeply moved.", "Though having guessed that in the other timeline he would die, Snape nevertheless willingly helps Scorpius recreate this timeline \u2013 and being discovered by Dementors, Snape sacrifices himself in order to cover Scorpius' escape.", "Severus Snape appears in all eight \"Harry Potter\" films, portrayed by British actor Alan Rickman.", "Rickman was Rowling's personal choice to portray the character.", "He had conversations with Rowling about his character and is one of the few \"Harry Potter\" actors that she spoke to prior to the completion of the book series about the future direction of the character.", "\"He knew very early on that he'd been in love with Lily,\" said Rowling.", "\"He needed to understand [\u2026] where this bitterness towards this boy who's the living example of her preference for another man came from.\"" ], [ "Severus Snape", "\"Entertainment Weekly\" listed Rickman as one of the most popular movie stars in 2007 for his performance as Snape, saying: \"As the icy, humourless magic instructor Severus Snape, Rickman may not be on screen long\u2014but he owns every minute.\"", "Rickman also noted fans' reactions; in an interview, he said he found \"that people in general adore Snape.", "He is sarcastic, stubborn, etc, etc.", "But he is also fascinating.", "I have a lot of fun impersonating him.\"", "Rickman was nominated for several awards for his portrayal of Snape, and in 2011, was elected the best character portrayal in all the \"Harry Potter\" films series.", "In 2011, \"Empire\" magazine published an open letter from Rickman to J.K. Rowling, ruminating on the ten years of working on the Potter films and thanking her for telling the story.", "In \"Harry Potter and the Order of the Phoenix\", the fifteen-year-old Snape (portrayed by Alec Hopkins) makes a brief appearance in a flashback to Snape\u2019s youth.", "In the final film, \"Harry Potter and the Deathly Hallows \u2013 Part 2\", the younger Snape, perhaps ten or eleven, is played by Benedict Clarke." ] ], "gold": "Severus Snape appears in all eight \"Harry Potter\" films, portrayed by British actor Alan Rickman. Rickman was Rowling's personal choice to portray the character. Benedict Clarke played Severus Snape as a child, and Alec Hopkins played him as a teenager.", "prediction 1": "Severus Snape is portrayed by Alan Rickman, who was chosen by J. K. Rowling to play the character. In Harry Potter films, he is played by Alec Hopkins, Benedict Clarke, and John Hurt.", "prediction 2": "Severus Snape appears in all eight Harry Potter films, portrayed by British actor Alan Rickman. In the Harry Potter films, he is played by Alec Hopkins, Benedict Clarke and Benedict Bartlett.", "prediction 3": "Severus Snape appears in all eight Harry Potter films, portrayed by British actor Alan Rickman. In the Harry Potter films, Alec Hopkins plays the older Snape, while Benedict Clarke plays the younger Snape, perhaps ten or eleven.", "prediction 4": "Alan Rickman plays the character Severus Snape. The character is portrayed in the Harry Potter films by Alan Rickman. The Harry Potter films' younger version of Snape, who is aged 12 to 15, is played by Alec Hopkins. The younger version of Snape, which is a ten or eleven-year-old, is played by Benedict Clarke.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 169, "end": 183 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Severus Snape appears in all eight \"Harry Potter\" films, portrayed by British actor Alan Rickman, who was chosen by J. K. Rowling to play the character. In Harry Potter films, Benedict Clarke played Severus Snape as a child, and Alec Hopkins played him as a teenager." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who is the person that cuts up dead bodies?", "passages": [ [ "Autopsy", "Autopsy\n\nAn autopsy (post-mortem examination, obduction, necropsy, or autopsia cadaverum) is a surgical procedure that consists of a thorough examination of a corpse by dissection to determine the cause and manner of death or to evaluate any disease or injury that may be present for research or educational purposes.", "(The term \"necropsy\" is generally reserved for non-human animals; see below).", "Autopsies are usually performed by a specialized medical doctor called a pathologist.", "In most cases, a medical examiner or coroner can determine cause of death and only a small portion of deaths require an autopsy.", "Autopsies are performed for either legal or medical purposes.", "For example, a forensic autopsy is carried out when the cause of death may be a criminal matter, while a clinical or academic autopsy is performed to find the medical cause of death and is used in cases of unknown or uncertain death, or for research purposes.", "Autopsies can be further classified into cases where external examination suffices, and those where the body is dissected and internal examination is conducted.", "Permission from next of kin may be required for internal autopsy in some cases.", "Once an internal autopsy is complete the body is reconstituted by sewing it back together." ], [ "Cadaver", "Cadaver\n\nA cadaver is a dead human body that is used by physicians and other scientists to study anatomy, identify disease sites, determine causes of death, and provide tissue to repair a defect in a living human being.", "Students in medical school study and dissect cadavers as a part of their education.", "Others who study cadavers include archaeologists and artists.", "The term cadaver is used in courts of law to refer to a dead body, as well as recovery teams searching for bodies in natural disasters.", "The word \u201cCadaver\u201d comes from the Latin word \u201ccadere\u201d (to fall).", "Related terms include \u201ccadaverous\u201d (resembling a cadaver) and \u201ccadaveric spasm\u201d (a muscle spasm causing a dead body to twitch or jerk).", "A \u201ccadaver graft\u201d (also called \u201cpostmortem graft\u201d) refers to the grafting of tissue from a dead body onto a living human to repair a defect or disfigurement.", "Cadavers can be observed for their stages of decomposition, helping to determine how long a body has been dead.", "Cadavers have been used in art as well to more accurately depict the human body in paintings and drawings.", "Observation of the various stages of decomposition can help determine how long a body has been dead.", "The rate of decomposition depends on many factors including temperature and the environment." ], [ "Cadaver", "Autopsies also can provide information on how certain drugs or procedures have been effective within the cadaver and how humans respond to certain injuries.", "Appendectomies, the removal of the appendix, are performed 28,000 times a year in the United States and are still practiced on human cadavers and not with technology simulations.", "Gross anatomy, a common course in medical school studying the visual structures of the body, gives students the opportunity to have a hands-on learning environment.", "The need for cadavers has also grown outside of academic programs for research.", "Organizations like Science Care and the Anatomy Gifts Registry help send bodies where they are needed most.", "For a cadaver to be viable and ideal for anatomical study and dissection, the body must be refrigerated or the preservation process must begin within 24 hours of death.", "This preservation may be accomplished by embalming using a mixture of embalming fluids, or with a relatively new method called plastination.", "Both methods have advantages and disadvantages in regards to preparing bodies for anatomical dissection in the educational setting.", "The practice of embalming via chemical fluids has been used for centuries.", "The main objectives of this form of preservation are to keep the body from decomposing, help the tissues retain their color and softness, prevent both biological and environmental hazards, and preserve the anatomical structures in their natural forms." ] ], "gold": "Autopsies, used to determine cause and manner of death, are usually performed by a specialized medical doctor called a pathologist. Medical students, physicians and other scientists may also dissect dead bodies, referred to as cadavers, in research and educational contexts. Appendectomies, for example, are still practiced on human cadavers and not with technology simulations.", "prediction 1": "A cadaver is a dead human body that is used by physicians and other scientists to study anatomy, identify disease sites, determine causes of death, and provide tissue to repair a defect in a living human being. Students in medical school study and dissect cadavers as a part of their education. Others who study cadavers include archaeologists and artists.\n", "prediction 2": "In forensic medicine, a medical examiner or coroner can determine the cause of death and only a small portion of deaths require an autopsy. When a medical examiner or coroner is consulted, he or she will either cut up a body or perform an autopsy.", "prediction 3": "Surgical dissection is the continuing dissection of a dead body by a doctor throughout the lifespan, whether for medical, scientific or legal purposes. For example, a coroner may perform an autopsy if there is no family, friend or relative to perform the dissection. Frequently, a coroner may draw the conclusions for the autopsy by deciding whether the body was flush with chemicals or if it was covered in blood.", "prediction 4": "In the United States, several people cut up dead bodies. The person who does this is a physician, often a pathologist or medical examiner. Other people who do this include archaeologists and artists.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 357 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "An autopsy is a surgical procedure that consists of a thorough examination of a corpse by dissection to determine the cause and manner of death or to evaluate any disease or injury that may be present for research or educational purposes. Autopsies are usually performed by a specialized medical doctor called a pathologist. A cadaver is a dead human body that is used by physicians and other scientists to study anatomy, identify disease sites, determine causes of death, and provide tissue to repair a defect in a living human being. Students in medical school study and dissect cadavers as a part of their education. Appendectomies, for example, are still practiced on human cadavers and not with technology simulations." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most assist in the nba?", "passages": [ [ "Scott Skiles", "Scott Skiles\n\nScott Allen Skiles Sr. (born March 5, 1964) is an American basketball coach and former player.", "He most recently served as the head coach of the Orlando Magic.", "He also coached the Phoenix Suns, Chicago Bulls, and Milwaukee Bucks.", "A first-round draft pick out of Michigan State University, Skiles played ten seasons as a point guard in the NBA.", "He holds the NBA record for assists in one game with 30, set in his fifth season in the league and second with Orlando, in which he also earned the 1990\u201391 NBA Most Improved Player Award.", "In 1982, Skiles led Plymouth High School to the Indiana State Championship, scoring 39 points to lead the Pilgrims past the Gary Roosevelt Panthers in double overtime.", "During the 1982 season Skiles led the state in scoring, averaging 30.2 points per game.", "He set several records during high school, including most points in a home game (53) and most points in an away game (56).", "He left Plymouth as the school's all-time career scoring leader (1,788 points), a record that would stand until 2005.", "Skiles had his number 22 jersey retired at Plymouth High School in 1992.", "Skiles attended Michigan State University, where in his senior season he was a First Team All-America selection as well as the Big Ten Conference MVP and scoring champion." ], [ "John Stockton", "Stockton would later declare that despite being still content with the game and how well he was playing, his growing family made him feel that \"sitting in the hotel room waiting for games wasn't making up for what I was missing at home.\"", "His number 12 jersey was retired by the Jazz during a game on November 22, 2004.", "A statue of Stockton can be seen in front of the Vivint Smart Home Arena; an accompanying statue of Karl Malone was placed nearby on March 23, 2006.", "The Malone and Stockton statues stand on a bronze plaque commemorating their achievements together.", "Stockton was announced as a member of the 2009 class of inductees to the Naismith Memorial Basketball Hall of Fame on April 6, 2009; he was formally inducted on September 11.", "Stockton chose 2000 inductee and fellow point guard Isiah Thomas to present him at the induction ceremony.", "Stockton has also been inducted into the Naismith Memorial Basketball Hall of Fame along with the rest of the 1992 United States men's Olympic basketball team in 2010.", "Along with his teammate Karl Malone, Stockton is considered one of the best players who never won an NBA championship.", "Stockton, a 10-time NBA All-Star, holds a commanding lead for the NBA record for career assists with 15,806 (10.5 per game)." ], [ "John Stockton", "Stockton also holds the record for assists-per-game average over one season (14.5 in 1990) and is one of three players who have logged more than 1,000 assists in one season, joining Kevin Porter (1,099 in 1979) and Isiah Thomas (1,123 in 1985) in the exclusive list.", "Stockton did this seven times, with season totals of 1,164, 1,134, 1,128, 1,126, 1,118, 1,031 and 1,011 assists.", "He and Karl Malone are regarded by many as the quintessential pick and roll duo.", "Apart from his passing skill, Stockton was also a capable scorer (13.1 points per game career average and a 51.5 career shooting percentage) with a reliable three-point shot (38.4% lifetime average).", "He is 41st on the all-time NBA scoring list with 19,711 career points.", "Despite the fact that he had never pulled down more than 9 rebounds (or recorded more than 9 steals) during a regular season game, he finally recorded his first career triple double, at age 39, in a playoff game against the Dallas Mavericks on April 28, 2001.", "He scored 12 points, pulled down 11 rebounds and had 10 assists.", "On defense, Stockton holds the NBA record for career steals with 3,265." ] ], "gold": "Scott Skiles holds the NBA record for most assists in one game with 30. John Stockton holds the NBA record for most career assists with 15,806. Stockton also holds the record for assists-per-game average over one season and is one of three players who have logged more than 1,000 assists in one season.", "prediction 1": "In the NBA, Scott Skiles has the most assists in one game, while the most assists in a season is a player's average assist over a season. John Stockton has the most assists in a season, with 15,806 over his career. Scott Skiles, a first-round draft pick out of Michigan State University, holds the most assists in a game, with 30, set in his fifth season in the league and second with Orlando.", "prediction 2": "It is unknown who has the most assists in a season in the NBA, but it is possible to tie the record for most assists in a game with 30, set by Scott Skiles in his fifth season in the league and second with Orlando. John Stockton has the most assists in a career with 15,806 from 1991-2000, while Scott Skiles holds the record for most assists in a game with 30 from 1989-90.", "prediction 3": "The player with the most career assists in the NBA is Scott Skiles, who holds the record for assists in one game with 30, set in his fifth season in the league and second with Orlando. John Stockton holds the record for assists-per-game average over one season, with 1,031 and 1,011 assists, respectively.", "prediction 4": "Scott Skiles holds the record for most assists in one game in the league with 30. John Stockton holds the record for most assists in a single season in the NBA with 1,011. Scott Skiles set the record in 1990. Isiah Thomas holds the record for the most assists in a single game in the NBA with 123.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 12, "end": 58 }, { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 137 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 160, "end": 214 }, { "error type": "Unverifiable", "explanation": "", "start": 215, "end": 393 } ], "missing-info": [], "corrected-prediction": "In the NBA, has the most assists in one game, while the most assists in a season is a player's average assist over a season. John Stockton holds the record for assists-per-game average over one season (14.5 in 1990) and is one of three players who have logged more than 1,000 assists in one season." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the woman who does the progressive commercials?", "passages": [ [ "Flo (Progressive)", "Flo (Progressive)\n\n", "Flo is a fictional salesperson character appearing in more than 100 commercials for Progressive Corporation, beginning in 2008.", "Portrayed by actress and comedian Stephanie Courtney, the character has developed a fan base on social networks and has become an iconic advertising mascot.", "The character debuted in 2008 through several television commercials and has since appeared in radio and print advertisements and web banners.", "\"Flo\", an upbeat store employee for Progressive Corporation, was created by the Boston-based agency Arnold Worldwide, specifically copywriter John Park and art director Steve Reepmeyer.", "Some have noticed that FLO has some resemblance in style and appearance to Chrissy Hynde of the Pretenders, especially when she sings, \"Stand by You\"- one of Chrissy's songs.", "In 2011, Progressive introduced an Australian counterpart to Flo, named Kitty, played by Australian actress Holly Austin.", "As of November 2014, Flo had appeared in 100 commercials.", "Flo is a cashier and is recognizable by her extreme enthusiasm, name tag, sparkling white no-wrinkles uniform, upbeat personality, heavy makeup, and retro hairstyle.", "According to Courtney, it takes one hour to prepare Flo's hair and another to apply her make-up." ], [ "Stephanie Courtney", "Stephanie Courtney\n\nStephanie Courtney (born February 8, 1970) is an American actress and comedian, best known for playing the advertising character Flo in television and radio commercials for Progressive Corporation beginning in 2008, and noted for her recurring roles on several television series, including the voices of Renee the Receptionist and Joy Peters on the Adult Swim comedy \"Tom Goes to the Mayor\" (2004\u201306), Marge on the AMC drama \"Mad Men\" (2007); and Diane on the ABC comedy \"Cavemen\" (2007).", "She also appeared in the season 2 premiere of \"Men of a Certain Age\".", "She also played in \"The Goldbergs\".", "Courtney was a member of The Groundlings, an improvisational and sketch comedy theater in Los Angeles, California.", "Courtney was born in Stony Point, Rockland County, New York the youngest of three children of a high school history teacher father and a singer mother.", "In 1992 she graduated from Binghamton University with a degree in English, where she had played Elizabeth Proctor in \"The Crucible\".", "By then, she said, \"I was never tortured over whether I wanted to become an actress.", "There was never another option in my mind.\"", "After graduation, she moved to New York City, where her roommate was future author and columnist Meghan Daum." ] ], "gold": "Flo is a fictional salesperson character appearing in more than 100 advertisements for Progressive Insurance since 2008. Portrayed by actress and comedian Stephanie Courtney, the character has developed a fan base on social networks and has become an iconic advertising mascot.", "prediction 1": "The character Flo, an upbeat store employee for Progressive Corporation, was created by the Boston-based agency Arnold Worldwide, specifically copywriter John Park and art director Steve Reepmeyer. American actress and comedian Stephanie Courtney played Flo in the first 100 commercials for Progressive Corporation. In 2011, Progressive introduced an Australian counterpart to Flo, named Kitty, played by Australian actress Holly Austin.", "prediction 2": "The character Flo, a fictional salesperson for Progressive Corporation, has been portrayed by actress Stephanie Courtney since 2008. Progressive also has a counterpart character, Kitty, played by Australian actress Holly Austin.", "prediction 3": "Flo is a fictional salesperson character appearing in more than 100 commercials for Progressive Corporation, beginning in 2008. Portrayed by actress and comedian Stephanie Courtney, the character has developed a fan base on social networks and has become an iconic advertising mascot. In 2011, Progressive introduced an Australian counterpart to Flo, named Kitty, played by Australian actress Holly Austin. As of November 2014, Flo had appeared in 100 commercials.", "prediction 4": "Stephanie Courtney is an American actress and comedian best known for playing the advertising character Flo in television and radio commercials for Progressive Corporation, beginning in 2008.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 197 }, { "error type": "Unverifiable", "explanation": "", "start": 258, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 315 }, { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 437 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Flo is a fictional salesperson character appearing in more than 100 commercials for Progressive Corporation, beginning in 2008. Portrayed by actress and comedian Stephanie Courtney, the character has developed a fan base on social networks and has become an iconic advertising mascot." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who won the 2017 so you think you can dance?", "passages": [ [ "So You Think You Can Dance", "So You Think You Can Dance\n\n", "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance.", "The first series of the franchise, created by \"Idols\" producers Simon Fuller and Nigel Lythgoe, premiered in July 2005 and has broadcast fifteen seasons since.", "Adaptations of the show began airing in other countries in late 2005 and to date 28 localized adaptations have been produced, representing 39 different countries and comprising more than ninety individual seasons.", "Although each varies in the particulars of its format and presentation, all shows in the \"So You Think You Can Dance\" franchise share a premise of placing dancers\u2014who come from a wide variety of dance backgrounds and are often, but not exclusively, amateur or semi-professional in experience\u2014in a competition which requires them to adapt to multiple styles of dance.", "As the competition progresses, a combination of judge decisions and at-home-viewer votes determine which dancers will advance in the competition from week to week, until ultimately one dancer is voted champion of that particular season and receives a prize package that may consist of money, work or training opportunities, additional material prizes and typically the title of the respective country's \"Favorite Dancer\" (i.e. \"America's Favorite Dancer\")." ] ], "gold": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. Adaptations of the show began airing in other countries in late 2005 and to date 30 localized adaptations have been produced, representing 41 different countries and comprising more than ninety individual seasons. In 2017, Lex Ishimoto won the American version of the show, while Elena Tsikitikou won the Greek version of the show.", "prediction 1": "So You Think You Can Dance is a reality television show in which contestants compete in dance. In the 2017 season, American dancer Ashley Judd won the competition and in the 2016 season, American dancer Taylor Hill won the competition. In the 2017 season, American dancer Madison Judd won the competition and in the 2017 season, American dancer Alexis Smith won the competition and in the 2017 season, American dancer Taylor Hill won the competition.", "prediction 2": "So You Think You Can Dance is a franchise of reality television shows on which contestants compete in dance. Season 11 saw the return of the show's champion, Jessica Ponce, with a win over fellow contestant, Alyssa Milano, who won the 2017 season. The 2017 season also saw the return of the contestant, Michael Jackson, who won the season.", "prediction 3": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. The 2017 season had 7 contestants in total, including: Christina Milian, Alexa Radcliffe, Javier Ramirez, and Jesse James. The winner of the 2016 season was Alicia Keys.", "prediction 4": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. The 2017 season featured the final dance of the season \"America's Favorite Dancer,\" with dancers Nicolette Brown and Sarah Reilly becoming the first two runner-ups of the season.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 95, "end": 235 }, { "error type": "Unverifiable", "explanation": "", "start": 236, "end": 450 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "So You Think You Can Dance is a reality television show in which contestants compete in dance. Adaptations of the show began airing in other countries in late 2005 and to date 28 localized adaptations have been produced, representing 39 different countries and comprising more than ninety individual seasons." }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "What type of cell is a stomach cell?", "passages": [ [ "Gastric glands", "Cells found in the gastric glands include foveolar cells, chief cells, parietal cells, G cells and enterochromaffin-like cells (ECLs).", "The first cells of all of the glands are foveolar cells in the neck region\u2013also called \"mucous neck cells\" that produce mucus.", "This is thought to be different from the mucus produced by the gastric mucosa.", "Fundic glands found in the fundus and also in the body have another two cell types\u2013gastric chief cells and parietal cells (oxyntic)).", "The chief cells are found in the basal regions of the gland and release a zymogen \u2013 pepsinogen, a precursor to pepsin.", "The parietal cells (\"parietal\" means \"relating to a wall\") are found in the walls of the tubes.", "The parietal cells secrete hydrochloric acid\u2013the main component of gastric acid.", "This needs to be readily available for the stomach in a plentiful supply, and so from their positions in the walls, their secretory networks of fine channels called canaliculi can project and ingress into all the regions of the gastric-pit lumen.", "Another important secretion of the parietal cells is intrinsic factor." ], [ "Parietal cell", "Parietal cell\n\nParietal cells (also known as oxyntic or delomorphous cells) are the epithelial cells that secrete hydrochloric acid (HCl) and intrinsic factor.", "These cells are located in the gastric glands found in the lining of the fundus and in the cardia of the stomach.", "They contain an extensive secretory network (called canaliculi) from which the HCl is secreted by active transport into the stomach.", "The enzyme hydrogen potassium ATPase (H/K ATPase) is unique to the parietal cells and transports the H against a concentration gradient of about 3 million to 1, which is the steepest ion gradient formed in the human body.", "Parietal cells are primarily regulated via histamine, acetylcholine and gastrin signaling from both central and local modulators (\"see 'Regulation')\".", "A canaliculus is an adaptation found on gastric parietal cells.", "It is a deep infolding, or little channel, which serves to increase the surface area, e.g. for secretion.", "The parietal cell membrane is dynamic; the numbers of canaliculi rise and fall according to secretory need." ], [ "Gastric chief cell", "Gastric chief cell\n\nA gastric chief cell (or peptic cell, or gastric zymogenic cell) is a type of cell in the stomach that releases pepsinogen and gastric lipase and is the cell responsible for secretion of chymosin in ruminants.", "The cell stains basophilic upon H&E staining due to the large proportion of rough endoplasmic reticulum in its cytoplasm.", "Gastric chief cells are generally located deep in the mucosal layer of the stomach lining.", "Chief cells release the zymogen (enzyme precursor) pepsinogen when stimulated by a variety of factors including cholinergic activity from the vagus nerve and acidic condition in the stomach.", "Gastrin and secretin may also act as secretagogues.", "It works in conjunction with the parietal cell, which releases gastric acid, converting the pepsinogen into pepsin.", "The terms \"chief cell\" and \"zymogenic cell\" are often used without the word \"gastric\" to name this type of cell.", "However those terms can also be used to describe other cell types (for example, parathyroid chief cells).", "Chief cells are also known as peptic cells." ] ], "gold": "There are four types of stomach cells, parietal cells, gastric chief cells, mucous cells and enteroendocrine cells. Parietal cells which are also known as oxyntic cells are epithelial cells in the stomach that secrete hydrochloric acid and intrinsic factor. These cells are located in the gastric glands found in the lining of the fundus and body regions of the stomach. Another type of stomach cell, the gastric chief cell which is also known as a peptic cell or gastric zymogenic cell, is a type of gastric gland cell that releases pepsinogen and gastric lipase and is the cell responsible for secretion of chymosin in ruminants. Gastric chief cells are generally located deep in the mucosal layer of the stomach lining. Another type of stomach cell, foveolar cells or surface mucous cells are mucus-producing cells which cover the inside of the stomach, protecting it from the corrosive nature of gastric acid. These cells line the gastric mucosa. Another type of stomach cell, enteroendocrine cells are specialized cells of the gastrointestinal tract and pancreas with endocrine function. Enteroendocrine cells are located in the stomach, in the intestine and in the pancreas. ", "prediction 1": "A stomach cell is a type of cell in the stomach that releases pepsinogen and gastric lipase, and is responsible for secretion of chymosin in ruminants. Chief cells are generally located deep in the mucosal layer of the stomach lining. A gastric zymogenic cell is a type of cell in the stomach that releases pepsinogen and gastric lipase, and is the cell responsible for secretion of chymosin in ruminants.", "prediction 2": "A stomach cell is a cell type found in the gastric lining and lining of the stomach, and a gastric chief cell is a type of cell in the stomach that releases pepsinogen and gastric lipase. The parietal cell, also known as oxyntic or delomorphous cells, is the epithelial cell that secretes hydrochloric acid and intrinsic factor.", "prediction 3": "Several types of stomach cells exist, including gastric chief cells, peptic cells, parietal cells, oxyntic cells, and delomorphous cells. These cells are epithelial cells that secrete hydrochloric acid (HCl) and intrinsic factor. Gastric chief cells, or peptic cells, are a type of cell in the stomach that releases pepsinogen and gastric lipase and is the cell responsible for secretion of chymosin in ruminants.", "prediction 4": "The stomach has several different cell types. The head cell is a type of cell in the stomach that releases pepsinogen and gastric lipase. The parietal cell is a type of cell in the stomach that secretes hydrochloric acid (HCl) and intrinsic factor.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "A stomach cell is a type of cell in the stomach that releases pepsinogen and gastric lipase, and is responsible for secretion of chymosin in ruminants. ", "start": 235, "end": 405 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Cells found in the gastric glands include foveolar cells, chief cells, parietal cells, G cells and enterochromaffin-like cells (ECLs)Parietal cells which are also known as oxyntic cells are epithelial cells in the stomach that secrete hydrochloric acid and intrinsic factor. These cells are located in the gastric glands found in the lining of the fundus and body regions of the stomach. A stomach cell is a type of cell in the stomach that releases pepsinogen and gastric lipase, and is responsible for secretion of chymosin in ruminants. Chief cells are generally located deep in the mucosal layer of the stomach lining. " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Where is the new tv series yellowstone filmed?", "passages": [ [ "Yellowstone (U.S. TV series)", "Principal photography for the series began in August 2017 at the Chief Joseph Ranch in Darby, Montana, which stands in as the home of John Dutton.", "Filming also took place that month near Park City, Utah.", "The production used all three soundstages at the Utah Film Studio in Park City, which is a total of 45,000 square feet.", "The building also houses offices, editing, a huge wardrobe department and construction shops.", "By November 2017, the series had filmed in more than twenty locations in Utah, including the Salt Flats and Spanish Fork.", "Additionally, filming also took place at various locations in Montana.", "Production was reportedly set to last until December 2017.", "The series' score was composed by Brian Tyler who worked with musicians from the London Philharmonia Orchestra and viola, cello, and violin soloists.", "On August 17, 2018, the soundtrack for the first season was released by Sony Music.", "On February 28, 2018, a teaser trailer for the series was released.", "On April 26, 2018, the first full trailer was released.", "On June 25, 2018, the series held a screening at Seriesfest, an annual international television festival, at the Red Rocks Amphitheatre in Denver, Colorado.", "The first season is scheduled to be released on Blu-ray and DVD on December 4, 2018.", "The series was met with a mixed response from critics upon its premiere." ], [ "Yellowstone (U.S. TV series)", "Yellowstone (U.S. TV series)\n\nYellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network.", "It stars Kevin Costner, Wes Bentley, Kelly Reilly, Luke Grimes, Cole Hauser and Gil Birmingham.", "The series follows the conflicts along the shared borders of a large cattle ranch, an Indian reservation, land developers and Yellowstone National Park.", "On July 24, 2018, it was announced that Paramount Network had renewed the series for a second season to air in 2019.", "\"Yellowstone\" follows \"the Dutton family, led by John Dutton, who controls the largest contiguous ranch in the United States, under constant attack by those it borders\u2014land developers, an Indian reservation, and America's first National Park.", "It is an intense study of a violent world far from media scrutiny\u2014where land grabs make developers billions, and politicians are bought and sold by the world's largest oil and lumber corporations.", "Where drinking water poisoned by fracking wells and unsolved murders are not news: they are a consequence of living in the new frontier.", "It is the best and worst of America seen through the eyes of a family that represents both.\"", "In 2013, Taylor Sheridan began work on the series, having recently grown tired of acting and begun writing screenplays." ] ], "gold": "Yellowstone is an American drama television series that premiered on June 20, 2018, on the Paramount Network. The series follows the conflicts along the shared borders of a large cattle ranch, a Native reservation, and land developers. Filming took place in Montana, and Chief Joseph Ranch, Salt Flats, Promontory Club, and Spanish Fork in Utah. The production used all three soundstages at the Utah Film Studios in Park City.", "prediction 1": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network. Principal photography for the series began in August 2017 at the Chief Joseph Ranch in Darby, Montana, which stands in as the home of John Dutton. Filming also took place that month near Park City, Utah. The series used all three soundstages at the Utah Film Studio in Park City, which is a total of 45,000 square feet.", "prediction 2": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network. Principal photography for the series began in August 2017 at the Chief Joseph Ranch in Darby, Montana, which stands in as the home of John Dutton. Filming also took place that month near Park City, Utah. The series had filmed in more than twenty locations in Utah, including the Salt Flats and Spanish Fork. Furthermore, filming also took place at various locations in Montana.", "prediction 3": "The new tv series Yellowstone is filmed mostly in Utah, with a few additional locations in Montana. Principal photography for the series began in August 2017 at the Chief Joseph Ranch in Darby, Montana, which stands in as the home of John Dutton. Furthermore, filming also took place that month near Park City, Utah.", "prediction 4": "The new tv series Yellowstone is filmed in a variety of locations, including the Salt Flats, Spanish Fork, and various locations in Montana. Principal photography for the series began in August 2017 at the Chief Joseph Ranch in Darby, Montana, which stands in as the home of John Dutton. Filming also took place that month near Park City, Utah.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 467 }, { "error type": "Irrelevant", "explanation": "", "start": 191, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 294 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Yellowstone is an American drama television series that premiered on June 20, 2018 on Paramount Network. The series follows the conflicts along the shared borders of a large cattle ranch, an Indian reservation, land developers. Principal photography for the series began at the Chief Joseph Ranch in Darby, Montana. Filming also took place that month near Park City, Utah. The series used all three soundstages at the Utah Film Studio in Park City." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "How many points did michael jordan make in his career?", "passages": [ [ "Michael Jordan", "By 1998, the season of his Finals-winning shot against the Jazz, he was well known throughout the league as a clutch performer.", "In the regular season, Jordan was the Bulls' primary threat in the final seconds of a close game and in the playoffs; he would always ask for the ball at crunch time.", "Jordan's total of 5,987 points in the playoffs is the second-highest in NBA history.", "He retired with 32,292 points in regular season play, placing him fourth on the NBA's all-time scoring list behind Kareem Abdul-Jabbar, Karl Malone, and Kobe Bryant.", "With five regular-season MVPs (tied for second place with Bill Russell\u2014only Kareem Abdul-Jabbar has won more, with six), six Finals MVPs (NBA record), and three All-Star Game MVPs, Jordan is the most decorated player in NBA history.", "Jordan finished among the top three in regular-season MVP voting 10 times, and was named one of the 50 Greatest Players in NBA History in 1996.", "He is one of only seven players in history to win an NCAA championship, an NBA championship, and an Olympic gold medal (doing so twice with the 1984 and 1992 U.S. men's basketball teams)." ], [ "Michael Jordan", "Michael Jordan\n\nMichael Jeffrey Jordan (born February 17, 1963), also known by his initials, MJ, is an American former professional basketball player.", "He played 15 seasons in the National Basketball Association (NBA) for the Chicago Bulls and Washington Wizards.", "His biography on the official NBA website states: \"By acclamation, Michael Jordan is the greatest basketball player of all time.\"", "Jordan was one of the most effectively marketed athletes of his generation and was considered instrumental in popularizing the NBA around the world in the 1980s and 1990s.", "He is currently the principal owner and chairman of the NBA's Charlotte Hornets.", "Jordan played three seasons for coach Dean Smith at the University of North Carolina.", "As a freshman, he was a member of the Tar Heels' national championship team in 1982.", "Jordan joined the Bulls in 1984 as the third overall draft pick.", "He quickly emerged as a league star and entertained crowds with his prolific scoring.", "His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness.", "He also gained a reputation for being one of the best defensive players in basketball.", "In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\"." ] ], "gold": "Michael Jeffrey Jordan, also known by his initials MJ, is an American former professional basketball player and businessman. In his NBA career, Michael Jordan had 32,292 regular season points. In the playoffs, he had 5,987 points in his NBA career.", "prediction 1": "Michael Jordan scored 32,292 points in his 15-year professional basketball career. He scored 1,047 points in his first season in the NBA and 1,068 points in his second season in the NBA. Jordan scored a career-high 2,469 points in his third season in the NBA.", "prediction 2": "Michael Jordan, better known by his initials MJ, was an American former professional basketball player who played 15 seasons in the National Basketball Association for the Chicago Bulls and the Washington Wizards. Jordan scored a total of 59,498 points in his career. His total of 5,987 points in the playoffs is the second-highest in NBA history.", "prediction 3": "Michael Jordan made a total of 32,292 points in his 15-year professional career. He also made a total of 5,987 points in the playoffs, which is the second-highest in NBA history.", "prediction 4": "Michael Jordan played 15 seasons in the National Basketball Association for the Chicago Bulls and Washington Wizards. Jordan scored a total of 58,769 points between 1984 and 1998. Jordan retired with 32,292 points between 1984 and 1998, which places him fourth on the NBA's all-time scoring list behind Kareem Abdul-Jabbar, Karl Malone, and Kobe Bryant.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 83, "end": 259 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 36, "end": 82 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Michael Jeffrey Jordan, also known by his initials MJ, is an American former professional basketball player. In his NBA career, Michael Jordan had 32,292 regular season points. In the playoffs, he had 5,987 points in his NBA career. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where does red dye in food come from?", "passages": [ [ "Food coloring", "Food coloring\n\nFood coloring, or color additive, is any dye, pigment or substance that imparts color when it is added to food or drink.", "They come in many forms consisting of liquids, powders, gels, and pastes.", "Food coloring is used both in commercial food production and in domestic cooking.", "Food colorants are also used in a variety of non-food applications including cosmetics, pharmaceuticals, home craft projects, and medical devices.", "People associate certain colors with certain flavors, and the color of food can influence the perceived flavor in anything from candy to wine.", "Sometimes the aim is to simulate a color that is perceived by the consumer as natural, such as adding red coloring to glac\u00e9 cherries (which would otherwise be beige), but sometimes it is for effect, like the green ketchup that Heinz launched in 1999.", "Color additives are used in foods for many reasons including:\n\n\nThe addition of colorants to foods is thought to have occurred in Egyptian cities as early as 1500 BC, when candy makers added natural extracts and wine to improve the products' appearance.", "During the Middle Ages, the economy in the European countries was based on agriculture, and the peasants were accustomed to producing their own food locally or trading within the village communities.", "Under feudalism, aesthetic aspects were not considered, at least not by the vast majority of the generally very poor population." ], [ "Cochineal", "Cochineal\n\nThe cochineal ( , ; Dactylopius coccus) is a scale insect in the suborder Sternorrhyncha, from which the natural dye carmine is derived.", "A primarily sessile parasite native to tropical and subtropical South America through North America (Mexico and the Southwest United States), this insect lives on cacti in the genus \"Opuntia\", feeding on plant moisture and nutrients.", "The insects are found on the pads of prickly pear cacti, collected by brushing them off the plants, and dried.", "The insect produces carminic acid that deters predation by other insects.", "Carminic acid, typically 17-24% of dried insects' weight, can be extracted from the body and eggs, then mixed with aluminium or calcium salts to make carmine dye, also known as cochineal.", "Today, carmine is primarily used as a colorant in food and in lipstick (E120 or Natural Red 4).", "The carmine dye was used in North America in the 15th century for coloring fabrics and became an important export good during the colonial period.", "After synthetic pigments and dyes such as alizarin were invented in the late 19th century, natural-dye production gradually diminished." ], [ "Food coloring", "In 1856, mauveine, the first synthetic color, was developed by Sir William Henry Perkin and by the turn of the century, unmonitored color additives had spread through Europe and the United States in all sorts of popular foods, including ketchup, mustard, jellies, and wine.", "Originally, these were dubbed 'coal-tar' colors because the starting materials were obtained from bituminous coal.", "Many synthesized dyes were easier and less costly to produce and were superior in coloring properties when compared to naturally derived alternatives.", "Some synthetic food colorants are diazo dyes.", "Diazo dyes are prepared by coupling of a diazonium compound with a second aromatic hydrocarbons.", "The resulting compounds contain conjugated systems that efficiently absorb light in the visible parts of the spectrum, i.e. they are deeply colored.", "The attractiveness of the synthetic dyes is that their color, lipophilicity, and other attributes can be engineered by the design of the specific dyestuff.", "The color of the dyes can be controlled by selecting the number of azo-groups and various substituents.", "Yellow shades are often achieved by using acetoacetanilide.", "Red colors are often azo compounds." ] ], "gold": "Food coloring, or color additive, is any dye, pigment, or substance that imparts color when it is added to food or drink. Carmine (E120), a is red dye derived from the cochineal insect, Dactylopius coccus. Allura red AC dye in food is a synthetic dye. Synthetic dyes are often less costly and technically superior to natural dyes.", "prediction 1": "Red dye in food comes from insects, primarily from scale insects in the suborder Sternorrhyncha, from which the natural dye carmine is derived. In 1856, mauveine, the first synthetic color, was developed by Sir William Henry Perkin. Some synthetic food colorants are diazo dyes. Diazo dyes are prepared by coupling of a diazonium compound with a second aromatic hydrocarbons.", "prediction 2": "The red dye in food comes from the scale insect, Dactylopius coccus, which is a primarily sessile parasite native to tropical and subtropical South America through North America. The cochineal is also the source of the natural dye carmine.", "prediction 3": "The natural red dye in food comes from an insect, called a cochineal. The insect is a scale parasite native to tropical and subtropical South America through North America. The cochineal is extracted from the body and eggs of the insects and mixed with aluminium or calcium salts to make carmine dye, also known as cochineal. Today, carmine is primarily used as a colorant in food and in lipstick.", "prediction 4": "The red dye in food comes from insects, mainly the cochineal, which is a scale insect in the suborder Sternorrhyncha, which produces carmine, a natural dye. The cochineal is a scale insect in the suborder Sternorrhyncha, from which the natural dye carmine is derived.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 375 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "Food coloring Food coloring, or color additive, is any dye, pigment or substance that imparts color when it is added to food or drink. Red dye in food comes from insects, primarily from scale insects in the suborder Sternorrhyncha, from which the natural dye carmine is derived. Many synthesized dyes were easier and less costly to produce and were superior in coloring properties when compared to naturally derived alternatives." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where does the myocardium receives oxygenated blood from?", "passages": [ [ "Coronary circulation", "Coronary circulation\n\nCoronary circulation is the circulation of blood in the blood vessels that supply the heart muscle (myocardium).", "Coronary arteries supply oxygenated blood to the heart muscle, and cardiac veins drain away the blood once it has been deoxygenated.", "Because the rest of the body, and most especially the brain, needs a steady supply of oxygenated blood that is free of all but the slightest interruptions, the heart works constantly and sometimes works quite hard.", "Therefore its circulation is of major importance not only to its own tissues but to the entire body and even the level of consciousness of the brain from moment to moment.", "Interruptions of coronary circulation quickly cause heart attacks (myocardial infarctions), in which the heart muscle is damaged by oxygen starvation.", "Such interruptions are usually caused by ischemic heart disease (coronary artery disease) and sometimes by embolism from other causes like obstruction in blood flow through vessels.", "Coronary arteries supply blood to the myocardium and other components of the heart.", "Two coronary arteries originate from the left side of the heart at the beginning (root) of the aorta, just after the aorta exits the left ventricle.", "There are three aortic sinuses (dilations) in the wall of the aorta just superior to the aortic semilunar valve." ], [ "Cardiac muscle", "Cardiac muscle\n\nCardiac muscle (also called heart muscle or myocardium) is one of three types of vertebrate muscles, with the other two being skeletal and smooth muscles.", "It is an involuntary, striated muscle that constitutes the main tissue of the walls of the heart.", "The myocardium forms a thick middle layer between the outer layer of the heart wall (the epicardium) and the inner layer (the endocardium), with blood supplied via the coronary circulation.", "It is composed of individual heart muscle cells (cardiomyocytes) joined together by intercalated discs, encased by collagen fibres and other substances forming the extracellular matrix.", "Cardiac muscle contracts in a similar manner to skeletal muscle, although with some important differences.", "An electrical stimulation in the form of an action potential delivered in a rhythmic pattern triggers the release of calcium from the cell's internal calcium store, the sarcoplasmic reticulum.", "The rise in calcium causes the cell's myofilaments to slide past each other in a process called excitation contraction coupling.", "Diseases of heart muscle are of major importance.", "These include conditions caused by a restricted blood supply to the muscle including angina pectoris and myocardial infarction, and other heart muscle disease known as cardiomyopathies." ], [ "Pulmonary circulation", "Pulmonary circulation\n\nThe pulmonary circulation is the portion of the circulatory system which carries deoxygenated blood away from the right ventricle of the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart.", "The term pulmonary circulation is readily paired and contrasted with the systemic circulation.", "The vessels of the pulmonary circulation are the pulmonary arteries and the pulmonary veins.", "A separate system known as the bronchial circulation supplies oxygenated blood to the tissue of the larger airways of the lung.", "The earliest human discussions of pulmonary circulation date back to Egyptian times.", "Human knowledge of pulmonary circulation grew gradually over centuries, and scientists Ibn al-Nafis, Michael Servetus, and William Harvey provided some of the first accurate descriptions of this process.", "Deoxygenated blood leaves the heart, goes to the lungs, and then re-enters the heart; Deoxygenated blood leaves through the right ventricle through the pulmonary artery.", "From the right atrium, the blood is pumped through the tricuspid valve (or right atrioventricular valve), into the right ventricle.", "Blood is then pumped from the right ventricle through the pulmonary valve and into the main pulmonary artery.", "The pulmonary arteries carry deoxygenated blood to the lungs, where carbon dioxide is released and oxygen is picked up during respiration." ] ], "gold": "Coronary arteries supply oxygenated blood to the myocardium or heart muscle, and cardiac veins drain away the blood once it has been deoxygenated. This deoxygenated blood leaves the heart, goes to the lungs, and then re-enters the heart as oxygenated blood to supply the rest of the body.", "prediction 1": "Coronary circulation is the circulation of blood in the blood vessels that supply the heart muscle, which is the myocardium. Coronary arteries supply oxygenated blood to the heart muscle, and cardiac veins drain away the blood once it has been deoxygenated. Pulmonary circulation is the portion of the circulatory system which carries deoxygenated blood away from the right ventricle of the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart.", "prediction 2": "The heart muscle receives oxygenated blood from multiple sources. The blood vessels that supply the heart muscle are called the coronary arteries, which supply oxygenated blood to the heart muscle and its components. The pulmonary circulation carries deoxygenated blood away from the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart. The pulmonary veins carry oxygenated blood to the larger airways of the lung.", "prediction 3": "The coronary circulation is the circulation of blood in the blood vessels that supply the heart muscle. Coronary arteries supply oxygenated blood to the heart muscle, and cardiac veins drain away the blood once it has been deoxygenated. The pulmonary circulation is the portion of the circulatory system which carries deoxygenated blood away from the right ventricle of the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart. The pulmonary arteries carry deoxygenated blood to the left atrium and ventricle of the heart, where carbon dioxide is released and oxygen is picked up during respiration.", "prediction 4": "The myocardium receives oxygenated blood from the coronary circulation, which is the circulation of blood in the blood vessels that supply the heart muscle. The pulmonary circulation, which is the portion of the circulatory system which carries deoxygenated blood away from the right ventricle of the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Coronary circulation is the circulation of blood in the blood vessels that supply the heart muscle, which is the myocardium. Coronary arteries supply oxygenated blood to the heart muscle, and cardiac veins drain away the blood once it has been deoxygenated. Pulmonary circulation is the portion of the circulatory system which carries deoxygenated blood away from the right ventricle of the heart, to the lungs, and returns oxygenated blood to the left atrium and ventricle of the heart." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where did blue ribbon sports open its first two retail stores?", "passages": [ [ "Nike, Inc.", "I don't care what all the billionaires say.", "Bill Bowerman made the first pair of shoes for me.", "People don't believe me.", "In fact, I didn't like the way they felt on my feet.", "There was no support and they were too tight.", "But I saw Bowerman make them from the waffle iron, and they were mine\".", "In 1964, in its first year in business, BRS sold 1,300 pairs of Japanese running shoes grossing $8,000.", "By 1965 the fledgling company had acquired a full-time employee, and sales had reached $20,000.", "In 1966, BRS opened its first retail store, located at 3107 Pico Boulevard in Santa Monica, California next to a beauty salon, so its employees no longer needed to sell inventory from the back of their cars.", "In 1967, due to rapidly increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts.", "By 1971, the relationship between BRS and Onitsuka Tiger was nearing an end.", "BRS prepared to launch its own line of footwear, which would bear the Swoosh newly designed by Carolyn Davidson.", "The Swoosh was first used by Nike on June 18, 1971, and was registered with the U.S. Patent and Trademark Office on January 22, 1974." ], [ "Nike, Inc.", "Nike, Inc.\n\nNike, Inc. () is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services.", "The company is headquartered near Beaverton, Oregon, in the Portland metropolitan area.", "It is the world's largest supplier of athletic shoes and apparel and a major manufacturer of sports equipment, with revenue in excess of US$24.1\u00a0billion in its fiscal year 2012 (ending May 31, 2012).", "As of 2012, it employed more than 44,000 people worldwide.", "In 2014 the brand alone was valued at $19 billion, making it the most valuable brand among sports businesses.", "As of 2017, the Nike brand is valued at $29.6 billion.", "Nike ranked No. 89 in the 2018 Fortune 500 list of the largest United States corporations by total revenue.", "The company was founded on January 25, 1964, as Blue Ribbon Sports, by Bill Bowerman and Phil Knight, and officially became Nike, Inc. on May 30, 1971.", "The company takes its name from Nike, the Greek goddess of victory." ] ], "gold": "Nike, Inc. is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services. The company was founded on January 25, 1964, as \"Blue Ribbon Sports\", or BRS, by Bill Bowerman and Phil Knight, and officially became Nike, Inc. on May 30, 1971. In its first year in business, BRS sold 1,300 pairs of Japanese running shoes grossing $8,000. By 1965, sales had reached $20,000 and In 1966, BRS opened its first retail store at 3107 Pico Boulevard in Santa Monica, California. In 1967, due to increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts.", "prediction 1": "Blue Ribbon Sports was founded on January 25, 1964, as Blue Ribbon Shoes and was purchased by Onitsuka Tiger for $8,000. In 1966, BRS opened its first retail store, located at 3107 Pico Boulevard in Santa Monica, California next to a beauty salon, so its employees no longer needed to sell inventory from the back of their cars. In 1967, due to rapidly increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts. By 2017, the Nike brand is valued at $29.6 billion.", "prediction 2": "Blue Ribbon Sports opened its first retail store in Santa Monica, California in 1966. The company expanded its retail and distribution operations on the East Coast in 1967. In 2017, the company opened its second retail store in Wellesley, Massachusetts.", "prediction 3": "In 1966, Blue Ribbon Sports opened its first retail store, located at 3107 Pico Boulevard in Santa Monica, California next to a beauty salon, so its employees no longer needed to sell inventory from the back of their cars. In 1967, due to rapidly increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts. In 2017, the Nike brand is valued at $29.6 billion, making it the most valuable brand among sports businesses.", "prediction 4": "In 1966, Blue Ribbon Sports opened its first retail store at 3107 Pico Boulevard in Santa Monica, California next to a beauty salon, so its employees no longer needed to sell inventory from the back of their cars. In 1967, due to rapidly increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts. In 2017, the company, which has a global market share of over 50%, opened its first two retail stores in San Francisco, California and Portland, Oregon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 467, "end": 518 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Nike, Inc. Nike, Inc. () is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services. The company was founded on January 25, 1964, as Blue Ribbon Sports, by Bill Bowerman and Phil Knight, and officially became Nike, Inc. on May 30, 1971. In 1964, in its first year in business, BRS sold 1,300 pairs of Japanese running shoes grossing $8,000. By 1965 the fledgling company had acquired a full-time employee, and sales had reached $20,000. In 1966, BRS opened its first retail store, located at 3107 Pico Boulevard in Santa Monica, California. In 1967, due to rapidly increasing sales, BRS expanded retail and distribution operations on the East Coast, in Wellesley, Massachusetts. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who acted as snake eyes in gi joe?", "passages": [ [ "Snake Eyes (G.I. Joe)", "In the sixth episode of season 2, Snake Eyes faces off against a pack of wolves; after saving one, the unnamed wolf helps him throughout the episode, and is later seen howling atop a hill near Sigma Six headquarters.", "This was confirmed as a Sigma 6 version of Timber, when an Arctic Sigma Six figure of Snake Eyes was released with Timber, with the figure's bio card describing the plot from this episode.", "Snake Eyes appeared in the \"Sigma 6\" comic book, released by Devil's Due Publishing with direct connection to animated series.", "Snake Eyes is spotlighted in issue #6, which centers on Storm Shadow, as Snake Eyes is sent in to retrieve a stolen electronic device from him.", "Storm Shadow refers to Snake Eyes as \"brother\", and breaks Snake Eyes' headgear, partially exposing his face, which again is shown to be of a blonde American with a scar.", "Child actor and martial artist Leo Howard, and martial artist/stuntman Ray Park, play young Snake Eyes and adult Snake Eyes respectively, in the film adaptation \"\".", "In an early draft by Stuart Beattie, Snake Eyes would have spoken as a gag, but Larry Hama convinced him to drop the joke." ], [ "Snake Eyes (G.I. Joe)", "Joe.", "Storm Shadow disguises himself as Snake Eyes to break Cobra Commander out of prison, as the real Snake Eyes watches from the shadows.", "With the help of Jinx, Snake Eyes captures Storm Shadow and takes him to the Blind Master to pay for his assassination of the Hard Master.", "However, Snake Eyes learns that Zartan was the one who murdered the Hard Master and framed Storm Shadow for it, and that Storm Shadow only joined Cobra in order to avenge the Hard Master's death.", "With this revelation, Storm Shadow teams up with Snake Eyes and the Joes to stop Cobra Commander's plan to destroy several countries and take over the world.", "During the final battle, Snake Eyes allows Storm Shadow to deal with Zartan, by giving him the sword that was used to kill the Hard Master.", "Snake Eyes and the Joes stop Cobra Commander's plan and are declared heroes, absolved of their accusations, while Storm Shadow avenges the Hard Master's death by killing Zartan before disappearing.", "In May 2018, it was announced that Paramount will develop a movie spin-off featuring Snake Eyes, and on December 4th, 2018, Robert Schwentke was announced to direct the movie, along with a March 27, 2020 release date.", "Snake Eyes is one of the most popular and recognizable G.I. Joe characters." ], [ "Snake Eyes (G.I. Joe)", "Snake Eyes (G.I. Joe)\n\nSnake Eyes (also released as \"Snake-Eyes\") is a fictional character from the \"\" toyline, comic books, and cartoon series.", "He is one of the original and most popular members of the G.I. Joe Team, and is most known for his relationships with Scarlett and Storm Shadow.", "Snake Eyes is one of the most prominent characters in the \"G.I. Joe: A Real American Hero\" franchise, having appeared in every series of the franchise since its inception.", "He is portrayed by Ray Park in the 2009 live-action film \"\", and the 2013 sequel \"\".", "Snake Eyes is the code name of a member of the G.I. Joe Team.", "He is the team's original commando, and much of his history and information, including his real name, place of birth and service number, have remained \"CLASSIFIED\" throughout all depictions of his origin.", "All that is known for certain is his rank/grade (originally U.S. Army Sergeant/E-5, eventually reaching Sergeant First Class/E-7 before it too was made \"CLASSIFIED\"), his primary military specialty is infantry, and his secondary military specialty is hand-to-hand combat instructor." ] ], "gold": "Snake Eyes is portrayed by Ray Park in the 2009 live-action film G.I. Joe: The Rise of Cobra, and the 2013 sequel G.I. Joe: Retaliation with Leo Howard playing the younger version of Snake Eyes in these two films. Henry Golding portrays the titular character in the 2021 spin-off, origin film Snake Eyes. Unlike his comic book counterpart, Snake Eyes did not play a major role in the Sunbow's G.I. Joe: A Real American Hero TV series, with the exception of the first three miniseries. In this series, although Snake Eyes does not speak, the vocal effects of his wolf timber were provided by Frank Welker.", "prediction 1": "Snake Eyes is a fictional character who appears in the G.I. Joe comic book series. In the 2009 live-action movie Snake Eyes, Ray Park is shown as Snake Eyes. In the animated series G.I. Joe: A Real American Hero, child actor and martial artist Leo Howard plays Snake Eyes. In the 2012 film, a child actor and martial artist played Snake Eyes.", "prediction 2": "Snake Eyes is a fictional character from the G.I. Joe toyline, comic books, and cartoon series. Kid actor and martial artist Leo Howard, and martial artist/stuntman Ray Park, play young Snake Eyes and adult Snake Eyes respectively, in the 2009 live-action film \"\", and the 2013 sequel \"\".", "prediction 3": "Snake Eyes is a fictional character from the G.I. Joe franchise, one of the most popular and recognizable characters of the G.I. Joe franchise. He is portrayed by Leo Howard, a child actor and martial artist, and martial artist and stuntman Ray Park, who are also part of the franchise's live-action films. In the 2009 live-action movie Snake Eyes, Ray Park played the role of Snake Eyes, a young Snake Eye and an adult Snake Eye.", "prediction 4": "Snake Eyes is a fictional character from the G.I. Joe toyline, comic books, and cartoon series. He is one of the most prominent characters in the G.I. Joe franchise, having appeared in every series of the franchise since its inception. In the 2009 live-action film Snake Eyes, Leo Howard plays Snake Eyes, while martial artist Ray Park plays Snake Eyes as an adult.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 158, "end": 212 }, { "error type": "Redundant", "explanation": "Snake Eyes is a fictional character who appears in the G.I. Joe comic book series. In the 2009 live-action movie Snake Eyes, Ray Park is shown as Snake Eyes. In the animated series G.I. Joe: A Real American Hero, child actor and martial artist Leo Howard plays Snake Eyes. ", "start": 273, "end": 342 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Snake Eyes is a fictional character who appears in the G.I. Joe comic book series. In the 2009 live-action movie and the 2013 sequel Snake Eyes is played by Ray Park. Child actor and martial artist Leo Howard plays young Snake Eyes." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "How many cvs stores are there in the usa?", "passages": [ [ "CVS Health", "CVS Health\n\nCVS Health Corporation (previously CVS Corporation or CVS Caremark Corporation) is an American retail pharmacy and health care company headquartered in Woonsocket, Rhode Island.", "The company began in 1964 with three partners who grew the venture from a parent company, Mark Steven, Inc., that helped retailers manage their health and beauty aid product lines.", "The business began as a chain of health and beauty aid stores, but within several years, pharmacies were added.", "To facilitate growth and expansion, the company joined The Melville Corporation, which managed a string of retail businesses.", "Following a period of growth in the 1980s and 1990s, CVS Corporation spun off from Melville in 1996, becoming a standalone company trading on the New York Stock Exchange as \n\nIt later completed a merger with the pharmacy benefit management company Caremark Rx in 2007 and was renamed CVS Caremark Corporation.", "The company was renamed CVS Health in 2014 following its decision to remove tobacco products from CVS Pharmacy store shelves.", "CVS Health's assets include CVS Pharmacy, CVS Caremark, CVS Specialty, and the retail clinic MinuteClinic.", "In 2018, it ranked seventh on the Fortune 500 and 17th on the Fortune Global 500 list with $184B in annual revenue.", "In December 2017, CVS agreed to acquire Aetna for $69 billion." ], [ "Albertsons", "During the same time, Albertsons exited the markets of Omaha, Nebraska, where it closed or sold 21 stores, and New Orleans, Louisiana where it closed seven, selling four to A&P, which converted them to Sav-A-Center.", "Despite this, the acquisition spree had caused significant problems for Albertsons, Inc.", "Many of the acquired chains had systems that did not mesh well with Albertsons.", "Financing those acquisitions required Albertsons Inc. to take on significant debt.", "Added to those problems were significant changes in consumer buying patterns, including new competition from large discounters such as Walmart and Costco that impacted sales.", "After several assessments of the company and months of rumors it was announced on January 23, 2006, Albertsons, Inc. was to be sold to a consortium of companies.", "SuperValu would take the bulk of the company including the brand names and what was considered to be the stronger divisions, including the Albertsons divisions of Southern California, Northwest, and Intermountain, as well as the ACME, Shaw's Supermarkets and Star Market, Bristol Farms, and Jewel-Osco brands.", "CVS would acquire 702 stand-alone Osco and Sav-on Drug stores (closing about 100 of them) and converting them to CVS/pharmacy stores." ], [ "Standard Drug Company (Richmond, Virginia)", "Standard Drug Company (Richmond, Virginia)\n\nStandard Drug Company was a drugstore chain based in Richmond, Virginia.", "It was founded in 1919 by Samuel and Leo Rosenthal, who were graduates of the MCV School of Pharmacy.", "The first store opened on Main Street in Downtown Richmond as a pharmacy only.", "In 1921 the Rosenthals acquired a large building at the corner of First and Broad streets that became the anchor store to the first discount drug chain in America.", "It thrived for decades, expanding throughout Virginia into Washington, D.C., and its Maryland suburbs.", "In October 1993, the 60-store Standard Drug chain was bought by CVS Corp., which closed several locations and renamed the others as Peoples Drug stores.", "CVS had purchased the Washington, D.C.-based Peoples in 1990, renovating and expanding most of the stores, but had retained the Peoples name.", "At the time of the company's purchase of Standard, plans already were under way to change the Peoples locations to CVS/Pharmacy stores.", "That name change happened in May 1994.", "Instead of keeping the Standard name until the change to CVS, the company made the temporary change to Peoples, as the stores' designs would be much closer to the future look of CVS stores, thus making the upcoming change to CVS much easier." ], [ "Revco", "The chain was purchased by CVS Pharmacy in June 1997, which at the time was half of Revco's size, and CVS rebranded or closed all of the 2,552 Revco stores by summer of 1998.", "In at least one market, Richmond, Virginia, the Federal Trade Commission prohibited CVS from taking over the Revco stores, stating that the company would have a near monopoly.", "So CVS sold the Revco stores it had bought to Eckerd.", "Eckerd changed most of the Richmond area Revco stores to Eckerd stores, and closed a few of them.", "A few others closed within a few years.", "Eckerd maintained its presence in the Richmond market until 2007, when it was bought out by Rite Aid.", "By that time, however, Rite Aid's operations in the Richmond area did not constitute a monopoly, as Walgreens had entered the market in the late 1990s and opened many successful stores.", "Revco was well known for the slogan \"You need all the Revco you can get!\" and its \"A Friend for Life\" slogan and senior citizen's discount program, called \"Senior Shoppers\" (in which customers over 65 received 10% off their purchase every Wednesday).", "Revco also had a discount program for customers with disabilities (called \"Helping Hands\") and for baby supplies (called \"Baby Bunch\")." ], [ "CVS Health", "By 1964 CVS had 17 stores that sold primarily health and beauty products.", "In 1967 CVS began operation of its first stores with pharmacy departments, opening locations in Warwick, Rhode Island and Cumberland, Rhode Island.", "CVS was sold to Melville Corporation in 1969.", "By 1970, CVS was operating 100 stores in New England and the Northeast.", "In 1972, CVS acquired 84 Clinton Drug and Discount Stores.", "The purchase introduced CVS to the Midwest with stores in Indiana.", "During 1977, CVS acquired 36 New Jersey\u2013based Mack Drug stores.", "1980s\n\n1990s\n\n2000s\n\n2010s\n\n\nOn December 3, 2018, U.S. District Judge Richard J. Leon informed CVS Health Corp and the insurer Aetna that they have to keep their management separate until he weighs in on their $69 billion merger.", "The judge gave CVS and Aetna until December 14, 2018 to explain why the companies should not hold off on their consolidation.", "CVS Pharmacy is one of the largest retail pharmacy chains in the United States, with 9,600 stores located in 49 states, the District of Columbia, and Puerto Rico, operating primarily under the CVS Pharmacy, CVS, Longs Drugs, Navarro Discount Pharmacy and Drogaria Onofre names." ] ], "gold": "CVS Pharmacy, Inc., previously CVS/pharmacy, is an American retail corporation headquartered in Woonsocket, Rhode Island and was owned by its original holding company Melville Corporation from its inception until its current parent company was spun off into its own company in 1996. In 1997, CVS nearly tripled its 1,400 stores after purchasing the 2,500-store Revco chain. After January 2006, CVS operated over 6,200 stores in 43 states and the District of Columbia and in some locations, CVS has two stores less than two blocks apart. CVS Pharmacy is currently the largest pharmacy chain in the United States by number of locations, with over 9,600 as of 2016, and total prescription revenue and its parent company ranks as the fifth largest U.S. corporation by FY2020 revenues in the Fortune 500.", "prediction 1": "CVS is an American retail pharmacy and health care company headquartered in Woonsocket, Rhode Island. Founded in 1964, the company has since acquired several drugstore chains, including Standard Drug Company in Richmond, Virginia, and Revco in 1998.\n", "prediction 2": "CVS is an American retail pharmacy and health care company headquartered in Woonsocket, Rhode Island. It began in 1964 with three partners who grew the venture from a parent company, Mark Steven, Inc., that helped retailers manage their health and beauty aid product lines. The chain had a few acquisitions. In 1993 CVS bought the Richmond-based Standard Drug Company, which was half of the total store stock of Revco. Peoples was then purchased by CVS Pharmacy in 1997, and the stores were rebranded or closed all of the Revco stores by summer of 1998. In the market, Richmond, the Federal Trade Commission prohibited CVS from taking over the Revco stores, stating that the company would have a near monopoly.", "prediction 3": "CVS is an American retail pharmacy and health care company headquartered in Woonsocket. It began in 1964 with three partners who grew the venture from a parent company, Mark Steven, Inc., that helped retailers manage their health and beauty aid product lines. CVS Health was renamed in 2014 following its decision to remove tobacco products from CVS pharmacy store shelves. CVS purchased several drugstore chains in the United States, including Standard Drug Company in Richmond, Virginia in 1993 and Peoples Drug stores in 1997.", "prediction 4": "CVS is an American retail pharmacy and health care company that operates pharmacy stores throughout the United States. There are 60 CVS stores in the United States and 132 in Canada. Live in Canada? Find the CVS stores in Regina and other cities near you.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 250 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4, 5 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "CVS is an American retail pharmacy and health care company headquartered in Woonsocket, Rhode Island. The company joined The Melville Corporation until it spun off from Melville in 1996, becoming a standalone company. By 1964 CVS had 17 stores, by 1970, CVS was operating 100 stores in New England and the Northeast. Revco was purchased by CVS Pharmacy in June 1997, which at the time was half of Revco's size, and CVS rebranded or closed all of the 2,552 Revco stores. Now CVS Pharmacy is one of the largest retail pharmacy chains in the United States, with 9,600 stores located in 49 states, the District of Columbia, and Puerto Rico." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the theme to the andy griffith show?", "passages": [ [ "The Andy Griffith Show", "The show's theme music, \"The Fishin' Hole\", was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode \"The Keeper of the Flame\" (1962).", "Whistling in the opening sequence, as well as the closing credits sequence, was performed by Earle Hagen.", "One of the show's tunes, \"The Mayberry March\", was reworked a number of times in different tempo, styles and orchestrations as background music.", "The show's sole sponsor was General Foods, with promotional consideration paid for (in the form of cars) by Ford Motor Company (mentioned in the credits).", "Initially, Griffith played Taylor as a heavy-handed country bumpkin, grinning from ear to ear and speaking in a hesitant, frantic manner.", "The style recalled that used in the delivery of his popular monologues such as \"What It Was, Was Football\".", "He gradually abandoned the \"rustic Taylor\" and developed a serious and thoughtful characterization.", "Producer Aaron Ruben recalled: \n\nHe was being that marvelously funny character from \"No Time for Sergeants\", Will Stockdale [a role Griffith played on stage and in film]\u00a0...", "One day he said, \"My God, I just realized that I'm the straight man." ], [ "The Andy Griffith Show", "The Andy Griffith Show\n\nThe Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons\u2014159 in black and white and 90 in color.", "The series partially originated from an episode of \"The Danny Thomas Show\".", "The show starred Andy Griffith in the role of Andy Taylor, the widowed sheriff of the fictional small community of Mayberry, North Carolina.", "Other major characters include Andy's inept but well-meaning deputy, Barney Fife (Don Knotts);", "Andy's spinster aunt and housekeeper, Bee Taylor (Frances Bavier), and Andy's precocious young son, Opie (Ron Howard).", "Eccentric townspeople and temperamental girlfriends complete the cast.", "Regarding the tone of the show, Griffith said that despite a contemporary setting, the show evoked nostalgia, saying in a \"Today Show\" interview: \"Well, though we never said it, and though it was shot in the '60s, it had a feeling of the '30s.", "It was, when we were doing it, of a time gone by.\"", "The show also avoided unfavorable cultural aspects of this period, such as racism and segregation, by simply avoiding these topics with the all-white cast never encountering such situations." ] ], "gold": "The Andy Griffith Show is an American situation comedy television series that aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning eight seasons\u2014159 in black and white and 90 in color. The show's theme music, \"The Fishin' Hole,\" was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode \"The Keeper of the Flame.\"", "prediction 1": "The theme music to The Andy Griffith Show was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode \"The Keeper of the Flame\". The theme music for The Fishin' Hole was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane. One of the show's tunes, \"The Mayberry March\", was reworked a number of times in different tempo, styles and orchestrations as background music.", "prediction 2": "The theme music for The Andy Griffith Show was written by Earle Hagen and Herbert Spencer. The show's lyrics were written by Everett Sloane, who guest-starred as Jubal Foster in the episode The Keeper of the Flame in 1962.", "prediction 3": "The theme music to The Andy Griffith Show, composed by Earle Hagen and Herbert Spencer, was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane. The theme music for The Fishin' Hole, composed by Earle Hagen and Herbert Spencer, was written in 1963 by Earle Hagen, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode The Keeper of the Flame.", "prediction 4": "The show's theme music, \"The Fishin' Hole\", was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode \"The Keeper of the Flame\" (1962). Whistling in the opening sequence, as well as the closing credits sequence, was performed by Earle Hagen.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The theme music to The Andy Griffith Show was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, ", "start": 211, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 480 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " The Andy Griffith Show The Andy Griffith Show is an American situation comedy which aired on CBS from October 3, 1960, to April 1, 1968, with a total of 249 half-hour episodes spanning over eight seasons\u2014159 in black and white and 90 in color. The theme music to The Andy Griffith Show, The Fishin' Hole, was composed by Earle Hagen and Herbert Spencer, with lyrics written by Everett Sloane, who also guest starred as Jubal Foster in the episode \"The Keeper of the Flame\". " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When did the slave trade end in britain?", "passages": [ [ "Slavery in Britain", "Slavery in Britain\n\nSlavery in Great Britain existed and was recognized from before the Roman occupation until the 12th century, when chattel slavery disappeared, at least for a time, after the Norman Conquest.", "Former slaves merged into the larger body of serfs in Britain and no longer were recognized separately in law nor custom.", "From the 17th century into the 19th century, transportation to the colonies as a criminal or an indentured servant served as punishment for both genuine and petty crimes, or for simply being poor and viewed as an 'undesirable', in England and Ireland facilitated by the Transportation Act of 1718 .", "Tens of thousands children and vulnerable adults were kidnapped from Britain and transported by sail ship to the emerging lands of America, as a source of expendable labour for the numerous plantations of the colonies.", "During the same period, workhouses employed people whose poverty left them no other alternative than to work under forced labour conditions.", "British merchants were among the largest participants in the Atlantic slave trade.", "And British owners living within the home British isles, as well as within its colonies, owned African slaves.", "Ship owners transported enslaved West Africans, as well as British natives, to the New World to be sold into slave labour.", "The ships brought commodities back to Britain then exported goods to Africa.", "Some brought slaves to Britain, where they were kept in bondage." ], [ "Slavery Abolition Act 1833", "The results of these inquiries contributed greatly to the abolition of slavery with the Slavery Abolition Act 1833.", "The Act had its third reading in the House of Commons on 26 July 1833, three days before William Wilberforce died.", "It received the Royal Assent a month later, on August 28, and came into force the following year, on 1 August 1834.", "In practical terms, only slaves below the age of six were freed in the colonies.", "Former slaves over the age of six were redesignated as \"apprentices\", and their servitude was abolished in two stages: the first set of apprenticeships came to an end on 1 August 1838, while the final apprenticeships were scheduled to cease on 1 August 1840.", "The Act specifically excluded \"the Territories in the Possession of the East India Company, or to the Island of Ceylon, or to the Island of Saint Helena.\"", "The exceptions were eliminated in 1843.", "The Act provided for compensation for slave-owners.", "The amount of money to be spent on the compensation claims was set at \"the Sum of Twenty Million Pounds Sterling\".", "Under the terms of the Act, the British government raised \u00a320 million (\u00a316.5 billion in 2013 pounds, when calculated as wage values) to pay out in compensation for the loss of the slaves as business assets to the registered owners of the freed slaves." ] ], "gold": "Slavery in Great Britain existed prior to the Roman occupation and until the 12th century, when chattel slavery disappeared, at least for a time, following the Norman Conquest. Ownership and purchase of slaves ended on August 1, 1834 in Britain. On December 1, 1834 the slave trade ended in the British Colony of Cape of Good Hope. On February 1, 1835 the slave trade ended in the British Colony of Mauritius.", "prediction 1": "The slave trade in Great Britain ended on 1 August 1834, when the Slavery Abolition Act of 1833 went into effect. The Act had its third reading in the House of Commons on 26 July 1833, three days before William Wilberforce died. The Royal Assent a month later, on August 28, came into force the following year, on 1 August 1834. Former slaves over the age of six were redesignated as \"apprentices\", and their servitude was abolished in two stages: the first set of apprenticeships came to an end on 1 August 1838, while the final apprenticeships were scheduled to cease on 1 August 1840.", "prediction 2": "The slave trade in Britain ended in 1833 with the passage of the Slavery Abolition Act 1833. The first set of apprenticeships came to an end on 1 August 1838, while the final apprenticeships were scheduled to cease on 1 August 1840. There were several subsequent stages of the abolition of slavery.", "prediction 3": "The slave trade in Great Britain ended on 1 August 1834 and the first set of apprenticeships ended on 1 August 1838, while the final apprenticeships were scheduled to cease on 1 August 1840. The abolition of slavery in Great Britain was facilitated by the Transportation Act of 1718.", "prediction 4": "The slave trade in Great Britain ended on 1 August 1834. The Slavery Abolition Act 1833 ended the slave trade in Britain in two stages. The first set of apprenticeships came to an end on 1 August 1838, while the final apprenticeships were scheduled to cease on 1 August 1840.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 228 }, { "error type": "Redundant", "explanation": "The slave trade in Great Britain ended on 1 August 1834, when the Slavery Abolition Act of 1833 went into effect. ", "start": 229, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 329, "end": 587 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 15 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Slavery in Britain Slavery in Great Britain existed and was recognized from before the Roman occupation until the 12th century, when chattel slavery disappeared, at least for a time, after the Norman Conquest. Slavery in Great Britain ended on 1 August 1834, when the Slavery Abolition Act of 1833 went into effect. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who won sexiest man alive more than once?", "passages": [ [ "People (magazine)", "Originally awarded in the wintertime, it shifted around the calendar, resulting in gaps as short as seven months and as long as a year and a half, with no selection at all during 1994 (21 years later the magazine did select Keanu Reeves to fill the 1994 gap, with runners-up including Hugh Grant and Jim Carrey).", "Since 1997, the dates have settled between mid-November and early December.", "Dates of magazine issues, winners, ages of winners at the time of selection, and pertinent comments are listed below.", ", John F. Kennedy, Jr. and Patrick Swayze are the only winners to have died.", "Kennedy, Adam Levine, David Beckham, and Blake Shelton are the only non-actors to have won the award.", "In December 2014, \"People\" selected its first and only Sexiest Woman Alive.", "No later \"People\" Sexiest Women of the Year were announced.", "Cindy Crawford alongside Richard Gere had been declared \"Sexiest Couple of the Year\" on October 19, 1993 as a departure from the magazine's annual \"Sexiest Man of the Year\" award.", "At the end of each year \"People\" magazine famously selects 25 news-making individuals or couples who have received a lot of media attention over the past 12 months and showcases them in a special year-end issue, the '25 Most Intriguing People of the Year'." ], [ "People (magazine)", "People.com will \"carry teen-focused stories that are branded as TeenPeople.com\", Mark Golin, the editor of People.com explained, and on the decision to merge the brands he said, \"We've got traffic on TeenPeople, People is a larger site, why not combine and have the teen traffic going to one place?\"", "In a July 2006 \"Variety\" article, Janice Min, \"Us Weekly\" editor-in-chief, blamed \"People\" for the increase in cost to publishers of celebrity photos:\n\"People\" reportedly paid $4.1 million for photos of newborn Shiloh Nouvel Jolie-Pitt, the child of Angelina Jolie and Brad Pitt.", "The photos set a single-day traffic record for their website, attracting 26.5 million page views.", "The annual feature the \"Sexiest Man Alive\" is billed as a benchmark of male attractiveness and typically includes only famous people and celebrities.", "It is determined using a procedure similar to the procedure used for \"Time\"'s Person of the Year.", "The origin of the title was a discussion on a planned story on Mel Gibson.", "Someone exclaimed, \"Oh my God, he is the sexiest man alive!\"", "And someone else said, \"You should use that as a cover line.\"", "For the first decade or so, the feature appeared at uneven intervals." ], [ "George Clooney", "He made his directorial debut a year later with the biographical spy comedy \"Confessions of a Dangerous Mind\", and has since directed the historical drama \"Good Night, and Good Luck\" (2005), the sports comedy \"Leatherheads\" (2008), the political drama \"The Ides of March\" (2011), and the war film \"The Monuments Men\" (2014).", "Clooney won an Academy Award for Best Supporting Actor for the Middle East thriller \"Syriana\" (2005), and subsequently earned Best Actor nominations for the legal thriller \"Michael Clayton\" (2007) and the comedy-dramas \"Up in the Air\" (2009) and \"The Descendants\" (2011).", "In 2013, he received the Academy Award for Best Picture for producing the political thriller \"Argo\".", "He has been nominated for Academy Awards in six different categories, a record he shares with Walt Disney.", "In 2009, Clooney was included in \"Time\" annual Time 100 as one of the \"Most Influential People in the World\".", "He is also noted for his political and economic activism, and has served as one of the United Nations Messengers of Peace since January 31, 2008.", "He is also a member of the Council on Foreign Relations.", "Clooney was born on May 6, 1961, in Lexington, Kentucky." ] ], "gold": "The annual feature the \"Sexiest Man Alive\" is billed as a benchmark of male attractiveness and typically includes only famous people and celebrities. Several men have won the \"Sexiest Man Alive\" more than once, including Richard Gere, Brad Pitt, George Clooney, who was born in Lexington, KY, and Pirates of the Caribbean actor Johnny Depp.", "prediction 1": "The annual feature the \"Sexiest Man Alive\" is billed as a benchmark of male attractiveness and typically includes only famous people and celebrities. It is determined using a procedure similar to the procedure used for \"Time\"'s Person of the Year. George Clooney has received the award for sexiest man alive more than once. In 1994, Keanu Reeves won the award for sexiest man alive. In 2014, People selected its first and only Sexiest Woman Alive. In 2015, People selected its first and only Sexiest Woman Alive. In 2015, People selected its first and only Sexiest Woman Alive. In 2016, People selected its first and only Sexiest Women of the Year. In 2014, People selected its first and only Sexiest Woman Alive. In 2016 and 2015, People selected its first and only Sexiest Woman Alive", "prediction 2": "Mel Gibson won the title of \"Sexiest Man Alive\" five times. He made his directorial debut a year later with the biographical spy comedy Confessions of a Dangerous Mind. In 1993, John F. Kennedy, Jr., and Patrick Swayze were the only winners to have died. There have also been winners of the sexiest man alive award twice.", "prediction 3": "The sexiest man alive award is awarded to either a man or a woman each year, and in 1994, it went to Keanu Reeves. In 2013, People selected Cindy Crawford as the sexiest woman alive, and in 2014, People selected the sexiest woman alive.", "prediction 4": "The annual feature the \"Sexiest Man Alive\" is billed as a benchmark of male attractiveness and typically includes only famous people and celebrities. For the first decade or so, the feature appeared at uneven intervals. For the first three decades, winners have alternated between Mel Gibson and George Clooney.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 247 }, { "error type": "Unverifiable", "explanation": "", "start": 324, "end": 382 }, { "error type": "Irrelevant", "explanation": "", "start": 383, "end": 447 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 451, "end": 456 }, { "error type": "Redundant", "explanation": "People selected its first and only Sexiest Woman Alive.", "start": 457, "end": 512 }, { "error type": "Redundant", "explanation": "In 2015, People selected its first and only Sexiest Woman Alive. ", "start": 513, "end": 577 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 581, "end": 586 }, { "error type": "Redundant", "explanation": " People selected its first and only Sexiest Woman Alive. ", "start": 587, "end": 648 }, { "error type": "Redundant", "explanation": "In 2014, People selected its first and only Sexiest Woman Alive.", "start": 649, "end": 713 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 714, "end": 786 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The annual feature the \"Sexiest Man Alive\" is billed as a benchmark of male attractiveness and typically includes only famous people and celebrities. Cindy Crawford alongside Richard Gere had been declared \"Sexiest Couple of the Year\" on October 19, 1993 as a departure from the magazine's annual \"Sexiest Man of the Year\" award." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Which country has lost the most matches in the world cup?", "passages": [ [ "FIFA Club World Cup records and statistics", "Wael Gomaa, Hossam Ashour and Mohamed Aboutrika have the record number of matches played in the FIFA Club World Cup, taking part in 11 matches.", "The following is a list of the top ten clubs with the most points gained in the FIFA Club World Cup.", "The clubs are primarily ranked by their points gained, on a basis of three points for a win, one for a draw and no point for a loss.", "\"After 2017 tournament.\"" ], [ "Ghana national under-17 football team", "Squad that played in the 2013 African U-17 Championship from 13 \u2013 27 April 2013.", "\"*Draws include knockout matches decided on penalty kicks.\"", "FIFA U-17 World Cup Record by team\n\n\"*Denotes draws including the 1991 & 1999 Semi-Final matches decided on penalty kicks v Qatar (4-2p) & Brazil (2-4p).\"", "Africa U-17 Cup of Nations Record by team\n\n\"*Denotes draws including the 2017 Semi-Final match decided on penalty kicks v Niger (6-5p).\"", "CAF U-16 and U-17 World Cup Qualifiers record by team\n\n", "The following list consist of previous Ghana U-17 national team players who have won or were influential at the FIFA U-17 World Cup with the Ghana U-17 national team or the FIFA U-20 World Cup with the Ghana U-20 national team, and those who were part of the Ghana U-23 national team that won the Bronze medal at the 1992 Summer Olympics.", "The list also includes the players who have graduated from the Ghana U-20 national team and gone on to represent the senior Ghana national team at the FIFA World Cup or African Cup of Nations:" ], [ "History of the France national football team", "They were victors in the second match defeating Mexico 3\u20132, but were unable to advance to the next round due to their head-to-head result with Yugoslavia, who advanced.", "Following the World Cup, France went on an eight-match unbeaten streak defeating the likes of Germany, Spain, England, and Sweden.", "The consistent play from the team led to the team again cruising through qualification for the 1958 FIFA World Cup in Sweden.", "France, for the second consecutive qualification, went undefeated scoring 19 goals and conceding only 4.", "Of the 19 goals scored, Racing de France striker Thad\u00e9e Cisowski scored seven including five in the 6\u20133 defeat of Belgium.", "At the 1958 World Cup, the team finished in third place.", "In the group stage, France again faced Yugoslavia, but were given unfamiliar opposition in Paraguay and Scotland.", "In the opening match against Paraguay, France got a 7\u20133 victory, with Reims striker Just Fontaine getting a hat trick.", "In the match against Yugoslavia, they were defeated 2\u20133 with Fontaine scoring both of his team's goals.", "The 2\u20131 victory over Scotland was enough to win the group and advance to the knockout rounds, a first for France.", "In the knockout rounds, France beat Northern Ireland 4\u20130 with Fontaine recording another two goals." ] ], "gold": "Mexico holds the record for the most losses in total matches in the World Cup with 27. Mexico also holds the record for most consecutive losses in matches in the World Cup with 9. Germany holds the record for the most knockout losses in matches in the World Cup with 14. ", "prediction 1": "The country with the most lost matches in the world cup is France, with 11 matches. The country with the most losses in the world cup is Yugoslavia, with 3 losses, and the most wins, with 7.", "prediction 2": "The country with the most losses in a world cup is France, with a total of 78. France has lost the most matches in a single tournament, with a total of 83. In the history of the France national football team, they have lost the most matches in the same tournament.", "prediction 3": "The country that has lost the most matches in a World Cup is France. In the history of the FIFA World Cup, that country was Yugoslavia. However, since 1958, the team has lost the most matches in a World Cup. For example, in the 1958 World Cup, France lost the most matches, in the 1958 World Cup they lost the most games against Serbia.", "prediction 4": "The country that has lost the most matches in the FIFA World Cup is France, with 19 matches. The country that has lost the most matches in the FIFA Club World Cup is Yugoslavia. The country that has lost the most matches in the FIFA World Cup is Belgium, with 3 losses.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 83 }, { "error type": "Unverifiable", "explanation": "", "start": 84, "end": 190 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Nba record for most turnovers in a career?", "passages": [ [ "Randy White (basketball)", "Randy White (basketball)\n\nRandy White (born November 4, 1967) is an American former professional basketball player.", "During his playing career, at a height of 6'8\" (2.03 m), and a weight of 240 pounds (109 kg), he played at the power forward position.", "White was a star at Louisiana Tech University, where he averaged 21.2 points and 10.5 rebounds as a senior, and earned the nicknames \"Mailman II\", and \"Mailkid\" (a reference to NBA legend and Louisiana Tech alumnus Karl \"The Mailman\" Malone), who White was often compared to, since they shared many traits, such as starring for Louisiana Tech University.", "White was then selected by the Dallas Mavericks, with the eighth pick of the 1989 NBA draft, and played five seasons with them, averaging a career-high 9.7 points per game in 1992\u201393.", "He later played in the CBA, and in the international leagues, including a stop with European powerhouse Maccabi Tel Aviv, and in Italy with Pfizer Reggio Calabria, in the 1994\u20131995 season." ], [ "Jeff Malone", "Malone also coached the NBA Development League's Columbus Riverdragons from 2001 to 2005, compiling a 102\u201398 record, before the franchise changed ownership and moved to Austin, Texas, renaming the team the Austin Toros and leaving Malone out of a job.", "He spent some time as the head coach of the Florida Flame until that team ceased operations in 2006, citing a lack of own home court.", "Malone is the nephew of the late Vivian Malone Jones, the first African American graduate of the University of Alabama, and Dr. Sharon Malone Holder, wife of U.S. Attorney General Eric Holder.", "He resides in Chandler, Arizona, with his wife and four children.", "He has no relation to former Jazz teammate Karl Malone." ], [ "LeBron James", "LeBron James\n\nLeBron Raymone James Sr. (; born December 30, 1984) is an American professional basketball player for the Los Angeles Lakers of the National Basketball Association (NBA).", "Often considered the best basketball player in the world and regarded by some as the greatest player of all time, James' accomplishments are extensive and include four NBA Most Valuable Player Awards, three NBA Finals MVP Awards, two Olympic gold medals, three All-Star Game MVP awards, and an NBA scoring title.", "He is the all-time NBA playoffs scoring leader and has amassed fourteen NBA All-Star Game appearances, twelve All-NBA First Team designations, and five All-Defensive First Team honors.", "A prep-to-pro, James played high school basketball for St. Vincent\u2013St. Mary High School in his hometown of Akron, Ohio, where he was heavily touted in the national media as a future NBA superstar.", "He joined the Cleveland Cavaliers in 2003 as the first overall draft pick.", "James quickly emerged as a league star and concluded his first season by winning the NBA Rookie of the Year Award.", "He would go on to establish himself as one of the premier players in the NBA with multiple accolades, including being given the NBA Most Valuable Player Award in 2009 and 2010." ] ], "gold": "Karl Malone, who is nicknamed the Mailman and played for 18 seasons with the Utah Jazz, holds the record for the most turnovers in a career in the NBA regular season. LeBron James, who is nicknamed King James and currently plays for the Los Angeles Lakers, holds the record for the most turnovers in a career in the NBA playoffs with 217.", "prediction 1": "The NBA record for most turnovers in a career is 21. In the 2017-2018 season, the NBA Record for the most turnovers in a career is 15. In the 2015-16 season, the NBA Record for the most turnovers in a career is 15.", "prediction 2": "LeBron James holds the record for most career turnovers in a season with 132.", "prediction 3": "The NBA records most turnovers in a career is 63. The NFL record for most turnovers in a career is 538.", "prediction 4": "The NBA record for most turnovers in a career is 63. In the 1990s, the record stood at 62. The NBA record for most turnovers in a season stands at 59.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 52 }, { "error type": "Redundant", "explanation": "The NBA record for most turnovers in a career is 21. ", "start": 53, "end": 134 }, { "error type": "Redundant", "explanation": "The NBA record for most turnovers in a career is 21. ", "start": 135, "end": 214 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who holds the record for most number of dot balls in ipl?", "passages": [ [ "Pawan Negi", "Pawan Negi\n\nPawan Negi (born 6 January 1993) is an Indian cricketer.", "He is a slow left-arm orthodox bowler.", "He plays for Delhi in the first-class Ranji Trophy competition, and has also played List A and Twenty20 cricket for the team.", "He played for Delhi Daredevils in the Indian Premier League in 2012 and 2013 and for Chennai Super Kings in 2014 and 2015.", "He was bought by Delhi Daredevils for 8.50 crores in IPL auction 2016 marking him ahead of stalwart Yuvraj Singh and making him the costliest Indian player of auction.", "He made his Twenty20 International debut for India cricket team against the United Arab Emirates cricket team in the 2016 Asia Cup at Sher-e-Bangla National Stadium on 3 March 2016.", "He is also picked in the Indian squad for ICC T20 World Cup 2016.", "In February 2017, he was bought by the Royal Challengers Bangalore team for the 2017 Indian Premier League for 1 crore.", "He has the record for the best bowling figures in a Champions League T20 match(5/22)\n\n", "In January 2018, he was bought by the Royal Challengers Bangalore in the 2018 IPL auction." ], [ "Sunil Narine", "Sunil Narine\n\nSunil Philip Narine (born 26 May 1988) is a Trinidadian cricketer of Indian descent who plays for the West Indies.", "Primarily an off-spin bowler, he is also an aggressive left-handed batsman.", "Narine currently plays for Kolkata Knight Riders in the IPL, Dhaka Dynamites in the BPL, Trinbago Knight Riders in the CPL and Lahore Qalandars in the PSL.", "He made his One Day International debut in December 2011 and Test debut in June 2012.", "Sunil made his debut in first-class cricket for Trinidad and Tobago in February 2009 during the Regional Four Day Competition, bowling thirteen overs without taking a wicket.", "He did not play another first-class match until nearly a year later, and after going wicketless in the first innings claimed a single scalp in the second, that of tail-ender Lionel Baker.", "On 19 January 2011, during the Caribbean Twenty20, Narine played his first Twenty20 (T20) match but did not bowl as the match was rained off before Trinidad and Tobago could bowl.", "T&T won the competition and Narine managed five wickets at an average of 13.40.", "By virtue of winning the competition Trinidad and Tobago qualified for the 2011 Champions League Twenty20 held in September and October, in which Narine was one of three bowlers to take ten or more wickets." ], [ "Bhuvneshwar Kumar", "Bhuvneshwar Kumar\n\nBhuvneshwar Kumar Mavi (born 5 February 1990) is an Indian international cricketer.", "He plays for Uttar Pradesh in domestic cricket.", "He also plays for the Sunrisers Hyderabad in the Indian Premier League.", "Kumar is a right-arm medium-fast bowler who swings the ball both ways efficiently, with his inswingers more effective than outswing, especially adept at creating late swing, and a useful lower order right-handed batsman.", "His talent was first noticed in an ODI match against Pakistan, where he successfully took a three-wicket haul.", "In the ODI series that followed, he marked his One Day International debut, his following spells in the game ensured him a place in the Indian squad for the rest of the series.", "After his five-wicket haul against South Africa, Bhuvneshwar Kumar became the first Indian bowler to take a five-wicket haul in all formats of the game.", "Bhuvneshwar Kumar was born in Meerut on 5 February 1990.", "It was his sister Rekha Adhana, who encouraged him to play cricket and took him to his first coaching centre when he was 13.", "Kumar plays for Uttar Pradesh in domestic cricket.", "He has also played for Central Zone in the Duleep Trophy.", "Kumar made his first-class debut at the age of 17 against Bengal." ] ], "gold": "The Indian Premier League (IPL) is a Twenty20 (T20) competition in men's cricket. Ashish Nehra, an Indian cricket coach and former cricketer who played in all formats of the game, holds the record for most number of dot balls in IPL in 2015. Bhuvneshwar Kumar Singh, an Indian international cricketer who plays all formats of the game, holds the record for most number of dot balls in IPL in 2016. Sunil Narine, a Trinidadian cricketer who plays internationally for the West Indies, holds the record for most number of dot balls in IPL in 2017.", "prediction 1": "The record for most dot balls in an IPL match is 62. The record for most dot balls in an ODI match is 38. The record for most dots in a T20 match is 40. The record for most dots in a T20 match is 32. The record for most dots in an ODI is 38. There is also a record for the most dot balls in an ODI.", "prediction 2": "In the Indian Premier League, Pawan Negi holds the record for the most number of dots balls in a match. Sunil Narine holds the record for the best bowling figures in a Champions League T20 match, with 5/22. Bhuvneshwar Kumar holds the record for the most number of dots balls in a match in a season.", "prediction 3": "The record for most dot balls in an IPL match is 287. However, the record for most dot balls in a Champions League T20 match is 243. Sunil Narine has the record for the best bowling figures in a Champions League T20 match (5/22).", "prediction 4": "The record for most dot balls in an IPL match is 102. The record for most dot balls in an IPL match is 102. The record for most dot balls in an IPL match is 102. The record for most dot balls in an IPL match is 102.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 49, "end": 52 }, { "error type": "Unverifiable", "explanation": "", "start": 102, "end": 105 }, { "error type": "Unverifiable", "explanation": "", "start": 149, "end": 152 }, { "error type": "Unverifiable", "explanation": "", "start": 196, "end": 199 }, { "error type": "Redundant", "explanation": "The record for most dots in a T20 match is 40. ", "start": 153, "end": 192 }, { "error type": "Redundant", "explanation": "The record for most dot balls in an ODI match is 38. ", "start": 200, "end": 241 }, { "error type": "Redundant", "explanation": "The record for most dots in an ODI is 38. ", "start": 242, "end": 298 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Bhuvneshwar Kumar Mavi is an Indian international cricketer. Sunil Philip Narine is a Trinidadian cricketer who plays for the West Indies." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the formula for area of a circle come from?", "passages": [ [ "Area of a circle", "Area of a circle\n\nIn geometry, the area enclosed by a circle of radius is .", "Here the Greek letter represents a constant, approximately equal to 3.14159, which is equal to the ratio of the circumference of any circle to its diameter.", "One method of deriving this formula, which originated with Archimedes, involves viewing the circle as the limit of a sequence of regular polygons.", "The area of a regular polygon is half its perimeter multiplied by the distance from its center to its sides, and the corresponding formula (that the area is half the perimeter times the radius, i.e. ) holds in the limit for a circle.", "Although often referred to as the area of a circle in informal contexts, strictly speaking the term \"disk\" refers to the interior of the circle, while \"circle\" is reserved for the boundary only, which is a curve and covers no area itself.", "Therefore, the area of a disk is the more precise phrase for the area enclosed by a circle.", "Modern mathematics can obtain the area using the methods of integral calculus or its more sophisticated offspring, real analysis.", "However the area of a disk was studied by the Ancient Greeks.", "Eudoxus of Cnidus in the fifth century B.C. had found that the area of a disk is proportional to its radius squared." ], [ "Area", "The mathematician Archimedes used the tools of Euclidean geometry to show that the area inside a circle is equal to that of a right triangle whose base has the length of the circle's circumference and whose height equals the circle's radius, in his book \"Measurement of a Circle\".", "(The circumference is 2\"r\", and the area of a triangle is half the base times the height, yielding the area \"r\" for the disk.)", "Archimedes approximated the value of \u03c0 (and hence the area of a unit-radius circle) with his doubling method, in which he inscribed a regular triangle in a circle and noted its area, then doubled the number of sides to give a regular hexagon, then repeatedly doubled the number of sides as the polygon's area got closer and closer to that of the circle (and did the same with circumscribed polygons).", "Swiss scientist Johann Heinrich Lambert in 1761 proved that \u03c0, the ratio of a circle's area to its squared radius, is irrational, meaning it is not equal to the quotient of any two whole numbers.", "In 1794 French mathematician Adrien-Marie Legendre proved that \u03c0 is irrational; this also proves that \u03c0 is irrational." ], [ "Area of a circle", "The area of a regular polygon is half its perimeter times the apothem.", "As the number of sides of the regular polygon increases, the polygon tends to a circle, and the apothem tends to the radius.", "This suggests that the area of a disk is half the circumference of its bounding circle times the radius.", "Following Archimedes' argument in \"The Measurement of a Circle\" (c. 260 BCE), compare the area enclosed by a circle to a right triangle whose base has the length of the circle's circumference and whose height equals the circle's radius.", "If the area of the circle is not equal to that of the triangle, then it must be either greater or less.", "We eliminate each of these by contradiction, leaving equality as the only possibility.", "We use regular polygons in the same way.", "Suppose that the area \"C\" enclosed by the circle is greater than the area \"T\"\u00a0= \u2044\"cr\" of the triangle.", "Let \"E\" denote the excess amount.", "Inscribe a square in the circle, so that its four corners lie on the circle.", "Between the square and the circle are four segments.", "If the total area of those gaps, \"G\", is greater than \"E\", split each arc in half." ] ], "gold": "In geometry, the area enclosed by a circle of radius r is \u03c0r2, where the Greek letter \u03c0 represents the constant ratio of the circumference of any circle to its diameter, approximately equal to 3.1416. One method of deriving this formula, which originated with Archimedes, involves viewing the circle as the limit of a sequence of regular polygons, where the area of a regular polygon is half its perimeter multiplied by the distance from its center to its sides, and the corresponding formula\u2013that the area is half the perimeter times the radius\u2013namely, A = 1/2 \u00d7 2\u03c0r \u00d7 r, holds in the limit for a circle. Archimedes showed the work for the formula for area of a circle in his book, The Measurement of a Circle.", "prediction 1": "The area of a circle is the area of a regular polygon, divided by the circumference of the circle and divided by its radius. One method of deriving this formula, which originated with Archimedes, involves viewing the circle as the limit of a sequence of regular polygons. The area of a regular polygon is half its perimeter multiplied by the distance from its center to its sides, and the corresponding formula (that the area is half the perimeter times the radius, i.e. ) holds in the limit for a circle.", "prediction 2": "The formula for the area of a circle come from Archimedes, who used the tools of Euclidean geometry to show that the area inside a circle is equal to that of a right triangle whose base has the length of the circle's circumference and whose height equals the circle's radius in his book Measurement of a Circle. Archimedes approximated the value of with his doubling method, in which he inscribed a regular triangle in a circle and noted its area, then doubled the number of sides to give a regular hexagon, then repeatedly doubled the number of sides as the polygon's area got closer and closer to that of the circle.", "prediction 3": "In geometry, the area enclosed by a circle of radius is. One method of deriving this formula, which originated with Archimedes, involves viewing the circle as the limit of a sequence of regular polygons. The area of a regular polygon is half its perimeter multiplied by the distance from its center to its sides, and the corresponding formula (that the area is half the perimeter times the radius, i.e. ) holds in the limit for a circle.", "prediction 4": "Archimedes used the tools of Euclidean geometry to show that the area inside a circle is equal to that of a right triangle whose base has the length of the circle's circumference and whose height equals the circle's radius, in his book Measurement of a Circle. However, the mathematician approximated the value of with his doubling method in which he inscribed a regular triangle in a circle and noted its area, then doubled the number of sides to give a regular hexagon, then repeatedly doubled the number of sides as the polygon's area got closer and closer to that of the circle.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 124 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In geometry, the area enclosed by a circle of radius r is \u03c0r2, where the Greek letter \u03c0 represents the constant ratio of the circumference of any circle to its diameter, approximately equal to 3.1416. One method of deriving this formula, which originated with Archimedes, involves viewing the circle as the limit of a sequence of regular polygons. The area of a regular polygon is half its perimeter multiplied by the distance from its center to its sides, and the corresponding formula (that the area is half the perimeter times the radius, i.e. ) holds in the limit for a circle. Archimedes showed the work for the formula for area of a circle in his book, The Measurement of a Circle." }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "What was the name of the little boy in pet cemetery?", "passages": [ [ "Pet Sematary (1989 film)", "Pet Sematary (1989 film)\n\nPet Sematary (sometimes referred to as Stephen King's Pet Sematary) is a 1989 American horror film adaptation of Stephen King's 1983 novel of the same name.", "Directed by Mary Lambert and written by King, the film features Dale Midkiff as Louis Creed, Denise Crosby as Rachel Creed, Blaze Berdahl as Ellie Creed, Miko Hughes as Gage Creed, and Fred Gwynne as Jud Crandall.", "Andrew Hubatsek was cast for Zelda's role.", "King, who scripted from his own book, also has a cameo as a minister.", "A sequel, \"Pet Sematary Two\", was met with less financial and critical success.", "An upcoming second film adaptation of the same name is scheduled for release in 2019.", "The Creed family\u2014Louis, Rachel, and their children Ellie and Gage\u2014move from Chicago to rural Ludlow, Maine, after Louis is offered a job as a doctor with the University of Maine.", "They befriend their elderly neighbor Jud Crandall, who takes them to an isolated pet cemetery (misspelled \"sematary\") in the forest behind the Creeds' new home.", "On his first day at work, Louis meets Victor Pascow, a jogger who is brought in with severe injuries from a car accident." ], [ "Miko Hughes", "Miko Hughes\n\nMiko John Hughes (born February 22, 1986) is an American actor known for his film roles; as a child, as Gage Creed in \"Pet Sematary\" (1989), as astronaut Jim Lovell's son Jeffrey in \"Apollo 13\" (1995), as a child on the autism spectrum named Simon opposite Bruce Willis in \"Mercury Rising\" (1998), and as Dylan (Heather Langenkamp's son) in \"Wes Craven's New Nightmare\" (1994),he also starred in Unspeakable Acts, as well as his recurring role as Aaron on \"Full House\" from 1990 to 1995.", "Hughes was born in Apple Valley, California the son of Mary (n\u00e9e Phelps) and John Hughes, a special effects technician (not to be confused with late \"Breakfast Club\" director John Hughes).", "He has three siblings: Mike, Mitch and Molly.", "He has English and Chickasaw Native American ancestry.", "Hughes started his acting career in a public service announcement when he was 22 months old, and followed that up by appearing in his first feature film five months later.", "From his years as a child actor, Hughes was consistently one of the busiest young actors in Hollywood." ] ], "gold": "Gage William Creed is a fictional character created by Stephen King, who is the primary antagonist of his 1983 novel Pet Sematary. Gage was portrayed in the 1989 film adaptation of the novel by Miko Hughes, who had a recurring role as Aaron on Full House from 1990 to 1995. He was portrayed in the 2019 remake by twins Hugo and Lucas Lavoie. Gage was also portrayed in a small cameo appearance by his creator, Stephen King, in the 1997 miniseries adaptation of The Shining.", "prediction 1": "The 1989 American horror film Pet Sematary is a horror film adaptation of Stephen King's 1983 novel of the same name. The Creed family\u2014Louis, Rachel, and their children Ellie and Gage\u2014move from Chicago to rural Ludlow, Maine, after Louis is offered a job as a pediatrician with the University of Maine. They befriend their elderly neighbor Jud Crandall, who takes them to an isolated pet cemetery in the forest behind the Creeds' new home. The little boy in Pet Sematary is named Gage Creed. The name of the little boy in Pet Cemetery was Victor Pascow.", "prediction 2": "Pet Sematary is a 1989 American horror film adaptation of Stephen King's 1983 novel of the same name. In the original film, Louis Creed is played by Dale Midkiff, Rachel Creed is played by Denise Crosby, Blaze Berdahl plays Ellie Creed, Miko Hughes plays Gage Creed, and Victor Pascow is played by Fred Gwynne. In the original 1989 American horror film, Victor Pascow is played by Fred Gwynne.", "prediction 3": "Pet Sematary is sometimes referred to as Stephen King's Pet Sematary. It's a 1989 American horror film adaptation of Stephen King's 1983 novel of the same name. In the original film, Miko Hughes played the role of Gage Creed. It was originally named Victor Pascow, the jogger who brought in the little boy with severe injuries from a car accident. The character was later changed to Simon, a child on the autism spectrum, opposite Bruce Willis in Mercury Rising.", "prediction 4": "Pet Sematary is a 1989 American horror film adaptation of Stephen King's 1983 novel of the same name. In the original version, Gage Creed was played by Miko Hughes. In the original version, Gage Creed was played by Denise Crosby.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 439 }, { "error type": "Redundant", "explanation": "The 1989 American horror film Pet Sematary is a horror film adaptation of Stephen King's 1983 novel of the same name. The Creed family\u2014Louis, Rachel, and their children Ellie and Gage\u2014move from Chicago to rural Ludlow, Maine, after Louis is offered a job as a pediatrician with the University of Maine. They befriend their elderly neighbor Jud Crandall, who takes them to an isolated pet cemetery in the forest behind the Creeds' new home. The little boy in Pet Sematary is named Gage Creed. ", "start": 492, "end": 553 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 1989 American horror film Pet Sematary is a horror film adaptation of Stephen King's 1983 novel of the same name. The little boy in Pet Sematary is named Gage Creed. Gage was portrayed in the 1989 film adaptation of the novel by Miko Hughes, who had a recurring role as Aaron on Full House from 1990 to 1995. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "How far is the crease from the wicket?", "passages": [ [ "Crease (cricket)", "A 2010 amendment to Law 29 clarified the circumstance where the wicket is put down while a batsman has become fully airborne after having first made his ground; the batsman is regarded to not be out of his ground.", "Drawn parallel with the popping crease and four feet away from it.", "The bowling crease is the line through the centres of the three stumps at each end.", "It is 8\u00a0ft 8 in (2.64 m) long, with the stumps in the centre.", "Four return creases are drawn, one on each side of each set of stumps.", "The return creases lie perpendicular to the popping crease and the bowling crease, 4 feet 4\u00a0inches (1.32 m) either side of and parallel to the imaginary line joining the centres of the two middle stumps.", "Each return crease line starts at the popping crease but the other end is considered to be unlimited in length and must be marked to a minimum of 8 feet (2.44 m) from the popping crease.", "The return creases are primarily used to determine whether the bowler has bowled a no-ball.", "To avoid a no-ball, the bowler's back foot in the delivery stride must land within and not touch the return crease.", "This is to stop the bowler from bowling at the batsmen from an unfair angle (i.e. diagonally)." ], [ "Crease (cricket)", "Crease (cricket)\n\n", "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side.", "They define the area within which the batsmen and bowlers operate.", "The term \"crease\" may refer to any of the lines themselves, particularly the popping crease, or to the region that they demark.", "Law 7 of the Laws of Cricket governs the size and position of the crease markings, and defines the actual line as the back edge of the width of the marked line on the grass, i.e., the edge nearest to the wicket at that end.", "Four creases (one popping crease, one bowling crease, and two return creases) are drawn at each end of the pitch, around the two sets of stumps.", "The batsmen generally play in and run between the areas defined by the creases at each end of the pitch.", "The bowling creases lie 22 yards (66 feet or 20.12 m) away, and marks the other end of the pitch." ] ], "gold": "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side and they also define the area within which the batsmen and bowlers operate. The term crease may refer to any of the lines themselves, particularly the popping crease, or to the region that they demark. Law 7 of the Laws of Cricket governs the size and position of the crease markings, and defines the actual line as the back edge of the width of the marked line on the grass, example, the edge nearest to the wicket at that end. The popping crease is 122 cm from the wicket, and the four return creases are drawn, one on each side of each set of stumps, and the return creases lie perpendicular to the popping crease and the bowling crease, 4 feet 4 inches, 1.32 m, either side of, and parallel to the imaginary line joining the centers of the two middle stumps. ", "prediction 1": "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side. The popping crease is the line through the centres of the three stumps at each end, 8 feet 8 inches long, with the stumps in the centre. The bowling crease is the line through the centres of the three stumps at each end. The return creases lie perpendicular to the popping crease and parallel to the bowling crease. The return creases lie 4 feet 4 inches either side of and parallel to the imaginary line joining the two middle stumps. The return creases are primarily used to determine whether the bowler has bowled a no-ball. The pop creases are considered to be unlimited in length and must be", "prediction 2": "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side. The popping crease is the line through the centres of the three stumps at each end, 8 feet 8 inches long, with the stumps in the centre. The bowling crease is 8 feet 8 inches away, and the return creases lie perpendicular to the popping crease and the bowling crease, and are 8 feet (2.44 m) from the popping crease.", "prediction 3": "The popping crease is a certain area demarcated by white lines painted or chalked on the field of play. It is 8 ft 8 in (2.64 m) long, with the stumps in the centre. The bowling crease is the line through the centres of the three stumps at each end. It is 4 feet 4 inches either side of and parallel to the imaginary line joining the centres of the two middle stumps. The return creases lie perpendicular to the popping crease and the bowling crease and are primarily used to determine whether the bowler has bowled a no-ball.", "prediction 4": "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side. The popping crease is the line through the centres of the three stumps at each end and is 8 ft 8 in (2.64 m) long, with the stumps in the centre. The bowling crease is the line through the centres of the three stumps at each end of the imaginary line joining the centres of the two middle stumps. The return creases lie either side of the popping crease and are considered unlimited in length and must be marked to a minimum of 8 feet (2.44 m) from the popping crease.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 678, "end": 769 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 526, "end": 534 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 378 }, { "error type": "Irrelevant", "explanation": "", "start": 398, "end": 462 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the sport of cricket, the crease is a certain area demarcated by white lines painted or chalked on the field of play, and pursuant to the rules of cricket they help determine legal play in different ways for the fielding and batting side. They define the area within which the batsmen and bowlers operate. The term \"crease\" may refer to any of the lines themselves, particularly the popping crease, or to the region that they demark. Law 7 of the Laws of Cricket governs the size and position of the crease markings, and defines the actual line as the back edge of the width of the marked line on the grass, i.e., the edge nearest to the wicket at that end.The popping crease is drawn four feet away from the bowling crease. Four return creases are drawn, one on each side of each set of stump. The return creases lie perpendicular to the popping crease and to the bowling crease. The return creases lie 4 feet 4 inches either side of and parallel to the imaginary line joining the two middle stumps. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who plays ted how i met your mother?", "passages": [ [ "Ted Mosby", "Ted Mosby\n\nTheodore Evelyn Mosby is a fictional character and the main protagonist in the U.S. television sitcom \"How I Met Your Mother\", portrayed by Josh Radnor.", "Ted also serves as the show's narrator from the future, voiced by Bob Saget, as he tells his children the \"long version\" of how he met their mother.", "Ted is the central character of the show.", "Born April 25, 1978, he is from Shaker Heights, Ohio (like show creator Carter Bays), a graduate of Wesleyan University (like Bays and show co-creator Craig Thomas), an Eagle Scout, and an architect.", "After his best friend, Marshall Eriksen, gets engaged in the pilot episode, Ted decides to try to find his soulmate.", "This quest informs the general direction of the show, along with Ted's relationship with the other main characters Marshall Eriksen (Jason Segel), Lily Aldrin (Alyson Hannigan), Robin Scherbatsky (Cobie Smulders), and Barney Stinson (Neil Patrick Harris).", "Ted's character is based largely on the show's creator, Carter Bays, with the friendship between him and fellow creator Craig Thomas being the base for the friendship between Ted and Marshall." ] ], "gold": "Ted Mosby is the central character on the US television sitcom How I Met Your Mother. In a way, Ted is played by two different actors. Actor Josh Radnor plays the Ted character that is seen on screen throughout the series. And, Bob Saget voices the version of Ted that lives in the future and narrates the show.", "prediction 1": "Ted Mosby is the main protagonist of the sitcom How I Met Your Mother. Ted's character is played by Josh Radnor. Ted also serves as the show's narrator from the future, voiced by Bob Saget, as he tells his children the \"long version\" of how he met their mother.", "prediction 2": "Theodore Evelyn Mosby is a fictional character in the U.S. television sitcom \"How I Met Your Mother\". The character is played by Josh Radnor.", "prediction 3": "Theodore Evelyn Mosby is the main protagonist of the sitcom \"How I Met Your Mother\". Josh Radnor plays Ted. Ted also serves as the show's narrator from the future, voiced by Bob Saget, as he tells his children the \"long version\" of how he met his mother.", "prediction 4": "Josh Radnor plays the role of Ted Mosby on the sitcom How I Met Your Mother. Ted is played by Josh Radnor and his character Theodore Evelyn Mosby is portrayed by Josh Radnor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 261 } ], "missing-info": [], "corrected-prediction": "Ted Mosby is the main protagonist of the sitcom How I Met Your Mother. Ted's character is played by Josh Radnor. Ted also serves as the show's narrator from the future, voiced by Bob Saget." }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "When did puerto become part of the usa?", "passages": [ [ "Puerto Rico", "Puerto Rico\n\nPuerto Rico (Spanish for \"Rich Port\"), officially the Commonwealth of Puerto Rico (, \"Free Associated State of Puerto Rico\") and briefly called Porto Rico, is an unincorporated territory of the United States located in the northeast Caribbean Sea, approximately southeast of Miami, Florida.", "An archipelago among the Greater Antilles, Puerto Rico includes the eponymous main island and several smaller islands, such as Mona, Culebra, and Vieques.", "The capital and most populous city is San Juan.", "The territory's total population is approximately 3.4 million.", "Spanish and English are the official languages, although though Spanish predominates.", "Puerto Rico's unique heritage, culture, and natural beauty has made it a top tourism destination.", "Originally populated by the indigenous Ta\u00edno people, Puerto Rico was colonized by Spain following the arrival of Christopher Columbus in 1493.", "It was contested by French, Dutch, and British, but remained a Spanish possession for the next four centuries.", "The island's cultural and demographic landscapes were shaped by the displacement and assimilation of the native population, the forced migration of African slaves, and settlement from the Canary Islands and Andalusia.", "In the Spanish Empire, Puerto Rico played a secondary but strategic role compared to wealthier colonies like Peru and New Spain." ], [ "5th Cavalry Regiment", "As the US mobilized for war, the 5th Cavalry was sent from San Antonio, Texas to Tampa, Florida.", "A shortage of naval transports and an abundance of military units eager to get into the action meant that the 5th Cavalry Regiment had to be split up, and only a few troops made it to Puerto Rico in time to engage the enemy.", "Alongside 17,000 other US troops, the troopers landed on the southwest coast of Puerto Rico at the port of Gu\u00e1nica, 15 miles west of Ponce.", "In July 1898, the regiment was split into four columns of both dismounted scouts and mounted cavalry, and in early August began patrolling across the mountainous enemy-held countryside.", "Troop A saw most of the action in the Puerto Rican Campaign; under General Theodore Schwan, it was part of the 2,800 man \"Independent Regular Brigade.\"", "Troop A performed well at the Battle of Silva Heights, at Las Marias and at Hormigueros where the 1,400 Spanish defenders beat a hasty retreat.", "The regiment's service in this war is symbolized by the white Maltese cross in the black chief of the upper half of the regimental coat of arms.", "The Spanish turned over the island of Puerto Rico to the United States on 10 December 1898.", "The 5th Cavalry remained on the island until early in 1899, when it returned to San Antonio." ], [ "Puerto Rico", "Recent research suggests that the U.S. did consider Puerto Rico valuable as a naval station, and recognized that it and Cuba generated lucrative crops of sugar \u2013 a valuable commercial commodity which the United States lacked, before the development of the sugar beet industry in the United States.", "On July 25, 1898, during the Spanish\u2013American War, the U.S. invaded Puerto Rico with a landing at Gu\u00e1nica.", "As an outcome of the war, Spain ceded Puerto Rico, along with the Philippines and Guam, then under Spanish sovereignty, to the U.S. under the Treaty of Paris, which went into effect on April 11, 1899.", "Spain relinquished sovereignty over Cuba, but did not cede it to the U.S.", "The United States and Puerto Rico began a long-standing metropolis-colony relationship.", "In the early 20th century, Puerto Rico was ruled by the military, with officials including the governor appointed by the President of the United States.", "The Foraker Act of 1900 gave Puerto Rico a certain amount of civilian popular government, including a popularly elected House of Representatives.", "The upper house and governor were appointed by the United States.", "Its judicial system was constructed to follow the American legal system; a Puerto Rico Supreme Court and a United State District Court for the territory were established.", "It was authorized a non-voting member of Congress, by the title of \"Resident Commissioner\", who was appointed." ] ], "gold": "Puerto Rico, officially the Commonwealth of Puerto Rico, is a Caribbean island and unincorporated territory of the United States. It is located in the northeast Caribbean Sea, approximately 1,000 miles (1,600 km) southeast of Miami, Florida. It became a part of the US due to the Treaty of Paris of 1898, which was signed on 10 December 1898 and came into effect on April 11, 1899.", "prediction 1": "The Spanish turned over the island of Puerto Rico to the United States on 10 December 1898, during the Spanish\u2013American War. As an outcome of the war, Spain ceded Puerto Rico, along with the Philippines and Guam, then under Spanish sovereignty, to the U.S. under the Treaty of Paris, which went into effect on April 11, 1899.\n", "prediction 2": "The Spanish turned Puerto Rico over to the United States as part of their possession of the Americas after the Spanish\u2013American War on 10 December 1898. Puerto Rico officially became a territory of the United States on 15 December 1898, 1 January 1899; its citizenship was not recognized until 1899.", "prediction 3": "The Spanish turned over the island of Puerto Rico to the United States on 10 December 1898. The 5th Cavalry Regiment remained on the island until early in 1899, when it returned to San Antonio. Puerto Rico began a long-standing metropolis-colony relationship with the United States when it was governed by the military with officials including the governor appointed by the President of the United States.", "prediction 4": "The United States conquered Puerto Rico on 10 December 1898 after Spanish troops invaded, but retained full control of the territory until April 11, 1899, when the treaty of Paris came into effect.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 150 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 244 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Puerto Rico, officially the Commonwealth of Puerto Rico, is a Caribbean Island and unincorporated territory of the United States. It is located in the northeast Caribbean Sea, southeast of Miami, Florida. Spain ceded Puerto Rico to the U.S. under the Treaty of Paris, which went into effect on April 11, 1899.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the song it's just an illusion?", "passages": [ [ "Just an Illusion", "Just an Illusion\n\n\"Just an Illusion\" is a song by the British trio Imagination.", "Co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, the song was a major European hit, peaking at number 2 in the group's native UK.", "In the United States, \"Just an Illusion\" went to number 27 on the Black chart.", "The song also peaked at number 15 on the dance charts.", "7\" Single" ], [ "Leee John", "Leee John\n\nLeee John (born Leslie McGregor John, 23 June 1957) is an English musician, singer, and actor of St Lucian descent.", "He was born in Hackney, London, and educated in New York City, later studying drama at the Anna Scher Theatre School.", "He is perhaps best known as the lead singer of the soul band Imagination, which had three UK Top 10 hits in the early 1980s.", "He was working as a backing singer when he met Ashley Ingram (born 27 November 1960, Northampton, England) a guitarist/bassist.", "They formed a songwriting partnership, working in a short-lived band called Fizzz.", "Together with Ingram and Errol Kennedy (born 9 June 1953, Montego Bay, Jamaica) they formed Imagination, a three-piece soul music band, in the early 1980s.", "Produced by Jolley & Swain, their hit \"Body Talk\" reached number 4 in the UK Singles Chart in May 1981.", "Their biggest hit, \"Just an Illusion\", peaked at number 2 in March 1982.", "The trio frequently appeared on \"Top of the Pops\" and other pop music programmes." ] ], "gold": "\"Just an Illusion\" is a song by the British trio Imagination. It was co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, who was the lead singer in the band. The song was a major European hit, peaking at number 2 in the group's native UK. In the United States the song went to number 27 on the Black chart.", "prediction 1": "\"Just an Illusion\" is a song by the British soul band Imagination, co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John. It was a major European hit, peaking at number 2 in the group's native UK. In the United States, \"Just an Illusion\" went to number 27 on the Black chart. It also peaked at number 15 on the dance charts.", "prediction 2": "\"Just an Illusion\" is a song by the British soul band Imagination. Co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, the song was a major European hit, peaking at number 2 in the group's native UK. In the United States, \"Just an Illusion\" went to number 27 on the Black chart. Leee John is an English musician, singer, and actor of St Lucian descent. He is perhaps best known as the lead singer of the soul band Imagination, which had three UK Top 10 hits in the early 1980s.", "prediction 3": "\"Just an Illusion\" is a song by the British soul band Imagination. Co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, the song was a major European hit, peaking at number 2 in the group's native UK. In the United States, \"Just an Illusion\" went to number 27 on the Black chart. It also peaked at number 15 on the dance charts.", "prediction 4": "\"Just an Illusion\" is a song by the British soul band Imagination. Co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, the song was a major European hit, peaking at number 2 in the group's native UK. In the United States, \"Just an Illusion\" went to number 27 on the Black chart. The song also peaked at number 15 on the dance charts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 338 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Just an Illusion\" is a song by the British soul band Imagination, co-written by Steve Jolley, Tony Swain, Ashley Ingram and Leee John, who was the lead singer in the band. It was a major European hit, peaking at number 2 in the group's native UK. In the United States, \"Just an Illusion\" went to number 27 on the Black chart." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who scored the fastest goal in fifa world cup?", "passages": [ [ "Hakan \u015e\u00fck\u00fcr", "Hakan \u015e\u00fck\u00fcr\n\nHakan \u015e\u00fck\u00fcr (born 1 September 1971) is a retired Turkish footballer who played as a striker.", "Nicknamed the \"Bull of the Bosphorus\" and \"Kral\" (king), he spent the majority of his professional career with Galatasaray, being a three-time \"Gol Kral\u0131\" (Goal King, title and award given to the annual top goalscorer of the S\u00fcper Lig), representing the club in three different spells and winning a total of 14 major titles.", "\u015e\u00fck\u00fcr represented Turkey a total of 112 times, scoring 51 goals, making him the nation's top goalscorer and 19th in the world at the time of his retirement.", "One of the most prolific strikers of the modern era, he netted 383 goals throughout his club career as well as the fastest ever in a World Cup, in 2002.", "He retired from football in 2008, only scoring once in single digits for his main team in 13 seasons; he was renowned for his heading ability.", "In the 2011 general elections, he was elected as an Istanbul MP for the Justice and Development Party.", "He resigned from the party in December 2013, continuing to serve as an independent.", "Born in Adapazar\u0131, Sakarya Province, \u015e\u00fck\u00fcr began his football career with local club Sakaryaspor, making his professional debut shortly after his 17th birthday." ], [ "Johan Neeskens", "Johan Neeskens\n\nJohannes Jacobus \"Johan\" Neeskens (; born 15 September 1951) is a Dutch football manager and former midfielder.", "As a player, he was an important member of the Dutch national team that finished as runners-up in the 1974 and 1978 FIFA World Cups and is considered to be one of the greatest Dutch midfielders of all time.", "In 2004, he was named one of the 125 Greatest Living Footballers at a FIFA Awards Ceremony, while in 2017 he has been included in the \"FourFourTwo\" list of the 100 all-time greatest players, at the 64th position.", "After his retirement in 1991, Neeskens was the assistant coach to Frank Rijkaard at Barcelona but was sacked along with Rijkaard as the end of the 2007\u201308 season.", "He later became head coach of the Dutch B national team until June 2009, at which date he has been appointed as the assistant coach to Frank Rijkaard at Galatasaray SK.", "Neeskens, a native of Heemstede, started his career at RCH Heemstede in 1968, before being spotted by Rinus Michels and signed for Ajax in 1970.", "The youngster impressed at right-back, playing in that position for Ajax in the 1971 European Cup Final win against Panathinaikos." ], [ "Christian Benteke", "Christian Benteke\n\nChristian Benteke Liolo (born 3 December 1990) is a Belgian professional footballer who plays as a striker for English club Crystal Palace and the Belgium national team.", "He began his career at Standard Li\u00e8ge, playing a part in their 2008\u201309 Belgian First Division triumph.", "Following a season at Genk he was signed for \u00a37 million by Aston Villa.", "He scored 49 goals in 100 matches for Villa across all competitions, including 19 Premier League goals in his debut season and helping them to the 2015 FA Cup Final, before transferring to Liverpool in 2015 for \u00a332.5 million.", "Benteke has earned over 30 caps for Belgium since making his debut in 2010.", "He missed the 2014 FIFA World Cup through injury, but was part of their team that reached the quarter-finals of UEFA Euro 2016.", "Benteke was born in Kinshasa in 1990.", "He and his family fled during the Mobutu regime and in 1993 emigrated to Li\u00e8ge, Belgium.", "Benteke played youth football for JS Pierreuse and later Standard Li\u00e8ge before moving to Genk.", "He rejoined Standard in January 2009 and scored three goals in 12 matches as the Walloon club won the 2008\u201309 Belgian championship." ] ], "gold": "There has been several fastest goals in the FIFA World Cup. Hakan \u015e\u00fck\u00fcr, a Turkish former professional footballer who played as a striker, scored the fastest goal from kick-off in the FIFA World Cup. Johan Neeskens, a Dutch football manager and former midfielder, scored the fastest goal in a FIFA World Cup Final. Christian Benteke Liolo, a Belgian professional footballer who plays as a striker for Premier League club Crystal Palace and the Belgium national team, scored the fastest goal in a FIFA World Cup qualifying match.", "prediction 1": "The fastest goal in a World Cup was scored by Belgium against South Africa in the 2006 FIFA World Cup. The fastest goal scored in a World Cup was by Norway's Anders Fogd in the 2010 FIFA World Cup. The goal was scored by Hakan \u00fck\u00fcr, a retired Turkish footballer who played as a striker.", "prediction 2": "The fastest goal in a World Cup was scored by Johan Neeskens in 2002. Hakan \u00fck\u00fcr scored the fastest goal in a Football World Cup in 2002. Christian Benteke scored the fastest goal in a Football World Cup in 2015.", "prediction 3": "The goal with the fastest goal in the history of the FIFA World Cup was scored by Hakan \u00fck\u00fcr in 2002, scoring 383 goals. Johan Neeskens scored the fastest goal in the history of the FIFA World Cup in 2002, scoring 49 goals in 100 matches.", "prediction 4": "The footballer who scored the fastest goal in a World Cup was Hakan \u00fck\u00fcr, who played as a striker for Galatasaray SK. Brazilian striker Christian Benteke scored the fastest goal in a World Cup, scoring 49 minutes and 12 seconds. Ajax substitute Florin Vargas scored the fastest goal in a World Cup, scoring 25 minutes and 17 seconds. In the 2002 FIFA World Cup, Brazilian striker Vargas scored the fastest goal in a World Cup, scoring 62 seconds, scoring a goal.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 43, "end": 102 }, { "error type": "Redundant", "explanation": "The fastest goal in a World Cup was scored by Belgium against South Africa in the 2006 FIFA World Cup. ", "start": 103, "end": 197 } ], "missing-info": [], "corrected-prediction": "The fastest goal in a World Cup was scored in 2002 by Hakan \u00fck\u00fcr, a retired Turkish footballer who played as a striker." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings i need a hero in footloose?", "passages": [ [ "Holding Out for a Hero", "Holding Out for a Hero\n\n\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film \"Footloose\", and later included on her 1986 album \"Secret Dreams and Forbidden Fire\".", "It was written by Jim Steinman and Dean Pitchford.", "Initially, the song only just reached the Top 100 in the UK Singles Chart, but made it to number 2 the following year, and re-entered the charts again at number 69 in 1991.", "The song reached No. 1 on the Irish Singles Chart on 28 September 1985.", "It reached the top 40 in the United States and Canada.", "The song's instrumental break was reused from an earlier song by Jim Steinman called \"Stark Raving Love\", which featured on Steinman's 1981 album \"Bad for Good\".", "Jim Steinman had been recruited to work on the \"Footloose\" soundtrack, for which he wrote \"Holding Out for a Hero\" with Dean Pitchford.", "Steinman suggested Tyler's name when he was approached about finding a singer to record the song.", "Tyler recorded the song at the Paramount Studios, and was shown the scene of the film where the song would feature.", "Around the world, \"Holding Out for a Hero\" has become considered a torch song." ] ], "gold": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose. In the Footloose Musical, the characters Ariel, Rusty, Urleen, Wendy Jo, and the Girls sing the song. They are played by Jennifer Laura Thompson, Rosalind Brown, and Stacy Francis.", "prediction 1": "Holding Out for a Hero is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose, and later included on her 1986 album Secret Dreams and Forbidden Fire. The song was written by Jim Steinman and Dean Pitchford. Around the world, \"Holding Out for a Hero\" has become considered a torch song.", "prediction 2": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose. It was written by Jim Steinman and Dean Pitchford.", "prediction 3": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose, and later included on her 1986 album Secret Dreams and Forbidden Fire. The song was written by Jim Steinman and Dean Pitchford.", "prediction 4": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose. It was written by Jim Steinman and Dean Pitchford. The song's instrumental break was reused from an earlier song by Steinman called \"Stark Raving Love\", which featured on Steinman's 1981 album Bad for Good. The song reached No. 1 on the Irish Singles Chart on 28 September 1985.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 324 } ], "missing-info": [], "corrected-prediction": "Holding Out for a Hero is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What movie was the song material girl in?", "passages": [ [ "Material Girl", "According to Haylie, the song was to be released as a single but there was no time to shoot a music video.", "Icelandic singer Hafd\u00eds Huld performed the song at The Secret Garden Festival and The Big Chill in the summer of 2007.", "On her sold out May 16, 2009, concert at the National Auditorium of Mexico City, Mexican Latin Pop singer, Yuridia performed a cover version of \"Material Girl\".", "An avant-garde/folk rock cover of the song by Mountain Party was included on the 2007 Madonna tribute compilation \"Through the Wilderness\".", "\"Material Girl\" was part of the \"Sparkling Diamonds\" medley in the 2001 film \"Moulin Rouge!\".", "In the 2004 movie \"\", the song was used for the scene where Bridget gets out of a Thai jail.", "The 2006 Nintendo DS rhythm-action game \"Elite Beat Agents\" contains a cover version of the song for one of the game's levels.", "The level follows two celebutantes trapped on a deserted island.", "It also appears in the video game Karaoke Revolution Party and in Nintendo's Wii Music, a 2008 music video game for the Wii.", "In 2010, Elton John performed a cover version of \"Material Girl\" at the Rainforest Fund Benefit Concert." ], [ "Material Girl", "The music video was a mimicry of Marilyn Monroe's performance of the song \"Diamonds Are a Girl's Best Friend\" from the 1953 film \"Gentlemen Prefer Blondes\".", "The mimicked scenes are interspersed with scenes of a Hollywood director trying to win the heart of an actress, played by Madonna herself.", "Discovering that, contrary to her song, the young woman was not impressed by money and expensive gifts, he pretended to be penniless and succeeded in taking her out on a date.", "She has performed the song in five of her world tours; most of her performances of the song on tour are mimicries of the song's music video.", "\"Material Girl\" has been covered by a number of artists, including Britney Spears and Hilary and Haylie Duff.", "It has appeared in the films \"Moulin Rouge!\"", "(2001), \"\" (2004), \"Material Girls\" (2006), and \"Crazy Rich Asians\" (2018).", "Madonna has often remarked that she regrets recording \"Material Girl\" as its title became a nickname for her in the mainstream media.", "The song has been labeled an empowering influence for women, and was the subject of debates.", "\"Material Girl\" was written by Peter Brown and Robert Rans, while Nile Rodgers produced the track." ], [ "Material Girl", "Material Girl\n\n\"Material Girl\" is a song recorded by American singer Madonna for her second studio album \"Like a Virgin\" (1984).", "It was released on January 23, 1985, by the Sire label as the second single from \"Like a Virgin\".", "It also appears slightly remixed on the 1990 greatest hits compilation, \"The Immaculate Collection\", and in its original form on the 2009 greatest hits compilation, \"Celebration\".", "The song was written by Peter Brown and Robert Rans, while Nile Rodgers produced the track.", "Madonna explained that the concept of the song was indicative of her life at that time, and she liked it because she felt it was provocative.", "\"Material Girl\" consists of synth arrangements with a robotic-sounding voice chant repeating the hook, \"living in a material world\".", "The lyrics identify with materialism, with Madonna asking for a rich and affluent life, rather than romance and relationships.", "Contemporary critics have frequently identified \"Material Girl\" along with \"Like a Virgin\" as the songs that established Madonna as an icon.", "\"Material Girl\" was a commercial success, reaching the top-five in Australia, Belgium, Canada, Ireland, Japan and United Kingdom.", "It reached the number two position on the \"Billboard\" Hot 100 in the United States, becoming her third top-five single there." ] ], "gold": "\"Material Girl\" is a song recorded by American singer Madonna and released on November 30, 1984, by the Sire label as the second single for her album \"Like a Virgin.\" The song was a commercial success, reaching the top five in Australia, Belgium, Canada, Ireland, Japan, and the United Kingdom, the number two position on the Billboard Hot 100 in the United States and later appearing in various movies. It was part of the \"Sparkling Diamonds\" medley in the 2001 film \"Moulin Rouge!\" and the 2004 movie \"Bridget Jones: The Edge of Reason,\" where the song was used for the scene where Bridget gets out of a Thai jail. It was also in the 2006 movie \"Material Girls\" and 2018's \"Crazy Rich Asians.\"", "prediction 1": "Material Girl was part of the \"Sparkling Diamonds\" medley in the 2001 film \"Moulin Rouge!\", while in the 2004 movie \", the song was used for the scene where Bridget gets out of a Thai jail. In 2010, Elton John performed a cover version of \"Material Girl\" at the Rainforest Fund Benefit Concert.", "prediction 2": "Material Girl is a song by American singer Madonna. The song was recorded for her second studio album, Like a Virgin. The music video was a mimicry of Marilyn Monroe's performance of the song \"Diamonds Are a Girl's Best Friend\" from the 1953 film Gentlemen Prefer Blondes. The song was used for the scene where Bridget gets out of a Thai jail.", "prediction 3": "\"Material Girl\" is a song by American singer Madonna originally released on her album Like a Virgin in 1984. The music video for the song was a mimicry of Marilyn Monroe's performance of the song Diamonds Are a Girl's Best Friend from the 1953 film Gentlemen Prefer Blondes. The song was to be released as a single but there was no time to shoot a music video.", "prediction 4": "Material Girl is a song that was originally released as a single by American singer Madonna in 1984. In 2001, Material Girl was part of the \"Sparkling Diamonds\" medley in the film Moulinettes. In the 2004 movie Material Girls, the song was used for the scene where Bridget gets out of a Thai jail.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 294 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": " \"Material Girl\" is a song recorded by American singer Madonna for her second studio album \"Like a Virgin\" (1984), It was released on January 23, 1985, by the Sire label as the second single from the album. It was a commercial success, reaching the top-five in Australia, Belgium, Canada, Ireland, Japan and United Kingdom. It reached the number two position on the \"Billboard\" Hot 100 in the United States. It was part of the \"Sparkling Diamonds\" medley in the 2001 film \"Moulin Rouge!\", The song was used for the scene where Bridget gets out of a Thai jail, in the 2004 movie. Other movies include \"Material Girls\" (2006), and \"Crazy Rich Asians\" (2018)." }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "What female hormone that isn't produced by the follicle is now being produced by the corpus luteum?", "passages": [ [ "Corpus luteum", "Corpus luteum\n\nThe corpus luteum (Latin for \"yellow body\"; plural corpora lutea) is a temporary endocrine structure in female ovaries and is involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen.", "It is the remains of the ovarian follicle that has released a mature ovum during a previous ovulation.", "The corpus luteum is colored as a result of concentrating carotenoids (including lutein) from the diet and secretes a moderate amount of estrogen to inhibit further release of gonadotropin-releasing hormone (GnRH) and thus secretion of luteinizing hormone (LH) and follicle-stimulating hormone (FSH).", "A new corpus luteum develops with each menstrual cycle.", "The \"corpus luteum\" develops from an ovarian follicle during the luteal phase of the menstrual cycle or oestrous cycle, following the release of a secondary oocyte from the follicle during ovulation." ] ], "gold": "The corpus luteum is a temporary endocrine structure in female ovaries that develops from an ovarian follicle during the luteal phase of the menstrual cycle or oestrous cycle, following a secondary oocyte release from the follicle ovulation. It is involved in producing relatively high levels of progesterone and moderate levels of estradiol and inhibin A, hormones that the follicle doesn't produce. This structure is the remains of the ovarian follicle that has released a mature ovum during a previous ovulation.", "prediction 1": "The corpus luteum, Latin for \"yellow body,\" is a temporary endocrine structure in female ovaries involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen. The corpus luteum develops from an ovarian follicle during the luteal phase of the menstrual cycle or oestrous cycle, following the release of a secondary oocyte from the follicle-stimulating hormone (FSH).", "prediction 2": "The corpus luteum, known as a yellow body, is a temporary endocrine structure in female ovaries that is involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen. It is colored as a result of concentrating carotenoids, including lutein, from the diet and secretes a moderate amount of estrogen to inhibit further release of gonadotropin-releasing hormone (GnRH) and thus secretion of luteinizing hormone (LH) and follicle-stimulating hormone (FSH).", "prediction 3": "The corpus luteum is a temporary endocrine structure in female ovaries that is involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen. It is the remains of the ovarian follicle that has released a mature ovum during a previous ovulation.", "prediction 4": "The corpus luteum is a temporary endocrine structure in female ovaries and is involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen. It is the remains of the ovarian follicle that has released a mature ovum during a previous ovulation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 43 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 444 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The corpus luteum, Latin for \"yellow body,\" is a temporary endocrine structure in female ovaries involved in the production of relatively high levels of progesterone, moderate levels of estradiol, inhibin A and small amounts of estrogen. It is the remains of the ovarian follicle that has released a mature ovum during a previous ovulation. The \"corpus luteum\" develops from an ovarian follicle during the luteal phase of the menstrual cycle or oestrous cycle, following the release of a secondary oocyte from the follicle during ovulation." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who was the host of the dating game?", "passages": [ [ "The Dating Game", "The Dating Game\n\nThe Dating Game is an ABC television show.", "It first aired on December 20, 1965 and was the first of many shows created and packaged by Chuck Barris from the 1960s through the 1980s.", "ABC dropped the show on July 6, 1973, but it continued in syndication for another year (1973\u20131974) as \"The New Dating Game\".", "The program was revived three additional times in syndication afterwards.", "The first revival premiered in 1978 and ran until 1980, the second ran from 1986 until 1989, and the last ran from 1996 until 1999 with a season of reruns following.", "Jim Lange hosted \"The Dating Game\" for its entire ABC network run and the 1973 and 1978 syndicated editions.", "The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons.", "When the show was revived with a different format in 1996, Brad Sherwood was named as its host.", "Chuck Woolery took over in 1997 after he left \"The Home and Family Show\" when the original format was reinstated and hosted for the last two seasons.", "Beginning in 1966, \"The Dating Game\" was often paired with \"The Newlywed Game\"." ] ], "gold": "Jim Lange hosted The Dating Game for its entire ABC network run and for the 1973 and 1978 syndicated editions. The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons in 1987-1988. When the show was revived with a different format in 1996, Brad Sherwood was named as its host. Chuck Woolery took over for the two final seasons, with the original format reinstated, from 1997-1998.", "prediction 1": "Jim Lange hosted The Dating Game for its entire ABC network run and the 1973 and 1978 syndicated editions. The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons. When the show was revived with a different format in 1996, Brad Sherwood was named as its host. Chuck Woolery took over in 1997 after he left \"The Home and Family Show\" when the original format was reinstated and hosted for the last two seasons.", "prediction 2": "The Dating Game is an ABC television show. It first aired on December 20, 1965 and was the first of many shows created and packaged by Chuck Barris from the 1960s through the 1980s. ABC dropped the show on July 6, 1973, but it continued in syndication for another year (1973\u20131974) as \"The New Dating Game\". The program was revived three additional times in syndication afterwards. The first revival premiered in 1978 and ran until 1980, the second ran from 1986 until 1989, and the last ran from 1996 until 1999 with a season of reruns following. When the show was revived with a different format in 1996, Chuck Woolery was named as its host. When the show was revived with a different format in 1996, Brad Sherwood was named as its host.", "prediction 3": "The Dating Game was a television show created and packaged by Chuck Barris from the 1960s through the 1980s. Jim Lange hosted the show for its entire ABC network run and the 1973 and 1978 syndicated editions. The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons. When the show was revived with a different format in 1996, Brad Sherwood was named as its host. Chuck Woolery took over in 1997 after he left The Home and Family Show when the original format was reinstated and hosted for the last two seasons. When the show was revived with a different format in 1996, Brad Sherwood was named as its host.", "prediction 4": "The Dating Game is an ABC television show. It first aired on December 20, 1965. Jim Lange hosted \"The Dating Game\" for its entire ABC network run and the 1973 and 1978 syndicated editions. The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons. When the show was revived with a different format in 1996, Brad Sherwood was named as its host. Chuck Woolery took over in 1997 after he left \"The Home and Family Show\" when the original format was reinstated and hosted for the last two seasons. Chuck Woolery took over in 1997 after he left \"The Home and Family Show\" when the original format was reinstated and took over in 1997.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Jim Lange hosted The Dating Game for its entire ABC network run and the 1973 and 1978 syndicated editions. The 1986 revival was hosted by Elaine Joyce for its first season and Jeff MacGregor for its remaining two seasons. When the show was revived with a different format in 1996, Brad Sherwood was named as its host. Chuck Woolery took over in 1997 after he left \"The Home and Family Show\" when the original format was reinstated and hosted for the last two seasons." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Which geographical part of haryana is shivalik hills situated?", "passages": [ [ "Sivalik Hills", "Sivalik Hills\n\nThe Sivalik Hills, also known as \"Churia Hills\", are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra.", "It is wide with an average altitude of .", "Between the Teesta and Raid\u0101k Rivers in Assam is a gap of about .", "In some Sanskrit texts, the region is called \"Manak Parbat\".", "Sivalik literally means 'tresses of Shiva\u2019.", "Geologically, the Sivalik Hills belong to the Tertiary deposits of the outer Himalayas.", "They are chiefly composed of sandstone and conglomerate rock formations, which are the solidified detritus of the Himalayas to their north; they poorly consolidated.", "The remnant magnetization of siltstones and sandstones indicates that they were deposited 16\u20135.2 million years ago.", "In Nepal, the Karnali River exposes the oldest part of the Shivalik Hills.", "They are the southernmost and geologically youngest east-west mountain chain of the Himalayas.", "They have many sub-ranges and extend west from Arunachal Pradesh through Bhutan to West Bengal, and further westward through Nepal (here known as \"Churia Hills\") and Uttarakhand, continuing into Himachal Pradesh and Kashmir.", "The hills are cut through at wide intervals by numerous large rivers flowing south from the Himalayas." ] ], "gold": "The Shivalik Hills, also known as the Sivalik Hills and Churia Hills, are a mountain range of the outer Himalayas that stretches from the Indus River about 1,500 miles eastwards close to the Brahmaputra River, spanning across the northern parts of the Indian subcontinent.", "prediction 1": "The Sivalik Hills, also known as Chiuria Hills, are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra, and covers an area of about 63 square kilometers. Geologically, the Sivalik Hills belong to the Tertiary deposits of the outer Himalayas and are chiefly composed of sandstone and conglomerate rock formations, which are the solidified detritus of the Himalayas to their north; they poorly consolidated.", "prediction 2": "The Sivalik Hills are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra. They are the southernmost and geologically youngest east-west mountain chain of the Himalayas. They are cut through at wide intervals by numerous large rivers flowing south from the Himalayas.", "prediction 3": "The Sivalik Hills, also known as \"Churia Hills\", are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra. Geologically, the Sivalik Hills belong to the Tertiary deposits of the outer Himalayas and are chiefly composed of sandstone and conglomerate rock formations, which are the solidified detritus of the Himalayas to their north; they poorly consolidated.", "prediction 4": "The Sivalik Hills, also known as \"Churia Hills\", are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra. They are the southernmost and geologically youngest east-west mountain chain of the Himalayas. The hills are cut through at wide intervals by numerous large rivers flowing south from the Himalayas.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 471 } ], "missing-info": [], "corrected-prediction": "The Sivalik Hills, also known as Chiuria Hills, are a mountain range of the outer Himalayas that stretches from the Indus River about eastwards close to the Brahmaputra. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the drought started in south africa?", "passages": [ [ "Cape Town water crisis", "Cape Town water crisis\n\nThe Cape Town water crisis in South Africa began in 2015, resulting in a severe water shortage in the region, most notably affecting the City of Cape Town.", "In early 2018, the dam levels were predicted to decline to critically low levels by April, the City announced plans for \"Day Zero\", when the municipal water supply would largely be shut off if a particular lower limit of water storage was reached, potentially making Cape Town the first major city to run out of water.", "Through water saving measures and water supply augmentation, the City had reduced its daily water usage by more than half to around 500 million litres () per day in March 2018.", "By June 2018 dam levels had increased to 43% of capacity, which enabled the City of Cape Town to announce that \"Day Zero\" was unlikely for 2019.", "In September, with dam levels close to 70%, the city began easing water restrictions.", "The Cape Town region experiences a Mediterranean climate with warm, dry summers and winter rainfall.", "Water is supplied largely from the six major dams of the Western Cape Water Supply System which are situated in the nearby mountainous areas.", "The dams are recharged by rain falling in the catchment areas, largely during the cooler winter months of May to August, and dam levels decline during the dry summer months of November to April during which urban water use increases and irrigation takes place in the agricultural areas." ], [ "2011 East Africa drought", "2011 East Africa drought\n\nBetween July 2011 and mid-2012, a severe drought affected the entire East Africa region.", "Said to be \"the worst in 60 years\", the drought caused a severe food crisis across Somalia, Djibouti, Ethiopia and Kenya that threatened the livelihood of 9.5 million people.", "Many refugees from southern Somalia fled to neighboring Kenya and Ethiopia, where crowded, unsanitary conditions together with severe malnutrition led to a large number of deaths.", "Other countries in East Africa, including Sudan, South Sudan and parts of Uganda, were also affected by a food crisis.", "According to FAO-Somalia, the food crisis in Somalia primarily affected farmers in the south rather than the northern pastoralists.", "Human Rights Watch (HRW) consequently noted that most of the displaced persons belonged to the agro-pastoral Rahanweyn clan and the agricultural Bantu ethnic minority group.", "On 20 July, the United Nations officially declared famine in two regions in the southern part of the country (IPC Phase 5), the first time a famine had been declared in the region by the UN in nearly thirty years.", "Tens of thousands of people are believed to have died in southern Somalia before famine was declared.", "This was mainly a result of Western governments preventing aid from reaching affected areas in an attempt to weaken the Al-Shabaab militant group, against whom they were engaged." ] ], "gold": "The Cape Town water crisis in South Africa was a period of severe water shortage in the Western Cape region, most notably affecting the City of Cape Town. While dam water levels had been declining since 2015, the Cape Town water crisis peaked during mid-2017 to mid-2018 where water levels hovered between 15 and 30 per cent of total dam capacity. The 2018\u20132021 Southern Africa drought is an ongoing period of drought taking place in Southern Africa. The drought began in late October 2018, and is negatively affecting food security in the region. ", "prediction 1": "The first major drought in South Africa began in 1965. The Cape Town water crisis began in 2015, resulting in a severe water shortage in the region, most notably affecting the City of Cape Town. Between July 2011 and mid-2012, a severe drought affected the entire East Africa region. The drought caused a severe food crisis across Somalia, Djibouti, Ethiopia and Kenya that threatened the livelihood of 9.5 million people.", "prediction 2": "The current drought in South Africa began in the country in July 2015. In early 2018, the dam levels were predicted to decline to critically low levels by April, resulting in a severe water shortage in the region, most notably affecting the City of Cape Town. In mid-2012, a severe drought affected the entire East Africa region. In the South African province of Port Elizabeth, the drought started in early 2017, with an estimated 60 per cent of the population facing severe water shortages. In southern regions, the drought started in the Cape Town region in early 2018 and continued into 2019.", "prediction 3": "The South African drought started in July 2011 and continued into mid-2012, resulting in severe water shortages in the region, most notably affecting the City of Cape Town. Between July 2011 and mid-2012, a severe drought affected the entire East Africa region, causing a severe food crisis across Somalia, Djibouti, Ethiopia and Kenya that threatened the livelihood of 9.5 million people. The drought was first detected in the Cape Town water crisis in 2015, and it lasted until mid-2017.", "prediction 4": "The South African drought started in May 2015, when the Cape Town water crisis began, resulting in a severe water shortage in the region, most notably affecting the City of Cape Town. In early 2018, the dam levels were predicted to decline to critically low levels by April, the City announced plans for \"Day Zero\", when the municipal water supply would largely be shut off if a particular lower limit of water storage was reached, potentially making Cape Town the first major city to run out of water. The drought also caused a severe food crisis across Somalia, Djiboutibouti, Ethiopia and Kenya that threatened the livelihood of 9.5 million people.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 284, "end": 422 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 54 } ], "missing-info": [], "corrected-prediction": "The Cape Town water crisis began in 2015, resulting in a severe water shortage in the region, most notably affecting the City of Cape Town. Between July 2011 and mid-2012, a severe drought affected the entire East Africa region." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who's opening for bruno mars in montreal?", "passages": [ [ "Moonshine Jungle Tour", "The SD Conversion software was used to transfer between the SD5, used as a backup, and the SD7.", "Shows during the first leg of the North American opened either with Goulding or Fitz and the Tantrums performing their songs.", "The shows in Europe had Mayer Hawthorne as the opening act for Mars, while in Australia Miguel commenced the show.", "In January 2014, a second leg in North America was announced with Pharrell Williams or Aloe Blacc as the supporting acts.", "However, Williams left the tour due to scheduling conflicts after only opening two nights for Mars at the Madison Square Garden.", "He was replaced by Nico & Vinz.", "Fitz and the Tantrums and Williams were considered to be worthy performers.", "However, Miguel was only considered a satisfactory opening act.", "As they finished their performance, a giant black curtain with drawings of gold palm trees was placed in front of the stage.", "A voice-over pronounced, \"Welcome to the Moonshine Jungle\" and suddenly the drape vanished." ], [ "Quebec City Summer Festival", "2013 :", "Def Leppard, Guns N' Roses, Bruno Mars, Wu-Tang Clan, Weezer, Rush, Stevie Wonder, Foreigner, The Black Keys, Ti\u00ebsto, Ellie Goulding.", "2014 :", "Lady Gaga, Billy Joel, Journey, Bryan Adams, The Killers, Soundgarden, Snoop Dogg, Queens Of The Stone Age, Cypress Hill, Deadmau5.", "2015 :", "The Rolling Stones, Foo Fighters, Boston, Megadeth, Keith Urban, Deep Purple, The Doobie Brothers, Jack \u00dc, Iggy Azalea, Milky Chance.", "2016 : Rammstein, Sting, Peter Gabriel, Red Hot Chili Peppers, Duran Duran, Selena Gomez, The Cult, Ice Cube, Brad Paisley, The Lumineers.", "2017", ": Muse, The Who, Metallica, P!nk, Gorillaz, Kendrick Lamar, The Backstreet Boys, Lady Antebellum, Flume, Melissa Etheridge, Migos, DNCE.", "2018 :", "Foo Fighters, The Weeknd, Neil Young, Shawn Mendes, Beck, Lorde, Future, Dave Matthews Band, The Chainsmokers, Jethro Tull, Sum 41. 2019 :", "Announcement first week of march 2019" ] ], "gold": "During the second European and North American leg of his 24K Magic Tour, Bruno Mars had several opening acts, including DJ Rashida in all shows, along with Charlie Wilson, Ciara and Boyz II Men, among others, on selected shows. DJ Rashida did the opening act for the Montreal show. During The Moonshine Jungle Tour, Ellie Goulding opened for Bruno Mars in Montreal during leg 1 and Bebe Rexha opened in Montreal for leg 7.", "prediction 1": "Bruno Mars' North American tour started with either Ellie Goulding or Fitz and the Tantrums opening for him in Montreal. The next week, on April 19, 2019, Miguel opened for Mars at the Montreal Summer Festival.", "prediction 2": "Bruno Mars' North American Moonshine Jungle Tour opened either with Goulding or Fitz and the Tantrums performing their songs. The shows in Europe had Mayer Hawthorne as the opening act for Mars, while in Australia Miguel commenced the show. In January 2014, a second leg in North America was announced with Pharrell Williams or Aloe Blacc as the supporting acts. However, Williams left the tour due to scheduling conflicts after only opening two nights for Mars at the Madison Square Garden. He was replaced by Nico & Vinz.", "prediction 3": "Bruno Mars opened for Fitz and the Tantrums in Montreal on September 9, 2013. Goulding also opened for Mars in Europe on September 8, 2013. In Australia, Miguel opened for Mars on September 10, 2013.", "prediction 4": "Bruno Mars' 2019 Moonshine Jungle Tour starts in Quebec City on August 11, 2019, with Miguel opening for Mars. In Europe, Mayer Hawthorne opened for Mars, while in Australia, Miguel opened for Mars.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 108, "end": 120 }, { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 210 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Bruno Mars' North American Moonshine Jungle Tour tour started with either Ellie Goulding or Fitz and the Tantrums opening for him.. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who do you play as in modern warfare 2?", "passages": [ [ "Call of Duty: Modern Warfare 2", "Call of Duty: Modern Warfare 2\n\nCall of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision.", "It was released worldwide on November 10, 2009 for Microsoft Windows, the PlayStation 3, and Xbox 360.", "A version for OS X was developed by Aspyr and released on May 20, 2014.", "The Xbox 360 version was made backward compatible for the Xbox One in 2018.", "It is the sixth installment of the \"Call of Duty\" series and the direct sequel to \"\", continuing the same storyline.", "It was released in conjunction with two other \"Call of Duty\" games: \"\" for the Nintendo DS, and \"\", a port of \"Call of Duty 4\" adapted by Treyarch for the Wii console.", "The game's campaign follows the Task Force 141, a special forces unit fronted by Captain Soap MacTavish, as they hunt Vladimir Makarov, leader of the Russian Ultranationalist party, and the United States Army Rangers, who are defending the country from a Russian invasion.", "The game's main playable characters are Sergeant Gary \"Roach\" Sanderson, of the 141, and Private James Ramirez, of the Army Rangers, with Captain MacTavish becoming playable later in the campaign." ], [ "Call of Duty: Modern Warfare 3", "Call of Duty: Modern Warfare 3\n\nCall of Duty: Modern Warfare 3 (stylized as Call of Duty: MW3) is a first-person shooter video game, developed by Infinity Ward and Sledgehammer Games, with assistance from Raven Software, and published by Activision.", "The game was released worldwide in November 2011 for Microsoft Windows, the Xbox 360, PlayStation 3, and Wii.", "It is the third installment in the \"Modern Warfare\" saga, a direct sequel to 2009's \"\", and the eighth \"Call of Duty\" installment.", "A for the Nintendo DS was developed by n-Space, while Treyarch developed the game's Wii port.", "In Japan, Square Enix published the game with a separate subtitled and dubbed version.", "The game's campaign follows \"Modern Warfare 2\" and begins right after the events of its final mission.", "Similar to \"Modern Warfare 2\", it is centered around the Task Force 141, which contains Captain Price, Soap MacTavish, and Yuri, one of the playable characters.", "Alongside the Delta Force and Special Air Service, they hunt Vladimir Makarov (antagonist of \"Modern Warfare 2\"), a Russian terrorist who leads the Russian Ultranationalist party.", "He leads several terror attacks across Europe, triggering a large-scale war between the Ultranationalists and friendly forces." ] ], "gold": "Call of Duty: Modern Warfare 2 is a 2009 first-person shooter game developed by Infinity Ward and published by Activision. The game's main playable characters are Sergeant Gary \"Roach\" Sanderson, of the 141, and Private James Ramirez, of the Army Rangers, with Captain MacTavish becoming playable later in the campaign. ", "prediction 1": "Call of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision. It was released worldwide on November 10, 2009 for Microsoft Windows, the PlayStation 3, and Xbox 360. A version for OS X was developed by Aspyr and released on May 20, 2014. The Xbox 360 version was made backward compatible for the Xbox One in 2018. Call of Duty: Modern Warfare 3 is a first-person shooter video game, developed by Infinity Ward and Sledgehammer Games, with assistance from Raven Software, and published by Activision.", "prediction 2": "Call of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision. It was released worldwide on November 10, 2009 for Microsoft Windows, the PlayStation 3, and Xbox 360. It is the sixth installment of the Call of Duty series and the direct sequel to \"\", continuing the same storyline. Call of Duty: Modern Warfare 3 is a first-person shooter video game, developed by Infinity Ward and Sledgehammer Games, with assistance from Raven Software, and published by Activision.", "prediction 3": "Call of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision. It was released worldwide on November 10, 2009 for Microsoft Windows, the PlayStation 3, and Xbox 360. Call of Duty: Modern Warfare 3 is a first-person shooter video game, developed by Infinity Ward and Sledgehammer Games, with assistance from Raven Software, and published by Activision. It is the third installment in the Modern Warfare saga, a direct sequel to 2009's \"\", and the eighth Clash Warfare series.", "prediction 4": "Call of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision. The game's main playable characters are Sergeant Gary \"Roach\" Sanderson, of the Task Force 141, and Private James Ramirez, of the United States Army Rangers, with Captain MacTavish becoming playable later in the campaign. Call of Duty: Modern Warfare 3 is a first-person shooter video game, developed by Infinity Ward and Sledgehammer Games, with assistance from Raven Software, and published by Activision.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 374 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 560 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Call of Duty: Modern Warfare 2 is a first-person shooter video game developed by Infinity Ward and published by Activision.The game's main playable characters are Sergeant Gary \"Roach\" Sanderson, of the 141, and Private James Ramirez, of the Army Rangers, with Captain MacTavish becoming playable later in the campaign." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played kunta kinte's father in roots?", "passages": [ [ "Kunta Kinte", "Kunta Kinte\n\nKunta Kinte ( 1750 \u2013 1822; ) is a character in the novel \"\" by American author Alex Haley.", "Haley claimed that Kunta Kinte was based on one of his ancestors: a Gambian man who was born in 1750, enslaved and taken to America and who died in 1822.", "Haley said that his account of Kunta's life in \"Roots\" was a mixture of fact and fiction.", "The extent to which Kunta Kinte is based on fact is disputed.", "Kunta Kinte's life story also figured in two US-made television series based on the book: the original 1977 TV miniseries \"Roots\", and a 2016 remake of the same name.", "In the original miniseries, the character was portrayed as a teenager by LeVar Burton and as an adult by John Amos.", "In the 2016 miniseries, he is portrayed by Malachi Kirby.", "Additionally, Burton reprised his role as Kunta in the TV movie \"\", a fictional tale originally broadcast during the 1988 Christmas season.", "According to \"\", Kunta Kinte was born circa 1750 in the Mandinka village of Juffure, in the Gambia.", "He was raised in a Muslim family.", "One day in 1767, while Kunta was searching for wood to make a drum for his younger brother, four men chased him, surrounded him, and took him captive." ], [ "Roots (1977 miniseries)", "Roots (1977 miniseries)\n\nRoots is an American television miniseries based on Alex Haley's 1976 novel \"\".", "The series first aired on ABC in January 1977.", "\"Roots\" received 37 Primetime Emmy Award nominations and won nine.", "It also won a Golden Globe and a Peabody Award.", "It received unprecedented Nielsen ratings for the finale, which still holds a record as the third-highest-rated episode for any type of television series, and the second-most watched overall series finale in U.S. television history.", "It was produced on a budget of $6.6 million.", "The series introduced LeVar Burton in the role of Kunta Kinte.", "A sequel, \"\", first aired in 1979, and a second sequel, \"\", a Christmas TV movie, starring Burton and Louis Gossett Jr., first aired in 1988.", "A related film, \"Alex Haley's Queen\", is based on the life of Queen Jackson Haley, who was Alex Haley's paternal grandmother.", "In 2016, a remake of the original miniseries, with the same name, was commissioned by the History channel and screened by the channel on Memorial Day.", "In The Gambia, West Africa, in 1750, Kunta Kinte is born to Omoro Kinte (Thalmus Rasulala), a Mandinka warrior, and his wife, Binta (Cicely Tyson)." ] ], "gold": "Kunta Kinte is a character from the novel Roots: The Saga of an American Family that was written by Alex Haley in 1976. The novel was adapted into a television miniseries twice. The first version was made in 1977, and Kunta Kinte's father, Omoro Kinte, was played by actor Thalmus Rasulala. Babs Olusanmokun played Omoro Kinte in the second version which was made in 2016.", "prediction 1": "Roots is an American television miniseries based on Alex Haley's 1976 novel. In the 1977 miniseries, Kunta Kinte's father was played by LeVar Burton as a teenager and John Amos as an adult. In the 2016 miniseries, Kunta Kinte is portrayed by Malachi Kirby. Additionally, Burton reprised his role as Kunta in the TV movie Roots, a fictional tale originally broadcast during the 1988 Christmas season.\n", "prediction 2": "Roots is an American television miniseries based on the 1976 novel by American author Alex Haley, and its original 1888 Christmas TV movie is a reboot of the 1977 version. In the 2016 miniseries, Kunta Kinte is portrayed by Malachi Kirby, and his father is Omoro Kinte, a Gambian warrior who was born in 1750 and lived until he was 1822.", "prediction 3": "Roots is an American television miniseries based on the 1976 novel of the same name by American author Alex Haley. In the 1977 series, Kunta Kinte's father was played by LeVar Burton as a teenager and John Amos as an adult. In the 2016 series, Kunta Kinte was played by Malachi Kirby.", "prediction 4": "Roots is a 1976 American novel by American author Alex Haley. The character Kunta Kinte was born to a Mandinka chieftain and his slave, Omoro Kinte, in The Gambia. His father, Omoro Kinte, was played by Thane Rasulala in the 1977 TV miniseries and by John Amos in the 1988 Christmas TV movie. Malachi Kirby and LeVar Burton both played Kunta in the 2016 miniseries.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 163, "end": 189 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 101, "end": 162 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "Roots is an American television miniseries based on Alex Haley's 1976 novel. The first version was released in 1977 and the second in 2016. Kunta Kinte's father, Omoro Kinte, was played by actor Thalmus Rasulala. \n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sang the song it's the final countdown?", "passages": [ [ "The Final Countdown (song)", "The Final Countdown (song)\n\n\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986.", "Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s, inspired by David Bowie's \"Space Oddity\".", "Originally made to just be a concert opener, it is the first single from the band's third studio album, also named \"The Final Countdown\".", "The song reached number one in 25 countries, including the United Kingdom, and was certified gold in that country in 1986.", "In the United States, the song peaked at number 8 on the \"Billboard\" Hot 100 and number 18 on the \"Billboard\" Album Rock Tracks chart.", "A music video by Nick Morris was made to promote the single that features footage from the band's two concerts at the Solnahallen in Solna, as well as extra footage of the sound checks at those concerts.", "The song was based on a keyboard riff which Joey Tempest had written, as early as 1981 or 1982, on a Korg Polysix keyboard which he had borrowed from keyboardist Mic Michaeli.", "In 1985, bassist John Lev\u00e9n suggested that Tempest should write a song based on that riff.", "Tempest recorded a demo version of the song and played it for the other band members." ], [ "The Final Countdown (song)", "On 2 October 1990 just a few hours before the German reunification, the English segment of international radio broadcaster of former East Germany \"RBI\", played the intro of the song with the female radio announcer says: \"Our broadcast came to you from Radio Berlin International, the voice of the disappearing German Democratic Republic\".", "\"Blender\" listed it as the 27th worst song ever, and both VH1 and \"Blender\" included it at 16 on the list of the \"Most Awesomely Bad Songs...Ever\".", "However, VH1 later ranked it at number 66 on their list of the best hard rock songs of all time.", "The song and band Europe appeared in a 2015 USA television commercial for GEICO insurance, playing in a lunchroom as a microwave oven's timer is counting down toward zero seconds; the script touts the intrinsic activity of the band, saying if you're Europe, \"you love a final countdown: it's what you do.\"", "A performance of the song by a band named Deep Sunshine was captured on video and later became a variation of a Rickroll on Fark.com, receiving over 5 million views on YouTube.", "The video has been labeled the \"worst cover ever\", its success stemming from its lack of artistic value.", "Slovenian avant-garde music group Laibach released a cover in 1994 on their \"NATO\" album." ] ], "gold": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by lead vocalist Joey Tempest, it was based on a keyboard riff he made in the early 1980's. A performance of the song by a band named Deep Sunshine was captured on video and has been labeled the \"worst cover ever\", its success stemming from its lack of artistic value. Slovenian avant-garde music group Laibach also released a cover of the song in 1994 on their \"NATO\" album.", "prediction 1": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s, inspired by David Bowie's \"Space Oddity\". Slovenian avant-garde music group Laibach released a cover in 1994 on their NATO album.", "prediction 2": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s, inspired by David Bowie's \"Space Oddity\". In 1985, bassist John Lev\u00e9n suggested that Tempest should write a song based on that riff. Tempest recorded a demo version of the song and played it for the other band members. Slovenian avant-garde music group Laibach released a cover in 1994 on their \"NATO\" album.", "prediction 3": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s, inspired by David Bowie's \"Space Oddity\". Swedish avant-garde music group Laibach released a cover of the song in 1994 on their \"NATO\" album. The song reached number one in 25 countries, including the United Kingdom, and was certified gold in that country in 1986. Slovenian avant-garde music group Laibach performed a cover in 1994 on their \"NATO\" album. Slovenian avant-garde music group Laibach released a cover in 1994 on their \"NATO\" album.", "prediction 4": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s, inspired by David Bowie's \"Space Oddity\". In 1985, bassist John Lev\u00e9n suggested that Tempest should write a song based on that riff. Tempest recorded a demo version of the song and played it for the other band members. Slovenian avant-garde music group Laibach released a cover of the song in 1994 on their \"NATO\" album.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 204 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"The Final Countdown\" is a song by Swedish rock band Europe, released in 1986. Written by Joey Tempest, it was based on a keyboard riff he made in the early '80s. A performance of the song by a band named Deep Sunshine was captured on video. The video has been labeled the \"worst cover ever\", its success stemming from its lack of artistic value. Slovenian avant-garde music group Laibach released a cover in 1994 on their NATO album." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who has the authority to impeach the president?", "passages": [ [ "Impeachment", "The Constitution defines impeachment at the federal level and limits impeachment to \"The President, Vice President, and all civil officers of the United States\" who may be impeached and removed only for \"treason, bribery, or other high crimes and misdemeanors\".", "Several commentators have suggested that Congress alone may decide for itself what constitutes a \"high crime or misdemeanor\", especially since \"Nixon v. United States\" stated that the Supreme Court did not have the authority to determine whether the Senate properly \"tried\" a defendant.", "In 1970, then-House Minority Leader Gerald R. Ford defined the criterion as he saw it: \"An impeachable offense is whatever a majority of the House of Representatives considers it to be at a given moment in history.\"", "The central question regarding the Constitutional dispute about the impeachment of members of the legislature is whether members of Congress are officers of the United States.", "The Constitution grants the House the power to impeach \"The President, the Vice President, and all civil Officers of the United States.\"", "It has been suggested that members of Congress are not officers of the United States.", "Others, however, believe that members are civil officers and are subject to impeachment.", "The House of Representatives impeached Senator William Blount in 1798, resulting in his expulsion." ], [ "Impeachment in the United States", "Impeachment in the United States\n\nImpeachment in the United States is the process by which the lower house of a legislature brings charges against a civil officer of government for crimes alleged to have been committed, analogous to the bringing of an indictment by a grand jury.", "At the federal level, this is at the discretion of the House of Representatives.", "Most impeachments have concerned alleged crimes committed while in office, though there have been a few cases in which officials have been impeached and subsequently convicted for crimes committed prior to taking office.", "The impeached official remains in office until a trial is held.", "That trial, and their removal from office if convicted, is separate from the act of impeachment itself.", "Analogous to a trial before a judge and jury, these proceedings are (where the legislature is bicameral) conducted by upper house of the legislature, which at the federal level is the Senate.", "At the federal level, of the Constitution grants to the House of Representatives \"the sole power of impeachment\", and grants to the Senate \"the sole Power to try all Impeachments\"." ] ], "gold": "The Constitution gives Congress, specifically the House of Representatives, the authority to impeach and remove \"The President, Vice President, and all civil officers of the United States\" upon a determination that such officers have engaged in treason, bribery, or other high crimes and misdemeanors. ", "prediction 1": "The United States Constitution grants to the House of Representatives \"the sole power of impeachment\", and grants to the Senate \"the sole Power to try all Impeachments\". The House of Representatives has the authority to impeach the president, the vice president, and all civil officers of the United States. Most impeachments in the United States have concerned alleged crimes committed while in office, though there have been a few cases in which officials have been impeached and subsequently convicted for crimes committed prior to taking office.", "prediction 2": "The United States Constitution grants the House of Representatives the power to impeach the president and the vice president, and all civil officers of the United States. The power to impeach the president is at the discretion of the House of Representatives.", "prediction 3": "The House of Representatives has the authority to impeach the president, and the Senate has the authority to try all impeachments. In the United States, impeachment in the United States is the process by which the lower house of a legislature brings charges against a civil officer of government for crimes alleged to have been committed, analogous to the bringing of an indictment by a grand jury. The House of Representatives impeached Senator William Blount in 1798, resulting in his expulsion. In 1798, the Senate impeachment was granted to the House of Representatives the sole power of impeachment, and grants to the Senate the sole power to try all Impeachments.", "prediction 4": "Impeachment in the United States is the process by which the lower house of a legislature brings charges against a civil officer of government for crimes alleged to have been committed, analogous to the bringing of an indictment by a grand jury. At the federal level, this is at the discretion of the House of Representatives. The House of Representatives impeached Senator William Blount in 1798, resulting in his expulsion.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 549 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States Constitution grants to the House of Representatives \"the sole power of impeachment\". The House of Representatives has the authority to impeach the president, the vice president, and all civil officers of the United States. Although they can be removed only for \"treason, bribery, or other high crimes and misdemeanors\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who won britain's got talent 2014 season 8?", "passages": [ [ "Britain's Got Talent (series 8)", "Britain's Got Talent (series 8)\n\nSeries Eight of Britain's Got Talent, a British talent competition series, began broadcasting in the UK during 2014, from 12 April to 7 June on ITV; because of England's international friendly with Peru, the show took a break on 30 May to avoid clashing with live coverage of the match.", "The series is most notable for holding auditions in Northern Ireland for the first time, instead of Scotland as had been done since the second series, as well as for the hosts Ant & Dec having to stand in for Simon Cowell, after illness forced him to be absent during a day of auditions.", "It was also the first series in the show's history to have a buzzer used during the live final, and was the first to include the \"Golden Buzzer\" - a format introduced to the programme, which had begun to appear within the \"Got Talent\" franchise since it was first introduced on \"Germany's Got Talent\" in 2012.", "The eighth series was won by boy band Collabro, with opera singer Lucy Kay finishing in second place and singing/rapping duo Bars and Melody in third place.", "During its broadcast, the series averaged around 9.8 million viewers." ], [ "Collabro", "Collabro\n\nCollabro are a UK-based musical theatre group and winners of the eighth series of \"Britain's Got Talent\" in 2014.", "The group consists of Michael Auger, Jamie Lambert, Matthew Pagan and Thomas J. Redgrave, and previously, Richard Hadfield until his departure from the band in June 2016.", "Collabro was voted the UK's favourite Britain's Got Talent Winners in a National Poll.", "The band have a following who they refer to as their \"Collaborators\" and famous fans include Jade Thirlwall from Little Mix.", "Their debut album \"Stars\" was released on 18 August 2014 and debuted at number one in the UK.", "They also had second album called Act 2, which debuted at number 2, and their third album, \"Home\", was released on 3 March 2017 and debuted at number 7.", "They now have a fourth album coming out on 31 August 2018 called Road to the Royal Albert Hall.", "Collabro formed in January 2014.", "Pagan and Lambert knew each other already, and used social media to find three additional singers to complete the band's line-up.", "Pagan and Lambert held auditions where they found Auger and Redgrave.", "They found Hadfield on YouTube singing \"Bring Him Home\".", "They sang together for the first time at the Miller pub in London Bridge." ] ], "gold": "The eighth series of the talent competition show \"Britain's Got Talent\" was won by boy band Collabro. The group members are Michael Auger, Jamie Lambert, Matt Pagan, Thomas J. Redgrave, and Richard Hadfield. ", "prediction 1": "Britain's Got Talent is a British talent competition series that began broadcasting in the UK during 2014, from 12 April to 7 June on ITV. The eighth series was won by boy band Collabro, with opera singer Lucy Kay finishing in second place and singing/rapping duo Bars and Melody in third place. The ninth series of Britain's Got Talent was won by the musical theatre group The Younger Americans, with the British band The Younger Americans finishing in 7th.", "prediction 2": "Collabro, a musical theatre group from the UK, won Britain's Got Talent series 8 on ITV. The show had three other winners during the broadcast.", "prediction 3": "Britain's Got Talent is a British talent competition series. The eighth season of the show was won by boy band Collabro. The final round was held in London on 30 May 2014.", "prediction 4": "Britain's Got Talent is a British talent competition series. Series 8 was won by boy band Collabro, with opera singer Lucy Kay finishing in second place and singing/rapping duo Bars and Melody in third place.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 295 }, { "error type": "Unverifiable", "explanation": "", "start": 296, "end": 458 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The eighth series British talent competition show was won by boy band Collabro. The group consists of Michael Auger, Jamie Lambert, Matthew Pagan and Thomas J. Redgrave, and previously, Richard Hadfield." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When did presidents start running with vice presidents?", "passages": [ [ "Running mate", "As more and more states subsequently began to choose their electors by popular election instead of appointment (South Carolina being the last state to change, in 1860), candidates began to realize they could run together as a team for president and vice president instead of running completely separately for each office.", "The practice of a presidential candidate having a running mate was solidified during the American Civil War.", "In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party.", "Notwithstanding this party disbanded after the war ended, with the result that Republican Lincoln was succeeded by Democrat Johnson; the states began to place candidates for President and Vice-President together on the same ballot ticket - thus making it impossible to vote for a presidential candidate from one party and a vice-presidential candidate from another party, as had previously been possible.", "Presidential candidates from smaller states sometimes choose a vice presidential running mate from a state with a large number of electoral votes - as in 1984 when Walter Mondale of Minnesota (10 votes) selected Geraldine Ferraro of New York (then 36 votes)." ] ], "gold": "The practice of having a presidential candidate run with a running mate began during the civil war. In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party.", "prediction 1": "The practice of a presidential candidate having a running mate was solidified during the American Civil War. In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party. The practice of a presidential candidate having a running mate was solidified during the 1865 election, when William Jefferson Harrison was the vice president and Lincoln from the Democratic Party.", "prediction 2": "The practice of a presidential candidate having a running mate was solidified during the American Civil War. In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party. Presidential candidates from smaller states sometimes choose a vice presidential running mate from a state with a large number of electoral votes, as in 1984 when Walter Mondale of Minnesota selected Geraldine Ferraro of New York.", "prediction 3": "The practice of a presidential candidate having a running mate was solidified during the American Civil War. In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party.", "prediction 4": "In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party. However, this practice was formalized during the American Civil War, when Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party. This practice of a running mates was solidified during the American Civil War.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 404, "end": 601 } ], "missing-info": [], "corrected-prediction": "The practice of a presidential candidate having a running mate was solidified during the American Civil War. In 1864, in the interest of fostering national unity, Abraham Lincoln from the Republican Party (popular in the North) and Andrew Johnson of the Democratic Party (popular in the South) were co-endorsed and ran together for President and Vice-President as candidates of the National Union Party. " }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "Leader who declared war on russia to support austria hungary?", "passages": [ [ "Wilhelm II, German Emperor", "Wilhelm II, German Emperor\n\nWilhelm II (Friedrich Wilhelm Viktor Albert; 27 January 18594 June 1941) was the last German Emperor (\"Kaiser\") and King of Prussia, reigning from 15 June 1888 until his abdication on 9 November 1918.", "He was the eldest grandchild of Queen Victoria of the United Kingdom and related to many monarchs and princes of Europe, most notably, King George V of the United Kingdom and Emperor Nicholas II of Russia.", "Acceding to the throne in 1888, he dismissed the chancellor, Otto von Bismarck, in 1890.", "He also launched Germany on a bellicose \"New Course\" in foreign affairs that culminated in his support for Austria-Hungary in the crisis of July 1914 that led in a matter of days to the First World War.", "Bombastic and impetuous, he sometimes made tactless pronouncements on sensitive topics without consulting his ministers, behavior which culminated in a disastrous \"Daily Telegraph\" interview in 1908 that cost him most of his influence.", "His leading generals, Paul von Hindenburg and Erich Ludendorff, dictated policy during the First World War with little regard for the civilian government.", "An ineffective war-time leader, he lost the support of the army, abdicated on 9 November 1918, and fled to exile in the Netherlands." ], [ "German entry into World War I", "As the war started, Germany stood behind its ally Austria-Hungary in a confrontation with Serbia, but Serbia was under the protection of Russia, which was allied to France.", "Germany was the leader of the Central Powers, which included Austria-Hungary, the Ottoman Empire, and later Bulgaria; arrayed against them were the Allies, consisting chiefly of Russia, France, Britain, and in 1915 Italy.", "There were several main causes of World War I, which broke out unexpectedly in June-August 1914, including the conflicts and hostility of the previous four decades.", "Militarism, alliances, imperialism, and ethnic nationalism played major roles.", "However the immediate origins of the war lay in the decisions taken by statesmen and generals during the Crisis of 1914, which was sparked by the assassination of Archduke Franz Ferdinand (heir to the throne of Austria Hungary) by a Serbian secret organization, the Black Hand.", "Since the 1870s or 1880s all the major powers had been preparing for a large-scale war, although none expected one.", "Britain focused on building up its Royal Navy, already stronger than the next two navies combined.", "Germany, France, Austria, Italy and Russia, and some smaller countries, set up conscription systems whereby young men would serve from 1 to 3 years in the army, then spend the next 20 years or so in the reserves with annual summer training.", "Men of higher social status became officers." ], [ "Wilhelm II, German Emperor", "Wilhelm offered to support Austria-Hungary in crushing the Black Hand, the secret organization that had plotted the killing, and even sanctioned the use of force by Austria against the perceived source of the movement\u2014Serbia (this is often called \"the blank cheque\").", "He wanted to remain in Berlin until the crisis was resolved, but his courtiers persuaded him instead to go on his annual cruise of the North Sea on 6 July 1914.", "Wilhelm made erratic attempts to stay on top of the crisis via telegram, and when the Austro-Hungarian ultimatum was delivered to Serbia, he hurried back to Berlin.", "He reached Berlin on 28 July, read a copy of the Serbian reply, and wrote on it:\n\nUnknown to the Emperor, Austro-Hungarian ministers and generals had already convinced the 83-year-old Franz Joseph I of Austria to sign a declaration of war against Serbia.", "As a direct consequence, Russia began a general mobilization to attack Austria in defense of Serbia.", "On the night of 30 July, when handed a document stating that Russia would not cancel its mobilization, Wilhelm wrote a lengthy commentary containing these observations:\n\nMore recent British authors state that Wilhelm II really declared, \"Ruthlessness and weakness will start the most terrifying war of the world, whose purpose is to destroy Germany." ] ], "gold": "Wilhelm II anglicised as William II, was the last German Emperor (Kaiser) and King of Prussia, reigning from June 15, 1888 until his abdication on November 9, 1918. Wilhelm was a friend of Archduke Franz Ferdinand of Austria, and he was deeply shocked by his assassination on June 28, 1914. Wilhelm offered to support Austria-Hungary in crushing the Black Hand, the secret organisation that had plotted the killing, and even sanctioned the use of force by Austria against the perceived source of the movement,Serbia, but Serbia was under the protection of Russia, which was allied to France. Wilhelm left virtually all decision-making regarding strategy and organisation of the war effort to the German Army's Great General Staff. German Chief of Staff Moltke sent an emotional telegram to the Austrian Chief of Staff Conrad on July 30: \"Austria-Hungary must be preserved, mobilise at once against Russia. Germany will mobilise.\" Vienna officials decided that Moltke was really in chargeand refused mediation and mobilized against Russia.", "prediction 1": "The German Empire declared war on Russia in 1914 to support Austria-Hungary. The German leader who declared war on Russian was the Emperor Friedrich Wilhelm II.", "prediction 2": "In 1917, Wilhelm II announced a military mobilization against Russia to support Austria-Hungary, which resulted in the Russians attacking Austria in defense of Serbia. The Emperor of Austria was Franz Joseph II, who had been Emperor since 1888 and was the last German Emperor and King of Prussia. However, as the leader of the Central Powers, Wilhelm declared war on Russia to support Austria-Hungary during the Crisis of 1914, which led in a matter of days to the First World War.", "prediction 3": "The German emperor Friedrich Wilhelm II declared war on Russia in July 1914 in support of his ally Austria-Hungary. He did so as the last German Emperor and King of Prussia, reigning from 15 June 1888 until his abdication on 9 November 1918. The Austrian-Hungarian crisis of July 1914 led to a series of events that led to the First World War.", "prediction 4": "There were several German leaders who declared war on Russia in the First World War. The German Emperor Friedrich Wilhelm Viktor Albert declared war on Russia to support Austria-Hungary in the crisis of July 1914 that led in a matter of days to the First World War. The Austro-Hungarian government was led by Franz Joseph I, 83, and their ministers had already convinced Joseph to sign a declaration of war against Serbia.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 0, "end": 76 }, { "error type": "Redundant", "explanation": "The German Empire declared war on Russia ", "start": 77, "end": 160 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": " German Emperor Wilhelm II was the last German Emperor (\"Kaiser\") and King of Prussia, reigning from 15 June 1888 until his abdication on 9 November 1918. Sparked by the 1914 assassination of Archduke Franz Ferdinand (heir to the throne of Austria Hungary), Wilhelm offered to support Austria-Hungary in crushing the Black Hand, the secret organization that had plotted the killing, and even sanctioned the use of force by Austria against the perceived source of the movement\u2014Serbia, but Serbia was under the protection of Russia, which was allied to France." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What is the name of the airport in boston?", "passages": [ [ "Edward Lawrence Logan", "Edward Lawrence Logan\n\nEdward Lawrence Logan (1875\u20131939) was an American lawyer, judge, military officer, and politician from Boston, Massachusetts.", "Rising to the rank of major general and given command of the 26th Infantry Division of the United States Army, Logan was instrumental in the post\u2013World War I reorganization of that unit.", "Logan also won election to the Massachusetts state legislature and to the Boston City Council and served as head of the American Legion in his state.", "General Edward Lawrence Logan International Airport, an international airport located in the East Boston neighborhood of Boston, is named after him.", "Edward Lawrence Logan was born January 20, 1875 in South Boston, Massachusetts, to Lawrence J. Logan and his wife, Catherine M. O'Connor Logan, a military family.", "He attended Boston Latin School before enrolling at Harvard College.", "In 1897, still in school, Logan enlisted in the 9th Infantry Regiment of the Massachusetts Volunteer Militia as a sergeant major, serving in that unit for the duration of the Spanish\u2013American War.", "He returned in the fall of 1898 and enrolled at Harvard Law School, and while still a student there was elected one of 75 members of the Boston Common Council, on which he served from 1899 to 1900.", "Upon his graduation in 1900, Logan ran for election to the Massachusetts House of Representatives, winning a seat on that body and serving from 1901 to 1902." ], [ "T. F. Green Airport", "T. F. Green Airport\n\nT. F. Green International Airport (officially Theodore Francis Green Memorial State Airport) is a public international airport in Warwick, Rhode Island, six miles (10\u00a0km) south of the state's capital and largest city of Providence.", "Opened in 1931, the airport was named for former Rhode Island governor and longtime senator Theodore Francis Green.", "Rebuilt in 1996, the renovated main terminal was named for former Rhode Island governor Bruce Sundlun.", "It was the first state-owned airport in the United States.", "The Federal Aviation Administration (FAA) National Plan of Integrated Airport Systems for 2017\u20132021 categorized it as a small hub primary commercial service facility.", "T. F. Green Airport is a regional airport serving the FAA's New England Region in the FAA System Plan.", "Along with two other regional airports, Worcester Regional Airport and Manchester-Boston Regional Airport, T. F. Green is considered a reliever airport to Logan International Airport in Boston, Massachusetts.", "The airport is the largest and most active airport among the six operated by the Rhode Island Airport Corporation (RIAC).", "T. F. Green Airport was dedicated on September 27, 1931, as Hillsgrove State Airport, drawing what was at that time the largest crowd that had attended a public function in the country." ] ], "gold": "General Edward Lawrence Logan International Airport is an international airport that is located mostly in East Boston. The other three commercial airports in the Boston area are Worcester Regional Airport, T. F. Green Airport and Manchester-Boston Regional Airport.", "prediction 1": "The Boston Logan International Airport is the main international airport in Boston, Massachusetts. The airport in South Boston is called Logan Airport. The Boston Logan Airport is also known by the name of T. F. Green International Airport, a regional airport in Warwick, Rhode Island. Both airports are in the New England region and are considered a reliever airport to Logan International Airport in Boston, Massachusetts.", "prediction 2": "General Edward Lawrence Logan International Airport is the airport in Boston, Massachusetts, which is located in the East Boston neighborhood of Boston. Theodore Francis Green Memorial State Airport is the name of the airport in Warwick, Rhode Island. T. F. Green International Airport is the name of the airport in Warwick, Rhode Island. It is a public international airport located in Warwick, Rhode Island, six miles (10 km) south of the state's capital and largest city, Providence. Theodore Francis Green Memorial State Airport is a regional airport serving the FAA's New England Region in the FAA System Plan. Along with two other regional airports, Worcester Regional Airport and Manchester-Boston Regional Airport, T. F. Green is considered a reliever airport to Logan International Airport in Boston, Massachusetts. F. Green Airport was dedicated on September 27, 1931, as Hillsgrove State Airport, drawing what was at that time the largest crowd had attended", "prediction 3": "Theodore Francis Green Memorial State Airport is the name of an international airport in Warwick, Rhode Island. It is the state-owned airport of Rhode Island. It opened in 1931 and was named after former Rhode Island governor and longtime senator Theodore Francis Green.", "prediction 4": "The airport is located in the East Boston neighborhood of Boston and is named after Edward Lawrence Logan, who rose to the rank of major general and was given command of the 26th Infantry Division of the United States Army. T. F. Green International Airport is a public international airport in Warwick, Rhode Island, six miles (10 km) south of the state's capital and largest city of Providence. T. F. Green was officially known as Hillsgrove State Airport and was dedicated on September 27, 1931.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 98 }, { "error type": "Unverifiable", "explanation": "", "start": 99, "end": 151 }, { "error type": "Unverifiable", "explanation": "", "start": 286, "end": 424 }, { "error type": "Unverifiable", "explanation": "", "start": 152, "end": 202 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 285 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "General Edward Lawrence Logan International Airport is an international airport that is located mostly in East Boston. The other three commercial airports in the Boston area are Worcester Regional Airport, T. F. Green Airport and Manchester-Boston Regional Airport." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does season 6 of the arrow air?", "passages": [ [ "Supergirl (season 3)", "Jordan too exited the series as a regular with this season, as he wanted to begin \"a new chapter in [his] life\".", "Filming for the season began on July 6, 2017 and ended on April 28, 2018, taking place in Vancouver.", "In May 2017, The CW president Mark Pedowitz officially announced plans for a four-show Arrowverse crossover event, crossing over episodes of the television series \"Supergirl\", \"The Flash\", \"Legends of Tomorrow\", and \"Arrow\".", "The crossover, \"Crisis on Earth-X\", began with \"Supergirl\" and a special airing of \"Arrow\" on November 27, 2017, and concluded on \"The Flash\" and \"Legends of Tomorrow\" on November 28.", "The crossover also sees Benoist, Brooks and Jordan playing the Earth-X versions of their characters.", "The season premiered on The CW in the United States on October 9, 2017, and ended on June 18, 2018.", "It premiered on October 16, 2017 in the United Kingdom on Sky One.", "The season was released on DVD on September 17, 2018, and Blu-ray on September 18, 2018.", "The review aggregator website Rotten Tomatoes gave the third season a 80% approval rating from critics with an average rating of 7.32/10, based on 13 reviews." ], [ "Legends of Tomorrow (season 3)", "They then created a whole new face and neck for me that was glued on and spray painted over the course of four hours.", "The end result was freakishly convincing.\"", "In May 2017, The CW president Mark Pedowitz officially announced plans for a four-show Arrowverse crossover event, crossing over episodes of the television series \"Supergirl\", \"The Flash\", \"Legends of Tomorrow\", and \"Arrow\".", "The crossover, \"Crisis on Earth-X\", began with \"Supergirl\" and a special airing of \"Arrow\" on November 27, 2017, and concluded on \"The Flash\" and \"Legends of Tomorrow\" on November 28.", "The third season began airing on October 10, 2017 on The CW in the United States, and concluded on April 9, 2018.", "The season was made available for streaming on Netflix in late April 2018, soon after the season finale aired.", "It was released on Blu-Ray on September 25, 2018.", "The review aggregator website Rotten Tomatoes reported a 100% approval rating with an average rating of 8.27/10 based on 13 reviews.", "The website's consensus reads, \"\"DC's Legends of Tomorrow\" lightens up the tone in its third season while spotlighting adventurous plots and a distinct sense of humor.\"" ], [ "Oliver Queen (Arrowverse)", "Oliver Queen (Arrowverse)\n\nOliver Queen is a fictional character in the television series \"Arrow\", based on the DC Comics superhero Green Arrow, created by Mort Weisinger and George Papp.", "Adapted for television in 2012 by Greg Berlanti, Marc Guggenheim and Andrew Kreisberg, Oliver Queen has been continually portrayed by Stephen Amell and is the alter-ego of the vigilante Green Arrow.", "This is the second time the character has been adapted to a live-action television series; the first time was on the series \"Smallville\", where the character appeared over the course of five seasons and was portrayed by Justin Hartley.", "In the series, Oliver is a billionaire playboy who returns to Starling City after five years of being stranded after a shipwreck and presumed dead.", "He spends his nights as a hooded vigilante named the \"Arrow\" who stops crime in the city.", "During the first season, Oliver focuses on a list, written by his father, of targets that are taking advantage of the citizens.", "Subsequent seasons have him venturing into all criminal activity, and he shifts from being willing to kill to having a rule against all killing as a means of stopping assailants.", "In \"Arrow\", Oliver does not take up the name of Green Arrow until season four." ] ], "gold": "Arrow is an American superhero television series developed by Greg Berlanti, Marc Guggenheim, and Andrew Kreisberg based on the DC Comics character Green Arrow, a costumed crime-fighter created by Mort Weisinger and George Papp, and is set in the Arrowverse with other related television series. Season 6 began airing in the United States on The CW on October 12, 2017, and completed its 23-episode run on May 17, 2018. It began streaming on Netflix in May 2018, soon after the season finale aired.", "prediction 1": "Season 6 of the American television series Arrow began airing on October 9, 2017 and ended on June 18, 2018. It premiered on October 16, 2017 in the United Kingdom on Sky One. Season 6 of the British television series Arrow began airing on October 8, 2018 and ended on April 11, 2019. Season 6 of the American television series Arrow began airing on October 10, 2018 and concluded on April 9, 2018. Season 6 of the UK television series Arrow began airing on March 14, 2019 and ended on March 12, 2020.", "prediction 2": "Season 6 of the CW television series Arrow began airing on October 9, 2017 in the United States, and ended on June 18, 2018. Season 6 of Arrowverse began airing on October 16, 2017 in the United Kingdom and October 15, 2016 in the United States. Season 6 of Arrowverse: Legends of Tomorrow began airing on October 16, 2017 in the United Kingdom and ended on June 18, 2018.", "prediction 3": "Season 6 of the television series Arrow premiered on October 9, 2017 in the United States and ended on June 18, 2018. Season 6 of Arrowverse began airing in the United States on October 2, 2019, and ended on April 25, 2019. Season 6 of Arrowverse premiered in the United Kingdom and Ireland on Sky One on October 16, 2017.", "prediction 4": "Season 6 of Arrow first aired on January 6, 2021. Season 5 aired on January 6, 2021. Season 6 of Arrow first aired on January 7, 2021. Season 6 of Arrow first aired on November 12, 2022.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 43, "end": 48 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 109, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 175 }, { "error type": "Unverifiable", "explanation": "", "start": 192, "end": 199 }, { "error type": "Unverifiable", "explanation": "", "start": 240, "end": 255 }, { "error type": "Unverifiable", "explanation": "", "start": 269, "end": 284 }, { "error type": "Redundant", "explanation": "Season 6 of the American television series Arrow began airing on October 9, 2017 and ended on June 18, 2018.", "start": 176, "end": 191 }, { "error type": "Redundant", "explanation": "Season 6 of the American television series Arrow began airing on October 9, 2017 and ended on June 18, 2018. ", "start": 285, "end": 346 }, { "error type": "Unverifiable", "explanation": "", "start": 350, "end": 366 }, { "error type": "Unverifiable", "explanation": "", "start": 384, "end": 398 }, { "error type": "Redundant", "explanation": "Season 6 of the British television series Arrow began airing on October 8, 2018 and ended on April 11, 2019. ", "start": 399, "end": 441 }, { "error type": "Unverifiable", "explanation": "", "start": 458, "end": 472 }, { "error type": "Unverifiable", "explanation": "", "start": 486, "end": 501 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "DC Comics superhero Green Arrow was created by Mort Weisinger and George Papp. The show was adapted by Greg Berlanti, Marc Guggenheim and Andrew Kreisberg." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings whats love got to do with it?", "passages": [ [ "What's Love Got to Do with It (song)", "It was then given to Phyllis Hyman, who wanted to do the song, but Arista Records head Clive Davis would not allow her.", "The song then was offered to Donna Summer, who has stated that she sat with it for a couple of years but never recorded it.", "Some months before Turner recorded the song, the British pop group Bucks Fizz were offered it.", "Member Jay Aston requested to sing lead on the track after hearing the demo, but was told by the producer that it was unsuitable for a female lead vocal.", "The group went on to record it in February 1984, but sung by male groupmember Bobby G. Aston recalls that the demo was very similar to the eventual Tina Turner version, but their finished version was in a very different style.", "It was intended for possible inclusion on their next album \"I Hear Talk\" but was shelved when Turner released her version first.", "The Bucks Fizz version went unreleased until it was included on a re-issue of their \"Are You Ready\" album in 2000.", "The Original Bucks Fizz went on to include the song in their reunion concert tour in October 2009.", "The name of the song was used as the title of a 1993 film depicting the early career of Tina Turner, in which the abusive relationship between Tina and Ike Turner was depicted." ], [ "What's Love Got to Do with It (song)", "What's Love Got to Do with It (song)\n\n", "\"What's Love Got to Do with It\" is a song recorded by the American singer Tina Turner, released in 1984.", "It was taken from her fifth solo album, \"Private Dancer\" and became Turner's most successful single.", "Although Turner had already scored a UK Top 10 and US Top 30 hit some months earlier with her rendition of \"Let's Stay Together\", \"What's Love Got to Do with It\" gave Turner her first and only US number one.", "The song ranked number 309 on \"Rolling Stone\" magazine's list of \"The 500 Greatest Songs of All Time\".", "It also ranked number 38 on the Songs of the Century list.", "It was the second-biggest single of 1984 in the US and the 17th-biggest in the United Kingdom.", "In 1993, the song's title was used as the title for the biographical film about Turner's life.", "In 2012, \"What's Love Got to Do with It\" was inducted into the Grammy Hall of Fame giving Turner her third Grammy Hall of Fame Award and her eleventh Grammy Award.", "The song was written by Terry Britten and Graham Lyle, who originally offered it to Cliff Richard, but it was rejected." ] ], "gold": "\"What's Love Got to Do with It\" is a song recorded by American singer Tina Turner and released in 1984. Some months before Turner recorded the song, the British pop group Bucks Fizz were offered the song. The group went on to record it in February 1984 sung by male member Bobby G, but that version was unreleased until the album Are you Ready in 2000.", "prediction 1": "\"What's Love Got to Do with It\" is a song recorded by the American singer Tina Turner, released in 1984. It was taken from her fifth solo album, Private Dancer and became Turner's most successful single. British pop group Bucks Fizz were offered it. Jay Aston requested to sing lead on the track after hearing the demo, but was told by the producer that it was unsuitable for a female lead vocal. The group went on to record it in February 1984, but sung by male groupmember Bobby G. Aston recalls that the demo was very similar to the eventual Tina Turner version, but their finished version was in a very different style.", "prediction 2": "What's Love Got to Do with It is a song recorded by the American singer Tina Turner, released in 1984. It was taken from her fifth solo album, Private Dancer and became Turner's most successful single. British pop group Bucks Fizz were offered the song in February 1984 and member Jay Aston requested to sing lead on the track after hearing the demo, but was told by the producer that it was unsuitable for a female lead vocal. The group went on to record it in February 1984, but sung by male groupmember Bobby G. Aston recalls that the demo was very similar to the eventual Tina Turner version, but their finished version was in a very different style.", "prediction 3": "\"What's Love Got to Do with It\" is a song recorded by the American singer Tina Turner, released in 1984. It was taken from her fifth solo album, Private Dancer and became Turner's most successful single. British pop group Bucks Fizz were offered it. Member Jay Aston requested to sing lead on the track after hearing the demo, but was told by the producer that it was unsuitable for a female lead vocal. The group went on to record it in February 1984, but sung by male groupmember Bobby G. Aston recalls that the demo was very similar to the eventual Turner version, but their finished version was in a very different style.", "prediction 4": "There are several songs called What's Love Got to Do with It. In 1984, Tina Turner sang the lead vocals for the song. It was given to Phyllis Hyman and Donna Summer, and then to the British pop group Bucks Fizz. They sung the lead vocals for the song in February 1984. The song was originally sung by male groupmember Bobby G. Aston sang the lead vocal for the song. In 1992, the song was used as the title for a biographical film about Turner.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 484, "end": 623 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"What's Love Got to Do with It\" is a song recorded by the American singer Tina Turner, released in 1984. Some months before Turner recorded the song, British pop group Bucks Fizz were offered it. The group went on to record it in February 1984, but sung by male groupmember Bobby G, but that version was unreleased until the album Are you Ready in 2000. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who plays kayla on days of our lives?", "passages": [ [ "Kayla Brady", "Kayla Brady\n\nKayla Brady is a fictional character on the NBC daytime soap opera \"Days of Our Lives\".", "She made her first appearance in 1982.", "Kayla was created by Pat Falken Smith as one of the original members of the Brady family, a fictional family on the serial.", "She is widely known for her popular pairing with Steve Johnson.", "This relationship gave the couple the title of a famous super couple.", "Kayla was described as being the \"good\" girl of the serial.", "During her time on \"Days of our Lives\", Kayla was extremely well received by television critics.", "Kayla Brady Johnson is one of the six Brady children.", "She is the daughter of the late Shawn Brady and Caroline Brady.", "She is the sister of Roman and Kimberly Brady, the half-sister of Bo Brady, and the sister of adopted brothers Frankie and Max Brady.", "She has been married four times, once to Jack Deveraux and three times to Steve Johnson.", "Steve and Kayla have two children, a daughter, Stephanie, and a son, Joey.", "Mary Beth Evans returned to \"Days of Our Lives\" for a short-stint on June 18, 2010, and then again on recurring status starting in December 2011.", "The role was originated on January 18, 1982 by actress Catherine Mary Stewart who played the role until December 14, 1983.", "The role is replaced in 1986 by actress Mary Beth Evans." ], [ "Kayla Brady", "Evans is most recognizable in the role as Kayla.", "She played the role from May 23, 1986 to May 26, 1992.", "Mary Beth Evans returned to play Kayla on June 12, 2006.", "She announced her departure from the serial on February 17, 2009, and was dropped off canvas.", "She returned to play Kayla in a recurring capacity from June 18 to 29, 2010 and September 23, 2010 to February 15, 2011.", "In December 2011, Evans began appearing on a regular basis in a recurring capacity.", "In May 2015, Evans announced she had been put back on contract with \"Days of Our Lives\".", "Kayla is first introduced to the show in 1982 as Roman Brady's younger sister and a nurse who works at University Hospital.", "Kayla shares a past relationship with Mike Horton, and also dates David Banning.", "She is involved with Chris Kositchek and loses her virginity to him.", "However, Kayla leaves town in 1983 when Chris cannot commit to her.", "Kayla returns to Salem in 1986 with Mary Beth Evans in the role after Steve Johnson is hired to scare her away from Cleveland.", "Accepting a job offer from Tom Horton, Kayla establishes a low income clinic on the riverfront and continues to cross paths with Steve.", "The two help orphans Max and Frankie find a home with Kayla's parents, and later go on the run together when Steve's former paramour Britta Englund is killed." ] ], "gold": "Kayla Brady is a fictional character from the television soap opera, Days of Our Lives, whom actress Catherine Mary Stewart portrayed from 1982 to 1983. In 1986, Mary Beth Evans was given the part and is the most recognizable actress in the role. Mary Beth Evans played Kayla from 1986 to 1992, from 2006 through 2009, in 2010, and in 2011 she began appearing on a regular basis in a recurring capacity. Rhonda Aldrich played Kayla Brady temporarily in 1989.", "prediction 1": "On the NBC daytime soap opera Days of Our Lives, Kayla Brady is a fictional character who first appeared on the show in 1982. The character was played by Mary Beth Evans from May 23, 1986 to May 26, 1992. The original role was played by Catherine Mary Stewart until December 14, 1983. Then, on January 18, 1982, Mary Beth Evans was cast.", "prediction 2": "Kayla Brady is a fictional character on the NBC daytime soap opera, Days of Our Lives. She made her first appearance in 1982. The character was originated on January 18, 1982 by actress Catherine Mary Stewart who played the role until December 14, 1983. The role is replaced in 1986 by actress Mary Beth Evans.", "prediction 3": "Kayla Brady was a fictional character on the NBC daytime soap opera Days of Our Lives. She made her first appearance in 1982 and was created by Pat Falken Smith as one of the original members of the Brady family, a fictional family on the serial. She is widely known for her popular pairing with Steve Johnson, which gave the couple the title of a famous super couple. Mary Beth Evans played the role from May 23, 1986 to May 26, 1992.", "prediction 4": "On Days of Our Lives, the character of Kayla Brady, played by Mary Beth Evans, first appeared in 1982. The role was originally played by Catherine Mary Stewart until December 14, 1983. Then, in 1986, the role was replaced by Mary Beth Evans. Then, in 2006, the role was returned to Mary Beth Evans for a short-stint on June 18, 2010, and then again on recurring status starting in December 2011. Then, in 2011, Mary Beth Evans returned to play Kayla on June 12, 2006.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "On the NBC daytime soap opera Days of Our Lives, Kayla Brady is a fictional character who first appeared on the show in 1982. The character was played by Mary Beth Evans ", "start": 285, "end": 337 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "On the NBC daytime soap opera Days of Our Lives, Kayla Brady is a fictional character who first appeared on the show in 1982, played by Catherine Mary Stewart until December 14, 1983. The character was played by Mary Beth Evans from May 23, 1986 to May 26, 1992, and from 2006 through 2009, then again in 2010, and in 2011 she began appearing on a regular basis in a recurring capacity." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "The young and the restless how many episodes?", "passages": [ [ "The Young and the Restless", "The Young and the Restless\n\nThe Young and the Restless (often abbreviated as Y&R) is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS.", "The show is set in a fictional Wisconsin town called Genoa City, which is unlike and unrelated to the real life village of the same name, Genoa City, Wisconsin.", "First broadcast on March 26, 1973, \"The Young and the Restless\" was originally broadcast as half-hour episodes, five times a week.", "The show expanded to one-hour episodes on February 4, 1980.", "In 2006, the series began airing encore episodes weeknights on SOAPnet until 2013, when \"Y&R\" moved to TVGN (now Pop).", "Pop still airs the encore episodes on weeknights, starting July 1, 2013.", "The series is also syndicated internationally.", "\"The Young and the Restless\" originally focused on two core families: the wealthy Brooks family and the working class Foster family.", "After a series of recasts and departures in the early 1980s, all the original characters except Jill Foster and Katherine Chancellor were written out.", "Bell replaced them with the new core families, the Abbotts and the Williamses.", "Over the years, other families such as the Newmans, Winters, and the Baldwin-Fishers were introduced." ], [ "The Young and the Restless", "Despite these changes, one storyline that has endured through almost the show's entire run is the feud between Jill Abbott and Katherine Chancellor, the longest rivalry on any American soap opera.", "Since its debut, \"The Young and the Restless\" has won nine Daytime Emmy Awards for Outstanding Drama Series.", "It is also currently the highest-rated daytime drama on American television.", "As of 2008, it had appeared at the top of the weekly Nielsen ratings in that category for more than 1,000 weeks since 1988.", "As of December 12, 2013, according to Nielsen ratings, \"The Young and the Restless\" was the leading daytime drama for an unprecedented 1,300 weeks, or 25 years.", "The serial is also a sister series to \"The Bold and the Beautiful\", as several actors have crossed over between shows.", "In June 2017, \"The Young and the Restless\" was renewed for three additional years.", "To compete with the youthful ABC soap operas, \"All My Children\", \"One Life to Live\", and \"General Hospital\", CBS executives wanted a new daytime serial that was youth oriented.", "William J. Bell and Lee Phillip Bell created \"The Young and the Restless\" in 1972 for the network under the working title, \"The Innocent Years!\"", "\"We were confronted with the very disturbing reality that young America had lost much of its innocence,\" Bell said." ], [ "Daniel Romalotti", "Subsequently, the character was rapidly aged, with Cam Gigandet assuming the role on March 10, 2004.", "The actor was fired after only a few days, and he last aired as Daniel on May 6, 2004.", "The role was recast with Owen Beckman, but the actor was also fired soon after landing the role; as opposed to Gigandet, Beckman's scenes were deleted when Michael Graziadei was cast in the role, who debuted on May 10, 2004.", "In May 2009, Graziadei signed a new contract with the soap, but in 2012, he chose not to renew his contract.", "He made his last appearance on January 3, 2013.", "However, Graziadei later reprised the role for four episodes from July 30 to August 2, 2013 to help usher his onscreen mother, Michelle Stafford, out of the series.", "In July 2016, \"Entertainment Weekly\" reported at Graziadei will briefly return on August 25, 2016, coinciding with \"The Young and the Restless\"'s 11,000 episode.", "Daniel was born off-screen on August 17, 1993; his birth year has since been revised to 1987.", "Daniel first arrived in Genoa City in 2004 after returning from boarding school to live with his mother, Phyllis Summers.", "Because she did not raise him as a child, Daniel resented Phyllis as well as her boyfriend, chemist Damon Porter." ] ], "gold": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. It is currently the highest-rated daytime drama on American television, a rank it has held for 32 years as of the end of the 2019\u201320 season. As of September 1, 2016, the show had 11,000 episodes and had 11,745 as of 2020.", "prediction 1": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. The series originally focused on two core families: the wealthy Brooks family and the working class Foster family. After a series of recasts and departures in the early 1980s, all the original characters except Jill Foster and Katherine Chancellor were written out. Bell replaced them with the new core families, the Abbotts and the Williamses. In June 2017, The Young and the Restless was renewed for three additional years.", "prediction 2": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. The show is set in a fictional Wisconsin town called Genoa City, which is unlike and unrelated to the real life village of the same name, Genoa City, Wisconsin. The first two seasons originally aired as half-hour episodes, five times a week. The show expanded to one-hour episodes on February 4, 1980.", "prediction 3": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. The series originally focused on two core families: the wealthy Brooks family and the working class Foster family. After a series of recasts and departures in the early 1980s, all the original characters except Jill Foster and Katherine Chancellor were written out. Bell replaced them with the new core families, the Abbotts and the Williamses. The show expanded to one-hour episodes on February 4, 1980. In 2006, the series began airing encore episodes weeknights on SOAPnet until 2013. In 2013, the series began airing encore episodes weeknights on TVGN (now Pop). In July 2016, Entertainment Weekly reported at Graziadei briefly return on August 25, 2016 coinciding with \"The Young and the Restless\"'s 11,000 episode count.", "prediction 4": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. Originally broadcast in half-hour episodes on March 26, 1973, the show expanded to one-hour episodes on February 4, 1980. In 2006, the series began airing encore episodes weeknights on SOAPnet until 2013, when the show moved to TVGN (now Pop). Pop still airs the encore episodes on weeknights, starting July 1, 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 235 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 386 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 546 } ], "missing-info": [], "corrected-prediction": "The Young and the Restless is an American television soap opera created by William J. Bell and Lee Phillip Bell for CBS. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What kind of dog is on homeward bound?", "passages": [ [ "Homeward Bound II: Lost in San Francisco", "Homeward Bound II: Lost in San Francisco\n\nHomeward Bound II:", "Lost in San Francisco is a 1996 American adventure comedy film and a sequel to the 1993 film \"\".", "Directed by David R. Ellis, the film features the three animals from the first film, Shadow the Golden Retriever (voiced by Ralph Waite, replacing Don Ameche, who died in 1993), Sassy the Himalayan cat (Sally Field), and Chance the American Bulldog (Michael J. Fox).", "It also features the voice work of Sinbad, Carla Gugino, Tisha Campbell-Martin, Stephen Tobolowsky, Jon Polito, Adam Goldberg, Al Michaels, Tommy Lasorda, and Bob Uecker.", "The film was released on March 8, 1996, and went on to gross over $32 million at the box office.", "The owners of Shadow the Golden Retriever (voiced by Ralph Waite), Sassy the Himalayan cat (Sally Field), and Chance the American Bulldog (Michael J. Fox) decide to take a family trip to Canada." ], [ "Homeward Bound: The Incredible Journey", "Homeward Bound: The Incredible Journey\n\nHomeward Bound: The Incredible Journey is a 1993 American adventure comedy film and a remake of the 1963 film \"The Incredible Journey\", which was based on the novel of the same name by Sheila Burnford.", "Directed by Duwayne Dunham, it was released on February 3, 1993.", "It grossed $41,833,324 in the United States and was followed in 1996 by \"\".", "This film is dedicated to producer Franklin R. Levy, who died during production of the film.", "Chance (voiced by Michael J. Fox), an immature and disobedient American Bulldog and the narrator of the film, explains that he is the pet of Jamie Burnford (Kevin Chevalia), but expresses no interest in his owner or being part of a family.", "He shares his home with Shadow (voiced by Don Ameche), a wise old Golden Retriever owned by Jamie's brother Peter (Benj Thall), and Sassy (voiced by Sally Field), a smart-mouthed Himalayan cat owned by Jamie and Peter's sister Hope (Veronica Lauren).", "That morning, the children's mother, Laura Burnford (Kim Greist), marries Bob Seaver (Robert Hays), and Chance manages to cause chaos by digging into the wedding cake in front of all the guests." ], [ "The Incredible Journey", "The Incredible Journey\n\nThe Incredible Journey (1961), by Scottish author Sheila Burnford, is a children's book first published by Hodder & Stoughton, which tells the story of three pets as they travel through the Canadian wilderness searching for their beloved masters.", "It depicts the suffering and stress of an arduous journey, together with the unwavering loyalty and courage of the three animals.", "The story is set in the northwestern part of Ontario, which has many lakes, rivers, and widely dispersed small farms and towns.", "It is usually considered a children's book, although Burnford has stated that she did not write it specifically for children.", "The book was a modest success when first published, but became widely known after 1963 when it was loosely adapted into a movie by the same name by Walt Disney.", "The story was again adapted loosely when Disney remade the film in 1993 as \"\".", "Burnford based the fictional story on the animals she and her husband owned while living in Canada: a Bull Terrier brought from England; a Siamese cat, whose mutual relationship with the terrier she described as \"closer than any other cat-and-dog relationship I had ever seen\"; and a young Labrador Retriever, who also developed a close relationship with the older dog." ] ], "gold": "There are several movies called Homeward Bound. Homeward Bound: The Incredible Journey is a 1993 American adventure comedy film that centers on the arduous journey of two dogs, a Golden Retriever and an American Bulldog, and a Himalayan cat. It is a remake of the 1963 film, The Incredible Journey, which was based on a novel of the same name. In 1996 Homeward Bound: The Incredible Journey was followed by a sequel, Homeward Bound II: Lost in San Francisco and features the same dogs and cat.", "prediction 1": "Homeward Bound is a 1993 American adventure comedy film based on the 1961 children's book of the same name by Scottish author Sheila Burnford, which tells the story of three pets as they travel through the Canadian wilderness searching for their beloved masters. The three pets are Shadow the Golden Retriever, Sassy the Himalayan cat, and Chance the American Bulldog.\n", "prediction 2": "The story of three pets, including a Golden Retriever, a Labrador Retriever, and a Himalayan cat, is told in both the 1963 film and the 1996 film Homeward Bound, which are both based on the 1961 children's book of the same name by Sheila Burnford.", "prediction 3": "Homeward Bound: The Incredible Journey is a 1993 American adventure comedy film and a remake of the 1963 film The Incredible Journey, which was based on the 1961 children's book of the same name by Sheila Burnford. The three animals on Homeward Bound are Shadow the Golden Retriever, Sassy the Himalayan cat, and Chance the American Bulldog. These pets decide to go on a family trip to Canada and the owners of each dog decide to transport their pet with them.", "prediction 4": "The three main dogs featured in the movie Homeward Bound are Shadow the Golden Retriever, Sassy the Himalayan cat, and Chance the American Bulldog. The three main characters in the movie are the three dogs of the children's book Homeward Bound: The Incredible Journey in 1963, Sassy the Himalayan cat in 1996, and Chance the American Bulldog in 1993.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 14 }, { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 346 }, { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 73 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "There are several movies called Homeward Bound. Homeward Bound: The Incredible Journey is a 1993 American adventure comedy film and a remake of the 1963 film \"The Incredible Journey\", which was based on the novel of the same name. It depicts the suffering and stress of an arduous journey, together with the unwavering loyalty and courage of three animals. The three animals are two dogs, a Golden Retriever and an American Bulldog, and a Himalayan cat. In 1996 Homeward Bound: The Incredible Journey was followed by a sequel, Homeward Bound II: Lost in San Francisco and features the same dogs and cat." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Where are the chargers playing their home games?", "passages": [ [ "Sports in San Diego", "The Chargers joined the NFL as result of the AFL\u2013NFL merger in 1970, and played their home games at the venue now known as SDCCU Stadium.", "On January 12, 2016, the Chargers were given a one-year option to join the Rams in the Los Angeles area.", "Team chairman and CEO Dean Spanos announced on January 29, 2016, that the Chargers would remain in San Diego for the 2016 season.", "In 2017 the Chargers moved back to their original city of Los Angeles, leaving San Diego without a professional football team for the first time since 1961.", "On May 29, 2018, the Alliance of American Football (AAF) announced they will start a franchise in San Diego, the San Diego Fleet, for their inaugural season in 2019.", "This franchise will play their home games at SDCCU Stadium.", "Former St. Louis Rams head coach, Mike Martz, is the head coach of the team.", "San Diego has a long history of minor league ice hockey teams, starting with the San Diego Skyhawks that played in the Pacific Coast Hockey League from 1948 to 1950.", "Hockey returned in 1966 with the San Diego Gulls of the Western Hockey League, which were created by Robert Breitbard to have a tenant for his upcoming arena \u2013 now known as the Valley View Casino Center.", "The Gulls soon grew a fanbase in San Diego, with averages of over 9,000 spectators." ], [ "Comparisons between the National Football League and NCAA football", "As of 2016, Los Angeles once again has an NFL team for the first time since the 1994 season; with the Rams returning from St Louis playing out of the Los Angeles Memorial Coliseum while a new stadium is constructed at Inglewood.", "Prior to 1994 it had two teams simultaneously.", "Immediately after that season, the Los Angeles Rams moved from suburban Anaheim to St. Louis, Missouri, and the Los Angeles Raiders returned to Oakland, California.", "The following year, the San Diego Chargers announced that they would return to Los Angeles, again giving it two teams.", "Los Angeles had multiple teams in the multiple American Football Leagues, prior to the NFL.", "The Los Angeles Wildcats, also called \"Wilson Wildcats\", were a traveling team for the first AFL in 1926.", "The Los Angeles Bulldogs were members of AFL (1937) and a minor AFL (1939) before joining the Pacific Coast Professional Football League.", "The Los Angeles Chargers were a charter member of AFL in 1960, becoming the San Diego Chargers in 1961.", "The returned to Los Angeles in 2017.", "The Los Angeles area has hosted the Super Bowl seven times.", "The Los Angeles Memorial Coliseum hosted Super Bowl I in 1967 and Super Bowl VII in 1973.", "The Rose Bowl hosted Super Bowl XI in 1977, Super Bowl XIV in 1980, Super Bowl XVII in 1983, Super Bowl XXI in 1987 and Super Bowl XXVII in 1993." ], [ "Sports in Los Angeles", "One year later, longtime Clippers owner Donald Sterling was banned from the NBA after derogatory statements he made became public, and was subsequently forced to sell the team.", "The franchise was purchased by former Microsoft executive Steve Ballmer in August 2014.", "The Clippers plan to build a new arena in Inglewood, across from the Los Angeles Stadium at Hollywood Park, by 2024 when their lease with Staples Center expires.", "The region has two National Football League (NFL) teams: the Los Angeles Chargers and Los Angeles Rams.", "The Rams originally played in LA from 1946 to 1994, while the Chargers shared LA with them for only one season in 1960.", "The NFL approved the Rams' relocation back to Los Angeles from St. Louis in 2016 with an option for the San Diego Chargers or Oakland Raiders to join at a later date.", "The Rams play their home games at Los Angeles Memorial Coliseum in Exposition Park until their new stadium, Los Angeles Stadium at Hollywood Park in Inglewood, is completed in 2020.", "In 2017, the Chargers announced they would be leaving San Diego to rejoin the Rams as the second team.", "For 2017 through 2019, the Chargers are playing in Carson at the soccer-specific StubHub Center until the new shared stadium is complete.", "2017 marked the first time since 1960 that the Rams and Chargers shared the same market and the first time since 1994 that the market had two NFL teams." ] ], "gold": "The Los Angeles Chargers were founded as a Los Angeles-based team on August 14, 1959, and began play on September 10, 1960. They spent their first season in Los Angeles, playing at the Los Angeles Memorial Coliseum, before relocating to San Diego in 1961, where they played at Balboa Stadium until 1966 and SDCCU Stadium from 1967-2016. The Chargers returned to Los Angeles prior to the 2017 season and played at Dignity Health Sports Park from 2017-2019, while SoFi Stadium was under construction. The Chargers currently play their home games at SoFi Stadium in Inglewood, California, which the club shares with the Los Angeles Rams.", "prediction 1": "The Los Angeles Chargers have played their home games in San Diego since 1960. Their first home games were played at SDCCU Stadium in 1970. From 2016 until 2019, the Chargers played in their home stadium in San Diego.", "prediction 2": "The Los Angeles Chargers joined the NFL as result of the AFL\u2013NFL merger in 1970, and played their home games at the venue now known as SDCCU Stadium. The team moved back to their original city of Los Angeles in 2017, leaving the city without a professional football team for the first time since 1961.", "prediction 3": "The Los Angeles Chargers are a professional football team and were founded in 1960 and played their home games in Los Angeles. In 2017 the Chargers moved back to their original city of Los Angeles, leaving San Diego without a professional football team for the first time since 1961. In 2018, the Alliance of American Football announced they would start a franchise in San Diego, the San Diego Fleet, for their inaugural season in 2019. This franchise will play their home games at SDCCU Stadium.", "prediction 4": "The Los Angeles Chargers joined the NFL as result of the AFL\u2013NFL merger in 1970, and played their home games at the venue now known as SDCCU Stadium. In 2017, the Chargers moved back to their original city of Los Angeles, leaving San Diego without a professional football team for the first time since 1961. In 2019, the Alliance of American Football announced they would start a franchise in San Diego, the San Diego Fleet, for their inaugural season in 2019. This franchise will play their home games at SDCCU Stadium.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 73, "end": 78 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 140, "end": 217 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Los Angeles Chargers were a charter member of AFL in 1960, becoming the San Diego Chargers in 1961. The Los Angeles Chargers played their first home games at SDCCU Stadium in 1970. For 2017 through 2019, the Chargers are playing in Carson at the soccer-specific StubHub Center until the new shared stadium, Los Angeles Stadium at Hollywood Park in Inglewood, is complete." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Who is the longest serving president in the world?", "passages": [ [ "Records of heads of state", "She has been Queen of the United Kingdom, Australia, Canada, and New Zealand, since February 6, 1952, but all of the other countries she is at present queen of had yet to gain independence at the time of her accession.", "The longest current reigning female monarch is Elizabeth II, who is the Queen of the United Kingdom and other commonwealth realms, and is a constitutional monarch.", "She has been Queen of the United Kingdom, Australia, Canada and New Zealand, since February 6, 1952, but all of the other countries she is at present queen of had yet to gain independence at the time of her accession.", "The longest-serving non-royal head of state in the 20th and 21st centuries was Fidel Castro, who held the titles of Prime Minister of Cuba, First Secretary of the Integrated Revolutionary Organizations, First Secretary of the Central Committee of the United Party for the Socialist Revolution of Cuba, First Secretary of the Central Committee of the Communist Party of Cuba, President of the Council of State, and President of the Council of Ministers of the Republic of Cuba.", "He served for 52 years, 2 months, and 3 days.", "The longest-serving and longest current serving male president ever is Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea of the Republic of Equatorial Guinea." ], [ "Records of heads of state", "The longest serving female non-royal head of state and longest serving female president ever was Vigd\u00eds Finnbogad\u00f3ttir, who was the President of the Republic of Iceland.", "She served for 16 years.", "The shortest serving monarch of all time is believed to be Louis XIX of France.", "After his father's abdication during the July Revolution on August 2, 1830, he ascended to the throne, but abdicated around 19 minutes later.", "This reign is disputed, as some historians believe this reign is too short to be valid.", "The next contender is the unnamed daughter of Emperor Xiaoming of Northern Wei who was appointed by her grandmother, Empress Dowager Hu.", "She reigned for a matter of hours until being replaced by Yuan Zhou.", "Mexican politician Pedro Lascur\u00e1in served as the 34th President of Mexico for a short period of time ranging from 15 to 56 minutes before he quit in a coup d'\u00e9tat in order to make General Victoriano Huerta the next President.", "Officially, the current Emperor of Japan, Akihito is the 125th in line from the first emperor Jimmu, who is variously believed to have reigned in the 1st or 7th century BC.", "However, the earliest documentary evidence is only for the 29th emperor, Kinmei (AD 509\u2013571)." ] ], "gold": "Different people can be considered the longest serving president in the world depending on what is meant by \"the longest serving president.\" The current longest serving male president, based only on time spent as president, is Teodoro Obiang Nguema Mbasogo, the President of the Republic of Equatorial Guinea. The current longest serving president in the world, including time spent as Prime Minister, is Paul Biya, President of Cameroon. The longest serving female president, ever, in the world, was Vigdis Finnbogadottir, the President of the Republic of Iceland.", "prediction 1": "The longest-serving and longest current serving male president ever is Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea. The longest-serving female non-royal head of state and longest serving female president ever was Vigds Finnbogad\u00f3ttir, who was the President of the Republic of Iceland. She served for 16 years.", "prediction 2": "The longest serving president is Fidel Castro, who held the titles of Prime Minister of Cuba, First Secretary of the Integrated Revolutionary Organizations, First Secretary of the Central Committee of the United Party for the Socialist Revolution of Cuba, First Secretary of the Central Committee of the Communist Party of Cuba, First Secretary of the Council of State, and President of the Council of Ministers of the Republic of Equatorial Guinea. He served for 52 years, 2 months, and 3 days. The longest-serving current serving male president ever is Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea. The longest-serving and longest current serving female non-royal head of state and longest current serving female president in the World was Vigds Finnbogad\u00f3ttttttttttj\u00f3n, who was the President of the Republic of Iceland.", "prediction 3": "The longest-serving and longest current serving male president ever was Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea. The longest-serving female non-royal head of state and longest serving female president ever was Vigds Finnbogad\u00f3ttir, who was the President of the Republic of Iceland. She served for 16 years. The longest-serving female head of state and longest serving female president ever was Vigds Finnbogad\u00f3tttttir, who was the President of the Republic of Iceland.", "prediction 4": "The longest-serving and longest current serving male president ever was Fidel Castro. He held the titles of Prime Minister of Cuba, First Secretary of the Integrated Revolutionary Organizations, First Secretary of the Central Committee of the United Party for the Socialist Revolution of Cuba, First Secretary of the Central Committee of the Communist Party of Cuba, and First Secretary of the Council of State. He served for 52 years, 2 months, and 3 days. The longest-serving female non-royal head of state and longest serving female president ever was Vigds Finnbogad\u00f3tttttttir, who was the President of Iceland. She served for 16 years. The longest serving current serving male president of Equatorial Guinea is Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea. The longest-serving and longest current serving male president in the world is Te", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 348 } ], "missing-info": [], "corrected-prediction": "The longest-serving and longest current serving male president ever is Teodoro Obiang Nguema Mbasogo, who is currently the President of Equatorial Guinea. The longest-serving female non-royal head of state and longest serving female president ever was Vigds Finnbogad\u00f3ttir, who was the President of the Republic of Iceland.." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did sweet child of mine hit the charts?", "passages": [ [ "Sweet Child o' Mine", "Sweet Child o' Mine\n\n\"Sweet Child o' Mine\" is a song by American rock band Guns N' Roses, appearing on their debut album, \"Appetite for Destruction\".", "Released in August 1988 as the album's third single, the song topped the \"Billboard\" Hot 100 chart, becoming the band's only number 1 US single.", "\"Billboard\" ranked it the number 5 song of 1988.", "Re-released in 1989, it reached number 6 on the UK Singles Chart.", "Guitarist Slash said in 1990, \"[The song] turned into a huge hit and now it makes me sick.", "I mean, I like it, but I hate what it represents.\"", "Slash has been quoted as having an initial disdain for the song due to its roots as simply a \"string skipping\" exercise and a joke at the time.", "During a jam session at the band's house in the Sunset Strip, drummer Steven Adler and Slash were warming up and Slash began to play a \"circus\" melody while making faces at Adler.", "Rhythm guitarist Izzy Stradlin asked Slash to play it again.", "Stradlin came up with some chords, Duff McKagan created a bassline and Adler planned a beat.", "In his autobiography, Slash said \"within an hour my guitar exercise had become something else\"." ], [ "Sweet Child o' Mine", "The story went viral quickly, encouraging several comments on both the MAX article and the suggestion that \"Unpublished Critics\" had influenced \"Sweet Child o' Mine\", including one from Duff McKagan, bass player with Guns N' Roses when \"Sweet Child o' Mine\" was written and recorded.", "McKagan found the similarities between the songs \"stunning,\" but said he had not previously heard \"Unpublished Critics.\"", "The song was covered by Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, \"The Globe Sessions\".", "This version earned her a Grammy Award for Best Female Rock Vocal Performance.", "The recording was produced by Rick Rubin and Crow.", "A music video for Crow's version was also released, directed by St\u00e9phane Sednaoui.", "Crow performed the song live at Woodstock '99.", "Ultimate Classic Rock profiled the song as part of a series on \"Terrible Classic Rock Covers\", and \"Rolling Stone\" readers named it the 4th worst cover song of all-time.", "\"Sweet Child O' Mine\" has been used in several films, such as:" ], [ "The Globe Sessions", "The Globe Sessions\n\nThe Globe Sessions is the third studio album by American singer-songwriter Sheryl Crow, released on 21 September 1998 in the United Kingdom and 29 September 1998 in the United States, then re-released in 1999.", "It was nominated for Album of the Year, Best Rock Album and Best Engineered Non-Classical Album at the 1999 Grammys, winning the latter two awards.", "\"The Globe Sessions\" reached \u00a02 on the UK Album Chart, while peaking at No. 5 on the \"Billboard\" 200 chart, achieving US sales of two million as of January 2008.", "The album was recorded at and named for the sessions recorded at Globe Recording Studio in New York owned by Robert FitzSimons and Tracey Loggia.", "On earlier versions of the album the track \"Crash and Burn\" contains the hidden track \"Subway Ride\", running , while omitting the track \"Sweet Child O' Mine\".", "Another version eliminates both \"Subway Ride\" and \"Sweet Child O' Mine\".", "The version of \"Sweet Child O' Mine\" included is the 'Rick Rubin New Mix', originally featured on the \"Big Daddy\" soundtrack and later included on \"Hits & Rarities\", and also called the 'Pop Version' on the CD single.", "It differs from the 'Rock Version' used in the single music video." ] ], "gold": "Sweet Child o' Mine was released in June 1988, and topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. The song was covered by Sheryl Crow in 1999 on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, The Globe Sessions. That version reached Number 29 on the US Adult Top 40 Chart.", "prediction 1": "The song Sweet Child o' Mine was released in August 1988 as the album's third single and topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. The song was later re-released in 1989 at number 6 on the UK Singles Chart and was covered by American singer-songwriter Sheryl Crow on the soundtrack to Big Daddy and released as a bonus track on her third studio album, The Globe Sessions.", "prediction 2": "\"Sweet Child o' Mine\" is a song by American rock band Guns N' Roses, appearing on their debut album Appetite for Destruction. Released in August 1988 as the album's third single, the song topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. Re-released in 1989, it reached number 6 on the UK Singles Chart. The song was also covered by American singer-songwriter Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, The Globe Sessions, and achieving US sales of two million as of two million in January 2008.", "prediction 3": "\"Sweet Child o' Mine\" is a song by American rock band Guns N' Roses, appearing on their debut album, Appetite for Destruction. Released in August 1988 as the album's third single, the song topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. Re-released in 1989, it reached number 6 on the UK Singles Chart. It was also covered by American singer-songwriter Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album The Globe Sessions, which reached 2 on the UK Album Chart, while peaking at No. 5 on the Billboard 200 chart, achieving US sales of 2 million as of January 2008.", "prediction 4": "\"Sweet Child o' Mine\" is a song by American rock band Guns N' Roses, appearing on their debut album, Appetite for Destruction. It was released in August 1988 as the album's third single and topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. It was re-released in 1989, reaching number 6 on the UK Singles Chart. The song was later covered by American singer-songwriter Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, The Globe Sessions, which reached 2 on the UK Album Chart, while peaking at No. 5 on the Billboard 200 chart, achieving US sales of two million as of January 2008.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 290 } ], "missing-info": [], "corrected-prediction": "The song Sweet Child o' Mine was released in August 1988 and topped the Billboard Hot 100 chart, becoming the band's only number 1 US single. The song was covered by Sheryl Crow on the soundtrack to Big Daddy and released as a bonus track on her third studio album, The Globe Sessions." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "When does the next season of ninjago come out?", "passages": [ [ "SpongeBob's Truth or Square", "Nickelodeon animation president Brown Johnson said \"Over the past decade, SpongeBob has become one of the most beloved characters in television history[...]", "And we're excited to cap off the year's celebration with this star-studded special anniversary event.\"", "Andrew Overtoom, supervising director, Alan Smart, and Tom Yasumi served as the special's animation directors while Luke Brookshier and Nate Cash handled the storyboard direction.", "It was a part of the series' tenth anniversary celebration.", "The title sequence of \"SpongeBob\" for the special was made exclusively for the series' tenth anniversary.", "It was animated in stop motion animation, with Cee Lo Green performing the theme.", "Mark Caballero, Seamus Walsh and Chris Finnegan of Screen Novelties animated its opening titles.", "Finnegan claimed that the crew were \"thrill[ed]\" to do the title sequence because \"the original title sequence is so recognizable and everyone seen it over and over and it's so great in its own way.\"" ], [ "John Cena", "He also guest starred as himself in the seventh episode of Disney Channel's \"Hannah Montana Forever\".", "On August 17, 2015, Cena guest co-hosted \"Today\" on NBC.", "He co-hosted the show again on December 28 and 29, 2015.", "Cena appeared on \"Late Night with Seth Meyers\" on August 21, 2015.", "Cena co-hosted \"Today\" again on March 28\u201330 and May 9, 10, 13 and 30, 2016.", "Cena hosts \"American Grit\" on Fox, which is a reality television series with 10 episodes.", "16 men and women were split into four teams, where challenges were given.", "A US$1 million prize was given to the winning team.", "\"American Grit\" premiered on Fox on April 14, 2016.", "Cena has been retweeting motivational tweets from his followers on Twitter who used the hashtag #ShowYourGrit, in a way that the fan did something motivational to his/her friends in a real-life scenario.", "The finale of Season 1 aired on June 9, 2016.", "Cena hosted the ESPN ESPY Awards on July 13, 2016, in Los Angeles.", "On December 10, 2016, Cena was the guest host of \"Saturday Night Live\" (\"SNL\") on NBC." ] ], "gold": "The show Ninjago has been in continuous production for over a decade, and celebrated its tenth anniversary on January 14, 2021. Some earlier seasons were aired on June 29, 2015, June 9, 2016, and May 15, 2017.", "prediction 1": "The next season of Ninjago came out in the US on March 9, 2018. The next season of Ninjago: Ultimate Team also came out in the US on March 5, 2019.", "prediction 2": "Nickelodeon released the first two seasons of Ninjago: The Animated Series on November 16, 2009. The third and final season released on December 7, 2018.", "prediction 3": "The next season of Ninjago came out on March 24, 2019. The next season of Ninjago 2 came out on May 26, 2019.", "prediction 4": "The next season of ninjago came out on Nickelodeon on August 9, 2017. The next season of ninjago: Warriors of the Fall came out on August 11, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 63 }, { "error type": "Unverifiable", "explanation": "", "start": 64, "end": 147 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played miss honey in the film matilda?", "passages": [ [ "Matilda (1996 film)", "Matilda (1996 film)\n\nMatilda is a 1996 American fantasy comedy film directed by Danny DeVito, who also produced with Michael Shamberg, Stacey Sher, and Lucy Dahl.", "It was written by Nicholas Kazan and Robin Swicord, based on Roald Dahl's novel of the same name.", "Mara Wilson, DeVito, Rhea Perlman, Embeth Davidtz, and Pam Ferris star.", "The film is about a young genius named Matilda, who uses telekinesis to deal with her parents, who do not value education, and Agatha Trunchbull, the oppressive principal of Crunchem Hall Elementary School.", "The film was released in the United States on August 2, 1996.", "Matilda Wormwood is a genius, but her parents, Harry and Zinnia, and her brother Michael ignore and mistreat her.", "Since babyhood, Matilda has displayed incredible learning ability and develops a strong sense of independence due to her often being left alone at home every weekday when her father is at work, her mother is playing bingo, and Michael is at school.", "To pass the time, Matilda learns the route to the public library to read books.", "At age six-and-a-half, Matilda begins to lose patience with her parents, expressing a desire to go to school, which her parents refuse blatantly and tease her." ], [ "Matilda (1996 film)", "In retaliation for her father constantly berating her, she resolves to punish him each time, first by adding hydrogen peroxide to his hair tonic to turn his hair an unhealthy blonde, and then gluing his hat to his head after discovering his cheating car business.", "Coincidentally, unlucky things begin to happen around Harry when Matilda gets angry with him.", "For instance, when reading a borrowed library copy of \"Moby-Dick\", which Harry rips up and makes her watch television instead, her increasing anger causes the television set to suddenly explode.", "Harry finally relents to letting Matilda go to school after selling a car to Agatha Trunchbull, the tyrannical principal of a rundown elementary school, Crunchem Hall.", "There, Matilda befriends several children and discovers Trunchbull's violent nature and overly harsh punishments of the students which have gone unsanctioned by the authorities.", "Thankfully, Matilda's teacher, Jennifer Honey, is a kind woman who adores her class and takes an immediate liking to Matilda's gentle and humble nature despite her incredible genius.", "She requests to Trunchbull that Matilda be moved up to a higher class, but Trunchbull refuses." ] ], "gold": "In the 1996 American fantasy comedy film, Matilda, the character Miss Honey is Matilda's school teacher. Because Miss Honey is shown at different ages in the film, more than one actress plays the part. Embeth Davidtz plays Miss Honey, the school teacher. Amanda and Kristyn Summers play Miss Honey at 2-years-old. And, the 5-year-old version of Miss Honey is played by Phoebe Pearl.", "prediction 1": "In the 1996 film Matilda, Jennifer Honey is the teacher. In the film, Miss Honey is played by Embeth Davidtz.", "prediction 2": "Matilda is a 1996 American fantasy comedy film directed by Danny DeVito, who also produced with Michael Shamberg, Stacey Sher, and Lucy Dahl. It was written by Nicholas Kazan and Robin Swicord, based on Roald Dahl's novel of the same name. Matilda Wormwood is a genius who uses telekinesis to deal with her parents, who do not value education, and Agatha Trunchbull, the oppressive principal of Crunchem Hall Elementary School. Honey is a kind woman who adores her class and takes an immediate liking to Matilda's gentle and humble nature despite her incredible genius.", "prediction 3": "Matilda is a 1996 American fantasy comedy film directed by Danny DeVito, who also produced with Michael Shamberg, Stacey Sher, and Lucy Dahl. The film is about a young genius named Matilda, who uses telekinesis to deal with her parents, who do not value education, and Agatha Trunchbull, the oppressive principal of Crunchem Hall Elementary School. Embeth Davidtz plays Miss Honey.", "prediction 4": "Matilda is a 1996 American fantasy comedy film directed by Danny DeVito, who also produced the film with Michael Shamberg, Stacey Sher, and Lucy Dahl. In the film, Mara Wilson plays Matilda Wormwood's teacher, Jennifer Honey. Honey is played by Embeth Davidtz, Pam Ferris, and Mara Wilson plays Matilda's mother, Zinnia.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "In the 1996 film Matilda, Jennifer Honey is the teacher. In the film, Miss Honey is played by Embeth Davidtz." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does black panther come out on dvd?", "passages": [ [ "Black Panther (film)", "The digital and Blu-ray releases included several bonus features: behind-the-scenes featurettes, audio commentary, deleted scenes, a blooper reel, an exclusive look at \"Ant-Man and the Wasp\", and a featurette on the first ten years of the MCU. , the film's Blu-ray and DVD releases have sold 4.2million units and grossed in the United States, making it the best-selling film of 2018 so far.", "\"Black Panther\" grossed $700.1million in the United States and Canada, and $646.9million in other territories, for a worldwide total of $1.347billion.", "During its theatrical run, it became the highest-grossing solo superhero film, the third-highest-grossing film of the MCU and superhero film overall, the ninth-highest-grossing film of all time, and the highest grossing film by a black director.", "It is the fifth MCU film and 33rd overall to surpass $1billion, and the second-highest-grossing film of 2018.", "In March 2018 \"Deadline Hollywood\" estimated the net profit of the film would be $461\u00a0million, accounting for production budgets, P&A, talent participations and other costs, with box office grosses and ancillary revenues from home media." ], [ "Black Panther (comics)", "Black Panther (comics)\n\nBlack Panther is a fictional superhero appearing in American comic books published by Marvel Comics.", "The character was created by writer-editor Stan Lee and writer-artist Jack Kirby, first appearing in \"Fantastic Four\" #52 (cover-dated July 1966) in the Silver Age of Comic Books.", "Black Panther's real name is T'Challa, king and protector of the fictional African nation of Wakanda.", "Along with possessing enhanced abilities achieved through ancient Wakandan rituals of drinking the essence of the heart-shaped herb, T'Challa also relies on his proficiency in science, rigorous physical training, hand-to-hand combat skills, and access to wealth and advanced Wakandan technology to combat his enemies.", "Black Panther is the first superhero of African descent in mainstream American comics, having debuted years before early African American superheroes such as Marvel Comics' the Falcon (1969), Luke Cage (1972) and Blade (1973), or DC Comics' John Stewart in the role of Green Lantern (1971).", "In one comic book storyline, the Black Panther mantle is handled by Kasper Cole, a multiracial New York City police officer.", "Beginning as an impersonator, Cole would later take on the moniker of White Tiger and become an ally to T'Challa." ], [ "Black Panther (comics)", "The role of Black Panther and leadership of Wakanda is also given to T'Challa's sister Shuri for a short time.", "Black Panther has made numerous appearances in various television shows, animated films and video games.", "The character is portrayed in live action by Chadwick Boseman in the 2016 film \"\", and the 2018 films \"Black Panther\" and \"\", set in the Marvel Cinematic Universe.", "In 2011, Black Panther was ranked 51st overall on IGN's \"Top 100 Comic Books Heroes\" list.", "The Black Panther's name predates the October 1966 founding of the Black Panther Party, though not the black panther logo of the party's predecessor, the Lowndes County Freedom Organization (LCFO), nor the segregated World War II Black Panthers Tank Battalion.", "Stan Lee, co-creator of the comic, denied that the comic, which pre-dates the political usage of the term, was, or could have been, named after any of the political uses of the term \"black panther\", including the LCFO, citing \"a strange coincidence\".", "He is the first black superhero in American mainstream comic books; very few black heroes were created before him, and none with actual superpowers." ], [ "Black Panther (TV series)", "Magna Pacific released the series in region 4.", "It was released on DVD and Blu-ray on December 1, 2010." ] ], "gold": "Black Panther is a fictional character and superhero appearing in American comic books published by Marvel Comics. Black Panther has made numerous appearances in various television shows, animated films and video games. The cartoon series \"Black Panther\" came out on DVD in Australia on December 1, 2010 and in the US on January 18, 2011. The \"Black Panther\" superhero movie was released for digital download by Walt Disney Studios Home Entertainment on May 8, 2018, and on Ultra HD Blu-ray, Blu-ray, and DVD on May 15, 2018.", "prediction 1": "Black Panther is a superhero appearing in American comic books published by Marvel Comics. The character was created by writer-editor Stan Lee and writer-artist Jack Kirby, first appearing in Fantastic Four #52 in the Silver Age of Comic Books. Black Panther was remade in 2015 for the big screen in the United States by AMC and released on DVD on December 1, 2015.", "prediction 2": "Black Panther is a fictional superhero appearing in American comic books published by Marvel Comics. The character was created by writer-editor Stan Lee and writer-artist Jack Kirby, first appearing in Fantastic Four #52 in the Silver Age of Comic Books. The 2016 film and the 2018 film \"Black Panther\" were released on DVD on January 7, 2016 and January 27, 2017.", "prediction 3": "Black Panther is a fictional superhero appearing in American comic books published by Marvel Comics. The character has made numerous appearances in various television shows, animated films and video games. In 2015, the Netflix Original series \"Black Panther\" was released on DVD and Blu-ray, while the 2016 film \"Black Panther\" was released on DVD and Blu-ray on April 17, 2016.", "prediction 4": "Black Panther is a fictional superhero appearing in American comic books published by Marvel Comics. It's release on DVD and Blu-ray was on December 1, 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 244 }, { "error type": "Unverifiable", "explanation": "", "start": 245, "end": 365 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Black Panther is a superhero appearing in American comic books published by Marvel Comics. The digital and Blu-ray for Black Panther (film) released in 2018. Black Panther (TV series) was released on DVD and Blu-ray on December 1, 2010." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When did california become a state of the united states?", "passages": [ [ "California", "The Central Valley, a major agricultural area, dominates the state's center.", "Although California is well-known for its warm Mediterranean climate, the large size of the state results in climates that vary from moist temperate rainforest in the north to arid desert in the interior, as well as snowy alpine in the mountains.", "Over time, drought and wildfires have become more pervasive features.", "What is now California was first settled by various Native Californian tribes before being explored by a number of European expeditions during the 16th and 17th centuries.", "The Spanish Empire then claimed it as part of Alta California in their New Spain colony.", "The area became a part of Mexico in 1821 following its successful war for independence but was ceded to the United States in 1848 after the Mexican\u2013American War.", "The western portion of Alta California then was organized and admitted as the 31st state on September 9, 1850.", "The California Gold Rush starting in 1848 led to dramatic social and demographic changes, with large-scale emigration from the east and abroad with an accompanying economic boom.", "The word \"California\" originally referred to the Baja California Peninsula of Mexico; it was later extended to the entire region composed of the current United States states of California, Nevada, and Utah, and parts of Arizona, New Mexico, Texas and Wyoming." ], [ "California", "California was suddenly no longer a sparsely populated backwater, but seemingly overnight it had grown into a major US population center.", "The seat of government for California under Spanish and later Mexican rule had been located in Monterey from 1777 until 1845.", "Pio Pico, last Mexican governor of Alta California, had briefly moved the capital to Los Angeles in 1845.", "The United States consulate had also been located in Monterey, under consul Thomas O. Larkin.", "In 1849, a state Constitutional Convention was first held in Monterey.", "Among the first tasks of the Convention was a decision on a location for the new state capital.", "The first full legislative sessions were held in San Jose (1850\u20131851).", "Subsequent locations included Vallejo (1852\u20131853), and nearby Benicia (1853\u20131854); these locations eventually proved to be inadequate as well.", "The capital has been located in Sacramento since 1854 with only a short break in 1862 when legislative sessions were held in San Francisco due to flooding in Sacramento.", "Once the state's Constitutional Convention had finalized its state constitution, it applied to the US Congress for admission to statehood.", "On September 9, 1850, as part of the Compromise of 1850, California was officially admitted into the United States as an undivided free state.", "Its status as a 'free state' prevented the expansion of slavery to the Pacific Coast, which was a foremost concern for the pre-Civil War US Congress." ], [ "Geography of Arizona", "Geography of Arizona\n\nArizona is a landlocked state situated in the southwestern region of the United States of America.", "It has a vast and diverse geography famous for its deep canyons, high- and low-elevation deserts, numerous natural rock formations, and volcanic mountain ranges.", "Arizona shares land borders with Utah to the north, the Mexican state of Sonora to the south, New Mexico to the east, and Nevada to the northwest, as well as water borders with California and the Mexican state of Baja California to the southwest along the Colorado River.", "Arizona is also one of the Four Corners states and is diagonally adjacent to Colorado.", "Arizona has a total area of , making it the sixth largest U.S. state.", "Of this area, just 0.32% consists of water, which makes Arizona the state with the second lowest percentage of water area (New Mexico is the lowest at 0.19%).", "Arizona spans about at its widest and at its longest, and has an average elevation of about .", "The geographic center of Arizona is located in Yavapai County, approximately east-southeast of the city of Prescott.", "Arizona is divided into 15 counties, and has 90 incorporated cities and towns.", "Approximately 65 percent of Arizona residents live in Maricopa County, which had a population of 3,880,181 as of the 2000 Census." ] ], "gold": "California is the most populous and third largest state in the Western United States, which is bordered by Nevada to the east, Arizona to the southeast, the Pacific Ocean to the west, Oregon to the north, and the Mexican state of Baja California to the south. The area that is now California was first settled by various Native Californian tribes before being explored by a number of Europeans during the 16th and 17th centuries. It became a part of Mexico in 1821, following its successful war for independence, but was ceded to the United States in 1848 after the Mexican-American War. California was officially admitted to the United States as the 31st state on September 9, 1850.", "prediction 1": "California was first settled by various Native Californian tribes before being explored by a number of European expeditions during the 16th and 17th centuries. The Spanish Empire then claimed it as part of Alta California in their New Spain colony. The western portion of Alta California then was organized and admitted as the 31st state on September 9, 1850.", "prediction 2": "California became a state of the United States on September 9, 1850, when the west portion of Alta California was organized and admitted as the 31st state. The state's Constitutional Convention had finalized its state constitution and applied to the US Congress for admission to statehood. On September 9, 1850, as part of the Compromise of 1850, California was officially admitted into the United States as an undivided free state.", "prediction 3": "On September 9, 1850, as part of the Compromise of 1850, California was officially admitted into the United States as an undivided free state. Its status as a 'free state' prevented the expansion of slavery to the Pacific Coast, which was a foremost concern for the pre-Civil War US Congress.", "prediction 4": "California became a state of the United States on September 9, 1850, as part of the Compromise of 1850, and was officially admitted into the US as an undivided free state. Its status as a 'free state' prevented the expansion of slavery to the Pacific Coast, which was a foremost concern for the pre-Civil War US Congress.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 276 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "California was first settled by various Native Californian tribes before being explored by a number of European expeditions during the 16th and 17th centuries. The area became a part of Mexico in 1821 following its successful war for independence but was ceded to the United States in 1848 after the Mexican\u2013American War. California then was organized and admitted as the 31st state on September 9, 1850." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who is noah flynn from the kissing booth?", "passages": [ [ "The Kissing Booth", "The Kissing Booth\n\nThe Kissing Booth is a 2018 American romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles.", "It stars Molly Ringwald, Joey King, Jacob Elordi and Joel Courtney.", "The film was released on 11 May 2018 on Netflix.", "Born on the same day and time in the same hospital in Los Angeles, California, Elle Evans (Joey King) and Lee Flynn (Joel Courtney) have been best friends all their lives.", "To keep their special friendship, the pair created a set of friendship rules they promise to follow, including rule #9: relatives totally off limits, especially Lee's older brother Noah (Jacob Elordi).", "On the first day of school due to unforeseen circumstances Elle is forced to go to school wearing a skirt that is too small.", "Another student touches her butt which almost gets Lee into a fight but Noah instead jumps into the fight.", "Elle violates the dress code", "so she has to serve detention.", "Tuppen, the student who touched Elle inappropriately, later apologizes.", "Lee and Elle chat", "and he approves of her going on a date with Tuppen however Elle is stood up.", "He goes to see her later that night to let her know that he was threatened by Noah not to go out with her." ], [ "Jacob Elordi", "Jacob Elordi\n\nJacob Elordi (born 26 June 1997) is an Australian actor .", "He played the role of Noah Flynn in \"The Kissing Booth.\"", "Since 2017, Elordi has been dating his co-star Joey King from \"The Kissing Booth\".", "He attended St. Joseph's College, Nudgee in a Northern suburb of Brisbane, Queensland, Australia.", "Elordi's first appearance in a Hollywood film was in \".\"", "In 2017, he was in the film \"Swinging Safari\" playing the role of Rooster.", "He also starred in the movie\" The Kissing Booth\" with the role of Noah Flynn.", "In 2018, Elordi starred in the horror film \"The Mortuary Collection\".", "He is also currently filming two TV series: \"Euphoria\" and an untitled Netflix Original." ], [ "Adam DeVine", "In 2018, DeVine played the lead, Noah Ashby, in the romantic comedy \"When We First Met\", which he also co-wrote.", "His co-stars include Alexandra Daddario, Shelley Hennig and Robbie Amell.", "Also that year, Devine, Anderson, and Holm starred in the film \"Game Over, Man!", "\", with Newacheck directing and Newacheck and Seth Rogen among its producers.", "On November 2, 2016, DeVine was cast as the lead of Walt Disney Pictures family-film \"Magic Camp\", alongside Jeffrey Tambor and Gillian Jacobs.", "DeVine plays Andy Tuckerman, a failed magician who goes back to the camp of his youth to mentor a rag-tag bunch of magicians.", "in May, 2017, DeVine was cast alongside Rebel Wilson and Liam Hemsworth in the romantic comedy \"Isn't It Romantic\".", "This film marks the fourth time that DeVine and Wilson have played love interests, after \"Workaholics\", \"Pitch Perfect\" and \"Pitch Perfect 2\"." ] ], "gold": "The Kissing Booth is an American teen romantic comedy film written and directed by Vince Marcello, that premiered on Netflix in May 2018. The film had two sequels, one that was released in 2020 and one in 2021. In the films, Noah Flynn is the love interest of a quirky, late blooming teenager named Elle, who has had a lifelong friendship with his younger brother, Lee. Noah is played by Jacob Elordi in all three films in The Kissing Booth series.", "prediction 1": "The Kissing Booth is a 2018 American romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles. It stars Molly Ringwald, Joey King, Jacob Elordi and Joel Courtney. American actor Jacob Elordi played the role of Noah Flynn. Australian actor Joey King played the role of Noah Flynn.", "prediction 2": "The Kissing Booth is a 2018 American romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles. The Kissing Booth stars Molly Ringwald, Joey King, Jacob Elordi and Joel Courtney. Australian actor Jacob Elordi played the role of Noah Flynn in The Kissing Booth.", "prediction 3": "The Kissing Booth is a 2018 romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles. It stars Molly Ringwald, Joey King, Jacob Elordi and Joel Courtney. The two have been best friends all their lives, so when Lee and Elle go to school one day due to unforeseen circumstances Elle is forced to wear a skirt that is too small, which almost gets Lee into a fight, but Noah instead jumps into the fight. In the movie Noah Flynnn, Jacob Elordi plays Noah Flynnnnnnnnn.", "prediction 4": "Noah Flynn is a fictional character in the 2018 romantic comedy film The Kissing Booth, played by Jacob Elordi and Joel Courtney. Flynn is the older brother of Elle and Joey, who have been best friends all their lives. Elordi has been dating his co-star Joey King since 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 206 }, { "error type": "Redundant", "explanation": "The Kissing Booth is a 2018 American romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles. It stars Molly Ringwald, Joey King, Jacob Elordi ", "start": 207, "end": 265 }, { "error type": "Redundant", "explanation": "The Kissing Booth is a 2018 American romantic comedy film directed by Vince Marcello, based on the novel of the same name by Beth Reekles. It stars Molly Ringwald, Joey King, Jacob Elordi ", "start": 266, "end": 323 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Kissing Booth is a 2018 American romantic comedy film, released on Netflix, directed by Vince Marcello. Elle Evans and Lee Flynn have been best friends all their lives and Lee's older brother is Noah. It stars Jacob Elordi. The Australian actor played the role of Noah Flynn." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Who is mr smith in sarah jane adventures?", "passages": [ [ "Mr Smith (The Sarah Jane Adventures)", "Mr Smith (The Sarah Jane Adventures)\n\n", "Mr Smith is a fictional extraterrestrial computer voiced by Alexander Armstrong which appears in the British children's science fiction television series, \"The Sarah Jane Adventures\", with further minor appearances in the final two episodes of the fourth series of \"Doctor Who\".", "He is installed in the attic of Sarah Jane Smith's home, and is used to hack into other systems; Sarah Jane asserts that he can hack \"into anything\".", "He first appeared in \"Invasion of the Bane\", the 2007 New Year's Day premi\u00e8re special, and has appeared in all the stories except \"The Eternity Trap\".", "Mr Smith is a Xylok, a member of a crystalline race which crashed to Earth as a meteorite some 60 million years in Earth's past.", "It was trapped underneath the surface of the Earth until the eruption of Krakatoa brought a single, small Xylok to the attention of geologists.", "Sarah Jane received the crystal from a geologist friend as an aid to her studies in volcanic activity.", "She found that the crystal could communicate with her laptop; it revealed to her that it could help her track alien life and protect the earth.", "To this end it is the core of the supercomputer known as Mr Smith." ], [ "Alexander Armstrong", "Alexander Armstrong\n\nAlexander Henry Fenwick Armstrong (born 2 March 1970) is an English comedian, actor, television presenter and bass baritone singer, best known as one half of the comedy duo Armstrong and Miller and as host of the BBC TV game show \"Pointless\".", "Aside from his \"Armstrong and Miller\" sketch show characters, Armstrong's television credits include a leading role in the TV series \"Life Begins\", whilst he also voiced Professor M in \"Tooned\", alien supercomputer Mr Smith in the \"Doctor Who\" spin-off \"The Sarah Jane Adventures\" as well as the main show's two part story \"The Stolen Earth\" / \"Journey's End\", and the title character in the revived series of \"Danger Mouse\".", "Armstrong was born in Rothbury, Northumberland, the youngest of three children, to physician Henry Angus Armstrong and his wife, Emma Virginia Peronnet Thompson-McCausland.", "His maternal grandparents were economist Lucius Thompson-McCausland and Helen Laura McCausland (6 April 1903 \u2013 February 2000), granddaughter of Captain Conolly Thomas McCausland (13 May 1828 \u2013 25 June 1902) and Hon.", "Laura St. John (12 June 1842 \u2013 21 October 1919), daughter of St Andrew St John, 15th Baron St John of Bletso." ] ], "gold": "The Xylok, Mr. Smith, is a fictional extraterrestrial computer which appears in the British Children's science fiction television series, The Sarah Jane Adventures. Actor Alexander Armstrong provides the voice of Mr. Smith.", "prediction 1": "Mr Smith is a fictional extraterrestrial computer voiced by Alexander Armstrong. He appears in the British children's science fiction television series, The Sarah Jane Adventures, with further minor appearances in the final two episodes of the fourth series of Doctor Who. Mr Smith is a Xylok, a member of a crystalline race which crashed to Earth as a meteorite some 60 million years in Earth's past. It was trapped underneath the surface of the Earth until the eruption of Krakatoa brought a single, small Xylok to the attention of geologists.", "prediction 2": "Mr Smith is a fictional extraterrestrial computer voiced by Alexander Armstrong, who appears in the British children's science fiction television series, The Sarah Jane Adventures, with further minor appearances in the final two episodes of the fourth series of Doctor Who. Mr Smith is a Xylok, a member of a crystalline race which crashed to Earth as a meteorite some 60 million years in Earth's past. It was trapped underneath the surface of the Earth until the eruption of Krakatoa brought a single, small Xylok to the attention of geologists.", "prediction 3": "Mr Smith is a fictional extraterrestrial computer voiced by Alexander Armstrong which appears in the British children's science fiction television series, The Sarah Jane Adventures, with further minor appearances in the final two episodes of the fourth series of Doctor Who. Mr Smith is a Xylok, a member of a crystalline race which crashed to Earth as a meteorite some 60 million years in Earth's past. It was trapped underneath the surface of the Earth until the eruption of Krakatoa brought a single, small Xylok to the attention of geologists. Mr Smith has appeared in all the stories except for The Eternity Trap.", "prediction 4": "Mr Smith in The Sarah Jane Adventures is a fictional extraterrestrial computer voiced by Alexander Armstrong. Mr Smith is a member of a crystalline race which crashed to Earth as a meteorite some 60 million years in Earth's past. It was trapped underneath the surface of the Earth until the eruption of Krakatoa brought a single, small Xylok to the attention of geologists. Sarah Jane received the crystal from a geologist friend as an aid to her studies in volcanic activity. It revealed to her that it could help her track alien life and protect the earth. Mr Smith is a member of a Xylok, a member of a crystalline race which crashed to Earth some 60 million years in Earth's past.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 545 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 401 } ], "missing-info": [], "corrected-prediction": "Mr Smith is a fictional extraterrestrial computer voiced by Alexander Armstrong. He appears in the British children's science fiction television series, The Sarah Jane Adventures. Mr Smith is a Xylok." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the score for 2001 a space odyssey?", "passages": [ [ "2001: A Space Odyssey (score)", "2001:", "A Space Odyssey (score)\n\nThe \"2001: A Space Odyssey\" score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film, \".\"", "In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for \"Spartacus\" and also worked on \"Dr. Strangelove\", to write the score of his upcoming film \"\".", "However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the soundtrack.", "North did not know of the abandonment of the score until after he saw the film's premiere screening.", "The world's first exposure to North's unused music was in 1993 via Telarc's issue of the main theme on \"Hollywood's Greatest Hits, Vol. 2\", a compilation album by Erich Kunzel and the Cincinnati Pops Orchestra.", "All the music North originally wrote was recorded commercially by North's friend and colleague Jerry Goldsmith with the National Philharmonic Orchestra and was released on Var\u00e8se Sarabande CDs shortly after Telarc's first theme release but before North's death." ] ], "gold": "In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus and also worked on Dr. Strangelove, to write the score of his upcoming film 2001: A Space Odyssey. However, during post-production, Kubrick chose to abandon North's music in favor of classical music pieces he had earlier chosen as \"guide pieces\" for the soundtrack. North did not know of the abandonment of the score until after he saw the film's premiere screening. Richard Strauss, Johann Strauss, and Aram Khachaturian wrote the music that was used in 2001: A Space Odyssey.", "prediction 1": "The 2001: A Space Odyssey score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film, \". In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus, Dr. Strangelove, and Spartacus II, to write the score of his upcoming film. However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the film's soundtrack. North did not know of the abandonment of the score until after he saw the film's premiere screening.", "prediction 2": "The 2001: A Space Odyssey score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film. In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus and also worked on Dr. Strangelove, to write the score of his upcoming film. However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the film's soundtrack. North did not know of the abandonment of the score until after he saw the film's premiere screening.", "prediction 3": "The 2001: A Space Odyssey score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film, \".\" In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus and also worked on \"Dr. Strangelove\", to write the score of his upcoming film \".\" However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the soundtrack.", "prediction 4": "The \"2001: A Space Odyssey\" score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film, \". Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus and also worked on \"Dr. Strangelove\", to write the score of his upcoming film. However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the soundtrack. North did not know of the abandonment of the score until after he saw the film's premiere screening. Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the soundtrack.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The 2001: A Space Odyssey score is an unused film score composed by Alex North for Stanley Kubrick's 1968 film, \". In the early stages of production, Kubrick had commissioned noted Hollywood composer Alex North, who had written the score for Spartacus, Dr. Strangelove, and Spartacus II, to write the score of his upcoming film. However, during post-production, Kubrick chose to abandon North's music in favor of the now-familiar classical music pieces he had earlier chosen as \"guide pieces\" for the film's soundtrack. North did not know of the abandonment of the score until after he saw the film's premiere screening." }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "When did lord of the rings become popular?", "passages": [ [ "Reception of J. R. R. Tolkien", "In 1957, it was awarded the International Fantasy Award.", "Despite its numerous detractors, the publication of the Ace Books and Ballantine paperbacks helped \"The Lord of the Rings\" become immensely popular in the 1960s.", "The book has remained so ever since, ranking as one of the most popular works of fiction of the twentieth century, judged by both sales and reader surveys.", "In the 2003 \"Big Read\" survey conducted by the BBC, \"The Lord of the Rings\" was found to be the \"Nation's best-loved book.\"", "In similar 2004 polls both Germany and Australia also found \"The Lord of the Rings\" to be their favourite book.", "In a 1999 poll of Amazon.com customers, \"The Lord of the Rings\" was judged to be their favourite \"book of the millennium.\"", "Tolkien's fiction began to acquire respectability among academics only at the end of his life, with the publication of Paul H. Kocher's 1972 \"Master of Middle-Earth\".", "Since then, Tolkien's works have become the subject of a body of academic research, both as fantasy and as an extended exercise in invented languages.", "Serious study began to reach the broader community with Tom Shippey's 1982 \"The Road to Middle-earth\" and Verlyn Flieger's \"Splintered Light\" in 1983." ], [ "Reception of J. R. R. Tolkien", "There are two Danish Tolkien societies; Bri, the Danish Tolkien Society, and Imladris, which is a virtual community.", "\"The Hobbit\" appeared in Norwegian translation in 1972 and \"The Lord of the Rings\" followed from 1973 to 1975 (\"Tiden Norsk Forlag\").", "Both translations were harshly criticized for errors and inconsistencies and complaints resulted in a new translation of \"LotR\", published in 1980/81.", "By the late 1980s, Tolkien's works were well known to the Norwegian public.", "A translation of the \"Silmarillion\" appeared in 1994.", "The unsatisfactory \"Hobbit\" translation was replaced only in 1997.", "By the mid-1990s, the popularity of Tolkien had risen to a level that made viable translations of his minor works.", "Arthedain - The Tolkien Society of Norway was founded in 1981.", "The Finnish Tolkien Society Kontu (\"Suomen Tolkien-seura Kontu ry\" in Finnish) is a registered society based in Finland.", "The society was earlier two different Societys that unify in beginning of year 2012.", "The Finnish Tolkien Society (Suomen Tolkien seura) was founded on January 3, 1992 and Kontu Internet Community (Verkkoyhteis\u00f6 Kontu ry) was founded on December 19, 2006." ], [ "The Lord of the Rings", "The Lord of the Rings\n\nThe Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien.", "The story began as a sequel to Tolkien's 1937 fantasy novel \"The Hobbit\", but eventually developed into a much larger work.", "Written in stages between 1937 and 1949, \"The Lord of the Rings\" is one of the best-selling novels ever written, with over 150 million copies sold.", "The title of the novel refers to the story's main antagonist, the Dark Lord Sauron, who had in an earlier age created the One Ring to rule the other Rings of Power as the ultimate weapon in his campaign to conquer and rule all of Middle-earth." ], [ "Three-volume novel", "Two of John Cowper Powys's novels, \"Wolf Solent\" (1929) and \"Owen Glendower\" (1940) were published, in a two volume edition, by Simon & Schuster in the USA.", "The \"Lord of the Rings\" is a three-volume novel, rather than a trilogy, as Tolkien originally intended the work to be the first of a two-work set, the other to be \"The Silmarillion\", but this idea was dismissed by his publisher.", "For economic reasons \"The Lord of the Rings\" was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955.", "The three volumes were entitled \"The Fellowship of the Ring\", \"The Two Towers\", and \"The Return of the King\".", "Japanese novelist Haruki Murakami has written several books in this format, such as \"The Wind-Up Bird Chronicle\" and \"1Q84\".", "However, many translations of the novel, such as into English, combine the three volumes of these novels into a single book." ], [ "The Lord of the Rings", "\"The Lord of the Rings\" has since been reprinted numerous times and translated into 38 languages.", "Tolkien's work has been the subject of extensive analysis of its themes and origins.", "Although a major work in itself, the story was only the last movement of a larger epic Tolkien had worked on since 1917, in a process he described as \"mythopoeia\".", "Influences on this earlier work, and on the story of \"The Lord of the Rings\", include philology, mythology, religion and the author's distaste for the effects of industrialization, as well as earlier fantasy works and Tolkien's experiences in World War I. \"The Lord of the Rings\" in its turn is considered to have had a great effect on modern fantasy; the impact of Tolkien's works is such that the use of the words \"Tolkienian\" and \"Tolkienesque\" have been recorded in the \"Oxford English Dictionary\".", "The enduring popularity of \"The Lord of the Rings\" has led to numerous references in popular culture, the founding of many societies by fans of Tolkien's works, and the publication of many books about Tolkien and his works.", "\"The Lord of the Rings\" has inspired, and continues to inspire, artwork, music, films and television, video games, board games, and subsequent literature." ] ], "gold": "The Lord of the Rings is an epic high-fantasy novel by J.R.R. Tolkien that was printed into three books for economic reasons due to its voluminous length. It became extremely popular in the 1960s and has been reprinted many times and translated into several languages. By the mid-1990s Tolkien's fiction had become so popular in Norway that even his minor works were able to be profitably translated into Norwegian.", "prediction 1": "The Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien. Written in stages between 1937 and 1949, \"The Lord of the Rings\" is one of the best-selling novels ever written, with over 150 million copies sold. The publication of the Ace Books and Ballantine paperbacks helped \"The Lord of the Rings\" become immensely popular in the 1960s. The book has remained so ever since, ranking as one of the most popular works of fiction of the twentieth century, judged by both sales and reader surveys.\n", "prediction 2": "The Lord of the Rings is an epic fantasy novel by English author and scholar J. R. R. Tolkien which began as a sequel to his 1937 fantasy novel The Hobbit, but eventually developed into a much larger work. It became popular in the 1960s over the course of two decades, when its first paperback edition was released by Ace Books.", "prediction 3": "The Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien. Written in stages between 1937 and 1949, The Lord of the Rings is one of the best-selling novels ever written, with over 150 million copies sold. The publication of the Ace Books and Ballantine paperbacks helped \"The Lord of the Rings\" become immensely popular in the 1960s. The book has remained so ever since, ranking as one of the most popular works of fiction of the twentieth century, judged by both sales and reader surveys.", "prediction 4": "The Lord of the Rings is an epic high fantasy novel written by J. R. R. Tolkien and published by Oxford University Press. The novel first became popular in the 1960s through the publication of the Ace Books and Ballantine paperbacks. It has remained so ever since, ranking as one of the most popular works of fiction of the twentieth century, judged by both sales and reader surveys. In the 2003 Big Read survey conducted by the BBC, \"The Lord of the Rings\" was found to be the \"Nation's best-loved book.\" In a 1999 poll, both Germany and Australia and the Lord of the Rings was judged to be their favourite \"Book of the millen. \"The Lord of the Rings\" was judged to be their favourite \"Book of the Rings\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 89 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 321 }, { "error type": "Redundant", "explanation": "The Lord of the Rings ", "start": 322, "end": 345 }, { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 541 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Lord of the Rings is an epic high fantasy novel, written by J. R. R. Tolkien. It became immensely popular in the 1960s. The book, that for economic reasons was published in three volumes, has remained so ever since, and has been reprinted numerous times and translated into several languages. Tolkien's works were well known to the Norwegian public that by the mid-1990s, the popularity had risen to a level that made viable translations of his minor works.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who holds the record for most triple doubles in the nba?", "passages": [ [ "Double (basketball)", "Double (basketball)\n\nIn basketball, a double is the accumulation of a double-digit number total in one of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game.", "Multiple players usually score double-digit points in any given basketball game; the double nomenclature is usually reserved for when a player has double-digit totals in more than one category.", "A double-double is the accumulation of a double-digit number total in two of the statistical five categories in a game.", "The most common double-double combination is points-rebounds, followed by points-assists.", "Since the season, Tim Duncan leads the National Basketball Association (NBA) in the points-rebounds combination with 840, and John Stockton leads the points-assists combination with 714.", "A triple-double is the accumulation of a double-digit number total in three of the five categories in a game.", "The most common way to achieve a triple-double is through points, rebounds, and assists.", "Oscar Robertson leads the all-time NBA list with 181 career triple-doubles and is, with Russell Westbrook, one of only two players ever to average a triple-double for a season.", "Westbrook currently holds the record for most triple-doubles in a season with 42 and is the only person to average a triple-double for two consecutive seasons." ], [ "Double (basketball)", "Some sources claim that it was coined by former Los Angeles Lakers public relations director Bruce Jolesch in the 1980s in order to showcase Magic Johnson's versatility, while others claim that it was coined by then Philadelphia 76ers media relations director Harvey Pollack in 1980.", "The triple-double became an officially recorded statistic during the .", "There has been occasional controversy surrounding triple-doubles made when a player achieves the feat with a late rebound.", "Players with nine rebounds in a game have sometimes been accused of deliberately missing a shot late in the game in order to recover the rebound; a few have even gone so far as shooting off their opponent's basket trying to score a triple-double.", "To deter this, NBA rules allow rebounds to be nullified if the shot is determined not to be a legitimate scoring attempt.", "From the to the , the NBA averaged 34.5 triple-doubles per season, roughly 1 in every 36 games.", "From the to the , the NBA saw a dramatic increase in the number of triple-doubles, with an average of 57.33 triple-doubles per season, roughly 1 in every 22 games.", "Russell Westbrook was responsible for 74 of the triple-doubles during that span, or 21.5% of the 344 total triple-doubles." ] ], "gold": "A triple-double is a single-game performance by a player who accumulates a double-digit number total in three of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game. Currently, Oscar Robertson leads the all-time NBA list for career triple-doubles with 181 and is, along with Russell Westbrook, one of only two players ever to average a triple-double for a season. Magic Johnson holds the record for most triple-doubles in the NBA for postseason.", "prediction 1": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game. A double-double is the accumulation of a double-digit number total in two of the statistical five categories in a game. Tim Duncan leads the National Basketball Association (NBA) in the points-rebounds combination with 840, and John Stockton leads the points-assists combination with 714. A triple-double is the accumulation of a double-digit number total in three of the five categories in a game. Russell Westbrook currently holds the record for most triple-doubles in a season with 42 and is the only person to average a triple-double for two consecutive seasons.", "prediction 2": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories in a game. A triple-double is the accumulation of a double-digit number total in two of the statistical five categories in a game. Tim Duncan currently leads the National Basketball Association in the points-rebounds combination with 840, and John Stockton currently leads the points-assists combination with 714. Russell Westbrook currently holds the record for most triple-doubles in a season with 42, and is the only person to average a triple-double for two consecutive seasons. Westbrook currently holds the record for most triple-doubles in a season with 37, and is the only person to average a triple-double for two consecutive seasons.", "prediction 3": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories in a game. The record for most triple doubles in a season in the NBA is held by Russell Westbrook.", "prediction 4": "In basketball, a double is the accumulation of a double-digit number total in one of five statistical categories\u2014points, rebounds, assists, steals, and blocked shots\u2014in a game. Tim Duncan leads the National Basketball Association in the points-rebounds combination with 840, and John Stockton leads the points-assists combination with 714. Russell Westbrook currently holds the record for most triple-doubles in a season with 42 and is the only person to average a triple-double for two consecutive seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 296 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 465 }, { "error type": "Irrelevant", "explanation": "", "start": 669, "end": 743 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "A triple-double is the accumulation of a double-digit number total in three of the five categories in a game. Oscar Robertson leads the all-time NBA list with 181 career triple-doubles and is one of only two players ever to average a triple-double for a season along with Russell Westbrook who currently holds the record for most triple-doubles in a season with 42 and ." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "When did they start putting security strips in money?", "passages": [ [ "Security printing", "Security printing\n\nSecurity printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards.", "The main goal of security printing is to prevent forgery, tampering, or counterfeiting.", "More recently many of the techniques used to protect these high-value documents have become more available to commercial printers whether they are using the more traditional offset and flexographic presses or the newer digital platforms.", "Businesses are protecting their lesser-value documents such as transcripts, coupons and prescription pads by incorporating some of the features listed below to ensure that they cannot be forged or that alteration of the data cannot occur undetected.", "A number of technical methods are used in the security printing industry.", "Most banknotes are made of heavy paper, almost always from cotton fibres for strength and durability, in some cases linen or speciality coloured or forensic fibres are added to give the paper added individuality and protect against counterfeiting." ], [ "Security printing", "A hologram may be embedded either via hot-stamping foil, wherein an extremely thin layer of only a few micrometers of depth is bonded into the paper or a plastic substrate by means of a hot-melt adhesive (called a size coat) and heat from a metal die, or it may be directly embossed as holographic paper, or onto the laminate of a card itself.", "When incorporated with a custom design pattern or logo, hologram hot stamping foils become security foils that protect credit cards, passports, bank notes and value documents from counterfeiting.", "Holograms help in curtailing forging, and duplication of products hence are very essential for security purposes.", "Once stamped on a product, they cannot be removed or forged, enhancing the product at the same time.", "Also from a security perspective, if stamped, a hologram is a superior security device as it is virtually impossible to remove from its substrate.", "Metal threads and foils, from simple iridescent features to foil color copying to foils with additional optically variable effects are often used.", "There are two kinds of security threads.", "One is a thin aluminum coated and partly de-metalized polyester film thread with microprinting which is embedded in the security paper as banknote or passport paper." ], [ "History of United Airlines", "The flight made a very short-lived record for fastest flight around the globe; within a month, a Gulfstream\u00a0IV business jet had broken Friendship One's record.", "The decline of Pan American World Airways offered opportunities; in 1991 United purchased Pan Am's routes to London Heathrow Airport.", "In direct negotiations with the UK government United also obtained rights to fly to Heathrow from Chicago.", "However, the aftermath of the Gulf War and competition from low-cost carriers led to losses of US$332 million in 1991 and US$957 million in 1992.", "In 1992 United purchased now-defunct Pan Am's Latin American and Caribbean routes and Miami gates, but United allowed months to elapse between Pan Am's demise and its launch of service.", "In 1994 United's pilots, machinists, bag handlers and non-contract employees agreed to acquire 55% of company stock in exchange for 15% to 25% salary concessions.", "The flight attendants voted to not participate in the deal, and at the beginning some wore buttons saying \"we just work here.\"", "The Employee Stock Ownership Plan (ESOP) made United the largest employee-owned corporation in the world.", "United used the opportunity to create a low-cost subsidiary, Shuttle by United, in an attempt to compete with low-cost carriers." ] ], "gold": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Metal threads and foils, from simple iridescent features to foil color copying to foils with additional optically variable effects are often used. In 1990, the US started putting security strips in $100 bills and added them to $50 bills in November 1991. In 1992 a security strip was added to the $20 bill as well as the $10 bill, the latter being added in July 1992. In November 1994, a security strip was added to $5 bills. In October 2013, a 3D security ribbon was added to $100 bills.", "prediction 1": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Security threads are thin aluminum coated and partly de-metalized polyester film thread with microprinting which is embedded in the security paper as banknote or passport paper. The company United Airlines started putting security strips in money in the year 2000. In 2009, the company started putting security threads in banknotes and in the security paper as banknotes. In 2011, they started integrating some of the features listed below to ensure that they cannot be forged or that alteration of the data cannot occur undetected.", "prediction 2": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Security threads are aluminum coated and partly de-metalized polyester film threads with microprinting that are embedded in the security paper as banknote or passport paper.", "prediction 3": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Security threads are thin aluminum coated and partly de-metalized polyester film thread with microprinting which is embedded in the security paper as banknote or passport paper.", "prediction 4": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards. Businesses are protecting their lesser-value documents such as transcripts, coupons and prescription pads by incorporating some of the features listed below to ensure that they cannot be forged or that alteration of the data cannot occur undetected. Holograms help in curtailing forging, and duplication of products hence are very essential for security purposes. Once stamped on a product, they cannot be removed or forged, enhancing the product at the same time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 516 }, { "error type": "Unverifiable", "explanation": "", "start": 517, "end": 603 }, { "error type": "Redundant", "explanation": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes, cheques, passports, tamper-evident labels, security tapes, product authentication, stock certificates, postage stamps and identity cards. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Security threads are thin aluminum coated and partly de-metalized polyester film thread with microprinting which is embedded in the security paper as banknote or passport paper. The company United Airlines started putting security strips in money in the year 2000. ", "start": 604, "end": 710 }, { "error type": "Unverifiable", "explanation": "", "start": 711, "end": 871 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Security printing is the field of the printing industry that deals with the printing of items such as banknotes. The main goal of security printing is to prevent forgery, tampering, or counterfeiting. Metal threads and foils, from simple iridescent features to foil color copying to foils with additional optically variable effects are often used." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When was the night begins to shine created?", "passages": [ [ "Frank Enea", "Frank Enea\n\nFrank Enea is an American musician and songwriter known as a member of the fictional band B.E.R. from the \"Teen Titans Go!\"", "TV Series.", "He is known for writing The Night Begins to Shine which peaked at #23 on the \"Billboard\" Hot Rock songs chart.", "He is also the founding member of Frank Enea and the Crooked Hearts and The Northeast.", "The Night Begins to Shine was originally written and produced in 2005 as an \"'80s-style song\" for a music library.", "The song was first featured in the \"Teen Titans Go!\"", "episode, \"Slumber Party\" as a throwaway joke.", "The song became popular with fans of the show.", "The song was subsequently featured in the episode, \"40%, 40%, 20%\", and was predominately featured in the four-part special, \"The Day the Night Stopped Beginning to Shine and\nBecame Dark", "Even Though It Was the Day\".", "The special also featured three covers of the song from Fall Out Boy, CeeLo Green, and Puffy Amiyumi." ] ], "gold": "The song, The Night Begins to Shine, is performed by the band B.E.R. and was originally written and produced in 2005. It was first featured in an episode of the Teen Titans Go! television series, and was released on October 30, 2015.", "prediction 1": "The Night Begins to Shine was originally written and produced in 2005 as an \"'80s-style song\" for a music library. The song was first featured in the \"Teen Titans Go!\" episode, \"Slumber Party\" as a throwaway joke. The song became popular with fans of the show. It was also predominately featured in the four-part special, \"The Day the Night Stopped Beginning to Shine and Became Dark Even Though It Was the Day\".", "prediction 2": "The Night Begins to Shine was originally written and produced in 2005 as an \"'80s-style song\" for a music library. The song was first featured in the \"Teen Titans Go!\" episode, \"Slumber Party\" as a throwaway joke. It became popular with fans of the show. The song was predominately featured in the four-part special, \"The Day the Night Stopped Beginning to Shine and Became Dark Even Though It Was the Day\".", "prediction 3": "The Night Begins to Shine was originally written and produced in 2005 as an \"'80s-style song\" for a music library. The song was first featured in the Teen Titans Go! episode, \"Slumber Party\" as a throwaway joke. The song became popular with fans of the show. The song was subsequently featured in the four-part special, The Day the Night Stopped Beginning to Shine and Became Dark Even Though It Was the Day.", "prediction 4": "The Night Begins to Shine was originally written and produced in 2005 as an \"'80s-style song\" for a music library. The song was first featured in the \"Teen Titans Go!\" episode, \"Slumber Party\" as a throwaway joke. The song became popular with fans of the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 193, "end": 213 }, { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 260 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 412 } ], "missing-info": [], "corrected-prediction": "The Night Begins to Shine was originally written and produced in 2005. The song was first featured in the \"Teen Titans Go!\" episode, \"Slumber Party\". " }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "Presently who is the chief minister of rajasthan?", "passages": [ [ "Scindia", "George Jivajirao served as the state's rajpramukh, or appointed governor, from 28 May 1948 to 31 October 1956, when Madhya Bharat was merged into Madhya Pradesh.", "In 1962, Rajmata Vijayraje Scindia, the widow of Maharaja Jiwajirao, was elected to the Lok Sabha, beginning the family's career in electoral politics.", "She was first a member of the Congress Party, and later became an influential member of the Bharatiya Janata Party.", "Her son Madhavrao Scindia was elected to the Lok Sabha in 1971 representing the Congress Party, and served until his death in 2001.", "His son, Jyotiraditya Scindia, also in the Congress Party, was elected to the seat formerly held by his father in 2004.", "Vijayaraje's daughters have supported the Bharatiya Janata Party.", "Vasundhara Raje Scindia contested and won five parliamentary elections from Madhya Pradesh and Rajasthan.", "Under the Vajpayee government from 1998 onwards, Vasundhara was in charge of several different ministries.", "In 2003 she led the Bharatiya Janata Party to its largest majority in Rajasthan, and became the state's Chief Minister.", "In 2013 again, she led Bharatiya Janata Party to a thumpin win in the state of Rajasthan, winning over 160 out of the 200 seats in the assembly elections." ], [ "Government of Rajasthan", "Government of Rajasthan\n\nThe Government of Rajasthan also known as the State Government of Rajasthan, or locally as State Government, is the supreme governing authority of the Indian state of Rajasthan and its 33 districts.", "It consists of an executive, led by the Governor of Rajasthan, a judiciary and a legislative.", "Jaipur is the capital of Rajasthan, and houses the Vidhan Sabha (Legislative Assembly) and the secretariat.", "1042-2lje-20242\n\nLike other states in India, the head of state of Rajasthan is the Governor, appointed by the President of India on the advice of the Central government.", "His or her post is largely ceremonial.", "The Chief Minister is the head of government and is vested with most of the executive powers.", "The present Legislature of Rajasthan is unicameral, consisting of Legislative Assembly, which consists of 200 M.L.A..", "The assembly sits for terms of a maximum of 5 years.", "The Rajasthan High Court is having its principal seat in Jodhpur, and a bench at Jaipur which have respective jurisdiction over the neighboring districts of Rajasthan.", "Local governments consists of Panchayati Raj Institutions(PRIs) for rural areas and Municipalities or Urban Local Bodies(ULBs) for urban areas.", "Here is the web directory of Rajasthan" ], [ "Ashok Gehlot", "Ashok Gehlot\n\nAshok Gehlot (born 3 May 1951) is an Indian politician, currently serving his third term as Chief Minister of Rajasthan since December 2018.", "He is Congress Party's national general secretary and in-charge of organizations and training.", "He is incubating this position from December 1998 to 2003 and from 2008 to 2013 and again from 17 December 2018.", "He hails from Jodhpur, Rajasthan.", "He represents Sardarpura constituency of Jodhpur as Member of Legislative Assembly of Rajasthan.", "Ashok Gehlot, son of Babu Laxman jadugar Singh Gehlot, was born on 3 May 1951 in Jodhpur, Rajasthan.", "A science and law graduate, he also holds an MA degree in economics.", "He is married to Sunita Gehlot and has a son and a daughter.", "He is a Hindu and a member of the Indian National Congress (INC) party.", "He was influenced by the teachings of Mahatma Gandhi at a very young age and was actively engaged in social political work even as a student.", "During 1971's East Bengali refugees crisis he served in the refugee camps in the eastern states of India.", "It is there when former prime minister Indira Gandhi first identified his organizational skills during one of her visits to the refugee camps." ] ], "gold": "The Chief Minister of Rajasthan is the chief executive of the Indian state of Rajasthan. From 12 December 2008 through 13 December 2013, Ashok Gehlot was the Chief Minister of Rajasthan. From 13 December 2013 through 16 December 2018, Vasundhara Raje Scindia was the Chief Minister of Rajasthan. After securing majority in 2018 assembly election, Ashok Gehlot of the Indian National Congress assumed office on 17 December 2018.", "prediction 1": "The head of state of Rajasthan is the Governor, appointed by the President of India on the advice of the Central government. In the present state, Ashok Gehlot is the Chief Minister of Rajasthan. Ashok Gehlot is an Indian politician, currently serving his third term as Chief Minister of Rajasthan since December 2018. Vijayraje Scindia has been the Chief Minister of Rajasthan since 2003.", "prediction 2": "The head of state of Rajasthan is the Governor, appointed by the President of India on the advice of the Central government. The current head of state is Ashok Gehlot, who serves his third term as chief minister of Rajasthan.", "prediction 3": "The head of state of Rajasthan is the governor, appointed by the President of India on the advice of the Central government. The current chief minister of Rajasthan is Ashok Gehlot, who has served in this position since December 2018.", "prediction 4": "There are several Chief Ministers of Rajasthan. In the state of Rajasthan, Vijayraje Scindia, the widow of Maharaja Jiwajirao, was the chief minister from 1962 to 1971. In 2003, she led the Bharatiya Janata Party to its largest majority in Rajasthan, and became the state's Chief Minister. In 2013, she led the Bharatiya Janata Party to a thumpin win in the state of Rajasthan, winning over 160 out of the 200 seats in the assembly elections. In 2013, she took over and a Congress Party. ruled the state from 2013 to 2018 and Ashok Gehlot, currently serves his third term as Chief Minister of Rajasthan since December 2018.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The head of state of Rajasthan is the Governor, appointed by the President of India on the advice of the Central government. In the present state, Ashok Gehlot is the Chief Minister of Rajasthan. ", "start": 196, "end": 318 }, { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 124 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6,7,8,9]}", "start": 319, "end": 389 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The head of state of Rajasthan is the Governor. Ashok Gehlot is an Indian politician, currently serving his third term as Chief Minister of Rajasthan since December 2018. Vasundhara Raje Scindia was elected the Chief Minister of Rajasthan in 2003. George Jivajirao served as the state's appointed governor, from 28 May 1948 to 31 October 1956" }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "When did sex and the city start and finish?", "passages": [ [ "Sex and the City", "Sex and the City\n\nSex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO.", "Broadcast from 1998 until 2004, the original run of the show had a total of 94 episodes.", "Throughout its six-year run, the show received contributions from various producers, writers, and directors, principally Michael Patrick King.", "Set and filmed in New York City and based on Candace Bushnell's 1997 book of the same name, the show follows the lives of a group of four women\u2014three in their mid-thirties and one in her forties\u2014who, despite their different natures and ever-changing sex lives, remain inseparable and confide in each other.", "Starring Sarah Jessica Parker (as Carrie Bradshaw), Kim Cattrall (as Samantha Jones), Kristin Davis (as Charlotte York), and Cynthia Nixon (as Miranda Hobbes), the quirky series had multiple continuing storylines that tackled relevant and modern social issues such as sexuality, safe sex, promiscuity, and femininity, while exploring the difference between friendships and romantic relationships.", "The deliberate omission of the better part of the early lives of the four women was the writers' way of exploring social life\u2014from sex to relationships\u2014through each of their four very different, individual perspectives." ] ], "gold": "Sex and the City is an American romantic comedy-drama television series created by Darren Star for HBO. It is an adaptation of Candace Bushnell's 1997 book of the same name. The TV series aired from June 6, 1998 - February 22, 2004. If the Sex and the City movies are included, then the franchise aired between June 6, 1998 - May 27, 2010.", "prediction 1": "Sex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO. Broadcast from 1998 until 2004, the original run of the show had a total of 94 episodes. Throughout its six-year run, the show received contributions from various producers, writers, and directors, principally Michael Patrick King.", "prediction 2": "Sex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO. The show started and ended airing in 1998 and 1998-2001, respectively.", "prediction 3": "Sex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO. Its production started in 1998 and ended in 2004.", "prediction 4": "Sex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO. Broadcast from 1998 until 2004, the original run of the show had a total of 94 episodes and was based on Candace Bushnell's 1997 book of the same name. The show follows the lives of a group of four women\u2014three in their mid-thirties and one in her forties\u2014who, despite their different natures and ever-changing sex lives, remain inseparable and confide inseach each other.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 205, "end": 347 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 204 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Sex and the City is an American romantic comedy-drama television series created by Darren Star and produced by HBO. It is an adaptation of Candace Bushnell's 1997 book of the same name. Broadcast from 1998 until 2004." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the war of spanish succession end?", "passages": [ [ "War of the Spanish Succession", "Some historians view this as a key point in the evolution of the modern nation state, while legal historian", "[[Randall Lesaffer]] also argues that it marks a significant milestone in the concept of collective security.", "Britain is usually seen as the main beneficiary, Utrecht marking its rise to becoming the primary European commercial power.", "It established naval superiority over its competitors, controlled the strategic Mediterranean ports of Gibraltar and Menorca, and gained commercial access to Spanish America.", "France accepted the Protestant succession, ensuring a smooth inheritance by George I in August 1714 and ended support for the Stuarts under the [[Anglo-French Alliance (1716\u20131731)|1716 Anglo-French Treaty]].", "Lastly, the war left all the participants with unprecedented levels of government debt but only Britain successfully financed it.", "Philip was confirmed as King of Spain, which retained its independence and the majority of its Empire but ceded the Spanish Netherlands and most of their Italian possessions.", "The 1707 \"Nueva Planta\" decrees transferred powers to Madrid and largely abolished regional political structures.", "These reforms enabled Spain to recover remarkably quickly and only British naval power prevented them regaining Naples and Sicily in 1718.", "Despite its failure in Spain, Austria secured its position in Italy and Hungary and acquired the bulk of the Spanish Netherlands." ], [ "War of the Spanish Succession", "The [[Treaty of Rastatt]] on 7 March 1714 confirmed Austrian gains in Italy, returned Breisach, [[Kehl]] and Freiburg, ended French support for the Hungarian revolt and agreed terms for the Dutch Barrier fortresses.", "Charles abandoned his claim to Strasbourg and Alsace and agreed to the restoration of the Wittelsbach Electors of Bavaria and Cologne, Max Emmanuel and Joseph Clemens.", "Article XIX of the treaty transferred sovereignty over the Spanish Netherlands to Austria.", "On 7 September, the Holy Roman Empire joined the agreement by the [[Treaty of Baden (1714)|Treaty of Baden]]; although Catalonia and Majorca were not finally subdued by the Bourbons until June 1715, the war was over.", "[[File:The Battle of Cape Passaro.jpg|thumb|right|upright=1.15|The Royal Navy destroys a Spanish fleet off Sicily, Cape Passaro, August 1718.]] The Peace of Utrecht stipulated that \"because of the great danger which threatened the liberty and safety of all Europe, from the too close conjunction of the kingdoms of Spain and France, [...] one and the same person should never become King of both kingdoms.\"" ], [ "War of the Spanish Succession", "War of the Spanish Succession\n\nThe War of the Spanish Succession (1701\u20131714) was a European conflict of the early 18th century, triggered by the death of the childless Charles II of Spain in November 1700.", "His closest heirs were members of the Austrian Habsburg and French Bourbon families; acquisition of an undivided Spanish Empire by either threatened the European balance of power.", "Charles left an undivided [[Monarchy of Spain to [[Louis XIV]]'s grandson", "[[Philip V of Spain|Philip]], who was proclaimed King of Spain on 16 November 1700.", "Disputes over separation of the Spanish and French crowns and commercial rights led to war in 1701 between the Bourbons of France and Spain and the [[Grand Alliance (League of Augsburg)|Grand Alliance]], whose candidate was [[Charles VI, Holy Roman Emperor|Archduke", "Charles]], younger son of Emperor", "[[Leopold I, Holy Roman Emperor|Leopold]].", "By the end of 1706, Allied victories in Italy and the [[Low Countries]] forced the French back within their borders but they were unable to make a decisive breakthrough.", "Control of the sea allowed the Allies to conduct successful offensives in Spain, but lack of popular support for Archduke Charles meant they could not hold territory outside the coastal areas." ] ], "gold": "The War of the Spanish Succession (1701\u20131714) was an early-18th-century European war, triggered by the death in November 1700 of the childless Charles II of Spain. It established the principle that dynastic rights were secondary to maintaining the balance of power between different countries. When Emperor Joseph I died in 1711, Archduke Charles succeeded his brother as emperor, and the new British government initiated peace talks. Since only British subsidies kept their allies in the war, this resulted in the 1713 Treaty of Utrecht, followed by the August 1714 Treaties of Rastatt and Baden. On 7 September 1714, the Holy Roman Empire joined the agreement by the Treaty of Baden. Although Catalonia and Majorca were not finally subdued by the Bourbons until June 1715, the war was over.", "prediction 1": "The War of the Spanish Succession ended on 7 September 1714. Catalonia and Majorca were not finally subdued by the Bourbons until June 1715, the war was over.", "prediction 2": "The War of the Spanish Succession was a European conflict of the early 18th century, triggered by the death of the childless Charles II of Spain in November 1700. France accepted the Protestant succession, ensuring a smooth inheritance by George I in August 1714 and ended support for the Stuarts under the '1716 Anglo-French Treaty. The Treaty of Rastatt on 7 March 1714 confirmed Austrian gains in Italy, returned Breisach, Kehl and Freiburg, ended French support for the Hungarian revolt and acquired the bulk of the Spanish Netherlands. On 7 September, the Holy Roman Empire joined the agreement by the ''s's's agreement by the's ''s ''s's's ''s's's a Treaty of Baden. Although Catalonia and Majorca were not finally subdu", "prediction 3": "The War of the Spanish Succession, a European conflict of the early 18th century, triggered by the death of the childless Charles II of Spain in November 1700. Disputes over separation of the Spanish and French crowns and commercial rights led to war in 1701 between the Bourbons of France and Spain. By the end of 1706, Allied victories in Italy and the Low Countries forced the French back within their borders but they were unable to make a decisive breakthrough. By the end of 1714, the war was over. The War of the Spanish Succession ended on 7 September, on 7 September, the Holy Roman Empire joined the agreement by the Treaty of Baden. Although Catalonia and Majorca were not finally subduke by the Bourbons until June 1715, the war was over.", "prediction 4": "The War of the Spanish Succession was a European conflict of the early 18th century, triggered by the death of the childless Charles II of Spain in November 1700. War of the Spanish Succession ended on 7 September 1714 with the Treaty of Rastatt.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The War of the Spanish Succession (1701\u20131714) was an early-18th-century European war, triggered by the death in November 1700 of the childless Charles II of Spain. The War of the Spanish Succession ended on 7 September 1714 when the Holy Roman Empire joined the agreement by the Treaty of Baden. Catalonia and Majorca were not finally subdued by the Bourbons until June 1715, the war was over." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "What year does outlander season 3 take place?", "passages": [ [ "Outlander (TV series)", "Some interiors were filmed on the show's Scotland soundstages, while Prague was used for the exterior street scenes and the Palace of Versailles.", "In addition some palaces in the south of England which have French rooms and architecture were used as Parisian interiors and part of Versailles.", "Moore noted that season two of \"Outlander\" \"will look completely different than season one\" with a \"richer, more dynamic kind of visual palette\".", "With the change of setting from Scotland to France, he said that \"visually you\u2019ve moved from the heavy woods and stone of season 1 into the finery of the Parisian apartments\".", "He explained:\nProduction on the third season began in September 2016 in Scotland, and filming took place in Cape Town from March to June 2017.", "Filming completed on June 16, 2017.", "In August 2017, Moore said that for season four, locations in Scotland would double as 18th century America, and some of the mountains and rivers of North Carolina would be recreated using locations in Eastern Europe.", "Production for season four was completed in Scotland by July 5, 2018.", "The music is composed by Bear McCreary.", "The title song is an adaptation of Robert Louis Stevenson's poem \"Sing me a Song of a Lad that is Gone\", set to the tune of the Scottish folk song \"The Skye Boat Song\"." ], [ "Jamie Fraser (character)", "Jamie Fraser (character)\n\nJames \"Jamie\" Fraser is a fictional character in the \"Outlander\" series of multi-genre novels by American author Diana Gabaldon, and its television adaptation.", "In the series, married World War II nurse Claire Randall is visiting Scotland when she finds herself transported from 1945 back to 1743.", "There she finds adventure, war and romance with the dashing Highland warrior Jamie Fraser.", "Jamie also appears in two novels in the \"Lord John\" series of historical mysteries, and in the 2013 novella \"Virgins\".", "Jamie is portrayed by Sam Heughan in the Starz television series \"Outlander\".", "He was nominated for a Saturn Award for Best Supporting Actor on Television in 2015, and Best Actor on Television in 2016.", "Heughan was also nominated for a People's Choice Award for Favorite Sci-Fi/Fantasy TV Actor in 2016 and 2017, a 2016 BAFTA Scotland Award for Best Actor in Television, and a 2016 Critics' Choice Television Award for Best Actor in a Drama Series.", "Jamie Fraser was inspired by the character Jamie McCrimmon from the television series \"Doctor Who\", portrayed by actor Frazer Hines.", "\"Outlander\" author, Diana Gabaldon, had seen the \"Doctor Who\" serial \"The War Games\" which inspired her to write the first novel in the \"Outlander\" series." ], [ "Lord John Grey (character)", "Lord John Grey (character)\n\nLord John William Grey is a fictional character created by Diana Gabaldon.", "He is a recurring secondary character in Gabaldon's \"Outlander\" series of novels, and the main character of the \"Lord John\" series of historical mystery novels and novellas.", "Secretly homosexual \"in a time when that particular predilection could get one hanged\", the character has been called \"one of the most complex and interesting\" of the hundreds of characters in Gabaldon's \"Outlander\" novels.", "Grey first appears in the second \"Outlander\" novel \"Dragonfly in Amber\" (1992) as a sixteen-year-old English soldier who chances upon Jamie and Claire Fraser on the eve of the Battle of Prestonpans.", "Recognizing Jamie as a wanted rebel and presuming Claire to be his prisoner, Grey attempts to save her.", "Using the threat of harm to Claire, Jamie tricks Grey into revealing information about the nearby British forces, and spares the boy's life.", "In \"Voyager\" (1994), a mortally injured Jamie is saved from execution as a traitor after the Battle of Culloden in 1746 by Harold Grey, Earl of Melton, as repayment for sparing the younger Grey.", "Jamie is sent home to Lallybroch to die, but recovers, and goes into hiding." ] ], "gold": "Outlander is a historical drama television series based on the ongoing novel series of the same name by Diana Gabaldon. Production on the third season began in September 2016 in Scotland, and filming took place in Cape Town from March to June 2017. Filming completed on June 16, 2017. Season 3 takes place in both 1948 and 1746.", "prediction 1": "In the television series Outlander, the fictional character of Jamie Fraser, is a character in the series of multi-genre novels and its television adaptation written by American author Diana Gabaldon. In the third season, the story takes place in 1743. Production on the third season began in September 2016 in Scotland, and filming took place in Cape Town from March to June 2017. Filming concluded on June 16, 2017. In the fourth season, the story takes place in 1743.", "prediction 2": "In the series Outlander, married World War II nurse Claire Randall is transported from 1945 back to 1743, where she finds adventure, war and romance with the dashing Highland warrior Jamie Fraser. In the third season, filming took place in Cape Town from March to June 2017. In the fourth season, filming took place in Scotland by July 5, 2018.", "prediction 3": "For the Outlander television series, production began in September 2016 and filming took place in Cape Town, South Africa from March to June 2017. Filming completed on June 16, 2017.", "prediction 4": "Season 3 of Outlander is set in 1743, during the time period of the Outlander novels. Production on the third season began in September 2016 in Scotland, and filming took place in Cape Town from March to June 2017. Filming completed on June 16, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 470 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 208, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 76 } ], "missing-info": [], "corrected-prediction": "The television series Outlander is a series of multi-genre novels written by American author Diana Gabaldon. The story takes place in 1743 and 1945. Production on the third season began in September 2016 in Scotland, and filming took place in Cape Town from March to June 2017. Filming concluded on June 16, 2017. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When will keeping up with the kardashians season 14 air?", "passages": [ [ "Rob & Chyna", "Rob & Chyna\n\nRob & Chyna is an American reality television series starring Rob Kardashian and Blac Chyna.", "The seven-part one-hour series premiered on September 11, 2016, on the E! cable network.", "The reality series was greenlit on June 1, 2016.", "\"Rob & Chyna\" follows the relationship of Rob Kardashian and Blac Chyna as they prepare to welcome their first child.", "Six hour-long episodes have been ordered, excluding a television special featuring the birth of Kardashian and Chyna's newborn.", "The show premiered on September 11, 2016.", "Jeff Olde, an executive vice president of the network, explained the reasons of giving Kardashian and Chyna their own series:\n\n", "The series airs on E!, an American cable network which features mostly entertainment-related programming, and reality television series, including \"Keeping Up with the Kardashians\", another series that both Rob Kardashian and Blac Chyna have been part of.", "The show is produced by Bunim/Murray Productions and Ryan Seacrest Productions, which also produce \"Keeping Up with the Kardashians\".", "On December 14, 2016, E! renewed the series for a second season consisting of eight episodes that was expected to premiere in 2017.", "In July 2017, E!" ], [ "Shark Tank", "Season 5 premiered on September 20, 2013.", "In October 2013, ABC ordered an additional two episodes for the season.", "In December 2013, ABC ordered another four episodes, bringing the season order to 29 episodes.", "Steve Tisch and John Paul DeJoria were added as panel members.", "In 2013, CNBC licensed exclusive off-network cable rights for the series from ABC.", "In May 2014, ABC announced a sixth season starting in September 2014.", "The series began its syndication run on CNBC on December 30, 2013.", "The seventh season of the show premiered on Friday, September 25, 2015.", "Actor/investor Ashton Kutcher, music manager/CEO Troy Carter, and venture investor Chris Sacca all appeared as guest sharks.", "The ninth season of the show premiered on Sunday, October 1, 2017, with a new, modern-looking set, new chairs, more space, and guest shark Richard Branson.", "During its first season, \"Shark Tank\" saw a mostly positive reception.", "Josh Wolk of \"Entertainment Weekly\" wrote, \"The moneymen ask informed questions and make shrewd decisions, a welcome relief from Donald Trump's capricious calls on Burnett's \"Celebrity Apprentice\".\"", "Heather Havrilesky from Salon said that \"ABC's \"Shark Tank\" is easily the best new reality TV show to air this summer.\"" ] ], "gold": "Season 14 of the American reality series Keeping Up with the Kardashians aired on the E! network from October 1, 2017 to March 4, 2018.", "prediction 1": "Rob & Chyna is an American reality television series starring Rob Kardashian and Blac Chyna. The seven-part one-hour series premiered on September 11, 2016, on the E! cable network. On December 14, 2016, E! renewed the series for a second season consisting of eight episodes that was expected to premiere in 2017. In July 2017, E! | wikipage: Shark Tank: The Next Big Thing premiered on Sunday, October 1, 2017.", "prediction 2": "The series Keeping Up with the Kardashians, also known as KKWTK, is an American reality television series starring Rob Kardashian and Blac Chyna. It follows the relationship of Rob Kardashian and Blac Chyna as they prepare to welcome their first child. Season 14 of the show will air on March 25, 2019, and season 15 will air on March 24, 2019.", "prediction 3": "The series Keeping Up with the Kardashians aired season 14 on September 14, 2019, and season 15 on September 25, 2019.", "prediction 4": "In the United States, Keeping Up with the Kardashians season 14 will air on November 7, 2018, and in the United Kingdom, it will air on November 14, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 313 }, { "error type": "Incoherent", "explanation": "", "start": 331, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 411 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 330 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "Who has the most hits in major league baseball?", "passages": [ [ "3,000 hit club", "3,000 hit club\n\nIn Major League Baseball (MLB), the 3,000 hit club is the group of batters who have collected 3,000 or more regular-season hits in their careers.", "Cap Anson was the first to join the club on July 18, 1897, although his precise career hit total is unclear.", "Two players\u2014Nap Lajoie and Honus Wagner\u2014reached 3,000 hits during the 1914 season.", "Ty Cobb became the club's fourth member in 1921 and became the first player in MLB history to reach 4,000 hits in 1927; he ultimately finished his career with 4,191.", "Pete Rose became the second member of the 4,000 hit club on April 13, 1984 while playing for the Montreal Expos.", "Cobb, also the major leagues' all-time career batting average leader, remained the MLB hit leader until September 11, 1985, when Rose collected his 4,192nd hit.", "Rose, the current record holder, finished his career with 4,256 hits.", "Roberto Clemente's career ended with precisely 3,000 hits, reaching the mark in the last at bat of his career on September 30, 1972.", "In total, 32 players have reached the 3,000 hit mark in MLB history." ], [ "Albert Pujols", "He also became the first player to hit career home runs 499 and 500 in the same game.", "Nationals Park is the same ballpark where he hit his 400th career home run in the 2010 season.", "Participating in the longest game of the year in MLB, and the longest in the history of Angel Stadium, Pujols ended a 19-inning, 6:31 contest against the Red Sox with a solo home run for a 5\u20134 final score.", "It was also his first walk-off home run as an Angel and first since June 2011.", "On September 6, against the Minnesota Twins, Pujols collected his 2,500th career hit, a two-run go-ahead double off of Jared Burton in the 9th inning.", "He also passed the 1,500 run mark in the same game.", "In the process, he became the fifth player in major league history with 2,500 hits and 500 home runs while maintaining a .310 lifetime batting average (the others were Babe Ruth, Jimmie Foxx, Ted Williams, and Manny Ramirez).", "After the 2014 season, Pujols led all active players in doubles, with 561.", "After the season, Pujols traveled to Japan to join a team of MLB All-Stars playing against All-Stars of Nippon Professional Baseball in the 2014 Major League Baseball Japan All-Star Series." ] ], "gold": "Pete Rose holds the Major League record for most career hits, with 4,256. There are currently five active players with at least 2,000 career hits, led by Albert Pujols with 3,299 hits.", "prediction 1": "In Major League Baseball, the 3,000 hit club is the group of batters who have collected 3,000 or more regular-season hits in their careers. Cap Anson was the first to join the club on July 18, 1897, although his precise career hit total is unclear. Ty Cobb became the club's fourth member in 1921 and became the first player in MLB history to reach 4,000 hits in 1927; he ultimately finished his career with 4,191. Pete Rose became the second member of the 4,000 hit club on April 13, 1984 while playing for the Toronto Blue Jays. Roberto Clemente's career ended with precisely 3,000 hits, reaching the mark in the last at bat of his career on September 30, 1972. In total, 32 players have reached the 3,000 hit mark in MLB history.", "prediction 2": "The 3,000 hit club in MLB is the group of batters who have collected 3,000 or more regular-season hits in their careers. Albert Pujols has the most hits in MLB history with 5,498. On September 6, against the Minnesota Twins, Pujols collected his 2,500th career hit, a two-run go-ahead double off of Jared Burton in the 9th inning. He also passed the 1,500 run mark in the same game.", "prediction 3": "In Major League Baseball, the 3,000 hit club is the group of batters who have collected 3,000 or more regular-season hits in their careers. The player with the most hits in MLB history is Albert Pujols. The player with the most home runs is Pedro Martinez, with 499.", "prediction 4": "In Major League Baseball, the 3,000 hit club is the group of batters who have collected 3,000 or more regular-season hits in their careers. Albert Pujols has the most hits in MLB history, with 2,500, 500, and 500 home runs. Ty Cobb has the most hits in MLB and has played in the major leagues for the most seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 248 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 530 }, { "error type": "Irrelevant", "explanation": "", "start": 531, "end": 732 } ], "missing-info": [], "corrected-prediction": "In Major League Baseball, Pete Rose holds the record for most career hits, with 4,256." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who is the mother in how i met you mother?", "passages": [ [ "The Mother (How I Met Your Mother)", "The Mother (How I Met Your Mother)\n\nTracy McConnell (colloquial: \"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\".", "The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother.", "Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "The Mother is played by Cristin Milioti.", "The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment.", "Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in \"Last Forever\", the series finale.", "The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "An alternate ending was released in the ninth season DVD." ] ], "gold": "Tracy Mosby (n\u00e9e McConnell) is the title character from the CBS television sitcom How I Met Your Mother. The show, narrated by Future Ted, played by Bob Saget, tells the story of how Ted Mosby, played by Josh Radnor, met his children's mother. Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character and was first seen fully in \"Something New.\" She was promoted to a main character in season 9 and is played by Cristin Milioti.", "prediction 1": "The Mother in the CBS sitcom How I Met Your Mother is played by Cristin Milioti. The show, narrated by Future Ted and narrated by Bob Saget, tells the story of how Ted Mosby met The Mother. The Mother is played by Tracy McConnell.", "prediction 2": "In the television sitcom How I Met Your Mother, the story of how Ted Mosby (Josh Radnor) met The Mother is the framing device behind the show. Many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment. The Mother is played by Cristin Milioti.", "prediction 3": "In the CBS television sitcom How I Met Your Mother, the story of how Ted Mosby met The Mother is the framing device behind the show. In the show, the mother is played by actress Cristin Milioti.", "prediction 4": "In the CBS sitcom How I Met Your Mother, the story of how Ted Mosby (Josh Radnor) met The Mother is the framing device behind the series. The Mother is played by actress Cristin Milioti.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The show, narrated by Future Ted ", "start": 114, "end": 140 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 214, "end": 230 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Tracy McConnell is the title character from the CBS television sitcom \"How I Met Your Mother\". The Mother is played by Cristin Milioti. The show, narrated by Future Ted, tells the story of how Ted Mosby (Josh Radnor) met The Mother. She appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When was once upon a time in the west made?", "passages": [ [ "Once Upon a Time in the West", "Once Upon a Time in the West\n\nOnce Upon a Time in the West () is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone.", "It stars Henry Fonda, cast against type, as the villain, Charles Bronson as his nemesis, Claudia Cardinale as a newly widowed homesteader, and Jason Robards as a bandit.", "The screenplay was written by Sergio Donati and Leone, from a story by Dario Argento, Bernardo Bertolucci and Leone.", "The widescreen cinematography was by Tonino Delli Colli, and the acclaimed film score was by Ennio Morricone.", "After directing \"The Good, the Bad and the Ugly\", Leone decided to retire from Westerns and desired to produce his film based on \"The Hoods\", which eventually became \"Once Upon a Time in America\".", "However, Leone accepted an offer from Paramount Pictures to provide access to Henry Fonda and to use a budget to produce another Western film.", "He recruited Bertolucci and Argento to devise the plot of the film in 1966, researching other Western films in the process.", "After Clint Eastwood turned down an offer to play the movie's protagonist, Bronson was offered the role.", "During production, Leone recruited Donati to rewrite the script due to concerns over time limitations." ], [ "Once Upon a Time in the West (soundtrack)", "Once Upon a Time in the West (soundtrack)\n\nOnce Upon a Time in the West is a soundtrack composed by Ennio Morricone, from the 1968 western film of the same name directed by Sergio Leone, released in 1972.", "The film score sold about 10 million copies worldwide.", "The soundtrack features leitmotifs that relate to each of the main characters of the movie (each with their own theme music), as well as to the spirit of the American West.", "The theme music for the Claudia Cardinale character has wordless vocals by Italian singer Edda Dell'Orso.", "It was Leone's desire to have the music available and played during filming.", "Leone had Morricone compose the score before shooting started and would play the music in the background for the actors on set.", "An expanded and remastered album was released in Italy, November 2005." ] ], "gold": "Once Upon a Time in the West is a 1968 epic Spaghetti Western film directed by Sergio Leone, who co-wrote it with Sergio Donati based on a story by Dario Argento, Bernardo Bertolucci, and Leone, starring Henry Fonda, Charles Bronson, Jason Robards, and Claudia Cardinale. Once Upon a Time in the West is a soundtrack composed by Ennio Morricone, from the 1968 western film of the same name directed by Sergio Leone, released in 1972. On September 3, 2007 the album was made. ", "prediction 1": "Once Upon a Time in the West is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone. It stars Henry Fonda, cast against type, as the villain, Charles Bronson as his nemesis, Claudia Cardinale as a newly widowed homesteader, and Jason Robards as a bandit. The film was released in 1972.\n", "prediction 2": "Once Upon a Time in the West is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone. It stars Henry Fonda, cast against type, as the villain, Charles Bronson as his nemesis, Claudia Cardinale as a newly widowed homesteader, and Jason Robards as a bandit. This movie was released in 1972.", "prediction 3": "Once Upon a Time in the West is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone. It stars Henry Fonda, cast against type, as the villain, Charles Bronson as his nemesis, Claudia Cardinale as a newly widowed homesteader, and Jason Robards as a bandit. The film was released in their entirety in 1972.", "prediction 4": "One Upon a Time in the West is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone. It stars Henry Fonda as the villain and Charles Bronson as his nemesis. The score for One Upon a Time in the West was composed by Ennio Morricone and played in the background during filming.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 196 }, { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 246 }, { "error type": "Irrelevant", "explanation": "", "start": 265, "end": 277 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 303, "end": 309 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Once Upon a Time in the West is a 1968 epic Spaghetti Western film co-written and directed by Sergio Leone. The screenplay was written by Sergio Donati and Leone, from a story by Dario Argento, Bernardo Bertolucci and Leone. It stars Henry Fonda, Charles Bronson , Claudia Cardinale, and Jason Robards. Once Upon a Time in the West is a soundtrack composed by Ennio Morricone, from the 1968 western film of the same name directed by Sergio Leone, released in 1972. An expanded and remastered album was released in Italy, November 2005.\n" }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "Who presented the first top of the pops?", "passages": [ [ "Samantha Juste", "Samantha Juste\n\nSamantha Juste (born Sandra Slater; 31 May 1944 \u2013 5 February 2014) became known on British television in the mid-1960s as the \"disc girl\" on the BBC\u2019s \"Top of the Pops\".", "In 1968 she married Micky Dolenz of the Monkees.", "Their daughter is actress Ami Dolenz.", "Sandra Slater was born in Manchester, England to a dressmaker named Phyllis and studied textile and dress design at Rochdale College of Art.", "The tall, long-legged blonde soon became a teenage model and took the name Samantha Juste.", "\"Top of The Pops\" was a weekly half-hour programme of current popular music, initially conceived and produced by Johnnie Stewart (1917\u20132005).", "It was first broadcast from a converted church in Rusholme, Manchester on 1 January 1964.", "Samantha Juste was an assistant to Cecil Korer, the programme's assistant producer.", "After the first few episodes, Juste replaced Denise Sampey; for 3\u00bd years she sat alongside the host (initially disc jockeys Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray), to place records on a turntable and apply the needle as the artist was about to perform." ], [ "Jimmy Savile", "On 30 July 2006, he co-hosted the final weekly edition, ending it with the words \"It's number one, it's still \"Top of the Pops\"\", before turning off the studio lights after the closing credits.", "When interviewed by the BBC on 20 November 2008 and asked about the revival of \"Top of the Pops\" for a Christmas comeback, he said he would welcome a \"cameo role\" in the programme.", "In the early 1960s, Savile co-hosted (with Pete Murray) the televised \"New Musical Express\" Poll Winners' Concert, held annually at the Empire Pool in Wembley, with acts such as the Beatles, Cliff Richard and the Shadows, Joe Brown and the Bruvvers, the Who, and many others.", "On 31 December 1969, he hosted the BBC/ZDF co-production \"Pop Go the Sixties\", shown across Western Europe, celebrating the hits of the decade.", "Savile presented a series of Public Information Films promoting road safety, notably \"Clunk Click Every Trip\", which promoted the use of seatbelts, the clunk representing the sound of the door and the click the sound of the seatbelt fastening." ] ], "gold": "Upon its inception in 1964, the BBC music chart television program Top of the Pops was presented by a team of disc jockeys in rotation. These disc jockeys were Alan Freeman, David Jacobs, Pete Murray and Jimmy Savile. On New Year's Day 1964, Jimmy Savile presented the first edition of Top of the Pops from a television studio in a converted church in Dickenson Road, Rusholme, Manchester. Over forty years later, Saville co-hosted the final weekly edition of Top of the Pops on July 30, 2006, ending it with the words, \"It's number one, it's still Top of the Pops,\" before turning off the studio lights after the closing credits.", "prediction 1": "\"Top of the Pops\" was a weekly half-hour programme of current popular music, originally conceived and produced by Johnnie Stewart. It was first broadcast from a converted church in Rusholme, Manchester on 1 January 1964. Samantha Juste replaced Denise Sampey, for 312 years, and sat alongside the host (initially disc jockeys Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray), to place records on a turntable and apply the needle as the artist was about to perform.", "prediction 2": "Jimmy Savile presented the first Top of the Pops, a weekly half-hour programme of current popular music, originally conceived and produced by Johnnie Stewart. It was first broadcast from a converted church in Rusholme, Manchester on 1 January 1964. Samantha Juste replaced Denise Sampey, for 312 years she sat alongside the host, initially disc jockeys Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray, to place records on a turntable and apply the needle as the artist was about to perform.", "prediction 3": "On 1 January 1964, Top of The Pops was broadcast from a converted church in Rusholme, Manchester. Disc jockeys Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray presented the first Top of the Pops, while Samantha Juste was an assistant to Cecil Korer, the programme's assistant producer. After the first few episodes, Juste replaced Denise Sampey; for 312 years she sat alongside the host, initially disc jockeys Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray.", "prediction 4": "The first Top of the Pops was presented by Jimmy Savile on 1 January 1964.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 473 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 292 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Top of the Pops\" was a weekly half-hour programme of current popular music. It was first broadcast from a converted church in Rusholme, Manchester on 1 January 1964. Initial host disc jockeys were Jimmy Savile, David Jacobs, Alan Freeman and Pete Murray. On 30 July 2006, Jimmy Savile co-hosted the final weekly edition, ending it with the words \"It's number one, it's still \"Top of the Pops\"\", before turning off the studio lights after the closing credits." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who made the song i can't make you love me?", "passages": [ [ "I Can't Make You Love Me", "I Can't Make You Love Me\n\n\"I Can't Make You Love Me\" is a song written by Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album \"Luck of the Draw\" (1991).", "Released as the album's third single in 1991, \"I Can't Make You Love Me\" became one of Raitt's most successful singles, reaching the top-twenty on the \"Billboard\" Hot 100 chart and the top-ten on the Adult Contemporary.", "In August 2000, \"Mojo\" magazine voted \"I Can't Make You Love Me\" the eighth best track on its The 100 Greatest Songs of All Time list.", "The song is ranked at number 339 on the \"Rolling Stone\" magazine's list of The 500 Greatest Songs of All Time.", "On 27 November 2016, the Grammy Hall of Fame announced its induction, along with that of another 24 songs.", "\"I Can't Make You Love Me\" was written by Nashville writers Mike Reid and Allen Shamblin, who were well-noted for their successes in the country music arena.", "The song was rewritten many times before being finalized, months later.", "\"We wrote, most every week, in Mike's basement,\" Shamblin told Peter Cooper in an interview with the Nashville Tennessean." ], [ "I Can't Make You Love Me", "In New Zealand, the song was Raitt's highest charting-single, reaching number 22, while in Netherlands, the song charted moderately at number 43.", "Although Bruce Hornsby had no hand in writing the song, his piano part on it became associated with him.", "Phil Collins described it as instantly recognizable as Hornsby's work.", "Hornsby's own publicity material mentions his role on the \"classic\".", "On his own subsequent tours, Hornsby included the song in a number of his set lists.", "He sometimes let a female backing singer in his band take on the vocal.", "Other times, he sang the song himself.", "English singer George Michael covered \"I Can't Make You Love Me\" and released as a B-side of his single, \"Older\", which was released on 20 January 1997 as the fourth single from the album of the same name.", "Michael's version was also included on his compilation, \"\" (1998).", "\"Older\" and \"I Can't Make You Love Me\" both reached number 3 on the UK Singles Chart.", "After the release of his second studio album, \"Listen Without Prejudice Vol. 1\" (1990), George Michael started a legal battle with his label, Sony Music, declaring his contract was financially inequitable and creatively stifling." ], [ "I Can't Make You Love Me", "Their version was released as the album's first single on October 27, 2009.", "Having a more R&B approach, \"I Can't Make You Love Me\" received generally favorable reviews from music critics, while it has achieved minor success on the \"Billboard's\" Hot R&B/Hip-Hop Songs chart.", "After releasing their second cover album in 2007, \"\", which was well received by critics, but failed to produce a successful single, the band announced plans for a new cover album, that features cover versions of songs by \"artists I don't think people would expect us to cover,\" according to member Shawn Stockman.", "On October 23, 2009, \"I Can't Make You Love Me\" was announced as \"Love\"'s lead-single.", "The song was later released on October 27, 2009 through iTunes store.", "For the band members, \"We wanted to stay true to our roots, and it's a very beautiful song.", "And with our sound, we gave it an R&B twist.", "It's always been a favorite of ours, and we hope people will fall in love with it again.\"", "A writer for \"Soul Bounce\" wrote that \"The biggest surprise on this album is the bluesy interpretation of Bonnie Rait's country hit, 'I Can't Make You Love Me.'" ] ], "gold": "I Can't Make You Love Me is a song written by Mike Reid and Allen Shamblin that was recorded by American singer Bonnie Raitt for her eleventh studio album, Luck of the Draw. Released as the album's third single in 1991, I Can't Make You Love Me became one of Raitt's most successful singles, reaching the top 20 on the Billboard Hot 100 chart and the top 10 on the Adult Contemporary. In 1997, English singer George Michael covered I Can't Make You Love Me and released it as a B-side of his single Older. In 2009, American R&B vocal group Boyz II Men recorded I Can't Make You Love Me for their third cover album, Love. Their version was released as the album's first single on October 27, 2009. On June 14, 2011, a version of the song by Justin Vernon as Bon Iver was released as a B-side to the single Calgary. Additionally, in 2011, English singer Adele covered I Can't Make You Love Me for her first live album, Live at the Royal Albert Hall. The song was acclaimed by music critics, who praised Adele's delivery and vocals. The song charted on the UK Singles Chart, reaching the top forty. However, the song was never released as a single. In 2014, Indian actress and singer Priyanka Chopra recorded a version of I Can't Make You Love Me for her debut studio album. Chopra's version of the song incorporated electronic dance music and electropop in its production.", "prediction 1": "\"I Can't Make You Love Me\" was written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album \"Luck of the Draw\" in 1991. English singer George Michael covered the song and released it as a B-side of his single \"Older\", released on 20 January 1997 as the fourth single from the album of the same name. Having a more R&B approach, \"I Can't Make You Love Me\" received generally favorable reviews from music critics, while it has achieved minor success on the Billboard's Hot R&B's Hot R&B/Hip-Hop Songs chart.", "prediction 2": "I Can't Make You Love Me is a song written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album Luck of the Draw in 1991. English singer George Michael covered I Can't Make You Love Me and released as a B-side of his single, Older. The band Soul Bounce also released their version of I Can't Make You Love Me as the album's first single on October 27, 2009.", "prediction 3": "\"I Can't Make You Love Me\" is a song written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album Luck of the Draw in 1991. The song was later covered by the English singer George Michael and released as the album's first single on October 27, 2009. The song was also covered by the band Soul Bounce in 2009.", "prediction 4": "I Can't Make You Love Me was a song written by Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album \"Luck of the Draw\" in 1991. English singer George Michael covered I Can't Make You Love Me and released as a B-side of his single, Older, which was released on 20 January 1997 as the fourth single from the album of the same name. The band released an extended version of the song as the album's first single on October 27, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 371 }, { "error type": "Irrelevant", "explanation": "", "start": 372, "end": 577 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I Can't Make You Love Me\" was written by Nashville writers Mike Reid and Allen Shamblin and recorded by American singer Bonnie Raitt for her eleventh studio album \"Luck of the Draw\" in 1991. \"I Can't Make You Love Me\" became one of Raitt's most successful singles, reaching the top-twenty on the \"Billboard\" Hot 100 chart and the top-ten on the Adult Contemporary. English singer George Michael covered the song and released it as a B-side of his single \"Older\", released on 20 January 1997." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who plays maggie's dad on grey's anatomy?", "passages": [ [ "Grey's Anatomy", "\"Grey's Anatomy: B-Team\" stars Sophia Taylor Ali (Dahlia Qadri), Jake Borelli (Levi Schmitt), Alex Blue Davis (Casey Parker), Jaicy Elliot (Taryn Helm), Rushi Kota (Vik Roy) and Jeanine Mason (Samantha \"Sam\" Bello) with special guest appearances made by Justin Chambers (Alex Karev), Kelly McCreary (Maggie Pierce), Kevin McKidd (Owen Hunt) and James Pickens Jr. (Richard Webber).", "The six episodes in this series were written by Barbra Kaye Friend with \"Grey's Anatomy\" series regular Sarah Drew (April Kepner) making her directorial debut directing each of them.", "\"Grey's Anatomy\" episodes appear regularly on ABC in the United States.", "All episodes are approximately forty-three minutes, and are broadcast in both high-definition and standard.", "The series' episodes are also available for download at the iTunes Store in standard and high-definition qualities, and Amazon Video.", "ABC Video on demand also releases recent episodes of the show for temporary viewing.", "Recent episodes are also available at ABC's official \"Grey's Anatomy\" website, and on Hulu and Xfinity.", "In 2009, ABC signed a deal allowing \"Grey's Anatomy\" episodes to be streamed on Netflix." ], [ "Maggie Pierce", "Maggie Pierce\n\nMargaret \"Maggie\" Pierce, M.D. is a fictional character from the American television medical drama \"Grey's Anatomy\", which airs on the American Broadcasting Company (ABC) in the United States.", "The character was created by series producer Shonda Rhimes and is portrayed by actress Kelly McCreary from the tenth season's penultimate episode onwards.", "It is revealed in the season ten finale, Maggie's biological parents are Richard Webber (James Pickens Jr.) and Ellis Grey (Kate Burton), making her Meredith's half-sister.", "McCreary was upgraded to a series regular in the eleventh episode of the eleventh season.", "Pierce has been described as \"perky\" and \"chatty\", as well as focusing mostly on her academic career rather than social life.", "She graduated from medical school at 19 and becomes the head of her department at the young age of 27 years old.", "Maggie is first introduced in the penultimate episode of the tenth season.", "Cristina Yang interviews various different candidates to replace her as the head of her department in Cardiothoracic surgery.", "Maggie, having finished high school and medical school early at 19, becomes head of her department at 27 years old.", "It is revealed in the season 10 finale \"Fear (of the Unknown)\" that Maggie's biological mother was Ellis Grey." ] ], "gold": "Margaret Pierce, M.D., F.A.C.S. is a fictional character from the American television medical drama Grey's Anatomy, which airs on the American Broadcasting Company (ABC) in the United States. It is revealed in the season ten finale that Maggie's biological parents are Richard Webber, played by James Pickens, Jr., and Ellis Grey, played by Kate Burton, making her Meredith's half-sister. Her adoptive Dad was played by Richard Lee Lawson.", "prediction 1": "The character Maggie's dad on Grey's Anatomy is played by James Pickens Jr., who plays Richard Webber.", "prediction 2": "Grey's Anatomy is an American television medical drama. It is based on the American television series Grey's Anatomy and is created by series producer Shonda Rhimes. Maggie's biological parents are Richard Webber (James Pickens Jr. ), and Ellis Grey (Kate Burton).", "prediction 3": "Grey's Anatomy is an American television medical drama. Maggie Pierce's parents are Richard Webber (James Pickens Jr.), played by James McCreary, and Ellis Grey (Kate Burton). In the series, James Pickens Jr. plays Richard Webber.", "prediction 4": "There are several characters named Maggie on the American television medical drama Grey's Anatomy. In the series, the character's father is Richard Webber, played by James Pickens Jr. in the tenth season. In the B-Team, the character's father is Alex Blue Davis, played by Jake Borelli. The role of Richard Webber is played by James Pickens Jr. in the tenth season.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "It is revealed in the season ten finale, Maggie's biological parents are Richard Webber (James Pickens Jr.) and Ellis Grey (Kate Burton), making her Meredith's half-sister." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When does episode 3 of the deuce come out?", "passages": [ [ "The Deuce (TV series)", "The Deuce (TV series)\n\n", "The Deuce is an American drama television series created by David Simon and George Pelecanos.", "The series' pilot began filming in October 2015 and was commissioned in January 2016.", "It is broadcast by the premium cable network HBO in the United States and premiered on September 10, 2017.", "HBO made the pilot available through its video-on-demand services and affiliate portals on August 25, 2017.", "\"The Deuce\" features an ensemble cast that includes James Franco and Maggie Gyllenhaal.", "It tells the story of the Golden Age of Porn, the legalization and rise of the porn industry in New York City that began in the 1970s.", "Themes explored include government and police corruption, the violence of the drug epidemic and the real-estate booms and busts that coincided with the change.", "The show's title is derived from the nickname for 42nd Street between Seventh Avenue and Eighth Avenue.", "On September 19, 2017, HBO renewed the series for a second season, which premiered on September 9, 2018.", "On September 20, 2018, HBO renewed the series for a third and final season.", "Set during the 1970s in New York, the violence of the drug epidemic is worsening." ], [ "The Shadowhunter Chronicles", "There was so much from the book that we had to leave out of the \"Mortal Instruments\" film.", "In the series we'll be able to go deeper and explore this world in greater detail and depth.\"", "The producers hope to adapt the entire book series if the TV adaptation proves successful.", "In February 2015, book series author Cassandra Clare announced via Twitter that the television series would be called \"Shadowhunters\" rather than \"The Mortal Instruments\".", "In March 2015, ABC Family picked up \"Shadowhunters\" straight-to-series, and premiered on January 12, 2016.", "The series was renewed for a second season in March 2016, comprising 20 episodes, which premiered on January 2, 2017.", "In April 2017, it was announced that the series was renewed for a third season of 20 episodes.", "The first half of ten episodes premiered on March 20, 2018.", "On June 4, 2018, Freeform canceled the series after three seasons, but ordered two extra episodes to properly conclude the series' story; the second half of the third season is set to premiere on February 25, 2019." ], [ "Teen Wolf (season 6)", "Teen Wolf (season 6)\n\nThe sixth season of \"Teen Wolf\", an American supernatural drama created by Jeff Davis and to some extent based on the 1985 film of the same name, received an order of 20 episodes on July 9, 2015, and premiered on November 15, 2016.", "The second half of the season premiered on July 30, 2017.", "Unlike the previous season, instead of telling a single story, the season was split into two 10-episode arcs, following the same format of the third season.", "On July 21, 2016, the cast announced at Comic Con that the series would end after its sixth season.", "The final episode aired on September 24, 2017.", "Scott, Stiles, Lydia, Malia and the rest of the pack are returning to Beacon Hills High for the second semester of senior year.", "Everyone will be feeling a bit emotional and anxious as they inch closer to graduation and the thought of imminently parting ways almost becomes a reality.", "But their last semester in high school will not go without trouble.", "\"Teen Wolf\" executive producer Jeff Davis revealed that the sixth season will be a \"ghost story\".", "\n\nThe sixth season of \"Teen Wolf\" received an order of 20 episodes on July 9, 2015.", "Instead of telling a single story, the season was broken into two 10 episode arcs." ] ], "gold": "American drama TV series The Deuce aired for 25 episodes over three seasons on HBO. Episode 3 of the first season aired on September 24, 2017, episode 3 of the second season aired on September 23, 2018, and episode 3 of the third season aired on September 23, 2019.", "prediction 1": "The third episode of the American drama The Deuce came out on September 10, 2017. The third episode of the third season of the television series Teen Wolf came out on September 24, 2017 and the third episode of the third season of The Deuce came out on September 25, 2019.", "prediction 2": "The third episode of the American television series The Deuce came out on September 10, 2017. Episode 3 of the American television series The Deuce came out on January 3, 2018. Episode 3 of the American television series The Shadowhunters came out on January 19, 2019. Episode 3 of the American television series The Deuce came out on January 15, 2019.", "prediction 3": "The Deuce is an American drama television series created by David Simon and George Pelecanos. The series' pilot began filming in October 2015 and was commissioned in January 2016. Episode 3 of the series premiered on September 10, 2017.", "prediction 4": "The Deuce is an American television series created by David Simon and George Pelecanos. The series' pilot began filming in October 2015 and was commissioned in January 2016. The first three episodes of the third season of The Deuce came out on September 10, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 185 }, { "error type": "Redundant", "explanation": "The third episode of the American drama The Deuce came out on September 10, 2017.", "start": 186, "end": 272 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Deuce is an American drama television series that aired for three seasons." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who dies in the new pirates of the caribbean?", "passages": [ [ "Pirates of the Caribbean (film series)", "Filming for the sequels began on February 28, 2005, with \"\" finishing on March 1, 2006, and \"\" on January 10, 2007.", "The second film was also the first Disney theatrical feature film with the computer-generated Walt Disney Pictures logo.", "Rossio and Elliot discovered the novel \"On Stranger Tides\" during production of \"Dead Man's Chest\" and \"At World's End\" and decided to use it as the basis for a fourth film.", "As Gore Verbinski was unavailable, Bruckheimer invited Rob Marshall to direct the film.", "Elliott and Rossio decided to do a stand-alone film, with a story that would support new characters, and incorporate elements from the novel, such as Blackbeard, the Fountain of Youth and mermaids\u2014the latter two having been already alluded to in the previous films.", "Depp, Rush, Greg Ellis and Kevin McNally returned to their roles, and the cast saw the additions of Ian McShane as Blackbeard and Pen\u00e9lope Cruz as Angelica, Blackbeard's daughter and Jack Sparrow's love interest.", "A further addition was Richard Griffiths as King George II of Great Britain.", "After the costly production of two simultaneous films, Disney tried to scale down the fourth installment, giving a lower budget, which led to cheaper locations and fewer scenes with special effects." ], [ "Black Pearl", "In the present day, the \"Pearl\" has remained trapped in its bottle for 'five winters', Jack keeping it in his pocket even as he is forced to use a smaller ship known as the \"Dying Gull\" to go to sea.", "Later in the film, Barbossa uses Blackbeard's sword to restore the \"Pearl\" to its regular size; stabbing the bottle with Blackbeard's sword cracks it, the bottle subsequently breaking as the \"Pearl\" grows to the size of a larger model, only regaining its full size when it returns to the sea.", "Barbossa then claims the ship for himself to battle the undead Captain Salazar, tying Jack to the rear of the ship.", "After tracking down the island where the Trident of Poseidon is located, triggering a mystical convergence that opens a trench in the ocean, Salazar claims the Trident for himself, but Henry Turner and Carina Smyth destroy the trident when Salazar attempts to use it to kill Jack.", "The destruction of the trident restores Salazar and his men to full life, but also causes the sea trench to collapse, with the \"Pearl\"s crew lowering its anchor to pull Jack, Henry and Carina to safety.", "Salazar attempts to climb up the anchor to attack Jack, but Barbossa sacrifices himself to stab Salazar and save the others (Carina having been identified as his daughter)." ], [ "Pirates of the Caribbean: On Stranger Tides", "Barbossa obtains Blackbeard's magic sword and gains control of the \"Queen Anne's Revenge\" and her crew.", "Despite resistance from Blackbeard's crew, the Spanish successfully pull down a pillar, crushing the Fountain of Youth.", "The Spanish army leaves once the fountain is in ruins.", "Philip is mortally wounded, but he returns to free Syrena.", "She helps Jack retrieve the missing chalices and gives them to him, telling him not to waste her tear.", "Syrena goes back to the dying Philip.", "She says she can save him if he asks her to.", "When he asks for her forgiveness, she kisses him and takes him underwater.", "With Blackbeard and Angelica both nearing death, Jack retrieves the last remaining drops of water from the destroyed fountain and puts the tear in one of them.", "Knowing that one of them must be sacrificed, he wants Angelica to drink from the chalice containing the tear.", "Instead, Blackbeard drinks it, asking his daughter to save him.", "Angelica agrees and drinks from the second chalice.", "Jack is upset to lose Angelica, but reveals that he made a mistake about which chalice contained the tear.", "Neither of the two are happy, and they both believe Jack deliberately tricked them.", "Angelica's wounds are healed as the Fountain fatally consumes Blackbeard's body, killing him." ] ], "gold": "In Pirates of the Caribbean Dead Men Tell No Tales, Captain Barbossa dies in order to kill Captain Salaza. Barbossa drops an anchor from Black Pearl to save Jack, Henry, and Carina Smyth, and as they climb to safety, a still-vengeful Salazar pursues them. Hector Barbossa sacrifices himself to save his daughter Carina and knocks Salazar off the anchor chain by stabbing him in the back, leading Salazar to plummet to the bottom of Poseidon's Tomb to drown. In the new Pirates of the Caribbean On Stranger Tides, Blackbeard dies by the fountain, after asking Angelica to die for him and getting tricked into drinking the chalice lacking the tear by Jack.", "prediction 1": "In the sequels to the 2005 film \"Pirates of the Caribbean: Dead Man's Chest\", Blackbeard dies in the first film, the second in the second film, and the third in the fourth film, the Fountain of Youth kills Blackbeard. The Fountain of Youth also kills Blackbeard in the new film, \"Pirates of the Caribbean: Dead Man's Chest\" in the second film, and the third in the fourth film, \"The God of Thunder in the North Sea\", which the character Blackbeard dies in the third and the fourth and fourth film, \"Piad\" dies in the fourth installment, which also includes the character Blackbeard as well as well as the character, but he is also killed by the Fountain of Youth.", "prediction 2": "Pirates of the Caribbean is an American action film series from the 1970s. In the second and third films, Blackbeard dies in both the first and second act, while Angelica dies in the third and fourth. The fourth film, Pirates of the Caribbean: Dead Man's Chest, is the third and final film in the series.", "prediction 3": "In the new Pirates of the Caribbean film series, the character Blackbeard dies in the first film, while Angelica dies in the second.", "prediction 4": "Pirates of the Caribbean: On Stranger Tides is the third and final film in the Pirates of the Caribbean film series. The third film killed Blackbeard, but the fourth film killed Angelica. Blackbeard is killed after the Fountain of Youth is destroyed and the Fountain of Youth consumes Blackbeard's body.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[15]}", "start": 0, "end": 77 }, { "error type": "Incoherent", "explanation": "", "start": 94, "end": 177 }, { "error type": "Redundant", "explanation": "In the sequels to the 2005 film \"Pirates of the Caribbean: Dead Man's Chest\", Blackbeard dies in the first film, the second in the second film, and the third in the fourth film, the Fountain of Youth kills Blackbeard. ", "start": 218, "end": 663 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 13 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 14 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": " In Pirates of the Caribbean: On Stranger Tides Blackbeard dies.The Fountain of Youth kills Blackbeard, after asking Angelica to die for him and getting tricked into drinking the chalice lacking the tear by Jack. On the Black Pearl, Salazar attempts to climb up the anchor to attack Jack, but Barbossa sacrifices himself to stab Salazar and save the others, including Carina, having been identified as his daughter." }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "When did ariana grandes new album come out?", "passages": [ [ "Ariana Grande discography", "Ariana Grande discography\n\nAmerican singer Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays (EPs), thirty-nine singles (including eleven as a featured artist), seven promotional singles and thirty-three music videos.", "After signing with Republic Records, she released her debut single \"Put Your Hearts Up\" in December 2011, but it failed to enter any official record chart.", "Grande made her chart debut in April 2013 with \"The Way\", which peaked at number nine on the United States chart \"Billboard\" Hot 100.", "Her debut studio album \"Yours Truly\" reached the top ten in many countries while debuting at number one on the US \"Billboard\" 200, and was subsequently certified platinum by the Recording Industry Association of America (RIAA).", "The album spawned two more singles: \"Baby I\" and \"Right There\", the former peaked at number six in Japan.", "In December 2013, Grande released her first extended play \"Christmas Kisses\", featuring four Christmas-themed tracks.", "The EP was re-released in December 2014, exclusive to Japan, with one bonus track, Grande's Christmas single \"Santa Tell Me\".", "Grande released her second studio album \"My Everything\" in August 2014.", "The material became her second consecutive number-one record on the \"Billboard\" 200." ], [ "My Everything (Ariana Grande album)", "My Everything (Ariana Grande album)\n\n", "My Everything is the second studio album by American singer and actress Ariana Grande, released on August 25, 2014 by Republic Records.", "Grande wanted \"My Everything\" to sound as \"an evolution\" from her debut album, \"Yours Truly\" (2013); it explores more mature themes and genres.", "In the album's production, Ariana worked with a host of producers \u2013 including Max Martin, Shellback, Benny Blanco, Ryan Tedder, Darkchild, Ilya Salmanzadeh, Zedd, and David Guetta.", "Upon its release, the album debuted atop the \"Billboard\" 200, selling 169,000 copies in its first week.", "It debuted at number one in Australia and Canada as well, and peaked in the top ten of twenty countries worldwide.", "As of April 2018, the album has sold 735,000 copies in the United States.", "\"My Everything\" was preceded by the lead single \"Problem\", which features Australian rapper Iggy Azalea.", "After its release on April 28, 2014, the single debuted at number three the week of May 17, selling over 400,000 copies in its first week and eventually peaking at number two on the \"Billboard\" Hot 100." ], [ "Yours Truly (Ariana Grande album)", "Yours Truly (Ariana Grande album)\n\n", "Yours Truly is the debut studio album by American singer and actress Ariana Grande.", "It was released on September 3, 2013, by Republic Records.", "Incorporating R&B, \"Yours Truly\" was influenced by Whitney Houston, Amy Winehouse, Christina Aguilera and Mariah Carey, amongst Grande's other greatest idols.", "Grande describes the album's first half as a \"throwback\" to the R&B music of the 1990s, and the second half being \"very unique and very special that I've sort of written\" which is completely original.", "On the album, Grande co-wrote six out of the twelve tracks.", "Contribution by Harmony Samuels, Kenneth \"Babyface\" Edmonds, Patrick \"J. Que\" Smith and \"Victorious\" co-star Leon Thomas III, as well as others, handling the production on the album.", "Grande recorded a number of songs on this album over a three-year period.", "The collaborations are with Big Sean, Mika and Mac Miller, in addition to The Wanted's Nathan Sykes, who features on the song \"Almost is Never Enough\" which was also included on .", "Occasionally, the album dips into other genres such as adult contemporary music and dance music.", "\"Yours Truly\" was promoted with live renditions of the album's songs during The Listening Sessions Tour." ] ], "gold": "American singer Ariana Grande has released six studio albums, one compilation album, one live album, one remix album, two extended plays (EPs), 52 singles, including 16 as a featured artist, and 12 promotional singles. Her album, \"Yours Truly\" came out on September 3, 2013, and \"My Everything\" on August 25, 2014. Her remix album came out on May 25, 2015. \"Dangerous Woman\" came out on May 20, 2016. Her new compilation album came out on September 27, 2017 and her new live album came out on December 23, 2019.", "prediction 1": "American singer Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays (EPs), thirty-nine singles, seven promotional singles and thirty-three music videos. Her second studio album, My Everything, was released on August 25, 2014 by Republic Records. My Everything was preceded by the lead single, Problem, which featured Australian rapper Iggy Azalea.", "prediction 2": "American singer and actress Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays (EPs), thirty-nine singles including eleven as a featured artist, seven promotional singles and thirty-three music videos. Her second studio album, My Everything, was released on August 25, 2014 by Republic Records. Yours Truly is the debut studio album by American singer and actress Ariana Grande. It was released on September 3, 2013, by Republic Records.", "prediction 3": "Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays, thirty-nine singles, seven promotional singles and thirty-three music videos. Her debut studio album, Yours Truly, was released on September 3, 2013, by Republic Records. Grande's second studio album, My Everything, was released on August 25, 2014.", "prediction 4": "American singer Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays (EPs), thirty-nine singles (including eleven as a featured artist), seven promotional singles and thirty-three music videos. My Everything is the second studio album by American singer and actress Ariana Grande, released on August 25, 2014. The material became her second consecutive number-one record on the Billboard 200. My Everything was preceded by the lead single \"Problem\", which features Australian rapper Iggy Azalea.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 280, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 402 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "American singer Ariana Grande has released four studio albums, one compilation album, one remix album, four extended plays (EPs), thirty-nine singles, seven promotional singles and thirty-three music videos. Her second studio album, My Everything, was released on August 25, 2014. Yours Truly released on September 3, 2013," }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many months are in the roman calendar?", "passages": [ [ "Roman calendar", "In order to avoid interfering with Rome's religious ceremonies, the reform added all its days towards the ends of months and did not adjust any nones or ides, even in months which came to have 31 days.", "The Julian calendar was supposed to have a single leap day on 24 February (a doubled \") every fourth year but following Caesar's assassination the priests figured this using inclusive counting and mistakenly added the bissextile day every three years.", "In order to bring the calendar back to its proper place, Augustus was obliged to suspend intercalation for one or two decades.", "The revised calendar remaining slightly longer than the solar year, the date of Easter shifted far enough away from the vernal equinox that Pope Gregory\u00a0XIII ordered its adjustment in the 16th century.", "The original Roman calendar is believed to have been an observational lunar calendar whose months began from the first signs of a new crescent moon.", "Because a lunar cycle is about days long, such months would have varied between 29 and 30 days.", "Twelve such months would have fallen 10 or 11 days short of the solar year; without adjustment, such a year would have quickly rotated out of alignment with the seasons in the manner of the Islamic calendar.", "Given the seasonal aspects of the later calendar and its associated religious festivals, this was presumably avoided through some form of intercalation or through the suspension of the calendar during winter." ], [ "Roman calendar", "Rome's 8-day week, the nundinal cycle, was shared with the Etruscans, who used it as the schedule of royal audiences.", "It was presumably a part of the early calendar and was credited in Roman legend variously to Romulus and Servius Tullius.", "The Romans themselves described their first organized year as one with ten fixed months, each of 30 or 31 days.", "Such a decimal division fitted general Roman practice.", "The four 31-day months were called \"full\" (') and the others \"hollow\" (').", "Its 304 days made up exactly 38 nundinal cycles.", "The system is usually said to have left the remaining 50-odd days of the year as an unorganized \"winter\", although Licinius Macer's lost history apparently stated the earliest Roman calendar employed intercalation instead and Macrobius claims the 10-month calendar was allowed to shift until the summer and winter months were completely misplaced, at which time additional days belonging to no month were simply inserted into the calendar until it seemed things were restored to their proper place.", "Later Roman writers credited this calendar to Romulus, their legendary first king and culture hero, although this was common with other practices and traditions whose origin had been lost to them." ], [ "Roman calendar", "Some scholars doubt the existence of this calendar at all, as it is only attested in late Republican and Imperial sources and apparently supported only by the misplaced names of the months from September to December.", "R\u00fcpke also finds the coincidence of the length of the supposed \"Romulan\" year with the length of the first ten months of the Julian calendar to be suspicious.", "Other traditions existed alongside this one, however.", "Plutarch's \"Parallel Lives\" recounts that Romulus's calendar had been solar but adhered to the general principle that the year should last for 360 days.", "Months were employed secondarily and haphazardly, with some counted as 20 days and others as 35 or more.", "The attested calendar of the Roman Republic was quite different.", "It followed Greek calendars in assuming a lunar cycle of days and a solar year of synodic months ( days), which align every fourth year after the addition of two intercalary months.", "The additional two months of the year were January and February; the intercalary month was sometimes known as Mercedonius.", "The Romans did not follow the usual Greek practice in alternating 29- and 30-day months and a 29- or 30-day intercalary month every other year." ] ], "gold": "The Roman Calendar went through different revisions throughout history. The original one is believed to have been an observational lunar calendar with twelve months that would have fallen 10 or 11 days short of the solar year. Nonetheless, their first organized calendar was one with ten fixed months, each of 30 or 31 days named \"hollow\" or \"full\" respectively. The later Roman Republican Calendar was quite different from previous iterations as it followed Greek calendars in assuming a lunar cycle of 29 1\u20442 days and a solar year of 12 1\u20442 synodic months.", "prediction 1": "The original Roman calendar is believed to have been an observational lunar calendar whose months began from the first signs of a new crescent moon. Because a lunar cycle is about days long, such months would have varied between 29 and 30 days. Twelve such months would have fallen 10 or 11 days short of the solar year. Later Roman writers credited this calendar to Romulus, their legendary first king and culture hero, although this was common with other practices and traditions whose origin had been lost to them. The attested calendar of the attested Roman Republic was quite different. It followed Greek calendars in assuming a lunar cycle of days and a solar year of synodic months, which align every fourth year after the addition of two intercalary months.", "prediction 2": "The original Roman calendar is believed to have been an observational lunar calendar whose months began from the first signs of a new crescent moon. Because a lunar cycle is about days long, such months would have varied between 29 and 30 days. Twelve such months would have fallen 10 or 11 days short of the solar year. Additionally, the Romans themselves described their first organized year as one with ten fixed months, each of 30 or 31 days. Such a decimal division fitted general Roman practice, especially during winter, when additional days belonging to no month were simply inserted into the calendar until it seemed things were restored to their proper place.", "prediction 3": "The original Roman calendar is believed to have been an observational lunar calendar whose months began from the first signs of a new crescent moon. Because a lunar cycle is about days long, such months would have varied between 29 and 30 days. The Romans themselves described their first organized year as one with ten fixed months, each of 30 or 31 days. However, the 10-month system was later credited to Romulus, the legendary first king and culture hero of Rome.", "prediction 4": "There are several different versions of the Roman calendar. The original Roman calendar is believed to have been an observational lunar calendar, whose months began from the first signs of a new crescent moon. According to the Romans, the first organized year was one with ten fixed months, each of 30 or 31 days, while the rest of the year was an unorganized winter. The earliest Roman calendar employed intercalation, at which time additional days belonging to no month were simply inserted into the calendar until it seemed things were restored to their proper place.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 690, "end": 765 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 517 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The original Roman calendar is believed to have been an observational lunar calendar whose months began from the first signs of a new crescent moon. Twelve such months would have fallen 10 or 11 days short of the solar year. The Romans themselves described their first organized year as one with ten fixed months, each of 30 or 31 days. Later, the attested calendar of the attested Roman Republic was quite different. It followed Greek calendars in assuming a lunar cycle of days and a solar year of synodic months. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who was given the ten commandments by god?", "passages": [ [ "Ten Commandments", "Ten Commandments\n\nThe Ten Commandments (, \"Aseret ha'Dibrot\"), also known as the Decalogue, are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity.", "The commandments include instructions to worship only God, to honour one's parents, and to keep the sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonesty, and coveting.", "Different religious groups follow different traditions for interpreting and numbering them.", "The Ten Commandments appear twice in the Hebrew Bible, in the books of Exodus and Deuteronomy.", "Modern scholarship has found likely influences in Hittite and Mesopotamian laws and treaties, but is divided over exactly when the Ten Commandments were written and who wrote them.", "In biblical Hebrew, the Ten Commandments are called (transliterated ) and in Mishnaic Hebrew (transliterated ), both translatable as \"the ten words\", \"the ten sayings\", or \"the ten matters\".", "The Tyndale and Coverdale English biblical translations used \"ten verses\".", "The Geneva Bible used \"tenne commandements\", which was followed by the Bishops' Bible and the Authorized Version (the \"King James\" version) as \"ten commandments\"." ], [ "Ten Commandments", "Most major English versions use \"commandments.\"", "The English name \"Decalogue\" is derived from Greek , \"dekalogos\", the latter meaning and referring to the Greek translation (in accusative) , , \"ten words\", found in the Septuagint (or LXX) at Exodus 34:28 and Deuteronomy 10:4.", "The stone tablets, as opposed to the commandments inscribed on them, are called , \"Lukhot HaBrit\", meaning \"the tablets of the covenant\".", "Different religious traditions divide the seventeen verses of and their parallels at into ten \"commandments\" or \"sayings\" in different ways, shown in the table below.", "Some suggest that the number ten is a choice to aid memorization rather than a matter of theology.", "Traditions:\nThe biblical narrative of the revelation at Sinai begins in after the arrival of the children of Israel at Mount Sinai (also called Horeb).", "On the morning of the third day of their encampment, \"there were thunders and lightnings, and a thick cloud upon the mount, and the voice of the trumpet exceeding loud\", and the people assembled at the base of the mount." ] ], "gold": "According to the book of Exodus, the Ten Commandments, or Decalogue, was given by God to Moses and the children of Israel at Mount Sinai. Modern biblical scholarship differs as to whether the children of Israel heard the Decalogue directly, or whether the laws were only passed to them through Moses.", "prediction 1": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. The commandments include instructions to worship only God, to honour one's parents, and to keep the sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonour, and coveting. Different religious groups follow different traditions for interpreting and numbering them. The Ten Commandments appear twice in the Hebrew Bible, in the books of Exonomy and Deuteronomy.", "prediction 2": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. They include instructions to worship only God, to honour one's parents, and to keep the Sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonesty, and coveting. Different religious groups follow different traditions for interpreting and numbering them. The Hebrew Bible refers to the Ten Commandments as the Ten Commandments.", "prediction 3": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. Different religious groups follow different traditions for interpreting and numbering them. The revelation to Moses, God's servant, began with Moses and continued until Aaron and Moses returned, with God's command to Aaron, God's servant, and his successor, Moses.", "prediction 4": "The Ten Commandments are a set of biblical principles relating to ethics and worship, which play a fundamental role in Judaism and Christianity. The Commandments include instructions to worship only God, to honour one's parents, and to keep the sabbath, as well as prohibitions against idolatry, blasphemy, murder, adultery, theft, dishonesty, and coveting. Different religious traditions divide the seventeen verses of and their parallels at into ten \"commandments\" or \"commandments\" or \"commandments\" or \"commandments\" or \"commandments\" in different ways, shown in the table below.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 448 }, { "error type": "Irrelevant", "explanation": "", "start": 449, "end": 544 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "When did sabrina the teenage witch first air?", "passages": [ [ "Sabrina the Teenage Witch (1996 TV series)", "Sabrina the Teenage Witch (1996 TV series)\n\nSabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name.", "The show premiered on September 27, 1996, on ABC to over 17 million viewers in its \"T.G.I.F.\" line-up.", "The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers (a departure from the \"Archie Comics\", where she has known of her magic powers since an early age as revealed in the \"Sabrina \u2013 That Cute Little Witch\" storylines in many \"Little Archie\" comic books).", "She lives with her 500-year-old aunts, witches Hilda (played by Caroline Rhea) and Zelda (played by Beth Broderick), and their magical talking cat, Salem (voiced by Nick Bakay), at 133 Collins Road, in the fictional Boston suburb of Westbridge, Massachusetts through most of the series.", "The series' first four seasons aired on ABC from September 27, 1996, to May 5, 2000; the final three seasons ran on The WB from September 22, 2000, to April 24, 2003.", "The unofficial pilot of the series was the 1996 TV movie \"Sabrina the Teenage Witch\" in April." ], [ "Sabrina the Teenage Witch (film)", "Sabrina the Teenage Witch (film)\n\nSabrina the Teenage Witch is a 1996 American television film adaptation based on the comic book series of the same name from Archie Comics.", "It served as a pilot for the \"Sabrina the Teenage Witch\" television series and premiered on Showtime on April 7, 1996.", "The only two actors who would appear in both the film and television series would be Melissa Joan Hart, whose character possessed a different surname from her comic book and television counterpart, and Michelle Beaudoin, whose character was renamed for the television series.", "Also of note is the fact that, unlike the comics, which were set in the fictional town of Greendale, and the eventual television series (located in an equally fictional town named Westbridge), the television film was said to take place in Riverdale.", "This was the name originally used in the comics for the home of Archie and his group of friends.", "Although set in the United States, just like the comics and said television series, the movie was shot entirely in British Columbia, Canada.", "The movie centers around Sabrina Sawyer, who is sent to live with her eccentric aunts in Riverdale.", "On her 16th birthday, Sabrina discovers that she is a witch.", "Sabrina then develops a crush on Seth, the cutest boy in school who happens to be dating Katie La More, the school's \"queen bee aka mean girl.\"" ], [ "Sabrina the Teenage Witch", "It included shorts with her Universal Horror-inspired cousins, the Groovie Goolies, and ran for four seasons, with the Goolies spinning off into their own series in 1971.", "In 1999, Melissa Joan Hart provided the voice of Sabrina's two aunts for \"\".", "This series lasted one season and produced 65 episodes, the television/direct-to-video movie \"\", and the continuation-spinoff series \"Sabrina's Secret Life\".", "Both of \"Sabrina\" animated shows and a movie are all produced by DiC Productions, now called DHX Media.", "The series is outside the Archie comics.", "In 2011, Archie Comics announced plans to produce a new animated series based on Sabrina the Teenage Witch to be released in late 2012.", "The show featured CGI animation that was produced by MoonScoop, and a brand new look for the \"Sabrina\" characters.", ", The Hub has picked up the series, and it finally debuted on air on October 12, 2013.", "In September 1996, the live-action TV movie spawned the \"Sabrina the Teenage Witch\" television series.", "Both the TV-movie and sitcom starred Melissa Joan Hart as Sabrina.", "The fictional home of the series was moved to Westbridge, Massachusetts.", "Her last name was changed back to Spellman, and her mother was stated to be mortal." ] ], "gold": "Sabrina the Teenage Witch is an American television sitcom created by Nell Scovell that is based on the Archie Comics series of the same name. The unofficial pilot of the series was the television movie Sabrina the Teenage Witch starring Melissa Joan Hart that aired on Showtime on April 7, 1996. The television sitcom show then premiered on Friday, September 27, 1996 on ABC. Sabrina the Teenage Witch aired for four season on ABC. Then, the show moved to The WB with the first episode on the WB airing on September 22, 2000. Additionally, Sabrina Goes to Rome, a television film produced for ABC that is part of the Sabrina the Teenage Witch television series franchise, premiered on October 4, 1998. Due to the success of Sabrina Goes to Rome, ABC produced a sequel titled Sabrina Down Under. Sabrina Down Under premiered on September 26, 1999. Sabrina the Teenage Witch was also an American animated television series based on the Archie Comics of the same name that was produced by Filmation. This CBS Saturday morning show premiered on September 13, 1969.", "prediction 1": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. The show premiered on September 27, 1996, on ABC to over 17 million viewers in its T.G.I.F. line-up. Sabrina the Teenage Witch is also a 1996 American television film adaptation based on the comic book series of the same name from Archie Comics. It served as a pilot for the Sabrina the Teenage Witch television series and premiered on Showtime on April 7, 1996.", "prediction 2": "Sabrina the Teenage Witch is an American television sitcom based on the Archie Comics series of the same name. The show premiered on September 27, 1996, on ABC to over 17 million viewers in its \"T.G.I.F.\" line-up. Sabrina the Teenage Witch is also the subject of a 1996 television film adaptation based on the comic book series of the same name from Archie Comics. The 1996 documentary film served as the pilot for the Sabrina the Teenage Witch television series and premiered on Showtime on April 7, 1996.", "prediction 3": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. The show premiered on September 27, 1996, on ABC to over 17 million viewers in its \"T.G.I.F.\" line-up. The series' first four seasons aired on ABC from September 27, 1996, to May 5, 2000; the final three seasons ran on The WB from September 22, 2000, to April 24, 2003. The unofficial pilot of the series was the 1996 TV movie \"Sabrina the Teenage Witch\" in April 7, 1996.", "prediction 4": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. It premiered on September 27, 1996, on ABC. There was also a 1996 television film adaptation of the comic book series of the same name. It served as a pilot for the Sabrina the Teenage Witch television series and premiered on Showtime on April 7, 1996.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 142, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 200 }, { "error type": "Redundant", "explanation": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. ", "start": 201, "end": 345 }, { "error type": "Redundant", "explanation": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. The show premiered on September 27, 1996, ", "start": 346, "end": 462 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. The unofficial pilot of the series was the television movie Sabrina the Teenage Witch starring Melissa Joan Hart that aired on Showtime on April 7, 1996. The series' first four seasons aired on ABC from September 27, 1996, to May 5, 2000; the final three seasons ran on The WB from September 22, 2000, to April 24, 2003." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who remade mad world by tears for fears?", "passages": [ [ "Mad World", "7\": Mercury / IDEA3 (United Kingdom) / 812 213\u20137 (United States)\n\n7\": Mercury / IDEA3 (Ireland) / 6059 568 (Australia, Europe) / TOS 1411 (South Africa)\n\n7\" double pack: Mercury / IDEA33 (United Kingdom)\n\n12\": Mercury / IDEA312 (United Kingdom) /", "6400 677 (Europe)\n\n\"Mad World\" achieved a second round of success 20 years after its release, when it was covered by Michael Andrews and Gary Jules for the film \"Donnie Darko\" (2001).", "While the Tears for Fears version featured synthesisers and heavy percussion, the Andrews/Jules version was stripped down; instead of a full musical backing, it used only a set of piano chords, a mellotron imitating a cello, very light touches of electric piano, and modest use of a vocoder on the chorus.", "Their version was originally released on CD in 2002 on the film's soundtrack, but an increasing cult-following spawned by the film's DVD release finally prompted Jules and Andrews to issue the song as a proper single.", "It was released through Sanctuary Records on 15 December 2003, in time for the race for the UK's Christmas number one, beating \"Christmas Time (Don't Let the Bells End)\"", "by The Darkness to take the title the following week." ], [ "Mad World", "Mad World\n\n\"Mad World\" is a 1982 song by the British band Tears for Fears.", "Written by Roland Orzabal and sung by bassist Curt Smith, it was the band's third single release and first chart hit, reaching number 3 on the UK Singles Chart in November 1982.", "Both \"Mad World\" and its B-side, \"Ideas as Opiates\", appeared on the band's debut LP \"The Hurting\" (1983).", "\"Mad World\" has since been covered by various artists, most notably by Michael Andrews and Gary Jules for the soundtrack of the film \"Donnie Darko\" in 2001.", "This version was a UK number one hit and won Orzabal his second Ivor Novello Award in 2003.", "\"Mad World\" was originally written on acoustic guitar when Orzabal was 19 after being inspired to write a new wave song in the vein of Duran Duran's \"Girls on Film\".", "After a few false starts with Orzabal on vocals, he suggested Smith sing it and \"suddenly it sounded fabulous\".", "\"Mad World\" was intended to be the B-side for the band's second single \"Pale Shelter (You Don't Give Me Love)\", but their record company stated that \"Mad World\" could be a single in its own right." ], [ "Mad World", "Despite \"Christmas Time (Don't Let the Bells End)\"", "by The Darkness being the bookmakers' favourite to become the 2003 Christmas number one in the UK, \"Mad World\" upset the odds and took the title on 21 December 2003.", "It remained at number one on the UK Singles Chart for three consecutive weeks.", "The song's success in the UK did not, however, translate to the United States, where it reached number 30 on the \"Billboard\" Modern Rock Tracks chart in the issue dated 27 March 2004.", "Jules performed \"Mad World\" with Myl\u00e8ne Farmer on her \"Timeless 2013 Tour.\"", "In 2006, the song was included in the commercial to the video game \"Gears of War\", which helped move it up the charts.", "A performance on the eighth season of \"American Idol\" by Adam Lambert also briefly increased its sales and interest in the song.", "The song reached No. 11 on the Rock Digital Songs chart.", "The music video was directed by Michel Gondry.", "It begins with an aerial shot of a school; the bell rings and children go out onto the pavement.", "The rest of the video sees the children forming different shapes whilst Jules stands on the roof and watches from above.", "On two occasions the camera pans towards Jules looking down at the children, whilst a third pan away sees Andrews playing a piano as the song ends." ] ], "gold": "\"Mad World\" is a 1982 song by the British band Tears for Fears. \"Mad World\" has since been covered by various artists, including a 2001 version recorded by Michael Andrews and Gary Jules for the soundtrack of the film Donnie Darko. English singer-songwriter Alex Parks remade \"Mad World\" in November 2003. In 2009, a performance on the eighth season of American Idol by Adam Lambert also briefly increased its sales and interest in the song.", "prediction 1": "\"Mad World\" is a 1982 song by the British band Tears for Fears. Written by Roland Orzabal and sung by bassist Curt Smith, it was the band's third single release and first chart hit, reaching number 3 on the UK Singles Chart in November 1982. The original Tears for Fears version featured synthesisers and heavy percussion, the original Andrews/Jules version was stripped down; instead of a full musical backing, it used only a set of piano chords, a set of piano chords, a mellotron imitating a cello, very light touches of electric piano, and modest use of a vocoder on the chorus. This version was released through Sanctuary Records on 15 December 2003, in time for the race for the UK's Christmas number one, beating \"Christmas Time (Don't Let the Bells End", "prediction 2": "\"Mad World\" is a 1982 song by the British band Tears for Fears. Written by Roland Orzabal and sung by bassist Curt Smith, it was the band's third single release and first chart hit, reaching number 3 on the UK Singles Chart in November 1982. While the Tears for Fears version featured synthesisers and heavy percussion, the Andrews/Jules version was stripped down; instead of a full musical backing, it used only a set of piano chords, a mellotron imitating a cello, very light touches of electric piano, and modest use of a vocoder on the chorus. Their version was originally released on CD in 2002 on the film's soundtrack, but an increasing cult-following prompted Jules and Andrews to issue the song as a proper single.", "prediction 3": "Several artists have remade Mad World by Tears for Fears, including Michael Andrews and Gary Jules, who covered Tears for Fears' 1982 song Mad World for the soundtrack of the film Donnie Darko. While the Tears for Fears version featured synthesisers and heavy percussion, the Andrews/Jules version was stripped down; instead of a full musical backing, it used only a set of piano chords, a mellotron imitating a cello, very light touches of electric piano, and modest use of a vocoder on the chorus.", "prediction 4": "Mad World is a 1982 song by the British band Tears for Fears. Written by Roland Orzabal and sung by bassist Curt Smith, it was the band's third single release and first chart hit, reaching number 3 on the UK Singles Chart in November 1982. While the Tears for Fears version featured synthesisers and heavy percussion, the Andrews and Jules version was stripped down; instead of a full musical backing, it used only a set of piano chords, a mellotron imitating a cello, very light touches of electric piano, and modest use of a vocal chords.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 241 }, { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 582 }, { "error type": "Irrelevant", "explanation": "", "start": 583, "end": 760 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Mad World\" is a 1982 song by the British band Tears for Fears. it was covered by Michael Andrews and Gary Jules for the film \"Donnie Darko\" (2001). A performance on the eighth season of \"American Idol\" by Adam Lambert also briefly increased its sales and interest in the song." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When did they limit president to 2 terms?", "passages": [ [ "Twenty-second Amendment to the United States Constitution", "Twenty-second Amendment to the United States Constitution\n\nThe Twenty-second Amendment (Amendment XXII) to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States, and also sets additional eligibility conditions for presidents who succeed to the unexpired terms of their predecessors.", "Prior to the ratification of the amendment, the president had not been subject to term limits, but George Washington had established a two-term tradition that many other presidents had followed.", "In the 1940 presidential election, Franklin D. Roosevelt became the first president to win a third term, giving rise to concerns about the potential issues involved with a president serving an unlimited number of terms.", "Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification.", "That process was completed on February 27, 1951, after the amendment had been ratified by the requisite 36 of the then-48 states (as neither Alaska nor Hawaii had yet been admitted as states), and its provisions came into force on that date.", "The amendment prohibits any individual who has been elected president twice from being elected again.", "Under the amendment, an individual who fills an unexpired presidential term lasting greater than two years is also prohibited from winning election as president more than once." ] ], "gold": "In the 1940 presidential election and the 1944 presidential election, Franklin D. Roosevelt became the first president to win a third term and then later a fourth term, giving rise to concerns about the potential issues involved with a president serving an unlimited number of terms. Congress approved the Twenty-second Amendment, which limits the number of times a person is eligible for the US Presidential election to two, on March 24, 1947, and submitted it to the state legislatures for ratification. That process was completed on February 27, 1951.", "prediction 1": "The Twenty-second Amendment to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States, and also sets additional eligibility conditions for presidents who succeed to the unexpired terms of their predecessors. Prior to the ratification of the amendment, the president had not been subject to term limits, but George Washington had established a two-term tradition that many other presidents had followed. Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification. That process was completed on February 27, 1951, after the amendment had been ratified by the requisite 36 of the then-48 states, and its provisions came into force on that date.\n", "prediction 2": "The Twenty-second Amendment (Amendment XXII) to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States, and also sets additional eligibility conditions for presidents who succeed to the unexpired terms of their predecessors. Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification, but it was not complete until February 27, 1951, after the amendment had been ratified by the requisite 36 of the then 48 states, and provisions came into force on that date.", "prediction 3": "The Twenty-second Amendment to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States. It also sets additional eligibility conditions for presidents who succeed to the unexpired terms of their predecessors. Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification. That process was completed on February 27, 1951, after the amendment had been ratified by the requisite 36 of the then-48 states, and its provisions came into force on that date.", "prediction 4": "The Twenty-second Amendment (Amendment XXII) to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States and also sets additional eligibility conditions for presidents who succeed to the unexpired terms of their predecessors. Prior to the ratification of the amendment, the president had not been subject to term limits, but George Washington had established a two-term tradition that many other presidents had followed. Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification. That process was completed on February 27, 1951, after the amendment had been ratified by the requisite 36 of the then-48 states, and its provisions came into force on that date.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 501 }, { "error type": "Irrelevant", "explanation": "", "start": 677, "end": 807 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the 1940 presidential election, Franklin D. Roosevelt became the first president to win a third term, giving rise to concerns about the potential issues involved with a president serving an unlimited number of terms. The Twenty-second Amendment to the United States Constitution sets a limit on the number of times an individual is eligible for election to the office of President of the United States. Congress approved the Twenty-second Amendment on March 24, 1947, and submitted it to the state legislatures for ratification. That process was completed on February 27, 1951." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who did the allies sign a truce with in 1918 (end of the war)?", "passages": [ [ "Armistice of 11 November 1918", "Armistice of 11 November 1918\n\nThe Armistice of 11 November 1918 was the armistice that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany.", "Previous armistices had been agreed with Bulgaria, the Ottoman Empire and the Austro-Hungarian Empire.", "Also known as the Armistice of Compi\u00e8gne from the place where it was signed at 5:45\u00a0a.m. by the French Marshal Foch, it came into force at 11:11\u00a0a.m.", "Paris time on 11 November 1918 (\"the eleventh minute of the eleventh hour of the eleventh day of the eleventh month\") and marked a victory for the Allies and a defeat for Germany, although not formally a surrender.", "The actual terms, largely written by the Allied Supreme Commander, Marshal Ferdinand Foch, included the cessation of hostilities, the withdrawal of German forces to behind the Rhine, Allied occupation of the Rhineland and bridgeheads further east, the preservation of infrastructure, the surrender of aircraft, warships, and military materiel, the release of Allied prisoners of war and interned civilians, eventual reparations, no release of German prisoners and no relaxation of the naval blockade of Germany.", "Although the armistice ended the fighting, it needed to be prolonged three times until the Treaty of Versailles, which was signed on 28 June 1919, took effect on 10 January 1920." ], [ "Matthias Erzberger", "Matthias Erzberger\n\nMatthias Erzberger (20 September 1875 \u2013 26 August 1921) was a German publicist and politician, Reich Minister of Finance from 1919 to 1920.", "Prominent in the Catholic Centre Party, he spoke out against World War I from 1917 and as authorized representative of the Reich government signed the armistice between Germany and the Allies.", "He was assassinated for this act by the right-wing terrorist group \"Organisation Consul\".", "He was born on 20 September 1875 in Buttenhausen (today part of M\u00fcnsingen) in the Kingdom of W\u00fcrttemberg, the son of Josef Erzberger (1847-1907), a tailor and postman, and his wife Katherina (n\u00e9e Flad; 1845-1916).", "In his early life he gained massive weight, which he lost in the course of thirty years.", "He attended the seminaries in Schw\u00e4bisch Hall and Bad Saulgau, where he graduated in 1894, and started a career as a primary school (\"Volksschule\") teacher.", "While teaching, he also studied constitutional law and economics at Fribourg, Switzerland.", "Two years later, he became a journalist working for the Catholic Centre party's publication \"Deutsches Volksblatt\" in Stuttgart, where he also worked as a freelance writer." ], [ "Matthias Erzberger", "When, towards the end of the war, the German Navy mutinied at Kiel, the sailors informed their officers that what they wanted was \"Erzberger\", by then synonymous with \"peace.\"", "On 3 October 1918, Erzberger entered the government of Prince Maximilian von Baden as a Secretary of State without a specified portfolio.", "On 6 November 1918, a reluctant Erzberger was sent to negotiate with the Allies in the Forest of Compi\u00e8gne.", "Prince Maximilian supposed that Erzberger, as a Catholic civilian, would be more acceptable to the allies than a Prussian military officer; in addition, he believed that Erzberger's reputation as a man of peace was unassailable.", "Against hopes that Erzberger would be able to obtain better conditions from the Allies, Ferdinand Foch, the chief Allied negotiator, was unwilling to make any concessions, with the exception of a slight extension of the time allotted to the German army to withdraw.", "Erzberger was unsure whether he should hold out for further changes in Germany's favour.", "On 10 November, Paul von Hindenburg himself telegraphed back that the armistice should be signed, with or without modifications, and a while later the new Chancellor, the Social Democrat Friedrich Ebert, telegraphed Erzberger to authorize him to sign." ] ], "gold": "The Armistice of November 11, 1918 was the armistice signed at Le Francport near Compi\u00e8gne that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. For Germany, the four signatories were Matthias Erzberger, Germany's Secretary of State, Count Alfred von Oberndorff from the Foreign Ministry, Major General Detlof von Winterfeldt from the army, and Captain Ernst Vanselow from the navy. Due to his signing of the armistice, Secretary of State Erzberger was regarded as a traitor by many on the German political right. He was assassinated in 1921 by the German right-wing terrorist group Organisation Consul..", "prediction 1": "The Armistice of 11 November 1918 was the armistice that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. Former German foreign minister and politician Matthias Erzberger signed the armistice. The armistice was signed with the help of German President Adolf Hitler and German Prime Minister Otto von Hindenburg.", "prediction 2": "The armistice of 11 November 1918 ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. Also known as the Armistice of Compi\u00e8gne from the place where it was signed at 5:45 a.m. by the French Marshal Ferdinand Foch, it came into force at 11:11 a.m. Paris time on 11 November 1918.", "prediction 3": "The Armistice of 11 November 1918 was the armistice that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. German naval officers mutinied at Kiel in the days before the armistice was signed, and the sailors informed their officers that what they wanted was \"Erzberger\", by then synonymous with \"peace.\" German publicist and politician Matthias Erzberger signed the armistice between Germany and the Allies.", "prediction 4": "The Armistice of 11 November 1918 was the armistice that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. Also known as the Armistice of Compi\u00e8gne from the place where it was signed at 5:45 a.m. by the French Marshal Foch, it came into force at 11:11 a.m. Paris time on 11 November 1918. Matthias Erzberger, a German publicist and politician, Reich Minister of Finance from 1919 to 1920, was as the authorized representative of the Reich government, signed the armistice between Germany and the Allies. However, it needed to be prolonged three times until the Treaty of Versailles, which was signed on 28 June 1919, took effect on 10 January 1920.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Armistice of 11 November 1918 was the armistice that ended fighting on land, sea and air in World War I between the Allies and their opponent, Germany. It is also known as the Armistice of Compi\u00e8gne from the place where it was signed by the French Marshal Foch. Former German foreign minister and politician Matthias Erzberger signed the armistice. He was assassinated for this act by the right-wing terrorist group in 1921. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many times have the warriors won the finals?", "passages": [ [ "History of the Golden State Warriors", "History of the Golden State Warriors\n\nThe history of the Golden State Warriors began in Philadelphia in 1946.", "In 1962, the franchise was relocated to San Francisco, California and became known as the San Francisco Warriors until 1971, when its name was changed to the current Golden State Warriors.", "Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won five others in the team's history, including another in Philadelphia after the 1955\u201356 season, and four more as Golden State after the 1974\u201375, 2014\u201315, 2016\u201317, and 2017\u201318 seasons.", "The Warriors were founded in Philadelphia in 1946 as the Philadelphia Warriors, a charter member of the Basketball Association of America.", "They were owned by Peter A. Tyrrell, who also owned the Philadelphia Rockets of the American Hockey League.", "Tyrell hired Eddie Gottlieb, a longtime basketball promoter in the Philadelphia area, as coach and general manager.", "He named the team after an early professional team in the city.", "Led by early scoring sensation Joe Fulks, they won the championship in the league's inaugural 1946\u201347 season by defeating the Chicago Stags, four games to one.", "(The BAA became the National Basketball Association in 1949.)" ] ], "gold": "The NBA team now known as the Golden State Warriors has won many titles under different names throughout its history. Originally, they were located in Philadelphia and known as the Philadelphia Warriors, during which time they won 1 BAA final and 1 NBA final. The team then moved to San Francisco, where they were first named the San Francisco Warriors and won 0 NBA finals. After they were renamed the Golden State Warriors, the team went on to win 4 NBA finals.", "prediction 1": "The Warriors have won the finals on five occasions. Their first championship was in 1946, and they've won it five times since then. The team has also won the finals two more times in the team's history, in 1965, and in 1979.", "prediction 2": "The Golden State Warriors have won the NBA Finals five times. Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won five others in the team's history. Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won five others in the team's history, including another in Philadelphia after the 1955\u201356 season, and four more as Golden State after the 1974\u201375, 2014\u201315, 2016\u201317, and 2017\u201318 seasons.", "prediction 3": "The Golden State Warriors have won the finals five times. Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won the finals five others in the team's history, including another in Philadelphia after the 1955\u201356 season, and four more as Golden State after the 1974\u201375, 2014\u201315, 2016\u201317, and 2017\u201318 seasons.", "prediction 4": "The Golden State Warriors have won the finals five times. Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won five others in the team's history, including another in Philadelphia after the 1955\u201356 season, and four more as Golden State after the 1974\u201375, 2014\u201315, 2016\u201317, and 2017\u201318 seasons.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 132, "end": 224 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Warriors were founded in Philadelphia in 1946 as the Philadelphia Warriors, a charter member of the Basketball Association of America. In 1962, the franchise was relocated to San Francisco, California and became known as the San Francisco Warriors. Along with their inaugural championship win in the 1946\u201347 season, the Warriors have won five others in the team's history, including another in Philadelphia after the 1955\u201356 season, and four more as Golden State after the 1974\u201375, 2014\u201315, 2016\u201317, and 2017\u201318 seasons." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Who sings you'll be a woman soon?", "passages": [ [ "Girl, You'll Be a Woman Soon", "Girl, You'll Be a Woman Soon\n\n\"Girl, You'll Be a Woman Soon\" is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967.", "The song enjoyed a second life when it appeared on the 1994 \"Pulp Fiction\" soundtrack, performed by rock band Urge Overkill.", "Other versions have been recorded by Cliff Richard (1968), Jackie Edwards (1968), the Biddu Orchestra (1978), and 16 Volt (1998).", "The song first appeared on Diamond's album \"Just for You\".", "The mono and stereo versions of this song differ slightly.", "On the mono \"Just For You\" LP as well as on the 45, the strings do not come in until the second verse.", "It also has a slightly longer fade.", "The stereo \"Just For You\" LP version has a shorter fade and the strings come in on the first chorus.", "Cliff Richard covered the song as the B-side to his 1968 single I'll Love You Forever Today, which featured in the movie Two a Penny.", "In 1992, the alternative rock band Urge Overkill recorded a cover of the song for their EP \"Stull\".", "This version would later be featured in Quentin Tarantino's 1994 film \"Pulp Fiction\"." ], [ "Stull (EP)", "Stull (EP)\n\nStull is the second extended play by the alternative rock band Urge Overkill.", "It was released in 1992 and would be the band's final major release on independent label Touch and Go Records.", "The EP's title and cover are direct references to Stull Cemetery, located just west of Lawrence, Kansas.", "Since the 1970s, urban legends have been spread that the cemetery is one of the seven portals to Hell.", "\"Stull\" also includes a cover of Neil Diamond's song \"Girl, You'll Be a Woman Soon\", which would later be re-released on the soundtrack to Quentin Tarantino's 1994 film \"Pulp Fiction\".", "Upon re-issue, Urge Overkill's version of \"Girl, You'll Be a Woman Soon\" charted at number 59 on the \"Billboard\" Hot 100.", "The \"Stull\" EP received largely positive reviews from critics, with Stephen Thomas Erlewine of AllMusic and Johan Kugelberg of \"Spin\" both complimenting the record.", "\"Stull\" contains two cover songs, the first of which is \"Girl, You'll Be a Woman Soon\", which was originally penned by Neil Diamond." ] ], "gold": "Girl, You'll Be a Woman Soon is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. The song enjoyed a second life when it appeared on the 1994 Pulp Fiction soundtrack, performed by rock band Urge Overkill. Urge Overkill's version of Girl You'll Be a Woman Soon was also featured in the second episode of the cult UK series Misfits. Other versions of Girl You'll Be a Woman Soon have been recorded by Cliff Richard, Jackie Edwards, the Biddu Orchestra and 16 Volt.", "prediction 1": "Girl, You'll Be a Woman Soon is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. Other versions have been recorded by Cliff Richard (1968), Jackie Edwards (1968), the Biddu Orchestra (1978), and 16 Volt (1998). In 1992, the alternative rock band Urge Overkill recorded a cover of the song for their EP \"Stull\". This version would later be featured in Quentin Tarantino's 1994 film Pulp Fiction.", "prediction 2": "\"Girl, You'll Be a Woman Soon\" is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. Other versions have been recorded by Cliff Richard (1968), Jackie Edwards (1968), the Biddu Orchestra (1978), and 16 Volt (1998). In 1992, the alternative rock band Urge Overkill recorded a cover of the song for their EP \"Stull\". This version would later be featured in Quentin Tarantino's 1994 film Pulp Fiction.", "prediction 3": "Girl, You'll Be a Woman Soon is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. Other versions have been recorded by Cliff Richard, Jackie Edwards, the Biddu Orchestra, and 16 Volt. The 1994 Pulp Fiction soundtrack features a cover of the song performed by rock band Urge Overkill.", "prediction 4": "\"Girl, You'll Be a Woman Soon\" is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. Other versions of the song have been recorded by Cliff Richard (1968), Jackie Edwards (1968), the Biddu Orchestra (1978), and 16 Volt (1998). In 1992, the alternative rock band Urge Overkill recorded a cover of the song for their EP \"Stull\". This version would later be featured in Quentin Tarantino's 1994 film Pulp Fiction.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Girl, You'll Be a Woman Soon is a song written by American musician Neil Diamond, whose recording of it on Bang Records reached number 10 on the US pop singles chart in 1967. Other versions have been recorded by Cliff Richard (1968), Jackie Edwards (1968), the Biddu Orchestra (1978), and 16 Volt (1998). In 1992, the alternative rock band Urge Overkill recorded a cover of the song for their EP \"Stull\". This version would later be featured in Quentin Tarantino's 1994 film Pulp Fiction." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who is the actor who plays the good doctor on tv?", "passages": [ [ "Good Doctor (Japanese TV series)", "Good Doctor (Japanese TV series)\n\nMinato Shindo (Kento Yamazaki) is autistic with savant syndrome.", "He has an amazing memory and keen spatial skills, but he finds it difficult to communicate with others.", "When he was a kid, Minato aspired to become a doctor because his older brother died when he was young.", "One day he met with doctor Akira Shiga (Akira Emoto) and amazed him by his ability to remember all the human organs at a young age.", "Doctor Akira committed to support Minato and upon the recommendation from him, Minato eventually enters the world of pediatric surgery as a resident.", "On May 26, Fuji TV first announced they will make an adaptation of Good Doctor with Kento Yamazaki as the lead actor.", "Begins with a tweet three days before on the official twitter account of Good doctor 2018 that Kento will star in the new Fuji TV drama as main lead, and then a few days later the other supporting casts were announced.", "Special screening for episode 1 was held on July 8, 2018 which was attended by three main lead of the drama.", "The first filming began around June 17 2018, with start a shooting from the story section of the station.", "This is notified through the drama official twitter account." ], [ "Good Doctor (South Korean TV series)", "Good Doctor (South Korean TV series)\n\nGood Doctor () is a 2013 South Korean medical drama television series starring Joo Won, Moon Chae-won, Joo Sang-wook, Kim Min-seo, Chun Ho-jin, Kwak Do-won and Ko Chang-seok.", "It aired on KBS2 from August 5 to October 8, 2013, on Mondays and Tuesdays at 21:55 for 20 episodes.", "The early working title was \"Green Scalpel\" (; lit.", "\"Green Mes\").", "=Synopsis=\nPark Shi-on (Joo Won) is an autistic savant who was sent to a specialized care center as a child, where he was discovered to have a genius-level memory and keen spatial skills.", "He eventually enters the field of pediatric surgery as a resident, where he is given six months to prove himself capable.", "However, due to his atypical mental and emotional condition, Shi-on faces conflict from his peers and patients, who view him as childlike and unreliable.", "Most critical is the hotheaded surgeon Kim Do-han (Joo Sang-wook), who labels him a soulless robot of a doctor who can only rely heavily on his photographic memory instead of feeling what the patient needs." ], [ "The Good Doctor (TV series)", "The Good Doctor (TV series)\n\n", "The Good Doctor is an American medical drama television series based on the 2013 award-winning South Korean series of the same name.", "The actor Daniel Dae Kim first noticed the series and bought the rights for his production company.", "He began adapting the series and in 2015 eventually shopped it to CBS, his home network.", "CBS decided against creating a pilot.", "Because Kim felt so strongly about the series, he bought back the rights from CBS.", "Eventually, Sony Pictures Television and Kim worked out a deal and brought on David Shore, creator of the Fox hit medical drama, \"House\", to develop the series.", "The show is produced by Sony Pictures Television and ABC Studios, in association with production companies Shore Z Productions, 3AD, and Entermedia.", "David Shore serves as showrunner and Daniel Dae Kim is an executive producer for the show.", "The series stars Freddie Highmore as Shaun Murphy, a young savant surgical resident at San Jose St. Bonaventure Hospital who lives with the challenges of autism.", "Antonia Thomas, Nicholas Gonzalez, Beau Garrett, Hill Harper, Richard Schiff, Will Yun Lee and Tamlyn Tomita also star in the show.", "The series received a put pilot commitment at ABC after a previous attempted series did not move forward at CBS Television Studios in 2015; \"The Good Doctor\" was ordered to series in May 2017." ] ], "gold": "There has been a 2013 South Korean series called Good Doctor, a Japanese remake of it entitled Good Doctor, and an American series based on it entitled The Good Doctor. South Korean actor Joo Won played the good doctor on South Korean TV. English actor Freddie Highmore played the good doctor on American TV, and Japanese actor and model Kento Yamazaki did on Japanese TV.", "prediction 1": "The Good Doctor is an American medical drama television series based on the 2013 South Korean television series of the same name. The South Korean series starred Joo Won as Park Shi-on, an autistic savant who was sent to a specialized care center as a child, where he was discovered to have a genius-level memory and keen spatial skills. In the 2017 adaptation, Kento Yamazaki plays the lead role of Minato Shindo. In the 2017 adaptation, the American actor Freddie Highmore plays Shaun Murphy, a savant surgical resident at San Jose St. Bonaventure Hospital who lives with autism.", "prediction 2": "The Good Doctor is an American medical drama television series based on the 2013 award-winning South Korean series of the same name. The series stars Joo Won as Park Shi-on, an autistic savant who was sent to a specialized care center as a child, where he was discovered to have a genius-level memory and keen spatial skills. Shaun Murphy is a young savant surgical resident at San Jose St. Bonaventure Hospital who lives with the challenges of autism. Kento Yamazaki plays the character Minato Shindo Shindo, who is autistic with savant syndrome. He has an amazing memory and keen spatial skills, but finds it difficult to communicate with others.", "prediction 3": "The Good Doctor is an American medical drama television series based on the 2013 South Korean series of the same name. In Japan, Kento Yamazaki plays Minato Shindo, an autistic man with savant syndrome who is discovered to have a genius level memory and keen spatial skills. In the United States, Freddie Highmore plays Shaun Murphy, a young savant surgical resident at San Jose St. Bonaventure Hospital who lives with the challenges of autism.", "prediction 4": "The Good Doctor is an American medical drama television series based on the 2013 award-winning South Korean series of the same name. The Korean series starred Joo Won as Park Shion, who is an autistic savant who was sent to a specialized care center as a child. He was discovered to have a genius-level memory and keen spatial skills. In the US adaptation of the Good Doctor, Kento Yamazaki plays the lead. In the South Korean adaptation, Joo Won plays Park Shion, who is an autistic savant with savant syndrome.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 337 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 345, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 438 }, { "error type": "Irrelevant", "explanation": "", "start": 495, "end": 581 } ], "missing-info": [], "corrected-prediction": "The South Korean series starred Joo Won as Park Shi-on. In the Japanese adaptation, Kento Yamazaki plays the lead role of Minato Shindo. In American adaption, the American actor Freddie Highmore plays Shaun Murphy." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where do the sacramento kings play at home?", "passages": [ [ "Sacramento Kings", "Sacramento Kings\n\nThe Sacramento Kings are an American professional basketball team based in Sacramento, California.", "The Kings compete in the National Basketball Association (NBA) as a member of the Western Conference's Pacific Division.", "The Kings are the only team in the major professional North American sports leagues located in Sacramento.", "The team plays its home games at the Golden 1 Center.", "The Kings are one of the oldest continuously operating professional basketball franchises in the nation.", "They originated in Rochester, New York, as the Rochester Seagrams (a semi-professional team) in 1923 and joined the National Basketball League in 1945 as the Rochester Royals.", "They jumped to the Basketball Association of America, forerunner of the NBA, in 1948.", "As the Royals, the team was often successful on the court, winning the NBA championship in 1951.", "The team, however, found it increasingly difficult to turn a profit in the comparatively small market of Rochester and relocated to Cincinnati in , becoming the Cincinnati Royals.", "In the team relocated to Kansas City, Missouri, and was renamed the Kansas City-Omaha Kings because it initially split its home games between Kansas City and Omaha, Nebraska.", "In , the Kings ceased playing home games in Omaha and simply became the Kansas City Kings.", "The team again failed to find success in its market and moved to Sacramento in .", "The Royals defected to the NBL's rival, the Basketball Association of America, in 1948." ], [ "Sacramento Kings", "On May 9, 2016, the Kings hired former Memphis Grizzlies coach Dave Joerger as head coach.", "During the 2016 NBA draft, the Kings traded the 8th pick to the Phoenix Suns for the 13th and 28th pick in the draft, as well as the rights to Serbian guard Bogdan Bogdanovi\u0107.", "Later in the evening, the Kings traded Marco Belinelli to the Charlotte Hornets in exchange for the 22nd pick in the draft.", "The Kings selected four players in the 2016 NBA draft \u2013 Greek center Georgios Papagiannis with the 13th pick, Syracuse shooting guard Malachi Richardson with the 22nd pick, Kentucky forward Skal Labissiere with the 28th pick, and Oklahoma guard Isaiah Cousins with the 59th pick.", "In free agency, the Kings signed Anthony Tolliver, Garrett Temple, Arron Afflalo, Matt Barnes, and Ty Lawson.", "On February 20, 2017, the Kings traded DeMarcus Cousins, alongside Omri Casspi to the New Orleans Pelicans for Tyreke Evans, Buddy Hield, Langston Galloway and two future draft picks.", "The initial Rochester Royals logo featured a blue and white shield with the word \"ROCHESTER\" on the top, with a white banner with the word \"ROYALS\" on it.", "From the beginning the road uniforms were blue with the city name written in front, while home uniforms were white with the team name written in front." ], [ "Sleep Train Arena", "Sleep Train Arena\n\nSleep Train Arena, originally ARCO Arena and later Power Balance Pavilion, is a defunct indoor arena located in Sacramento, California, United States.", "Opened in 1988, it was the home of the Sacramento Kings of the National Basketball Association (NBA) from 1988 to 2016.", "It hosted nearly 200 spectator events each year.", "The arena is named for The Sleep Train, a chain of mattress and bed retailers based in Rocklin that at the time of the agreement was a subsidiary of Mattress Firm, a Houston-based retailer that has since re-branded all Sleep Train stores as Mattress Firm.", "The original ARCO Arena (1985\u20131988), where the Kings played their home games for three seasons (1985 to 1988), after moving from Kansas City had a capacity of 10,333 seats.", "This arena was also the home for the Sacramento Attack of the Arena Football League in 1992 in their only season and the WNBA's Sacramento Monarchs until they folded in 2009.", "Sleep Train Arena is located in a once isolated area on the expanding northern outskirts of the city.", "It was constructed at a cost of just $40 million, the lowest of any venue in the NBA.", "It is the smallest arena in the NBA with a seating capacity of 17,317, and has 30 luxury suites and 412 club seats.", "It can host such varied events as concerts, ice shows, rodeos and monster truck rallies." ] ], "gold": "From 1988-2016, the Sacramento Kings played their home games at the Sleep Train Arena, formerly ARCO Arena II/Power Balance Pavilion. Since 2016, the Kings play their home games at the Golden 1 Center, in Sacramento, California. ", "prediction 1": "The Sacramento Kings are an American professional basketball team based in Sacramento, California. The team plays its home games at the Golden 1 Center. Sleep Train Arena was the home of the Sacramento Kings from 1988 to 2016.", "prediction 2": "The Sacramento Kings are an American professional basketball team based in Sacramento, California. The Kings play their home games at the Golden 1 Center. The Kings were first introduced to the NBA as the Rochester Royals in 1923. As the Royals, the team found it increasingly difficult to turn a profit in the comparatively small market of Rochester and relocated to Cincinnati in 1945. In the following years, the team relocated to Kansas City, Missouri, where they were renamed the Kansas City-Omaha Kings. In 1988, the Sacramento Kings played at the Sleep Train Arena.", "prediction 3": "The Sacramento Kings are an American professional basketball team based in Sacramento, California. The Kings compete in the National Basketball Association (NBA) as a member of the Western Conference's Pacific Division. The Kings play their home games at the Golden 1 Center. The Kings originated in Rochester, New York, as the Rochester Seagrams (a semi-professional team) in 1923, and joined the National Basketball League in 1945 as the Rochester Royals. They jumped to the Basketball Association of America, forerunner to the NBA, in 1948.", "prediction 4": "The Sacramento Kings are an American professional basketball team based in Sacramento, California. The team plays its home games at the Golden 1 Center. The Kings originated in Rochester, New York, as the Rochester Seagrams (a semi- professional team) in 1923. They jumped to the NBA in 1948 as the Rochester Royals. The Kings played their home games in the ARCO Arena from 1985 to 1988, which was a defunct indoor arena located in Sacramento, California.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 98 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The team plays its home games at the Golden 1 Center. Sleep Train Arena was the home of the Sacramento Kings from 1988 to 2016 and was formerly known as ARCO Arena and later Power Balance Pavilion." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many wild card teams make it to the mlb playoffs?", "passages": [ [ "Major League Baseball wild card", "Major League Baseball wild card\n\nIn Major League Baseball (MLB), the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division.", "Both teams in each league possess the two best winning percentages in their respective league after the three division winners.", "The wild card was first instituted in MLB in 1994, with one wild-card team per league advancing to the Division Series in the postseason to face a division winner.", "In 2012, the system was modified to add a second wild-card team per league and put each league's wild-card teams against each other in a play-in game\u2014the MLB Wild Card Game\u2014the winner of which would then advance to the Division Series and play the team with the best record.", "This system ensures that the team with the second-best record in each league, after the three division winners and the team with the first-best record in the league that is a non-division winner, will also get a postseason berth, even if it isn't a division champion.", "From 1969 through 1993, division leaders in each league advanced to the League Championship Series, with the winners of each LCS meeting in the World Series.", "However, an expanding number of teams over the years made making the playoffs increasingly difficult." ] ], "gold": "In Major League Baseball, the wild card teams are the two teams in each of the two leagues, American and National, that have qualified for the postseason despite failing to win their division. The wild card was first instituted in MLB in 1994, with one wild-card team per league advancing to the Division Series in the postseason to face a division winner. In 2012, the system was modified to two wild cards per league and each league's wild card teams played against each other in a play-in game, called the MLB Wild Card Game, where the winner of which would then advance to the Division Series and play the team with the best record. This system ensures that the team with the second-best record in each league will get a postseason berth, even if that team doesn't win its division.", "prediction 1": "In MLB, the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division. In 1994, one wild card team per league made it to the Division Series, with another added in 2012. In 2012, the wild card system was modified to add a second wild card team per league, with each league's wild-card teams against each other in a play-in game\u2014the MLB Wild Card Game\u2014the winner of which would then advance to the Division Series and play the team with the best record.", "prediction 2": "In Major League Baseball, the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division. The wild card was first instituted in MLB in 1994, with one wild-card team per league advancing to the Division Series in the postseason to face a division winner. In 2012, the system was modified to add a second wild-card team per league and put each league's wild-card teams against each other in a play-in game\u2014the winner of which would then advance to the Division Series and play the team with the best record.", "prediction 3": "In Major League Baseball, the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division. Both teams in each league possess the two best winning percentages in their respective league after the three division winners. In 2012, the system was modified to add a second wild-card team per league and put each league's wild-card teams against each other in a play-in game\u2014the MLB Wild Card Game\u2014the winner of which would then advance to the Division Series and play the team with the best record.", "prediction 4": "In Major League Baseball, the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division. In 1994, there was one wild-card team per league, and in 2012, the system was modified to add a second wild-card team per league, with each league's wild-card teams against each other in a play-in game\u2014the MLB Wild Card Game\u2014the winner of which would then advance to the Division Series and play the team with the best record.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "In MLB, the wild card teams are the two teams in each of the two leagues (American and National) that have qualified for the postseason despite failing to win their division. In 1994, one wild card team per league made it to the Division Series, with another added in 2012. In 2012, the wild card system was modified to add a second wild card team per league, with each league's wild-card teams against each other in a play-in game\u2014the MLB Wild Card Game\u2014the winner of which would then advance to the Division Series and play the team with the best record. This system ensures that the team with the second-best record in each league, after the three division winners and the team with the first-best record in the league that is a non-division winner, will also get a postseason berth, even if it isn't a division champion." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What type of metal are guns made of?", "passages": [ [ "Gun barrel", "Gun barrel\n\nA gun barrel is a crucial part of gun-type ranged weapons such as small firearms, artillery pieces and air guns.", "It is the straight shooting tube, usually made of rigid high-strength metal, through which a contained rapid expansion of high-pressure gas(es) is introduced (via propellant combustion or mechanical compression) behind a projectile in order to propel it out of the front end (muzzle) at a high velocity.", "The hollow interior of the barrel is called the bore.", "The measurement of the diameter of the bore is called the caliber.", "Caliber is usually measured in inches or millimetres.", "The first firearms were made at a time when metallurgy was not advanced enough to cast tubes capable of withstanding the explosive forces of early cannons, so the pipe (often built from staves of metal) needed to be braced periodically along its length for reinforcement, producing an appearance somewhat reminiscent of storage barrels being stacked together, hence the English name.", "Gun barrels are usually metal.", "However, the early Chinese, the inventors of gunpowder, used bamboo, which has a strong, naturally tubular stalk and is cheaper to obtain and process, as the first barrels in gunpowder projectile weapons such as the fire lances.", "The Chinese were also the first to master cast-iron cannon barrels, and used the technology to make the earliest infantry firearms \u2014 the hand cannons." ], [ "Gun barrel", "Early European guns were made of wrought iron, usually with several strengthening bands of the metal wrapped around circular wrought iron rings and then welded into a hollow cylinder.", "Bronze and brass were favoured by gunsmiths, largely because of their ease of casting and their resistance to the corrosive effects of the combustion of gunpowder or salt water when used on naval vessels.", "Early firearms were muzzle-loading, with the gunpowder and then the shot loaded from the front end (muzzle) of the barrel, and were capable of only a low rate of fire due to the cumbersome loading process.", "The later-invented breech-loading designs provided a higher rate of fire, but early breechloaders lacked an effective way of sealing the escaping gases that leaked from the back end (breech) of the barrel, reducing the available muzzle velocity.", "During the 19th century, effective breechblocks were invented that sealed a breechloader against the escape of propellant gases.", "Early cannon barrels were very thick for their caliber.", "This was because manufacturing defects such as air bubbles trapped in the metal were common back in the days, and played key factors in many gun explosions; these defects made the barrel too weak to withstand the pressures of firing, causing it to fail and fragment explosively." ], [ "Gunmetal", "Gunmetal\n\nGunmetal, also known as red brass in the United States, is a type of bronze \u2013 an alloy of copper, tin, and zinc.", "Proportions vary by approximation but 88% copper, 8\u201310% tin, and 2\u20134% zinc is an approximation.", "Originally used chiefly for making guns, it has largely been replaced by steel.", "Gunmetal, which casts and machines well and is resistant to corrosion from steam and salt water, is used to make steam and hydraulic castings, valves, gears, statues, and various small objects, such as buttons.", "It has a tensile strength of 221 to 310 MPa, a specific gravity of 8.7, a Brinell hardness of 65 to 74, and a melting point of around 1,000 degrees Celsius.", "Gunmetal can also mean steel treated to simulate gunmetal bronze.", "Bushings made of this metal are used in machinery.", "The Victoria Cross, Britain's highest award for military valour, is traditionally made using gunmetal from a cannon captured at the Siege of Sevastopol during the Crimean War.", "The British Gwalior Star medal, awarded to the British participants in the 1843 campaign against the Scindias, is made from guns captured at the Battles of Maharajpur and Punniar, during the Gwalior Campaign." ] ], "gold": "Guns have been made of several types of metal, including steel, bronze, brass, wrought iron, and gun metal. Guns are made of steel, which replaced gun metal, while guns' barrels are usually made of rigid high-strength metal. In the past, guns were chiefly made with gun metal, an alloy of copper, tin, and zinc. They were also made of bronze and brass, which was favored by gunsmiths, while early European guns were made of wrought iron.", "prediction 1": "Gun barrels are usually made of metal. However, the early Chinese, the inventors of gunpowder, used bamboo as the first barrels in gunpowder projectile weapons such as the fire lances. Early firearms were muzzle-loading, with the gunpowder and then the shot loaded from the front end (muzzle) of the barrel. Gunmetal, also known as red brass in the United States, is a type of bronze \u2013 an alloy of copper, tin, and zinc. Originally used chiefly for making guns, it has largely been replaced by steel.", "prediction 2": "Gun barrels are usually made of metal. However, the early Chinese, the inventors of gunpowder, used bamboo as the first barrels in gunpowder projectile weapons such as the fire lances. Gunmetal, also known as red brass in the United States, is a type of bronze \u2013 an alloy of copper, tin, and zinc. Originally used chiefly for making guns, it has largely been replaced by steel.", "prediction 3": "Gun barrels are usually made of metal. However, the early Chinese were the first to master cast-iron cannon barrels, and used the technology to make the earliest infantry firearms, the hand cannons. Early firearms were muzzle-loading, with the gunpowder and then the shot loaded from the front end (muzzle) of the barrel. Gunmetal, also known as red brass in the United States, is a type of bronze \u2013 an alloy of copper, tin, and zinc.", "prediction 4": "A gun barrel is a crucial part of gun-type ranged weapons such as small firearms, artillery pieces and air guns, and is usually made of rigid high-strength metal. Gunmetal is a type of bronze \u2013 an alloy of copper, tin, and zinc. Originally used chiefly for making guns, it has largely been replaced by steel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 363 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Gun barrels are usually made of metal. Gunmetal is a type of bronze \u2013 an alloy of copper, tin, and zinc. Originally used chiefly for making guns, it has largely been replaced by steel. The earliest firearm, the hand cannons, was made with cast-iron barrels. Early European guns were made of wrought iron. Bronze and brass were favoured by gunsmiths" }, "preference": [ 0, 0, 1, 1, 1, 1 ] }, { "question": "Who has the most championships in the wnba?", "passages": [ [ "Van Chancellor", "Van Chancellor\n\nVan Winston Chancellor (born September 27, 1943) is a former college and professional basketball coach.", "He coached University of Mississippi women's basketball, Louisiana State University women's basketball, and the professional Houston Comets.", "He was named head coach of the Lady Tigers on April 11, 2007, replacing Pokey Chatman.", "In 2001, Chancellor was elected to the Women's Basketball Hall of Fame, located in Knoxville, Tennessee.", "He was enshrined as a member of the Naismith Memorial Basketball Hall of Fame in September 2007.", "Chancellor currently serves as an analyst for Southland Conference games on ESPN3.", "Chancellor played two years of basketball at East Central Junior College in Decatur, Mississippi, before transferring to Mississippi State University, where he earned a bachelor\u2019s degree in mathematics & physical education in 1965.", "During his senior year at Mississippi State, he served as head coach of the boys' basketball team at Noxapater High School.", "Chancellor went on to coach boys' and girls' basketball at Horn Lake High School and Harrison Central High School in Mississippi.", "He received his master\u2019s degree in physical education from the University of Mississippi in 1973.", "Chancellor spent 19 seasons (1978\u20131997) as the head coach of the University of Mississippi Rebels, compiling an overall record of 439-154 (.740)." ], [ "Cheryl Reeve", "Cheryl Reeve\n\nCheryl Reeve is an American basketball head coach and general manager for the Minnesota Lynx of the WNBA.", "She has coached the Lynx to four league championships.", "In WNBA history, she has the highest winning percentage, she won the most games of any female coach, and she won the most postseason games of any coach.", "Reeve was named the WNBA Coach of the Year in 2011 and 2016.", "Reeve grew up in Washington Township, Gloucester County, New Jersey and graduated from Washington Township High School in 1984, where she was part of the school's first team to make the state finals.", "In 1988, Reeve was a Rhodes Scholar nominee and received a MAAC Scholar-Athlete Post Graduate Award and a NCAA Post-Graduate Scholarship.", "She earned a bachelors in computer science that year and then an MBA, both from La Salle University.", "Reeve started out as assistant coach at her alma mater, La Salle for two years.", "She was then an assistant at George Washington for five years.", "The Colonials posted five 20-win seasons, captured three Atlantic 10 Conference Championships and appeared in four NCAA tournaments during Reeve's stint at George Washington.", "Her first head coaching position was with the Indiana State Sycamores from 1995 to the middle of the 1999-2000 season (replaced by her assistant coach Jim Wiedie)." ], [ "Minnesota Lynx", "Minnesota Lynx\n\nThe Minnesota Lynx are a professional basketball team based in Minneapolis, Minnesota, playing in the Western Conference in the Women's National Basketball Association (WNBA).", "The team won the WNBA title in 2011, 2013, 2015, and 2017.", "Founded prior to the 1999 season, the team is owned by Glen Taylor, who is also the majority owner of the Lynx' NBA counterpart, the Minnesota Timberwolves.", "The franchise has been home to many high-quality players such as Katie Smith, explosive small-forward Seimone Augustus, native Minnesotan Lindsay Whalen, Connecticut standout Maya Moore, forward Rebekkah Brunson, and center Sylvia Fowles.", "The Lynx have qualified for the WNBA playoffs in ten of their twenty years.", "With four championships, the Lynx are tied with the Houston Comets for the most titles in WNBA history, and they have won more Western Conference championships than any other franchise.", "On April 22, 1998, the WNBA announced they would add two expansion teams (Minnesota and the Orlando Miracle) for the 1999 season.", "The team was officially named the Minnesota Lynx on December 5, 1998.", "The Lynx started their inaugural season in 1999 with 12,122 fans in attendance to watch the first regular-season game against the Detroit Shock at Target Center.", "The Lynx defeated Detroit 68\u201351 in the franchise's first game." ] ], "gold": "The teams and the coaches with the most championships in the WNBA differ. The teams with the most are the Seattle Storm, Minnesota Lynx and Houston Comets, who are tied with four championships. The coaches with the most are Van Chancellor, who coached the Houston Comets, and Cheryl Reeve, who is the Minnesota Lynx's head manager.", "prediction 1": "The most championships in the WNBA were won by the Houston Comets in 1995 and 1996. The most titles won by a woman by a male head coach by the Minnesota Lynx in 2011 and 2017 respectively. Van Chancellor, a former college and professional basketball coach, has the most titles in WNBA history.", "prediction 2": "In the Women's National Basketball Association, the Houston Comets have won the most championships in its history. Van Winston Chancellor holds the record for most championships in the WNBA with five. American head coach Cheryl Reeve holds the record for most WNBA league championships with four.", "prediction 3": "There are several women's basketball teams in the WNBA. The Houston Comets have the most championships in WNBA history. The Minnesota Lynx have won the WNBA title in 2011, 2013, 2015, and 2017. The Houston Comets have won the most Western Conference championships.", "prediction 4": "The Houston Comets have the most championships in WNBA history. Van Winston Chancellor has the most championships in WNBA history. Cheryl Reeve has the most championships in WNBA history.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 69, "end": 83 }, { "error type": "Incoherent", "explanation": "", "start": 115, "end": 157 }, { "error type": "Unverifiable", "explanation": "", "start": 161, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 256 }, { "error type": "Unverifiable", "explanation": "", "start": 257, "end": 293 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "The most championships in the WNBA were won by the Houston Comets and the Minnesota Lynx with 4 each. The most titles won by a woman is Cheryl Reeve with 4 with the Lynx and she's their general manager. Van Chancellor has coached the Houston Comets. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who has the major league home run record?", "passages": [ [ "Home run", "Only eight other major league players have hit as many as 600: Hank Aaron (755), Babe Ruth (714), Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609).", "The single season record is 73, set by Barry Bonds in 2001.", "Other notable single season records were achieved by Babe Ruth who hit 60 in 1927, Roger Maris, with 61 home runs in 1961, and Mark McGwire, who hit 70 in 1998.", "Negro League slugger Josh Gibson's Baseball Hall of Fame plaque says he hit \"almost 800\" home runs in his career.", "The \"Guinness Book of World Records\" lists Gibson's lifetime home run total at 800.", "Ken Burns' award-winning series, \"Baseball\", states that his actual total may have been as high as 950.", "Gibson's true total is not known, in part due to inconsistent record keeping in the Negro Leagues.", "The 1993 edition of the MacMillan \"Baseball Encyclopedia\" attempted to compile a set of Negro League records, and subsequent work has expanded on that effort.", "Those records demonstrate that Gibson and Ruth were of comparable power." ], [ "Home runs allowed", "Home runs allowed\n\n", "In baseball statistics, home runs allowed (HRA) signifies the total number of home runs a pitcher allowed.", "The record for the most home runs allowed by any pitcher belongs to Jamie Moyer (522).", "The National League record for most home runs allowed belongs to Warren Spahn with 434 and the American League record is 422 held by Frank Tanana." ], [ "Major League Baseball", "Major League Baseball\n\nMajor League Baseball (MLB) is a professional baseball organization, the oldest of the four major professional sports leagues in the United States and Canada.", "A total of 30 teams play in the National League (NL) and American League (AL), with 15 teams in each league.", "The NL and AL were formed as separate legal entities in 1876 and 1901 respectively.", "After cooperating but remaining legally separate entities beginning in 1903, the leagues merged into a single organization led by the Commissioner of Baseball in 2000.", "The organization also oversees Minor League Baseball, which comprises 256 teams affiliated with the Major League clubs.", "With the World Baseball Softball Confederation, MLB manages the international World Baseball Classic tournament.", "Baseball's first openly all-professional team was founded in Cincinnati in 1869.", "(There had been teams in the past that paid some players, and some that had paid all players but under the table.)", "The first few decades of professional baseball were characterized by rivalries between leagues and by players who often jumped from one team or league to another.", "The period before 1920 in baseball was known as the dead-ball era; players rarely hit home runs during this time.", "Baseball survived a conspiracy to fix the 1919 World Series, which came to be known as the Black Sox Scandal.", "The sport rose in popularity in the 1920s, and survived potential downturns during the Great Depression and World War II." ] ], "gold": "There are several Major League home run records. Barry Bonds, an American former professional baseball left fielder, has both the Major League home run record for a career with 762 and home run record for a season with 73. Jamie Moyer, an American former professional baseball pitcher, has the Major League home runs allowed record with 522.", "prediction 1": "Major League Baseball is a professional baseball organization and the oldest of the four major professional sports leagues in the United States and Canada. Hank Aaron has the major league home run record of 755 while Babe Ruth has the major league home run record of 714.", "prediction 2": "The Major League Baseball organization, the oldest of the four major professional sports leagues in the United States and Canada, has the record for the most home runs allowed by any pitcher. Jamie Moyer holds the record for the most home runs allowed by any pitcher. The National League record for the most home runs allowed belongs to Warren Spahn with 434 and the American League record is 422 held by Frank Tanana. The most home runs allowed by any pitcher is 522 held by Warren Spahn. The home run record was set in the 1940 by the Chicago White Sox Scandal.", "prediction 3": "In baseball statistics, home runs allowed signifies the total number of home runs a pitcher allowed. The record for the most home runs allowed by any pitcher belongs to Jamie Moyer with 522 and the American League record is 422 held by Frank Tanana. In the major leagues, Hank Aaron has the major league home run record with 755 (a record that he set in 1975).", "prediction 4": "In baseball statistics, home runs allowed signifies the total number of home runs a pitcher allowed. The record for the most home runs allowed by any pitcher belongs to Jamie Moyer with 522; the National League record for most home runs allowed belongs to Warren Spahn with 434, and the American League record is 422 held by Frank Tanana. Only eight other major league players have hit as many as 600: Hank Aaron (755), Babe Ruth (714), Alex Rodriguez (696), Willie Mays (633), Albert Pujols (633), and Sammy Sos.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 271 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": " Hank Aaron has the major league home run record of 755. The single season record is 73, set by Barry Bonds in 2001. Negro League slugger Josh Gibson's Baseball Hall of Fame plaque says he hit \"almost 800\" home runs in his career. The record for the most home runs allowed by any pitcher belongs to Jamie Moyer with 522." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "The mountain range that separates europe from asia is?", "passages": [ [ "Ural Mountains", "Ural Mountains\n\nThe Ural Mountains (; ; , \"Ural tau\u017aar\u0131\"), or simply the Urals, are a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan.", "The mountain range forms part of the conventional boundary between the continents of Europe and Asia.", "Vaygach Island and the islands of Novaya Zemlya form a further continuation of the chain to the north into the Arctic Ocean.", "The mountains lie within the Ural geographical region and significantly overlap with the Ural Federal District and with the Ural economic region.", "They have rich resources, including metal ores, coal, precious and semi-precious stones.", "Since the 18th century the mountains have contributed significantly to the mineral sector of the Russian economy.", "As attested by Sigismund von Herberstein, in the 16th century Russians called the range by a variety of names derived from the Russian words for rock (stone) and belt.", "The modern Russian name for the Urals (\u0423\u0440\u0430\u043b, \"Ural\"), first appearing in the 16th\u201317th century when the Russian conquest of Siberia was in its heroic phase, was initially applied to its southern parts and gained currency as the name of the entire range during the 18th century." ], [ "Caucasus", "The North Caucasus region is known as the \"Ciscaucasus\", whereas the South Caucasus region is commonly known as the \"Transcaucasus\".", "The Ciscaucasus contains most of the Greater Caucasus mountain range.", "It consists of Southern Russia, mainly the North Caucasian Federal District's autonomous republics, and the northernmost parts of Georgia and Azerbaijan.", "The Ciscaucasus lies between the Black Sea to its west, the Caspian Sea to its east, and borders the Southern Federal District to its north.", "The two Federal Districts are collectively referred to as \"Southern Russia.\"", "The Transcaucasus borders the Greater Caucasus range and Southern Russia to its north, the Black Sea and Turkey to its west, the Caspian Sea to its east, and Iran to its south.", "It contains the Lesser Caucasus mountain range and surrounding lowlands.", "All of Armenia, Azerbaijan (excluding the northernmost parts) and Georgia (excluding the northernmost parts) are in the South Caucasus.", "The watershed along the Greater Caucasus range is generally perceived to be the dividing line between Europe and Southwest Asia.", "The highest peak in the Caucasus is Mount Elbrus (5,642 meters) located in western Ciscaucasus, and is considered as the highest point in Europe.", "The Caucasus is one of the most linguistically and culturally diverse regions on Earth." ] ], "gold": "Two mountain ranges, the Caucasus Mountains and the Ural Mountains, separate Europe from Asia. The Caucasus Mountains is a mountain range at the intersection of Europe and Asia that stretches between the Black Sea and the Caspian Sea. This mountain range is surrounded by the Caucasus region. The Ural Mountains is a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan. This mountain range also forms part of the conventional boundary between Europe and Asia.", "prediction 1": "The watershed along the Greater Caucasus range is generally perceived to be the dividing line between Europe and Southwest Asia. The Ural Mountains, or simply the Urals, are a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan. The mountain range forms part of the conventional boundary between the continents of Europe and Asia.", "prediction 2": "The mountain range that separates Europe from Asia runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan. The Ural Mountains, or simply the Urals, are a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River. The watershed along the Greater Caucasus range is generally perceived to be the dividing line between Europe and Southwest Asia.", "prediction 3": "The Greater Caucasus mountain range consists of the mountains of Southern Russia, Northern Russia, and the North Caucasus, and is also known as the Ciscaucasus or Cisnaucasus. The Lesser Caucasus mountain range, which comprises northern Armenia, Azerbaijan, and Georgia, forms the northern extremity of the Greater Caucasus mountain range, part of the conventional boundary between the continents of Europe and Asia. The Ural Mountains, or simply the Urals, are a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan.", "prediction 4": "The Greater Caucasus mountain range lies between the Black Sea and the Caspian Sea, while the Lesser Caucasus mountain range runs between the Black Sea and the Caspian Sea. The Ural Mountains, or simply the Urals, form part of the conventional boundary between Europe and Asia. The mountains are situated in western Russia and border the Caspian Sea.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Ural Mountains, or simply the Urals, are a mountain range that runs approximately from north to south through western Russia, from the coast of the Arctic Ocean to the Ural River and northwestern Kazakhstan. The mountain range forms part of the conventional boundary between the continents of Europe and Asia. The North Caucasus region is known as the \"Ciscaucasus\" and contains most of the Greater Caucasus mountain range. The watershed along the Greater Caucasus range is generally perceived to be the dividing line between Europe and Southwest Asia. The Ciscaucasus lies between the Black Sea to its west, the Caspian Sea to its east." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "How many keys does a piano have full size?", "passages": [ [ "Innovations in the piano", "The Phoenix Piano of the UK has experimented with soundboard made of carbon fiber composite, which they claim can be made with better sounding qualities than wood, and without the swelling, shrinking and cracking that do affect wood.", "Phoenix Piano has now for sale pianos with carbon fiber composite soundboard, built by Steingraeber & Sohne\n\nThe Astin-Weight piano company of Salt Lake City, Utah introduced two related innovations to the upright piano which were designed and patented by Edwin R. Astin Sr.", "Their purpose was to obtain the largest possible soundboard, and indeed, Astin-Weight soundboards cover the entire rear surface of the piano.", "This is made possible by placing the pinblock forward of the soundboard, and using a peripheral metal frame instead of back posts.", "The Astin-Weight piano is said to produce a very rich tone, not to every listener's taste but greatly prized by Astin-Weight owners.", "Almost every modern piano has 36 black keys and 52 white keys for a total of 88 keys (seven octaves plus a minor third, from A0 to C8).", "Most makers standardized around the 88 key format during the 1880s and 1890s time period.", "Many older pianos only have 85 keys (seven octaves from A0 to A7), while some manufacturers extend the range further in one or both directions." ] ], "gold": "A full-size piano has 52 white keys and 36 black keys for a total of 88 keys. Almost every modern piano has this key count, spanning seven octaves plus a minor third, from A0 to C8. Many older pianos have only 85 keys, spanning seven octaves from A0 to A7.", "prediction 1": "Almost every modern piano has 36 black keys and 52 white keys for a total of 88 keys, seven octaves plus a minor third, from A0 to C8. Many older pianos only have 85 keys, seven octaves from A0 to A7.\n", "prediction 2": "Upright pianos, also known as grand pianos, typically have 36 black keys, 52 white keys, and an eight-row. There is also a 10 row organ key with 72 keys, and a regular upright piano with 18 keys, is usually full size.", "prediction 3": "Modern pianos have 88 keys, whereas older pianos only have 85 keys and some have 36 black keys and 52 white keys.", "prediction 4": "Modern upright pianos have 36 black keys and 52 white keys for a total of 88 keys (seven octaves plus a minor third, from A0 to C8). Many older pianos only have 85 keys, which are seven octaves long from A0 to A7.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Almost every modern piano has 36 black keys and 52 white keys for a total of 88 keys, seven octaves plus a minor third, from A0 to C8. Many older pianos only have 85 keys, seven octaves from A0 to A7.\n" }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Earths entire equatorial climate zone is generally a belt around earth that has?", "passages": [ [ "Tropics", "Tropics\n\nThe tropics are the region of the Earth surrounding the Equator.", "They are delimited in latitude by The Tropic of Cancer in the Northern Hemisphere at \u00a0N and the Tropic of Capricorn in\nthe Southern Hemisphere at \u00a0S; these latitudes correspond to the axial tilt of the Earth.", "The tropics are also referred to as the tropical zone and the torrid zone (see geographical zone).", "The tropics include all the areas on the Earth where the Sun contacts the a point directly overhead at least once during the solar year (which is a subsolar point) - thus the latitude of the tropics is roughly equal to the angle of the Earth's axial tilt.", "The tropics are distinguished from the other climatic and biomatic regions of Earth, which are the middle latitudes and the polar regions on either side of the equatorial zone.", "The tropics comprise 40% of the Earth's surface area and contain 36% of the Earth's landmass.", ", the region is home to 40% of the world population, and this figure is projected to reach 50% by the late 2030s.", "\"Tropical\" is sometimes used in a general sense for a tropical climate to mean warm to hot and moist year-round, often with the sense of lush vegetation.", "Many tropical areas have a dry and wet season." ] ], "gold": "Earth's entire equatorial climate zone is generally a belt around the Earth that has several features. It has a feature associated with the Sun, that the Sun contacts a point directly overhead at least once during the solar year. It also has a feature associated with weather, to receive sunlight that is more direct than the rest of Earth, generally hotter and wetter.", "prediction 1": "The equatorial zone is the region of the Earth surrounding the Equator. The tropics include all the areas on the Earth where the Sun contacts the a point directly overhead at least once during the solar year, which is a subsolar point. The equatorial zone is generally a belt around Earth that has a subtropical climate.\n", "prediction 2": "The equatorial climate zone is generally a belt around Earth that has an equatorial zone. The tropics include all the areas on the Earth where the Sun contacts a point directly overhead at least once during the solar year, which is a subsolar point, thus the latitude of the tropics is roughly equal to the angle of the Earth's axial tilt. The tropics comprise 40% of the Earth's surface area and contain 36% of the Earth's landmass.", "prediction 3": "The equatorial climate zone is generally a belt around the Earth that has a tropical climate, characterized by much warmer than average temperatures in the summer and warm, dry, and wet winters. The tropics include all the areas on the Earth where the Sun contacts the a point directly overhead at least once during the solar year, which is a subsol point.", "prediction 4": "The equatorial climate zone is the area of the Earth where the Sun converges with a point directly overhead at least once during the solar year. It is generally referred to as the equatorial belt.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 236, "end": 321 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The equatorial zone is the region of the Earth surrounding the Equator. The tropics include all the areas on the Earth where the Sun contacts the a point directly overhead at least once during the solar year, which is a subsolar point. \"Tropical\" is sometimes used in a general sense for a tropical climate to mean warm to hot and moist year-round." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first male-to-female transsexual surgical transformation take place?", "passages": [ [ "Sex reassignment surgery (male-to-female)", "She transitioned and had surgery in the mid-1970s, and successfully fought to have transgender people recognized in their new sex.", "The first male-to-female surgeries in the United States took place in 1966 at the Johns Hopkins University Medical Center.", "The first physician to perform sex reassignment surgery in the United States was the late Elmer Belt, who did so until the late 1960s.", "In 2017, the United States Defense Health Agency for the first time approved payment for sex reassignment surgery for an active-duty U.S. military service member.", "The patient, an infantry soldier who identifies as a woman, had already begun a course of treatment for gender reassignment.", "The procedure, which the treating doctor deemed medically necessary, was performed on November 14 at a private hospital, since U.S. military hospitals lack the requisite surgical expertise.", "When changing anatomical sex from male to female, the testicles are removed, and the skin of foreskin and penis is usually inverted, as a flap preserving blood and nerve supplies (a technique pioneered by Sir Harold Gillies in 1951), to form a fully sensitive vagina (vaginoplasty).", "A clitoris fully supplied with nerve endings (innervated) can be formed from part of the glans of the penis." ], [ "Sex reassignment surgery (male-to-female)", "Sex reassignment surgery (male-to-female)\n\n", "Sex reassignment surgery for male-to-female involves reshaping the male genitals into a form with the appearance of, and, as far as possible, the function of female genitalia.", "Before any surgery, patients usually undergo hormone replacement therapy (HRT), and, depending on the age at which HRT begins, facial hair removal.", "There are associated surgeries patients may elect to, including facial feminization surgery, breast augmentation, and various other procedures.", "Lili Elbe was the first known recipient of male-to-female sex reassignment surgery, in Germany in 1930.", "She was the subject of four surgeries: one for orchiectomy, one to transplant an ovary, one for penectomy, and one for vaginoplasty and a uterus transplant.", "However, she died three months after her last operation.", "Christine J\u00f8rgensen was likely the most famous recipient of sex reassignment surgery, having her surgery done in Denmark in late 1952 and being outed right afterwards.", "She was a strong advocate for the rights of transgender people.", "Another famous person to undergo male-to-female sex reassignment surgery was Ren\u00e9e Richards." ] ], "gold": "Sex reassignment surgery for male-to-female involves reshaping the male genitals into a form with the appearance of, and as far as possible, the function of female genitalia. Lili Elbe was the first well-known recipient of male-to-female sex reassignment surgery, in Germany in 1930. The first male-to-female surgeries in the United States took place in 1966 at the Johns Hopkins University Medical Center.", "prediction 1": "The first male-to-female transsexual surgical transformation took place in the United States in 1966 at the Johns Hopkins University Medical Center. Sex reassignment surgery for male-to-female involves reshaping the male genitals into a form with the appearance of, and, as far as possible, the function of female genitalia. The first known recipient of male-to-female sex reassignment surgery was Lili Elbe, in Germany, in 1930. Christine Jrgensen was likely the most famous recipient of male-to-female reassignment surgery, having her surgery done in Denmark in late 1952 and being outed right afterwards.", "prediction 2": "The first male-to-female sexual surgical transformations took place in the United States in 1966 at the Johns Hopkins University Medical Center. In the 1960s, the first physician to perform sex reassignment surgery in the United States was the late Elmer Belt, who did so until the late 1960s. In 2017, the United States Defense Health Agency for the first time approved payment for sex reassignment surgery for an active-duty U.S. military service member. The procedure, which the treating doctor deemed medically necessary, was performed on November 14 at a private hospital, since U.S. military hospitals lack the requisite surgical expertise.", "prediction 3": "The first male-to-female sex reassignment surgery, in which the male genitals are reshaped to have the appearance and function of female genitalia, took place in the mid-1970s at the Johns Hopkins University Medical Center in Baltimore, Maryland.", "prediction 4": "The first male-to-female transsexual surgical transformation took place in the United States in 1966 at the Johns Hopkins University Medical Center. The first physician to perform sex reassignment surgery in the United States was the late Elmer Belt, who did so until the late 1960s. The first female-to-male surgeries in the United States took place in 1966 at the Johns Hopkins University Medical Center.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 607 } ], "missing-info": [], "corrected-prediction": "The first male-to-female transsexual surgical transformation took place in the United States in 1966 at the Johns Hopkins University Medical Center. Sex reassignment surgery for male-to-female involves reshaping the male genitals into a form with the appearance of, and, as far as possible, the function of female genitalia. The first known recipient of male-to-female sex reassignment surgery was Lili Elbe, in Germany, in 1930. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who played light in the death note movie?", "passages": [ [ "Death Note (2017 film)", "Death Note (2017 film)\n\nDeath Note is a 2017 American neo-noir supernatural thriller film loosely adapted from the Japanese manga of the same name created by Tsugumi Ohba and Takeshi Obata.", "The film is directed by Adam Wingard and written by Charles Parlapanides, Vlas Parlapanides and Jeremy Slater.", "The film stars Nat Wolff, Lakeith Stanfield, Margaret Qualley, Shea Whigham, Paul Nakauchi, Jason Liles and Willem Dafoe, and follows the story of an introverted Seattle high school student named Light Turner, who finds a mysterious supernatural notebook known as the \"Death Note\" and after being intrigued with it's god-like abilites, eventually decides to trigger a world-wide massacre of criminals and terrorists, in order to change the world into a utopian society without crime, eventually attracting the attention of an enigmatic international detective, known only under the alias of \"L\", who determines himself in finding and apprehending Light.", "The film was released on Netflix on August 25, 2017.", "Upon release, \"Death Note\" received mixed reviews from critics and audiences." ], [ "Death Note (2006 film)", "Death Note (2006 film)\n\nThe two films were directed by Sh\u016bsuke Kaneko, produced by Nippon Television, and distributed by Warner Bros. Pictures Japan.", "The film was licensed by VIZ Pictures, Warner Bros..\n\nA spin-off film directed by Hideo Nakata and titled \"\", was released on February 9, 2008.", "Another sequel, \"\", was released in October 2016.", "Within the Kanto region of Japan, Light Yagami: an intelligent and distinguished yet disaffected Japanese college student stumbles across a mysterious dark-colored notebook, with the words: \"Death Note\" marked on the cover, while returning home from his classes.", "The Death Note's instructions claim that if a person's name is written within while picturing that person's face, he or she will die.", "Light is initially skeptical of the Death Note's authenticity, but after experimenting with it on a convicted criminal, he realizes it is real.", "After experimenting with it on his second victim: an accquitted felon named Takuo Shibuimaru and meeting with the previous owner of the Death Note, a demonic Shinigami named Ryuk, Light seeks to become a literal human deity by passing his judgment on those he deems to be morally impure or impede his plans to change the world." ], [ "Tatsuya Fujiwara", "Tatsuya Fujiwara\n\nBorn in Saitama, Fujiwara has had an interest in acting from a young age.", "In 2013, he married his long-term girlfriend and in summer 2016, they became parents.", "The name and gender of their child is unknown.", "He is famous for acting the part of Shuya Nanahara in Kinji Fukasaku's controversial 2000 film \"Battle Royale\".", "He continues the character as a leader of the in the sequel, \"\".", "He stars as Light Yagami, the leading role in \"Death Note\" and \"\", films based on the manga of the same name.", "He also has a cameo appearance in \"\", an L spin-off movie for the \"Death Note\" series.", "Fujiwara stated during filming that it was difficult to portray a character with such restrained emotions.", "During the filming of \"\", Tatsuya became close friends with Kenichi Matsuyama, who plays L. Matsuyama mentioned that Tatsuya had done a good job.", "In theatrical works, he is known for collaborating with Yukio Ninagawa, one of the most influential directors in Japan.", "He started his career in theatre, before his screen debut, with the title role of \"Shintoku-maru\", the boy who has an obsessive relationship with his step mother." ] ], "gold": "Tatsuya Fujiwara stars as Light Yagami in Death Note, a 2006 Japanese supernatural thriller film based on the manga series of the same title. Fujiwara also stars as Light Yagami in the film's sequels, Death Note: The Last Name and Death Note: Light Up the New World. The first movie in this series, Death Note, briefly played in certain North American theaters in 2008. This theatrical version featured actors from the English dub of the anime voicing over their respective characters with Canadian voice actor Bradley Swaile voicing Light Yagami. Death Note is also a 2017 American supernatural crime thriller film loosely adapted from the Japanese manga of the same name. In this version of Death Note, Nat Wolff stars as Light Turner.", "prediction 1": "Light Yagami is a Japanese college student who stumbles across a mysterious dark-colored notebook, with the words: \"Death Note\" marked on the cover, while returning home from his classes. He is initially skeptical of the Death Note's authenticity, but after experimenting with it on a convicted criminal, he realizes it is real. Kenichi Matsuyama plays Light in the Death Note movie, while Akira Tanaka plays Light in the Death Note sequel.", "prediction 2": "Death Note is a 2017 American neo-noir supernatural thriller film loosely adapted from the Japanese manga Death Note, created by Tsugumi Ohba and Takeshi Obata. In the 2006 film, Light Yagami, Light is played by Tatsuya Fujiwara. In the 2017 film, Light is played by Nat Wolff. In the 2006 film, Light is played by Kenichi Matsuyama. In the 2016 film, Light is played by Jason Liles.", "prediction 3": "Light Yagami is a high school student from Seattle who finds a mysterious notebook known as the Death Note and after being intrigued with it's god-like abilities, decides to trigger a world-wide massacre of criminals and terrorists, in order to change the world into a utopian society without crime. In the 2006 film Death Note, Kenichi Matsuyama plays Light. In the 2017 film Death Note, Nat Wolff plays Light, and In the 2017 sequel, Tatsuya Fujiwara plays Light.", "prediction 4": "Death Note is a 2017 American neo-noir supernatural thriller film loosely adapted from the Japanese manga of the same name created by Tsugumi Ohba and Takeshi Obata. The film follows the story of an introverted Seattle high school student named Light Turner, who finds a mysterious supernatural notebook known as the \"Death Note\" and after being intrigued with it's god-like abilites, eventually decides to trigger a world-wide massacre of criminals and terrorists, eventually attracting the attention of an enigmatic international detective, known only under the alias of \"L\", who determines himself in finding and apprehending Light.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 13, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 328 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 329, "end": 346 }, { "error type": "Unverifiable", "explanation": "", "start": 384, "end": 440 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Light Yagami is a Japanese college student who stumbles across a mysterious dark-colored notebook, with the words: \"Death Note\" marked on the cover, while returning home from his classes. He is initially skeptical of the Death Note's authenticity, but after experimenting with it on a convicted criminal, he realizes it is real. Tatsuya Fujiwara plays Light in the Death Note movie, and in the 2008 spin-off movie. Death Note is a 2017 American neo-noir supernatural thriller film loosely adapted from the Japanese manga of the same name. The film stars Nat Wolff." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sings can you feel the love tonight in the movie the lion king?", "passages": [ [ "Can You Feel the Love Tonight", "Can You Feel the Love Tonight\n\n\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film \"The Lion King\" composed by Elton John with lyrics by Tim Rice.", "It was described by Don Hahn (the film's producer), Roger Allers and Rob Minkoff (the film's directors) as having \"the most diverse history\" in the film.", "It was a chart hit in the UK, peaking at number 14 on the UK Singles Chart, and achieved even more success in the US, reaching number four on the \"Billboard\" Hot 100.", "The song was a number-one hit in Canada and France, and it sold 11 million copies worldwide.", "The song was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella, while another version used in the film's closing credits was performed by Elton John.", "It won the 1994 Academy Award for Best Original Song, and the Golden Globe Award for Best Original Song.", "It also earned Elton John the Grammy Award for Best Male Pop Vocal Performance.", "Within around one and a half months before the film was released in June 1994, John's recording was released throughout radio stations and as a commercial single and entered the \"Billboard\" Hot 100.", "It became the bestselling single." ], [ "Elton John", "Elton John\n\nSir Elton Hercules John (born Reginald Kenneth Dwight, 25 March 1947) is an English singer, pianist, and composer.", "He has worked with lyricist Bernie Taupin as his songwriting partner since 1967; they have collaborated on more than 30 albums.", "John has sold more than 300million records, making him one of the best-selling music artists in the world.", "He has more than fifty Top 40 hits, including seven consecutive number one albums in the U.S., 58 \"Billboard\" Top 40 singles, 27 Top 10, four which reached number two and nine which reached number one.", "His tribute single \"Candle in the Wind 1997\", rewritten in dedication to Diana, Princess of Wales, sold over 33million copies worldwide and is the best-selling single in the history of the UK and U.S. singles charts.", "He has also composed music, produced records, and has occasionally acted in films.", "Raised in the Pinner area of London, John learned to play piano at an early age, and by 1962 had formed Bluesology.", "John met his songwriting partner, Bernie Taupin, in 1967, after they had both answered an advert for songwriters.", "For two years they wrote songs for other artists, including Lulu, and John also worked as a session musician for artists such as the Hollies and the Scaffold." ] ], "gold": "There were several singers of the song Can You Feel the Love Tonight in Disney's 1994 film The Lion King. Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella sang the song in the movie during the film. Elton John sang the song in the movie during the closing credits. Elton John is an English singer, songwriter, pianist, and composer.", "prediction 1": "\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film \"The Lion King\" composed by Elton John with lyrics by Tim Rice. It was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella. Another version used in the film's closing credits was performed by Elton John. John also sang the song in the film's opening credits.", "prediction 2": "\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film \"The Lion King\" composed by Elton John with lyrics by Tim Rice. It was described by Don Hahn (the film's producer), Roger Allers and Rob Minkoff (the film's directors) as having \"the most diverse history\" in the film. The song was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella, while another version used in the closing credits was performed by Elton John.", "prediction 3": "\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film The Lion King, composed by Elton John with lyrics by Tim Rice. The song was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella, while another version used in the film's closing credits was performed by Elton John. The song was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella, while another version used in the film's closing credits was performed by Elton John.", "prediction 4": "\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film \"The Lion King\" composed by Elton John with lyrics by Tim Rice. It was described by Don Hahn (the film's producer), Roger Allers and Rob Minkoff (the film's directors) as having \"the most diverse history\" in the film. Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella performed Can You Feel the Love Tonight in the film, while another version used in the closing credits was performed by Elton John.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 332, "end": 386 } ], "missing-info": [], "corrected-prediction": "\"Can You Feel the Love Tonight\" is a song from Disney's 1994 animated film \"The Lion King\" composed by Elton John with lyrics by Tim Rice. It was performed in the film by Kristle Edwards, Joseph Williams, Sally Dworsky, Nathan Lane, and Ernie Sabella. Another version used in the film's closing credits was performed by Elton John. " }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who is the actor that plays professor lupin?", "passages": [ [ "Harry Potter and the Prisoner of Azkaban", "Sadly, Snape lets slip that Lupin is a werewolf, leading to his resignation.", "Harry visits Lupin before he leaves, and as they say goodbye, Lupin is certain that they will meet again.", "\"Harry Potter and the Prisoner of Azkaban\" is the third book in the \"Harry Potter\" series.", "The first, \"Harry Potter and the Philosopher's Stone\" (\"Harry Potter and the Sorcerer's Stone\" in the US), was published by Bloomsbury on 26 June 1997 and the second, \"Harry Potter and the Chamber of Secrets\", was published on 2 July 1998.", "Rowling started to write the \"Prisoner of Azkaban\" the day after she finished \"The Chamber of Secrets\".", "Rowling's favourite aspect of this book was introducing the character Remus Lupin, Rowling additionally said in 2004 that \"Prisoner of Azkaban\" was \"the best writing experience I ever had...I was in a very comfortable place writing (number) three.", "Immediate financial worries were over, and press attention wasn't yet by any means excessive\"." ], [ "Order of the Phoenix (fictional organisation)", "In the film series, Lupin is portrayed by David Thewlis as an adult, and by James Utechin as a teenager.", "\"Harry Potter\" director David Yates and J. K. Rowling have stated that Remus Lupin is their favourite series character.", "Both Lupin's first name, Remus, and the pseudonym he uses on \"Potterwatch\", Romulus, are a reference to the Roman mythological twin brothers Romulus and Remus, who are said to have had a wolf foster-mother.", "Furthermore, Remus' last name, Lupin, refers to the Latin word \"lupus\", which means wolf.", "Alastor \"Mad-Eye\" Moody is perhaps the most famous Auror in the modern times of the Wizarding World, single-handedly responsible for capturing numerous wizard criminals.", "He is also said never to have killed his quarry, even when permitted to do so, unless he had no other choice.", "Moody's face is badly scarred; he has lost several body parts while fighting Dark wizards, including his left eye, lower left leg, and part of his nose; and he is cautious \u2013 some characters might say paranoid \u2013 in that he refuses to eat or drink anything which he himself did not prepare." ] ], "gold": "Remus John Lupin is a fictional character in the Harry Potter book series written by J. K. Rowling. He first appears in Harry Potter and the Prisoner of Azkaban as the new Defence Against the Dark Arts professor. Lupin remains in the story long after resigning from this post as a friend to the central character, Harry Potter. In the films, he is portrayed by David Thewlis as an adult, and James Utechin as a teenager.", "prediction 1": "In the Harry Potter film series, Lupin is portrayed by David Thewlis as an adult, and by James Utechin as a teenager. J. K. Rowling and David Yates have stated that Remus Lupin is their favourite series character. In the Harry Potter television series, Lupin is portrayed by John Hurt as a teenager. James Utechin is the actor that plays Professor Lupin.", "prediction 2": "Harry Potter and the Prisoner of Azkaban is the third book in the Harry Potter series. In the book, Lupin is played by Samuel L. Jackson as an adult and by David Thewlis as an adult. In the film, Lupin is portrayed by James Utechin as a teenager.", "prediction 3": "In the Harry Potter film series, Professor Lupin is portrayed by David Thewlis as an adult, and by James Utechin as a teenager. David Thewlis plays the character of Remus Lupin in the adult film, Harry Potter and the Prisoner of Azkaban.", "prediction 4": "Remus Lupin is a professor in the Harry Potter series. In the Harry Potter film series, Lupin is portrayed by David Thewlis as an adult, and by James Utechin as a teen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 213 }, { "error type": "Unverifiable", "explanation": "", "start": 214, "end": 299 }, { "error type": "Redundant", "explanation": " and by James Utechin as a teenager.", "start": 300, "end": 354 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "In the Harry Potter film series, Lupin is portrayed by David Thewlis as an adult, and by James Utechin as a teenager. He was introduced in the Prisoner of Azkaban." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the traitor during the revolutionary war?", "passages": [ [ "Charles Lee (general)", "Charles Lee (general)\n\nCharles Lee (\u00a0\u2013 2 October 1782) served as a general of the Continental Army during the American War of Independence.", "He also served earlier in the British Army during the Seven Years War.", "He sold his commission after the Seven Years War and served for a time in the Polish army of King Stanislaus II.", "Lee moved to North America in 1773 and bought an estate in Virginia.", "When the fighting broke out in the American War of Independence in 1775, he volunteered to serve with rebel forces.", "Lee's ambitions to become Commander in Chief of the Continental Army were thwarted by the appointment of George Washington to that post.", "During 1776, forces under his command repulsed a British attempt to capture Charleston, which boosted his standing with the army and Congress.", "Later that year, he was captured by British cavalry under Banastre Tarleton; he was held by the British as a prisoner until exchanged in 1778.", "During the Battle of Monmouth later that year, Lee led an assault on the British that miscarried.", "He was subsequently court-martialed and his military service brought to an end.", "He died in Philadelphia in 1782.", "Lee was born on in Darnhall, Cheshire, England, the son of Major General John Lee and his wife Isabella Bunbury (daughter of Sir Henry Bunbury, 3rd Baronet)." ], [ "Benedict Arnold", "Benedict Arnold\n\nBenedict Arnold (June 14, 1801) was an American military officer who served as a general during the American Revolutionary War, fighting for the American Continental Army before defecting to the British in 1780.", "George Washington had given him his fullest trust and placed him in command of the fortifications at West Point, New York.", "Arnold planned to surrender the fort to British forces, but the plot was discovered in September 1780 and he fled to the British.", "His name quickly became a byword in the United States for treason and betrayal because he led the British army in battle against the very men whom he had once commanded.", "Arnold was born in the Connecticut Colony and was a merchant operating ships on the Atlantic Ocean when the war began in 1775.", "He joined the growing army outside Boston and distinguished himself through acts of intelligence and bravery.", "His actions included the Capture of Fort Ticonderoga in 1775, defensive and delaying tactics at the Battle of Valcour Island on Lake Champlain in 1776 which allowed American forces time to prepare New York's defenses, the Battle of Ridgefield, Connecticut (after which he was promoted to major general), operations in relief of the Siege of Fort Stanwix, and key actions during the pivotal Battles of Saratoga in 1777, in which he suffered leg injuries that halted his combat career for several years." ], [ "Charles Lee (general)", "as he rode off, which Martin found unusual but plausible since Washington had been \"in a great passion\" because of the retreat.", "It is not clear that Lee had made a bad strategic decision; he believed himself outnumbered, which in fact he was \u2013 British commander Sir Henry Clinton had 10,000 troops to Lee's 5,440 \u2013 and believed that a retreat was reasonable.", "But he disobeyed orders, and he publicly expressed disrespect to his commander in chief.", "Washington had wanted to test the abilities of Lee's troops, since they were among the first to be trained in European tactics by Baron von Steuben.", "Some historians have suggested that Lee may have retreated at the Battle of Monmouth as part of a plan to aid the British.", "While Lee was being held prisoner by British General Sir William Howe, 5th Viscount Howe in March 1777, he drafted a plan for British military operations against the Americans.", "At the time, Lee was under a threat of being tried as a deserter from the British Army because he hadn't resigned his British commission as lieutenant-colonel until several days after he accepted an American commission.", "The plan in Lee's handwriting was found in the Howe family archives in 1857.", "Lee tried to get Congress to overturn the court-martial's verdict.", "When this failed, he made open attacks on Washington's character." ] ], "gold": "There were several traitors during the Revolutionary War, two of them being Charles Lee and Benedict Arnold. Charles Lee was considered a traitor for letting the British escape, and he was suspended from the army for a year. Benedict Arnold, whose name became synonymous with \"traitor,\" was considered a traitor by defecting to the British.", "prediction 1": "Charles Lee served as a general of the Continental Army during the American War of Independence. He also served earlier in the British Army during the Seven Years War. His name quickly became a byword in the United States for treason and betrayal because he led the British army in battle against the very men whom he had once commanded. Benedict Arnold, an American military officer who served as a general during the American Revolutionary War, fighting for the American Continental Army before defecting to the British in 1780. His actions included the Capture of Fort Ticonderoga in 1775.", "prediction 2": "Charles Lee was a general of the Continental Army during the American War of Independence. He also served earlier in the British Army during the Seven Years War. He sold his commission after the Seven Years War and served for a time in the Polish army of King Stanislaus II. Benedict Arnold was an American military officer who served as a general during the American Revolutionary War, fighting for the American Continental Army before defecting to the British in 1780. His name quickly became a byword in the United States for treason and betrayal because he led the British army in battle against the very men whom he had once commanded.", "prediction 3": "Charles Lee served as a general of the Continental Army during the American War of Independence and served previously in the British Army during the Seven Years War. He also sold his commission after the Seven Years War and served for a time in the Polish army of King Stanislaus II. His name quickly became a byword in the United States for treason and betrayal because he led the British army in battle against the very men whom he had once commanded. Benedict Arnold, an American military officer who served as a general, fled to the British in 1780. His name quickly became a byword in the United States for trea byword in the United States for trea byword for a byword in the United States for trea byword.", "prediction 4": "Charles Lee was a general of the Continental Army during the American War of Independence. He served earlier in the British Army during the Seven Years War. Benedict Arnold was an American military officer who served as a general during the American Revolutionary War, fighting for the American Continental Army before defecting to the British in 1780. His name quickly became a byword in the United States for treason and betrayal because he led the British army in battle against the very men whom he had once commanded.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 167 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 168, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 355, "end": 489 }, { "error type": "Irrelevant", "explanation": "", "start": 531, "end": 592 }, { "error type": "Irrelevant", "explanation": "", "start": 12, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 337 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Charles Lee, while imprisoned, drafted a plan for British military operations against the Americans. Benedict Arnold's name quickly became a byword in the United States for treason and betrayal. He defected to the British in 1780. " }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "A newborn infant during the first weeks following birth is called a(n)?", "passages": [ [ "Infant", "Infant\n\nAn infant (from the Latin word \"infans\", meaning \"unable to speak\" or \"speechless\") is the more formal or specialised synonym for \"baby\", the very young offspring of a human.", "The term may also be used to refer to juveniles of other organisms.", "A newborn is, in colloquial use, an infant who is only hours, days, or up to one month old.", "In medical contexts, newborn or neonate (from Latin, \"neonatus\", newborn) refers to an infant in the first 28 days after birth; the term applies to premature, full term, and postmature infants; before birth, the term \"fetus\" is used.", "The term \"infant\" is typically applied to young children under one year of age; however, definitions may vary and may include children up to two years of age.", "When a human child learns to walk, the term \"toddler\" may be used instead.", "In British English, an infant school is for children aged between four and seven.", "As a legal term, \"infancy\" continues from birth until age 18.", "A newborn's shoulders and hips are wide, the abdomen protrudes slightly, and the arms and legs are relatively long with respect to the rest of their body." ] ], "gold": "A newborn is, in colloquial use, an infant who is only hours, days, or up to one month old. In medical contexts, newborn or neonate, refers to an infant in the first 28 days after birth.", "prediction 1": "In medical contexts, newborn or neonate refers to an infant in the first 28 days after birth; the term applies to premature, full term, and postmature infants. Before birth, the term \"fetus\" is used. The term \"infant\" is typically applied to young children under one year of age; however, definitions may vary and may include children up to two years of age.", "prediction 2": "In medical contexts, newborn or neonate refers to an infant in the first 28 days after birth. The term applies to premature, full term, and postmature infants. Before birth, the term \"fetus\" is used.", "prediction 3": "In medical contexts, newborn or neonate refers to an infant in the first 28 days after birth. The term applies to premature, full term, and postmature infants; before birth, the term \"fetus\" is used.", "prediction 4": "An infant is, in colloquial use, an infant who is only hours, days, or up to one month old, and is a very young offspring of a human. In medical contexts, newborn or neonate refers to an infant in the first 28 days after birth; the term applies to premature, full term, and postmature infants.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 358 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A newborn is, in colloquial use, an infant who is only hours, days, or up to one month old. In medical contexts, newborn or neonate refers to an infant in the first 28 days after birth." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "When did twenty one pilots start the hiatus?", "passages": [ [ "Twenty One Pilots", "The duo performed at several small venues they first played as a local band including The Basement, Newport Music Hall, and Express Live!, before ending their tour cycle with arena shows at Nationwide Arena and Value City Arena.", "In an interview with \"Alternative Press\" in November 2016, Twenty One Pilots stated that after their last show, they will be \"going dark\" to focus on new music.", "Joseph stated that he would like to focus on lyrical content of the music, and bring the music back to the \"authenticity, lyrics, delivery, and fearlessness of songwriting\" similar to that of the self-titled album.", "The band's last activity came in July 2017 in the form of posts on social media depicting an eye closing over lyrics from several of their songs.", "In March 2018, their song \"Hometown\" received a Gold certification from the RIAA, making \"Blurryface\" the first full-length album to have every track achieve at least gold status.", "In April 2018, a cryptic message was uncovered on the band's web store, which revealed a website.", "Fans began using the clues and found other sections of this site, hinting at the possibility of the band's return.", "There were multiple images uploaded to the website, including letters from a character named \"Clancy\"." ], [ "Twenty One Pilots", "In July 2018, Twenty One Pilots broke their year-long silence, first sending a cryptic email to fans and later posting a video to all social media platforms and updating their logo and branding.", "Tyler Joseph made his first media appearance in over a year for an interview with Zane Lowe of Beats 1 from his own home studio in Columbus, Ohio, in which he spoke about the band's year long hiatus, creating the new album, and battling against personal demons and insecurities.", "On July 11, 2018, the band released two new songs, \"Jumpsuit\" and \"Nico and the Niners\", as well as the music video for \"Jumpsuit\".", "They also made the announcement of their fifth studio album, \"Trench\", scheduled to be released on October 5, 2018, and a new world tour, titled \"The Bandito Tour\", starting October 16.", "Later, on July 26, 2018, the music video for \"Nico and the Niners\" was released.", "The song \"Levitate\" was subsequently released as the album's third single via Zane Lowe's Beats 1 show as the day's \"World Record\".", "The music video was also released, concluding the trilogy series." ] ], "gold": "Twenty One Pilots announced their hiatus in November 2016 during an interview with Alternative Press, stating that they will be \"going dark\" to focus on new music. The official beginning of the hiatus was in July 2017, when the band published posts on social media depicting an eye closing over lyrics from several of their songs. In July 2018, the band broke their year-long silence, first send a cryptic email to fans and later posting a video to all social media platforms and updating their logo and branding.", "prediction 1": "Twenty One Pilots started a yearlong hiatus on July 1, 2017 and officially began a new hiatus on July 3, 2018.", "prediction 2": "Twenty One Pilots started a year-long hiatus on August 1, 2017. The band's last activity came in July 2017 in the form of posts on social media depicting an eye closing over lyrics from several of their songs. In July 2018, the band broke their year-long silence, first sending a cryptic email to fans and later posting a video to all social media platforms and updating their logo and branding.", "prediction 3": "Twenty One Pilots started the hiatus in July 2018. The band first sent cryptic messages to fans in April 2018 and posted a video to all social media platforms in July 2018. During the hiatus, the band also made the announcement of their fifth studio album Trench, scheduled to be released on October 5, 2018.", "prediction 4": "Twenty One Pilots started their year-long hiatus on June 13, 2017 and ended it on July 11, 2018. On July 26, 2018, the band released their music video for \"Nico and the Niners\", and on July 11, 2018, they sent a cryptic email to fans and then posted a video to all social media platforms and updated their logo and branding. In November 2016, Twenty One Pilots stated that after their last show, they will be \"going dark\" to focus on new music.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 64, "end": 104 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "In an interview with \"Alternative Press\" in November 2016, Twenty One Pilots stated that after their last show, they will be \"going dark\" to focus on new music. Twenty One Pilots started a yearlong hiatus on July 1, 2017 with posts on social media depicting an eye closing over lyrics from several of their songs. They broke their year-long silence, first sending a cryptic email to fans and later posting a video to all social media platforms and updating their logo and branding, in July 2018." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who is the pig voice in toy story?", "passages": [ [ "John Ratzenberger", "John Ratzenberger\n\nJohn Dezso Ratzenberger (born April 6, 1947) is an American actor, voice actor, and entrepreneur.", "He played Cliff Clavin in the TV show \"Cheers\", for which he earned two Emmy nominations, and plays voice roles in Pixar Animation Studios' films, including Hamm in the \"Toy Story\" franchise, The Underminer in \"The Incredibles\" franchise, and Mack in the \"Cars\" franchise.", "He is the only actor to appear in all of Pixar's feature films, and with minor appearances in major films such as \"Superman\" and \"The Empire Strikes Back\", he is one of the most successful actors of all time in terms of box-office receipts.", "Born in Bridgeport, Connecticut, Ratzenberger began his entertainment career while living in London in the 1970s.", "He had minor film and television roles throughout the late 70s and early 1980s before creating, and then landing, the role of the know-it-all mailman Cliff Clavin on \"Cheers\" (1982\u20131993), a role he portrayed throughout the show's eleven seasons.", "His first Pixar role was the voice of Hamm the Piggy Bank in \"Toy Story\" (1995) and has voiced Pixar characters in films and video games ever since." ], [ "Toy Story (franchise)", "The series takes place in the far future.", "It features Buzz Lightyear (voiced by Patrick Warburton), a famous, experienced Space Ranger who takes a crew of rookies under his wing as he investigates criminal activity across the galaxy and attempts to bring down Evil Emperor Zurg once and for all.", "It aired on ABC from October 2, 2000 to January 13, 2001.", "Buzz Lightyear of Star Command: The Adventure Begins is a spin-off animated direct-to-video film, partially based on \"Toy Story\".", "The film was released on August 8, 2000.", "It acts as a pilot to the television series \"Buzz Lightyear of Star Command\" and features Tim Allen as the voice of Buzz Lightyear, who is voiced by Patrick Warburton in the main series.", "In this film, Buzz Lightyear is a space ranger who fights against the evil Emperor Zurg, showing the inspiration for the Buzz Lightyear toyline that exists in the \"Toy Story\" series.", "Although the film was criticized for not using the same animation as in \"Toy Story\" and \"Toy Story 2\", it sold three million VHS and DVDs in its first week of release.", "Pixar created original animations for the games, including fully animated sequences for PC titles." ] ], "gold": "Hamm, the piggy bank character in the Toy Story movies is voiced by John Ratzenberger in all four movies in the series. Hamm briefly appears in Buzz Lightyear of Star Command: The Adventure Begins, where he is voiced by Andrew Stanton.", "prediction 1": "In Toy Story, the pig is voiced by John Ratzenberger. In the Toy Story 2 film, the pig is voiced by Christopher Nolan. In the Toy Story 3 film, the pig is voiced by David Fincher.", "prediction 2": "The pig in Toy Story is voiced by a variety of people, including Tom Hanks, the original Toy Story, and Jermaine Dupri. In the Toy Story franchise, the pig is voiced by John Ratzenberger. Ratzenberger also played Cliff Clavin in the TV show Cheers and has voiced Pixar characters in films, video games and commercials since 1995.", "prediction 3": "There are three pigs in Toy Story. Hamm is voiced by John Ratzenberger, the actor, voice actor, and entrepreneur. The pig is also the voice of the pig in the Toy Story 2 video game. The pig in Toy Story 1 is voiced by Tim Allen. The pig in Toy Story 2 is voiced by Patrick Warburton.", "prediction 4": "In Toy Story, the pig is voiced by John Dezso Ratzenberger, who also voices the character in the original film. In the 1995 film, the voice of the pig in Toy Story was Tim Allen, while the pig in the 1995 film was John Ratzenberger.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 54, "end": 118 }, { "error type": "Unverifiable", "explanation": "", "start": 119, "end": 179 } ], "missing-info": [], "corrected-prediction": "In Toy Story, the pig is voiced by John Ratzenberger." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does the next season of anne with an e start on netflix?", "passages": [ [ "Anne with an E", "The series initially premiered on March 19, 2017, on CBC and aired on a weekly basis, the season finale airing on April 30, 2017.", "The series debuted on Netflix on May 12, 2017, under the title \"Anne With An E\".", "The second and later seasons were retitled to match Netflix's title by the CBC which had initially used the title \"Anne\".", "The CBC premier for Season 2 was in late September, after it had been streaming on Netflix for some time.", "The first season has achieved a rating of 85% on Rotten Tomatoes based on 27 reviews for an average rating of 7.78/10 the site's critical consensus stating: \"\"Anne with an E\" uses its complex central character to offer a boldly stylish, emotionally resonant spin on classic source material that satisfies in its own right.\"", "The series has received a rating of 79 on Metacritic based on fifteen reviews, indicating \"generally favorable reviews\".", "Emily Ashby, writing for Common Sense Media, calls the series an \"exceptional\" and \"spectacular\" interpretation, giving it four out of five stars.", "Tasha Cerny, contributor for the Tracking Board, praises the cinematography as lush and colourful, the characters vibrant, and the plot \"surprisingly thrilling for a story about a young girl living in a small secluded community in the late nineteenth century." ], [ "Anne with an E", "Anne with an E\n\nAnne with an E is a Canadian drama television series based on the 1908 novel \"Anne of Green Gables\" by Lucy Maud Montgomery, and adapted by Emmy Award-winning writer and producer Moira Walley-Beckett.", "It airs on CBC Television in Canada, and elsewhere in the world it is available for streaming on Netflix.", "The first season consists of seven episodes, with Niki Caro directing the 90-minute season premiere.", "The series premiered on March 19, 2017, on CBC, the first season finale airing on April 30, 2017.", "The first season was titled simply Anne in Canada, while Netflix used \"Anne with an E\".", "CBC adopted the \"Anne with an E\" name beginning in the second season.", "On August 3, 2017, both CBC and Netflix renewed the series for a 10-episode second season, which began production in November 2017.", "Season 2 premiered on Netflix on July 6, 2018, and on CBC on September 23, 2018.", "In August 2018, CBC and Netflix renewed the series for a 10-episode third season to premiere in 2019.", "In the late 19th century, brother and sister Matthew and Marilla Cuthbert, both in their old age, decide to take on an orphan boy to help out around their ancestral farm of Green Gables, on the outskirts of the town of Avonlea, on Prince Edward Island." ] ], "gold": "Anne with an E, initially titled Anne for its first season within Canada, is a Canadian television series that premiered on March 19, 2017 on CBC and on May 12, 2017 on Netflix. Anne with an E's second season premiered on Nextflix on July 6, 2018. Anne with an E's third season premiered on Nextlfix on January 3, 2020. CBC and Netflix announced that the third season of Anne with an E will be the series' final season. ", "prediction 1": "The Canadian television series Anne with an E originally started airing on CBC Television in Canada on March 19, 2017. After that the series debuted on Netflix on May 12, 2017, under the title \"Anne With An E\". The second and later seasons were retitled to match Netflix's title by the CBC which had initially used the title \"Anne\". The CBC premier for Season 2 was in late September, after it had been streaming on Netflix for some time.", "prediction 2": "The Canadian drama television series Anne with an E is based on the 1908 novel Anne of Green Gables by Lucy Maud Montgomery. It airs on CBC Television in Canada, and elsewhere in the world it is available for streaming on Netflix. Season 1 of Anne with an E started on Netflix on May 5, 2017. Season 2 started on Netflix on July 6, 2018, and on CBC on September 23, 2018. Season 3 started on Netflix on May 5, 2020.", "prediction 3": "The Canadian television series Anne with an E premiered on CBC Television on March 19, 2017, and on Netflix on May 12, 2017. Season 2 premiered on Netflix on July 6, 2018, and on CBC on September 23, 2018. Season 3 premiered on Netflix on May 7, 2019.", "prediction 4": "Anne with an E is a Canadian drama television series based on the 1908 novel Anne of Green Gables by Lucy Maud Montgomery and adapted by Emmy Award-winning writer and producer Moira Walley-Beckett. It airs on CBC Television in Canada, and elsewhere in the world it is available for streaming on Netflix. Season 2 premiered on Netflix on July 6, 2018, and on CBC on September 23, 2018. Season 3 started on Netflix on April 12, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 332 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Canadian television series Anne with an E originally started airing on CBC Television in Canada on March 19, 2017. After that the series debuted on Netflix on May 12, 2017, under the title \"Anne With An E\". The CBC premier for Season 2 was September 23, 2018, after it had been streaming on Netflix since July 6, 2018. The third season is to premiere in 2019." }, "preference": [ 1, 1, 0, 0, 0, 0 ] }, { "question": "When do the new data protection laws come into effect?", "passages": [ [ "General Data Protection Regulation", "Businesses must report any data breaches within 72 hours if they have an adverse effect on user privacy.", "In some cases, violators of the GDPR may be fined up to \u20ac20 million or up to 4% of the annual worldwide turnover of the preceding financial year in case of an enterprise, whichever is greater.", "The GDPR was adopted on 14 April 2016, and became enforceable beginning 25 May 2018.", "As the GDPR is a regulation, not a directive, it is directly binding and applicable.", "In November 2018, Google was accused of GDPR privacy violations by 7 countries.", "The GDPR consists of 99 \"articles\", grouped into 11 chapters, and an additional 171 \"recitals\" with explanatory remarks.", "The chapters' headings are:\n\n", "The regulation applies if the data controller (an organisation that collects data from EU residents), or processor (an organisation that processes data on behalf of a data controller like cloud service providers), or the data subject (person) is based in the EU.", "Under certain circumstances, the regulation also applies to organisations based outside the EU if they collect or process personal data of individuals located inside the EU.", "The regulation does not apply to the processing of data by a person for a \"purely personal or household activity and thus with no connection to a professional or commercial activity.\"" ], [ "General Data Protection Regulation", "The proposed ePrivacy Regulation was also planned to be applicable from 25 May 2018, but will be delayed for several months.", "The eIDAS Regulation is also part of the strategy.", "With the United Kingdom scheduled to leave the European Union in 2019, the UK granted royal assent to the \"Data Protection Act 2018\" on 23 May 2018, which contains equivalent regulations and protections.", "If the UK leaves the EU, it will become a \"third country\" for the purposes of the transfer of personal data outside the EU.", "This may require an \"adequacy decision\" by the European Commission on the suitability of the UK's data protection framework, or other appropriate safeguards that may allow such transfers to take place.", "(Chapter V).", "It is currently (August 2018) the UK Government's view that a 'legally-binding data protection agreement' between the EU and the UK would be more appropriate than an 'adequacy finding'.", "Such an agreement would include the UK Information Commissioner taking part in the 'one stop shop' mechanism and having a seat on the European Data Protection Board." ], [ "Information privacy law", "The California Online Privacy Protection Act (OPPA) of 2003 requires operators of commercial web sites or online services that collect personal information on California residents through a web site to conspicuously post a privacy policy on the site and to comply with its policy.", "The safe harbor arrangement was developed by the United States Department of Commerce in order to provide a means for U.S. companies to demonstrate compliance with European Commission directives and thus to simplify relations between them and European businesses.", "Recently, lawmakers in several states have proposed legislations to change the way online businesses handle user information.", "Among those generating significant attention are several Do Not Track legislations and the Right to Know Act (California Bill AB 1291).", "The California Right to Know Act, if passed, would require every business which keeps user information to provide its user a copy of stored information when requested.", "The bill faced heavy oppositions from trade groups representing companies such as Google, Microsoft, and Facebook, and failed to pass.", "On June 28, 2018 California legislature passed AB 375, the California Consumer Privacy Act of 2018, effective January 1, 2020.", "If the law is not amended before it becomes effective, The California Consumer Privacy Act, AB. 375 \u2014 gives California residents an array of new rights, starting with the right to be informed about what kinds of personal data companies have collected and why it was collected." ] ], "gold": "The Swiss Federal Data Protection Act (DPA) and the Swiss Federal Data Protection Ordinance (DPO) entered into force on July 1, 1993 and was amended on January 1, 2008.The General Data Protection Regulation was adopted in the EU on 14 April 2016, and became enforceable beginning 25 May 2018. The UK granted royal assent to the \"Data Protection Act 2018\" on 23 May 2018. The California legislature passed the California Consumer Privacy Act of 2018 which became effective January 1, 2020.", "prediction 1": "The new data protection laws came into effect in the EU on 25 May 2018, in the UK on 23 May 2018, and in the United States on 28 June 2018.", "prediction 2": "The new data protection laws in the EU come into effect on 25 May 2018. The GDPR was adopted on 14 April 2016, and became enforceable beginning 25 May 2018. The proposed ePrivacy Regulation was also planned to be applicable from 25 May 2018, but will be delayed for several months.", "prediction 3": "The new data protection laws in the European Union came into effect on 25 May 2018 and were based on the General Data Protection Regulation, which was adopted on 14 April 2016, and became enforceable beginning 25 May 2018. The data protection laws in the United States came into effect on 25 May 2018 and the California Consumer Privacy Act came into effect on January 1, 2020.", "prediction 4": "The General Data Protection Regulation (GDPR) was adopted on 14 April 2016, and became enforceable beginning 25 May 2018. As the GDPR is a regulation, not a directive, it is directly binding and applicable. With the United Kingdom scheduled to leave the European Union in 2019, the UK granted royal assent to the Data Protection Act 2018 on 23 May 2018.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The new data protection laws or General Data Protection Regulation was adopted on 14 April 2016, and came into effect in the EU on 25 May 2018. The UK granted royal assent to the \"Data Protection Act 2018\" on 23 May 2018. In the United States on 28 June 2018, California legislature passed the California Consumer Privacy Act of 2018, which became effective January 1, 2020." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Where was the 1960's tarzan tv series filmed?", "passages": [ [ "Tarzan (1966 TV series)", "Tarzan (1966 TV series)\n\nTarzan is a series that aired on NBC from 1966 to 1968.", "The series portrayed Tarzan (played by Ron Ely) as a well-educated character who had grown tired of civilization, and returned to the jungle where he had been raised.", "It was filmed in Brazil.", "The production later relocated to Mexico.", "This series was set in the newly independent Africa of the time.", "This series retained many of the trappings of the film series, included the \"Tarzan yell\" and Cheeta, but excluded Jane as part of the \"new look\" for the fabled apeman that executive producer Sy Weintraub had introduced in previous motion pictures starring Gordon Scott, Jock Mahoney, and Mike Henry.", "CBS aired repeat episodes of the program during the summer of 1969.", "Maurice Evans had a recurring guest-starring role as retired Brigadier Sir Basil Bertram, hero of the Battle of the Bulge.", "Julie Harris had a recurring guest-role as missionary Charity Jones.", "Chips Rafferty had a recurring guest-starring role as Dutch Jensen.", "On March 13, 2012, Warner Bros. released \"Tarzan: Season 1, Part 1 & Tarzan: Season 1, Part 2\" on DVD in region 1 via their Warner Archive Collection manufacture-on-demand service.", "The second season was released on September 17, 2013." ] ], "gold": "Tarzan is a television series that aired on NBC from 1966 to 1968. The series portrayed Tarzan, played by Ron Ely, as a well-educated character who had grown tired of civilization, and returned to the jungle where he had been raised. It was set in one of the newly indpendent African countries of the time. It was initially filmed in Brazil, but the production later relocated to Mexico. ", "prediction 1": "Tarzan is a series that aired on NBC from 1966 to 1968. The series portrayed Tarzan as a well-educated character who had grown tired of civilization, and returned to the jungle where he had been raised. It was filmed in Brazil. The production later relocated to Mexico. This series was set in the newly independent Africa of the time.\n", "prediction 2": "The 1960's Tarzan TV series was filmed mostly in Brazil, while the 1969 series was filmed in Mexico, which is north of present-day Mexico and sits within the Brazilian state of Bahia.", "prediction 3": "Tarzan is a series that aired on NBC from 1966 to 1968. The series portrayed Tarzan as a well-educated character who had grown tired of civilization, and returned to the jungle where he had been raised. The series was filmed in Brazil. The production later relocated to Mexico. This series was set in the newly independent Africa of the time.", "prediction 4": "Tarzan is a series that aired on NBC from 1966 to 1968. The series portrayed Tarzan as a well-educated character, who had grown tired of civilization, and returned to the jungle where he had been raised. It was filmed in Brazil. The production later relocated to Mexico. This series was set in the newly independent Africa of the time. This series retained many of the trappings of the film series, including the \"Tarzan yell\" and Cheeta, but excluded Jane as part of the \"new look\" for the fable fable apeman that executive producer Sy Weintraub had introduced in previous motion pictures starring Gordon Scott, Jock Mahoney, and Mike Henry.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Tarzan is a series that aired on NBC from 1966 to 1968. The series portrayed Tarzan as a well-educated character who had grown tired of civilization, and returned to the jungle where he had been raised. It was filmed in Brazil. The production later relocated to Mexico. This series was set in the newly independent Africa of the time.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is the man who tortures theon greyjoy?", "passages": [ [ "Ramsay Bolton", "Ramsay Bolton\n\nRamsay Bolton, formerly known as Ramsay Snow and also as Bastard of Bolton or Bastard of the Dreadfort, is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation \"Game of Thrones\".", "Introduced in 1998's \"A Clash of Kings\", Ramsay is the eldest son of Roose Bolton, the lord of the Dreadfort, an ancient fortress in the North of the kingdom of Westeros.", "He is subsequently mentioned in \"A Storm of Swords\" (2000) and \"A Feast for Crows\" (2005).", "He later appears in Martin's \"A Dance with Dragons\" (2011).", "Ramsay is portrayed by Welsh actor Iwan Rheon in the HBO television adaptation.", "Ramsay Snow is the bastard son of Lord Roose Bolton of Dreadfort, and is conceived out of Roose murdering a miller and raping the victim's wife.", "A year later the woman arrived at the Dreadfort with the newborn Ramsay, and Roose gave the woman the mill along with a pig, several chicks and a bag of silver coin every year on the condition that she never reveal to Ramsay the truth of his parentage." ], [ "Theon Greyjoy", "Theon is subsequently brutally tortured, flayed and castrated by Ramsay, who forces him to rename himself Reek, and beats him until he submits to his new name.", "Theon's penis is sent in a box to his father, with Ramsay threatening to mutilate Theon further unless the Ironmen retreat from the North.", "Balon refuses, as Theon defied him and is now unable to further the Greyjoy line.", "Outraged, Yara responds that she intends to save her brother on her own accord.", "Theon Greyjoy remains a prisoner, locked in the cages of the dogs under Ramsay's watch.", "Theon, now adopting and living under the name Reek that Ramsay gave to him, is a broken man living in this squalor.", "Yara Greyjoy, his sister comes to his rescue, but the torture he has endured has begun to take his mind and he thoroughly believes he is Reek.", "He refuses to go with her, and in a fight with Ramsay, Yara is beaten and leaves without her brother.", "Ramsay rewards his prisoner with a bath and soft words.", "Easing the body of the tortured Theon into the bath, he asks him to do a job, to play a role.", "Ramsay tells Reek to assume the name of Theon Greyjoy, and help him fight." ] ], "gold": "Ramsay Bolton, previously known as Ramsay Snow, is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation \"Game of Thrones\". He is directly responsible for several atrocities in both the novels and television show, including the brutal torture of Theon Greyjoy; however, his role as a primary antagonist is greatly expanded in the television adaptation. Ramsay is portrayed by Welsh actor Iwan Rheon in the HBO television adaptation.", "prediction 1": "Ramsay Bolton, formerly known as Ramsay Snow and also as Bastard of Bolton or Bastard of the Dreadfort, is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Ramsay is the bastard son of Lord Roose Bolton of Dreadfort. He tortures Theon Greyjoy until he submits to his new name.", "prediction 2": "Ramsay Bolton is the eldest son of Roose Bolton, the lord of the Dreadfort, and the man who tortures Theon Greyjoy. Ramsay forces Theon to rename himself Reek, and beats him until he submits to his new name. After being tortured, Theon is rescued by Yara Greyjoy, his sister, but his mind has been altered, and he no longer believes he is Reek.", "prediction 3": "Theon Greyjoy is the protagonist of the Game of Thrones series of fantasy novels. Theon Greyjoy is tortured by Ramsay Bolton. Ramsay forces theon to rename himself Reek, beating him until he submits to his new name. Ramsay also forces theon to resign himself as a dwarves and castrate him.", "prediction 4": "Ramsay Bolton is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin and its television adaptation Game of Thrones. He is the eldest son of Lord Roose Bolton of Dreadfort, and is conceived out of Roose murdering a miller and raping the victim's wife. Ramsay forces Theon to rename himself Reek, and beats him until he submits to his new name.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 271, "end": 331 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 391 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Ramsay Bolton, formerly known as Ramsay Snow, is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. He tortures Theon Greyjoy. Ramsay is portrayed by Welsh actor Iwan Rheon in the HBO television adaptation." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did pittsburgh win the stanley cup last?", "passages": [ [ "Pittsburgh Penguins", "Pittsburgh Penguins\n\nThe Pittsburgh Penguins are a professional ice hockey team based in Pittsburgh, Pennsylvania.", "They are members of the Metropolitan Division of the Eastern Conference of the National Hockey League (NHL).", "The Penguins are one of two NHL franchises in Pennsylvania; the other being the Philadelphia Flyers.", "The cities' proximity has led to a rivalry known as the \"Battle of Pennsylvania\".", "The club is owned by Mario Lemieux and Ronald Burkle, who purchased the Penguins in 1999 and brought the club out of bankruptcy.", "The franchise was founded in 1967 as one of the first expansion teams during the league's original expansion from six to twelve teams.", "The Penguins played in the Civic Arena, also known as The Igloo, from the time of their inception through the end of the 2009\u201310 season, when they moved to the PPG Paints Arena.", "The 1992\u201393 Penguins won the franchise's first-ever Presidents' Trophy for being the team with the most points at the end of the regular season.", "In addition to their eight division titles, they have qualified for six Stanley Cup Finals, winning the Stanley Cup five times \u2013 in 1991, 1992, 2009, 2016, and 2017.", "Along with the Edmonton Oilers, the Penguins are tied for the most Cup championships among non-Original Six teams and sixth overall." ], [ "2017 Stanley Cup Finals", "2017 Stanley Cup Finals\n\nThe 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs.", "The Eastern Conference champion and defending Stanley Cup champion Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two.", "Penguins captain Sidney Crosby was awarded the Conn Smythe Trophy as the most valuable player of the playoffs for the second consecutive year.", "The Penguins won the Stanley Cup in their opponent's rink, just like they did the previous four times.", "During the regular season, the Penguins finished second in the league with 111 points, which gave them home ice advantage in the series.", "The series began on May 29 and concluded on June 11.", "The Penguins made their second consecutive Finals appearance, marking the third time in their history they had done this, following their appearances in \u2013 and \u2013.", "This was the first time since 2009, a rematch between the Penguins and Detroit Red Wings, that any team appeared in consecutive Finals.", "The Penguins also became the first team since the Red Wings (in and ) to win the Stanley Cup in consecutive years.", "This marked the second consecutive season in which a Western Conference team made their first appearance in the Finals; the San Jose Sharks made their Finals debut the year prior." ], [ "2016\u201317 NHL season", "2016\u201317 NHL season\n\nThe 2016\u201317 NHL season was the 100th season of operation (99th season of play) of the National Hockey League.", "Thirty teams were competing in an 82-game regular season from October 12, 2016, to April 9, 2017.", "The 2017 Stanley Cup playoffs began on April 12 and concluded on June 11, with the Pittsburgh Penguins winning the Stanley Cup over the Nashville Predators in six games.", "On June 11, the Pittsburgh Penguins became the first team to repeat as Stanley Cup champions since the Detroit Red Wings in 1997\u201398, winning the franchise's fifth Stanley Cup and their third in nine seasons.", "In December 2015 commissioner Gary Bettman informed teams that he projected the salary cap to be at least $74.5 million for the 2016\u201317 season, and that it could increase as much as $3.1 million.", "It was eventually set at $73.1 million.", "On June 22, 2016, NHL Commissioner Gary Bettman officially announced that the league had approved an expansion team in Las Vegas, Nevada, later christened the Vegas Golden Knights, who were set to begin play in the 2017\u201318 season.", "Canadian rightsholder Rogers Media reinstated Ron MacLean as host of \"Hockey Night in Canada\" for the 2016\u201317 season to replace George Stroumboulopoulos, whose introduction in the 2014\u201315 season was met with mixed reception by viewers." ] ], "gold": "The last time that the Pittsburgh Penguins won the Stanly Cup was on June 11, 2017, when they defeated the Nashville Predators four games to two in the finals, becoming champions for the 2016-17 NHL season. The Pittsburgh Penguins became the first team to repeat as Stanley Cup champions since the Detroit Red Wings in 1997\u201398", "prediction 1": "The Pittsburgh Penguins are a professional ice hockey team based in Pittsburgh, Pennsylvania. They are members of the Metropolitan Division of the Eastern Conference of the National Hockey League and have won the Stanley Cup five times. Their last Stanley Cup win came on June 11, 2017, when they defeated the Nashville Predators, 4 games to 2.", "prediction 2": "The Pittsburgh Penguins have won the Stanley Cup on five occasions. They won the Cup in 1991, 1992, 2009, 2016, and 2017. The 2017 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2016\u201317 season, and the culmination of the 2017 Stanley Cup playoffs.", "prediction 3": "The Pittsburgh Penguins have won the Stanley Cup five times. They have qualified for six Stanley Cup Finals, winning the Stanley Cup five times, in 1991, 1992, 2009, 2016, and 2017. In 2017, the Penguins won the Stanley Cup for the second consecutive year in a row, which was the last time the team had won the Stanley Cup.", "prediction 4": "The Pittsburgh Penguins are a professional ice hockey team based in Pittsburgh. They are members of the Metropolitan Division of the Eastern Conference of the National Hockey League. In addition to their eight division titles, the team qualified for six Stanley Cup Finals, winning the Stanley Cup five times \u2013 in 1991, 1992, 2009, 2016, and 2017. In the 2017 Stanley Cup Finals, the Pittsburgh Penguins defeated the Western Conference champion Nashville Predators, four games to two. On June 11, the Pittsburgh Penguins became the first team to repeat as Stanley Cup champions since the Detroit Red Wings in 1997\u201398, winning the franchise's fifth Stanley Cup and their third in nine seasons. In the 2017 Pittsburgh Penguins won the Stanley Cup in their fifth and their third Stanley Cup.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 236 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Their last Stanley Cup win came on June 11, 2017, when they defeated the Nashville Predators, 4 games to 2. The Pittsburgh Penguins became the first team to repeat as Stanley Cup champions since the Detroit Red Wings in 1997\u201398." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does the new episode of flash come out?", "passages": [ [ "The Flash (1990 TV series)", "The Flash (1990 TV series)\n\n", "The Flash is a 1990 American television series developed by the writing team of Danny Bilson and Paul De Meo that aired on CBS.", "It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds.", "\"The Flash\" starred John Wesley Shipp as Allen, along with Amanda Pays, and Alex D\u00e9sert.", "Barry Allen, a forensic scientist working for the Central City police, is struck by lightning and doused in chemicals in his lab.", "He develops superspeed and creates a superhero identity for himself to fight crime: The Flash.", "Research scientist Dr. Tina McGee works at S.T.A.R. Labs and helps Barry fight crime while trying to understand how his powers are developing.", "As well as his superheroics, Barry tries to maintain a private life, and tries to keep his superhero identity from his colleagues, his boss Lt. Garfield, and his best friend, Julio Mendez.", "Other guest stars in minor roles include Jonathan Brandis as Terry Cohan, Bryan Cranston as Phillip Moses, Mark Dacascos as Osako, Robert O'Reilly as Victor Kelso, and Sven-Ole Thorsen as the android assassin Omega." ], [ "The Flash (2014 TV series)", "It has been well received by critics and audiences, and won the People's Choice Award for \"Favorite New TV Drama\" in 2014.", "The series, together with \"Arrow\", has spun characters out to their own show, \"Legends of Tomorrow\", which premiered on January 21, 2016.", "On April 2, 2018, The CW renewed the series for a fifth season, which premiered on October 9, 2018.", "In season one, after witnessing his mother's supernatural murder, Barry Allen is taken in by Detective Joe West and his family.", "Barry becomes a brilliant but socially awkward crime scene investigator for the Central City Police Department.", "A particle accelerator malfunctions, bathing the city center with a radiation during a thunderstorm, and Barry is struck by lightning.", "Awakening after a coma, he discovers he can move at superhuman speeds.", "Harrison Wells, the accelerator's designer, describes Barry's nature as \"metahuman\".", "Barry vows to use his gifts to protect Central City.", "As the Flash, Barry also pursues his mother's murderer, the Reverse-Flash.", "In season two, after a singularity event occurs, the Flash is recognized as Central City's hero.", "However, the event brings a new threat from a parallel earth: Zoom, a demonic speedster who seeks to eliminate all speedsters throughout the multiverse." ] ], "gold": "The original TV series The Flash aired from September 20, 1990, to May 18, 1991. Episodes 20, 21, and 22 aired on May 4, 1991, May 11, 1991, and May 18, 1991, respectively. A more recent series, The Flash, premiered on October 7, 2014, and is still on the air, with the new seasons set to premiere on November 16, 2021. Episodes 76, 77, and 78 aired on November 21, 2017, November 28, 2017, and December 5, 2017, respectively. ", "prediction 1": "The Flash is a 1990 American television series developed by the writing team of Danny Bilson and Paul De Meo that aired on CBS. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. Episode 136 of the third season came out on September 17, 1990. Episode 138 of the fourth season came out on September 16, 1990.", "prediction 2": "The Flash is a 1990 American television series developed by the writing team of Danny Bilson and Paul De Meo that aired on CBS. It was based on the DC Comics character Barry Allen, a forensic scientist working for the Central City police who is struck by lightning and doused in chemicals in his lab. He develops superspeed and creates a superhero identity for himself to fight crime: The Flash. The Flash: Legends of Tomorrow premiered on January 21, 2016.", "prediction 3": "Season 3 episode 2 came out on February 14, 2019. Season 4 episode 1 came out on February 14, 2019.", "prediction 4": "The Flash is a 1990 American television series developed by the writing team of Danny Bilson and Paul De Meo that aired on CBS. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. The new episode of Flash comes out monthly, on the same day each month.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 267 }, { "error type": "Unverifiable", "explanation": "", "start": 268, "end": 331 }, { "error type": "Redundant", "explanation": "The Flash is a 1990 American television series developed by the writing team of Danny Bilson and Paul De Meo that aired on CBS. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. Episode 136 of the third season came out on September 17, 1990. ", "start": 332, "end": 396 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Flash is a 1990 American television series. A more recent series, The Flash, premiered in 2014, with a a fifth season, which premiered on October 9, 2018." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who sings sitting in the hall of fame?", "passages": [ [ "Hall of Fame (song)", "Hall of Fame (song)\n\n\"Hall of Fame\" is a song by Irish pop rock band The Script.", "It is the lead single from their third studio album \"#3\".", "The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "The track was given its first radio play on Capital on 23 July 2012.", "Written and co-produced by the band, the song is about following dreams and making an impact on the world.", "The song has been licensed for use in various media since its release.", "The Script frontman Danny O'Donoghue first met will.i.am while they were both judges for \"The Voice UK\".", "O'Donoghue told: \"I played Will a few demos backstage early on in \"The Voice\".", "We got to Hall Of Fame and he immediately asked if he could have it for his new album, as it was exactly what he was looking for.", "I wasn\u2019t having it, it was our lead single", "but I asked if he\u2019d be on it.", "He agreed and we booked in time to record it.", "The problem is, he\u2019s either late or completely flakes, so it took four attempts to get to record his part.", "Eventually we put it together in his hotel room in 15 minutes.", "It\u2019s a classic duet, I do one line and he responds.\"" ] ], "gold": "\"Hall of Fame\" is a song by Irish pop rock band The Script. The track features American hip-hop artist will.i.am of The Black Eyed Peas. The track was given its first radio play on Capital on 23 July 2012.", "prediction 1": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album \"#3\". The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "prediction 2": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album #13. The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "prediction 3": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album \"#3\". The track features American hip hop artist will.i.am of The Black Eyed Peas.", "prediction 4": "\"Hall of Fame\" is a song by Irish pop rock band The Script. It is the lead single from their third studio album, \"#3\". The track features American hip-hop artist will.i.am of The Black Eyed Peas.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 117 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Hall of Fame\" is a song by Irish pop rock band The Script.. The track features American hip-hop artist will.i.am of The Black Eyed Peas. The track was given its first radio play on Capital on 23 July 2012." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did france manage to get away from the church's hold over it?", "passages": [ [ "Separation of church and state", "Separation of church and state\n\nThe separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state.", "Conceptually, the term refers to the creation of a secular state (with or without legally explicit church\u2013state separation) and to disestablishment, the changing of an existing, formal relationship between the church and the state.", "In a society, the degree of political separation between the church and the civil state is determined by the legal structures and prevalent legal views that define the proper relationship between organized religion and the state.", "The arm's length principle proposes a relationship wherein the two political entities interact as organizations independent of the authority of the other.", "The strict application of secular principle of \"la\u00efcit\u00e9\" (secularity) is used in France, while secular societies, such as Denmark and the United Kingdom, maintain a form of constitutional recognition of an official state religion.", "The philosophy of the separation of the church from the civil state parallels the philosophies of secularism, disestablishmentarianism, religious liberty, and religious pluralism, by way of which the European states assumed some of the social roles of the church, the welfare state, a social shift that produced a culturally secular population and public sphere." ], [ "Relations between the Catholic Church and the state", "During the French Wars of Religion, the Monarchomachs began to contest the divine right of kings, setting up the bases for the theory of popular sovereignty and theorizing the right of tyrannicides.", "The central principle of the medieval, Renaissance and \"ancien r\u00e9gime\" periods, monarchical rule 'by God's will', was fundamentally challenged by the 1789 French Revolution.", "The revolution began as a conjunction of a need to fix French national finances and a rising middle class who resented the privileges of the clergy (in their role as the First Estate) and nobility (in their role as the Second Estate).", "The pent-up frustrations caused by lack of political reform over a period of generations led the revolution to spiral in ways unimaginable only a few years earlier, and indeed unplanned and unanticipated by the initial wave of reformers.", "Almost from the start, the revolution was a direct threat to clerical and noble privilege: the legislation that abolished the feudal privileges of the Church and nobility dates from August 4, 1789, a mere three weeks after the fall of the Bastille (although it would be several years before this legislation came fully into effect).", "At the same time, the revolution also challenged the theological basis of royal authority.", "The doctrine of popular sovereignty directly challenged the former divine right of kings." ], [ "France", "The counter-revolution, begun in March 1793 in the Vend\u00e9e, by July had spread to Brittany, Normandy, Bordeaux, Marseilles, Toulon, Lyon.", "Paris' Convention government between October and December 1793 with brutal measures managed to subdue most internal uprisings, at the cost of tens of thousands of lives.", "Some historians consider the civil war to have lasted until 1796 with a toll of possibly 450,000 lives.", "France in February 1794 abolished slavery in its American colonies, but would reintroduce it later.", "Political disagreements and enmity in the National Convention between October 1793 and July 1794 reached unprecedented levels, leading to dozens of Convention members being sentenced to death and guillotined.", "Meanwhile, France's external wars in 1794 were going prosperous, for example in Belgium.", "In 1795, the government seemed to return to indifference towards the desires and needs of the lower classes concerning freedom of (Catholic) religion and fair distribution of food.", "Until 1799, politicians, apart from inventing a new parliamentary system (the 'Directory'), busied themselves with dissuading the people from Catholicism and from royalism.", "Napoleon Bonaparte seized control of the Republic in 1799 becoming First Consul and later Emperor of the French Empire (1804\u20131814; 1815)." ] ], "gold": "The separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the state. Conceptually, the term refers to the creation of a secular state and to disestablishment, the changing of an existing, formal relationship between the church and the state. France got away from the Church's hold in September 1792 with the issue of divorce, and on August 4, 1789 they eliminated the tithe. In October 1793, the Christian calendar was replaced. ", "prediction 1": "Separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state. Conceptually, the term refers to the creation of a secular state, with or without legally explicit church-state separation, and to disestablishment, the changing of an existing, formal relationship between the church and the state. The philosophy of the separation of the church from the civil state parallels the philosophies of secularism, disestablishmentarianism, religious liberty, and religious pluralism, by way the European states assumed some of the social roles of the church, the state.", "prediction 2": "The separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state. Conceptually, the term refers to the creation of a secular state, with or without legally explicit church-state separation, and to disestablishment, the changing of an existing, formal relationship between the church and the state. The principle of monarchical rule 'by God's will', fundamentally challenged by the 1789 French Revolution, led to spiral in ways unimaginable only a few years earlier, unplanned and unanticipated by the initial wave of reformers. The philosophy of the separation of the church from the civil state parallels the philosophies of secularism, disestablishmentarianism, religious liberty, religious liberty, religious liberty, and religious pluralism,", "prediction 3": "The separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state. Conceptually, the term refers to the creation of a secular state (with or without legally explicit church\u2013state separation) and to disestablishment, the changing of an existing, formal relationship between the church and the state. The 1789 French Revolution challenged the central principle of the medieval, Renaissance and \"ancien r\u00e9gime\", monarchical rule 'by God's will', challenging the doctrine of popular sovereignty, challenging the theology of royal authority. The separation of church from the state is a philosophy of secularism, disestablishmentarianism, religious liberty, and religious pluralism, by way that European states assume some of the social roles of the church.", "prediction 4": "The separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state. Conceptually, the term refers to the creation of a secular state (with or without legally explicit church\u2013state separation) and to disestablishment, the changing of an existing, formal relationship between the church and the state. The philosophy of the separation of the church from the civil state parallels the philosophies of secularism, disestablishmentarianism, religious liberty, and religious pluralism.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 414, "end": 679 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Separation of church and state is a philosophic and jurisprudential concept for defining political distance in the relationship between religious organizations and the nation state. Conceptually, the term refers to the creation of a secular state, with or without legally explicit church-state separation, and to disestablishment, the changing of an existing, formal relationship between the church and the state. The legislation that abolished the feudal privileges of the Church and nobility dates from August 4, 1789." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did the earth and solar system form?", "passages": [ [ "Formation and evolution of the Solar System", "Formation and evolution of the Solar System\n\nThe formation and evolution of the Solar System began 4.6 billion years ago with the gravitational collapse of a small part of a giant molecular cloud.", "Most of the collapsing mass collected in the center, forming the Sun, while the rest flattened into a protoplanetary disk out of which the planets, moons, asteroids, and other small Solar System bodies formed.", "This model, known as the nebular hypothesis was first developed in the 18th century by Emanuel Swedenborg, Immanuel Kant, and Pierre-Simon Laplace.", "Its subsequent development has interwoven a variety of scientific disciplines including astronomy, physics, geology, and planetary science.", "Since the dawn of the space age in the 1950s and the discovery of extrasolar planets in the 1990s, the model has been both challenged and refined to account for new observations.", "The Solar System has evolved considerably since its initial formation.", "Many moons have formed from circling discs of gas and dust around their parent planets, while other moons are thought to have formed independently and later been captured by their planets.", "Still others, such as Earth's Moon, may be the result of giant collisions.", "Collisions between bodies have occurred continually up to the present day and have been central to the evolution of the Solar System.", "The positions of the planets might have shifted due to gravitational interactions." ], [ "History of Earth", "Human activity is now a dominant force affecting global change, harming the biosphere, the Earth's surface, hydrosphere, and atmosphere with the loss of wild lands, over-exploitation of the oceans, production of greenhouse gases, degradation of the ozone layer, and general degradation of soil, air, and water quality.", "In geochronology, time is generally measured in mya (megayears or million years), each unit representing the period of approximately 1,000,000 years in the past.", "The history of Earth is divided into four great eons, starting 4,540 mya with the formation of the planet.", "Each eon saw the most significant changes in Earth's composition, climate and life.", "Each eon is subsequently divided into eras, which in turn are divided into periods, which are further divided into epochs.", "The history of the Earth can be organized chronologically according to the geologic time scale, which is split into intervals based on stratigraphic analysis.", "The standard model for the formation of the Solar System (including the Earth) is the solar nebula hypothesis.", "In this model, the Solar System formed from a large, rotating cloud of interstellar dust and gas called the solar nebula.", "It was composed of hydrogen and helium created shortly after the Big Bang 13.8\u00a0Ga (billion years ago) and heavier elements ejected by supernovae." ] ], "gold": "The Solar System formed 4.5 billion years ago, its formation and evolution beginning with the gravitational collapse of a small part of a giant molecular cloud, while the Earth formed 4,540 mya, or 4,540 million years ago.", "prediction 1": "The Earth and Solar System formed 4 billion years ago, when 4.6 billion years ago it was formed from a large rotating cloud of interstellar dust and gas called the solar nebula. The standard model for the formation of the Solar System (including the Earth) is the solar nebula hypothesis. In this model, the Solar System formed from a large, rotating cloud of interstellar dust and gas called the solar nebula.", "prediction 2": "The formation and evolution of the Solar System began 4.6 billion years ago with the gravitational collapse of a small part of a giant molecular cloud. This model, known as the nebular hypothesis, was first developed in the 18th century by Emanuel Swedenborg, Immanuel Kant, and Pierre-Simon Laplace. The Solar System has evolved considerably since its initial formation. Many moons have formed from circling discs of gas and dust around their parent planets, while other moons are thought to have formed independently and later been captured by their parent planets. Collisions between bodies have occurred continuously up to the present day and have been central to the evolution of the Solar System.", "prediction 3": "The Earth and its Solar System formed around 4 billion years ago. The Earth formed at a rate of 1 billion miles per second, which is about 1 in 50,000 years. The formation and evolution of the Solar System began 4.6 billion years ago with the gravitational collapse of a small part of a giant molecular cloud. The model for the formation of the Solar System including the Earth is called the solar nebula hypothesis, in which the Solar System formed from a large, rotating cloud of interstellar dust and gas called the solar nebula.", "prediction 4": "The Earth and the Solar System formed 4.6 billion years ago with the gravitational collapse of a small part of a giant molecular cloud. The Earth and its satellites formed over the course of this time. The formation and evolution of the Solar System began about 4.5 billion years ago.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 34, "end": 54 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 410 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Earth and Solar System formed 4 billion years ago, when 4.6 billion years ago with the gravitational collapse of a small part of a giant molecular cloud. The history of Earth is divided into four great eons, starting 4,540 mya with the formation of the planet." }, "preference": [ 2, 1, 0, 1, 1, 0 ] }, { "question": "Who is the tennessee titans number one receiver?", "passages": [ [ "Washington Redskins draft history", "Washington Redskins draft history\n\n", "This is a list of the Washington Redskins NFL Draft selections.", "The Washington Redskins franchise was founded as the Boston Braves, named after the local baseball franchise.", "The team changed their name to the Redskins in 1933 and moved to Washington, D.C. in 1937.", "Every year during April, each NFL franchise seeks to add new players to its roster through a collegiate draft known as the \"NFL Annual Player Selection Meeting\", which is more commonly known as the NFL Draft.", "Teams are ranked in inverse order based on the previous season's record, with the worst record picking first, and the second worst picking second and so on.", "The two exceptions to this order are made for teams that appeared in the previous Super Bowl; the Super Bowl champion \"always\" picks 32nd, and the Super Bowl loser \"always\" picks 31st.", "Teams have the option of trading away their picks to other teams for different picks, players, cash, or a combination thereof.", "Thus, it is not uncommon for a team's actual draft pick to differ from their assigned draft pick, or for a team to have extra or no draft picks in any round due to these trades.", "The Boston Redskins were one of the nine original franchises that participated in the 1936 NFL Draft, which was the first official draft of the National Football League." ], [ "Kenny Britt", "Kenny Britt\n\nKenneth Lawrence Britt (born September 19, 1988) is an American football wide receiver who is a free agent.", "He played college football at Rutgers and was drafted by the Tennessee Titans with the 30th overall pick in the 2009 NFL Draft.", "He has also played for the St. Louis / Los Angeles Rams, Cleveland Browns and New England Patriots.", "Ranked a four-star prospect by Rivals.com, Britt spurned numerous suitors to stay home at his home-state university, Rutgers University.", "Prior to National Signing Day, there were strong rumors that he would commit to Illinois but he chose to attend Rutgers instead.", "Britt was pressed into the starting lineup as a true freshman in 2006.", "That season, he had a major role in one of the biggest wins in school history, which was the victory over Louisville.", "Britt continued his stellar play in the 2007 season, making 62 receptions for 1232 yards and 8 touchdowns, averaging 19.9 yards per catch.", "Britt led all sophomores in Division I-A football in receiving yards and yards per reception, finishing 11th and 5th in those categories respectively for all of I-A. Britt also led the Big East conference in both categories in 2007, and was rewarded with a spot on the Big East's All-Conference team, and was named by Rutgers as its 2007 offensive MVP." ], [ "Kendall Wright", "Kendall Wright\n\nKendall Thomas Wright (born November 12, 1989) is an American football wide receiver who is currently a free agent.", "He played college football at Baylor, where he is the career leader in receptions, receiving yards, and receiving touchdowns.", "Wright was drafted by the Tennessee Titans in the first round, 20th overall, of the 2012 NFL Draft.", "Wright attended Pittsburg High School in Pittsburg, Texas, where he was a three-sport standout that earned All-state honors in football, basketball and track.", "In football, he excelled as a quarterback and cornerback, receiving second-team Class 3A All-State honors from the Texas Sports Writers Association and honorable mention by the Associated Press at both positions as a junior and senior.", "As a junior, he accounted for 26 total touchdowns and passed for 850 yards.", "As a senior quarterback, he rushed for 1,069 yards while passing for 1,170 yards, totalling 24 touchdowns.", "As an All-State basketball performer, he averaged 24.5 points, six rebounds, five assists and five steals per game en route to receiving 2007 East Texas Player of the Year honors from the Tyler Morning Telegraph.", "He served as a youth basketball coach while still in high school." ] ], "gold": "Every year during April, each NFL franchise seeks to add new players to its roster through a collegiate draft known as \"the NFL Annual Player Selection Meeting\", which is more commonly known as the NFL Draft. Teams are ranked in inverse order based on the previous season's record, with the worst record picking first, and the second worst picking second and so on. For the Tennessee Titan's, Kenny Britt from Rutgers University was picked number one receiver in 2009, Kendall Wright from Baylor in 2012, and Corey Davis from Western Michigan in 2017. ", "prediction 1": "The Tennessee Titans have a number one receiver in the 2017 NFL Draft, Kenny Britt. The Tennessee Titans' number one wide receiver in 2017 was Kenny Britt. The Tennessee Titans number one receiver in 2018 was Kendall Wright.", "prediction 2": "Kenny Britt is the Tennessee Titans number one wide receiver. Kendall Wright is the Tennessee Titans number one receiver.", "prediction 3": "Kenny Britt is the number one receiver on the Tennessee Titans. Kendall Wright is the number one receiver on the Tennessee Titans.", "prediction 4": "The Tennessee Titans number one receiver for the 2016 season is Kenny Britt. The Tennessee Titans number one receiver for the 2017 season is Kendall Wright.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 177, "end": 204 }, { "error type": "Redundant", "explanation": "The Tennessee Titans have a number one receiver in the 2017 NFL Draft, Kenny Britt. ", "start": 84, "end": 155 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 21, "end": 70 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Every year during April, each NFL franchise seeks to add new players to its roster through a collegiate draft known as the \"NFL Annual Player Selection Meeting\", which is more commonly known as the NFL Draft. Teams are ranked in inverse order based on the previous season's record, with the worst record picking first, and the second worst picking second and so on. The Tennessee Titans receiver pick in 2009 is Kenny Britt, from Rutgers. The Tennessee Titans first round pick in 2012 was Kendall Wright, from Baylor." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who wrote wake me up when its all over?", "passages": [ [ "Wake Me Up (Avicii song)", "Wake Me Up (Avicii song)\n\n\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album \"True\", released on CD and cassette by PRMD Music, Lava Records and Sony Music's Columbia Records on 17 June 2013.", "\"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc.", "American soul singer Aloe Blacc provides vocals for the track and Mike Einziger of Incubus provides acoustic guitar.", "Avicii introduced \"Wake Me Up!\"", "for the first time live on stage at the Ultra Music Festival in Miami.", "The experimental rendering (it was accompanied by a live band with instruments and vocalists, including Blacc, Einziger and Incubus members Ben Kenney on bass and Jos\u00e9 Pasillas on drums) reportedly confused and angered a section of the electronic dance festival community.", "Subsequently, Avicii achieved critical and commercial success with the release of the single worldwide.", "\"Wake Me Up\" peaked at number one in much of Europe and charted well in various countries." ] ], "gold": "Swedish DJ and record producer Avicii, Mike Einziger, and Aloe Blacc, an American soul singer, collaborated to write Wake Me Up When It's All Over, while Avicii also performed it. The song Wake Me Up was released as the lead single from Avicii's debut studio album True on June 17, 2013.", "prediction 1": "\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album True. \"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc. American soul singer Aloe Blacc provides vocals for the track and Mike Einziger of Incubus provides acoustic guitar.", "prediction 2": "Avicii, Mike Einziger, and Aloe Blacc wrote Wake Me Up, a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album True. American soul singer Aloe Blacc provides vocals for the track and Mike Einziger of Incubus provides acoustic guitar.", "prediction 3": "\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album True on 17 June 2013. The song was composed by Avicii, Mike Einziger, and Aloe Blacc.", "prediction 4": "\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album True on 17 June 2013. \"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc. American soul singer Aloe Blacc provides vocals for the track and Mike Einziger of Incubus provides acoustic guitar.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 310 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Wake Me Up\" is a song by Swedish DJ and record producer Avicii, released as the lead single from his debut studio album True on 17 June 2013. \"Wake Me Up\" was written by Avicii, Mike Einziger, and Aloe Blacc. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who won the 2018 pikes peak hill climb?", "passages": [ [ "Volkswagen I.D. R", "Volkswagen I.D. R\n\nThe Volkswagen I.D. R is a prototype fully electric vehicle designed as part of Volkswagen's I.D. Project, and included within Volkswagen's R series of cars designed specifically for competing in motorsport events.", "It is the first electric racing car designed by Volkswagen.", "The Volkswagen I.D. made its competition d\u00e9but at the Pikes Peak International Hill climb in Colorado Springs, Colorado on June 24, 2018.", "It was driven by Romain Dumas, and the team set a target of beating the existing electric car record of 8:57.118 minutes, set in 2016 by Rhys Millen with the Drive e0 PP100.", "The I.D. R became the first car to complete the hill climb in under eight minutes (\"7:57.148\"), breaking the outright record set by S\u00e9bastien Loeb and the Peugeot 208 T16 Pikes Peak.", "In 2018 the Dewar Trophy was awarded to Integral Powertrain (the provider of the motors used by Volkswagen) for their electric motors and drivers.", "Previous winners include Keith Duckworth for the Cosworth DFV engine and Mercedes AMG High Performance Powertrains for their Formula 1 hybrid powertrain.", "The Volkswagen I.D. R features two electric motors, located at each axle, allowing for a combined and of torque..", "The I.D." ], [ "Colorado Springs, Colorado", "The city has a long association with the sport of figure skating, having hosted the U.S. Figure Skating Championships six times and the World Figure Skating Championships five times.", "It is home to the World Figure Skating Museum and Hall of Fame and the Broadmoor Skating Club, a notable training center for the sport.", "In recent years, the World Arena has hosted skating events such as Skate America and the Four Continents Figure Skating Championships.", "The Pikes Peak International Hill Climb (PPIHC), also known as The Race to the Clouds, is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak, every year on the last Sunday of June.", "The first running of the Pikes Peak Hill Climb was promoted by Spencer Penrose.", "Penrose had finished widening the narrow carriage road into a much wider \"Pikes Peak Highway.\"", "He decided to encourage tourists to visit by creating a race to the clouds.", "The PPIHC takes place on a public toll-road boasting 156 turns, while competitors climb from the start line at mile 7 marker on the Pikes Peak Highway to the finish line at the summit.", "The race is self-sanctioned and is the most diverse one day motorsports event in the world with everything from Sidecars, Motorcycles, Semi-Trucks, and 1,400+hp EV & Unlimited Racers being able to compete in the same event." ], [ "Pikes Peak International Hill Climb", "Pikes Peak International Hill Climb\n\nThe Pikes Peak International Hill Climb (PPIHC), also known as The Race to the Clouds, is an annual automobile and motorcycle hillclimb to the summit of Pikes Peak in Colorado, USA.", "The track measures and has over 156 turns, climbing from the start at Mile 7 on Pikes Peak Highway, to the finish at , on grades averaging 7.2%.", "It used to consist of both gravel and paved sections, however as of August 2011, the highway is fully paved and as a result all subsequent events will be run on asphalt from start to finish.", "The race is self-sanctioned and has taken place since 1916.", "It is currently contested by a variety of classes of cars, trucks, motorcycles and quads.", "There are often numerous new classes tried and discarded year-to-year.", "On average there are 130 competitors.", "The PPIHC operates as the Pikes Peak Auto Hill Climb Educational Museum to organize the annual motorsports event.", "The first Pikes Peak Hill Climb was promoted by Spencer Penrose, who had converted the narrow carriage road into the much wider Pikes Peak Highway.", "The first Penrose Trophy was awarded in 1916 to Rea Lentz with a time of 20:55.60.", "In the same year Floyd Clymer won the motorcycle class with a time of 21:58.41." ] ], "gold": "The Pikes Peak International Hill Climb, also known as The Race to the Clouds, is an annual automobile hill climb to the summit of Pikes Peak in Colorado, USA with the track measuring 12.42 miles , has over 156 turns, climbing 4,720 ft from the start at Mile 7 on Pikes Peak Highway, to the finish at 14,115 ft, on grades averaging 7.2%. The Unlimited Division features the most exotic vehicles, most of them built specifically for this race. These race cars have the best chance of setting a new overall race record, and in 2018, Romain Dumas set a new record of 7 minutes 57.148 seconds in the all-electric Volkswagen I.D. R Pikes Peak, beating S\u00e9bastien Loeb's previous record by over 15 seconds. The overall honors have always fallen to vehicles in car divisions, however motorcycles have their own divisions, records and winners, and that same year Carlin Dunne won for motorcycles. ", "prediction 1": "The Pikes Peak International Hill Climb, also known as The Race to the Clouds, is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak in Colorado, USA. The race is self-sanctioned and is the most diverse one day motorsports event in the world with everything from Sidecars, Motorcycles, Semi-Trucks, and 1,400+hp EV & Unlimited Racers being able to compete in the same event. The first Pikes Peak Hill Climb was promoted by Spencer Penrose, who had converted the narrow carriage road into the much wider Pikes Peak Highway. The first Penrose Trophy was awarded in 1916 to Rea Lentz with a time of 20:55.60. The second Penrose Trophy was awarded to Floyd Clymer with a time of 21:58.", "prediction 2": "The Pikes Peak International Hill Climb is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak in Colorado, USA. In 2018, Romain Dumas drove the Volkswagen I.D. R, which was driven by the team Ekspres. The I.D. R became the first car to complete the hill climb in under eight minutes (7:57.148), breaking the outright record set by S\u00e9bastien Loeb and the Peugeot 208 T16 Pikes Peak.", "prediction 3": "The Pikes Peak International Hill Climb is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak in Colorado, USA. The first running of the Pikes Peak Hill Climb was promoted by Spencer Penrose, who had converted the narrow carriage road into the much wider Pikes Peak Highway. The first Penrose Trophy was awarded in 1916 to Rea Lentz with a time of 20:55.60. In the same year Floyd Clymer won the motorcycle class with a time of 21:58.41. The Dewar Trophy was awarded to Integral Powertrain for their electric motors and drivers. Previous winners include Keith Duckworth for the Cosworth engine and Mercedes AMG High Performance Powertrain for their EV & Unlimited Racers.", "prediction 4": "Pikes Peak International Hill Climb is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak in Colorado, USA. In 2018, Romain Dumas won the motorcycle class, and the Volkswagen I.D. R won the electric car class.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 412, "end": 559 }, { "error type": "Irrelevant", "explanation": "", "start": 560, "end": 718 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 411 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Pikes Peak International Hill Climb, also known as The Race to the Clouds, is an annual invitational automobile and motorcycle hill climb to the summit of Pikes Peak in Colorado, USA. The track measures and has over 156 turns, climbing from the start at Mile 7 on Pikes Peak Highway, to the finish at , on grades averaging 7.2%. In 2018, Romain Dumas set a new record of 7 minutes 57.148 seconds in the all-electric Volkswagen I.D. R Pikes Peak, beating S\u00e9bastien Loeb's previous record." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What is the genre of the boy in the striped pajamas?", "passages": [ [ "The Boy in the Striped Pyjamas (film)", "The Boy in the Striped Pyjamas (film)\n\n", "The Boy in the Striped Pyjamas (released as The Boy in the Striped Pajamas in the United States) is a 2008 British American historical drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name.", "Written and Directed by Mark Herman, produced by BBC Films and Heyday Films, and distributed by Miramax, the film stars Vera Farmiga, David Thewlis, Asa Butterfield, and Jack Scanlon.", "It was released on 12 September 2008 in the United Kingdom.", "The Holocaust drama relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys; Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate.", "The film opens with the quote \"Childhood is measured out by sounds and smells and sights, before the dark hour of reason grows\", by John Betjeman.", "A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II.", "He learns that his father Ralf has been promoted, due to which their family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" (occupied Poland)." ] ], "gold": "Historical / post modern book The Boy in the Striped Pajamas was made into a historical tragedy film in 2008. The setting is in World War II, a Holocaust drama that relates the horror of a Nazi extermination camp through the eyes of two 8-year-old boys: Bruno, played by Asa Butterfield, the son of the camp's Nazi commander, and Shmuel, played by Jack Scanlon, a Jewish prisoner. ", "prediction 1": "The Boy in the Striped Pyjamas is a 2008 British American Holocaust drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name. The film is a Holocaust drama and is set in a Nazi concentration camp in Nazi Germany during World War II.", "prediction 2": "The Boy in the Striped Pyjamas is a 2008 British American Holocaust drama film set in World War II, based on John Boyne's 2006 novel of the same name. Written and Directed by Mark Herman, the film was produced by BBC Films and Heyday Films, and distributed by Miramax. The genre of the film is Holocaust drama.", "prediction 3": "The Boy in the Striped Pyjamas is a 2008 British American Holocaust drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name. Written and Directed by Mark Herman, the film is a Holocaust drama that relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys, Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate.", "prediction 4": "The Boy in the Striped Pyjamas is a 2008 British American historical drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name. Written and Directed by Mark Herman, the film is a Holocaust drama that relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys, Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Boy in the Striped Pyjamas is a 2008 British American Holocaust drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name. The film is a Holocaust drama and is set in a Nazi concentration camp in Nazi Germany during World War II Nazi extermination camp through the eyes of two 8-year-old boys; Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who sang the theme song for fat albert?", "passages": [ [ "Fat Albert and the Cosby Kids", "The lack of network restrictions allowed the producer to delve into more mature subject matter.", "A notable episode (\"Busted\") featured the kids having an inadvertent brush with the law and given a \"Scared Straight!", "\"-style tour of an occupied maximum security prison, even contained utterances (by the jail's inmates) of the words \"damn\" and \"bastard\" (Cosby had appeared in the beginning of the episode advising viewers that those words would be used as part of the story's dialogue to realistically depict jail life).", "Another notable episode, \"Gang Wars\", featured a child being shot and killed.", "Another segment was added: \"Legal Eagle\", a crime-fighting eagle with a pair of bumbling police squirrels.", "Production of new episodes ceased in 1985.", "The theme song, \"Gonna Have a Good Time\", was composed by Ricky Sheldon and Edward Fournier, and performed by Michael Gray (vocals), Kim Carnes (background vocals) and Edward Fournier (background vocals).", "A cover of the show's theme song, performed by Dig, is included on the 1995 tribute album \"\", produced by Ralph Sall for MCA Records.", "The song's chorus (\"Na-na-na, gonna have a good time!\")" ], [ "Kim Carnes", "Later that year, her cover of Smokey Robinson's \"More Love,\" from the album \"Romance Dance\" (1980), hit No. 10.", "The following year, Carnes released \"Mistaken Identity\", which featured the worldwide hit, \"Bette Davis Eyes.\"", "This became the best-selling single of the year in the United States, spending nine weeks at No. 1 on the Billboard Hot 100, going Gold, and won the Grammy Awards for Record of the Year and Song of the Year.", "\"Mistaken Identity\" went to No. 1 on the Billboard 200, was certified Platinum, and was nominated for the Grammy Award for Album of the Year.", "Carnes also saw success with the singles \"Draw of the Cards (No. 28),\" \"Does It Make You Remember (No. 36),\" \"Crazy in the Night (Barking at Airplanes) (No. 15),\" \"Make No Mistake, He's Mine (No. 51),\" with Barbra Streisand, \"What About Me?", "(No. 15),\" with Kenny Rogers and James Ingram, \"I'll Be Here Where the Heart Is,\" from the \"Flashdance\" soundtrack, and the Grammy Award nominated singles \"Voyeur (No. 29)\" and \"Invisible Hands (No. 40).\"" ] ], "gold": "The theme song for Fat Albert, \"Gonna Have a Good Time,\" is sung by Michael Gray on vocals with Kim Carnes and Edward Fournier on background vocals. Carnes is best known for her 1981 worldwide hit, \"Bette Davis Eyes,\" which won the Grammy Award for Record of the Year and Song of the Year.", "prediction 1": "The theme song for Fat Albert and the Cosby Kids was performed by Michael Gray, Kim Carnes, and Edward Fournier. A cover of the show's theme song, performed by Dig, is included on the 1995 tribute album \"\", produced by Ralph Sall for MCA Records. The song's chorus (\"Na-na-na, gonna have a good time!\") was sung by Michael Gray.\n", "prediction 2": "The show's theme song, Going to Have a Good Time, was performed by Michael Gray, Kim Carnes, and Edward Fournier. The 1996 version, Going to Have a Good Time, was performed by Alycia Kaye. The 1985 version, Going to Have a Good Time, was performed by Dig.", "prediction 3": "The theme song for the show Fat Albert and the Cosby Kids was sang by Michael Gray, Kim Carnes and Edward Fournier. Michael Gray sang the intro of the song \"Gonna Have a Good Time\" during the show. The show's theme song was then covered by Dig on the 1995 tribute album \"\", produced by Ralph Sall for MCA Records. A cover of the show's theme song, performed by Dig, is included on the 1995 tribute album \"\".", "prediction 4": "There were several singers of the Fat Albert theme song. Michael Gray sang the theme song during his time as a child in the series The Cosby Kids, Kim Carnes sang background vocals while Edward Fournier sang background vocals while Michael Gray sang the song during his time as a teenager.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 329 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The theme song for Fat Albert and the Cosby Kids was performed by Michael Gray, Kim Carnes, and Edward Fournier. Carnes released \"Mistaken Identity\", which featured the worldwide hit, \"Bette Davis Eyes\", which won the Grammy Award for Record of the Year and Song of the Year." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who was the voice of scar in the lion king?", "passages": [ [ "Scar (The Lion King)", "Praising the film for successfully combining \"grand-opera melodrama and low-comedy hi-jinks,\" the \"Orlando Sentinel\"s Jay Boyar concluded that \"One reason they work so well together is that even most of the serious sections contain an undercurrent of humor, provided\u00a0... by the deliciously droll voice-performance of Jeremy Irons as Scar.\"", "Mathew DeKinder of the \"St. Louis Post-Dispatch \"felt that Irons successfully \"handle[s] all of the dramatic heavy lifting.\"", "Even film critics who generally disliked the film tended to enjoy Scar's characterization and Irons's performance.", "Terrence Rafferty of \"The New Yorker\" wrote, \"Among the celebrity voices on the soundtrack, two performances stand out,\" namely, \"Jeremy Irons, as the villainous lion Scar\" who \"does an elegant, funny George Sanders impersonation.\"", "(Sanders himself had voiced Shere Khan for Disney in their 1967 version of \"The Jungle Book\").", "Stephen Hunter of \"The Baltimore Sun \"described Irons's voice as \"plummy-rich with rancid irony.\"" ], [ "Scar (The Lion King)", "Chiwetel Ejiofor was officially chosen on November 1, 2017 for the role of Scar for the CGI live action remake, \"The Lion King\" (2019) directed by Jon Favreau, as he had impressed him after watching his antagonistic performance as Baron Mordo in the Marvel film \"Doctor Strange\" (2016).", "The studio originally dismissed \"The Lion King \"as a risk because, at the time, it was believed that the greatest films starred people.", "Concerned about the novelty of the film, Disney CEO Jeffrey Katzenberg decided to divide the studio into two separate animated films, \"The Lion King \"and \"Pocahontas\", the latter of which was dubbed \"the home run\" because it was expected to be the more successful of the two projects.", "Disney's more seasoned and experienced animators gravitated towards \"Pocahontas\", while the studio's newer animators were relegated to working on \"The Lion King\", dubbing themselves the \"B-team\".", "However, Allers received Katzenberg's decision positively as an opportunity for \"newer animators ... to step up to leadership roles\", among them Andreas Deja, who became Scar's supervising animator." ], [ "Jeremy Irons", "Other notable films have included Steven Soderbergh's mystery thriller \"Kafka\" (1991), the period drama \"The House of the Spirits\" (1993), the romantic drama \"M. Butterfly\" (1993), the voice of Scar in Disney's \"The Lion King\" (1994), Simon Gruber in the action film \"Die Hard with a Vengeance\" (1995), the drama \"Lolita\" (1997), Musketeer Aramis in \"The Man in the Iron Mask\" (1998), the action adventure \"Dungeons & Dragons\" (2000), the drama \"The Merchant of Venice\" (2004), the drama \"Being Julia\" (2004), the epic historical drama \"Kingdom of Heaven\" (2005), the fantasy-adventure \"Eragon\" (2006), the Western \"Appaloosa\" (2008), and the indie drama \"Margin Call\" (2011).", "In 2016, he appeared in \"Assassin's Creed\" and, starting that year, has portrayed Alfred Pennyworth in the DC Extended Universe, beginning with \"\" and reprising the role in \"Justice League\" (2017).", "Irons has also made several notable appearances on TV.", "He earned his first Golden Globe Award nomination for his break-out role in the ITV series \"Brideshead Revisited\" (1981)." ] ], "gold": "There are several movies called The Lion King. Jeremy Irons was the voice of Scar in Disney's The Lion King (1994). The Lion King II: Simba's Pride is the sequel to Disney's 1994 animated feature film, The Lion King, and the voice of Scar was Jim Cummings. The 2019 film the lion king is a remake of Disney's traditionally animated 1994 film of the same name and the voice of Scar is Chiwetel Umeadi Ejiofor.", "prediction 1": "Scar is a villainous lion who appears in the Disney film The Lion King. Jeremy Irons voices Scar in this film.", "prediction 2": "Scar in The Lion King was voiced by Jeremy Irons between 1994 and 2019.", "prediction 3": "Scar was voiced by Jeremy Irons in the 1994 Disney film The Lion King. Chiwetel Ejiofor voiced Scar in the 2019 live action remake of The Lion King.", "prediction 4": "Scar is a fictional character in the Disney animated film The Lion King. The voice of Scar in the 1994 film was Jeremy Irons and Chiwetel Ejiofor. In 2019, Jon Favreau directed a live action remake of the film titled The Lion King: Rise of the Lion King directed by Jon Favreau.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Scar is a villainous lion who appears in the 1994 Disney film The Lion King. Jeremy Irons voices Scar in this film. Chiwetel Ejiofor was chosen for the role of Scar for the CGI live action remake, \"The Lion King\" (2019)." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Where is the new orleans jazz fest held?", "passages": [ [ "New Orleans Jazz & Heritage Festival", "New Orleans Jazz & Heritage Festival\n\nThe New Orleans Jazz & Heritage Festival, often known as Jazz Fest, is an annual celebration of the music and culture of New Orleans and Louisiana.", "The term \"Jazz Fest\" also refers to the days surrounding the festival and the many shows at unaffiliated New Orleans nightclubs scheduled during the festival weekends.", "Jazz Fest is held annually on the last weekend of April (Friday\u2013Sunday) and the first weekend of May (Thursday\u2013Sunday) between 11 a.m. and 7 p.m. at the Fair Grounds Race Course, a horse racing track in the middle of New Orleans.", "The festival is a major tourist destination with economic importance for New Orleans rivaled only by Mardi Gras; the event brings to the city $300 million annually.", "Early Jazz Fests featured almost exclusively local acts.", "As the event's popularity grew, the festival expanded to include nationally known acts.", "According to the official website, \"the Festival celebrates the indigenous music and culture of New Orleans and Louisiana, so the music encompasses every style associated with the city and the state: blues, R&B, gospel, Cajun, zydeco, Afro-Caribbean, folk, Latin, rock, rap, country, bluegrass, and everything in between.", "And of course there is lots of jazz, both contemporary and traditional.\"" ], [ "New Orleans Jazz & Heritage Festival", "The Festival also features a wide variety of vendors selling local foods and crafts.", "The official food policy of the Festival is \"no carnival food\" and there are more than seventy food booths with food items including: Mango Freeze, crawfish beignets, cochon de lait sandwiches, alligator sausage po' boy (sandwich), boiled crawfish, softshell crab po'boy, Cajun jambalaya, jalape\u00f1o bread, fried green tomatoes, Oyster patties, muffulettas, red beans and rice, and crawfish Monica.", "Vegan and vegetarian options are also available.", "All food vendors go through a strict screening process to ensure quality and sanitary food handling practices.", "In addition, most foods are made with fresh, local ingredients, and are prepared by hand.", "All food vendors are small, locally owned businesses.", "There are craft booths throughout the grounds.", "The Congo Square African Marketplace contains pieces from local, national, and international artisans, and has the atmosphere of a true marketplace.", "Many of the artisans utilize ancient crafting techniques.", "In the Contemporary Crafts area, one can find handmade clothing, leather goods, jewelry, paintings, sculptures, and musical instruments, and visitors can also watch demonstrations of metal, painting, pottery, and fiber works." ] ], "gold": "The New Orleans Jazz & Heritage Festival is an annual celebration of local music and culture held at the Fair Grounds Race Course in New Orleans, Louisiana. The GPS coordinates of the festival are 29.95\u00b0N 90.08\u00b0W. Jazz Fest attracts thousands of visitors to New Orleans each year. The Festival features a variety of local food and craft vendors, but has a \"no carnival food,\" and instead includes food from small, locally owned businesses, featuring local dishes like crawfish beignets, cochon de lait sandwiches, alligator sausage po' boy, boiled crawfish, softshell crab po'boy, Cajun jambalaya, jalape\u00f1o bread, fried green tomatoes, Oyster patties, muffulettas, red beans and rice, and crawfish Monica.", "prediction 1": "The New Orleans Jazz & Heritage Festival, commonly known as Jazz Fest, is an annual celebration of the music and culture of New Orleans and Louisiana. Jazz Fest is held annually on the last weekend of April and the first weekend of May between 11 a.m. and 7 p.m. at the Fair Grounds Race Course, a horse racing track in the middle of New Orleans.", "prediction 2": "The New Orleans Jazz & Heritage Festival, often known as Jazz Fest, is an annual celebration of the music and culture of New Orleans and Louisiana. Jazz Fest is held annually on the last weekend of April (Friday\u2013Sunday) and the first weekend of May (Thursday\u2013Sunday) between 11 a.m. and 7 p.m. at the Fair Grounds Race Course, a horse racing track in the middle of New Orleans.", "prediction 3": "The New Orleans Jazz & Heritage Festival, often known as Jazz Fest, is an annual celebration of the music and culture of New Orleans and Louisiana. The festival is held annually on the last weekend of April (Friday\u2013Sunday) and the first weekend of May (Thursday\u2013Sunday) between 11 a.m. and 7 p.m. at the Fair Grounds Race Course, a horse racing track in the middle of New Orleans.", "prediction 4": "The New Orleans Jazz & Heritage Festival is an annual celebration of the music and culture of New Orleans and Louisiana. The festival is held annually on the last weekend of April (Friday\u2013Sunday) and the first weekend of May (Thursday\u2013Sunday) between 11 a.m. and 7 p.m. at the Fair Grounds Race Course, a horse racing track in the middle of New Orleans.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 333 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The New Orleans Jazz & Heritage Festival is an annual celebration of the music and culture of New Orleans and Louisiana. Jazz Fest is held at the Fair Grounds Race Course, New Orleans. The official food policy of the Festival is \"no carnival food\" and there are more than seventy food booths with food items including: Mango Freeze, crawfish beignets, cochon de lait sandwiches, alligator sausage po' boy (sandwich), boiled crawfish, softshell crab po'boy, Cajun jambalaya, jalape\u00f1o bread, fried green tomatoes, Oyster patties, muffulettas, red beans and rice, and crawfish Monica." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What was t-mobile called before it was t-mobile?", "passages": [ [ "T-Mobile US", "T-Mobile US\n\nT-Mobile US, Inc., commonly shortened to T-Mobile, is a United States-based wireless network operator whose majority shareholder is the German telecommunications company Deutsche Telekom (DT).", "Its headquarters are located in Bellevue, Washington, in the Seattle metropolitan area.", "T-Mobile is the third largest wireless carrier in the United States with 77.2 million customers as of Q3 2018.", "T-Mobile US provides wireless voice and data services in the United States, Puerto Rico and the U.S. Virgin Islands under the T-Mobile and Metro by T-Mobile brands (which it acquired in a reverse takeover in 2013, resulting in the company going public on the NASDAQ stock exchange), and also serves as the host network for many mobile virtual network operators.", "The company has annual revenues of over $40 billion.", "In 2015, Consumer Reports named T-Mobile the number one American wireless carrier.", "In 2017, T-Mobile was ranked #1 in Customer Service Satisfaction by Nielsen.", "T-Mobile US traces its roots to the 1994 establishment of VoiceStream Wireless PCS as a subsidiary of Western Wireless Corporation.", "Spun off from parent Western Wireless on May 3, 1999, VoiceStream Wireless was purchased by Deutsche Telekom AG in 2001 for $35 billion and renamed T-Mobile USA, Inc. in July, 2002." ], [ "T-Mobile", "The company owns licences to operate a 1900\u00a0MHz GSM PCS digital cellular network and AWS UMTS digital cellular networks using 600MHz, 700MHz, 850MHz, 1700\u00a0MHz and 2100\u00a0MHz covering areas of the continental U.S., Alaska, Hawaii, Puerto Rico and the U.S. Virgin Islands \n.", "It provides coverage in areas where it does not own radio frequency spectrum licenses via roaming agreements with other operators of compatible networks.", "In addition to its cellular mobile network, T-Mobile US operates a nationwide Wi-Fi Internet-access network under the T-Mobile HotSpots brand.", "The T-Mobile HotSpot service offers access to a nationwide network of approximately 8,350 access points, installed in venues such as Starbucks coffeehouses, FedEx Office Office and Print Centers, Hyatt hotels and resorts, Red Roof Inns, Sofitel hotels, Novotel hotels, the airline clubs of American Airlines, Delta Air Lines, United Airlines and US Airways, and airports.", "T-Mobile US, Inc. traces its roots to the 1994 establishment of VoiceStream Wireless PCS as a subsidiary of Western Wireless Corporation.", "Spun off from parent Western Wireless on 3 May 1999, VoiceStream Wireless Corporation was purchased by Deutsche Telekom on 31 May 2001, for $35 billion and renamed T-Mobile USA, Inc. in July 2002." ] ], "gold": "T-Mobile US, Inc. is an American wireless network operator that does business under the global brand name T-Mobile. But it has previously gone by other names. T-Mobile was first called VoiceStream Wireless PCS, then it was called Deutsche Telekom AG.", "prediction 1": "T-Mobile USA, Inc., commonly shortened to T-Mobile, is a US-based wireless network operator whose majority shareholder is the German telecommunications company Deutsche Telekom (DT). T-Mobile US traces its roots to the 1994 establishment of VoiceStream Wireless PCS as a subsidiary of Western Wireless Corporation. Spun off from parent Western Wireless on 3 May 1999, VoiceStream Wireless Corporation was purchased by Deutsche Telekom AG in 2001 for $35 billion and renamed T-Mobile USA, Inc. in July, 2002.", "prediction 2": "T-Mobile US, Inc., commonly shortened to T-Mobile, is a United States-based wireless network operator whose majority shareholder is the German telecommunications company Deutsche Telekom (DT). T-Mobile US traces its roots to the 1994 establishment of VoiceStream Wireless PCS as a subsidiary of Western Wireless Corporation. Spun off from parent Western Wireless on 3 May 1999, VoiceStream Wireless Corporation was purchased by Deutsche Telekom AG in 2001 for $35 billion and renamed T-Mobile USA, Inc. in July, 2002.", "prediction 3": "T-Mobile, a subsidiary of Deutsche Telekom, was renamed T-Mobile USA, Inc. in July 2002. VoiceStream Wireless PCS was a subsidiary of Western Wireless Corporation established in 1994. Deutsche Telekom bought VoiceStream Wireless on 31 May 2001, for $35 billion, and renamed T-Mobile USA, Inc. in July 2002.", "prediction 4": "T-Mobile US, Inc., commonly shortened to T-Mobile, is a United States-based wireless network operator whose majority shareholder is the German telecommunications company Deutsche Telekom (DT). T-Mobile US, Inc. traces its roots to the 1994 establishment of VoiceStream Wireless PCS as a subsidiary of Western Wireless Corporation. Spun off from parent Western Wireless on 3 May 1999, VoiceStream Wireless Corporation was purchased by Deutsche Telekom AG in 2001 for $35 billion and renamed T-Mobile USA, Inc. in July 2002.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 41 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 315, "end": 507 } ], "missing-info": [], "corrected-prediction": "T-Mobile USA, Inc., or T-Mobile, is a US-based wireless network operator. T-Mobile US traces its roots to the 1994 establishment of VoiceStream Wireless PCS." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who has the most shutouts in nhl history?", "passages": [ [ "George Hainsworth", "On the recommendation of Montreal Canadiens' part-owner Leo Dandurand, Lalonde signed Hainsworth to a pro contract of $2,500 per season with Saskatoon.", "Hainsworth played three seasons with Saskatoon before he was signed by Dandurand to play goal for Montreal in 1926.", "The Western league was in the process of folding, and Dandurand signed Hainsworth to a $6,500 per year contract before Toronto claimed him from the Western league players who were en masse moving to the National Hockey League (NHL).", "Dandurand had to pay $5,000 to Saskatoon for the rights to Hainsworth.", "There was a need for a top goaltender in Montreal.", "Georges Vezina, the Canadiens goaltender, had recently died of tuberculosis.", "Vezina had played every game in team history from the 1910\u201311 NHA season until the opening game of the 1925\u201326 NHL season, when the illness proved too much for him.", "In his memory, the team decided to create the Vezina Trophy for most valuable goaltender in the NHL.", "Hainsworth proved up to the challenge by winning the Vezina Trophy for the 1926\u201327, 1927\u201328 and 1928\u201329 NHL seasons.", "In 1928\u201329, he set an all-time record with 22 shutouts and a 0.92 goals against average while playing all 44 games." ], [ "Martin Brodeur", "Martin Brodeur\n\nMartin Pierre Brodeur (; born May 6, 1972) is a Canadian American professional ice hockey executive and former player.", "He is the current executive vice president of business development for the New Jersey Devils of the National Hockey League (NHL).", "In his 21-season tenure with the Devils, he won three Stanley Cup championships and five Eastern Conference titles in 17 postseason campaigns.", "He also won two Olympic gold medals with Team Canada in the 2002 and 2010 Winter Olympic Games, as well as several other medals with Team Canada in other international competitions.", "Brodeur is widely regarded as one of the greatest goaltenders of all time and in 2017 was named by the league as one of the \"100 Greatest NHL Players\".", "He leads the list of goaltenders in wins, losses, shutouts, games played, goals scored, assists and points earned.", "He was elected to the Hockey Hall Of Fame in 2018.", "Brodeur holds numerous NHL and franchise records, including all-time regular season wins (691), losses (397), shutouts (125), and games played (1,266).", "He won at least 30 games in twelve straight seasons between 1995\u201396 and 2007\u201308 and is the only goalie in NHL history with eight 40-win seasons." ], [ "Martin Brodeur", "It was his 105th career shutout, giving him the all-time professional record, surpassing George Hainsworth's total of 104 combined in the NHL (94) and Western Canada Hockey League (10).", "On April 6, 2010, Brodeur reached his 600th career win by defeating the Thrashers 3\u20130.", "This was also his 110th career shutout.", "In the 2009\u201310 NHL season, Brodeur led the NHL in wins (45), shutouts (9), games played (77) and minutes played (4,499).", "He also won his fifth Jennings Trophy and had the third-best GAA in the league, leading his team to back-to-back division wins that included a 6\u20130 regular-season sweep of the defending Stanley Cup champion Penguins.", "However, the Devils lost in the first round of the playoffs, losing to the seventh-seeded Flyers in five games.", "Brodeur had a 5\u201318\u20131 stretch to begin the 2010\u201311 season, as New Jersey slumped to the bottom of the NHL.", "Although the Devils improved in the second half of the season, they did not reach the playoffs; Brodeur recorded 23 wins and a 2.45 GAA, but had his lowest save percentage (.903) in 16 seasons." ] ], "gold": "George Hainsworth holds the record for most shutouts in a season with 22 in the 1928-29 season. Martin Brodeur hold the record for most shutouts in NHL history in the regular season with 125, playoffs with 24, overall in a career with 149, and a single playoff season with 7.", "prediction 1": "The player with the most shutouts in NHL history is George Hainsworth with 22. Martin Brodeur holds the record for most shutouts in NHL career with 110 and 105.", "prediction 2": "The NHL has had the most shutouts in different seasons. In 1926, George Hainsworth had the most shutouts, including 23 in the 1926\u201327, 1927\u201328 and 1928\u201329 seasons. In 2010 Martin Brodeur had 110 shutouts, surpassing Hainsworth's 104 combined in the NHL and Western Canada Hockey League.", "prediction 3": "Martin Brodeur has the most shutouts in NHL history, with 110. In the NHL, Martin Brodeur has the most shutouts with 105, surpassing George Hainsworth's total of 104 combined in the NHL and Western Canada Hockey League (10).", "prediction 4": "There are several goaltenders in the NHL who have the most shutouts in their career. George Hainsworth has the most shutouts in his career, while Martin Brodeur has the most, with 110 career shutouts.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 143, "end": 160 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The player with the most shutouts in NHL history is George Hainsworth with 22 in the 1928-29 season. Martin Brodeur holds numerous NHL and franchise records, including all-time regular season wins (691), losses (397), shutouts (125), and games played (1,266)." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who does the voice of max from a goofy movie?", "passages": [ [ "A Goofy Movie", "A Goofy Movie\n\nA Goofy Movie is a 1995 animated musical comedy drama film, produced by Disney MovieToons and Walt Disney Television Animation and distributed by Walt Disney Pictures.", "The animated directorial debut of Kevin Lima, the film is based on The Disney Afternoon television series \"Goof Troop\" created by Mike Peraza, and acts as a follow-up to the show.", "Taking place several years after the events of \"Goof Troop\", \"A Goofy Movie\" follows Goofy and his son, Max, who is now in high school, and revolves around the father-son relationship between the two as Goofy takes Max on a fishing trip out of fear that Max is drifting away from him, unintentionally interfering with Max's social life, particularly his relationship with Roxanne, his high school crush.", "It features the voices of Jason Marsden, Bill Farmer, Jim Cummings, Kellie Martin, Pauly Shore, Jenna von O\u00ff, and Wallace Shawn, and prominently features the singing voice of Tevin Campbell as Powerline, a fictional pop star.", "The film was also dedicated to Pat Buttram, who died during the film's production.", "\"A Goofy Movie\" was released theatrically on April 7, 1995, by Walt Disney Pictures to mixed reviews from critics and moderate box office success.", "It has since gained a cult following among millennials." ], [ "Max Goof", "\"A Goofy Movie\" features Max as a teenage high school student, finishing the school year before going on summer break.", "In this movie, Max has grown to find his father's goofy antics embarrassing, and is likewise viewed by his peers as a geek and a goof himself; a view he seeks to change at the school assembly when he dresses up like the popular rock star Powerline and interrupts the assembly to perform Powerline's hit song \"Stand Out\" before the entire student body.", "Additionally, Max seeks to gain the attention of his crush, a popular girl named Roxanne, whom Max is convinced only ever '[looks] right through [him]' and believes the laugh he inherited from his father (\"ah-hyuck\") is to her disliking.", "Though Max ends up in detention for hijacking the assembly, he succeeds in not only impressing the other students but also winning the affections of Roxanne, who shyly yet delightedly agrees to go with him to a party that is to be held the next Saturday.", "However, the principal informs Max's father, Goofy, about Max's behavior and, fearful that his son is becoming a delinquent, Goofy decides to take Max on a cross-country fishing trip for some 'father-son bonding', much to Max's chagrin." ] ], "gold": "A Goofy Movie is a 1995 American animated musical comedy film that revolves around the father-son relationship between Goofy and his 14-year-old son Max as they embark on a misguided mission to bond together in the middle of a cross-country fishing trip. Different people voiced the character of Max during the production of the movie. Jason Marsden, who was in high-school at the time, was the primary voice actor, while Aaron Lohr worked on his singing voice.", "prediction 1": "A Goofy Movie is a 1995 musical comedy drama animated film. The film features the voices of Jason Marsden, Bill Farmer, Jim Cummings, Kellie Martin, Pauly Shore, Jenna von O, and Wallace Shawn, and prominently features the singing voice of Tevin Campbell as Powerline, a fictional pop star.", "prediction 2": "Max Goof is the voice of Max in the 1995 animated musical comedy drama film A Goofy Movie. The film was the animated directorial debut of Kevin Lima, and is based on the television series Goof Troop created by Mike Peraza. Jason Marsden, Bill Farmer, Jim Cummings, Kellie Martin, Pauly Shore, Jenna von O, and Wallace Shawn do the voices of Max and Powerline. Tevin Campbell does the voice of Powerline.", "prediction 3": "Max Goof is a fictional character in the 1995 animated musical comedy drama film, A Goofy Movie, and the film's director is Kevin Lima, with voices by Jason Marsden, Bill Farmer, Jim Cummings, Kellie Martin, Pauly Shore, Wallace Shawn, and Wallace Shawn, and prominently features the singing voice of Tevin Campbell as the pop star Powerline.", "prediction 4": "The voice of Max Goof in A Goofy Movie is done by Jason Marsden. He is the son of Goofy and Max, who is now in high school and has grown to find his dad's goofy antics embarrassing. He also finds his peers' opinion of him as a geek and a goof.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 290 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A Goofy Movie is a 1995 musical comedy drama animated film. It revolves around the father-son relationship between the two as Goofy takes Max on a fishing trip out of fear that Max is drifting away from him. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When did italy last win the world cup in soccer?", "passages": [ [ "Wales at the FIFA World Cup", "Wales at the FIFA World Cup\n\nThe FIFA World Cup is an international association football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body.", "The championship has been contested every four years since the first tournament in 1930, except in 1942 and 1946, due to World War II.", "The Wales national football team has entered every World Cup since the 1950 tournament, but to date has only qualified for one World Cup, in 1958.", "On that occasion, they reached the quarter-finals before being eliminated by eventual winners Brazil.", "During the preparations for the 1928 Olympic Football Tournament, FIFA ruled that all its member associations must provide \"broken time\" payments to cover the expenses of players from their country who participated.", "In response to what they considered to be unacceptable interference, the football associations of Wales, England, Ireland and Scotland held a meeting at which they agreed to resign from FIFA.", "As a result, Wales did not compete in the three interwar World Cup competitions.", "The Football Association of Wales did not rejoin FIFA as a permanent member until 1946.", "The 1949\u201350 British Home Championship was used as the qualifying group for the four British teams ahead of the 1950 FIFA World Cup, with the top two qualifying for the finals in Brazil." ], [ "Italy at the FIFA World Cup", "Italy at the FIFA World Cup\n\nThis is a record of Italy's results at the FIFA World Cup.", "The World Cup is an international association football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the first tournament in 1930, except in 1942 and 1946, due to World War II.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the Finals, is used to determine which teams qualify for the Finals.", "The current format of the Finals involves 32 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1 million people watching the 2006 tournament final.", "Italy is one of the most successful national teams in the history of the World Cup, having won four titles (1934, 1938, 1982, 2006), just one fewer than Brazil.", "The team was present in 18 out of the 21 tournaments, reaching six finals, a third place and a fourth place." ] ], "gold": "The World Cup is an international association football competition contested by the men's national teams of the members of F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's global governing body. The last time Italy won the World Cup in soccer was 2006.", "prediction 1": "Italy has won the FIFA World Cup multiple times. Their most recent victory came in 2006, when they defeated the United States 1-0 in the opening match of the tournament.", "prediction 2": "The FIFA World Cup is an international association football competition contested by the men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association, the sport's global governing body. Italy has won the World Cup four times, in 1934, 1938, 1982 and 2006. The last time Italy won the World Cup was in 1958, when they reached the quarter-finals before being eliminated by eventual winners Brazil.", "prediction 3": "The FIFA World Cup is an international association football competition contested by the men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association, the sport's global governing body. Italy has won the FIFA World Cup four times. The last time Italy won the World Cup in soccer was in 1934. However, Italy has only qualified for one World Cup, in 1958, when they reached the quarter-finals before being eliminated by eventual winners Brazil.", "prediction 4": "The FIFA World Cup is an international association football competition contested by the men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's global governing body. Italy last won the World Cup in soccer in 1934, 1938, 1982, and 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 48 }, { "error type": "Unverifiable", "explanation": "", "start": 94, "end": 169 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The World Cup is an international association football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body. Italy has won the FIFA World Cup multiple times. Italy's most recent victory came in 2006." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "How many videos is maddie in with sia?", "passages": [ [ "Maddie Ziegler", "Ziegler danced to Sia's vocals on several television shows in 2014 and 2015, including \"The Ellen DeGeneres Show\", \"Dancing with the Stars\", \"Jimmy Kimmel Live!\"", "and \"Saturday Night Live\", as well as at the Hollywood Bowl.", "By the end of 2015, Ziegler had performed with Sia on the \"Ellen DeGeneres Show\" three times.", "She also performed to \"Chandelier\", alongside Sia and Kristen Wiig, at the 2015 Grammy Awards.", "The \"Chandelier\" and \"Elastic Heart\" videos were both selected as part of PopSugar's 2016 list of \"25 of the Best Dance Videos of the Last Decade\".", "In 2016, Ziegler starred in a fourth Sia video, \"Cheap Thrills\", from the album \"This Is Acting\".", "A \"Teen Vogue\" reviewer wrote that Ziegler \"delivers another powerful performance\".", "This was followed by a fifth Sia video, later that year, for \"The Greatest\".", "The video of the song has accumulated more than 500 million YouTube views.", "Reviewing Ziegler's performance, Kathleen Hildebrand wrote in \"S\u00fcddeutsche Zeitung\" that anyone who has seen Ziegler's \"iconic\" movement will never again return to \"boringly ordinary\" MTV videos." ], [ "Maddie Ziegler", "Maddie Ziegler\n\nMadison Nicole Ziegler ( ; born September 30, 2002), is an American dancer, actress and model.", "She first became known for appearing in Lifetime's reality show \"Dance Moms\" from 2011 (at age 8) until 2016.", "From 2014 to 2017, she gained wider fame for starring in a series of music videos by Sia, including \"Chandelier\" and \"Elastic Heart\", which cumulatively have attracted more than 4 billion views on YouTube.", "Ziegler has appeared in films, television and concerts, and has modeled on magazine covers and in advertisements for Capezio, Ralph Lauren and Target, among other brands.", "She was included by \"Time\" magazine on its list of the \"30 most influential teens\" in each of 2015, 2016 and 2017.", "Ziegler was a judge on the 2016 season of \"\", toured with Sia in North America and Australia in 2016 and 2017 and toured in Australia and New Zealand with her sister, Mackenzie, in 2017 and 2018.", "Her 2017 memoir, \"The Maddie Diaries\", was a \"New York Times\" Best Seller.", "She voiced the character Camille Le Haut in the animated film \"Ballerina\" (2016) and appeared as Christina Sickleman in the feature film \"The Book of Henry\" (2017)." ], [ "The Greatest (Sia song)", "The Greatest (Sia song)\n\n\"The Greatest\" is a song recorded by Australian singer and songwriter Sia for the deluxe edition of her seventh studio album, \"This Is Acting\" (2016).", "Being made available for digital consumption as the record's third single on 5 September 2016 through Monkey Puzzle and RCA Records, \"The Greatest\" features the vocal collaboration of American rapper Kendrick Lamar.", "The electropop and tropical house song was written by Sia, Greg Kurstin, and Lamar while production was solely handled by Kurstin.", "The solo version was written solely by the former two.", "The song was initially supposed to be in a new album called \"We Are Your Children\".", "An accompanying music video for the single was filmed by Sia and Daniel Askill, and portrays American dancer Maddie Ziegler among 48 others.", "Although the singer has not provided an interpretation of the video's plot, numerous media outlets have perceived it as a tribute to the 49 victims of the Orlando nightclub shooting.", "Commercially, \"The Greatest\" reached the top five in several countries and was awarded with certifications in various territories.", "The music video was nominated for a 2017 MTV Video Music Award for Best Choreography.", "\"Billboard\" editor Gil Kaufman described \"The Greatest\" as an \"uplifting, poppy song with a subtle island vibe.\"" ] ], "gold": "Maddie Ziegler has danced to songs performed by Sia in multiple music videos and on television shows. She starred in three videos from Sia's 100 Forms of Fear album, and, in total, she has been in five. She has been associated with seven of Sia's music videos either as a songwriter or singer. Maddie has also danced to Sia's vocals on several television shows, including three times on the Ellen DeGeneres Show.", "prediction 1": "American dancer, actress and model Maddie Ziegler has appeared in several videos with Sia. In 2014, she appeared in a series of music videos with Sia, including Chandelier and Elastic Heart, which cumulatively have attracted more than 4 billion views on YouTube. In 2016, she starred in a fourth Sia video, Cheap Thrills, from the album This Is Acting. In 2017, she appeared in a fifth Sia video, later that year, for \"The Greatest\". The music video for \"Chandelier\" and \"Elastic Heart\", which cumulatively have attracted more than 4 billion views on YouTube.", "prediction 2": "American dancer, actress and model Maddie Ziegler has appeared in several music videos with Sia, including Cheap Thrills, The Greatest, The Dance Moms, The Dancers, and More. Sia also released two singles, Sia and The Greatest, in 2016. The Greatest is a song recorded by Australian singer and songwriter Sia for the deluxe edition of her seventh studio album This Is Acting. This song was originally supposed to be in a new album called \"We Are Your Children\". However, the video was filmed by Sia and Daniel Askill, and portrays American dancer Maddie Ziegler among 48 others.", "prediction 3": "Maddie Ziegler has appeared in multiple videos with Sia. The dancer appeared in five music videos with Sia, including Chandelier, Cheap Thrills, The Greatest, and Elastic Heart. In 2017, she appeared in a fifth music video, for the song The Greatest, which features dancer Maddie Ziegler, and the music video for the song was directed by Daniel Askill.", "prediction 4": "Maddie Ziegler has been in several videos with Sia. She first became known for appearing in Lifetime's reality show Dance Moms from 2011 to 2016. During this time she gained wider fame for starring in a series of music videos by Sia, including Cheap Thrills and The Greatest, both of which have attracted more than 4 billion views on YouTube. In 2016, she starred in a fourth Sia video, Cheap Thrills, from the album This Is Acting. In 2017, she starred in a video for The Greatest, which features American rapper Kendrick Lamar and also.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 191, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 352 }, { "error type": "Redundant", "explanation": " In 2014, she appeared in a series of music videos with Sia, including Chandelier and Elastic Heart, which cumulatively have attracted more than 4 billion views on YouTube. ", "start": 434, "end": 559 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "American dancer, actress and model Maddie Ziegler has appeared in several videos with Sia. Ziegler danced to Sia's vocals on several television shows in 2014 and 2015, including \"The Ellen DeGeneres Show\", \"Dancing with the Stars\", \"Jimmy Kimmel Live!\" In 2014, she appeared in a series of music videos with Sia, including Chandelier and Elastic Heart. In 2016, she starred in a fourth Sia video, Cheap Thrills. In 2017, she appeared in a fifth Sia video, later that year, for \"The Greatest\". " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Dil hai ki manta nahi is remake of?", "passages": [ [ "Dil Hai Ke Manta Nahin", "Dil Hai Ke Manta Nahin\n\nDil Hai Ke Manta Nahin (English: \"The Heart Is Such, It Doesn't Agree\") is a 1991 Indian Hindi-language romantic comedy film.", "It was produced by Gulshan Kumar, directed by Mahesh Bhatt, and starred his daughter Pooja Bhatt in her first major lead female role, while the lead male role was played by Aamir Khan.", "Supporting roles were played by Anupam Kher, Sameer Chitre, and Tiku Talsania, while Deepak Tijori made a special appearance.", "The movie was commercially not successful at the box office.", "The movie revolves around a spoilt heiress who runs away from home to marry a gold-digging film star.", "En route, she is helped by a smart-alecky journalist only to end up falling for him.", "It is an unofficial remake of the 1956 Bollywood film \"Chori Chori\" and 1966 Tamil language film \"Chandhrodhayam\", which in turn were adaptations of the 1934 Hollywood film \"It Happened One Night\".", "In turn, \"Dil Hai Ke Manta Nahin\" was remade in Tamil as \"Kadhal Rojavae\" (2000) and inspired the Kannada movie \"Hudugaata\" (2007)." ], [ "Chori Chori", "Chori Chori\n\nChori Chori (Hindi: \u091a\u094b\u0930\u0940 \u091a\u094b\u0930\u0940; English: \"Surreptitiously\") is a 1956 Indian Hindi-language romantic comedy film directed by Anant Thakur, with music by Shankar Jaikishan and lyrics by Hasrat Jaipuri and Shailendra.", "The film is an unofficial remake of the American film \"It Happened One Night\".", "Bhagwan Dada, Pran, David, and Johnny Walker have character parts.", "This was the last film of Nargis-Raj Kapoor, with Nargis doing one cameo appearance in the Raj Kapoor starrer Jagte Raho.", "The music of \"Chori Chori\" had popular tracks including \"Aaja Sanam\", \"Yeh Raat Bheegi Bheegi\" in the voices of Lata Mangeshkar and Manna Dey; \"Jahan Mein Jati Hun\" by Lata and Manna and \"Sawa Lakh Ki Lottery,\" by Mohammad Rafi.", "The movie would later inspire the unofficial 1991 Hindi re-make \"Dil Hai Ke Manta Nahin\", directed by Mahesh Bhatt and starring Aamir Khan and Pooja Bhatt.", "Like \"Chori Chori\" it too became a hit." ], [ "Chandhrodhayam", "The reporter is helped in his quest by a friend, a photographer of the newspaper, Alwar (Nagesh), (a husband who is often corrected by his wife Ahalya (Manorama).", "Chandran wants at all costs to help another young woman wounded cruelly by life since her birth, Kamala (Bharathi Vishnuvardhan).", "She had previously been a victim of a predator, the rich Paranthaman (M. N. Nambiar).", "Chandra puts everything in its place by uniting Kamala with Paranthaman and he himself marrying Devi, with the blessings of the elders from both the families.", "Duriyothanan regrets his misdeeds and asks Chandran to start a new newspaper and name it as he wants.", "The newspaper is named \"Chandrodayam\", the first issue carrying the wedding news of Chandran and Devi.", "The casting is established according to the original order of the credits of opening of the movie, except those not mentioned\n\nThe film was inspired by the 1934 American film \"It Happened One Night\".", "The climactic fight sequence between M. N. Nambiar and MGR was shot with the use of only one light source: a rolling, broken small table lamp.", "The soundtrack is composed by M. S. Viswanathan." ] ], "gold": "\"Dil Hai Ke Manta Nahi\" is an unofficial remake of the 1956 Hindi film \"Chori Chori\" and 1966 Tamil film \"Chandhrodhayam\". Both those films are remakes of the 1934 American film \"It Happened One Night\". ", "prediction 1": "Dil Hai Ke Manta Nahin is a 1991 Indian Hindi-language romantic comedy film. It was produced by Gulshan Kumar, directed by Mahesh Bhatt, and starred his daughter Pooja Bhatt in her first major lead female role. The movie revolves around a spoilt heiress who runs away from home to marry a gold-digging film star. The movie was commercially not successful at the box office. The 1956 Bollywood film Chori Chori is an unofficial remake of the 1956 Bollywood film Chori Chori Chori and 1966 Tamil language film Chandhrodhayam, which in turn were adaptations of the 1934 Hollywood film It Happened One Night.", "prediction 2": "Dil Hai Ke Manta Nahin is an unofficial remake of the 1956 Bollywood film Chori Chori and the 1966 Tamil language film Chandhrodhayam, which in turn were adaptations of the 1934 Hollywood film It Happened One Night. Dil Hai Ke Manta Nahin was remade in Tamil as Kadhal Rojavae in 2000 and inspired the Kannada movie Hudugaata in 2007.", "prediction 3": "Chori Chori is a 1956 Indian Hindi-language romantic comedy film directed by Anant Thakur, with music by Shankar Jaikishan and lyrics by Hasrat Jaipuri and Shailendra. It is an unofficial remake of the 1934 American film It Happened One Night. Dil Hai Ke Manta Nahin is a 1991 Indian Hindi-language romantic comedy film. It was produced by Gulshan Kumar, directed by Mahesh Bhatt, and starred his daughter Pooja Bhatt in her first major lead female role.", "prediction 4": "Chori Chori Chori is a 1956 Indian Hindi romantic comedy film directed by Anant Thakur, with music by Shankar Jaikishan and lyrics by Hasrat Jaipuri and Shailendra. The film is an unofficial remake of the 1934 American film It Happened One Night. Dil Hai Ke Manta Nahin is an unofficial remake of the 1991 Indian Hindi-language romantic comedy film. In turn, Dil Hai Ke Manta Nahin was remade in Tamil as Kadhal Rojavae (2000) and inspired the Kannada movie Hudugaataataataata Nahin.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 76 }, { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 373 } ], "missing-info": [], "corrected-prediction": "The 1956 Bollywood film Chori Chori is an unofficial remake of the 1956 Bollywood film Chori Chori Chori and 1966 Tamil language film Chandhrodhayam, which in turn were adaptations of the 1934 Hollywood film It Happened One Night." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When was tahiti village in las vegas built?", "passages": [ [ "Tahiti Village", "Additional towers, as high as 11 stories, were planned for the back portion of the 27-acre property.", "The timeshare was ultimately expected to feature 1,046 rooms, generating sales of more than $1.5 billion.", "Amenities included a pool and beach, as well as a lounge, concierge, and spa.", "Michael Kaplan, chairman of Consolidated Resorts, said at the time, \"We assembled 27 acres in the last three years and we had offers of two and three times what we paid for the land before we even started construction.", "I can't believe the value of the land out there.", "You look at that location, it's as close to the Strip as you can get.\"", "Tahiti Village's second phase began construction in September 2006, with a 10-story 284-unit tower.", "At that time, the resort was expected to ultimately feature 1,083 units.", "The second phase, consisting of three 10-story towers, was topped off in July 2007.", "The second phase also included a seven-story parking garage.", "In 2007, Alan Thicke and Tanya Roberts appeared in a Tahiti Village infomercial titled \"Second Honeymoon\", produced in the style of a game show featuring timeshare purchasers.", "Thicke also appeared in a 2007 television commercial for the resort." ], [ "Tahiti Village", "A Polynesian-themed restaurant, Tahiti Joe's, operated on the second floor of the resort.", "In July 2009, Consolidated Resorts filed for bankruptcy.", "Operations at Tahiti Village continued despite the filing.", "In August 2010, Arthur Spector Companies acquired the remaining timeshare inventory and operating assets of Tahiti Village.", "In June 2014, Tahiti Village opened 17\u00b0 South, a tropical-themed restaurant and bar, named after the Polynesian islands located 17 degrees south of the equator.", "In August 2014, the restaurant was opened to the public; restaurants at the resort were previously for guests only.", "In November 2014, the new Mahana Spa opened on the ninth floor of Tower Five." ], [ "Tahiti Village", "Tahiti Village\n\nTahiti Village is a Tahitian-themed timeshare resort located on of land at 7200 South Las Vegas Boulevard, south of the Las Vegas Strip, in Enterprise, Nevada.", "Tahiti Village was announced by Consolidated Resorts Inc. on March 7, 2003, as a $200 million 580-unit timeshare resort to be developed on of land at the southeast corner of South Las Vegas Boulevard and Arby Avenue.", "Sales were expected to begin in July or August 2003, with groundbreaking expected to take place in September 2003.", "Consolidated Resorts, which owned timeshares in Las Vegas and in Hawaii, planned to construct the resort in three or four phases, with the first phase scheduled for an August 2004 completion.", "The resort's buildings would range between two and eight stories.", "No casino was planned for inclusion on the property.", "The resort's appearance was to be similar to the Tahiti, another one of the company's timeshare projects in Las Vegas.", "By July 2004, the project was expected to feature a total of 975 units.", "The $60 million first phase was topped off in September 2005, with the first three buildings standing five and six stories high and offering 154 two-bedroom units, with the potential to split them into 308 one-bedroom units.", "The six-story towers were scheduled for completion in March 2006." ] ], "gold": "The $60 million first phase of Tahiti Village in Las Vegas was completed in September 2005. Tahiti Village's second phase began construction and was completed between September 2006-July 2007 with three ten-story towers being built. This second phase also included a seven-story parking garage. In June 2014, Tahiti Village opened 17\u00b0 South, a tropical-themed restaurant and bar, named after the Polynesian islands located 17 degrees south of the equator.", "prediction 1": "Tahiti Village in Las Vegas is a timeshare resort located in Enterprise, Nevada. It was announced by Consolidated Resorts Inc. on March 7, 2003, as a $200 million 580-unit timeshare resort to be developed on of land at the southeast corner of South Las Vegas Boulevard and Arby Avenue. Sales were expected to begin in July or August 2003, with groundbreaking expected to take place in September 2003. The $60 million first phase was topped off in September 2005, with the first three buildings standing five and six stories high and offering 154 two-bedroom units, with the potential to split into 308 one-bedroom units. The six-story towers were scheduled for March 2006.", "prediction 2": "Tahiti Village is a timeshare resort located on land at 7200 South Las Vegas Boulevard, south of the Las Vegas Strip. Sales were expected to begin in July or August 2003, with groundbreaking expected to take place in September 2003. The resort's first phase was topped off in August 2004 with buildings ranging between two and eight stories. The second phase, consisting of three 10-story towers, was topped off in July 2007.", "prediction 3": "Tahiti Village is a $90 million timeshare resort located on 7200 South Las Vegas Boulevard, south of the Las Vegas Strip, in Enterprise, Nevada. Sales were expected to begin in July or August 2003, with groundbreaking expected to take place in September 2003. The first phase of the resort was topped off in September 2005, with the first three buildings standing five and six stories high and offering 154 two-bedroom units, with the potential to split 308 one-bedroom units. The six-story towers were scheduled for completion in March 2006.", "prediction 4": "Tahiti Village in Las Vegas was announced on March 7, 2003, as a $200 million 580-unit timeshare resort to be developed on of land at the southeast corner of South Las Vegas Boulevard and Arby Avenue. Sales were expected to begin in July or August 2003, with groundbreaking expected to take place in September 2003. The resort's second phase began construction in September 2006, with a 10-story 284-unit tower. At that time, the resort was expected to ultimately feature 1,083 units.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 28, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 285 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 463, "end": 620 }, { "error type": "Irrelevant", "explanation": "", "start": 621, "end": 672 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7, 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Tahiti Village in Las Vegas, had its $60 million first phase topped off in September 2005. Tahiti Village's second phase began construction in September 2006 and was topped off in July 2007, consisting of three 10-story towers. The second phase also included a seven-story parking garage. In June 2014, Tahiti Village opened 17\u00b0 South, a tropical-themed restaurant and bar, named after the Polynesian islands located 17 degrees south of the equator." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who's the head coach for the kansas city chiefs?", "passages": [ [ "Pittsburgh Steelers", "Noll's career record with Pittsburgh was 209\u2013156\u20131.", "In 1992, Chuck Noll retired and was succeeded by Kansas City Chiefs defensive coordinator Bill Cowher, a native of the Pittsburgh suburb of Crafton.", "Cowher led the Steelers to the playoffs in each of his first six seasons, a feat that had been accomplished only by legendary coach Paul Brown of the Cleveland Browns.", "In those first six seasons, Cowher coached them as deep as the AFC Championship Game three times and following the 1995 season an appearance in Super Bowl XXX on the strength of the \"Blitzburgh\" defense.", "However, the Steelers lost to the Dallas Cowboys in Super Bowl XXX, two weeks after a thrilling AFC Championship victory over the Indianapolis Colts.", "Cowher produced the franchise's record-tying fifth Super Bowl win in Super Bowl XL over the National Football Conference champion Seattle Seahawks ten years later.", "With that victory, the Steelers became the third team to win five Super Bowls, and the first sixth-seeded playoff team to reach and win the Super Bowl since the NFL expanded to a 12-team post-season tournament in 1990.", "He coached through the 2006 season which ended with an 8\u20138 record, just short of the playoffs.", "Overall Cowher's teams reached the playoffs 10 of 15 seasons with six AFC Championship Games, two Super Bowl berths and a championship." ], [ "Romeo Crennel", "Following Todd Haley's termination as the team's head coach after 13 games in the 2011 season, Crennel was named the team's interim head coach for the remaining three games of the season.", "Crennel won his first game as the interim head coach of the Chiefs on December 18, 2011 against the then undefeated Green Bay Packers 19\u201314, which was significant as Crennel snapped the Packers' 19-game winning streak and ended their hopes for a perfect season.", "Crennel finished his stint as interim head coach with a 2\u20131 record.", "However, in his tenure as a head coach for the Chiefs, Crennel would only win 2 more games finishing with a 4\u201315 overall record.", "On January 9, 2012 Crennel was named the Chiefs' permanent head coach.", "Three days later, Crennel announced his intent to remain as defensive coordinator during his tenure as head coach.", "On November 5, 2012, Crennel announced he would be stepping down as defensive coordinator and named linebackers coach Gary Gibbs to the vacant position, after a 1\u20137 start to the season.", "On December 1, 2012, Crennel attempted to prevent the suicide of player Jovan Belcher by talking to him and witnessed his death by a self-inflicted gunshot wound to the head." ], [ "Derrick Johnson", "The following week, he tied his season-high of 13 combined tackles (ten solo), deflected a pass, made a sack, and an interception during a 23\u201320 win \nagainst the San Diego Chargers in Week 8.", "On December 13, 2011, the Kansas City Chiefs fired head coach Todd Haley after a 35\u201310 loss to the New York Jets made them fall to a 5\u20138 record.", "Defensive coordinator Romeo Crennel was named the interim head coach for the remainder of the season.", "On December 27, 2011, it was announced that Johnson was voted to the 2012 Pro Bowl.", "He was selected to the Pro Bowl for the first time in his career and was also named first-team All-Pro.", "Johnson started in all 16 games and made a career-high 131 combined tackles (104 solo), nine pass deflections, two sacks, two interceptions, and a forced fumble.", "The Kansas City Chiefs chose to promote interim head coach/defensive coordinator Romeo Crennel to their full-time head coach.", "Crennel retained the base 3-4 defense and named Johnson and Javon Belcher the starting inside linebackers to begin the regular season.", "The pair were joined by outside linebackers Justin Houston and Tamba Hali." ], [ "Kansas City Chiefs", "On January 23, 2009, Herman Edwards was fired as head coach, and two weeks later Todd Haley signed a four-year contract to become Edwards' successor.", "Haley had a background with Pioli, which made him an attractive hire for Pioli's first coach in Kansas City.", "In April 2009 Tony Gonzalez was traded to the Atlanta Falcons after failed trade attempts over the previous two seasons.", "Notably, head coach Todd Haley fired offensive coordinator Chan Gailey just weeks before the start of the 2009 season and chose to take on the coordinator duties himself.", "Throughout 2009 the Chiefs acquired veterans to supplement the Chiefs' young talent including Matt Cassel, Mike Vrabel, Bobby Engram, Mike Brown, Chris Chambers, and Andy Alleman.", "The team finished with a 4\u201312 record, just a two-game improvement upon their record from the 2008 season.", "For the 2010 season, the Chiefs made significant hires for their coaching staff, bringing on former Patriots assistant coaches Charlie Weis and Romeo Crennel to coach the offense and defense, respectively.", "The coaching additions proved to be very successful, as the Chiefs would go on to secure their first AFC West title since 2003.", "Their ten victories in the 2010 season combined for as many as the team had won in their previous three seasons combined.", "On January 9, 2011, the Chiefs lost their home Wild Card playoff game to the Baltimore Ravens 30\u20137." ], [ "Todd Haley", "Palko proved to be inadequate as a backup to a merely serviceable Cassel, leading many to question how a team with legitimate playoff hopes entering the 2011 season had remained so thin at so many key positions during the off-season, especially at quarterback and safety, where the Chiefs' lack of depth was more than woeful.", "Haley was fired on December 12, 2011, after leading his team to a 5\u20138 record during the 2011 NFL season.", "The 2011 season began with three losses, including two blow-outs to Detroit and Buffalo.", "The team appeared to regroup, winning four straight games, before losing the next 5 of 6, including a complete team collapse in Haley's final game against the New York Jets.", "Late in that game Haley was flagged for an unsportsmanlike conduct penalty, allowing the Jets to complete a touchdown drive that ultimately put the game out of reach.", "After the loss, defensive coordinator Romeo Crennel was promoted to replace Haley.", "On February 7, 2012, the Steelers announced that Haley would be the team's new offensive coordinator.", "Haley grew up in the Pittsburgh suburb of Upper Saint Clair, Pennsylvania, and his father was the Steelers' former personnel director.", "He is the first offensive coordinator in 13 years to be hired from outside the organization." ], [ "Andy Reid", "Andy Reid\n\nAndrew Walter Reid (born March 19, 1958) is an American football coach who is the current head coach of the Kansas City Chiefs of the National Football League (NFL).", "Reid was previously the head coach of the Philadelphia Eagles, a position he held from 1999 to 2012.", "From 2001 to 2012, he was also the Eagles' executive vice president of football operations, effectively making him the team's general manager.", "He led the Eagles to five National Football Conference (NFC) championship games, including four consecutive appearances from 2001\u20132004, and one Super Bowl appearance in 2004.", "Reid played college football at Brigham Young University.", "Born in Los Angeles, California, Reid attended John Marshall High School and worked as a vendor at Dodger Stadium as a teenager.", "He also played youth sports in East Hollywood at Lemon Grove Recreation Center, and among his coaches was Pete Arbogast, who is the radio announcer for the USC football team, and formerly the radio play-by-play man for the Cincinnati Bengals.", "In 1971, at age 13, Reid appeared live on \"Monday Night Football\" during the Punt, Pass, and Kick competition.", "Reid played offensive tackle at Glendale Community College in Glendale, California.", "Reid played offensive tackle at Brigham Young University from 1978 to 1980 where he was a teammate of Jim McMahon." ] ], "gold": "Andy Reid is the current head coach for the Kansas City Chiefs. In his eight seasons with the Kansas City Chiefs, Reid has led the Chiefs to seven postseason appearances, five division titles, three AFC Championship Games, two Super Bowl appearances and one Super Bowl title in Super Bowl LIV, the franchise's first title in 50 years and his first title as a head coach. Prior to Reid, Romeo Crennel was the head coach for the Kansas City Chiefs. On January 9, 2012 Crennel was named the 11th full-time head coach in Kansas City Chiefs history. Three days later, Crennel announced his intent to remain as defensive coordinator during his tenure as head coach. However, on November 5, 2012, Crennel announced he would be stepping down as defensive coordinator after a 1\u20137 start to the season. Then, on December 31, 2012, Crennel was fired as head coach. Prior to Crennel, Todd Haley was head coach for the Kansas City Chiefs. Haley served as the head coach for the Kansas City Chiefs from 2009 to 2011. On December 12, 2011, Haley was fired after leading the team to a 5\u20138 record during the 2011 NFL season.", "prediction 1": "The Kansas City Chiefs have had several head coaches since the 1970s. Chuck Noll was the head coach from 1988 to 1992, Bill Cowher from 1993 to 1996, and Romeo Crennel from 2011 to 2012. Derrick Johnson was the head coach from 2009 to 2012 and Tony Gonzalez from 2013 to 2014.\n", "prediction 2": "The Kansas City Chiefs have had a multitude of different coaches, incl. Todd Haley in 2009, Herman Edwards in 2010, and Bill Cowher from 2010 to 2012. The current head coach for the Kansas City Chiefs is Romeo Crennel, who ran the defense during the 2011-2012 season and won his first game as the interim head coach on December 18, 2011.", "prediction 3": "Chuck Noll was the legendary head coach of the Pittsburgh Steelers from 1975 to 1992. From 1992 to 2011, the Kansas City Chiefs appointed Defensive Coordinator Romeo Crennel as their first interim head coach. Crennel coached until the end of the 2011 season and was fired by Todd Haley after a 31\u201332 loss to the New York Jets ended their perfect season. Crennel served from 2011 to 2012 as the interim head coach until 2012. On December 13, 2011, the Kansas City Chiefs fired head coach Todd Haley after a 13 games in the team's last game of the regular season.", "prediction 4": "Every team has had at least one head coach, beginning with the Kansas City Chiefs in 1990 under Chuck Noll. In 1992, Noll retired and was succeeded by Kansas City Chiefs defensive coordinator Bill Cowher. Cowher led the Chiefs to the playoffs in each of his first six seasons and produced the franchise's record-tying fifth Super Bowl win in Super Bowl XL over the Seattle Seahawks ten years later. On December 13, 2011, the Kansas City Chiefs fired head coach Todd Haley after a 35\u201310 loss to the New Jersey Jets made them fall to a 5\u20138 record. Crennel was promoted in September 2013. On December 1, 2012, Crennel announced his intent to remain as defensive coordinator during his tenure as head coach for the rest of the remainder of the season. Crennel was promoted to his permanent head coach on March 7, 2013.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 53, "end": 69 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,2,3]}", "start": 70, "end": 118 }, { "error type": "Unverifiable", "explanation": "", "start": 119, "end": 149 }, { "error type": "Unverifiable", "explanation": "", "start": 181, "end": 186 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6,7]}", "start": 211, "end": 221 }, { "error type": "Unverifiable", "explanation": "", "start": 244, "end": 277 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6, 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 6, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Kansas City Chiefs have had several head coaches. On January 9, 2012 Romeo Crennel was named the Chiefs' permanent head coach. Three days later, Crennel announced his intent to remain as defensive coordinator during his tenure as head coach. On November 5, 2012, Crennel announced he would be stepping down as defensive coordinator, after a 1\u20137 start to the season. Prior to Crennel, Todd Haley was the head coach, who was with the team since at least 2009. On December 13, 2011, the Kansas City Chiefs fired Haley due to their 5\u20138 record season. Andy Reid is the current head coach of the Kansas City Chiefs." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did val kilmer go to high school?", "passages": [ [ "Val Kilmer", "In 1977 Kilmer's younger brother Wesley drowned in a swimming pool at age 15; their father died in 1993.", "Kilmer attended Berkeley Hall School, a Christian Science school in Los Angeles, until ninth grade.", "He attended Chatsworth High School with Kevin Spacey and Mare Winningham, and also attended the Hollywood Professional School.", "He became the youngest person at the time to be accepted into the Juilliard School's Drama Division, where he was a member of Group 10.", "In 1981, while at Juilliard, Kilmer co-authored and starred in the play \"How It All Began,\" which was performed at the Public Theater at the New York Shakespeare Festival.", "Kilmer turned down a role in Francis Ford Coppola's 1983 film \"The Outsiders,\" as he had prior theatre commitments.", "In 1983 he appeared off Broadway in \"The Slab Boys\" with Kevin Bacon and Sean Penn.", "That same year, his first off-stage acting role (excluding television commercials) came in the form of an episode of \"ABC Afterschool Special\" called \"One Too Many,\" which was an educational drama on drinking and driving; it also starred a young Michelle Pfeiffer.", "Also in 1983, Kilmer self-published a collection of his own poetry entitled \"My Edens After Burns,\" that included poems inspired by his time with Pfeiffer." ], [ "Chatsworth High School", "Chatsworth High School\n\nChatsworth Charter High School is a charter secondary school located in Chatsworth in the San Fernando Valley of Los Angeles, California, U.S.", "The campus was built with one-story buildings around a central quad as land was inexpensive and an open, outdoor feeling was consistent with the area.", "The administration building anchors the southeast end of the quad, while the cafeteria and auditorium anchors the northwest end.", "Athletics are on the other side of the internal roadway.", "Chatsworth's Chancellor band was the last LAUSD band to go to the Pasadena Tournament of Roses Parade, January 1, 1969.", "as the system of selecting a schools band was changed to selecting players from each band.", "The band was led by music teacher Irwin Pope, and co-drum majors, Eric Micko and Loring Kutchins.", "Chatsworth's Drama Department participates in Fall and Shakespeare DTASC Festivals every year, earning recognition in acting and technical design.", "The department puts on a production every year and is Thespian Troupe #2314 in the National Honor Thespian Society.", "Many notable alumni artists have come out of Chatsworth High School's Drama Department such as Val Kilmer, Mare Winningham and Kevin Spacey.", "Spacey recently co-produced a documentary airing on HBO, \"Shakespeare High\" featuring Chatsworth's Drama Department." ], [ "Big Apple Academy", "Big Apple Academy\n\nBig Apple Academy is a coeducational independent school for students, including the range from Pre-K through 8th grade.", "The Academy occupies two modern facilities located in the Gravesend area of Brooklyn, New York City.", "It is a private educational institution.", "The Big Apple Academy takes its roots in the affiliated Bambi Academy, a Day Care Center founded by and oriented mostly towards Russian-speaking immigrants.", "Due to the success of the program, it was decided to expand the institution's goals.", "In 1992 the first Kindergarten class was opened, and the school matured into a large educational center \u2013 Big Apple Academy.", "The school created its own curricula, developed new teaching methods, and purchased equipment.", "Today Big Apple Academy includes curricula for kindergarten through 8th grade\n\nThe Big Apple Academy comprises the following departments:\n\n", "Admission decisions are based on an applicant\u2019s school records, entrance exams (English, Math), and a personal interview.", "The curriculum is based on the standards of learning for K-12 NY schools by the New York State Department of Education, as well as those provided by various national pedagogical organizations.", "Starting in kindergarten, children have 40-minute lessons with subject teachers in English, Math, Computer Science, Science, Social Studies, Art, Music, Russian Language and P.E., which includes swimming and standard athletic exercises." ] ], "gold": "Val Kilmer attended high school in Los Angeles, beginning with his freshman year at Christian Science school Berkeley Hall School. Afterwards, he attended charter school Chatsworth High School and the Hollywood Professional School, where many children working in the Los Angeles entertainment business studied. He then became the youngest person at the time to be accepted to Juilliard School's Drama Division.", "prediction 1": "Val Kilmer attended Chatsworth High School, a charter secondary school located in Chatsworth, in the San Fernando Valley of Los Angeles, California, United States. The school's Drama Department participates in Fall and Shakespeare DTASC Festivals every year, earning recognition in acting and technical design.", "prediction 2": "Val Kilmer attended a variety of high schools in Los Angeles, including Chatsworth High School, Big Apple Academy, and Hollywood Professional School. Kilmer attended Berkeley Hall School, a Christian Science school in Los Angeles, until ninth grade. He also attended Chatsworth High School with Kevin Spacey and Mare Winningham, and also attended the Hollywood Professional School.", "prediction 3": "Val Kilmer attended high school with Kevin Spacey and Mare Winningham at Chatsworth High School in Chatsworth, California. Kilmer also attended the Hollywood Professional School and the Big Apple Academy.", "prediction 4": "Val Kilmer attended Chatsworth High School and the Big Apple Academy in New York City. In 1981, while at Juilliard, Kilmer co-authored and starred in the play \"How It All Began,\" which was performed at the Public Theater at the New York Shakespeare Festival. Kilmer also attended the Hollywood Professional School.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 310 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Kilmer attended Berkeley Hall School, a Christian Science school in Los Angeles, until ninth grade. Val Kilmer attended Chatsworth High School, a charter secondary school located in Chatsworth, in the San Fernando Valley of Los Angeles, California, United States. He became the youngest person at the time to be accepted into the Juilliard School's Drama Division." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When was the first child car seat made?", "passages": [ [ "Child safety seat", "It came into effect in July 2013 and provides extra protection in several ways, most notably by providing rearward facing travel for children up to 15 months instead of 9 to 12 months, which the previous EU regulation advised.", "Since the first car was manufactured and put on the market in the early 1900s, many modifications and adjustments have been implemented to protect those that drive and ride in motorized vehicles.", "Most restraints were put into place to protect adults without regard for young children.", "Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children.", "The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them.", "It was not until 1962 that two designs with the purpose of protecting a child were developed independently.", "British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models.", "American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child.", "It is noted that seat belts for adults were not standard equipment in automobiles until the 1960s.", "There are several types of car seats, which vary in the position of the child and size of the seat.", "The United Nations European Regional standard ECE R44/04 categorizes these into 4 groups: 0-3." ], [ "Child safety seat", "Recalls vary in severity; sometimes the manufacturer will send an additional part for the seat, other times they will provide an entirely new seat.", "The purchase of a used seat is not recommended.", "Due to the aforementioned concerns regarding expiry dates, crash testing, and recalls, it is often impossible to determine the history of the child restraint when it is purchased second-hand.", "Children traveling by plane are safer in a child safety seat than in a parent's arms.", "The FAA and the AAP recommend that all children under 40 lb use a child safety seat on a plane.", "Booster seats cannot be used on airplanes because they don't have shoulder belts.", "Parents should not put children into safety seats with thick winter coats on.", "The coat will flatten in an accident and the straps will not be snug enough to keep the child safe.", "An alternative would be placing a coat on the child backwards after buckling the child in.", "Straps on the harness should be snug on the child, parents should not be able to pinch the straps away from the shoulders of the child.", "The straps also need to be placed at the proper height for the child." ] ], "gold": "Though child car seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. Instead, their purpose was to act as booster seats to bring the child to a height to make it easier for the driver of the car to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin designed a forward-facing seat with a metal frame to protect the child. Child safety seats first became available to the public in the late 1960s; however, few parents used them. ", "prediction 1": "The first child car seat was made in the early 1930s and came into effect on July 1, 2013. Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child.", "prediction 2": "The first child car seat was made in the early 1930s. Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child.", "prediction 3": "The first child car seat was constructed in the early 1900s. Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. In 1962, British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child.", "prediction 4": "The first child car seat was manufactured in the early 1930s. Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The first child car seat was made in the early 1930s and came into effect on July 1, 2013. Though child seats were beginning to be manufactured in the early 1930s, their purpose was not the safety of children. The purpose was to act as booster seats to bring the child to a height easier for the driving parent to see them. It was not until 1962 that two designs with the purpose of protecting a child were developed independently. British inventor Jean Ames created a rear-facing child seat with a Y-shaped strap similar to today's models. American Leonard Rivkin, of Denver Colorado, designed a forward-facing seat with a metal frame to protect the child." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who did stevie wonder sing happy birthday to?", "passages": [ [ "Happy Birthday (Stevie Wonder song)", "Happy Birthday (Stevie Wonder song)\n\n\"Happy Birthday\" is a 1981 single written, produced and performed by Stevie Wonder for the Motown label.", "Wonder, a social activist, was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday, and created this single to make the cause known.", "Besides being released as a single, the song also appears on Wonder's album \"Hotter Than July\".", "The song, one of many of Wonder's songs to feature the use of a keyboard synthesizer, features Wonder lamenting the fact that anyone would oppose the idea of a Dr. King holiday, where \"peace is celebrated throughout the world\" and singing to King in the chorus, \"Happy birthday to you\".", "The holiday, he proposes, would facilitate the realization of Dr. King's dreams of integration and \"love and unity for all of God's children\".", "Wonder used the song to popularize the campaign, and continued his fight for the holiday, holding the Rally for Peace Press Conference in 1981.", "United States President Ronald Reagan approved the creation of the holiday, signing it into existence on November 2, 1983." ], [ "Happy Birthday (Stevie Wonder song)", "The first official Martin Luther King, Jr. Day, held the third Monday in January of each year, was held on January 20, 1986, and was commemorated with a large-scale concert, where Stevie Wonder was the headlining performer.", "Although the single failed to reach the \"Billboard\" Hot 100, it charted on the R&B chart, and it became one of Wonder's biggest hits in the UK, reaching No.2 in the charts in August 1981.", "Wonder also performed this song at the Diamond Jubilee Concert in London for the Diamond Jubilee of Elizabeth II." ] ], "gold": "Stevie Wonder, a social activist, was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday. He created the single Happy Birthday to promote this cause. The song features Wonder singing to King in the chorus, \"Happy birthday to you\". When Wonder performed the song at Nelson Mandela Day at Radio City Music Hall on July 19, 2009, he slightly changed the lyrics in the second verse to, \"Thanks to Mandela and Martin Luther King!\" Wonder also performed Happy Birthday for Queen Elizabeth II at the Diamond Jubilee Concert in London.", "prediction 1": "\"Happy Birthday\" is a 1981 single written, produced and performed by Stevie Wonder for the Motown label. It is one of Wonder's songs to feature the use of a keyboard synthesizer. During the chorus of the song, Wonder laments the fact that anyone would oppose the idea of a Dr. King holiday, where \"peace is celebrated throughout the world\". It also features Wonder singing to King in the chorus, \"Happy birthday to you\".", "prediction 2": "\"Happy Birthday\" is a 1981 single written, produced and performed by Stevie Wonder for the Motown label. Wonder, a social activist, was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday, and created this single to make the cause known. The song, one of many of Wonder's songs to feature the use of a keyboard synthesizer, features Wonder lamenting the fact that anyone would oppose the idea of a Dr. King holiday, where \"peace is celebrated throughout the world\", and singing to King in the chorus, \"Happy birthday to you\".", "prediction 3": "\"Happy Birthday\" is a 1981 single written, produced and performed by Stevie Wonder for the Motown label. Wonder, a social activist, was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday, and created this single to make the cause known. The song, one of many of Wonder's songs to feature the use of a keyboard synthesizer, features Wonder lamenting the fact that anyone would oppose the idea of a Dr. King holiday, where \"peace is celebrated throughout the world\" and singing to King in the chorus, \"Happy birthday to you\".", "prediction 4": "\"Happy Birthday\" is a 1981 single written, produced and performed by Stevie Wonder for the Motown label. Stevie Wonder was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday, and created this single to make the cause known. The song, one of many of Wonder's songs to feature the use of a keyboard synthesizer, features Wonder lamenting the fact that anyone would oppose the idea of a Dr. King holiday, where \"peace is celebrated throughout the world\", and singing to Dr. King in the chorus, \"Happy birthday to you\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 104 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Wonder, a social activist, was one of the main figures in the campaign to have the birthday of Martin Luther King, Jr. become a national holiday, and created this single to make the cause known. The song features Wonder singing to King in the chorus, \"Happy birthday to you\"." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who does the director of the fbi report to?", "passages": [ [ "Dana Boente", "Boente was one of the 46 United States Attorneys ordered by Attorney General Jeff Sessions on March 10, 2017 to tender their resignation; Trump declined to accept his resignation.", "Boente was not in the line of succession of the Attorney General of the United States pursuant to Executive Order 13762 signed by President Barack Obama before leaving office.", "He was appointed by President Donald Trump as Acting Attorney General on January 30, 2017, after Acting Attorney General Sally Yates was dismissed by Trump earlier that evening.", "When Jeff Sessions was confirmed and sworn in as Attorney General on February 9, 2017, Boente became Acting Deputy Attorney General.", "Also on February 9, 2017, Trump signed a new Executive Order; Executive Order 13775 to replace Obama's EO, an action which modified the order of succession to add Boente to the list.", "Sessions recused himself from all matters pertaining to American presidential campaigns because of revelations that he had communications with Russian Ambassador to the U.S. Sergey Kislyak during the 2016 United States presidential election, Boente was designated to perform the functions of the Attorney General with respect to campaign issues until the permanent deputy attorney general, Rod J. Rosenstein, was confirmed by the United States Senate and sworn into office which took place on April 25, 2017." ], [ "Dana Boente", "Dana Boente\n\nDana James Boente ( ; born February 7, 1954) is the former United States Attorney for the Eastern District of Virginia.", "He also served as acting assistant attorney general for the National Security Division of the United States Department of Justice.", "On October 27, 2017, Boente announced he would resign from the Department of Justice after a successor is in place.", "On January 23, 2018, Boente was named general counsel to the FBI by the director Christopher A. Wray, filling the vacancy after James Baker's reassignment to another part of the bureau.", "Boente was born in Carlinville, Illinois in 1954 to James and Doris Boente.", "Boente received a Bachelor of Science degree in business administration in 1976 from Saint Louis University and his Masters of Business Administration in 1977.", "He then attended the Saint Louis University School of Law, receiving his Juris Doctor in 1982.", "In 1982, Boente began his career as a law clerk for Chief U.S. District Judge J. Waldo Ackerman for the Central District of Illinois.", "In 1984, he joined the Tax Division\u2019s Criminal Section as part of the Attorney General's Honors Program.", "Boente became an Assistant U.S. Attorney in the Fraud Unit of the Eastern District of Virginia in 2001." ], [ "Director of the Federal Bureau of Investigation", "Director of the Federal Bureau of Investigation\n\nThe Director of the Federal Bureau of Investigation is the head of the Federal Bureau of Investigation, the United States' primary federal law enforcement agency, and is responsible for its day-to-day operations.", "The FBI Director is appointed for a single 10-year term by the President of the United States and confirmed by the Senate.", "The FBI is an agency within the Department of Justice (DOJ), and thus the Director reports to the Attorney General of the United States.", "The Director briefed the President on any issues that arose from within the FBI until the \"Intelligence Reform and Terrorism Prevention Act of 2004\" was enacted following the September 11 attacks.", "Since then, the Director reports in an additional capacity to the Director of National Intelligence, as the FBI is also part of the United States Intelligence Community.", "The current Director is Christopher A. Wray, who assumed the role on August 2, 2017 after being confirmed by the United States Senate, taking over from Acting Director Andrew McCabe after the dismissal of former Director James Comey by President Donald Trump.", "The FBI Director is appointed by the President and, since 1972, subject to confirmation by the Senate." ] ], "gold": "The Director of the FBI reports to the Attorney General of the United States, who is appointed by the President. Following the inauguration of President Donald Trump on January 20, 2017, the Acting Attorney General was Sally Yates, but she was dismissed on 10 days later on January 30. Dana Boente then served as Acting Attorney General until February 9, when President Trump's nominee for Attorney General, Jeff Sessions, was sworn in. Sessions would hold the position until November 7, 2018.", "prediction 1": "The Director of the Federal Bureau of Investigation is the head of the Federal Bureau of Investigation, the United States' primary federal law enforcement agency, and is responsible for its day-to-day operations. The Director reports to Attorney General Jeff Sessions, who is also the Attorney General of the United States. The Director of the FBI reports in an additional capacity to the Director of National Intelligence, as the FBI is also part of the United States Intelligence Community.", "prediction 2": "The Director of the Federal Bureau of Investigation is the head of the Federal Bureau of Investigation, the United States' primary federal law enforcement agency, and is responsible for its day-to-day operations. The FBI is an agency within the Department of Justice (DOJ), and thus the Director reports to the Attorney General of the United States. The current Director reports in an additional capacity to the Director of National Intelligence.", "prediction 3": "The Director of the Federal Bureau of Investigation is the head of the Federal Bureau of Investigation, the United States' primary federal law enforcement agency, and is responsible for its day-to-day operations. The Director is appointed for a single 10-year term by the President of the United States and confirmed by the Senate. The FBI is an agency within the Department of Justice, and thus the Director reports to the Attorney General of the United States. The Director also reports in an additional capacity to the Director of National Intelligence, as the FBI is also part of the United States Intelligence, as the FBI is also part of the United States Intelligence.", "prediction 4": "The Director of the Federal Bureau of Investigation is the head of the Federal Bureau of Investigation, the United States' primary federal law enforcement agency, and is responsible for its day-to-day operations. The Director reports to the Attorney General of the United States, Jeff Sessions. The current director of the FBI is Christopher A. Wray, who assumed the role on August 2, 2017 after being confirmed by the United States Senate, taking over from Acting Director Andrew McCabe after the dismissal of former Director James Comey by President Donald Trump.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 492 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Director of the FBI, appointed by the President, reports to the Attorney General of the United States. Dana Boente was appointed by President Donald Trump as Acting Attorney General on January 30, 2017, after Acting Attorney General Sally Yates was dismissed by Trump earlier that evening. When Jeff Sessions was confirmed and sworn in as Attorney General on February 9, 2017, Boente became Acting Deputy Attorney General. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When is the english premier league going to start?", "passages": [ [ "2017\u201318 Premier League", "2017\u201318 Premier League\n\nThe 2017\u201318 Premier League was the 26th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The season started on 11 August 2017 and concluded on 13 May 2018.", "Fixtures for the 2017\u201318 season were announced on 14 June 2017.", "Chelsea were the defending champions, while Newcastle United, Brighton & Hove Albion and Huddersfield Town entered as the promoted teams from the 2016\u201317 EFL Championship.", "Manchester City won their third Premier League title, and fifth English top-flight title overall, with five games to spare.", "The team broke numerous Premier League records over the course of the season, including: most points (100), most wins (32), most away wins (16), most goals (106), most consecutive league wins (18), highest goal difference (+79), most passes in a game (903), fewest minutes behind in matches (153 minutes) and biggest winning points margin (19).", "All three promoted clubs avoided relegation for the first time since the 2011\u201312 campaign, and for only the third time in Premier League history.", "From this season on, club strips can feature sleeve sponsorship, whereby sponsors' logos will appear on the left sleeve of the strip in lieu of the Premier League patch." ], [ "2016\u201317 Premier League", "2016\u201317", "Premier League\n\nThe 2016\u201317 Premier League was the 25th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The season began on 13 August 2016 and concluded on 21 May 2017.", "Fixtures for the 2016\u201317 season were announced on 15 June 2016.", "Chelsea won their fifth Premier League title, and sixth English title, with two matches to spare following a 1\u20130 away win over West Bromwich Albion on 12 May.", "The defending champions were Leicester City, who finished 12th, thereby setting a new record for the worst Premier League title defence; the record had previously been held by Chelsea, who had finished 10th in 2015\u201316 after winning the title in 2014\u201315.", "Burnley, Middlesbrough and Hull City entered as the three promoted teams from the 2015\u201316 Football League Championship.", "On 9 February 2016, the Premier League announced a rebrand; beginning with the 2016\u201317 season, the competition was known simply as the Premier League, without any sponsor's name attached.", "As part of the rebranding, a new logo was introduced.", "From the beginning of the 2016\u201317 season, ticket prices for away fans were capped at \u00a330 per ticket.", "Twenty teams competed in the league \u2013 the top seventeen teams from the previous season, as well as the three teams promoted from the Championship." ], [ "2015\u201316 Premier League", "2015\u201316 Premier League\n\nThe 2015\u201316 Premier League (known as the Barclays Premier League for sponsorship reasons) was the 24th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992.", "The season began on 8 August 2015, and was scheduled to conclude on 15 May 2016.", "However, the Manchester United vs Bournemouth fixture was postponed to 17 May 2016 on the final day due to a suspicious package inside Old Trafford.", "Chelsea began the season as defending champions of the 2014\u201315 season.", "Bournemouth, Watford and Norwich City entered as the three promoted teams from the 2014\u201315 Football League Championship.", "Leicester City won the championship for the first time in their 132-year history, becoming the 24th club to become English football champions, and the sixth club to win the Premier League.", "Many commentators consider this to be one of the greatest sports shocks in history, especially considering that Leicester City spent much of the previous season in the relegation zone before finishing 14th.", "Leicester City were the surprise of the season.", "Following their late escape from relegation in the previous season many pundits had predicted that they would be relegated and bookmakers gave 5,000\u20131 odds on them winning the title.", "After the dismissal of manager Nigel Pearson, they began the new season with Italian Claudio Ranieri in charge." ] ], "gold": "The 2015\u201316 Premier League, known as the Barclays Premier League for sponsorship reasons, was the 24th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992. The season began on 8 August 2015, and was scheduled to conclude on 15 May 2016. The 2016\u201317 Premier League season began on 13 August 2016 and concluded on 21 May 2017. The 2017\u201318 Premier League season started on 11 August 2017 and concluded on 13 May 2018.", "prediction 1": "The premier league in England is a professional football league based in London. In the 2016\u201317 season, the Premier League was the top English professional league for association football clubs, and the season started on 13 August 2016. In the 2015\u201316 season, the Premier League was the 24th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992. The season began on 8 August 2015 and the 2016\u201317 season started on 13 August 2016.", "prediction 2": "The English Premier League has been played since the start of professional football in England in 1932, and since the beginning of the 20th century, has been played in over 100 different countries. The 2016 edition of the Premier League began on 13 August 2016, while the 2017 edition started on 11 August 2017. The 2018 season started on 27 August 2018, and the 2019 season started on 24 August 2019.", "prediction 3": "The English Premier League has had several seasons. The 2015\u201316 Premier League began on 8 August 2015, and the 2016\u201317 Premier League began on 13 August 2016. The 2016\u201317 Premier League started on 21 May 2017 and the 2017\u201318 Premier League started on 11 August 2018.", "prediction 4": "The English Premier League is a professional football league organized by the Football League Association and the Football League Development League (DDL). The Premier League season starts on the second Sunday of August, each year. The 2016-17 season starts on the second Sunday of August, each year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 209 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2015\u201316 Premier League (known as the Barclays Premier League for sponsorship reasons) was the 24th season of the Premier League, the top English professional league for association football clubs, since its establishment in 1992. The season began on 8 August 2015, and was scheduled to conclude on 15 May 2016. The 2016\u201317 Premier League season began on 13 August 2016 and concluded on 21 May 2017. The 2017\u201318 Premier League season started on 11 August 2017 and concluded on 13 May 2018." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who owns the rights to shazam the superhero?", "passages": [ [ "Captain Marvel (DC Comics)", "None of these versions saw print, though Captain Marvel, the Wizard Shazam, and Black Adam did appear in DC's \"War of the Gods\" miniseries in 1991.", "By this time, DC had finally ceased the fee-per-use licensing agreement with Fawcett Publications and purchased the full rights to Captain Marvel and the other Fawcett Comics characters.", "In 1991, Jerry Ordway was given the \"Shazam!\" assignment, which he pitched as a painted graphic novel that would lead into a series, rather than starting the series outright.", "Ordway both wrote and illustrated the graphic novel, titled \"The Power of Shazam!", "\", which was released in 1994.", "\"Power of Shazam!\" retconned Captain Marvel again and gave him a revised origin, rendering \"Shazam!", "The New Beginning\" and the \"Action Comics Weekly\" story apocryphal while Marvel's appearances in \"Legends\" and \"Justice League\" still counted as part of the continuity.", "Ordway's story more closely followed Captain Marvel's Fawcett origins, with only slight additions and changes.", "The graphic novel was a critically acclaimed success, leading to a \"Power of Shazam!\"", "ongoing series which ran from 1995 to 1999.", "That series reintroduced the Marvel Family and many of their allies and enemies into the modern-day DC Universe." ], [ "Captain Marvel (DC Comics)", "In 1972, DC licensed the Marvel Family characters from Fawcett, and returned them to publication.", "By 1991, DC had acquired all rights to the characters.", "DC has since integrated Captain Marvel and the Marvel Family into their DC Universe and has attempted to revive the property several times, with mixed success.", "Due to trademark conflicts over another character named \"Captain Marvel\" owned by Marvel Comics, DC has branded and marketed the character using the trademark Shazam!", "since his 1972 reintroduction.", "This, in turn, led many to assume that \"Shazam\" was the character's name.", "DC later officially renamed the character \"Shazam\" when relaunching its comic book properties in 2011, and his associates became known as the \"Shazam Family\" the following year.", "Captain Marvel/Shazam and his family battle an extensive rogues' gallery, primarily archenemies Dr. Sivana and Black Adam.", "The character has been featured in two television series adaptations, one live action and one animated, by Filmation.", "An upcoming New Line Cinema/Warner Bros. \"Shazam!\"", "feature film is scheduled for release in 2019 as part of the DC Extended Universe, with Zachary Levi and Asher Angel portraying the title role.", "Captain Marvel was ranked as the 55th greatest comic book character of all time by \"Wizard\" magazine." ], [ "Captain Marvel (DC Comics)", "Captain Marvel (DC Comics)\n\nCaptain Marvel, also known as Shazam (), is a fictional comic book superhero appearing in publications by the American publisher DC Comics.", "Artist C. C. Beck and writer Bill Parker created the character in 1939.", "Captain Marvel first appeared in \"Whiz Comics\" #2 (cover-dated Feb. 1940), published by Fawcett Comics.", "He is the alter ego of Billy Batson, a boy who, by speaking the magic word \"SHAZAM\" (acronym of six \"immortal elders\": Solomon, Hercules, Atlas, Zeus, Achilles and Mercury), can transform himself into a costumed adult with the powers of superhuman strength, speed, flight and other abilities.", "Based on book sales, the character was the most popular superhero of the 1940s, outselling even Superman.", "Fawcett expanded the franchise to include other \"Marvels\", primarily Marvel Family associates Mary Marvel and Captain Marvel Jr., who can harness Billy's powers as well.", "Captain Marvel was also the first comic book superhero to be adapted into film, in a 1941 Republic Pictures serial titled \"Adventures of Captain Marvel\".", "Fawcett ceased publishing Captain Marvel-related comics in 1953, partly because of a copyright infringement suit from DC Comics, alleging that Captain Marvel was a copy of Superman." ] ], "gold": "The fictional superhero character Shazam is also known as Captain Marvel. Originally, Fawcett Comics owned the rights to Captain Marvel. But, Fawcett Comics stopped publishing Marvel related comics in 1953 partly because of a copyright infringement suite from DC Comics alleging that Captain Marvel was a copy of a DC character called Superman. By 1991, DC Comics acquired all the rights to the family of Marvel characters and integrated Captain Marvel, aka Shazam, into their DC Universe.", "prediction 1": "Shazam is a fictional superhero appearing in publications by the American publisher DC Comics. In 1990, Jerry Ordway was given the \"Shazam!\" assignment, which he pitched as a painted graphic novel that would lead into a series, rather than starting the series outright. By 1991, DC had acquired the full rights to Captain Marvel and the other Fawcett Comics characters. DC eventually officially renamed the character \"Shazam\" when relaunching its comic book properties in 2011.", "prediction 2": "In 1972, DC licensed the Marvel Family characters from Fawcett, and returned them to publication. By 1991, DC had acquired the full rights to Captain Marvel and the other Fawcett Comics characters. Jerry Ordway was given the \"Shazam!\" assignment, which he pitched as a painted graphic novel that would lead into a series, rather than starting the series outright. Due to trademark conflicts over another character named Captain Marvel owned by Marvel Comics, DC has branded and marketed the character using the trademark Shazam!", "prediction 3": "Captain Marvel, also known as Shazam, is a fictional superhero appearing in publications by the American publisher DC Comics. In 1972, DC licensed the Marvel Family characters from Fawcett and returned them to publication. By 1991, DC had acquired all rights to the characters. Due to trademark conflicts over another character named Captain Marvel owned by Marvel Comics, DC has branded and marketed the character using the trademark Shazam! since his 1972 reintroduction. This, in turn, led many to assume that \"Shazam\" was the character's name.", "prediction 4": "Captain Marvel is a fictional superhero appearing in publications by the American publisher DC Comics. In 1972, DC licensed the Marvel Family characters from Fawcett, and returned them to publication. By 1991, DC had acquired all rights to the characters. Jerry Ordway was given the \"Shazam!\" assignment, which he pitched as a painted graphic novel that would lead into a series, rather than starting the series outright. DC later officially renamed the character \"Shazam\" when relaunching its comic book properties in 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 94 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 98, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 370, "end": 477 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "Shazam, also known as Captain Marvel, is a fictional superhero. He was originally owned by Fawcett Comics. Fawcett ceased publishing Captain Marvel-related comics in 1953, partly because of a copyright infringement suit from DC Comics, alleging that Captain Marvel was a copy of Superman. By 1991, DC had acquired the full rights to Captain Marvel and the other Fawcett Comics characters. Eventually adding them into the modern-day DC Universe." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When was the driving test introduced in the uk?", "passages": [ [ "United Kingdom driving test", "In practise it can cost considerably more, when it is considered that most candidates do not pass both tests on the first occasion.", "This is also not counting fees paid for private driving instruction.", "UK driving licences were introduced by the Motor Car Act 1903 but no test was required.", "The intention was purely to identify vehicles and their drivers.", "The Road Traffic Act 1930 introduced age restrictions and a test for disabled drivers; this was the first formal driving test in the UK.", "These licences were only valid for one year from the date of issue.", "Legislation for compulsory testing was introduced for all new drivers with the Road Traffic Act 1934.", "The test was initially voluntary to avoid a rush of candidates until 1 June 1935 when all people who had started to drive on or after 1 April 1934 needed to have passed the test.", "Testing was suspended during World War II,\nand was suspended again during the Suez Crisis in 1956 to allow examiners help to administer petrol rations.", "The driving theory test was introduced in July 1996 as a written examination, which was updated to computerised format in \n2000.", "The hazard perception segment of the theory test was introduced in November 2002.", "In January 2015, new CGI clips replaced the real-life video clips in the Hazard Perception Test.", "Drivers wishing to gain a category B (car) licence need to pass two separate tests.", "First, the theory test must be passed." ], [ "United Kingdom driving test", "\"open the bonnet\") are:-\nIf the candidate failed to answer a \"show me\" or \"tell me\" question correctly, they would receive a driving fault for each question that is answered incorrectly (up to two driving faults total).", "This means that a candidate does not automatically fail their practical driving test based off their answers to these questions unless the examiner believes that the fault is serious.", "The controlled stop, more commonly referred to as the \"emergency stop\", is an exercise which determines the ability of the candidate to stop the vehicle promptly yet under control during a simulated emergency.", "The simulation is performed by the examiner raising his or her hand and saying, \"STOP!\".", "A controlled stop exercise will be carried out on every extended test and one third of normal tests.", "This might be an emergency stop, or the candidate might be asked to make a controlled stop in a specific location.", "During dangerous weather conditions, such as rain and snow, this test can be left out for safety reasons.", "The Driving test changed on December 4, 2017.", "The manoeuvres have now changed and you will not be asked to do a Turn in the Road or a Reverse to the left, If you are taking driving lessons your Instructor should still teach you these reversing exercises so you are able to carry them out if necessary." ] ], "gold": "The Road Traffic Act 1930 introduced a test for disabled drivers. This was the first formal driving test in the UK. Then, in 1934, legislation for compulsory testing was introduced for all new drivers with the Road Traffic Act 1934. This test was initially voluntary to avoid a rush of candidates until 1 June 1935 when it became mandatory. The driving theory test was introduced in July 1996 as a written examination, which was updated to computerized format in 2000. The hazard perception segment of the theory test was introduced in November 2002. In January 2015, new CGI clips replaced the real-life video clips in the Hazard Perception Test. The driving test changed on 4 December 2017.", "prediction 1": "The driving theory test was introduced in July 1996 as a written examination, which was updated to computerised format in 2000. The hazard perception segment of the theory test was introduced in November 2002. The Driving test changed on December 4, 2017 and the manoeuvres have now changed and you will not be asked to do a Turn in the Road or a Reverse to the left.", "prediction 2": "The driving theory test was introduced in July 1996 as a written examination, which was updated to computerised format in 2000. The hazard perception segment of the theory test was introduced in November 2002. The driving test changed on December 4, 2017.", "prediction 3": "The driving theory test was introduced in July 1996 as a written examination, which was updated to computerised format in 2000. The hazard perception segment of the theory test was introduced in November 2002 and in January 2015, new CGI clips replaced the real-life video clips in the Hazard Perception Test. The driving test changed on December 4, 2017.", "prediction 4": "The theory test for the UK driving test was introduced in July 1996. The practical test was introduced on December 4, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 367 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] } ], "corrected-prediction": "The Road Traffic Act 1930 introduced age restrictions and a test for disabled drivers; this was the first formal driving test in the UK. Legislation for compulsory testing was introduced for all new drivers with the Road Traffic Act 1934. The test was initially voluntary to avoid a rush of candidates until 1 June 1935 when all people who had started to drive on or after 1 April 1934 needed to have passed the test. The driving theory test was introduced in July 1996 as a written examination, which was updated to computerised format in 2000. The hazard perception segment of the theory test was introduced in November 2002. In January 2015, new CGI clips replaced the real-life video clips in the Hazard Perception Test. The Driving test changed on December 4, 2017." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the way you look tonight come out?", "passages": [ [ "The Way You Look Tonight", "The Way You Look Tonight\n\n\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern.", "It won the Academy Award for Best Original Song in 1936.", "Fields remarked, \"The first time Jerry played that melody for me I went out and started to cry.", "The release absolutely killed me.", "I couldn't stop, it was so beautiful.\"", "In the movie, Astaire sang \"The Way You Look Tonight\" to Ginger Rogers while she was washing her hair in an adjacent room.", "His recording reached the top of the charts in 1936.", "Other versions that year were by Guy Lombardo and by Teddy Wilson with Billie Holiday.", "To take advantage of the success of the song, pianist Teddy Wilson brought Billie Holiday into a studio ten weeks after the movie was released.", "Holiday was twenty-one when she recorded \"The Way You Look Tonight\" as a duet with Wilson in October 1936.", "Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste.", "The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964.", "Versions were also recorded by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker." ], [ "The Way You Look Tonight", "Bing Crosby and his wife Dixie Lee recorded it as a duet on August 19, 1936.", "The Lettermen found their first hit when their version reached No. 14 on the \"Billboard\" magazine Hot 100 singles chart and No. 36 on the UK Singles Chart.", "Sonny Rollins and Thelonious Monk recorded it in 1954." ], [ "It Had to Be You: The Great American Songbook", "It Had to Be You: The Great American Songbook\n\nIt Had to Be You: The Great American Songbook is the first album of American pop standards recorded by British musician Rod Stewart.", "It was released on 22 October 2002, and became the first in a five-volume series.", "The album was Stewart's first release for Sony Music imprint J Records.", "It included his second recording of \"Every Time We Say Goodbye.\"", "A live DVD of the same title was released on 4 February 2003, which featured performances of material from the studio album as well as Stewart's earlier material.", "Stiefel at Stiefel Entertainment." ], [ "Hey, Good Lookin' (song)", "Hey, Good Lookin' (song)\n\n\"Hey, Good Lookin'\" is a 1951 song written and recorded by Hank Williams, and his version was inducted into the Grammy Hall of Fame in 2001.", "Since its original 1951 recording it has been covered by a variety of artists.", "The Hank Williams song was inspired by another song by the same title, which was written by Cole Porter in 1942.", "The lyrics for the Williams version begin as a come on using double entendres related to food preparation (\"How's about cookin' somethin' up with me?\").", "By the third and fourth verses, the singer is promising the object of his affection that they can become an exclusive couple (\"How's about keepin' steady company?\" and \"I'm gonna throw my date book over the fence\").", "Williams was friendly with musician Jimmy Dickens.", "Having told Dickens that Dickens needed a hit record if he was going to become a star, Williams said he'd write it, and penned \"Hey Good Lookin'\" in only 20 minutes while on a plane with Dickens, Minnie Pearl, and Pearl's husband Henry Cannon.", "A week later Williams recorded it himself, jokingly telling Dickens, \"That song's too good for you!\"" ] ], "gold": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and composed by Jerome Kern with lyrics written by Dorothy Fields. It won the Academy Award for Best Original Song in 1936. Bing Crosby and his wife Dixie Lee recorded it as a duet on August 19, 1936. To take advantage of the success of the song, pianist Teddy Wilson brought Billie Holiday into a studio ten weeks after the movie was released and when Holiday was twenty-one when she recorded \"The Way You Look Tonight\" as a duet with Wilson in October 1936. In 1942, the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste. The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964. Versions were also recorded by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker, and Tony Bennett. Rod Stewart included it on the album \"Great American Songbook\" in 2002.", "prediction 1": "\"The Way You Look Tonight\" is a song from the film Swing Time that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. It was also the title of a song that was recorded by Bing Crosby and his wife Dixie Lee on August 19, 1936. The song was also the title of an album, It Had to Be You: The Great American Songbook, which was released on October 22, 2002.", "prediction 2": "\"The Way You Look Tonight\" is a song from the film Swing Time that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. The song was recorded and released by Bing Crosby and his wife Dixie Lee on August 19, 1936. The song came out on the charts again in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste.", "prediction 3": "\"The Way You Look Tonight\" is a song from the film Swing Time. It was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. It was also recorded in 1936 by Teddy Wilson and Billie Holiday, and was first released on November 6, 1936. It was also featured on Rod Stewart's album It Had to Be You: The Great American Songbook on October 22, 2002.", "prediction 4": "The way you look tonight is a song from the movie \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. Hey, Good Lookin' is a 1951 song written and recorded by Hank Williams. His version was inducted into the Grammy Hall of Fame in 2001.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 13 ] } ], "corrected-prediction": "\"The Way You Look Tonight\" is a song from the film Swing Time that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. It was also the title of a song that was recorded by Bing Crosby and his wife Dixie Lee on August 19, 1936. To take advantage of the success of the song, pianist Teddy Wilson brought Billie Holiday into a studio ten weeks after the movie was released. Holiday was twenty-one when she recorded \"The Way You Look Tonight\" as a duet with Wilson in October 1936. Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste. The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964. Versions were also recorded by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker. The song was also the title of an album, It Had to Be You: The Great American Songbook, which was released on October 22, 2002." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When was the original food and drugs act passed in the us?", "passages": [ [ "Pure Food and Drug Act", "Pure Food and Drug Act\n\nThe was the first of a series of significant consumer protection laws which was enacted by Congress in the 20th century and led to the creation of the Food and Drug Administration.", "Its main purpose was to ban foreign and interstate traffic in adulterated or mislabeled food and drug products, and it directed the U.S. Bureau of Chemistry to inspect products and refer offenders to prosecutors.", "It required that active ingredients be placed on the label of a drug\u2019s packaging and that drugs could not fall below purity levels established by the United States Pharmacopeia or the National Formulary.", "\"The Jungle\" by Upton Sinclair was an inspirational piece that kept the public's attention on the important issue of unsanitary meat processing plants that later led to food inspection legislation.", "Sinclair quipped, \"I aimed at the public's heart and by accident I hit it in the stomach,\" as readers demanded and got the pure food law.", "The Pure Food and Drug Act of 1906 was a key piece of Progressive Era legislation, signed by President Theodore Roosevelt on the same day as the Federal Meat Inspection Act.", "Enforcement of the Pure Food and Drug Act was assigned to the Bureau of Chemistry in the U.S. Department of Agriculture which was renamed the U.S. Food and Drug Administration (FDA) in 1930." ], [ "Pure Food and Drug Act", "The men soon adopted the motto \"Only the Brave dare eat the fare\" and at times the publicity given to the trials became a burden.", "Though many results of the trial came to be in dispute, there was no doubt that formaldehyde was dangerous and it disappeared quickly as a preservative.", "Wiley himself felt that he had found adverse effects from large doses of each of the preservatives and the public seemed to agree with Wiley.", "In many cases, most particularly with ketchup and other condiments, the use of preservatives was often used to disguise insanitary production practices.", "Although the law itself did not proscribe the use of some of these preservatives, consumers increasingly turned away from many products with known preservatives.", "The 1906 statute regulated food and drugs moving in interstate commerce and forbade the manufacture, sale, or transportation of poisonous patent medicines.", "The Act arose due to public education and expos\u00e9s from public interest guardians such as Upton Sinclair and Samuel Hopkins Adams, social activist Florence Kelley, researcher Harvey W. Wiley, and President Theodore Roosevelt.", "The 1906 Act paved the way for the eventual creation of the Food and Drug Administration (FDA) and is generally considered to be that agency's founding date, though the agency existed before the law was passed and was not named FDA until later." ], [ "Quackery", "The end of the road for the quack medicines now considered grossly fraudulent in the nations of North America and Europe came in the early 20th century.", "February 21, 1906 saw the passage into law of the Pure Food and Drug Act in the United States.", "This was the result of decades of campaigning by both government departments and the medical establishment, supported by a number of publishers and journalists (one of the most effective was Samuel Hopkins Adams, who wrote \"The Great American Fraud\" series in \"Collier's\" in 1905).", "This American Act was followed three years later by similar legislation in Britain and in other European nations.", "Between them, these laws began to remove the more outrageously dangerous contents from patent and proprietary medicines, and to force quack medicine proprietors to stop making some of their more blatantly dishonest claims.", "\"Medical quackery and promotion of nostrums and worthless drugs were among the most prominent abuses that led to formal self-regulation in business and, in turn, to the creation of the\" Better Business Bureau.", "\"Quackery is the promotion of false and unproven health schemes for a profit.", "It is rooted in the traditions of the marketplace\", with \"commercialism overwhelming professionalism in the marketing of alternative medicine\".", "\"Quackery\" is most often used to denote the peddling of the \"cure-alls\" described above." ] ], "gold": "The Pure Food and Drug Act passed in the US Senate on February 21, 1906. It was then passed by the US House of Representatives on June 20, 1906. It was a key piece of Progressive Era legislation and was signed by President Roosevelt. It paved the way for the eventual creation of the Food and Drug Administration although the agency existed before the law was passed and was not named the FDA until later.", "prediction 1": "The Pure Food and Drug Act of 1906 was a key piece of Progressive Era legislation signed by President Theodore Roosevelt on the same day as the Federal Meat Inspection Act. This act regulated food and drugs moving in interstate commerce and forbade the manufacture, sale, or transportation of poisonous patent medicines.", "prediction 2": "The Pure Food and Drug Act was enacted on February 21, 1906 and passed by Congress on the first day of the 116th Congress.", "prediction 3": "The Pure Food and Drug Act was the first of a series of significant consumer protection laws which was enacted by Congress in the 20th century and led to the creation of the Food and Drug Administration. Its main purpose was to ban foreign and interstate traffic in adulterated or mislabeled food and drug products, and it directed the U.S. Bureau of Chemistry to inspect products and refer offenders to prosecutors. It required that active ingredients be placed on the label of a drug\u2019s packaging and that drugs could not fall below purity levels established by the United States Pharmacopeia or the National Formulary. This Act was the result of decades of public education and expos\u00e9s from public interest guardians such as Theodore Roosevelt on the same day as the Federal Meat Inspection Act. This act paved the way for the eventual creation of the Food and is generally considered to be that agency's founding date, though the agency existed before", "prediction 4": "The Pure Food and Drug Act was passed into law on February 21, 1906 and was the first of a series of significant consumer protection laws which was enacted by Congress in the 20th century and led to the creation of the Food and Drug Administration. Its main purpose was to ban foreign and interstate traffic in adulterated or mislabeled food and drug products and it directed the U.S. Bureau of Chemistry to inspect products and refer offenders to prosecutors. It required that active ingredients be placed on the label of a drug's packaging and that drugs could not fall below purity levels established by the United States Pharmacopeia or the National Formulary.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 172 }, { "error type": "Irrelevant", "explanation": "", "start": 173, "end": 320 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Pure Food and Drug Act of 1906 was a key piece of Progressive Era legislation signed by President Theodore Roosevelt. February 21, 1906 saw its passage into law. It paved the way for the eventual creation of the Food and Drug Administration (FDA) and is generally considered to be that agency's founding date, though the agency existed before the law was passed and was not named FDA until later." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who plays the fbi agent in shades of blue?", "passages": [ [ "Shades of Blue (TV series)", "Lopez was given the main role in 2014.", "On February 26, 2015, Liotta, de Matteo, Vincent Laresca and Warren Kole were cast as Lt. Matt Wozniak, Det.", "Shirley Nazario, Det.", "Tony Espada and Agent Robert Stahl, respectively.", "Dayo Okeniyi was given the role of Det.", "Michael Loman.", "On March 30, 2015, Hampton Fluker was cast in a recurring role as Det.", "Marcus Tufo.", "On April 8, Sarah Jeffery was cast as Santos' daughter, Christina.", "On April 13, 2015, Gino Anthony Pesi was cast in a recurring role as Assistant District Attorney James Nava.", "On June 15, 2016, Anna Gunn joined Shades of Blue's second season in a recurring role.", "Filming for the first season began on June 5, 2015, in New York City.", "Filming for the second season began in July 2016 in New York City.", "Filming for the third season began in April 2017 in New York City.", "The show has received mixed reviews despite praise for Lopez's performance.", "On Metacritic, \"Shades of Blue\" has a Metascore of 58/100, based on 28 critics.", "On Rotten Tomatoes, the show is rated 56% based on 35 reviews, with an average rating of 5.6/10." ], [ "Shades of Blue (TV series)", "Shades of Blue (TV series)\n\nShades of Blue is an American crime drama television series created by Adi Hasak that aired on NBC.", "The series premiered on January 7, 2016.", "The series is set in New York City and stars Jennifer Lopez as Harlee Santos, a single-mother NYPD detective who is forced to work for the FBI's anti-corruption task force, while dealing with her own financial and family problems.", "In March 2017, the series was renewed for a third season.", "NBC later announced in April 2018 that this would be the final season, and that it would consist of 10 episodes.", "The third and final season premiered on June 17, 2018, and the series finale aired on August 19, 2018.", "In February 2014, NBC gave a 13-episode straight-to-series order.", "A teaser trailer was made available on June 3, 2015, containing statements by Lopez, Ray Liotta, and Drea de Matteo.", "The series premiered on January 7, 2016.", "On February 5, 2016, NBC renewed \"Shades of Blue\" for a 13-episode second season, which premiered on March 5, 2017.", "On March 17, 2017, the series was renewed for a third season.", "NBC later announced on April 4, 2018, that this would be the final season, and it would contain 10 episodes.", "The third season premiered on June 17, 2018." ], [ "June Stahl", "June Stahl\n\nAgent June Stahl is a fictional character on the FX television series \"Sons of Anarchy\" and a major antagonist of the series, played by Ally Walker.", "She was a Stockton, California-based Agent of the Bureau of Alcohol, Tobacco, Firearms and Explosives investigating the Sons of Anarchy Motorcycle Club in Charming, California.", "She is portrayed as being bisexual.", "Stahl's methods are often ruthless, and include murdering her own girlfriend to get what she wants.", "Her actions have led to the deaths of two people associated with SAMCRO as well as the kidnapping of Abel Teller.", "She also killed an admitted gunrunner and then framed Gemma Teller Morrow, making the shooting seem unlawful.", "June Stahl arrives in Charming in episode 6, \"\", and is assigned to a case involving the Sons of Anarchy Motorcycle Club and their involvement in inter-state arms trafficking.", "She had been called in by David Hale, the local police department's Deputy Chief, as he had been struggling to rid the town of the gang due to his superior, Wayne Unser's, corruptness.", "She soon becomes involved in an affair with David Hale.", "Jax Teller, SAMCRO's Vice President, witnessed them in a sexual encounter at the police station while breaking Cherry out of lockup." ] ], "gold": "The 2016 crime drama TV series Shades of Blue features several recurring characters who are agents of the FBI. Warren Kole plays Agent Robert Stahl, protagonist Harlee's obsessive handler, while Leslie Silva plays Agent Gail Baker, Harlee's old friend, and Afton Williamson plays Agent Katie Myers, who is assigned to search for Stahl in season 3.", "prediction 1": "Shades of Blue is an American crime drama television series created by Adi Hasak that aired on NBC. The show stars Jennifer Lopez as Harlee Santos, a single-mother NYPD detective who is forced to work for the FBI's anti-corruption task force while dealing with her own financial and family problems. In the first season, Agent Robert Stahl is portrayed by ally Walker.", "prediction 2": "Shades of Blue is an American crime drama television series created by Adi Hasak that aired on NBC. The show stars Jennifer Lopez as Harlee Santos, a single-mother NYPD detective who is forced to work for the FBI's anti-corruption task force, while dealing with her own financial and family problems. Agent Robert Steel is a fictional character on the FX television series Sons of Anarchy and was played by Ally Walker.", "prediction 3": "Shades of Blue is an American crime drama television series created by Adi Hasak that aired on NBC from 2016-2019. The show stars Jennifer Lopez as Harlee Santos, a single-mother NYPD detective who is forced to work for the FBI's anti-corruption task force, while dealing with her own financial and family problems. Agent Robert Stahl, a fictional character on the FX television series Sons of Anarchy, is played by Ally Walker.", "prediction 4": "Shades of Blue is an American crime drama television series created by Adi Hasak that aired on NBC. The series stars Jennifer Lopez as Harlee Santos, a single-mother NYPD detective who is forced to work for the FBI's anti-corruption task force while dealing with her own financial and family problems. Agent Robert Stahl is a fictional character on the FX television series Sons of Anarchy and a major antagonist of the series, played by Ally Walker.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 299 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 356, "end": 368 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Shades of Blue is a 2016 American crime drama television series. In the first season, Agent Robert Stahl is portrayed by Warren Kole. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was the last year we had a total eclipse of the sun?", "passages": [ [ "Solar eclipse of August 21, 2017", "Solar eclipse of August 21, 2017\n\nThe solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts.", "As a partial solar eclipse, it was visible on land from Nunavut in northern Canada to as far south as northern South America.", "In northwestern Europe and Africa, it was partially visible in the late evening.", "In Asia, it was visible only at the eastern extremity, the Chukchi Peninsula.", "Prior to this event, no solar eclipse had been visible across the entire contiguous United States since June 8, 1918; not since the February 1979 eclipse had a total eclipse been visible from anywhere in the mainland United States.", "The path of totality touched 14 states, and the rest of the U.S. had a partial eclipse.", "The area of the path of totality was about 16 percent of the area of the United States, with most of this area over the ocean, not land." ], [ "Solar eclipse of August 21, 2017", "The event's shadow began to cover land on the Oregon coast as a partial eclipse at 4:05\u00a0p.m. UTC (9:05\u00a0a.m. PDT), with the total eclipse beginning there at 5:16\u00a0p.m. UTC (10:16\u00a0a.m. PDT); the total eclipse's land coverage ended along the South Carolina coast at about 6:44\u00a0p.m. UTC (2:44\u00a0p.m. EDT).", "Visibility as a partial eclipse in Honolulu, Hawaii began with sunrise at 4:20\u00a0p.m.", "UTC (6:20\u00a0a.m. HST) and ended by 5:25\u00a0p.m. UTC (7:25\u00a0a.m. HST).", "This total solar eclipse marked the first such event in the smartphone and social media era in America.", "Information, personal communication, and photography were widely available as never before, capturing popular attention and enhancing the social experience.", "Marriage proposals took place coinciding with the eclipse, and at least one wedding was also planned and took place to coincide with the eclipse.", "Logistical problems were expected with the influx of visitors, especially for smaller communities.", "The sale of counterfeit eclipse glasses was also anticipated to be a hazard for eye injuries." ], [ "Solar eclipse of March 20, 2034", "Solar eclipse of March 20, 2034\n\nA total solar eclipse will occur on March 20, 2034.", "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth.", "A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's, blocking all direct sunlight, turning day into darkness.", "Totality occurs in a narrow path across Earth's surface, with the partial solar eclipse visible over a surrounding region thousands of kilometres wide.", "
Animated path" ], [ "Solar eclipse of March 9, 2016", "Solar eclipse of March 9, 2016\n\nA total solar eclipse took place on March 8\u20139, 2016.", "If viewed from east of the International Date Line (for instance from Hawaii), the eclipse took place on March 8 (local time) and elsewhere on March 9.", "A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's and the apparent path of the Sun and Moon intersect, blocking all direct sunlight and turning daylight into darkness; the sun appears to be black with a halo around it.", "Totality occurs in a narrow path across Earth's surface, with the partial solar eclipse visible over a surrounding region thousands of kilometres wide.", "The eclipse of March 8\u20139, 2016 had a magnitude of 1.0450 visible across an area of Pacific Ocean, which started in the Indian Ocean, and ended in the northern Pacific Ocean.", "The eclipse was clearly visible in many parts of Indonesia, including Central Sulawesi and Ternate, but obscured by clouds and smokes in Palembang, the largest city on the path of totality.", "The eclipse coincided with Nyepi, a public holiday in Indonesia and the end of the Balinese saka calendar.", "Because Nyepi is normally a day of silence, Muslims in Bali had to be given special dispensation to attend special prayer services during the eclipse." ], [ "Solar eclipse of March 20, 2015", "Solar eclipse of March 20, 2015\n\nA total solar eclipse occurred on March 20, 2015.", "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth.", "A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's, blocking all direct sunlight, turning day into darkness.", "Totality occurs in a narrow path across Earth's surface, with a partial solar eclipse visible over a surrounding region thousands of kilometres wide.", "It had a magnitude of 1.045.", "The longest duration of totality was 2 minutes and 47 seconds off the coast of the Faroe Islands.", "It was the last total solar eclipse visible in Europe until the eclipse of August 12, 2026.", "The track of totality passed across the North Atlantic and into the Arctic Ocean.", "The only populated places from which the totality could be seen were the Faroe Islands and Svalbard.", "The solar eclipse began at 08:30GMT in North West Europe and moved towards the northeast but still in northern Europe.", "It was most visible from the North Atlantic and Arctic Oceans, Greenland, Iceland, Ireland, the United Kingdom, Faroe Islands, northern Norway and Murmansk Oblast.", "The shadow began its pass off the south coast of Greenland." ] ], "gold": "A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's, blocking all direct sunlight, turning day into darkness. Totality occurs in a narrow path across Earth's surface, with a partial solar eclipse visible over a surrounding region thousands of kilometers wide. The last year a total solar eclipse was visible in the US was in 2017, which spanned the entire contiguous United States. Prior to this event, no solar eclipse had been visible across the entire United States since 1918. The last time a total solar eclipse was visible from the Faroe Islands, Svalbard, the North Atlantic, the North Pole, and the UK was in 2015. The last time a total solar eclipse was visible from Indonesia, Micronesia, and the Marshall Islands was in 2016.", "prediction 1": "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth. A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's, blocking all direct sunlight, turning day into darkness. A total solar eclipse occurs when the Moon's apparent path is larger than the Sun's, blocking all direct sunlight and turning daylight into darkness. A total solar eclipse occurred on March 8, 2016, and a total solar eclipse occurred on March 20, 2015.\n", "prediction 2": "Solar eclipses occur when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth. A total solar eclipse occurs when the Moon's apparent diameter is larger than the Sun's and the apparent path of the Sun and Moon intersect, blocking all direct sunlight, turning daylight into darkness. The last total solar eclipse on Earth occurred on March 20, 2015. The solar eclipse of March 8, 2016, occurred on March 9, 2016.", "prediction 3": "Solar eclipses occur when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth. The last time a total solar eclipse occurred on Earth was on March 20, 2015.", "prediction 4": "From June 21, 1918, through March 20, 2034 a total solar eclipse of the sun occurred when the Moon passed between Earth and the Sun, obscuring the image of the Sun for a viewer on Earth. This solar eclipse marked the first such event in the smartphone and social media era in America. \u2022 On March 8, 2016, a total solar eclipse of the sun took place in Indonesia and on March 9, 2016, a total solar eclipse of the Earth occurred on March 20, 2015.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth. ", "start": 151, "end": 296 }, { "error type": "Redundant", "explanation": "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth.", "start": 297, "end": 446 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": "A solar eclipse occurs when the Moon passes between Earth and the Sun, thereby totally or partly obscuring the image of the Sun for a viewer on Earth. Totality occurs in a narrow path across Earth's surface, with a partial solar eclipse visible over a surrounding region thousands of kilometres wide. The solar eclipse of August 21, 2017, was visible within a band that spanned the entire contiguous United States. Prior to this event, no solar eclipse had been visible across the entire contiguous United States since June 8, 1918; not since the February 1979 eclipse had a total eclipse been visible from anywhere in the mainland United States. A total solar eclipse, visible from Indonesia, occurred on March 8, 2016. A total solar eclipse, visible from the Faroe Islands, Svalbard, the North Atlantic, and the UK, occurred on March 20, 2015\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the person that serves legal documents?", "passages": [ [ "Service of process", "As a substitute for personal service by a process server, some jurisdictions may allow voluntary acceptance of service, also called waiver of service.", "It means that the served party agrees to voluntarily acknowledge receipt of the complaint or petition without the need to engage a process server.", "Acceptance or waiver of service is encouraged by some court systems, especially U.S. federal courts.", "Under Federal Rule of Civil Procedure 4(d)(2), when a defendant refuses to waive service \"without good cause\", the defendant can be held liable for the cost of personal service.", "However, in general, individual service by a process server is the best way to effect service of process, as it completely avoids having to litigate the collateral issue of whether the defendant actually had good cause (or not) to not waive service.", "Personal service is service of process directly to the (or a) party named on the summons, complaint, or petition.", "In most lawsuits in the United States, personal service is required to prove service.", "Most states allow substituted service in almost all lawsuits unless a corporation, LLC, LLP, or other business entity is being served; in those cases, personal service must be achieved by serving (in hand) the documents to the \"registered agent\" of a business entity.", "Some states, e.g. Florida, do not require that the documents actually be handed to the individual." ], [ "Service of process", "Specific practice is that: See CPLR 308 and DRL 232.", "In civil law jurisdictions, which include all of Continental Europe and most Asian countries, service of process is generally performed by the court.", "This may be done in person by a bailiff, or by mail, depending on the jurisdiction.", "International service of foreign judicial and extrajudicial documents is governed in general by the 1965 Hague Service Convention.", "Prior to the enactment of the Hague Service Convention, service of process in civil cases was generally effected by a letter rogatory, a formal request from the court in the country where proceedings were initiated or underway to a court in another country where the defendant resided.", "This procedure generally required the use of consular and diplomatic channels as the request had to be made to the foreign minister (Secretary of State in the United States) of the defendant's country by the foreign minister of the originating court.", "Since 1965, member states designate a central authority for service of process and requests go directly there.", "In addition, many states allow some type of service directly by mail or personal service by a person otherwise authorized to service process without involvement of local courts.", "In some instances, delivery to an agent for acceptance of service or \"registered agent\" can substitute for personal service on the principal party to be served.", "The Registered Agent is a person or company authorized in advance to accept service on behalf of the served party." ], [ "Service of process", "Service of process\n\nService of process is the procedure by which a party to a lawsuit gives an appropriate notice of initial legal action to another party (such as a defendant), court, or administrative body in an effort to exercise jurisdiction over that person so as to enable that person to respond to the proceeding before the court, body, or other tribunal.", "Notice is furnished by delivering a set of court documents (called \"process\") to the person to be served.", "Each jurisdiction has rules regarding the appropriate service of process.", "Typically, a summons and other related documents must be served upon the defendant personally, or in some cases upon another person of suitable age and discretion at the person's residence or place of business or employment.", "In some cases, service of process may be effected through the mail as in some small claims court procedures.", "In exceptional cases, other forms of service may be authorized by procedural rules or court order, including service by publication when an individual cannot be located in a particular jurisdiction.", "Proper service of process initially establishes personal jurisdiction of the court over the person served.", "If the defendant ignores further pleadings or fails to participate in the proceedings, then the court or administrative body may find the defendant in default and award relief to the claimant, petitioner or plaintiff.", "The defendant may contest the default in his or her home state." ] ], "gold": "Service of process is the procedure by which a party to a lawsuit gives an appropriate notice of initial legal action to another party, court, or administrative body in an effort to exercise jurisdiction over that person so as to enable that person to respond to the proceeding before the court, body, or other tribunal. The general term for a person who serves these legal documents is a process server and most jurisdictions require or permit process to be served by a court official, such as a sheriff, marshal, constable, or bailiff. In Rhode Island, the term limited power constable is used for individuals who complete 90 days of training, passes a written exam and an oral interview in order to serve documents and are placed on a one year period with limited powers until they can apply for his/her full powers to arrest, evict, and be able to serve statewide. In civil law jurisdictions, which include all of Continental Europe and most Asian countries, service of process is generally performed by the court and may be done in person by a bailiff, or by mail, depending on the jurisdiction.", "prediction 1": "In civil law jurisdictions, which include all of Continental Europe and most Asian countries, service of process is generally performed by the court. This may be done in person by a bailiff, or by mail, depending on the jurisdiction. In some instances, delivery to an agent for acceptance of service or a \"registered agent\" can substitute for personal service on the principal party to be served. The Registered Agent is a person or company authorized in advance to accept service on behalf of the served party.", "prediction 2": "In most civil law jurisdictions, personal service is service of process directly to the party named on the summons, complaint, or petition. In civil law jurisdictions, service of process is generally performed by the court. This may be done in person by a bailiff, or by mail, depending on the jurisdiction. In some instances, delivery to an agent for acceptance of service or \"registered agent\" can substitute for personal service on the principal party to be served.", "prediction 3": "In most jurisdictions, including all of Continental Europe and most Asian countries, service of process is generally performed by the court. This may be done in person by a bailiff, or by mail, depending on the jurisdiction. In some instances, delivery to an agent for acceptance of service or the \"registered agent\" can substitute for personal service on the principal party to be served. The registered agent is a person or company authorized in advance to accept service on behalf of the served party.", "prediction 4": "In civil law jurisdictions, including all of Continental Europe and most Asian countries, service of process is generally performed by the court. This may be done in person by a bailiff, or by mail, depending on the jurisdiction. However, in some states, delivery to an agent for acceptance of service or \"registered agent\" can substitute for personal service on the principal party to be served. In those instances, delivery to an agent for acceptance of service or \"registered agent\" can substitute for personal service on the principal party to be served. In some jurisdictions, delivery to an agent for acceptance of service can substitute for personal service by mail or by a person otherwise authorized to serve process without involvement of local courts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 511 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Service of process is the procedure by which a party to a lawsuit gives an appropriate notice of initial legal action to another party, court, or administrative body in an effort to exercise jurisdiction over that person so as to enable that person to respond to the proceeding before the court, body, or other tribunal. In civil law jurisdictions, which include all of Continental Europe and most Asian countries, service of process is generally performed by the court. This may be done in person by a bailiff, or by mail, depending on the jurisdiction. " }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "Distance of earth orbit around the sun in miles?", "passages": [ [ "Earth's orbit", "Earth's orbit\n\nAll celestial bodies in the Solar System, including planets such as our own, orbit around the Solar System's centre of mass.", "The sun makes up 99.76% of this mass which is why the centre of mass is extremely close to the sun.", "Earth's orbit is the trajectory along which Earth travels around the Sun.", "The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes \u00a0days (1 sidereal year), during which time Earth has traveled 940\u00a0million km (584 million mi).", "Earth's orbit has an eccentricity of 0.0167.", "As seen from Earth, the planet's orbital prograde motion makes the Sun appear to move with respect to other stars at a rate of about 1\u00b0 (or a Sun or Moon diameter every 12\u00a0hours) eastward per solar day.", "Earth's orbital speed averages about 30\u00a0km/s (108,000\u00a0km/h; 67,000\u00a0mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "From a vantage point above the north pole of either the Sun or Earth, Earth would appear to revolve in a counterclockwise direction around the Sun." ], [ "Apsis", "Apsis\n\nAn apsis (; plural apsides , Greek: \u1f01\u03c8\u1fd6\u03b4\u03b5\u03c2) is an extreme point in the orbit of an object.", "The word comes via Latin from Greek and is cognate with \"apse\".", "For elliptic orbits about a larger body, there are two apsides, named with the prefixes \"peri-\" () and \"ap-\"/\"apo-\" () added to a reference to the body being orbited.", "A straight line connecting the periapsis and apoapsis is the \"line of apsides\".", "This is the major axis of the ellipse, its greatest diameter.", "The center of mass, or barycenter, of a two-body system lies on this line at one of the two foci of the ellipse.", "When one body is sufficiently larger than the other, this focus may be located within the larger body.", "However, whether this is the case, both bodies are in similar elliptical orbits.", "Both orbits share a common focus at the system's barycenter, with their respective lines of apsides being of length inversely proportional to their masses.", "Historically, in geocentric systems, apsides were measured from the center of the Earth." ] ], "gold": "Earth orbits the Sun at an average distance of 92.96 million miles, and one complete orbit takes 365.256 days. But there are two apsides in any elliptic orbit, i.e. no planetary body orbits its primary body at the same distance at all times. The farthest point of the Earth's orbit, the apoapsis or aphelion, is at a distance of 94.51 million miles; the Earth's periapsis or perihelion is at a distance of 91.40 million miles from the Sun. ", "prediction 1": "Earth's orbit is the trajectory along which Earth travels around the Sun. The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi).", "prediction 2": "Earth's orbit is the trajectory along which Earth travels around the Sun. The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi). One complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi). Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "prediction 3": "Earth's orbit is the trajectory along which Earth travels around the Sun. The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi). Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "prediction 4": "The distance between the Earth and the Sun is measured in miles, and the average distance between the Earth and the Sun is 149.60 million km (92.96 million mi). Earth's orbit is the trajectory along which Earth travels around the Sun.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 288 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 73 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": " The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes 365.256 days (1 sidereal year). For elliptic orbits about a larger body, there are two apsides, named with the prefixes \"peri-\" and \"ap-\"/\"apo-." }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "The pre-industrial level of co2 in the atmosphere in ppmv is about?", "passages": [ [ "Carbon dioxide in Earth's atmosphere", "When Earth first formed, Earth's atmosphere may have contained more greenhouse gases and concentrations may have been higher, with estimated partial pressure as large as , because there was no bacterial photosynthesis to reduce the gas to carbon compounds and oxygen.", "Methane, a very active greenhouse gas which reacts with oxygen to produce and water vapor, may have been more prevalent as well, with a mixing ratio of 10 (100 parts per million by volume).", "Though water is responsible for most (about 36-70%) of the total greenhouse effect, the role of water vapor as a greenhouse gas depends on temperature.", "On Earth, carbon dioxide is the most relevant, direct anthropologically influenced greenhouse gas.", "Carbon dioxide is often mentioned in the context of its increased influence as a greenhouse gas since the pre-industrial (1750) era.", "In the IPCC Fifth Assessment Report the increase in CO was estimated to be responsible for 1.82 W\u00b7m of the 2.63 W\u00b7m change in radiative forcing on Earth (about 70%).", "The concept of atmospheric CO increasing ground temperature was first published by Svante Arrhenius in 1896.", "The increased radiative forcing due to increased CO in the Earth's atmosphere is based on the physical properties of CO and the non-saturated absorption windows where CO absorbs outgoing long-wave energy." ] ], "gold": "On Earth, carbon dioxide is the most relevant, direct anthropologically influenced greenhouse gas, often mentioned in the context of its increased influence as a greenhouse gas since the pre-industrial era. It is commonly assumed that the level of carbon dioxide in the atmosphere before this time was of 290 ppmv, but more recent indirect data points at a value closer to 260-270 ppmv.", "prediction 1": "The pre-industrial level of carbon dioxide in the atmosphere in parts per million by volume is about. The pre-industrial level of CO2 in the atmosphere in ppmv is about.", "prediction 2": "Carbon dioxide is often mentioned in the context of its increased influence as a greenhouse gas since the pre-industrial (1750) era, in the IPCC Fifth Assessment Report, the increase in CO was estimated to be responsible for 1.82 Wm of the 2.63 Wm change in radiative forcing on Earth (about 70%).", "prediction 3": "Carbon dioxide is often mentioned in the context of its increased influence as a greenhouse gas since the pre-industrial (1750) era. In the IPCC Fifth Assessment Report the increase in CO was estimated to be responsible for 1.82 Wm of the 2.63 Wm change in radiative forcing on Earth (about 70%).", "prediction 4": "The pre-industrial level of carbon dioxide in the atmosphere in ppmv is about. The IPCC Fifth Assessment Report estimated the pre-industrial level of carbon dioxide in the atmosphere to be about 1750 ppmv.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 102, "end": 169 }, { "error type": "Incoherent", "explanation": "", "start": 0, "end": 101 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "On Earth, carbon dioxide is the most relevant, direct anthropologically influenced greenhouse gas. Carbon dioxide is often mentioned in the context of its increased influence as a greenhouse gas since the pre-industrial era. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When did spirit in the sky come out?", "passages": [ [ "Spirit in the Sky", "Spirit in the Sky\n\n\"Spirit in the Sky\" is a song written and originally recorded by Norman Greenbaum and released in late 1969.", "The single became a gold record, selling two million copies from 1969 to 1970 and reached number three on the US \"Billboard\" Hot 100 chart (April 18, 1970), where it lasted for 15 weeks in the Top 100.", "\"Billboard\" ranked the record the No. 22 song of 1970.", "It also climbed to number one on the UK, Australian and Canadian charts in 1970.", "\"Rolling Stone\" ranked \"Spirit in the Sky\" No. 333 on its list of the 500 Greatest Songs of All Time.", "The song was featured on the 1969 album of the same name.", "Cover versions by Doctor and the Medics and Gareth Gates have also made the number 1 spot in the UK.", "\"Spirit in the Sky\" makes several references to Jesus, although Greenbaum is Jewish.", "In a 2006 interview with the \"New York Times\", Greenbaum told a reporter he was inspired to write the song after watching Porter Wagoner singing a gospel song on TV.", "Greenbaum said: \"I thought, 'Yeah, I could do that,' knowing nothing about gospel music, so I sat down and wrote my own gospel song.", "It came easy.", "I wrote the words in 15 minutes.\"" ], [ "Spirit in the Sky", "A humorous version of the song recorded to raise money for the charity Comic Relief by The Kumars with Gareth Gates also reached No. 1 in 2003 becoming the third version of this song to top the UK singles chart.", "Christian band Stellar Kart covered the song on their 2010 album, \"Everything Is Different Now\".", "Goldfrapp sampled the song for their single \"Ooh La La\".", "\"Spirit in the Sky\" served as the first single from \"Pop Idol\" runner-up Gareth Gates' second studio album, \"Go Your Own Way\".", "The single was released on March 14, 2003, and was the official \"Comic Relief\" charity single for 2003.", "The song features guest vocals from The Kumars.", "The song peaked at number one on the UK Singles Chart, becoming Gates' fourth number one single." ], [ "Sweden in the Eurovision Song Contest 2019", "The fourth semi-final will take place on the 23rd of February 2019 at the Sparbanken Lidk\u00f6ping Arena in Lidk\u00f6ping.", "The Second Chance Round will take place on the 2nd of March 2019 at the Rosvalla Nyk\u00f6ping Eventcenter in Nyk\u00f6ping.", "The \"Eurovision Song Contest 2019\" will take place at the Expo Tel Aviv in Tel Aviv, Israel, and will consist of two semi-finals on 8 and 10 May and the final on 12 May 2018.", "According to Eurovision rules, all nations with the exceptions of the host country and the \"Big 5\" (France, Germany, Italy, Spain and the United Kingdom) are required to qualify from one of two semi-finals in order to compete for the final; the top ten countries from each semi-final progress to the final.", "Voting during the three shows will involve each country awarding two sets of points from 1-8, 10 and 12: one from their professional jury and the other from televoting.", "Each nation's jury consisted of five music industry professionals who are citizens of the country they represent, with their names published before the contest to ensure transparency.", "This jury judges each entry based on: vocal capacity; the stage performance; the song's composition and originality; and the overall impression by the act." ] ], "gold": "\"Spirit in the Sky\" is a song written and originally recorded by Norman Greenbaum and released in late 1969, featuring in the album of the same name. The song became a hit, having climbed to number one on the UK, Australian and Canadian charts in 1970. Since then, the song has been covered by different artists including Gareth Gates, who released his version as a single on March 14, 2003. A song by the same name was released by the Norwegian supergroup Keiino on 25 January 2019 for the Eurovision Song Contest 2019.", "prediction 1": "Spirit in the Sky is a song written and originally recorded by Norman Greenbaum and released in late 1969. The single became a gold record, selling two million copies from 1969 to 1970 and reached number three on the US Billboard Hot 100 chart (April 18, 1970). The humorous version of the song recorded to raise money for the charity Comic Relief by The Kumars with Gareth Gates also reached No. 1 in 2003, becoming the third version of this song to top the UK singles chart. Christian band Stellar Kart covered the song on their 2010 album, Everything Is Different Now.", "prediction 2": "Spirit in the Sky, a song written and originally recorded by Norman Greenbaum and released in late 1969, has had several cover versions. A humorous version of the song recorded to raise money for the charity Comic Relief by The Kumars with Gareth Gates also reached No. 1 in 2003, becoming the third version of this song to top the UK singles chart. Christian band Stellar Kart covered the song on their 2010 album, Everything Is Different Now. The song served as the first single from \"Pop Idol\" runner-up Gareth Gates' second studio album, Go Your Own Way, and was the official Comic Relief charity single for 2003.", "prediction 3": "Spirit in the Sky is a song written and originally recorded by Norman Greenbaum and released in late 1969. The single became a gold record, selling two million copies from 1969 to 1970 and reached number three on the US Billboard Hot 100 chart (April 18, 1970), where it lasted for 15 weeks in the Top 100. Christian band Stellar Kart covered the song on their 2010 album, Everything Is Different Now. A humorous version of the song recorded to raise money for the charity Comic Relief by The Kumars with Gareth Gates also reached No. 1 in 2003, becoming the third version of this song to top the UK singles chart. Christian band Stellar Kart covered the song on their 2010 album, Everything Is Different Now. Christian band Stellar Kart covered the song on their 2010 album, Everything Is Different Now.", "prediction 4": "Spirit in the Sky is a song written and originally recorded by Norman Greenbaum and released in late 1969. The single became a gold record, selling two million copies from 1969 to 1970 and reached number three on the US Billboard Hot 100 chart (April 18, 1970), where it lasted for 15 weeks in the Top 100. A humorous version of the song recorded to raise money for the charity Comic Relief by The Kumars with Gareth Gates also reached No. 1 in 2003, becoming the third version of this song to top the UK singles chart.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 261 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 347 }, { "error type": "Irrelevant", "explanation": "", "start": 408, "end": 476 }, { "error type": "Irrelevant", "explanation": "", "start": 477, "end": 571 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Spirit in the Sky is a song written and originally recorded by Norman Greenbaum and released in late 1969. The song was featured on the 1969 album of the same name. The song climbed to number one on the UK, Australian and Canadian charts in 1970. The humorous version of the song recorded by The Kumars with Gareth Gates also reached No. 1 in 2003. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who does lesean mccoy play for in the nfl?", "passages": [ [ "LeSean McCoy", "McCoy had said in November 2008 and in January 2009 that he was coming back to Pittsburgh for his junior year.", "On January 7, 2009, McCoy notified Wannstedt of his decision to go pro.", "However, he delayed the decision until January 14, when he officially announced he was leaving for the NFL.", "Talking to Larry Fitzgerald of the Arizona Cardinals, who also left after two years, helped sway McCoy.", "The team's performance in the Sun Bowl, did not have any influence though.", "On January 14, 2009, the University of Pittsburgh announced that McCoy declared himself eligible for the NFL Draft, forgoing his final two years of eligibility.", "The serious injury he sustained his senior year at Bishop McDevitt was a factor in his decision to enter the draft early.", "\"As a result of a season-ending injury my senior year, I learned a humbling lesson,\" McCoy said.", "\"Nothing is promised to us and it can all be taken away in a moment.\"", "McCoy was drafted by the Philadelphia Eagles in the second round (53rd overall) of the 2009 NFL Draft.", "He was the fourth running back to be selected that year.", "He signed a four-year contract for $3.47 million, including $1.72 million guaranteed, with the team on June 29, 2009." ], [ "LeSean McCoy", "LeSean McCoy\n\nLeSean Kamel \"Shady\" McCoy (born July 12, 1988) is an American football running back for the Buffalo Bills of the National Football League (NFL).", "He was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft.", "He played college football at Pittsburgh.", "McCoy attended Bishop McDevitt High School in Harrisburg, Pennsylvania, from 2002 to 2006.", "In his senior year of high school, McCoy suffered a major ankle injury, which threatened his career.", "In his first year at Pittsburgh in 2007, McCoy rushed for over 1,300 yards and recorded 14 touchdowns.", "In 2008, McCoy was selected as a second-team All-American.", "His 21 rushing touchdowns were third in the nation, only one behind the two leaders.", "McCoy made his NFL debut on September 13, 2009, against the Carolina Panthers.", "He rushed for 637 yards that year.", "In 2010, McCoy took over as the starting running back for the Eagles, and broke the 1,000 yard rushing barrier.", "In 2011, McCoy was named First team All-Pro by the Associated Press.", "In 2012, McCoy suffered a concussion that limited him to only twelve games.", "In 2013, McCoy led the NFL in rushing yards with 1,607, shattering the team's individual single-season rushing yards record that stood for 34 years." ], [ "LeSean McCoy", "At the time, this was McCoy's second highest single game rushing total of his career.", "The Philadelphia Eagles took the win over divisional foe Washington Redskins.", "His performance was good enough to earn him FedEx Ground Player of the Week honors.", "McCoy was only handed the ball 11 times in Week two, resulting in 53 yards.", "But he contributed as a wide receiver and caught five passes for 114 yards.", "114 yards currently stands as McCoy's top receiving yards in a game.", "The Eagles then faced former head coach Andy Reid and the Kansas City Chiefs in Week 3, on Thursday Night Football.", "McCoy rushed for 158 yards on 20 attempts, for 7.9 yards per carry.", "Though the Eagles lost this game and fell to 1-2, McCoy surpassed 150 yards from scrimmage in each of his first three games of the season.", "Over the course of the next six games McCoy saw somewhat limited action with varied results.", "He received more than 20 carries once in a game and broke 100 yards rushing only once.", "The Eagles dropped back to back games to divisional foes but beat Oakland on November 3, to bring their record to 4-5.", "McCoy rushed for 155 yards against the Green Bay Packers.", "This was his third game surpassing 150 yards rushing.", "On December 8, 2013, Philadelphia had their first major snowfall of the year, with over 8.5 inches of snow falling." ] ], "gold": "LeSean McCoy is an American football running back who played for several NFL teams. After having been drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft, he played for the team until 2014. In 2015, he started playing for the Buffalo Bills, but left in 2018. The following year, McCoy signed a one-year contract with Kansas City Chiefs, playing for them from 2019 to 2020. ", "prediction 1": "LeSean McCoy was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft. He was the fourth running back to be selected that year. McCoy signed a four-year contract for $3.47 million, including $1.72 million guaranteed, with the team on June 29, 2009.", "prediction 2": "LeSean McCoy, born July 12, 1988, is an American football running back who plays for the Buffalo Bills of the National Football League. He was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft. He made his NFL debut on September 13, 2009, against the Carolina Panthers. He rushed for 637 yards that year.", "prediction 3": "LeSean McCoy is an American football running back for the Buffalo Bills of the National Football League. He was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft. He had been a member of the Eagles since 2009. Then, in 2013, he was part of the Kansas City Chiefs.", "prediction 4": "LeSean McCoy was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft. He was the first running back selected by the Eagles. McCoy played for the Buffalo Bills from 2009 to 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 272 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "LeSean McCoy is an American football running back for the Buffalo Bills of the National Football League (NFL). LeSean McCoy was drafted by the Philadelphia Eagles in the second round of the 2009 NFL Draft. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does the dutch reformed church come from?", "passages": [ [ "Dutch Reformed Church", "Two years later, in 1568, following an attack on the Netherlands by the forces of the Duke of Alba, many Netherlanders fled to the German city of Wesel, where a Synod was convened at which the Belgic Confession and Heidelberg Catechism were adopted, and provisions were made for the offices of pastor, elder, teacher and deacon.", "The first Synod of 23 Dutch Reformed leaders was held in October 1571 in the German city of Emden.", "The Synod of Emden is generally considered to be the founding of the Dutch Reformed Church, the oldest of the Reformed churches in the Netherlands.", "The Synod both affirmed the actions of the earlier Synod of Wesel, as well as established presbyterian church government for the Dutch Reformed Church.", "The first Synod to be located in the Dutch Republic was held in Dordrecht in 1578.", "This synodical meeting is not to be confused with the better known Second Synod of Dort of 1618.", "Large groups of Marranos settled in Emden and converted to Christianity.", "Mostly all Marranos, many Jewish groups converted to Christianity around 1649 to the Nederduitsche, Niederdeutsche church later on Dutch Reformed Church.", "In the latter meeting, the Church fathers expelled Arminians and added the Canons of Dort to the Confessions." ], [ "Netherlands Reformed Churches", "Netherlands Reformed Churches\n\nThe Netherlands Reformed Churches are a conservative Reformed Protestant Christian denomination in the Kingdom of the Netherlands.", "The denomination came into existence in 1967 out of a schism within the Reformed Churches in the Netherlands (Liberated).", "The history of the Netherlands Reformed Churches (Dutch \"Nederlands Gereformeerde Kerken\") coincides to a great extent with that of the Reformed Churches (Liberated), of which it was a part until the early 1960s.", "That denomination arose out of a conflict within the Reformed Churches in the Netherlands over the covenant and the power of the general synod.", "After that schism, referred to as the \"Liberation\" (Dutch \"Vrijmaking\"), the Liberated churches became a very conservative, orthodox denomination.", "Wary of the liberal tendencies within various Reformed denominations, they started to develop a number of cultural and political structures and institutes, membership in which was restricted to church members.", "Some within the church held the view that the Liberated church was the only true church in the Netherlands, implying that all other Christians were in violation of God's command to be joined to God's covenant people.", "A sizeable group disagreed with this view.", "In 1964 the disagreement came to a head, when Rev. Van der Ziel was accused of errors in his teaching and found guilty by the synod of the Reformed Churches (Liberated), which defrocked him." ], [ "Dutch Reformed Church", "Dutch Reformed Church\n\nThe Dutch Reformed Church (in or NHK) was the largest Christian denomination in the Netherlands from the onset of the Protestant Reformation until 1930.", "It was the foremost Protestant denomination, and\u2014since 1892\u2014one of the two major Reformed denominations along with the Reformed Churches in the Netherlands.", "It spread to the United States, South Africa, Indonesia, Sri Lanka, Brazil, and various other world regions through the Dutch colonization.", "It has been the original denomination of the Dutch Royal Family until being merged into the Protestant Church in the Netherlands, a United church of both Reformed and Evangelical Lutheran theological orientations.", "The allegiance to the Dutch Reformed Church was a common feature among Dutch immigrant communities around the world, and became a crucial part of Afrikaner nationalism in South Africa.", "It developed during the Protestant Reformation, being shaped theologically by John Calvin, but also other major Reformed theologians.", "It was founded in 1571.", "The Dutch Reformed Church was shaped by various theological developments and controversies during its history, including Arminianism, the Nadere Reformatie and a number of splits in the 19th century that greatly diversified Dutch Calvinism.", "The church functioned until 2004, the year it merged with the Reformed Churches in the Netherlands and the Evangelical Lutheran Church in the Kingdom of the Netherlands to form the Protestant Church in the Netherlands." ] ], "gold": "During the Reformation, many Netherlanders fled to the German city of Wesel following an attack on the Netherlands by the forces of the Duke of Alba as part of the religious violence and persecution carried out by the established Catholic Church and governments. These reformers later held their reunited in the German city of Emden, where they convened the Synod of Emden, generally considered to be the founding of the Dutch Reformed Church. This denomination was strongly shaped by the theology of John Calvin.", "prediction 1": "The Dutch Reformed Church (in or NHK) was the largest Christian denomination in the Netherlands from the onset of the Protestant Reformation until 1930. It was the foremost Protestant denomination, and\u2014since 1892\u2014one of the two major Reformed denominations along with the Reformed Churches in the Netherlands. The church functioned until 2004, when it merged with the Reformed Churches in the Netherlands and the Evangelical Lutheran Church in the Kingdom of the Netherlands to form the Protestant Church in the Netherlands.", "prediction 2": "The Dutch Reformed Church is a conservative Reformed Protestant Christian denomination in the Kingdom of the Netherlands. It came into existence in 1967 out of a schism within the Reformed Churches in the Netherlands. The church was founded in 1571 in the German city of Wesel.", "prediction 3": "The Dutch Reformed Church, known simply as the Dutch Reformed Church, is a conservative Reformed Protestant Christian denomination in the Kingdom of the Netherlands. It came into existence in 1967 out of a schism within the Reformed Churches in the Netherlands (Liberated). The church functioned until 2004, the year it merged with the Reformed Churches in the Netherlands and the Evangelical Lutheran Church in the Kingdom of the Netherlands to form the Protestant Church in the Netherlands.", "prediction 4": "The Dutch Reformed Church, commonly known as the NHK, was the largest Christian denomination in the Netherlands from the onset of the Protestant Reformation until 1930. It was the foremost Protestant denomination in the Netherlands and one of the two major Reformed denominations along with the Reformed Churches in the Netherlands. It was founded in 1571 and developed during the Protestant Reformation, being shaped theologically by John Calvin, but also other major Reformed theologians.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 309 }, { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 524 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Following an attack on the Netherlands by the forces of the Duke of Alba, many Netherlanders fled to the German city of Wesel. The first Synod of 23 Dutch Reformed leaders was held in October 1571 in the German city of Emden. The Synod of Emden is generally considered to be the founding of the Dutch Reformed Church, the oldest of the Reformed churches in the Netherlands. This denomination was strongly shaped by the theology of John Calvin. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When was the rh bill passed into law?", "passages": [ [ "Responsible Parenthood and Reproductive Health Act of 2012", "On December 19, 2012, both versions of the bill were passed to the Bicameral Committee to produce a final version to be signed by the President Aquino.", "The committee quickly passed the bill in just one session.", "It was transmitted back to the House of Representatives and the Senate, which both ratified the bill, with the Senate voting 11\u20135 in favor of ratification, and the House of Representatives voting via voice vote\n\nOn December 21, 2012, President Aquino signed the bill into law, codifying the bill as Republic Act No. 10354, otherwise known as the \"Responsible Parenthood and Reproductive Health Act of 2012\".", "News of the signing was announced by House Majority Leader Neptali Gonzales II on December 28, 2012.", "In response to petitions challenging the law's constitutionality, the Supreme Court voted 10-5 on March 19, 2013 to issue a status quo ante order halting the implementation of the law for four months.", "Oral arguments were set for June 18 but postponed until July 9 after the Supreme Court received additional petitions and interventions.", "During oral arguments, several justices indicated that the court \"does not seem to be the right forum\u2013at least for now.\"", "Ir could not settle medical issues, such as whether any contraceptives to be made available were actually abortifacients." ], [ "Responsible Parenthood and Reproductive Health Act of 2012", "Responsible Parenthood and Reproductive Health Act of 2012\n\nThe Responsible Parenthood and Reproductive Health Act of 2012 (Republic Act No. 10354), informally known as the Reproductive Health Law or RH Law, is a law in the Philippines, which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care.", "While there is general agreement about its provisions on maternal and child health, there is great debate on its mandate that the Philippine government and the private sector will fund and undertake widespread distribution of family planning devices such as condoms, birth control pills, and IUDs, as the government continues to disseminate information on their use through all health care centers.", "Passage of the legislation was controversial and highly divisive, with tambays, academics, religious institutions, and major political figures declaring their support or opposition while it was pending in the legislature.", "Heated debates and rallies both supporting and opposing the RH Bill took place nationwide.", "The Supreme Court delayed implementation of the law in March 2013 in response to challenges.", "On April 3,2014, the Court ruled that the law was \"not unconstitutional\" but struck down eight provisions partially or in full.", "The Senate Policy Brief titled \"Promoting Reproductive Health\", the history of reproductive health in the Philippines dates back to 1967 when leaders of 12 countries including the Philippines' Ferdinand Marcos signed the Declaration on Population." ] ], "gold": "The Responsible Parenthood and Reproductive Health Act, or RH Law, is a Philippine law that provided universal access to methods on contraception, fertility control, sexual education, and maternal care. Passage of the legislation was controversial and highly divisive. Enacted by the Senate on December 19, 2012, the bill was signed by Benigno Aquino III on December 21, 2012 and enacted on December 23, 2012 by the House of Representatives. The RH bill was finally commenced on January 17, 2013.", "prediction 1": "The Responsible Parenthood and Reproductive Health Act of 2012, officially known as Republic Act No. 10354, is a law in the Philippines, which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care. The law was passed on December 19, 2012, both versions of the bill were passed to the Bicameral Committee to produce a final version to be signed by the President Aquino. The bill was transmitted back to the House of Representatives and the Senate, which both ratified the bill, with the Senate voting 11\u20135 in favor of ratification. On December 21, 2012, President Aquino signed the responsible parenthood and reproductive health bill into law, codifying the law, otherwise known as the Responsible Parenthood and Reproductive Health Act of 2012.", "prediction 2": "The Responsible Parenthood and Reproductive Health Act of 2012 (RH Law) is a law in the Philippines, which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care. While there is general agreement about its provisions on maternal and child health, there is great debate on its mandate that the Philippine government and the private sector will fund and undertake widespread distribution of family planning devices such as condoms, birth control pills, and IUDs, as the government continues to disseminate information on their use through all health care centers.", "prediction 3": "The Responsible Parenthood and Reproductive Health Act of 2012, informally known as the Reproductive Health Law or RH Law, is a law in the Philippines which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care. The bill was passed by both houses of the Philippine Congress on December 19, 2012 and by the Bicameral Committee on December 21, 2012.", "prediction 4": "The Responsible Parenthood and Reproductive Health Act or RH Law is a law in the Philippines, which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care. It was passed by both houses of the Philippine legislature on December 19, 2012, and was transmitted to the Senate on December 21, 2012. The law was passed by both houses of the Philippine legislature on December 21, 2012, and signed by President Aquino on December 21, 2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 427, "end": 588 }, { "error type": "Irrelevant", "explanation": "", "start": 701, "end": 802 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Responsible Parenthood and Reproductive Health Act of 2012 is a law in the Philippines, which guarantees universal access to methods on contraception, fertility control, sexual education, and maternal care. Passage of the legislation was controversial and highly divisive. The law was passed on December 19, 2012, both versions of the bill were passed to the Bicameral Committee to produce a final version to be signed by the President Aquino. On December 21, 2012, President Aquino signed the responsible parenthood and reproductive health bill into law." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When was the first season of the office?", "passages": [ [ "The Office", "The Office\n\nThe Office is a mockumentary sitcom that was first made in the United Kingdom and has now been remade in many other countries.", "The total overall viewership is in the hundreds of millions worldwide.", "The original United Kingdom TV series was created by Ricky Gervais and Stephen Merchant.", "It starred Gervais as the boss and main character of the show.", "The first broadcast on BBC Two on 9 July 2001, the show ran for 14 episodes \u2013 two series of six episodes and a two-part Christmas special.", "The longest running version is the United States adaptation, which ran for 9 seasons from 2005 to 2013.", "Germany's \"Stromberg\" has seen 46 episodes over five seasons and a movie aired 2014 in German cinemas.", "\"Selected major awards won only\"" ], [ "The Office (1995 TV series)", "The Office (1995 TV series)\n\nThe Office is an American sitcom starring Valerie Harper that aired for five episodes on CBS from March 11 to April 15, 1995 as a mid-season replacement during the 1994\u201395 television season.", "The series, billed as an office comedy version of the British series \"Upstairs, Downstairs\", centered on the camaraderie of executives and their secretaries of a busy corporate office at a design-packaging company.", "Rita Stone (Valerie Harper) is a divorc\u00e9e and 19-year veteran of a secretarial pool at the executive office of a package design company in Chicago called Package Inc.", "She is outspoken and mainly the glue that holds things together at the company, seeing that everything gets done on time, mediating disputes and trying to be a good listener to both job-related and personal problems." ], [ "The Office (UK TV series)", "The Office (UK TV series)\n\nThe Office is a British television mockumentary sitcom, first broadcast in the UK on BBC Two on 9 July 2001.", "Created, written and directed by Ricky Gervais and Stephen Merchant, the program is about the day-to-day lives of office employees in the Slough branch of the fictional Wernham Hogg Paper Company.", "Gervais also stars in the series, playing the central character, David Brent.", "Two six-episode series were made, along with a pair of 58-minute Christmas specials.", "When it was first shown on BBC Two, it was nearly cancelled due to low ratings, but it has since become one of the most successful of all British comedy exports.", "As well as being shown internationally on BBC Worldwide, channels such as BBC Prime, BBC America and BBC Canada, the series has been sold to broadcasters in over 80 countries, including ABC1 in Australia, The Comedy Network in Canada, TVNZ in New Zealand and the pan-Asian satellite channel STAR World, based in Hong Kong.", "The show began airing in The United States on Cartoon Network's late night programing block, Adult Swim on 18 September 2009 until 2012.", "The show centres on themes of social clumsiness, the trivialities of human behaviour, self-importance and conceit, frustration, desperation and fame." ], [ "The Office (U.S. season 1)", "The Office (U.S. season 1)\n\nThe first season of the American television comedy \"The Office\" premiered in the United States on NBC on March 24, 2005, concluded on April 26, 2005, and consists of six episodes.", "\"The Office\" is an American adaptation of the British TV series of the same name, and is presented in a mockumentary format, portraying the daily lives of office employees in the Scranton, Pennsylvania branch of the fictitious Dunder Mifflin Paper Company.", "This season introduced the main characters, and established the general plot, which revolves around Michael Scott (Steve Carell), regional manager of the Scranton branch office, trying to convince the filmmakers of the documentary that he presides over a happy, well-running office.", "Meanwhile, sales rep Jim Halpert (John Krasinski) finds methods to undermine his cube-mate, Dwight Schrute (Rainn Wilson); receptionist Pam Beesly (Jenna Fischer) tries to deal with Michael's insensitivities and flubs; and temporary employee Ryan Howard (B. J. Novak) is acting mostly as an observer of the insanity around him.", "Season one of \"The Office\" aired on Tuesdays in the United States at 9:30\u00a0p.m." ] ], "gold": "The Office is the name of several American versions of British TV series. The American sitcom starring Valerie Harper and billed as an office comedy version of the British series Upstairs, Downstairs aired its first season on March 11, 1995. The British television mockumentary sitcom created by Ricky Gervais was first broadcasted on 9 July 2001. The latter was remade in the United States, airing on March 24, 2005. It has since been remade in 8 other countries.", "prediction 1": "The first season of The Office, an American mockumentary sitcom, was aired in the United States on March 24, 2005. It was aired in the United Kingdom on BBC Two on July 9, 2001. It was remade in other countries and has been seen by millions worldwide. American version of the show aired from March 23, 2005-April 26, 2005.", "prediction 2": "The first season of the British sitcom The Office was broadcast on BBC Two on 9 July 2001. The first season of the American television comedy The Office aired in the United States on March 24, 2005.", "prediction 3": "The first season of The Office was broadcast in the United Kingdom on BBC Two on 9 July 2001. The first season of The Office in the United States was broadcast in the United States on NBC from March 24, 2005, to April 26, 2005.", "prediction 4": "The first season of the British television sitcom The Office aired on BBC Two on 9 July 2001. The first season of the American television comedy The Office aired on March 24, 2005.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 322 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Office is an American sitcom starring Valerie Harper that aired for five episodes on CBS from March 11 to April 15, 1995. The first season of The Office, an American mockumentary sitcom, was aired in the United States on March 24, 2005. It was aired in the United Kingdom on BBC Two on July 9, 2001. It was remade in many other countries. " }, "preference": [ 1, 1, 1, 2, 0, 0 ] }, { "question": "What is the total number of goals scored in the 2018 world cup?", "passages": [ [ "2018 FIFA World Cup", "2018 FIFA World Cup\n\nThe 2018 FIFA World Cup was the 21st FIFA World Cup, an international football tournament contested by the men's national teams of the member associations of FIFA once every four years.", "It took place in Russia from 14 June to 15 July 2018.", "It was the first World Cup to be held in Eastern Europe, and the 11th time that it had been held in Europe.", "At an estimated cost of over $14.2\u00a0billion, it was the most expensive World Cup.", "It was also the first World Cup to use the video assistant referee (VAR) system.", "The finals involved 32 teams, of which 31 came through qualifying competitions, while the host nation qualified automatically.", "Of the 32 teams, 20 had also appeared in the previous tournament in 2014, while both Iceland and Panama made their first appearances at a FIFA World Cup.", "A total of 64 matches were played in 12 venues across 11 cities.", "The final took place on 15 July at the Luzhniki Stadium in Moscow, between France and Croatia.", "France won the match 4\u20132 to claim their second World Cup title, marking the fourth consecutive title won by a European team.", "The bidding procedure to host the 2018 and 2022 FIFA World Cup tournaments began in January 2009, and national associations had until 2 February 2009 to register their interest." ], [ "Gianluigi Buffon", "On 24 March, Buffon made his 1,000th career appearance, keeping a clean sheet (his 426th overall for club and country) in a 2\u20130 home over Albania in a World Cup qualifier, becoming the eighteenth player to reach this milestone; in the process, he also became the sole most capped European player at international level, with his 168th appearance for Italy, and the joint fifth-most capped male international footballer of all time, alongside Iv\u00e1n Hurtado.", "On 2 September, Buffon made his 170th international appearance in a 3\u20130 away defeat to Spain in a World Cup qualifier; he later extended his European international appearance record with his 172nd appearance for Italy on 6 October, in a 1\u20131 home draw against Macedonia in a 2018 World Cup qualifier, making him the fourth-most capped male international footballer of all time, ahead of Egyptian striker Hossam Hassan (169 caps), and behind only Egyptian midfielder Ahmed Hassan (184 caps), Saudi Arabian goalkeeper Mohamed Al-Deayea (178 caps), and Mexican defender Claudio Su\u00e1rez (177 caps).", "Buffon's 175th international appearance came on 13 November, in the second leg of the World Cup play-offs against Sweden, at the San Siro Stadium in Milan." ] ], "gold": "The 2018 FIFA World Cup was held in Russia, where a total of 169 goals were scored throughout the 64 matches played. Of these, 12 were own goals, 11 scored during the quarter-finals, 4 in the semi-finals, 2 in the third place play-off and 6 during the final, in which France won the match 4-2 against Croatia.", "prediction 1": "The total number of goals scored by the men's national teams of the member associations of FIFA in the 2018 World Cup was 74. It was the most goals scored in any tournament in the history of FIFA. The total number of goals conceded during the 2018 World Cup was 67.", "prediction 2": "In the 2018 FIFA World Cup, the total number of goals scored by all teams was 56. In total, 63 goals were scored in all competitions. The total number of goals scored per game was 62.", "prediction 3": "The 2018 FIFA World Cup was an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. There were a total of 142 goals scored in the 64 matches played.", "prediction 4": "The 2018 FIFA World Cup was an international football tournament contested by the men's national teams of the member associations of FIFA once every four years. There were a total of 104 goals scored in the tournament. The total number of assists was 84, while the total goals scored in all competitions was 81.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 125 }, { "error type": "Unverifiable", "explanation": "", "start": 126, "end": 196 }, { "error type": "Unverifiable", "explanation": "", "start": 197, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The 2018 FIFA World Cup was held in Russia with 64 matches were played." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How many locks in the caen hill flight?", "passages": [ [ "Kennet and Avon Canal", "In the village of Semington the Wilts & Berks Canal joined the canal, linking the Kennet and Avon to the River Thames at Abingdon.", "The North Wilts Canal merged with it to become a branch to the Thames and Severn Canal at Latton near Cricklade.", "The canal was opened in 1810, but abandoned in 1914\u00a0\u2013 a fate hastened by the collapse of Stanley Aqueduct in 1901.", "In 1977 the Wilts & Berks Canal Amenity Group was formed with the aim of fully restoring the canal to re-connect the Kennet and Avon to the upper reaches of the Thames.", "Caen Hill Locks, at Devizes, provides an insight into the engineering needed to build and maintain the canal.", "The main flight of 16 locks, which take 5\u20136 hours\u00a0to navigate in a boat, is part of a longer series of 29 locks built in three groups: seven at Foxhangers, sixteen at Caen Hill, and six at the town end of the flight.", "The total rise is in or a 1 in 30 gradient.", "The locks were the last part of the route of the canal to be completed.", "The steepness of the terrain meant that there was no space to use the normal arrangement of water pounds between the locks.", "As a result, the 16\u00a0locks utilise unusually large side ponds to store the water needed for their operation." ] ], "gold": "There are 29 total locks in the Caen Hill Flight with 16 locks in the main Caen Hill Flight. Caen Hill Locks, at Devizes, provides an insight into the engineering needed to build and maintain the Kennet and Avon Canal. The main flight of 16 locks, which take 5 to 6 hours to navigate in a boat is part of a longer series of 29 locks built in three groups with 7 at Foxhangers, 16 at Caen Hill and 6 at the town end of the flight.", "prediction 1": "Caen Hill Flight is a flight of locks on the Kennet and Avon Canal, between Devizes and Foxhangers. In total, there are 16 locks in this flight, which take 5\u20136 hours to navigate in a boat. There are also 16 locks in the Caen Hill Town end of the flight.", "prediction 2": "Caen Hill Locks, at Devizes, provides an insight into the engineering needed to build and maintain the Kennet and Avon Canal. There are 16 locks in the main flight of the flight, which takes 5\u20136 hours to navigate in a boat, and is part of a longer series of 29 locks built in three groups: seven at Foxhangers, sixteen at Caen Hill, and six at the town end of the flight.", "prediction 3": "The Caen Hill Flight of Locks in Devizes, Somerset, has 16 locks. These locks were the last part of the route of the canal to be completed.", "prediction 4": "Caen Hill Locks, in Devizes, is a flight of locks on the Kennet and Avon Canal. There are 16 locks in the flight, which takes 5\u20136 hours to navigate in a boat. The locks were the last part of the route of the canal to be completed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 99 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 189, "end": 253 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Caen Hill Locks, at Devizes, provides an insight into the engineering needed to build and maintain the canal. The main flight of 16 locks, which take 5\u20136 hours to navigate in a boat, is part of a longer series of 29 locks built in three groups: seven at Foxhangers, sixteen at Caen Hill, and six at the town end of the flight." }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "When did the movie knock knock come out?", "passages": [ [ "Knock Knock (1940 film)", "Knock Knock (1940 film)\n\nKnock Knock is a 1940 animated short subject, part of the \"Andy Panda\" series, produced by Walter Lantz.", "The cartoon is noted for being the first appearance of Woody Woodpecker, and was released by Universal Pictures on November 25, 1940.", "The cartoon ostensibly stars Andy Panda (voice of Sara Berner) and his father, Papa Panda (voice of Mel Blanc), but it is Woody Woodpecker (voice of Blanc) who steals the show.", "Woody constantly pesters Papa Panda by pecking at his house roof, tempting him to try to kill the woodpecker with his shotgun.", "Andy, meanwhile, tries to sprinkle salt on Woody's tail in the belief that this will somehow capture the bird.", "To Woody's surprise, Andy's attempts prevail (comically, the mound of salt placed on Woody's tail is so heavy that he cannot run away), and in an ending very similar to 1938's \"Daffy Duck & Egghead\", two other woodpeckers arrive to take Woody to the insane asylum but then prove to be crazier than he is.", "Like most of the early 1940s Lantz cartoons, \"Knock Knock\" carried no director's credit." ], [ "Knock Knock (2015 film)", "As Evan watches on, she uploads it to his Facebook profile.", "They depart for another victim and take Monkey with them, leaving Evan to his fate.", "Karen and the kids arrive home to the entire house ruined while speechless.", "On April 4, 2014, Keanu Reeves was added to the cast to play Evan Webber, a happily married family man and architect.", "The shooting was filmed in Santiago de Chile.", "Eli Roth stated that filming in Chile is easier than in the United States.", "Chilean actress Ignacia Allamand also joined the film.", "On January 26, 2015 Lionsgate acquired the distribution rights to the film.", "\"Knock Knock\" premiered at the 2015 Sundance Film Festival on January 23, 2015.", "The film was released on October 9, 2015 in the United States.", "On Metacritic, a review aggregator the film has a score of 53 out of 100, based on 22 critics, indicating that it received \"mixed or average reviews\".", "Rotten Tomatoes reports a rating of 35%, based on 68 reviews, with an average rating of 5.2/10.", "The site's consensus states: \"\"Knock Knock\" brings a lot of talent to bear on its satirical approach to torture horror, but not effectively enough to overcome its repetitive story or misguidedly campy tone.\"" ] ], "gold": "There is more than one movie titled \"Knock Knock\" including the 1940 animated short film which is noted for being the first appearance of Woody Woodpecker, and was released by Universal Pictures on November 25, 1940. The movie directed by Eli Roth titled \"Knock Knock\" is an erotic thriller that first premiered at the 2015 Sundance Film Festival on January 23, 2015 and broadly released in the United States on October 9, 2015. ", "prediction 1": "The movie Knock Knock is a 1940 animated short subject, part of the \"Andy Panda\" series, produced by Walter Lantz. The cartoon is noted for being the first appearance of Woody Woodpecker, and was released by Universal Pictures on November 25, 1940. On January 26, 2015, Lionsgate acquired the distribution rights to the film. The film was released on October 9, 2015 in the United States.\n", "prediction 2": "The movie knock knock is an American classic and an American comedy film. The cartoon, knock knock, was released by Universal Pictures on November 25, 1940 and has since been adapted into a live-action movie.", "prediction 3": "The movie Knock Knock, the first installment in the Andy Panda series, was released by Universal Pictures on November 25, 1940. It was adapted and released into a movie on October 9, 2015 in the United States.", "prediction 4": "Knock Knock is a 1940 animated short subject, part of the \"Andy Panda\" series, produced by Walter Lantz. The cartoon is noted for being the first appearance of Woody Woodpecker, and was released by Universal Pictures on November 25, 1940. On January 26, 2015, Lionsgate acquired the distribution rights to the film. \"Knock Knock\" premiered at the 2015 Sundance Film Festival on January 23, 2015. The film was released on October 9, 2015 in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 325 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The movie Knock Knock is a 1940 animated short. The cartoon is noted for being the first appearance of Woody Woodpecker, and was released by Universal Pictures on November 25, 1940. A different film named \"Knock Knock\", involving Eli Roth, premiered at the Sundance Film Festival on January 23, 2015 and was released on October 9, 2015 in the United States.\n" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Where is don't rain on my parade from?", "passages": [ [ "Don't Rain on My Parade", "Don't Rain on My Parade\n\n\"Don't Rain on My Parade\" is a popular song from the 1964 musical \"Funny Girl\".", "It was also featured in the 1968 movie version of the musical.", "The song was written by Bob Merrill and Jule Styne.", "Both the movie and stage versions feature Barbra Streisand performing the song.", "In 2004 it finished No. 46 in AFI's 100 Years...100", "Songs survey of top tunes in American cinema.", "Streisand has sung the song live on many occasions, including during her comeback tour \"Barbra Streisand: The Concert Tour\" (1993\u20131994), \"Timeless Live In Concert Tour\" (1999\u20132000), \"\" (2006\u20132007) and the \"\" (2016).", "The instrumental of this song can be heard during the Overture of the stage show, the film and on Streisand's 2006\u20132007 Tour.", "There is a reprise version of this song with alternate lyrics which served as the finale for the stage show.", "This number was cut from the film.", "Streisand sang this version live for the first time since her run in the original Broadway production as an encore during her 2006\u201307 Tour." ], [ "Funny Girl (Original Broadway Cast Recording)", "Funny Girl (Original Broadway Cast Recording)\n\nFunny Girl (Original Broadway Cast Recording) is the original Broadway cast recording of the musical \"Funny Girl\", loosely based on the life of Fanny Brice: the show opened on March 26, 1964 at the Winter Garden Theater, starring Barbra Streisand.", "It is considered a Streisand's album since she performed 12 out of its 17 tracks.", "It was recorded in a one-day session, quickly after its Broadway debut, and released one week later by Capitol Records, marking the first time a Streisand album was not released through Columbia.", "At the time, Streisand was already a successful singer, winner of the 1963 Grammy Award for Album of the Year and Best Female Vocal Performance and with her 3 first solo albums charting in the Billboard Top 200.", "The album peaked at No. 2 on the Billboard 200 in June 1964.", "and went to win its composers the Grammy for Best Score From an Original Cast Show Album, beating \"Hello, Dolly!\".", "All music written by Jule Styne; lyrics by \u2013 Bob Merrill" ], [ "Broadway theatre", "Broadway theatre\n\nBroadway theatre, commonly known as Broadway, refers to the theatrical performances presented in the 41 professional theatres each with 500 or more seats located in the Theater District and Lincoln Center along Broadway, in Midtown Manhattan, New York City.", "Along with London's West End theatre, Broadway theatre is widely considered to represent the highest level of commercial theatre in the English-speaking world.", "The Theater District is a popular tourist attraction in New York City.", "According to The Broadway League, for the 2017\u20132018 season (which ended May 27, 2018) total attendance was 13,792,614 and Broadway shows had US$1,697,458,795 in grosses, with attendance up 3.9%, grosses up 17.1%, and playing weeks up 2.8%.", "The majority of Broadway shows are musicals.", "Historian Martin Shefter argues \"'Broadway musicals,' culminating in the productions of Richard Rodgers and Oscar Hammerstein, became enormously influential forms of American popular culture\" and helped make New York City the cultural capital of the nation.", "New York did not have a significant theatre presence until about 1750, when actor-managers Walter Murray and Thomas Kean established a resident theatre company at the Theatre on Nassau Street, which held about 280 people.", "They presented Shakespeare plays and ballad operas such as \"The Beggar's Opera\"." ] ], "gold": "\"Don't Rain on My Parade\" is a popular song from \"Funny Girl,\" a musical that opened on Broadway in the United States in 1964. The song was also featured in the 1968 movie version of the musical. Both the movie and stage versions feature Barbra Streisand performing the song.", "prediction 1": "\"Don't Rain on My Parade\" is a popular song from the 1964 musical \"Funny Girl\", also featured in the 1968 movie version of the musical. The song was written by Bob Merrill and Jule Styne. It was also featured in the 2006 film version of the musical.", "prediction 2": "\"Don't Rain on My Parade\" is a popular song from the 1964 musical \"Funny Girl\". It was also featured in the 1968 movie version of the musical. The song was written by Bob Merrill and Jule Styne. Barbra Streisand has sung the song live on many occasions. The original Broadway cast recording of the musical \"Funny Girl\" is considered a Streisand album since she performed 12 out of its 17 tracks.", "prediction 3": "\"Don't Rain on My Parade\" is a popular song from the 1964 musical \"Funny Girl\". It was also featured in the 1968 movie version of the musical. The song was written by Bob Merrill and Jule Styne.", "prediction 4": "\"Don't Rain on My Parade\" is a song from the 1964 musical comedy Funny Girl, which was also featured in the 1968 movie version of the musical. The song was written by Bob Merrill and Jule Styne and was featured in both the film and stage versions of the musical. The original Broadway cast recording of the musical was released on July 29, 1964, which was the date Barbra Streisand sang the song live for the first time since her run in the original Broadway production.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 187 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7,8]}", "start": 221, "end": 249 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Don't Rain on My Parade\" is a popular song from the 1964 Broadway musical \"Funny Girl\", also featured in the 1968 movie version of the musical. Both the movie and stage versions feature Barbra Streisand performing the song. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How far does the earth travel in a second?", "passages": [ [ "Earth's orbit", "Earth's orbit\n\nAll celestial bodies in the Solar System, including planets such as our own, orbit around the Solar System's centre of mass.", "The sun makes up 99.76% of this mass which is why the centre of mass is extremely close to the sun.", "Earth's orbit is the trajectory along which Earth travels around the Sun.", "The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes \u00a0days (1 sidereal year), during which time Earth has traveled 940\u00a0million km (584 million mi).", "Earth's orbit has an eccentricity of 0.0167.", "As seen from Earth, the planet's orbital prograde motion makes the Sun appear to move with respect to other stars at a rate of about 1\u00b0 (or a Sun or Moon diameter every 12\u00a0hours) eastward per solar day.", "Earth's orbital speed averages about 30\u00a0km/s (108,000\u00a0km/h; 67,000\u00a0mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "From a vantage point above the north pole of either the Sun or Earth, Earth would appear to revolve in a counterclockwise direction around the Sun." ] ], "gold": "The Earth takes 365.256 days to travel the 940 million km (584 million mi) Sun's orbit. Earth's orbital speed averages 29.78 km/s (18.5 mi/s).", "prediction 1": "Earth's orbit is the trajectory along which Earth travels around the Sun. The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi). Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "prediction 2": "Earth travels a total of 149.60 million km (92.96 million mi) in a second, and one complete orbit takes days (one sidereal year), during which time Earth has traveled 940 million km (584 million mi). Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "prediction 3": "Earth's orbit is the trajectory along which Earth travels around the Sun. The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi). The Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph), which is fast enough to cover the planet's diameter in 7 minutes and the distance to the Moon in 4 hours.", "prediction 4": "Earth moves at a speed of 30 km/s during its orbit of the Sun. The earth travels around the Sun at a speed of 149.60 million km per second.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 467 } ], "missing-info": [], "corrected-prediction": "The average distance between the Earth and the Sun is 149.60 million km (92.96 million mi), and one complete orbit takes days (1 sidereal year), during which time Earth has traveled 940 million km (584 million mi). Earth's orbital speed averages about 30 km/s (108,000 km/h; 67,000 mph)." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who killed john in hush hush sweet charlotte?", "passages": [ [ "Hush...Hush, Sweet Charlotte", "Hush...Hush, Sweet Charlotte\n\nHush...Hush, Sweet Charlotte is a 1964 American psychological thriller film directed and produced by Robert Aldrich, and starring Bette Davis, Olivia de Havilland, Joseph Cotten, Agnes Moorehead and Mary Astor in her final film role.", "The movie was adapted for the screen by Henry Farrell and Lukas Heller, from Farrell's unpublished short story \"What Ever Happened to Cousin Charlotte?\"", "It received seven Academy Award nominations.", "In 1927, young Southern belle Charlotte Hollis (Bette Davis) and her married lover John Mayhew (Bruce Dern) plan to elope during a party at the Hollis family's antebellum mansion in Ascension Parish, Louisiana.", "Charlotte's father (Victor Buono) confronts John over the affair and intimidates him with the news that John's wife Jewel (Mary Astor) visited the day before and revealed the affair.", "John pretends to Charlotte that he no longer loves her and that they must part.", "John is then brutally decapitated in the summerhouse with a cleaver, with one hand severed.", "Charlotte discovers his body.", "She returns traumatized to the party in a bloody dress, and most of the guests assume Charlotte is the murderer.", "The story jumps to 1964." ], [ "Hush...Hush, Sweet Charlotte", "Charlotte is now a wealthy spinster, still living on the plantation that has been in her family for generations.", "Charlotte's father died the year after Mayhew's murder, believing his daughter guilty.", "Throughout the years, Charlotte believed her father killed John Mayhew.", "Everyone else assumes that Charlotte, the crazy recluse, decapitated her lover.", "The Louisiana Highway Commission intends to demolish her house and build a new highway through the plantation.", "Charlotte refuses to leave and ignores the eviction notice.", "She keeps the foreman (George Kennedy), his demolition crew, and the bulldozer away by shooting at them with a rifle.", "They temporarily give up and leave.", "Charlotte is living alone as a virtual recluse in the Hollis mansion, tended by Velma (Agnes Moorehead), her housekeeper.", "Seeking help in her fight against the Highway Commission, she calls upon Miriam (Olivia de Havilland), a poor cousin who lived with the family as a girl, but has since moved to New York City and has become wealthy.", "Miriam renews her relationship with Drew Bayliss (Joseph Cotten), a local doctor who jilted her after the murder." ] ], "gold": "Hush...Hush, Sweet Charlotte is an American psychological thriller where a middle-aged Southern woman is plagued by bizarre occurrences after summoning her cousin to help challenge the local government's impending demolition of her home. In the movie, almost everybody thinks that Charlotte was responsible of the unsolved murder of John, her lover from decades before. Charlotte, on the other hand, suspects that it was her father. Nonetheless, it is later revealed that Jewel, John's wife, was the real perpetrator of the crime.", "prediction 1": "Hush hush sweet charlotte is a 1964 American psychological thriller film shot on location in Ascension Parish, Louisiana. In the film, Charlotte Hollis kills her lover John Mayhew with a cleaver. The next day John's body is discovered, and Charlotte believes her father killed him. Throughout the years, Charlotte believed her father killed John Mayhew. Throughout the years, Charlotte believed her father killed John Mayhew. Everyone else assumes that Charlotte, the crazy recluse, killed John Mayhew.", "prediction 2": "Hush...Hush, Sweet Charlotte is a 1964 American psychological thriller film directed and produced by Robert Aldrich, and starring Bette Davis, Olivia de Havilland, Joseph Cotten, Agnes Moorehead and Mary Astor in her final film role. The movie was adapted for the screen by Henry Farrell and Lukas Heller, from Farrell's unpublished short story What Ever Happened to Cousin Charlotte? It received seven Academy Award nominations. Throughout the years, Charlotte believed her father killed John Mayhew. Everyone else assumed that Charlotte, the crazy recluse, the murderer.", "prediction 3": "Hush...Hush, Sweet Charlotte is a 1964 American psychological thriller film directed and produced by Robert Aldrich, and starring Bette Davis, Olivia de Havilland, Joseph Cotten, Agnes Moorehead and Mary Astor in her final film role. In 1927, young Southern belle Charlotte Hollis and her married lover John Mayhew plan to elope during a party at the Hollis family's antebellum mansion in Ascension Parish, Louisiana. John is then brutally decapitated in the summerhouse with one hand severed. Charlotte discovers his body and everyone else assumes that she decapitated her lover.", "prediction 4": "Hush...Hush, Sweet Charlotte is a 1964 American psychological thriller film directed and produced by Robert Aldrich and starring Bette Davis, Olivia de Havilland, Joseph Cotten, Agnes Moorehead and Mary Astor in her final film role. The movie was adapted for the screen by Henry Farrell and Lukas Heller, from Farrell's unpublished short story \"What Ever Happened to Cousin Charlotte?\" It received seven Academy Award nominations. Throughout the years, Charlotte believed her father killed John Mayhew. Everyone else assumed that Charlotte, the crazy recluse, the murderer, the crazy recluse, the murderer.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 73, "end": 121 }, { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 167 }, { "error type": "Redundant", "explanation": "The next day John's body is discovered, and Charlotte believes her father killed him.", "start": 304, "end": 353 }, { "error type": "Redundant", "explanation": "Throughout the years, Charlotte believed her father killed John Mayhew. ", "start": 354, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 195 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10, 5 ] } ], "corrected-prediction": "Hush hush sweet charlotte is a 1964 American psychological thriller film. In the film, John Mayhew was killed. The next day John's body is discovered, and Charlotte, throughout the years, believes her father killed him. Everyone else assumes that Charlotte, the crazy recluse, decapitated her lover. The Louisiana Highway Commission intends to demolish her house and Charlotte asks her cousin to come help." }, "preference": [ 0, 1, 1, 1, 0, 2 ] }, { "question": "How many layers are there in osi model?", "passages": [ [ "OSI model", "OSI model\n\nThe Open Systems Interconnection model (OSI model) is a conceptual model that characterizes and standardizes the communication functions of a telecommunication or computing system without regard to its underlying internal structure and technology.", "Its goal is the interoperability of diverse communication systems with standard protocols.", "The model partitions a communication system into abstraction layers.", "The original version of the model defined seven layers.", "A layer serves the layer above it and is served by the layer below it.", "For example, a layer that provides error-free communications across a network provides the path needed by applications above it, while it calls the next lower layer to send and receive packets that comprise the contents of that path.", "Two instances at the same layer are visualized as connected by a \"horizontal\" connection in that layer.", "The model is a product of the Open Systems Interconnection project at the International Organization for Standardization (ISO).", "In the late 1970s, one project was administered by the International Organization for Standardization (ISO), while another was undertaken by the International Telegraph and Telephone Consultative Committee (CCITT, from French:", "Comit\u00e9 Consultatif International T\u00e9l\u00e9phonique et T\u00e9l\u00e9graphique).", "These two international standards bodies each developed a document that defined similar networking models.", "In 1983, these two documents were merged to form a standard called The Basic Reference Model for Open Systems Interconnection." ] ], "gold": "The OSI model is a conceptual model that characterizes and standardizes the communication functions of a telecommunication or computing system without regard to its underlying internal structure and technology. There are generally considered to be 7 layers in the model, and 8 layers when the user is included.", "prediction 1": "The OSI model partitions a communication system into abstraction layers. The original version of the model defined seven layers. A layer serves the layer above it and is served by the layer below it.", "prediction 2": "The OSI model partitions a communication system into abstraction layers. The original version of the model defined seven layers. A layer serves the layer above it and is served by the layer below it. For example, a layer that provides error-free communications across a network provides the path needed by applications above it, while it calls the next lower layer to send and receive packets that comprise the contents of that path.", "prediction 3": "The Open Systems Interconnection model (OSI model) is a conceptual model that characterizes and standardizes the communication functions of a telecommunication or computing system without regard to its underlying internal structure and technology. The original version of the model defined seven layers. A layer serves the layer above it and is served by the layer below it.", "prediction 4": "The Open Systems Interconnection model (OSI model) is a conceptual model that characterizes and standardizes the communication functions of a telecommunication or computing system without regard to its underlying internal structure and technology. The model partitions a communication system into abstraction layers. The original version of the model defined seven layers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 72 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The OSI model is a conceptual model that characterizes and standardizes the communication functions of a telecommunication or computing system without regard to its underlying internal structure and technology. The original version of the model defined seven layers. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "What is the current ios update for iphone?", "passages": [ [ "IOS version history", "IOS version history\n\niOS is a mobile operating system, developed by Apple Inc. for iPhone, iPad, and iPod Touch.", "Updates for iOS are released through the iTunes software and, since iOS 5, via over-the-air software updates.", "With the announcement of iOS 5 on June 6, 2011, a USB connection to iTunes was no longer needed to activate iOS devices; data synchronization can happen automatically and wirelessly through Apple's iCloud service.", "Major new iOS releases are announced yearly during the Apple Worldwide Developers Conference (WWDC), and are usually released in September of the same year, usually coinciding with the release of new iPhone models.", "The most recent stable release, iOS 12.1.2, was released on December 17, 2018.", "June 2007 saw the official release of what eventually became iOS\u00a0\u2013 concurrently with the first iPhone.", "iOS did not have an official name until the official release of the iPhone software development kit (iPhone SDK) on March 6, 2008.", "Before then, Apple marketing simply stated that iPhone ran a version of Mac OS X made specifically for iPhone.", "When iOS was introduced, it was named \"iPhone OS\".", "It was officially renamed iOS on June 7, 2010 with the announcement and introduction of iPad." ], [ "IOS 10", "iOS 10.3.1 was released on April 3, 2017, with bug fixes and security improvements, including a fix for a Wi-Fi vulnerability discovered by Google's Project Zero team of security researchers.", "iOS 10.3.2 was released on May 15, 2017, with bug fixes and security improvements.", "iOS 10.3.3 was released on July 19, 2017, with new wallpapers for the 12.9-inch iPad Pro, along with bug fixes and security improvements, including a fix for a Wi-Fi vulnerability in which devices searching for signal were open to hackers.", "The Control Center has been redesigned and split into three pages: one for general settings, such as quick toggles for airplane mode and orientation lock, one for audio controls and one for controlling HomeKit (internet of things) appliances, if used.", "3D Touch capabilities have been added to several toggles.", "Apps can show a widget when their home-screen icon is accessed with 3D Touch.", "Most default apps included with iOS devices can be hidden from the home screen and 're-downloaded' from the App Store.", "Upon doing this, the sandbox of the respective app is removed, which contains user data, settings and caches." ], [ "IOS jailbreaking", "On August 4, 2016, Apple released iOS version 9.3.4 to patch the semi-untethered jailbreak for 64-bit devices.", "On August 25, 2016, Apple released iOS version 9.3.5 to patch three important vulnerabilities used for the secret jailbreak from the Pegasus Malware from the NSO Group.", "On January 23, 2017, Apple released iOS 10.2.1 to patch jailbreak exploits released by Google for the Yalu iOS 10 jailbreak created by Luca Todesco.", "On December 2, 2017, iOS 11.2 was released, and included a patch to the async_wake exploit by Ian Beer.", "On May 29, 2018, iOS 11.4 was released, including a patch to 2 exploits (empty_list and multi_path) by Ian Beer.", "The legal status of jailbreaking is affected by laws regarding circumvention of digital locks, such as laws protecting digital rights management (DRM) mechanisms.", "Many countries do not have such laws, and some countries have laws including exceptions for jailbreaking.", "International treaties have influenced the development of laws affecting jailbreaking.", "The 1996 World Intellectual Property Organization (WIPO)", "Copyright Treaty requires nations party to the treaties to enact laws against DRM circumvention." ] ], "gold": "The version history of the mobile operating system iOS, developed by Apple Inc., began with the release of iPhone OS for the original iPhone on June 29, 2007 and since its initial release, it has been used as the operating system for iPhone, iPad, iPod Touch, and HomePod, seeing continuous development since then, resulting in new major releases of the software. In 2014, the iOS update for the iPhone was 7.1.2. In 2016, the iOS update for the iPhone was 9.3.5. In 2017, the iOS update for the iPhone was 10.3.3.", "prediction 1": "iOS is a mobile operating system, developed by Apple Inc. for the iPhone, iPad, and iPod Touch. The most recent stable release of iOS was 12.1.2 on December 17, 2018.", "prediction 2": "The most recent stable release of iOS, version 12.1.2, was released on December 17, 2018. The most recent jailbreak update for the iOS operating system on the iPhone was a security patch for the async_wake exploit.", "prediction 3": "Apple released several updates to the operating system iOS on December 17, 2018, and the most recent of the three was iOS 12.1.2.", "prediction 4": "iOS is a mobile operating system developed by Apple Inc. for iPhone, iPad, and iPod Touch. The most recent stable release of iOS, 11.1.2, was released on December 17, 2018.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "iOS is a mobile operating system, first released in June 2007, developed by Apple Inc. for the iPhone, iPad, and iPod Touch. In 2016, the iOS update for the iPhone was 9.3.5. In 2017, the iOS update for the iPhone was 10.3.3. The most recent stable release of iOS was 12.1.2 on December 17, 2018." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who played regina in once upon a time?", "passages": [ [ "Once Upon a Time (TV series)", "He gets his hands dirty.", "He's got a kingdom to run.", "He has a family to protect.", "He has an epic, epic love for Snow White.", "He's like everybody else.", "He's human.\"", "Jennifer Morrison was hired for the part of Emma Swan.", "The actress explained her character as someone who \"help[s] her son Henry whom she abandoned when he was a baby and who seems like he's a little bit emotionally dysfunctional\", but noted that Emma does not start out believing in the fairytale universe.", "Ten-year-old Jared Gilmore, known for his work on \"Mad Men\", took the role of her son, Henry.", "The role of The Evil Queen/ Regina was given to Lana Parrilla.", "For the second season, Meghan Ory and Emilie de Ravin were promoted to series regulars as Red Riding Hood / Ruby and Belle / Lacey respectively, while Bailey made guest appearances in two episodes after departing the series and Sbarge joined the recurring cast.", "Colin O'Donoghue was cast as Captain Killian \"Hook\" Jones, and was upped to series regular for the fourteenth episode of the season." ], [ "Lana Parrilla", "Lana Parrilla\n\nLana Maria Parrilla (born July 15, 1977) is an American actress.", "Parrilla is best known for her roles on television and radio.", "She was a regular cast member in the fifth season of the ABC sitcom \"Spin City\" from 2000 to 2001.", "She later starred in \"Boomtown\" (2002-2003), \"Windfall\" (2006), \"Swingtown\" (2008) and as Dr. Eva Zambrano in the short-lived medical drama \"Miami Medical\" (2010).", "She also played the role of Sarah Gavin during the fourth season of the Fox series \"24\" in 2005.", "In 2011, Parrilla began starring as The Evil Queen/Regina Mills in the ABC fantasy drama series, \"Once Upon a Time\".", "In 2016 Parrilla won a Teen Choice Award for Choice Sci-Fi/Fantasy TV Actress.", "Parrilla was born in the Brooklyn borough of New York City in 1977.", "Her mother, Dolores Dee Azzara, is of Sicilian ancestry and her father was Sam Parrilla (1943\u201394), a Puerto Rico-born baseball player who played professionally for 11 seasons (1963\u201373), including with the Major League Philadelphia Phillies as an outfielder for one season (1970).", "She is also the niece of Candice Azzara, the American Broadway and TV actress." ], [ "Ava Acres", "Ava Acres\n\nAva Acres is an American actress.", "She played Young Regina in \"Once Upon a Time\" and also appears in \"Agents of S.H.I.E.L.D.\" as Katya Belyakov, the main antagonist of the episode \"Melinda\".", "In addition, she has played Madeline in season 5 of the television series \"American Horror Story\", and as Young Rebecca in the comedy series \"Crazy Ex-Girlfriend\".", "Acres' older sister, Isabella, is also an actress." ], [ "Once Upon a Time (TV series)", "Once Upon a Time (TV series)\n\nOnce Upon a Time is an American fantasy drama television series on ABC which debuted on October 23, 2011, and concluded on May 18, 2018.", "The first six seasons are largely set in the fictitious seaside town of Storybrooke, Maine, with the characters of Emma Swan and Regina Mills serving as the leads, while the seventh and final season takes place in a Seattle, Washington neighborhood called Hyperion Heights, with a new main narrative led by Mills, and Swan and Mills son, Henry Mills.", "The show borrows elements and characters from the Disney universe and popular Western literature, folklore, and fairy tales.", "\"Once Upon a Time\" was created by \"Lost\" and \"\" writers Edward Kitsis and Adam Horowitz.", "A spin-off series, \"Once Upon a Time in Wonderland\", consisting of 13 episodes which followed the titular character from \"Alice in Wonderland\", premiered on October 10, 2013 and concluded on April 3, 2014." ] ], "gold": "In the ABC TV series Once Upon a Time, American actress Ava Acres played young Regina, and American actress Lana Parrilla played adult Regina.", "prediction 1": "In the American fantasy drama television series Once Upon a Time, Regina Mills is played by Ava Acres, a 20-year-old American actress who played Regina in the first six seasons. In Season 7, Regina was played by Jennifer Morrison, while in Season 8 Regina was played by Emily McMullin. In Season 12 Regina was played by Jill DeVito, a twenty-something American actress who played Regina in the first seven seasons.", "prediction 2": "In the American fantasy drama television series, Once Upon a Time, the evil queen/regina Mills is played by American actress Lana Parrilla. American actress Ava Acres plays Regina Mills in the series.", "prediction 3": "The American fantasy drama television series Once Upon a Time uses elements and characters from the Disney universe and popular Western literature, folklore, and fairy tales. American actress Ava Acres played Young Regina in the 2011 episode of Once Upon a Time.", "prediction 4": "Once Upon a Time is an American fantasy drama television series on ABC. The first six seasons are largely set in the fictitious seaside town of Storybrooke, Maine, with the characters of Emma Swan and Regina Mills serving as the leads, while the seventh and final season takes place in a Seattle, Washington neighborhood called Hyperion Heights. Ava Acres played Regina's Young Regina on the American version of the show.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 66, "end": 78 }, { "error type": "Unverifiable", "explanation": "", "start": 178, "end": 285 }, { "error type": "Unverifiable", "explanation": "", "start": 286, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 133 }, { "error type": "Unverifiable", "explanation": "", "start": 134, "end": 177 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "In ABC's American fantasy drama television series Once Upon a Time, starring Lana Parrilla, as Regina Mills. Young Regina is played by Ava Acres. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who sang baby did a bad bad thing?", "passages": [ [ "Baby Did a Bad Bad Thing", "Baby Did a Bad Bad Thing\n\n\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album \"Forever Blue\".", "Filled with sensuality and erotic imagery, the song was described by Isaak as a declaration to \"somebody who is so evil and twisted and bad, and yet, you still want them\u201d.", "The title evokes how \"That\u2019s a bad bad thing\" is used by both parents scolding misbehaving children and adults during sexual intercourse.", "Similar to how Isaak's \"Wicked Game\" only became a success following its inclusion in \"Wild at Heart\" (1990), the song got most of its mainstream recognition after being featured in the 1999 Stanley Kubrick film \"Eyes Wide Shut\", starring Tom Cruise and Nicole Kidman.", "Kubrick heard the song as Kidman listened to Isaak's music to liven up during rehearsals.", "Isaak was asked for his approval as he prepared to perform on \"The Tonight Show\", and immediately agreed once he was told it was for Kubrick, who Isaak declared \"hasn't done a film I didn't like\"." ], [ "Amy Lee", "Amy Lee\n\nAmy Lynn Hartzler (; born December 13, 1981), known professionally as Amy Lee, is an American singer, songwriter, and pianist.", "She is the co-founder and lead vocalist of the rock band Evanescence.", "Along with her contributions with the band, Lee has also participated on other musical projects including Walt Disney Records' \"Nightmare Revisited\" and \"\".", "She has performed collaborations with artists such as Korn, Seether, and David Hodges.", "Lee composed the soundtrack to the films \"War Story\" (2014) and \"\" (2015) with cellist Dave Eggar, and the song \"Speak to Me\" for the film \"Voice from the Stone\" (2017).", "She possesses a mezzo-soprano vocal range.", "Lee received the Songwriter Icon Award from the National Music Publishers Association in 2008.", "In 2012, she won Best Vocalist at the \"Revolver\" Golden Gods Awards and was also named Rock Goddess of the Year at the \"Loudwire\" Music Awards.", "She was awarded Best Film Score by the Moondance International Film Festival for \"Indigo Grey: The Passage\" in 2015.", "Lee is also the American chairperson for the international epilepsy awareness foundation \"Out of the Shadows\".", "Amy Lee was born in Riverside, California, to parents John Lee, a disc jockey and TV personality, and Sara Cargill.", "She has two sisters, Carrie and Lori." ], [ "Lynda Carter", "Lynda Carter\n\nLynda Carter (born Linda Jean C\u00f3rdova Carter; July 24, 1951) is an American actress, singer, songwriter, model, and beauty pageant titleholder, who was crowned Miss World America 1972.", "She would go on to finish as a semifinalist in the Miss World 1972 pageant.", "Carter is most widely known as the star of the American live action television series \"Wonder Woman\", in the role of Diana Prince / Wonder Woman, based on the DC comic book fictional superheroine character of the same name, which aired on ABC and later on CBS from 1975 to 1979.", "Carter was born in Phoenix, Arizona, the daughter of Juanita (n\u00e9e C\u00f3rdova) and Colby Carter.", "Her father is of English and Scots-Irish ancestry, and her mother, whose family hailed from Mexico, is of Mexican, Spanish and French descent.", "Carter made her public television debut on \"Lew King's Talent Show\" at age 5.", "During high school, Carter performed in a band called \"Just Us\", consisting of a marimba, a conga drum, an acoustic guitar, and a stand-up bass played by another girl.", "When she was 16, she joined two of her cousins in another band called The Relatives.", "Actor Gary Burghoff was the drummer." ] ], "gold": "Chris Isaak's song Baby Did a Bad Bad Thing has been sung a number of times. American musician Chris Isaak sang the 1996 version of it, while industrial music duo Collide sang it in 2009. In 2016, The Pinxtones and singer Amy Lee sang it. Singer Lynda Carter sang it in 2018.", "prediction 1": "\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album Forever Blue. American singer, songwriter, and pianist Amy Lee sang the song. American actress, singer, songwriter and model Lynda Carter also sang the song.", "prediction 2": "\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album Forever Blue. American singer, songwriter, and pianist Amy Lee sang the song. American actress Lynda Carter sang the song. American rock and roll singer Chris Isaak also sang the song.", "prediction 3": "\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album Forever Blue. American singer, songwriter, and pianist Amy Lee sang the song. American actress, singer, and songwriter Lynda Carter sang the song.", "prediction 4": "\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album Forever Blue. American singer, songwriter, and pianist Amy Lee sang the song. American actress Lynda Carter also sang the song.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 143, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 286 } ], "missing-info": [], "corrected-prediction": "\"Baby Did a Bad Bad Thing\" is a song by American rock and roll artist Chris Isaak, released as the first track to the 1995 album Forever Blue. " }, "preference": [ 1, 0, 0, 2, 0, 0 ] }, { "question": "Where is eurovision 2018 going to be held?", "passages": [ [ "Eurovision Song Contest 2018", "Following Sobral's triumph, the European Broadcasting Union (EBU)'s Executive Supervisor for the Eurovision Song Contest, Jon Ola Sand, issued the hosting invitation to RTP during the winner's press conference.", "The following day, the director-general of RTP, Nuno Artur Silva, confirmed that the broadcaster would organise the contest in 2018 and mentioned MEO Arena (later renamed Altice Arena) in Lisbon as a likely venue to host the contest.", "On 15 May 2017, RTP appeared to have confirmed Lisbon as the host city, but clarified the following day that no final decision had been taken regarding both the host city and venue.", "The basic requirements to select a host city were set out in a document presented by the EBU to RTP following their win in Kiev:\n\nBesides Lisbon, other cities signalled their interest in bidding to host the 2018 contest: Braga, Espinho, Faro, Gondomar, Guimar\u00e3es, and Santa Maria da Feira.", "The mayor of Porto, Rui Moreira, declared he would not be interested in \"spending millions of euros\" to host the contest, but he would support a bid from the Metropolitan Area of Porto (Espinho, Gondomar, and Santa Maria da Feira)." ], [ "Portugal in the Eurovision Song Contest 2018", "Portugal in the Eurovision Song Contest 2018\n\nPortugal participated in the Eurovision Song Contest 2018.", "In addition to participating in the contest, the Portuguese broadcaster R\u00e1dio e Televis\u00e3o de Portugal (RTP) also hosted the event on 8, 10 and 12 May 2018, at the Altice Arena in Lisbon, after winning the competition in with the song \"Amar pelos dois\" performed by Salvador Sobral.", "The Portuguese entry for the 2018 contest was selected through a national final, the \"Festival da Can\u00e7\u00e3o\".", "It consisted of two semi-finals on 18 and 25 February 2018, at RTP's studios in Lisbon, and a final on 4 March 2018, at the Pavilh\u00e3o Multiusos in Guimar\u00e3es.", "Prior to the 2018 Contest, Portugal had participated in the Eurovision Song Contest forty-nine times since its first entry in 1964.", "Since semi-finals were introduced into the contest in 2004, Portugal has failed to reach the final eight times.", "Portugal held the record for the most appearances in the contest without a win until 2017 when they won in Kiev, Ukraine, with Salvador Sobral's entry, \"Amar pelos dois\".", "The Portuguese broadcaster for the 2018 Contest, who broadcasts the event in Portugal and organises the selection process for its entry, will be R\u00e1dio e", "Televis\u00e3o de Portugal (RTP)." ] ], "gold": "The Eurovision Song Contest 2018 took place in Lisbon, Portugal. It was the first time Portugal had hosted the contest - 54 years after the country made its debut. Organized by the European Broadcasting Union and host broadcaster R\u00e1dio e Televis\u00e3o de Portugal, the contest was held at the Altice Arena, and consisted of two semi-finals May on 8 and 10, and the final on May 12, 2018.", "prediction 1": "The Eurovision Song Contest is an international music competition held at the Eurovision Song Contest. The host city for Eurovision 2018 was Lisbon. The host city for the 2018 contest was Lisbon.", "prediction 2": "The Eurovision Song Contest is an annual international music talent search competition held in the United Kingdom. In 2018, the Eurovision Song Contest was held in Lisbon at the MEO Arena, later renamed Altice Arena, at the Palace of Culture, Bel\u00e9m. The final was held on 4 March 2018, at the Pavilho Multiusos, Guimares.", "prediction 3": "The Eurovision Song Contest was held in several cities in Portugal in 2018. The host city for the 2018 contest was Lisbon, Portugal. The host city for the 2018 contest's finals was Lisbon, Portugal. The finals were held on 8, 10 and 12 May 2018, at the Altice Arena in Lisbon.", "prediction 4": "The Eurovision Song Contest was held in Ukraine in 2017. Portugal's entry for the 2018 contest was selected through a national final. The Portuguese broadcaster for the 2018 Contest, who broadcasts the event in Portugal and organises the selection process for its entry, will be R\u00e1dio e Televiso de Portugal (RTP). The contest was held on 8, 10 and 12 May 2018, at the Altice Arena in Lisbon, after winning the competition in Kiev, Ukraine, with the song \"Amar pelos dois\" performed by Salvador Sobral.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 102 }, { "error type": "Redundant", "explanation": "The Eurovision Song Contest is an international music competition held at the Eurovision Song Contest. The host city for Eurovision 2018 was Lisbon. ", "start": 149, "end": 195 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The host city for Eurovision 2018 was Lisbon. The Portuguese broadcaster R\u00e1dio e Televis\u00e3o de Portugal (RTP) hosted the event on 8, 10 and 12 May 2018, at the Altice Arena." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Where did the new york giants first play?", "passages": [ [ "History of the New York Giants", "Before the 1948 season, the Giants signed defensive back Emlen Tunnell, the first African American player in team history, and later the first African American inducted into the Hall of Fame.", "From 1947 to 1949, they never finished above .500, but came back with a 10\u20132 record in 1950.", "However, they lost to the Cleveland Browns, whom they had beaten twice in the regular season, 8\u20133, in the 1950 divisional playoff game.", "In 1949, halfback Gene \"Choo-Choo\" Roberts scored a league-high 17 touchdowns, and in 1950, he set a team record that would stand for over 50 years, when he rushed for 218 yards on November 12.", "Following the 1953 season, an important transition in Giants history occurred.", "After being the team's coach for 23 years, Steve Owen was fired by Wellington and Jack Mara, and replaced by Jim Lee Howell.", "Wellington later described the move by calling it \"the hardest decision I'd ever made\".", "New York went 7\u20135 in 1954 under Howell.", "In their 31st and final season playing their home games at the Polo Grounds in 1955, they went 5\u20131\u20131 over their final seven games to finish 6\u20135\u20131.", "They were led by rejuvenated running back Frank Gifford, who played the entire season solely on offense for the first time in several years." ], [ "New York Giants", "New York Giants\n\nThe New York Giants are a professional American football team based in the New York metropolitan area.", "The Giants compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division.", "The team plays its home games at MetLife Stadium in East Rutherford, New Jersey, which it shares with the New York Jets in a unique arrangement.", "The Giants hold their summer training camp at the Quest Diagnostics Training Center at the Meadowlands Sports Complex.", "The Giants were one of five teams that joined the NFL in 1925, and is the only one of that group still existing, as well as the league's longest-established team in the Northeastern United States.", "The team ranks third among all NFL franchises with eight NFL championship titles: four in the pre\u2013Super Bowl era (1927, 1934, 1938, 1956) and four since the advent of the Super Bowl (XXI (1986), XXV (1990), XLII (2007), and XLVI (2011)), along with more championship appearances than any other team, with 19 overall appearances.", "Their championship tally is surpassed only by the Green Bay Packers (13) and Chicago Bears (9).", "Throughout their history, the Giants have featured 28 Hall of Fame players, including NFL", "Most Valuable Player (MVP) award winners Mel Hein, Frank Gifford, Y." ], [ "History of the New York Giants", "From 1981 to 1990, the team qualified for the postseason seven times and won Super Bowls XXI and XXV.", "The team's success during the 1980s was aided by head coach Bill Parcells, quarterback Phil Simms and Hall of Fame linebackers Lawrence Taylor and Harry Carson.", "New York struggled throughout much of the 1990s as Parcells left the team, and players such as Simms and Taylor declined and eventually retired.", "They returned to the Super Bowl in 2000, but lost to the Baltimore Ravens in Super Bowl XXXV.", "The Giants upset the heavily favored New England Patriots in Super Bowls XLII and XLVI.", "The Giants were founded in 1925 by original owner Tim Mara with an investment of $500.", "Legally named \"New York Football Giants\" (which they still are to this day) to distinguish themselves from the baseball team of the same name, they became one of the first teams in the then five-year-old National Football League.", "In 1919, Charles Stoneham, the owner of the New York Giants baseball team, had organized and promoted a professional football team to be called the New York Giants.", "The team folded before its first game.", "The New York Football Giants played their first game against All New Britain in New Britain, Connecticut on October 5, 1925." ] ], "gold": "The New York Giants are a professional American football team based in the New York metropolitan area. The team was one of five teams that originally joined the NFL in 1925, and are the only one of that group still existing. The first game they ever played was against All New Britain in New Britain, CT on October 5, 1925, the Polo Grounds being the first place were they ever played their home games.", "prediction 1": "The New York Giants are a professional American football team based in the New York metropolitan area. The team was founded in 1925 and first played against All New Britain in New Britain, Connecticut. They began playing in the NFL in 1946, and started playing in the NFL in 1947. They began playing in the NFL in 1950 and began playing in the NFL in 1961.", "prediction 2": "The New York Giants are a professional American football team based in the New York metropolitan area. The team was founded in 1925 and first played on October 5, 1925 against All New Britain in New Britain, Connecticut.", "prediction 3": "The New York Giants are a professional American football team based in the New York metropolitan area and compete in the National Football League (NFL) as a member club of the league's National Football Conference East division. The team first played on October 5, 1925 against All New Britain in New Britain, Connecticut. The team first played on October 5, 1925 against the Cincinnati Bengals at MetLife Stadium in East Rutherford, New Jersey.", "prediction 4": "The New York Giants are a professional American football team based in the New York metropolitan area. The team played its first game against All New Britain on October 5, 1925.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 131 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 235, "end": 240 }, { "error type": "Redundant", "explanation": "They began playing in the NFL in 1946, and ", "start": 245, "end": 271 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 275, "end": 280 }, { "error type": "Redundant", "explanation": "They began playing in the NFL in 1946, and started playing in the NFL in 1947. ", "start": 281, "end": 310 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 314, "end": 318 }, { "error type": "Redundant", "explanation": "They began playing in the NFL in 1950 and ", "start": 323, "end": 347 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 351, "end": 356 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "The New York Giants are a professional American football team based in the New York metropolitan area. The Giants were one of five teams that joined the NFL in 1925, and is the only one of that group still existing. The New York Football Giants played their first game against All New Britain in New Britain, Connecticut on October 5, 1925." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When does game of thrones come out this year?", "passages": [ [ "Game of Thrones", "Game of Thrones\n\nGame of Thrones is an American fantasy drama television series created by David Benioff and D. B. Weiss.", "It is an adaptation of \"A Song of Ice and Fire\", George R. R. Martin's series of fantasy novels, the first of which is \"A Game of Thrones\".", "It is filmed in Belfast and elsewhere in Northern Ireland, Canada, Croatia, Iceland, Malta, Morocco, Scotland, Spain, and the United States.", "The series premiered on HBO in the United States on April 17, 2011, and its seventh season ended on August 27, 2017.", "The series will conclude with its eighth season premiering in April 2019.", "Set on the fictional continents of Westeros and Essos, \"Game of Thrones\" has several plot lines and a large ensemble cast but centers on three primary story arcs.", "The first story arc centers on the Iron Throne of the Seven Kingdoms and follows a web of alliances and conflicts among the dynastic noble families either vying to claim the throne or fighting for independence from the throne.", "The second story arc focuses on the last descendant of the realm's deposed ruling dynasty, exiled and plotting a return to the throne." ], [ "Game of Thrones (season 6)", "Game of Thrones (season 6)\n\nThe sixth season of the fantasy drama television series \"Game of Thrones\" premiered on HBO on April 24, 2016, and concluded on June 26, 2016.", "It consists of ten episodes, each of approximately 50\u201360 minutes long, largely of original content not found in George R. R. Martin's \"A Song of Ice and Fire\" series.", "Some story elements were derived from the novels and from information Martin revealed to the show-runners.", "The series was adapted for television by David Benioff and D. B. Weiss.", "HBO ordered the season on April 8, 2014, together with the fifth season, which began filming in July 2015 primarily in Northern Ireland, Spain, Croatia, Iceland and Canada.", "Each episode cost over $10 million.", "The season follows the continuing struggle between the Starks and other noble families of Westeros for the Iron Throne.", "The Starks defeat the Bolton forces in battle, and Jon Snow is proclaimed the King in the North.", "Tyrion attempts to rule Meereen while Daenerys is held captive by a Dothraki tribe.", "At King's Landing, the Tyrell army attempts to liberate Margaery and Loras, but Margaery capitulates to the High Sparrow, who becomes more powerful by influencing King Tommen." ], [ "Game of Thrones (season 7)", "On March 8, 2017, HBO released the first promotional poster for the season ahead of the SXSW Festival in Austin, Texas, which teases the battle of \"ice vs. fire\".", "Showrunners Benioff and Weiss also spoke at the event, along with fellow cast members Sophie Turner and Maisie Williams.", "On March 9, 2017, HBO hosted a live stream on the \"Game of Thrones\" Facebook page that revealed the premiere date for the seventh season as being July 16, 2017.", "It was accompanied by a teaser trailer.", "On March 30, 2017, the first official promo for the show was released, highlighting the thrones of Daenerys Targaryen, Jon Snow, and Cersei Lannister.", "On April 20, 2017, HBO released 15 official photos shot during the season.", "On May 22, 2017, HBO released several new photos from the new season.", "On May 23, 2017, HBO released the official posters featuring the Night King.", "The first official trailer for season 7 was released on May 24, 2017.", "The trailer set a world record for being the most viewed show trailer ever, being viewed 61 million times across digital platforms, in the first 24 hours.", "The second official trailer was released on June 21, 2017.", "The season premiere was screened at the Walt Disney Concert Hall in Los Angeles on July 12, 2017." ] ], "gold": "Game of Thrones is an American fantasy drama television series based of A Song of Ice and Fire, a series of fantasy novels by George R. R. Martin. It premiered on HBO in the United States on April 17, 2011, and concluded with season 8 on May 19, 2019, with a total of 73 episodes broadcast. The previous three seasons were released on July 16, 2017, April 24, 2016 and April 12, 2015.", "prediction 1": "Game of Thrones is an American fantasy television series created by David Benioff and D. B. Weiss. It is an adaptation of George R. R. Martin's series of fantasy novels, the first of which is A Game of Thrones. The series premiered on HBO in the United States on April 17, 2011, and its seventh season ended on August 27, 2017. Game of Thrones' eighth season premiered in April 2019, with the final episode airing on April 26, 2019.", "prediction 2": "Game of Thrones is an American fantasy drama television series created by David Benioff and D. B. Weiss based on George R. R. Martin's novel A Game of Thrones. Season 7 premiered in the United States on July 16, 2017. Season 8 premiered on HBO on June 23, 2018. Game of Thrones season 9 premiered on HBO in the United States on March 15, 2019. Season 10 premiered on HBO on April 9, 2019.", "prediction 3": "Game of Thrones is an American fantasy drama television series created by David Benioff and D. B. Weiss. It is an adaptation of George R. R. Martin's series of fantasy novels, the first of which is A Game of Thrones. Game of Thrones premiered on HBO in the United States on April 17, 2011 and its seventh season ended on August 27, 2017. The series will conclude with its eighth season premiering in April 2019. Game of Thrones comes out in the United States on July 12, 2017 and on HBO in the United States on July 14, 2018.", "prediction 4": "Game of Thrones is an American fantasy drama television series created by David Benioff and D. B. Weiss. It is an adaptation of George R. R. Martin's series of fantasy novels, the first of which is A Game of Thrones. Season 1 of the series came out on May 17, 2015. Season 2 came out on May 17, 2018. Season 3 came out on May 23, 2017. Season 4 came out on June 28, 2019. Season 5 came out on May 12, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 327 }, { "error type": "Unverifiable", "explanation": "", "start": 384, "end": 432 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Game of Thrones is an American fantasy television series. Weiss. It is an adaptation of \"A Song of Ice and Fire\", George R. R. Martin's series of fantasy novels, the first of which is A Game of Thrones. The series premiered on HBO in the United States on April 17, 2011, and its seventh season ended on August 27, 2017. Game of Thrones' eighth season premiered in April 2019. The previous two seasons were released on July 16, 2017, April 24, 2016 for seasons seven and six, respectively. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When is the last time there was a solar eclipse in the us?", "passages": [ [ "Solar eclipse", "Solar eclipse\n\nA solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon which fully or partially blocks (\"occults\") the Sun.", "This can only happen when the Sun, Moon and Earth are nearly aligned on a straight line in three dimensions (syzygy) during a new moon when the Moon is close to the ecliptic plane.", "In a total eclipse, the disk of the Sun is fully obscured by the Moon.", "In partial and annular eclipses, only part of the Sun is obscured.", "If the Moon were in a perfectly circular orbit, a little closer to the Earth, and in the same orbital plane, there would be total solar eclipses every new moon.", "However, since the Moon's orbit is tilted at more than 5 degrees to the Earth's orbit around the Sun, its shadow usually misses Earth.", "A solar eclipse can only occur when the moon is close enough to the ecliptic plane during a new moon.", "Special conditions must occur for the two events to coincide because the Moon's orbit crosses the ecliptic at its orbital nodes twice every draconic month (27.212220 days) while a new moon occurs one every synodic month (29.530587981 days)." ], [ "Solar eclipse of July 28, 1851", "Solar eclipse of July 28, 1851\n\nThe earliest scientifically useful photograph of a total solar eclipse was made by Julius Berkowski at the Royal Observatory in K\u00f6nigsberg, Prussia, on July 28, 1851.", "It was the first correctly exposed photographic image taken during totality thereby including the sun's corona.", "A solar eclipse occurs when the moon passes between the Earth and the sun, casting a shadow on Earth that temporarily obscures part or all of the sun's disc.", "Eclipses can occur only when all three bodies are properly aligned.", "Partial eclipses, in which only a portion of the sun's surface is obscured, are relatively common due to the width of the moon's outer shadow, or penumbra, which may be several hundred miles wide.", "Total eclipses occur when the moon's inner shadow, or umbra, reaches the surface of the earth, completely obscuring the sun over a much narrower portion of the ground.", "If the moon is too far away at the time of an eclipse, its umbra may not reach the Earth's surface, and only a partial eclipse will be visible.", "Before the advent of modern science, solar eclipses were often viewed with superstitious dread.", "However, eclipses are also of interest to science due to the various phenomena that can be observed when they occur." ], [ "Solar eclipse", "The magnitude of an eclipse is the ratio of the apparent size of the Moon to the apparent size of the Sun during an eclipse.", "An eclipse that occurs when the Moon is near its closest distance to Earth (\"i.e.,\" near its perigee) can be a total eclipse because the Moon will appear to be large enough to completely cover the Sun's bright disk or photosphere; a total eclipse has a magnitude greater than or equal to 1.000.", "Conversely, an eclipse that occurs when the Moon is near its farthest distance from Earth (\"i.e.,\" near its apogee) can only be an annular eclipse because the Moon will appear to be slightly smaller than the Sun; the magnitude of an annular eclipse is less than 1.", "Slightly more solar eclipses are annular than total because, on average, the Moon lies too far from Earth to cover the Sun completely.", "A hybrid eclipse occurs when the magnitude of an eclipse changes during the event from less to greater than one, so the eclipse appears to be total at locations nearer the midpoint, and annular at other locations nearer the beginning and end, since the sides of the Earth are slightly further away from the Moon." ], [ "Solar eclipse of August 21, 2017", "Solar eclipse of August 21, 2017\n\nThe solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\" by the media, was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts.", "As a partial solar eclipse, it was visible on land from Nunavut in northern Canada to as far south as northern South America.", "In northwestern Europe and Africa, it was partially visible in the late evening.", "In Asia, it was visible only at the eastern extremity, the Chukchi Peninsula.", "Prior to this event, no solar eclipse had been visible across the entire contiguous United States since June 8, 1918; not since the February 1979 eclipse had a total eclipse been visible from anywhere in the mainland United States.", "The path of totality touched 14 states, and the rest of the U.S. had a partial eclipse.", "The area of the path of totality was about 16 percent of the area of the United States, with most of this area over the ocean, not land." ] ], "gold": "A solar eclipse occurs when a portion of the Earth is engulfed in a shadow cast by the Moon which fully or partially blocks sunlight. A total eclipse occurs when the dark silhouette of the Moon completely obscures the intensely bright light of the Sun, allowing the much fainter solar corona to be visible. The last total solar eclipse in the US was August 21, 2017. An annular eclipse occurs when the Sun and Moon are exactly in line with the Earth, but the apparent size of the Moon is smaller than that of the Sun. The last time there was an annular solar eclipse in the US was May 20, 2012.", "prediction 1": "A solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon which fully or partially blocks (\"occults\") the Sun. This can only happen when the Sun, Moon and Earth are nearly aligned on a straight line in three dimensions (syzygy) during a new moon when the Moon is close to the ecliptic plane. The last time a solar eclipse was visible across the entire contiguous United States was on June 8, 1918. The solar eclipse of August 21, 2017, dubbed \"The Great American Eclipse\", was a total solar eclipse visible within a band that spanned the entire contiguous United States, passing from the Pacific to the Atlantic coasts.\n", "prediction 2": "The last total solar eclipse observed in the United States was on June 8, 1918, when the Sun was occulted by a total eclipse of the Moon. A solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon, which partially or completely blocks the Sun. Solar eclipses occur when the moon passes between the Earth and the Sun, casting a shadow on Earth that temporarily obscures part or all of the sun's disc. Solar eclipses can occur only when the moon is close enough to the ecliptic plane during a new moon, plus the Earth's orbit occults on a new moon. The last total solar eclipse in the US was on August 21, 2017, a partial solar eclipse visible on land from Nunavut in northern Canada to as far south as far south, and as far from northern South America and Zodiaciscipit did not reach Earth.", "prediction 3": "A solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon which fully or partially blocks (\u201coccults\u201d) the Sun. This can only happen when the Sun, Moon and Earth are nearly aligned on a straight line in three dimensions (syzygy), during a new moon when the Moon is close to the ecliptic plane. The last time there was a total solar eclipse over the United States was on June 8, 1918. The solar eclipse of August 21, 2017 was the last time a total solar eclipse visible across the entire contiguous United States since July 28, 1851.", "prediction 4": "A solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon which fully or partially blocks (\"occults\") the Sun. This can only happen when the Sun, Moon and Earth are nearly aligned on a straight line in three dimensions (syzygy) during a new moon when the Moon is close to the ecliptic plane. The last time there was a solar eclipse visible across the entire contiguous US was on June 8, 1918. Under those circumstances, there is only two others. On August 21, 2017, there was a total solar eclipse visible across the entire contiguous US, Inc.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 472, "end": 656 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 5 ] } ], "corrected-prediction": "A solar eclipse occurs when an observer (on Earth) passes through the shadow cast by the Moon which fully or partially blocks the Sun. Partial eclipses is when only a portion of the sun's surface is obscured while total eclipses occur when the moon's inner shadow, or umbra, reaches the surface of the earth, completely obscuring the sun over a much narrower portion of the ground. This can only happen when the Sun, Moon and Earth are nearly aligned on a straight line. The last time a solar eclipse was visible across the entire contiguous United States was on June 8, 1918. There was an eclipse in February 1979 and there was a total solar eclipse on August 21, 2017. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "How many teams can england have in the champions league?", "passages": [ [ "English football clubs in international competitions", "English football clubs in international competitions\n\nEnglish football clubs have entered European association football competitions (UEFA Champions League/European Cup, UEFA Cup/Inter-Cities Fairs Cup and the now defunct UEFA Intertoto Cup and UEFA Cup Winners' Cup) since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup.", "English clubs have also taken part in the FIFA Club World Cup on four occasions and the Intercontinental Cup on six occasions.", "The European Cup began in 1955\u201356, but there was no English representative during that inaugural season as reigning champions Chelsea had been persuaded to withdraw by The Football League.", "The first English side to participate in the following edition was Manchester United, who were also the first English winners in 1968, ten years after their first attempt to win the cup had effectively ended when eight of their players died in the Munich air disaster when flying home from Belgrade after qualifying for the 1957\u201358 semi-final.", "Tottenham Hotspur won the Cup Winners' Cup in 1963.", "Prior to that, England had been pioneers in establishing international competitions, with the Sir Thomas Lipton Trophy, which was won by West Auckland when they defeated Italian side Juventus in 1909." ], [ "UEFA Financial Fair Play Regulations", "Qualification and participation in the Champions League is regarded as a lucrative affair and can earn clubs up to \u00a360\u00a0million in prize money and television rights a season if a club makes it to the final.", "A club only has to play 13 matches from the group stages to reach the final.", "In comparison, finishing bottom of the Premier League is now worth \u00a3175\u00a0million, but is won over 38 matches.", "The financial gulf between successful clubs in the top-tier of European league has had an impact domestically, most notably in the Premier League, where for approximately a dozen years (from 1996 to 2008) there had been an almost complete dominance of the three major domestic English competitions by just three clubs (Arsenal, Chelsea, and Manchester United).", "During this period, the lack of competition for lucrative Champions League football in England from outside of those four clubs was frequently criticised.", "More recently, however, the grip on the four top places in the Premier League (that enable automatic entry into the Champions League competition) by the incumbent \"Big 4\" clubs has been eroded somewhat in more recent seasons due to the rise in competitive performance of both Tottenham Hotspur and Manchester City and the relative decline of Liverpool, Arsenal and Manchester United." ] ], "gold": "English football clubs have entered European association football competitions since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup. English clubs have also taken part in the FIFA Club World Cup on four occasions and the Intercontinental Cup on six occasions. In the 2015-16 season 5 English clubs were in the champions league. In the 2014-15 season, 4 English clubs were in the champions league.", "prediction 1": "English football clubs have entered European association football competitions (UEFA Champions League/European Cup, UEFA Cup/Inter-Cities Fairs Cup and the now defunct UEFA Intertoto Cup and UEFA Cup Winners' Cup) since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup. The English FA set a maximum of 4 teams in the 2005-2006 Champions League for each team in the Premier League and 2 teams in the Europa League for the 2009-2016 season. However, the number of teams is currently set by the European football competitions.", "prediction 2": "English football clubs have entered European association football competitions (UEFA Champions League/European Cup, UEFA Cup/Inter-Cities Fairs Cup and the now defunct UEFA Intertoto Cup and UEFA Cup Winners' Cup) since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup. English clubs have also taken part in the FIFA Club World Cup on four occasions and the Intercontinental Cup on six occasions. The clubs can earn clubs up to \u00a360 million in prize money and television rights a season if a club makes it to the final. A team only has to play 13 matches from the group stages to reach the final.", "prediction 3": "English football clubs have entered European association football competitions (UEFA Champions League/European Cup, UEFA Cup/Inter-Cities Fairs Cup, UEFA Intertoto Cup and UEFA Cup Winners' Cup) since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup. English clubs have also taken part in the FIFA Club World Cup on four occasions and the Intercontinental Cup on six occasions.", "prediction 4": "UEFA Champions League teams consist of four teams from the six UEFA member associations, four from the UEFA Super League and two from the UEFA Europa League. UEFA allows one team for each country in the world for each club to have two representatives from England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 213 }, { "error type": "Unverifiable", "explanation": "", "start": 314, "end": 482 }, { "error type": "Unverifiable", "explanation": "", "start": 483, "end": 567 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "English football clubs have entered European association football competitions since 1955, when Birmingham City and a London XI took part in the inaugural Inter-Cities Fairs Cup. English clubs have also taken part in the FIFA Club World Cup on four occasions and the Intercontinental Cup on six occasions. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "What are the six continental confederations of fifa?", "passages": [ [ "Super cup", "Super cup\n\nA super cup is a competition, usually but not exclusively in association football, which often forms the \"curtain-raiser\" to a season.", "It is typically contested on a national level by two competition winners of the previous season: the knock-out cup winner and the league winner.", "There are also continental super cups, like the UEFA Super Cup in football, which puts together winners of the top- and second-tier UEFA competitions.", "Sometimes these are two-legged ties, with a match played at each side's stadium, but increasingly they are one-off fixtures at a neutral venue, such as a national stadium.", "Some Super Cups have even been staged in venues outside their home country, such as the Italian, French, Mexican and Turkish games.", "If the league champions are also the national cup winners, they may play the runners-up from one of the competitions.", "The following nations have an active super cup competition:\n\n\n\n\nMost of the continental football federations also have their own super cups:\n\nMost of the continental football confederations have jointly held a competition pitting their champions against each other: \nAll of these competitions are now defunct and have been succeeded by the FIFA Club World Cup, which features the champions of all of the confederations, plus the champion of the host country.", "A similar tournament is held at international level, the FIFA Confederations Cup." ] ], "gold": "The FIFA is divided into six different continental confederations, the AFC, CAF, CONCACAF, CONMEBOL, OFC, UEFA, all of which oversee the game in the different continents and regions, organizing continental national and club competitions.", "prediction 1": "There are six continental confederations of FIFA. The six continental football confederations of FIFA are: UEFA, Africa Football Confederation, African Football Confederation, North American Football Confederation, South American Football Confederation, and the African Football Confederation.", "prediction 2": "The six continental confederations of FIFA are the Association Football Confederations (AFC), the Confederation of European Football Associations (UEFA), and the Confederation of European Football Associations (CECO).", "prediction 3": "The six continental confederations of FIFA are the Football Confederation of Europe, the Football Confederation of Central America and the Football Confederation of Southern Africa. The FIFA Confederations Cup is a tournament, usually but not exclusively in association football, which often forms the curtain-raiser to a season. There are also continental super cups, like the UEFA Super Cup in football, which puts together winners of the top- and second-tier UEFA competitions.", "prediction 4": "There are six continental confederations of FIFA, or six continental associations of football. The FIFA Confederations Cup is a tournament held annually at the annual FIFA World Cup. There are also continental super cups, like the UEFA Super Cup in football, which puts together winners of the top- and second-tier UEFA competitions.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 49 }, { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 293 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who has tom brady played in the super bowl?", "passages": [ [ "Tom Brady", "Tom Brady\n\nThomas \"Tom\" Edward Patrick Brady Jr. (born August 3, 1977) is an American football quarterback for the New England Patriots of the National Football League (NFL).", "He is one of only two players in NFL history to have won five Super Bowls (along with defensive player Charles Haley), and he is the only player to have won them all with a single franchise.", "Because of his numerous accomplishments and accolades, many analysts and sportswriters consider Brady to be among the greatest quarterbacks of all time.", "After playing college football for the University of Michigan, Brady was drafted by the Patriots in the sixth round of the 2000 NFL Draft.", "Due to his late draft selection, Brady is considered to be the biggest \"steal\" in the history of the NFL Draft.", "In Brady's sixteen seasons as a starter, he has quarterbacked the Patriots to eight Super Bowl appearances, the most for any player in history.", "Brady is also one of only two quarterbacks to win the Super Bowl in their first season as a starter, the other being Kurt Warner." ], [ "2016 New England Patriots season", "After passes from Brady to White, Amendola, Chris Hogan, and Julian Edelman, as well as a 10-yard rush by White, the Patriots had first-and-10 at the Falcons' 15-yard line.", "A pass interference penalty against De'Vondre Campbell put the ball at the Atlanta 2.", "After an incomplete pass intended for Martellus Bennett, James White took a toss to the right and dove at the goal line for a touchdown, winning Super Bowl LI for the Patriots, 34\u201328.", "With the victory, the Patriots won their fifth Super Bowl, tying them with the Dallas Cowboys and San Francisco 49ers for the second most of all time.", "The win was also the fifth Super Bowl victory for Tom Brady and Bill Belichick, both setting records (Belichick surpassing Chuck Noll for most Super Bowl wins by a head coach, and Brady surpassing Joe Montana and Terry Bradshaw for most Super Bowl wins by a quarterback).", "Brady was named Super Bowl MVP for the fourth time, also setting a record.", "The following are the records surpassed by the Patriots in Super Bowl LI:\n\n\n", "The following are the records tied by the Patriots in Super Bowl LI:\n\n\nFour Patriots were elected to the 2017 Pro Bowl.", "Quarterback Tom Brady, linebacker Dont'a Hightower, safety Devin McCourty, and special teamer Matthew Slater were all named as starters." ], [ "Atlanta Falcons", "Atlanta Falcons\n\nThe Atlanta Falcons are a professional American football team based in Atlanta, Georgia.", "The Falcons compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) South division.", "The Falcons joined the NFL in 1965 as an expansion team, after the NFL offered then-owner Rankin Smith a franchise to keep him from joining the rival American Football League (AFL).", "In their 51 years of existence (through 2016), the Falcons have compiled a record of 350\u2013450\u20136 ( in the regular season and in the playoffs), winning division championships in 1980, 1998, 2004, 2010, 2012, and 2016.", "The Falcons have appeared in two Super Bowls, the first during the 1998 season in Super Bowl XXXIII, where they lost to the Denver Broncos and the second was eighteen years later, a overtime defeat by the New England Patriots in Super Bowl LI.", "The Falcons' current home field is Mercedes-Benz Stadium, which opened for the 2017 season; the team's headquarters and practice facilities are located at a site in Flowery Branch, northeast of Atlanta in Hall County.", "Professional football first came to Atlanta in 1962, when the American Football League (AFL) staged two preseason contests, with one featuring the Denver Broncos vs. the Houston Oilers and the second pitting the Dallas Texans against the Oakland Raiders." ] ], "gold": "As of Super Bowl LV, football quarterback Tom Brady has had 10 Super Bowl appearances and has played several professional football teams in the Super Bowl, including the Philadelphia Eagles in the 2017 Super Bowl, the Atlanta Falcons in the 2016 Super Bowl, and the Seattle Seahawks in the 2014 Super Bowl.", "prediction 1": "Tom Brady has played in five Super Bowls. In his 16 seasons as a starter, Brady has quarterbacked the Patriots to eight Super Bowl appearances. The Atlanta Falcons have played in two Super Bowls. In 1998, Tom Brady played in Super Bowl XXXIII. In 2007, Joe Montana played in Super Bowl XVIII. In 2012, Tom Brady played in Super Bowl XLVIII.", "prediction 2": "Tom Brady is an American professional football quarterback for the New England Patriots of the National Football League. In his 16 seasons as a starter, Brady has quarterbacked the Patriots to eight Super Bowl appearances, the most for any player in history. In Super Bowl LI, Brady played in his 18th game, a double overtime defeat to the Atlanta Falcons.", "prediction 3": "Tom Brady is an American professional football quarterback for the New England Patriots of the National Football League. In his 16 seasons as a starter, Brady has quarterbacked the Patriots to eight Super Bowl appearances, the most for any player in history. In Super Bowl XLI, Brady played against the Atlanta Falcons, who defeated New England in overtime. Brady was named Super Bowl MVP for the fourth time, also setting a record.", "prediction 4": "Tom Brady has played in five Super Bowls. He has played for the New England Patriots in Super Bowl LI, Super Bowl XXXIII, Super Bowl II, and Super Bowl XXXXIII. Tom Brady also has played for the Atlanta Falcons in Super Bowl XXXIII.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Tom Brady has played in five Super Bowls. ", "start": 42, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 195 }, { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 292 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 340 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Tom Brady has quarterbacked the Patriots to eight Super Bowl appearances, and has played several professional football teams in the Super Bowl, including The Atlanta Falcons in 2016. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who sings the song raise a little hell?", "passages": [ [ "Raise a Little Hell", "Raise a Little Hell\n\n\"Raise a Little Hell\" is a song by Canadian rock band Trooper.", "The song is the 10th and final track on the band's 1978 album \"Thick as Thieves\".", "It is the band's only US Hot 100 hit and is regularly played in sports stadiums across Canada and the United States.", "The song peaked at #27 on the Canadian Hot 100 and #59 on the Billboard Hot 100, the group's only hit on the latter chart.", "The song appeared in the television series \"Call Me Fitz\" and \"Stranger Things\"; and the films \"Gutterball (2008) and \"Drive Angry\" (2011).", "\"Raise a Little Hell\" has become both a staple of classic rock radio stations around the world, and a popular sports anthem in Canada and the United States, most notably at National Hockey League and Major League Baseball games.", "Rolling Stone placed the song at #7 on their list of the \"Top 10 Sports Anthems of All Time\", while CKKQ-FM \"the Q\" ranked the song at #10 on their list of \"The 150 Best Canadian Songs\".", "The song as covered by Canadian punk band GrimSkunk and appears on \"\" which the soundtrack to the film \"FUBAR\"." ] ], "gold": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper, who released it as the 10th and final track on the band's 1978 album \"Thick as Thieves\". The song was Trooper's only US Hot 100 hit and was later covered by Canadian punk band GrimSkunk for the soundtrack of the film \"FUBAR\".", "prediction 1": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper. The song is the 10th and final track on the band's 1978 album \"Thick as Thieves\". It is the band's only US Hot 100 hit and is regularly played in sports stadiums across Canada and the United States. It is also a popular sports anthem in the National Hockey League and Major League Baseball games.", "prediction 2": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper that was released on their 1978 album Thieves. It is the band's only US Hot 100 hit and is regularly played in sports stadiums across Canada and the United States. The song appeared in the television series Call Me Fitz and Stranger Things; and the films Gutterball (2008) and Drive Angry (2011). The song as covered by Canadian punk band GrimSkunk and appears on the soundtrack to the film FUBAR.", "prediction 3": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper. The song is the 10th and final track on the band's 1978 album \"Thick as Thieves\". It is the band's only US Hot 100 hit and is regularly played in sports stadiums across Canada and the United States. The song has become both a staple of classic rock radio stations around the world, and a popular sports anthem in Canada and the United States, most notably at National Hockey League and Major League Baseball games.", "prediction 4": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper. It is the 10th and final track on the band's 1978 album Thieves. The song is the band's only US Hot 100 hit and is regularly played in sports stadiums across Canada and the United States. The song appeared in the television series Call Me Fitz and Stranger Things; and the films Gutterball (2008) and Drive Angry (2011). The song has become both a staple of classic rock radio stations around the world, and a popular sports anthem in Canada and the United States, most notably at National Hockey League Baseball games. It has been covered by Canadian punk band GrimSkunk, and appears on the soundtrack to the film FUBAR.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 261 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 359 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"Raise a Little Hell\" is a song by Canadian rock band Trooper. The song is the 10th and final track on the band's 1978 album \"Thick as Thieves\". It is the band's only US Hot 100 hit. The song was covered by Canadian punk band GrimSkunk and appears on \"\" which the soundtrack to the film \"FUBAR\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did stranger things come out on netflix?", "passages": [ [ "Stranger Things", "The team decided to make the game in a similar style to \"The Legend of Zelda\" because it \"was a perfect match because both [\"Stranger Things\" and \"Zelda\"] are about exploration, and it's kind of a mysterious fit that fit the mood of the show,\" according to BonusXP president Dave Pottinger.", "The map of Hawkins in the game was based on a Google street view map of Jackson, Georgia where the series is filmed.", "In order to help keep the game a secret, BonusXP did not hire game testers for their quality assurance, instead having family members from the design team provide feedback; this process helped create the two difficulty levels in the game.", "Completing the game gives players a clip from the Season 2 premiere episode of the show.", "The game was downloaded 3 million times in the first week, becoming a top download and receiving critical praise.", "With the release of season two, an update to the game added Max as a playable character, and a release for the Amazon Fire TV, which included controller support.", "The game was nominated for \"Mobile Game\" at the 14th British Academy Games Awards.", "A second mobile game by BonusXP, \"Stranger Things 3: The Game\", was announced during The Game Awards 2018; it will be released as a tie-in for \"Stranger Things\" third season." ], [ "Stranger Things", "Stranger Things\n\nStranger Things is an American science fiction-horror web television series created, written, and directed by the Duffer Brothers and released on Netflix.", "The Duffer Brothers, Shawn Levy, and Dan Cohen serve as executive producers.", "The first season stars Winona Ryder, David Harbour, Finn Wolfhard, Millie Bobby Brown, Gaten Matarazzo, Caleb McLaughlin, Natalia Dyer, Charlie Heaton, Cara Buono, and Matthew Modine, with Noah Schnapp and Joe Keery in recurring roles.", "For the second season, Schnapp and Keery were made series regulars, along with the additions of Sadie Sink, Dacre Montgomery, Sean Astin, and Paul Reiser; Maya Hawke joined the cast for the third season.", "Set in the fictional town of Hawkins, Indiana, in the 1980s, the first season focuses on the investigation into the disappearance of a young boy amid supernatural events occurring around the town, including the appearance of a girl with psychokinetic abilities who helps the missing boy's friends in their own search.", "The second season, titled \"Stranger Things 2\", is set one year later, and deals with attempts of the characters to return to normality and consequences that linger from the first season.", "The third season, titled \"Stranger Things 3\", is set in mid-1985." ], [ "Stranger Things", "The Duffer Brothers developed the series as a mix of investigative drama alongside supernatural elements portrayed with childlike sensibilities.", "They established its time frame in the 1980s and created a homage to the pop culture of that decade.", "Several themes and directorial aspects were inspired and aesthetically informed by the works of Steven Spielberg, John Carpenter, and Stephen King, among others, including several films, anime and video games.", "The first season of eight episodes premiered on Netflix on July 15, 2016.", "It received critical acclaim for its characterization, pacing, atmosphere, acting, soundtrack, directing, writing, and homages to 1980s genre films.", "The second season, consisting of nine episodes, was released on October 27, 2017.", "In December 2017, Netflix ordered a third season, which began production in April 2018 and will consist of eight episodes, and is set to be released in 2019.", "The Duffer Brothers have said that \"Stranger Things\" is likely to end after its fourth or fifth season.", "The series has received 31 Emmy Award nominations, including for Outstanding Drama Series, four Golden Globe Award nominations, and won the Screen Actors Guild Award for Outstanding Performance by an Ensemble in a Drama Series in 2016.", "\"Stranger Things\" is set in the fictional rural town of Hawkins, Indiana, during the early 1980s." ] ], "gold": "Stranger Things is an American science fiction horror drama television series set in the 1980s in the fictional town of Hawkins, Indiana, following the investigation into the disappearance of a young boy amid supernatural events occurring around the town, including the appearance of a girl with psychokinetic abilities. The show premiered on July 15, 2016 on Netflix to critical acclaim and record viewership on the platform. A second season was released on October 27, 2017 and a third on July 4, 2019, both of them receiving an overall positive response from critics.", "prediction 1": "Stranger Things is an American science fiction horror web television series created, written, and directed by the Duffer Brothers and released on Netflix. The first season of eight episodes premiered on Netflix on July 15, 2016. The second season, consisting of nine episodes, was released on October 27, 2017. In December 2017, Netflix ordered a third season, which began production in April 2018, and will consist of eight episodes, and is set to be released in 2019.", "prediction 2": "Stranger Things is an American science fiction-horror web television series created, written, and directed by the Duffer Brothers and released on Netflix. The first season of eight episodes premiered on Netflix on July 15, 2016. The second season, consisting of nine episodes, was released on October 27, 2017. In December 2017, Netflix ordered a third season, which began production in April 2018, and will consist of eight episodes, and is set to be released in 2019.", "prediction 3": "Stranger Things is an American science fiction horror web television series created, written, and directed by the Duffer Brothers and released on Netflix. The first season of eight episodes premiered on Netflix on July 15, 2016. The second season, consisting of nine episodes, was released on October 27, 2017.", "prediction 4": "Stranger Things is an American science fiction-horror web television series created, written, and directed by the Duffer Brothers and released on Netflix. Episodes 1 and 2 of the series first came out on Netflix on July 15, 2016, while the third and fourth season came out on Netflix in 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 276 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 434 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Stranger Things is an American science fiction horror web television series. Set in the fictional town of Hawkins, Indiana, in the 1980s, the first season focuses on the investigation into the disappearance of a young boy amid supernatural events occurring around the town, including the appearance of a girl with psychokinetic abilities. The first season of eight episodes premiered on Netflix on July 15, 2016. It received critical acclaim for its characterization. The second season was released on October 27, 2017. A third season is set to be released in 2019. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did the soviet union test its first atomic bomb?", "passages": [ [ "Soviet atomic bomb project", "The Soviet efforts also rounded up captured German scientists to join their program, and relied heavily on knowledge passed by spies to Soviet intelligence agencies.", "On 29 August 1949, the Soviet Union secretly conducted its first successful weapon test (\"First Lightning\", based on the American \"Fat Man\" design) at the Semipalatinsk Test Site in Kazakhstan.", "As early as 1910 in Russia, independent research was being conducted on radioactive elements by several Russian scientists.", "Despite the hardship faced by the Russian academy of sciences during the national revolution in 1917, followed by the violent civil war in 1922, the Russian scientists had made remarkable efforts towards the advancement of physics research in the Soviet Union in the 1930s.", "Before the first revolution in 1905, the mineralogist Vladimir Vernadsky had made a number of public calls for a survey of Russia's uranium deposits but none were heeded.", "However, such early efforts were independently and privately funded by various organizations until 1922 when the Radium Institute in Petrograd (now Saint Petersburg) opened and industrialized the research.", "From the 1920s until the late 1930s, Russian physicists had been conducting joint research with their European counterparts on the advancement of atomic physics at the Cavendish Laboratory run by a Kiwi physicist, Ernest Rutherford, where Georgi Gamov and Pyotr Kapitsa had studied and researched." ], [ "Soviet atomic bomb project", "Soviet atomic bomb project\n\nThe Soviet atomic bomb project (Russian: \u0421\u043e\u0432\u0435\u0442\u0441\u043a\u0438\u0439 \u043f\u0440\u043e\u0435\u043a\u0442 \u0430\u0442\u043e\u043c\u043d\u043e\u0439 \u0431\u043e\u043c\u0431\u044b, \"Sovetskiy proyekt atomnoy bomby\") was the classified research and development program that was authorized by Joseph Stalin in the Soviet Union to develop nuclear weapons during World War II.", "Although the Soviet scientific community discussed the possibility of an atomic bomb throughout the 1930s, going as far as making a concrete proposal to develop such a weapon in 1940, the full-scale program was initiated during World War II.", "Because of the conspicuous silence of the scientific publications on the subject of nuclear fission by German, American, and British scientists, Russian physicist Georgy Flyorov suspected that the Allied powers had secretly been developing a \"superweapon\" since 1939.", "Flyorov wrote a letter to Stalin urging him to start this program in 1942.", "Initial efforts were slowed due to the German invasion of the Soviet Union and remained largely composed of the intelligence knowledge gained from the Soviet spy rings working in the U.S. Manhattan Project.", "After Stalin learned of the atomic bombings of Hiroshima and Nagasaki that ended the Pacific War in 1945, the program was pursued aggressively and accelerated through effective intelligence gathering about the German nuclear weapon project and the American Manhattan Project." ], [ "RDS-1", "RDS-1\n\nThe RDS-1 (), also known as Izdeliye 501 (device 501) and First Lightning (), was the nuclear bomb used in the Soviet Union's first nuclear weapon test.", "The United States assigned it the code-name Joe-1, in reference to Joseph Stalin.", "It was detonated on 29 August 1949 at 7:00\u00a0a.m., at Semipalatinsk, Kazakh SSR, after top-secret research and development as part of the Soviet atomic bomb project.", "The weapon was designed at the Kurchatov Institute\u00a0\u2014 at the time officially known as \"Laboratory \u2116 2\", but designated as the \"office\" or \"base\" in internal documents\u00a0\u2014 starting in April 1946.", "Plutonium for the bomb was produced at the industrial complex Chelyabinsk-40.", "The RDS-1 explosion yielded 22 kilotons of TNT, similar to the American Gadget and Fat Man bombs.", "At Lavrentiy Beria's insistence, the RDS-1 bomb was designed as an implosion weapon similar to the Fat Man bomb dropped on Nagasaki, Japan; RDS-1 also had a solid plutonium core." ] ], "gold": "The Soviet atomic bomb project was the classified research and development program that was authorized by Joseph Stalin in the Soviet Union to develop nuclear weapons during World War II. After Stalin learned of the atomic bombings of Hiroshima and Nagasaki, the program was pursued aggressively and accelerated through effective intelligence gathering about the German nuclear weapon project and the American Manhattan Project. On August 29, 1949 at 7:00 a.m., the Soviet Union secretly conducted its first successful weapon test at the Semipalatinsk Test Site in Kazakhstan.", "prediction 1": "The Soviet Union secretly conducted its first successful weapon test on 29 August 1949, when the RDS-1 was detonated at 7:00 a.m. at the Semipalatinsk Test Site in Kazakhstan. The RDS-1, also known as Izdeliye 501 (device 501) and First Lightning, was the nuclear bomb used in the Soviet Union's first nuclear weapon test. The RDS-1 was designed at the Kurchatov Institute and was named after Soviet leader Joseph Stalin.", "prediction 2": "The Soviet atomic bomb project was the classified research and development program that was authorized by Joseph Stalin in the Soviet Union to develop nuclear weapons during World War II. The Soviet Union secretly conducted its first successful weapon test on 29 August 1949, which involved the first RDS-1 atomic bomb, also known as Izdeliye 501 (device 501) and First Lightning, based on the American Fat Man design, at the Semipalatinsk Test Site in Kazakhstan. The RDS-1 bomb was detonated at 7:00 a.", "prediction 3": "The Soviet Union secretly conducted its first successful weapon test on 29 August 1949 at the Semipalatinsk Test Site in Kazakhstan. The bomb used in the test was named First Lightning, after its inventor, Lavrentiy Beria, who had been working on the device until he was captured in November 1940.", "prediction 4": "The Soviet atomic bomb project was the classified research and development program that was authorized by Joseph Stalin in the Soviet Union to develop nuclear weapons during World War II. The Soviets secretly conducted their first successful weapon test on 29 August 1949, based on the American \"Fat Man\" design. The RDS-1 bomb was used in the test. The device was designed by Lavrentiy Beria and was designed as an implosion weapon similar to the Fat Man bomb dropped on Nagasaki, Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 322 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 421 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Soviet atomic bomb project was the classified research and development program that was authorized by Joseph Stalin in the Soviet Union to develop nuclear weapons during World War II. After Stalin learned of the atomic bombings of Hiroshima and Nagasaki that ended the Pacific War in 1945, the program was pursued aggressively and accelerated through effective intelligence gathering about the German nuclear weapon project and the American Manhattan Project. The Soviet Union secretly conducted its first successful weapon test on 29 August 1949, when the RDS-1 was detonated at 7:00 a.m. at the Semipalatinsk Test Site in Kazakhstan. " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When did nc state win the national championship?", "passages": [ [ "1974 NCAA Division I Basketball Tournament", "1974 NCAA Division I Basketball Tournament\n\nThe 1974 NCAA Division I Basketball Tournament involved 25 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball.", "It was the first tournament to officially be designated as a Division I championship\u2014previously, NCAA member schools had been divided into the \"University Division\" and \"College Division\".", "The NCAA created its current three-division setup, effective with the 1973\u201374 academic year, by moving all of its University Division schools to Division I and splitting the College Division members into Division II (fewer scholarships) and Division III (no athletic scholarships allowed).", "Previous tournaments would retroactively be considered Division I championships.", "The tournament began on March 9, 1974, and ended with the championship game on March 25 in Greensboro, North Carolina.", "As of 2017, it is the last tournament in which neither school had previously appeared in any national championship game (5 years later Michigan State would defeat Indiana St in each school's inaugural Division I National Finals, but Indiana State had previously contested and lost finals in the NAIA National Championships and the NCAA Division II National Championships).", "A total of 29 games were played, including a third place game in each region and a national third place game." ], [ "1974 NCAA Division I Basketball Tournament", "North Carolina State, coached by Norm Sloan, won the national title with a 76\u201364 victory in the final game over Marquette, coached by Al McGuire.", "This result ended UCLA's record streak of seven consecutive titles.", "David Thompson of North Carolina State was named the tournament's Most Outstanding Player.", "This was the final year that only conference champions and independents could participate in the tournament.", "During the same time in 1974, the Collegiate Commissioners' Association held a tournament in St. Louis, Missouri.", "They invited the second-place teams from eight conferences to participate.", "In 1975, the NCAA would expand the field to include at-large bids for conference runners-up.", "The UCLA \u2013 North Carolina State semifinal game made \"USA Today\"s list of the greatest NCAA tournament games of all time at #13.", "UCLA star Bill Walton calls that game the most disappointing outcome of his entire basketball career, given how UCLA lost a 5-point lead late in regulation and a 7-point lead in the 2nd overtime, before NC State rallied to win, 80-77.", "The game, played in Greensboro, was like a home game for the Wolfpack; UCLA had defeated NC State by 18 points in a neutral site game in St. Louis (where UCLA defeated Memphis State the previous March to win its seventh consecutive national championship) earlier in the season." ], [ "1983 NCAA Division I Men's Basketball Tournament", "1983 NCAA Division I Men's Basketball Tournament\n\nThe 1983 NCAA Division I Men's Basketball Tournament involved 52 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball.", "It began on March 17, 1983, and ended with the championship game on April 4 at The Pit, then officially known as University Arena, on the campus of the University of New Mexico in Albuquerque.", "A total of 51 games were played.", "North Carolina State, coached by Jim Valvano, won the national title with a 54\u201352 victory in the final game over Houston, coached by Guy Lewis.", "The ending of the final game is one of the most famous in college basketball history, with a buzzer-beating dunk by Lorenzo Charles off a desperation pass from 30 feet out by Dereck Whittenburg.", "Both Charles's dunk and Valvano's running around the court in celebration immediately after the game have been staples of NCAA tournament coverage ever since.", "North Carolina State's victory has often been considered one of the greatest upsets in college basketball history, and is the fourth biggest point-spread upset in Championship Game history.", "Akeem Olajuwon of Houston was named the tournament's Most Outstanding Player, becoming the last player to date to earn this award while playing for a team that failed to win the national title." ] ], "gold": "The 1974 NCAA Division I Basketball Tournament involved 25 schools playing in single elimination play to determine the national champion of men's NCAA Division I college basketball. It was the first tournament to be designated as a Division I championship previously, NCAA member schools had been divided into the \"University Division\" and \"College Division\". North Carolina State, coached by Norm Sloan, won the national title with a 76\u201364 victory in the final game over Marquette, coached by Al McGuire. In 1983, North Carolina State, coached by Jim Valvano, won the national title with a 54\u201352 victory in the final game over Houston, coached by Guy Lewis.", "prediction 1": "The North Carolina State Wolfpack won the national championship in 1974, when Norm Sloan coached the team to a 76-64 victory over Marquette. The 1983 North Carolina State Men's Basketball team won the national championship with a 54-52 victory in the final game over Houston, coached by Guy Lewis.", "prediction 2": "There are several NCAA basketball championships, including those won by North Carolina State. The 1974 NCAA Division I Basketball Tournament involved 25 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball. It was the first tournament to officially be designated as a Division I championship. In 1983, North Carolina State, coached by Jim Valvano, won the national title with a 54-52 victory in the final game over Houston, coached by Guy Lewis.", "prediction 3": "The 1974 NCAA Division I Men's Basketball Tournament involved 25 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball. It was the first tournament to officially be designated as a Division I championship. In the 1983 NCAA Division I Men's Basketball Tournament, North Carolina State won the national title with a 54-52 victory in the final game over Houston, coached by Guy Lewis.", "prediction 4": "During the 1974 NCAA Division I Basketball Tournament, which involved 25 schools playing in single-elimination play to determine the national champion of men's NCAA Division I college basketball, North Carolina State won the national championship with a 76-64 victory in the final game over Marquette, coached by Al McGuire. As of 2017, it is the last tournament in which neither school had previously appeared in any national championship game. The 1983 NCAA Division I Men's Basketball Tournament involved 52 schools playing in single-elimination play to determine the national champion of men's NCAA Division II college basketball.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 1974 NCAA Division I Basketball Tournament involved 25 schools playing in single elimination play to determine the national champion of men's NCAA Division I college basketball. It was the first tournament to officially be designated as a Division I championship\u2014previously, NCAA member schools had been divided into the \"University Division\" and \"College Division. The North Carolina State Wolfpack won the national championship in 1974, when Norm Sloan coached the team to a 76-64 victory over Marquette. The 1983 North Carolina State Men's Basketball team won the national championship with a 54-52 victory in the final game over Houston, coached by Guy Lewis." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who sings in what's love got to do with it movie?", "passages": [ [ "What's Love Got to Do with It (film)", "Bassett won a Golden Globe for Best Performance by an Actress in a Motion Picture - Comedy/Musical and an NAACP Image Award for Outstanding Lead Actress in a Motion Picture.", "Laurence Fishburne was nominated for the Academy Award for Best Actor in a Leading Role and Bassett was nominated for Best Actress in a Leading Role.", "The film won an American Choreography Award for one of its dance sequences.", "The film is recognized by American Film Institute in these lists:\n\n", "The movie received critical acclaim.", "It currently holds a 96% \"fresh\" rating on Rotten Tomatoes, based on 49 reviews with the consensus: \"With a fascinating real-life story and powerhouse performances from Angela Bassett and Laurence Fishburne, \"What's Love Got to Do with It\" is a can't miss biopic.\"", "The film received Academy Award nominations for Best Actress for Angela Bassett (losing to Holly Hunter for The Piano) and Best Actor for Laurence Fishburne (losing to Tom Hanks for Philadelphia).", "Ike Turner complained that negative portrayal of himself in the movie is inaccurate and that the movie and Tina's book are \"filled with lies.\"", "Phil Spector slammed the movie (and the book) as a \"piece of trash\" which \"demonized and vilified Ike\".", "In 2018, Tina Turner revealed to Oprah Winfrey that she only recently watched the movie." ], [ "What's Love Got to Do with It (film)", "What's Love Got to Do with It (film)\n\n", "What's Love Got to Do with It is a 1993 American biographical film directed by Brian Gibson, based on the life of American-born singer Tina Turner.", "It stars Angela Bassett as Tina Turner and Laurence Fishburne as Ike Turner.", "The screenplay was adapted by Kate Lanier from the book \"I, Tina\" written by Tina Turner and Kurt Loder.", "Both Ike and Tina Turner assigned rights to Lanier for their lives to be dramatized in the film.", "The film's soundtrack featured the hit song \"I Don't Wanna Fight\", which went to number one in seven countries.", "In the United States, the film grossed almost $40 million and around $20 million in rentals.", "In the United Kingdom, it grossed nearly \u00a310 million.", "Born and raised in Nutbush, Tennessee, Anna Mae Bullock (Tina's birth name) grows up in an unhappy family, with her parents leaving and abandoning her at a young age.", "Following her grandmother's death, she relocates to St. Louis, reuniting with her mother and close sister Alline.", "Anna Mae pursues a chance to be a professional singer after seeing charismatic bandleader Ike Turner perform one night.", "Later she wins her spot in Turner's band after singing onstage and he begins mentoring her." ], [ "What's Love Got to Do with It (film)", "Whitney Houston was actually offered the role, but had to decline due to imminent maternity.", "Jenifer Lewis also originally auditioned to play Tina Turner but was cast instead as Tina's mother even though she was born in 1957 and just one year older than Angela Bassett.", "Angela Bassett auditioned for the role in October 1992 and was chosen only a month before production began in December.", "During that time she had to learn not only how to talk like Turner but to dance and move like her.", "She would have been willing to try to do the singing as well, but \"not in the time we had,\"", "she said.", "\"I did think about it for a second, though.\"", "Instead, she lip syncs to soundtracks recorded by Tina Turner and Fishburne.", "Bassett worked with Tina Turner, but only \"a little bit.\"", "Turner helped most with the re-creations of her famed dance routines.", "All the Ike and Tina Turner songs used in the film were newly re-recorded versions featuring Tina Turner covering her own songs." ] ], "gold": "What's Love Got to Do with It is a 1993 American biographical musical drama based on the life of American singer Tina Turner. The film stars Angela Bassett, who had to learn to talk, dance and move like Turner. She was willing to sing as well, but due to time restrictions she decided to lyp sync to songs recorded by Turner and Laurence Fishburne, who played Ike Turner, Tina's husband. Unlike Bassett, Fishburne sang for the role.", "prediction 1": "In the 1993 American biographical film What's Love Got to Do with It, Angela Bassett plays Tina Turner and Laurence Fishburne plays Ike Turner. It was based on the life of American-born singer Tina Turner and stars Bassett as Tina Turner and Fishburne as Ike Turner.", "prediction 2": "The film What's Love Got to Do with It was filmed in 1993 and stars Angela Bassett as Tina Turner and Laurence Fishburne as Ike Turner. Bassett also sings in the film, but instead of doing the singing, she lip syncs to soundtracks recorded by Tina Turner and Fishburne.", "prediction 3": "What's Love Got to Do with It is a 1993 American biographical film directed by Brian Gibson, based on the life of American-born singer Tina Turner. The film stars Angela Bassett as Tina Turner and Laurence Fishburne as Ike Turner. The soundtrack featured the hit song \"I Don't Wanna Fight\", which went to number one in seven countries.", "prediction 4": "What's Love Got To Do With It is a 1993 American biographical film directed by Brian Gibson, based on the life of American-born singer Tina Turner. It stars Angela Bassett as Tina Turner and Laurence Fishburne as Ike Turner. The film's soundtrack featured the hit song \"I Don't Wanna Fight\", which went to number one in seven countries. Bassett lip syncs to soundtracks recorded by Tina Turner and Fishburne.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "In the 1993 American biographical film What's Love Got to Do with It, Angela Bassett plays Tina Turner and Laurence Fishburne plays Ike Turner. ", "start": 205, "end": 266 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "In the 1993 American biographical film What's Love Got to Do with It, Angela Bassett plays Tina Turner and Laurence Fishburne plays Ike Turner. It was based on the life of American-born singer Tina Turner. Bassett, who had to learn to talk, dance and move like Turner, was willing to sing as well, but due to time restrictions she decided to lyp sync to songs recorded by Turner and Fishburne." }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "Who has scored the most goals in international soccer?", "passages": [ [ "Ali Daei", "Ali Daei\n\nAli Daei ( ; born 21 March 1969) is an Iranian former footballer and current coach and businessman.", "Daei currently manages Persian Gulf Pro League club Saipa and is the owner and CEO of Daei Sport.", "He was a captain of the Iran national football team, having played as a striker for clubs such as Bayern Munich and Hertha BSC, and is the world's all-time leading goalscorer in men's international matches.", "From June 2007 until 2013, Daei was a member of the FIFA Football Committee.", "In 2001, Daei was appointed as a UNICEF Goodwill Ambassador.", "Daei was born in Ardabil, Iran and is an Iranian Azerbaijani.", "Daei graduated from Sharif University of Technology in Materials Engineering (Metallurgical) with a B.Sc. degree.", "Born in Ardabil, he played for his hometown club, Esteghlal Ardabil, when he was 19.", "His next club was Taxirani F.C. in Tehran, where he played for one season, before joining another Tehran-based club, Bank Tejarat F.C..", "He stayed four years with Bank Tejarat, scoring 49 goals in 75 games for the club.", "Daei's fame is attributed mostly to his renowned goal scoring ability." ], [ "Cristiano Ronaldo", "Cristiano Ronaldo\n\nCristiano Ronaldo dos Santos Aveiro (; born 5 February 1985) is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team.", "Often considered the best player in the world and regarded by many as one of the greatest players of all time, Ronaldo has a record-tying five Ballon d'Or awards, the most for a European player, and is the first player to win four European Golden Shoes.", "He has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship.", "A prolific goalscorer, Ronaldo holds the records for most official goals scored in Europe's top-five leagues (405), the UEFA Champions League (121), the UEFA European Championship (9), as well as those for most assists in the UEFA Champions League (34) and the UEFA European Championship (6).", "He has scored over 680 senior career goals for club and country.", "Born and raised on the Portuguese island of Madeira, Ronaldo was diagnosed with a racing heart at age 15.", "He underwent an operation to treat his condition, and began his senior club career playing for Sporting CP, before signing with Manchester United at age 18 in 2003." ], [ "Christine Sinclair", "Christine Sinclair\n\nChristine Margaret Sinclair, OC (born June 12, 1983) is a Canadian soccer player and captain of the Canadian national team.", "She plays professionally for the Portland Thorns FC in the National Women's Soccer League (NWSL) and previously played for FC Gold Pride and Western New York Flash in the Women's Professional Soccer (WPS).", "A CONCACAF champion, two-time Olympic bronze medalist and 14-time winner of the Canada Soccer Player of the Year award, Sinclair is Canada's all-time leading scorer and currently second-best worldwide in all-time international goals scored (177), behind only Abby Wambach (184).", "Having played over 15 years with the senior national team, Sinclair has played in four FIFA Women's World Cups (USA 2003, China 2007, Germany 2011, Canada 2015) and three Olympic Football Tournaments (Beijing 2008, London 2012, Rio 2016).", "She has been shortlisted for FIFA World Player of the Year seven times, in 2005, 2006, 2007, 2008, 2010, 2012, and 2016.", "Sinclair has won championships with three different professional teams: the 2010 WPS Championship with FC Gold Pride, the 2011 WPS Championship with Western New York Flash, and the 2013 and 2017 NWSL Championships with Portland Thorns FC.", "She won the national collegiate Division I championship twice, in 2002 and 2005, with the University of Portland." ] ], "gold": "Ali Daei is an Iranian former professional footballer, football manager and businessman, known for his heading accuracy and ability in the air, he was the world's top international goalscorer with 109 goals, until his record was broken by Cristiano Ronaldo in 2021. Christine Sinclair is a Canadian professional soccer player and captain of the Canadian national team as well as Portland Thorns FC in the National Women's Soccer League. Sinclair is the world's all-time leader for international goals scored for men or women with 187 goals, and she is also the second footballer of either sex to score at five World Cup editions, preceded by Marta.", "prediction 1": "The player with the most goals scored in international soccer is Cristiano Ronaldo. The goal scorer with the most assists is Abby Wambach.", "prediction 2": "The player who has scored the most international goals is Cristiano Ronaldo, who has scored 724 goals in international soccer. The player who has scored the most international goals is a Canadian soccer player, Christine Sinclair, who has scored 177 goals in international soccer. The player who has scored the most goals in men's international matches is Ali Daei, who is the world's all-time leading goalscorer in men's international matches.", "prediction 3": "The player with the most international goals scored is Cristiano Ronaldo, with 405 goals in his career. Abby Wambach has scored the most goals in a career with 184.", "prediction 4": "The goal scorer with the most international goals in a career is Cristiano Ronaldo, with 680 for club and country. Among women's international soccer goals scored, Abby Wambach holds the record for most goals scored in a competition, while Canadian soccer player Christine Sinclair holds the record for most goals scored in a single match.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 109, "end": 121 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2, 3 ] } ], "corrected-prediction": "The player with the most goals scored in international soccer is Cristiano Ronaldo. Ali Daei is an Iranian former footballer and current coach and businessman. He is the world's all-time leading goalscorer in men's international matches. Christine Margaret Sinclair is a Canadian soccer player and captain of the Canadian national team. She plays professionally for the Portland Thorns FC in the National Women's Soccer League. Sinclair is Canada's all-time leading scorer and currently second-best worldwide in all-time international goals. The goal scorer with the most all-time international goals is Abby Wambach. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Oldest player on us women's soccer team?", "passages": [ [ "Christie Pearce", "Christie Pearce\n\nChristie Patricia Pearce (formerly Rampone; born June 24, 1975) is an American professional soccer defender.", "She is the former captain of the United States women's national soccer team.", "Pearce is a 3-time Olympic gold medalist, and also a 2-time FIFA Women's World Cup champion.", "Pearce has played in five FIFA Women's World Cup finals and four Olympics women's football tournaments.", "She is a 1999 and 2015 FIFA Women's World Cup champion, and a three-time gold medalist having won championship titles at the 2004 Athens Olympics, 2008 Beijing Olympics and 2012 London Olympics.", "She has finished no lower than third place in each of the World Cup or Olympic tournaments in which she has competed.", "Pearce played in the W-League from 1997 through 1998.", "She played in two American professional leagues the entire time they were in operation; from 2001 through 2003 in the WUSA and from 2009 through 2011 in the WPS.", "In 2009, while playing for Sky Blue FC, she simultaneously served as coach of the club while winning the 2009 Women's Professional Soccer Playoffs, and was named WPS Sportswoman of the Year.", "Pearce is the oldest player to appear in a FIFA Women's World Cup game, and the second-most capped player in U.S. and world history.", "Born in Fort Lauderdale, Florida, Christie Pearce grew up in Point Pleasant, New Jersey." ], [ "United States women's national soccer team", "Held annually in the Algarve region of Portugal since 1994, it is one of the most prestigious women's football events, alongside the Women's World Cup and Women's Olympic Football.", "Since 2016, the SheBelieves Cup has gained more interest from the very top ranked teams (USA, Germany, France and England) and thus shifted some attention from the tournament. .", "Active players are shown in Bold.", "The women's national team boasts the first six players in the history of the game to have earned 200 caps.", "These players have since been joined in the 200-cap club by several players from other national teams, as well as by five more Americans: Kate Markgraf, Abby Wambach, Heather O'Reilly, Carli Lloyd and Hope Solo.", "Kristine Lilly and Christie Rampone are the only players to earn more than 300 caps.", "In March 2004, Mia Hamm and Michelle Akers were the only two women and the only two Americans named to the FIFA 100, a list of the 125 greatest living soccer players chosen by Pel\u00e9 as part of FIFA's centenary observances." ] ], "gold": "Christie Pearce, American professional soccer defender and former captain of the United States women's national soccer team, is the oldest player to have competed at the FIFA World Cup for the US. More recently, Carli Lloyd was the oldest player of the team at the 2020 She Believes Cup.", "prediction 1": "Christie Patricia Pearce is an American professional soccer defender and the former captain of the United States women's national soccer team. Pearce is the oldest player to appear in a FIFA Women's World Cup game, and the second-most capped player in U.S. and world history. She is also the oldest player to have played in a Women's World Cup game in 1999.", "prediction 2": "The United States women's national soccer team boasts the first six players in the history of the game to have earned 200 caps. Kristine Lilly and Christie Rampone are the only players to earn more than 300 caps. Pearce, who is also the oldest player to appear in a FIFA Women's World Cup game, is the second-most capped player in U.S. and world history.", "prediction 3": "American professional soccer defender Christie Patricia Pearce, formerly Rampone, is the former captain of the United States women's national soccer team. Pearce is the oldest player to appear in a FIFA Women's World Cup game, and the second-most capped player in U.S. and world history. Kristine Lilly and Hope Solo are the only players to earn more than 300 caps.", "prediction 4": "The United States women's national soccer team boasts the first six players in the history of the game to have earned 200 caps. These players have since been joined in the 200-cap club by several players from other national teams, as well as by five more Americans: Kristine Lilly and Hope Solo. Pearce is the oldest player to appear in a FIFA Women's World Cup game, and the second-most capped player in U.S. and world history.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 275 }, { "error type": "Unverifiable", "explanation": "", "start": 276, "end": 357 } ], "missing-info": [], "corrected-prediction": "Christie Patricia Pearce is an American professional soccer defender and the former captain of the United States women's national soccer team. Pearce is the oldest player to appear in a FIFA Women's World Cup game." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where does the word christian come from in the bible?", "passages": [ [ "Christians", "The first recorded use of the term (or its cognates in other languages) is in the New Testament, in Acts 11:26, after Barnabas brought Saul (Paul) to Antioch where they taught the disciples for about a year, the text says: \"[...] the disciples were called Christians first in Antioch.\"", "The second mention of the term follows in Acts 26:28, where Herod Agrippa II replied to Paul the Apostle, \"Then Agrippa said unto Paul, Almost thou persuadest me to be a Christian.\"", "The third and final New Testament reference to the term is in 1 Peter 4:16, which exhorts believers: \"Yet if \"[any man suffer]\" as a Christian, let him not be ashamed; but let him glorify God on this behalf.\"", "Kenneth Samuel Wuest holds that all three original New Testament verses' usages reflect a derisive element in the term \"Christian\" to refer to followers of Christ who did not acknowledge the emperor of Rome.", "The city of Antioch, where someone gave them the name \"Christians\", had a reputation for coming up with such nicknames." ] ], "gold": "The word Christian was first mentioned in the New Testament in chapter and verse Acts 11:26. In the narrative where after Barnabas brought Saul (Paul) to Antioch where they taught the disciples. The quote that mentions the word Christian first is \"[...] the disciples were called Christians first in Antioch.\"", "prediction 1": "The word Christian comes from the Old Testament, where it is used to refer to followers of Christ who did not acknowledge the emperor of Rome. The first recorded use of the term (or its cognates in other languages) is in the New Testament, in Acts 11:26, after Barnabas brought Saul (Paul) to Antioch where they taught the disciples for about a year, the text says: \"[...] the disciples were called Christians first in Antioch.\" The second mention of the term follows in Acts 26:28, where Herod Agrippa replied to Paul the Apostle, \"Then Agrippa said unto Paul, Almost thou persuadest me to be a Christian.\"", "prediction 2": "The word \"Christian\" is found in the New Testament, specifically in Acts 11:26. Others that mention the word include Acts 26:28, Acts 26:29, and 1 Peter 4:16.", "prediction 3": "The word Christian is found in the New Testament, the Old Testament, and the New Testament's Revelation which all come from the same source: Hebrews. The word Christian translates to \"Christ like\" in the New Testament. This puts the term Christian in its entirety in the original Greek.", "prediction 4": "The word \"Christian\" is a term found in the bible. It is a personified name given to followers of Christ, who did not acknowledge the emperor of Rome.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 419, "end": 607 } ], "missing-info": [], "corrected-prediction": "The first recorded use of the term (or its cognates in other languages) is in the New Testament, in Acts 11:26, after Barnabas brought Saul (Paul) to Antioch where they taught the disciples for about a year, the text says: \"[...] the disciples were called Christians first in Antioch.\"" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was the last time pennsylvania voted republican?", "passages": [ [ "1796 United States presidential election in Pennsylvania", "1796 United States presidential election in Pennsylvania\n\nThe 1796 United States presidential election in Pennsylvania took place as part of the 1796 United States presidential election.", "Voters chose 15 representatives, or electors to the Electoral College, who voted for President and Vice President.", "Pennsylvania voted for the Democratic-Republican candidate, Thomas Jefferson, over the Federalist candidate, John Adams.", "Jefferson won Pennsylvania by a margin of 1.16%.", "Greene County's returns, which favored Jefferson, were not submitted in time to be included in the official vote totals.", "As a result, the two highest vote-getting Adams electors received more votes than the two lowest vote-getting Jefferson electors and the electoral vote was split, with 14 of 15 electors casting their ballots for Jefferson." ], [ "1984 United States presidential election in Pennsylvania", "1984 United States presidential election in Pennsylvania\n\nThe 1984 United States presidential election in Pennsylvania took place on November 6, 1984, and was part of the 1984 United States presidential election.", "Voters chose 25 representatives, or electors to the Electoral College, who voted for president and vice president.", "Pennsylvania voted for the Republican nominee, President Ronald Reagan, over the Democratic nominee, former Vice President Walter Mondale.", "Reagan won Pennsylvania by a margin of 7.35 percentage points.", "Reagan won the state by sweeping the small towns and rural areas of central Pennsylvania and performing well in the traditionally Republican suburbs of Philadelphia, but the race was kept within single digits by Mondale\u2019s strong showing in traditionally Democratic Western Pennsylvania, along with decisive double-digit wins in the cities of Pittsburgh and Philadelphia.", ", this is the last election in which Lackawanna County voted Republican.", "It is along with the two Dwight D. Eisenhower/Adlai Stevenson II elections of 1952 and 1956, one of only three elections since the Civil War in which Pennsylvania voted more Democratic than neighboring New York." ], [ "2016 United States presidential election in Pennsylvania", "2016 United States presidential election in Pennsylvania\n\nThe 2016 United States presidential election in Pennsylvania took place on November 8, 2016, as part of the 2016 general election in which all fifty states and the District of Columbia participated.", "Pennsylvania voters chose electors to represent them in the Electoral College via a popular vote.", "On April 26, 2016, in the presidential primaries, voters selected the Democratic, Republican, and Green parties' respective nominees for president.", "Pennsylvania is a closed primary state, meaning voters must have been previously registered with a particular political party in order to vote for one of that parties' candidates, to participate in their respective party primary.", "The Republican party candidate, who became their nominee following the primary was Donald Trump, who won Pennsylvania by 44,292 votes out of more than six million cast, a difference of 0.72% and the narrowest margin in a presidential election for the state in 176 years, since 1840 when William Henry Harrison defeated Martin Van Buren by just 0.12%.", "Prior to the election, Pennsylvania was expected to be close, but narrowly go to Clinton.", "On election day, Pennsylvania swung to Donald Trump, gaining almost 300,000 votes over Mitt Romney.", "Donald Trump carried 56 of the state's 67 counties, predominantly rural or semi-rural counties, while Clinton carried much of the Philadelphia metropolitan area as well as other cities including Pittsburgh, Harrisburg and Scranton." ] ], "gold": "United States Presidential elections in Pennsylvania occur when voters in the U.S. Commonwealth of Pennsylvania cast ballots for electors to the Electoral College as part of a national election to elect the President and Vice President of the United States. Pennsylvania has voted Republican in several Presidential elections, including on November 6, 1984, November 8, 1988 and November 8, 2016.", "prediction 1": "The last time Pennsylvania voted republican was on November 8, 2016, when President Trump became their nominee following the primary.", "prediction 2": "The last time Pennsylvania voted republican was during the 1796-84 election, which took place on November 6, 1984, and was part of the 1984 United States presidential election.", "prediction 3": "The last time Pennsylvania voted republican was in 1796, when Thomas Jefferson was the Democratic-Republican candidate and John Adams the Federalist candidate. The last time Pennsylvania voted republican was in 1984, when Ronald Reagan was the Republican nominee and Walter Mondale the Democratic nominee. The last time Pennsylvania voted republican was in 2016, when Donald Trump was the Republican nominee.", "prediction 4": "The last time Pennsylvania voted republican was in 1796, when Thomas Jefferson was the Democratic-Republican candidate and John Adams the Federalist candidate. The last time Pennsylvania voted republican was in 1984, when Ronald Reagan was the Republican nominee and former Vice President Walter Mondale the Democratic nominee. The last time Pennsylvania voted republican was in 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 133 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The last time Pennsylvania voted republican was on November 8, 2016. Pennsylvania also voted for the Republican nominee on November 6, 1984." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "When was the iphone 6 released in canada?", "passages": [ [ "IPhone 6S", "IPhone 6S\n\nThe iPhone 6S and iPhone 6S Plus (stylized and marketed as iPhone 6s and iPhone 6s Plus) are smartphones that were designed, developed, and marketed by", "Apple Inc.", "It is the ninth generation of the iPhone.", "They were announced on September 9, 2015 at the Bill Graham Civic Auditorium in San Francisco by Apple CEO Tim Cook, with pre-orders beginning September 12 and official release on September 25, 2015.", "The iPhone 6S and 6S Plus were succeeded by the iPhone 7 and iPhone 7 Plus on September 7, 2016 and were discontinued with the announcement of the iPhone XS, iPhone XS Max, and iPhone XR on September 12, 2018.", "The iPhone 6S has a similar design to the iPhone 6 but includes updated hardware, including a strengthened chassis and upgraded system-on-chip, a 12-megapixel camera, improved fingerprint recognition sensor, LTE Advanced support, and \"Hey Siri\" capabilities without needing to be plugged in.", "The iPhone 6S also introduces a new hardware feature known as \"3D Touch\", which enables pressure-sensitive touch inputs.", "The iPhone 6S had a mostly positive reception." ], [ "IPhone 6", "The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014; pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749.", "In China, where the iPhone 5c and 5s were the first models in the iPhone series to be released in the country on the same day as their international launch, Apple notified local wireless carriers that it would be unable to release the iPhone 6 and iPhone 6 Plus on the 19th because there were \"details which are not ready\"; local media reported that the devices had not yet been approved by the Ministry of Industry and Information Technology, and earlier in the year, a news report by state broadcaster China Central Television alleged that iPhone devices were a threat to national security because iOS 7's \"frequent locations\" function could expose \"state secrets.\"", "In August 2015, Apple admitted that some iPhone 6 Plus models may have faulty cameras that could be causing photos to look blurry and initiated a replacement program.", "On September 9, 2015, with the release of the iPhone 6S and iPhone 6S Plus, the iPhone 6 and 6 Plus were moved to the mid-range of the iPhone lineup." ] ], "gold": "The iPhone 6 was first released in Canada on September 19th, 2014. A little over a year later on September 25, 2015 the iPhone 6S was released. ", "prediction 1": "The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014.", "prediction 2": "The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014; pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749. In Canada, where the iPhone 5c and 5s were the first models in the Apple iPhone series to be released in the country on the same day as their international launch, Apple notified local wireless carriers that it would be unable to release the iPhone 6 and iPhone 6 Plus on September 19, 2014, and released on September 19, 2014; pre-orders began on September 12, 2014, with the iPhone 6 starting at US$749 and the iPhone 6 Plus starting at US$749 and the iPhone 6 starting at US$899.", "prediction 3": "The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014. Pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749, and Apple notified local wireless carriers that it would be unable to release the iPhone 6 and iPhone 6 Plus on the 19th because there were \"details which are not ready\".", "prediction 4": "The first model in the iPhone series to be released in Canada on the same day as their international launch was the iPhone 6. The iPhone 6 and iPhone 6 Plus were officially unveiled during a press event at the Flint Center for Performing Arts in Cupertino, California on September 9, 2014 and released on September 19, 2014; pre-orders began on September 12, 2014, with the iPhone 6 starting at US$649 and the iPhone 6 Plus starting at US$749 respectively.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 166 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The iPhone 6 and iPhone 6 Plus were officially released on September 19, 2014. The IPhone 6S official release was on September 25, 2015." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where did pluvial lakes form during the last ice age?", "passages": [ [ "Pluvial lake", "Pluvial lake\n\nA pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation.", "These intervals of greater moisture availability are not always contemporaneous with glacial periods.", "Pluvial lakes are typically closed lakes that occupied endorheic basins.", "Pluvial lakes that have since evaporated and dried out may also be referred to as \"paleolakes\".", "The word comes from the Latin \"pluvia\", which means \"rain\".", "Pluvial lakes represent changes in the hydrological cycle: wet cycles generate large lakes, and dry cycles cause the lakes to dry up leaving large flat plains.", "Accumulated sediments show the variation in water level.", "During glacial periods, when the lake level is fairly high, mud sediments will settle out and be deposited.", "At times in between glaciers (interglacial), salt deposits may be present because of the arid climate and the evaporation of lakewater.", "Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene.", "One of these was Lake Bonneville in western Utah, which covered roughly .", "When Lake Bonneville was at its maximum water level, it was higher than the Great Salt Lake." ], [ "Pluvial lake", "Fresh water mollusks have been found in mud deposits from Searles Lake in California and suggest that the water temperature was about 7 degrees Fahrenheit (or 4 degrees Celsius) cooler than current temperatures.", "Radiocarbon dating of the youngest mud beds yield dates from 24,000 to 12,000 years ago.", "When warm air from arid regions meets chilled air from glaciers, cloudy, cool, rainy weather is created beyond the terminus of the glacier.", "That humid climate was present during the last glacial period in North America and caused more precipitation than evaporation.", "The increase in rainfall fills the drainage basin and forms a lake.", "During interglacial periods, the climate becomes arid once more and causes the lakes to evaporate and dry up." ] ], "gold": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. Several pluvial lakes formed in what is now the southwestern United States, specifically in Utah and California, during the last Ice Age. One of these was Lake Bonneville in western Utah, which covered roughly 19,000 square miles and when it reached maximum water level, it was 1,000 feet higher than the Great Salt Lake. Fresh water mollusks have also been found in mud deposits from Searles Lake in California and suggest that the water temperature was about 7 degrees Fahrenheit cooler than current temperatures and radiocarbon dating of the youngest mud beds yield dates from 24,000 to 12,000 years ago.", "prediction 1": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. These intervals of greater moisture availability are not always contemporaneous with glacial periods. Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene. One of these was Lake Bonneville in western Utah, which covered roughly.", "prediction 2": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. These intervals of greater moisture availability are not always contemporaneous with glacial periods. Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene. One of these was Lake Bonneville in western Utah. The other lakes were Lake St. George in Illinois and Lake Ontario in Ontario, Canada.", "prediction 3": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. Pluvial lakes that have since evaporated and dried out may also be referred to as \"paleolakes\". Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene.", "prediction 4": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. These intervals of greater moisture availability are not always contemporaneous with glacial periods. Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene. For example, one of these was Lake Bonneville in western Utah, which covered roughly.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 266 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "A pluvial lake is a body of water that accumulated in a basin because of a greater moisture availability resulting from changes in temperature and/or precipitation. Several pluvial lakes formed in what is now the southwestern United States during the glaciation of the late Pleistocene. One of these was Lake Bonneville in western Utah, which covered roughly. Fresh water mollusks have been found in mud deposits from Searles Lake in California and suggest that the water temperature was about 7 degrees Fahrenheit (or 4 degrees Celsius) cooler than current temperatures. Radiocarbon dating of the youngest mud beds yield dates from 24,000 to 12,000 years ago." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "When was the first video game released to the public?", "passages": [ [ "History of video games", "The first games known to incorporate a monitor were two research projects completed in 1952, a checkers program by Christopher Strachey on the Ferranti Mark 1 and a tic-tac-toe program called \"OXO\" by Alexander Douglas on the EDSAC.", "Both of these programs used a relatively static display to track the current state of the game board.", "The first known game incorporating graphics that updated in real time was a billiards game programmed by William Brown and Ted Lewis specifically for a demonstration of the MIDSAC computer at the University of Michigan in 1954.", "Perhaps the first game created solely for entertainment rather than to demonstrate the power of some technology, train personnel, or aid in research was \"Tennis for Two\", designed by William Higinbotham and built by Robert Dvorak at the Brookhaven National Laboratory in 1958.", "Designed to entertain the general public at Brookhaven's annual series of open houses, the game was deployed on an analog computer with graphics displayed on an oscilloscope and was dismantled in 1959.", "Higinbotham never considered adapting the successful game into a commercial product, which would have been impractical with the technology of the time.", "Ultimately, the widespread adoption of computers to play games would have to wait for the machines to spread from serious academics to their students on U.S. college campuses." ], [ "Magnavox Odyssey", "Magnavox Odyssey\n\nThe Magnavox Odyssey is the first commercial home video game console.", "It was developed by a small team led by Ralph H. Baer at Sanders Associates and released by Magnavox in the United States in September 1972 and overseas the following year.", "The Odyssey consists of a white, black, and brown box which connects to a television set, and two rectangular controllers attached by wires.", "It is capable of displaying three square dots on the screen in monochrome black and white, with differing behavior for the dots depending on the game played, and with no sound capabilities.", "Players place plastic overlays on the screen to create visuals, and the one or two players for each game control their dots with the three knobs and one button on the controller in accordance with the rules given for the game.", "The Odyssey console came packaged with dice, paper money, and other board game paraphernalia to go along with the games, and a peripheral controller\u2014the first video game light gun\u2014was sold separately.", "The idea for a video game console was thought up by Baer in August 1966, and over the next three years he, along with Bill Harrison and Bill Rusch, created seven successive prototype consoles.", "The seventh, known as the Brown Box, was shown to several manufacturers before Magnavox agreed to produce it in January 1971." ] ], "gold": "The first video game, \"Tennis for Two\" designed by William Higinbotham and built by Robert Dvorak, was designed for public entertainment in 1958 at the Brookhaven's annual series of open houses. Higinbotham never considered adapting the successful game into a commercial product, which would have been impractical with the technology of the time. The Magnavox Odyssey was the first commercial home video game console, which released in the United States in September 1972, and overseas the following year. ", "prediction 1": "The first commercial home video game was released to the public on September 7, 1972 by Magnavox. The Magnavox Odyssey was developed by a small team led by Ralph H. Baer at Sanders Associates and released by Magnavox in the United States on September 7, 1972 and internationally the following year.", "prediction 2": "The first video game released to the public was a billiards game programmed by William Brown and Ted Lewis specifically for a demonstration of the MIDSAC computer at the University of Michigan in 1952. The first game developed solely for entertainment rather than to demonstrate the power of some technology, train personnel, or aid in research was Tennis for Two, designed by William Higinbotham and built by Robert Dvorak at the Brookhaven National Laboratory in 1958. The first commercial home video game console was the Magnavox Odyssey, which was released by Magnavox in the United States in September 1972 and overseas the following year.", "prediction 3": "The first video game released to the public in the United States was released in September 1972.", "prediction 4": "The first video game released to the public was tennis game \"Tennis For Two\" designed by William Higinbotham and built by Robert Dvorak at the Brookhaven National Laboratory in 1958. The first commercial home video game console was released by Magnavox in the United States in September 1972 and overseas the following year. The idea for a video game console was thought up by Baer in August 1966, and over the next three years he, along with Bill Harrison and Bill Rusch, created seven successive prototypes. The Magnavox Odyssey was developed by a small team led by Ralph H. Baer at Sanders Associates and released by Magnavox in the United States in the United States in September 1972 and overseas the following year. The first home video game console was released by Magnavox in the United States in September 1972 and overseas the following year.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 77, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 191 }, { "error type": "Redundant", "explanation": "The first commercial home video game was released to the public on September 7, 1972 by Magnavox. ", "start": 196, "end": 258 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The first commercial home video game was released to the public, in the United States, in September 1972 by Magnavox. It was released internationally the following year. The first game was \"Tennis for Two\", designed by William Higinbotham and built by Robert Dvorak. It was designed to entertain the general public at Brookhaven's annual series of open houses. Higinbotham never considered adapting the successful game into a commercial product, which would have been impractical with the technology of the time." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When does the new mlb the show come out?", "passages": [ [ "MLB: The Show", "MLB: The Show\n\nMLB:", "The Show is a Major League Baseball video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios.", "The series debuted in 2006 with \"\" for the PlayStation 2 and PlayStation Portable.", "There has been a new release in the series every year since 2006, and since \"\" in 2007, every game released has also been available for the PlayStation 3, until the release of MLB 17: The Show.", "\"\", which was released in March 2012, is also the first game in the series to not be available for the PS2 or PSP and the first game in the series to be made available for the PlayStation Vita, Sony's new handheld.", "The series is the successor to 989 Studios' MLB series.", "\"MLB The Show 17\" is the first game in the series to be exclusive to the Playstation 4 line, meaning the PS4 and PS4 Pro.", "Gameplay simulates a typical game of baseball, with the player controlling an entire team or a select player.", "The player may take control of one of 30 Major League Baseball teams in any game mode (excluding Road to the Show) and use that team in gameplay.", "The Series has variable game modes in which a player takes control of a team for a single game, one season, or a franchise (multiple seasons)." ], [ "MLB The Show 16", "MLB The Show 16\n\nMLB The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment.", "It is the eleventh entry of the \"\" franchise, and was released on March 29, 2016, for PlayStation 3 and PlayStation 4.", "It is the first \"MLB: The Show\" entry to not have a portable version, and is the final version available for PlayStation 3.", "Toronto Blue Jays third baseman and 2015 American League MVP Josh Donaldson is the main cover athlete for the game.", "He also appears on the separate Canadian cover edition, making him the first player to be on both the American and Canadian versions of the game.", "Jung-ho Kang of the Pittsburgh Pirates and Wei-Yin Chen of the Miami Marlins appear on the Korean and Taiwanese covers, respectively.", "The game features more game modes, such as Road To The Show and an all-new franchise mode.", "In addition, Conquest Mode and Battle Royale have been added into the game.", "Conquest Mode takes your Diamond Dynasty team against all 30 MLB teams and their strongholds in order to capture new territories and eventually all of North America.", "Each territory is inhabited by fans of your team or one of the 30 MLB teams.", "In order to capture one of the territories, you must attack the territory by either playing a minimum three-inning game against that team or simulate to avoid playing the game." ], [ "MLB 14: The Show", "MLB 14: The Show\n\nMLB 14:", "The Show is a baseball video game developed and published by Sony Computer Entertainment, based on Major League Baseball (MLB).", "It is the ninth entry of the \"\" franchise.", "Announced on November 4, 2013, the game was released on April 1, 2014 for the PlayStation 3 and PlayStation Vita.", "The PlayStation 4 version was released on May 6, 2014.", "Detroit Tigers first baseman Miguel Cabrera is the featured athlete on the cover.", "As with the previous two entries, Canada has a unique cover, with Toronto Blue Jays third baseman Brett Lawrie on the cover.", "Matt Vasgersian, Eric Karros, and Steve Lyons did the play-by-play action.", "Mike Carlucci returned as P.A. Announcer.", "In March 2015, Sony announced the multiplayer support of the game would be shut down on June 18, 2015.", "Matt Beaudette of Hardcore Gamer gave the game a 4/5, calling it \"excellent\", going onto say that \"it seems quite apparent most of the work on this year\u2019s game went into getting it up and running on the PS4 with shiny new graphics.\"" ] ], "gold": "MLB The Show 21 is a baseball video game by San Diego Studio and published by Sony Interactive Entertainment that was released for the PlayStation 4 and PlayStation 5, as well as the Xbox One and Xbox Series X/S, on April 20, 2021. MLB The Show 17 was the twelfth edition of the MLB: The Show franchise, and was released on March 28, 2017, for PlayStation 4. MLB The Show 16 was the eleventh entry of the MLB: The Show franchise, and was released on March 29, 2016, for PlayStation 3 and PlayStation 4. MLB 15: The Show was the tenth entry of the MLB: The Show franchise, and was released on March 31, 2015, for PlayStation 3, PlayStation 4 and PlayStation Vita.", "prediction 1": "MLB The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment, based on Major League Baseball. It was announced on November 4, 2013, and released on April 1, 2014. MLB The Show 16: Season 3 came out on April 4, 2016.", "prediction 2": "MLB The Show is a video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios. The series has been released every year since 2006, and since the release of MLB 17: The Show on March 29, 2016, for PlayStation 3 and PlayStation 4. MLB The Show 16 is a baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. MLB 14: The Show is a baseball video game developed and published by Sony Computer Entertainment, based on Major League Baseball. The game was released on April 1, 2014 for the PlayStation 3 and PlayStation Vita. The PlayStation 4 version was released on May 6, 2014.", "prediction 3": "MLB The Show is a video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios. MLB The Show 17 was released on March 29, 2016, for PlayStation 3 and PlayStation 4. MLB The Show 16 was a baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. MLB 14: The Show was a baseball video game developed and published by Sony Computer Entertainment, based on Major League Baseball. It was announced on November 4, 2013, the game was released on April 1, 2014 for the PlayStation 3 and PlayStation 4 version was released on May 6, 2014.", "prediction 4": "MLB: The Show is a video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios. MLB: The Show 11: The Show is a baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. MLB 14: The Show is a baseball video game developed and published by Sony Computer Entertainment based on Major League Baseball. It is the ninth entry of the MLB franchise. Announced on November 4, 2013, the game was released on April 1, 2014 for the PlayStation 3 and PlayStation Vita. The PlayStation 4 version was released on May 6, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 197 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 198, "end": 228 }, { "error type": "Redundant", "explanation": "MLB The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment, based on Major League Baseball. It was announced on November 4, 2013, and released on April 1, 2014. ", "start": 229, "end": 281 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "There has been a new release in the MLB: The Show series every year since 2006. MLB The Show 16 is the eleventh entry of the Major League Baseball video game series, developed by Sony San Diego and published by Sony Computer Entertainment, released on March 29, 2016, for PlayStation 3 and PlayStation 4. MLB 14: The Show was released on April 1, 2014. The PlayStation 4 version was released on May 6, 2014." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who killed the governor on the walking dead?", "passages": [ [ "The Walking Dead (franchise)", "The Walking Dead (franchise)\n\n", "The Walking Dead is a media franchise created by Robert Kirkman and Tony Moore including a comic book series, two television series, six novels, video games, and various other media such as audio books and sound tracks.", "\"The Walking Dead\" is a monthly black-and-white comic book series chronicling the travels of Rick Grimes, his family, and other survivors of a zombie apocalypse.", "First issued in 2003 by publisher Image Comics, the series was created by writer Robert Kirkman and artist Tony Moore (who was later replaced by Charlie Adlard from issue #7 onward, though Moore continued to do the covers through issue #24.)", "\"The Walking Dead\" received the 2010 Eisner Award for Best Continuing Series at San Diego Comic-Con International.", "\"The Walking Dead\" is an American television drama series developed by Frank Darabont.", "The series stars Andrew Lincoln as sheriff's deputy Rick Grimes, who awakens from a coma to find the world dominated by flesh-eating \"walkers\", resembling the zombies of George A. Romero's horror films.", "He sets out to find his family and encounters other survivors along the way.", "\"The Walking Dead\" premiered on October 31, 2010 on the cable television channel AMC in the United States." ], [ "The Walking Dead (TV series)", "The Walking Dead (TV series)\n\n", "The Walking Dead is an American post-apocalyptic horror television series developed by Frank Darabont for AMC that is based on the comic book series by Robert Kirkman, Tony Moore, and Charlie Adlard.", "Andrew Lincoln plays the show's lead character, sheriff's deputy Rick Grimes, who awakens from a coma to discover a world overrun by man-eating zombies, commonly referred to as \"walkers\".", "Grimes reunites with his family and becomes the leader of a group of other survivors.", "Together, they struggle to adapt to a post-apocalyptic world filled with walkers and with other groups of survivors, the living often more dangerous than the dead.", "Much of the series takes place in and around Atlanta, Georgia, and later Alexandria, Virginia.", "The series premiered in the United States on October 31, 2010.", "It is exclusively shown on cable television channel AMC in the U.S. and internationally on Fox International Channels.", "Beginning with its third season, \"The Walking Dead\" has attracted the most 18 to 49-year-old viewers of any cable or broadcast television series.", "The series was renewed for a ninth season, which debuted on October 7, 2018.", "An AMC spin-off series, \"Fear the Walking Dead\", debuted on August 23, 2015." ], [ "The Walking Dead: The Fall of the Governor", "When her relationship with Austin becomes more serious Lilly discovers she is pregnant and Austin is the father.", "One day an arena fighter named Harold Abernathy is killed by a vengeful opponent named Eugene Cooney.", "Because the Governor has a show planned later that day he forces Michonne to fight Eugene in the arena.", "During the fight Michonne decapitates Eugene using her katana, which upsets the audience.", "The Governor discovers that Rick, Glenn and Michonne live in a prison and he wants to find out where the prison is.", "He enlists Martinez to gain Rick's trust and help them escape, so he can find the prison.", "Martinez succeeds to convince Rick that they are on the same side.", "He helps him escape and frees Glenn and Michonne.", "When they flee Dr. Stevens and his assistant Alice join them.", "Outside Woodbury Stevens is bitten and killed by a zombie.", "Meanwhile, Michonne goes back to The Governor's apartment for revenge.", "She knocks him out and ties him up.", "She proceeds to torture him by mutilating his penis, cutting off his right arm and removing his left eye using a spoon.", "Then she leaves him for dead and escapes." ] ], "gold": "The Walking Dead is an American post-apocalyptic comic book series created by writer Robert Kirkman and artist Tony Moore and later adapted into a television series that premiered on October 31, 2010. During both The Walking Dead #27 and season 3 of the TV show, the character of The Governor would be introduced. He becomes a central antagonist in both the comic and the show and is later killed by Lilly Chambler.", "prediction 1": "The Walking Dead is a post-apocalyptic horror television series developed by Frank Darabont for AMC. The Walking Dead is a comic book series chronicling the travels of Rick Grimes, his family, and other survivors of a zombie apocalypse. One day an arena fighter named Harold Abernathy is killed by a vengeful opponent named Eugene Cooney. Because the Governor has a show planned later that day he forces Michonne to fight Eugene Cooney. Because the Governor has a show planned later that day he forces Michonne to fight Eugene Cooney.", "prediction 2": "The Walking Dead is an American post-apocalyptic horror television series developed by Frank Darabont that is based on the comic book series The Walking Dead. In Season 4, episode 2 of the series, The Fall of the Governor, Rick Grimes is killed by Michonne Martinez.", "prediction 3": "The Walking Dead is an American post-apocalyptic horror television series developed by Frank Darabont for AMC that is based on the comic book series by Robert Kirkman, Tony Moore, and Charlie Adlard. The Walking Dead: The Fall of the Governor is a 2010 American television drama series developed by Frank Darabont for AMC. In the first episode of Season 7, the show's lead character Rick Grimes is killed by Michonne, a bounty hunter. In Season 8, the governor is killed by Michonne, who is killed Rick Grimes by a fighter named Harold Abernathy, and is killed by a vengeful opponent named Eugene Cooney.", "prediction 4": "The Walking Dead is an American post-apocalyptic horror television series developed by Frank Darabont for AMC that is based on the comic book series and is titled The Fall of the Governor. On the Walking Dead Harold Abernathy is killed by a vengeful opponent named Eugene Cooney. Because the Governor has a show planned later that day he forces Michonne to fight Eugene in the arena. During the fight Michonne decapitates Eugene using her katana, which upsets the audience.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 100 }, { "error type": "Irrelevant", "explanation": "", "start": 141, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 338 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 436 }, { "error type": "Redundant", "explanation": "The Walking Dead is a post-apocalyptic horror television series developed by Frank Darabont for AMC. The Walking Dead is a comic book series chronicling the travels of Rick Grimes, his family, and other survivors of a zombie apocalypse. One day an arena fighter named Harold Abernathy is killed by a vengeful opponent named Eugene Cooney. Because the Governor has a show planned later that day he forces Michonne to fight Eugene Cooney. ", "start": 437, "end": 534 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Walking Dead is a post-apocalyptic horror television series adapted from The Walking Dead comic book series created by Robert Kirkman and Tony Moore. The series premiered in the United States on October 31, 2010. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who is the 1st governor general of india?", "passages": [ [ "Governor-General of India", "After 1947, the Sovereign continued to appoint the Governor-General, but thereafter did so on the advice of the newly-sovereign Indian Government.", "Governors-General served at the pleasure of the Sovereign, though the practice was to have them serve five-year terms.", "Governors-General could have their commission rescinded; and if one was removed, or left, a provisional Governor-General was sometimes appointed until a new holder of the office could be chosen.", "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten.", "Many parts of the Indian subcontinent were governed by the East India Company, which nominally acted as the agent of the Mughal Emperor.", "In 1773, motivated by corruption in the Company, the British government assumed partial control over the governance of India with the passage of the Regulating Act of 1773.", "A Governor-General and Supreme Council of Bengal were appointed to rule over the Presidency of Fort William in Bengal.", "The first Governor-General and Council were named in the Act.", "The Charter Act 1833 replaced the Governor-General and Council of Fort William with the Governor-General and Council of India.", "The power to elect the Governor-General was retained by the Court of Directors, but the choice became subject to the Sovereign's approval." ], [ "Governor-General of India", "Governor-General of India\n\nThe Governor-General of India (or, from 1858 to 1947, officially the Viceroy and Governor-General of India, commonly shortened to Viceroy of India) was originally the head of the British administration in India and, later, after Indian independence in 1947, the representative of the Indian head of state.", "The office was created in 1773, with the title of \"Governor-General of the Presidency of Fort William\".", "The officer had direct control only over Fort William, but supervised other East India Company officials in India.", "Complete authority over all of British India was granted in 1833, and the official came to be known as the \"Governor-General of India\".", "In 1858, as a consequence of the Indian Mutiny the previous year, the territories and assets of the East India Company came under the direct control of the British Crown; as a consequence the Company Raj was succeeded by the British Raj.", "The Governor-General (now also the Viceroy) headed the central government of India, which administered the provinces of British India, including the Punjab, Bengal, Bombay, Madras, the United Provinces, and others." ], [ "Governor-General of India", "However, much of India was not ruled directly by the British Government; outside the provinces of British India, there were hundreds of nominally independent princely states or \"native states\", whose relationship was not with the British Government or the United Kingdom, but rather one of homage directly with the British Monarch as sovereign successor to the Mughal Emperors.", "From 1858, to reflect the Governor-General's new additional role as the Monarch's representative in re the fealty relationships vis the princely states, the additional title of Viceroy was granted, such that the new office was entitled \"Viceroy and Governor-General of India\".", "This was usually shortened to \"Viceroy of India\".", "The title of Viceroy was abandoned when British India split into the two independent dominions of India and Pakistan, but the office of Governor-General continued to exist in each country separately\u2014until they adopted republican constitutions in 1950 and 1956, respectively.", "Until 1858, the Governor-General was selected by the Court of Directors of the East India Company, to whom he was responsible.", "Thereafter, he was appointed by the Sovereign on the advice of the British Government; the Secretary of State for India, a member of the UK Cabinet, was responsible for instructing him or her on the exercise of their powers." ] ], "gold": "The governor-general of India was the representative of the British Government on India and, after Indian independence in 1947, the representative of the Indian head of state. The first governor-general in the country was Warren Hastings, who was the governor-general of Bengal. Alternatively, after British India was partitioned into two dominions, the first governor-general of the Dominion of India was Lord Mountbatten.", "prediction 1": "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten. The first Governor-General of British India was William Bentinck. The first Governor-General of independent India was Louis, Lord Mountbatten.", "prediction 2": "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten.", "prediction 3": "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten. The office was created in 1773, with the title of \"Governor-General of the Presidency of Fort William\". In 1858, as a consequence of the Indian Mutiny the previous year, the territories and assets of the East India Company came under the direct control of the British Crown.", "prediction 4": "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten. The first Governor-General of independent India was Louis, Lord Mountbatten. The first Governor-General of British India, who was elected in 1778, was Sir George Westmacott. The first Governor-General of independent India was Louis, Lord Mountbatten. The first Governor-General of British India was Sir George Westmacott.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten. ", "start": 152, "end": 294 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Governor-General of India was originally the head of the British administration in India and, later, after Indian independence in 1947, the representative of the Indian head of state. The first Governor-General of British India was Lord William Bentinck, and the first Governor-General of independent India was Louis, Lord Mountbatten. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "One organism benefits at the expense of another?", "passages": [ [ "Cheating (biology)", "Cheating (biology)\n\nCheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms.", "Cheating is common in many mutualistic and altruistic relationships.", "A cheater is an individual who does not cooperate (or cooperates less than their fair share) but can potentially gain the benefit from others cooperating.", "Cheaters are also those who selfishly use common resources to maximize their individual fitness at the expense of a group.", "Natural selection favors cheating, but there are mechanisms to regulate it.", "Organisms communicate and cooperate to perform a wide range of behaviors.", "Mutualism, or mutually beneficial interactions between species, is common in ecological systems.", "These interactions can be thought of \"biological markets\" in which species offer partners goods that are relatively inexpensive for them to produce and receive goods that are more expensive or even impossible for them to produce.", "However, these systems provide opportunities for exploitation by individuals that can obtain resources while providing nothing in return.", "Exploiters can take on several forms: individuals outside a mutualistic relationship who obtain a commodity in a way that confers no benefit to either mutualist, individuals who receive benefits from a partner but have lost the ability to give any in return, or individuals who have the option of behaving mutualistically towards their partners but chose not to do so." ], [ "Parasitism", "Parasitism\n\nIn evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life.", "The entomologist E. O. Wilson has characterised parasites as \"predators that eat prey in units of less than one\".", "Parasites include protozoans such as the agents of malaria, sleeping sickness, and amoebic dysentery; animals such as hookworms, lice, mosquitoes, and vampire bats; fungi such as honey fungus and the agents of ringworm; and plants such as mistletoe, dodder, and the broomrapes.", "There are six major parasitic strategies of exploitation of animal hosts, namely parasitic castration, directly transmitted parasitism (by contact), trophically transmitted parasitism (by being eaten), vector-transmitted parasitism, parasitoidism, and micropredation.", "Like predation, parasitism is a type of consumer-resource interaction, but unlike predators, parasites, with the exception of parasitoids, are typically much smaller than their hosts, do not kill them, and often live in or on their hosts for an extended period.", "Parasites of animals are highly specialised, and reproduce at a faster rate than their hosts." ], [ "Biological interaction", "One or both species involved in the interaction may be obligate, meaning they cannot survive in the short or long term without the other species.", "Though mutualism has historically received less attention than other interactions such as predation, it is an important subject in ecology.", "Examples include cleaning symbiosis, gut flora, M\u00fcllerian mimicry, and nitrogen fixation by bacteria in the root nodules of legumes.", "Commensalism benefits one organism and the other organism is neither benefited nor harmed.", "It occurs when one organism takes benefits by interacting with another organism by which the host organism is not affected.", "A good example is a remora living with a shark.", "Remoras eat leftover food from the shark.", "The shark is not affected in the process, as remoras eat only leftover food of the shark, which does not deplete the shark's resources.", "Parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life.", "The parasite either feeds on the host, or, in the case of intestinal parasites, consumes some of its food.", "Neutralism (a term introduced by Eugene Odum) describes the relationship between two species that interact but do not affect each other." ] ], "gold": "In ethology, cheating is a term used to describe behavior whereby organisms receive a benefit at the cost of other organisms, a concept that natural selection favors, but there are mechanisms to regulate it. Cheating is common in many mutualistic and altruistic relationships, where a cheater is an individual who does not cooperate, or cooperates less than their fair share, but can potentially gain the benefit from others cooperating. Cheaters are also those who selfishly use common resources to maximize their individual fitness at the expense of a group. In evolutionary biology, parasitism is a close relationship between species, where one organism, the parasite, lives on or inside another organism, the host, causing it some harm, and is adapted structurally to this way of life.", "prediction 1": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. Cheating is common in many mutualistic and altruistic relationships. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. It occurs when one organism takes benefits by interacting with another organism by which the host organism is neither benefited nor harmed. Commensalism benefits one organism while the other organism is neither benefited nor harmed.", "prediction 2": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. Cheating is common in many mutualistic and altruistic relationships. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. Commensalism benefits one organism and the other organism is neither benefited nor harmed. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. It occurs when one organism takes benefits by interacting with another organism by which the host organism is neither benefited nor harmed.", "prediction 3": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. Cheating is common in many mutualistic and altruistic relationships. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. Commensalism benefits one organism and the other organism is neither benefited nor harmed. It occurs when one organism takes benefits by interacting with another organism by which the host organism is not harmed.", "prediction 4": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. It occurs when one organism takes benefits by interacting with another organism by which the host organism is neither benefited nor harmed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 436, "end": 575 }, { "error type": "Redundant", "explanation": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. Cheating is common in many mutualistic and altruistic relationships. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. It occurs when one organism takes benefits by interacting with another organism by which the host organism is neither benefited nor harmed. ", "start": 576, "end": 668 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Cheating is a term used in behavioral ecology and ethology to describe behavior whereby organisms receive a benefit at the cost of other organisms. Cheating is common in many mutualistic and altruistic relationships. A cheater is an individual who does not cooperate (or cooperates less than their fair share) but can potentially gain the benefit from others cooperating. Cheaters are also those who selfishly use common resources to maximize their individual fitness at the expense of a group. Natural selection favors cheating, but there are mechanisms to regulate it. In evolutionary biology, parasitism is a relationship between species, where one organism, the parasite, lives on or in another organism, the host, causing it some harm, and is adapted structurally to this way of life. Predation is a type of consumer-resource interaction where predators are typically much larger than their hosts, and kill them." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When was the last time lsu was in the college world series?", "passages": [ [ "LSU Tigers softball", "LSU Tigers softball\n\nThe LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball.", "The team participates in the Southeastern Conference (SEC), and plays home games in Tiger Park.", "LSU has won five SEC regular season championships, five SEC tournament championships and has been to the Women's College World Series six times.", "The team is currently coached by Beth Torina.", "LSU softball had its beginnings in 1979 with a team coached by Carol Smith.", "However, after only three seasons, LSU decided to disband its softball program.", "In 1997 the Southeastern Conference decided to begin sponsoring softball, partly to help member institutions to comply with Title IX.", "LSU softball was reborn and quickly became one of the best teams not only in the conference, but in the nation.", "Since 1997, LSU has won 9 Western Division titles, 5 regular season SEC championships and 5 SEC tournament championships which is more than any other school in the conference.", "LSU has also appeared in 6 Women's College World Series and 19 NCAA tournaments.", "On June 9, 2011, the University announced long-time Alabama head coach Patrick Murphy as the new skipper of the LSU softball program.", "However, three days later, Murphy announced that he had changed his mind and would remain at Alabama." ], [ "LSU Tigers softball", "Beth Torina, coach at Florida International University (FIU), was hired a short time later and has since led the program to four Women's College World Series appearances in her first six years at the helm.", "The program earned its 1,000th victory on May 1, 2016 after defeating the Arkansas Razorbacks 9-1 in Fayetteville, Arkansas.", "The Tigers have posted an impressive 11 seasons of at least 50 wins.", "The team has finished 3rd at the Women's College World series four times (2001, 2004, 2015, 2016) and 5th two times (2012, 2017).", "LSU and UCLA are the only two teams to qualify for three consecutive WCWS berths from 2015-2017.", "LSU moved into the New Tiger Park during the spring of 2009.", "Since that date, LSU holds a 240-63-1 record at home (.793 winning percentage).", "The Tigers home crowds have grown steadily at Tiger Park from 2012-present, during which the Tigers have posted a 169-44 record (.795).", "At least 1,000 fans have attended every home game during the 2014, 2015, 2016 and 2017 seasons.", "Additionally, since 2012, the program has surpassed 1,500 fans 95 times, 2000+ fans 34 times and 3,000+ fans 3 times.", "September 2017." ], [ "LSU Tigers baseball", "LSU Tigers baseball\n\nThe LSU Tigers baseball team represents Louisiana State University in NCAA Division I college baseball.", "The team participates in the West Division of the Southeastern Conference.", "It is one of the elite college baseball programs in the nation, ranking seventh all-time with 18 College World Series appearances and second all-time with six national championships (1991, 1993, 1996, 1997, 2000, and 2009).", "The Tigers play home games on LSU's campus at Alex Box Stadium, Skip Bertman Field, and they are currently coached by Paul Mainieri.", "During the program's first thirty seasons, LSU had a total of 15 head coaches.", "No coach's tenure lasted longer than two seasons, with the exception of C. C. Stroud, who was head coach for eight seasons.", "Stroud coached LSU from 1914\u20131921 and had an overall record of 73\u201358\u20135 (.595).", "The program won at least ten games during four of his eight seasons as head coach.", "In 1927, Harry Rabenhorst became head baseball coach and became the longest tenured head baseball coach in LSU history.", "Rabenhorst began his career at LSU in 1925 as the head coach of the men's basketball team and two years later, in 1927, he also added head baseball coach to his duties." ] ], "gold": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball, participates in the Southeastern Conference and plays home games in Tiger Park. The team has finished third at the Women's College World series four times, in 2001, 2004, 2015, and 2016, and fifth two times in 2012, and 2017. The LSU Tigers baseball team represents Louisiana State University in NCAA Division I college baseball and participates in the West Division of the Southeastern Conference. It is one of the elite college baseball programs in the nation, ranking seventh all-time with 18 College World Series appearances and second all-time with six national championships, with the most recent being in 2017, where the team came in second.", "prediction 1": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball. The team participates in the Southeastern Conference (SEC), and plays home games in Tiger Park. The last time LSU was in the College World Series was in 2001, and the last time it was in 2017.", "prediction 2": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball. The team participates in the Southeastern Conference (SEC), and plays home games in Tiger Park. The team has been to the Women's College World Series six times. The last time LSU was in the WCWS was in 2001.", "prediction 3": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball. The team participates in the Southeastern Conference, and plays home games in Tiger Park. The last time the Tigers were in the College World Series was on September 5, 2017.", "prediction 4": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball. The team participates in the Southeastern Conference and plays home games in Tiger Park. The team has been to the Women's College World Series six times, including three appearances in 2001.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 254, "end": 262 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The LSU Tigers softball team represents Louisiana State University in NCAA Division I college softball. The team participates in the Southeastern Conference (SEC), and plays home games in Tiger Park. The team has finished 3rd at the Women's College World series four times (2001, 2004, 2015, 2016) and 5th two times (2012, 2017). The last time LSU was in the College World Series was in 2017. The LSU Tigers baseball team represents Louisiana State University in NCAA Division I college baseball. The team participates in the West Division of the Southeastern Conference. It is one of the elite college baseball programs in the nation, ranking seventh all-time with 18 College World Series appearances and second all-time with six national championships" }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who's got the most followers on twitter?", "passages": [ [ "Barack Obama", "Barack Obama\n\nBarack Hussein Obama II (; born August 4, 1961) is an American attorney and politician who served as the 44th President of the United States from 2009 to 2017.", "A member of the Democratic Party, he was the first African American to be elected to the presidency.", "He previously served as a United States Senator from Illinois (2005\u20132008).", "Obama was born in 1961 in Honolulu, Hawaii, two years after the territory was admitted to the Union as the 50th state.", "After graduating from Columbia University in 1983, he worked as a community organizer in Chicago.", "In 1988, he enrolled in Harvard Law School, where he was the first black president of the \"Harvard Law Review\".", "After graduating, he became a civil rights attorney and an academic, teaching constitutional law at the University of Chicago Law School from 1992 to 2004.", "He represented the 13th district for three terms in the Illinois Senate from 1997 to 2004, when he ran for the U.S. Senate.", "He received national attention in 2004 with his March primary win, his well-received July Democratic National Convention keynote address, and his landslide November election to the Senate.", "In 2008, he was nominated for president a year after his campaign began and after a close primary campaign against Hillary Clinton.", "He was elected over Republican John McCain and was inaugurated on January 20, 2009.", "Nine months later, he was named the 2009 Nobel Peace Prize laureate." ], [ "Barack Obama on social media", "Barack Obama on social media\n\nThe topic of Barack Obama's usage of social media in his political campaigns, including podcasting, Twitter, Myspace, Facebook, and YouTube has been compared to the adoption of radio, television, MTV, and the Internet in slingshotting his presidential campaign to success and as thus has elicited much scholarly inquiry.", "In the 2008 presidential campaign, Obama had more \"friends\" on Facebook and Myspace and more \"followers\" on Twitter than his opponent John McCain.", "Obama's usage of the wider Internet has often since been compared to Franklin D. Roosevelt and John F. Kennedy's adaption of the radio and television mediums respectively in the history of communication between the White House and the American Public.", "Barack Obama's Twitter account (@BarackObama) is the official account on social networking site Twitter for former President of the United States Barack Obama, and has been used for his election efforts.", "Obama also used the White House's Twitter account (@WhiteHouse) for his presidential activities.", ", Obama's account had 103,083,062 followers, followed 617,962 accounts, and had posted 15,548 tweets.", "Well into 2011, it was following the most people of any account on the network and was the third to achieve ten million followers." ] ], "gold": "@BarackObama, owned by the 44th President of the United States, Barack Obama, is the current Twitter account with the most followers. ", "prediction 1": "The person who has the most followers on Twitter is Barack Obama. In 2016, Barack Obama had 103,083,062 followers, followed 617,962 accounts, and had posted 15,548 tweets. In 2017, Trump had 103,083,062 followers.", "prediction 2": "In 2017, the holder of the most Twitter followers, the Obama campaign, was Bill Clinton.", "prediction 3": "Barack Hussein Obama, born August 4, 1961, is an American attorney and politician who served as the 44th president of the United States from 2009 to 2017. In the 2008 presidential campaign, Obama had more \"friends\" on Facebook and Myspace and more \"followers\" on Twitter than his opponent John McCain. In 2017, the account of former President of the United States Barack Obama had the most followers on Twitter, followed 617,962 accounts and had posted 15,548 tweets.", "prediction 4": "In 2016, the person with the most followers on Twitter was Donald Trump, followed by Hillary Clinton. In 2017, Donald Trump had the most followers on Twitter, followed by Barack Obama.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 172, "end": 213 }, { "error type": "Unverifiable", "explanation": "", "start": 69, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 171 } ], "missing-info": [], "corrected-prediction": "The person who has the most followers on Twitter is Barack Obama. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who created the declaration of the rights of man?", "passages": [ [ "Declaration of the Rights of Man and of the Citizen", "Declaration of the Rights of Man and of the Citizen\n\nThe Declaration of the Rights of Man and of the Citizen (), set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution.", "The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette, in consultation with Thomas Jefferson.", "Influenced by the doctrine of \"natural right\", the rights of man are held to be universal: valid at all times and in every place, pertaining to human nature itself.", "It became the basis for a nation of free individuals protected equally by the law.", "It is included in the beginning of the constitutions of both the Fourth French Republic (1946) and Fifth Republic (1958) and is still current.", "Inspired by the Enlightenment philosophers, the Declaration was a core statement of the values of the French Revolution and had a major impact on the development of freedom and democracy in Europe and worldwide.", "The Declaration, together with Magna Carta, the English Bill of Rights, the United States Declaration of Independence and the United States Bill of Rights, inspired in large part the 1948 United Nations Universal Declaration of Human Rights.", "The content of the document emerged largely from the ideals of the Enlightenment.", "The key drafts were prepared by Lafayette, working at times with his close friend Thomas Jefferson." ], [ "Marie Antoinette", "The abolition of feudal privileges by the National Constituent Assembly on 4 August 1789 and the Declaration of the Rights of Man and of the Citizen (\"La D\u00e9claration des Droits de l'Homme et du Citoyen\"), drafted by Lafayette with the help of Thomas Jefferson and adopted on 26 August, paved the way to a Constitutional Monarchy (4 September 1791 \u2013 21 September 1792).", "Despite these dramatic changes, life at court continued, while the situation in Paris was becoming critical because of bread shortages in September.", "On 5 October, a crowd from Paris descended upon Versailles and forced the royal family to move to the Tuileries Palace in Paris, where they lived under a form of house arrest under the watch of Lafayette's \"Garde nationale\", while the comte de Provence and his wife were allowed to reside in the Petit Luxembourg, where they remained until they went into exile on 20 June 1791.", "Marie Antoinette continued to perform charitable functions and attend religious ceremonies, but dedicated most of her time to her children.", "She also played an important political, albeit not public, role between 1789 and 1791 when she had a complex set of relationships with several key actors of the early period of the French Revolution.", "One of the most important was Necker, the Prime Minister of Finances (\"Premier ministre des finances\").", "Despite her dislike of him, she played a decisive role in his return to office." ], [ "Jean-Marie Cal\u00e8s", "The Convention solemnly promulgated the Constitution of the Year I on June 24, 1793 (constitution of the 6 messidor year I, the \"\"convention montagnarde\"\").", "It was ratified by referendum on August 9, but was never implemented because of wartime.", "Indeed, two months later only, on October 10, 1793, the Convention decreed that its application was suspended indefinitely and \"\u00ab the government will be revolutionary until peace\" \"\u00bb\".", "The Convention adopted a few years later the Constitution of the Year III (August 22, 1795, which included in its preamble the Declaration of the Rights and Duties of Man and the Citizen of 1795), which was approved by plebiscite on September 6, 1795, and founded the new regime of the Directory (it established also the Census suffrage, and politically, provided for a two-house legislature: a Council of Five Hundred and a Council of Ancients, and a unique kind of executive: a five-member committee (Directory) chosen by the legislature)." ], [ "Marie-Jean H\u00e9rault de S\u00e9chelles", "Marie-Jean H\u00e9rault de S\u00e9chelles\n\nMarie-Jean H\u00e9rault de S\u00e9chelles (20 September 1759 \u2013 5 April 1794) was a French judge and politician who took part in the French Revolution.", "Marie-Jean H\u00e9rault de S\u00e9chelles was born in Paris in a noble and well-known family.", "His grandfather was Ren\u00e9 H\u00e9rault, who had served as Lieutenant General of Police of Paris between 1725 and 1739.", "His great-grandfather was Jean Moreau de S\u00e9chelles (1690-1760), who had served as Controller-General of Finances between 1754 and 1756 and had given his name to the Seychelles archipelago.", "Jean Moreau de S\u00e9chelles's daughter, H\u00e9l\u00e8ne Moreau de S\u00e9chelles (1715-1798), was the second wife of Ren\u00e9 H\u00e9rault.", "Most authors, however, consider that Ren\u00e9 H\u00e9rault was not the biological grandfather of Marie-Jean H\u00e9rault de S\u00e9chelles.", "His biological grandfather was most likely Louis Georges \u00c9rasme de Contades (1704-1793), Marshal of France, who had an affair with H\u00e9l\u00e8ne Moreau de S\u00e9chelles during her marriage to Ren\u00e9 H\u00e9rault." ], [ "French Constitution of 1793", "The draftsmen were also placed on the elite Committee of Public Safety to maximize their resources.", "The Convention deemed their work to be of supreme importance, to be completed \"in the shortest possible time.\"", "The work took less than two weeks.", "A complete constitutional document was submitted to the Convention on 10 June 1793.", "It was subsequently accepted by that body on 24 June and put to a public referendum.", "Employing universal male suffrage, the vote was a resounding popular victory for the new constitution, which received the approval of 1,784,377 out of approximately 1,800,000 voters.", "The Constitution expanded upon the Declaration of the Rights of Man and of the Citizen of 1789, to which it added several rights: it proclaimed the superiority of popular sovereignty over national sovereignty.", "It added several new economic and social rights, including right of association, right to work and public assistance, right to public education, right of rebellion (and duty to rebel when the government violates the right of the people), and the abolition of slavery, all written into what is known as the Declaration of the Rights of Man and Citizen of 1793.", "Sections 1 through 6 spelled out exactly who should be treated as a French Citizen and under what conditions citizenship could be revoked." ], [ "Jean-Jacques-Fran\u00e7ois Le Barbier", "Jean-Jacques-Fran\u00e7ois Le Barbier\n\nJean-Jacques-Fran\u00e7ois Le Barbier (born in Rouen on 11 November 1738 \u2014 died in Paris on 7 May 1826) was a writer, illustrator and painter of French history.", "By 1780 he was an official painter of the King of France.", "He was the father of artist \u00c9lise Bruy\u00e8re.", "His most famous work was a representation of the Declaration of the Rights of Man and of the Citizen made in 1789.", "He also designed the suite of tapestries of the four contintents (1790\u201391).", "Select list of work" ] ], "gold": "The Declaration of the Rights of Man and of the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The content of the document emerged largely from the ideals of the Enlightenment. The principal drafts were prepared by Lafayette, working at times with his close friend Thomas Jefferson. In August 1789, the Abb\u00e9 Siey\u00e8s and Honor\u00e9 Mirabeau played a central role in conceptualizing and drafting the final Declaration of the Rights of Man and of the Citizen. The Declaration of the Rights of Man painting was created by Jean-Jacques-Fran\u00e7ois Le Barbier. The Declaration of the Rights of the Man and of the Citizen of 1793 was written by the commission that included Louis Antoine L\u00e9on de Saint-Just and Marie-Jean H\u00e9rault de S\u00e9chelles. It included new rights and revisions to prior ones. It was officially adopted on 10 August but never went into effect.", "prediction 1": "The Declaration of the Rights of Man and of the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette, in consultation with Thomas Jefferson. Influenced by the doctrine of \"natural right\", the rights of man are held to be universal: valid at all times and in every place, pertaining to human nature itself. It became the basis for a nation of free individuals protected equally by the law.\n", "prediction 2": "The Declaration of the Rights of Man and the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette, in consultation with Thomas Jefferson. Influenced by the doctrine of \"natural right\", the rights of man are held to be universal: valid at all times and in every place, pertaining to human nature itself. It became the basis for a nation of free individuals protected equally by the law. Inspired by the Enlightment philosophers, the Declaration was a core statement of the values of the French Revolution and had a major impact on the development of freedom and democracy in Europe and worldwide.", "prediction 3": "The Declaration of the Rights of Man and of the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette, in consultation with Thomas Jefferson, and popularly adopted on 26 August 1789. The Declaration, together with Magna Carta, the English Bill of Rights, the United States Declaration of Independence and the United States Bill of Rights, inspired in large part the 1948 United Nations Universal Declaration of Human Rights and Canada Declaration of Rights.", "prediction 4": "The Declaration of the Rights of Man and of the Citizen is a human civil rights document from the French Revolution. The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette in consultation with Thomas Jefferson. Influenced by the doctrine of \"natural right\", the rights of man are held to be universal: valid at all times and in every place, pertaining to human nature itself. The Declaration, together with Magna Carta, the English Bill of Rights, the United States Declaration of Independence and the United States Bill of Rights, inspired in large part the 1948 United Nations Universal Declaration of Human Rights.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 453 }, { "error type": "Irrelevant", "explanation": "", "start": 454, "end": 537 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Declaration of the Rights of Man and of the Citizen, set by France's National Constituent Assembly in 1789, is a human civil rights document from the French Revolution. The Declaration was drafted by the Abb\u00e9 Siey\u00e8s and the Marquis de Lafayette, in consultation with Thomas Jefferson. The content of the document emerged largely from the ideals of the Enlightenment. The key drafts were prepared by Lafayette, working at times with his close friend Thomas Jefferson. Jean-Jacques-Fran\u00e7ois Le Barbier made a work of the Declaration of the Rights of Man and of the Citizen. The Declaration of the Rights of Man and Citizen of 1793 added several new economic and social rights. It was ratified by referendum on August 9, but was never implemented because of wartime.\n." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Who sang dedicated to the one i love?", "passages": [ [ "Dedicated to the One I Love", "Dedicated to the One I Love\n\n\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass which was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas.", "Pauling was the guitarist of The \"5\" Royales, the group that recorded the original version of the song, produced by Bass, in 1957.", "Their version was re-released in 1961 and charted at number 81 on the \"Billboard\" Hot 100.", "A cover version recorded by American girl group the Shirelles reached number 83 in 1959.", "This version was re-released In 1961 and reached number 3 on the \"Billboard\" Hot 100 chart and number 2 on \"Billboard\"s Hot R&B Sides.", "The song was subsequently included on their 1961 album \"Tonight's the Night\".", "In 1967, a subsequent and more popular cover version by the Mamas & the Papas released on the Dunhill label went to number 2 on the \"Billboard\" Hot 100, kept from number 1 by Happy Together by The Turtles.", "This version also reached number 2 on the UK's \"Record Retailer\" chart.", "The lead singer on the Mamas & the Papas version was Michelle Phillips.", "It was the first time that Phillips was given the lead over Cass Elliot." ], [ "The O'Kaysions", "The O'Kaysions\n\nThe O'Kaysions are an American pop band from Kenly, North Carolina that first formed in 1959.", "They are best known for their 1968 million-seller \"Girl Watcher\".", "The group first formed under the name The Kays in 1959, and scored a Top 10 hit in the U.S. in 1968 with the tune \"Girl Watcher\" (#5 Pop, #6 R&B).", "The song was first released on the North State record label owned by Ronald Killette (Buck Trail), then based in Goldsboro, N.C., under the production of John I Whitfield .", "Authorship credit for the song was originally shared by Buck Trail and O'Kaysions band member Wayne Pittman.", "Due to the popularity of this single it was sold to and released nationally by ABC Records where it eventually reached #5 on the Billboard pop charts.", "\"Girl Watcher\" received gold record status for a million sales from the R.I.A.A. in December 1968.", "It was their only major hit, and they released their full-length album in 1969 entitled \"The O'Kaysions\" on the ABC label." ] ], "gold": "\"Dedicated To The One I Love\" is a song written by Ralph Bass and Lowman Pauling, who was the guitarist of the \"5\" Royales. The song was a hit for the \"5\" Royales in 1957, the Shirelles in 1959, and the Mamas and the Papas in 1967. In 1973, the song was released by Ruben and the Jets and in 1968 The O'Kaysions released a version of the song on their debut album, Girl Watcher. In 1981 Bernadette Peters recorded a version, which reached number 65 on the Billboard Hot 100.", "prediction 1": "\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass. It was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas. The O'Kaysions are an American pop band from Kenly, North Carolina that first formed in 1959. They are best known for their 1968 million-seller \"Girl Watcher\". The Shirelles recorded a cover of \"Dedicated to the One I Love\" and the Mamas & the Papas released a subsequent cover version. This was re-released in 1961 and reached number 3 on the Billboard Hot 100 chart and number 2 on \"Billboard\" Hot R&B Sides.", "prediction 2": "\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass which was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas. Pauling was the guitarist of The \"5\" Royales, the group that recorded the original version of the song, produced by Bass, in 1957. A cover version recorded by American girl group the Shirelles reached number 83 in 1959. This version was re-released in 1961 and reached number 3 on the \"Billboard\" Hot 100 chart and number 2 on the \"Billboard\"s Hot R&B Sides\". The lead singer on the Mamas & the Papas version was Michelle Phillips.", "prediction 3": "\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass which was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas. The O'Kaysions are an American pop band from Kenly, North Carolina that first formed in 1959, and scored a Top 10 hit in the U.S. in 1968 with the tune \"Girl Watcher\". The Shirelles also sang a cover version of \"Dedicated to the One I Love\" in 1961. The Mamas & the Papas sang the song. The lead singer on the Mamas & the Papas version was Michelle Phillips. The lead singer on the Papas version was Michelle Phillips.", "prediction 4": "\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass that was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas. The song was originally composed by Pauling for the group The Kaysions and was first released in 1957. It was re-released in 1961 and charted at number 81 on the Billboard Hot 100. In 1961, a cover version was recorded by American girl group the Shirelles, which reached number 83 in 1959. This version was re-released in 1961 and reached number 3 on the Billboard Hot 100 chart and number 2 on the Billboard's Hot R&B Sides chart. In 1967, a subsequent and more popular cover version was released on the Mamas & the Papas.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 567 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Dedicated to the One I Love\" is a song written by Lowman Pauling and Ralph Bass. Pauling was the guitarist of The \"5\" Royales, the group that recorded the original version of the song, produced by Bass, in 1957. It was a hit for the \"5\" Royales, the Shirelles and the Mamas & the Papas. A cover version recorded by American girl group the Shirelles reached number 83 in 1959." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who sang i'll fly away in o brother where art thou?", "passages": [ [ "O Brother, Where Art Thou? (soundtrack)", "It won the Grammy Award for Album of the Year in 2002, the Grammy Award for Best Country Collaboration with Vocals (for singer Dan Tyminski, whose voice overdubbed George Clooney's in the film on \"I Am a Man of Constant Sorrow\", Nashville songwriter Harley Allen, and the Nashville Bluegrass Band's Pat Enright), and the Grammy Award for Best Male Country Vocal Performance for \"O, Death\" by Ralph Stanley.", "In 2001, the album spent over 20 weeks on the \"Billboard\" Top Country Chart.", "It won the Album of the Year Award and Single of the Year Award for \"I Am a Man of Constant Sorrow\" won an award for single of the year at the Country Music Association Awards.", "It also won the Album of the Year Award at the Academy of Country Music Awards and took home 2 International Bluegrass Music Awards: Album of the Year and Gospel Recorded Performance of the Year (for Alison Krauss and Gillian Welch on \"I'll Fly Away\").", "Some of the artists on the soundtrack played a concert at the Ryman Auditorium in Nashville, Tennessee, which was recorded in the documentary film, \"Down from the Mountain\".", "In 2006, the album ranked #38 on \"CMT's 40 Greatest Albums in Country Music\"." ], [ "O Brother, Where Art Thou?", "The use of dirges and other macabre songs is a theme that often recurs in Appalachian music (\"O Death\", \"Lonesome Valley\", \"Angel Band\", \"I Am Weary\") in contrast to bright, cheerful songs (\"Keep On the Sunny Side\", \"In the Highways\") in other parts of the film.", "The voices of the Soggy Bottom Boys were provided by Dan Tyminski (lead vocal on \"Man of Constant Sorrow\"), Nashville songwriter Harley Allen, and the Nashville Bluegrass Band's Pat Enright.", "The three won a CMA Award for Single of the Year and a Grammy Award for Best Country Collaboration with Vocals, both for the song \"Man of Constant Sorrow\".", "Tim Blake Nelson sang the lead vocal on \"In the Jailhouse Now\".", "\"Man of Constant Sorrow\" has five variations: two are used in the film, one in the music video, and two in the soundtrack album.", "Two of the variations feature the verses being sung back-to-back, and the other three variations feature additional music between each verse.", "Though the song received little significant radio airplay, it reached #35 on the U.S. \"Billboard\" Hot Country Singles & Tracks chart in 2002." ], [ "O Brother, Where Art Thou?", "The version of \"I'll Fly Away\" heard in the film is performed not by Krauss and Welch (as it is on the CD and concert tour), but by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo, recorded in 1956 for the album \"Bowling Green\" on Tradition Records.", "The film premiered at the AFI Film Festival on October 19, 2000.", "It grossed $71,868,327 worldwide off its $26 million budget.", "Review aggregation website Rotten Tomatoes gives it a score of 77% based on 147 reviews and an average score of 7.1/10.", "The consensus reads: \"Though not as good as Coen brothers' classics such as \"Blood Simple\", the delightfully loopy \"O Brother, Where Art Thou?\" is still a lot of fun.\"", "The film holds an average score of 69/100 on Metacritic based on 30 reviews.", "Roger Ebert gave two and a half out of four stars to the film, saying all the scenes in the film were \"wonderful in their different ways, and yet I left the movie uncertain and unsatisfied\".", "The film was selected into the main competition of the 2000 Cannes Film Festival.", "The film also received two Academy Award nominations at the 73rd Academy Awards: Best Adapted Screenplay and Best Cinematography." ] ], "gold": "Although the original soundtrack album for the film \"O Brother, Where Art Thou?\" includes the song \"I'll Fly Away\" performed by Alison Krauss and Gillian Welch, the version that can be heard in the movie itself, as well as in the 10th Anniversary Delux Edition's bonus disc, is a different one. Played by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo, this version was recorded in 1956 for the album \"Bowling Green\" on Tradition Records.", "prediction 1": "The song \"I'll Fly Away\" in the film \"O Brother, Where Art Thou?\" was sung by the Kossoy Sisters and Erik Darling with long-neck five-string banjo. The voices of the Soggy Bottom Boys were provided by Dan Tyminski, Nashville songwriter Harley Allen, and the Nashville Bluegrass Band's Pat Enright.", "prediction 2": "The song \"I'll Fly Away\" heard in the film was sung by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo, recorded in 1956 for the album \"Bowling Green\" on Tradition Records. Dan Tyminski sang the lead vocal on the song \"Man of Constant Sorrow\", while Harley Allen and the Nashville Bluegrass Band sang the backing vocals.", "prediction 3": "The song I'll Fly Away in the movie O Brother, Where Art Thou? was originally sung by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo. The film was directed by Michael Scott and produced by John Carpenter. The soundtrack includes a version by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo, recorded in 1956 for the album Bowling Green on Tradition Records. Dan Tyminski sang the lead vocal on the song I Am a Man of Constant Sorrow. The voices of the Soggy Bottom Boys were provided by Dan Tyminski, Nashville songwriter Harley Allen, and the Nashville Bluegrass Band's Pat Enright.", "prediction 4": "The version of \"I'll Fly Away\" heard in the film is performed by the Kossoy Sisters with Erik Darling accompanying on long-neck five-string banjo. The film premiered at the AFI Film Festival on October 19, 2000. Dan Tyminski sang the lead vocal on \"I Am a Man of Constant Sorrow\", Nashville songwriter Harley Allen, and the Nashville Bluegrass Band's Pat Enright. The film did not feature any of the other performers, but instead featured the Kossoy Sistersoy Sisters with Erik Darling accompanying on long-neck five-string banjo. The song was recorded in 1956 for the album \"Bowling Green\" on Tradition Records. The Kosoy Sistersoy Sistersoy Sisters with Erik Darling accompanying on long-neck five-string banjo. The Kosoy Sistersoy Sister", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 297 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The song \"I'll Fly Away\" in the film \"O Brother, Where Art Thou?\" was sung by the Kossoy Sisters and Erik Darling with long-neck five-string banjo, recorded in 1956 for the album \"Bowling Green\" on Tradition Records. Although the original soundtrack album for the film \"O Brother, Where Art Thou?\" includes the song \"I'll Fly Away\" performed by Alison Krauss and Gillian Welch." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Where was the movie the way back filmed?", "passages": [ [ "India", "India\n\nIndia (IAST: ), also known as the Republic of India (IAST: ), is a country in South Asia.", "It is the seventh-largest country by area, the second-most populous country (with over 1,200 crore (1.2 billion) people), and the most populous democracy in the world.", "Bounded by the Indian Ocean on the south, the Arabian Sea on the southwest, and the Bay of Bengal on the southeast, it shares land borders with Pakistan to the west; China, Nepal, and Bhutan to the northeast; and Bangladesh and Myanmar to the east.", "In the Indian Ocean, India is in the vicinity of Sri Lanka and the Maldives, while its Andaman and Nicobar Islands share a maritime border with Thailand and Indonesia.", "The Indian subcontinent was home to the urban Indus Valley Civilisation of the 3rd millennium .", "In the following millennium, the oldest scriptures associated with Hinduism began to be composed.", "Social stratification, based on caste, emerged in the first millennium BCE, and Buddhism and Jainism arose.", "Early political consolidations took place under the Maurya and Gupta empires; the later peninsular Middle Kingdoms influenced cultures as far as Southeast Asia.", "In the medieval era, Judaism, Zoroastrianism, Christianity, and Islam arrived, and Sikhism emerged, all adding to the region's diverse culture." ], [ "Queen of the Desert (film)", "The film\u2019s about Gertrude Bell, it\u2019s really not about making Lawrence of Arabia.\"", "Nick N. Raslan, one of the producer of the film, also appeared the film in a cameo appearance.", "Principal photography began on December 20, 2013.", "Herzog shot background scenes and establishing shots without the principal cast in Merzouga, Morocco and Petra, Jordan.", "Principal photography with the main cast started in Merzouga on January 13, 2014.", "Filming also took place at Marrakesh and Erfoud and continued till February 26, 2014, in Ouarzazate, Morocco.", "After Morocco, filming moved to London and finished on March 6, 2014.", "A major portion of filming took place in Morocco.", "Fifty actors (apart from main cast), more than 1,500 extras and 65 technicians, all Moroccan, participated.", "The film premiered at 65th Berlin International Film Festival in February 2015.", "It had a theatrical released in Germany on September 3, 2015.", "A different cut of the film will be screened at AFI Fest in November 2015.", "Originally, Atlas Distribution Co. acquired the US distribution rights of the film and planned to have a wide release in fall 2015.", "However, IFC Films later acquired distribution rights with a planned spring 2017 release.", "An official trailer was released on June 13, 2015, followed by a second trailer, released a month later." ], [ "The Way Back", "The Way Back\n\nThe Way Back is a 2010 American survival film directed by Peter Weir, from a screenplay by Weir and Keith Clarke.", "The film is inspired by \"The Long Walk\" (1956), the memoir by former Polish prisoner of war S\u0142awomir Rawicz, who claimed to have escaped from a Soviet Gulag and walked 4,000 miles to freedom in World War II.", "The film stars Jim Sturgess, Colin Farrell, Ed Harris, and Saoirse Ronan, with Alexandru Potocean, Sebastian Urzendowsky, Gustaf Skarsg\u00e5rd, Drago\u0219 Bucur and Mark Strong.", "The film was nominated for an Academy Award for Best Makeup.", "During World War II, after the Soviet invasion of Poland, young Polish army officer Janusz Wieszczek (Jim Sturgess) is held as a POW and interrogated by the NKVD.", "The Soviets, unable to get him to admit that he is a spy, take his wife into custody; from her they extort a statement condemning him.", "He is sentenced to 20 years in a Gulag labour camp deep in Siberia." ] ], "gold": "The 2010 film The Way Back is an American survival film directed by Peter Weir, from a screenplay by Weir and Keith Clarke and is inspired by The Long Walk, the memoir by former Polish prisoner of war S\u0142awomir Rawicz, who claimed to have escaped from a Soviet Gulag and walked 4,000 miles to freedom in World War II. This movie was filmed in Bulgaria, India, and Morocco. The 2020 film, The Way Back, which is an American sports drama directed by Gavin O'Connor and starring Ben Affleck, Al Madrigal, Michaela Watkins, and Janina Gavankar, follows an alcoholic construction worker who is recruited to become head coach of the basketball team at the high school he used to attend. This production was filmed in Los Angeles.", "prediction 1": "The Way Back is a 2010 American survival film directed by Peter Weir, from a screenplay by Weir and Keith Clarke. Filming also took place at Marrakesh and Erfoud and continued till February 26, 2014, in Ouarzazate, Morocco. After Morocco, filming moved to London and finished on March 6, 2014.", "prediction 2": "The 2010 American survival film, The Way Back, was filmed in Morocco, Morocco, Morocco, and London. Filming was also done in Marrakesh and Erfoud, and continued till February 26, 2014, in Ouarzazate, Morocco.", "prediction 3": "The film The Way Back is a 2010 American survival film directed by Peter Weir from a screenplay by Weir and Keith Clarke. It was filmed in Morocco, Morocco, and England.", "prediction 4": "The Way Back is a 2010 American survival film directed by Peter Weir from a screenplay by Weir and Keith Clarke. Filming also took place at Marrakesh and Erfoud and continued till February 26, 2014, in Ouarzazate, Morocco. A major portion of filming took place in Morocco. Fifty actors, more than 1,500 extras and 65 technicians, all Moroccan, participated.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 293 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Way Back is a 2010 American survival film directed by Peter Weir, from a screenplay by Weir and Keith Clarke. The film is inspired by \"The Long Walk\" (1956), the memoir by former Polish prisoner of war S\u0142awomir Rawicz, who claimed to have escaped from a Soviet Gulag and walked 4,000 miles to freedom in World War II. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played the doctor in madea's big happy family?", "passages": [ [ "Madea's Big Happy Family", "Madea's Big Happy Family\n\nMadea's Big Happy Family is a 2010 American musical play created, written, produced, and directed by Tyler Perry.", "It stars Tyler Perry as Mabel \"Madea\" Simmons, Cassi Davis as Aunt Bam, Palmer Williams, Jr. as Uncle Monroe, and Chandra Currelley-Young as Shirley.", "Perry began writing \"\"Big Happy Family\"\" after the death of his mother in December 2009.", "The main character of Shirley is based on her.", "Shirley (Chandra Currelley), accompanied by Aunt Bam (Cassi Davis), visits Dr. Frank Wallace (Omarr Dixon).", "Dr. Wallace tells Shirley that her cancer is active and she might have 4\u20136 weeks left.", "Later, Aunt Bam tells Shirley that she invited Madea to come over and help her when she tells her children the news.", "The scene later switches to the house where Joyce (Cheryl Pepsii Riley) shows up and informs Shirley that she called everybody, later Aunt Bam complains about the fact that she still doesn't have a man.", "Soon enough, Madea (Tyler Perry) arrives, ready to help Shirley." ], [ "Madea's Big Happy Family", "Lastly, Madea reveals that Kimberly was raped by an uncle on her father's side at 12 years old.", "She then tells her that she has love and needs get past the pain and show it more.", "Kimberly goes upstairs with Jason and sincerely apologizes for all she's done (\"You Are My Man\").", "Madea goes \"off-script\" to talk about things that are happening in \"the world today.\"", "Later, Madea gathers everyone and they all join in singing old songs.", "Finally, upstairs, Harold asks Tammy to sit down and when she doesn't comply, he yells at her.", "Harold then resolves the issue between their relationship with a song (\"If Only For One Night\").", "A film adaptation of the play was released on April 22, 2011." ], [ "Madea's Big Happy Family (film)", "Madea's Big Happy Family (film)\n\nTyler Perry's Madea's Big Happy Family is a 2011 comedy-drama film based on Tyler Perry's 2010 play of the same name and the 11th film in the Tyler Perry film franchise, and the sixth in the \"Madea\" franchise.", "Shirley (Loretta Devine), goes to visit Dr. Evans (Philip Anthony-Rodriguez) with family friend, Aunt Bam (Cassi Davis) about her cancer and finds out that it has gotten worse, and that she may only have a few months to live.", "She asks Aunt Bam to call her children so she can tell them.", "Cora and Mr. Brown (David and Tamela Mann) are also at the hospital, to get Mr. Brown a check-up.", "Dr. Evans tells them he has to do a colonoscopy on Mr. Brown, and they find a growth that needs to be removed surgically.", "Meanwhile, Madea (Tyler Perry) furiously and violently drives her car through a restaurant named 'Smax', because they stopped serving breakfast for the day, and because the manager had been very rude to her." ] ], "gold": "Madea's Big Happy Family is a 2010 American musical play created, written, produced, and directed by Tyler Perry. In the play the character Shirley (Chandra Currelley), accompanied by Aunt Bam (Cassi Davis), visits Dr. Frank Wallace (Omarr Dixon). Dr. Wallace tells Shirley that her cancer is active and she might have 4\u20136 weeks left. During the live tour of the play the doctor is played by Quan Hodges. The play was adapted into a movie released on April 22, 2011, Philip Anthony-Rodriguez played the doctor. ", "prediction 1": "Madea's Big Happy Family is a 2010 American musical play written, produced, and directed by Tyler Perry. In the play, Shirley goes to visit Dr. Frank Wallace, played by Omarr Dixon, who tells Shirley that her cancer is active and she might have 4\u20136 weeks left. Later, Shirley's aunts Bam and Harold are in the house where Joyce and Cheryl Pepsii Riley both show up, and later Aunt Bam complains about the fact that she still doesn't have a man. In the film, Philip Anthony-Rodriguez plays Dr. Evans, while Philip Anthony-Rodriguez plays Dr.", "prediction 2": "Madea's Big Happy Family is a 2010 American musical play written, produced, and directed by Tyler Perry. The play stars Tyler Perry as Mabel \"Madea\" Simmons, Cassi Davis as Aunt Bam, Palmer Williams, Jr. as Uncle Monroe, and Chandra Currelley-Young as Shirley. A 2011 comedy-drama film adaptation of the play was released on April 22, 2011. Philip Anthony-Rodriguez plays Dr. Evans.", "prediction 3": "Madea's Big Happy Family is a 2010 American musical play written, produced, and directed by Tyler Perry. It stars Tyler Perry as Mabel \"Madea\" Simmons, Cassi Davis as Aunt Bam, Palmer Williams, Jr. as Uncle Monroe, and Chandra Currelley-Young as Shirley. Doctor Frank Wallace is played by Omarr Dixon.", "prediction 4": "Madea's Big Happy Family is a 2010 American musical play created, written, produced, and directed by Tyler Perry. It stars Tyler Perry as Mabel Simmons, Cassi Davis as Aunt Bam, Palmer Williams, Jr. as Uncle Monroe, and Chandra Currelley-Young as Shirley. In the 2010 film adaptation of the play, Philip Anthony Rodriguez plays Dr. Evans, while Philip Anthony Rodriguez plays Dr. Evans.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 444 }, { "error type": "Incoherent", "explanation": "", "start": 500, "end": 540 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Madea's Big Happy Family is a 2010 American musical play written, produced, and directed by Tyler Perry. In the play the character Shirley (Chandra Currelley), accompanied by Aunt Bam (Cassi Davis), visits Dr. Frank Wallace (Omarr Dixon), who tells Shirley that her cancer is active and she might have 4\u20136 weeks left. In the film released on April 22, 2011, Philip Anthony-Rodriguez plays Dr. Evans." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who stirred up a slave rebellion in virginia?", "passages": [ [ "Nat Turner's slave rebellion", "Turner eluded capture for six weeks but remained in Southampton County.", "On October 30, a white farmer named Benjamin Phipps discovered him hidden among the local Nottoway people, in a depression in the earth, created by a large, fallen tree that was covered with fence rails.", "He was tried on November 5, 1831 for \"conspiring to rebel and making insurrection\"; he was convicted and sentenced to death.", "He was asked if he regretted what he had done, and he responded, \"Was Christ not crucified?\"", "He was hanged on November 11 in Jerusalem, Virginia, and his corpse was drawn and quartered.", "After Turner's capture, lawyer Thomas Ruffin Gray published \"The Confessions of Nat Turner: The Leader of the Late Insurrection in Southampton, Virginia\".", "The book was the result of Gray's research while Turner was in hiding and his conversations with Turner before the trial, and it is the primary window into Turner's mind.", "Gray had a conflict of interest because he was the defense attorney for other accused participants, so historians disagree on how to assess it as insight into Turner.", "In the aftermath of the rebellion, dozens of suspected rebels were tried in courts called specifically for the purpose of hearing the cases against the slaves.", "Most of the trials took place in Southampton, but some were held in neighboring Sussex County plus a few in other counties." ], [ "Nat Turner", "Nat Turner\n\nNat Turner (October 2, 1800\u00a0\u2013 November 11, 1831) was an African-American slave who led a two-day rebellion of slaves and free blacks in Southampton County, Virginia on August 21, 1831.", "The rebellion caused the death of approximately sixty white men, women and children.", "Whites organized militias and called out regular troops to suppress the uprising.", "In addition, white militias and mobs attacked blacks in the area, killing an estimated 120, many of whom were not involved in the revolt.", "Nobody was arrested, tried or executed for these crimes against black men, women and children.", "The rebels went from plantation to plantation, gathering horses and guns, freeing other slaves along the way, and recruiting other blacks who wanted to join their revolt.", "During the rebellion, Virginia legislators targeted free blacks with a colonization bill, which allocated new funding to remove them, and a police bill that denied free blacks trials by jury and made any free blacks convicted of a crime subject to sale into slavery and relocation.", "In the aftermath, the state tried those accused of being part of Turner's slave rebellion: 18 were executed, 14 were transported out of state, and several were acquitted.", "Turner hid successfully for two months.", "When found, he was tried, convicted, sentenced to death, hanged and possibly beheaded.", "Across Virginia and other southern states, state legislators passed new laws to control slaves and free blacks." ], [ "Nat Turner", "Turner said: \"I communicated the great work laid out for me to do, to four in whom I had the greatest confidence\"\u00a0\u2013 his fellow slaves Henry, Hark, Nelson, and Sam.", "Beginning in February 1831, Turner claimed certain atmospheric conditions as a sign to begin preparations for a rebellion against slaveowners.", "On February 12, 1831, an annular solar eclipse was visible in Virginia.", "Turner envisioned this as a black man's hand reaching over the sun.", "He initially planned the rebellion to begin on July 4, Independence Day.", "Turner postponed it because of illness and to use the delay for additional planning with his co-conspirators.", "On August 7 there was another solar eclipse, in which the sun appeared bluish-green, possibly the result of lingering atmospheric debris from an eruption of Mount St. Helens in present-day Washington state.", "Turner interpreted this as the final signal, and about a week later, on August 21, he began the uprising.", "Turner started with a few trusted fellow slaves.", "\"All his initial recruits were other slaves from his neighborhood\".", "The neighborhood men had to find ways to communicate their intentions without giving up their plot.", "Songs may have tipped the neighborhood members to movements.", "\"It is believed that one of the ways Turner summoned fellow conspirators to the woods was through the use of particular songs.\"" ] ], "gold": "Nat Turner was an enslaved African-American preacher who led the four-day rebellion of enslaved and free black people in Southampton County, Virginia, in 1831. Turner started with a few trusted fellow enslaved individuals. \"All his initial recruits were other slaves from his neighborhood\". The neighborhood men had to find ways to communicate their intentions without giving up their plot. The rebel slaves killed between 55 and 65 people, at least 51 of whom were white.", "prediction 1": "Nat Turner, an African-American slave, stirred up a slave rebellion in Virginia on August 21, 1831. The rebellion caused the death of approximately sixty white men, women and children. Whites organized militias and called out regular troops to suppress the uprising. Whites also attacked blacks in the area, killing an estimated 120, many of whom were not involved in the revolt.", "prediction 2": "Nat Turner stirred up a slave rebellion in Virginia on August 21, 1831. The rebellion caused the death of approximately sixty white men, women and children. Whites organized militias and called out regular troops to suppress the uprising.", "prediction 3": "Nat Turner stirred up a slave rebellion in Virginia on August 21, 1831, when he claimed certain atmospheric conditions as a sign to begin preparations for a rebellion against white slaveowners. On February 12, 1831, an annular solar eclipse was visible in Virginia. Turner envisioned this as a black man's hand reaching over the sun. On August 7, there was another solar eclipse in which the sun appeared bluish-green, possibly the result of lingering atmospheric debris from an eruption of Mount St. Helens in present-day Washington.", "prediction 4": "Nat Turner stirred up a slave rebellion in Virginia by stirring up atmospheric conditions and using songs to summon fellow conspirators to the woods. The rebellion caused the death of approximately 60 white men, women and children. Whites organized militias and called out regular troops to suppress the uprising.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 379 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] } ], "corrected-prediction": "Nat Turner, an African-American slave, stirred up a slave rebellion in Virginia on August 21, 1831. All his initial recruits were other slaves from his neighborhood\". The neighborhood men had to find ways to communicate their intentions without giving up their plot. The rebellion caused the death of approximately sixty white men, women and children. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did it become a tradition to stand for the national anthem?", "passages": [ [ "The Star-Spangled Banner", "On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played.", "That revision also directed men and women to place their hands over their hearts only if the flag was displayed.", "Those in uniform were required to salute.", "On July 7, 1976, the law was simplified.", "Men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting.", "On August 12, 1998, the law was rewritten keeping the same instructions, but differentiating between \"those in uniform\" and \"members of the Armed Forces and veterans\" who were both instructed to salute during the playing whether or not the flag was displayed.", "Because of the changes in law over the years and confusion between instructions for the Pledge of Allegiance versus the National Anthem, throughout most of the 20th century many people simply stood at attention or with their hands folded in front of them during the playing of the Anthem, and when reciting the Pledge they would hold their hand (or hat) over their heart.", "After 9/11, the custom of placing the hand over the heart during the playing of the national anthem became nearly universal." ], [ "The Star-Spangled Banner", "Since 1998, federal law (viz., the United States Code ) states that during a rendition of the national anthem, when the flag is displayed, all present including those in uniform should stand at attention; Non-military service individuals should face the flag with the right hand over the heart; Members of the Armed Forces and veterans who are present and not in uniform may render the military salute; military service persons not in uniform should remove their headdress with their right hand and hold the headdress at the left shoulder, the hand being over the heart; and Members of the Armed Forces and veterans who are in uniform should give the military salute at the first note of the anthem and maintain that position until the last note.", "The law further provides that when the flag is not displayed, all present should face toward the music and act in the same manner they would if the flag were displayed.", "Military law requires all vehicles on the installation to stop when the song is played and all individuals outside to stand at attention and face the direction of the music and either salute, in uniform, or place the right hand over the heart, if out of uniform.", "The law was amended in 2008, and since allows military veterans to salute out of uniform, as well.", "The text of is suggestive and not regulatory in nature.", "Failure to follow the suggestions is not a violation of the law." ] ], "gold": "When the United States national anthem was first recognized by law in 1931, there were no guidelines related to behavior during its playing. However, on June 22, 1942, the law was revised indicating that those in uniform should salute during the playing of the national anthem, while others should simply stand at attention, with men removing their hats. The same code also required that women should place their hands over their hearts when the flag is displayed during the playing of the national anthem but not if the flag were not displayed. On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music of the national anthem when it is played. This revision also directed men and women to place their hands over their hearts only if the flag were displayed. Additionally, those in uniform were required to salute. Then, on July 7, 1976, the law was simplified. Men and women were instructed to stand with their hands over their hearts, with men removing their hats, regardless of whether or not the flag were displayed. Since 1998, federal law states that during a rendition of the national anthem, when the flag is displayed, all present, including those in uniform, should stand at attention. Additionally, non-military service individuals should face the flag with their right hand over their heart. The law further provides that when the flag is not displayed, all present should face towards the music and act in the same manner they would if the flag were displayed.", "prediction 1": "On July 7, 1976, the law was simplified and instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. After 9/11, the custom of placing the hand over the heart during the playing of the national anthem became nearly universal.", "prediction 2": "After 9/11, the custom of placing the right hand over the heart during the playing of the national anthem became nearly universal. On August 12, 1998, the law was rewritten keeping the same instructions, but differentiating between \"those in uniform\" and \"members of the Armed Forces and veterans\" who were both instructed to salute during the playing whether or not the flag was displayed.", "prediction 3": "The custom of placing the hand over the heart during the playing of the national anthem became nearly universal after 9/11. Before 1998, federal law states that during a rendition of the national anthem, when the flag is displayed, all present including those in uniform should stand at attention. When the flag is not displayed, all present including those in uniform, should face the flag with the right hand over the heart.", "prediction 4": "The custom of standing for the National Anthem first became a tradition after 9/11. It was a tradition during the 20th century. On July 7, 1976, the law was simplified. Men and women were instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. On December 23, 1942, the law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played. On July 7, 1976, the law was again revised instructing men and women to place their hands over their hearts only if the flag was displayed. On December 8, 2003, the law was amended to include those in uniform. Since 1998, federal law states that during a rendition of the National Anthem, all present including those in uniform should stand at attention; Non-military service individuals should face the flag with the right hand over the", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 334 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "On December 23, 1942, The Star-Spangled Banner law was again revised instructing men and women to stand at attention and face in the direction of the music when it was played. That revision also directed men and women to place their hands over their hearts only if the flag was displayed. Those in uniform were required to salute.On July 7, 1976, the law was simplified and instructed to stand with their hands over their hearts, men removing their hats, irrespective of whether or not the flag was displayed and those in uniform saluting. Since 1998, federal law (viz., the United States Code ) states that during a rendition of the national anthem, when the flag is displayed, all present including those in uniform should stand at attention; Non-military service individuals should face the flag with the right hand over the heart. The law further provides that when the flag is not displayed, all present should face toward the music and act in the same manner they would if the flag were displayed." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sang i left my heart in sanfrancisco?", "passages": [ [ "I Left My Heart in San Francisco", "I Left My Heart in San Francisco\n\n\"I Left My Heart in San Francisco\" is a popular song, written in the fall of 1953 in Brooklyn, New York, with music by George Cory and lyrics by Douglass Cross (1920\u20131975) and best known as the signature song of Tony Bennett.", "In 1962, the song was released as a single by Bennett on Columbia Records as the b-side to \"Once Upon a Time,\" peaked at #19 on the U.S. \"Billboard\" Hot 100, and was also included on the album \"I Left My Heart in San Francisco\".", "It also reached number seven on the Easy Listening chart.", "The song is one of the official anthems for the city of San Francisco.", "In 2018, it was selected for preservation in the National Recording Registry by the Library of Congress as being \"culturally, historically, or artistically significant.\"", "The music was written by George Cory, with lyrics by Douglass Cross, about two amateur writers nostalgic for San Francisco after moving to New York.", "Although the song was originally written for Claramae Turner, who often used it as an encore, she never got around to recording it.", "The song found its way to Tony Bennett through Ralph Sharon, Bennett's longtime accompanist and friends with the composers." ], [ "I Left My Heart in San Francisco", "Sharon brought the music along when he and Bennett were on tour and on their way to San Francisco's Fairmont Hotel.", "Prior to Tony Bennett hearing it, the song was pitched to Tennessee Ernie Ford, whom Claramae Turner suggested Cross take it to.", "Ford turned the song down.", "In December 1961, in the famous \"Venetian Room\" at the Fairmont Hotel in San Francisco, Tony Bennett first sang \"I Left My Heart in San Francisco\".", "In the audience that night were San Francisco mayor George Christopher and future mayor Joseph L. Alioto.", "From the 1960s through the 1980s, at San Francisco's premier supper club the \"Venetian Room,\" Bennett sang the city song.", "Bennett first recorded the song at CBS Studios on 30th Street on January 23, 1962; CBS released it as the b-side of \"Once Upon A Time.\"", "The A-side received no attention, and DJs began flipping the record over and playing \"San Francisco.\"", "It became a hit on the pop singles chart in 1962 and spent close to a year on various other charts, achieving gold record status.", "It then won the top prize of Grammy Award for Record of the Year, as well as for Best Male Solo Vocal Performance.", "In 2001 \"I Left My Heart in San Francisco\" was ranked 23rd on an RIAA/NEA list of the most historically significant Songs of the 20th Century." ] ], "gold": "\"I Left My Heart in San Francisco\" is a popular song, written in the fall of 1953 in Brooklyn, New York, with music by George Cory (1920\u20131978) and lyrics by Douglass Cross and best known as the signature song of Tony Bennett. Although the song was originally written for Claramae Turner, who often used it as an encore, she never got around to recording it. Prior to Tony Bennett hearing it, the song was pitched to Tennessee Ernie Ford, whom Claramae Turner suggested Cross take it to.", "prediction 1": "In 1962, the song I Left My Heart in San Francisco, written in the fall of 1953 in Brooklyn, New York, was released as a single by Tony Bennett on Columbia Records as the b-side to \"Once Upon A Time.\" In the 1960s through the 1980s, at San Francisco's premier supper club the Venetian Room, Bennett sang the city song.", "prediction 2": "I Left My Heart in San Francisco is a popular song, written in the fall of 1953 in Brooklyn, New York, with music by George Cory and lyrics by Douglass Cross (1920\u20131975) and best known as the signature song of Tony Bennett. In December 1961, in the famous Venetian Room at the Fairmont Hotel in San Francisco, Tony Bennett first sang \"I Left My Heart in San Francisco\". In the audience that night were San Francisco mayor George Christopher and future mayor Joseph L. Alioto.", "prediction 3": "In the fall of 1953 in Brooklyn, New York, with music by George Cory and lyrics by Douglass Cross, I Left My Heart in San Francisco is a popular song, best known as the signature song of Tony Bennett. In December 1961, in the famous Venetian Room at the Fairmont Hotel in San Francisco, Tony Bennett first sang I Left My Heart in San Francisco. In the 1960s through the 1980s, at San Francisco's premier supper club the Venetian Room, Bennett sang the city song.", "prediction 4": "I Left My Heart in San Francisco is a popular song, written in the fall of 1953 in Brooklyn, New York, with music by George Cory and lyrics by Douglass Cross. It is best known as the signature song of Tony Bennett. From the 1960s through the 1980s, at San Francisco's premier supper club the Venetian Room, Bennett sang the city song. In December 1961, in the famous \"Venetian Room\" at the Fairmont Hotel in San Francisco, Tony Bennett first sang \"I Left My Heart in San Francisco.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 200 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 318 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "In 1962, the song I Left My Heart in San Francisco is a popular song, written in the fall of 1953 in Brooklyn, New York, with music by George Cory and lyrics by Douglass Cross (1920\u20131975) and best known as the signature song of Tony Bennett. Although the song was originally written for Claramae Turner, who often used it as an encore, she never got around to recording it. Prior to Tony Bennett hearing it, the song was pitched to Tennessee Ernie Ford, whom Claramae Turner suggested Cross take it." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is the x factor final 2017 filmed?", "passages": [ [ "The X Factor (UK series 14)", "For the first time since series six, a major overhaul of the set layout was made as live shows debuted in a new filming location, LH2 Studios in London.", "Numerous other changes were introduced for this series' live shows.", "This included contestant and musical guest performances on both Saturday and Sunday shows, and the removal of the sing-offs, deadlocks and judges' votes on the Sunday show.", "Each show, two of the categories would sing and immediately after the performances, the public vote would open for a short amount of time.", "At the end of each show, the contestant with the fewest votes is automatically eliminated from the competition.", "In addition, the contestant with the highest votes for that night would also be announced.", "The two acts who won their respective public vote would then sing against each other in a new element of the show called the prize fight.", "After another public vote, the winner of the prize fight would win a special weekly prize.", "For the first time ever the live final will broadcast from the Excel Centre, London and not Wembley Arena as part of the show's drastic changes this series.", "Liam Payne performed on the first live show, while Stormzy performed on the second live show.", "Tokio Myers performed on the third live show, while Rita Ora performed on the fourth." ], [ "The X Factor (UK series 14)", "The X Factor (UK series 14)\n\nThe X Factor is a British television music competition to find new singing talent.", "The fourteenth series began airing on ITV on 2 September 2017, presented by Dermot O'Leary.", "For the first time in seven years, the judging panel remained the same as the previous series, with Simon Cowell, Sharon Osbourne, Nicole Scherzinger and Louis Walsh returning.", "This is the first series not to include companion show \"The Xtra Factor\", after it was cancelled in January 2017.", "Its replacement is a programme called \"Xtra Bites\" presented by Becca Dudley on the ITV Hub.", "This is also the first series to be sponsored by Just Eat, with the show having being sponsored by TalkTalk since 2009, as well as the second time the show has premiered in September, rather than August, since the first series in 2004.", "Rak-Su won the competition on 3 December 2017 and they became the second group to win the competition and Simon Cowell became the winning mentor for the fourth time.", "In December 2016, Louis Walsh confirmed he would continue to judge the series through 2018, stating he had signed through \"the next two years\"." ] ], "gold": "The X Factor is a British television music competition to find new singing talent. The fourteenth series began airing on ITV on 2 September 2017, presented by Dermot O'Leary. For the first time ever the live final was broadcast from the Excel Centre, London, which is in the Custom House area of Canning Town, East London, in the London Borough of Newham, and not Wembley Arena as part of the show's drastic changes this series.", "prediction 1": "The X Factor is a British television music competition to find new singing talent. The final of the fourteenth series, which began airing on ITV on 2 September 2017, was filmed at the Excel Centre, London.", "prediction 2": "The X Factor is a British television music competition to find new singing talent. The live final 2017 of the fourteenth series was filmed at London's LH2 Studios, not Wembley Arena. For the first time ever the live final will broadcast from the Excel Centre, London and not Wembley Arena as part of the show's drastic changes this series.", "prediction 3": "The X Factor is a British television music competition to find new singing talent. In 2017, the final show was filmed at LH2 Studios in London.", "prediction 4": "The X Factor is a British television music competition to find new singing talent. For the first time ever the live final will broadcast from the Excel Centre, London and not Wembley Arena as part of the show's drastic changes this series.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The X Factor is a British television music competition to find new singing talent. The fourteenth series began airing began airing on ITV on 2 September 2017, presented by Dermot O'Leary. For the first time ever the live final will broadcast from the Excel Centre, London and not Wembley Arena as part of the show's drastic changes this series." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did delhi become capital of british india?", "passages": [ [ "Delhi", "In 1783, Sikhs under Baghel Singh captured Delhi and Red Fort but due to the treaty signed, Sikhs withdrew from Red Fort and agreed to restore Shah Alam II as the emperor.", "In 1803, during the Second Anglo-Maratha War, the forces of British East India Company defeated the Maratha forces in the Battle of Delhi.", "During the Indian Rebellion of 1857, Delhi fell to the forces of East India Company after a bloody fight known as the Siege of Delhi.", "The city came under the direct control of the British Government in 1858.", "It was made a district province of the Punjab.", "In 1911, it was announced that the capital of British held territories in India was to be transferred from Calcutta to Delhi.", "The name \"New Delhi\" was given in 1927, and the new capital was inaugurated on 13 February 1931.", "New Delhi, also known as \"Lutyens' Delhi\", was officially declared as the capital of the Union of India after the country gained independence on 15 August 1947.", "During the partition of India, thousands of Hindu and Sikh refugees, mainly from West Punjab fled to Delhi, while many Muslim residents of the city migrated to Pakistan.", "Migration to Delhi from the rest of India continues (), contributing more to the rise of Delhi's population than the birth rate, which is declining." ] ], "gold": "In 1911, it was announced that the capital of British-held territories in India was to be transferred from Calcutta to Delhi. The name \"New Delhi\" was given in 1927, and the new capital was inaugurated on 13 February 1931.", "prediction 1": "The city of Delhi became the capital of British India in 1858. The name \"New Delhi\" was given in 1927, and the new capital was inaugurated on 13 February 1931.", "prediction 2": "Delhi became capital of british India on 17 August 1793, and again on 15 August 1794. Until 1931, Delhi was the capital of British India.", "prediction 3": "In 1858, Delhi came under the direct control of the British Government after it fell to the East India Company after a bloody fight known as the Siege of Delhi. The name \"New Delhi\" was given in 1927, and the new capital was inaugurated on 13 February 1931. New Delhi, also known as \"Lutyens' Delhi\", was officially declared as the capital of the Union of India after the country gained independence on 15 August 1947.", "prediction 4": "In 1911, it was announced that the capital of British held territories in India was to be transferred from Calcutta to Delhi. The name New Delhi was given in 1927, and the new capital was inaugurated on 13 February 1931. The city came under the direct control of the British Government in 1858. The city came under the control of the British Government in 1858.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 57, "end": 62 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In 1911, it was announced that the capital of British held territories in India was to be transferred from Calcutta to Delhi. The name \"New Delhi\" was given in 1927, and the new capital was inaugurated on 13 February 1931." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played helen lawson in valley of the dolls?", "passages": [ [ "Helen Lawson", "She travels back to New York and originates another musical role, but this musical is a failure.", "Her vicious temperament later is shown in a physical fight with Neely O'Hara after making comments toward O'Hara's failed marriage to a supposed homosexual man, and asking if Neely's twin sons, Bud and Jud, are homosexual as well.", "O'Hara rips off and destroys Lawson's wig, much to Lawson's horror.", "At this point, Lawson's voice has developed a slight vibrato.", "Later in the novel, O'Hara mentions that Lawson's voice has gone and that she has left to play a \"character role\" in a television series.", "For the 1967 film adaptation, author Susann hoped that the Bette Davis would play the role, but Judy Garland was hired instead.", "Garland was replaced by Susan Hayward.", "Lawson made another appearance in the 2008 novel \"Candy Everybody Wants\" by Josh Kilmer-Purcell, where she acts as a mentor to the protagonist, 15-year-old Jayson Blocher, as he is beginning his career in Hollywood." ], [ "Valley of the Dolls (film)", "On July 20, 2009, Patty Duke told an audience at a screening of the film at the Castro Theater in San Francisco that director Mark Robson made Garland wait from 8am to 4pm before filming her scenes for the day, knowing that Garland would be upset and drunk by that time.", "Hayward reportedly had a difficult relationship with the cast and crew, and her clashes with Duke became part of the dramatic tension between their characters.", "20th Century Fox wanted contract star Raquel Welch to play Jennifer but she refused, not wanting to play a \"sexpot\" role.", "She asked to play Neely but the studio refused.", "\"Beyond the Valley of the Dolls\", a 1970 satirical pastiche, was filmed by Twentieth Century-Fox while the studio was being sued by Jacqueline Susann, according to Irving Mansfield's book \"Life With Jackie\".", "Susann created the title for a Jean Holloway-scripted sequel that was rejected by the studio, which allowed Russ Meyer to film a radically different movie with the same title.", "The suit went to court after Susann's death in 1974; the estate won damages of $2 million against Fox.", "The Criterion Collection released \"Valley of the Dolls\" along with its parody \"Beyond the Valley of the Dolls\" on September 2016 on DVD and Blu-ray." ], [ "Valley of the Dolls (TV series)", "Valley of the Dolls (TV series)\n\nValley of the Dolls is an American television series that debuted in 1994 and ran for 65 episodes.", "A 1990s television adaption of the novel \"Valley of the Dolls\" about the lives of various glamorous women living in Southern California." ], [ "Valley of the Dolls (film)", "Valley of the Dolls (film)\n\nValley of the Dolls is a 1967 American drama film based on the 1966 novel of the same name by Jacqueline Susann.", "It was directed by Mark Robson, produced by Robson and David Weisbart, and stars Barbara Parkins, Patty Duke, Sharon Tate, and Susan Hayward.", "Three young women meet when they embark on their careers.", "Neely O'Hara (Duke) is a plucky kid with undeniable talent who sings in a Broadway show, of which legendary actress Helen Lawson (Hayward) is the arrogant star, while Jennifer North (Tate), a beauty with limited talent, is in the chorus.", "Anne Welles (Parkins) is a New England ingenue who has arrived in New York City and works as a secretary for a theatrical agency that represents Lawson.", "She proves her worth to her boss, Henry Bellamy (Robert H. Harris) and Miss Steinberg (Naomi Stevens) and she excels in her job.", "Neely, Jennifer, and Anne become fast friends, sharing the bonds of ambition and the tendency to fall in love with the wrong men.", "Neely is fired from the show as Lawson considers her a threat to her top billing in the play." ] ], "gold": "There have been several adaptations of Jacqueline Susann's 1966 novel Valley of the Dolls. Sally Kirkland played Helen Lawson in the 1994 American drama series Valley of the Dolls. This series was a 1990s television adaption of the 1966 novel about the lives of various glamorous women living in Southern California. Valley of the Dolls is also a 1967 American drama film based on Jacqueline Susann's novel. In this film adaptation, Judy Garland was originally cast as Helen; however, she was replaced by Susan Hayward. Garland was fired when she reportedly came to work drunk. Susan Hayward replaced her in the role after production had already started. On July 20, 2009, Patty Duke told an audience at a screening of the film at the Castro Theater in San Francisco that director Mark Robson made Garland wait from 8:00 am to 4:00 pm before filming her scenes for the day, knowing that Garland would be upset and drunk by that time. In Jacqueline Susann's Valley of the Dolls, another adaptation, Jean Simmons played Helen Lawson. Jacqueline Susann's Valley of the Dolls was American television drama miniseries that aired on CBS in October 1981.", "prediction 1": "In the 1967 American drama film Valley of the Dolls, Bette Davis plays Helen Lawson, who is the arrogant star of a Broadway show, and in the 1990s television series Valley of the Dolls, Susan Hayward plays Helen Lawson. In the 1970 satirical pastiche Beyond the Valley of the Dolls, Raquel Welch plays Jennifer. In the 1994 television series, Aimee Parkins plays Anne Welles.", "prediction 2": "Helen Lawson is a legendary American actress who plays the role of Helen Lawson in the 1967 American drama film Valley of the Dolls, as well as in the 1990s television series Valley of the Dolls. In the 1970 satirical pastiche Beyond the Valley of the Dolls, Susan Hayward played the role of Helen Lawson. In the 1990s television series, Helen Lawson plays the role of Helen Lawson.", "prediction 3": "Helen Lawson is a legendary American actress. She is played by Susan Hayward in the 1967 film Valley of the Dolls, and in the 1990s television series Valley of the Dolls. In the 1990s TV series, Lawson is played by Sharon Tate.", "prediction 4": "Helen Lawson is a character in the 1967 American drama film Valley of the Dolls that was played by Judy Garland, but was replaced by Susan Hayward. In the 1990s television adaptation of the novel Valley of the Dolls, a 1990s television adaptation was adapted by Twentieth Century Fox as a satirical pastiche of the 1967 film based on the 1966 novel of the same name. In the 1970 satirical pastiche Beyond the Valley of the Dolls, Susan Hayward played Helen Lawson, who is the arrogant star of a Broadway show. In the 1990s television series Valley of the Dolls, Lawson is played by Patty Duke. In the 1967 film, Lawson is played by Patty Duke.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6,7]}", "start": 53, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 129 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 186, "end": 199 }, { "error type": "Unverifiable", "explanation": "", "start": 283, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 282 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the 1967 American drama film Valley of the Dolls, Susan Hayward plays Helen Lawson. Judy Garland was cast prior. On July 20, 2009, Patty Duke told an audience at a screening of the film at the Castro Theater in San Francisco that director Mark Robson made Garland wait from 8am to 4pm before filming her scenes for the day, knowing that Garland would be upset and drunk by that time. There's a 1990s television adaption of the novel \"Valley of the Dolls\" about the lives of various glamorous women living in Southern California." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When is office 2019 going to be released?", "passages": [ [ "Microsoft Office 2019", "Microsoft Office 2019\n\nMicrosoft Office 2019 is the current version of Microsoft Office, a productivity suite, succeeding Office 2016.", "It was released to general availability for Windows 10 and for macOS on September 24, 2018.", "Some features that had previously been restricted to Office 365 subscribers are available in this release.", "On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10.", "On June 12, 2018, Microsoft released a preview for macOS.", "Office 2019 includes many of the features previously published via Office 365, along with improved inking features, new animation features in PowerPoint including the morph and zoom features, and new formulae and charts in Excel for data analysis.", "OneNote is absent from the suite as the UWP version of OneNote bundled with Windows 10 replaces it.", "OneNote 2016 can be installed as an optional feature on the Office Installer.", "For Mac users, Focus Mode will be brought to Word, 2D maps will be brought to Excel and new Morph transitions, SVG support and 4K video exports will be coming to PowerPoint, including other features.", "Despite being released in the same month, the new Office user interface in Word, Excel, PowerPoint, and Outlook is only available to Office 365 subscribers, not perpetual Office 2019 licensees.", "The Office 2019 user interface retains the Metro design language from Office 2016, except that the Microsoft account picture is circular." ], [ "Resident Alien (comics)", "The concept was still confusing for \"Bam Smack Pow\", who would have preferred if story points from the prior miniseries had been better summarized.", "In March 2013, Hogan mentioned a television series based on the property was \"under discussion.\"", "In March 2015, Dark Horse editor and Vice President of Publishing Randy Stradley confirmed Hollywood was still showing interest in adapting the series.", "On May 31 2018, Syfy placed a pilot order for the series.", "Created as a joint venture by Universal Cable Productions, Dark Horse Entertainment, and Amblin Television, the show was adapted for television by Chris Sheridan.", "Sheridan is one of the show's executive producers, along with Mike Richardson, Keith Goldberg, Justin Falvey, and Darryl Frank.", "Production began on October 1, 2018, with Alan Tudyk starring as Harry.", "The pilot will also include Corey Reynolds playing Sheriff Mike Thompson and Alice Wetterlund as D'Arcy Morin.", "As part of the adaptation process, the fictional setting of Patience was relocated from Washington to Colorado." ], [ "Windows 10 version history", "It carries the build number 10.0.17763.", "The first preview was released to Insiders on February 14, 2018.", "The update was made available to public consumers on October 2, 2018.", "On October 6, 2018, Microsoft halted the public rollout of the update due to a serious bug that deletes user's files after updating.", "On October 9, 2018, Microsoft re-released the update to Insiders, stating that all known issues in the update (including file deletion bug) was identified and fixed.", "On October 25, 2018, Microsoft confirmed the existence of another bug which overwrites files without any confirmation when extracting from a ZIP file.", "The ZIP bug was fixed for Insiders on October 30, 2018.", "The public rollout of the update resumed on November 13, 2018.", "Windows 10 version 1903, codenamed \"19H1\", is the seventh major update to Windows 10 and the first to use a more descriptive codename (including the year and the order released) instead of the \"Redstone\" codename.", "The first preview was released to Insiders who opted in to the exclusive Skip Ahead ring on July 25, 2018." ] ], "gold": "Microsoft Office 2019 is the current version of Microsoft Office for both Windows and Mac and will be succeeded by Office 2021 in the second half of the year. On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10 and on June 12, 2018, Microsoft released a preview for macOS. On September 24, 2018 Office 2019 was then released for general availability for Windows 10 and for macOS. The Office 2019 was released in the UK on October 1, 2018 and in India on October 6, 2018.", "prediction 1": "Microsoft Office 2019 is the current version of Microsoft Office, a productivity suite, succeeding Office 2016. It was released to general availability for Windows 10 and for macOS on September 24, 2018. On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10. On June 12, 2018, Microsoft released a preview for macOS. Office 2019 includes many of the features previously published via Office 365, along with improved inking features, new animation features in PowerPoint including the morph and zoom features, and new formulae and charts in Excel for data analysis. The first preview was released to Insiders on February 14, 2018. The full version was released to public consumers on October 2, 2018.\n", "prediction 2": "Microsoft Office 2019, the current version of Microsoft Office a productivity suite, was released to general availability for Windows 10 and macOS on September 24, 2018. The office 2019 preview went live on Windows 10 after the beta period ended on May 31, 2019. The full version of Office 2019, including all the prereleases, was released to the general public on October 2, 2018.", "prediction 3": "Microsoft Office 2019, the current version of Microsoft Office, a productivity suite, was released to general availability for Windows 10 and for macOS on September 24, 2018. On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10. On June 12, 2018, Microsoft released a preview for macOS. Office 2019 includes many of the features previously published via Office 365, along with improved inking features, new animation features in PowerPoint including the morph and zoom features, and new formulae and charts in Excel for data analysis. The miniseries Patience: Secret Life of Elizabeth was first season 2 had been cancelled and only one episode was published in December 2017. This newspaper article published in a preview was released to Insiders in 2011.", "prediction 4": "Microsoft Office 2019 is the current version of Microsoft Office, a productivity suite, succeeding Office 2016. It was released to general availability for Windows 10 and for macOS on September 24, 2018. On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10. On June 12, 2018, Microsoft released a preview for macOS. The first preview was released to Insiders on February 14, 2018, the update was made available to public consumers on October 2, 2018. On October 6, 2018, Microsoft halted the public rollout of the update due to a serious bug that deletes user's files after updating.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 347, "end": 730 } ], "missing-info": [], "corrected-prediction": "Microsoft Office 2019 is the current version of Microsoft Office, a productivity suite, succeeding Office 2016. It was released to general availability for Windows 10 and for macOS on September 24, 2018. On April 27, 2018, Microsoft released Office 2019 Commercial Preview for Windows 10. On June 12, 2018, Microsoft released a preview for macOS. \n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What movie is the song chaiyya chaiyya from?", "passages": [ [ "Chaiyya Chaiyya", "Chaiyya Chaiyya\n\n\"Chaiyya Chaiyya\" () is an Indian song from the 1998 Hindi film \"Dil Se..\" directed by Mani Ratnam.", "The song was composed by A.R. Rahman, written by Gulzar, and sung by Sukhwinder Singh and Sapna Awasthi.", "It quickly became popular upon the release and its music video gained cult status, partly because it was filmed on a moving train.", "The song is based on Sufi music and Urdu poetry.", "The Tamil version is called \"Thaiyya Thaiyya\", which was also popular among Tamils.", "In 2002, the BBC World Service conducted an international poll to choose the ten most popular songs of all time.", "Around 7000 songs were selected from all over the world.", "According to the BBC, people from 155 countries voted \"Chaiyya Chaiyya\" ninth in the top 10 songs.", "The lyrics of \"Chaiyya Chaiyya\" are based on the Sufi folk song \"Thaiyya Thaiyya\" with lyrics by poet Bulleh Shah.", "Singer Sukhwinder Singh originally suggested the song to A.R. Rahman who was looking for a Punjabi devotional song to include on the soundtrack of \"Dil Se..\".", "Gulzar subsequently rewrote the lyrics and changed the name to \"Chaiyya Chaiyya\"." ], [ "Chaiyya Chaiyya", "She also said that \"...One of the unit members tripped and hurt himself.", "Other than that, things were safe.\"", "The song was featured in the opening of the second act of the musical \"Bombay Dreams\", in which the train sequence from \"Dil Se..\" is recreated on stage.", "Remixes of the song were used in the opening and closing credits of the 2006 film \"Inside Man\".", "The opening credits, set over shots of the robbery crew driving into Manhattan, feature an abridged version of the original with additional trumpet accompaniment, and the closing credits feature a hip-hop-inflected remix featuring Panjabi MC (\"Chaiyya Chaiyya Bollywood Joint\").", "The song was featured in the background in episode 13 of the American sitcom \"Outsourced\".", "The song was featured in the pilot episode of \"Smith\".", "A cover of this song was performed in episode 5 of season 5 of \"\".", "The original track and a live version of \"Chaiyya Chaiyya\" are featured in AR Rahman's compilation album, \"A. R. Rahman \u2013 A World of Music\".", "The song was used during the opening ceremony of the 2010 Commonwealth Games held at the Jawaharlal Nehru Stadium, New Delhi on 3 October 2010." ] ], "gold": "\"Chaiyya Chaiyya\" is an Indian pop-folk song, featured in the soundtrack of the Bollywood film Dil Se.., released in 1998. Remixes of the song were used in the opening and closing credits of the 2006 film Inside Man.", "prediction 1": "\"Chaiyya Chaiyya\" is an Indian song from the 1998 Hindi film \"Dil Se.\" directed by Mani Ratnam. The song was composed by A.R. Rahman, written by Gulzar, and sung by Sukhwinder Singh and Sapna Awasthi. Remixes of the song were used in the opening and closing credits of the 2006 film \"Inside Man\".", "prediction 2": "Chaiyya Chaiyya is an Indian song from the 1998 Hindi film \"Dil Se.\" directed by Mani Ratnam. The song was composed by A.R. Rahman, written by Gulzar, and sung by Sukhwinder Singh and Sapna Awasthi. It quickly became popular upon the release and its music video gained cult status, partly because it was filmed on a moving train. The song was featured in the opening of the second act of the musical \"Bombay Dreams\".", "prediction 3": "The song \"Chaiyya Chaiyya\" is from the 1998 Hindi film \"Dil Se.\" directed by Mani Ratnam. It was composed by A.R. Rahman, written by Gulzar, and sung by Sukhwinder Singh and Sapna Awasthi.", "prediction 4": "\"Chaiyya Chaiyya\" is an Indian song from the 1998 Hindi film \"Dil Se.\" directed by Mani Ratnam. The song was composed by A.R. Rahman, written by Gulzar, and sung by Sukhwinder Singh and Sapna Awasthi. The music video for the song gained cult status partly because it was filmed on a moving train.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 200 } ], "missing-info": [], "corrected-prediction": "\"Chaiyya Chaiyya\" is an Indian song from the 1998 Hindi film \"Dil Se.\" Remixes of the song were used in the opening and closing credits of the 2006 film \"Inside Man\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "The italian term for a loud volume level is?", "passages": [ [ "Dynamics (music)", "Dynamics (music)\n\n", "In music, the dynamics of a piece is the variation in loudness between notes or phrases.", "Dynamics are indicated by specific musical notation, often in some detail.", "However, dynamics markings still require interpretation by the performer depending on the musical context: for instance a \"piano\" (quiet) marking in one part of a piece might have quite different objective loudness in another piece, or even a different section of the same piece.", "The execution of dynamics also extends beyond loudness to include changes in timbre and sometimes tempo rubato.", "Dynamics are one of the expressive elements of music.", "Used effectively, dynamics help musicians sustain variety and interest in a musical performance, and communicate a particular emotional state or feeling.", "Dynamic markings are always relative.", "never indicates a precise level of loudness, it merely indicates that music in a passage so marked should be considerably quieter than .", "There are many factors affecting the interpretation of a dynamic marking.", "For instance, the middle of a musical phrase will normally be played louder than the beginning or ending, to ensure the phrase is properly shaped, even where a passage is marked throughout.", "Similarly, in multi-part music, some voices will naturally be played louder than others, for instance to emphasis the melody and the bass line, even if a whole passage is marked at one dynamic level." ], [ "Fortissimo Records", "Fortissimo Records\n\nFortissimo Records is an independent record label and promoting collective from Milton Keynes, England run by Action Beats Don McLean.", "Taking their name from the Italian musical term for \"very loud\" (see \"dynamics\"), Fortissimo was formed in 2002, arranging gigs at Bletchley Youth Club, in Milton Keynes.", "They then moved to releasing CDs and LPs by bands from the Milton Keynes area, having now 10 releases, and arranging gigs for touring bands from the UK and United States.", "In 2009 the label released the album \"Patterns\" of the Boston noise band Neptune.", "In 2010, Fortissimo has released a vinyl re-issue of Glenn Branca's 1981 album \"The Ascension\" and the first solo album \"Mate\" of former Action Beat member Peter James Taylor.", "In 2011, Fortissimo released the album 'the Last Minute' by Hired Muscle." ], [ "Music theory", "These two basic notations are modified by indications including \"mezzo piano\" (mp) for moderately soft (literally \"half soft\") and \"mezzo forte\" (mf) for moderately loud, \"sforzando\" or \"sforzato\" (sfz) for a surging or \"pushed\" attack, or \"fortepiano\" (fp) for a loud attack with a sudden decrease to a soft level.", "The full span of these markings usually range from a nearly inaudible \"pianissississimo\" (pppp) to a loud-as-possible \"fortissississimo\" (ffff).", "Greater extremes of pppppp and fffff and nuances such as p+ or \"pi\u00f9 piano\" are sometimes found.", "Other systems of indicating volume are also used in both notation and analysis: dB (decibels), numerical scales, colored or different sized notes, words in languages other than Italian, and symbols such as those for progressively increasing volume (\"crescendo\") or decreasing volume (\"decrescendo\"), often called \"hairpins\" when indicated with diverging or converging lines as shown in the graphic above.", "Articulation is the way the performer sounds notes." ] ], "gold": "Many musical terms are in Italian, because the vast majority of the most important early composers, from the Renaissance to the Baroque period, were Italian and that is the period when numerous musical indications were used extensively for the first time. The word forte is a term for a loud volume level. The term mezzo forte means \"moderately loud,\" while fortissimo means \"to be played very loudly.\" The word Crescendo is used for an increasingly loud volume level, as it translates as \"increasing\" or \"growing.\" Stentato or stentando is a musical expression used for a loud, boisterous volume level, and means \"labored, heavy, in a dragging manner, sluggish\", or \"strong and forced.\"", "prediction 1": "In Italian music, the term for a loud volume level is called \"pianissississimo.\" In Italian music, the term for a loud volume level is \"piano\". In a piece of music, the dynamics of a piece is the variation in loudness between notes or phrases. Dynamics markings still require interpretation by the performer depending on the musical context. For instance, a \"piano\" marking in one part of a piece might have quite different objective loudness in another piece, or even a different section of the same piece. Fortissimo Records a record label and promoting collective from Milton Keynes, England run by Action Beats Don McLean. Taking their name from the Italian term for \"very loud\", it merely indicates that music in a passage so marked should be considerably quieter than the passage so marked should be considerably quieter than a passage so marked.", "prediction 2": "In Italian music the term for a loud volume level is called \"pianissississimo\". The term is used to describe a loud attack or attack with a sudden decrease to a soft level. In Latin music the term for a loud volume level is \"pianississisimo.\"", "prediction 3": "In Italian music, the word for a loud volume level is piano. The word piano is a musical term used to describe a low or medium level of loudness. The term fortepiano is also used to describe a loud attack with a sudden decrease to a soft level.", "prediction 4": "In music, the dynamics of a piece is the variation in loudness between notes or phrases. Italian musical terms for very loud include pianississima, pianoissima, fortepiano, fortepiano, fortepiano, fortepiano and fortepiano. In Italian music, the term for very loud volume level is pianississimo, pianoississima, fortepiano and fortepiano.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 61, "end": 80 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 135, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 507 }, { "error type": "Irrelevant", "explanation": "", "start": 508, "end": 626 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 687, "end": 768 }, { "error type": "Redundant", "explanation": "it merely indicates that music in a passage so marked should be considerably quieter than ", "start": 774, "end": 852 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Mezzo forte\" (mf) means moderately loud. For the sound to be as loud-as-possible, it is \"fortissississimo\". For progressively increasing volume, it is \"crescendo\". Fortissimo is the Italian term for \"very loud\"." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where do they go in fault in our stars?", "passages": [ [ "The Fault in Our Stars", "Augustus is at the meeting to support Isaac, his friend who has eye cancer.", "They meet after the support group and begin to talk.", "When everything seems to be going well, Augustus pulls out a cigarette and puts it between his lips.", "Hazel is disgusted by this and yells at him saying that he's already got cancer and he wants to pay money for more cancer, Augustus explains that he does not actually light the cigarette.", "Hazel, impressed by this, goes to his house to watch a movie.", "Hazel and Augustus strike a bond immediately and agree to read each other's favorite novels.", "Augustus gives Hazel \"The Price of Dawn\", and Hazel recommends \"An Imperial Affliction\", a novel written by Peter Van Houten, who lives in Amsterdam, about a cancer-stricken girl named Anna that parallels Hazel's own experience.", "After Augustus finishes reading her book, he is frustrated upon learning that the novel ends abruptly without a conclusion.", "The novel ends in the middle of a sentence, which means she either died or became too sick to continue telling the story.", "Hazel explains the novel's author had retreated following the novel's publication and has not been heard from since." ], [ "The Fault in Our Stars", "A week later, Augustus reveals to Hazel that he has tracked down Van Houten's assistant, Lidewij, and, through her, has managed to start an e-mail correspondence with Van Houten.", "The two write to Van Houten with questions regarding the novel's ending and the fate of the mother of Anna.", "Van Houten eventually replies, explaining that he can only answer Hazel's questions in person.", "At a picnic, Augustus surprises Hazel with tickets to Amsterdam to meet Van Houten.", "While on the plane to Amsterdam, Augustus confesses his love for Hazel.", "Hazel and Augustus finally meet Van Houten but are shocked to find that he is a mean-spirited drunk.", "Horrified by Van Houten's behavior, Lidewij confesses to having arranged the meeting on his behalf, angering Van Houten, who proceeds to insult Hazel's cancer, starting an argument and causing Hazel and Augustus to flee from his home.", "Then, they go to the Anne Frank House, where Augustus and Hazel share their first kiss.", "Later that night they have sex in Augustus's hotel room, the first time for both of them.", "During their intimacy, Hazel tells Augustus she loves him.", "Augustus confesses to Hazel that his cancer has returned.", "The two affirm their love and support for one another." ], [ "The Fault in Our Stars", "The Fault in Our Stars\n\nThe Fault in Our Stars, published in January 2012, is the sixth novel by author John Green.", "The title is inspired by Act 1, Scene 2 of Shakespeare's play \"Julius Caesar\", in which the nobleman Cassius says to Brutus: \"The fault, dear Brutus, is not in our stars, /", "But in ourselves, that we are underlings.\"", "The story is narrated by Hazel Grace Lancaster, a 16-year-old girl with thyroid cancer that has affected her lungs.", "Hazel is forced by her parents to attend a support group where she subsequently meets and falls in love with 17-year-old Augustus Waters, an ex-basketball player and amputee.", "A feature film adaptation of the novel directed by Josh Boone and starring Shailene Woodley, Ansel Elgort and Nat Wolff was released on June 6, 2014.", "Both the book and its film adaptation were met with strong critical and commercial success.", "Hazel Grace Lancaster, a 16-year-old with thyroid cancer that has spread to her lungs, attends a cancer patient support group at her mother's behest.", "At one meeting, Hazel meets a 17-year-old boy currently in remission named Augustus Waters, whose Osteosarcoma caused him to lose his right leg." ] ], "gold": "In the book and the film \"The Fault in Our Stars\" The characters Hazel and Augustus meet at a cancer patient support group, where Hazel goes at the behest of her mother. Later they were able to go to Amsterdam through Make-A-Wish, and after meeting Hazel's favorite author, they visit the Anne Frank House, where they kiss. ", "prediction 1": "The Fault in Our Stars is a novel about a teenage girl with cancer who falls in love with 17-year-old Augustus Waters. The two go to Amsterdam to meet Peter Van Houten, who wrote the novel. But, they are then forced to flee from Van Houten's home and go to the Anne Frank House, where they share their first kiss. Later that night they have sex in Augustus's hotel room, the first time for both of them.", "prediction 2": "The Fault in Our Stars is a novel written by John Green, which is set in the 1930s. The story is narrated by Hazel Grace Lancaster, a 16-year-old with thyroid cancer that has affected her lungs, attending a cancer patient support group at her mother's behest. At one meeting, Hazel meets a 17-year-old boy currently in remission named Augustus Waters, whose Osteosarcoma caused him to lose his right leg.", "prediction 3": "In the novel The Fault in Our Stars, Augustus Waters goes to Amsterdam with Hazel to meet Peter Van Houten, the author of the novel. On the way, Augustus asks Hazel to take him to the Anne Frank House, where the two share their first kiss. Later that night, they have sex in Augustus's hotel room, the first time for both of them. The Fault in Our Stars is inspired by Act 1, Scene 2 of Shakespeare's play \"Julius Caesar\", in which Cassius says to Brutus: \"The fault, dear Brutus, dear Brutus, is not in our stars, / But in ourselves, that we are underlings.\"", "prediction 4": "In The Fault in Our Stars, published in January 2012, the story of Hazel Grace Lancaster, who has thyroid cancer that has affected her lungs, and Augustus Waters, who has Osteosarcoma, describes Hazel as being in a support group with other cancer patients. At one meeting, Hazel meets and falls in love with 17-year-old Augustus Waters, an ex-basketball player and amputee. The two then go to the Anne Frank House, where Augustus and Hazel share their first kiss.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 403 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Fault in Our Stars is a novel about a teenage girl named Hazel with cancer who falls in love with 17-year-old Augustus Waters, who she meets at a cancer patient support group she was forced by her parents to attend. The two go to Amsterdam to meet Peter Van Houten, who wrote Hazel's favorite novel. But, they are then forced to flee from Van Houten's home and go to the Anne Frank House, where they share their first kiss. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the largest denomination of us currency?", "passages": [ [ "Large denominations of United States currency", "In total, 11 different types of U.S. currency were issued in high-denomination notes across nearly 20 different series dates.", "The obverse of United States banknotes generally depict either historical figures, allegorical figures symbolizing significant concepts (e.g., liberty, justice), or a combination of both.", "The reverse designs range from abstract scroll-work with ornate denomination identifiers to reproductions of historical art works.", "Series 1934 gold certificates ($100, $1,000, $10,000 and $100,000) were issued after the gold standard was repealed and gold was compulsorily confiscated by order of President Franklin Roosevelt on March 9, 1933 (see United States Executive Order 6102).", "Thus the series 1934 notes were used only for intragovernmental (i.e., Federal Reserve Bank) transactions and were not issued to the public.", "This series was discontinued in 1940.", "The series 1928 gold certificate reverse was printed in black and green.", "See history of the United States dollar.", "Although they are still technically legal tender in the United States, high-denomination bills were last printed on December 27, 1945, and officially discontinued on July 14, 1969, by the Federal Reserve System, due to 'lack of use'.", "The $5,000 and $10,000 effectively disappeared well before then." ], [ "Large denominations of United States currency", "The Federal Reserve began taking high-denomination currency out of circulation (destroying large bills received by banks) in 1969.", ", only 336 $10,000 bills were known to exist; 342 remaining $5,000 bills; and 165,372 remaining $1,000 bills.", "Due to their rarity, collectors will sometimes pay considerably more than the face value of the bills to acquire them.", "Some are in museums in other parts of the world.", "For the most part, these bills were used by banks and the federal government for large financial transactions.", "This was especially true for gold certificates from 1865 to 1934.", "However, for the most part, the introduction of an electronic money system has made large-scale cash transactions obsolete.", "When combined with concerns about counterfeiting and the use of cash in unlawful activities such as the illegal drug trade and money laundering, it is unlikely that the U.S. government will reissue large denomination currency in the near future, despite the amount of inflation that has occurred since 1969 (a $100 bill is now worth less, in real terms, than a $20 bill was worth in 1969).", "According to the U.S. Department of Treasury website, \"The present denominations of our currency in production are $1, $2, $5, $10, $20, $50 and $100." ] ], "gold": "The largest denomination of US currency can be with respect to circulation, production or in the form of a gold certificate. The largest denomination of US currency in the form of a gold certificate is $100,000. The largest denomination of legal tender US currency ever in circulation is $10,000, while the largest denomination of legal tender US currency currently in production is $100.", "prediction 1": "In total, 11 different types of U.S. currency were issued in high-denomination notes across nearly 20 different series dates. The largest denomination of us currency is $100. The largest denomination of us currency is $100,000. The largest denomination of us currency is $1,250.", "prediction 2": "The largest denomination of us currency was $1,200, in 1865, and the largest denomination in 1913, in 1934. The largest denominations of US currency were $100, $1,000, $10,000, and $100,000. The largest denomination in 1913 was $1,200, and the largest in 1934 was $100. The largest in 1967 was $1,200, and the largest in 1976 was $20.", "prediction 3": "The largest currency denomination in the United States is the US dollar. It is the largest denomination of the United States, in both nominal and convertible form. The largest denomination of the US currency in convertible form is the US $100 bill. The largest denomination of the US currency in convertible form is the US $100 bill.", "prediction 4": "The largest denomination of US currency issued is $100. The largest denomination of U.S. currency issued is $100.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 125 }, { "error type": "Unverifiable", "explanation": "", "start": 228, "end": 278 }, { "error type": "Unverifiable", "explanation": "", "start": 126, "end": 174 }, { "error type": "Unverifiable", "explanation": "", "start": 175, "end": 227 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The largest denomination of US currency in the form of a gold certificate is $100,000. The largest denomination of legal tender US currency currently in production is $100. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What did ariel give up in the little mermaid?", "passages": [ [ "The Little Mermaid (1989 film)", "She sings to him, but immediately leaves just as he regains consciousness to avoid being discovered.", "Fascinated by the memory of her voice, Eric vows to find the girl who saved and sang to him, and Ariel vows to find a way to join him and his world.", "Noticing a change in Ariel's behavior, Triton questions Sebastian about her behavior and learns of her love for Eric.", "Triton confronts Ariel in her grotto, and destroys the artifacts she collected with his trident.", "After Triton leaves, two eels named Flotsam and Jetsam convince Ariel to visit Ursula the sea witch.", "Ursula makes a deal with Ariel to transform her into a human for three days in exchange for Ariel's voice, which Ursula puts in a nautilus shell.", "Within these three days, Ariel must receive the \"kiss of true love\" from Eric.", "If Ariel gets Eric to kiss her, she will remain a human permanently, otherwise, she will transform back into a mermaid and belong to Ursula.", "Ariel accepts and is then given human legs and taken to the surface by Flounder and Sebastian.", "Eric finds Ariel on the beach and takes her to his castle, unaware that she is the one who had rescued him earlier.", "Ariel spends time with Eric, and at the end of the second day, they almost kiss but are thwarted by Flotsam and Jetsam." ], [ "Ariel (The Little Mermaid)", "Ariel first appears in \"The Little Mermaid\" (1989), in which she is shown as being adventurous and curious about the world of humans, a fascination which angers both her father King Triton and his court composer Sebastian, as merfolk are not allowed to make contact with the human world.", "She and Flounder go in search of human objects, which they take to a seagull named Scuttle for appraisal.", "Ariel falls in love with a human prince named Prince Eric after saving him from drowning, and visits the sea witch, Ursula, who agrees to turn her into a human in exchange for her voice.", "Ariel must make Prince Eric fall in love with her and romantically kiss her within three days, lest she belong to Ursula forever.", "Unknown to Ariel, this agreement is part of Ursula's bigger plan to trap Ariel's father, King Triton and steal his magical trident.", "After being transformed, Ariel is naked, except for her breasts, and cannot breathe, nor swim.", "Sebastian and Flounder take her to the surface.", "She is soon found by Eric and is taken back to his castle.", "Ariel almost manages to obtain the \"kiss of true love\", but is stopped by Ursula's underhanded tactics." ] ], "gold": "In The Little Mermaid, Ariel gives up her voice to transform into a human. Ariel falls in love with a human prince named Prince Eric after saving him from drowning. Ariel then visits the sea witch, Ursula, who agrees to turn Ariel into a human in exchange for her voice. Ariel must then make Prince Eric fall in love with her and romantically kiss her within three days, or she will belong to Ursula forever.", "prediction 1": "Ariel gives up her voice in The Little Mermaid. Ursula, the sea witch, offers to transform Ariel into a human for three days in exchange for her voice. Ariel must make Prince Eric fall in love with her and romantically kiss her within three days, lest she belong to Ursula forever.", "prediction 2": "Ariel gives up her human legs after receiving the kiss of true love from Eric. Ursula, the sea witch, then turns Ariel into a human for three days in exchange for Ariel's voice. Ariel must make Prince Eric fall in love with her and romantically kiss her within three days, lest she belong to Ursula forever. Unknown to Ariel, this agreement is part of Ursula's bigger plan to trap Ariel's father, King Triton, and steal his magical trident.", "prediction 3": "Ariel gives up her voice in The Little Mermaid in exchange for a deal with Ursula the sea witch, in which she is transformed into a human for three days in exchange for Eric's kiss. After being transformed, Ariel is naked, except for her breasts, and cannot breathe, nor swim. After being transformed, Ariel is naked, except for her breasts, and cannot breathe, nor swim. But, if she can't obtain the \"kiss of true love\", she will transform back into merwoman and belong to Ursula forever. If Ariel gets Eric to kiss her, she will remain a human permanently, otherwise, she will transform back into a mermaid forever. If she gets Eric to kiss her, she will transform back into a mermaid and belong to Ursula forever.", "prediction 4": "In The Little Mermaid, Ariel gives up everything, including singing, in exchange for the voice of Eric. In the film, Ariel meets Ursula the sea witch. Ursula agrees to turn Ariel into a human for three days in exchange for Ariel's voice. Ariel must make prince Eric fall in love with her and romantically kiss her within three days, lest she belong to Ursula forever.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Ariel gives up her voice in The Little Mermaid. Ariel falls in love with a human prince named Prince Eric after saving him from drowning. Ursula, the sea witch, offers to transform Ariel into a human for three days in exchange for her voice. Ariel must make Prince Eric fall in love with her and romantically kiss her within three days, lest she belong to Ursula forever." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the tv show dallas first air?", "passages": [ [ "Dallas (2012 TV series)", "The first season premiered on June 13, 2012, and introduces the central characters of the show: John Ross Ewing III, Christopher Ewing, Elena Ramos, Rebecca Sutter, Ann Ewing, Bobby Ewing, Sue Ellen Ewing and J.R. Ewing.", "The main focus of the season 1 is the discovery of oil reserves on Southfork by John Ross and attempts by him and his father, J.R. to wrest the land from Bobby.", "Other storylines in this season include the love triangle between John Ross, Christopher and Elena, Christopher's marriage to Rebecca, Sue Ellen's plans to run for Governor of Texas and Bobby's health problems.", "Prior to \"Dallas\", Cidre was best known for producing and writing episodes of \"Cane\", an American television drama that chronicled the lives and internal power struggles of a powerful and wealthy Cuban-American family running an immensely successful rum and sugar cane business in South Florida.", "In 2010, TNT announced it would order a pilot for the continuation of the \"Dallas\" series.", "The pilot was filmed in and around the city of Dallas in early 2011.", "Production began in late August 2011 in Dallas on the remaining nine episodes in the first season order, based in studios constructed for the Fox television series \"The Good Guys\"." ], [ "Dallas (2012 TV series)", "Dallas (2012 TV series)\n\n", "Dallas is an American prime time television soap opera developed by Cynthia Cidre and produced by Warner Horizon Television, that aired on TNT from June 13, 2012 to September 22, 2014.", "The series was a revival of the prime time television soap opera of the same name that aired on CBS from 1978 to 1991.", "The series revolved around the Ewings, a wealthy Dallas family in the oil and cattle-ranching industries.", "The series brought back several stars of the original series, including Patrick Duffy as Bobby Ewing, Linda Gray as Sue Ellen Ewing, Ken Kercheval as Cliff Barnes, and Larry Hagman as J.R. Ewing.", "They were joined by the next generation of characters, including Josh Henderson as John Ross Ewing III, the son of J.R. and Sue Ellen Ewing; Jesse Metcalfe as Christopher Ewing, the adopted son of Bobby and Pamela Barnes Ewing; and Julie Gonzalo as Pamela Rebecca Barnes, the daughter of Cliff Barnes and Afton Cooper.", "The series was made for TNT, sister company to Warner Bros. Television, which has owned the original series since its purchase of Lorimar Television (the original show's production company) in 1989." ], [ "Dallas (1978 TV series)", "Dallas (1978 TV series)\n\n", "Dallas is an American prime time television soap opera that aired on CBS from April 2, 1978 to May 3, 1991.", "The series revolves around a wealthy and feuding Texas family, the Ewings, who own the independent oil company Ewing Oil and the cattle-ranching land of Southfork.", "The series originally focused on the marriage of Bobby Ewing and Pamela Barnes, whose families were sworn enemies with each other.", "As the series progressed, Bobby's older brother, oil tycoon J.R. Ewing, became the show's breakout character, whose schemes and dirty business became the show's trademark.", "When the show ended in May 1991, J.R. was the only character to have appeared in every episode.", "The show was famous for its cliffhangers, including the \"Who shot J.R.?\" mystery.", "The 1980 episode \"Who Done It\" remains the second highest rated prime-time telecast ever.", "The show also featured a \"Dream Season,\u201d in which the entirety of season 9 was revealed to have been a dream of Pam Ewing.", "After 14 seasons, the series finale \"Conundrum\" aired in 1991." ] ], "gold": "There are two version of the television show Dallas. The original series was created by David Jacobs and aired on CBS from April 2, 1978 to May 3, 1991. The revival version of Dallas, which was developed by Cynthia Cidre and produced by Warner Horizon Television, aired on TNT from June 13, 2012 to September 22, 2014. The revival brought back several stars of the original series, including Patrick Duffy as Bobby Ewing, Linda Gray as Sue Ellen Ewing, and Larry Hagman as J.R. Ewing in major roles. ", "prediction 1": "The television show Dallas first aired on April 2, 1978. The new version of the show aired on June 13, 2012, and it was a revival of the original show that aired on CBS from 1978 to 1991. The new show, Dallas: The Prime Time Soap Opera, is a revival of the popular prime time soap opera Dallas that originally aired on CBS from April 2, 1978 to May 3, 1991.", "prediction 2": "The American television show Dallas first aired on TNT on June 13, 2012 and a revival of the original Dallas aired on TNT from June 13, 2012 to September 22, 2014. It is based on the American television show Dallas, which was first aired on CBS from April 2, 1978 to May 3, 1991.", "prediction 3": "The tv show Dallas first aired on CBS on April 2, 1978. The series revolves around a wealthy and feuding Texas family called the Ewings. The show originally focused on the marriage of Bobby Ewing and Pamela Barnes, whose families were sworn enemies. Dallas is an American prime time television soap opera that aired on CBS from April 2, 1978 to May 3, 1991. The new show, Dallas: The New American Primetime Soap Opera, premiered on June 13, 2012 and ran for 14 seasons.", "prediction 4": "The television show Dallas first aired on CBS on April 2, 1978. In the 1980s and 1990s, the show was rerun on CBS. In 2012, the American prime time soap opera Dallas first aired on TNT from June 13, 2012 to September 22, 2014. In 2013, the revival of the original show Dallas aired on TNT for 14 seasons.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 188, "end": 357 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The television show Dallas aired on CBS from April 2, 1978 to May 3, 1991. The new version developed by Cynthia Cidre and produced by Warner Horizon Television, that aired on TNT from June 13, 2012 to September 22, 2014, and it was a revival of the original show that aired on CBS from 1978 to 1991. The series brought back several stars of the original series, including Patrick Duffy as Bobby Ewing, Linda Gray as Sue Ellen Ewing, Ken Kercheval as Cliff Barnes, and Larry Hagman as J.R. Ewing." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When does little league world series baseball start?", "passages": [ [ "Little League World Series", "Little League World Series\n\nThe Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old.", "Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball.", "The Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania.", "(Although the postal address of the organization is in Williamsport, the Series itself is played at Howard J. Lamade Stadium and Volunteer Stadium at the Little League headquarters complex in South Williamsport.)", "Initially, only teams from the United States competed in the Series, but it has since become a worldwide tournament.", "The tournament has gained popular renown, especially in the United States, where games from the Series and even from regional tournaments are broadcast on ESPN.", "The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years.", "Taiwan's dominance during those years has been attributed to a national effort to combat its perceived diplomatic isolation around the world.", "From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups." ], [ "2018 Little League World Series", "2018 Little League World Series\n\nThe 2018 Little League World Series was held from August 16 to August 26 at the Little League headquarters complex in South Williamsport, Pennsylvania.", "Eight teams from the United States and eight teams from around the world competed in the 72nd edition of the tournament.", "Honolulu Little League of Honolulu, Hawaii defeated South Seoul Little League of Seoul, South Korea in the championship by a 3\u20130 score.", "It was the third championship for a team from Hawaii, having won previously in and .", "Regional qualifying tournaments were held between June and August 2018.", "The draw to determine the opening round pairings took place on June 14, 2018.", "Teams that lose their first two games get to play a consolation game against a team from the other side of the bracket that also lost its first two games.", "These games are labeled Game A and Game B.", "This consolation game is played between the runner-up of the United States championship and the runner-up of the International championship.", "The Honolulu LL reached the LLWS with an undefeated record in seven games.", "In total, their record was 12\u20130.", "On September 29, 2017, Major League Baseball announced that the second MLB Little League Classic would be played on August 19, 2018, between the New York Mets and Philadelphia Phillies.", "The game was again played at BB&T Ballpark at Historic Bowman Field, with the Mets winning, 8\u20132." ], [ "2019 Little League World Series", "2019 Little League World Series\n\nThe 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania.", "Eight teams from the United States and eight teams from around the world will compete in the 73rd edition of the tournament.", "On August 19, 2018 it was announced that the third MLB Little League Classic is scheduled to be played on August 18, 2019 at BB&T Ballpark at Historic Bowman Field.", "The game will feature the Chicago Cubs and the Pittsburgh Pirates.", "The Pirates will make their second appearance in the annual game, having won the inaugural event in 2017." ] ], "gold": "The Little League World Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania. The 2021 Little League World Series starts on August 19, 2021. The 2020 Little League World Series was scheduled to begin on August 20, 2020, but it was canceled due to the COVID-19 pandemic. In prior years, the Little League World Series started on August 15, 2019, August 16, 2018, August 17, 2017, August 18, 2016 and August 21, 2015. ", "prediction 1": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. The Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania. The 2018 Little League World Series was held from August 16 to August 26 at the Little League headquarters complex in South Williamsport, Pennsylvania. The 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania. The 2019 Little League headquarters complex in South Williamsport, Pennsylvania.", "prediction 2": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. The 2018 Little League World Series was held from August 16 to August 26 at the Little League headquarters complex in South Williamsport, Pennsylvania. The 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania.", "prediction 3": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. The 2018 Little League World Series was held from August 16 to August 26 at the Little League headquarters complex in South Williamsport, Pennsylvania. The 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania. Eight teams from the United States and eight teams from around the world will compete in the 73rd edition of the tournament. The 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania.", "prediction 4": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. The Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania. The 2019 Little League World Series will be held from August 15 to August 25 at the Little League headquarters complex in South Williamsport, Pennsylvania.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 264 }, { "error type": "Irrelevant", "explanation": "", "start": 434, "end": 512 }, { "error type": "Irrelevant", "explanation": "", "start": 590, "end": 668 }, { "error type": "Irrelevant", "explanation": "", "start": 669, "end": 749 } ], "missing-info": [], "corrected-prediction": "The Little League World Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania.The 2018 Little League World Series was held from August 16 to August 26. The 2019 Little League World Series will be held from August 15 to August 25." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Tallest nba player in the league right now?", "passages": [ [ "Arvydas Sabonis", "On April 4, 2011, Sabonis was named to the Naismith Memorial Basketball Hall of Fame, and he was inducted on August 12, 2011.", "At that time, he was the tallest player to ever enter the Naismith Memorial Basketball Hall of Fame; one year later, he would be surpassed by Ralph Sampson.", "On October 24, 2011, Sabonis was voted as the next President of the Lithuanian Basketball Federation, replacing Vladas Garastas, who had led the LBF since 1991.", "He resigned from the position on October 2, 2013, but came back to it on October 10, 2013.", "Born in Kaunas, Lithuanian SSR, Soviet Union, Sabonis began playing basketball at age 13.", "By the time he was 15 years old, he was a member of the Soviet national junior team.", "Sabonis escaped conscription to the Soviet Army, by enrolling at the Lithuanian University of Agriculture, in his hometown.", "Sabonis made his professional club debut in 1981, with one of the oldest basketball teams in Lithuania, \u017dalgiris, in his hometown of Kaunas.", "With the club, he won three consecutive Soviet Premier League titles, and the 1986 FIBA Club World Cup (FIBA Intercontinental Cup).", "In 1989, Sabonis left \u017dalgiris, and signed with the Spanish Liga ACB club F\u00f3rum Valladolid." ], [ "Edy Tavares", "On February 6, 2017, he was named in the Eastern Conference All-Star team for the 2017 NBA D-League All-Star Game.", "At the season's end, he was named the recipient of the NBA Development League Defensive Player of the Year Award.", "On April 12, 2017, Tavares signed with the Cleveland Cavaliers.", "He made his debut for the Cavaliers that night, recording 10 rebounds and 6 blocks in a 99\u201383 loss to the Toronto Raptors.", "Tavares did not play at all in the 2017 playoffs due to a hand injury.", "On October 11, 2017, Tavares was waived by the Cavaliers.", "Shortly after getting waived by the Cavaliers, Tavares returned to Raptors 905, ultimately playing only one regular season game for them, scoring 13 points, with 10 rebounds and 3 blocks vs. the Grand Rapids Drive on November 5, 2017.", "On November 10, 2017, Tavares signed with Real Madrid until the end of the 2019\u201320 season.", "In May 2018, Real Madrid won the 2017\u201318 EuroLeague championship, after defeating Fenerbah\u00e7e Do\u011fu\u015f in the final game with 85\u201380.", "Over 17 EuroLeague games", ", Tavares averaged 6.5 points, 5.3 rebounds and 1.5 blocks per game." ] ], "gold": "Through 2019, twenty-six players have been listed at 7 feet 3 inches or taller. Kristaps Porzi\u0146\u0123is is one of three active this season. Tibor Plei\u00df is on the list and was active from 2015 to 2016. From 2015 to 2017, Edy Tavares was also on the active list of the tallest players in the NBA, until he signed with Real Madrid.", "prediction 1": "In 2019, Edy Tavares is the tallest player in the NBA. In 2019, he is the tallest player in the NBA Development League.", "prediction 2": "Arvydas Sabonis is the tallest player in the NBA. At 6'1\", 188 cm, and 183 inches, he is the tallest player in the NBA. He is the third tallest player in the NBA at 6'7\".", "prediction 3": "The NBA has a number of players that are the tallest players in the league. Arvydas Sabonis is the tallest player in the NBA. He is the tallest player in the NBA Development League. Edy Tavares is the tallest player in the NBA.", "prediction 4": "The NBA currently has two players who are the tallest in the league. Arvydas Sabonis and Edy Tavares are the tallest currently in the league. Sabonis was the tallest player to enter the Naismith Memorial Basketball Hall of Fame in 2011. Sampson was the tallest currently in the NBA.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 54 }, { "error type": "Redundant", "explanation": "In 2019, Edy Tavares is the tallest player in the NBA. ", "start": 55, "end": 119 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who is the voice of calcifer in howl's moving castle?", "passages": [ [ "Works of Hayao Miyazaki", "Works of Hayao Miyazaki\n\nThe following is a list of works by Japanese filmmaker and artist Hayao Miyazaki, divided into the categories of his early works, manga works, and filmography.", "Some of his most widely known works are his animated films created during his time with Studio Ghibli, including \"My Neighbor Totoro\" (1988), \"Princess Mononoke\" (1997), \"Spirited Away\" (2001), \"Howl's Moving Castle\" (2004), \"Ponyo\" (2008), and \"The Wind Rises\" (2013).", "The following list contains Hayao Miyazaki's works, both major and minor, since his debut as manga artist:" ], [ "Howl's Moving Castle (film)", "The soundtrack CD was first released on 19 November 2004 by Tokuma Japan Communications.", "Hisaishi also composed and conducted a \"Howl's Moving Castle: Symphony Suite\", an album published on 21 January 2004 which includes ten re-arranged pieces from the original soundtrack.", "He and Youmi Kimura also composed \"Howl's Moving Castle CD Maxi-Single\", a CD single published on 27 October 2004 which includes the film's theme song, sung by Chieko Baisho (the Japanese voice actor for Sophie), its karaoke version, and a piano version of the film's main theme, \"The Merry-Go-Round of Life\".", "The film opened at the 61st Venice Film Festival in 2004, and was released in Japan on 20 November 2004.", "The film grossed $14.5 million in its first week of release in Japan alone.", "The film was distributed in Japan by Toho, and made $190,000,000 in that country.", "It was distributed internationally by various companies, and made approximately an additional $45,000,000 outside Japan, for a worldwide total of $235,184,110.", "The film was later dubbed into English by Pixar's Pete Docter.", "It was distributed in the United States by Buena Vista, a subsidiary of Disney.", "It was released on DVD on 10 March 2006." ], [ "Howl's Moving Castle (film)", "\"Howl's Moving Castle\" had its world premiere at the Venice Film Festival on 5 September 2004, and was theatrically released in Japan on 20 November 2004.", "It went on to gross $190 million in Japan and $235 million worldwide, making it one of the most financially successful Japanese films in history.", "The film received critical acclaim, particularly for its visuals and Miyazaki's treatment of its themes.", "It was nominated for the Academy Award for Best Animated Feature at the 78th Academy Awards, but lost to \"\", in 2006, and won several other awards, including four Tokyo Anime Awards and a Nebula Award for Best Script.", "Sophie, a young milliner, encounters a wizard named Howl on her way to visit her sister Lettie.", "Upon returning home, she meets the Witch of the Waste, who transforms her into a ninety-year-old woman.", "Seeking to break the curse, Sophie leaves home and sets off through the countryside.", "She meets a living scarecrow, whom she calls \"Turnip Head\".", "He leads her to Howl's moving castle, where she meets Howl's young apprentice Markl, and the fire-demon Calcifer, who is the source of the castle's magic.", "When Howl appears, Sophie announces that she has hired herself as a cleaning lady." ] ], "gold": "Howl's Moving Castle is a 2004 Japanese animated fantasy film that was dubbed into English. Calcifer, a fire demon, was voiced in the original Japanese version by Tatsuya Gashuin. In the dubbed version, Billy Crystal voiced the character.", "prediction 1": "The fire-demon Calcifer is voiced by Chieko Baisho in the Japanese version of Howl's Moving Castle. The American voice of Calcifer is voiced by Jason Alexander. The Japanese voice of Calcifer is voiced by Yuichiro Taniguchi. In the English version, Calcifer is voiced by Michael Caine.", "prediction 2": "In the Japanese version of Howl's Moving Castle, Calcifer is voiced by Chieko Baisho. Calcifer is also the name of the fire-demon in the film. Calcifer was originally sung by Chieko Baisho in the original movie.", "prediction 3": "Calcifer is the name of the fire-demon in the film Howl's Moving Castle. He is voiced by Chieko Baisho.", "prediction 4": "In Howl's Moving Castle, the fire-demon Calcifer is voiced by Chieko Baisho, while the fire-demon Howl is voiced by Markl. The fire-demon Calcifer is voiced by Akira Nagase, the Japanese voice of Calcifer.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 100, "end": 160 }, { "error type": "Unverifiable", "explanation": "", "start": 161, "end": 224 }, { "error type": "Unverifiable", "explanation": "", "start": 225, "end": 285 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 99 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Howl's Moving Castle is a 2004 Japanese animated fantasy film that was dubbed into English. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Is red bell pepper a fruit or vegetable?", "passages": [ [ "Bell pepper", "Canadian English uses both \"bell pepper\" and \"pepper\" interchangeably.", "In some languages, the term \"paprika\", which has its roots in the word for pepper, is used for both the spice and the fruit \u2013 sometimes referred to by their colour (e.g., \"groene paprika\", \"gele paprika\", in Dutch, which are green and yellow, respectively).", "The bell pepper is called \"\u30d1\u30d7\u30ea\u30ab\" (\"papurika\") or \"\u30d4\u30fc\u30de\u30f3\" (\"piiman\", from Portuguese \"piment\u00e3o\") in Japan.", "In Switzerland, the fruit is mostly called \"peperone\", which is the Italian name of the fruit.", "In France, it is called \"poivron\", with the same root as \"poivre\" (meaning \"pepper\") or \"piment\".", "In Spain it is called \"pimiento\", which would be the masculine form of the traditional spice, \"pimienta\"." ], [ "Bell pepper", "Bell pepper\n\nThe bell pepper (also known as sweet pepper, pepper or capsicum ) is a cultivar group of the species \"Capsicum annuum\".", "Cultivars of the plant produce fruits in different colours, including red, yellow, orange, green, white, and purple.", "Bell peppers are sometimes grouped with less pungent pepper varieties as \"sweet peppers\".", "Peppers are native to Mexico, Central America, and northern South America.", "Pepper seeds were imported to Spain in 1493, and from there, spread to Europe and Asia.", "The mild bell pepper cultivar was developed in 1920s, in Szeged, Hungary.", "Preferred growing conditions for bell peppers include warm, moist soil in a temperate range of .", "The misleading name \"pepper\" was given by Europeans when Christopher Columbus brought the plant back to Europe.", "At that time, black pepper (peppercorns), from the unrelated plant \"Piper nigrum\" originating from India, was a highly prized condiment; the name \"pepper\" was at that time applied in Europe to all known spices with a hot and pungent taste and was therefore naturally extended to the newly discovered genus \"Capsicum\".", "The most commonly used alternative name of the plant family, \"chile\", is of Mexican origin, from the Nahuatl word \"chilli\"." ], [ "Tomato", "The word's dual pronunciations were immortalized in Ira and George Gershwin's 1937 song \"Let's Call the Whole Thing Off\" (\"You like", "and I like / You like", "and I like \") and have become a symbol for nitpicking pronunciation disputes.", "In this capacity, it has even become an American and British slang term: saying \"\" when presented with two choices can mean \"What's the difference?\" or \"It's all the same to me\".", "Botanically, a tomato is a fruit\u2014a berry, consisting of the ovary, together with its seeds, of a flowering plant.", "However, the tomato is considered a \"culinary vegetable\" because it has a much lower sugar content than culinary fruits; it is typically served as part of a salad or main course of a meal, rather than as a dessert.", "Tomatoes are not the only food source with this ambiguity; bell peppers, cucumbers, green beans, eggplants, avocados, and squashes of all kinds (such as zucchini and pumpkins) are all botanically fruit, yet cooked as vegetables.", "This has led to legal dispute in the United States.", "In 1887, U.S. tariff laws that imposed a duty on vegetables, but not on fruit, caused the tomato's status to become a matter of legal importance." ] ], "gold": "Red bell peppers are botanical fruits but culinary vegetables. The bell pepper is the fruit of plants in the Grossum cultivar group of the species Capsicum annuum. In the culinary world, a red bell pepper is commonly used as a vegetable ingredient or a vegetable side dish. For example, pieces of bell pepper are commonly used in garden salads.", "prediction 1": "The red bell pepper is a fruit and a vegetable. Botanically, a tomato is a fruit\u2014a berry, consisting of the ovary, together with its seeds, of a flowering plant. However, the tomato is considered a \"culinary vegetable\" because it has a much lower sugar content than culinary fruits. This has led to a legal dispute in the United States.", "prediction 2": "The red bell pepper, also known as sweet pepper, pepper or capsicum, is a cultivar group of the species Capsicum annuum. Cultivars of the plant produce fruits in different colours, including red, yellow, orange, green, white, and purple. However, the tomato is considered a \"culinary vegetable\" because it has a much lower sugar content than culinary fruits.", "prediction 3": "The red bell pepper (also known as sweet pepper, pepper or capsicum ) is a cultivar group of the species capsicum annuum. Cultivars of the plant produce fruits in different colours, including red, yellow, orange, green, white, and purple. Bell peppers are sometimes grouped with less pungent pepper varieties as \"sweet peppers\". Botanically, a tomato is a fruit, consisting of the ovary, together with its seeds, of a flowering plant. However, the tomato is considered a \"culinary vegetable\" because it has a much lower sugar content than culinary fruits; it is typically served as part of a salad or main course of a meal, rather than as dessert.", "prediction 4": "The red bell pepper, also known as sweet pepper, pepper or capsicum, is a cultivar group of the species Capsicum annuum, which produces fruits in different colours, including red, yellow, orange, green, white, and purple. Depending on the cultivar, the bell pepper can be a berry, a berry, or a vegetable. The fruit of a red bell pepper can be either a berry or a vegetable.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 336 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Red bell peppers are botanical fruits but culinary vegetables. Bell pepper is a cultivar group of the species \"Capsicum annuum\"." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When does melinda tell sam she's jim?", "passages": [ [ "Ghost Whisperer (season 4)", "Melinda says goodbye to her close friend Rick Payne, who leaves Grandview on a research trip for the university.", "In this season, Jim is shot and killed.", "He does not \"cross over\" because he does not want to leave Melinda, and his spirit later enters the body of a man named Sam Lucas, who died in an unrelated accident in Grandview and crossed over.", "When Jim/Sam regains consciousness, he has no memory of being Jim.", "Melinda works to get him to remember his past life and her, and succeeds after much difficulty and skepticism on the part of her friends.", "They soon discover that Melinda is pregnant and that the date of conception was right before Jim died.", "At the end of the season, Ned and Eli find the Book of Changes, a book written by the Watchers (a benevolent group of ghosts who keep watch over the living).", "The book tells them of past and future prominent dates, such as Andrea and Jim's deaths.", "One date is listed as September 25, 2009; Melinda's due date.", "Melinda learns from a Watcher named Carl that her child is destined to not only inherit her gift, but be far more powerful than her.", "Melinda and Jim decide to remarry and have a small ceremony on a snowy night, on the street where they first met." ] ], "gold": "In episode 79, Delusions of Grandview, Melinda tells Sam he's Jim. In season 4 of Ghost Whisperer, Jim is shot and killed. He does not cross over because he does not want to leave Melinda. Jim's spirit later enters the body of a man named Sam Lucas. When Jim/Sam regains consciousness, he has no memory of being Jim. Melinda then works to get him to remember his past life and her. ", "prediction 1": "In this season, Jim is shot and killed. His spirit later enters the body of a man named Sam Lucas, who died in an unrelated accident in Grandview and crossed over. When Jim/Sam regains consciousness, he has no memory of being Jim. Melinda works to get him to remember his past life and her, and succeeds after much difficulty and skepticism on the part of her friends. They soon discover that Melinda is pregnant and that the date of conception was right before Jim died.\n", "prediction 2": "In the second season, Jim dies and his spirit enters the body of Sam Lucas, a man who died in an unrelated accident in Grandview and crossed over. Sam was Jim's younger sister from an earlier life.", "prediction 3": "In this season, Jim is shot and killed, and his spirit later enters the body of a man named Sam Lucas, who died in an unrelated accident in Grandview and crossed over. When Jim/Sam regains consciousness, he has no memory of being Jim. Melinda works to get him to remember his past life and her, and succeeds after much difficulty and skepticism on the part of her friends. They soon discover that Melinda is pregnant and that the date of conception was right before Jim died. Ned and Eli find the Book of Changes, a book written by the Watchers. The book tells them of past and future prominent dates. One date is listed as April 27, 2009, which was Melinda's due date in season 4.", "prediction 4": "When Melinda finds out her former boyfriend Sam is Jim, she tries to get his memory of who he was to change his mind. The date that Melinda tells Sam she is Jim is September 25, 2009, the day before Jim died.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 472 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 0 ] } ], "corrected-prediction": "In season 4, Jim is shot and killed. His spirit later enters the body of a man named Sam Lucas. When Jim/Sam regains consciousness, he has no memory of being Jim. Melinda works to get him to remember his past life and her." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who played in last years half time show?", "passages": [ [ "Super Bowl counterprogramming", "The NFL has continued to stay true to its goal of ensuring that the halftime show is as much of a spectacle as the game itself, which has complimented the absolute dominance of the Super Bowl in television viewership.", "Besides a string of halftime shows from 2006 to 2011 that featured veteran rock acts in the wake of the Super Bowl XXXVIII \"wardrobe malfunction\", the practice of inviting pop acts to perform at the Super Bowl halftime show has continued.", "The Super Bowl XLIX halftime show featuring Katy Perry was seen by 118.5 million viewers, as part of an overall telecast that was the most-watched television broadcast in American history.", "As all four major U.S. television networks currently have ties to the NFL and broadcast its games (CBS, Fox, and NBC alternate airing the Super Bowl yearly and air regular season games, and ABC's parent company owns ESPN, which broadcasts \"Monday Night Football\" during the regular season, and has simulcast its Wild Card playoff game on ABC since 2016), Phil Rosenthal of the \"Chicago Tribune\" believed that there was now \"zero likelihood some broadcast network is going to launch a broadside against the NFL's showcase.", "\", while a \"GQ\" writer argued that the practice was now obsolete, due to the larger number of media options that have emerged since." ], [ "Jingle Bell Ball", "Jingle Bell Ball\n\nThe Jingle Bell Ball is a concert held every year in December, by the radio station Capital FM at The O2 Arena.", "Artists that have headlined the ball are Justin Bieber, Taylor Swift, Ed Sheeran, Sam Smith, Rihanna, The Black Eyed Peas, Bruno Mars, Coldplay, Little Mix, Katy Perry, Kylie Minogue, Lady Gaga, Take That, Janet Jackson, Ellie Goulding and P!nk.", "Other notable acts who have performed at the Ball include, One Direction, Cheryl, Halsey, Miley Cyrus, Charlie Puth, Dua Lipa, David Guetta, Liam Payne, Shawn Mendes, Major Lazer, Jason Derulo, The Chainsmokers, Shakira, 5 Seconds of Summer, OneRepublic, Calvin Harris and Niall Horan.", "It is claimed that a portion of ticket sales profit is donated to Global's Make Some Noise, Capital's flagship charity, formerly known as Help a Capital Child and Help a London Child.", "It was held over one night \u2013 6 December.", "David Smyth of the Evening Standard rated it three stars, saying it was \"too quick to be boring but too superficial to stick in the mind\".", "The 2009 event was held over two nights.", "Capital's Jingle Bell Ball 2010 was again held over two nights." ] ], "gold": "Halftime shows are a tradition during American football games at all levels of competition. Katy Perry was the headliner for the Halftime Show at Super Bowl XLIX, with Lenny Kravitz, Missy Elliott, and the Arizona State University Sun Devil Marching Band as guest performers. Lady Gaga played the Halftime Show for Super Bowl LI. The headliner for the Super Bowl 50's Halftime Show was Coldplay, with Beyonc\u00e9, Bruno Mars, Mark Ronson, Gustavo Dudamel, and the University of California Marching Band and Youth Orchestra L.A. as guest performers.", "prediction 1": "The halftime show for the Super Bowl is a spectacle, and has been viewed by more than 118.5 million viewers. Katy Perry performed in the 2016 halftime show. Katy Perry performed in the 2017 halftime show.\n", "prediction 2": "There are several halftime shows for the Super Bowl. In 2014, Coldplay, Katy Perry, and One Direction performed. In 2017, Coldplay performed. In 2018, Theresa May performed.", "prediction 3": "The halftime show for the Super Bowl is a spectacle as much of a spectacle as the game itself. Throughout the years, various artists have played in the halftime show. On December 6, 2010 the halftime show featured Katy Perry, Lady Gaga, Take That, Janet Jackson, Ellie Goulding, P!nk, Bachelor in Paradise, Black Eyed Peas, Drake, Old Dominion, Elton John, Bret Michaels, Drake, Madonna, Anastacia, One Direction, Cheryl, Harry Styles, David Guetta, Liam Payne, Gavin Davis, The Chainsmokers, Shakira, The Wild, Jurissmoak, Bradent, Austin Till My Heart \u2013 Super Bowl \u2013 Bryant, Katy Perry and Thomas Austin, London.", "prediction 4": "In 2011, Katy Perry performed at the Super Bowl halftime show, while Lady Gaga performed last year's halftime show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 108 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 137, "end": 141 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 185, "end": 189 }, { "error type": "Redundant", "explanation": "halftime show", "start": 190, "end": 205 }, { "error type": "Redundant", "explanation": "Katy Perry performed in the ", "start": 157, "end": 184 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The halftime show for the Super Bowl is a spectacle. The practice of inviting pop acts to perform at the Super Bowl halftime show has continued. Katy Perry performed in The Super Bowl XLIX halftime show.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who smokes the hookah in alice in wonderland?", "passages": [ [ "Caterpillar (Alice's Adventures in Wonderland)", "Alan Rickman voices the Caterpillar, who in this adaptation is named Absolem.", "Rickman was filmed while recording his voice in a studio, but his face was not composited onto the character's face as originally planned.", "He appears five times in the movie.", "The first time is outside Wonderland, when a young man named Hamish Ascot is about to propose to Alice and she notices a blue caterpillar on his shoulder.", "The second time is when Nivens McTwisp the White Rabbit, Tweedledum and Tweedledee, Mallymkun the Dormouse, and the Uilleam the Dodo consider Alice's identity, and they consult him.", "Absolem appears in a thick cloud of hookah smoke, which he blows at Alice.", "He appears again after Alice arrives at the White Queen's Castle, and again to remind Alice of her previous visit to Wonderland.", "He blows smoke at her twice this time, and Alice asks him to stop it.", "At the end of the movie, Absolem, as a butterfly, appears on Alice's shoulder as she sets off for China.", "Rickman reprises the role in \"Alice Through the Looking Glass\" (2016), though he remains a butterfly, leading Alice to the looking-glass portal to Underland and informing her that matters require her urgent attention." ], [ "Caterpillar (Alice's Adventures in Wonderland)", "Caterpillar (Alice's Adventures in Wonderland)\n\nThe Caterpillar (also known as the Hookah-Smoking Caterpillar) is a fictional character appearing in Lewis Carroll's book \"Alice's Adventures in Wonderland\".", "Introduced in Chapter Four (\"Rabbit Sends in a Little Bill\") and the main center of interest of Chapter V (\"Advice from a Caterpillar\"), the Caterpillar is a hookah-smoking caterpillar exactly three inches high (a height, the virtues of which, he defends against Alice's complaint).", "Alice does not like the Caterpillar when they first meet, because he does not immediately talk to her and when he does, it is usually in short, rather rude sentences, or difficult questions.", "The original illustration by John Tenniel is something of a visual paradox, wherein the caterpillar's human face appears to be formed from the head and legs of a naturalistic caterpillar.", "The Caterpillar makes an appearance in a few other places outside \"Alice's Adventures in Wonderland\", such as \"American McGee's Alice\" and the novel \"The Looking-Glass Wars\"; in both of these spin-offs he plays the role of an oracle.", "His memorable phrase is a breathy \"Whooo\u00a0... are\u00a0..." ], [ "Alice in Wonderland (franchise)", "Alice in Wonderland (franchise)\n\nAlice in Wonderland is a Disney media franchise, commencing in 1951 with the theatrical release of the animated film \"Alice in Wonderland\".", "The film is an adaptation of the books by Lewis Carroll, which featured his character Alice.", "A live-action film directed by Tim Burton was released in 2010.", "\"Alice in Wonderland\" is a 1951 British-American animated fantasy comedy-adventure film produced by Walt Disney Productions and based primarily on Lewis Carroll's \"Alice's Adventures in Wonderland\" with several additional elements from his sequel, \"Through the Looking-Glass\".", "The 13th Disney animated feature film, it was released in New York City and London on July 26, 1951, and features the voices of Kathryn Beaumont (who later voiced Wendy Darling in the 1953 film \"Peter Pan\") as Alice, and Ed Wynn as the Mad Hatter.", "The theme song, \"Alice in Wonderland\", has since become a jazz standard.", "\"Alice in Wonderland\" is a 2010 American fantasy film directed by Tim Burton and written by Linda Woolverton.", "Released by Walt Disney Pictures, the film stars Mia Wasikowska as Alice Kingsleigh, Johnny Depp, Anne Hathaway and Helena Bonham Carter.", "The film was shot in the United Kingdom and the United States." ] ], "gold": "In Lewis Carroll's 1865 book Alice's Adventures in Wonderland, the Caterpillar is the character who smokes the hookah. In 1951, Walt Disney Productions released Alice in Wonderland, an animated musical fantasy film that is based on the Alice books by Lewis Carroll. In this film, the Caterpillar is voiced by Richard Haydn and is a blue creature who, as in the original Carroll story, smokes a hookah. In 2010, Tim Burton directed Alice in Wonderland, a live-action, animated dark fantasy adventure film that is loosely based on Carroll's Alice novels and Disney's 1951 Alice In Wonderland film. In Burton's film, Alan Rickman voices the Caterpillar, who, in this adaptation, is named Absolem.", "prediction 1": "The Hookah-Smoking Caterpillar in Alice in Wonderland is a caterpillar. The Caterpillar, also known as the Hookah-Smoking Caterpillar, is a fictional character appearing in Lewis Carroll's book Alice's Adventures in Wonderland. The live-action film adaptation was released in 2010 and is directed by Tim Burton.", "prediction 2": "The Hookah-Smoking Caterpillar is a fictional character in Lewis Carroll's book Alice's Adventures in Wonderland. The Caterpillar, also known as the Hookah-Smoking Caterpillar, smokes the hookah at Alice. Alan Rickman voices the Caterpillar in the 2011 film version of Alice in Wonderland.", "prediction 3": "The Hookah smoking Caterpillar is a fictional character appearing in Lewis Carroll's book Alice's Adventures in Wonderland. The Caterpillar is a hookah-smoking caterpillar that smokes the hookah at Alice. A live-action film adaptation of the 1951 film was released in 2010. Alan Rickman voices the Caterpillar, who in this adaptation is named Absolem.", "prediction 4": "In the 1951 animated film Alice in Wonderland, the Hookah-Smoking Caterpillar is portrayed by Kathryn Beaumont as Alice, and Johnny Depp as the Mad Hatter. In the 2010 live-action version of the film, the Hookah-Smoking Caterpillar is voiced by Alan Rickman.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Hookah-Smoking Caterpillar in Alice in Wonderland is a caterpillar. ", "start": 72, "end": 134 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Caterpillar, also known as the Hookah-Smoking Caterpillar, is a fictional character appearing in Lewis Carroll's book Alice's Adventures in Wonderland. In 1951, Walt Disney Productions released Alice in Wonderland, an animated musical fantasy film that is based on the Alice books by Lewis Carroll. The live-action film adaptation was released in 2010 and is directed by Tim Burton. Alan Rickman voices the Caterpillar, who in this adaptation is named Absolem." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who played edmond dantes in the count of monte cristo?", "passages": [ [ "The Count of Monte Cristo (2002 film)", "The Count of Monte Cristo (2002 film)\n\nThe Count of Monte Cristo is a 2002 adventure drama film produced by Roger Birnbaum, Gary Barber, and Jonathan Glickman that was directed by Kevin Reynolds.", "An international co-production between the United States, the United Kingdom, and Ireland, the film is an adaptation of the book of the same name by Alexandre Dumas, p\u00e8re and stars Jim Caviezel, Guy Pearce, and Richard Harris.", "It follows the general plot of the novel (the main storyline of imprisonment and revenge is preserved); but many aspects, including the relationships between major characters and the ending, have been changed, simplified, or removed; and action scenes have been added.", "The film met with modest box office success.", "In 1815, Edmond Dant\u00e8s, Second Mate of a French merchant vessel, and his friend Fernand Mondego, representative of the shipping company, seek medical help at Elba for their ailing captain.", "Napoleon Bonaparte, having kept his guardians from killing the pair, exchanges his physician\u2019s services with Edmond for the delivery of a letter.", "Edmond is sworn to its secrecy, but the exchange is witnessed by Fernand." ], [ "Edmond Dant\u00e8s", "Edmond Dant\u00e8s\n\nEdmond Dant\u00e8s () is a title character and the protagonist of Alexandre Dumas, p\u00e8re's 1844 adventure novel \"The Count of Monte Cristo\".", "Within the story's narrative, Dant\u00e8s is an intelligent, honest, and loving man who turns bitter and vengeful after he is framed for a crime he did not commit.", "When Dant\u00e8s finds himself free and enormously wealthy, he takes it upon himself to reward those who have helped him in his plight and punish those responsible for his years of suffering.", "He is known by the aliases The Count of Monte Cristo (), Sinbad the Sailor (\"Sinbad le Marin\"), Abb\u00e9 Busoni, and Lord Wilmore.", "When the reader is first introduced to Edmond Dant\u00e8s, he arrives in Marseille as first mate aboard the merchant ship \"Le Pharaon\" (The Pharaoh).", "At only 19 years old, the young Dant\u00e8s seems destined for success.", "Although the trip was successful, the former Captain, Lecl\u00e8re, has fallen ill and died.", "Dant\u00e8s relays these events to his patron, M. Morrel, who tells Dant\u00e8s that he will try to have him named captain.", "Dant\u00e8s rushes off to see his father and then his beloved, the young Catalan woman Merc\u00e9d\u00e8s, and the two agree to be married immediately.", "The marriage never occurs, however." ], [ "John Gilbert (actor)", "John Gilbert (actor)\n\nJohn Gilbert (born John Cecil Pringle; July 10, 1897 \u2013 January 9, 1936) was an American actor, screenwriter and director.", "He rose to fame during the silent film era and became a popular leading man known as \"The Great Lover\".", "At the height of his career, Gilbert rivaled Rudolph Valentino, another silent film era leading man, as a box office draw.", "Gilbert's popularity began to wane when silent pictures gave way to talkies.", "Though Gilbert was often cited as one of the high-profile examples of an actor who was unsuccessful in making the transition to talkies, his decline as a star had far more to do with studio politics and money than with the sound of his screen voice, which was rich and distinctive.", "Born John Cecil Pringle in Logan, Utah, to stock-company actor parents, John Pringle (1865\u20131929) and Ida Apperly Gilbert (1877\u20131913), he struggled through a childhood of abuse and neglect.", "His family moved frequently and Gilbert attended several schools throughout the United States.", "After his family settled in California, he attended Hitchcock Military Academy in San Rafael, California.", "After he left school Gilbert worked as a rubber goods salesman in San Francisco, then as a stage manager in stock company in Spokane, Washington in 1915.", "He lost his job when the company folded." ] ], "gold": "Edmond Dant\u00e8s is a title character and the protagonist of Alexandre Dumas's 1844 adventure novel, The Count of Monte Cristo, who has been played by many actors in many different versions of film and television. John Cecil Pringle, known professionally as John Gilbert, played the character in the 1922 version of the film. Robert Donat took on the role in 1934, Jean Marais in 1954, and Richard Chamberlain in 1975. There was also a TV series in 1956 which starred George Dolenz as Dant\u00e8s, and, most recently, Jim Caviezel portrayed the character in the 2002 film.", "prediction 1": "The Count of Monte Cristo is a 2002 adventure drama film produced by Roger Birnbaum, Gary Barber, and Jonathan Glickman that was directed by Kevin Reynolds. Jim Caviezel plays Edmond Dant\u00e8s in the film, as well as English actor Guy Pearce as Fernand Mondego. American actor John Gilbert plays Edmond Dant\u00e8s.", "prediction 2": "The Count of Monte Cristo is a 2002 adventure drama film that is an adaptation of Alexandre Dumas, p\u00e8re's 1844 adventure novel. The role of Edmond Dant\u00e8s is played by Jim Caviezel, Guy Pearce, and Richard Harris. Various actors played the character, including American actor, screenwriter, and director, John Gilbert.", "prediction 3": "In the 1844 novel The Count of Monte Cristo, the protagonist, Edmond Dant\u00e8s, is played by Jim Caviezel and Guy Pearce. American actor, screenwriter and director John Gilbert played Ted Dant\u00e8s.", "prediction 4": "The Count of Monte Cristo is a 2002 adventure drama film produced by Roger Birnbaum, Gary Barber, and Jonathan Glickman that was directed by Kevin Reynolds. Jim Caviezel plays Edmond Dant\u00e8s, Second Mate of a French merchant vessel, and his friend Fernand Mondego represents the shipping company. In the original 1844 novel, Dant\u00e8s is an intelligent, honest, and loving man who turns bitter and vengeful after he is framed for a crime he did not commit.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 259, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 156 }, { "error type": "Unverifiable", "explanation": "", "start": 157, "end": 258 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Edmond Dant\u00e8s is a title character and the protagonist of Alexandre Dumas's 1844 adventure novel, The Count of Monte Cristo. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who won the most world cup in cricket?", "passages": [ [ "Cricket World Cup", "India volunteered to host the third Cricket World Cup, but most ICC members preferred England as the longer period of daylight in England in June meant that a match could be completed in one day.", "The 1987 Cricket World Cup was held in India and Pakistan, the first hosted outside England.", "Many of the tournaments have been jointly hosted by nations from the same geographical region, such as South Asia in 1987, 1996 and 2011, Australasia in 1992 and 2015, Southern Africa in 2003 and West Indies in 2007.", "Twenty nations have qualified for the Cricket World Cup at least once.", "Seven teams have competed in every tournament, five of which have won the title.", "The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once.", "The West Indies (1975 and 1979) and Australia (1999, 2003 and 2007) are the only teams to have won consecutive titles.", "Australia has played in seven of the eleven finals (1975, 1987, 1996, 1999, 2003, 2007, 2015).", "England has yet to win the World Cup, but has been runners-up three times (1979, 1987, 1992)." ], [ "2003 Cricket World Cup statistics", "2003 Cricket World Cup statistics\n\n2003 Cricket World Cup statistics lists all the major statistics and records for the 2003 Cricket World Cup held in South Africa, Zimbabwe and Kenya from 9 February to 24 March 2003.", "Talha Jubair became the youngest player to participate in Cricket World Cup.", "Sri Lanka's clinical demolition of Canada for 36 runs created a new World Cup record for the lowest innings score, a dubious distinction that was, at the time, the lowest score in ODI history.", "Records tumbled when defending champions Australia took on minnows Namibia, with Glenn McGrath claiming the World Cup's best bowling figures (7/15), a performance that helped Australia defeat Namibia by 256 runs.", "Team-mate Adam Gilchrist created a new wicket-keeping dismissal record in the same match, with 6.", "Against Namibia, Indian players Sachin Tendulkar and Sourav Ganguly recorded the second highest partnership in World Cup cricket (244 runs).", "India and Australia clashed in a one-sided battle in the final, with Australia creating multiple records (highest World Cup final score, highest score by a captain in a World Cup final \u2013 Ricky Ponting, most number of sixes by a batsman \u2013 Ponting) in a match; with Australia winning by 125 runs." ] ], "gold": "Twenty nations have qualified for the Cricket World Cup at least once. Seven teams have competed in every tournament, six of which have won the title. Australia has won the most, with five. Adam Gilchrist, Glenn McGrath and Ricky Ponting share the individual record of three World Cup titles each.", "prediction 1": "The West Indies have won the most Cricket World Cups in history, with three titles in each of the last seven tournaments. Australians have won the most World Cups in history, with five titles, while Sri Lanka has won two. Australia has played in seven of the eleven finals and has won consecutive titles. The record for most World Cup partnerships in cricket is 244 runs.", "prediction 2": "The West Indies won the first two tournaments, Australia has won five, India has won two, while Pakistan and Sri Lanka have each won once. The team that has won the most World Cups in cricket is Australia. The West Indies have won the most World Cups in cricket in the last 25 years. In the past, the West Indies have won the most Cricket World Cups in the last 25 years.", "prediction 3": "The most world cup in cricket has been won by five different nations, with Australia having won the most consecutive titles in the past. The West Indies have won the first two Cricket World Cups, Australia has won five, India has won two and Pakistan and Sri Lanka have each won once. Australia have also won the most World Cup games played, and have won the most consecutive matches played.", "prediction 4": "The West Indies have won the most World Cups in cricket in the history of the tournament. Hence, if Australia and India win the same Cricket World Cup, they are the two teams with the most consecutive titles won in each tournament. Hence, the most consecutive titles won by Australia are in 1979 and 1987.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 29, "end": 33 }, { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 193, "end": 208 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 217, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 371 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4, 5 ] } ], "corrected-prediction": "Twenty nations have qualified for the Cricket World Cup at least once. Seven teams have competed in every tournament, five of which have won the title. Australia has won the most World Cups, with five titles." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "What network is broadcasting the ncaa basketball tournament?", "passages": [ [ "2016 NCAA Division I Men's Basketball Tournament", "The Wildcats shot 71.4% for the game, surpassed in Final Four games only by the Wildcats' 78.6% performance in the 1985 final against Georgetown.", "The 44-point margin was also greater than the combined margin of defeat in Oklahoma's seven previous losses in 2015\u201316.", "In addition, the 2016 semifinals were the first since 2008 to both be decided by double-digit margins, and the combined 61-point margin broke a men's Final Four record set in 1949.", "The Wildcats' Championship run was the most dominant in NCAA Tournament history, with a total point differential of +124 (breaking the 2009 record set by the North Carolina Tar Heels of +121).", "CBS Sports and Turner Sports held joint U.S. television broadcast rights to the Tournament under the \"NCAA March Madness\" brand.", "Beginning in 2016, rights to the Final Four and championship game began to alternate between Turner and CBS, with Turner networks broadcasting the 2016 Final Four and championship; a conventional telecast aired on TBS, accompanied by \"Team Stream\" broadcasts on TNT and TruTV which featured commentary and coverage focused on each participating team.", "Turner employed this multi-channel presentation of the semifinals in 2014 and 2015, but this was the first time it was used for the final." ], [ "NCAA Division I Men's Basketball Tournament", "While Turner's primary NBA voices, Marv Albert and Kevin Harlan, are already employed by CBS in other capacities, they also lend analysts Chris Webber, Grant Hill, and Reggie Miller and secondary play-by-play man Brian Anderson to CBS.", "In turn, CBS announcers Jim Nantz, Brad Nessler, Spero Dedes, and Andrew Catalon appear on Turner network broadcasts along with analysts Len Elmore, Bill Raftery, Dan Bonner, Mike Gminski, and Doug Gottlieb.", "The current contract runs through 2024 and, for the first time in history, provides for the nationwide broadcast each year of all games of the tournament.", "All First Four games air on truTV.", "A featured first- or second-round game in each time \"window\" is broadcast on CBS, while all other games are shown either on TBS, TNT or truTV.", "The regional semifinals, better known as the Sweet Sixteen, are split between CBS and TBS.", "CBS had the exclusive rights to the regional finals, also known as the Elite Eight, through 2014.", "That exclusivity extended to the entire Final Four as well, but after the 2013 tournament Turner Sports elected to exercise a contractual option for 2014 and 2015 giving TBS broadcast rights to the national semifinal matchups.", "CBS kept its national championship game rights." ] ], "gold": "CBS, TruTV, TNT and TBS broadcast the NCAA basketball tournament. In 2021, the First Four was broadcast on truTV and TBS. The First and Second Rounds of the 2021 NCAA basketball tournament were broadcast on CBS, TBS, TNT and truTV. The Sweet Sixteen and the Elite Eight were broadcast on CBS and TBS. The Final Four and Championship were broadcast on CBS. Since 2016, the rights to the Final Four and Championship Game have alternated between Turner networks and CBS. ", "prediction 1": "The NCAA basketball tournament is broadcast by several networks. Beginning in 2016, rights to the Final Four and championship game began to alternate between Turner Sports and CBS, with Turner networks broadcasting the 2016 Final Four and championship. A conventional telecast aired on TBS, accompanied by Team Stream broadcasts on TNT and TruTV which featured commentary and coverage focused on each participating team.", "prediction 2": "CBS Sports and Turner Sports held joint U.S. television broadcast rights to the NCAA March Madness brand, but beginning in 2016, rights to the Final Four and championship game began to alternate between Turner and CBS, with Turner networks broadcasting the 2016 Final Four and championship; a conventional telecast aired on TBS, accompanied by \"Team Stream\" broadcasts on TNT and TruTV which featured commentary and coverage focused on each participating team. A featured first- or second-round game in each time \"window\" is broadcast on CBS, while all other games are shown either on TBS, TNT or TruTV.", "prediction 3": "The 2016 NCAA Men's Basketball Tournament was broadcast by both Turner Sports and CBS. Turner Sports broadcasts the Final Four and the championship game.", "prediction 4": "CBS Sports and Turner Sports held joint U.S. television broadcast rights to the NCAA March Madness tournament, which included the National Collegiate Athletic Association tournament and the NCAA Men's Basketball Tournament. Beginning in 2016, rights to the Final Four and championship game began to alternate between Turner and CBS, with Turner networks broadcasting the 2016 Final Four and championship. A conventional telecast aired on TBS, accompanied by \"Team Stream\" broadcasts on TNT and TruTV which featured commentary and coverage focused on each participating team.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 346, "end": 420 } ], "missing-info": [], "corrected-prediction": "The NCAA basketball tournament is broadcast by several networks. Beginning in 2016, rights to the Final Four and championship game began to alternate between Turner Sports and CBS, with Turner networks broadcasting the 2016 Final Four and championship. A conventional telecast aired on TBS, accompanied by Team Stream broadcasts on TNT and TruTV." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the law of bantu education passed?", "passages": [ [ "Bantu Education Act, 1953", "Bantu Education Act, 1953\n\nThe Bantu Education Act, 1953 (Act No. 47 of 1953; later renamed the Black Education Act, 1953) was a South African segregation law which legalised several aspects of the apartheid system passed by the Apartheid regime which was really not on the side of the black community.", "Its major provision was enforcing racially separated educational facilities.", "Even universities were made \"tribal\", and all but three missionary schools chose to close down when the government no longer would help support their schools.", "Very few authorities continued using their own finances to support education for native Africans.", "In 1959, this type of education was extended to \"non white\" universities and colleges with the Extension of University Education Act, and the internationally prestigious University College of Fort Hare was taken over by the government and degraded to being part of the Bantu education system.", "It is often argued that the policy of Bantu (African) education was aimed to direct black or non-white youth to the unskilled labour market, although Kiyaam Govind, at the time Minister of Native Affairs, claimed that the aim was to solve South Africa's \"ethnic problems\" by creating complementary economic and political units for different ethnic group.", "The national authorities of the time is often said to have viewed education as having a rather pivotal position in their goal of eventually separating South Africa from the Bantustans entirely." ] ], "gold": "The Bantu Education Act was a South African segregation law which legalized several aspects of the apartheid system, particularly those having to do with educational facilities. The Bantu Education Act was passed in 1953, but didn't go into effect until 1 January 1954.", "prediction 1": "The Bantu Education Act, 1953, was passed on 27 November 1953. It was a South African segregation law which legalised several aspects of the apartheid system passed by the Apartheid regime which was really not on the side of the black community. Even universities were made \"tribal\", and all but three missionary schools chose to close down when the government no longer would help support their schools. In 1959, this type of education was extended to \"non white\" universities and colleges with the Extension of University Education Act, and the internationally prestigious University College of Fort Hare was taken over by the government and degraded to being part of the Bantu education system.", "prediction 2": "The Bantu Education Act, 1953 was a South African segregation law that legalised several aspects of the apartheid system passed by the Apartheid regime which was really not on the side of the black community. It's major provision was enforcing racially separated educational facilities. In 1953, this type of education was extended to \"non white\" universities and colleges with the Extension of University Education Act, and the internationally prestigious University College of Fort Hare was taken over by the government and degraded to being part of the Bantu education system.", "prediction 3": "The Bantu Education Act, 1953 was a South African segregation law which legalised several aspects of the apartheid system passed by the apartheid regime which was really not on the side of the black community. Its major provision was enforcing racially separated educational facilities. Even universities were made \"tribal\", and all but three missionary schools chose to close down when the government no longer would help support their schools. In 1959, this type of education was extended to \"non white\" universities and colleges with the Extension of University Education Act, and the internationally prestigious University College of Fort Hare was taken over by the government and degraded to being part of the Bantu education system.", "prediction 4": "The Bantu Education Act, 1953 was a South African segregation law which legalised several aspects of the apartheid system passed by the Apartheid regime which was really not on the side of the black community. Its major provision was enforcing racially separated educational facilities. Even universities were made \"tribal\", and all but three missionary schools chose to close down when the government no longer would help support their schools. In 1959, this type of education was extended to \"non white\" universities and colleges with the Extension of University Education Act, and the internationally prestigious University College of Fort Hare was taken over by the government and degraded to being part of the Bantu education system. It is often argued that the policy of Bantu (African) education was aimed to direct black or non-white youth to the unskilled labour market.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 45, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 404 }, { "error type": "Irrelevant", "explanation": "", "start": 405, "end": 697 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Bantu Education Act, 1953, was passed on 1953. It was a South African segregation law which legalised several aspects of the apartheid system, particularly those having to do with educational facilities. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When was the first superman comic book published?", "passages": [ [ "Superman (comic book)", "Superman (comic book)\n\n", "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist.", "Superman began as one of several anthology features in the National Periodical Publications comic book \"Action Comics\" #1 in June 1938.", "The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939.", "Between 1986 and 2006 it was retitled The Adventures of Superman while a new series used the title \"Superman\".", "In May 2006, it was returned to its original title and numbering.", "The title was canceled with issue #714 in 2011, and was relaunched with issue #1 the following month which ended its run in 2016.", "A fourth series was released with issue #1 in June 2016 and ended in April 2018.", "A fifth series with new issue #1 was launched in July 2018.", "Due to the Superman character's popularity after his premiere in \"Action Comics\" #1, National Allied Publications decided to launch an entirely new magazine featuring a single character, which at that time was unprecedented.", "\"Superman\" #1 appeared on the shelves in the summer of 1939.", "Superman now also had the distinction of being the first ever hero-character featured in more than one comic magazine." ], [ "Superman", "Since 1938, Superman stories have been regularly published in periodical comic books published by DC Comics.", "The first and oldest of these is \"Action Comics\", which began in April 1938.", "\"Action Comics\" was initially an anthology magazine, but it eventually became dedicated to Superman stories.", "The second oldest periodical is \"Superman\", which began in June 1939.", "\"Action Comics\" and \"Superman\" have been published without interruption (ignoring changes to the title and numbering scheme).", "A number of other shorter-lived Superman periodicals have been published over the years.", "Superman is part of the DC Universe, which is a shared universe of superhero characters owned by DC Comics, and consequently he frequently appears in stories alongside the likes of Batman, Wonder Woman, and others.", "Superman has sold more comic books over his lifetime than any other American superhero character.", "Exact sales figures for the early decades of Superman comic books are hard to find because, like most publishers at the time, DC Comics concealed this data to deny competitors, but sales of \"Action Comics\" and \"Superman\" probably peaked in the mid-1940s and thereafter steadily declined as part of a general trend in comic book sales.", "Sales data first became public in 1960, and showed that Superman was the best-selling comic book character of the 1960s.", "Sales rose again starting in 1987." ] ], "gold": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist. Superman began as one of several anthology features in the National Periodical Publications comic book \"Action Comics\" #1 in June 1938. The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering in June 1939.", "prediction 1": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist that has been published in numerous periodical comic books over the years. The first Superman comic book appeared on the shelves in the summer of 1939. The comic strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939. The second oldest periodical, Superman, was published in June 1939.", "prediction 2": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist. The first Superman comic book was published on June 19, 1939, as Action Comics #1. The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939.", "prediction 3": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist. The series began as one of several anthology features in the National Periodical Publications comic book Action Comics #1 in June 1938. The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939. Between 1986 and 2006, it was retitled The Adventures of Superman while a new series used the title Superman. In May 2006, it was returned to its original title and numbering scheme.", "prediction 4": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist. Superman began as one of several anthology features in the National Periodical Publications comic book Action Comics #1 in June 1938. The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939. Between 1986 and 2006 it was retitled The Adventures of Superman while a new series used the title Superman. In May 2006, the title was returned to its original title and numbering scheme.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 445, "end": 512 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 268 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Superman is an ongoing American comic book series featuring the DC Comics superhero Superman as its main protagonist that has been published in numerous periodical comic books over the years. Superman began as one of several anthology features in the National Periodical Publications comic book \"Action Comics\" #1 in June 1938. The strip proved so popular that National launched Superman into his own self-titled comic book, the first for any superhero, premiering with the cover date Summer 1939. " }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "When was the first globe of the world made?", "passages": [ [ "Globe", "This capability also permits exploring the earth from different orientations to help counter the north-up bias caused by conventional map presentation.", "Celestial globes show the apparent positions of the stars in the sky.", "They omit the Sun, Moon and planets because the positions of these bodies vary relative to those of the stars, but the ecliptic, along which the Sun moves, is indicated.", "The sphericity of the Earth was established by Greek astronomy in the 3rd century BC, and the earliest terrestrial globe appeared from that period.", "The earliest known example is the one constructed by Crates of Mallus in Cilicia (now \u00c7ukurova in modern-day Turkey), in the mid-2nd century BC.", "No terrestrial globes from Antiquity or the Middle Ages have survived.", "An example of a surviving celestial globe is part of a Hellenistic sculpture, called the Farnese Atlas, surviving in a 2nd-century AD Roman copy in the Naples Archaeological Museum, Italy.", "Early terrestrial globes depicting the entirety of the Old World were constructed in the Islamic world.", "According to David Woodward, one such example was the terrestrial globe introduced to Beijing by the Persian astronomer, Jamal ad-Din, in 1267.", "The earliest extant terrestrial globe was made in 1492 by Martin Behaim (1459\u20131537) with help from the painter Georg Glockendon." ], [ "Globe", "Behaim was a German mapmaker, navigator, and merchant.", "Working in Nuremberg, Germany, he called his globe the \"N\u00fcrnberg Terrestrial Globe.\"", "It is now known as the Erdapfel.", "Before constructing the globe, Behaim had traveled extensively.", "He sojourned in Lisbon from 1480, developing commercial interests and mingling with explorers and scientists.", "In 1485\u20131486, he sailed with Portuguese explorer Diogo C\u00e3o to the coast of West Africa.", "He began to construct his globe after his return to N\u00fcrnberg in 1490.", "Another early globe, the Hunt\u2013Lenox Globe, ca. 1510, is thought to be the source of the phrase \"Hic Sunt Dracones\", or \u201cHere be dragons\u201d.", "A similar grapefruit-sized globe made from two halves of an ostrich egg was found in 2012 and is believed to date from 1504.", "It may be the oldest globe to show the New World.", "Stefaan Missine, who analyzed the globe for the Washington Map Society journal \"Portolan\", said it was \u201cpart of an important European collection for decades.\u201d", "After a year of research in which he consulted many experts, Missine concluded the Hunt\u2013Lenox Globe was a copper cast of the egg globe." ], [ "Globe", "Globe\n\nA globe is a spherical model of Earth, of some other celestial body, or of the celestial sphere.", "Globes serve similar purposes to maps, but unlike maps, do not distort the surface that they portray except to scale it down.", "A globe of Earth is called a \"terrestrial globe\".", "A globe of the celestial sphere is called a \"celestial globe\".", "A globe shows details of its subject.", "A terrestrial globe shows land masses and water bodies.", "It might show nations and prominent cities and the network of latitude and longitude lines.", "Some have raised relief to show mountains.", "A celestial globe shows stars, and may also show positions of other prominent astronomical objects.", "Typically it will also divide the celestial sphere up into constellations.", "The word \"globe\" comes from the Latin word \"globus\", meaning \"sphere\".", "Globes have a long history.", "The first known mention of a globe is from Strabo, describing the Globe of Crates from about 150\u00a0BC.", "The oldest surviving terrestrial globe is the Erdapfel, wrought by Martin Behaim in 1492.", "The oldest surviving celestial globe sits atop the Farnese Atlas, carved in the 2nd century Roman Empire.", "Flat maps are created using a map projection that inevitably introduces an increasing amount of distortion the larger the area that the map shows." ] ], "gold": "A globe is a spherical model of Earth, of some other celestial body, or of the celestial sphere. The sphericity of the Earth was established by Greek astronomy in the 3rd century BC, and the earliest terrestrial globe appeared from that period. The earliest known example is the one constructed by Crates of Mallus in Cilicia, in the mid-2nd century BC. The earliest extant terrestrial globe was made in 1492 by Martin Behaim with help from the painter Georg Glockendon.", "prediction 1": "The first spherical model of Earth, or globe, is known as a terrestrial globe, or globe of the celestial sphere. The earliest surviving terrestrial globe was made in 1492 by Martin Behaim. The earliest terrestrial globe made in the 1400s is the Globe of Crates, which was a model of Earth sculpted from an ostrich egg. A globe of the celestial sphere is the Erdapfel, wrought by Martin Behaim in 1492 with help from the painter Georg Glockendon.", "prediction 2": "The earliest known terrestrial globe was constructed in 1485 by Crates of Mallus in Cilicia (now ukurova in modern-day Turkey), but the first known celestial globe was made in 1492 by Martin Behaim in Nuremberg, Germany, using the technique of a copper cast of an ostrich egg. The earliest surviving terrestrial globe was the Erdapfel, made by Behaim in 1492, and the oldest surviving celestial globe was the Hunt\u2013Lenox Globe, ca.", "prediction 3": "A globe is a spherical model of Earth, of some other celestial body, or of the celestial sphere. The earliest known example is the one constructed by Crates of Mallus in Cilicia in the mid-2nd century BC. The earliest extant terrestrial globe was made in 1492 by Martin Behaim with help from the painter Georg Glockendon. The earliest surviving celestial globe is the Erdapfel, wrought by Martin Behaim in 1492.", "prediction 4": "A globe is a spherical model of Earth, of some other celestial body, or of the celestial sphere. The oldest surviving terrestrial globe is the Erdapfel, wrought by Martin Behaim in 1492, with help from the painter Georg Glockendon. The celestial globe shows the positions of the stars in the sky. A globe of the Earth is called a terrestrial globe.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 232, "end": 237 }, { "error type": "Unverifiable", "explanation": "", "start": 262, "end": 318 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The first spherical model of Earth, or globe, is known as a terrestrial globe, or globe of the celestial sphere. The sphericity of the Earth was established by Greek astronomy in the 3rd century BC, and the earliest terrestrial globe appeared from that period. The earliest known example is the one constructed by Crates of Mallus in Cilicia, in the mid-2nd century BC. A globe of the celestial sphere is the Erdapfel, wrought by Martin Behaim in 1492 with help from the painter Georg Glockendon." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who established mission san francisco de la espada?", "passages": [ [ "Espada Acequia", "Espada Acequia\n\nThe Espada Acequia, or Piedras Creek Aqueduct, was built by Franciscan friars in 1731 in what is now San Antonio, Texas, United States.", "It was built to supply irrigation water to the lands near Mission San Francisco de la Espada, today part of San Antonio Missions National Historical Park.", "The acequia is still in use today and is an Historic Civil Engineering Landmark and a National Historic Landmark.", "Mission Espada's \"acequia\" (irrigation) system can still be seen today.", "The main ditch, or \"acequia madre\", continues to carry water to the mission and its former farmlands.", "This water is still used by residents living on these neighboring lands.", "The initial survival of a new mission depended upon the planting and harvesting of crops.", "In south central Texas, intermittent rainfall and the need for a reliable water source made the design and installation of an acequia system a high priority.", "Irrigation was so important to Spanish colonial settlers that they measured cropland in \"suertes\" -the amount of land that could be watered in one day.", "The use of acequias was originally brought to the arid regions of Spain by the Romans and the Moors.", "When Franciscan missionaries arrived in the desert Southwest they found the system worked well in the hot, dry environment." ], [ "Spanish missions in Texas", "It was completed near the Hasinai village of Nabedaches in late May, and its first mass was conducted on June 1, 1690.", "In its first two years of existence, the mission faced much hardship, as floodwaters and then drought destroyed their crops.", "After an epidemic killed half of the local population, the Hasinai became convinced that the missionaries had caused the deaths.", "Fearing an attack, on October 25, 1693 the missionaries buried the mission bell, set the building ablaze, and retreated to Mexico.", "The mission was reestablished on July 3, 1716, as Nuestro Padre San Francisco de los Tejas.", "In 1721, it was renamed Mission San Francisco de los Neches.", "It was moved in 1731 to San Antonio where it was named Mission San Francisco de la Espada.", "The surviving structure is now part of San Antonio Missions National Historical Park operated by the National Park Service.", "A commemorative representation of Mission San Francisco de los Tejas, is located in Weches at Mission Tejas State Park.", "Mission Sant\u00edsimo Nombre de Mar\u00eda was the second mission established by the Spanish in East Texas.", "Built for the native Neches population, the mission opened in September 1690 northeast of Mission San Francisco.", "The mission consisted of a straw chapel and a house for the priest.", "It was destroyed by a flood in 1692." ] ], "gold": "Mission San Francisco de la Espada (also Mission Espada) is a Roman Rite Catholic mission established in 1690 by Spain and relocated in 1731 to present-day San Antonio, Texas, in what was then known as northern New Spain. The mission was built in order to convert local Native Americans to Christianity and solidify Spanish territorial claims in the New World against encroachment from France. Founded in 1690 as San Francisco de los Tejas near Weches, Texas and southwest of present-day Alto, Texas, Mission San Francisco de la Espada was the second mission established in Texas. Three priests, three soldiers and supplies were left among the Nabedache Indians.", "prediction 1": "The first Spanish mission in Texas was San Francisco de los Tejas, established in 1690, and renamed on July 3, 1716, as Nuestro Padre San Francisco de los Tejas. In 1731, the mission was moved to San Antonio, where it was renamed Mission San Francisco de la Espada. The surviving structure is now part of San Antonio Missions National Historical Park operated by the National Park Service.", "prediction 2": "The Spanish established Mission San Francisco de la Espada in 1690. The mission was reestablished in 1716 as Nuestro Padre San Francisco de los Tejas. In 1721, it was renamed Mission San Francisco de los Neches. It was moved in 1731 to San Antonio where it was named Mission San Francisco de la Espada.", "prediction 3": "The Spanish established Mission San Francisco de la Espada in 1690. The mission was reestablished on July 3, 1716, as Nuestro Padre San Francisco de los Tejas and was renamed Mission San Francisco de los Neches. In 1731, it was moved to San Antonio where it was named Mission San Francisco de la Espada.", "prediction 4": "The Espada Acequia, or Piedras Creek Aqueduct, was built by Franciscan friars in 1731 in what is now San Antonio, Texas, United States. It was built to supply irrigation water to the lands near Mission San Francisco de la Espada. The mission was reestablished on July 3, 1716, as Nuestro Padre San Francisco de los Tejas. In 1721, it was renamed Mission San Francisco de los Neches. It was moved in 1731 to San Antonio where it was named Mission San Francisco de la Espada.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 39, "end": 66 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 120, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 389 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5,6]}", "start": 103, "end": 116 } ], "missing-info": [], "corrected-prediction": "The first Spanish mission in Texas was Nuestro Padre San Francisco de los Tejas, established in 1690, and reestablished on July 3, 1716. In 1721 it was renamed as Mission San Francisco de los Neches.. In 1731, the mission was moved to San Antonio, where it was renamed Mission San Francisco de la Espada. " }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "Who was the chicano leader who worked to unionize agricultural workers?", "passages": [ [ "United Farm Workers", "She had great influence over the direction that it took, breaking stereotypes of the Mexican woman in the 1960s.", "However, it was most common for Chicana activists and female labor union members to be involved in administrative tasks for the early stages of UFW.", "Women like Helen Ch\u00e1vez were important in responsibilities such as credit union bookkeeping and behind the scenes advise.", "Still, both women along with other Chicana activists participated in picketing with their families in the face of police intimidation and racial abuse.", "Keeping track of union services and membership were traditionally responsibilities given to female organizers and it was integral to the institutional survival of the UFW, but it has gone much less recognized throughout history due to the male led strikes receiving majority public attention.", "In May 1966, California farm worker activist Eugene Nelson traveled to Texas to rally support for the Schenley Farms boycott.", "While in Houston, AFL-CIO state representatives suggested that he visit Rio Grande City on the Texas-Mexico border in the lower Rio Grande Valley.", "Seeing the possibilities for organizing workers in the impoverished region, he quickly set about recruiting volunteers for the United Farm Workers Organizing Committee (UFWOC) as both strikers and assistants.", "Other UFWOC activists joined Nelson in Rio Grande City, including Gilbert Padilla, Antonio Orendain, and Bill Chandler." ], [ "Cesar Chavez", "Cesar Chavez\n\nCesar Chavez (born C\u00e9sar Estrada Ch\u00e1vez, ; March 31, 1927 \u2013 April 23, 1993) was an American labor leader and civil rights activist who, with Dolores Huerta, co-founded the National Farm Workers Association (later the United Farm Workers union, UFW) in 1962.", "Originally a Mexican American farm worker, Chavez became the best known Latino American civil rights activist, and was strongly promoted by the American labor movement, which was eager to enroll Hispanic members.", "His public-relations approach to unionism and aggressive but nonviolent tactics made the farm workers' struggle a moral cause with nationwide support.", "By the late 1970s, his tactics had forced growers to recognize the UFW as the bargaining agent for 50,000 field workers in California and Florida.", "During his lifetime, Colegio Cesar Chavez was one of the few institutions named in his honor, but after his death he became a major historical icon for the Latino community, with many schools, streets, and parks being named after him.", "He has since become an icon for organized labor and leftist politics, symbolizing support for workers and for Hispanic empowerment based on grass roots organizing.", "He is also famous for popularizing the slogan \"S\u00ed, se puede\" (Spanish for \"Yes, one can\" or, roughly, \"Yes, it can be done\"), which was adopted as the 2008 campaign slogan of Barack Obama." ] ], "gold": "C\u00e9sar Estrada Ch\u00e1vez and Dolores Clara Fern\u00e1ndez Huerta were the Chicano leaders who worked to unionize agricultural workers.", "prediction 1": "Cesar Chavez was an American labor leader and civil rights activist who, with Dolores Huerta, co-founded the National Farm Workers Association, later the United Farm Workers union, UFW, in 1962. Cesar Chavez was also the first Chicano leader to organize farm workers.\n", "prediction 2": "Cesar Chavez, an American labor leader and civil rights activist who developed the strategy and tactics used to unionize agricultural workers, is recognized as the greatest Latino American civil rights activist. Cesar Chavez was a Mexican American farm worker that helped organize the farm workers of California and Florida in the 1960s and 70s. In 1972, Eugine Nelson and Maya Lino led direct action to organize farm workers of Mexico in the Rio Grande Valley.", "prediction 3": "Cesar Chavez was an American labor leader and civil rights activist who, with Dolores Huerta, co-founded the National Farm Workers Association (later the United Farm Workers union, UFW), in 1962. Eugene Nelson was the first Chicano leader who organized and organized the first UFW.", "prediction 4": "Cesar Chavez, an American labor leader and civil rights activist, co-founded the National Farm Workers Association (later the United Farm Workers union, UFW) in 1962. With Dolores Huerta, he co-founded the UFW. American farmworker Cesar Chavez became the best known Latino American civil rights activist, with his public-relations approach to unionism and aggressive but nonviolent tactics made the farm workers' struggle a moral cause with nationwide support. In 1969, Dolores Huerta was also the first Chicana leader who established the United Farm Workers Organizing Committee. Sheila Huerta and others organized the UFW.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 195, "end": 268 } ], "missing-info": [], "corrected-prediction": "Cesar Chavez was an American labor leader and civil rights activist who, with Dolores Huerta, co-founded the National Farm Workers Association, later the United Farm Workers union, UFW, in 1962. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did brown v board of education take place?", "passages": [ [ "Brown v. Board of Education", "Brown v. Board of Education\n\nBrown v. Board of Education of Topeka, 347 U.S. 483 (1954), was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional.", "The decision effectively overturned the \"Plessy v. Ferguson\" decision of 1896, which allowed state-sponsored segregation, insofar as it applied to public education.", "Handed down on May 17, 1954, the Warren Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal.\"", "As a result, \"de jure\" racial segregation was ruled a violation of the Equal Protection Clause of the Fourteenth Amendment of the United States Constitution.", "This ruling paved the way for integration and was a major victory of the Civil Rights Movement, and a model for many future impact litigation cases.", "However, the decision's fourteen pages did not spell out any sort of method for ending racial segregation in schools, and the Court's second decision in \"Brown II\" () only ordered states to desegregate \"with all deliberate speed\".", "For much of the sixty years preceding the \"Brown\" case, race relations in the United States had been dominated by racial segregation." ] ], "gold": "Brown V. Board of Education originated in 1951, when the public school district in Topeka, Kansas, refused to enroll the daughter of local black resident Oliver Brown at the school closest to their home, instead requiring her to ride a bus to a segregated black elementary school farther away. The Browns and twelve other local black families in similar situations then filed a class action lawsuit in U.S. federal court against the Topeka Board of Education, alleging that its segregation policy was unconstitutional. Handed down on May 17, 1954, the Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal\", and therefore violate the Equal Protection Clause of the Fourteenth Amendment of the U.S. Constitution.", "prediction 1": "Brown v. Board of Education of Topeka was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional. Handed down on May 17, 1954, the Warren Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal.\" As a result, \"de jure\" racial segregation was ruled a violation of the Equal Protection Clause of the Fourteenth Amendment of the United States Constitution. This ruling paved the way for integration and was a major victory of the Civil Rights Movement, and a model for many future impact litigation cases. However, the decision's fourteen pages did not spell out any sort of method for ending racial segregation in schools.", "prediction 2": "Brown v. Board of Education of Topeka, 347 U.S. 483 (1954), was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional. The decision effectively overturned the \"Plessy v. Ferguson\" decision of 1896, which allowed state-sponsored segregation, insofar as it applied to public education. The ruling paved the way for integration and was a major victory of the Civil Rights Movement, and a model for many future impact litigation cases.", "prediction 3": "Brown v. Board of Education of Topeka, 347 U.S. 483 was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional. Handed down on May 17, 1954, the Warren Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal.\" As a result, \"de jure\" racial segregation was ruled a violation of the Equal Protection Clause of the Fourteenth Amendment of the United States Constitution. This ruling paved the way for integration and was a major victory of the Civil Rights Movement, and a model for many future impact litigation cases. However, the decision's fourteen pages did not spell out any sort of method for ending racial segregation in schools, and the Court's second decision in \"Brow", "prediction 4": "Brown v. Board of Education of Topeka, 347 U.S. 483 was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional. Handed down on May 17, 1954, the Warren Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal.\" As a result, \"de jure\" racial segregation was ruled a violation of the Equal Protection Clausea violation of the Fourteenth Amendment of the United States Constitution. This ruling paved the way for integration and was a major victory of the Civil Rights Movement, and a model for many future impact litigation cases.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 516, "end": 664 }, { "error type": "Irrelevant", "explanation": "", "start": 665, "end": 782 } ], "missing-info": [], "corrected-prediction": "Brown v. Board of Education of Topeka was a landmark United States Supreme Court case in which the Court declared state laws establishing separate public schools for black and white students to be unconstitutional. Handed down on May 17, 1954, the Warren Court's unanimous (9\u20130) decision stated that \"separate educational facilities are inherently unequal.\" As a result, \"de jure\" racial segregation was ruled a violation of the Equal Protection Clause of the Fourteenth Amendment of the United States Constitution. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When did the church of the nazarene start?", "passages": [ [ "Church of the Nazarene", "Church of the Nazarene\n\nThe Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America.", "With its members commonly referred to as Nazarenes, it is the largest Wesleyan-holiness denomination in the world.", "At the end of September 2016 the Church of the Nazarene had 2,471,553 members in 30,574 churches in 162 different \"world areas\".", "With 626,811 members at the end of 2016, the United States was the nation with the greatest number of Nazarenes.", "Other nations with large Nazarene populations include Mozambique (202,118), Brazil (153,002), India (136,079), Haiti (134,236), Bangladesh (123,192), Guatemala (90,101), Mexico (70,700), Peru (67,394), Benin (56,036), and Ethiopia (50,361)." ], [ "History of the Church of the Nazarene", "The merger of the Holiness Church of Christ in the south and the Pentecostal Church of the Nazarene took place on Tuesday, October 13, 1908, at 10:40\u00a0a.m., \"amid great shouts of joy and holy enthusiasm.\"", "Bresee had a problem with the denomination being called \"The Pentecostal Church of the Nazarene.", "He feared the inclusion of the word \"Pentecostal\" would make the church appear charismatic.", "Bresee smoked a pipe and some of the other joining organizations had an issue with smoking.", "Bresee agreed to stop smoking and to include a rule against smoking if the word \"Pentecostal\" were to be left out of the name of the new denomination.", "This used to be public knowledge, but lately, the Church of the Nazarene has attempted to keep this fact secret.", "The newly merged Church of the Nazarene began with 10,034 members, 228 congregations, 11 districts, and 19 missionaries, according to historical records.", "The latter date marks the \"official\" founding date.", "Bresee, Reynolds and Ellyson were elected general superintendents.", "Other independent bodies joined at later dates, including the Pentecostal Church of Scotland (founded in 1909 by Rev. George Sharpe) and the Pentecostal Mission (founded in 1898 by J.O." ], [ "Church of the Nazarene", "During 2016, Nazarene churches received annual income from all sources of US$860,949,037, a decrease of US$941,336 from 2015, and a 3.79% decadal decrease from the US$894,866,142 reported in September 2006.", "Worldwide per capita expenses amounted to US$353.04 (a decrease of $198.77 from that reported in 2006).", "The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century.", "The most prominent of these mergers took place at the First and Second General Assemblies, held at Chicago, Illinois, and Pilot Point, Texas in 1907 and 1908, respectively.", "The primary architect of these early mergers was C. W. Ruth.", "The First General Assembly held in Chicago, Illinois from October 10\u201317, 1907 brought together the Eastern and the Western streams.", "The Western group was the Church of the Nazarene founded in October 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church, and Dr Joseph Pomeroy Widney, a Methodist physician, and the second president of the University of Southern California." ] ], "gold": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Wesleyan-Holiness movement in North America. With its members commonly referred to as Nazarenes, it is the largest Wesleyan-Holiness denomination in the world and a member of the World Methodist Council. The original Church of the Nazarene started in 1895. The modern incarnation of the Church of Nazarene started on October 13, 1908.", "prediction 1": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America. The Church of the Nazarene began with 10,034 members, 228 congregations, 11 districts, and 19 missionaries, according to historical records. The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations, and denominations throughout the 20th century.", "prediction 2": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America. Its members are commonly referred to as Nazarenes and it is the largest Wesleyan-holiness denomination in the world. The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century. The Church of the Nazarene was founded on October 10, 1895 in Los Angeles, California by Dr. Phineas F. Bresee, a minister in the Methodist Episcopal Church. The Church of the Nazarene was founded in 1907 by Rev. George Sharpe and the Pentecostal Church of the Nazarene.", "prediction 3": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America. The Church of the Nazarene is the largest Wesleyan-holiness denomination in the world. The Church of the Nazarene began on October 13, 1908, with 10,034 members, 228 congregations, 11 districts, and 19 missionaries, according to historical records.", "prediction 4": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America. It was founded on October 13, 1908, by the merger of the Holiness Church of Christ in the south and the Pentecostal Church of the Nazarene. The Church of the Nazarene is the product of a series of mergers that occurred between various holiness churches, associations and denominations throughout the 20th century.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 280, "end": 454 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Church of the Nazarene is an evangelical Christian denomination that emerged from the 19th-century Holiness movement in North America. With its members commonly referred to as Nazarenes, it is the largest Wesleyan-holiness denomination in the world. The Western group was the Church of the Nazarene founded in October 1895. The most prominent modern incarnation of the Church of Nazarene took place in 1907 and 1908." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who sings lifestyles of the rich and famous?", "passages": [ [ "Lifestyles of the Rich and Famous (Kool G Rap & DJ Polo song)", "Lifestyles of the Rich and Famous (Kool G Rap & DJ Polo song)\n\n\"Lifestyles of the Rich and Famous\" is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album \"Rated XXX\".", "\"Lifestyles of the Rich and Famous\" is a braggadocio rap in which Kool G Rap boasts of his extravagant lifestyles, success with women and luxurious possessions.", "The song's hook samples the lines \"I'm representin, puttin' Queens on the map\" and \"Playin' big willie style with the chauffeur.", "Yaknawmean?\" from the Lost Boyz song \"Jeeps, Lex Coups, Bimaz & Benz\" and Junior M.A.F.I.A. 's \"Player's Anthem\", respectively.", "A heavy piano sample from the Fonda Rae song \"Over Like a Fat Rat\" can also be heard throughout.", "\"Lifestyles of the Rich and Famous\" samples the following songs:\n\nAnd was later sampled on:" ], [ "Lifestyles of the Rich and Famous (Good Charlotte song)", "Lifestyles of the Rich and Famous (Good Charlotte song)\n\n\"Lifestyles of the Rich and Famous\" is a song written by Benji Madden, Joel Madden and Tim Armstrong for Good Charlotte's second studio album \"The Young and the Hopeless\".", "It was released as the first single from the album in late 2002 in the United States and in early 2003 for the worldwide market.", "Upon its release the single reached a peak position of number 20 on the U.S. \"Billboard\" Hot 100 and charted in the top 40 in a number of European countries.", "The basic concept of the song is the global obsession with fame and the way that celebrities are not appreciative of how fortunate they are.", "The song has references to a number of celebrities within the lyrics.", "Johnnie Cochran, a famous attorney who represented (amongst others) stars such as O.J. Simpson, who was acquitted of murdering his ex-wife Nicole Brown.", "He is mentioned in the lines \"\"Well did you know when you're famous you could kill your wife / and there's no such thing as 25 to life / as long as you got the cash to pay for Cochran\".\"" ] ], "gold": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. The song samples Jeeps, Lex Coups, Bimaz & Benz by Lost Boyz. Lifestyles of the Rich and Famous is a song written by Benji Madden, Joel Madden and Tim Armstrong for Good Charlotte's second studio album The Young and the Hopeless. It was released as the first single from the album in late 2002 in the United States and in early 2003 for the worldwide market.", "prediction 1": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. It's a braggadocio rap in which Kool G Rap boasts of his extravagant lifestyles, success with women and luxurious possessions. Lifestyles of the Rich and Famous is also the first single from Good Charlotte's second studio album The Young and the Hopeless. There is also a song by Benji Madden, Joel Madden and Tim Armstrong, which was released on October 2, 2003.", "prediction 2": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. The song is a braggadocio rap in which Kool G Rap boasts of his extravagant lifestyles, success with women and luxurious possessions. Lifestyles of the Rich and Famous is also a song written by Benji Madden, Joel Madden and Tim Armstrong for Good Charlotte's second studio album The Young and the Hopeless.", "prediction 3": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. The song is a braggadocio rap in which Kool G Rap boasts of his extravagant lifestyles, success with women and luxurious possessions. The song was written by Benji Madden, Joel Madden and Tim Armstrong for Good Charlotte's second studio album The Young and the Hopeless and was released as the first single from the album in late 2002 in the United States and in early 2003 for the worldwide market.", "prediction 4": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. The song is a braggadocio rap in which Kool G Rap boasts of his extravagant lifestyles, success with women and luxurious possessions. It has also been sampled on a number of different songs. \"Lifestyles of the Rich and Famous\" is also the first single from Good Charlotte's second studio album The Young and the Hopeless.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 251 }, { "error type": "Incoherent", "explanation": "", "start": 381, "end": 488 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lifestyles of the Rich and Famous is the first single from American hip hop duo Kool G Rap & DJ Polo's 1996 album Rated XXX. Lifestyles of the Rich and Famous is a song written by Benji Madden, Joel Madden and Tim Armstrong for Good Charlotte's second studio album The Young and the Hopeless. It was released as the first single from the album in late 2002 in the United States and in early 2003 for the worldwide market." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "What is the circulation of the globe and mail?", "passages": [ [ "The Globe and Mail", "The Globe and Mail\n\nThe Globe and Mail is a Canadian newspaper printed in five cities in western and central Canada.", "With a weekly readership of 2,018,923 in 2015, it is Canada's most widely read newspaper on weekdays and Saturdays, although it falls slightly behind the \"Toronto Star\" in overall weekly circulation because the \"Star\" publishes a Sunday edition while the \"Globe\" does not.", "\"The Globe and Mail\" is regarded by some as Canada's \"newspaper of record\".", "The newspaper is owned by The Woodbridge Company, based in Toronto.", "The predecessor to \"The Globe and Mail\" was called \"The Globe\"; it was founded in 1844 by Scottish immigrant George Brown, who became a Father of Confederation.", "Brown's liberal politics led him to court the support of the Clear Grits, precursor to the modern Liberal Party of Canada.", "\"The Globe\" began in Toronto as a weekly party organ for Brown's Reform Party, but seeing the economic gains that he could make in the newspaper business, Brown soon targeted a wide audience of liberal minded freeholders.", "He selected as the motto for the editorial page a quotation from Junius, \"The subject who is truly loyal to the Chief Magistrate will neither advise nor submit to arbitrary measures.\"", "The quotation is carried on the editorial page to this day." ] ], "gold": "The Globe and Mail is a Canadian newspaper and regarded by some people as Canada's newspaper of record. The Globe and Mail publishes a weekday and Saturday edition, but does not print a Sunday edition. The newspaper's daily circulation amount is 291,571. At 354,850, the circulation for the Saturday edition is higher.", "prediction 1": "The Globe and Mail is a Canadian newspaper printed in five cities in western and central Canada. In 2015, the newspaper had a weekly readership of 2,018,923.", "prediction 2": "The circulation of The Globe and Mail in 2015 was 2,018,923.", "prediction 3": "The Globe and Mail is a Canadian newspaper that is printed in five cities in western and central Canada. In 2015, the newspaper had a weekly circulation of 2,018,923.", "prediction 4": "The Globe and Mail is a Canadian newspaper that is printed in five cities in western and central Canada. The newspaper has a weekly readership of 2,018,923 in 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 96 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Globe and Mail is a Canadian newspaper and regarded by some people as Canada's newspaper of record. With a weekly readership of 2,018,923 in 2015, it is Canada's most widely read newspaper on weekdays and Saturdays, but does not print a Sunday edition. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who was the individual who is credited with establishing the size of earth?", "passages": [ [ "Earth radius", "This concept aids the interpretation of terrestrial and planetary radio occultation refraction measurements and in some navigation and surveillance applications.", "This table summarizes the accepted values of the Earth's radius.", "The first published reference to the Earth's size appeared around 350\u00a0BC, when Aristotle reported in his book \"On the Heavens\" that mathematicians had guessed the circumference of the Earth to be 400,000 stadia.", "Scholars have interpreted Aristotle's figure to be anywhere from highly accurate to almost double the true value.", "The first known scientific measurement and calculation of the circumference of the Earth was performed by Eratosthenes in about 240\u00a0BC.", "Estimates of the accuracy of Eratosthenes\u2019s measurement range from 0.5% to 17%.", "For both Aristotle and Eratosthenes, uncertainty in the accuracy of their estimates is due to modern uncertainty over which stadion length they meant." ], [ "Hipparchus", "Before him a grid system had been used by Dicaearchus of Messana, but Hipparchus was the first to apply mathematical rigor to the determination of the latitude and longitude of places on the Earth.", "Hipparchus wrote a critique in three books on the work of the geographer Eratosthenes of Cyrene (3rd century\u00a0), called \"Pr\u00f2s t\u00e8n 'Eratosth\u00e9nous geograf\u00edan\" (\"Against the Geography of Eratosthenes\").", "It is known to us from Strabo of Amaseia, who in his turn criticised Hipparchus in his own \"Geografia\".", "Hipparchus apparently made many detailed corrections to the locations and distances mentioned by Eratosthenes.", "It seems he did not introduce many improvements in methods, but he did propose a means to determine the geographical longitudes of different cities at lunar eclipses (Strabo \"Geografia\" 1 January 2012).", "A lunar eclipse is visible simultaneously on half of the Earth, and the difference in longitude between places can be computed from the difference in local time when the eclipse is observed.", "His approach would give accurate results if it were correctly carried out but the limitations of timekeeping accuracy in his era made this method impractical." ], [ "Earth's circumference", "As explained by Cleomedes, Posidonius observed Canopus on but never above the horizon at Rhodes, while at Alexandria he saw it ascend as far as 7\u00bd degrees above the horizon (the meridian arc between the latitude of the two locales is actually 5 degrees 14 minutes).", "Since he thought Rhodes was 5,000 stadia due north of Alexandria, and the difference in the star's elevation indicated the distance between the two locales was 1/48 of the circle, he multiplied 5,000 by 48 to arrive at a figure of 240,000 stadia for the circumference of the earth.", "It is generally thought that the stadion used by Posidonius was almost exactly 1/10 of a modern statute mile.", "Thus Posidonius's measure of 240,000 stadia translates to , not much short of the actual circumference of .USCB", "DOC-D1026 QVC Manual 01/03/09", "Furthermore, economic and foreign trade indicators released by the federal government typically contain data produced by the Census Bureau.", "The Article One of the United States Constitution (section II) directs the population be enumerated at least once every ten years and the resulting counts used to set the number of members from each state in the House of Representatives and, by extension, in the Electoral College.", "The Census Bureau now conducts a full population count every 10 years in years ending with a zero and uses the term \"decennial\" to describe the operation.", "Between censuses, the Census Bureau makes population estimates and projections.", "In addition, Census data directly affects how more than $400 billion per year in federal and state funding is allocated to communities for neighborhood improvements, public health, education, transportation and more.", "The Census Bureau is mandated with fulfilling these obligations: the collecting of statistics about the nation, its people, and economy.", "The Census Bureau's legal authority is codified in Title 13 of the United States Code." ] ], "gold": "As of the 2010 United States census, the population of Mecklenburg County, North Carolina was 919,628 people. However, the population of Mecklenburg County increased to1,093,901 people as of the 2018 estimate, making it the most populous county in North Carolina and the first county in the Carolinas to surpass one million people in population. Previously, as of the 2000 United States census, there were 695,454 people residing in Mecklenburg County, North Carolina. Prior to this, as of the 1990 United States census, there were 511,433 people residing in Mecklenburg County, North Carolina. The United States census is a census that is legally mandated by the United States Constitution and takes place every 10 years. The most recent national census took place in 2020, while the next census is scheduled for 2030.", "prediction 1": "Mecklenburg County is a county located on the border in the southwestern part of the state of North Carolina, in the United States. As of the 2010 census, the population was 919,618. It increased to 1,034,070 as of the 2015 estimate, making it the most populous county in North Carolina and the first county in the Carolinas to surpass 1 million in population.", "prediction 2": "Mecklenburg County is the county seat and largest city of North Carolina, in the United States, and was founded in 1762. As of the 2010 census, the population was 919,618. As of the 2015 estimate, the population was 1,034,070, making it the most populous county in North Carolina and the first county in the Carolinas to surpass 1 million in population.", "prediction 3": "As of the 2010 census, the population of Mecklenburg County was 919,618. As of the 2015 estimate, the population was 1,034,070.", "prediction 4": "The population of Mecklenburg County, North Carolina, as of the 2010 census, was 919,618. It increased to 1,034,070 as of the 2015 estimate, making it the most populous county in North Carolina and the first county in the Carolinas to surpass 1 million in population.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 131 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "As of the 2010 census, the population was 919,618. It increased to 1,034,070 as of the 2015 estimate, making it the most populous county in North Carolina and the first county in the Carolinas to surpass 1 million in population. The United States Constitution directs the population be enumerated at least once every ten years." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did freaky friday come out chris brown?", "passages": [ [ "Freaky Friday (song)", "Freaky Friday (song)\n\n\"Freaky Friday\" is a song recorded by American rapper Lil Dicky, featuring guest vocals from American singer Chris Brown and uncredited vocals from Ed Sheeran, DJ Khaled, and Kendall Jenner.", "Written by Dicky, Brown, Cashmere Cat, Lewis Hughes, Wilbart McCoy III, Ammo and its producers DJ Mustard, Benny Blanco and Twice as Nice, it was released by Dirty Burd on March 15, 2018, alongside its music video.", "The song topped the charts in the United Kingdom and New Zealand, and peaked at number eight on the \"Billboard\" Hot 100.", "The song has also reached the top ten of the charts in Australia, Canada and Ireland.", "\"Freaky Friday\" is a hip hop and comedy hip hop song featuring a pop-rap production.", "The music video parodies the 2003 film \"Freaky Friday\" and features cameos from Jimmy Tatro, Ed Sheeran, DJ Khaled and Kendall Jenner.", "As of December 2018, the video had over 440 million views on YouTube.", "The video shows Lil Dicky at a Chinese restaurant, similar to the 2003 film, \"Freaky Friday\", where a character is at a Chinese restaurant and wishes she was somebody else." ] ], "gold": "Freaky Friday, a song recorded by American rapper Lil Dicky featuring guest vocals from American singer Chris Brown, was released as a digital download on March 15, 2018, alongside its music video. This music video parodies the film Freaky Friday and features cameos from Jimmy Tatro, Ed Sheeran, DJ Khaled and Kendall Jenner. Then, on March 20, 2018, the song Freaky Friday premiered on the radio in the United States.", "prediction 1": "Chris Brown sang on the song \"Freaky Friday\", which was recorded by American rapper Lil Dicky and features guest vocals from American singer Chris Brown. The song was released by Dirty Burd on March 15, 2018, alongside its music video.", "prediction 2": "Chris Brown sang on the song \"Freaky Friday,\" a song recorded by American rapper Lil Dicky, with guest vocals from American singer Chris Brown and uncredited vocals from Ed Sheeran, DJ Khaled, and Kendall Jenner. The song was released on March 15, 2018 by Dirty Burd, alongside its music video.", "prediction 3": "Chris Brown has sung the song \"Freaky Friday,\" which was written by Lil Dicky, Cashmere Cat, Lewis Hughes, Wilbart McCoy III, Ammo and its producers DJ Mustard, Benny Blanco and Twice as Nice. Chris Brown performed on the song's guest vocals for the music video, which parodies the 2003 movie \"Freaky Friday\".", "prediction 4": "Chris Brown has released several songs called \"Freaky Friday\". \"Freaky Friday\" is a song recorded by American rapper Lil Dicky, featuring guest vocals from American singer Chris Brown. The song was released on March 15, 2018, alongside its music video. The music video parodies the 2003 film \"Freaky Friday\", and features cameos from Jimmy Tatro, Ed Sheeran, DJ Khaled and Kendall Jenner.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Chris Brown sang on the song \"Freaky Friday\", which was recorded by American rapper Lil Dicky and features guest vocals from American singer Chris Brown. The song was released by Dirty Burd on March 15, 2018, alongside its music video. The music video parodies the 2003 film \"Freaky Friday\" and features cameos from Jimmy Tatro, Ed Sheeran, DJ Khaled and Kendall Jenner." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When did colour tv start in the uk?", "passages": [ [ "United Kingdom in the Eurovision Song Contest 1992", "United Kingdom in the Eurovision Song Contest 1992\n\nThe United Kingdom competed at the Eurovision Song Contest 1992 with Michael Ball and the song \"One Step Out of Time\".", "The British Broadcasting Corporation (BBC) continued to use a national final to select their entry for the Eurovision Song Contest.", "For the 1992 UK national final, the multi-artist format utilized since 1976 was dropped in favor of having a single act perform all the nominated songs which had been the format for the UK national final for Eurovision from 1964 to 1975.", "The BBC internally selected Michael Ball to eventually compete for the UK in Malm\u00f6, Sweden.", "The eight songs in contention to represent the UK were presented during Terry Wogan's \"Wogan\" chat show on BBC1.", "Two songs were presented during each of four broadcasts between 8 and 30 March.", "The songs were also featured in various programmes on BBC Radio 2.", "Ball performed all the songs in the British national final \"A Song For Europe\" held on 3 April (recorded the previous evening) at the BBC Television Centre TC3 studios in London, with the winner of \"A Song For Europe\" decided through televoting.", "A separate results show was broadcast on BBC1 the same evening.", "BBC Radio 2 simulcast the final, with commentary by Ken Bruce, but did not broadcast the results show." ], [ "BBC", "There was a widely reported urban myth that, upon resumption of the BBC television service after the war, announcer Leslie Mitchell started by saying, \"As I was saying before we were so rudely interrupted\u00a0...\"", "In fact, the first person to appear when transmission resumed was Jasmine Bligh and the words said were \"Good afternoon, everybody.", "How are you?", "Do you remember me, Jasmine Bligh\u00a0... ?\"", "The European Broadcasting Union was formed on 12 February 1950, in Torquay with the BBC among the 23 founding broadcasting organisations.", "Competition to the BBC was introduced in 1955, with the commercial and independently operated television network of ITV.", "However, the BBC monopoly on radio services would persist until 8 October 1973 when under the control of the newly renamed Independent Broadcasting Authority (IBA), the UK's first Independent local radio station, LBC came on-air in the London area.", "As a result of the Pilkington Committee report of 1962, in which the BBC was praised for the quality and range of its output, and ITV was very heavily criticised for not providing enough quality programming, the decision was taken to award the BBC a second television channel, BBC2, in 1964, renaming the existing service BBC1.", "BBC2 used the higher resolution 625 line standard which had been standardised across Europe." ], [ "Television in the United Kingdom", "Television in the United Kingdom\n\nTelevision in the United Kingdom started in 1936 as a public service which was free of advertising.", "Currently, the United Kingdom has a collection of free-to-air, free-to-view and subscription services over a variety of distribution media, through which there are over 480 channels for consumers as well as on-demand content.", "There are six main channel owners who are responsible for most material viewed.", "There are 27,000 hours of domestic content produced a year at a cost of \u00a32.6\u00a0billion.", "Since 24 October 2012, all television broadcasts in the United Kingdom have been in a digital format, following the end of analogue transmissions in Northern Ireland.", "Digital content is delivered via terrestrial, satellite and cable, as well as over IP.", "Free-to-air, free-to-view and subscription providers are available, with differences in the number of channels, capabilities such as the programme guide (EPG), video on demand (VOD), high-definition (HD), interactive television via the red button, and coverage across the UK.", "The UK's five most watched channels, BBC One, BBC Two, ITV, Channel 4 and Channel 5, are available from all providers.", "Broadcast television is distributed as radio waves via terrestrial or satellite transmissions, or as electrical or light signals through ground-based cables." ] ], "gold": "Regular television broadcasts in the United Kingdom started in 1936, as a public service which was free of advertising, while the introduction of television and the first tests commencing in 1927. The first color TV was showcased in the UK in 1961. On July 1, 1967, color TV started to air on BBC2, which is one of the stations provided by the United Kingdom's national broadcaster, BBC, and was joined by other stations, BBC1 and ITV, on November 15, 1969. On December 2, 1967 \"full\" color tv was introduced, but nationwide color TV did not start in the country until 1976. ", "prediction 1": "Television in the United Kingdom started in 1936 as a public service which was free of advertising. The first colour television broadcasts in the United Kingdom were in 1955 with the commercial and independently operated television network ITV.", "prediction 2": "Television in the United Kingdom started in 1936 as a public service which was free of advertising. Until 24 October 2012, all television broadcasts in the United Kingdom have been in a digital format, following the end of analogue transmissions in Northern Ireland.", "prediction 3": "Television in the United Kingdom started in 1936 as a public service which was free of advertising. The first colour television broadcast in the UK was in 1935, when the BBC was owned by the government. The first colour television broadcast in the UK was in 1962.", "prediction 4": "Television in the United Kingdom started in 1936 as a public service which was free of advertising. There was a widely reported urban myth that, upon resumption of the BBC television service after the war, announcer Leslie Mitchell started by saying, \"As I was saying before we were so rudely interrupted... \". In fact, the first person to appear when transmission resumed was Jasmine Bligh.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 104, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 239 } ], "missing-info": [], "corrected-prediction": "Television in the United Kingdom started in 1936 as a public service which was free of advertising. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who was the dude in the big lebowski?", "passages": [ [ "The Big Lebowski", "\"The Big Lebowski\" was a disappointment at the U.S. box office and received mixed reviews at the time of its release.", "Over time, reviews have become largely positive, and the film has become a cult favorite, noted for its idiosyncratic characters, dream sequences, unconventional dialogue, and eclectic soundtrack.", "In 2014, the film was selected for preservation in the National Film Registry by the Library of Congress, being deemed \"culturally, historically, or aesthetically significant\".", "A spin-off based on John Turturro's character, titled \"Going Places\", was filmed in 2017, with Turturro also acting as writer and director.", "In 1991, Jeffrey \"the Dude\" Lebowski is a middle-aged slacker who gets assaulted in his Los Angeles home by two goons hired by pornographer Jackie Treehorn, demanding money owed him by the wife of another, wealthier Jeffrey Lebowski.", "Realizing they have the wrong man, they leave, but not before one of them urinates on the Dude's rug.", "The next day, the Dude tells what happened to his friends and bowling partners, Donny and Vietnam veteran Walter.", "The Dude seeks compensation from the other Lebowski, a cantankerous and wheelchair-bound philanthropist." ], [ "The Big Lebowski", "The Big Lebowski\n\nThe Big Lebowski () is a 1998 crime comedy film written, produced, and directed by Joel and Ethan Coen.", "It stars Jeff Bridges as Jeffrey \"The Dude\" Lebowski, a Los Angeles slacker and avid bowler.", "He is assaulted as a result of mistaken identity, after which The Dude learns that a millionaire also named Jeffrey Lebowski was the intended victim.", "The millionaire Lebowski's trophy wife is kidnapped, and he commissions The Dude to deliver the ransom to secure her release; but the plan goes awry when the Dude's friend Walter Sobchak (John Goodman) schemes to keep the ransom money.", "Julianne Moore and Steve Buscemi also star, with David Huddleston, John Turturro, Philip Seymour Hoffman, Sam Elliott, Tara Reid, David Thewlis, and Peter Stormare appearing in supporting roles.", "The film is loosely inspired by the work of Raymond Chandler.", "Joel Coen stated, \"We wanted to do a Chandler kind of story \u2013 how it moves episodically, and deals with the characters trying to unravel a mystery, as well as having a hopelessly complex plot that's ultimately unimportant.\"", "The original score was composed by Carter Burwell, a longtime collaborator of the Coen brothers." ], [ "Dude", "One of the first known references to the word in American film was in the 1969 movie, \"Easy Rider\" where Captain America (portrayed by Peter Fonda) explains to his cellmate lawyer (portrayed by Jack Nicholson) the definition of \"Dude\": \"Dude means nice guy; Dude means regular sort of person.\"", "The usage of the word to mean a \"cool person\" was further popularized in American films of the 1980s and 1990s such as \"Teenage Mutant Ninja Turtles\", \"Fast Times at Ridgemont High\", \"Bill and Ted's Excellent Adventure\", \"Wayne's World\", and \"Clerks\".", "The 1998 film \"The Big Lebowski\" featured Jeff Bridges as \"The Dude\", described as a \"lazy deadbeat\".", "The character was largely inspired by activist and producer Jeff Dowd who has been called \"Dude\" since childhood.", "The film's central character inspired the creation of Dudeism, a neoreligion.", "The 2000 film \"Dude, Where's My Car?\" uses the word in the title.", "In 2008, Bud Light aired an advertising campaign in which the dialogue consists entirely of different inflections of \"Dude!\" and does not mention the product by name.", "It was a followup to their near-identical and more widely noted \"Whassup?\" campaign." ] ], "gold": "Jeff Bridges played \"The Dude\" in The Big Lebowski. In the movie, \"The Dude\", a middle-aged bachelor with a penchant for cannabis and bowling, is assaulted by two goons hired by pornographer Jackie Treehorn, demanding money owed by the wife of another Jeffrey Lebowski. Jeff Dowd was the inspiration for the character.", "prediction 1": "The Big Lebowski is a 1998 American crime comedy film written, produced, and directed by Joel and Ethan Coen. It stars Jeff Bridges as Jeffrey \"The Dude\" Lebowski, a middle-aged slacker and avid bowler. In 1991, Jeffrey \"the Dude\" Lebowski is assaulted in his Los Angeles home by two goons hired by pornographer Jackie Treehorn, demanding money owed him by the wife of another, wealthier Jeffrey Lebowski. The Dude learns that a millionaire also named Jeffrey Lebowski was the intended victim.", "prediction 2": "In The Big Lebowski, the title character is Jeffrey \"the Dude\" Lebowski, played by Jeff Bridges. The character was largely inspired by activist and producer Jeff Dowd, who has been called \"Dude\" since childhood. The 1998 film was a disappointment at the U.S. box office and received mixed reviews at the time of its release. However, over the years, reviews have become largely positive, and the film has become a cult favorite, noted for its idiosyncratic characters, unconventional dialogue, and eclectic soundtrack.", "prediction 3": "The Big Lebowski is a 1998 American crime comedy film. The character of the dude in the film is Jeffrey \"the Dude\" Lebowski, played by Jeff Bridges. The dude in the film is described as a \"lazy deadbeat\" and is largely inspired by activist and producer Jeff Dowd, who has been called \"Dude\" since childhood.", "prediction 4": "The Big Lebowski is a 1998 crime comedy film written, produced, and directed by Joel and Ethan Coen. It stars Jeff Bridges as Jeffrey \"The Dude\" Lebowski, a middle-aged slacker and avid bowler. In 1991, Jeffrey \"the Dude\" Lebowski is assaulted in his Los Angeles home by two goons hired by pornographer Jackie Treehorn, demanding money owed him by the wife of another, wealthier Jeffrey Lebowski. The dude learns that the intended victim.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 17, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 493 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the Big Lebowski movie, Jeff Bridges plays Jeffrey \"The Dude\" Lebowski, a middle-aged slacker and avid bowler. In 1991, Jeffrey \"the Dude\" Lebowski is assaulted in his Los Angeles home by two goons hired by pornographer Jackie Treehorn, demanding money owed him by the wife of another, wealthier Jeffrey Lebowski. The character was largely inspired by activist and producer Jeff Dowd." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Why would a recrystallization need to be done?", "passages": [ [ "Recrystallization (chemistry)", "Recrystallization (chemistry)\n\n", "In chemistry, recrystallization is a technique used to purify chemicals.", "By dissolving both impurities and a compound in an appropriate solvent, either the desired compound or impurities can be removed from the solution, leaving the other behind.", "It is named for the crystals often formed when the compound precipitates out.", "Alternatively, \"recrystallization\" can refer to the natural growth of larger ice crystals at the expense of smaller ones.", "In chemistry, recrystallization is a procedure for purifying compounds.", "The most typical situation is that a desired \"compound A\" is contaminated by a small amount of \"impurity B\".", "There are various methods of purification that may be attempted (see Separation process), recrystallization being one of them.", "There are also different recrystallization techniques that can be used such as:\n\nTypically, the mixture of \"compound A\" and \"impurity B\" is dissolved in the smallest amount of hot solvent to fully dissolve the mixture, thus making a saturated solution.", "The solution is then allowed to cool.", "As the solution cools the solubility of compounds in solution drops.", "This results in the desired compound dropping (recrystallizing) from solution.", "The slower the rate of cooling, the bigger the crystals form." ], [ "Recrystallization (metallurgy)", "Recrystallization (metallurgy)\n\nRecrystallization is a process by which deformed grains are replaced by a new set of defect-free grains that nucleate and grow until the original grains have been entirely consumed.", "Recrystallization is usually accompanied by a reduction in the strength and hardness of a material and a simultaneous increase in the ductility.", "Thus, the process may be introduced as a deliberate step in metals processing or may be an undesirable byproduct of another processing step.", "The most important industrial uses are softening of metals previously hardened or rendered brittle by cold work, and control of the grain structure in the final product.", "Recrystallization is defined as the process in which grains of a crystal structure come in a new structure or new crystal shape.", "A precise definition of recrystallization is difficult to state as the process is strongly related to several other processes, most notably recovery and grain growth.", "In some cases it is difficult to precisely define the point at which one process begins and another ends.", "Doherty \"et al.\" (1997) defined recrystallization as:\n\"...", "the formation of a new grain structure in a deformed material by the formation and migration of high angle grain boundaries driven by the stored energy of deformation." ] ], "gold": "In chemistry recrystillization is one of various methods for purifying compounds. In metallurg recrystallization\u00a0is a process by which deformed\u00a0grains\u00a0are replaced by a new set of defect-free grains that\u00a0nucleate\u00a0and grow until the original grains have been entirely consumed. The most important industrial uses are softening of metals previously hardened or rendered brittle by cold work, and control of the grain structure in the final product.", "prediction 1": "In chemistry, recrystallization is a procedure for purifying compounds. The most typical situation is that a desired \"compound A\" is contaminated by a small amount of \"impurity B\". There are various methods of purification that may be attempted, recrystallization being one of them. Recrystallization is usually accompanied by a reduction in the strength and hardness of a material and a simultaneous increase in the ductility. Recrystallization is a process by which deformed grains are replaced by a new set of defect-free grains that nucleate and grow until the original grains have been entirely consumed.", "prediction 2": "Recrystallization is a technique used to purify chemicals. By dissolving both impurities and a compound in an appropriate solvent, either the desired compound or impurities can be removed from the solution, leaving the other behind. It is named for the crystals often formed when the compound precipitates out. Recrystallization is also a process by which deformed grains are replaced by a new set of defect-free grains that nucleate and grow until the original grains have been entirely consumed. Recrystallization is usually accompanied by a reduction in the strength and hardness of a material and a simultaneous increase in the ductility.", "prediction 3": "In chemistry, recrystallization is a procedure for purifying compounds. The most typical situation is that a desired \"compound A\" is contaminated by a small amount of \"impurity B\". There are various methods of purification that may be attempted, recrystallization being one of them. Recrystallization is usually accompanied by a reduction in the strength and hardness of a material and a simultaneous increase in the ductility. Thus, the process may be introduced as a deliberate step in metals processing or may be an undesirable byproduct of another processing step.", "prediction 4": "In chemistry, recrystallization is a procedure for purifying compounds. The most typical situation is that a desired compound A is contaminated by a small amount of impurity B. There are various methods of purification that may be attempted, recrystallization being one of them. In metallurgy, recrystallization is a process by which deformed grains are replaced by a new set of defect-free grains that nucleate and grow until the original grains have been entirely consumed. Recrystallization is usually accompanied by a reduction in the strength and hardness of a material and a simultaneous increase in the ductility.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 427 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In chemistry, recrystallization is a procedure for purifying compounds. Recrystallization (metallurgy) is a process by which deformed grains are replaced by a new set of defect-free grains that nucleate and grow until the original grains have been entirely consumed. The most important industrial uses are softening of metals previously hardened or rendered brittle by cold work, and control of the grain structure in the final product." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who are the singers in i'm the one?", "passages": [ [ "I'm the One (DJ Khaled song)", "I'm the One (DJ Khaled song)\n\n", "\"I'm the One\" is a song written and recorded by American musician DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne.", "The song was released on April 28, 2017 by We the Best and Epic Records as the second single from Khaled's tenth studio album \"Grateful\".", "DJ Khaled initially marketed the song in February 2017 by posting photos of the music video on his Instagram account.", "He announced the song's release date, title, and cover art on April 24, 2017.", "According to DJ Khaled, Quavo completed his verse for the song in five minutes after listening to the instrumentals.", "\"I'm the One\" debuted atop the \"Billboard\" Hot 100, becoming the first number-one single on the chart for DJ Khaled, Chance the Rapper, and Quavo (as a solo performer apart from Migos).", "It became the first hip hop song to do so since \"Not Afraid\" by Eminem in 2010.", "It became Bieber's fourth chart-topper, following the first three singles off \"Purpose\".", "Lil Wayne topped the chart for the third time in his career, but for the first time since 2009." ] ], "gold": "The main singer in \"I'm the One\" is DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne. ", "prediction 1": "\"I'm the One\" is a song written and recorded by American musician DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne. The track was released on April 28, 2017 by We the Best and Epic Records as the second single from Khaled's tenth studio album \"Grateful\".", "prediction 2": "\"I'm the One\" is a song written and recorded by American musician DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne.", "prediction 3": "The song \"I'm the One\" was written and recorded by American musician DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne.", "prediction 4": "\"I'm the One\" is the first single from DJ Khaled's tenth studio album, \"Grateful\" which features Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 316 } ], "missing-info": [], "corrected-prediction": "\"I'm the One\" is a song written and recorded by American musician DJ Khaled featuring Canadian singer Justin Bieber and American rappers Quavo, Chance the Rapper, and Lil Wayne." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who wrote we're going to be friends?", "passages": [ [ "Suzy Lee (song)", "Suzy Lee (song)\n\n\"Suzy Lee\" is a love song by the American rock band The White Stripes from their 1999 self-titled album.", "The name Suzy Lee appears in the song as well as other instances throughout the White Stripes' discography, most notably from their 2001 album \"White Blood Cells\", in the song \"We're Going to Be Friends\", and the dedication of \"Get Behind Me Satan\" in which Jack White dedicated the album to Suzy Lee, \"Wherever she may be...\"", "It is rumored that Suzy Lee was a childhood friend/crush of his.", "Unlike most of the White Stripes' alternative rock and folk rock songs, \"Suzy Lee\" draws a large influence from blues music, most obviously with the use of a slide guitar throughout the song, played by Johnny Walker of the Soledad Brothers.", "Although it is different from many of their other songs, a characteristically simple and heavy drum beat, played by Meg White, largely drives the song\u2019s melody.", "\"Suzy Lee\" is one of many songs where the White Stripes are compared to the hard rock/blues rock band Led Zeppelin." ], [ "The White Stripes", "The White Stripes performed live for the first time since September 2007 on the final episode of \"Late Night with Conan O'Brien\" on February 20, 2009, where they performed an alternate version of \"We're Going to Be Friends\".", "This proved to be their final live performance as a band.", "In 2009 he reported that the White Stripes were working on their seventh album.", "In an article dated May 6, 2009 with MusicRadar.com, Jack mentioned recording songs with Meg before the Conan gig had taken place, saying, \"We had recorded a couple of songs at the new studio.\"", "About a new White Stripes album, Jack said, \"It won't be too far off.", "Maybe next year.\"", "Jack also explained Meg's acute anxiety during the Stripes' last tour, saying, \"I just came from a Raconteurs tour and went right into that, so I was already full-speed.", "Meg had come from a dead-halt for a year and went right back into that madness.", "Meg is a very shy girl, a very quiet and shy person.", "To go full-speed from a dead-halt is overwhelming, and we had to take a break.\"", "A concert film, \"Under Great White Northern Lights\" premiered at the Toronto International Film Festival on September 18, 2009." ], [ "Jack White", "Jack White\n\nJohn Anthony \"Jack\" White (; born July 9, 1975) is an American singer, songwriter, multi-instrumentalist and producer.", "He is best known as the lead singer and guitarist of the duo The White Stripes, but has also had success in other bands and as a solo artist.", "White has enjoyed consistent critical and popular success and is widely credited as one of the key artists in the garage rock revival of the 2000s.", "He has won twelve Grammy Awards, and all three of his solo albums have reached number one on the \"Billboard\" charts.", "\"Rolling Stone\" ranked him number 70 on its 2010 list of \"The 100 Greatest Guitarists of All Time\".", "David Fricke's 2011 list ranked him at number 17.", "After moonlighting in several underground Detroit bands as a drummer, White founded The White Stripes with fellow Detroit native and then-wife Meg White in 1997.", "Their 2001 breakthrough album, \"White Blood Cells\", brought them international fame with the hit single and accompanying music video \"Fell in Love with a Girl\".", "This recognition provided White opportunities to collaborate with famous artists, including Loretta Lynn and Bob Dylan.", "In 2006, White founded The Raconteurs with Brendan Benson, and in 2009 founded The Dead Weather with Alison Mosshart of The Kills." ] ], "gold": "\"We're Going to Be Friends\" is a song by the American alternative rock band White Stripes from their album White Blood Cells. It was released in late 2002, and tells the story of meeting a new friend at the beginning of a school year. The song was written by singer, songwriter, instrumentalist and producer, Jack White, who is the lead singer and guitarist of the White Stripes, but has also had success in other bands and as a solo artist. White also wrote a book in 2017 based off the song that shares the title.", "prediction 1": "The song \"We're Going to Be Friends\" is a love song by the American rock band The White Stripes. American singer, songwriter, multi-instrumentalist and producer John Anthony \"Jack\" White wrote the song.", "prediction 2": "\"We're Going to Be Friends\" is a love song by the American rock band The White Stripes, which was released in 1999. It is rumored that Suzy Lee was a childhood friend/crush of Jack White. It is also one of many songs where the White Stripes are compared to the hard rock/blues rock band Led Zeppelin. In 2001, the lead singer and guitarist of the duo, Jack White, wrote the song.", "prediction 3": "The song \"We're Going to Be Friends\" is a love song by the American rock band The White Stripes, which was written by lead singer and guitarist Jack White. John Anthony \"Jack\" White wrote the song, and Meg White wrote the lyrics.", "prediction 4": "The love song \"We're Going to Be Friends\" comes from American rock band The White Stripes' 1999 self-titled album. American singer-songwriter, multi-instrumentalist, producer, and guitarist Jack White wrote the song. Jack White is best known as the lead singer and guitarist of the duo The White Stripes, but has also had success in other bands and as a solo artist.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The song \"We're Going to Be Friends\" is a love song by the American rock band The White Stripes from their 2001 album \"White Blood Cells\". American singer, songwriter, multi-instrumentalist and producer John Anthony \"Jack\" White wrote the song. He is best known as the lead singer and guitarist of the duo The White Stripes, but has also had success in other bands and as a solo artist." }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "When did elton john sing candle in the wind?", "passages": [ [ "Candle in the Wind", "Candle in the Wind\n\n\"Candle in the Wind\" is a threnody with music and lyrics by Elton John and Bernie Taupin.", "It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier.", "In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales.", "Candle in the Wind 1997 was released as a single and reached No. 1 in many countries, proving a much greater success than the original, officially being listed as the second best-selling single of all time, behind Bing Crosby's \"White Christmas (song)\".", "The original version in the key of E major appeared on John's 1973 album \"Goodbye Yellow Brick Road\" and was released as a single in 1974.", "The lyrics of the song are a sympathetic portrayal of the life of Marilyn Monroe.", "(The song's opening line \"Goodbye, Norma Jean\" refers to Monroe's real name, Norma Jeane [more commonly spelled Jean] Baker.)", "In the Eagle Vision documentary on the making of \"Goodbye Yellow Brick Road\", Taupin said the song is about \"the idea of fame or youth or somebody being cut short in the prime of their life." ], [ "Candle in the Wind 1997", "Candle in the Wind 1997\n\n\"Candle in the Wind 1997\" is a song by Bernie Taupin and Elton John, a re-written and re-recorded version of their 1974 song \"Candle in the Wind\".", "It was released on 13 September 1997 as a tribute single to Diana, Princess of Wales, with the global proceeds from the song going towards Diana's charities.", "In many countries, it was pressed as a double A-side with \"Something About the Way You Look Tonight\".", "The lyrics were written by Bernie Taupin, and the song produced by Sir George Martin.", "According to the \"Guinness Book of Records\", \"Candle in the Wind 1997\" is the second highest selling single of all time (behind Bing Crosby's \"White Christmas\" from 1942), and it is the highest selling single since charts began in the 1950s.", "After being released, \"Candle in the Wind 1997\" entered at number one in the UK Singles Chart, John's fourth UK number one single, and became the best-selling single in UK Chart history.", "In October it became John's ninth U.S. number one single, where it topped the \"Billboard\" Hot 100 for 14 weeks, and is the best-selling single in \"Billboard\" history, and was the first single certified Diamond in the U.S." ], [ "Candle in the Wind 1997", "The song topped the German Singles Chart for seven weeks and the Australian ARIA Charts for six weeks, and reached number one in Japan, Canada, France and music charts around the world.", "The 1997 version won John the Grammy Award for Best Male Pop Vocal Performance at the 40th Grammy Awards ceremony in 1998.", "At the 1998 Brit Awards the song was nominated for the Brit Award for Best British Single.", "The lyrics of the earlier version of \"Candle in the Wind\", also written by Taupin, were a tribute to Marilyn Monroe.", "The opening lines of the 1973 version, \"Goodbye Norma Jean, though I never knew you at all,\" were adapted to \"Goodbye England's rose, may you ever grow in our hearts.\"", "Most of the lyrics were adapted to suit the circumstances of Diana's life and death.", "On 31 August 1997, Diana, Princess of Wales, died in a car crash in Paris, France.", "The news shocked Elton John, as he and the Princess had been very good friends.", "Earlier in the summer, he had also lost another good friend, fashion designer Gianni Versace.", "Pictures depicting Diana appearing to console a distraught John at Versace's funeral were featured prominently in news coverage throughout the world.", "To cope with the grief, John wanted to pay a tribute to Diana." ] ], "gold": "The lyrics to the song, Candle in the Wind, were written in honor of Marilyn Monroe by Bernie Taupin in 1973. It was performed and recorded by Elton John the same year. Candle in the Wind 1997 is a re-written and re-recorded version of the 1973 song. The 1997 version is a tribute to Diana, Princess of Wales, who died in August 1997.", "prediction 1": "In 1997, Elton John performed a rewritten version of the song Candle in the Wind as a tribute to Diana, Princess of Wales. Candle in the Wind was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1998, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales. In 1997, John performed a rewritten version of the song as a tribute to Diana.", "prediction 2": "\"Candle in the Wind\" is a threnody with music and lyrics by Elton John and Bernie Taupin. It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales. The song was released as a single and reached No. 1 in many countries, proving a much greater success than the original, officially being listed as the second best-selling single of all time, behind Bing Crosby's \"White Christmas\".", "prediction 3": "Candle in the Wind is a threnody with music and lyrics by Elton John and Bernie Taupin. It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales. The song was released on 13 September 1997 as a tribute single for Diana, Princess of Wales. The 1997 version won John the Grammy Award for Best Male Pop Vocal Performance at the 40th Grammy Awards ceremony in 1998.", "prediction 4": "\"Candle in the Wind\" is a threnody with music and lyrics by Elton John and Bernie Taupin. It was originally written in 1973, in honour of Marilyn Monroe, who had died 11 years earlier. In 1997, John performed a rewritten version of the song as a tribute to Diana, Princess of Wales. In 1998, the song won John the Grammy Award for Best Male Pop Vocal Performance at the 40th Grammy Awards ceremony in 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 233 }, { "error type": "Redundant", "explanation": "In 1997, Elton John performed a rewritten version of the song Candle in the Wind as a tribute to Diana", "start": 332, "end": 410 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 237, "end": 242 }, { "error type": "Redundant", "explanation": "In 1997, Elton John performed a rewritten version of the song Candle in the Wind as a tribute to Diana, Princess of Wales.", "start": 243, "end": 331 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "In 1997, Elton John performed a rewritten version of the song Candle in the Wind as a tribute to Diana, Princess of Wales, who died in August 1997. Candle in the Wind was originally written in 1973, in honour of Marilyn Monroe, by Elton John and Bernie Taupin. " }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who plays claire in the time traveler's wife?", "passages": [ [ "The Time Traveler's Wife (film)", "The Time Traveler's Wife (film)\n\nThe Time Traveler's Wife is a 2009 American romantic science fiction drama film based on Audrey Niffenegger's 2003 novel of the same name.", "Directed by Robert Schwentke, the film stars Eric Bana, Rachel McAdams, and Ron Livingston.", "The story follows Henry DeTamble (Bana), a Chicago librarian with a paranormal genetic disorder that causes him to randomly time travel as he tries to build a romantic relationship with Clare Abshire (McAdams), who would become his wife.", "Filming began in September 2007, originally in anticipation of an autumn 2008 release.", "The film's release was postponed with initially no official explanation from the studio.", "McAdams later noted that the delay was due to additional scenes and reshoots that could not be completed until the season at their outdoor location matched previously filmed footage, and Bana had regrown his hair following his work on the 2009 film \"Star Trek\".", "The film was released on August 14, 2009.", "In the early 1970s, Henry DeTamble is in a car accident that kills his mother but which he survives by inadvertently time traveling back two weeks.", "Moments later, Henry is helped by an older version of himself who has also traveled back." ] ], "gold": "The Time Traveler's Wife is the debut novel by the American author Audrey Niffenegger, published in 2003. It is a love story about Henry, a man, with a genetic disorder that causes him to time travel unpredictably, and about Clare, his wife, an artist, who has to cope with his frequent absences and dangerous experiences of reappearing in odd places. In August 2009, a film version was released starring Eric Bana as Henry, and Rachel McAdams as Henry's wife Clare, with Brooklynn Marie Proulx playing the child version of her.", "prediction 1": "The Time Traveler's Wife is a 2009 American romantic science fiction drama film based on Audrey Niffenegger's 2003 novel of the same name. Directed by Robert Schwentke, the film stars Eric Bana, Rachel McAdams, and Ron Livingston. Clare Abshire is played by Rachel McAdams in the film.", "prediction 2": "The Time Traveler's Wife is a 2009 American romantic science fiction drama film based on Audrey Niffenegger's 2003 novel of the same name. It follows Henry DeTamble, a Chicago librarian with a paranormal genetic disorder that causes him to randomly time travel as he tries to build a romantic relationship with Clare Abshire, played by Rachel McAdams.", "prediction 3": "The Time Traveler's Wife is a 2009 American romantic science fiction drama film based on Audrey Niffenegger's 2003 novel of the same name. Directed by Robert Schwentke, the film stars Eric Bana, Rachel McAdams, and Ron Livingston. Clare Abshire, played by Rachel McAdams, is the character Clare in the film.", "prediction 4": "In the 2009 American romantic science fiction drama film The Time Traveler's Wife, Rachel McAdams plays Clare Abshire. Rachel Bana plays Clare DeTamble, a Chicago librarian with a paranormal genetic disorder that causes him to randomly time travel as he tries to build a romantic relationship with Clare Abshire, played by McAdams.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 168 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Time Traveler's Wife is a 2009 American romantic science fiction drama film based on Audrey Niffenegger's 2003 novel of the same name. The film stars Eric Bana, Rachel McAdams, and Ron Livingston. The story follows Henry DeTamble (Bana), a Chicago librarian with a paranormal genetic disorder that causes him to randomly time travel as he tries to build a romantic relationship with Clare Abshire (McAdams), who would become his wife. Clare Abshire is played by Rachel McAdams in the film." }, "preference": [ 2, 0, 2, 0, 0, 2 ] }, { "question": "Which mountain range lies to the east of north america?", "passages": [ [ "Appalachian Mountains", "Appalachian Mountains\n\nThe Appalachian Mountains (), often called the Appalachians, are a system of mountains in eastern North America.", "The Appalachians first formed roughly 480 million years ago during the Ordovician Period.", "They once reached elevations similar to those of the Alps and the Rocky Mountains before experiencing natural erosion.", "The Appalachian chain is a barrier to east-west travel, as it forms a series of alternating ridgelines and valleys oriented in opposition to most highways and railroads running east-west.", "Definitions vary on the precise boundaries of the Appalachians.", "The United States Geological Survey (USGS) defines the \"Appalachian Highlands\" physiographic division as consisting of thirteen provinces: the Atlantic Coast Uplands, Eastern Newfoundland Atlantic, Maritime Acadian Highlands, Maritime Plain, Notre Dame and M\u00e9gantic Mountains, Western Newfoundland Mountains, Piedmont, Blue Ridge, Valley and Ridge, Saint Lawrence Valley, Appalachian Plateaus, New England province, and the Adirondack areas.", "A common variant definition does not include the Adirondack Mountains, which geologically belong to the Grenville Orogeny and have a different geological history from the rest of the Appalachians.", "The mountain range is mostly in the United States (U.S.) but it extends into southeastern Canada, forming a zone from wide, running from the island of Newfoundland southwestward to Central Alabama in the United States." ], [ "Maghreb", "The traditional definition of the region that restricted it to the Atlas Mountains and the coastal plains of Morocco, Algeria, Tunisia, and Libya was expanded by the inclusion of Mauritania and of the disputed territory of Western Sahara.", "During the era of Al-Andalus in the Iberian Peninsula (711\u20131492), the Maghreb's inhabitants, the Muslim Berbers or Maghrebis, were known by Europeans as \"Moors\", or as \"Afariqah\" (Roman Africans).", "Morocco transliterates into Arabic as \"al-Maghreb\" (The Maghreb).", "Before the establishment of modern nation states in the region during the 20th century, \"Maghreb\" most commonly referred to a smaller area, between the Mediterranean Sea and the Atlas Mountains in the south.", "It often also included the territory of eastern Libya, but not modern Mauritania.", "As recently as the late 19th century, Maghreb was used to refer to the Western Mediterranean region of coastal North Africa in general, and to Algeria, Morocco and Tunisia, in particular.", "The region was somewhat unified as an independent political entity during the rule of the Berber kingdom of Numidia, which was followed by the Roman Empire's rule or influence." ], [ "Wildlife of Morocco", "Wildlife of Morocco\n\nThe wildlife of Morocco is composed of its flora and fauna.", "The country has a wide range of terrains and climate types and a correspondingly large diversity of plants and animals.", "The coastal areas have a Mediterranean climate and vegetation while inland the Atlas Mountains are forested.", "Further south, the borders of the Sahara Desert are increasingly arid.", "Large mammals are not particularly abundant in Morocco, but rodents, bats and other small mammals are more plentiful.", "Four hundred and ninety species of birds have been recorded here.", "Morocco is a country in northwestern Africa.", "The land borders include Western Sahara in the southwest and Algeria to the south and east.", "To the north and west Morocco has a long coastline on the Atlantic Ocean; to the north it abuts the Strait of Gibraltar and the Mediterranean Sea.", "It encompasses a wide range of terrain types; there is a coastal plain in the north, and many mountain ranges running from east to west across the country, with the Rif Mountains in the northern half and the Atlas Mountains further south.", "The southern borders are where the Atlas foothills merge into the edges of the Sahara Desert.", "The coastal plain has a Mediterranean climate but is affected by the upwelling cold Canary Current close off-shore; this gives it wet winters and warm summers." ], [ "Mid-Atlantic Ridge", "Mid-Atlantic Ridge\n\nThe Mid-Atlantic Ridge (MAR) is a mid-ocean ridge, a divergent tectonic plate or constructive plate boundary located along the floor of the Atlantic Ocean, and part of the longest mountain range in the world.", "In the North Atlantic it separates the Eurasian and North American plates, and in the South Atlantic it separates the African and South American plates.", "The ridge extends from a junction with the Gakkel Ridge (Mid-Arctic Ridge) northeast of Greenland southward to the Bouvet Triple Junction in the South Atlantic.", "Although the Mid-Atlantic Ridge is mostly an underwater feature, portions of it have enough elevation to extend above sea level.", "The section of the ridge that includes Iceland is known as the Reykjanes Ridge.", "The ridge has an average spreading rate of about per year.", "A ridge under the Atlantic Ocean was first inferred by Matthew Fontaine Maury in 1850.", "The existence of the ridge was discovered during the expedition of HMS \"Challenger\" in 1872.", "A team of scientists on board, led by Charles Wyville Thomson, discovered a large rise in the middle of the Atlantic while investigating the future location for a transatlantic telegraph cable.", "The existence of such a ridge was confirmed by sonar in 1925 and was found to extend around the Cape of Good Hope into the Indian Ocean by the German Meteor expedition." ] ], "gold": "There are several mountain ranges to the east of North America. The Appalachian Mountains, often called the Appalachians, are a system of mountains in eastern to northeastern North America. The Mid-Atlantic Ridge is a mid-ocean ridge (a divergent or constructive plate boundary) located along the floor of the Atlantic Ocean, and part of the longest mountain range in the world. The Atlas Mountains are a mountain range in the Maghreb. It separates the Mediterranean and Atlantic coastlines from the Sahara Desert.", "prediction 1": "The Appalachians are a system of mountains in eastern North America. The Appalachians first formed roughly 480 million years ago during the Ordovician Period. The mountain range is mostly in the United States but it extends into southeastern Canada, forming a zone from wide, running from the island of Newfoundland southwestward to Central Alabama in the United States. The Maghreb is a region in North Africa. It encompasses a wide range of terrain types, with the Rif Mountains in the northern half and the Atlas Mountains further south.\n", "prediction 2": "The Appalaches, also known as the Eastern Mountain Range or simply the Appalachians, are a system of mountains in eastern North America. During the Ordovician Period, the Appalachians first formed and eventually quickly fell. There are several other mountain ranges in this region. Morocco, a country in northwestern Africa, lies to the east of North America and the largest diameter of any mountain range in the world. A mid-ocean ridge lies along the floor of the Atlantic Ocean, and is part of the longest mountain range in the world.", "prediction 3": "The Appalachians are a system of mountains in eastern North America. They lie mostly in the United States but it extends into southeastern Canada, forming a zone from wide, running from the island of Newfoundland southwestward to Central Alabama in the United States. The traditional definition of the region that restricted it to the Atlas Mountains and the coastal plains of Morocco, Algeria, Tunisia, and Libya was expanded by the inclusion of Mauritania and of the disputed territory of Western Sahara. The Morocco transliterates into Arabic as al-Maghreb.", "prediction 4": "The Appalachian Mountains are a system of mountains in eastern North America, originally forming roughly 480 million years ago during the Ordovician Period. The Appalachians are also known as the Atlantic Coast Mountains, and lie mostly in the United States, but extends into southeastern Canada, forming a zone from wide, running from the island of Newfoundland southwestward to Central Alabama in the United States. The geographical region that lies to the east of North America is also known as the Maghreb. Morocco transliterates into Arabic as al-Maghreb, or Maghreb, and the northern side of the Atlantic Ocean. The Mid-Atlantic Ridge (MAR) is a divergent tectonic plate boundary, located along the floor of the Atlantic Ocean, and part of the longest mountain range.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 158 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 383, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 427, "end": 462 }, { "error type": "Irrelevant", "explanation": "", "start": 481, "end": 501 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 541 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Appalachians are a system of mountains in eastern North America. Mid-Atlantic Ridge The Mid-Atlantic Ridge (MAR) is a mid-ocean ridge, a divergent tectonic plate or constructive plate boundary located along the floor of the Atlantic Ocean, and part of the longest mountain range in the world. The Maghreb encompasses the Rif Mountains and the Atlas Mountains that separates the Mediterranean and Atlantic coastlines from the Sahara Desert.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the edwardian era start and end?", "passages": [ [ "Edwardian era", "Edwardian era\n\nThe Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War.", "The death of Queen Victoria in January 1901 marked the end of the Victorian era.", "Her successor, Edward VII, was already the leader of a fashionable elite that set a style influenced by the art and fashions of continental Europe.", "Samuel Hynes described the Edwardian era as a \"leisurely time when women wore picture hats and did not vote, when the rich were not ashamed to live conspicuously, and the sun really never set on the British flag\".", "The Liberals returned to power in 1906 and made significant reforms.", "Below the upper class, the era was marked by significant shifts in politics among sections of society that had largely been excluded from power, such as common labourers, servants, the industrial working class, and the Irish.", "Women became increasingly aware of politics.", "The Edwardian period is sometimes portrayed as a romantic golden age of long summer afternoons and garden parties, basking in a sun that never sets on the British Empire.", "This perception was created in the 1920s and later by those who remembered the Edwardian age with nostalgia, looking back to their childhoods across the abyss of the Great War." ] ], "gold": "The Edwardian era or Edwardian period of British history spanned the reign of King Edward VII, 1901 to 1910, and is sometimes expanded to the start of the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era. Samuel Hynes described the Edwardian era as a \"leisurely time when women wore picture hats and did not vote, when the rich were not ashamed to live conspicuously, and the sun really never set on the British flag.\"", "prediction 1": "The Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era. It began on January 1, 1901, and ended on May 31, 1910.", "prediction 2": "The Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era. The era is sometimes portrayed as a romantic golden age of long summer afternoons and garden parties, basking in a sun that never sets on the British Empire.", "prediction 3": "The Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era. Edward VII was already the leader of a fashionable elite that set a style influenced by the art and fashions of continental Europe.", "prediction 4": "The Edwardian era, or Edwardian period of British history, covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, ", "start": 307, "end": 362 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Edwardian era or Edwardian period of British history covers the brief reign of King Edward VII, 1901 to 1910, and is sometimes extended in both directions to capture long-term trends from the 1890s to the First World War. The death of Queen Victoria in January 1901 marked the end of the Victorian era. Samuel Hynes described the Edwardian era as a \"leisurely time when women wore picture hats and did not vote, when the rich were not ashamed to live conspicuously, and the sun really never set on the British flag\"." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "When was the last time the georgia bulldogs won the ncaa football championship?", "passages": [ [ "Georgia Bulldogs football", "Georgia Bulldogs football\n\nThe Georgia Bulldogs football program represents the University of Georgia in the sport of American football.", "The Bulldogs compete in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Eastern Division of the Southeastern Conference (SEC).", "They play their home games at historic Sanford Stadium on the university's Athens, Georgia, campus.", "Georgia's inaugural season was in 1892.", "UGA claims two consensus national championships (1942 and 1980); the AP and Coaches Polls have each voted the Bulldogs the national champion once (1980); Georgia has also been named the National Champion by at least one polling authority in three other seasons (1927, 1946 and 1968).", "The Bulldogs have won 15 conference championships, including 13 SEC championships (tied for second-most all-time), and have appeared in 54 bowl games, tied for second-most all-time.", "The program has also produced two Heisman Trophy winners, four number-one National Football League (NFL) draft picks, and many winners of other national awards.", "The team is known for its storied history, unique traditions, and rabid fan base, known as the \"Bulldog Nation\".", "Georgia has won over 800 games in their history, placing them 11th all-time in wins." ] ], "gold": "1980 was the last time the Georgia Bulldogs won the NCAA football championship.", "prediction 1": "The Georgia Bulldogs football program represents the University of Georgia in the sport of American football. The Bulldogs compete in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Eastern Division of the Southeastern Conference (SEC). The last time the Georgia Bulldogs won the ncaa football championship was in 1980.", "prediction 2": "The Georgia Bulldogs football program represents the University of Georgia in the sport of American football. The team competes in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Eastern Division of the Southeastern Conference (SEC). The last time the Georgia Bulldogs won the ncaa football championship was in 1980.", "prediction 3": "The Georgia Bulldogs football program represents the University of Georgia in the sport of American football. The Bulldogs compete in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Eastern Division of the Southeastern Conference (SEC). The team has won 15 conference championships, including 13 SEC championships, and have appeared in 54 bowl games, tied for second-most all-time.", "prediction 4": "The Georgia Bulldogs represent the University of Georgia in the sport of American football. The Bulldogs compete in the Football Bowl Subdivision (FBS) of the National Collegiate Athletic Association (NCAA) and the Eastern Division of the Southeastern Conference (SEC). The team has won 15 conference championships, including 13 SEC championships and have appeared in 54 bowl games, tied for second-most all-time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 287 } ], "missing-info": [], "corrected-prediction": "The last time the Georgia Bulldogs won the ncaa football championship was in 1980." }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who wrote the original you were always on my mind?", "passages": [], "gold": "Always on my Mind is the title to several songs. Each song was written by a different individual or individuals. The original version of the song by BJ Thomas was written by Wayne Carson, Mark James, Johnny Christopher. There is a version of Always on my Mind written by Rani Kamalesvaran, Paul Gray. Tiki Tanne, Glen Nathan wrote another song with the same title. Ina Wroldsen, Andreas Romdhane, Josef Larossi wrote the song by Adelen. And, the version of the song that was published on Sam Cooke's album My Kind of Blues, was written by J.W. Alexander.", "prediction 1": "Who wrote the original you were always on my mind?", "prediction 2": "The original you were always on my mind was by Richard Stine.", "prediction 3": "There are a few. In the original you were always on my mind, the writer was James Joyce.", "prediction 4": "I was always on my mind.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 50 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What are the books in the game of thrones series?", "passages": [], "gold": "The books in The Game of Thrones series 1 through 5 are A Game of Thrones, A Clash of Kings, A Storm of Swords, A Feast for Crows, A Dance with Dragons. These have been released already. Series 6 and 7 have not yet been released, and are titled The Winds of Winter and A Dream of Spring.", "prediction 1": "There are several books in the Game of Thrones series.", "prediction 2": "The Game of Thrones series consists of six books.", "prediction 3": "The Game of Thrones series is a fantasy series written by Stephen King that is set in the fictional world of the fictional kingdom of England. There are 3 books in the Game of Thrones series.", "prediction 4": "There are a number of books in the Game of Thrones series.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 54 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When were the olympic games banned from greece?", "passages": [ [ "Ancient Olympic Games", "Ancient Olympic Games\n\nThe ancient Olympic Games were originally a festival, or celebration of and for Zeus; later, events such as a footrace, a javelin contest, and wrestling matches were added.", "The Olympic Games (, \"Olympia\", \"the Olympics\"; also , , \"the Olympiad\") were a series of athletic competitions among representatives of city-states and one of the Panhellenic Games of ancient Greece.", "They were held in honor of Zeus, and the Greeks gave them a mythological origin.", "The first Olympics is traditionally dated to 776 BC.", "They continued to be celebrated when Greece came under Roman rule, until the emperor Theodosius I suppressed them in AD393 as part of the campaign to impose Christianity as the State religion of Rome.", "The games were held every four years, or \"olympiad\", which became a unit of time in historical chronologies.", "During the celebration of the games, an Olympic Truce was enacted so that athletes could travel from their cities to the games in safety.", "The prizes for the victors were olive leaf wreaths or crowns.", "The games became a political tool used by city-states to assert dominance over their rivals.", "Politicians would announce political alliances at the games, and in times of war, priests would offer sacrifices to the gods for victory.", "The games were also used to help spread Hellenistic culture throughout the Mediterranean.", "The Olympics also featured religious celebrations." ] ], "gold": "The olympic games were banned from Greece in AD393, when the emperor Theodosius I suppressed them.", "prediction 1": "The Olympic Games were originally a festival, or celebration of and for Zeus; later, events such as a footrace, a javelin contest, and wrestling matches were added. During the celebration of the games, an Olympic Truce was enacted so that athletes could travel from their cities to the games in safety.", "prediction 2": "The Olympic Games were originally a festival, or celebration of and for Zeus, and one of the Panhellenic Games of ancient Greece. The first Olympics is traditionally dated to 776 BC, and continued to be celebrated when Greece came under Roman rule, until the emperor Theodosius I suppressed them in AD393 as part of the campaign to impose Christianity as the State religion of Rome.", "prediction 3": "The Olympic Games, officially known as the Olympics, were a series of athletic competitions among representatives of city-states and one of the Panhellenic Games of ancient Greece. They continued to be celebrated when Greece came under Roman rule, until the emperor Theodosius I suppressed them in AD393. The olympic games were banned from Greece in 2004.", "prediction 4": "The Olympic Games, commonly known as the Olympics, were originally a festival, or celebration of and for Zeus; later, events such as a footrace, a javelin contest, and wrestling matches were added. The first Olympic Games is traditionally dated to 776 BC. They continued to be celebrated when Greece came under Roman rule, until the emperor Theodosius I suppressed them in AD393.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 302 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "They continued to be celebrated when Greece came under Roman rule, until the emperor Theodosius I suppressed them in AD393" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who wrote the lyrics for new york new york?", "passages": [ [ "New York, New York (Ryan Adams song)", "New York, New York (Ryan Adams song)\n\n\"New York, New York\" is a song written and performed by American alt-country musician Ryan Adams.", "It appeared on his 2001 album \"Gold\".", "The song earned Adams a Grammy Award nomination for Best Male Rock Vocal, and the single reached #53 in the UK charts in December 2001.", "In 2009, the song was included in \"The Guardian\"s \"1000 Songs Everyone Must Hear\".", "The song's lyrics mention several lower Manhattan geographic references, including the intersection of Avenue A and 10th Street, Houston Street, and", "Avenue B.", "The music video features Adams performing in front of the city's skyline from Brooklyn and was filmed four days before the September 11 attacks on the World Trade Center.", "As a result, a message was placed at the end of the video, dedicating it to those who lost their lives, and to \"those who worked to save them\".", "Profits from the video were donated to a September 11 charity.", "Adams had previously filmed and finished an entirely different video for the song, but decided at the last minute to scrap it and film a new one focusing on the Manhattan skyline (specifically the World Trade Center)." ], [ "Theme from New York, New York", "Theme from New York, New York\n\n\"Theme from \"New York, New York\"\" (or \"New York, New York\") is the theme song from the Martin Scorsese film \"New York, New York\" (1977), composed by John Kander, with lyrics by Fred Ebb.", "It was written for and performed in the film by Liza Minnelli.", "It remains one of the best-known songs about New York City.", "In 2004 it finished #31 on AFI's 100 Years...100", "Songs survey of top tunes in American Cinema.", "In 1979, \"Theme from \"New York, New York\"\" was re-recorded by Frank Sinatra for his album \"\" (1980), and has since become closely associated with him.", "He occasionally performed it live with Minnelli as a duet.", "Sinatra recorded it a second time for his 1993 album \"Duets\", with Tony Bennett." ], [ "New York, New York (On the Town)", "New York, New York (On the Town)\n\n\"New York, New York\" is a song from the 1944 musical \"On the Town\" and the 1949 MGM musical film of the same name.", "The music was written by Leonard Bernstein and the lyrics by Betty Comden and Adolph Green.", "A well known line of this song is, \"New York, New York, a helluva town.", "The Bronx is up but the Battery's down.\"", "For the film version, the word \"helluva\" was changed to \"wonderful\" to appease the Production Code offices.", "In 2004 the film version finished at #41 in AFI's 100 Years...100 Songs survey of top tunes in American cinema.", "It is not to be confused with the \"Theme from \"New York, New York\"\", originally performed by Liza Minnelli and later popularized by Frank Sinatra.", "The theme from \"New York, New York\" was referenced by John Williams for his celebratory \"For New York\", composed in 1988 for Bernstein's 70th birthday gala.", "The song was parodied as \"Springfield, Springfield\" in the 1993 episode \"Boy-Scoutz 'n the Hood\" of \"The Simpsons\"." ] ], "gold": "New York, New York is a song title of several songs, written by several people. The song from the 1944 musical, On The Town, was written by Betty Comden and Adolph Green. New York, New York theme song from the 1977 film with the same name, was written by Fred Ebb. And, the 2001 alt-country song, New York, New York, was written by Ryan Adams.", "prediction 1": "\"New York, New York\" is a song written and performed by American alt-country musician Ryan Adams. The song appeared on his 2001 album Gold and earned Adams a Grammy Award nomination for Best Male Rock Vocal. \"Theme from New York, New York\" is the theme song from the 1944 musical \"On the Town\" and the 1949 MGM musical film of the same name. The music was written by Leonard Bernstein and the lyrics by Betty Comden and Adolph Green.", "prediction 2": "\"New York, New York\" is a song written and performed by American alt-country musician Ryan Adams. It appeared on his 2001 album Gold. The song earned Adams a Grammy Award nomination for Best Male Rock Vocal. Theme from \"New York, New York\" is a song from the 1944 musical On the Town and the 1949 MGM musical film of the same name. The music was written by Leonard Bernstein and the lyrics by Betty Comden and Adolph Green.", "prediction 3": "\"New York, New York\" is a song written and performed by American alt-country musician Ryan Adams. It appeared on his 2001 album Gold and earned Adams a Grammy Award nomination for Best Male Rock Vocal. \"Theme from New York, New York\" is a song from the 1944 musical \"On the Town\" and the 1949 MGM musical film of the same name. The music was written by Leonard Bernstein and the lyrics by Betty Comden and Adolph Green.", "prediction 4": "\"New York, New York\" is a song written and performed by American alt-country musician Ryan Adams. It appeared on his 2001 album Gold and earned Adams a Grammy Award nomination for Best Male Rock Vocal. The theme from New York, New York, is a song from the 1944 musical On the Town and the 1949 MGM musical film of the same name. The music was written by Leonard Bernstein and the lyrics by Betty Comden and Adolph Green.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 52 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 388 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 208, "end": 219 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"New York, New York\" is a song title of several songs, written by several people. The song from the 1944 musical, On The Town, was written by Betty Comden and Adolph Green. New York, New York theme song from the 1977 film with the same name, were written by Fred Ebb. Additionally, it is a 2001 song written by American alt-country musician Ryan Adams. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was the first king size bed made?", "passages": [ [ "Bed", "Elsewhere, there was also the closed bed with sliding or folding shutters, and in England\u2014where beds were commonly quite simple in form\u2014the four poster was the usual citizen's bed until the middle of the 19th century.", "Bed sizes vary considerably around the world, with most countries having their own standards and terminology.", "While the \"double\" size appears to be standard among English speaking countries, based on the imperial measurement of 4\u00a0ft 6\u00a0in by 6\u00a0ft 3\u00a0in (137\u00a0cm x 190\u00a0cm), the sizes for other bed types tend to vary.", "Mainland European sizes differ, not merely because of the use of the metric system.", "In the mid-1950s, the United States bedding industry introduced a new size: the king size.", "A king-sized bed differs from the other sizes in implementation, as it is not common to have a king-sized box spring; rather, two smaller box-springs are used under a king-sized mattress.", "It is a common misconception that in a US \"standard\" or \"Eastern king\", the box springs are identical in size to a \"twin extra-long\"; however, \"twin extra-long\" mattresses next to each other add up to wide instead of the width that is standard for an \"eastern king\"." ] ], "gold": "Larger mattresses that were later standardized as king size beds were made in the mid-1940s. Before then, most beds had been either twins or doubles. The first standardized king size beds were made in the 1950s. ", "prediction 1": "In the mid-1950s, the United States bedding industry introduced a new size: the king size. A king-sized bed differs from the other sizes in implementation, as it is not common to have a king-sized box spring; rather, two smaller box-springs are used under a king-sized mattress.", "prediction 2": "The first king size bed was made in the mid-1950s.", "prediction 3": "The first king size bed was made in the United States in the mid-1950s. The first king size bed was made in the United Kingdom in 1921.", "prediction 4": "The first king size bed was made in the late 1950s.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 278 } ], "missing-info": [], "corrected-prediction": "In the mid-1950s, the United States bedding industry introduced a new size: the king size." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who dies in guardians of the galexy 2?", "passages": [ [ "Guardians of the Galaxy Vol. 2", "Ayesha, leader of the Sovereign race, has the Guardians protect valuable batteries from an inter-dimensional monster in exchange for Gamora's estranged sister Nebula, who was caught attempting to steal the batteries.", "After Rocket steals some for himself, the Sovereign attacks the Guardians' ship with a fleet of drones.", "These are destroyed by a mysterious figure, and the Guardians crash-land on a nearby planet.", "There, this figure reveals himself as Quill's father, Ego, and invites Quill, Gamora, and Drax to his home planet.", "Rocket and Groot remain behind to repair the ship and guard Nebula.", "Ayesha hires Yondu Udonta and his crew, who have been exiled from the greater Ravager community for child trafficking, to recapture the Guardians.", "They capture Rocket, but when Yondu hesitates to turn over Quill, whom he raised, his lieutenant Taserface leads a mutiny with help from Nebula.", "Taserface imprisons Rocket and Yondu aboard the latter's ship and executes his loyalists by releasing them into space.", "Nebula leaves to find and kill Gamora, whom she blames for the torture inflicted on her by their father, Thanos.", "While imprisoned, Rocket and Yondu bond." ], [ "Guardians of the Galaxy Vol. 2", "The Guardians hold a funeral for Yondu, which is attended by Kraglin and dozens of Ravager ships, acknowledging Yondu's sacrifice and accepting him as a Ravager again.", "In a series of mid- and post-credit scenes, Kraglin takes up Yondu's telekinetic arrow and control-fin; Ravager leader Stakar Ogord reunites with his ex-teammates; Groot has grown into a teenager; Ayesha creates a new artificial being with whom she plans to destroy the Guardians, naming him Adam; and a group of uninterested Watchers abandon their informant, who is discussing his experiences on Earth.", "Additionally, reprising their roles from the first film are Laura Haddock as Meredith Quill, Gregg Henry as her father, Seth Green as the voice of Howard the Duck, and canine actor Fred as Cosmo." ] ], "gold": "There are several deaths in Guardians of the Galaxy 2. Taserface warns the Soverign and dies. Ego dies due to a bomb blast, and Yondu Udonta dies after sacrificing himself to save Quill.", "prediction 1": "In Guardians of the Galaxy Vol. 2, Ego dies after he is shot by a drone, and Yondu dies after he is shot by Taserface.", "prediction 2": "In Guardians of the Galaxy Vol. 2, Yondu Udonta dies. The Guardians hold a funeral for him, attended by Kraglin and dozens of Ravager ships, acknowledging his sacrifice and accepting him as a Ravager again.", "prediction 3": "Yondu dies in Guardians of the Galaxy Vol. 2 after being beaten to death by Taserface, a mutiny leader who has been imprisoned for child trafficking.", "prediction 4": "In the second Guardian of the Galaxy film, Gamora's estranged sister Nebula dies. Gamora's father Ego dies in the film. Yondu Udonta dies in the film, as does Rocket Udonta.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 35, "end": 72 } ], "missing-info": [], "corrected-prediction": "In Guardians of the Galaxy Vol. 2, Yondu dies after he is shot by Taserface." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who were the leaders of the battle of chickamauga?", "passages": [ [ "Battle of Chickamauga", "Battle of Chickamauga\n\nThe Battle of Chickamauga, fought on September 18 \u2013 20, 1863, between U.S. and Confederate forces in the American Civil War, marked the end of a Union offensive in southeastern Tennessee and northwestern Georgia \u2014 the Chickamauga Campaign.", "It was the first major battle of the war fought in Georgia, the most significant Union defeat in the Western Theater, and involved the second-highest number of casualties after the Battle of Gettysburg.", "The battle was fought between the Army of the Cumberland under Maj. Gen. William Rosecrans and the Confederate Army of Tennessee under Gen. Braxton Bragg, and was named for Chickamauga Creek, which meanders near the battle area in northwest Georgia (and ultimately flows into the Tennessee River about 3.5 miles (5.6\u00a0km) northeast of downtown Chattanooga).", "After his successful Tullahoma Campaign, Rosecrans renewed the offensive, aiming to force the Confederates out of Chattanooga.", "In early September, Rosecrans consolidated his forces scattered in Tennessee and Georgia and forced Bragg's army out of Chattanooga, heading south.", "The Union troops followed it and brushed with it at Davis's Cross Roads.", "Bragg was determined to reoccupy Chattanooga and decided to meet a part of Rosecrans's army, defeat it, and then move back into the city." ] ], "gold": "The Confederate leader at the Battle of Chickamauga was Braxton Bragg. William Rosecrans was the Union leader at the Battle of Chickamauga.", "prediction 1": "The Battle of Chickamauga was fought on September 18 \u2013 20, 1863, between the Union Army and the Confederate Army. The Union Army was led by Maj. Gen. William Rosecrans and the Confederate Army of Tennessee was led by Gen. Braxton Bragg.", "prediction 2": "The battle of Chickamauga was fought on September 18 \u2013 20, 1863, between the United States Army of the Cumberland under Maj. Gen. William Rosecrans and the Confederate Army of Tennessee under Gen. Braxton Bragg.", "prediction 3": "The Battle of Chickamauga, fought on September 18 \u2013 20, 1863, between the Union Army of the Cumberland and the Confederate Army of Tennessee, marked the end of a Union offensive in southeastern Tennessee and northwestern Georgia \u2013 the Chickamauga Campaign. The battle was fought between the Army of the Cumberland under Maj. Gen. William Rosecrans and the Confederate Army of Tennessee under Gen. Braxton Bragg, and was named for Chickamauga Creek, which meander near the battle area in northwest Georgia.", "prediction 4": "The Battle of Chickamauga, fought on September 18 \u2013 20, 1863, between the United States and Confederate forces in the American Civil War, marked the end of a Union offensive in southeastern Tennessee and northwestern Georgia \u2014 the Chickamauga Campaign. The battle was fought between the Army of the Cumberland under Maj. Gen. William Rosecrans and the Confederate Army of Tennessee under Gen. Braxton Bragg, and was named for Chickamauga Creek, which meanders near the battle area in northwest Georgia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 113 } ], "missing-info": [], "corrected-prediction": "The Union Army was led by Maj. Gen. William Rosecrans and the Confederate Army of Tennessee was led by Gen. Braxton Bragg at the Battle of Chickamauga. " }, "preference": [ 0, 1, 1, 1, 1, 0 ] }, { "question": "Who has become the new prime minister of pakistan?", "passages": [ [ "Prime Minister of Pakistan", "In each of these periods, the military junta led by the President had the powers of the Prime Minister.", "Imran Khan has held the office of Prime Minister since 18 August 2018, following the outcome of nationwide general elections held on 25 July 2018.", "The office of the Prime Minister was created on immediate effect after the partition and the establishment of Pakistan in 1947; the Prime Minister existed alongside the Governor-General who was the representative of the British Monarchy.", "The first Prime Minister, Liaquat Ali Khan, exercised central executive powers until his assassination in 1951.", "However, the powers slowly began to be reduced as a result of constant intervention by the Governor-General.", "Despite the first set of the Constitution giving central power in 1956, the next six prime ministers were dismissed by the Governor-General from 1951 till 1957.", "In addition, the first set of the Constitution had evolved the Governor-General into the President of Pakistan whilst declaring the country an \"Islamic republic\".", "In 1958, President Iskandar Mirza dismissed the seventh prime minister to impose martial law in a mere two weeks, President Mirza was ousted by army chief General Ayub Khan who had for a brief period held the post of Prime Minister.", "In 1962, the second set of the Constitution completely dissolved the office of prime minister as all powers were transferred to the President of Pakistan." ], [ "Prime Minister of Pakistan", "A populist intellectual movement leading to the departure of Pervez Musharraf allowed Asif Zardari to become President.", "In 2010, the XVIII Amendment to the Constitution of Pakistan was passed to reverse the XVII amendment; it returned the country to being a parliamentary democratic republic.", "In addition, the XVIII Amendment removed all powers of the presidency to dissolve the Parliament unilaterally and sweep away the powers amassed by the former presidents Pervez Musharraf and Zia-ul-Haq to maintain a delicate check and balance.", "Following a contempt of court case, the Supreme Court permanently disqualified Prime Minister Yousuf Raza Gillani.", "Originally, the PPP nomination was Makhdoom Shahbuddin, but he was forced to withdraw after the ANF issued non-bailable arrest warrants against him.", "Raja Pervaiz Ashraf became the Prime Minister and remained in office until 2013.", "The general election held in 2013 saw the PML(N) almost achieve a supermajority.", "Following this, Nawaz Sharif was elected as Prime Minister, returning to the post for the third time after a fourteen-year absence, in a democratic transition.", "In 2017, Sharif was forced to step down as prime minister following corruption charges against him.", "On August 18, 2018, Imran Khan was sworn in as the country's 21st prime minister." ], [ "Shahid Khaqan Abbasi", "According to BBC Urdu, Abbasi had not became a part of any major political or financial controversy throughout his time in a ministerial office which is considered a high-profile cabinet slot.", "Nawaz Sharif resigned as Prime Minister on 29 July 2017 and nominated his brother Shehbaz Sharif as his successor, but as Shehbaz was not a member of the National Assembly, he could not be immediately sworn in as Prime Minister.", "Therefore, Abbasi was chosen by Sharif as a temporary Prime Minister for 45 days, which would allow two months time for Shehbaz to contest elections from Nawaz's vacated constituency in Lahore, be elected to the National Assembly, and become eligible to be Prime Minister.", "BBC News noted that Abbasi was selected as the Prime Minister for two reasons.", "The first for being the least controversial among the PML-N leaders, and the second for having links with the Military of Pakistan." ], [ "Nawaz Sharif", "Sharif was sworn in for an unprecedented third term on 7 June 2013 after the resounding election victory of the PML-N.\nAfter being sworn in, he faced numerous challenges, including bringing an end to US drone strikes and Taliban attacks while also tackling a crippled economy.", "Speculation was rife that the new government may need a bailout from the International Monetary Fund to restore economic stability.", "Unlike Sharif's previous two governments which were underpinned by social conservatism, Sharif's third term is credited to be one of social centrism.", "He called the future of Pakistan as one underpinned as an \"educated, progressive, forward looking and an enterprising nation\".", "In January 2016, he also moved to back Punjab Government's policy of banning Tablighi Jamaat from preaching in educational institutions and in February 2016 he enacted a law that provides for a helpline for women to report abuses by their husbands and others despite the criticism of conservative religious parties.", "His government hanged Mumtaz Qadri on 29 February 2016.", "Qadri had shot Salman Taseer to death in 2011 over his opposition to blasphemy laws.", "According to BBC News, the move to hang Qadri is an indication of government's growing confidence in taming the street power of religious groups." ], [ "Shahid Khaqan Abbasi", "On 1 August 2017, Abbasi was elected as Prime Minister of Pakistan by the National Assembly, defeating his rival Naveed Qamar of the PPP by 221 votes to 47.", "Jamiat Ulema-e Islam (F) and the Muttahida Qaumi Movement also supported his election.", "Addressing the National Assembly after his election, he said, \"I may be here for 45 days or 45 hours, but I'm not here to keep the seat warm.", "I intend to work and get some important things done.\"", "On that same day, he was sworn in as the Prime Minister in an oath-taking ceremony at the Presidency Palace.", "After he took charge, Nawaz Sharif decided that Shehbaz Sharif would remain in Punjab and Abbasi would continue as Prime Minister until the June 2018 general election.", "According to Rana Sanaullah Khan, PML-N senior leadership feared that if Shahbaz Sharif left the post of Chief Ministership of Punjab it would weaken the party's hold in the country's most populous province, which has 183 out of the 342 seats in the National Assembly and plays a crucial role in determining the successive government in Pakistan." ], [ "Abbasi ministry", "Abbasi ministry\n\nThe Abbasi ministry was formed by Shahid Khaqan Abbasi on 4 August 2017 to begin a new government following the disqualification of Nawaz Sharif from the post of Prime Minister of Pakistan until end May 2018 when justice Nasirul Mulk take oath as new caretaker prime minister.", "The ministry, a Pakistan Muslim League (N) majority government, succeeded the third Sharif ministry, which was formed following the 2013 general election and had dissolved in the July 2017 after Nawaz Sharif was disqualification by the Supreme Court of Pakistan to hold the office of Prime Minister." ] ], "gold": "Imran Khan became the Prime Minister of Pakistan in 18 August 2018, following the outcome of nationwide general elections held on 25 July 2018. He succeeded Shahid Khaqan Abassi, who became Prime Minister in 2017 after the Pakistani National Assembly voted for him. Abassi was priviously chosen by Nawaz Sharif to act as a temporary Primer Minister, following corruption charges against him resulting from Panama papers leak. Sharif had served the position from 2013 to 2017.", "prediction 1": "Imran Khan has held the office of Prime Minister of Pakistan since 18 August 2018, following the outcome of nationwide general elections held on 25 July 2018. The current prime minister of Pakistan is Nawaz Sharif, who resigned as Prime Minister on 29 July 2017 and nominated his brother Shehbaz Sharif as his successor.\n", "prediction 2": "In Pakistan, there have been several Prime Ministers. In 2017, Nawaz Sharif was elected as Prime Minister following a 14 year absence. In 2018, Imran Khan was sworn in as the 21st Prime Minister of Pakistan. Nawaz Sharif resigned as Prime Minister on 29 July 2017 and nominee Shahid Khaqan Abbasi was named as his successor.", "prediction 3": "Imran Khan, the 21st Prime Minister of Pakistan, was sworn in on 18 August 2018 following the outcome of nationwide general elections held on 25 July 2018. Nawaz Sharif was elected as the 21st Prime Minister prior to the 2017 elections, but he was replaced by his brother Shehbaz Sharif.", "prediction 4": "In Pakistan, the office of the Prime Minister was created on immediate effect after the partition and the establishment of Pakistan in 1947, and the first prime minister, Liaquat Ali Khan, exercised central executive powers until his assassination in 1951. However, the powers slowly began to be reduced as a result of constant intervention by the Governor-General. In 2013, Nawaz Sharif was elected as Prime Minister, returning to the post for the third time after a fourteen-year absence, in a democratic transition. Nawaz Sharif resigned as Prime Minister on 29 July 2017 and nominated his brother Shehbaz Sharif as his successor but as a member of the National Assembly, he could not be immediately sworn in as Prime Minister. On August 18, 2018, Imran Khan was sworn in as the country's 21st Prime Minister.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 163, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 321 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "Imran Khan has held the office of Prime Minister of Pakistan since 18 August 2018, following the outcome of nationwide general elections held on 25 July 2018. The former prime minister of Pakistan was Nawaz Sharif, who resigned on 29 July 2017, he was sworn in for his third term in 2013. He resigned following corruption charges against him. Shahid Khaqan Abbasi was chosen by Sharif as a temporary Prime Minister Another was Raja Pervaiz Ashraf, who held office until 2013. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who led the committee of public safety apex?", "passages": [ [ "Committee of Public Safety", "Committee of Public Safety\n\nThe Committee of Public Safety (), created in April 1793 by the National Convention and then restructured in July 1793, formed the \"de facto\" executive government in France during the Reign of Terror (1793\u20131794), a stage of the French Revolution.", "The Committee of Public Safety succeeded the previous Committee of General Defence (established in January 1793) and assumed its role of protecting the newly established republic against foreign attacks and internal rebellion.", "As a wartime measure, the Committee\u2014composed at first of nine and later of twelve members\u2014was given broad supervisory powers over military, judicial and legislative efforts.", "It was formed as an administrative body to supervise and expedite the work of the executive bodies of the Convention and of the government ministers appointed by the Convention.", "As the Committee tried to meet the dangers of a coalition of European nations and counter-revolutionary forces within the country, it became more and more powerful.", "Following the defeat at the Convention of the Girondins in June 1793, a prominent Jacobin identified as a radical, Maximilien Robespierre, was added to the Committee.", "The power of the Committee peaked between August 1793 and July 1794.", "In December 1793, the Convention formally conferred executive power upon the Committee.", "The execution of Robespierre in July 1794 represented a reactionary period against the Committee of Public Safety." ], [ "Committee of Public Safety", "Closely associated with the leadership of Danton, it was initially known as the Danton Committee.", "Danton steered the Committee through the 31 May and 2 June 1793 \"journ\u00e9es\" that resulted in the fall of the Girondins and through the intensifying war in the Vend\u00e9e.", "When the Committee was recomposed on 10 July 1793, Danton was not included.", "Nevertheless, he continued to support the centralization of power by the Committee.", "On 27 July 1793, Maximilien Robespierre was elected to the Committee.", "At this time, the Committee was entering a more powerful and active phase, which would see it become a \"de facto\" dictatorship alongside its powerful partner, the Committee of General Security.", "The role of the Committee of Public Safety included the governance of the war (including the appointment of generals), the appointing of judges and juries for the Revolutionary Tribunal, the provisioning of the armies and the public, the maintenance of public order and oversight of the state bureaucracy.", "The Committee was also responsible for interpreting and applying the decrees of the National Convention and thus for implementing some of the most stringent policies of the Terror\u2014for instance, the \"lev\u00e9e en masse\" passed on 23 August 1793, the Law of Suspects passed on 17 September 1793 and the Law of the Maximum passed on 29 September 1793." ] ], "gold": "The Committee of Public Safety, initially known as the Danton Committee, formed a provisional government in France on April 6, 1793, during the French Revolution. In the beginning, Georges Danton steered the committee. However, after July 1793, the committee was headed by the radical Jacobin Maximilien Robespierre under whose leadership it organized the Reign of Terror.", "prediction 1": "The Committee of Public Safety was created in April 1793 by the National Convention and then restructured in July 1793, and formed the \"de facto\" executive government in France during the Reign of Terror, a stage of the French Revolution. Closely associated with the leadership of Danton, it was initially known as the Danton Committee. Danton steered the Committee through the 31 May and 2 June 1793 \"journ\u00e9es\" that resulted in the fall of the Girondins and through the intensifying war in the Vend\u00e9e. Robespierre was elected to the Committee, Maximilien Robespierre was elected to the Committee.", "prediction 2": "The Committee of Public Safety was a constitutional body established in April 1793 by the National Convention and then restructured in July 1793. Closely associated with the leadership of Danton, it was initially known as the Danton Committee. Danton steered the Committee through the 31 May and 2 June 1793 \"journ\u00e9es\" that resulted in the fall of the Girondins and through the intensifying war in the Vend\u00e9e. On 27 July 1793, Maximilien Robespierre was elected to the Committee.", "prediction 3": "The Committee of Public Safety was created in April 1793 by the National Convention and then restructured in July 1793, and formed the \"de facto\" executive government in France during the Reign of Terror (1793\u20131794), a stage of the French Revolution. Closely associated with the leadership of Danton, it was initially known as the Danton Committee. Danton steered the Committee through the 31 May and 2 June 1793 \"journ\u00e9es\" that resulted in the fall of the Girondins and through the intensifying war in the Vend\u00e9e. But it was soon becoming a more powerful and active phase, which would see it become a \"de facto\" dictatorship alongside its powerful partner, the Committee of General Security. On 27 July 1793, Maximilien Robespierre was elected to the Committee.", "prediction 4": "The Committee of Public Safety was created in April 1793 by the National Convention and then restructured in July 1793, formed the \"de facto\" executive government in France during the Reign of Terror, a stage of the French Revolution. Closely associated with the leadership of Simon Danton, it was initially known as the Danton Committee. On 27 July 1793, Maximilien Robespierre was elected to the Committee.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 502 }, { "error type": "Redundant", "explanation": " Robespierre was elected to the Committee, ", "start": 545, "end": 597 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Committee of Public Safety was created in April 1793 by the National Convention and then restructured in July 1793, and formed the \"de facto\" executive government in France during the Reign of Terror, a stage of the French Revolution. Closely associated with the leadership of Danton, it was initially known as the Danton Committee. Georges Danton steered the Committee. On 27 July 1793, Maximilien Robespierre was elected to the Committee under whose the committee becomes a \"de facto\" dictatorship." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When is the new andi mack episode coming out?", "passages": [ [ "Andi Mack", "Minsky had created the popular sitcom \"Lizzie McGuire\", which aired from 2001 to 2004, but was initially reluctant to create another teen-oriented series.", "Minsky eventually found inspiration for the series in an article on how actor Jack Nicholson had learned as an adult that the woman whom he believed to be his sister was actually his mother.", "Disney Channel ordered a pilot based on the concept in November 2015, and subsequently ordered \"Andi Mack\" to series in August 2016.", "The series started filming in Salt Lake City in September 2016, and finished filming in December 2016.", "The first episode became available on the Disney Channel App, On-Demand, Disney Channel's YouTube, iTunes, Amazon, and Google Play on March 10, 2017, while the second episode became available the same day via Disney Channel On-Demand as well as to subscribers using the Disney Channel App.", "The series premiered on Disney Channel on April 7, 2017.", "A total of 13 episodes were ordered for the first season; however, only 12 episodes were aired.", "Disney Channel renewed the series for a second season on May 25, 2017.", "The filming of the second season began in July 2017.", "On August 20, 2017, five additional episodes were ordered for the second season.", "One week prior to the season two premiere, a music video for the full version of the series' theme song was released, starring the entire cast." ], [ "Andi Mack", "Andi Mack\n\nAndi Mack is an American family comedy-drama television series created by Terri Minsky that premiered on Disney Channel on April 7, 2017.", "The series stars Peyton Elizabeth Lee, Joshua Rush, Sofia Wylie, Asher Angel, Lilan Bowden, Lauren Tom, and Trent Garrett.", "It follows 13-year-old Andi Mack and her best friends, Cyrus Goodman and Buffy Driscoll, as they attend middle school.", "\"Andi Mack\" is the top-rated series on American television among all girls and in its time period among all children ages 6\u201314.", "It is the first series on Disney Channel to feature a gay middle school boy, Cyrus Goodman, which has drawn considerable media attention and was reported in the news as \"history\".", "The series has been nominated for and won awards for his coming out storyline, the introduction of which caused a ratings surge.", "On the night of her thirteenth birthday, Andi Mack's world is turned upside down when she discovers that whom she believed to be her sister, Bex, is actually her mother.", "Andi joins her middle school frisbee team to get close to Jonah, whom both she and her best friend Cyrus are developing romantic feelings for, while also competing with Jonah's high school girlfriend Amber." ], [ "Andi Mack", "On October 25, 2017, TVLine revealed that in the second season, Cyrus will begin to realize that he has romantic feelings for Jonah, following through from several hints in the first season, making him the first gay main character with a coming out storyline on Disney Channel.", "The second season premiered on Disney Channel on October 27, 2017.", "On February 19, 2018, Disney Channel announced that \"Andi Mack\" had been renewed for a third season, with the cast informed about the renewal live on \"Good Morning America\" by the creator that day.", "The third season premiered on October 8, 2018.", "On November 13, 2018, it was announced that the series would be featuring a two-episode arc\u2014\"Cookie Monster\" and \"The New Girls\"\u2014revolving around gun safety and peer pressure.", "On December 14, 2018, it was announced that Stoney Westmoreland was fired by Disney Channel and would no longer appear on the series, because of his arrest for allegedly planning a sexual liaison with a 13-year-old.", "The series has been praised for accurately representing the lives of young teenagers, with examples including a learning disability, panic attacks, a bar mitzvah, and the unplanned pregnancy of the mother of the title character." ] ], "gold": "Andi Mack is an American family comedy-drama television series that aired on Disney Channel. The top-rated series ran for three seasons. The series premiered on April 7, 2017. The second season began airing on October 27, 2017. The first episode of the last season aired on October 8, 2018.", "prediction 1": "Andi Mack is an American family comedy-drama television series created by Terri Minsky that premiered on Disney Channel on April 7, 2017. The first episode became available on the Disney Channel App, On-Demand, Disney Channel's YouTube, iTunes, Amazon, and Google Play on March 10, 2017, while the second episode became available the same day via Disney Channel On-Demand as well as to subscribers using the Disney Channel App.", "prediction 2": "Andi Mack is an American family comedy-drama television series created by Terri Minsky that premiered on Disney Channel on April 7, 2017. Episode 1 came out on the Disney Channel App, On-Demand, Disney Channel's YouTube, iTunes, Amazon, and Google Play on March 10, 2017. Episode 2 came out the same day via Disney Channel On-Demand as well as to subscribers using the Disney Channel App.", "prediction 3": "Andi Mack is an American family comedy-drama television series created by Terri Minsky that premiered on Disney Channel on April 7, 2017. The first episode came out on the Disney Channel App, On-Demand, Disney Channel's YouTube, iTunes, Amazon, and Google Play on March 10, 2017. The second episode came out the same day via Disney Channel On-Demand as well as to subscribers using the Disney Channel App.", "prediction 4": "Andi Mack is an American family comedy-drama television series created by Terri Minsky that premiered on Disney Channel on April 7, 2017. The first episode of the second season came out on March 10, 2017, while the second episode came out the same day via Disney Channel On-Demand and to subscribers using the Disney Channel App. The fourth and final episode of the fourth season came out on September 28, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 86 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 427 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Andi Mack is an American family comedy-drama television series that premiered on Disney Channel on April 7, 2017. It was a top-rated series. The second season premiered on October 27, 2017. The third season premiered on October 8, 2018. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who is regarded as the father of modern india?", "passages": [ [ "B. R. Ambedkar", "B. R. Ambedkar\n\nBhimrao Ramji Ambedkar (14 April 1891\u00a0\u2013 6 December 1956), popularly known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), while also supporting the rights of women and labour.", "He was independent India's first law and justice minister, the principal architect of the Constitution of India, and a founding father of the Republic of India.", "Ambedkar was a prolific student earning doctorates in economics from both Columbia University and the London School of Economics and gained a reputation as a scholar for his research in law, economics, and political science.", "In his early career he was an economist, professor, and lawyer.", "His later life was marked by his political activities; he became involved in campaigning and negotiations for India's independence, publishing journals, advocating political rights and social freedom for Dalits, and contributing significantly to the establishment of the state of India.", "In 1956, he converted to Buddhism initiating mass conversions of Dalits.", "In 1990, the Bharat Ratna, India's highest civilian award, was posthumously conferred upon Ambedkar.", "Ambedkar's legacy includes numerous memorials and depictions in popular culture." ], [ "B. R. Ambedkar", "According to Arvind Sharma, Ambedkar noticed certain flaws in the Aryan invasion theory that were later acknowledged by western scholarship.", "For example, scholars now acknowledge \"an\u0101s\" in Rig Veda 5.29.10 refers to speech rather than the shape of the nose.", "Ambedkar anticipated this modern view by stating:\n\nAmbedkar disputed various hypotheses of the Aryan homeland being outside India, and concluded the Aryan homeland was India itself.", "According to Ambedkar, the Rig Veda says Aryans, D\u0101sa and Dasyus were competing religious groups, not different peoples.", "Upon India's independence on 15 August 1947, the new Congress-led government invited Ambedkar to serve as the nation's first Law Minister, which he accepted.", "On 29 August, he was appointed Chairman of the Constitution Drafting Committee, and was appointed by the Assembly to write India's new Constitution.", "Granville Austin described the Indian Constitution drafted by Ambedkar as 'first and foremost a social document'.", "'The majority of India's constitutional provisions are either directly arrived at furthering the aim of social revolution or attempt to foster this revolution by establishing conditions necessary for its achievement.'" ], [ "Ram Mohan Roy", "Ram Mohan Roy\n\nRaja Ram Mohan Roy (22 May 1774 \u2013 27 September 1833) was one of the founders of the Brahmo Sabha, the precursor of the Brahmo Samaj, a socio-religious reform movement in the Indian subcontinent.", "He was given the title of Raja by Akbar II, the Mughal emperor.", "His influence was apparent in the fields of politics, public administration, education and religion.", "He was known for his efforts to abolish the practices of sati and child marriage.", "Raja Ram Mohan Roy is considered by many historians as the \"Father of the Indian Renaissance.\"", "In 2004, Roy was ranked number 10 in BBC's poll of the Greatest Bengali of all time.", "Ram Mohan Roy was born in Radhanagar, Hooghly District, Bengal Presidency.", "His father Ramkanta was a Vaishnavite, while his mother, Tarini Devi, was from a Shivaite family.", "Thus one parent prepared him for the occupation of a scholar, the \"Shastri\", the other secured for him all the worldly advantages needed to launch a career in the \"laukik\" or worldly sphere of public administration.", "Torn between these two parental ideals from early childhood, Ram Mohan vacillated the rest of his life, moving from one to the other and back.", "Ram Mohan Roy was married thrice.", "His first wife died early." ] ], "gold": "Dr. B.R.Ambedkar and Raja Ram Mohan Roy are regarded as the Father of Modern India conferred by Columbia University. Dr. Ambedkar was an Indian jurist, economist, politician and social reformer, who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables or Dalits. He also authored India's new constitution. Raja Ram Mohan Roy was an Indian reformer who was one of the founders of the Brahmo Sabha, the precursor of the Brahmo Samaj, a social-religious reform movement in the Indian subcontinent. Roy is considered to be the \"Father of the Bengal Renaissance\" by many historians.", "prediction 1": "Bhimrao Ramji Ambedkar, popularly known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), while also supporting the rights of women and labour. Ram Mohan Roy, one of the founders of the Brahmo Sabha, is considered by many historians as the \"Father of the Indian Renaissance.\"", "prediction 2": "Bhimrao Ramji Ambedkar, known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables. He was independent India's first law and justice minister, the principal architect of the Constitution of India, and a founding father of the Republic of India. Ram Mohan Roy, one of the founders of the Brahmo Sabha, is considered by many historians as the Father of the Indian Renaissance.", "prediction 3": "Bhimrao Ramji Ambedkar, popularly known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), while also supporting the rights of women and labour. Ram Mohan Roy, one of the founders of the Brahmo Sabha, the precursor of the Brahmo Samaj, a socio-religious reform movement in the Indian subcontinent. He is considered by many historians as the \"Father of the Indian Renaissance.\"", "prediction 4": "Bhimrao Ramji Ambedkar, popularly known as Babasaheb Ambedkar, was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"), while also supporting the rights of women and labour. Raja Ram Mohan Roy is considered by many historians as the \"Father of the Indian Renaissance.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 303 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "Bhimrao Ramji Ambedkar was an Indian jurist, economist, politician and social reformer who inspired the Dalit Buddhist movement and campaigned against social discrimination towards the untouchables (\"Dalits\"). He also drafted up India's new constitution. Ram Mohan Roy, one of the founders of the Brahmo Sabha, the precursor of the Brahmo Samaj, a socio-religious reform movement in the Indian subcontinent. He is considered by many historians as the \"Father of the Indian Renaissance.\"" }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "How far has croatia gone in the world cup before?", "passages": [ [ "Croatia at the FIFA World Cup", "Croatia at the FIFA World Cup\n\nCroatia national football team have appeared in the FIFA World Cup on five occasions (in 1998, 2002, 2006, 2014 and 2018) since gaining independence in 1991.", "Before that, from 1930 to 1990 Croatia was part of Yugoslavia.", "Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France.", "In the draw for the final tournament, held on 4 December 1997 at Stade V\u00e9lodrome in Marseille, Croatia was drawn to play in Group H, along with two other teams which qualified for the World Cup for the first time, Jamaica and Japan, and two-time World Cup winners Argentina.", "In their first match Croatia beat Jamaica 3\u20131, in a game memorable for Croatia's first ever World Cup goal, an opener scored by Mario Stani\u0107 in the 27th minute.", "Croatia went on to beat Japan 1\u20130 before losing their third group stage match against Argentina 0\u20131, in a game which was of little importance as both teams had already qualified for round of 16.", "In round of 16, Croatia faced Group G winners Romania (who had finished top of their group in front of England) and won the game through a penalty converted by Davor \u0160uker in stoppage time of the first half after a foul on Aljo\u0161a Asanovi\u0107 by Gabriel Popescu." ], [ "Croatia national football team", "Most of these are friendly in nature, stemming from repeated match-ups and the context in which they are played.", "However, some are also politically and socially charged.", "Here are the team's most notable opponents:\n\n\nCroatia qualified for and competed in three consecutive World Cup tournaments between 1998 and 2006, but failed to qualify for the 2010 World Cup in South Africa after finishing 3rd in Group 6 behind England and Ukraine.", "Although they had joined both FIFA and UEFA by 1992, they were unable to enter the 1994 World Cup as qualification had started before the side was officially recognised as a state.", "In the following three World Cup groups they were eliminated after finishing third in all of them, before finally advancing further than the group stage at the 2018 World Cup.", "On 11 July 2018, Croatia won their semi-final match against England, advancing the national team to their first FIFA World Cup final wherein they secured second place as runners-up against winners France.", "Supplanting their third place positioning in 1998, this is the nation's best performance to date.", "Dario \u0160imi\u0107 was Croatia's first player to reach 100 appearances, doing so before his retirement in 2008.", "This allowed him to surpass Robert Jarni's previous record of 81 appearances." ] ], "gold": "Croatia national football team have appeared in the FIFA World Cup on five occasions (in 1998, 2002, 2006, 2014 and 2018) since gaining independence in 1991. Their best result thus far was reaching the 2018 final, where they lost 4\u20132 to France and were Runners-up in the World Cup.", "prediction 1": "Croatia have appeared in the FIFA World Cup on five occasions since gaining independence in 1991. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France. Croatia qualified for and competed in three consecutive World Cup tournaments between 1998 and 2006, but failed to qualify for the 2010 World Cup in South Africa after finishing 3rd in Group 6 behind England and Ukraine. On 11 July 2018, Croatia won their semi-final match against England, advancing the national team to their first FIFA World Cup final wherein they secured second place as runners-up against France.", "prediction 2": "Croatia has appeared in the FIFA World Cup on five occasions. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France. In 1998, Croatia qualified for and competed in three consecutive World Cup tournaments between 1998 and 2006. In 2002, Croatia went to the semi-finals and on 2018, they advanced further than the group stage.", "prediction 3": "Croatia has appeared in the FIFA World Cup on five occasions since gaining independence in 1991. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France.", "prediction 4": "Croatia have appeared in the FIFA World Cup on five occasions (in 1998, 2002, 2006, 2014 and 2018) since gaining independence in 1991. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France. Their best performance to date has been a 4-2 defeat to France in the 2018 final.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 484 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Croatia have appeared in the FIFA World Cup on five occasions (in 1998, 2002, 2006, 2014 and 2018) since gaining independence in 1991. Their best result thus far was silver position at the 2018 final, where they lost 4-2 to France. Croatia advanced to their first FIFA World Cup final wherein they secured second place as runners-up against France." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who sings the theme song for that 70's show?", "passages": [ [ "That '70s Show", "The original version of the song appeared on Big Star's 1972 debut album \"#1 Record\".", "In 2000, Chilton confirmed that he was paid $70 in royalties each time the show aired, an amount he thought ironic, given the show's title.", "Big Star's original version of the song was not used on the show.", "Instead, a cover version sung by Todd Griffin was used as the theme song for the show's first season.", "Beginning in the second season, the theme song was performed by the band Cheap Trick.", "Unlike previous versions of the song, Cheap Trick ended the song with the repeated phrase \"We're all alright!\"", "quoting the ending of their 1978 hit song \"Surrender\".", "Both versions of the song (Todd Griffin and Cheap Trick) used on the show end with somebody yelling \"Hello, Wisconsin!\"", "In Griffin's version, Danny Masterson is the one yelling \"Hello, Wisconsin!\"", "while it is unknown who yells it in Cheap Trick's version during the opening.", "On the soundtrack, \"That '70s Album (Rockin')\", Cheap Trick's lead singer Robin Zander yells \"Hello, Wisconsin!\"", "Alternate holiday versions of the theme song were arranged for Halloween and Christmas specials, using organ music and bells, respectively." ], [ "In the Street (song)", "In the Street (song)\n\n\"In the Street\" is a song by the American rock band Big Star.", "It was written by Chris Bell and Alex Chilton.", "The song was featured on the 1972 album \"#1 Record\".", "The song was the \"B\" side of their first single, \"When My Baby's Beside Me.\"", "Lead vocals on \"In the Street\" were handled by Chris Bell.", "\"In the Street\" was recorded by Todd Griffin as \"That '70s Song\" with additional lyrics by Ben Vaughn as the theme song for the television sitcom \"That '70s Show\".", "Another recording of \"That '70s Song\" by Cheap Trick was used as the theme beginning with season two.", "The Cheap Trick version was released on the \"That '70s Album\" soundtrack album and another version by Cheap Trick was released on their album \"Authorized Greatest Hits\"." ] ], "gold": "\"In the Street\" is a song by the American rock band\u00a0Big Star, written by\u00a0Chris Bell\u00a0and\u00a0Alex Chilton.\u00a0A cover version by\u00a0Todd Griffin\u00a0as \"That '70s Song\" with additional lyrics by\u00a0Ben Vaughn, was used\u00a0as the theme song for the television\u00a0sitcom\u00a0That '70s Show.\u00a0 Another version of \"That '70s Song \", was recorded by Cheap Trick and used as the theme song for, That '70s Show seasons \u00a02-8.", "prediction 1": "That 70's Show has had different theme songs. The original version of the theme song appeared on Big Star's 1972 debut album #1 Record. Instead, a cover version sung by Todd Griffin was used as the theme song for the show's first season. Beginning in the second season, the theme song was performed by the band Cheap Trick.", "prediction 2": "\"That '70s Show\" is an American television sitcom that aired from 1972 to 1980. A cover version of the song was sung by Todd Griffin for the show's first season. Beginning in the second season, the theme song was performed by the band Cheap Trick. Another recording of \"That '70s Song\" by Cheap Trick was used as the theme song beginning with season two.", "prediction 3": "\"That '70s Show\" is a television sitcom created by and starring the American rock band Big Star, whose song \"In the Street\" was recorded by Todd Griffin as \"That '70s Song\" with additional lyrics by Ben Vaughn as the theme song for the television sitcom That '70s Show. Another recording of \"That '70s Song\" by Cheap Trick was used as the theme song beginning with season two.", "prediction 4": "\"That '70s Show\" is an American television sitcom created by the American rock band Big Star. The show's theme song is \"In the Street\", which is sung by Todd Griffin as \"That '70s Song\" with additional lyrics by Ben Vaughn. The theme song for the show's second season is performed by the band Cheap Trick.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 45 }, { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 135 }, { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 237 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"In the Street\" is a song by the American rock band Big Star, written by Chris Bell and Alex Chilton. \"In the Street\" was recorded by Todd Griffin as \"That '70s Song\" with additional lyrics by Ben Vaughn as the theme song for the television sitcom \"That '70s Show\". Beginning in the second season, the theme song was performed by the band Cheap Trick." }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "Who is the song about you're so vain?", "passages": [ [ "You're So Vain", "Over the years Simon has divulged \"letter clues\" and has claimed that the subject's name contains the letters A, E, and R.\n\nShortly before the writing of the song, Simon was married to James Taylor; she has said that he was \"definitely not\" the subject of the song.", "David Bowie, David Cassidy and Cat Stevens have all been cited by the press as speculative candidates.", "In August 2003 Simon agreed to reveal the name of the song's subject to the highest bidder of the Martha's Vineyard Possible Dreams charity auction.", "With the top bid of $50,000, Dick Ebersol, president of NBC Sports and a friend of Simon, won the right to know the name of the subject of \"You're So Vain\".", "A condition of the prize was that Ebersol not reveal the name.", "Ebersol said Simon allowed him to divulge a clue about the person's name: \"Carly told me that I could offer up to the entire world a clue as to what she'll tell me when we have this night in about two weeks.", "And the clue is: The letter 'E' is in the person's name.\"", "In 2004 Simon told Regis Philbin, \"If I tell it, it's going to come out in dribs and drabs." ], [ "You're So Vain", "Simon's publicist also confirmed the song was not about Geffen, but that there was indeed \"a David who is connected to the song in some way, shape, or form\".", "\"Vanity Fair\" noted that in addition to \"David\", \"Warren\" and an unintelligible name are whispered during the recording.", "After her live performance of the song with Simon in July 2013, Taylor Swift stated that Simon had revealed the identity of the song's subject to her in confidence.", "In November 2015, Simon, promoting her about-to-be-published memoir, said, \"I have confirmed that the second verse is Warren (Beatty)\" and added that while \"Warren thinks the whole thing is about him,\" he is the subject of that verse only, with the remainder of the song referring to two other, still unnamed men.", "The song was a number-one hit in the US, Canada and Australia and reached number four in Ireland and South Africa.", "Bowing at #99 on the \"Billboard\" Hot 100 on 2 December 1972, the song took only five more weeks to rocket to the top of the chart, where it stayed for the first three weeks of 1973, also spending two weeks at the top of the Easy Listening chart in early 1973, her first number one on either chart." ], [ "You're So Vain", "Her heartbreak over eventually losing him inspired the song \"Dan, My Fling,\" which appears on her first album.", "Armstrong's full name, Daniel Kent Armstrong, contains all three letters of Simon's clue.", "On November 4, 2009, Simon said she had hidden the name of the subject in a certain version of the song.", "The next day, the program's crew revealed the name concealed in a back-played whisper: David.", "Simon denied that the whisper was \"David,\" saying she had spoken \"Ovid\" both forwards and backwards, and that sounded like David.", "In February 2010, Simon reiterated that the name of the subject was whispered in a re-recording of \"You're So Vain\": \"There's a little whisper\u2014and it's the answer to the puzzle.\"", "A representative for Simon confirmed that the name whispered during the song is \"David\".", "Multiple media outlets then speculated that the subject was Simon's former boss at Elektra, David Geffen.", "The following day Jim Hart, Simon's ex-husband and close friend, denied that the song was about Geffen.", "Simon said that when she wrote the song in 1971, she had not yet met Geffen." ] ], "gold": "The subject of the song \"You're So Vain\" by Carly Simon is about three men, one of which Simon clues that their name contains the letters 'A', 'E,' and 'R.' Author Sheila Weller believes that Dan Armstrong was the song's inspiration, and his full name, Daniel Kent Armstrong, contains the letters from Simon's clue. Carly Simon confirmed that the song's second verse is about Warren Beatty, although he thinks that the entire song is about him. The press has speculated that the song is about David Cassidy, Cat Steven, and David Bowie.", "prediction 1": "The 1971 song \"You're So Vain\" was written by Simon and released on August 2, 1971. Shortly before the writing of the song, Simon was married to James Taylor; she has said that he was \"definitely not\" the subject of the song. Dick Ebersol, president of NBC Sports and a friend of Simon, won the right to know the name of the subject of the song.", "prediction 2": "Simon's 1971 song You're So Vain is not about David Geffen, but about her heartbreak over ultimately losing him, as described in her song \"You're So Vain\". The subject of the song is a man named Warren Beatty, whose name appears in the second verse of the song.", "prediction 3": "Simon's 1971 song \"You're So Vain\" is about losing her husband, David Geffen, and its subject is Warren Beatty. David Bowie, Cat Stevens and David Cassidy have been cited by the press as speculative candidates. Dick Ebersol, president of NBC Sports and a friend of Simon, won the right to know the name of the song's subject.", "prediction 4": "You're So Vain is a song by American singer Simon Simon about her heartbreak over eventually losing him. The song was a number-one hit in the US, Canada and Australia and reached number four in Ireland and South Africa. In August 2003, Simon agreed to reveal the name of the song's subject to the highest bidder of the Martha's Vineyard Possible Dreams charity auction. Dick Ebersol, president of NBC Sports and a friend of Simon, won the right to know the name of the song's subject.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 345 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1971 song \"You're So Vain\" was written by Simon. Over the years Simon has divulged \"letter clues\" and has claimed that the subject's name contains the letters A, E, and R. Shortly before the writing of the song, Simon was married to James Taylor; she has said that he was \"definitely not\" the subject of the song. Armstrong's full name, Daniel Kent Armstrong, contains all three letters of Simon's clue. Carly Simon \"I have confirmed that the second verse is Warren (Beatty)\" and added that while \"Warren thinks the whole thing is about him,\". David Bowie, David Cassidy and Cat Stevens have all been cited by the press as speculative candidates. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who was the dog in marley and me?", "passages": [ [ "Marley & Me (film)", "Marley & Me (film)\n\nMarley & Me is a 2008 American comedy-drama film about the titular dog, Marley.", "It was directed by David Frankel and the screenplay by Scott Frank and Don Roos is based on the memoir of the same name by John Grogan.", "The film stars Owen Wilson and Jennifer Aniston as Marley's owners.", "\"Marley & Me\" was released in the United States and Canada on December 25, 2008, and set a record for the largest Christmas Day box office ever with $14.75 million in ticket sales.", "The film was followed by a 2011 direct-to-video prequel, \"\".", "Soon after their wedding, John and Jenny Grogan (Owen Wilson and Jennifer Aniston) escape the brutal Michigan winters and relocate to a cottage in South Florida, where they are hired as reporters for competing newspapers.", "At \"The Palm Beach Post\", Jenny immediately receives prominent front-page assignments, while at the \"South Florida Sun-Sentinel\", John finds himself writing obituaries and two-paragraph articles about mundane news like a fire at the local garbage dump.", "When John senses Jenny is contemplating motherhood, his friend and co-worker Sebastian Tunney (Eric Dane) suggests the couple adopt a dog to see if they're ready to raise a family." ], [ "Marley & Me (film)", "Life is idyllic until the aging Marley begins to show signs of arthritis and deafness.", "An attack of gastric dilatation volvulus almost kills him, but he recovers.", "When a second attack occurs, it becomes clear surgery will not help him, and Marley is euthanized with John at his side.", "The family pay their last respects to their beloved pet as they bury him beneath a tree in their front yard.", "Because the film covers 14 years in the life of the dog, 22 different yellow labradors played the part of Marley (as revealed in the special feature Finding Marley on the DVD).", "The film was shot on location in Florida's West Palm Beach, Fort Lauderdale, Hollywood, Miami, and Dolphin Stadium, in addition to Philadelphia and West Chester in Pennsylvania.", "The Irish honeymoon scenes were shot in and around Ballynahinch Castle, Connemara, County Galway, Ireland.", "The film's score was composed by Theodore Shapiro, who previously had worked with director Frankel on \"The Devil Wears Prada\".", "He recorded it with the Hollywood Studio Symphony at the Newman Scoring Stage at 20th Century Fox.", "Dave Barry, Grogan's fellow South Florida humor columnist, makes an uncredited cameo as a guest at the surprise party celebrating Grogan's 40th birthday.", "\"Marley & Me\" received mixed to positive reviews from critics." ] ], "gold": "Marley & Me is a 2008 American comedy-drama film based on the 2005 memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as the owners of Marley, a Labrador retriever. Because the film covers 14 years in the life of the dog, 22 different yellow Labradors played the part of Marley. A Labrador named Clyde, plays Marley the most as an adult. ", "prediction 1": "Marley is a 2008 American comedy-drama film about the titular dog, Marley. It was directed by David Frankel and the screenplay by Scott Frank and Don Roos is based on the memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as Marley's owners.", "prediction 2": "Marley & Me is a 2008 American comedy-drama film about the titular dog, Marley. It was directed by David Frankel and the screenplay by Scott Frank and Don Roos is based on the memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as Marley's owners.", "prediction 3": "Marley & Me is a 2008 American comedy-drama film about the titular dog, Marley. It was directed by David Frankel and the screenplay by Scott Frank and Don Roos is based on the memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as Marley's owners. Because the film covers 14 years in the life of the dog, 22 different yellow labradors played the part of Marley.", "prediction 4": "Marley is a 2008 American comedy-drama film about the titular dog, Marley. It was directed by David Frankel and the screenplay by Scott Frank and Don Roos is based on the memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as Marley's owners. Because the film covers 14 years in the life of the dog, 22 different yellow labradors played the part of Marley (as revealed in the special feature Finding Marley on the DVD).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 157 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Marley is a 2008 American comedy-drama film based on the memoir of the same name by John Grogan. The film stars Owen Wilson and Jennifer Aniston as Marley's owners. Because the film covers 14 years in the life of the dog, 22 different yellow labradors played the part of Marley. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When did the earliest organisms appear on earth?", "passages": [ [ "Earliest known life forms", "Earliest known life forms\n\nThe earliest known life forms on Earth are putative fossilized microorganisms found in hydrothermal vent precipitates.", "The earliest time that life forms first appeared on Earth is unknown.", "They may have lived earlier than 3.77 billion years ago, possibly as early as 4.28 billion years ago, or nearly 4.5 billion years ago according to some; in any regards, not long after the oceans formed 4.41 billion years ago, and not long after the formation of the Earth 4.54 billion years ago.", "The earliest \"direct\" evidence of life on Earth are microfossils of microorganisms permineralized in 3.465-billion-year-old Australian Apex chert rocks.", "A life form, or lifeform, is an entity or being that is living.", "Currently, Earth remains the only place in the universe known to harbor life forms.", "More than 99% of all species of life forms, amounting to over five billion species, that ever lived on Earth are estimated to be extinct.", "Some estimates on the number of Earth's current species of life forms range from 10 million to 14 million, of which about 1.2 million have been documented and over 86 percent have not yet been described." ], [ "Earliest known life forms", "\"Remains of life\" have been found in 4.1 billion-year-old rocks in Western Australia.", "Evidence of biogenic graphite, and possibly stromatolites, were discovered in 3.7 billion-year-old metasedimentary rocks in southwestern Greenland.", "In May 2017, evidence of life on land may have been found in 3.48 billion-year-old geyserite which is often found around hot springs and geysers, and other related mineral deposits, uncovered in the Pilbara Craton of Western Australia.", "This complements the November 2013 publication that microbial mat fossils had been found in 3.48 billion-year-old sandstone in Western Australia.", "In November 2017, a study by the University of Edinburgh suggested that life on Earth may have originated from biological particles carried by streams of space dust.", "A December 2017 report stated that 3.465-billion-year-old Australian Apex chert rocks once contained microorganisms, the earliest \"direct\" evidence of life on Earth.", "In January 2018, a study found that 4.5 billion-year-old meteorites found on Earth contained liquid water along with prebiotic complex organic substances that may be ingredients for life.", "According to biologist Stephen Blair Hedges, \"If life arose relatively quickly on Earth \u2026 then it could be common in the universe.\"" ] ], "gold": "The earliest undisputed evidence of life on Earth dates from at least 3.5 billion years ago.Some computer models suggest life began as early as 4.5 billion years ago. A December 2017 report stated that 3.465-billion-year-old\u00a0Australian\u00a0Apex chert\u00a0rocks once contained\u00a0microorganisms. 3.77 billion years ago is the earliest time that life forms first appeared on Earth.", "prediction 1": "The earliest organisms that appeared on Earth were putative fossilized microorganisms found in hydrothermal vent precipitates, and they can be further dated to 4.48 billion years ago. These microorganisms are found in 3.465-billion-year-old Australian Apex chert rocks.", "prediction 2": "The earliest organisms to appear on Earth are putative fossilized microorganisms found in hydrothermal vent precipitates. The earliest time that life forms first appeared on Earth is unknown. They may have lived earlier than 3.77 billion years ago, possibly as early as 4.28 billion years ago, or nearly 4.5 billion years ago according to some. In any regards, not long after the oceans formed 4.41 billion years ago, and not long after the formation of the Earth 4.54 billion years ago.", "prediction 3": "The earliest organisms that appeared on Earth were putative fossilized microorganisms found in hydrothermal vent precipitates. According to some, they may have lived earlier than 3.77 billion years ago, possibly as early as 4.28 billion years ago, or nearly 4.5 billion years ago.", "prediction 4": "There are several early life forms, including microorganisms found in hydrothermal vent precipitates. The earliest known organisms on Earth are putative fossilized microorganisms found in hydrothermal vent precipitates. The earliest time that life forms first appeared on Earth is unknown. They may have lived earlier than 3.77 billion years ago, possibly as early as 4.28 billion years ago, or nearly 4.5 billion years ago according to some; in any regards, not long after the oceans formed 4.41 billion years ago, and not long after the formation of the Earth 4.54 billion years ago. The earliest \"direct\" evidence of life on Earth is microfosils of microorganisms permineralized in 3.465-billion-year-old Australian Apex chert rocks.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 127, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 126 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The earliest \"direct\" evidence of life on Earth are microfossils of microorganisms permineralized in 3.465-billion-year-old Australian Apex chert rocks. Some computer models suggest life began as early as 4.5 billion years ago." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who played batman and robin in the tv series?", "passages": [ [ "Batman (TV series)", "shows a room in the Batcave containing \"souvenirs\" of deathtraps that the Joker employed in the 1960s series, with accompanying flashbacks: the giant key from the \"Human Key Duplicator\" from \"The Impractical Joker\", the slot machine-controlled electric chair from \"The Joker Goes to School\", and the giant clam from \"The Joker's Hard Times\".", "The episode \"The Color of Revenge!\" begins with a flashback to the time of the 1960s television series, using attributes such as the red Batphone, the Shakespeare bust, the sliding bookcase, the Batpoles, Robin in his old television-series costume, and the shot of Batman and Robin fastening their seat belts in the Batmobile.", "Additionally, the Adam West Batman briefly appears in \"Night of the Batmen!\"", "as part of an army of Batmen gathered across the Multiverse.", "The \"Young Justice\" episode \"Schooled\" briefly references the show, as well, by featuring a Shakespeare bust in Bruce's office at the Waynetech building in Metropolis.", "As a further homage to the series, Bruce is shown accessing an emergency Batsuit hidden in his desk by flipping a switch concealed within the bust.", "Adam West and Burt Ward lend their voices and likeness to the third DC Comics Special on \"Robot Chicken\"." ], [ "Batman (TV series)", "In 2008, Adam West released a privately issued DVD with the tongue-in-cheek title \"Adam West Naked\" for which he recorded anecdotes regarding all 120 episodes of the series.", "In 2013, PBS aired an episode of \"Pioneers of Television\" called \"Superheroes\" that featured interviews with Adam West and Burt Ward, and talked about the 1960s TV series.", "It was released on DVD March 11, 2013.", "Also in 2013, PBS produced and transmitted a documentary titled \"Superheroes: A Never-Ending Battle\".", "This documentary talked a little bit about the series and included an interview with Adam West.", "On November 11, 2014, Warner Bros. released the full 120-episode Batman collection on Blu-ray and DVD with a variety of extras including a miniature Batmobile, a 32-page episode guide, and \"Adam West Scrapbook.\"", "A second box released on Warner Bros.' own batmanondvd website replaces the Batmobile and the trading cards with a script from the episode \"The Joker is Wild\" and a bonus box containing the movie and the \"Adam West Naked\" documentary.", "This series is also available at the iTunes Store.", "Starting in 1966, an enormous amount of Batman merchandise was manufactured and marketed to cash-in on the TV show's vast popularity." ], [ "Batman: The Animated Series", "Developed and published by Konami, this game was distinctive upon the fact that it still used the earlier \"\" moniker instead of \"The Adventures of Batman & Robin\" second season title given to the other games.", "Though not directly related, the \"\" video game series features some of the voice cast from \"The Animated Series\" returning to their roles, notably including Kevin Conroy as Batman and Mark Hamill as The Joker.", "Arleen Sorkin also reprised her role as Harley Quinn in the first game of the series, \"\".", "Many of the character's costumes from the series also appear as downloadable skins in the games.", "Due the success of the show, Fox approached Bruce Timm to make a spin-off centered on Catwoman, but the project was scrapped in favor of \"\"." ] ], "gold": "Throughout the years, different actors have portrayed Batman and his crime-fighting partner and sidekick, Robin. In the live-action 1960s TV series, Adam West played Batman, and Burt Ward played Robin. In the animated TV series Batman: The Animated Series, Kevin Conroy played Batman, and Loren Lester played Robin. In the animated tv series The Batman, Rino Romano plays Batman, and Evan Sabara plays Robin.", "prediction 1": "Batman & Robin was a television series that ran from 1960 to 1966 and featured Adam West as Batman and Burt Ward as Robin. In the 1960s, the two characters were played by Kevin Conroy and Mark Hamill, respectively. The resulting video game series adapted from the TV series also featured Conroy and Ward as Batman and Robin.", "prediction 2": "Batman and Robin are played by Adam West in the 1960s television series. In the Animated Series, Burt Ward played Robin and Adam West played Batman.", "prediction 3": "Batman is a television series created by Bruce Timm and produced by Warner Bros., which aired from 1966-67. Adam West played Batman and Burt Ward played Robin in the 1960s television series. The 1966 video game series incorporated some of the voice cast from the 1960s TV series, notably including Kevin Conroy as Batman and Mark Hamill as The Joker.", "prediction 4": "Batman & Robin is a television series created by Bruce Timm for Fox Television in 1966. The show starred Adam West as Batman and Burt Ward as Robin. In the 1960s, a reimagined version of the show aired on CBS. The reimagined version featured Kevin Conroy as Batman and Mark Hamill as The Joker.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 61, "end": 65 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 123, "end": 136 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 188, "end": 200 }, { "error type": "Unverifiable", "explanation": "", "start": 274, "end": 324 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Batman & Robin was a television series that ran from 1960 and featured Adam West as Batman and Burt Ward as Robin. Batman: The Animated Series had Kevin Conroy as Batman. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who were the baby boy twins in full house?", "passages": [ [ "Full House", "In season two, Danny is re-assigned from his duties as sports anchor by his television station to become co-host of a new local breakfast TV show, \"Wake Up, San Francisco\", and is teamed up with Nebraska native Rebecca Donaldson.", "Jesse and Becky eventually fall in love and get married in season four.", "In season five, Becky gives birth to twin sons, Nicky and Alex.", "The producers' first choice to play the character of Danny Tanner was Bob Saget.", "Saget was not available to appear in the pilot due to his commitment as an on-air contributor to CBS's \"The Morning Program\".", "The producers instead cast actor John Posey to play Danny.", "Posey only appeared in the unaired pilot (which is included on the DVD release of Season 1).", "John Stamos's character was originally named Jesse Cochran; Stamos reportedly wanted his character to better reflect his Greek heritage, so producers decided to change the character's surname to Katsopolis (beginning with season two).", "To comply with child labor laws, twins Ashley and Mary-Kate Olsen were cast to alternate in the role of Michelle during tapings.", "The girls were jointly credited as \"Mary Kate Ashley Olsen\" in seasons two through seven because the producers did not want audiences to know that the Michelle character was played by twins.", "(The sisters occasionally appeared together in fantasy sequences.)" ], [ "Full House", "All six of the original cast members remained with the show through its entire eight-year run, with five characters added to the main cast along the way.", "D.J. 's best friend Kimmy was a recurring character in seasons one through four, who was upgraded to a regular in season five.", "Rebecca originally appeared for six episodes in season two; producers decided to expand her role and made her a regular the following season.", "After marrying Jesse, they have twins Nicky and Alex, who make their debut in season five.", "As babies, the children were played by Daniel and Kevin Renteria, and in season six, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit.", "The last main character added was Steve Hale, who was D.J. 's boyfriend in seasons six and seven.", "He was played by Scott Weinger.", "The series was created by Jeff Franklin and executive produced by Franklin, along with Thomas L. Miller and Robert L. Boyett.", "The series was produced by Jeff Franklin Productions and Miller-Boyett Productions, in association with Lorimar-Telepictures (1987\u20131988), Lorimar Television (1988\u20131993), and then by Warner Bros. Television (1993\u20131995) after Lorimar was folded into Warner Bros.'s existing television production division." ] ], "gold": "On the television show, Jesse Katsopolis, played by John Stamos, is Danny's brother-in-law, Pam's younger brother, making him the uncle to DJ, Stephanie, and Michelle. In the series, he marries Rebecca Donaldson, Danny's co-host on Wake Up, San Francisco, by whom he has twin sons Nicholas and Alexander, better known as Nicky and Alex, played by Daniel and Kevin Renteria.", "prediction 1": "Full House is a teen television show created and produced by Jeff Franklin and executive produced by Franklin, along with Thomas L. Miller and Robert L. Boyett. As babies, the children were played by Daniel and Kevin Renteria, and in season six, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit. As children, the children were played by Daniel and Kevin Renteria, and in season seven, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit.", "prediction 2": "In Full House, the twins were played by Daniel and Kevin Renteria. In season 6, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit.", "prediction 3": "There were twins in Full House as babies. They were played by Daniel and Kevin Renteria in season four and by Rebecca Donaldson in season five.", "prediction 4": "In the television series Full House, the twin baby boys were played by Daniel and Kevin Renteria, and in season six, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 11, "end": 160 }, { "error type": "Redundant", "explanation": "As babies, the children were played by Daniel and Kevin Renteria", "start": 318, "end": 385 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 393, "end": 406 }, { "error type": "Redundant", "explanation": " and in season six, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit. ", "start": 411, "end": 478 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "In Full House, after Rebecca marry Jesse, they have twins Nicky and Alex. As babies, the children were played by Daniel and Kevin Renteria, and in season six, the roles of the twins were succeeded by Blake and Dylan Tuomy-Wilhoit. John Stamos played Jesse Katsopolis. Danny is on the local breakfast TV show, \"Wake Up, San Francisco\", and Rebecca Donaldson is his co-host." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who is the new lead singer of foreigner?", "passages": [ [ "Foreigner (band)", "On July 25, 2004 in Santa Barbara, California at Fess Parker's DoubleTree Resort, Jones appeared at a benefit show for muscular dystrophy with a brand new version of Foreigner that included: Jeff Jacobs, Thom Gimbel, former Dokken bass player Jeff Pilson, future Black Country Communion drummer Jason Bonham (son of Led Zeppelin drummer John Bonham and leader of Bonham) and Bonham singer Chas West.", "West was front man for that show only and was eventually replaced by former Hurricane singer Kelly Hansen, who had sent the band an audition tape and was invited aboard in March 2005, making his debut with the group on March 11 at Boulder Station near Las Vegas.", "During their 2005 spring tour, Chas West briefly continued with the band as a special guest, playing rhythm guitar.", "Their 2005 BMG album, \"Extended Versions\", featured the new line-up playing all their classic hits live in concert in one of the most \"studio like, clean sounding\" live album recordings produced.", "Foreigner joined Def Leppard along with Styx on tour in 2007.", "They also toured extensively in their own right in 2007 \u2013 the thirtieth anniversary of the release of their debut.", "In late 2007, keyboardist Jeff Jacobs left Foreigner after 16 years and was replaced, first by Paul Mirkovich then by Michael Bluestein (in 2008)." ], [ "Foreigner (band)", "Jones got together with New York keyboardist Al Greenwood (who had just played with former Flash members Colin Carter and Mike Hough in a group called Storm), drummer Stan Williams and Louisiana bassist Jay Davis (later with Rod Stewart) and began jamming.", "Another friend, Stories singer Ian Lloyd, was brought in to sing but Jones decided the chemistry was not quite right and retained only Greenwood as he renewed his search for players.", "During a session for Ian Lloyd's album, Jones met up with transplanted Englishman and ex-King Crimson member Ian McDonald and another session for Ian Hunter unearthed another fellow Brit in drummer Dennis Elliott.", "But after auditioning about forty or fifty singers, the right vocalist was becoming harder to come by until Jones dragged out an old Black Sheep album given to him backstage at a Spooky Tooth concert a few years prior by that group's lead singer, Lou Gramm.", "Jones put in a call to Gramm, who was back in his hometown of Rochester, New York after Black Sheep's break-up, and sent him a plane ticket to New York City.", "Gramm proved to be the missing piece of the puzzle and Brooklyn, New York bassist Ed Gagliardi completed the new sextet." ], [ "Lou Gramm", "Lou Gramm\n\nLou Gramm (born Louis Andrew Grammatico; May 2, 1950) is an American rock singer-songwriter, best known for being the original lead singer of the British-American rock band Foreigner.", "Louis Andrew Grammatico was born on May 2, 1950, in Rochester, New York, the son of Nikki (nee Masetta), a singer, and Bennie Grammatico, a band leader and trumpeter.", "He attended Gates-Chili High School in Rochester, graduating with the class of 1968.", "He is also an alumnus of Monroe Community College in Rochester.", "Gramm began his musical career in high school playing in local Rochester bands, including St. James Infirmary (later The Infirmary), PHFFT, and Poor Heart.", "Gramm then went on to sing, play drums and eventually become front man for the band Black Sheep.", "Black Sheep was the first American band signed to the Chrysalis label, which released their first single, \"Stick Around\" (1974).", "Black Sheep played in nightclubs in Rochester and Buffalo, New York, including McVan's, formerly at Niagara Street and Hertel Avenue.", "Soon after this initial bit of success, Black Sheep signed with Capitol Records, releasing two albums in succession [\"Black Sheep\" (1975) and \"Encouraging Words\" (late 1975)]." ], [ "Kelly Hansen", "Kelly Hansen\n\nKelly Hansen (born April 18, 1961) is an American singer, best known as the current lead singer of the rock band Foreigner.", "He started his career as an independent studio singer.", "He later met guitarist Robert Sarzo and bassist Tony Cavazo (brothers of Rudy Sarzo and Carlos Cavazo, respectively, of Quiet Riot fame), with whom he formed the hard-rock band Hurricane in 1984.", "Hurricane would achieve some moderate commercial success throughout the mid-to-late 1980s and into the 1990s.", "However, Hurricane's record label went bankrupt in 1991, and the band disbanded shortly thereafter.", "Hansen continued to make music, recording as a guest and session singer for many projects, including Slash's Snakepit, Fergie Fredriksen, Don Dokken, and Bourgeois Pigs.", "In 1998 Hansen joined the band Unruly Child replacing vocalist Mark Free.", "Unruly Child recorded a new album which was released in early 1999.", "2001 saw the return of Hurricane with an altered lineup and new album, \"Liquifury\".", "In 2003, Hansen joined forces with Fabrizio V.Zee Grossi and recorded a self-titled album under the band name Perfect World.", "Hansen then went on to join Foreigner in 2005 after Lou Gramm left in 2003 due to continuing conflicts with Mick Jones." ] ], "gold": "Foreigner has had different lead singers over the years. Lou Gramm was the lead singer from 1977 to 1990 and 1992 to 2002. Chas West was front man for the band for one show only at a benefit for muscular dystrophy dubbed \"Mick Jones & Friends\" in 2004. In 2005, Kelly Hansen took over as lead singer and is still in that role today.", "prediction 1": "American singer Kelly Hansen is the current lead singer of the rock band Foreigner. Kelly Hansen had previously been the lead singer of the band Hurricane, but left the band in 2005 after a show at Fess Parker's DoubleTree Resort in Santa Barbara, California. Chas West was the new lead singer of Foreigner until 2005 when he was replaced by former Hurricane singer Kelly Hansen.\n", "prediction 2": "American rock singer-songwriter, Lou Gramm, is the initial lead singer of the band Foreigner, while British-American rock band, Foreigner, was originally led by Australian singer Chas West. However, over time, Gramm's voice continued to be difficult to discern, so in 2004, Chas West appeared as the lead vocalist for the band's show only and was later replaced by singer Kelly Hansen.", "prediction 3": "American singer, Kelly Hansen, took over as lead vocalist of the band Foreigner in 2005. The band's keyboardist Jeff Jacobs left in 2007 after 16 years and was replaced by Paul Mirkovich.", "prediction 4": "On July 23, 2004, at a benefit show for muscular dystrophy, singer Chas West was the front man for a brand new version of the band and his role was vacated when singer Kelly Hansen was introduced to the band through an audition tape. Also, in March 2005, Hansen joined the band as lead singer and stayed with them until 2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 15 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 278, "end": 281 }, { "error type": "Redundant", "explanation": "the current lead singer of the rock band Foreigner.", "start": 294, "end": 306 }, { "error type": "Redundant", "explanation": " current lead singer ", "start": 318, "end": 341 }, { "error type": "Redundant", "explanation": "Kelly Hansen is the current lead singer of the rock band Foreigner. ", "start": 366, "end": 380 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Kelly Hansen is the current lead singer of the rock band Foreigner, taking over that role from Chas West in 2005. West was front man for the band for one show only at a benefit for muscular dystrophy in 2004. Lou Gramm was also a former lead singer of the band.\n " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the first drafted player for the sounders?", "passages": [ [ "2009 Seattle Sounders FC season", "In the expansion draft, held on November 26, 2008, Seattle Sounders FC selected the following players from other MLS teams: Nate Jaqua (Houston), Brad Evans (Columbus), Stephen King (Chicago), Jeff Parke (RBNY), James Riley (San Jose), Khano Smith (New England), Jarrod Smith (Toronto FC), Nathan Sturgis (Real Salt Lake), Peter Vagenas (LA Galaxy) and Tyson Wahl (Kansas City).", "As the 2009 expansion team Sounders FC was given the first pick in each round of the SuperDraft.", "With the number one pick of the first round of the draft, Seattle Sounders FC selected University of Akron forward Steve Zakuani.", "As the first picks of the second round (16th overall), third round (31st overall), and fourth round (46th overall), Seattle selected Wake Forest University defender Evan Brown, Azusa Pacific University defender Jared Karkas, and Harvard University midfielder/forward Michael Fucito respectively.", "The team lineup was adjusted throughout.", "Defender Jeff Parke was selected in the expansion draft, and reported for training camp after tryouts with teams in Belgium.", "After training with the club for less than a week, Parke was unable to reach a contract agreement and left to train with the Vancouver Whitecaps of the USL." ], [ "Seattle Sounders FC results by opponent", "Seattle Sounders FC results by opponent\n\nSeattle Sounders FC is an American soccer club founded in 2008, after the city of Seattle was awarded a Major League Soccer (MLS) franchise.", "The club began playing competitive soccer in the 2009 Major League Soccer season.", "It plays its home games at CenturyLink Field, competing in the Western Conference of the MLS.", "The current Sounders FC is the third soccer team from Seattle to bear the \"Sounders\" nickname.", "The tradition was started by Seattle's North American Soccer League team in 1974, and continued by the city's United Soccer Leagues side, formed in 1994.", "The current Sounders FC is an entity distinct to both of these clubs, and played its first MLS game on March 19, 2009, against the New York Red Bulls.", "The Sounders record against each club faced in competitive matches, both domestically and internationally, are listed below.", "As of the 2012 season, there have been four different competitive competitions the Sounders have competed in.", "These include the MLS regular season, the MLS Cup Playoffs, the Lamar Hunt U.S. Open Cup and the CONCACAF Champions League.", "The Sounders began their first US Open Cup campaign as a Major League Soccer team in April 2009.", "The club went on to advance to the final, where they faced D.C. United at RFK Stadium." ], [ "2009 Seattle Sounders FC season", "Seattle Sounders FC officially announced the 2007 USL First Division MVP and former USL Sounder S\u00e9bastien Le Toux as its first signing on May 7, 2008.", "On August 14, 2008, the Sounders announced in a press conference their second signing for the 2009 season, former United States men's national team goalkeeper Kasey Keller, a Washington native.", "On September 5, 2008, Seattle Sounders FC announced the third signee for the franchise to be Sanna Nyassi from Gambia.", "Nyassi, a 19-year-old midfielder, was a member of the Gambia U-20 national team at the 2007 FIFA Championship.", "Sanna's twin brother, Sainey Nyassi, was signed by the Revolution and is a regular starter in MLS this season.", "On October 28, 2008, it was officially announced that the Sounders had signed Swedish midfielder Fredrik Ljungberg using the Designated Player Rule.", "He signed a two-year contract reported to be worth $2.5\u00a0million per season.", "Team building continued with the 2008 MLS Expansion Draft and the 2009 MLS SuperDraft." ], [ "2009 Seattle Sounders FC season", "On September 2, 2009 the U.S. Open Cup final was played in Washington D.C.'s RFK Stadium.", "Sounders FC prevailed 2\u20131 becoming the second MLS expansion team in league history (Chicago being the first) to win the Cup in their inaugural MLS season.", "Goalkeepers\n\nIn\n\nOut\n\n\n\nU.S. Open Cup\n\nMLS Player of the Week\n\n\nMLS Player of the Month\n\n\nMLS Goal of the Week\n\n\nMLS Save of the Week\n\n\n", "Golden scarf recipients\n\nBefore each home game, Sounders FC honors a member of the community or special guest with a Golden Scarf." ] ], "gold": "The 2009 season was Seattle Sounders FC's debut in Major League Soccer. Seattle Sounders FC officially announced the 2007 USL First Division MVP and former USL Sounder Sebastien Le Toux as its first signing on May 7, 2008. Team building continued with the 2008 MLS Expansion Draft and the 2009 MLS SuperDraft. With the number one pick of the first round of the SuperDraft, Seattle Sounders FC selected University of Akron forward Steve Zakuani. On September 2, 2009 the U.S. Open Cup final was played in Washington D.C.'s RFK Stadium. Sounders FC prevailed 2\u20131 becoming the second MLS expansion team in league history to win the Cup in their inaugural MLS season.", "prediction 1": "Seattle Sounders FC is an American professional soccer team. They were founded in 2008, after the city of Seattle was awarded a Major League Soccer franchise. The club first played competitive soccer in the 2009 season. On May 7, 2008, the Sounders announced the signing of S\u00e9bastien Le Toux, the 2007 USL First Division MVP and former USL Sounder who was a member of the Gambia U-20 national team at the 2007 FIFA Championship. On August 14, 2008, the Sounders announced the signing of former United States men's national team goalkeeper Jared Karkas, and Harvard University midfielder Michael Fucito. The Sounders FC signed Sanna Nyassi, a 19-year-old midfielder named a member of the United FC.", "prediction 2": "The Seattle Sounders FC were drafted in the first round of the 2008 MLS Expansion Draft and the first round of the 2009 MLS SuperDraft. With the number one pick of the first round of the draft Seattle Sounders FC selected University of Akron forward Steve Zakuani. With the number one pick of the second round (16th overall), third round (30th overall), and fourth round (46th overall), Seattle selected Wake Forest University defender Evan Brown, Azusa Pacific University defender Jared Karkas, and Harvard University midfielder/forward Michael Fucito.", "prediction 3": "Seattle Sounders FC is an American professional soccer team based in Seattle, Washington. As part of the 2008 MLS Expansion Draft and the 2009 MLS SuperDraft, the Sounders selected S\u00e9bastien Le Toux, a former USL Sounder, as their first drafted player. On September 5, 2008, the Sounders announced the third signee for the franchise to be Sanna Nyassi from Gambia. On October 28, 2008, it was officially announced that the Sounders had signed Swedish midfielder Fredrik Ljungberg using the Designated Player Rule.", "prediction 4": "The Seattle Sounders are an American professional soccer team that played in the Major League Soccer (MLS) for one season. At the 2008 MLS Expansion Draft and the 2009 MLS SuperDraft, Seattle Sounders FC selected Steve Zakuani as the first drafted player for the Sounders. Sanna Nyassi was the third signing for the franchise to be a midfielder from Gambia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 158 }, { "error type": "Irrelevant", "explanation": "", "start": 348, "end": 428 }, { "error type": "Irrelevant", "explanation": "", "start": 429, "end": 602 }, { "error type": "Irrelevant", "explanation": "", "start": 603, "end": 697 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "Seattle Sounders FC is an American professional soccer team. The club first played competitive soccer in the 2009 season. On May 7, 2008, the Sounders announced the signing of S\u00e9bastien Le Toux, the 2007 USL First Division MVP. Team building continued with the 2008 MLS Expansion Draft and the 2009 MLS SuperDraft. With the number one pick of the first round of the Superdraft, Seattle Sounders FC selected University of Akron forward Steve Zakuani. On September 2, 2009 the U.S. Open Cup final was played in Washington D.C.'s RFK Stadium. Sounders FC prevailed 2\u20131 becoming the second MLS expansion team in league history (Chicago being the first) to win the Cup in their inaugural MLS season." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the longest living president of the united states?", "passages": [ [ "Jimmy Carter", "The former president has an extensive family history of cancer, including both of his parents and all three of his siblings.", "On December 6, 2015, Carter issued a statement that his medical scans no longer showed any cancer.", "On January 20, 2017, at age 92, Carter became the oldest living former president to attend a presidential inauguration.", "Carter, born October 1, 1924 (age ), also has the distinction of having the longest post-presidency in U.S. history, currently at .", "He is currently the second longest-lived president in history after George H. W. Bush, who was born 111 days before Carter.", "With Bush's death on November 30, 2018, Carter would become the longest-lived president on March 21, 2019.", "Carter has made arrangements to be buried in front of his home in Plains, Georgia.", "Carter noted in 2006 that a funeral in Washington, D.C., with visitation at the Carter Center was planned as well.", "In the wake of Nixon's Watergate scandal, exit polls from the 1976 presidential election suggested that many still held Gerald Ford's pardon of Nixon against him.", "By comparison, Carter was viewed as a sincere, honest, and well-meaning Southerner.", "Carter began his term with a 66\u00a0percent approval rating, which had dropped to 34\u00a0percent approval by the time he left office, with 55\u00a0percent disapproving." ], [ "Herbert Hoover", "At the time of his death, he had the longest retirement of any president.", "Former President Jimmy Carter surpassed the length of Hoover's retirement on September 7, 2012.", "At the time of Hoover's death he was the second longest-lived president after John Adams; both were since surpassed by George H. W. Bush, Jimmy Carter, Gerald Ford, and Ronald Reagan.", "He had outlived by 20 years his wife, Lou Henry Hoover, who had died in 1944, and he was the last living member of both the Harding and Coolidge administrations.", "He had also outlived John F. Kennedy, who was assassinated nearly a year prior.", "By the time of his death, he had rehabilitated his image.", "His birthplace in Iowa and an Oregon home where he lived as a child became National Landmarks during his lifetime.", "His Rapidan fishing camp in Virginia, which he had donated to the government in 1933, is now a National Historic Landmark within the Shenandoah National Park.", "Hoover and his wife are buried at the Herbert Hoover Presidential Library and Museum in West Branch, Iowa.", "Hoover was honored with a state funeral in which he lay in state at the United States Capitol rotunda.", "This was the last of three state funerals in a span of 12 months, coming as it did just after the deaths of President John F. Kennedy and General Douglas MacArthur." ] ], "gold": "The oldest living U.S. president is Jimmy Carter, born October 1, 1924. On March 22, 2019, he also became the nation's longest-lived president, surpassing the lifespan of George H W Bush.", "prediction 1": "The longest living president was Herbert Hoover who, from 1901 to 1967, was the last living president of the United States. The longest living president of the United States was Jimmy Carter, who lived to be 92 years old and attended the 102nd inauguration on January 20, 2017.", "prediction 2": "The longest living president in U.S. history was Herbert Hoover, who lived from 1865 to 1944. He was succeeded by Jimmy Carter in 1977.", "prediction 3": "In the United States, the longest-living president was Herbert Hoover, who lived from 1893 to 1944. He was succeeded by his son, Jimmy Carter, on January 20, 2017, at age 92.", "prediction 4": "The presidents of the United States with the longest lives were Herbert Hoover and John Adams. In total, the longest-living president was Herbert Hoover. The other longest-living president was Jimmy Carter.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 277 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Jimmy Carter is currently the second longest-lived president in history after George H. W. Bush, who was born 111 days before Carter. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who authorized the construction of the boulder dam?", "passages": [ [ "Hoover Dam", "Initial talks produced no result, but when the Supreme Court handed down the \"Wyoming v. Colorado\" decision undermining the claims of the upstream states, they became anxious to reach an agreement.", "The resulting Colorado River Compact was signed on November 24, 1922.", "Legislation to authorize the dam was introduced repeatedly by two California Republicans, Representative Phil Swing and Senator Hiram Johnson, but representatives from other parts of the country considered the project as hugely expensive and one that would mostly benefit California.", "The 1927 Mississippi flood made Midwestern and Southern congressmen and senators more sympathetic toward the dam project.", "On March 12, 1928, the failure of the St. Francis Dam, constructed by the city of Los Angeles, caused a disastrous flood that killed up to 600 people.", "As that dam was a curved-gravity type, similar in design to the arch-gravity as was proposed for the Black Canyon dam, opponents claimed that the Black Canyon dam's safety could not be guaranteed.", "Congress authorized a board of engineers to review plans for the proposed dam.", "The Colorado River Board found the project feasible, but warned that should the dam fail, every downstream Colorado River community would be destroyed, and that the river might change course and empty into the Salton Sea.", "The Board cautioned: \"To avoid such possibilities, the proposed dam should be constructed on conservative if not ultra-conservative lines.\"" ], [ "Hoover Dam", "On December 21, 1928, President Coolidge signed the bill authorizing the dam.", "The Boulder Canyon Project Act appropriated $165\u00a0million for the Hoover Dam along with the downstream Imperial Dam and All-American Canal, a replacement for Beatty's canal entirely on the U.S. side of the border.", "It also permitted the compact to go into effect when at least six of the seven states approved it.", "This occurred on March 6, 1929, with Utah's ratification; Arizona did not approve it until 1944.", "Even before Congress approved the Boulder Canyon Project, the Bureau of Reclamation was considering what kind of dam should be used.", "Officials eventually decided on a massive concrete arch-gravity dam, the design of which was overseen by the Bureau's chief design engineer John L. Savage.", "The monolithic dam would be thick at the bottom and thin near the top, and would present a convex face towards the water above the dam.", "The curving arch of the dam would transmit the water's force into the abutments, in this case the rock walls of the canyon.", "The wedge-shaped dam would be thick at the bottom, narrowing to at the top, leaving room for a highway connecting Nevada and Arizona.", "On January 10, 1931, the Bureau made the bid documents available to interested parties, at five dollars a copy." ], [ "Hoover Dam", "Hoover Dam\n\nHoover Dam is a concrete arch-gravity dam in the Black Canyon of the Colorado River, on the border between the U.S. states of Nevada and Arizona.", "It was constructed between 1931 and 1936 during the Great Depression and was dedicated on September 30, 1935, by President Franklin D. Roosevelt.", "Its construction was the result of a massive effort involving thousands of workers, and cost over one hundred lives.", "Originally known as Boulder Dam from 1933, it was officially renamed Hoover Dam, for President Herbert Hoover, by a joint resolution of Congress in 1947.", "Since about 1900, the Black Canyon and nearby Boulder Canyon had been investigated for their potential to support a dam that would control floods, provide irrigation water and produce hydroelectric power.", "In 1928, Congress authorized the project.", "The winning bid to build the dam was submitted by a consortium called Six Companies, Inc., which began construction on the dam in early 1931.", "Such a large concrete structure had never been built before, and some of the techniques were unproven.", "The torrid summer weather and lack of facilities near the site also presented difficulties.", "Nevertheless, Six Companies turned the dam over to the federal government on March 1, 1936, more than two years ahead of schedule.", "Hoover Dam impounds Lake Mead, the largest reservoir in the United States by volume (when it is full)." ] ], "gold": "Hoover Dam\u00a0is a\u00a0concrete\u00a0arch-gravity dam\u00a0in the\u00a0Black Canyon\u00a0of the\u00a0Colorado River, on the border between the U.S. states of\u00a0Nevada\u00a0and\u00a0Arizona. It was constructed between 1931 and 1936 during the\u00a0Great Depression. Dedicated on September 30, 1935, by President\u00a0Franklin D. Roosevelt, it was referred to as Hoover Dam after President Herbert Hoover in bills passed by Congress during its construction, but was named Boulder Dam by the Roosevelt administration. The Hoover Dam name was restored by Congress in 1947. Congress authorized a board of engineers to review plans for the proposed dam. On December 21, 1928,\u00a0President Coolidge\u00a0signed the bill authorizing the dam.", "prediction 1": "On December 21, 1928, President Coolidge signed the bill authorizing the Boulder Canyon Project, which would have created a massive concrete arch-gravity dam in the Black Canyon of the Colorado River. The dam was dedicated on September 30, 1935, by President Franklin D. Roosevelt.", "prediction 2": "Hoover Dam is a concrete arch-gravity dam in the Black Canyon of the Colorado River, in the state of Nevada. It was constructed between 1931 and 1936, and was dedicated on September 30, 1935, by President Franklin D. Roosevelt. The Boulder Canyon Project Act authorized the construction of the dam on December 21, 1928, and was signed the same day by President Calvin Coolidge.", "prediction 3": "The Boulder Canyon Project was approved by Congress in 1928. The winning bid to build the dam was submitted by a consortium called Six Companies, Inc., which began construction on the dam in early 1931. The construction cost over $1 million and involved thousands of workers. The dam was dedicated on September 30, 1935, by President Franklin D. Roosevelt.", "prediction 4": "The Boulder Canyon Project was authorized by Congress and signed by President Coolidge on December 21, 1928. The dam was dedicated on September 30, 1935 by President Franklin D. Roosevelt.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 200 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Hoover Dam is a concrete arch-gravity dam in the Black Canyon of the Colorado River, on the border between the U.S. states of Nevada and Arizona. It was constructed between 1931 and 1936 during the Great Depression and was dedicated on September 30, 1935, by President Franklin D. Roosevelt. Originally known as Boulder Dam from 1933, it was officially renamed Hoover Dam, for President Herbert Hoover, by a joint resolution of Congress in 1947. Congress authorized a board of engineers to review plans for the proposed dam. On December 21, 1928, President Coolidge signed the bill authorizing the Boulder Canyon Project." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Countries who have won the cricket world cup?", "passages": [ [ "2019 Cricket World Cup", "2019 Cricket World Cup\n\nThe 2019 Cricket World Cup (officially ICC Cricket World Cup 2019) is the 12th edition of the Cricket World Cup, scheduled to be hosted by England and Wales, from 30 May to 14 July 2019.", "The hosting rights were awarded in April 2006, after England and Wales withdrew from the bidding to host the 2015 ICC Cricket World Cup, which was held in Australia and New Zealand.", "The first match will be played at The Oval while the final will be played at Lord's.", "It is the fifth time that the Cricket World Cup will be held in England and Wales, following the 1975, 1979, 1983 and 1999 World Cups.", "The format for the tournament will be a single group of ten teams, with each team playing the other nine teams, and the top four teams progressing to a knockout stage of semi-finals and a final.", "The ten team tournament has gained criticism due to the lack of Associate teams in the tournament.", "Given the increase of the Test playing nations from 10 to 12, with the admission of Ireland and Afghanistan in June 2017, it will be the first World Cup to be contested without all of the Test playing nations being present, and after the elimination of all the Associate teams at the qualifying tournament, this will be also be the first World Cup to feature no Associate members." ], [ "2019 Cricket World Cup", "The 2019 World Cup will feature 10 teams, a decrease from previous World Cups in 2011 and 2015 which featured 14 teams.", "The hosts, England, and the top seven other teams in the ICC One Day International rankings as of 30 September 2017 earned automatic qualification, with the remaining two spots being decided by the 2018 Cricket World Cup Qualifier.", "At the time of the announcement of the qualification structure, ICC Associate and Affiliate members, who were guaranteed four spots in the previous two World Cup tournaments, could be represented by at most two teams, and possibly none at all if they were beaten by the lowest ranked Full Members in the Qualifier.", "It also meant that at least two of the 10 Test playing nations at the time of the announcement would have to play in the qualifying tournament, and could possibly miss the World Cup finals entirely.", "Following recent success, Ireland and Afghanistan were promoted into the ICC ODI Championship and have also since been promoted to full members of the ICC, becoming the newest Test cricketing nations.", "However, they still needed to qualify for the World Cup via the current process.", "Afghanistan won the qualifying tournament defeating the West Indies in the final.", "Both teams qualified for the World Cup, while Zimbabwe despite hosting the qualifying tournament failed to reach the final and will miss the World Cup for the first time since 1983." ], [ "2017 Women's Cricket World Cup", "2017 Women's Cricket World Cup\n\nThe 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017.", "It was the eleventh edition of the Women's Cricket World Cup, and the third to be held in England (after the 1973 and 1993 tournaments).", "The 2017 World Cup was the first in which all participating players were fully professional.", "Eight teams qualified to participate in the tournament.", "England won the final against India at Lord's on 23 July by 9 runs.", "The 2014\u201316 ICC Women's Championship, featuring the top eight ranked teams in women's cricket, was the first phase of qualifying for the World Cup, with the top four teams qualifying automatically.", "The remaining four places were decided at the 2017 World Cup Qualifier, a ten-team event that was held in Sri Lanka in February 2017.", "This featured the bottom four teams from the ICC Women's Championship and six other teams.", "On 8 February 2016, the International Cricket Council (ICC) announced the five venues for the 2017 Women's World Cup.", "Lord's hosted the final, and other matches were played at the home grounds of Derbyshire, Leicestershire, Somerset and Gloucestershire.", "The captains of each team were announced on 21 April 2017, with the full squads named shortly after." ] ], "gold": "The Cricket World Cup, officially known as ICC Men's Cricket World Cup is the international championship of One Day International (ODI) cricket. The event is held every four years. The winners in 2007 and 2015 were Australia, while India won in 2011. The ICC Women's Cricket World Cup is the sport's oldest world championship. The winners in 2009 and 2017 were England, while Australia won in 2013.", "prediction 1": "The Cricket World Cup is an international cricket tournament in which countries play against each other for a single team in a single group. Traditionally, countries that have won the Cricket World Cup are Australia, New Zealand, Pakistan, South Africa and Sri Lanka. However, the 2019 Cricket World Cup will feature 10 teams, a decrease from previous World Cups in 2011 and 2015 which featured 14 teams. The format for the tournament is a single group of ten teams, with each team playing the other nine teams, and the top four teams progressing to a knockout stage of semi-finals and a final. The 2017 Men's Cricket World Cup was an international cricket tournament that took place in England from 24 June to 23 July by 9 runs. Afghanistan won the qualifying tournament defeating the West Indies in the final.", "prediction 2": "The Cricket World Cup is an annual international cricket tournament attended by 32 nations. The format for the tournament will be a single group of ten teams, with each team playing the other nine teams, and the top four teams progressing to a knockout stage of semi-finals and a final. In the 2018 Cricket World Cup, Australia won the men's tournament and in the 2017 women's tournament, Afghanistan won the women's tournament and in the 2015, Pakistan won the men's tournament.", "prediction 3": "The Cricket World Cup is an international cricket tournament that is organized by the International Cricket Council (ICC) and is hosted by the nations of the ICC. The 2017 Men's Cricket World Cup was held in England from 24 June to 23 July 2017. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017.", "prediction 4": "The Cricket World Cup is an annual international cricket tournament hosted by the United States and Canada. The format for the tournament is a single group of ten teams, with each team playing the other nine teams, with the top four teams progressing to a knockout stage of semi-finals and a final. In 2018, England and the top seven other teams in the ICC One Day International rankings as of 30 September 2017 earned automatic qualification, while the remaining two spots were decided by the 2018 Cricket World Cup Qualifier.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 140 }, { "error type": "Unverifiable", "explanation": "", "start": 141, "end": 155 }, { "error type": "Unverifiable", "explanation": "", "start": 206, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 404 }, { "error type": "Redundant", "explanation": "The Cricket World Cup is an international cricket tournament in which countries play against each other for a single team in a single group. ", "start": 405, "end": 511 }, { "error type": "Irrelevant", "explanation": "", "start": 512, "end": 594 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 604, "end": 609 }, { "error type": "Irrelevant", "explanation": "", "start": 668, "end": 718 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 719, "end": 729 }, { "error type": "Irrelevant", "explanation": "", "start": 730, "end": 811 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Cricket World Cup is an international cricket tournament. England won the final at the 2017 Women's Cricket World Cup." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who sings gimme shelter with the rolling stones?", "passages": [ [ "Gimme Shelter", "According to him:\nThe recording features guest vocals by Merry Clayton, recorded at a last-minute late-night recording session during the mixing phase, arranged by her friend and record producer Jack Nitzsche.", "After the first verse is sung by Jagger, Merry Clayton enters and they share the next three verses.", "A harmonica solo by Jagger and guitar solo by Richards follow.", "Then, with great energy, Clayton repeatedly sings \"Rape, murder!", "It's just a shot away!", "It's just a shot away!", "\", almost screaming the final stanza.", "She and Jagger then repeat the line \"It's just a shot away\" and finish with repeats of \"It's just a kiss away\".", "When speaking of her inclusion in the recording, Jagger stated in the 2003 book \"According to the Rolling Stones\": \"The use of the female voice was the producer's idea.", "It would be one of those moments along the lines of 'I hear a girl on this track \u2013 get one on the phone.'\" Summoned \u2013 pregnant \u2013 from bed around midnight by producer Jack Nitzsche, Clayton made her recording with just a few takes then returned home to bed.", "It remains the most prominent contribution to a Rolling Stones track by a female vocalist." ], [ "Lisa Fischer", "trilogy featured Fischer in the starring role of Doris Winter and followed the character as she assembled a company of fellow singers for the forthcoming international \"World Peace and Harmony Tour\".", "Lisa Fischer continued to work on music doing background vocals and she also is a songwriter for artist such as Anane Vega.", "Fischer toured with Tina Turner on her Twenty Four Seven Tour.", "It was the worldwide top-grossing tour of 2000.", "She continued to sing backup for Tina Turner and The Rolling Stones as well as compose songs for herself and up-and-coming artists.", "Lisa was featured in an April 14, 2008 issue of \"Jet Magazine\"\u2032s \"Where Are They Now?\" column.", "In 2009, Fischer completed touring with Tina Turner on her and she is featured on Turner's new live DVD-CD titled \"Tina Live\".", "In the performance of Tina! :", "50th Anniversary Tour, in 2009, Fischer and Turner sing \"It's Only Rock 'n Roll (But I Like It)\" together and after Turner leaves the stage, Fischer completes the song solo.", "Fischer sang on Sting's album \"If on a Winter's Night...\" as a backing vocalist.", "In September 2009, Sting and his band, plus Fischer, performed the songs live in Durham Cathedral.", "The rehearsals as well as the concert were filmed and were released as a DVD." ], [ "Gimme Shelter", "Gimme Shelter\n\n\"Gimme Shelter\" is the opening track to the 1969 album \"Let It Bleed\" by the Rolling Stones.", "Greil Marcus, writing in \"Rolling Stone\" magazine at the time of its release, praised the song, stating that the band has \"never done anything better\".", "Although the first word was spelled \"Gimmie\" on that album, subsequent recordings by the band and other musicians have made \"Gimme\" the customary spelling.", "The recording features Richards playing in an open tuning on electric guitar.", "The recording also features vocals by Merry Clayton.", "\"Gimme Shelter\" was written by the Rolling Stones' lead vocalist Mick Jagger and guitarist Keith Richards, the band's primary songwriting team.", "Richards began working on the song's signature opening riff in London whilst Jagger was away filming \"Performance\".", "As released, the song begins with Richards performing a guitar intro, soon joined by Jagger's lead vocal.", "Of \"Let It Bleed\"'s bleak world view, Jagger said in a 1995 interview with \"Rolling Stone\" magazine:\n\nSimilarly, on NPR in 2012: \nHowever, the song's inspiration was not initially Vietnam or social unrest, but Keith Richards seeing people scurrying for shelter from a sudden rain storm." ] ], "gold": "\"Gimme Shelter\" is the opening track to the 1969 album \"Let It Bleed\" by the Rolling Stones, featuring guest vocals by Merry Clayton. On tour, the vocalist that sings \"Gimme Shelter\" together with the band is Lisa Fischer, who has accompanied them on live performances since 1989.", "prediction 1": "\"Gimme Shelter\" is the opening track to the 1969 album Let It Bleed by the Rolling Stones. Mick Jagger sang the lead vocal and guitarist Keith Richards sang the lead guitar. Merry Clayton sang the lead vocal on the recording, while Jagger sang the background vocal.", "prediction 2": "\"Gimme Shelter\" is the opening track to the 1969 album Let It Bleed by the Rolling Stones. The song was written by the Rolling Stones' lead vocalist Mick Jagger and guitarist Keith Richards, the band's primary songwriting team. In 2005, the Rolling Stones revealed that they have re-recorded the song with guest vocals by Merry Clayton.", "prediction 3": "\"Gimme Shelter\" is the opening track to the 1969 album Let It Bleed by the Rolling Stones. The recording also features vocals by Merry Clayton, recorded at a last-minute late-night recording session during the mixing phase, arranged by her friend and record producer Jack Nitzsche.", "prediction 4": "\"Gimme Shelter\" is the opening track to the 1969 album Let It Bleed by the Rolling Stones. It was written by the Rolling Stones' lead vocalist Mick Jagger and guitarist Keith Richards, the band's primary songwriting team. Merry Clayton sings on the recording, which was recorded at a last-minute late night recording session during the mixing phase, arranged by her friend and record producer Jack Nitzsche.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 226, "end": 265 } ], "missing-info": [], "corrected-prediction": "\"Gimme Shelter\" is the opening track to the 1969 album Let It Bleed by the Rolling Stones, featuring guest vocals by Merry Clayton. Mick Jagger sang the lead vocal and guitarist Keith Richards sang the lead guitar. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most superbowl in the nfl?", "passages": [ [ "Three-peat", "Two-time defending Super Bowl champions who failed to three-peat include the Green Bay Packers (1968), Miami Dolphins (1974), Pittsburgh Steelers (twice: 1976, 1980), San Francisco 49ers (1990), Dallas Cowboys (1994), Denver Broncos (1999), and New England Patriots (2005).", "All of these teams failed to return to the title game in the third season (indicated in parentheses).", "The Buffalo Bills went to 4 consecutive Super Bowls from 1990\u20131993 which is a feat unmatched in NFL history, however they lost in every appearance.", "In the early years of the NFL, decades before the introduction of either the term \"three-peat\" or the Super Bowl, the Packers won three consecutive NFL titles from 1929\u201331.", "This was achieved without playing any postseason playoff games, as the league title was determined at that time from the season standings.", "In addition, the Packers won the NFL championship in 1965, at a time when the rival NFL and AFL played separate exclusive championships.", "They then followed that 1965 championship with their first two Super Bowl victories in 1966 and 1967 (their Super Bowl berths were earned by winning both the 1966 NFL Championship Game and 1967 NFL Championship Game), thereby winning championships three years in a row.", "There have been efforts to come up with a similarly clever name for the potential fourth consecutive championship in the year following a three-peat." ], [ "2011 New England Patriots season", "The Patriots, as was the case in their previous appearance against these same Giants in Super Bowl XLII, had a chance to join the San Francisco 49ers, the Dallas Cowboys, the Pittsburgh Steelers, and the Green Bay Packers as the only teams to win at least four Super Bowls (the Packers, who had entered the 2011 season as the defending champions, had not yet won a fourth Super Bowl when the Patriots had last appeared).", "Instead, the Patriots tied a then-NFL record for most losses in a Super Bowl that had been set by the Minnesota Vikings and tied by the Denver Broncos and Buffalo Bills, each of whom had lost four.", "With the loss, along with losses in 1985, 1996, and 2007, the Patriots tied with the Denver Broncos, Buffalo Bills and Minnesota Vikings for most Super Bowl losses at four (although the Broncos would lose their fifth against the Seattle Seahawks two years later, and the Patriots would lose their fifth six years later).", "The Patriots traded their original seventh-round pick to the Atlanta Falcons for offensive lineman Quinn Ojinnaka in August 2010.", "The Patriots also acquired the Denver Broncos' fourth-round selection in exchange for a sixth-round selection and running back Laurence Maroney.", "The Patriots acquired the sixth-round selection from the New Orleans Saints in a September 2009 trade for tight end David Thomas." ] ], "gold": "The New England Patriots and Pittsburgh Steelers have won the most Super Bowls with six championships, while the Dallas Cowboys and the San Francisco 49ers have five wins. The New England Patriots have the most Super Bowl appearances with 11, while the Buffalo Bills have the most consecutive appearances with four, all losses, from 1990 to 1993. The Miami Dolphins and New England Patriots are the only other teams to have at least three consecutive appearances. The Denver Broncos and Patriots have each lost a record of five Super Bowls, while the Minnesota Vikings and the Bills have lost four.", "prediction 1": "The Green Bay Packers have the most Super Bowls in NFL history with four wins. In 2016, the Dallas Cowboys have the most Super Bowls and in 2017, the New England Patriots have the most Super Bowls.", "prediction 2": "The Green Bay Packers have the most Super Bowls in NFL history, with 13 victories, while the Dallas Cowboys have the most Super Bowls.", "prediction 3": "The Green Bay Packers have the most Super Bowls in league history. The most games that they have played in the Super Bowl are in 1966, 1967, and 1969.", "prediction 4": "The Green Bay Packers have won the most Super Bowls in the NFL. In the early years of the NFL, decades before the introduction of either the term \"three-peat\" or the Super Bowl, the Green Bay Packers won three consecutive NFL titles from 1929-31. This was achieved without playing any postseason playoff games, as the rival NFL and AFL played separate exclusive championships. The Packers also won the most Super Bowls in the NFL in 1966, 1967, and 1969.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 79, "end": 197 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Buffalo Bills have the most consecutive Super Bowls from 1990\u20131993 in NFL history. Patriots tied with the Denver Broncos for most Super Bowl losses at five, while the Buffalo Bills and Minnesota Vikings have four. The San Francisco 49ers, the Dallas Cowboys, the Pittsburgh Steelers, and the Green Bay Packers as the only teams to win at least four Super Bowls." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where is the fastest speed limit in the united states?", "passages": [ [ "Transportation in Texas", "Most roads, such as rural two-lane roads, rural divided expressways and interstates, and urban interstates are posted at 75 mph (121\u00a0km/h), but some rural freeways and interstates have 80 mph (129\u00a0km/h) speed limits, and one toll road, Texas State Highway 130, has an 85 mph (137\u00a0km/h) speed limit, the highest in the United States.", "The Dallas-Fort Worth International Airport, located nearly equidistant from downtown Dallas and downtown Fort Worth, is the largest airport in the state, the second largest in the United States, and fourth largest in the world.", "The airport is the headquarters for American Airlines.", "Texas's second-largest air facility is Houston's George Bush Intercontinental Airport (IAH).", "The airport is the tenth-busiest in the United States for total passengers, and nineteenth-busiest worldwide.", "The airport is the largest hub for United Airlines, with over 600 daily departures.", "A long list of cities within Texas, as well as international destinations, are served directly from this airport.", "With 30 destinations in Mexico, IAH offers service to more Mexican destinations than any other U.S. airports.", "IAH currently ranks second among U.S. airports with scheduled non-stop domestic and international service (221 destinations), trailing only Atlanta Hartsfield with 250 destinations." ] ], "gold": "The state of Texas currently holds the highest posted speed limit in the United States at 85 mph. which can be found only on the Texas State Highway 130.", "prediction 1": "The speed limit for a motor vehicle in Texas is 85 mph (137 km/h).", "prediction 2": "The speed limit in Texas is 85 mph, while in other states, it is 75 mph. The fastest speed limit in Texas is 80 mph on Interstate 10 in Allen County.", "prediction 3": "The speed limit in Texas is 80 mph, while rural freeways and interstates have 80 mph speed limits. One toll road, Texas State Highway 130, has an 85 mph (137 km/h) speed limit, the highest in the United States. The Dallas-Fort Worth International Airport is the fastest speed limit in the United States, while Houston's George Bush Intercontinental Airport is the fastest.", "prediction 4": "The speed limit in Texas is 85 mph, and it's in Texas State Highway 130, located in Texas State, which is the fastest road in the United States.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Texas State Highway 130, has an 85 mph (137 km/h) speed limit, the highest in the United States." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When did the anaheim angels win the world series?", "passages": [ [ "2002 San Francisco Giants season", "The Giants scored the first run on a sacrifice, but the Angels responded with a run-scoring double from catcher Bengie Molina and a 3-run double to right field from left fielder Garret Anderson to open a 4-1 lead.", "Rookie starting pitcher John Lackey maintained that lead.", "In the 9th inning, closer Troy Percival provided some tense moments as he opened the inning by putting two Giants on base, with only one out.", "But Tsuyoshi Shinjo \u2013 the first Japanese player in a World Series game \u2013 struck out swinging, and Kenny Lofton, also representing the tying run, flied out to Darin Erstad in right-center field to end the Series.", "The Angels won Game 7, 4-1, to claim their franchise's first and so far only World Series Championship.", "John Lackey became the first rookie pitcher to win a World Series game 7 since 1909.", "All-Star Game" ], [ "2002 Anaheim Angels season", "= Batting average; HR = Home runs; RBI = Runs batted in\"\nWith their 10-5 win over the Texas Rangers on Mon.", "September 26, 2002, the Angels clinched their first (and only to date as of 2017)", "Wildcard berth.", "At this time, the Angels would be in the postseason for the first time since the 1986 season.", "The 2002 American League Division Series featured the Wildcard winner Anaheim Angels and the AL East champion New York Yankees.", "The series began on October 1, 2002 with the Angels splitting the first two games at Yankee Stadium.", "The Angels then proceeded to win the next two games, earning their ticket to the ALCS and winning their first postseason series in franchise history.", "The 2002 American League Championship Series featured the Wildcard winner Anaheim Angels and the AL Central champion Minnesota Twins.", "The series began on October 8, 2002 with the Angels splitting the first two games at the Hubert H. Humphrey Metrodome.", "The Angels then went home where they won three straight at Edison Field to earn a spot in the 2002 World Series.", "Infielder Adam Kennedy was the ALCS MVP.", "The 2002 World Series was the 98th edition of the Fall Classic, held from October 19\u201327, 2002.", "The series featured the American League champion Anaheim Angels defeating the National League champion San Francisco Giants, 4\u20133, to win the franchise's first ever World Series." ], [ "John Lackey", "However, in Game 7 of the World Series on October 27, 2002, Lackey allowed one earned run on four hits while striking out four in five innings, allowing the Angels to hold an early 4\u20131 lead to hand over to their bullpen trio of Brendan Donnelly, Francisco Rodr\u00edguez, and Troy Percival to seal their World Series title.", "Lackey became only the second rookie in World Series history to start and win Game 7, the other being Babe Adams of the Pittsburgh Pirates.", "It was the first of two Series title-clinching games in which he received credit as the winning pitcher.", "Mike Scioscia announced that Lackey would start on Opening Day 2003, replacing injured ace Jarrod Washburn.", "Lackey struggled his sophomore year, compiling a 10\u201316 record with a 4.63 ERA while leading the team in hits and earned runs allowed, and wild pitches.", "He finished with a record of 14\u201313 and a 4.67 ERA, helping the Angels win their first division title since .", "The campaign saw Lackey mature further, working into the sixth inning in 30 of his 36 starts, earning a 14\u20135 record with a 3.44 ERA.", "He ranked second in strikeouts per nine innings (with 8.6 K/9 IP) and third in strikeouts (199).", "However, he finished with the third most wild pitches in the league." ] ], "gold": "The Anaheim Angels were the champions of the 2002 World Series against the San Francisco Giants. The Angels defeated the Giants in game 7, winning four games to three, on Sunday, October 27, 2002. It was played at Pacific Bell Park in San Francisco and Edison International Field of Anaheim in Anaheim. To date, it is the Anaheim Angels only World Series win.", "prediction 1": "The 2002 World Series was the 98th edition of the Fall Classic, held from October 19\u201327, 2002. The series featured the American League champion Anaheim Angels defeating the National League champion San Francisco Giants, 4\u20133, to win the franchise's first World Series. John Lackey became the first rookie pitcher to win a World Series game 7 since 1909.", "prediction 2": "The Anaheim Angels won the 2002 World Series when they defeated the San Francisco Giants 4\u20133 in Game 7 of the Fall Classic, held from October 19\u201327, 2002.", "prediction 3": "The 2002 World Series was the 98th edition of the Fall Classic, held from October 19\u201327, 2002. The American League champion Anaheim Angels defeated the National League champion San Francisco Giants, 4\u20133, to win the franchise's first and so far only World Series Championship. In Game 7, John Lackey became the first rookie pitcher to win a World Series game 7 since 1909. The Angels went on to win the series 4\u20131 and claimed their first and so far only World Series Championship.", "prediction 4": "The 2002 World Series featured the American League champion Anaheim Angels defeating the National League champion San Francisco Giants, 4\u20133, to win the franchise's first ever World Series. However, in Game 7 of the World Series on October 27, 2002, John Lackey became the first rookie pitcher to win a World Series game 7 since 1909.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 352 } ], "missing-info": [], "corrected-prediction": "The 2002 World Series was the 98th edition of the Fall Classic, held from October 19\u201327, 2002. The series featured the American League champion Anaheim Angels defeating the National League champion San Francisco Giants, 4\u20133, to win the franchise's first World Series. " }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "When does are you the one 2018 come on?", "passages": [ [ "Voltron", "On March 25, 2016, a teaser trailer was released, announcing that the first season, consisting of 13 episodes, would premiere June 10, 2016.", "A second season premiered on Netflix on January 20, 2017.", "The third season premiered on Netflix on August 4, 2017, and consisted of 7 episodes while the fourth season premiered on October 13, 2017, and consisted of 6 episodes.", "The fifth season premiered on March 2, 2018, and consists of six episodes.", "[5] The sixth season premiered on June 15, 2018 and consists of seven episodes.", "The 7th season premiered August 10th 2018 and consists of 13 episodes.", "The 8th and final season is set to release on December 14th, 2018 and will consist of 13 episodes.", "The series' success has spawned several comics, action figures, and other toys.", "In Australia, DVDs of all episodes of \"Voltron\" were released by Madman Entertainment as the 20th Anniversary Edition, Lion Force Voltron Collection.", "The original series was released in five volumes between August 2004 and July 2005, under the name \"Voltron: Defender of the Universe\".", "Each box was in the color and style of one of the lions with a metallic glossy inner DVD-case.", "Another three volumes of \"\"Vehicle Team Voltron\"\" were released between August and December 2005.", "In addition, a \"Best of\" 2-DVD set released in November 2006 featured five episodes from each series." ], [ "Are You the One?", "Are You the One?", "Are You the One?, sometimes abbreviated as AYTO?, is an American reality television series on MTV, in which young singles try to find love.", "A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm.", "Then, while living together, the contestants try to identify all of these \"perfect matches.\"", "If they succeed, the entire group shares a prize of up to $1 million.", "Over the course of each season, the contestants have the opportunity to pair up in different combinations to compete against each other to win dates, as well as the opportunity to learn in the \"truth booth\" if a given couple is a correct match.", "At the end of each episode, the contestants pair up in a \"matching ceremony\" and learn how many perfect matches they have, but not which matches are correct.", "From season 3 onward, the prize was reduced any time that the house failed to identify any matches other than those already confirmed via the truth booth.", "On March 22, 2017, spin-off \"Are You The One: Second Chances\" premiered.", "10 perfect matches from previous seasons returned to compete in tasks designed to test the strength of their bonds." ], [ "Cond\u00e9 Nast Entertainment", "Graydon Carter, a \"Vanity Fair\" editor, called the series a \"representation of how people are consuming more voraciously than ever.\"", "At the company's fifth annual Digital Content NewFronts presentation in New York in May 2017, CNE announced the return of 65 original short-form digital series and the premiere of 40 new shows.", "In August 2017, CNE announced its participation in Facebook's new original video programing platform, Watch, by introducing \"Virtually Dating,\" a show where blind dates take place in a virtual reality world.", "Ostroff identifies Facebook Watch as \"a new opportunity, new type of content.\"", "In December 2017, CNE announced a new first-look deal that gives Paramount and Anonymous Content an opportunity to partner with CNE on production for scripted TV projects in advance of other potential collaborators.", "On February 22, 2018, Cond\u00e9 Nast announced the launch of Iris, a video and social-led brand for socially-conscious millennial women, that was developed from the original programming on The Scene.", "Programming on Iris will include the series \u201c Broken,\u201d showcasing couples confronting each other about infidelity, and \u201cAffirmations\", featuring children receiving affirmations from their parents.", "In July 2018, Dawn Ostroff stepped down as President to join Spotify, and COO Sahar Elhabashi was appointed interim head." ] ], "gold": "\"Are You the One?\" is an American reality television series on MTV, in which young singles try to find love. The main idea of the show revolves around a group of men and women who are secretly paired into couples by producers, via a matchmaking algorithm. Then, while living together, the contestants try to identify all of these \"perfect matches\", sharing a price that can go as high as $1 million if they succeed. The seventh season of the show came out on August 15, 2018, the same year a new season of the Brazilian version of the program aired on February 22, 2018.", "prediction 1": "Are You the One is an American reality television series on MTV, in which young singles try to find love. A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm. Then, while living together, the contestants try to identify all of these \"perfect matches.\" If they succeed, the entire group shares a prize of up to $1 million. The 8th and final season is set to release on December 14th, 2018.", "prediction 2": "Are You the One is an American reality television series on MTV, in which young singles try to find love. A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm. Then, while living together, the contestants try to identify all of these \"perfect matches.\" If they succeed, the entire group shares a prize of up to $1 million. The 8th and final season, which consists of 13 episodes, is set to release on December 14th, 2018.", "prediction 3": "Are You the One? is an American reality television series on MTV in which young singles try to find love. A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm. Then, while living together, the contestants try to identify all of these \"perfect matches.\" If they succeed, the entire group shares a prize of up to $1 million. The 8th and final season is set to release on December 14th, 2018 and will consist of 13 episodes.", "prediction 4": "Are You the One?, sometimes abbreviated as AYTO?, is an American reality television series on MTV in which young singles try to find love. A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm. The contestants then have the opportunity to pair up in different combinations to compete against each other to win dates, as well as the opportunity to learn in the truth booth if a given couple is a correct match. The series' success has spawned several comics, action figures, action figures, action figures, and other toys.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Are You the One is an American reality television series on MTV, in which young singles try to find love. A group of men and women are secretly paired into male-female couples by producers, via a matchmaking algorithm. Then, while living together, the contestants try to identify all of these \"perfect matches.\" If they succeed, the entire group shares a prize of up to $1 million. The 7th season premiered August 10th 2018. The 8th and final season is set to release on December 14th, 2018." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "How many episodes are in this season of the walking dead?", "passages": [ [ "The Walking Dead (franchise)", "The Walking Dead (franchise)\n\n", "The Walking Dead is a media franchise created by Robert Kirkman and Tony Moore including a comic book series, two television series, six novels, video games, and various other media such as audio books and sound tracks.", "\"The Walking Dead\" is a monthly black-and-white comic book series chronicling the travels of Rick Grimes, his family, and other survivors of a zombie apocalypse.", "First issued in 2003 by publisher Image Comics, the series was created by writer Robert Kirkman and artist Tony Moore (who was later replaced by Charlie Adlard from issue #7 onward, though Moore continued to do the covers through issue #24.)", "\"The Walking Dead\" received the 2010 Eisner Award for Best Continuing Series at San Diego Comic-Con International.", "\"The Walking Dead\" is an American television drama series developed by Frank Darabont.", "The series stars Andrew Lincoln as sheriff's deputy Rick Grimes, who awakens from a coma to find the world dominated by flesh-eating \"walkers\", resembling the zombies of George A. Romero's horror films.", "He sets out to find his family and encounters other survivors along the way.", "\"The Walking Dead\" premiered on October 31, 2010 on the cable television channel AMC in the United States." ], [ "Fear the Walking Dead", "Fear the Walking Dead\n\nFear the Walking Dead is an American post-apocalyptic horror drama television series created by Robert Kirkman and Dave Erickson, that premiered on AMC on August 23, 2015.", "It is a companion series and prequel to \"The Walking Dead\", which is based on the comic book series of the same name by Robert Kirkman, Tony Moore, and Charlie Adlard.", "In July 2018, AMC renewed the series for a fifth season, which is set to premiere in 2019.", "Andrew Chambliss and Ian Goldberg have been the showrunners since the fourth season.", "Set initially in Los Angeles, California and then later in Mexico, the series follows a dysfunctional, blended family composed of high school guidance counselor Madison Clark, her English teacher fianc\u00e9 Travis Manawa, her daughter Alicia, her drug addict son Nick, Travis's son from a previous marriage, Chris, Chris's mother Liza Ortiz, and others who join their group at the onset of the apocalypse.", "They must reinvent themselves, learning new skills and adopting new attitudes in order to survive as civilization collapses around them.", "The first season consists of six episodes.", "The second season, comprising 15 episodes, premiered on April 10, 2016.", "On April 15, 2016, AMC announced the series had been renewed for a 16-episode third season, which premiered on June 4, 2017." ], [ "The Walking Dead (season 5)", "The Walking Dead (season 5)\n\nThe fifth season of \"The Walking Dead\", an American post-apocalyptic horror television series on AMC, premiered on October 12, 2014, and concluded on March 29, 2015, consisting of 16 episodes.", "Developed for television by Frank Darabont, the series is based on the eponymous series of comic books by Robert Kirkman, Tony Moore, and Charlie Adlard.", "The executive producers were Kirkman, David Alpert, Scott M. Gimple, Greg Nicotero, Tom Luse, and Gale Anne Hurd, with Gimple as showrunner for the second consecutive season.", "The fifth season received widespread critical acclaim.", "It was nominated for multiple awards and won three, including Best Syndicated/Cable Television Series for the third consecutive year, at the 41st Saturn Awards.", "This season adapts material from issues #62\u201377 of the comic book series and introduces notable comic characters, including the cannibalistic hunters from Terminus, Father Gabriel Stokes (Seth Gilliam) and Aaron (Ross Marquand), as well as the Anderson and Monroe families.", "Now reunited, the season continues the story of Rick Grimes (Andrew Lincoln) and his group of survivors as they search for sanctuary, but face new threats from both walkers and other (hostile) human survivors." ] ], "gold": "The Walking Dead is an American post-apocalyptic horror television series based on the comic book series of the same name and features a large ensemble cast as survivors of a zombie apocalypse trying to stay alive under near-constant threat of attacks from zombies. Seasons 6, 7, and 8 of the show each have 16 episodes. The eleventh and final season of The Walking Dead, premiered on August 22, 2021, and will consist of 24 episodes.", "prediction 1": "The fifth season of The Walking Dead, an American post-apocalyptic horror television series on AMC, premiered on October 12, 2014, and concluded on March 29, 2015, consisting of 16 episodes. Season 5 is the sixth season of The Walking Dead, which is a monthly black-and-white comic book series chronicling the travels of Rick Grimes and his family as they search for sanctuary in a world dominated by flesh-eating \"walkers\".", "prediction 2": "The Walking Dead is a post-apocalyptic horror television series. The fifth season of The Walking Dead, a post-apocalyptic horror television series developed by Frank Darabont, consisted of 16 episodes. The six-episode season 5 finale of the series aired on March 29, 2015.", "prediction 3": "The Walking Dead is an American post-apocalyptic horror television series that premiered on AMC on October 12, 2014. The fifth season of the series consists of 16 episodes.", "prediction 4": "The Walking Dead is a post-apocalyptic horror television series that premiered on AMC on September 9, 2010. The fifth season of The Walking Dead, an American post-apocalyptic horror television series that premiered on AMC on October 12, 2014, has 16 episodes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 163 }, { "error type": "Incoherent", "explanation": "", "start": 191, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 275 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The fifth season of The Walking Dead, an American post-apocalyptic horror television series on AMC, consisting of 16 episodes, is based on The Walking Dead, comic book series chronicling the travels of Rick Grimes and his family as they search for sanctuary in a world dominated by flesh-eating \"walkers\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is in charge if president is impeached?", "passages": [ [ "Harry E. Claiborne", "The other House managers were Kastenmeier; Romano Mazzoli, D-Ky.; Dan Glickman, D-Kan.; Fish; Henry Hyde, R-Ill.; Thomas Kindness, R-Ohio; and DeWine.", "When the U.S. House formally presented the Senate with the four articles of impeachment against Claiborne on August 6, 1986, it set the stage for the first U.S. Senate impeachment trial in fifty years.", "House Judiciary Chairman, Rep. Rodino, was joined by eight other House managers and read each of the articles \"to an unusually somber Senate.", "About 40 senators were in their seats listening.\"", "Vice President George Bush presided over a ceremony where members of the Senate took a special oath for the impeachment trial.", "The only one absent was Arizona Senator Barry Goldwater, who was ill.\n\n", "On July 25, 1986 the Senate Rules Committee met to draft rules for impeachment trial and on August 12, 1986 the Senate Rules Committee approved revisions of Senate impeachment rules.", "On August 14, 1986 the Senate established procedures for the impeachment trial, including approving S. Res.", "481 providing for the use of trial committee to hear evidence." ], [ "Impeachment in the United States", "After hearing the charges, the Senate usually deliberates in private.", "The Constitution requires a two-thirds super majority to convict a person being impeached.", "The Senate enters judgment on its decision, whether that be to convict or acquit, and a copy of the judgment is filed with the Secretary of State.", "Upon conviction in the Senate, the official is automatically removed from office and may also be barred from holding future office.", "The trial is not an actual criminal proceeding and more closely resembles a civil service termination appeal in terms of the contemplated deprivation.", "Therefore, the removed official may still be liable to criminal prosecution under a subsequent criminal proceeding.", "The President may not grant a pardon in the impeachment case, but may in any resulting Federal criminal case.", "Beginning in the 1980s with Harry E. Claiborne, the Senate began using \"Impeachment Trial Committees\" pursuant to Senate Rule XI.", "These committees presided over the evidentiary phase of the trials, hearing the evidence and supervising the examination and cross-examination of witnesses.", "The committees would then compile the evidentiary record and present it to the Senate; all senators would then have the opportunity to review the evidence before the chamber voted to convict or acquit.", "The purpose of the committees was to streamline impeachment trials, which otherwise would have taken up a great deal of the chamber's time." ], [ "United States House of Representatives", "The House may approve \"articles of impeachment\" by a simple majority vote; however, a two-thirds vote is required for conviction in the Senate.", "A convicted official is automatically removed from office and may be disqualified from holding future office under the United States.", "No further punishment is permitted during the impeachment proceedings; however, the party may face criminal penalties in a normal court of law.", "In the history of the United States, the House of Representatives has impeached sixteen officials, of whom seven were convicted.", "(Another, Richard Nixon, resigned after the House Judiciary Committee passed articles of impeachment but before a formal impeachment vote by the full House.)", "Only two Presidents of the United States have ever been impeached: Andrew Johnson in 1868 and Bill Clinton in 1998.", "Both trials ended in acquittal; in Johnson's case, the Senate fell one vote short of the two-thirds majority required for conviction.", "Under the Twelfth Amendment, the House has the power to elect the President if no presidential candidate receives a majority of votes in the Electoral College.", "The Twelfth Amendment requires the House to choose from the three candidates with the highest numbers of electoral votes.", "The Constitution provides that \"the votes shall be taken by states, the representation from each state having one vote.\"", "It is rare for no presidential candidate to receive a majority of electoral votes." ], [ "Article Two of the United States Constitution", "When William Henry Harrison died in office, a debate arose over whether the Vice President would become President, or if he would just inherit the powers, thus becoming an Acting President.", "Harrison's Vice President, John Tyler, believed that he had the right to become President.", "However, many Senators argued that he only had the right to assume the powers of the presidency long enough to call for a new election.", "Because the wording of the clause is so vague, it was impossible for either side to prove its point.", "Tyler took the Oath of Office as President, setting a precedent that made it possible for later Vice Presidents to ascend to the presidency unchallenged following the President's death.", "The \"Tyler Precedent\" established that if the President dies, resigns or is removed from office, the Vice President becomes President.", "The Congress may provide for a line of succession beyond the Vice President.", "The current Presidential Succession Act establishes the order as the Speaker of the House of Representatives, the President \"pro tempore\" of the Senate and then the fifteen Cabinet Secretaries in order of that Department's establishment.", "There are concerns regarding the constitutionality of having members of Congress in the line of succession, however, as this clause specifies that only an \"officer of the United States\" may be designated as a presidential successor." ] ], "gold": "The Constitution of the United States gives Congress the authority to impeach the president of the United States from office in two separate proceedings. The first one takes place in the House of Representatives, which impeaches the president of The United States of America by approving articles of impeachment through a simple majority vote. The second proceeding, the impeachment trial, takes place in the Senate. The Chief Justice presides over the Senate impeachment trial of the president of the United States. If the president is impeached and removed from office, the United States presidential line of succession stipulates that this office passes to the vice president.", "prediction 1": "The president is impeached by the House of Representatives, but the Senate enters judgment on its decision, whether that be to convict or acquit, and a copy of the judgment is filed with the Secretary of State. The Senate enters judgment on its decision, whether that be to convict or acquit, and a copy of the judgment is filed with the Secretary of State. The President may not grant a pardon in the impeachment case, but may in any resulting Federal criminal case.\n", "prediction 2": "It is the turn of the Senate to impeach the President if they fail to deliver a majority of the votes required to convict him/her or acquit the president. The Senate may choose to enter judgment before either acquitting or removing the president from office, but due to the fact that there is no super majority to convict, the schedule changes frequently in the process of impeaching the President so there will be no formal impeachment vote even after a trial in the Senate.", "prediction 3": "Presidents can be impeached by the House of Representatives or the Senate. The Senate is in charge of hearing the impeachment case, and if convicted, the president is automatically removed from office. The President may grant a pardon in the impeachment case, but may also in any resulting Federal criminal case.", "prediction 4": "Upon conviction in the Senate, the official is automatically removed from office and may also be barred from holding future office under the United States. No further punishment is permitted during the impeachment proceedings; however, the party may face criminal penalties in a normal court of law.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 210 }, { "error type": "Redundant", "explanation": "The president is impeached by the House of Representatives, but the Senate enters judgment on its decision, whether that be to convict or acquit, and a copy of the judgment is filed with the Secretary of State. ", "start": 211, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 468 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 7 ] } ], "corrected-prediction": "The president is impeached by the House of Representatives, but the Senate enters judgment on its decision, whether that be to convict or acquit. The House may approve \"articles of impeachment\" by a simple majority vote. The \"Tyler Precedent\" established that if the President dies, resigns or is removed from office, the Vice President becomes President. Congress may provide for a line of succession beyond the Vice President.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What is the eastern-most point of mainland australia?", "passages": [ [ "Cape Byron", "Cape Byron\n\nCape Byron is the easternmost point of the mainland of Australia.", "It is about east of the town of Byron Bay and projects into the Pacific Ocean.", "The cape was named by British explorer Captain James Cook, when he passed the area on 15 May 1770, to honour British explorer John Byron who circumnavigated the globe in HMS \"Dolphin\" from 1764 to 1766.", "The Cape is part of the Cape Byron State Conservation Area.", "Built in 1901, the Cape Byron Lighthouse is the last of the great 19th-century Victorian era lighthouses managed by the National Parks and Wildlife Service (NPWS).", "It is constructed from concrete blocks and stands on the most easterly point of the Australian mainland.", "The Cape Byron walking track winds through the Cape Byron State Conservation Area.", "The loop walk can be started at any point with parking available at Captain Cook Lookout, Palm Valley, Wategos Beach and the Lighthouse.", "Cape Byron is part of the 22,000 hectare Cape Byron Marine Park, which was established in November 2002.", "The area is also noted for its wildlife, with the whale watching industry a significant contributor to the local economy.", "Cape Byron Marine Park is a multiple-use marine park which includes protected areas where fishing and collecting are prohibited, and general-use areas which support both commercial and recreational fishing." ] ], "gold": "The Eastern-most point of mainland Australia is Cape Byron in the state of New South Wales, which sits at 153.6383\u00b0 E.", "prediction 1": "Cape Byron is the easternmost point of the mainland of Australia, and it is about east of the town of Byron Bay and projects into the Pacific Ocean. Built in 1901, the Cape Byron Lighthouse is the last of the great 19th-century Victorian era lighthouses managed by the National Parks and Wildlife Service (NPWS). Built in 1770, the Cape Byron Lighthouse is constructed from concrete blocks and stands on the most easterly point of the Australian mainland.", "prediction 2": "Cape Byron is the easternmost point of the mainland of Australia, and was named by Captain James Cook, when he passed the area on 15 May 1770, to honour British explorer John Byron who circumnavigated the globe in HMS \"Dolphin\" from 1764 to 1766. It is about east of the town of Byron Bay and projects into the Pacific Ocean. Cape Byron is also the easternmost point of the Northern Territory.", "prediction 3": "Cape Byron is the eastern-most point of the mainland of Australia. It is about east of the town of Byron Bay and projects into the Pacific Ocean. It was named by British explorer Captain James Cook, when he passed the area on 15 May 1770, to honour British explorer John Byron who circumnavigated the globe in HMS \"Dolphin\" from 1764 to 1766. Built in 1901, the Cape Byron Lighthouse is the last of the great 19th-century Victorian era lighthouses managed by the National Parks and Wildlife Service (NPWS).", "prediction 4": "Cape Byron is the easternmost point of the mainland of Australia. The cape was named by British explorer Captain James Cook, when he passed the area on May 15, 1770, to honour British explorer John Byron who circumnavigated the globe in HMS \"Dolphin\" from 1764 to 1766. Built in 1901, the Cape Byron Lighthouse is the last of the great 19th-century Victorian era lighthouses managed by the National Parks and Wildlife Service (NPWS). The Cape Byron Lighthouse is constructed from concrete blocks and stands on the most easterly point of the Australian mainland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 455 } ], "missing-info": [], "corrected-prediction": "Cape Byron is the easternmost point of the mainland of Australia, and it is about east of the town of Byron Bay." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who passed the vernacular press act in 1878 why was it passed?", "passages": [ [ "Vernacular Press Act", "Vernacular Press Act\n\nIn British India, the Vernacular Press Act (1878) was enacted to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies\u2014notably, the opposition that had grown with the outset of the Second Anglo-Afghan War (1878\u201380).", "The act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on 14 March 1878.", "The act excluded English-language publications as it was meant to control seditious writing in 'publications in Oriental languages' everywhere in the country, except for the South.", "But the British totally discriminated the Indian Press.", "The act empowered the government to impose restrictions on the press in the following ways:\n\n1.)", "Modelled on the Irish press act, this act provided the government with extensive rights to censor reports and editorials in the Vernacular press.", "2.)", "From now on the government kept regular track of Vernacular newspapers.", "3.)", "When a report published in the newspaper was judged as seditious, the newspaper was warned.", "4. )", "No Indian was allowed to carry arms without license\n\nThe first periodicals in India were under the control of East India Company, and the press sometimes created a problem for the interests of the company.", "This resulted in the first two papers being banned\u2014one started by Bolt and the Bengal Gazette." ] ], "gold": "In British India, the Vernacular Press Act of 1878 was enacted to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies, specifically, the opposition that had grown with the outset of the Second Anglo-Afghan War in 1878\u201380. The Act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on March 14, 1878. The act excluded English-language publications as it was meant to control seditious writing in 'publications in Oriental languages' everywhere in the country, except for the South. Thus the British totally discriminated against the non-English language Indian Press.", "prediction 1": "The Vernacular Press Act was passed by the Viceroy's Council on March 14, 1878. It was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on March 14, 1878.", "prediction 2": "The Vernacular Press Act was enacted in 1878 to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies and the opposition that had grown with the outset of the Second Anglo-Afghan War. The act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on 14 March 1878.", "prediction 3": "The Vernacular Press Act was enacted to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies\u2014notably, the opposition that had grown with the outset of the Second Anglo-Afghan War. The act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on 14 March 1878.", "prediction 4": "In British India, the Vernacular Press Act was enacted to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies and prevent the expression of criticism toward the British. The act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on 14 March 1878.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " passed by the Viceroy's Council on March 14, 1878.", "start": 155, "end": 205 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": " In British India, the Vernacular Press Act (1878) was enacted to curtail the freedom of the Indian press and prevent the expression of criticism toward British policies\u2014notably, the opposition that had grown with the outset of the Second Anglo-Afghan War (1878\u201380). The act was proposed by Lord Lytton, then Viceroy of India, and was unanimously passed by the Viceroy's Council on 14 March 1878. The act excluded English-language publications as it was meant to control seditious writing in 'publications in Oriental languages' everywhere in the country, except for the South. But the British totally discriminated the Indian Press. " }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "What does the c mean in the nfl?", "passages": [ [ "National Football League team captains", "National Football League team captains\n\nIn the National Football League, the team captain designation is a team-appointed position that designates certain players as leaders on and off the field.", "The captains program was implemented by the NFL Player Advisory Council established by NFL commissioner Roger Goodell in conjunction with the NFL Players Association.", "Starting in , the league began permitting teams to name up to six players as captains.", "Players who have been named a team captain typically have a \"C\" patch on their jerseys.", "There is a standard design used by all teams participating in the captaincy program.", "The patches are in team colors and are worn on the front left or right breast (depending on other patches, etc. worn by the specific team).", "The number of stars filled in on the patch represents the number of consecutive years that player has been named captain by a team.", "If they've been named captain for longer than four years, the \"C\" on the patch is gold.", "Some teams (e.g. Pittsburgh and New England) do not have this patch on their jerseys but still designate captains.", "In the case of the Green Bay Packers, they would use weekly captains during the regular season, but would switch to assigning captains whenever they qualify for the playoffs.", "The New York Jets suspended designated team captains after an incident involving Santonio Holmes in a 2011 game." ], [ "Center (gridiron football)", "Center (gridiron football)\n\nCenter (C) is a position in American football and Canadian football (in the latter the position is spelled centre, following Commonwealth spelling conventions).", "The center is the innermost lineman of the offensive line on a football team's offense.", "The center is also the player who passes (or \"snaps\") the ball between his legs to the quarterback at the start of each play.", "In recent years, the importance of centers for a football team has increased, due to the re-emergence of 3\u20134 defenses.", "According to Baltimore Ravens general manager Ozzie Newsome, \"you need to have somebody who can neutralize that nose tackle.", "If you don't, everything can get screwed up.", "Your running game won't be effective and you'll also have somebody in your quarterback's face on every play.\"", "The center's first and primary role is to pass the football to the quarterback.", "This exchange is called a snap.", "Most offensive schemes make adjustments based on how the defensive line and linebackers align themselves in relation to the offensive line, and what gaps they line up in.", "Because the center has an ideal view of the defensive formation before the snap, he typically makes the first line call." ] ], "gold": "On the NFL, players who have been named a team captain typically wear a \"C\" patch on their jerseys. The patches are in team colors and are worn on the front left or right breast.The letter \"C\" is also used to distinguish the player whose position is the center, the innermost lineman of the offensive line on a football team's offense.", "prediction 1": "In the National Football League, the team captain designation is a team-appointed position that designates certain players as leaders on and off the field. The center is the innermost lineman of the offensive line on a football team's offense. The center is also the player who passes (or \"snaps\") the ball between his legs to the quarterback at the start of each play. The center's first and primary role is to pass the football to the quarterback.", "prediction 2": "The position center in the National Football League is called the center. The center is the player who passes (or \"snaps\") the ball between his legs to the quarterback at the start of each play. Center is also the player who passes (or \"snaps\") the ball between his legs to the quarterback at the start of each play. The center's first and primary role is to pass the football to the quarterback.", "prediction 3": "Center (C) is a position in American football and Canadian football. The center is the innermost lineman of the offensive line on a football team's offense. The center is also the player who passes (or \"snaps\") the ball between his legs to the quarterback at the start of each play. The position is also known as the 'Gridiron football'.", "prediction 4": "In the National Football League, the team captain designation is a team-appointed position that designates certain players as leaders on and off the field. Center (C) is a position in American football and Canadian football. In the latter the position is spelled centre, following Commonwealth spelling conventions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 369 }, { "error type": "Irrelevant", "explanation": "", "start": 370, "end": 449 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 155 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "On the NFL, players who have been named a team captain typically have a \"C\" patch on their jerseys. The patches are in team colors and are worn on the front left or right breast. The center (C) a position in American football, is the innermost lineman of the offensive line on a football team's offense. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where was indian independence league formed in 1942?", "passages": [ [ "Bangkok Conference", "The Bangkok conference opened on 15 June 1942 at the Silpakon theatre in Bangkok with an opening address by the Thai deputy foreign minister Wichit.", "Amongst the guests to this conference were the Japanese Ambassador Tsubokami Teiji, German minister Ernst Wendler, and the Italian minister Guido Crolla.", "The conference defined the structure of the league as consisting of a Council for Action and a Committee of representatives below it.", "Below the committee was to be the territorial and local branches.", "Rash Behari Bose was to chair the council, while K.P.K Menon, Nedyam Raghavan were among the civilian members of the council.", "Mohan Singh and an officer by the name of Gilani were to be the INA's members.", "The committee of representatives took members from the 12 territories with Indian population, with representation proportional to the representative Indian population.", "The Bangkok resolution further decided that the Indian National Army was to be subordinate to it.", "The introduction to the resolution states:\n", "The resolution itself adopted a thirty-four point resolution, to each of which it expected the Japanese government to respond to.", "These included the demand that the Japanese government clearly, explicitly and publicly recognise India as an independent nation and the league as the nation's representatives and guardians." ], [ "Indian Independence League", "Indian Independence League\n\nThe Indian Independence League (also known as IIL) was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India.", "Founded in 1928 by Indian nationalists, the organisation was located in various parts of Southeast Asia and included Indian expatriates, and later, Indian nationalists in-exile under Japanese occupation following Japan's successful Malayan Campaign during the first part of the Second World War.", "During the Japanese Occupation in Malaya, the Japanese encouraged Indians in Malaya to join the Indian Independence League.", "Established primarily to foster Indian Nationalism and to obtain Japanese support for the Indian Independence Movement, the League came to interact and command the first Indian National Army under Mohan Singh before it was dissolved.", "Later, after the arrival of Subhas Chandra Bose in South East Asia and the revival of the INA, the League came under his leadership, before giving way to Azad Hind.", "With the occupation of South-East Asia, \na large expatriate Indian population had come under the Japanese occupation.", "A framework of local Indian associations had existed even before the war reached Malaya.", "\"The biggest\" of these included the likes of the pre-war Central Indian Association, the Singapore Indian Independence league and other organisations, and had amongst their members eminent Indian expatriates, e.g." ], [ "Indian Independence League", "With encouraging reports from Fujiwara and the establishment of the local Independence leagues, the IGHQ sought Rash Behari's help to expand and amalgamate the Indian movement taking shape.", "Rash Behari advised the IGHQ to attach the evolving INA to a political organisation that would also speak for the civilian Indian population in South-east Asia.", "In March 1942, he invited the local leaders of the Indian Independence leagues to a conference in Tokyo.", "This invitation was taken up and the delegation met at a Tokyo hotel in late March 1942.", "The Tokyo conference, however, failed to reach any definitive decisions.", "A number of the Indian delegation held differences with Rash Behari, especially given his long connection with Japan and the current position of Japan as the occupying power in South-east Asia, and were wary of vested Japanese interests.", "The conference agreed to meet again in Bangkok at a future date.", "The Indian delegation returned to Singapore in April with Rash Behari.", "In Singapore, Rash Behari was invited to chair a public meeting that saw the proclamation of the All-Malayan Indian Independence League.", "The League was headed by Nedyam Raghavan, a Penang Barrister and a prominent Malayan Indian.", "The governing board included K.P. Kesava Menon and S.C Goho, the latter the chairman of the Singapore Indian Independence League." ] ], "gold": "The Indian Independence League was a political organisation that operated from various parts of Southeast Asia in between the 1920s and the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. In the year 1942, they were brought together on different occasions. On march, the Tokyo Conference was held, but it ultimately failed to reach any definitive decisions as number of the Indian delegates held differences with Rash Behari, especially given his long connection with Japan and the former position of Japan as the occupying power in South-east Asia. This is why another conference took place in June in the city of Bangkok", "prediction 1": "The Indian Independence League was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. In 1928, Indian nationalists founded the league which was located in various parts of Southeast Asia and included Indian expatriates, and later, Indian nationalists in-exile under Japanese occupation following Japan's successful Malayan Campaign during the first part of the Second World War. The Indian government encouraged Indians in Malaya to join the League, the League.", "prediction 2": "The Indian Independence League was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. Founded in 1928 by Indian nationalists, the organisation was located in various parts of Southeast Asia and included Indian expatriates, and later, Indian nationalists in-exile under Japanese occupation following Japan's successful Malayan Campaign during the first part of the Second World War. Established primarily to foster Indian Nationalism and to obtain Japanese support for the Indian Independence Movement, the League came to interact and command the first Indian National Army under Mohan Singh before it was dissolved.", "prediction 3": "The Indian Independence League, or IIL, was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. Founded in 1928 by Indian nationalists, the organisation was located in various parts of Southeast Asia and included Indian expatriates, and later, Indian nationalists in-exile under Japanese occupation following Japan's successful Malayan Campaign during the first part of the Second World War. Established primarily to foster Indian Nationalism and to obtain Japanese support for the Indian Independence Movement, the League came to interact and command the first Indian National Army under Mohan Singh before it was dissolved. Later, after the arrival of Subhas Chandra Bose in South East Asia and the revival of the League, Azad Hind Bose, the League came under his leadership, and the League came under Azad Hind Hind.", "prediction 4": "The Indian Independence League, also known as IIL, was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. Founded in 1928 by Indian nationalists, the organisation was located in various parts of Southeast Asia and included Indian expatriates, and later, Indian nationalists in-exile under Japanese occupation following Japan's successful Malayan Campaign during the first part of the Second World War. Established primarily to foster Indian Nationalism and to obtain Japanese support for the Indian Independence Movement, the League came to interact and command the first Indian National Army before it was dissolved.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 491, "end": 573 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Indian Independence League was a political organisation operated from the 1920s to the 1940s to organise those living outside India into seeking the removal of British colonial rule over India. In March 1942, he invited the local leaders of the Indian Independence leagues to a conference in Tokyo. The Tokyo conference, however, failed to reach any definitive decisions. A number of the Indian delegation held differences with Rash Behari, especially given his long connection with Japan and the current position of Japan as the occupying power in South-east Asia. The conference agreed to meet again in Bangkok at a future date. " }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "When did 18 years olds get the vote?", "passages": [ [ "Voting age", "Many countries, particularly in Western Europe, reduced their voting ages to 18 years during the 1970s, starting with the United Kingdom (1969), with the United States (26th Amendment) (1971), Canada, West Germany (1972), Australia (1974), France (1974), and others following soon afterwards.", "By the end of the 20th century, 18 had become by far the most common voting age.", "However, a few countries maintain a voting age of 20 years or higher.", "It was argued that young men could be drafted to go to war at 18, and many people felt they should be able to vote at the age of 18.", "In the late 20th and early 21st centuries voting ages were lowered to 16 in India, Switzerland, Austria, and Morocco.", "Japan lowered its voting age from 20 to 18 in June 2016.", "a dispute continued in the Maldives.", "Around the year 2000, a number of countries began to consider whether the voting age ought to be reduced further, with arguments most often being made in favour of a reduction to 16.", "The earliest moves came during the 1990s, when the voting age for municipal elections in some States of Germany was lowered to 16.", "Lower Saxony was the first state to make such a reduction, in 1995, and four other states did likewise.", "Arguments against lowering the voting age to sixteen include lack of political maturity." ], [ "Suffrage in Australia", "The exception was military service.", "In World War I, members of the armed services had the vote in some states, and in World War II, the Commonwealth and some states did the same.", "The voting age for all federal elections was lowered from 21 to 18 in 1973.", "The states had lowered the voting age to 18 by 1973, the first being Western Australian in 1970.", "At Federation, the \"Commonwealth Franchise Act 1902\" disenfranchised those \"attainted of treason, or who had been convicted and is under sentence or subject to be sentenced for any offence \u2026 punishable by imprisonment for one year or longer.\"", "In 1983, this disenfranchisement was relaxed and prisoners serving a sentence for a crime punishable under the law for less than 5 years were allowed to vote.", "A further softening occurred in 1995 when the disenfranchisement was limited to those actually serving a sentence of 5 years or longer, although earlier that year the Keating Government had been planning legislation to extend voting rights to all prisoners.", "Disenfranchisement does not continue after release from jail/prison." ], [ "1970 United Kingdom general election", "1970 United Kingdom general election\n\nThe 1970 United Kingdom general election was held on Thursday 18 June 1970.", "It resulted in a surprise victory for the Conservative Party under leader Edward Heath, which defeated the governing Labour Party under Harold Wilson.", "The Liberal Party, under its new leader Jeremy Thorpe, lost half their seats.", "The Conservatives, including the Ulster Unionist Party (UUP), secured a majority of 31 seats.", "This general election was the first in which people could vote from the age of 18, after passage of the Representation of the People Act the previous year.", "As of 2017, it is the earliest general election from which there remain members of the House of Commons who have a record of continuous service; Kenneth Clarke of the Conservatives and Dennis Skinner of Labour entered Parliament for the first time at this election.", "Clarke is the current Father of the House since the death of 86-year-old Gerald Kaufman in February 2017.", "Most opinion polls prior to the election indicated a comfortable Labour victory, and put Labour up to 12.4% ahead of the Conservatives.", "On election day, however, a late swing gave the Conservatives a 3.4% lead and ended almost six years of Labour government, although Wilson remained leader of the Labour Party in opposition." ] ], "gold": "18 year-olds were first given the right to vote in general UK elections on 18 June 1970 and in Federal Canadian election on 26 June 1970. They gained the right to vote in the US with the passage of the 26th Constitutional Amendment on July 1, 1971, whereas Australia lowered its voting age from 21 to 18 in 1973. Japanese 18 year-olds were not able to vote until June 2016, when the nation's voting age was lowered from 20.", "prediction 1": "In many countries, particularly in Western Europe, reduced their voting ages to 18 years during the 1970s, starting with the United Kingdom in 1969, the United States in 1971, Canada, West Germany in 1972, Australia in 1974, France in 1974, and other countries following soon afterwards. However, a few countries maintain a voting age of 20 years or higher. In the late 20th and early 21st centuries, voting ages were lowered to 16 in India, Switzerland, Austria, and Morocco. In the United Kingdom, the voting age for all federal elections was lowered from 21 to 18 in 1973. In the United Kingdom, the 1970 United Kingdom general election was held on Thursday 18 June 1970. The first was Western Australian in 1970.", "prediction 2": "Many countries, particularly in Western Europe, reduced their voting ages to 18 years during the 1970s, starting with the United Kingdom in 1969 and with the United States and Canada in 1971 and 1971, respectively. In the late 20th and early 21st centuries, voting ages were lowered to 16 in India, Switzerland, Austria, and Morocco and in 2016 Japan lowered its voting age from 20 to 18. In the 1970 United Kingdom general election, which was the first in which people could vote from the age of 18, the first being Western Australian in 1970. The 1970 United Kingdom general election was the first in which people could vote from the age of 18, after passing the Representation of the People Act the previous year.", "prediction 3": "In the United Kingdom, the age at which 18-year olds were allowed to vote was 18 in 1969, and in the United States in 1971, in Canada in 1972, in Australia in 1974, and in France in 1974. In Australia, the age at which 18-year-olds got the vote was 19 in 1972, and in the United States in 1971. In Japan, the age at which 18-year-olds got the vote was 20 in 2016 and in India in 2020.", "prediction 4": "Many countries, particularly in Western Europe, reduced their voting ages to 18 years during the 1970s, starting with the United Kingdom (1969), the United States (26th Amendment) (1971), Canada, West Germany (1972), Australia (1974), France (1974), and others following soon afterwards. By the end of the 20th century, 18 had become by far the most common voting age. However, a few countries maintain a voting age of 20 years or higher. In the late 20th and early 21st centuries, voting ages were lowered to 16 in India, Switzerland, Austria, the first state to make such a reduction, in 1995, and four other states did likewise. Japan lowered its voting age from 20 to 18 in June 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 476 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 484, "end": 499 }, { "error type": "Irrelevant", "explanation": "", "start": 576, "end": 674 }, { "error type": "Irrelevant", "explanation": "", "start": 675, "end": 716 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In many countries, particularly in Western Europe, reduced their voting ages to 18 years during the 1970s, starting with the United Kingdom in 1969, the United States in 1971 (26th Amendment), Canada, West Germany in 1972, Australia in 1974, France in 1974, and other countries following soon afterwards. In Australia, the voting age for all federal elections was lowered from 21 to 18 in 1973. Japan lowered its voting age from 20 to 18 in June 2016." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Where does the last name ketchum come from?", "passages": [ [ "Charlton Heston", "Charlton Heston was born John Charles Carter on October 4, 1923, to Lilla (\"n\u00e9e\" Charlton Baines; 1899\u20131994) and Russell Whitford Carter (1897\u20131966), a sawmill operator.", "Many sources indicate he was born in Evanston, Illinois.", "Heston's autobiography, however stated otherwise.", "Yet other sources place his birth in No Man's Land, Illinois, which usually refers to a then-unincorporated area now part of Wilmette, a wealthy Chicago suburb.", "Heston said in a 1995 interview that he was not very good at remembering addresses or his early childhood.", "Heston was partially of Scottish descent, including from the Clan Fraser, but the majority of his ancestry was English.", "His earliest immigrant ancestors arrived in America from England in the 1600s.", "His maternal great-grandparents, and namesakes, were Englishman William Charlton from Sunderland and Scotswoman Mary Drysdale Charlton.", "They emigrated to Canada, where his grandmother, Marian Emily Charlton, was born in 1872.", "In his autobiography, Heston refers to his father participating in his family's construction business.", "When Heston was an infant, his father's work moved the family to St. Helen, Michigan.", "It was a rural, heavily forested part of the state, and Heston lived an isolated yet idyllic existence, spending much time hunting and fishing in the backwoods of the area." ] ], "gold": "The surname Ketchum, a habitational name most likely reduced from Kitchenham, is originally from the country of England.", "prediction 1": "The last name ketchum came from the British Isles. In 1870, the last name ketchum was first found in Maine, and in 1872, it was found in Canada. The last name ketchum came from the United States.", "prediction 2": "The last name ketchum is a British family name that comes from the 1700s. The family name ketchum originally came from the United States. The family name ketchum has also been used in some other names, such as ketchum, ketchum and ketchum.", "prediction 3": "The name ketchum comes from the English language, although the name has also been used in English literature. The name ketchum was given to a boy named Charles ketchum in 1867.", "prediction 4": "The name ketchum comes from the English family name ketchum. The surname ketchum was first used in the United States in the late 18th century. The family name ketchum originated in the United States and was used in Canada. In the 19th century, the family name ketchum was used in England, Scotland and Ireland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 195 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "What is the population of venice italy 2018?", "passages": [ [ "Venice", "Venice\n\nVenice (, ; ; , ) is a city in northeastern Italy and the capital of the Veneto region.", "It is situated across a group of 118\u00a0small islands that are separated by canals and linked by over 400\u00a0bridges.", "The islands are located in the shallow Venetian Lagoon, an enclosed bay that lies between the mouths of the Po and the Piave rivers (more exactly between the Brenta and the Sile).", "Parts of Venice are renowned for the beauty of their settings, their architecture, and artwork.", "The lagoon and a part of the city are listed as a UNESCO World Heritage Site.", "In 2018, 260,897\u00a0people resided in \"Comune di Venezia\", of whom around 55,000 live in the historical city of Venice (\"Centro storico\").", "Together with Padua and Treviso, the city is included in the Padua-Treviso-Venice Metropolitan Area (PATREVE), with a total population of 2.6\u00a0million.", "PATREVE is only a statistical metropolitan area.", "The name is derived from the ancient Veneti people who inhabited the region by the 10th\u00a0century\u00a0BC.", "The city was historically the capital of the Republic of Venice." ] ], "gold": "Venice is a city in northeastern Italy and the capital of the Veneto region. It is situated on a group of 118 small islands that are separated by canals and linked by over 400 bridges. In 2018, 260,897 people resided in the city, of whom around 55,000 live in the historical city of Venice, while a total of 2.6 million people did so in the Padua-Treviso-Venice Metropolitan Area. Therefore, the city's population density is around 1,600/sq m, or 630/km2.", "prediction 1": "There are more than a few islands in Venice. The population of the city is around 260,897 in 2018.", "prediction 2": "In 2018, the population of Venice, Italy was 260,897. In 2017, the population was 260,897. In 2020, the population was 260,897.", "prediction 3": "Veneto is a region in northeastern Italy and the capital of the Veneto region. In 2018, 260,897 people resided in Comune di Venezia, of whom around 55,000 live in the historical city of Venice (Centro storico). Together with Padua and Treviso, the city is included in the Padua-Treviso-Venice Metropolitan Area (PATREVE), with a total population of 2.6 million.", "prediction 4": "In 2018, 260,897 people resided in \"Comune di Venezia\", of whom around 55,000 live in the historical city of Venice. Together with Padua and Treviso, the city is included in the Padua-Treviso-Venice Metropolitan Area (PATREVE), with a total population of 2.6 million.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 44 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Venice is a city in northeastern Italy and the capital of the Veneto region. It is situated on a group of 118 small islands that are separated by canals and linked by over 400 bridges. In 2018, 260,897 people resided in \"Comune di Venezia\", of whom around 55,000 live in the historical city of Venice. Together with Padua and Treviso, the city is included in the Padua-Treviso-Venice Metropolitan Area, with a total population of 2.6 million." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Where in the bible is the story of samuel?", "passages": [ [ "Samuel", "Samuel\n\nSamuel is a figure who, in the narratives of the Hebrew Bible, plays a key role in the transition from the period of the biblical judges to the institution of a kingdom under Saul, and again in the transition from Saul to David.", "He is venerated as a prophet by Jews, Christians, and Muslims.", "In addition to his role in the Hebrew Scriptures, Samuel is mentioned in the New Testament, in rabbinical literature, and in the second chapter of the Qur'an, although here not by name.", "He is also treated in the fifth through seventh books of Josephus's \"Antiquities of the Jews\", written in the first century CE (AD).", "He is called Samuel the Seer in 1 Chronicles.", "Samuel's mother was Hannah and his father was Elkanah.", "Elkanah lived at Ramathaim in the district of Zuph.", "His genealogy is also found in a pedigree of the Kohathites (1 Chronicles 6:3-15) and in that of Heman, apparently his grandson (1 Chronicles 6:18\u201333).", "According to the genealogical tables in Chronicles, Elkanah was a Levite - a fact not mentioned in the books of Samuel." ], [ "Elkanah", "Elkanah\n\nElkanah ( \"\u2019Elq\u0101n\u0101h\" \"El has purchased\") was, according to the Books of Samuel, the husband of Hannah, and the father of her children including her first, Samuel.", "Elkanah practiced polygamy; his other wife, less favoured but bearing more children, was named Peninnah.", "The names of Elkanah's other children apart from Samuel are not given.", "Elkanah plays only a minor role in the narrative, and is mostly a supporting character to Eli, Hannah, and Samuel.", "Elkanah is descended from Kohath and Levi, making him a Levite.", "Elkanah was the son of Jeroham, who was the son of Elihu, who was the son of Tohu, who was the son of Zuph.", "Elkanah is described as having originated from Zuph, specifically Ramathaim-Zophim, which was part of the tribal lands of Ephraim; however, the Books of Chronicles state that he was a Levite.", "He is the great great great grandson of another Elkanah.", "The Talmud lists him as a prophet, along with his wife and son." ] ], "gold": "Samuel, whose parents were Hannah and Elkanah, is a figure from the narratives of the Hebrew Bible, the New Testament, and the Quran. He is considered a prophet by Jews, Christians, and Muslims. The story of Samuel is found in the Bible passage 1 Samuel 1:1\u201328. He is first called the Seer in 1 Samuel 9:9.", "prediction 1": "Samuel is a figure who, in the narratives of the Hebrew Bible, plays a key role in the transition from the period of the biblical judges to the institution of a kingdom under Saul, and again in the transition from Saul to David. In addition to his role in the Hebrew Scriptures, Samuel is mentioned in the New Testament, in rabbinical literature, and in the second chapter of the Qur'an, although there is no mention of his name. In the second chapter of the Qur'an, Samuel is called Samuel the Seer in 1 Chronicles.", "prediction 2": "Samuel is a figure who, in the narratives of the Hebrew Bible, plays a key role in the transition from the period of the biblical judges to the institution of a kingdom under Saul, and again in the transition from Saul to David. In addition to his role in the Hebrew Scriptures, Samuel is mentioned in the New Testament, in rabbinical literature, and in the second chapter of the Qur'an, although here not by name. He is also treated in the fifth through seventh books of Josephus's Antiquities of the Jews, written in the first century CE (AD).", "prediction 3": "The story of Samuel is told in the Book of Samuel, which is in the Old Testament. In the New Testament, he is mentioned in rabbinical literature, and in the second chapter of the Qur'an, although here not by name. Elkanah Elkanah, according to the Books of Samuel, is the husband of Hannah, and the father of her children, including her first, Samuel.", "prediction 4": "Samuel is a figure in the narratives of the Hebrew Bible, who, in the narratives of the Hebrew Scriptures, plays a key role in the transition from the period of the biblical judges to the institution of a kingdom under Saul, and again in the transition from Saul to David. In addition to his role in the Hebrew Scriptures, Samuel is mentioned in the New Testament, in rabbinical literature, and in the second chapter of the Qur'an, although here not by name. Elkanah plays only a minor role in the narrative, and is mostly a supporting character to Eli, Hannah, and Samuel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 346 }, { "error type": "Irrelevant", "explanation": "", "start": 388, "end": 429 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 430, "end": 516 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Samuel, whose parents were Hannah and Elkanah, is a figure who, in the narratives of the Hebrew Bible. In addition to his role in the Hebrew Scriptures, Samuel is mentioned in the New Testament and in the second chapter of the Qur'an. He is called Samuel the Seer in 1 Chronicles." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Which inner ear organ senses the position of the head in space?", "passages": [ [ "Vestibular system", "Vestibular system\n\nThe vestibular system, in most mammals, is the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance.", "Together with the cochlea, a part of the auditory system, it constitutes the labyrinth of the inner ear in most mammals.", "As movements consist of rotations and translations, the vestibular system comprises two components: the semicircular canals which indicate rotational movements; and the otoliths which indicate linear accelerations.", "The vestibular system sends signals primarily to the neural structures that control eye movements, and to the muscles that keep an animal upright and in general control posture.", "The projections to the former provide the anatomical basis of the vestibulo-ocular reflex, which is required for clear vision; while the projections to the latter provide \nthe anatomical means required to enable an animal to maintain its desired position in space.", "The brain uses information from the vestibular system in the head and from proprioception throughout the body to enable the animal to understand its body's dynamics and kinematics (including its position and acceleration) from moment to moment.", "How these two perceptive sources are integrated to provide the underlying structure of the sensorium is unknown.", "The semicircular canal system detects rotational movements." ], [ "Vestibular system", "Humans have two otolithic organs on each side, one called the utricle, the other called the saccule.", "The utricle contains a patch of hair cells and supporting cells called a macula.", "Similarly, the saccule contains a patch of hair cells and a macula.", "Each hair cell of a macula has 40-70 stereocilia and one true cilium called a kinocilium.", "The tips of these cilia are embedded in an otolithic membrane.", "This membrane is weighted down with protein-calcium carbonate granules called otoliths.", "These otoliths add to the weight and inertia of the membrane and enhance the sense of gravity and motion.", "With the head erect, the otolithic membrane bears directly down on the hair cells and stimulation is minimal.", "When the head is tilted, however, the otolithic membrane sags and bends the stereocilia, stimulating the hair cells.", "Any orientation of the head causes a combination of stimulation to the utricles and saccules of the two ears.", "The brain interprets head orientation by comparing these inputs to each other and to other input from the eyes and stretch receptors in the neck, thereby detecting whether the head is tilted or the entire body is tipping.", "Essentially, these otolithic organs sense how quickly you are accelerating forward or backward, left or right, or up or down." ] ], "gold": "The position of the head in space is sensed by the inner ear organ system called the vestibular system, inner ear tubes called the semicircular canals, a larger inner ear otolithic organ called the utricle, and a smaller inner ear otolithic organ called the saccule.", "prediction 1": "The vestibular system, in most mammals, is the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance. Together with the cochlea, a part of the auditory system, it constitutes the labyrinth of the inner ear in most mammals. Humans have two otolithic organs on each side, one called the utricle, the other called the saccule. These organs sense how rapidly you are accelerating forward or backward, left or right, or right, or down.", "prediction 2": "The vestibular system is an internal system of the inner ear, the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance. The vestibular system consists of two components: the semicircular canals which indicate rotational movements; and the otoliths which indicate linear accelerations. The semicircular canal system detects rotational movements. The utricle and the saccule contain hair cells and supporting cells called a macula and an olithic membrane. The olithic organs sense how quickly you are accelerating forward or backward, left or right, or right, left or right, or left or right, or left or right, or right, or up or down.", "prediction 3": "The vestibular system, in most mammals, is the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance. Together with the cochlea, a part of the auditory system, it constitutes the labyrinth of the inner ear in most mammals. Humans have two otolithic organs on each side, one called the utricle, the other called the saccule. The utricle senses position of the head in space. The saccules, on each side, the other called the olithic membrane. These organs sense accelerations how quickly you are accelerating forward or backward, left or backward, or right, left or right, or right, or up or down.", "prediction 4": "The vestibular system, in most mammals, is the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance. Together with the cochlea, a part of the auditory system, it constitutes the labyrinth of the inner ear in most mammals. The vestibular system comprises two components: the semicircular canals which indicate rotational movements; and the otoliths which indicate linear accelerations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 532 }, { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 425 } ], "missing-info": [], "corrected-prediction": "The vestibular system, in most mammals, is the sensory system that provides the leading contribution to the sense of balance and spatial orientation for the purpose of coordinating movement with balance. Together with the cochlea, a part of the auditory system, it constitutes the labyrinth of the inner ear in most mammals. " }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "When do monica and chandler have a baby?", "passages": [ [ "Friends", "Friends\n\nFriends is an American television sitcom, created by David Crane and Marta Kauffman, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons.", "With an ensemble cast starring Jennifer Aniston, Courteney Cox, Lisa Kudrow, Matt LeBlanc, Matthew Perry and David Schwimmer, the show revolves around six friends in their 20s and 30s who live in Manhattan, New York City.", "The series was produced by Bright/Kauffman/Crane Productions, in association with Warner Bros. Television.", "The original executive producers were Kevin S. Bright, Marta Kauffman, and David Crane.", "Kauffman and Crane began developing \"Friends\" under the title \"Insomnia Cafe\" between November and December 1993.", "They presented the idea to Bright, and together they pitched a seven-page treatment of the show to NBC.", "After several script rewrites and changes, including a title change to \"Six of One\", and, \"Friends Like Us\", the series was finally named \"Friends\".", "Filming of the show took place at Warner Bros. Studios in Burbank, California.", "All ten seasons of \"Friends\" ranked within the top ten of the final television season ratings; it ultimately reached the number-one spot in its eighth season." ], [ "Monica Geller", "The birth of Monica and Chandler's twins serves as one of the finale's main plots.", "They were named Jack and Erica \u2013 after Monica's father and their birth mother, respectively.", "\u2013 The twins are born three minutes and forty-six seconds apart.", "Although the surprise addition of Monica and Chandler's twins was generally well received, critics questioned the fact that the babies are brought home from the hospital the same day as their delivery\n\nMonica is portrayed by American actress Courteney Cox.", "Crane and Kauffman had originally written the role of Monica for comedian Janeane Garofalo, their first choice, because they were attracted to her \"edgier and snarkier\" voice.", "However, Garofalo ultimately turned down the offer.", "Actress Jami Gertz was also offered the role but declined, while actress Leah Remini auditioned for Monica before ultimately being cast as Carrie Heffernan in the sitcom \"The King of Queens\" in 1998; Remini would eventually guest star in an episode of \"Friends\"." ], [ "Monica Geller", "In 2015, HitFix wrote a similar article entitled \"5 Reasons Monica Geller is the Best \"Friends\" Friend\", published in tandem with Cox's 51 birthday.", "An article in \"The Birmingham News\" cited \"The One Where it All Began\", \"The One With Two Parts: Part 2\", \"The One with the Prom Video\", \"The One with Chandler in a Box\", \"The One with the Embryos\", \"The One with All the Thanksgivings\", \"The One Where Everybody Finds Out\", \"The One On the Last Night\", \"The One with the Proposal\", \"The One with Monica and Chandler's Wedding\" and \"The Last One\" among Monica's best episodes; Cox herself acknowledged \"The One with the Embryos\" as her personal favorite.", "Meanwhile, BDCwire ranked \"The One with the Routine\", \"The One with the Cheap Wedding Dress\", \"The One with Monica's Boots\", \"The One with the Jellyfish\" and \"The One Where Monica Sings\" among the character's best.", "Despite consistently warm reception towards Cox and her character, some aspects of Monica's characterization have been criticized." ] ], "gold": "Monica and Chandler are two characters from the American television sitcom Friends. During the series finale Season 10 Episode 17, \"The One Where They Say Goodbye\" or simple \"The Last One,\" they both have a baby together.", "prediction 1": "In the American television sitcom Friends, Monica and Chandler have a baby twin. The birth of Monica and Chandler's twins serves as one of the finale's main plots. The twins were named Jack and Erica \u2013 after Monica's father and their birth mother, respectively.", "prediction 2": "Friends, an American television sitcom, is about six friends in their 20s and 30s who live in Manhattan, New York City. On the show they are surprised to find out they are expecting twins. The show's eighth season features the birth of the twins. The first two episodes of the show were aired on September 22, 1994, and the third episode was televised on May 6, 2004.", "prediction 3": "Friends is an American television sitcom created by David Crane and Marta Kauffman that aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. The series revolves around six friends in their 20s and 30s who live in Manhattan, New York City. The birth of Monica and Chandler's twins serves as one of the finale's main plots. The twins are named Jack and Erica \u2013 after Monica's father and their birth mother, respectively.", "prediction 4": "Friends is an American television sitcom created by David Crane and Marta Kauffman, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. In the finale, the birth of Monica and Chandler's twins serves as one of the show's main plots. The twins are named Jack and Erica \u2013 after Monica's father and their birth mother, respectively.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 261 } ], "missing-info": [], "corrected-prediction": "In the American television sitcom Friends, Monica and Chandler have a baby twin. The birth of Monica and Chandler's twins serves as one of the finale's main plots. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who came up with the idea of survival of the fittest?", "passages": [ [ "Survival of the fittest", "Survival of the fittest\n\n\"Survival of the fittest\" is a phrase that originated from Darwinian evolutionary theory as a way of describing the mechanism of natural selection.", "The biological concept of fitness is defined as reproductive success.", "In Darwinian terms the phrase is best understood as \"Survival of the form that will leave the most copies of itself in successive generations.\"", "Herbert Spencer first used the phrase, after reading Charles Darwin's \"On the Origin of Species\", in his \"Principles of Biology\" (1864), in which he drew parallels between his own economic theories and Darwin's biological ones: \"This survival of the fittest, which I have here sought to express in mechanical terms, is that which Mr. Darwin has called 'natural selection', or the preservation of favoured races in the struggle for life.\"", "Darwin responded positively to Alfred Russel Wallace's suggestion of using Spencer's new phrase \"survival of the fittest\" as an alternative to \"natural selection\", and adopted the phrase in \"The Variation of Animals and Plants under Domestication\" published in 1868.", "In \"On the Origin of Species\", he introduced the phrase in the fifth edition published in 1869, intending it to mean \"better designed for an immediate, local environment\"." ] ], "gold": "\"Survival of the fittest\" is a phrase first stated by Herbert Spencer. Spencer used this phrase after reading Darwin's \"On the Origin of Species\", in his \"Principles of Biology\" (1864). Herbert stated \"This survival of the fittest, which I have here sought to express in mechanical terms, is that which Charles Darwin has called 'natural selection', or the preservation of favoured races in the struggle for life.\" In 1869, Darwin introduced the phrase in the 5th edition of the \"Origin of Species\" intending it to mean \"better designed for an immediate, local environment\".", "prediction 1": "\"Survival of the fittest\" is a phrase that originated from Darwinian evolutionary theory as a way of describing the mechanism of natural selection. The biological concept of fitness is defined as reproductive success. In Darwinian terms the phrase is best understood as \"Survival of the form that will leave the most copies of itself in successive generations.\" Herbert Spencer first used the phrase, after reading Charles Darwin's \"On the Origin of Species\", in his \"Principles of Biology\" (1864), in which he drew parallels between his own economic theories and Darwin's biological ones.\n", "prediction 2": "\"Survival of the fittest\" is a phrase that originated from Darwinian evolutionary theory as a way of describing the mechanism of natural selection. The biological concept of fitness is defined as reproductive success, and in Darwinian terms this means that the organism that survives will leave the most copies of itself in successive generations. In his Principles of Biology, discussed in 1864, Herbert Spencer first used the phrase, after reading Charles Darwin's \"On the Origin of Species\". Charles Darwin responded positively to Alfred Russel Wallace's suggestion of using Spencer's new phrase \"survival of the fittest\" as an alternative to \"natural selection\", and adopted the phrase in his book The Variations of Animals Under Domestication, published in 1869.", "prediction 3": "\"Survival of the fittest\" is a phrase that originated from Darwinian evolutionary theory as a way of describing the mechanism of natural selection. The biological concept of fitness is defined as reproductive success. In Darwinian terms the phrase is best understood as \"Survival of the form that will leave the most copies of itself in successive generations.\" Herbert Spencer first used the phrase, after reading Charles Darwin's \"On the Origin of Species\", in his \"Principles of Biology\". In this paper, he drew parallels between his own economic theories and Darwin's biological ones: \"Survival of the form that will leave the most copies of itself in successive generations.\" In \"On the Origin of Species\", Charles Darwin responded positively to Alfred Russel Wallace's suggestion of using Spencer's new phrase \"survival of the fittest\" as an alternative to \"natural selection\".", "prediction 4": "\"Survival of the fittest\" is a phrase that originated from Darwinian evolutionary theory as a way of describing the mechanism of natural selection. The biological concept of fitness is defined as reproductive success. In Darwinian terms \"survival of the form that will leave the most copies of itself in successive generations\" is the phrase that was first used, by Herbert Spencer, after reading Charles Darwin's \"On the Origin of Species\", in his Principles of Biology 1864.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 147 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 499, "end": 590 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"Survival of the fittest\" is a phrase first used by Herbert Spencer, after reading Charles Darwin's \"On the Origin of Species\", in his \"Principles of Biology\" (1864). Herbert stated \"This survival of the fittest, which I have here sought to express in mechanical terms, is that which Charles Darwin has called 'natural selection', or the preservation of favoured races in the struggle for life.\" In 1869, Darwin introduced the phrase in the 5th edition of the \"Origin of Species\" intending it to mean \"better designed for an immediate, local environment\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where did the superstition saying knock on wood come from?", "passages": [ [ "Knocking on wood", "Knocking on wood\n\nKnocking on wood \u2013 in Britain, Australia, New Zealand, South Africa and Ireland the phrase is touch wood \u2013 is an apotropaic tradition of literally touching, tapping, or knocking on wood, or merely stating that one is doing or intending to do so, in order to avoid \"tempting fate\" after making a favourable observation, a boast, or declaration concerning one's own death or other unfavorable situation beyond one's control.", "Only the spoken party (a singular person) is to actually \"knock on wood\" at a time.", "The origin of the custom may be in German folklore, where in supernatural beings are thought to live in trees, and can be invoked for protection.", "One explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures.", "In these instances, people might knock or touch wood to request good luck, or to distract spirits with evil intentions.", "When in need of a favour or some good luck, one politely mentioned this wish to a tree and then touched the bark, representing the first \"knock\".", "The second \"knock\" was to say \"thank you\".", "The knocking was also supposed to prevent evil spirits from hearing your speech and as such stop them from interfering." ] ], "gold": "The superstition that knocking on wood to avoid an unfavorable result after making a prediction has various possible origins. Some say it may come from Celtic or German folklore, wherein supernatural beings are thought to live in trees, and can be invoked for protection. One explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures. The custom might also be related to Christian religious pieces such as wooden crucifixes. It might also come from the game of tag, where some define a rule called \"Tiggy Touchwood\" so that players are safe from being tagged if they are touching wood.", "prediction 1": "Knocking on wood \u2013 in Britain, Australia, New Zealand, South Africa and Ireland the phrase is touch wood \u2013 is an apotropaic tradition of literally touching, tapping, or knocking on wood, or merely stating that one is doing or intending to do so, in order to avoid \"tempting fate\" after making a favourable observation, a boast, or declaration concerning one's own death or other unfavorable situation beyond one's control. One explanation states that the custom derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures.", "prediction 2": "Knocking on wood, also called touching or knocking on wood, is an apotropaic tradition of literally touching, tapping or knocking on wood, or merely stating that one is doing or intending to do so, in order to avoid \"tempting fate\" after making favourable observations, a boast, or declaration concerning one's own death or other unfavorable situation beyond one's control. One explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures. One explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures.", "prediction 3": "Knocking on wood, or to literally touch, tap, or knock on wood, is an apotropaic tradition of merely stating that one is doing or intending to do so, in order to avoid \"tempting fate\" after making favourable observations, a boast, or declaration concerning one's own death or other unfavorable situation beyond one's control. The origin of the custom may be in German folklore, where in supernatural beings are thought to live in trees, and can be invoked for protection. One explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures. In these instances, people might knock or touch wood to request good luck, or to distract spirits with evil intentions.", "prediction 4": "The superstition saying \"knock on wood\" comes from German folklore where supernatural beings are thought to live in trees, and can be invoked for protection. Another explanation states that the tradition derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures. In these instances, people might knock or touch wood to request good luck, or to distract spirits with evil intentions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 422 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Knocking on wood is an apotropaic tradition of literally touching on wood in order to avoid \"tempting fate\" after making a favourable observation. The origin of the custom may be in German folklore, where in supernatural beings are thought to live in trees, and can be invoked for protection. One explanation states that the custom derived from the Pagans who thought that trees were the homes of fairies, spirits, dryads and many other mystical creatures." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did king give his i have a dream speech?", "passages": [ [ "I Have a Dream", "I Have a Dream\n\n\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States.", "Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement.", "Beginning with a reference to the Emancipation Proclamation, which freed millions of slaves in 1863, King said \"one hundred years later, the Negro still is not free\".", "Toward the end of the speech, King departed from his prepared text for a partly improvised peroration on the theme \"I have a dream\", prompted by Mahalia Jackson's cry: \"Tell them about the dream, Martin!\"", "In this part of the speech, which most excited the listeners and has now become its most famous, King described his dreams of freedom and equality arising from a land of slavery and hatred.", "Jon Meacham writes that, \"With a single phrase, Martin Luther King Jr. joined Jefferson and Lincoln in the ranks of men who've shaped modern America\".", "The speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of public address." ] ], "gold": "The \"I Have a Dream\" speech was delivered on August 28, 1963 by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom.", "prediction 1": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. King departed from his prepared text for a partly improvised peroration on the theme \"I have a dream\".", "prediction 2": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963, in which he called for civil and economic rights and an end to racism in the United States. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was ranked the top American speech of the 20th American speech of the 20th century in a 1999 poll of scholars of public address.", "prediction 3": "Martin Luther King Jr. gave his I Have a Dream speech during the March on Washington for Jobs and Freedom on August 28, 1963. Delivered to over 250,000 civil rights supporters from the steps of the Lincoln Memorial in Washington, D.C., the speech was a defining moment of the civil rights movement. In the speech, King described his dreams of freedom and equality arising from a land of slavery and hatred.", "prediction 4": "Martin Luther King Jr. delivered his I have a dream speech on August 28, 1963, during the March on Washington for Jobs and Freedom. King's speech was ranked the top American speech of the 20th century in a 1999 poll of scholars of public address. King described his dreams of freedom and equality arising from a land of slavery and hatred.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 448 }, { "error type": "Irrelevant", "explanation": "", "start": 449, "end": 551 } ], "missing-info": [], "corrected-prediction": "\"I Have a Dream\" is a public speech that was delivered by American civil rights activist Martin Luther King Jr. during the March on Washington for Jobs and Freedom on August 28, 1963." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who has scored the most goals for chelsea?", "passages": [ [ "Chelsea F.C. in international football competitions", "Chelsea F.C. in international football competitions\n\nChelsea Football Club is an English professional football club based in Fulham, London.", "The club's involvement in international competitions dates back to the 1950s.", "As champions of England, the club was invited to participate in the inaugural European Champions' Cup in 1955, but withdrew after pressure from the Football League.", "Three years later, Chelsea made their European debut against St\u00e6vnet in the Inter-Cities Fairs Cup, on 30 September 1958.", "Chelsea won their first European title in 1971, defeating Real Madrid to win the European Cup Winners' Cup.", "In 1998, they won the trophy again, followed by the UEFA Super Cup later that year.", "In 2012 Chelsea won the UEFA Champions League, the fifth English team, and the first from London, to win the competition.", "In 2013 Chelsea won the UEFA Europa League to become the fourth club to win all three main UEFA club competitions.", "Chelsea are presently England's third-most successful club in Europe, with five trophies in total.", "John Terry holds the club record for appearances in European competitions with 124, while striker Didier Drogba is the club's leading European goalscorer with 36 goals.", "Chelsea's biggest European win is 13\u20130, which came against Jeunesse Hautcharage in the Cup Winners' Cup in 1971." ], [ "Chelsea F.C.", "The record for a Chelsea goalkeeper is held by Harris's contemporary, Peter Bonetti, who made 729 appearances (1959\u201379).", "With 103 caps (101 while at the club), Frank Lampard of England is Chelsea's most capped international player.", "Frank Lampard is Chelsea's all-time top goalscorer, with 211 goals in 648 games (2001\u20132014); he passed Bobby Tambling's longstanding record of 202 in May 2013.", "Seven other players have also scored over 100 goals for Chelsea:", "George Hilsdon (1906\u201312), George Mills (1929\u201339), Roy Bentley (1948\u201356), Jimmy Greaves (1957\u201361), Peter Osgood (1964\u201374 and 1978\u201379), Kerry Dixon (1983\u201392) and Didier Drogba (2004\u201312 and 2014\u20132015).", "Greaves holds the record for the most goals scored in one season (43 in 1960\u201361).", "Chelsea's biggest winning scoreline in a competitive match is 13\u20130, achieved against Jeunesse Hautcharage in the Cup Winners' Cup in 1971.", "The club's biggest top-flight win was an 8\u20130 victory against Wigan Athletic in 2010, which was matched in 2012 against Aston Villa.", "Chelsea's biggest loss was an 8\u20131 reverse against Wolverhampton Wanderers in 1953." ], [ "Jimmy Greaves", "His hat-trick against Manchester City on 19 November included his 100th league goal, making him the youngest player to pass the 100-goal mark, at the age of 20 years and 290 days.", "However, he became increasingly disillusioned at Chelsea as, despite his goals, the team also conceded goals with regularity, and were never consistent enough to mount a title challenge.", "They also exited the FA Cup by losing 2\u20131 at home to Fourth Division side Crewe Alexandra.", "Club chairman Joe Mears agreed to sell Greaves as Chelsea were in need of extra cash.", "His last game was the final game of the 1960\u201361 season on 29 April; he was made captain for the day and scored all four goals in a 4\u20133 win against Nottingham Forest.", "This took his tally for the season to a club record 41 goals in 40 league games, making him the division's top scorer.", "Greaves was signed by Italian Serie A club A.C. Milan in June 1961 for an \u00a380,000 fee, and was given a three-year contract on \u00a3140 a week with a \u00a315,000 signing bonus.", "He became unhappy at the thought of leaving London and tried to cancel the move before it was fully confirmed, but \"Rossoneri\" manager Giuseppe Viani refused to annul the deal." ] ], "gold": "The record for most goals in total for Chelsea is 211 by Frank Lampard. Jimmy Greaves scored the most goals in a season for Chelsea with 41 in the 1960-61 season. George Hilsdon scored 6 goals in a match against Workstop Town o n11 January 1908. Didier Drogba has the most goals for Chelsea in FA Cup finals with 4. ", "prediction 1": "Jimmy Greaves scored the most goals for Chelsea in an individual season in a single season for the club. Greaves' record for the most goals scored in a single season for the club was 43 in 1960-61.", "prediction 2": "Several players have scored over 100 goals for Chelsea. The player with the most goals for Chelsea is Jimmy Greaves, who scored 43 goals in 1960\u201361. Greaves also holds the record for the most goals scored in one season.", "prediction 3": "The man who has scored the most goals for Chelsea is Jimmy Greaves with 43 goals in the 1960s and 1961 season. He was made captain for the day and scored all four goals in a 4\u20133 win against Nottingham Forest. The player with the most goals in a single season is George Hilsdon with 43 goals in the 1960s and 1961 season.", "prediction 4": "The player with the most goals for Chelsea is Jimmy Greaves, who scored 43 goals in the 1960-61 season. Similarly, the player who scored the most goals in a season is Harry Kane, with 102 goals in all competitions.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " for Chelsea in an individual season ", "start": 72, "end": 104 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": " Frank Lampard is Chelsea's all-time top goalscorer, with 211 goals. Jimmy Greaves scored the most goals for Chelsea in an individual season. Greaves' record for the most goals scored in a single season for the club was 43 in 1960-61. Striker Didier Drogba is the club's leading European goalscorer with 36 goals." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did they find the dead sea scrolls?", "passages": [ [ "Dead Sea Scrolls", "150 metres) from Khirbet Qumran, while caves 1, 2, 3 and 11 are located 1 mile (1\u20132 kilometres)", "North, with Cave 3 being the most remote.", "In February 2017, Hebrew University archaeologists announced the discovery of a new, 12th cave.", "There was one blank parchment found in a jar; however, broken and empty scroll jars and pickaxes suggest that the cave was looted in the 1950s.", "The 972 manuscripts found at Qumran were found primarily in two separate formats: as scrolls and as fragments of previous scrolls and texts.", "In the fourth cave the fragments were torn into up to 15,000 pieces.", "These small fragments created somewhat of a problem for scholars.", "G.L. Harding, director of the Jordanian Department of Antiquities, began working on piecing the fragments together but did not finish this before his death in 1979.", "The original seven scrolls from Cave 1 at Qumran are the Great Isaiah Scroll (1QIsa), a second copy of Isaiah (1QIsa), the Community Rule Scroll (1QS), the Pesher on Habakkuk (1QpHab), the War Scroll (1QM), the Thanksgiving Hymns (1QH), and the Genesis Apocryphon (1QapGen)." ], [ "Dead Sea Scrolls", "Dead Sea Scrolls\n\nDead Sea Scrolls (also Qumran Caves Scrolls) are ancient Jewish religious, mostly Hebrew, manuscripts found in the Qumran Caves in the West Bank near the Dead Sea.", "Many thousands of written fragments have been discovered in the Dead Sea area.", "They represent the remnants of larger manuscripts damaged by natural causes or through human interference, with the vast majority only holding small scraps of text.", "However, a small number of well-preserved, almost intact manuscripts have survived \u2013 fewer than a dozen among those from the Qumran Caves.", "Researchers have assembled a collection of 981 different manuscripts \u2013 discovered in 1946/47 and in 1956 \u2013 from 11 caves.", "The 11 Qumran Caves lie in the immediate vicinity of the Hellenistic-period Jewish settlement at Khirbet Qumran in the eastern Judaean Desert, in the West Bank.", "The caves are located about west of the northwest shore of the Dead Sea, whence they derive their name.", "Scholarly consensus dates the Qumran Caves Scrolls from the last three centuries BCE and the first century CE.", "Bronze coins found at the same sites form a series beginning with John Hyrcanus (in office 135\u2013104\u00a0BCE) and continuing until the period of the First Jewish\u2013Roman War (66\u201373 CE), supporting the radiocarbon and paleographic dating of the scrolls." ], [ "Dead Sea Scrolls", "The identified texts fall into three general groups:\n\nThe Dead Sea Scrolls were discovered in a series of twelve caves around the site known as Wadi Qumran near the Dead Sea in the West Bank (of the Jordan River) between 1946 and 1956 by Bedouin shepherds and a team of archeologists.", "The practice of storing worn-out sacred manuscripts in earthenware vessels buried in the earth or within caves is related to the ancient Jewish custom of Genizah.", "The initial discovery, by Bedouin shepherd Muhammed edh-Dhib, his cousin Jum'a Muhammed, and Khalil Musa, took place between November 1946 and February 1947.", "The shepherds discovered seven scrolls (See Scrolls and fragments) housed in jars in a cave near what is now known as the Qumran site.", "John C. Trever reconstructed the story of the scrolls from several interviews with the Bedouin.", "Edh-Dhib's cousin noticed the caves, but edh-Dhib himself was the first to actually fall into one (the cave now called Cave 1).", "He retrieved a handful of scrolls, which Trever identifies as the Isaiah Scroll, Habakkuk Commentary, and the Community Rule, and took them back to the camp to show to his family.", "None of the scrolls were destroyed in this process." ] ], "gold": "The Dead Sea Scrolls are a series of ancient Jewish and Hebrew religious manuscripts that were found in the Qumran Caves in the Judaean Desert, on the northern shore of the Dead Sea. Many different written fragments have been found, together with a small number of well-preserved, almost intact manuscripts that survived. The initial discovery took place in November 1946 - February 1947, when 7 scrolls where found housed in jars, with additional fragments recovered with linen cloth and jar in February 1949 - March 5, 1949. From November 1951 - February 1952, 30 more fragments were obtained in Cave 2, with new discoveries being made on the following decades, including a blank parchment found inside a jar in February 2017.", "prediction 1": "The Dead Sea Scrolls were found in a series of twelve caves around the site known as Wadi Qumran near the Dead Sea in the West Bank between 1946 and 1956 by Bedouin shepherds and a team of archeologists. The shepherds discovered seven scrolls housed in jars in a cave near what is now known as the Qumran site. The initial discovery, by Bedouin shepherd Muhammed edh-Dhib, his cousin Jum'a Muhammed, Khalil Musa, took place between November 1946 and February 1947.", "prediction 2": "The Dead Sea Scrolls were discovered in a series of 12 caves around the site known as Wadi Qumran near the Dead Sea in the West Bank between 1946 and 1956 by Bedouin shepherds and a team of archeologists. The initial discovery took place between November 1946 and February 1947. Muhammed edh-Dhib, his cousin Jum'a Muhammed, and Khalil Musa found seven scrolls housed in jars in a cave near what is now known as Qumran. The original seven scrolls from Cave 1 at Qumran are the Great Isaiah Scroll, the Community Rule Scroll and the Pesher on Habakkuk Scroll. The original seven scrolls found in Cave 1 at Qumran are the Great Isaiah Scroll (1Qisa), the Community Rule Scroll (1QS) and the Genesis Apocryphon (1QHapH", "prediction 3": "The Dead Sea Scrolls were discovered in a series of twelve caves around the site known as Wadi Qumran near the Dead Sea in the West Bank near the Dead Sea in the Jordan River between 1946 and 1956 by Bedouin shepherds and a team of archeologists. The initial discovery, by Bedouin shepherd Muhammed edh-Dhib, his cousin Jum'a Muhammed, and Khalil Musa, took place between November 1946 and February 1947. The shepherds discovered seven scrolls housed in jars in a cave near the now known as Cave 1. The community rule scrolls and the Pesher on Habakkuk Commentary, the Community Rule Scroll, which is known as the Community Rule Scroll (1QS).", "prediction 4": "The Dead Sea Scrolls are ancient Jewish religious manuscripts found in the Qumran Caves in the West Bank near the Dead Sea. The first discovery was made between November 1946 and February 1947 by Bedouin shepherd Muhammed edh-Dhib, his cousin Jum'a Muhammed, and Khalil Musa.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 59 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 412 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Dead Sea Scrolls are ancient Jewish religious, mostly Hebrew, manuscripts found in the Qumran Caves in the West Bank near the Dead Sea. Many thousands of written fragments have been discovered in the Dead Sea area. However, a small number of well-preserved, almost intact manuscripts have survived. The initial discovery took place between November 1946 and February 1947, when 7 scrolls where found housed in jars. In February 2017, there was one blank parchment found in a jar. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Who plays the role of karmen in 7de laan?", "passages": [ [ "7de Laan", "7de Laan\n\n7de", "Laan is a South African Afrikaans soap opera created by Danie Odendaal and produced by Danie Odendaal Productions.", "The series is set in and around the fictional 7de", "Laan (Sewende Laan or 7th Avenue) in the suburb of Hillside, Johannesburg, where the characters live and work.", "The programme's dialogue is primarily in Afrikaans and is subtitled in English with some English and Zulu dialogue in between.", "The street and shopfronts which are featured on the opening visuals, are that of Seventh Street in Melville, Johannesburg.", "Odendaal originally conceived of the series when he was a resident of the Melville section of Johannesburg.", "At the time, Odendaal would watch the people of his community over breakfast and a cup of coffee at his favourite coffee shop.", "He would make up fictitious characters based on what he saw.", "The working title for the show was \"Die Koffiekan\" (The Coffee Pot).", "Later it was renamed \"Hoe Meer Dae\u2026\" (How many days), but the name was considered too similar to the American soap opera, \"Days of Our Lives.\"", "Eventually, the title \"7de Laan\" was chosen because it reflects a place where people live and work and because it is a common street name in South Africa." ] ], "gold": "7de Laan is a South African Afrikaans soap opera that focuses on the lives of residents staying in and around the community of 7de Laan, in the suburb of Hillside. At least two characters named Karmen appear in the show. One of them, Karmen Meintjies, is played by Gabriella Linto, while a second character who shares the name but has no surname is played by Erin le Roux. Baby Karmen also makes an appearance in the show, with Razeen Isaacs playing the role.", "prediction 1": "7de Laan is a South African Afrikaans soap opera created by Danie Odendaal and produced by Danie Odendaal Productions. The series is set in and around the fictional 7de Laan in the suburb of Hillside, Johannesburg, where the characters live and work. The role of Karmen is played by Aarena Mafutu.", "prediction 2": "7de Laan is a South African Afrikaans soap opera created by Danie Odendaal and produced by Danie Odendaal Productions. The series is set in and around the fictional 7de Laan in the suburb of Hillside, Johannesburg, where the characters live and work. Initially, Odendaal would watch the people of his community over breakfast and a cup of coffee at his favourite coffee shop. He would make up fictitious characters based on what he saw. A young actress, Nadia Van der eloo, who played the part of Karmen. A former student, a student, played the role of Karmen.", "prediction 3": "7de Laan is a South African Afrikaans soap opera created by Danie Odendaal and produced by Danie Odendaal Productions. The series is set in and around the fictional 7de Laan in the suburb of Hillside, Johannesburg, where the characters live and work. The characters have a long history and are familiar to each other, but there are similarities to the characters in the American soap opera, Days of Our Lives.", "prediction 4": "7de Laan is a South African Afrikaans soap opera created by Danie Odendaal and produced by Danie Odendaal Productions. The series is set in and around the fictional 7de Laan or Sewende Laan or 7th Avenue in the suburb of Hillside, Johannesburg, where the characters live and work. Eventually, the title 7de Laan was chosen because it reflects a place where people live and work and because it is a common street name in South Africa. Also, the actress Grace Mbie plays the role of Karmen.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 118 }, { "error type": "Unverifiable", "explanation": "", "start": 251, "end": 297 } ], "missing-info": [], "corrected-prediction": "7de Laan is a South African Afrikaans soap opera. The series is set in and around the fictional 7de Laan in the suburb of Hillside, Johannesburg, where the characters live and work. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Where does assassin's creed 3 take place?", "passages": [ [ "Assassin's Creed III", "Connor's story spans through two decades of his life.", "From his childhood in 1760 to 1783.", "Boston and New York City are cities that can be explored, as well as the American Colonial Frontier, spanning forest, cliffs, rivers, Connor's Mohawk village, and the settlements of Lexington, and Concord.", "The player can hunt small and large animals, and approximately one third of the story takes place in the Frontier.", "The city of Philadelphia can also be visited at one point during the game, as can The Caribbean during several naval missions.", "The entire Eastern seaboard is also explorable via Connor's captaining his naval warship, the \"Aquila\".", "\"Assassin's Creed III\" features a large cast of characters.", "The main character is Ratonhnhak\u00e9:ton (Noah Watts), also known as Connor, an 18th-century assassin.", "The 18th century characters include Achilles Davenport (Roger Aaron Brown), Connor's mentor and a retired assassin; Connor's mother Kanieht\u00ed:io or Ziio (Kaniehtiio Horn); Connor's first mate aboard the \"Aquila\" Robert Faulkner (Kevin McNally); and the French taverner Stephane Chapheau (Shawn Baichoo)." ], [ "Assassin's Creed III", "\"Assassin's Creed III\" is a third-person action-adventure title set in an open world in which the player uses a combination of stealth, parkour, and combat to complete various missions.", "The player takes the role of three characters during the course of the game.", "The main character is Desmond Miles, a 21st-century Assassin, working to uncover the secrets of a mysterious Precursor Vault that will protect the Earth from an upcoming solar flare on December 21, 2012.", "To uncover the secrets, Desmond uses the Animus to live out memories of two of his ancestors which the player controls during these sequences, both set at the time of the American Revolutionary War.", "The first, briefly played at the start of the game, is Haytham Kenway, a British Templar who seeks the location of the Vault.", "The second, and the primary character for the game, is Ratonhnhak\u00e9:ton, the result of a brief liaison between Kenway and a Native American woman.", "Ratonhnhak\u00e9:ton takes on the name Connor to blend in better with colonial society.", "When playing as Connor, the player has access to a huge wilderness known as the Frontier (which is 1.5 times bigger than Rome in \"\"), the cities of Boston and New York City." ], [ "Assassin's Creed III", "\"Assassin's Creed III\" is set in an open world and presented from the third-person perspective with a primary focus on using Desmond and Connor's combat and stealth abilities to eliminate targets and explore the environment.", "Connor is able to freely explore 18th-century Boston, New York City, and the American frontier to complete side missions away from the primary storyline.", "The game also features a multiplayer component, allowing players to compete online to complete solo and team based objectives including assassinations and evading pursuers.", "Ubisoft developed a new game engine, Anvil Next, for the game.", "The game received positive reviews from critics, who praised it for its gameplay, narrative, diverse cast of characters, visuals and grand, ambitious scale, while criticism was directed at the unevenly developed gameplay mechanics and the glitches within the game.", "It was a commercial success, selling more than 12 million copies worldwide.", "Its sequel, \"\", was released in October 2013, and follows Ratonhnhak\u00e9:ton's grandfather\u00a0\u2013 Edward Kenway\u00a0\u2013 a pirate and Assassin operating in the Caribbean during the Golden Age of Piracy.", "In September 2018, a remastered edition of \"Assassin's Creed III\" was announced as a downloadable add-on to \"Assassin's Creed Odyssey\"." ] ], "gold": "Assassin's Creed III is set in an open world where Connor is able to freely explore 18th-century Boston, Massachusetts, New York City, New York and the frontier. The American frontier spans forests, cliffs, rivers, Connor's Mohawk village and the settlements of Lexington and Concord. The city of Philadelphia can also be visited at one point during the game. Additionally, portions of the Eastern Seaboard and Caribbean Sea can be explored via the naval warship Aquila.", "prediction 1": "Assassin's Creed III is a third-person action game set in an open world where the player takes the role of three characters, with the main focus on using Desmond Miles's combat abilities to eliminate targets and explore the environment. In the game, the player is able to freely explore 18th-century Boston, New York City, and the American frontier to complete side missions away from the primary storyline. The game takes place in the United States of America and takes place in the 18th-century colonial city of Philadelphia is also visitable at one point during several naval missions.", "prediction 2": "The story of Assassin's Creed III is set in the American colonial frontier, which is 1.5 times bigger than Rome, the city of Philadelphia and the cities of Boston and New York City. The game takes place in an open world where the player takes the role of three characters as they attempt to complete various missions.", "prediction 3": "Assassin's Creed III is an action-adventure game set in an open world which the player explores using stealth, parkour, and combat. The game takes place in the American colonial frontier, in the 17th century Boston, New York City, and in the Caribbean.", "prediction 4": "The story of Assassin's Creed III takes place in 18th-century Boston and New York City, as well as the American Colonial Frontier. The game's main character is Ratonhnhak\u00e9:ton, also known as Connor, an 18th-century assassin. Connor is able to freely explore 18th-century Boston, New York City, and the American frontier to complete side missions away from the main storyline.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 349, "end": 407 }, { "error type": "Irrelevant", "explanation": "", "start": 408, "end": 505 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Assassin's Creed III is set in an open world where player is able to freely explore 18th-century Boston, New York City, and the American frontier, spanning forest, cliffs, rivers, Connor's Mohawk village, and the settlements of Lexington, and Concord. The city of Philadelphia can also be visited at one point during the game. The entire Eastern seaboard is also explorable via Connor's captaining his naval warship, the \"Aquila\"." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the left lane of a motorway used for?", "passages": [ [ "Driving in the United Kingdom", "Speed limits of 5\u00a0mph, 20\u00a0mph, 30\u00a0mph, 40\u00a0mph, 50\u00a0mph and 60\u00a0mph are also used on roads in the UK where it is deemed that the national or in-town speed limit is inappropriate, with repeater signs posted at regular intervals.", "Drivers on dual carriageways (which may or may not be motorways) are legally required to use the left-most lane unless overtaking other vehicles on the road, unless signs or road markings indicate that the left-most lane(s) is only for traffic leaving at the next junction.", "Drivers who wish to overtake a slower vehicle are thus expected to move out from their lane (having used the indicator lights to warn other road-users of their intention to do so), pass the slower vehicle and return to the left-most lane.", "This enables faster traffic to overtake unhindered if it wishes to do so.", "On the UK's busiest roads, where there may be four or more lanes in each direction, there is often a situation where overtaking becomes continual as each successive lane moves at a slightly faster speed than that to its left.", "On motorways an extra left lane termed the 'hard shoulder' is usually present for use only when a vehicle has broken down.", "It is illegal to drive in this lane unless indicated otherwise, for example on one of the increasing number of Smart Motorways." ], [ "Lane", "Urban access roads and roads in low-density areas may have lanes as narrow as in width per lane, with shoulders at least wide.", "Painted lane markings vary widely from country to country.", "In the United States, Canada, Mexico, Honduras, Puerto Rico, Virgin Islands and Norway, yellow lines separate traffic going opposite directions and white separates lanes of traffic traveling the same direction, but such is not the case in many European countries.", "Lane markings are mostly lines painted on the road by a road marking machine, which can adjust the marking widths according to the lane type.", "Traffic reports in California often refer to accidents being \"in the number X lane.\"", "The California Department of Transportation (Caltrans) assigns the numbers from left to right.", "The far left passing lane is the number 1 lane.", "The number of the slow lane (closest to freeway onramps/offramps) depends on the total number of lanes, and could be anywhere from 2 to 8.", "For much of human history, roads did not need lane markings because most people walked or rode horses at relatively slow speeds.", "However, when automobiles, trucks, and buses came into widespread use during the first two decades of the 20th century, head-on collisions became more common." ] ], "gold": "The left lane in a motorway is used both as a slow lane or to connect with an entry/exit. In some cases, there might be extra left lane termed the 'hard shoulder', which is present for use only when a vehicle has broken down, meaning its illegal to drive in this lane unless indicated otherwise.", "prediction 1": "On motorways an extra left lane termed the 'hard shoulder' is usually present for use only when a vehicle has broken down. It is illegal to drive in this lane unless indicated otherwise, for example on one of the increasing number of Smart Motorways.", "prediction 2": "On motorways there is an extra left lane called the hard shoulder which is usually present for use only when a vehicle has broken down. It's illegal to drive in this lane unless indicated otherwise, for example on one of the increasing number of Smart Motorways.", "prediction 3": "On motorways an extra left lane termed the 'hard shoulder' is usually present for use only when a vehicle has broken down. It is illegal to drive in this lane unless indicated otherwise, for example on one of the increasing number of Smart Motorways. On dual carriageways drivers are legally required to use the left-most lane unless overtaking other vehicles on the road, unless signs or road markings indicate that the left-most lane(s) is only for traffic leaving at the next junction.", "prediction 4": "The left lane of a motorway is used for two purposes. Firstly, it is used for traffic leaving at the next junction. Secondly, it is used for traffic entering and exiting the motorway.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 250 } ], "missing-info": [], "corrected-prediction": "On motorways an extra left lane termed the 'hard shoulder' is usually present for use only when a vehicle has broken down. It is illegal to drive in this lane unless indicated otherwise." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time vikings played on thanksgiving?", "passages": [ [ "Thanksgiving (United States)", "Professional football games are often held on Thanksgiving Day; until recently, these were the only games played during the week apart from Sunday or Monday night.", "The National Football League has played games on Thanksgiving every year since its creation.", "The Detroit Lions have hosted a game every Thanksgiving Day from 1934 to 1938 and again every year since 1945.", "In 1966, the Dallas Cowboys, who had been founded six years earlier, adopted the practice of hosting Thanksgiving games.", "The league added a third game in prime time in 2006, which aired on the NFL Network, then moved to NBC in 2012.", "The third game has no set site or team, providing an opportunity for all teams in the league to host a Thanksgiving game in the future.", "For college football teams that participate in the highest level (all teams in the Football Bowl Subdivision, as well as three teams in the historically black Southwestern Athletic Conference of the Championship Subdivision), the regular season ends on Thanksgiving weekend, and a team's final game is often against a regional or historic rival, such as the Iron Bowl between Alabama and Auburn, the Civil War between Oregon and Oregon State, the Apple Cup between Washington and Washington State, and Michigan and Ohio State playing in their rivalry game.", "Most of these college games are played on the Friday or Saturday after Thanksgiving, but usually one or two college games are played on Thanksgiving itself." ] ], "gold": "Since its inception in 1920, the NFL has played games on Thanksgiving Day, which traditionally included one game hosted by the Detroit Lions since 1934, and one game hosted by the Dallas Cowboys since 1966, with a third prime time game featuring different teams annually and with no fixed host being included since 2006. The last time the Minnesota Vikings played on Thanksgiving was on November 23, 2017, having played before both on November 24, 2016 and November 23, 2000.", "prediction 1": "The Vikings play on Thanksgiving every year since 1935. The Detroit Lions have hosted a game every Thanksgiving Day from 1934 to 1938. The Vikings played on Thanksgiving the last time they played on November 4, 1939. The Dallas Cowboys played on Thanksgiving the last time they played.", "prediction 2": "The Minnesota Vikings have played games on Thanksgiving every year since 1945. The last time the Vikings played on Thanksgiving was in 2004. The National Football League has played games on Thanksgiving every year since its creation. The Detroit Lions have hosted a game every Thanksgiving Day from 1934 to 1938 and again every year since 1945. In 1966, the Dallas Cowboys, who had been founded six years earlier, adopted the practice of hosting Thanksgiving games.", "prediction 3": "The last time the Vikings played on thanksgiving was in 2011. The NFL has played games on Thanksgiving every year since its creation. The Detroit Lions have hosted a game every Thanksgiving Day from 1934 to 1938 and again every year since 1945. In 1966, the Dallas Cowboys, who had been founded six years earlier, adopted the practice of hosting Thanksgiving games.", "prediction 4": "The Vikings have played a game on thanksgiving every year since their creation in 1896. The last time the Vikings played on Thanksgiving was in 1897.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 217, "end": 285 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 55 }, { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 216 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The National Football League has played games on Thanksgiving every year since its creation. The Detroit Lions have hosted a game every Thanksgiving Day from 1934 to 1938. In 1966, the Dallas Cowboys adopted the practice of hosting Thanksgiving games. The league added a third game in prime time in 2006." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Who plays the t3 on every witch way?", "passages": [ [ "Every Witch Way", "Emma barely makes it through the school year with the help of Lily, the school nurse who is Emma's guardian; Andi Cruz, her best friend; Daniel Miller, a mutual crush, and the rest of the Sharks, Iridium High's swim team.", "There are obstacles along the way, too, including Maddie Van Pelt, the leader of the Panthers, a trio of the school's most popular girls, who is a newly profound witch and Daniel's ex-girlfriend, and the principal, Miss Torres: she is a 400-year-old witch and the old Chosen One, too, but she's malicious.", "During the upcoming eclipse, she plans on taking Emma's powers, but fails after Maddie and Emma join forces, despite their differences, and send her away using a spell from the Hexoren, a book of spells that Emma inherited from her late mother.", "At the end of the season, Daniel and Emma become a couple; also, after defeating the principal, both witches think they lost their powers, but in reality, Emma still has them, and she keeps this a secret from Daniel in season 2.", "It's a new year at Iridium High." ], [ "Jason Drucker", "Jason Drucker\n\nJason Ian Drucker (born September 20, 2005) is an American child actor.", "He starred as Greg Heffley in the 2017 film \"\".", "He also played Tommy Miller, the youngest of the Miller Family, in Nickelodeon's \"Every Witch Way\".", "In 2018, he co-stars in the \"Transformers\" spin-off \"Bumblebee\"." ] ], "gold": "On Every Witch Way, Louis Tomeo plays Robert Miller who is the oldest and leader of the Terrible 3 as well as being their best inventor. Jackie Frazey plays Melanie Miller who is the middle child and only girl. She is also the smartest of the Terrible 3. Jason Ian Drucker plays Tommy Miller who is the youngest of the Terrible 3 and the most hyperactive.", "prediction 1": "Jason Ian Drucker, an American child actor, plays Tommy Miller, the youngest of the Miller Family, on Nickelodeon's Every Witch Way.", "prediction 2": "Jason Ian Drucker, an American child actor, plays Tommy Miller, the youngest of the Miller Family, on Nickelodeon's Every Witch Way. In the first season, Jason Drucker played Tommy Miller and in the second season, Jason Drucker played Tommy Miller.", "prediction 3": "Jason Drucker plays Tommy Miller, the youngest of the Miller Family, in Nickelodeon's Every Witch Way. In the first season, Jason Drucker played the t3. In the second season, Jason Drucker played the t3.", "prediction 4": "Jason Ian Drucker plays Tommy Miller, the youngest of the Miller Family, on Nickelodeon's Every Witch Way.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 43 } ], "missing-info": [], "corrected-prediction": "Jason Ian Drucker, an American child actor the youngest of the Miller Family, on Nickelodeon's Every Witch Way." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "Who wrote all i really want to do?", "passages": [ [ "All I Really Want to Do", "\"All I Really Want to Do\" opens the album with a different attitude than Dylan's previous album, \"The Times They Are a-Changin'\"; a playful song about a relationship rather than a finger-pointing political song.", "Musically simple, though playful, \"All I Really Want to Do\" is essentially a list of things, physical and psychological, that Dylan does not want to do or be to the listener (perhaps a woman, but just as likely his audience as a whole).", "Dylan laughs at some of his own jokes in the song, as he parodies typical \"boy meets girl\" love songs.", "One interpretation of the song is that it is a parody of male responses to early feminist conversations.", "Along with another \"Another Side of Bob Dylan\" song, \"It Ain't Me, Babe,\" \"All I Really Want to Do\" questioned the usual assumptions of relationships between men and women, rejecting possessiveness and machismo.", "The song's chorus features Dylan singing in a high, keening yodel, likely inspired by Hank Williams or Ramblin' Jack Elliott, while disingenuously claiming that all he wants to do is to be friends." ], [ "All I Really Want to Do", "All I Really Want to Do\n\n\"All I Really Want to Do\" is a song written by Bob Dylan and featured on his Tom Wilson-produced 1964 album, \"Another Side of Bob Dylan\" (\"see\" 1964 in music).", "It is arguably one of the most popular songs that Dylan wrote in the period immediately after he abandoned topical songwriting.", "Within a year of its release on \"Another Side of Bob Dylan\", it had also become one of Dylan's most familiar songs to pop and rock audiences, due to hit cover versions by Cher and the Byrds.", "\"All I Really Want to Do\" was first released on Dylan's 1964 album \"Another Side of Bob Dylan\".", "The song was also included on the Dylan compilations \"Bob Dylan's Greatest Hits Vol.", "II\" in 1971 and the 3-disc edition of \"Dylan\" in 2007.", "In addition, two live versions of the song have been released: one, recorded in 1978, on \"Bob Dylan at Budokan\" and the other, recorded in 1964, on \"\".", "Dylan wrote the song in 1964 and recorded it in one take on June 9, 1964.", "Like other songs on \"Another Side of Bob Dylan\", \"All I Really Want to Do\" was inspired by Dylan's breakup with Suze Rotolo." ] ], "gold": "\"All I Really Want to Do\" is a song written by Bob Dylan in 1964, and was covered by a couple of popular artists. Within a year of its release on \"Another Side of Bob Dylan\", it had also become one of Dylan's most familiar songs to pop and rock audiences, due to hit cover versions by Cher and the Byrds, both in 1965.", "prediction 1": "\"All I Really Want to Do\" is a song written by Bob Dylan and featured on his Tom Wilson-produced 1964 album, Another Side of Bob Dylan. It is arguably one of the most popular songs that Dylan wrote in the period immediately after he abandoned topical songwriting. Like other songs on \"Another Side of Bob Dylan\", \"All I Really Want to Do\" was inspired by Dylan's breakup with Suze Rotolo.\n", "prediction 2": "\"All I Really Want to Do\" is a song written by Bob Dylan and featured on his Tom Wilson-produced 1964 album, Another Side of Bob Dylan. It is arguably one of the most popular songs that Dylan wrote in the period immediately after he abandoned topical songwriting. Dylan wrote the song in 1964 and recorded it in one take on June 9, 1964.", "prediction 3": "\"All I Really Want to Do\" is a song written by Bob Dylan and featured on his Tom Wilson-produced 1964 album, Another Side of Bob Dylan. Dylan wrote the song in 1964 and recorded it in one take on June 9, 1964. Several other artists wrote songs like \"Swagger\" and \"The Fixer Upper\".", "prediction 4": "\"All I Really Want to Do\" is a song written by Bob Dylan and featured on his Tom Wilson-produced 1964 album, Another Side of Bob Dylan. Like other songs on \"Another Side of Bob Dylan\", \"All I Really Want to Do\" was inspired by Dylan's breakup with Suze Rotolo.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 108 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"All I Really Want to Do\" is a song written by Bob Dylan in 1964. Within a year of its release on \"Another Side of Bob Dylan\", it had also become one of Dylan's most familiar songs to pop and rock audiences, due to hit cover versions by Cher and the Byrds." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who wrote the song the girl is mine?", "passages": [ [ "The Girl Is Mine", "The Girl Is Mine\n\n\"The Girl Is Mine\" is a song recorded by Michael Jackson and Paul McCartney.", "The track was written by Jackson and produced by Jackson and Quincy Jones.", "It was released as the first single for Jackson's sixth solo album, \"Thriller\" (1982).", "The song was recorded at Westlake Studios, Los Angeles, from April 14 to 16, 1982.", "The year before, Jackson and McCartney had recorded \"Say Say Say\" and \"The Man\" for the latter's fifth solo album, \"Pipes of Peace\" (1983).", "Although \"The Girl Is Mine\" was released as a single, Jackson never performed the song live.", "\"The Girl Is Mine\" achieved success in the music charts.", "Aside from topping the R&B singles chart, the single peaked at number two on the \"Billboard\" Hot 100 and number eight in the UK.", "By 1985, it had sold 1.3 million copies, and was eventually certified platinum by the Recording Industry Association of America, for shipments of at least one million units.", "Despite the song's success, it received generally mixed reviews from critics who consider it to be the weakest song on \"Thriller\".", "\"The Girl Is Mine\" has been the subject of two plagiarism lawsuits, the first in 1984 and the latter in 1993." ] ], "gold": "There are multiple songs titled, \"The Girl is Mine\". Michael Jackson released the song as the first single for his sixth solo album, Thriller (1982). There is also a song by 99 Souls that features multiple artists: Angela Beyince, Beyonce Knowles, Brandy Norwood, Donald Davis, Edward Robinson, Fred Jerkins III, Kelendria Rowland, LaShawn Daniels, Patrick Douthit, Rodney Jerkins, Tejeda Japhe, Tenitra Williams.", "prediction 1": "\"The Girl Is Mine\" is a song recorded by Michael Jackson and Paul McCartney. The track was written by Jackson and produced by Jackson and Quincy Jones. It was released as the first single for Jackson's sixth solo album, Thriller.\n", "prediction 2": "The track, The Girl Is Mine, was written by Michael Jackson and produced by Jackson and Quincy Jones. It was released as the first single for Jackson's sixth solo album, Thriller (1982).", "prediction 3": "\"The Girl Is Mine\" is a song recorded by Michael Jackson and Paul McCartney. The track was written by Jackson and produced by Jackson and Quincy Jones. It was released as the first single for Jackson's sixth solo album, \"Thriller\". Through various songs, the track has been the subject of plagiarism lawsuits, both of which was filed in 1984 and 1993.", "prediction 4": "\"The Girl Is Mine\" is a song recorded by Michael Jackson and Paul McCartney. The track was written by Jackson and produced by Jackson and Quincy Jones. It was released as the first single for Jackson's sixth solo album, Thriller (1982). The song was written and produced by Jackson and Quincy Jones.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 76 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 151 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"The Girl Is Mine\" is a song written by Michael Jackson. It was released as the first single for Jackson's sixth solo album, \"Thriller\" (1982).\n" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When does the my little pony movie release?", "passages": [ [ "My Little Pony: The Movie (1986 film)", "My Little Pony: The Movie (1986 film)\n\n", "My Little Pony: The Movie is a 1986 American animated musical fantasy film based on the Hasbro toy line, My Little Pony.", "Theatrically released on June 20, 1986 by De Laurentiis Entertainment Group, the film features the voices of Danny DeVito, Madeline Kahn, Cloris Leachman, Rhea Perlman and Tony Randall.", "Produced by Sunbow Productions and Marvel Productions, with animation production by Toei Animation in Japan and AKOM in South Korea, the film was succeeded by a television series anthology which ran in late 1986.", "A ten-part episode from that series, \"The End of Flutter Valley\", served as a sequel to the film.", "At their home, Dream Castle, the ponies are running and playing through flowery meadows and grassy green fields with their animal friends.", "Elsewhere, Baby Lickety-Split is practicing a new dance step, as Spike, a baby dragon, accompanies her rehearsal on the piano.", "Meanwhile, at the Volcano of Gloom, a wicked witch named Hydia is planning to ruin the ponies' festival, but her two incompetent daughters, Reeka and Draggle, are not up to her family's standards of wickedness, and she laments about it, before sending them off to ruin the festival." ], [ "My Little Pony: The Movie (2017 film)", "My Little Pony: The Movie (2017 film)\n\n", "My Little Pony: The Movie is a 2017 animated musical fantasy film based on the television series \"\", which was developed as part of the 2010 re-launch of the \"My Little Pony\" franchise by Hasbro.", "The film was directed by Jayson Thiessen and based on a story and screenplay co-written by Meghan McCarthy, both \"Friendship Is Magic\" veterans.", "The plot follows the alicorn , her five pony friends \u2013 collectively known as the \"Mane 6\" \u2013 and her dragon assistant embarking on a quest to save their home of Equestria from an evil conqueror, gaining new friends in the process.", "In addition to the show's regular voice cast reprising their roles, the film features the voices of Emily Blunt, Kristin Chenoweth, Liev Schreiber, Michael Pe\u00f1a, Sia, Taye Diggs, Uzo Aduba, and Zoe Saldana as new characters.", "The film was produced by Allspark Pictures and DHX Media, using traditional animation created with Toon Boom Harmony.", "It premiered in New York City on September 24, 2017, and was released on October 6, 2017 in North America through Lionsgate.", "The film received mixed reviews from critics and grossed over $60million worldwide on a $6.5 million budget." ], [ "My Little Pony: The Movie (2017 film)", "The score for the film was released on November 16, 2018, more than a year after the film was released.", "On August 7, 2015, Lionsgate announced that they would distribute and market the film worldwide except in China.", "The film was showcased at the 2016 Cannes Film Festival on May 10 along with eight other Lionsgate features to help sell the film to international distributors.", "\"My Little Pony: The Movie\" was originally scheduled for release in the United States on November 3, 2017, but it was subsequently moved up to October 6, 2017.", "Theatrically, the film was accompanied by a 5-minute animated short from Hasbro Studios' web series \"\".", "A private premiere screening was held in New York City on September 24, 2017, twelve days prior to the nationwide release date.", "Numerous toys based on characters, sets, and props from the film were made by Hasbro, and a vast majority of the products was released on August 1, 2017.", "The 2016 PonyRadioCon panel included a brief preview for some of the planned merchandise being developed for the film, including T-shirts and graphics.", "On July 27, 2016, the My Little Pony Collectible Card Game hinted on Twitter about a new set of cards based on the film.", "Hasbro's toyline for the film was shown and promoted at Toy Fair 2017 and various other toy conventions." ] ], "gold": "There are several My Little Pony films, including 1986's My Little Pony: The Movie and a 2017 film of the same name. The 1986 film was theatrically released on June 6, 1986, and was released on VHS and Beta in late October 1986. The 2017 film premiered in New York City at a private premiere screening on September 24, 2017, was theatrically released on October 6, 2017, and was released for digital downloads on December 19, 2017.", "prediction 1": "The My Little Pony movie is a musical animated film based on the My Little Pony toy line. It was released theatrically on June 20, 1986 by De Laurentiis Entertainment Group. The 2017 film My Little Pony: The Movie premiered in New York City on September 24, 2017, and was released on October 6, 2017 in North America through Lionsgate.", "prediction 2": "My Little Pony: The Movie is an animated musical fantasy film based on the animated television series My Little Pony. It was originally scheduled for release in the United States on November 3, 2017, but it was subsequently moved up to October 6, 2017.", "prediction 3": "The 1986 animated musical fantasy film My Little Pony: The Movie was originally scheduled for release in the United States on June 20, 1986 by De Laurentiis Entertainment Group. However, the 2017 animated musical fantasy film My Little Pony: The Movie premiered in New York City on September 24, 2017 and was released on October 6, 2017 in North America through Lionsgate.", "prediction 4": "My Little Pony: The Movie is a 2017 animated musical fantasy film based on the television series My Little Pony that premiered in New York City on September 24, 2017, and was released on October 6, 2017 in North America through Lionsgate. Theatrically released on June 20, 1986 by De Laurentiis Entertainment Group, the film features the voices of Danny DeVito, Madeline Kahn, Cloris Leachman, Rhea Perlman and Tony Randall.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 173 } ], "missing-info": [], "corrected-prediction": "The My Little Pony movie is a musical animated film based on the My Little Pony toy line. It was released theatrically on June 20, 1986. The 2017 film My Little Pony: The Movie premiered in New York City on September 24, 2017, and was released on October 6, 2017 in North America through Lionsgate." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays peter on guardians of the galaxy?", "passages": [ [ "Guardians of the Galaxy (film)", "Guardians of the Galaxy (film)\n\nGuardians of the Galaxy (retroactively referred to as Guardians of the Galaxy Vol. 1) is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures.", "It is the tenth film in the Marvel Cinematic Universe (MCU).", "The film was directed by James Gunn, who wrote the screenplay with Nicole Perlman, and features an ensemble cast including Chris Pratt, Zoe Saldana, Dave Bautista, Vin Diesel, and Bradley Cooper as the titular Guardians, along with Lee Pace, Michael Rooker, Karen Gillan, Djimon Hounsou, John C. Reilly, Glenn Close, and Benicio del Toro.", "In \"Guardians of the Galaxy\", Peter Quill forms an uneasy alliance with a group of extraterrestrial criminals who are fleeing after stealing a powerful artifact.", "Perlman began working on the screenplay in 2009.", "Producer Kevin Feige first publicly mentioned \"Guardians of the Galaxy\" as a potential film in 2010 and Marvel Studios announced it was in active development at the San Diego Comic-Con International in July 2012.", "Gunn was hired to write and direct the film that September.", "In February 2013, Pratt was hired to play Peter Quill / Star-Lord, and the supporting cast members were subsequently confirmed." ], [ "Guardians of the Galaxy (TV series)", "After Howard the Duck admitted being threatened by Collector into double-crossing the Guardians of the Galaxy as well as Collector's ship shrinking Hala by converting the black hole generator into a molecular compression engine, Phyla-Vell works with the Guardians of the Galaxy to save Hala and defeat Collector who gets away after setting his ship to self-destruct.", "This season included Marvel characters Spider-Man, Max Modell, Venom, and Carnage in a crossover with the television series \"Spider-Man\", with Stan Lee having a voice role to go with his cameo.", "Marvel was rumored to be considering a new animated series with another \"Spider-Man\" show or a \"Guardians of the Galaxy\" show.", "The appearances of the \"Guardians of the Galaxy\" in \"Avengers Assemble\" and \"Ultimate Spider-Man\" were supposed to be test runs for their own show.", "Comicbookmovie.com indicated in January 2014 that the \"Guardians of the Galaxy\" series was selected for development.", "On July 26, 2014, at San Diego Comic-Con, a week before the release of the \"Guardians of the Galaxy\" film, Marvel Animation announced the Guardians of the Galaxy animated TV series with a trailer featuring Rocket Raccoon and Star-Lord." ] ], "gold": "The Guardians of the Galaxy is a fictional comic-book superhero team by Marvel Comics that appeared in a 2014 movie by the same name and was later adapted into a TV show based on that same movie. In the film, the character of Peter is played by Chris Pratt. Meanwhile, the character was voiced by Will Friedle in the television series.", "prediction 1": "Peter Quill is a fictional character who appears in the comic book Guardians of the Galaxy. Chris Pratt plays the character in the 2014 film, while Djimon Hounsou plays Peter on the 2014 animated TV series.", "prediction 2": "Guardians of the Galaxy is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. In February 2013, Chris Pratt was hired to play Peter Quill / Star-Lord, and the supporting cast members were subsequently confirmed. In the 2014 Guardians of the Galaxy TV series, Peter Quill is voiced by Djimon Hounsou, and Glenn Close.", "prediction 3": "Guardians of the Galaxy is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. Chris Pratt plays Peter Quill, the leader of the Guardians of the Galaxy and Star-Lord, in the film. The Guardians of the Galaxy animated television series first aired on July 26, 2014, and also featured Tom Holland as Peter Quill.", "prediction 4": "Guardians of the Galaxy is an American superhero film based on the Marvel Comics superhero team of the same name. It is produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures. In February 2013, Chris Pratt was hired to play Peter Quill / Star-Lord, and the supporting cast members were subsequently confirmed. In the Guardians of the Galaxy TV series, Peter Quill is voiced by Djimon Hounsou.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 91 }, { "error type": "Unverifiable", "explanation": "", "start": 92, "end": 206 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Guardians of the Galaxy is a 2014 American superhero film based on the Marvel Comics superhero team of the same name. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "How many seasons are there in last man standing?", "passages": [ [ "Last Man Standing (U.S. TV series)", "Last Man Standing (U.S. TV series)\n\n", "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd.", "Distributed by 20th Century Fox Television, the series originally ran on ABC from 2011 to 2017 for six seasons, and entered syndication in 2015.", "Despite being ABC's second-highest rated sitcom for the 2016\u201317 season, it was revealed in May 2017 that the network had declined to renew \"Last Man Standing\" for a seventh season.", "Media publications reported that ABC was unwilling to cover the production costs for a seventh season on behalf of 20th Century Fox Television.", "One year later, the studio's sibling network Fox announced it had picked up the show for a seventh season, which premiered on September 28, 2018.", "The series follows Mike Baxter, a senior executive and director of marketing for an outdoor sporting goods store chain based in Denver, Colorado.", "His home life is initially filled with his wife, three daughters and a grandson, but later extends to the young men who are married to or dating his daughters.", "Several notable guest stars have appeared throughout the series, including appearances made from cast members of Tim Allen's previous series, \"Home Improvement\"." ], [ "Trailer Park Boys", "On November 15, 2014, Netflix released a new 90-minute special, titled \"Trailer Park Boys: Live at the North Pole\".", "Season 9 of \"Trailer Park Boys\" was made available on March 27, 2015.", "On June 1, 2015, Swearnet officially announced that the production of Season 10 is underway.", "On December 9, 2015, a new 75-minute special debuted on Netflix, titled \"Trailer Park Boys: Drunk, High, and Unemployed Live In Austin\".", "On March 28, 2016, Netflix released season 10 of the \"Trailer Park Boys\".", "It consisted of 10 episodes and includes appearances from several well-known stars such as Snoop Dogg, Jimmy Kimmel, Doug Benson and Tom Arnold.", "Two episodes were directed by Bobby Farrelly.", "On April 2, 2016, and on April 20, 2016, Lucy DeCoutere and Jonathan Torrens announced they were leaving the show.", "On May 30, 2016, filming and production began for Season 11 of \"Trailer Park Boys\".", "On July 5, 2016, filming for Season 11 was completed and editing began.", "On October 28, 2016, \"Trailer Park Boys Out of the Park: Europe\" was made available to stream on Netflix with 8 episodes.", "On February 22, it was announced that Season 11 would air March 31, 2017.", "On March 31, 2017, Season 11 aired." ] ], "gold": "Last Man Standing is an American sitcom created by Jack Burditt for ABC that starred Tim Allen as an executive at a sporting goods store chain headquartered in Denver, Colorado. It run for 8 seasons and spawned British and Australian versions of the show that run for 3 and 1 seasons respectively.", "prediction 1": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store chain in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. The series originally ran on ABC from 2011 to 2017 for six seasons, and entered syndication in 2015. Despite being ABC's second-highest rated sitcom for the 2016\u201317 season, it was revealed in May 2017 that the network had declined to renew Last Man Standing for a seventh season, which premiered on September 28, 2018 and was a season 10 of the trailer park boys.", "prediction 2": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. Originally ran on ABC from 2011 to 2017 for six seasons, and entered syndication in 2015. Despite being ABC's second-highest rated sitcom for the 2016\u201317 season, it was revealed in May 2017 that the network had declined to renew Last Man Standing for a seventh season, which premiered on September 28, 2018.", "prediction 3": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store in Denver, Colorado, who is a married father of three daughters and a grandfather to his oldest daughter's son, Boyd. There are multiple seasons of the series, with season 1, season 2, season 3, and season 4.", "prediction 4": "Last Man Standing has been in the U.S. television lineup for six seasons. In the U.S., there are seven seasons. In the United States, there are two seasons. In the U.S., there is one season. In the U.S., there is one season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 240 }, { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 520 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 559, "end": 604 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Last Man Standing is an American television sitcom starring Tim Allen as a senior employee of a sporting goods store chain in Denver, Colorado. The series originally ran on ABC from 2011 to 2017 for six seasons. A seventh season by the studio's sibling network Fox premiered on September 28." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When was the book of exodus in the bible written?", "passages": [ [ "Book of Exodus", "Book of Exodus\n\nThe Book of Exodus or Exodus is the second book of the Torah and the Hebrew Bible (the Old Testament) immediately following Genesis.", "The book tells how the Israelites leave slavery in Egypt through the strength of Yahweh, the god who has chosen Israel as his people.", "Led by their prophet Moses they journey through the wilderness to Mount Sinai, where Yahweh promises them the land of Canaan (the \"Promised Land\") in return for their faithfulness.", "Israel enters into a covenant with Yahweh who gives them their laws and instructions to build the Tabernacle, the means by which he will come here from heaven and dwell with them and lead them in a holy war to possess the land, and then give them peace.", "Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile (6th century BCE), based on earlier written and oral traditions, with final revisions in the Persian post-exilic period (5th century BCE).", "Carol Meyers in her commentary on Exodus suggests that it is arguably the most important book in the Bible, as it presents the defining features of Israel's identity: memories of a past marked by hardship and escape, a binding covenant with God, who chooses Israel, and the establishment of the life of the community and the guidelines for sustaining it." ] ], "gold": "The initial composition of the book of Exodus in the Bible was written in the 6th century BCE, with its final revision written in the 5th century BCE.", "prediction 1": "The Book of Exodus is the second book of the Torah and the Hebrew Bible (the Old Testament) immediately following Genesis. The book tells how the Israelites leave slavery in Egypt through the strength of Yahweh, the god who has chosen Israel as his people. Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile (6th century BCE), based on earlier written and oral traditions, with final revisions in the Persian post-exilic period (5th century BCE).", "prediction 2": "The book of Exodus or Exodus is the second book of the Torah and the Hebrew Bible immediately following Genesis. Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile 6th century BCE, based on earlier written and oral traditions, with final revisions in the Persian post-exilic period (5th century BCE).", "prediction 3": "The Book of Exodus is the second book of the Torah and the Hebrew Bible immediately following Genesis. Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile (6th century BCE).", "prediction 4": "The book of Exodus is the second book of the Torah and the Hebrew Bible immediately following Genesis. The book tells how the Israelites leave slavery in Egypt through the strength of Yahweh, the god who has chosen Israel as his people. Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile (6th century BCE).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 442 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 256 } ], "missing-info": [], "corrected-prediction": " Traditionally ascribed to Moses himself, modern scholarship sees the book as initially a product of the Babylonian exile (6th century BCE) with final revisions in the Persian post-exilic period (5th century BCE)." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who made the song i need a hero?", "passages": [ [ "Holding Out for a Hero", "Holding Out for a Hero\n\n\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film \"Footloose\", and later included on her 1986 album \"Secret Dreams and Forbidden Fire\".", "It was written by Jim Steinman and Dean Pitchford.", "Initially, the song only just reached the Top 100 in the UK Singles Chart, but made it to number 2 the following year, and re-entered the charts again at number 69 in 1991.", "The song reached No. 1 on the Irish Singles Chart on 28 September 1985.", "It reached the top 40 in the United States and Canada.", "The song's instrumental break was reused from an earlier song by Jim Steinman called \"Stark Raving Love\", which featured on Steinman's 1981 album \"Bad for Good\".", "Jim Steinman had been recruited to work on the \"Footloose\" soundtrack, for which he wrote \"Holding Out for a Hero\" with Dean Pitchford.", "Steinman suggested Tyler's name when he was approached about finding a singer to record the song.", "Tyler recorded the song at the Paramount Studios, and was shown the scene of the film where the song would feature.", "Around the world, \"Holding Out for a Hero\" has become considered a torch song." ] ], "gold": "The song Holding Out For A Hero was written by Jim Steinman and Dean Pitchford, produced by Jim Steinman, and sang by Bonnie Tyler.", "prediction 1": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film Footloose, and later included on her 1986 album Secret Dreams and Forbidden Fire. It was written by Jim Steinman and Dean Pitchford. Initially, the song only just reached the Top 100 in the UK Singles Chart, but made it to number 2 the following year, and re-entered the charts again at number 69 in 1991. The song reached No. 1 on the Irish Singles Chart on 28 September 1985. It reached No. 1 on the Irish Singles Chart on 28 September 1985. It reached the top 40 in the United States and Canada.", "prediction 2": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film FOOTLESSE. It was written by Jim Steinman and Dean Pitchford. Around the world, \"Holding Out for a Hero\" has become considered a torch song.", "prediction 3": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the soundtrack to the 1984 film \"Footloose\". It was written by Jim Steinman and Dean Pitchford. Around the world, \"Holding Out for a Hero\" has become considered a torch song.", "prediction 4": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler for the 1984 film \"Footloose\". It was written by Jim Steinman and Dean Pitchford. Around the world, \"Holding Out for a Hero\" has become considered a torch song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 486 }, { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 552 }, { "error type": "Irrelevant", "explanation": "", "start": 553, "end": 607 } ], "missing-info": [], "corrected-prediction": "\"Holding Out for a Hero\" is a song recorded by Welsh singer Bonnie Tyler. It was written by Jim Steinman and Dean Pitchford. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "When does man in the high castle come on?", "passages": [ [ "The Man in the High Castle (TV series)", "Juliana and Hawthorne Abendsen\u2014the Man in the High Castle\u2014are captured by the Nazis.", "Smith learns from Abendsen that people can only travel to the other world if their counterpart there has died.", "Smith rushes to stop Juliana from escaping, and shoots her just as she travels, disappearing before his eyes.", "The pilot and the second episode were screened at a special Comic-Con event.", "The season premiered on November 20, 2015.", "The second season was released on December 16, 2016.", "The third season was released on October 5, 2018.", "In 2010, it was announced that the BBC would co-produce a four-part TV adaptation of \"The Man in the High Castle\" for BBC One together with Headline Pictures, FremantleMedia Enterprises and Scott Free Films.", "Director Ridley Scott was to act as executive producer of the adaptation by Howard Brenton.", "On February 11, 2013, \"Variety\" reported that Syfy was producing the book as a four-part miniseries, with Frank Spotnitz and Scott as executive producers, co-produced with Scott Free Productions, Headline Pictures and Electric Shepherd Prods.", "On October 1, 2014, Amazon Studios began filming the pilot episode for a potential television drama to be broadcast on their Prime web video streaming service." ], [ "The Man in the High Castle (TV series)", "Adapted by Spotnitz, the project was produced for Amazon by Scott, David Zucker and Jordan Sheehan for Scott Free, Stewart Mackinnon and Christian Baute for Headline Pictures, Isa Hackett and Kalen Egan for Electric Shepherd and Spotnitz's Big Light Productions.", "The pilot was released by Amazon Studios on January 15, 2015.", "Amazon Studios' production process is somewhat different from those of other conventional television channels in that they produce pilot episodes of a number of different prospective programs, then release them and gather data on their success.", "The most promising shows are then picked up as regular series.", "On February 18, 2015, Amazon announced that \"The Man in the High Castle\" was given the green-light along with four other series, and a full season would be produced.", "Principal filming for the pilot took place in Seattle, with the city standing in for San Francisco and locations in New York City, as well as Roslyn, Washington, which was the long-time shooting location for \"Northern Exposure\".", "Sites used in Seattle include the Seattle Center Monorail, the Paramount Theatre, a newspaper office in the Pike Place Market area, as well as various buildings in the city's Capitol Hill, International District, and Georgetown neighborhoods." ] ], "gold": "The High Castle season 1 came on January 15, 2015, season 2 came on December 16, 2016, season 3 came on October 5, 2018, and season 4 came on November 15, 2019.", "prediction 1": "The TV series The Man in the High Castle came on TV on November 20, 2015. The second season came on November 16, 2016 and the third season came on October 5, 2018.", "prediction 2": "The television series Man in the High Castle premiered on November 20, 2015. The second season was released on December 16, 2016, and the third season was released on October 5, 2018.", "prediction 3": "The Man in the High Castle is a television series created by Ridley Scott and produced by Frank Spotnitz, adapted by Spotnitz. The four-part TV adaptation of the book was produced by Syfy for their web video streaming service. The pilot episode was released by Amazon Studios on January 15, 2015. The first episode of the second season was screened at a special Comic-Con event. The third season was released on October 5, 2018.", "prediction 4": "The BBC One adaptation of \"The Man in the High Castle\" premiered on November 20, 2015. The second season premiered on December 16, 2016. The third season was released on October 5, 2018.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The TV series The Man in the High Castle came on TV on November 20, 2015. The second season came on November 16, 2016 and the third season came on October 5, 2018." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When was the lord of the rings written?", "passages": [ [ "The Lord of the Rings", "The Lord of the Rings\n\nThe Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien.", "The story began as a sequel to Tolkien's 1937 fantasy novel \"The Hobbit\", but eventually developed into a much larger work.", "Written in stages between 1937 and 1949, \"The Lord of the Rings\" is one of the best-selling novels ever written, with over 150 million copies sold.", "The title of the novel refers to the story's main antagonist, the Dark Lord Sauron, who had in an earlier age created the One Ring to rule the other Rings of Power as the ultimate weapon in his campaign to conquer and rule all of Middle-earth." ], [ "The Lord of the Rings (film series)", "Bilbo attends the Council of Elrond, Sam looks into Galadriel's mirror, Saruman is redeemed before he dies and the Nazg\u00fbl just make it into Mount Doom before they fall.", "They presented their treatment to Harvey and Bob Weinstein, the latter of whom they focused on impressing with their screenwriting as he had not read the book.", "They agreed upon two films and a total budget of $75\u00a0million.", "During mid-1997, Jackson and Walsh began writing with Stephen Sinclair.", "Sinclair's partner, Philippa Boyens, was a major fan of the book and joined the writing team after reading their treatment.", "It took 13\u201314 months to write the two film scripts, which were 147 and 144 pages respectively.", "Sinclair left the project due to theatrical obligations.", "Amongst their revisions, Sam is caught eavesdropping and forced to go along with Frodo, as occurs in the original novel.", "In the final treatment Sam, Merry, and Pippin infer the existence of One Ring and voluntarily go along after confronting Frodo about it.", "Gandalf's account of his time at Orthanc was pulled out of flashback and Lothl\u00f3rien was cut, with Galadriel doing what she does in the story at Rivendell.", "Denethor attends the Council with his son." ] ], "gold": "JRR Tolkien wrote the Lord of the Rings Trilogy between 1937 and 1949. The screenplay for the Lord of the Rings movies was written in mid-1997.", "prediction 1": "The Lord of the Rings is an epic high fantasy novel written by J. R. R. Tolkien. Written in stages between 1937 and 1949, The Lord of the Rings is one of the best-selling novels ever written, with over 150 million copies sold. It was adapted into a film in mid-1997 with a screenplay by Michael Jackson and Christopher Walsh.", "prediction 2": "The Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien. Written in stages between 1937 and 1949, The Lord of the Rings is one of the best-selling novels ever written, with over 150 million copies sold. In mid-1997, Jackson and Walsh began writing with Stephen Sinclair, Sinclair's partner, Philippa Boyens, was a major fan of the book and joined the writing team after reading their treatment. Sinclair left the project due to theatrical obligations.", "prediction 3": "The Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien. The story began as a sequel to Tolkien's 1937 fantasy novel The Hobbit, but eventually developed into a much larger work. Written in stages between 1937 and 1949, \"The Lord of the Rings\" is one of the best-selling novels ever written, with over 150 million copies sold. During mid-1997, Jackson and Walsh began writing with Stephen Sinclair. Sinclair left the project due to theatrical obligations.", "prediction 4": "The Lord of the Rings is an epic high fantasy novel written by English author and scholar J. R. R. Tolkien. Written in stages between 1937 and 1949, The Lord of the Rings is one of the best-selling novels ever written, with over 150 million copies sold. The Lord of the Rings film series began filming in 1997 after its first printing. The first film was released in 2000 and the second in 2013.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 284, "end": 325 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4,6]}", "start": 257, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4, 6 ] } ], "corrected-prediction": "The Lord of the Rings is written in stages between 1937 and 1949 by J. R. R. Tolkien. The Lord of the Rings was adapted into a film with its script being written for 13-14 months from mid-1997." }, "preference": [ 1, 1, 1, 1, 0, 0 ] }, { "question": "Who did the soundtrack for blade runner 2049?", "passages": [ [ "Blade Runner 2049 (soundtrack)", "Blade Runner 2049 (soundtrack)\n\nBlade Runner 2049:", "Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film \"Blade Runner 2049\".", "Released in October 2017, the album contains music by Hans Zimmer and Benjamin Wallfisch, along with additional tracks by Elvis Presley, Frank Sinatra and Lauren Daigle.", "It also includes the piece \"Tears in the Rain\", which was originally composed and performed (as \"Tears in Rain\") by Vangelis, the composer of the original 1982 soundtrack \"Blade Runner\".", "\"Blade Runner 2049\" is the sequel to Ridley Scott's 1982 film \"Blade Runner\".", "Directed by Denis Villeneuve, it stars Ryan Gosling and Harrison Ford, Ana de Armas, Sylvia Hoeks and Jared Leto.", "Set thirty years after the original film, the story depicts a bioengineered human, a replicant blade runner named K, who discovers the remains of a once-pregnant replicant.", "To prevent a possible war between replicants and humans, K is secretly tasked with finding the child and destroying all evidence related to it.", "The soundtrack was nominated for the BAFTA Award for Best Film Music at the 71st British Academy Film Awards." ], [ "Alcon Entertainment", "Alcon and Warner Bros. signed a new agreement in February 2006, continuing their eight-year relationship, under which Warner Bros. would continue to distribute feature films developed and financed by Alcon.", "In 2014, Alcon partnered with Sleeping Giant Media to form ASG Music Group.", "ASG is a full service music company and record label.", "In 2017, ASG released the Blade Runner 2049 soundtrack, produced by Grammy nominated producer Michael Hodges, Kayla Morrison and Ashley Culp, with Epic Records.", "The Album reached #1 on the \"Billboard\" Soundtrack Sales Charts." ] ], "gold": "The film Blade Runner 2049 is the sequel to Ridley Scott's 1982 film, Blade Runner. Several people were involved in creating the movie's soundtrack. It contains music composed by Hans Zimmer and Benjamin Wallfisch, along with additional music by Elvis Presley, Frank Sinatra and Lauren Daigle. The soundtrack was produced by Michael Hodges, Kayla Morrison and Ashley Culp.", "prediction 1": "Blade Runner 2049: Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film Blade Runner 2049. Released in October 2017, the album contains music by Hans Zimmer and Benjamin Wallfisch, along with additional tracks by Elvis Presley, Frank Sinatra and Lauren Daigle. It also includes the piece \"Tears in the Rain\", which was originally composed and performed (as \"Tears in Rain\") by Vangelis, the composer of the original 1982 soundtrack Blade Runner.", "prediction 2": "Blade Runner 2049: Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film Blade Runner 2049. The album contains music by Hans Zimmer and Benjamin Wallfisch, along with additional tracks by Elvis Presley, Frank Sinatra and Lauren Daigle. It also includes the piece \"Tears in the Rain\", which was originally composed and performed (as \"Tears in Rain\") by Vangelis, the composer of the original 1982 soundtrack Blade Runner. In 2017, ASG released the Blade Runner 2049 soundtrack, produced by Grammy nominated producer Michael Hodges, Kayla Morrison and Ashley Culp, with Epic Records. The album reached #1 on the Billboard Soundtrack Sales Charts.", "prediction 3": "Blade Runner 2049: Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film Blade Runner 2049. The soundtrack was produced by Grammy nominated producer Michael Hodges, Kayla Morrison and Ashley Culp, with Epic Records.", "prediction 4": "Blade Runner 2049: Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film Blade Runner 2049 released in October 2017. It contains music by Hans Zimmer and Benjamin Wallfisch, along with additional tracks by Elvis Presley, Frank Sinatra and Lauren Daigle. Also included on the album is Vangelis, the same composer of the 1982 Blade Runner soundtrack.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 176 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Blade Runner 2049: Original Motion Picture Soundtrack is a soundtrack album of the music for the 2017 American science fiction film Blade Runner 2049. Released in October 2017, the album contains music by Hans Zimmer and Benjamin Wallfisch, along with additional tracks by Elvis Presley, Frank Sinatra and Lauren Daigle. It also includes the piece \"Tears in the Rain\", which was originally composed and performed (as \"Tears in Rain\") by Vangelis, the composer of the original 1982 soundtrack for Ridley Scott's Blade Runner. It was produced by Grammy nominated producer Michael Hodges, Kayla Morrison and Ashley Culp, with Epic Records." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who played the diva in the movie fifth element?", "passages": [ [ "Inva Mula", "Inva Mula\n\nInva Mula (born June 27, 1963) is an Albanian opera lyric soprano.", "She began her soprano career at a very early age.", "Her father (Avni Mula) and mother (Nina Mula) were also opera singers.", "She is also known for providing the voice of the diva Plavalaguna in the film \"The Fifth Element\".", "Mula was born in Tirana, Albania to an Albanian father from Gjakove and a Russian mother.", "In 1987 she won the \"Cantante d'Albania\" competition in Tirana and in 1988 the George Enescu Competition in Bucharest.", "In 1992 she won the \"Butterfly\" competition in Barcelona.", "She received an award at Pl\u00e1cido Domingo's first \"Operalia International Opera Competition\" contest in Paris, 1993.", "A CD of the event was released.", "She later performed in various concerts at the Op\u00e9ra Bastille in Paris, and in Brussels for Europalia Mexico, in Munich, and in Oslo.", "In 1996 she performed Luigi Cherubini's opera \"M\u00e9d\u00e9e\" (which was taped for TV) at Compi\u00e8gne in France.", "She then returned for Georges Bizet's opera \"La Jolie fille de Perth\" (released CD, filmed for TV, and released DVD in Japan) in 1998." ], [ "Inva Mula", "Her ex-husband Pirro \u00c7ako is a well-known singer and composer from Albania, so she used the spelling Tchako rather than \u00c7ako.", "However, after mid-1990 she began using the name Inva Mula, and never returned to the old one.", "They are now divorced.", "Her current husband is Hetem Ramadani, a businessman from Kosovo.", "Mula is perhaps best known to Western filmgoers as the voice of the Diva Plavalaguna (played on-screen by Ma\u00efwenn Le Besco) in the 1997 film \"The Fifth Element\", where she is credited using her (then) married name as Inva Mulla Tchako.", "She performed the aria \"Oh, giusto cielo!...Il dolce suono\" (the mad scene) from Gaetano Donizetti's \"Lucia di Lammermoor\" and \"The Diva Dance\".", "Director Luc Besson adored Maria Callas, but the sound quality of her 1956 EMI Classics recording of \"Lucia\" wasn't clear enough to use on a film soundtrack, so Callas's agent Michel Glotz, who had produced this recording, introduced him to Mula." ] ], "gold": "The voice of Diva Plavalaguna in the movie The Fifth Element is played by Inva Mula, and the actress that played the physical character is Ma\u00efwenn Le Besco.", "prediction 1": "In the 1997 film The Fifth Element, Albanian opera lyric soprano Inva Mula provides the voice of the Diva Plavalaguna, played on-screen by Mawenn Le Besco.", "prediction 2": "In the 1997 film The Fifth Element, the diva Plavalaguna is played on-screen by Mawenn Le Besco. Albanian opera lyric soprano Inva Mula voices the diva in the movie.", "prediction 3": "In the 1997 film, The Fifth Element, the diva Plavalaguna is played on-screen by Mawenn Le Besco. Albanian opera lyric soprano Inva Mula also provided the voice of the diva in the movie.", "prediction 4": "Inva Mula is an Albanian opera lyric soprano who is best known to Western filmgoers as the voice of the Diva Plavalaguna in the 1997 film The Fifth Element. Mawenn Le Besco played the Diva on-screen in the film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 64 } ], "missing-info": [], "corrected-prediction": "In the 1997 film The Fifth Element, Inva Mula provides the voice of the Diva Plavalaguna, while the character was played on-screen by Mawenn Le Besco." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time the 76ers won a game?", "passages": [ [ "Sports in Philadelphia", "The franchise won its first championship in 1955, as the Nationals.", "After moving to Philadelphia in 1963 and being renamed the 76ers, the franchise acquired Wilt Chamberlain and experienced a great period of success.", "The team won a then-record 68 games and the championship in the 1966-1967 season, making it the only team besides the Boston Celtics to win an NBA championship in the 1960s.", "The franchise missed the playoffs for four consecutive seasons in the early 1970s, and the 1972\u20131973 Sixers hold the NBA record for most losses in one season, with 73.", "However, the team quickly bounced back after it acquired Julius Erving, and Erving and Moses Malone led the Sixers to a championship in 1983.", "The franchise continued to experience success until the early 1990s, when it traded Charles Barkley.", "The Sixers missed the playoffs for seven straight seasons until the emergence of Allen Iverson, who led the team to the 2001 finals.", "The team hovered around .500 for most of the 2000s decade, and missed the playoffs from 2013 to 2017.", "In 1996, the NBA named the 1967 and 1983 championship-winning teams two of the ten greatest teams in NBA history.", "The Philadelphia Warriors played in Philadelphia from 1946 to 1962 before moving to San Francisco and becoming the Golden State Warriors.", "The Philadelphia Warriors won two championships and three conference titles during that time." ], [ "1982\u201383 Philadelphia 76ers season", "However, the Sixers backed up Malone's boast.", "They made a mockery of the Eastern Conference playoffs, first sweeping the New York Knicks in the Semifinals and then beating the Milwaukee Bucks in five games in the Conference Finals.", "The Sixers went on to win their third NBA championship with a four-game sweep of the defending NBA champion Los Angeles Lakers, who had defeated them the season before.", "Malone was named the playoffs' MVP.", "Their 12\u20131 playoff record ranks as the third-best in league history after the 2017 Warriors, who went 16-1, and the 2001 Lakers, who went 15\u20131 en route to the NBA title coincidentally beating the 76ers in the finals.", "The Philadelphia-based group Pieces of a Dream had a minor hit in 1983 with the R&B song \"Fo-Fi-Fo\", which title was prompted by Malone's quip.", "The 76ers had a first round bye.", "(1) Philadelphia 76ers vs. (5) New York Knicks: \"76ers win series 4\u20130\"\n\n(1) Philadelphia 76ers vs. (2) Milwaukee Bucks: \"76ers win series 4\u20131\"\n\n(1) Philadelphia 76ers vs. (1) Los Angeles Lakers: \"76ers win series 4\u20130\"\n\nThe 1983 NBA Finals was the championship round of the season." ], [ "Robert Covington", "On April 12, in a loss to the Toronto Raptors, Covington had his seventh game of the season with six or more three-pointers, joining Stephen Curry, Klay Thompson and J. R. Smith as the only players to do so in 2015\u201316.", "In the team's season finale the following day, Covington scored 27 points and again hit six three-pointers in a 115\u2013105 loss to the Chicago Bulls.", "On December 14, 2016, Covington had season highs of 26 points and 12 rebounds in a 123\u2013114 loss to the Raptors.", "On January 20, 2017, he scored 22 points and made two three-pointers in the final 40 seconds to lead the 76ers to a come-from-behind 93\u201392 win over the Portland Trail Blazers.", "On January 29, 2017, he scored 21 points and tied his season high of 12 rebounds in a 121\u2013108 loss to the Chicago Bulls.", "In March 2017, he had 13 rebounds on three separate occasions.", "On March 31, he was ruled out for the rest of the season with right knee soreness and swelling.", "In the 76ers' season opener on October 18, 2017, Covington scored 29 points in a 120\u2013115 loss to the Washington Wizards.", "On November 13, he scored a season-high 31 points against the Los Angeles Clippers." ] ], "gold": "The 76ers have won several games. The last time the team won a Championship was in 1983 against the Los Angeles Lakers, sweeping them in four games. The last time 76ers won a game in the 2014-2015 regular season was in March 2015. The last time the 76ers won a game in the 2015-2016 regular season and in the 2016-2017 regular season were in April 2016 and March 2017 respectively.", "prediction 1": "The Philadelphia 76ers have won a game seven times in their history. The last time they won a game was on February 10, 1983, when they beat the Houston Rockets 76-71. The last time they lost a game was on February 9, 1983, when they defeated the New York Knicks 76-71. The last time the 76ers won a game on February 9, 1983, was on February 20, 1983, when they beat the New York Knicks 76-71.", "prediction 2": "The Philadelphia 76ers have won five consecutive games since being named the Philadelphia 76ers in 1955. The team won a then-record 68 games and the championship in the 1966-1967 season, making it the only team besides the Boston Celtics to win an NBA championship in the 1960s. The team missed the playoffs for four consecutive seasons in the early 1970s, and the 1972\u20131973 Sixers hold the NBA record for most losses in one season, with 73. However, the team bounced back after it acquired Julius Erving, and Moses Malone led the Sixers to a championship in 1983.", "prediction 3": "The Philadelphia 76ers have won a game 68 times. The last time the 76ers won a game was in the 1966-1967 season. The last time the 76ers won a game was in the 1983 NBA Finals. The last time the 76ers won a game was on January 20, 2017, with Robert Covington scoring 22 points.", "prediction 4": "The Philadelphia 76ers haven't won a championship since the 1983 NBA Finals. The team last won a game in the regular season on October 18, 1983. They also lost the season finale on December 14, 2016 and on January 20, 2017 respectively.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 69, "end": 166 }, { "error type": "Unverifiable", "explanation": "", "start": 167, "end": 268 }, { "error type": "Redundant", "explanation": "The last time they lost a game was on February 9, 1983, when they defeated the New York Knicks 76-71. ", "start": 269, "end": 392 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 68 } ], "missing-info": [], "corrected-prediction": "The 76ers won the NBA Championship in 1983 against the Los Angeles Lakers, sweeping them in four games. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was sent to england to convert the pagan anglo-saxons?", "passages": [ [ "Anglo-Saxon paganism", "While Christianity was initially restricted to Kent, it saw \"major and sustained expansion\" in the period from c. 625 to 642, when the Kentish king Eadbald sponsored a mission to the Northumbrians led by Paulinus, the Northumbrian king Oswald invited a Christian mission from Irish monks to establish themselves, and the courts of the East Anglians and the Gewisse were converted by continental missionaries", "Felix the Burgundian and Birinus the Italian.", "The next phase of the conversion took place between c.653 and 664, and entailed the Northumbrian sponsored conversion of the rulers of the East Saxons, Middle Anglians, and Mercians.", "In the final phase of the conversion, which took place during the 670s and 680s, the final two Anglo-Saxon kingdoms to be led by pagan rulers \u2014 in Sussex and the Isle of Wight \u2014 saw their leaders baptised.", "As with other areas of Europe, the conversion to Christianity was facilitated by the aristocracy.", "These rulers may have felt themselves to be members of a pagan backwater in contrast to the Christian kingdoms in continental Europe.", "The pace of Christian conversion varied across Anglo-Saxon England, with it taking almost 90 years for the official conversion to succeed.", "Most of the Anglo-Saxon kingdoms returned to paganism for a time after the death of their first converted king." ], [ "Anglo-Saxon paganism", "What is known about the religion and its accompanying mythology have since influenced both literature and Modern Paganism.", "The word \"pagan\" is a Latin term that was used by Christians in Anglo-Saxon England to designate non-Christians.", "In Old English, the vernacular language of Anglo-Saxon England, the equivalent term was \"h\u00e6\u00f0en\" (\"heathen\"), a word that was cognate to the Old Norse \"hei\u00f0inn\", both of which may derive from a Gothic word, \"hai\u00feno\".", "Both \"pagan\" and \"heathen\" were terms that carried pejorative overtones, with \"h\u00e6\u00f0en\" also being used in Late Anglo-Saxon texts to refer to criminals and others deemed to have not behaved according to Christian teachings.", "The term \"paganism\" was one used by Christians as a form of othering, and as the archaeologist Neil Price put it, in the Anglo-Saxon context, \"paganism\" is \"largely an empty concept defined by what it is not (Christianity)\".", "There is no evidence that anyone living in Anglo-Saxon England ever described themselves as a \"pagan\" or understood there to be a singular religion, \"paganism\", that stood as a monolithic alternative to Christianity.", "These pagan belief systems would have been inseparable from other aspects of daily life." ], [ "Birinus", "Birinus\n\nBirinus (also \"Berin\", \"Birin\"; \u00a0\u2013 649 or 650) was the first Bishop of Dorchester and was known as the \"Apostle to the West Saxons\" for his conversion of the Kingdom of Wessex to Christianity.", "He is venerated as a saint by the Roman Catholic Church, the Eastern Orthodox Church, and Anglican churches.", "After Augustine of Canterbury performed the initial conversions in England, Birinus, a Frank, came to the kingdoms of Wessex in 634, landing at the port of \"Hamwic\", now in the St Mary's area of Southampton.", "During Birinus's brief time at Hamwic, St. Mary's Church was founded.", "A Benedictine monk, Birinus had been made bishop by Asterius in Genoa, and Pope Honorius I created the commission to convert the West Saxons.", "In 635, he persuaded the West Saxon king Cynegils to allow him to preach.", "Cynegils was trying to create an alliance with Oswald of Northumbria, with whom he intended to fight the Mercians.", "At the final talks between kings, the sticking point was that Oswald, being a Christian, would not ally himself with a pagan.", "Cynegils then converted and was baptised.", "He gave Birinus Dorchester-on-Thames for his episcopal see." ] ], "gold": "Anglo-Saxon paganism only existed for a relatively short time-span, from the fifth to the eighth centuries. In 596, Pope Gregory I ordered a Gregorian mission to be launched in order to convert the Anglo-Saxons to the Roman Catholic denomination of Christianity. The leader of this mission, Augustine, probably landed in Thanet, then part of the Kingdom of Kent, in the summer of 597. The courts of the East Anglians and the Gewisse were converted by continental missionaries Felix of Burgundy and Birinus the Italian from 625 to 642. The deities of this religion provided the basis for the names of the days of the week in the English language. What is known about the religion and its accompanying mythology have since influenced both literature and Modern Paganism.", "prediction 1": "After Augustine of Canterbury performed the initial conversions in England, Birinus Birinus, a Frank, came to the kingdoms of Wessex in 634, landing at the port of Hamwic, now in the St Mary's area of Southampton. A Benedictine monk, Birinus had been made bishop by Asterius in Genoa, and Pope Honorius I created the commission to convert the West Saxons. In 635, he persuaded the West Saxon king Cynegils to allow him to preach. He gave Birinus Dorchester-on-Tha gift of Dorchester.\n", "prediction 2": "There were several missions to convert Anglo-Saxons to Christianity. Augustine of Canterbury had first converted the inhabitants of Kentish Lingala and Langdale. In 635, Bishop Birinus of Dorchester sent a mission to convert the citizens of Wessex to Christianity. Paulinus was the first missionary sent by Augustine to convert the people of Anglo-Saxon England. Felix the Burgundian and Birinus the Italian also came to convert the citizens of Anglo-Saxon England to Christianity.", "prediction 3": "After Augustine of Canterbury performed the initial conversions in England, Birinus the Frank, was the first Bishop of Dorchester and was known as the \"Apostle to the West Saxons\" for his conversion of the Kingdom of Wessex to Christianity. Cynegils, the king of West Saxons, allowed Birinus to preach, but Cynegils eventually converted and was baptised.", "prediction 4": "After Augustine of Canterbury performed the initial conversions in England, Birinus, a Frank, came to the kingdoms of Wessex in 634, landing at the port of Hamwic, now in the St Mary's area of Southampton, and worked as the \"Apostle to the West Saxons\". In 636, Cynegils the Great allowed Birinus to preach, and he was baptised. At the time, this was the official start of the Christian conversion of the Anglo-Saxons to Christianity, which sifer and Augustine were sent to convert the pantheists in 635. On December 14, Augustine of Canterbury led the initial conversions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 213 }, { "error type": "Irrelevant", "explanation": "", "start": 356, "end": 429 }, { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 484 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "After Augustine of Canterbury performed the initial conversions in England, the Kentish king Eadbald sponsored a mission to the Northumbrians led by Paulinus, the Northumbrian king Oswald invited a Christian mission from Irish monks to establish themselves, and the courts of the East Anglians and the Gewisse were converted by continental missionaries, Felix the Burgundian and Birinus the Italian. A Benedictine monk, Birinus had been made bishop by Asterius in Genoa, and Pope Honorius I created the commission to convert the West Saxons." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What types of workers are typically paid a wage and perform manual labor?", "passages": [ [ "Japanese blue collar workers", "Japanese blue collar workers\n\nThe blue collar worker () in Japan encompasses many different types of jobs, skilled and unskilled, including factory workers, construction workers, and agricultural workers.", "In the context of Japanese culture, the blue collar worker can be viewed in relation to its converse: the white-collar worker or the stereotypical Japanese \"salaryman\".", "In Japanese culture, the salaryman is seen as someone whose goal is to be a successful businessman regardless of the impact on his family or on his own personal happiness; commitment and loyalties lie more with the company than the family.", "The Japanese white-collar workers are generally University educated, while blue-collar workers normally only have a high school diploma or have attended a trade or technical school.", "Before World War II, most blue-collar workers normally only had a normal elementary school () diploma or a senior elementary school () diploma.", "Therefore, blue-collar workers were contemned as \"unscholarly\" and \"inferior\" in Japan.", "The Japanese blue-collar workers on average works 40 hours a week from 9\u00a0am-5\u00a0pm with occasional overtime work.", "The white-collar workers may work over 12 hours a day or 60 hours a week and can spend the majority of his time working and commuting to work, as well as traveling for months at a time for his job." ], [ "Working class", "Working class\n\nThe working class (or labouring class) comprises the people employed for wages, especially in manual-labour occupations and industrial work.", "Working-class occupations (see also \"Designation of workers by collar color\") include blue-collar jobs, some white-collar jobs, and most pink-collar jobs.", "The working class only rely upon their earnings from wage labour, thereby, the category includes most of the working population of industrialized economies, of the urban areas (cities, towns, villages) of non-industrialized economies, and of the rural workforce.", "In Marxist theory and socialist literature, the term \"working class\" is often used interchangeably with the term \"proletariat\" and includes all workers who expend both physical and mental labour (salaried knowledge workers and white-collar workers) to produce economic value for the owners of the means of production (the bourgeoisie in Marxist literature).", "As with many terms describing social class, \"working class\" is defined and used in many different ways.", "The most general definition, used by Marxists and many socialists, is that the working class includes all those who have nothing to sell but their labour power and skills.", "In that sense it includes both white and blue-collar workers, manual and mental workers of all types, excluding only individuals who derive their income from business ownership and the labour of others." ], [ "Blue-collar worker", "Blue-collar worker\n\nIn many countries, a blue-collar worker is a working class person who performs manual labor.", "Blue-collar work may involve skilled or unskilled manufacturing, mining, sanitation, custodial work, textile manufacturing, commercial fishing, food processing, oil field work, waste disposal, and recycling, construction, mechanic, maintenance, warehousing, technical installation, and many other types of physical work.", "Blue-collar work often involves something being physically built or maintained.", "In contrast, the white-collar worker typically performs work in an office environment and may involve sitting at a computer or desk.", "A third type of work is a service worker (pink collar) whose labor is related to customer interaction, entertainment, sales or other service-oriented work.", "Many occupations blend blue, white, or pink industry categorizations.", "Blue-collar work is often paid hourly wage-labor, although some professionals may be paid by the project or salaried.", "There is a wide range of payscales for such work depending upon field of specialty and experience.", "The term \"blue collar\" was first used in reference to trades jobs in 1924, in an Alden, Iowa newspaper.", "The phrase stems from the image of manual workers wearing blue denim or chambray shirts as part of their uniforms." ] ], "gold": "A Blue Collar worker is a person who performs manual labor and is typically paid a wage. Blue Collar workers may perform skilled or unskilled work in fields such as manufacturing, mining, maintenance, landscaping, shipping, driving, construction and pest control. Blue Collar work often involves something being physically built or maintained.", "prediction 1": "The working class comprises the people employed for wages, especially in manual-labour occupations and industrial work. In many countries, a blue-collar worker is a working class person who performs manual labor. Blue-collar work may involve skilled or unskilled manufacturing, mining, sanitation, custodial work, textile manufacturing, commercial fishing, food processing, waste disposal, and recycling, construction, mechanic, maintenance, warehousing, technical installation, and many other types of physical work. In the context of Japanese culture, the salaryman is seen as someone whose goal is to be a successful businessman regardless of the impact on his family or on his personal happiness. In the Japanese culture, the salaryman is seen as someone whose goal is to be a successful businessman regardless of the impact on his family or on his own personal happiness.", "prediction 2": "In many countries, a blue-collar worker is a working class person who performs manual labor. Blue-collar work is often paid hourly wage-labor, although some professionals may be paid by the project or salaried. The working class comprises the people employed for wages, especially in manual-labour occupations and industrial work. The working class includes both white-collar workers and the blue-collar workers.", "prediction 3": "The working class or labouring class comprises the people employed for wages, especially in manual-labour occupations and industrial work. In many countries, a blue-collar worker is a working class person who performs manual labor. Blue-collar work may involve skilled or unskilled manufacturing, mining, sanitation, custodial work, textile manufacturing, commercial fishing, food processing, waste disposal, and recycling, construction, mechanic, maintenance, warehousing, technical installation, and many other types of physical work.", "prediction 4": "In many countries, a blue-collar worker is a working class person who performs manual labor. Blue-collar work may involve skilled or unskilled manufacturing, mining, sanitation, custodial work, textile manufacturing, commercial fishing, food processing, waste disposal, and recycling, construction, mechanic, maintenance, warehousing, technical installation, and many other types of physical work. In Japan, the blue collar worker encompasses many different types of jobs, skilled and unskilled, including factory workers, construction workers, and agricultural workers. In Japan, the working class includes both the white-collar worker. The working class comprises the people employed for wages, especially in manual-labour occupations and industrial work. In Marxist theory and socialist literature, the term \"proletariat\" is often used interchangeably with the term \"s\", and includes all workers who expend both physical and mental labour", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 419, "end": 517 }, { "error type": "Irrelevant", "explanation": "", "start": 518, "end": 876 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "In many countries, a blue-collar worker is a working class person who performs manual labor. Blue-collar work may involve skilled or unskilled manufacturing, mining, sanitation, custodial work, textile manufacturing, commercial fishing, food processing, waste disposal, and recycling and construction. Blue-collar work often involves something being physically built or maintained." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the last state founded in america?", "passages": [ [ "Hawaii Admission Act", "Hawaii Admission Act\n\nThe Admission Act, formally An Act to Provide for the Admission of the State of Hawaii into the Union () is a statute enacted by the United States Congress and signed into law by President Dwight D. Eisenhower which dissolved the Territory of Hawaii and established the State of Hawaii as the 50th state to be admitted into the Union.", "Statehood became effective on August 21, 1959.", "Hawaii remains the most recent state to join the United States.", "Prior to 1959, Hawaii was a territory of the United States of America.", "In 1946, the United Nations listed Hawaii as a non-self-governing territory under the administration of the United States (Resolution 55(I) of 1946-12-14).", "Also listed as non-self-governing territories under the jurisdiction of the United States were Alaska Territory, American Samoa, Guam, Puerto Rico, and the Virgin Islands.", "Out of a total population of 600,000 in the islands and 155,000 registered voters, 140,000 votes were cast, the highest turnout ever in Hawaii.", "The vote showed approval rates of at least 93% by voters on all major islands.", "Of the approximately 140,000 votes cast, fewer than 8,000 rejected the Admission Act of 1959.", "The acceptance of statehood for Hawaii was not without its share of controversy.", "There were Native Hawaiians who protested against statehood." ], [ "Alaska Statehood Act", "Alaska Statehood Act\n\nThe Alaska Statehood Act () was signed by President Dwight D. Eisenhower on July 7, 1958, allowing Alaska to become the 49th U.S. state on January 3, 1959.", "From 1867 to 1884 Alaska was considered to be a military district of the United States of America under the control of the federal government.", "Alaskans had sought statehood since as early as the 1920s, though this vision was not realized until the decade after World War II.", "In 1884, the government passed the Organic Act which allowed for Alaska to become a judicial district as well as a civil one, with judges, clerks, marshals, and limited government officials appointed by the federal government to run the territory.", "Furthermore, during the Gold Rush Era (1890\u20131900), over 100,000 people traveled north into the Yukon Territory and Alaska in search of gold.", "Several industries flourished as a result, such as fishing, trapping, mining and mineral production.", "Alaska's resources were depleted to the extent that it came to be considered a \"colonial economy\".", "Alaska was still just a district, however, and the local government had little control over local affairs.", "Several issues arose that made it more difficult for Alaska to push towards self-government.", "One of these was the formation of the \"Alaska Syndicate\" in 1906 by the two barons J. P. Morgan and Simon Guggenheim." ], [ "Arizona Territory", "Arizona Territory\n\nThe Territory of Arizona (also known as Arizona Territory) was a territory of the United States that existed from February 24, 1863 until February 14, 1912, when the remaining extent of the territory was admitted to the Union as the state of Arizona.", "It was created from the western half of the New Mexico Territory during the American Civil War.", "Following the expansion of the New Mexico Territory in 1853, as a result of the Gadsden Purchase, several proposals for a division of the territory and the organization of a separate Territory of Arizona in the southern half of the territory were advanced as early as 1856.", "These proposals arose from concerns about the ability of the territorial government in Santa Fe to effectively administer the newly acquired southern portions of the territory.", "The first proposal dates from a conference held in Tucson that convened on August 29, 1856.", "The conference issued a petition to the U.S. Congress, signed by 256 people, requesting organization of the territory and elected Nathan P. Cook as the territorial delegate to Congress.", "In January 1857, the bill for the organization of the territory was introduced into the House of Representatives, but the proposal was defeated on the grounds that the population of the proposed territory was yet too small.", "Later a similar proposal was defeated in the Senate." ] ], "gold": "Hawaii is the most recent state to join the United States, as its statehood became effective on August 21, 1959. The 49th state to be admitted to the union was Alaska, which became a state on January 3, 1959. On February 14, 1912 Arizona became admitted to the union as the 48th state. New Mexico was the 47th state to be added to the union, and it was added on January 6, 1912.", "prediction 1": "The last state founded in America was the state of Arizona created in 1862. The State of Arizona was created in 1863 from the western half of the New Mexico Territory created during the American Civil War. The State of Hawaii was founded in 1959.", "prediction 2": "Several states were founded in america. The last state to be founded in America was the State of Washington. In 1863, the State of Washington was founded as a state, and in 1863, the State of Arizona was founded as a state. The State of Hawaii was founded in 1959 as the 50th state to be admitted into the Union.", "prediction 3": "The last state founded in America was Hawaii. The State of Hawaii was created on August 21, 1959, and the State of Arizona was created on February 14, 1912. The Territory of Arizona was a territory of the United States that existed from February 24, 1863 until February 14, 1912. It was created from the western half of the New Mexico Territory during the American Civil War.", "prediction 4": "The last state founded in America was the Territory of Arizona in February 1863. The Admission Act, formally An Act to Provide for the Admission of the State of Hawaii into the Union, is a statute enacted by the United States Congress and signed into law by President Dwight D. Eisenhower that dissolved the Territory of Hawaii and established the State of Hawaii as the 50th state to be admitted into the Union. Statehood became effective on August 21, 1959.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 246 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Hawaii is the most recent state to join the United States, as its statehood became effective on August 21, 1959. The 49th state to be admitted to the union was Alaska, which became a state on January 3, 1959. On February 14, 1912 Arizona became admitted to the union. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did sweden change to right hand drive?", "passages": [ [ "Dagen H", "Dagen H\n\nDagen H (H day), today usually called \"H\u00f6gertrafikoml\u00e4ggningen\" (\"The right-hand traffic diversion\"), was the day on 3 September 1967, in which the traffic in Sweden switched from driving on the left-hand side of the road to the right.", "The \"H\" stands for \"\"H\u00f6gertrafik\"\", the Swedish word for \"right traffic\".", "It was by far the largest logistical event in Sweden's history.", "There were various major arguments for the change:\n\nHowever, the change was widely unpopular; in a 1955 referendum, 83 percent voted to keep driving on the left.", "Nevertheless, on 10 May 1963, the Swedish Parliament (\"Riksdagen\") approved the Prime Minister Tage Erlander's government proposal of an introduction of right hand traffic in 1967, as the number of cars on the road tripled from 500,000 to 1.5 million, and was expected to reach 2.8 million by 1975.", "A body known as \"Statens H\u00f6gertrafikkommission\" (HTK) (\"the state right-hand traffic commission\") was established to oversee the changeover.", "It also began implementing a four-year education programme, with the advice of psychologists." ], [ "Transport in Sweden", "The changeover took place on a Sunday morning at 5am on September 3, 1967, which was known in Swedish as \"Dagen H\" (H-Day), the 'H' standing for \"H\u00f6gertrafik\" or right-hand traffic.", "Since Swedish cars were left-hand drive, experts had suggested that changing to driving on the right would reduce accidents, because drivers would have a better view of the road ahead.", "Indeed, fatal car-to-car and car-to-pedestrian accidents did drop sharply as a result.", "This was likely due to drivers initially being more careful and because of the initially very low speed limits, since accident rates soon returned to nearly the same as earlier.", "Total roadways: 572,900\u00a0km, as of 2009.", "Motorways run through Sweden, Denmark and over the \u00d6resund Bridge to Stockholm, Gothenburg, Uppsala and Uddevalla.", "The system of motorways is still being extended.", "The longest continuous motorways are V\u00e4rnamo-G\u00e4vle (E4; 585\u00a0km) and Rabbalshede-Vellinge (E6; 412\u00a0km; will by 2013 be extended so the motorway between Trelleborg and Oslo in Norway will be completed)." ] ], "gold": "Traffic in Sweden switched from the left-hand side of the road to the right on September 3, 1967. The date is referred to as H\u00f6gertrafikoml\u00e4ggningen, meaning \"the right-hand traffic diversion\". Commonly shortened to Dagen H, or H Day, it was by far the largest logistical event in Swedish history.", "prediction 1": "The Swedish people have always driven on the left-hand side of the road, despite having a number of arguments for the change, and in 1955, 83 percent voted to keep driving on the left. However, on 10 May 1963, the Swedish Parliament approved the Prime Minister Tage Erlander's government proposal of an introduction of right hand traffic in 1967, as the number of cars on the road tripled from 500,000 to 1.5 million, and was expected to reach 2.8 million by 1975. The date of the changeover was September 3, 1967, and the Swedish country began implementing a four-year education programme, with the advice of psychologists.", "prediction 2": "Dagen H (H day), also known in Swedish as Dagen H-Day, was the day on 3 September 1967, in which the traffic in Sweden switched from driving on the left-hand side of the road to the right. Since Swedish cars were left-hand drive, experts had suggested that changing to driving on the right would reduce accidents, because drivers would have a better view of the road ahead. Indeed, fatal car-to-car and car-to-pedestrian accidents did drop sharply as a result.", "prediction 3": "The Swedish Parliament approved the Prime Minister Tage Erlander's government proposal of an introduction of right hand traffic in 1967, as the number of cars on the road tripled from 500,000 to 1.5 million, and was expected to reach 2.8 million by 1975. Since Swedish cars were left-hand drive, experts had suggested that changing to driving on the right would reduce accidents, because drivers would have a better view of the road ahead. Indeed, fatal car-to-car and car-to-pedestrian accidents did drop sharply as a result.", "prediction 4": "The day on 3 September 1967, in which the traffic in Sweden switched from driving on the left-hand side of the road to the right, was known in Swedish as Dagen H (H day), the 'H' standing for H\u00f6gertrafik, the Swedish word for right traffic. Since Swedish cars were left-hand drive, experts had suggested that changing to driving on the right would reduce accidents, because drivers would have a better view of the road ahead. Indeed, fatal car-to-car and car-to-pedestrian accidents did drop sharply as a result.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 464 }, { "error type": "Irrelevant", "explanation": "", "start": 515, "end": 624 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Dagen H (H day), today usually called \"H\u00f6gertrafikoml\u00e4ggningen\" (\"The right-hand traffic diversion\"), was the day on 3 September 1967, in which the traffic in Sweden switched from driving on the left-hand side of the road to the right. It was by far the largest logistical event in Sweden's history. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the name of the mall in syracuse new york?", "passages": [ [ "Destiny USA", "Wilmorite, which was constructing the Great Northern Mall in nearby Clay, was accused by the Syracuse city government of using associates in Connecticut to form the \"Citizen's League for an Environmentally Acceptable Northeast,\" which lobbied against construction of a mall at Oil City.", "Eagan meanwhile filed criticism of the mall, claiming that a 25 percent drop in downtown retail sales would occur if the mall was built.", "It proposed an additional downtown mall with a \"Walt Disney-like attraction.\"", "During construction, the mall faced several delays, primarily around environmental cleanup, before opening on October 15, 1990 as Carousel Center, named for the 1908 Philadelphia Toboggan Company carousel, PTC #18 operating within the mall.", "When it opened, Carousel Center featured a unique mix of discount and upscale department stores.", "Charter anchors included JCPenney, Kaufmann's, Steinbach, Lechmere, Chappell's, Hills, and the last Bonwit Teller ever built.", "Each department store was two levels, except Steinbach and Lechmere shared a building, with a store on each level, as well as Chappell's and Hills.", "A basement \"Commons\" area featured covered parking and additional junior anchors, including The Rx Place and Filene's Basement.", "Another unique feature of the mall was the Skydeck, which was on the top levels of the central tower." ], [ "Destiny USA", "In November 2011, parts of the new addition opened mostly featuring temporary holiday stores and signs showing yet to come.", "About this time, but announced earlier that year", "Forever 21 and H&M essentially switched places, with H&M taking a large in-line space that replaced the old Forever 21 and part of the Borders, while Forever 21 moved to the old H&M, which extruded the original storefront.", "In June 2012, it was announced that any further expansions to Destiny USA (including the glass-enclosed park, water features, hotels and technology park) were officially cancelled.", "By late summer of 2012, the CarouselCenter.com webpage merged in with the DestinyUSA.com webpage, as new signage went up.", "In August 2012, the mall's name officially changed to \"Destiny USA\"., ending all references to Carousel Center.", "New major stores in the mall included Burlington Coat Factory in the Commons level, Dick's Sporting Goods and Saks Fifth Avenue Off 5th.", "P.F. Chang's and Dave and Buster's are some of the new restaurants to open.", "New amusement activities include WonderWorks, Billy Beez Indoor Play Park, Revolutions Entertainment; a bowling and restaurant venue with a bar and dance area, RPM Raceway Indoor Karting (formerly Pole Position Raceway), and Canyon Climb, the world's largest indoor rope course." ], [ "Destiny USA", "The same year, Pyramid cancelled the previous expansion project for a project that would triple, not double, the size of the mall, and rename it as \"DestiNY USA\".", "The Skydeck was closed for offices of this new megamall.", "Pyramid Companies promised an extravagant experience in which diners could eat at restaurants while watching people in wave pools, or visiting the aquarium on the site, among other things.", "There would also be a large Central New York Visitors Center inside the mall.", "However, the path to DestiNY USA would not be easy.", "Pyramid needed public funds and tax breaks to make the project possible, and people worried that the mall would be obsolete before all of it was paid.", "Eventually it was decided that the mall would be developed in phases, with the 800,000 square foot addition coming first.", "Despite this, Pyramid continued to unveil further plans for Destiny USA including a year-round glass-enclosed park and amphitheaters.", "Eventually, the large tax breaks and the magnitude of the project would gain much controversy.", "In 2002, Ames closed when the corporate parent went bankrupt.", "At about the time of Ames closing, construction of the $180 million, 47 floor, 1,300 room Grand Destiny hotel purportedly began with a ceremony during which a steel beam was driven into a Carousel Center parking lot." ] ], "gold": "The mall in Syracuse, New York, opened on October 15, 1990, as the Carousel Center, named for the 1908 Philadelphia Toboggan Coasters carousel operating within the mall. In 2001, The Pyramid Companies cancelled the previous expansion project that would double the size of the mall for a project that would triple the size of the mall instead. The new project proposed to rename the mall from Carousel Center to Destiny USA. By late summer of 2012, the CarouselCenter.com webpage merged in with the DestinyUSA.com webpage, as new signage went up. In August 2012, the mall's name officially changed to Destiny USA ending all references to Carousel Center.", "prediction 1": "The largest mall in Syracuse, New York, is called Carousel Center. However, the mall was originally named Carousel Center, after the 1908 Philadelphia Toboggan Company carousel, PTC #18 operating within the mall. In August 2012, the name of the mall was officially changed to Destiny USA, ending all references to Carousel Center.", "prediction 2": "The mall in Syracuse, New York was originally named Carousel Center. Then in 1990, it was renamed as Destiny USA. Then in August 2012, the mall's name officially changed to Destiny USA.", "prediction 3": "The mall in Syracuse, New York is known by various names, including the Carousel Center. It opened on October 15, 1990. In August 2012, the mall's name officially changed to \"Destiny USA\", ending all references to Carousel Center.", "prediction 4": "The Syracuse Mall in Syracuse, New York is known by many names. It is also known by the name Destiny USA. It was built in 1990 and was named Carousel Center, after the 1908 Philadelphia Toboggan Company carousel, PTC #18 operating within the mall. In August 2012, the mall's name officially changed to Destiny USA, ending all references to Carousel Center.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 29 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The mall in Syracuse, New York, opened on October 15, 1990, as the Carousel Center, named for the 1908 Philadelphia Toboggan Coasters carousel operating within the mall. The Pyramid company cancelled the previous expansion project for a project that would triple, not double, the size of the mall, and rename it as \"DestiNY USA\". The largest mall in Syracuse, New York, is called Carousel Center. By late summer of 2012, the CarouselCenter.com webpage merged in with the DestinyUSA.com webpage, as new signage went up. In August 2012, the name of the mall was officially changed to Destiny USA, ending all references to Carousel Center." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did my sister's keeper come out?", "passages": [ [ "My Sister's Keeper (film)", "My Sister's Keeper (film)\n\n", "My Sister's Keeper is a 2009 American drama film directed by Nick Cassavetes and starring Cameron Diaz, Abigail Breslin, Sofia Vassilieva, Jason Patric, and Alec Baldwin.", "Based on Jodi Picoult's 2004 novel of the same name, on June 26, 2009 the film was released to cinemas in the United States, Canada, Ireland, Mexico, and the United Kingdom.", "Kate Fitzgerald (Sofia Vassilieva) has acute promyelocytic leukemia.", "Conceived by in vitro fertilization, her younger sister Anna (Abigail Breslin) was brought into the world as a savior sister.", "She is a genetic match to her older sister and can donate compatible organs, blood, and tissue to help her.", "When Kate turns 15, she goes into renal failure and 11-year old Anna knows that she will be forced by her parents to donate one of her kidneys.", "She also realizes that she may not be able to live the life she wants to lead \u2013 she will not be able to play sports, drink alcohol, or be a mother in the future.", "Anna tells her parents that she does not want to be a donor and sues them for medical emancipation and the rights to her own body." ], [ "My Sister's Keeper (novel)", "The on-call firefighter (who also happens to be Brian, Anna's father) who arrives at the scene, retrieves an unconscious and severely injured Anna from the wreckage of the crushed car.", "She goes into cardiac arrest and is revived.", "Both she and Campbell are rushed to the hospital.", "At the hospital, the doctor informs Sara and Brian that Anna is brain-dead and asks them if they have considered organ donation.", "An injured Campbell steps in and declares that he has the power of attorney and that \"there is a girl upstairs who needs that kidney.\"", "Kate is prepared for surgery, and Anna's kidney is successfully transplanted.", "Anna's life-support machines are then shut off by her family.", "Kate survives the surgery and remains in remission.", "Jesse has reformed and graduates from the police academy, despite his criminal record.", "Picoult, Jodi.", "\"My Sister's Keeper.\"", "Atria Books: New York, 2004; /." ] ], "gold": "The novel My Sister's Keeper by Jodi Picoult was published by Atria Books on April 6, 2004. The film My Sister's Keeper based on Picoult's novel was released on June 26, 2009 in the United States, Canada, Ireland, Mexico and the United Kingdom. ", "prediction 1": "My Sister's Keeper is a 2009 American drama film based on Jodi Picoult's 2004 novel of the same name. Based on Picoult's 2004 novel of the same name, on June 26, 2009 the film was released to cinemas in the United States, Canada, Ireland, Mexico, and the United Kingdom. Based on Picoult's 2004 novel of the same name, on June 20, 2004 the novel, titled My Sister's Keeper, came out in the United States on September 27, 2004.", "prediction 2": "My Sister's Keeper is a 2009 American drama film based on Jodi Picoult's 2004 novel of the same name. It came out on June 26, 2009, in theatres across the United States, Canada, Ireland, Mexico, and the United Kingdom. Based on Picoult's 2004 novel of the same name, My Sister's Keeper came out on October 9, 2004.", "prediction 3": "My Sister's Keeper is a 2009 American drama film based on Jodi Picoult's 2004 novel of the same name. The film was released to cinemas on June 26, 2009 in the United States, Canada, Ireland, Mexico, and the United Kingdom. The novel was written by Sara Picoult and is titled The Sister Who Saved Her Sister, which also came out in 2004.", "prediction 4": "My Sister's Keeper is a 2009 American drama film directed by Nick Cassavetes and starring Cameron Diaz, Sofia Vassilieva, Jason Patric, and Alec Baldwin. Based on Jodi Picoult's 2004 novel of the same name, on June 26, 2009 the film was released to cinemas in the United States, Canada, Ireland, Mexico, and the United Kingdom.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " based on Jodi Picoult's 2004 novel of the same name. ", "start": 102, "end": 149 }, { "error type": "Redundant", "explanation": " based on Jodi Picoult's 2004 novel of the same name. ", "start": 271, "end": 346 }, { "error type": "Unverifiable", "explanation": "", "start": 347, "end": 426 } ], "missing-info": [], "corrected-prediction": "My Sister's Keeper is a 2009 American drama film based on Jodi Picoult's 2004 novel of the same name released on June 26, 2009 in the United States, Canada, Ireland, Mexico, and the United Kingdom. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played brian in fast n furious 7?", "passages": [ [ "The Fate of the Furious", "In July 2015, Moritz said that Walker's character, Brian O'Conner, would not appear in the film, following the use of CGI in the previous film after Walker died in a single-vehicle accident on November 30, 2013, with Moritz stating that his character had \"moved on\".", "It had previously been reported that Paul's younger brother, Cody Walker, would either join the cast in a new role, or replace his older brother in the role of O'Conner; however, it was later announced that the character will not return to the franchise.", "Moritz also said that the film would shift the focus of the franchise from a series of heist films to a spy caper, following a similar change in focus from street racing in \"Fast Five\" (2011).", "In December 2016, the film was retitled \"The Fate of the Furious\".", "Diesel, Russell and Michelle Rodriguez were the first to confirm their involvement in the film, and Tyrese Gibson and Chris Bridges both confirmed their return soon after.", "Lucas Black had signed on to reprise his role from \"\" as Sean Boswell for \"Furious 7\", and two more installments in September 2013, though he did not appear in \"Fate\".", "In May 2015, Dwayne Johnson confirmed his involvement in the film, additionally hinting at a possible spin-off film involving his character, Luke Hobbs." ], [ "Furious 7", "Furious 7\n\nFurious 7 (alternatively known as Fast & Furious 7 and Fast Seven) is a 2015 American action film directed by James Wan and written by Chris Morgan.", "It is the seventh installment in \"The Fast and the Furious\" franchise.", "The film stars Vin Diesel, Paul Walker, Dwayne Johnson, Michelle Rodriguez, Tyrese Gibson, Chris \"Ludacris\" Bridges, Jordana Brewster, Djimon Hounsou, Kurt Russell, and Jason Statham.", "\"Furious 7\" follows Dominic Toretto (Diesel), Brian O'Conner (Walker), and the rest of their team, who have returned to the United States to live normal lives after securing amnesty for their past crimes in \"Fast & Furious 6\" (2013), until Deckard Shaw (Statham), a rogue special forces assassin seeking to avenge his comatose younger brother, puts the team in danger once again.", "With the previous three installments set between \"2 Fast 2 Furious\" (2003) and \"\" (2006), \"Furious 7\" is the first installment in the franchise to take place after \"Tokyo Drift\".", "The film also marks the final film appearance of Walker, who died in a single-vehicle crash on November 30, 2013 with filming only half-completed." ], [ "Furious 7", "Following Walker's death, filming was delayed for script rewrites, and his brothers, Caleb and Cody, were used as stand-ins to complete his remaining scenes.", "These script rewrites completed the story arcs for both Walker and Brewster's characters (Brian O'Conner and Mia Toretto, respectively), causing both to be retired.", "Plans for a seventh installment were first announced in February 2012 when Johnson stated that production on the film would begin after the completion of \"Fast & Furious 6\".", "In April 2013, Wan, predominantly known for horror films, was announced to direct the film in place of Justin Lin, who left the franchise after directing the previous four installments.", "Casting began in the same month with the re-signing of Diesel and Walker, and an initial release date was set.", "Principal photography began in Atlanta, Georgia, in September 2013, resumed in April 2014 and ended in July 2014, with other filming locations including Los Angeles, Colorado, Abu Dhabi, and Tokyo.", "\"Furious 7\" premiered in Los Angeles on April 1, 2015, and was theatrically released in the United States on April 3, 2015, playing in 3D, IMAX 3D, and 4DX internationally.", "Upon release, the film became a critical and commercial success, with praise being aimed at the film's action sequences and its tribute to Walker." ] ], "gold": "Furious 7 is a 2015 American action film directed by James Wan and written by Chris Morgan and is the sequel to Fast & Furious 6 and the seventh installment in the Fast & Furious franchise. The film stars Vin Diesel, Paul Walker, Dwayne Johnson, Michelle Rodriguez, Tyrese Gibson, Chris \"Ludacris\" Bridges, Jordana Brewster, Djimon Hounsou, Kurt Russell, and Jason Statham. Paul Walker originally played the role of Brian, but after his death, his brothers Cody Walker and Caleb Walker stood in to complete his remaining scenes. Because of this situation, the film had to delay its release date; with other filming locations including Los Angeles, Colorado, Abu Dhabi, and Tokyo. ", "prediction 1": "Furious 7 is a 2015 American action film directed by James Wan and written by Chris Morgan. In the 2015 film, Brian O'Conner is played by Paul Walker, while Cody Walker plays the character Brian in the 2015 film. In the 2015 film, Brian is played by Jordana Brewster, Kurt Russell plays Brian, and Dwayne Johnson plays Brian.", "prediction 2": "In the 2015 American action film Fast & Furious 7, the character Brian O'Conner was played by Paul Walker. The role was recast to Jordana Brewster, Kurt Russell, and Jason Statham.", "prediction 3": "In the 2015 American action film Fast & Furious 7, the character Brian O'Conner is played by Paul Walker. The film was directed by James Wan, who also wrote the script, and Kurt Russell plays the lead.", "prediction 4": "In the 2015 American action film Fast & Furious 7 and its sequel Fast Seven, the character Brian O'Conner was played by Jason Statham. Cody Walker played the character in the film.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 213, "end": 325 }, { "error type": "Redundant", "explanation": "2015 ", "start": 99, "end": 103 }, { "error type": "Redundant", "explanation": "In the 2015 film,", "start": 195, "end": 212 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Furious 7 is a 2015 American action film directed by James Wan and written by Chris Morgan. It is the seventh installment in \"The Fast and the Furious\" franchise. The film stars Vin Diesel, Paul Walker, Dwayne Johnson, Michelle Rodriguez, Tyrese Gibson, Chris \"Ludacris\" Bridges, Jordana Brewster, Djimon Hounsou, Kurt Russell, and Jason Statham. In the film, Brian O'Conner is originally played by Paul Walker, with his brothers Cody Walker and Caleb Walker serving as stand ins for the scenes left unfinished following Brian's death. Filming locations includded Los Angeles, Colorado, Abu Dhabi, and Tokyo." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who won so you think you can dance 2016?", "passages": [ [ "So You Think You Can Dance: The Next Generation (U.S. TV series)", "There were also new group dances for the hip-hop finalists and their all-stars; the ballroom finalists and their all-stars; and the contemporary finalists (plus Emma) and their all stars.", "In addition, there was a new group routine for all the finalists plus Maddie Ziegler, and Cat Deely chose to reprise her favorite all-stars routine.", "During the course of the broadcast, each of the Top 4 reprised their favorite solo of the season, each judge chose two favorite routines to see again, each of the all-stars chose a favorite duet to reprise, and other duets were reprised as described below.", "Results were announced during the last hour of the show as follows:", "Emma placed 4th, Tate was 3rd, J. T. was runner-up, and Kida won the $250,000 top prize and will be featured on the cover of \"Dance Spirit\" magazine.", "Notes:" ], [ "So You Think You Can Dance: The Next Generation (U.S. TV series)", "So You Think You Can Dance: The Next Generation (U.S. TV series)\n\n", "So You Think You Can Dance: The Next Generation is the 13th season of \"So You Think You Can Dance\", an American dance competition show.", "The show premiered on Monday, May 30, 2016 in a new format featuring dancers between ages 8 to 13 at the time of their auditions.", "The season was broadcast on Fox in the United States, one show each week on Mondays, as it was the previous season.", "The top prize remained $250,000, and Cat Deeley continued as host.", "Auditions were held in Los Angeles, CA, Chicago, IL and New York City.", "100 dancers were selected by the judges for the Dance Academy portion of the season, in which 10 finalists were selected by, and paired with, \"all-stars\" from previous seasons, who mentored and performed with them during the live performance episodes.", "Series creator and executive producer Nigel Lythgoe, along with new permanent members Paula Abdul and Jason Derulo, returned as members of the permanent judging panel and judge the audition rounds.", "After this, the fourth judge, dancer Maddie Ziegler, who was then 13 years old, joined the show." ], [ "So You Think You Can Dance", "So You Think You Can Dance\n\n", "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance.", "The first series of the franchise, created by \"Idols\" producers Simon Fuller and Nigel Lythgoe, premiered in July 2005 and has broadcast fifteen seasons since.", "Adaptations of the show began airing in other countries in late 2005 and to date 28 localized adaptations have been produced, representing 39 different countries and comprising more than ninety individual seasons.", "Although each varies in the particulars of its format and presentation, all shows in the \"So You Think You Can Dance\" franchise share a premise of placing dancers\u2014who come from a wide variety of dance backgrounds and are often, but not exclusively, amateur or semi-professional in experience\u2014in a competition which requires them to adapt to multiple styles of dance.", "As the competition progresses, a combination of judge decisions and at-home-viewer votes determine which dancers will advance in the competition from week to week, until ultimately one dancer is voted champion of that particular season and receives a prize package that may consist of money, work or training opportunities, additional material prizes and typically the title of the respective country's \"Favorite Dancer\" (i.e. \"America's Favorite Dancer\")." ] ], "gold": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. So You Think You Can Dance: The Next Generation is the 13th season of So You Think You Can Dance, an American dance competition show. Leon \"Kida\" Burns won the dance competition. In Vietnam, Th\u1eed th\u00e1ch c\u00f9ng b\u01b0\u1edbc nh\u1ea3y: So You Think You Can Dance is a Vietnamese televised dance competition and an entry in the international So You Think You Can Dance television franchise, which was won by Nguy\u1ec5n \u0110\u0103ng Qu\u00e2n in 2016. In India, So You Think You Can Dance is an Indian Hindi competitive dance television series that was won by Alisha Behura in 2016.", "prediction 1": "So You Think You Can Dance is an American reality television show in which contestants compete in dance. The 13th season featured dancers between ages 8 to 13 at the time of their auditions. The winner of this season was Kida.", "prediction 2": "So You Think You Can Dance is an American dance competition show. In the 2016 season, Kida won the top prize for the season, valued at $250,000.", "prediction 3": "So You Think You Can Dance is an American dance competition show. The 13th season of the show premiered on Monday, May 30, 2016 in a new format featuring dancers between ages 8 and 13 at the time of their auditions. The winner of the season was Kida.", "prediction 4": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. The 13th season featured dancers between ages 8 to 13 at the time of their auditions. The show premiered on Monday, May 30, 2016 in a new format featuring dancers between ages 8 to 13 at the time of their auditions. The top prize remained $250,000, and Cat Deeley continued as host. Kida won the $250,000 top prize and will be featured on the cover of Dance Spirit magazine.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 30, "end": 41 }, { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 190 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "So You Think You Can Dance is a franchise of reality television shows in which contestants compete in dance. The 13th season's, So You Think You Can Dance: The Next Generation an American dance competition show, winner was Kida." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who does the white house director of communications report to?", "passages": [ [ "White House Chief of Staff", "White House Chief of Staff\n\nThe White House Chief of Staff position is the successor to the earlier role of the President's private secretary.", "The role was formalized as the Assistant to the President in 1946 and acquired its current title in 1961.", "The current official title is Assistant to the President and Chief of Staff.", "The Chief of Staff is a political appointee of the President who does not require Senate confirmation, and who serves at the pleasure of the President.", "It is not a legally required role, but every president since Harry Truman has appointed one.", "In the administration of Donald Trump, the current Chief of Staff is John F. Kelly, who succeeded Reince Priebus on July 31, 2017.", "On December 8, 2018, President Trump announced that Kelly would be stepping down from his post by the end of the year.", "On December 14, Trump announced on Twitter that OMB director Mick Mulvaney would become the new acting Chief of Staff.", "The duties of the White House chief of staff vary greatly from one administration to another and, in fact, there is no legal requirement that the president even fill the position.", "However, since at least 1979, all presidents have found the need for a chief of staff, who typically oversees the actions of the White House staff, manages the president's schedule, and decides who is allowed to meet with the president." ], [ "Reince Priebus", "Reince Priebus\n\nReinhold Richard \"Reince\" Priebus ( ; born March 18, 1972) is an American lawyer and politician who served as White House Chief of Staff for President Donald Trump from January 20, 2017, until July 31, 2017.", "He also served as the chairman of the Republican National Committee (RNC) from 2011 to 2017.", "Raised in Wisconsin, Priebus graduated from the University of Miami School of Law in 1998.", "After working for the law firm Michael Best & Friedrich LLP, Priebus was elected as the chairman of the Wisconsin Republican Party in 2007.", "In 2009, he became the general counsel for the Republican National Committee.", "He won the 2011 Republican National Committee chairmanship election and took office in January 2011.", "As chairman, Priebus was the public face of the party and frequently criticized the policies of President Barack Obama.", "He presided over the Republican Party during the 2012 and 2016 presidential elections.", "Priebus publicly criticized Trump during the early stages of the 2016 Republican presidential primaries, but he later called for party unity.", "He opposed efforts to deny Trump the nomination at the 2016 Republican National Convention and supported his presidential campaign in the general election.", "Days after Trump won the 2016 presidential election, Trump announced that Priebus would serve as his first Chief of Staff." ], [ "Denis McDonough", "After Daschle's re-election defeat in 2004, McDonough became legislative director for newly elected Senator Ken Salazar.", "McDonough later served as a senior fellow at the Center for American Progress in 2004.", "In 2007, Senator Barack Obama's chief foreign policy advisor Mark Lippert, a Navy reservist, was called into active duty.", "Lippert recruited McDonough to serve as his replacement during Lippert's deployment to Iraq.", "McDonough continued to serve as a senior foreign policy advisor to Obama during his 2008 presidential campaign.", "After President Obama's election, he joined the administration as the National Security Council's head of Strategic Communication.", "He also served as National Security Council Chief of Staff.", "On October 20, 2010, President Barack Obama announced that McDonough would be replacing Thomas E. Donilon as Deputy National Security Advisor, who had been promoted to succeed General James L. Jones as National Security Advisor.", "McDonough was seen in photos of the White House Situation Room taken during the monitoring of the SEAL operation in Pakistan that resulted in the death of Osama bin Laden in May 2011.", "On January 20, 2013, at the beginning of his second term in office, Obama appointed McDonough as his Chief of Staff." ] ], "gold": "The White House Communications Director reports to the White House Chief of Staff. John F. Kelly served as the White House Chief of Staff for President Donald Trump from July 31, 2017, to January 2, 2019. Reince Priebus served as White House Chief of Staff for President Donald Trump from January 20, 2017, until July 31, 2017. From 2013 to 2017, Denis McDonough served as White House Chief of Staff for President Barack Obama.", "prediction 1": "The White House director of communications reports to the Chief of Staff, which is the political appointee of the President who does not require Senate confirmation, and who serves at the pleasure of the President. In the administration of Donald Trump, the current Chief of Staff is John F. Kelly, who succeeded Reince Priebus on July 31, 2017.", "prediction 2": "The White House director of communications reports to the president, but this position is not directly reported to the President. The director reports to John F. Kelly, who in turn reports to the President.", "prediction 3": "The White House director of communications reports to the White House chief of staff, John F. Kelly. The position was formalized as the Assistant to the President in 1946 and acquired its current title in 1961. The Director of Communications reports to the White House chief of staff, Reince Priebus, who served from January 20, 2017, until July 31, 2017.", "prediction 4": "The White House director of communications reports to the White House Chief of Staff, John F. Kelly.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 214 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 258, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "In the administration of Donald Trump, the Chief of Staff was John F. Kelly, who succeeded Reince Priebus on July 31, 2017. Richard Priebus served as White House Chief of Staff for President Donald Trump from January 20, 2017, until July 31, 2017. On January 20, 2013, at the beginning of his second term in office, Obama appointed Denis McDonough as his Chief of Staff." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who sang i only think of you on two occasions?", "passages": [ [ "Two Occasions", "Two Occasions\n\n\"Two Occasions\" is an R&B song written by Babyface, Darnell Bristol and Sid Johnson (who was the former manager for Babyface's early group, Manchild) .", "It was produced by Babyface and L.A. Reid for The Deele's third studio album \"Eyes of a Stranger\" (1987).", "The ballad was released as the album's second single in 1988.", "It's the only song on the album that features Babyface on lead vocals, which alternate between himself, Bristol, and Carlos \"Satin\" Greene throughout the course of the song.", "It has since been remade into a live version with added vocals from Babyface with all original vocals from The Deele intact; this version appeared on the 12\" maxi single and also three years later on his album, \"A Closer Look\".", "The song and Babyface were later referenced by Mariah Carey in her 2005 hit song, \"We Belong Together.\"", "The song is also sampled in the 2009 hit song \"Want It, Need It\" by Plies featuring Ashanti.", "It was also sampled in the song \"I Still Love You\" by Next (group) on their \"Rated Next\" album.", "Rap/Hip Hop artist Charlie Manhattan, released his version of \"Two Occasions,\" in 2007, which was taken from his solo debut album, \"The Manhattan Project\"." ], [ "Two Occasions", "\"Faye Wong\" also sampled the song in \"Miss You Night and Day\" found in her 1992 album, \"Coming Home\".", "Craig Lytle, in his review of the album for AllMusic, called \"Two Occasions\" a \"quiet-storm classic\" with \"superb arrangement and production\", declaring the song \"worthy of a number-one ranking.\"", "In 1989, the song won a BMI Pop Award.", "Although the band's first hit \"Body Talk\" actually had a higher placement on the R&B chart, \"Two Occasions\" is widely considered The Deele's most successful single.", "It peaked at number ten on the U.S. \"Billboard\" Hot 100, number four on the Hot R&B and number twenty-one on the Adult Contemporary chart." ], [ "The Deele", "The Deele\n\nThe Deele (pronounced /deal/) is an American band from Cincinnati, Ohio who achieved success in the 1980s with such hit singles as \"Body Talk\" and \"Two Occasions.\"", "When the group began recording in the early 1980s, the lineup consisted of Indianapolis native Kenny \"Babyface\" Edmonds along with Cincinnati musicians Antonio \"L.A.\" Reid, Carlos \"Satin\" Greene, Darnell \"Dee\" Bristol, Stanley \"Stick\" Burke, and Kevin \"Kayo\" Roberson.", "In 2007, Bristol, Greene, Roberson & Burke reformed the group with several new members.", "A March 2016 BET Honors performance, featuring Babyface and Reid reuniting with their former bandmates on stage, led to a more permanent reunion of the classic Deele lineup that has continued to the present.", "The Deele was formed in 1981 and originally comprised local Cincinnati musicians drummer Antonio \"L.A.\" Reid, bassist Kevin \"Kayo\" Roberson, vocalist/percussionist Darnell \"Dee\" Bristol, lead vocalist Carlos \"Satin\" Greene, guitarist/keyboardist Stanley \"Stick\" Burke, and guitarist Steve \"Tuck\" Walters.", "Reid, Roberson, and Walters had been members of a previous Cincinnati-based band, Pure Essence." ] ], "gold": "The Deele, an American band from Cincinnati, Ohio who achieved success in the 1980s with such hit singles as \"Body Talk\" and \"Two Occasions,\" sang the song in 1987. The Whispers cut a version of the song that appeared on their 1997 album Songbook : Volume One - The Songs of Babyface. Faye Wong also covered the song in Cantonese, titled as \"Miss You Night and Day\" found in her 1992 album, Coming Home.", "prediction 1": "\"Two Occasions\" is an R&B song written by Babyface, Darnell Bristol and Sid Johnson. The song was produced by Babyface and L.A. Reid for The Deele's third studio album, Eyes of a Stranger. It was released as the album's second single in 1988. Rap/Hip Hop artist Charlie Manhattan, released his version of \"Two Occasions,\" in 2007, which was taken from his solo debut album, The Manhattan Project.", "prediction 2": "The Deele, an American R&B band from Cincinnati who achieved success in the 1980s with hit singles such as Body Talk and Two Occasions, sang the song. It was produced by Babyface and L.A. Reid for The Deele's third studio album Eyes of a Stranger in 1987. The song was released as the album's second single in 1988. Rap/Hip Hop artist Charlie Manhattan, released his version of Two Occasions in 2007, which was taken from his solo debut album, The Manhattan Project. The original vocals from Babyface were referenced by Mariah Carey in her 2005 hit song, We Belong Together. It has since been remade into a live version with added vocals from Babyface with all original vocals from The Deele intact.", "prediction 3": "\"Two Occasions\" is an R&B song written by Babyface, Darnell Bristol and Sid Johnson. It was produced by Babyface and L.A. Reid for The Deele's third studio album Eyes of a Stranger in 1987. The song was released as the album's second single in 1988. Rap/Hip Hop artist Charlie Manhattan released his version of \"Two Occasions,\" in 2007, which was taken from his solo debut album, The Manhattan Project.", "prediction 4": "The Deele, an American R&B band from Cincinnati, Ohio, sang \"I only think of you on two occasions\" in 1988. The Deele was formed in 1981 and originally comprised local Cincinnati musicians drummer Antonio \"L.A.\" Reid, lead vocalist Carlos \"Satin\" Greene, vocalist Darnell \"Dee\" Bristol, guitarist/keyboardist Stanley \"Stick\" Burke, and guitarist Steve \"Tuck\" Walters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 330 }, { "error type": "Irrelevant", "explanation": "", "start": 331, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 84 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Deele is an American band from Cincinnati, Ohio who achieved success in the 1980s with such hit singles as \"Body Talk\" and \"Two Occasions.\" Lead vocals on the latter alternate between Babyface, Bristol, and Carlos \"Satin\" Greene. Charlie Manhattan has also released a version of the song." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the first settlers come to america?", "passages": [ [ "European colonization of the Americas", "European colonization of the Americas\n\nThe European colonization of the Americas describes the history of the settlement and establishment of control of the continents of the Americas by most of the naval powers of Western Europe.", "Systematic European colonization began in 1492, when a Spanish expedition headed by the Italian explorer Christopher Columbus sailed west to find a new trade route to the Far East but inadvertently landed in what came to be known to Europeans as the \"New World\".", "He ran aground on the northern part of Hispaniola on 5 December 1492, which the Taino people had inhabited since the 7th century; the site became the first permanent European settlement in the Americas.", "Western European conquest, large-scale exploration and colonization soon followed.", "Columbus's first two voyages (1492\u201393) reached the Bahamas and various Caribbean islands, including Hispaniola, Puerto Rico, and Cuba.", "In 1497, Italian explorer John Cabot, on behalf of England, landed on the North American coast, and a year later, Columbus's third voyage reached the South American coast.", "As the sponsor of Christopher Columbus's voyages, Spain was the first European power to settle and colonize the largest areas, from North America and the Caribbean to the southern tip of South America.", "The Spaniards began building up their American empire in the Caribbean, using islands such as Cuba, Puerto Rico, and Hispaniola as bases." ], [ "Settlement of the Americas", "The early environment of the ice-free corridor was dominated by glacial outwash and meltwater, with ice-dammed lakes and periodic flooding from the release of ice-dammed meltwater.", "Biological productivity of the deglaciated landscape was gained slowly.", "The earliest possible viability of the ice-free corridor as a human migration route has been estimated at 11.5k cal years BP.", "Birch forests were advancing across former herb tundra in Beringia by 14.3ka C years BP (17k cal years BP) in response to climatic amelioration, indicating increased productivity of the landscape.", "The archaeological community is in general agreement that the ancestors of the Indigenous peoples of the Americas of historical record entered the Americas at the end of the Last Glacial Maximum (LGM), shortly after 20,000 years ago, with ascertained archaeological presence shortly after 16,000 years ago.", "There remain uncertainties regarding the precise dating of individual sites and regarding conclusions drawn from population genetics studies of contemporary Native Americans.", "It is also an open question whether this post-LGM migration represented the first peopling of the Americas, or whether there had been an earlier, pre-LGM migration which had reached South America as early as 40,000 years ago.", "In the early 21st century, the models of the chronology of migration are divided into two general approaches." ], [ "Spanish colonization of the Americas", "Columbus made four voyages to the West Indies as the monarchs granted Columbus the governorship of the new territories, and financed more of his trans-Atlantic journeys.", "He founded La Navidad on the island later named Hispaniola (now divided into Haiti and the Dominican Republic), in what is the present-day Haiti on his first voyage.", "After its destruction by the indigenous Taino people, the town of Isabella was begun in 1493, on his second voyage.", "In 1496 his brother, Bartholomew, founded Santo Domingo.", "By 1500, despite a high death rate, there were between 300 and 1000 Spanish settled in the area.", "The local Ta\u00edno people continued to resist, refusing to plant crops and abandoning their Spanish-occupied villages.", "The first mainland explorations were followed by a phase of inland expeditions and conquest.", "In 1500 the city of Nueva C\u00e1diz was founded on the island of Cubagua, Venezuela, followed by the founding of Santa Cruz by Alonso de Ojeda in present-day Guajira peninsula.", "Cuman\u00e1 in Venezuela was the first permanent settlement founded by Europeans in the mainland Americas, in 1501 by Franciscan friars, but due to successful attacks by the indigenous people, it had to be refounded several times, until Diego Hern\u00e1ndez de Serpa's foundation in 1569.", "The Spanish founded San Sebastian de Uraba in 1509 but abandoned it within the year." ] ], "gold": "The archaeological community is in general agreement that the ancestors of the Indigenous peoples of the Americas of historical record entered the Americas through Alaska at the end of the Last Glacial Maximum (LGM), shortly after 20,000 years ago, with ascertained archaeological presence shortly after 16,000 years ago. Systematic European colonization began in 1492, when a Spanish expedition headed by the Italian explorer Christopher Columbus sailed west to find a new trade route to the Far East but inadvertently landed in what came to be known to Europeans as the \"New World\". He ran aground on 5 December 1492 on the northern part of Hispaniola, which the Taino people had inhabited since the 9th century; the site became the first permanent European settlement in the Americas. The first European settlers came to modern-day America in 1500.", "prediction 1": "The first settlers in America came to america in 1492, when a Spanish expedition led by the Italian explorer Christopher Columbus sailed west to find a new trade route to the Far East but inadvertently landed in what came to be known to Europeans as the \"New World\". Hispaniola became the first permanent European settlement in the Americas. The earliest settlers were from the island of Hispaniola in 1493 and from 1496 to 1500.", "prediction 2": "The Europeans who sailed to America to find a new trade route to the Far East in 1492 ran aground on the island of Hispaniola on 5 December 1492, and the site became the first permanent European settlement in the Americas. They then began building up their American empire in the Caribbean, using islands such as Cuba, Puerto Rico, and Hispaniola as bases. The Spanish colonized the Americas from 1492 to 1500, establishing cities, towns, and villages. The first permanent settlements in the Americas were founded in 1521 and 1620. The Spanish, after they settled the region, they began building up their American empire in the Caribbean, using islands such as Cuba, Puerto Rico, Puerto Rico, Puerto Rico, and Hispaniola as bases. By 1500, there were between 300 and 1000 Spanish settled in the area.", "prediction 3": "The first European settlers in the Americas arrived in 1492, when a Spanish expedition headed by the Italian explorer Christopher Columbus sailed west to find a new trade route to the Far East but inadvertently landed in what came to be known to Europeans as the \"New World\". Hispaniola, which is now Haiti, was the first permanent European settlement in the Americas. By 1500, between 300 and 1000 Spanish were settled in the area.", "prediction 4": "The first permanent European settlement in the Americas was founded in 1492 by a Spanish expedition led by the Italian explorer Christopher Columbus. Then, in 1497, Italian explorer John Cabot on behalf of England landed on the North American coast and, a year later, Columbus's third voyage reached the South American coast. Then, in 1501, the city of Nueva C\u00e1diz was founded on the island of Cubagua, Venezuela, followed by the founding of Santa Cruz by Alonso de Ojeda in present-day Guajira peninsula. In 1498, Spanish settlers reached the area, and by 1500, despite a high death rate, there were 300 and 1000 Spanish settled in the area.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 342, "end": 429 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The archaeological community is in general agreement that the ancestors of the Indigenous peoples of the Americas of historical record entered the Americas at the end of the Last Glacial Maximum (LGM), shortly after 20,000 years ago, with ascertained archaeological presence shortly after 16,000 years ago. Systematic European colonization began in 1492, when a Spanish expedition headed by the Italian explorer Christopher Columbus sailed west to find a new trade route to the Far East but inadvertently landed in what came to be known to Europeans as the \"New World\". He ran aground on the northern part of Hispaniola on 5 December 1492, which the Taino people had inhabited since the 7th century; the site became the first permanent European settlement in the Americas. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "When were the first colonies established in america?", "passages": [ [ "Thirteen Colonies", "Thirteen Colonies\n\nThe Thirteen Colonies, also known as the Thirteen British Colonies or Thirteen American Colonies, were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries.", "They declared independence in 1776 and formed the United States of America.", "The Thirteen Colonies had very similar political, constitutional, and legal systems and were dominated by Protestant English-speakers.", "They were part of Britain's possessions in the New World, which also included colonies in Canada, the Caribbean, and the Floridas.", "Between 1625 and 1775, the colonial population grew from roughly 2,000 to over 2 million, sometimes displacing American Indians.", "In the 18th century, the British government operated its colonies under a policy of mercantilism, in which the central government administered its possessions for the economic benefit of the mother country.", "Nevertheless, the Thirteen Colonies had a high degree of self-governance and active local elections, and they resisted London's demands for more control; Rhode Island and Connecticut had always elected their own governors.", "The French and Indian War (1754\u201363) against France and its Indian allies led to growing tensions between Britain and the Thirteen Colonies.", "In the 1750s, the colonies began collaborating with one another instead of dealing directly with Britain." ], [ "Thirteen Colonies", "These inter-colonial activities cultivated a sense of shared American identity and led to calls for protection of the colonists' \"Rights as Englishmen\", especially the principle of \"no taxation without representation\".", "Grievances with the British government led to the American Revolution, in which the colonies collaborated in forming the Continental Congress.", "The colonists fought the American Revolutionary War (1775\u201383) with the aid of France and, to a significantly smaller degree, the Dutch Republic and Spain.", "In 1606, King James I of England granted charters to both the Plymouth Company and the London Company for the purpose of establishing permanent settlements in America.", "The London Company established the Colony and Dominion of Virginia in 1607, the first permanently settled English colony on the continent.", "The Plymouth Company founded the Popham Colony on the Kennebec River, but it was short-lived.", "The Plymouth Council for New England sponsored several colonization projects, culminating with Plymouth Colony in 1620 which was settled by English Puritan separatists, known today as the Pilgrims.", "The Dutch, Swedish, and French also established successful American colonies at roughly the same time as the English, but they eventually came under the English crown.", "The Thirteen Colonies were complete with the establishment of the Province of Georgia in 1732, although the term \"Thirteen Colonies\" became current only in the context of the American Revolution." ], [ "Roanoke Colony", "Roanoke Colony\n\nThe Roanoke Colony (), also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America.", "It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina.", "The colony was sponsored by Sir Walter Raleigh, although he himself never set foot in it.", "The initial settlement was established in the summer of 1585, but a lack of supplies and bad relations with the local Native Americans caused many of its members to return to England with Sir Francis Drake a year later, leaving behind a small detachment.", "These men had all disappeared by the time a second expedition led by John White, who also served as the colony's governor, arrived in July 1587.", "White, whose granddaughter Virginia Dare was born there shortly thereafter (making her the first English child born in the New World), left for England in late 1587 to request assistance from the government, but was prevented from returning to Roanoke until August 1590 due to the Anglo-Spanish War.", "Upon his arrival, the entire colony was missing with only a single clue to indicate what happened to them: the word \"CROATOAN\" carved into a tree.", "For many years, it was widely accepted that the colonists were massacred by local tribes, but no bodies were ever discovered, nor any other archaeological evidence." ] ], "gold": "The establishment of the Roanoke Colony was an attempt by Sir Walter Raleigh to found the first permanent English settlement in North America. The first Roanoke colony was founded by governor Ralph Lane in 1585 on Roanoke Island in what is now Dare County, North Carolina, United States. The London Company established the Colony and Dominion of Virginia in 1607, the first permanently settled English colony on the continent. The Thirteen Colonies, also known as the Thirteen British Colonies or the Thirteen American Colonies, were a group of colonies of Great Britain on the Atlantic coast of America founded in the 17th and 18th centuries which declared independence in 1776 and formed the United States of America.", "prediction 1": "The Thirteen Colonies, also known as the Thirteen British Colonies or Thirteen American Colonies, were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries. They declared independence in 1776 and formed the United States of America. The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The Roanoke Colony was the first attempt at founding a permanent English settlement in North America. The Roanoke Colony was established in the summer of 1585 on Roanoke Island in what is today's Dare County, North Carolina.\n", "prediction 2": "The Thirteen Colonies, also known as the Thirteen British Colonies or Thirteen American Colonies, were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries. They declared independence in 1776 and formed the United States of America. The Roanoke Colony was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina.", "prediction 3": "The first colony in North America founded by the English was the Thirteen Colonies, also known as the Thirteen British Colonies or Thirteen American Colonies. They declared independence in 1776 and formed the United States of America. The Roanoke Colony was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The Thirteen Colonies were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries.", "prediction 4": "The Thirteen Colonies were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries. In 1606 King James I of England granted charters to both the Plymouth Company and the London Company for the purpose of establishing permanent settlements in America. The London Company established Pilgrim's Progress in 1608, and the Lost Colony was the first attempt at founding a permanent English settlement in North America and was established in 1585. There was also a second colony established in July 1587 and in 1589. The Lost Colony, also known as the Lost Colony, was established in 1585 and its administrator John White led by Walter Raleigh, was the first attempt at founding a permanent English settlement, but a lack of supplies and bad relations with Native Americans caused many of its members to return to England with Sir Francis Drake a year later.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 336 }, { "error type": "Redundant", "explanation": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America.", "start": 513, "end": 614 }, { "error type": "Redundant", "explanation": "It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. ", "start": 615, "end": 738 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7, 8 ] } ], "corrected-prediction": "The Thirteen Colonies, also known as the Thirteen British Colonies or Thirteen American Colonies, were a group of British colonies on the Atlantic coast of North America founded in the 17th and 18th centuries. They declared independence in 1776 and formed the United States of America. The Roanoke Colony was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. It was sponsored by Sir Walter Raleigh. The London Company established the Colony and Dominion of Virginia in 1607, the first permanently settled English colony on the continent. The Plymouth Company founded the Popham Colony on the Kennebec River, but it was short-lived. The Plymouth Council for New England sponsored several colonization projects, culminating with Plymouth Colony in 1620. The Dutch, Swedish, and French also established successful American colonies at roughly the same time as the English." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When was the first friday the 13th movie released?", "passages": [ [ "Friday the 13th (franchise)", "Friday the 13th (franchise)\n\nFriday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tie\u2011in merchandise.", "The franchise mainly focuses on the fictional character Jason Voorhees, who drowned as a boy at Camp Crystal Lake due to the negligence of the camp staff.", "Decades later, the lake is rumored to be \"cursed\" and is the setting for a series of mass murders.", "Jason is featured in all of the films, as either the killer or the motivation for the killings.", "The original film, created to cash in on the success of \"Halloween\" (1978), was written by Victor Miller and was produced and directed by Sean S. Cunningham.", "The films have grossed over $464 million at the box-office worldwide.", "Frank Mancuso, Jr., a producer of the films, also developed the television show \"\" after Paramount released \"\".", "The television series was not connected to the franchise by any character or setting, but was created based on the idea of \"bad luck and curses\", which the film series symbolized.", "While the franchise was owned by Paramount, four films were adapted into novels, with \"Friday the 13th Part III\" adapted by two separate authors." ], [ "Friday the 13th (1980 film)", "Changes involved an addition to the title\u2014as opposed to a number attached to the end\u2014like \"\" and \"\", or filming the movie in 3-D, as Miner did for \"Friday the 13th Part III\" (1982).", "One major addition that would affect the entire film series was the addition of Jason's hockey mask in the third film; this mask would become one of the most recognizable images in popular culture.", "A reboot to \"Friday the 13th\" was released theatrically in February 2009, with \"Freddy vs. Jason\" writers Damian Shannon and Mark Swift hired to script the new film. The film focused on Jason Voorhees, along with his trademark hockey mask.", "The film was produced by Michael Bay, Andrew Form and Brad Fuller through Bay's production company Platinum Dunes, for New Line Cinema.", "In November 2007, Marcus Nispel, director of the 2003 remake of \"The Texas Chainsaw Massacre\", was hired to direct.", "The film had its United States release on February 13, 2009.", "In 1987, seven years after the release of the motion picture, Simon Hawke produced a novelization of \"Friday the 13th\"." ], [ "Friday the 13th (2009 film)", "Nispel said, \"I don't believe that, when you watch a \"Friday the 13th\" film, you want to feel like John Williams is sitting next to you with the London Symphony Orchestra\".", "On October 18, 2008, the teaser trailer debuted at the 2008 Scream Awards and was released three days later.", "In December, the theatrical trailer was released along with a theatrical poster.", "On Friday, February 13, 2009, \"Friday the 13th\" was released in 3,105 theaters in North America.", "The 2009 film was given the widest release of any \"Friday the 13th\" film, including the crossover film with \"A Nightmare on Elm Street\".", "It was released in nearly three times as many theaters as the original 1980 film and exceeded \"Freddy vs. Jason\" by 91 theaters.", "\"Friday the 13th\" was also released in 2,100 theaters in 28 markets outside North America.", "The film was released on DVD, Blu-ray, and Apple TV on June 16, 2009.", "The DVD and Blu-ray releases contain the theatrical release and an extended cut of the film.", "The film was re-released on September 13, 2013 for the \"Friday the 13th: The Complete Collection\", a box set features of all twelve films in the franchise." ] ], "gold": "Friday the 13th is an American horror franchise that mainly focuses on the fictional character Jason Voorhees, who was thought to have drowned as a boy at Camp Crystal Lake due to the negligence of the camp staff, but decades later, the lake is rumored to be \"cursed\" and is the setting for a series of mass murders. Jason is featured in all of the films, as either the killer or the motivation for the killings. The first Friday the 13th film was release in the United States on May 9, 1980. The 2009 Friday the 13th reboot, which was originally conceived as an origin story, but the project evolved into a re-imagining of the first four Friday the 13th films where the character Jason Voorhees was redesigned as a lean, quick killer with a backstory that allows the viewer to feel sympathy for him, but not enough that he would lose his menace. The reboot was released in Manns Chinese Theater on February 9, 2009 and on Friday, February 13, 2009, it was released in 3,105 theaters in North America.", "prediction 1": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise. The original 1980 film, created to cash in on the success of Halloween, was written by Victor Miller and was produced and directed by Sean S. Cunningham. A reboot to \"Friday the 13th\" was released theatrically in February 2009, with \"Freddy vs. Jason\" writers Damian Shannon and Mark Swift hired to script the new film. The 2009 film was given the widest release of any \"Friday the 13th\" film, including the crossover film with \"A Nightmare on Elm Street\".", "prediction 2": "Friday the 13th is a horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise. The original Friday the 13th film was released on October 18, 1978. The reboot to Friday the 13th was released theatrically on February 13, 2009, with Marcus Nispel, director of the 2003 remake of The Texas Chainsaw Massacre, hired to direct. The 2009 film was given the widest release of any Friday the 13th film, including the crossover film with A Nightmare on Elm Street. It was released on DVD, Blu-ray, and Apple TV on June 16, 2009.", "prediction 3": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise. The original film, created to cash in on the success of \"Halloween\" (1978), was written by Victor Miller and produced and directed by Sean S. Cunningham. A reboot to Friday the 13th was released theatrically in February 2009, with Marcus Nispel, director of the 2003 remake of \"The Texas Chainsaw Massacre\", hired to direct. The 2009 film was given the widest release of any Friday the 13th franchise, including the crossover film with \"A Nightmare on Elm Street\".", "prediction 4": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise. The original Friday the 13th movie was released on September 21, 1978. A reboot to Friday the 13th was released theatrically on February 13, 2009, which was released in 3,105 theaters in North America. The 2009 film was given the widest release of any Friday the 13th film, including the crossover film with \"A Nightmare on Elm Street\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 160 }, { "error type": "Unverifiable", "explanation": "", "start": 165, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 314 }, { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 480 }, { "error type": "Irrelevant", "explanation": "", "start": 481, "end": 617 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3, 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Friday the 13th is an American horror franchise that comprises twelve slasher film. The franchise mainly focuses on the fictional character Jason Voorhees, who drowned as a boy at Camp Crystal Lake due to the negligence of the camp staff. Decades later, the lake is rumored to be \"cursed\" and is the setting for a series of mass murders and Jason is featured in all of the films, as either the killer or the motivation for the killings. There is a 1980 film. A reboot to \"Friday the 13th\" was released theatrically on Friday, February 13, 2009. It was released in 3,105 theaters in North America." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the battle of san jacinto start and end?", "passages": [ [ "Battle of San Jacinto", "Battle of San Jacinto\n\nThe Battle of San Jacinto (), fought on April 21, 1836, in present-day Harris County, Texas, was the decisive battle of the Texas Revolution.", "Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's Mexican army in a fight that lasted just 18 minutes.", "A detailed, first-hand account of the battle was written by General Houston from Headquarters of the Texian Army, San Jacinto, on April 25, 1836.", "Numerous secondary analyses and interpretations have followed, several of which are cited and discussed throughout this entry.", "General Santa Anna, the President of Mexico, and General Mart\u00edn Perfecto de Cos both escaped during the battle.", "Santa Anna was captured the next day on April 22 and", "Cos on April 24, 1836.", "After being held about three weeks as a prisoner of war, Santa Anna signed the peace treaty that dictated that the Mexican army leave the region, paving the way for the Republic of Texas to become an independent country.", "These treaties did not specifically recognize Texas as a sovereign nation, but stipulated that Santa Anna was to lobby for such recognition in Mexico City.", "Sam Houston became a national celebrity, and the Texans' rallying cries from events of the war, \"Remember the Alamo!\"", "and \"Remember Goliad!\"" ], [ "Antonio L\u00f3pez de Santa Anna", "Santa Anna believed that Travis was overly rude and disrespectful towards him, and had that not happened, he would have allowed Sam Houston to establish a dominant presence there.", "In his letter, he stated that the disrespect of Travis led to the demise of all of his followers, which he claimed only took a couple hours.", "However, the defeat at the Alamo bought time for General Sam Houston and his Texas forces.", "During the siege of the Alamo, the Texas Navy had more time to plunder ports along the Gulf of Mexico and the Texian Army gained more weapons and ammunition.", "Despite Sam Houston's lack of ability to maintain strict control of the Texian Army, they defeated Santa Anna's much larger army at the Battle of San Jacinto on 21 April 1836.", "The Texans shouted, \"Remember Goliad, Remember the Alamo!\"", "The day after the battle, a small Texan force led by James Austin Sylvester captured Santa Anna.", "They found the general dressed in a dragoon private's uniform and hiding in a marsh.", "On May 14, 1836, a treaty was made between Santa Anna and Texas.", "It committed Santa Anna to ceasing attacks on the Texan people, bringing to an end all military conflict between the two.", "Santa Anna also agreed that his troops would leave Texas." ] ], "gold": "The Battle of San Jacinto started and ended on April 21, 1836, in present-day Harris County, Texas. This battle was the decisive battle of the Texas Revolution. Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's much larger Mexican army in a fight that lasted just 18 minutes. ", "prediction 1": "The Battle of San Jacinto was fought on April 21, 1836, in present-day Harris County, Texas. Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's Mexican army in a fight that lasted just 18 minutes. A detailed, first-hand account of the battle was written by General Houston from Headquarters of the Texian Army, San Jacinto, on April 25, 1836.", "prediction 2": "The Battle of San Jacinto, fought on April 21, 1836, in present-day Harris County, Texas, was the decisive battle of the Texas Revolution. Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's Mexican army in a fight that lasted just 18 minutes. A detailed, first-hand account of the battle was written by General Houston from Headquarters of the Texian Army, San Jacinto, on April 25, 1836.", "prediction 3": "The battle of San Jacinto began on 21 April 1836 and ended on May 14, 1836.", "prediction 4": "The Battle of San Jacinto, fought on 21 April 1836, in present-day Harris County, Texas, was the decisive battle of the Texas Revolution. Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's Mexican army in a fight that lasted just 18 minutes. Santa Anna signed the peace treaty that dictated that the Mexican army leave the region, paving the way for the Republic of Texas to become an independent country. On May 14, 1836, a treaty was made between Santa Anna and Texas, bringing to an end all military conflict between the two.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 394 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Battle of San Jacinto was fought on April 21, 1836, in present-day Harris County, Texas, was the decisive battle of the Texas Revolution. Led by General Sam Houston, the Texian Army engaged and defeated General Antonio L\u00f3pez de Santa Anna's Mexican army in a fight that lasted just 18 minutes. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who did the texas rangers play in the world series?", "passages": [ [ "San Francisco Giants", "Their rivalry with the Oakland Athletics dates back to when the Giants were in New York and the A's were in Philadelphia and played each other in the 1905, 1911, & 1913 World Series, and was renewed in 1968 when the Athletics moved from Kansas City and the teams again played each other in the earthquake-interrupted 1989 Bay Bridge World Series.", "The 2010 NLCS inaugurated a Giants rivalry with the Philadelphia Phillies after confrontations between Jonathan S\u00e1nchez and Chase Utley, and between Ram\u00f3n Ram\u00edrez and Shane Victorino.", "However, with the Philadelphia Phillies dropping off as one of the premier teams of the National League, this rivalry has died down since 2010 and 2011.", "Another rivalry that has intensified recently is with the St. Louis Cardinals, whom the team has faced 4 times in the NLCS.", "The rivalry between the New York Giants and Chicago Cubs in the early twentieth century was once regarded as one of the most heated in baseball, with Merkle's Boner leading to a 1908 season-ending matchup in New York of particular note.", "That historical rivalry was revisited when the Giants beat the Cubs in the 1989 NL playoffs, in their one-game playoff in Chicago at the end of the 1998 season, and on June 6, 2012 in a \"Turn Back The Century\" game in which both teams wore replica 1912 uniforms." ], [ "San Francisco Giants", "While the Giants have more total wins, head-to-head wins, National League pennants and World Series titles in their franchise histories, the Dodgers have won the National League West 5 more times than the Giants since the start of division play in 1969.", "Both teams have made the postseason as a National League wild card twice.", "The Giants won their first world championship in California in 2010, while the Dodgers won their last world title in 1988.", "As of the end of the 2014 baseball season, the Los Angeles Dodgers lead the San Francisco Giants in California World Series triumphs, 5-3, whereas in 20th century New York, the Giants led the Dodgers in World Series championships, 5-1.", "The combined franchise histories give the Giants an 8-6 edge in MLB championships, overall.", "A geographic rivalry with the cross-Bay American League Athletics greatly increased with the 1989 World Series, nicknamed the \"Battle of the Bay\", which Oakland swept (and which was interrupted by the Loma Prieta earthquake moments before the scheduled start of Game 3 in San Francisco).", "In addition, the introduction of interleague play in 1997 has pitted the two teams against each other for usually six games every season since 1997, three in each city (but only four in 2013, two in each city).", "Before 1997, they played each other only in Cactus League spring training." ], [ "Curse of Coogan's Bluff", "The Giants qualified to play in the World Series after defeating the Atlanta Braves in the National League Division Series and the Philadelphia Phillies (who made back-to-back World Series appearances in the previous year) in the National League Championship Series.", "The Giants defeated the Texas Rangers in five games to win the World Series championship for the first time since moving to San Francisco in 1958, thus ending the 52-year Curse of Coogan's Bluff.", "Following their 2010 championship, the Giants would win two more world championships in the next four years\u2014in 2012 and in 2014.", "However they have yet to win the World Series clincher while playing in San Francisco." ] ], "gold": "The Texas Rangers were in the World Series two years in a row. In 2010 they played the San Francisco Giants, and lost. In 2011 the Cardinals defeated the Rangers in 7 games to win their 11th World Series championship and their first since 2006.", "prediction 1": "The Texas Rangers played in the World Series for the first time since moving to San Francisco in 1958.", "prediction 2": "The Texas Rangers played in the World Series in 1913. The Texas Rangers played in the World Series in 2010 against the New York Giants.", "prediction 3": "The Texas Rangers played in the World Series in 1913. The Texas Rangers played in the World Series in 1915. The Texas Rangers played in the World Series in 1934.", "prediction 4": "The Texas Rangers played in the 1989 World Series. The Texas Rangers played in the 1913 World Series. The Texas Rangers played in the 1915 World Series.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 0, "end": 102 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Texas Rangers played in the World Series championship in 1958 and lost to the Giants. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Where was the biggest great white shark found?", "passages": [ [ "Great white shark", "Adults of this species weigh on average, however mature females can have an average mass of .", "The largest females have been verified up to in length and an estimated in weight, perhaps up to .", "The maximum size is subject to debate because some reports are rough estimations or speculations performed under questionable circumstances.", "Among living cartilaginous fish, only the whale shark (\"Rhincodon typus\"), the basking shark (\"Cetorhinus maximus\") and the giant manta ray (\"Manta birostris\"), in that order, are on average larger and heavier.", "These three species are generally quite docile in disposition and given to passively filter-feeding on very small organisms.", "This makes the great white shark the largest extant macropredatory fish.", "Great white sharks are at around when born, and grow about each year.", "According to J.\u00a0E. Randall, the largest white shark reliably measured was a individual reported from Ledge Point, Western Australia in 1987.", "Another great white specimen of similar size has been verified by the Canadian Shark Research Center:", "A female caught by David McKendrick of Alberton, Prince Edward Island, in August 1988 in the Gulf of St.\u00a0Lawrence off Prince Edward Island.", "This female great white was long." ], [ "Great white shark", "However, there was a report considered reliable by some experts in the past, of a larger great white shark specimen from Cuba in 1945.", "This specimen was long and had a body mass estimated at .", "However, later studies also revealed that this particular specimen was actually around in length, a specimen in the average maximum size range.", "The largest great white recognized by the International Game Fish Association (IGFA) is one caught by Alf Dean in south Australian waters in 1959, weighing .", "Several larger great whites caught by anglers have since been verified, but were later disallowed from formal recognition by IGFA monitors for rules violations.", "A number of very large unconfirmed great white shark specimens have been recorded.", "For decades, many ichthyological works, as well as the \"Guinness Book of World Records\", listed two great white sharks as the largest individuals: In the 1870s, a great white captured in southern Australian waters, near Port Fairy, and an shark trapped in a herring weir in New Brunswick, Canada, in the 1930s.", "However these measurements were not obtained in a rigorous, scientifically valid manner, and researchers have questioned the reliability of these measurements for a long time, noting they were much larger than any other accurately reported sighting.", "Later studies proved these doubts to be well founded." ], [ "Great white shark", "Great white shark\n\nThe great white shark (\"Carcharodon carcharias\"), also known as the great white, white shark or white pointer, is a species of large mackerel shark which can be found in the coastal surface waters of all the major oceans.", "The great white shark is notable for its size, with larger female individuals growing to in length and in weight at maturity.", "However, most are smaller; males measure , and females measure on average.", "According to a 2014 study, the lifespan of great white sharks is estimated to be as long as 70 years or more, well above previous estimates, making it one of the longest lived cartilaginous fish currently known.", "According to the same study, male great white sharks take 26 years to reach sexual maturity, while the females take 33 years to be ready to produce offspring.", "Great white sharks can swim at speeds of over , and can swim to depths of .", "The great white shark has no known natural predators other than, on very rare occasions, the killer whale.", "The great white shark is arguably the world's largest known extant macropredatory fish, and is one of the primary predators of marine mammals.", "It is also known to prey upon a variety of other marine animals, including fish and seabirds." ] ], "gold": "The great white shark, also known as the white shark, white pointer, or simply great white, is a species of large mackerel shark which can be found in all the major oceans. There are different claims about where the biggest great white shark has been found. According to J E Randall, the largest reliably measured white shark came from Ledge Point, Western Australia. The largest shark that has been verified by the Canadian Shark Research Center was from the Gulf of St. Lawrence off Prince Edward Island. The largest great white that has been recognized by the International Game Fish Association was caught in south Australian waters.", "prediction 1": "The largest great white shark found in Australia is a female caught in South Australia in 1923 weighing a massive 68 pounds. The largest great white shark reported in the world was caught in Western Australia in 1987.", "prediction 2": "The biggest great white shark found anywhere on earth is in North America, but there have been several larger females that have been found around the world. The largest great white caught by the International Game Fish Association (IGFA) is in South Australia in 1959, at a length of.", "prediction 3": "The largest great white shark found worldwide is in the waters off the coast of Australia. The largest great whites are a species of large mackerel shark which can be found in the coastal surface waters of all the major oceans. The largest great whites are found in the waters off the coast of Australia. The largest great whites have been verified up to in length and an estimated in weight, perhaps up to.", "prediction 4": "The largest known great white shark is a species of large mackerel shark that can be found in the coastal surface waters of all the major oceans. The largest great white shark that has been captured is a 17-foot specimen captured in the Bahamas in 1923, which was a record-breaking size for a great white. The largest great white caught in Australia is a 14-foot specimen caught in the Gulf of St. Lawrence, off Prince Edward Island in August 1988.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 0, "end": 124 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The great white shark, also known as the white shark, white pointer, or simply great white, is a species of large mackerel shark which can be found in all the major oceans. According to J. E. Randall, the largest white shark reliably measured was a individual reported from Ledge Point, Western Australia in 1987. Another great white specimen of similar size has been verified by the Canadian Shark Research Center. The largest great white recognized by the International Game Fish Association (IGFA) is one caught by Alf Dean in south Australian waters." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When does season 7 of game of thrones finish?", "passages": [ [ "Agent Carter (season 2)", "But that's part of the reason that when we talked about it, we said, 'You know what?", "This season let's stay in L.A.' Because so much of L.A. still looks like it did in 1946.\"", "Butters expanded by saying the move to L.A. \"was something we had talked about in the middle of the first season...", "[and] we realized that not only was it a good idea for the storytelling, but also...it's much easier for us to shoot L.A. for L.A. than try to shoot L.A. for New York.\"", "She added the season hoped to film at Musso & Frank Grill, the Formosa Cafe, the Griffith Observatory, racetracks, piers, and other locations in Downtown Los Angeles.", "The Universal Studios backlot serves as the backlot for the film studio Stark starts, Stark Pictures, with filming also taking place at the Los Angeles River.", "The Dunbar Hotel, a famous jazz club where both African-Americans and Caucasians would attend, is portrayed in the season.", "The showrunners looked to the films \"LA Confidential\", \"Chinatown\", \"The Big Heat\", and \"The Lady from Shanghai\" when shaping the visuals for the season, with additional research provided by Pei." ], [ "Game of Thrones (season 8)", "Game of Thrones (season 8)\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series and will also adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\".", "The season will be adapted for television by David Benioff and D. B. Weiss.", "Filming officially began on October 23, 2017, and concluded in July 2018.", "The season is scheduled to premiere in April 2019.", "\n\n\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series; it will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\"." ] ], "gold": "The seventh and penultimate season of the fantasy drama television series Game of Thrones premiered on HBO on July 16, 2017, and concluded on August 27, 2017. Unlike previous seasons, which consisted of ten episodes each, the seventh season consisted of only seven episodes. Like the previous season, it largely consisted of original content not found in George R. R. Martin's A Song of Ice and Fire series, while also incorporating material that Martin revealed to showrunners about the upcoming novels in the series. Filming began on August 31, 2016, at Titanic Studios in Belfast, and ended in February 2017.", "prediction 1": "Season 7 of Game of Thrones finished filming on October 23, 2017 and the final season completed filming on July 18, 2018. The final season was adapted for television by David Benioff and D. B. Weiss. Filming officially began on October 23, 2017 and concluded in July 2018. The seventh season finished filming on July 18, 2017, and the final season finished filming on July 18, 2017.", "prediction 2": "The seventh season of Game of Thrones finished filming on July 7, 2018. The eighth and final season of the fantasy drama television series Game of Thrones was announced by HBO in July 2016.", "prediction 3": "The seventh season of Game of Thrones finished filming on July 8, 2018. Filming officially began on October 23, 2017 and concluded in July 2018. The season is scheduled to premiere in April 2019.", "prediction 4": "Season 7 of Game of Thrones finished filming on August 30, 2017. Filming officially began on October 23, 2017, and concluded in July 2018. The seventh season was adapted for television by David Benioff and D. B. Weiss. Filming officially began on October 23, 2017, and concluded in July 2018. The seventh season was filmed in Los Angeles from October 23 to August 2, 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 28, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 272 }, { "error type": "Redundant", "explanation": "Season 7 of Game of Thrones finished filming on October 23, 2017 and the final season completed filming on July 18, 2018. ", "start": 273, "end": 382 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Season 7 of Game of Thrones will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series. It will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who was the port to port killer on ncis?", "passages": [ [ "Tony DiNozzo and Ziva David", "Ziva abruptly ends their relationship after learning that he had lied to her directly about his reasoning for being in Washington, D.C. and by omission about his role in the Port to Port killer case.", "In the episode \"Swan Song\", former NCIS agent Mike Franks is killed by the Port to Port killer, who is identified as Lieutenant Jonas Cobb, and Ziva turns to Tony for comfort while the team is grieving over his death.", "She is kidnapped by Cobb in the following episode, the Season 8 finale, and Tony shows great concern.", "When EJ assures him that they will find Ziva, he replies that \"it's just different for some of us\".", "EJ takes an extended leave of absence with the conclusion of the season, ending her affair with Tony.", "Ziva and Ray repair their relationship somewhat, and he gives her an empty ring box as a \"promise\" before leaving for a long-term assignment.", "Glasberg commented, \"Ziva and Ray are a little open-ended at the moment.", "There isn't any closure to it.", "We'll have to see where it leads, but I think he was pretty clear that he has a job to do at the moment, and that's gonna be the primary focus for him.\"" ] ], "gold": "In the 8th season of NCIS, they are after the Port-to-Port killer. They learn that his latest victim survived because somebody intervened and lost an eye in the process, and the on-again, off-again enemy, Trent Kort names the Port to Port Killer as Lt. Jonas Cobb played by Kerr Smith, the first member of a CIA assassination team who cracked under inhumane training. Kort was sent to locate Cobb and eliminate him. ", "prediction 1": "On NCIS, the Port to Port killer was Jonas Cobb. In the episode Swan Song, former NCIS agent Mike Franks is killed by the Port to Port killer, who is identified as Lieutenant Jonas Cobb. Ziva is kidnapped by Cobb in the following episode, the Season 8 finale, and Tony shows great concern.", "prediction 2": "Jonas Cobb was the Port to Port killer on NCIS. In the episode \"Swan Song\", former NCIS agent Mike Franks is killed by the Port to Port killer, who is identified as Lieutenant Jonas Cobb. In the following episode, the Season 8 finale, Ziva is kidnapped by Cobb in the following episode, the Season 9 finale.", "prediction 3": "On NCIS, the Port to Port killer was identified as Lieutenant Jonas Cobb, and the Port to Port murderer was identified as Mike Franks, who was killed by the Port to Port killer, who is identified as Mike Franks.", "prediction 4": "The Port to Port killer was identified as New Orleans Police Chief Jonas Cobb. In the episode \"Swan Song\", former NCIS agent Mike Franks is killed by the Port to Port killer, who is identified as Lieutenant Jonas Cobb. In the episode \"Swan Song\", former NCIS agent EJ Caplan is killed by the Port to Port killer, who is identified as Danias Acosta.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 289 } ], "missing-info": [], "corrected-prediction": "On NCIS, the Port to Port killer was Jonas Cobb." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the population of big spring texas?", "passages": [ [ "Big Spring, Texas", "Big Spring, Texas\n\nBig Spring is a city in and the county seat of Howard County, Texas, United States, at the crossroads of U.S. Highway 87 and Interstate 20.", "With a population of 27,282 as of the 2010 census, it is the largest city between Midland to the west, Abilene to the east, Lubbock to the north, and San Angelo to the south.", "Big Spring was established as the county seat of Howard County in 1882; it is the largest community in the county.", "The city got its name from the single, large spring that issued into a small gorge between the base of Scenic Mountain and a neighboring hill in the southwestern part of the city limits.", "Although the name is sometimes still mistakenly pluralized, it is officially singular.", "\"To the native or established residents who may wince at the plural in Big Spring, it should be explained that until about 1916, when for some unexplained reason the name dropped the final 's', the official name of the town was indeed Big Springs.\"", "The area had long been a popular watering hole for Native American residents and nomads, including members of the more recently established Jumano, Apache, and Comanche tribes." ], [ "Big Spring, Texas", "I-20 leads east to Abilene and west to Midland.", "U.S. Route 87 (Gregg Street) runs through the center of Big Spring, leading north to Lubbock and southeast to San Angelo.", "According to the United States Census Bureau, Big Spring has a total area of .", "About are land, and , or 0.45%, is covered with water.", "As of the census of 2000, 25,233 people, 8,155 households, and 5,463 families resided in the city.", "The population density was 1,320.4 people per square mile (509.8/km\u00b2).", "The 9,865 housing units averaged 516.2 per square mile (199.3/km\u00b2).", "The racial makeup of the city was 76.69% White, 5.31% African American, 0.59% Native American, 0.63% Asian, 0.02% Pacific Islander, 14.41% from other races, and 2.35% from two or more races.", "Hispanics or Latinos of any race were 44.64% of the population.", "Of the 8,155 households, 32.8% had children under the age of 18 living with them, 48.3% were married couples living together, 14.1% had a female householder with no husband present, and 33.0% were not families." ] ], "gold": "According to the 1990 census, Big Spring, Texas had a population of 23,093. 10 years later, in 2000, the census showed 25,233, in 2010 it was 27,282 and in 2018, 28,162. ", "prediction 1": "In the city of Big Spring, Texas, the population was 25,233 at the 2000 census, 25,238 at the 2000 census, and 25,282 at the 2010 census. The population density was 1,320.4 people per square mile (509.8/km2).", "prediction 2": "The population of Big Spring, Texas, United States, as of the 2010 census was 27,282.", "prediction 3": "The population of Big Spring, Texas, was 25,233 at the 2000 census. As of the 2010 census, the population was 27,282.", "prediction 4": "Big Spring, Texas is a city in and the county seat of Howard County, Texas, United States, at the crossroads of U.S. Highway 87 and Interstate 20. With a population of 27,282 as of the 2010 census, it is the largest city between Midland to the west, Abilene to the east, Lubbock to the north, and San Angelo to the south.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 208 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 107, "end": 137 }, { "error type": "Redundant", "explanation": "the population was 25,233 at the 2000 census, ", "start": 80, "end": 106 } ], "missing-info": [], "corrected-prediction": "In the city of Big Spring, Texas, the population was 25,233 at the 2000 census and 27,282 at the 2010 census. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did jane and chris win the olympics?", "passages": [ [ "Torvill and Dean", "Torvill and Dean\n\nTorvill and Dean (Jayne Torvill and Christopher Dean) are British ice dancers and British, European, Olympic and World champions.", "At the Sarajevo 1984 Winter Olympics the pair won gold and became the highest scoring figure skaters of all time (for a single programme) receiving twelve perfect 6.0s and six 5.9s which included artistic impression scores of 6.0 from every judge, after skating to Maurice Ravel's \"Bol\u00e9ro\".", "Their performance was watched by a British television audience of more than 24 million people.", "The pair turned professional following the 1984 World Championships, regaining amateur status briefly ten years later in 1994 to compete in the Olympics once again.", "The pair retired from competitive skating for good in 1998 when they toured one last time with their own show, \"Ice Adventures\", before rejoining \"Stars on Ice\" for one more season.", "Their final routine was performed to Paul Simon's \"Still Crazy After All These Years\", a routine they had devised a few years earlier for competition.", "Although remaining close friends, the pair did not skate together again until they were enticed out of retirement to take part in ITV's \"Dancing on Ice\".", "Both are from Nottingham, England, where the local National Ice Centre is accessed through a public area known as Bolero Square, in honour of the pair's Olympic achievements." ], [ "Torvill and Dean", "He then lifts his one leg back with Torvill held horizontal across his body as he completes the lift gliding forward on one leg.", "The obvious difficulty and stunning symmetry of the lift made it quite a show stopper, and they can be seen to repeat the lift during the 1993 \"Skates of Gold Exhibition\" in Boston USA when they take to the ice with their peers from their amateur period: Marina Klimova & Sergei Ponomarenko, and Natalia Bestemianova and Andrei Bukin.", "Dean and Torvill showed that the years have done nothing to detract from their skill, strength and balance when they incorporated the same lift into a re-worked version of Bolero for the 2007 series of \"Dancing on Ice\".", "Encounter runs at over six minutes and was for Torvill and Dean their most enduring professional performance, winning them the World Professional Championships in 1984 and known to be used as performance piece until 1987.", "They resurrected the piece in 1994 to win at the World Team Championships.", "It is last known to have been performed at Wembley for the Face the Music World Tour filmed in June 1995.", "The theme of the piece involves two people who walk past each other in the street, notice each other, do a double take, and instantly fall in love.", "What follows is a brief encounter of two people very much in love but destined to be apart." ], [ "Torvill and Dean", "They choreographed, as a team, for other ice dancers and skaters, particularly the Canadian brother\u2013sister team Isabelle and Paul Duchesnay, who skated for France at the Albertville 1992 Winter Olympics, taking the silver medal with their \"West Side Story\" routine.", "After ten years as professionals, Torvill and Dean decided to return to the amateur arena for the 1994 Olympics in Lillehammer, Norway (along with other great skaters of the 1980s, such as Brian Boitano and Katarina Witt, following a change in eligibility rules).", "The couple moved to Hamar, Norway, in 1993 in order to practise at the Hamar Olympic Amphitheatre which hosted the figure skating events.", "Their free dance was designed to re-establish some of the ideas about ice dance which they themselves had been instrumental in dismantling; \"Let's Face The Music and Dance\" had no swooning lovers, theatrical accessories, or strong ideological message; instead, the emphasis was upon pure, light-hearted dance in the Astaire and Rogers tradition.", "The routine did have one move, an assisted lift, which pushed the envelope of the rules, though they had danced the routine at the European Championships with no indication from the judges of any problems." ] ], "gold": "Jayne Torvill and Christopher Dean are English ice dancers and former British, European, Olympic, and World champions. Torvill and Dean won two Olympic medals. The team won the gold medal for figure skating at the 1984 Olympics at Sarajevo. Ten years later, during the 1994 Olympics at Lillehammer, Norway, they won the bronze medal.", "prediction 1": "Torvill and Dean are British ice dancers and British, European, Olympic and World champions. At the Sarajevo 1984 Winter Olympics the pair won gold and became the highest scoring figure skaters of all time (for a single programme) after skating to Maurice Ravel's Bol\u00e9ro. Torvill and Dean turned professional following the 1984 World Professional Championships, regaining amateur status briefly ten years later in 1994 to compete in the Olympics once again. Their most enduring professional performance was Encounter, which runs at over six minutes and was for Torvill and Dean's most enduring professional performance, winning them the World Team Championships. It was their most enduring professional performance, winning them the World Professional Championships in 1984 and known to be used as performance piece until 1987. However, it was resurrected the piece in 1994 to win at the World Team Championships. It was last known to have been", "prediction 2": "Torvill and Dean, also known as Torvill and Dean, are British ice dancers and British, European, Olympic and World champions. At the 1984 Winter Olympics the pair won gold and became the highest scoring figure skaters of all time after skating to Maurice Ravel's Bol\u00e9ro. They retired from competitive skating for good in 1998 when they toured one last time with their own show, Ice Adventures, before rejoining ITV's Dancing on Ice for one more season. Their final routine was performed to Paul Simon's Still Crazy After All These Years, a routine they had devised a routine they had devised a few years earlier for competition. They resurrected the piece in 1994 to win at the World Team Championships.", "prediction 3": "Torvill and Dean (Jayne Torvill and Christopher Dean) are British ice dancers and British, European, Olympic and World champions. They won the gold medal at the 1984 Winter Olympics in Sarajevo. They re-won the professional championships in 1984, regaining amateur status briefly ten years later in 1994 to compete in the Olympics once again. Their most enduring professional performance was called Encounter, running at over six minutes and was for Torvill and Dean their most enduring professional performance, winning the World Professional Championships in 1984 and known to be used as performance piece until 1987. They re-worked the piece in 1994 to win at the World Team Championships. The piece was last known to have been performed at Wembley for the Face the Music World Tour filmed in June 1995.", "prediction 4": "At the 1984 Winter Olympics, the British ice dancers, Jayne Torvill and Christopher Dean, won gold in the pair's competition, Encounter, for which they devised the music, and their performance was televised for a global audience of over 24 million people. They retired from competitive skating for good in 1998 when they toured one last time with their own show, Ice Adventures, before rejoining \"Stars on Ice\" for one more season. They resurrected the piece in 1994 to win at the World Team Championships.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 413 }, { "error type": "Irrelevant", "explanation": "", "start": 458, "end": 579 }, { "error type": "Redundant", "explanation": "Their most enduring professional performance was Encounter, which runs at over six minutes and was for Torvill and Dean's ", "start": 580, "end": 619 }, { "error type": "Irrelevant", "explanation": "", "start": 620, "end": 662 }, { "error type": "Redundant", "explanation": "Their most enduring professional performance was Encounter, which runs at over six minutes and was for Torvill and Dean's most enduring professional performance, winning them the World Team Championships. ", "start": 663, "end": 773 }, { "error type": "Irrelevant", "explanation": "", "start": 774, "end": 827 }, { "error type": "Irrelevant", "explanation": "", "start": 828, "end": 913 }, { "error type": "Irrelevant", "explanation": "", "start": 914, "end": 944 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Torvill and Dean are British ice dancers and British, European, Olympic and World champions. At the Sarajevo 1984 Winter Olympics the pair won gold. They attended the 1994 Olympics in Lillehammer, Norway." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who ends up with the money in prison break?", "passages": [], "gold": "Nobody is in possession of the money at the end of Prison Break; however, Bill King was the last person to have it. ", "prediction 1": "Who ends up with the money in prison break?", "prediction 2": "The guy who ends up with the money in prison break is the one who ends up with the ad money.", "prediction 3": "The end up with the money in prison break is you.", "prediction 4": "The prison breaker who ends up with the money is the one who ends up with the money in prison break.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 43 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who wrote the girl who played with fire?", "passages": [ [ "The Girl Who Played with Fire (film)", "The Girl Who Played with Fire (film)\n\n", "The Girl Who Played with Fire () is a 2009 Swedish thriller film directed by Daniel Alfredson, and the sequel to \"The Girl with the Dragon Tattoo\".", "It is based on the best-selling novel of the same name by the late Swedish author and journalist Stieg Larsson, the second in his \"Millennium\" series.", "The film follows Lisbeth Salander as she returns to Sweden after spending a year abroad.", "She falls under suspicion of having murdered a journalist and his girlfriend as well as her own social services guardian, Nils Bjurman.", "Mikael Blomkvist has to do what he can to find her before the authorities do.", "Lisbeth Salander purchases an apartment in Stockholm.", "On returning to Sweden after nearly a year living abroad, Salander reconnects with her best friend and former partner Miriam Wu and offers her free use of her old apartment in return for forwarding her mail.", "Later, Salander confronts Nils Bjurman after hacking into his mail and discovering that he has an appointment booked with a tattoo removal specialist.", "Threatening him with his own gun, she warns him not to remove the tattoo that she etched on his abdomen.", "\"Millennium\" magazine welcomes Dag Svensson, a new journalist who is writing an expos\u00e9 on prostitution and human trafficking in Sweden." ], [ "Stieg Larsson", "It was titled for the English-language market as \"The Girl with the Dragon Tattoo\" and published in the United Kingdom in February 2008.", "It was awarded the Glass Key award as the best Nordic crime novel in 2005.", "His second novel, \"Flickan som lekte med elden\" (2006, \"The Girl Who Played with Fire\"), received the Best Swedish Crime Novel Award in 2006 and was published in the United Kingdom in January 2009.", "The third novel, \"Luftslottet som spr\u00e4ngdes\" (\"The Air Castle That was Blown Up\"), published in English as \"The Girl Who Kicked the Hornets' Nest\", was published in the United Kingdom in October 2009 and the United States in May 2010.", "Larsson left about three quarters of a fourth novel on a notebook computer, now possessed by his partner, Eva Gabrielsson: synopses or manuscripts of the fifth and sixth in the series, which he intended to comprise an eventual total of ten books, may also exist.", "Gabrielsson has stated in her book, \"\"There Are Things I Want You to Know\" About Stieg Larsson and Me\" (2011) that she is capable of finishing the book.", "In 2013, Swedish publisher Norstedts contracted David Lagercrantz, a Swedish author and journalist, to continue the \"Millennium\" series." ] ], "gold": "The Girl Who Played with Fire is the second novel in the best-selling Millennium series by Swedish writer Stieg Larsson. It was published posthumously in Swedish in 2006 and in English in January 2009. Also in 2009, a crime thriller film was released by the same name and was the sequel to The Girl with the Dragon Tattoo. The screenplay was written by Ulf Rydberg and the film was directed by Daniel Alfredson.", "prediction 1": "The Girl Who Played with Fire is a 2009 Swedish thriller film directed by Daniel Alfredson, and the sequel to \"The Girl with the Dragon Tattoo\". It is based on the best-selling novel of the same name by the late Swedish author and journalist Stieg Larsson, the second in his Millennium series. Larsson left about three quarters of a fourth novel on a notebook computer, now possessed by his partner, Eva Gabrielsson. Synopses or manuscripts of the fifth and sixth in the series, which he intended to comprise an eventual total of ten books, may also exist. In 2013, Swedish publisher Norstedts contracted David Lagercrantz, a Swedish author and journalist, to continue the Millennium series.", "prediction 2": "The Girl Who Played with Fire is a 2009 Swedish thriller film directed by Daniel Alfredson. It is based on the best-selling novel of the same name by the late Swedish author and journalist Stieg Larsson, the second in his Millennium series. Larsson left about three quarters of a fourth novel on a notebook computer, now possessed by his partner, Eva Gabrielsson.", "prediction 3": "Stieg Larsson wrote The Girl Who Played with Fire, which was published as The Girl with the Dragon Tattoo in February 2008. His second novel, flickan som lekte med elden, which received the Best Swedish Crime Novel Award in 2006, was published in the United Kingdom in January 2009. The third novel, Luftslottet som spr\u00e4ngdes (\"The Air Castle That was Blown Up\"), published in English as The Girl Who Kicked the Hornets' Nest, was published in October 2009, which was published in the United Kingdom in October 2009 and the United States in May 2010. Larsson left about three quarters of a fourth novel on a notebook computer, now possessed by his partner, Eva Gabrielsson, and synopsis or manuscripts of the fifth and sixth in the series.", "prediction 4": "The Girl Who Played with Fire is a 2009 Swedish thriller film directed by Daniel Alfredson, based on the best-selling novel of the same name by the late Swedish author and journalist Stieg Larsson, the second in his Millennium series. Larsson left about three quarters of a fourth novel on a notebook computer, now possessed by his partner, Eva Gabrielsson. In 2013, Swedish publisher Norstedts contracted David Lagercrantz, a Swedish author and journalist, to continue the Millennium series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 416 }, { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 556 }, { "error type": "Irrelevant", "explanation": "", "start": 557, "end": 691 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Girl Who Played with Fire is based on the best-selling novel of the same name by the late Swedish author and journalist Stieg Larsson, the second in his Millennium series. It was published posthumously in Swedish in 2006 and in English in January 2009. The Girl Who Played with Fire is a 2009 Swedish thriller film directed by Daniel Alfredson, and the sequel to \"The Girl with the Dragon Tattoo\".\n " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did season 3 of queen of the south start?", "passages": [ [ "Joshua John Miller", "The film starred Miller, Kirstie Alley, and Piper Laurie, and featured Miller's mother, Susan Bernard, in a brief, uncredited cameo.", "It toured the festival circuit, and garnered mixed reviews from critics.", "In December 2003, he completed his MFA in creative writing at the University of Iowa.", "He was awarded the Capote Fellowship, and was also chosen for the Houghton-Mifflin Fellowship Award.", "He has also written articles for \"Harper's Bazaar\", \"Playboy\", and \"Esquire\".", "In 2007, Miller appeared as Jinky in \"The Wizard of Gore\".", "He has written a second novel, titled \"Ash\".", "Miller collaborated with M.A. Fortin to write the DreamWorks TV and Fox production \"Howl\".", "Miller and Fortin then co-wrote the short film \"Dawn\" (2014), which was directed by actress Rose McGowan and premiered at the Sundance Film Festival.", "The two also co-wrote the screenplay and executive produced the 2015 horror comedy film \"The Final Girls\", directed by Todd Strauss-Schulson and starring Taissa Farmiga and Malin \u00c5kerman.", "Miller and Fortin wrote the pilot for the USA Network drama series \"Queen of the South\".", "Miller also serves as an executive producer for the series, which began airing on June 23, 2016." ], [ "Queen of the South (TV series)", "Queen of the South (TV series)\n\nQueen of the South is an American television crime drama series.", "It premiered on June 23, 2016, on USA Network and is an adaptation of the telenovela \"La Reina del Sur\", which airs on USA's sister network Telemundo, and is in turn is an adaptation of the novel of the same name by Spanish author Arturo P\u00e9rez-Reverte.", "On September 6, 2016, USA Network renewed the series for a second season which premiered June 8, 2017.", "On August 10, 2017, USA renewed the series for a third season, which premiered on June 21, 2018.", "On October 1, 2018, it was announced that the USA Network had renewed the series for a fourth season.", "\"Queen of the South\" first season received mixed to positive feedback from critics.", "On Rotten Tomatoes, it has a rating of 69%, based on 16 reviews.", "The site's consensus reads: \"\"Queen of the South\" enlivens an overdone premise with action and narrative vigor\u2014and shows hints of intriguing potential.\"", "On Metacritic, the first season scored 59 out of 100, based on 15 critics, indicating \"mixed or average reviews\".", "Internationally, the series premiered in Australia on Showcase on August 4, 2016.", "German TV channel DMAX is showing the series since June 14, 2017." ] ], "gold": "The 2016 crime drama TV series Queen of the South premiered its third season on June 21, 2018 at 9:00 pm ET. New episodes aired regularly at that time on Thursday nights for the remainder of the season.", "prediction 1": "Queen of the South is an American television crime drama series. It premiered on June 23, 2016, on USA Network and is an adaptation of the telenovela \"La Reina del Sur\", which airs on USA's sister network Telemundo, and is in turn is an adaptation of the novel of the same name by Spanish author Arturo P\u00e9rez-Reverte. On August 10, 2017, USA renewed the series for a third season, which premiered on June 21, 2018. On October 1, 2018, it was announced that the series had been renewed for a fourth season.\n", "prediction 2": "Queen of the South is an American television crime drama series. It premiered on June 23, 2016, on USA Network. The first season ended on July 1, 2017. On September 6, 2016, USA Network renewed the series for a second season which premiered June 8, 2017. On August 10, 2017, USA renewed the series for a third season, which premiered June 21, 2018.", "prediction 3": "Queen of the South is an American television crime drama series. It premiered on June 23, 2016, on USA Network. On August 10, 2017, USA renewed the series for a third season, which premiered on June 21, 2018. On October 1, 2018, it was announced that the USA Network had renewed the series for a fourth season.", "prediction 4": "Queen of the South is an American television crime drama series. It premiered on June 23, 2016, on USA Network and is an adaptation of the telenovela \"La Reina del Sur\", which airs on USA Network's sister network Telemundo, and is in turn an adaptation of the novel of the same name by Spanish author Arturo P\u00e9rez-Reverte. On August 10, 2017, USA renewed the series for a third season, which premiered on June 21, 2018. On October 1, 2018, it was announced that the series had been renewed for a fourth season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 349 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 506 } ], "missing-info": [], "corrected-prediction": "Queen of the South is a 2016 American television crime drama series, which premiered its third season on June 21, 2018.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does the 2017 tax plan take effect?", "passages": [ [ "Tax Cuts and Jobs Act of 2017", "The CBO estimates that implementing the Act would add an estimated $2.289trillion to the national debt over ten years, or about $1.891trillion after taking into account macroeconomic feedback effects, in addition to the $9.8trillion increase forecast under the current policy baseline and existing $20trillion national debt.", "The individual and pass-through tax cuts fade over time and become net tax increases starting in 2027 while the corporate tax cuts are permanent.", "This enabled the Senate to pass the bill with only 51 votes, without the need to defeat a filibuster, under the budget reconciliation process.", "The House passed the penultimate version of the bill on December 19, 2017, though for Senate procedural reasons small changes were needed and a revote was held in the House.", "The Senate passed the final version on December 20 in a 51\u201348 vote and that final version was passed by the House of Representatives on that same day.", "The bill was signed into law by President Donald Trump on December 22, 2017.", "Most of the changes introduced by the bill went into effect on January 1, 2018, and did not affect 2017 taxes." ] ], "gold": "The 2017 tax plan began to take effect on January 1, 2018, while the plan began to affect people on tax filing - April 17, 2018.", "prediction 1": "The tax plan signed into law by President Donald Trump took effect on December 22, 2017. Most of the changes introduced by the bill went into effect on January 1, 2018, and did not affect 2017 taxes.", "prediction 2": "The 2017 tax plan took effect on January 1, 2018, and most of the changes introduced by the bill went into effect on January 1, 2019.", "prediction 3": "The Tax Cuts and Jobs Act of 2017 went into effect on January 1, 2018, but the individual and pass-through tax cuts fade over time and become net tax increases starting in 2027 while the corporate tax cuts are permanent. The tax plan was signed into law by President Donald Trump on December 22, 2017.", "prediction 4": "The 2018 tax plan takes effect on January 1, 2018, and most of the changes introduced by the bill went into effect on January 1, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 88 } ], "missing-info": [], "corrected-prediction": "Most of the changes introduced by the tax plan bill went into effect on January 1, 2018, and did not affect 2017 taxes." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where does russia rank in the world economy?", "passages": [ [ "North America", "North America's GDP per capita was evaluated in October 2016 by the International Monetary Fund (IMF) to be $41,830, making it the richest continent in the world, followed by Oceania.", "Canada, Mexico, and the United States have significant and multifaceted economic systems.", "The United States has the largest economy of all three countries and in the world.", "In 2016, the U.S. had an estimated per capita gross domestic product (PPP) of $57,466 according to the World Bank, and is the most technologically developed economy of the three.", "The United States' services sector comprises 77% of the country's GDP (estimated in 2010), industry comprises 22% and agriculture comprises 1.2%.", "The U.S. economy is also the fastest growing economy in North America and the Americas as a whole, with the highest GDP per capita in the Americas as well.", "Canada shows significant growth in the sectors of services, mining and manufacturing.", "Canada's per capita GDP (PPP) was estimated at $44,656 and it had the 11th largest GDP (nominal) in 2014.", "Canada's services sector comprises 78% of the country's GDP (estimated in 2010), industry comprises 20% and agriculture comprises 2%." ], [ "Russia", "Russia has an upper-middle income mixed economy, \"World Bank\" with enormous natural resources, particularly oil and natural gas.", "It has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP).", "Since the turn of the 21st century, higher domestic consumption and greater political stability have bolstered economic growth in Russia.", "The country ended 2008 with its ninth straight year of growth, but growth has slowed with the decline in the price of oil and gas.", "Real GDP per capita, PPP (current international) was 19,840 in 2010.", "Growth was primarily driven by non-traded services and goods for the domestic market, as opposed to oil or mineral extraction and exports.", "The average nominal salary in Russia was $967 per month in early 2013, up from $80 in 2000.", "In May 2016 the average nominal monthly wages fell below $450 per month, and tax on the income of individuals is payable at the rate of 13% on most incomes.", "Approximately 19.2 million of Russians lived below the national poverty line in 2016, significantly up from 16.1 million in 2015.", "Unemployment in Russia was 5.4% in 2014, down from about 12.4% in 1999." ] ], "gold": "According to IMF and World Bank, Russia ranks 11th in the world economy. The United Nations ranks Russia as 12th in the world economy.", "prediction 1": "Russia has an upper-middle income mixed economy with enormous natural resources, particularly oil and natural gas. It has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP). Russia's economy is considered a high-income economy because of high levels of corruption.", "prediction 2": "Russia is the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP). The country has enormous natural resources, particularly oil and natural gas, and has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP).", "prediction 3": "Russia has an upper-middle income mixed economy with enormous natural resources, particularly oil and natural gas. It has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP). Since the turn of the 21st century, higher domestic consumption and greater political stability have bolstered economic growth in Russia.", "prediction 4": "The Russian economy is considered to be of average size by many. It has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 114 }, { "error type": "Unverifiable", "explanation": "", "start": 229, "end": 319 } ], "missing-info": [], "corrected-prediction": "Russia has the 12th largest economy in the world by nominal GDP and the 6th largest by purchasing power parity (PPP). " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "What u.s. president established the precedent of not seeking more than two terms in office?", "passages": [ [ "Term limits in the United States", "Washington wanted to retire when his first term ended in 1792 but all his advisors begged him to stand for reelection.", "By 1796 he insisted on retiring, for he felt worn out, and was disgusted with the virulent personal attacks on his integrity.", "His Farewell Address very briefly mentioned why he would not run for a third term, and goes on to give a great deal of political advice.", "But he does not mention of term limits .", "After his death his refusal to run was explained in terms of a \"no-third-tradition\".", "Historian David Crocket argues, \"The argument for term limits has a solid and respectable pedigree.", "Contrary to popular belief, however, that pedigree does not begin with George Washington.\"", "Politically Washington felt the stability of the republic required a contested presidential election with a choice of candidates, which would not happen if he ran again.", "If he won and then died a vice president would take over who was not elected and his goal would fail.", "(He in fact did die in 1799 two years into the new term).", "The election went forward and he was absolutely neutral between John Adams and Thomas Jefferson.", "He personally did not feel bound by a two-term limit.", "In the 1780s, about half the states provided term limits for governors.", "The Constitutional convention of 1787 discussed the issue and decided not to do so." ] ], "gold": "George Washington is sometimes given credit for establishing the precedent of not seeking more than two terms in office. Although, everything Washington did set a precedent, but not necessarily a policy. Washington did not seek reelection for the third term only because he was too worn out to run and wanted to retire. The president that did, in fact, establish the precedent for not seeking reelection for the third term was the 3rd president, Thomas Jefferson, when he refused to run for a third term in 1808.", "prediction 1": "In the United States, George Washington established the precedent for not seeking more than two terms in office.", "prediction 2": "President George Washington established the precedent of not seeking more than two terms in office. Washington personally did not feel bound by a two-term limit.", "prediction 3": "The U.S. president with the longest term was George Washington, who was elected in 1792. He wanted to retire when his first term ended in 1792 but all his advisors begged him to stand for reelection. By 1796 he insisted on retiring, for he felt worn out, and was disgusted with the virulent personal attacks on his integrity. After his death his refusal to run was explained in terms of a \"no-third-tradition\".", "prediction 4": "There is no precedent in the US for presidents not seeking more than two terms in office. George Washington established the precedent of not seeking more than two terms in office. George Washington was the first president to establish the precedent for not seeking more than two terms in office.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the United States, George Washington established the precedent for not seeking more than two terms in office. By 1796 Washington insisted on retiring, for he felt worn out, and was disgusted with the virulent personal attacks on his integrity." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who is rues mother in home and away?", "passages": [ [ "Home and Away", "Home and Away\n\nHome and Away (often abbreviated as H&A) is an Australian television soap opera.", "It was created by Alan Bateman and commenced broadcast on the Seven Network on 17 January 1988.", "Bateman came up with the concept of the show during a trip to Kangaroo Point, New South Wales, where he noticed locals were complaining about the construction of a foster home and against the idea of foster children from the city living in the area.", "The soap opera was initially going to be called \"Refuge\", but the name was changed to the \"friendlier\" title of \"Home and Away\" once production began.", "The show premiered with a ninety-minute pilot episode (subsequently in re-runs and on VHS known as \"Home and Away: The Movie\").", "Since then, each subsequent episode has aired for a duration of twenty-two minutes and \"Home and Away\" has become the second longest-running drama series in Australian television.", "In Australia, it is currently broadcast from Mondays to Thursdays at 7:00 pm.", "'", "Home and Away' follows the lives and loves of the residents in Summer Bay, a fictional seaside town of New South Wales." ], [ "Roo Stewart", "Roo Stewart\n\nRuth Martha \"Roo\" Stewart (also Morgan) is a fictional character from the Australian soap opera \"Home and Away\", played by Justine Clarke from 1988 to 1989.", "The character made her first screen appearance during the episode broadcast on 20 January 1988.", "Clarke quit the role in 1989 and the character was written out.", "In August 2010, it was announced that Roo would return to \"Home and Away\" with Georgie Parker in the role.", "The character returned on 29 October 2010.", "In 1987, Clarke auditioned for the roles of Carly Morris, Lynn Davenport and Bobby Simpson; but was unsuccessful each time.", "After the series had finished filming their pilot episode, producers changed their minds and invited Clarke to audition for the role of Roo, which she won.", "Clarke told a reporter from \"TV Life\" that she was \"really pleased\" because she thought Roo was a \"great character\".", "Roo's personality gained an unwelcome reception amongst viewers.", "Clarke said that \"everyone\" hated Roo and revealed that people would \"boo\" at her while attending promotional appearances.", "On one occasion Clarke had to leave a shopping centre because females were shouting \"slut\" at her.", "Clarke said that Roo is \"a cow\" but defended her because Roo ultimately ends up suffering." ], [ "Martha MacKenzie", "However, it was later confirmed she would be staying with the show and a spokesperson said, \"Jodi is looking forward, not backward, and is hard at work on the set of \"Home and Away\"\".", "Gordon was backed by her fellow cast members and fans of her character, who voiced their support for her.", "At the time Gordon was signed to appear in the serial for another two years after she had signed to a three-year contract.", "In January 2010, it was announced that Gordon had decided to leave the show.", "She asked Channel Seven to release her two years early from her contract.", "Producers and network executives had urged her to stay with the show because her character was popular with viewers.", "Gordon said, \"I've had a wonderful five years with Channel Seven and \"Home and Away\"\u2014it's been an amazing experience to be a part of this incredible show.", "I've learnt so much.\"", "Gordon filmed her final scenes at the end of February.", "Fellow Actor Ray Meagher who plays Martha's grandfather Alf Stewart backed her decision to leave the show, but said he was sad that his character would be left on-screen without any blood relatives.", "Channel Seven described Martha as being \"Friendly, straight down the line, and with a great enthusiasm for life\", and \"Jetstar\" magazine called Martha \"a feisty addition to the Stewart family\"." ] ], "gold": "In the Australian television soap opera, Home and Away, the fictional character Martha Stewart is Ruth \"Roo\" Stewart's mother. Martha Stewart was played by actress Alison Mulvaney in 1989 when the character was introduced to the show, through flashbacks, as Alf Stewart's first wife. In 2018, Sue Belinda Giblin started playing the role of Martha Stewart.", "prediction 1": "In the Australian television soap opera, Home and Away, Ruth Martha \"Roo\" Stewart is played by Justine Clarke from 1988 to 1989. The character made her first screen appearance during the episode broadcast on 20 January 1988. Clarke quit the role in 1989, and the character was written out. In August 2010, it was announced that Roo would return to Home and Away with Georgie Parker in the role. The character returned on 29 October 2010.", "prediction 2": "Home and Away is an Australian television soap opera that follows the lives and loves of the residents of Summer Bay, a fictional seaside town of New South Wales. In 1987, Martha \"Roo\" Stewart was played by Justine Clarke. In 1989, he was played by Ray Meagher. In 2010, Georgie Parker played Roo.", "prediction 3": "\"Home and Away\" is an Australian television soap opera created by Alan Bateman and commenced broadcast on the Seven Network on 17 January 1988. In 1987, Justine Clarke played the role of Roo Stewart, who is a fictional character from the show. In 1989, Justine Clarke played the role of Ruth \"Roo\" Stewart, also known as Martha \"Roo\" MacKenzie.", "prediction 4": "Martha \"Roo\" Stewart is a fictional character in the Australian television soap opera Home and Away, played by Justine Clarke from 1988 to 1989. The character made her first screen appearance during the episode broadcast on 20 January 1988. The character is portrayed by Georgie Parker from August 2010 to October 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 289 } ], "missing-info": [], "corrected-prediction": "In the Australian television soap opera, Home and Away, Ruth Martha \"Roo\" Stewart is played by Justine Clarke from 1988 to 1989. In August 2010, it was announced that Roo would return to Home and Away with Georgie Parker in the role. The character returned on 29 October 2010." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the killer in the original scream movie?", "passages": [ [ "Scream (1996 film)", "Williamson had attached five-page proposals for potential sequels to \"Scream\" when he originally sold the script, hoping to entice prospective buyers into buying a film and a franchise.", "When Dimension Films bought the script, they secured Williamson for two future \"Scream\" films, should the original prove successful.", "After a highly positive test screening of \"Scream\" at which executives from Dimension Films and Miramax were present, Craven was signed to direct the two future sequels.", "After the film's box office and critical success, the first sequel was greenlit and sent into production while \"Scream\" was still in theaters.", "The second picture was given an increased budget.", "The surviving cast\u2014Campbell, Cox, Arquette, Kennedy, and Schreiber\u2014all returned, as well as much of the original crew, including editor Patrick Lussier and composer Marco Beltrami.", "A third film followed shortly after, again with the crew and surviving cast returning to create what was, at the time, the concluding film in the \"Scream\" trilogy.", "The three original films, released in a five-year period, followed the story of Sidney Prescott's encounters with a succession of killers adopting the Ghostface disguise.", "The films also analyze her relationship with her deceased mother, who inadvertently initiates the events depicted in the films." ], [ "Ghostface (character)", "Ghostface (character)\n\nGhostface (alternatively stylized as Ghost Face or GhostFace) is a fictional identity adopted by several characters of the \"Scream\" series.", "The character is primarily mute but voiced by Roger L. Jackson, regardless of who is behind the mask.", "The character first appeared in \"Scream\" (1996) as a disguise used by teenagers Billy Loomis (Skeet Ulrich) and Stu Macher (Matthew Lillard), during their killing spree in the fictional town of Woodsboro.", "Ghostface was created by Wes Craven and Kevin Williamson.", "The mask is inspired by \"The Scream\" painting by Edvard Munch and was created and designed by Fun World costume company employee Brigitte Sleiertin as a Halloween costume, prior to being discovered by Marianne Maddalena and Craven for the film.", "The character is used primarily as a disguise for each of the antagonists of each film to conceal their identity, while conducting serial murders and as such has been portrayed by several actors.", "In \"Scream\", the identity is temporarily adopted by the killers' target, Sidney Prescott (Neve Campbell), using it against them.", "In the \"Scream\" universe, the costume is not unique and is easily obtainable, allowing others to wear a similar outfit.", "Ghostface often calls its targets to taunt or threaten them while using a voice changer that hides its true identity." ] ], "gold": "The killer, Ghostface, in the original Scream movie was played by characters Billy Loomis and Stu Macher, who in real life are Skeet Ulrich and Matthew Lillard, respectively.", "prediction 1": "Ghostface is a fictional identity used by several characters of the Scream series. The character is primarily mute but voiced by Roger L. Jackson, regardless of who is behind the mask. The character first appeared in \"Scream\" (1996) as a disguise used by teenagers Billy Loomis and Stu Macher, during their killing spree in the fictional town of Woodsboro. In the original Scream movie, the identity is temporarily adopted by the killers' target, Sidney Prescott, played by Neve Campbell, using the mask against them. The third film is the ending of the Scream trilogy, with Billy Loomis as the target, while the Killer.", "prediction 2": "In the original Scream movie, Billy Loomis is the killer and Stu Macher the assassin. In the original Scream movie, Neve Campbell plays the victim. In the original Scream movie, the killer is Billy Loomis, played by Skeet Ulrich and Matthew Lillard. In the original Scream movie, the killer is Billy Loomis, played by Skeet Ulrich and Matthew Lillard. The character Ghostface is a fictional identity adopted by several characters of the Scream series.", "prediction 3": "Ghostface is a fictional character who appears in the Scream franchise as a disguise used by teenagers Billy Loomis and Stu Macher during their killing spree in the fictional town of Woodsboro. The character was created by Wes Craven and Kevin Williamson and was primarily mute, but voiced by Roger L. Jackson, regardless of who is behind the mask.", "prediction 4": "Ghostface is a fictional character that appears in the 3 original Scream films. The character was created by Wes Craven and Kevin Williamson in 1996 and first appeared in Scream. Skeet Ulrich plays the killer and Matthew Lillard is the victim. Neve Campbell plays the victim.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 10, "end": 41 }, { "error type": "Irrelevant", "explanation": "", "start": 357, "end": 517 }, { "error type": "Irrelevant", "explanation": "", "start": 518, "end": 620 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Ghostface is a character first appeared in \"Scream\" (1996) as a disguise used by teenagers Billy Loomis (Skeet Ulrich) and Stu Macher (Matthew Lillard), during their killing spree in the fictional town of Woodsboro." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did a/c first appear in homes?", "passages": [ [ "Air conditioning", "The controlled temperature and humidity helped maintain consistent paper dimensions and ink alignment.", "Later, Carrier's technology was applied to increase productivity in the workplace, and The Carrier Air Conditioning Company of America was formed to meet rising demand.", "Over time, air conditioning came to be used to improve comfort in homes and automobiles as well.", "Residential sales expanded dramatically in the 1950s.", "In 1906, Stuart W. Cramer of Charlotte was exploring ways to add moisture to the air in his textile mill.", "Cramer coined the term \"air conditioning\", using it in a patent claim he filed that year as an analogue to \"water conditioning\", then a well-known process for making textiles easier to process.", "He combined moisture with ventilation to \"condition\" and change the air in the factories, controlling the humidity so necessary in textile plants.", "Willis Carrier adopted the term and incorporated it into the name of his company.", "Shortly thereafter, the first private home to have air conditioning was built in Minneapolis in 1914, owned by Charles Gates.", "Realizing that air conditioning would one day be a standard feature of private homes, particularly in regions with warmer climate, David St. Pierre DuBose (1898-1994) designed a network of ductwork and vents for his home \"Meadowmont\", all disguised behind intricate and attractive Georgian-style open moldings.", "This building is believed to be one of the first private homes in the United States equipped for central air conditioning." ], [ "Air conditioning", "He wrote: \"Fresh meat frozen and packed as if for a voyage, so that the refrigerating process may be continued for any required period\", and in 1873 prepared the sailing ship \"Norfolk\" for an experimental beef shipment to the United Kingdom.", "His choice of a cold room system instead of installing a refrigeration system upon the ship itself proved disastrous when the ice was consumed faster than expected.", "In 1902, the first modern electrical air conditioning unit was invented by Willis Carrier in Buffalo, New York.", "After graduating from Cornell University, Carrier found a job at the Buffalo Forge Company.", "There, he began experimenting with air conditioning as a way to solve an application problem for the Sackett-Wilhelms Lithographing and Publishing Company in Brooklyn, New York.", "The first air conditioner, designed and built in Buffalo by Carrier, began working on 17 July 1902.", "Designed to improve manufacturing process control in a printing plant, Carrier's invention controlled not only temperature but also humidity.", "Carrier used his knowledge of the heating of objects with steam and reversed the process.", "Instead of sending air through hot coils, he sent it through cold coils (filled with cold water).", "The air was cooled, and thereby the amount of moisture in the air could be controlled, which in turn made the humidity in the room controllable." ] ], "gold": "The first a/c unit appeared in a house in 1914, but did not become popular until the 1950s.", "prediction 1": "In 1906, Stuart W. Cramer of Charlotte was exploring ways to add moisture to the air in his textile mill. Cramer coined the term \"air conditioning\", using it in a patent claim he filed that year as an analogue to \"water conditioning\", then a well-known process for making textiles easier to process. In 1902, the first modern electrical air conditioning unit was invented by Willis Carrier in Buffalo, New York. In 1909, the first indoor air conditioner, designed and built in Buffalo by Carrier, New York, began working on 17 July 1909. The first home to have air conditioning was built in Minneapolis in 1913, and is believed to be one of the first private homes in the United States equipped for central air conditioning. The first private home to have air conditioning was built in Minneapolis in 1914, Minnesota in 1914, owned by Charles Gates. In 1914, the first private home to have air conditioning", "prediction 2": "In 1906, Stuart W. Cramer of Charlotte was exploring ways to add moisture to the air in his textile mill. Cramer coined the term \"air conditioning\", using it in a patent claim he filed that year as an analogue to \"water conditioning\", then a well-known process for making textiles easier to process. In 1902, the first modern electrical air conditioning unit was invented by Willis Carrier in Buffalo, New York. The first air conditioner, designed and built in Buffalo by Carrier, began working on 17 July 1902. The first modern electrical air conditioning unit was built in Minneapolis in 1914, Minnesota in 1914, Minnesota, owned by Charles Gates.", "prediction 3": "In 1906, Stuart W. Cramer of Charlotte was exploring ways to add moisture to the air in his textile mill. Cramer coined the term \"air conditioning\" using it in a patent claim he filed that year as an analogue to \"water conditioning\", then a well-known process for making textiles easier to process. Shortly thereafter, the first private home to have air conditioning was built in Minneapolis in 1914, owned by Charles Gates. In 1902, the first modern electrical air conditioning unit was invented by Willis Carrier in Buffalo, New York. The first air conditioner, designed and built in Buffalo by Carrier, began working on 17 July 1902.", "prediction 4": "In the United States, the first air conditioning system was installed in a home on July 17, 1902. In the United States, the first air conditioning unit was installed in a home in New York on July 17, 1902.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 411 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 415, "end": 420 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 532, "end": 537 }, { "error type": "Irrelevant", "explanation": "", "start": 421, "end": 531 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 606, "end": 611 }, { "error type": "Redundant", "explanation": " The first home to have air conditioning was built in Minneapolis in 1913, and is believed to be one of the first private homes in the United States equipped for central air conditioning. ", "start": 725, "end": 849 }, { "error type": "Redundant", "explanation": "The first private home to have air conditioning was built in Minneapolis in 1914, ", "start": 850, "end": 906 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The first private home to have air conditioning was built in Minneapolis in 1914. Residential sales expanded dramatically in the 1950s." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When did the singer of alice in chains die?", "passages": [ [ "William DuVall", "CWTF began touring as both the opening band and as part of Jerry Cantrell's solo band for his \"Degradation Trip\" tours in 2001 and 2002.", "Follow up releases: \"Live 2002\" CD, companion to their \"Live Underground 2002\" DVD; \"The Reckoning\" EP in 2006 and \"Beyond the Last Light\" CD in 2007.", "CWTF's entire catalog was produced by William's DVL Recordings label.", "In early 2000, DuVall met Alice in Chains guitarist/vocalist Jerry Cantrell in Los Angeles through a mutual acquaintance who introduced Cantrell to Comes with the Fall's self-titled first album.", "Cantrell started hanging out with the band and occasionally joining them onstage.", "The following year, Comes with the Fall was both the opening act on Cantrell's tour for his second solo album, \"Degradation Trip\", and also the singer's backing band, with DuVall singing Staley's parts at the concerts from 2001 to 2002.", "DuVall joined Alice in Chains as lead singer during the band's reunion concerts in 2006, and made his first public performance with the band at VH1's \"Decades Rock Live\" concert honoring Heart, in which he sang Alice in Chains' \"Rooster\".", "According to Cantrell, it only took one audition for DuVall to get the gig." ], [ "Layne Staley", "In 2010, in an interview on VH1's \"Celebrity Rehab\" with Staley's mother, Nancy McCallum, former Alice in Chains bass player Mike Starr said that he spent time with Staley the day before he died, as Starr's birthday was on April 4, 2002.", "Starr claimed that Staley was very sick but would not call 911.", "The ex-bandmates briefly argued, which ended with Starr storming out.", "Starr stated that Staley called after him as he left: \"Not like this, don't leave like this\".", "Since Staley is believed to have died a day later, on April 5, Starr expressed regret that he did not call 911 to save his friend's life; Starr reported that Staley had threatened to sever their friendship if he did.", "Starr was the last known person to see Staley alive.", "\"I wish I hadn't been high on benzodiazepine", "[that night], I wouldn't have just walked out the door\", Starr said.", "The interview ended with Starr apologizing to McCallum for not calling 911, but McCallum was insistent that neither she nor anyone in her family blamed Starr for Staley's death.", "She also told Starr: \"Layne would forgive you.", "He'd say, 'Hey, I did this.", "Not you.'\"" ] ], "gold": "The band Alice in Chains has had a few members die over the years. Layne Staley died on April 5, 2002. And, Mike Starr died on March 8, 2011.", "prediction 1": "Layne Staley, the singer of Alice in Chains, died on April 5, 2002. He was reportedly found dead in his home at a hotel in Huntington Beach, California. The band's drummer Mike Starr, who was also the bass player for the band, told a fan that he spent time with Staley the day before he died. Staley is believed to have died a day later, on April 5, 2002.", "prediction 2": "Layne Staley is the lead singer of the alternative rock band Alice in Chains. The singer is believed to have died on April 5, 2002, the day after Mike Starr said that he spent time with Staley the day before he died. However, Starr expressed regret that he did not call 911 to save his friend's life, and reported that Staley had threatened to sever their friendship if he did. Starr was the last known person to see Staley alive.", "prediction 3": "Layne Staley, the singer of Alice in Chains, is believed to have died on April 5, 2002. Former Alice in Chains bass player Mike Starr said that he spent time with Staley the day before he died, as Starr's birthday was on April 4, 2002. Starr expressed regret that he did not call 911 to save his friend's life.", "prediction 4": "Layne Staley, the lead singer of Alice in Chains died on April 5, 2002. According to the American singer's family he died on April 5, 2002.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 68, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 292 }, { "error type": "Unverifiable", "explanation": "", "start": 293, "end": 355 } ], "missing-info": [], "corrected-prediction": "Layne Staley, the singer of Alice in Chains, died on April 5, 2002. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many african-american head coaches in the nfl?", "passages": [ [ "2016 Cincinnati Bengals season", "2016 Cincinnati Bengals season\n\nThe 2016 Cincinnati Bengals season was the franchise's 47th season in the National Football League, the 49th overall and the fourteenth under head coach Marvin Lewis.", "The Bengals regressed from their 12\u20134 record from 2015, and missed the playoffs for the first time since 2010, finishing 6\u20139\u20131, and finishing in 3rd place in their division.", "This season would see the Bengals play in London for the first time ever, where they tied the Washington Redskins 27\u201327.", "On January 12, 2016, defensive backs coach Vance Joseph was hired as the new defensive coordinator of the Miami Dolphins.", "On the same day, linebackers coach Matt Burke also was hired as the new linebackers coach of the Miami Dolphins.", "On January 13, offensive coordinator Hue Jackson was hired as the new head coach of the Cleveland Browns.", "On January 15, quarterbacks coach Ken Zampese was promoted to offensive coordinator.", "On the same day, former New Orleans Saints head coach Jim Haslett was hired as the new linebackers coach.", "On January 18, the Bengals hired former Miami Dolphins assistant coaches Bill Lazor as the new quarterbacks coach, and Kevin Coyle as the new defensive backs coach, as well as hiring Washington Redskins assistant coach Jacob Burney as the new defensive line coach." ] ], "gold": "Before 1979, the NFL had 1 African American head coach. In 1979, there were 2 African American head coaches. Then, in 2003, there were 3 African American head coaches in the NFL.", "prediction 1": "There are currently 8 African-American head coaches in the National Football League. In the 2016 season, the Bengals hired Marvin Lewis as their head coach. In 2017, there were 8 African-American head coaches in the NFL. In 2018, there were 7 African-American head coaches in the NFL.", "prediction 2": "There are 6 black head coaches in the National Football League. There have been 6 African-American head coaches in the nfl since the beginning of the nfl.", "prediction 3": "There are currently three african-american head coaches in the National Football League.", "prediction 4": "There are currently 451 head coaches in the National Football League. Of those, there have been 59 african-american coaches, with 3 head coaches from Puerto Rico and 2 from Nigeria. There are 5 head coaches from Haiti and 1 from Nigeria. There have also been 3 head coaches from South Africa and 1 from South Africa.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 84 }, { "error type": "Unverifiable", "explanation": "", "start": 157, "end": 220 }, { "error type": "Unverifiable", "explanation": "", "start": 221, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 156 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who does andrea end up with in the devil wears prada?", "passages": [ [ "The Devil Wears Prada (film)", "Andy, repulsed, says she could never do that to anyone.", "Miranda replies that she already did, stepping over Emily when she agreed to go to Paris.", "When they stop, Andy gets out and throws her cell phone into the fountain of the Place de la Concorde, leaving Miranda, \"Runway\", and fashion behind.", "Some time later, Andy meets up with Nate, who is moving to Boston because he got a new job as the sous chef of a restaurant.", "They agree to start dating again and see what the future holds.", "The same day, Andy is interviewed and is accepted to work at a major New York publication company.", "The editor recounts how he called \"Runway\" for a reference on Andy, and got a response from Miranda herself.", "Miranda described Andy as \"her biggest disappointment\"- and said that the editor would be \"an idiot\" if he didn't hire her.", "Emily is offered her Paris wardrobe by Andy and the two leave on good terms.", "Andy passes the \"Runway\" office building and sees Miranda get into a car.", "Andy gives a wave, but Miranda does not acknowledge her.", "Andy is used to this and instead walks further into the crowd.", "Once inside the car, however, Miranda smiles and then orders her chauffeur to drive." ], [ "The Devil Wears Prada (novel)", "Afraid she has been blacklisted from publishing for good, she moves back with her parents.", "She works on short fiction and finances her unemployment with profits made from reselling the designer clothing she was provided for her Paris trip.", "\"Seventeen\" buys one of her stories.", "At the novel's end, she returns to the Elias-Clark building to discuss a position at one of the company's other magazines and sees Miranda's new junior assistant, who looks as harried and put-upon as she once did.", "Weisberger stated in publicity materials that Priestly's demands are partial fiction and a composite of actual experiences she and her friends had in their first jobs.", "Some reviewers state that Anna Wintour, editor-in-chief of \"Vogue\", was the inspiration for Priestly.", "After the film was released, another one of Wintour's assistants was identified as the model for Emily." ], [ "The Devil Wears Prada (novel)", "She promises to place phone calls to people she knows at the \"New Yorker\" on Andrea's behalf once her year is up and suggests she take on some small writing assignments at \"Runway\".", "Back at the hotel, Andrea gets urgent calls from Alex and her parents asking her to call them.", "She does and learns that Lily is comatose after driving drunk and wrecking a car.", "Though her family and Alex pressure her to return home, she tells Miranda she will honor her commitment to \"Runway\".", "Miranda is pleased, and says her future in magazine publishing is bright, but phones with another impossible demand at Christian Dior's Paris fashion show.", "Andrea decides that her family and friends are more important than her job, and realizes to her horror that she is becoming more and more like Miranda.", "She refuses to comply with Miranda's latest outrageous request, and when Miranda scolds her publicly, Andrea replies, \"Fuck you, Miranda.", "\"Fuck you\".\"", "She is fired on the spot, and returns home to reconnect with friends and family.", "Her romantic relationship with Alex is beyond repair, but they remain friends.", "Lily recovers and is lucky to receive only community service for her DUI charge.", "In the last chapter Andrea learns her dispute with Miranda made her a minor celebrity when the incident made \"\"Page Six\"\"." ] ], "gold": "In the 2006 Devil Wears Prada film based on the novel of the same name by Lauren Weisberger, the end of the movie shows Andrea, also known as Andy, meeting up with her boyfriend Nate and apologizing. They eventually reconcile as Nate found a new job as a sous chef in Boston. That same day, Andy is interviewed and accepted to work at a major New York publication company. In the Devil Wears Prada novel, Andrea's boyfriend is named Alex. At the end of the novel, her romantic relationship with Alex is beyond repair. Additionally, at the novel's end, Andrea returns to the Elias-Clark building to discuss a position at one of the company's other magazines, though the outcome of this is left uncertain.", "prediction 1": "Andrea is in a relationship with Alex in The Devil Wears Prada, a novel and a film based on the 1999 film. In the film, Andrea is a co-worker with Miranda Priestly and the novella is set in the same world. In the novel, Andrea is dating Nate, a sous chef at a restaurant in Boston.", "prediction 2": "In the film, The Devil Wears Prada, Andy is dating Miranda Priestly's assistant, Nate. In the novel, Andrea is dating Miranda's assistant, Emily Priestly. In the film, Andrea's relationship with Miranda is with Alex, the friend of Miranda's.", "prediction 3": "Andrea ends up with Alex in the Devil Wears Prada. Alex is the character Andrea's boyfriend in the film. In the novel, Andrea ends up with Miranda's assistant, a junior assistant, and a girl named Lily.", "prediction 4": "Andrea, in the movie The Devil Wears Prada, is dating an assistant to Miranda Priestly. In the novel, she is dating Alex, the model for Miranda's character in the film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 205 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 209, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 106 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Andrea is in a relationship with Alex in Weisberger's novel, The Devil Wears Prada. At the novel's end her romantic relationship with Alex is beyond repair, but they remain friends and she returns to the Elias-Clark building to discuss a position at one of the company's other magazines. In the film, Andrea meets up with Nate, who is moving to Boston because he got a new job as the sous chef of a restaurant. They agree to start dating again and see what the future holds. The same day, Andy is interviewed and is accepted to work at a major New York publication company. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the driver's license compact start?", "passages": [ [ "Driver License Compact", "Driver License Compact\n\nThe Driver License Compact is an agreement between states in the United States of America.", "The compact is used to exchange data between motorist's home state and a state where the motorist incurred a vehicular infraction.", "Not all states are members, and states respond to the data differently.", "Under the Driver License Compact, which is a series of laws within the adopting states in the United States and adopting provinces of Canada, in order for a driver's state to penalize him/her for an out-of-state offense, the driver's state must have the equivalent statute.", "If the driver's state does not have the statute, no action can be taken.", "For example, the state of Indiana does not have a careless driving offense whereas Colorado does.", "If an Indiana licensed driver gets convicted of careless driving in Colorado, the Indiana Bureau of Motor Vehicles takes no action.", "The Driver License Compact came into existence with Nevada becoming the first member in 1960.", "Organizations in the Western States such as governors came together to cooperate on traffic safety.", "Under the Beamer Resolution (\"Interstate Compacts for Highway Safety Resolution\"), Public Law 85-684, enacted on August 20, 1958, 72 Stat. 635 (named for Rep. John V. Beamer, R-Indiana), states were automatically given permission to form compacts in the areas of traffic safety." ] ], "gold": "The Driver License Compact is an agreement between states in the United States of America which is used to exchange data between motorist's home state and a state where the motorist incurred a vehicular infraction. Not all states are members, and states respond to the data differently. The Driver License Compact came into existence with Nevada becoming the first member in 1960. Under the Beamer Resolution, Public Law 85-684, enacted on August 20, 1958, 72 Stat. 635 states were automatically given permission to form compacts in the areas of traffic safety.", "prediction 1": "The Driver License Compact is an agreement between states in the United States of America. The compact is used to exchange data between motorist's home state and a state where the motorist incurred a vehicular infraction. Not all states are members, and states respond to the data differently. The Driver License Compact came into existence with Nevada becoming the first member in 1960.", "prediction 2": "The Driver License Compact is an agreement between states in the United States of America. It is used to exchange data between motorist's home state and a state where the motorist incurred a vehicular infraction. Not all states are members, and states respond to the data differently. The Driver License Compact came into existence with Nevada becoming the first member in 1960. Organizations in the Western States came together to cooperate on traffic safety.", "prediction 3": "The Driver License Compact is an agreement between states in the United States of America that is used to exchange data between a motorist's home state and a state where the motorist incurred a vehicular infraction. The compact is used to exchange data between the home state of the motorist and the state where the motorist incurred the violation. The Driver License Compact came into existence with Nevada becoming the first member in 1960. Organizations in the Western States such as governors came together to cooperate on traffic safety.", "prediction 4": "The Driver License Compact is a series of laws within the adopting states in the United States and adopting provinces of Canada that is used to exchange data between motorists home state and state where the motorist incurred a vehicular infraction. Under the Driver License Compact, which is a series of laws within the adopting states in the United States and adopting provinces of Canada, in order for a driver's state to penalize him/her for an out-of-state offense, the driver's state must have the equivalent statute. If the driver's state does not have the equivalent statute, no action can be taken.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Driver License Compact is an agreement between states in the United States of America. The compact is used to exchange data between motorist's home state and a state where the motorist incurred a vehicular infraction. Not all states are members, and states respond to the data differently. The Driver License Compact came into existence with Nevada becoming the first member in 1960. Under the Beamer Resolution (\"Interstate Compacts for Highway Safety Resolution\"), Public Law 85-684, enacted on August 20, 1958, 72 Stat. 635 (named for Rep. John V. Beamer, R-Indiana), states were automatically given permission to form compacts in the areas of traffic safety." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang the song these eyes are crying?", "passages": [ [ "These Eyes", "These Eyes\n\n\"These Eyes\" is a song by the Canadian rock band The Guess Who.", "The song was co-written by the group's lead guitarist Randy Bachman and lead singer Burton Cummings and originally included on the band's 1969 album \"Wheatfield Soul\".", "It was first released as a single (backed by \"Lightfoot\"), in their native Canada, where its chart success (#7), along with the influence of CKLW-AM Windsor's radio station music director Rosalie Trombley, helped land them a U.S. distribution deal with RCA Records.", "It was then released in the U.S.", "In March 1969, and became a breakthrough success for the group, as it would be their first single to reach the top ten on the \"Billboard\" Pop Singles chart, peaking at number six, and would eventually be certified gold by the RIAA for sales of over one million copies.", "While it was actually the 18th single released by the band, it was the first from the quartet of Cummings, Bachman, Jim Kale, and Garry Peterson as produced by Jack Richardson.", "Bachman had the original piano chords with an original title of \"These Arms\".", "Cummings changed the title to \"These Eyes\" and added the middle eight.", "The song features an orchestral arrangement by Ben McPeek." ] ], "gold": "The 1968 song, These Eyes, was sung by Canadian rock band, The Guess Who. Burton Cummings was lead singer for the band that performed the song.", "prediction 1": "\"These Eyes\" is a song by the Canadian rock band The Guess Who. The song was co-written by the group's lead guitarist Randy Bachman and lead singer Burton Cummings and originally included on the band's 1969 album Wheatfield Soul. It was first released as a single in their native Canada, where its chart success (#7), along with the influence of CKLW-AM Windsor's radio station music director Rosalie Trombley, helped land them a U.S. distribution deal with RCA Records. It was then released in the U.S. In March 1969, and became a breakthrough success for the group, as it would be their first single to reach the top ten on the Billboard Pop Singles chart, peaking at number six, and would eventually be certified gold by the RIAA for sales of over one million copies.\n", "prediction 2": "\"These Eyes\" is a song by the Canadian rock band The Guess Who. The song was co-written by the group's lead guitarist Randy Bachman and lead singer Burton Cummings and originally included on the band's 1969 album Wheatfield Soul. Cummings sang lead vocals on the song, while Bachman sang background vocals. The tour coverage of the track was not as good as one might expect, and some of the songs were not released until 2017.", "prediction 3": "\"These Eyes\" is a song by Canadian rock band The Guess Who. The song was co-written by the group's lead guitarist Randy Bachman and lead singer Burton Cummings and originally included on the band's 1969 album Wheatfield Soul. The song was first released as a single in their native Canada, where its chart success (#7), along with the influence of CKLW-AM Windsor's radio station music director Rosalie Trombley, helped land them a U.S. distribution deal with RCA Records. It was then released in the U.S. In March 1969, and became a breakthrough success for the group, as it would be their first single to reach the top ten on the Billboard Pop Singles chart, peaking at number six, and eventually be certified gold by the RIAA for sales of over one million copies.", "prediction 4": "\"These Eyes\" is a song by the Canadian rock band The Guess Who. The song was co-written by the group's lead guitarist Randy Bachman and lead singer Burton Cummings and originally included on the band's 1969 album Wheatfield Soul. It was first released as a single, backed by \"Lightfoot\", in their native Canada, and was a breakthrough success for them, as it would be their first single to reach the top ten on the \"Billboard\" Pop Singles chart, peaking at number six, and would eventually be certified gold by the RIAA for sales of over one million copies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 470 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 771 } ], "missing-info": [], "corrected-prediction": "\"These Eyes\" is a song by the Canadian rock band The Guess Who. Burton Cummings was lead singer for the band that performed the song.\n" }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who sang and danced singing in the rain?", "passages": [ [ "Singin' in the Rain (song)", "Singin' in the Rain (song)\n\n\"Singin' in the Rain\" is a song with lyrics by Arthur Freed and music by Nacio Herb Brown, published in 1929.", "The song is a centerpiece of the musical film of the same name, \"Singin' in the Rain\" (1952).", "It is unclear exactly when the song was written; it has been claimed that the song was performed as early as 1927.", "The song was listed as No. 3 on AFI's 100 Years...100 Songs.", "The song has an unusual form: the 32-bar chorus, rather than being preceded by a verse and containing an internal bridge as was becoming standard at the time, opens the song and then is followed by a 24-bar verse that has the feeling of a bridge before the chorus repeats.", "\"Singin' in the Rain\" was first performed by Doris Eaton Travis in the 1929 revue \"The Hollywood Music Box Revue\".", "The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical \"The Hollywood Revue of 1929\".", "B.A. Rolfe and his Lucky Strike Orchestra recorded the song possibly as early as 1928 but perhaps 1929." ] ], "gold": "\"Singin' in the Rain\" was first performed by Doris Eaton Travis in the 1929 revue \"The Hollywood Music Box Revue\". The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical \"The Hollywood Revue of 1929\". The song was recorded by Annette Hanshaw, and reissued on the 1999 CD \"Annette Hanshaw, Volume 6, 1929\".", "prediction 1": "\"Singin' in the Rain\" is a song with lyrics by Arthur Freed and music by Nacio Herb Brown, published in 1929. It is unclear exactly when the song was written, but it has been claimed that the song was performed as early as 1927. The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical \"The Hollywood Revue of 1929\".", "prediction 2": "\"Singin' in the Rain\" is a song with lyrics by Arthur Freed and music by Nacio Herb Brown, published in 1929. The song is a centerpiece of the musical film of the same name, \"Singin' in the Rain\" (1952). It is unclear exactly when the song was written; it has been claimed that the song was performed as early as 1927. Doris Eaton Travis sang and danced singing in the rain in the 1929 revue The Hollywood Music Box Revue. The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical The Hollywood Revue of 1929. B.A. Rolfe and his Lucky Strike Orchestra recorded the song possibly as early as 1928 but perhaps 1928.", "prediction 3": "\"Singin' in the Rain\" is a song with lyrics by Arthur Freed and music by Nacio Herb Brown, published in 1929. The song is a centerpiece of the musical film of the same name, \"Singin' in the Rain\" (1952). It is unclear exactly when the song was written; it has been claimed that the song was performed as early as 1927. \"Singin' in the Rain\" was first performed by Doris Eaton Travis in the 1929 revue \"The Hollywood Music Box Revue\". The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical \"The Hollywood Revue of 1929\". B.A. Rolfe and his Lucky Strike Orchestra recorded the song possibly as early as early as 1928 but perhaps as early as early as early as 1928.", "prediction 4": "Singin' in the Rain is a song with lyrics by Arthur Freed and music by Nacio Herb Brown, published in 1929. The song is a centerpiece of the musical film of the same name, Singin' in the Rain (1952). It is unclear exactly when the song was written; it has been claimed that the song was performed as early as 1927. The song was first performed by Doris Eaton Travis in the 1929 revue The Hollywood Music Box Revue. The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical The Hollywood Revue of 1929.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 228 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": " Singin' in the Rain\" was first performed by Doris Eaton Travis in the 1929 revue \"The Hollywood Music Box Revue\". The song became a hit and was recorded by a number of artists, notably Cliff Edwards, who also performed the number with the Brox Sisters in the early MGM musical \"The Hollywood Revue of 1929\"." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When is season 3 on fuller house coming out?", "passages": [ [ "Fuller House (TV series)", "Fuller House (TV series)\n\n", "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series, and is a sequel to the 1987\u20131995 television series \"Full House\".", "It centers around D.J. Tanner-Fuller, a veterinarian and widowed mother of three sons, whose sister Stephanie and best friend Kimmy\u2014along with her teenage daughter\u2014live together at the Tanners' childhood home in San Francisco, California.", "Most of the original series ensemble cast have reprised their roles on \"Fuller House\", either as regular cast members or in guest appearances, with the exception of Mary-Kate and Ashley Olsen, who alternated the role of Michelle Tanner in \"Full House.\"", "Netflix ordered an initial thirteen episodes which were released on February 26, 2016, worldwide.", "The third season is split into two parts, with the first half of nine episodes being released on September 22, 2017, and the second half on December 22, 2017.", "While the first season reception was generally negative, the second and third seasons received mostly positive reviews.", "On January 29, 2018, Netflix renewed \"Fuller House\" for a fourth season, which was released on December 14, 2018.", "Like the original series, the show is set in the same house in San Francisco, California.", "Recently widowed D.J." ], [ "Fuller House (TV series)", "On March 2, 2016, the series was renewed for a second season, and production for the second season began on May 5, 2016.", "Thirteen new episodes were ordered and were released on December 9, 2016.", "On December 24, 2016, the series was renewed for a third season, to be released in 2017.", "and On December 31, 2016, it was confirmed that the season was given an 18-episode order.", "Production for the third season began on March 18, 2017, and ended on September 2, 2017.", "It was announced on June 26, 2017 that the third season would be split into two parts, with the release of the first part on September 22, 2017 to consist of nine episodes.", "It was announced on November 13, 2017 that the second half, also consisting of nine episodes, would be released on December 22, 2017.", "On January 29, 2018, the series was renewed for a fourth season of thirteen episodes.", "The fourth season was released on December 14, 2018.", "In addition to Cameron Bure, Sweetin, and Barber reprising their roles, the other main roles went to Michael Campion, Elias Harger, and Soni Bringas, as their children: Jackson and Max Fuller, and Ramona Gibbler, respectively.", "It was disclosed that John Stamos would have a recurring role as Jesse Katsopolis and would also be producing." ] ], "gold": "Fuller House is an American family sitcom and sequel to the 1987\u201395 television series Full House, airing as a Netflix original series. During the course of the series, 75 episodes of Fuller House were released over five seasons, between February 26, 2016, and June 2, 2020. The first part of Season 3 came out on September 22, 2017. The second part of Season 3 came out on December 22, 2017.", "prediction 1": "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series and is a sequel to the 1987\u20131995 television series Full House. It centers around D.J. Tanner-Fuller, a veterinarian and widowed mother of three sons, whose sister Stephanie and best friend Kimmy\u2014along with her teenage daughter\u2014live together at the Tanners' childhood home in San Francisco, California. The third season was split into two parts, with the first half of nine episodes being released on September 22, 2017.", "prediction 2": "Season 3 of Fuller House, an American sitcom created by Jeff Franklin that airs as a Netflix original series, was released on December 24, 2016. Season 3 of Fuller House was renewed for a third season in 2016 and was released on December 14, 2018.", "prediction 3": "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series, and is a sequel to the 1987\u20131995 television series Full House. Season 3 came out in 2017.", "prediction 4": "Fuller House is an American sitcom created by Jeff Franklin that airs as a Netflix original series. It centers around D.J. Tanner-Fuller, a veterinarian and widowed mother of three sons, whose sister Stephanie and best friend Kimmy\u2014along with her teenage daughter\u2014live together at the Tanners' childhood home in San Francisco, California. The third season is split into two parts, with the first half of nine episodes being released on September 22, 2017 and the second half on December 22, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 59 }, { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 400 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Fuller House is an American sitcom that airs as a Netflix original series and is a sequel to the 1987\u20131995 television series Full House. The third season is split into two parts, with the first half of nine episodes being released on September 22, 2017, and the second half on December 22, 2017." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How many episodes are going to be in pll season 7?", "passages": [ [ "Pretty Little Liars (season 6)", "Pretty Little Liars (season 6)\n\nThe sixth season of the American mystery drama television series \"Pretty Little Liars\", based on the books of the same name by Sara Shepard, was renewed on June 10, 2014 for two additional seasons, making the show ABC Family's longest running original series.", "The sixth and seventh seasons will consist of 20 episodes each.", "It aired 10 episodes for the first half the season, which began airing on June 2, 2015.", "Filming for the sixth season began on March 24, 2015, which was confirmed by showrunner I. Marlene King on Twitter.", "The season premiere was written by I. Marlene King and Lijah J. Barasz and was directed by Chad Lowe.", "The title of the premiere, \"Game On, Charles\", was revealed by King after the fifth-season finale.", "It was previously said that the sixth season will not include a special holiday-themed episode between the first and second half of the season, which is set to air on January 12, 2016, however on October 9, 2015 at New York Comic Con it was announced that there would be a behind-the-scenes special.", "Previous holiday-themed episodes have been the thirteenth episode of each previous season excluding the first season." ] ], "gold": "The seventh and final season of the American mystery drama television series Pretty Little Liars, based on the books of the same name by Sara Shepard, consisted of 20 episodes. 10 episodes aired in the summer of 2016, and the remaining ten episodes aired in April 2017. The season premiered on June 21, 2016 and ended on June 27, 2017 on Freeform. ", "prediction 1": "Pretty Little Liars is an American comedy/drama television series based on the books of the same name by Sara Shepard. The seventh season will consist of 20 episodes each. It aired 10 episodes for the first half of the season, which began airing on June 2, 2015.", "prediction 2": "Pretty Little Liars is an American mystery television series based on the books of the same name by Sara Shepard. The episodes of the sixth season were 10, and the episodes of the seventh season were 19.", "prediction 3": "Pretty Little Liars will have 7 seasons, each consisting of 20 episodes. Season 7 will have 128 episodes, which is the same as season 7 and will have the same number of episodes as the seventh season.", "prediction 4": "Pretty Little Liars is an American mystery television series based on the books of the same name by Sara Shepard. It was renewed on June 10, 2014 for two additional seasons, making the show ABC Family's longest running original series. The seventh season will consist of 20 episodes each.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 166, "end": 171 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 172, "end": 262 } ], "missing-info": [], "corrected-prediction": "Pretty Little Liars is an American comedy/drama television series based on the books of the same name by Sara Shepard. The seventh season will consist of 20 episodes. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the dh rule start in baseball?", "passages": [ [ "Designated hitter", "In Major League Baseball, during interleague play, the application of the DH rule is determined by the identity of the home team, with the rules of the home team's league applying to both teams.", "If the game is played in an American League park, the designated hitter may be used; in a National League park, the pitcher must bat or else be replaced with a pinch-hitter.", "On June 12, 1997, San Francisco Giants outfielder Glenallen Hill became the first National League player to DH in a regular-season game, when the Giants met the American League's Texas Rangers at The Ballpark in Arlington in interleague play.", "At first, the DH rule was not applied to the World Series.", "From 1973 to 1975, all World Series games were played under National League rules, with no DH and pitchers batting.", "For 1976, it was decided the DH rule would apply to all games in a World Series, regardless of venue, but only in even-numbered years.", "Cincinnati Reds first baseman Dan Driessen became the first National League player to act as a DH in any capacity (regular season or postseason) when he was listed as the DH in the first game (he was the DH in all four Series games that year).", "This practice lasted through 1985.", "Beginning in 1986, the DH rule was used in games played in the stadium of the American League representative." ], [ "Designated hitter", "There was initially no DH in the All-Star Game.", "Beginning in 1989, the rule was applied only to games played in American League stadiums.", "During this era, if the All-Star Game was scheduled for an American League stadium, fans would vote in the DH for the American League's starting lineup, while the National League's manager decided that league's starting DH.", "Since 2010, the designated hitter has always been used by both teams regardless of where the game is played.", "In June 2010, the Philadelphia Phillies' scheduled 2010 series against the Toronto Blue Jays at Rogers Centre was moved to Philadelphia, because of security concerns for the G-20 Summit.", "The Blue Jays wore their home white uniforms and batted last as the home team, and the designated hitter was used.", "The game was the first occasion of the use of a designated hitter in a National League ballpark in a regular-season game with Ryan Howard being the first player to fill the role.", "In spring training games, the home team chooses whether the designated hitter is used.", "Occasionally National League teams opt to use the designated hitter, usually when a player is recovering from an injury.", "The rationale for the designated hitter rule arose comparatively early in the history of professional baseball." ], [ "Designated hitter", "The reason for the difference is that as players get closer to reaching the majors, teams prefer to have the rules mimic, as closely as possible, those of the major league teams for which the players may soon be playing.", "The DH is used in most professional baseball leagues around the world.", "One notable exception is the Central League of Japan, where pitchers bat as they do in the National League.", "Japan's Pacific League adopted the designated hitter in 1975.", "When teams from different leagues play against each other in the Japan Series or interleague games, the DH rule is adopted if the Pacific League's team hosts the game.", "The DH rule is used in the Japanese minor leagues.", "In American high schools and other amateur baseball leagues that use National Federation of State High School Associations (NFHS) rules, a DH may bat in place of one player in any position, not just a pitcher.", "Many coaches use a designated hitter in place of the weakest hitter in the lineup, if they use one at all.", "In amateur baseball, many pitchers are also good hitters and will often play another position (or even DH) when not pitching.", "Japanese high school baseball is one of the few amateur baseball leagues in the world that has never used the designated hitter rule at all.", "In high school baseball in South Korea, the rule has been adopted since 2004." ] ], "gold": "The American League regular season started using the Designated Hitter, or DH, rule in Major League Baseball in 1973. In 1976, it was decided that the DH rule would be used for all games in a World Series, in even-numbered years, then, in 1986, the rule was applied to World Series games that were played in an American League stadium. In 1989, the rule was applied to All-Star games played at American League stadiums, and in 2010 it was applied to every All-Star game, no matter where they were played. Japan's Pacific League started using the DH rule in 1975.", "prediction 1": "The designated hitter rule started in Major League Baseball during interleague play, with the application of the DH rule determined by the identity of the home team, with the rules of the home team's league applying to both teams. The rule first started in the All-Star Game in 1973. Beginning in 1989, the DH rule was used in games played in the stadium of the American League representative. The DH rule started in the Japanese minor leagues in 2010.", "prediction 2": "The designated hitter rule started in Major League Baseball on August 6, 1970. It started being used in the All-Star Game on August 6, 1973. It started being used during interleague play on September 5, 1977. Then, beginning in 1986, the DH rule was used in games played in the stadium of the American League representative.", "prediction 3": "In Major League Baseball, during interleague play, the application of the designated hitter rule is determined by the identity of the home team, with the rules of the home team's league applying to both teams. From 1973 to 1975, all World Series games were played under National League rules, with no designated hitter and pitchers batting. For 1986, the DH rule was applied only to games played in the stadium of the American League representative. Beginning in 2010, the designated hitter has always been used by both teams regardless of where the game is played.", "prediction 4": "The designated hitter rule, in baseball, was first introduced in the All-Star Game on June 12, 1974. With the introduction of the American League and the development of the National League, the designated hitter rule was adopted in the National League from 1986 to 2020. The DH rule was last used in Major League Baseball during interleague play in 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 60, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 230 }, { "error type": "Unverifiable", "explanation": "", "start": 240, "end": 253 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 297, "end": 302 }, { "error type": "Unverifiable", "explanation": "", "start": 444, "end": 452 }, { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 443 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "For 1976, it was decided the DH rule would apply to all games in a World Series, regardless of venue, but only in even-numbered years. Beginning in 1986, the DH rule was used in games played in the stadium of the American League representative. It also, in 1989, affected the All-Star Game in the American League stadiums. Since 2010, the designated hitter has always been used by both teams regardless of where the game is played. Japan's Pacific League adopted the designated hitter in 1975." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "U.s. army general who won several victories in the mexican-american war?", "passages": [ [ "Winfield Scott", "Scott remained in the Army after the war, served in several command positions, and carried out high level staff tasks, including frequent updates to the Army's field regulations.", "After missing out on appointment as the Army's commanding general in 1828, he received it in 1841; he served in this post until his retirement in 1861, shortly after the start of the American Civil War.", "Known as \"Old Fuss and Feathers\" and the \"Grand Old Man of the Army\", Scott was a national hero after the Mexican\u2013American War, where he led one of the two invading armies; he later served as occupying military governor of Mexico City.", "His stature was so high that in 1852, the Whig Party passed over its own incumbent President, Millard Fillmore to nominate Scott as their candidate in that year's presidential election.", "Scott lost to Democratic Party nominee Franklin Pierce in the general election, but remained a popular national figure, receiving a brevet promotion to lieutenant general in 1855, becoming the first American since George Washington to hold that higher rank.", "At the start of the Civil War, Scott took steps to defend the national capital city of Washington, D.C. and ensure the successful inauguration of Abraham Lincoln as the 16th president in March 1861." ], [ "Zachary Taylor", "Zachary Taylor\n\nZachary Taylor (November 24, 1784 \u2013 July 9, 1850) was the 12th President of the United States, serving from March 1849 until his death in July 1850.", "Taylor previously was a career officer in the United States Army, rose to the rank of major general and became a national hero as a result of his victories in the Mexican\u2013American War.", "As a result, he won election to the White House despite his vague political beliefs.", "His top priority as president was preserving the Union, but he died sixteen months into his term, before making any progress on the status of slavery, which had been inflaming tensions in Congress.", "Taylor was born into a prominent family of planters who migrated westward from Virginia to Kentucky in his youth.", "He was commissioned as an officer in the U.S. Army in 1808 and made a name for himself as a Captain in the War of 1812.", "He climbed the ranks establishing military forts along the Mississippi River and entered the Black Hawk War as a Colonel in 1832.", "His success in the Second Seminole War attracted national attention and earned him the nickname \"Old Rough and Ready\".", "In 1845, during the annexation of Texas, President James K. Polk dispatched Taylor to the Rio Grande in anticipation of a battle with Mexico over the disputed Texas\u2013Mexico border." ] ], "gold": "Winfield Scott, born in 1786, was the 3rd Commanding General of the United States Army, and won several victories in the Mexican-American War. He was known as Old Fuss and Feathers, and as \"The Grand Old Man of the Army\" for his many years of service. Another US Army General who won several victories in the Mexican-American War is the 13th President of the United States, Zachary Taylor, who was born in 1784.", "prediction 1": "Winfield Scott was a U.S. army general who won several victories in the Mexican-American War. He remained in the Army after the war, served in several command positions, and carried out high level staff tasks, including frequent updates to the Army's field regulations. Zachary Taylor was the 12th President of the United States, serving from March 1849 until his death in July 1850. Taylor previously was a career officer in the United States Army, rose to the rank of major general and became a national hero as a result of his victories in the Mexican\u2013American War.", "prediction 2": "Zachary Taylor, a U.S. army general who won several victories in the Mexican\u2013American War, was the 12th president of the United States, serving from March 1849 until his death in July 1850. Taylor previously was a career officer in the United States Army, rose to the rank of major general and became a national hero as a result of his victories in the Mexican\u2013American War.", "prediction 3": "Winfield Scott was a U.S. army general who won several victories in the Mexican-American War. He also remained in the Army after the war, served in several command positions, and carried out high level staff tasks, including frequent updates to the Army's field regulations.", "prediction 4": "General Winfield Scott was an American general who led one of the two invading armies in the Mexican\u2013American War. He remained in the Army after the war, served in several command positions, and carried out high level staff tasks, including frequent updates to the Army's field regulations. Known as Old Fuss and Feathers and the \"Grand Old Man of the Army\", Scott was a national hero after the Mexican\u2013American War, where he led one of the two invading armies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 383 }, { "error type": "Irrelevant", "explanation": "", "start": 391, "end": 449 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Winfield Scott was a U.S. army general who became a hero of the Mexican-American War by leading one of the invading armies. He was known as \"Old Fuss and Feathers\" and the \"Grand Old Man of the Army\". Zachary Taylor was the 12th President of the United States, born in 1784. Taylor rose to the rank of major general and became a national hero as a result of his victories in the Mexican\u2013American War." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who played carrie in days of our lives?", "passages": [ [ "Carrie Brady", "Carrie is a member of the Brady family, one of the show's two core families.", "She has a long-standing rivalry with her sister Sami Brady (Alison Sweeney), as Sami has routinely tried to steal Austin from Carrie.", "In 2011, Carrie and Sami started to get along better, but their closeness fell apart when Carrie fell in love with Sami's then-husband, Rafe Hernandez, in 2012.", "The affection was returned by Rafe.", "Clark's portrayal of Carrie has garnered attention for Clark who was nominated for Outstanding Younger Actress at the Daytime Emmy's in 1997, and again nominated in 1998.", "She won a Soap Opera Digest Award with co-star Austin Peck for Hottest Romance in 1997.", "She was also nominated for Best Young Actress in a Daytime Drama at the Young Artist Awards in 1990, and Nominated for Best Young Actress in a Daytime Drama at the Young Artist Awards in 1989.", "The role of Carrie was originated by child actress Andrea Barber.", "She was succeeded by Clark, who was only twelve years old at the time, on April 14, 1986.", "Clark remained with the serial until January 14, 1991, when producers wanted to age the character.", "She went on to appear on other shows such as \"General Hospital\", and appeared in movies such as .", "Meanwhile, the show briefly re-cast Carrie with actress Tracy Middendorf from January 10, 1992 to December 14, 1992." ], [ "Carrie Brady", "Carrie Brady\n\nCarrie Brady is a fictional character from the NBC soap opera, \"Days of Our Lives\", a long-running serial set in the fictional town of Salem.", "Created by head writer Margaret DePriest, the role of Carrie has been most notably portrayed by Christie Clark, who took over the role in 1986 as a teenager.", "Clark remained with the series off-and-on until leaving in October 2006, however, returned again as a series regular in September 2011 as part of a reboot of the series.", "Her return was short lived as she left the show the following July.", "On September 15, 2016, it was announced that Clark would again reprise her portrayal as Carrie in 2017.", "Carrie, a lawyer, also returned when her mother Anna was accused of a murder for several weeks in early 2018.", "Throughout the show, Carrie has been involved in classic soap opera storylines.", "Her romantic pairing with Austin Reed (Austin Peck; Patrick Muldoon) led them to be labeled a supercouple.", "She is the daughter of Anna DiMera (Leann Hunley) and Roman Brady (at the time Wayne Northrop, later Josh Taylor), though as a child she was mainly raised by her step-parents, Marlena Evans (Deidre Hall) and John Black (Drake Hogestyn)." ], [ "Days of Our Lives", "Later that same year, \"Days of Our Lives\" introduced its highly popular teen scene with new characters such as Carrie Brady, played by Tracy Middendorf, and then back to Christie Clark again; a SORASed Sami Brady, played by Alison Sweeney; Lucas Roberts played by Bryan Dattilo; Austin Reed portrayed by Patrick Muldoon and later, Austin Peck; Abe Carver's younger brother Jonah Carver, played by Thyme Lewis; Jamie Caldwell, played by Miriam Parish; and Wendy Reardon played by Tammy Townsend.", "These additions were to appeal to younger viewers.", "By 1997, the romantic dilemmas of Carrie, Austin, Mike, and Sami, and the Will Horton paternity issue and custody battle storylines had become a focal point of the series.", "The shocking and ratings-grabbing 1993 plot when Vivian Alamain buried Dr. Carly Manning alive (the first controversial storyline from head writer Reilly); and the 1994\u20131995 story line in which the town's Christmas tree burns down and Marlena becomes possessed in \"Exorcist\" fashion.", "From 1993 to 1998, actress Eileen Davidson portrayed several characters from the same family on the series.", "Her main character, the villainous Kristen DiMera, suffers a miscarriage in secret, and in a panic to keep her love John Black away from Marlena, Kristen pretends to still be pregnant with John's child." ] ], "gold": "Carrie Brady, a fictional character from the soap opera Days of Our Lives, has been played by more than one actress. The first to play Carrie was child actress Andrea Barber, who played the role from 1982 to 1986. Christie Clark took over the part from 1986 to 1991, and then from 1992 to 2019. Tracy Middendorf played Carrie from January 10, 1992 to December 14, 1992.", "prediction 1": "On the television soap opera Days of Our Lives, the character Carrie Brady is played by a number of actors. The role of Carrie was originated by child actress Andrea Barber, who was only twelve years old at the time, on April 14, 1986. The role was notably portrayed by Christie Clark, who took over the role in 1986 as a teenager.", "prediction 2": "The character of Carrie Brady, who originated on the television soap opera, Days of Our Lives, has been played by a number of different actresses. Her portrayal was most notably by Christie Clark, who took over the role in 1986 as a teenager. From 1993 to 1998, actress Eileen Davidson played several characters from the same family on the series, including carrie's mother Anna, Kristen, and Sami, both played by Alison Sweeney. A number of other actors have played Carrie, including Emily, who played the younger Carrie in different years; Tracy Middendorf played Carrie Brady in the 1990-series.", "prediction 3": "The character of Carrie Brady is a fictional character from the NBC soap opera, Days of Our Lives, a long-running serial set in the fictional town of Salem. Created by head writer Margaret DePriest, the role of Carrie has been most notably portrayed by Christie Clark, who took over the role in 1986 as a teenager. Clark remained with the show off-and-on until leaving in October 2006, however, returned again as a series regular in September 2011 as part of a reboot of the show.", "prediction 4": "In Days of Our Lives, the character of Carrie Brady is played by several actresses. Christie Clark played the character from 1986 to 1991, and Tracy Middendorf played the role from 1992 to 1993. In 2017, Clark had a second go at the role and reprised her role in 2017. In 2016, it was announced that Clark would again reprise her role in 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 174, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 235 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 331 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 12 ] } ], "corrected-prediction": "On the television soap opera Days of Our Lives, the character Carrie Brady is played by a number of actors. The role of Carrie was originated by child actress Andrea Barber. The role was notably portrayed by Christie Clark, who took over the role in 1986. The show briefly re-cast Carrie with actress Tracy Middendorf from January 10, 1992 to December 14, 1992." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is the president of holy cross college?", "passages": [ [ "Holy Cross College (Indiana)", "Holy Cross College (Indiana)\n\nHoly Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana.", "The college was founded in 1966 and is administered by members of the Congregation of Holy Cross.", "The college\u2019s baccalaureate program focuses on experiential learning, founded upon a program of Four Pillars: Service Learning, Global Perspectives, Professional Internship, Classroom Experience which culminates in a Capstone Presentation.", "Each student completes the same multidisciplinary core courses.", "Electives may be taken which allow each student to gain knowledge and experience preferred areas of interest.", "Students have academic advisors for each major and minor they are pursuing.", "Students may take courses at any of the local universities participating in the Northern Indiana Consortium for Education (NICE).", "After their first year, students may take classes at the University of Notre Dame at no extra cost.", "Current accreditation at the Baccalaureate level includes ten Bachelor of Arts degrees and 17 minors.", "Campus ministry is described as \"Distinctively Catholic, Open to All\" Mass is offered on weekdays at 12:25\u00a0p.m. and Sundays at 7:30\u00a0p.m.", "Adoration takes place on Tuesday nights from 7:00\u00a0p.m. until midnight.", "Confession is offered during the first hour of adoration on Tuesdays, along with before and after mass on Fridays." ] ], "gold": "Holy Cross College, not to be confused with College of the Holy Cross, is a private, Catholic institute of higher education in Notre Dame, Indiana. It was founded in 1966 by the Holy Cross Brothers. In 1966, John Driscoll, C.S.C., was the first president of the college. The Rev. David Tyson, C.S.C. was the president in 2020.", "prediction 1": "Holy Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana. The president of Holy Cross College is Father Joseph A. DeFranco.", "prediction 2": "Holy Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana. The college was founded in 1966 and is administered by members of the Congregation of Holy Cross. The president of Holy Cross College is Father John Y. LaVerne.", "prediction 3": "Holy Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana. The college was founded in 1966 and is administered by members of the Congregation of Holy Cross. The president of Holy Cross College is Father Joseph Alonso.", "prediction 4": "Holy Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana. It was founded in 1966 and is administered by members of the Congregation of Holy Cross. The college\u2019s president is John C. O\u2019Connor.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 124, "end": 189 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Holy Cross College is a Roman Catholic, co-educational, residential institution of higher education in Notre Dame, Indiana. The college was founded in 1966. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "When does the under 20s rugby world cup start?", "passages": [ [ "2017 World Rugby Under 20 Championship", "2017 World Rugby Under 20 Championship\n\nThe 2017 World Rugby Under 20 Championship was the tenth annual international rugby union competition for Under 20 national teams.", "The event was organised in Georgia by rugby's governing body, World Rugby.", "A total of twelve nations played in the tournament, which was held in Tbilisi and Kutaisi from 31 May to 18 June.", "The following teams participated in the 2017 World Rugby U20 Championship:\n", "The following officials will oversee the thirty matches:\n\nThe fixtures were released in September 2016.", "\"All times are in Georgian Standard Time (UTC+04)\"\n\nPoints were awarded in the \"Pool Stage\" via the standard points system: \n\n", "If at completion of the Pool Stage two or more teams were level on points, the following tiebreakers were applied:" ], [ "World Rugby Under 20 Championship", "World Rugby Under 20 Championship\n\nThe World Rugby Under 20 Championship (known as the IRB Junior World Championship until 2014) is an international rugby union competition.", "The event is organised by the sport's governing body, World Rugby, and is contested by 12 men's junior national teams with an under-20 age requirement.", "This event replaced the IRB's former age-grade world championships, the Under 19 and Under 21 World Championships.", "The inaugural tournament was held in June 2008, hosted by Wales and with 16 teams participating.", "Wales was announced as host for the inaugural tournament in November 2007.", "The number of participating nations was reduced to 12 before the 2010 tournament due to financial reasons.", "The U20 Championship is the upper level of the World Rugby tournament structure for under-20 national sides.", "At the same time that the U20 Championship was launched, World Rugby (then known as the International Rugby Board) also launched a second-level competition, the U20 Trophy, featuring eight teams.", "Promotion and relegation between the Trophy and the Championship is in place.", "The winner of the Trophy will play in next year's Championship, while the last placed team at the Championship will be relegated to the Trophy for the next year." ], [ "2018 World Rugby Under 20 Championship", "2018 World Rugby Under 20 Championship\n\nThe 2018 World Rugby Under 20 Championship was the eleventh annual international rugby union competition for Under 20 national teams.", "The event was organised in France by rugby's governing body, World Rugby.", "A total of twelve nations played in the tournament, which was held in three cities from 30 May to 17 June.", "The following teams participated in the 2018 U20 Championship:\n\nThe venues that play host to the tournament were as follows:\n\n", "The Pool stage fixture was as follows:\n\n", "The player statistics for the 2018 U20 Championship:" ], [ "2019 World Rugby Under 20 Championship", "2019 World Rugby Under 20 Championship\n\nThe 2019 World Rugby Under 20 Championship is the twelfth edition of the premier age-grade rugby competition.", "The tournament is being held in Argentina for the second time, previously being held in 2010 between 4 and 22 June.", "First time champions, France, will be the defending champions.", "The dates are yet to be confirmed.", "The cities of Rosario and Santa Fe will host the event.", "The following teams participated in the 2019 U20 Championship:\n\nThe Pool stage fixture was as follows:" ] ], "gold": "The World Rugby Under 20 Championship, known as the IRB Junior World Championship until 2014, is an international rugby union competition, organised by the sport's governing body, World Rugby, and is contested by 12 men's junior national teams with an under-20 age requirement. The inaugural tournament was held in June 2008, hosted by Wales and with 16 teams participating. Other dates held for the Championship were June, 2 June 2015, 7 June 2016, and the exception of 31 May 2017.", "prediction 1": "The World Rugby Under 20 Championship is an international rugby union competition contested by 12 men's junior national teams with an under-20 age requirement. The 2016 World Rugby Under 20 Championship started on 3 September, 2017. The 2017 World Rugby Under 20 Championship started on 31 May, 2017. The 2018 World Rugby Under 20 Championship started on 30 May, 2018. The 2019 World Rugby Under 20 Championship started on 14 June, 2019.", "prediction 2": "The World Rugby Under 20 Championship is an annual international rugby union competition, organised by the sport's governing body, World Rugby, and is contested by 12 men's junior national teams with an under-20 age requirement. The inaugural tournament was held in June 2008, hosted by Wales and with 16 teams participating. The 2018 World Rugby Under 20 Championship was the eleventh annual international rugby union competition for Under 20 national teams. The 2019 World Rugby Under 20 Championship is the twelfth edition of the premier age-grade rugby competition, the tournament is being held in Argentina for the second time, previously being held in 2010 between 4 and 22 June.", "prediction 3": "The 2019 World Rugby Under 20 Championship is the twelfth edition of the premier age-grade rugby competition. The tournament is being held in Argentina for the second time, previously being held in 2010 between 4 and 22 June. The 2017 World Rugby Under 20 Championship was the tenth annual international rugby union competition for Under 20 national teams. The 2018 World Rugby Under 20 Championship was the eleventh annual international rugby union competition for Under 20 national teams. The 2019 World Rugby Under 20 Championship is the twelfth edition of the premier age-grade rugby competition. The tournament is being held in Brazil from 1 to 10 June.", "prediction 4": "The World Rugby Under 20 Championship is an annual international rugby union competition for men's junior national teams with an under-20 age requirement. The event is organised by the sport's governing body, World Rugby, and is contested by 12 men's junior national teams with an under-20 age requirement. The 2018 World Rugby Under 20 Championship was the eleventh annual international rugby union competition for Under 20 national teams. The tournament was held in France by rugby's governing body, World Rugby and was held in three cities from 30 May to 17 June. The 2019 World Rugby Under 20 Championship is the twelfth edition of the premier age-grade rugby competition. The tournament was held in Argentina for the second time, previously being held in 2010 between 4 and 22 June.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 160, "end": 232 }, { "error type": "Unverifiable", "explanation": "", "start": 369, "end": 437 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The World Rugby Under 20 Championship, known as the IRB Junior World Championship until 2014, is an international rugby union competition, organized by the sport's governing body, contested by 12 men's junior national teams with an under-20 age requirement. The inaugural tournament was held in June 2008, hosted by Wales and with 16 teams participating. The 2017 World Rugby Under 20 Championship started on 31 May, 2017. The 2018 World Rugby Under 20 Championship started on 30 May, 2018. " }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who is the presiding officer of the senate when the vice president is not there?", "passages": [ [ "Presiding Officer of the United States Senate", "This list includes all Presidents of the Senate (the Vice Presidents of the United States), those Presidents pro tempore of the Senate who presided during intra\u2013term vacancies in the vice presidency or when the Vice President was acting as President of the United States, and those Chief Justices who presided during presidential impeachment trials.", "It does not include Presidents pro tempore who presided over sessions temporarily during an absence of the Senate President, or junior senators designated by the President pro tempore to preside temporarily." ], [ "Presiding Officer of the United States Senate", "Presiding Officer of the United States Senate\n\nThe Presiding Officer of the United States Senate is the person who presides over the United States Senate and is charged with maintaining order and decorum, recognizing members to speak, and interpreting the Senate's rules, practices, and precedents.", "Senate presiding officer is a role, not an actual office.", "The actual role is usually performed by one of three officials: the Vice President; an elected United States Senator; or, in special cases, the Chief Justice.", "Outside the constitutionally mandated roles, the actual appointment of a person to do the job of presiding over the Senate as a body is governed by Rule I of the Standing Rules.", "The Vice President is assigned the responsibility by the Constitution of presiding over the Senate and designated as its president.", "The vice president has the authority (\"ex officio\", for they are not an elected member of the Senate) to cast a tie-breaking vote.", "Early vice presidents took an active role in regularly presiding over proceedings of the body, with the president pro tempore only being called on during the vice president's absence.", "During the 20th century, the role of the vice president evolved into more of an executive branch position." ], [ "Presiding Officer of the United States Senate", "Now, the vice president is usually seen as an integral part of a president's administration and presides over the Senate only on ceremonial occasions or when a tie-breaking vote may be needed.", "The Constitution also provides for the appointment of one of the elected senators to serve as President pro tempore.", "This senator presides when the vice president is absent from the body.", "The president pro tempore is selected by the body specifically for the role of presiding in the absence of (as the meaning of \"pro tempore\", literally \"for the time being\") the actual presiding officer.", "By tradition, the title of \"President pro tempore\" has come to be given more-or-less automatically to the most senior senator of the majority party.", "In actual practice in the modern Senate, the president pro tempore also does not often serve in the role (though it is their constitutional right to do so).", "Instead, as governed by Rule I, they frequently designate a junior senator to perform the function.", "When the Senate hears an impeachment trial of the President of the United States, by the procedure established in the Constitution, the Chief Justice is designated as the presiding officer.", "The Constitution provides for two officers to preside over the Senate.", "designates the Vice President of the United States as the President of the Senate." ] ], "gold": "The Presiding Officer of the United States Senate is the person who presides over the United States Senate and is charged with maintaining order and decorum, recognizing members to speak, and interpreting the Senate's rules, practices, and precedents. Senate presiding officer is a role, not an actual office, the actual role is usually performed by one of three officials, the Vice President, an elected United States Senator, or, in special cases, the Chief Justice. The Constitution also provides for the selection of one of the elected senators to serve as President pro tempore, and the presiding officer of the senate when it's an impeachment trial is the Chief Justice of the Supreme Court. ", "prediction 1": "The presiding officer of the United States Senate when the vice president is absent is the person who presides over the Senate and is charged with maintaining order and decorum, recognizing members of the Senate to speak, and interpreting the Senate's rules, practices, and precedents. When the vice president is absent, the president pro tempore is appointed by the body specifically for the role of presiding in the absence of the actual presiding officer.", "prediction 2": "The Presiding Officer of the United States Senate is the person who presides over the United States Senate and is charged with maintaining order and decorum, recognizing members of the Senate to speak, and interpreting the Senate's rules, practices, and precedents. The Vice President is assigned the responsibility by the Constitution of presiding over the Senate and designated as its president. The Constitution also provides for the appointment of one of the elected senators to serve as President pro tempore. This senator presides when the vice president is absent from the body.", "prediction 3": "The Vice President is assigned the responsibility by the Constitution of presiding over the Senate and designated as its president. The Constitution also provides for the appointment of one of the elected senators to serve as President pro tempore. This senator presides when the vice president is absent from the body.", "prediction 4": "The Presiding Officer of the United States Senate is the person who presides over the United States Senate and is charged with maintaining order and decorum, recognizing members of the Senate to speak, and interpreting the Senate's rules, practices, and precedents. The Vice President is assigned the responsibility by the Constitution of presiding over the Senate and designated as its president. The Constitution provides for the appointment of one of the elected senators to serve as President pro tempore. This senator presides when the vice president is absent from the body.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 458 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The presiding officer of the United States Senate when the vice president is absent is the person who presides over the Senate and is charged with maintaining order and decorum, recognizing members of the Senate to speak, and interpreting the Senate's rules, practices, and precedents. Senate presiding officer is a role, not an actual office, The actual role is usually performed by one of three officials: the Vice President; an elected United States Senator; or, in special cases, the Chief Justice. The Constitution also provides for the appointment of one of the elected senators to serve as President pro tempore. When the Senate hears an impeachment trial of the President of the United States the Chief Justice is designated as the presiding officer." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "Who sings american woman stay away from me?", "passages": [ [ "American Woman", "The music video (directed by Paul Hunter) featured actress Heather Graham (who starred in \"The Spy Who Shagged Me\"); the original political themes of the song were largely replaced by sex appeal.", "In 1999, Kravitz and his band were joined by the Guess Who for a live performance of \"American Woman\" at the MuchMusic Video Awards.", "Grammy Awards 2000\n\nIt was featured in Sam Mendes's movie \"American Beauty\", performed by main character Lester Burnham (played by Kevin Spacey).", "Sam the Eagle performed a karaoke version of this song in a Muppets viral video.", "It is being used in the HBO trailer for the movie \"Game Change\".", "A version sung by an older man was used in the film \"The Cable Guy\" (1996).", "It was heard during the ending credits of the \"Witchblade\" TV movie (2000), starring Yancy Butler and based on the Top Cow comic book series.", "American Woman was featured in the Austin Powers movie \"The Spy Who Shagged Me\" with Heather Graham dancing provocatively whilst it played.", "The song was featured in an episode of \"\"Due South\"\"s first season.", "Kelly Clarkson recorded a cover version of the song as a theme song from the Paramount Network TV series, \"American Woman\"." ], [ "American Woman", "American Woman\n\n\"American Woman\" is a song released by the Canadian rock band The Guess", "Who in January 1970, from their sixth studio album of the same name.", "It was later released in March 1970 as a single backed with \"No Sugar Tonight\", which reached number one on the \"Billboard\" Hot 100.", "\"Billboard\" magazine placed the single at number three on the Year-End Hot 100 singles of 1970 list.", "On May 22, 1970, the single was certified as gold by the RIAA.", "Produced by Jack Richardson, the single was recorded on August 13, 1969 at RCA's Mid-America Recording Center in Chicago.", "The music and lyrics of the song were improvised on stage during a concert in Southern Ontario, Canada (the guitarist, Randy Bachman, recalled it being in Kitchener; Burton Cummings, the lead singer, said it was at the Broom and Stone, a curling rink in Scarborough that was used for concerts).", "Bachman was playing notes while tuning his guitar after replacing a broken string, and he realised he was playing a new riff that he wanted to remember.", "He continued playing it and the other band members returned to the stage and joined in, creating a jam session in which Cummings improvised the lyrics.", "They noticed a kid with a cassette recorder making a bootleg recording and asked him for the tape." ] ], "gold": "\"American Woman\" a song a song released by the Canadian rock band the Guess Who in January 1970 of the Canadian rock band the Guess Who, sung by Burton Cummings. It was later released in March 1970 as a single backed with \"No Sugar Tonight\", and it reached number one for three weeks commencing May 9 on both the United States' Billboard Hot 100, and the Canadian RPM magazine singles chart. ", "prediction 1": "\"American Woman\" is a song released by the Canadian rock band The Guess Who in January 1970. It was later released in March 1970 as a single backed with \"No Sugar Tonight\", which reached number one on the Billboard Hot 100. A version sung by an older man was used in the film The Cable Guy in 1996. Kelly Clarkson recorded a cover version of the song as a theme song from the Paramount Network TV series, American Woman.", "prediction 2": "\"American Woman\" is a song released by the Canadian rock band The Guess Who in January 1970, from their sixth studio album of the same name. It was later released in March 1970 as a single backed with \"No Sugar Tonight\", which reached number one on the Billboard Hot 100. A version sung by an older man was used in the film The Cable Guy. Kelly Clarkson recorded a cover version of the song as a theme song from the Paramount Network TV series, \"American Woman\".", "prediction 3": "The music and lyrics of the 1970 song \"American Woman\" were improvised on stage during a concert in Southern Ontario, Canada. The lead singer, Burton Cummings, sang the song \"stay away from me\".", "prediction 4": "\"American Woman\" is a song released by the Canadian rock band The Guess Who in January 1970, from their sixth studio album of the same name. It was later released in March 1970 as a single backed with \"No Sugar Tonight\", which reached number one on the Billboard Hot 100. A version sung by an older man was used in the film The Cable Guy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 420 } ], "missing-info": [], "corrected-prediction": "\"American Woman\" is a song released by the Canadian rock band The Guess Who in January 1970. It was later released in March 1970 as a single backed with \"No Sugar Tonight\", which reached number one on the Billboard Hot 100. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When is next olympic games to be held?", "passages": [ [ "2018 Winter Olympics", "2018 Winter Olympics\n\nThe 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games () and commonly known as PyeongChang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea, with the opening rounds for certain events held on 8 February 2018, the eve of the opening ceremony.", "Pyeongchang was elected as the host city in July 2011, during the 123rd IOC Session in Durban, South Africa.", "This was the first time that South Korea had hosted the Winter Olympics and the second Olympics held in the country overall, after the 1988 Summer Olympics in Seoul.", "It was the third time that an East Asian country had hosted the Winter Games, after Sapporo (1972) and Nagano (1998), both in Japan.", "It was also the first of three consecutive Olympics to be held in East Asia, the other two being the 2020 Summer Olympics in Tokyo and the 2022 Winter Olympics in Beijing.", "The Games featured 102 events over fifteen disciplines in seven sports, with the addition of \"big air\" snowboarding, mass start speed skating, mixed doubles curling, and mixed team alpine skiing to the Winter Olympic programme.", "2,914 athletes from 92 NOCs competed, including the debuts of Ecuador, Eritrea, Kosovo, Malaysia, Nigeria and Singapore." ], [ "2016 Summer Olympics", "2016 Summer Olympics\n\nThe 2016 Summer Olympics (), officially known as the Games of the XXXI Olympiad and commonly known as Rio 2016, was an international multi-sport event that was held from 5 to 21 August 2016 in Rio de Janeiro, Brazil, with preliminary events in some sports beginning on 3 August.", "These were the first Olympic Games ever to be held in South America and the third to be held in a developing country, after the 1968 games in Mexico City and the 1988 games in Seoul, South Korea.", "More than 11,000 athletes from 205 National Olympic Committees, including first time entrants Kosovo, South Sudan, and the Refugee Olympic Team, took part.", "With 306 sets of medals, the games featured 28 Olympic sports, including rugby sevens and golf, which were added to the Olympic program in 2009.", "These sporting events took place at 33 venues in the host city, and at five separate venues in the Brazilian cities of S\u00e3o Paulo, Belo Horizonte, Salvador, Bras\u00edlia, and Manaus.", "These were the first Summer Olympic Games to take place under the International Olympic Committee (IOC) presidency of Thomas Bach.", "The host city Rio de Janeiro was announced at the 121st IOC Session in Copenhagen, Denmark, on 2 October 2009.", "Rio became the first South American city ever to host the Olympic Games." ], [ "2014 Winter Olympics", "2014 Winter Olympics\n\nThe 2014 Winter Olympics, officially called the XXII Olympic Winter Games () () and commonly known as Sochi 2014, was an international winter multi-sport event that was held from 7 to 23 February 2014 in Sochi, Krasnodar Krai, Russia, with opening rounds in certain events held on the eve of the opening ceremony, 6 February 2014.", "Both the Olympics and 2014 Winter Paralympics were organized by the Sochi Organizing Committee (SOOC).", "Sochi was selected as the host city in July 2007, during the 119th IOC Session held in Guatemala City.", "It was the first Olympics to be held in a CIS state since the breakup of the Soviet Union in 1991.", "The Soviet Union was previously the host nation for the 1980 Summer Olympics in Moscow.", "These were the first Olympic Games under the International Olympic Committee (IOC) presidency of Thomas Bach.", "A record 98 events in fifteen winter sport disciplines were held during the Games.", "A number of new competitions\u2014a total of twelve accounting for gender\u2014were held during the Games, including biathlon mixed relay, women's ski jumping, mixed-team figure skating, mixed-team luge, half-pipe skiing, ski and snowboard slopestyle, and snowboard parallel slalom." ], [ "2022 Winter Paralympics", "2022 Winter Paralympics\n\nThe 2022 Winter Paralympics (Chinese: \u7b2c\u5341\u4e09\u5c4a\u51ac\u5b63\u6b8b\u75be\u4eba\u5965\u6797\u5339\u514b\u8fd0\u52a8\u4f1a), officially known as the XIII Paralympic Winter Games, is an international winter multi-sport event for disabled athletes that is scheduled to take place in Beijing, People's Republic of China, from 4 to 13 March 2022.", "Beijing will become the first city to host both the Summer and Winter Paralympics.", "These games will be the first Winter Paralympics held in China.", "Competitions in the 2022 Winter Paralympics will be held in seven Winter Paralympic sports, with 81 medal events in total.", "The official emblem \"Flying High\" (\u98de\u5f97\u5f88\u9ad8) was unveiled on 15 December 2017 at the Beijing National Aquatics Center.", "It is an inspiration of a skater and skier with a ribbon motif and the Chinese character \"\u98de\" (f\u0113i, means fly), with the Paralympic colors and the Chinese flag colors.", "The emblem was designed by Lin Cunzhen who also created the Olympic emblem and the Nanjing 2014 Summer Youth Olympics logo.", "To be unveiled in 2020." ], [ "2024 Summer Olympics", "2024 Summer Olympics\n\nThe 2024 Summer Olympics (), officially known as the Games of the XXXIII Olympiad, (French: Jeux de la XXXIIIe Olympiade) and commonly known as Paris 2024, is a forthcoming international multi-sport event that is scheduled to take place from 26 July to 11 August 2024 in Paris, France.", "Having previously hosted the 1900 and 1924 Summer Olympics, Paris will become the second city to host the Olympic Games three times, along with London (1908, 1948, and 2012).", "The 2024 Games also mark the centennial of the 1924 Games.", "This will be the sixth overall Olympic Games held in France (including summer and winter Games).", "Bidding to host these Games began in 2015 with five candidate cities in contention, but Hamburg, Rome, and Budapest withdrew, leaving Paris and Los Angeles as the two candidates remaining.", "A proposal to elect the 2024 and 2028 Olympic host cities at the same time was approved by an Extraordinary IOC Session on 11 July 2017 in Lausanne.", "On 31 July 2017, the IOC made a deal with Los Angeles to host the 2028 Summer Olympics, making Paris the host of the 2024 Summer Olympics.", "The formal announcement of the hosts for both Olympiads took place at the 131st IOC Session in Lima, Peru, on 13 September 2017." ], [ "2020 Summer Olympics", "2020 Summer Olympics\n\nThe 2020 Summer Olympics, officially known as the and commonly known as Tokyo 2020, is a forthcoming international multi-sport event that is scheduled to take place from 24 July to 9 August 2020.", "Tokyo was selected as the host city during the 125th IOC Session in Buenos Aires on 7 September 2013.", "These Games will mark the return of the Summer Olympics to Tokyo for the first time since 1964, and the fourth Olympics overall to be held in Japan, following the 1972 Winter Olympics in Sapporo and the 1998 Winter Olympics in Nagano.", "They will be the second of three consecutive Olympic Games to be held in East Asia, following the 2018 Winter Olympics in Pyeongchang, South Korea, and preceding the 2022 Winter Olympics in Beijing, China.", "These Games will see the introduction of additional disciplines within several of the Summer Olympics sports, including 3x3 basketball, freestyle BMX and Madison cycling, as well as further mixed events.", "Under new IOC policies that allow sports to be added to the Games' programme to augment the permanent \"core\" Olympic events, these Games will see karate, sport climbing, surfing and skateboarding make their Olympic debuts, and the return of baseball and softball (which were removed from the summer programme after 2008).", "Tokyo, Istanbul, and Madrid were the three candidate cities." ], [ "Canoeing at the 2020 Summer Olympics", "Canoeing at the 2020 Summer Olympics\n\nThe canoeing races at the 2020 Summer Olympics in Tokyo will be contested in two main disciplines: the slalom, from 26 to 31 July, and the sprint, from 3 to 8 August.", "The slalom canoe competition will be held at the Canoe Slalom Course; whereas the sprint events will be staged at Sea Forest Waterway.", "The competition features 16 events.", "Host nation (Japan)" ] ], "gold": "The next Olympic Games will be held in 2022 and 2024. The 2022 Winter Olympics are scheduled to take place from 4 to 20 February 2022 in Beijing, China, while the 2024 Summer Olympics are scheduled to take place from 26 July to 11 August 2024 in Paris, France. The 2020 Summer Olympics were postponed to 2021 as a result of the COVID-19 pandemic, the first such instance in the history of the Olympic Games. The 2020 Summer Olympics were held from 23 July to 8 August 2021 in Tokyo, Japan, with some preliminary events that began on 21 July. The 2018 Winter Olympics were held between 9 and 25 February 2018 in South Korea, with the opening rounds for certain events held on 8 February 2018, the day before the opening ceremony. The 2016 Summer Olympics were held from 5 to 21 August 2016 in Rio de Janeiro, Brazil, with preliminary events in some sports beginning on 3 August. The 2014 Winter Olympics were held from 7 to 23 February 2014 in Sochi, Russia, with opening rounds in certain events held on the eve of the opening ceremony, 6 February 2014.", "prediction 1": "The 2020 Summer Olympic Games are scheduled to take place in Tokyo in 2020 and the 2022 Winter Paralympics in 2022. The 2020 Summer Olympic Games are scheduled to take place in Tokyo in 2021. The 2022 Winter Paralympics is an international winter multi-sport event for disabled athletes that is scheduled to take place in Beijing, People's Republic of China, from 4 to 13 March 2022.\n", "prediction 2": "The 2020 and 2022 Olympic Games were both held in China. The 2020 Winter Paralympics was an international winter multi-sport event for disabled athletes that was scheduled to take place in Beijing from 4 to 13 March 2022. The 2015 Summer Olympics were held from 23 September 2015 to 6 October 2015. The 2012 Summer Olympic Games were held from 12 to 16 September 2012. The Rio 2016 Summer Olympics were held from 5 August 2016 to 21 August 2016 in Rio de Janeiro, Brazil.", "prediction 3": "There were several Olympic Games. The 2004 Summer Olympics were held in Australia in August 2004. The 2014 Winter Olympics were held from 7 to 23 February 2014 in Sochi, Russia with opening rounds in certain events held on the eve of the opening ceremony, 6 February 2014.", "prediction 4": "There are several international Olympic games that have been hosted. There was the 2018 Winter Olympics, the 2016 Summer Olympics, and the 2022 Winter Paralympics. The 2020 Summer Olympic Games of Football were held in Tokyo and the 2022 Winter Olympics of Handball and Beach Volleyball were held in Beijing. The 1984 Summer Olympic Games of Football were held in Pyeongchang, South Korea.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 115 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 384 }, { "error type": "Redundant", "explanation": "The 2020 Summer Olympic Games are scheduled to take place in Tokyo in 2020", "start": 116, "end": 173 }, { "error type": "Unverifiable", "explanation": "", "start": 174, "end": 191 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2020 Summer Olympic Games are scheduled to take place in Tokyo in 2020. The 2018 Winter Olympics was held between 9 and 25 February 2018 in South Korea. The 2016 Summer Olympics was held from 5 to 21 August 2016 in Rio de Janeiro, Brazil, with preliminary events in some sports beginning on 3 August. The 2014 Winter Olympics was held from 7 to 23 February 2014 in Sochi, Russia, with opening rounds in certain events held on the eve of the opening ceremony, 6 February 2014. The 2024 Summer Olympics is scheduled to take place from 26 July to 11 August 2024 in Paris, France." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What's the video with the most views on youtube?", "passages": [ [ "Despacito", "The video became the first on YouTube to receive three billion, four billion, and five billion views on August 4, 2017; October 11, 2017; and April 5, 2018, respectively \"(dates are based on UTC)\".", "It has received over 5.8 billion views as of December 18, 2018 and has been the most viewed video on the site since August 4, 2017, when it surpassed the music video for \"See You Again\" by Wiz Khalifa featuring Charlie Puth.", "It is also the site's most-liked video, with over 31 million as of December 6, 2018.", "On Vevo, the music video received 5.14 million views in its first 24 hours of release, which the website reported as being the most for a Spanish-language video's first day on its platform, surpassing J Balvin's record with the music video for his song \"Bobo\".", "The music video received a Latin Grammy Award for Best Short Form Music Video at the 18th Latin Grammy Awards and a \"Billboard\" Music Award for Top Streaming Song (Video) at the 25th \"Billboard\" Music Awards, and was nominated for an American Music Award for Video of the Year at the 45th American Music Awards." ], [ "Johny Johny Yes Papa", "As of 13 December 2018, a video containing the song, uploaded by ChuChu TV in 2014, has more than 1.5 billion views, and another video of the song, uploaded to YouTube by Loo Loo Kids in 2016, has more than 1.4 billion views.", "The two videos are respectively the 47th- and 66th-most-viewed videos on the site, as well as the third- and fourth-most-viewed nursery rhyme videos.", "A further video containing the song, uploaded by CVS 3D Rhymes in 2017, has over 1.1 billion views.", "These three videos containing the song are also in the top 50 most-disliked YouTube videos.", "Another video was listed in 2015 by \"The Daily Dot\" as one of eleven \"unintentionally disturbing\" YouTube videos for children.", "The song became an internet meme in August 2018, with one version by Billion Surprise Toys\u2014a company with 16 million subscribers to its YouTube channel\u2014going particularly viral on Twitter.", "This version prominently features Johny and his father doing popular dance moves such as the \"Gangnam Style\" dance, and intertwines the original lyrics with a repeated \"doo-doo-doo-da-doo\" to the melody of \"Baby Shark\"." ], [ "See You Again", "In Australia, \"See You Again\" rose from number 59 to number one on the Australian Singles Chart issued for April 11, 2015, marking Khalifa and Puth's first number one hit on the chart.", "The song's climb to number one was the largest in Australian Singles Chart history.", "The music video for \"See You Again\" was directed by Marc Klasfeld.", "It was uploaded to YouTube on April 6, 2015.", "The video, recorded by American rapper Wiz Khalifa and American singer Charlie Puth, was the most viewed video on YouTube from July 10 to August 4, 2017 and the most liked video on the site from August 28, 2016 to July 25, 2017.", "As of December 15, 2018, it has received over 3.9 billion views and 22.4 million likes, making it the site's third most viewed and second most liked video.", "It is one of 148 videos to exceed one billion views, 29 videos to exceed two billion views, and seven videos to exceed three billion views.", "It was the second video ever to record two billion and three billion views.", "The video begins with a shot of a cliff top at sunset, followed by Khalifa walking down a highway road.", "Puth is then shown singing the chorus whilst sitting at, and playing, a piano located between two cars." ] ], "gold": "An early metric of a video's popularity was the so-called Billion View Club, denoting videos which had succeeded in reaching over 1 billion views since their initial upload to YouTube. The music video for \"See You Again\" was directed by Marc Klasfeld, and uploaded to YouTube on April 6, 2015. Baby Shark Dance uploaded in 2016. \"Despacito\" became the first video to reach three billion views in August 2017. ", "prediction 1": "The video with the most views on YouTube is Despacito, which was uploaded to the site on August 4, 2017. It has received over 5.8 billion views as of December 18, 2018 and has been the most viewed video on the site since August 4, 2017, when it surpassed the music video for \"See You Again\" by Wiz Khalifa featuring Charlie Puth.", "prediction 2": "The most-viewed video on YouTube is Despacito, uploaded by ChuChu TV in 2014. The video for \"See You Again\" by Wiz Khalifa featuring Charlie Puth received over 3.9 billion views as of December 15, 2018, and 22.4 million likes, making it the site's third most viewed and second most liked video.", "prediction 3": "The video with the most views on youtube is Despacito, the music video for which the rapper Wiz Khalifa and singer Charlie Puth sang the chorus. The music video for \"See You Again\" was uploaded to YouTube on April 6, 2015 and received over 3.9 billion views as of December 15, 2018.", "prediction 4": "The video with the most views on YouTube is \"Despacito\", which received over five billion views on August 4, 2017; October 11, 2017; and April 5, 2018. On Vevo, the music video for \"See You Again\" by Wiz Khalifa featuring Charlie Puth received 5.14 million views in its first 24 hours of release.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 167 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The music video for \"See You Again\" was directed by Marc Klasfeld, and uploaded to YouTube on April 6, 2015. The video with the most views on YouTube is Despacito, which was uploaded to the site on August 4, 2017. It has been the most viewed video on the site since August 4, 2017, when it surpassed the music video for \"See You Again\"." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does friday the 13th movie take place?", "passages": [ [ "Friday the 13th (2009 film)", "Friday the 13th (2009 film)\n\nFriday the 13th is a 2009 American slasher film directed by Marcus Nispel and written by Damian Shannon and Mark Swift.", "The film is a reboot of the \"Friday the 13th\" film series, which began in 1980, and is the twelfth installment in the film series.", "\"Friday the 13th\" follows Clay Miller (Jared Padalecki) as he searches for his missing sister, Whitney (Amanda Righetti), who is captured by Jason Voorhees (Derek Mears) while camping in woodland at Crystal Lake.", "The 2009 film was originally conceived as an origin story, but the project evolved into a re-imagining of the first four \"Friday the 13th\" films.", "The character Jason Voorhees was redesigned as a lean, quick killer with a backstory that allows the viewer to feel a little sympathy for him, but not enough that he would lose his menace.", "In keeping with the tone of the film, Jason's mask was recreated from a mold of the original mask used for \"Part III\"; though there were subtle changes.", "\"Friday the 13th\" includes some of Harry Manfredini's musical score from the previous \"Friday the 13th\" films because the producers recognized its iconic status.", "\"Friday the 13th\" was released in theaters on Friday, February 13, 2009." ], [ "Friday the 13th (franchise)", "Friday the 13th (franchise)\n\nFriday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tie\u2011in merchandise.", "The franchise mainly focuses on the fictional character Jason Voorhees, who drowned as a boy at Camp Crystal Lake due to the negligence of the camp staff.", "Decades later, the lake is rumored to be \"cursed\" and is the setting for a series of mass murders.", "Jason is featured in all of the films, as either the killer or the motivation for the killings.", "The original film, created to cash in on the success of \"Halloween\" (1978), was written by Victor Miller and was produced and directed by Sean S. Cunningham.", "The films have grossed over $464 million at the box-office worldwide.", "Frank Mancuso, Jr., a producer of the films, also developed the television show \"\" after Paramount released \"\".", "The television series was not connected to the franchise by any character or setting, but was created based on the idea of \"bad luck and curses\", which the film series symbolized.", "While the franchise was owned by Paramount, four films were adapted into novels, with \"Friday the 13th Part III\" adapted by two separate authors." ], [ "Jacksonburg Creek", "Jacksonburg Creek\n\nJacksonburg Creek is a tributary of the Paulins Kill located along the eastern face of Kittatinny Mountain in Warren County in northwestern New Jersey in the United States.", "It rises near the Warren County-Sussex County border in Hardwick Township and enters the Paulins Kill approximately one mile south of Blairstown.", "The Appalachian Trail passes within its watershed and crosses the creek as it traverses the ridgeline of Kittatinny Mountain.", "The 1980 slasher film \"Friday the 13th\" was filmed at Camp NoBeBosCo north of Blairstown, New Jersey in Hardwick Township.", "The camp's Sand Pond, which stood in for the movie's \"Crystal Lake,\" is the headwaters of Jacksonburg Creek." ] ], "gold": "Friday the 13th is a 2009 American slasher film that is a reboot of the Friday the 13th franchise that began in 1980. The films are set at Camp Crystal Lake, where Jason Voorhees was thought to have drowned as a boy due to the negligence of the camp staff. Decades later, the lake is rumored to be cursed and is the setting for a series of mass murders. The 2009 Friday the 13th movie was filmed in Austin, Texas, while the 1980 Friday the 13th movie was shot in and around the townships of Hardwick, Blairstown and Hope in Warren County, New Jersey.", "prediction 1": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise based on the slasher film franchise created by Sean S. Cunningham in the 1980s. The original 1980 slasher film was filmed at Camp NoBeBosCo in Hardwick Township. The 2009 film is a reboot of the \"Friday the 13th\" film series, which began in 1980 and is the twelfth installment in the film series.", "prediction 2": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise. The original 1980 slasher film \"Friday the 13th\" was filmed at Camp NoBeBosCo north of Blairstown, New Jersey in Hardwick Township. The 2009 slasher film is a reboot of the \"Friday the 13th\" film series, which began in 1980, and is the twelfth installment in the franchise.", "prediction 3": "Friday the 13th is a horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tie-in merchandise. The 1980 slasher film \"Friday the 13th\" was filmed at Camp NoBeBosCo north of Blairstown, New Jersey in Hardwick Township. The 2009 film is a reboot of the \"Friday the 13th\" film series, which began in 1980, and is the twelfth installment in the film series. The 2009 film is a horror film that takes place in Woods near Crystal Lake.", "prediction 4": "Friday the 13th is an American horror franchise that comprises twelve slasher films, a television show, novels, comic books, video games, and tiein merchandise and mainly focuses on the fictional character Jason Voorhees, who drowns as a boy at Camp Crystal Lake due to the negligence of the camp staff. The 1980 slasher film was filmed at Camp NoBeBosCo north of Blairstown, New Jersey. The camp's Sand Pond, which stood in for the movie's Crystal Lake, is the headwaters of Jacksonburg Creek. The 2009 film takes place of Camp NoBeBosCo north of Blairstown, New Jersey in Hardwick Township.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 406, "end": 456 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 239 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Friday the 13th is a 2009 American slasher film that is a reboot of the Friday the 13th franchise that began in 1980. Cunningham in the 1980s. The films are set at Camp Crystal Lake, where Jason Voorhees was thought to have drowned as a boy due to the negligence of the camp staff. Decades later, the lake is rumored to be \"cursed\" and is the setting for a series of mass murders. The 1980 slasher film \"Friday the 13th\" was filmed at Camp NoBeBosCo north of Blairstown, New Jersey in Hardwick Township." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When did the state of the union address start?", "passages": [ [ "State of the Union", "In 1801, Thomas Jefferson discontinued the practice of delivering the address in person, regarding it as too monarchical (similar to the Speech from the Throne).", "Instead, the address was written and then sent to Congress to be read by a clerk until 1913 when Woodrow Wilson re-established the practice despite some initial controversy.", "However, there have been exceptions to this rule.", "Presidents during the latter half of the 20th century have sent written State of the Union addresses.", "The last President to do this was Jimmy Carter in 1981, after his defeat by Ronald Reagan and days before his term ended.", "For many years, the speech was referred to as \"the President's Annual Message to Congress\".", "The actual term \"State of the Union\" first emerged in 1934 when Franklin D. Roosevelt used the phrase, becoming its generally accepted name since 1947.", "Prior to 1934, the annual message was delivered at the end of the calendar year, in December.", "The ratification of the 20th Amendment on January 23, 1933, changed the opening of Congress from early March to early January, affecting the delivery of the annual message.", "Since 1934, the message or address has been delivered to Congress in January or February.", "The Twentieth Amendment also established January 20 as the beginning of the presidential term." ], [ "February 2017 Donald Trump speech to joint session of Congress", "February 2017 Donald Trump speech to joint session of Congress\n\nThe 45th President of the United States, Donald Trump, gave his first public address before a joint session of the United States Congress on Tuesday, February 28, 2017.", "Similar to a State of the Union address, it was delivered before the 115th United States Congress in the Chamber of the United States House of Representatives in the United States Capitol.", "Presiding over this joint session was the House Speaker, Paul Ryan.", "Accompanying the Speaker of the House was the President of the United States Senate, Mike Pence, the Vice President of the United States.", "During his speech, President Trump announced the creation of the Office of Victims of Immigration Crime Engagement (VOICE) in the United States Department of Homeland Security.", "Veteran Affairs Secretary David Shulkin was the designated survivor and did not attend the address in order to maintain a continuity of government.", "He was sequestered at a secret secure location for the duration of the event.", "Fact-checkers noted that although Trump's speech to Congress had \"fewer untrue statements than many of his remarks\", the address nevertheless included numerous false and misleading statements on a variety of issues, including the federal budget, immigration and crime, immigration and the economy, welfare, and the job impact of the Keystone XL and Dakota Access Pipelines." ], [ "2016 State of the Union Address", "2016 State of the Union Address\n\nThe 2016 State of the Union Address was given by the 44th United States President Barack Obama on Tuesday, January\u00a012, 2016, in the chamber of the United States House of Representatives.", "It was addressed to the 114th United States Congress.", "It was the first State of the Union address with Paul Ryan as Speaker of the House of Representatives.", "It was the last State of the Union Address of Obama's presidency; no U.S. president since Gerald Ford has given a final State of the Union address at the end of his term.", "Obama's presidency ended on January\u00a020, 2017.", "In an effort to expand on the presidential administration's use of the Internet to reach American citizens, the 2016 State of the Union Address broadcasts live on the White House website, as well as on the White House YouTube channel.", "Senate President pro tempore Orrin Hatch and Secretary of Homeland Security Jeh Johnson were the designated survivors for the 2016 address.", "The Address was watched by 31.3 million viewers.", "The President opened the speech by welcoming the Speaker, Vice President, Members of Congress, and fellow Americans.", "He noted that this was his eighth speech, and promised it would be shorter than usual, joking that he knew \"some of you are antsy to get back to Iowa.\"" ] ], "gold": "George Washington delivered the first State of the Union address before a joint session of Congress on January 8, 1790 in New York City, then the provisional United States capital. In 1801, Thomas Jefferson discontinued the practice of delivering the address in person, regarding it as too monarchical. Instead, the address was written and then sent to Congress to be read by a clerk until 1913 when Woodrow Wilson re-established the practice of an in-person State of the Union address. An in-person address to Congress has been delivered nearly every year since. Starting in 1934, during the first term of Franklin D. Roosevelt, the State of the Union address has typically been given in January. In 1981, Ronald Reagan began the practice of newly inaugurated presidents delivering an address to Congress in February of the first year of their term but not designating that speech as an official State of the Union address. In 2017, Donald Trump, delivered his first his first public address before a joint session of Congress on Tuesday, February 28, 2017 at 9:00 p.m. EST. In 2016, Barack Obama delivered his final State of the Union address on Tuesday, January 12, 2016 at 9:00 p.m. EST. In 2015, Barack Obama delivered his annual State of the Union address on January 20, 2015 at 9:00 p.m. EST.", "prediction 1": "The practice of giving the State of the Union address was discontinued in 1791. The term \"State of the Union\" first emerged in 1934 when Franklin D. Roosevelt used the phrase, becoming its generally accepted name since 1947. The 44th and current United States presidents have delivered the State of the Union address in person since 1801. The 45th and current United States presidents have delivered the address in the spring and fall. The first State of the Union address was given on February 28, 2017, by Donald Trump. The 2016 State of the Union address was given by the 44th United States President Barack Obama on January 12, 2016. The 2016 address was given by the 44th United States Congress in the chamber of the United States House of Representatives. It was the first State of the Union address with Paul Ryan as Speaker of the House of Representatives.", "prediction 2": "The annual State of the Union address first began in 1801 when Thomas Jefferson discontinued the practice of delivering the address in person, regarding it as too monarchical. Instead, the address was written and then sent to Congress to be read by a clerk until 1913 when Woodrow Wilson re-established the practice despite some initial controversy. In the latter half of the 20th century, presidents have sent written State of the Union addresses. The 44th President of the United States, Barack Obama, gave his first public address before a joint session of Congress on Tuesday, February 28, 2017. The 45th President of the United States, Donald Trump, gave his first public address before a joint session of Congress on Tuesday, February 29, 2017. Similar to a State of the Union address, it was delivered before the 115th United States Congress in the chamber of the United States Senate. It was the first State of the Union address with Paul Ryan as Speaker of the House of", "prediction 3": "The State of the Union address started in 1801. However, in the 20th century, it started in 1934, when Franklin D. Roosevelt used the phrase, becoming its generally accepted name since 1947. The 45th president of the United States, Donald Trump, gave his first public address before a joint session of Congress on February 28, 2017. It was the first State of the Union address with Speaker Paul Ryan as Speaker of the House of Representatives.", "prediction 4": "In 1913, Woodrow Wilson re-established the practice of delivering the State of the Union address in person. In 1801 Thomas Jefferson discontinued the practice of delivering the address in person, regarding it as too monarchical, so it was written and then sent to Congress to be read by a clerk until 1913. However, there have been exceptions to this rule, particularly during the latter half of the 20th century when presidents have sent written State of the Union addresses. In 2014, the State of the Union address was given in January. In 2015, the 2015, President Barack Obama gave his first public address before a joint session of Congress on February 28, 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 58, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 224 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 317, "end": 326 }, { "error type": "Unverifiable", "explanation": "", "start": 426, "end": 435 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 436, "end": 464 }, { "error type": "Redundant", "explanation": "The 2016 State of the Union address was given by the 44th United States President Barack Obama on January 12, 2016. ", "start": 638, "end": 664 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 672, "end": 699 }, { "error type": "Irrelevant", "explanation": "", "start": 762, "end": 864 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10, 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": " In 1801, Thomas Jefferson discontinued the practice of delivering the address in person, regarding it as too monarchical. Instead, the address was written and then sent to Congress to be read by a clerk until 1913 when Woodrow Wilson re-established the practice. After 1933, the address has been delivered to Congress in January or February. The 2016 State of the Union Address was the last one given by the 44th United States President Barack Obama on Tuesday, January 12, 2016. The 45th President of the United States, Donald Trump, gave his first public address before a joint session of the United States Congress on Tuesday, February 28, 2017." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "What are the extra books of the bible called?", "passages": [ [ "Deuterocanonical books", "Deuterocanonical books\n\nThe deuterocanonical books (from the Greek meaning \"belonging to the second canon\") are books and passages considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations.", "They are seven books from the Septuagint, the standard translation of the Hebrew Bible in the Hellenistic period, written during the reign of Ptolemy II (283\u2013246 BCE) and referenced extensively in the New Testament, particularly in the Pauline Epistles.", "With the rise of Rabbinic Judaism at the end of the Second Temple Period, the Hebrew Canon was in flux, until the Masoretic Text, compiled between the 7th and 10th centuries, became the authoritative text of the mainstream Rabbinic Judaism.", "The Masoretic Text excluded the seven deuterocanonical books and formed the basis for their exclusion in the Protestant Old Testament.", "The term distinguished these texts both from those that were termed protocanonical books, which were the books of the Hebrew canon; and from the apocryphal books, which were those books of Jewish origin that were known sometimes to have been read in church as scripture but which were considered not to be canonical." ] ], "gold": "The extra books of the Bible are called the deuterocanonical books. The deuterocanonical books are books and passages considered by the Catholic Church, the Eastern Orthodox Church, the Oriental Orthodox Churches and the Assyrian Church of the East to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. The Catholic and Orthodox churches consider Tobit, Judith, Baruch, Letter of Jeremiah, Sirach, 1 Maccabees, 2 Maccabees, Wisdom of Solom, Additions to Esther, and Additions to Daniel to be the extra books. The Orthodox church also includes the Prayer of Manasseh, 1 Esdras, 3 Maccabees, and Psalm 151.", "prediction 1": "The deuterocanonical books are books and passages considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. They are seven books from the Septuagint, the standard translation of the Hebrew Bible in the Hellenistic period, written during the reign of Ptolemy II. The Masoretic Text excluded the seven deuterocanonical books and formed the basis for their exclusion in the Protestant Old Testament.", "prediction 2": "The extra books of the Bible are known as the deuterocanonical books, or books of the second canon, and are considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. The deuterocanonical books are seven books from the Septuagint, the standard translation of the Hebrew Bible in the Hellenistic period, written during the reign of Ptolemy II. The book were excluded from the Masoretic Text, compiled between the 7th and 10th century, became the authoritative text of mainstream Rabbinic Judaism.", "prediction 3": "The deuterocanonical books are books and passages considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. They are seven books from the Septuagint, the standard translation of the Hebrew Bible in the Hellenistic period, written during the reign of Ptolemy II and referenced extensively in the New Testament, particularly in the Pauline Epistles.", "prediction 4": "The deuterocanonical books are books considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. They are seven books from the Septuagint, the standard translation of the Hebrew Bible in the Hellenistic period, written during the reign of Ptolemy II in the 283\u2013246 BCE, referenced extensively in the New Testament, particularly in the Pauline Epistles.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 515 } ], "missing-info": [], "corrected-prediction": "The deuterocanonical books are books and passages considered by the Catholic Church and the Eastern Orthodox Church to be canonical books of the Old Testament but which are considered non-canonical by Protestant denominations. " }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Where did copper come from for bronze age?", "passages": [ [ "Bronze Age Europe", "Immigration brought new people to the islands from the continent.", "Recent tooth enamel isotope research on bodies found in early Bronze Age graves around Stonehenge indicate that at least some of the immigrants came from the area of modern Switzerland.", "The Beaker people displayed different behaviors from the earlier Neolithic people and cultural change was significant.", "Integration is thought to have been peaceful as many of the early henge sites were seemingly adopted by the newcomers.", "The rich Wessex culture developed in southern Britain at this time.", "Additionally, the climate was deteriorating; where once the weather was warm and dry it became much wetter as the Bronze Age continued, forcing the population away from easily defended sites in the hills and into the fertile valleys.", "Large livestock ranches developed in the lowlands which appear to have contributed to economic growth and inspired increasing forest clearances.", "The Deverel-Rimbury culture began to emerge in the second half of the 'Middle Bronze Age' (c. 1400\u20131100 BC) to exploit these conditions.", "Cornwall was a major source of tin for much of western Europe and copper was extracted from sites such as the Great Orme mine in northern Wales.", "Social groups appear to have been tribal but with growing complexity and hierarchies becoming apparent.", "Also, the burial of dead (which until this period had usually been communal) became more individual." ], [ "Copper", "Investment casting was invented in 4500\u20134000 BC in Southeast Asia and carbon dating has established mining at Alderley Edge in Cheshire, UK, at 2280 to 1890 BC.", "\u00d6tzi the Iceman, a male dated from 3300\u20133200 BC, was found with an axe with a copper head 99.7% pure; high levels of arsenic in his hair suggest an involvement in copper smelting.", "Experience with copper has assisted the development of other metals; in particular, copper smelting led to the discovery of iron smelting.", "Production in the Old Copper Complex in Michigan and Wisconsin is dated between 6000 and 3000 BC.", "Natural bronze, a type of copper made from ores rich in silicon, arsenic, and (rarely) tin, came into general use in the Balkans around 5500 BC.", "Alloying copper with tin to make bronze was first practiced about 4000 years after the discovery of copper smelting, and about 2000 years after \"natural bronze\" had come into general use.", "Bronze artifacts from the Vin\u010da culture date to 4500 BC.", "Sumerian and Egyptian artifacts of copper and bronze alloys date to 3000 BC.", "The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe about 2500 BC.", "It ended with the beginning of the Iron Age, 2000\u20131000 BC in the Near East, and 600 BC in Northern Europe." ], [ "Chalcolithic", "The process of transition from Neolithic to Chalcolithic in the Middle East is characterized in archaeological stone tool assemblages by a decline in high quality raw material procurement and use.", "This dramatic shift is seen throughout the region, including the Tehran Plain, Iran.", "Here, analysis of six archaeological sites determined a marked downward trend in not only material quality, but also in aesthetic variation in the lithic artefacts.", "Fazeli et al. use these results as evidence of the loss of craft specialisation caused by increased use of copper tools.", "An archaeological site in Serbia contains the oldest securely dated evidence of coppermaking from 7,500 years ago.", "The find in June 2010 extends the known record of copper smelting by about 800 years, and suggests that copper smelting may have been invented in separate parts of Asia and Europe at that time rather than spreading from a single source.", "In Serbia, a copper axe was found at Prokuplje, which indicates use of metal in Europe by 7,500 years ago (5500\u00a0BCE), many years earlier than previously believed.", "Knowledge of the use of copper was far more widespread than the metal itself.", "The European Battle Axe culture used stone axes modeled on copper axes, even with imitation \"mold marks\" carved in the stone." ] ], "gold": "The Aegean Bronze Age began around 3200 BC, when civilizations first established a far-ranging trade network. This network imported tin and charcoal to Cyprus, where copper was mined and alloyed with the tin to produce bronze. In Britain, the Great Orme copper mine was estimated to have produced enough copper to make about 2,000 tons of bronze during the Bronze Age, which in Britain is considered to have been the period from around 2100 to 750 BC. In Africa, archeologists have discovered that as early as 1000 BC, copper smelting and mining was occurring in Akjoujt, Mauretania. In the Middle East, the Timna Valley, located in Southern Israel, is rich in copper ore and has been mined since the 5th millennium BC. In China, archaeologists have found a number of remains of copper metallurgy in various cultures from the late fourth millennium BC to the early third millennium BC. These remains include the copper-smelting remains and copper artifacts in the Hongshan culture and copper slag at the Yuanwozhen site. Thus, it can be assumed that the inhabitants of the Yellow River valley by the later Yangshao period had already learned how to make copper artifacts.", "prediction 1": "The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe about 2500 BC, and in Northern Europe about 600 BC. Investment casting was invented in 4500\u20134000 BC in Southeast Asia and carbon dating has established mining at Alderley Edge in Cheshire, UK, at 2280 to 1890 BC. Copper was extracted from sites such as the Great Orme mine in northern Wales. The Balkans around 5500 BC was the time when natural bronze, a type of copper made from ores rich in silicon, arsenic, arsenic, arsenic, arsenic, and (rarely) tin, came into general use in the region.", "prediction 2": "Copper for the Bronze Age came from various sources. Investment casting was invented in 4500\u20134000 BC in Southeast Asia. Cornwall was a major source of tin for much of western Europe and copper was extracted from sites such as the Great Orme mine in northern Wales. The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe around 2500 BC, and in Northern Europe around 600 BC.", "prediction 3": "The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe about 2500 BC, and in Northern Europe about 600 BC. Investment casting was invented in 4500\u20134000 BC in Southeast Asia and carbon dating has established mining at Alderley Edge in Cheshire, UK, at 2280 to 1890 BC. Copper was extracted from sites such as the Great Orme mine in northern Wales.", "prediction 4": "The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe about 2500 BC, and in Northern Europe about 600 BC. Recent tooth enamel isotope research on bodies found in early Bronze Age graves around Stonehenge indicate that at least some of the immigrants came from the area of modern Switzerland. Cornwall was a major source of tin for much of western Europe and copper was extracted from sites such as the Great Orme mine in northern Wales.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[10]}", "start": 107, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 440 }, { "error type": "Redundant", "explanation": "a type of copper made from ores rich in silicon, arsenic, ", "start": 499, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 498 }, { "error type": "Irrelevant", "explanation": "", "start": 530, "end": 580 } ], "missing-info": [], "corrected-prediction": "The Bronze Age began in Southeastern Europe around 3700\u20133300 BC, in Northwestern Europe about 2500 BC. Copper was extracted from sites such as the Great Orme mine in northern Wales. " }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who has had the most babies in one pregnancy?", "passages": [ [ "Gravata case", "Gravata case\n\nThe Gravata case was a medical case that happened during the first decades of the 1900s, regarding a Tuscan woman by that name who had many multiple births and in total birthed 62 living children.", "She was born in Tuscany, the twin daughter of a triplet.", "Her first child was a girl.", "Her next pregnancy produced 6 sons, followed by 5 more the next year.", "Then 2 sets of triplets, and a set of quadruplets.", "The next 36 children were single or twin girls.", "The last 4 were boys." ], [ "Suleman octuplets", "Suleman octuplets\n\n", "The Suleman octuplets are six male and two female children conceived via in vitro fertilization (IVF) and subsequently born to Nadya Suleman on January 26, 2009, in Bellflower, California, United States.", "They currently reside in Lancaster, California.", "They are only the second full set of octuplets to be born alive in the United States and, having survived more than a week, surpassed the previous worldwide survival rate for a complete set of octuplets set by the Chukwu octuplets of 1998.", "The extremely controversial circumstances of their high order multiple birth has led to debate in the field of assisted reproductive technology as well as an investigation by the Medical Board of California of the fertility specialist involved, regarding the transfer of twelve embryos at once.", "Suleman's octuplets were conceived by in vitro fertilization (IVF) conducted by Dr. Michael Kamrava.", "Suleman claimed to have requested implantation of six embryos that she had accumulated from previous IVF treatments, despite being informed that the recommended guideline limit for a woman her age was three.", "She stated she wanted all six transferred, as they were all that remained from previous harvest cycles, and she neither wanted to destroy them nor to continue paying for their frozen storage." ], [ "Chukwu octuplets", "Chukwu octuplets\n\nThe Chukwu octuplets were the first set of octuplets live-born in the United States in recorded history.", "The birth happened in 1998.", "The six girls and two boys were born in December 1998 at St. Luke's Episcopal Hospital in Houston, Texas.", "Their parents \u2014 mother, Nkem Chukwu (then 27) and father, Iyke Louis Udobi (then 41) \u2014 are both Nigerian-born American citizens.", "All weighed under two pounds at the time of birth.", "The first born, Ebuka, was delivered on December 8, 15 weeks premature.", "The remaining 7 octuplets were born by Caesarean section on December 20, 13 weeks premature.", "The smallest of the octuplets, Odera, died on December 27, a week after birth (she was the lightest of the 8 babies, weighing just over 300 grams (10\u00a0oz).", "The obstetrician was Brian Kirshon, a well-known physician practicing in Houston.", "The seven remaining octuplets celebrated their 10th birthday in Houston on December 20, 2008, in the company of volunteers who helped in their early years.", "The five girls and two boys are reported to be \"normal, active and bright fourth-graders.\"" ] ], "gold": "The greatest number of healthy babies ever born from one pregnancy is nine. The nonuplets were born to Malian woman Halima Cisse on May 4, 2021. The previous record holder for most surviving babies from a single pregnancy was Nadya Suleman of California, who gave birth to IVF-conceived octuplets in 2009. A number of other instances of octuple and nonuple births have been recorded, but one or more infants have died in each case, such as with the octuplets born to Nkem Chukwu in 1998.", "prediction 1": "The most babies in one pregnancy were born by a woman in the first decade of the 1900s, named Maria Gravata, in which she had 7 children in total. The Gravata case was a medical case that happened during the first decades of the 1900s, regarding a Tuscan woman by that name who had many multiple births and in total birthed 62 living children. The Suleman octuplets were six male and two female children conceived via in vitro fertilization and subsequently born to Nadya Suleman on January 26, 2009, in Bellflower, California, United States. They are only the second full set of octuplets to be born alive in the United States and, having survived more than surpassed the previous worldwide survival rate for a complete set of a complete set of octuplets set by the Chukwu octuplets of", "prediction 2": "The most babies conceived in one pregnancy is 63, with 6 in Italy and 61 in the United States. The most live-born babies in one pregnancy in any country is 62 in the world. The most live-born babies in any country is 63 in the United States.", "prediction 3": "The most babies born in one pregnancy are the Gravata case, which happened in the first decade of the 1900s. The Gravata case was a medical case that happened during the first decades of the 1900s, regarding a Tuscan woman by that name who had many multiple births and in total birthed 62 living children. The Suleman octuplets are six male and two female children conceived via in vitro fertilization and subsequently born to Nadya Suleman on January 26, 2009 in Bellflower, California, United States. The Suleman octuplets are the second full set of octuplets to be born alive in the United States and, having survived more than surpassed the previous worldwide survival rate for a complete set of octuplets set by the Chukwu octuplets of octuplets set of", "prediction 4": "The most babies born in one pregnancy by a woman is 62, which is 73 more than the record held by a woman named Gravata who had many multiple births and in total birthed 62 living children. The most babies born by a single woman is a set of triplets by Nkem Chukwu, who had seven live births in 1998. The most babies born by multiple births by a single woman is the octuplets by Nadya Suleman, who had two weeks after birth, they survived more than a week and surpassed the previous worldwide survival rate for a complete set of octuplets set by the Chukwu octuplets of 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 343 } ], "missing-info": [], "corrected-prediction": "The Suleman octuplets were six male and two female children conceived via in vitro fertilization and subsequently born to Nadya Suleman on January 26, 2009, in Bellflower, California, United States. They are only the second full set of octuplets to be born alive in the United States and, having survived more than surpassed the previous worldwide survival rate for a complete set of a complete set of octuplets set by the Chukwu octuplets of 1998." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What team does steph curry brother play for?", "passages": [ [ "Stephen Curry", "On December 28, Curry recorded his sixth career triple-double with 23 points, a career-high 14 rebounds and 10 assists in a 122\u2013103 win over the Sacramento Kings.", "During the game against the Kings, Curry was guarded by his brother Seth for the first time in their NBA careers.", "On January 22, he recorded his second triple-double of the season and seventh of his career with 39 points, 12 assists and 10 rebounds in a 122\u2013110 win over the Indiana Pacers.", "He made eight three-pointers in the game to reach 200 for the season, becoming the first player in NBA history to make 200 three-pointers in four straight seasons.", "On February 3, he made 11 three-pointers (including seven in the first quarter) and scored 51 points (including a career-high 36 points in the first half) to lead the Warriors past the Washington Wizards 134\u2013121.", "His 51 points tied Gilbert Arenas and Michael Jordan for the Verizon Center record.", "During the 2016 NBA All-Star Weekend, Curry competed in his third straight All-Star game for the West, and competed in the Three-Point Shootout, where he lost in the final round to teammate Klay Thompson." ], [ "Seth Curry", "Seth Curry\n\nSeth Adham Curry (born August 23, 1990) is an American professional basketball player for the Portland Trail Blazers of the National Basketball Association (NBA).", "He played college basketball for one year with the Liberty Flames before transferring to the Duke Blue Devils.", "He is the son of former NBA player Dell Curry and the younger brother of NBA player Stephen Curry.", "Curry grew up in Charlotte, North Carolina, while his father, Dell, played for the Charlotte Hornets.", "As a child, Curry's father would take him and his older brother, Stephen, to his games where they would often shoot around with the team in warm-ups.", "Curry is a 2008 graduate of Charlotte Christian School where he was a three-year starter for the Knights' basketball team.", "His senior year, Curry averaged 22.3 points, 5.0 rebounds, and 5.0 assists while shooting 52 percent from the field.", "At the end of the season, he earned all-conference, all-state, and first team SAA All-American accolades.", "In his three years on varsity, Charlotte Christian amassed a 105\u201324 overall record including a state final appearance in 2006.", "Curry was also on the Charlotte Christian academic honor roll all four years.", "After high school, Curry chose to attend Liberty University.", "In his freshman season at Liberty, he led all freshmen nationally in average points per game scored with 20.2 a game." ], [ "Eddy Curry", "Eddy Curry\n\nEddy Anthony Curry Jr. (born December 5, 1982) is an American professional basketball player for the Wolf Warriors of the ASEAN Basketball League (ABL).", "Coming directly out of Thornwood High School in South Holland, Illinois, Curry was selected fourth overall in the 2001 NBA draft by the Chicago Bulls.", "Curry played for the Bulls until 2005, then played for the New York Knicks from 2005 to 2010.", "Curry played for the Miami Heat in the season and was part of the Heat's 2012 championship team.", "Curry played for the Dallas Mavericks for the early part of the season before playing out the season for the Zhejiang Golden Bulls of the Chinese Basketball Association.", "Prior to becoming considered one of the best high school basketball players in the nation as a senior at Thornwood High School in South Holland, Illinois, Curry aspired to be a gymnast and did not pick up basketball until the seventh grade when he reluctantly went out for the school team.", "In 2001, Curry led his team to second place in the IHSA State Playoffs.", "For his efforts, Curry was named 2001 Illinois Mr. Basketball.", "In his senior year of high school he posted averages of 22 points per game, 9 rebounds and 6 blocks.", "He was named to the 1998, 1999 and 2000 State Farm Holiday Classic all-tournament teams, and in 2003 was named by the fans to the tournament's All-Quarter Century Team." ] ], "gold": "Seth Curry is an American professional basketball player, son of former NBA player Dell Curry and the younger brother of NBA player Stephen Curry. He played college basketball for one year with the Liberty Flames before transferring to the Duke Blue Devils, and has later been part of various NBA teams. He currently plays for the Philadelphia 76ers, but his career took him to the Dallas Mavericks during the 2016-2017 season, the Sacramento Kings, where he played since July 2015, and the Phoenix Suns, team in which he debuted on March 11, 2015.", "prediction 1": "Seth Curry is an American professional basketball player for the Portland Trail Blazers of the National Basketball Association (NBA). He is the younger brother of Stephen Curry and is part of the San Antonio Spurs basketball team. Eddy Curry is an American professional basketball player for the Wolf Warriors of the ASEAN Basketball League (ABL).", "prediction 2": "Seth Curry is a professional basketball player for the Portland Trail Blazers of the National Basketball Association. He is the younger brother of Stephen Curry and the younger brother of Eddy Curry.", "prediction 3": "Seth Curry is an American professional basketball player for the Portland Trail Blazers of the National Basketball Association, while his older brother Stephen Curry plays for the Cleveland Cavaliers. Seth Curry, born August 23, 1990, is an American professional basketball player for the San Antonio Spurs of the Western Conference. He also plays for the Wolf Warriors of the ASEAN Basketball League, while his younger brother Stephen Curry, born on December 15, 1988, is an American professional basketball player for the San Antonio Spurs.", "prediction 4": "Seth Curry, the younger brother of Stephen Curry, is a professional basketball player for the Portland Trail Blazers of the National Basketball Association. Seth Curry was a three-year starter for the Charlotte Christian Knights' basketball team and played for the Miami Heat from 2005 to 2010.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 184, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 347 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Seth Curry is an American professional basketball player for the Portland Trail Blazers of the National Basketball Association (NBA). He is the son of former NBA player Dell Curry and the younger brother of Stephen Curry. He played college basketball for one year with the Liberty Flames before transferring to the Duke Blue Devils." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who won the super bowl on february 6 2011?", "passages": [ [ "Super Bowl XLV", "2010s: 2011.", "The Green Bay Packers finished the season with a 10\u20136 record and became the first number 6-seeded team in the NFC to compete in the Super Bowl.", "They are only the second number 6 seeded team to reach the Super Bowl, with the only other number 6 seed to accomplish this feat being the Pittsburgh Steelers, who won Super Bowl XL following the 2005 season.", "Green Bay also joined the 2005 Steelers as the only teams ever to defeat the top three seeded teams on the road in the playoffs.", "In order to secure their fifth Super Bowl bid they defeated their longtime rivals, the Chicago Bears, in the NFC Championship Game at Soldier Field.", "The offense was led by quarterback Aaron Rodgers, who was in his third year as a starter after taking over for the team's all-time leading passer Brett Favre.", "Rodgers finished the season completing 65.7% of his passes for 3,922\u00a0yards and 28 touchdowns, with only eleven interceptions, giving him his second consecutive season with a triple digit passer rating (101.2).", "He was also a good rusher, adding 356\u00a0yards and 4 touchdowns on the ground.", "His top target was pro bowl receiver Greg Jennings, who caught 76 passes for 1,265\u00a0yards and 12 touchdowns, giving him a 16.6\u00a0yards per catch average while also ranking him fourth in the NFL in yards and second in touchdown catches." ], [ "Super Bowl XLV", "Super Bowl XLV\n\nSuper Bowl XLV was an American football game between the American Football Conference (AFC) champion Pittsburgh Steelers and the National Football Conference (NFC) champion Green Bay Packers to decide the National Football League (NFL) champion for the 2010 season.", "The Packers defeated the Steelers by the score of 31\u201325.", "The game was played on February 6, 2011 at Cowboys Stadium in Arlington, Texas, the first time the Super Bowl was played in the Dallas\u2013Fort Worth area.", "Unlike most other Super Bowls, this game featured two title-abundant franchises: coming into the game, the Packers held the most NFL championships with 12 (9 league championships prior to the Super Bowl era and 3 Super Bowl championships), while the Steelers held the most Super Bowl championships with 6.", "The Packers entered their fifth Super Bowl in team history, and became the first number 6-seeded team in the NFC to compete in the Super Bowl, after posting a 10\u20136 regular season record.", "The Steelers finished the regular season with a 12\u20134 record, and advanced to a league-tying 8th Super Bowl appearance.", "Green Bay dominated most of the first half of Super Bowl XLV, jumping to a 21\u20133 lead before Pittsburgh cut it down to 21\u201310 just before halftime." ], [ "Super Bowl XLV", "The Steelers had one of the league's top defenses, leading the NFL in sacks (48), and fewest points (14.5) and rushing yards (62.8) allowed per game, while ranking second in fewest total yards (276.8).", "The line was anchored by pro bowl end Brett Keisel.", "The Steelers also had four excellent linebackers: LaMarr Woodley, James Harrison, James Farrior, and Lawrence Timmons.", "For the third consecutive year, Woodley and Harrison each recorded at least 10 sacks.", "Woodley also forced three fumbles and Harrison forced six.", "Farrior had 109 total tackles and six sacks.", "Timmons led the team with 135 total tackles, while also recording three sacks and two interceptions.", "The secondary was led by pro bowl safety Troy Polamalu, who won the NFL Defensive Player of the Year Award, tying his career-best seven interceptions and returning them for 101\u00a0yards and a touchdown.", "Coach Mike Tomlin, already the youngest coach to ever win a Super Bowl, became the youngest coach ever to make it to the Super Bowl twice at age 38.", "The Pittsburgh Steelers had also accomplished going to the Super Bowl in five different decades; and, in every decade since the post AFL-NFL merger.", "1970s: 1975, 1976, and 1979.", "1980s:", "1980. 1990s: 1996.", "2000s: 2006 and 2009." ] ], "gold": "The Super Bowl XLV, held on February 6, 2011, was an American football game between the American Football Conference champion Pittsburgh Steelers, coached by Mike Tomlin, and the National Football Conference (NFC) champion Green Bay Packers, coached by Mike McCarthy. The Packers won the match by the score of 31\u201325 and declared themselves champions of the 2010 Season.", "prediction 1": "The 2011 Super Bowl was between the Pittsburgh Steelers and the Green Bay Packers. The Green Bay Packers, who had been the number 6 seed in the NFC, defeated the Pittsburgh Steelers 31\u201325 in the regular season to decide the National Football League champion for the 2010 season.", "prediction 2": "The Super Bowl was played on February 6, 2011 between the Pittsburgh Steelers and the Green Bay Packers to decide the National Football League champion for the 2010 season. The game was played at Cowboys Stadium in Arlington, Texas, the first time the Super Bowl was played in the Dallas\u2013Fort Worth area. The Steelers won the game by a score of 31\u201325, with Troy Polamalu winning the NFL Defensive Player of the Year Award.", "prediction 3": "The 2011 Super Bowl was between the Pittsburgh Steelers and the Green Bay Packers, a rival team from the National Football Conference. The Packers defeated the Steelers 31\u201325 in the first half of the game to decide the National Football League champion for the 2010 season. Troy Polamalu, who won the NFL Defensive Player of the Year Award, tied his career-best seven interceptions and returned them for 101 yards and a touchdown.", "prediction 4": "The Green Bay Packers defeated the Pittsburgh Steelers 31\u201325 in the 2011 Super Bowl. This game was played at Cowboys Stadium in Arlington, Texas, the first time the Super Bowl was played in the Dallas\u2013Fort Worth area.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 148 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Super Bowl XLV was an American football game between the American Football Conference (AFC) champion Pittsburgh Steelers and the National Football Conference (NFC) champion Green Bay Packers held on Febuary 6, 2011. The Green Bay Packers defeated the Pittsburgh Steelers 31\u201325 in the regular season to decide the National Football League champion for the 2010 season." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When did fast and furious 8 came out?", "passages": [ [ "The Fate of the Furious", "The prop struck two horses: one was wounded and the other mortally injured; it was later euthanized.", "In late April, filming began in Cuba's capital city, Havana.", "In May, filming also took place in Cleveland, Ohio.", "Franchise cinematographer Stephen F. Windon returned for the eighth installment.", "Filming also took place in Atlanta and New York City.", "Brian Tyler, who scored the third, fourth, fifth, and seventh installments, was tapped to compose the film score for the eighth picture.", "A soundtrack album by Atlantic Records was released on April 14, 2017, coinciding with the film's US theatrical release.", "The film's score album was released on April 27, by Back Lot Music.", "\"The Fate of the Furious\" had its world premiere in Berlin on April 4, 2017.", "The film was theatrically released in the United States on April 14, 2017, playing in 3D, IMAX 3D, and 4DX internationally, and received a day-and-date release across major markets such as Australia, the United Kingdom, China, and India, beginning on April 12, 2017.", "The film was released day-and-date in 1,074 IMAX screens around the world, making it the widest day-and-date opening in IMAX history." ], [ "The Fate of the Furious", "\"The Fate of the Furious\" was released on 4K, Blu-ray, DVD and Digital HD on July 11, 2017.", "\"The Fate of the Furious\" grossed $226 million in the United States and Canada and $1.010 billion in other territories for a worldwide total of $1.236 billion, against a production budget of $250 million ($350 million including marketing costs).", "It is Universal Pictures' most ambitious worldwide distribution release in the studio's history.", "The film was released day-and-date in 64 territories worldwide, including almost all major markets (minus Japan), starting from April 12, 2017, and was projected to earn anywhere between $375\u2013440 million in its five-day opening weekend.", "By the end of the weekend, it ended up earning $539.9 million from nearly 23,000 screens, way above initial projections, to score the biggest global opening in cinematic history.", "It also marked the third time that a film earned over $500 million in a single weekend, after \"\" ($529 million) and \"Jurassic World\" ($525.5 million).", "In IMAX, the film made $31.1 million from 1,079 screens to record the biggest IMAX April debut and the fourth-biggest overall." ], [ "The Fate of the Furious", "The Fate of the Furious\n\nThe Fate of the Furious (alternatively known as Fast & Furious 8 and Fast 8, and often stylized as F8) is a 2017 American action film directed by F. Gary Gray and written by Chris Morgan.", "It is the eighth installment in \"The Fast and the Furious\" franchise.", "The film stars Vin Diesel, Dwayne Johnson, Jason Statham, Michelle Rodriguez, Tyrese Gibson, Chris \"Ludacris\" Bridges, Scott Eastwood, Nathalie Emmanuel, Elsa Pataky, Kurt Russell and Charlize Theron.", "\"The Fate of the Furious\" follows Dominic Toretto (Diesel), who has settled down with his wife Letty Ortiz (Rodriguez), until cyberterrorist Cipher (Theron) coerces him into working for her and turns him against his team, forcing them to find Dom and take down Cipher.", "\"The Fate of the Furious\" marks the first installment in the franchise since \"\" (2006) not to feature both Paul Walker, who died in a single-vehicle crash during the filming of \"Furious 7\" (2015) on November 30, 2013, and Jordana Brewster.", "Script rewrites to the seventh installment after Walker's death were intended to complete the story arcs for both of their characters (Brian O'Conner and Mia Toretto, respectively)." ] ], "gold": "The action thriller film The Fate of the Furious, also known as Fast & Furious 8 or F8, had its world premiere in Berlin on April 4, 2017. The film was released in the United States on April 14, 2017, and elsewhere in major global markets beginning on April 12, 2017. With an estimated production budget of up to $270 million, F8 is one of the most expensive films ever made, and released on 1,074 IMAX screens worldwide in the widest day-and-date opening in IMAX history.", "prediction 1": "The Fast and Furious 8 is a 2017 American action film directed by F. Gary Gray and written by Chris Morgan. The film had its world premiere in Berlin on April 4, 2017. The film was theatrically released in the United States on April 14, 2017.", "prediction 2": "The Fast and the Furious: The Fate of the Furious was a 2017 American action film directed by F. Gary Gray and written by Chris Morgan. Filming began in Cuba's capital city, Havana, in late April, and the United States premiered it on April 14, 2017. The film was released day-and-date in 64 territories worldwide, including almost all major markets, including Japan, Australia, the United Kingdom, China, and India, beginning on April 12, 2017.", "prediction 3": "Fast & Furious 8 is a 2017 American action film directed by F. Gary Gray and written by Chris Morgan. The film premiered in Berlin on April 4, 2017, and was released theatrically in the United States on April 14, 2017.", "prediction 4": "The Fast and Furious film franchise has a total of seven installments: Fast, Furious 7, and Fast 8. Fast & Furious 8 was released on April 14, 2017 in the United States, on April 12, 2017 in Australia, on April 13, 2017 in the United Kingdom, on April 12, 2017, and in 64 territories worldwide, including almost all major markets (excluding Japan) beginning on April 12, 2017. The film was released day-and-date in 1,074 IMAX screens around the world, making it the widest day-and-date opening in cinematic history.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 4, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 107 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Fate of the Furious film, also known as Fast & Furious 8 or F8, had its world premiere in Berlin on April 4, 2017. The film was theatrically released in the United States on April 14, 2017, and elsewhere in major global markets beginning on April 12, 2017. The production budget of the film was $250 million The film was released day-and-date in 1,074 IMAX screens around the world, making it the widest day-and-date opening in IMAX history." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "When was the east india company established in india?", "passages": [ [ "East India Company", "Before them the Portuguese Estado da \u00cdndia had traded there for much of the 16th century and the first of half a dozen Dutch Companies sailed to trade there from 1595.", "These Dutch companies amalgamated in March 1602 into the United East Indies Company (VOC), which introduced the first permanent joint stock from 1612 (meaning investment into shares did not need to be returned, but could be traded on a stock exchange).", "By contrast, wealthy merchants and aristocrats owned the EIC's shares.", "Initially the government owned no shares and had only indirect control until 1657 when permanent joint stock was established.", "During its first century of operation, the focus of the company was trade, not the building of an empire in India.", "Company interests turned from trade to territory during the 18th century as the Mughal Empire declined in power and the East India Company struggled with its French counterpart, the French East India Company (\"Compagnie fran\u00e7aise des Indes orientales\") during the Carnatic Wars of the 1740s and 1750s.", "The battles of Plassey and Buxar, in which the British defeated the Bengali powers, left the company in control of Bengal and a major military and political power in India." ], [ "East India Company", "East India Company\n\nThe East India Company (EIC), also known as the Honourable East India Company (HEIC) or the British East India Company and informally as John Company, Company Bahadur, or simply The Company, was an English and later British joint-stock company.", "It was formed to trade in the Indian Ocean region, initially with Mughal India and the East Indies (Maritime Southeast Asia), and later with Qing China.", "The company ended up seizing control over large parts of the Indian subcontinent, colonized parts of Southeast Asia, and colonized Hong Kong after a war with Qing China.", "Originally chartered as the \"Governor and Company of Merchants of London trading into the East Indies\", the company rose to account for half of the world's trade, particularly in basic commodities including cotton, silk, indigo dye, salt, spices, saltpetre, tea, and opium.", "The company also ruled the beginnings of the British Empire in India.", "In his speech to the House of Commons in July 1833, Lord Macaulay explained that since the beginning, the East India company had always been involved in both trade and politics, just as its French and Dutch counterparts had been.", "The company received a Royal Charter from Queen Elizabeth I on 31 December 1600, coming relatively late to trade in the Indies." ] ], "gold": "Throughout history, there have been many different companies named East India Company that were established in India. For instance, a British joint-stock company was founded in 1600 to trade in the Indian Ocean region, initially with the East Indies and later with Qing China. On the other hand, the Dutch East India Company was established in 1602 and later became the first among its namesakes to introduce a permanent joint stock in 1612. There was also a Portuguese East India Company, which was established in 1628.", "prediction 1": "The East India Company, also known as the Honourable East India Company, or the British East India Company, was a joint-stock company founded in 1657 to trade in the Indian Ocean region, initially with Mughal India and the East Indies (Maritime Southeast Asia), and later with Qing China. The company received a Royal Charter from Queen Elizabeth I on 31 December 1600, coming relatively late to trade in the Indies. The company received a Royal Charter from King James II on 17 July 1615.", "prediction 2": "The East India Company, also known as the Honourable East India Company, or the British East India Company, was formed in 1657 to trade in the Indian Ocean region, initially with Mughal India and the East Indies and later with Qing China. It received a Royal Charter from Queen Elizabeth I on 31 December 1600, coming relatively late to trade in the Indies.", "prediction 3": "The East India Company, also known as the Honourable East India Company or the British East India Company, was established on 31 December 1600 in India. The company received a Royal Charter from Queen Elizabeth I on 31 December 1600, coming relatively late to trade in the Indies.", "prediction 4": "The East India Company was an English and later British joint-stock company, originally chartered as the \"Governor and Company of Merchants of London trading into the East Indies\", which rose to account for half the world's trade, particularly in basic commodities including cotton, silk, indigo dye, salt, spices, saltpetre, tea, and opium, and ruled the beginnings of the British Empire in India. The company received a Royal Charter from Queen Elizabeth I on 31 December 1600, coming relatively late to trade in the Indies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 416 }, { "error type": "Unverifiable", "explanation": "", "start": 417, "end": 489 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The East India Company, also known as the Honourable East India Company, or the British East India Company, was a joint-stock company founded in 1657 to trade in the Indian Ocean region, initially with Mughal India and the East Indies (Maritime Southeast Asia), and later with Qing China. The Dutch East India Company was established in 1602 and later became the first among its namesakes to introduce a permanent joint stock in 1612. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first star wars movie air?", "passages": [ [ "Star Wars: Episode I \u2013 The Phantom Menace", "Star Wars: Episode I \u2013 The Phantom Menace\n\nStar Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox.", "It is the first installment in the \"Star Wars\" prequel trilogy and stars Liam Neeson, Ewan McGregor, Natalie Portman, Jake Lloyd, Ian McDiarmid, Anthony Daniels, Kenny Baker, Pernilla August, and Frank Oz.", "The film is set 32 years before the original film, and follows Jedi Knight Qui-Gon Jinn and his apprentice Obi-Wan Kenobi as they protect Queen Amidala in hopes of securing a peaceful end to a large-scale interplanetary trade dispute.", "Joined by Anakin Skywalker\u2014a young slave with unusually strong natural powers of the Force\u2014they simultaneously contend with the mysterious return of the Sith.", "Lucas began production of this film after he determined that film special effects had advanced to the level he wanted for the fourth film in the saga.", "Filming started on June 26, 1997, at locations including Leavesden Film Studios and the Tunisian desert.", "Its visual effects included extensive use of computer-generated imagery (CGI); many of its characters and settings were completely computerized." ], [ "Star Wars (film)", "After two weeks William Friedkin's \"Sorcerer\" replaced \"Star Wars\" at Mann's Chinese Theatre because of contractual obligations; Mann Theatres moved the film to a less-prestigious location after quickly renovating it.", "When \"Star Wars\" made an unprecedented second opening at Mann's Chinese Theatre on August 3, 1977, after \"Sorcerer\" failed, thousands of people attended a ceremony in which C-3PO, R2-D2 and Darth Vader placed their footprints in the theater's forecourt.", "At that time \"Star Wars\" was playing in 1,096 theaters in the United States.", "Approximately 60 theaters played the film continuously for over a year; in 1978, Lucasfilm distributed \"Birthday Cake\" posters to those theaters for special events on May 25, the one-year anniversary of the film's release.", "\"Star Wars\" premiered in the UK on December 27, 1977.", "News reports of the film's popularity in America caused long lines to form at the two London theaters that first offered the film; it became available in 12 large cities in January 1978, and other London theaters in February.", "\"Star Wars\" was re-released theatrically in 1978, 1979, 1981 and 1982." ], [ "Star Wars: Episode I \u2013 The Phantom Menace", "The film was Lucas' first directorial effort after a 22-year hiatus following \"Star Wars\" in 1977.", "\"The Phantom Menace\" was released in theaters on May 19, 1999, almost 16 years after the premiere of the previous \"Star Wars\" film, \"Return of the Jedi\".", "The film's premiere was extensively covered by media and was greatly anticipated because of the large cultural following the \"Star Wars\" saga had cultivated.", "It received mixed reviews; critics praised the visuals, action sequences, John Williams' musical score and some of the performances, but criticized the screenplay, characterization, and Ahmed Best and Jake Lloyd's performances (as Jar Jar Binks and Anakin Skywalker respectively).", "It grossed more than $924.3 million worldwide during its initial theatrical run, becoming the highest-grossing film of 1999, the second-highest-grossing film worldwide and in North America (behind \"Titanic),\" as well as the highest-grossing \"Star Wars\" film at the time.", "A 3D reissue, which has earned an additional $102.7 million at the box office and brought the film's overall worldwide takings to over $1 billion, was released in February 2012.", "The film was followed by two sequels, \"\" in 2002 and \"\" in 2005." ] ], "gold": "Star Wars, retroactively titled Star Wars: Episode IV: A New Hope, is a 1977 American epic space-opera film written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. Star Wars was released in a limited number of theaters in the United States on May 25, 1977, and quickly became a blockbuster hit, leading to it being expanded to a much wider release. Star Wars: Episode I: The Phantom Menace is a 1999 American epic space-opera film written and directed by George Lucas, produced by Lucasfilm, distributed by 20th Century Fox. The Phantom Menace aired in Los Angeles on May 16, 1999, and was released in theaters on May 19, 1999, almost 16 years after the premiere of Return of the Jedi.", "prediction 1": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. It is the first installment in the \"Star Wars\" prequel trilogy and follows Jedi Knight Qui-Gon Jinn and his apprentice Obi-Wan Kenobi as they protect Queen Amidala in hopes of securing a peaceful end to a large-scale interplanetary trade dispute. The film premiered in the UK on December 27, 1977.\n", "prediction 2": "Star Wars: Episode I \u2013 The Phantom Menace premiered in the UK on December 27, 1977 and in the US on January 4, 1978. American epic space opera Star Wars: Episode I \u2013 The Phantom Menace premiered in the US on May 19, 1999, almost 16 years after the premiere of the previous Star Wars film, Return of the Jedi.", "prediction 3": "The first Star Wars movie, Episode I \u2013 The Phantom Menace, premiered in the UK on December 27, 1977. In the United States, the film premiered on December 31, 1977 and in 1999 the first installment of the Star Wars prequel trilogy, which consisted of three films. They were: Episode IV - The Phantom Menace, released in theaters on May 19, 1999, and Episode V - The Rise of Skywalker, released on July 23, 2000.", "prediction 4": "The first Star Wars movie, Episode I, premiered in the UK on December 27, 1977. The first Star Wars film, Episode I: The Phantom Menace, was released in the US on March 12, 1999. The first and only prequel to the original Star Wars film, Episode IV - The Clone Wars, premiered in the UK on December 27, 1977.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 421 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 422, "end": 430 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. It was released in theaters on May 19, 1999, almost 16 years after the premiere of the previous \"Star Wars\" film, \"Return of the Jedi\". \"Star Wars\" premiered in the UK on December 27, 1977. It also aired on August 3, 1977, a second airing after its first airing sometime earlier. \"Star Wars\" was re-released theatrically in 1978, 1979, 1981 and 1982.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What is the literacy rate in the dominican republic?", "passages": [ [ "Education in the Dominican Republic", "Education in the Dominican Republic\n\nIn the Dominican Republic, education is free and compulsory at the elementary level, and free but non-mandatory at the secondary level.", "It is divided into four stages:\n\nLiteracy rates and school participation in the Dominican Republic has risen over the past years.", "Through these efforts, women have reported fast upward movement in social class partially due to increased education.", "There have been numerous efforts to evaluate teachers, students, and facilities through examinations.", "Teachers in the Dominican Republic rate higher in multiple aspects than other countries in Latin America, however, still rank below many other countries.", "The school conditions vary based on whether the school is private, polytechnic, or public non-polytechnic, with decreasing quality facilities respectively.", "A very similar trend has been found in student performance.", "Despite advances in the education system, there are still issues in regards to gender inequality, participation in the education system, and involvement of outside organizations.", "Literacy is defined by the NCES as having the ability to use printed and written information to function in society, to achieve one\u2019s goals, and to develop one\u2019s knowledge and potential.", "According to the CIA World Factbook, 91.8% of the population over the age of 15 is considered literate.", "Literacy for females is listed at 92.3% while literacy for males is listed at 91.2%.", "Compared to the world, these numbers are higher than the average." ] ], "gold": "Literacy rates and school participation in the Dominican Republic has risen over the past years. The overall literacy rate today in the Dominican Republic is 91.8%. For females, the percentage is 92.3% and for males it is 91.2%.", "prediction 1": "Literacy rates in the Dominican Republic are 91.8%, 92.3%, 91.2%, and 91.2%.", "prediction 2": "Literacy rates and school participation in the Dominican Republic has risen over the past years, as women have reported fast upward movement in social class partially due to increased education. Literacy rates and school participation are defined by the NCES as having the ability to use printed and written information to function in society, to achieve one\u2019s goals, and to develop one\u2019s knowledge and potential.", "prediction 3": "In the Dominican Republic, literacy rates and school participation have risen over the past years. According to the CIA World Factbook, 91.8% of the population over the age of 15 is considered literate. Literacy for females is listed at 92.3% while literacy for males is listed at 91.2%.", "prediction 4": "Literacy rates in the Dominican Republic range from 91.8% to 92.3%, with male literacy at 91.2%.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 76 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "Literacy rates and school participation in the Dominican Republic has risen over the past years. According to the CIA World Factbook, 91.8% of the population over the age of 15 is considered literate. Literacy for females is listed at 92.3% while literacy for males is listed at 91.2%." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who is the female in the at&t commercial?", "passages": [ [ "Milana Vayntrub", "Vayntrub and Stevie Nelson teamed up to start the YouTube comedy channel \"Live Prude Girls\" where they produced a number of shorts and the hit web series \"Let's Talk About Something More Interesting\".", "Live Prude Girls went on to be featured on \"NewMediaRockstars\" Top 100 Channels countdown, ranked at No. 93.", "Vayntrub has had small roles in film and television, including \"Life Happens\".", "She has also starred in several \"CollegeHumor\" videos.", "In 2011, Vayntrub was the lead in the music video for \"Teenage Tide\" by Letting Up Despite Great Faults.", "She appeared as Tara in two episodes of the sitcom \"Silicon Valley\".", "Since November 2013, she has portrayed a saleswoman named \"Lily Adams\" in a series of TV commercials for AT&T.", "She also portrayed Tina Shukshin on the Yahoo!", "Screen original series \"Other Space\".", "In January 2016, after visiting Greece and meeting with refugee families fleeing the Syrian Civil War, Vayntrub co-founded a website and social media movement called #CantDoNothing to spotlight the European migrant crisis.", "She appeared in the television series \"This Is Us\" as Sloane Sandburg, author and co-star of the play in which Kevin Pearson is starring in New York." ], [ "Milana Vayntrub", "Milana Vayntrub\n\nMilana Aleksandrovna Vayntrub (; Uzbek Cyrillic: \u041c\u0438\u043b\u0430\u043d\u0430 \u0410\u043b\u0435\u043a\u0441\u0430\u043d\u0434\u0440\u043e\u0432\u043d\u0430 \u0412\u0430\u0439\u043d\u0442\u0440\u0443\u0431; born March 8, 1987) is an Uzbekistan-born American actress and comedian.", "She plays the character Lily Adams in a series of AT&T television commercials.", "Vayntrub has appeared in short films and in the web series \"Let's Talk About Something More Interesting\", co-starring Stevie Nelson.", "She starred in the Yahoo!", "Screen series \"Other Space\".", "She is set to star as Doreen Green / Squirrel Girl in the \"New Warriors\" television series set in the Marvel Cinematic Universe.", "Vayntrub was born in Tashkent, Uzbek Soviet Socialist Republic, and is Jewish.", "When she was two and a half years old, she and her parents immigrated to the U.S. as refugees, settling in West Hollywood.", "She started acting in Mattel Barbie commercials at the age of five, due in part to her family's financial problems.", "Vayntrub briefly attended Beverly Hills High School, but dropped out after her sophomore year, got a GED, and went on to earn a Bachelor of Arts in Communication from University of California, San Diego.", "She studied improv comedy at the Upright Citizens Brigade Theater." ] ], "gold": "From 2013 to 2016, AT&T TV released a series of commercials that starred Lyly Adams, a saleswoman played by actress Milana Vayntrub.", "prediction 1": "Milana Aleksandrovna Vayntrub is an American actress and comedian. She plays the character Lily Adams in a series of AT&T television commercials. The female lead in the AT&T commercial is the saleswoman and a member of the AT&T sales team. In the AT&T ad, the female lead is the receptionist.", "prediction 2": "Since November 2013, Milana Aleksandrovna Vayntrub has portrayed a saleswoman named Lily Adams in a series of AT&T television commercials. Vayntrub plays Lily Adams, a sales person for AT&T. She also portrayed Tina Shukshin on the Yahoo! Screen original series Other Space.", "prediction 3": "Milana Aleksandrovna Vayntrub is an American actress and comedian. Since November 2013, she has portrayed a saleswoman named \"Lily Adams\" in a series of AT&T television commercials. She also portrayed Tina Shukshin on the Yahoo! Screen original series \"Other Space\".", "prediction 4": "Milana Vayntrub, an American actress and comedian, plays the character Lily Adams in a series of AT&T television commercials. In the first and second spots, Lily Adams is the female salesperson from AT&T. In the second and third spots, Lily Adams is the female salesperson from AT&T.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The female lead in the AT&T commercial is the saleswoman and a member of the AT&T sales team. ", "start": 240, "end": 292 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 239 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Milana Aleksandrovna Vayntrub is an American actress and comedian. She plays the character Lily Adams, a saleswoman, in a series of AT&T television commercials starting in 2013. " }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who drives the number 43 car in nascar?", "passages": [ [ "Darrell Wallace Jr.", "Darrell Wallace Jr.\n\n", "Darrell \"Bubba\" Wallace Jr. (born October 8, 1993) is an American professional stock car racing driver.", "He currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 43 Chevrolet Camaro ZL1 for Richard Petty Motorsports, part-time in the Camping World Truck Series, driving the No. 20 Chevrolet Silverado for Young's Motorsports, and part-time in the NASCAR K&N Pro Series East, driving the No. 27 for Jefferson-Pitts Racing.", "Previously, Wallace was signed as a development driver for Joe Gibbs Racing where Wallace competed in the Camping World Truck Series, driving the No. 54 Toyota Tundra for Kyle Busch Motorsports.", "He also raced in the Xfinity Series, driving the No. 6", "Ford Mustang of Roush Fenway Racing, from 2015 to mid 2017.", "Wallace is noted for being one of the most successful African American drivers in the history of NASCAR.", "The son of Darrell Wallace Sr. and Desiree Wallace, Wallace was born in Mobile, Alabama, and grew up in Concord, North Carolina.", "His father, Darrell Sr., is the owner of an industrial cleaning company.", "His mother, Desiree, is a social worker who ran track at the University of Tennessee.", "Wallace is best friends with fellow driver and competitor Ryan Blaney." ], [ "Richard Petty", "Richard Petty\n\nRichard Lee Petty (born July 2, 1937), nicknamed The King, is a former NASCAR driver and voice actor who raced in the Strictly Stock/Grand National Era and the NASCAR Winston Cup Series.", "He won the NASCAR Championship seven times (Dale Earnhardt and Jimmie Johnson are the only other drivers to accomplish this feat), winning a record 200 races during his career, winning the Daytona 500 a record seven times, and winning a record 27 races (10 of them consecutively) in the 1967 season alone.", "Statistically, he is the most accomplished driver in the history of the sport and is one of the most respected figures in motorsports as a whole.", "He also collected a record number of poles (127) and over 700 Top 10 finishes in his 1,184 starts, including 513 consecutive starts from 1971\u20131989.", "Petty was the only driver to ever win in his 500th race start, until Matt Kenseth joined him in 2013.", "He was inducted into the inaugural class of the NASCAR Hall of Fame in 2010.", "Petty is a second generation driver.", "His father, Lee Petty, won the first Daytona 500 in 1959 and was also a three-time NASCAR champion.", "His son Kyle was also a NASCAR driver.", "His grandson, Adam (Kyle's son), was killed in a practice crash at New Hampshire International Speedway on May 12, 2000, five weeks after Lee's death." ], [ "Petty Enterprises", "Petty's final race came at the season-ending Hooters 500 at Atlanta Motor Speedway.", "The race is well known for hosting the closest championship point battle in NASCAR history, and the first career start for future four-time champion Jeff Gordon.", "Petty would not officially finish the race after an accident on lap 94, but did manage to run one last lap after the race in a fender-less race car, with tear-filled eyes and a hand out the window, waving goodbye to his many fans.", "After Richard's retirement, Rick Wilson was named to replace him in a renumbered #44, but had little success.", "In 1994, the car was changed back to the King's famous number 43, and Wally Dallenbach, Jr. was hired as the driver.", "He was replaced mid-season by John Andretti.", "For 1995, Busch Series Rookie of the Year Bobby Hamilton was hired to drive.", "Hamilton would score four top fives, and scored his first win with the team the following year at Phoenix, this would be Petty Enterprises first win since 1983.", "In 1997 Hamilton won at Rockingham, but left the team at the end of the season to drive for Morgan-McClure Racing.", "In 1998, journeyman John Andretti was hired and he gave the team three top fives in his first year, and another win at Martinsville the following." ] ], "gold": "Several drivers have driven the number 43 car in Nascar over the years. In 1959, Richard Petty drove the number 43 car. 1994 saw Wally Dallenbach Jr. with the number. Since 2017, Bubba Wallace has been driving the No. 43 Chevrolet Camaro ZL1 1LE for Richard Petty Motorsports.", "prediction 1": "Darrell \"Bubba\" Wallace Jr. currently competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 43 Chevrolet Camaro ZL1 for Richard Petty Motorsports. In 1994, the car was changed back to the King's famous number 43, and Wally Dallenbach, Jr. was hired as the driver. He was replaced mid-season by John Andretti. In 1998, journeyman John Andretti was hired and he gave the team three top fives in his first year.", "prediction 2": "In NASCAR, the number 43 Chevrolet Camaro ZL1 is a stock car that is driven by American stock car racing driver, Darrell Wallace Jr. The car was renumbered in 1994 to reflect the success of Richard Petty. In 1995, Bobby Hamilton was hired to drive the car. In 1998, John Andretti was hired to drive the car.", "prediction 3": "Darrell \"Bubba\" Wallace Jr. drives the number 43 Chevrolet Camaro ZL1 in NASCAR. In the 1994 season, the car was changed back to the King's famous number 43, and Wally Dallenbach, Jr. was hired as the driver. He was replaced mid-season by John Andretti. In the 2015 season, the number 43 Chevrolet Camaro ZL1 was driven by Darrell Wallace Jr., a professional stock car racing driver who competes full-time in the Monster Energy NASCAR Cup Series.", "prediction 4": "Richard Petty began driving the number 43 car in 1994 and it was driven by Wally Dallenbach, Jr. in 1995, Bobby Hamilton in 1995, and John Andretti in 1998. Wallace competes full-time in the Monster Energy NASCAR Cup Series, driving the No. 43 Chevrolet Camaro ZL1 for Richard Petty Motorsports, and part-time in the Camping World Truck Series, driving the No. 20 Chevrolet Silverado for Young's Motorsports.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 430 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Several drivers have driven the number 43 car in Nascar over the years. Richard Petty drove the number 43 car before his retirement. In 1994, Wally Dallenbach, Jr. was hired as the driver of the number 43 car. He was replaced mid-season by John Andretti. In 1995 and 1998, Bobby Hamilton and John Andretti was hired respectively to drive the number 43 car. Darrell \"Bubba\" Wallace Jr. currently drives the No. 43 Chevrolet Camaro ZL1 for Richard Petty Motorsports" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who wrote the song top of the world?", "passages": [ [ "Top of the World (The Carpenters song)", "Top of the World (The Carpenters song)\n\n\"Top of the World\" is a 1972 song written and composed by Richard Carpenter and John Bettis and first recorded by American pop duo the Carpenters.", "It was a Billboard Hot 100 No. 1 hit for the duo for two consecutive weeks in 1973.", "The Carpenters originally intended the song to be only an album cut.", "However, after country singer Lynn Anderson covered the song and it became a number two hit on the country charts, they reconsidered.", "Originally recorded for and released on the duo's 1972 studio album \"A Song for You\", the song topped the \"Billboard\" Hot 100 singles chart in late 1973, becoming the duo's second of three No. 1 singles, following \"(They Long to Be) Close to You\" and preceding \"Please Mr. Postman.\"", "Karen Carpenter re-recorded it for the band's first compilation as she was not quite satisfied with the original.", "In Japan, it was used as the opening theme song for the 1995 Japanese drama Miseinen.", "In 2003, another drama, Beginner, had it as its ending theme song." ], [ "Top of the World (Dixie Chicks song)", "Top of the World (Dixie Chicks song)\n\n\"Top of the World\" is a contemporary folk-country song written by Patty Griffin and most known as recorded and performed in Grammy Award-winning fashion by the Dixie Chicks.", "Griffin wrote and recorded \"Top of the World\" for her would-be 2000 album Silver Bell.", "But a dispute with her label A&M Records caused the album to go unreleased and Griffin to be dropped, although copies of \"Silver Bell\" circulated and increased Griffin's reputation as a songwriter within the music industry.", "The Dixie Chicks, who had already covered other Griffin songs and had toured with Griffin on their 2000 Fly Tour, recorded \"Top of the World\" as the concluding track on their 2003 album \"Home\".", "Beginning quietly with \"Home\"'s mixture of acoustic stringed instruments, and with the vocal line shifting around among one-, two-, and three-part singing, the song begins by portraying an almost unbearable level of regret at things not done:\n\nTension is built up with pauses, then midway through a string section begins accompanying in an ominous fashion.", "The reason for the regret is fully unveiled:\n\nThe strings then pick up in intensity during the instrumental coda, as Chicks lead singer Natalie Maines moans wordlessly and then repeats \"To the top of the world\" as a mantra over and over." ], [ "Top of the World (Brandy song)", "Top of the World (Brandy song)\n\n\"Top of the World\" is a song by American singer Brandy Norwood, from her second studio album, \"Never Say Never\" (1998).", "The song was written by Rodney \"Darkchild\" Jerkins, Fred Jerkins III, LaShawn Daniels, Isaac Phillips, Nycolia Turman, and Mase, with Darkchild and Brandy producing and Mase having featured vocals.", "Released as the album's second international single in 1998, the track peaked at number two on the UK Singles Chart and reached the top 20 in Ireland and New Zealand.", "\"Top of the World\" topped the U.K. R&B Chart for six weeks and hit #2 on the UK national chart.", "The song became the second consecutive European success for Brandy and peaked at number twenty on the European Singles Chart.", "\"Top of The World\" also charted at number eleven on the New Zealand Singles Chart and 21 on the Canadian Singles Chart.", "In the U.S. it was a modest hit while peaking #44 on the Hot 100 Airplay, #19 on the R&B charts and #10 on the Rhythmic Chart." ] ], "gold": "There many different songs that share the title \"Top of the World\". One of them was written by John Bettis and Richard Carpenter and released in 1972 by the American pop due The Carpenters. In 1991, Van Halen released their own version written by Sammy Hagar, Alex Van Halen, Eddie Van Halen and Michael Anthony for the album \"For Unlawful Carnal Knowledge\". American singer Brandy Norwood presented one written by written by Rodney Jerkins, Fred Jerkins III, LaShawn Daniels, Isaac Phillips, Nycolia Turman in her second studio album \"Never Say Never\". The Dixie Chicks also covered a song of that same name that was written by Patty Griffin in 2000 for her album \"Silver Bell\", which was left unreleased for 13 years following a dispute with her label.", "prediction 1": "\"Top of the World\" is a 1972 song written and composed by Richard Carpenter and John Bettis and first recorded by American pop duo the Carpenters. \"Top of the World\" is a contemporary folk-country song written by Patty Griffin and most known as recorded and performed in Grammy Award-winning fashion by the Dixie Chicks. In 1998, American singer Brandy Norwood released a song titled \"Top of the World\" which was written by Rodney \"Darkchild\" Jerkins, Fred Jerkins, LaShawn Daniels, Isaac Phillips, Nycolia Turman, and Mase, with Darkchild and Brandy producing and Mase having featured vocals.", "prediction 2": "Top of the World is a 1972 song written and composed by Richard Carpenter and John Bettis and first recorded by American pop duo the Carpenters. Top of the World is also a contemporary folk-country song written by Patty Griffin and most known as recorded and performed in Grammy Award-winning fashion by the Dixie Chicks. In 1998, American singer Brandy Norwood released the song Top of the World, written by Rodney \"Darkchild\" Jerkins, Fred Jerkins III, LaShawn Daniels, Isaac Phillips, Nycolia Turman, Nycolia Turman, Nycolia Turman, and Mase, with Darkchild and Brandy producing and Mase having featured vocals.", "prediction 3": "\"Top of the World\" is a 1972 song written and composed by Richard Carpenter and John Bettis and first recorded by American pop duo the Carpenters. It was a Billboard Hot 100 No. 1 hit for the duo for two consecutive weeks in 1973. \"Top of the World\" is also a contemporary folk-country song written by Patty Griffin and most known as recorded and performed in Grammy Award-winning fashion by the Dixie Chicks. In 2002 the song was released as the concluding track on their 2003 album Home.", "prediction 4": "\"Top of the World\" is a 1972 song written and composed by Richard Carpenter and John Bettis that was first recorded by American pop duo the Carpenters. \"Top of the World\" is also a contemporary folk-country song written and recorded by Patty Griffin for her would-be 2000 album Silver Bell. However, a dispute with her label A&M Records caused the album to go unreleased, causing Griffin to be dropped. The song was written by Rodney \"Darkchild\" Jerkins, Fred Jerkins, LaShawn Daniels, Isaac Phillips, Nycolia Turman, Nycolia Turman, and Mase, with Darkchild and Brandy producing and Mase having featured vocals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 515, "end": 593 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Top of the World\" is a 1972 song written and composed by Richard Carpenter and John Bettis and first recorded by American pop duo the Carpenters. \"Top of the World\" is a contemporary folk-country song written by Patty Griffin and most known as recorded and performed by the Dixie Chicks. A dispute with her label A&M Records, in 2000, caused the album Silver Bell to go unreleased. In 1998, American singer Brandy Norwood released a song titled \"Top of the World\" which was written by Rodney \"Darkchild\" Jerkins, Fred Jerkins, LaShawn Daniels, Isaac Phillips, Nycolia Turman, it was from her second studio album, \"Never Say Never\" (1998)." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the wizard of oz come from?", "passages": [ [ "The Wizard of Oz (1939 film)", "The Wizard of Oz (1939 film)\n\nThe Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer.", "Widely considered to be one of the greatest films in cinema history, it is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book \"The Wonderful Wizard of Oz.\"", "It was directed primarily by Victor Fleming (who left production to take over direction on the troubled \"Gone with the Wind\" production).", "It stars Judy Garland as Dorothy Gale, alongside Ray Bolger, Jack Haley, Bert Lahr, Frank Morgan, Billie Burke, and Margaret Hamilton, with Charley Grapewin, Pat Walshe, and Clara Blandick, Terry (billed as Toto), and Singer's Midgets as the Munchkins.", "Legendary for its use of Technicolor, fantasy storytelling, musical score and memorable characters, the film has become an icon of American popular culture.", "It was nominated for six Academy Awards, including Best Picture, but lost to \"Gone with the Wind\".", "It did win in two other categories: Best Original Song for \"Over the Rainbow\" and Best Original Score by Herbert Stothart." ], [ "The Wizard of Oz (1939 film)", "On February 12, 1939, Fleming hastily replaced Cukor in directing \"Gone with the Wind\"; the next day, King Vidor was assigned as director by the studio to finish the filming of \"The Wizard of Oz\" (mainly the sepia-toned Kansas sequences, including Garland's singing of \"Over the Rainbow\" and the tornado).", "In later years, when the film became firmly established as a classic, Vidor chose not to take public credit for his contribution until after the death of his friend Fleming in 1949.", "Principal photography concluded with the Kansas sequences on March 16, 1939; nonetheless, reshoots and pick-up shots were filmed throughout April and May and into June, under the direction of producer LeRoy.", "After the deletion of the \"Over the Rainbow\" reprise during subsequent test screenings in early June, Garland had to be brought back one more time to reshoot the \"Auntie Em, I'm frightened!\"", "scene without the song; the footage of Blandick's Aunt Em, as shot by Vidor, had already been set aside for rear-projection work, and was simply reused." ], [ "The Wonderful Wizard of Oz", "The Wonderful Wizard of Oz\n\nThe Wonderful Wizard of Oz () is an American children's novel written by author L. Frank Baum and illustrated by W. W. Denslow, originally published by the George M. Hill Company in Chicago on May 17, 1900.", "It has since seen several reprints, most often under the title The Wizard of Oz, which is the title of the popular 1902 Broadway musical adaptation as well as the iconic 1939 musical film adaptation.", "The story chronicles the adventures of a young farm girl named Dorothy in the magical Land of Oz, after she and her pet dog Toto are swept away from their Kansas home by a cyclone.", "The novel is one of the best-known stories in American literature and has been widely translated.", "The Library of Congress has declared it \"America's greatest and best-loved homegrown fairytale\".", "Its groundbreaking success and the success of the Broadway musical adapted from the novel led Baum to write thirteen additional Oz books that serve as official sequels to the first story.", "Baum dedicated the book \"to my good friend & comrade, My Wife\", Maud Gage Baum.", "In January 1901, George M. Hill Company completed printing the first edition, a total of 10,000 copies, which quickly sold out.", "\"The Wonderful Wizard of Oz\" sold three million copies by the time it entered the public domain in 1956." ] ], "gold": "\"The Wizard of Oz\" is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer based on the 1900 children's fantasy novel The Wonderful Wizard of Oz. The story takes place in the fictitious Emerald City where the main character Dorothy Gale meets a wizard that claims is from Kansas, when in reality he is from Omaha, Nebraska.", "prediction 1": "The Wonderful Wizard of Oz, originally published as a children's book by L. Frank Baum and illustrated by W. W. Denslow, is considered to be one of the greatest films in cinema history. It is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book The Wonderful Wizard of Oz. It was produced by Metro-Goldwyn-Mayer in 1939. The movie based on the book took place in the Midwest and was directed by Victor Fleming.", "prediction 2": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer, widely considered to be one of the greatest films in cinema history, and the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book The Wonderful Wizard of Oz. The film was directed by Victor Fleming, who left production to take over direction on the troubled \"Gone with the Wind\" production. It stars Judy Garland as Dorothy Gale, alongside Ray Bolger, Jack Haley, Bert Lahr as Toto, and Clara Blandick as Auntie Em, who is billed as Toto.", "prediction 3": "The Wonderful Wizard of Oz is an American children's novel written by author L. Frank Baum and illustrated by W. W. Denslow, originally published by the George M. Hill Company in Chicago on May 17, 1900. It has since seen several reprints, most often under the title The Wizard of Oz, which is the title of the popular 1902 Broadway musical adaptation as well as the iconic 1939 musical fantasy film adaptation.", "prediction 4": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer, widely considered to be one of the greatest films in cinema history, and the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book The Wonderful Wizard of Oz. The story chronicles the adventures of a young farm girl named Dorothy Gale in the magical Land of Oz, after she and her pet dog Toto are swept away from their Kansas home by a cyclone. It has since seen several reprints, most often under the title The Wizard of Oz, which is the title of the popular 1902 Broadway musical adaptation as well as the title of the iconic 1939 musical. The movie version of The story was originally published by the George M. Hill Company in Chicago on May 17, 1900. The film was directed by Victor Fleming, who left production to take over direction on the trouble", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 28, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 318 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 239 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 456 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Wonderful Wizard of Oz is a 1900 children's book. The Wizard of Oz is a 1939 American musical fantasy film based on the book that was produced by Metro-Goldwyn-Mayer in 1939. " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Who plays the new mayor on blue bloods?", "passages": [ [ "Chapter 1 (House of Cards)", "Meanwhile, Claire is forced to downsize her non-profit organization, the Clean Water Initiative, which had been promised a large donation upon her husband's confirmation, without which the organization is forced to substantially curtail its budget.", "On a whim, \"Washington Herald\" reporter Zoe Barnes (Kate Mara) pays a late-night visit to Frank at his home.", "She offers to be Frank's undercover mouthpiece in the press in exchange for the elevated profile that she would gain from breaking substantive stories.", "Meanwhile, Peter Russo (Corey Stoll), a young, inexperienced congressman from Philadelphia, is arrested for drunk driving with a prostitute (Rachel Brosnahan).", "Stamper finds out about the arrest and immediately contacts the D.C. police commissioner, offering Underwood's support for his mayoral campaign in exchange for releasing Russo.", "Russo is picked up from jail by his secretary and romantic partner, Christina Gallagher (Kristen Connolly), and falsely tells her that he was alone when he was arrested.", "Frank meets with Donald Blythe (Reed Birney), a progressive congressman with whom the Walker administration wants to work on an education bill.", "Frank dismisses his proposal as too ambitious and asks him to rewrite it, but secretly passes a copy to Zoe." ], [ "Herman Badillo", "Badillo unsuccessfully sought a Republican mayoral nomination in 2001, losing in a landslide vote for billionaire businessman and political neophyte Michael Bloomberg who would later prevail in that general election.", "Badillo resigned from Congress on December 31, 1977 to become deputy mayor of New York City under Mayor Ed Koch, a position he held until September 1979.", "Badillo was one of seven deputy mayors appointed by Koch for the first portion of his administration.", "As a deputy mayor Badillo handled labor relations and community outreach for Koch.", "In a major public disagreement with Mayor Koch over the lack of support for his program to revitalize the South Bronx, Badillo resigned his post.", "Some argue that Badillo made a major career mistake in giving up his Congressional post for this appointed position under Mayor Koch.", "After leaving City Hall, Badillo worked as an attorney in New York City.", "He supported Mario Cuomo for governor over Koch during the 1982 Democratic Primary.", "In late 1983 Cuomo appointed Badillo Chairman of the State of New York Mortgage Agency.", "In 1985 Badillo considered a bid for mayor against Koch in the Democratic Primary.", "In 1986 Badillo was the Democratic nominee for New York State Comptroller, losing to Republican incumbent Edward Regan.", "During these years Badillo was also active in Presidential politics, supporting Alan Cranston for the Democratic Presidential Nomination in 1984 and Michael Dukakis in 1988." ], [ "Catch Me If You Can", "He goes there and locates Frank, and tells him that the French police will kill him if he does not go with Carl quietly.", "Frank assumes he is lying at first, but Carl promises Frank he would never lie to him, and Carl takes him outside, where the French police escort him to prison.", "The scene then flashes forward to a plane returning Frank home from prison, where Carl informs him that his father has died.", "Grief-stricken, Frank escapes from the plane and goes back to his old house, where he finds his mother with the man she left his father for, as well as a girl who Frank realizes is his half-sister.", "Frank gives himself up and is sentenced to 12 years in prison, getting visits from time to time from Carl.", "When Frank points out how one of the checks Carl is carrying as evidence is fake, Carl convinces the FBI to offer Frank a deal by which he can live out the remainder of his sentence working for the bank fraud department of the FBI, which Frank accepts.", "While working at the FBI, Frank misses the thrill of the chase and even attempts to fly as an airline pilot again.", "He is cornered by Carl, who insists that Frank will return to the FBI job since no one is chasing him.", "On the following Monday, Carl is nervous that Frank has not yet arrived at work.", "However, Frank eventually arrives and they discuss their next case." ] ], "gold": "Blue Bloods is an American police procedural drama television series that has been airing on CBS since September 2010. There have been several actors who have portrayed the mayor in the show. David Ramsey played mayor Carter Poole, Lorraine Bracco portrayed mayor Margaret Dutton, and Dylan Walsh has portrayed mayor Peter Chase. It will begin its twelfth season on October 1, 2021.", "prediction 1": "The role of mayor in the television show Blue Bloods is played by Corey Stoll, who portrays Peter Russo, who is a congressman from Philadelphia. On the show, the role of the new mayor is played by Herman Badillo, who resigned from Congress in 1977 to become the deputy mayor of New York City under Mayor Ed Koch.", "prediction 2": "John Underwood plays the mayor on the television show Blue Bloods. Corey Stoll plays Peter Russo in the episode, while Kate Mara plays Claire Stamper in the House of Cards episode.", "prediction 3": "Blue Bloods is a 2002 American television drama based on the House of Cards. The show stars Corey Stoll as Peter Russo, a young, inexperienced congressman from Philadelphia, who is arrested for drunk driving with a prostitute. Corey Stoll also plays the mayor on the show.", "prediction 4": "There are numerous episodes of the television show Blue Bloods in which the new mayor is played by different actors. The first time the mayor is played is in the episode Catch Me If You Can, which aired on February 8, 2013. The second time the mayor is played is by actor Corey Stoll, who played the role of Peter Russo in the episode.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 145, "end": 212 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 312 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who wrote the song billy don't be a hero?", "passages": [ [ "Billy Don't Be a Hero", "Billy Don't Be a Hero\n\n\"Billy Don't Be a Hero\" is a 1974 pop song that was first a UK hit for Paper Lace and then, some months later, a US hit for Bo Donaldson and The Heywoods.", "The song was written and composed by two British songwriters, Mitch Murray and Peter Callander.", "Because the song was released in 1974, it was associated by some listeners with the Vietnam War, though the war to which it actually refers is never identified in the lyrics.", "It has been suggested that the drum pattern, references to a marching band leading soldiers in blue, and \"riding out\" (cavalry) refer to the American Civil War.", "However the drum beat and cavalry \"riding out\" is not specific to the American Civil War, and blue uniforms were common in the 19th century.", "That being said, Paper Lace themselves performed the song on \"Top of the Pops\" wearing Union-style uniforms, as can be seen on YouTube.", "A young woman is distraught that her fianc\u00e9 chooses to enlist with Army recruiters passing through the town, causing her to implore him:\nThe song goes on to describe how Billy is killed in action in a pitched battle after volunteering to ride out and seek reinforcements.", "(This suggests mounted infantry and a lack of modern two-way radio communications.)" ], [ "Billy Don't Be a Hero", "In the end, the heartbroken woman throws away the official letter notifying her of Billy's \"heroic\" death.", "Paper Lace's version of \"Billy Don't Be a Hero\" reached No. 1 in the UK Singles Chart on 16 March 1974, and did likewise in Australia, where it spent eight weeks at the top spot.", "Thereafter, Bo Donaldson's and the Heywoods's version reached No. 1 in the U.S. on the \"Billboard\" Hot 100 on 15 June 1974, but was dubbed into French for Canada.", "The US version sold over three and a half million copies, and was awarded a gold disc by the R.I.A.A. in June 1974.", "Donaldson and the Heywoods's version was a massive hit in Latin America and Japan as well, but it remained largely unknown elsewhere as of late July 2017.", "\"Billboard\" ranked it as the No. 21 song for 1974.", "Despite the song's popularity, it was poorly received, and it was voted No. 8 on \"Rolling Stone\" magazine's readers' poll of \"10 Worst Songs of the 1970s.\"", "The song is mentioned as having played on K-Billy's \"Super Sounds of the '70s Weekend\" in the film \"Reservoir Dogs.\"" ] ], "gold": "\"Billy Don't Be a Hero\" is a 1974 pop song that was first a UK hit for Paper Lace, composed by two British songwriters, Mitch Murray and Peter Callander. The song was translated into French for the Canadian market by Andre Popp and Pierre Cour.", "prediction 1": "\"Billy Don't Be a Hero\" is a 1974 pop song that was first a UK hit for Paper Lace and then, some months later, a US hit for Bo Donaldson and The Heywoods. The song was written and composed by two British songwriters, Mitch Murray and Peter Callander. Because the song was released in 1974, it was associated by some listeners with the Vietnam War, though the war to which it actually refers is never identified in the lyrics. However, it has been suggested that the drum pattern, references to a marching band leading soldiers in blue, and \"riding out\" refer to the American Civil War. However, the drum beat and cavalry \"riding out\" is not specific to the American Civil War.", "prediction 2": "Mitch Murray and Peter Callander wrote the song Billy Don't Be a Hero. The song was first a UK hit for Paper Lace and then, some months later, a US hit for Bo Donaldson and the Heywoods.", "prediction 3": "\"Billy Don't Be a Hero\" is a 1974 pop song that was first a UK hit for Paper Lace and then, some months later, a US hit for Bo Donaldson and The Heywoods. The song was written and composed by two British songwriters, Mitch Murray and Peter Callander.", "prediction 4": "The 1974 pop song \"Billy Don't Be a Hero\" was written and composed by two British songwriters, Mitch Murray and Peter Callander. Because the song was released in 1974, it was associated by some listeners with the Vietnam War, though the war to which it actually refers is never identified in the lyrics. Paper Lace and Donaldson and the Heywoods both released versions of the song in the UK, and the US, respectively.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 585 }, { "error type": "Irrelevant", "explanation": "", "start": 586, "end": 676 } ], "missing-info": [], "corrected-prediction": "\"Billy Don't Be a Hero\" is a 1974 pop song that was first a UK hit for Paper Lace. The song was written and composed by two British songwriters, Mitch Murray and Peter Callander. " }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "How many members form a jury in scotland?", "passages": [ [ "Trial by jury in Scotland", "Trial by jury in Scotland\n\nTrial by jury in Scotland is used in the courts of Scotland in solemn procedure for trial on indictment before a judge and jury of fifteen for serious criminal cases, and in certain civil cases (mainly personal injury claims.)", "In criminal trials conviction is on the basis of a majority verdict, with eight jurors required to decide that the accused is guilty; should fewer than eight jurors declare a guilty verdict then the accused is acquitted.", "Thus, a hung jury is an impossibility in Scottish criminal law, but in civil trials a hung jury is possible.", "Some people were executed on majority verdicts in Scotland, such as Susan Newell, who had one juror dissenting.", "Criminal procedure in Scotland is generally regulated by the Criminal Procedure (Scotland) Act 1995 (as amended) and various Acts of Adjournal passed by the High Court of Justiciary.", "Under Scots law a jury in a criminal trial must have at least fifteen jurors for a case to continue, and at least eight jurors must declare guilt into order to convict.", "The jury has a choice of three verdicts: guilty (a conviction), not guilty (acquittal) and not proven (also acquittal).", "The pool of potential jurors is chosen purely at random, and Scottish courts have set themselves against any form of jury vetting." ], [ "Hung jury", "When the jury is called to deliver a verdict after majority directions have been given, a careful protocol of questions is followed: only in the event of a guilty verdict is it then asked whether or not all jurors were agreed on that verdict, to prevent any acquittal from being tainted by it being disclosed that any jurors dissented.", "The protocol is followed separately for each charge.", "It is not possible to have a hung jury in Scotland in criminal cases.", "Juries consist of 15, and verdicts are decided by simple majority (8) of the initial membership.", "If jurors drop out because of illness or another reason, the trial can continue with a minimum of 12 jurors, but the support of 8 jurors is still needed for a guilty verdict; anything less is treated as an acquittal.", "In civil cases there is a jury of 12, with a minimum of 10 needed to continue the trial.", "It is possible to have a hung jury if there is a tied vote after three hours' deliberation.", "In the United States, the result is a mistrial, and the case may be retried (\"United States v. Perez\", 1824)." ] ], "gold": "Trial by jury in Scotland is used in the courts of Scotland in solemn procedure for trial on indictment before a judge and jury for serious criminal cases, and in certain civil cases. Juries in these cases consist of 15 people. If jurors drop out because of illness the trial can continue with a minimum of 12 jurors. In civil trials there is a jury of 12 people, and a hung jury is possible.", "prediction 1": "In Scotland, a jury consists of 15 members, and verdicts are decided by simple majority (8) of the initial membership. If jurors drop out because of illness or another reason, the trial can continue with a minimum of 12 jurors, but the support of 8 jurors is still needed for a guilty verdict; anything less is treated as an acquittal. In civil cases, a jury of 12 is needed, with a minimum of 10 needed to continue the trial. In Scottish criminal trials, conviction is on the basis of a majority verdict, with eight jurors required to decide that the accused is guilty. Should fewer than eight jurors declare a guilty verdict then the accused is acquitted.", "prediction 2": "Trial by jury in Scotland is used in the courts of Scotland in solemn procedure for trial on indictment before a judge and jury of fifteen for serious criminal cases, and in certain civil cases (mainly personal injury claims). In criminal trials conviction is on the basis of a majority verdict, with eight jurors required to decide that the accused is guilty; should fewer than eight jurors declare a guilty verdict then the accused is acquitted. Thus, a hung jury is an impossibility in Scottish criminal law, but in civil trials a hung jury is possible.", "prediction 3": "Trial by jury is a legal procedure in which a jury consists of fifteen members for a criminal case. If more than 15 members drop out due to illness or another reason, the trial can continue with a minimum of 12 members, with a minimum of 10 members needed to continue the trial. In civil cases there is a jury of 12, with a minimum of 10 members needed to continue the trial. In Scottish criminal cases conviction is on the basis of a majority verdict, with eight jurors required to decide that the accused is guilty. If fewer than eight jurors declare a guilty verdict then the accused is acquitted.", "prediction 4": "Trial by jury in Scotland is used in the courts of Scotland in solemn procedure for trial on indictment before a judge and jury of fifteen for serious criminal cases, and in certain civil cases (mainly personal injury claims). In criminal trials conviction is on the basis of a majority verdict, with eight jurors required to decide that the accused is guilty; should fewer than eight jurors declare a guilty verdict then the accused is acquitted. Thus, a hung jury is a possibility in Scottish criminal law, but in civil trials a hung jury is possible. It is not possible to have a hung jury in civil cases. In civil cases there is a jury of 12.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 427, "end": 657 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Trial by jury in Scotland is used in the courts of Scotland in solemn procedure for trial on indictment before a judge and jury for serious criminal cases, and in certain civil cases. In Scotland, a jury consists of 15 members. If jurors drop out because of illness or another reason, the trial can continue with a minimum of 12 jurors. In civil cases, a jury of 12 is needed, with a minimum of 10 needed to continue the trial. " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who sing play that funky music white boy?", "passages": [ [ "Play That Funky Music", "Play That Funky Music\n\n\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry.", "The single was the first released by the Cleveland-based Sweet City record label in April 1976 and distributed by Epic Records.", "The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses.", "The single hit number one on the \"Billboard\" Hot 100 on September 18, 1976; it was also number one on the Hot Soul Singles chart.", "The single was certified platinum by the Recording Industry Association of America for shipments of over 2 million records and eventually sold 2.5 million in the United States alone.", "The song was listed at No. 93 on \"Billboard\" magazine's \"All-Time Top 100 Songs\" in 2018.", "It was also the group's only U.S. Top 40 song. !", "scope=\"row\"|United Kingdom (BPI)\n!", "scope=\"row\"|United States (RIAA) \n!", "scope=\"row\"|United States (RIAA) \n\n", "American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\"." ], [ "To the Extreme", "To the Extreme\n\nTo the Extreme is the major label debut studio album of American rapper Vanilla Ice.", "The album was initially released in 1989 by independent record label Ichiban Records under the title \"Hooked\".", "Vanilla Ice signed to SBK Records, who reissued the album under its current title.", "The album contains Vanilla Ice's most successful singles, \"Ice Ice Baby\" and a cover of \"Play That Funky Music\".", "Although reviews of the album were mixed, \"To the Extreme\" spent 16 weeks at the top of the \"Billboard 200\", and sold 15 million copies worldwide.", "\"Play That Funky Music\" was released independently as a single in 1988.", "Based on this single, the independent record label Ichiban Records signed Vanilla Ice to a record deal, releasing the album \"Hooked\" in January 1989, containing \"Play That Funky Music\" and its B-side, \"Ice Ice Baby\".", "In 1989 Vanilla Ice released an early version of \"To the Extreme\" under the title \"Hooked\" on Ichiban Records.", "\"Play That Funky Music\" was released as the album's first single, with \"Ice Ice Baby\" appearing as the B-side.", "The 12-inch single featured the radio, instrumental and a cappella versions of \"Play That Funky Music\" and the radio version and \"Miami Drop\" remix of \"Ice Ice Baby\"." ], [ "Wild Cherry (band)", "Wild Cherry (band)\n\nWild Cherry was an American funk rock band best known for their song \"Play That Funky Music\".", "Rob Parissi (lead vocals & guitar) was raised in the steel mill town of Mingo Junction, Ohio.", "He graduated from Mingo High School in 1968, and formed the band Wild Cherry in 1970 in Steubenville, Ohio.", "The band's name 'Wild Cherry' was taken from a box of cough drops.", "The band played the Ohio Valley region, the Northern West Virginia panhandle, and Pittsburgh, Pennsylvania.", "The original lineup included Ben Difabbio (drums and vocals) and Louie Osso (guitar, lead and background vocals) from Steubenville, Larry Brown (bass, lead and background vocals) from Weirton, West Virginia, and Larry Mader (keyboards, lead and background vocals) from East Springfield, Ohio.", "Over time, the band members changed; Osso, Brown, and Mader leaving the band, and were replaced by Parissi's cousin, Coogie Stoddart (guitar, lead and background vocals) and Joe Buchmelter (bass).", "Buchmelter was soon replaced by Bucky Lusk." ] ], "gold": "\"Play That Funky Music\" is a song written and performed by Rob Parissi and the band Wild Cherry, which was the first released by the Cleveland-based Sweet City record label in April 1976. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music.\" This led the rapper to get a record deal with Ichiban Records, releasing the album Hooked in January 1989, containing \"Play That Funky Music\" and its B-side, \"Ice Ice Baby\". Additionally, in 1988, the band Roxanne reached No. 63 on the Billboard Hot 100 with a cover version.", "prediction 1": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "prediction 2": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "prediction 3": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\" in 1988. The album was released in 1989 by independent record label Ichiban Records under the title \"Hooked\".", "prediction 4": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of Play That Funky Music.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 388 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The single was the first released by the Cleveland-based Sweet City record label in April 1976. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\". Based on this single, the independent record label Ichiban Records signed Vanilla Ice to a record deal, releasing the album \"Hooked\" in January 1989, containing \"Play That Funky Music\" and its B-side, \"Ice Ice Baby\". " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When did the washington nationals become a baseball team?", "passages": [ [ "Washington Nationals", "In both 2003 and 2004, the Expos played 22 of their home games in San Juan, Puerto Rico at the Hiram Bithorn Stadium, and the remaining 59 in Montreal.", "On September 29, 2004, MLB announced that the Expos would move to Washington, D.C. in 2005.", "The Expos played their final game on October 3 at Shea Stadium, losing by a score of 8\u20131 against the New York Mets, the same opponent that the Expos first faced at its start, 35 years earlier.", "On November 15, a lawsuit by the former team owners against MLB and former majority owner Jeffrey Loria was struck down by arbitrators, bringing to an end all legal actions that would impede a move.", "The owners of the other MLB teams approved the move to Washington in a 28\u20131 vote on December 3 (Baltimore Orioles owner Peter Angelos cast the sole dissenting vote).", "Numerous professional baseball teams have called Washington, D.C. home.", "The Washington Senators, a founding member of the American League (AL), played in the nation's capital from 1901 to 1960 before moving to Minnesota and becoming the Twins.", "The original Washington American League Base Ball Club was founded by three local businessmen: Edward J. Walsh, Benjamin Minor, and Harry Rapley.", "Clark Griffith was hired as manager in 1912 and became a part owner, accumulating majority shares in later years." ], [ "Washington Nationals", "Washington Nationals\n\nThe Washington Nationals are a professional baseball team based in Washington, D.C..", "The Nationals compete in Major League Baseball (MLB) as a member club of the National League (NL) East division.", "From 2005 to 2007, the team played in RFK Stadium; since 2008 their home stadium has been Nationals Park on South Capitol Street in Southeast D.C., near the Anacostia River.", "The Nationals are the eighth major league franchise to be based in Washington, D.C., and the first since 1971.", "The current National League club was founded in 1969 as the Montreal Expos, part of the MLB expansion.", "The Expos were purchased by Major League Baseball in 2002, and the team was renamed the Nationals and moved to Washington, D.C. before the 2005 season, marking the first franchise relocation in MLB since the third Washington Senators moved to Texas in 1971.", "While the team initially struggled after moving to Washington, the Nationals have experienced considerable success in recent years, winning division titles in 2012, 2014, 2016, and 2017, although they have yet to advance out of the first round in the playoffs.", "Two of the team's first overall picks in the MLB Draft, Stephen Strasburg in 2009 and Bryce Harper in 2010, attracted new levels of attention to the team." ] ], "gold": "The Washington Nationals are an American professional baseball team based in Washington, D.C. that were originally founded in 1969 as the Montreal Expos. After a failed contraction plan, the Expos were purchased by MLB, which sought to relocate the team to a new city. On September 29, 2004, MLB announced the Expos would move to Washington, D.C. The Nationals were established in 2005 as the first MLB franchise relocation since the third Washington Senators moved to Texas in 1971.", "prediction 1": "The Washington Nationals are a professional baseball team based in Washington, D.C. The team competes in Major League Baseball as a member club of the National League East division. On September 29, 2004, MLB announced that the Montreal Expos would move to Washington, D.C. in 2005. From 2005 to 2007, the team played in RFK Stadium; since 2008 their home stadium has been Nationals Park on South Capitol Street in Southeast D.C., near the Anacostia River.", "prediction 2": "The Washington Nationals are a professional baseball team based in Washington, D.C., and compete in Major League Baseball as a member club of the National League East division. They were founded on September 29, 2004 by the Montreal Expos, a part of the MLB expansion. They were purchased by Major League Baseball in 2002, and the team was renamed the Nationals and moved to Washington, D.C. before the 2005 season, marking the first franchise relocation in MLB since the third Washington Senators moved to Texas in 1971.", "prediction 3": "The Washington Nationals are a professional baseball team based in Washington, D.C. The team competes in Major League Baseball (MLB) as a member club of the National League East division. They first became a baseball team on September 29, 2004, when the Montreal Expos were purchased by Major League Baseball. The team was renamed the Nationals and moved to Washington, D.C. before the 2005 season, marking the first franchise relocation in MLB since the third Washington Senators moved to Texas in 1971.", "prediction 4": "The Washington Nationals are a professional baseball team based in Washington, D.C.. The team competes in Major League Baseball as a member club of the National League East division. The Expos were purchased by Major League Baseball in 2002 and the team was renamed the Nationals and moved to Washington, D.C. before the 2005 season, marking the first franchise relocation in MLB since the third Washington Senators moved to Texas in 1971.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 456 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Washington Nationals are a professional baseball team based in Washington, D.C. The current National League club was founded in 1969 as the Montreal Expos. The Expos were purchased by MLB, which sought to relocate the team to a new city. On September 29, 2004, MLB announced that the Montreal Expos would move to Washington, D.C. in 2005. The Nationals were established in 2005 as the first MLB franchise relocation since the third Washington Senators moved to Texas in 1971." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When was the first iron man comic released?", "passages": [ [ "Iron Man (comic book)", "Iron Man (comic book)\n\n", "Iron Man is the name of several comic book titles featuring the character Iron Man and published by Marvel Comics, beginning with the original \"Iron Man\" comic book series which debuted in 1968.", "The character made his first appearance in \"Tales of Suspense\" #39 (cover dated March 1963).", "After issue #99 (March 1968), the \"Tales of Suspense\" series was renamed \"Captain America\".", "An Iron Man story appeared in the one-shot comic \"Iron Man and Sub-Mariner\" (April 1968), before the \"Golden Avenger\" made his solo debut with \"Iron Man\" #1 (May 1968).", "The series' indicia gives its copyright title \"Iron Man,\" while the trademarked cover logo of most issues is \"The Invincible Iron Man.\"", "Artist George Tuska began a decade long association with the character with \"Iron Man\" #5 (Sept. 1968).", "Writer Mike Friedrich and artist Jim Starlin's brief collaboration on the \"Iron Man\" series introduced Mentor, Starfox, and Thanos in issue #55 (Feb. 1973).", "Friedrich scripted a metafictional story in which Iron Man visited the San Diego Comic Convention and met several Marvel Comics writers and artists.", "He then wrote the multi-issue \"War of the Super-Villains\" storyline which ran through 1975." ], [ "Tales of Suspense", "Tales of Suspense\n\nTales of Suspense is the name of an American comic book anthology series and two one-shot comics published by Marvel Comics.", "The first, which ran from 1959 to 1968, began as a science-fiction anthology that served as a showcase for such artists as Jack Kirby, Steve Ditko, and Don Heck, then featured superheroes Captain America and Iron Man during the Silver Age of Comic Books before changing its title to \"Captain America\" with issue #100 (cover-dated April 1968).", "Its sister title was \"Tales to Astonish\".", "Following the launch of Marvel Legacy in 2017, \"Tales of Suspense\" was once again resurrected at issue #100, featuring The Winter Soldier and Hawkeye in a story called \"The Red Ledger\".", "\"Tales of Suspense\" and its sister publication \"Tales to Astonish\" were both launched with a January 1959 cover date.", "Initially published under Atlas Comics, the 1950s forerunner of Marvel, it fell under the Marvel banner with issue #19 (July 1961), the first with a cover sporting the early \"MC\" box.", "It contained science-fiction mystery/suspense stories written primarily by editor-in-chief Stan Lee and his brother, Larry Lieber, with artists including Jack Kirby, Steve Ditko, and Don Heck." ] ], "gold": "The first Iron Man comic was released in 1968, but Iron Man previously appeared in other comics dating back to 1963. The character made his first appearance in Tales of Suspense #39, part of the Tales of Suspense comic book anthology series, in March 1963. Later, an Iron Man story appeared in the one-shot comic Iron Man and Sub-Mariner in April 1968 before the release of the first Iron Man comic book series in May 1968.", "prediction 1": "The Iron Man comic book series was published by Marvel Comics. The series began with the original Iron Man comic book series which debuted in 1968. The first issue of the Iron Man comic book series was released on March 13, 1963. The first issue of the Iron Man one-shot comic was released on April 1, 1968.\n", "prediction 2": "The first Iron Man comic book series released by Marvel Comics was in 1968 and it first featured the character on March 19, 1963 in Tales of Suspense, March 1963. An Iron Man story appeared in the one-shot comic Iron Man and Sub-Mariner, March 1968, before the Golden Avenger made his solo debut with Iron Man #1, May 1968. It first appeared as a Marvel comic book title published by Marvel Comics in March 1969. It first featured Captain America in March 1968.", "prediction 3": "The character Iron Man appeared in several comic book titles published by Marvel Comics, beginning with the original Iron Man comic book series which debuted in 1968. One of these titles was Tales of Suspense, which ran from 1959 to 1968. It consisted of science-fiction mystery/suspense stories written primarily by editor-in-chief Stan Lee and his brother, Larry Lieber, with artists including Jack Kirby, Steve Ditko, and Don Heck.", "prediction 4": "The Iron Man AC Comics comic book series began with the original Iron Man comic book series in 1968. The first issue of Tales of Suspense ran from March 1963 to April 1968. The first issue of Tales of Suspense was published in January 1959. The first two issues of Iron Man, Captain America and Tales to Astonish, were both published in March 1960 and April 1968.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 62 }, { "error type": "Redundant", "explanation": "The Iron Man comic book series was published by Marvel Comics. The series began with the original Iron Man comic book series which debuted in 1968. The first issue of the Iron Man comic book series was released on March 13, 1963. ", "start": 230, "end": 308 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The original Iron Man comic book series was debuted in 1968. The first issue of the Iron Man one-shot comic was released on April 1, 1968. The character made his first appearance in \"Tales of Suspense\" #39 (cover dated March 1963). An Iron Man story appeared in the one-shot comic \"Iron Man and Sub-Mariner\" (April 1968), before the \"Golden Avenger\" made his solo debut with \"Iron Man\" #1 (May 1968).\n" }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "How many languages are recognised by indian constitution?", "passages": [ [ "Languages of India", "Languages of India\n\nLanguages spoken in India belong to several language families, the major ones being the Indo-Aryan languages spoken by 78.05% of Indians and the Dravidian languages spoken by 19.64% of Indians.", "Languages spoken by the remaining 2.31% of the population belong to the Austroasiatic, Sino-Tibetan, Tai-Kadai, and a few other minor language families and isolates.", "India (780) has the world's second highest number of languages, after Papua New Guinea (839).", "Article 343 of the Indian constitution stated that the official language of the Union should become Hindi in Devanagari script instead of the extant English.", "But this was thought to be a violation of the constitution's guarantee of federalism.", "Later, a constitutional amendment, , allowed for the continuation of English in the Indian government indefinitely until legislation decides to change it.", "The form of numerals to be used for the official purposes of the Union were supposed to be the international form of Indian numerals, distinct from the numerals used in most English-speaking countries.", "Despite the misconceptions, Hindi is not the national language of India.", "The Constitution of India does not give any language the status of national language." ], [ "Eighth Schedule to the Constitution of India", "Eighth Schedule to the Constitution of India\n\nThe Eighth Schedule to the Constitution of India lists the official languages of the Republic of India.", "At the time when the Constitution was enacted, inclusion in this list meant that the language was entitled to representation on the Official Languages Commission, and that the language would be one of the bases that would be drawn upon to enrich Hindi, the official language of the Union.", "The list has since, however, acquired further significance.", "The Government of India is now under an obligation to take measures for the development of these languages, such that \"they grow rapidly in richness and become effective means of communicating modern knowledge\".", "In addition, a candidate appearing in an examination conducted for public service is entitled to use any of these languages as the medium in which he or she answers the paper.", "As per Articles 344(1) and 351 of the Indian Constitution, the eighth schedule includes the recognition of the following 22 languages:\n\nOf these languages, 14 were initially included in the Constitution.", "Subsequently, Sindhi was added in 1967 by 21st constitutional amendment act; Konkani, Manipuri and Nepali were added in 1992 by 71st Constitutional Amendment Act; and Bodo, Dogri, Maithili and Santali were added in 2003 by 92nd Constitutional Amendment Act." ] ], "gold": "India has the world's fourth highest number of languages. In article 343 of the Indian constitution 1 language was recognized as the official language of the Union, Hindi. After the constitutional amendment called The Official Languages Act of 1963 2 languages were recognized, Hindi and English.", "prediction 1": "As per Articles 344(1) and 351 of the Indian Constitution, the eighth schedule includes the recognition of the following 22 languages: Sindhi was initially included in the Constitution, followed by Konkani, Manipuri and Nepali, which were added in 1992, and Bodo, Dogri, Maithili and Santali were added in 2003 by 92nd Constitutional Amendment Act.", "prediction 2": "The Indian Constitution recognises 22 languages. Of these, 14 were initially included in the Constitution. Subsequently, Sindhi was added in 1967 by 21st constitutional amendment act. Konkani, Manipuri and Nepali were added in 1992 by 71st Constitutional Amendment Act. Bodo, Dogri, Maithili and Santali were added in 2003 by 92nd Constitutional Amendment Act.", "prediction 3": "The Constitution of India recognises 22 languages. Of these, 14 were initially included in the Constitution. Sindhi was added in 1967 by 21st constitutional amendment act; Konkani, Manipuri and Nepali were added in 1992 by 71st Constitutional Amendment Act; and Bodo, Dogri, Maithili and Santali were added in 2003 by 92nd Constitutional Amendment Act.", "prediction 4": "The Indian Constitution recognises 22 languages, including 14 of which are initially included in the Constitution. Sindhi was added in 1967 by 21st constitutional amendment act. Konkani, Manipuri and Nepali were added in 1992 by 71st Constitutional Amendment Act. Bodo, Dogri, Maithili and Santali were added in 2003 by 92nd Constitutional Amendment Act.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 348 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Article 343 of the Indian constitution stated that the official language of the Union should become Hindi in Devanagari script instead of the extant English. Later, a constitutional amendment, , allowed for the continuation of English in the Indian government. As per Articles 344(1) and 351 of the Indian Constitution, the eighth schedule includes the recognition of a 22 languages." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who is the judge of madras high court?", "passages": [ [ "Indira Banerjee", "Indira Banerjee\n\nJustice Indira Banerjee is presently a Judge in the Supreme Court of India, the 8th female Judge in history and the 3rd female Judge of the Supreme Court of India at present.", "She was the Chief Justice of the Madras High Court, the second woman to hold the postition in India.", "before being elevated as a Judge of the Supreme Court of India.", "Indira Banerjee was born on 24 September 1957.", "She did her schooling at the Loreto House in Kolkata.", "She pursued her higher education at the Presidency College, Kolkata and Calcutta University's College of Law.", "She was enrolled as an advocate on 5 July 1985 and practised before the Calcutta High Court.", "Indira Banerjee was appointed as a permanent Judge of the Calcutta High Court on 5 February 2002 and transferred to the Delhi High Court with effect from 8 August 2016.", "She was elevated as the Chief Justice of the Madras High Court and assumed charge on 5 April 2017.", "Justice Banerjee succeeded Justice Sanjay Kishan Kaul as the Chief Justice of the Madras High Court, after he was elevated to the Supreme Court of India.", "She is the second woman to head the chartered High Court, after Justice Kanta Kumari Bhatnagar who headed the Court between June and November 1992." ], [ "Rajesh Kumar Agrawal", "Rajesh Kumar Agrawal\n\nRajesh Kumar Agrawal (born 5 May 1953) was a judge on the Supreme Court of India.", "Previously, he was the Chief Justice of the Madras High Court.", "He assumed office as Chief Justice on 24 October 2013.", "He was the acting chief justice of Madras High Court after his predecessor, M. Y. Eqbal, was elevated to the Supreme Court of India.", "He retired as a judge on 4 May 2018." ], [ "Huluvadi G. Ramesh", "Huluvadi G. Ramesh\n\nJustice Huluvadi G. Ramesh (born 20 May 1957) is the second seniormost Judge at the Madras High Court in India since April 2016.", "He briefly officiated as the Acting Chief Justice of the court from February 2017 till the appointment of Indira Banerjee as Chief Justice in April 2017.", "Ramesh started off as an advocate in March 1981.", "Initially, he used to practise in the courts at Mysore and Bangalore districts.", "He became a District Judge in Karnataka in February 1993 and was promoted to be an Additional Judge at the High Court of Karnataka in September 2004.", "Ramesh was transferred to Allahabad High Court in February 2015.", "He alleged a conspiracy behind the same during his farewell address.", "In 2016, he was brought to Chennai." ] ], "gold": "The Madras High Court is the second oldest High Court of India after the Calcutta High Court in Kolkata. The 25th Chief Justice of the Madras High Court who was the acting Chief Justice of the Madras High Court from 7 February - 23 October 2013 was Rajesh Kumar Agrawal, the current President of the National Consumer Disputes Redressal Commission (NCDRC). The 26th Chief Justice of the Madras High Court was Sanjay Kishan Kaul. The acting Chief Justice of the Madras High Court from 13 February - 25 July 2014 was Satish K Agnihotri. The acting Chief Justice of the Madras High Court from 16 February - 4 April 2017 was Huluvadi G. Ramesh. The 27th Chief Justice of the Madras High Court was Indira Banerjee.", "prediction 1": "The Chief Justice of the Madras High Court is Indira Banerjee. The second female Chief Justice of the Madras High Court is Sanjay Kishan Kaul. The third female Chief Justice of the Madras High Court is Huluvadi G. Ramesh.", "prediction 2": "The Madras High Court has been administered by five judges since the start of the year 1923. The current chief justice is Indira Banerjee, who succeeded Sanjay Kishan Kaul as the Chief Justice of the Madras High Court on 5 April 2017. The next three judges are Rajesh Kumar Agrawal, Huluvadi G. Ramesh, and S. S. Rao.", "prediction 3": "Huluvadi G. Ramesh is the second seniormost judge at the Madras High Court in India since April 2016. He was the acting chief justice of the court from February 2017 till the appointment of Indira Banerjee as Chief Justice in April 2017.", "prediction 4": "There are several Judges of Madras High Court. The current Chief Justice of the Madras High Court is Indira Banerjee. The previous Chief Justice was Sanjay Kishan Kaul, who was elevated to the Supreme Court of India on October 3, 2013. Huluvadi G. Ramesh, who was appointed as Acting Chief Justice of Madras High Court from February 2017 to April 2017, was the second seniormost judge at the Madras High Court in India.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 143, "end": 159 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 67, "end": 80 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Huluvadi G. Ramesh, the second senior most Judge of the Madras High Court, officiated as the Acting Chief Justice of the court from February 2017 till the appointment of Indira Banerjee as Chief Justice in April 2017. Banerjee succeeded Justice Sanjay Kishan Kaul as the Chief Justice of the Madras High Court. Justice Kanta Kumari Bhatnagar headed the Court between June and November 1992. Rajesh Kumar Agrawal assumed office as Chief Justice on 24 October 2013, after his predecessor, M. Y. Eqbal. He retired as a judge on 4 May 2018." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who has the second most wins at daytona international speedway?", "passages": [ [ "1959 Daytona 500", "1959 Daytona 500\n\nThe 1959 First Annual 500 Mile NASCAR International Sweepstakes at Daytona (now known as the 1959 Inaugural Daytona 500) was the second race of the 1959 NASCAR Grand National (now Monster Energy NASCAR Cup Series) season.", "It was held on February 22, 1959, in front of 41,921 spectators.", "It was the first race held at the 2.5-mile (4.0 kilometer)", "Daytona International Speedway.", "Daytona International Speedway is a race track in Daytona Beach, Florida that was one of the first superspeedways to hold NASCAR races.", "The standard track at Daytona is a four-turn superspeedway that is long.", "The track also features two other layouts that utilize portions of the primary high speed tri-oval, such as a sports car course and a motorcycle course.", "The track's infield includes the Lake Lloyd.", "The speedway is currently owned and operated by International Speedway Corporation.", "The track was built by NASCAR founder Bill France, Sr. to host racing that was being held at the former Daytona Beach Road Course and opened with the first Daytona 500 in 1959.", "The Daytona 500 is regarded as the most important and prestigious race on the NASCAR calendar.", "It is also the series' first race of the year; this phenomenon is virtually unique in sports, which tend to have championships or other major events at the end of the season rather than the start." ], [ "Cale Yarborough", "Cale Yarborough\n\nWilliam Caleb \"Cale\" Yarborough (born March 27, 1939), is an American farmer, businessman and former NASCAR Winston Cup Series driver and owner.", "He is one of only two drivers in NASCAR history to win three consecutive championships.", "He was the second NASCAR driver to appear on the cover of \"Sports Illustrated\" (the first was Curtis Turner on the February 26, 1968 issue)\n", "His 83 wins tie him with Jimmie Johnson for sixth on the all-time Monster Energy NASCAR Cup Series winner's list (behind Bobby Allison and Darrell Waltrip, who are tied for fourth with 84).", "His 14.82% winning percentage is the ninth best all-time and third among those with 500 or more starts.", "Yarborough won the Daytona 500 four times; his first win coming in 1968 for the Wood Brothers, the second in 1977 for Junior Johnson, and back-to-back wins in 1983 and 1984.", "Yarborough is a three-time winner of the National Motorsports Press Association Driver of the Year Award (1977, 1978, 1979).", "Yarborough was born to Julian and Annie Yarborough in the tiny, unincorporated community of Sardis near Timmonsville, South Carolina, the oldest of three sons." ], [ "Hendrick Motorsports", "Hendrick Motorsports\n\nHendrick Motorsports (HMS), originally named All Star Racing, is an American professional stock car racing team that currently competes in the Monster Energy NASCAR Cup Series.", "The team, created in 1984 by Rick Hendrick, is one of stock car racing's premier organizations.", "As of 2018, Hendrick Motorsports has won twelve Monster Energy Cup Series owners and drivers championships, three Truck Series owners and drivers titles, and one Nationwide Series drivers crown, 252 Monster Energy NASCAR Cup Series victories, 26 Xfinity Series wins, and 26 Camping World Truck Series victories.", "As of the 2016 season, the team has won a Monster Energy NASCAR Cup Series race on every track on the current circuit\u00a0\u2013 except for Kentucky Speedway, which has only been on the circuit since 2011.", "Hendrick Motorsports currently fields four full-time Monster Energy Cup Series teams with the Chevrolet Camaro ZL1, including the No. 9 NAPA/SunEnergy1/Hooters/Mountain Dew/Kelley Blue Book for Chase Elliott, the No. 24 Liberty University/Axalta/UniFirst/Hertz for William Byron, the No. 48 Ally Financial for Jimmie Johnson, and the No. 88 Nationwide Insurance/Axalta Coating Systems/LLumar/Valvoline for Alex Bowman." ] ], "gold": "The Daytona 500 is a 500-mile-long (805 km) NASCAR Cup Series motor race held annually at Daytona International Speedway in Daytona Beach, Florida. The driver with the second most wins at the Daytona International Speedway is Cale Yarborough, an American former NASCAR Winston Cup Series driver and owner, businessman, and farmer. The team with the second most wins is Hendrick Motorsports, an American professional auto racing organization that competes in the NASCAR Cup Series. The manufacturer with the second most wins is Ford, an American multinational automobile manufacturer headquartered in Dearborn, Michigan, United States.", "prediction 1": "The most wins at daytona international speedway are by Bobby Allison and Darrell Waltrip. Bobby Allison has the second most wins at Daytona International Speedway, and the second most wins by a single driver, is by Jimmie Johnson, with 83.", "prediction 2": "The second most wins at Daytona International Speedway are for the 1959 and 1970 seasons. The 1989 and 1990 seasons have the most wins at the Speedway. The 1996 and 2007 seasons have the most wins.", "prediction 3": "The American stock car racing team Hendrick Motorsports has the second most wins at daytona international speedway. Bobby Allison has the second most wins at Daytona, and Darrell Waltrip has the second most wins at the speedway. The most wins at the speedway are in the Monster Energy NASCAR Cup Series, with a total of 113, which ranks him fourth on the all-time winners' list. The most wins at the speedway are in the NASCAR Winston Cup Series, which is a modified street course.", "prediction 4": "The most wins at Daytona International Speedway are from the 1959 Daytona 500 and the 1959 Inaugural Daytona 500. The second most wins at Daytona International Speedway are from the 1977 Daytona 500 and in the 1989 Daytona 500. The second most wins at Daytona International Speedway are from the 1988 Daytona 500 and in 1989 the 2013 Daytona 500 and the 2014 Daytona 500.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 55, "end": 89 }, { "error type": "Irrelevant", "explanation": "", "start": 4, "end": 13 }, { "error type": "Unverifiable", "explanation": "", "start": 104, "end": 163 }, { "error type": "Unverifiable", "explanation": "", "start": 212, "end": 239 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Daytona 500 is held at Daytona International Speedway is a race track in Daytona Beach, Florida. Caleb \"Cale\" Yarborough is an American farmer, businessman and former NASCAR Winston Cup Series driver and owner. Hendrick Motorsports is an American professional stock car racing team that currently competes in the Monster Energy NASCAR Cup Series." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who are the members of 5 seconds of summer?", "passages": [ [ "5 Seconds of Summer", "5 Seconds of Summer\n\n5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011.", "The group consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin.", "They were originally YouTube celebrities, posting videos of themselves covering songs from various artists during 2011 and early 2012.", "They rose to international fame while touring with English-Irish band One Direction on their Take Me Home Tour.", "They have since released three studio albums and headlined three world tours.", "In early 2014, the band released \"She Looks So Perfect\" as their debut single, which topped the charts in Australia, New Zealand, Ireland and the United Kingdom.", "Their self-titled debut album was released on June 2014, peaking at number one in 11 countries, and was followed by a live album titled \"LiveSOS\".", "They went on their first headlining tour Rock Out with Your Socks Out Tour to support the album.", "The band released their second album \"Sounds Good Feels Good\" in October 2015, topping the charts in 8 countries, and was followed by a live documentary DVD called \"How Did We End Up Here\".", "They went on the Sounds Live Feels Live World Tour to support the album." ], [ "Westlife", "Also, additional two dates were announced on 11 December 2018 for Cardiff, Wales.", "Pre-sale of tickets was on 13 December 2018 and fifth round of general on-sale was on 14 December 2018.", "9am.", "The said tour has a total of thirty-two dates and set to take place on UK and Ireland's largest indoor arenas and stadium so far.", "Westlife's debut album and single coincided with the apogee of boy band popularity, and their success was most apparent in Ireland, the UK, and most of African, Asian, Australian and European countries.", "They had 12 worldwide concert tours over their 14-year career and sold over 5 million tickets.", "On April 2001, over one million fans wanted to chat with the lads from 122 countries.", "Voted worldwide as the best boy band on \"MTV Battle of the Boybands\" with over thirty-two bands in the choices in 2012.", "Their battle between Backstreet Boys garnered the highest rate of votes with more than one million.", "The total votes throughout the two-week competition got more than 12 million votes.", "They have more than 50,000 official fans club members in mainland China alone in 2006.", "Boy band One Direction was mistaken for Westlife in Ghana.", "They are the biggest selling international, foreign album act in Philippine and Indonesian music records history.", "They are Vietnam's most viewed music artist in YouTube as of 2015." ] ], "gold": "5 Seconds of Summer, often shortened to 5SOS (pronounced as '5 sos'), are an Australian pop rock band from Sydney, New South Wales, formed in late 2011. The group consists of lead vocalist and rhythm guitarist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. Since 2014, 5 Seconds of Summer have sold more than 10 million albums, sold over 2 million concert tickets worldwide, and the band's songs streams surpass 7 billion, making them one of the most successful Australian musical exports in history.", "prediction 1": "5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011. They consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. They were originally YouTube celebrities, posting videos of themselves covering songs from various artists during 2011 and early 2012.", "prediction 2": "5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011. The group consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. The band's first single, \"She Looks So Perfect,\" was released in early 2014, and has since released three studio albums and headlined three world tours. In addition to the members listed above, there are also members of The Wall.", "prediction 3": "5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011. The group consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. They were originally YouTube celebrities, posting videos of themselves covering songs from various artists during 2011 and early 2012. They rose to international fame while touring with English-Irish band One Direction on their Take Me Home Tour.", "prediction 4": "5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011. The group consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. They were originally YouTube celebrities, posting videos of themselves covering songs from various artists during 2011 and early 2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 383 } ], "missing-info": [], "corrected-prediction": "5 Seconds of Summer, often shortened to 5SOS, are an Australian pop rock band from Sydney, New South Wales, formed in 2011. They consists of lead vocalist Luke Hemmings, lead guitarist Michael Clifford, bassist Calum Hood, and drummer Ashton Irwin. " }, "preference": [ 0, 1, 0, 0, 2, 2 ] }, { "question": "Who does tracy end up with in hairspray?", "passages": [ [ "Hairspray (1988 film)", "Hairspray (1988 film)\n\nHairspray is a 1988 American dance comedy film written and directed by John Waters, and starring Ricki Lake, Divine, Debbie Harry, Sonny Bono, Jerry Stiller, Leslie Ann Powers, Colleen Fitzpatrick, and Michael St. Gerard.", "\"Hairspray\" was a dramatic departure from Waters's earlier works, with a much broader intended audience.", "\"Hairspray\"s PG is the mildest rating a Waters film has received; most of his previous films were rated X by the MPAA.", "Set in 1962 Baltimore, Maryland, the film revolves around self-proclaimed \"pleasantly plump\" teenager Tracy Turnblad as she pursues stardom as a dancer on a local TV show and rallies against racial segregation.", "\"Hairspray\" was only a moderate success upon its initial theatrical release, earning a modest gross of $8 million.", "However, it managed to attract a larger audience on home video in the early 1990s and became a cult classic.", "Most critics praised the film, although some were displeased with the overall campiness.", "The film ranks #444 on \"Empire\" magazine's 2008 list of the 500 greatest movies of all time.", "In 2002, the film was adapted into a Broadway musical of the same name, which won eight Tony Awards, including Best Musical in 2003." ], [ "Hairspray (2007 film)", "Hairspray (2007 film)\n\nHairspray is a 2007 musical romantic comedy film based on the 2002 Broadway musical of the same name, which in turn was based on John Waters's 1988 comedy film of the same name.", "The film was a British-American venture produced by Ingenious Media and Zadan/Meron Productions.", "Adapted from both Waters's 1988 script and Thomas Meehan and Mark O'Donnell's book for the stage musical by screenwriter Leslie Dixon, the 2007 film version of \"Hairspray\" was directed and choreographed by Adam Shankman and has an ensemble cast including John Travolta, Michelle Pfeiffer, Christopher Walken, Amanda Bynes, James Marsden, Queen Latifah, Brittany Snow, Zac Efron, Elijah Kelley, Allison Janney, and Nikki Blonsky in her feature film debut.", "Set in 1962 Baltimore, Maryland, the film follows the \"pleasantly plump\" teenager Tracy Turnblad as she pursues stardom as a dancer on a local TV show and rallies against racial segregation.", "The film began development in 2004, and Dixon reworked Meehan and O'Donnell's first draft of the screenplay to tone down the musical's campiness.", "In 2005, Shankman agreed to direct the film." ], [ "Hairspray (musical)", "Hairspray (musical)\n\nHairspray is an American musical with music by Marc Shaiman, lyrics by Scott Wittman and Shaiman and a book by Mark O'Donnell and Thomas Meehan, based on John Waters\u2019s 1988 film of the same name.", "The songs include 1960s-style dance music and \"downtown\" rhythm and blues.", "In 1962 Baltimore, Maryland, plump teenager Tracy Turnblad's dream is to dance on \"The Corny Collins Show\", a local TV dance program based on the real-life \"Buddy Deane Show\".", "When Tracy wins a role on the show, she becomes a celebrity overnight, and meets a colorful group of characters, leading to social change as Tracy campaigns for the show's integration.", "In 2003 it won eight Tony Awards, including one for Best Musical, out of 13 nominations.", "It ran for 2,642 performances, and closed on January 4, 2009.", "\"Hairspray\" has also had national tours, a West End production, and numerous foreign productions and was adapted as a 2007 musical film.", "The London production was nominated for a record-setting eleven Laurence Olivier Awards, winning four, including Best New Musical." ] ], "gold": "The 1988 American comedy film Hairspray was written and directed by John Waters, and stars Ricki Lake, Divine, Debbie Harry, Sonny Bono, Jerry Stiller, Leslie Ann Powers, Colleen Fitzpatrick, Michael St. Gerard, and Ruth Brown. The movie inspired a musical with music and lyrics by Marc Shaiman and Scott Wittman, which opened in Seattle in 2002 and won 8 Tony Awards. There is also a 2007 musical romantic comedy film that was based off of the other two productions of the same name. In all three productions, Tracy ends up with Lincoln \"Link\" Larkin.", "prediction 1": "Hairspray is a 1988 American dance comedy film written and directed by John Waters, and starring Ricki Lake, Divine, Debbie Harry, Sonny Bono, Jerry Stiller, Leslie Ann Powers, Colleen Fitzpatrick, and Michael St. Gerard. In the 2007 film version, Hairspray is a musical romantic comedy film based on the 2002 Broadway musical of the same name, which in turn was based on Waters's 1988 film of the same name. The 2007 film, which is a romantic comedy film based on the 2002 Broadway musical of the same name, which in turn was adapted from both Waters's's 1988 American musical with music by Marc Shaiman, lyrics by Scott Wittman and Shaiman, and Shaiman, based on Waters's's film of the same name. Hairspray was adapted as a 2007 romantic", "prediction 2": "Hairspray is a 1988 American dance comedy film written and directed by John Waters, starring Ricki Lake, Divine, Debbie Harry, Sonny Bono, Jerry Stiller, Leslie Ann Powers, Colleen Fitzpatrick, and Michael St. Gerard. Hairspray: The Musical was adapted into a Broadway musical of the same name in 2002. The 2007 film adaptation was directed and choreographed by Adam Shankman and has an ensemble cast including John Travolta, Michelle Pfeiffer, Christopher Walken, Amanda Bynes, Queen Latifah, and James Marsden, Brittany Snow, Zac Efron, Elijah Kelley, Elijah Kelley, Zac Efron, Elijah Kelley, and Nikki Blonsky in her feature film debut.", "prediction 3": "Hairspray is an American dance comedy film directed by John Waters and set in 1962 Baltimore, Maryland. The 1988 film stars Ricki Lake and is a dramatic departure from Waters's earlier works, with a much broader intended audience. Hairspray is a 2007 romantic comedy musical film based on the 2002 Broadway musical of the same name, which in turn was based on Waters's 1988 comedy film of the same name. The 2007 film version of Hairspray was directed and choreographed by Adam Shankman and has an ensemble cast including John Travolta and Michelle Pfeiffer, Christopher Walken, Amanda Bynes, Amanda Bynes, Christopher Walken, Nicole Kidman, and Kiera.", "prediction 4": "Hairspray is a 1988 American dance comedy film written and directed by John Waters. The film revolves around self-proclaimed \"pleasantly plump\" teenager Tracy Turnblad as she pursues stardom as a dancer on a local TV show and rallies against racial segregation. In 2007, the film Hairspray was adapted into a musical romantic comedy film directed and choreographed by Adam Shankman.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " In the 2007 film version, Hairspray is a musical romantic comedy film based on the 2002 Broadway musical of the same name, which in turn was based on Waters's 1988 film of the same name. ", "start": 409, "end": 577 }, { "error type": "Redundant", "explanation": "Marc Shaiman, lyrics by Scott Wittman and Shaiman, ", "start": 643, "end": 655 }, { "error type": "Redundant", "explanation": "which in turn was based on Waters's 1988 film of the same name. ", "start": 656, "end": 698 }, { "error type": "Irrelevant", "explanation": "", "start": 699, "end": 739 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Hairspray is a 1988 American dance comedy film written and directed by John Waters, and starring Ricki Lake, Divine, Debbie Harry, Sonny Bono, Jerry Stiller, Leslie Ann Powers, Colleen Fitzpatrick, and Michael St. Gerard. In the 2007 film version, Hairspray is a musical romantic comedy film based on the 2002 Broadway musical of the same name, which in turn was based on Waters's 1988 film of the same name. The musical had music from Marc Shaiman and Scott Wittman, which won eight Tony Awards." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did paper pound notes go out of circulation?", "passages": [ [ "Bank of England \u00a35 note", "Bank of England \u00a35 note\n\nThe Bank of England \u00a35 note, also known as a fiver, is a banknote of the pound sterling.", "It is the smallest denomination of banknote issued by the Bank of England.", "In September 2016, a new polymer note was introduced, featuring the image of Queen Elizabeth II on the obverse and a portrait of Winston Churchill on the reverse.", "The old paper note, first issued in 2002 and bearing the image of prison reformer Elizabeth Fry on the reverse, was phased out and ceased to be legal tender after 5 May 2017.", "Five pound notes (\u00a35) were introduced by the Bank of England in 1793, following the ten pound note which had been introduced in 1759 as a consequence of gold shortages caused by the Seven Years' War.", "The 5 pound note was introduced again, due to gold shortages caused by the French Revolutionary Wars and the Napoleonic Wars and was the lowest denomination of note issued until 1797.", "The earliest notes were handwritten and were issued to individuals as needed.", "These notes were written on one side only and bore the name of the payee, the date and the signature of the issuing cashier.", "In 1797, due to the extra money need to fund the war and the uncertainty caused as Britain declared war on France, a series of bank runs drained the Bank of England of its gold supply." ], [ "Bank of England \u00a31 note", "Bank of England \u00a31 note\n\nThe Bank of England \u00a31 note was a banknote of the pound sterling.", "After the ten shilling note was withdrawn in 1970 it became the smallest denomination note issued by the Bank of England.", "The one pound note was issued by the Bank of England for the first time in 1797 and continued to be printed until 1984.", "The note was withdrawn in 1988 in favour of the one pound coin.", "One pound notes were introduced by the Bank of England for the first time in 1797, following gold shortages caused by the French Revolutionary Wars.", "The earliest notes were handwritten, and were issued as needed to individuals.", "These notes were written on one side only and bore the name of the payee, the date, and the signature of the issuing cashier.", "Between 1797 and 1821 the lack of bullion meant that banks would not exchange banknotes for gold, but after the end of the Napoleonic Wars the shortage was alleviated such that notes could be exchanged for an equivalent amount of gold when presented at the bank.", "One pound notes ceased to be issued in 1821 and were replaced by gold sovereigns.", "During the First World War the British Government wanted to maintain its stocks of gold and so banks were ordered to again stop exchanging any and all denominations of banknotes for gold.", "Gold sovereigns were replaced by one pound notes issued by the Treasury." ], [ "Bank of Scotland \u00a310 note", "Bank of Scotland \u00a310 note\n\nThe Bank of Scotland \u00a310 note, also known as a tenner, is a banknote of the pound sterling.", "It is the second smallest denomination of banknote issued by the Bank of Scotland.", "The current polymer note, first issued in 2017, bears the image of Walter Scott on the obverse and a vignette of the Glenfinnan Viaduct on the reverse.", "Paper currency was introduced in Scotland immediately following the foundation of the Bank of Scotland in 1695.", "Early banknotes were monochrome, and printed on one side only.", "The issuing of banknotes by Scottish banks was regulated by the Banknote (Scotland) Act 1845 until it was superseded by the Banking Act 2009.", "Though strictly not legal tender in Scotland, Scottish banknotes are nevertheless legal currency and are generally accepted throughout the United Kingdom.", "Scottish banknotes are fully backed such that holders have the same level of protection as those holding genuine Bank of England notes.", "The \u00a310 note is currently the second smallest denomination of banknote issued by the Bank of Scotland.", "Scottish banknotes are not withdrawn in the same manner as Bank of England notes, and therefore several different versions of the Bank of Scotland ten pound note may be encountered although the Committee of Scottish Bankers encouraged the public to spend or exchange older, non-polymer ten pound notes before 1 March 2018." ] ], "gold": "Paper one-, five-, and ten-pound notes, banknotes of the pound sterling, went out of circulation on different dates. Paper one-pound notes were withdrawn in favor of the one-pound coin and went out of circulation on 11 March 1988. Paper five-pound and ten-pound notes went out of circulation on 5 May 2017 and 1 March 2018, respectively.", "prediction 1": "The Bank of England discontinued the use of paper pound notes in 1793 and in 2017 the use of paper pound notes went out of circulation. The British government began to ban the use of paper currency in 1821 and in 1793 the use of paper money was halted. The Bank of Scotland also discontinued the use of paper pound notes in 1795 and in 2017 the use of paper pound notes went out of circulation. The last paper pound note issued by the Bank of Scotland was issued in 2019.", "prediction 2": "The Bank of England issued paper pound notes in 1793 and in 1797. Between 1797 and 1821 the lack of bullion meant that banks would not exchange banknotes for gold, but after the end of the Napoleonic Wars the shortage was alleviated such that notes could be exchanged for an equivalent amount of gold when presented at the bank. The Bank of Scotland issued paper pound notes in 1797. In September 2016 a new polymer note was introduced, featuring the image of Queen Elizabeth II on the obverse and a portrait of Winston Churchill on the reverse. The old paper note, first issued in 2002 and bearing the image of prison reformer Elizabeth Fry on the reverse, was phased out and ceased to be legal tender after 5 May 2017.", "prediction 3": "The old paper pound notes went out of circulation in the United Kingdom on 5 May 2017, after which they were phased out and ceased to be legal tender. Five pound notes (\u00a35) were introduced by the Bank of England in 1793, following the ten pound note which had been introduced in 1759 as a consequence of gold shortages caused by the Seven Years' War. The one pound note was issued by the Bank of England for the first time in 1797, following gold shortages caused by the French Revolutionary Wars.", "prediction 4": "There are several pound notes that went out of circulation. Five pound notes were introduced by the Bank of England in 1793, following the ten pound note which had been introduced in 1759 as a consequence of gold shortages caused by the Seven Years' War. The one pound note was issued by the Bank of England for the first time in 1797. The old paper note, first issued in 2002 and bearing the image of prison reformer Elizabeth Fry on the reverse, was phased out and ceased to be legal tender after 5 May 2017. The new polymer note, first issued in 2018, and bearing the image of Queen Elizabeth II on the obverse and a portrait of Winston Churchill on the reverse, was phased out and ceased to be legal tender after 5 May 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 252 }, { "error type": "Unverifiable", "explanation": "", "start": 395, "end": 471 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 274, "end": 394 }, { "error type": "Unverifiable", "explanation": "", "start": 62, "end": 69 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Bank of England discontinued the use of paper \u00a35 pound notes as legal tender on 5 May 2017. The \u00a31 note was withdrawn in 1988 in favour of the one pound coin. The Bank of Scotland's older, non-polymer ten pound notes were encouraged to be spent or exchanged before 1 March 2018." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does the water from slide rock come from?", "passages": [ [ "Slide Rock State Park", "Slide Rock State Park\n\nSlide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States.", "It takes its name from a natural water slide formed by the slippery bed of Oak Creek.", "Slide Rock State Park is located on Coconino National Forest land and is co-managed by the Arizona State Parks agency and the United States Forest Service.", "Tall red rock formations that are typical of the region also surround the park, which contains a working apple farm.", "The land was first developed by Frank L. Pendley, who arrived in the canyon in 1907 and acquired title to the land under the Homestead Act in 1910.", "Pendley developed an irrigation system (which is still in use today) and planted an apple orchard in 1912.", "The state completed a road through the canyon in 1914, and Pendley built rustic tourist cabins in 1933 that in part survive today.", "Several films were shot in the area: \"Angel and the Badman\" (1946), \"Broken Arrow\" (1950), \"Drum Beat\" (1954), and \"Gun Fury\" (1953).", "The park was purchased by Arizona State Parks from the Arizona Parklands Foundation on July 10, 1985 and officially dedicated as Slide Rock State Park in October 1987.", "The Pendley Homestead Historic District was accepted onto the National Register of Historic Places on December 23, 1991." ], [ "Oak Creek Canyon", "Oak Creek Canyon\n\nOak Creek Canyon is a river gorge located in northern Arizona between the cities of Flagstaff and Sedona.", "The canyon is often described as a smaller cousin of the Grand Canyon because of its scenic beauty.", "State Route 89A enters the canyon on its north end via a series of hairpin turns before traversing the bottom of the canyon for about until the highway enters the town of Sedona.", "The Oak Creek Canyon \u2013 Sedona area is second only to Grand Canyon as the most popular tourist destination in Arizona.", "Oak Creek Canyon is about long, ranging in width from .", "The depth of the canyon ranges from .", "However, due to the faulting that played a major role in its formation, the west rim of the canyon is higher than the east rim.", "The average elevation of the west rim is while the east rim elevation is .", "Oak Creek, a tributary of the Verde River, flows along the bottom of the canyon, and is one of the few perennial streams in the high desert region of northern Arizona.", "Oak Creek is largely responsible for carving the modern Oak Creek Canyon, although movement along the Oak Creek Fault, a long north\u2013south normal fault line, is thought to have played a role as well.", "Oak Creek has an elevation of just north of Sedona to at the northern terminus of the canyon.", "Oak Creek enters more open country below Sedona." ] ], "gold": "Slide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States. It takes its name from a natural water slide formed by the slippery bed of Oak Creek. Oak Creek is a tributary of the Verde River, which is one of the few perennial streams in the high desert region of northern Arizona.", "prediction 1": "Slide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States. It takes its name from a natural water slide formed by the slippery bed of Oak Creek. Oak Creek is a tributary of the Verde River, which flows along the bottom of the canyon.", "prediction 2": "Slide Rock State Park is a park located in Oak Creek Canyon, a river gorge in northern Arizona, that takes its name from a natural water slide formed by the slippery bed of Oak Creek. The park was first developed by Frank L. Pendley, who arrived in the canyon in 1907 and acquired title to the land under the Homestead Act in 1910. Pendley developed an irrigation system, which is still in use today, and planted an apple orchard in 1912. The park is located on Coconino National Forest land and is co-managed by the Arizona State Parks agency and the US Forest Service.", "prediction 3": "Slide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States. It takes its name from a natural water slide formed by the slippery bed of Oak Creek. Slide Rock State Park is located on Coconino National Forest land and is co-managed by the Arizona State Parks agency and the United States Forest Service.", "prediction 4": "Slide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States. It takes its name from a natural water slide formed by the slippery bed of Oak Creek. The water from Slide Rock State Park comes from Oak Creek, a tributary of the Verde River, which flows along the bottom of the canyon, and is one of the few perennial streams in the high desert region of northern Arizona.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 290 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Slide Rock State Park is an Arizona State Park located in Oak Creek Canyon north of Sedona, Arizona, United States. It takes its name from a natural water slide formed by the slippery bed of Oak Creek. Oak Creek is a tributary of the Verde River, which is one of the few perennial streams in the high desert region of northern Arizona." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who's face is on $100 bill?", "passages": [ [ "United States one hundred-dollar bill", "United States one hundred-dollar bill\n\nThe United States one hundred-dollar bill ($100) is a denomination of United States currency.", "The first United States Note with this value was issued in 1862 and the Federal Reserve Note version was launched in 1914, alongside other denominations.", "Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse of the bill since 1914.", "On the reverse of the banknote is an image of Independence Hall in Philadelphia, which has been used since 1928.", "The $100 bill is the largest denomination that has been printed and circulated since July 13, 1969, when the denominations of $500, $1,000, $5,000, and $10,000 were retired.", "The Bureau of Engraving and Printing says the average life of a $100 bill in circulation is 90 months (7.5 years) before it is replaced due to wear and tear.", "The bills are also commonly referred to as \"Bens,\" \"Benjamins,\" or \"Franklins,\" in reference to the use of Benjamin Franklin's portrait on the denomination, or as \"C-Notes,\" based on the Roman numeral for 100.", "The bill is one of two denominations printed today that does not feature a President of the United States; the other is the $10 bill, featuring Alexander Hamilton." ], [ "Canadian one hundred-dollar note", "Canadian one hundred-dollar note\n\nThe Canadian hundred-dollar note is one of five banknotes of the Canadian dollar.", "It is the highest-valued and least-circulated of the notes since the $1000 note was gradually removed from circulation starting in 2000.", "The current 100-dollar note was put into circulation through major banks in November 2011, made of a durable polymer instead of the traditional paper notes.", "The notes are dominantly brown in colour; the front design of the note features former prime minister Sir Robert Borden and the design on the back depicts the discovery of insulin.", "Security features introduced into the note design include two transparent windows, which make the notes harder to forge than the traditional notes.", "One window extends from the top to the bottom of the note and has holographic images inlaid.", "The other window is in the shape of a maple leaf.", "Additional features include transparent text, a metallic portrait, raised ink, and partially hidden numbers.", "A new $50 note came out in March, 2012, a new $20 note in November 2012, and new $10 and $5 notes in November 2013.", "The note's design and change of material to a polymer (plastic) paper was first announced on March 10, 2011, for longevity and counterfeit prevention." ], [ "Postage stamps and postal history of Christmas Island", "The philatelic office in Melbourne, in charge of the Australian Territories stamp sales, delivered one hundred stamp sheets to the Phosphate Commission which expedited them to the island by ship sailing from Fremantle.", "The same royal effigy served for the registered postal stationery issued on 18 May 1959.", "The first stamps were viewed as a temporary issue, but it took five years to produce the next series.", "Under supervision of the Department of Territories, the Stamp Advisory Committee and representatives of the island, the Australian Post Office and Note Printing Branch's artists and printers worked on the project from photographs taken on the island presenting its flora, fauna and mining industry.", "Finally, ten stamps were scheduled, drawn and engraved by G. Lissenden, Peter Morris and Bruce Stewart.", "They were issued on 28 August 1963.", "Two years later, the island participated in the omnibus issue for the 50th anniversary of the Australian and New Zealand Army Corps landing in Gallipoli during World War I. These two issues bore the designation \"CHRISTMAS ISLAND\" without any reference to Australia like the new cancelling datestamps on which the \"AUST\" abbreviation disappeared.", "Nonetheless, on 6 May 1968, the monetary and postal systems of Christmas Island were brought closer to the Australian ones: the Malayan dollar was replaced by the Australian dollar and the Australian Post and Telegraphs Act came into force." ] ], "gold": "Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse side of the United States $100 bill since 1914. The front design of the Canadian $100 note features former prime minister Robert Borden and the design on the back depicts the discovery of insulin. The Australian $100 bill was designed by Bruce Stewart, and features portraits of soprano Dame Nellie Melba on the observe side and engineer and First World War general Sir John Monash on the reverse.", "prediction 1": "The $100 bill is a denomination of United States currency. The first United States Note with this value was issued in 1862. Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse of the bill since 1914. On the reverse of the banknote is an image of Independence Hall in Philadelphia, which has been used since 1928. The Canadian $100 note is one of five banknotes of the Canadian dollar. It is the highest-valued and least-circulated of the notes since the $1000 note was gradually removed from circulation starting in 2000.", "prediction 2": "The one hundred-dollar bill is a denomination of United States currency. Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse of the bill since 1914. On the reverse of the banknote is an image of Independence Hall in Philadelphia, which has been used since 1928. The Canadian one hundred-dollar note is one of five banknotes of the Canadian dollar. The Canadian $100 bill is one of two denominations printed today that does not feature a President of the United States; the other is the $10 bill, featuring Alexander Hamilton.", "prediction 3": "The $100 bill is a denomination of United States currency. The first $100 United States Note with this value was issued in 1862 and the Federal Reserve Note version was launched in 1914, alongside other denominations. Benjamin Franklin, statesman, inventor, diplomat, and American founding father has been featured on the obverse of the bill since 1914. On the reverse of the banknote is an image of Independence Hall in Philadelphia, which has been used since 1928.", "prediction 4": "The United States $100 bill is a denomination of United States currency. Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse of the bill since 1914. On the reverse of the banknote is an image of Independence Hall in Philadelphia, which has been used since 1928.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 58 }, { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 371 }, { "error type": "Irrelevant", "explanation": "", "start": 372, "end": 443 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 580 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Statesman, inventor, diplomat, and American founding father Benjamin Franklin has been featured on the obverse of the bill since 1914. The front design of the note features former prime minister Sir Robert Borden and the design on the back depicts the discovery of insulin. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did us start fighting in europe ww2?", "passages": [ [ "Military history of the United States during World War II", "The first stepping stone for the Allied liberation of Europe was, in Prime Minister Winston Churchill's words, the \"soft underbelly\" of Europe on the Italian island of Sicily.", "Launched on 9 July 1943, Operation Husky was, at the time, the largest amphibious operation ever undertaken.", "The American seaborne assault by the U.S. 7th Army landed on the southern coast of Sicily between the town of Licata in the west, and Scoglitti in the east and units of the 82nd airborne division parachuted ahead of landings.", "Despite the elements, the operation was a success and the Allies immediately began exploiting their gains.", "On 11 August, seeing that the battle was lost, the German and Italian commanders began evacuating their forces from Sicily to Italy.", "On 17 August, the Allies were in control of the island, U.S. 7th Army lost 8,781 men (2,237 killed or missing, 5,946 wounded, and 598 captured).", "Following the Allied victory in Sicily, Italian public sentiment swung against the war and Italian dictator Benito Mussolini.", "He was deposed in a coup, and the Allies struck quickly, hoping resistance would be slight.", "The first Allied troops landed on the Italian peninsula on 3 September 1943 and Italy surrendered on 8 September, however the Italian Social Republic was established soon afterwards." ], [ "Military history of the United States during World War II", "The introduction of the revered P-51 Mustang, which had enough fuel to make a round trip to Germany's heartland, helped to reduce losses later in the war.", "In mid-1942, the United States Army Air Forces (USAAF) arrived in the UK and carried out a few raids across the English Channel.", "The USAAF Eighth Air Force's B-17 bombers were called the \"Flying Fortresses\" because of their heavy defensive armament of ten to twelve machine guns, and armor plating in vital locations.", "In part because of their heavier armament and armor, they carried smaller bomb loads than British bombers.", "With all of this, the USAAF's commanders in Washington, DC, and in Great Britain adopted the strategy of taking on the Luftwaffe head on, in larger and larger air raids by mutually defending bombers, flying over Germany, Austria, and France at high altitudes during the daytime.", "Also, both the U.S. Government and its Army Air Forces commanders were reluctant to bomb enemy cities and towns indiscriminately.", "They claimed that by using the B-17 and the Norden bombsight, the USAAF should be able to carry out \"precision bombing\" on locations vital to the German war machine: factories, naval bases, shipyards, railroad yards, railroad junctions, power plants, steel mills, airfields, etc." ] ], "gold": "In Europe during WW2, the US started fighting on the ground on 9 July 1943, the day Operation Husky was launched, and started fighting with air raids in mid-1942, which was when the United States Army Air Forces arrived in the UK and carried out a few raids across the English Channel.", "prediction 1": "The first Allied troops landed on the Italian peninsula on 3 September 1943 and Italy surrendered on 8 September. The United States Army Air Forces (USAAF) arrived in the UK and carried out a few raids across the English Channel. Also in mid-1942, the United States Navy launched its first combat sorties in Europe.", "prediction 2": "In the second world war, we began fighting in Europe during Operation Husky, which was an amphibious operation that started on 9 July 1943 on the Italian island of Sicily. The American seaborne assault by the U.S. 7th Army landed on the southern coast of Sicily between the town of Licata in the west, and Scoglitti in the east, and units of the 82nd airborne division parachuted ahead of landings. The American Air Forces first arrived in the UK in mid-1942, and carried out a few raids across the English Channel.", "prediction 3": "During World War II, the United States started fighting in Europe on the Italian island of Sicily. The first stepping stone for the Allied liberation of Europe was, in Prime Minister Winston Churchill's words, the \"soft underbelly\" of Europe on the Italian island of Sicily. Operation Husky was launched on 9 July 1943 and was, at the time, the largest amphibious operation ever undertaken. In mid-1942, the United States Army Air Forces (USAAF) arrived in the UK and carried out a few raids across the English Channel. The introduction of the revered P-51 Mustang helped to reduce losses later in the war.", "prediction 4": "The first stepping stone for the Allied liberation of Europe was, in Prime Minister Winston Churchill's words, the \"soft underbelly\" of Europe on the Italian island of Sicily. Launched on 9 July 1943, Operation Husky was, at the time, the largest amphibious operation ever undertaken. The United States Army Air Forces (USAAF) arrived in the UK and carried out a few raids across the English Channel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 113 }, { "error type": "Unverifiable", "explanation": "", "start": 252, "end": 304 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2, 3 ] } ], "corrected-prediction": "In mid-1942, the United States Army Air Forces (USAAF) arrived in the UK and carried out a few raids across the English Channel. Operation Husky was launched on 9 July 1943, in Europe, with US Army soldiers involved. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings gran torino at the end of the movie?", "passages": [ [ "Walt Kowalski", "Walt Kowalski\n\nWalter \"Walt\" Kowalski is the main character of the film \"Gran Torino\", portrayed by Clint Eastwood.", "Walt is a misanthropic and irritable Polish-American former auto worker who becomes embroiled in a conflict involving a Hmong family and a gang.", "Walt had served in the Korean War and had killed a Korean boy who had been trying to surrender to him; the experience haunts him for the rest of his life.", "He is a retiree who formerly worked at a Ford automobile plant, and he owns a Gran Torino he had personally built.", "He also owns an M1 Garand rifle and an M1911A1 pistol, both of which he kept from the Korean War.", "Walt's wife, Dorothy Kowalski, is dead by the beginning of the film.", "Nick Schenk, the writer of the script of the film, said \"Walt is like a lot of shop teachers and coaches that you have in school.", "He's the kind of guy who's just waiting for you to screw up so he can roll his eyes at you.\"", "Eastwood has said that the car is \"sort of a symbol of his days with the Ford plant\" and that the gun \"is sort of a symbol of his days in the military.", "\u2026", "He's clinging to the memory of the war." ], [ "Gran Torino", "Gran Torino\n\nGran Torino is a 2008 American drama film directed and produced by Clint Eastwood, who also starred in the film.", "The film co-stars Christopher Carley, Bee Vang and Ahney Her.", "This was Eastwood's first starring role since 2004's \"Million Dollar Baby\".", "The film features a large Hmong American cast, as well as one of Eastwood's younger sons, Scott.", "Eastwood's oldest son, Kyle, provided the score.", "Set in Detroit, Michigan, it is the first mainstream American film to feature Hmong Americans.", "Many Lao Hmong war refugees resettled in the U.S. following the communist takeover of Laos in 1975.", "The story follows Walt Kowalski, a recently widowed Korean War veteran alienated from his family and angry at the world.", "Walt's young neighbor, Thao Vang Lor, is pressured by his cousin into stealing Walt's prized 1972 Ford Gran Torino for his initiation into a gang.", "Walt thwarts the theft with his M1 Garand rifle and subsequently develops a relationship with the boy and his family.", "\"Gran Torino\" opened in a limited theatrical release in the United States on December 12, 2008, before expanding wide on January 9, 2009.", "It grossed $270 million worldwide (making it Eastwood's second highest-grossing film to-date)." ] ], "gold": "The character who sings Gran Torino at the end of the movie is Walt Kowalski, the protagonist of the 2008 film Gran Torino, while the performer who does is Clint Eastwood, who portrayed Kowalski in the film.", "prediction 1": "The song Gran Torino at the end of the movie was sung by Kyle Eastwood and Kurt Cobain.", "prediction 2": "The 2008 American drama film Gran Torino features a song by the symphony orchestra, which is performed by Kyle Eastwood. The song was performed by the group Xiaodong Dance Club, in which the chorus sang \"gran torino\".", "prediction 3": "\"Gran Torino\" is a 2008 American drama film directed and produced by Clint Eastwood, who also starred in the film. Eastwood's oldest son, Kyle, provided the score for the film. The song \"Gran Torino\" was written by Danny DeVito and released as a single in the United States in 2011.", "prediction 4": "The character Gran Torino, played by Clint Eastwood, is a former Polish-American auto worker who becomes embroiled in a conflict involving a Hmong family and a gang. At the end of the movie, Kyle Eastwood sings Gran Torino.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 87 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "When did bat out of hell come out?", "passages": [ [ "Bat Out of Hell (TV series)", "Bat Out of Hell (TV series)\n\nBat Out of Hell is a British thriller television serial created by Francis Durbridge and originally aired on BBC Two from 26 November to 24 December 1966.", "The series followed two lovers, Diana Stewart (Sylvia Syms) and Mark Paxton (John Thaw), who are haunted by the voice of Diana's husband over the telephone after he is murdered by the couple.", "Inspector Clay, played by Dudley Foster, was the detective inspector who headed the police investigation.", "Diana Stewart (Sylvia Syms) and Mark Paxton (John Thaw), are in love, however, Diana's husband Geoffrey (Noel Johnson) is unlikely to grant her a divorce.", "When it is discovered that Geoffrey has a mistress, the two begin planning his murder.", "One night, as he is preparing to go on a month-long holiday, Diana shoots her husband and Mark arrives shortly afterward to help her get rid of Geoffrey's body.", "Things start to go wrong when the body disappears from the house and Diana later receives a mysterious telephone call from her \"deceased\" husband.", "Diana is told by Geoffrey to meet him at a local hotel or he will go to the police and have her arrested for attempted murder.", "Much to Mark's dismay, she is told to come to the hotel alone." ], [ "Bat Out of Hell", "Since April 2, 2018 it has been running at the Dominion Theatre, London, with plans to run the show in parallel in Germany and in a tour of the United States in 2019.", "The album was developed from a musical, \"Neverland\", a futuristic rock version of \"Peter Pan\", which Steinman wrote for a workshop in 1974, and performed at the Kennedy Center Music Theatre Lab in 1977.", "Steinman and Meat Loaf, who were touring with the National Lampoon show, felt that three songs were \"exceptional\" and Steinman began to develop them as part of a seven-song set they wanted to record as an album.", "The three songs were \"Bat Out of Hell\", \"Heaven Can Wait\" and \"The Formation of the Pack\", which was later retitled \"All Revved Up with No Place to Go\".", "\"Bat Out of Hell\" is often compared to the music of Bruce Springsteen, particularly the album \"Born to Run\".", "Steinman says he finds that \"puzzling, musically\", although they share influences; \"Springsteen was more an inspiration than an influence.\"", "A BBC article added \"that Max Weinberg and Roy Bittan from Springsteen's E Street Band played on the album only helped reinforce the comparison.\"", "Steinman and Meat Loaf had immense difficulty finding a record company willing to sign them." ], [ "Bat Out of Hell (TV series)", "Mark soon receives a phone call from a local shopkeeper, Kitty Tracey (Patsy Smart), who informs him that Diana has been arrested at the hotel after the police discovered Geoffrey's body.", "This is not the case, and the couple believe they are \"home and dry\" until they are preyed upon by a mysterious blackmailer.", "\"Bat Out of Hell\" was first broadcast on 26 November 1966.", "It aired Saturday nights at 10:05 pm and ran for five episodes with the series finale on 24 December 1966.", "The serial provided an interesting premise with the story taking place before the actual murder, a rarity in the genre at the time, so that the motives for Diana Stewart and Mark Paxton decision to murder Geoffrey Stewart could be better understood by the audience.", "The series climax, according to the John Thaw Foundation, is \"particularly well remembered\" in British television history.", "A novelisation of a five-part serial, entitled \"Bat Out of Hell: An Inspector Clay Mystery\", was written by Francis Durbridge and published in 1972.", "British crime novelist Martin Edwards, who enjoyed the series as a child, praised the book as \"a little-known gem of suspense\"." ] ], "gold": "Bat Out of Hell is a debut album, that came out on October 21, 1977, by American rock singer Meat Loaf and composer Jim Steinman. It was developed from a musical, Neverland, a futuristic rock version of Peter Pan, which Steinman wrote for a workshop in 1974. The British television show with the same name, released on 26 November 1966, a thriller that followed two lovers, Diana Stewart, and Mark Paxton, who are haunted by the voice of Diana's husband over the telephone after he is murdered by the couple.", "prediction 1": "Bat Out of Hell is a British thriller television serial created by Francis Durbridge and originally aired on BBC Two from 26 November to 24 December 1966. The series followed two lovers, Diana Stewart and Mark Paxton, who are haunted by the voice of Diana's husband over the telephone after he is murdered by the couple. Inspector Clay, played by Dudley Foster, was the detective inspector who headed the police investigation. The album was developed from a musical, Neverland, a futuristic rock version of Peter Pan, which Steinman wrote for a workshop in 1974, and performed at the Kennedy Center Music Theatre Lab in 1977.\n", "prediction 2": "The British television series, Bat Out of Hell, first came out in 1966. The TV show eventually turned into a 40 episode miniseries, which was repackaged as an eight-part adventure adventure thriller, called Detective Inspector Clay's Saga, and aired on BBC Two from 26 November to 24 December 1966.", "prediction 3": "Batons Out of Hell, a British television serial serial, first came out on BBC2 in 1966. The series followed two lovers, Diana Stewart and Mark Paxton, who are haunted by the voice of Diana's husband over the telephone after he is murdered by the couple. The darkness of the night soon follows when Diana shoots her husband and Mark arrives shortly afterward to help her get rid of his body. The next day, Diana's alarm rings, and Mark arrives to find the body.", "prediction 4": "The television serial Bat Out of Hell first came out on BBC Two on 26 November 1966. The music video for the show was released on April 4, 2019, and it was bested by David Bowie, who recorded an edition of 680 copies for the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 426 }, { "error type": "Irrelevant", "explanation": "", "start": 563, "end": 626 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Bat Out of Hell is a British thriller television show that released on 26 November 1966. The series followed two lovers, Diana Stewart and Mark Paxton, who are haunted by the voice of Diana's husband over the telephone after he is murdered by the couple. An album with the same name was developed from a musical, Neverland, a futuristic rock version of Peter Pan, which Steinman wrote for a workshop in 1974. It was an album from Steinman and Meat Loaf." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where did the pilgrims land first plymouth rock or provincetown?", "passages": [ [ "Plymouth Rock", "Plymouth Rock\n\nPlymouth Rock is the traditional site of disembarkation of William Bradford and the \"Mayflower\" Pilgrims who founded Plymouth Colony in 1620.", "The Pilgrims did not refer to Plymouth Rock in any of their writings; the first known written reference to the rock dates to 1715 when it was described in the town boundary records as \"a great rock.\"", "The first documented claim that Plymouth Rock was the landing place of the Pilgrims was made by Elder Thomas Faunce in 1741, 121 years after the Pilgrims arrived in Plymouth.", "From that time to the present, Plymouth Rock has occupied a prominent spot in American tradition and has been interpreted by later generations as a symbol of both the virtues and the flaws of the first English people who colonized New England.", "In 1774, the rock broke in half during an attempt to haul it to Town Square in Plymouth.", "The top portion (the fragment now visible) sat in Town Square, was moved to Pilgrim Hall Museum in 1834, and was returned to its original site on the shore of Plymouth Harbor in 1880.", "Today it is ensconced beneath a granite canopy designed by McKim, Mead & White.", "Plymouth Rock is geologically classified as a Dedham Granite boulder and a glacial erratic." ], [ "Provincetown, Massachusetts", "Provincetown, Massachusetts\n\nProvincetown is a New England town located at the extreme tip of Cape Cod in Barnstable County, Massachusetts, in the United States.", "A small coastal resort town with a year-round population of just under 3,000, Provincetown has a summer population of as high as 60,000.", "Often called \"P-town\" or \"P'town\", the town is known for its beaches, harbor, artists, tourist industry, and its status as a vacation destination for the LGBTQ community.", "At the time of European encounter, the area was long settled by the historic Nauset tribe, who had a settlement known as \"Meeshawn\".", "They spoke Massachusett, a Southern New England Algonquian language dialect that they shared in common with their closely related neighbors, the Wampanoag.", "On May 15, 1602, having made landfall from the west and believing it to be an island, Bartholomew Gosnold initially named this area \"Shoal Hope\".", "Later that day, after catching a \"great store of codfish\", he chose instead to name this outermost tip of land \"Cape Cod\".", "Notably, that name referred specifically to the area of modern-day Provincetown; it wasn't until much later that that name was reused to designate the entire region now known as Cape Cod." ], [ "Plymouth, Massachusetts", "Today, these settlers are much better known as the \"Pilgrims\", a term coined by William Bradford.", "The Mayflower first anchored in the harbor of Provincetown, Massachusetts on November 11, 1620.", "The ship was headed for the mouth of the Hudson River near Manhattan, which was part of the Colony of Virginia at the time, but it did not go beyond Cape Cod.", "The Pilgrim settlers realized that they did not have a patent to settle in the region, so they signed the Mayflower Compact prior to disembarking.", "They explored various parts of Cape Cod and eventually sought a suitable location for a permanent settlement to the westward in Cape Cod Bay.", "They discovered the sheltered waters of Plymouth Harbor on December 17, and the protected bay led to a site for the new settlement after three days of surveying.", "The settlers officially disembarked on December 21, 1620.", "It is traditionally said that the Pilgrims first set foot in America at the site of Plymouth Rock, though no historical evidence can prove this claim.", "They named their settlement \"Plimouth\" (sometimes spelled \"Plimoth\") after the major port city in Devon, England from which the \"Mayflower\" ultimately sailed.", "Plymouth faced many difficulties during its first winter, the most notable being the risk of starvation and the lack of suitable shelter.", "From the beginning, the assistance of Native Americans was vital." ] ], "gold": "The Pilgrims landed at Provincetown, Massachusetts, prior to landing at Plymouth Rock, having first landed at Provincetown on November 11, 1620, and having first landed at Plymouth Rock in December 1620.", "prediction 1": "Plymouth Rock is the site of disembarkation of William Bradford and the Mayflower Pilgrims who founded Plymouth Colony in 1620. The Pilgrims did not refer to Plymouth Rock in any of their writings; the first known written reference to the rock dates to 1715 when it was described in the town boundary records as \"a great rock.\" The first documented claim that Plymouth Rock was the landing place of the Pilgrims was made by Elder Thomas Faunce in 1741, 121 years after the Pilgrims were originally named Provincetown, the outermost tip of Cape Cod.", "prediction 2": "Plymouth Rock is the traditional site of disembarkation of William Bradford and the Mayflower Pilgrims who founded Plymouth Colony in 1620. The first known written reference to the rock dates to 1715 when it was described in the town boundary records as \"a great rock.\" The first documented claim that Plymouth Rock was the landing place of the Pilgrims was made by Elder Thomas Faunce in 1741, 121 years after the Pilgrims arrived in Plymouth. Provincetown is a New England town located at the extreme tip of Cape Cod in Barnstable County, Massachusetts, Massachusetts, in Barnstable County, Massachusetts.", "prediction 3": "There is no evidence that the Pilgrims first set foot in America at the site of Plymouth Rock. The first documented claim that Plymouth Rock was the landing place of the Pilgrims was made by Elder Thomas Faunce in 1741, 121 years after the Pilgrims arrived in Plymouth. The site is in the area now known as Provincetown, a small coastal resort town located at the extreme tip of Cape Cod in Barnstable County, Massachusetts, in the United States.", "prediction 4": "It is traditionally said that the Pilgrims first set foot in America at the site of Plymouth Rock, though no historical evidence can prove this claim. The first documented claim that Plymouth Rock was the landing place of the Pilgrims was made by Elder Thomas Faunce in 1741, 121 years after the Pilgrims arrived in Plymouth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 548 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Plymouth Rock is the site of disembarkation of William Bradford and the Mayflower Pilgrims who founded Plymouth Colony in 1620. The Mayflower first anchored in the harbor of Provincetown, Massachusetts on November 11, 1620." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who did golden state play in the playoffs last year?", "passages": [ [ "2015\u201316 Cleveland Cavaliers season", "2015\u201316 Cleveland Cavaliers season\n\nThe 2015\u201316 Cleveland Cavaliers season was the 46th season of the Cleveland Cavaliers franchise in the National Basketball Association (NBA).", "In the playoffs, the Cavaliers swept the Detroit Pistons in four games in the First Round, then swept the Atlanta Hawks in four games in the Semifinals, before finally defeating the Toronto Raptors in six games in the Conference Finals to reach the NBA Finals for a second consecutive year.", "There, the Cavaliers faced off against the defending NBA champion Golden State Warriors, the team that defeated them in last year's NBA Finals in six games, and were coming off of a record-breaking regular season, where the team posted a league-best 73-9 record.", "The Cavaliers would go on to defeat the Golden State Warriors in the 2016 NBA Finals in seven games, coming back from a 3\u20131 series deficit to avenge their NBA Finals loss from the year before and winning their first NBA championship.", "The Cavaliers became the first team in NBA Finals history to recover from a 3\u20131 series deficit and win.", "The Cavaliers' victory also marked the first championship win by a major professional sports team from Cleveland since 1964, ending a 52\u2013year championship drought dating back to the 1964 NFL title won by the Cleveland Browns.", "The Cavaliers started the season strong and rose to the top of the Eastern Conference." ], [ "2014 NBA Playoffs", "In addition, this was the first time in NBA history that the Knicks, Celtics, and Lakers missed the playoffs in the same year (the Celtics last missed the playoffs in 2007)", "The Denver Nuggets also missed the playoffs for the first time since 2003.", "The first round of the 2014 Playoffs is generally considered one of the greatest postseason rounds in NBA history.", "The first 11 days of the playoffs saw at least one road team win on its opponent's home floor.", "That ended on April 30 with the Raptors, Spurs, and Houston Rockets all winning at home against the Brooklyn Nets, Dallas Mavericks, and Portland Trail Blazers, respectively.", "The 24 road wins is an NBA playoffs record for the first round.", "In addition, the 2014 playoffs featured a record eight first-round games that went into overtime, including four straight between the Memphis Grizzlies and Oklahoma City Thunder (Games 2\u20135), another NBA record.", "Five of the eight first-round series were extended to game sevens.", "Three of the series, Atlanta Hawks at Indiana Pacers, Memphis Grizzlies at Oklahoma City Thunder, and Golden State Warriors at Los Angeles Clippers, were played on May 3, which marked the first time in NBA history that three Game 7s were played on the same day.", "Two other game sevens were played on the following day, featuring Dallas at San Antonio and Brooklyn at Toronto." ], [ "2017 NBA Finals", "2017 NBA Finals\n\nThe 2017 NBA Finals was the championship series of the National Basketball Association (NBA)'s 2016\u201317 season and conclusion of the season's playoffs.", "The Western Conference champion Golden State Warriors defeated the defending NBA champion and Eastern Conference champion Cleveland Cavaliers 4 games to 1.", "This Finals was the first time in NBA history the same two teams had met for a third consecutive year.", "The Cavaliers sought to repeat as champions after winning the championship in 2016, while the Warriors won the first meeting in 2015.", "Golden State earned home court advantage with a 2016\u201317 regular season record of , while Cleveland finished the regular season with a record.", "The Warriors entered the 2017 Finals after becoming the first team in NBA playoff history to start , while the Cavaliers entered the 2017 Finals with a record during the first three rounds of the postseason.", "The Warriors' start in the playoffs is the most consecutive postseason wins in NBA history and their record is the best winning percentage () in NBA Playoff history.", "This was the Golden State Warriors' third consecutive trip to the NBA Finals and ninth appearance overall, having come short of back-to-back titles in the 2016 NBA Finals by losing in seven games after having a 3\u20131 lead." ] ], "gold": "The 2020 NBA season marked the first time the Golden State Warriors missed the playoffs in eight years. Before that, during the 2017 edition, they played against the Trail Blazers, Jazz, Spurs, and Cavaliers, and won the finals 4-1 against the latter ones. In 2016, they also played against Rockets, Trail Blazers, Thunder, and Cavaliers in the playoffs, becoming the first team in NBA history to squander a 3\u20131 lead in the finals in the process. During the 2015 playoffs, they met against Pelicans, Grizzlies, Rockets, and Cavaliers, defeating the Cavaliers in six matches in order to crown themselves as winners of the 2015 NBA championship.", "prediction 1": "The Golden State Warriors played in the NBA playoffs in 2016 and 2017. The Warriors defeated the Cavaliers in the finals of the 2015\u201316 season and the 2015\u201316 season. In the 2017 playoffs, the Warriors defeated the Cavaliers 4 games to 1.", "prediction 2": "Golden State has played in the NBA playoffs three times. In 2016, the Golden State Warriors defeated the Cleveland Cavaliers in six games. Also in 2016, the Golden State Thunder defeated the Cleveland Cavaliers in six games. In 2017, the Golden State Warriors defeated the Los Angeles Clippers in six games. In 2018, the Golden State Warriors defeated the Portland Trail Blazers in six games.", "prediction 3": "The Golden State Warriors have played in the NBA Playoffs 3 times. In 2015, they played the Detroit Pistons in the First Round, and in 2016 they played the Oklahoma City Thunder. In 2017, they played the Los Angeles Clippers.", "prediction 4": "The Golden State Warriors defeated the Cleveland Cavaliers in the 2016 NBA Finals in seven games. The Warriors won the championship by defeating the Cavaliers 4 games to 1 in the second round of the playoffs. The Western Conference champions went on to defeat the Cavaliers in the finals of the 2016\u201317 season, and the Eastern Conference champions went on to defeat the Golden State Warriors, who lost in the playoffs in six games.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 70 }, { "error type": "Redundant", "explanation": "The Warriors defeated the Cavaliers in the finals of the 2015\u201316 season ", "start": 143, "end": 166 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 84, "end": 92 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Golden State Warriors played in the NBA playoffs. The Warriors lost to the Cavaliers in the playoff finals of the 2015\u201316 season. They squandered a 3\u20131 series score. In the prior year, the Warriors beat the Cavaliers to win the NBA Finals. In the 2014 playoffs, the Warriors played the Los Angeles Clippers. In the 2017 playoffs, the Warriors defeated the Cavaliers 4 games to 1." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "When did the death penalty stop in the uk?", "passages": [ [ "Capital punishment in the United Kingdom", "It was passed on a free vote in the House of Commons by 200 votes to 98.", "The bill was subsequently passed by the House of Lords by 204 votes to 104.", "Silverman was opposed in the General Election 1966 in the Nelson and Colne constituency by Patrick Downey, the uncle of Lesley Anne Downey, a victim in the Moors murders case, who stood on an explicitly pro-hanging platform.", "Downey polled over 5,000 votes, 13.7%, then the largest vote for a genuinely independent candidate since 1945.", "The Murder (Abolition of Death Penalty) Act 1965 suspended the death penalty in Great Britain (but not in Northern Ireland) for murder for a period of five years, and substituted a mandatory sentence of life imprisonment; it further provided that if, before the expiry of the five-year suspension, each House of Parliament passed a resolution to make the effect of the Act permanent, then it would become permanent.", "In 1969 the Home Secretary, James Callaghan, proposed a motion to make the Act permanent, which was carried in the Commons on 16 December 1969, and a similar motion was carried in the Lords on 18 December.", "The death penalty for murder was abolished in Northern Ireland on 25 July 1973 under the Northern Ireland (Emergency Provisions) Act 1973." ], [ "Monarchy of Ireland", "The effect was to create a personal union between the Crown of Ireland and the British Crown, instead of the English Crown.", "Later, from 1 January 1801, an additional merger took place between the two Kingdoms.", "By the terms of the Acts of Union 1800, the Kingdom of Ireland merged with the Kingdom of Great Britain, thus creating the United Kingdom of Great Britain and Ireland.", "Following the separation of most of Ireland from that kingdom in 1922, the remaining constituent parts were renamed the United Kingdom of Great Britain and Northern Ireland in 1927, five years after the establishment of the Irish Free State.", "In early December 1922, most of Ireland (twenty-six of the country's thirty-two counties) left the United Kingdom of Great Britain and Ireland.", "These 'Twenty-Six Counties' now became the Irish Free State, a self-governing dominion within the British Empire.", "Six of Ireland's north-eastern counties, all within the Province of Ulster, remained within the United Kingdom as Northern Ireland.", "As a Dominion, the Free State was a constitutional monarchy with the British monarch as its head of state.", "The monarch was officially represented in the new Free State by the Governor-General of the Irish Free State." ], [ "United Kingdom", "United Kingdom\n\nThe United Kingdom, officially the United Kingdom of Great Britain and Northern Ireland but more commonly known as the UK or Britain, is a sovereign country lying off the north-western coast of the European mainland.", "The United Kingdom includes the island of Great Britain, the north-eastern part of the island of Ireland and many smaller islands.", "Northern Ireland is the only part of the United Kingdom that shares a land border with another sovereign statethe Republic of Ireland.", "Apart from this land border, the United Kingdom is surrounded by the Atlantic Ocean, with the North Sea to the east, the English Channel to the south and the Celtic Sea to the south-west, giving it the 12th-longest coastline in the world.", "The Irish Sea lies between Great Britain and Ireland.", "With an area of , the United Kingdom is the 78th-largest sovereign state in the world.", "It is also the 22nd-most populous country, with an estimated 66.0 million inhabitants in 2017.", "The UK is a unitary parliamentary democracy and constitutional monarchy.", "The current monarch is Queen Elizabeth II, who has reigned since 1952, making her the longest-serving current head of state.", "The United Kingdom's capital and largest city is London, a global city and financial centre with an urban area population of 10.3 million.", "Other major urban areas in the UK include Manchester, Birmingham, Leeds, Glasgow, Liverpool, and Newcastle." ] ], "gold": "The death penalty stopped in the United Kingdom on a number of dates. In the UK, the death penalty for murder was suspended in Great Britain in 1965, while it was stopped permanently in the UK in 1969 and abolished in the UK on 31 July 1998. The death penalty for murder was abolished in Northern Ireland, which with Great Britain constitutes the UK, on 25 July 1973.", "prediction 1": "The death penalty in Great Britain was abolished on 15 December 1965 and the death penalty in Northern Ireland was abolished on 25 July 1973. The death penalty was abolished in Northern Ireland on 25 July 1973. The death penalty was abolished in Great Britain on 14 March 1973.", "prediction 2": "The death penalty was abolished in the United Kingdom in 1965 and in Northern Ireland in 1973. The death penalty for murder was abolished in Northern Ireland on 25 July 1973.", "prediction 3": "The death penalty in the United Kingdom was abolished in 1965. The Murder (Abolition of Death Penalty) Act 1965 suspended the death penalty in Great Britain but not in Northern Ireland for a period of five years. The death penalty for murder was abolished in Northern Ireland on 25 July 1973 under the Northern Ireland (Emergency Provisions) Act 1973.", "prediction 4": "The death penalty in the United Kingdom was abolished on 1 January 1965. The Murder (Abolition of Death Penalty) Act 1965 suspended the death penalty in Great Britain (but not in Northern Ireland) for murder for a period of five years, and substituted a mandatory sentence of life imprisonment. The death penalty for murder was abolished in Northern Ireland on 25 July 1973 under the Northern Ireland (Emergency Provisions) Act 1973.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 211, "end": 277 }, { "error type": "Redundant", "explanation": " the death penalty in Northern Ireland was abolished on 25 July 1973. ", "start": 142, "end": 210 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In the UK, the death penalty for murder was suspended in Great Britain in 1965, while it was stopped permanently in the UK in 1969. The death penalty was abolished in Northern Ireland on 25 July 1973. " }, "preference": [ 1, 0, 2, 2, 2, 0 ] }, { "question": "What channel is the weather channel.on direct tv?", "passages": [ [ "DirecTV", "DirecTV\n\nDirecTV (stylized as DIRECTV) is an American direct broadcast satellite service provider based in El Segundo, California and is a subsidiary of AT&T.", "Its satellite service, launched on June 17, 1994, transmits digital satellite television and audio to households in the United States, Latin America and the Caribbean/Americas.", "Its primary competitors are Dish Network and cable television providers.", "On July 24, 2015, after receiving approval from the United States Federal Communications Commission and United States Department of Justice, AT&T acquired DirecTV in a transaction valued at $67.1 billion.", "DirecTV provides television and audio services to subscribers through satellite transmissions.", "Services include the equivalent of many local television stations, broadcast television networks, subscription television services, satellite radio services, and private video services.", "Subscribers have access to hundreds of channels, so its competitors are cable television service and other satellite-based services.", "Most subscribers use reception antennas which are much smaller than the first generation antennas, which were typically a few yards (meters) across.", "Advances in antenna technology, including fractal antennas, have allowed a general reduction in antenna size across all industries and applications.", "Receiving equipment includes a satellite dish, an integrated receiver/decoder and a DirecTV access card, which is necessary to operate the receiver/decoder." ], [ "The Weather Channel", "Representatives for DirecTV stated that it added WeatherNation TV in response to subscriber complaints regarding the number of reality programs on The Weather Channel, which it estimated had amounted to 40% of its daily schedule (WeatherNation TV, which outside of its carriage by DirecTV is primarily carried on broadcast television stations as a main channel affiliation or a digital multicast service, does not run programming outside of forecasts with the only interruption in its weather coverage coming from affiliates that carry children's programs to fulfill FCC educational programming requirements; however, WeatherNation has been criticized for its absence of live programming, which TWC does provide, especially during significant weather events).", "DirecTV stated that weather information is also available through broadcast television stations carried as part of its local channel tier, as well as the provider's designated emergency channels.", "The Weather Channel fought back by airing commercials encouraging people to not subscribe to DirecTV by parodying the provider's popular \"When You...\" ad campaign, which is this:\n\nOn April 8, 2014, The Weather Channel and DirecTV both settled on a new agreement (TWC decided to alter its programming lineup by trimming the amount of reality programming on weekdays in half, restricting them to its nighttime schedule, in response to complaints from DirecTV subscribers), with the provider restoring the channel on channel 362 the following day." ] ], "gold": "The Weather Channel is on several channels on the satellite service provider DirectTV, including Channel 362 on DirecTV in HD/SD and Channel 1362 on DirecTV on demand.", "prediction 1": "DirecTV is an American direct broadcast satellite service provider based in El Segundo, California and is a subsidiary of AT&T. The Weather Channel was removed from DirecTV in May 2014 due to subscriber complaints regarding the number of reality programs it was showing.", "prediction 2": "DirecTV is an American direct broadcast satellite service provider that transmits digital satellite television and audio to homes in the United States, Latin America and the Caribbean/Americas. DirecTV added WeatherNation TV in response to subscriber complaints regarding the number of reality programs on The Weather Channel, which it estimated had amounted to 40% of its daily schedule. WeatherNation TV, which outside of its carriage by DirecTV is primarily carried on broadcast television stations as a main channel affiliation or a digital multicast service, does not run programming outside of forecasts with the only interruption in its weather coverage coming from affiliates that carry children's programs to fulfill FCC educational programming requirements.", "prediction 3": "DirecTV, an American direct broadcast satellite service provider, is an American direct broadcast satellite service provider based in El Segundo, California that transmits digital satellite television and audio to households in the United States, Latin America and the Caribbean/Americas. The Weather Channel was originally added to DirecTV in response to subscriber complaints regarding the number of reality programs on The Weather Channel, which it estimated had amounted to 40% of its daily schedule. WeatherNation TV, which outside of its carriage by DirecTV is primarily carried on broadcast television stations as a main channel affiliation or a digital multicast service, does not run programming outside of forecasts with the only interruption in its weather coverage coming from affiliates that carry children's programs. DirecTV has been criticized for its absence of live programming, which TWC has been criticized for its absence of live programming, which", "prediction 4": "The Weather Channel is a television-only weather channel on DirecTV. The channel has existed since 2006 on channel 362 and has been on DirecTV since 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 270 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the best picture in the oscars?", "passages": [ [ "Academy Award for Best Picture", "Academy Award for Best Picture\n\nThe Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences (AMPAS) since the awards debuted in 1929.", "This award goes to the producers of the film and is the only category in which every member of the Academy is eligible to submit a nomination.", "Best Picture is the final award of the night and is considered the most prestigious honor of the ceremony.", "The Grand Staircase columns at the Dolby Theatre in Hollywood, where the Academy Awards ceremonies have been held since 2002, showcase every film that has won the Best Picture title since the award's inception.", "As of 2018, there have been 546 films nominated for Best Picture and 90 winners.", "At the 1st Academy Awards ceremony (for 1927 and 1928), there were two categories of awards that were each considered the top award of the night: \"Outstanding Picture\" and \"Unique and Artistic Picture,\" the former being won by the war epic \"Wings,\" and the latter by the art film \".\"", "Each award was intended to honor different and equally important aspects of superior filmmaking.", "The following year, the Academy dropped the \"Unique and Artistic Picture\" award, and decided retroactively that the award won by \"Wings\" was the highest honor that could be awarded." ], [ "Academy Award for Best Director", "The Academy Awards for Best Director and Best Picture have been very closely linked throughout their history.", "Of the 90 films that have been awarded Best Picture, 64 have also been awarded Best Director.", "Since its inception, the award has been given to 69 directors or directing teams.", "John Ford has received the most awards in this category with four.", "William Wyler was nominated on twelve occasions, more than any other individual.", "Damien Chazelle became the youngest director in history to receive this award, at the age of 32 for his work on \"La La Land\".", "Two directing teams have shared the award; Robert Wise and Jerome Robbins for \"West Side Story\" in 1961 and Joel and Ethan Coen for \"No Country for Old Men\" in 2007.", "The Coen brothers are the only siblings to have won the award.", "Kathryn Bigelow is the only woman to have won the award, for 2009's \"The Hurt Locker\".", "As of the 2018 ceremony, Guillermo del Toro is the most recent winner in this category for his work on \"The Shape of Water\".", "In the following table, the years are listed as per Academy convention, and generally correspond to the year of film release in Los Angeles County, California; the ceremonies are always held the following year.", "For the first five ceremonies, the eligibility period spanned twelve months from August 1 to July 31." ] ], "gold": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences with the award going to the producers of the film. For the 88th Academy Awards, producers Nicole Rocklin, Steve Golin, Michael Sugar, and Blye Pagon Faust won for the film Spotlight. The 89th awards went to Dede Gardner, Jeremy Kleiner, and Adele Romanski for Moonlight, and the 90th went to J. Miles Dale, Guillermo del Toro for The Shape of Water. ", "prediction 1": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences (AMPAS) since the awards debuted in 1929. This award goes to the producers of the film and is the only category in which every member of the Academy is eligible to submit a nomination. The grand staircase columns at the Dolby Theatre in Hollywood, where the Academy Awards ceremonies have been held since 2002, showcase every film that has won the Best Picture title since the award's inception. Since its inception, the award has been given to 69 directors or directing teams. The Coen brothers are the only siblings to have won this award.", "prediction 2": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences since the awards debuted in 1929. This award goes to the producers of the film and is the only category in which every member of the Academy is eligible to submit a nomination. As of 2018, there have been 546 films nominated for Best Picture and 90 winners. Of the 90 films that have been awarded Best Picture, 64 have also been awarded Best Director. Since its inception, the award has been given to 69 directors or directing teams.", "prediction 3": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences since the awards debuted in 1929. The Best Picture award goes to the producers of the film and is the only category in which every member of the Academy is eligible to submit a nomination. The Grand Staircase columns at the Dolby Theatre in Hollywood, where the Academy Awards ceremonies have been held since 2002, showcase every film that has won the Best Picture title since the award's inception. Of the 90 films that have been awarded Best Director, 64 have also been awarded Best Director.", "prediction 4": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences since the awards debuted in 1929. This award goes to the producers of the film, and is the only category in which every member of the Academy is eligible to submit a nomination. In the 2012 and 2013 Oscars, \"The Shape of Water\" was the winner of Best Picture.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 318 }, { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 529 }, { "error type": "Irrelevant", "explanation": "", "start": 530, "end": 611 }, { "error type": "Irrelevant", "explanation": "", "start": 612, "end": 675 } ], "missing-info": [], "corrected-prediction": "The Academy Award for Best Picture is one of the Academy Awards presented annually by the Academy of Motion Picture Arts and Sciences. This award goes to the producers of the film. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Which type of memory shows a much greater decline with age than others?", "passages": [ [ "Memory and aging", "While MCI patients had a lower performance in this task than the control group, AD patients performed worse overall.", "The abilities of MCI patients stood out, however, due to the ability to provide examples to make up for their difficulties.", "AD patients failed to use any compensatory strategies and therefore exhibited the difference in use of episodic memory and executive functioning.", "Normal aging is associated with a decline in various memory abilities in many cognitive tasks; the phenomenon is known as age-related memory impairment (AMI) or age-associated memory impairment (AAMI).", "The ability to encode new memories of events or facts and working memory shows decline in both cross-sectional and longitudinal studies.", "Studies comparing the effects of aging on episodic memory, semantic memory, short-term memory and priming find that episodic memory is especially impaired in normal aging; some types of short-term memory are also impaired.", "The deficits may be related to impairments seen in the ability to refresh recently processed information.", "Source information is one type of episodic memory that suffers with old age; this kind of knowledge includes where and when the person learned the information.", "Knowing the source and context of information can be extremely important in daily decision-making, so this is one way in which memory decline can affect the lives of the elderly." ], [ "Memory and aging", "The supporting research in this test, after controlling for sex, education, and other health-related issues, show that greater age was associated with lower hit and greater false alarm rates, and also a more liberal bias response on recognition tests.", "Older people have a higher tendency to make outside intrusions during a memory test.", "This can be attributed to the inhibition effect.", "Inhibition caused participants to take longer time in recalling or recognizing an item, and also subjected the participants to make more frequent errors.", "For instance, in a study using metaphors as the test subject, older participants rejected correct metaphors more often than literally false statements.", "Working memory, which as previously stated is a memory system that stores and manipulates information as we complete cognitive tasks, demonstrates great declines during the aging process.", "There have been various theories offered to explain why these changes may occur, which include fewer attentional resources, slower speed of processing, less capacity to hold information, and lack of inhibitory control.", "All of these theories offer strong arguments, and it is likely that the decline in working memory is due to the problems cited in all of these areas.", "Some theorists argue that the capacity of working memory decreases as we age, and we are able to hold less information." ] ], "gold": "Normal aging is associated with a decline in various memory abilities in many cognitive tasks. The ability to encode new memories of events or facts and working memory shows decline in both cross-sectional and longitudinal studies. Studies comparing the effects of aging on episodic memory, semantic memory, short-term memory and priming find that episodic memory is especially impaired in normal aging as well as some types of short-term memory.", "prediction 1": "Working memory shows a great decline during the aging process, which is a memory system that stores and manipulates information as we complete cognitive tasks. Several factors are believed to contribute to this decline, including age-related memory impairment and age-associated memory impairment. In some cases, episodic memory, which encodes new memories of events or facts, shows a greater decline with age than working memory.", "prediction 2": "Working memory, which as previously stated is a memory system that stores and manipulates information as we complete cognitive tasks, demonstrates great declines during the aging process. Source information is one type of episodic memory that suffers with old age. This kind of knowledge includes where and when the person learned the information.", "prediction 3": "Working memory, which as previously stated is a memory system that stores and manipulates information as we complete cognitive tasks, demonstrates great declines during the aging process. As we age, the ability to encode new memories of events or facts and working memory both show declines. Source information is one type of episodic memory that suffers with old age.", "prediction 4": "Working memory, which is a memory system that stores and manipulates information as we complete cognitive tasks, shows great declines during the aging process. There are different types of episodic memory, semantic memory, short-term memory, and priming that show declines with age. Source information is one type of episodic memory that suffers with old age.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 159 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Normal aging is associated with a decline in various memory abilities in many cognitive tasks. The ability to encode new memories of events or facts and working memory shows decline in both cross-sectional and longitudinal studies. Studies comparing the effects of aging on episodic memory, semantic memory, short-term memory and priming find that episodic memory is especially impaired in normal aging; some types of short-term memory are also impaired. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who planted the bomb at the atlanta olympics?", "passages": [ [ "Centennial Olympic Park bombing", "Centennial Olympic Park bombing\n\nThe Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27 during the 1996 Summer Olympics.", "The blast directly killed 1 person and injured 111 others; another person later died of a heart attack.", "It was the first of four bombings committed by Eric Rudolph.", "Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park.", "Rudolph, a carpenter and handyman, had detonated three pipe bombs inside a U.S. military ALICE Pack.", "Motivated by what he considered to be the government's sanctioning of \"abortion on demand\", Rudolph wanted to force the cancellation of the Olympics.", "After the bombings, Jewell was temporarily investigated as a suspect by the Federal Bureau of Investigation and the news media falsely focused on him aggressively as the presumed culprit.", "However, in October 1996, Jewell was exonerated when the FBI declared that he was no longer a person of interest.", "Following three more bombings in 1997, Rudolph was identified by the FBI as the suspect.", "In 2003, Rudolph was arrested and tried before being convicted two years later.", "Rudolph was sentenced to life imprisonment without parole for his crimes." ] ], "gold": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing in Georgia, on July 27, 1996, during the Atlanta Summer Olympics. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and began clearing spectators out of the park.", "prediction 1": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27 during the 1996 Summer Olympics. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park.", "prediction 2": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27, 1996 during the Summer Olympics. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park.", "prediction 3": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27 during the 1996 Summer Olympics. The blast directly killed 1 person and injured 111 others; another person later died of a heart attack. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park.", "prediction 4": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27 during the 1996 Summer Olympics. The blast directly killed 1 person and injured 111 others; another person later died of a heart attack. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park. Rudolph, a carpenter and handyman, had detonated three pipe bombs inside a U.S. Army ALICE Pack.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Centennial Olympic Park bombing was a domestic terrorist pipe bombing attack on the Centennial Olympic Park in Atlanta, Georgia, on July 27 during the 1996 Summer Olympics. It was the first of four bombings committed by Eric Rudolph. Security guard Richard Jewell discovered the bomb before detonation and cleared most of the spectators out of the park." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sang the song in the misty moonlight?", "passages": [ [ "In the Misty Moonlight", "In the Misty Moonlight\n\n\"In the Misty Moonlight\" is a song written by Cindy Walker.", "One of the first singers to record the song in 1964 was Jim Reeves: it is included on his posthumous album \"The Jim Reeves Way\".", "There also have been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964.", "It was released as a single in 1967 and went to number one on the Easy Listening chart and number forty-six on the \"Billboard\" Hot 100.", "The song was Martin's fifth and final number one on the Easy Listening chart.", "On the other hand, Jerry Wallace had a #19 hit on Billboard Top 100 when his version was released in 1964, so as far as Billboard Top 100 charts, Wallace had the more successful version.", "Both Wallace and Martin's versions are high quality and well produced." ] ], "gold": "\"In the Misty Moonlight\" is a song written by Cindy Walker originally sung by Jim Reeves in 1964. Many artists have covered the song, but the two most successful versions were recorded by Dean Martin and Jerry Wallace. Wallace's version had a #19 hit on the Billboard Top 100 when his version was released in 1964. ", "prediction 1": "\"In the Misty Moonlight\" is a song written by Cindy Walker. One of the first singers to record the song in 1964 was Jim Reeves. There have also been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964. It was released as a single in 1967 and went to number one on the Easy Listening chart and number forty-six on the \"Billboard\" Hot 100.", "prediction 2": "\"In the Misty Moonlight\" is a song written by Cindy Walker. One of the first singers to record the song in 1964 was Jim Reeves: it is included on his posthumous album The Jim Reeves Way. There also have been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964. It was released as a single in 1967 and went to number one on the Easy Listening chart and number forty-six on the Billboard Hot 100.", "prediction 3": "\"In the Misty Moonlight\" is a song written by Cindy Walker. One of the first singers to record the song in 1964 was Jim Reeves: it is included on his posthumous album \"The Jim Reeves Way\". There have been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964. It was released as a single in 1967 and went to number one on the Easy Listening chart and number forty-six on the \"Billboard\" Hot 100.", "prediction 4": "\"In the Misty Moonlight\" is a song written by Cindy Walker. One of the first singers to record the song in 1964 was Jim Reeves: it is included on his posthumous album \"The Jim Reeves Way\". There have been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964. It was released as a single in 1967 and went to number one on the Easy Listening chart and number forty-six on the Billboard Hot 100.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 399 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"In the Misty Moonlight\" is a song written by Cindy Walker. One of the first singers to record the song in 1964 was Jim Reeves. There have also been many other artists who have covered the song, but the most successful version was recorded by Dean Martin in 1964. On the other hand, Jerry Wallace had a #19 hit on Billboard Top 100 when his version was released in 1964." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was cross country skiing added to the olympics?", "passages": [ [ "Cross-country skiing (sport)", "Skating is most effective on wide, smooth, groomed trails, using fiberglass skis that glide well; it also benefits a stronger athlete\u2014which, according to Olav B\u00f8, are the reasons that the technique made a breakthrough in the early 1980s.", "Athletes widely adopted skating to both sides by the time of the 1985 world championship and it was formally adopted by the FIS in 1986\u2014despite initial opposition from Norway, the Soviet Union and Finland\u2014while preserving events using only classic technique.", "The Winter Olympic Games are a major international sporting event that occurs once every four years.", "The first Winter Olympics, the 1924 Winter Olympics, was held in Chamonix, France and included Nordic skiing (which includes cross-country skiing) among the five principal disciplines.", "Cross-country events have evolved in the Winter Olympics since 1924, as seen in the following timeline:\n\n\nThe FIS Nordic World Ski Championships have been held in various numbers and types of events since 1925 for men and since 1954 for women.", "From 1924 to 1939, the World Championships were held annually, including years with Winter Olympic Games.", "After World War II, the World Championships were held every four years from 1950 to 1982.", "Since 1985, the World Championships have been held in odd-numbered years." ], [ "Cross-country skiing at the Winter Olympics", "Cross-country skiing at the Winter Olympics\n\nCross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France.", "The women's events were first contested at the 1952 Winter Olympics.", "\"Updated after 2018 Winter Olympics." ] ], "gold": "On 30 January 1924, men's cross country skiing was added to the Winter Olympics. Years later on 23 February 1952, the women's events were contested during the VI Olympic Winter Games. ", "prediction 1": "Cross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France. The women's events were first contested at the 1952 Winter Olympics. It has been formally adopted by the FIS in 1986, despite initial opposition from Norway, the Soviet Union and Finland\u2014while preserving events using only classic technique.", "prediction 2": "The first Winter Olympic Games, the 1924 Winter Olympics, was held in Chamonix, France and included Nordic skiing (which includes cross-country skiing) among the five principal disciplines. Cross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France. The women's events were first contested at the 1952 Winter Olympics. Despite initial opposition from Norway, the Soviet Union and Finland, cross-country skiing was formally adopted by the FIS in 1986.", "prediction 3": "Cross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France. The women's events were first contested at the 1952 Winter Olympics. Cross-country skiing was added to the Winter Olympic Games in 2018.", "prediction 4": "The first Winter Olympic Games, the 1924 Winter Olympics, were held in Chamonix, France and included Nordic skiing (which includes cross-country skiing among the five principal disciplines). Cross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France. The women's events were first contested at the 1952 Winter Olympics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 366 } ], "missing-info": [], "corrected-prediction": "Cross-country skiing has been contested at the Winter Olympic Games since the first Winter Games in 1924 in Chamonix, France. The women's events were first contested at the 1952 Winter Olympics. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings the song if you want my love you got it?", "passages": [ [ "If You Want My Love", "If You Want My Love\n\n\"If You Want My Love\" is a song by the American rock band Cheap Trick, released in 1982 as the first single from their sixth studio album \"One on One\".", "It was written by guitarist Rick Nielsen and produced by Roy Thomas Baker.", "It reached No. 45 on the \"Billboard\" Hot 100 Chart, and No. 2 in Australia.", "The song was the first single release from the band to feature new bassist Jon Brant.", "A music video was filmed to promote the single, which received regular airing on MTV.", "The single's B-side, \"Four Letter Word\", was featured as the closing track on \"One on One\", and was written by Rick Nielsen and Robin Zander.", "A live version of \"If You Want My Love\" was performed at the band's 25th anniversary concert in Rockford, Illinois during 1999.", "The performance saw Brant rejoining Cheap Trick on stage to play bass on the track, along with \"She's Tight\".", "The concert was later released in 2001 as \"Silver\".", "Speaking of the song in an interview featured on the \"Silver\" DVD, bassist Tom Petersson stated that it was \"the best Beatle song we ever recorded\".", "He, however, was referring to Cheap Trick as a band, as he had not been with the group at the time the track was originally recorded." ], [ "If You Want My Love (Twenty 4 Seven song)", "If You Want My Love (Twenty 4 Seven song)\n\n\"If You Want My Love\" is a song recorded by the Dutch band Twenty 4 Seven.", "It was the tenth single and the sixth song to be taken from the fourth album, \"Twenty 4 Hours A Day, Seven Days A Week\".", "The song remained a constant area of success only in the Netherlands, the single reached 77 on the (Single Top 100).", "It did not chart in the United Kingdom.", "\"If You Want My Love\" was postponed a couple of times, because \"We Are the World\" did successfully well in many other countries, like Spain where it went top 10." ] ], "gold": "\"If You Want My Love\" is a song by the American rock band Cheap Trick, released in 1982 as the first single from their sixth studio album \"One on One\". A song with the same name was recorded by the Dutch band Twenty 4 Seven in 1997. It was the tenth single and the sixth song to be taken from the fourth album, Twenty 4 Hours A Day, Seven Days A Week. ", "prediction 1": "If You Want My Love is a song by the American rock band Cheap Trick, released in 1982 as the first single from their sixth studio album One on One. A live version of If You Want My Love was performed at the band's 25th anniversary concert in Rockford, Illinois during 1999. If You Want My Love is a song recorded by the Dutch band Twenty 4 Seven. It was the tenth single and the sixth song to be taken from the fourth album, Twenty 4 Hours A Day, Seven Days A Week.\n", "prediction 2": "If You Want My Love is a song by the American rock band Cheap Trick, released in 1982 as the first single from their sixth studio album One on One. In 1999, a live version of the song was performed for a special 25th anniversary concert of the band, which was recorded at The Fillmore Chicago. In 2001, the song was recorded by the Dutch band Twenty 4 Seven.", "prediction 3": "If You Want My Love is a song by the American rock band Cheap Trick, which was released in 1982 as the first single from their sixth studio album One on One. Another song by Twenty 4 Seven is If You Want My Love, which was released in 1999 for their 25th anniversary concert in Rockford, Illinois. The band also released a single titled If You Get It By The End in 2005.", "prediction 4": "There are many songs titled \"If You Want My Love\". One of the songs, \"You Got It\" by American rock band Cheap Trick, was released in 1982. Another one, \"If You Want My Love\" by Dutch band Twenty 4 Seven, was released in 1999.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 273 } ], "missing-info": [], "corrected-prediction": "If You Want My Love is a song by the American rock band Cheap Trick, released in 1982 as the first single from their sixth studio album One on One. A song with the same name was recorded by the Dutch band Twenty 4 Seven. It was the tenth single and the sixth song to be taken from the fourth album, Twenty 4 Hours A Day, Seven Days A Week.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote there's no business like show business?", "passages": [ [ "There's No Business Like Show Business", "There's No Business Like Show Business\n\n\"There's No Business Like Show Business\" is an Irving Berlin song, written for the 1946 musical \"Annie Get Your Gun\" and orchestrated by Ted Royal.", "The song, a slightly tongue-in-cheek salute to the glamour and excitement of a life in show business, is sung in the musical by members of \"Buffalo Bill's Wild West\" Show in an attempt to persuade Annie Oakley to join the production.", "It is reprised three times in the musical.", "The song is also featured in the 1954 movie of the same name, where it is notably sung by Ethel Merman as the main musical number.", "The movie, directed by Walter Lang, is essentially a catalog of various Berlin's pieces, in the same way that \"Singin' in the Rain\"\u2014which starred Donald O'Connor as well\u2014was a collection of Arthur Freed songs.", "There was also a disco version of the song made during the 1970s, with Merman reprising her singing role in \"The Ethel Merman Disco Album\".", "The song became one of Ethel Merman's standards and was often performed by her at concerts and on television." ], [ "There's No Business Like Show Business (film)", "There's No Business Like Show Business (film)\n\nIrving Berlin's There's No Business Like Show Business is a 1954 20th Century-Fox DeLuxe Color musical-comedy-drama in CinemaScope, directed by Walter Lang.", "It stars an ensemble cast, consisting of Ethel Merman, Dan Dailey, Donald O'Connor, Mitzi Gaynor, Marilyn Monroe, Johnnie Ray, and Richard Eastham.", "The title is borrowed from the famous song in the stage musical (and MGM film) \"Annie Get Your Gun\".", "The screenplay was written by Phoebe Ephron and Henry Ephron, based on a story by Lamar Trotti; and the movie was Fox's first musical in CinemaScope and DeLuxe Color.", "Donald O'Connor later called the film the best picture he ever made.", "In 1919, Terence Donahue and his wife Molly are a husband-and-wife vaudeville team known as the Donahues, pursue both a stable family life as well as professional success.", "Their children, Steve, Katy, and Tim, join the act one by one, and their act eventually becomes the Five Donahues.", "The family is a success and soon hit the top." ] ], "gold": "\"There's No Business Like Show Business\" is an Irving Berlin song, written for the 1946 musical \"Annie Get Your Gun\" and orchestrated by Ted Royal. The title is borrowed from the famous song in the stage musical (and MGM film) \"Annie Get Your Gun\". The screenplay was written by Phoebe Ephron and Henry Ephron, based on a story by Lamar Trotti; and the movie was Fox's first musical in CinemaScope and DeLuxe Color.", "prediction 1": "There's No Business Like Show Business is a song by Irving Berlin, written for the 1946 musical Annie Get Your Gun and orchestrated by Ted Royal. The song, a slightly tongue-in-cheek salute to the glamour and excitement of a life in show business, is sung in the musical by members of Buffalo Bill's Wild West Show in an attempt to persuade Annie Oakley to join the production. The song is also featured in the 1954 movie of the same name, where it is notably sung by Ethel Merman as the main musical number. The film was directed by Walter Lang, and the screenplay was written by Phoebe Ephron and Henry Ephron, based on a story by Lamar Trotti.", "prediction 2": "\"There's No Business Like Show Business\" is an Irving Berlin song, written for the 1946 musical Annie Get Your Gun and orchestrated by Ted Royal. The song, a slightly tongue-in-cheek salute to the glamour and excitement of a life in show business, is sung in the musical by members of Buffalo Bill's Wild West Show in an attempt to persuade Annie Oakley to join the production. It is reprised three times in the musical. There is also a 1954 20th Century Fox DeLuxe Color musical-comedrama in CinemaScope, directed by Walter Lang, where it is notably sung by Ethel Merman as the main musical number.", "prediction 3": "\"There's No Business Like Show Business\" is an Irving Berlin song, written for the 1946 musical \"Annie Get Your Gun\" and orchestrated by Ted Royal. The song, a slightly tongue-in-cheek salute to the glamour and excitement of a life in show business, is sung in the musical by members of \"Buffalo Bill's Wild West\" Show in an attempt to persuade Annie Oakley to join the production. It is also featured in the 1954 movie of the same name, where it is notably sung by Ethel Merman as the main musical number. It became one of Ethel Merman's standards and was often performed by her at concerts and on television.", "prediction 4": "There's No Business Like Show Business is an Irving Berlin song, written for the 1946 musical \"Annie Get Your Gun\" and orchestrated by Ted Royal. The song, a slightly tongue-in-cheek salute to the glamour and excitement of a life in show business, is sung in the musical by members of Buffalo Bill's Wild West Show in an attempt to persuade Annie Oakley to join the production. The song is also featured in the 1954 movie of the same name, where it is notably sung by Ethel Merman as the main musical number.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 377 }, { "error type": "Irrelevant", "explanation": "", "start": 378, "end": 508 }, { "error type": "Irrelevant", "explanation": "", "start": 509, "end": 546 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "There's No Business Like Show Business is a song by Irving Berlin, written for the 1946 musical Annie Get Your Gun and orchestrated by Ted Royal. The title is borrowed from the famous song in the stage musical (and MGM film) \"Annie Get Your Gun\". The screenplay was written by Phoebe Ephron and Henry Ephron, based on a story by Lamar Trotti; and the movie was Fox's first musical in CinemaScope and DeLuxe Color. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Snow white and the huntsman movie heroine name?", "passages": [ [ "Snow White and the Huntsman", "At the time reboots of fairy tales were not a popular film genre and according to Daugherty \"no one really knew what to do with it\" More problems came when the release of Terry Gilliam's \"The Brothers Grimm\" (2005) flopped at the box office which caused potential buyers to be hesitant about the script.", "The script was finally greenlit after the success of Tim Burton's \"Alice in Wonderland\" (2010).", "Film producers considered casting a lesser-known actress for the role of Snow White, with mention of Riley Keough, Felicity Jones, Bella Heathcote, Alicia Vikander, and Rachel Maxwell as possible picks.", "This idea became less likely as known actresses Dakota Fanning and Kristen Stewart were later rumored to be short-listed for the role.", "On March 4, 2011 a series of tweets from co-producer Palak Patel confirmed that Stewart was offered the role.", "Winona Ryder was initially considered to play Queen Ravenna, before the role went to Charlize Theron.", "Tom Hardy was supposedly first offered the role of Eric, the Huntsman, but turned down the offer.", "The role was then apparently offered to Michael Fassbender, and then Johnny Depp, but both claim to have declined it." ], [ "The Huntsman: Winter's War", "The Huntsman: Winter's War\n\nThe Huntsman: Winter's War is a 2016 American fantasy adventure film, both a prequel and sequel to \"Snow White and the Huntsman\" (2012), it takes place before and after the events of the first film.", "The film is the directorial debut of Cedric Nicolas-Troyan, who was a visual effects supervisor and second unit director on the first film.", "It is written by Craig Mazin and Evan Spiliotopoulos, based on characters created by Evan Daugherty, which like the first film were inspired by the fairy tale \"Snow White\" compiled by the Brothers Grimm, as well as \"The Snow Queen\" by Hans Christian Andersen.", "Reprising their roles from the first film, the cast includes Chris Hemsworth, Charlize Theron, Nick Frost, and Sam Claflin.", "The film also introduced new characters played by Emily Blunt, Jessica Chastain, and Rob Brydon.", "The film premiered in Hamburg on March 29, 2016, and was released in the United States on April 22, 2016.", "It received mixed to negative reviews from critics and audiences alike, with praise for the visuals and cast but many feeling the film was an unnecessary sequel.", "It grossed $165 million worldwide against an estimated $115 million production cost." ], [ "Snow White and the Huntsman", "A prequel/sequel, titled \"\", directed by the first film's visual effects supervisor Cedric Nicolas-Troyan, was released on April 22, 2016.", "Hemsworth, Theron, Claflin and Nick Frost reprised their roles and new characters were played by Emily Blunt and Jessica Chastain.", "Stewart did not reprise her role, but appeared in archive footage.", "While admiring a rose blooming in the winter, Queen Eleanor of the kingdom of Tabor pricks her finger on one of its thorns.", "Three drops of blood fall onto the snow-covered ground, and she wishes for a daughter as white as the snow, with lips as red as the blood, hair as black as a raven's wings and a heart as strong and defiant as the rose.", "Queen Eleanor gives birth to her daughter, Snow White, but falls ill and dies several years later.", "After her death, Snow White's father, King Magnus, and his army battle an invading dark army of demonic glass soldiers.", "Upon rescuing their prisoner Ravenna, the King becomes enchanted with her beauty and marries her.", "Ravenna is in fact a powerful sorceress and the Dark Army's master.", "On their wedding night, Ravenna confesses there was a king much like Magnus that hurt her.", "She declares she cannot be a weak queen and kills Magnus before unleashing her invading army upon the kingdom." ] ], "gold": "In Snow White and the Huntsman, Snow White is the movie's heroine. Kristen Stewart stars as Snow White in the film Snow White and the Huntsman. Raffey Cassidy plays young Snow White in this film. Additionally, a sequel to Snow White and the Huntsman was planned, with director Rupert Sanders in talks to return. In August 2012, The Hollywood Reporter reported that the sequel was shelved in the aftermath of the scandal involving Sanders cheating on his wife with Stewart. Therefore, a spin-off film concentrating on the Huntsman was planned instead, which would not star Stewart. The prequel/sequel, The Huntsman: Winter's War, was released on April 22, 2016. Stewart did not reprise her role as Snow White in this film, but she appeared in archive footage.", "prediction 1": "The Snow Queen is the name of the heroine in the first two Snow White and the Huntsman movies. In the first two films, the heroine was named Ravenna. In the third and fourth, the heroine was named Ariel. In the fourth, the heroine was named Ariel.", "prediction 2": "There have been several Snow White movie heroine names. In the original film, the character of Snow White was played by Winona Ryder. In the sequel, the character of Snow White was played by Kristen Stewart.", "prediction 3": "The Snow Queen is a fictional woman in the Snow White and the Huntsman movie. In the 2012 version the character's name was Ravenna, and in the 2016 version it was Dakota Fanning.", "prediction 4": "The Snow Queen is the heroine of the 2012 film Snow White and the Huntsman, which is a reboot of the fairy tale. In the 2012 film, Eleanor is played by Winona Ryder and in 2016, Dakota Fanning plays Snow White. In the 2016 film, The Huntsman: Winter's War, the heroine is played by Emily Blunt.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 150, "end": 203 }, { "error type": "Redundant", "explanation": "The Snow Queen is the name of the heroine in the first two Snow White and the Huntsman movies. In the first two films, the heroine was named Ravenna. In the third and fourth, the heroine was named Ariel. ", "start": 204, "end": 247 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 94 }, { "error type": "Redundant", "explanation": "The Snow Queen is the name of the heroine in the first two Snow White and the Huntsman movies. ", "start": 95, "end": 149 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4, 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "In Snow White and the Huntsman Kristen Stewart stars as Snow White. The Huntsman: Winter's War was released in the United States on April 22, 2016. Stewart did not reprise her role, but appeared in archive footage." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When does law and order svu new season start?", "passages": [ [ "Law & Order: Special Victims Unit", "Law & Order: Special Victims Unit\n\nLaw & Order: Special Victims Unit (often abbreviated to Law & Order: SVU or just SVU) is an American police procedural, legal, crime drama television series set in New York City, where it is also primarily produced.", "In the style of the original \"Law & Order\", episodes are often \"ripped from the headlines\" or loosely based on real crimes that have received media attention.", "Created by Dick Wolf, the series premiered on NBC on September 20, 1999, as the second series in Wolf's successful \"Law & Order\" franchise.", "\"Law & Order: Special Victims Unit\" has been nominated for and won numerous awards, including the 2006 Emmy for Outstanding Lead Actress in a Drama Series for Mariska Hargitay, the first, and to date only, Emmy to be received by a regular on any \"Law & Order\" series.", "It is the current longest running scripted non-animated U.S. primetime TV series since the cancellation of the original \"Law & Order\" on May 24, 2010 and is the fourth-longest running scripted U.S. primetime TV series on a major broadcast network.", "\"Law & Order: Special Victims Unit\" originally centered almost exclusively on the detectives of the Special Victims Unit in a fictional version of the 16th Precinct of the New York City Police Department." ], [ "Law & Order: Special Victims Unit (season 18)", "Law & Order: Special Victims Unit (season 18)\n\n", "The eighteenth season of \"\" debuted on Wednesday, September 21, 2016, on NBC and finished on Wednesday, May 24, 2017, with a two-hour season finale.", "Rick Eid, who previously worked on \"Law & Order\" and \"\", became the executive producer and showrunner, following Warren Leight's departure from the series at the conclusion of the seventeenth season.", "Eid himself departed the series at the end of the eighteenth season and was replaced by Michael S. Chernuchin.", "\"Law & Order: Special Victims Unit\" was renewed for an eighteenth season on February 1, 2016, by NBC.", "It was announced in March 2015 that season seventeen would be show runner/executive producer Warren Leight's last season on the show; he signed a three-year deal with Sony Pictures Television, his contract allowing him to work on \"SVU\" for one final season.", "On March 10, 2016, it was announced that Rick Eid would replace Leight as showrunner on this season.", "The 400th episode of the series aired this season.", "\"Motherly Love,\" directed by Mariska Hargitay, was filmed and billed as the 400th show." ], [ "Law & Order: Special Victims Unit (season 17)", "Law & Order: Special Victims Unit (season 17)\n\n", "The seventeenth season of \"\" debuted on Wednesday, September 23, 2015 on NBC, and concluded on Wednesday, May 25, 2016.", "\"Law & Order: Special Victims Unit\" was renewed for a seventeenth season on February 5, 2015, by NBC.", "Mariska Hargitay (Olivia Benson) had her contract renewed for season 17, as well as Ice-T (Det.", "Fin Tutuola).", "It was announced in March 2015 that season seventeen would be show runner/executive producer Warren Leight's last season on the show; he signed a three-year deal with Sony Pictures Television, his contract allowing him to work on \"SVU\" for one final season.", "Production on season seventeen started in late May 2015 on the two-hour season premiere, afterwards the cast and crew took a hiatus and resumed filming on August 21, 2015.", "Executive producer Leight shared via Twitter that star Mariska Hargitay would be directing an episode this season as well, tweeting \"Of course Mariska will direct again this year.", "After 17 seasons, she's in a class of her own.\"", "The episode in question turned out to be \"A Misunderstanding\", which aired on January 20, 2016." ] ], "gold": "Law & Order: Special Victims Unit (often abbreviated to Law & Order: SVU or just SVU) is an American crime drama television series. Law & Order: Special Victims Unit follows the style of the original Law & Order in that some episodes are loosely based on real crimes that have received media attention. The series is the longest-running primetime U.S. live-action series in the history of television. Season 17 started airing on September 23, 2015, season 18 started airing on September 21, 2016, and season 19 started airing on September 27, 2017.", "prediction 1": "Law & Order: Special Victims Unit is an American police procedural, legal, crime drama television series set in New York City, where it is also primarily produced. Season 18 of the series started airing on Wednesday, September 21, 2016 and the 18th season of the series started airing on Wednesday, May 24, 2017. Season 17 and 18 started airing on Wednesday, May 25, 2016 and the 18th season started airing on Wednesday, September 25, 2017.", "prediction 2": "Law & Order: Special Victims Unit is an American police procedural, legal, crime drama television series. Season 1 of the show started on September 20, 1999, and season 2 started on September 23, 2015. Season 3 started on September 4, 2019.", "prediction 3": "Law & Order: Special Victims Unit is an American television police procedural, legal, crime drama television series set in New York City, where it is also primarily produced. Season 1 of season 2 started on September 30, 2014, while season 3 started on September 21, 2016. Season 6 started on September 26, 2017, season 7 started on October 9, 2017, and season 8 started on October 11, 2017.", "prediction 4": "Law & Order: Special Victims Unit is an American police procedural, legal, crime drama television series set in New York City, where it is also primarily produced. Law & Order: Special Victims Unit was renewed for an eighteenth season on February 1, 2016, by NBC. Production on season 17 started in late May 2015 on the two-hour season premiere, afterwards the cast and crew took a hiatus and resumed filming on August 21, 2015. Season 18 started on Wednesday, September 21, 2016 on NBC. Season 19 started on Wednesday, September 7, 2017, on September 19, 2019, on September 19, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 216 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 240, "end": 312 }, { "error type": "Redundant", "explanation": "18", "start": 327, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 348, "end": 358 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 359, "end": 371 }, { "error type": "Redundant", "explanation": "the 18th season of the series started airing on Wednesday, May 24, 2017. ", "start": 376, "end": 440 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Law & Order: Special Victims Unit (often abbreviated to Law & Order: SVU or just SVU) is an American crime drama television series. Law & Order: Special Victims Unit follows the style of the original Law & Order in that some episodes are loosely based on real crimes that have received media attention. The series is the current longest running scripted non-animated U.S. primetime TV series since the cancellation of the original \"Law & Order\" on May 24, 2010. Season 17 started airing on September 23, 2015 and season 18 started airing on September 21, 2016." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What percentage of us population voted in 2016 presidential election?", "passages": [ [ "2016 United States elections", "2016 United States elections\n\nThe 2016 United States elections were held on Tuesday, November 8, 2016.", "During this presidential election year, the President of the United States and Vice President were elected.", "In addition, elections were held for all 435 voting-member seats in the United States House of Representatives (as well as all six non-voting delegate seats) and 34 of the 100 seats in the United States Senate to determine the 115th Congress.", "The Republican Party won the presidency, and retained its majorities in the House and Senate although the Democrats made modest gains in both houses.", "Twelve state governorships, two territorial governorships, and numerous other state and local elections were also contested.", "The United States presidential election of 2016 was the 58th quadrennial presidential election.", "The electoral vote distribution was determined by the 2010 census from which presidential electors electing the President and Vice President were chosen; a simple majority (270) of the 538 electoral votes were required to win.", "Former President Barack Obama, a member of the Democratic Party, was ineligible to be elected to a third term due to term limits established by the Twenty-second Amendment to the United States Constitution." ], [ "2016 United States presidential election", "65.9 million of those ballots were counted for Clinton and just under 63 million for Trump, representing 20.3% (Clinton) and 19.4% (Trump) of a census estimate of U.S. population that day of 324 million.", "Considering a VAP of 250.6 million people and voting eligible population (VEP) of 230.6 million people, this is a turnout rate of 55.4% VAP and 60.2% VEP.", "Based on this estimate, voter turnout was up compared to 2012 (54.1% VAP) but down compared to 2008 (57.4% VAP).", "A FEC report of the election recorded an official total of 136.7 million votes cast for President \u2014 more than any prior election.", "Data scientist Azhar Hamdan noted the paradoxes of the 2016 outcome, saying that \"chief among them [was] the discrepancy between the popular vote, which Hillary Clinton won by 2.8 million votes, and the electoral college, where Trump won 304-227\".", "He said Trump outperformed Mitt Romney's 2012 results, while Clinton only just matched Barack Obama's 2012 totals." ] ], "gold": "The 2016 United States presidential election was the 58th quadrennial presidential election, held on Tuesday, November 8, 2016. Examining overall turnout in the 2016 election, University of Florida Prof. Michael McDonald estimated that 138.8 million Americans cast a ballot. Considering a VAP of 250.6 million people and a voting eligible population of 230.6 million people, this is a turnout rate of 55.4% VAP and 60.2% VEP. Hillary Clinton won 51.1% of the two party vote and 20.3% of the US population and Donald Trump won 48.9% of the two party vote and 19.4% of the US population.", "prediction 1": "This percentage of us population voted in 2016 presidential election. Voter turnout was 55.4% VAP and 60.2% VEP.", "prediction 2": "The 2016 US presidential election was held on November 8, 2016. During this presidential election year, the President of the United States and Vice President were elected.", "prediction 3": "The 2016 United States presidential election was held on November 8, 2016; the president of the United States and vice president of the United States were elected. The voter turnout rate was 55.4% VAP and 60.2% VEP, respectively.", "prediction 4": "The 2016 United States elections were held on Tuesday, November 8, 2016. During this presidential election year, the President of the United States and Vice President were elected. During the 2016 election, a total of 136.7 million votes were cast for President.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 69 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2016 United States presidential election was the 58th quadrennial presidential election, and was held on Tuesday, November 8, 2016. Overall, an official total of 136.7 million votes were cast for President. Considering a VAP of 250.6 million people and voting eligible population (VEP) of 230.6 million people, this amounted to a turnout rate of 55.4% VAP and 60.2% VEP. Further, Hillary Clinton won 20.3% of the US population's vote while Donald Trump won 19.4%." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "During prophase 1 homologous chromosomes exchange segments of dna in a process called?", "passages": [ [ "Chromosomal crossover", "Chromosomal crossover\n\nChromosomal crossover (or crossing over) is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids that results in recombinant chromosomes during sexual reproduction.", "It is one of the final phases of genetic recombination, which occurs in the \"pachytene\" stage of prophase I of meiosis during a process called synapsis.", "Synapsis begins before the synaptonemal complex develops and is not completed until near the end of prophase\u00a0I. Crossover usually occurs when matching regions on matching chromosomes break and then reconnect to the other chromosome.", "Crossing over was described, in theory, by Thomas Hunt Morgan.", "He relied on the discovery of Frans Alfons Janssens who described the phenomenon in 1909 and had called it \"chiasmatypie\".", "The term \"chiasma\" is linked, if not identical, to chromosomal crossover.", "Morgan immediately saw the great importance of Janssens' cytological interpretation of chiasmata to the experimental results of his research on the heredity of \"Drosophila\".", "The physical basis of crossing over was first demonstrated by Harriet Creighton and Barbara McClintock in 1931.", "The linked frequency of crossing over between two gene loci (markers) is the \"crossing-over value\" ." ] ], "gold": "During prophase 1, homologous chromosomes exchange segments of DNA in a specific process called chromosomal crossover, or crossing over. It is one of the final phases of genetic recombination, which occurs in the pachytene stage of prophase 1 of meiosis during a process called synapsis.", "prediction 1": "Chromosomal crossover (or crossing over) is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids that results in recombinant chromosomes during sexual reproduction. During prophase 1 homologous chromosomes exchange segments of dna in a process called synapsis.", "prediction 2": "Chromosomal crossover is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids that results in recombinant chromosomes during sexual reproduction. It is one of the final phases of genetic recombination, which occurs in the \"pachytene\" stage of prophase I of meiosis during a process called synapsis.", "prediction 3": "Chromosomal crossover is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids that results in recombinant chromosomes during sexual reproduction. In prophase 1 homologous chromosomes exchange segments of dna in a process called synapsis. Synapsis occurs in the \"pachytene\" stage of prophase I of meiosis during a process called synapsis.", "prediction 4": "Chromosomal crossover is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids that results in recombinant chromosomes during sexual reproduction. Crossover usually occurs when matching regions on matching chromosomes break and then reconnect to the other chromosome.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 199 }, { "error type": "Unverifiable", "explanation": "", "start": 200, "end": 295 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Chromosomal crossover (or crossing over) is the exchange of genetic material between 2 homologous chromosomes non-sister chromatids. It is one of the final phases of genetic recombination, which occurs in the \"pachytene\" stage of prophase I of meiosis during a process called synapsis." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who is the serial killer in bates motel?", "passages": [ [ "Psycho (franchise)", "Today, the novels are out of print and are very rare to find.", "List indicator(s)\n\n\"Psycho\" is based on the 1959 novel of the same name by Robert Bloch which in turn is based loosely on the case of convicted Wisconsin murderer Ed Gein.", "Both Gein and \"Psycho\"s protagonist, Norman Bates, were solitary murderers in isolated rural locations.", "Both had deceased, domineering mothers, and had sealed off one room of their house as a shrine to their mother, and both dressed in women's clothing.", "However, there are many differences between Bates and Ed Gein.", "Among others, Gein would not be strictly considered a serial killer, having officially killed \"only\" two people.", "Peggy Robertson, Hitchcock's production assistant, read Anthony Boucher's positive review of the Bloch novel and decided to show the book to Hitchcock, even though readers at Hitchcock's home studio Paramount Pictures rejected its premise for a film.", "Hitchcock acquired rights to the novel for $9,500.", "He reportedly ordered Robertson to buy up copies to keep the novel's surprises for the film.", "Hitchcock chose to film \"Psycho\" to recover from two aborted projects with Paramount: \"Flamingo Feather\" and \"No Bail for the Judge\".", "Hitchcock also faced genre competitors whose works were critically compared to his own and so wanted to film new material." ], [ "Anthony Perkins", "Anthony Perkins\n\nAnthony Perkins (April 4, 1932\u00a0\u2013 September 12, 1992) was an American actor and singer.", "He was nominated for the Academy Award for Best Supporting Actor for his second film, \"Friendly Persuasion\", but is best known for playing Norman Bates in Alfred Hitchcock's \"Psycho\" (1960) and its three sequels.", "His other films include \"Fear Strikes Out\" (1957), \"The Matchmaker\" (1958), \"On the Beach\" (1959), \"Tall Story\" (1960), \"The Trial\" (1962), \"Phaedra\" (1962), \"Five Miles to Midnight\" (1962), \"Pretty Poison\" (1968), \"Murder on the Orient Express\" (1974), \"Mahogany\" (1975), \"North Sea Hijack\" (1979), \"The Black Hole\" (1979), and \"Crimes of Passion\" (1984).", "Perkins was born in New York City, son of stage and film actor Osgood Perkins and his wife, Janet Esselstyn (n\u00e9e Rane).", "His paternal great-grandfather was wood engraver Andrew Varick Stout Anthony.", "He was five when his father died.", "Perkins was a descendant of a \"Mayflower\" passenger, John Howland.", "He attended Brooks School, Browne & Nichols School, Columbia University and Rollins College, having moved to Boston in 1942." ], [ "Psycho (1960 film)", "Psycho (1960 film)\n\nPsycho is a 1960 American psychological horror film directed and produced by Alfred Hitchcock, and written by Joseph Stefano.", "It stars Anthony Perkins, Janet Leigh, John Gavin, Vera Miles, and Martin Balsam, and was based on the 1959 novel of the same name by Robert Bloch.", "The film centers on an encounter between a secretary, Marion Crane (Leigh), who ends up at a secluded motel after stealing money from her employer, and the motel's owner-manager, Norman Bates (Perkins), and its aftermath.", "\"Psycho\" was seen as a departure from Hitchcock's previous film \"North by Northwest\", having been filmed on a low budget, in black-and-white, and by a television crew.", "The film initially received mixed reviews, but outstanding box-office returns prompted reconsideration which led to overwhelming critical acclaim and four Academy Award nominations, including Best Supporting Actress for Leigh and Best Director for Hitchcock.", "\"Psycho\" is now considered one of Hitchcock's best films and praised as a major work of cinematic art by international film critics and scholars.", "Often ranked among the greatest films of all time, it set a new level of acceptability for violence, deviant behavior and sexuality in American films, and is widely considered to be the earliest example of the slasher film genre." ] ], "gold": "Psycho is a 1960 American psychological horror thriller film produced and directed by Alfred Hitchcock. Psycho is based on Robert Bloch's 1959 novel of the same name, which was loosely inspired by the case of convicted Wisconsin murderer and grave robber Ed Gein. Both Gein (who lived just from Bloch) and the story's protagonist, Norman Bates (played by Anthony Perkins in the film), were solitary murderers in isolated rural locations. Each had deceased, domineering mothers, had sealed off a room in their home as a shrine to her, and dressed in women's clothes.", "prediction 1": "Psycho is a 1960 American psychological horror film directed and produced by Alfred Hitchcock, and was based on the 1959 novel of the same name by Robert Bloch. In the movie, Norman Bates is the serial killer. In the book, Norman Bates is the serial killer. In the film, Norman Bates is the serial killer.", "prediction 2": "Norman Bates is the serial killer in Psycho, a 1960 American psychological horror film directed and produced by Alfred Hitchcock, and was based on the 1959 novel of the same name by Robert Bloch. In the 1959 film, Norman Bates is played by American actor Anthony Perkins, who is also known for his role in Psycho's three sequels. In the 1960 film, Norman Bates is played by American actor John Gavin, who is known for playing the serial killer in the 1959 film.", "prediction 3": "Psycho is a 1960 American psychological horror film directed and produced by Alfred Hitchcock, and was based on the 1959 novel of the same name by Robert Bloch. Norman Bates, played by Anthony Perkins, is the motel owner-manager and serial killer in the film. There are many similarities between Norman Bates and Ed Gein. Gein was convicted of two counts of murder, but his crimes were not considered serial killings.", "prediction 4": "Psycho is a 1960 American psychological horror film directed and produced by Alfred Hitchcock, and was based on the 1959 novel of the same name by Robert Bloch. Both Norman Bates and Ed Gein were solitary murderers in isolated rural locales. However, there are many differences between Bates and Ed Gein. Gein would not be strictly considered a serial killer, having officially killed \"only\" two people.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 257 }, { "error type": "Redundant", "explanation": "In the movie, Norman Bates is the serial killer.", "start": 258, "end": 305 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Psycho is a 1960 American psychological horror film directed and produced by Alfred Hitchcock. It was based on the 1959 novel of the same name by Robert Bloch, which was loosely inspired by the case of convicted Wisconsin murderer Ed Gein. In the movie, Norman Bates (played by Anthony Perkins) is the serial killer. Interestingly, both Gein and Bates were solitary murderers in isolated rural locations. Each also had deceased, domineering mothers, a sealed off a room in their home as a shrine to her, and dressed in women's clothes." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "Who sang never promised you a rose garden?", "passages": [ [ "I Beg Your Pardon", "I Beg Your Pardon\n\n\"I Beg Your Pardon\" (also titled as \"I Beg Your Pardon", "[I Never Promised You a Rose Garden]\") is a song by Canadian synthpop band Kon Kan, released as the first single from their 1988 debut album \"Move to Move\".", "The song contains various samples of other songs, including Lynn Anderson's 1970 hit \"Rose Garden\", GQ's \"Disco Nights (Rock-Freak)\", Silver Convention's \"Get Up and Boogie\", and National Lampoon's \"Disco Hotline\" sketch from their \"That's Not Funny, That's Sick\" album.", "Recreated samples of Spagna's \"Call Me\" and the opening bars of the theme from the film \"The Magnificent Seven\" are also present in the song.", "The song was a hit, reaching the top twenty in a number of countries including the UK, where it peaked at #5." ], [ "Rose Garden (Lynn Anderson song)", "Rose Garden (Lynn Anderson song)\n\n\"Rose Garden\" (also known and covered as \"(I Never Promised You A) Rose Garden\") is a song written by Joe South, best known as recorded by country music singer Lynn Anderson, and first released by Billy Joe Royal in 1967.", "Anderson's October 1970 release topped the U.S. \"Billboard\" country chart for five weeks, reached No. 3 on the U.S. \"Billboard\" Hot 100 pop chart, and hit No. 1 on both \"Cash Box\"s and \"Record World\"s pop and country singles charts.", "The song was also a major pop hit internationally, topping the charts in Australia, Canada, New Zealand, Ireland, Norway, South Africa, and throughout Europe.", "Anderson's version of \"Rose Garden\" remains among the most successful crossover recordings of all-time.", "The Lynn Anderson single was her third release for Columbia Records in 1970, after several years of recording for Chart Records.", "It proved to be the first crossover record of her career.", "\"Rose Garden\" was originally an album cut by the song's writer, Joe South, in 1969.", "Several other male vocalists recorded it on albums including Freddy Weller, Billy Joe Royal, and Dobie Gray and Third Avenue Blues Band, but it was never a hit until Anderson's version." ] ], "gold": "\"(I Never Promised You A) Rose Garden\" is a song written in 1967 by American singer-songwriter Joe South and was first recorded by Billy Joe Royal, with versions by South himself and Dobie Gray appearing shortly after. In 1970, Lynn Anderson recorded \"Rose Garden\" after hearing Joe South's version, but Anderson's producer rejected the song's recording because he did not consider it to be a female tune. After much convincing, the song was eventually recorded and released as a single by Columbia Records and became a crossover hit after it reached both the American Billboard country and pop charts. \"I Beg Your Pardon (I Never Promised You a Rose Garden)\" is also the debut single by Canadian synthpop duo Kon Kan, from their 1988 debut album Move to Move, which was written by Kon Kan member Barry Harris, and Joe South, who is credited due to the song's heavy sampling of \"Rose Garden\".", "prediction 1": "\"Rose Garden\" is also known and covered as \"(I Never Promised You A) Rose Garden\" it was originally an album cut by the song's writer, Joe South, in 1969. Country music singer Lynn Anderson covered the track in 1970, and Anderson's version remains among the most successful crossover recordings of all-time. Kon Kan covered the track in 1988 as the first single from their 1988 debut album Move to Move.", "prediction 2": "\"(I Never Promised You A) Rose Garden\" is a song written by Joe South, best known as recorded by country music singer Lynn Anderson, and first released by Billy Joe Royal in 1967. The song was originally an album cut by the song's writer, Joe South, in 1969. Several other male vocalists recorded it on albums including Freddy Weller, Billy Joe Royal, and Dobie Gray and Third Avenue Blues Band, but it was never a hit until Anderson's version in 1970.", "prediction 3": "\"Rose Garden\" is a song written by Joe South, best known as recorded by country music singer Lynn Anderson. The song was originally an album cut by the song's writer, Joe South, in 1969. Several other male vocalists recorded it on albums including Freddy Weller, Billy Joe Royal, and Dobie Gray and Third Avenue Blues Band, but it was never a hit until Anderson's version.", "prediction 4": "\"Rose Garden\" is a song written by Joe South and best known as recorded by country music singer Lynn Anderson. Anderson's version was released on October 20, 1970 and topped the U.S. Billboard country chart for five weeks. The song was also a major pop hit internationally, topping the charts in Australia, Canada, New Zealand, Ireland, Norway, South Africa, and throughout Europe. Several other male vocalists recorded the song including Freddy Weller, Billy Joe Royal, and Dobie Gray and Third Avenue Blues Band, but it was never a hit until Anderson's version.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 307 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 316, "end": 341 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Rose Garden\" is also known and covered as \"(I Never Promised You A) Rose Garden\", it was originally an album cut by the song's writer, Joe South, in 1969. It was first released by Billy Joe Royal in 1967. Country music singer Lynn Anderson covered the track in 1970. The song was a hit in the America Billboard and other pop charts. It is also the title of a song by Canadian synthpop band Kon Kan, released as the first single from their 1988 debut album Move to Move. It sampled from \"Rose Garden\" as well. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has scored the most goals in the fifa world cup?", "passages": [ [ "FIFA World Cup top goalscorers", "FIFA World Cup top goalscorers\n\nMore than 2,000 goals have been scored at the 21 editions of the FIFA World Cup final tournaments, not counting penalties scored during shoot-outs.", "Since the first goal scored by French player Lucien Laurent at the 1930 FIFA World Cup, more than 1,250 footballers have scored goals at the World Cup, of which just 97 have scored at least five.", "The top goalscorer of the inaugural competition was Argentina's Guillermo St\u00e1bile with eight goals.", "Since then, only 22 players have scored more at all the games played at the World Cup than St\u00e1bile did throughout the 1930 tournament.", "The first was Hungary's S\u00e1ndor Kocsis with eleven in 1954.", "At the next tournament, France's Just Fontaine improved on this record with 13 goals in only six games.", "Gerd M\u00fcller scored 10 for West Germany in 1970 and broke the overall record when he scored his 14th goal at the World Cup during West Germany's win at the 1974 final.", "His record stood for more than three decades until Ronaldo's 15 goals between 1998 and 2006 for Brazil.", "Germany's Miroslav Klose went on to score a record 16 goals across four consecutive tournaments between 2002 and 2014." ], [ "FIFA World Cup top goalscorers", "Only two other players have surpassed 10 goals at the World Cup: Pel\u00e9 with 12 between 1958 and 1970 for Brazil, and J\u00fcrgen Klinsmann with 11 between 1990 and 1998 for Germany.", "Of all the players who have played at the World Cup, only six have scored, on average, at least two goals per game played:", "Kocsis, Fontaine, St\u00e1bile, Russia's Oleg Salenko, Switzerland's Josef H\u00fcgi, and Poland's Ernst Wilimowski \u2014 the latter scored four in his single World Cup game in 1938.", "The top 97 goalscorers have represented 28 nations, with 14 players scoring for Brazil, and another 14 for Germany or West Germany.", "In total, 64 footballers came from UEFA (Europe), 29 from CONMEBOL (South America), and only four from elsewhere: Cameroon, Ghana, Australia, and the United States.", "Fontaine holds the record for the most goals scored at a single tournament, with 13 goals in 1958.", "The players that came closest to this record were Kocsis in 1954, M\u00fcller in 1970 and Portugal's Eus\u00e9bio in 1966, with 11, 10 and 9, respectively.", "The lowest scoring tournament's top scorer was in 1962, when six players tied at only four goals each." ] ], "gold": "A player can score the most goals in the FIFA World Cup in different ways. When counting the number of career goals made in the FIFA World Cup, Josef Klose has scored the most. Oleg Anatolyevich Salenko has scored the most goals in a single FIFA World Cup match, and France's Just Louis Fontaine has scored the most goals in a single FIFA World Cup.", "prediction 1": "The player who has scored the most goals at the World Cup is Just Fontaine. The goal scorer who has scored the most goals at the World Cup is Argentina's Guillermo St\u00e1bile. The goal scorer who has scored the most goals at the World Cup is Hungary's S\u00e1ndor Kocsis. However, the goal scorer who has scored the most goals at the World Cup is Gerd M\u00fcller.", "prediction 2": "The players with the most goals at the FIFA World Cup are Brazil, France, Germany, and West Germany. The goal-scorer with the most goals in the World Cup is France's Just Fontaine, who scored 13 goals in 1958. The player with the most goals at the FIFA World Cup is Portugal's Eus\u00e9bio, who scored 10, 11, and 9 goals, respectively.", "prediction 3": "The player who has scored the most goals at the FIFA World Cup is Just Fontaine, who holds the record for the most goals scored at a single tournament, with 13 goals in 1958. The goal scorer who has scored the most goals at the FIFA World Cup is a Hungarian named S\u00e1ndor Kocsis, who scored 11 goals in the tournament. The goal scorer who has scored the most goals in a single tournament is Portugal's Eus\u00e9bio, who scored 11, 10 and 9, respectively.", "prediction 4": "The player to score the most goals in a single World Cup tournament is Just Fontaine, who scored 13 goals in 1958. The player to score the most goals at a single World Cup tournament is Hungary's S\u00e1ndor Kocsis, who scored eleven goals in 1954. Germany's Gerd M\u00fcller scored 10 goals for West Germany in 1970 and broke the overall record when he scored his 14th goal at the World Cup during West Germany's win at the 1974 final. The goal scorer to score the most in a single World Cup tournament is Fontaine, who scored the record for the most goals scored at a single tournament, with 13 goals in 1958.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The player who has scored the most goals at the World Cup is", "start": 76, "end": 141 }, { "error type": "Redundant", "explanation": "The player who has scored the most goals at the World Cup is ", "start": 173, "end": 238 }, { "error type": "Redundant", "explanation": "The player who has scored the most goals at the World Cup is", "start": 264, "end": 338 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 142, "end": 172 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 239, "end": 263 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 339, "end": 351 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The player who has scored the most goals within a single World Cup is Just Fontaine. Overall, Miroslav Klose has scored the most across tournaments. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is the darts being held in las vegas?", "passages": [ [ "2017 US Darts Masters", "2017 US Darts Masters\n\nThe 2017 partypoker US Darts Masters was the inaugural staging of the tournament by the Professional Darts Corporation, as a third entry in the 2017 World Series of Darts.", "The tournament featured eight North American players who faced eight PDC players, which was held at the Tropicana Las Vegas in Las Vegas, United States from 14\u201315 July 2017.", "Michael van Gerwen became the champion, defeating Daryl Gurney 8\u20136 in the final to win his first title in Vegas.", "This is how the prize money is divided:\n\nAdrian Lewis and Phil Taylor were both originally scheduled to take part but both withdrew.", "Lewis was replaced by Gerwyn Price, whilst Taylor was replaced by World Number six James Wade.", "The eight invited PDC players, seeded according to the World Series Order of Merit , were:\n\nThe North American qualifier winners were:\n\nThe top 4 North American Order of Merit qualifiers were:" ], [ "2018 US Darts Masters", "2018 US Darts Masters\n\nThe 2018 William Hill US Darts Masters was the second staging of the tournament by the Professional Darts Corporation.", "It was the second event in the 2018 World Series of Darts.", "The tournament featured 16 players (8 PDC representatives and 8 North American representatives) and was held at the Mandalay Bay in Las Vegas on 6\u20137 July 2018.", "Michael van Gerwen was the defending champion after defeating Daryl Gurney 8\u20136 in the 2017 final.", "However, he lost 8\u20133 in the quarter-finals to James Wade.", "Gary Anderson won his sixth World Series title after beating Rob Cross 8\u20134 in the final.", "The total prize fund was \u00a360,000.", "The eight PDC representatives are:\n\n\n", "The North American qualifier winners were:\n\nThe top 4 North American Order of Merit qualifiers were:" ], [ "World Series of Darts Finals", "World Series of Darts Finals\n\nThe World Series of Darts Finals is a darts tournament held by the Professional Darts Corporation.", "The tournament is held annually in November.", "The first 3 events were held in the Braehead Arena in Glasgow, Scotland, but the venue was switched to the Multiversum Schwechat, Vienna, Austria for 2018, and will move again to the AFAS Live, Amsterdam, Netherlands in 2019.", "The playing field includes the top eight of the World Series of Darts ranking, 16 players, a mix of invited players by the PDC and qualifiers.", "The World Series of Darts began in 2013.", "The goal of these series of tournaments is to make darts more popular across the globe.", "Two World Series tournaments were held in the first year: the Dubai Duty Free Darts Masters and the Sydney Darts Masters.", "In 2014, events in Singapore and Perth were added to the series, followed by Japan (Yokohama, then Tokyo in 2016) and Auckland in 2015, Shanghai in 2016, and the USA (Las Vegas)", "Melbourne and Germany (D\u00fcsseldorf) in 2017.", "Brisbane was added to the roster in 2018.", "The best 8 players from the World Series Darts tournaments qualified for the finals tournament, which was inaugurated in 2015.", "This ranking is formed by the points that the player earns in the World Series tournament.", "The distribution of the points in each World Series tournament is:" ], [ "Las Vegas Open (darts)", "Las Vegas Open (darts)\n\nThe Las Vegas Open is a darts tournament organised by the American Darts Organization that started in 1980." ] ], "gold": "The Las Vegas Open tournament for darts is being held at the Tuscany Suites and Casino in Las Vegas. Previously, the 2017 US Darts Masters was held at the Tropicana in Las Vegas, while the 2018 William Hill US Darts Masters and the 2019 Dafabet US Darts Masters tournaments were held at the Mandalay Bay in Las Vegas.", "prediction 1": "The World Series of Darts Finals is a darts tournament held by the Professional Darts Corporation. The tournament is held annually in November. The first 3 events were held in the Braehead Arena in Glasgow, Scotland, but the venue was switched to the Multiversum Schwechat, Vienna, Austria for 2018 and will move again to the AFAS Live, Amsterdam, Netherlands in 2019.", "prediction 2": "The World Series of Darts Finals is a darts tournament held by the Professional Darts Corporation. The tournament is held annually in November. The first 3 events were held in the Braehead Arena in Glasgow, Scotland, but the venue was switched to the Multiversum Schwechat, Vienna, Austria for 2018. It was the second event in the 2018 World Series of Darts and was held at the Mandalay Bay in Las Vegas on 6\u20137 July 2018.", "prediction 3": "The Las Vegas Open is a darts tournament organised by the American Darts Organization that started in 1980. The 2017 partypoker US Darts Masters was the inaugural staging of the tournament by the Professional Darts Corporation, as a third entry in the 2017 World Series of Darts. The tournament featured eight North American players who faced eight PDC players, which was held at the Tropicana Las Vegas in Las Vegas, United States from 14\u201315 July 2017. The 2018 William Hill US Darts Masters was the second staging of the tournament by the Professional Darts Corporation. The tournament featured 16 players (8 PDC representatives and 8 North American representatives) and was held at the Mandalay Bay in Las Vegas on 6\u20137 July 2018.", "prediction 4": "The World Series of Darts is a darts tournament held by the Professional Darts Corporation. The tournament is held annually in November. The first 3 events were held in the Braehead Arena in Glasgow, Scotland, but the venue was switched to the Multiversum Schwechat, Vienna, Austria for 2018 and will move again to the AFAS Live, Amsterdam, Netherlands in 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 98 }, { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 368 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2017 US Darts Masters was held at the Tropicana Las Vegas in Las Vegas, while the 2018 William Hill US Darts Masters tournament was held at the Mandalay Bay in Las Vegas." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who sings this is me in the movie?", "passages": [ [ "The Greatest Showman", "The Greatest Showman\n\nThe Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya.", "The film is inspired by the story of P. T. Barnum's creation of the Barnum & Bailey Circus and the lives of its star attractions.", "Principal photography began in New York City in November 2016.", "The film premiered on December 8, 2017, aboard the RMS \"Queen Mary 2\".", "It was released in the United States on December 20, 2017, by 20th Century Fox and grossed over $434million worldwide, making it the fifth-highest grossing live-action musical of all time.", "The film was released seven months after Ringling Bros. and Barnum & Bailey Circus's dissolution.", "\"The Greatest Showman\" received mixed reviews, with praise for the performances, music, and production values, but criticism for its artistic license, with some reviewers calling it \"faux-inspiring and shallow\".", "At the 75th Golden Globe Awards, the film received nominations for Best Motion Picture \u2013 Musical or Comedy and Best Actor \u2013 Musical or Comedy for Jackman." ], [ "Keala Settle", "Keala Settle\n\nKeala Joan Settle (born November 5, 1975) is an American actress and singer.", "Settle originated the role of Norma Valverde in \"Hands on a Hardbody\", which ran on Broadway in 2013, and was nominated for the Outer Critics Circle Award, Drama Desk Award, and Tony Award for Best Featured Actress in a Musical.", "In 2017, she portrayed Lettie Lutz, a bearded lady, in the musical film \"The Greatest Showman\".", "The song \"This Is Me\" from the film, principally sung by Settle, won the 2018 Golden Globe Award for Best Original Song, and was nominated for the Academy Award for Best Original Song.", "Settle was born in Hawaii, the eldest of five children of Susanne (n\u00e9e Riwai), who is of M\u0101ori descent from New Zealand, and British-born David Settle.", "She is a graduate of Kahuku High School (class of 1993), and an alumna of Southern Utah University.", "Settle made her Broadway debut in 2011 in \"Priscilla, Queen of the Desert\" as Shirley and in the ensemble.", "Settle originated the role of Norma Valverde in \"Hands on a Hardbody\", a musical which ran briefly on Broadway in 2013, and is based on the 1997 documentary about real people competing to win a new truck." ] ], "gold": "The Greatest Showman is a 2017 American musical drama film. The film was inspired by the story of P. T. Barnum's creation of Barnum's American Museum and the lives of its star attractions. The song This is Me was sung by bearded lady Lettie Lutz, played by Keala Settle.", "prediction 1": "The song This Is Me from the 2017 American musical film The Greatest Showman is sung by American actress and singer Keala Settle. The song was originally sung by American actress Michelle Williams, but was also sung by American singer-songwriter Zac Efron.", "prediction 2": "The song This Is Me from the 2017 American musical film The Greatest Showman is principally sung by American actress and singer Keala Settle. Settle originated the role of Norma Valverde in the 2013 musical Hands on a Hardbody, which ran briefly on Broadway in 2013.", "prediction 3": "The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya. The song This Is Me from the film, principally sung by American actress and singer Keala Settle, won the 2018 Golden Globe Award for Best Original Song, and was nominated for the Academy Award for Best Original Song.", "prediction 4": "In the 2017 musical film The Greatest Showman, the song \"This Is Me\" is sung by American actress and singer Keala Settle. American actress and singer Judith McBride sang the song, while American singer and actress Amanda Settle sang the song.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 130, "end": 256 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Greatest Showman is a 2017 American musical drama film. The film was inspired by the story of P. T. Barnum's creation of Barnum's American Museum and the lives of its star attractions. The song This Is Me is sung by American actress and singer Keala Settle. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who is rated the best goalkeeper in the world?", "passages": [ [ "IFFHS World's Best Goalkeeper", "IFFHS World's Best Goalkeeper\n\nThe IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the most outstanding goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS).", "The votes are cast by IFFHS's editorial staff as well as experts from different continents.", "The award is awarded every January.", "The winning goalkeeper is awarded a gold trophy at the \"World Football Gala\".", "Italy's Gianluigi Buffon and Spain's Iker Casillas have the most award victories, having won it five times, followed by Germany's Manuel Neuer, who has won the award four times; Casillas won the award for five consecutive years between 2008 and 2012.", "Below is a list of the previous winners since the first award in 1987.", "Bayern Munich, with a total of eight, is the team with the most wins.", "At the end of the 20th century, the IFFHS also voted on the World's Goalkeeper of the Century, won by the Soviet Union's Lev Yashin running ahead of Gordon Banks and Dino Zoff." ], [ "Manuel Neuer", "Manuel Neuer\n\nManuel Peter Neuer (; born 27 March 1986) is a German professional footballer who plays as a goalkeeper and captain for both German club Bayern Munich and the Germany national team.", "Neuer has been described as a \"sweeper-keeper\" because of his unique playing style and speed when rushing off his line to anticipate opponents; he is also known for his quick reflexes, excellent shot-stopping abilities, strength, long throwing range, command of his area, and accurate control and distribution of the ball.", "Regarded by pundits as the best goalkeeper in the world (he won the IFFHS World's Best Goalkeeper award for four consecutive years between 2013 and 2016), and as one of the best and most complete goalkeepers of all-time, Neuer won the 2014 FIFA World Cup with Germany as well as the Golden Glove award for being the best goalkeeper in the tournament, and is considered by some in the sport to be the best goalkeeper in football since Lev Yashin.", "In 2014, Neuer finished third in the voting, behind Lionel Messi and Cristiano Ronaldo, for the FIFA Ballon d'Or award.", "The same year, he was ranked the third-best player in the world by \"The Guardian\"." ], [ "Gianluigi Buffon", "Gianluigi Buffon\n\nGianluigi Buffon, (, ; born 28 January 1978), commonly shortened to Gigi Buffon, is an Italian professional footballer who plays as a goalkeeper for French club Paris Saint-Germain.", "He is widely regarded by players, pundits and managers as one of the greatest goalkeepers of all time, and, by some, as the greatest ever.", "At club level, Buffon's professional career began with Parma in 1995, where he made his Serie A debut.", "He soon earned a reputation as one of the most promising young goalkeepers in Italy, and helped Parma win the Coppa Italia, the UEFA Cup and the Supercoppa Italiana, in 1999.", "After joining Juventus in 2001 for the world record fee for a goalkeeper of \u20ac52 million at the time, Buffon won Serie A titles in both of his first two seasons at the club, and established himself as one of the best players in the world in his position.", "With Juventus, he won a record nine Serie A titles, as well as four Coppa Italia titles, and five Supercoppa Italiana titles.", "After 17 years with Juventus, Buffon signed with French club Paris Saint-Germain at the age of 40 in 2018, where he immediately won the Troph\u00e9e des Champions in his first season with the team." ] ], "gold": "The IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the best goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS). According to IFFHS, the best goalkeeper in the world in 2015 and 2016 was Manuel Neuer, a German professional footballer who plays as a goalkeeper and captains both Bundesliga club Bayern Munich and the Germany national team. According to IFFHS and FIFA, the best goalkeeper in the world in 2017 was Gianluigi Buffon, an Italian professional footballer who plays as a goalkeeper for and captains Serie B club Parma.", "prediction 1": "The IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the most outstanding goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS). The winning goalkeeper is awarded a gold trophy at the \"World Football Gala\". Gianluigi Buffon, commonly shortened to Gianluigi, is an Italian professional footballer who plays as a goalkeeper for French club Paris Saint-Germain. Manuel Neuer, a German professional footballer, has won the award for four consecutive years between 2013 and 2016.\n", "prediction 2": "The International Federation of Football History & Statistics (IFFHS) announces the World's Best Goalkeeper every January at its World Football Gala Gala Awards ceremony in Zurich, Switzerland. Gianluigi Buffon, 51, holds the record for most award victories. Germany's Manuel Neuer, 54, has won the award four times.", "prediction 3": "The IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the most outstanding goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS). The winning goalkeeper is awarded a gold trophy at the World Football Gala. Italy's Gianluigi Buffon, commonly shortened to Gianni Buffon, is an Italian professional footballer who plays as a goalkeeper for French club Paris Saint-Germain. Manuel Peter Neuer, of Germany, is considered by some in the sport. Following Buffon, Neuer of the IFFHS World's Best Goalkeeper since 2013, 2014, and Milan'hid Goalkeeper David Arjkobnik Fior Ziel istgistBest Goalkeeper in the world.", "prediction 4": "The IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the most outstanding goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS). The voting is done by IFFHS's editorial staff as well as experts from different continents. Among current and former winners is Italian goalkeeper Gianluigi Buffon, from Juventus. Inter Milan's Jan Julian Dzeko received the award in 2012. Four years later, German goalkeeper Manuel Neuer won the award, a gold trophy at the World Football Gala.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 287 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 338 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The IFFHS World's Best Goalkeeper is a football award given annually since 1987 to the most outstanding goalkeeper of the year as voted by the International Federation of Football History & Statistics (IFFHS). Gianluigi Buffon, an Italian professional footballer who plays as a goalkeeper for French club Paris Saint-Germain, won the award five times along with Spain's Iker Casillas. Additionally, Manuel Neuer, a German professional footballer who plays as a goalkeeper and captains both German club Bayern Munich and the Germany national team, has won the award for four years. At the end of the 20th century, the IFFHS also voted on the World's Goalkeeper of the Century, won by the Soviet Union's Lev Yashin.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When does the new new jersey governor get sworn in?", "passages": [ [ "Governorship of Chris Christie", "Governorship of Chris Christie\n\nChris Christie took office as the 55th Governor of New Jersey on January 19, 2010, and began his second term on January 21, 2014, and left office on January 16, 2018.", "Governor Christie declared a \"state of emergency\" and laid out plans for more than US$1 billion in cuts to the state budget in an address to the New Jersey State Assembly on February 10, 2010.", "The budget included a carefully crafted plan requiring school districts to spend their surpluses in order to allow the state to withhold US$400 million in aid funding while retaining federal stimulus eligibility and avoiding the need for the legislature to pass a bill.", "Due to falling revenues and growing expenses, the Christie administration inherited a US$1.3 billion budget deficit from the US$29 billion 2009 New Jersey budget passed by Jon Corzine's administration.", "On February 9, 2010, he signed Executive Order No. 12, which placed a 90-day freeze on the Council on Affordable Housing (COAH) and established the Housing Opportunity Task Force to examine the State's affordable housing laws, constitutional obligations, and the effectiveness of the current framework.", "On February 11, 2010, Christie signed Executive Order No." ], [ "Richard Codey", "Codey became acting governor again with the resignation of Jim McGreevey on November 15, 2004.", "According to the New Jersey State Constitution at the time, in the event of a vacancy in the governor's office, the President of the State Senate takes on the additional position of acting governor until the next gubernatorial election.", "After taking over in 2004 Codey became popular with many New Jersey residents and reportedly considered a run for a full four-year term.", "However, U.S. Senator Jon Corzine's large number of endorsements as well as his large campaign war chest, funded primarily by his great personal wealth, convinced Codey to announce officially on January 31, 2005 that he would step aside.", "Codey served as governor until Corzine was sworn in on January 17, 2006 following Corzine's victory in the November 8, 2005 elections.", "Some had speculated that Codey could be a possible candidate for Corzine's vacant seat in the United States Senate, with Corzine appointing his own successor once he was sworn in as governor.", "However, Codey announced on November 23, 2005 that he was not interested in the Senate seat.", "With the passage on November 8, 2005, of a constitutional amendment creating the position of lieutenant governor, Codey became the last person to serve simultaneously as governor and senate president." ], [ "Lieutenant Governor of New Jersey", "In an unusual political circumstance, the 2001 legislative elections returned a senate with equal numbers of Republicans and Democrats, with each party having 20 senators.", "Both sides negotiated to choose two senators from their respective parties to serve as co-presidents.", "Because of an 8-day gap between the seating of the new state legislature and the inauguration of Governor-elect Jim McGreevey, four men held the position of acting governor:\n\nAfter Governor Jim McGreevey resigned in the midst of a sex scandal in 2004, Richard Codey served again as acting governor from November 15, 2004 to January 17, 2006.", "Codey was the only acting governor during this time, as the 2003 legislative elections had given the Democrats outright control of the state senate.", "Codey's tenure ended with the inauguration of Governor Jon Corzine on January 17, 2006.", "Public attention was directed to the issue of succession in the wake of the resignations of Whitman and McGreevey during so brief a period.", "The response of the general public and the media was that the situation of acting governors and resignations made the situation untenable and that the state needed a permanent solution such as a lieutenant governor.", "There were three chief arguments in favor of establishing a lieutenant governor:\n\nIn 2005, the state legislature passed resolutions for a proposed constitutional amendment to create the position of lieutenant governor." ] ], "gold": "The incoming New Jersey governor doesn't always get sworn into office on the same day of the year as those who served before them. For example, the 53rd governor of New Jersey, Richard Codey, was sworn in for his second term on November 15, 2004. The next New Jersey governor, Jon Corzine, was sworn in on January 17, 2006, and Chris Christie, the 55th governor, was sworn in on January 19, 2010.", "prediction 1": "Chris Christie took office as the 55th Governor of New Jersey on January 19, 2010, and began his second term on January 21, 2014, and left office on January 16, 2018. Richard Codey served as acting governor from November 15, 2004 to January 17, 2006, until Jon Corzine was sworn in as governor on January 17, 2006 following Corzine's victory in the November 8, 2005 elections.\n", "prediction 2": "Chris Christie took office as the 55th Governor of New Jersey on January 19, 2010, and began his second term on January 21, 2014, and left office on January 16, 2018. The last governor of New Jersey to be sworn in as governor was Richard Codey, who served the office from November 15, 2004 to January 17, 2006.", "prediction 3": "Chris Christie, a Democrat elected in the November 2000 general election, took office as the 55th Governor of New Jersey on January 19, 2010. He was sworn in as governor by the Governor-elect on January 17, 2006, and had previously served as governor from November 15, 2004 until January 17, 2006 when Senator Jon Corzine became governor.", "prediction 4": "The new governor of New Jersey must be sworn in by the Senate President before assuming office as governor. The governor-elect gets sworn in on a date and time that are specific to the term they will serve. Chris Christie was sworn in January 18, 2010, as the 55th governor of New Jersey, and Chris Christie took office January 19, 2010. Governor Chris Christie served as governor from January 31, 2004 - January 17, 2006. Then, on January 17, 2006, Governor Jon A. Corzine was officially inaugurated as governor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 166 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 377 } ], "missing-info": [], "corrected-prediction": "The New Jersey Governors swore in on different dates. Chris Christie took office as the 55th Governor of New Jersey on January 19, 2010. Richard Codey served as acting governor from November 15, 2004. Jon Corzine was sworn in as governor on January 17, 2006.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where did dorothy live in the wizard of oz?", "passages": [ [ "Dorothy Gale", "Eric Shanower's novel, \"The Giant Garden of Oz\", features a cow named Imogene.", "In the sixth Oz book by Baum, \"The Emerald City of Oz\" (1910), when Uncle Henry and Aunt Em are unable to pay the mortgage on the new farmhouse built at the end of \"The Wonderful Wizard of Oz\", Dorothy brings them to live in Oz; the plot features a tour of Oz as a marvelous, Utopian land in which they have escaped the troubles of Kansas.", "She becomes princess of Oz and Ozma's \"companion,\" essentially marrying the queen.", "Dorothy is a standard character, having at least a cameo role in thirteen of the fourteen Oz books written by L. Frank Baum (while she did not appear at all in \"The Marvelous Land of Oz\", she is mentioned several times in that story, as it was her actions in \"The Wonderful Wizard of Oz\" that led to the events in the former) and is at least a frequent figure in the nineteen that followed by author Ruth Plumly Thompson, getting at least a cameo in all her books except \"Captain Salt in Oz\" (in which neither Oz nor any of its inhabitants appear, though they are mentioned)." ], [ "Dorothy Gale", "Dorothy Gale\n\nDorothy Gale is a fictional character created by American author L. Frank Baum as the main protagonist in many of his \"Oz\" novels.", "She first appears in Baum's classic children's novel \"The Wonderful Wizard of Oz\" (1900) and reappears in most of its sequels.", "In addition, she is the main character in various adaptations, notably the classic 1939 film adaptation of the novel, \"The Wizard of Oz\".", "In later novels, the Land of Oz steadily becomes more familiar to her than her homeland of Kansas.", "Indeed, Dorothy eventually goes to live in an apartment in the Emerald City's palace but only after her Aunt Em and Uncle Henry have settled in a farmhouse on its outskirts, unable to pay the mortgage on their house in Kansas.", "Dorothy's best friend Princess Ozma, ruler of Oz, officially makes her a princess of Oz later in the novels.", "In the Oz books, Dorothy is raised by her aunt and uncle in the bleak landscape of a Kansas farm.", "Whether Aunt Em or Uncle Henry is Dorothy's blood relative remains unclear.", "Uncle Henry makes reference to Dorothy's mother in \"The Emerald City of Oz\", possibly an indication that Henry is Dorothy's blood relative." ] ], "gold": "Dorothy Gale is a fictional character created by American author L. Frank Baum as the protagonist in many of his Oz novels. She first appears in Baum's classic 1900 children's novel The Wonderful Wizard of Oz and in most of its sequels, as well as being the main character in various adaptations, notably the classic 1939 film adaptation. Dorothy's homeland is in Kansas, but she eventually goes to live in an apartment in the Emerald City's palace but only after her Aunt Em and Uncle Henry have settled on a farm on its outskirts, unable to pay the mortgage on their house in Kansas. Dorothy's best friend Princess Ozma, ruler of Oz, officially makes her a princess of Oz later in the novels.", "prediction 1": "Dorothy Gale is a fictional character created by American author L. Frank Baum as the main protagonist in many of his Oz novels. In the 1939 film adaptation of the classic children's novel The Wizard of Oz, Dorothy lives in an apartment in the Emerald City's palace, but only after her Aunt Em and Uncle Henry have settled in a farmhouse on its outskirts, unable to pay the mortgage on their house in Kansas.", "prediction 2": "Dorothy Gale is a fictional character created by American author L. Frank Baum as the main protagonist in many of his Oz novels. In the 1939 film adaptation, Dorothy lives in the Emerald City of Oz.", "prediction 3": "In the 1939 film adaptation of The Wizard of Oz, Dorothy Gale is the main character. She first appears in American author L. Frank Baum's classic children's novel, The Wonderful Wizard of Oz, where she lives with her aunt and uncle on a farm.", "prediction 4": "In the original 1900 novel, The Wonderful Wizard of Oz, Dorothy lives with her aunt and uncle in a Kansas farm. She eventually goes to live in an apartment in the Emerald City's palace but only after her Aunt Em and Uncle Henry have settled in a farmhouse on its outskirts, unable to pay the mortgage on their house in Kansas. In the 1910 Oz book, The Emerald City of Oz, Dorothy brings her aunt and uncle to live in Oz, where the plot features a tour of Oz as a marvelous, Utopian land in which they have escaped the troubles of Kansas.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Dorothy Gale is a fictional character created by American author L. Frank Baum as the main protagonist in many of his Oz novels. She first appears in Baum's classic children's novel \"The Wonderful Wizard of Oz\" (1900) and reappears in most of its sequels. In addition, she is the main character in various adaptations, notably the classic 1939 film adaptation. Dorothy's homeland is in Kansas, but she eventually goes to live in an apartment in the Emerald City's palace, but only after her Aunt Em and Uncle Henry have settled in a farmhouse on its outskirts, unable to pay the mortgage on their house in Kansas. Dorothy's best friend Princess Ozma, ruler of Oz, officially makes her a princess of Oz later in the novels." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is my big fat greek wedding set?", "passages": [ [ "My Big Fat Greek Wedding", "Hanks later said that casting Vardalos in the lead role \"brings a huge amount of integrity to the piece, because it's Nia's version of her own life and her own experience.", "I think that shows through on the screen and people recognize it.\"", "In 2000, while in Toronto doing pre-production for the film, Vardalos and Playtone producer Gary Goetzman overheard actor John Corbett (who was in town shooting the film \"Serendipity\") at a bar, telling a friend of his about having read the script for \"My Big Fat Greek Wedding\", and being upset that he couldn't make the auditions.", "Vardalos and Goetzman approached Corbett and offered him the part of Ian Miller on the spot, which he accepted.", "Despite being based on life in the Greek community of Winnipeg, the film was set in Chicago and shot in both Toronto and Chicago.", "Toronto's Ryerson University and Greektown neighborhood feature prominently in the film.", "The home used to depict Gus and Maria Portokalos's residence (as well as the home bought next door at the end of the film for Toula and Ian) is located on Glenwood Crescent just off O'Connor Drive in East York.", "The real home representing the Portokalos' residence actually has most of the external ornamentation that was shown in the film." ], [ "My Big Fat Greek Wedding", "My Big Fat Greek Wedding\n\nMy Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with non-Greek upper middle class White Anglo-Saxon Protestant Ian Miller.", "The film received generally positive reviews from critics and, at the 75th Academy Awards, it was nominated for the Academy Award for Best Original Screenplay.", "A sleeper hit, the film became the highest-grossing romantic comedy of all time, and grossed $241.4 million in North America, despite never reaching number one at the box office during its release.", "It was the highest-grossing film to accomplish this feat for 14 years until the animated film \"Sing\" grossed $268 million in 2016.", "The film spawned a franchise, which inspired the short-lived 2003 TV series \"My Big Fat Greek Life\" and a film sequel titled \"My Big Fat Greek Wedding 2\", was released on March 25, 2016.", "Fotoula \"Toula\" Portokalos is her family's black sheep.", "Her staunchly proud Greek immigrant parents, Gus and Maria, raised their daughters to follow their cultural traditions of marriage and motherhood." ] ], "gold": "My Big Fat Greek Wedding is a 2002 American-Canadian independent romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with the upper middle class White Anglo-Saxon Protestant Ian Miller. Despite being based on life in the Greek community of Winnipeg, the film was set in Chicago and shot in both Chicago and Toronto.", "prediction 1": "My Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with upper middle class White Anglo-Saxon Protestant Ian Miller. The home used to depict Gus and Maria Portokalos' residence, as well as the home bought next door at the end of the film for Toula and Ian, is located on Glenwood Crescent just off O'Connor Drive in East York. Toronto's Ryerson University and Greektown neighborhood feature prominently in the film. Toronto's Ryerson University and Greektown neighborhood of East York feature prominently in the film.", "prediction 2": "My Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with non-Greek upper middle class White Anglo-Saxon Protestant Ian Miller. The home used to depict Gus and Maria Portokalos' residence is located on Glenwood Crescent just off O'Connor Drive in East York. The real home representing the Portokalos' residence actually has most of the external ornamentation that was shown in the film.", "prediction 3": "My Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with upper middle class White Anglo-Saxon Protestant Ian Miller. The home used to depict Gus and Maria Portokalos' residence, as well as the home bought next door at the end of the film for Toula and Ian, is located on Glenwood Crescent just off O'Connor Drive in East York.", "prediction 4": "My Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with upper middle class White Anglo-Saxon Protestant Ian Miller. Toronto's Ryerson University and Greektown neighborhood feature prominently in the film. The home used to depict Gus and Maria Portokalos' residence as well as the real home bought next door at the end of the film is located on Glenwood Crescent just off O'Connor Drive in East York. The home used to depicting the Portokalos' residence is located on Glenwood Crescent just off O'Connor Drive in East York. The home used to depicting Gus and Maria Portokalos's residence is located on Glenwood Crescent just off O'Connor Drive in East York.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 494 }, { "error type": "Irrelevant", "explanation": "", "start": 495, "end": 583 }, { "error type": "Irrelevant", "explanation": "", "start": 584, "end": 685 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "My Big Fat Greek Wedding is a 2002 romantic comedy film directed by Joel Zwick and written by Nia Vardalos, who also stars in the film as Fotoula \"Toula\" Portokalos, a middle class Greek American woman who falls in love with upper middle class White Anglo-Saxon Protestant Ian Miller. Despite being based on life in the Greek community of Winnipeg, the film was set in Chicago and shot in both Toronto and Chicago." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who is the world best selling music artist?", "passages": [ [ "Elvis Presley singles discography", "While Elvis is recognized by many in the recording industry as the best selling artist of all time, the Recording Industry Association of America (RIAA), the U.S. recording industry\u2019s official certifying agent for sales, stirred up controversy in November 2007 when it announced that country singer Garth Brooks had become the best selling solo artist in U.S. history.", "Elvis Presley Enterprises has disputed the RIAA\u2019s claim, pointing out several omissions in the RIAA\u2019s figures.", "The RIAA bases its claim on album sales only, and does not include single sales in determining the highest selling solo artist, despite the fact that the RIAA also certifies single sales.", "While Elvis\u2019 album sales are significant, his single sales were also significant as can be seen in the tables below.", "During much of Elvis\u2019 career in the 1950s and 1960s, single sales were considered the primary market for the industry, while albums were a secondary market.", "It was not until the late 1960s and early 1970s that albums became the primary market for the industry.", "RIAA does not certify sales of less than 500,000 units for albums and singles.", "Elvis has had numerous albums and singles which have sold hundreds of thousands of units each but have not reached the 500,000 threshold.", "Taken together, these could add up to millions in total sales that are not recognized by the RIAA." ], [ "2009 in Japanese music", "2009 in Japanese music\n\nThe following is an overview of the year 2009 in Japanese music.", "It includes notable awards, lists of number-ones, yearly best-sellers, albums released, groups established and disestablished, deaths of notable Japanese music-related people as well as any other relevant Japanese music-related events.", "For overviews of the year in music from other countries, see 2009 in music.", "The two best-selling music artists in Japan in 2009 by value of sales, including sales of records and of DVDs and Blu-rays, according to Oricon, were Arashi, with and Exile.", "The following is a list of the top 10 best-selling albums in Japan in 2009, according to Oricon.", "The best-selling album of the year, \"All the Best!", "1999\u20132009\", sold more than 1.43 million copies.", "The following section includes albums by Japanese artists released in Japan in 2009 as well as Japanese-language albums by foreign artists released in the country during this year." ] ], "gold": "According to an independently verified list of best-selling music artists, as of 2017, The Beatles are the highest-selling band based on sales claims and certified units. The individual members of The Beatles are John Lennon, Paul McCartney, Ringo Starr and George Harrison. Elvis Presley is considered the highest-selling individual artist based on sales claims, while Drake is considered the highest-selling individual artist based on certified units.", "prediction 1": "The Recording Industry Association of America (RIAA), the U.S. recording industry's official certifying agent for sales, stirred up controversy in November 2007 when it announced that country singer Garth Brooks had become the best selling solo artist in U.S. history. While Elvis is recognized by many in the recording industry as the best selling artist of all time, the RIAA stirred up controversy in November 2007 when it announced that country singer Jason Mraz had become the best selling solo artist in U.S. history.", "prediction 2": "The Recording Industry Association of America is the U.S. recording industry's official certifying agent for sales. Garth Brooks has been named the top selling solo artist in the U.S. since 2004. During much of Elvis' career in the 1950s and 1960s, single sales were considered the primary market for the industry, while albums were a secondary market. RIAA does not include single sales in determining the highest selling solo artist, despite the fact that the RIAA also certifies single sales.", "prediction 3": "While Elvis Presley is recognized by many in the recording industry as the best selling artist of all time, the Recording Industry Association of America stirred up controversy in November 2007 when it announced that country singer Garth Brooks had become the best selling solo artist in U.S. history. The two best-selling music artists in Japan in 2009 by value of sales, including sales of records and of DVDs and Blu-rays, according to Oricon, were Arashi, with and Exile.", "prediction 4": "The Recording Industry Association of America (RIAA) stirred up controversy in November 2007 when it announced that country singer Garth Brooks had become the best selling solo artist in U.S. history. While Elvis is recognized by many in the recording industry as the best selling artist of all time, the RIAA stirred up controversy in November 2007 when it announced that country singer George Strait had become the best selling solo artist in U.S. history.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 168 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 456, "end": 466 }, { "error type": "Redundant", "explanation": " it announced that country singer Garth Brooks had become the best selling solo artist in U.S. history. ", "start": 369, "end": 455 }, { "error type": "Redundant", "explanation": " become the best selling solo artist in U.S. history. ", "start": 467, "end": 523 }, { "error type": "Unverifiable", "explanation": "", "start": 269, "end": 368 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Recording Industry Association of America (RIAA) announced that country singer Garth Brooks had become the best selling solo artist in U.S. history. Elvis Presley Enterprises has disputed the RIAA\u2019s claim, pointing out several omissions in the RIAA\u2019s figures." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What's donnas real name from that 70's show?", "passages": [ [ "Donna Pinciotti", "Donna Pinciotti\n\nDonna Marie Pinciotti is a fictional character and one of the two female leads in the Fox sitcom \"That '70s Show\", appearing in all eight seasons.", "Portrayed by Laura Prepon, Donna is the love interest to Eric Forman.", "Donna's relationship with next-door neighbor Eric Forman is often the main focus of the series.", "However, it is tumultuous at times, having suffered two break-ups during the show's run.", "Despite this, Eric and Donna often act as the \"parents\" of the group, being mature and responsible when their friends are not, for example in episodes like \"Dine and Dash\".", "Another episode that illustrates their parenthood of the group is when they have just broken up and Eric takes them all out and returns late.", "He and Donna engage in an argument because Eric gives Fez ice cream and Donna is angry because he wouldn't be hungry for dinner.", "When Fez is going to be deported, she and Eric become upset because \"their\" Fez is leaving.", "Eric is sometimes threatened by his feeling inferior to her, especially during the third season, when she gets a job as a disc jockey.", "Donna and Eric lose their virginity to each other in the beginning of season two, after many failed attempts to \"do it\"." ], [ "That '70s Show", "That '70s Show\n\nThat '70s Show is an American television period sitcom that originally aired on Fox from August 23, 1998 to May 18, 2006.", "The series focused on the lives of a group of six teenage friends living in fictional Point Place, Wisconsin, from May 17, 1976 to December 31, 1979.", "The main teenage cast members were Topher Grace, Mila Kunis, Ashton Kutcher, Danny Masterson, Laura Prepon and Wilmer Valderrama.", "The main adult cast members were Debra Jo Rupp, Kurtwood Smith, Don Stark, Tommy Chong and Tanya Roberts.", "The creators had wanted the show to have a 1970s \"feel\" from the beginning, so opted to set the series later in the decade, when trends and political ideologies had become firmly established and disseminated.", "The idea that the duration of the series would carry sociopolitical undertones also necessitated a chain of social events which could influence the characters.", "Thus, 1976 was chosen, which allowed episodes set within a short time frame to address streaking, the sexual revolution, the Equal Rights Amendment, the 1973 oil crisis, and the presidencies of Richard Nixon and Gerald Ford, all of which were culturally influential events that occurred in the earlier years of the 1970s." ] ], "gold": "That '70s Show is an American television sitcom that focuses on the lives of a group of six teenage friends living in fictional Point Place, Wisconsin, from May 17, 1976, to December 31, 1979. The character of Donna Pinciotti, portrayed by Laura Prepon, is intelligent, good-looking, and a feminist tomboy. She is Eric's girlfriend for seven seasons, and briefly is his fianc\u00e9e. She also has brief romances with Michael's brother Casey and with Randy during the final season before rekindling her relationship with Eric at the end of the show's finale.", "prediction 1": "Donna Marie Pinciotti is a fictional character from That 70's Show. She's one of the two female leads in the Fox sitcom. Donna's real name is Laura Prepon.", "prediction 2": "Donna Marie Pinciotti is a fictional character and one of the two female leads in the Fox sitcom That '70s Show. Portrayed by Laura Prepon, Donna is the love interest to Eric Forman. Donna has a real name of Donna A. Pinciotti, and her real name is Nancy Pinciotti.", "prediction 3": "Donna Marie Pinciotti is a fictional character and one of the two female leads in the Fox sitcom That '70s Show, appearing in all eight seasons. Donna is played by Laura Prepon and is the love interest to Eric Forman. The show focused on the lives of a group of six teenage friends living in fictional Point Place, Wisconsin, from May 17, 1976 to December 31, 1979. Donna's real name is Susanne Marie.", "prediction 4": "Donna Marie Pinciotti is a fictional character and one of the two female leads in the Fox sitcom That '70s Show. She is played by Laura Prepon. Donna is the love interest to Eric Forman. Donna is the daughter of the show's executive producer, John and Laura's husband, Frank Pinciotti.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 120 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "That '70s Show is an American television sitcom that focuses on the lives of a group of six teenage friends living in fictional Point Place, Wisconsin, from May 17, 1976, to December 31, 1979. Donna Marie Pinciotti is a fictional character from That 70's Show portrayed by Laura Prepon. Donna's relationship with next-door neighbor Eric Forman is often the main focus of the series." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "Who played pugsley in the addams family tv show?", "passages": [ [ "Pugsley Addams", "In the 1977 TV movie, Ken Weatherwax played a grown-up Pugsley, who has become a witch-doctor.", "In the interval between the original TV series and this movie his parents have had two more children, who look just like the original Pugsley and Wednesday.", "He is known as Pericles Addams in Spanish-speaking countries and in Brazil (Portuguese) as \"Feioso\" (Ugly).", "The 1998 series \"The New Addams Family\" features Pugsley played by Vancouver native Brody Smith.", "He is essentially the same as the original 1960s incarnation; however the influence of director John Bell's namesake Charlie 'Edge' Bell is undeniable.", "Also, he is portrayed as the younger sibling, as opposed to Wednesday.", "In the film \"The Addams Family\" and its sequel, \"Addams Family Values\", Pugsley is played by Jimmy Workman.", "He acts as an unwitting accomplice to his (older?) sister, Wednesday, who makes attempts to inflict lethal harm upon him - although he has returned the favor on occasion.", "In \"The Addams Family\", Pugsley and Wednesday open a lemonade stand, but their drinks are toxic, and cause Lurch to spit flames when he tries it." ], [ "Ken Weatherwax", "Ken Weatherwax\n\nKenneth Patrick Weatherwax (September 29, 1955 \u2013 December 7, 2014) was an American child actor best known for having played Pugsley Addams on \"The Addams Family\".", "Weatherwax was born in Los Angeles, California, into a show-business family.", "His aunt was actress and dancer Ruby Keeler, while his half-brother, Joey D. Vieira, played \"Porky\" on the first three seasons of \"Lassie\" under the stage name of Donald Keeler, beginning in 1954.", "His uncles were Frank and Rudd Weatherwax, Lassie's trainers and owners of the first dog to play the role.", "Weatherwax made his acting debut in the early 1960s when he was nine years old, playing a boy named \"Chester\" in Gleem toothpaste commercials alongside Alice Pearce.", "He was then cast as Pugsley Addams on \"The Addams Family\", after successfully auditioning with stars Carolyn Jones and John Astin.", "The program ran for two seasons from 1964 to 1966.", "After its cancellation, Weatherwax found he was typecast as Pugsley and lost interest in acting.", "He entered the U.S. Army at seventeen, and at the age of 21, he reprised the role of Pugsley in the 1977 reunion film \"Halloween with the New Addams Family\"." ], [ "Jodie Foster", "Jodie Foster\n\nAlicia Christian Foster (born November 19, 1962) is an American actress, director, and producer.", "She has received two Academy Awards, three British Academy Film Awards, two Golden Globe Awards, and the Cecil B DeMille Award.", "For her work as a director, she has been nominated a Primetime Emmy Award.", "A child prodigy, Foster began her professional career as a child model when she was three years old, and she made her acting debut in 1968 in the television sitcom \"Mayberry R.F.D.\"", "In the late 1960s and early 1970s, she worked in several television series and made her film debut with Disney's \"Napoleon and Samantha\" (1972).", "Following appearances in the musical \"Tom Sawyer\" (1973) and Martin Scorsese's comedy-drama \"Alice Doesn't Live Here Anymore\" (1974), Foster's breakthrough came with Scorsese's psychological thriller \"Taxi Driver\" (1976), in which she played a child prostitute; at age 14, she received a nomination for the Academy Award for Best Supporting Actress." ] ], "gold": "There are several The Addams Family sitcoms, including a 1964 ABC sitcom and a 1973 animated sitcom. American child actor Ken Weatherwax played Pugsley in the 1964 TV show The Addams Family. In the 1973 The Addams Family TV show, Pugsley was played by Jodie Foster, an American actress, director, and producer.", "prediction 1": "In the addams family television show, Pugsley Addams was played by many actors. The children's character was played by Ken Weatherwax from 1964 to 1966. Then, in 1977, Pugsley was played by Jodie Foster. In the 1998 TV movie, Pugsley was played by Vancouver native Brody Smith.", "prediction 2": "In the Addams Family television show, Pugsley was played by Ken Weatherwax, Kenny Weldon, and Jimmy Workman. In the 1977 TV movie, Pugsley is played by Brody Smith and in the 1998 series, Pugsley is played by John G. Slater.", "prediction 3": "In the Addams Family television show, the role of Pugsley is frequently played by children. In the 1974 movie, Pugsley is played by Alicia Christian Foster. In the 1998 movie, Pugsley is played by Vancouver native Brody Smith. In the 1999 movie, Pugsley is played by Michael Mann.", "prediction 4": "In the Addams Family television show, Pugsley Addams was played by child actor Ken Weatherwax. Weatherwax's version of the character was played by American actress Jodie Foster.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 216, "end": 225 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 203 } ], "missing-info": [], "corrected-prediction": "In the addams family television show, Pugsley Addams was played by many actors. The children's character was played by Ken Weatherwax from 1964 to 1966. In the 1998 TV series, Pugsley was played by Vancouver native Brody Smith." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who dies in one flew over the cuckoo's nest?", "passages": [ [ "One Flew Over the Cuckoo's Nest (novel)", "McMurphy persuades one of the women to seduce Billy Bibbit, a timid, boyish patient with a terrible stutter and little experience with women, so he can lose his virginity.", "Although McMurphy plans to escape before the morning shift starts, he and the other patients instead fall asleep without cleaning up the mess of the group\u2019s antics, and the morning staff discovers the ward in complete disarray.", "Nurse Ratched finds Billy and the prostitute in each other's arms, partially dressed, and admonishes him.", "Billy asserts himself for the first time, answering Nurse Ratched without stuttering.", "Ratched calmly threatens to tell Billy's mother what she has seen.", "Billy has an emotional breakdown, and once left alone in the doctor's office, commits suicide by cutting his throat.", "Nurse Ratched blames McMurphy for the loss of Billy's life.", "Enraged at what she has done to Billy, McMurphy attacks Ratched, attempting to strangle her to death, tearing off her uniform and revealing her breasts to the patients and aides who are watching.", "McMurphy is physically restrained and moved to the Disturbed ward.", "Nurse Ratched misses a week of work due to her injuries, during which time many of the patients either transfer to other wards or check out of the hospital forever." ], [ "One Flew Over the Cuckoo's Nest (novel)", "When she returns she cannot speak and is thus deprived of her most potent tool to keep the men in line.", "With Bromden, Martini, and Scanlon the only patients who attended the boat trip left on the ward, McMurphy is brought back in.", "He has received a lobotomy, and is now in a vegetative state, rendering him silent and motionless.", "The Chief smothers McMurphy with a pillow during the night in an act of mercy before lifting the tub room control panel that McMurphy could not lift earlier, throwing it through a window and escaping the hospital.", "\"One Flew Over the Cuckoo's Nest\" was written in 1959 and published in 1962 in the midst of the Civil Rights Movement and deep changes to the way psychology and psychiatry were being approached in America.", "The 1960s began the controversial movement towards deinstitutionalization, an act that would have affected the characters in Kesey's novel.", "The novel is a direct product of Kesey's time working the graveyard shift as an orderly at a mental health facility in Menlo Park, California.", "Not only did he speak to the patients and witness the workings of the institution, but he voluntarily took psychoactive drugs, including mescaline and LSD, as part of Project MKUltra." ] ], "gold": "Several characters die in \"One Few Over the Cuckoo's Nest\". Randle Patrick \"Mac\" McMurphy, who is smothered with a pillow, and Billy Bibbit, who commits suicide, died in both the book and the film version. Charlie Cheswick, who drowns, Rawler, who dies in the toilet, and Old Blastic, who dies in both in a dream and in reality, only died in the book.", "prediction 1": "In One Flew Over the Cuckoo's Nest, the main character, McMurphy, dies by cutting his throat. Then, when Billy Bibbit is left alone in the doctor's office, the chief of staff, Chief Bromden, smothers McMurphy with a pillow.", "prediction 2": "The novel One Flew Over the Cuckoo's Nest was written in 1959 and published in 1962 in the midst of the Civil Rights Movement and deep changes to the way psychology and psychiatry were approached in America. In the novel, McMurphy attempts to strangle Ratched to death, tearing off her uniform and revealing her breasts to the patients and aides who are watching. Enraged at what he has done to Billy, McMurphy attacks Ratched, attempting to strangle Ratched to death, attempting to kill Nurse Ratched by cutting his throat. Enraged at what he has done to Billy, McMurphy attempts to kill Ratched, attempting to kill her by strangle Ratched, attempting to death, attempting to kill Ratched, ripping off her uniform and revealing her breasts to the patients and aides who are watching.", "prediction 3": "There are several characters that die in One Flew Over the Cuckoo's Nest. One of them, Billy Bibbit, is a patient at the hospital who is suffering from a mental illness. McMurphy, who was patient at the hospital when the novel was published, kills Nurse Ratched, who blames McMurphy for the loss of Billy's life. McMurphy then attacks Ratched, attempting to strangle her to death, tearing off her uniform and revealing her breasts to the patients and aides who are watching.", "prediction 4": "In One Flew Over the Cuckoo's Nest, Billy Bibbit, a patient at the hospital who had been a patient at a mental hospital for a long time, dies after Nurse Ratched strangles her to death. McMurphy tries to strangle Ratched, a woman who worked in the psychiatric unit, to death, but is stopped by the Chief, who smothers McMurphy with a pillow. Ratched dies of a suicide, and is attacked by McMurphy, he attempts to strangle Ratched to death, but Nurse Ratched blames McMurphy for the loss of Billy, and McMurphy, McMurphy tries to strangle Ratched, attempting to death, ripping off her uniform and revealing her breasts to the patients and aides watching.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 156, "end": 175 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 56, "end": 65 }, { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 55 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 155 } ], "missing-info": [], "corrected-prediction": "In One Flew Over the Cuckoo's Nest, Billy dies by cutting his own throat. Then, Chief Bromden smothers McMurphy with a pillow." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who play the role of draupadi in mahabharat?", "passages": [ [ "Draupadi", "The Draupadi Amman cult (or Draupadi cult) is a tradition that binds together a community of people in worshipping Draupadi Amman as a village goddess with unique rituals and mythologies.", "The cult believes that Draupadi is the incarnation of the goddess Kali.", "Fire walking or theemithi is a popular ritual enacted at Draupadi Amman temples.", "At the ancient religious festival of Bengalore named Karaga, Draupadi is worshipped as an incarnation of Adishakti and Parvati in the nine day event.", "There are over 400 temples dedicated to Draupadi in the Indian states of Andhra Pradesh, Tamil Nadu, Karnataka and other countries like Sri Lanka, Singapore, Malaysia, Mauritius, R\u00e9union, South Africa.", "In these regions, Draupadi is worshipped mainly by people of the Vanniyar caste.", "There are a few processions and festivals which are conducted for about 3 weeks a year.", "The most famous festival is in the village Durgasamudram, Tirupati of Chittoor district.", "In B.R.Chopra's \"Mahabharat\", Draupadi was portrayed by Roopa Ganguly.", "In the 2008 Television series, \"Kahaani Hamaaray Mahaabhaarat Ki\", Draupadi was enacted by Anita Hassanandani Reddy." ], [ "Draupadi", "In \"2013 Mahabharat TV Series\", Draupadi was played by Pooja Sharma.", "In \"Dharmakshetra\" (2014), Draupadi was portrayed by Kashmira Irani.", "In \"Suryaputra Karna (2015 TV Series)\"", "Draupadi was portrayed by Pankhuri Awasthy.", "In \"Karn Sangini\" she is portrayed by Madhirakshi Mundle.", "In \"Draupadi\" (DD Kisan) Mitali Nag essays the role of Draupadi from Village Boy Production.", "The fiery heroine of Mahabharata has been the topic of research and debate for centuries.", "There are various award-winning plays and novels attributed to her." ], [ "Draupadi", "Draupadi\n\nDraupadi () is the most important female character in the Hindu epic, \"Mahabharata\".", "According to the epic, she is the daughter of Drupada, King of Panchala.", "Draupadi is considered as one of the Panchakanyas or Five Virgins.", "Like other epic characters, Draupadi is referred to by multiple names in the \"Mahabharata\".", "Her names are as follows:\n\n\n", "According to the epic Mah\u0101bh\u0101rata, Bareilly region (Panchala) is said to be the birthplace of Draupadi, who was also referred to as 'Panchali'.", "King Drupada of Panchala had been defeated by the Pandava prince Arjuna on behalf of Drona, who subsequently took half his kingdom.", "To gain revenge on Drona, he performed a yaj\u00f1a called Putrakameshti yajna to obtain a means of blessing him.", "From the sacrificial fire, Draupadi emerged as a beautiful dark-skinned young woman after her sibling Dhrishtadyumna.", "When she emerged from the fire, a heavenly voice said that she would bring about the destruction of the Kuru line.", "Draupadi is described in the Mahabharata as a very beautiful woman of that time." ] ], "gold": "Draupadi is the heroine of the Hindu epic, Mahabharata, who was the common wife of the five Pandava brothers, Yudhishthira, Bhima, Arjuna, Nakula and Sahadeva and is described to be the most beautiful woman of her time and was prophesied to bring the end of many warriors. In the 1965 film Mahabharat, the character was played by Padmini Ramachandran. In the 1988 TV series, as well as the 1997 TV series and the Mahabharat Aur Barbareek film, Indian actress, playback singer and politician Roopa Ganguly played the role. In the 1989 film, the role was played by Mallika Sarabhai and in the 2013 series Pooja Sharma played the role.", "prediction 1": "Draupadi is the most important female character in the Hindu epic, Mahabharata. According to the epic, she is the daughter of Drupada, who is the founder of the Pandava kingdom of Panchala. In B.R. Chopra's \"Mahabharat\", Draupadi was portrayed by Roopa Ganguly. In the 2008 Television series, Khaani Hamaaray Mahaabhaarat Ki, Draupadi was enacted by Anita Hassanandani Reddy. In \"Draupadi\" (DD Kisan), Mitali Nag essays the role of Draupadi from Village Boy Production.", "prediction 2": "Draupadi is the most important female character in the Hindu epic, Mahabharata. According to the epic, she is the daughter of Drupada, King of Panchala. According to the Ramayana, the most important female character in the Hindu epic, Mahabharata, is Draupadi, who is the wife of Drona. In B.R. Chopra's film, she was played by Roopa Ganguly. In the 2008 television series, Kahaani Hamaaray, Draupadi was portrayed by Kashmira Irani. In Mitali Nag essays the role of Draupadi, from Village Boy Production.", "prediction 3": "Draupadi is the most important female character in the Hindu epic, Mahabharata. According to the epic, she is the daughter of Drupada, King of Panchala. In B.R.Chopra's \"Mahabharat\", Draupadi was played by Roopa Ganguly. In the 2008 Television series, Kahaani Hamaaray Mahaabhaarat Ki\", Draupadi was played by Anita Hassanandani Reddy.", "prediction 4": "Draupadi is the most important female character in the Hindu epic, Mahabharata. According to the epic, she is the daughter of Drupada, King of Panchala. In B.R.Chopra's version, Draupadi was portrayed by Roopa Ganguly. In the 2008 Television series, Kahaani Hamaaray Mahaabhaarat Ki, Draupadi was enacted by Anita Hassanandani Reddy. Mitali Nag essays the role of Draupadi in the 2013 Mahabharata.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 441, "end": 469 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 2, 3, 4, 5 ] } ], "corrected-prediction": "Draupadi is described in the Mahabharata as a very beautiful woman of that time. In B.R. Chopra's \"Mahabharat\", Draupadi was portrayed by Roopa Ganguly. In the 2008 Television series, Khaani Hamaaray Mahaabhaarat Ki, Draupadi was enacted by Anita Hassanandani Reddy. In \"Draupadi\" (DD Kisan), Mitali Nag essays the role of Draupadi. In \"2013 Mahabharat TV Series\", Draupadi was played by Pooja Sharma. In \"Dharmakshetra\" (2014), Draupadi was portrayed by Kashmira Irani. In \"Suryaputra Karna (2015 TV Series)\", Draupadi was portrayed by Pankhuri Awasthy. In \"Karn Sangini\" she is portrayed by Madhirakshi Mundle." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who played scarlett in gone with the wind?", "passages": [ [ "Gone with the Wind (film)", "Gone with the Wind (film)\n\nGone with the Wind is a 1939 American epic historical romance film, adapted from Margaret Mitchell's 1936 novel of the same name.", "The film was produced by David O. Selznick of Selznick International Pictures and directed by Victor Fleming.", "Set in the American South against the backdrop of the American Civil War and the Reconstruction era, the film tells the story of Scarlett O'Hara, the strong-willed daughter of a Georgia plantation owner.", "It follows her romantic pursuit of Ashley Wilkes, who is married to his cousin, Melanie Hamilton, and her subsequent marriage to Rhett Butler.", "The leading roles are played by Vivien Leigh (Scarlett), Clark Gable (Rhett), Leslie Howard (Ashley), and Olivia de Havilland (Melanie).", "Production was difficult from the start.", "Filming was delayed for two years because of Selznick's determination to secure Gable for the role of Rhett Butler, and the \"search for Scarlett\" led to 1,400 women being interviewed for the part.", "The original screenplay was written by Sidney Howard and underwent many revisions by several writers in an attempt to get it down to a suitable length.", "The original director, George Cukor, was fired shortly after filming began and was replaced by Fleming, who in turn was briefly replaced by Sam Wood while Fleming took some time off due to exhaustion." ], [ "Gone with the Wind (musical)", "Gone with the Wind (musical)\n\nGone with the Wind is a musical based on the Margaret Mitchell's novel of the same name and its 1939 film adaptation, with music and lyrics by Margaret Martin, and a book by Martin, adapted by Sir Trevor Nunn.", "It began previews on 5 April 2008 and officially opened at the New London Theatre in London's West End on 22 April 2008.", "The production was directed by Sir Trevor Nunn and featured sets by John Napier and costumes by Andreane Neofitu.", "Darius Danesh and Jill Paice starred as Rhett Butler and Scarlett O'Hara respectively.", "The show was produced by Aldo Scrofani, Colin Ingram, Gary McAvay and the Nederlander Producing Company.", "The production closed on 14 June 2008, after 79 performances.", "This was not the first musical version of \"Gone With the Wind\".", "A musical adaptation by Harold Rome played a year at the Drury Lane Theatre in 1972, starring June Ritchie as Scarlett, and featuring Bonnie Langford.", "Margaret Martin, a newcomer to songwriting and playwriting, contacted the Stephen Mitchell Trust, sending tapes of songs and a draft script, and the Trust eventually agreed to give her the rights to make an adaptation of \"Gone with the Wind\"." ], [ "Vivien Leigh", "Vivien Leigh\n\nVivien Leigh (; born Vivian Mary Hartley, and styled as Lady Olivier after 1947; 5\u00a0November 19138\u00a0July 1967) was an English stage and film actress.", "She won two Academy Awards for Best Actress, for her iconic performances as Scarlett O'Hara in \"Gone with the Wind\" (1939) and Blanche DuBois in the film version of \"A Streetcar Named Desire\" (1951), a role she had also played on stage in London's West End in 1949.", "She also won a Tony Award for her work in the Broadway musical version of \"Tovarich\" (1963).", "After completing her drama school education, Leigh appeared in small roles in four films in 1935 and progressed to the role of heroine in \"Fire Over England\" (1937).", "Lauded for her beauty, Leigh felt that her physical attributes sometimes prevented her from being taken seriously as an actress.", "Despite her fame as a screen actress, Leigh was primarily a stage performer.", "During her 30-year career, she played roles ranging from the heroines of No\u00ebl Coward and George Bernard Shaw comedies to classic Shakespearean characters such as Ophelia, Cleopatra, Juliet, and Lady Macbeth.", "Later in life, she performed as a character actress in a few films.", "At the time, the public strongly identified Leigh with her second husband, Laurence Olivier, who was her spouse from 1940 to 1960." ] ], "gold": "There has been a 1939 film and 2008 musical entitled Gone with the Wind. In the film, Scarlett was played by British actress Vivien Leigh. Leigh won an Academy Award for Best Actress for her performance as Scarlett O'Hara in Gone with the Wind. In the musical, American actress Jill Paice played Scarlett.", "prediction 1": "In the 1939 American epic romance film Gone with the Wind, Scarlett O'Hara is played by English actress Vivien Leigh, and American actor Clark Gable plays the role. In the 2008 musical Gone with the Wind, Scarlett is played by June Ritchie, and in the 2012 American musical Gone With the Wind, Scarlett is played by Jill Paice.", "prediction 2": "Gone with the Wind is a 1939 American epic historical romance film, adapted from Margaret Mitchell's 1936 novel of the same name. It tells the story of Scarlett O'Hara, the strong-willed daughter of a Georgia plantation owner. The leading roles are played by Vivien Leigh as Scarlett, Clark Gable as Rhett, and Leslie Howard as Ashley. In the 2008 musical adaptation of Gone with the Wind, June Ritchie played Scarlett, and Jill Paice played Scarlett. Leigh played Scarlett in the 1970 musical adaptation of the Broadway musical version of Gone with the Wind by Harold Rome, starring June Ritchie as Scarlett.", "prediction 3": "In the 1939 American epic romantic romance film Gone with the Wind, Scarlett O'Hara is played by Vivien Leigh, Clark Gable, Ashley Wilkes, and Melanie Hamilton. In the 2008 musical version of Gone with the Wind, Scarlett is played by June Ritchie while In the 2002 film version, Scarlett is played by Darius Danesh. In the 2012 film version, Scarlett is played by Olivia De Havilland. In the 2013 film version, Scarlett is played by June Ritchie.", "prediction 4": "There are various versions of Gone with the Wind, including a 1939 film adaptation of Margaret Mitchell's 1936 novel of the same name. In the 1939 film version, Vivien Leigh played Scarlett O'Hara. In the 2008 musical version, Darius Danesh played Rhett Butler and Jill Paice played Scarlett. In the 1972 musical version, June Ritchie played Scarlett, and in the 2013 musical version, Olivia de Havilland played Melanie.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 252, "end": 256 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 165, "end": 240 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "In the 1939 American epic romance film Gone with the Wind, Scarlett O'Hara is played by English actress Vivien Leigh, and American actor Clark Gable plays the role. In the 2008 musical Gone with the Wind, Scarlett is played by Jill Paice. A musical adaptation by Harold Rome played a year at the Drury Lane Theatre in 1972 starring June Ritchie as Scarlett." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who scored the most goals in football career?", "passages": [ [ "S\u00e1ndor Kocsis", "During the 1952 season at Honv\u00e9d, Kocsis was the world's top goalscorer in world 1st division football with 36 goals.", "He repeated that feat in 1954 with 33 goals.", "Kocsis made his debut for the senior Hungary team in 1948.", "Together with Ferenc Pusk\u00e1s, Zolt\u00e1n Czibor, J\u00f3zsef Bozsik and N\u00e1ndor Hidegkuti, he formed the offensive nucleus of the Golden Team that went unbeaten for 32 consecutive games.", "The Hungarian national team suffered no defeats in Class-A international matches between 4 June 1950 and 4 July 1954, in the 1954 FIFA World Cup Final.", "Kocsis scored his first international hat trick in a game against Sweden on 20 November 1949, and he scored a further one on 22 June 1952 against Finland.", "Kocsis also scored six goals at the Olympics in Helsinki as Hungary became Olympic Champions in 1952.", "On 19 October 1952, he scored his third international hat trick in a game against Czechoslovakia.", "In 1953, Hungary defeated England 6\u20133 at Wembley Stadium and then in 1954 by 7\u20131 in Budapest.", "During the latter game, Kocsis added a further two goals.", "In 1953 Hungary also won the Central European International Cup.", "He finished the 1954 World Cup as top goalscorer, scoring 11 goals including two hat tricks." ], [ "Cristiano Ronaldo", "Cristiano Ronaldo\n\nCristiano Ronaldo dos Santos Aveiro (; born 5 February 1985) is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team.", "Often considered the best player in the world and regarded by many as one of the greatest players of all time, Ronaldo has a record-tying five Ballon d'Or awards, the most for a European player, and is the first player to win four European Golden Shoes.", "He has won 26 trophies in his career, including five league titles, five UEFA Champions League titles and one UEFA European Championship.", "A prolific goalscorer, Ronaldo holds the records for most official goals scored in Europe's top-five leagues (405), the UEFA Champions League (121), the UEFA European Championship (9), as well as those for most assists in the UEFA Champions League (34) and the UEFA European Championship (6).", "He has scored over 680 senior career goals for club and country.", "Born and raised on the Portuguese island of Madeira, Ronaldo was diagnosed with a racing heart at age 15.", "He underwent an operation to treat his condition, and began his senior club career playing for Sporting CP, before signing with Manchester United at age 18 in 2003." ], [ "2011 FIFA Women's World Cup squads", "Note: The caps and goals totals for many players on the squad differ dramatically between FIFA's squad list and the player list of the Canadian Soccer Association.", "For example, the FIFA list only credits Christine Sinclair with 43 goals, while the CSA credits Sinclair with 116.", "An examination of Sinclair's CSA matches page and CSA statistics page reveals that all of her CSA-credited caps were against full national teams, which means that all 116 goals should presumably be listed as full international goals.", "Examinations of several other players' CSA records indicate analogous results.", "Therefore, the CSA numbers are used in this list.", "Coach: Carolina Morace\n\nThe squad was named on 6 June.", "Coach:", "Bruno Bini\n\nCoach: Silvia Neid\n\nA pre-squad of 26 players was announced on 18 March.", "After Dzsenifer Marozs\u00e1n got injured in a training with the German national team, Conny Pohlers was called in to the squad.", "The line-up was officially reduced to 21 players on 27 May 2011.", "The final squad was announced on 14 June.", "Coach: Uche Eucharia\n\nThe squad was announced on 10 June 2011.", "Coach: Hope Powell\n\nThe squad was announced on 8 June 2011.", "Coach: Norio Sasaki\n\nCoach: Leonardo Cu\u00e9llar\n\nThe squad was announced on 8 June 2011." ] ], "gold": "Josef Bican has scored the most football goals in their career in history. Out of all the active players, Cristiano Ronaldo scored the most goals in his career with over 780 official senior career goals. Ali Daei of Iran has scored the most men's international goals in his career. He is the only player to score over 100 goals in international football with 109 goals. Christine Sinclair is the world's all-time leader for international goals scored for men or women with 187 goals, and is one of the most-capped active international footballers with 300 caps.", "prediction 1": "The player with the most goals in a football career is S\u00e1ndor Kocsis, with 36 in his first two seasons at Honv\u00e9d and 33 in his second season at Honv\u00e9d. Cristiano Ronaldo, a professional footballer from Portugal who plays as a forward for Italian club Juventus, also ranks highest in the world in terms of goals scored.", "prediction 2": "The player with the most goals scored in football career is S\u00e1ndor Kocsis, with 36 goals in 1952, and 33 goals in 1954. A prolific goalscorer, Cristiano Ronaldo holds the records for most goals scored in Europe's top-five leagues (405), the UEFA Champions League (121), the UEFA European Championship (9), as well as those for most assists in the UEFA Champions League (34) and the UEFA European Championship (61).", "prediction 3": "The player with the most goals in his career is S\u00e1ndor Kocsis, with 36 in his career and 33 in 1954. Cristiano Ronaldo is a Portuguese professional footballer who plays as a forward for Italian club Juventus and captains the Portugal national team.", "prediction 4": "In a career, S\u00e1ndor Kocsis is the goal scorer with the most goals scored, with 36, in 1952 and 33 goals in 1954. Cristiano Ronaldo is the goal scorer with the most goals scored, with 680 senior career goals for club and country.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Cristiano Ronaldo ranks highest in the world in terms of goals scored. He has scored over 680 senior career goals." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who won the french open women's tennis?", "passages": [ [ "2017 French Open \u2013 Women's Singles", "2017 French Open \u2013 Women's Singles\n\nGarbi\u00f1e Muguruza was the defending champion, having won the tournament in 2016, but she was defeated in the fourth round by Kristina Mladenovic.", "This was the first time at the French Open since 1977, and any Grand Slam event since the 1979 Australian Open that no former Grand Slam champion have reached the quarterfinals.", "Je\u013cena Ostapenko won the title, defeating Simona Halep in the final, 4\u20136, 6\u20134, 6\u20133.", "This was Ostapenko's first WTA Tour-level singles title.", "She became the first Latvian player, male or female, to win a Grand Slam singles tournament, the youngest woman to win the French Open since 1997, and the first woman since Barbara Jordan at the aforementioned 1979 Australian Open to win a Grand Slam event as her first tour-level singles title.", "Ostapenko was the first unseeded woman to win the French Open since 1933, as well as the lowest-ranked (47) since computer rankings began in 1975.", "As a result of Halep's loss in the final, Angelique Kerber retained the WTA no. 1 singles ranking even though she lost in the first round." ], [ "French Open", "French Open\n\nThe French Open (), also called Roland-Garros (), is a major tennis tournament held over two weeks between late May and early June at the Stade Roland-Garros in Paris, France.", "The venue is named after the French aviator Roland Garros.", "It is the premier clay court tennis championship event in the world and the second of four annual Grand Slam tournaments, the other three being the Australian Open, Wimbledon and the US Open.", "The French Open is currently the only Grand Slam event held on clay, and it is the zenith of the spring clay court season.", "Because of the seven rounds needed for a championship, the slow-playing surface and the best-of-five-set men's singles matches (without a tiebreak in the final set), the event is widely considered to be the most physically demanding tennis tournament in the world.", "Officially named in French \"Championnats Internationaux de France de tennis\" and \"Tournoi de Roland-Garros\" (the \"French International Championships of Tennis\" or \"Roland Garros Tournament\" in English), the tournament is referred to in English as the \"French Open\" and alternatively as \"Roland Garros\", which is the designation used by the tournament itself in all languages." ], [ "French Open", "French spelling rules dictate that in the name of a place or event named after a person, the elements of the name are joined together with a hyphen.", "Therefore, the names of the stadium and the tournament are hyphenated as \"Roland-Garros\".", "In 1891 the Championnat de France, which is commonly referred to in English as the French Championships, began.", "They were only open to tennis players who were members of French clubs.", "The first winner was a Briton\u2014H. Briggs\u2014who was a Paris resident.", "The first women's singles tournament, with four entries, was held in 1897.", "The mixed doubles event was added in 1902 and the women's doubles in 1907.", "This \"French club members only\" tournament was played until 1924, using four different venues during that period:\n\n\nAnother tournament, the World Hard Court Championships, is sometimes considered the precursor to the French Open as it was open to international competitors.", "It was held on clay courts at Stade Fran\u00e7ais in Saint-Cloud from 1912 to 1914, then, after World War I, was contested there again in 1920, 1921 and 1923, with the 1922 tournament held at Brussels, Belgium.", "Winners of this tournament included world No. 1's such as Tony Wilding from New Zealand (1913, 1914) and Bill Tilden from the US (1921)." ] ], "gold": "The French Open is an annual major tennis tournament that is held in Paris, France which has included a women's singles tournament since 1897, and a women's doubles tournament since 1907. There have been many champions over the years. Jelena Ostapenko won the women's singles tournament in 2017, Garbine Muguruza won in 2016, and Serena Williams won in 2015. Bethanie Mattek-Sands and Lucie Safarova won the women's doubles in both 2015 and 2017, while Caroline Garcia and Kristina Mladenovic were the champions in 2016.", "prediction 1": "The 2017 French Open, also called Roland-Garros, was won by Jeena Ostapenko, defeating Simona Halep in the final, 4\u20136, 6\u20134, 6\u20133. This was Ostapenko's first WTA Tour-level singles title.", "prediction 2": "The French Open is an annual tennis championship held over two weeks in Paris. In 2017, Jeena Ostapenko won the title, defeating Simona Halep in the final, 4\u20136, 6\u20134, 6\u20133. This was Ostapenko's first WTA Tour-level singles title, and she became the first Latvian player, male or female, to win a Grand Slam singles tournament.", "prediction 3": "The French Open is a major tennis tournament held over two weeks between late May and early June at the Stade Roland-Garros in Paris, France. In 2017, Jeena Ostapenko won the title, defeating Simona Halep in the final, 4\u20136, 6\u20134, 6\u20133. This was Ostapenko's first WTA Tour-level singles title.", "prediction 4": "The French Open is a tennis tournament held over two weeks between late May and early June at the Stade Roland-Garros in Paris, France. In 2017, Jeena Ostapenko won the title, defeating Simona Halep in the final, 4\u20136, 6\u20134, 6\u20133. This was Ostapenko's first WTA Tour-level singles title.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 170 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "The French Open, also called Roland-Garros, is a major tennis tournament held at Paris, France. The first women's singles tournament was held in 1897 and the women's doubles in 1907. The 2017 French Open singles was won by Je\u013cena Ostapenko." }, "preference": [ 2, 2, 2, 1, 1, 0 ] }, { "question": "What kind of car is a chevy malibu?", "passages": [ [ "Chevrolet Malibu", "Chevrolet Malibu\n\nThe Chevrolet Malibu is a mid-size car manufactured and marketed by Chevrolet from 1964 to 1983 and since 1997.", "The Malibu began as a trim-level of the Chevrolet Chevelle, becoming its own model line in 1978.", "Originally a rear-wheel-drive intermediate, GM revived the Malibu nameplate as a front-wheel-drive car in 1997.", "Named after coastal community of Malibu, California, the Malibu was marketed primarily in North America, with the eighth generation introduced globally.", "The first Malibu was a top-line subseries of the mid-sized Chevrolet Chevelle from 1964 to 1972.", "Malibus were generally available in a full range of bodystyles including a four-door sedan, two-door Sport Coupe hardtop, convertible and two-seat station wagon.", "Interiors were more lavish than lesser Chevelle 300 and 300 Deluxe models thanks to patterned cloth and vinyl upholstery (all-vinyl in convertibles and station wagons), deep-twist carpeting, deluxe steering wheel and other items.", "The Malibu SS was available only as a two-door Sport Coupe hardtop or convertible and added bucket seats, center console (with optional four-speed manual or Powerglide transmissions), engine gauges and special wheelcovers, and offered with any six-cylinder or V8 engine offered in other Chevelles - with the top option being a in 1964." ], [ "Chevrolet Malibu", "For the 1978 model year, the Malibu name, which had been the bestselling badge in the lineup, replaced the Chevelle name.", "This was Chevrolet's second downsized nameplate, following the lead of the 1977 Chevrolet Caprice.", "The new, more efficient platform was over a foot shorter and had shed compared to previous versions, yet offered increased trunk space, leg room, and head room.", "Only two trim levels were offered - Malibu and Malibu Classic.", "The Malibu Classic Landau series had a two-tone paint job on the upper and lower body sections, and a vinyl top.", "This generation introduced the Chevrolet 90\u00b0 V6 family of engines, with the 200 CID (3.3\u00a0L) V6 as the base engine for the all new 1978 Chevrolet Malibu, along with the 229 CID (3.8\u00a0L) V6 and the 305 CID (5.0\u00a0L) Chevy built V8 as options.", "The 200 and 229 engines were essentially a small block V-8, with one pair of cylinders lopped off.", "The front and rear bellhousing face were the same as the small V8.", "The 231 engine was a Buick product, and featured a front distributor.", "Three bodystyles were produced (station wagon, sedan, and coupe), and the design was also used as the basis for the El Camino pickup truck with its own chassis." ], [ "Chevrolet Chevy Malibu", "Chevrolet Chevy Malibu\n\nThe Chevrolet Chevy Malibu was a compact car made by Chevrolet in Argentina from 1968 to 1982.", "Successor to the Chevrolet 400, the Chevy Malibu offered a more modern body style with better safety features and updated mechanicals.", "The car was based on the U.S. market 1968 Chevy II Nova.", "Only the 4-door sedan version was manufactured in the country, although U.S. versions included a two door coupe in addition to the sedan.", "Although the Chevy 400 sold well in the Argentine market, General Motors decided on offering an updated model with more modern styling and up-to-date mechanicals.", "The Chevy 400 was based on the 1962 Chevy II, and by 1968, was already out of date.", "While the equivalent U.S. Market Chevy Nova featured changes in safety and emissions equipment during its relatively short 1968-1974 run (it had a total restyle for 1975), the Argentina version retained the 1968 car's features throughout its entire run, including a dash-mounted ignition switch and smaller side marker lights." ] ], "gold": "There have been many versions, or generations, of the Chevrolet Malibu since the introduction of the mid-size car in 1964. Before 1997, the Chevy Malibu came with Rear Wheel Drive, but has had Front Wheel Drive since 1997. The Malibu has been available with a 4-door sedan body style for many years.", "prediction 1": "The Chevrolet Malibu is a mid-size car manufactured and marketed by Chevrolet from 1964 to 1983 and since 1997. The first Malibu was a top-line subseries of the mid-sized Chevrolet Chevelle from 1964 to 1972. The second Malibu was a compact car made by Chevrolet in Argentina from 1968 to 1982.\n", "prediction 2": "The Chevrolet Malibu is a mid-size car manufactured and marketed by Chevrolet from 1964 to 1983, and since 1997. The Malibu began as a trim-level of the Chevrolet Chevelle, becoming its own model line in 1978, and was available in a full range of bodystyles including a four-door sedan, two-door Sport Coupe hardtop, convertible and two-seat station wagon. The Chevrolet Chevy Malibu was a compact car made by Chevrolet in Argentina from 1968 to 1982. The first Malibu was a top-line subseries of the mid-sized Chevy Chevelle, and eventually became its own model line in 1997.", "prediction 3": "The Chevrolet Malibu is a mid-size car manufactured and marketed by Chevrolet from 1964 to 1983 and since 1997. It began as a trim-level of the Chevrolet Chevelle, becoming its own model line in 1978. Chevrolet also produced the Chevy Chevy Malibu in Argentina from 1968 to 1982. It had a more modern design with better safety features and updated mechanicals. In 2007 the new Chevrolet Malibu was introduced globally.", "prediction 4": "The Chevrolet Malibu is a mid-size car manufactured and marketed by Chevrolet from 1964 to 1983 and since 1997. The first Malibu was a top-line subseries of the mid-sized Chevrolet Chevelle from 1964 to 1972. It was a successor to the Chevy 400 in Argentina, and it was sold well in the country except that only the four-door sedan version was manufactured, but that year the number two-door sedan was discontinued.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 295 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 213, "end": 226 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Chevrolet Malibu is a mid-size car manufactured by Chevrolet from 1964 to 1983 and since 1997. The first Malibu was a top-line subseries of the mid-sized Chevrolet Chevelle. It was originally a rear-wheel-drive intermediate, but became a front-wheel-drive car in 1997. The Malibus were generally available in a full range of bodystyles including a four-door sedan, two-door Sport Coupe hardtop, convertible and two-seat station wagon. The Malibu SS was available only as a two-door Sport Coupe hardtop or convertible and added bucket seats, center console (with optional four-speed manual or Powerglide transmissions), engine gauges and special wheelcovers, and offered with any six-cylinder or V8 engine offered in other Chevelles - with the top option being a in 1964. The Chevy Malibu was a compact car. Only the 4-door sedan version was manufactured in the country, although U.S. versions included a two door coupe in addition to the sedan." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who is winner of womens world cup 2017?", "passages": [ [ "2017 Women's Rugby World Cup Final", "2017 Women's Rugby World Cup Final\n\nThe 2017 Women's Rugby World Cup Final was a rugby union match to determine the winner of the 2017 Women's Rugby World Cup, played between reigning champions England and New Zealand on 26 August 2017 at Kingspan Stadium in Belfast.", "New Zealand won the Rugby World Cup for a record fifth time, beating England 41\u201332.", "England was the only team in the competition to be made up of professional rugby players, whereas New Zealand had just six players contracted.", "New Zealand was placed in Pool A with Canada, Hong Kong and Wales in arguably the competitions toughest group.", "England was in Pool B alongside USA, Spain and Italy.", "On 10 August England played their first game of the tournament against Spain and ran in ten tries, including a hat-trick to Kay Wilson, to record a 56\u20135 victory.", "New Zealand played Wales the same day and led 20\u20130 at half time before extending the final margin to 44\u201312, with Selica Winiata scoring a hat-trick of her own.", "New Zealand continued their dominance with a 121\u20130 thrashing of Hong Kong in their next game.", "They scored 19 tries in total, with eight of them coming from winger Portia Woodman.", "England's second match saw them score the same number of tries and points as their first one as they downed Italy 56\u201313." ], [ "2017 Women's Cricket World Cup", "2017 Women's Cricket World Cup\n\nThe 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017.", "It was the eleventh edition of the Women's Cricket World Cup, and the third to be held in England (after the 1973 and 1993 tournaments).", "The 2017 World Cup was the first in which all participating players were fully professional.", "Eight teams qualified to participate in the tournament.", "England won the final against India at Lord's on 23 July by 9 runs.", "The 2014\u201316 ICC Women's Championship, featuring the top eight ranked teams in women's cricket, was the first phase of qualifying for the World Cup, with the top four teams qualifying automatically.", "The remaining four places were decided at the 2017 World Cup Qualifier, a ten-team event that was held in Sri Lanka in February 2017.", "This featured the bottom four teams from the ICC Women's Championship and six other teams.", "On 8 February 2016, the International Cricket Council (ICC) announced the five venues for the 2017 Women's World Cup.", "Lord's hosted the final, and other matches were played at the home grounds of Derbyshire, Leicestershire, Somerset and Gloucestershire.", "The captains of each team were announced on 21 April 2017, with the full squads named shortly after." ], [ "2017 ITTF Women's World Cup", "2017 ITTF Women's World Cup\n\nThe 2017 ITTF Women's World Cup was a table tennis competition held in Markham, Ontario, from 27 to 29 October 2017.", "It was the 21st edition of the ITTF-sanctioned event, and the first time that it had been staged in Canada.", "In the final, China's Zhu Yuling defeated fellow Chinese player Liu Shiwen, 4\u20133, to win her first World Cup title.", "The following list of players was confirmed on 2 October 2017, based on the qualification system set by the ITTF.", "The tournament consisted of two stages: a preliminary group stage and a knockout stage.", "The players seeded 9 to 20 were drawn into four groups, with three players in each group.", "The top two players from each group then joined the top eight seeded players in the second stage of the competition, which consisted of a knockout draw.", "The seeding list was based on the official ITTF world ranking for October 2017.", "The preliminary group stage took place on 27 October, with the top two players in each group progressing to the main draw.", "The knockout stage took place from 28\u201329 October." ] ], "gold": "The 2017 ITTF Women's World Cup was a table tennis competition held in Markham, Ontario, in October 2017, in which Cheng I-ching won the bronze medal, Liu Shiwen won the silver medal, and Zhu Yuling won the gold medal. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from June 24 to July 23, 2017, where eight teams qualified to participate in the tournament and England won the final by 9 runs. The 2017 Women's Rugby World Cup Final was played between reigning champions England and New Zealand on August 26, 2017 at Kingspan Stadium in Belfast, where New Zealand won the title for a record fifth time, beating England 41\u201332.", "prediction 1": "The 2017 Women's Rugby World Cup was a rugby union match to determine the winner of the 2017 Women's Rugby World Cup, played between reigning champions England and New Zealand on 26 August 2017 at Kingspan Stadium in Belfast. New Zealand won the Rugby World Cup for a record fifth time, beating England 41\u201332. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017.", "prediction 2": "The 2017 ISAF World Table Tennis Championship was a table tennis competition held in Markham, Ontario, Canada, from 27 to 29 October 2017. In the final, China's Zhu Yuling defeated fellow Chinese player Liu Shiwen, 4\u20133, to win her first World Cup title. In the 2017 Women's Rugby World Cup Final, a rugby union match to determine the winner of the Women's Rugby World Cup, played between reigning champions England and New Zealand on 26 August 2017 at Kingspan Stadium in Belfast.", "prediction 3": "The 2017 Women's Rugby World Cup was a rugby union match to determine the winner of the 2017 Women's Rugby World Cup, played between reigning champions England and New Zealand on 26 August 2017 at Kingspan Stadium in Belfast. The 2017 ITTF Women's World Cup was a table tennis competition held in Markham, Ontario, from 27 to 29 October 2017. In the final, China's Zhu Yuling defeated fellow Chinese player Liu Shiwen, 4\u20133, to win her first World Cup title.", "prediction 4": "The 2017 Women's Rugby World Cup was a rugby union match to determine the winner of the 2017 Women's Rugby World Cup. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017. The winner of the 2017 ITTF Women's World Cup was China's Zhu Yuling, who defeated fellow Chinese player Liu Shiwen, 4\u20133, to win her first World Cup title.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 117 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2017 ITTF Women's World Cup was a table tennis competition held in Markham, Ontario, in October 2017. In the final, Liu Shiwen won the silver medal, and Zhu Yuling won the gold medal. The 2017 Women's Cricket World Cup was an international women's cricket tournament that took place in England from 24 June to 23 July 2017, where eight teams qualified to participate in the tournament and England won the final by 9 runs. The 2017 Women's Rugby World Cup Final was played between reigning champions England and New Zealand on 26 August 2017 at Kingspan Stadium in Belfast. New Zealand won the Rugby World Cup for a record fifth time, beating England 41\u201332. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What was the last episode of into the badlands?", "passages": [ [ "Into the Badlands (TV series)", "Into the Badlands (TV series)\n\nInto the Badlands is an American television series that premiered on November 15, 2015 on AMC.", "The series follows a warrior and a young boy who journey through a dangerous feudal land together seeking enlightenment.", "AMC renewed the show for a 10-episode second season, which premiered on March 19, 2017.", "On April 25, 2017, AMC renewed the series for a 16-episode third season, which premiered on April 22, 2018, while by late September of 2018, the series was still in limbo on airing the final half of the season's episodes.", "Opening introduction, narrated by M.K. (Aramis Knight):\n", "The series is set in a post-apocalyptic world approximately 500 years after a war that left civilization in ruins.", "Many elements of technology, such as electricity and ground vehicles, have survived the apocalypse but society now shuns guns, leading to a reliance on melee weaponry and cross-bows.", "In a territory known as the Badlands, the former state of Oklahoma, a feudal society has developed to fill the power vacuum left by the war.", "Barons control land and monopolies over commodities like opium and fuel, trading amongst themselves to maintain the peace.", "Each baron is served by a massive workforce of slaves called cogs, as well as a prostitute class called dolls." ] ], "gold": "Into the Badlands is an American television series that premiered on November 15, 2015, on AMC, and was canceled after three seasons. The series finale was titled \"Seven Strike as One\" and aired on May 6, 2019. It was in season 3, episode 16, which was episode 32 of the whole series.", "prediction 1": "In the third season, there were three episodes. The last episode, \"Into the Badlands: The Last Ship\", was on April 22, 2018.", "prediction 2": "The last episode of the third season of Into the Badlands is a special episode titled The Last Episode. The series follows a warrior and a young boy who journey through a dangerous feudal land together seeking enlightenment. The last episode of season one was titled The Last Episode, while the last episode of season two was titled The Last Episode.", "prediction 3": "The last episode of Into the Badlands was Episode 16 of the third season, which premiered on May 20, 2019.", "prediction 4": "The last episode of Into the Badlands was episode 3: The Battle for the Badlands. The Battle for the Badlands was episode 66.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 0, "end": 47 }, { "error type": "Unverifiable", "explanation": "", "start": 48, "end": 124 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Into the Badlands is an American television series that premiered on November 15, 2015, on AMC." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "How many times the word ilm come in the holy quran?", "passages": [ [ "Ilm (Arabic)", "Ilm (Arabic)\n\n\u2018Ilm ( \"knowledge\") is the Islamic term for knowledge.", "According to the Oxford English Dictionary, the word knowledge refers to \"Facts, information, and skills acquired through experience or education; the theoretical or practical understanding of a subject.\"", "Knowledge in the Western world means information about something, divine or corporeal, while In Islamic point of view 'ilm is an all-embracing term covering theory, action and education, it is not confined to the acquisition of knowledge only, but also embraces socio-political and moral aspects.it requires insight, commitment to the goals of Islam and for the believers to act upon their belief.", "Also it is reported in hadith that \"Knowledge is not extensive learning.", "Rather, it is a light that God casts in the heart of whomever He wills.\"", "In other words, humans have to think about the universe with reason and intellect, a faculty bestowed us by Allah.", "Since that there is more insistence on the faculty of intellect among Shia, even evaluating the claims of someone who claims prophecy is on the shoulder of intellect.", "In the Qur'an the word 'alim has occurred in 140 places, while al-'ilm in 27.", "In all, the total number of verses in which 'ilm or its derivatives and associated words are used is 704." ] ], "gold": "Ilm, the Arabic term for knowledge, and its different variations appear a total of 704 times in the Holy Quran. In particular, the form of 'alim appears 140 times, and al-'ilm does so 27 times.", "prediction 1": "Ilm is the Islamic term for knowledge. According to the Oxford English Dictionary, the word knowledge refers to \"Facts, information, and skills acquired through experience or education; the theoretical or practical understanding of a subject.\" However, from an Islamic point of view ilm is an all-embracing term covering theory, action and education, it is not confined to the acquisition of knowledge only, but also embraces socio-political and moral aspects. Also, it is reported in hadith that \"Knowledge is not extensive learning. Rather, it is a light that God casts in the heart of whomever He wills.\"", "prediction 2": "In the holy Quran the word Ilm comes in 140 places. Al-'ilm comes in 27. In all, the total number of verses in which 'ilm or its derivatives and associated words are used is 704.", "prediction 3": "Ilm is the Islamic term for knowledge. According to the Oxford English Dictionary, the word knowledge refers to \"Facts, information, and skills acquired through experience or education; the theoretical or practical understanding of a subject.\" In the Holy Qur'an, the word 'alim has occurred in 140 places, while al-'ilm in 27. In all, the total number of verses in which 'ilm or its derivatives and associated words are used is 704.", "prediction 4": "In the Qur'an, the word 'ilm has occurred in 144 places, while al-'ilm has occurred in 27. In all, the total number of verses in which 'ilm or its derivatives and associated words are used is 704.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 460 }, { "error type": "Irrelevant", "explanation": "", "start": 461, "end": 534 }, { "error type": "Irrelevant", "explanation": "", "start": 535, "end": 607 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Ilm is the Islamic term for knowledge. In the Qur'an the word 'alim has occurred in 140 places, while al-'ilm in 27. In all, the total number of verses in which 'ilm or its derivatives and associated words are used is 704." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "Where do the la rams play their home football games?", "passages": [ [ "History of the Los Angeles Rams", "Until the Los Angeles Stadium at Hollywood Park has finished construction and is ready for use, the Rams are playing their home games at the Los Angeles Memorial Coliseum, which had been home to the team for 33 seasons (1946\u20131979), and is currently also the home of the USC Trojans college football team.", "The Rams' return to Los Angeles is also being used to help expand the league's presence around the globe.", "In 2016, the Rams faced the New York Giants in London at Twickenham Stadium, as part of the NFL's International Series.", "The Rams are also expected to play a game in China in time for the 2018 NFL season.", "Kevin Demoff, the team's Executive Vice President of Football Operations/Chief Operating Officer, told \"The Guardian\" that he sees L.A. as a gateway to Asia and says being in L.A. will help sell the brand, more so, than in St. Louis.", "On February 4, 2016, the Los Angeles Rams selected Oxnard, California to be the site of their minicamp, offseason team activities, and offseason program that began on April 18.", "In March, it was announced that the Rams would be featured on HBO's \"Hard Knocks\"." ], [ "History of the Los Angeles Rams", "History of the Los Angeles Rams\n\nThe Los Angeles Rams are a professional American football team that play in the National Football League (NFL).", "The Rams franchise was founded in 1936 as the Cleveland Rams in the short-lived second American Football League before joining the NFL the next year.", "In 1946, the franchise moved to Los Angeles.", "The Rams franchise remained in the metro area until 1994, when they moved to St. Louis, and were known as the St. Louis Rams from 1995 to 2015.", "The Rams franchise returned to Los Angeles in 2016.", "This article chronicles the franchise's history during their time in Los Angeles, from playing at the Los Angeles Memorial Coliseum between 1946 and 1979, to playing at Anaheim Stadium (now known as Angel Stadium of Anaheim) in Anaheim from 1980 to 1994, and its return to Southern California beginning with the season.", "On January 12, 1946, Dan Reeves was denied a request by the other National Football League (NFL) owners to move his team, the Cleveland Rams to Los Angeles and the then-103,000-seat Los Angeles Memorial Coliseum.", "Reeves threatened to end his relationship with the NFL and get out of the professional football business altogether unless the Rams transfer to Los Angeles was permitted.", "A settlement was reached and, as a result, Reeves was allowed to move his team to Los Angeles." ], [ "Los Angeles Rams", "Los Angeles Rams\n\nThe Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area.", "The Rams compete in the National Football League (NFL), as a member club of the league's National Football Conference (NFC) West division.", "The Rams franchise has won three NFL championships and is the only franchise to win championships while representing three different cities (Cleveland in 1945, Los Angeles in 1951, and St. Louis in 1999).", "The Rams play their home games at the Los Angeles Memorial Coliseum in Los Angeles, California.", "The franchise began in 1936 as the Cleveland Rams, located in Cleveland, Ohio.", "The club was owned by Homer Marshman and featured players such as William \"Bud\" Cooper, Harry \"The Horse\" Mattos, Stan Pincura, and Mike Sebastian.", "Damon \"Buzz\" Wetzel joined as general manager.", "After winning the 1945 NFL Championship Game, the franchise moved to Los Angeles, California in 1946, making way for Paul Brown's Cleveland Browns of the All-America Football Conference and becoming the only NFL championship team to play the following season in another city.", "The club played their home games at the Los Angeles Memorial Coliseum before moving into a reconstructed Anaheim Stadium in nearby Anaheim in 1980.", "After the 1994 NFL season, the Rams left California and moved east to St. Louis, Missouri." ] ], "gold": "The Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area. They compete in the NFL as a member of the NFC West division, and currently play their home games at SoFi Stadium in Inglewood, which they share with the Los Angeles Chargers. During both 2016 and 2017 seasons, they played their home games at the Los Angeles Memorial Coliseum, which they used until the SoFi Stadium was completed. There was also a period in between 1980 and 1994 when they played at Anaheim Stadium.", "prediction 1": "The Los Angeles Rams are a professional American football team that play in the National Football League. The team began playing in Los Angeles in 1936 as the Cleveland Rams in the short-lived second American Football League before joining the NFL the next year. The team played at the Los Angeles Memorial Coliseum between 1946 and 1979 before moving to a reconstructed Anaheim Stadium in nearby Anaheim in 1980.", "prediction 2": "The Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area and play in the National Football League. Until the Los Angeles Stadium at Hollywood Park has finished construction and is ready for use, the Rams are playing their home games at the Los Angeles Memorial Coliseum, which had been home to the team for 33 seasons (1946\u20131979), and is currently also the home of the USC Trojans college football team. The team's return to Los Angeles is also being used to help expand the league's presence around the globe. In 2016, the Rams faced the New York Giants in London at Twickenham Stadium, as part of the NFL's International Series. The Rams franchise remained in the metro area until 1994, when they moved to St. Louis, and were known as the St. Louis Rams from 1995 to 2015. The team returned to Los Angeles in 2016.", "prediction 3": "The Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area that play in the National Football League (NFL). They began playing in Los Angeles in 1936 as the Cleveland Rams in the short-lived second American Football League before joining the NFL the next year. After Dan Reeves was denied a request by the other National Football League (NFL) owners to move his team, the Cleveland Rams to Los Angeles and the then-103,000-seat Los Angeles Memorial Coliseum, the team returned to Los Angeles in 2016.", "prediction 4": "The Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area. Their home games are played at the Los Angeles Memorial Coliseum. The team has played at the Coliseum since 1946, during which time they had played at the Los Angeles Memorial Coliseum from 1946 to 1979. They also had played at Anaheim Stadium from 1980 to 1994, and in 2017 they returned to the Los Angeles Memorial Coliseum.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 262 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Los Angeles Rams are a professional American football team based in the Los Angeles metropolitan area. They compete in the NFL as a member of the NFC West division. The team played at the Los Angeles Memorial Coliseum between 1946 and 1979 before moving to a reconstructed Anaheim Stadium in nearby Anaheim from 1980 to 1994." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "What is the west bank and gaza strip?", "passages": [ [ "West Bank", "West Bank\n\nThe West Bank ( '; ' or \"\") is a landlocked territory near the Mediterranean coast of Western Asia, bordered by Jordan to the east and by the Green Line separating it and Israel on the south, west and north.", "The West Bank also contains a significant section of the western Dead Sea shore.", "The West Bank has been under Israeli occupation since the 1967 Six-Day War.", "The Oslo Accords, signed between the Palestine Liberation Organization and Israel, created administrative districts with varying levels of Palestinian autonomy within each area.", "Area C, in which Israel maintained complete civil and security control, accounts for over 60% of the territory of the West Bank.", "The West Bank, including East Jerusalem, has a land area of 5,640\u00a0km plus a water area of 220\u00a0km, consisting of the northwest quarter of the Dead Sea.", "it has an estimated population of 2,747,943 Palestinians, and approximately 391,000 Israeli settlers, and approximately another 201,200 Israeli settlers in East Jerusalem.", "The international community considers Israeli settlements in the West Bank, including East Jerusalem, illegal under international law, though Israel disputes this." ], [ "Gaza Strip", "Gaza Strip\n\nThe Gaza Strip (; ' ), or simply Gaza\"', is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, that borders Egypt on the southwest for and Israel on the east and north along a border.", "Gaza and the West Bank are claimed by the State of Palestine.", "The territories of Gaza and the West Bank are separated from each other by Israeli territory.", "Both fell under the jurisdiction of the Palestinian Authority, but Gaza has since June 2007 been governed by Hamas, a Palestinian Islamic organization which came to power in free elections in 2006.", "It has been placed under an Israeli and U.S.-led international economic and political boycott from that time onwards.", "The territory is long, and from wide, with a total area of .", "With around 1.85 million Palestinians on some 362 square kilometers, Gaza ranks as the 3rd most densely populated polity in the world.", "An extensive Israeli buffer zone within the Strip renders much land off-limits to Gaza's Palestinians.", "Gaza has an annual population growth rate of 2.91% (2014 est. )", ", the 13th highest in the world, and is often referred to as overcrowded.", "The population is expected to increase to 2.1 million in 2020.", "By that time, Gaza may be rendered unliveable, if present trends continue." ] ], "gold": "The West Bank is a landlocked territory near the Mediterranean coast of Western Asia, bordered by Jordan to the east and by the Green Line separating it and Israel on the south, west and north. The site has been occupied by Israel since 1967, and both it and the Gaza Strip, a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, are claimed by the only \"de jure\" sovereign State of Palestine.", "prediction 1": "The West Bank is a landlocked territory near the Mediterranean coast of Western Asia, bordered by Jordan to the east and by the Green Line separating it from Israel on the south, west and north. The Gaza Strip is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, that borders Egypt on the southwest for and Israel on the east and north along a border. The territories of Gaza and the West Bank are separated from each other by Israeli territory.", "prediction 2": "The West Bank is a landlocked territory near the Mediterranean coast of Western Asia that borders Jordan to the east and the Green Line that separates it from Israel on the south, west and north. The Gaza Strip is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, that borders Egypt on the southwest for and Israel on the east and north along a border. Both Gaza and the West Bank are claimed by the State of Palestine. The territories of Gaza and the West Bank are separated from each other by Israeli territory.", "prediction 3": "The West Bank is a landlocked territory near the Mediterranean coast of Western Asia, bordered by Jordan to the east and by the Green Line separating it and Israel on the south, west and north. The Gaza Strip is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, that borders Egypt on the southwest for and Israel on the east and north along a border.", "prediction 4": "The West Bank and the Gaza Strip are a part of the Palestinian State of Palestine. The territories are separated by the Green Line, which runs between them. The West Bank is a landlocked territory near the Mediterranean coast of Western Asia bordered by Jordan to the east and by the Green Line separating it and Israel on the south, west and north. The Gaza Strip is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea, bordering Egypt on the southwest for and Israel on the east and north along a border.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 388, "end": 481 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 387 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The West Bank is a landlocked territory near the Mediterranean coast of Western Asia, bordered by Jordan to the east and by the Green Line separating it from Israel on the south, west and north. The West Bank has been under Israeli occupation since the 1967. The Gaza Strip is a self-governing Palestinian territory on the eastern coast of the Mediterranean Sea. Gaza and the West Bank are claimed by the State of Palestine." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "What's the infant mortality rate in the united states?", "passages": [ [ "Maternal Mortality and Morbidity Task Force", "Maternal Mortality and Morbidity Task Force\n\nThe Maternal Mortality and Morbidity Task Force was started by the Department of State in 2013 to help reduce maternal death in Texas.", "The task force and DSHS must submit a joint report on the findings of the task force and recommendations to the governor, lieutenant governor, speaker of the House of Representatives, and appropriate committees of the Texas Legislature by September 1 of each even-numbered year, beginning September 1, 2016.", "The maternal mortality ratio (MMR) for the state of Texas was concluded to be the highest in the developed world in 2016, with the maternal mortality rate (MMRate) of the state surging beyond the poor MMRate of 48 states of the US (excluding California and Texas) at 23.8% to a remarkably high 35.8%.", "In the United States the maternal mortality ratio rose during the years 2002-2015.", "Although improvements in health care facilitated a dramatic decline in maternal mortality worldwide during the 20th century, women still die from complications of pregnancy, though there are significant differences in the top causes per region and income class.", "Since 1990 the World Health Organization measures both the maternal mortality ratio and the maternal mortality rate.", "In 1994 the period of measurement for a \"maternal-related death\" after childbirth was extended from six weeks to a year after the \"birth event\"." ], [ "Health care in the United States", "Life expectancy at birth for a child born in the U.S. in 2015 is 81.2 (females) or 76.3 (males) years, compared to 79.9 (females) or 74 (males) years (AMRO regional estimates).", "Globally, average life expectancy is 73.8 for females and 69.1 for males born in 2015.", "The 2015 global average for under-five child mortality was 42.5 per 1000 live births.", "The U.S.\u2019s under-five child mortality of 6.5 is more than 6 times less.", "The 2015 global average for maternal mortality was 216, the United State\u2019s average of 14 maternal deaths 100,000 live births is more than 15 times less, however Canada had half as many (7) and Finland, Greece, Iceland and Poland each only had 3.", "While not as high in 2015 (14) as in 2013 (18.5), maternal deaths related to childbirth have shown recent increases; in 1987, the mortality ratio was 7.2 per 100,000.", "As of 2015, the American rate is double the maternal mortality rate in Belgium or Canada, and more than triple the rate in the Finland as well as several other Western European countries." ] ], "gold": "The total number reported for the US infant mortality rate can differ from year to year and is reported by different organizations. According to the CIA World Factbook, the infant mortality rate in both 2016 and 2017 was 5.8. The World Bank, another organization that reports the infant mortality rate, reported that, in 2018, the US infant mortality rate was 6.5.", "prediction 1": "The infant mortality rate in the United States is 7.2 per 100,000 live births. As of 2015, it was 6.2 per 100,000 live births.", "prediction 2": "The infant mortality rate in the United States is currently 6.3 per 100,000 live births. The state of Texas has the highest infant mortality rate in the United States.", "prediction 3": "The United States has a high infant mortality rate of 6.5 per 100,000 live births, which is more than 6 times less than the global average of 42.5. As of 2015, the infant mortality rate in the US was 7.2 per 100,000 live births, as of 2015, it was 12.8 per 100,000 live births.", "prediction 4": "The infant mortality rate in the United States is 7.2 per 100,000 live births, the same as in 1987. The maternal mortality ratio in Texas was a record high of 35.8% in 2016 and the infant mortality rate in 2015 was 6.5 per 100,000 live births, the same as the international average of 42.5 per 1000 live births.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 79, "end": 126 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The infant mortality rate in the United States is 7.2 per 100,000 live births in 1987. " }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who are the democratic candidates running for governor in kansas?", "passages": [ [ "2010 Kansas gubernatorial election", "2010 Kansas gubernatorial election\n\nThe 2010 Kansas gubernatorial election was held on November 2, 2010.", "Incumbent Governor Mark Parkinson, who assumed office when previous Governor Kathleen Sebelius was sworn in as the United States Secretary of Health and Human Services on April 28, 2009, declined to seek election to a full term.", "United States Senator Sam Brownback, who unsuccessfully ran for president in 2008, emerged as the Republican nominee, facing off against Democratic State Senator Tom Holland, who was unopposed for his party's nomination.", "Owing to the large amount of popularity that he had accumulated during his tenure in the United States Senate, Brownback defeated Holland in a landslide to become the 46th Governor of Kansas." ], [ "2006 Kansas gubernatorial election", "2006 Kansas gubernatorial election\n\nThe Kansas gubernatorial election of 2006 took place on November 7, 2006.", "Incumbent Democratic Governor Kathleen Sebelius, who sported high approval ratings ran for re-election to serve a second and final term.", "Governor Sebelius was unopposed for the Democratic nomination and she faced the Republican nominee, State Senator Jim Barnett, who emerged from a crowded primary.", "Sebelius roundly defeated Barnett and cruised to re-election, which was quite a considerable feat for a Democrat in staunchly conservative Kansas." ], [ "2014 Kansas gubernatorial election", "2014 Kansas gubernatorial election\n\nThe 2014 Kansas gubernatorial election took place on November 4, 2014, to elect the Governor of Kansas, concurrently with the election of Kansas' Class II U.S. Senate seat, as well as other elections to the United States Senate in other states and elections to the United States House of Representatives and various state and local elections.", "Incumbent Republican Governor Sam Brownback ran for re-election to a second term.", "He was opposed in the general election by Democrat Paul Davis, the Minority Leader of the Kansas House of Representatives, and Libertarian attorney Keen Umbehr.", "The election was viewed as a referendum on Brownback's aggressive tax cutting initiatives and his conservative values.", "The consensus among \"The Cook Political Report\", \"Governing\", \"The Rothenberg Political Report\", \"Sabato's Crystal Ball\", \"Daily Kos Elections\", and others was that the contest was a tossup.", "Brownback won the election by a margin of 3.7%.", "Davis carried seven counties, all in eastern Kansas, five of which are home to four-year state universities." ] ], "gold": "Several Democratic candidates have run in the Kansas Gubernatorial election over the years. Incumbent Democrat Kathleen Sebelius ran unopposed by her party for Governor of Kansas in 2006 and won. Four years later, in 2010, Democrat Tom Holland ran unopposed by his party for Governor of Kansas, but lost. Next, during the 2014 Gubernatorial election in Kansas, Democrat Paul Davis ran for the office but lost.", "prediction 1": "The Democratic nomination for governor in Kansas is currently held by Republican Sam Brownback. Democrat Paul Davis is the Minority Leader of the Kansas House of Representatives and Libertarian attorney Keenumbehr is the Libertarian candidate. In the 2010 gubernatorial election, Democratic Governor Kathleen Sebelius was unopposed for the Democratic nomination and she faced Republican State Senator Jim Barnett in a crowded primary. In the 2014 gubernatorial election, Democrat Paul Davis was the Minority Leader of the Kansas House of Representatives, and Libertarian attorney Keen Umbehr.", "prediction 2": "The 2010 Kansas gubernatorial election was held on November 2, 2010. Democratic incumbent Kathleen Sebelius was unopposed for the Democratic nomination and faced the Republican nominee, State Senator Jim Barnett, who emerged from a crowded primary. In the 2014 Kansas gubernatorial election, which took place on November 4, 2014, Democrat Paul Davis, the Minority Leader of the Kansas House of Representatives, and Libertarian attorney Keen Umbehr were the Democratic candidates running for governor in Kansas.", "prediction 3": "The Democratic Party of Kansas has traditionally used the Democratic party to nominate governors, typically for a two-year term. In 2010, Democratic incumbent Kathleen Sebelius ran unopposed for the Democratic nomination, and she faced Republican nominee Jim Barnett in a crowded primary before being defeated in the general election by Democrat Paul Davis. In the 2014 gubernatorial election, Democratic State Senator Tom Holland was unopposed for his party's nomination, and Republicans Sam Brownback and Keenum Brody were unopposed.", "prediction 4": "The Kansas gubernatorial election of 2010 was held on November 2, 2010. Democratic incumbent Governor Kathleen Sebelius was unopposed for the Democratic nomination. Republican incumbent Sam Brownback was opposed in the general election by Democrat Paul Davis, the Minority Leader of the Kansas House of Representatives, and Libertarian attorney Keen Umbehr.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 4, "end": 25 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 243 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 280, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 434 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 442, "end": 470 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 592 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Democratic nomination for governor in Kansas has been several people. In 2006, incumbent Democratic Governor Kathleen Sebelius was unopposed for the Democratic nomination and won. Democratic State Senator Tom Holland, was unopposed for his party's nomination but lost the election. In 2014, Paul Davis was the candidate for the Democrats but lost." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When was the last time america declared war?", "passages": [ [ "Declaration of war by the United States", "Declaration of war by the United States\n\nA declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another.", "The document Declarations of War and Authorizations for the Use of Military Force: Historical Background and Legal Implications gives an extensive\nlisting and summary of statutes which are automatically engaged upon the US declaring war.", "For the United States, of the Constitution says \"Congress shall have power to ... declare War.\"", "However, that passage provides no specific format for what form legislation must have in order to be considered a \"declaration of war\" nor does the Constitution itself use this term.", "In the courts, the United States Court of Appeals for the First Circuit, in \"Doe v. Bush\", said: \"[T]he text of the October Resolution itself spells out justifications for a war and frames itself as an 'authorization' of such a war.\"", "in effect saying an authorization suffices for declaration and what some may view as a formal Congressional \"Declaration of War\" was not required by the Constitution.", "The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania, because President Franklin Roosevelt thought it was improper to engage in hostilities against a country without a formal declaration of war." ], [ "Declaration of war", "63, the King, with prior authorization by the Parliament, has the power to declare war and make peace.", "According to 2010:1408 15 kap.", "14 \u00a7 entitled \"Krigsf\u00f6rklaring\" (declaration of war) the Swedish cabinet (regeringen) may not declare Sweden to be at war without the parliaments (riksdagen) consent unless Sweden is first attacked.", "In the United States, Congress, which makes the rules for the military, has the power under the constitution to \"declare war\".", "However neither the U.S. Constitution nor any Act of Congress stipulate what format a declaration of war must take.", "War declarations have the force of law and are intended to be executed by the President as \"commander in chief\" of the armed forces.", "The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "Since then, the US has used the term \"authorization to use military force\", as in the case against Iraq in 2003.", "Sometimes decisions for military engagements were made by US presidents, without formal approval by Congress, based on UN Security Council resolutions that do not expressly declare the UN or its members to be at war." ] ], "gold": "A declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another nation. On June 5, 1942 United States President Franklin Roosevelt used specific terminology to formally declare war against Hungary, Bulgaria, and Romania. Since then, no American president has issued a formal declaration of war when using military force. The last time America authorized an undeclared war was March 3, 2003.", "prediction 1": "The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the US declared war on Bulgaria, Hungary, and Romania.", "prediction 2": "The last time the United States declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "prediction 3": "The last time the United States formally declared war, using specific terminology, on any nation was in 1942 when war was declared against Axis-allied Hungary, Bulgaria, and Romania, because President Franklin Roosevelt thought it was improper to engage in hostilities against a country without a formal declaration of war. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "prediction 4": "A declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another. The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 349 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": " A declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another. The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania by President Franklin Roosevelt. Since then, the US has used the term \"authorization to use military force\", as in the case against Iraq in 2003." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "How many episodes in marvels runaways season 1?", "passages": [ [ "Runaways (TV series)", "Filming on the pilot began in Los Angeles in February 2017.", "The series was officially ordered by Hulu in May 2017.", "The first season was released from November 21, 2017, to January 9, 2018.", "In January 2018, \"Runaways\" was renewed for a 13-episode second season, which is scheduled to be released in its entirety on December 21, 2018.", "Six teenagers from different backgrounds unite against a common enemy \u2013 their criminal parents, collectively known as the Pride.", "In the second season, the teenagers are now on the run from their parents, living on their own and figuring out how to stop the Pride, before learning there may be a mole among them who contacts Jonah, the leader of Pride, aiding his dangerous plan.", "Old Lace, a genetically engineered \"Deinonychus\" telepathically linked with Gert Yorkes, appears in the series.", "The character is portrayed by a puppet that was operated by six people, including one person pumping air through the puppet to show the dinosaur breathing.", "Barer called the puppet \"incredible ...", "You see her emotions.", "We don't not make use of that.\"", "Stan Lee makes a cameo appearance as a limo driver.", "Brian K. Vaughan was hired to write a screenplay for Marvel Studios in May 2008, based on his comic book \"Runaways\"." ], [ "Runaways (TV series)", "Runaways (TV series)\n\nMarvel's Runaways, or simply Runaways, is an American web television series created for Hulu by Josh Schwartz and Stephanie Savage, based on the Marvel Comics superhero team of the same name.", "It is set in the Marvel Cinematic Universe (MCU), sharing continuity with the films and other television series of the franchise.", "The series is produced by ABC Signature Studios, Marvel Television and Fake Empire Productions, with Schwartz and Savage serving as showrunners.", "Rhenzy Feliz, Lyrica Okano, Virginia Gardner, Ariela Barer, Gregg Sulkin, and Allegra Acosta star as the Runaways, six teenagers from different backgrounds who unite against their parents, the Pride, portrayed by Angel Parker, Ryan Sands, Annie Wersching, Kip Pardue, Ever Carradine, James Marsters, Brigid Brannagh, Kevin Weisman, Brittany Ishibashi, and James Yaegashi.", "A film from Marvel Studios based on the \"Runaways\" began development in May 2008, before being shelved in 2013 due to the success of \"The Avengers\".", "In August 2016, Marvel Television announced that \"Runaways\" had received a pilot order from Hulu, after being developed and written by Schwartz and Savage.", "Casting for the Runaways and the Pride were revealed in February 2017." ], [ "Runaways (TV series)", "Marvel's position is everything is connected, but our show is trying to walk that line where the reality our kids are facing, they are facing for the first time.\"", "He also said they \"were very capable of telling the story that we wanted to tell independent of any of the other Marvel stories that are out there.\"", "Loeb added that there were no plans to crossover across networks with the similarly themed \"Cloak & Dagger\" on Freeform and \"New Warriors\", as Marvel wanted the series to find its footing before further connecting with other elements of the universe, though \"You'll see things that comment on each other; we try to touch base wherever we can... things that are happening in L.A. are not exactly going to be affecting what's happening in New Orleans [where \"Cloak & Dagger\" is set]...", "It's being aware of it and trying to find a way [to connect] that makes sense.\"", "Speaking to the second season, Schwartz said there would be a reference late in the season \"that will probably be our first real bread crumb that connects to the MCU.\"", "\"Runaways\" premiered its first three episodes on Hulu in the United States on November 21, 2017, with the first season consisting of 10 episodes, and concluding on January 9, 2018." ] ], "gold": "The superhero TV series Marvel's Runaways ran for a total of three seasons and 33 episodes, all of which aired on the streaming service Hulu. The first season of 10 episodes was released on November 21, 2017. The second season of 13 episodes was released on December 21, 2018, and the third season of 10 episodes was released on December 13, 2019.", "prediction 1": "Marvel's Runaways, or simply Runaways, is an American web television series created for Hulu by Josh Schwartz and Stephanie Savage, based on the Marvel Comics superhero team of the same name. The first three episodes of the first season were released on Hulu in the United States on November 21, 2017. The first 10 episodes of the second season were released on Hulu in the United States on January 9, 2018.", "prediction 2": "Marvel's Runaways, or simply Runaways, is an American web television series created for Hulu by Josh Schwartz and Stephanie Savage, based on the Marvel Comics superhero team of the same name. The series premiered its first three episodes on Hulu in the United States on November 21, 2017, with the first season consisting of 10 episodes, and concluding on January 9, 2018. In January 2018, Marvel's Runaways was renewed for a 13-episode second season, which is scheduled to be released in its entirety on December 21, 2018.", "prediction 3": "Marvel's Runaways, or simply Runaways, is an American web television series created for Hulu by Josh Schwartz and Stephanie Savage, based on the Marvel Comics superhero team of the same name. The first season consisted of 10 episodes, and concluded on January 9, 2018. In January 2018, \"Runaways\" was renewed for a 13-episode second season, which is scheduled to be released in its entirety on December 21, 2018.", "prediction 4": "Marvel's Runaways, or simply Runaways, is an American web television series created for Hulu by Josh Schwartz and Stephanie Savage, based on the Marvel Comics superhero team of the same name. The first season premiered its first three episodes on Hulu in the United States on November 21, 2017, with the first season consisting of 10 episodes, and concluding on January 9, 2018. In January 2018, \"Runaways\" was renewed for a 13-episode second season, which is scheduled to be released in its entirety on December 21, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 38 }, { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 57 }, { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 158 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 279 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 306, "end": 314 }, { "error type": "Redundant", "explanation": "on Hulu", "start": 359, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 387 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 391, "end": 407 } ], "missing-info": [], "corrected-prediction": "Marvel's Runaways is superhero television series aired on Hulu. The first season of 10 episodes was released on November 21, 2017. The second season of 13 episodes was released on December 21, 2018." }, "preference": [ 1, 0, 1, 0, 0, 0 ] }, { "question": "What album is man of the world on fleetwood mac?", "passages": [ [ "Man of the World (song)", "Man of the World (song)\n\n\"Man of the World\" is a song recorded by Fleetwood Mac in 1969, and composed by vocalist and lead guitarist Peter Green.", "It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the \"Greatest Hits\" album in 1971.", "It later featured on the 1992 boxed set \"25 Years \u2013 The Chain\", and on the 2002 compilation albums \"The Very Best of Fleetwood Mac\" and \"The Best of Peter Green's Fleetwood Mac\".", "A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\".", "\"Man of the World\" is a song about a man who has everything he wants, except the companion he craves.", "It is in the key of D major, and ends on a D major sixth chord.", "The single's peak position in the UK Singles Chart was No. 2 on 7 June 1969, spending a total of 14 weeks on the listing.", "It entered the Dutch Top 40 on 26 April 1969 and peaked at No. 12.", "It also reached the top five in Norway and Ireland.", "It was not released in the USA until 1976, when DJM records released it as a single, with different B-sides.", "It has been also re-released in many countries as a 'Golden Oldies' single." ] ], "gold": "Man of the World is a song recorded by Fleetwood Mac in 1969. Man of the World first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the Greatest Hits album in 1971. It later featured on the 1992 boxed set 25 Years \u2013 The Chain, and on the 2002 compilation albums The Very Best of Fleetwood Mac and The Best of Peter Green's Fleetwood Mac. A slightly different version of the song was included on the 1998 compilation The Vaudeville Years.", "prediction 1": "\"Man of the World\" is a song recorded by Fleetwood Mac in 1969, and composed by vocalist and lead guitarist Peter Green. It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the Greatest Hits album in 1971. It later featured on the 1992 boxed set \"25 Years \u2013 The Chain\", and on the 2002 compilation albums \"The Very Best of Fleetwood Mac\" and \"The Best of Peter Green's Fleetwood Mac\". A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\".", "prediction 2": "Man of the World is a song recorded by Fleetwood Mac in 1969, and composed by vocalist and lead guitarist Peter Green. It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the Greatest Hits album in 1971. It later featured on the 1992 boxed set 25 Years \u2013 The Chain, and on the 2002 compilation albums The Very Best of Fleetwood Mac and The Best of Peter Green's Fleetwood Mac. A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\".", "prediction 3": "\"Man of the World\" is a song recorded by Fleetwood Mac in 1969, and composed by vocalist and lead guitarist Peter Green. It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the \"Greatest Hits\" album in 1971. It later featured on the 1992 boxed set \"25 Years \u2013 The Chain\", and on the 2002 compilation albums \"The Very Best of Fleetwood Mac\" and \"The Best of Peter Green's Fleetwood Mac\". A slightly different version of \"Man of the World\" was included on the 1998 compilation \"The Vaudeville Years\".", "prediction 4": "\"Man of the World\" is a song recorded by Fleetwood Mac in 1969, and composed by vocalist and lead guitarist Peter Green. It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the Greatest Hits album in 1971. It later featured on the 1992 boxed set \"25 Years \u2013 The Chain\", and on the 2002 compilation albums \"The Very Best of Fleetwood Mac\" and \"The Best of Peter Green's Fleetwood Mac\". A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\". A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 120 } ], "missing-info": [], "corrected-prediction": "\"Man of the World\" is a song recorded by Fleetwood Mac in 1969. It first appeared as a Fleetwood Mac single in various countries in 1969, subsequently appearing on the Greatest Hits album in 1971. It later featured on the 1992 boxed set \"25 Years \u2013 The Chain\", and on the 2002 compilation albums \"The Very Best of Fleetwood Mac\" and \"The Best of Peter Green's Fleetwood Mac\". A slightly different version of the song was included on the 1998 compilation \"The Vaudeville Years\"." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where did the allied leaders meet in july of 1945 to discuss how germany was to be punished?", "passages": [ [ "Potsdam Conference", "Potsdam Conference\n\nThe Potsdam Conference () was held at Cecilienhof, the home of Crown Prince Wilhelm in Potsdam, occupied Germany, from 17 July to 2 August 1945.", "(In some older documents, it is also referred to as the Berlin Conference of the Three Heads of Government of the USSR, USA, and UK.)", "The participants were the Soviet Union, the United Kingdom, and the United States, represented by Communist Party General Secretary Joseph Stalin, Prime Ministers Winston Churchill and Clement Attlee, and President Harry S. Truman.", "Stalin, Churchill, and Truman gathered to decide how to administer Germany, which had agreed to unconditional surrender nine weeks earlier on 8 May (Victory in Europe Day).", "The goals of the conference also included the establishment of postwar order, peace treaty issues, and countering the effects of the war.", "A number of changes had taken place in the five months since the Yalta Conference which greatly affected the relationships among the leaders.", "The Soviet Union was occupying Central and Eastern Europe, the Red Army effectively controlled the Baltic states, Poland, Czechoslovakia, Hungary, Bulgaria, and Romania, and refugees were fleeing from these countries.", "Stalin had set up a puppet Communist government in Poland, and he insisted that his control of Eastern Europe was a defensive measure against possible future attacks, claiming that it was a legitimate sphere of Soviet influence.", "Second, Britain had a new Prime Minister." ], [ "Diplomatic history of World War II", "The Potsdam Conference was held July 17-Aug. 2, 1945, at Potsdam, Germany, near Berlin.", "Stalin met with the new U.S. President Harry S. Truman and two British prime ministers in succession\u2014Winston Churchill and Clement Attlee.", "It demanded \"unconditional surrender\" from Japan, and finalized arrangements for Germany to be occupied and controlled by the Allied Control Commission.", "The status of other occupied countries was discussed in line with the basic agreements made earlier at Yalta.", "The Dumbarton Oaks Conference or, more formally, the Washington Conversations on International Peace and Security Organization was an international conference at which the United Nations was formulated and negotiated among international leaders.", "The conference was held at Dumbarton Oaks from August 21, 1944 to October 7, 1944.", "At the conference, delegations from the Soviet Union, the United Kingdom, the United States and the Republic of China deliberated over proposals for the establishment of an organization to maintain peace and security in the world.", "San Francisco Conference was a convention of delegates from 50 Allied nations that took place from 25 April 1945 to 26 June 1945 in San Francisco, United States.", "At this convention, the delegates reviewed and rewrote the Dumbarton Oaks agreements." ] ], "gold": "The allied leaders met at the Potsdam Conference, which was held at Cecilienhof, the home of Crown Prince Wilhelm in Potsdam, Germany, from 17 July to 2 August 1945. Here, the allied leaders met to discuss how to punish Germany, which had agreed to an unconditional surrender nine weeks earlier, on the 8 May. The goals of the conference also included establishing the postwar order, solving issues on the peace treaty and countering the effects of the war.", "prediction 1": "The Potsdam Conference was held at Cecilienhof, the home of Crown Prince Wilhelm in Potsdam, occupied Germany, from 17 July to 2 August 1945. The participants were the Soviet Union, the United Kingdom, and the United States, represented by Communist Party General Secretary Joseph Stalin, Prime Ministers Winston Churchill and Clement Attlee, and President Harry S. Truman. The conference demanded \"unconditional surrender\" from Japan, and finalized arrangements for Germany to be occupied and controlled by the Allied Control Commission.\n", "prediction 2": "The Potsdam Conference was held from 17 July to 2 August 1945 in Potsdam, occupied Germany. Every year, political leaders from the United Kingdom, United States, Soviet Union and the UK met in different locations to discuss how to punish Germany after it was surrendered.", "prediction 3": "The Potsdam Conference was held from 17 to 2 August 1945 at Potsdam, Germany, near Berlin. An international conference to discuss how the Allies were to punish Nazi Germany took place at that city in July 1945.", "prediction 4": "The Potsdam Conference was held at Cecilienhof, the home of Crown Prince Wilhelm in Potsdam, occupied Germany, from 17 July to 2 August 1945. The Potsdam Conference demanded \"unconditional surrender\" from Japan, and finalized arrangements for Germany to be occupied and controlled by the Allied Control Commission. The San Francisco Conference was a convention of delegates from 50 Allied nations that took place from 25 April 1945 to 26 June 1945 in San Francisco, United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 373 }, { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 435 }, { "error type": "Irrelevant", "explanation": "", "start": 440, "end": 539 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Potsdam Conference was held at Cecilienhof, the home of Crown Prince Wilhelm in Potsdam, occupied Germany, from 17 July to 2 August 1945. The conference decided how to administer Germany, which had agreed to unconditional surrender nine weeks earlier on 8 May. The goals of the conference also included the establishment of postwar order, peace treaty issues, and countering the effects of the war.\n" }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who won the nhl scoring race this year?", "passages": [ [ "Art Ross Trophy", "From 1963 to 2001, Marcel Dionne and Bryan Trottier were the only \"single-time\" winners of the scoring title, while Stan Mikita, Phil Esposito, Bobby Orr, Guy Lafleur, Wayne Gretzky, Mario Lemieux, and Jaromir Jagr had won it on multiple occasions.", "For two decades, from 1981 to 2001, only three players won the Art Ross Trophy: Gretzky, Lemieux, and Jagr.", "The streak ended when Jarome Iginla won the trophy in 2002.", "Gretzky has won the trophy ten times, including seven consecutive, during his 20-year NHL career.", "Gordie Howe and Lemieux have each won it six times, while Esposito and Jagr each have five.", "Jagr, from the Czech Republic, has won the award the most times by a non-Canadian.", "Patrick Kane is the only American born player to win the trophy, doing so in 2016.", "Gretzky is the only player to win the trophy for more than one team, while Thornton is the only player to win it while playing for two different teams in one season." ], [ "Art Ross Trophy", "Art Ross Trophy\n\nThe Art Ross Trophy is awarded to the National Hockey League (NHL) player who leads the league in points at the end of the regular season.", "It was presented to the league by former player, General Manager, and head coach Art Ross.", "The trophy has been awarded 65 times to 27 players since its introduction in the 1947\u201348 NHL season.", "Ross is also known for his design of the official NHL puck, with slightly bevelled edges for better control.", "The current holder is Connor McDavid of the Edmonton Oilers.", "The Art Ross Trophy was presented to the National Hockey League (NHL) in 1947 by Arthur Howey \"Art\" Ross, former General Manager and head coach of the Boston Bruins and Hockey Hall of Fame inductee as a player.", "Elmer Lach of the Montreal Canadiens was the winner of the first Art Ross Trophy, which was awarded at the conclusion of the season.", "Players from the Pittsburgh Penguins have won the trophy 15 times (all within a 26-season span from to ); the Montreal Canadiens, Edmonton Oilers and Chicago Blackhawks are tied for second, as players from those teams have won it nine times each.", "Although Joe Thornton, winner from the season, started the season playing for the Boston Bruins, he finished with the San Jose Sharks and the award counts for the Sharks.", "Therefore, Boston Bruins have seven players winning the trophy, fifth overall." ], [ "Connor McDavid", "In three separate nights of the 2017\u201318 season, McDavid scored his second, third, and fourth career hat tricks.", "He also earned his first four-goal game on one of those nights, against the Tampa Bay Lightning on February 5, 2018.", "Despite the Oilers failing to qualify for the 2018 Stanley Cup playoffs, McDavid won the Art Ross Trophy for the second straight season, and won the Ted Linsday award for the second consecutive time.", "McDavid first played in an IIHF tournament in 2013 when he joined the Canadian under-18 team at the 2013 IIHF World U18 Championships in Sochi, Russia.", "The youngest player on the Canadian team, McDavid played his first game against Slovakia on April 18, where he recorded one goal and two assists.", "After recording a hat trick against Sweden, McDavid was named the best Canadian player of the game.", "He led the tournament in goals and points while helping Canada win a gold medal for only the third time since the tournament's inception in 1999, defeating the four-time defending champion, the United States, in the final.", "Jim Nill, then chief scout for the Detroit Red Wings, said of his performance that, \"I guess you could say he is kind of The Next One.", "Every so many years [a player arrives like] Gretzky, Lemieux." ] ], "gold": "The winner of the 2020-21 NHL scoring race, who was consequently awarded the Art Ross Trophy, is Connor McDavid of the Edmonton Oilers. McDavid also won the trophy in 2016-17 and 2017-18. In the previous 2015-16 season, Patrick Kane of the Chicago Blackhawks became the only American born player to win the trophy. Jamie Benn of the Dallas Stars won the trophy in 2014-2015.", "prediction 1": "The Art Ross Trophy was presented to the National Hockey League in 1947 by Arthur Howey \"Art\" Ross, former player, general manager, and head coach of the Boston Bruins. In 2019, the Art Ross Trophy was won by Connor McDavid of the Edmonton Oilers. In 2019, the Art Ross Trophy was once again won by Elmer Lach of the Montreal Canadiens.", "prediction 2": "The Art Ross Trophy is awarded to the National Hockey League player who leads the league in points at the end of the regular season. The current holder of the trophy is Connor McDavid of the Edmonton Oilers. Elmer Lach of the Montreal Canadiens was the winner of the first Art Ross Trophy, which was awarded at the conclusion of the season. During the 2017-18 season, McDavid won the Art Ross Trophy for the second straight season, and won the Ted Linsday award for the second consecutive time.", "prediction 3": "The Art Ross Trophy is awarded to the National Hockey League player who leads the league in points at the end of the regular season. Connor McDavid of the Edmonton Oilers won the Art Ross Trophy for the second straight season. During the 2016-17 season, Wayne Gretzky won the Art Ross Trophy for the second time, and in 2017-18, the winner was Mario Lemieux.", "prediction 4": "Connor McDavid of the Edmonton Oilers won the nhl scoring race in 2018. The Art Ross Trophy is awarded to the National Hockey League player who leads the league in points at the end of the regular season. The trophy was presented to the league in 1947 by former player, General Manager, and head coach Art Ross. The current holder of the trophy is McDavid, who won it for the second straight season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 168 }, { "error type": "Unverifiable", "explanation": "", "start": 169, "end": 177 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 281, "end": 309 }, { "error type": "Unverifiable", "explanation": "", "start": 248, "end": 256 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Art Ross Trophy is currently won by Connor McDavid of the Edmonton Oilers. Patrick Kane is the only American born player to win the trophy, doing so in 2016." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where are the guys from impractical jokers from?", "passages": [ [ "Impractical Jokers", "Impractical Jokers\n\nImpractical Jokers is an American hidden camera reality series that premiered on TruTV on December 15, 2011, and is produced by NorthSouth Productions.", "It follows Joseph \"Joe\" Gatto, James \"Murr\" Murray, Brian \"Q\" Quinn, and Salvatore \"Sal\" Vulcano, the four members of the comedy troupe The Tenderloins, as they coerce one another into doing public pranks while being filmed by hidden cameras.", "The show differs from other prank television programs, focusing on witty humor, as compared to slapstick, crude comedy.", "On March 7, 2018, TruTV announced that the show would be renewed for an eighth season that will have 26 episodes and is expected to air in February 2019.", "TruTV also confirmed an \"Impractical Jokers\" feature-length movie is planned, which began filming in April 2018 and is expected to premiere sometime in 2019.", "Joseph \"Joe\" Gatto, James \"Murr\" Murray, Brian \"Q\" Quinn, and Salvatore \"Sal\" Vulcano, four high school friends who attended Monsignor Farrell High School, from Staten Island, New York, formed the live improv and sketch comedy troupe The Tenderloins in 1999." ], [ "The Crimea (band)", "The Crimea (band)\n\nThe Crimea were a British indie band, based in Camden, London.", "The band were featured in John Peel's Festive Fifty, ranking higher than bands such as The White Stripes and all eleven of the initial album demos were played on his show.", "The Guardian has described The Crimea's songs as \"mini-epics\" that reduce frontman Davey MacManus to \"spasms of jerking anguish\".", "On 2 July 2013 they announced via their official Twitter account that they were calling time on their 11-years as a band and that their gig at the Jazz Caf\u00e9 in London on 30 July 2013 would be their last.", "In 1998 The Crocketts signed to UK label V2 and released two albums.", "However, in late 2001, the band were dropped from the label's roster as part of a 'rationalisation' plan.", "Following this setback, Davey MacManus and Owen Hopkin formed The Crimea.", "Their song \"Lottery Winners On Acid\" was played frequently by John Peel in 2002.", "They recorded a Peel session on 16 January 2003.", "The Crimea were signed to Warner Bros Records following a showcase at the 2004 SXSW Festival in Texas." ] ], "gold": "The guys from the US version Impractical Jokers are from Staten Island, New York. The UK version Impractical Jokers' actor Joel Dommett is from Rockhampton, Gloucestershire, Marek Ryan Larwood is from Norwich, Norfolk, England, and Roisin Marcella Conaty is from Camden, London.", "prediction 1": "Impractical Jokers is an American hidden camera reality series that premiered on TruTV on December 15, 2011 and is produced by NorthSouth Productions. It follows Joseph Gatto, James Murray, Brian Quinn, and Salvatore Vulcano, the four members of the comedy troupe The Tenderloins, as they coerce one another into doing public pranks while being filmed by hidden cameras. The show differs from other prank television programs, focusing on witty humor, as compared to slapstick, crude comedy. The Crimea were a British indie band, based in Camden, London. The Crimea were based in London. The band were formed in their song \"Lottery Winners On Acid\".", "prediction 2": "Impractical Jokers is an American hidden camera reality show that premiered on TruTV on December 15, 2011, and is produced by NorthSouth Productions. It follows Joseph \"Joe\" Gatto, James \"Murr\" Murray, Brian \"Q\" Quinn, and Salvatore \"Sal\" Vulcano, the four members of the comedy troupe The Tenderloins, as they coerce one another into doing public pranks while being filmed by hidden cameras. The high school friends who attended Monsignor Farrell High School, from Staten Island, New York, formed the live improv and sketch comedy troupe The Tenderloins in 1999. The band The Crimea were a British indie band, based in Camden, London.", "prediction 3": "Impractical Jokers is an American hidden camera reality series that premiered on TruTV on December 15, 2011. It follows Joseph \"Joe\" Gatto, James \"Murr\" Murray, Brian \"Q\" Quinn, and Salvatore \"Sal\" Vulcano, the four members of the comedy troupe The Tenderloins, as they coerce one another into doing public pranks while being filmed by hidden cameras. The show differs from other prank television programs, focusing on witty humor, as opposed to slapstick, crude comedy.", "prediction 4": "Impractical Jokers is an American hidden camera reality series that premiered on TruTV on December 15, 2011, and is produced by NorthSouth Productions. It follows Joseph \"Joe\" Gatto, James \"Murr\" Murray, Brian \"Q\" Quinn, and Salvatore \"Sal\" Vulcano, the four members of the comedy troupe The Tenderloins, as they coerce one another into doing public pranks while being filmed by hidden cameras. The show differs from other prank television programs, focusing on witty humor, as opposed to slapstick, crude comedy. TruTV also confirmed an Impractical Jokers feature-length movie is planned, which began filming in April 2018 and is expected to premiere sometime in 2019. The Crimea were a British indie band, based indie band, based in Camden, London. The Crime", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 150 }, { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 490 }, { "error type": "Irrelevant", "explanation": "", "start": 491, "end": 553 }, { "error type": "Irrelevant", "explanation": "", "start": 554, "end": 648 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The guys from the US version Impractical Jokers are from Staten Island, New York." }, "preference": [ 0, 1, 0, 1, 1, 2 ] }, { "question": "When was the criminal code of canada created?", "passages": [ [ "Criminal Code (Canada)", "Criminal Code (Canada)\n\nThe Criminal Code () is a law that codifies most criminal offences and procedures in Canada.", "Its official long title is \"An Act respecting the criminal law\" (R.S.C. 1985, c. C-46, as amended).", "Section 91(27) of the Constitution Act, 1867 establishes the sole jurisdiction of Parliament over criminal law in Canada.", "The Criminal Code contains some defences, but most are part of the common law rather than statute.", "Important Canadian criminal laws not forming part of the code include the Firearms Act, the Controlled Drugs and Substances Act, the Canada Evidence Act, the Food and Drugs Act, the Youth Criminal Justice Act and the Contraventions Act.", "One of the conveniences of the criminal code was that it constituted the principle that no person would be able to be convicted of a crime unless otherwise specifically outlined and stated in a statute.", "This legal document has played a major part in Canada's history and has also helped form other legal acts and laws, for example the Controlled Drugs and Substances Act.", "The main body of the Criminal Code is divided into the following major components:\n\n\n", "The main body is followed by schedules (i.e. appendices) relating to some of the above-mentioned Parts and a series of prescribed legal forms, such as Form 5 which sets out the proper legal wording for a search warrant." ], [ "Law of Canada", "Canadian administrative law is the body of law that addresses the actions and operations of governments and governmental agencies.", "Individual provinces have codified some principles of contract law in a \"Sale of Goods Act\", which was modeled on early English versions.", "Outside of Quebec, most contract law is still common law, based on the rulings of judges in contract litigation over the years.", "Quebec, being a civil law jurisdiction, does not have contract law, but rather has its own law of obligations.", "Constitutional law is the area of Canadian law relating to the interpretation and application of the Constitution of Canada by the Courts.", "This is represented in the \"Constitution Act, 1867\", \"Constitution Act, 1982\" and \"Canadian Charter of Rights and Freedoms\".", "Copyright law of Canada governs the legally enforceable rights to creative and artistic works under the laws of Canada.", "Criminal law in Canada falls under the exclusive legislative jurisdiction of the federal government.", "The power to enact criminal law is derived from section 91(27) of the Constitution Act, 1867.", "Most criminal laws have been codified in the \"Criminal Code\", as well as the \"Controlled Drugs and Substances Act\", \"Youth Criminal Justice Act\", and several other peripheral Acts.", "The provinces are responsible for the administration of justice, including criminal trials within their respective provinces, despite their inability to enact criminal laws." ] ], "gold": "The Criminal Code is a law that codifies most criminal offences and procedures in Canada. It was first enacted in 1982 and first enforced on July 1, 1893. One of the conveniences of the Criminal Code was that it constituted the principle that no person would be able to be convicted of a crime unless otherwise specifically outlined and stated in a statute. This legal document has played a major part in Canada's history and has also helped form other legal acts and laws, for example, the Controlled Drugs and Substances Act..", "prediction 1": "The Criminal Code of Canada is a law that codifies most criminal offences and procedures in Canada. Its official long title is An Act respecting the criminal law, and its provisions were created in 1867. The power to enact criminal law is derived from section 91(27) of the Constitution Act, 1867, which establishes the sole jurisdiction of Parliament over criminal law in Canada. Important Canadian criminal laws not forming part of the code include the Firearms Act, the Controlled Drugs and Substances Act, the Food and Drugs Act, the Youth Criminal Justice Act, and the Contraventions Act.", "prediction 2": "The Criminal Code of Canada was created in 1867, and is a law that codifies most criminal offences and procedures in Canada. The Criminal Code contains some defences, but most are part of the common law rather than statute.", "prediction 3": "The Criminal Code of Canada is a law that codifies most criminal offences and procedures in Canada. Its official long title is \"An Act respecting the criminal law\" and the section 91(27) of the Constitution Act, 1867 establishes the sole jurisdiction of Parliament over criminal law in Canada. Important Canadian criminal laws not forming part of the Criminal Code include the Firearms Act, the Controlled Drugs and Substances Act, the Canada Evidence Act, the Food and Drugs Act, the Youth Criminal Justice Act and the Youth Criminal Justice Act.", "prediction 4": "The Criminal Code of Canada was created in 1867, when the Constitution Act established the sole jurisdiction of Parliament over criminal law in Canada. The power to enact criminal law is derived from section 91(27) of the Constitution Act, 1867.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 593 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 162 }, { "error type": "Unverifiable", "explanation": "", "start": 163, "end": 203 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Criminal Code of Canada is a law that codifies most criminal offences and procedures in Canada. One of the conveniences of the criminal code was that it constituted the principle that no person would be able to be convicted of a crime unless otherwise specifically outlined and stated in a statute. This legal document has played a major part in Canada's history and has also helped form other legal acts and laws, for example, the Controlled Drugs and Substances Act.." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who developed the steam engine that could drive machinery?", "passages": [ [ "Steam engine", "The first commercial steam-powered device was a water pump, developed in 1698 by Thomas Savery.", "It used condensing steam to create a vacuum which raised water from below and then used steam pressure to raise it higher.", "Small engines were effective though larger models were problematic.", "They had a limited lift height and were prone to boiler explosions.", "Savery's engine was used in mines, pumping stations and supplying water to water wheels that powered textile machinery.", "Savery engine was of low cost.", "Bento de Moura Portugal introduced an improvement of Savery's construction \"to render it capable of working itself\", as described by John Smeaton in the Philosophical Transactions published in 1751.", "It continued to be manufactured until the late 18th century.", "One engine was still known to be operating in 1820.", "The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine, invented by Thomas Newcomen around 1712.", "It improved on Savery's steam pump, using a piston as proposed by Papin.", "Newcomen's engine was relatively inefficient, and mostly used for pumping water.", "It worked by creating a partial vacuum by condensing steam under a piston within a cylinder." ], [ "Steam engine", "Steam engine\n\nA steam engine is a heat engine that performs mechanical work using steam as its working fluid.", "The steam engine uses the force produced by steam pressure to push a piston back and forth inside a cylinder.", "This pushing force is transformed, by a connecting rod and flywheel, into rotational force for work.", "The term \"steam engine\" is generally applied only to reciprocating engines as just described, not to the steam turbine.", "Steam engines are external combustion engines, where the working fluid is separated from the combustion products.", "The ideal thermodynamic cycle used to analyze this process is called the Rankine cycle.", "In general usage, the term \"steam engine\" can refer to either complete steam plants (including boilers etc.)", "such as railway steam locomotives and portable engines, or may refer to the piston or turbine machinery alone, as in the beam engine and stationary steam engine.", "Steam-driven devices were known as early as the aeliopile in the first century AD, with a few other uses recorded in the 16th and 17th century.", "Thomas Savery's dewatering pump used steam pressure operating directly on water.", "The first commercial engine producing continuous rotary motion was only developed in 1712 by Newcomen.", "James Watt made a critical improvement by removing spent steam to a separate vessel for condensation, greatly improving the amount of work obtained per unit of fuel consumed." ], [ "Steam engine", "Many such engines have been designed, from the time of James Watt to the present day, but relatively few were actually built and even fewer went into quantity production; see link at bottom of article for more details.", "The major problem is the difficulty of sealing the rotors to make them steam-tight in the face of wear and thermal expansion; the resulting leakage made them very inefficient.", "Lack of expansive working, or any means of control of the cutoff, is also a serious problem with many such designs.", "By the 1840s, it was clear that the concept had inherent problems and rotary engines were treated with some derision in the technical press.", "However, the arrival of electricity on the scene, and the obvious advantages of driving a dynamo directly from a high-speed engine, led to something of a revival in interest in the 1880s and 1890s, and a few designs had some limited success..\n\n", "Of the few designs that were manufactured in quantity, those of the Hult Brothers Rotary Steam Engine Company of Stockholm, Sweden, and the spherical engine of Beauchamp Tower are notable.", "Tower's engines were used by the Great Eastern Railway to drive lighting dynamos on their locomotives, and by the Admiralty for driving dynamos on board the ships of the Royal Navy.", "They were eventually replaced in these niche applications by steam turbines." ] ], "gold": "The first commercial steam-powered device was a water pump, developed in 1698 by Thomas Savery. The first commercially successful engine that could transmit continuous power to a machine was developed in 1712 by Thomas Newcomen. And James Watt invented the first rotary steam engine, making a critical improvement by removing spent steam to a separate vessel for condensation, greatly improving the amount of work obtained per unit of fuel consumed.", "prediction 1": "The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine, invented by Thomas Newcomen around 1712. It improved on Savery's steam pump, using a piston as proposed by Papin. The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine, developed by Benjamin Bento de Moura Portugal. The first commercially-successful steam engine that could transmit continuous power to rotary motion was developed by Thomas Newcomen around 1712.", "prediction 2": "The first commercial steam-powered device was a water pump, developed in 1698 by Thomas Savery. It used condensing steam to create a vacuum which raised water from below and then used steam pressure to raise it higher. The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine, invented by Thomas Newcomen around 1712. It improved on Savery's steam pump, using a piston as proposed by Papin. Newcomen's engine was relatively inefficient, and mostly used for pumping water. The first commercially-successssssssssssuessssssssssssssssssssssssssssssssssssssssuccinssssssssssucc", "prediction 3": "A steam engine is a heat engine that performs mechanical work using steam as its working fluid. The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine, invented by Thomas Newcomen around 1712. The first commercially-successful steam engine that could drive machinery was the water pump, developed in 1698 by Thomas Savery, and improved on Savery's device by using a piston as proposed by Papin.", "prediction 4": "The first commercially-successful steam engine that could transmit continuous power to a machine was the atmospheric engine, invented by Thomas Newcomen around 1712. It improved on Savery's steam pump, using a piston as proposed by Papin. The first commercially-successful steam engine that could transmit continuous power to a machine was the rotary engine, developed in 1712 by Newcomen. Thomas Watt made a critical improvement by removing spent steam to a separate vessel for condensation, greatly improving the amount of work obtained per unit of fuel consumed. The first commercial steam engine that could transmit continuous power to a machine, was developed in 1698 by Thomas Savery. It used condensing steam to create a vacuum which raised water from below and then used steam pressure to raise water from below and used steam pressure to raise it higher.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 233 }, { "error type": "Unverifiable", "explanation": "", "start": 354, "end": 400 }, { "error type": "Redundant", "explanation": "The first commercially-successful engine that could transmit continuous power to a machine, was the atmospheric engine,", "start": 234, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 401, "end": 547 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 12 ] } ], "corrected-prediction": "The first commercial steam-powered device was a water pump, developed in 1698 by Thomas Savery. The first commercially-successful engine that could transmit continuous power to a machine invented by Thomas Newcomen around 1712. James Watt made a critical improvement by removing spent steam to a separate vessel for condensation, greatly improving the amount of work obtained per unit of fuel consumed. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who said its better to burn out than fade away?", "passages": [ [ "Hey Hey, My My (Into the Black)", "Hey Hey, My My (Into the Black)\n\n\"Hey Hey, My My (Into the Black)\" is a song written by Canadian musician Neil Young.", "Combined with its acoustic counterpart \"My My, Hey Hey (Out of the Blue)\", it bookends Young's successful 1979 album \"Rust Never Sleeps\".", "Inspired by electropunk group Devo, the rise of punk and what Young viewed as his own growing irrelevance, the song significantly revitalized Young's career at the time, and today crosses generations, inspiring admirers from punk to grunge.", "The song is about the alternatives of continuing to produce similar music (\"to rust\" or \u2013 in \"My My, Hey Hey (Out of the Blue)\" \u2013 \"to fade away\") or to burn out.", "A line from the acoustic version of the song, \"it's better to burn out than to fade away,\" became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note.", "Young later said that he was so shaken that he dedicated his 1994 album \"Sleeps with Angels\" to Cobain." ] ], "gold": "The line, \"it's better to burn out than to fade away,\" is a lyric featured in Neil Young's 1979 acoustic song My My, Hey Hey (Out of the Blue). It was taken from a song Young's bandmate Jeff Blackburn performed with The Ducks. The line later became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note. Young later said that he was so shaken that he dedicated his 1994 album \"Sleeps with Angels\" to Cobain.", "prediction 1": "\"It's better to burn out than to fade away\" was a line from the acoustic version of Hey Hey, My My (Into the Black) by Canadian musician Neil Young that became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note.", "prediction 2": "\"It's better to burn out than to fade away,\" is a line from the acoustic version of the song \"Hey Hey, My My (Into the Black)\" by Canadian musician Neil Young. The line became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note.", "prediction 3": "\"It's better to burn out than to fade away,\" is a line from the acoustic version of the song Hey Hey, My My (Into the Black) written by Canadian musician Neil Young. The line became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note.", "prediction 4": "\"It's Better to Burn Out Than to Fade Away\" is a song written by Canadian musician Neil Young. The line became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"It's better to burn out than to fade away\" was a line from the acoustic version of Hey Hey, My My (Into the Black) by Canadian musician Neil Young that became infamous after being quoted in Nirvana frontman Kurt Cobain's suicide note. Young later said that he was so shaken that he dedicated his 1994 album \"Sleeps with Angels\" to Cobain." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Where did the seminole lived before the trail of tears?", "passages": [ [ "Seminole", "More speculatively, the Creek word itself, may be derived from the Spanish word \"cimarr\u00f3n\", meaning \"runaway\" or \"wild one\", historically used for certain Native American groups in Florida.", "The people who constituted the nucleus of this Florida group either chose to leave their tribe or were banished.", "At one time, the terms \"renegade\" and \"outcast\" were used to describe this status, but the terms have fallen into disuse because of a negative connotation.", "They identify as \"yat'siminoli\" or \"free people\" because for centuries their ancestors had resisted Spanish efforts to conquer and convert them, as well as English efforts to take their lands and use them in their wars.", "They signed several treaties with the United States including the Treaty of Moultrie Creek and the Treaty of Paynes Landing.", "Native American refugees from northern wars, such as the Yuchi and Yamasee after the Yamasee War in South Carolina, migrated into Spanish Florida in the early 18th century.", "More arrived in the second half of the 18th century, as the Lower Creeks, part of the Muscogee people, began to migrate from several of their towns into Florida to evade the dominance of the Upper Creeks and pressure of English colonists moving into their lands." ], [ "Seminole", "In a process of ethnogenesis, they constructed a new culture which they called \"Seminole\", a derivative of the \"Mvskoke\"' (a Creek language) word \"simano-li\", an adaptation of the Spanish \"cimarr\u00f3n\" which means \"wild\" (in their case, \"wild men\"), or \"runaway\" [men].", "The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia, who by the time of the Creek Wars (1812\u20131813) numbered about 4,000 in Florida.", "At that time, numerous refugees of the Red Sticks migrated south, adding about 2,000 people to the population.", "They were Creek-speaking Muscogee, and were the ancestors of most of the later Creek-speaking Seminole.", "In addition, a few hundred escaped African-American slaves (known as the Black Seminole) had settled near the Seminole towns and, to a lesser extent, Native Americans from other tribes, and some white Americans.", "The unified Seminole spoke two languages: Creek and Mikasuki (mutually intelligible with its dialect Hitchiti), two among the Muskogean languages family.", "Creek became the dominant language for political and social discourse, so Mikasuki speakers learned it if participating in high-level negotiations." ] ], "gold": "The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia. Native American refugees from northern wars, such as the Yuchi and Yamasee after the Yamasee War in South Carolina, migrated into Spanish Florida in the early 18th century. More arrived in the second half of the 18th century, as the Lower Creeks, part of the Muscogee people, began to migrate from several of their towns into Florida to evade the dominance of the Upper Creeks and pressure of English colonists moving into their lands.", "prediction 1": "The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia, who by the time of the Creek Wars 1812\u20131813 numbered about 4,000 in Florida. More arrived in the second half of the 18th century, as the Lower Creeks, part of the Muscogee people, began to migrate from several of their towns into Florida to evade the dominance of the Upper Creeks and pressure of English colonists moving into their lands. During this time, hundreds of escaped African-American slaves had settled near the Seminole towns and, to a lesser extent, Native Americans from other tribes and, and some white Americans.", "prediction 2": "In a process of ethnogenesis, they constructed a new culture which they called Seminole, a derivative of the Mvskoke' (a Creek language) word \"simano-li\", an adaptation of the Spanish \"cimarr\u00f3n\" which means \"wild\" (in their case, \"wild men\"), or \"runaway\" [men]. Initially, the Seminole lived in Florida, but then they migrated to other parts of the United States and moved north to Florida, where they lived in Florida.", "prediction 3": "The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia, who by the time of the Creek Wars (1812\u20131813) numbered about 4,000 in Florida. During the process of ethnogenesis, they constructed a new culture, which they called the Seminole. The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia, who by the time of the Creek Wars (1812\u20131813) numbered about 4,000 in Florida.", "prediction 4": "In a process of ethnogenesis, the Seminole constructed a new culture which they called Seminole, a derivative of the Mvskoke' (a Creek language) word \"simano-li\", an adaptation of the Spanish \"cimarr\u00f3n\" which means \"wild\" or \"wild men\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 613 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Seminole were a heterogeneous tribe made up of mostly Lower Creeks from Georgia. Native American refugees from northern wars, such as the Yuchi and Yamasee after the Yamasee War in South Carolina, migrated into Spanish Florida in the early 18th century. More arrived in the second half of the 18th century, as the Lower Creeks, part of the Muscogee people, began to migrate from several of their towns into Florida to evade the dominance of the Upper Creeks and pressure of English colonists moving into their lands. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played the twins on i love lucy?", "passages": [ [ "The Borden Twins", "The Borden Twins\n\nThe Borden Twins (born May 29, 1932), Rosalyn Borden and Marilyn Borden, were twin sisters who acted together in numerous television programs from the 1950s until the 1980s.", "They were best remembered as \"Teensy\" and \"Weensy\" in an episode of \"I Love Lucy\" entitled \"Tennessee Bound\".", "They never rose above supporting players, but the duo performed in many venues, including gigs on the nightclub circuit, as well as larger events including the Rose Bowl.", "The twins also performed at numerous USO shows at home and overseas.", "The sisters worked with notable performers such as Lucille Ball, Dean Martin, and Jerry Lewis, Andy Williams, Sammy Davis, Jr., Jimmy Durante, Bea Arthur, Bob Newhart and The Ritz Brothers.", "Rosalyn \"Roz\" Borden died January 23, 2003 of liver disease in Modesto, California.", "Marilyn Borden died March 25, 2009 of complications of congestive heart failure and chronic obstructive pulmonary disease, also in Modesto." ], [ "Ricky Ricardo Jr.", "Ricky Ricardo Jr.\n\nEnrique Alberto Ricardo IV, \"Little Ricky,\" is a fictional character from the American television series \"I Love Lucy\" (1951\u201357, with Ricky Jr. becoming a part of the show as of his birth in 1953) and \"The Lucy-Desi Comedy Hour\" (1957\u201360).", "Little Ricky was played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky.", "Although the \"I Love Lucy\" announcer and the opening credits of \"The Lucy-Desi Comedy Hour\" gave his stage name as \"Little Ricky\", in his post-\"Lucy\" acting career, particularly his four-year irregular stint on \"The Andy Griffith Show\", he was billed as Richard Keith.", "In the show, Little Ricky is the son of Lucy Ricardo and Ricky Ricardo.", "Little Ricky lives with his parents in a New York Brownstone apartment building, which is owned and run by his godparents; the family later moves to a large suburban house in Westport, Connecticut.", "Lucy finds out she was expecting Little Ricky on the Season 2 episode \"Lucy is Enceinte.\"" ], [ "Lucy and Superman", "Lucy and Superman\n\n\"Lucy and Superman\" is an episode of the sitcom \"I Love Lucy\", and was first broadcast on January 14, 1957 on CBS.", "The episode was written by Bob Carroll, Jr., Madelyn Pugh, Bob Schiller and Bob Weiskopf.", "Directed by James V. Kern, it is the 13th episode of the sixth season, and the 166th episode of the series.", "The episode features a guest appearance by George Reeves as Superman.", "His character is referred to as \"Superman\" throughout the episode (rather than \"George Reeves\" or \"the actor who plays Superman\").", "Bandleader Ricky Ricardo (Desi Arnaz) and his young son Little Ricky watch the latest episode of the \"Adventures of Superman\" television series, which concludes with the narrator stating that Superman will be making personal appearances in the coming week at Macy's Department Store in New York City.", "As Ricky's wife Lucy (Lucille Ball) enters and sends her son to bed, she promises to take him to see Superman at Macy's.", "Ethel and Fred Mertz (Vivian Vance, William Frawley) arrive and drop off favors for Little Ricky's fifth birthday party, which is scheduled for Saturday." ] ], "gold": "There were several sets of twins on the I Love Lucy show, both real life twin actors and roles of twin characters to be played. Rosalyn Borden and Marilyn Borden played twins Teensy and Weensy on the Tennessee Bound episode. David Stollery played Timmy Hudson, one of the twins on The Amateur Hour episode. And Little Ricky was played by a number of actors, including twins Richard and Ronald Lee Simmons and twins Michael and Joseph Mayer.", "prediction 1": "The twins on the American television sitcom I Love Lucy were played by a number of actors, including the twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer, and, most notably, Keith Thibodeaux, who played the role of the twin, Enrique Alberto Ricardo IV. The twins were best remembered as \"Teensy\" and \"Weensy\" in an episode of I Love Lucy entitled \"Tennessee Bound\".", "prediction 2": "The twin sisters Rosalyn and Marilyn Borden acted together in numerous television programs from the 1950s until the 1980s. They were best remembered as \"Teensy\" and \"Weensy\" in an episode of I Love Lucy entitled Tennessee Bound. The twins were played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky.", "prediction 3": "The Borden Twins were twin sisters who acted together in numerous television programs from the 1950s until the 1980s. In the 1957 episode of I Love Lucy entitled \"Tennessee Bound\", the twins are played by Richard Simmons and Michael Mayer, respectively. In the 1960 episode \"Lucy and Superman\" which first aired on January 14, 1957, the twins are played by George Reeves.", "prediction 4": "The twins Rosalyn and Marilyn Borden, who were born May 29, 1932, acted together in various television programs from the 1950s until the 1980s. They were best remembered as \"Teensy\" and \"Weensy\" in an episode of \"I Love Lucy\" entitled \"Tennessee Bound\". The twins never rose above supporting players, but the duo performed in many venues, including gigs on the nightclub circuit, as well as larger events including the Rose Bowl. Most notably, Keith Thibodeaux, who played Little Ricky. Although the \"I Love Lucy\" announcer and the opening credits of \"The Lucy-Desi Comedy Hour\" gave his stage name as \"Little Ricky\", in his post-Lucy acting career, he was billed as Richard Keith Thibodeaux.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 0, "end": 9 }, { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 272 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Little Ricky on the American television sitcom I Love Lucy was played by a number of actors, including the twins Richard and Ronald Lee Simmons and twins Michael and Joseph Mayer. The twin sisters Rosalyn Borden and Marilyn Borden were best remembered as \"Teensy\" and \"Weensy\" in an episode of I Love Lucy entitled \"Tennessee Bound\"." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played jason grimshaw's dad in corrie?", "passages": [ [ "Jason Grimshaw", "Producer Stuart Blackburn told the official website: \"Tony's arrival is going to cause massive ructions for the Grimshaws.", "He is a man who can be your best friend or your worst enemy, and with a long history of lies and betrayal, this is a guy who has an awful lot of making up to do.\"", "In late 2005, Jason began dating Sarah Platt portrayed by Tina O'Brien, they had an on off relationship and were due to marry in 2006.", "Speaking of the storyline Thomas said: \"Jason was thinking about getting married in four years rather than four months.", "It was just a gesture, and that\u2019s all he wanted it to be.", "He thought they would just get engaged and they didn\u2019t have to get married for ages yet.", "It was more of a stepping stone for him.", "It has come round quickly for Jason, and he is sort of being pushed into it.", "He doesn\u2019t want to lose Sarah", "so he is going along with it because he does actually love her.\"", "Asked if Jason would settle down Thomas also said: \"He's had a bit of a past and he's a bit of a Jack The Lad around Charlie but on this occasion, for once, he's actually showing some grown-up qualities and, when faced with the prospect of losing Sarah, he chose to bite the bullet." ], [ "Jason Grimshaw", "They later employ Jason's friend, Gary Windass (Mikey North) and Zeedan Nazir (Qasim Akhtar), as labourers.", "After Jason's brother, Todd, returns to Weatherfield, Tony employs him, as a secretary at the builder's yard, but he puts the company at risk, after ordering cheap materials to make a loft conversion for Jason's friend, Tyrone.", "Matters turn worse when Tyrone falls through the roof, breaks his ribs and sues 'Jason's Construction'.", "When Jason discovers what Todd has done and that Jason and Gary knew what he was up to, he fires all three of them, leaving only Zeedan working at the builder's yard and, unable to live in the same house as Todd, for what he has done, Jason moves into the flat above the kebab shop with Eva.", "After realising that what happened to him was not Jason's fault, Tyrone decides to accept Tony's \u00a35,000 compensation and forgives Jason.", "When Todd is disowned by Eileen, he moves into a run-down flat, but he later gets a job at Barlow's Buys, impressing Eileen, who realises that he is trying to make amends, but Jason is not convinced." ], [ "Jason Grimshaw", "Ryan Thomas and Bruno Langley were cast in the roles of brothers Jason and Todd Grimshaw, the 17- and 15-year-old sons of Streetcars controller Eileen.", "Jason was originally going to be called James.", "The family moved into Liz and Jim McDonald's old house on the street.", "Producers hoped Thomas and Langley would achieve the same heartthrob status as Adam Rickitt, who played Nick Tilsley for two years before leaving to pursue a pop career.", "\"We thought it was time for some good looking boys,\" said a spokeswoman.", "The Grimshaws are often portrayed as arguing rivals in their scenes.", "Jason and his brother Todd Grimshaw (Bruno Langley) are portrayed as \"bickering brothers\".", "Jason is often cheeky to their mother, Eileen Grimshaw (Sue Cleaver).", "Thomas told a reporter from \"Soaplife\" that he and Langley were best friends off-screen.", "In 2007, Thomas told Derek Robins of \"The Sun\" that \"Jason and Todd have a great bond as brothers and after all family is what Corrie is all about.\"", "He added that Jason eventually accepts his sexuality and wants to spend more time with Todd.", "On 15 November 2013, it was announced that Terrance Maynard had been cast as Jason's father Tony Stewart.", "Tony had been seen in the programme in 2003 played by Alan Igbon." ] ], "gold": "In the British soap opera \"Coronation Street\", the father of the character Jason Grimshaw, Tony Stewart, was played by Alan Igbon in 2003. On November 15, 2013, it was announced that Terence Maynard would start to play Tony.", "prediction 1": "Jason Grimshaw and his father Tony Stewart are played by Ryan Thomas and Bruno Langley. Jason was originally going to be called James. On 15 November 2013, it was announced that Terrance Maynard had been cast as Jason's father. Tony Stewart had been seen in the programme in 2003 played by Alan Igbon.", "prediction 2": "Terrance Maynard was cast as Jason's dad in Corrie. Tony Stewart was played by Alan Igbon in 2003. In 2014, Terrance Maynard took over the role of Tony.", "prediction 3": "Jason Grimshaw is the lead character in the television soap opera Corrie. His father is Tony Stewart, played by Terrance Maynard. Tony Stewart, played by Alan Igbon, is the lead character's father in the 2009 series of Corrie.", "prediction 4": "Jason Grimshaw is played by Ryan Thomas and Bruno Langley. Terrance Maynard is the son of Eileen and Tony Stewart. Tony Stewart was played by Alan Igbon in the 2003 version of Corrie. Tony is a man who can be your best friend or your worst enemy, and with a long history of lies and betrayal, this is a guy who has an awful lot of making up to do.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 134 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 87 } ], "missing-info": [], "corrected-prediction": "On 15 November 2013, it was announced that Terrance Maynard had been cast as Jason's father. Tony Stewart had been seen in the programme in 2003 played by Alan Igbon." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where does the monkey's paw come from?", "passages": [ [ "The Monkey's Paw", "The Monkey's Paw\n\n\"The Monkey's Paw\" is a supernatural short story by author W. W. Jacobs first published in England in the collection \"The Lady of the Barge\" in 1902.", "In the story, three wishes are granted to the owner of the monkey's paw, but the wishes come with an enormous price for interfering with fate.", "It has been adapted scores of times in other media, including plays, movies, TV shows, operas, stories and comics, as early as 1903 and as recently as 2017.", "The short story involves Mr. and Mrs. White and their adult son, Herbert.", "Sergeant-Major Morris, a friend who served with the British Army in India, introduces them to a mummified monkey's paw.", "An old fakir placed a spell on the paw, so that it would grant three wishes.", "The wishes are granted but always with hellish consequences as punishment for tampering with fate.", "Morris, having had a horrific experience using the paw, throws the monkey's paw into the fire but Mr. White retrieves it.", "Before leaving, Morris warns Mr. White that if he does use the paw, then it will be on his own head." ] ], "gold": "\"The Monkey's Paw\" is a supernatural short story by author W. W. Jacobs, first published in England in the collection \"The Lady of the Barge\" in 1902. In the story, a friend of the White family, Sergeant-Major Morris, comes by for dinner and introduces them to a mummified monkey's paw.", "prediction 1": "The Monkey's Paw is a supernatural short story written in 1902 by author W. W. Jacobs, first published in England in the collection The Lady of the Barge in 1902. An old fakir placed a spell on the monkey's paw, so that it would grant three wishes. The wishes are granted but always with hellish consequences as punishment for tampering with fate.", "prediction 2": "The Monkey's Paw is a supernatural short story by author W. W. Jacobs first published in England in the collection The Lady of the Barge in 1902. In the story, three wishes are granted to the owner of the monkey's paw, but the wishes come with an enormous price for interfering with fate. It has been adapted scores of times in other media, including plays, movies, TV shows, operas, stories and comics, as early as 1903 and as recently as 2017. The story involves Mr. Sergeant-Major Morris, a friend who served with the British Army in India, introduces them to a mummified monkey's paw. An old fakir placed a spell on the paw, so that it would grant three wishes.", "prediction 3": "The Monkey's Paw is a supernatural short story by author W. W. Jacobs first published in England in the collection The Lady of the Barge in 1902. An old fakir placed a spell on the paw, so that it would grant three wishes. The wishes are granted but always with hellish consequences as punishment for tampering with fate. Morris, having had a horrific experience using the paw, throws the monkey's paw into the fire but Mr. White retrieves it.", "prediction 4": "The Monkey's Paw is a supernatural short story by author W. W. Jacobs first published in England in the collection The Lady of the Barge in 1902. An old fakir placed a spell on the paw, so that it would grant three wishes. The wishes are granted but always with hellish consequences as punishment for tampering with fate. The story involves Mr. and Mrs. White and their adult son, Herbert. Sergeant-Major Morris, a friend who served with the British Army in India, introduces them to a mummified monkey's paw.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 248 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 347 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Monkey's Paw is a supernatural short story written in 1902 by author W. W. Jacobs, first published in England in the collection The Lady of the Barge in 1902. in the story, Sergeant-Major Morris, a friend who served with the British Army in India, introduces them to a mummified monkey's paw." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who dies in the maze runner death cure?", "passages": [ [ "Maze Runner: The Death Cure", "Meanwhile, Lawrence rallies his rebels outside the city before blowing a hole in the city wall, sacrificing himself to allow his allies and the infected people to storm the city.", "Gally finds Thomas, Minho, and Newt.", "Newt, sending Minho and Gally ahead to get the serum from Brenda, gives Thomas a pendant before passing out.", "Teresa transmits her voice throughout the city, telling Thomas that his blood can save Newt if he will only return to WCKD.", "Newt, nearly consumed by the Flare, regains consciousness and attacks Thomas, while begging Thomas to kill him.", "When Thomas refuses, Newt\u2013left with no other option\u2013stabs himself.", "Thomas makes his way back to WCKD and confronts", "Ava.", "However, she is killed by Janson, who is infected by the Flare.", "Janson knocks Thomas out and drags him to a lab where Teresa is ready to extract his blood.", "However, he reveals that he is only truly interested in curing himself and others that he feels are worthy, which results in Teresa turning on him.", "After a fight, Janson is killed by Cranks, allowing Thomas and Teresa to escape to the rooftop, where Teresa gives Thomas a vial with the cure.", "Their allies suddenly appear in an aircraft: Thomas makes it aboard, but Teresa dies when the headquarters collapses in on itself." ], [ "Maze Runner: The Death Cure", "Maze Runner:", "The Death Cure\n\nMaze Runner:", "The Death Cure (also known simply as The Death Cure) is a 2018 American dystopian science fiction action film directed by Wes Ball and written by T.S. Nowlin, based on the novel \"The Death Cure\" written by James Dashner.", "It is the sequel to the 2015 film \"\" and the third and final installment in the \"Maze Runner\" film series.", "The film stars Dylan O'Brien, Kaya Scodelario, Thomas Brodie-Sangster, Dexter Darden, Nathalie Emmanuel, Giancarlo Esposito, Aidan Gillen, Walton Goggins, Ki Hong Lee, Jacob Lofland, Katherine McNamara, Barry Pepper, Will Poulter, Rosa Salazar, and Patricia Clarkson.", "\"Maze Runner:", "The Death Cure\" was originally set to be released on February 17, 2017, in the United States by 20th Century Fox, but the studio rescheduled the film's release for January 26, 2018, in theatres and IMAX, allowing time for O'Brien to recover from injuries he sustained during filming.", "The film received mixed reviews from critics and grossed over $288\u00a0million worldwide.", "Thomas, Newt, and Frypan are the last of the free \"Gladers\" immune to the Flare virus that has ravaged the world's population." ] ], "gold": "Teresa, played by Kaya Scodelario, is the character that dies in the Maze Runner: Death Cure.", "prediction 1": "Maze Runner: The Death Cure is a 2018 American dystopian action film written by T.S. Nowlin and directed by Wes Ball based on the 2015 novel The Death Cure written by James Dashner. Thomas, Newt, and Gally are the only survivors of the Flare virus. Newt, who was sent ahead to get the serum from Brenda, gives Thomas a pendant before passing out and is killed by Janson. Thomas's fellow survivors, Ava, are killed by Janson, who is infected by the Flare.", "prediction 2": "Maze Runner: The Death Cure is a 2018 American dystopian science fiction action film which is the sequel to the 2015 film, the third and final installment in the Maze Runner film series. Thomas, Newt, and Newt's friend, Ava, who is an infected Glader, die in the 2018 film. Thomas makes it aboard an aircraft, but Teresa dies when the headquarters collapses in on itself.", "prediction 3": "Maze Runner: The Death Cure is a 2018 American dystopian action film directed by Wes Ball and written by T.S. Nowlin, based on the novel The Death Cure written by James Dashner. Thomas is killed by Janson, who is infected by the Flare. Thomas and Teresa escape to a rooftop, where Teresa gives Thomas a vial with the cure. However, Thomas makes it aboard, but Teresa dies when the headquarters collapses in on itself.", "prediction 4": "Maze Runner: The Death Cure is a 2018 American dystopian action film directed by Wes Ball and written by T.S. Nowlin, based on the novel The Death Cure written by James Dashner. In the film, Thomas makes it aboard, but Teresa dies when the headquarters collapses in on itself. In the novel, Thomas dies while trying to stop the Flare from destroying the Earth. Thomas dies when he is attacked by Janson, who is infected by the Flare virus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 454 }, { "error type": "Unverifiable", "explanation": "", "start": 182, "end": 254 }, { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 370 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 13 ] } ], "corrected-prediction": "Teresa is the character that dies in the Maze Runner: Death Cure." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who wrote i am a friend of god?", "passages": [ [ "Friends of God: A Road Trip with Alexandra Pelosi", "Friends of God: A Road Trip with Alexandra Pelosi\n\nFriends of God: A Road Trip With Alexandra Pelosi is an HBO television documentary about evangelicals in the United States that is written, directed, produced, and narrated by Alexandra Pelosi.", "The documentary first aired on January 25, 2007 on HBO.", "Lisa Heller was supervising producer and Sheila Nevins was executive producer.", "Jerry Falwell called this film \"The Only Documentary that he and I ever watched and liked.\"", "In this documentary, Alexandra Pelosi visits several of the largest evangelical Christian church congregations (\"megachurches\") in the country, such as Lakewood Church and New Life Church (Colorado Springs, Colorado), and interviews their leaders and members.", "Pelosi also visits other Christian organizations like the Christian Wrestling Federation and Cruisers for Christ (a car club) as well as others committed to spreading the Gospel through their own unique packaging and marketing.", "The documentary centers around the relationship between Christian evangelical churches and political activism.", "It also demonstrates how these organizations have shaped modern politics in regards to issues that include, but are not limited to, gay rights, abortion, and the creation-evolution controversy." ], [ "Israel Houghton", "Israel Houghton\n\nIsrael Houghton (; born May 19, 1971) is an American Christian music singer, songwriter, producer and worship leader.", "Houghton is usually credited as \"Israel & New Breed\".", "Houghton produced an album by Michael Gungor, \"Bigger Than My Imagination\", which was described as \"one of the year's best worship albums\" in a 2003 \"Christianity Today\" review.", "Among the awards that Houghton has won includes six Grammy Awards; three for Best Pop/Contemporary Gospel Album and one for Best Traditional Gospel Album for \"Alive In South Africa\".", "Houghton was married to Meleasa Houghton from 1994 until they separated in 2015, with the divorce being finalized on February 22, 2016.", "Together they have two daughters and two sons.", "On November 11, 2016, Houghton married singer and TV personality Adrienne Bailon in Paris, after nine months of dating." ] ], "gold": "Friend of God is a song written by Israel Houghton, an American Christian music singer, songwriter, producer and worship leader. Houghton is usually credited as Israel & New Breed. Friends of God: A Road Trip With Alexandra Pelosi is an HBO television documentary about evangelicals in the United States that first aired on January 25, 2007.", "prediction 1": "Friends of God: A Road Trip With Alexandra Pelosi is an HBO television documentary about evangelicals in the United States that is written, directed, produced, and narrated by Alexandra Pelosi. The documentary centers around the relationship between Christian evangelical churches and political activism. It also demonstrates how these organizations have shaped modern politics in regards to issues that include, but are not limited to, gay rights, abortion, and the creation-evolution controversy.\n", "prediction 2": "Friends of God: A Road Trip With Alexandra Pelosi is an HBO television documentary about evangelicals in the United States that is written, directed, produced, and narrated by Alexandra Pelosi. It demonstrates how these organizations have shaped modern politics in regards to issues that include, but are not limited to, gay rights, abortion, and the creation-evolution controversy. In the 1994 movie I Am A Friend Of God, Timothy Slater mentions Jane Jacobs, while Stina Winn claims that she wrote I Am A Kind of God: A Piper George Grabar and Jeff Nadraina Rebbeth and Robert Owen Blumo Davies s wrote the 1991 song I Am A Call To Be A Year of God.", "prediction 3": "There are several \"I am a friend of God\" songs. The most famous is I Am A Friend of God, a song written by American Christian singer, songwriter, producer Israel Houghton. Another popular song written by Houghton was I Am A Friend of God, an HBO television documentary about evangelicals in the United States that was written, directed, produced, and narrated by Alexandra Pelosi.", "prediction 4": "I Am A Friend of God is a 2007 HBO television documentary about evangelicals in the United States that is written, directed, produced, and narrated by Alexandra Pelosi. The documentary centers around the relationship between Christian evangelical churches and political activism and demonstrates how these organizations have shaped modern politics in regards to issues like gay rights, abortion, and the creation-evolution controversy. In this documentary, Alexandra Pelosi visits several of the largest evangelical Christian church congregations (\"megachurches\") in the country, and interviews their leaders and members. Pelosi also visits other Christian organizations like the Christian Wrestling Federation and Cruisers for Christ (a car club) as well as others committed to spreading the Gospel through their own unique packaging and marketing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 499 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 193 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Friends of God: A Road Trip With Alexandra Pelosi is an HBO television documentary about evangelicals in the United States that first aired on January 25, 2007. Israel Houghton is an American Christian music singer, songwriter, producer and worship leader usually credited as Israel & New Breed." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who did green bay lose to in the playoffs last year?", "passages": [ [ "Green Bay Packers", "In the Divisional round, they defeated No. 1 seeded Atlanta 48\u201321.", "They then played the Chicago Bears at Soldier Field in the NFC Championship Game \u2013 only the second playoff meeting between the two storied rivals (the other a 33\u201314 Chicago victory which sent them to the 1941 NFL Championship Game).", "Green Bay won 21\u201314 to move on to Super Bowl XLV.", "On February 6, 2011, they defeated the AFC champion Pittsburgh Steelers 31\u201325, becoming the first No. 6 seed from the NFC to win a Super Bowl.", "Aaron Rodgers was named Super Bowl MVP.", "In 2011, coming off their victory in Super Bowl XLV, the Packers won their first 13 games, eventually finishing the season 15\u20131.", "The 15 victories marked the franchise record for wins in a season, and tied for second most regular-season wins in NFL history, behind only the 2007 Patriots who went 16\u20130.", "Following the season, Aaron Rodgers would be named the NFL's MVP, his first such award.", "Despite receiving home-field advantage, Green Bay lost their first game to eventual Super Bowl XLVI champion New York Giants, 37\u201320.", "With an 11\u20135 record, the Packers beat the Minnesota Vikings in the NFC wild card round 24\u201310, but lost in the divisional round of the playoffs to the eventual NFC Champion San Francisco 49ers by a score of 45\u201331." ], [ "2015 Green Bay Packers season", "2015 Green Bay Packers season\n\nThe Green Bay Packers season was the franchise's 97th season overall, 95th in the National Football League, and the tenth under head coach Mike McCarthy.", "With a Week 15 win over the Oakland Raiders, the Packers clinched a playoff spot for the seventh consecutive season, but they failed to win their fifth consecutive NFC North title after a Week 17 loss to the Minnesota Vikings as does matching their 12-4 record from last season.", "As a result, the fifth-seeded Packers traveled to Washington to face the fourth-seeded Redskins in the Wild Card round.", "They beat the Redskins 35\u201318, and then traveled to Arizona for a rematch against the second-seeded Arizona Cardinals, where the Packers' season ended as they lost to the Cardinals in overtime, 20\u201326.", "
\n
\n\nNotes\n\nNote: Intra-division opponents are in bold text.", "The Packers opened their season against their famed arch-rival, the Bears.", "The Bears, behind the strong running of Matt Forte, had the early lead against the Packers, but the Packers were able to gain the advantage in the second half behind Aaron Rodgers' three touchdown passes, two of which were to James Jones, who had been cut by the New York Giants just a week prior." ], [ "2017 Green Bay Packers season", "2017 Green Bay Packers season\n\nThe 2017 Green Bay Packers season was their 99th season overall, 97th season in the National Football League, and the 12th under head coach Mike McCarthy.", "After reaching the NFC Championship Game in the previous season, the Packers failed to improve a 10\u20136 record from 2016 and were eliminated from postseason contention after Week 15, making this the first time since 2008 that they failed to make the playoffs.", "After a 4-1 start, the Packers lost starting quarterback Aaron Rodgers to a collarbone injury during the week 6 game against the Minnesota Vikings, and went on to lose 8 of the 11 remaining games.", "A loss to the Lions in week 17 secured the Packers\u2019 first losing season since 2008.", "The Packers' opponents in this season were almost identical to that of their 2005 season in which the team finished 4-12; this season the Packers faced the Seattle Seahawks, and teams from the NFC South & AFC North.", "The lone difference between these two seasons was that the team faced the Dallas Cowboys, replacing the Philadelphia Eagles, as the Cowboys won their division in 2016.", "
\n\nThe Packers' preliminary preseason schedule was announced on April 10.", "The Packers' preliminary regular season schedule was announced on April 20.", "Note: Intra-division opponents are in bold text.", "The Packers' offense struggled for the first half against the Seahawks." ] ], "gold": "Green Bay has lost to several teams in the playoffs. ln 2014, they lost to Seattle Seahawks. In 2015, it was Arizona Cardinals they lost to. Atlanta Falcons was the team that defeated them in the playoffs in 2016, which was the last divisional playoff game Green Bay lost.", "prediction 1": "The Green Bay Packers lost their first playoff game of the season to the New York Giants on February 6, 2011. The Packers then lost their second playoff game to the San Francisco 49ers on January 6, 2017.", "prediction 2": "The 2016 Green Bay Packers lost to the Minnesota Vikings in the Divisional Round of the NFC Championship Game. The 2017 Green Bay Packers lost to the San Francisco 49ers by a score of 45\u201331.", "prediction 3": "In the 2014 playoffs, the Green Bay Packers lost to the Atlanta Falcons, and in the 2015 playoffs, the Packers lost to the Minnesota Vikings. Then, in 2016, the Packers lost to the San Francisco 49ers. In 2016, the Green Bay Packers lost to the Seattle Seahawks in the divisional round of the playoffs. In 2017, the Packers lost to the Arizona Cardinals in the divisional round of the playoffs.", "prediction 4": "The Green Bay Packers have lost all three of their NFL playoff games. In the 2015 playoffs, they lost to the Minnesota Vikings by a score of 37-20. In the 2016 playoffs, they lost to the Atlanta Falcons by a score of 28-20. In 2017, they lost to the San Francisco 49ers by a score of 45\u201331.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 185, "end": 204 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Green Bay Packers lost their first playoff game of the season to the New York Giants on February 6, 2011. In 2015, it was Arizona Cardinals they lost to. The Packers then lost their second playoff game to the San Francisco 49ers." }, "preference": [ 0, 0, 1, 0, 0, 0 ] }, { "question": "Who plays timon and pumbaa in the lion king?", "passages": [ [ "Timon and Pumbaa", "Timon and Pumbaa\n\nTimon and Pumbaa are an animated meerkat and warthog duo introduced in Disney's 1994 animated film \"The Lion King\" and its franchise.", "Timon was portrayed through his many appearances by Nathan Lane (in all three films and early episodes of the show), Max Casella (the original actor in \"The Lion King\" Broadway musical), Kevin Schon (in certain episodes of the show), Quinton Flynn (in certain episodes of the show), Bruce Lanoil in the \"Wild About Safety\" shorts and \"Kingdom Hearts II\", and while Pumbaa is voiced by Ernie Sabella (in all of his animated speaking appearances), and was portrayed by Tom Alan Robbins in the original cast of the Broadway musical.", "In the upcoming live-action remake, the characters will be portrayed by Billy Eichner and Seth Rogen respectively.", "Nathan Lane and Ernie Sabella first came to audition for the roles of the hyenas, but when the producers saw how well they worked together they decided to cast them as Timon and Pumbaa." ], [ "Timon and Pumbaa", "\"\u2014a reference to Sidney Poitier's line \"They call me Mister Tibbs!\"", "from the 1967 film \"In the Heat of the Night\".", "Unlike real meerkats, Timon can walk on his hind legs, while in real life, meerkats walk on all four legs and can only \"stand\" on their hind ones.", "Based on the characters Rosencrantz and Guildenstern from \"Hamlet\", Timon and Pumbaa are played by Nathan Lane and Ernie Sabella.", "Timon was animated and created by Michael Surrey.", "They made their first appearances in the 1994 film when they shooed away the vultures that swarmed around young Simba, who had collapsed from heat exhaustion.", "Timon and Pumbaa then took the collapsed lion cub back to a small pool, where they splashed water on him to wake him up.", "After Simba is awakened by the two, they introduce themselves and welcome Simba to stay with them and follow their \"hakuna matata\" philosophy.", "At first, Simba is confused about Timon and Pumbaa's lifestyle, but it is explained to him in the song \"Hakuna Matata\".", "Many years later, while out on a musical walk with Timon, Pumbaa is distracted by a bug, which he follows into the jungle." ] ], "gold": "There are several people that have played the characters, Timon and Pumba, of the Lion King. In the original broadway musical they were played by Max Casella and Tom Alan Robbins. Timon was voiced in early episodes by Nathan Lane. Kevin Schon and Quinton Flynn in seasons 2 and 3, and part of season 1, respectively. Ernie Sabella played Pumba in the tv series. And, in the films, it was Nathan Land as Timon and Ernie Sabella as Pumba.", "prediction 1": "Timon and Pumbaa are a duo of meerkats and warthogs who are introduced in Disney's 1994 animated film, The Lion King, and its franchise. Timon is played by Nathan Lane, who has appeared in all three films and early episodes of the show, and Max Casella, who originated the role of Pumbaa in the Broadway musical. Ernie Sabella voices Timon in the animated speaking parts of the film, while Pumbaa is voiced by Tom Alan Robbins in the original cast of the Broadway musical.", "prediction 2": "Timon and Pumbaa are an animated meerkat and warthog duo introduced in Disney's 1994 animated film \"The Lion King\" and its franchise. Timon was portrayed through his many appearances by Nathan Lane, while Pumbaa is voiced by Ernie Sabella, while Tom Alan Robbins was the original actor in The Lion King Broadway musical. In the upcoming live-action remake, the characters will be portrayed by Billy Eichner and Seth Rogen respectively.", "prediction 3": "Timon and Pumbaa are an animated meerkat and warthog duo introduced in Disney's 1994 animated film The Lion King and its franchise. Timon is played through his many appearances by Nathan Lane, as well as Max Casella, Kevin Schon, Quinton Flynn, Bruce Lanoil, Quinton Flynn, Quinton Flynn, Bruce Lanoil in Wild About Safety shorts and Kingdom Hearts II. Pumbaa is voiced by Ernie Sabella, while Tom Alan Robbins was played by Billy Eichner and Seth Rogen respectively.", "prediction 4": "Timon and Pumbaa are an animated meerkat and warthog duo introduced in Disney's 1994 animated film, \"The Lion King\". Timon was played through his many appearances by Nathan Lane, Max Casella, Kevin Schon, Quinton Flynn, Bruce Lanoil, Quinton Flynn, Quinton Flynn, Quinton Flynn, Quinton Flynn, Quinton Flynn, Quinton Flynn, Bruce Lanoil in the Wild About Safety shorts and Kingdom Hearts II, while Pumbaa is voiced by Ernie Sabella, while Tom Alan Robbins was played Pumbaa by Tom Alan Robbins in the original cast of the Broadway musical.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 334, "end": 383 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 281, "end": 287 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 400, "end": 406 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Timon and Pumbaa are a duo of meerkats and warthogs who are introduced in Disney's 1994 animated film, The Lion King, and its franchise. Timon is played by Nathan Lane, who has appeared in all three films and early episodes of the show, Max Casella, who originated the role in the Broadway musical. Kevin Schon and Quinton Flynn in certain episodes of the show, and Bruce Lanoil in the \"Wild About Safety\" shorts and \"Kingdom Hearts II\". Ernie Sabella voices Pumbaa in all of his animated speaking parts while Pumbaa is portrayed by Tom Alan Robbins in the original cast of the Broadway musical." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Who sings i will be right here waiting for?", "passages": [ [ "Right Here Waiting", "Certified Gold on August 21, the record spent three consecutive weeks at number one, replaced by Paula Abdul's \"Cold Hearted\" in the week of September 2, 1989.", "The song was Marx's first of several to go to number one on the Hot Adult Contemporary Chart.", "Certified Platinum on October 16, 1989, \"Right Here Waiting\" is Marx's best selling single.", "It is also his most enduring, charting in the top 15 of Billboard's Hot Adult Contemporary Recurrents chart for four years running, from 2000 to 2003, more than ten years after its release.", "The song also reached #1 on the Radio & Records CHR/Pop Airplay chart on August 4, 1989 staying on the top of the chart for three weeks and remained on the chart for thirteen weeks.", "In the United Kingdom, the song was released in September 1989 and peaked at #2.", "\"Right Here Waiting\" was covered by the American R&B artist Monica.", "It was only released in the United States in December 1999 as the seventh and final single from her second studio album, \"The Boy Is Mine\", and features the R&B band 112.", "No music video was made for the song." ], [ "Right Here Waiting", "Right Here Waiting\n\n\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx.", "It was released in June 29, 1989, as the second single from his second album, \"Repeat Offender\".", "The song was a global hit, topping charts throughout the world, including the U.S. where it reached number one on the \"Billboard\" Hot 100.", "It was certified Platinum by the RIAA.", "The song has been covered by many artists, including Monica for her album \"The Boy Is Mine\".", "\"Right Here Waiting\" was the second single from \"Repeat Offender\", after \"Satisfied\".", "Marx wrote the song on the road as a love letter to his wife, the actress Cynthia Rhodes, who was in South Africa shooting on a film.", "The track was arranged by Marx with Jeffery (C.J.) Vanston to feature none of the heavy drums and synthesizers popular at the time, with Marx's vocal accompanied only by classical guitar (by Bruce Gaitsch) and keyboards (by Vanston).", "It is one of Marx's most frequently covered compositions.", "\"Right Here Waiting\" entered the \"Billboard\" Hot 100 singles chart at number 44 in the week of July 8, 1989, and became Marx's third consecutive number one single on August 12, 1989." ] ], "gold": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx released on June 29, 1989, as the second single from his second album, \"Repeat Offender.\" The song was a global hit, topping charts throughout the world, including the U.S., where it reached number one on the Billboard Hot 100 and was later certified Platinum by the RIAA. The song has later been covered by many artists, including Monica, for her album \"The Boy Is Mine.\"", "prediction 1": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx. It was released in June 29, 1989, as the second single from his second album, \"Repeat Offender\". The song was a global hit, topping charts throughout the world, including the U.S., where it reached number one on the \"Billboard Hot 100\".", "prediction 2": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx. It was released in June 29, 1989, as the second single from his second album, Repeat Offender. The track was arranged by Marx with Jeffery (C.J.) Vanston to feature none of the heavy drums and synthesizers popular at the time, with Marx's vocal accompanied only by classical guitar (by Bruce Gaitsch) and keyboards (by Vanston). This song was one of Marx's most frequently covered compositions. It was covered by the American R&B artist Monica.", "prediction 3": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx. It was released in June 29, 1989, as the second single from his second album, \"Repeat Offender\". The song was a global hit, topping charts throughout the world, including the U.S. where it reached number one on the Billboard Hot 100.", "prediction 4": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx. It was released in June 29, 1989, as the second single from his second album, \"Repeat Offender\". The song was a global hit, topping charts throughout the world, including the U.S. where it reached number one on the \"Billboard\" Hot 100. It was certified Platinum by the RIAA. Right Here Waiting was also covered by the American R&B artist Monica. It was only released in the United States in December 1999 as the seventh and final single from her second studio album, \"The Boy Is Mine\", and features the R&B band 112.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Right Here Waiting\" is a song by American singer and songwriter Richard Marx. It was released in June 29, 1989, as the second single from his second album, \"Repeat Offender\". The song was a global hit, topping charts throughout the world, including the U.S., where it reached number one on the \"Billboard Hot 100\". It was certified Platinum by the RIAA. The song has been covered by many artists, including Monica for her album \"The Boy Is Mine\"." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who wrote when will my life begin from tangled?", "passages": [ [ "When Will My Life Begin?", "When Will My Life Begin?", "\"When Will My Life Begin?\" is a song from Disney's 2010 animated feature film, \"Tangled\".", "It is sung by Rapunzel (Mandy Moore), and serves as the \"I Want\" song of the film.", "It is reprised later on once she is allowed out of the tower for the first time.", "A short reprise with Rapunzel reiterating her situation, and reasoning that \"I've got my mother's love...", "I have everything\" etc., was cut from the final film, though was included in the soundtrack.", "Lyrics are by Glenn Slater, and music is by Alan Menken.", "\"When Will My Life Begin?\" was the first song that was written for the movie.", "Alan Menken explained how he devised the song within the constraints of the chosen genre (guitar-themed score): \"When I thought about Rapunzel in the tower and her long hair, on a gut level, and I thought of the folk music of the 1960s\u2014Jackson Browne, Joni Mitchell\u2014and, it wasn\u2019t an immediate yes, but I wrote six different versions of that opening number [\u201cWhen Will My Life Begin\u201d performed by Mandy Moore as Rapunzel] and it worked\"." ] ], "gold": "The song \"When Will My Life Begin?\" from Tangled was put together by two people. Lyrics are by Glenn Slater, and music is by Alan Menken.", "prediction 1": "When Will My Life Begin? is a song from Disney's 2010 animated feature film, Tangled. It is sung by Rapunzel, played by Mandy Moore, and serves as the \"I Want\" song of the film. Lyrics are by Glenn Slater, and music is by Alan Menken. Alan Menken also wrote six different versions of \"When Will My Life Begin\" performed by Mandy Moore as Rapunzel and it worked.", "prediction 2": "\"When Will My Life Begin?\" is the first song that was written for Disney's 2010 animated feature film, Tangled. The song was sung by Rapunzel (Mandy Moore), and serves as the \"I Want\" song of the film. Alan Menken also contributed music for the song.", "prediction 3": "\"When Will My Life Begin?\" is a song from Disney's 2010 animated feature film, Tangled. It is sung by Rapunzel, played by Mandy Moore.", "prediction 4": "\"When Will My Life Begin?\" is a song from Disney's 2010 animated feature film, Tangled. It is sung by Rapunzel (Mandy Moore), and serves as the \"I Want\" song of the film. Lyrics are by Glenn Slater, and music is by Alan Menken. Alan Menken explained how he devised the song within the constraints of the chosen genre (guitar-themed score). \"When I thought about Rapunzel in the tower and her long hair, and I thought of the folk music of the 1960s\u2014Jackson Browne, Joni Mitchell\u2014and, it worked\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 177 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 361 } ], "missing-info": [], "corrected-prediction": " In The song \"When Will My Life Begin?\" from Tangled, the Lyrics are by Glenn Slater, and music is by Alan Menken. " }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did jimmy johnson win his last race?", "passages": [], "gold": "Jimmy Johnson has won several NASCAR Cup Series. On June 4, 2017, Jimmy Johnson won his very 83rd race. He won his 81st and 82nd race on April 9, 2017 and April 24, 2017 respectively. Jimmy Johnson won his last Busch Grand National series on July 14, 2001.", "prediction 1": "In 1996 the only time Jimmy johnson won a race was in the Indianapolis 500.", "prediction 2": "The last time Jimmy Johnson won a race was on August 24, 1993.", "prediction 3": "He had a lone win in the 1980 race at the Indianapolis 500.", "prediction 4": "Jacques Villeneuve won his last race in 1997.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 75 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did blood transfusions become safer and why?", "passages": [ [ "Blood transfusion", "By the late 19th century, blood transfusion was regarded as a risky and dubious procedure, and was largely shunned by the medical establishment.", "Work to emulate James Blundell continued in Edinburgh.", "In 1845 the Edinburgh Journal described the successful transfusion of blood to a woman with severe uterine bleeding.", "Subsequent transfusions were successful with patients of Professor James Young Simpson after whom the Simpson Memorial Hospital in Edinburgh was named.", "The largest series of early successful transfusions took place at the Edinburgh Royal Infirmary between 1885 and 1892.", "Edinburgh later became the home of the first blood donation and blood transfusion services.", "It was not until 1901, when the Austrian Karl Landsteiner discovered three human blood groups (O, A, and B), that blood transfusion was put onto a scientific basis and became safer.", "Landsteiner discovered that adverse effects arise from mixing blood from two incompatible individuals.", "He found that when incompatible types are mixed, an immune response is triggered and the red blood cells clump.", "The immunological reaction occurs when the receiver of a blood transfusion has antibodies against the donor blood cells.", "The destruction of red blood cells releases free hemoglobin into the bloodstream, which can have fatal consequences.", "Landsteiner's work made it possible to determine blood group and allowed a way for blood transfusions to be carried out much more safely." ], [ "Blood bank", "At the onset of World War II, liquid plasma was used in Britain.", "A large project, known as 'Blood for Britain' began in August 1940 to collect blood in New York City hospitals for the export of plasma to Britain.", "A dried plasma package was developed, which reduced breakage and made the transportation, packaging, and storage much simpler.", "The resulting dried plasma package came in two tin cans containing 400\u00a0cc bottles.", "One bottle contained enough distilled water to reconstitute the dried plasma contained within the other bottle.", "In about three minutes, the plasma would be ready to use and could stay fresh for around four hours.", "Charles R. Drew was appointed medical supervisor, and he was able to transform the test tube methods into the first successful mass production technique.", "Another important breakthrough came in 1939\u201340 when Karl Landsteiner, Alex Wiener, Philip Levine, and R.E. Stetson discovered the Rhesus blood group system, which was found to be the cause of the majority of transfusion reactions up to that time.", "Three years later, the introduction by J.F. Loutit and Patrick L. Mollison of acid-citrate-dextrose (ACD) solution, which reduced the volume of anticoagulant, permitted transfusions of greater volumes of blood and allowed longer term storage.", "Carl Walter and W.P." ], [ "Blood transfusion", "The use of blood plasma as a substitute for whole blood and for transfusion purposes was proposed as early as 1918, in the correspondence columns of the \"British Medical Journal\", by Gordon R. Ward.", "At the onset of World War II, liquid plasma was used in Britain.", "A large project, known as 'Blood for Britain' began in August 1940 to collect blood in New York City hospitals for the export of plasma to Britain.", "A dried plasma package was developed, which reduced breakage and made the transportation, packaging, and storage much simpler.", "The resulting dried plasma package came in two tin cans containing 400 mL bottles.", "One bottle contained enough distilled water to reconstitute the dried plasma contained within the other bottle.", "In about three minutes, the plasma would be ready to use and could stay fresh for around four hours.", "Dr. Charles R. Drew was appointed medical supervisor, and he was able to transform the test tube methods into the first successful technique for mass production.", "Another important breakthrough came in 1939\u201340 when Karl Landsteiner, Alex Wiener, Philip Levine, and R.E. Stetson discovered the Rhesus blood group system, which was found to be the cause of the majority of transfusion reactions up to that time.", "Three years later, the introduction by J.F." ] ], "gold": "In 1901, Karl Landsteiner discovered three human blood groups (O, A, and B), which made blood transfusions safer than they were prior to this . discovery. Another event that made blood transfusions even safer was in 1937\u201340 when Karl Landstiner, Alex Wiener, Philip Levine, and R.E. Stetson discovered the Rhesus blood group system, which was found to be the cause of the majority of transfusion reactions.", "prediction 1": "By the late 19th century, blood transfusion was regarded as a risky and dubious procedure, and was largely shunned by the medical establishment. However, blood transfusion became safer after Austrian Karl Landsteiner discovered three human blood groups (O, A, and B) and put them onto a scientific basis in 1901. Landsteiner discovered that adverse effects arise from mixing blood from two incompatible individuals. He found that when incompatible types are mixed, an immune response is triggered and the red blood cells clump. The introduction by J. Loutit and Patrick L. Mollison of acid-cit-dextrose solution, which reduced the volume of anticoagulant, permitted transfusions of greater volumes of blood and allowed longer term storage.", "prediction 2": "By the late 19th century, blood transfusion was regarded as a risky and dubious procedure, and was largely shunned by the medical establishment. However, it was not until 1901, when the Austrian Karl Landsteiner discovered three human blood groups (O, A, and B), that blood transfusion was put onto a scientific basis and became safer. Landsteiner discovered that adverse effects arise from mixing blood from two incompatible individuals. He found that when incompatible types are mixed, an immune response is triggered and the red blood cells clump.", "prediction 3": "In 1901, the Austrian Karl Landsteiner discovered three human blood groups (O, A, and B), which made it possible to determine blood group and allowed a way for blood transfusions to be carried out much more safely. Another important breakthrough came in 1939\u201340 when Karl Landsteiner, Alex Wiener, Philip Levine, and R.E. Stetson discovered the Rhesus blood group system, which was found to be the cause of the majority of transfusion reactions up to that time. Three years later, the introduction by J. Loutit and Patrick L. Mollison of acid-cit-dextrose (ACD) solution, which reduced the volume of anticoagulant, permitted transfusions of greater volumes of blood and allowed longer term storage.", "prediction 4": "By the late 19th century, blood transfusion was regarded as a risky and dubious procedure, and was largely shunned by the medical establishment. However, it wasn't until 1901, when the Austrian Karl Landsteiner discovered three human blood groups (O, A, and B), that blood transfusion was put onto a scientific basis and became safer. Landsteiner discovered that adverse effects arise from mixing blood from two incompatible individuals, and that when incompatible types are mixed, an immune response is triggered and the red blood cells clump. He found that when incompatible types are mixed, an immune response is triggered and the red blood cells clump.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 527 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 739 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "Blood transfusion became safer after Austrian Karl Landsteiner discovered three human blood groups (O, A, and B) and put them onto a scientific basis in 1901. Another important breakthrough came in 1939\u201340 when Karl Landsteiner, Alex Wiener, Philip Levine, and R.E. Stetson discovered the Rhesus blood group system, which was found to be the cause of the majority of transfusion reactions up to that time. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When did india gain independence from british rule?", "passages": [ [ "Indian independence movement", "The agitations, mass strikes, demonstrations and consequently support for the mutineers, therefore continued several days even after the mutiny had been called off.", "Along with this, the assessment may be made that it described in crystal clear terms to the government that the British Indian Armed forces could no longer be universally relied upon for support in crisis, and even more it was more likely itself to be the source of the sparks that would ignite trouble in a country fast slipping out of the scenario of political settlement.", "On 3 June 1947, Viscount Louis Mountbatten, the last British Governor-General of India, announced the partitioning of British India into India and Pakistan.", "With the speedy passage through the British Parliament of the Indian Independence Act 1947, at 11:57 on 14 August 1947 Pakistan was declared a separate nation, and at 12:02, just after\nmidnight, on 15 August 1947, India also became a sovereign and democratic nation.", "Eventually, 15 August became the Independence Day for India, due to the ending of British rule over India.", "On that 15 August, both Pakistan and India had the right to remain in or remove themselves from the British Commonwealth.", "In 1949, India decided to remain in the commonwealth.", "Violent clashes between Hindus, Sikhs and Muslims followed.", "Prime Minister Nehru and deputy prime minister Sardar Vallabhbhai Patel invited Mountbatten to continue as Governor General of India." ], [ "Indian independence movement", "The work of these various movements led ultimately to the Indian Independence Act 1947, which ended the suzerainty in India and the creation of Pakistan.", "India remained a Dominion of the Crown until 26 January 1950, when the \"Constitution of India\" came into force, establishing the Republic of India; Pakistan was a dominion until 1956, when it adopted its first republican constitution.", "In 1971, East Pakistan declared independence as the People's Republic of Bangladesh.", "European traders first reached Indian shores with the arrival of the Portuguese explorer Vasco da Gama in 1498 at the port of Calicut, in search of the lucrative spice trade.", "Just over a century later, the Dutch and English established trading outposts on the subcontinent, with the first English trading post set up at Surat in 1613.", "Over the course of the seventeenth and early eighteenth centuries, the British defeated the Portuguese and Dutch militarily, but remained in conflict with the French, who had by then sought to establish themselves in the subcontinent.", "The decline of the Mughal Empire in the first half of the eighteenth century provided the British with the opportunity to establish a firm foothold in Indian politics." ], [ "Indian independence movement", "Indian independence movement\n\nThe Indian independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent.", "The movement spanned a total of 90 years (1857\u20131947) considering movement against British Indian Empire.", "The Indian Independence movement includes both protest (peaceful and non-violent) and militant (violent) mechanisms to root out British Administration from India.", "The first organised militant movements were in Bengal, but they later took root in the newly formed Indian National Congress with prominent moderate leaders seeking only their basic right to appear for Indian Civil Service (British India) examinations, as well as more rights, economic in nature, for the people of the soil.", "The early part of the 20th century saw a more radical approach towards political self-rule proposed by leaders such as the Lal, Bal, Pal and Aurobindo Ghosh, V. O. Chidambaram Pillai.", "The last stages of the self-rule struggle from the 1920s onwards saw Congress adopt Mohandas Karamchand Gandhi's policy of nonviolence and civil disobedience, and several other campaigns.", "Nationalists like Subhash Chandra Bose, Bhagat Singh, Bagha Jatin preached armed revolution to achieve self-rule." ] ], "gold": "The Indian independence movement was a series of historical events to end British rule in India. The last stages of the self-rule struggle were characterized by the adoption of Mahatma Gandhi's policy of non-violence and civil disobedience, and several other campaigns. It all culminated on 15 August 1947, when, at 12:02 A.M., India officially became a sovereign and democratic nation when the Indian Independence Act was signed. The act finally gained royal assent on 18 July 1947, and India remained a Dominion of the Crown until 26 January 1950, when the \"Constitution of India\" came into force, establishing the Republic of India.", "prediction 1": "The Indian independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent. The Indian independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent. Indian independence day became the Independence Day for India, due to the ending of British Rule over India.", "prediction 2": "The Indian independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule 1757\u20131857 and the British Raj (1857\u20131947) in the Indian subcontinent. On 15 August 1947, both India and Pakistan were declared a separate nation and Eventually, 15 August became the Independence Day for India, due to the ending of British rule over India.", "prediction 3": "The Indian Independence Movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent. The Indian Independence Act 1947 ended the suzerainty in India and the creation of Pakistan. At noon on 15 August 1947, India also became a sovereign and democratic nation. Eventually, 15 August became the Independence Day for India, due to the ending of British Empire. India remained a Dominion of the Crown until 26 January 1950, when the Constitution of India was adopted its first republican constitution, establishing the Republic of India. In 1971, East Pakistan declared independence as the People's Republic of Bangladesh and the People's Republic of Bangladesh.", "prediction 4": "The Indian Independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent. The 15 August 1947 declaration of independence for India became the Independence Day for India, due to the ending of British rule over India.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 256 }, { "error type": "Redundant", "explanation": "The Indian independence movement was a series of activities whose ultimate aim was to end the British Raj and encompassed activities and ideas aiming to end the East India Company rule (1757\u20131857) and the British Raj (1857\u20131947) in the Indian subcontinent. ", "start": 257, "end": 513 }, { "error type": "Incoherent", "explanation": "", "start": 514, "end": 622 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Indian independence movement was a series of activities whose ultimate aim was to end the British Raj. The last stages of the self-rule struggle from the 1920s onwards saw Congress adopt Mohandas Karamchand Gandhi's policy of nonviolence and civil disobedience, and several other campaigns. the Indian Independence Act 1947, at 11:57 on 14 August 1947 Pakistan was declared a separate nation, and at 12:02, just after midnight, on 15 August 1947, India also became a sovereign and democratic nation. India remained a Dominion of the Crown until 26 January 1950, when the \"Constitution of India\" came into force, establishing the Republic of India. \n " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What is the restart if a goal kick does not leave the penalty area?", "passages": [ [ "Goal kick", "The goal-kick had to be taken from the half of the goal area nearest to the spot where the ball went out of play.", "This requirement was removed in 1992, when it was permitted to take the goal-kick from any point within the goal-area.", "This change was made in order to \"eliminate[] one of the common timewasting tactics\".", "In 1913 and 1914, the distance opponents were required to retreat was increased from six yards to ten yards.", "In 1948, opponents were required to be completely outside the penalty area when the goal-kick was taken.", "In 1936, after a proposal by the Scottish Football Association, a new restriction was added: it was specified that the goal-kick has to put the ball into play beyond the penalty area; if the ball does not leave the penalty area, the kick has to be retaken.", "The goalkeeper was also explicitly forbidden from \"receiv[ing] the ball into his hands from a goal-kick in order that he may thereafter kick it into play\".", "Amadeo Carrizo has been cited as the first goalkeeper to recognize the importance of the goal kick as a method of launching an attack.", "This table describes all free kicks awarded to the defending team after the ball goes out of play over the goal line, including the defensive corner kick from the 1872 laws." ] ], "gold": "Prior to 2019, if a goal kick does not leave the penalty area, the kick has to be retaken.In 2019, the requirement that the ball had to leave the penalty area was removed: the ball became in-play as soon as it was kicked.", "prediction 1": "In 1936, after a proposal by the Scottish Football Association, a new restriction was added: it was specified that the goal-kick has to put the ball into play beyond the penalty area; if the ball does not leave the penalty area, the kick has to be retaken.", "prediction 2": "In 1936, after a proposal by the Scottish Football Association, a new restriction was added: it was specified that the goal-kick has to put the ball into play beyond the penalty area; if the ball does not leave the penalty area, the kick has to be retaken. This penalty is known as the goal kick restart, as it has to be taken from the area where the ball went out of play before the restart.", "prediction 3": "In 1936, after a proposal by the Scottish Football Association, a new restriction was added: it was specified that the goal-kick has to put the ball into play beyond the penalty area; if the ball does not leave the penalty area, the kick has to be retaken. The Scottish Football Association proposed this change in 1934, and it was enacted in 1936.", "prediction 4": "The goal-kick has to be taken from the half of the goal area nearest to the spot where the ball went out of play. This requirement was removed in 1992, when it was permitted to take the goal-kick from any point within the goal-area. In 1936, after a proposal by the Scottish Football Association, a new restriction was added: it was specified that the goal-kick has to put the ball into play beyond the penalty area; if the ball does not leave the penalty area, the kick has to be retaken.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 9, "end": 183 } ], "missing-info": [], "corrected-prediction": "In 1936, if the ball does not leave the penalty area, the kick has to be retaken." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does the saying all quiet on the western front come from?", "passages": [ [ "All Quiet on the Western Front", "All Quiet on the Western Front\n\nAll Quiet on the Western Front () is a novel by Erich Maria Remarque, a German veteran of World War I.", "The book describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front.", "The novel was first published in November and December 1928 in the German newspaper \"Vossische Zeitung\" and in book form in late January 1929.", "The book and its sequel, \"The Road Back\" (1930), were among the books banned and burned in Nazi Germany.", "\"All Quiet on the Western Front\" sold 2.5 million copies in 22 languages in its first 18 months in print.", "In 1930, the book was adapted as an Academy-Award-winning film of the same name, directed by Lewis Milestone.", "It was adapted again in 1979 by Delbert Mann, this time as a television film starring Richard Thomas and Ernest Borgnine.", "The English translation by Arthur Wesley Wheen gives the title as \" All Quiet on the Western Front\".", "The literal translation of \"Im Westen nichts Neues\" is \"In the West Nothing New,\" with \"West\" being the Western Front; the phrase refers to the content of an official communiqu\u00e9 at the end of the novel." ], [ "All Quiet on the Western Front", "Brian Murdoch's 1993 translation would render the phrase as \"there was nothing new to report on the Western Front\" within the narrative.", "Explaining his retention of the original book-title, he says:\n", "Although it does not match the German exactly, Wheen's title has justly become part of the English language and is retained here with gratitude.", "The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context.", "The book tells the story of Paul B\u00e4umer who belongs to a group of German soldiers on the Western Front during World War I.", "The patriotic speeches of his teacher Kantorek had led the whole class to volunteer for military service shortly after the start of World War I.", "His class was \"scattered over the platoons amongst Frisian fishermen, peasants, and labourers.\"", "B\u00e4umer arrives at the Western Front with his friends and schoolmates (Leer, M\u00fcller, Kropp and a number of other characters).", "There they meet Stanislaus Katczinsky, an older soldier, nicknamed Kat, who becomes Paul's mentor.", "While fighting at the front, B\u00e4umer and his comrades have to engage in frequent battles and endure the treacherous and filthy conditions of trench warfare." ] ], "gold": "The saying \"all quiet on the western front\" comes from a German novel by Erich Maria titled Im Westen nichts Neues, which describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front. The English translation of the title done by Arthur Wesley Wheen is \"All Quiet on the Western Front\". The literal translation of \"Im Westen nichts Neues\" is \"Nothing New in the West.\" The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context.", "prediction 1": "The phrase all quiet on the western front comes from a novel that was written by a German veteran of World War I. It describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front. The English translation by Arthur Wesley Wheen gives the title as All Quiet on the Western Front. The literal translation of \"Im Westen nichts Neues\" is \"In the West Nothing New,\" with \"West\" being the Western Front; the phrase refers to the content of an official communiqu\u00e9 at the end of the novel.", "prediction 2": "All Quiet on the Western Front is a novel by Erich Maria Remarque, a German veteran of World War I. The book describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front. The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context.", "prediction 3": "All Quiet on the Western Front is a novel written by Erich Maria Remarque, a German veteran of World War I. The book describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front. The English translation by Arthur Wesley Wheen gives the title as \"All Quiet on the Western Front.\"", "prediction 4": "The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context. The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 521, "end": 604 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The phrase all quiet on the western front comes from a novel that was written by a German veteran Erich Maria Remarque of World War I. It describes the German soldiers' extreme physical and mental stress during the war, and the detachment from civilian life felt by many of these soldiers upon returning home from the front. The English translation by Arthur Wesley Wheen gives the title as All Quiet on the Western Front. The literal translation of \"Im Westen nichts Neues\" is \"In the West Nothing New,\" with \"West\" being the Western Front. The phrase \"all quiet on the Western Front\" has become a colloquial expression meaning stagnation, or lack of visible change, in any context." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does pati from pati's mexican table live?", "passages": [ [ "Pati Jinich", "Her father was an architect and a jeweler who turned restaurateur, and her mother ran an art gallery.", "Food was always an important part of Jinich's family life growing up.", "Her three older sisters pursued the culinary arts early on, but Jinich grew up dreaming of a career in academia.", "She earned a political science bachelor's degree from the Instituto Tecnol\u00f3gico Aut\u00f3nomo de M\u00e9xico and a master's degree in Latin-American studies from Georgetown University, and she worked as a political analyst at a Washington, DC, think tank before switching careers.", "She met her husband, Daniel Jinich, who is also Mexican, on a blind date.", "They were married in Mexico City in 1996 when she was 24.", "Jinich first began researching and cooking Mexican cuisine out of homesickness for her native Mexico City, when she moved to Dallas, Texas, with her husband.", "Soon, she was teaching Mexican cooking to friends and neighbors.", "At the same time, as she was writing her bachelor's thesis, she offered to help KERA, the Dallas public TV station, with a documentary on the Mexican Revolution, but they needed help with another project: the PBS series \"New Tastes from Texas\" with Chef Stephan Pyles, for which she became a production assistant." ], [ "Pati Jinich", "Pati Jinich\n\nPatricia Jinich (born March 30, 1972) is an award-winning Mexican chef, TV personality, cookbook author, and food writer.", "She is best known for her James Beard Award winning and Emmy nominated public television series \"Pati's Mexican Table\".", "Her first cookbook, also \"Pati's Mexican Table\", was published in March 2013 and her second cookbook, \"Mexican Today\", was published in April 2016.", "Jinich is the resident chef at the Mexican Cultural Institute in Washington, DC, where she has run her \"Mexican Table\" live culinary program since 2007.", "She has appeared on \"The Today Show\", \"The Chew\", \"The Talk\", \"CBS This Morning\", \"The Home and Family Show\", \"All Things Considered\", \"Morning Edition\", and \"The Splendid Table\" among other media.", "Her food writing has appeared in \"The Washington Post\".", "In May 2014, Jinich was invited to cook at the White House for President Barack Obama's Cinco de Mayo dinner.", "In May 2018, she cooked at the James Beard House in New York city for their Cinco de Mayo dinner.", "Jinich was born and raised in Mexico City in a Jewish Mexican family, and is the youngest of four sisters.", "Her grandparents were Jewish refugees from Eastern Europe." ], [ "Pati Jinich", "Two years later, she relocated to Washington, DC, with her husband and their first-born son, where she resumed her academic pursuits, earning her master's degree from Georgetown and landing her \"dream job\" at the Inter-American Dialogue, but she never stopped obsessively thinking about food and enrolled at L'Academie de Cuisine in Maryland.", "Jinich envisioned herself writing articles about Mexican cuisine and teaching it in her home kitchen, until she met with the executive director of the Mexican Cultural Institute in Washington, DC, who encouraged her to bring her cooking program to the institute.", "In 2007, she launched her \"Mexican Table\" series of live cooking demonstrations along with multi-course tasting dinners, which she still runs today.", "The classes combine Jinich's skilled Mexican cooking with her knowledge of the country's history and regions.", "Each one explores a single topic\u2014for example, dishes of the Mexican Revolution, a historical vanilla menu, or convent foods from colonial Mexico.", "Around the same time, she started her blog about Mexican cuisine, which was followed by invitations to write about food for print publications and to give talks and cooking demos for radio and TV shows.", "Jinich's charisma and intelligence caught the attention of television producers." ] ], "gold": "Pati Jinich from Pati's Mexican Table lives in Chevy Chase, Maryland, with her husband and their three sons. Jinich was born and raised in Mexico City in a Jewish Mexican family. She first began researching and cooking Mexican cuisine out of homesickness for her native Mexico City when she moved to Dallas, Texas, with her husband. Two years later, she relocated to Washington, DC, with her husband and their first-born son. Here she earned her master's degree from Georgetown University and worked as a political analyst for the Inter-American Dialogue before enrolling at L'Academie de Cuisine in Maryland and switching careers.", "prediction 1": "Pati Jinich is an award-winning Mexican chef, TV personality, cookbook author, and food writer best known for her public television series \"Pati's Mexican Table\". She is the resident chef at the Mexican Cultural Institute in Washington, DC, where she has run her \"Mexican Table\" live culinary program since 2007. She was born and raised in Mexico City in a Jewish Mexican family, and is the youngest of four sisters.", "prediction 2": "Pati Jinich is an award-winning Mexican chef, TV personality, cookbook author, and food writer best known for her James Beard Award winning and Emmy nominated public television series \"Pati's Mexican Table.\" Jinich is the resident chef at the Mexican Cultural Institute in Washington, DC, where she has run her \"Mexican Table\" live culinary program since 2007. Two years later, she relocated to New York City with her husband and their first-born son, where she resumed her academic pursuits, earning her master's degree from Georgetown University.", "prediction 3": "Pati Jinich is an award-winning Mexican chef, TV personality, cookbook author, and food writer best known for her James Beard Award winning and Emmy nominated public television series \"Pati's Mexican Table\". Jinich is the resident chef at the Mexican Cultural Institute in Washington, DC, where she has run her Mexican Table live culinary program since 2007. Jinich was born and raised in Mexico City in a Jewish Mexican family, and is the youngest of four sisters.", "prediction 4": "Patricia Jinich is an award-winning Mexican chef, TV personality, cookbook author, and food writer. Jinich is the resident chef at the Mexican Cultural Institute in Washington, DC, where she has run her \"Mexican Table\" live culinary program since 2007. Jinich was born and raised in Mexico City in a Jewish Mexican family, and is the youngest of four sisters. Her grandparents were Jewish refugees from Eastern Europe. In 2017, she moved to Los Angeles with her husband Daniel Jinich, whom she married in 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 416 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Pati Jinich is an award-winning Mexican chef, best known for her public television series \"Pati's Mexican Table\". She was born and raised in Mexico City in a Jewish Mexican family. Jinich first began researching and cooking Mexican cuisine out of homesickness for her native Mexico City, when she moved to Dallas, Texas, with her husband. Later, she relocated to Washington, DC, with her husband and their first-born son, where she resumed her academic pursuits, earning her master's degree from Georgetown and landing her \"dream job\" at the Inter-American Dialogue, but she never stopped obsessively thinking about food and enrolled at L'Academie de Cuisine in Maryland." }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Who is the original singer of sweet child of mine?", "passages": [ [ "Sweet Child o' Mine", "The story went viral quickly, encouraging several comments on both the MAX article and the suggestion that \"Unpublished Critics\" had influenced \"Sweet Child o' Mine\", including one from Duff McKagan, bass player with Guns N' Roses when \"Sweet Child o' Mine\" was written and recorded.", "McKagan found the similarities between the songs \"stunning,\" but said he had not previously heard \"Unpublished Critics.\"", "The song was covered by Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, \"The Globe Sessions\".", "This version earned her a Grammy Award for Best Female Rock Vocal Performance.", "The recording was produced by Rick Rubin and Crow.", "A music video for Crow's version was also released, directed by St\u00e9phane Sednaoui.", "Crow performed the song live at Woodstock '99.", "Ultimate Classic Rock profiled the song as part of a series on \"Terrible Classic Rock Covers\", and \"Rolling Stone\" readers named it the 4th worst cover song of all-time.", "\"Sweet Child O' Mine\" has been used in several films, such as:" ], [ "Sweet Child o' Mine", "Lead singer Axl Rose was listening to the musicians upstairs in his room and was inspired to write lyrics, which he completed by the following afternoon.", "He based it on his girlfriend Erin Everly, and declared that Lynyrd Skynyrd served as an inspiration \"to make sure that we'd got that heartfelt feeling\".", "On the next composing session in Burbank, the band added a bridge and a guitar solo.", "When the band recorded demos with producer Spencer Proffer, he suggested adding a breakdown at the song's end.", "The musicians agreed, but were not sure what to do.", "Listening to the demo in a loop, Rose started saying to himself, \"Where do we go?", "Where do we go now?\" and Proffer suggested that he sing that.", "The \"Sweet Child o' Mine\" video depicts the band rehearsing in the Huntington Ballroom at Huntington Beach, surrounded by crew members.", "All of the band members' girlfriends at the time were shown in the clip: Rose's girlfriend Erin Everly, whose father is Don Everly of The Everly Brothers; McKagan's girlfriend Mandy Brix, from the all-female rock band the Lame Flames; Stradlin's girlfriend Angela Nicoletti; Adler's girlfriend Cheryl Swiderski; and Slash's girlfriend Sally McLaughlin." ] ], "gold": "\"Sweet Child o' Mine\" is a song by American rock band Guns N' Roses. Lead singer Axl Rose wrote and performed the lyrics for the song.", "prediction 1": "Sweet Child o' Mine was originally sung by Axl Rose and the band Guns N' Roses. The song was covered by Sheryl Crow on the soundtrack to Big Daddy, and released as a bonus track on her third studio album, The Globe Sessions. The music video for Crow's version was also released, directed by St\u00e9phane Sednaoui.\n", "prediction 2": "Axl Rose was the lead singer of Sweet Child o' Mine, and the specific lyrics to the song were written by him.", "prediction 3": "Sweet Child o' Mine was originally written by Axl Rose and recorded by Guns N' Roses. Lead singer Axl Rose was listening to the musicians upstairs in his room and was inspired to write lyrics, which he completed by the following afternoon. Axl Rose based it on his girlfriend Erin Everly, whose father is Don Everly of The Everly Brothers. In 2010, Axl Rose and Rolling Stone Magazine named it the worst cover song of all time.", "prediction 4": "Sweet Child o' Mine originated with Axl Rose and the Stone Roses and was originally sung by Rose. The song was later covered by Sheryl Crow for the soundtrack to Big Daddy and released as a bonus track on her third studio album, The Globe Sessions. The video for Crow's version was also released, directed by St\u00e9phane Sednaoui.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 310 } ], "missing-info": [], "corrected-prediction": "Sweet Child o' Mine was originally sung by Axl Rose and the band Guns N' Roses.\n" }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "What was the dog called in neverending story?", "passages": [ [ "The NeverEnding Story (film series)", "The NeverEnding Story (film series)\n\nThe NeverEnding Story (German: \"Die unendliche Geschichte\") is a West German-produced English language epic fantasy film series based on the novel of the same name by Michael Ende.", "The original 1984 film, \"The NeverEnding Story\", was directed and co-written by Wolfgang Petersen and was later followed by two sequels.", "The first film adapted the first half of the original novel, the second half of the novel was used as the basis for the second film, \"\".", "The third film in the series, \"The NeverEnding Story III\", has an original plot." ], [ "The NeverEnding Story (film)", "Though the Auryn protects Atreyu, his beloved horse Artax is lost to the swamp, and he continues alone.", "Later, Atreyu is surprised by the sudden appearance of Morla, a giant turtle.", "Bastian, reading, is also surprised and lets out a scream, which Atreyu and Morla appear to hear.", "Morla does not have the answers Atreyu seeks, but directs him to the Southern Oracle, ten thousand miles distant.", "Atreyu succumbs to exhaustion trying to escape the Swamps but is saved by the luckdragon Falkor.", "Falkor takes him to the home of two gnomes that live near the entrance to the Southern Oracle.", "The gnomes explain that Atreyu will face various trials before reaching the Oracle.", "Atreyu gets past the first trial, but is perplexed by the second trial, a mirror that shows the viewer's true self, reveals a boy which Bastian recognizes as himself.", "Bastian throws the book aside, but after catching his breath, continues to read.", "Atreyu eventually meets the Southern Oracle who tells him the only way to save the Empress is to find a human child to give her a new name, beyond the boundaries of Fantasia.", "Atreyu and Falkor flee before the Nothing consumes the Southern Oracle." ], [ "The Neverending Story", "At the advice of the giant turtle, Morla the Aged One, Atreyu sets off in search of an invisible oracle known as Uyulala, who may know the Empress's cure.", "In reaching her, he is aided by a luckdragon named Falkor, whom he rescues from the monster 'Ygramul the Many'.", "By Uyulala, he is told the only thing that can save the Empress is a new name given to her by a human child, who can only be found beyond Fantastica's borders.", "As Falkor and Atreyu search for the borders of Fantastica, Atreyu is flung from Falkor's back in a confrontation with the four Wind Giants and loses AURYN in the sea.", "Atreyu lands in the ruins of Spook City, the home of various wicked creatures.", "Injured by the fall and stranded in the dangerous city, Atreyu finds the wolf G'mork, chained and near death, who tells him that all the residents of the city have leapt voluntarily into The Nothing.", "There, thanks to the irresistible pull of the destructive phenomenon, they have become lies in the human world.", "The wolf also reveals that he is a servant of The Manipulators, the force behind The Nothing.", "They wish to prevent the Empress's chosen hero from saving her." ] ], "gold": "The Neverending Story is a fantasy novel by German writer Michael Ende, published in 1979, which has been adapted into several films and a TV series. Falkor, or Fuchur in German, is a companion of Atreyu and Bastian who is a white dog-like luckdragon. He appears in the 1984 film The Neverending Story, as well as the 1990 sequel The Neverending Story II: The Next Chapter and the TV series.", "prediction 1": "The NeverEnding Story is a West German-produced English language epic fantasy film series that is based on the novel of the same name by Michael Ende. In the 1984 film, Atreyu is saved by the luckdragon Falkor. Falkor takes him to the home of two gnomes that live near the entrance to the Southern Oracle. Here Atreyu finds the wolf G'mork, chained and near death, who tells him that all the residents of the city have leapt voluntarily into The Nothing.", "prediction 2": "The NeverEnding Story is a West German-produced English language epic fantasy film series based on the novel of the same name by Michael Ende. The 1984 film adaptation of the 1984 novel by Michael Ende was directed by Wolfgang Petersen and was later followed by two sequels. In the first film, the character Atreyu is saved by the luckdragon Falkor, whom he rescues from the monster 'Ygramul the Many'. In the second film, the character G'mork is saved from the monster Ygramulul the Many. In the third film, the character is a dog named Aura. In the final film, G'mork is a dog that is a dog that is called Auri. The dog is named Aurryn. The dog is named after the character Aurryn.", "prediction 3": "The NeverEnding Story is a 1984 West German-produced English language epic fantasy film series based on the novel of the same name by Michael Ende. In the film, the dog G'mork is a wolf chained and near death, who tells Atreyu that all the residents of the city have leapt voluntarily into The Nothing. The wolf also reveals that he is a servant of The Manipulators, the force behind The Nothing.", "prediction 4": "The NeverEnding Story is a West German-produced English language epic fantasy film series based on the novel of the same name by Michael Ende. The original 1984 film, The NeverEnding Story, was directed and co-written by Wolfgang Petersen and was later followed by two sequels. The first film adapted the first half of the original novel, the second half of the novel was used as the basis for the second film. The third film, The NeverEnding Story III, has an original plot.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 27, "end": 77 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 454 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 187 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The NeverEnding Story is a film series that is based on the novel of the same name by Michael Ende. In the 1984 film, Atreyu travels with the luckdragon Falkor." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When was the titan built at six flags?", "passages": [ [ "Titan (roller coaster)", "Titan (roller coaster)\n\nTitan is a steel hyper coaster located at Six Flags Over Texas in Arlington, Texas.", "Unlike most hypercoasters, Titan is a combination of an out and back roller coaster and a twister roller coaster.", "It stands at 245 feet and contains a 255 drop at 85 miles per hour.", "It is the tallest, fastest, and longest coaster in Texas.", "Six Flags Over Texas had plans to add a hypercoaster to the park for several years.", "An early proposal from Arrow Dynamics showed a hypercoaster over the park's reservoir next to Judge Roy Scream.", "In August 2000, Six Flags Over Texas announced plans to build a new steel roller coaster for the park's 40th anniversary.", "Although no statistics were revealed, information that was released confirmed Giovanola as the manufacturer, that the new coaster would be similar to Goliath at Six Flags Magic Mountain and that it would be built in the Texas section of the park.", "As survey markers began to appear in September it became clear that the new coaster would extend from the Texas section to the employee cantina, pool and softball fields then out into the parking lot.", "By the time the official announcement was made on November 14, 2000, the employee areas had been demolished, excavation had already begun and teal-colored supports were stacked in the parking lot." ] ], "gold": "Titan is a steel roller coaster located at Six Flags Over Texas in Arlington, Texas. Construction for the coaster was started on November 14, 2000 and completed in March, 2001. The ride opened on April 27, 2001 as the tallest, fastest, and longest roller coaster in Texas.", "prediction 1": "Titan is a steel hyper coaster located at Six Flags Over Texas in Arlington, Texas. In August 2000, Six Flags Over Texas announced plans to build a new steel roller coaster for the park's 40th anniversary. Although no statistics were revealed, information that was released confirmed Giovanola as the manufacturer, that the new coaster would be similar to Goliath at Six Flags Magic Mountain and that it would be built in the Texas section of the park. By the time the official announcement was made on November 14, 2000, the employee areas had been demolished, excavation had already begun and teal-colored supports stacked.", "prediction 2": "When the Titan was announced to be built on November 14, 2000, the employee areas at Six Flags Over Texas had been demolished and excavation had already begun.", "prediction 3": "In August 2000, Six Flags Over Texas announced plans to build a new steel roller coaster for the park's 40th anniversary. The coaster was built in the Texas section of the park. The employee areas at Six Flags Over Texas were demolished by the time the announcement was made on November 14, 2000.", "prediction 4": "In August 2000, Six Flags Over Texas announced plans to build a new steel roller coaster for the park's 40th anniversary. By the time the official announcement was made on November 14, 2000, the employee areas had been demolished, excavation had already begun and teal-colored supports stacked in the parking lot.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 205 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 452 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Titan is a steel hyper coaster located at Six Flags Over Texas in Arlington, Texas. It is the tallest, fastest, and longest coaster in Texas. By the time the official announcement was made on November 14, 2000, the employee areas had been demolished, excavation had already begun and teal-colored supports stacked." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Who sings tis so sweet to trust in jesus with alan jackson?", "passages": [ [ "'Tis So Sweet to Trust in Jesus", "'Tis So Sweet to Trust in Jesus\n\n\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead.", "The lyrics were written in 1882.", "They appeared in Stead's \"Songs of Triumph\".", "The song is included in many hymnals and has been recorded by many artists.", "\u2019Tis so sweet to trust in Jesus,\nJust to take Him at His Word;\nJust to rest upon His promise,\nJust to know, \"Thus says the Lord!\"", "Refrain\nJesus, Jesus, how I trust Him!", "How I\u2019ve proved Him o\u2019er and o\u2019er\nJesus, Jesus, precious Jesus!", "O for grace to trust Him more!", "O how sweet to trust in Jesus,\nJust to trust His cleansing blood;\nJust in simple faith to plunge me\n\u2019Neath the healing, cleansing flood!", "Refrain\n\nYes, \u2019tis sweet to trust in Jesus,\nJust from sin and self to cease;\nJust from Jesus simply taking\nLife and rest, and joy and peace.", "Refrain\n\nI\u2019m so glad I learned to trust Thee,\nPrecious Jesus, Savior, Friend;\nAnd I know that Thou art with me,\nWilt be with me to the end.", "Refrain" ], [ "Precious Memories (Alan Jackson album)", "Precious Memories (Alan Jackson album)\n\n", "Precious Memories is the thirteenth studio album and the first gospel album by American country music artist Alan Jackson.", "It was released on February 28, 2006 on the Arista Nashville label.", "Unlike his previous albums, this is a side project composed of traditional gospel songs.", "Although no singles were released from it, \"Precious Memories\" earned a Platinum certification by the Recording Industry Association of America (RIAA).", "A second volume, \"Precious Memories Volume II\", was released on March 26, 2013.", "All tracks Traditional except where noted.", "As listed in liner notes.", "\"Precious Memories\" debuted at No. 4 on the U.S. \"Billboard\" 200, and No. 1 on the Top Country Albums, becoming his eighth #1 country album.", "In August 2006, \"Precious Memories\" was certified Platinum by the RIAA.", "It has sold 389,600 copies in the United States as of November 2017.", "In 2007, the album won a Dove Award for Country Album of the Year at the 38th GMA Dove Awards." ] ], "gold": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. The song was featured on American country music artist Alan Jackson's first gospel album, Precious Memories. Mattie Jackson, Denise Jackson and Ali Jackson sing backing vocals in the Alan Jackson version. Dani Jackson sings assistant backing vocals in the song.", "prediction 1": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. The lyrics were written in 1882. The song is included in many hymnals and has been recorded by many artists.", "prediction 2": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. The lyrics were written in 1882. The song is included in many hymnals and has been recorded by many artists. Refrain Jesus, Jesus, how I trust Him! How I\u2019ve proved Him o\u2019er and o\u2019er Jesus, Jesus, precious Jesus! O for grace to trust Him more! O how sweet to trust in Jesus, Just from his cleansing blood!", "prediction 3": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. The lyrics were written in 1882. The song is included in many hymnals and has been recorded by many artists. \" Precious Memories, Alan Jackson's thirteenth studio album and the first gospel album, features traditional gospel songs.", "prediction 4": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. The lyrics were written in 1882. The song is included in many hymnals and has been recorded by many artists. Refrain Jesus, Jesus, how I trust Him! How I\u2019ve proved Him o\u2019er and o\u2019er Jesus, Jesus, precious Jesus! O for grace to trust Him more! O how sweet to trust in Jesus, Just from Jesus simply taking Life and rest upon His cleansing blood! Refrain I\u2019m so glad I learned to trust Thee, Precious Memories Volume II, and I\u2019m so glad I learned To trust Thee, Precious Memories, becoming his eighth #1 country album.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 233 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"'Tis So Sweet to Trust in Jesus\" is a Christian hymn with music by William J. Kirkpatrick and lyrics by Louisa M. R. Stead. Precious Memories is the first gospel album by American country music artist Alan Jackson." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won rookie of the year nfl 2016?", "passages": [ [ "National Football League Rookie of the Year Award", "National Football League Rookie of the Year Award\n\nVarious entities present a National Football League Rookie of the Year Award each season to the top rookie(s) in the National Football League (NFL).", "The NFL considers the rookie of the year awards by the Associated Press (AP) to be its official honor.", "The AP awards and Pepsi's rookie of the year award are presented each year at the NFL Honors.", "The Pepsi NFL Rookie of the Year award is an annual award given since 2002 to the top rookie in the NFL.", "The winner is selected by fans through an online voting process at NFL.com.", "Every week during the NFL regular season, five finalists are chosen for the Pepsi NFL Rookie of the Week award, and the winner is determined by fan voting online.", "Those results are used to help determine the finalists for the Rookie of the Year award.", "Voting occurs throughout the postseason and concludes the week before the Super Bowl.", "More than 350,000 votes were cast for the inaugural award in 2002, 1.002 million votes in 2009, and more than 1.59 million votes in 2010.", "Since 2011, the winner of the Pepsi Rookie of the Year award is announced at the NFL Honors show the night before the Super Bowl." ], [ "Trevor Siemian", "The Broncos took a 24\u20137 lead, but two costly turnovers helped the Chargers make the score 24\u201321, but Broncos defensive end Shelby Harris blocked the Chargers attempt at a game-tying field goal from Younghoe Koo, giving the Broncos the win.", "The following week, Siemian and the Broncos hosted the Dallas Cowboys, led by 2016 Offensive Rookie of the Year Dak Prescott and 2016 leading rusher Ezekiel Elliott.", "The Broncos defense shut down Dallas' offense and Siemian went 22-of-32 for 231 yards, a career-high tying four touchdowns, and one interception as the Broncos blew out the Cowboys 42\u201317.", "For his performance, Siemian was voted the NFL's Clutch Performer of the week and the FedEx Air Player of the week.", "During Week 6 against the New York Giants on \"NBC Sunday Night Football\", Siemian briefly left the game with a left shoulder injury near the end of the second quarter.", "He came back in the game in the third quarter, but two interceptions and a fumble still proved to be costly as the Broncos lost by a score of 23\u201310, despite Siemian having a career-high 376 passing yards." ] ], "gold": "Various entities present a National Football League Rookie of the Year Award each season to the top rookies in the NFL. The NFL considers the Associated Press to be the official determination on the award. For 2016, Dak Prescott was the NFL Offensive Rookie of the Year and Joey Bosa was the NFL Defensive Rookie of the Year.", "prediction 1": "The National Football League has awarded several rookie of the year awards each season. In 2016, the Pepsi NFL Rookie of the Year award was given to Trevor Siemian.", "prediction 2": "The National Football League has awarded several rookie of the year awards. The Pepsi NFL Rookie of the Year award is given each year since 2002 to the top rookie in the NFL. Various entities present a National Football League Rookie of the Year Award each season to the top rookie(s) in the NFL. In 2016, Trevor Siemian was named the winner.", "prediction 3": "The National Football League recognizes a top rookie each season, with Trevor Siemian winning in 2016. The Pepsi NFL Rookie of the Year award is presented each year at the NFL Honors.", "prediction 4": "The National Football League has given several rookie of the year awards, including the Associated Press Rookie of the Year award in 2002, the Pepsi Rookie of the Year award in 2009, and the Pepsi Rookie of the Year award in 2010. From 2009 to 2010, the Pepsi Rookie of the Year award has been given annually to the top rookie in the NFL. In 2016, the Pepsi Rookie of the Year award was won by Brandon Graham, Trevor Siemian was awarded, and Ezekiel Elliott was named Rookie of the Year, and the Pepsi Rookie of the year. The Pepsi Rookie of the Year award was presented by NFL Honors show.com.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 88, "end": 164 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Various entities present a National Football League Rookie of the Year Award each season to the top rookies in the NFL. The NFL considers the rookie of the year awards by the Associated Press (AP) to be its official honor. For 2016, Dak Prescott was the NFL Offensive Rookie of the Year." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Last time france won the football world cup?", "passages": [ [ "France at the FIFA World Cup", "France at the FIFA World Cup\n\n", "This is a record of France's results at the FIFA World Cup.", "France was one of the four European teams that participated at the inaugural World Cup in 1930 and have appeared in 15 FIFA World Cups, tied for the sixth most of any country.", "The national team is one of eight to have won the FIFA World Cup title and one of only six to have done so more than once.", "The French team won its first World Cup title in 1998.", "The tournament was played on home soil and France defeated Brazil 3\u20130 in the final match.", "The tournament was hosted in France once before in 1938, where France was eliminated by defending champions Italy in the quarter finals.", "In 2006, France finished as runners-up, losing on penalties (5\u20133) to Italy after the game was tied 1\u20131 after 120 minutes.", "The team has also finished in third place on two occasions, in 1958 and 1986, and in fourth place once, in 1982.", "In 2018 France won the World Cup for the second time 4\u20132 against Croatia in Luzhniki Stadium, Russia.", "The 1998 final was held on 12 July at the Stade de France, Saint-Denis.", "France defeated holders Brazil 3\u20130, with two goals from Zinedine Zidane and a stoppage time strike from Emmanuel Petit." ], [ "FIFA World Cup", "FIFA World Cup\n\nThe FIFA World Cup, often simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the \"\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the inaugural tournament in 1930, except in 1942 and 1946 when it was not held because of the Second World War.", "The current champion is France, which won its second title at the 2018 tournament in Russia.", "The current format of the competition involves a qualification phase, which currently takes place over the preceding three years, to determine which teams qualify for the tournament phase, which is often called the \"World Cup Finals\".", "After this, 32 teams, including the automatically qualifying host nation(s), compete in the tournament phase for the title at venues within the host nation(s) over a period of about a month.", "The 21 World Cup tournaments have been won by eight national teams.", "Brazil have won five times, and they are the only team to have played in every tournament.", "The other World Cup winners are Germany and Italy, with four titles each; Argentina, France and inaugural winner Uruguay, with two titles each; and England and Spain with one title each." ] ], "gold": "France last won the World Cup in 2018. They are the current World Cup champions, and this was France's second World Cup title. The French team won its first World Cup title in 1998. France was one of four European teams that participated in the inaugural World Cup in 1930. France has appeared in 15 World Cups, tied for the sixth most of any country. The eight Women's World Cup tournaments have been won by four national teams. These teams are the United States, Germany, Japan and Norway. ", "prediction 1": "The FIFA World Cup, often simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the \"FIFA\", the sport's global governing body. France has won the football world cup four times, most notably in 1998, 1998-2000, and 2018. The last time France won the football world cup was 1998. The last time France won the football world cup was 1998.", "prediction 2": "The FIFA World Cup, more simply called the World Cup, is an international association football competition contested by the senior men's national teams of the members of the FIFA, the sport's global governing body. The last time France won the football world cup was in 1998 with a victory over Brazil at the Stade de France, Saint-Denis. This was followed by a 2-0 victory against Croatia in the semi finals in 2018.", "prediction 3": "France has won the FIFA World Cup on several occasions; in 1998, the team defeated holders Brazil 3\u20130 in the final match. The last time France won the football World Cup was 1998, when they defeated Argentina 2-0 in the final match. The last time France won the football World Cup was in 2002, when they defeated Argentina 2-1 in the final match.", "prediction 4": "The FIFA World Cup is an international association football competition contested by the senior men's national teams of the members of the \" and the sport's global governing body. The last time France won the football world cup was in 1998, when the tournament was played on home soil and France defeated holders Brazil 3\u20130 in the final match. The last time France won the football world cup was in 2016 when the tournament was played in Russia. The last time France won the football world cup was in 2008.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 311, "end": 368 }, { "error type": "Redundant", "explanation": "The last time France won the football world cup was 1998. ", "start": 369, "end": 426 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 280 }, { "error type": "Unverifiable", "explanation": "", "start": 290, "end": 300 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "France last won the World Cup in 2018. They are the current World Cup champions, and this was France's second World Cup title. The French team won its first World Cup title in 1998. France was one of the four European teams that participated at the inaugural World Cup in 1930 and have appeared in 15 FIFA World Cups, tied for the sixth most of any country. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who controls the house of representatives right now?", "passages": [ [ "United States House of Representatives", "In the mid-1970s, there were major reforms of the House, strengthening the power of sub-committees at the expense of committee chairs and allowing party leaders to nominate committee chairs.", "These actions were taken to undermine the seniority system, and to reduce the ability of a small number of senior members to obstruct legislation they did not favor.", "There was also a shift from the 1990s to greater control of the legislative program by the majority party; the power of party leaders (especially the Speaker) grew considerably.", "The Republicans took control of the House in 1995, under the leadership of Speaker Newt Gingrich.", "Gingrich attempted to pass a major legislative program, the Contract with America, on which the House Republicans had been elected, and made major reforms of the House, notably reducing the tenure of committee chairs to three two-year terms.", "Many elements of the Contract did not pass Congress, were vetoed by President Bill Clinton, or were substantially altered in negotiations with Clinton.", "However, after Republicans held control in the 1996 election, Clinton and the Gingrich-led House agreed on the first balanced federal budget in decades, along with a substantial tax cut.", "The Republicans held on to the House until 2006, when the Democrats won control and Nancy Pelosi was subsequently elected by the House as the first female Speaker." ], [ "United States House of Representatives", "After the whips, the next ranking official in the House party's leadership is the Party Conference Chair (styled as the Republican Conference Chair and Democratic Caucus Chair).", "After the Conference Chair, there are differences between each party's subsequent leadership ranks.", "After the Democratic Caucus Chair is the Campaign Committee Chair (Democratic Congressional Campaign Committee), then the co-chairs of the Steering Committee.", "For the Republicans it is the Chair of the House Republican Policy Committee, followed by the Campaign Committee Chairman (styled as the National Republican Congressional Committee).", "The chairs of House committees, particularly influential standing committees such as Appropriations, Ways and Means, and Rules, are powerful but not officially part of House leadership hierarchy.", "Until the post of Majority Leader was created, the Chair of Ways and Means was the \"de facto\" majority leader.", "When the Presidency and Senate are controlled by a different party from the one controlling the House, the Speaker can become the \"de facto\" \"leader of the opposition\".", "Some notable examples include Tip O'Neill in the 1980s, Newt Gingrich in the 1990s, and John Boehner in the 2010s.", "Since the Speaker is a partisan officer with substantial power to control the business of the House, the position is often used for partisan advantage." ], [ "116th United States Congress", "116th United States Congress\n\nThe One Hundred Sixteenth United States Congress is the next meeting of the legislative branch of the Federal government of the United States, composed of the United States Senate and the United States House of Representatives.", "It is scheduled to meet in Washington, D.C., from January 3, 2019, to January 3, 2021, during the third and fourth years of Donald Trump's current term as president.", "In the 2018 midterm elections, the Democratic Party won the majority in the House of Representatives and will have a preponderance of voting influence in selecting the next Speaker.", "In the Senate, the Republican Party increased its majority, giving the U.S. a split Congress.", "As of the beginning of the Congress in January 3, 2019, most members of this Congress are Christians.", "Of them, approximately half are Protestant.", "Other religions include Judaism, Buddhism, Islam, and Hinduism.", "75 senators are men, and 25 are women, the highest number of female senators ever.", "For the first time in history, both senators from six states are women, including California, Washington, Nevada, Arizona, Minnesota, and New Hampshire.", "Additionally, thirteen states are represented by one male and one female senator, while 31 states are represented by two male senators.", "91 senators are white, 4 are Hispanic, 2 are black, 2 are Asian, and 1 is both black and Asian." ] ], "gold": "The 117th United States Congress is the current meeting of the legislative branch of the United States federal government. It convened in Washington, D.C., on January 3, 2021, and will end on January 3, 2023. In the House of Representatives, The Democratic Party has the majority. Democrat Nancy Pelosi is the current Speaker of the House who controls the House of Representatives. She was elected to this position by the entire House membership. This position is partisan, and the Speaker often plays an important part in running the House and advancing a political platform.", "prediction 1": "In the United States, the Speaker of the House is a Democrat. The Republican Party controls the House of Representatives. In the 2018 midterm elections, the Democratic Party won the majority in the House of Representatives. If the party that controls the House loses its majority, then the Speaker of the House becomes the de facto leader of the opposition. The Speaker currently controls the House of Representatives in 2019.", "prediction 2": "The United States House of Representatives is the legislative branch of the Federal government of the United States, composed of the United States Senate and the United States House of Representatives. The current speaker is Nancy Pelosi, and the current majority party is the Democratic Party. In the midterm elections of 2018, the Democratic Party won the majority in the House of Representatives and will have a preponderance of voting influence in selecting the next Speaker.", "prediction 3": "The United States House of Representatives is the legislative branch of the United States federal government, composed of the United States Senate and the United States House of Representatives. The current Speaker of the house is Nancy Pelosi and the current majority party is the Democratic Party. In the 2018 midterm elections, the Democratic Party won the majority in the House of Representatives, while the current minority party is controlled by the Republican Party.", "prediction 4": "The United States House of Representatives is the lower chamber of the United States federal government. In the current session, the Democratic Party controls the majority of the House, and the Republican Party controls the majority.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 62, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 357 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 358, "end": 369 }, { "error type": "Redundant", "explanation": "In the 2018 midterm elections, the Democratic Party won the majority in the House of Representatives. ", "start": 370, "end": 426 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "116th United States Congress is the next meeting of the legislative branch of the Federal government of the United States. It is scheduled to meet in Washington, D.C., from January 3, 2019, to January 3, 2021. In the United States, the Speaker of the House is a Democrat. In the 2018 midterm elections, the Democratic Party won the majority in the House of Representatives. The Speaker is a partisan officer with substantial power to control the business of the House. Nancy Pelosi was elected by the House as the Speaker.\n" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who cut down the trees in the lorax?", "passages": [ [ "The Lorax (film)", "At first keeping his promise, the Once-ler continues Thneed production by harvesting the Truffula tree tufts in a slow, but sustainable manner.", "However, his greedy and lazy relatives soon convince him to resume chopping down the trees.", "Over time, the Once-ler's deforestation spirals into a mass overproduction.", "Flushed with wealth, the Once-ler rationalizes his short-sighted needs into arrogant self-righteousness, and the Lorax's helpless protests do not stop him.", "The Once-ler pollutes the sky, river, and landscape, until the very last Truffula tree falls.", "With no further chance of business, he is left broken and his money-broke mother disowns him.", "With the region uninhabitable because of the pollution and deforestation from the Once-ler's business, the Lorax sends the animals off to find a new place to live before the Once-ler sees him depart into the sky, leaving only a stone-cut word: \"Unless\".", "Distraught and ruined, the Once-ler becomes a recluse." ], [ "The Lorax", "The Lorax\n\nThe Lorax is a children's book written by Dr. Seuss and first published in 1971.", "It chronicles the plight of the environment and the Lorax, who speaks for the trees against the Once-ler.", "As in most Dr. Seuss works, most of the creatures mentioned are original to the book.", "The book is commonly recognized as a fable concerning the danger corporate greed poses to nature, using the literary element of personification to give life to industry as the Once-ler and the environment as the Lorax.", "\"The Lorax\" was Dr. Seuss's personal favorite of his books.", "He was able to create a story addressing economic and environmental issues without it being dull.", "\"\"The Lorax\",\" he once explained, \"came out of me being angry.", "In \"The Lorax\" I was out to attack what I think are evil things and let the chips fall where they might.\"", "A boy living in a polluted area visits a strange isolated man called the Once-ler on the Street of the Lifted Lorax.", "The boy pays the Once-ler fifteen cents, a nail, and the shell of a great-great-great grandfather snail to hear the legend of how the Lorax was lifted and taken away." ], [ "The Lorax (film)", "The Lorax (film)\n\n", "The Lorax (also known as Dr. Seuss' The Lorax) is a 2012 American 3D computer-animated musical fantasy film produced by Illumination Entertainment and based on Dr. Seuss's children's book of the same name.", "The film was released by Universal Pictures on March 2, 2012, on what would have been Seuss's 108th birthday.", "The second adaptation of the book (following the 1972 animated television special), the film builds on the book by expanding the story of the Lorax and Ted, the previously unnamed boy who visits the Once-ler.", "The cast includes Danny DeVito as the Lorax, Ed Helms as the Once-ler and Zac Efron as Ted.", "New characters introduced in the film are Audrey, Ted's love interest (voiced by Taylor Swift), Aloysius O'Hare (Rob Riggle), Mrs. Wiggins, Ted's mother (Jenny Slate), and Grammy Norma, Ted's grandmother (Betty White).", "The film received mixed reviews from critics, but it was a box office success, grossing $348.8 million worldwide based on a $70 million budget." ] ], "gold": "The Lorax is a children's book about the danger of human destruction of the natural environment, written by Dr. Seuss and published in 1971. The Once-ler causes the environmental destruction by cutting down the Truffula trees. In 2012, Illumination Entertainment produced a 3D computer-animated musical comedy film of the same name and cast Ed Helms as the Once-ler.", "prediction 1": "The Lorax is a children's book written by Dr. Seuss and first published in 1971. It chronicles the plight of the environment and the Lorax, who speaks for the trees against the Once-ler. In the film, the Lorax is played by Danny DeVito as the Lorax and a musical fantasy movie is played by Zac Efron as Ted.", "prediction 2": "The Lorax is a children's book written by Dr. Seuss and first published in 1971. It chronicles the plight of the environment and the Lorax, who speaks for the trees against the Once-ler. In the 1972 animated television special, the Once-ler cut down the trees. The second adaptation of the book, The Lorax, was a 2012 computer-animated musical fantasy film produced by Illumination Entertainment and based on Dr. Seuss's children's book of the same name. The Lorax is a 2012 American computer-animated musical fantasy musical comedy musical fantasy film produced by Illumination Entertainment and based on the 1972 fable Lorax, and Zac Efron as Ted. The film builds on the story by expanding the story of the Once-ler and Ted, the previously unnamed boy who visits the Once-ler on the Street of the Lifted Lorax", "prediction 3": "The Lorax is a 1971 children's book written by Dr. Seuss and first published in 1971. It chronicles the plight of the environment and the Lorax, who speaks for the trees against the Once-ler. In the 1972 animated television special, the Once-ler chopped down the trees in the Street of the Lifted Lorax. In the 2012 animated musical fantasy film, the Once-ler cuts down the trees and the Lorax speaks for the trees against the Once-ler.", "prediction 4": "The Lorax is a children's book written by Dr. Seuss and published in 1971. It chronicles the plight of the environment and the Lorax, who speaks for the trees against the Once-ler. Ed Helms played the Once-ler in the 1972 animated tv special. Zac Efron played Ted.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 307 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Lorax is a children's book about the danger corporate greed poses to nature, written by Dr. Seuss and first published in 1971. The Once-ler pollutes the sky, river, and landscape, until the very last Truffula tree falls. In 2012, Illumination Entertainment produced a 3D computer-animated musical comedy film of the same name and cast Ed Helms as the Once-ler." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "Who is the present deputy governor of plateau state?", "passages": [ [ "Plateau State", "Plateau State\n\nPlateau is the twelfth largest state in Nigeria.", "Approximately in the centre of the country, it is geographically unique in Nigeria due to its boundaries of elevated hills surrounding the Jos Plateau it's capital, and the entire plateau itself.", "Plateau State is celebrated as \"The Home of Peace and Tourism\".", "With natural formations of rocks, hills and waterfalls, it derives its name from the Jos Plateau and has a population of around 3.5 million people.", "Plateau State is located in Nigeria\u2019s middle belt.", "With an area of 26,899 square kilometres, the State has an estimated population of about three million people.", "It is located between latitude 08\u00b024'N and longitude 008\u00b032' and 010\u00b038' east.", "The state is named after the picturesque Jos Plateau, a mountainous area in the north of the state with captivating rock formations.", "Bare rocks are scattered across the grasslands, which cover the plateau.", "The altitude ranges from around 1,200 meters (about 4000 feet) to a peak of 1,829 metres above sea level in the Shere Hills range near Jos .", "Years of tin and columbite mining have also left the area strewn with deep gorges and lakes.", "Though situated in the tropical zone, a higher altitude means that Plateau State has a near temperate climate with an average temperature of between 13 and 22\u00a0\u00b0C." ], [ "Plateau State", "In 1996, Plateau State was further subdivided to create Nasarawa State which was carved out of the western half of Plateau State by Sani Abacha's military regime.", "Tin mining activities began in 1902 under the British and continue to the present day.", "The Plateau State administrative structure consists of the State Cabinet, the House of Assembly and Local Government Areas.", "The state government is run by the Governor (chief executive), Deputy Governor, Secretary to the state government, Commissioners (cabinet members), special advisers, permanent secretaries, board chairmen and general managers.", "The current governor is Simon Bako Lalong.", "The House of Assembly consists of 25 members and 11 special advisers.", "The Speaker of the house is currently Mr Joshua Madaki who was elected in 2018 by his Hon.", "Members following the impeachement of Rt Hon Peter Azi.", "Local Government is headed by a chairman, who is the chief executive, while his cabinet consists of elected councilors who make up the legislative arm.", "Plateau State is also divided into 17 Local Government Areas, each encompassing ethnic groups who share common affinities or distant bloodlines.", "Leaders of these Local Government areas are elected by the people from amongst several contestants who may not be related to any past chiefdom leaders." ], [ "Damishi Sango", "But the focus of his career was the ongoing political struggle between leading Plateau State politicians including himself, Joshua Dariye, elected Plateau State governor in April 1999 and reelected in 2003, who held office until impeached in November 2006, Jonah Jang, who was elected Plateau State governor in April 2007, Solomon Lar and Fidelis Tapgun, earlier governors of the state and Senator Ibrahim Mantu.", "In October 2001 it was reported that Sango and retired Air Commodore Jonah Jang had reached an agreement to cooperate in removing the current party leadership in Plateau State, dominated by Governor Dariye, before competing independently for the post of governor.", "In March 2002 Sango described Dariye's recent creation of new districts and Chiefdoms as cosmetic, doing nothing to solve the urgent need to improve road and hospitals, power, water and schools.", "Dariye announced the formation of a group called the Plateau Elders Unity Forum, saying Jang and Sango were among the members, but they were not consulted before their names were announced.", "Jang later left the PDP to become the gubernatorial candidate of the All Nigeria People's Party (ANPP).", "In May 2002 Sango also left the PDP.", "In August 2002 he was formally accepted as a member of the Alliance for Democracy (AD) party." ] ], "gold": "Plateau is the twelfth-largest state in Nigeria. Its current deputy governor is Simon Bako Lalong. Prior to him, Jonah David Jang held the position until 2015.", "prediction 1": "Plateau State is the twelfth largest state in Nigeria. It is geographically unique in Nigeria due to its boundaries of elevated hills surrounding the Jos Plateau, it's capital and the entire plateau itself. Jonah Jang, who was elected Plateau State governor in April 2007, is the present deputy governor of Plateau State. The current governor is Simon Bako Lalong.", "prediction 2": "Plateau State in Nigeria is a state located in the middle belt of Nigeria. The state government is run by the governor (chief executive), deputy governor, secretary to the state government, commissioners (cabinet members), special advisers, permanent secretaries, board chairmen and general managers. The current governor is Simon Bako Lalong. The Deputy Governor of Plateau is Damishi Sango.", "prediction 3": "Plateau State is a state in Nigeria. The state government is run by the governor (chief executive), Deputy Governor, Secretary to the state government, Commissioners, special advisers, permanent secretaries, board chairmen and general managers. The current governor is Simon Bako Lalong, who held office until November 2006. The current deputy governor is Damishi Sango.", "prediction 4": "Plateau State is a state in Nigeria. From 1999 to 2007, the state's governor was Joshua Dariye, while the current deputy governor is Jonah Jang.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 206 }, { "error type": "Unverifiable", "explanation": "", "start": 273, "end": 321 } ], "missing-info": [], "corrected-prediction": "Plateau State is the twelfth largest state in Nigeria. The current governor is Simon Bako Lalong. Jonah Jang was elected Plateau State governor in April 2007. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who gave the idea of separate independent muslim state in india?", "passages": [ [ "Partition of India", "The two-nation theory is the ideology that the primary identity and unifying denominator of Muslims in the Indian subcontinent is their religion, rather than their language or ethnicity, and therefore Indian Hindus and Muslims are two distinct nations regardless of such commonalities.", "The two-nation theory was a founding principle of the Pakistan Movement (i.e., the ideology of Pakistan as a Muslim nation-state in South Asia), and the partition of India in 1947.", "The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan.", "It is also a source of inspiration to several Hindu nationalist organizations, with causes as varied as the redefinition of Indian Muslims as non-Indian foreigners and second-class citizens in India, the expulsion of all Muslims from India, establishment of a legally Hindu state in India, prohibition of conversions to Islam, and the promotion of conversions or reconversions of Indian Muslims to Hinduism.", "The Hindu Mahasabha leader Lala Lajpat Rai was one of the first persons to demand to bifurcate India by Muslim and non-Muslim population." ], [ "Partition of India", "Partition of India\n\nThe Partition of India was the division of British India in 1947 which eventually accompanied the creation of three independent dominions, Bangladesh, India and Pakistan.", "The Dominion of India became, as of 1950, the Republic of India (India), and the Dominion of Pakistan became, as of 1956, the Islamic Republic of Pakistan (Pakistan) and also, in 1971, the People's Republic of Bangladesh (Bangladesh).", "The \"partition\" involved the division of three provinces, Assam, Bengal and Punjab, based on district-wide Hindu or Muslim majorities.", "The boundary demarcating India and Pakistan came to be known as the Radcliffe Line.", "It also involved the division of the British Indian Army, the Royal Indian Navy, the Indian Civil Service, the railways, and the central treasury, between the two new dominions.", "The partition was set forth in the Indian Independence Act 1947 and resulted in the dissolution of the British Raj, as the British government there was called.", "The two self-governing countries of Pakistan and India legally came into existence at midnight on 14\u201315 August 1947.", "The partition displaced over 14 million people along religious lines, creating overwhelming refugee crises in the newly constituted dominions; there was large-scale violence, with estimates of loss of life accompanying or preceding the partition disputed and varying between several hundred thousand and two million." ] ], "gold": "The Partition of India was the division of British India into two independent Dominions: India and Pakistan. The Hindu Mahasabha leader Lala Lajpat Rai was one of the first persons to demand to bifurcate India by Muslim and non-Muslim population. The Pakistan Movement, with principles that were founded on the two-nation theory, also promoted the idea of a separate independent Muslim state in India.", "prediction 1": "The Partition of India was the division of British India in 1947 which ultimately accompanied the creation of three independent dominions, Bangladesh, India and Pakistan. The two-nation theory is the ideology that the primary identity and unifying denominator of Muslims in the Indian subcontinent is their religion, rather than their language or ethnicity, and therefore Indian Hindus and Muslims are two distinct nations regardless of such commonalities. The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan. The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan. The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed", "prediction 2": "The Partition of India was the division of British India in 1947 which eventually accompanied the creation of three independent dominions, Bangladesh, India and Pakistan. It involved the division of three provinces, Assam, Bengal and Punjab, based on district-wide Hindu or Muslim majorities. The boundary demarcating India and Pakistan came to be known as the Radcliffe Line. Lala Lajpat Rai was one of the first persons to demand to bifurcate India by Muslim and non-Muslim population.", "prediction 3": "The Partition of India was the division of British India in 1947 which ultimately accompanied the creation of three independent dominions, Bangladesh, India, and Pakistan. The two-nation theory is the ideology that the primary identity and unifying denominator of Muslims in the Indian subcontinent is their religion, rather than their language or ethnicity, and therefore Indian Hindus and Muslims are two distinct nations regardless of such commonalities. The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan. The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan.", "prediction 4": "Partition of India was the division of British India in 1947 which ultimately accompanied the creation of three independent dominions, Bangladesh, India and Pakistan. The two-nation theory is the ideology that the primary identity and unifying denominator of Muslims in the Indian subcontinent is their religion, rather than their language or ethnicity, and therefore Indian Hindus and Muslims are two distinct nations regardless of such commonalities. The Hindu Mahasabha leader Lala Lajpat Rai was one of the first persons to demand to bifurcate India by Muslim and non-Mus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 456 }, { "error type": "Irrelevant", "explanation": "", "start": 457, "end": 666 }, { "error type": "Redundant", "explanation": " The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it as the awakening of Muslims for the creation of Pakistan. ", "start": 667, "end": 876 }, { "error type": "Redundant", "explanation": "The ideology that religion is the determining factor in defining the nationality of Indian Muslims was undertaken by Muhammad Ali Jinnah, who termed it ", "start": 877, "end": 1025 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Partition of India was the division of British India in 1947 which ultimately accompanied the creation of three independent dominions, Bangladesh, India and Pakistan. The Hindu Mahasabha leader Lala Lajpat Rai was one of the first persons to demand to bifurcate India by Muslim and non-Muslim population. The two-nation theory was a founding principle of the Pakistan Movement (i.e., the ideology of Pakistan as a Muslim nation-state in South Asia), and the partition of India in 1947. " }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who plays dorthy in the wizard of oz?", "passages": [ [ "Dorothy Gale", "Since she was sixteen years old at the time of filming, Garland's maturing figure was bound into a figure-hiding corset.", "Since fantasy films generally were unsuccessful at that time, MGM portrayed Oz as a head-trauma-induced delirium, instead of a real place.", "It is implied that Oz is merely Dorothy's dream since she awakens in bed at the end, though Dorothy is convinced that her journey was all in fact real.", "A window knocked out Dorothy when the tornado was approaching the farm.", "After that storm lifted the farmhouse, she and Toto saw a chicken coop, an old lady knitting calmly in a rocking chair with a cat on her lap, a cow, and two men rowing a boat who doff their hats to her as well as miscellaneous debris flying by them.", "Finally, Dorothy saw Miss Almira Gulch, who was going to abduct Toto to the sheriff, fly on her bicycle outside the window, becoming a witch on a broom.", "As one of the first movies to be filmed in Technicolor, the director had the color of the famous magic slippers changed from silver to red because the Ruby slippers were more visually appealing on film." ], [ "Dorothy Gale", "Dorothy does not appear in \"The Patchwork Girl of Oz\" (1914), although some film books claim that Mildred Harris, who had yet to sign her contract with The Oz Film Manufacturing Company, played the role.", "The character, is, in fact, eliminated from the film version, although she has a fairly large role in the novel.", "Dorothy Dwan portrayed Dorothy in the 1925 film \"Wizard of Oz\".", "In this film, Aunt Em (Mary Carr) informs her on her eighteenth birthday that she was left on their doorstep and is really a princess of Oz destined to marry Prince Kynd (Bryant Washburn), who has currently lost the throne to Prime Minister Kruel (Josef Swickard), in a storyline similar to that of \"His Majesty the Scarecrow of Oz\", only with Dorothy as the love interest.", "In the end, the story proves to be the dream of a little girl who has fallen asleep listening to the story of Kynd and Kruel, said to be the story of \"The Wonderful Wizard of Oz\".", "The film also introduced the idea of the farmhands also being the Scarecrow, Tin Woodsman and Cowardly Lion, albeit as costumes they don in order to conceal themselves in Oz.", "In the 1939 movie \"The Wizard of Oz\", Dorothy was played by Judy Garland, who received an Academy Juvenile Award for her performance." ], [ "Dorothy Gale", "Elements of Dorothy Gale's character are possibly derived from Matilda Joslyn Gage, Dorothy Gage's grandmother.", "Dorothy Gage is buried in Evergreen Cemetery in Bloomington, Illinois.", "Lee Sandlin writes that L. Frank Baum read a disaster report of a tornado in Irving, Kansas, in May 1879 which included the name of a victim, Dorothy Gale, who was \"found buried face down in a mud puddle.\"", "In Baum's 1902 stage musical adaptation, Dorothy was played by Anna Laughlin.", "In 1908 L. Frank Baum adapted his early Oz novels as \"The Fairylogue and Radio-Plays\", with Romola Remus as Dorothy.", "This was followed by \"The Wonderful Wizard of Oz\", a motion picture short that Otis Turner, one of the directors of \"Fairylogue\", made without Baum as part of a contract fulfillment.", "In this 1910 film, Dorothy was played by Bebe Daniels.", "It was followed by two sequels (the same year), \"Dorothy and the Scarecrow in Oz\" and \"The Land of Oz\", both of which included Dorothy, but whether Daniels participated is unknown.", "Baum subsequently loosely adapted \"The Wonderful Wizard of Oz\" into a 1914 motion picture directed by J. Farrell MacDonald titled \"His Majesty, the Scarecrow of Oz\" with Violet MacMillan as Dorothy." ] ], "gold": "There are several versions of the film, The Wizard of Oz, or The Wonderful Wizard of Oz, and in each one a different actress plays Dorothy. Bebe Daniels played Dorothy in the 1910 silent fantasy film, The Wonderful Wizard of Oz. An actress named Dorothy Dwan played Dorothy in the 1925 silent film, The Wizard of Oz. And, Judy Garland received an Academy Juvenile Award for her performance as Dorothy in the 1939 version of The Wizard of Oz, which is one of the first movies to be filmed in Technicolor.", "prediction 1": "In the 1939 movie The Wizard of Oz, the character of Dorthy is played by Judy Garland. However, in the 1908 film The Wonderful Wizard of Oz, the character of Dorthy is played by Bebe Daniels. In the 1914 film of the same name, the role of Dorthy is played by Violet MacMillan.", "prediction 2": "In the 1939 movie \"The Wizard of Oz\", Dorthy is played by Judy Garland. In the 1910 film \"Dorothy and the Scarecrow in Oz\", Violet MacMillan played Dorthy. In the 1908 stage musical adaptation of \"The Wonderful Wizard of Oz\", Violet MacMillan played Dorthy.", "prediction 3": "In the 1939 movie adaptation of The Wizard of Oz, Dorthy is played by Judy Garland, who received an Academy Juvenile Award for her performance. In the 1910 film adaptation of The Wonderful Wizard of Oz, Dorthy is played by Bebe Daniels. In the 1939 film adaptation of The Wizard of Oz, Dorthy is played by Janet Gaynor. In the 1939 film adaptation of The Great Gatsby, Dorthy is played by Margaret McLean. In the 1940 film adaptation of The Great Garland, Dorthy is played by Mary Carr. In the 1935 adaptation of The Great Garland, Dorthy is played by Mary Carr.", "prediction 4": "There are several versions of the story The Wonderful Wizard of Oz. The 1925 film was directed by Otis Turner and starred Bebe Daniels as Dorothy. The 1939 movie was directed by MGM and starred Judy Garland. The 1940 film was directed by Josef Swickard as Dorthy.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 178, "end": 191 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 103, "end": 107 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In Baum's 1902 stage musical adaptation, Dorothy was played by Anna Laughlin. In 1908 L. Frank Baum adapted his early Oz novels as \"The Fairylogue and Radio-Plays\", with Romola Remus as Dorothy. Dorothy Dwan portrayed Dorothy in the 1925 film \"Wizard of Oz\". In the 1939 movie The Wizard of Oz, which is one of the first movies to be filmed in Technicolor, the character of Dorothy is played by Judy Garland, who received an Academy Juvenile Award for her performance . In the 1910 film,\"The Wonderful Wizard of Oz\" the character of Dorothy is played by Bebe Daniels. In the 1914 film of the same name, the role of Dorothy is played by Violet MacMillan." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did the nissan armada body style change?", "passages": [ [ "Nissan Armada", "Nissan Armada\n\n", "The Nissan Armada is a full-size SUV.", "An upscale version of the Armada is sold as the Infiniti QX80.", "From 2003 to 2015 the Armada was assembled in Canton, Mississippi based on the Nissan Titan.", "From mid-2016 onwards, the Armada has been built in Yukuhashi, Kyushu, Japan and shares the same platform as the Nissan Patrol, with American-specific modifications, and went on sale in late Summer 2016 as a 2017 model.", "Developed under Carlos Ghosn's NRP (Nissan Revival plan), using the platform code WA60, from September 1999 to 2003 under lead designers Shiro Nakamura and Diane Allen and chief engineers Yuzo Sakita and Larry Dominique, the 2004 model Pathfinder Armada was unveiled on April 17, 2003 at the New York Auto Show.", "In January 2001, a final exterior design by Giovanny Arroba was approved by Sakita, Allen, Nakamura, and Nissan executive management, with the final design freeze being completed in July 2001 alongside.", "Prototypes based on the Y61 Patrol were hand-assembled as mules from 2001, with the first WA60-specific prototypes being completed and sent to testing in early 2002.", "Design patents were filed in 2003, with production starting on August 14, 2003 and going on sale on October 1, 2003." ], [ "Nissan Armada", "The Armada grew in length and width, but the wheelbase and height were moderately reduced.", "In addition to the Endurance V8, a seven-speed transmission was introduced to improve fuel economy, acceleration and torque, along with an increase in horsepower from 317 to 390 hp at 5,200 rpm.", "The exterior moderately differs from the updated Patrol, that was introduced in early 2014.", "As with the previous generation, the Armada continued to offer 2WD and 4WD and available in SV, SL, and Platinum trims.", "The move is part of Nissan's plan to have the Armada and Patrol share the same global platform instead of sharing the platform with the American-built Titan, due to Nissan investing in expansion of its truck production in Mississippi.", "Although it still competes with the Toyota Sequoia and Mercedes-Benz GL-Class, it meets all of the specifications able to rival the Toyota Land Cruiser and Mercedes-Benz G-Class." ] ], "gold": "The Nissan Armada is a full-size SUV. A facelift was designed through 2005, being introduced in early 2007 for the 2008 model year. From mid-2016 onwards, the Armada is been built in Yukuhashi, Kyushu, Japan and shares the same platform as the Nissan Patrol, with American-specific modifications, and went on sale in late Summer 2016 as a 2017 model.", "prediction 1": "The Nissan Armada is a full-size SUV developed under Carlos Ghosn's NRP (Nissan Revival plan), using the platform code WA60, from September 1999 to 2003. From mid-2016 onwards, the Armada has been built in Yukuhashi, Kyushu, Japan and shares the same platform as the Nissan Patrol, with American-specific modifications, and went on sale in late Summer 2016 as a 2017 model. The body style of the 2004 model was changed from the 2003 to the 2005 model.\n", "prediction 2": "The Nissan Armada is a full-size SUV developed under Carlos Ghosn's NRP (Nissan Revival plan), using the platform code WA60 from September 1999 to 2003. It was unveiled at the New York Auto Show on April 17, 2003. In June 2004, the Armada was unveiled at the Detroit Auto Show. The body style of the 2005 model Armada was changed from the sporty to more sporty.", "prediction 3": "The 2002-2003 model of the Nissan Armada, designed under Carlos Ghosn's NRP, was unveiled on April 17, 2003 at the New York Auto Show. Since then, the Armada has been manufactured in Japan and shares the same platform as the Nissan Patrol, with American-specific modifications, since mid-2016.", "prediction 4": "The current generation of the Nissan Armada was introduced on October 1, 2003. From 2003 to 2015, the Armada was assembled in Canton, Mississippi based on the Nissan Titan. In mid-2016, the Armada has been built in Yukuhashi, Kyushu, Japan and shares the same platform as the Nissan Patrol, with American-specific modifications, and went on sale in late Summer 2016 as a 2017 model.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 37, "end": 153 }, { "error type": "Unverifiable", "explanation": "", "start": 374, "end": 452 }, { "error type": "Incoherent", "explanation": "", "start": 154, "end": 373 } ], "missing-info": [], "corrected-prediction": "The Nissan Armada is a full-size SUV. From mid-2016 onwards, the Armada has been built in Yukuhashi, Kyushu, Japan and shares the same platform as the Nissan Patrol, but with American-specific modifications. It went on sale late in the Summer of 2016 as a 2017 model." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays taylor forrester on bold and the beautiful?", "passages": [ [ "Taylor Hayes (The Bold and the Beautiful)", "Bell introduced the role of psychiatrist Dr. Taylor Hamilton Hayes, played by actress Hunter Tylo, during the episode dated June 6, 1990.", "According to \"Variety\", Bell created Taylor as \"a romantic leading lady but also as a character who could facilitate social issues \u2014 and directly partake in a few, too\".", "Previously, Tylo was dismissed from two other soaps, \"All My Children\" and \"Days of Our Lives\".", "The actress noted that her \"crazy sense of humor\" and \"funny business\" could have won her the role of Taylor, and she said: \"After the audition, they told me I was the only one right for the role.", "I think they liked my 'a woman's gotta do what a woman's gotta do' attitude.\"", "Sherilyn Wolter temporarily replaced Tylo in 1990.", "Tylo vacated the role in May 1994 to pursue other projects, but the soap opera left the door open for her to return, which she did months later.", "During her absence, the character was presumed to be dead.", "In March 1996, following Taylor's decreased airtime and rumors circulating of her exit, it was confirmed that the actress was to leave \"The Bold and the Beautiful\" after her contract expired that June, to pursue a primetime role on the Fox television drama \"Melrose Place\"." ], [ "Taylor Hayes (The Bold and the Beautiful)", "Taylor Hayes (The Bold and the Beautiful)\n\n", "Taylor Hayes is a fictional character from the American CBS soap opera \"The Bold and the Beautiful\", portrayed by Hunter Tylo.", "The character was created by William J. Bell and debuted during the episode dated June 6, 1990.", "Tylo appeared as a regular continuously until 1994 when she took a hiatus for a few months before being written back into the series.", "In 1996, she left the serial after being cast on \"Melrose Place\", where she was soon fired on the grounds of being pregnant, and returned shortly after.", "In 2002, Tylo and the show's executive producer Bradley Bell had mutually agreed that the character was played out, and Taylor was subsequently killed off, last appearing that October.", "Tylo returned in 2004, reprising Taylor as a ghost.", "She returned on a permanent basis in April 2005, with the character revealed to be alive.", "Tylo exited \"The Bold and the Beautiful\" again in July 2013, but returned for multiple guest appearances in 2014.", "She returned again in April 2018 on a recurring basis until in December 2018 she was upped to a series regular.", "Described as a world-renowned psychiatrist based in Los Angeles, Taylor was introduced to facilitate social issues and act as a romantic lead." ] ], "gold": "Taylor Hayes is a fictional character from the American CBS soap opera \"The Bold and the Beautiful\" portrayed by Hunter Tylo. Although she took a few short breaks in 1994 and 1996, Hunter Tylo played the role from the character's debut in 1990 until 2002 when she was killed off of the show. Tylo then returned in 2004 as a ghost of her former character, which led to her being revealed to be alive and reprising her role from 2005 until 2013, with multiple guest appearances in 2014 and a regular role once again from 2018-2019. It should also be noted that Sherilyn Wolter did take over the role very briefly in 1990.", "prediction 1": "The character Taylor Hayes was created by William J. Bell and debuted during the episode dated June 6, 1990. American actress Hunter Tylo played Taylor Hayes from 1990 to 2005. Sherilyn Wolter temporarily replaced Tylo in 1990.", "prediction 2": "The character of Dr. Taylor Forrester on Bold and the Beautiful was played by Hunter Tylo. Tylo vacated the role of Taylor Hayes in May 1994 to pursue other projects, but the soap opera left the door open for her to return, which she did months later. Tylo returned on a permanent basis in April 2005, with the character revealed to be alive. She returned on a recurring basis in 2018.", "prediction 3": "Taylor Hayes is a fictional character from the American CBS soap opera \"The Bold and the Beautiful\", portrayed by Hunter Tylo. The character was created by William J. Bell and debuted during the episode dated June 6, 1990.", "prediction 4": "Taylor Hamilton Hayes is a fictional character from the American CBS soap opera \"The Bold and the Beautiful\", portrayed by Hunter Tylo. The character was created by William J. Bell and debuted during the episode dated June 6, 1990. In the next two seasons, Taylor was played by Sherilyn Wolter and in the third season Taylor was played by Rachel Cox.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 27, "end": 57 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4, 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7, 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "The character Taylor Hayes debuted during the episode dated June 6, 1990. She is a fictional character from the American CBS soap opera \"The Bold and the Beautiful\". American actress Hunter Tylo played Taylor Hayes from 1990 to 2005. Sherilyn Wolter temporarily replaced Tylo in 1990. Hunter played the character with breaks in 1994 and 1996, she was killed off in 2002. Tylo returned in 2004, reprising Taylor as a ghost and returned on a permanent basis in April 2005, with the character revealed to be alive. Tylo exited \"The Bold and the Beautiful\" again in July 2013, but returned for multiple guest appearances in 2014 and returned again in April 2018 until in December 2018 she was upped to a series regular." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What year did elton john song crocodile rock?", "passages": [ [ "Crocodile Rock", "Crocodile Rock\n\n\"Crocodile Rock\" is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France (it was listed as \"Strawberry Studios\" in the album's credits), where John and his team had previously recorded the \"Honky Ch\u00e2teau\" album.", "It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., as a pre-release single from his forthcoming 1973 album \"Don't Shoot Me", "I'm Only the Piano Player\", and became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks.", "In the U.S., it was certified Gold on 5 February 1973 and Platinum on 13 September 1995 by the RIAA.", "In Canada, it topped the chart as well, remaining at No.1 on the \"RPM 100\" national singles chart for four weeks from 17 February \u2013 10 March.", "It was the first song released as a single on the MCA label (catalogue #40000) after MCA dissolved its Uni, Decca, Kapp and Coral labels.", "(John had previously been with the Uni label.)", "\"Crocodile Rock\" is dominated by a Farfisa organ, played by John." ] ], "gold": "\"Crocodile Rock\" is a song written by Elton John and Bernie Taupin, and was recorded in June 1972 in France. It was released on October 27, 1972 in the UK and November 20, 1972 in the US. The song became Elton John's first US number one single on February 3, 1973, where it stayed for three weeks. In the US, the single was also certified Gold in February 1973 and platinum in September 1995 by the RIAA.", "prediction 1": "Crocodile Rock is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France, where John and his team had previously recorded the \"Honky Ch\u00e2teau\" album. It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., as a pre-release single from his forthcoming 1973 album Don't Shoot Me I'm Only the Piano Player, and became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks.", "prediction 2": "Crocodile Rock is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France. It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., as a pre-release single from his forthcoming 1973 album \"Don't Shoot Me I'm Only the Piano Player\". It became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks.", "prediction 3": "Crocodile Rock is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France. It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., as a pre-release single from his forthcoming 1973 album Don't Shoot Me I'm Only the Piano Player. It became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks, reaching the top spot on 3 February 1973, and stayed there for three weeks.", "prediction 4": "Crocodile Rock is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France, where John and his team had previously recorded the \"Honky Ch\u00e2teau\" album. It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., as a pre-release single from his forthcoming 1973 album Don't Shoot Me I'm Only the Piano Player. It became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 214 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 391 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Crocodile Rock is a song written by Elton John and Bernie Taupin, and recorded in summer 1972 at the Ch\u00e2teau d'H\u00e9rouville studio in France, where John and his team had previously recorded the \"Honky Ch\u00e2teau\" album. It was released on 27 October 1972 in the UK and 20 November 1972 in the U.S., and became his first U.S. number-one single, reaching the top spot on 3 February 1973, and stayed there for three weeks. It was certified Gold on 5 February 1973 and Platinum on 13 September 1995 by the RIAA." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "When was first season of dancing with the stars?", "passages": [ [ "Dancing with the Stars (U.S. TV series)", "Dancing with the Stars (U.S. TV series)\n\nDancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC.", "It is the US version of the UK series \"Strictly Come Dancing\".", "The show is hosted by Tom Bergeron, alongside Erin Andrews, who became co-host in season eighteen.", "Lisa Canning was co-host in the first season, Samantha Harris co-hosted seasons two through nine and Brooke Burke-Charvet in seasons ten through seventeen.", "The twenty-seventh season premiered on September 24, 2018, and its spin-off \"\" premiered on October 7, 2018.", "\"Dancing with the Stars\" will not premiere for a spring season in 2019, but is set to return in the fall of 2019.", "The format of the show consists of a celebrity paired with a professional dancer.", "Each couple performs predetermined dances and competes against the others for judges' points and audience votes.", "The couple receiving the lowest combined total of judges' points and audience votes is eliminated each week until only the champion dance pair remains.", "Tom Bergeron has been the host since the program's premiere in 2005.", "In season 1, his co-host was Lisa Canning." ] ], "gold": "Several countries have their own version of the television dance competition, Dancing with the Stars, which is based on the UK television dance series, Strictly Come Dancing. The first season of the American version was televised June 1 - July 6, 2005. The first season of the Australian version was televised October 5 - November 23, 2004. The first season of the Irish version was televised January 8 - March 26, 2017. ", "prediction 1": "Dancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC. It is the US version of the UK series \"Strictly Come Dancing\". The format consists of a celebrity paired with a professional dancer and competes against the others for judges' points and audience votes. Lisa Canning was co-host in the first season, Samantha Harris co-hosted seasons two through nine and Brooke Burke-Charvet in seasons ten through seventeen. The twenty-st season premiered on September 24, 2018, and its spin-off \"\" premiered on October 7, 2018.", "prediction 2": "Dancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC. It is the US version of the UK series Strictly Come Dancing. The format consists of a celebrity paired with a professional dancer performing predetermined dances and competing against the others for judges' points and audience votes. The couple receiving the lowest combined total of judges' points and audience votes is eliminated each week until only the champion dance pair remains.", "prediction 3": "Dancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC. It is the US version of the UK series Strictly Come Dancing. The format consists of a celebrity paired with a professional dancer performing predetermined dances and competing against the others for judges' points and audience votes.", "prediction 4": "Dancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC. It is the US version of the UK series Strictly Come Dancing. Lisa Canning was co-host in the first season, Samantha Harris co-hosted seasons two through nine and Brooke Burke-Charvet in seasons ten through seventeen. The twenty-seventh season premiered on September 24, 2018, and its spin-off \"\" premiered on October 7, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 472 }, { "error type": "Irrelevant", "explanation": "", "start": 473, "end": 576 } ], "missing-info": [], "corrected-prediction": "Dancing with the Stars is an American dance competition television series that premiered on June 1, 2005, on ABC." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who has the most tries in the nrl?", "passages": [ [ "National Rugby League", "National Rugby League\n\nThe National Rugby League (NRL) is a league of professional men's rugby league teams in Australia.", "Run by the Australian Rugby League Commission, the NRL's main competition is known as the Telstra Premiership due to sponsorship from Telstra Corporation and is contested by sixteen teams, fifteen of which are based in Australia with one based in New Zealand.", "It is the most viewed and attended rugby league club competition in the world.", "The National Rugby League is Australia's top-level domestic men's rugby-league club competition.", "It contains clubs from the original Sydney club Rugby League competition, which had been running continuously since 1908.", "The NRL formed in the aftermath of the 1990s' Super League war as a joint partnership between the Australian governing body, the Australian Rugby League (ARL) and media giant News Corporation-controlled Super League, after both organisations ran premierships parallel to each other in 1997.", "This partnership was dissolved in February 2012, with control of the NRL going to the independently formed Australian Rugby League Commission.", "NRL matches are played in Australia and New Zealand from March to October.", "The season culminates in the premiership-deciding game, the NRL Grand Final, traditionally one of Australia's most popular sporting events and one of the world's largest attended sporting championship games." ], [ "Ken Irvine", "Ken Irvine\n\nKenneth John Irvine (5 March 1940 \u2013 22 December 1990) was an Australian rugby league footballer of the 1950s, '60s and '70s.", "He holds the standing Australian record for the most number of tries in a first-grade career \u2013 212.", "No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who has scored 188.", "He is also the 2nd all-time top try-scorer for the Australian national team with 33, two behind Darren Lockyer's 35.", "Irvine's great speed is legendary and he is regarded as Australia's greatest ever winger, being named in 2008 in the list of Australian rugby league's 100 greatest players, as well as being an automatic selection for the Australian Rugby League's \"Team of the Century\".", "Irvine played his club football for the North Sydney and Manly-Warringah clubs in the New South Wales Rugby Football League premiership, winning the premiership with Manly in 1972 and 1973.", "His great speed saw him play primarily on the .", "Born in Cremorne, Sydney, to John Bernard Irvine, a butcher, and his wife Doris May, \"n\u00e9e\" McCabe, Irvine attended Marist Brothers College Mosman." ], [ "David Brown (rugby league)", "David Brown (rugby league)\n\nDavid Michael Brown (1913\u20131974) was one of Australia's greatest rugby league footballers.", "Brown in his distinctive headgear was said to be one of the most admired sights in the game during the 1930s.", "He won two premierships with Easts and scored so many points, tries and goals and established so many records (some may never be bettered) that he is referred to as \"the Bradman of league\".", "In 2003 Brown was inducted into the Australian Rugby League Hall of Fame and in 2008 he was named in the New South Wales rugby league team of the century.", "In 2018, Brown joined Rugby League's elite by being inducted as a Rugby League Immortal.", "Brown was born Sydney, New South Wales, Australia.", "As a child Brown lost the top of his thumb in a lawn-mowing accident.", "While playing football at school he badly broke an arm, dislocating the elbow and causing severe nerve damage which cost him the use of two fingers on his right hand.", "Despite these setbacks Brown was an all-round sportsman \u2013 an A-grade tennis player, champion junior surfer and a representative cricketer.", "Brown attended Sydney's Waverley College under the tuition of Arthur Hennessy, Australia's first ever rugby league test captain, who was the school sporting coach at the time." ] ], "gold": "The National Rugby League (NRL) is Australia's top-level domestic men's rugby league club competition. Ken Irvine has the most career tries scored in the NRL. No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who scored 190. Dave Brown, who has won two premierships with Easts and scored so many points, tries and goals and established so many records that he is referred to as \"the Bradman of league,\" has the most single season tries in the NRL.", "prediction 1": "The National Rugby League is a league of professional men's rugby league teams in Australia. Kenneth John Irvine holds the Australian record for the most number of tries in a first-grade career, which is 212. No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who has scored 188. In the 1890s and 1990s, John Hicks scored the most tries in the NRL, while Kenneth John Hoopsetson has the most tries in a premiership.", "prediction 2": "The National Rugby League is a league of professional men's rugby league teams in Australia. Ken Irvine holds the Australian record for the most number of tries in a first-grade career \u2013 212. No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who has scored 188.", "prediction 3": "The National Rugby League is a league of professional men's rugby league teams in Australia. Darren Lockyer has the most tries in the NRL with 35. Ken Irvine holds the standing Australian record for the most number of tries in a first-grade career \u2013 212. No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who has scored 188.", "prediction 4": "The National Rugby League is an Australian professional rugby league league league competition. The player with the most tries in the NRL is Ken Irvine, with 212. The Australian record for most tries in a first-grade career is held by Kenneth John Irvine, an Australian rugby league footballer of the 1950s, '60s and '70s. The record for most tries in a first grade career is held by Melbourne Storm player Billy Slater, with 188.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 382, "end": 450 }, { "error type": "Unverifiable", "explanation": "", "start": 451, "end": 517 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The National Rugby League is a league of professional men's rugby league teams in Australia. Kenneth John Irvine holds the Australian record for the most number of tries in a first-grade career, which is 212. No other player has yet managed 200 tries in their Australian club career, with the closest to Irvine's tally being Melbourne Storm player Billy Slater, who has scored 188. David Brown won two premierships with Easts and scored so many points, tries and goals and established so many records (some may never be bettered) that he is referred to as \"the Bradman of league\"." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When was the last super bowl the redskins won?", "passages": [ [ "Washington Redskins", "With 24 postseason appearances, the Redskins have an overall postseason record of Their three Super Bowl wins are tied with the Oakland Raiders and Denver Broncos, behind the Pittsburgh Steelers (six), San Francisco 49ers, Dallas Cowboys, and New England Patriots (five each), and the Green Bay Packers and New York Giants (four each).", "All of the Redskins' league titles were attained during two 10-year spans.", "From 1936 to 1945, the Redskins went to the NFL Championship six times, winning two of them.", "The second period lasted between 1982 and 1991 where the Redskins appeared in the postseason seven times, captured four Conference titles, and won three Super Bowls out of four appearances.", "The Redskins have also experienced failure in their history.", "The most notable period of general failure was from 1946 to 1970, during which the Redskins posted only four winning seasons and did not have a single postseason appearance.", "During this period, the Redskins went without a single winning season during the years 1956\u20131968.", "In 1961, the franchise posted their worst regular season record with a 1\u201312\u20131 showing.", "Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record." ], [ "Washington Redskins", "That season is best remembered for the Redskins prolific wide receiver trio nicknamed \"The Posse\" consisting of wide receivers Art Monk, Gary Clark, and Ricky Sanders who became the first trio of wide receivers in NFL history to post 1,000-plus yards in the same season.", "Also, in a week 14 victory against the San Diego Chargers, Redskins head coach Joe Gibbs achieved career victory no. 100.", "The Redskins returned to the playoffs in 1990 as a wild card team, lost in the Divisional playoffs to the 49ers, 28\u201310.", "The 1991 season started with a franchise-record 11 straight victories.", "Also during the season, \"The Hogs\", under the coaching of Redskins offensive line coach Joe Bugel, allowed a league low and franchise record nine sacks \u2013 the third lowest total in NFL history.", "The 1991 Redskins offense also dominated under the brilliant coaching of offensive minded head football coach Joe Gibbs scoring 485 points which was the most by any team in the 1991 NFL season.", "The 1991 Redskins defense was also dominant under the coaching of defensive coordinator and guru Richie Petitbon, giving up only 224 total points which was second best of any team in the NFL in 1991, while also not allowing a single point to opponents in 3 of the 16 games played that season.", "After posting a 14\u20132 record, the Redskins made and dominated the playoffs, beating the Falcons and Lions by a combined score of 64\u201317." ], [ "Washington Redskins", "Washington Redskins\n\nThe Washington Redskins are a professional American football team based in the Washington metropolitan area.", "The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division.", "The team plays its home games at FedExField in Landover, Maryland; its headquarters and training facility are at Inova Sports Performance Center at Redskins Park in Ashburn, Virginia and the Redskins Complex in Richmond, Virginia, respectively.", "The Redskins have played more than one thousand games since their founding in , and are one of only five franchises in the NFL to record over six hundred regular season and postseason wins, reaching that mark in 2015.", "The Redskins have won five NFL Championships (the latter three in Super Bowls), and have captured fourteen divisional titles and six conference championships.", "It was the first NFL franchise with an official marching band and the first with a fight song, \"Hail to the Redskins\".", "The team began play in Boston as the Braves in 1932, and became the \"Redskins\" the following year.", "In 1937, the team relocated to Washington, D.C.", "The Redskins won the 1937 and 1942 NFL championship games, as well as Super Bowls XVII, XXII, and XXVI.", "They have been league runner-up six times, losing the 1936, 1940, 1943, and 1945 title games, and Super Bowls VII and XVIII." ] ], "gold": "The Redskins are a professional American football team based in the Washington metropolitan area that compete in the National Football League as a member of the NFC East Division. The team won its first Super Bowl in January 1981 and its second in January 1988. The most recent Super Bowl that the Redskins won was Super Bowl XXVI in 1991. Since the 1991 season, they have won the NFC East four times, had a winning record in nine seasons, and reached the postseason in seven.", "prediction 1": "The Washington Redskins are a professional American football team based in the Washington metropolitan area. The Redskins have won five Super Bowls in their history. The last one was held on February 6, 1991.", "prediction 2": "The Washington Redskins are a professional American football team based in the Washington metropolitan area. From 1936 to 1945, the Redskins went to the NFL Championship six times, winning two of them. The second period lasted between 1982 and 1991 where the Redskins appeared in the postseason seven times, captured four Conference titles, and won three Super Bowls out of four appearances. Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record.", "prediction 3": "The Washington Redskins are a professional American football team based in the Washington metropolitan area and compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division. Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record.", "prediction 4": "The Washington Redskins have won five Super Bowls. The last time they won a Super Bowl was in 1991. Since then, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 183, "end": 202 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 165 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Redskins are a professional American football team based in the Washington metropolitan area that compete in the National Football League as a member of the NFC East Division. Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "When does new episode of game of thrones come out?", "passages": [ [ "Game of Thrones (season 8)", "Game of Thrones (season 8)\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series and will also adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\".", "The season will be adapted for television by David Benioff and D. B. Weiss.", "Filming officially began on October 23, 2017, and concluded in July 2018.", "The season is scheduled to premiere in April 2019.", "\n\n\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series; it will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\"." ] ], "gold": "The seventh season of the television fantasy drama series, The Game of Thrones, started on July 16, 2017, and had seven episodes, unlike the previous seasons which had ten. Episode 5 aired on August 13, 2017 and was followed a week later by episode 6, which aired on August 20, 2017. The season finale, episode 7, aired on August 27, 2017.", "prediction 1": "New episodes of Game of Thrones come out every Monday at 10 PM EST.", "prediction 2": "The eighth and final season of the fantasy drama television series Game of Thrones was announced by HBO in July 2016. Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes. Filming officially began on October 23, 2017, and concluded in July 2018.", "prediction 3": "The eighth and final season of the fantasy drama television series Game of Thrones was announced by HBO in July 2016. Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes. Filming officially began on October 23, 2017, and concluded in July 2018. The season is scheduled to premiere in April 2019.", "prediction 4": "Game of Thrones is a fantasy drama television series that is broadcast by HBO. Episodes of the series come out on a weekly basis. Episodes from the sixth season came out in June 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 67 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who sing my mind playing tricks on me?", "passages": [ [ "Mind Playing Tricks on Me", "Pitchfork Media ranked the song #45 on its Top 200 Tracks of the 1990s list, with reviewer Tom Breihan writing \"This track established the South as a serious force in the music, proving that these Texans could do dark better than anyone on either coast.\"", "The song was also included in \"The Pitchfork 500\", a book of the greatest 500 songs from '76-'06 published by Pitchfork Media.", "The song has also been referenced and sampled by other artists.", "The Kottonmouth Kings remade the song for their album \"\" under the same name.", "Kryptik & Team Death made a remix of the song for the compilation album \"Devil's Nite 2K8\" titled \"Mind Playing Tricks On Me '08.\"", "The Insane Clown Posse also covered this song with Detroit native Anybody Killa and Southern rapper Lil Wyte on \"The Mighty Death Pop!", "\"'s bonus cover album \"Smothered, Covered & Chunked\".", "Brazilian rapper Gabriel o Pensador sampled \"Mind Playing Tricks on Me\" in his song \"Lavagem Cerebral\", from his 1993 album \"\"." ], [ "Mind Playing Tricks on Me", "Mind Playing Tricks on Me\n\n\"Mind Playing Tricks on Me\" is a single by the Geto Boys, featured on their 1991 album \"We Can't Be Stopped\".", "The lyrics used within describe various mental states such as posttraumatic stress disorder.", "The sample used in the song is \"Hung Up On My Baby\" by Isaac Hayes from his 1974 film \"Tough Guys\".", "It was the only number-one single (chart: Hot Rap Singles) ever released by the Geto Boys.", "It reached #23 on the \"Billboard\" Hot 100, making it the highest charting single by the Geto Boys.", "It was also certified Gold by the RIAA.", "It has been regarded as one of the best hip hop songs to come out of the 90's.", "\"Mind Playing Tricks on Me\" has received acclaim over the years.", "In 2012, Rolling Stone Magazine ranked it the fifth greatest hip hop song of all time.", "The song was rated number 18 in the 100 Greatest Rap Songs by About.com.", "VH1 ranked the song 82 on its list of 100 Greatest Songs of the 90's and 45 on its list of 100 Greatest Songs of Hip Hop." ], [ "Kottonmouth Kings", "Kottonmouth Kings\n\nKottonmouth Kings is an American hip hop group from Placentia, Orange County, California.", "The band officially formed in 1996, describing their eclectic sound as \"psychedelic hip-hop punk rock\".", "Kottonmouth Kings are composed of Daddy X (singer of Humble Gods, X Pistols, former singer of Doggy Style), Lou Dog (drummer of Humble Gods and former drummer of Doggy Style), D-Loc, DJ Bobby B, and newest member/ vocalist, The Dirtball.", "The group first attracted mainstream attention with the song \"Suburban Life\", which appeared on the soundtrack to the film \"Scream 2.\"", "The groups original lineup consisted of D-Loc and Saint Dog and Johnny Richter(Johnny left before the recording of Royal Highness) but later incorporated Daddy X and the Dirtball.", "On February 24, 1998 Kottonmouth Kings released their first overall album, and their first EP, an EP titled Stoners Reeking Havoc.", "On August 11, 1998 Kottonmouth Kings released their first national album, first studio album, and 2nd overall album titled Royal Highness on Suburban Noize Records and Capitol Records.", "The album featured the original lineup of: Daddy X, D-Loc, Saint Dog on vocals, and Lou Dog on drums and percussion, and DJ Bobby B." ] ], "gold": "\"Mind Playing Tricks on Me\" is a song that has been referenced and sampled by numerous artists. The original version of \"Mind Playing Tricks on Me\" was sang by Geto Boys and was featured on their 1991 album \"We Can't Be Stopped\". In 2001, The Kottonmouth Kings, a group known for their activism in favor of legalizing cannabis, sang a cover of the song for their album, \"Hidden Stash II: The Kream of the Krop\". In 2012, the song was included in the album, \"Smothered, Covered & Chunked\", sang by Insane Clown Posse with Anybody Killa and Lil Wyte.", "prediction 1": "\"Mind Playing Tricks on Me\" is a single by the Geto Boys, featured on their 1991 album We Can't Be Stopped. The Kottonmouth Kings remade the song for their album \"\" under the same name. Kryptik & Team Death made a remix of the song for the compilation album \"Devil's Nite 2K8\" titled \"Mind Playing Tricks On Me '08.\" The Insane Clown Posse also covered this song with Detroit native Anybody Killa and Southern rapper Lil Wyte on their bonus cover album \"Smothered, Covered, Covereking Havoc\".", "prediction 2": "Mind Playing Tricks on Me is a single by the Geto Boys, featured on their 1991 album We Can't Be Stopped. The Kottonmouth Kings remade the song for their album \"\" under the same name. Kryptik & Team Death made a remix of the song for the compilation album \"Devil's Nite 2K8\" titled Mind Playing Tricks On Me '08.\" The Insane Clown Posse also covered this song with Detroit native Anybody Killa and Southern rapper Lil Wyte on their bonus cover album \"Smothered, Covered, Chunked.\" The Dirtball also recorded a version of Mind Playing Tricks on Me. The Geto Boys released their 1991 album, with Saint Dog as the Dirtball as a 2nd overall album Royal Highness.", "prediction 3": "Mind Playing Tricks on Me is a single by the Geto Boys, featured on their 1991 album We Can't Be Stopped. It was also covered by The Kottonmouth Kings and Daddy X. The Dirtball is a member of the American hip hop group Kottonmouth Kings.", "prediction 4": "Mind Playing Tricks on Me is a song by the Geto Boys, featured on their 1991 album We Can't Be Stopped. The Kottonmouth Kings remade the song for their album \"\" under the same name. Kryptik & Team Death made a remix of the song for the compilation album Devil's Nite 2K8 titled Mind Playing Tricks On Me '08.\" The Insane Clown Posse also covered this song with Detroit native Anybody Killa and Southern rapper Lil Wyte on their bonus cover album \"Smothered, Covered, Covered, Covered & Chunked.\"", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 164 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 474, "end": 492 }, { "error type": "Irrelevant", "explanation": "", "start": 401, "end": 416 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 382 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"Mind Playing Tricks on Me\" is a single by the Geto Boys, featured on their 1991 album We Can't Be Stopped. The Kottonmouth Kings remade the song for their album, under the same name. Kryptik & Team Death made a remix of the song for the compilation album \"Devil's Nite 2K8\" titled \"Mind Playing Tricks On Me '08.\" The Insane Clown Posse also covered this song with Anybody Killa and Lil Wyte on their bonus cover album \"Smothered, Covered & Chunked\". Brazilian rapper Gabriel o Pensador sampled \"Mind Playing Tricks on Me\" in his song \"Lavagem Cerebral\"." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who is the democratic whip in the house?", "passages": [ [ "Party leaders of the United States House of Representatives", "Party leaders of the United States House of Representatives\n\nParty leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot.", "With the Republicans holding a majority of seats and the Democrats holding a minority, the current leaders are: Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "Unlike in Westminster style legislatures or as with the Senate Majority Leader, the House Majority Leader's duties and prominence vary depending upon the style and power of the Speaker of the House.", "Typically, the Speaker does not participate in debate and rarely votes on the floor.", "In some cases, Majority Leaders have been more influential than the Speaker; notably, Tom DeLay was more prominent than Speaker Dennis Hastert.", "In addition, Speaker Newt Gingrich delegated to Dick Armey an unprecedented level of authority over scheduling legislation on the House floor.", "The current Minority Leader Nancy Pelosi serves as floor leader of the opposition party, and is the counterpart to the Majority Leader.", "Unlike the Majority Leader, the Minority Leader is on the ballot for Speaker of the House during the convening of the Congress." ], [ "Jim Clyburn", "Jim Clyburn\n\nJames Enos Clyburn (; born July 21, 1940) is an American politician of the Democratic Party serving as the U.S. Representative for since 1993, and the House Assistant Minority Leader since 2011.", "He was previously House Majority Whip, serving in that post from 2007 to 2011.", "His congressional district includes large portions of Columbia and Charleston, as well as several rural areas between them.", "Clyburn is the current dean of the South Carolina congressional delegation.", "As Assistant Democratic Leader, he is the third-ranking Democrat in the House behind House Minority Leader Nancy Pelosi and Minority Whip Steny Hoyer.", "After the Democrats took control of the House following the 2018 midterm elections, Clyburn will serve in his second stint as Majority Whip beginning in January 2019 as part the 116th Congress, continuing his status as the number three House Democrat behind (likely) Speaker of the House Pelosi and confirmed Majority Leader Hoyer.", "Clyburn was born in Sumter, South Carolina, the son of Enos Lloyd Clyburn, a fundamentalist minister, and his wife, Almeta (n\u00e9e Dizzley), a beautician." ], [ "Steny Hoyer", "Steny Hoyer\n\nSteny Hamilton Hoyer (; born June 14, 1939) is an American politician serving as the U.S. Representative for , serving since 1981.", "The district includes a large swath of rural and suburban territory southeast of Washington, D.C..", "Hoyer is the dean of the Maryland Congressional delegation and the House Minority Whip.", "A Democrat, he was first elected in a special election on May 19, 1981 and served as the House Majority Leader from 2007 to 2011, under Speaker Nancy Pelosi.", "He had previously served two stints as House Minority Whip - from 2003 to 2007, and from 2011 to 2019.", "That made him the second-ranking figure in the House Democratic Leadership hierarchy.", "After the 2018 midterm elections in which the Democrats took control of the House, Hoyer will begin his second stint as Majority Leader in January 2019 as part of the 116th Congress, and will remain the number two House Democrat behind Speaker-designate Pelosi.", "The 116th Congress will also mark Hoyer's 20th term in the House.", "As of December 5, 2017, he is the most senior Democrat serving in the House of Representatives following the resignation of John Conyers.", "Starting in 2019, Hoyer will serve as the House Majority Leader." ] ], "gold": "Party leaders and whips of the United States House of Representatives are elected by their respective parties in a closed-door caucus by secret ballot. With the Democrats holding a majority of seats in the House currently, the Majority Whip is Jim Clyburn of South Carolina. Clyburn succeeds Steny Hoyer of Maryland who, during two periods of Republican House control, 2003\u20132007 and 2011\u20132019, served as House Minority Whip.", "prediction 1": "The United States House of Representatives has many Democratic whips. The current Democratic whips, also known as floor leaders, are Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "prediction 2": "The Democratic Whips in the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. The current Democratic Whips are Jim Clyburn, Steve Scalise, Nancy Pelosi, and Steny Hoyer.", "prediction 3": "There are several Democrats in the United States House of Representatives, each representing a different party. The Democratic whips are Kevin McCarthy, Steve Scalise, Nancy Pelosi, Jim Clyburn, and Steny Hoyer. McCarthy is the Majority Leader of the House of Representatives and Scalise the Majority Whip of the House of Representatives. Prior to that, Steve Scalise was the Majority Whip of the House of Representatives. Hoyer was the Minority Whip of the House of Representatives from 2003 to 2007 to 2011.", "prediction 4": "The majority leader of the House of Representatives is Kevin McCarthy, followed by Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 47, "end": 69 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 74, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 223 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Party leaders of the United States House of Representatives Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. With the Republicans holding a majority of seats and the Democrats holding a minority, the Democrat's whip is Minority Whip Steny Hoyer. He has two stints as House Minority Whip - from 2003 to 2007, and from 2011 to 2019. Democrat Jim Clyburn was the House Majority Whip, serving in that post from 2007 to 2011. He will also serve his second stint as Majority Whip beginning in January 2019." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote and sang i'm leaving on a jet plane?", "passages": [ [ "Leaving on a Jet Plane", "Leaving on a Jet Plane\n\n\"Leaving on a Jet Plane\" is a song written by John Denver in 1966 and most famously recorded by Peter, Paul and Mary.", "The original title of the song was \"Babe, I Hate to Go\", as featured on his 1966 studio album \"John Denver Sings\", but Denver's then producer Milt Okun convinced him to change the title.", "Peter, Paul and Mary recorded the song for their 1967 \"Album 1700\" but only released it as a single in 1969.", "It turned out to be Peter, Paul and Mary's biggest (and final) hit, becoming their only No. 1 on the \"Billboard\" Hot 100 chart in the United States.", "The song also spent three weeks atop the easy listening chart and was used in commercials for United Airlines in the late 1960s and early 1970s.", "The song also topped the charts in Canada, and reached No. 2 in both the UK Singles Chart and Irish Singles Chart in February 1970.", "In 1969, John Denver recorded a version of the song for his debut solo album, \"Rhymes & Reasons\", and re-recorded it in 1973 for \"John Denver's Greatest Hits\".", "His version was featured in the end credits of \"The Guard\".", "In the 1980s the song prompted litigation involving the British group New Order." ] ], "gold": "Leaving on a Jet Plane is a song written by John Denver in 1966 and most famously recorded by Peter, Paul and Mary. The original title of the song was Babe, I Hate to Go, as featured on his 1966 studio album John Denver Sings, but Denver's then producer Milt Okun convinced him to change the title. Peter, Paul and Mary recorded the song for their 1967 studio album, Album 1700, and Warner Bros.- Seven Arts released it as a single in 1969.", "prediction 1": "\"Leaving on a Jet Plane\" is a song written by John Denver in 1966. Peter, Paul and Mary recorded the song for their 1967 album 1700, but only released it as a single in 1969. It turned out to be Peter, Paul and Mary's biggest (and final) hit, becoming their only No. 1 on the Billboard Hot 100 chart in the United States. John Denver recorded a version of the song for his debut solo album, Rhymes & Reasons, and re-recorded it in 1973 for John Denver's Greatest Hits. His version was featured in the end credits of The Guard.", "prediction 2": "\"Leaving on a Jet Plane\" is a song written by John Denver in 1966 and most famously recorded by Peter, Paul and Mary. The original title of the song was \"Babe, I Hate to Go\", as featured on Denver's 1966 studio album \"John Denver Sings\", but Denver's then producer Milt Okun convinced him to change the title. In 1967, Peter, Paul and Mary recorded the song for their 1967 \"Album 1700\" but only released it as a single in 1969. In 1969, John Denver recorded a version of the song for his debut solo album, Rhymes & Reasons, and re-re-re-re-re-recorded it in 1973 for \"John Denver's Greatest Hits\".", "prediction 3": "\"I'm leaving on a jet plane\" is a song written by John Denver in 1966 and most famously recorded by Peter, Paul and Mary. The original title of the song was \"Babe, I Hate to Go\", as featured on his 1966 studio album \"John Denver Sings\", but Denver's then producer Milt Okun convinced him to change the title.", "prediction 4": "\"I'm leaving on a jet plane\" is a song written by John Denver in 1966 and most famously recorded by Peter, Paul and Mary. The original title of the song was \"Babe, I Hate to Go\", as featured on his 1966 studio album \"John Denver Sings\", but Denver's then producer Milt Okun convinced him to change the title. Peter, Paul and Mary recorded the song for their 1967 \"Album 1700\" but only released it as a single in 1969. It turned out to be Peter, Paul and Mary's biggest, becoming their only No. 1 on the \"Billboard\" Hot 100 chart in the United States. It turned out to be their biggest (and final) hit, becoming their only No. 1 on the Billboard Hot 100 chart in the United States. It turned out to be Peter, Paul and Mary's biggest (and final) hit, becoming their only No", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 321 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Leaving on a Jet Plane\" is a song written by John Denver in 1966. Peter, Paul and Mary recorded the song for their 1967 album 1700, but only released it as a single in 1969. The original title of the song was \"Babe, I Hate to Go\", as featured on his 1966 studio album \"John Denver Sings\", but Denver's then producer Milt Okun convinced him to change the title." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the issuing of the national identity card began in sri lanka?", "passages": [ [ "National identity card (Sri Lanka)", "National identity card (Sri Lanka)\n\nThe National Identity Card (abbreviation: NIC) is the identity document in use in Sri Lanka.", "It is compulsory for all Sri Lankan citizens who are sixteen years of age and older to have their NICs.", "NICs are issued by the Department for Registration of Persons.", "The Registration of Persons Act No.32 of 1968 as amended by Act Nos 28 and 37 of 1971 and Act No.11 of 1981 legislates the issuance and usage of NICs.", "The original intention was to issue a book form identity card very much like the driving license of the 1970s because of the need to accommodate the 2\"x2\" size photos which were the norm at the time.", "This resulted in limited use of the ID.", "For example, fishermen could not use it as the book would get wet.", "It was necessary to make it easy to carry and waterproof while standing up to rough handling.", "T. B. Ekanayake, the first Commissioner of Registration of Persons, contacted Dr. D. B. Nihalsingha, the Director of the Government Film Unit, and handed over the responsibility for the design of an easy to carry the card.", "Gaspe Ratnayake, the artist of the GFU, designed the card, which is the same design even today." ] ], "gold": "The National Identity Card (abbreviation: NIC) is the identity document in use in Sri Lanka. It is compulsory for all Sri Lankan citizens who are fifteen years of age and older to have their NICs. NICs are issued by the Department for Registration of Persons. Sri Lanka first began issuing NICs on 14 September 1972 and first began issuing smart card NICs on 27 October 2017.", "prediction 1": "The registration of persons act, which originally established the registration of individuals in Sri Lanka, was first passed in 1968. Acts 28 and 37 of 1971 and 11 of 1981 also legislated the issuance and usage of NICs. The original intention was to issue a book form identity card very much like the driving license of the 1970s because of the need to accommodate the 2\"x2\" size photos which were the norm at the time. This resulted in limited use of the ID. It was necessary to make it easy to carry and waterproof while standing up to rough handling. Gaspe Ratnayake, the artist of the GFU, designed the card, which remains the same design even today.", "prediction 2": "The original intention was to issue a book form identity card very much like the driving license of the 1970s because of the need to accommodate the 2\"x2\" size photos which were the norm at the time. This resulted in limited use of the ID. It was necessary to make it easy to carry and waterproof while standing up to rough handling. Gaspe Ratnayake, the artist of the GFU, designed the card, which is the same design even today.", "prediction 3": "The National Identity Card (abbreviation: NIC) is the identity document in use in Sri Lanka. It is compulsory for all Sri Lankan citizens who are sixteen years of age and older to have their NICs. The original intention was to issue a book form identity card very much like the driving license of the 1970s because of the need to accommodate the 2\"x2\" size photos which were the norm at the time. This resulted in limited use of the ID. It was necessary to make it easy to carry and waterproof while standing up to rough handling. Gaspe Ratnayake, the artist of the GFU, designed the card, which is the same design even today.", "prediction 4": "The issuing of the national identity card in Sri Lanka began in 1968 and is now compulsory for all Sri Lankan citizens who are sixteen years of age and older to have their NICs. The Registration of Persons Act No.32 of 1968 was amended by Act Nos 28 and 37 of 1971 and Act No.11 of 1981. The card is issued by the Department for Registration of Persons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 419 }, { "error type": "Irrelevant", "explanation": "", "start": 420, "end": 459 }, { "error type": "Irrelevant", "explanation": "", "start": 460, "end": 553 }, { "error type": "Irrelevant", "explanation": "", "start": 554, "end": 654 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2, 3 ] } ], "corrected-prediction": "The National Identity Card (abbreviation: NIC) is the identity document in use in Sri Lanka. It is compulsory for all Sri Lankan citizens who are sixteen years of age and older to have their NICs. NICs are issued by the Department for Registration of Persons." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Actor who provided the voice for scar in the lion king?", "passages": [ [ "Scar (The Lion King)", "Scar (The Lion King)\n\nScar is a fictional character who appears in Disney's \"The Lion King\" franchise.", "Scar was created in 1989 by screenwriters Irene Mecchi, Jonathan Roberts, and Linda Woolverton, and animated by Andreas Deja.", "The Pride Lands' reclusive heir presumptive, Scar is introduced in the first film as Simba's uncle and Mufasa's younger brother.", "Originally first-in-line to Mufasa's throne until he is suddenly replaced by Simba, Scar decides to lead an army of hyenas in his plot to take the throne by killing Mufasa and exiling Simba, ultimately blaming his brother's death on his nephew.", "Loosely based on King Claudius, the main antagonist of William Shakespeare's play \"Hamlet\", Scar's villainy was additionally inspired by Adolf Hitler and Joseph Stalin.", "As the character's supervising animator, Deja based Scar's appearance on that of Irons himself, as well as the actor's Academy Award-winning performance as Claus von B\u00fclow in \"Reversal of Fortune \"(1990).", "Before Irons was cast, the directors had considered offering the role to actors Tim Curry and Malcolm McDowell.", "As a character, Scar has garnered widespread acclaim from film critics, who greeted Irons's vocal performance with equal enthusiasm." ], [ "Scar (The Lion King)", "Consequently, Disney was forced to recruit American voice actor Jim Cummings, who had also been providing the voice of \"The Lion King\"s laughing hyena Ed at the time, to impersonate Irons and record the rest of the song.", "Jim Cummings told \"The Huffington Post \"that \"[s]tunt singing\" is actually something the actor continues to do regularly, having done the same for American actor Russell Means, voice of Chief Powhatan in Disney's \"Pocahontas \"(1995).", "Critics observed that Irons \"fakes his way\u00a0... through 'Be Prepared' in the grand tradition of talk-singing,\" drawing similarities between him and American actor James Cagney and English actor Rex Harrison.", "Deja revealed that, during a recording session, Irons' stomach was grumbling.", "Deja joked, \"The growling sound could be heard in his recording, so we had to record that part of his dialog all over again.\"", "As a result of Irons' prominent British accent, critics have compared both the actor and Scar to Shere Khan, the villain of Disney's \"The Jungle Book \"(1967), voiced by English actor George Sanders." ], [ "Scar (The Lion King)", "Chiwetel Ejiofor was officially chosen on November 1, 2017 for the role of Scar for the CGI live action remake, \"The Lion King\" (2019) directed by Jon Favreau, as he had impressed him after watching his antagonistic performance as Baron Mordo in the Marvel film \"Doctor Strange\" (2016).", "The studio originally dismissed \"The Lion King \"as a risk because, at the time, it was believed that the greatest films starred people.", "Concerned about the novelty of the film, Disney CEO Jeffrey Katzenberg decided to divide the studio into two separate animated films, \"The Lion King \"and \"Pocahontas\", the latter of which was dubbed \"the home run\" because it was expected to be the more successful of the two projects.", "Disney's more seasoned and experienced animators gravitated towards \"Pocahontas\", while the studio's newer animators were relegated to working on \"The Lion King\", dubbing themselves the \"B-team\".", "However, Allers received Katzenberg's decision positively as an opportunity for \"newer animators ... to step up to leadership roles\", among them", "Andreas Deja, who became Scar's supervising animator." ] ], "gold": "Scar is the main antagonist in Disney's The Lion King franchise, originally first-in-line to Mufasa's throne until he is suddenly replaced by Mufasa's son Simba, after which decides to lead an army of hyenas in his plot to take the throne by killing Mufasa and exiling Simba, ultimately blaming his brother's death on his nephew. On th 1994 animated movie he was voiced by Jeremy Irons and Jim Cummings, who did the singing sections and later returned to voice the character in The Lion King II: Simba's Pride. The photorealistic version of the character in the 2019 The Lion King CGI remake is voiced Chiwetel Ejiofor.", "prediction 1": "Scar is a fictional character who appears in Disney's The Lion King franchise. The reclusive heir presumptive, Scar is introduced in the first film as Simba's uncle and Mufasa's younger brother. Consequently, Disney was forced to recruit American voice actor Jim Cummings, who had also been providing the voice of \"The Lion King\"'s laughing hyena Ed at the time, to impersonate Irons and record the rest of the song. In the 2019 film adaptation, Chiwetel Ejiofor was officially chosen on November 1, 2017 for the role of Scar in the CGI live action remake, \"The Lion King\".\n", "prediction 2": "There are several actors who have voiced Scar in Disney's The Lion King franchise. American actor James Cagney and English actor Rex Harrison provided the voices for Scar in the 1987 film, The Lion King. The original film, The Lion King: Prince of Persia, was voiced by British actor Richard Gere. American actor Jim Cummings provided the voice for Scar in the 1996 film; however, the 2009 version was voiced by English actor George Sanders.", "prediction 3": "The role of Scar is based on Richard Rodgers' role as Claus von B\u00fclow in Reversal of Fortune in 1990. In Disney's The Lion King franchise, the voice of Scar is provided by James Cagney. Also on the production team was Andy Serkis, who provided the voice of King Tigress in Pinocchio, Ian McKellen in Mahjong In The Jungle Book, and George Sanders who provided the voice of Shere Khan in The Jungle Book.", "prediction 4": "The voice of Scar is Jim Cummings in Disney's The Lion King franchise. Other greater-than-life characters such as Shere Khan and Oswald Chamberlain also have been voiced by Cummings. On the other hand, Chinese actor Chiwetel Ejiofor provided the voice of Scar in Disney's The Lion King franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 5, "end": 33 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 485, "end": 504 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Scar appears in Disney's The Lion King franchise. Originally first-in-line to Mufasa's throne until he is suddenly replaced by Simba, Scar decides to lead an army of hyenas in his plot to take the throne by killing Mufasa and exiling Simba, ultimately blaming his brother's death on his nephew. Scar was voiced by Irons. In addition, Disney was forced to recruit American voice actor Jim Cummings to impersonate Irons and record the rest of a song. In the 2019 film adaptation, Chiwetel Ejiofor was officially chosen for the role of Scar in the 2019 CGI live action remake, \"The Lion King\".\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who keeps their powers in wizards of waverly place?", "passages": [ [ "Wizards of Waverly Place (season 4)", "Alex wins and gains full wizardry; Justin becomes a full wizard as well when Professor Crumbs reveals he is retiring as headmaster of WizTech and passes the position to Justin.", "Jerry also decides to pass down the Waverly Sub Station to Max one day since he is the only child who is not a wizard anymore.", "The series ends with hugging and Alex saying that they are all happy." ], [ "Alex Russo", "Alex Russo\n\nAlexandra Margarita \"Alex\" Russo is a fictional character and the protagonist of the Disney Channel sitcom \"Wizards of Waverly Place\", portrayed by Selena Gomez.", "In 2008, AOL named her the twentieth greatest witch in television history.", "Selena Gomez, who portrays Alex, is one of the only two cast members to appear in every single episode of the series; the only other cast member to do so is David Henrie, who portrays Justin Russo.", "The character has also appeared in \"The Suite Life on Deck\" episode, Double Crossed.", "\"Wizards of Waverly Place\" revolves around Alex Russo and her two brothers, Justin (David Henrie) and Max (Jake T. Austin), three siblings who training to become their family's wizard and retain their powers.", "The siblings reside in Manhattan's Greenwich Village with their parents Jerry (David DeLuise), a former wizard, and Theresa (Maria Canals Barrera), a mortal.", "Alex and her brothers attend classes under the tutelage of their father Jerry, from whom they inherited their magical abilities.", "The siblings tend to grow unfocused at times, especially pertaining to when they discover that their abilities can be applied towards more non-magical uses.", "Additionally, her family owns and runs a subway-themed sandwich shop, and keep the fact that they are wizards a secret from most people outside of their immediate family." ] ], "gold": "Wizards of Waverly Place is an American fantasy teen sitcom created by Todd J. Greenwald that aired on Disney Channel for four seasons between October 2007 and January 2012. The series centers on Alex Russo, a teenage wizard living in Greenwich Village, Manhattan, who undertakes training alongside her siblings, Justin and Max, who are also equipped with magical abilities. At the end of the show, Alex becomes a full wizard after winning the wizard competition and Justin keeps his full powers by being made the Headmaster at Wiz Tech.", "prediction 1": "Harry, Justin, and Max are three siblings in the sitcom Wizards of Waverly Place, who train to become their family's wizard and retain their powers. Harry's family keep their powers a secret and keep their magical abilities a secret from most people outside of their immediate family. The show revolves around Alex Russo and her two brothers, Justin (David Henrie) and Max (Jake T. Austin), three siblings who training to become their family's wizard and retain their powers.", "prediction 2": "Alex Russo, who is the protagonist of the Disney Channel sitcom Wizards of Waverly Place, is the niece and nephew of Justin and Max Russo, who are training to become their family's wizard and retain their powers.", "prediction 3": "Wizards of Waverly Place revolves around Alex Russo and her two brothers, Justin (David Henrie) and Max (Jake T. Austin), three siblings who training to become their family's wizard and retain their powers.", "prediction 4": "In the animated television series \"Wizards of Waverly Place\", the three siblings who train to become their family's wizard and retain their powers are Alex Russo, Justin Henrie, and Max Austin.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 0, "end": 6 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 149, "end": 156 }, { "error type": "Redundant", "explanation": "Harry's family keep their powers a secret and ", "start": 195, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 190 }, { "error type": "Redundant", "explanation": "Harry, Justin, and Max are three siblings in the sitcom Wizards of Waverly Place, who train to become their family's wizard and retain their powers.", "start": 285, "end": 475 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Alex Russo, Justin, and Max are three siblings in the sitcom Wizards of Waverly Place, who train to become their family's wizard and retain their powers. They reside in Manhattan's Greenwich Village. Alex wins and gains full wizardry; Justin becomes a full wizard as well when he becomes headmaster of WizTech." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who plays drax on gaurdians of the galaxy?", "passages": [ [ "Drax the Destroyer", "In the film, Drax is an alien whose wife and daughter were slaughtered by Ronan the Accuser, on the instructions of Thanos, for which Drax vows revenge.", "He first meets the other Guardians of the Galaxy in prison, including Gamora, whom he holds responsible for his family's deaths because she is a daughter of Thanos.", "She tells him that she was raised by Thanos only after he slaughtered her own family, and bears no loyalty to him, and the two join Peter Quill in escaping prison in order to confront Ronan, whom they eventually kill.", "A recurring gag throughout the film is Drax's inability to understand metaphors because Drax's species is, according to Rocket, completely literal.", "Bautista reprised his role as Drax in its 2017 sequel \"Guardians of the Galaxy Vol. 2\" and again in \"\" (2018)." ], [ "Drax the Destroyer", "Drax the Destroyer\n\nDrax the Destroyer (Arthur Douglas) is a fictional character appearing in American comic books published by Marvel Comics.", "Created by Jim Starlin, the character first appeared in \"The Invincible Iron Man\" #55 (February 1973).", "The character's origin story relates that Arthur Douglas was a human whose family was attacked and killed by the supervillain Thanos.", "Needing a champion to combat Thanos, the being known as Kronos took Arthur's spirit and placed it in a powerful new body, and Drax the Destroyer was born.", "Drax's powers included enhanced strength and resilience, flight, and the ability to project energy blasts from his hands.", "The character often battled Thanos, and on occasion the superheroes Captain Marvel and Adam Warlock.", "He was also a member of the group known as the Infinity Watch.", "In 2004, the character lost his flight and energy blasts, and a portion of his strength and resilience.", "This version of the character played a role in the crossover comic book storylines \"Annihilation\" and \"\", and became a member of the relaunched Guardians of the Galaxy.", "Drax has been featured in a variety of associated Marvel merchandise, including animated television series, action figures, and video games." ], [ "Bumblebee (film)", "On May 31, 2018, Jess Harnell revealed he will be reprising his role as the voice of Barricade from the 2007 film and \"The Last Knight,\" but was presumably cut from the film On July 13, 2018, it was announced that Angela Bassett and Justin Theroux would be voicing a pair of new Decepticons respectively called Shatter and Dropkick, who will be the main antagonists of the film.", "On August 26, 2018, voice actor David Sobolov, who had previously voiced Depthcharge in \"\", Brawl in the 2007 video game and Shockwave in \"\" confirmed he will voice Blitzwing.", "On December 3, 2018, Lorenzo di Bonaventura revealed to IGN that Dylan O'Brien will voice Bumblebee.", "On December 9, 2018, about a week before the film's release, voice actress Grey Griffin revealed through a special fan screening that she had reprised her role as Arcee from \"\".", "On the same day, voice actor and long-time \"Transformers\" fan Jon Bailey also revealed that he has voiced both Shockwave and Soundwave in the film, both of which were previously voiced by Frank Welker in \"\"." ] ], "gold": "Drax the Destroyer, a.k.a. Arthur Douglas, is a fictional character appearing in American comic books published by Marvel Comics. David Sobolov, a Canadian voice actor and director, has played Drax in the Ultimate Spider-Man episode \"Guardians of the Galaxy,\" the TV series Guardians of the Galaxy, and Guardians of the Galaxy playset of Disney Infinity 2.0 and Disney Infinity 3.0. A live-action film version of Guardians of the Galaxy was made in 2014 in which actor and former professional wrestler, Dave Bautista, plays the character Drax. He reprised the role in the Guardians of the Galaxy Vol. 2 in 2017, Avengers: Infinity War in 2018, and Avengers: End Game in 2019.", "prediction 1": "Drax the Destroyer is a fictional character appearing in American comic books published by Marvel Comics, created by Jim Starlin. Arthur Douglas was a human whose family was attacked and killed by the supervillain Thanos. Needing a champion to combat Thanos, the being known as Kronos took Arthur's spirit and placed it in a powerful new body, and Drax the Destroyer was born. Bautista reprised his role as Drax in its 2017 sequel \"Guardians of the Galaxy Vol. 2\" and again in \"\" (2018) and again in \"\" (2018).", "prediction 2": "Drax the Destroyer is a fictional character appearing in American comic books published by Marvel Comics. Created by Jim Starlin, the character first appeared in The Invincible Iron Man #55 in February 1973. Bautista reprised his role as Drax in its 2017 sequel Guardians of the Galaxy Vol. 2 and again in \"\" (2018).", "prediction 3": "Drax the Destroyer is a fictional character appearing in American comic books published by Marvel Comics. Created by Jim Starlin, the character first appeared in Invincible Iron Man #55 in February 1973. The character's origin story relates that Arthur Douglas was a human whose family was attacked and killed by the supervillain Thanos. Needing a champion to combat Thanos, the being known as Kronos took Arthur's spirit and placed it in a powerful new body, and Drax the Destroyer was born.", "prediction 4": "Drax the Destroyer was voiced by Adam Bautista in the 2017 Guardians of the Galaxy movie. In the 2017 Guardians of the Galaxy Vol. 2 film, Bautista played Drax while also voicing Gamora, Gamora's daughter.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 376 }, { "error type": "Redundant", "explanation": "Bautista reprised his role as Drax in its 2017 sequel \"Guardians of the Galaxy Vol. 2\" and again in \"\" (2018) ", "start": 487, "end": 510 }, { "error type": "Irrelevant", "explanation": "", "start": 477, "end": 479 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Drax the Destroyer (Arthur Douglas) is a fictional character appearing in American comic books published by Marvel Comics. Bautista reprised his role as Drax in its 2017 sequel \"Guardians of the Galaxy Vol. 2\" and again in 2018." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does meredith find out pierce is her sister?", "passages": [ [ "Fear (Of the Unknown) (Grey's Anatomy)", "Fear (Of the Unknown) (Grey's Anatomy)\n\n\"Fear (Of the Unknown)\" is the twenty fourth episode and the season finale of the tenth season of the American television medical drama \"Grey's Anatomy\", and is the 220th episode overall.", "It aired on May 15, 2014 on ABC in the United States.", "The episode was written by William Harper and directed by Tony Phelan.", "On its initial airing it was watched by 8.92 million viewers.", "The episode marked the departure of one of lead characters, Cristina Yang, played by Sandra Oh since the inception of the series.", "The episode focuses on Yang as she prepares to say her goodbyes to the doctors at Grey-Sloan Memorial hospital including her best friend Meredith Grey (Ellen Pompeo) and her love interest Owen Hunt (Kevin McKidd) and leave for Zurich for her new job.", "The episode received generally positive reviews with Oh's performance receiving enormous praise.", "Amidst Yang's departure a catastrophe occurs at a nearby mall bringing loads of patients to Grey-Sloan.", "Derek Shepherd (Patrick Dempsey) asks Meredith to move to D.C. with her for his new job." ] ], "gold": "Meredith finds out Pierce is her sister in a Grey's Anatomy episode entitled \"Fear (Of the Unknown),\" which is Season 10 Episode 24, the season finale of the drama's tenth season, and episode number 220 overall. The episode's date is May 15, 2014, the day it aired on ABC in the United States.", "prediction 1": "Fear (Of the Unknown) is the twenty fourth episode and the season finale of the tenth season of the American television medical drama Grey's Anatomy, and is the 220th episode overall. It aired on May 15, 2014 on ABC in the United States.", "prediction 2": "Fear (Of the Unknown) is the twenty fourth episode and the season finale of the tenth season of the American television medical drama Grey's Anatomy, and is the 220th episode overall. The episode aired on May 15, 2014 on ABC in the United States.", "prediction 3": "Fear (Of the Unknown) is the twenty fourth episode and the season finale of the tenth season of the American television medical drama Grey's Anatomy, and is the 220th episode overall. It aired on May 15, 2014 on ABC in the United States. Amidst Yang's departure a catastrophe occurs at a nearby mall bringing loads of patients to Grey-Sloan. Derek Shepherd asks Meredith to move to D.C. with her for his new job.", "prediction 4": "\"Fear (Of the Unknown)\" is the twenty fourth episode and the season finale of the tenth season of the American television medical drama \"Grey's Anatomy\" and is the 220th episode overall. Fear occurs in the episode \"Damaged and Betrayed\" which aired on May 15, 2014.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Fear (Of the Unknown) is the twenty fourth episode and the season finale of the tenth season of the American television medical drama Grey's Anatomy, and is the 220th episode overall. It aired on May 15, 2014 on ABC in the United States." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When does a baby have its first bowel movement?", "passages": [ [ "Meconium", "Meconium\n\nMeconium is the earliest stool of a mammalian infant.", "Unlike later feces, meconium is composed of materials ingested during the time the infant spends in the uterus: intestinal epithelial cells, lanugo, mucus, amniotic fluid, bile, and water.", "Meconium, unlike later feces, is viscous and sticky like tar, its color usually being a very dark olive green; it is almost odorless.", "When diluted in amniotic fluid, it may appear in various shades of green, brown, or yellow.", "It should be completely passed by the end of the first few days after birth, with the stools progressing toward yellow (digested milk).", "Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid (also called \"amniotic liquor\") prior to birth or during labor and delivery.", "The stained amniotic fluid (called \"meconium liquor\" or \"meconium stained liquor\") is recognized by medical staff that this may be a sign of fetal distress.", "Some post-dates pregnancies (where the woman is more than 40 weeks pregnant) may also have meconium stained liquor without fetal distress." ], [ "Meconium", "In the USA, the results of meconium testing may be used by child protective services and other law enforcement agencies to determine the eligibility of the parents to keep the newborn.", "Most of the time that the amniotic fluid is stained with meconium it will be homogeneously distributed throughout the fluid making it brown.", "This indicates that the fetus passed the meconium some time ago such that sufficient mixing occurred as to establish the homogeneous mixture.", "Terminal meconium occurs when the fetus passes the meconium a short enough time before birth/cesarean section that the amniotic fluid remains clear, but individual clumps of meconium are in the fluid.", "The meconium sometimes becomes thickened and congested in the intestines, a condition known as meconium ileus.", "Meconium ileus is often the first sign of cystic fibrosis.", "In cystic fibrosis, the meconium can form a bituminous black-green mechanical obstruction in a segment of the ileum.", "Beyond this, there may be a few separate grey-white globular pellets.", "Below this level, the bowel is a narrow and empty micro-colon.", "Above the level of the obstruction, there are several loops of hypertrophied bowel distended with fluid." ] ], "gold": "Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid (also called amniotic liquor) prior to birth or during labor and delivery. The meconium sometimes becomes thickened and congested in the intestines, a condition known as meconium ileus. Meconium ileus is often the first sign of cystic fibrosis. If this occurs, no meconium is passed, and abdominal distension and vomiting appear soon after birth.", "prediction 1": "The baby has its first bowel movement in the uterus at about 37 days after birth. Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid prior to birth or during labor and delivery. Terminal meconium occurs when the fetus passes the meconium a short enough time before birth/cesarean section that the amniotic fluid remains clear, but individual clumps of meconium are in the fluid.", "prediction 2": "Meconium is the earliest stool of a mammalian infant, and is composed of materials ingested during the time the infant spends in the uterus: intestinal epithelial cells, lanugo, mucus, amniotic fluid, bile, and water. Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid prior to birth or during labor and delivery. Terminal meconium occurs when the fetus is short enough time before birth/cesarean section that the meconium becomes thickened and congested in the intestine, a condition known as meconium ileus. This condition is often the first sign of cystic fibrosis.", "prediction 3": "The earliest stool of a mammalian infant is known as meconium, when the fetus passes the meconium a short enough time before birth/cesarean section that the amniotic fluid remains clear, but individual clumps of meconium are in the fluid. Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid prior to birth or during labor and delivery. Meconium ileus is often the first sign of cystic fibrosis.", "prediction 4": "The baby's first stool normally comes from meconium, a congested material found in the bowel of the infant. In some cases, meconium may be expelled into the amniotic fluid, also called amniotic liquor, before birth or during labor and delivery.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 451 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 81 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Meconium is normally retained in the infant's bowel until after birth, but sometimes it is expelled into the amniotic fluid (also called \"amniotic liquor\") prior to birth or during labor and delivery. The meconium sometimes becomes thickened and congested in the intestines, a condition known as meconium ileus. Meconium ileus is often the first sign of cystic fibrosis." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who owns most of the world oil supply?", "passages": [ [ "Petroleum industry", "16, the first oil discovery drilled out of sight of land.", "Forty-four Gulf of Mexico exploratory wells discovered 11 oil and natural gas fields by the end of 1949.", "During World War II (1939-1945) - control of oil supply from Baku and Middle East played a huge role in the events of the war and the ultimate victory of the allies.", "Cutting off the oil supply considerably weakened Japan in the latter part of the war.", "After World War II ended, the countries of the Middle East took the lead in oil production from the United States.", "Important developments since World War II include deep-water drilling, the introduction of the Drillship, and the growth of a global shipping network for petroleum relying upon oil tankers and pipelines.", "In 1949, first offshore oil drilling at Oil Rocks (Neft Dashlari) in the Caspian Sea off Azerbaijan eventually resulted in a city built on pylons.", "In the 1960s and 1970s, multi-governmental organizations of oil\u2013producing nations OPEC and OAPEC played a major role in setting petroleum prices and policy.", "Oil spills and their cleanup have become an issue of increasing political, environmental, and economic importance.", "With the advent of hydraulic fracturing and other horizontal drilling techniques, shale play has seen an enormous uptick in production." ], [ "OPEC", "The chief executive of the organization is the OPEC Secretary General.", "The Conference ordinarily meets at the Vienna headquarters, at least twice a year and in additional extraordinary sessions when necessary.", "It generally operates on the principles of unanimity and \"one member, one vote\", with each country paying an equal membership fee into the annual budget.", "However, since Saudi Arabia is by far the largest and most-profitable oil exporter in the world, with enough capacity to function as the traditional swing producer to balance the global market, it serves as \"OPEC's de facto leader\".", "At various times, OPEC members have displayed apparent anti-competitive cartel behavior through the organization's agreements about oil production and price levels.", "In fact, economists often cite OPEC as a textbook example of a cartel that cooperates to reduce market competition, as in this definition from OECD's \"Glossary of Industrial Organisation Economics and Competition Law\":\n\nInternational commodity agreements covering products such as coffee, sugar, tin and more recently oil (OPEC: Organization of Petroleum Exporting Countries) are examples of \"international cartels\" which have publicly entailed agreements between different national governments.", "OPEC members strongly prefer to describe their organization as a modest force for market stabilization, rather than a powerful anti-competitive cartel." ], [ "OPEC", "OPEC\n\nThe Organisation of the Petroleum Exporting Countries (OPEC, ) is an intergovernmental organisation of nations, founded in 1960 in Baghdad by the first five members (Iran, Iraq, Kuwait, Saudi Arabia, and Venezuela), and headquartered since 1965 in Vienna, Austria.", "the 15 countries accounted for an estimated 44 percent of global oil production and 81.5 percent of the world's \"proven\" oil reserves, giving OPEC a major influence on global oil prices that were previously determined by the so called \"Seven Sisters\u201d grouping of multinational oil companies.", "The stated mission of the organisation is to \"coordinate and unify the petroleum policies of its member countries and ensure the stabilization of oil markets, in order to secure an efficient, economic and regular supply of petroleum to consumers, a steady income to producers, and a fair return on capital for those investing in the petroleum industry.\"", "The organization is also a significant provider of information about the international oil market.", "Algeria, Angola, Ecuador, Equatorial Guinea, Gabon, Iran, Iraq, Kuwait, Libya, Nigeria, Qatar, the Republic of the Congo, Saudi Arabia (the de facto leader), United Arab Emirates, and Venezuela.", "Indonesia is a former member, and Qatar will no longer be a member of OPEC from 1 January 2019..", "By continent, two are South American, seven African, and six are Asian (Middle East)." ] ], "gold": "The Organization of the Petroleum Exporting Countries is an intergovernmental organization or cartel of 13 countries. In the 1960s and 1970s, multi-governmental organizations of oil\u2013producing nations OPEC and OAPEC played a major role in setting petroleum prices and policy. The current OPEC members are the following: Algeria, Angola, Equatorial Guinea, Gabon, Iran, Iraq, Kuwait, Libya, Nigeria, the Republic of the Congo, Saudi Arabia (the de facto leader), the United Arab Emirates and Venezuela. Saudi Aramco owns most of the world's oil supply.", "prediction 1": "The Organisation of the Petroleum Exporting Countries (OPEC, ) is an international organization of nations, founded in 1960 in Baghdad by the first five members (Iran, Iraq, Kuwait, Saudi Arabia, and Venezuela), headquartered since 1965 in Vienna, Austria. OPEC members account for an estimated 44 percent of global oil production and 81.5 percent of the world's proven oil reserves. Although OPEC members have displayed apparent anti-competitive cartel behavior through the organization's agreements about oil production and price levels, it serves as \"OPEC's de facto leader\".", "prediction 2": "The Organisation of the Petroleum Exporting Countries is a group of 15 countries that own a majority of the world's oil supply. OPEC members account for about 44 percent of global oil production and 81.5 percent of the world's proven oil reserves.", "prediction 3": "The Organisation of the Petroleum Exporting Countries (OPEC, formerly known as the Organisation of the Petroleum Exporting Countries, or OPEC) is an intergovernmental organisation of nations comprised of 15 countries. The 15 countries accounted for an estimated 44 percent of global oil production and 81.5 percent of the world's proven oil reserves, giving OPEC a major influence on global oil prices that were previously determined by the so-called \"Seven Sisters\" grouping of multinational oil companies. Despite this, the majority of world oil supply comes from Iran and Iraq, Saudi Arabian, while the United Arab Emirates and Venezuela account for the remaining oil.", "prediction 4": "The Organisation of the Petroleum Exporting Countries (OPEC) is an intergovernmental organisation of nations founded in 1960 in Baghdad by the first five members (Iran, Iraq, Kuwait, Saudi Arabia, and Venezuela), and headquartered since 1965 in Vienna, Austria. The 15 countries accounted for an estimated 44 percent of global oil production and 81.5 percent of the world's \"proven\" oil reserves, giving OPEC a major influence on global oil prices that were previously determined by the so-called \"Seven Sisters\" grouping of multinational oil companies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 256 }, { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 383 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 540, "end": 542 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 539 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Organisation of the Petroleum Exporting Countries (OPEC, ) is an international organization of 15 nations. In the 1960s and 1970s, multi-governmental organizations of oil\u2013producing nations OPEC and OAPEC played a major role in setting petroleum prices and policy. The members are Algeria, Angola, Ecuador, Equatorial Guinea, Gabon, Iran, Iraq, Kuwait, Libya, Nigeria, Qatar, the Republic of the Congo, Saudi Arabia (the de facto leader), United Arab Emirates, and Venezuela. Saudi Arabia has more capacity than others." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays the queen in star wars the phantom menace?", "passages": [ [ "The Saga Begins", "The Saga Begins\n\n\"The Saga Begins\" is a parody song by \"Weird Al\" Yankovic of \"American Pie\" by Don McLean, with lyrics that humorously summarize the plot of the film \"\" through the point of view of Obi-Wan Kenobi, one of the protagonists of the film, as well as Anakin's master.", "The song's title, not mentioned anywhere in the lyrics, derives from a tagline that appeared in teaser trailers and the film poster for \"The Phantom Menace\": \"Every \"saga\" has a \"beginning\"\".", "\"The Saga Begins\" was released as a single from the 1999 album \"Running with Scissors\", and later appearing on the compilation album titled \"The Saga Begins\".", "Set to the tune of \"American Pie\", \"The Saga Begins\" recounts the plot of \"\", from Obi-Wan Kenobi's point of view.", "Yankovic gathered most of the information he needed to write the song from Internet spoilers.", "Although Lucasfilm declined a request for an advance screening, Yankovic eventually attended a costly pre-screening for charity.", "He had done such an accurate job with the story line that after the pre-screening, he ended up making only very minor alterations." ], [ "Star Wars: Episode I \u2013 The Phantom Menace", "Star Wars: Episode I \u2013 The Phantom Menace\n\nStar Wars:", "Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox.", "It is the first installment in the \"Star Wars\" prequel trilogy and stars Liam Neeson, Ewan McGregor, Natalie Portman, Jake Lloyd, Ian McDiarmid, Anthony Daniels, Kenny Baker, Pernilla August, and Frank Oz.", "The film is set 32 years before the original film, and follows Jedi Knight Qui-Gon Jinn and his apprentice Obi-Wan Kenobi as they protect Queen Amidala in hopes of securing a peaceful end to a large-scale interplanetary trade dispute.", "Joined by Anakin Skywalker\u2014a young slave with unusually strong natural powers of the Force\u2014they simultaneously contend with the mysterious return of the Sith.", "Lucas began production of this film after he determined that film special effects had advanced to the level he wanted for the fourth film in the saga.", "Filming started on June 26, 1997, at locations including Leavesden Film Studios and the Tunisian desert.", "Its visual effects included extensive use of computer-generated imagery (CGI); many of its characters and settings were completely computerized." ], [ "Natalie Portman", "Natalie Portman\n\nNatalie Portman (born Neta-Lee Hershlag; June 9, 1981) is a film actress, producer, and director with dual Israeli and American citizenship.", "She is the recipient of various accolades, including an Academy Award and two Golden Globe Awards.", "Portman made her feature film debut as Mathilda, the young prot\u00e9g\u00e9e of a hitman, in \"\" (1994).", "While still in high school, she gained international recognition for starring as Padm\u00e9 Amidala in \"\" and received critical acclaim for playing a precocious teenager in the drama \"Anywhere but Here\" (both 1999).", "From 1999 to 2003, Portman attended Harvard University for a bachelor's degree in psychology.", "She continued acting while at university, starring in The Public Theater's 2001 revival of Anton Chekhov's play \"The Seagull\" and the sequel \"\" (2002).", "In 2004, Portman was nominated for an Academy Award for Best Supporting Actress and won a Golden Globe Award for playing a mysterious stripper in \"Closer\".", "The \"Star Wars\" prequel trilogy concluded with \"\" (2005), following which Portman portrayed a wide variety of roles." ] ], "gold": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space-opera film written and directed by George Lucas. It stars Israeli-born American actress Natalie Portman, born Natalie Hershlag, who portrays Queen Amidala. English actress, Keira Knightley, portrays Sabe, Queen Amidala's handmaiden, who plays the decoy queen throughout The Phantom Menace. The movie was a box office success and broke numerous box office records during its debut.", "prediction 1": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. The film stars Natalie Portman as queen Amidala, played by Natalie Portman in the 1999 film and in a parody song by Weird Al\" Yankovic of \"American Pie\" by Don McLean, with lyrics that humorously summarize the plot of the film through the point of view of Obi-Wan Kenobi, one of the protagonist of the film, as well as Anakin's master.", "prediction 2": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. The film stars Liam Neeson as King Amidala and Natalie Portman as Queen Amidala. Natalie Portman plays Queen Amidala in the film, as does Rian Johnson.", "prediction 3": "In the 1999 American epic space opera Star Wars: Episode I \u2013 The Phantom Menace, Queen Amidala is played by Natalie Portman, and the Queen of Naboo is played by Ewan McGregor.", "prediction 4": "Star Wars: Episode I - The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. It follows Jedi Knight Qui-Gon Jinn and his apprentice Obi-Wan Kenobi as they protect Queen Amidala in hopes of securing a peaceful end to a large-scale interplanetary trade dispute. Natalie Portman plays the queen in the film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 174 }, { "error type": "Unverifiable", "explanation": "", "start": 175, "end": 223 }, { "error type": "Redundant", "explanation": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century Fox. The film stars Natalie Portman as queen Amidala, ", "start": 224, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 267, "end": 510 } ], "missing-info": [], "corrected-prediction": "Star Wars: Episode I \u2013 The Phantom Menace is a 1999 American epic space opera written and directed by George Lucas. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who sings baby i'm a want you?", "passages": [ [ "Baby I'm-a Want You (song)", "Baby I'm-a Want", "You (song)\n\n\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread.", "The single was released in October 1971 (see 1971 in music).", "It became the title track for the album of the same name, released in January 1972.", "It was one of Bread's highest-charting singles in both the U.S. and U.K. In the U.S., it reached #3 on the \"Billboard\" Hot 100 chart in December 1971, the third of Bread's four top-five hits (\"Make It with You\", #1 in 1970; \"If\", #4 earlier in 1971; and \"Everything I Own\", from the same album, #5 in 1972).", "\"Baby I'm-a Want You\" reached the top of the easy listening chart and rose to #14 on the UK Singles Chart in February 1972.", "It was certified as a gold record by the RIAA.", "As with virtually all of the band's well-known recordings, the song was both written and produced by the band's lead vocalist, David Gates." ] ], "gold": "\"Baby I'm-a Want You\" is a popular song by the American soft rock band Bread. The song was both written and produced by David Gates, who is also the lead vocalist on the song. The single was released in October 1971 and became the title track for the album of the same name, released in January 1972. It was one of the band's highest charting singles in both the U.S. and U.K., as it reached number 3 on the Billboard Hot 100 chart.", "prediction 1": "\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread. The single was released in October 1971 (see 1971 in music). It became the title track for the album of the same name, released in January 1972.", "prediction 2": "\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread. The single was released in October 1971. It became the title track for the album of the same name, released in January 1972. The song was both written and produced by the band's lead vocalist, David Gates.", "prediction 3": "\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread. It was the title track for the album of the same name, released in January 1972. The song was both written and produced by the band's lead vocalist, David Gates.", "prediction 4": "\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread. The single was released in October 1971. It became the title track for the album of the same name, released in January 1972.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Baby I'm-a Want You\" is a popular song by the American pop-rock band Bread. The song was both written and produced by David Gates, who is also the lead vocalist on the song. The single was released in October 1971 (see 1971 in music). It became the title track for the album of the same name, released in January 1972. It was one of the band's highest charting singles in both the U.S. and U.K., as it reached number 3 on the Billboard Hot 100 chart." }, "preference": [ 2, 1, 0, 1, 1, 0 ] }, { "question": "Where was friday night lights filmed tv show?", "passages": [ [ "Friday Night Lights (TV series)", "Camera operators were trained to follow the actors, rather than having the actors stand in one place with cameras fixed around them.", "The actors knew that the filming would work around them.", "Executive producer Jeffrey Reiner described this method as \"no rehearsal, no blocking, just three cameras and we shoot.\"", "Working in this fashion profoundly influenced everyone involved with the show.", "Series star Kyle Chandler said: \"When I look back at my life, I'm going to say, '", "Wow, [executive producer]", "Peter Berg really changed my life.'", "\" Executive producer and head writer Jason Katims echoed this sentiment, saying: \"When I first came on [the \"FNL\"] set, I thought, it\u2019s interesting \u2013 this is what I imagined filmmaking would be, before I saw what filmmaking was.\"", "All five seasons of \"Friday Night Lights\" were filmed in Austin and Pflugerville.", "With the show yielding roughly $33 million a year in revenue, other states courted the production company after the state of Texas failed to pay all the rebates it had promised to the show's producers.", "The Texas legislature authorized funding to match the offers of other states, and the production company preferred to stay near Austin, so the show remained in Texas.", "\"Friday Night Lights\" is unusual for using actual locations rather than stage sets and sound stage." ], [ "Friday Night Lights (TV series)", "An episode from Julie's senior year in high school was filmed in the Boston area, at Boston College, Boston University, and Tufts University.", "Some scenes at fictional Oklahoma Tech University were filmed at Gregory Gym at The University of Texas at Austin.", "Initially targeted at the youth market, the show emphasized the football element.", "NBC teamed with social networking site Bebo to create a site that allowed students to upload video and photos, as well as create blogs about their local football teams.", "Students who participated were eligible for one of 10 $5,000 scholarships.", "NBC had negotiated with Bebo for network and series promotion on Bebo\u2019s network of youth-oriented sites including Piczo, Hi5, Tickle, Ringo, and FastWeb.", "To complement this promotion, NBC sent out \u201cSchool Spirit\u201d kits to 1,000 high schools around the country.", "These kits included posters, pom-poms, mini-footballs and disposable cameras, all bearing the show\u2019s logo.", "The kits also contained copies of the show\u2019s pilot episode on DVD.", "The network repeated this promotion for its second season promotion, when it teamed with HouseParty.com to send out 1,000 \"Party Kits,\" which contained advance copies of the Season 2 opener along with other promotional material." ], [ "Friday Night Lights (TV series)", "Though \"Friday Night Lights\" never garnered a sizable audience, it was a critical success, lauded for its realistic portrayal of Middle America and deep exploration of its central characters.", "The show appeared on a number of best lists and was awarded a Peabody Award, a Humanitas Prize, a Television Critics Association Award and several technical Primetime Emmy Awards.", "At the 2011 Primetime Emmy Awards, the show was nominated for Outstanding Drama Series.", "Kyle Chandler and Connie Britton also scored multiple nominations for the Outstanding Lead Actor and Actress awards for a drama series.", "Executive producer Jason Katims was nominated for Outstanding Writing for a Drama Series.", "Chandler and Katims each won the Emmy in 2011.", "\"Friday Night Lights\" was inspired by H.G. \"Buzz\" Bissinger's non-fiction book \"\" (1990) and the 2004 film based on it.", "The book, which explores the 1988 season of the Permian Panthers, a high school football team in Odessa, Texas, was a factual work of documentary journalism.", "The people featured were not renamed in the book.", "The Universal Pictures film, which stars Billy Bob Thornton and was directed by Peter Berg, Bissinger's second cousin, based its characters on the residents of Odessa c. 1988.", "Once filming on the movie was completed, Berg began to explore adapting the story for television." ] ], "gold": "Friday Night Lights is an American sports drama television series developed by Peter Berg, that was inspired by the 1990 nonfiction book by H. G. Bissinger. Filming for the show's pilot began in February 2006 in Texas, in Austin and Pflugerville High School's stadium was used for football scenes. Some scenes were filmed outside Texas, such as the scenes that were used to portray the fictional Braemore College, which were filmed at Temple University on June 20, 2010. An episode from Julie's senior year in high school was filmed in the Boston area, at Boston College, Boston University, and Tufts University and some scenes at fictional Oklahoma Tech University were filmed at Gregory Gym at The University of Texas at Austin.", "prediction 1": "The television show Friday Night Lights is filmed in the United States. Filming took place in Austin, Texas, at the University of Texas at Austin and at Boston College, Boston University, and Tufts University. Filming at Oklahoma Tech University was filmed at Gregory Gym at The University of Texas at Austin, Texas.", "prediction 2": "Friday Night Lights is a television show based on the 1990 book \"Buzz\" Bissinger's non-fiction book about the Permian Panthers, a high school football team in Odessa, Texas, and the 2004 film based on it, which was filmed in Odessa. Filming locations for the show included Austin, Boston, Boston University, Tufts University, and Gregory Gym at The University of Texas at Austin.", "prediction 3": "Friday Night Lights is an American television show and was directed by Peter Berg, who also directed the film version of the same name. The show was filmed in Austin, Texas. The five seasons were filmed in Austin and Pflugerville, Texas.", "prediction 4": "The first five seasons of Friday Night Lights were filmed in Austin and Pflugerville, Texas. The show's executive producer described this method as \"no rehearsal, no blocking, just three cameras and we shoot.\" Some scenes at fictional Oklahoma Tech University were filmed at Gregory Gym at The University of Texas at Austin.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6, 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The television show, inspired by the 1990 nonfiction book by H. G. Bissinger and produced by Peter Berg, Friday Night Lights, is filmed in the United States. All five seasons of \"Friday Night Lights\" were filmed in Austin, Texas and Pflugerville. An episode from Julie's senior year in high school was filmed in the Boston area, at Boston College, Boston University, and Tufts University. Filming at fictional Oklahoma Tech University was filmed at Gregory Gym at The University of Texas at Austin, Texas." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When was south africa banned from international cricket?", "passages": [ [ "South African rebel tours", "South African rebel tours\n\nThe South African rebel tours were a series of seven cricket tours staged between 1982 and 1990.", "They were known as the rebel tours because the international cricketing bodies banned South Africa throughout this period because of apartheid.", "As such the tours were organised and conducted in spite of the express disapproval of national cricket boards and governments, the International Cricket Conference and international organisations such as the United Nations.", "The tours were the subject of enormous contemporaneous controversy and remain a sensitive topic throughout the cricket-playing world.", "Until the D'Oliveira affair in 1968 and Olympic exclusion in 1964, only white athletes had been allowed to represent South Africa in international sport.", "This position reflected the apartheid society in South Africa (1948 onwards) and racist social conventions pre-dating apartheid.", "In 1971 an international sports boycott was instituted against South Africa to voice global disapproval of their racist selection policies and apartheid in general.", "South Africa became world sport's pariah, excluded from the Olympics, the FIFA World Cup, Test cricket and a host of minority sports.", "The boycott effected measurable change on policy and opinion in sports selection \u2013 and cricket in particular.", "In 1976 the South African Cricket Union (SACU) was created to administer the game in the republic on a multi-racial, meritocratic basis: so-called \"normal\" cricket." ], [ "South Africa national cricket team", "World class cricketers of their day like Clive Rice, Vintcent van der Bijl also never played Test Cricket despite their first class records.", "The ICC reinstated South Africa as a Test nation in 1991, and the team played its first sanctioned international match since 1970 (and its first ever One-Day International) against India in Calcutta on 10 November 1991.", "South Africa's first Test match after re-admission was played against the West Indies in April 1992.", "The match was played in Bridgetown, Barbados and South Africa lost by 52 runs.", "Since South Africa have been reinstated they have achieved mixed success, and hosted the International Cricket Council Cricket World Cup in 2003.", "However, it is widely believed the sides containing the likes of Allan Donald, Shaun Pollock, Gary Kirsten, Jacques Kallis and Hansie Cronje grossly underachieved, gaining a reputation as \"chokers\", due to them reaching the semi-finals of the Cricket World Cup four times, but failing to progress into the finals.", "In the second part of the 1990s, South Africa had the highest winning percentage in ODIs of any team, but they were knocked out of the 1996 World Cup in the quarter-finals, and then were eliminated on countback after tying their semi-final against Australia in 1999." ], [ "Sport in South Africa", "Sport in South Africa\n\nSouth Africans have a passionate following, although they remain divided along ethnic lines.", "Football, cricket and rugby are the most popular sports.", "Rugby union has traditionally been the most popular sport in South Africa amongst white South Africans.", "The national rugby team is nicknamed \"The Springboks\".", "South Africa hosted the 1995 Rugby World Cup, the first one hosted in Africa.", "Cricket is traditionally the popular sport among the white British diaspora and Indian South African communities, although it is now followed by members of all races.", "The national cricket team is nicknamed \"The Proteas\".", "Football has historically been particularly popular amongst persons of African descent and is South Africa's most popular sport.", "The South Africa national football team, \"Bafana Bafana\", has not enjoyed considerable success since the early 20th Century.", "South Africa is one among the only four countries which have played world cups of all three major games - Cricket, football, and rugby.", "England, New Zealand, and Australia are the other three such nations.", "\"England\" plays all three games in the elite level, but along with \"Australia\" and \"New Zealand\", \"South Africa\" is dominant power in \"cricket\" and \"rugby union\" only.", "Other popular sports include: boxing, hockey, tennis, golf, surfing, netball, running and also obstacle course racing." ] ], "gold": "International cricket was banned in South Africa beginning in 1970 due to increased decolonization and the anti-apartheid movement which called for boycotts of South Africa, including sports. The ban ended in 1991 as South Africa negotiated a political way towards majority rule. Cricket is one of the most popular sports in South Africa.", "prediction 1": "The ICC banned South Africa from international cricket in 1971, during which time the country was banned from seven cricket tours, which included an inter-governmental tour of India in 1984. The ICC reinstated the South African team as a Test nation in 1991, and South Africa played its first sanctioned international match since 1970 against India in Calcutta on 10 November 1991. The country was reinstated in 2003 and hosted the International Cricket Council Cricket World Cup.", "prediction 2": "The ICC banned South Africa from international cricket in 1971, and the ASA from international cricket in 1972, and in 1983, and in 1995, and in 1999, respectively. After being banned from international cricket in 1971, the ASA was created to administer the game in the republic on a multi-racial, meritocratic basis and the ASA from 1991 to 2003, and the ICC reinstated South Africa as a Test nation in 2002.", "prediction 3": "The ban on South Africa from playing international cricket first began on 1 March 1972 and continued to the end of the ban on 31 December 1972. The ban was lifted on 10 November 1991. The ban on South Africa from playing international cricket was lifted on 10 November 1991.", "prediction 4": "The ICC banned South Africa from international cricket in 1971 and again in 1991 for a period of 12 years. Since being reinstated, South Africa have achieved mixed success playing Test cricket internationally. However, the team had a rough time playing Test cricket internationally from 1980 to 1990. In 1982, South Africa had staged seven cricket tours. These tours were known as the rebel tours because the international cricketing bodies banned South Africa throughout this period because of apartheid.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 480 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The ICC banned South Africa from international cricket in 1971, when an international sports boycott was instituted against South Africa to voice global disapproval of their racist selection policies and apartheid in general. The ICC reinstated the South African team as a Test nation in 1991. Cricket is one of the most popular sports in South Africa. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When was the first land before time movie made?", "passages": [ [ "The Land Before Time", "This is the only Don Bluth film of the 1980s in which Dom DeLuise did not participate (instead, he starred in Disney's \"Oliver & Company\" that same year), and the only film in \"The Land Before Time\" series that is not a musical, as well as the only one to be released theatrically worldwide.", "Released by Universal Pictures on November 18, 1988, the film spawned a franchise with thirteen direct-to-video sequels and a television series as well as merchandise.", "During the age of the dinosaurs, a massive famine forces several herds of dinosaurs to seek an oasis known as the Great Valley.", "Among these, a mother in a diminished \"Longneck\" herd gives birth to a single baby, named Littlefoot.", "Years later, Littlefoot plays with Cera, a \"Three-horn\", until her father intervenes, whereupon Littlefoot's mother describes the different kinds of dinosaurs: \"Three-horns\", \"Spiketails\", \"Swimmers\", and \"Flyers\".", "That night, as Littlefoot follows a \"Hopper\", he encounters Cera again, and they play together briefly until a large \"Sharptooth\" attacks them.", "Littlefoot's mother comes to their rescue, but receives fatal injuries in the process.", "An earthquake swallows up the Sharptooth and divides Littlefoot and Cera from their herds." ], [ "The Land Before Time (franchise)", "The Land Before Time (franchise)\n\n", "The Land Before Time, is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs.", "The series began in 1988 with the eponymous \"The Land Before Time\", directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg.", "It was followed by a total of thirteen direct-to-video musical sequels, TV series, video games, soundtracks and related merchandising.", "Neither the sequels nor the series involve the participation of Bluth, Lucas, or Spielberg.", "All 14 films were released in a Complete Collection DVD set on June 14, 2016.", "The films follow a friendship of a group of young dinosaurs by the names of Littlefoot (Apatosaurus), Cera (Triceratops), Petrie (Pteranodon), Ducky (Saurolophus), and Spike (Stegosaurus).", "After finding The Great Valley, they raise a carnivorous baby who they name Chomper, survive a drought, a cold snap, encounter aliens, and witness a solar eclipse.", "Throughout all films, they embark upon adventures, learning lessons about life and friendship along the way.", "The following is a list of the fourteen films in \"The Land Before Time\" series.", "A television series based on the films began airing on YTV in Canada on January 5, 2007." ] ], "gold": "The Land Before Time is an American children's franchise of animated adventure films by Universal Pictures centered on dinosaurs. The series began on November 18, 1988 with the eponymous The Land Before Time, which released on December 1, 1988 in the UK. It was followed by 13 direct-to-video musical sequels, a TV series, video games, soundtracks, and related merchandising.", "prediction 1": "The Land Before Time is a franchise of American animated adventure films by Universal Pictures centered on dinosaurs. The series began in 1988 with the eponymous The Land Before Time, directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg. Released by Universal Pictures on November 18, 1988, the film spawned a franchise with thirteen direct-to-video musical sequels, TV series, video games, soundtracks and related merchandising.", "prediction 2": "The Land Before Time is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs. The series began in 1988 with the eponymous \"The Land Before Time\", directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg. It was followed by a total of thirteen direct-to-video musical sequels, TV series, video games, soundtracks, and related merchandise. The Complete Collection DVD set of The Land Before Time was released on June 14, 2016.", "prediction 3": "The Land Before Time is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs. The series began in 1988 with the eponymous \"The Land Before Time\", directed and produced by Don Bluth and executive produced by George Lucas and Steven Spielberg. The films follow a friendship of a group of young dinosaurs by the names of Littlefoot (Apatosaurus), Cera (Triceratops), Pee Wee (Pteranodon), Ducky (Saurolophus), Spike (Stegosaurus), and Spike (Stegosaurus).", "prediction 4": "The Land Before Time, is an American franchise of animated adventure films by Universal Pictures centered on dinosaurs which began in 1988 with the eponymous \"The Land Before Time\", directed and produced by Don Bluth, George Lucas, and Steven Spielberg, and released theatrically on November 18, 1988. The franchise has grown to include 13 sequels, including 13 direct-to-video musical sequels, a TV series, video games, soundtracks, and related merchandise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 279 } ], "missing-info": [], "corrected-prediction": "The Land Before Time is a franchise of American animated adventure films by Universal Pictures centered on dinosaurs. The series began in 1988 with the eponymous The Land Before Time. Released by Universal Pictures on November 18, 1988, the film spawned a franchise with thirteen direct-to-video musical sequels, TV series, video games, soundtracks and related merchandising." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who won the war between ethiopia and italy?", "passages": [ [ "First Italo-Ethiopian War", "First Italo-Ethiopian War\n\nThe First Italo-Ethiopian War was fought between Italy and Ethiopia from 1895 to 1896.", "It originated from a disputed treaty which, the Italians claimed, turned the country into an Italian protectorate.", "Italy was supported by the two other triple alliance members Germany and Austria-Hungary.", "Much to their surprise, they found that Ethiopian ruler Menelik II, rather than being opposed by some of his traditional enemies, was supported by them, so the Italian army, invading Ethiopia from Italian Eritrea in 1893, faced a more united front than they expected.", "In addition, Ethiopia was supported by Russia, an Orthodox Christian nation like Ethiopia with military advisers, army training, and the sale of weapons for Ethiopian forces during the war.", "Ethiopia was also supported diplomatically by the French in order to prevent Italy from becoming a colonial competitor.", "Full-scale war broke out in 1895, with Italian troops having initial success until Ethiopian troops counterattacked Italian positions and besieged the Italian fort of Meqele, forcing its surrender.", "Italian defeat came about after the Battle of Adwa, where the Ethiopian army dealt the heavily outnumbered Italians a decisive blow and forced their retreat back into Eritrea." ], [ "Second Italo-Ethiopian War", "Second Italo-Ethiopian War\n\nThe Second Italo-Ethiopian War, also referred to as the Second Italo-Abyssinian War, was a colonial war fought from 3 October 1935 until 19 February 1937, although Addis Ababa was captured on 5 May 1936.", "The war was fought between the armed forces of the Kingdom of Italy and those of the Ethiopian Empire (also known as Abyssinia).", "Ethiopia was defeated, annexed and subjected to military occupation.", "The Ethiopian Empire became a part of the Italian colony of Italian East Africa.", "Fighting continued until the Italian defeat in East Africa in 1941, during the East African Campaign of the Second World War.", "Italy and Ethiopia were members of the League of Nations yet the League was unable to control Italy or to protect Ethiopia when Italy violated Article X of the Covenant of the League of Nations.", "The Abyssinia Crisis of 1935 is often seen as a clear demonstration of the ineffectiveness of the League.", "The Italian victory coincided with the zenith of the popularity of dictator Benito Mussolini and the Fascist regime at home and abroad.", "Ethiopia was consolidated with Eritrea and Italian Somaliland into \"Africa Orientale Italiana\" (Italian East Africa).", "Ever since the 1880s, Italy had been committed to an imperialist policy in the Horn of Africa with Italy taking Eritrea in 1885, and subsequently parts of Somalia." ], [ "Second Italo-Ethiopian War", "From 27 to 29 February, the armies of \"Ras\" Kassa and \"Ras\" Seyoum were destroyed at the Second Battle of Tembien.", "Ethiopians again argued that poison gas played a role in the destruction of the withdrawing armies.", "In early March, the army of \"Ras\" Imru was attacked, bombed and defeated in what was known as the Battle of Shire.", "In the battles of Amba Aradam, Tembien and Shire, the Italians suffered about 2,600 casualties and the Ethiopians about 15,000; Italian casualties at the Battle of Shire being 969 men.", "The Italian victories stripped the Ethiopian defences on the northern front, Tigr\u00e9 province had fallen most of the Ethiopian survivors returned home or took refuge in the countryside and only the army guarding Addis Ababa stood between the Italians and the rest of the country.", "On 31 March 1936 at the Battle of Maychew, the Italians defeated an Ethiopian counter-offensive by the main Ethiopian army commanded by Selassie.", "The Ethiopians launched near non-stop attacks on the Italian and Eritrean defenders but could not overcome the well-prepared Italian defences.", "When the exhausted Ethiopians withdrew, the Italians counter-attacked.", "The \"Regia Aeronautica\" attacked the survivors at Lake Ashangi with mustard gas." ] ], "gold": "The first war between Italy and Ethiopia took place from 1895 to 1896. This war was won by the Ethiopian army after the Battle of Adwa. The second war between the two nations was fought from October 1935 to February 1937 and was won by the Italians in the Battle of Maychew. ", "prediction 1": "The First Italo-Ethiopian War was fought between Italy and Ethiopia from 1895 to 1896. It originated from a disputed treaty which, the Italians claimed, turned the country into an Italian protectorate. Much to their surprise, they found that Ethiopian ruler Menelik II, rather than being opposed by some of his traditional enemies, was supported by them. The Second Italo-Ethiopian War, also referred to as the Second Italo-Abyssinian War, was a colonial war fought from 3 October 1935 until 19 February 1937, although Addis Ababa was captured on 5 May 1936.\n", "prediction 2": "The First Italo-Ethiopian War fought between Italy and Ethiopia from 1895 to 1896. It originated from a disputed treaty which, the Italians claimed, turned the country into an Italian protectorate. The Second Italo-Ethiopian War was a colonial war fought from 3 October 1935 to 19 February 1937, although Addis Ababa was captured on 5 May 1936. Fighting continued until the Italian defeat in East Africa in 1941, during the East African Campaign of the Second World War.", "prediction 3": "The First Italo-Ethiopian War was fought between Italy and Ethiopia from 1895 to 1896. Originating from a disputed treaty, the Italians claimed, turned the country into an Italian protectorate. Much to their surprise, they found that Ethiopian ruler Menelik II, rather than being opposed by some of his traditional enemies, was supported by them, so the Italian army, invading Ethiopia from Italian Eritrea in 1893, faced a more united front than they expected. The Second Italo-Ethiopian War is a colonial war fought between March 1936 and February 1937.", "prediction 4": "The First Italo-Ethiopian war was fought between Italy and Ethiopia from 1895 to 1896. It originated from a disputed treaty which, the Italians claimed, turned the country into an Italian protectorate. The Second Italo-Ethiopian war, also referred to as the Second Italo-Abyssinian War, was a colonial war fought from 3 October 1935 to 19 February 1937, although Addis Ababa was captured on 5 May 1936.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 439 }, { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 458 }, { "error type": "Irrelevant", "explanation": "", "start": 510, "end": 559 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The First Italo-Ethiopian War was fought between Italy and Ethiopia from 1895 to 1896. This war was won by the Ethiopian army after the Battle of Adwa. The Second Italo-Ethiopian War was fought from October 1935 until February 1937 and was won by the Italians in the Battle of Maychew." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "When did the united states became a state?", "passages": [ [ "Articles of Confederation", "Articles of Confederation\n\nThe Articles of Confederation, formally the Articles of Confederation and Perpetual Union, was an agreement among the 13 original states of the United States of America that served as its first constitution.", "It was approved, after much debate (between July 1776 and November 1777), by the Second Continental Congress on November 15, 1777, and sent to the states for ratification.", "The Articles of Confederation came into force on March 1, 1781, after being ratified by all 13 states.", "A guiding principle of the Articles was to preserve the independence and sovereignty of the states.", "The central government established by the Articles received only those powers which the former colonies had recognized as belonging to king and parliament.", "The Articles formed a war-time confederation of states, with an extremely limited central government.", "While unratified, the document was used by the Congress to conduct business, direct the American Revolutionary War, conduct diplomacy with foreign nations, and deal with territorial issues and Native American relations.", "The adoption of the Articles made few perceptible changes in the federal government, because it did little more than legalize what the Continental Congress had been doing.", "That body was renamed the Congress of the Confederation; but Americans continued to call it the \"Continental Congress\", since its organization remained the same." ], [ "Lee Resolution", "In the Second Continental Congress, the movement towards independence was guided principally by an informal alliance of delegates eventually known as the \"Adams-Lee Junto\", after Samuel Adams and John Adams of Massachusetts and Richard Henry Lee of Virginia.", "On May 15, 1776, the revolutionary Virginia Convention, then meeting in Williamsburg, passed a resolution instructing Virginia's delegates in the Continental Congress \"to propose to that respectable body to declare the United Colonies free and independent States, absolved from all allegiance to, or dependence upon, the Crown or Parliament of Great Britain\".", "In accordance with those instructions, on June 7, Richard Henry Lee proposed the resolution to Congress and it was seconded by John Adams.", "Resolved, That these United Colonies are, and of right ought to be, free and independent States, that they are absolved from all allegiance to the British Crown, and that all political connection between them and the State of Great Britain is, and ought to be, totally dissolved.", "That it is expedient forthwith to take the most effectual measures for forming foreign Alliances.", "That a plan of confederation be prepared and transmitted to the respective Colonies for their consideration and approbation." ], [ "History of the United States", "As a strategist, however, he had a better idea of how to win the war than they did.", "The British sent four invasion armies.", "Washington's strategy forced the first army out of Boston in 1776, and was responsible for the surrender of the second and third armies at Saratoga (1777) and Yorktown (1781).", "He limited the British control to New York City and a few places while keeping Patriot control of the great majority of the population.", "The Loyalists, whom the British counted upon too heavily, comprised about 20% of the population but never were well organized.", "As the war ended, Washington watched proudly as the final British army quietly sailed out of New York City in November 1783, taking the Loyalist leadership with them.", "Washington astonished the world when, instead of seizing power for himself, he retired quietly to his farm in Virginia.", "Political scientist Seymour Martin Lipset observes, \"The United States was the first major colony successfully to revolt against colonial rule.", "In this sense, it was the first 'new nation'.\"", "On July 2, 1776, the Second Continental Congress, meeting in Philadelphia, declared the independence of the colonies by adopting the resolution from Richard Henry Lee, that stated:\n
\nOn July 4, 1776 they adopted the Declaration of Independence and this date is celebrated as the nation's birthday." ] ], "gold": "The Second Continental Congress, meeting in Philadelphia, declared the independence of the colonies by adopting the resolution from Richard Henry Lee. On July 4, 1776, they adopted the Declaration of Independence. The Articles of Confederation and Perpetual Union was an agreement among the 13 original states of the United States of America that served as its first constitution. It was ratified on March 1, 1781. the United States Constitution took effect on March 4, 1789.", "prediction 1": "The Articles of Confederation were an agreement among the 13 original states of the United States of America that served as its first constitution. The Articles were approved, after much debate, by the Second Continental Congress on November 15, 1777 and sent to the states for ratification. They came into force on March 1, 1781, after being ratified by all 13 states.", "prediction 2": "The United States became a state on March 1, 1781, after being ratified by all 13 states. The Articles of Confederation, formally the Articles of Confederation and Perpetual Union, was an agreement among the 13 original states of the United States of America that served as its first constitution. It was approved, after much debate, by the Second Continental Congress on November 15, 1777, and sent to the states for ratification.", "prediction 3": "The United States became a state on March 1, 1781, after being ratified by all 13 states and approved by the Second Continental Congress on November 15, 1777.", "prediction 4": "The Articles of Confederation were an agreement among the 13 original states of the United States of America that served as its first constitution. The Articles were approved, after much debate, by the Second Continental Congress on November 15, 1777, and sent to the states for ratification by all 13 states. The Articles came into force on March 1, 1781, after being ratified by all 13 states.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 291 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Second Continental Congress, meeting in Philadelphia, declared the independence of the colonies by adopting the resolution from Richard Henry Lee. On July 4, 1776 they adopted the Declaration of Independence. The Articles of Confederation and Perpetual Union were an agreement among the 13 original states of the United States of America that served as its first constitution. They came into force on March 1, 1781, after being ratified by all 13 states." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who sang you beat me to the punch?", "passages": [ [ "You Beat Me to the Punch", "You Beat Me to the Punch\n\n\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962.", "It was co-written by Smokey Robinson of the Miracles, who was responsible for the majority of hits released by Wells while she was a Motown artist, and another Miracles member, Ronnie White.", "Following the success of the previous single, \"The One Who Really Loves You\", Motown released this record shortly after it was produced and the song performed similar work as \"The One Who Really Loves You\" did, becoming a \"Billboard\" Top 10 Pop smash, peaking at number nine on the pop chart and becoming her first number-one hit on the Billboard R&B singles chart.", "It also won Wells a Grammy nomination for Best Rhythm and Blues Recording.", "Like \"The One Who Really Loves You\" before it, the song was produced with a mock-calypso beat.", "It inspired an \"answer\" song by soul singer Gene Chandler called \"You Threw A Lucky Punch\" which used the same music and different lyrics and became a Pop and R&B chart hit that year.", "In DTV, \"You Threw A Lucky Punch\" was set to Toby Tortoise Returns.", "This song was used in the movie Boulevard Nights." ] ], "gold": "You Beat Me to the Punch is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. Tony Jackson with the Vibrations sang the song in 1964, The Temptations sang the song in 1965, and Barbara McNair sang the song in 2003.", "prediction 1": "\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. It was co-written by Smokey Robinson of the Miracles, who was responsible for the majority of hits released by Wells while she was a Motown artist, and another Miracles member, Ronnie White.", "prediction 2": "\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. It was co-written by Smokey Robinson of the Miracles, who was responsible for the majority of hits released by Wells while she was a Motown artist, and another Miracles member, Ronnie White. Following the success of the previous single, \"The One Who Really Loves You\", Motown released this record shortly after it was produced and the song performed similar work as \"The One Who Really Loves You\" did, becoming a \"Billboard\" Top 10 Pop smash, peaking at number nine on the pop chart and becoming her first number-one hit on the Billboard R&B singles chart. It also won Wells a Grammy nomination for Best Rhythm and Blues Recording.", "prediction 3": "\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. It was co-written by Smokey Robinson of the Miracles, responsible for the majority of hits released by Wells while she was a Motown artist, and another Miracles member, Ronnie White. This song inspired an \"answer song\" by soul singer Gene Chandler called \"You Threw A Lucky Punch\", which used the same music and different lyrics and became a Pop and R&B chart hit that year.", "prediction 4": "\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. It was co-written by Smokey Robinson of the Miracles, who was responsible for the majority of hits released by Wells while she was a Motown artist, and another Miracles member, Ronnie White. This song inspired an \"answer\" song by soul singer Gene Chandler called \"You Threw A Lucky Punch\" which used the same music and different lyrics and became a Pop and R&B chart hit that year. It also won Wells a Grammy nomination for Best Rhythm and Blues Recording.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 301 } ], "missing-info": [], "corrected-prediction": "\"You Beat Me to the Punch\" is a soul single by Motown singer Mary Wells, released on the Motown label in 1962. " }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who is dina from real housewives new jersey?", "passages": [ [ "Dina Manzo", "Manzo has one daughter, Lexi Ioannou, born January 25, 1996.", "In October 2012, Manzo separated from her then husband Tommy Manzo.", "In February 2016, their divorce was finalized.", "Manzo is close friends with former co-star Teresa Giudice.", "Manzo is the godmother of Giudice's daughter, Audriana.", "In 2015, Manzo moved from Franklin Lakes, New Jersey to Malibu, California.", "In May 2017, Manzo and her boyfriend Dave Cantin were the victims of a robbery at her home." ], [ "Dina Manzo", "Dina Manzo\n\nDina Manzo is an American television personality and entrepreneur.", "She is most known for appearing on \"The Real Housewives of New Jersey\" and her own party-planning television series \"Dina's Party\".", "Born in Brooklyn, New York City, New York, the youngest of 11 children, Manzo at age 6 moved with her family to Wayne, New Jersey.", "In 2007, Manzo and her then husband appeared in an episode of VH1's \"My Fabulous Wedding\".", "In 2009, Manzo appeared in the first two seasons of \"The Real Housewives of New Jersey\", a reality series focusing on a group of women living in New Jersey, before departing.", "In 2014, Manzo returned for the sixth season.", "In 2015, Manzo departed the series due to relocating to California.", "In 2011, Manzo hosted the party-planning series \"Dina's Party\" on HGTV.", "It was later cancelled after two seasons.", "Manzo runs Project Ladybug, a nonprofit foundation that focuses on helping children diagnosed with cancer and their families pay for medical bills and other expenses.", "In 2016, Manzo released a skincare product line titled Glow by Dina.", "Manzo has appeared on The Real Housewives of New Jersey alongside her sibling Caroline Manzo, brother Chris Laurita, and sister-in-law Jacqueline Laurita." ] ], "gold": "Dina Manzo is a cast member of the Real Housewives of New Jersey. She married Dave Cantin in June 2017", "prediction 1": "Dina Manzo is an American television personality and entrepreneur. She is most known for appearing on The Real Housewives of New Jersey and her own party-planning television series, Dina's Party. Born in Brooklyn, New York City, New York, the youngest of 11 children, Manzo at age 6 moved with her family to Wayne, New Jersey.", "prediction 2": "Dina Manzo is an American television personality and entrepreneur. She is most known for appearing on The Real Housewives of New Jersey, as well as her own party-planning television series, Dina's Party.", "prediction 3": "Dina Manzo is an American television personality and entrepreneur. Dina Manzo is most known for appearing on The Real Housewives of New Jersey and her own party-planning television series Dina's Party. In 2011, Manzo hosted the party-planning series Dina's Party on HGTV. It was later cancelled after two seasons.", "prediction 4": "Dina Manzo is an American television personality and entrepreneur. She is most known for appearing on The Real Housewives of New Jersey and her own party-planning television series, Dina's Party. Born in Brooklyn, New York City, New York, the youngest of 11 children, Manzo at age 6 moved with her family to Wayne, New Jersey. In 2011, Manzo hosted the party-planning series, Dina's Party, on HGTV. It was later cancelled after two seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 326 } ], "missing-info": [], "corrected-prediction": "Dina Manzo is an American television personality and entrepreneur. She is most known for appearing on The Real Housewives of New Jersey and her own party-planning television series, Dina's Party. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who is our present election commissioner of india?", "passages": [ [ "Election Commissioner of India", "Election Commissioner of India\n\nElection Commissioners of India are members of Election Commission of India, a body constitutionally empowered to conduct free and fair elections to the national and state legislatures.", "The Election Commissioners are usually retired Indian Administrative Service (IAS) officers.", "Until 1989, the commission was a single member body, but later two additional Election Commissioners were added.", "Thus, the Election Commission currently consists of a Chief Election Commissioner and two Election Commissioners.", "The decisions of the commission are taken by a majority vote.", "Sunil Arorais the current Chief Election Commissioner and the other two are Ashok Lavasa\n\nOriginally in 1950, the commission had only a Chief Election Commissioner.", "Two additional Commissioners were appointed to the commission for the first time on 16 October 1989 but they had a very short tenure, ending on 1 January 1990.", "\"The Election Commissioner Amendment Act, 1989\" made the Commission a multi-member body.", "The concept of a 3-member Commission has been in operation since then, with the decisions being made by a majority vote.the official website was introduced on 28 February 1998\n\nThe Chief Election Commissioner cannot be removed from his post easily on account of any political reasons.", "This is necessary so as to preserve the independence of election commission." ], [ "Department of Infrastructure and Industrial Development", "The current chairperson of Udyog Bandhu is Anup Chandra Pandey, who also serves as the chief secretary of Uttar Pradesh and the Infrastructure and Industrial Development Commissioner of Uttar Pradesh, whereas, its current executive director of Udyog Bandhu is Santosh Kumar Yadav.", "On the divisional level, Udyog Bandhu meetings are chaired by the divisional commissioner of that division, whilst on the district level, Udyog Bandhu meetings are chaired by the district magistrate and collector of that district.", "There are six sections in IIDD, namely Section-1, Section-2, Section-3, Section-4, Section-5, and Section-6, each dealing with matters allotted to it.", "Satish Mahana, serves as the departmental minister, and Suresh Rana serves as the Minister of State for Infrastructure and Industrial Development.", "The administration of department is normally headed by the principal secretary responsible for it, who is an IAS officer.", "The principal secretary is assisted by two secretaries, four special secretaries and three joint, deputy or under secretaries.", "The current principal secretary is Rajesh Kumar Singh.", "Presently, the chief secretary of Uttar Pradesh serves as the administrative head of the Department Infrastructure and Industrial Development as the Infrastructure and Industrial Development Commissioner.", "The current chief secretary is Anup Chandra Pandey." ], [ "Georgia\u2013India relations", "Secretary in the Ministry of Overseas Indian Affairs Parvez Dewan represented India at the first \"Day of Diaspora\" celebrations in Tbilisi in May 2012.", "Deputy Foreign Minister David Jalagania led a Georgian delegation to attend the first Inter-Governmental Commission (IGC) in Delhi April 2014.", "India's Central Election Commissioner Nasim Zaidi participated in the International Conference of Election Commissioners in Batumi in February 2015.", "An Indian Foreign Ministry delegation attended the AIIB Founding Member countries Expert Meeting in Tbilisi in July 2015.", "Chairperson of the Election Commission of Georgia Tamar Zhvania visited New Delhi on 13 July 2015.", "During the visit, the two countries signed an MoU for cooperation in election management and administration.", "Indian Election Commissioner O.P. Rawat and two other Election Commission officials visited Kakheti province, Georgia to participate in a multilateral event on electoral practices on February 2016.", "Deputy Economy Minister Ketevan Bochorishvili visited India in April 2016.", "He promoted a \"Film in Georgia\" project to Indian directors, producers and film studios.", "A delegation from India International Institute of Democracy and Election Management (IIIDEM) visited Tbilisi to conduct training for officials of the Election Commission of Georgia in June 2016." ] ], "gold": "The Election Commission of India is currently a three-member body with one Chief Election Commissioner and two Election Commissioners. Syed Nasim Ahmad Zaidi was a member of the Election Commission from 2015 to 2017. The members of the election commission in 2021 are Sushil Chandra, Rajiv Kumar, and Anup Chandra Pandey.", "prediction 1": "The election commissioners of India are members of the Election Commission of India, a body constitutionally empowered to conduct free and fair elections to the national and state legislatures. Sunil Arorais the current Chief Election Commissioner and the other two are Ashok Lavasa Originally in 1950, the commission had only a Chief Election Commissioner. Two additional Commissioners were appointed to the commission for the first time on 16 October 1989 but they had a very short tenure, ending on 1 January 1990. Thus, the current Election Commission consists of a Chief Election Commissioner and the other two are Ashok Lavasa and Santosh Kumar Yadav.", "prediction 2": "The Indian Election Commission is a body constitutionally empowered to conduct free and fair elections to the national and state legislatures. Until 1989, the commission was a single member body, but later two additional Election Commissioners were added. Thus, the Election Commission currently consists of a Chief Election Commissioner and two Election Commissioners. Sunil Arorais the current Chief Election Commissioner and the other two are Ashok Lavasa. The current chairperson of Udyog Bandhu is Anup Chandra Pandey, who also serves as the chief secretary of Uttar Pradesh and the Infrastructure and Industrial Development Commissioner of Uttar Pradesh. The current executive director of Udyog Bandhu is Santosh Kumar Yadav.", "prediction 3": "The Election Commissioners of India are members of the Election Commission of India, a body constitutionally empowered to conduct free and fair elections to the national and state legislatures. Originally in 1950, the commission had only a Chief Election Commissioner. Then, two additional commissioners were appointed to the commission for the first time on 16 October 1989 but they had a very short tenure, ending on 1 January 1990. Sunil Arora is the present Chief Election Commissioner and the other two are Ashok Lavasa.", "prediction 4": "The Election Commission of India, a body constitutionally empowered to conduct free and fair elections to the national and state legislatures, consists of the Chief Election Commissioner, Sunil Arora, and the two additional Election Commissioners, Ashok Lavasa and Santosh Kumar Yadav. The incumbents are: Sunil Arora, who is the current Chief Election Commissioner of India, and Sunil Dev. Originally in 1950, the commission had only a Chief Election Commissioner. Two additional Commissioners were appointed to the commission for the first time on 16 October 1989, but they had a very short tenure, ending on 1 January 1990.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The election commissioners of India are ", "start": 40, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 517 }, { "error type": "Unverifiable", "explanation": "", "start": 633, "end": 657 }, { "error type": "Redundant", "explanation": " Sunil Arorais the current Chief Election Commissioner and the other two are Ashok Lavasa ", "start": 518, "end": 632 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Election Commission currently consists of a Chief Election Commissioner and two Election Commissioners. Sunil Arorais is the current Chief Election Commissioner and the other two are Ashok Lavasa and one other." }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "Where is the isle of man tt held?", "passages": [ [ "Isle of Man TT", "It is still billed in popular culture as the most dangerous motorsport event in the world, with the \"New York Times\" stating the number of deaths \"to 146 since it was first run in 1907; if one includes fatal accidents occurring during the Manx Grand Prix, the amateur races held later in the summer on the same Snaefell Mountain Course, the figure rises above 250.\"", "fatalities in its history.", "An on-site account of the 2003 race by \"Sports Illustrated\" writer Franz Lidz called the spectacle \"38 Miles of Terror... a test of nerves and speed that may be sport's most dangerous event.\"", "In 1976, the Isle of Man TT lost its world championship status; this was transferred to the United Kingdom by the FIM and run as the British Grand Motor-Cycle Grand Prix for the 1977 season.", "The Isle of Man TT Races then became an integral part of the new style TT Formula 1, Formula 2 and Formula 3 World Championships between 1977 and 1990 to develop and maintain the international racing status of the Isle of Man TT races.", "The event was redeveloped by the Isle of Man Department of Tourism as the \"Isle of Man TT Festival\" from 1989 onwards." ], [ "Isle of Man TT", "Isle of Man TT\n\nThe International Isle of Man TT (Tourist Trophy) races are an annual motorcycle sport event run on the Isle of Man in May/June of most years since its inaugural race in 1907, and is often called one of the most dangerous racing events in the world.", "The Isle of Man TT is run in a time-trial format on public roads closed to the public by an Act of Tynwald (the parliament of the Isle of Man).", "The event consists of one week of practice sessions followed by one week of racing.", "It has been a tradition, perhaps started by racing competitors in the early 1920s, for spectators to tour the Snaefell Mountain Course on motorcycles during the Isle of Man TT on \"\"Mad Sunday\"\", an informal and unofficial sanctioned event held on the Sunday between 'Practice Week' and 'Race Week'.", "The first Isle of Man TT race was held on Tuesday 28 May 1907 and was called the International Auto-Cycle Tourist Trophy.", "The event was organised by the Auto-Cycle Club over 10 laps of the Isle of Man St John's Short Course of 15\u00a0miles 1,470\u00a0yards for road-legal 'touring' motorcycles with exhaust silencers, saddles, pedals and mudguards." ], [ "Isle of Man TT", "From 1911 the Isle of Man TT transferred to the much longer Snaefell Mountain Course of 37.40 miles (current length 37.73 miles).", "The race programme developed from a single race with two classes for the 1907 Isle of Man TT, expanding in 1911 to two individual races for the 350cc Junior TT motor-cycles and the Blue Riband event the 500cc Senior TT race.", "The race did not take place from 1915 to 1919 due to the First World War.", "It resumed in 1920.", "A 250cc Lightweight TT race was added to the Isle of Man TT programme in 1922 followed by a Sidecar TT race in 1923.", "There was no racing on the Isle of Man between 1940 and 1945 due to the Second World War.", "It recommenced with the Manx Grand Prix in 1946 and the Isle of Man TT in 1947, with a greatly expanded format that included the new Clubman's TT races.", "The Isle of Man TT became part of the FIM Motor-cycle Grand Prix World Championship (now MotoGP) as the British round of the World Motor-Cycling Championship during the period 1949\u20131976.", "Following safety concerns with the Snaefell Mountain Course and problems over inadequate 'start-money' for competitors, there was a boycott of the Isle of Man TT races from the early 1970s by many of the leading competitors, motorcycle manufacturers and national motorcycle sporting federations." ] ], "gold": "The Isle of Man TT or Tourist Trophy is a motorcycle race held on the public roads of the Isle of Man. The inaugural race was held in 1907. It was organized by the Auto-Cycle Club over 10 laps of the Isle of Man St John's Short Course. From 1911 the Isle of Man TT transferred to the much longer Snaefell Mountain Course of 37.40 miles l.", "prediction 1": "The Isle of Man TT is an annual motorcycle sport event run on the Isle of Man in May/June of most years since its inaugural race in 1907. It is often called one of the most dangerous racing events in the world. The TT is run in a time-trial format on public roads closed to the public by an Act of Tynwald (the parliament of the Isle of Man).", "prediction 2": "The Isle of Man TT is an annual motorcycle sport event run on the Isle of Man in May/June of most years since its inaugural race in 1907. The Isle of Man TT is run in a time-trial format on public roads closed to the public by an Act of Tynwald (the parliament of the Isle of Man).", "prediction 3": "The International Isle of Man TT (Tourist Trophy) races are an annual motorcycle sport event, run on the Isle of Man in May/June of most years since its inaugural race in 1907. It is often called one of the most dangerous racing events in the world. The first Isle of Man TT race was held on Tuesday 28 May 1907 and was called the International Auto-Cycle Tourist Trophy. The race programme developed from a single race with two classes for the 1907 Isle of Man TT, expanding in 1911 to two individual races for the 350cccccc Junior TT motor-cycles and the Blue Riband event the 500ccccccc Senior TT race in 1923. There was no racing on the Isle of Man TT races between 1940 and 1945 due to the Second World War.", "prediction 4": "The Isle of Man TT is an annual motorcycle sport event run on the Isle of Man in May/June of most years since its inaugural race in 1907. The first Isle of Man TT race was held on Tuesday 28 May 1907 and was called the International Auto-Cycle Tourist Trophy. From 1911 the Isle of Man TT transferred to the much longer Snaefell Mountain Course of 37.40 miles. The original course was on the Isle of Man St John's Short Course of 15 miles 1,470 yards for road-legal 'touring's with exhaust silencers, pedals, pedals and mudguards. From 1919 the Isle of Man TT race was moved to the much longer Snaefell Mountain Course of 37.40 miles (current length 37.73 miles).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 342 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Isle of Man TT is an annual motorcycle sport event run on the Isle of Man in May/June of most years since its inaugural race in 1907. The event was organised by the Auto-Cycle Club over 10 laps of the Isle of Man St John's Short Course. From 1911 the Isle of Man TT transferred to the much longer Snaefell Mountain Course of 37.40 miles. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many series of homeland have been made?", "passages": [ [ "Homeland (TV series)", "Homeland (TV series)\n\nHomeland is an American spy thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series \"Prisoners of War\" (Original title , literally \"Abductees\"), which was created by Gideon Raff.", "The series stars Claire Danes as Carrie Mathison, a Central Intelligence Agency officer with bipolar disorder, and Damian Lewis as Nicholas Brody, a U.S. Marine Corps Scout Sniper.", "Mathison had come to believe that Brody, who was held captive by al-Qaeda as a prisoner of war, was \"turned\" by the enemy and poses a threat to the United States.", "The series focuses on a storyline that evolves from this premise, together with Mathison's ongoing covert work.", "The series is broadcast in the U.S. on the cable channel Showtime, and is produced by Fox 21 Television Studios (formerly Fox 21).", "It premiered on October 2, 2011.", "The first episode was made available online, more than two weeks before the television broadcast, with viewers having to complete game tasks to gain access.", "The series finished airing its seventh season on April 29, 2018, and has been renewed for an eighth and final season, which will premiere in June 2019.", "The series has received generally positive reviews, with its first two seasons gaining near universal praise." ], [ "Rodina (TV series)", "Rodina (TV series)\n\nRodina (; Homeland) is a Russian political thriller television series developed by Pavel Lungin and Timur Weinstein based on the Israeli series \"Hatufim\", which was created by Gideon Raff, and it is a second adaptation after the American adaptation \"Homeland\" by Howard Gordon and Alex Gansa.", "The series stars Viktoriya Isakova as Anna Zimina, a Federal Security Service (FSB) officer and Vladimir Mashkov as Alexey Bragin, a Russian Marine Corps sniper.", "Anna had come to believe that Alexey, who was held captive by Chechen terrorists as a prisoner of war, was \"turned\" by the enemy and threatened the Russian Federation.", "The series was broadcast in the Russian Federation on channel Russia-1, and produced by WeiT Media.", "The first episode aired on March 16, 2015 and the last on March 26, 2015.", "The series was a ratings hit, with the premiere the network's highest-rated show in two years.", "The series begins in 1993.", "Marine Colonel Alexey Bragin and sniper Yuri Khamzin go missing during a military operation in the North Caucasus.", "Six years later, a joint force of the FSB's Alpha Group and Spetsnaz GRU raids a terrorist camp in the North Caucasus." ], [ "Homeland (season 6)", "Homeland (season 6)\n\nThe sixth season of the American television drama series \"Homeland\" premiered on January 15, 2017, and concluded on April 9, 2017, on Showtime, consisting of 12 episodes.", "The series started as a loosely based variation of the two-season run of the Israeli television series \"Hatufim\" (English: \"Prisoners of War\") created by Gideon Raff and is developed for American television by Howard Gordon and Alex Gansa.", "The sixth season was released on Blu-ray and DVD on February 6, 2018.", "Taking place several months after the previous season, Carrie Mathison is back in the United States, living in Brooklyn, New York with her young pre-school aged daughter.", "She is now working at a foundation whose efforts are to provide aid to Muslims living in the United States.", "Peter Quinn is alive but has suffered a major stroke and is incapacitated but seemingly, turned to a junkie.", "Saul Berenson and Dar Adal are still CIA operatives and are dealing with counter-terrorism within the United States.", "The season features the results of a presidential election of a female candidate, and takes place between election day and inauguration day.", "The season also has a storyline regarding the Joint Comprehensive Plan of Action." ] ], "gold": "Homeland is an American espionage thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series Prisoners of War. The series ran for 8 seasons. Rodina is a Russian political thriller television series based on the Israeli series Hatufim. Rodina is a second adaptation of Hatufim, after the American version Homeland. This series had 1 season.", "prediction 1": "Homeland is an American spy thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series Prisoners of War, which was created by Gideon Raff. The series stars Claire Danes as Carrie Mathison, a Central Intelligence Agency officer with bipolar disorder, and Damian Lewis as Nicholas Brody, a U.S. Marine Corps Scout Sniper. The Russian political thriller television series, Rodina, is based on the Israeli series Hatufim, which was created by Gideon Raff. The series finished airing its seventh season on April 29, 2018, and has been renewed for an eighth and final series, which will premiere in June 2019.", "prediction 2": "Homeland is an American spy thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series \"Prisoners of War,\" which was created by Gideon Raff. The series stars Claire Danes as Carrie Mathison, a Central Intelligence Agency officer with bipolar disorder, and Damian Lewis as Nicholas Brody, a U.S. Marine Corps Scout Sniper. The Russian political thriller television series developed by Pavel Lungin and Timur Weinstein based on the Israeli series \"Hatufim\", which was created by Gideon Raff. The series finished airing its seventh season on April 9, 2017, and has been renewed for an eighth and the final season, which will premiere in June 2019.", "prediction 3": "There have been two different television series of the American spy thriller series Homeland. The first American television series was Homeland: The Beginning of the End, which aired from 1993-1995. The second American television series was Homeland: The Beginning of the End, which aired from 1995-1999. The third American television series was Homeland: The Fall, which aired from 1995-1999. The fourth American television series was Homeland: The Fall, which aired from 1999-2000. The fifth American television series was Homeland: The Rise of the Series, and finished airing its seventh season on April 29, 2018. The series finished airing its seventh season on April 9, 2017, and has been renewed for an eighth and final season, which will premiere in June 2019.", "prediction 4": "Homeland is an American spy thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series Prisoners of War, which was created by Gideon Raff. The series stars Claire Danes as Carrie Mathison, a Central Intelligence Agency officer with bipolar disorder, and Damian Lewis as Nicholas Brody, a U.S. Marine Corps Scout Sniper. The series finished airing its seventh season on April 29, 2018, and has been renewed for an eighth and final season, which will premiere in June 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 456, "end": 489 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 490, "end": 500 }, { "error type": "Irrelevant", "explanation": "", "start": 501, "end": 579 }, { "error type": "Irrelevant", "explanation": "", "start": 608, "end": 641 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Homeland is an American spy thriller television series developed by Howard Gordon and Alex Gansa based on the Israeli series Prisoners of War. The Russian political thriller television series, Rodina, is based on the Israeli series Hatufim, it is a second adaptation after the American adaptation \"Homeland\". Homeland had eight seasons." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the french stop using the guillotine?", "passages": [ [ "Guillotine", "On 6 August 1909, the guillotine was used on the junction of the Boulevard Arago and the Rue de la Sant\u00e9, behind the La Sant\u00e9 Prison.", "The last public guillotining in France was of Eugen Weidmann, who was convicted of six murders.", "He was beheaded on 17 June 1939 outside the prison Saint-Pierre, rue Georges Clemenceau 5 at Versailles, which is now the Palais de Justice.", "A number of problems with that execution (inappropriate behavior by spectators, incorrect assembly of the apparatus, and the fact that it was secretly filmed) caused the French government to order that future executions be conducted in private in the prison courtyard.", "The guillotine remained the official method of execution in France until the death penalty was abolished in 1981.", "The final three guillotinings in France before its abolition were those of child-murderers Christian Ranucci (on 28 July 1976) in Marseille, J\u00e9r\u00f4me Carrein (on 23 June 1977) in Douai and torturer-murderer Hamida Djandoubi (on 10 September 1977) in Marseille." ], [ "Eugen Weidmann", "Eugen Weidmann\n\nEugen Weidmann (February 5, 1908 \u2013 June 17, 1939) was a German criminal and serial murderer who was executed by guillotine in France in June 1939, the last public execution in that country.", "(Executions by guillotine continued in private until Hamida Djandoubi's execution on September 10, 1977).", "Weidmann was born in Frankfurt am Main in Germany to the family of an export businessman, and went to school there.", "He was sent to live with his grandparents at the outbreak of World War I; during this time he started stealing.", "Later in his twenties he served five years in Saarbr\u00fccken jail for robbery.", "During his time in jail Weidmann met two men who would later become his partners in crime: Roger Million and Jean Blanc.", "After their release from jail, they decided to work together to kidnap rich tourists visiting France and steal their money.", "They rented a villa in Saint-Cloud, near Paris, for this purpose.", "Their first kidnap attempt ended in failure because their victim struggled too hard, forcing them to let him go.", "In July 1937, they made a second attempt, Weidmann having made the acquaintance of Jean De Koven, a 22-year-old New York City dancer visiting her aunt Ida Sackheim in Paris." ] ], "gold": "The guillotine was the official method of execution in France until the abolition of the death penalty in 1981. It was last used for this purpose on September 10, 1977 in the execution of torturer-murderer Hamida Djandoubi.", "prediction 1": "The French stopped using the guillotine on 6 August 1909, when the guillotine was used on the junction of the Boulevard Arago and the Rue de la Sant\u00e9, behind the La Sant\u00e9 Prison. However, the last public guillotining in France was of Eugen Weidmann, who was convicted of six murders and executed by guillotine in June 1939. The guillotine remained the official method of execution in France until the death penalty was abolished in 1981.", "prediction 2": "The guillotine was used in France from 1870 to 1939. The last public guillotining in France was of Eugen Weidmann, who was convicted of six murders. He was beheaded on 17 June 1939 outside the prison Saint-Pierre, rue Georges Clemenceau 5 at Versailles, which is now the Palais de Justice. After problems with that execution, the French government ordered that future executions be conducted in private in the prison courtyard.", "prediction 3": "In the 19th century, the guillotine was used in a variety of public executions in France. In June 1939, Eugen Weidmann was the last public execution in France performed by guillotine. In 1889, the guillotine was used on the junction of the Boulevard Arago and the Rue de la Sant\u00e9, behind the La Sant\u00e9 Prison.", "prediction 4": "The guillotine was first used in France on 5 January 1882. The last public guillotining in France was of Eugen Weidmann, a German criminal and serial murderer who was executed by guillotine in France on 17 June 1939, the last public execution in the country. However, the guillotine remained the official method of execution in France until the death penalty was abolished in 1981. The last three guillotinings in France before its abolition were those of the death penalty in 1981.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 323 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": " The guillotine remained the official method of execution in France until the death penalty was abolished in 1981. It was last used for this purpose on September 10, 1977 in the execution of torturer-murderer Hamida Djandoubi." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "What are the different types of sae in ffa?", "passages": [ [ "National FFA Organization", "At the national level, there are 24 Career Development Events:\n\nExamples of CDEs that can be available at the state level are:\n\nTo be an active member in the National FFA Organization, a member must have an Supervised Agricultural Experience (SAE) project.", "The projects involve hands-on application of concepts and principles learned in the agricultural education classroom, with guidelines for the SAE projects governed by the state FFA delegation.", "SAE programs are grouped into four different areas:" ], [ "Supervised agricultural experience", "Supervised agricultural experience\n\nA supervised agricultural experience, or SAE, is required before obtaining a Chapter FFA Degree for the United States National FFA Organization.", "An SAE can be anything from raising livestock at a school farm to a research project for class According to the 13th addition of \"The Official FFA Student Handbook, \"there are eight types of SAE projects.", "They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory.", "SAE projects are often exhibited at county and state fairs, whether it is showing livestock or displaying a project.", "An SAE is one of the three components of Agricultural Education, the other two being FFA and classroom instruction.", "SAE is a high school agricultural education program approach to experiential learning.", "The FFA motto (\"Learning to do, Doing to learn, Earning to live, Living to serve\") was created to show what the FFA values.", "We learn in the classroom so we can do in the world.", "We do for the world what we learn in the classroom.", "We earn what need through the jobs we have and we live our lives to serve others.", "A significant level of debate centers on the meaning of the word \"agricultural\" in SAE.", "Meanings of the words \"supervised\" and \"experience\" are widely agreed upon." ] ], "gold": "Supervised agriculture experiences, sae for short, include Exploratory, which is about learning about the big picture of agriculture and related careers. Research/Experimentation and Analysis is about conducting research of information to discover new knowledge. Ownership/Entrepreneurship is about planning and operation of an agriculture related business, and Placement is about working for pay or either experience in an agricultural setting.", "prediction 1": "A supervised agricultural experience, or SAE, is required before obtaining a Chapter FFA Degree for the United States National FFA Organization. According to the 13th addition of The Official FFA Student Handbook, \"there are eight types of SAE projects. They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory.", "prediction 2": "There are eight types of SAE projects in the FFA. They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory.", "prediction 3": "The FFA requires members to participate in a supervised agricultural experience (SAE) before obtaining a Chapter FFA Degree for the United States National FFA Organization. There are eight different types of SAE projects. They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory.", "prediction 4": "The FFA has eight different types of Supervised Agricultural Experience projects, or SAE, which is required before obtaining a Chapter FFA Degree for the United States National FFA Organization. According to the 13th addition of \"The Official FFA Student Handbook\", there are eight types of SAE projects. They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 144 } ], "missing-info": [], "corrected-prediction": "According to the 13th addition of The Official FFA Student Handbook, \"there are eight types of Supervised agriculture experiences (SAE) projects. They include: entrepreneurship, placement, agriscience research, agricultural service learning, exploratory, improvement, supplemental and directed school laboratory." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "When do the strangers prey at night come out?", "passages": [ [ "The Strangers: Prey at Night", "In February 2017, it was announced that Johannes Roberts would be the sequel's new director, and that filming would commence during the summer of the same year.", "In May 2017, Christina Hendricks, Bailee Madison, and Lewis Pullman were reported as the film's stars, and production began in Los Angeles on May 30.", "In June 2017, it was announced Martin Henderson had also joined the cast, along with other cast members.", "Filming began in June 2017 in Covington, Kentucky and lower Cincinnati which concluded on July 10, 2017.", "Bailee Madison's boyfriend Alex Lange has visited the set of the movie while the events of filming.", "There was once an event called \"The Strangers: Prey at Night Experience\", in which people visited.", "Bailee Madison did almost all of her stunts and had some minor injuries including, a broken toe along with some bruises while filming.", "On set, the cast explained how horrifying the set was to film there at night, saying it was just as creepy as it was in the movie.", "On October 12, 2017, \"Collider\" reported the film would be released on March 9, 2018, by Aviron Pictures.", "A teaser trailer for the film was released on November 16, 2017.", "The official trailer debuted on January 5, 2018." ] ], "gold": "The strangers prey at night film came out on March 9, 2018 by Aviron Pictures. The teaser trailer for the film was released on November 16, 2017. The official trailer for the strangers prey at night debuted on January 5, 2018.", "prediction 1": "The Strangers: Prey at Night is a horror film sequel to the 2015 film of the same name. Production began in February 2017 and filming began in the summer of the same year. Filming began in June 2017 in Covington, Kentucky and lower Cincinnati which concluded on July 10, 2017. Filming began in November 2017 in Los Angeles and production began in Los Angeles on November 22, 2017.", "prediction 2": "The Strangers: Prey at Night comes out on February 10, 2018 and on January 5, 2018. The teaser trailer for the film was released on November 16, 2017. There was also a trailer for the movie released on January 5, 2018.", "prediction 3": "The Strangers: Prey at Night came out in the United States on March 9, 2018.", "prediction 4": "The Strangers: Prey at Night came out on March 9, 2018, by Aviron Pictures, with a teaser trailer for the film released on November 16, 2017. The official trailer debuted on January 5, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 87 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 88, "end": 121 }, { "error type": "Unverifiable", "explanation": "", "start": 126, "end": 171 }, { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 276 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 277, "end": 322 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 327, "end": 380 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The strangers prey at night film came out on March 9, 2018 by Aviron Pictures. The teaser trailer for the film was released on November 16, 2017. The official trailer for the strangers prey at night debuted on January 5, 2018." }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "Who plays cj on the bold and the beautiful?", "passages": [ [ "C. J. Garrison", "C. J. Garrison\n\nC. J. Garrison is a fictional character in the American soap opera \"The Bold and the Beautiful\", portrayed by Mick Cain from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017.", "Clarke Jr. was born to Sally Spectra (played by Darlene Conley) and Clarke Garrison (Daniel McVicar).", "Not long after C.J. 's birth, Clarke left town.", "C.J. grew into a disobedient child in his early teens, having a cynical view on the world and starting a food fight with Brooke Logan Forrester (Katherine Kelly Lang) and Eric Forrester's (John McCook) son, Rick, who was close to C.J. 's age.", "His father returned in 1996 and C.J. was initially resentful of Clarke until Clarke rescued him from kidnappers.", "A few years later in December 1997, C.J. and Rick (then played by Jacob Young) were closer to friends than enemies.", "They both pursued Rick's babysitter, seductress Amber Moore (Adrienne Frantz), which led to a drag race that nearly killed Rick.", "CJ spent most of 1998 and 1999 as Amber's shoulder to cry on as she became pregnant and married Rick." ] ], "gold": "The Bold and the Beautiful character, CJ, was played by several actors. Michelle Heap in 1991, Jacob and Tyler DeHaven from 1991-93, and Taylor Joseph Robinson from 1993-94 were the earliest actors to play the role of CJ Garrison. Christopher Graves and Kevin Graves played the character from 1994-95. From 1995-97, CJ was played by Kyle Sabihy. Mick Cain played the role from 1997-2004 and in 2007, 2010, and 2017.", "prediction 1": "C.J. Garrison is a fictional character in the American soap opera The Bold and the Beautiful. He was played by Mick Cain from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017.", "prediction 2": "C. J. Garrison is a fictional character in the American soap opera The Bold and the Beautiful. He was portrayed by Mick Cain from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017.", "prediction 3": "C. J. Garrison is a fictional character in the American soap opera The Bold and the Beautiful, played by Mick Cain from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017.", "prediction 4": "C.J. Garrison is a fictional character in the American soap opera The Bold and the Beautiful. Mick Cain played C.J. from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "C.J. Garrison is a fictional character in the American soap opera The Bold and the Beautiful. He was played by Mick Cain from December 1997 to January 2001, July 2002 to August 2003, returning briefly in 2004, 2007, 2010 and 2017." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What was the magnitude of the 1989 san francisco earthquake?", "passages": [ [ "Moment magnitude scale", "Moment magnitude scale\n\n", "The moment magnitude scale (MMS; denoted as M\" or M\") is one of many seismic magnitude scales used to measure the size of earthquakes.", "The scale was developed in the 1970s to succeed the 1930s-era Richter magnitude scale (\"M\").", "Even though the formulas are different, the new scale was designed to produce magnitude values for a given earthquake similar to those produced by the older one.", "Under suitable assumptions, as with the Richter magnitude scale, an increase of one step on this logarithmic scale corresponds to a 10 (about 32) times increase in the amount of energy released, and an increase of two steps corresponds to a 10 (1,000) times increase in energy.", "Thus, an earthquake of \"M\" of 7.0 releases about 32 times as much energy as one of 6.0 and nearly 1,000 times one of 5.0.", "The moment magnitude is based on the seismic moment of the earthquake, which is equal to the shear modulus of the rock near the fault multiplied by the average amount of slip on the fault and the size of the area that slipped.", "Since January 2002, the MMS has been the scale used by the United States Geological Survey to calculate and report magnitudes for all modern large earthquakes." ], [ "Seismic magnitude scales", "For shallow earthquakes the surface waves carry most of the energy of the earthquake, and are the most destructive.", "Deeper earthquakes, having less interaction with the surface, produce weaker surface waves.", "The surface-wave magnitude scale, variously denoted as Ms, M, and M, is based on a procedure developed by Beno Gutenberg in 1942 for measuring shallow earthquakes stronger or more distant than Richter's original scale could handle.", "Notably, it measured the amplitude of surface waves (which generally produce the largest amplitudes) for a period of \"about 20 seconds\".", "The scale approximately agrees with at ~6, then diverges by as much as half a magnitude.", "A revision by , sometimes labeled M, measures only waves of the first second.", "A modification \u2013 the \"Moscow-Prague formula\" \u2013 was proposed in 1962, and recommended by the IASPEI in 1967; this is the basis of the standardized M scale (Ms_20, M(20)).", "A \"broad-band\" variant (Ms_BB, M(BB)) measures the largest velocity amplitude in the Rayleigh-wave train for periods up to 60 seconds.", "The M scale used in China is a variant of M calibrated for use with the Chinese-made \"type 763\" long-period seismograph.", "The MLH scale used in some parts of Russia is actually a surface wave magnitude." ], [ "1989 Loma Prieta earthquake", "1989 Loma Prieta earthquake\n\nThe 1989 Loma Prieta earthquake occurred in Northern California on October 17 at local time (1989-10-18 00:04 UTC).", "The shock was centered in The Forest of Nisene Marks State Park approximately northeast of Santa Cruz on a section of the San Andreas Fault System and was named for the nearby Loma Prieta Peak in the Santa Cruz Mountains.", "With a moment magnitude of 6.9 and a maximum Mercalli intensity of IX (\"Violent\"), the shock was responsible for 63 deaths and 3,757 injuries.", "The Loma Prieta segment of the San Andreas Fault System had been relatively inactive since the 1906 San Francisco earthquake (to the degree that it was designated a seismic gap) until two moderate foreshocks occurred in June 1988 and again in August 1989.", "Damage was heavy in Santa Cruz County and less so to the south in Monterey County, but effects extended well to the north into the San Francisco Bay Area, both on the San Francisco Peninsula and across the bay in Oakland.", "No surface faulting occurred, though a large number of other ground failures and landslides were present, especially in the Summit area of the Santa Cruz Mountains." ], [ "Jim Berkland", "Berkland's predictions have been either self-published in his newsleter or website, or announced in various interviews or speaking engagements.", "His notoriety arose from an interview published in the Gilroy Dispatch on October 13, 1989, where he predicted that an earthquake with a magnitude between 3.5 and 6.0 would occur in the San Francisco Bay Area between October 14 and October 21.", "The 6.9-magnitude Loma Prieta earthquake occurred on October 17, just four days later.", "Berkland claims that government officials told him not to make any more predictions, fearing mass panic, and he was suspended for two months from his Santa Clara County geology position in late October, 1989.", "Interviewed on Fox News in March 2011, Berkland predicted a massive earthquake in California for sometime between March 19 and March 26, 2011.", "He cited as factors the highest tides in 18 years and the proximity of the Moon, suggesting that the quake will most likely strike on Saturday, March 19, 2011.", "No such quake occurred.", "He has also claimed to have predicted the 1980 M 7.2 Eureka earthquake just fourteen hours before it hit, but the tape-recording documenting this \"had somehow been lost in the mail\".", "Up to June 2010 Berkland made many predictions in his newsletter and on his website, for which he has claimed a \"75 percent accuracy rate\"." ] ], "gold": "There are several magnitude scales for measuring the size of an earthquake. The 1989 San Francisco earthquake's MW magnitude, or moment magnitude scale magnitude, was 6.9. The earthquake's MS magnitude, or surface-wave magnitude scale magnitude, was 7.2.", "prediction 1": "The 1989 San Francisco earthquake had a magnitude of 6.9 on the moment magnitude scale, which is one of many seismic magnitude scales used to measure the size of earthquakes. The magnitude of the 1989 San Francisco earthquake was 7.0, while the magnitude of the 1989 Loma Prieta earthquake was 6.9, and the magnitude of the 1989 San Francisco tsunami was 7.5.\n", "prediction 2": "The 1989 San Francisco earthquake had a magnitude of 6.9 on the moment magnitude scale. The magnitude previously reported for the event was 7.0, but a revised magnitude of 6.9 was reported for the 1989 Loma Prieta earthquake in Northern California on October 17, 1989.", "prediction 3": "The 1989 San Francisco earthquake had a magnitude of 6.9 according to the moment magnitude scale, which was developed in the 1970s to succeed the 1930s-era Richter magnitude scale. The magnitude of the 1989 Loma Prieta earthquake was 6.9 and had a maximum Mercalli intensity of IX.", "prediction 4": "The 1989 San Francisco earthquake struck in the state of California on October 17, 1989, with a magnitude of 6.9 on the moment magnitude scale.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 174 }, { "error type": "Unverifiable", "explanation": "", "start": 175, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 360 } ], "missing-info": [], "corrected-prediction": "The magnitude of the 1989 Loma Prieta Earthquake was 6.9 on the moment magnitude scale.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many episodes of house of cards this season?", "passages": [ [ "House of Cards (season 2)", "House of Cards (season 2)\n\nThe second season of the American television drama series \"House of Cards\" began filming a set of 13 episodes on April 29, 2013 and concluded on November 8.", "Filming occurred primarily in Baltimore.", "On December 4, 2013, Netflix announced that the season would be released in its entirety on February 14, 2014.", "Set in current day Washington, D.C., season two deals with topics such as entitlement reform, Chinese cyberespionage, anthrax scares, Senate parliamentary procedure, and government shutdowns.", "It begins at the exact time that season one ended.", "Critics previewed the first four episodes of the season under non-disclosure agreements that they not reveal any spoilers.", "Reviews began appearing as early as January 31.", "Many critics who previewed the season noted the first episode was shocking, but withheld the surprises of the four episodes made available for preview.", "Willa Paskin of \"Slate\" broke the embargo nearly a day early revealing several spoilers.", "Whereas critics had been somewhat split on the propriety of binge-watching the first season, they were more supportive of the practice for season two.", "Early reviews were largely positive, noting that the second season had a darker tone than the first.", "Molly Parker was praised as an addition to the cast." ] ], "gold": "73 episodes of House of Cards were released over six seasons. House of cards season 5, season 4, and season 3 contained 13 episodes each. The series aired between February 1, 2013, and November 2, 2018.", "prediction 1": "House of Cards is an American television drama series that was adapted from the popular 2008 film of the same name. The second season of the show was filmed in 13 episodes.", "prediction 2": "The second season of the American television drama series House of Cards began filming a set of 13 episodes on April 29, 2013 and concluded on November 8. Filming occurred primarily in Baltimore. Netflix announced that the season would be released in its entirety on February 14, 2014.", "prediction 3": "The second season of the American television drama series House of Cards began filming a set of 13 episodes on April 29, 2013 and concluded on November 8. Filming occurred primarily in Baltimore. Season two deals with topics such as entitlement reform, Chinese cyberespionage, anthrax scares, Senate parliamentary procedure, and government shutdowns. Season two premiered on the CBS Television Network on January 31, 2014, with 13 episodes total.", "prediction 4": "The second season of the American television drama series \"House of Cards\" began filming a set of 13 episodes on April 29, 2013 and concluded on November 8. Season two deals with topics such as entitlement reform, Chinese cyberespionage, anthrax scares, Senate parliamentary procedure, and government shutdowns.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 53 }, { "error type": "Unverifiable", "explanation": "", "start": 54, "end": 115 } ], "missing-info": [], "corrected-prediction": "The second season of House of Cards show was filmed in 13 episodes." }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "Who plays mr wickham in pride and prejudice?", "passages": [ [ "Edward Ashley-Cooper", "Edward Ashley-Cooper\n\nEdward Montague Hussey Cooper (August 12, 1906 \u2013 May 5, 2000) was an actor descended from an English family but born in Australia.", "Known by his professional name of Edward Ashley (to avoid confusion with a fellow actor Edward Cooper), Cooper performed in 60 films for Metro Goldwyn Mayer including \"Pride and Prejudice\" (1940) where he played George Wickham.", "Edward Montague Hussey Cooper was born on 12 August 1906 in Sydney, Australia, the son of Edward Montague Hussey Cooper and Violet Coghill Maddrell.", "His father, Edward (known as Montague) was a Master Mariner and a Lieutenant in the Royal Naval Reserve, who worked as a second officer for the P&O Steam Navigation Company in Australia.", "Despite his use of the surname Ashley-Cooper, there was no link to the Earl of Shaftesbury.", "Edward Ashley made a number of films in the United Kingdom before moving to California, United States, in 1940 where his first big role was George Wickham in \"Pride and Prejudice\".", "After this his career consisted of a large number of mainly supporting roles until 1988, including a recurring character in the \"Maverick\" television series called \"Nobby Ned Wingate\" in the late 1950s." ], [ "Pride and Prejudice (1995 TV series)", "Pride and Prejudice (1995 TV series)\n\nPride and Prejudice is a six-episode 1995 British television drama, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name.", "Jennifer Ehle and Colin Firth starred as Elizabeth Bennet and Mr. Darcy.", "Produced by Sue Birtwistle and directed by Simon Langton, the serial was a BBC production with additional funding from the American A&E Network.", "BBC1 originally broadcast the 55-minute episodes from 24 September to 29 October 1995.", "The A&E Network aired the series in double episodes on three consecutive nights beginning 14 January 1996.", "Critically acclaimed and a popular success, \"Pride and Prejudice\" was honoured with several awards, including a BAFTA Television Award for Jennifer Ehle for \"Best Actress\" and an Emmy for \"Outstanding Individual Achievement in Costume Design for a Miniseries or a Special\".", "The role of Mr Darcy elevated Colin Firth to stardom.", "A scene showing Firth in a wet shirt was recognised as \"one of the most unforgettable moments in British TV history\".", "\"The New York Times\" called the adaptation \"a witty mix of love stories and social conniving, cleverly wrapped in the ambitions and illusions of a provincial gentry\"." ], [ "George Wickham", "He is shown playing croquet with Elizabeth who speaks fondly of Jane, who has just received a letter from Caroline, expressing the hope that her brother will marry Miss Darcy.", "Wickham says that being loved by Elizabeth would be a privilege because of her loyalty towards those for whom she cares.", "A mutual attraction is more clearly seen in this adaptation than the 1995 adaptation.", "When Mrs. Gardiner warns against reckless commitments, as in the novel, her niece reassures her that she is not in love with Wickham, but adds, nonetheless, that the lack of money rarely prevents young people from falling in love.", "She calms her sisters, much more affected than herself by Wickham's courtship of Mary King, pointing out to them that young people must also have enough money to live on.", "Lydia, by contrast, seems to be already very interested in Wickham and tries to get his attention.", "The Pride and Prejudice of 1995 further highlights the two-faced nature of the character, played by Adrian Lukis, a tall dark haired actor who was by turns smiling, insolent, or menacing.", "He appears as a much darker character than in the previous version, which may explain why the attraction he exerts over Elizabeth is less emphasized than in the 1980 series." ] ], "gold": "There are multiple Pride and Prejudice films. The original Pride and Prejudice was made in 1940 and starred Edward Montague Hussey Cooper, known professionally as Edward Ashley, as Mr. Wickham. In the 2005 version of the film, Rupert Friend plays the character. There was also a six-episode 1995 British television drama series named Pride and Prejudice, where Adrian Lukis portrays Mr. Wickham.", "prediction 1": "In the 1940 film Pride and Prejudice, actor Edward Ashley played the character George Wickham. In the 1995 television series, actor Adrian Lukis played the role of Mr. Wickham. In the 1980 TV series, the character was played by David Hitchcock.", "prediction 2": "In the 1940 film Pride and Prejudice, actor Edward Ashley played the role of Mr. Wickham. The 1995 TV series Pride and Prejudice, adapted by Andrew Davies from Jane Austen's 1813 novel of the same name, starred Jennifer Ehle as Elizabeth Bennet and Colin Firth as Mr. Darcy. In the 1990 version, actor Adrian Lukis played Mr. Wickham.", "prediction 3": "In the 1940 film Pride and Prejudice, actor Edward Ashley plays the character of George Wickham. The 1995 television series Pride and Prejudice stars Colin Firth as Mr. Darcy, played by Jennifer Ehle. The 1990 series features actor Adrian Lukis as Mr. Wickham.", "prediction 4": "Pride and Prejudice is a British television drama which was adapted by Andrew Davies from Jane Austen's 1813 novel of the same name. The 1975 adaptation was filmed in London and is based on the 1813 novel. The 1995 adaptation was filmed in Los Angeles and features Colin Firth as Mr. Wickham. The 2000 film adaptation features Robert Evans as Mr. Wickham.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 199 }, { "error type": "Unverifiable", "explanation": "", "start": 228, "end": 244 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "There were a couple of actors. In the 1940 film Pride and Prejudice, actor Edward Montague Hussey Cooper, professionally known as Edward Ashley, played the character George Wickham. In the 1995 television series, actor Adrian Lukis played the role of Mr. Wickham. " }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "When was we can work it out written?", "passages": [ [ "We Can Work It Out", "We Can Work It Out\n\n\"We Can Work It Out\" is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon.", "It was first issued as a double A-side single with \"Day Tripper\" in December 1965.", "The release marked the first time in Britain that both tracks on an artist's single were promoted as joint A-sides.", "The song was recorded during the sessions for the band's \"Rubber Soul\" album.", "The single was number 1 in Britain (where it won the Ivor Novello Award for the top-selling A-side of 1965), America, Australia, Canada and Ireland.", "\"We Can Work It Out\" is a comparatively rare example of a Lennon\u2013McCartney collaboration from this period in the Beatles' career, in that it recalls the level of collaboration the two songwriters had shared when writing the group's hit singles of 1963.", "This song, \"A Day in the Life\", \"Baby, You're a Rich Man\" and \"I've Got a Feeling\", are among the notable exceptions.", "McCartney wrote the words and music to the verses and the chorus, with lyrics that \"might have been personal\", probably a reference to his relationship with Jane Asher." ], [ "We Can Work It Out (Andreas Johnson song)", "We Can Work It Out (Andreas Johnson song)\n\n", "We Can Work It Out, is a Swedish English language hit sung by the Swedish singer Andreas Johnson and was recorded in 2010.", "Lyrics are by Andreas Johnson himself and music was written by Bobby Ljunggren and Marcos Ubeda.", "Andreas Johnson participated in the Swedish Melodifestivalen 2010 with \"We Can Work It Out\" and finished second in the second semi-final in G\u00f6ransson Arena, Sandviken on 13 February 2010.", "The song qualified for the final in Stockholm." ], [ "Sweetbox", "Sweetbox\n\nSweetbox is a Los Angeles based pop music project formed in Germany in 1995 by executive producer Heiko Schmidt and music producer Roberto \"Geo\" Rosan.", "Throughout the years Sweetbox has had several lead singers including Kimberly Kearney, Dacia Bridges, Tina Harris, Jade Villalon, Jamie Pineda and most recently and currently, Miho Fukuhara and LogiQ Pryce.", "Although the project released four singles in the mid 1990s, with initial singers Kimberley Kearney and Dacia Bridges, worldwide success came with third vocalist, Tina Harris.", "Everything's Gonna Be Alright was released in 1997, which topped charts around the world and started a musical theme, sampling classical music, which the project would later become known for.", "Tina Harris left after two years, with Jade Villalon replacing her as the fourth vocalist with five original albums, all reaching Gold or Platinum in Korea.", "Villalon, along with \"Geo\" left the project after seven years to go on and do other projects.", "Vocalist Jamie Pineda took the role as new vocalist shortly after in late 2007 and then releasing her first studio album The Next Generation in 2009, which was produced by Derek Bramble.", "Pineda released one more album, Diamond Veil in 2011 and it was released in Japan and Korea, as the 8th studio album from Sweetbox." ] ], "gold": "\"We Can Work It Out\" is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon in 1965. There is also a song with the same title that is an English-language hit sung by the Swedish singer Andreas Johnson and was written in 2010. Sweetbox, a German based pop music project formed in 1995, also wrote a song titled \"We Can Work It Out\" in 2009.", "prediction 1": "We Can Work It Out is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon. It was first issued as a double A-side single with \"Day Tripper\" in December 1965. We Can Work It Out, is a Swedish English language hit sung by the Swedish singer Andreas Johnson and was recorded in 2010. Lyrics are by Andreas Johnson himself and music was written by Bobby Ljunggren and Marcos Ubeda.", "prediction 2": "We Can Work It Out is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon. It was first issued as a double A-side single with \"Day Tripper\" in December 1965. \"We Can Work It Out\" is also a Swedish English language hit sung by the Swedish singer Andreas Johnson and was recorded in 2010. Lyrics are by Andreas Johnson himself and music was written by Bobby Ljunggren and Marcos Ubeda.", "prediction 3": "\"We Can Work It Out\" is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon. It was first issued as a double A-side single with \"Day Tripper\" in December 1965. \"We Can Work It Out\", is also a Swedish English language hit sung by the Swedish singer Andreas Johnson, that was recorded in 2010.", "prediction 4": "\"We Can Work It Out\" is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon. It was first issued as a double A-side single with \"Day Tripper\" in December 1965. \"We Can Work It Out,\" is also a Swedish English language hit sung by the Swedish singer Andreas Johnson and was recorded in 2010. Lyrics are by Andreas Johnson himself and music was written by Bobby Ljunggren and Marcos Ubeda.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 316, "end": 412 } ], "missing-info": [], "corrected-prediction": "We Can Work It Out is a song by the English rock band the Beatles, written by Paul McCartney and John Lennon. It was first issued as a double A-side single with \"Day Tripper\" in December 1965. We Can Work It Out, is a Swedish English language hit sung by the Swedish singer Andreas Johnson and was recorded in 2010. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "How many seats in the house and senate?", "passages": [ [ "United States Congress", "United States Congress\n\nThe United States Congress is the bicameral legislature of the Federal government of the United States.", "The legislature consists of two chambers: the House of Representatives and the Senate.", "The Congress meets in the United States Capitol in Washington, D.C..", "Both senators and representatives are chosen through direct election, though vacancies in the Senate may be filled by a gubernatorial appointment.", "Congress has 535 voting members: 435 representatives and 100 senators.", "The House of Representatives has six non-voting members representing Puerto Rico, American Samoa, Guam, the Northern Mariana Islands, the U.S. Virgin Islands, and the District of Columbia in addition to its 435 voting members.", "Although they cannot vote in the full house, these members can sit and vote in congressional committees and introduce legislation.", "The members of the House of Representatives serve two-year terms representing the people of a single constituency, known as a \"district\".", "Congressional districts are apportioned to states by population using the United States Census results, provided that each state has at least one congressional representative.", "Each state, regardless of population or size, has two senators.", "Currently, there are 100 senators representing the 50 states.", "Each senator is elected at-large in their state for a six-year term, with terms staggered, so every two years approximately one-third of the Senate is up for election." ] ], "gold": "The United States Congress is the bicameral legislature of the federal government of the United States, and consists of two chambers: the House of Representatives and the Senate. Congress has 535 voting members: 435 representatives and 100 senators. In addition, there are currently six non-voting members of the House of Representatives, bringing the total membership to 441.", "prediction 1": "The United States Congress is a bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. The number of seats in the house is based on the number of registered voters in each state. The number of seats in the Senate is based on the number of registered voters in each state.", "prediction 2": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. There are currently 115 members of both chambers. Each state has two senators.", "prediction 3": "The United States Congress is the bicameral legislature of the Federal government of the United States. The legislature consists of two chambers, the House of Representatives and the Senate. The number of seats in each chamber is determined by the number of members in each district. The number of seats in each district is determined by the number of citizens in each congressional district.", "prediction 4": "The United States Congress, or Congress, consists of two chambers: the House of Representatives and the Senate. There are currently 265 seats in the House and 145 seats in the Senate.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 189, "end": 280 }, { "error type": "Redundant", "explanation": "The number of seats in the house is based on the number of registered voters in each state. ", "start": 281, "end": 373 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The United States Congress is a bicameral legislature of the Federal government of the United States. The legislature consists of two chambers: the House of Representatives and the Senate. Congress has 535 voting members: 435 representatives and 100 senators. The House of Representatives has six non-voting members in addition to its 435 voting members." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Where was the old man and the sea published?", "passages": [ [ "The Old Man and the Sea", "The Old Man and the Sea\n\nThe Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba, and published in 1952.", "It was the last major work of fiction by Hemingway that was published during his lifetime.", "One of his most famous works, it tells the story of Santiago, an aging Cuban fisherman who struggles with a giant marlin far out in the Gulf Stream off the coast of Cuba.", "In 1953, \"The Old Man and the Sea\" was awarded the Pulitzer Prize for Fiction, and it was cited by the Nobel Committee as contributing to their awarding of the Nobel Prize in Literature to Hemingway in 1954.", "\"The Old Man and the Sea\" tells the story of a battle between an aging, experienced fisherman, Santiago, and a large marlin.", "The story opens with Santiago having gone 84 days without catching a fish, and now being seen as \"\"salao\", the worst form of unluckiness.", "He is so unlucky that his young apprentice, Manolin, has been forbidden by his parents to sail with him and has been told instead to fish with successful fishermen.", "The boy visits Santiago's shack each night, hauling his fishing gear, preparing food, talking about American baseball and his favorite player, Joe DiMaggio." ], [ "The Sea Is My Brother", "The Sea Is My Brother\n\nThe Sea Is My Brother is a novel by the American author Jack Kerouac, published in 2011.", "The novel was written in 1942 and remained unpublished throughout Kerouac's lifetime due to his dissatisfaction with the novel.", "The plot and its characters are based on Kerouac's experience in United States Merchant Marine during World War II.", "Kerouac served on the troop transport from July through October 1942 before returning to Columbia University.", "The \"Dorchester\" would be torpedoed three months after Kerouac's departure with most of the 600-man crew dying including the Four Chaplains.", "This service inspired him to write \"Sea\".", "The author, who was 20 years old when \"Sea\" was written, allegedly thought that the book was \"a crock [of shit] as literature\", and apparently did not bother to shop it around to publishers.", "Dawn Ward, editor of the Penguin edition of \"The Sea Is my Brother\", holds that while the novel is not the same as the great work Kerouac produced later in his life, it illuminates Kerouac's early development as a writer.", "\"It was referred to briefly in letters, but nothing that led anyone to believe that there was this really large volume ...", "This book is really quite important as it shows how Jack developed his writing process.\"" ] ], "gold": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 and published in New York City in the United States in 1952. It was the last major work of fiction written by Hemingway that was published during his lifetime. It tells the story of Santiago, an aging Cuban fisherman who struggles with a giant marlin far out in the Gulf Stream off the coast of Cuba.", "prediction 1": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba, and published in 1952. It was the last major work of fiction by Hemingway that was published during his lifetime. The Sea Is My Brother is a novel by the American author Jack Kerouac, written in 1942 and remained unpublished throughout Kerouac's lifetime due to his dissatisfaction with the novel. It was only published in 2011, and was reprinted as a Penguin edition in 2011. The Sea Is My Brother is a novel by the American author Jack Kerouac, and was written in 1961 and published in the Penguin edition.", "prediction 2": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba, and published in 1952. The novel was published in 1943 in New York City, New Jersey and New York, and in 1961 it was published in New York City. The Sea is My Brother is a novel by the American author Jack Kerouac, published in 2011. The book was published in 1942 and remained unpublished throughout Kerouac's lifetime due to his dissatisfaction with the novel.", "prediction 3": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba and published in 1952. It was the last major work of fiction by Hemingway that was published during his lifetime. The Sea Is My Brother is a novel written by the American author Jack Kerouac in 1942 and published in 2011.", "prediction 4": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba, and published in 1952. In 1953, \"The Old Man and the Sea\" was awarded the Pulitzer Prize for Fiction, and it was cited by the Nobel Committee as contributing to their awarding of the Nobel Prize in Literature to Hemingway in 1954. The Sea Is My Brother is a novel by the American author Jack Kerouac, published in 2011. The novel was written in 1942 and remained unpublished throughout Kerouac's lifetime due to his dissatisties with the novel. The plot and its characters are based on Kerouac's experience in the United States Merchant Marine during World War II.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 403 }, { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 482 }, { "error type": "Redundant", "explanation": "The Sea Is My Brother is a novel by the American author Jack Kerouac, written in 1942 and remained unpublished throughout Kerouac's lifetime due to his dissatisfaction with the novel. ", "start": 483, "end": 614 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Old Man and the Sea is a short novel written by the American author Ernest Hemingway in 1951 in Cuba, and published in 1952. It was the last major work of fiction by Hemingway that was published during his lifetime. It tells the story of Santiago, an aging Cuban fisherman who struggles with a giant marlin far out in the Gulf Stream off the coast of Cuba." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many ml in a pint of beer uk?", "passages": [ [ "Pint", "Pint\n\nThe pint (, ; symbol pt, sometimes abbreviated as \"p\") is a unit of volume or capacity in both the imperial and United States customary measurement systems.", "In both of those systems it is traditionally one-eighth of a gallon.", "The British imperial pint is about 20% larger than the American pint because the two systems are defined differently.", "Almost all other countries have standardized on the metric system, so the size of what may be called a pint varies depending on local custom.", "The imperial pint (\u2248\u00a0568\u00a0ml) is used in the United Kingdom and Ireland and to a limited extent in Commonwealth nations.", "In the United States, two pints are used: a liquid pint (\u2248\u00a0473\u00a0ml) and a less-common dry pint (\u2248\u00a0551\u00a0ml).", "Each of these pints is one-eighth of its respective gallon, but the gallons differ.", "This difference dates back to 1824, when the British Weights and Measures Act standardised various liquid measures throughout the British Empire, while the United States continued to use the earlier English measure.", "The imperial pint consists of 20 imperial fluid ounces and the US liquid pint is 16 US fluid ounces, making the imperial fluid ounce about 4% smaller than the US fluid ounce." ], [ "Pint", "Many recipes published in the UK and Ireland still give ingredient quantities in imperial, where the pint is often used as a unit for larger liquid quantities.", "The Guild of Food Writers recommends that new recipes be published in metric units.", "The British Virgin Islands also requires that beer and cider be sold in pints.", "Also, in Canada, water amounts in air purifiers are advertised in pints as well as BTUs (\"British thermal units\"), see metrication.", "In Australia and New Zealand, a subtle change was made to 1\u00a0pint milk bottles during the conversion from imperial to metric in the 1970s.", "The height and diameter of the milk bottle remained unchanged, so that existing equipment for handling and storing the bottles was unaffected, but the shape was adjusted to increase the capacity from 568\u00a0ml to 600\u00a0ml \u2013 a conveniently rounded metric measure.", "Such milk bottles are no longer officially referred to as pints.", "However, the \"pint glass\" in pubs in Australia remains closer to the standard imperial pint, at 570\u00a0ml.", "It holds about 500\u00a0ml of beer and about 70\u00a0ml of froth, except in South Australia, where a pint is served in a 425\u00a0ml glass and a 570\u00a0ml glass is called an \"imperial pint\"." ] ], "gold": "In the United Kingdom, beer is often measured with the imperial pint at 568.26 mL, which a metric-measure glass would round up to 570 mL. A bottled pint of beer is slightly smaller at 550 mL or 500 mL, closer in volume to the American imperial pint, which is 20% smaller than the British measurement.", "prediction 1": "The Imperial pint is a unit of volume or capacity in both the imperial and United States customary measurement systems. In the British Empire, 568 ml is the standard imperial beer pint, while in the United States, 551 ml is the standard dry beer pint.", "prediction 2": "The imperial pint is a unit of volume or capacity in both the imperial and United States customary measurement systems. The British imperial pint is about 20% larger than the American pint because the two systems are defined differently. The imperial pint is used in the United Kingdom and Ireland, to a limited extent in Commonwealth nations. The US uses two pints, a liquid pint and a less-common dry pint. In the United States, a liquid pint is 473 ml and a less-common dry pint is 551 ml.", "prediction 3": "In the United Kingdom and Ireland, the Imperial pint is used as a unit of volume or capacity for beer. In the United States, the imperial pint is 568 ml, with a more common dry pint of 551 ml. In the UK, the pint glass in pubs in the UK is 570 ml.", "prediction 4": "The imperial pint is a unit of volume or capacity in both the imperial and United States customary measurement systems. In the UK, a pint is roughly one-eighth of a gallon. In the United States, there is a liquid pint and a dry pint, each of which is one-eighth of its respective gallon, but the gallons differ. The British drinker is served a pint of beer in a 425 ml glass. In the United Kingdom and Ireland, the standard imperial pint is 568 ml. The British beer is served in a 570 ml glass, which holds about 500 ml of beer and 70 ml of froth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " In the British Empire, 568 ml is the standard imperial beer pint, while in the United States, 551 ml is the standard dry beer pint. The British imperial pint is about 20% larger than the American pint." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When was the last time the bombers won a grey cup?", "passages": [ [ "Winnipeg Blue Bombers", "Winnipeg Blue Bombers\n\nThe Winnipeg Blue Bombers (officially the Winnipeg Football Club) are a Canadian football team based in Winnipeg, Manitoba.", "They are currently members of the West Division of the Canadian Football League (CFL).", "They play their home games at Investors Group Field after many years of playing at the since demolished Canad Inns Stadium.", "The Blue Bombers were founded in 1930 as the Winnipeg Football Club, which remains the organization's legal name today.", "Since that time, they have won the league's Grey Cup championship 10 times, most recently in 1990.", "With 10 wins, they have the third-highest win total in the Grey Cup although they are currently the team with the longest Grey Cup drought.", "The Blue Bombers were the first team not located in Ontario or Quebec to win a championship and hold the record for most Grey Cup appearances with 25.", "The first football team in Winnipeg was formed in 1879, and was called the Winnipeg Rugby Football Club.", "On June 10, 1930, they amalgamated with all the other teams in the Manitoba Rugby Football Union to create the Winnipeg Winnipegs Rugby Football Club, adopting the colours green and white.", "The Winnipegs played their first game against St. John's Rugby Club on June 13, 1930, when St. John's won by a score of 7\u20133." ], [ "Robert Molle", "Robert Molle\n\nRobert \u201cBob\u201d Molle (born September 23, 1962) is a Canadian author, speaker and former amateur and professional athlete.", "After finishing high school in his hometown of Saskatoon, Saskatchewan, Molle attended Simon Fraser University in Burnaby, British Columbia.", "At 6\u20194\" and 275\u00a0lb., he joined both the wrestling team and the football team at SFU, and quickly became a standout in both sports.", "Molle won a silver medal for Canada as a Super Heavyweight wrestler at the 1984 Olympics in Los Angeles.", "American wrestler Bruce Baumgartner defeated Molle to win the Gold medal.", "He was drafted by the Winnipeg Blue Bombers with the ninth overall pick of the 1985 CFL Draft.", "On November 27, 1988, he hoisted a Grey Cup as a member of the Blue Bombers' offensive line.", "He won another Grey Cup in 1990 and eventually became a captain of the Blue Bombers.", "On September 25, 2016, he was inducted into the Blue Bombers Hall of Fame." ], [ "Perry Tuttle", "In 1986, Tuttle began his 6-season career in Canadian Football League with Winnipeg Blue Bombers.", "Throughout his time with the Bombers, he caught 321 passes for 5,817 yards for 41 touchdowns.", "On November 25, 1990 at B.C Place Stadium in Vancouver, the Bombers (12-6) defeated the Edmonton Eskimos, 50- 11, to win the Grey Cup Championship, the equivalent to the Super Bowl in the NFL.", "The Bombers quarterback Tom Burgess awarded the Offensive Most Value Player honor and linebacker Greg Battle was named Defensive Most Valuable Player.", "In the third quarter of the game, Tuttle caught a 60-yard pass that later led to his 5-yard touchdown catch.", "Two seasons after the Blue Bombers championship win, in 1992, Tuttle ended his football career and moved his family back to North Carolina (Charlotte).", "A few years after his retirement, Tuttle was once again recognized for his outstanding football talent with an induction into the Winnipeg Blue Bomber Hall of Fame." ] ], "gold": "The Winnipeg Blue Bombers are the current Grey Cup champions since defeating the Hamilton Tiger-Cats in 2019 championship game. Previously, the team won the Grey Cup at BC Place on November 25, 1990, at Landsdowne Park on November 27, 1988, and at Commonwealth Stadium on November 18, 1984. The Bombers hold the record for most Grey Cup appearances of any team and were the first club in Western Canada to win a championship.", "prediction 1": "The Winnipeg Blue Bombers are a Canadian football team based in Winnipeg, Manitoba and are currently members of the West Division of the Canadian Football League. Since that time, they have won the league's Grey Cup championship 10 times, most recently in 1990. On November 25, 1990 at B.C Place Stadium in Vancouver, the Bombers (12-6) defeated the Edmonton Eskimos, 50- 11, to win the Grey Cup Championship, the equivalent to the Super Bowl in the NFL.", "prediction 2": "The Winnipeg Blue Bombers are a Canadian football team based in Winnipeg, Manitoba. They are currently members of the West Division of the Canadian Football League (CFL). Since that time, they have won the league's Grey Cup championship 10 times, most recently in 1990. In addition, they hold the record for the most Grey Cup appearances with 25. On November 25, 1990 at B.C. Place Stadium in Vancouver, the Bombers (12-6) defeated the Edmonton Eskimos, 50- 11, to win the Grey Cup Championship.", "prediction 3": "The Winnipeg Blue Bombers are a Canadian football team based in Winnipeg, Manitoba. They were founded in 1930 as the Winnipeg Football Club, which remains the organization's legal name today. The last time the Bombers won the Grey Cup was in 1990, when they defeated the Edmonton Eskimos 50-11.", "prediction 4": "The Winnipeg Blue Bombers are a Canadian professional football team based in Winnipeg, Manitoba. Since 1930, they have won the league's Grey Cup championship 10 times, most recently in 1990. The last time they lost a Grey Cup was in 1989.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 454 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Winnipeg Blue Bombers were the first team not located in Ontario or Quebec to win a championship and hold the record for most Grey Cup appearances. Winning most recently on November 25, 1990 at B.C Place Stadium in Vancouver. Previous to that, on November 27, 1988, they hoisted a Grey Cup." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What are the most popular sports in usa?", "passages": [ [ "Sports in the United States", "Sports in the United States\n\nSports in the United States are an important part of American culture.", "American football is the most popular sport in the United States followed by basketball, baseball, and soccer.", "Tennis, golf, hockey, wrestling, auto racing, arena football, field lacrosse, box lacrosse and volleyball are also popular sports in the country.", "Based on revenue, the four major professional sports leagues in the United States are Major League Baseball (MLB), the National Basketball Association (NBA), the National Football League (NFL), and the National Hockey League (NHL).", "The market for professional sports in the United States is roughly $69 billion, roughly 50% larger than that of all of Europe, the Middle East, and Africa combined.", "All four enjoy wide-ranging domestic media coverage and are considered the preeminent leagues in their respective sports in the world, although American football does not have a substantial following in other nations.", "Three of those leagues have teams that represent Canadian cities, and all four are the most financially lucrative sports leagues of their sport.", "Major League Soccer (MLS), which also includes teams based in Canada, is sometimes included in a \"top five\" of leagues." ], [ "Sports in the United States", "In the broadest definition of sports\u2014physical recreation of all sorts\u2014the four most popular sports among the general population of the United States are exercise walking (90 million), exercising with equipment (53 million), swimming (52 million) and camping (47 million).", "The most popular competitive sport (and fifth most popular recreational sport) is bowling (43 million).", "Other most popular sports are fishing (35 million), bicycling (37 million), weightlifting (33 million), aerobics (30 million), and hiking (28 million).", "According to a January 2018 Poll by Gallup, 37% of Americans consider American football their favorite spectator sport, while 11% prefer basketball, 9% baseball, and 7% soccer.", "There is some variation by viewer demographics.", "Men, show a stronger preference for football than women, conservatives a stronger preference than liberals, and those over 35 a stronger preference than those under 35.", "In all groups, however, football is still the most popular.", "Basketball and soccer are more popular among liberals than conservatives.", "Though baseball has historically been called the \"national pastime\", American football has considerably grown in popularity with the advent of television over the last several decades." ], [ "National Football League", "Overall annual attendance increased from three million at the beginning of his tenure to seventeen million by the end of his tenure, and 400 million viewers watched 1989's Super Bowl XXIII.", "The NFL established NFL Properties in 1963.", "The league's licensing wing, NFL Properties earns the league billions of dollars annually; Rozelle's tenure also marked the creation of NFL Charities and a national partnership with United Way.", "Paul Tagliabue was elected as commissioner to succeed Rozelle; his seventeen-year tenure, which ended in 2006, was marked by large increases in television contracts and the addition of four expansion teams, as well as the introduction of league initiatives to increase the number of minorities in league and team management roles.", "The league's current Commissioner, Roger Goodell, has focused on reducing the number of illegal hits and making the sport safer, mainly through fining or suspending players who break rules.", "These actions are among many the NFL is taking to reduce concussions and improve player safety.", "From 1920 to 1934, the NFL did not have a set number of games for teams to play, instead setting a minimum.", "The league mandated a 12-game regular season for each team beginning in 1935, later shortening this to 11 games in 1937 and 10 games in 1943, mainly due to World War II." ] ], "gold": "The sport Americans enjoy the most is exercise walking, with about 90 million participants. However, football is the most watched sport in America, where the NFL is the most popular sports league and the Super Bowl in particular draws high viewership numbers. When attending games in person, however, Major League Baseball is America's favorite choice with more than 69.6 million spectators in 2018.", "prediction 1": "American football is the most popular sport in the United States followed by basketball, baseball, and soccer. Tennis, golf, hockey, wrestling, auto racing, arena football, field lacrosse, box lacrosse and volleyball are also popular sports in the country. Based on revenue, the four major professional sports leagues in the United States are Major League Baseball (MLB), the National Basketball Association (NBA), the National Football League (NFL), and the National Hockey League (NHL). The market for professional sports in the United States is roughly $69 billion, roughly 50% larger than that of all of Europe, the Middle East, the Middle East, the Middle East, the Middle East, the Middle East, the Middle East, the Middle East, and Africa combined.", "prediction 2": "American football is the most popular sport in the United States, followed by basketball, baseball, and soccer. Tennis, golf, hockey, wrestling, auto racing, arena football, field lacrosse, box lacrosse and volleyball are also popular sports in the country. Based on revenue, the four major professional sports leagues in the United States are Major League Baseball, the National Basketball Association, the National Football League, and the National Hockey League. The market for professional sports in the United States is roughly $69 billion, roughly 50% larger than that of all of Europe, the Middle East, the Middle East, the Africa, the United States.", "prediction 3": "Sports in the United States are an important part of American culture. American football is the most popular sport in the United States followed by basketball, baseball, and soccer. Tennis, golf, hockey, wrestling, auto racing, arena football, field lacrosse, box lacrosse and volleyball are also popular sports in the country. Based on revenue, the four major professional sports leagues in the United States are Major League Baseball, the National Basketball Association, the National Football League, and the National Hockey League.", "prediction 4": "Sports in the United States are an important part of American culture. American football is the most popular sport in the United States followed by basketball, baseball, and soccer. Tennis, golf, hockey, wrestling, auto racing, arena football, field lacrosse, box lacrosse, and volleyball are also popular sports in the country. Based on revenue, the four major professional sports leagues in the United States are Major League Baseball, the National Basketball Association, the National Football League, and the National Hockey League.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 256 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "American football is the most popular sport in the United States, though historically and based on revenue, Major League Baseball (MLB) is the \"national pastime\". The most popular sport among the general population of the United States is exercise walking with 90 million participants." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "When did the black panther movie come out?", "passages": [ [ "Black Panther (film)", "The premiere featured a purple carpet that was flanked by women dressed as the Dora Milaje, while Coogler, cast members, and other guests wore African clothing at the request of Marvel for attendees to wear \"royal attire\", honoring the African setting of the film.", "Ahead of the premiere screening, Coogler received an extended standing ovation before he announced the cast of the film.", "\"Black Panther\" was released in the United Kingdom, Hong Kong, and Taiwan on February 13, in South Korea on February 14, and the United States on February 16.", "In the United States, the film opened in 4,020 theaters, with over 3,200 of those in 3D, 404 in IMAX, over 660 in premium large format, and over 200 D-Box locations.", "In addition, \"Black Panther\" was the first MCU film to be converted to ScreenX, a 270-degree wraparound format, that played in over 101 locations in eight countries.", "The film opened in most markets in its first weekend of release including a \"cross-nation release\" in Africa, a first for a Disney film.", "\"Black Panther\" was originally scheduled for release on November 3, 2017, before moving to July 6, 2018 to accommodate \"\" (2017).", "It was then moved to the final February date to accommodate \"Ant-Man and the Wasp\" (2018)." ], [ "Black Panther (film)", "\"Black Panther\" premiered in Riyadh, Saudi Arabia on April 18, 2018, marking the first public film screening since movie theaters were banned in the kingdom in the early 1980s after ultraconservative religious standards were introduced in 1979.", "The ban was lifted in December 2017 by Crown Prince Mohammed bin Salman.", "The film premiered in a newly constructed 620 leather seat cinema, owned by AMC Theatres, in Riyadh's King Abdullah Financial District that was originally intended to be a symphony hall.", "Disney's regional distributor Italia Film revealed that 40 seconds of the film had been removed, which was in line with cuts made to the film across the region.", "Awwad Alawwad, Saudi Arabia's Minister of Culture and Information, and Adam Aron, CEO of AMC Entertainment, were in attendance for the premiere along with other diplomats and industry experts; no one from the cast or production team was in attendance.", "Men and women sat together at the screening, after the Saudi government relaxed enforcement of laws banning co-mingling between unrelated men and women.", "\"Black Panther\" screened there for five days before \"Avengers: Infinity War\" premiered on April 26.", "\"Black Panther\" was released for digital download by Walt Disney Studios Home Entertainment on May 8, 2018, and on Ultra HD Blu-ray, Blu-ray, and DVD on May 15." ], [ "The Black Panther (1977 film)", "The Black Panther (1977 film)\n\nThe Black Panther is a 1977 British crime film.", "Its subject is the criminal Donald Neilson, known as the \"Black Panther\".", "It was directed and produced by Ian Merrick, his first feature, and stars Donald Sumpter, Debbie Farrington and Marjorie Yates.", "It was seen as exploitative so soon after the events depicted.", "The film featured the kidnap of a young girl, Leslie Whittle.", "It was controversial on its release, and was slandered by media figures such as Sue Lawley of \"Tonight\".", "Subsequently, the film was effectively banned.", "In 2012, the film was remastered, and resurrected into the British Film Institute \"Archives and Hall of Fame\", as an important British film to rave reviews.", "John Patterson of \"The Guardian\" commented that \"The Black Panther\" \"emerges as a meticulous, tactful, well made and highly responsible true crime movie\"." ] ], "gold": "There are several films by the title \"The Black Panther\". One \"The Black Panther\" movie is a 1977 British crime film that came out on December 26, 1977. Another \"The Black Panther\" is a 2018 American superhero film based on the Marvel Comics character of the same name. This \"The Black Panther\" had its world premiere at the Dolby Theatre in Los Angeles on January 29, 2018. It was released in the United Kingdom, Hong Kong, and Taiwan on February 13, 2018, in South Korea on February 14, 2018, in the United States on February 16, 2018, and in Riyadh, Saudi Arabia on April 18, 2018.", "prediction 1": "The Black Panther is a 1977 British crime film and the first film to feature Donald Neilson, also known as the Black Panther. The film was released in the United Kingdom, Hong Kong, and Taiwan on February 13. In South Korea, the film was released on February 14, and in the United States it was released on February 16. In Africa, the film was released April 18, 2018, marking the first public film screening since movie theaters were banned in the kingdom in the early 1980s after ultraconservative religious standards were introduced in 1979.", "prediction 2": "The Black Panther is a film directed by Ian Merrick that tells the story of the criminal Donald Neilson, known as the Black Panther. The movie premiered in Riyadh, Saudi Arabia on April 18, 2018, marking the first public film screening since movie theaters were banned in the kingdom in the early 1980s after ultraconservative religious standards were introduced in 1979. The ban was lifted in December 2017 by Crown Prince Mohammed bin Salman. The film's release dates included the United Kingdom, Hong Kong, and Taiwan on February 13, South Korea on February 14, and the United States on February 16.", "prediction 3": "Black Panther is a superhero film that's based on the 1977 film by the same name. It was released in the United Kingdom, Hong Kong, and Taiwan on February 13, in South Korea on February 14, and the United States on February 16. In the United States, the film opened in 4,020 theaters, with over 3,200 of those in 3D, 404 in IMAX, over 660 in premium large format, and over 200 D-Box locations.", "prediction 4": "Black Panther is a superhero film that follows Donald Neilson, also known as the Black Panther. It was released in the United Kingdom, Hong Kong, and Taiwan on February 13, in South Korea on February 14, and the United States on February 16. In the United States, the film opened in 4,020 theaters, with over 3,200 of those in 3D, 404 in IMAX, over 660 in premium large format, and over 200 D-Box locations. Black Panther was released for digital download on May 8, 2018 and on Ultra HD Blu-ray, Blu-ray, Blu-ray, Blu-ray, Blu-ray, Blu-ray, and DVD on May 15. It was released for digital download by Walt Disney Studios Home Entertainment on May 8, 2018, and on Ultra HD Blu-Ray, Blu-ray, Blu-ray, Blu-ray, Blu-Ray, DVD on May 15, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 125 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 320, "end": 330 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 544 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Black Panther is a 1977 British crime film. The MCU film Black Panther was released in the United Kingdom, Hong Kong, and Taiwan on February 13. In South Korea, the film was released on February 14, and in the United States it was released on February 16. In Riyadh, Saudi Arabia the film was released April 18, 2018. \"Black Panther\" was released for digital download by Walt Disney Studios Home Entertainment on May 8, 2018, and on Ultra HD Blu-ray, Blu-ray, and DVD on May 15." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When was the country music hall of fame built?", "passages": [ [ "Country Music Hall of Fame and Museum", "Country Music Hall of Fame and Museum\n\nThe Country Music Hall of Fame and Museum in Nashville, Tennessee, is one of the world's largest museums and research centers dedicated to the preservation and interpretation of American vernacular music.", "Chartered in 1964, the museum has amassed one of the world's most extensive musical collections.", "The Country Music Hall of Fame and Museum is one of the world's largest and most active popular music research centers and the world's largest repository of country music artifacts.", "Early in the 1960s, as the Country Music Association's campaign to publicize country music was accelerating, CMA leaders determined that a new organization was needed to operate a country music museum and to carry out research and education activities beyond CMA's scope as a trade organization.", "Toward this end, the nonprofit Country Music Foundation (CMF) was chartered by the state of Tennessee in 1964 to collect, preserve, and publicize information and artifacts relating to the history of country music.", "Through CMF, industry leaders raised money to build the Country Music Hall of Fame and Museum, which opened on April 1, 1967.", "Located at the head of Music Row, the museum was erected on the site of a small Nashville city park.", "At this point, artifacts began to be displayed and a small library was begun in a loft above one of the museum's galleries." ], [ "Country Music Hall of Fame and Museum", "Early in the 1970s the basement of the museum building was partially complete, and library expansion began, embracing not only recordings but also books and periodicals, sheet music and songbooks, photographs, business documents, and other materials.", "At the outset, CMA staff had run the museum, but by 1972 the museum (already governed by its own independent board of directors) acquired its own small staff, which has steadily increased to over 150 full-time professionals.", "Building expansion took place in 1974, 1977, and 1984 to store and display the museum's growing collection of costumes, films, historic cars, musical instruments, and other artifacts.", "An education department was created to conduct ongoing programs with Middle Tennessee schools, an oral history program was begun, and a publications department was launched to handle books, as well as the \"Journal of Country Music.\"", "To become more accessible, in May 2001 the Country Music Hall of Fame and Museum moved to a new, facility in the heart of downtown Nashville's arts and entertainment district.", "In 2014, the museum unveiled a $100 million expansion, doubling its size to 350,000 square feet of galleries, archival storage, education classrooms, retail stores, and special event space." ] ], "gold": "The Country Music Hall of Fame and Museum is one of the world's largest and most active popular music research centers, established in 1961 by The Country Music Association (CMA). The Museum opened in Music Row in 1967 on the site of a small Nashville city park. In May 2001 the Country Music Hall of Fame and Museum moved to a new facility in the heart of downtown Nashville's arts and entertainment district. In 2014, the museum unveiled a $100 million expansion, doubling its size to 350,000 square feet.", "prediction 1": "The Country Music Hall of Fame and Museum is one of the world's largest museums and research centers dedicated to the preservation and interpretation of American vernacular music. Chartered in 1964, the museum has amassed one of the world's most extensive musical collections. Located at the head of Music Row, the museum was erected on the site of a small Nashville city park.", "prediction 2": "The Country Music Hall of Fame and Museum in Nashville, Tennessee, is one of the world's largest museums and research centers dedicated to the preservation and interpretation of American vernacular music. Chartered in 1964, the museum has amassed one of the world's most extensive musical collections. Located at the head of Music Row, the museum was erected on the site of a small Nashville city park. In the 1970s, the basement of the museum building was partially complete, and library expansion began, embracing not only recordings but also books and periodicals, sheet music and songbooks, photographs, business documents, and other materials. In 1974, 1977, and 1984, building expansion took place in 1974, 1977, and 1984 to store and display the growing collection of costumes, films, historic cars, musical instruments, and other artifacts. In 2014, the museum moved to a new, facility in the heart of downtown Nashville's arts", "prediction 3": "The Country Music Hall of Fame and Museum in Nashville, Tennessee, is one of the world's largest museums and research centers dedicated to the preservation and interpretation of American vernacular music, having been Chartered in 1964. Located at the head of Music Row, the museum was erected on the site of a small Nashville city park. Early in the 1970s the basement of the museum building was partially complete, and library expansion began, embracing not only recordings but also books and periodicals, sheet music and songbooks, photographs, business documents, and other materials. Building expansion took place in 1974, 1977, and 1984 to store and display the growing collection of costumes, films, historic cars, musical instruments, and other artifacts.", "prediction 4": "The Country Music Hall of Fame and Museum in Nashville, Tennessee, is one of the world's largest museums and research centers dedicated to the preservation and interpretation of American vernacular music. Chartered in 1964, the museum has amassed one of the world's most extensive musical collections. Located at the head of Music Row, the museum was erected on the site of a small Nashville city park. The basement of the museum building was partially complete, early in the 1970s the basement of the museum building was partially complete, and library expansion began, embracing not only recordings but also books and periodicals, sheet music and songbooks, photographs, business documents, and other materials.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 179 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 276 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Country Music Hall of Fame and Museum is one of the world's largest museums and research centers chartered in 1964. The Museum opened in Music Row in 1967 on the site of a small Nashville city park. In May 2001 the Country Music Hall of Fame and Museum moved to a new, facility in the heart of downtown Nashville's arts and entertainment district. In 2014, the museum unveiled a $100 million expansion, doubling its size to 350,000 square feet." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is next in line for the royal throne of england?", "passages": [ [ "Succession to the British throne", "Succession to the British throne\n\nSuccession to the British throne is determined by descent, sex (for people born before October 2011), legitimacy, and religion.", "Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line.", "The Bill of Rights 1689 and the Act of Settlement 1701 restrict succession to the throne to the legitimate Protestant descendants of Sophia of Hanover that are in \"communion with the Church of England\".", "Spouses of Roman Catholics were disqualified from 1689 until the law was amended in 2015.", "Protestant descendants of those excluded for being Roman Catholics are eligible.", "Queen Elizabeth II is the sovereign, and her heir apparent is her eldest son, Charles, Prince of Wales.", "Next in line after him is Prince William, Duke of Cambridge, the Prince of Wales's elder son.", "Third in line is Prince George, the eldest child of the Duke of Cambridge, followed by his sister, Princess Charlotte and younger brother, Prince Louis.", "Sixth in line is Prince Harry, Duke of Sussex, the younger son of the Prince of Wales.", "Under the Perth Agreement, which came into effect in 2015, only the first six in line of succession require the sovereign's consent before they marry; without such consent, they and their children would be disqualified from succession." ] ], "gold": "The succession to the Royal Throne of England is is determined by descent, sex, legitimacy, and religion, with the Crown being inherited by a sovereign's children or by a childless sovereign's nearest collateral line as determined under common law. Currently, the next person in line is Queen Elizabeth II's heir apparent, her eldest son Charles, Prince of Wales.", "prediction 1": "Succession to the British throne is determined by descent, sex (for people born before October 2011), legitimacy, and religion. Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. Charles, Prince of Wales, is the sovereign's heir apparent. Next in line after him is Prince William, Duke of Cambridge, the Prince of Wales' elder son. Third in line is Prince George, the eldest child of the Duke of Cambridge. Fourth in line is Princess Charlotte and younger brother, Prince Louis. Sixth in line is Prince Harry, Duke of Sussex, the younger son of the Prince of Wales.\n", "prediction 2": "Succession to the English throne is determined by descent, sex (for people born before October 2011), legitimacy, and religion. Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. Afterwards, Charles, Prince of Wales, will be the heir apparent of Queen Elizabeth II. William, Duke of Cambridge, will be the next in line. Third in line is Prince George, the eldest child of the Duke of Cambridge, followed by his sister, Princess Charlotte and younger brother, Prince Louis. Sixth in line is Harry, Duke of Sussex. Under the Perth Agreement, only the first six in line require the sovereign's consent before they marry.", "prediction 3": "The line of succession to the throne of England is determined by descent, sex (for people born after October 2011), legitimacy, and religion. The sovereign is the Queen Elizabeth II, her husband is Charles, Prince of Wales, her eldest son and her seventh child. He is followed by Prince William, Duke of Cambridge, Princess Charlotte's younger son, and younger son Louis. And, the next in line for the crown is Prince Harry, Duke of Sussex, the younger son of the Prince of Wales.", "prediction 4": "The next in line for the head of state of England is Charles, 1st Prince of Wales. After him, Prince William is the next in line. Prince George, 2nd Prince of Wales, is next in line after him. Prince Harry, 6th Prince of Sussex.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 402 }, { "error type": "Irrelevant", "explanation": "", "start": 403, "end": 477 }, { "error type": "Irrelevant", "explanation": "", "start": 478, "end": 549 }, { "error type": "Irrelevant", "explanation": "", "start": 550, "end": 637 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Succession to the British throne is determined by descent, sex (for people born before October 2011), legitimacy, and religion. Under common law, the Crown is inherited by a sovereign's children or by a childless sovereign's nearest collateral line. Currently, the next person in line is Queen Elizabeth II's heir apparent, her eldest son Charles, Prince of Wales." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "If you have a north wind which way is it blowing?", "passages": [ [ "Wind direction", "Wind direction\n\nWind direction is reported by the direction from which it originates.", "For example, a \"northerly\" wind blows from the north to the south.", "Wind direction is usually reported in cardinal directions or in azimuth degrees.", "Wind direction is measured in degrees clockwise from due north.", "Consequently, a wind blowing from the north has a wind direction of 0\u00b0; a wind blowing from the east has a wind direction of 90\u00b0; a wind blowing from the south has a wind direction of 180\u00b0; and a wind blowing from the west has a wind direction of 270\u00b0.", "In general, wind directions are measured in units from 0\u00b0 to 360\u00b0, but can alternatively be expressed from -180\u00b0 to 180\u00b0.", "Winds are named for the direction from which they come, followed by the suffix \"-erly\".", "For example, winds from the north are called \"northerly winds\" (\"north\" + \"-erly\").", "A variety of instruments can be used to measure wind direction, such as the windsock and wind vane.", "Both of these instruments work by moving to minimize air resistance.", "The way a weather vane is pointed by prevailing winds indicates the direction from which the wind is blowing.", "The larger opening of a windsock faces the direction that the wind is blowing from; its tail, with the smaller opening, points in the same direction as the wind is blowing." ], [ "North wind", "North wind\n\nA north wind is a wind that originates in the north and blows south.", "The north wind has had historical and literal significance, since it often signals cold weather and seasonal change in the Northern hemisphere.", "In the Southern Hemisphere, especially in southern Australia, the north wind is a hot wind which often leads to bushfires.", "\"When love beckons to you, follow him,\nThough his ways are hard and steep.", "And when his wings enfold you yield to him,\nThough the sword hidden among his pinions may wound you.", "And when he speaks to you believe in him,\nThough his voice may shatter your dreams\nas the north wind lays waste the garden.\"", "(1-7)" ] ], "gold": "A north wind is a wind that originates in the north and blows in a southward direction. The north wind has had historical and literal significance, since it often signals cold weather and seasonal change in the Northern hemisphere. In the Southern Hemisphere, especially in southern Australia, the north wind is a hot wind which often leads to bushfires.", "prediction 1": "A north wind is a wind that originates in the north and blows south. The way a weather vane is pointed by prevailing winds indicates the direction from which the wind is blowing. The bigger opening of a windsock faces the direction that the wind is blowing from, and its tail, with the smaller opening, points in the same direction as the wind is blowing.", "prediction 2": "A north wind is a wind that originates in the north and blows south. It is also known as a northerly wind. Wind direction is usually reported by the direction from which it originates. The way a weather vane is pointed by prevailing winds indicates the direction from which the wind is blowing. For example, a north wind blows from the north to the south.", "prediction 3": "A north wind is a wind that originates in the north and blows south. The way a weather vane is pointed by prevailing winds indicates the direction from which the wind is blowing. The larger opening of a windsock faces the direction that the wind is blowing from; its tail, with the smaller opening, points in the same direction as the wind is blowing.", "prediction 4": "A north wind is a wind that originates in the north and blows south. Wind direction is reported by the direction from which it originates. For example, a \"northerly\" wind blows from the north to the south. A wind blowing from the north has a wind direction of 0\u00b0, a wind blowing from the east has a wind direction of 90\u00b0, a wind blowing from the south has a wind direction of 180\u00b0, and a wind blowing from the west has a wind direction of 270\u00b0.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 355 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "A north wind is a wind that originates in the north and blows south. The north wind has had historical and literal significance, since it often signals cold weather and seasonal change in the Northern hemisphere. In the Southern Hemisphere, especially in southern Australia, the north wind is a hot wind which often leads to bushfires. " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who wrote the music for come from away?", "passages": [ [ "Come from Away", "Come from Away\n\nCome from Away is a musical with book, music and lyrics by Irene Sankoff and David Hein.", "It is set in the week following the September 11 attacks and tells the true story of what transpired when 38 planes were ordered to land unexpectedly in the small town of Gander, Newfoundland and Labrador, Canada as part of Operation Yellow Ribbon.", "The characters in the musical are based on (and in most cases share the names of) real Gander residents as well as some of the 7,000 stranded travelers they housed and fed.", "The musical has been received by audiences and critics as a cathartic reminder of the capacity for human kindness in even the darkest of times and the triumph of humanity over hate.", "After being workshopped in 2012 and first produced at Sheridan College in Oakville, Ontario in 2013, it went on to have record-breaking runs at the La Jolla Playhouse and the Seattle Repertory Theatre in 2015, at the Ford's Theatre in Washington, D.C., and the Royal Alexandra Theatre in Toronto in 2016.", "It opened on Broadway at the Gerald Schoenfeld Theatre on March 12, 2017, and became a critical and box office success, routinely playing to standing-room-only audiences even during previews." ], [ "David Hein", "David Hein\n\nDavid Hein is a Canadian playwright, songwriter and actor best known for co-writing the Broadway musical \"Come from Away\" with his writing partner and wife, Irene Sankoff.", "Hein was born in Regina, Saskatchewan, and was educated at York University in Toronto, Ontario.", "After graduating, he and his fianc\u00e9e moved to New York City in 1999 where he worked at a music studio and she studied at The Actor's Studio.", "After spending several years studying and working in New York the couple returned to Toronto where Hein wrote a song \"My Mother's Lesbian Jewish Wiccan Wedding\", about his mother and her later life partner, which he and Sankoff expanded into a play that was staged at the Toronto Fringe Festival in 2009 and then picked up by Mirvish Productions for a run at Toronto's Panasonic Theatre before touring Canada.", "As a result of \"My Mother\u2019s Lesbian Jewish Wiccan Wedding\" success, theatre producer Michael Rubinoff approached Hein and Sankoff with his idea about a show based on Operation Yellow Ribbon in which residents of Gander, Newfoundland, housed 7,000 airline passengers who had been stranded at Gander Airport as a result of the grounding of all North American air flights following the September 11 attacks." ] ], "gold": "Irene Sankoff and her husband David Hein wrote the music, book and lyrics for the Canadian musical Come from Away. Sankoff and Hein met at York University. After graduating, they moved to New York City in 1999 where he worked at a music studio and she studied at The Actor's Studio and performed in theatres. They were in New York City during the September 11 attacks.", "prediction 1": "David Hein, a Canadian playwright, songwriter and actor, wrote all the music for the musical Come from Away with his writing partner and wife, Irene Sankoff.", "prediction 2": "Come from Away, a musical with book, music and lyrics by Irene Sankoff and David Hein, is a Canadian playwright, songwriter and actor best known for co-writing the Broadway musical Come from Away with his writing partner and wife, Irene Sankoff. In 1999, Hein and Sankoff worked at a music studio in New York City and studied at The Actor's Studio. Hein wrote the music for Come from Away and sang the music for the opening number.", "prediction 3": "Come from Away is a musical with book, music and lyrics by Irene Sankoff and David Hein. It is set in the week following the September 11 attacks and tells the true story of what transpired when 38 planes were ordered to land unexpectedly in the small town of Gander, Newfoundland and Labrador, Canada as part of Operation Yellow Ribbon. Irene Sankoff wrote the music for the musical. David Hein wrote the lyrics. David Hein wrote the music.", "prediction 4": "Come from Away is a musical with book, music and lyrics by Irene Sankoff and David Hein. It is set in the week following the September 11 attacks and tells the true story of what transpired when 38 planes were ordered to land unexpectedly in the small town of Gander, Newfoundland and Labrador, Canada as part of Operation Yellow Ribbon. After being workshopped in 2012 and first produced at Sheridan College in Oakville, Ontario in 2013, it went on to have record-breaking runs at the La Jolla Playhouse and the Seattle Repertory Theatre in 2015, at the Royal Alexandra Theatre in Toronto in 2016, and later returned to Toronto where Hein wrote a song, about his mother and her later life partner, about his mother and her later life partner.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "David Hein, a Canadian playwright, songwriter and actor, wrote all the music for the musical Come from Away with his writing partner and wife, Irene Sankoff. Sankoff and Hein met at York University. After graduating, they moved to New York City in 1999 where he worked at a music studio and she studied at The Actor's Studio. They were in New York City during the September 11 attacks." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "What is the name of the big island in hi?", "passages": [ [ "Hawaii (island)", "Hawaii (island)\n\nHawai\u02bbi ( ; ) is the largest island located in the U.S. state of Hawaii.", "It is the largest and the southeasternmost of the Hawaiian Islands, a chain of volcanic islands in the North Pacific Ocean.", "With an area of , it has 63% of the Hawaiian archipelago's combined landmass, and is the largest island in the United States.", "However, it has only 13% of Hawai\u02bbi\u2019s people.", "The island of Hawai\u02bbi is the third largest island in Polynesia, behind the two main islands of New Zealand.", "The island is often referred to as the Island of Hawai\u02bbi, the Big Island, or Hawai\u02bbi Island to distinguish it from the state.", "Administratively, the whole island encompasses Hawai\u02bbi County.", "As of the 2010 Census the population was 185,079.", "The county seat and largest city is Hilo.", "There are no incorporated cities in Hawai\u02bbi County (see List of counties in Hawaii).", "Hawai\u02bbi is said to have been named after Hawai\u02bbiloa, the legendary Polynesian navigator who first discovered it.", "Other accounts attribute the name to the legendary realm of Hawaiki, a place from which some Polynesian people are said to have originated, the place where they transition to in the afterlife, or the realm of the gods and goddesses." ], [ "Pa\u02bbao", "Accounts recorded by, Mary Kawena Pukui, Abraham Fornander, Kanuikaikaina, and other custodians of Hawaiian lore argue that Pili and Pa'ao both came from the islands known today as Samoa.", "'Upolu ('Uporu) is one of the main islands of Samoa; and Vava'u (Wewa'u) is the northern group of Tongan islands, which are geographically closer to Samoa than to Tongatapu, and were linguistically and politically closer to Samoa in the past.", "Legends suggest that Paao introduced certain customs (such as human sacrifice, primary worship of the god K\u016b, red feathered girdles \"K\u0101\u02bbei\", K\u0101\u02bbeke drums and veneration of the bonito fish) to Hawaii.", "He is also said to have brought a \"pure\" chief to rule over the Hawai'i Island, deposing the highest ranking & tyrant chief, Kapaw\u0101.", "At this time in Hawai'i's history the four island kingdoms were: Kaua\u02bbi (Kaua\u02bbi & Ni\u02bbihau), O\u02bbahu, Maui (Maui, Moloka\u02bbi, L\u0101na\u02bbi and Kaho'olawe) Hawai'i." ] ], "gold": "The state of Hawaii is typically recognized by its eight main islands: Hawai'i, Maui, O'ahu, Kaua'i, Moloka'i, L\u0101na\u02bbi, Ni\u02bbihau and Kaho\u02bbolawe. Hawai\u02bbi is known commonly as the Big Island to reduce confusion between the island and the state itself.", "prediction 1": "Hawaii is the largest island located in the U.S. state of Hawaii, and is often referred to as the Island of Hawaii, the Big Island, or Hawaii Island to distinguish it from the state.", "prediction 2": "Hawaii is the largest island in the Hawaiian Islands, a chain of volcanic islands in the North Pacific Ocean. It is often referred to as the Island of Hawaii, the Big Island, or Hawaii Island to distinguish it from the state.", "prediction 3": "Hawaii is the largest island located in the U.S. state of Hawaii and is the largest and southeasternmost of the Hawaiian Islands, a chain of volcanic islands in the North Pacific Ocean. It is also the name of the largest city in the county, Hawaii Island. Hawaii is said to have been named after Hawaiiloa, the legendary Polynesian navigator who first discovered it. Other accounts attribute the name to the legendary realm of Hawaiki, a place from which some Polynesian people are said to have originated, the place from which they transition to in the afterlife, or the realm of the realm of the gods and goddesses and goddesses and goddesses.", "prediction 4": "Hawai'i is the largest island located in the U.S. state of Hawaii. It is the largest and the southeasternmost of the Hawaiian Islands, a chain of volcanic islands in the North Pacific Ocean. It is often referred to as the Island of Hawaii, the Big Island, or Hawaii Island to distinguish it from the state.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Hawaii is the largest island located in the U.S. state of Hawaii, and is often referred to as the Island of Hawaii, the Big Island, or Hawaii Island to distinguish it from the state." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When does the new mlb game come out?", "passages": [ [ "MLB: The Show", "MLB: The Show\n\nMLB:", "The Show is a Major League Baseball video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios.", "The series debuted in 2006 with \"\" for the PlayStation 2 and PlayStation Portable.", "There has been a new release in the series every year since 2006, and since \"\" in 2007, every game released has also been available for the PlayStation 3, until the release of MLB 17: The Show.", "\"\", which was released in March 2012, is also the first game in the series to not be available for the PS2 or PSP and the first game in the series to be made available for the PlayStation Vita, Sony's new handheld.", "The series is the successor to 989 Studios' MLB series.", "\"MLB The Show 17\" is the first game in the series to be exclusive to the Playstation 4 line, meaning the PS4 and PS4 Pro.", "Gameplay simulates a typical game of baseball, with the player controlling an entire team or a select player.", "The player may take control of one of 30 Major League Baseball teams in any game mode (excluding Road to the Show) and use that team in gameplay.", "The Series has variable game modes in which a player takes control of a team for a single game, one season, or a franchise (multiple seasons)." ], [ "MLB The Show 17", "Additions like critical situations, in which you only play important at-bats in late innings of games, and quick manage, in which you are in complete control of all managerial decisions during a game have been implemented.", "Like previously, \"Diamond Dynasty\" involves building the ultimate baseball team and maintaining a virtual trading-card collection.", "The player creates a customized team, selecting the players (current and past), a team name, logo, and uniforms.", "Games are played in tournament-style competitions against other players' teams.", "Additional legendary baseball players have been added to collect, new missions to complete, and live updated 2017 Topps player cards.", "On December 3, 2016, \"MLB The Show 17\" was announced with a trailer for the game that showed the games release date along with new features.", "It was released worldwide on March 28, 2017, for PlayStation 4.", "This was the first time since \"\" that the game was not released for the PlayStation 3.", "There were four different versions of the game to purchase: Standard Edition, MVP Edition, Hall of Fame Edition, and Digital Deluxe Edition.", "If players purchase the Hall of Fame Edition of the game, they receive the Steel Book case cover, several physical items, such as a limited edition New Era Hat, and many in-game bonuses.", "\"MLB The Show 17\" received \"generally favorable\" reviews from critics, according to review aggregator Metacritic." ], [ "MLB The Show 16", "MLB The Show 16\n\nMLB The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment.", "It is the eleventh entry of the \"\" franchise, and was released on March 29, 2016, for PlayStation 3 and PlayStation 4.", "It is the first \"MLB: The Show\" entry to not have a portable version, and is the final version available for PlayStation 3.", "Toronto Blue Jays third baseman and 2015 American League MVP Josh Donaldson is the main cover athlete for the game.", "He also appears on the separate Canadian cover edition, making him the first player to be on both the American and Canadian versions of the game.", "Jung-ho Kang of the Pittsburgh Pirates and Wei-Yin Chen of the Miami Marlins appear on the Korean and Taiwanese covers, respectively.", "The game features more game modes, such as Road To The Show and an all-new franchise mode.", "In addition, Conquest Mode and Battle Royale have been added into the game.", "Conquest Mode takes your Diamond Dynasty team against all 30 MLB teams and their strongholds in order to capture new territories and eventually all of North America.", "Each territory is inhabited by fans of your team or one of the 30 MLB teams.", "In order to capture one of the territories, you must attack the territory by either playing a minimum three-inning game against that team or simulate to avoid playing the game." ] ], "gold": "MLB: The Show is a Major League Baseball video game series with a new release every year since it debuted in 2006. The 2015 mlb game came out on March 31; the 2016 one came out on March 29, and the one in 2017, on March 28.", "prediction 1": "MLB: The Show is a Major League Baseball video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios. The series debuted in 2006 with MLB: The Show for the PlayStation 2. MLB: The Show 17 was announced on December 3, 2016 with a trailer for the game that showed the games release date along with new features. It was released worldwide on March 28, 2017, for PlayStation 4.", "prediction 2": "MLB: The Show is a video game series produced by SIE San Diego Studio, a development team that is part of SCE Worldwide Studios. MLB The Show 17 is the first game in the MLB: The Show franchise to be exclusive to the Playstation 4 line. MLB: The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. MLB: The Show 17 is released on December 3, 2016 for PlayStation 3 and PlayStation 4. MLB: The Show 16: The Show Lite was released on December 29, 2016 for PlayStation 3 and PlayStation 4.", "prediction 3": "MLB The Show 17 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. On December 3, 2016, MLB The Show 17 was announced with a trailer for the game that showed the games release date along with new features. It was released worldwide on March 28, 2017, for PlayStation 4 and PlayStation 3.", "prediction 4": "MLB The Show is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. Baseball The Show 17 was announced on December 3, 2016, with a trailer for the game that showed the games release date along with new features. MLB The Show 16 is a Major League Baseball video game developed by Sony San Diego and published by Sony Computer Entertainment. It is the eleventh entry of the MLB: The Show franchise, and was released on March 29, 2016 for PlayStation 3 and PlayStation 4.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 150 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 358 }, { "error type": "Irrelevant", "explanation": "", "start": 404, "end": 422 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "MLB: The Show is a Major League Baseball video game series with a new release every year since it debuted in 2006. The series debuted in 2006 with MLB: The Show for the PlayStation 2. MLB: The Show 17 was released worldwide on March 28, 2017. The 2016 show came out on March 29." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When was the last time the jets won a superbowl?", "passages": [ [ "1968 New York Jets season", "1968 New York Jets season\n\nThe 1968 New York Jets season was the ninth season for the team in the American Football League (AFL).", "The team had the most successful season in franchise history.", "Trying to improve upon their 8\u20135\u20131 record of 1967, they won the AFL Eastern Division with an 11\u20133 record.", "They defeated the defending champion Oakland Raiders in the AFL championship game, and earned the right to play in Super Bowl III against the NFL champion Baltimore Colts.", "In a stunning upset, marked by fourth-year quarterback Joe Namath's famous \"guarantee\" of victory, the Jets defeated the heavily favored Colts 16\u20137.", "The Jets have yet to return to the Super Bowl and makes them along with the New Orleans Saints and the Tampa Bay Buccaneers the only teams to have been to just one Super Bowl and win it.", "On April 2, 2007, NFL Network aired , the 1968 New York Jets, with team commentary from Joe Namath, Gerry Philbin and Don Maynard, and narrated by Alec Baldwin.", "On May 21, Sonny Werblin sold his shares in the Jets to his partners Don Lillis, Leon Hess, Townsend Martin, and Phil Isselin.", "Lillis became the president on May 21, but died on July 23, and Isselin was appointed president on August 6." ] ], "gold": "The 1968 New York Jets season was the team's most successful season in American Football league history. They won the AFL Eastern Division with an 11\u20133 record, defeated the defending champion Oakland Raiders in the AFL championship game, and earned the right to play in Super Bowl III against the NFL champion Baltimore Colts. In a stunning upset, marked by fourth-year quarterback Joe Namath's famous \"guarantee\" of victory, the Jets defeated the heavily favored Colts 16\u20137 on January 12, 1969. This was the last time the Jets made it to a Super Bowl and makes them, along with the New Orleans Saints, as the only teams to have been to just one Super Bowl and win it.", "prediction 1": "The New York Jets have yet to return to the Super Bowl and makes them along with the New Orleans Saints and the Tampa Bay Buccaneers the only teams to have been to just one Super Bowl and win it. The team had the most successful season in franchise history. However, the last time they did was in 1988.", "prediction 2": "The last time the Jets won a Super Bowl was on February 7, 1968. The team had the most successful season in franchise history and defeated the defending champion Oakland Raiders in the AFL championship game, and earned the right to play in Super Bowl III against the NFL champion Baltimore Colts. In a stunning upset, marked by fourth-year quarterback Joe Namath's famous \"guarantee of victory,\" the Jets defeated the heavily favored Colts 16\u20137.", "prediction 3": "The 1968 New York Jets season was the ninth season for the team in the American Football League. The team had the most successful season in franchise history. They defeated the defending champion Oakland Raiders in the AFL championship game, and earned the right to play in Super Bowl III against the NFL champion Baltimore Colts. In a stunning upset, marked by fourth-year quarterback Joe Namath's famous \"guarantee of victory\", the Jets defeated the heavily favored Colts 16\u20137.", "prediction 4": "The New York Jets last won a Super Bowl in 1968. They were in the AFL Eastern Division.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 258, "end": 302 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The 1968 New York Jets season was the team's most successful season in American Football league history. They won the AFL Eastern Division with an 11\u20133 record, defeated the defending champion Oakland Raiders in the AFL championship game, and earned the right to play in Super Bowl III against the NFL champion Baltimore Colts. In a stunning upset, marked by fourth-year quarterback Joe Namath's famous \"guarantee\" of victory, the Jets defeated the heavily favored Colts 16\u20137 . The New York Jets have yet to return to the Super Bowl and makes them along with the New Orleans Saints and the Tampa Bay Buccaneers the only teams to have been to just one Super Bowl and win it. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When was the tenure of office act passed?", "passages": [ [ "Tenure of Office Act (1867)", "Tenure of Office Act (1867)\n\n", "The Tenure of Office Act was a United States federal law (in force from 1867 to 1887) that was intended to restrict the power of the President of the United States to remove certain office-holders without the approval of the Senate.", "The law was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson.", "It purported to deny the president the power to remove any executive officer who had been appointed by the president with the advice and consent of the Senate, unless the Senate approved the removal during the next full session of Congress.", "The act was significantly amended on April 5, 1869.", "Congress repealed the act in its entirety in 1887.", "While evaluating the constitutionality of a similar law in \"Myers v. United States\", the Supreme Court stated that the Tenure of Office Act was likely invalid.", "In the post-Civil War political environment, President Andrew Johnson endorsed the quick re-admission of the Southern secessionist states.", "The two-thirds Republican majorities of both houses of Congress, however, passed laws over Johnson's vetoes, establishing a series of five military districts overseeing newly created state governments." ], [ "Tenure of Office Act (1820)", "Tenure of Office Act (1820)\n\nThe Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States, and purported to be \"An Act to limit the term of office of certain officers therein named, and for other purposes\" The author of the law was Secretary of the Treasury William H. Crawford, which was introduced into the Senate by Mahlon Dickerson of New Jersey.", "The Act imposed tenure limits on officeholders, and insured their removal under certain conditions.", "Congress asserted a right to remove officers, ostensibly to create a blank slate for incoming presidents as well as to weed out poor performers.", "The law encroached on executive authority by replacing the previous powers of the executive.", "(Previously, the president determined tenures for public officers like district attorneys, naval officers, and tax collectors.)", "President James Madison argued that the Four Years' Law of 1820 was unconstitutional because the four-year limit was arbitrary and a precedent that could enable Congress to limit office tenure to as short as a day.", "Though a loss of executive power was feared, these limited terms frequently served to benefit the presidency.", "President Andrew Jackson enforced this law believing a system of rotation in office was a democratic reform and would make civil service responsible to the popular will." ] ], "gold": "The Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States, and purported to be \"An Act to limit the term of office of certain officers therein named, and for other purposes\". Another Tenure of Office Act was a United States federal law (in force from 1867 to 1887) that was intended to restrict the power of the president to remove certain office-holders without the approval of the Senate. The law was enacted on March 2, 1867, over the veto of President Andrew Johnson.", "prediction 1": "The Tenure of Office Act was a United States federal law that was intended to restrict the power of the president to remove certain office-holders without the approval of the Senate. The law was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson. The act was significantly amended on April 5, 1869. Congress repealed the act in its entirety in 1887. Similarly, the Tenure of Office Act of 1820 was passed on May 15, 1820 by the Congress of the United States.", "prediction 2": "The Tenure of Office Act was a United States federal law in force from 1867 to 1887 that was intended to restrict the power of the president of the United States to remove certain office-holders without the approval of the Senate. It was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson. The act was significantly amended on April 5, 1869. Congress repealed the act in its entirety in 1887. The Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States. The Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States.", "prediction 3": "The Tenure of Office Act was a United States federal law, in force from 1867 to 1887, that was intended to restrict the power of the President of the United States to remove certain office-holders without the approval of the Senate. The law was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson. The act was significantly amended on April 5, 1869. Congress repealed the act in its entirety in 1887. The Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States.", "prediction 4": "The Tenure of Office Act was a United States federal law that was in force from 1867 to 1887 that was intended to restrict the power of the president of the United States to remove certain office-holders without the approval of the Senate. The law was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson. It purported to deny the president the power to remove any executive officer who had been appointed by the president with the advice and consent of the Senate, unless the Senate approved the removal during the next full session of Congress. The act was significantly amended on April 5, 1869, and Congress repealed the act in its entirety in 1887.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 320 }, { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 371 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Tenure of Office Act of 1820, also known as the Four Years' Law, was passed on May 15, 1820 by the Congress of the United States, and purported to be \"An Act to limit the term of office of certain officers therein named, and for other purposes\". Another Tenure of Office Act was a United States federal law (in force from 1867 to 1887) that was intended to restrict the power of the president to remove certain office-holders without the approval of the Senate. The law was enacted on March 2, 1867, over the veto of U.S. President Andrew Johnson. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When did the movie top gun come out?", "passages": [ [ "The Final Girls", "The film was one of the festival's opening night films, screening at The Paramount Theatre.", "It then closed the Stanley Film Festival on May 2, 2015, and had a gala premiere at the Los Angeles Film Festival on June 16, 2015.", "The film also later screened at the 2015 Toronto International Film Festival on September 19, 2015, and the Sitges Film Festival on October 12, 2015.", "The film received a video on demand and limited release on October 9, 2015 by Stage 6 Films.", "In April 2016, two special midnight screenings of the film were held at the Sunshine Cinema in New York City, followed by a Q&A with co-star Alia Shawkat and director Todd Strauss-Schulson.", "A panel for the film was held at San Diego Comic-Con on July 23, 2016, with Strauss-Schulson, Fortin, Miller, Middleditch, and Trimbur appearing.", "The film was released straight-to-DVD in the UK on October 12, 2015, Australia on November 5, 2015, Italy on November 11, 2015, Germany on November 12, 2015, and Spain and Japan on December 2, 2015.", "It was released via DVD and Blu-ray in the United States and Canada on November 3, 2015.", "The film had its television premiere on June 26, 2016 on Freeform." ], [ "Top Gun", "The film also boosted Navy recruitment.", "The Navy had recruitment booths in some theaters to attract enthusiastic patrons.", "\"Top Gun\" was re-released in IMAX 3D on February 8, 2013, for six days.", "A four-minute preview of the conversion, featuring the \"Danger Zone\" flight sequence, was screened at the 2012 International Broadcasting Convention in Amsterdam, Netherlands.", "Subsequently, the film was released in Blu-ray 3D on February 19, 2013.", "The film opened in the United States in 1,028 theaters on May 16, 1986.", "It quickly became a success and was the highest-grossing film of 1986.", "It would be six months before its theater count dropped below that of its opening week.", "It was number one on its first weekend with an US$8,193,052 gross, and went on to a total domestic figure of US$176,786,701.", "Internationally it took in an estimated US$177,030,000 for a worldwide box office total of US$353,816,701.", "The film sold an estimated 47,650,100 tickets in North America in its initial theatrical run.", "Upon the film's original release, critical response was mixed.", "Review aggregator Rotten Tomatoes reports that 54% of 54 critics have given the film a positive review, with a rating average of 5.8/10." ], [ "Shine a Light (film)", "\"Shine a Light\" was initially scheduled for release on September 21, 2007, but Paramount Classics postponed it until April 2008.", "The world premiere was at the 58th Berlin International Film Festival on February 7, 2008.", "The film was also screened in some IMAX cinemas.", "The IMAX version of the film was the second IMAX Stones concert film, the first being \"Live at the Max\", released in 1991.", "The MPAA gave the film a PG-13 rating (the film was edited from an R) for brief strong language, drug references, and smoking, and has been released on both DVD and Blu-ray disc by Paramount Home Entertainment, a division of Paramount Pictures.", "Most of the performance footage was culled from the second night of filming.", "All songs are written by Mick Jagger and Keith Richards, except the ones which are noted.", "Additional acoustic instrumental numbers are also played during the closing credits:\n\nNoting Martin Scorsese's frequent use of Rolling Stones music in his scripted films, Mick Jagger has joked that \"Shine a Light\" may be the only Scorsese film that does not include \"Gimme Shelter\" in its soundtrack.", "From Paramount Home Entertainment, \"Shine a Light\" was released on DVD and Blu-ray July 29, 2008.", "The DVD sold 50,115 copies during the first week in the U.S." ] ], "gold": "Top Gun's movie premiere was held in New York City on May 12, 1986. The film then opened in 1,028 theaters in the United States on May 16, 1986. Two years later, on October 21, 1998, the film was first released in the United States on DVD.", "prediction 1": "The film Top Gun came out on May 16, 1986 in 1,028 theaters in the United States. The film also had its world premiere at the 58th Berlin International Film Festival on February 7, 2008. The film's theatrical run ended on June 26, 2016. The film was re-released in IMAX 3D on February 8, 2013, for six days. The film had its television premiere on June 26, 2016 on Freeform.", "prediction 2": "The film Top Gun was initially released in the United States on May 16, 1986. The world premiere was at the 58th Berlin International Film Festival on February 7, 2008. The film was then released on DVD and Blu-ray in the United States and Canada on November 3, 2015. The film had its television premiere on June 26, 2016 on Freeform.", "prediction 3": "The movie Top Gun came out on May 16, 1986, in 1,028 theaters in the United States. It was re-released in IMAX 3D on February 8, 2013, for six days. The film's television premiere was on June 26, 2016 on Freeform. The film's world premiere was at the 58th Berlin International Film Festival on February 7, 2008.", "prediction 4": "The movie Top Gun opened in the United States in 1,028 theaters on May 16, 1986. It quickly became a success and was the highest-grossing film of 1986. It was released on DVD in the United States and Canada on November 3, 2015, and in the United Kingdom on October 12, 2015. Top Gun was re-released in IMAX 3D on February 8, 2013, for six days. The film had its television premiere on June 26, 2016 on Freeform.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 374 } ], "missing-info": [], "corrected-prediction": "The film Top Gun came out on May 16, 1986 in 1,028 theaters in the United States. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "What kind of money is used in the netherlands?", "passages": [ [ "Dutch guilder", "Dutch guilder\n\nThe Dutch guilder (, ) or fl.", "was the currency of the Netherlands from the 17th century until 2002, when it was replaced by the euro.", "Between 1999 and 2002, the guilder was officially a \"national subunit\" of the euro.", "However, physical payments could only be made in guilder, as no euro coins or banknotes were available.", "The Netherlands Antillean guilder is still in use in Cura\u00e7ao and Sint Maarten (two countries in the Kingdom of the Netherlands), but this currency is distinct from the Dutch guilder.", "In 2004, the Surinamese guilder was replaced by the Surinamese dollar.", "The Dutch name \"gulden\" was a Middle Dutch adjective meaning \"golden\", and the name indicates the coin was originally made of gold.", "The symbol \u0192 or fl.", "for the Dutch guilder was derived from another old currency, the florin.", "The exact exchange rate, still relevant for old contracts and for exchange of the old currency for euros at the central bank, is 2.20371 Dutch guilders (NLG) for 1 euro (EUR).", "Inverted, this gives EUR 0.453780 for NLG 1.", "Before the introduction of the first guilder, there were regional and foreign golden coins that were likely referred to as \"\"gulden\"\" in Dutch." ] ], "gold": "The Dutch guilder was the currency of the Netherlands from the 17th century until 2002, when it was replaced by the Euro. The exact exchange rate, still relevant for old contracts and for exchange of the old currency for Euros at the central bank, is 2.20371 Dutch guilders for 1 Euro.", "prediction 1": "The Netherlands guilder is a currency of the Netherlands used from the 17th century until 2002, when it was replaced by the euro. The Dutch name \"gulden\" was a Middle Dutch adjective meaning \"golden\", and the name indicates the coin was originally made of gold. The symbol or fl. for the Dutch guilder was derived from another old currency, the florin.", "prediction 2": "The Dutch guilder was the currency of the Netherlands from the 17th century until 2002, when it was replaced by the euro. Between 1999 and 2002, the guilder was officially a \"national subunit\" of the euro. However, physical payments could only be made in guilder, as no euro coins or banknotes were available. The Netherlands Antillean guilder is still in use in Cura\u00e7ao and Sint Maarten, but this currency is distinct from the Dutch guilder. In 2004, the Surinamese guilder was replaced by the Surinamese dollar.", "prediction 3": "In the Netherlands, the Dutch guilder was the currency from the 17th century until 2002, when it was replaced by the euro. The Netherlands Antillean guilder is still in use in Cura\u00e7ao and Sint Maarten, but this currency is distinct from the Dutch guilder. In 2004, the Surinamese guilder was replaced by the Surinamese dollar.", "prediction 4": "The Dutch guilder or fl. was the currency of the Netherlands from the 17th century until 2002, when it was replaced by the euro. Between 1999 and 2002, the guilder was officially a \"national subunit\" of the euro. However, physical payments could only be made in guilder, as no euro coins or banknotes were available. The Netherlands Antillean guilder is still in use in Cura\u00e7ao and Sint Maarten, but this currency is distinct from the Dutch guilder. In 2004, the Surinamese guilder was replaced by the Surinamese dollar.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 261 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 353 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The Netherlands guilder is a currency of the Netherlands used from the 17th century until 2002, when it was replaced by the euro. The exact exchange rate, still relevant for old contracts and for exchange of the old currency for euros at the central bank, is 2.20371 Dutch guilders (NLG) for 1 euro (EUR)." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Where is diamonds are a girl best friend from?", "passages": [ [ "Gentlemen Prefer Blondes (1953 film)", "Gentlemen Prefer Blondes (1953 film)\n\n", "Gentlemen Prefer Blondes is a 1953 American musical comedy film based on the 1949 stage musical of the same name.", "It was directed by Howard Hawks and stars Jane Russell and Marilyn Monroe, with Charles Coburn, Elliott Reid, Tommy Noonan, George Winslow, Taylor Holmes, and Norma Varden in supporting roles.", "The film is filled with comedic gags and musical numbers, choreographed by Jack Cole, while the music was written by Hoagy Carmichael, Harold Adamson, Jule Styne, and Leo Robin.", "The songs by Styne and Robin are from the Broadway show, while the songs by Carmichael and Adamson were written especially for the film.", "Depsite the film's title, Monroe was paid her usual contract salary of $500 a week, while Russell, the more known and experienced actress of the two, earned $200,000.", "While Russell's down-to-earth, sharp wit has been noted by most critics, it was Monroe's turn as the gold-digging Lorelei Lee for which the film is often remembered." ], [ "Diamonds Are a Girl's Best Friend", "Diamonds Are a Girl's Best Friend\n\n\"Diamonds Are a Girl's Best Friend\" is a jazz song introduced by Carol Channing in the original Broadway production of \"Gentlemen Prefer Blondes\" (1949), which was written by Jule Styne and Leo Robin.", "It was based on a novel by Anita Loos.", "The song is perhaps most famously performed by Marilyn Monroe in the 1953 film \"Gentlemen Prefer Blondes\".", "Monroe's character, Lorelei Lee, has been followed on a Transatlantic ocean liner by a detective hired by her fianc\u00e9's father, who wants assurance that she is not marrying purely for money.", "He is informed of compromising pictures taken with a British diamond mine owner and cancels her letter of credit before she arrives in France, requiring her to work in a nightclub to survive.", "Her fianc\u00e9 arrives at the cabaret to see her perform this song, about exploiting men for riches.", "Diamonds are an element in another story line in the film, in which Lorelei is given a diamond tiara by the mine owner, in gratitude for her recovering the photographs.", "In a later scene, Jane Russell, who played opposite Monroe, sang \"Diamonds Are a Girl's Best Friend\" in court, while pretending to be Lorelei." ], [ "Diamonds Are a Girl's Best Friend", "\", in which it is sung principally by Nicole Kidman in the role of Satine, the (fictional) star performer of the famous Moulin Rouge nightclub in Paris, at the turn of the 20th century.", "This film version is technically a musical adaptation that director Baz Luhrmann titled \"Sparkling Diamonds\".", "Although it consists almost entirely of an adaptation of \"Diamonds Are a Girl's Best Friend\", this version differs from the lyrics in \"Gentlemen Prefer Blondes\" in several ways.", "For example, it does not include the name Harry Winston in the chant of famous jewelers; rather, Moulin Rouge founder Charles Zidler's name was changed to Harold in the film, so his name replaces Winston's in the song as \"Harry Zidler\".", "Black Starr & Frost-Gorham was known by that name only after 1925, but instead of using their 1875-1925 name of \"Black Starr & Frost\", their name was replaced in the Luhrmann film by nonsense words (understood by many listeners as \"Ross Cole;\" in the 2002 DVD release, the words printed in the text captioning are \"Black Star, Roscor\").", "And the potentially anachronistic line \"help you at the Automat\" was altered in the Luhrmann film to \"help you feed your pussycat.\"" ] ], "gold": "\"Diamonds Are a Girl's Best Friend\" is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes in 1949. An adaptation of the play was made into a musical comedy film with the same name. Actresses Marilyn Monroe and Jane Russell each sing the song at different times in the film. An adaptation of the song entitled, \"Sparkling Diamonds,\" was sung by Nicole Kidman's character, Satine, in the 2001 film, Moulin Rouge.", "prediction 1": "\"Diamonds Are a Girl's Best Friend\" is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes, which was written by Jule Styne and Leo Robin. It was based on a novel by Anita Loos. The 1953 American musical comedy film Gentlemen Prefer Blondes was filmed in the same location as the 1949 stage musical of the same name.", "prediction 2": "Diamonds Are a Girl's Best Friend is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes, which was written by Jule Styne and Leo Robin. It was based on a novel by Anita Loos. This 1953 American musical comedy film is filled with comedic gags and musical numbers, choreographed by Jack Cole, while the music is written by Hoagy Carmichael, Harold Adamson, Jule Styne and Leo Robin. The song is a jazz song from Gentlemen Prefer Blondes, which is a musical adaptation of Diamonds Are a Girl's Best Friend, which is s Are a Girl's Best Friend.", "prediction 3": "Diamonds Are a Girl's Best Friend is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes, which was written by Jule Styne and Leo Robin, and was based on a novel by Anita Loos. It is perhaps most famously performed by Marilyn Monroe in the 1953 American musical comedy film Gentlemen Prefer Blondes. The film version of the song is technically a musical adaptation that director Baz Luhrmann titled Sparkling Diamonds.", "prediction 4": "\"Diamonds Are a Girl's Best Friend\" is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes (1949), which was written by Jule Styne and Leo Robin. It was based on a novel by Anita Loos. It is in the 1953 American musical comedy film Gentlemen Prefer Blondes titled Sparkling Diamonds.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 191 }, { "error type": "Unverifiable", "explanation": "", "start": 231, "end": 369 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Diamonds Are a Girl's Best Friend\" is a jazz song introduced by Carol Channing in the original Broadway production of Gentlemen Prefer Blondes in 1949. Gentlemen Prefer Blondes is a 1953 American musical comedy film based on the 1949 stage musical of the same name. Actresses Marilyn Monroe and Jane Russell each sing the song at different times in the film. An adaptation of the song entitled, \"Sparkling Diamonds,\" was sung by Nicole Kidman's character, Satine, in the film, Moulin Rouge." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Current chief justice of all provinces of pakistan?", "passages": [ [ "Mian Saqib Nisar", "Mian Saqib Nisar\n\nMian Saqib Nisar - (, born 18 January 1954), is the 25th and current Chief Justice of Pakistan, in office since 31 December 2016.", "He has previously served as the Federal Secretary for Law.", "He remains a visiting professor of law at the Punjab University where he provides instructions on constitutional law.", "Ascended as the Justice of the Supreme Court on 18 February 2010, he was elevated as chief justice when Justice Anwar Zaheer Jamali reached his constitutionally set retiring age.", "Saqib Nisar's father was Mian Nisar, an advocate belonged to a Arain family of Lahore.", "He was educated at the Cathedral High School in Lahore where he matriculated and enrolled at Government College University (GCU) where he graduated with a B.A. degree in 1977.", "He later went to attend the Punjab University where he secured LLB in civil law in 1980.", "While being an undergraduate student at the GCU Lahore, he was selected to be a member of the international delegation representing Pakistan in International Youth Conference held in Tripoli in Libya in 1973.", "Soon after his graduation with a law degree, Nisar enrolled as an advocate and began private practice of law at the District Court in 1980.", "In 1982, he was called to the bar at the Punjab Bar Council and was enrolled as an advocate of the Lahore High Court." ], [ "Chief Justice of Pakistan", "Chief Justice of Pakistan\n\nThe Chief Justice of Pakistan (initials as CJP) is the head of the court system of Pakistan (the judicature branch of government) and the chief judge of the Supreme Court of Pakistan.", "The Chief Justice is the senior most of 17 Senior Justices of the Supreme Court of Pakistan.", "From 1947 until 1960, the chief justice and senior justices were known as \"Federal Judge\".", "The Chief Justice is the chief administrative officer of the country's court system and the highest judicial officer- ranking immediately above the Chief Justice of the Federal Shariat Court- and is responsible for supervising federal judicial policies, and conducting judicial business in the Supreme Court.", "Nomination for the appointment of the Chief Justice is made by Prime Minister of Pakistan, and final appointments are confirmed by the President of Pakistan.", "Presiding over the oral arguments before the court, the Chief Justice has significant agenda-setting power over meetings of the Supreme Court.", "In modern tradition, the Chief Justice has the ceremonial duty of administering the oath of office of the President of Pakistan.", "The first Chief Justice was Sir Abdul Rashid.", "The current Chief Justice is Mian Saqib Nisar; incumbent since 31 December 2016.", "Pakistan's longest-serving Chief Justice was Mohammad Haleem for total of 3,205 days.", "The shortest-serving Chief Justice was Muhammad Shahabuddin, who died in office 9 days after taking oath." ], [ "Pakistani state of emergency, 2007", "On 3 December 2007, the federal government issued a notification of removal of three justices of the Supreme Court without any retirement privileges.", "They were Chief Justice Iftikhar Muhammad Chaudhry, Justice Rana Bhagwandas and Justice Khalil-ur-Rehman Ramday.", "On 3 December 2007, the federal government issued another notification that in pursuance to Article 3 of the Oath of Office (Judges) Order, 2007 (Order No. 1 of 2007), 24 judges of the High Courts of Sindh, Punjab and NWFP had ceased to hold office, with effect from 3 November 2007, the day emergency was proclaimed in the country.", "According to the notification twelve justices of Sindh High Court were notified to cease to hold office.", "They were Justice Rahmat Hussain Jafferi, Justice Khilji Arif Hussain, Justice Aamir Hani Muslim, Justice Gulzar Ahmed, Justice Maqbool Baqar, Justice Muhammad Athar Saeed, Justice Faisal Arab, Justice Sajjad Ali Shah, Justice Zafar Ahmed Khan Sherwani, Justice Salman Ansari, Justice Abdul Rashid Kalwar and Justice Arshad Siraj.", "According to the notification ten justices of Lahore High Court were notified to cease to hold office." ] ], "gold": "The current Chief Justice of Pakistan is Gulzar Ahmed, an incumbent since December 21, 2019, following the retirement of the 26th Chief Justice of Pakistan, Asif Saeed Khosa. Previous Chief Justices include the 25th Chief Justice: Mian Saqib Nisar, the 24th Chief Justice: Anwar Zaheer Jamali, and the 23rd Chief Justice: Jawwad S. Khawaja.", "prediction 1": "The Chief Justice of Pakistan is the head of the court system of Pakistan and the chief judge of the Supreme Court of Pakistan. From 1947 until 1960, the chief justice and senior justices were known as \"Federal Judge\". The current chief justice of all provinces of Pakistan is Mian Saqib Nisar, who was appointed on 31 December 2016.", "prediction 2": "The Chief Justice of Pakistan is the head of the court system of Pakistan and the chief judge of the Supreme Court of Pakistan. On 31 December 2016, Mian Saqib Nisar became the 25th and current Chief Justice of all provinces of Pakistan.", "prediction 3": "The Chief Justice of Pakistan is the head of the court system of Pakistan and the chief judge of the Supreme Court of Pakistan. The current chief justice for all provinces of Pakistan is Mian Saqib Nisar, who has been in office since 31 December 2016.", "prediction 4": "The Chief Justice of Pakistan is the head of the court system of Pakistan (the judicature branch of government) and the chief judge of the Supreme Court of Pakistan. The current chief justice for all provinces of Pakistan is Mian Saqib Nisar, who has been in office since 31 December 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 333 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 218 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Mian Saqib Nisar is the 25th and current Chief Justice of Pakistan. The 24th Chief Justice was Anwar Zaheer Jamali." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who struck out the most in a season?", "passages": [ [ "Mark Reynolds (baseball)", "Between 2009 and 2011, he finished with top ten home run totals and at bats per home run rates.", "In 2009, he set the all-time record for most strikeouts among batters in a season.", "He also holds two other of the ten highest single-season strikeout totals (211 and 204), and led the league in strikeouts in four consecutive seasons.", "Born in Pikeville, Kentucky, on August 3, 1983, Reynolds later moved with his family to Virginia Beach, Virginia.", "In 1994 he played for the Virginia Blasters Amateur Athletic Union (AAU) baseball program, where one of his teammates was B. J. Upton.", "Both would eventually join B. J. 's younger brother Justin, David Wright and Ryan Zimmerman on a Hampton Roads-based autumn showcase team called the Mets in 2000.", "The five players, who were all shortstops at the time, rotated among the three positions on the left side and middle of the infield.", "While with the Mets, Reynolds was nicknamed \"Skeletor\" due to his lanky build and \"Forrest Gump\" because of his awkward running style.", "Reynolds was a four-year letterman in baseball, basketball and golf at First Colonial High School, where he graduated in 2001.", "In his three years at the University of Virginia, he was the starting shortstop on the Cavaliers baseball team." ], [ "Nolan Ryan", "Nolan Ryan\n\nLynn Nolan Ryan Jr. (born January 31, 1947), nicknamed The Ryan Express, is a former Major League Baseball (MLB) pitcher and a previous chief executive officer (CEO) of the Texas Rangers.", "He is currently an executive adviser to the owner of the Houston Astros.", "Over a record 27-year baseball career that spanned four decades: 1966, 19681993, Ryan pitched for the New York Mets, California Angels, Houston Astros, and Texas Rangers.", "He was inducted into the Baseball Hall of Fame in 1999.", "Ryan, a hard-throwing, right-handed pitcher, threw pitches that were regularly clocked above 100 miles per hour (161\u00a0km/h).", "He maintained this velocity throughout his career, even into his 40s.", "Ryan was also known to throw a devastating 12\u20136 curveball at exceptional velocity for a breaking ball.", "Ryan had a lifetime winning percentage of .526, and he was an eight-time MLB All-Star.", "His 5,714 career strikeouts is an MLB record by a significant margin.", "He leads the runner-up, Randy Johnson, by 839 strikeouts.", "Similarly, Ryan's 2,795 bases on balls lead second-place Steve Carlton by 962\u2014walking over 50% more hitters than any other pitcher in MLB history." ], [ "Matt Kilroy", "Matt Kilroy\n\nMatthew Aloysius \"Matches\" Kilroy (June 21, 1866 \u2013 March 2, 1940) was an American left-handed pitcher in Major League Baseball.", "In 1886, he had 513 strikeouts, which remains the MLB single-season record.", "Kilroy was born in Philadelphia in 1866.", "He was one of 13 children of Mary Ann and Patrick Kilroy.", "He started his professional baseball career with the Southern League's Augusta Browns in 1885.", "That season, he pitched 447 innings and had a win\u2013loss record of 29\u201322 with a 0.97 earned run average and 363 strikeouts.", "Kilroy starred as an MLB rookie during the season for the last-place Baltimore Orioles.", "He started 68 games, completing 66 of them while throwing 583 innings.", "Although he had a disappointing record of 29 wins and 34 losses, he set a mark that was unequalled in major league pitching.", "Kilroy struck out 513 batters that season, the most ever in a single season and far ahead of second-place Charles \"Old Hoss\" Radbourn's total of 441 in ." ], [ "2015 St. Louis Cardinals season", "In the MLB Draft, the Cardinals selected outfielder Nick Plummer with the 23rd overall and team's number-one pick from Brother Rice High School in Michigan.", "In a June 12 start against the Royals, Jaime Garc\u00eda netted his 500th career strikeout by getting Omar Infante as the Cardinals won 4\u20130.", "It was Garc\u00eda's 102nd career start; he had also not issued a walk in his first 30 IP of the season.", "Lyons, whom the Cardinals recalled from Memphis to take the place of an injured Lance Lynn on June 13, stopped a winless streak of 13 MLB starts by pitching a 3\u20132 victory over the Royals.", "He struck out five in six innings.", "Closer Trevor Rosenthal strung together a scoreless inning streak while saving his NL-leading 21st game of the season.", "The Cardinals' first back-to-back home runs of the season occurred on June 15 against the Twins, which Molina and Reynolds accomplished.", "It was Molina's first home run of the season and first in 95 games, dating back to June 27, 2014.", "The Cardinals' previous back-to-back home runs occurred when Holliday and Grichuk delivered against the Reds on September 19, 2014." ] ], "gold": "American left-handed pitcher Matt Kilroy holds the MLB record for the most single-season strikeouts, with 513 strikeouts in 1886. American baseball player Nolan Ryan, who pitched for the New York Mets, California Angels, Houston Astros, and Texas Rangers struck out the most batters in a season in MLB live-ball era. Ryan achieved a career of 5,714 strikeouts, which is an MLB record by a significant margin. In contrast, Mark Reynolds set the all-time record for most strikeouts among batters in a season in 2009 and as of 2018, has had 1,870 career strikeouts.", "prediction 1": "Mark Reynolds, a former Major League Baseball pitcher, holds the record for the most strikeouts among batters in a season with 211. Nolan Ryan, a former Major League Baseball pitcher, holds the record for the most strikeouts among batters in a season with 204. Matt Kilroy, an American left-handed pitcher in Major League Baseball, struck out the most batters in a season with 513 in 1886.\n", "prediction 2": "Mark Reynolds holds the record for most strikeouts among batters in a season. He also holds two other of the ten highest single-season strikeout totals, 211 and 204. Matt Kilroy and Steve Carlton both set the record for the most strikeouts in a season in 2018. Jeter was the American pitcher with the most strikeouts in a season in 1926.", "prediction 3": "There are several blogs that claim to own the record for most strikeouts in a season. For instance, on June 2, 2007, Evan Longoria, an American professional baseball player, hit a career-high 514 strikeouts, while Matt Kilroy and Dave Lyons set the record for most strikeouts between the two at 513.", "prediction 4": "The individual who struck out the most batters in a given season is named Matt Kilroy, with his 513 strikeout total in 1886 being the prior record. In 2009, Mark Reynolds, 154, broke the record for most strikeouts among batters in a given season. Nolan Ryan, Jr, who moved to the Houston Astros in 2017, set the record for most strikeouts among batters in a season, giving Reynolds a total of 5,714 strikeouts in his MLB career, trailing only Randy Johnson with his record of 839. Randy Johnson holds the record with 1,693 strikeouts, with 514.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 55, "end": 131 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 184, "end": 260 }, { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 54 } ], "missing-info": [], "corrected-prediction": "Mark Reynolds, set the record for the most strikeouts among batters in a season in 2009. Nolan Ryan, a former Major League Baseball pitcher, holds the record for the most career strikeouts with 5,174. Matt Kilroy, an American left-handed pitcher in Major League Baseball, struck out the most batters in a season with 513 in 1886.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where was the movie safe haven filmed at?", "passages": [ [ "Wilmington, North Carolina", "Located on the Cape Fear River, which flows into the Atlantic Ocean, Wilmington is a sizable seaport, including private marine terminals and the North Carolina State Ports Authority's Port of Wilmington.", "Wilmington is home to the Greater Wilmington Chamber of Commerce, the oldest Chamber in North Carolina, organized in 1853.", "Companies with their headquarters in Wilmington include Live Oak Bank and HomeInsurance.com.", "According to the City's 2014 Comprehensive Annual Financial Report, the top employers in the city are:\n\n\nPublic Schools in Wilmington are operated by the New Hanover County School System.", "The city supports a very active calendar with its showcase theater, Thalian Hall, hosting about 250 events annually.", "The complex has been in continuous operation since it opened in 1858 and houses three performance venues, the Main Stage, the Grand Ballroom, and the Studio Theater.", "The Hannah Block Historic USO/Community Arts Center, 120 S. Second Street in historic downtown Wilmington, is a multiuse facility owned by the City of Wilmington and managed by the Thalian Association, the Official Community Theater of North Carolina.", "Here, five studios are available to nonprofit organizations for theatrical performances, rehearsals, musicals, recitals and art classes.", "For more than half a century, the Hannah Block Historic USO Building has facilitated the coming together of generations, providing children with programs that challenge them creatively, and enhance the quality of life for residents throughout the region." ], [ "Southport, North Carolina", "Southport, North Carolina\n\nSouthport is a city in Brunswick County, North Carolina, United States, near the mouth of the Cape Fear River.", "Its estimated population was 3,625 as of 2016.", "Southport has been a popular filming location for television and movies, including film adaptations of the works of novelist Nicholas Sparks.", "The town can be seen in the television series \"Dawson's Creek\", \"Under the Dome\", Revenge, and \"Matlock\", and in numerous movies, including \"I Know What You Did Last Summer\", \"Summer Catch\", \"Domestic Disturbance\", \"Crimes of the Heart\", \"Nights in Rodanthe\", \"A Walk to Remember\" and \"Safe Haven\".", "Southport is the location of the North Carolina Fourth of July Festival, which attracts 40,000 to 50,000 visitors annually.", "The Southport area was explored as early as the 1500s by Spanish explorers.", "During the 18th century, British settlements along the Carolina coast lacked fortifications to protect against pirates and privateers, and numerous Spanish attackers exploited this weakness.", "In response to these attacks, Governor Gabriel Johnston in 1744 appointed a committee to select the best location to construct a fort for the defense of the Cape Fear River region.", "It was determined that the fort should be constructed at a site at the mouth of the Cape Fear River." ], [ "Wilmington, North Carolina", "Movies shot in Wilmington include Maximum Overdrive (1986), \"Crimes of the Heart\" (1986), \"Year of the Dragon\" (1985), \"Blue Velvet\" (1986), \"King Kong Lives\" (1986), \"Hiding Out\" (1987), \"Raw Deal\" (1986), \"Track 29\" (1988), \"Weeds\" (1987), \"Teenage Mutant Ninja Turtles\" (1990), Silver Bullet (1985) and Firestarter (1984).", "Since 1995, Wilmington hosts an annual, nationally recognized, independent film festival, the \"Cucalorus\".", "It is the keystone event of The Cucalorus Film Foundation, a non-profit organization.", "The Foundation also sponsors weekly screenings, several short documentary projects, and the annual Kids Festival, with hands on film-making workshops.", "The Cape Fear Independent Film Network also hosts a film festival annually.", "In 2014, governor Pat McCrory decided not to renew the film incentives which ended up taking a massive toll on not just Wilmington's but North Carolina's entire film industry.", "As a result, most productions and film businesses moved to Atlanta, GA.", "As of 2017, there have been attempts to bring the industry back to North Carolina via the North Carolina Film and Entertainment Grant.", "This grant designates $31 million per fiscal year (Jul 1-Jun 30) in film incentives." ], [ "Safe Haven (film)", "Safe Haven (film)\n\nSafe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Josh Duhamel and Cobie Smulders.", "It was released theatrically in North America on February 14, 2013.", "The film was directed by Lasse Hallstr\u00f6m, and is an adaptation of Nicholas Sparks' 2010 novel of the same name.", "The film was originally set for a February 8 release.", "A terrified woman, Katie, flees her house in Boston, having been in the possession of a bloody knife.", "After taking shelter with a neighbor, she is at the bus station trying to flee town.", "She buys a bus ticket with her hair now cropped and bleached and stops in the small town of Southport, North Carolina.", "At the general store, she introduces herself as Katie Feldman.", "After getting a job as a waitress, and renting a small house on the edge of town, Katie befriends her neighbor, Jo.", "She meets Alex Wheatley, a widowed father of two young children, Josh, who has a strained relationship with him, and Lexie, who operates the local general store.", "Alex soon gives Katie a bicycle so she won't have to walk.", "It's not too long before Katie and Alex start a relationship, and she becomes like a mother to Josh and Lexie." ], [ "Safe Haven (film)", "This means that Jo was Carly, in the form of an angel, who led Katie to her husband, Alex.", "According to a 2012 Twitch Film article, Keira Knightley had entered into \"early talks\" to play Katie, but had to drop out due to scheduling conflicts with the 2013 film \"Begin Again\".", "The film began principal photography on June 18, 2012 in Wilmington and Southport, North Carolina.", "Parts of it were filmed in Louisiana and the opening scene with Katie on the Coach America bus is on the Linn Cove Viaduct along the Blue Ridge Parkway near Grandfather Mountain in Linville, North Carolina.", "\"Safe Haven\" grossed US$71,349,120 in North America and US$26,245,020 in other territories for a worldwide total of US$97,594,140.", "In its opening weekend, the film grossed US$21,401,594, finishing third at the box office behind \"A Good Day to Die Hard\" (US$24,834,845) and \"Identity Thief\" (US$23,674,295).", "Critical reaction for \"Safe Haven\" was largely negative." ] ], "gold": "Safe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Marc \u201cKen\u201d Anthony and Cobie Smulders. The film began principal photography on June 18, 2012 in Wilmington and Southport, North Carolina. Parts of it were filmed in Louisiana and the opening scene with Katie on the Coach America bus is on the Linn Cove Viaduct along the Blue Ridge Parkway near Grandfather Mountain in Linville, North Carolina.", "prediction 1": "Safe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Josh Duhamel and Cobie Smulders. The movie was filmed in Wilmington, North Carolina. The film was filmed in Southport, North Carolina.\n", "prediction 2": "Safe Haven is a 2013 American romantic drama fantasy thriller film that was shot in Wilmington, North Carolina. With a backdrop of the Cape Fear River, the film was filmed in Southport, North Carolina.", "prediction 3": "Safe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Josh Duhamel and Cobie Smulders. The movie was filmed in Wilmington and Southport, NC, United States, near the mouth of the Cape Fear River.", "prediction 4": "Safe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Josh Duhamel and Cobie Smulders. The movie was shot in the city of Wilmington, North Carolina. Other movies shot in North Carolina include Maximum Overdrive, Crimes of the Heart, Sandlot, Year of the Dragon, Blue Velvet, King Kong Lives, Hidden Out, Track 29, Weeds, Teenage Mutant Ninja Turtles: A Brief History, and A Walk to Remember.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The movie was filmed in Wilmington, North Carolina. ", "start": 177, "end": 227 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 4 ] } ], "corrected-prediction": "Safe Haven is a 2013 American romantic drama fantasy thriller film starring Julianne Hough, Josh Duhamel and Cobie Smulders. The movie began principal photography on June 18, 2012 in Wilmington and Southport, North Carolina. Parts of it were filmed in Louisiana and the opening scene with Katie on the Coach America bus is on the Linn Cove Viaduct along the Blue Ridge Parkway near Grandfather Mountain in Linville, North Carolina." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has the most followers on instagram as of today?", "passages": [ [ "Celebrity branding", "Companies can simply tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click.", "The culture of advertising on Instagram came naturally when businesses realized that celebrities have a direct means of communication to their target demographic.", "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers.", "By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people.", "Many of America's top-earning celebrities Instagram accounts are continually promoting products such as health supplements, vitamins and detox teas.", "These aren't spontaneous proclamations, but rather posts paid for by brands to advertise products to the celebrities' sizable following.", "On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram.", "At the top end of the digital celebrity pay scale some posts can earn around $300,000, especially when Instagram pictures can be easily linked to other social media platforms such as Facebook or Twitter.", "One of the celebrities that is most well known for promoting brands on her Instagram page is Kim Kardashian." ], [ "Celebrity branding", "If a brand or company decides to use celebrity branding to market their product, it is highly probable that they are deciding to attempt to reach the largest assortment of potential consumers possible, rather than reaching a small number of consumers but more frequently \u2013 which is described as frequency (Belch & Belch, 2012).", "An example of the usefulness of a celebrity's reach can be shown in statistics taken from telegraph.co.uk regarding the world's most followed Instagram celebrities.", "The most followed Instagram celebrity is Selena Gomez, with each post that she makes being viewed by all or most of her 145 million followers.", "Cristiano Ronaldo is 2nd, with 144 million followers, and Ariana Grande is 3rd with 116 million followers.", "A direct brand endorsement from one of these celebrities would be significant were they to post a picture with the company's product encouraging their followers to go out and purchase it, and this is on Instagram alone.", "Imagine the effect of a celebrity posting an endorsement across all of their social media, (Facebook, Instagram, Twitter, Snapchat, etc.).", "The reach that an A-list celebrity has possesses the ability to reach millions of potential consumers, and as a result can be an incredibly effective way to boost sales, or at the very least get a brand's name out there in a wider audience than before." ] ], "gold": "The most followed Instagram account of all time is @instagram, which is owned by Instagram.", "prediction 1": "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers. By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people. On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram. The most followed Instagram celebrity is Selena Gomez, with each post that she makes being viewed by all or most of her 145 million followers. Cristiano Ronaldo is 2nd, and Ariana Grande is 3rd with 116 million followers.", "prediction 2": "The person with the most followers on Instagram as of today is Selena Gomez, with each post that she makes being viewed by all or most of her 145 million followers. Cristiano Ronaldo is 2nd with 144 million followers, and Ariana Grande is 3rd with 116 million followers.", "prediction 3": "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers. By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people. On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram, and at the top end of the digital celebrity pay scale some posts can earn around $300,000 for a post.", "prediction 4": "In 2015, the most popular Instagram account by far is that of Selena Gomez. Cristiano Ronaldo, Jr. has 144 million followers, and Ariana Grande, 16,749,971 followers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 268 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 472 } ], "missing-info": [], "corrected-prediction": "The most followed Instagram celebrity is Selena Gomez, with each post that she makes being viewed by all or most of her 145 million followers. Cristiano Ronaldo is 2nd, and Ariana Grande is 3rd with 116 million followers." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When did the chicago fire soccer team start?", "passages": [ [ "Sports in Chicago", "The club's achievements include: winning the National Soccer League of Chicago; winning 9 titles in Chicago's International League, of which the team was a member 1926\u20131936; and winning the National Challenge Cup twice.", "In the 1950s, the Chicago Falcons operated.", "They won the National Challenge Cup in 1953.", "The \"Chicago Sting\" operated 1974\u20131988.", "The club competed in the \"North American Soccer League\" 1975\u20131984 and the \"Major Indoor Soccer League\" from 1984 until the team's eventual folding.", "The Sting were the only club other than the \"New York Cosmos\" to win multiple titles in the NASL.", "The Chicago Fire, a member of Major League Soccer, have won one MLS Cup and four U.S. Open Cups since they entered the league in 1998.", "The Fire won their sole MLS Cup in 1998, their inaugural season, led by head coach Bob Bradley, who later went on to coach the U.S. national soccer team.", "The Fire have played since 2006 at Toyota Park, a soccer-specific stadium located in the Chicago suburb of Bridgeview near Midway Airport.", "The Fire have historically drawn an attendance average of over 15,000 fans per game.", "The Fire originally played at Soldier Field, also spending parts of two seasons at Cardinal Stadium in Naperville." ], [ "Chicago Fire U-23", "Chicago Fire U-23\n\nChicago Fire U-23 was an American soccer team based in Chicago, Illinois, United States.", "Founded in 2001, the team played in the Premier Development League (PDL), the fourth tier of the American Soccer Pyramid, in the Great Lakes Division of the Central Conference.", "The team played its home games at the artificial turf practice field adjacent to Toyota Park in Bridgeview, Illinois.", "The team's colors were red and white.", "Until 2005 they were known as the Chicago Fire Reserves.", "From the 2008 season, the team was usually referred to as Chicago Fire PDL, although the official name of the team did not change.", "Chicago Fire Reserves entered the PDL in 2001 as part of an effort on the part of MLS franchise Chicago Fire to develop and enhance the level of youth soccer in the Chicago area.", "Playing under the auspices of a professional club gave the Fire an advantage in terms of organization and player talent identification, which has led to them becoming one of the most successful teams in the PDL, winning their divisional title on all but one occasion, in the club's first 8 years, and having many of their players graduate on to the biggest of soccer stages." ], [ "1998 Chicago Fire season", "1998 Chicago Fire season\n\nThe 1998 Chicago Fire season was the Chicago Fire Soccer Club's inaugural season of existence, and their first season in Major League Soccer, the top tier of American soccer.", "The Chicago Fire enjoyed one of the strongest debuts for an expansion club in the history of American soccer and of the North American sports leagues in general.", "The Fire won the double by winning both MLS Cup '98 and the 1998 U.S. Open Cup Final, both in a five-day timespan.", "It was the first time that an expansion franchise in any of the major American sports leagues won the league championship.", "The next time an expansion franchise would reach the championship of their respective sports league would be 20 years later, when the first-year Vegas Golden Knights NHL ice hockey team reached the 2018 Stanley Cup Finals.", "The last professional soccer club to play in the Chicago area was the Chicago Sting, who played in the original NASL from 1974 to 1983, and then in the Major Indoor Soccer League from 1984 to 1988.", "The Sting won two Soccer Bowl championships: in 1981 and again in 1984.", "The Chicago Fire were one of two new MLS expansion teams to join MLS in 1998, and the first two ever expansion teams in league history.", "The other team being the now-defunct, Miami Fusion.", "The Fire were founded on October 8, 1997, on the 126th anniversary of the Great Chicago Fire." ] ], "gold": "The Chicago Fire U-23 American soccer team based in Chicago, Illinois was founded in 2001. The team last played in the PDL, the fourth tier of the American Soccer Pyramid and last played in 2016, choosing to leave the PDL. The Chicago Fire Football Club American professional soccer franchise based in Chicago that was named after the Great Chicago Fire of 1871 was founded October 8, 1997. The team competes in Major League Soccer as a member of the league's Eastern Conference, having moved to the conference in 2002.", "prediction 1": "The Chicago Fire soccer team started playing professionally on October 8, 1997, as one of two new MLS expansion teams to join MLS in 1998, and their first season in Major League Soccer, the top tier of American soccer.", "prediction 2": "The Chicago Fire Soccer Club was founded on October 8, 1997, on the 126th anniversary of the Great Chicago Fire. The team has played in the Premier Development League (PDL) since 2001, playing in the fourth tier of the American Soccer Pyramid, the Great Lakes Division of the Central Conference. The team has won one MLS Cup and four U.S. Open Cups since they entered the league in 1998.", "prediction 3": "The Chicago Fire Soccer Club was founded on October 8, 1997, on the 126th anniversary of the Great Chicago Fire. The team played in the Premier Development League (PDL) from 2001-2014. The team won their sole MLS Cup in 1998, their inaugural season.", "prediction 4": "The Chicago Fire soccer team started playing professional soccer on October 8, 1997, and their inaugural season of existence was in 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 161 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 218 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Chicago Fire U-23 American soccer team based in Chicago, Illinois was founded in 2001 and played in the Premier Development League (PDL). The Chicago Fire soccer team started playing professionally on October 8, 1997 in Major League Soccer." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "The involuntary movement of the bolus through the digestive system is known as?", "passages": [ [ "Swallowing", "4) Movement of the bolus posteriorly\n\nAt the end of the oral preparatory phase, the food bolus has been formed and is ready to be propelled posteriorly into the pharynx.", "In order for anterior to posterior transit of the bolus to occur, orbicularis oris contracts and adducts the lips to form a tight seal of the oral cavity.", "Next, the superior longitudinal muscle elevates the apex of the tongue to make contact with the hard palate and the bolus is propelled to the posterior portion of the oral cavity.", "Once the bolus reaches the palatoglossal arch of the oropharynx, the pharyngeal phase, which is reflex and involuntary, then begins.", "Receptors initiating this reflex are proprioceptive (afferent limb of reflex is IX and efferent limb is the pharyngeal plexus- IX and X).", "They are scattered over the base of the tongue, the palatoglossal and palatopharyngeal arches, the tonsillar fossa, uvula and posterior pharyngeal wall.", "Stimuli from the receptors of this phase then provoke the pharyngeal phase.", "In fact, it has been shown that the swallowing reflex can be initiated entirely by peripheral stimulation of the internal branch of the superior laryngeal nerve." ], [ "Bolus (digestion)", "Bolus (digestion)\n\n", "In digestion, a bolus (from Latin \"bolus\", \"ball\") is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing (which is largely an adaptation for plant-eating mammals).", "It has the same color as the food being eaten, and the saliva gives it an alkaline pH. Under normal circumstances, the bolus is swallowed, and travels down the esophagus to the stomach for digestion.", "Once the bolus reaches the stomach, it mixes with gastric juices and becomes chyme, which then travels through the intestines for further digestion and absorption, and eventual discharge as feces." ], [ "Swallowing", "12) Esophageal peristalsis\n\nLike the pharyngeal phase of swallowing, the esophageal phase of swallowing is under involuntary neuromuscular control.", "However, propagation of the food bolus is significantly slower than in the pharynx.", "The bolus enters the esophagus and is propelled downwards first by striated muscle (recurrent laryngeal, X) then by the smooth muscle (X) at a rate of 3\u20135\u00a0cm/s. The upper esophageal sphincter relaxes to let food pass, after which various striated constrictor muscles of the pharynx as well as peristalsis and relaxation of the lower esophageal sphincter sequentially push the bolus of food through the esophagus into the stomach.", "13) Relaxation phase\n\nFinally the larynx and pharynx move down with the hyoid mostly by elastic recoil.", "Then the larynx and pharynx move down from the hyoid to their relaxed positions by elastic recoil.", "Swallowing therefore depends on coordinated interplay between many various muscles, and although the initial part of swallowing is under voluntary control, once the deglutition process is started, it is quite hard to stop it." ] ], "gold": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing. Once the bolus reaches the palatoglossal arch of the oropharynx the pharyngeal phase, which is reflex and involuntary movement, begins. The involuntary movement of Esophageal peristalsis moves the bolus along the esophagus into the stomach.", "prediction 1": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing. Once the bolus reaches the palatoglossal arch of the oropharynx, the pharyngeal phase, which is reflex and involuntary, then begins. Receptors initiating this reflex are proprioceptive. The esophageal phase of swallowing is under involuntary neuromuscular control.", "prediction 2": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing, and travels down the esophagus to the stomach for digestion. Once the bolus reaches the palatoglossal arch of the oropharynx, the pharyngeal phase, which is reflex and involuntary, then begins. Receptors initiating this phase are proprioceptive and scattered over the base of the tongue, the palatoglossssssssssal arch of the oropharyngeal plexus- IX and pharyngeal plexus- IX and X).", "prediction 3": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing. Involuntary movement of the bolus through the digestive system is called the pharyngeal phase, which is reflex and involuntary, then begins. Receptors initiating this reflex are proprioceptive, while esophageal peristalsis is a phase that occurs in which the pharyngeal wall contracts to produce the esopharynx.", "prediction 4": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing. Once the bolus reaches the palatoglossal arch of the oropharynx, the pharyngeal phase, which is reflex and involuntary, then begins. Receptors initiating this reflex are proprioceptive, and are scattered over the base of the tongue, the palatoglossal and palatopharyngeal plexus, the pharyngeal limb is the pharyngeal plexus- IX and X).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 383 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "In digestion, a bolus is a ball-like mixture of food and saliva that forms in the mouth during the process of chewing. Once the bolus reaches the palatoglossal arch of the oropharynx, the pharyngeal phase, which is reflex and involuntary, then begins. The involuntary movement of Esophageal peristalsis moves the bolus along the esophagus into the stomach." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was the surface mining control and reclamation act written?", "passages": [ [ "Surface Mining Control and Reclamation Act of 1977", "Surface Mining Control and Reclamation Act of 1977\n\nThe Surface Mining Control and Reclamation Act of 1977 (SMCRA) is the primary federal law that regulates the environmental effects of coal mining in the United States.", "SMCRA created two programs: one for regulating active coal mines and a second for reclaiming abandoned mine lands.", "SMCRA also created the Office of Surface Mining, an agency within the Department of the Interior, to promulgate regulations, to fund state regulatory and reclamation efforts, and to ensure consistency among state regulatory programs.", "SMCRA grew out of a concern about the environmental effects of strip mining.", "Coal had been mined in the United States since the 1740s, but surface mining did not become widespread until the 1930s.", "At the end of that decade, states began to enact the first laws regulating the coal mining industry:", "West Virginia in 1939, Indiana in 1941, Illinois in 1943, and Pennsylvania in 1945.", "Despite those laws, the great demand for coal during World War II led to coal being mined with little regard for environmental consequences.", "After the war, states continued to enact and expand regulatory programs, some of which required mining permits or the posting of bonds to ensure that the land could be reclaimed after mining was complete.", "But these state laws were largely unsuccessful at stemming the environmental impacts of surface mining." ], [ "Surface mining reclamation in West Virginia", "Surface mining reclamation in West Virginia\n\nSurface Mining is done all over the United States and this causes growing concerns about the impact on the environment.", "West Virginia is one of the leading coal mining states in the USA and the environmental debate has never been stronger.", "There have been battles fought and protest marches to raise awareness for environmental impacts of coal mining.", "The US government took action and put in place guidelines and restrictions for mining as well as laws to protect the land after mining is completed.", "This was done with the Surface Mining Control and Reclamation Act.", "The impact of this act on the reclaimed land and its uses have made a positive impact, nowhere more so than in West Virginia.", "The Surface Mining Control and Reclamation Act (SMCRA) was approved on August 3, 1977.", "This Act established guidelines for the regulation of surface mining and the reclamation of the mine sites.", "This is enforced under the administration of the Office of Surface Mining, Reclamation and Enforcement, in the Department of the Interior.", "The law establishes minimum requirements uniform for all surface coal mining on Federal and State lands, including exploration activities and the surface effects of underground mining.", "Mine operators are required to minimize disturbances and the adverse impact on fish, wildlife and related environmental elements and maintain the integrity of such resources when possible.", "Restoration of land and water resources is a priority in reclamation planning.", "There are multiple ways that reclaimed land can be used." ] ], "gold": "The Surface Mining Control and Reclamation Act of 1977 (SMCRA) is the primary federal law that regulates the environmental effects of coal mining in the United States. It was introduced to the House on January 31, 1977. The Act was approved on August 3, 1977. This Act established guidelines for the regulation of surface mining and the reclamation of the mine sites.", "prediction 1": "The Surface Mining Control and Reclamation Act of 1977 was approved on August 3, 1977. The act established guidelines for the regulation of surface mining and the reclamation of the mine sites.", "prediction 2": "The Surface Mining Control and Reclamation Act of 1977 was approved on August 3, 1977. The act established guidelines for the regulation of surface mining and the reclamation of the mine sites. This is enforced under the administration of the Office of Surface Mining, Reclamation and Enforcement, in the Department of the Interior.", "prediction 3": "The Surface Mining Control and Reclamation Act of 1977 was approved on August 3, 1977. This law established guidelines for the regulation of surface mining and the reclamation of the mine sites. Mine operators are required to minimize disturbances and the adverse impact on fish, wildlife and related environmental elements.", "prediction 4": "The Surface Mining Control and Reclamation Act of 1977 was approved on August 3, 1977. This act established guidelines for the regulation of surface mining and the reclamation of mine sites.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Surface Mining Control and Reclamation Act of 1977 (SMCRA) is the primary federal law that regulates the environmental effects of coal mining in the United States. The act was approved on August 3, 1977. The act established guidelines for the regulation of surface mining and the reclamation of the mine sites." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "What does the e in heb stand for?", "passages": [ [ "H-E-B", "H-E-B\n\nH-E-B is an American privately held supermarket chain based in San Antonio, Texas, with more than 350 stores throughout the U.S. state of Texas, as well as in northeast Mexico.", "The company also operates Central Market, an upscale organic and fine foods retailer.", "As of 2017, the company has a total revenue surpassing 25 billion.", "H-E-B ranked No. 15 on \"Forbes\" 2014 list of \"America's Largest Private Companies\".", "H-E-B was named Retailer of the Year in 2010 by \"Progressive Grocer\".", "\"Supermarket News\" ranked H-E-B No. 13 in the 2008 \"Top 75 North American Food Retailers\".", "Based on 2014 revenues, H-E-B is the twentieth largest retailer in the United States.", "It donates five percent of pre-tax profits to charity.", "The company was founded on November 26, 1905, when Florence Butt opened the C.C. Butt Grocery Store on the ground floor of her family home in Kerrville, Texas.", "In 1919, Howard Edward Butt, Florence's youngest son, took over the store upon his return from World War I. Shortly after becoming owner of his mother's small store, Howard tried four expansions into Central Texas, including one in Junction, all of which failed." ], [ "Howard Edward Butt Sr.", "Howard Edward Butt Sr.\n\nHoward Edward Butt Sr. (April 9, 1895 \u2013 March 12, 1991) was an American businessman, and CEO of the H-E-B grocery store chain, which was founded by his mother, Florence Thornton Butt, in 1905.", "Butt was youngest of the three sons born to Charles Butt, a pharmacist from Memphis, and Florence Thornton Butt.", "When the family moved to the drier climate of Kerrville, Texas due to his father's tuberculosis and in 1905, his mother opened a small grocery store below their apartment.", "Howard managed the store while in high school and then after graduation, moved to California where he harvested grapes.", "After service in the navy during World War I, he returned to Texas in 1919 to once again manage the family store.", "In 1922, he switched the store from the traditional \"credit-and-delivery\" setup to \"cash-and-carry\" and expanded its lineup from basic groceries to include personal care products.", "His first attempt at expansion - establishing a feed store in Kerrville and three satellite stores in nearby towns - ended in failure.", "In 1926, he tried again and opened a second store in Del Rio, Texas, 150 miles to the southwest along the Rio Grande which was successful." ], [ "Hindu Endowments Board", "Hindu Endowments Board\n\nThe Hindu Endowments Board (Abbreviation: HEB) is a statutory board of the Singapore Government, under the Ministry of Community Development, Youth and Sports (MCYS).", "The Hindu Endowments Board (HEB) manages the Sri Mariamman Temple, Sri Srinivasa Perumal Temple, Sri Sivan Temple and Sri Vairavimada Kaliamman Temples, and also administers two Kindergartens and a half-way house, where substance abusers are rehabilitated.", "HEB\u2019s involvement in community projects spans from free medical counseling services to bringing Deepavali joy to Little India, Singapore through a street light up and trade fair held annually during the festive season.", "Underprivileged Singaporeans in community homes and charities are not forgotten and benefit through Deepavali Cheer, HEB\u2019s annual festive care and share programme.", "HEB is responsible for organizing major Hindu festivals like Thaipusam and Firewalking.", "It also helps other Hindu temples in Singapore on staff matters, religious issues and getting land for relocation of temples.", "HEB actively supports and is involved in inter religious activities and community service projects organized by the various religious groups in Singapore." ] ], "gold": "When referring to HEB of Singapore, or Hindu Endowments Board, the \"E\" stands for endowments. The \"E\" in HEB stands for Euless when referring to HEB cities in Texas or the HEB school district in Texas. The \"E\" in HEB biscuits, which are wheat biscuits containing high-protein cereals and vegetable fat, stands for energy. The \"E\" in HEB bolometer stands for electron, and the \"E\" in HEB supermarket chain in Texas stands for Edward, as the initials of store owner Howard E. Butt became the name of the store.", "prediction 1": "H-E-B is an American privately held supermarket chain based in San Antonio, Texas, with more than 350 stores throughout the U.S. state of Texas, as well as in northeast Mexico. HEB is also the abbreviation of the Hindu Endowments Board, which is a statutory board of the Singapore Government, under the Ministry of Community Development, Youth and Sports.", "prediction 2": "H-E-B stands for Hindu Endowments Board, which is a statutory board of the Singapore Government under the Ministry of Community Development, Youth and Sports. The HEB manages the Sri Mariamman Temple, Sri Srinivasa Perumal Temple, Sri Sivan Temple and Sri Vairavimada Kaliamman Temples, and also administers two kindergartens and a half-way house, where substance abusers are rehabilitated.", "prediction 3": "The e in HEB stands for the Hindu Endowments Board, which is a statutory board of the Singapore Government under the Ministry of Community Development, Youth and Sports. The Hindu Endowments Board manages the Sri Mariamman Temple, Sri Srinivasa Perumal Temple, Sri Sivan Temple and Sri Vairavimada Kaliamman Temples, and also administers two Kindergartens and a half-way house, where substance abusers are rehabilitated. HEB actively supports and is involved in inter religious activities and community service projects organized by various religious groups in Singapore.", "prediction 4": "The H in HEB stands for Hindu Endowments Board, which is a statutory board of the Singapore Government, under the Ministry of Community Development, Youth and Sports (MCYS). The HEB manages the Sri Mariamman Temple, Sri Srinivasa Perumal Temple, Sri Sivan Temple and Sri Vairavimada Kaliamman Temples, as well as administers two kindergartens and a half-way house, where substance abusers are rehabilitated.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 176 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 355 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Howard Edward Butt is CEO of the H-E-B American privately held supermarket chain based in San Antonio, Texas. HEB is also the abbreviation of the Hindu Endowments Board, which is a statutory board of the Singapore Government." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who did the music for the dark knight?", "passages": [ [ "The Dark Knight (soundtrack)", "The nine-minute suite for the Joker (\"Why So Serious\") was based around two notes played by electric cello, solo violin, guitars and a string section.", "Zimmer compared its style to the band Kraftwerk, who come from his native Germany, as well as his work with bands like The Damned.", "Throughout the piece, Zimmer used razor blades on string instruments to achieve the tortured, twisted sound to accompany the character on the screen.", "When Ledger died, Zimmer stated that he felt like scrapping his original material and composing a new theme, but decided that to do so would compromise the \"evil [performance] projects\".", "James Newton Howard composed the \"elegant and beautiful\" themes for Harvey Dent/Two-Face, to work as an aural contrast.", "The heroic brass theme which plays when Batman leaves Ra's al Ghul to die in \"Batman Begins\" makes a reappearance when Batman hurls the Joker off the building in the film's climax.", "It also makes its third and final appearance in \"The Dark Knight Rises\" when Batman fires a missile at Miranda Tate, while her truck driver was killed, sending her and the truck to a crashing halt.", "The cue was released on the two-disc special edition, and can be found on the track, \"We Are Tonight's Entertainment\"." ], [ "The Dark Knight (film)", "The Dark Knight (film)\n\nThe Dark Knight is a 2008 superhero film directed, co-produced, and co-written by Christopher Nolan.", "Based on the DC Comics character Batman, the film is the second part of Nolan's \"The Dark Knight Trilogy\" and a sequel to 2005's \"Batman Begins\", starring an ensemble cast including Christian Bale, Michael Caine, Heath Ledger, Gary Oldman, Aaron Eckhart, Maggie Gyllenhaal and Morgan Freeman.", "In the film, Bruce Wayne / Batman (Bale), Police Lieutenant James Gordon (Oldman) and District Attorney Harvey Dent (Eckhart) form an alliance to dismantle organized crime in Gotham City, but are menaced by an anarchist mastermind known as the Joker (Ledger), who seeks to undermine Batman's influence and turn the city to chaos.", "Nolan's inspiration for the film was the Joker's comic book debut in 1940, the 1988 graphic novel \"\", and the 1996 series \"\", which retold Two-Face's origin.", "The \"Dark Knight\" nickname was first applied to Batman in \"Batman\" #1 (1940), in a story written by Bill Finger.", "\"The Dark Knight\" was filmed primarily in Chicago, as well as in several other locations in the United States, the United Kingdom, and Hong Kong." ], [ "The Dark Knight (soundtrack)", "The Dark Knight (soundtrack)\n\nThe Dark Knight: Original Motion Picture Soundtrack is the soundtrack album to the 2008 film of the same name, which is a sequel to Christopher Nolan's 2005 film \"Batman Begins\".", "The soundtrack was released on July 15, 2008, in three editions: CD, limited edition CD digipak, and digital download.", "The 2-CD Special Edition was released on December 9, 2008, along with the DVD.", "A limited edition 180-gram vinyl LP was released on August 12, 2008.", "The soundtrack was composed by \"Batman Begins\" collaborators Hans Zimmer and James Newton Howard and recorded in April 2008.", "The score won the Grammy Award for Best Score Soundtrack for Visual Media.", "Zimmer originally said the main \"Batman\" theme was purposely introduced at the end of \"Batman Begins\", and would be fleshed out in the sequel as the character develops.", "Zimmer and Howard both believed that creating a heroic theme that a viewer could hum would ignore the complexity and darkness of the character.", "The \"Batman\" theme (audible twice early in the film, once towards the end and a final time at the beginning of the end credits) creates what Zimmer described as a \"red herring\", a kind of musical foreshadowing, which was played by a cello." ] ], "gold": "The Dark Knight is a superhero film based on the DC Comics character Batman, which is the second film in a trilogy by director Christopher Nolan. A Hans Zimmer, James Newton Howard team composed the music for The Dark Night, as well as the first film in the series, Batman Begins. Hans Zimmer also wrote the music for the third film in the trilogy, The Dark Knight Rises, which was made in 2012. There is also a 2000 television series called \"Dark Knight,\" which was based on Sir Walter Scott's novel Ivanhoe, which Mike Jones wrote the music. ", "prediction 1": "Hans Zimmer and James Newton Howard composed the music for The Dark Knight, the 2008 superhero film directed by Christopher Nolan. The music for The Dark Knight: Original Motion Picture Soundtrack is the soundtrack album to the 2008 film of the same name, which is a sequel to Christopher Nolan's 2005 film Batman Begins. The soundtrack was composed by \"Batman Begins\" collaborators Hans Zimmer and James Newton Howard and recorded in April 2008. The score won the Grammy Award for Best Score Soundtrack for Visual Media.", "prediction 2": "The music for the Dark Knight was composed by Hans Zimmer and James Newton Howard. The score won the Grammy Award for Best Score Soundtrack for Visual Media. Zimmer's version of the music for the film was composed by the composers of Batman Begins and The Dark Knight Trilogy.", "prediction 3": "The music for The Dark Knight was composed by Hans Zimmer and James Newton Howard for the 2008 film. The film was directed by Christopher Nolan and based on the DC Comics character Batman. The music was composed by Batman Begins collaborators Zimmer and Howard and recorded in April 2008. The Dark Knight: Original Motion Picture Soundtrack was the soundtrack album to the 2008 superhero film of the same name, which is a sequel to Christopher Nolan's 2005 film Batman Begins.", "prediction 4": "The music for The Dark Knight was composed by Hans Zimmer and James Newton Howard for the 2005 Batman movie Batman Begins. The score won the Grammy Award for Best Score Soundtrack for Visual Media for a Motion Picture. The Dark Knight Soundtrack was released in three editions: CD, limited edition CD digipak, and digital download, and a limited edition 180-gram vinyl LP was released on August 12, 2008. The music for the 2008 Batman movie was composed by Christopher Nolan and James Newton Howard for the 2008 Batman film The Dark Knight: Original Motion Picture Soundtrack.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 321 }, { "error type": "Irrelevant", "explanation": "", "start": 419, "end": 446 }, { "error type": "Irrelevant", "explanation": "", "start": 447, "end": 521 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Hans Zimmer and James Newton Howard composed the music for The Dark Knight, the 2008 superhero film, based on the DC Comics character Batman, and directed by Christopher Nolan. The soundtrack was composed by \"Batman Begins\" collaborators Hans Zimmer and James Newton Howard." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who has the most formula 1 world championships?", "passages": [ [ "Formula One", "This increased financial burdens, combined with the dominance of four teams (largely funded by big car manufacturers such as Mercedes-Benz), caused the poorer independent teams to struggle not only to remain competitive, but to stay in business, and forced several teams to withdraw.", "Since , twenty-eight teams have withdrawn from Formula One.", "This has prompted former Jordan owner Eddie Jordan to say that the days of competitive privateers are over.", "Michael Schumacher and Ferrari won five consecutive Drivers' Championships (2000\u20132004) and six consecutive Constructors' Championships (1999\u20132004).", "Schumacher set many new records, including those for Grand Prix wins (91), wins in a season (thirteen of eighteen), and most Drivers' Championships (seven).", "Schumacher's championship streak ended on 25 September 2005, when Renault driver Fernando Alonso became Formula One's youngest champion at that time, until Lewis Hamilton in .", "During 2006, Renault and Alonso won both titles again.", "Schumacher retired at the end of 2006 after sixteen years in Formula One, but came out of retirement for the 2010 season, racing for the newly formed Mercedes works team, following the rebrand of Brawn GP.", "During this period, the championship rules were changed frequently by the FIA with the intention of improving the on-track action and cutting costs." ], [ "Emilia-Romagna", "Included in the table below are all sides in the top three tiers of Italian football (Serie A, Serie B and Lega Pro), as well as any sides that have won major honours.", "Ferrari's motor sport division Scuderia Ferrari is also run out of Maranello in the Province of Modena, the teams' colours being red.", "Ferrari's Formula One team has won 15 Drivers' titles and 16 Constructors' titles.", "The team has also won multiple Le Mans 24 Hours in sportscar racing.", "The most successful Ferrari driver is German racer Michael Schumacher won five consecutive Formula One titles between and with Ferrari, being the first Formula One driver to achieve that milestone.", "Among other legendary Ferrari drivers include pre-Formula One era Tazio Nuvolari, and in the Formula One era Alberto Ascari, Juan Manuel Fangio, John Surtees, Niki Lauda and Kimi R\u00e4ikk\u00f6nen include among drivers to have won the title in a Ferrari car.", "Ducati Corse is the motorsports division of Ducati's motorcycle company, being the predominant Italian constructor in MotoGP and the Superbike World Championship.", "Ducati has won one MotoGP title with Australian Casey Stoner in 2007.", "Stoner is also the most successful rider for the team in MotoGP, having won 23 Grands Prix in his four seasons." ], [ "Formula One drivers from Germany", "Formula One drivers from Germany\n\nThere have been 52 Formula One drivers from Germany including three world champions, one of whom is currently racing in the sport.", "Michael Schumacher holds many records in F1 including the most world championship titles and the most consecutive titles.", "In 2008 Sebastian Vettel became the youngest ever driver to win a race (which was later broken) and, in 2010, became the youngest world championship winner.", "In 2016, Nico Rosberg became the third driver from Germany to win the F1 World Drivers' Championship.", "There are currently two German race drivers in Formula One.", "Since the first season in 1950 Germany has produced three F1 World Drivers' Champions.", "The first title did not come until 1994 when Michael Schumacher claimed his first of seven championship victories.", "Sebastian Vettel is the second German drivers' champion, winning back-to-back titles in 2010, 2011, 2012 and 2013.", "Nico Rosberg is the third German drivers' champion, winning the title in 2016.", "Wolfgang von Trips was leading the championship in at the time of his fatal accident, and finished 2nd in the standings, just 1 point behind eventual champion Phill Hill.", "There have been seven race winners from Germany, with Michael Schumacher having by far the most victories.", "Vettel has wins to date.", "Ralf Schumacher won six Grands Prix and Heinz-Harald Frentzen won three." ] ], "gold": "There are two kinds of Formula One World Champions, a racing driver and an automobile constructor. Michael Schumacher of the United Kingdom has won the most Formula One World Drivers' Championships. Scuderia Ferrari has been awarded the most Formula One World Constructors' Championships, and team Scuderia Ferrari has also provided the most Formula One World Driver's Champions. The United Kingdom is home to the most Formula One World Constructors' Championships.", "prediction 1": "Michael Schumacher has the most world championships, with seven in total, and Sebastian Vettel holds the record for the most consecutive championships. Ralf Schumacher has won the most races, with six in total, and Heinz-Harald Frentzen has won three.", "prediction 2": "There have been 52 Formula One drivers from Germany. Michael Schumacher holds the record for most world championship titles and most consecutive championships, as well as for most races won and most consecutive championships. Sebastian Vettel and Nico Rosberg are the two German race drivers who have won the most FIA World Drivers' Championships. Ralf Schumacher has the most races won, with six wins to date.", "prediction 3": "Michael Schumacher holds many records in Formula One including the most world championship titles and the most consecutive titles. Sebastian Vettel has won back-to-back championships in 2010, 2011 and 2013, while Nico Rosberg is the third German driver to win the World Drivers' Championship. There have been seven race winners from Germany, with Michael Schumacher having by far the most victories. Ralf Schumacher has won six Grands Prix and Heinz-Harald Frentzen won three.", "prediction 4": "There have been 52 Formula One drivers from Germany including three world champions, one of whom is currently racing in the sport. Michael Schumacher has the most world championship titles and the most consecutive titles. Sebastian Vettel has the most drivers' championships, with seven wins to his name, while Ralf Schumacher has the most wins to date.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 78, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 251 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Michael Schumacher has the most F1 World Drivers' Champions. Ferrari's, motor sport division Scuderia Ferrari's, Formula One team has won 15 Drivers' titles and 16 Constructors' titles." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "What is it called when you say the father the son and the holy spirit?", "passages": [ [ "Minuscule 418", "Aland placed it in Category V.\n\n", "In Matthew 6:13 it has doxology in the Lord's Prayer in this version: \n\n\u1f45\u03c4\u03b9 \u03c3\u03bf\u1fe6 \u1f10\u03c3\u03c4\u03b9\u03bd \u1f21 \u03b2\u03b1\u03c3\u03b9\u03bb\u03b5\u03af\u03b1 \u03ba\u03b1\u1f76 \u1f21 \u03b4\u03cd\u03bd\u03b1\u03bc\u03b9\u03c2 \u03ba\u03b1\u1f76 \u1f21 \u03b4\u03cc\u03be\u03b1, \u03c4\u03bf\u1fe6 \u03c0\u03b1\u03c4\u03c1\u1f78\u03c2 \u03ba\u03b1\u1f76 \u03c4\u03bf\u1fe6 \u03c5\u1f31\u03bf\u1fe6 \u03ba\u03b1\u1f76 \u03c4\u03bf\u1fe6 \u1f01\u03b3\u03af\u03bf\u03c5 \u03c0\u03bd\u03b5\u03cd\u03bc\u03b1\u03c4\u03bf\u03c2 \u03b5\u1f30\u03c2 \u03c4\u03bf\u1f7a\u03c2 \u03b1\u1f30\u1ff6\u03bd\u03b1\u03c2.", "\u1f00\u03bc\u03ae\u03bd (\"For thine is the kingdom and the power and the glory, of the Father and of the Son and of the Holy Spirit for ever.", "Amen.\")", "This ending appears in only two other manuscripts: 157 and 225.", "The manuscript was added to the list of New Testament manuscripts by Scholz (1794-1852).", "C. R. Gregory saw it in 1886.", "The manuscript is currently housed at the Biblioteca Marciana (Gr. I. 28) in Venice." ], [ "Trinitarian formula", "Although LDS members baptize with the same Trinitarian formula, they reject the Nicene Trinitarian conception and regard the three Persons of the Trinity as being distinct personages united not in substance, but in dominion and purpose.", "Other faiths (Frankists, Oneness Pentecostals and Branhamists in particular) use the formula \"In the name of Jesus Christ\" (based on Acts 2:38) for baptism, and in turn re-baptize converts who were first baptized under the Trinitarian formula, sometimes claiming that such persons would not have been previously aware that \"Jesus is the Lord\".", "Likewise, converts to Trinitarian denominations from Mormonism and other nontrinitarian denominations have to be baptized in the name of the (Nicene) Trinity.", "Together with baptism, the Trinitarian formula is used in other prayers, rites, liturgies, and sacraments.", "One of its most common uses apart from baptism is when Roman Catholics, Eastern and Oriental Orthodox, Anglicans, Lutherans, Methodists, and others make the sign of the cross while reciting the formula.", "Some scholars of the Greek New Testament and of the historical Jesus, both liberal and conservative, regard the trinitarian formula as an early Christian elaboration." ] ], "gold": "The Trinitarian formula is the phrase \"in the name of the Father, and of the Son, and of the Holy Spirit,\" referring to the three persons of the Christian Trinity. It is often followed by an \"amen.\" The Trinitarian formula is used in baptism as well as in numerous prayers, rites, liturgies, and sacraments. One of its most common uses apart from baptism is when Roman Catholics, Eastern and Oriental Orthodox, Lutherans, Anglicans, Methodists, and others make the sign of the cross while reciting the formula.", "prediction 1": "Minuscule 418 is a manuscript that is derived from the Greek New Testament and has doxology in the Lord's Prayer in this version: , . (\"For thine is the kingdom and the power and the glory, of the Father and of the Son and of the Holy Spirit for ever. Amen. Amen.\") This ending appears in only two other manuscripts: 157 and 225.", "prediction 2": "There are a number of different endings for the Trinitarian formula. Minuscule 418 is often used in the Lord's Prayer. The ending \"For thine is the kingdom and the power and the glory, of the Father and of the Son and of the Holy Spirit for ever\" appears only in the three Trinitarian formulas.", "prediction 3": "Together with baptism, the Trinitarian formula is used in other prayers, rites, liturgies, and sacraments. One of its most common uses apart from baptism is when Roman Catholics, Eastern and Oriental Orthodox, Anglicans, Lutherans, and others make the sign of the cross while reciting the formula.", "prediction 4": "The Trinitarian formula is used in other prayers, rites, liturgies, and sacraments. Together with baptism, the Trinitarian formula is used in other prayers, rites, liturgies, and sacraments. One of its most common uses apart from baptism is when Roman Catholics, Eastern and Oriental Orthodox, Anglicans, Lutherans, Methodists, and others make the sign of the cross while reciting the formula.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 349 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Trinitarian formula is used in baptism as well as in numerous prayers, rites, liturgies, and sacraments. One of its most common uses apart from baptism is when Roman Catholics, Eastern and Oriental Orthodox, Lutherans, Anglicans, Methodists, and others make the sign of the cross while reciting the formula." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Qbasic is the extension of which programming language?", "passages": [ [ "QBasic", "QBasic\n\nQBasic, a short form of Quick Beginners All purpose Symbolic Instruction Code, is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC.", "Code entered into the IDE (integrated development environment) is compiled to an intermediate representation(IR), and this IR is immediately interpreted on demand within the IDE.", "It can run under nearly all versions of DOS and 32-bit versions of Windows, or through emulation via DOSBox/DOSEMU on Linux, FreeBSD, and 64-bit versions of Windows.", "(QBasic is a DOS program and requires DOS or a DOS emulator.", "Windows XP comes with an emulator called DOS Virtual Machine, subsequent versions of Windows require an emulator such as DosBox.)", "For its time, QBasic provided a state-of-the-art IDE, including a debugger with features such as on-the-fly expression evaluation and code modification.", "It supports various inbuilt functions.", "Like QuickBASIC, but unlike earlier versions of Microsoft BASIC, QBasic is a structured programming language, supporting constructs such as subroutines.", "Line numbers, a concept often associated with BASIC, are supported for compatibility, but are not considered good form, having been replaced by descriptive line labels." ], [ "QBasic", "QBasic has limited support for user-defined data types (structures), and several primitive types used to contain strings of text or numeric data.", "QBasic was intended as a replacement for GW-BASIC.", "It was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements.", "Version 1.0 was shipped together with MS-DOS 5.0 and higher, as well as Windows 95, Windows NT 3.x, and Windows NT 4.0.", "IBM recompiled QBasic and included it in PC DOS 5.x, as well as OS/2 2.0 onwards.", "eComStation, descended from OS/2 code, includes QBasic 1.0 .", "QBasic 1.1 is included with MS-DOS 6.x, and, without codice_1, in Windows 95, Windows 98 and Windows Me.", "Starting with Windows 2000, Microsoft no longer includes QBasic with their operating systems, but can still be obtained for use on newer versions of Windows.", "QBasic (as well as the built-in MS-DOS Editor) is backwards-compatible with DOS releases prior to 5.0 (down to at least DOS 3.20)." ] ], "gold": "QBasic is an integrated development environment and interpreter for a variety of dialects of BASIC which are based on QuickBASIC. Code entered into the IDE is compiled to an intermediate representation, and this IR is immediately interpreted on demand within the IDE. QBasic was intended as a replacement for GW-BASIC. It was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements. ", "prediction 1": "QBasic is a short form of Quick Beginners All purpose Symbolic Instruction Code, and is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC. In the past, QuickBASIC was the base of QBasic, while QBasic was intended as a replacement for GW-BASIC. It was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements.", "prediction 2": "QBasic is a short form of Quick Beginners All purpose Symbolic Instruction Code, it is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC. Like QuickBASIC, but unlike earlier versions of Microsoft BASIC, QBasic is a structured programming language, supporting constructs such as subroutines. Like QuickBASIC, but unlike earlier versions of Microsoft BASIC, QBasic is based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements. It was intended as a replacement for GW-BASIC.", "prediction 3": "QBasic is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC. Code entered into the IDE is compiled to an intermediate representation(IR), and this IR is immediately interpreted on demand within the IDE. It can run under nearly all versions of DOS and 32-bit versions of Windows, or through emulation via DOSBox/DOSEMU on Linux, FreeBSD, and 64-bit versions of Windows. QBasic was intended as a replacement for GW-BASIC. It was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements.", "prediction 4": "QBasic is a short form of Quick Beginners All purpose Symbolic Instruction Code, which is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC. It was intended as a replacement for GW-BASIC and was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements. IBM recompiled QBasic and included it in PC DOS 5.x, as well as OS/2 2.0 onwards. QBasic 1.1 is included with MS-DOS 6.x, and, without codice_1, in Windows 95, Windows 98 and Windows Me.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 12, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "QBasic is an integrated development environment and interpreter for a variety of BASIC programming languages which are based on QuickBASIC. Code entered into the IDE is compiled to an intermediate representation, and this IR is immediately interpreted on demand within the IDE. QBasic was intended as a replacement for GW-BASIC. It was based on the earlier QuickBASIC 4.5 compiler but without QuickBASIC's compiler and linker elements." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where was the first buffalo wild wings located?", "passages": [ [ "Buffalo Wild Wings", "Buffalo Wild Wings\n\nBuffalo Wild Wings (originally Buffalo Wild Wings & Weck, hence the numeronym BW3) is an American casual dining restaurant and sports bar franchise in the United States, Canada, India, Mexico, Oman, Panama, Philippines, Saudi Arabia, United Arab Emirates, and Vietnam which specializes in Buffalo wings and sauces.", "As of June 2017, it had 1,238 locations (625 directly owned by the company, and 612 franchised locations) across all 50 U.S. states and DC.", "An alternate nickname in recent usage by the company is B-Dubs.", "Buffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery.", "Lowery's parents had become Disbrow's guardians as they were his ice skating coaches.", "After Disbrow had finished judging an amateur figure skating competition at Kent State University, the pair met up to get some Buffalo-style chicken wings to eat.", "Failing to find any restaurant serving them, they decided to open their own restaurant serving wings.", "For the first location, they selected a location near Ohio State University, Columbus.", "Weck was an original part of the name, as beyond the wings and its dozen sauces, the restaurant served beef on weck.", "The pair brought on an additional partner, Mark Lutz, within six months after opening." ] ], "gold": "Buffalo Wild Wings is an American casual dining restaurant and sports bar franchise in the United States, Canada, India, Mexico, Oman, Panama, Philippines, Saudi Arabia, United Arab Emirates, and Vietnam which specializes in Buffalo wings and sauces. Buffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery. Lowery's parents had become Disbrow's guardians as they were his ice skating coaches and after Disbrow had finished judging an amateur figure skating competition at Kent State University, the pair met up to get some Buffalo-style chicken wings to eat. Failing to find any restaurant serving them, they decided to open their own restaurant serving wings and for the first location, they selected a location near Ohio State University, Columbus.", "prediction 1": "Buffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery. After Disbrow had finished judging an amateur figure skating competition at Kent State University, the pair met up to get some Buffalo-style chicken wings to eat. Failing to find any restaurant serving them, they decided to open their own restaurant serving wings. For the first location, they selected a location near Ohio State University, Columbus. Weck was an original part of the name, as beyond the wings and its dozen sauces, the restaurant served beef on weck.", "prediction 2": "Buffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery. Failing to find any restaurant serving them, they decided to open their own restaurant serving wings. For the first location, they selected a location near Ohio State University, Columbus. Buffalo Wild Wings & Weck was founded in 1984 in Kent, Ohio.", "prediction 3": "Buffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery, after the pair met up to get some Buffalo-style chicken wings to eat. Failing to find any restaurant serving them, they decided to open their own restaurant serving wings. For the first location, they selected a location near Ohio State University, Columbus. Weck was an original part of the name, as beyond the wings and its dozen sauces, the restaurant served beef on weck.", "prediction 4": "Buffalo Wild Wings is an American casual dining restaurant and sports bar franchise in the United States, Canada, India, Mexico, Oman, Panama, Philippines, Saudi Arabia, United Arab Emirates, and Vietnam which specializes in Buffalo wings and sauces. The first Buffalo Wild Wings was located near Ohio State University, Columbus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 431, "end": 547 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Buffalo Wild Wings is an American casual dining restaurant and sports bar franchise in the United States, Canada, India, Mexico, Oman, Panama, Philippines, Saudi Arabia, United Arab Emirates, and Vietnam which specializes in Buffalo wings and sauces. \nBuffalo Wild Wings & Weck was founded in 1982 by Jim Disbrow and Scott Lowery. Lowery's parents had become Disbrow's guardians as they were his ice skating coaches. After Disbrow had finished judging an amateur figure skating competition at Kent State University, the pair met up to get some Buffalo-style chicken wings to eat. Failing to find any restaurant serving them, they decided to open their own restaurant serving wings. For the first location, they selected a location near Ohio State University, Columbus. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who drove the car over the cliff in thelma and louise?", "passages": [ [ "Thelma & Louise", "Thelma & Louise\n\nThelma & Louise is a 1991 American road film directed by Ridley Scott and written by Callie Khouri.", "It stars Geena Davis as Thelma and Susan Sarandon as Louise, two friends who embark on a road trip with unforeseen consequences.", "The supporting cast include Harvey Keitel, Michael Madsen, and", "Brad Pitt in his first major film role.", "The film became a critical and commercial success, receiving six Academy Award nominations and winning for Best Original Screenplay.", "Scott was nominated for Best Director, and both Sarandon and Davis were nominated for Best Actress.", "At its release, the film stirred controversy.", "At the intersection of several genres, it is now considered a classic.", "It influenced other films and artistic works and became a landmark of feminist film.", "In 2016, the United States Library of Congress selected the film for preservation in the National Film Registry, finding it \"culturally, historically, or aesthetically significant\".", "Best friends Thelma Dickinson and Louise Sawyer set out for a weekend vacation at a fishing cabin in the mountains to take a break from their dreary lives in Arkansas." ], [ "Thelma & Louise", "Thelma and Louise are finally cornered by the authorities only one hundred yards from the edge of the Grand Canyon.", "Hal arrives on the scene, but he is refused the chance to make one last attempt to talk the women into surrendering.", "Rather than be captured and spend the rest of their lives in jail, Thelma proposes that they \"keep going\".", "Louise asks Thelma if she is certain, and Thelma says yes.", "They kiss, Louise steps on the gas, and they accelerate over the cliff.", "Although the setting for the film is a fictional route between Arkansas and the Grand Canyon, it was filmed almost entirely in the states of California and Utah.", "The primary filming locations were rural areas around Bakersfield, California and Moab, Utah.", "The Grand Canyon scenes were actually filmed just south of Dead Horse Point State Park in Utah.", "Parts of the film were also shot at Shafer Overlook, Monument Valley, La Sal Mountains, La Sal Junction, Cisco, Old Valley City Reservoir, Thompson Springs, Arches National Park, and Crescent Junction in Utah.", "The film was screened out of competition at the 1991 Cannes Film Festival.", "The film received critical acclaim.", "Janet Maslin of \"The New York Times\" had only praise for the film in her review:\n\nRoger Ebert also praised the film but withheld a perfect score on the basis of \"the last shot before the titles begin." ], [ "Thelma & Louise", "Thelma, a ditzy housewife, is married to a disrespectful and controlling man, Darryl, while sharp-tongued Louise works as a waitress in a diner and is on\u2013off dating a musician, Jimmy, who spends most of his time on the road.", "On the way, they stop for a drink at a roadhouse bar, where Thelma meets and dances with a flirtatious stranger, Harlan.", "When he takes her outside to the parking lot to get some fresh air, he starts kissing her and taking her clothes off without her consent.", "Thelma resists, but Harlan hits her, and then attempts to rape her.", "Louise finds them and threatens to shoot Harlan with the gun that Thelma brought with her.", "Harlan stops, but, as the women walk away, he yells that he should have continued the rape and continually insults them.", "Enraged, Louise shoots him dead, and the pair flee the scene.", "At a motel, they discuss how to handle the situation.", "Thelma wants to go to the police, but Louise fears that no one will believe Thelma's claim of attempted rape and they will be subsequently charged for murder.", "They decide to go on the run, but Louise insists that they travel from Oklahoma to Mexico without going through Texas." ] ], "gold": "Thelma & Louise is a 1991 American female buddy road crime film, starring Geena Davis as Thelma and Susan Sarandon as Louise, two friends who embark on a road trip that ends up in unforeseen circumstances. In their travels, they end up at a roadhouse bar, where a man attempts to rape Thelma until Louise intervenes and ends up shooting him. They are cornered by the authorities only one hundred yards from the edge of the Grand Canyon, but rather than be captured and spend the rest of their lives in jail or die by execution, Thelma proposes that they \"keep going.\" After Louise is reassured that Thelma is certain, Louise steps on the gas, and drives the car over the cliff.", "prediction 1": "Thelma & Louise is a 1991 American road film starring Geena Davis as Thelma and Susan Sarandon as Louise, two friends who embark on a road trip with unforeseen consequences. Although the setting for the film is a fictional route between Arkansas and the Grand Canyon, it was filmed almost entirely in the states of California and Utah. Hal arrives on the scene, but he is refused the chance to make one last attempt to talk the women into surrendering. Rather than be captured and spend the rest of their lives in jail, Thelma proposes that they \"keep going\".\n", "prediction 2": "The 1991 film Thelma & Louise is an American road film based on the real-life experience of two best friends who embark on a road trip with unforeseen consequences. Although the setting for the film is a fictional route between Arkansas and the Grand Canyon, it was filmed almost entirely in the states of California and Utah. Hal arrives on the scene, but he is refused the chance to make one last attempt to talk the women into surrendering. Rather than be captured and spend the rest of their lives in jail, Thelma proposes to get behind the heroine.", "prediction 3": "Thelma & Louise is a 1991 American road film starring Geena Davis as Thelma and Susan Sarandon as Louise, two best friends who embark on a road trip with unforeseen consequences. Although the setting for the film is a fictional route between Arkansas and the Grand Canyon, it was filmed almost entirely in the states of California and Utah. Hal arrives on the scene, but he is refused the chance to make one last attempt to talk the women into surrendering. Rather than be captured and spend the rest of their lives in jail, they propose to keep going. They kiss, Louise steps on the gas, and they accelerate over the cliff together.", "prediction 4": "In the 1991 American film Thelma & Louise, two best friends, Thelma Dickinson and Louise Sawyer, decide to go on the run together after they say they were unable to perform a dummy rape in front of the guard at the edge of the Grand Canyon. Hal Welch drives the car over the cliff in the film, but is later arrested and committed to a local jail.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 452 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Thelma & Louise is a 1991 American road film starring Geena Davis as Thelma and Susan Sarandon as Louise, two friends who embark on a road trip with unforeseen consequences. On the way, they stop for a drink at a roadhouse bar, where a man attempts to rape Thelma until Louise intervenes and ends up shooting him. Thelma and Louise are finally cornered by the authorities only one hundred yards from the edge of the Grand Canyon. Rather than be captured and spend the rest of their lives in jail, Thelma proposes that they \"keep going\". After Louise is reassured that Thelma is certain, Louise steps on the gas, and drives the car over the cliff.\n" }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who sang blue moon in american werewolf in london?", "passages": [ [ "Blue Moon (1934 song)", "The famous introduction to the song (\"bomp-baba-bomp\" and \"dip-da-dip\") was an excerpt of an original song that the group had in its act.", "The record reached number one on the \"Billboard\" Pop chart for three weeks and number one on the R&B chart.", "It also peaked at on the UK Singles Chart.", "The Marcels' version of \"Blue Moon\" sold a million copies, and was awarded a gold disc.", "It is featured in the \"Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll\".", "The Marcels doo-wop version is one of three different versions used in the 1981 film \"An American Werewolf in London\" with this version appearing at the end credits of the film.", "A version by Bobby Vinton plays during the film's opening titles while a version by Sam Cooke plays during the film's famous werewolf transformation scene.", "The Marcels' version of the song is referenced in the 1962 Academy Award nominated animated short Disney musical film, \"A Symposium on Popular Songs\" during the song, \"Puppy Love Is Here to Stay\" written by Robert & Richard Sherman.", "American country music group the Mavericks covered the song for the soundtrack of the 1995 film \"Apollo 13\".", "Their version peaked at number 57 on the \"RPM\" Country Tracks chart in Canada." ], [ "Blue Moon (1934 song)", "Blue Moon (1934 song)\n\n\"Blue Moon\" is a classic popular song written by Richard Rodgers and Lorenz Hart in 1934, and has become a standard ballad.", "It may be the first instance of the familiar \"50s progression\" in a popular song.", "The song was a hit twice in 1949 with successful recordings in the US by Billy Eckstine and Mel Torm\u00e9.", "In 1961, \"Blue Moon\" became an international number one hit for the doo-wop group The Marcels, on the \"Billboard\" 100 chart and in the UK Singles chart.", "Over the years, \"Blue Moon\" has been covered by various artists including versions by Frank Sinatra, Billie Holiday, Elvis Presley, The Platters, The Mavericks, Dean Martin, The Supremes, Bob Dylan and Rod Stewart.", "Bing Crosby included the song in a medley on his album \"On the Happy Side\" (1962).", "It is also the anthem of English Football League club Crewe Alexandra and English Premier League football club Manchester City, who have both adapted the song slightly.", "In September 2018, documentary producer Liz Roman Gallese wrote that \"Blue Moon\" was composed in January 1931 by her father, Edward W. Roman (1914-1992), at the time the 17-year-old son of Polish immigrants living in Troy, New York." ] ], "gold": "\"Blue Moon\" is a classic popular song written by Richard Rodgers and Lorenz Hart in 1934. The Marcels created a doo-wop version that is one of three different versions used in the 1981 film An American Werewolf in London. The Marcels' version is play in the end credits of the film. A version by Bobby Vinton plays during the film's opening titles, while a version by Sam Cooke plays during the film's famous werewolf transformation scene. ", "prediction 1": "\"Blue Moon\" is a classic popular song written by Richard Rodgers and Lorenz Hart in 1934, and has become a standard ballad. The song was a hit twice in 1949 with successful recordings in the US by Billy Eckstine and Mel Torm\u00e9. In 1961, \"Blue Moon\" became an international number one hit for the doo-wop group The Marcels, on the \"Billboard\" 100 chart and in the UK Singles chart. American country music group the Mavericks also covered the song for the soundtrack of the 1995 film Apollo 13.", "prediction 2": "There are several different versions of the song Blue Moon in the 1981 film American Werewolf in London. In the film, the famous introduction to the song (\"bomp-baba-bomp\" and \"dip-da-dip\") was an excerpt from an original song that the group had in its act. The song was a hit twice in 1949 with successful recordings in the US by Billy Eckstine and Mel Torm\u00e9. The doo-wop group The Marcels sang it in their version of the 1981 film.", "prediction 3": "The American werewolf in London is a 1981 American American horror film directed by Tim Burton. The film features three different versions of the song. The first is sung by Bobby Vinton and the second is sung by Sam Cooke.", "prediction 4": "The song Blue Moon is a classic popular song written by Richard Rodgers and Lorenz Hart in 1934, and has become a standard ballad. In 1961, \"Blue Moon\" became an international number one hit for the doo-wop group The Marcels, on the Billboard 100 chart and in the UK Singles chart. American country music group the Mavericks covered the song for the soundtrack of the 1995 film Apollo 13. Their version peaked at number 57 on the RPM Country Tracks chart in Canada.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 380, "end": 491 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "\"Blue Moon\" is a classic popular song written by Richard Rodgers and Lorenz Hart in 1934. The Marcels doo-wop version is one of three different versions used in the 1981 film \"An American Werewolf in London\" with this version appearing at the end credits of the film. A version by Bobby Vinton plays during the film's opening titles while a version by Sam Cooke plays during the film's famous werewolf transformation scene. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who starred in one flew over the cuckoos nest?", "passages": [ [ "One Flew Over the Cuckoo's Nest (film)", "One Flew Over the Cuckoo's Nest (film)\n\n", "One Flew Over the Cuckoo's Nest is a 1975 American comedy-drama film directed by Milo\u0161 Forman, based on the 1962 novel \"One Flew Over the Cuckoo's Nest\" by Ken Kesey.", "The film stars Jack Nicholson, and features a supporting cast of Louise Fletcher, William Redfield, Will Sampson, and Brad Dourif.", "The film also featured Christopher Lloyd in his film debut.", "Considered by some to be one of the greatest films ever made, \"One Flew Over the Cuckoo's Nest\" is No. 33 on the American Film Institute's 100 Years... 100 Movies list.", "The film was the second to win all five major Academy Awards (Best Picture, Actor in Lead Role, Actress in Lead Role, Director and Screenplay) following \"It Happened One Night\" in 1934, an accomplishment not repeated until 1991 with \"The Silence of the Lambs\".", "It also won numerous Golden Globe and BAFTA Awards.", "In 1993, the film was deemed \"culturally, historically, or aesthetically significant\" by the United States Library of Congress, and selected for preservation in the National Film Registry." ], [ "One Flew Over the Cuckoo's Nest (play)", "One Flew Over the Cuckoo's Nest (play)\n\n", "One Flew Over the Cuckoo's Nest (1963) is a play based on Ken Kesey's 1962 novel of the same name.", "Dale Wasserman's stage adaptation, with music by Teiji Ito, made its Broadway preview on November 12, 1963, its premiere on November 13, and ran until January 25, 1964 for a total of one preview and 82 performances.", "Since then, the play has had two revivals: first off-Broadway in 1971, with Danny DeVito as Martini, then as a Broadway production in 2001 with Gary Sinise as McMurphy.", "The film version \"One Flew Over the Cuckoo's Nest\" was released in 1975 was based on the novel, but not on the play.", "DeVito reprised his stage role in the film.", "The 1963\u201364 Broadway production starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as \"Chief\" Bromden, and Joan Tetzel as Nurse Ratched.", "Douglas retained the rights to make a film version of \"One Flew Over the Cuckoo's Nest\" for a decade, but was unable to find a studio willing to make it with him." ], [ "One Flew Over the Cuckoo's Nest (play)", "Eventually, he gave the rights to his son Michael, who succeeded in getting the film produced.", "At that time, Kirk Douglas was deemed too old for the role of McMurphy, and the role was given to Jack Nicholson.", "In 1982 Greg Hersov directed a production at the Royal Exchange, Manchester with Jonathan Hackett as Randle McMurphy, Linda Marlowe as Nurse Ratched and Tim McInnerny as Billy Bibbitt.", "In April 1988, the Playhouse Theatre was the site for the first London production of \"One Flew Over the Cuckoo's Nest\".", "The play was brought to the London stage by Cuckoo Productions, formed by Diane Hilton, Karin Parnaby, and Judy Kershaw.", "They raised \u00a3100,000 in 24 hours to bring the play to the London theatre.", "In 2001, the Steppenwolf Theatre Company produced a Broadway revival, winning the Tony Award for Best Play Revival.", "This production was directed by Terry Kinney and starred Gary Sinise, Amy Morton, Tim Sampson, Eric Johner, and Ross Lehman.", "In 2004, Guy Masterson and Nica Burns mounted a production at the Edinburgh Fringe Festival with Christian Slater, Mackenzie Crook and Frances Barber and a cast of comedians including Owen O'Neill." ] ], "gold": "There are several productions of \"One Flew Over the Cuckoo's Nest\". The 1963\u201364 Broadway production of \"One Flew Over the Cuckoo's Nest\" starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as \"Chief\" Bromden, and Joan Tetzel as Nurse Ratched. \"One Flew Over the Cuckoo's Nest\" was also a 1975 American comedy-drama film directed by Milo\u0161 Forman that stars Jack Nicholson as Randle McMurphy, a new patient at a mental institution, and features a supporting cast of Louise Fletcher, William Redfield, Will Sampson, Sydney Lassick, Brad Dourif, Danny DeVito and Christopher Lloyd in his film debut. In 1982, Greg Hersov directed a production at the Royal Exchange, Manchester with Jonathan Hackett as Randle McMurphy, Linda Marlowe as Nurse Ratched and Tim McInnerny as Billy Bibbitt. In 2001, the Steppenwolf Theatre Company produced a Broadway revival, winning the Tony Award for Best Play Revival. This production was directed by Terry Kinney and starred Gary Sinise, Amy Morton, Tim Sampson, Eric Johner, and Ross Lehman. In 2004, Guy Masterson and Nica Burns mounted a production at the Edinburgh Fringe Festival with Christian Slater, Mackenzie Crook and Frances Barber and a cast of comedians including Owen O'Neill.", "prediction 1": "One Flew Over the Cuckoo's Nest is a 1975 American comedy-drama film based on the 1962 novel One Flew Over the Cuckoo's Nest by Ken Kesey. Dale Wasserman's stage adaptation starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as Chief Bromden, Joan Tetzel as Nurse Ratched and Jonathan Hackett as Randle McMurphy. In the 2001, Gary Sinise played McMurphy and Eric Johner as Billy Bibbittt.", "prediction 2": "There were several productions of One Flew Over the Cuckoo's Nest. The 1963 Broadway production starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as Chief Bromden, and Joan Tetzel as Nurse Ratched. The 1975 American comedy-drama film version starred Jack Nicholson. The 2001 Broadway revival starred Gary Sinise as McMurphy.", "prediction 3": "There is also a 1975 American comedy-drama film, One Flew Over the Cuckoo's Nest, directed by Milo Forman, based on the 1962 novel One Flew Over the Cuckoo's Nest by Ken Kesey. Jack Nicholson stars as Randle Patrick McMurphy in the film, and in the 1963\u201364 Broadway production, Randle McMurphy plays Kirk Douglas. In 2001, Gary Sinise plays McMurphy in the Broadway revival of the play, and in 2002, Gary Sinise plays Randle McMurphy.", "prediction 4": "In 1963, Dale Wasserman's stage adaptation of One Flew Over the Cuckoo's Nest starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as Chief Bromden, and Joan Tetzel as Nurse Ratched. In 1971, Danny DeVito played Martini in the film adaptation of One Flew Over the Cuckoo's Nest and in 2001, Gary Sinise starred as McMurphy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 172 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "One Flew Over the Cuckoo's Nest is a 1975 American comedy-drama film directed by Milo\u0161 Forman. The film stars Jack Nicholson, and features a supporting cast of Louise Fletcher, William Redfield, Will Sampson, Danny DeVito and Brad Dourif. The film also featured Christopher Lloyd in his film debut. The 1963\u201364 Broadway production starred Kirk Douglas as Randle Patrick McMurphy, Gene Wilder as Billy Bibbit, William Daniels as Harding, Ed Ames as Chief Bromden, Joan Tetzel as Nurse Ratched. In 1982 Greg Hersov directed a production at the Royal Exchange, Manchester with Jonathan Hackett as Randle McMurphy, Linda Marlowe as Nurse Ratched and Tim McInnerny as Billy Bibbitt. In 2001, the Steppenwolf Theatre Company produced a Broadway revival, winning the Tony Award for Best Play Revival. This production was directed by Terry Kinney and starred Gary Sinise, Amy Morton, Tim Sampson, Eric Johner, and Ross Lehman. In 2004, Guy Masterson and Nica Burns mounted a production at the Edinburgh Fringe Festival with Christian Slater, Mackenzie Crook and Frances Barber and a cast of comedians including Owen O'Neill." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When is have and have nots season finale?", "passages": [ [ "The Haves and the Have Nots (TV series)", "Described in her on-air role as a \" villainess,\" she was hailed as \"slowly becoming a household name and gaining a cult-like following from the hit series.\"", "\"The Haves and the Have Nots\" premiered on Tuesday, May 28, 2013, at 9/8c on the Oprah Winfrey Network.", "\"The Haves and the Have Nots\" is the first scripted television series to air on OWN.", "Both the show's first and second episodes aired back to back on its premiere night.", "Each episode of the series runs for an hour (42 minutes plus commercials).", "\"The Haves and the Have Nots\" set a record for OWN, scoring the highest ratings ever for a series premiere on the network.", "During the show's first season, \"The Haves and the Have Nots\" received numerous widely publicized series highs in ratings, including with its July 30 episode, its August 6 episode, its August 13 episode, its August 27 episode, and most notably with its season 1 finale on September 3.", "The season 1 finale of \"The Haves And the Have Nots\" was the third most watched telecast in OWN history, bested only by an interview with Whitney Houston's daughter Bobbi Kristina and episodes of \"Oprah's Next Chapter\" featuring Lance Armstrong." ], [ "Summer Heights High", "The premiere episode of \"Summer Heights High\" did well in the ratings as a strong lead-in from the return of \"The Chaser's War on Everything\".", "It peaked at 1.6\u00a0million viewers (5 capital cities) with an average of 1.22\u00a0million.", "Along with \"Spicks and Specks\", \"Summer Heights High\" helped ABC TV to achieve its strongest midweek ratings for 2007.", "The second episode rated stronger than the premiere with an average of 1.375\u00a0million viewers tuning in.", "The third episode managed to rate very well with 1.275\u00a0million viewers while the fourth episode fared well with 1.235 against the season premiere of \"Prison Break\".", "The fifth episode only managed 1.156\u00a0million viewers, the lowest ratings for an episode of the show, although the program remained the highest-rating show in its timeslot.", "The sixth episode picked up slightly in viewers from the previous week with 1.192\u00a0million tuning in.", "The seventh episode grew in ratings as the penultimate episode, picking up to average 1.307\u00a0million viewers for the night.", "The eighth and final episode achieved the highest ratings for \"Summer Heights High\" with a total of 1.512\u00a0million viewers watching the concluding episode to the series.", "The series is renowned for its controversial portrayal of such issues as mental disabilities, homosexuality, sexual abuse, and racism." ], [ "The Haves and the Have Nots (TV series)", "The mid-season finale, aired on March 11, 2014, was the most watched broadcast in OWN's history, and also came in first among all of cable television and number 4 among all shows on television for the night it aired.", "The mid-season premiere aired on May 27, 2014.", "The third season of the series premiered on January 6, 2015.", "The second half premiered on June 30, 2015.", "The fourth season of the series premiered on January 5, 2016 and the second half premiered on June 21, 2016 and aired through September 6, 2016.", "The fifth season premiered on January 3, 2017 and ended with the mid-season finale on March 14, 2017.", "On January 30, 2017, the series was given an additional 44-episode order.", "The second half of season 5 premiered on June 20, 2017 and ended with the season finale on September 12, 2017.", "On November 21, 2017, the series was renewed for a sixth season, which premiered on January 9, 2018, and the 1st mid-season finale aired March 13, 2018 and on March 13, 2018, OWN also announced the second half of the season, which premiered on May 1, 2018 and with the 2nd mid-season finale July 17, 2018.", "On July 17, 2018, OWN announced the third half of the season, which premiered on August 14, 2018." ] ], "gold": "The series finale of the Haves and Have Nots aired on Tuesday, July 20, 2021. The Haves and the Have Nots first premiered on May 28, 2013, and the series ran for eight seasons on the Oprah Winfrey Network. During its highest rated years from 2014 to 2017, the program averaged more than 3.1 million viewers each year. During these highest rated years, season finales aired on September 12, 2017, September 6, 2016 and September 22, 2015. ", "prediction 1": "The Haves and the Have Nots is a television series renowned for controversial portrayal of such issues as mental disabilities, homosexuality, sexual abuse, and racism. The mid-season finale of the first season was aired on July 29, 2013. The mid-season finale of the second season was aired on July 27, 2018. The season finale of the third season was aired on August 27, 2018.", "prediction 2": "The have and the have not's season finale airs on Tuesdays at 9/8c on the Oprah Winfrey Network and on OWN.com. The mid-season finale of the series aired on March 11, 2014, the most watched broadcast in OWN history, and also came in first among all of cable television and number 4 among all shows on television for the night it aired. The second half of the season premiered on June 20, 2017 and ended with the season finale on September 12, 2017.", "prediction 3": "The season finale of the show The Haves and the Have Nots aired on May 28, 2013 and May 27, 2014. The mid-season finale of the show aired on March 11, 2014. The season finale of the show's fifth season aired on January 3, 2017 and the season finale of its sixth season aired on March 13, 2018. The series is renowned for its controversial portrayal of such issues as mental disabilities, homosexuality, sexual abuse, and racism.", "prediction 4": "The Haves and the Have Nots is an American television series renowned for its controversial portrayal of issues such as mental disabilities, homosexuality, sexual abuse, and racism. The first episode of season 1 of the series, The Haves and the Have Nots, aired on September 3, 2014. The second episode of season 3 aired on July 15, 2014. The fifth episode of season 6 aired on January 3, 2017 and the seventh episode grew in ratings as the penultimate episode to the series. The sixth episode of season 7 was aired on July 18, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 51, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 376 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Haves and the Have Nots is a television series that premiered on May 28, 2013 on the Oprah Winfrey Network. The fifth season finale aired on September 12, 2017. The fourth season aired through September 6, 2016." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sings the wheels in the sky keep on turning?", "passages": [ [ "Wheel in the Sky", "Wheel in the Sky\n\n\"Wheel in the Sky\" is a song by the American rock band Journey, recorded in 1977 and included on their fourth studio album, \"Infinity.\"", "It was written and composed by Robert Fleischman, Neal Schon and Diane Valory.", "At the time of the song's composition, the band had decided to follow a new direction into an edgier sound and began recording simple hard rock pieces with new lead vocalist Fleischman, who was replaced by Steve Perry by the time work on \"Infinity\" began in earnest.", "The song had started out as a poem called \"Wheels In My Mind\" by Diane Valory, the wife of Journey bassist Ross Valory.", "\"Wheel In The Sky\" reached #57 on the \"Billboard\" Hot 100 in 1978, becoming Journey's first song to chart on the Hot 100, and also reached #45 on the Canadian \"RPM\" 100.", "The song opens with a short instrumental that lasts for 28 seconds.", "Perry then sings the first verse, which is followed by the chorus, and the second verse with the chorus repeated once again.", "Neal Schon joins the song with a guitar solo which is filled with Perry's vocals, which can be briefly heard in the background.", "Finally, the chorus is repeated four times before the short outro that closes the song." ] ], "gold": "\"Wheel in the Sky\" is a song by the American rock band Journey, recorded in 1977 and included on their fourth studio album, Infinity. Steve Perry was the lead singer for \"Wheel in the Sky\". The song had started out as a poem called \"Wheels In My Mind\" by Diane Valory, the wife of Journey bassist Ross Valory.", "prediction 1": "\"Wheel in the Sky\" is a song by the American rock band Journey that was recorded in 1977 and included on their fourth studio album, Infinity. The song was written and composed by Robert Fleischman, Neal Schon and Diane Valory. Steve Perry sang the song.", "prediction 2": "\"Wheel in the Sky\" is a song by the American rock band Journey, recorded in 1977 and included on their fourth studio album, \"Infinity.\" It was written and composed by Robert Fleischman, Neal Schon and Diane Valory. Steve Perry, who later became lead vocalist, sings the chorus and the first verse in the song. Neal Schon joins the song with a guitar solo which is filled with Perry's vocals, which can be briefly heard in the background. Finally, the chorus is repeated four times before the short outro that closes the song.", "prediction 3": "\"Wheel in the Sky\" is a song by the American rock band Journey, recorded in 1977 and included on their fourth studio album, \"Infinity.\" It was written and composed by Robert Fleischman, Neal Schon and Diane Valory. Steve Perry sang the chorus of the song.", "prediction 4": "\"Wheel in the Sky\" is a song by the American rock band Journey, recorded in 1977 and included on their fourth studio album, Infinity. At the time of the song's composition, the band had decided to follow a new direction into an edgier sound and began recording simple hard rock pieces with new lead vocalist Fleischman, who was replaced by Steve Perry by the time work on \"Infinity\" began in earnest. Perry sings the first verse, which is followed by the chorus, and the second verse with the chorus repeated once again. Neal Schon joins the song with a guitar solo which is filled with Perry's vocals, which can briefly heard in the background. Finally, the chorus is repeated four times before the short outro that closes the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 226 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Wheel in the Sky\" is a song by the American rock band Journey that was recorded in 1977 and included on their fourth studio album, Infinity. Steve Perry sang the song. The song had started out as a poem called \"Wheels In My Mind\" by Diane Valory, the wife of Journey bassist Ross Valory." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who plays elsa in olaf's frozen adventure?", "passages": [ [ "Olaf's Frozen Adventure", "Olaf's Frozen Adventure\n\nOlaf's Frozen Adventure is a 2017 American 3D computer-animated featurette, produced by Walt Disney Animation Studios and released by Walt Disney Pictures.", "It is directed by Kevin Deters and Stevie Wermers, who previously directed the holiday-themed \"Prep and Landing\" shorts.", "The film features the voices of Josh Gad, Kristen Bell, Idina Menzel, and Jonathan Groff reprising their roles from the original 2013 film \"Frozen\".", "It premiered in 3D in theaters for a limited time engagement in front of Pixar's \"Coco\" on November 22, 2017, and made its television debut on ABC on December 14, 2017.", "It is the first Christmas season since the gates reopened and Anna and Elsa host a celebration for all of Arendelle.", "When the townspeople unexpectedly leave early to enjoy their individual holiday customs, the sisters realize they have no family traditions of their own.", "Elsa laments the fact that because she had isolated herself most of her life, she and Anna were unable to spend time with each other.", "Olaf decides to look for traditions with Sven's help.", "Going through the town, Olaf encounters various family traditions relating to Christmas, Hanukkah and Winter solstice." ], [ "Elsa (Frozen)", "Elsa (Frozen)\n\nQueen Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film \"Frozen\".", "She is voiced primarily by Broadway actress and singer Idina Menzel.", "At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager.", "Created by directors Chris Buck and Jennifer Lee, Elsa is loosely based on the title character of \"The Snow Queen\", a Danish fairytale by Hans Christian Andersen.", "In the Disney film adaptation, she is introduced as the princess of the fictional Scandinavian kingdom of Arendelle, heiress to the throne and the elder sister of Princess Anna (Kristen Bell).", "Elsa has the magical ability to create and manipulate ice and snow.", "She inadvertently sends Arendelle into an eternal winter on the evening of her coronation.", "Throughout the film, she struggles first with controlling and concealing her abilities and then with liberating herself from her fears of unintentionally harming others, especially her younger sister.", "The Snow Queen character, neutral but cold-hearted in the original fairytale and villain in numerous adaptations of the character, proved difficult to adapt to film due to her transparent depiction." ] ], "gold": "Olaf's Frozen Adventure is a 2017 American 3D computer-animated featurette, produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The film features the voices of Josh Gad, Kristen Bell, Idina Menzel, and Jonathan Groff reprising their roles from the original 2013 film Frozen. Eva Bella plays the role as young Elsa.", "prediction 1": "In the 2017 American computer-animated featurette, Olaf's Frozen Adventure, Elsa is voiced by Broadway actress and singer Idina Menzel. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager. The Snow Queen character, loosely based on the title character of Hans Christian Andersen's Danish fairy tale, is voiced by Eva Bella as a young child.", "prediction 2": "Elsa of Arendelle is a fictional character who appears in the 2017 American computer-animated featurette, Olaf's Frozen Adventure. She is voiced primarily by Broadway actress and singer Idina Menzel. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager.", "prediction 3": "Elsa is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen. She is voiced primarily by Broadway actress and singer Idina Menzel and voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager.", "prediction 4": "Elsa of Arendelle is a fictional character who appears in Walt Disney Animation Studios' 53rd animated film Frozen. She is voiced primarily by Broadway actress and singer Idina Menzel. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 403 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Olaf's Frozen Adventure is a 2017 American 3D computer-animated featurette, produced by Walt Disney Animation Studios and released by Walt Disney Pictures. The film features the voices of Josh Gad, Kristen Bell, Idina Menzel, and Jonathan Groff reprising their roles from the original 2013 film \"Frozen\". In the film, Olaf's Frozen Adventure, Elsa is voiced by Broadway actress and singer Idina Menzel. At the beginning of the film, she is voiced by Eva Bella as a young child and by Spencer Lacey Ganus as a teenager. " }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When did the movie dirty dancing come out?", "passages": [ [ "Dirty Dancing", "It was the first film to sell more than a million copies for home video, and its soundtrack created by Jimmy Ienner generating two multi-platinum albums and multiple singles, including \"(I've Had) The Time of My Life\", which won both the Golden Globe and Academy Award for Best Original Song, and a Grammy Award for best duet.", "The film's popularity led to a 2004 prequel, \"\", and a stage version which has had sellout performances in Australia, Europe, and North America.", "A made-for-TV remake was also released in 2017.", "In the summer of 1963 17-year-old Frances \"Baby\" Houseman is vacationing with her affluent family at Kellerman's resort.", "Her father, Jake, is doctor and friend to Max Kellerman, the resort proprietor.", "Exploring one night, Baby surreptitiously observes Max instructing the waiters, all Ivy League students, to romance the guests' daughters no matter how unattractive.", "She also sees Max's condescending attitude to the working class entertainment staff including Johnny, the resort's dance instructor.", "Baby is attracted to Johnny, and dances briefly with him when his cousin Billy takes her to one of the staff's secret dirty dancing parties." ], [ "Dirty Dancing (1988 TV series)", "Dirty Dancing (1988 TV series)\n\nDirty Dancing was an American Comedy-drama television series that ran for 11 episodes on CBS from October 29, 1988, until January 21, 1989.", "It was based on the film \"Dirty Dancing\" but had none of the original cast or crew.", "It starred Patrick Cassidy as Johnny (Patrick Swayze's character in the film) and Melora Hardin as Baby (Jennifer Grey's character in the film).", "The television series followed the same basic premise of the film, with a few variations.", "The series was still set at Kellerman's during the summer of 1963, but instead of being the daughter of a resort guest, Baby became the daughter of Max Kellerman (in the film, Baby's last name was Houseman), and was put in charge of Johnny as Kellerman's talent director.", "Much like the movie, Baby noted that she intended to attend Mount Holyoke in the fall, so it was not clear how the series would continue once the summer ended.", "As was the case in the film, Baby and Johnny had an adversarial relationship, but eventually came to respect each other.", "As this was a weekly series, Baby and Johnny did not fall in love immediately, but as the series progressed, their feelings grew." ], [ "Dirty Dancing: Havana Nights", "Dirty Dancing: Havana Nights\n\nDirty Dancing: Havana Nights (also known as Dirty Dancing 2 or Dirty Dancing 2: Havana Nights) is a 2004 American dance musical romantic drama film directed by Guy Ferland.", "The film is a prequel/\"re-imagining\" of the 1987 blockbuster \"Dirty Dancing\", reusing the same basic plot, but transplanting it from upstate New York to Cuba on the cusp of the Cuban Revolution.", "The movie was filmed in Old San Juan, Puerto Rico.", "In 1958, Katey Miller (Romola Garai), her parents (Sela Ward and John Slattery), and her younger sister Susie (Mika Boorem) arrive in Cuba during the Cuban revolution.", "A self-described bookworm, Katey is not very happy about having to move to a different country during her senior year of high school, as she had been planning to attend Radcliffe College, although the rest of her family seem extremely pleased to be in Cuba.", "Meeting several other rich American teenagers down by the pool - including James Phelps (Jonathan Jackson), the son of her father's boss -, Katey becomes disgusted when one of the teenagers insults a local waiter when he accidentally knocks over some of their drinks." ] ], "gold": "Dirty Dancing premiered at the 1987 Cannes Film Festival on May 12, 1987 and was then released in the United States on August 21, 1987. The film eventually earned over $214 million worldwide. Dirty Dancing: Havana Nights, also known as Dirty Dancing 2 or Dirty Dancing 2: Havana Nights, was released in 2004 and is an unrelated prequel to the 1987 blockbuster film Dirty Dancing. This 2004 film uses the same basic plot as 1987's Dirty Dancing but changes the setting of the story from upstate New York to Cuba.", "prediction 1": "Dirty Dancing was the first movie to sell more than a million copies for home video, and its soundtrack created by Jimmy Ienner generating two multi-platinum albums and multiple singles, including \"(I've Had) The Time of My Life\", which won both the Golden Globe and Academy Award for Best Original Song, and a Grammy Award for best duet. Dirty Dancing: The Movie was a 1992 American Dance musical romantic drama television series that ran for 11 episodes on CBS from October 29, 1988, and that followed the same basic premise of the film, but with a few variations. Dirty Dancing: The 2004 American Dance musical romantic drama film Dirty Dancing: Havana Nights was a remake of the 2004 American Dance Musical romantic romantic drama film Dirty Dancing: The Dirty Dancing: The Movie, which was re-imagining of the 1987 film Dir", "prediction 2": "Dirty Dancing is a movie that was released on June 6, 1963. It was the first movie to sell more than a million copies for home video, with the soundtrack created by Jimmy Ienner generating two multi-platinum albums and multiple singles, including the hit single \"(I've Had) The Time of My Life.\" Dirty Dancing: The Musical was released on January 22, 1967 and the tv series Dirty Dancing: The Comedy was released on October 29, 1988. The 2004 dance musical romantic drama Dirty Dancing: Havana Nights was directed by Guy Ferland.", "prediction 3": "Dirty Dancing was released in the United States on June 13, 1963. The film was also adapted into a television show based on the movie that ran for 11 episodes on CBS from October 29, 1988, until January 21, 1989. Dirty Dancing 2 is a 2004 American dance musical romantic drama film directed by Guy Ferland and reusing the same basic plot as the film. Dirty Dancing 3 is a 2017 American dance musical romantic drama film directed by Guy Ferland and starring Jermaine Dupri and John Slattery.", "prediction 4": "Dirty Dancing, the movie about a 17-year-old American girl who is attracted to a dance instructor, was the first film to sell more than a million copies for home video, and its soundtrack created by Jimmy Ienner generating two multi-platinum albums and multiple singles, including \"(I've Had) The Time of My Life\", which won both the Golden Globe and Academy Award for Best Original Song, and a Grammy Award for best duet. There was also a comedy-drama television series that ran for 11 episodes from October 29, 1988, until January 21, 1989. Dirty Dancing 2 was a 2004 American dance musical romantic drama film directed by Guy Ferland, reusing the same basic plot, but transplanting it from upstate New York to Cuba on the cusp of the Cuban Revolution.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 338 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 566 }, { "error type": "Irrelevant", "explanation": "", "start": 591, "end": 633 }, { "error type": "Redundant", "explanation": "American Dance musical romantic drama film ", "start": 688, "end": 739 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Dirty Dancing: Havana Nights, also known as Dirty Dancing 2 or Dirty Dancing 2: Havana Nights, was released in 2004 and is a prequel/\"re-imagining\" of the 1987 blockbuster \"Dirty Dancing\" , reusing the same basic plot, but transplanting it from upstate New York to Cuba on the cusp of the Cuban Revolution." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "How many seats do the democrats hold in the senate?", "passages": [ [ "2018 United States Senate elections", "They are arranged so that the parties are separated and a majority is clear by crossing the middle.", "Each block indicates an incumbent senator's actions going into the election.", "Some \"Ran\" for re-election, some \"Retired\" and the remainder (without a note) were not up for election this year.", "Before the elections, Republicans held 51 seats, Democrats held 47, and independents held two.", "Each block indicates the results of each election.", "Some senators were \"Re-elected\", some were a \"Gain\" in the seat from the other party (either by beating an incumbent or by winning an open seat), some were a \"Hold\" by the same party but with a different senator, two were an \"Appointee elected\" to finish a term and the remainder, (without a note) were not up for election this year.", "After these elections, Democrats had 45 seats, independents had 2, and Republicans had 53.", "Most election predictors used:\n\nThese are the election dates for the regularly scheduled general elections.", "Shading is added for future events.", "In these special elections, the winners will be seated before January 3, 2019, when elected and qualified.", "They are ordered by election date, then by state and by class.", "In these general elections, the winners were elected for the term beginning January 3, 2019." ], [ "2020 United States elections", "The vice president is selected in a similar manner, though a contingent election will be held in the United States Senate if no individual receives a majority of the vice presidential electoral vote.", "At least 34 of the 100 seats in the United States Senate will be up for election.", "All seats of Senate Class II will be up for election; the winners of those elections will serve six-year terms.", "Additionally, Arizona will hold a special election to a fill a Class III Senate vacancy; the winner of that election will serve a two-year term.", "Other states may also hold special elections.", "Republicans won control of the Senate in the 2014 Senate elections.", "They retained that majority through the 2016 and most recent 2018 Senate elections.", "Depending on the outcome of one undetermined race, Republicans will hold either 52 or 53 Senate seats, Democrats will hold either 45 or 46 seats, and independents will hold two seats.", "Both independents have caucused with the Democratic Party since joining the Senate.", "Barring further vacancies or party switching, 21 Republican-held seats, along with 12 Democratic-held seats, will be up for election.", "If they win the vice presidency, Democrats will need to win a total of at least 50 seats to take the majority; otherwise, they will need to win at least 51 seats to take the majority.", "All 435 voting seats in the United States House of Representatives will be up for election." ] ], "gold": "During the 113th Senate the Democrats held 53 seats. In the 114th Senate the Democrat held 44 seats and during the 115th Senate the Democrats held 47 seats.", "prediction 1": "The number of seats the Democrats hold in the Senate is divided into two groups. Depending on the outcome of one undetermined race, Republicans will hold either 52 or 53 seats, Democrats will hold either 45 or 46 seats, and independents will hold two seats. If they win the vice presidency, Democrats will need to win a total of at least 50 seats to take the majority; otherwise, they will need to win at least 51 seats to take the majority.", "prediction 2": "In the United States Senate, Democrats hold a total of 46 seats. The Democrats also hold 45 seats, 47 seats, and two seats.", "prediction 3": "In the United States Senate, Democrats hold 44 seats, Republicans have 52, and Democrats hold 53. Depending on the outcome of one undetermined race, Republicans will hold either 52 or 53 Senate seats, Democrats will hold either 45 or 46 seats, and independents will hold two seats.", "prediction 4": "Depending on the outcome of one undetermined race, Republicans will hold either 52 or 53 seats, Democrats will hold either 45 or 46 seats, and independents will hold two seats. Democrats have held 49 seats in the Senate since 1867.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 441 } ], "missing-info": [], "corrected-prediction": "Depending on the outcome of one undetermined race, Republicans will hold either 52 or 53 seats, Democrats will hold either 45 or 46 seats, and independents will hold two seats. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is the champions league cup final being held?", "passages": [ [ "2017 UEFA Champions League Final", "With a stadium capacity of 66,000 for the final, a total amount of 41,500 tickets were available to fans and the general public, with the two finalist teams receiving 18,000 tickets each and with 5,500 tickets being available for sale to fans worldwide via UEFA.com from 17 to 28 March 2017 in four price categories: \u00a3390, \u00a3275, \u00a3140, and \u00a360.", "The remaining tickets were allocated to the local organising committee, UEFA and national associations, commercial partners and broadcasters, and to serve the corporate hospitality programme.", "American hip-hop group The Black Eyed Peas performed at the opening ceremony preceding the final.", "The performance, which included a pyrotechnic display, ran over time and forced the kick-off to be delayed by several minutes.", "The 2017 UEFA Women's Champions League Final was held two days prior, on 1 June 2017, at the Cardiff City Stadium, with title holders Lyon beating Paris Saint-Germain 7\u20136 on penalties, following a 0\u20130 draw after extra time.", "The winning penalty was scored by Lyon goalkeeper Sarah Bouhaddi, immediately after her opposite number, Katarzyna Kiedrzynek, had missed her kick.", "The annual UEFA Champions Festival was held between 1\u20134 June 2017 at Cardiff Bay.", "German referee Felix Brych was announced as the final referee by UEFA on 12 May 2017." ], [ "2016 UEFA Champions League Final", "2016 UEFA Champions League Final\n\nThe 2016 UEFA Champions League Final was the final match of the 2015\u201316 UEFA Champions League, the 61st season of Europe's premier club football tournament organised by UEFA, and the 24th season since it was renamed from the European Champion Clubs' Cup to the UEFA Champions League.", "It was played at the San Siro stadium in Milan, Italy, on 28 May 2016, between Spanish teams Real Madrid and Atl\u00e9tico Madrid, in a repeat of the 2014 final.", "It was the second time in the tournament's history that both finalists were from the same city.", "Real Madrid won 5\u20133 on a penalty shoot-out after a 1\u20131 draw at the end of extra time, securing a record-extending 11th title in the competition.", "Real Madrid earned the right to play against the winners of the 2015\u201316 UEFA Europa League, Sevilla, in the 2016 UEFA Super Cup.", "They also qualified to enter the semi-finals of the 2016 FIFA Club World Cup as the UEFA representative.", "The San Siro, officially known as Stadio Giuseppe Meazza, was announced as the venue of the final at the UEFA Executive Committee meeting in Nyon, Switzerland, on 18 September 2014, the fourth European Cup/Champions League final hosted at the stadium following those in 1965, 1970 and 2001." ], [ "2015 UEFA Champions League Final", "2015 UEFA Champions League Final\n\nThe 2015 UEFA Champions League Final was the final match of the 2014\u201315 UEFA Champions League, the 60th season of Europe's premier club football tournament organised by UEFA, and the 23rd season since it was renamed from the European Champion Clubs' Cup to the UEFA Champions League.", "It was played at the Olympiastadion in Berlin, Germany, on 6 June 2015, between Italian side Juventus and Spanish side Barcelona.", "For the second time \u2013 after 2010 \u2013 both teams came into the final with the possibility of winning a treble, having each won their national league and cup for the season.", "Barcelona scored the only goal of the first half after four minutes, through Ivan Rakiti\u0107.", "Ten minutes after the interval, Juventus equalised with a goal by \u00c1lvaro Morata.", "In the 68th minute, Luis Su\u00e1rez put Barcelona back in the lead, and the final score of 3\u20131 was confirmed when Neymar scored with the last kick of the game.", "It was Barcelona's fifth trophy in the competition, and sealed their second treble, the other coming in 2009.", "As winners, Barcelona earned the right to play against the winners of the 2014\u201315 UEFA Europa League, Sevilla, in the 2015 UEFA Super Cup, and won that match 5\u20134." ] ], "gold": "The UEFA Champions League (abbreviated as UCL) is an annual club football competition organised by the Union of European Football Associations (UEFA) and contested by top-division European clubs, deciding the competition winners through a round robin group stage to qualify for a double-legged knockout format, and a single leg final. It is one of the most prestigious football tournaments in the world and the most prestigious club competition in European football, played by the national league champions (and, for some nations, one or more runners-up) of their national associations. The 2015 UEFA Champions League Final was was played at the Olympiastadion in Berlin, Germany. The 2016 UEFA Champions League Final was played at the San Siro stadium in Milan, Italy. The 2017 UEFA Champions League Final was played in Millennium Stadium, Cardiff, which is the capital of Wales in the United Kingdom.", "prediction 1": "The UEFA Champions League is the annual tournament of UEFA's European champion club competition. The 2017 UEFA Champions League Final was held on 1 June 2017 at Cardiff City Stadium. The 2015 UEFA Champions League Final was played at the Olympiastadion in Berlin, Germany on 6 June 2015, between Italian side Juventus and Spanish side Barcelona.", "prediction 2": "The UEFA Champions League Cup finals are played in various stadiums around the world. In 2015, it was played at the Olympiastadion in Berlin, Germany, on 6 June 2015, between Italian side Juventus and Spanish side Barcelona. In 2016, the UEFA Champions League Final was played at the San Siro stadium in Milan, Italy, between Spanish teams Real Madrid and Atl\u00e9tico Madrid, in a repeat of the 2014 final. In 2017, the UEFA Women's Champions League Final was held two days prior, on 1 June 2017, at the Cardiff City Stadium, with title holders Lyon beating Paris Saint-Germain 7\u20136 on penalties, following a 0 draw after extra time, following 0 draw at the end of extra time. The 2017 UEFA Women's Champions League Final was held at the Cardiff City Stadium with title holders Lyon beating Paris Saint-Germain 7\u20136 on penalties, following a 7\u20130 draw after", "prediction 3": "The Champions League cup final is held each year between the league winners. The 2015 UEFA Champions League Final was played at the Olympiastadion in Berlin, Germany, on 6 June 2015, between Italian side Juventus and Spanish side Barcelona. The 2017 UEFA Champions League Final was held two days prior, on 1 June 2017, at the Cardiff City Stadium, with title holders Lyon beating Paris Saint-Germain 7\u20136 on penalties, following a 0\u20130 draw after extra time.", "prediction 4": "The 2017 UEFA Women's Champions League Final was held on 1 June 2017 at the Cardiff City Stadium, with title holders Lyon beating Paris Saint-Germain 7\u20136 on penalties following a 0\u20130 draw after extra time. The 2016 UEFA Champions League Final was the final match of the 2015\u201316 UEFA Champions League, the 61st season of Europe's premier club football tournament organised by UEFA, and the 24th season since it was renamed from the European Champion Clubs' Cup to the UEFA Champions League.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 287 }, { "error type": "Irrelevant", "explanation": "", "start": 288, "end": 345 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The UEFA Champions League is the annual tournament of UEFA's European champion club competition. The 2017 UEFA Women's Champions League Final was held at Cardiff City Stadium. The 2016 UEFA Champions League Final was played at the San Siro stadium in Milan, Italy. The 2015 UEFA Champions League Final was played at the Olympiastadion in Berlin, Germany." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How many players on a football team nfl?", "passages": [ [ "American football", "Each bowl game would be associated with a particular conference, and earning a spot in a bowl game was the reward for winning a conference.", "This arrangement was profitable, but it tended to prevent the two top-ranked teams from meeting in a true national championship game, as they would normally be committed to the bowl games of their respective conferences.", "Several systems have been used since 1992 to determine a national champion of college football.", "The first was the Bowl Coalition, in place from 1992 to 1994.", "This was replaced in 1995 by the Bowl Alliance, which gave way in 1997 to the Bowl Championship Series (BCS).", "The BCS arrangement proved to be controversial, and was replaced in 2014 by the College Football Playoff (CFP).", "A football game is played between two teams of 11 players each.", "Playing with more on the field is punishable by a penalty.", "Teams may substitute any number of their players between downs; this \"platoon\" system replaced the original system, which featured limited substitution rules, and has resulted in teams utilizing specialized offensive, defensive and special teams squads.", "Individual players in a football game must be designated with a uniform number between 1 and 99.", "NFL teams are required to number their players by a league-approved numbering system, and any exceptions must be approved by the Commissioner.", "NCAA and NFHS teams are \"strongly advised\" to number their offensive players according to a league-suggested numbering scheme." ], [ "National Football League uniform numbers", "Also, if a player changes primary positions during his career, he is not required to change his number unless he changes from an eligible receiver to ineligible or vice versa (Jason Peters is a notable example, having moved from tight end, where he wore number 86, to offensive tackle, where he currently wears 71).", "Any player wearing any number may play at almost any position on the field at any time, if the player reports to the official; players wearing numbers 50\u201379 must let the referee know that they are playing out of position by reporting as an \"ineligible number in an eligible position,\" and likewise, those wearing any other number can report as an \"eligible number in an ineligible position\" (there are restrictions on the latter case as of the 2015 season, and eligible numbered players may never in any case line up in a formation position that is ineligible but appears to be eligible, such as a split tackle in a slot position).", "It is not uncommon for running backs to line up at wide receiver on certain plays, or to have a large lineman play at fullback or tight end in short yardage situations, or to have wide receivers fill in as extra defensive backs.", "Also, in preseason games, when teams have expanded rosters, players may wear numbers that are outside of the above rules.", "When the final 53-player roster is established, they are reissued numbers within the above guidelines." ] ], "gold": "The NFL can have 53 players on their team, but only 11 can be on the field at one time.", "prediction 1": "In the National Football League, there are 53 total players, or 242 teams with a total of 56 players. Individual players in a football game must be designated with a uniform number between 1 and 99. NFL teams are required to number their players by a league-approved numbering system, and any exceptions must be approved by the Commissioner. The numbering system for offensive players is different, with each team having between 2 and 19 players.", "prediction 2": "Traditionally, the National Football League has had 53 players on its roster. The NFL has used the numbering system of 1-10. There have also been teams with 59 players.", "prediction 3": "There are 53 players in the National Football League. The number of players on a team in the National Football League is 53.", "prediction 4": "A football game is played between two teams of 11 players each. Teams are required to number their players by a league-approved numbering system, and any exceptions must be approved by the Commissioner. NFL teams are required to number their players by a league-approved numbering system, and any exceptions must be approved by the Commissioner.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 61, "end": 101 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 341 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 398 }, { "error type": "Unverifiable", "explanation": "", "start": 399, "end": 446 } ], "missing-info": [], "corrected-prediction": "In the National Football League, there are 53 total players." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Where did the house of windsor come from?", "passages": [ [ "House of Windsor", "House of Windsor\n\nThe House of Windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms.", "The dynasty is of German paternal descent and was originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria, wife of Albert, Prince Consort.", "The name was changed from \"Saxe-Coburg and Gotha\" to the English \"Windsor\" (from \"Windsor Castle\") in 1917 because of anti-German sentiment in the British Empire during World War I. There have been four British monarchs of the house of Windsor to date: three kings and the present queen, Elizabeth II.", "During the reign of the Windsors, major changes took place in British society.", "The British Empire participated in the First and Second World Wars, ending up on the winning side both times, but subsequently lost its status as a superpower during decolonisation.", "Much of Ireland broke with the United Kingdom and the remnants of the Empire became the Commonwealth of Nations.", "The current head of the house is monarch of sixteen sovereign states." ], [ "House of Saxe-Coburg and Gotha", "House of Saxe-Coburg and Gotha\n\nThe House of Saxe-Coburg and Gotha (; German: \"Haus Sachsen-Coburg und Gotha\") is a German dynasty that ruled the duchy of Saxe-Coburg and Gotha, which was one of the Ernestine duchies.", "It is a cadet branch of the Saxon House of Wettin.", "Founded by Ernest Anton, the sixth duke of Saxe-Coburg-Saalfeld, it has been the royal house of several European monarchies.", "Agnatic branches currently reign in Belgium through the descendants of Leopold I and in the United Kingdom and the other Commonwealth realms through the descendants of Prince Albert.", "Due to anti-German sentiment in the United Kingdom during World War I, George V changed the name of his branch from \"Saxe-Coburg and Gotha\" to \"Windsor\" in 1917.", "The same happened in 1920 in Belgium, where the name was changed to \"\"van Belgi\u00eb\"\" (Dutch) or \"\"de Belgique\"\" (French) or \"\"von Belgien\"\" (German), meaning \"of Belgium\".", "The first duke of Saxe-Coburg and Gotha was Ernest I, who reigned from 1826 until his death in 1844." ], [ "House of Windsor", "These are the United Kingdom (where they are based), Canada, Australia, New Zealand, Jamaica, Barbados, the Bahamas, Grenada, Papua New Guinea, Solomon Islands, Tuvalu, Saint Lucia, Saint Vincent and the Grenadines, Belize, Antigua and Barbuda, and Saint Kitts and Nevis.", "As well as these separate monarchies, there are also three Crown dependencies, fourteen British Overseas Territories and two associated states of New Zealand.", "Edward VII", "and, in turn, his son, George V, were members of the German ducal House of Saxe-Coburg and Gotha by virtue of their descent from Albert, Prince Consort, husband of Queen Victoria, the last British monarch from the House of Hanover.", "High anti-German sentiment amongst the people of the British Empire during World War I reached a peak in March 1917, when the Gotha G.IV, a heavy aircraft capable of crossing the English Channel, began bombing London directly and became a household name.", "In the same year, on 15 March, King George's first cousin, Nicholas II, the Emperor of Russia, was forced to abdicate, which raised the spectre of the eventual abolition of all the monarchies in Europe.", "The King and his family were finally convinced to abandon all titles held under the German Crown and to change German titles and house names to anglicised versions." ] ], "gold": "The House of Windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms. In 1901, the House of Saxe-Coburg and Gotha, a branch of the House of Wettin, succeeded the House of Hanover to the British monarchy with the accession of King Edward VII, son of Queen Victoria and Prince Albert of Saxe-Coburg and Gotha. Edward VII and, in turn, his son, George V, were members of the German ducal House of Saxe-Coburg and Gotha by virtue of their descent from Albert, Prince Consort, husband of Queen Victoria, the last British monarch from the House of Hanover.", "prediction 1": "The house of windsor originated in Germany. The house of windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms. The house of windsor is of German paternal descent and originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria, wife of Albert, Prince Consort.", "prediction 2": "The House of Windsor is the reigning royal house of the United Kingdom and other Commonwealth realms. The house of windsor is of German paternal descent and was originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria, wife of Albert, Prince Consort. Due to anti-German sentiment in the United Kingdom during World War I, George V changed the name of his branch from \"Saxe-Coburg and Gotha\" to the English \"Windsor\" (from \"Windsor\" in 1917.", "prediction 3": "The house of windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms. The dynasty is of German paternal descent and was originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria, wife of Albert, Prince Consort. The name was changed from Saxe-Coburg and Gotha to the English \"Windsor\" in 1917 because of anti-German sentiment in the British Empire during World War I.", "prediction 4": "The House of Windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms. The dynasty is of German paternal descent and was originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria, wife of Albert, Prince Consort. Since the House of Windsor's founding, George V, George V's successor, changed the name of his branch from Saxe-Coburg and Gotha to the English \"Windsor\" in 1917, from \"Saxe-Coburg and Gotha\" to the English \"Windsor\" (from \"Saxe-Coburg and Gotha\" to the English \"Windsor\", because of anti-German sentiment in the British Empire during World War I.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 43 }, { "error type": "Redundant", "explanation": " The house of windsor ", "start": 150, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 395, "end": 436 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3, 4 ] } ], "corrected-prediction": "The house of windsor is the reigning royal house of the United Kingdom and the other Commonwealth realms. It is of German paternal descent and originally a branch of the House of Saxe-Coburg and Gotha, itself derived from the House of Wettin, which succeeded the House of Hanover to the British monarchy following the death of Queen Victoria. Edward VII and, in turn, his son, George V, were members of the German ducal House of Saxe-Coburg and Gotha by virtue of their descent from Albert, Prince Consort, husband of Queen Victoria, the last British monarch from the House of Hanover." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who wrote the music to the lion king?", "passages": [ [ "The Lion King (soundtrack)", "The Lion King (soundtrack)\n\nThe Lion King: Original Motion Picture Soundtrack is the original motion picture soundtrack for the 1994 Disney animated film, \"The Lion King\".", "It contains songs from the film written by Elton John and Tim Rice, and a score composed by Hans Zimmer.", "Elton John has a dual role of performer for several tracks.", "Additional performers include Carmen Twillie, Jason Weaver, Rowan Atkinson, Whoopi Goldberg, Jeremy Irons, Cheech Marin, Jim Cummings, Nathan Lane, Ernie Sabella, and Sally Dworsky.", "The album was released on April 27, 1994 on CD and audio cassette.", "The soundtrack was recorded in three different countries: the U.S., the U.K. and South Africa.", "It is the best-selling soundtrack album to an animated film in the United States with over 7 million copies sold, with 4,934,000 copies sold in 1994.", "An expanded version of \"The Lion King\" soundtrack, featuring 30 minutes of previously-unreleased material, was released as part of the \"\" series on June 24, 2014.", "In 2014, Hot Topic released a vinyl picture disc of the soundtrack.", "Walt Disney Records released an expanded edition of \"The Lion King\" soundtrack containing an additional thirty minutes of previously-unheard material from the film, as well as a collection of demo versions of cues." ], [ "Lebo M.", "Lebo M.\n\nLebohang \"Lebo M.\" Morake (born 20 May 1964) is a South African producer and composer.", "He arranged and performed music for \"The Lion King\" movies and stage productions.", "He was recommended to Disney by Hans Zimmer, the score composer of \"The Lion King\", and was later hired to form and conduct the African choir that sang for the movies.", "His voice is the first voice heard in the beginning of the film, singing a chant over the opening sequence which is often considered synonymous with the film's image in popular culture.", "He also contributed to the sequel to the film's soundtrack, \"Rhythm of the Pride Lands\", and the film's direct-to-video sequel \".", "Lebo Morake was born on 20 May 1964 in the Apartheid-ridden Soweto in Johannesburg, South Africa and inspired by Nelson Mandela, he spent years working hard in the South African slums but was exiled from South Africa in 1979.", "He made his way to the U.S. and to Los Angeles where he worked in a variety of jobs, including begging and serving at McDonald's.", "He returned to South Africa 5 years after the elimination of the Apartheid regime after being gone for 20 years.", "He lives with his family in Johannesburg and Los Angeles.", "He founded the Lebo M Foundation and Till Dawn Entertainment." ] ], "gold": "The 1994 Lion King film had music written by Elton John and Tim Rice and Hans Zimmer. In the 2019 Lion King film the music was written by Elton John and Tim Rice, Hans Zimmer, Lebohang \"Lebo M\" Morake and Beyonce.", "prediction 1": "The music for the 1994 Disney animated film The Lion King was written by Tim Rice, Elton John, and Lebo Morake. The Lion King: Original Motion Picture Soundtrack is the original motion picture soundtrack for the 1994 Disney animated film, The Lion King. It contains songs from the film written by Elton John and Tim Rice, and a score composed by Hans Zimmer.\n", "prediction 2": "There are several English-language songs for The Lion King. Other songs are written by Tim Rice, Elton John for the ending theme song, Jack the Ripper for the theme song, George Harrison for the opening theme song, and Keith Urban for the closing theme song. Lebo Morake wrote the music for this film.", "prediction 3": "The 1994 Disney animated film, The Lion King, has an original motion picture soundtrack which includes songs written by Tim Rice, Elton John, and Lebo Morake.", "prediction 4": "The Lion King: Original Motion Picture Soundtrack is the original motion picture soundtrack for the 1994 Disney animated film, The Lion King. It contains songs from the film written by Elton John and Tim Rice, and a score composed by Hans Zimmer. Additionally, an expanded version of the soundtrack, featuring 30 minutes of previously-unreleased material, was released as part of the \"\" series on June 24, 2014. A South African producer and composer called Lebo Morake is credited with being the first voice heard in the beginning of The Lion King. Unknown for his music for his own song, and the film's Rhythm of the Pride Lands, and its direct-to sequel.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 99, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 321 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The music for the 1994 Disney animated film The Lion King was written by Tim Rice, Elton John, and a score composed by Hans Zimmer. Lebohang \"Lebo M.\" Morake arranged and performed music for \"The Lion King\" movies and stage productions.\n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who sings tomorrow belongs to me in cabaret?", "passages": [ [ "Mark Lambert (American actor)", "Mark Lambert (American actor)\n\nMark Lambert (born January 19, 1952) is an American actor and singer.", "He was born Mark Robert Luebke and grew up in San Jose, California, where he graduated from Oak Grove High School in 1970.", "He was discovered by a Hollywood manager while appearing at the San Jose Community Theatre.", "After moving to Los Angeles, Lambert made a single episode appearance of \"Room 222.\"", "He went on to guest star in a variety of television shows, including \"The Mod Squad,\" \"The Partridge Family,\" and \"Ironside\".", "He made his Broadway-theatre d\u00e9but in New York City originating the role of Henrik Egerman in the musical-theatre production of \"A Little Night Music\" (1973-74) with music and lyrics by Stephen Sondheim and book by Hugh Wheeler.", "After \"Night Music\" closed, Lambert moved back to California and appeared in feature films and television productions.", "He dubbed the singing voice for \"Tomorrow Belongs to Me\" in \"Cabaret\" (1972), although the screen role was played by Oliver Collignon, a young German extra; Lambert's voice was uncredited.", "Lambert married actress Victoria Mallory in 1975; they remained together until her death from cancer in 2014.", "The couple had a daughter, Ramona Mallory Lambert, also an actress, known professionally as Ramona Mallory." ], [ "Cabaret (musical)", "The role, as played by Joel Grey in both prior incarnations, was an asexual, edgy character dressed in a tuxedo with rouged cheeks.", "Alan Cumming's portrayal was highly sexualized, as he wore suspenders (i.e. braces) around his crotch and red paint on his nipples.", "Staging details differed as well; instead of \"Tomorrow Belongs to Me\" being performed by a male choir, the Emcee plays a recording of a boy soprano singing it.", "In the final scene, the Emcee removes his outer clothes to reveal a striped suit of the type worn by the internees in concentration camps; on it are pinned a yellow badge (identifying Jews) and a pink triangle (denoting homosexuals).", "Other changes included added references to Cliff's bisexuality, including a brief scene where he kisses one of the Cabaret boys.", "\"I Don't Care Much\", which was cut from the original production, was reinstated, and \"Mein Herr\" was added from the film.", "The second Broadway revival was based on the 1993 Mendes-Donmar Warehouse production.", "For the Broadway transfer, Rob Marshall was co-director and choreographer.", "The production opened after 37 previews on March 19, 1998, at the Kit Kat Klub, housed in what previously had been known as Henry Miller's Theatre." ], [ "Cabaret (musical)", "Cabaret (musical)\n\nCabaret is a 1966 musical with music by John Kander, lyrics by Fred Ebb, and book by Joe Masteroff, based on John Van Druten's 1951 play \"I Am a Camera\", which was adapted from the short novel \"Goodbye to Berlin\" (1939) by Christopher Isherwood.", "Set in 1931 Berlin as the Nazis are rising to power, it focuses on the nightlife at the seedy Kit Kat Klub, and revolves around young American writer Cliff Bradshaw and his relationship with English cabaret performer Sally Bowles.", "A sub-plot involves the doomed romance between German boarding house owner Fr\u00e4ulein Schneider and her elderly suitor Herr Schultz, a Jewish fruit vendor.", "Overseeing the action is the Master of Ceremonies at the Kit Kat Klub.", "The club serves as a metaphor for ominous political developments in late Weimar Germany.", "The 1966 original Broadway production became a hit, inspiring numerous subsequent productions in London and New York, as well as the 1972 film of the same name." ] ], "gold": "Cabaret is a 1966 musical with music by John Kander, lyrics by Fred Ebb, and book by Joe Masteroff. The musical was based on John Van Druten's 1951 play I Am a Camera which was adapted from the semi-autobiographical novel Goodbye to Berlin (1939) by Anglo-American writer Christopher Isherwood. In the musical, the Emcee plays a recording of a boy soprano singing the song Tomorrow Belongs to Me. Fr\u00e4ulein Kost, Ernst Ludwig and Company reprise Tomorrow Belongs to Me with more overtly Nazi overtones, later in the show. In the 1972 American musical drama film loosely based on the 1966 Broadway musical Cabaret, Oliver Collignon plays the Nazi youth, with his singing voice for Tomorrow Belongs to Me dubbed by Mark Lambert.", "prediction 1": "In the 1972 musical Cabaret, the singing voice for \"Tomorrow Belongs To Me\" is voiced by German actor Oliver Collignon, while the German actor who plays Cliff Bradshaw on the screen is played by German-born actor Oliver Collignon.", "prediction 2": "In the 1972 musical Cabaret, the song \"Tomorrow Belongs to Me\" is sung by a boy soprano instead of a male choir. In the 1966 musical Cabaret, the song was sung by John Kander, and in the 1972 film version, it was sung by a boy soprano.", "prediction 3": "Cabaret is a musical based on the 1951 play I Am a Camera. It was first performed by a male choir in the original Broadway production on March 19, 1966. Instead, the Emcee plays a recording of a boy soprano singing Tomorrow Belongs to Me. Then the screen role was played by Oliver Collignon, a young German extra; Lambert's voice was uncredited. In the 1972 film, the voice for Tomorrow Belongs to Me was sung by Mark Lambert himself.", "prediction 4": "In the 1972 film Cabaret, the song \"Tomorrow Belongs to Me\" was sang by a boy soprano. The singing voice for the song was credited to American actor and singer Mark Lambert. In the 1966 musical Cabaret, the singing voice for \"Tomorrow Belongs to Me\" was credited to German extra Oliver Collignon.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Cabaret is a 1966 musical with music by John Kander, lyrics by Fred Ebb, and book by Joe Masteroff, based on John Van Druten's 1951 play \"I Am a Camera\", which was adapted from the short novel \"Goodbye to Berlin\" (1939) by Christopher Isherwood. In the musical, instead of \"Tomorrow Belongs to Me\" being performed by a male choir, the Emcee plays a recording of a boy soprano singing it. In the 1972 musical Cabaret, the singing voice for \"Tomorrow Belongs To Me\" is voiced by German actor Oliver Collignon, while the German actor who plays Cliff Bradshaw on the screen is played by German-born actor Oliver Collignon." }, "preference": [ 1, 2, 0, 2, 2, 1 ] }, { "question": "The population of the oceania / pacific region is approximately?", "passages": [ [ "Oceania", "Oceania\n\nOceania (, , ) is a geographic region comprising Australasia, Melanesia, Micronesia and Polynesia.", "Spanning the eastern and western hemispheres, Oceania covers an area of and has a population of /1e6 round 0 million.", "Situated in the southeast of the Asia-Pacific region, Oceania is the smallest continental grouping in land area and the second smallest in population after Antarctica.", "The islands at the geographic extremes of Oceania are the Bonin Islands, a politically integral part of Japan; Hawaii, a state of the United States; Clipperton Island, a possession of France; the Juan Fern\u00e1ndez Islands, belonging to Chile; and the Campbell Islands, belonging to New Zealand.", "Oceania has a diverse mix of economies from the highly developed and globally competitive financial markets of Australia and New Zealand, which rank high in quality of life and human development index, to the much less developed economies that belong to countries such as of Kiribati and Tuvalu, while also including medium-sized economies of Pacific islands such as Palau, Fiji and Tonga.", "The largest and most populous country in Oceania is Australia, with Sydney being the largest city of both Oceania and Australia.", "The first settlers of Australia, New Guinea, and the large islands just to the east arrived between 50,000 and 30,000 years ago.", "Oceania was first explored by Europeans from the 16th century onward." ] ], "gold": "Oceania is a geographic region that includes Australasia, Melanesia, Micronesia and Polynesia. Spanning the Eastern and Western Hemispheres, Oceania has a land area of 8,525,989 square kilometres (3,291,903 sq mi). When compared with the continents, the region of Oceania is the smallest in land area and the second smallest in population after Antarctica. In 2010, the population of Oceania was around 37.8 million people and in 2018 the population grew to approximately 41,570,842 people.", "prediction 1": "Oceania is a geographical region comprising Australasia, Melanesia, Micronesia and Polynesia. Spanning the eastern and western hemispheres, Oceania covers an area of and has a population of /1e6 round 0 million. Situated in the southeast of the Asia-Pacific region, Oceania is the smallest continental grouping in land area and the second smallest in population after Antarctica.", "prediction 2": "Oceania is a geographic region comprising Australasia, Melanesia, Micronesia and Polynesia. Spanning the eastern and western hemispheres, Oceania covers an area of and has a population of 1e6 round 0 million. Situated in the southeast of the Asia-Pacific region, Oceania is the smallest continental grouping in land area and the second smallest in population after Antarctica.", "prediction 3": "Oceania is a geographic region comprising Australasia, Melanesia, Micronesia and Polynesia. Spanning the eastern and western hemispheres, Oceania covers an area of and has a population of /1e6 round 0 million. Situated in the southeast of the Asia-Pacific region, Oceania is the smallest continental grouping in land area and the second smallest in population after Antarctica.", "prediction 4": "The population of Oceania is roughly 1e6 round 0 million. The largest country in Oceania is Australia.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Oceania is a geographical region comprising Australasia, Melanesia, Micronesia and Polynesia. Spanning the eastern and western hemispheres, Oceania covers an area of and has a population of /1e6 round 0 million. Situated in the southeast of the Asia-Pacific region, Oceania is the smallest continental grouping in land area and the second smallest in population after Antarctica." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When did gender testing of female olympic athletes begin?", "passages": [ [ "Sex verification in sports", "Sex verification in sports\n\nSex verification in sports (also known as gender verification, or loosely as gender determination or a sex test) is the issue of verifying the eligibility of an athlete to compete in a sporting event that is limited to a single sex.", "The issue has arisen multiple times in the Olympic games and other sporting competitions where it has been alleged that male athletes attempted to compete as women, or that a woman has an intersex condition giving an alleged unfair advantage.", "The first mandatory sex test issued by the IAAF for woman athletes was in July 1950 in the month before the European Championships in Belgium.", "All athletes were tested in their own countries.", "Sex testing at the games began at the 1966 European Athletics Championships in response to suspicion that several of the best women athletes from the Soviet Union and Eastern Europe were actually men.", "At the Olympics, testing was introduced in 1968.", "Initially, sex verification took the form of physical examinations.", "It subsequently evolved into chromosome testing, and later testosterone testing.", "It is not always a simple case of checking for XX vs. XY chromosomes, or sex hormone levels, to determine whether an athlete is unambiguously a woman or a man." ], [ "Sex verification in sports", "According to a \"Time\" magazine article about hermaphrodites, Brundage felt the need to clarify \"sex ambiguities\" after observing the performance of Czechoslovak runner and jumper Zde\u0148ka Koubkov\u00e1 and English shotputter and javelin thrower Mary Edith Louise Weston.", "Both individuals later had gender reassignment surgery and legally changed their names, to Zden\u011bk Koubek and Mark Weston, respectively.", "Sex verification tests began in 1950 with the International Association of Athletics Federation (IAAF), using physical examinations.", "The Dutch athlete Foekje Dillema was banned for Life in July 1950.", "The International Olympic Committee followed suit in 1968.", "Initially, women athletes \"were asked to parade nude before a panel of doctors\".", "For a period of time these tests were mandatory for female athletes, due to fears that male athletes would pose as female athletes and have an unfair advantage over their competitors.", "Chromosome testing was introduced by the International Olympic Committee during the 1968 Summer Olympics.", "This tested for the Y-chromosome, and was designed to identify males potentially disguised as females.", "This method of testing was later abolished, as it was shown to be inconclusive in identifying maleness.", "The International Association of Athletics Federations ceased sex screening for all athletes in 1992, but retained the option of assessing the sex of a participant should suspicions arise." ] ], "gold": "Sex testing at the actual games began with the 1966 European Athletics Championships\u2019 response to suspicion that several of the best women athletes from the Soviet Union and Eastern Europe were actually men. At the Olympics, testing was introduced in 1968. Chromosome testing was introduced by the International Olympic Committee during the 1968 Summer Olympics.", "prediction 1": "The first mandatory sex test issued by the IAAF for woman athletes was in July 1950 in the month before the European Championships in Belgium. Testing at the Olympics began at the 1966 European Athletics Championships in response to suspicion that several of the best women athletes from the Soviet Union and Eastern Europe were actually men. Testing at the Olympics, testing was introduced in 1968.", "prediction 2": "The first mandatory sex test issued by the IAAF for woman athletes was in July 1950 in the month before the European Championships in Belgium. At the 1968 Summer Olympics, testing was introduced. Initially, sex verification took the form of physical examinations. It subsequently evolved into chromosome testing, and later testosterone testing.", "prediction 3": "Sex verification in sports, also known as gender verification, or loosely as gender determination or a sex test, is the issue of verifying the eligibility of an athlete to compete in a sporting event that is limited to a single sex. The first mandatory sex test issued by the IAAF for woman athletes was in July 1950 in the month before the European Championships in Belgium. Sex testing at the Olympics, testing was introduced in 1968. Initially, sex verification took the form of physical examinations. It subsequently evolved into chromosome testing, and later testosterone testing.", "prediction 4": "The first mandatory sex test issued by the IAAF for woman athletes was in July 1950, in the month before the European Championships in Belgium. Sex verification in sports is the issue of verifying the eligibility of an athlete to compete in a sporting event that is limited to a single sex. Testing at the Olympic games began at the 1966 European Athletics Championships in response to suspicion that several of the best women athletes from the Soviet Union and Eastern Europe were actually men.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 142 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Testing at the Olympics began at the 1966 European Athletics Championships in response to suspicion that several of the best women athletes from the Soviet Union and Eastern Europe were actually men. Testing at the Olympics, testing was introduced in 1968.Chromosome testing was introduced by the International Olympic Committee during the 1968 Summer Olympics." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "The left lower quadrant of the abdomen contains part of the?", "passages": [ [ "Quadrant (abdomen)", "Quadrant (abdomen)\n\n", "The human abdomen is divided into regions by anatomists and physicians for purposes of study, diagnosis, and therapy.", "In the four-region scheme, four quadrants allow localisation of pain and tenderness, scars, lumps, and other items of interest, narrowing in on which organs and tissues may be involved.", "The quadrants are referred to as the left lower quadrant, left upper quadrant, right upper quadrant and right lower quadrant, as follows below.", "These terms are not used in comparative anatomy, since most other animals do not stand erect.", "Left lower quadrant:\n\nLeft upper quadrant:\n\nRight upper quadrant:\n\n", "Right lower quadrant:\n\nIf abdominal pain or signs of peritonitis are localised in the LLQ, colitis, diverticulitis, ureteral colic or pain due to ovarian cysts or pelvic inflammatory disease may be suspected.", "Examples of tumors in the left lower quadrant include colon cancer and ovarian tumor.", "The LUQ may be painful or tender in the case of intestinal malrotation.", "The RUQ may be painful or tender in hepatitis, cholecystitis, and peptic ulcer.", "The RLQ may be painful and/or tender in such conditions as appendicitis.", "Children\n\nAdults\n\nElderly" ], [ "Descending colon", "Descending colon\n\nThe descending colon is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon.", "The function of the descending colon in the digestive system is to store the remains of digested food that will be emptied into the rectum.", "The descending colon begins at the splenic flexure at the upper left part of the abdomen.", "It passes downward through the left hypochondrium and lumbar regions, along the outer border of the left kidney and ends at the lower left part of the abdomen where it continues as the sigmoid colon.", "It is retroperitoneal in two-thirds of humans.", "In the other third, it has a (usually short) mesentery.", "The arterial supply comes via the left colic artery.", "While the first part of the large intestine is responsible for the absorption of water and other substances from the chyme, the main function of the descending colon is to store waste until it can be removed from the body in solid form, when a person has a bowel movement.", "The stools gradually solidify as they move along into the descending colon.", "There are several diseases associated with the descending colon.", "Among the most common are the inflammatory bowel diseases (such as ulcerative colitis or Crohn\u2019s disease) and colon cancer." ], [ "Abdomen", "(Note that \"hypo\" means \"below\" and \"epi\" means \"above\", while \"chondron\" means \"cartilage\" (in this case, the cartilage of the rib) and \"gaster\" means stomach.", "The reversal of \"left\" and \"right\" is intentional, because the anatomical designations reflect the patient's own right and left.)", "The right iliac fossa (RIF) is a common site of pain and tenderness in patients who have appendicitis.", "The fossa is named for the underlying iliac fossa of the hip bone, and thus is somewhat imprecise.", "Most of the anatomical structures that will produce pain and tenderness in this region are not in fact in the concavity of the ileum.", "However, the term is in common usage.", "Another way of dividing the abdomen is by using 4 quadrants:\n\n", "The invertebrate abdomen is built up of a series of upper plates known as tergites and lower plates known as sternites, the whole being held together by a tough yet stretchable membrane.", "The abdomen contains the insect's digestive tract and reproductive organs, it consists of eleven segments in most orders of insects though the eleventh segment is absent in the adult of most higher orders." ] ], "gold": "The left lower quadrant of the human abdomen contains the descending colon and sigmoid colon, and the left ovary and fallopian tube in women. It also includes the left ureter and half of the left flank region. The equivalent term for animals is left posterior quadrant. ", "prediction 1": "The human abdomen is divided into regions by anatomists and physicians for purposes of study, diagnosis, and therapy. The left lower quadrant of the abdomen contains part of the descending colon, which is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon. If abdominal pain or signs of peritonitis are localised in the LLQ, colitis, diverticulitis, ureteral colic or pain due to ovarian cysts or pelvic inflammatory disease may be suspected. Examples of tumors in the right lower quadrant include colon cancer and ovarian tumor.", "prediction 2": "The human abdomen is divided into quadrants by anatomists and physicians for purposes of study, diagnosis, and therapy. In the four-region scheme, four quadrants allow localisation of pain and tenderness, scars, lumps, and other items of interest, narrowing in on which organs and tissues may be involved. The left lower quadrant contains the left hypochondrium and lumbar regions, along with the outer border of the left kidney. The descending colon is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon.", "prediction 3": "The human abdomen is divided into regions by anatomists and physicians for purposes of study, diagnosis, and therapy. In the four-region scheme, four quadrants allow localisation of pain and tenderness, scars, lumps, and other items of interest, narrowing in on which organs and tissues may be involved. The quadrants are referred to as the left lower quadrant, left upper quadrant, right upper quadrant and right lower quadrant, as follows below. The descending colon is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon. The function of the descending colon in the digestive system is to store the remains of digested food that will be emptied into the rectum.", "prediction 4": "The human abdomen is divided into regions by anatomists and physicians for purposes of study, diagnosis, and therapy. The left lower quadrant of the abdomen contains part of the descending colon. The descending colon is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon. Examples of tumors in the left lower quadrant include colon cancer and ovarian tumor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 486 }, { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 573 } ], "missing-info": [], "corrected-prediction": "The left lower quadrant of the abdomen contains part of the descending colon, which is the part of the large intestine from the splenic flexure to the beginning of the sigmoid colon. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did india won the first cricket world cup?", "passages": [ [ "History of the ICC Cricket World Cup", "The forty over match (eight balls per over) was used to fill the time as compensation for the frustrated crowd.", "The success and popularity of the domestic one-day competitions in England and other parts of the world as well as the early One-day Internationals prompted the International Cricket Council to consider organising a Cricket World Cup.", "The Men's Cricket World Cup was first held in 1975 in England, which was the only nation that was able to put forward the resources to stage an event of such magnitude.", "The first three tournaments were officially known as the Prudential Cup after the financial services company Prudential plc who sponsored the event.", "The matches were of 60 overs per team and played in traditional white uniform and red balls.", "They were all played during the day.", "Eight teams participated in the first tournament: Australia, England, the West Indies, Pakistan, India, and New Zealand (the six Test nations at the time), with Sri Lanka and a composite team from East Africa.", "One notable omission was the South African cricket team who were not competing due to the international sports boycott.", "West Indies won the first Cricket World Cup by defeating Australia by 17 runs in the final.", "The next two World Cups held in 1979 and 1983 were again hosted by England." ] ], "gold": "The 1983 Cricket World Cup, officially the Prudential Cup '83, was the 3rd edition of the Cricket World Cup tournament. It was held from June 9 to June 25,1983 in both England and Wales, and India won. ", "prediction 1": "The Men's Cricket World Cup was first held in England in 1975. The winning team was India, who defeated Australia by 17 runs in the final to win the tournament. The next two Cricket World Cups were held in 1979 and 1983, both in England.", "prediction 2": "The Men's Cricket World Cup was first held in England in 1975, with India winning the first Cricket World Cup in 1982. The next two Cricket World Cups were held in 1979 and 1983, both of which were again hosted by England.", "prediction 3": "The first Men's Cricket World Cup was first held in England in 1975. The next two Cricket World Cups held in 1979 and 1983 were again hosted by England. India won the first cricket world cup in 1975, in which they defeated the West Indies by 17 runs in the final.", "prediction 4": "The first Cricket World Cup was first held in England in 1975, where it was the only nation able to put forward the resources to stage an event of such magnitude. India won the first one-day international on December 11, 1975, by defeating Australia by 17 runs in the final. The next two Cricket World Cups held in 1979 and 1983 were again hosted by England. The Women's Cricket World Cup was first held in 1982 in England, where it was held in 1990.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Men's Cricket World Cup was first held in England in 1975. The winning team was India, who defeated Australia by 17 runs in the final to win the tournament. The next two Cricket World Cups were held in 1979 and 1983, both in England." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "What is the queen of spades worth in rummy?", "passages": [ [ "Rummy", "Rummy\n\nRummy is a group of matching-card games notable for similar gameplay based on matching cards of the same rank or sequence and same suit.", "The basic goal in any form of rummy is to build \"melds\" which consists of sets, three or four of a kind of the same rank; or runs, three or more cards in sequence, of the same suit.", "If a player discards a card, making a run in the discard pile, it may not be taken up without taking all cards below the top card.", "The Mexican game of Conquian is considered by games scholar David Parlett to be ancestral to all rummy games, which itself is derived from a Chinese game called Khanhoo and, going further back, Mahjong." ], [ "Continental Rummy", "Continental Rummy\n\nContinental Rummy (also called Continental, May I?, and Double-deck rummy) is a progressive partnership Rummy card game related to Rumino.", "It is considered the forerunner of the whole family of rummy games using two packs of cards as one.", "Its name derives from the fact that it is played throughout the United States, Mexico, Canada, and also in South America.", "According to Albert Morehead, it was \"at one time the most popular form of Rummy in women's afternoon games, until in 1950 it lost out to Canasta.\"", "The object of Continental Rummy is to be the player with the fewest penalty points after playing all seven hands.", "Everyone draws one card, the high card deals, and the subsequent deals are passed to the left.", "Two 52-card decks are used plus two Jokers per deck.", "The number of decks used additional to the base of two is determined by dividing the number of players by two and rounding up, if needed.", "For example:\n\n\nEach player is dealt 12 cards, the remaining stock pile is set on the table.", "Jokers and red Aces are wild.", "After a card is drawn, one must be discarded, and the next player to the left has the option of drawing either the top discard or top stock card then he must discard." ], [ "Bing rummy", "In the above example, a player (provided that they melded their three sets to start) could also meld a king, a 7 of clubs or jack of clubs, or a 3.", "Since a player\u2019s meld does not score any points, those cards would be placed on the other player\u2019s meld.", "An important rule about melding is that a player cannot meld in such a way so that the cards left in their hand would put them over 75 points.", "For example, a player starts the hand with 63 points.", "They can only meld if they will have 12 or fewer points left in their hand.", "Moreover, whenever they draw/discard they must ensure their hand stays under 12 points.", "When a player has melded all 14 cards, the players count up the points in their hand with each card valued as its rank, face cards are 10 points (A hand with 6, Q, Q would be 26 points) and aces are 15 points (A hand with A, 3 would be 18 points).", "This total is added to the player\u2019s running score and if he finishes with a score of 76 or more he can buy in for the starting amount of cash, he would then have a score equal to the highest score of 75 or less.", "A player with less than 76 points wins when all the other players have 76 points or more." ] ], "gold": "Rummy, a group of matching-card games, has a large number of games derived from it. In basic rummy, gin rummy, and 500 rummy, the queen of spades is worth 10 points. However, in Mille rummy, the queen of spades is worth 100 points.", "prediction 1": "In Rummy, the queen of spades is worth 26 points. In the game of Bing Rummy, the queen of spades is worth 77 points.", "prediction 2": "In some games, the queen of spades is worth more than the king of clubs. The queen of clubs is worth 66 points. In Continental Rummy, the queen of clubs is worth 62 points.", "prediction 3": "The queen of spades is worth 10 points in rummy. The queen of clubs is worth 7 points in rummy. The queen of clubs is worth 18 points.", "prediction 4": "Rummy is a group of matching-card games notable for similar gameplay based on matching cards of the same rank or sequence and same suit. In Continental Rummy, the queen of spades is worth 20 points, the ace of spades is worth 26 points, and the king of clubs is worth 30 points. The jack of clubs is worth 12 points, and the queen of spades is worth 13 points.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 49 }, { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 116 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Rummy is a group of matching-card games." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays rabbit's girlfriend in 8 mile?", "passages": [ [ "8 Mile (film)", "8 Mile (film)\n\n8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem, Mekhi Phifer, Brittany Murphy, Michael Shannon, and Kim Basinger.", "The film is based loosely on Eminem's actual upbringing, and follows white rapper B-Rabbit (Eminem) and his attempt to launch a career in a genre dominated by African-Americans.", "The title is derived from 8 Mile Road, the highway between the predominantly black city of Detroit and Wayne County and the predominantly White Oakland County and Macomb County suburbs.", "It was filmed mostly on location.", "\"8 Mile\" was a critical and commercial success.", "Eminem won the Academy Award for Best Original Song for \"Lose Yourself\".", "In 1995 Detroit, Jimmy \"B-Rabbit\" Smith Jr. is a young, unhappy blue-collar worker from a poor family.", "He has moved back north of 8 Mile Road to the run-down trailer home in Warren, Michigan of his alcoholic mother Stephanie, his little sister Lily, and Stephanie's abusive live-in boyfriend Greg.", "Although encouraged by his friends, Jimmy worries about his potential as a rapper.", "He falters during a rap battle one night at a local venue, the Shelter, and he leaves the stage humiliated.", "Jimmy works at a car factory." ] ], "gold": "8 Mile is a 2002 American musical drama film written by Scott Silver and directed by Curtis Hanson. It stars Eminem as Jimmy \"B-Rabbit\" Smith Jr., alongside Mekhi Phifer, as future Jimmy's closest friend and the rap battle host, Brittany Murphy as Alex Latourno, Jimmy's love interest, and Taryn Manning as Janeane, Jimmy's ex-girlfriend. The film, which contains autobiographical elements from Eminem's life, follows white rapper B-Rabbit, Eminem, and his attempt to launch a career in hip hop, a genre dominated by African-Americans. ", "prediction 1": "8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem, Mekhi Phifer, Brittany Murphy, Michael Shannon, and Kim Basinger, and is loosely based on Eminem's actual upbringing. The film follows white rapper B-Rabbit and his attempt to launch a career in a genre dominated by African-Americans. Mekhi played rabbit's girlfriend in the movie while Brittany played Rabbit's mother Stephanie.", "prediction 2": "8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem and Mekhi Phifer. Brittany Murphy plays rabbit's girlfriend in the film.", "prediction 3": "8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem, Mekhi Phifer, Brittany Murphy, Michael Shannon, and Kim Basinger. In the film, Stephanie, Rabbit's girlfriend, is played by Mekhi Phifer.", "prediction 4": "8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem, Mekhi Phifer, Brittany Murphy, Michael Shannon, and Kim Basinger. The film follows white rapper B-Rabbit and his attempt to launch a career in a genre dominated by African-Americans. Mekhi plays a young, alcoholic mother to rabbit's little sister Lily and Stephanie plays a young, abusive boyfriend to rabbit's abusive boyfriend Greg.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 345, "end": 439 } ], "missing-info": [], "corrected-prediction": "8 Mile is a 2002 American drama film written by Scott Silver, directed by Curtis Hanson, and starring Eminem, Mekhi Phifer, Brittany Murphy, Michael Shannon, and Kim Basinger, and is loosely based on Eminem's actual upbringing. The film follows white rapper B-Rabbit and his attempt to launch a career in a genre dominated by African-Americans. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What is the main organs of the integumentary system?", "passages": [ [ "Integumentary system", "Integumentary system\n\nThe integumentary system comprises the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside.", "The integumentary system includes hair, scales, feathers, hooves, and nails.", "It has a variety of additional functions; it may serve to waterproof, and protect the deeper tissues, excrete wastes, and regulate temperature, and is the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature.", "In most land vertebrates with significant exposure to sunlight, the integumentary system also provides for vitamin D synthesis.", "The skin is the largest organ of the body.", "In humans, it accounts for about 12 to 15 percent of total body weight and covers 1.5-2m of surface area.", "The human skin (integument) is composed of at least two major layers of tissue: the epidermis and dermis.", "(The hypodermis or subcutaneous layer is not part of the skin.)", "The epidermis is the outermost layer, providing the initial barrier to the external environment." ] ], "gold": "The integumentary system is the set of organs forming the outermost layer of an animal's body. It has a variety of functions; it may serve to maintain water balance, protect the deeper tissues, excrete wastes, and regulate\u00a0body temperature, and is the attachment site for\u00a0sensory receptors\u00a0to detect pain, sensation, pressure, and temperature. The skin and its appendages make up the integumentary system. The skin is the largest organ of the body and the main organ of the system. The appendages include hair,\u00a0scales,\u00a0feathers,\u00a0hooves, and\u00a0nails.", "prediction 1": "The integumentary system consists of the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside. The integumentary system includes hair, scales, feathers, hooves, and nails. It has a variety of additional functions; it may serve to waterproof, and protect the deeper tissues, excrete wastes, and regulate temperature, and is the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature.", "prediction 2": "The integumentary system comprises the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside. The integumentary system includes hair, scales, feathers, hooves, and nails. It has a variety of additional functions, including serving to waterproof, and protect the deeper tissues, excreting wastes, and regulating temperature. It is also the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature.", "prediction 3": "The integumentary system comprises the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside. The integumentary system includes hair, scales, feathers, hooves, and nails. It has a variety of additional functions, such as it may serve to waterproof, and protect the deeper tissues, excrete wastes, and regulate temperature, and is the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature.", "prediction 4": "The integumentary system comprises the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside. The integumentary system includes hair, scales, feathers, hooves, and nails. It has a variety of additional functions, including it may serve to waterproof, and protect the deeper tissues, excrete wastes, regulate temperature, and is the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The integumentary system consists of the skin and its appendages acting to protect the body from various kinds of damage, such as loss of water or damages from outside. The integumentary system includes hair, scales, feathers, hooves, and nails. It has a variety of additional functions; it may serve to waterproof, and protect the deeper tissues, excrete wastes, and regulate temperature, and is the attachment site for sensory receptors to detect pain, sensation, pressure, and temperature. The skin is the largest organ of the body." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What year is outlander season 3 set in?", "passages": [ [ "Outlander (franchise)", "Outlander (franchise)\n\nThe \"Outlander\" franchise is a series of novels, short fiction, and related works.", "It is composed of the core \"Outlander\" novel series, the \"Lord John\" novel series spin-off, adaptations , a theatrical , and a television series.", "The core \"Outlander\" series is a sequence of novels and shorter works written by Diana Gabaldon that feature elements of historical fiction, romance, mystery, adventure and science fiction/fantasy.", "The franchise has expanded to include the 2014 television drama series \"Outlander\" on Starz, a 2010 graphic novel and a 2010 musical album called \"\".", "Gabaldon has also spun off recurring secondary character Lord John Grey into the \"Lord John\" series, a sequence of novels and shorter works that can be generally categorized as historical mysteries.", "The \"Outlander\" series focuses on 20th-century British nurse Claire Randall, who time travels to 18th-century Scotland and finds adventure and romance with the dashing Highland warrior Jamie Fraser.", "The \"Outlander\" series has been released in unabridged (read by Davina Porter) and abridged audiobooks (read by Geraldine James).", "Several of the \"Lord John\" books have been released in audiobook form, read by Jeff Woodman." ], [ "Outlander (TV series)", "Outlander (TV series)\n\nOutlander is a drama television series based upon author Diana Gabaldon's historical time travel book series of the same name.", "Developed by Ronald D. Moore and produced by Sony Pictures Television and Left Bank Pictures for Starz, the show premiered on August 9, 2014.", "It stars Caitriona Balfe as Claire Randall, a married World War II nurse who in 1945 finds herself transported back to 1743 Scotland, where she encounters the dashing Highland warrior Jamie Fraser (Sam Heughan) and becomes embroiled in the Jacobite risings.", "The second season of 13 episodes, based on \"Dragonfly in Amber\", premiered on April 9, 2016.", "On June 1, Starz renewed the series for a third and fourth season, which adapt the third and fourth \"Outlander\" novels, \"Voyager\" and \"Drums of Autumn\".", "The 13-episode third season premiered on September 10, 2017, and concluded on December 10, 2017.", "The 13-episode fourth season premiered on November 4, 2018, and Starz has renewed the series for a fifth and sixth season.", "In 1946, former World War II nurse Claire Randall and her husband Frank are visiting Inverness, Scotland, when she is carried back in time to the 18th century from the standing stones at Craigh na Dun." ], [ "Lord John Grey (character)", "Subsequently, in \"Lord John and the Haunted Soldier\" (2007), the Royal Commission of Inquiry opens an inquiry into the circumstances surrounding the cannon explosion, and Grey is called to stand before a tribunal.", "He begins his own investigation as accusations threaten him and his half brother DeVane.", "In \"The Custom of the Army\" (2010), it is 1759 and Grey finds himself both about to be promoted within His Majesty\u2019s Army and fresh from a gentlemen's duel in which his opponent was killed.", "He gladly accepts an urgent summons from his old friend Charlie Carruthers, who is facing court-martial in Canada.", "There Grey meets and becomes romantically involved with a Native American man named Manoke.", "In 1760 in \"The Scottish Prisoner\" (2011), Grey and Jamie Fraser find themselves traveling together to Ireland to try to bring back an English soldier with the intent of instigating court-martial procedures against him.", "During this process they manage to begin to rebuild their friendship.", "Grey and Stephan von Namtzen finally consummate their long-simmering attraction.", "Grey later marries Isobel Dunsany, in part to take care of Jamie Fraser's illegitimate son William by Isobel's deceased sister Geneva.", "In 1765 Grey, by then a lieutenant-colonel, has retired from military life and is appointed the Governor of Jamaica." ] ], "gold": "Outlander is a television drama series based on the Outlander series of historical time travel novels by Diana Gabaldon. It stars Caitr\u00edona Balfe as Claire Randall, a married former World War II nurse, later surgeon, who in 1946 finds herself transported back to the Scotland of 1743 where she meets and falls in love with the dashing Highland warrior Jamie Fraser and becomes embroiled in the Jacobite risings. Season 3, episode 1, is set in 1948 when Claire is in her present and in 1746 when characters are in the past. Season 3 episode 5 is set in 1968 for Roger, but in 1765 for Claire when she is in the past.", "prediction 1": "The Outlander franchise is a series of novels, short fiction, and related works. It is composed of the core Outlander novel series, the Lord John novel series spin-off, adaptations, a theatrical, and a television series. Season 3 was set in 1643, and season 4 was set in 1765. The third and fourth season were set in 1762, and the fifth and sixth season were set in 1765.", "prediction 2": "Outlander is a television series based upon author Diana Gabaldon's historical time travel novel series of the same name that follows 20th-century British nurse Claire Randall, who finds herself transported back to 1743 Scotland, where she encounters the dashing Highland warrior Jamie Fraser. The 13-episode third season premiered on September 10, 2017, and concluded on December 10, 2017. The 13-episode fourth season premiered on November 4, 2018, and Starz has renewed the series for a fifth and sixth season.", "prediction 3": "In 2017, outlander season 3 was set in the year 1745, in 2020, it is the year 1766, and in 2025, it is the year 1766. It was also set in 1766, 1766, and 1767.", "prediction 4": "The Outlander franchise is a series of novels, short fiction, and related works composed of the core Outlander novel series, the Lord John novel series spin-off, adaptations, a theatrical production, and a television series. The core Outlander series is a sequence of novels and shorter works written by Diana Gabaldon that feature elements of historical fiction, romance, mystery, adventure, and science fiction/fantasy. The Outlander TV series focuses on 20th-century British nurse Claire Randall, who time travels to 18th-century Scotland, where she meets the dashing Highland warrior Jamie Fraser.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 80 }, { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 220 }, { "error type": "Unverifiable", "explanation": "", "start": 221, "end": 276 }, { "error type": "Unverifiable", "explanation": "", "start": 277, "end": 371 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Outlander is a television drama series based on the Outlander series of historical time travel novels by Diana Gabaldon. It stars Caitriona Balfe as Claire Randall, a married World War II nurse who in 1945 finds herself transported back to 1743 Scotland, where she encounters the dashing Highland warrior Jamie Fraser (Sam Heughan) and becomes embroiled in the Jacobite risings. The 13-episode third season premiered on September 10, 2017, and concluded on December 10, 2017. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Where was the movie the princess bride filmed?", "passages": [ [ "The Princess Bride (film)", "The Princess Bride (film)\n\nThe Princess Bride is a 1987 American romantic comedy fantasy adventure film directed and co-produced by Rob Reiner, starring Cary Elwes, Robin Wright, Mandy Patinkin, Chris Sarandon, Wallace Shawn, Andr\u00e9 the Giant, and Christopher Guest.", "Adapted by William Goldman from his 1973 novel of the same name, it tells the story of a farmhand named Westley, accompanied by companions befriended along the way, who must rescue his true love Princess Buttercup from the odious Prince Humperdinck.", "The film effectively preserves the novel's narrative style by presenting the story as a book being read by a grandfather (Peter Falk) to his sick grandson (Fred Savage).", "The film was first released in the United States on September 25, 1987, and was well-received by critics at the time, but was only a modest box office success.", "Over time, particularly with the introduction of the Internet, the film has become a cult classic.", "The film is number 50 on Bravo's \"100 Funniest Movies\", number 88 on The American Film Institute's (AFI) \"AFI's 100 Years...100 Passions\" list of the 100 greatest film love stories, and 46 in Channel 4's 50 Greatest Comedy Films list." ], [ "The Princess Bride (film)", "Mandy Patinkin and Wallace Shawn were early choices for the cast; Shawn in particular was chosen as Vizzini due to his diminutive size to contrast that of the giant Fezzik.", "For Fezzik, the production crew told Jenkins they wanted someone the likes of Andre the Giant in size.", "She contacted the World Wrestling Federation to ask about hiring Andre, but were told that the filming conflicted with a wrestling match in Tokyo that would pay him $5 million.", "Jenkins auditioned other tall men, including Kareem Abdul-Jabbar, Lou Ferrigno, and Carel Struycken, but these didn't pan out.", "Near the end of filming, the World Wrestling Federation told Jenkins that Andre's match in Tokyo had been cancelled, clearing him to play the part in their film.", "The film was shot in various locations in Great Britain and Ireland:\n\nThe framing story scenes, the last to be filmed, were recorded at Shepperton Studios in Surrey.", "Reiner rented a house in England near these sites and frequently invited the cast over for meals and light-hearted get-togethers.", "Many cast members believed this helped to create a sense of \"family\" that helped to improve their performances for the film." ] ], "gold": "The Princess Bride is a 1987 American fantasy adventure comedy film directed and co-produced by Rob Reiner and adapted by William Goldman from his 1973 novel. The movie tells the story of a farmhand named Westley, who must rescue his true love Princess Buttercup from the odious Prince Humperdinck. The filming was completed throughout various locations in 1986. In England, the sites of Cave Dale, Castleton, Derbyshire, Burnham Beeches, Buckinghamshire, Penshurst Place, Kent, Haddon Hall, Bakewell, Derbyshire, Lathkill Dale, Shepperton Studios in Surrey, Carl Wark, Sheffield, and Bradley Rocks and Robin Hood's Stride, Birchover, Derbyshire were chosen to shoot different scenes, while, in Ireland, parts of the movie were filmed over in the Cliffs of Moher, County Clare.", "prediction 1": "The Princess Bride is a 1987 American romantic comedy fantasy adventure film directed and co-produced by Rob Reiner, starring Cary Elwes, Robin Wright, Mandy Patinkin, Chris Sarandon, Andr\u00e9 the Giant, Christopher Guest, and Christopher Guest. The film was shot in various locations in Great Britain and Ireland, including The Prince of Persia, Shepperton Studios in Surrey, and the last scenes to be filmed at Kingswood Park in London.", "prediction 2": "The Princess Bride is a 1987 American romantic comedy fantasy adventure film directed and co-produced by Rob Reiner, starring Cary Elwes, Robin Wright, Mandy Patinkin, Chris Sarandon, Andr\u00e9 the Giant, and Christopher Guest. The film was shot in various locations in Great Britain and Ireland. The framing story scenes, the last to be filmed, were recorded at Shepperton Studios in Surrey.", "prediction 3": "The Princess Bride is a 1987 American romantic comedy fantasy film directed and co-produced by Rob Reiner, starring Cary Elwes, Robin Wright, Mandy Patinkin, Chris Sarandon, Andr\u00e9 the Giant, and Christopher Guest. The film was shot in various locations in Great Britain and Ireland. The framing story scenes, the last to be filmed, were recorded at Shepperton Studios in Surrey. Reiner rented a house in England near these sites and frequently invited the cast over for meals and light-hearted get-togethers.", "prediction 4": "The Princess Bride is a 1987 American romantic comedy fantasy adventure film directed and co-produced by Rob Reiner, starring Cary Elwes, Robin Wright, Chris Sarandon, Wallace Shawn, Andr\u00e9 the Giant, and Christopher Guest. The film was shot in various locations in Great Britain and Ireland: The framing story scenes, the last to be filmed, were recorded at Shepperton Studios in Surrey. Reiner rented a house in England near these sites and frequently invited the cast over for meals and light-hearted get-togethers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 242 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 374, "end": 435 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Princess Bride is a 1987 American romantic comedy fantasy adventure film directed and co-produced by Rob Reiner and adapted by William Goldman from his 1973 novel. The movie tells the story of a farmhand named Westley, who must rescue his true love Princess Buttercup from the odious Prince Humperdinck. The film was shot in various locations in Great Britain and Ireland: The framing story scenes, the last to be filmed, were recorded at Shepperton Studios in Surrey." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "When did call of duty ww2 come out?", "passages": [ [ "Call of Duty: WWII", "Call of Duty: WWII\n\nCall of Duty: WWII is a first-person shooter video game developed by Sledgehammer Games and published by Activision.", "It was released worldwide on November 3, 2017 for Microsoft Windows, PlayStation 4 and Xbox One.", "It is the fourteenth main installment in the \"Call of Duty\" series and the first title in the series to be set primarily during World War II since \"\" in 2008.", "The game's campaign is set in the European theatre and is centered around a squad in the 1st Infantry Division following their battles on the Western Front and set mainly in the historical events of Operation Overlord.", "The player controls Ronald \"Red\" Daniels, who has squadmates who can supply the player with extra ammunition, health, or grenades; none of these are automatically replenished in the campaign.", "The multiplayer mode features map locations not seen in the campaign.", "The mode also features the new Divisions system, replacing the create-a-class system that previous games in the series used.", "A social hub, Headquarters, was also implemented into the game, allowing for players to interact with each other.", "Sledgehammer Games were interested in bringing the series back to World War II after developing their previous title, \"\" (2014), which featured advanced movements and futuristic warfare technology." ], [ "Call of Duty: World at War", "The three multiplayer maps are \"Battery\", which takes place on an abandoned coastal artillery battery Pacific; \"Breach\", which is set in the overcrowded streets of Berlin, Germany near the Brandenburg Gate; and \"Revolution\", which is based on an industrialized city in Russia.", "The new Nazi Zombies map, \"Der Riese\" which means \"The Giant\" in English, is based in a factory where \"element 115\" is being processed and used to build teleporters and other mysterious devices, such as the \"Pack-a-Punch Machine\", which upgrades guns, such as the Wunderwaffe DG-2.", "New weapons such as Monkey Bombs were also added.", "This map also introduced the official backstory to Zombies mode, which is continued into \"\".", "All map packs were released for free on Microsoft Windows.", "The packs were paid DLC for the Xbox 360 and PS3.", "\"Call of Duty: World at War\" was released for the Nintendo DS on November 11, 2008 in North America, and on November 14 in Europe.", "It was published by Activision and developed by n-Space, who used the same game engine as their previous title, \"\".", "The game's scenarios are also based on World War II's Pacific theater and Eastern front with American, British and Soviet campaigns." ], [ "Call of Duty", "The game continues the story from the point at which it ended in the \"\" and continues the fictional battle story between the United States and Russia, which evolves into the Third World War between NATO allied nations and ultra-nationalist Russia.", "\"\", developed by Treyarch, is the fifth installment of the main series.", "Released after \"Modern Warfare\", it returns to the World War II setting of earlier titles, featuring the Pacific theater and Eastern front.", "The game uses the same proprietary game engine as \"Call of Duty 4\" and was released for the PC, PlayStation 3, Wii, Xbox 360 consoles and the Nintendo DS handheld in North America on November 11, 2008, and November 14, 2008 in Europe.", "As of June 2009, \"Call of Duty: World at War\" has sold over 11 million copies.", "It acts as a prologue for Treyarch's next game, \"Black Ops\", which is in the same universe, sharing characters and story references.", "\"Call of Duty: Black Ops\" is the seventh installment in the series, the third developed by Treyarch, and was published by Activision for release on November 9, 2010.", "It is the first game in the series to take place during the Cold War and also takes place partially in the Vietnam War." ] ], "gold": "Call of Duty: WWII is a first-person shooter video game developed by Sledgehammer Games and published by Activision. It was released worldwide on November 3, 2017 for Microsoft Windows, PlayStation 4 and Xbox One. It is the fourteenth main installment in the Call of Duty series and the first title in the series to be set primarily during World War II since Call of Duty: World at War in 2008. Call of Duty: World At War came out on November 11, 2008 in North America, November 12, 2008 in Australia, and in November 14, 2008 in the EU.", "prediction 1": "Call of Duty: WWII is a first-person shooter video game developed by Sledgehammer Games and published by Activision. It was released worldwide on November 3, 2017 for Microsoft Windows, PlayStation 4 and Xbox One. Call of Duty: WWII was released for the Nintendo DS on November 11, 2008 in North America, and on November 14, 2008 in Europe.\n", "prediction 2": "Call of Duty: WWII, the fourteenth installment in the Call of Duty series, was released for the Nintendo DS in North America on November 11, 2008, and November 14, 2008 in Europe. It came out for the PS4, Xbox One and PC in November 3, 2017. Inside the game, players take control of different characters and squads.", "prediction 3": "Call of Duty: WWII, the 14th installment in the Call of Duty video game series, was released on November 3, 2017 for Microsoft Windows and Xbox One. Call of Duty: WWII was first released on the Nintendo DS in North America on November 11, 2008, and on November 14 in Europe. The game was released on November 9, 2010 for the Xbox 360 and Nintendo DS.", "prediction 4": "Call of Duty: WWII is a first-person shooter video game developed by Sledgehammer Games and published by Activision, which was released worldwide on November 3, 2017 for Microsoft Windows, PlayStation 4 and Xbox One. It is the fourteenth main installment in the Call of Duty series and the first title in the series to be set primarily during World War II since 2008's Call of Duty: Modern Warfare. Call of Duty: World at War was released for the Nintendo DS on November 11, 2008 in North America, and on November 14, 2008 in Europe. The game was released worldwide on November 8, 2008, PlayStation 4, Xbox 360 and IBM PlayStation 4 in Asia, Macau, and the Nintendo DS on November 12, 2011.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 228, "end": 232 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Call of Duty: WWII is a first-person shooter video game developed by Sledgehammer Games and published by Activision. It was released worldwide on November 3, 2017 for Microsoft Windows, PlayStation 4 and Xbox One. It is the fourteenth main installment in the Call of Duty series and the first title in the series to be set primarily during World War II since Call of Duty: World at War in 2008. Call of Duty: World At War was released for the Nintendo DS on November 11, 2008 in North America, and on November 14, 2008 in Europe.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did canada change from miles to kilometers?", "passages": [ [ "Metrication in Canada", "Metrication in Canada\n\nMetrication in Canada began in 1970 and while Canada has converted to the metric system for many purposes, there is still significant use of non-metric units and standards in many sectors of the Canadian economy.", "This is mainly due to historical ties with the United Kingdom (before metrication), the traditional use of the imperial system of measurement in Canada, proximity to the United States, and to public opposition to metrication during the transition period.", "Until the 1970s, Canada traditionally used the Imperial measurement system, labelled as \"Canadian units of measurement\" under Schedule II of the \"Weights and Measures Act\" (R.S., 1985, c. W-6).", "These units have the same name and, with the exception of capacity measures such as the gallon, the same values as US customary units.", "For example, before metrication in Canada, gasoline was sold by the imperial gallon (about 4.55 litres).", "In cross-border transactions, it was often unclear whether values quoted in gallons, etc. were referring to the US values (3.79 litres) or the imperial values of these units.", "The fact that a higher price was being charged did not always resolve the matter.", "The Liberal federal government of Pierre Trudeau first began implementing metrication in Canada in 1970 with a government agency dedicated to implementing the project, the Metric Commission, being established in 1971." ], [ "Metrication in Australia", "An important and very visible sign of metric conversion in Australia was the change in road signs and the accompanying traffic regulations; \"M-day\" for this change was 1 July 1974.", "Because of careful planning, almost every road sign in Australia was converted within a month.", "This was achieved by installing covered metric signs alongside the imperial signs before the change and then removing the imperial sign and uncovering the metric sign during the month of conversion.", "While road signs could not all be changed at the same time, there was little chance of confusion as to what any speed limit sign meant during this short change-over period.", "This was because the previous (MPH) signs had the signage in black on white and were rectangular, in the same style as current US speed limit signs, while the (km/h) signs which replaced them had the number indicating the speed limit inside a red circle, as is done in Europe.", "Road distance signs were also converted during this period.", "To avoid confusion as to whether the distance indicated was in miles or kilometres all the new kilometre signs had affixed to them a temporary yellow plate, on which was indicated the corresponding number of miles.", "These temporary plates were removed after about one year.", "Except for bridge-clearance and flood-depth signs, dual marking was avoided." ] ], "gold": "Metrication in Canada began in 1970 and ceased in 1985. While Canada has converted to the metric system for many purposes, there is still significant use of non-metric units and standards in many sectors of the Canadian economy and everyday life today. During the Labor Day weekend in 1977, every speed limit sign in the country was changed from mph to km/h. From the same time every new car sold had to have a speedometer that showed speed in km/h and distance in km. The distances on road signs were changed to kilometers during the next few months.", "prediction 1": "Canada converted to the metric system for many purposes in 1970, but still uses the imperial system of measurement for many purposes. Metrication in Canada began in 1970. An important and very visible sign of metric conversion in Australia was the change in road signs and the accompanying traffic regulations. \"M-day\" for this change was 1 July 1974.", "prediction 2": "Canada switched from miles to kilometers in 1970. The change began on 1 July 1974, so road signs were converted from miles to kilometers on 1 July 1974.", "prediction 3": "Metrication in Canada originated in 1970 and while Canada has converted to the metric system for many purposes, there is still significant use of non-metric units and standards in many sectors of the Canadian economy. This is mainly due to historical ties with the United Kingdom (before metrication), the traditional use of the imperial system of measurement in Canada, proximity to the United States, and to public opposition to metrication during the transition period. An important and very visible sign of metric conversion in Australia was the change in road signs and the accompanying traffic regulations; \"M-day\" for this change was 1 July 1974. Because of careful planning, almost every road sign in Australia was converted within a month. Because of careful planning, almost every road sign in Australia was converted within a month. Because of careful planning, almost every road sign in Australia was converted within a month.", "prediction 4": "The first official date for Canada to change from miles to kilometers was 1 July 1974. This was the \"M-day\" for metrication.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 351 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Metrication in Canada began in 1970 and while Canada has converted to the metric system for many purposes, there is still significant use of non-metric units and standards in many sectors of the Canadian economy." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who plays queen of hearts in alice in wonderland?", "passages": [ [ "Red Queen (Through the Looking-Glass)", "In both \"American McGee's Alice\" and Tim Burton's film adaptation of the books, the characters are also combined, leading to further popular misconception.", "Also, Jefferson Airplane's song \"White Rabbit\" contains the lyric \"and the Red Queen's off with her head\", another instance of the two characters combined or mistaken for one another (as the phrase \"off with his/her head\" is constantly uttered only by the Queen of Hearts in \"Alice's Adventures in Wonderland\").", "However, American McGee's game implies that after Alice was put into the asylum the Queen of Hearts and Red Queen fused together.", "The 2010 live-action film \"Alice in Wonderland\", fashioned as a sequel to the novel, features Helena Bonham Carter as the Red Queen.", "Bonham Carter's head was digitally increased three times its original size on screen.", "Bonham Carter's character is a combination of the Red Queen, the Duchess and the Queen of Hearts.", "From the original Red Queen, this character gets only a relationship to the White Queen.", "Here the Red Queen is the older sister of the White Queen, and is jealous of her sister, whom her subjects genuinely love.", "From the original John Tenniel illustrations of the Duchess, she gets a massive head in proportion to her body and a retinue of frog footmen." ], [ "Alice in Wonderland (1951 film)", "Alice in Wonderland (1951 film)\n\nAlice in Wonderland is a 1951 American animated musical fantasy-adventure film produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll.", "the 13th release of Disney's animated features, the film premiered in London on July 26, 1951 and in New York City on July 28, 1951.", "The film features the voices of Kathryn Beaumont as Alice, Sterling Holloway as the Cheshire Cat, Verna Felton as the Queen of Hearts, and Ed Wynn as the Mad Hatter.", "Walt Disney first attempted unsuccessfully to adapt \"Alice\" into an animated feature film during the 1930s.", "However, he finally revived the idea in the 1940s.", "The film was originally intended to be a live-action/animated film; however, Disney decided to make it an all-animated feature in 1946.", "The film was considered a flop on its initial release, leading to Walt Disney showing it on television as one of the first episodes of his TV series Disneyland.", "It proved to be very successful on Television, especially during the psychedelic era.", "It was eventually re-released in theaters which proved to be massively successful.", "The film became even more successful though merchandising and subsequent home video releases.", "The theme song of the same name has since become a jazz standard." ], [ "Walt Disney Pictures", "Walt Disney Pictures\n\nWalt Disney Pictures, formally known as Buena Vista Pictures, is an American film studio and a subsidiary of Walt Disney Studios, owned by The Walt Disney Company.", "The subsidiary is the main producer of live-action feature films within the Walt Disney Studios unit, and is based at the Walt Disney Studios in Burbank, California.", "It took on its current name in 1983.", "Today, in conjunction with the other units of Walt Disney Studios, Walt Disney Pictures is regarded as one of Hollywood's \"Big Six\" film studios.", "Films produced by Walt Disney Animation Studios and Pixar are also released under this brand.", "\"Pirates of the Caribbean\" is the studio's most successful franchise, with two of its sequels, released in and , earning over $1 billion in worldwide box office gross.", "The studio's predecessor (and the modern-day The Walt Disney Company's as a whole) was founded as the Disney Brothers Cartoon Studio, by filmmaker Walt Disney and his business partner and brother, Roy, in 1923.", "The creation of Mickey Mouse and subsequent short films and merchandise generated revenue for the studio which was renamed as The Walt Disney Studio at the Hyperion Studio in 1926.", "In 1929, it was renamed again to Walt Disney Productions." ] ], "gold": "The Walt Disney Company has produced many adaptations of Lewis Carroll's novel \"Alice in Wonderland.\" For instance, an animated musical fantasy movie by the same name was released in 1951, where Verna Felton portrays the character of the Queen of Hearts. The Queen appeared again in 2010 in a live-action/animated dark fantasy adventure film based on the book and directed by Tim Burton, where the role fell in the hands of Helena Bonham Carter. She played the character once more in the 2016 sequel \"Alice Through the Looking Glass.\"", "prediction 1": "Verna Felton plays the Queen of Hearts in the 1951 animated film Alice in Wonderland. In the 2010 live-action film, Alice in Wonderland II: Through the Looking-Glass, Helena Bonham Carter plays the Queen of Hearts.", "prediction 2": "There are several movies that have been made about Alice in Wonderland. The 1951 animated musical fantasy-adventure film, Alice in Wonderland, is based on the Alice books by Lewis Carroll. In the 2010 live-action film Alice in Wonderland, Helena Bonham Carter plays the Queen of Hearts.", "prediction 3": "The 1951 animated musical fantasy-adventure film Alice in Wonderland features the voices of Kathryn Beaumont as Alice, Sterling Holloway as the Cheshire Cat, Verna Felton as the Queen of Hearts, and Ed Wynn as the Mad Hatter. In the 2010 live-action film Alice in Wonderland, fashioned as a sequel to the novel, Helena Bonham Carter plays the Queen of Hearts.", "prediction 4": "In the 1951 animated musical fantasy-adventure film Alice in Wonderland, Verna Felton plays the Queen of Hearts. Additionally, in \"American McGee's Alice\" and Tim Burton's film adaptation of the books, the characters are also combined, leading to further popular misconception. In the 2010 live-action film, \"Alice in Wonderland\", fashioned as a sequel to the novel, Helena Bonham Carter plays the Queen of Hearts.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 136, "end": 166 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Verna Felton plays the Queen of Hearts in the 1951, American animated musical fantasy-adventure film, produced by Walt Disney Productions and based on the \"Alice\" books by Lewis Carroll, Alice in Wonderland. In the 2010 live-action film, Alice in Wonderland, Helena Bonham Carter plays the Queen of Hearts." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How many barrel of oil are used each day?", "passages": [ [ "2000s energy crisis", "World demand for oil is projected to increase 37% over 2006 levels by 2030, according to the 2007 U.S. Energy Information Administration's (EIA) annual report.", "In 2007, the EIA expected demand to reach an ultimate high of , from 2006's , driven in large part by the transportation sector.", "A 2008 report from the International Energy Agency (IEA) predicted that although drops in petroleum demand due to high prices have been observed in developed countries and are expected to continue, a 3.7 percent rise in demand by 2013 is predicted in developing countries.", "This is projected to cause a net rise in global petroleum demand during that period.", "Transportation consumes the largest proportion of energy, and has seen the largest growth in demand in recent decades.", "This growth has largely come from new demand for cars and other personal-use vehicles powered by internal combustion engines.", "This sector also has the highest consumption rates, accounting for approximately 55% of oil use worldwide as documented in the Hirsch report and 68.9% of the oil used in the United States in 2006.", "Cars and trucks are predicted to cause almost 75% of the increase in oil consumption by India and China between 2001 and 2025.", "In 2008, auto sales in China were expected to grow by as much as 15\u201320 percent, resulting in part from economic growth rates of over 10 percent for five years in a row." ] ], "gold": "There are 93 million barrels of oil used each day globally. 20,000,000 barrels of oil are used each day in the United States. In 2020, total worldwide oil consumption is expected to drop by 9% year over year compared to 2019 due to the COVID-19 pandemic according to the International Energy Agency.", "prediction 1": "The number of barrels of oil used per day in the United States is 83,680 barrels, and for the United States, it was 94,546 barrels, or 57.7 million barrels.", "prediction 2": "On average, 2.6 barrels of oil are used each day.", "prediction 3": "In the United States, 32,000 barrels of oil are used per day. In Europe, 400,000 barrels are used each day. In the United States, 3,300 barrels are used per day.", "prediction 4": "The United States uses an average of 2.6 barrels of oil per day.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 156 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "When did half pences go out of circulation?", "passages": [ [ "Half cent (United States coin)", "Half cent (United States coin)\n\nThe half cent is the smallest denomination of United States coin ever minted.", "It was first minted in 1793 and last minted in 1857.", "It was minted in five different appearances.", "First authorized by the Coinage Act of 1792 on April 2, 1792, the coin was produced in the United States from 1793 to 1857.", "The half-cent piece was made of 100% copper and was valued at five milles, or one two-hundredth of a dollar.", "It was slightly smaller than a modern U.S. quarter with diameters 22\u00a0mm (1793), 23.5\u00a0mm (1794\u20131836) and 23\u00a0mm (1840\u20131857).", "Coinage was discontinued by the Coinage Act of February 21, 1857.", "They were all produced at the Philadelphia Mint.", "There are several different types of half cents:\n\n\nThere are no mint marks on any of the coins (all minted at the Philadelphia Mint) and the edges are plain on most half cents.", "On the 1793 coin and a variety of the 1797 coin, it was lettered and another 1797 variety had a gripped, or milled, edge.", "Liberty Cap, Left\n\nLiberty Cap, Right\n\nDraped Bust\n\nClassic Head (Shown at top right)\n\nBraided Hair" ], [ "Halfpenny (British decimal coin)", "Halfpenny (British decimal coin)\n\n", "The British decimal halfpenny (p) coin was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling.", "It was ignored in banking transactions, which were carried out in units of 1p.", "The decimal halfpenny had the same value as 1.2 pre-decimal pence, and was introduced to enable the prices of some low-value items to be more accurately translated to the new decimal currency.", "The possibility of setting prices including an odd half penny also made it more practical to retain the pre-decimal sixpence in circulation (with a value of new pence) alongside the new decimal coinage.", "The halfpenny coin's obverse featured the profile of Queen Elizabeth II; the reverse featured an image of St Edward's Crown.", "It was minted in bronze (like the 1p and 2p coins).", "It was the smallest decimal coin in both size and value.", "The size was in proportion to the 1p and 2p coins.", "It soon became Britain's least favourite coin.", "The Treasury had continued to argue that the halfpenny was important in the fight against inflation (preventing prices from being rounded up).", "The coin was demonetised and withdrawn from circulation in December 1984." ], [ "Halfpenny (Irish decimal coin)", "Halfpenny (Irish decimal coin)\n\nThe decimal halfpenny (p) () coin was the smallest denomination of the Irish pound.", "It was first issued when the Irish currency was decimalised on Decimal Day, 15 February 1971.", "It was one of three new designs introduced all in bronze and featuring ornamental birds on the reverse.", "The coin value was weakened by inflation and very few were produced beyond the initial run for 1971.", "It was removed from circulation and demonetised on 1 January 1987.", "The main reason that halfpennies were issued was that when shillings were decimalised they were worth five new pence, so a sixpence (half of a shilling) yielded a value of new pence.", "Its dimensions and appearance were the same as the British coin of the same denomination as the pounds of Britain and Ireland were pegged until 1979.", "The coin was designed by the Irish artist Gabriel Hayes and the design is adapted from the manuscript Cologne Collectio Canonum (Cologne, Dombibliothek Cod. 213) in Cologne.", "The coin has a diameter of 1.7145 centimetres and mass of 1.782 grams consisting of copper, tin and zinc.", "The coin was worth of an Irish pound.", "The 1985 version of this coin is particularly rare, and valuable to coin collectors - the vast majority of the 2.8 million were melted in 1987." ] ], "gold": "Several countries have halfpennies. The half cent was the smallest denomination of United States coin ever minted. It was first minted in 1793 and last minted in 1857. The British decimal halfpenny coin was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. The coin was demonetised and withdrawn from circulation in December 1984. Likewise, the decimal halfpenny coin was the smallest denomination of the Irish pound. It was removed from circulation and demonetised on January 1, 1987.", "prediction 1": "The half penny is the smallest denomination of United States coin ever minted. It was first minted in 1793 and last minted in 1857. The American half cent was first authorized by the Coinage Act of 1792 on April 2, 1792, and produced in the United States from 1793 to 1857. The British decimal halfpenny was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. It was ignored in banking transactions, which were carried out in units of 1p. The Irish decimal halfpenny was first issued when the Irish currency was decimalised on Decimal Day, 15 February 1971, and was removed from circulation and demonetised on 1 January 1987.", "prediction 2": "The half cent is the smallest denomination of United States coin ever minted. It was first minted in 1793 and last minted in 1857. The British decimal halfpenny was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. It was ignored in banking transactions, which were carried out in units of 1p. The decimal halfpenny was the smallest denomination of the Irish pound. It was first issued when the Irish currency was decimalised on Decimal Day, 15 February 1971. The decimal halfpenny was the smallest denomination of the Irish pound. It was removed from circulation and demonetised on 1 January 1987.", "prediction 3": "The half cent is the smallest denomination of United States coin ever minted. It was first minted in 1793 and last minted in 1857. The British decimal halfpenny coin was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. The halfpenny was removed from circulation and demonetised on 1 January 1987.", "prediction 4": "The half cent is the smallest denomination of United States coin ever minted. It was first authorized by the Coinage Act of 1792 on April 2, 1792, the coin was produced in the United States from 1793 to 1857. The British decimal halfpenny was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. It was ignored in banking transactions, which were carried out in units of 1p. The decimal halfpenny was first issued when the Irish currency was decimalised on Decimal Day, 15 February 1971. It was one of three new designs introduced all in bronze and featuring ornamental birds on the reverse. It was removed from circulation and demonetised on 1 January 1987.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 273 }, { "error type": "Irrelevant", "explanation": "", "start": 421, "end": 499 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 618 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 12 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The half penny is the smallest denomination of United States coin ever minted. It was first minted in 1793 and last minted in 1857. The British decimal halfpenny was introduced in February 1971, at the time of decimalisation, and was worth one two-hundredth of a pound sterling. The coin was demonetised and withdrawn from circulation in December 1984. The Irish decimal halfpenny was the smallest denomination of the Irish pound. It was removed from circulation and demonetised on 1 January 1987." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "La liga highest goal scorer in this season?", "passages": [ [ "Lionel Messi", "During the second half of the 2013\u201314 season, doubts persisted over Messi's form, leading to a perception among the \"cul\u00e9s\" that he was reserving himself for the 2014 FIFA World Cup.", "Statistically, his contribution of goals, shots, and passes had dropped significantly compared to previous seasons.", "He still managed to break two longstanding records in a span of seven days: a hat-trick on 16 March against Osasuna saw him overtake Paulino Alc\u00e1ntara's 369 goals to become Barcelona's top goalscorer in all competitions including friendlies, while another hat-trick against Real Madrid on 23 March made him the all-time top scorer in \"El Cl\u00e1sico\", ahead of the 18 goals scored by former Real Madrid player Alfredo Di St\u00e9fano.", "Messi finished the campaign with his worst output in five seasons, though he still managed to score 41 goals in all competitions.", "For the first time in five years, Barcelona ended the season without a major trophy; they were defeated in the Copa del Rey final by Real Madrid and lost the league in the last game to Atl\u00e9tico Madrid, causing Messi to be booed by sections of fans at the Camp Nou." ], [ "Lionel Messi", "In Bar\u00e7a's last home league match on 5 May, against Espanyol, Messi scored all four goals before approaching the bench to embrace Guardiola, who had announced his resignation as manager.", "He finished the season as league top scorer in Spain and Europe for a second time, with 50 goals, an all-time La Liga record, while his 73 goals in all competitions surpassed Gerd M\u00fcller\u2019s 67 goals in the 1972\u201373 Bundesliga season, making him the single-season top scorer in the history of European club football.", "Under manager Tito Vilanova, who had first coached him aged 14 at \"La Masia\", Messi helped the club achieve its best-ever start to a La Liga season during the second half of 2012, amassing 55 points by the competition's midway point, a record in Spanish football.", "A double scored on 9 December against Real Betis saw Messi break two longstanding records: he surpassed C\u00e9sar Rodr\u00edguez's record of 190 league goals, becoming Barcelona's all-time top scorer in La Liga, and Gerd M\u00fcller's record of most goals scored in a calendar year, overtaking his 85 goals scored in 1972 for Bayern Munich and Germany.", "Messi sent M\u00fcller a number 10 Barcelona shirt, signed \"with respect and admiration\", after breaking his 40-year record." ], [ "Pichichi Trophy", "Pichichi Trophy\n\nIn Spanish football, the Trofeo Pichichi is awarded by the sports newspaper \"Marca\" to the top goalscorer of each La Liga season.", "Named after the Athletic Bilbao striker Rafael \"Pichichi\" Moreno, the trophy has been awarded annually since the 1952\u201353 season.", "All top scorers who preceded the award's creation were retroactively named Pichichi winners by \"Marca\".", "Since the 2014\u201315 season, the top scorer of the Liga Iberdrola is also awarded the Pichichi Trophy.", "The Pichichi is not officially recognised by the league's governing body, the Liga de F\u00fatbol Profesional (LFP).", "As the award is based on \"Marca\"s subjective criteria, its data may differ from the official match delegate reports.", "For the top scorers in La Liga according to LFP data, see \"List of La Liga top scorers\"." ] ], "gold": "Lionel Messi holds the record for most goals scored in a single season in La Liga with 50 in the 2011\u201312 season. He was also the top goal scorer in the 2016-17 season with 37. Luis Su\u00e1rez was the top goal scorer in the 2015-16 season with 40 goals. Cristiano Ronaldo was the top scorer in La Liga in the 2014-15 season with 48 goals.", "prediction 1": "Barcelona's all-time top scorer in La Liga is Lionel Messi, who scored 91 goals in the 2013\u201314 season. The Scoring Record for the 2012\u201313 season is 190. Messi's 73 goals in all competitions surpassed Gerd M\u00fcller\u2019s 67 goals in the 1972\u201373 Bundesliga season, making him the single-season top scorer in the history of European club football.", "prediction 2": "La Liga has awarded the Trofeo Pichichi to the top goalscorer of each La Liga season since 1952. Named after Athletic Bilbao striker Rafael \"Pichichi\" Moreno, the award is awarded annually since the 1952\u201353 season, and is awarded to the top scorer of the Liga Iberdrola since the 2015\u201316 season.", "prediction 3": "In Spanish football, the Trofeo Pichichi is awarded by the sports newspaper \"Marca\" to the top goalscorer of each La Liga season. In the 2014-15 season, the top scorer of the Liga Iberdrola was awarded the Pichichi Trophy.", "prediction 4": "La Liga has a top scorer award. Lionel Messi finished the 2013-14 season as the top goal scorer in all competitions, scoring 63 goals. Messi finished the 2014-15 season as the top goal scorer in all competitions.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 71, "end": 73 }, { "error type": "Unverifiable", "explanation": "", "start": 87, "end": 102 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 31 }, { "error type": "Unverifiable", "explanation": "", "start": 130, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 338 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Messi finished a season by scoring 50 goals, an all-time La Liga record. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Ps i love you who wrote the letters?", "passages": [ [ "P.S. I Love You (film)", "As the film ends with Holly taking her mother on a trip to Ireland, we see that Holly has opened herself up to the journey beginning with the next chapter of her life, and wherever it takes her she has the hope of falling in love again.", "The major difference between the novel and its film adaptation is that, in the novel, the main characters Holly and Gerry Kennedy are Irish.", "In the film, only Gerry is Irish, Holly and her family are Irish Americans, and the two live in New York.", "Also in the novel, Holly has numerous siblings, but in the film she has one.", "The film adds a character called William, played by Jeffrey Dean Morgan.", "Another change is that in the books, the letters arrive all in a package together and Holly is expected to open them once a month.", "In the movie, the letters are delivered by mail.", "The film remains fairly true to the novel, and all of Gerry's letters are virtually unchanged.", "In \"A Conversation with Cecilia Ahern\", a bonus feature on the DVD release of the film, the author of the original novel discusses the Americanization of her story \u2014 which was set in Ireland \u2014 for the screen and her satisfaction with the plot changes which screenwriter/director Richard LaGravenese had to make in order to fit the book into the screen." ], [ "P.S. I Love You (film)", "P.S.", "I Love You (film)\n\n", "P.S.", "I Love You is a 2007 American romance film directed by Richard LaGravenese.", "The screenplay by LaGravenese and Steven Rogers is based on the 2004 novel of the same name by Cecelia Ahern.", "It stars Hilary Swank, Gerard Butler, Lisa Kudrow, Gina Gershon, James Marsters, Harry Connick Jr. and Jeffrey Dean Morgan.", "It was distributed by Warner Bros. Pictures and Momentum Pictures.", "Holly and Gerry are a married couple who live on the Lower East Side of Manhattan.", "They are deeply in love, but they fight occasionally.", "By winter that year, Gerry suddenly dies of a brain tumor, and Holly realizes how much he meant to her as well as how insignificant their arguments were.", "Deeply distraught, Holly withdraws from her family and friends out of grief until they descend upon her on her 30th birthday.", "They are determined to prod the young widow to face the future and explore what her life choices should be.", "As they rally around Holly and help organize her apartment, a cake is delivered, and with it is a message from Gerry.", "It proves to be the first of several meaningful messages \u2014 all ending with \"P.S. I Love You\" \u2014 which he had arranged to have delivered to her after his death." ], [ "Gerard Butler", "Gerard Butler\n\nGerard James Butler (born 13 November 1969) is a Scottish actor and producer.", "After studying law, Butler turned to acting in the mid-1990s with small roles in productions such as \"Mrs Brown\" (1997), the James Bond film \"Tomorrow Never Dies\" (1997), and \"Tale of the Mummy\" (1998).", "In 2000, he starred as Dracula in the horror film \"Dracula 2000\" with Christopher Plummer and Jonny Lee Miller.", "He subsequently played Attila the Hun in the miniseries \"Attila\" (2001) and then appeared in the films \"Reign of Fire\" with Christian Bale (2002) and \"\" with Angelina Jolie (2003), before playing Andr\u00e9 Marek in the adaptation of Michael Crichton's science fiction adventure \"Timeline\" (2003).", "He then was cast as the role of Erik, The Phantom in Joel Schumacher's 2004 film adaptation of the musical \"The Phantom of the Opera\" alongside Emmy Rossum.", "That role earned him a Satellite Award nomination for Best Actor.", "Although \"Attila\" and \"The Phantom of the Opera\" were important breaks, it was only in 2007 that Butler gained worldwide recognition for his portrayal of King Leonidas in Zack Snyder's fantasy war film \"300\"." ] ], "gold": "P.S. I Love You is a 2007 American romantic drama film directed by Richard LaGravenese from a screenplay by LaGravenese and Steven Rogers based on the 2004 novel of the same name by Cecelia Ahern. The film remains fairly true to the novel, and all of Gerry's letters are virtually unchanged. Scottish actor and film producer Gerard Butler plays Gerry.", "prediction 1": "Gerry wrote the letters in the 2004 novel P.S. I Love You. However, in the 2007 American romance film P.S. I Love You, the author of the novel and the screenplay, Cecelia Ahern, also wrote the script. The letters are delivered by mail. Similarly, the 2007 film remains fairly true to the novel, and all of Gerry's letters are virtually unchanged.", "prediction 2": "In the 2007 American romance film P.S. I Love You, Gerry Kennedy writes the letters to Holly. In the book and the film, they arrive all in a package together and Holly is expected to open them once a month. In the movie, the letters are delivered by mail. The film remains fairly true to the novel, and all of Gerry's letters are virtually unchanged.", "prediction 3": "P.S. I Love You is a 2007 American romantic comedy film directed by Richard LaGravenese. The screenplay by LaGravenese and Steven Rogers is based on the 2004 novel of the same name by Cecelia Ahern. In the 2004 novel, Holly and Gerry Kennedy are deeply in love, but they fight occasionally. By winter that year, Gerry suddenly dies of a brain tumor, and Holly realizes how much he meant to her as well as how insignificant their arguments were. In the film, the letters arrive all in a package together and Holly is expected to open them once a month. In the 2007 American romance film, the letters are delivered by mail.", "prediction 4": "In the 2004 novel P.S. I Love You by Cecelia Ahern, the character of Gerry Kennedy writes the letters. In the 2007 film adaptation of the same title, Gerry writes the letters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 200 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 147, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 235 } ], "missing-info": [], "corrected-prediction": "Gerry wrote the letters in P.S. I Love You, the 2007 American romance film with screenplay by LaGravenese and Steven Rogers, based on the 2004 novel of the same name by Cecelia Ahern. The film remains fairly true to the novel, and all of Gerry's letters are virtually unchanged." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who is girl in we don't talk anymore?", "passages": [ [ "We Don't Talk Anymore (Charlie Puth song)", "MTV's Madeline Roth praised the singers' vocals by saying they \"blend so beautifully together.\"", "Marie Sherman of Fuse said the song is \"freaking catchy\" and that the chorus would be stuck in people's heads.", "Lindsey Sullivan of \"Billboard\" called the song \"ridiculously catchy\".", "Idolator's Mike Wass opined that the song \"sounds like a smash.\"", "Dee Lockett of Vulture.com deemed it \"the chillest breakup duet.\"", "A live performance video was released on July 19, 2016.", "It features Puth and Gomez performing with the latter's Revival Tour in Anaheim, California on July 9.", "The music video premiered on August 2, 2016, on BuzzFeed and was directed by Phil Pinto.", "It shows Puth and Mirella Cardoso as his love interest.", "This video does not include the appearance of Gomez, but only used the version of Puth and Gomez.", "As of December 2018, the video has more than 2.0 billion views and 7 million likes on YouTube and is the site's 28th most-viewed video.", "It was nominated for Best Collaboration at 2017 MTV Video Music Awards but lost to Zayn and Taylor Swift's I Don't Wanna Live Forever." ], [ "We Don't Talk Anymore (Charlie Puth song)", "We Don't Talk Anymore (Charlie Puth song)\n\n", "\"We Don't Talk Anymore\" is a song produced and performed by American singer Charlie Puth from his debut studio album \"Nine Track Mind\" (2016).", "It contains guest vocals from Selena Gomez.", "Jacob Kasher co-wrote the track with the artists.", "The song was released on May 24, 2016, as the third and final single from the album.", "Musically, it is a pop song with a tropical-inspired production.", "The song peaked at number 9 on the US \"Billboard\" Hot 100, earning Puth his second top 10 single and Gomez's sixth.", "It has also attained the top 10 positions in more than 20 countries, and reached number one in Italy, Lebanon, Serbia and Romania.", "Puth created the guitar line during a trip in Japan.", "He produced the beat in the Philippines and recorded his vocals in Los Angeles.", "Months later Puth played the song for Selena Gomez, whom he had met previously at an after party following the MTV Video Music Awards.", "He thought that their voices would complement each other well and then asked her to sing the second verse.", "Gomez's vocals were recorded in Puth's closet.", "Her recording session lasted approximately 15 minutes.", "On December 10, 2015, Puth posted a snippet of the song announcing the collaboration with Gomez." ] ], "gold": "\"We Don't Talk Anymore\" is a song by American singer Charlie Puth featuring Selena Gomez. A live performance video was released on July 19, 2016 which features Gomez. Puth and Mirella Cardoso\u00a0appear in a video for the song that premiered on BuzzFeed.", "prediction 1": "\"We Don't Talk Anymore\" is a song produced and performed by American singer Charlie Puth from his debut studio album Nine Track Mind. It contains guest vocals from Selena Gomez. Jacob Kasher co-wrote the track with the artists.", "prediction 2": "\"We Don't Talk Anymore\" is a song produced and performed by American singer Charlie Puth from his debut studio album Nine Track Mind (2016). It contains guest vocals from Selena Gomez. Jacob Kasher co-wrote the track with the artists. The music video premiered on August 2, 2016, on BuzzFeed and was directed by Phil Pinto. It shows Puth and Mirella Cardoso as his love interest.", "prediction 3": "The song \"We Don't Talk Anymore\" is sung by American singer Charlie Puth and features guest vocals from Selena Gomez. The music video for \"We Don't Talk Anymore\" was directed by Phil Pinto and shows Puth and Mirella Cardoso as his love interest.", "prediction 4": "\"We Don't Talk Anymore\" is a song produced and performed by American singer Charlie Puth from his debut studio album Nine Track Mind (2016). It contains guest vocals from Selena Gomez. Jacob Kasher co-wrote the track with the artists. It was nominated for Best Collaboration at 2017 MTV Video Music Awards but lost to Zayn and Taylor Swift's I Don't Wanna Live Forever.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 227 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"We Don't Talk Anymore\" is a song produced and performed by American singer Charlie Puth. It contains guest vocals from Selena Gomez. A live performance video was released on July 19, 2016 which features Puth and Gomez. The music video premiered on August 2, 2016, on BuzzFeed. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the dont tread on me flag created?", "passages": [ [ "Gadsden flag", "Gadsden flag\n\nThe Gadsden flag is a historical American flag with a yellow field depicting a rattlesnake coiled and ready to strike.", "Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\"", "The flag is named after American general and politician Christopher Gadsden (1724\u20131805), who designed it in 1775 during the American Revolution.", "It was used by the Continental Marines as an early motto flag, along with the Moultrie flag.", "The timber rattlesnake can be found in the area of the original Thirteen Colonies.", "Its use as a symbol of the American colonies can be traced back to the publications of Benjamin Franklin.", "In 1751, he made the first reference to the rattlesnake in a satirical commentary published in his \"Pennsylvania Gazette\".", "It had been the policy of Great Britain to send convicted criminals to the Americas, so Franklin suggested that they thank the British by sending rattlesnakes to Britain.", "In 1754, during the French and Indian War, Franklin published his famous woodcut of a snake cut into eight sections.", "It represented the colonies, with New England joined together as the head and South Carolina as the tail, following their order along the coast.", "Under the snake was the message \"Join, or Die\".", "This was the first political cartoon published in an American newspaper." ] ], "gold": "The Gadsden flag is a historical American flag with a yellow field depicting a timber rattlesnake coiled and ready to strike. The words \"Don't Tread on Me\" can be read beneath the rattlesnake. The flag is named after politician Christopher Gadsden, who designed it in 1775 during the American Revolution. It is sometimes used in the United States as a symbol of constitutionalism and limited government.", "prediction 1": "The don't tread on me flag is a historical American flag with a yellow field depicting a rattlesnake coiled and ready to strike. Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\" The flag is named after American general and politician Christopher Gadsden (1724\u20131805), who designed it in 1775 during the American Revolution. It was used by the Continental Marines as an early motto flag, along with the Moultrie flag.", "prediction 2": "The Gadsden flag is a historical American flag with a yellow field depicting a rattlesnake coiled and ready to strike. Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\" The flag is named after American general and politician Christopher Gadsden (1724\u20131805), who designed it in 1775 during the American Revolution. It was used by the Continental Marines as an early motto flag, along with the Moultrie flag.", "prediction 3": "The Gadsden flag is a historical American flag with a yellow field depicting a rattlesnake coiled and ready to strike. Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\" The flag is named after American general and politician Christopher Gadsden (1724\u20131805), who designed it in 1775 during the American Revolution.", "prediction 4": "The Gadsden flag is an American flag with a yellow field depicting a rattlesnake coiled and ready to strike. Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\" The flag is named after American general and politician Christopher Gadsden (1724\u20131805), who designed it in 1775 during the American Revolution. It was used by the Continental Marines as an early motto flag, along with the Moultrie flag.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 284 } ], "missing-info": [], "corrected-prediction": "The don't tread on me flag is a historical American flag with a yellow field depicting a rattlesnake coiled and ready to strike. Positioned below the rattlesnake are the words \"DONT TREAD ON ME.\" The flag is named after American general and politician Christopher Gadsden, who designed it in 1775 during the American Revolution. It was used by the Continental Marines as an early motto flag, along with the Moultrie flag." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Where is the womans euro 2017 being held?", "passages": [ [ "UEFA Women's Euro 2017", "UEFA Women's Euro 2017\n\nThe 2017 UEFA Women's Championship, commonly referred to as UEFA Women's Euro 2017, was the 12th edition of the UEFA Women's Championship, the quadrennial international football championship organised by UEFA for the women's national teams of Europe.", "The competition was expanded to 16 teams (from 12 teams in the previous edition).", "The Netherlands were declared as hosts by the UEFA Executive Committee on 4 December 2014.", "Germany's 22-year reign as champions of Europe was ended after losing 1\u20132 to Denmark in the quarter-finals.", "In addition it was only Germany's second loss in the finals since 1993.", "Another former winner, Norway, lost to both finalists, the Netherlands and Denmark, and ended without goals or points.", "The Netherlands won their first ever title by beating fellow first time finalists, Denmark, 4\u20132 in the final.", "Expressions of interest in hosting the tournament were received from seven associations.", "The Netherlands were chosen to host the tournament on 4 December 2014.", "This was the first time that the tournament will be staged in this country.", "A total of 47 UEFA nations entered the competition (including Andorra which entered for the first time at senior women's level), and with the hosts Netherlands qualifying automatically, the other 46 teams competed in the qualifying competition to determine the remaining 15 spots in the final tournament." ], [ "UEFA Women's Euro 2013", "Six teams were firstly eliminated during an eight-team preliminary round staged in Macedonia and Malta on 3\u20138 March 2011.", "On 14 March 2011 38 teams \u2013 the 36 top-ranked nations (according to their UEFA coefficient) and the two teams advancing from the preliminary round \u2013 were then drawn into seven qualifying groups at a draw in Nyon, Switzerland.", "Matches in these qualifying groups began in September 2011 and concluded a year later.", "The seven group winners automatically qualified for the final tournament along with the best-ranked runners-up.", "The remaining six runners-up entered into two-legged play-offs held in October 2012 to determine the final line-up.", "The following twelve teams participated in the final tournament:\nThe tournament was staged at seven venues in seven different towns with each group being staged at two different venues.", "At some venues, the capacity was reduced during the championship.", "The final draw for the tournament group stage took place on 9 November 2012 at the Swedish Exhibition & Congress Centre in Gothenburg.", "The ceremony was conducted by the UEFA General Secretary Gianni Infantino, with the teams drawn out by tournament ambassadors Patrik Andersson and Steffi Jones.", "As hosts, Sweden were automatically placed in the top-seeded pot, though they would have been in any case owing to their UEFA coefficient ranking.", "The eleven qualifiers were placed into the three final draw pots according to their UEFA coefficient ranking." ], [ "UEFA Women's Euro 2017 Final", "UEFA Women's Euro 2017 Final\n\nThe UEFA Women's Euro 2017 Final was a football match to determine the winner of UEFA Women's Euro 2017.", "The match took place on 6 August 2017 at De Grolsch Veste in Enschede, Netherlands, and was contested by the winners of the semi-finals, the Netherlands and Denmark.", "The Netherlands won the final 4\u20132 for their first UEFA Women's Championship title.", "Both the Netherlands and Denmark reached the UEFA Women's Championship final for the first time in their histories.", "For the first time since 1993, a country other than Germany won the competition.", "Apart from Germany, only two other countries have won the championship: Norway and Sweden.", "Norway was defeated by both the Netherlands and Denmark in the preliminary round whereas Sweden was defeated by the Netherlands in the quarter-finals.", "The finalists met each other in the group stage of the tournament, with the Netherlands winning 1\u20130 via a penalty from Sherida Spitse.", "
\n
\n\n
\nMatch rules" ] ], "gold": "The 2017 UEFA European Women's Championship, commonly referred to as UEFA Women's Euro 2017, was hosted by the Netherlands where seven venues in seven different towns were used. The group matches were held in: Breda, Utrecht, Rotterdam, Deventer, Tilburg, Doetinchem. Four cities hosted the quarter finals: Rotterdam, Deventer, Tilburg, Doetinchem. The semifinals were held in Breda, Enschede, and the finals were held in Enschede.", "prediction 1": "The UEFA Women's Championship, commonly referred to as UEFA Women's Euro 2017, was the 12th edition of the UEFA Women's Championship, the quadrennial international football championship organised by UEFA for the women's national teams of Europe. The tournament was staged at seven venues in seven different towns with each group being staged at two different venues. At some venues, the capacity was reduced during the championship. The tournament was staged at the Stadion Osvalds Stadion in the city of Enschede, Netherlands. The final was contested by the winners of the semi-finals, the Netherlands and Denmark. The match took place on 6 August 2017 at De Grolsch Veste in Enschede in Enschede, Netherlands, and was contested by the winners of the semifinals, the final 4\u20132 for their first UEFA Women's Euro 2017.", "prediction 2": "The UEFA Women's Championship was held from 2013 to 2017. The tournament was staged at seven venues in seven different towns with each group being staged at two different venues. The final match between the Netherlands and Denmark, the runner-up of the 2013 edition and the winner of the 2017 edition, took place on 6 August 2017 at De Grolsch Veste in Enschede, Netherlands.", "prediction 3": "The UEFA Women's Championship, commonly referred to as UEFA Women's Euro 2017, was the 12th edition of the UEFA Women's Championship, the quadrennial international football championship organised by UEFA for the women's national teams of Europe. The tournament was staged at seven venues in seven different towns with each group being staged at two different venues. The final match took place on 6 August 2017 at De Grolsch Veste in Enschede, Netherlands, and was contested by the winners of the semi-finals, the Netherlands, 4\u20132 for their first UEFA Women's Euro 2017.", "prediction 4": "The 2017 UEFA Women's Championship was the 12th edition of the quadrennial international football championship organised by UEFA for the women's national teams of Europe. The competition was expanded to 16 teams (from 12 teams in the previous edition). The tournament was staged at seven venues in seven different towns with each group being staged at two different venues. The final match took place on 6 August 2017 at De Grolsch Veste in Enschede, Netherlands, and was contested by the winners of the semi-finals, the Netherlands.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 432 }, { "error type": "Unverifiable", "explanation": "", "start": 433, "end": 527 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 615 }, { "error type": "Irrelevant", "explanation": "", "start": 699, "end": 817 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2017 UEFA European Women's Championship, commonly referred to as UEFA Women's Euro 2017, was hosted by the Netherlands where seven venues in seven different towns were used. The final took place at De Grolsch Veste in Enschede, Netherland. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who has the world record for the fastest mile?", "passages": [ [ "Mile run world record progression", "Mile run world record progression\n\n", "The world record in the mile run is the best mark set by a male or female runner in the middle-distance track and field event.", "The IAAF is the official body which oversees the records.", "Hicham El Guerrouj is the current men's record holder with his time of 3:43.13, while Svetlana Masterkova has the women's record of 4:12.56.", "Since 1976, the mile has been the only non-metric distance recognized by the IAAF for record purposes.", "Accurate times for the mile run (1.609344\u00a0km) were not recorded until after 1850, when the first precisely measured running tracks were built.", "Foot racing had become popular in England by the 17th century, when footmen would race and their masters would wager on the result.", "By the 19th century \"pedestrianism\", as it was called, had become extremely popular and the best times recorded in the period were by professionals.", "Even after professional foot racing died out, it was not until 1915 that the professional record of 4:12 (set by Walter George in 1886) was surpassed by an amateur.", "Progression of the mile record accelerated in the 1930s as newsreel coverage greatly popularized the sport, making stars out of milers such as Jules Ladoum\u00e8gue, Jack Lovelock, and Glenn Cunningham." ], [ "Eamonn Coghlan", "Coghlan was nicknamed \"The Chairman of the Boards\" because of his success on indoor tracks.", "He won 52 of his 70 races at 1,500 m and 1 Mile from 1974 to 1987.", "He set the world record for the indoor mile run with a time of 3.52.6 at the San Diego Sports Arena in San Diego in 1979.", "He lowered this to 3:50.6 in 1981 and then bettered it to 3:49.78 in 1983 at New Jersey's Meadowlands Arena indoor arena.", "His record stood until 1997 when it was broken by Morocco's Hicham El Guerrouj in a time of 3:48.45.", "It is still the third fastest indoor mile of all time and is still, more than 30 years on, a European record.", "Coghlan's 1983 time was the fastest mile ever run in the United States until 10 June 2007, when Daniel Kipchirchir Komen ran 3:48.28 outdoors in Eugene, Oregon.", "It remains one of only four sub-3:50 miles run on American soil.", "By and large, Coghlan was more successful at indoor running notwithstanding a later world title in 1983 over 5,000 meters." ] ], "gold": "The world record in the mile run is the fastest time set by a runner in the middle-distance track and field event. The IAAF is the official body that oversees the records and, since 1976, the mile has been the only non-metric distance recognized by the IAAF for record purposes. Hicham El Guerrouj is the current men's record holder with his time of 3:43.13 achieved on February 12, 1997, while Sifan Hassan has the women's record with a time of 4:12.33. Among previous athletes that held the distinction, you can find Eamonn Coghlan, the holder previous to El Guerrouj, Doina Melinte, who obtained the women's record on February 13, 1988, and Genzebe Dibaba, who did so in 2016.", "prediction 1": "The world record in the mile run is the best mark set by a male or female runner in the middle-distance track and field event. The record is held for males by Hicham El Guerrouj who runs the fastest time of 3:43.13, while females by Svetlana Masterkova who runs 4:12.56.", "prediction 2": "The world record for the fastest mile, in the men's race, is 3:43.13, and the women's record is 4:12.56. Hicham El Guerrouj of Morocco holds the record for the fastest mile, in the men's event 3:43.13.", "prediction 3": "The world record for the fastest mile is the best time set by a male or female runner in the middle distance track and field event. Hicham El Guerrouj holds the record for the fastest mile in men's competition, while Svetlana Masterkova holds the record for women's competition. The fastest mile in men's competition is 3:43.13, while the fastest mile in women's competition is 4:12.56. The fastest mile in women's competition is 4:12.56.", "prediction 4": "The world record for the fastest mile is the best mark set by a male or female runner in the middle-distance track and field event. The IAAF is the official body which oversees the records. The current men's record holder for the fastest mile is Hicham El Guerrouj with his time of 3:43.13, while Svetlana Masterkova holds the record for the fastest mile in 4:12.56. Eamonn Coghlan holds the record for the fastest indoor mile run with a time of 3:49.78 in New Jersey's Meadowlands Arena indoor arena. The record stood until 1997 when it was broken by Morocco's Hicham El Guerrouj in a time of 3:48.45. It is still the third fastest indoor mile of all time and is still, more than 30 years on, a European record.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The world record in the mile run is the best mark set by a male or female runner in the middle-distance track and field event. The IAAF is the official body which oversees the records. Since 1976, the mile has been the only non-metric distance recognized by the IAAF for record purposes. The record is held for males by Hicham El Guerrouj who runs the fastest time of 3:43.13, while females by Svetlana Masterkova who runs 4:12.56. Among previous athletes that held the distinction, you can find Eamonn Coghlan, the holder previous to El Guerrouj." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who is the speaker of the house chosen by?", "passages": [ [ "Speaker of the United States House of Representatives", "Speaker of the United States House of Representatives\n\nThe Speaker of the House is the presiding officer of the United States House of Representatives.", "The office was established in 1789 by Article I, of the United States Constitution.", "The Speaker is the political and parliamentary leader of the House of Representatives, and is simultaneously the House's presiding officer, \"de facto\" leader of the body's majority party, and the institution's administrative head.", "Speakers also perform various other administrative and procedural functions.", "Given these several roles and responsibilities, the Speaker usually does not personally preside over debates.", "That duty is instead delegated to members of the House from the majority party.", "Neither does the Speaker regularly participate in floor debates.", "The Constitution does not require the Speaker to be an elected member of the House of Representatives, although every Speaker thus far has been.", "The Speaker is second in the United States presidential line of succession, after the Vice President and ahead of the President \"pro tempore\" of the Senate.", "The current House Speaker is Congressman Paul Ryan from Wisconsin.", "He was elected to the office on October 29, 2015, and is the 54th person to serve as Speaker.", "On April 11, 2018, Ryan announced he would not seek re-election in the 2018 mid-terms, and will also relinquish the office of Speaker when his term ends in 2019." ] ], "gold": "The speaker of the house in the US House of Representatives is chosen by The House of Representatives. The speaker of the House of Commons in the UK is chosen by Members of House of Commons. And, the speaker of the House of Commons in Canada is chosen by a secret ballot by the Parliament.", "prediction 1": "The Speaker of the House is the presiding officer of the United States House of Representatives. The office was established in 1789 by Article I, of the United States Constitution. The current House Speaker is Congressman Paul Ryan from Wisconsin. He was elected to the office on October 29, 2015, and is the 54th person to serve as Speaker.\n", "prediction 2": "The Speaker of the House is the presiding officer of the United States House of Representatives. He is simultaneously the House's presiding officer, \"de facto\" leader of the body's majority party, and the institution's administrative head. He has held the position since 2015, when Congressman Paul Ryan from Wisconsin was elected.", "prediction 3": "The Speaker of the House is the presiding officer of the United States House of Representatives. The office was established in 1789 by Article I, of the United States Constitution. The current Speaker of the House is Congressman Paul Ryan from Wisconsin. He was elected to the office on October 29, 2015, and is the 54th person to serve as Speaker.", "prediction 4": "The Speaker of the House is the presiding officer of the United States House of Representatives and is principally responsible for the conduct of business in the House. The Speaker is chosen by a majority of the members of the House, but sometimes also by the majority party. The Constitution does not require the Speaker of the House to be an elected member of the House of Representatives, although every Speaker thus far has been. The current House Speaker is Congressman Paul Ryan from Wisconsin. Ryan was elected to the office on October 29, 2015, and is the 54th person to serve as Speaker of the House.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 247 }, { "error type": "Irrelevant", "explanation": "", "start": 298, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 297 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When did alvin and the chipmunks come out?", "passages": [ [ "Alvin and the Chipmunks (1983 TV series)", "Beginning with the 1988\u201389 season, the series was renamed to simply \"The Chipmunks\", and production switched to DiC Enterprises for the remainder of the series' run (with the exception of five episodes produced for the syndication package by Murakami-Wolf-Swenson, which aired on NBC in fall 1988 for reasons currently unknown \u2013 this was not due to the 1988 Writers Guild of America Strike, which did not affect any animated series).", "For its final season in 1990, the series was renamed again, this time, \"The Chipmunks Go to the Movies\", as all episodes in this season were spoofs of popular Hollywood movies.", "The series went into syndication in the fall of 1988 under the original \"Alvin and The Chipmunks\" title, distributed by Lorimar-Telepictures (and later Warner Bros. Television after Warner Communications' purchase of Lorimar, Warner Bros. would later buy Ruby-Spears in 1996).", "The package contained all 52 episodes produced by Ruby-Spears (#901\u2013952), as well as the Valentine's and Reunion specials." ], [ "Alvin and the Chipmunks", "Alvin and the Chipmunks\n\nAlvin and the Chipmunks, originally David Seville and the Chipmunks or simply the Chipmunks, is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958.", "The group consists of three singing animated anthropomorphic chipmunks: Alvin, the mischievous troublemaker, who quickly became the star of the group; Simon, the tall, bespectacled intellectual; and Theodore, the chubby, impressionable sweetheart.", "The trio is managed by their human adoptive father, David (Dave) Seville.", "In reality, \"David Seville\" was Bagdasarian's stage name, and the Chipmunks themselves are named after the executives of their original record label.", "The characters became a success, and the singing Chipmunks and their manager were given life in several animated cartoon productions, using redrawn, anthropomorphic chipmunks, and eventually films.", "The voices of the group were all performed by Bagdasarian, who sped up the playback to create high-pitched voices.", "This oft-used process was not entirely new to Bagdasarian, who had also used it for two previous novelty songs, including \"Witch Doctor\", but it was so unusual and well-executed it earned the record two Grammy Awards for engineering." ], [ "Alvin and the Chipmunks (film)", "Despite this feat, none of the songs were released as singles or ever solicited to mainstream radio (although it is possible that kid-oriented radio stations, such as Radio Disney, might have played them anyway) and charted solely because of high digital downloads caused by the anticipation of the group's film, \"Alvin and the Chipmunks\".", "The four songs that charted on the \"Billboard\" Hot 100 (and with the chart peaks included and the songs' Hot Digital Songs peaks) were:\nA soundtrack sampler was released along with the DVD of the film in a two pack sold exclusively at Walmart.", "This features five songs produced exclusively for the soundtrack.", "The film's original score was composed and conducted by Christopher Lennertz, a fan of the Chipmunks since childhood.", "La-La Land Records released a limited edition album on September 19, 2008.", "The video game for this film was released December 4, 2007 for the Wii, Nintendo DS, PlayStation 2, and the PC, just ten days before the film was released.", "It was written and produced by DeeTown Entertainment.", "A sequel, titled \"\", was released on December 23, 2009." ] ], "gold": "Alvin and the Chipmunks are an American animated virtual band created by Ross Bagdasarian for a novelty record in 1958. Their debut song, The Chipmunk Song (Christmas Don't Be Late) was released on November 17, 1958 and became a number one hit. Then, on September 17, 1983, Alvin and the Chipmunks, the animated television series produced by Bagdasarian Productions, debuted and proceeded to air on NBC until 1990. On December 14, 2007, Alvin and the Chipmunks, an American live-action, computer animated musical comedy film based on the characters of the same name created by Ross Bagdasarian, was released. Alvin and the Chipmunks is also the title of a video game based on the 2007 film. This Alvin and the Chipmunks video game was released on December 4, 2007. Additionally, debuting on Nickelodeon on August 3, 2015, Alvinnn!!! and the Chipmunks is CGI-animated, musical television series produced by Bagdasarian Productions. ", "prediction 1": "Alvin and the Chipmunks is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958. The group consists of three singing animated anthropomorphic chipmunks: Alvin, the mischievous troublemaker, who quickly became the star of the group; Simon, the tall, bespectacled intellectual; and Theodore, the chubby, impressionable sweetheart. The film released on December 4, 2007 and the video game was released on December 5, 2009.", "prediction 2": "Alvin and the Chipmunks, originally David Seville and the Chipmunks or simply the Chipmunks, is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958. The group consists of three singing animated anthropomorphic chipmunks: Alvin, the mischievous troublemaker, who quickly became the star of the group; Simon, the tall, bespectacled intellectual; and Theodore, the chubby, impressionable sweetheart.", "prediction 3": "Alvin and the Chipmunks, originally David Seville and the Chipmunks or simply the Chipmunks, is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958. The group consists of three singing animated anthropomorphic chipmunks: Alvin, the mischievous troublemaker, who quickly became the star of the group, Simon, the tall, bespectacled intellectual, and Theodore, the chubby, impressionable sweetheart.", "prediction 4": "Alvin and the Chipmunks, originally David Seville and the Chipmunks or simply the Chipmunks, is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958. The group consists of three singing animated anthropomorphic chipmunks: Alvin, the mischievous troublemaker, who quickly became the star of the group; Simon, the tall, bespectacled intellectual; and Theodore, the chubby, impressionable sweethearts, the group's film, \"Alvin and the Chipmunks\" soundtrack sampler was released along with the DVD of the film. The video game for this film was released on December 4, 2007 for the Wii, Nintendo DS, PlayStation 2, PlayStation 2, just ten days before the film was released on December 25, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 369 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[8]}", "start": 374, "end": 407 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 416, "end": 460 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Alvin and the Chipmunks is an American animated music group created by Ross Bagdasarian Sr. for a novelty record in 1958. Alvin and the Chipmunks 1983 TV series ran until 1990. The video game for the Alvin and the Chipmunks film was released December 4, 2007 and a sequel was released on December 23, 2009. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings i'm in love with my car?", "passages": [ [ "I'm in Love with My Car", "I'm in Love with My Car\n\n\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album \"A Night at the Opera\" in 1975.", "It is the album's only song written entirely by drummer Roger Taylor.", "Taylor played the guitars in the original demo, but they were later rerecorded by May on his Red Special and Taylor also doubled on electric guitar in addition to drums.", "The lead vocals were performed by Taylor on the studio version and all released live versions.", "The revving sounds at the conclusion of the song were a recording of Taylor's then current car, an Alfa Romeo.", "The lyrics were inspired by one of the band's roadies, Johnathan Harris, whose Triumph TR4 was evidently the \"love of his life\".", "The song is dedicated to him, with the liner notes mentioning, \"Dedicated to Johnathan Harris, boy racer to the end\".", "When it came down to releasing the album's first single, Taylor was so fond of his song that he urged Freddie Mercury (author of the first single, \"Bohemian Rhapsody\") to allow it to be the B-side and locked himself in a cupboard until Mercury agreed." ] ], "gold": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album \"A Night at the Opera\" in 1975. It is the album's only song written entirely by drummer Roger Taylor. The lead vocals were performed by Roger Taylor on the studio version and all released live versions.", "prediction 1": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album \"A Night at the Opera\" in 1975. The lead vocals were performed by Roger Taylor on the studio version and all released live versions.", "prediction 2": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album \"A Night at the Opera\" in 1975. It is the album's only song written entirely by drummer Roger Taylor. The lead vocals were performed by Taylor on the studio version and all released live versions. The revving sounds at the conclusion of the song were a recording of Taylor's then current car, an Alfa Romeo.", "prediction 3": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album A Night at the Opera in 1975. The lead vocals were performed by Roger Taylor on the studio version and all released live versions.", "prediction 4": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album A Night at the Opera in 1975. It is the album's only song written entirely by drummer Roger Taylor. The lead vocals were performed by Taylor on the studio version and all released live versions.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I'm in Love with My Car\" is a song by the British rock band Queen, released on their fourth album \"A Night at the Opera\" in 1975. It is the album's only song written entirely by drummer Roger Taylor. The lead vocals were performed by Roger Taylor on the studio version and all released live versions." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "What kind of lizard is orange with black spots?", "passages": [ [ "Red salamander", "This species differs it is slightly smaller and lacks black coloration on the tip of the tail and chin.", "The Blue Ridge red salamander is found in elevations to more than in the southern part of the Blue Ridge Mountains of Virginia.", "The blackchin red salamander, \"P. r. schencki\", differs in appearance by having strong black coloration under its chin, as well as spotting all the way to the tip of the tail.", "It can also be found in elevations to more than in the Blue Ridge Mountains.", "The southern red salamander (\"P. r. vioscai\") is often purplish- to salmon-colored and normally has white spots on its head.", "This subspecies is found from southern South Carolina to southeast Louisiana and southwest Kentucky.", "All subspecies of \"P. ruber\" occupy moist environments such as under moss and stones near clear water sources such as streams or springs.", "Red salamanders are normally not found near large streams, but instead near smaller water sources.", "Some important aquatic and terrestrial ecological aspects of this salamander include its diet, predators, and microhabitat preferences.", "Larvae mainly feed on invertebrates such as insect larvae and worms.", "Larval growth rates differ depending on the temperature of the water and tend to be higher in the warmer months when water temperature is higher." ], [ "Lizard", "This \"eye\" has only a rudimentary retina and lens and cannot form images, but is sensitive to changes in light and dark and can detect movement.", "This helps them detect predators stalking it from above.", "Until 2006 it was thought that among lizards, only the Gila monster and the Mexican beaded lizard were venomous.", "However, several species of monitor lizards, including the Komodo dragon, produce powerful venom in their oral glands.", "Lace monitor venom, for instance, causes swift loss of consciousness and extensive bleeding through its pharmacological effects, both lowering blood pressure and preventing blood clotting.", "Nine classes of toxin known from snakes are produced by lizards.", "The range of actions provides the potential for new medicinal drugs based on lizard venom proteins.", "Genes associated with venom toxins have been found in the salivary glands on a wide range of lizards, including species traditionally thought of as non-venomous, such as iguanas and bearded dragons.", "This suggests that these genes evolved in the common ancestor of lizards and snakes, some 200 million years ago (forming a single clade, the Toxicofera).", "However, most of these putative venom genes were \"housekeeping genes\" found in all cells and tissues, including skin and cloacal scent glands.", "The genes in question may thus be evolutionary precursors of venom genes." ] ], "gold": "The Gila monster is a venomous lizard found in the Southwest that can be orange with black splotches, but there are other lizard-like animals that are orange with black spots too, including the northern red salamander, which is 11 to 18 cm and orange and red with irregular black spots, the spotted-tail salamander, which is 10 to 20 cm and orange with irregular black spots, and the mud salamander, which is 7.6 to 20 cm and red-orange with 30 to 40 rounded black spots.", "prediction 1": "The orange with black spots lizard is a species of monitor lizard. These lizards are orange-bodied and have black spots all the way to the tip of the tail. The orange-spotted red salamander is also known as the blackchin red salamander, which differs in appearance by having strong black coloration under its chin and spotting all the way to the tip of the tail. Finally, the red-spotted monitor lizard, P. r. schencki, is orange-colored and normally has white spots on its head.", "prediction 2": "Orange with black spots are present in many lizard species, including the yellow-spotted monitor lizard and the orange-spotted monitor lizard. The blackchin red salamander is orange with black spots but it has both coloration under its chin and black spots on the tip of the tail. The southern red salamander, also known as the southern monitor lizard, is orange-tan to salmon-colored and normally has white spots on its head.", "prediction 3": "The orange-spotted monitor lizard, also known as a red salamander, is a large reptile with black spots. The orange-spotted monitor lizard, known as the blackchin red salamander, is found from southern South Carolina to southeast Louisiana and southwest Kentucky. The orange-spotted monitor lizard, also known as a tiger monitor, is orange with black spots on the tip of the tail and chin.", "prediction 4": "Red salamanders are orange-colored with black spots. The blackchin red salamander is an orange-spotted lizard with black spots, while the southern red salamander has spots that are purplish- to salmon-colored.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 66 }, { "error type": "Unverifiable", "explanation": "", "start": 67, "end": 155 }, { "error type": "Unverifiable", "explanation": "", "start": 160, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 479 } ], "missing-info": [], "corrected-prediction": " The red salamander, known as the blackchin red salamander, differs in appearance by having strong black coloration under its chin and spotting all the way to the tip of the tail. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "What kind of church is the hagia sophia?", "passages": [ [ "Little Hagia Sophia", "Little Hagia Sophia\n\nLittle Hagia Sophia Mosque (), formerly the Church of the Saints Sergius and Bacchus (, \"Ekkl\u0113s\u00eda t\u00f4n Hag\u00ed\u014dn Serg\u00edou ka\u00ec B\u00e1kchou en to\u00ees Horm\u00edsdou\"), is a former Greek Eastern Orthodox church dedicated to Saints Sergius and Bacchus in Constantinople, converted into a mosque during the Ottoman Empire.", "This Byzantine building with a central dome plan was erected in the sixth century by Justinian, likely was a model for Hagia Sophia (\"Holy Wisdom\"), and is one of the most important early Byzantine buildings in Istanbul.", "It was recognized at the time as an adornment to the entire city, and a modern historian of the East Roman Empire has written that the church, \"by the originality of its architecture and the sumptuousness of its carved decoration, ranks in Constantinople second only to St. Sophia itself\".", "The building stands in Istanbul, in the district of Fatih and in the neighborhood of Kumkap\u0131, at a short distance from the Marmara Sea, near the ruins of the Great Palace and to the south of the Hippodrome.", "It is now separated from the sea by the Sirkeci-Halkal\u0131 suburban railway line and the coastal road, Kennedy Avenue." ], [ "Hagia Sophia", "Hagia Sophia\n\nHagia Sophia (; from the Greek \u0391\u03b3\u03af\u03b1 \u03a3\u03bf\u03c6\u03af\u03b1, , \"Holy Wisdom\"; or \"Sancta Sapientia\"; ) is the former Greek Orthodox Christian patriarchal cathedral, later an Ottoman imperial mosque and now a museum (\"Ayasofya M\u00fczesi\") in Istanbul, Turkey.", "Built in 537 AD at the beginning of the Middle Ages, it was famous in particular for its massive dome.", "It was the world's largest building and an engineering marvel of its time.", "It is considered the epitome of Byzantine architecture and is said to have \"changed the history of architecture\".", "The Hagia Sophia construction consists of mostly masonry.", "The structure is composed of brick and mortar joint that are 1.5 times the width of the bricks.", "The mortar joints are composed of a combination of sand and minute ceramic pieces displaced very evenly throughout the mortar joints.", "This combination of sand and ceramic pieces could be considered to be the equivalent of modern concrete at the time.", "From the date of its construction in 537 until 1453, it served as an Eastern Orthodox cathedral and the seat of the Ecumenical Patriarch of Constantinople, except between 1204 and 1261, when it was converted by the Fourth Crusaders to a Roman Catholic cathedral under the Latin Empire.", "The building was later converted into an Ottoman mosque from 29 May 1453 until 1931." ] ], "gold": "The Hagia Sophia was originally a Greek Orthodox Christian patriarchal cathedral. In 1453, it was converted into an Ottoman imperial mosque. The Little Hagia Sophia was originally a Greek Eastern Orthodox church. It was converted into a mosque during the Ottoman Empire.", "prediction 1": "The Hagia Sophia is an ancient Greek Orthodox church which was built in 537 AD and is called Holy Wisdom. It was later converted into an Ottoman imperial mosque from 29 May 1453 until 1931, and is now a museum. The church, originally called the Church of the Saints Sergius and Bacchus, was erected in the sixth century by Justinian, likely was a model for Hagia Sophia, and is one of the most important early Byzantine buildings in Istanbul.", "prediction 2": "The Hagia Sophia church was originally an Eastern Orthodox cathedral and the seat of the Ecumenical Patriarch of Constantinople, and was converted to a mosque during the Ottoman Empire. The church has been called a basilica, a church of the Holy Wisdom, or a church of Sancta Sapientia. A church of the Holy Wisdom is also called a basilica.", "prediction 3": "The Hagia Sophia is a church building in Istanbul, Turkey. It was erected in the sixth century by Justinian, probably was a model for Hagia Sophia, the church dedicated to St. Sophia. It is known as the \"Holy Wisdom\" church, or Sancta Sapientia church.", "prediction 4": "The Hagia Sophia is the former Greek Orthodox Christian patriarchal cathedral, later an Ottoman imperial mosque and now a museum in Istanbul, Turkey. It was originally erected in 537 AD at the beginning of the Middle Ages and is characterized by its massive dome, which made it the world's largest building and an engineering marvel of its time. The church was converted by the Fourth Crusaders to a Roman Catholic cathedral under the Latin Empire between 1204 and 1261.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 442 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Hagia Sophia is an ancient Greek Orthodox church patriarchal cathedral. It was later converted into an Ottoman imperial mosque from 29 May 1453 until 1931, and is now a museum. The Little Hagia Sophia was originally a Greek Eastern Orthodox church. It was converted into a mosque during the Ottoman Empire." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who plays nick on the young and the restless?", "passages": [ [ "Nicholas Newman", "On June 21, 1994, the producers of the series decided to rapidly age Nick to a teenager; ending speculation that another teenage child of Victor Newman (Eric Braeden) would be introduced to the soap opera.", "The character's return as a teenager was written as him returning from boarding school after a long duration.", "Since then, the role has been portrayed by actor Joshua Morrow.", "Morrow had previously auditioned for the role of \"Dylan\" on another CBS soap opera \"The Bold and the Beautiful\", making it to the final two casting options, but lost the role to Dylan Neal.", "The network later requested him to read for the part of Nick, which he won.", "Morrow, who worked in a restaurant prior to debuting on \"The Young and the Restless\", considered his change in profession a \"quantum leap in careers\".", "He said that accepting the role was \"a very easy decision\" considering how popular the show was.", "\"The Record\" newspaper described the role as being \"tailor-made\" for Morrow.", "In 2002, Morrow signed a new contract with the soap opera that would ensure his portrayal of the role for an additional five years.", "His contract was considered \"record-breaking\" at the time, as no soap opera contract had exceeded four years prior to this.", "Upon his contract's expiration in 2007, Morrow agreed to an additional five years with \"The Young and the Restless\"." ], [ "J. T. Hellstrom", "J. T. Hellstrom\n\nJ. T. Hellstrom is a fictional character from \"The Young and the Restless\", an American soap opera on the CBS network.", "The role was portrayed by actor Thad Luckinbill from August 27, 1999, to November 5, 2010.", "Luckinbill originally appeared on a recurring basis until he was put on contract in November 2002.", "On November 3, 2017, it was announced that Luckinbill would reprise the role of J.T., beginning December 12, 2017.", "Luckinbill exited on April 16, 2018, when the character was killed off.", "J. T. Hellstrom is introduced in 1999 as a high school friend of Billy Abbott, Raul Guittierez, Mackenzie Browning, Brittany Hodges and Rianna Miner.", "He has a reputation as a ladies' man.", "He dates Rianna, who he treats poorly and cheats on with Brittany.", "They break up and Rianna moves on with Raul.", "J. T. begins a relationship with Billy's niece, Colleen Carlton.", "Colleen is heartbroken when J. T. has a one night stand with Brittany's mother, Anita, but they eventually reconcile." ], [ "Nicholas Newman", "His other storylines have included trying to seek independence away from his powerful father as well as multiple other relationships.", "In 2013, a storyline regarding Summer's paternity was visited, centered on speculation that she is actually the daughter of Jack Abbott, Phyllis' ex-husband.", "Morrow regards Nick as a \"good dude\" who has a \"fiery\" protective personality, which has developed into a \"more mature\" persona as the character grew.", "Nick and Morrow gained a significant amount of crazed fan attention and popularity during the late 1990s, considered a long-time fan favorite by \"TV Guide\".", "The pairing of Nick and Sharon has been met with notable success, listed as one of the genre's best supercouples by \"The Huffington Post\" and SoapNet, among other sources.", "Morrow's performance has been met with critical acclaim, having garnered him the Daytime Emmy Award for Outstanding Younger Actor in a Drama Series nomination consecutively from 1996 to 2000.", "Created and introduced by William J. Bell, the role of Nicholas Newman was born onscreen during the episode dated December 31, 1988.", "The character was portrayed by infant twins Marco and Stefan Flores in 1989, while child actor Griffin Ledner took over the following year, departing in January 1991.", "Child actor John Alden played the role of Nick from 1991 to 1994." ] ], "gold": "The character was portrayed by infant twins Marco and Stefan Flores in 1989, while child actor Griffin Ledner took over the following year, departing in January 1991. Child actor John Alden played the role of Nick from 1991 to 1994. On June 21, 1994, the producers of the series decided to rapidly age Nick to a teenager returning from boarding school after a long duration, with Joshua Morrow taking over the role. Thad Luckinbill stepped into the role on July 16, 2018, when it was revealed Nicholas had been posing as J. T. Hellstrom.", "prediction 1": "The character of Nicholas Newman on The Young and the Restless was played by infant twins Marco and Stefan Flores from 1989 to 1991, and child actor John Alden from 1994 to 2000. Joshua Morrow played Nick from 2000 to 2014, and Morrow's performance was met with critical acclaim.", "prediction 2": "The role of Nicholas Newman on The Young and the Restless was played by infant twins Marco and Stefan Flores in 1989, while child actor John Alden played the role of Nick from 1991 to 1994. In 2016, Joshua Morrow was cast to play the part of Nick. In 2018, Thad Luckinbill played the role of Nick from November 5, 2010 to March 4, 2020. In 2019, Joshua Morrow was cast to play the role of Nick from February 6, 2019 to March 4, 2021.", "prediction 3": "On the Young and the Restless, the character of Nick was played by infant twins Marco and Stefan Flores from 1989 to 1991. Child actor John Alden played the role of Nick from 1991 to 1994. Joshua Morrow played the role of Nick from 2015 to 2020.", "prediction 4": "On the Young and the Restless, the character of Nicholas Newman is played by several different actors. John Alden played the role of Nick from 1991 to 1994, while Thad Luckinbill played Nick from 1999 to 2010. John Alden's portrayal of the character was replaced by Joshua Morrow in 2015.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[8]}", "start": 124, "end": 132 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 165, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 279 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The character of Nicholas Newman on The Young and the Restless was played by infant twins Marco and Stefan Flores in 1989, while child actor Griffin Ledner took over the following year, departing in January 1991. Child actor John Alden played the role of Nick from 1991 to 1994. On June 21, 1994, the producers of the series decided to rapidly age Nick to a teenager. Since then, the role has been portrayed by actor Joshua Morrow" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who was the most powerful witch in charmed?", "passages": [ [ "Piper Halliwell", "Executive producer Brad Kern stated that Piper was written into the series as \"the middle sister just trying to keep the peace, trying to find love, trying to find her career, and trying to keep Prue and Phoebe from killing each other.\"", "When the series was in its first development stages, executive producer Aaron Spelling had always known who he wanted for the role of Prue, Shannen Doherty, an actress from a previous Spelling Television series, \"Beverly Hills, 90210\".", "Doherty already devoted to the project pitched the idea of her best friend for the role of Piper Halliwell, former \"Picket Fences\" actress Holly Marie Combs.", "Doherty played the role of Prue in a 28-minute test pilot (the \"unaired pilot\", never aired on television) alongside Combs and actress Lori Rom who played the youngest sister Phoebe Halliwell.", "Rom quit the series and a new pilot was filmed with former \"Who's the Boss\" actress Alyssa Milano, who took over the role of Phoebe.", "Piper is the second eldest Halliwell sister and is portrayed by Holly Marie Combs in all of the show's aired 178 episodes as well as the unaired pilot, making Combs the only cast member to appear in the complete series and the first pilot." ], [ "Prue Halliwell", "Prue Halliwell\n\nPrudence \"Prue\" Halliwell is a fictional character from the American television series \"Charmed\", played by Shannen Doherty from October 7, 1998 until May 17, 2001.", "The character was created by Constance M. Burge, who based Prue on her older sister.", "Prue is introduced into the series as the eldest sister to Piper (Holly Marie Combs) and Phoebe Halliwell (Alyssa Milano).", "She is one of the first original featured leads and, more specifically, a Charmed Oneone of the most powerful witches of all time.", "Prue initially possesses the power to move objects with her mind by chanelling telekinesis through her eyes.", "As the series progresses, she learns how to channel her telekinesis through her hands and gains the power of astral projection, the ability to be in two places at once.", "Prue also develops martial arts skills and becomes an effective hand-to-hand fighter like Phoebe.", "Prue is portrayed as the oldest, responsible, strong, \"kick-ass sister\" and \"leader of the group.\"", "During her three seasons on \"Charmed\", she is regarded as the strongest and most powerful witch of the Halliwell sisters." ], [ "Charmed", "Charmed\n\nCharmed is an American fantasy drama television series created by Constance M. Burge and produced by Aaron Spelling and his production company Spelling Television, with Brad Kern serving as showrunner.", "The series was originally broadcast by The WB for eight seasons from October 7, 1998, until May 21, 2006.", "The series narrative follows a trio of sisters, known as The Charmed Ones, the most powerful good witches of all time, who use their combined \"Power of Three\" to protect innocent lives from evil beings such as demons and warlocks.", "Each sister possesses unique magical powers that grow and evolve, while they attempt to maintain normal lives in modern-day San Francisco.", "Keeping their supernatural identities separate and secret from their ordinary lives often becomes a challenge for them, with the exposure of magic having far-reaching consequences on their various relationships and resulting in a number of police and FBI investigations throughout the series.", "There were several instances where their secrets were revealed, mostly to their lovers.", "The series initially focuses on the three Halliwell sisters, Prue (Shannen Doherty), Piper (Holly Marie Combs) and Phoebe (Alyssa Milano).", "Following Prue's death in the third-season finale, their long-lost half sister Paige Matthews (Rose McGowan) assumes her place within the \"Power of Three\" from season four onwards." ] ], "gold": "Charmed is an American supernatural fantasy drama television series with a narrative following a trio of sisters, known as The Charmed Ones, the most powerful good witches of all time, who use their combined \"Power of Three\" to protect innocent lives from evil beings such as demons and warlocks. Each sister possesses unique magical powers that grow and evolve, while they attempt to maintain normal lives in modern-day San Francisco. The series initially focuses on the three Halliwell sisters, the eldest, Prue Halliwell, middle sister, Piper Halliwell, and youngest sister, Phoebe Halliwell. Following Prue's death in the third-season finale, their long-lost half sister Paige Matthews assumes her place within the \"Power of Three\" from season four onwards.", "prediction 1": "Prue Halliwell is a fictional character from the American television series Charmed, played by Shannen Doherty from October 7, 1998 until May 17, 2001. She was regarded as the strongest and most powerful witch of the three Halliwell sisters in the series.", "prediction 2": "The most powerful witch in the American television series Charmed was Prue Halliwell. In the series, in three different seasons, she was the most powerful witch. The most powerful witch in Charmed was Piper Halliwell.", "prediction 3": "In the American television series, Charmed, Prue \"Prue\" Halliwell was the most powerful witch. In the show, she was portrayed as the oldest, responsible, strong, \"kick-ass sister\" and \"leader of the group.\"", "prediction 4": "Prue Halliwell was the most powerful witch in the American television series Charmed. She was played by Shannen Doherty throughout the series. In the original television series, the character was played by Holly Marie Combs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 151 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "Charmed is an American fantasy drama television series with a narrative following a trio of sisters, known as The Charmed Ones, the most powerful good witches of all time, who use their combined \"Power of Three\" to protect innocent lives from evil beings such as demons and warlocks. Each sister possesses unique magical powers that grow and evolve, while they attempt to maintain normal lives in modern-day San Francisco. The series initially focuses on the three Halliwell sisters, the eldest, Prue Halliwell, middle sister, Piper Halliwell, and youngest sister, Phoebe Halliwell. Prue was regarded as the strongest and most powerful witch of the three Halliwell sisters in the series. Following Prue's death in the third-season finale, their long-lost half sister Paige Matthews assumes her place within the \"Power of Three\" from season four onwards." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "How tall are the twin towers in new york?", "passages": [ [ "Twin Towers 2", "Twin Towers 2\n\nThe Twin Towers II (also known as Twin Towers 2, New Twin Towers, Trump Twin Towers and World Trade Center Phoenix) was a proposed twin-towered skyscraper complex which would have been located at the World Trade Center site in Manhattan, New York City.", "The proposed complex would have replaced the former Twin Towers of the World Trade Center destroyed in the September 11 attacks, restoring the skyline of the city to its former state.", "The main design for the proposed complex would feature new landmark twin towers, nearly identical to the originals designed by Minoru Yamasaki, though it would feature 115 stories\u20145 floors taller than the originals, among other differences.", "Beside the towers, an above-ground memorial would have occupied the footprints of the original towers.", "The new site would also have featured three 12-story buildings, replacing the original 3, 4 and 5 World Trade Center.", "The complex was designed and developed by American architect Herbert Belton and American engineer Kenneth Gardner, and sponsored by Donald Trump.", "After the September 11 attacks in 2001, several ideas about building new twin towers were discussed online and in the media.", "After the Lower Manhattan Development Corporation (LMDC) launched the World Trade Center Site Memorial Competition in 2002, seven architectural groups were commissioned by the organization to create a proposal to restore the Manhattan skyline." ], [ "World Trade Center in popular culture", "World Trade Center in popular culture\n\nThe original World Trade Center, which featured the landmark Twin Towers (1 WTC and 2 WTC), was a building complex in the Financial District in Lower Manhattan, New York City.", "1 and 2 World Trade Center\u2013the North and South Tower\u2013stood at 1,368 feet and 1,362 feet with 110-stories, respectively, becoming the tallest buildings in the world from 1971\u20131973.", "The North Tower, with its antenna included, was the tallest building in the world by pinnacle height until the towers were destroyed in the September 11 attacks in 2001.", "An iconic feature of the New York City skyline for nearly three decades, the World Trade Center has been featured in cartoons, comic books, computer games, video games, television, films, photographs, artwork and music videos.", "Most of the Marvel Comics' heroes reside in New York City, so views of the towers were not uncommon.", "The World Trade Center complex was featured in numerous other comics, as well.", "The Twin Towers of the World Trade Center have also been depicted in several online webcomics:" ], [ "Mandarin Oriental, New York", "Mandarin Oriental, New York\n\nMandarin Oriental, New York, is a five-star hotel located in Manhattan's Time Warner Center at Columbus Circle in New York City, managed by Mandarin Oriental Hotel Group.", "A part of the multi-use Time Warner Center development, the hotel opened in December 2003.", "In addition to the 248 guestrooms and suites, the hotel provides services for 64 residences.", "The hotel has received many national and international awards, and operates one of only two Forbes Five-Star spas in Manhattan.", "The Mandarin Oriental is located more than above ground in the north tower of the Time Warner Center at Columbus Circle.", "The Time Warner Center contains of mixed-use space and is to date the largest such development in New York City history.", "In addition to the hotel and private condominiums, the complex includes The Shops at Columbus Circle, numerous upscale restaurants, Time Warner\u2019s headquarters, CNN live broadcast production studios, office and residential space, and a performance hall for Jazz at Lincoln Center.", "The AAA Five-Diamond awarded hotel contains 202 guestrooms and 46 suites on floors 35 to 54 of the Time Warner Center with views of Central Park and the Hudson River.", "Vivienne Tam, a noted New York fashion designer, designed the hotel\u2019s signature fan, which is displayed in the hotel lobby.", "Dale Chihuly created two glass pieces installed in the hotel." ] ], "gold": "The Twin Towers of Deutsche Bank Center, formally known as Time Warner Center, in Manhattan, New York are a mixed use building on Columbus Circle standing at 751 feet or 229 meters tall. The proposed Twin Towers II, which were planned to be a skyscraper complex located at the World Trade Center site in Manhattan that would have replaced the former Twin Towers destroyed in the September 11 attacks, are 1,476 feet or 450 meters tall. The original Twin Towers of the World Trade Center in New York stood at 1,368 feet or 417 meters tall, and 1,362 feet or 417 meters tall and at the time were the tallest buildings in the world. (also One Columbus Circle and formerly Time Warner Center) is a mixed-use building on Columbus Circle in Manhattan, New York City.", "prediction 1": "The original World Trade Center, featuring the landmark Twin Towers 1 and 2 WTC, was a building complex in the Financial District in Lower Manhattan, New York City. The North and South Towers, also known as the North and South Towers, stood at 1,356 feet and 1,362 feet, respectively, becoming the tallest buildings in the world from 1971\u20131973. The North Tower, with its antenna included, was the tallest building in the world by pinnacle height until the towers were destroyed in the September 11 attacks in 2001. The South Towers were 1,368 feet tallest in the city, while the South Tower was 1,368 feet tallest. The North Towers were 1,368 feet each.", "prediction 2": "In New York, the twin towers are 1,362 feet tall and 1,368 feet tall, respectively.", "prediction 3": "The twin towers in New York are approximately 1,368 feet tall, and 1,362 feet tall, respectively. The North and South Towers of the World Trade Center were the tallest buildings in the world at the time of their destruction in the September 11, 2001 attacks. The proposed Twin Towers II skyscraper complex would have replaced the former Twin Towers of the World Trade Center destroyed in the September 11 attacks. The proposed twin-towered skyscraper complex would feature new landmark twin towers, nearly identical to the originals designed by Minoru Yamasaki, though it would feature 115 stories\u20145 floors taller than the originals, among other differences.", "prediction 4": "The original Twin Towers of the World Trade Center, which featured the landmark Twin Towers 1 and 2 WTC, was a building complex in the Financial District in Lower Manhattan, New York City. The North Tower stood at 1,368 feet and the South Tower stood at 1,362 feet with 110-stories, respectively. The North Tower, with its antenna included, was the tallest building in the world by pinnacle height until the towers were destroyed in the September 11 attacks in 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 149 }, { "error type": "Irrelevant", "explanation": "", "start": 33, "end": 55 }, { "error type": "Redundant", "explanation": "The North and South Towers, ", "start": 193, "end": 234 }, { "error type": "Irrelevant", "explanation": "", "start": 345, "end": 451 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 244, "end": 249 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 519, "end": 524 }, { "error type": "Redundant", "explanation": "The North Tower, with its antenna included, was the tallest building in the world", "start": 537, "end": 568 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 595, "end": 600 }, { "error type": "Redundant", "explanation": "The North and South Towers, also known as the North and South Towers, stood at 1,356 feet and 1,362 feet, respectively, becoming the tallest buildings in the world from 1971\u20131973. ", "start": 615, "end": 647 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 648, "end": 653 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The original World Trade Center, the Twin Towers 1 and 2, was in New York City. The North and South Towers stood at 1,368 feet and 1,362 feet, respectively, becoming the tallest buildings in the world from 1971\u20131973. The towers were destroyed in the September 11 attacks in 2001. The Time Warner Center contains mixed-use and is located at Columbus Circle in New York City. The Twin Towers II was a proposed twin-towered skyscraper complex which would have been located at the World Trade Center site in Manhattan, New York City. They would have been 115 stories tall." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What is the name of the satellite that orbits earth?", "passages": [ [ "International Space Station", "International Space Station\n\nThe International Space Station (ISS) is a space station, or a habitable artificial satellite, in low Earth orbit.", "Its first component launched into orbit in 1998, with the first long-term residents arriving in November 2000.", "It has been inhabited continuously since that date.", "The last pressurised module was fitted in 2011.", "The station is expected to operate until at least 2028.", "Development and assembly of the station continues, with components scheduled for launch in 2018 and 2019.", "The ISS is the largest human-made body in low Earth orbit and can often be seen with the naked eye from Earth.", "The ISS consists of pressurised modules, external trusses, solar arrays, and other components.", "ISS components have been launched by Russian Proton and Soyuz rockets, and American Space Shuttles.", "The ISS serves as a microgravity and space environment research laboratory in which crew members conduct experiments in biology, human biology, physics, astronomy, meteorology, and other fields.", "The station is suited for the testing of spacecraft systems and equipment required for missions to the Moon and Mars.", "The ISS maintains an orbit with an altitude of between by means of reboost manoeuvres using the engines of the \"Zvezda\" module or visiting spacecraft.", "It completes \u00a0orbits per day." ], [ "Space research", "From 1986 to 2001, Russian space station Mir served as a permanent microgravity research laboratory in which crews conducted experiments in biology, human biology, physics, astronomy, meteorology and spacecraft systems with a goal of developing technologies required for permanent occupation of outer space.", "The International Space Station has played a key role in advances in space research.", "Since the arrival of Expedition 1 in November 2000, the station has been continuously occupied for , having exceeded the previous record of almost ten years set by the Russian station Mir.", "The ISS serves as a microgravity and space environment research laboratory in which crew members conduct tests in biology, physics, astronomy and many other fields." ], [ "Envisat", "Envisat\n\nEnvisat (\"Environmental Satellite\") is a large inactive Earth-observing satellite which is still in orbit.", "Operated by the European Space Agency (ESA), it was the world's largest civilian Earth observation satellite.", "It was launched on 1 March 2002 aboard an Ariane 5 from the Guyana Space Centre in Kourou, French Guiana, into a Sun synchronous polar orbit at an altitude of (\u00b1\u00a0).", "It orbits the Earth in about 101 minutes, with a repeat cycle of 35 days.", "After losing contact with the satellite on 8 April 2012, ESA formally announced the end of Envisat's mission on 9 May 2012.", "Envisat cost \u20ac2.3 billion (including \u20ac300 million for 5 years of operations) to develop and launch.", "The mission is due to be replaced by the Sentinel series of satellites.", "The first of these, Sentinel 1, has taken over the radar duties of Envisat since its launch in 2014.", "Envisat was launched as an Earth observation satellite.", "Its objective was to service the continuity of European Remote-Sensing Satellite missions, providing additional observational parameters to improve environmental studies." ], [ "Aqua (satellite)", "Aqua (satellite)\n\nAqua (EOS PM-1) is a NASA scientific research satellite in orbit around the Earth, studying the precipitation, evaporation, and cycling of water.", "It is the second major component of the Earth Observing System (EOS) preceded by Terra (launched 1999) and followed by Aura (launched 2004).", "The name \"Aqua\" comes from the Latin word for water.", "The satellite was launched from Vandenberg Air Force Base on May 4, 2002, aboard a Delta II rocket.", "Aqua is on a Sun-synchronous orbit.", "It flies as the third in the satellite formation called the \"A Train\" with several other satellites (OCO-2, the Japanese GCOM W1, CALIPSO, CloudSat, and Aura).", "Aqua is one of NASA's missions for Earth science operating in the A-Train constellation.", "It has demonstrated a very high level of precision in making the primary long-term measurements of the mission.", "These highly calibrated climate quality measurements of radiance, reflectance, and backscatter have been used to cross-calibrate past and present sensors launched by NASA, as well as a variety of sensors launched from other agencies and the international community." ] ], "gold": "The International Space Station is a modular space station, also known as a habitable artificial satellite, that orbits the Earth. The International Space Station serves as a microgravity and space environment research laboratory in which scientific research is conducted in astrobiology, astronomy, meteorology, physics and other fields. Additionally, Envisat, or Environmental Satellite, is a large inactive Earth-observing satellite which is still orbiting the Earth. Operated by the European Space Agency, it was previously the world's largest civilian Earth observation satellite. It was launched on March 1, 2002. After losing contact with the satellite on April 8, 2012, the European Space Agency formally announced the end of Envisat's mission on May 9, 2012. This mission has been replaced by the Sentinel series of satellites. The first of these, Sentinel 1, has taken over the radar duties of Envisat since its launch in 2014. Another satellite that orbits the Earth, Aura is a multi-national NASA scientific research satellite. This satellite studies the Earth's ozone layer, air quality and climate. Aura is the third major component of the Earth Observing System, following Terra and Aqua, two satellites that also orbit the earth. The Earth Observing System, which contains the satellites Aura, Terra and Aqua, is a NASA program consisting of a series of artificial satellite missions and scientific instruments in Earth's orbit. These satellites and instruments are designed for long-term global observations of the land surface, biosphere, atmosphere and oceans.", "prediction 1": "The Earth Observing System (EOS) satellite orbits Earth in a Sun-synchronous orbit. It is operated by the European Space Agency (ESA), and was the world's largest civilian Earth observation satellite. Aqua is a NASA scientific research satellite in orbit around the Earth, studying the precipitation, evaporation, and cycling of water. It orbits Earth in about 101 minutes, with a repeat cycle of 35 days.", "prediction 2": "The Earth Observing System is a constellation of satellites orbiting the Earth. Several satellites orbit around the Earth. The International Space Station is the largest human-made body in low Earth orbit that can often be seen from Earth. There are several Earth observation satellites orbiting the Earth. There is also an Earth observation satellite orbiting the Earth called Aqua, which was launched on 1 March 2002 and the Envisat Earth observation satellite orbits the Earth.", "prediction 3": "The Earth Observing System, or EOS, includes several satellites orbiting the Earth. The first satellite, Terra, launched into orbit in 1999, was Terra PM-1, which orbited the Earth in a Sun-synchronous orbit. The second satellite, Aqua, that orbits the Earth in a Sun-synchronous orbit, launched in 2002, is Aqua PM-2, which orbits the Earth in about 101 minutes.", "prediction 4": "There are several satellites that orbit Earth. One is called Aqua, a NASA scientific research satellite. Another is called Envisat, a large inactive Earth observation satellite which is still in orbit.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 405 }, { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 83 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": " The International Space Station (ISS) is a space station, or a habitable artificial satellite, in low Earth orbit. The ISS serves as a microgravity and space environment research laboratory in which crew members conduct experiments in biology, human biology, physics, astronomy, meteorology, and other fields. Envisat (\"Environmental Satellite\") is a large inactive Earth-observing satellite which is still in orbit. It is operated by the European Space Agency (ESA), and was the world's largest civilian Earth observation satellite. It was launched on 1 March 2002. After losing contact with the satellite on 8 April 2012, ESA formally announced the end of Envisat's mission on 9 May 2012. The mission is due to be replaced by the Sentinel series of satellites. The first of these, Sentinel 1, has taken over the radar duties of Envisat since its launch in 2014. Aqua is the second major component of the Earth Observing System (EOS) preceded by Terra and followed by Aura. It flies in the satellite formation with several other satellites, OCO-2, the Japanese GCOM W1, CALIPSO, CloudSat." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What nation lies on both africa and asia?", "passages": [ [ "Boundaries between the continents of Earth", "Though most geographic sources assign the area south of the Caucasus Mountain crest to Southwest or West Asia, no definition is entirely satisfactory, with it often becoming a matter of self-identification.", "Cultural influences in the area originate from both Asia and Europe.", "While geographers rarely define continents primarily politically, Georgia and to a lesser extent Armenia and Azerbaijan are increasingly in the 21st century politically oriented towards Europe, but Armenia has a great cultural diaspora to the south, and Azerbaijan shares a cultural affinity with Iranian Azerbaijan as well as with the Turkic countries of Central Asia.", "The Turkish city Istanbul lies in on both sides of the Bosporus (one of the Turkish Straits), making it a transcontinental city.", "Russia and Turkey are transcontinental countries with territory in both Europe and Asia by any definition except that of Eurasia as a single continent.", "While Russia is historically a European country with a history of imperial conquests in Asia, the situation for Turkey is inverse, as that of an Asian country with imperial conquests in Europe.", "Kazakhstan is also a transcontinental country by this definition, its West Kazakhstan and Atyrau provinces extending on either side of the Ural River.", "This Ural River delineation is the only segment not to follow a major mountain range or wide water body, both of which often truly separate populations." ], [ "Boundaries between the continents of Earth", "The usual line taken to divide Africa from Asia today is at the Isthmus of Suez, the narrowest gap between the Mediterranean and Gulf of Suez, the route today followed by the Suez Canal.", "This makes the Sinai Peninsula geographically Asian, and Egypt a transcontinental country.", "Less than 2% of Egyptian population live in the Sinai, and hence Egypt, even though technically transcontinental, is usually considered an African country entirely and not partly Asian.", "But when discussing the geopolitical region of the Middle East and North Africa, Egypt is usually grouped with the Western Asian countries as part of the Middle East, while Egypt's western neighbor Libya is grouped with the remaining North African countries as the Maghreb.", "However, they are both members of the Arab League as well as the African Union.", "The Seychelles, Mauritius, and Comoros are island nations in the Indian Ocean associated with Africa.", "The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country.", "The border between North America and South America is at some point on the Isthmus of Panama.", "The most common demarcation in atlases and other sources follows the Dari\u00e9n Mountains watershed divide along the Colombia-Panama border where the isthmus meets the South American continent." ], [ "Yom Kippur War", "Yom Kippur War\n\nThe Yom Kippur War, Ramadan War, or October War (, ', or \u05de\u05dc\u05d7\u05de\u05ea \u05d9\u05d5\u05dd \u05db\u05d9\u05e4\u05d5\u05e8\", \"; , ', or , '), also known as the 1973 Arab\u2013Israeli War, was a war fought from October 6 to 25, 1973, by a coalition of Arab states led by Egypt and Syria against Israel.", "The war took place mostly in Sinai and the Golan\u2014occupied by Israel during the 1967 Six-Day War\u2014with some fighting in African Egypt and northern Israel.", "Egypt's initial war objective was to use its military to seize a foothold on the east bank of the Suez Canal and use this to negotiate the return of the rest of Sinai.", "The war began when the Arab coalition launched a joint surprise attack on Israeli positions, on Yom Kippur, the holiest day in Judaism, which also occurred that year during the Muslim holy month of Ramadan.", "Egyptian and Syrian forces crossed ceasefire lines to enter the Sinai Peninsula and the Golan Heights, respectively.", "Both the United States and the Soviet Union initiated massive resupply efforts to their respective allies during the war, and this led to a near-confrontation between the two nuclear superpowers.", "The war began with a massive and successful Egyptian crossing of the Suez Canal." ] ], "gold": "Contiguous transcontinental countries are states that have one continuous or immediately-adjacent piece of territory that spans a continental boundary, most commonly the line that separates Europe and Asia. The modern convention for the land boundary between Asia and Africa runs along the Isthmus of Suez and the Suez Canal in Egypt. After the Yom Kippur War of October 1973, Israel briefly became a transcontinental state as it occupied territory on the African side of the Suez Canal, in addition to the entirety of Sinai, but the land was returned in 1975 per the Sinai Interim Agreement. Out of the 27 governorates of Egypt, two lie entirely on the Asian Sinai Peninsula and two are transcontinental: Ismailia Governorate is nearly equally divided by the Suez Canal, and Suez Governorate, which is coterminous with the \"transcontinental city\" of Suez and has a small portion east of the Canal.", "prediction 1": "There are several countries that lie on both continents. The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country. The country that lies on both continents is Turkey, and the country of Georgia lies on both continents. The country that lies on both continents is the Republic of Georgia.", "prediction 2": "The usual line taken to divide Africa from Asia today is at the Isthmus of Suez, the narrowest gap between the Mediterranean and Gulf of Suez, the route today followed by the Suez Canal. This makes the Sinai Peninsula geographically Asian, and Egypt a transcontinental country. The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country.", "prediction 3": "The usual line taken to divide Africa from Asia today is at the Isthmus of Suez, the narrowest gap between the Mediterranean and Gulf of Suez, the route now followed by the Suez Canal. The Sinai Peninsula is geographicly Asian, and Egypt is a transcontinental country. The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country.", "prediction 4": "The usual line taken to divide Africa from Asia today is at the Isthmus of Suez, the narrowest gap between the Mediterranean and Gulf of Suez, the route today followed by the Suez Canal. This makes the Sinai Peninsula geographically Asian, and Egypt a transcontinental country. Less than 2% of Egyptian population live in the Sinai, and hence Egypt, even though technically transcontinental, is usually considered an African country entirely and not partly Asian. The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 208, "end": 223 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 270, "end": 286 }, { "error type": "Redundant", "explanation": "and the country of Georgia lies on both continents. ", "start": 287, "end": 355 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "There are several countries that lie on both continents. The usual line taken to divide Africa from Asia today is at the Isthmus of Suez, the narrowest gap between the Mediterranean and Gulf of Suez, the route today followed by the Suez Canal. Thus, Egypt is a transcontinental country. The Seychelles, Mauritius, and Comoros are island nations in the Indian Ocean associated with Africa. The island of Socotra may be considered African as it lies on this continent's shelf, but is part of Yemen, an Asian country. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who plays fiona's boss on shameless season 4?", "passages": [ [ "Fiona Dolman", "Fiona Dolman\n\nFiona Dolman (born 30th January 1970) is a Scottish actress best known for playing Miss Pamela Andrews in the ITV daytime drama series and spinoff to \"The Royal\", \"The Royal Today\", and for the role of Jackie Rosemary Lambert Bradley, PC Mike Bradley's solicitor wife in \"Heartbeat\".", "In the series, her character Jackie drove a blue Hillman Imp (129 EWR) and then a green Sunbeam Alpine (LVY666F).", "She left at the end of series 10 when she confessed to Mike that she\u2019d met someone else.", "She also featured in Channel 4's vampire serial \"Ultraviolet\".", "Dolman featured briefly in the BBC show \"Paradox\".", "She also appeared in the BBC series \"Waterloo Road\" in August 2010 as a Police sergeant.", "From April 2011 Dolman appears as Sarah Barnaby, wife of DCI John Barnaby and new head teacher at Causton Comprehensive School, in \"Midsomer Murders\".", "She has also appeared on Lily Savage's Blankety Blank." ], [ "Shameless (season 5)", "Shameless (season 5)\n\nThe fifth season of \"Shameless\", an American comedy-drama television series based on the British series of the same name by Paul Abbott, premiered on January 11, 2015 on the Showtime television network.", "Executive producers are John Wells, Paul Abbott and Andrew Stearn, and producer Michael Hissrich.", "Like all previous seasons, the season consisted of 12 episodes.", "The season picks up from the season 4 finale two to three months after the events of finding out Ian's bipolarity and Fiona's release from prison.", "Fiona begins a new relationship with a skilled member of a rock 'n' roll band while juggling her new job at Patsy's Pies, where she has flirtatious encounters with her boss, Sean.", "Lip is home from college for the summer, and is torn between two worlds as his loyalty to the South Side is questioned while gentrification comes to the neighborhood.", "Ian's declining mental health raises the concerns of Mickey and the rest of the Gallaghers, yet he remains in denial of his condition.", "Debbie continues to struggle with the pains of adolescence and Carl begins a new business venture as a drug-dealer.", "Sammi becomes more involved in the lives of her half-brothers and sisters while Frank struggles with sobriety following his recent liver transplant." ], [ "Shameless (season 2)", "Lip wants to continue seeing Karen, who is now attending Sex Addicts Anonymous meetings and in a sex-free relationship with a fellow group member; however, he is also preoccupied with summer courses, running a fighting ring, and selling pot and alcohol out of an ice cream truck with Kev.", "Fiona and Veronica are waitressing at a local club; Fiona is seeing someone to get her mind off of Steve, though Veronica is adamant her new boyfriend is \"a rebound\" and \"even looks like Steve.\"", "Ian is still working for Kash and Linda, whose marriage is deteriorating despite her pregnancy; Ian also expresses interest in attending West Point, and Lip agrees to help him with his application and grades; he is also looking forward to Mickey's release from jail.", "Debbie and Carl run a babysitting service in the house to bring in extra funds.", "Sheila is simultaneously trying to find Eddie (who committed suicide last season) and working on getting over her agoraphobia.", "\n\n", "The show's second season began shooting on July 5, 2011 and it premiered on Sunday, January 8, 2012 at a new time slot at 9:00pm." ] ], "gold": "Shameless is an American comedy-drama television series that aired on Showtime from January 9, 2011 to April 11, 2021. At the start of season 4 of the series, Fiona is adjusting to her new job at Worldwide Cup and begins dating her boss, Mike Pratt, who is played by Jake McDorman. Later in season 4, Fiona gets a job as a waitress at the Golden House Restaurant, a diner managed by Charlie Peters, who is played by Jeffrey Dean Morgan. ", "prediction 1": "Sean Gallagher played Fiona's boss on Shameless season 4. In the first half of the fourth season, Sean played Fiona's boss, but in Season 5, Sean played Fiona's boss. In the second half of the fourth season, Sean played Fiona's boss, and in the third and final half, Sean played Fiona's boss. In the fourth and final half of the fourth season, Fiona had flirtatious encounters with Sean.", "prediction 2": "On Shameless season 4, Fiona has flirtatious encounters with her boss, Sean. Sean is played by Scottish actress Fiona Dolman.", "prediction 3": "Sean O'Brien plays Fiona's boss on Shameless season 4. The fourth season of the American comedy-drama television series Shameless, which is based on the British television series Shameless, was filmed in June, 2013, and aired on January 10, 2015.", "prediction 4": "On the show Shameless, Fiona Dolman flirts with her boss Sean while juggling her new job at Patsy's Pies. Sean is Sean Gallagher, a shady businessman and the boss of the housewife Fiona works for. In the season 4 finale, Patrick McCabe played Sean, with Sean playing Fiona's boss, Veronica. Sean's character, Sean's mother, is played by Jennifer McGuire.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 57 }, { "error type": "Redundant", "explanation": "Sean Gallagher played Fiona's boss on Shameless season 4. ", "start": 58, "end": 166 }, { "error type": "Redundant", "explanation": "Sean Gallagher played Fiona's boss on Shameless season 4. ", "start": 167, "end": 292 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 387 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the voice of finn in adventure time?", "passages": [ [ "Finn the Human", "In the following episode \"Two Swords\", Finn gets fitted with a new robotic arm by Princess Bubblegum, to replace the missing arm.", "In the Season 9 finale \"Three Buckets\" it is revealed that this arm can transform into many different weapons.", "In the series final episode, \"Come Along With Me\", Finn loses his robotic arm while entering GOLB's mouth, the entity biting it off and making it fall to the ground.", "1000 years on the future, a pair called Shermy and Beth finds that robotic arm after it fell from a Prize Ball Guardian's feet.", "Finn is currently 17 years old as revealed in the season 10 episode \"Seventeen\".", "At the beginning of the series, Finn was a 12-year-old boy who is supposedly the only known human in the Land of Ooo.", "During the episode \"Mystery Train\", Finn turned 13; it has been stated that the episode first airing date (March 14) is Finn's birthday.", "After season 3 ended, Pendleton Ward stated in an interview that Finn was 14.", "Finn was 15 years old in the second half of Season 5, according to Adam Muto.", "In the Season 6 finale, \"The Comet\", Finn reveals that he has reached 16 years of age.", "And finally, during the episode \"Seventeen\", Finn turned 17 years old." ], [ "Finn the Human", "Finn the Human\n\nFinn Mertens (also known as Finn and Finn the Human) is a fictional character and the main protagonist of the American animated television series \"Adventure Time\" created by Pendleton Ward.", "He is voiced by Jeremy Shada in most appearances.", "The character made his debut in the original pilot, where he was named Pen and voiced by Zack Shada, Jeremy's older brother.", "The character has been met with largely positive critical reception.", "Finn debuted at age 12 but aged over the course of the show, and was 17 by the series finale.", "Finn sets off on magical random quests around the Land of Ooo.", "He would gladly fight or beat up anything evil, but would not harm anything good or \"neutral\" as shown in \"The Enchiridion!\" when he refused to squash an innocent ant.", "Having a strong moral code, Finn swore that he would help anyone in need and often performs heroic feats to save the day; however, Finn's enthusiastic nature becomes more toned down as the series progresses, suggesting he is both maturing and developing as a character as he ages.", "As shown in \"Memories of Boom Boom Mountain\", Finn appears to have been abandoned in the woods during infancy." ], [ "Jeremy Shada", "Jeremy Shada\n\nJaden Jeremy Shada () (born January 21, 1997) is an American actor, voice actor, singer and musician who is best known for his work as the voice of Finn the Human from the American animated television series \"Adventure Time\".", "He is also known for starring as various characters in the sketch-comedy series \"Incredible Crew\" and currently voice acts as Lance in \"\".", "Shada is also known as the bass player and secondary vocalist in the rock band Make Out Monday.", "Shada was born in Boise, Idaho.", "He began acting at the age of seven soon after moving to Los Angeles with his family.", "He was inspired to act by his older brother Zack Shada, who had begun to act himself.", "Shada initially appeared in commercials.", "Later on, he began auditioning for voice acting and theatrical performances, taking the advice from a voice over agent.", "His first live-action theatrical role was as Young Kurt Diamond in \"No Rules\".", "He has since appeared in additional live action and voice acting roles, such as playing Charlie Pace in childhood flashbacks on \"Lost\".", "In 2009, Jeremy Shada's agent approached him with the idea of auditioning for the role of Finn.", "Both recognized that Zack Shada had been the original voice of Finn in the pilot episode of \"Adventure Time\" three years before." ], [ "Puhoy", "Puhoy\n\n\"Puhoy\" is the sixteenth episode of the fifth season of the American animated television series \"Adventure Time\".", "The episode was written and storyboarded by Tom Herpich and Steve Wolfhard, from a story by Patrick McHale, Kent Osborne, and Pendleton Ward.", "It originally aired on Cartoon Network on April 8, 2013.", "The episode guest stars Mandy Siegfried as Roselinen, Jonathan Frakes as Adult Finn, and Wallace Shawn as Rasheeta.", "The series follows the adventures of Finn (voiced by Jeremy Shada), a human boy, and his best friend and adoptive brother Jake (voiced by John DiMaggio), a dog with magical powers to change shape and grow and shrink at will.", "In this episode, Finn begins second-guessing his relationship with Flame Princess, so he builds a giant pillow fort.", "While navigating it, Finn seemingly falls asleep and dreams that he ends up in a pillow world where he marries a pillow woman named Roselinen (Siegfriend) and has two children with her.", "In the pillow world, Finn grows old and dies, only to wake up in the real world.", "He soon receives a call from Flame Princess, reaffirming their relationship." ] ], "gold": "Finn Mertens, also known as Finn the Human, is a fictional character and the main protagonist of the American animated television series Adventure Time created by Pendleton Ward. He is voiced by Jeremy Shada in most appearances. The character made his debut in the original pilot, where he was named Pen and voiced by Zack Shada, Jeremy's older brother. Jonathan Frakes voices Finn as an adult, while David Bradley voices Finn as an elderly man.", "prediction 1": "Finn Mertens is a fictional character and the main protagonist of the American animated television series Adventure Time. He is voiced by Jeremy Shada in most appearances. The character made his debut in the original pilot, where he was named Pen and voiced by Zack Shada, Jeremy's older brother. The voice of Finn was changed several times throughout the series. The most recent change was in Season 5, Episode 16, which was voiced by Jeremy Shada.\n", "prediction 2": "Jeremy Shada is the voice of Finn in the American animated television series Adventure Time. Shada is the brother of the protagonist of the series and played the character for several seasons. In the fifth season episode Puhoy, Finn is voiced by James Matthias Rapp.", "prediction 3": "Finn Mertens is a fictional character and the main protagonist of the American animated television series Adventure Time. In the revived show, he was voiced by Jeremy Shada, who joined the cast in Season 9, Season 10, and Season 11 respectively. In addition, in Season 12, Finn is voiced by Jordan Mistry.", "prediction 4": "Jason Jason Shada has voiced the character Finn Mertens in Adventure Time. Jake Lundgren has voiced Finn in the animated series Paranormal Activity. Jaden Jeremy Shada has voiced the character several times. Artist Jeremy Alexander Roach has voiced the character of Finn Blaze in the Paranormal Activity series. The voice of Finn in the animated television series Adventure Time is consistent with Shada's previous work as the character Jake.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 364, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 297, "end": 363 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 4 ] } ], "corrected-prediction": "Finn Mertens is a fictional character and the main protagonist of the American animated television series Adventure Time. He is voiced by Jeremy Shada in most appearances. The character made his debut in the original pilot, where he was named Pen and voiced by Zack Shada, Jeremy's older brother. Jonathan Frakes voices Finn as an adult.\n" }, "preference": [ 1, 1, 1, 0, 1, 0 ] }, { "question": "Who presides over the joint session of parliament?", "passages": [ [ "Joint Session of Indian Parliament", "Joint Session of Indian Parliament\n\nThe Parliament of India is bicameral.", "Concurrence of both houses are required to pass any bill.", "However, the makers of the Constitution of India visualised situations of deadlock between the upper house i.e. Rajya Sabha and the lower house i.e. Lok Sabha.", "Therefore, the Constitution of India provides for Joint sittings of both the Houses to break this deadlock.", "The joint sitting of the Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha.", "The Chairman doesn't preside over the joint session at any mens/cost.", "If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House.", "As per Article 108 of Constitution, a Joint session of Parliament can be summoned in the following situations." ] ], "gold": "The joint sitting of the Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. The Chairman doesn't preside over the joint session at any means/cost.", "prediction 1": "The Joint Session of Indian Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House.", "prediction 2": "The Joint session of the Indian Parliament is called by the President and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. The Chairman doesn't preside over the joint session at any mens/cost. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House.", "prediction 3": "The Joint Session of India's Parliament is called by the President of India under Article 108 of the Constitution of India and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha.", "prediction 4": "The joint sitting of the Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. The Chairman doesn't preside over the joint session at any cost. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 362 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Joint Session of Indian Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. The Chairman doesn't preside over the joint session at any mens/cost." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who did the song go all the way?", "passages": [ [ "Go All the Way (song)", "Go All the Way (song)\n\n\"Go All the Way\" is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen.", "The song reached the Top 5 on three principal US charts: number 5 on the \"Billboard\" Hot 100, number 4 on \"Cashbox\" and number 3 on \"Record World\".", "The single sold more than 1.3 million copies, earning the band their only certified Gold Record.", "It was their second single release, their all-time biggest US hit, and appeared on their debut LP, \"Raspberries\".", "Because of its sexually suggestive lyrics, considered risqu\u00e9 for the day, the song was banned by the BBC.", "The tune ranked at number 33 on \"Billboard\"s Top 100 Singles of 1972 year-end list (number 39 on \"Cashbox\"s year-end best-sellers countdown).", "In 1989, \"Spin\" magazine named \"Go All the Way\" in its list of the \"100 Greatest Singles of All Time\", ranking it at number 91.", "\"Go All the Way\" appeared in \"Blender\" magazine's July 2006 issue as one of its \"Greatest Songs Ever\".", "The song was performed on \"Don Kirshner's Rock Concert, Live\" in 1974." ], [ "Go All the Way (song)", "It was also performed on \"The Mike Douglas Show\".", "\"Go All the Way\" has been featured in three movies.", "Director Cameron Crowe, a Raspberries fan, used the song in his 2000 film \"Almost Famous\".", "The Killers recorded another version of the song for the 2012 film \"Dark Shadows\", an adaptation of the 1966\u20131971 TV series \"Dark Shadows\".", "The song briefly appears in the 2014 Marvel Studios film \"Guardians of the Galaxy\".", "In interviews with hard rock/metal personality Eddie Trunk, he states that this song sparked his interest in music due mainly to the distorted guitar riffs.", "\"Go All the Way\" was included on the \"Raspberries Pop Art Live\" CD set from their reunion concert recording, November 26, 2004, at the House of Blues in Cleveland, Ohio, released August 18, 2017.", "\"Go All the Way\" was recorded by the American melodic rock band From the Fire.", "Matthew Sweet and Bangles member Susanna Hoffs included a faithful rendition of the song in their 2009 collaboration \"Under the Covers, Vol. 2\"." ] ], "gold": "\"Go All the Way\" is a single by American rock group Raspberries, originally sang by Eric Carmen and released in July 1972, that reached the Top 5 on three main US charts: number 5 on the Billboard Hot 100, number 4 on Cashbox, and number 3 on Record World. The single sold more than 1.3 million copies, earning the band their only certified Gold Record. Matthew Sweet and Bangles member Susanna Hoffs would later include a faithful rendition of the song in their 2009 collaboration \"Under the Covers, Vol. 2.\"", "prediction 1": "\"Go All the Way\" is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen. The song reached the Top 5 on three principal US charts: number 5 on the Billboard Hot 100, number 4 on Cashbox and number 3 on Record World. \"Go All the Way\" has been featured in three movies. Director Cameron Crowe, a Raspberries fan, used the song in his 2000 film Almost Famous. The Killers recorded another version of the song for the 2012 film Dark Shadows.", "prediction 2": "\"Go All the Way\" is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen. The song reached the Top 5 on three principal US charts: number 5 on the Billboard Hot 100, number 4 on Cashbox and number 3 on Record World. Go All the Way has been featured in three movies. The Killers recorded another version of the song for the 2012 film Dark Shadows. \"Go All the Way\" was also recorded by the American melodic rock band From the Fire in their 2009 collaboration Under the Covers, Vol. 2 (Under the Covers, Vol.", "prediction 3": "Go All the Way is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen. The song reached the Top 5 on three principal US charts: number 5 on the Billboard Hot 100, number 4 on Cashbox and number 3 on Record World. \"Go All the Way\" has been featured in three movies. Director Cameron Crowe, a Raspberries fan, used the song in his 2000 film Almost Famous. The Killers recorded another version of the song for the 2012 film \"Dark Shadows\".", "prediction 4": "\"Go All the Way\" is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen. The single sold more than 1.3 million copies, earning the band their only certified Gold Record. The song was performed on Don Kirshner's Rock Concert, Live in 1974. \"Go All the Way\" was also included on the \"Raspberries Pop Art Live\" CD set from their reunion concert recording, November 26, 2004, at the House of Blues in Cleveland, Ohio, released August 18, 2017. \"Go All the Way\" was recorded by the American melodic rock band From the Fire.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 324 }, { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 413 }, { "error type": "Irrelevant", "explanation": "", "start": 414, "end": 494 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "\"Go All the Way\" is a single by American pop-rock group Raspberries, released in July 1972 and written by band leader Eric Carmen. The song reached the Top 5 on three principal US charts: number 5 on the Billboard Hot 100, number 4 on Cashbox and number 3 on Record World. The single sold more than 1.3 million copies, earning the band their only certified Gold Record. Matthew Sweet and Bangles member Susanna Hoffs included a faithful rendition of the song in their 2009 collaboration \"Under the Covers, Vol. 2\"." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who played the young tom riddle in harry potter?", "passages": [ [ "Lord Voldemort", "Voldemort appears in seven \"Harry Potter\" films, namely \"Harry Potter and the Philosopher's Stone\", \"Harry Potter and the Chamber of Secrets\", \"Harry Potter and the Goblet of Fire\", \"Harry Potter and the Order of the Phoenix\", \"Harry Potter and the Half-Blood Prince\", \"Harry Potter and the Deathly Hallows \u2013 Part 1\" and \"Harry Potter and the Deathly Hallows \u2013 Part 2\".", "Several actors have portrayed him in his varying incarnations and ages.", "In \"Harry Potter and the Philosopher's Stone\", Voldemort's manifestation is as a face on the back of Quirrell's head, an effect achieved by computer generated imagery.", "Ian Hart, the actor who played Quirrell in the same film, provided the voice and the facial source for this character.", "Voldemort also appears in a scene in the Forbidden Forest where he is seen drinking the blood of a unicorn.", "As Voldemort's face was altered enough by CG work, and Hart's voice was affected enough, there was no confusion by Hart's playing of the two roles.", "In that film, he was also shown in a flashback sequence when he arrived at the home of James and Lily Potter to kill them." ], [ "Lord Voldemort", "Fiennes's nephew, Hero Fiennes-Tiffin, portrayed Tom Riddle as a child in \"Harry Potter and the Half-Blood Prince\".", "By the time filming arrived Christian Coulson was 29, and not considered suitable to return as the adolescent Riddle.", "Thomas James Longley was originally scheduled to take over the role, but last minute renegotiations saw Frank Dillane cast instead.", "After he regains his body in the fourth book, Rowling describes Voldemort as having pale skin, a chalk-white, skull-like face, snake-like slits for nostrils, red eyes and cat-like slits for pupils, a skeletally thin body and long, thin hands with unnaturally long fingers.", "As mentioned in the first chapter of the seventh book, he also has no hair or lips.", "Earlier in life, as seen through flashbacks contained in the second and sixth books, Tom Marvolo Riddle was handsome and tall with pale skin, jet black hair, and dark brown eyes.", "He could charm many people with his looks.", "The transformation into his monstrous state is believed to have been the result of creating his Horcruxes and becoming less human as he continued to divide his soul.", "In the films, Voldemort's eyes are blue with round pupils." ], [ "Lord Voldemort", "In Alan Moore's \"\", a young Tom Marvolo Riddle (introduced as \"Tom\", whose middle name is a \"marvel\" and last name is a \"conundrum\") appears, and becomes the new avatar of Oliver Haddo at the story's conclusion.", "In \"A Very Potter Musical\", Voldemort is played by actor Joe Walker.", "Voldemort also appeared in the 2012 Summer Olympics opening ceremony in London as an inflatable representation of children's literature villains, alongside The Queen of Hearts, Captain Hook, and Cruella de Vil.", "Voldemort appears in \"The Lego Batman Movie\" as one of the prisoners in the Phantom Zone that Joker recruits to take over Gotham City.", "Though Ralph Fiennes is featured in this movie as the voice of Alfred Pennyworth, he does not reprise his role.", "Instead, Voldemort is voiced by Eddie Izzard\n\nOutside of the \"Harry Potter\" video games, Voldemort is also playable in \"Lego Dimensions\", with archive audio of Ralph Fiennes's portrayal in the films used for his voiceovers.", "In \"The Lego Batman Movie\" pack for the game, Voldemort is voiced by Liam O'Brien\".", "A 2018 Italian fan film titled \"\" depicts the story of Tom Riddle's rise to power." ] ], "gold": "Christian Coulson played 16-year-old Tom Riddle in the film Harry Potter and the Chamber of Secrets. Then, in Harry Potter and the Half-Blood Prince, two actors played young Tom Riddle. The nephew of Ralph Fiennes, Hero Fiennes-Tiffin, portrayed 11-year-old Tom Riddle in the film, while Frank Dillane played 16-year-old Tom Riddle. Christian Coulson, who played Tom Riddle in Harry Potter and the Chamber of Secrets, was now 29 years old. Therefore, he was not considered suitable to return to the adolescent role of Tom Riddle in Harry Potter and the Half-Blood Prince.", "prediction 1": "Hero Fiennes-Tiffin, the nephew of Ralph Fiennes, played Tom Riddle as a child in Harry Potter and the Chamber of Secrets. By the time filming arrived Christian Coulson was 29, and not considered suitable to return as the adolescent Riddle. Thomas James Longley was originally scheduled to take over the role, but last minute renegotiations saw Frank Dillane cast instead. In Harry Potter and the Half Blood Prince, Ralph Fiennes' nephew, portrayed Tom Riddle as a young Tom Riddle as a child. By the time filming arrived Christian Coulson was 29, and not considered suitable to return as the adolescent Riddle. By the time filming arrived Christian Coulson was not considered suitable to return as the adolescent Riddle.", "prediction 2": "Hero Fiennes-Tiffin, played the young Tom Riddle in Harry Potter and the Chamber of Secrets and Harry Potter and the Half Blood Prince. Christian Coulson, played the young Tom Riddle in Harry Potter and the Goblet of Fire. Thomas James Longley was originally scheduled to take over the role, but last minute renegotiations saw Frank Dillane cast instead. In Harry Potter and the Half Blood Prince, Ralph Fiennes' nephew, portrayed the young Tom Riddle as a child, an adolooo. In Harry Potter and the Half Blood Prince, Hero Fiennes's nephew, Hero Fiennes-Tiffin, Hero Fiennes's nephew, portrayed the child Tom Marvolodle in Harry Potter and the LEGO Movie. In the Harry Potter and the Very Potter Musical, Voldemort is played by Joe Walker. In Harry Potter and", "prediction 3": "Hero Fiennes-Tiffin, played the young Tom Riddle in Harry Potter and the Chamber of Secrets, and Christian Coulson played the adult Tom Riddle. In Harry Potter and the Half Blood Prince, Hero Fiennes-Tiffin plays Tom Riddle as a child. In Harry Potter and the Chamber of Secrets, Christian Coulson plays Tom Riddle as an adolescent. In Harry Potter and the Order of the Phoenix, Thomas James Longley plays Tom Riddle as an adolooman, and Joe Walker plays Lord Voldemort as a young Tom Marvolo Riddle.", "prediction 4": "Hero Fiennes-Tiffin played the young Tom Riddle in Harry Potter and the Chamber of Secrets and Harry Potter and the Goblet of Fire. In Harry Potter and the Half Blood Prince, Hero Fiennes-Tiffin played the young Tom Riddle. In Harry Potter and the Deathly Hallows, Frank Dillane played the young Tom Riddle. In Harry Potter and the Deathly Hallows: Parts 1 and 2, Hero Fiennes-Tiffin played the young Tom Riddle.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 95, "end": 122 }, { "error type": "Redundant", "explanation": "Hero Fiennes-Tiffin, the nephew of Ralph Fiennes, played Tom Riddle as a child in Harry Potter and the Chamber of Secrets. ", "start": 373, "end": 493 }, { "error type": "Redundant", "explanation": "By the time filming arrived Christian Coulson was 29, and not considered suitable to return as the adolescent Riddle. ", "start": 494, "end": 721 }, { "error type": "Irrelevant", "explanation": "", "start": 241, "end": 344 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Hero Fiennes-Tiffin, the nephew of Ralph Fiennes, played Tom Riddle as a child in Harry Potter and the Half-Blood Prince. By the time filming arrived Christian Coulson was 29, and not considered suitable to return as the adolescent Riddle. Frank Dillane was also cast as adolescent Riddle. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the winter olympic games begin and where?", "passages": [ [ "1924 Winter Olympics", "1924 Winter Olympics\n\nThe 1924 Winter Olympics, officially known as the I Olympic Winter Games (), were a winter multi-sport event which was held in 1924 in Chamonix, France.", "Originally held in association with the 1924 Summer Olympics, the sports competitions were held at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France between January 25 and February 5, 1924.", "The Games were organized by the French Olympic Committee, and were in retrospect designated by the International Olympic Committee (IOC) as the I Olympic Winter Games.", "The tradition of holding the Winter Olympics in the same year as the Summer Olympics would continue until 1992, after which the current practice of holding a Winter Olympics in the second year after each Summer Olympics began.", "Although Figure Skating had been an Olympic event in both London and Antwerp, and Ice Hockey had been an event in Antwerp, the winter sports had always been limited by the season.", "In 1921, at the convention of the IOC in Lausanne, there was a call for equality for winter sports, and after much discussion it was decided to organize an \"international week of winter sport\" in 1924 in Chamonix.", "The first gold medal awarded in the Olympic Winter Games was won by Charles Jewtraw of the United States in the 500-meter speed skate." ] ], "gold": "The Winter Olympic Games is a major international multi-sport event held once every four years for sports practiced on snow and ice. The first edition of the Games was held in Chamonix, France, starting on January 25, 1924.", "prediction 1": "The 1924 Winter Olympics were a winter multi-sport event which was held in Chamonix, France between January 25 and February 5, 1924. Originally held in association with the 1924 Summer Olympics, the sports competitions were held at the foot of Mont Blanc in Chamonix, Haute-Savoie, France between January 25 and February 5, 1924.", "prediction 2": "The 1924 Winter Olympics, officially known as the I Olympic Winter Games, were a winter multi-sport event which was held in 1924 in Chamonix, France. Originally held in association with the 1924 Summer Olympics, the sports competitions were held at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France between January 25 and February 5, 1924. The tradition of holding the Winter Olympics in the same year as the Summer Olympics would continue until 1992, after which the current practice of holding a Winter Olympics in the second year after each Summer Olympics began.", "prediction 3": "The 1924 Winter Olympics were a multi-sport winter event held in association with the 1924 Summer Olympics. The sports competitions were held at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France between January 25 and February 5, 1924. Originally held in association with the 1924 Summer Olympics, the sports competitions were held at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France between January 25 and February 5, 1924.", "prediction 4": "The 1924 Winter Olympics, officially known as the I Olympic Winter Games, were a winter multi-sport event which was held in 1924 in Chamonix, France. Originally held in association with the 1924 Summer Olympics, the sports competitions were held at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France between January 25 and February 5, 1924.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 218 }, { "error type": "Redundant", "explanation": "The 1924 Winter Olympics were a winter multi-sport event which was held in Chamonix, France between January 25 and February 5, 1924. ", "start": 289, "end": 329 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 1924 Winter Olympics were a winter multi-sport event which was held in Chamonix, France between January 25 and February 5, 1924. More specifically at the foot of Mont Blanc in Chamonix, and Haute-Savoie, France ." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What term do we use for the lowest layer of the atmosphere?", "passages": [ [ "Atmosphere of Earth", "However, polar stratospheric or nacreous clouds are occasionally seen in the lower part of this layer of the atmosphere where the air is coldest.", "The stratosphere is the highest layer that can be accessed by jet-powered aircraft.", "The troposphere is the lowest layer of Earth's atmosphere.", "It extends from Earth's surface to an average height of about , although this altitude varies from about at the geographic poles to at the Equator, with some variation due to weather.", "The troposphere is bounded above by the tropopause, a boundary marked in most places by a temperature inversion (i.e. a layer of relatively warm air above a colder one), and in others by a zone which is isothermal with height.", "Although variations do occur, the temperature usually declines with increasing altitude in the troposphere because the troposphere is mostly heated through energy transfer from the surface.", "Thus, the lowest part of the troposphere (i.e. Earth's surface) is typically the warmest section of the troposphere.", "This promotes vertical mixing (hence, the origin of its name in the Greek word \u03c4\u03c1\u03cc\u03c0\u03bf\u03c2, \"tropos\", meaning \"turn\").", "The troposphere contains roughly 80% of the mass of Earth's atmosphere." ], [ "Atmosphere of Earth", "The troposphere is denser than all its overlying atmospheric layers because a larger atmospheric weight sits on top of the troposphere and causes it to be most severely compressed.", "Fifty percent of the total mass of the atmosphere is located in the lower of the troposphere.", "Nearly all atmospheric water vapor or moisture is found in the troposphere, so it is the layer where most of Earth's weather takes place.", "It has basically all the weather-associated cloud genus types generated by active wind circulation, although very tall cumulonimbus thunder clouds can penetrate the tropopause from below and rise into the lower part of the stratosphere.", "Most conventional aviation activity takes place in the troposphere, and it is the only layer that can be accessed by propeller-driven aircraft.", "Within the five principal layers above, that are largely determined by temperature, several secondary layers may be distinguished by other properties:\n\n", "The average temperature of the atmosphere at Earth's surface is or , depending on the reference.", "The average atmospheric pressure at sea level is defined by the International Standard Atmosphere as .", "This is sometimes referred to as a unit of standard atmospheres (atm)." ] ], "gold": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to an average height of about , although this altitude varies from about at the geographic poles to at the Equator, with some variation due to weather. The planetary boundary layer is the part of the troposphere that is closest to Earth's surface and is directly affected by it, mainly through turbulent diffusion.", "prediction 1": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to an average height of about.", "prediction 2": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to a height of about, although this altitude varies from about at the geographical poles to at the Equator, with some variation due to weather. The tropopause is the boundary marked in most places by a temperature inversion (i.e. a layer of relatively warm air above a colder one) and in others by a zone which is isothermal with height.", "prediction 3": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to an average height of about, although this altitude varies from about at the geographic poles to at the Equator, with some variation due to weather. The tropopause is the boundary marked in most places by a temperature inversion, i.e. a layer of relatively warm air above a colder one, and in others by a zone which is isothermal with height.", "prediction 4": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to an average height of about, although this altitude varies from about at the geographic poles to at the Equator, with some variation due to weather.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The troposphere is the lowest layer of Earth's atmosphere. It extends from Earth's surface to an average height of about , although this altitude varies from about at the geographic poles to at the Equator, with some variation due to weather. " }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "Total no of members nominated by president in lok sabha and rajya sabha?", "passages": [ [ "Parliament of India", "Parliament of India\n\nThe Parliament of India is the supreme legislative body of the Republic of India.", "The Parliament is composed of the President of India and the houses.", "It is a bicameral legislature with two houses: the Rajya Sabha (Council of States) and the Lok Sabha (House of the People).", "The President in his role as head of legislature has full powers to summon and prorogue either house of Parliament or to dissolve Lok Sabha.", "The president can exercise these powers only upon the advice of the Prime Minister and his Union Council of Ministers.", "Those elected or nominated (by the President) to either house of Parliament are referred to as Members of Parliament (MP).", "The Members of Parliament, Lok Sabha are directly elected by the Indian public voting in Single-member districts and the Members of Parliament, Rajya Sabha are elected by the members of all State Legislative Assembly by proportional representation.", "The Parliament has a sanctioned strength of 545 in Lok Sabha including the 2 nominees from the Anglo-Indian Community by the President, and 245 in Rajya Sabha including the 12 nominees from the expertise of different fields of science, culture, art and history.", "The Parliament meets at Sansad Bhavan in New Delhi.", "The \"Sansad Bhavan\" (Parliament House) is located in New Delhi." ], [ "Eighth Amendment of the Constitution of India", "Eighth Amendment of the Constitution of India\n\nThe Eighth Amendment of the Constitution of India, officially known as The Constitution (Eighth Amendment) Act, 1959, amended article 334 of the Constitution in order to extend the period of reservation of seats for the Scheduled Castes and Scheduled Tribes and representation of the Anglo-Indians in the Lok Sabha and the State Legislative Assemblies for ten years, i.e. up to 26 January 1970.", "Article 334 had stipulated that the reservation of seats should expire within a period of ten years from the commencement of the Constitution (i.e. 26 January 1960).", "The 8th Amendment extended the period for reservations to 1970.", "The period of reservation was extended to 1980, 1990, 2000, 2010 and 2020 by the 23rd, 45th, 62nd, 79th and 95th Amendments respectively.", "The full text of Article 334 of the Constitution, after the 8th Amendment, is given below:\nArticle 334 of the Constitution laid down that the provisions of the Constitution relating to the reservation of seats for the Scheduled Castes and Scheduled Tribes and the representation of the Anglo-Indian community by nomination in the House of the People and the Legislative Assemblies of the States would cease to have effect on the expiration of a period of ten years from the commencement of the Constitution (i.e., it would expire in 1960)." ], [ "Standing Committee on Finance", "Formally set up in April 1993, the committee used to consist of 45members\u2014 30 nominated by the Speaker from amongst the members of Lok Sabha and 15members nominated by the Chairman, Rajya Sabha from amongst the members of Rajya Sabha.", "However, during the re-structuring of DRSCs in July 2004 by the 14th Lok Sabha, the membership was reduced to 31members\u201421 from Lok Sabha and 10 from Rajya Sabha.", "The inaugural chairperson of the committee was Debi Prasad Pal, a former Minister of State for Finance (1995\u201396), member of the 10th Finance Commission, retired judge of the Calcutta High Court and member of the Indian National Congress.", "The functions of the committee are stated as below:\n\n\nThe Standing Committees shall not consider the matters of day to day administration of the department.", "Proceedings, Draft Reports and Minutes of the Committee are treated as \"\u2018Confidential\u2019\" until the concerned reports are presented to Parliament.", "Working of the committee has been designed so as to keep individual opinions and statements as confidential, so, that the atmosphere within the committee is more open to discussion without the need to toe the party line or indulge in political .", "The report presented by the committee \"is based on a broad consensus and has persuasive value to be treated as considered advice.", "Hence it is not binding in nature." ] ], "gold": "The Parliament of India is the supreme legislative body of the Republic of India, a bicameral legislature composed by the President of India and the two houses: the Rajya Sabha, Council of States, and the Lok Sabha, House of the People. During each election, the President nominates a total of 14 members to both cameras of the Parliament, 12 of which are experts of different fields of science, culture, art, and history. Between 1952 and 2020, 2 members of the Anglo-Indian community were also nominated by the President on the advice of the Government of India. This practice was abolished in January 2020 by the 104th Constitutional Amendment Act, 2019.", "prediction 1": "The Parliament of India is the supreme legislative body of the Republic of India. The President of India in his role as head of legislature has full powers to summon and prorogue either house of Parliament or to dissolve Lok Sabha. The number of members nominated by the president in Lok Sabha is 35, while in Rajya Sabha is 246.", "prediction 2": "The Parliament of India is the supreme legislative body of the Republic of India and is composed of the President of India and the houses. It is a bicameral legislature with two houses: the Lok Sabha (House of the People) and the Rajya Sabha (Council of States). The total number of members nominated by the President in Lok Sabha was 58, while the total number of members nominated by the President in Rajya Sabha was 63.", "prediction 3": "There are two houses of the Indian Parliament. The Lok Sabha is the house of the people and the Rajya Sabha is the house of the states. The number of members nominated by the president in both Lok Sabha and Rajya Sabha is 545. The number of members nominated by the president in both Lok Sabha and Rajya Sabha is 10.", "prediction 4": "The Parliament of India is the supreme legislative body of the Republic of India. The President of India in his role as head of legislature has full powers to summon and prorogue either house of Parliament or to dissolve Lok Sabha. The Eighth Amendment of the Constitution of India, officially known as The Constitution (Eighth Amendment) Act, 1959, amended article 334 of the Constitution in order to extend the period of reservation of seats for the Scheduled Castes and Scheduled Tribes and representation of the Anglo-Indians in the Rajya Sabha including the 245 in Rajya Sabha including the 12 nominees from different fields of science, culture, art, art and history. The Parliament has a sanctioned strength of 545 in the Lok Sabha including the 2 nominees from the expertise of different fields of science, culture, art, culture, and history.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 297, "end": 300 }, { "error type": "Unverifiable", "explanation": "", "start": 310, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 231 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Parliament of India is the supreme legislative body of the Republic of India. It is a bicameral legislature with two houses: the Rajya Sabha (Council of States) and the Lok Sabha (House of the People). The number of members nominated by the president in Lok Sabha is 2. They are from the Anglo-Indian Community. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "In which language is the indian national anthem?", "passages": [ [ "Jana Gana Mana", "Jana Gana Mana\n\n\"Jana Gana Mana\" () is the national anthem of India.", "It was originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore.", "The first stanza of the song Bharoto Bhagyo Bidhata was adopted by the Constituent Assembly of India as the National Anthem on 24 January 1950.", "A formal rendition of the national anthem takes approximately fifty-two seconds.", "A shortened version consisting of the first and last lines (and taking about 20\u00a0seconds to play) is also staged occasionally.", "It was first publicly sung on 27 December 1911 at the Calcutta (now, Kolkata) Session of the Indian National Congress.", "A separate poem, Vande Mataram, was created \"national song\" of India during both the colonial period and after independence in 1956.", "The poem was first sung on the second day of the annual session of the Indian National Congress in Calcutta (now Kolkata) on 27 December 1911, and again in January 1912 at the annual event of the Adi Brahmo Samaj.", "Though the Bengali song had been written in 1911, it was largely unknown except to the readers of the Adi Brahmo Samaj journal, \"Tattwabodhini Patrika\", of which Tagore was the editor." ], [ "Rabindranath Tagore", "Rabindranath Tagore\n\nRabindranath Tagore FRAS (; 7 May 1861\u00a0\u2013 7 August 1941), sobriquet Gurudev, was a Bengali polymath from the Indian subcontinent, a poet, musician and artist.", "He reshaped Bengali literature and music, as well as Indian art with Contextual Modernism in the late 19th and early 20th centuries.", "Author of \"Gitanjali\" and its \"profoundly sensitive, fresh and beautiful verse\", he became in 1913 the first non-European to win the Nobel Prize in Literature.", "Tagore's poetic songs were viewed as spiritual and mercurial; however, his \"elegant prose and magical poetry\" remain largely unknown outside Bengal.", "He is sometimes referred to as \"the Bard of Bengal\".", "A Pirali Brahmin from Calcutta with ancestral gentry roots in Jessore, Tagore wrote poetry as an eight-year-old.", "At the age of sixteen, he released his first substantial poems under the pseudonym \"Bh\u0101nusi\u1e43ha\" (\"Sun Lion\"), which were seized upon by literary authorities as long-lost classics.", "By 1877 he graduated to his first short stories and dramas, published under his real name.", "As a humanist, universalist, internationalist, and ardent anti-nationalist, he denounced the British Raj and advocated independence from Britain." ] ], "gold": "Jana Gana Mana is the national anthem of India. It was originally composed as Bharoto Bhagyo Bidhata in Bengali by the poet sometimes referred to as the Bard of Bengal, Rabindranath Tagore. Later, it was written in sadhu Bengali or tatsama Bengali which is heavily sanskiritised. ", "prediction 1": "\"Jana Gana Mana\" is the national anthem of India. It was originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore. The first stanza of the song was adopted by the Constituent Assembly of India as the National Anthem on 24 January 1950. A formal rendition of the national anthem takes approximately fifty-two seconds. A shortened version consisting of the first and last lines (and taking about 20 seconds to play) is also staged occasionally.", "prediction 2": "\"Jana Gana Mana\" is the national anthem of India. It was originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore. The first stanza of the song Bharoto Bhagyo Bidhata was adopted by the Constituent Assembly of India as the National Anthem on 24 January 1950.", "prediction 3": "\"Jana Gana Mana\" is the national anthem of India, originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore. The first stanza of the song was adopted by the Constituent Assembly of India as the National Anthem on 24 January 1950. A formal rendition of the national anthem takes approximately fifty-two seconds. A shortened version consisting of the first and last lines (and taking about 20 seconds to play) is also staged occasionally.", "prediction 4": "The national anthem of India is Jana Gana Mana, originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore. The first stanza of the song Bharoto Bhagyo Bidhata was adopted by the Constituent Assembly of India as the National Anthem on 24 January 1950.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 263 }, { "error type": "Irrelevant", "explanation": "", "start": 264, "end": 344 }, { "error type": "Irrelevant", "explanation": "", "start": 345, "end": 470 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Jana Gana Mana\" is the national anthem of India. It was originally composed as Bharoto Bhagyo Bidhata in Bengali by poet Rabindranath Tagore who is sometimes referred to as \"the Bard of Bengal\". " }, "preference": [ 2, 0, 2, 1, 0, 2 ] }, { "question": "Who is the presiding officer of the house of reps?", "passages": [ [ "October 2015 Speaker of the United States House of Representatives election", "The last Speaker election to require multiple ballots occurred in 1923.", "John Boehner, a member of the Republican Party from Ohio, served as the Majority Leader of the United States House of Representatives from February 2006 until January 2007.", "As the Democratic Party assumed control of the House following the 2006 elections, Boehner served as Minority Leader from January 2007 until January 2011.", "When Republicans reassumed control of the House of Representatives in January 2011, Boehner was elected as Speaker, with the votes of all 241 of his fellow Republicans.", "In 2014, some House Republicans reached out to Ben Carson about his interest in becoming Speaker should they be able to oust Boehner; Carson declined, citing his impending candidacy for president.", "Boehner's Republican opponents formed a congressional caucus, called the Freedom Caucus, in January 2015 to focus their opposition.", "Though Boehner was reelected as Speaker at the beginning of the 114th United States Congress that month, 25 conservative members of the Republican caucus did not vote for him.", "Daniel Webster, a Republican from Florida, received 12 votes.", "Throughout 2015, Boehner and the Freedom Caucus remained at odds.", "Boehner stripped his opponents of leadership posts and other perks, while the American Action Network, a group allied with Boehner, aired television ads against Freedom Caucus members in their home districts." ], [ "Nancy Pelosi", "Nancy Pelosi\n\nNancy Patricia D'Alesandro Pelosi (; born March 26, 1940) is an American politician serving as the Minority Leader of the United States House of Representatives since 2011.", "She previously served as the 52nd Speaker of the House from 2007 to 2011, the only woman to have done so.", "A member of the Democratic Party, Pelosi represents California's 12th congressional district which consists of four-fifths of San Francisco.", "The district was numbered as the 5th during Pelosi's first three terms in the House, and as the 8th from 1993 to 2013.", "She served as the House Minority Whip from 2002 to 2003, and was House Minority Leader from 2003 to 2007.", "Pelosi is the first woman, the first Californian, and the first Italian-American to lead a major party in Congress.", "After the Democrats took control of the House in 2007 and increased their majority in 2009, Pelosi was elected Speaker of the House.", "After the Democrats lost House control in the 2010 elections, Pelosi remained the leader of the Democrats and thus Minority Leader from 2011 to 2019.", "Democrats won the majority in the 2018 midterms and Pelosi is the Democrats' designee for Speaker in the upcoming election.", "If elected Speaker, Pelosi would become the seventh individual to return to the Speakership in non-consecutive terms of office." ], [ "2019 Speaker of the United States House of Representatives election", "2019 Speaker of the United States House of Representatives election\n\nAn election for the Speaker of the U.S. House of Representatives will take place during the first week in January 2019, during the opening day of the 116th United States Congress, two months after the 2018 elections.", "The Dean of the United States House of Representatives, in this case, Alaska's Don Young, will administer the oath of office to the new Speaker who, in turn, administers the oath of office en masse to the rest of the members of the United States House of Representatives.", "Incumbent Republican speaker Paul Ryan did not run for re-election to the House.", "The Democratic caucus assuming control of the House in January will have a preponderance of voting influence in selecting the next Speaker.", "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives, and is second in the United States presidential line of succession, after the Vice President and ahead of the President pro tempore of the United States Senate.", "Though the Constitution does not require that the Speaker be an elected member of the House of Representatives, every Speaker to date has been elected from House membership.", "The 435 members of the House of Representatives elect a Speaker by majority rule at the beginning of each session of the United States Congress, who serves until the end of the Congress." ] ], "gold": "The speaker of the United States House of Representatives, commonly known as the speaker of the House, is the presiding officer of the United States House of Representatives. The current speaker of the House is Democrat Nancy Pelosi of California. She succeeded Paul Ryan in this position. ", "prediction 1": "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives, and is second in the United States presidential line of succession, after the Vice President and ahead of the President pro tempore of the United States Senate. John Boehner served as the Majority Leader of the United States House of Representatives from February 2006 until January 2007. Then, in January 2011, Nancy Pelosi was elected Speaker of the House.", "prediction 2": "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives, and is second in the United States presidential line of succession, after the Vice President and ahead of the President pro tempore of the United States Senate. John Boehner was the last speaker election to require multiple ballots occurred in 1923. As the Democratic Party assumed control of the House following the 2006 elections, Boehner served as Minority Leader from January 2007 until January 2011. Nancy Pelosi was the last speaker of the United States House of Representatives in January 2015. Pelosi was elected Speaker in November, and was the presiding officer of the house of reps.", "prediction 3": "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives. Before 2011, John Boehner, a member of the Republican Party from Ohio, served as the Majority Leader of the United States House of Representatives from February 2006 until January 2007. After that, Nancy Pelosi served as the 52nd Speaker of the House from 2007 to 2011 and from 2011 to 2019.", "prediction 4": "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives. The last Speaker election to require multiple ballots occurred in 1923. John Boehner served as the Majority Leader of the United States House of Representatives from February 2006 until January 2007. Nancy Pelosi served as the 52nd Speaker of the House from 2007 to 2011. She previously served as the 52nd Speaker of the House from 2007 to 2011, the only woman to have done so.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 418 } ], "missing-info": [], "corrected-prediction": "The Speaker of the United States House of Representatives is the presiding officer of the United States House of Representatives. Nancy Pelosi served as the 52nd Speaker of the House from 2007 to 2011" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "How many teams qualify for the world cup from concacaf?", "passages": [ [ "2014 FIFA World Cup qualification (CONCACAF)", "2014 FIFA World Cup qualification (CONCACAF)\n\n", "The CONCACAF qualification for the 2014 FIFA World Cup consisted of four rounds of competition, in which the 35 member nations competed for three automatic berths at the finals in Brazil.", "The United States, Costa Rica, and Honduras qualified.", "The fourth-place finisher, Mexico, played a two-game series against New Zealand, the first-placed team from Oceania and qualified to the Finals.", "In March 2011, following news that CONCACAF would not receive four spots in the 2014 World Cup, officials within CONCACAF indicated that the first format proposed would be revised.", "Several days later, officials within CONCACAF announced the qualifying format they would present to FIFA.", "The proposed format, which was subsequently accepted by FIFA, consists of 4 stages.", "All 35 FIFA-affiliated national teams from CONCACAF entered qualification.", "The seeding \u2013 used to draw the first three rounds of the qualifiers \u2013 was based on the FIFA World Rankings of March 2011.", "(World rankings shown in parentheses)\n\n", "The schedule of the competition was as follows.", "The inter-confederation play-off between the fourth-placed team from CONCACAF (Mexico) and the winning team from OFC (New Zealand) was played between 13\u201320 November 2013." ], [ "2010 FIFA World Cup qualification (CONCACAF)", "colspan=\"5\" | Group 1\n\n!", "colspan=\"5\" | Group 2\n\n!", "colspan=\"5\" | Group 3\n\nThe winners from the Second Round were placed into three groups of four teams, where they played a double round robin home and away schedule.", "The top two teams from each group advanced to the Fourth Round.", "The six teams that reached the fourth round formed one double-round-robin, home-and-away group nicknamed the \"Hexagonal.\"", "The top three teams qualified for the 2010 FIFA World Cup.", "The fourth place team qualified for a home-and-away play-off against the fifth-place team from CONMEBOL.", "The allocation of teams in the draw took place in Johannesburg, South Africa on 22 November 2008.", "The 4th place team played the 5th place team from the CONMEBOL (South American Zone) Qualification in a home and away play-off.", "The winner of this play-off qualified for the 2010 FIFA World Cup.", "The draw for the order in which the two matches were played was held on 2 June 2009 during the FIFA Congress in Nassau, the Bahamas.", "The CONCACAF side played the first leg at home.", "The following three teams from CONCACAF qualified for the final tournament." ], [ "2018 FIFA World Cup qualification (CONCACAF)", "2018 FIFA World Cup qualification (CONCACAF)\n\nThe North, Central American and Caribbean section of the 2018 FIFA World Cup qualification acted as qualifiers for the 2018 FIFA World Cup, to be held in Russia, for national teams which are members of the Confederation of North, Central American and Caribbean Association Football (CONCACAF).", "3.5 slots (3 direct slots and 1 inter-confederation play-off slot) in the final tournament were available for CONCACAF teams.", "In a change to previous qualification tournaments for this confederation, the first three rounds were played as knockout rounds, with both the fourth round and the final round (referred to as the \"Hexagonal\") played as group stages.", "The first round was played during the FIFA international dates of 23\u201331 March 2015.", "CONCACAF announced the full format details on 12 January 2015.", "The United States failed to qualify for the World Cup for the first time since 1986 after they were defeated by Trinidad and Tobago on the final day of the qualification tournament, resulting in a fifth-place finish.", "As a result, Panama qualified for the World Cup for the first time ever.", "The qualification structure was as follows:\n\nAll 35 FIFA-affiliated national teams from CONCACAF entered qualification.", "The seeding \u2013 used to draw the first four rounds of the qualifiers \u2013 was based on the FIFA World Rankings of August 2014 (shown in parentheses)." ] ], "gold": "For each World Cup, FIFA decides beforehand the number of places in the World Cup finals allocated to each of the qualifying zones, based on the numbers and relative strengths of the confederations' teams. Using this methodology, in previous World Cups, CONCACAF has had three to four teams qualify for the World Cup finals. The 2022 CONCACAF qualification process changed significantly from the 2018 qualification cycle. The top three teams will advance to the World Cup finals, while the fourth-placed side will enter the inter-continental playoffs.", "prediction 1": "The CONCACAF qualification for the 2014 FIFA World Cup consisted of four rounds of competition in which the 35 member nations competed for three automatic berths at the finals in Brazil. The 2018 FIFA World Cup qualification acted as qualifiers for the 2018 FIFA World Cup, to be held in Russia, for national teams which are members of the Confederation of North, Central American and Caribbean Association Football (CONCACAF). The qualifying structure was as follows: All 35 FIFA-affiliated national teams from CONCACAF entered qualification.", "prediction 2": "The 2014 FIFA World Cup qualification for CONCACAF consisted of four rounds of competition, in which the 35 member nations competed for three automatic berths at the finals in Brazil. The United States, Costa Rica, and Honduras qualified. In the 2010 FIFA World Cup qualification, the top three teams qualified for the 2010 FIFA World Cup. The 4th place team qualified for a home-and-away play-off against the 5th place team from CONMEBOL. The North, Central American and Caribbean section of the 2018 FIFA World Cup qualification acted as qualifiers for the 2018 FIFA World Cup.", "prediction 3": "The Confederation of North, Central American and Caribbean Association Football (CONCACAF) is a football confederation made up of 35 member nations which play together in international football competitions. The 2018 FIFA World Cup qualification acted as qualifiers for the 2018 FIFA World Cup, to be held in Russia, for national teams which are members of the Confederation of North, Central American and Caribbean Association Football (CONCACAF). In 2014, the 35 member nations competed for three automatic berths at the finals in Brazil. In 2013, the top three teams qualified for the 2010 FIFA World Cup. In 2013, the top three teams qualified for the 2010 FIFA World Cup.", "prediction 4": "The CONCACAF qualification for the 2014 FIFA World Cup consisted of four rounds of competition, in which the 35 member nations competed for three automatic berths at the finals in Brazil. The United States, Costa Rica, and Honduras qualified. In the 2010 FIFA World Cup qualification, the top two teams in each group qualified for a home-and-away play-off against the fourth-place team from CONCACAF. In the 2018 FIFA World Cup qualification, the North, Central American and Caribbean section of the 2018 FIFA World Cup, while the four teams from CONCACAF qualified for the 2018 FIFA World Cup. In the 2018 FIFA World Cup qualification, the North, Central American and Caribbean section of the 2018 FIFA World Cup acted as qualifiers for the 2018 FIFA World Cup, to be held in Russia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 543 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "The CONCACAF qualification for the 2014 FIFA World Cup had three automatic berths and had another match for the fourth spot. The 2018 FIFA World Cup qualification had 3.5 slots (3 direct slots and 1 inter-confederation play-off slot) for CONCACAF teams. The 2010 FIFA World Cup qualifications had 3 slots available and a match to decide the 4th." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does tony romo a football life air?", "passages": [ [ "A Football Life", "Season Six premiered Friday, September 16 at 9:00 PM ET and aired 13 new episodes starting with the story of Pro Football Hall of Fame running back Curtis Martin, and including Brett Favre, Chuck Noll, and Jim Brown.", "Two mini-episodes were released on the NFL's official YouTube channel.", "In contrast to the television series, these two episodes feature fictional characters Rod Tidwell and Frank Cushman from the movie \"Jerry Maguire\".", "Season Seven of A Football Life premiered on Friday, September 15 at 9:00 PM ET and subsequently aired 13 episodes beginning with the former Miami Dolphins quarterback Dan Marino.", "Other episodes featured former Oakland Raiders coach John Madden, former Buffalo Bills quarterback Jim Kelly, Dallas Cowboys owner Jerry Jones and former Washington Redskins coach and current NASCAR owner Joe Gibbs.", "Season Eight of A Football Life premiered on Friday, September 14, 2018 at 9:00 PM ET and subsequently aired 11 episodes.", "It will feature Mike Holmgren, Dwight Clark and The Catch, Lawrence Taylor, Thurman Thomas, Carson Palmer, Brian Dawkins, Doug Williams, Willie McGinest, Cris Collinsworth, Tony Romo and Bill Cowher" ], [ "A Football Life", "A Football Life\n\nA Football Life is a documentary series of 111 episodes, developed by NFL Films and aired on NFL Network that documents the lives of select National Football League players, coaches, owners, and teams.", "Friends, teammates, family members and other players and coaches associated with the subjects are interviewed.", "The name of the series originated in a quote from Steve Sabol of NFL Films:\n\nOriginating as an NFL Network special on the career of Bill Parcells in November 2010, it premiered as an episodic series on September 15, 2011, with the first part of Bill Belichick's documentary.", "The documentary was viewed by about 657,000 viewers, the most-watched documentary in NFL Network's history, and was the second-most watched program in Boston at the time with 151,000 viewers, trailing behind a Boston Red Sox game.", "Season One was eventually released on DVD.", "Season Two began on September 12, 2012, with \"The Faces of Tebow\".", "The series was nominated for an Emmy Award for \"Outstanding Edited Sports Series/Anthology\" and \"Outstanding Promotional Announcement \u2013 Episodic\" for Belichick's episode in 2012.", "Season Four was announced for September 10, 2014.", "Season Five began on September 18 at 9 pm, and it had 13 new episodes including Terrell Owens, Dick Vermeil, Paul Brown, and more." ], [ "Reason (rapper)", "That same day, he released a single titled \"The Soul\", with a music video released the next week.", "On August 29, he released the second single titled \"Better Dayz\", a song that had already made an appearance on his first mixtape.", "On September 11, he released the third single titled \"Summer Up\", also accompanied by a music video.", "He was also featured on Los Angeles rapper JAG's album with Cozz on \"Black Boy Rise\".", "He is also scheduled to go on tour with Jay Rock on the \"Big Redemption Tour\".", "Reason released his debut studio album, \"There You Have It\", on September 28, 2018.", "The album was originally released on May 19, 2017, but upon signing with TDE, the label decided to re-release the album.", "In an interview, Reason named Lil Wayne, J. Cole, Eminem, Fabolous, and Lupe Fiasco as his inspirations and favorite hip hop artists." ] ], "gold": "A Football Life is a documentary series developed by NFL Films documenting the lives of select National Football League players, coaches, and teams. Tony Romo's episode aired on NFL Network on September 28, 2018, at 9:00 PM ET.", "prediction 1": "A Football Life is a documentary series of 111 episodes, developed by NFL Films and aired on NFL Network that documents the lives of select National Football League players, coaches, owners, and teams. Tony Romo's A Football Life airs on Sunday, September 15, 2011.", "prediction 2": "A Football Life is a documentary series of 111 episodes, developed by NFL Films and aired on NFL Network. Friends, teammates, family members and other players and coaches associated with the subjects are interviewed. Tony Romo's A Football Life airs on Mondays at 8 PM ET and Fridays at 9:00 PM ET. Other episodes include Tony Romo's A Football Life and Romo's A Football Life and the episode The Faces of Tebow.", "prediction 3": "A Football Life is an American sports documentary series. It is a documentary series about the lives of select National Football League players, coaches, owners, and teams. Tony Romo's season of the series premieres in September 2016 at 9 pm ET. The series originally started out as a special for the NFL Network on November 10, 2010, but became an episodic series starting in September 15, 2011. Tony Romo's season began on September 10, 2014, and finished on September 11, 2019.", "prediction 4": "A Football Life is a documentary series of 111 episodes, developed by NFL Films and aired on NFL Network that documents the lives of select National Football League players, coaches, owners, and teams. Tony Romo's season on A Football Life premiered on September 15, 2011 at 9:00 PM ET.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 56 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "A Football Life is a documentary series developed by NFL Films documenting the lives of select National Football League players, coaches, owners, and teams. Tony Romo's A Football Life airs on Sunday, September 15, 2011. Season Eight of A Football Life premiered on Friday, September 14, 2018 at 9:00 PM ET " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who have been the hosts of whose line is it anyway?", "passages": [ [ "Whose Line Is It Anyway? (U.S. TV series)", "Whose Line Is It Anyway?", "(U.S. TV series)\n\nWhose Line Is It Anyway?", "(often known as simply Whose Line?) is an improvisational comedy television show, an adaptation of the British show of the same name.", "It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey.", "A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "The series features Ryan Stiles, Colin Mochrie, and Wayne Brady as its regular performers with the fourth seat occupied by a guest panelist.", "The show consists of a panel of four performers who create characters, scenes, and songs on the spot, in the style of short-form improvisation games.", "Topics for the games are based on either audience suggestions or predetermined prompts from the host, who would set up a game and situation that the performers would improvise.", "The original host Drew Carey awarded arbitrary point values after each game, often citing a humorous reason for his decision.", "The points were purely decorative and served no practical purpose.", "He would reiterate this at the beginning of, and multiple times throughout, each episode by describing \"Whose Line\" as \"the show where everything's made up and the points don't matter\"." ], [ "Whose Line Is It Anyway? (UK TV series)", "Whose Line Is It Anyway?", "(UK TV series)\n\nWhose Line is it Anyway?", "(shortened to Whose Line? or WLIIA) is a short-form improvisational comedy television show created by Dan Patterson and Mark Leveson, and hosted by Clive Anderson.", "Beginning as a BBC radio programme, it was successfully adapted for television after its acquisition by Channel 4, and aired ten series from 23 September 1988 to 4 February 1999.", "\"Whose Line?\" consists of a panel of four performers who create characters, scenes or songs on the spot in the style of short-form improvisation games, based on topics either prompted from audience suggestions or predetermined by the host.", "The show's participants consisted of a rotating cast of noted comedians from Britain, Canada and the United States, including Stephen Fry, Paul Merton, Ryan Stiles, Colin Mochrie, Josie Lawrence, Greg Proops, Tony Slattery, and Jim Sweeney.", "The success of \"Whose Line?\" spawned several domestic and international adaptations.", "An American version aired on ABC between 1999 and 2007 and was revived on The CW in 2013, and is broadcast in multiple countries.", "\"Whose Line Is It Anyway?", "Australia\" debuted on The Comedy Channel in 2016." ] ], "gold": "Whose Line Is It Anyway? is an improvisational comedy television show in the United States, an adaptation of the British show of the same name. From 1998 to 2007, Drew Carey was the host of the American version. Clive Anderson was the host of the British version for it's ten season run. A revival of the American show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "prediction 1": "Whose Line is It Anyway? is an improvisational comedy television show, an adaptation of the British show of the same name. It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013. The show consists of a panel of four performers who create characters, scenes, and songs on the spot, in the style of short-form improvisation games.\n", "prediction 2": "Whose Line is It Anyway? (often known as simply Whose Line?) is an improvisational comedy television show, an adaptation of the British show of the same name. It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "prediction 3": "Whose Line is It Anyway? is an improvisational comedy television show, an adaptation of the British show of the same name. It aired on ABC and ABC Family from August 5, 1998, to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "prediction 4": "Whose Line is It Anyway? is an improvisational comedy television show, an adaptation of the British show of the same name. It aired on ABC and ABC Family from August 5, 1998, to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW in 2013, featuring Ryan Stiles, Colin Mochrie, and Wayne Brady as its regular performers with the fourth seat occupied by a guest panelist. The British series originally aired from September 10, 1988, and Clive Anderson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 153 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 455 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Whose Line is It Anyway? is an improvisational comedy television show in the United States, an adaptation of the British show of the same name. From 1998 to 2007, the American version was hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013. Clive Anderson was the host of the British version for its ten series run. \n" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who played frederick in the sound of music?", "passages": [ [ "The Sound of Music (film)", "The Sound of Music (film)\n\n", "The Sound of Music is a 1965 American musical drama film produced and directed by Robert Wise, and starring Julie Andrews and Christopher Plummer, with Richard Haydn and Eleanor Parker.", "The film is an adaptation of the 1959 stage musical of the same name, composed by Richard Rodgers with lyrics by Oscar Hammerstein II.", "The film's screenplay was written by Ernest Lehman, adapted from the stage musical's book by Lindsay and Crouse.", "Based on the memoir \"The Story of the Trapp Family Singers\" by Maria von Trapp, the film is about a young Austrian woman studying to become a nun in Salzburg, Austria in 1938 who is sent to the villa of a retired naval officer and widower to be governess to his seven children.", "After bringing and teaching love and music into the lives of the family through kindness and patience, she marries the officer and together with the children they find a way to survive the loss of their homeland through courage and faith.", "The film was released on March 2, 1965 in the United States, initially as a limited roadshow theatrical release.", "Although critical response to the film was widely mixed, the film was a major commercial success, becoming the number one box office movie after four weeks, and the highest-grossing film of 1965." ], [ "The Sound of Music Live (2015)", "The Sound of Music Live (2015)\n\n", "The Sound of Music Live is a television special that was originally broadcast by ITV on 20 December 2015.", "The special was an adaptation of Rodgers and Hammerstein's Broadway musical \"The Sound of Music\", starring Kara Tointon as Maria von Trapp, performed and televised live from 3 Mills Studios in London.", "On 9 November 2018, the production was broadcast in the United States as part of PBS's performing arts anthology series \"Great Performances\".", "In October 2015, ITV announced that it would transmit a live adaptation of the musical \"The Sound of Music\" as part of its holiday programming lineup, in what would be the first time that such a programme had been attempted in the United Kingdom.", "\"The Sound of Music Live\" was part of ITV's continuing efforts to broadcast more live \"event\" programs, which are designed to attract critical masses of viewers by encouraging them to watch via the original broadcast, rather than via catch-up services and digital video recorders.", "The desire for increased ITV viewership came especially in the wake of declining ratings for its reality music competition \"The X Factor\", whose series 12 finale had the second-smallest viewership in the programme's history." ], [ "The Sound of Music Live!", "The Sound of Music Live!", "The Sound of Music Live!", "is a television special that was originally broadcast by NBC on December 5, 2013.", "Produced by Craig Zadan and Neil Meron, the special was an adaptation of Rodgers and Hammerstein's Broadway musical \"The Sound of Music\".", "The television special starred country singer and \"American Idol\" winner Carrie Underwood as Maria von Trapp, and was performed and televised live from Grumman Studios in Bethpage, New York.", "Spearheaded by NBC chairman Bob Greenblatt, the network positioned the special as being a live television \"event\".", "In preparing for the broadcast, Meron and Zadan emphasized the logistical challenges that they would face due to the live aspects of the special, and the fact that \"The Sound of Music Live!\"", "was an adaptation based on the musical itself and not the 1965 film version.", "Meron felt that if the telecast were successful, the concept could become \"another kind of entertainment that can exist on TV.\"", "By her request, Underwood's casting as Maria was personally endorsed by Julie Andrews, who starred in the 1965 film.", "The production was met with mixed reviews; much of its criticism was directed towards the casting of Carrie Underwood to play Maria, whom critics (including the real-life von Trapp family) believed was not experienced enough in theatre to portray such an iconic role." ] ], "gold": "Nicholas Hammond played Friedrich in the 1965 film The Sound of Music. The film is an adaptation of the 1959 stage musical of the same name that was composed by Richard Rodgers with lyrics by Oscar Hammerstein II. In another adaptation of the musical, Michael Nigro played Friedrich in The Sound of Music Live!, a television special that was originally broadcast by NBC on December 5, 2013. This special was performed and televised live from Grumman Studios in Bethpage, New York. The Sound of Music Live from 2015 is a television special that was performed and televised live from 3 Mills Studios in London and originally broadcast by ITV. This special featured Guy Trundle as Friedrich and was also an adaptation of the 1959 Broadway musical.", "prediction 1": "There are several films based on the 1965 musical musical The Sound of Music. The 1965 film was directed by Robert Wise, and starred Julie Andrews as Frederik, a character played by Christopher Plummer in the 1965 film. In the 2015 television special The Sound of Music Live!, Karina Tointon played Frederik. In the 2015 film, John McKinnon played Frederik.", "prediction 2": "The 1965 American musical drama film The Sound of Music is an adaptation of the 1959 stage musical of the same name, composed by Richard Rodgers with lyrics by Oscar Hammerstein II. The film is an adaptation of the 1959 stage musical of the same name, produced and directed by Robert Wise, and starring Julie Andrews and Christopher Plummer, with Richard Haydn and Eleanor Parker. The Sound of Music Live! is a television special that was originally broadcast by ITV on 20 December 2015. The television special starred country singer and \"American Idol\" winner Carrie Underwood as Maria von Trapp.", "prediction 3": "In the 1965 American musical drama film The Sound of Music, Richard Haydn plays Frederic Frederick. In the 2015 television special The Sound of Music Live, Carrie Underwood plays Frederic.", "prediction 4": "The 1965 American musical drama film The Sound of Music, which is an adaptation of the 1959 stage musical of the same name, is directed by Robert Wise and starred Julie Andrews and Christopher Plummer. The 1965 television special The Sound of Music Live! is an adaptation of Rodgers and Hammerstein's Broadway musical The Sound of Music, which starred Kara Tointon as Maria von Trapp. In the 1965 film, Edward \"Frederick\" DeVine played Frederik DeVine, and in the 2015 television special, which starred country singer Carrie Underwood as Maria von Trapp. In the 2015, \"Sound of Music Live!\" was televised live from 3 Mills Studios in Bethpage, New York.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 37, "end": 49 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 120 }, { "error type": "Unverifiable", "explanation": "", "start": 121, "end": 219 }, { "error type": "Unverifiable", "explanation": "", "start": 277, "end": 308 }, { "error type": "Redundant", "explanation": "There are several films based on the 1965 musical musical The Sound of Music. The 1965 film was directed by Robert Wise, and starred Julie Andrews as Frederik, a character played by Christopher Plummer in the 1965 film. In the 2015 television special The Sound of Music Live!, Karina Tointon played Frederik. ", "start": 309, "end": 357 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "There are several films named The Sound of Music Live based on the 1959 stage musical of the same name, composed by Richard Rodgers with lyrics by Oscar Hammerstein II.. The 1965 Sound of Music film, the 2015 television special The Sound of Music Live! performed and televised live from 3 Mills Studios in London, the 2013 television special The Sound of Music Live! originally broadcast by NBC, performed and televised live from Grumman Studios in Bethpage, New York." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who fired the first shots of the civil war?", "passages": [ [ "Fort Sumter", "At about 7:00\u00a0a.m., Captain Abner Doubleday, the fort's second in command, was given the honor of firing the Union's first shot, in defense of the fort.", "He missed, in part because Major Anderson did not use the guns mounted on the highest tier, the barbette tier (where the guns could engage the Confederate batteries better), where the gunners would be more exposed to Confederate fire.", "The firing continued all day.", "The Union fired slowly to conserve ammunition.", "At night, the fire from the fort stopped, but the Confederates still lobbed an occasional shell into Sumter.", "On Saturday, April 13, the fort was surrendered and evacuated.", "During the attack, the Union colors fell.", "Lt. Norman J. Hall risked life and limb to put them back up, burning off his eyebrows permanently.", "A Confederate soldier bled to death having been wounded by a misfiring cannon.", "One Union soldier died and another was mortally wounded during the 47th shot of a 100 shot salute, allowed by the Confederacy.", "Afterward, the salute was shortened to 50 shots.", "Accounts, such as in the famous diary of Mary Chesnut, describe Charleston residents along what is now known as The Battery, sitting on balconies and drinking salutes to the start of the hostilities.", "The Fort Sumter Flag became a popular patriotic symbol after Major Anderson returned North with it." ], [ "Battle of Fort Sumter", "At 4:30\u00a0a.m. on April 12, 1861, Lt. Henry S. Farley, acting upon the command of Capt. George S. James, fired a single 10-inch mortar round from Fort Johnson.", "(James had offered the first shot to Roger Pryor, a noted Virginia secessionist, who declined, saying, \"I could not fire the first gun of the war.\")", "The shell exploded over Fort Sumter as a signal to open the general bombardment from 43 guns and mortars at Fort Moultrie, Fort Johnson, the floating battery, and Cummings Point.", "Under orders from Beauregard, the guns fired in a counterclockwise sequence around the harbor, with 2 minutes between each shot; Beauregard wanted to conserve ammunition, which he calculated would last for only 48 hours.", "Edmund Ruffin, another noted Virginia secessionist, had traveled to Charleston to be present for the beginning of the war, and fired one of the first shots at Sumter after the signal round, a 64-pound shell from the Iron Battery at Cummings Point.", "The shelling of Fort Sumter from the batteries ringing the harbor awakened Charleston's residents (including diarist Mary Chesnut), who rushed out into the predawn darkness to watch the shells arc over the water and burst inside the fort.", "Major Anderson held his fire, awaiting daylight." ], [ "Battle of Fort Sumter", "Battle of Fort Sumter\n\nThe Battle of Fort Sumter (April 12\u201313, 1861) was the bombardment of Fort Sumter near Charleston, South Carolina by the Confederate States Army, and the return gunfire and subsequent surrender by the United States Army, that started the American Civil War.", "Following the declaration of secession by South Carolina on December 20, 1860, its authorities demanded that the U.S. Army abandon its facilities in Charleston Harbor.", "On December 26, Major Robert Anderson of the U.S. Army surreptitiously moved his small command from the vulnerable Fort Moultrie on Sullivan's Island to Fort Sumter, a substantial fortress built on an island controlling the entrance of Charleston Harbor.", "An attempt by U.S. President James Buchanan to reinforce and resupply Anderson using the unarmed merchant ship \"Star of the West\" failed when it was fired upon by shore batteries on January 9, 1861.", "South Carolina authorities then seized all Federal property in the Charleston area except for Fort Sumter.", "During the early months of 1861, the situation around Fort Sumter increasingly began to resemble a siege.", "In March, Brigadier General P. G. T. Beauregard, the first general officer of the newly formed Confederate States Army, was placed in command of Confederate forces in Charleston.", "Beauregard energetically directed the strengthening of batteries around Charleston harbor aimed at Fort Sumter." ] ], "gold": "The Battle of Fort Sumter was the bombardment of Fort Sumter near Charleston, South Carolina by the South Carolina militia which started the American Civil War. Confederate batteries opened fire, firing for 34 straight hours, on the fort. Edmund Ruffin, noted Virginian agronomist and secessionist, claimed that he fired the first shot on Fort Sumter. His story has been widely believed, but Lieutenant Henry S. Farley, commanding a battery of two 10 inch siege mortars on James Island, actually fired the first shot at 4:30 am on April 12, 1861.", "prediction 1": "At about 7:00 a.m., Captain Abner Doubleday, the fort's second in command, was given the honor of firing the Union's first shot, in defense of the fort. The Union fired slowly to conserve ammunition during the Battle of Fort Sumter, with the return gunfire and subsequent surrender by the United States Army, that started the American Civil War. At 4:30 a.m. on April 12, 1861, Lt. Henry S. Farley, acting upon the command of Capt. George S. James, fired a single 10-inch mortar round from Fort Johnson.", "prediction 2": "The first shot of the Civil War in the Battle of Fort Sumter was fired by Captain Abner Doubleday at approximately 7:00 a.m. on April 12, 1861. Lt. Henry S. Farley fired a single 10-inch mortar round from Fort Johnson at about 4:30 a.m. on April 12, 1861. Capt. George S. James had offered the first shot to Roger Pryor, a noted Virginia secessionist, who declined, saying, \"I could not fire the first gun of the war.\"", "prediction 3": "Captain Abner Doubleday, the fort's second in command, was given the honor of firing the Union's first shot, in defense of the fort. He missed, in part because Major Anderson did not use the guns mounted on the highest tier, the barbette tier, where the guns could engage the Confederate batteries better, where the gunners would be more exposed to Confederate fire. At 4:30 a.m. on April 12, 1861, Lt. Henry S. Farley, acting upon the command of Capt. George S. James, fired the first 10-inch mortar round from Fort Johnson.", "prediction 4": "Captain Abner Doubleday, who was the second in command of Fort Sumter, was given the honor of firing the Union's first shot, in defense of the fort. He missed, in part because Major Anderson did not use the guns mounted on the highest tier, the barbette tier, where the guns could engage the Confederate batteries better, where the gunners would be more exposed to Confederate fire. At 4:30 a.m. on April 12, 1861, Lt. Henry S. Farley, acting upon the command of Capt. George S. James, fired a single 10-inch mortar round from Fort Johnson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 345 }, { "error type": "Irrelevant", "explanation": "", "start": 399, "end": 448 }, { "error type": "Irrelevant", "explanation": "", "start": 455, "end": 503 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Battle of Fort Sumter was the bombardment of Fort Sumter near Charleston, South Carolina by the Confederate States Army that started the American Civil War. At 4:30 a.m. on April 12, 1861, Lt. Henry S. Farley, fired the first shot. Edmund Ruffin, another noted Virginia secessionist, fired one of the first shots at Sumter." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "How many episodes of once upon a time is there?", "passages": [ [ "Once Upon a Time (TV series)", "Once Upon a Time (TV series)\n\nOnce Upon a Time is an American fantasy drama television series on ABC which debuted on October 23, 2011, and concluded on May 18, 2018.", "The first six seasons are largely set in the fictitious seaside town of Storybrooke, Maine, with the characters of Emma Swan and Regina Mills serving as the leads, while the seventh and final season takes place in a Seattle, Washington neighborhood called Hyperion Heights, with a new main narrative led by Mills, and Swan and Mills son, Henry Mills.", "The show borrows elements and characters from the Disney universe and popular Western literature, folklore, and fairy tales.", "\"Once Upon a Time\" was created by \"Lost\" and \"\" writers Edward Kitsis and Adam Horowitz.", "A spin-off series, \"Once Upon a Time in Wonderland\", consisting of 13 episodes which followed the titular character from \"Alice in Wonderland\", premiered on October 10, 2013 and concluded on April 3, 2014." ], [ "WansapanaSummer", "WansapanaSummer\n\nWansapanaSummer is a Philippine fantasy drama anthology produced and aired by ABS-CBN.", "It was a re-run of the past episodes of \"Wansapanataym\" from 2010\u2013present, and formerly broadcast during the Summer season every Weekday mornings right after \"Naruto Shipp\u016bden\" on ABS-CBN's Umaganda morning block.", "The replay of the past episodes of \"Wansapanataym\" aired every Monday to Friday at 10:15am from April 29, 2013 until June 20, 2013.", "\"WansapanaSummer\" was part of the 2013 line-up of Umaganda and Team Animazing morning block which includes the replay of \"Yakitate!!", "Japan\", the first season \"Kuroko's Basketball\", the fifth season of \"Naruto Shipp\u016bden\", and the pre-noontime drama \"Be Careful With My Heart\".", "Its highest rating was 18.3% in May 10, 2013.", "In 2014, a second replay of \"WansapanaSummer\" was aired from March 17, 2014 until April 11, 2014 at the same timeslot at 10:15am." ], [ "Leaving Storybrooke", "Leaving Storybrooke\n\n\"Leaving Storybrooke\" is the twenty-second episode of the seventh season and the 155th and final episode overall of the American fantasy-drama series \"Once Upon a Time\".", "Written by the show's creators Edward Kitsis and Adam Horowitz, and directed by Ralph Hemecker, it premiered on ABC in the United States on May 18, 2018.", "In the episode, the Wish Realm Rumplestiltskin\u2019s plan to eliminate all the happy endings of all the characters in every realm is revealed, as Sir Henry prepares to kill Regina as part of the scheme, while Alice and Robin seek out help from Storybrooke to rescue Henry, Jacinda, Lucy, Hook, and Weaver, who is ready to risk everything to stop his evil counterpart from carrying out his plan.", "The \u201cLeaving Storybrooke\u201d city limits sign is displayed.", "The Seattle scenery is not featured.", "The Wish Realm events and the outcome involving the realms from previous encounters occurs after the events of \u201cHomecoming.\u201d\n\n", "As Alice and Robin arrived in Storybrooke, they find the dwarfs, Granny, Archie and Pongo.", "They explain a fifth Dark Curse took them, along with the future versions of Henry, Regina and Mr. Gold to Seattle in the past (which is the present day)." ] ], "gold": "There are 155 episodes of Once Upon a Time, the American fantasy adventure drama television series that aired on ABC from 2011 to 2018. Another television series, Wansapanataym, the Filipinization of the English phrase \"once upon a time,\" is a Philippine fantasy anthology produced and broadcast by ABS-CBN. This series has 441 episodes.", "prediction 1": "There are 159 episodes of the American fantasy drama television series Once Upon a Time. In the Philippines, there is a fantasy drama anthology produced and aired by ABS-CBN. There is also the spin-off series Once Upon a Time in Wonderland, consisting of 13 episodes which followed the titular character from Alice in Wonderland.", "prediction 2": "There are 178 episodes of the American fantasy television series Once Upon a Time. The show is based on the children's book series Alice in Wonderland. There are also 184 episodes of the Filipino fantasy television series Once Upon a Time in Wonderland, which is a spin-off of the show created by Lost creators Edward Kitsis and Adam Horowitz. The Filipino fantasy television series once Upon a Time in Seattle has 174 episodes. Additionally, there is a Philippine fantasy drama anthology produced and aired by ABS-CBN.", "prediction 3": "There are 221 episodes of the American fantasy drama television series Once Upon a Time. The first 221 episodes were released in the United States in the year 2015, and the second 221 episodes were released in the United Kingdom in 2015.", "prediction 4": "There are 281 episodes of the American fantasy drama television series Once Upon a Time. The show is largely set in the fictitious seaside town of Storybrooke, Maine, and features the characters of Emma Swan and Regina Mills serving as the leads. The series also has a spin-off series called Once Upon a Time in Wonderland, consisting of 13 episodes. The Philippine fantasy drama anthology WansapanaSummer has 281 episodes.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 10, "end": 13 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are 155 episodes of Once Upon a Time, an American fantasy drama television series on ABC, it debuted on October 23, 2011, and concluded on May 18, 2018. In the Philippines, there is a fantasy drama anthology produced and aired by ABS-CBN. There is also the spin-off series, Once Upon a Time in Wonderland, consisting of 13 episodes which followed the titular character from Alice in Wonderland." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where does christina yang go in season 9?", "passages": [ [ "Cristina Yang", "\"\"New York\" Magazine\" praised the abortion storyline, saying that the show \"was brave enough to do what almost no other series will: show this one particular, totally legal medical procedure on TV\" and that the abortion was \"the only plausible resolution\" for Yang's pregnancy.", "Tanner Stransky, also of \"Entertainment Weekly\", said of Yang's actions after Owen's affair: \"It alternately seems silly and not silly, when you really think about it.\"", "Robert Bianco of \"USA Today\" praised Yang's storylines in the eighth season, saying: \"Their stories are effectively tied into that of a patient whose ability to move forward is complicated by a complex response to a hideous past.\"", "HitFix writer Liane Bonin Starr applauded Yang's brief departure from Seattle Grace to Mayo Clinic in the ninth season, which was \"interesting\" as \"it showed us a new side of her\u2014and after so many seasons, that was some welcome insight.\"", "The relation between Meredith and Cristina has been acclaimed and been a highlight of the show.", "Mark Perigard of the Boston Herald considered the friendship to be \"the secret core of Grey's\"." ], [ "Cristina Yang", "Afterward, Yang, Meredith, Shepherd, Arizona Robbins (Jessica Capshaw), Mark Sloan (Eric Dane), and Lexie Grey (Chyler Leigh) are involved in an aviation accident while on the way to Boise, Idaho to perform surgery on conjoined twins.", "Lexie dies, and Mark later succumbs to his injuries after they are rescued and dies.", "Following their rescue, Yang, traumatized, suffers from brief reactive psychosis which provokes violent outbursts and makes her unresponsive.", "Yang leaves Seattle to become a cardiothoracic surgical fellow and goes, as planned, to the Mayo Clinic, but has difficulties adapting to her new colleagues' way of working.", "While in Minnesota, Yang develops a friendship with a near-retirement cardio surgeon, Craig Thomas (William Daniels).", "She mainly teases him with comments regarding his old age.", "She also begins an affair with the head of surgery Dr. Parker (Steven Culp) who has issues with Thomas.", "After Thomas dies from a heart attack, Yang returns to Seattle.", "Cristina is re-hired and Owen asks for a divorce once Cristina wants to reconcile.", "Shocked, Cristina agrees, but later finds out that the potential conflict of interest regarding the plane crash lawsuit was a key motive behind Owen's request and confronts him.", "Owen tells her that he 'feels responsible' and was worried as he thought she was dead." ], [ "Grey's Anatomy (season 11)", "In terms of awards and accolades the season garnered six nominations at the 41st People's Choice Awards winning four including Favorite Network TV Drama, Dempsey and Pompeo won Favorite Dramatic TV Actor and Actress respectively and Oh winning for Favorite TV Character We Miss Most.", "On May 7, 2015, ABC announced the renewal of \"Grey's Anatomy\" for a twelfth season as part of their 2015-16 TV lineup.", "The season follows the story of surgical residents, fellows, and attendings as they experience the difficulties of the competitive careers they have chosen.", "It is set in the surgical wing of the fictional Grey Sloan Memorial Hospital, located in Seattle, Washington.", "The doctors at Grey Sloan Memorial must get used to the fact that Dr. Cristina Yang (Sandra Oh) is now in Switzerland, but they find it difficult to like her new replacement, Dr. Maggie Pierce (Kelly McCreary).", "She tries making friends with the doctors, but the one she\u2019s really interested in learning more about is her half-sister, Dr. Meredith Grey (Ellen Pompeo).", "Upon hearing Maggie's news, Meredith doesn\u2019t believe her.", "Trying to prove her wrong, Meredith pores over her mother\u2019s journals to see if there might have been any evidence of truth.", "What she finds is that the pieces fit, and that she and Maggie are in fact half-sisters." ] ], "gold": "In season 9 of Grey's Anatomy, Cristina Yang leaves Seattle Grace in Seattle, Washington and goes to Rochester, Minnesota to take up her fellowship at the Mayo Clinic. Following the death of Doctor Thomas, Yang returns to Seattle Grace.", "prediction 1": "Cristina Yang goes to Switzerland for a medical procedure in season 9 of Grey's Anatomy. In this episode of the show, Yang is visiting her half-sister, Dr. Meredith Grey, who is in Switzerland for the next year. In season 10, Yang visits a friend in Switzerland during an office visit. In season 11, Cristina leaves Seattle to become a cardiothoracic surgical fellow and goes, as planned, to the Mayo Clinic. However, she has difficulties adapting to her new colleagues' way of working. In Season 12, Yang goes to the Mayo Clinic.", "prediction 2": "Cristina Yang is a character on the television show Grey's Anatomy. In the ninth season, she goes to Switzerland to be with her daughter, Meredith. The following season, she goes to the Mayo Clinic, where she has difficulties adapting to her new colleagues' way of working.", "prediction 3": "Cristina Yang goes to Switzerland in season 9 of Grey's Anatomy. There she meets Dr. Maggie Pierce, the director of surgery at the hospital where she works.", "prediction 4": "Cristina Yang travels to Switzerland in season 9 of Grey's Anatomy, where she is a cardiothoracic surgical fellow. She also travels to the Mayo Clinic, a hospital in Minnesota, where she has difficulties adapting to her new colleagues' way of working.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 88 }, { "error type": "Unverifiable", "explanation": "", "start": 89, "end": 211 }, { "error type": "Unverifiable", "explanation": "", "start": 212, "end": 285 }, { "error type": "Unverifiable", "explanation": "", "start": 286, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 486 }, { "error type": "Unverifiable", "explanation": "", "start": 487, "end": 530 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "When did the film mama mia come out?", "passages": [ [ "Mamma Mia! (film)", "held its world premiere on June 30, 2008 at Leicester Square in London and premiered on July 4, 2008 in Stockholm, Sweden, with Andersson, Bj\u00f6rn Ulvaeus, Anni-Frid Lyngstad and Agnetha F\u00e4ltskog in attendance.", "The film was released theatrically on July 10 in the United Kingdom, on July 17 in Germany and on July 18 in the United States.", "It received mixed reviews from critics, who praised the musical numbers and production values, but criticized the plot and casting of inexperienced singers, in particular Brosnan and Skarsg\u00e5rd.", "Nonetheless, the film grossed $615 million worldwide on a $52 million budget, becoming the fifth highest-grossing film of 2008.", "A sequel, titled \"Mamma Mia!", "Here We Go Again\", was released on July 20, 2018 with most of the main cast returning.", "On the Greek island of Kalokairi, 20-year-old bride-to-be Sophie Sheridan reveals to her bridesmaids, Ali and Lisa, that she has secretly invited three men to her wedding without telling her mother, Donna.", "They are the men that her mother's diary reveals could have been her father: Irish-American architect Sam Carmichael, Swedish adventurer and writer Bill Anderson, and British banker Harry Bright." ], [ "Mamma Mia! (film series)", "Mamma Mia! (film series)\n\nMamma Mia! and Mamma Mia!", "Here We Go Again are an American musical film series based on the 1999 musical of the same name, based on the songs of successful pop group ABBA, with additional music composed by ABBA member Benny Andersson.", "An international co-production between Germany, the United Kingdom, and the United States, the first two films were directed by Phyllida Lloyd and Ol Parker, respectively, distributed by Universal Pictures in partnership with Tom Hanks and Rita Wilson's Playtone and Littlestar, and the title originates from ABBA's 1975 chart-topper \"Mamma Mia\".", "Meryl Streep and Amanda Seyfried play the lead roles of single mother Donna Sheridan and her daughter Sophie respectively.", "Pierce Brosnan, Colin Firth, and Stellan Skarsg\u00e5rd play the three possible fathers to Sophie.", "Though the world premiere of the film occurred elsewhere, most of the media attention was focused on the Swedish premiere, where Anni-Frid Lyngstad and Agnetha F\u00e4ltskog joined Bj\u00f6rn Ulvaeus and Benny Andersson with the cast at the Rival Theatre in Mariatorget, Stockholm, owned by Andersson, on July 4, 2008.", "It was the first time all four members of ABBA had been photographed together since 1986.", "\"Mamma Mia!" ], [ "Mamma Mia! Here We Go Again", "The film premiered on July 16, 2018 at the Hammersmith Apollo in London.", "The first trailer for the film was released on December 21, 2017, in front of \"Pitch Perfect 3\", another Universal Pictures film.", "Cher performed \"Fernando\" at the Las Vegas CinemaCon on April 25, 2018, after footage of the film was shown.", "Universal sponsored YouTube stars the Merrell Twins to perform a cover version of the song \"Mamma Mia\" to promote the film.", "\"Mamma Mia!", "Here We Go Again\" was released via digital copy on October 9, 2018 and released on DVD, Blu-ray, and 4K UHD Combo Pack on October 23, 2018.", "The film debuted at the top of the \nNPD VideoScan First Alert chart for the week ending on October 27, 2018.", "It retained the top spot on the chart for the week ending on November 3, 2018.", "\"Mamma Mia!", "Here We Go Again\" grossed $120.6 million in the United States and Canada, and $273.1 million in other territories, for a total worldwide gross of $393.7 million, against a production budget of $75 million.", "In June 2018, three weeks prior to its release, official industry tracking had the film debuting to $27\u201333 million, which increased to as much as $36 million by the week of its release." ] ], "gold": "Mamma Mia! held its world premiere on June 30, 2008 at Leicester Square in London and premiered on July 4, 2008 in Stockholm, Sweden. The film was released theatrically on July 10, 2008 in the United Kingdom, on July 17, 2008 in Germany and on July 18, 2008 in the United States. The film's sequel, Mamma Mia! Here We Go Again, premiered at the Hammersmith Apollo in London on July 16, 2018. The sequel was then released in both the United Kingdom and the United States on July 20, 2018.", "prediction 1": "The film Mamma Mia!, the 1999 musical film based on the hit song of the same name by ABBA, premiered on June 30, 2008 at Leicester Square in London. The film premiered on July 4, 2008 in Stockholm, Sweden, with Bj\u00f6rn Ulvaeus, Anni-Frid Lyngstad, and Agnetha F\u00e4ltskog in attendance. The sequel, Mamma Mia! Here We Go Again, was released on July 20, 2018 with most of the main cast returning.", "prediction 2": "Mamma Mia! and Mamma Mia! Here We Go Again are American musical film series based on the 1999 musical of the same name, based on the songs of successful pop group ABBA, with additional music composed by ABBA member Benny Andersson. The film premiered on July 16, 2018 at the Hammersmith Apollo in London. The sequel, titled Mamma Mia! Here We Go Again, was released on July 20, 2018 with most of the main cast returning.", "prediction 3": "Mamma Mia! is a musical film series based on the 1999 musical of the same name, based on the songs of successful pop group ABBA, with additional music composed by ABBA member Benny Andersson. The film premiered on June 30, 2008 at Leicester Square in London and premiered on July 4, 2008 in Stockholm, Sweden. The sequel, titled Mamma Mia! Here We Go Again, was released on July 20, 2018 with most of the main cast returning. The film premiered on July 16, 2018 at the Hammersmith Apollo in London.", "prediction 4": "Mamma Mia! is a musical comedy film series based on the 1999 musical of the same name, based on the songs of successful pop group ABBA, with additional music composed by ABBA member Benny Andersson. The film premiered June 30, 2008 in London and on July 4, 2008 in Stockholm, Sweden. The sequel, Mamma Mia! Here We Go Again, was released on July 20, 2018 with most of the main cast returning. The film premiered on July 16, 2018 at the Hammersmith Apollo in London.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 21, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 281 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Mamma Mia! held its world premiere on June 30, 2008 at Leicester Square in London and premiered on July 4, 2008 in Stockholm, Sweden. The film was released theatrically on July 10 in the United Kingdom, on July 17 in Germany and on July 18 in the United States. The sequel, Mamma Mia! Here We Go Again, was released on July 20, 2018 with most of the main cast returning. It also premiered on July 16, 2018 at the Hammersmith Apollo in London." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who is in drake started from the bottom video?", "passages": [ [ "Started from the Bottom", "I did not buy my way into this spot and it was the furthest thing from easy to achieve.", "I am proud of every part of my past and I'm excited for this song to find a place in your life as well.\"", "The song makes use of instrumentation from drums and a piano; MTV describes it as \"departure\" from his earlier works.", "On September 4, 2012, Drake was seen filming the music video for the song which was being directed by Director X.", "The music video was released on February 10, 2013.", "The video features an all-white dressed Drake standing in the back of a white Bentley convertible, during a blizzard.", "In other scenes, he works retail in a Shoppers Drug Mart drugstore, flies a plane into his native Toronto and dances around in a club.", "Drake's mother, Sandi, and producers Boi-1da and Noah \"40\" Shebib also have cameos in the video.", "At the end it displays Drake and his friends partying at a villa.", "Shortly after the song's debut Wiz Khalifa was the first to release a remix to the song." ], [ "OVO Sound", "OVO Sound\n\nOVO Sound is a Toronto-based Canadian record label founded by hip hop artist Drake, Oliver El-Khatib, and long-time producer Noah \"40\" Shebib in 2012.", "It operates as a subsidiary of, and is distributed through, Warner Music Group's Warner Bros. Records.", "The label has acts including Drake, PARTYNEXTDOOR, Majid Jordan, OB O'Brien, Roy Woods, and dvsn, as well as in-house producers 40, Boi-1da, T-Minus, Mike Zombie, Nineteen85 and Future the Prince.", "The label's roots can be traced back to 2006, where Drake's first official mixtape, \"Room for Improvement\", was released under the unofficial record label, \"All Things Fresh\" which eventually became \"October's Very Own\".", "This was due to Drake's standing as an unsigned artist at the time, with subsequent releases published under the \"October's Very Own\" moniker.", "Drake would then raise the profile of the label by prominently featuring OVO throughout his music, regularly mentioning the label in songs, on stage as well as the distribution of OVO merchandise." ] ], "gold": "The Started From the Bottom music video features Drake. Boi-1da and Noah \"40\" Shebib, who founded the Canadian record label OVO Sound with Drake, and Drake's mother, Sandi, have cameos in the video. Additionally, at the end of the music video, Drake and his friends are partying at a villa. ", "prediction 1": "In the Drake song \"Started from the Bottom\" video, Drake plays the part of a young man in a blizzard. In the video, Drake plays a young man, while his mother, Sandi, and producers Boi-1da and Noah \"40\" Shebib also have cameos. Drake also plays a man in the video, while Future the Prince and Wiz Khalifa appear in a remix.", "prediction 2": "Drake is in the song Started from the Bottom video, which was directed by Director X. Drake's mother, Sandi, and producers Boi-1da and Noah \"40\" Shebib also have cameos.", "prediction 3": "Drake's music video for his song \"Started from the Bottom\" was directed by Director X. The video features an all-white dressed Drake standing in the back of a white Bentley convertible, during a blizzard. Drake's mother, Sandi, and producers Boi-1da and Noah \"40\" Shebib also have cameos in the video. At the end it displays Drake and his friends partying at a villa.", "prediction 4": "Drake is in the music video for his song \"Started from the Bottom\" directed by Director X. Drake is seen in the music video with his mother Sandi, producers Boi-1da and Noah \"40\" Shebib, as well as his friends dancing at a villa.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 322 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In the Drake song \"Started from the Bottom\" video, Drake plays the part of a young man in a blizzard. In the video, Drake plays a young man, while his mother, Sandi, and producers Boi-1da and Noah \"40\" Shebib also have cameos. At the end it displays Drake and his friends partying at a villa." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When was rob kardashian on dancing with the stars?", "passages": [ [ "Rob Kardashian", "Kardashian graduated from the University of Southern California's Marshall School of Business in 2009.", "Kardashian was a contestant on season 13 of \"Dancing with the Stars\" in 2011.", "He was paired with two-time champion Cheryl Burke and made it further than his sister, Kim, did during her appearance in the seventh season.", "Kardashian was almost eliminated in the fourth week.", "During the season, Kardashian became the most improved dancer, advancing with his partner Cheryl Burke to the finals, her fifth time doing so.", "The pair ended up in second place against J.R. Martinez and Karina Smirnoff.", "Kardashian has also taken on several business ventures working with PerfectSkin, Rival Spot, the BG5 and working on his own sock line.", "Kardashian was one of the final judges of Miss USA 2012.", "Kardashian announced in August 2012 that he would return to the University of Southern California and study law later in the year.", "USC's Gould School of Law, however, denied this, and stated via its Twitter account that Kardashian had not even applied to the school.", "In 2012, Kardashian participated in Fox's dating game show \"The Choice\".", "That same year, he launched his sock line titled Arthur George." ], [ "Dancing with the Stars (U.S. season 13)", "Dancing with the Stars (U.S. season 13)\n\nSeason thirteen of \"Dancing with the Stars\" premiered on September 19, 2011.", "Carrie Ann Inaba, Len Goodman, and Bruno Tonioli returned as the judges, and Tom Bergeron and Brooke Burke Charvet returned as hosts.", "Twelve couples competed in this season.", "Starting this season, Alan Dedicoat, the announcer, introduces Harold Wheeler and his band after the introduction of the remaining competitors.", "Actor J.R. Martinez won the competition with over 9 million votes.", "Rob Kardashian and Ricki Lake took second and third places, respectively.", "Nine professional partners\u2014Derek Hough, Maksim Chmerkovskiy, Cheryl Burke, Tony Dovolani, Mark Ballas, Lacey Schwimmer, Karina Smirnoff, Anna Trebunskaya, and Kym Johnson\u2014returned this season.", "Maksim's brother, Valentin Chmerkovskiy, made his debut competing as a professional.", "Peta Murgatroyd and Tristan MacManus, part of season 12's troupe of dancers, also became professional partners for the first time.", "Louis van Amstel did not compete as a professional, but participated in a new segment called \"Ballroom Battles\", which would be canceled on November 7." ] ], "gold": "Rob Kardashian was a contestant on season 13 of \"Dancing with the Stars\" in 2011. During the season, Kardashian became the most improved dancer, advancing with his partner Cheryl Burke to the finals. The pair ended up in second place against J.R. Martinez and Karina Smirnoff.", "prediction 1": "Rob Kardashian appeared on Dancing with the Stars season 13 in 2011. Season thirteen premiered on September 19, 2011.", "prediction 2": "Rob Kardashian was a contestant on season 13 of Dancing with the Stars in 2011. He was paired with two-time champion Cheryl Burke and made it further than his sister, Kim, did during her appearance in the seventh season. Kardashian announced in August 2012 that he would return to the University of Southern California and study law later in the year. The season premiered on September 19, 2011.", "prediction 3": "Rob Kardashian was a contestant on season 13 of Dancing with the Stars in 2011. He was paired with two-time champion Cheryl Burke and made it further than his sister, Kim, did during her appearance in the seventh season. While on the competition, the 22-year-old was almost eliminated in the fourth week.", "prediction 4": "Rob Kardashian was a contestant on season 13 of \"Dancing with the Stars\" in 2011. He was paired with two-time champion Cheryl Burke and made it further than his sister, Kim, did during her appearance in the seventh season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 117 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Rob Kardashian appeared on Dancing with the Stars season 13 in 2011. During the season, Kardashian became the most improved dancer, advancing with his partner Cheryl Burke to the finals. The pair ended up in second place against J.R. Martinez and Karina Smirnoff." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "State of rhode island and providence plantations general treasurer?", "passages": [ [ "Rhode Island", "Rhode Island\n\nRhode Island (), officially the State of Rhode Island and Providence Plantations, is a state in the New England region of the United States.", "It is the smallest state in area, the seventh least populous, and the second most densely populated.", "It has the longest official name of any state.", "Rhode Island is bordered by Connecticut to the west, Massachusetts to the north and east, and the Atlantic Ocean to the south via Rhode Island Sound and Block Island Sound.", "It also shares a small maritime border with New York.", "Providence is the state capital and most populous city in Rhode Island.", "On May 4, 1776, the Colony of Rhode Island was the first of the Thirteen Colonies to renounce its allegiance to the British Crown, and it was the fourth among the newly independent states to ratify the Articles of Confederation on February 9, 1778.", "The state boycotted the 1787 convention which drew up the United States Constitution and initially refused to ratify it; it was the last of the states to do so on May 29, 1790.", "Rhode Island's official nickname is \"The Ocean State\", a reference to the large bays and inlets that amount to about 14 percent of its total area.", "Despite its name, most of Rhode Island is located on the mainland of the United States.", "Its official name is \"State of Rhode Island and Providence Plantations\", which is derived from the merger of four Colonial settlements." ], [ "Ratification of the United States Constitution by Rhode Island", "Ratification of the United States Constitution by Rhode Island\n\nThe ratification of the United States Constitution by Rhode Island was the 1790 decision by the State of Rhode Island and Providence Plantations (\"Rhode Island\") to accede to the United States Constitution.", "It was a controversial process that occurred only after the United States threatened a trade embargo against Rhode Island for non-compliance.", "Rhode Island early acquired a reputation for opposition to closer union with the other former British colonies that had formed the United States of America.", "Its veto of an act of the Congress of the Confederation earned it a number of deprecatory nicknames, including \"Rogue Island\" and \"the Perverse Sister\".", "One provision of the Articles of Confederation stated that an amendment to the Articles could only be made with the approval of all of the states, and this gave any state a functional veto power over amendments.", "Other states opposed amendments that might harm their own interests, but Rhode Island was particularly ready to use its veto power.", "The United States Congress called a convention to propose amendments in order to deal with this and other perceived shortcomings in the Articles, but Rhode Island refused to participate, and the convention instead set about drafting a new Constitution.", "Rhode Island was the only state to not participate in its proceedings." ], [ "Seth Magaziner", "Seth Magaziner\n\nSeth Magaziner (born July 22, 1983) is an American investment professional and the current General Treasurer of the State of Rhode Island.", "Magaziner is a native of Bristol, Rhode Island and the son of Democratic policy advisor Ira Magaziner.", "He graduated from Milton Academy in Milton, Massachusetts in 2002.", "He then attended Brown University in Providence, Rhode Island, where he served as president of the Brown University Democrats, president of the College Democrats of Rhode Island and served on the Brown University Steering Committee on Slavery and Justice.", "Magaziner received a Master of Business Administration from the Yale School of Management, in New Haven, Connecticut.", "Magaziner worked as Elementary School teacher at Creswell Elementary School in Hurricane Katrina ravaged Opelousas, Louisiana from 2006-2008, as a Teach for America Corps member.", "In 2009, he worked as an associate at Point Judith Capital, a Rhode Island based venture capital firm.", "After graduate school, Magaziner went to work at Trillium Asset Management, a Boston, Massachusetts based socially responsible investment firm, as a vice president and lead analyst for energy, banking, and diversified financial sector investment.", "On October 22, 2013, Magaziner announced his intention to run for Rhode Island General Treasurer in an online announcement video.", "He won the Democratic nomination in the September 9 primary election, defeating former Treasurer Frank Caprio." ] ], "gold": "Seth Magaziner assumed office on January 6, 2015, and is the current general treasurer of Rhode Island, which was named the State of Rhode Island and Providence Plantations until 2020. Previously, Gina Raimondo was Rhode Island's general treasurer from 2011 to 2015, assuming office on January 4, 2011, while Frank T. Caprio was Rhode Island's general treasurer from 2007 to 2011, assuming office on January 7, 2007. ", "prediction 1": "Seth Magaziner is the current general treasurer of the State of Rhode Island. He took office in September 9, 2013 and served until December 31, 2021.", "prediction 2": "The State of Rhode Island and Providence Plantations is a state in the New England region of the United States. The current general treasurer is Seth Magaziner. The first general treasurer was Jonathan K. Taylor in 1830. The second general treasurer was John R. Williams in 1913.", "prediction 3": "State of Rhode Island and Providence Plantations is a state in the New England region of the United States. On May 4, 1776, the Colony of Rhode Island was the first of the Thirteen Colonies to renounce its allegiance to the British Crown, and it was the fourth among the newly independent states to ratify the Articles of Confederation on February 9, 1778. In 1790, the State of Rhode Island and Providence Plantations voted to accede to the United States Constitution. Seth Magaziner is the current General Treasurer of the State of Rhode Island.", "prediction 4": "Seth Magaziner, who is an American investment professional and the current Treasurer of the State of Rhode Island, has served as general treasurer of the State of Rhode Island since September 9, 2013 and is the son of former treasurer Frank Caprio.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 118, "end": 149 } ], "missing-info": [], "corrected-prediction": "Seth Magaziner is the current general treasurer of the State of Rhode Island. He took office in September 9, 2013." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who voices the dad in phineas and ferb?", "passages": [ [ "Phineas and Ferb", "The show's casting organization is responsible for selecting most of the voice actors and actresses, choosing actors such as Vincent Martella and Mitchel Musso for major roles based on perceived popularity with target demographics.", "Povenmire and Marsh select guest stars, casting people that they \"really want to work with\".", "They also solicit guest roles from actors they feel would lend an interesting presence to the show.", "Guest stars have included pop culture figures like Damian Lewis, boxer Evander Holyfield, film stars Cloris Leachman and Ben Stiller, and pop singer Kelly Clarkson.", "Povenmire and Marsh have also solicited Tim Curry and Barry Bostwick, stars of \"The Rocky Horror Picture Show,\" to make guest appearances, while creator Richard O'Brien voices Lawrence, Ferb's father and Candace and Phineas's stepfather.", "O'Brien's participation eventually became regular, as he was cast to play Lawrence Fletcher, the children's father, who appears in about half of the episodes in the show.", "\"Top Gear\" stars Jeremy Clarkson, Richard Hammond, and James May all guest starred in a race-car themed episode as commentators.", "Other guest stars include Tina Fey, Seth MacFarlane, David Mitchell, Jaret Reddick, Clay Aiken, Chaka Khan, and Kevin Smith.", "The show has received generally positive reviews." ], [ "Phineas and Ferb", "The two plots intersect at the end to erase all traces of the boys' project just before Candace can show it to their mother.", "This usually leaves Candace very frustrated.", "Creators Dan Povenmire and Jeff \"Swampy\" Marsh had previously worked together on Fox's \"The Simpsons\" and Nickelodeon's \"Rocko's Modern Life\".", "The creators also voice two of the main B-plot characters: Major Monogram and Dr. Doofenshmirtz.", "\"Phineas and Ferb\" was conceived after Povenmire sketched a triangular boy\u00a0\u2013 the prototype for Phineas\u00a0\u2013 in a restaurant.", "Povenmire and Marsh developed the series concept together and pitched it to networks for 16 years before securing a run on Disney Channel.", "The show follows the adventures of stepbrothers Phineas Flynn (Vincent Martella) and Ferb Fletcher (Thomas Sangster), who live in the fictional city of Danville, in a (never specified) Tri-State area, as they seek ways to occupy their time during their summer vacation.", "Often these adventures involve elaborate, life-sized and ostensibly dangerous construction projects." ], [ "Rollercoaster (Phineas and Ferb)", "Rollercoaster (Phineas and Ferb)\n\n\"Rollercoaster\" is the pilot episode of the Disney Channel original animated television series \"Phineas and Ferb\", originally broadcast on Disney Channel on August 17, 2007 as a preview of the series, and Disney XD on February 13, 2009.", "The episode follows series protagonists Phineas and Ferb building an extremely large roller coaster panning from their backyard to throughout the city.", "\"Rollercoaster\" was written by co-creators Dan Povenmire and Jeff \"Swampy\" Marsh.", "Povenmire also directed the episode.", "The two used the episode to pitch the series to Disney.", "They recorded a set of storyboard reels, which Povenmire voiced over and sent them overseas.", "The preview of the episode totaled a combined 10.8 million viewers.", "Since airing, the episode has received mixed reviews from critics.", "Stepbrothers Phineas (Vincent Martella) and Ferb (Thomas Brodie-Sangster) are sitting lazily under the big tree in their backyard when they decide to construct a large rollercoaster.", "With their mother Linda (Caroline Rhea) at the grocery store, their sister Candace (Ashley Tisdale) wants to catch them in the act and \"bust\" them." ] ], "gold": "Phineas and Ferb is an American animated musical-comedy television series created by Dan Povenmire and Jeff \"Swampy\" Marsh for Disney Channel and Disney XD. Creator Richard O'Brien voices Lawrence, Ferb's father and Candace and Phineas's stepfather. Dan Povenmire voices Vanessa's dad.", "prediction 1": "Phineas and Ferb is an American animated children's television show based on the book series Phineas and Ferb: A Countdown to Summer Vacation. The show's creator Richard O'Brien voices Lawrence Fletcher, the children's father. O'Brien also voices the father of Phineas and Ferb's stepfather, Candace and Phineas.", "prediction 2": "Richard O'Brien voices the father in Phineas and Ferb, the Disney Channel original animated television series. Richard O'Brien voices the children's father in the show, while Vincent Martella voices the dad. Richard O'Brien voices the father in the show.", "prediction 3": "In the Disney Channel original animated television series Phineas and Ferb, creator Richard O'Brien voices the father. Richard O'Brien voices the stepfather in the show.", "prediction 4": "\"Phineas and Ferb\" is an American animated television show created by Dan Povenmire and Jeff \"Swampy\" Marsh for Disney Channel. It follows the adventures of stepbrothers Phineas Flynn (Vincent Martella) and Ferb Fletcher (Thomas Brodie-Sangster), who live in the fictional city of Danville, in a (never specified) Tri-State area, as they seek ways to occupy their time during their summer vacation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 142 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Phineas and Ferb is an American animated children's television show created by Dan Povenmire and Jeff \"Swampy\". The show's creator Richard O'Brien voices Lawrence, Ferb's father and Candace and Phineas's stepfather." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the first new york times published?", "passages": [ [ "The New York Times", "Since 2008, the \"Times\" has been organized into the following sections: News, Editorials/Opinions-Columns/Op-Ed, New York (metropolitan), Business, Sports of The Times, Arts, Science, Styles, Home, Travel, and other features.", "On Sunday, the \"Times\" is supplemented by the \"Sunday Review\" (formerly the \"Week in Review\"), \"The New York Times Book Review\", \"The New York Times Magazine\" and \"\".", "The \"Times\" stayed with the broadsheet full-page set-up and an eight-column format for several years after most papers switched to six, and was one of the last newspapers to adopt color photography, especially on the front page.", "\"The New York Times\" was founded as the New-York Daily Times on September 18, 1851.", "Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones, the \"Times\" was initially published by Raymond, Jones & Company.", "Early investors in the company included Edwin B. Morgan, Christopher Morgan, and Edward B. Wesley.", "Sold for a penny (equivalent to cents today), the inaugural edition attempted to address various speculations on its purpose and positions that preceded its release:\n", "In 1852, the newspaper started a western division, \"The Times of California\", which arrived whenever a mail boat from New York docked in California." ], [ "The New York Times", "However, the effort failed once local California newspapers came into prominence.", "On September 14, 1857, the newspaper officially shortened its name to The New-York Times.", "(The hyphen in the city name was dropped on December 1, 1896.)", "On April 21, 1861, \"The New York Times\" began publishing a Sunday edition to offer daily coverage of the Civil War.", "One of the earliest public controversies it was involved with was the Mortara Affair, the subject of twenty editorials in the \"Times\" alone.", "The main office of \"The New York Times\" was attacked during the New York City Draft Riots.", "The riots, sparked by the beginning of drafting for the Union Army, began on July 13, 1863.", "On \"Newspaper Row\", across from City Hall, Henry Raymond stopped the rioters with Gatling guns, early machine guns, one of which he manned himself.", "The mob diverted, instead attacking the headquarters of abolitionist publisher Horace Greeley's \"New York Tribune\" until being forced to flee by the Brooklyn City Police, who had crossed the East River to help the Manhattan authorities.", "In 1869, Henry Raymond died, and George Jones took over as publisher." ] ], "gold": "The New York Times was founded as the New-York Daily Times on September 18, 1851. It was founded by journalist and politician Henry Jarvis Raymond and former banker George Jones. On September 14, 1857, the newspaper officially shortened its name to The New-York Times. The hyphen in the city name was dropped on December 1, 1896.", "prediction 1": "The New York Times was founded as the New-York Daily Times on September 18, 1851. Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones, the \"Times\" was initially published by Raymond, Jones & Company. Early investors in the company included Edwin B. Morgan, Christopher Morgan, and Edward B. Wesley. The first edition of The New York Times was sold for a penny, equivalent to cents today. On April 21, 1861, The New York Times began publishing a Sunday edition to offer daily coverage of the Civil War. The main office of The New-York Times was attacked during the New York City Draft Riots. The riots, s, s, sparked by the beginning of drafting for the Union Army, began on July 13, 1863. The main office of The New York Times was attacked during the New York City Draft Riots. The New", "prediction 2": "On September 18, 1851, the New-York Daily Times was founded by journalist and politician Henry Jarvis Raymond and former banker George Jones. The shortened name was changed to The New-York Times on April 21, 1861, when it began publishing a Sunday edition to offer daily coverage of the Civil War. The first Sunday edition of The New-York Times was published on April 21, 1861.", "prediction 3": "The first New York Times was published on September 18, 1851. Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones, the newspaper was initially published by Raymond, Jones & Company.", "prediction 4": "The first New York Times was founded as the New-York Daily Times on September 18, 1851. Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones, the \"Times\" was initially published by Raymond, Jones & Company. On April 21, 1861, \"The New-York Times\" began publishing a Sunday edition to offer daily coverage of the Civil War.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 538 }, { "error type": "Irrelevant", "explanation": "", "start": 539, "end": 725 }, { "error type": "Irrelevant", "explanation": "", "start": 726, "end": 822 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The New York Times was founded as the New-York Daily Times on September 18, 1851. Founded by journalist and politician Henry Jarvis Raymond and former banker George Jones. On September 14, 1857, the newspaper officially shortened its name to The New-York Times. The hyphen in the city name was dropped on December 1, 1896." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who heads up the un human rights council?", "passages": [ [ "United Nations Human Rights Council", "United Nations Human Rights Council\n\nThe United Nations Human Rights Council (UNHRC) is a United Nations body whose mission is to promote and protect human rights around the world.", "The UNHRC has 47 members elected for staggered three-year terms on a regional group basis.", "The 38th session of the UNHRC began June 18, 2018.", "It ended on July 7, 2018.", "The headquarters of UNHRC is in Geneva, Switzerland.", "The UNHRC investigates allegations of breaches of human rights in UN member states, and addresses important thematic human rights issues such as freedom of association and assembly, freedom of expression, freedom of belief and religion, women's rights, LGBT rights, and the rights of racial and ethnic minorities.", "The UNHRC was established by the UN General Assembly on March 15, 2006 (by resolution A/RES/60/251) to replace the UN Commission on Human Rights (UNCHR, herein CHR) that had been strongly criticised for allowing countries with poor human rights records to be members." ], [ "Nazhat Shameem", "Before the full hearing could proceed, the Fiji Court of Appeal, made up of judges appointed by the challenged Judicial Service Commission, and post-2006, found that the Bainimarama government was unlawfully appointed, and ultra vires of the President's powers.", "On 11 April 2009, all the judges were removed from office by the President of Fiji, following the abrogation of the Constitution.", "Shameem was not reappointed.", "She went on to form a legal consultancy which mainly conducted legal skills workshops for lawyers.", "In May 2014, Shameem was appointed Fiji's first Permanent Representative to the United Nations Office in Geneva.", "On 27 October 2014, she presented her credentials as Fiji's permanent representative to the World Trade Organization to Director-General Roberto Azevedo.", "She is married to Aslam Khan, the chief executive officer of Vodafone Fiji.", "They have a child who is studying Law in the United Kingdom.", "Shameem is the sister of Shaista Shameem, Director of the Fiji Human Rights Commission.", "Her other siblings are Dr. Nikhat Shameem, an academic in the field of linguistics, and Dr. Raffat Shameem, a Cardiologist.", "Their father was from Multan, Pakistan while their mother was born in Fiji." ], [ "Joachim R\u00fccker", "Joachim R\u00fccker\n\nJoachim R\u00fccker (born May 30, 1951, in Schw\u00e4bisch Hall, Baden-W\u00fcrttemberg) is a German diplomat.", "He was the President of the United Nations Human Rights Council.", "R\u00fccker was born in 1951 in Schw\u00e4bisch Hall, Baden-W\u00fcrttemberg, Germany.", "He has a doctoral degree in international economics.", "R\u00fccker previously served as a foreign policy adviser to the Social Democratic parliamentary group in the German Bundestag.", "He was the Commissioner for Finance and Head of the Budget and Finance Division at the Federal Foreign Office in Berlin.", "R\u00fccker also held various postings in the Federal Foreign Office in Bonn and German embassies abroad, including Dar es Salaam, Detroit (as Consulate-General) and Vienna.", "Additionally, he was the Ambassador and Deputy High Representative for Administration and Finance in the Office of the High Representative in Sarajevo, and the Mayor of the city of Sindelfingen in Germany.", "From September 2006 to 20 June 2008, R\u00fccker served as the Special Representative of the United Nations Secretary-General for Kosovo and the head of UNMIK.", "In November of that year, he was named Ambassador of Germany to Sweden.", "In January 2015, R\u00fccker was appointed the President of the United Nations Human Rights Council.", "He is the first German diplomat to be elected to the position." ] ], "gold": "The United Nations Human Rights Council (UNHRC) is a United Nations body whose mission is to promote and protect human rights around the world. The president of the UNHRC was Joachim R\u00fccker in 2015. He was succeeded by Choi Kyong-Iim in 2016 and Joaqu\u00edn Alexander Maza Martelli in 2017. Nazhat Shameem is the current president.", "prediction 1": "The United Nations Human Rights Council (UNHRC) is a United Nations body whose mission is to promote and protect human rights around the world. The 47-member UNHRC investigates allegations of breaches of human rights in UN member states, and addresses important thematic human rights issues such as freedom of association and assembly, freedom of expression, freedom of belief and religion, women's rights, LGBT rights, and the rights of racial and ethnic minorities. In January 2015, Joachim R\u00fccker, a German diplomat, was elected to the position.\n", "prediction 2": "The United Nations Human Rights Council (UNHRC) is a UN body whose mission is to promote and protect human rights around the world. The 38th session of the UNHRC began June 18, 2018 and ended July 7, 2018. The prior UNHRC President for Fiji was Nazhat Shameem, who was appointed Fiji's first Permanent Representative to the United Nations Office in Geneva in May 2014. A German diplomat, Joachim R\u00fccker, was the prior UNHRC President for Germany.", "prediction 3": "The United Nations Human Rights Council (UNHRC) is a United Nations body whose mission is to promote and protect human rights around the world. The 47-member UNHRC investigates allegations of breaches of human rights in UN member states, and addresses important thematic human rights issues such as freedom of association and assembly, freedom of expression, freedom of belief and religion, women's rights, LGBT rights, and the rights of racial and ethnic minority. In January 2015, Joachim R\u00fccker, a German diplomat, was elected to the position.", "prediction 4": "The United Nations Human Rights Council, officially the United Nations Human Rights Council, was headed by Nazhat Shameem since 2014. She is the sister of Shaista Shameem, Director of the Fiji Human Rights Commission, and was previously named the head of the UNHRC in 2016. In January 2015, Joachim R\u00fccker, a German diplomat, was elected the first German diplomat to take charge of the UNHRC.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 467 } ], "missing-info": [], "corrected-prediction": "The United Nations Human Rights Council (UNHRC) is a United Nations body whose mission is to promote and protect human rights around the world. In January 2015, Joachim R\u00fccker, a German diplomat, was elected as the President of the United Nations Human Rights Council.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who played eddard stark in game of thrones?", "passages": [ [ "Ned Stark", "Ned Stark\n\nEddard \"Ned\" Stark is a fictional character in the 1996 fantasy novel \"A Game of Thrones\" by George R. R. Martin, and \"Game of Thrones\", HBO's adaptation of Martin's \"A Song of Ice and Fire\" series.", "In the storyline, Ned is the lord of Winterfell, an ancient fortress in the North of the fictional continent of Westeros.", "Though the character is established as the main character in the novel and the first season of the TV adaptation, Martin's plot twist at the end involving Ned shocked both readers of the book and viewers of the TV series.", "Ned is portrayed by Sean Bean in the first season of \"Game of Thrones\", as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons.", "Bean was nominated for a Saturn Award for Best Actor on Television and a Scream Award for Best Fantasy Actor for the role.", "He and the rest of the cast were nominated for Screen Actors Guild Awards for Outstanding Performance by an Ensemble in a Drama Series in 2011.", "In \"A Game of Thrones\" (1996), Ned Stark is introduced as the virtuous and honorable patriarch of House Stark and the father of six children." ], [ "Sean Bean", "Sean Bean\n\nShaun Mark Bean (born 17 April 1959), known professionally as Sean Bean (), is an English actor.", "After graduating from the Royal Academy of Dramatic Art, Bean made his professional debut in a theatre production of \"Romeo and Juliet\" in 1983.", "Retaining his Yorkshire accent, he first found mainstream success for his portrayal of Richard Sharpe in the ITV series \"Sharpe\".", "Bean subsequently gained further recognition for his performance as Ned Stark in the HBO epic fantasy series \"Game of Thrones\", and won both a BAFTA and an International Emmy, both for Best Actor.", "He has also been nominated for a Saturn Award.", "One of his most prominent film roles was Boromir in \"The Lord of the Rings\" trilogy (2001\u201303).", "Other roles include Alec Trevelyan in the James Bond film \"GoldenEye\" (1995) and Odysseus in \"Troy\" (2004), as well as roles in \"Patriot Games\" (1992), \"Ronin\" (1998), \"Equilibrium\" (2002), \"National Treasure\" (2004), \"North Country\" (2005), \"The Island\" (2005), \"Silent Hill\" (2006), \"Black Death\" (2010), \"Jupiter Ascending\" (2015) and \"The Martian\" (2015)." ] ], "gold": "Eddard Stark is a character on Game of Thrones. As a child, he was played by Sebastian Croft. As an adolescent, he was played by Robert Aramayo. Sean Bean played the adult character on the show.", "prediction 1": "Eddard \"Ned\" Stark is a fictional character in the 1996 fantasy novel A Game of Thrones by George R. R. Martin, and Game of Thrones, HBO's adaptation of Martin's A Song of Ice and Fire series. Ned is portrayed by Sean Bean in the first season of Game of Thrones, as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons.", "prediction 2": "Eddard \"Ned\" Stark is a fictional character in the 1996 fantasy novel A Game of Thrones by George R. R. Martin that is portrayed by Sean Bean in the first season of Game of Thrones, as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons.", "prediction 3": "Eddard \"Ned\" Stark is a fictional character in the 1996 fantasy novel A Game of Thrones by George R. R. Martin and Game of Thrones, HBO's adaptation of Martin's A Song of Ice and Fire series. In the storyline, Ned is the lord of Winterfell, an ancient fortress in the North of the fictional continent of Westeros. In Game of Thrones, Ned is portrayed by Sean Bean in the first season, as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons.", "prediction 4": "Eddard \"Ned\" Stark is a fictional character in the 1996 fantasy novel A Game of Thrones by George R. R. Martin and the HBO epic fantasy series Game of Thrones. Ned is portrayed by Sean Bean in the first season of Game of Thrones, as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 47, "end": 71 }, { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 192 } ], "missing-info": [], "corrected-prediction": "Eddard \"Ned\" Stark is a fictional character on Game of Thrones. Ned is portrayed by Sean Bean in the first season of Game of Thrones, as a child by Sebastian Croft in the sixth season, and as a young adult by Robert Aramayo in the sixth and seventh seasons." }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Where was the hotel in the shining located?", "passages": [ [ "The Shining (film)", "The set for the Overlook Hotel was at the time the largest ever built at Elstree, including a life-size re-creation of the exterior of the hotel.", "In February 1979, the set at Elstree was badly damaged in a fire, causing a delay in the production.", "While most of the interior shots, and even some of the Overlook exterior shots, were shot on studio sets, a few exterior shots were shot on location by a second-unit crew headed by Jan Harlan.", "Saint Mary Lake and Wild Goose Island in Glacier National Park, Montana was the filming location for the aerial shots of the opening scenes, with the Volkswagen Beetle driving along Going-to-the-Sun Road.", "The Timberline Lodge on Mount Hood in Oregon was filmed for a few of the establishing shots of the fictional Overlook Hotel; notably absent in these shots is the hedge maze, something the Timberline Lodge does not have.", "Outtakes of the opening panorama shots were later used by Ridley Scott for the closing moments of the original cut of the film \"Blade Runner\" (1982).", "\"The Shining\" had a prolonged and arduous production period, often with very long workdays.", "Principal photography took over a year to complete, due to Kubrick's highly methodical nature." ], [ "Doctor Sleep (2020 film)", "Warner Bros. plans to release \"Doctor Sleep\" in theaters in the United States on , 2020.", "Based on the 2013 horror novel of the same name by Stephen King, the film follows an adult Danny Torrance (who was a child in King's 1977 horror novel \"The Shining\") with psychic powers he calls \"the shining\" and dealing with alcoholism like his father did.", "Danny comes across a cult that feeds on the \"steam\" of children who have the same psychic powers.", "\"Doctor Sleep\" is based on the 2013 horror novel of the same name by Stephen King.", "The novel is a sequel to King's 1977 novel \"The Shining\".", "The 1977 novel was adapted into a 1980 horror film of the same name by director Stanley Kubrick.", "King was critical of Kubrick's film adaptation to the point of writing and executive-producing a new adaptation with the 1997 television miniseries.", "While the film \"Doctor Sleep\" is intended to be a direct adaptation of the 2013 sequel novel, director Mike Flanagan said \"Doctor Sleep\" would still \"acknowledge Kubrick's \"The Shining\" in some way\".", "Warner Bros. Pictures began developing a film adaptation of \"Doctor Sleep\" as early as 2014." ], [ "The Shining (film)", "The Shining (film)\n\n", "The Shining is a 1980 horror film produced and directed by Stanley Kubrick and co-written with novelist Diane Johnson.", "The film is based on Stephen King's 1977 novel of the same name\".", "\"The Shining\" is about Jack Torrance (Jack Nicholson), an aspiring writer and recovering alcoholic, who accepts a position as the off-season caretaker of the isolated historic Overlook Hotel in the Colorado Rockies.", "Wintering over with Jack are his wife Wendy Torrance (Shelley Duvall) and young son Danny Torrance (Danny Lloyd).", "Danny possesses \"the shining\", psychic abilities that enable him to see into the hotel's horrific past.", "The hotel's cook, Dick Hallorann (Scatman Crothers), also has this and is able to telepathically communicate with Danny.", "The hotel had a previous winter caretaker who went crazy and killed his family and himself.", "After a winter storm leaves the Torrances snowbound, Jack's sanity deteriorates due to the influence of the supernatural forces that inhabit the hotel, placing his wife and son in danger.", "Production took place almost exclusively at EMI Elstree Studios with sets strongly based on real locations.", "Kubrick often worked with a small crew which allowed him to do many takes, sometimes to the exhaustion of the actors and staff." ] ], "gold": "The Shining is a 1980 psychological horror film produced and directed by Stanley Kubrick and co-written with novelist Diane Johnson. The film's central character is Jack Torrance (Nicholson), an aspiring writer and recovering alcoholic who accepts a position as the off-season caretaker of the isolated historic Overlook Hotel in the Colorado Rockies, with his wife, Wendy Torrance (Duvall), and young son, Danny Torrance (Lloyd). The Timberline Lodge on Mount Hood in Oregon was filmed for a few of the establishing shots of the fictional Overlook Hotel. Besides the film, The Shining is also a three-episode horror television miniseries based on the 1977 Stephen King novel of the same name. The miniseries was shot at The Stanley Hotel in Estes Park, Colorado, in the Colorado Rockies, King's inspiration for the novel in March 1997.", "prediction 1": "The Shining is a 1980 horror film produced and directed by Stanley Kubrick and co-written with novelist Diane Johnson. It is based on Stephen King's 1977 novel The Shining. The hotel in the film is located at the Overlook Hotel in the Colorado Rockies. The Overlook Hotel is a fictional hotel that is used to create tension and intrigue for the characters, particularly Jack Torrance, who is the caretaker of the hotel. In the film, the hotel is actually located in Montana. Saint Mary Lake and Wild Goose Island, Montana was the filming location for the aerial shots of the opening scenes.", "prediction 2": "The Shining is a 1980 horror film produced and directed by Stanley Kubrick and co-written with novelist Diane Johnson. The film is based on Stephen King's 1977 novel of the same name. The hotel in the film is the Overlook Hotel. Saint Mary Lake and Wild Goose Island in Glacier National Park, Montana was the filming location for the aerial shots of the opening scenes. The Timberline Lodge on Mount Hood in Oregon was filmed for a few of the establishing shots of the fictional Overlook Hotel.", "prediction 3": "The Overlook Hotel is the fictional hotel in The Shining, an 1980 horror film produced and directed by Stanley Kubrick. Filming locations for the hotel included a few real-life locations, including Saint Mary Lake and Wild Goose Island in Glacier National Park, Montana. Saint Mary Lake and Wild Goose Island were also used for filming the aerial shots of the opening scenes of The Shining. Saint Mary Lake and Wild Goose Island were used for filming the scenes for the aerial shots of the opening scenes. Saint Mary Lake and Wild Goose Island were used in the 1983 horror novel The Shining.", "prediction 4": "The Overlook Hotel is the hotel in the film The Shining, adapted into a 1980 horror film directed by Stanley Kubrick, and the most recognisable location for the hotel in the film. Saint Mary Lake and Wild Goose Island in Glacier National Park, Montana were the filming locations for the aerial shots of the opening scenes. The Timberline Lodge on Mount Hood in Oregon was filmed for a few of the establishing shots of the fictional Overlook Hotel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 172 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,5]}", "start": 213, "end": 252 }, { "error type": "Unverifiable", "explanation": "", "start": 306, "end": 356 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 292 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,4,5]}", "start": 437, "end": 474 }, { "error type": "Irrelevant", "explanation": "", "start": 475, "end": 590 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Shining is a 1980 horror film produced and directed by Stanley Kubrick and co-written with novelist Diane Johnson. Jack Torrance is an aspiring writer and recovering alcoholic, who accepts a position as the off-season caretaker of the isolated historic Overlook Hotel in the Colorado Rockies. The set for the Overlook Hotel was built at Elstree. The Timberline Lodge on Mount Hood in Oregon was filmed for a few of the establishing shots of the fictional Overlook Hotel. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What is the most famous part of the sistine chapel?", "passages": [ [ "Sistine Chapel", "Sistine Chapel\n\nThe Sistine Chapel (; ; ) is a chapel in the Apostolic Palace, the official residence of the Pope, in Vatican City.", "Originally known as the \"Cappella Magna\", the chapel takes its name from Pope Sixtus IV, who restored it between 1477 and 1480.", "Since that time, the chapel has served as a place of both religious and functionary papal activity.", "Today it is the site of the Papal conclave, the process by which a new pope is selected.", "The fame of the Sistine Chapel lies mainly in the frescos that decorate the interior, and most particularly the Sistine Chapel ceiling and \"The Last Judgment\" by Michelangelo.", "During the reign of Sixtus IV, a team of Renaissance painters that included Sandro Botticelli, Pietro Perugino, Pinturicchio, Domenico Ghirlandaio and Cosimo Rosselli, created a series of frescos depicting the \"Life of Moses\" and the \"Life of Christ\", offset by papal portraits above and trompe l\u2019oeil drapery below.", "These paintings were completed in 1482, and on 15 August 1483 Sixtus IV celebrated the first mass in the Sistine Chapel for the Feast of the Assumption, at which ceremony the chapel was consecrated and dedicated to the Virgin Mary." ], [ "Separation of Light from Darkness", "Separation of Light from Darkness\n\nThe Separation of Light from Darkness is, from the perspective of the Genesis chronology, the first of nine central panels that run along the center of Michelangelo's Sistine Chapel ceiling and which depict scenes from the Book of Genesis.", "Michelangelo probably completed this panel in the summer of 1512, the last year of the Sistine ceiling project.", "It is one of five smaller scenes that alternate with four larger scenes that run along the center of the Sistine ceiling.", "The \"Separation of Light from Darkness\" is based on verses 3\u20135 from the first chapter of the Book of Genesis:\n", "Although in terms of the Genesis chronology it is the first of nine central panels along the Sistine ceiling, the \"Separation of Light from Darkness\" was the last of the nine panels painted by Michelangelo.", "Michelangelo painted the Sistine ceiling in two stages.", "Between May 1508 and the summer of 1511, he completed the \"entrance half\" of the Sistine chapel and ended this stage by painting the \"Creation of Eve\" and the scenes flanking this central panel.", "After an idle period of about 6 months, he painted the \"altar half,\" starting with the \"Creation of Adam\", between the winter of 1511 and October 1512." ] ], "gold": "The fame of the Sistine Chapel lies mainly in the frescos that decorate the interior, most particularly the Sistine Chapel ceiling and The Last Judgment. The Sistine Chapel ceiling was painted by Michelangelo between 1508 and 1512", "prediction 1": "The Sistine Chapel is a chapel in the Apostolic Palace, the official residence of the Pope, in Vatican City. Its fame lies mainly in the frescos that decorate the interior, and most particularly the Sistine Chapel ceiling and \"The Last Judgment\" by Michelangelo. The Separation of Light from Darkness is, from the perspective of the Genesis chronology, the first of nine central panels that run along the center of Michelangelo's Sistine Chapel ceiling and which depict scenes from the Book of Genesis. The Separation of Light from Darkness is, from Darkness is, from the perspective of the Genesis chronology, the first of nine central panels that run along the center of Michelangelo's Sistine Chapel ceiling. The Separation of Light from Darkness is, from the Book of Genesis.", "prediction 2": "The most famous part of the Sistine Chapel is the ceiling, which is a masterpiece by Italian Renaissance artist Michelangelo. The most famous part of the Sistine Chapel is one of the nine central panels, the Separation of Light from Darkness, which depict scenes from the Book of Genesis. The ceiling was completed in two stages: between May 1508 and the summer of 1511, he completed the \"entrance half\" of the Sistine chapel and ended this stage by painting the \"Creation of Eve\" and the scenes flanking this central panel. The Most famous part of the Sistine Chapel is the Separation of Light from Darkness, which is the first of nine central panels that run along the center of Michelangelo's Sistine Chapel ceiling and depict scenes from the Book of Genesis.", "prediction 3": "The Sistine Chapel is a chapel in the Apostolic Palace, the official residence of the Pope, in Vatican City. The most famous part of the Sistine Chapel is the ceiling. The most famous panel of the Sistine chapel is the Separation of Light from Darkness by Michelangelo.", "prediction 4": "The Most Famous Part of the Sistine Chapel is the ceiling. The most famous part of the Sistine ceiling is the Separation of Light from Darkness, which is the first of nine central panels that run along the center of Michelangelo's Sistine ceiling, and depict scenes from the Book of Genesis. The entrance half of the Sistine chapel was completed between May 1508 and the summer of 1511, and ended this stage by painting the \"Creation of Eve\" and the scenes flanking this central panel. The Separation of Light from Darkness is, from the perspective of the Genesis chronology, the first of nine central panels that run along the center of Michelangelo's Sistine Chapel ceiling, the last of the nine central panels that run along the center of Michelangelo's Sistine ceiling and that depict scenes from the Book of Genesis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 502 }, { "error type": "Redundant", "explanation": "The Separation of Light from Darkness is, ", "start": 545, "end": 562 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 544 }, { "error type": "Irrelevant", "explanation": "", "start": 563, "end": 711 }, { "error type": "Redundant", "explanation": " The Separation of Light from Darkness is,", "start": 712, "end": 753 }, { "error type": "Irrelevant", "explanation": "", "start": 754, "end": 779 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7, 8 ] } ], "corrected-prediction": "The Sistine Chapel's fame lies mainly in the frescos that decorate the interior, and most particularly the Sistine Chapel ceiling and \"The Last Judgment\" by Michelangelo. He painted the Sistine Chapel ceiling from 1508 to 1512." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "How many toms shoes have been given away?", "passages": [ [ "Toms Shoes", "A story by \"LA Weekly\" priced the manufacturing cost of a pair of Toms Shoes at $3.50-$5.00 in U.S. dollars, and noted that the children's shoes given out by the company were among the cheapest to make, which is not necessarily apparent to consumers.", "According to garment-industry author Kelsey Timmerman, many people he spoke to in Ethiopia were critical of the company, saying that they felt it exploited the idea of Ethiopian poverty as a marketing tool.", "An Argentina-based shoemaker agreed, saying that the imagery used by the company was manipulative.", "Employees of TOMS travel to different countries on \"Giving Trips\" to deliver shoes to children in person.", "In 2006, Toms distributed 10,000 pairs of shoes in Argentina.", "In November 2007, the company distributed 50,000 pairs of shoes to children in South Africa.", "As of April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States.", "As of 2012, Toms has given away over one million pairs of shoes in 40 countries.", "Students attending colleges across the United States have created TOMS campus clubs.", "As of March 20, 2014, 281 campus clubs existed in the United States with another dozen located in Canada." ] ], "gold": "In November 2007, Toms shoes distributed 50,000 pairs of shoes to children in South Africa, a part of the 140,000 pairs of shoes the company had distributed to children in Argentina, Ethiopia, South Africa as well as children in the United States as of April 2009. As of 2012, Toms has given away over one million pairs of shoes in 40 countries.", "prediction 1": "Toms Shoes is an American company that gives away children's shoes. As of April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States.", "prediction 2": "In 2006, Toms distributed 10,000 pairs of shoes in Argentina. In November 2007, the company distributed 50,000 pairs of shoes to children in South Africa. By April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States.", "prediction 3": "Toms Shoes distributes shoes to children in different countries on \"Giving Trips\" to deliver shoes to children in person. In 2006, Toms distributed 10,000 pairs of shoes in Argentina. In November 2007, the company distributed 50,000 pairs of shoes to children in South Africa. As of April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States.", "prediction 4": "As of April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States. In 2006, Toms distributed 10,000 pairs of shoes in Argentina. In November 2007, the company distributed 50,000 pairs of shoes to children in South Africa. As of 2012, Toms has given away over one million pairs of shoes in 40 countries. Students attending colleges across the United States have created TOMS campus clubs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 67 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": " In November 2007, Toms shoes distributed 50,000 pairs of shoes to children in South Africa. As of April 2009, Toms had distributed 140,000 pairs of shoes to children in Argentina, Ethiopia, South Africa as well as children in the United States. As of 2012, Toms has given away over one million pairs of shoes in 40 countries." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the percentage of jewish population in the world?", "passages": [ [ "Historical Jewish population comparisons", "Historical Jewish population comparisons\n\nJewish population centers have shifted tremendously over time, due to the constant streams of Jewish refugees created by expulsions, persecution, and officially sanctioned killing of Jews in various places at various times.", "In addition, assimilation and forced conversions have also impacted Jewish population sizes throughout Jewish history.", "The 20th century saw a large shift in Jewish populations, as a result of large-scale migration to the Americas and to Israel due to pogroms in the Russian Empire followed by the Holocaust.", "The independence of Israel sparked mass emigrations and expulsions of Jews from the Arab world.", "Today, the majority of the world's Jewish population is concentrated in two countries, the United States and Israel.", "The Torah contains a number of statements as to the number of (adult, male) Hebrews that left Egypt, the descendants of the seventy sons and grandsons of Jacob who took up their residence in that country.", "Altogether, including Levites, the number given is 611,730.", "For non-Levites, this represents men fit for military service, i.e. between twenty and sixty years of age; among the Levites the relevant number is those obligated in temple service (males between twenty and fifty years of age).", "This would imply a population of about 3,000,000." ], [ "Historical Jewish population comparisons", "The same source gives two wildly different estimate for the \"Falasha\", the Ethiopian Jews, variously estimating them at 50,000 and 200,000; the former would be comparable to their present-day population.", "In 1939, the core Jewish population reached its historical peak of 17 million (0.8% of the global population).", "Because of the Holocaust, the number was reduced to 11 million in 1945.", "The population grew again to around 13 million by the 1970s, but has since recorded near-zero growth until around 2005 due to low fertility rates and to assimilation.", "Since 2005, the world's Jewish population has been growing modestly at a rate of around 0.78% (in 2013).", "This increase primarily reflects the rapid growth of Haredi and some Orthodox sectors, who are becoming a growing proportion of Jews.", "a. Albania, Iraq, Jordan, Lebanon, Macedonia, Syria, Turkey\nb.", "Baltic states (Estonia, Latvia, Lithuania), Belarus, Moldova, Russia (including Siberia), Ukraine. c. Caucasus (Armenia, Azerbaijan, Georgia), Central Asia (Kazakhstan, Kyrgyzstan, Tajikistan, Turkmenistan, Uzbekistan)." ], [ "Asia", "Judaism, the oldest of the Abrahamic faiths, is practiced primarily in Israel, the indigenous homeland and historical birthplace of the Hebrew nation: which today consists both of those Israelites who remained in Asia/North Africa and those who returned from diaspora in Europe, North America, and other regions; though various diaspora communities persist worldwide.", "Jews are the predominant ethnic group in Israel (75.6%) numbering at about 6.1 million, although the levels of adherence to Jewish religion vary.", "Outside of Israel there are small ancient Jewish communities in Turkey (17,400), Azerbaijan (9,100), Iran (8,756), India (5,000) and Uzbekistan (4,000), among many other places.", "In total, there are 14.4\u201317.5 million (2016, est.)", "Jews alive in the world today, making them one of the smallest Asian minorities, at roughly 0.3 to 0.4 percent of the total population of the continent.", "Christianity is a widespread religion in Asia with more than 286 million adherents according to Pew Research Center in 2010, and nearly 364 million according to Britannica Book of the Year 2014.", "Constituting around 12.6% of the total population of Asia.", "In the Philippines and East Timor, Roman Catholicism is the predominant religion; it was introduced by the Spaniards and the Portuguese, respectively." ] ], "gold": "Jewish population centers have shifted tremendously over time, due to the constant streams of Jewish refugees created by expulsions, persecution, and officially sanctioned killing of Jews in various places at various times. In 1900, the Jewish population accounted for 0.68 of the world's population and reached its historical peak of 17 million in 1939. Because of the Holocausts, that number dropped to 11 million by 1945, but in the 1970s, the population grew again to around 13 million, accounting for 0.4 of the world's population. Since then, due to low fertility rates and assimilation, near-zero population growth was recorded until around 2005, leaving the Jewish population at 0.19 of the world's population in 2010.", "prediction 1": "In the year 2000, the world's Jewish population was estimated at 2.1 million, while in 1999 it was 2.9 million. As of 2017, the world's Jewish population was estimated at 1.9 million. The world's Jewish population in 2013 was estimated at 0.78%.", "prediction 2": "In 2013, the world's Jewish population grew modestly at a rate of 0.78% (in 2013). This increase primarily reflects the rapid growth of Haredi and some Orthodox sectors, who are becoming a growing proportion of Jews. The Jewish population in Asia and North Africa was approximately 75.6 percent in 2016. However, the percentage of the world's Jewish population living outside of Israel was slightly higher at 0.78% in 2013.", "prediction 3": "There are currently 14\u201317.5 million Jews living in the world today. Jewry is the predominant ethnic group in Israel, which is 75.6 percent of the world's population. Jews in the rest of the world are comprised of people of other faiths, such as Islam, Christianity, and other major world religions.", "prediction 4": "There are approximately 15.4\u201317.5 million Jews living in the world today. In 1939, the core Jewish population reached its historical peak of 17 million (0.8% of the global population). Because of the Holocaust, the number was reduced to 11 million in 1945. The population grew again to around 13 million by the 1970s, but has since recorded near-zero growth until around 2005 due to low fertility rates and to assimilation. Since 2005, the world's Jewish population has been growing modestly at a rate of around 0.78% (in 2013).", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 62, "end": 77 }, { "error type": "Unverifiable", "explanation": "", "start": 99, "end": 111 }, { "error type": "Unverifiable", "explanation": "", "start": 171, "end": 183 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 188, "end": 213 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 4 ] } ], "corrected-prediction": "Jewish population centers have shifted tremendously over time, due to the constant streams of Jewish refugees created by expulsions, persecution, and officially sanctioned killing of Jews in various places at various times. In 1939, the core Jewish population reached its historical peak of 17 million (0.8% of the global population). Because of the Holocaust, the number was reduced to 11 million in 1945. The population grew again to around 13 million by the 1970s, but has since recorded near-zero growth until around 2005 due to low fertility rates and to assimilation." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who headlined the first ever glastonbury festival in 1970?", "passages": [ [ "Glastonbury Festival", "The festival retains vestiges of this tradition such as the Green Fields area, encompassing the Green Futures and Healing Field.", "The first festival at Worthy Farm was the \"Pilton Pop, Blues & Folk Festival\", mounted by Michael Eavis on Saturday 19 September 1970, and attended by 1,500 people.", "The original headline acts were The Kinks and Wayne Fontana and the Mindbenders but these acts were replaced at short notice by Tyrannosaurus Rex, later known as T. Rex.", "Tickets were \u00a31.", "Other billed acts of note were Quintessence, Stackridge, and Al Stewart.", "The \"Glastonbury Fair\" of 1971 was instigated by Andrew Kerr after being found and introduced to Michael Eavis by David Trippas and organised with help from Jean Bradbery, Kikan Eriksdotter, John Massara, Jeff Dexter, Arabella Churchill, Thomas Crimble, Bill Harkin, Gilberto Gil, Mark Irons, John Coleman, and Jytte Klamer.", "The 1971 festival featured the first incarnation of the \"Pyramid Stage\".", "Conceived by Bill Harkin the stage was a one-tenth replica of the Great Pyramid of Giza built from scaffolding and metal sheeting and positioned over a blind spring which was found by dowsing." ], [ "Glastonbury Festival", "Glastonbury Festival\n\nGlastonbury Festival is a five-day festival of contemporary performing arts that takes place near Pilton, Somerset, England.", "In addition to contemporary music, the festival hosts dance, comedy, theatre, circus, cabaret, and other arts.", "Leading pop and rock artists have headlined, alongside thousands of others appearing on smaller stages and performance areas.", "Films and albums recorded at Glastonbury have been released, and the festival receives extensive television and newspaper coverage.", "Glastonbury is the largest greenfield festival in the world, and is now attended by around 175,000 people, requiring extensive infrastructure in terms of security, transport, water, and electricity supply.", "The majority of staff are volunteers, helping the festival to raise millions of pounds for charity organisations.", "Regarded as a major event in British culture, the festival is inspired by the ethos of the hippie, counterculture, and free festival movements.", "It retains vestiges of these traditions, such as the Green Fields area, which includes sections known as the Green Futures and Healing Fields.", "After the 1970s, the festival took place almost every year and grew in size, with the number of attendees sometimes being swollen by gatecrashers.", "Michael Eavis hosted the first festival, then called Pilton Festival, after seeing an open-air Led Zeppelin concert at the 1970 Bath Festival of Blues and Progressive Music." ] ], "gold": "Glastonbury Festival, formally Glastonbury Festival of Contemporary Performing Arts, is a five-day festival of contemporary performing arts that takes place in Pilton, Somerset, in England. The first festival was in 1970 and was supposed to headline The Kinks and Wayne Fontana and the Mindbenders. However, these acts were replaced on short notice by Tyrannosaurus Rex, later known as T. Rex. Other billed acts of note were: Steamhammer, Quintessence, Stackridge, Al Stewart and Keith Christmas.", "prediction 1": "The first ever Glastonbury festival was called Pilton Festival on Saturday 19 September 1970, which was hosted by Michael Eavis. The Kinks and Wayne Fontana and the Mindbenders headlined the event, but were replaced by Tyrannosaurus Rex at short notice.", "prediction 2": "The first Glastonbury Festival in 1970 in Somerset was the Pilton Pop, Blues & Folk Festival, mounted by Michael Eavis on Saturday 19 September 1970. The first headline acts were The Kinks and Wayne Fontana and the Mindbenders but these acts were replaced at short notice by Tyrannosaurus Rex, later known as T. Rex.", "prediction 3": "The first ever Glastonbury festival was held on Saturday 19 September 1970 at Worthy Farm, near Pilton, Somerset, England. The original headline acts were The Kinks and Wayne Fontana and the Mindbenders but these acts were replaced at short notice by Tyrannosaurus Rex, later known as T. Rex.", "prediction 4": "The first festival at Worthy Farm was the \"Pilton Pop, Blues & Folk Festival\", mounted by Michael Eavis on Saturday 19 September 1970, attended by 1,500 people. The original headline acts were The Kinks and Wayne Fontana and the Mindbenders but these acts were replaced at short notice by Tyrannosaurus Rex, later known as T.Rex. The 1971 festival featured the first incarnation of the \"Pyramid Stage\". Conceived by Bill Harkin the stage was a one-tenth replica of the Great Pyramid of Giza built from scaffolding and metal sheeting and positioned over a blind spring which was found by dowsing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 128 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Glastonbury Festival is a five-day festival of contemporary performing arts that takes place near Pilton, Somerset, England. The first ever Glastonbury festival was called was on Saturday 19 September 1970. The Kinks and Wayne Fontana and the Mindbenders headlined the event, but were replaced by Tyrannosaurus Rex at short notice. Other billed acts of note were Quintessence, Stackridge, and Al Stewart." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Where did the church of latter day saints originated?", "passages": [ [ "The Church of Jesus Christ of Latter-day Saints", "The church has an open canon which includes four scriptural texts: the Bible (both Old and New Testaments), the Book of Mormon, the Doctrine and Covenants, and the Pearl of Great Price.", "Other than the Bible, the majority of the LDS canon constitutes revelation received by Joseph Smith and recorded by his scribes which includes commentary and exegesis about the Bible, texts described as lost parts of the Bible, and other works believed to be written by ancient prophets.", "Because of some of the doctrinal differences, Catholic, Orthodox, and several Protestant churches consider the Church to be distinct and separate from mainstream Christianity.", "Under the doctrine of continuing revelation, Latter-day Saints believe that the church president is a modern-day \"prophet, seer, and revelator\" and that Jesus Christ, under the direction of God the Father, leads the church by revealing his will to its president.", "Individual members of the church believe that they can also receive personal revelation from God in conducting their lives.", "The president heads a hierarchical structure with various levels reaching down to local congregations.", "Bishops, drawn from the laity, lead local congregations.", "Male members, after reaching age 12, may be ordained to the priesthood, provided they are living the standards of the church.", "Women are not ordained to the priesthood but do occupy leadership roles in some church auxiliary organizations." ], [ "The Church of Jesus Christ of Latter-day Saints", "The largest of these smaller groups is the Community of Christ (previously known as the Reorganized Church of Jesus Christ of Latter Day Saints), based in Independence, Missouri, followed by The Church of Jesus Christ, based in Monongahela, Pennsylvania.", "Like the LDS Church, these faiths believe in Joseph Smith as a prophet and founder of their religion.", "They also accept the Book of Mormon, and most, but not all, accept at least some version of the Doctrine and Covenants.", "However, they tend to disagree to varying degrees with the LDS Church concerning doctrine and church leadership.", "The main branches of the Latter Day Saint movement resulted from the crisis of succession upon the death of Joseph Smith.", "Other branches may be considered later offshoots of the LDS Church branch, mainly due to disagreements about plural marriage.", "The church teaches that it is a continuation of the Church of Christ established in 1830 by Joseph Smith.", "This original church underwent several name changes during the 1830s, being called the Church of Jesus Christ, the Church of God, and then in 1834, the name was officially changed to the Church of the Latter Day Saints.", "In April 1838, the name was officially changed to the Church of Jesus Christ of Latter Day Saints." ], [ "Community of Christ", "Formerly known as the Reorganized Church of Jesus Christ of Latter Day Saints, the Community of Christ regards itself as the true embodiment of the original church organized in 1830 by Joseph Smith, and it regards Joseph Smith III, the eldest surviving son of Smith, to have been his legitimate successor.", "The church was \"legally organized on April 6, 1830, in Fayette, New York\".", "The formal reorganization occurred on April 6, 1860, in Amboy, Illinois, as the \"Church of Jesus Christ of Latter Day Saints\", adding the word \"Reorganized\" to the church name in 1872.", "The Community of Christ today considers the period from 1830 to 1844 to be a part of its early history and from 1844, the year of the death of the founder, to 1860, to be a period of disorganization.", "Since 1844, the doctrines and practices of the Community of Christ have evolved separately from the other denominations of the Latter Day Saint movement.", "Since the 1960s, the church's proselytizing outside North America forced a re-assessment and a gradual evolution of its practices and beliefs.", "Some changes included the ordination of women to the priesthood, open communion, and changing the church's name from the Reorganized Church of Jesus Christ of Latter Day Saints to the current name in April 2001." ] ], "gold": "Joseph Smith formally organized the The Church of Jesus Christ of Latter-day Saints, on April 6, 1830, in western New York. Initial converts were drawn to the church in part because of the newly published Book of Mormon, a self-described chronicle of indigenous American prophets that Smith said he had translated from golden plates.", "prediction 1": "The Church of Jesus Christ of Latter-day Saints originated in Amboy, Illinois; however, it was legally organized on April 6, 1830, in Fayette, New York. The church underwent several name changes during the 1830s, being called the Church of Jesus Christ, the Church of God, and then in 1834, the name was officially changed to the Church of the Latter Day Saints. In April 1838, the name was officially changed to the Church of Jesus Christ of Latter Day Saints.", "prediction 2": "The Church of Jesus Christ of Latter-day Saints originated in the Community of Christ, which was officially organized on April 6, 1830, in Fayette, New York. The church's formal reorganization occurred on April 6, 1860, in Amboy, Illinois, as the Church of Jesus Christ of Latter Day Saints, adding the word \"Reorganized\" to the church name in 1872.", "prediction 3": "The Church of Jesus Christ of Latter-day Saints originated in the Church of Christ established in 1830 by Joseph Smith. The church underwent several name changes during the 1830s, being called the Church of Jesus Christ, the Church of God, and then in 1834, the name was officially changed to the Church of the Latter Day Saints. In April 1838, the name was officially changed to the Church of Jesus Christ of Latter Day Saints.", "prediction 4": "The Church of Jesus Christ of Latter Day Saints originated in the Church of Christ established in 1830 by Joseph Smith. This original church underwent several name changes during the 1830s, being called the Church of Jesus Christ, the Church of God, and then in 1834, the name was officially changed to the Church of the Latter Day Saints. The formal reorganization occurred on April 6, 1860, in Amboy, Illinois, as the Church of Jesus Christ of Latter Day Saints, adding the word \"Reorganized\" to the church name in 1872. The Church of Jesus Christ of Latter Day Saints was officially organized on April 6, 1830 by Joseph Smith.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 461 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Church of Jesus Christ of Latter-day Saints was legally organized on April 6, 1830, in Fayette, New York, by Joseph Smith. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "What is the record score for the world cup?", "passages": [ [ "Ernst Wilimowski", "Willimowski's appearances for Poland include two performances that were both historic and memorable.", "In a match against Brazil played in Strasbourg, France during the 1938 FIFA World Cup, \"Ezi\" put on a stunning display by becoming the first player ever to score four goals in a single World Cup match.", "His continued attacks on the opposition net also drew a penalty as he was fouled to the ground by Brazilian keeper Batatais, which led to Poland's fifth goal scored from the spot by German-born Fritz Scherfke, from Pozna\u0144.", "However, it was not enough - Poland lost the match 5-6 and was eliminated from the tournament.", "Willimowski's record was later equalled by other players, but was bettered only 56 years later, when Oleg Salenko scored five goals against Cameroon during the 1994 FIFA World Cup.", "It still remains the only World Cup match when a player from the losing side scored four goals.", "Willimowski put on another memorable display on 27 August 1939 in Warsaw in an international friendly against what was then one of the best teams in the world - Hungary, the 1938 World Cup runner-up.", "After 33 minutes of play the Hungarians were ahead 2:0.", "Willimowski scored three goals and again drew a penalty through his attacking play which was converted by teammate Leonard Pi\u0105tek, giving Poland a 4:2 win." ], [ "FIFA World Cup top goalscorers", "FIFA World Cup top goalscorers\n\nMore than 2,000 goals have been scored at the 21 editions of the FIFA World Cup final tournaments, not counting penalties scored during shoot-outs.", "Since the first goal scored by French player Lucien Laurent at the 1930 FIFA World Cup, more than 1,250 footballers have scored goals at the World Cup, of which just 97 have scored at least five.", "The top goalscorer of the inaugural competition was Argentina's Guillermo St\u00e1bile with eight goals.", "Since then, only 22 players have scored more at all the games played at the World Cup than St\u00e1bile did throughout the 1930 tournament.", "The first was Hungary's S\u00e1ndor Kocsis with eleven in 1954.", "At the next tournament, France's Just Fontaine improved on this record with 13 goals in only six games.", "Gerd M\u00fcller scored 10 for West Germany in 1970 and broke the overall record when he scored his 14th goal at the World Cup during West Germany's win at the 1974 final.", "His record stood for more than three decades until Ronaldo's 15 goals between 1998 and 2006 for Brazil.", "Germany's Miroslav Klose went on to score a record 16 goals across four consecutive tournaments between 2002 and 2014." ] ], "gold": "There are several record scores for the World Cup. In the World Cup, the record score for a player in a match is 5, for a player in a single tournament is 13, for a team in a match is 10, and for a team in a single tournament is 27.", "prediction 1": "The world record for a goal scored at the World Cup is a goal scored by an opponent in each of the four quarterfinals. The record for a goal scored during the tournament is a goal scored by an opponent in each of the four quarterfinals. The record for a goal scored during a World Cup is a goal scored by an opponent in each of the four quarterfinals.", "prediction 2": "The record score for a match at the World Cup is 4:2. Fritz Scherfke scored four goals in a single World Cup match in 1938, in a match played in Strasbourg, France. The record score for a match at the World Cup in 1939 was 4:0. The record score for a match at the World Cup in 1994 was 5:4.", "prediction 3": "The record total goals scored at a World Cup is 4 goals. The record total goals scored for a single World Cup match is 4 goals. The record total goals scored for a double World Cup is 10 goals.", "prediction 4": "The record score for a single match at the World Cup is 4 - 0 \u2013 1 \u2013 0. The record score for a quarterfinal match at the World Cup is 1 \u2013 0 \u2013 1 \u2013 2 \u2013 0 \u2013 1 \u2013 1, 0 \u2013 1. The record score for a quarterfinal match at the World Cup is 4-0 \u2013 2 \u2013 4. The record for a quarterfinal match at the World Cup is 4 \u2013 1 \u2013 0.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 118 }, { "error type": "Redundant", "explanation": "The world record for a goal scored at the World Cup is a goal scored by an opponent in each of the four quarterfinals. ", "start": 119, "end": 236 }, { "error type": "Redundant", "explanation": "The world record for a goal scored at the World Cup is a goal scored by an opponent in each of the four quarterfinals. ", "start": 237, "end": 351 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who did the song come a little bit closer?", "passages": [ [ "Come a Little Bit Closer", "Come a Little Bit Closer\n\n\"Come a Little Bit Closer\" is a song by the 1960s rock and roll band Jay and the Americans.", "It reached number 3 on the \"Billboard\" Hot 100 in 1964, making it the band's highest charting single.", "It remains their most popular song, according to Last.fm song rankings.", "It also peaked at number 4 on the Cashbox chart and at number 1 on \"RPM's\" singles chart.", "The single served as a comeback for the group, who had not had a hit in some time.", "It was written by songwriters Tommy Boyce and Bobby Hart, as well as Wes Farrell, and became Boyce and Hart's first top 10 hit.", "Jay and the Americans also recorded a Spanish version of the song, in which, due to a poor translation, the final punch line is missing.", "The song is featured in the 2017 film \"Guardians of the Galaxy Vol. 2\".", "The lyrics tell the story of a young woman who is romantically involved with a man named Jos\u00e9, but seduces the narrator with flattering words until he is love-stricken.", "After they kiss Jos\u00e9 arrives and the narrator flees, only to hear in the distance as the young woman uses on Jos\u00e9 the exact same enticing words she told the narrator, suggesting she lures every suitor she meets with the exact same \"script\"." ], [ "Guardians of the Galaxy Vol. 2", "Ayesha, leader of the Sovereign race, has the Guardians protect valuable batteries from an inter-dimensional monster in exchange for Gamora's estranged sister Nebula, who was caught attempting to steal the batteries.", "After Rocket steals some for himself, the Sovereign attacks the Guardians' ship with a fleet of drones.", "These are destroyed by a mysterious figure, and the Guardians crash-land on a nearby planet.", "There, this figure reveals himself as Quill's father, Ego, and invites Quill, Gamora, and Drax to his home planet.", "Rocket and Groot remain behind to repair the ship and guard Nebula.", "Ayesha hires Yondu Udonta and his crew, who have been exiled from the greater Ravager community for child trafficking, to recapture the Guardians.", "They capture Rocket, but when Yondu hesitates to turn over Quill, whom he raised, his lieutenant Taserface leads a mutiny with help from Nebula.", "Taserface imprisons Rocket and Yondu aboard the latter's ship and executes his loyalists by releasing them into space.", "Nebula leaves to find and kill Gamora, whom she blames for the torture inflicted on her by their father, Thanos.", "While imprisoned, Rocket and Yondu bond." ] ], "gold": "Come a Little Bit Closer is a song by the 1960s rock and roll band Jay and the Americans. It reached number 3 on the Billboard Hot 100 on 21 November 1964. The song was written by songwriters Tommy Boyce and Bobby Hart along with Wes Farrell. The song was produced by Artie Ripp. Come a Little Bit Closer is featured in the 2017 film Guardians of the Galaxy Vol. 2, where the song plays as Yondu, Rocket Raccoon and Groot massacre the Ravagers who had mutinied against Yondu. The animated web series How It Should Have Ended made their own parody of the song titled Here Comes My Arrow for their How Guardians of The Galaxy Vol. 2 Should Have Ended video.", "prediction 1": "Come a Little Bit Closer is a song by the 1960s rock and roll band Jay and the Americans. It reached number 3 on the \"Billboard\" Hot 100 in 1964, making it the band's highest charting single. It remains their most popular song, according to Last.fm song rankings. The song is also featured in the 2017 Guardians of the Galaxy Vol. 2.", "prediction 2": "\"Come a Little Bit Closer\" is a song by the 1960s rock and roll band Jay and the Americans. It reached number 3 on the Billboard Hot 100 in 1964, making it the group's highest charting single. The song was written by songwriters Tommy Boyce and Bobby Hart, as well as Wes Farrell, and became Boyce and Hart's first top 10 hit. The Spanish version, which, due to a poor translation, the final punch line is missing, was released but the English version was released in 2017.", "prediction 3": "The 1960s rock and roll band Jay and the Americans sang Come a Little Bit Closer, which served as a comeback hit for the group, who had not had a hit in some time. The lyrics tell the story of a young woman who is romantically involved with a man named Jos\u00e9, but seduces the narrator with flattering words until he is love-stricken. After they kiss Jos\u00e9 arrives and the narrator flees, only to hear in the distance as the young woman uses on Jos\u00e9 the exact same enticing words she told the narrator, suggesting she lures every suitor she meets with the exact same \"script\" she used on Jos\u00e9 the exact same enticing words she told the narrator.", "prediction 4": "\"Come a Little Bit Closer\" is a song by the 1960s rock and roll band Jay and the Americans. It reached number 3 on the Billboard Hot 100 in 1964, making it the band's highest charting single. It remains their most popular song, according to Last.fm song rankings. The song is featured in the 2017 film Guardians of the Galaxy Vol. 2. The lyrics tell the story of a young woman who is romantically involved with a man named Jos\u00e9, but seduces the narrator with flattering words until he is love-stricken.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 263 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Come a Little Bit Closer is a song by the 1960s rock and roll band Jay and the Americans. It reached number 3 on the \"Billboard\" Hot 100 in 1964. It was written by songwriters Tommy Boyce and Bobby Hart, as well as Wes Farrell. The song is also featured in the 2017 Guardians of the Galaxy Vol. 2." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Moss is an example of which type of plant?", "passages": [ [ "Moss", "Moss\n\nMosses are small flowerless plants that typically grow in dense green clumps or mats, often in damp or shady locations.", "The individual plants are usually composed of simple leaves that are generally only one cell thick, attached to a stem that may be branched or unbranched and has only a limited role in conducting water and nutrients.", "Although some species have conducting tissues, these are generally poorly developed and structurally different from similar tissue found in vascular plants.", "Mosses do not have seeds and after fertilisation develop sporophytes with unbranched stalks topped with single capsules containing spores.", "They are typically tall, though some species are much larger.", "\"Dawsonia\", the tallest moss in the world, can grow to in height.", "Mosses are commonly confused with lichens, hornworts, and liverworts.", "Lichens may superficially look like mosses, and have common names that include the word \"moss\" (e.g., \"reindeer moss\" or \"iceland moss\"), but are not related to mosses.", "Mosses used to be grouped together with the hornworts and liverworts as \"non-vascular\" plants in the former division \"bryophytes\", all of them having the haploid gametophyte generation as the dominant phase of the life cycle." ], [ "Charophyta", "Charophyta are complex green algae that form a sister group to the Chlorophyta and within which the Embryophyta emerged.", "The chlorophyte and charophyte green algae and the embryophytes or land plants form a clade called the green plants or Viridiplantae, that is united among other things by the absence of phycobilins, the presence of chlorophyll b and chlorophyll a, cellulose in the cell wall and the use of starch, stored in the plastids, as a storage polysaccharide.", "Unlike chlorophytes, the charophytes and embryophytes share several traits, such as the presence of certain enzymes (class I aldolase, Cu/Zn superoxide dismutase, glycolate oxidase, flagellar peroxidase), lateral flagella (when present), and, in many species, the use of phragmoplasts in mitosis.", "Thus Charophyta and Embryophyta together form the clade Streptophyta, excluding the Chlorophyta." ], [ "Plant", "Embryophytes include the vascular plants, such as ferns, conifers and flowering plants.", "They also include the \"bryophytes\", of which mosses and liverworts are the most common.", "All of these plants have eukaryotic cells with cell walls composed of cellulose, and most obtain their energy through photosynthesis, using light, water and carbon dioxide to synthesize food.", "About three hundred plant species do not photosynthesize but are parasites on other species of photosynthetic plants.", "Embryophytes are distinguished from green algae, which represent a mode of photosynthetic life similar to the kind modern plants are believed to have evolved from, by having specialized reproductive organs protected by non-reproductive tissues.", "Bryophytes first appeared during the early Paleozoic.", "They mainly live in habitats where moisture is available for significant periods, although some species, such as \"Targionia\", are desiccation-tolerant.", "Most species of bryophytes remain small throughout their life-cycle.", "This involves an alternation between two generations: a haploid stage, called the gametophyte, and a diploid stage, called the sporophyte.", "In bryophytes, the sporophyte is always unbranched and remains nutritionally dependent on its parent gametophyte." ] ], "gold": "Moss is an an example of the Plantae Kingdom, clade Embryophytes (land plants), which are the most familiar group of green plants that comprise vegetation on Earth. Mosses are small, non-vascular flowerless plant in the taxonomic division Bryophyta Schimp. sensu stricto. Bryophyta (sensu lato, Schimp. 1879) may also refer to the parent group, bryophytes, which comprise liverworts, mosses and hornworts. Mosses typically form dense green clumps or mats, often in damp or shady locations", "prediction 1": "Embryophytes are plants that have eukaryotic cells with cell walls composed of cellulose and most obtain their energy through photosynthesis, using light, water and carbon dioxide to synthesize food. Mosses are a nonvascular plant that typically grow in dense green clumps or mats, often in damp or shady locations. Embryophytes are also known as bryophytes, which include mosses and liverworts.", "prediction 2": "Embryophytes are green algae that form a sister group to the Chlorophyta and within which the Embryophyta emerged. Charophyta are complex green algae that form a sister group to the Chlorophyta and include both vascular and non-vascular plants, such as ferns, conifers and flowering plants. The haploid gametophyte generation is the dominant phase of the life cycle. Embryophytes are distinguished from green algae that represent a mode of photosynthetic life similar to the kind modern plants are believed to have evolved from, by having specialized reproductive organs protected by non-reproductive tissues. Mosses are small flowerless plants that typically grow in dense green clumps or mats, often in damp or shady locations. They are often grown in damp or shady locations.", "prediction 3": "Many types of plants are classified as Embryophytes, and these include vascular plants, such as ferns, conifers and flowering plants, and bryophytes, which include mosses, liverworts, and hornworts. Bryophytes are haploid gametophytes, which are characterized by eukaryotic cells and cell walls composed of cellulose.", "prediction 4": "Embryophytes are plants that are non-vascular and have eukaryotic cells with cell walls composed of cellulose and obtain their energy through photosynthesis. For example, mosses are small flowerless plants that typically grow in dense green clumps or mats, often in damp or shady locations. Mosses used to be grouped together with the hornworts and liverworts as \"non-vascular\" plants in the former division, bryophytes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 199 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 329, "end": 343 } ], "missing-info": [], "corrected-prediction": "Mosses are a nonvascular plant that typically grow in dense green clumps or mats, often in damp or shady locations. Embryophytes also include bryophytes, which include mosses and liverworts." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does derek get in a car accident?", "passages": [ [ "Derek Shepherd", "Meanwhile, he and Meredith fight bitterly on and off over whether they should move.", "After a bad argument, he accepts the job in the heat of the moment and leaves for Washington.", "While there, he and Meredith talk things out over the phone and come to a mutual conclusion that they both did not want to end their marriage.", "He tells her that just being with her, raising their children and operating on patients was more satisfying than \"saving the world\".", "In season 11, Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington.", "He is able to hear and process auditory input, but unable to speak.", "He is recognized by Winnie, one of the victims of a crash he assisted in earlier, who tells the surgeons that their patient's name is Derek and that he is a surgeon as well.", "The hospital he was taken to was understaffed and his head injury was not detected quickly enough by the interns on duty that night.", "Although the neurosurgeon on call is paged multiple times, he takes too long to arrive and Derek is declared brain dead.", "Police arrive at Meredith's door and take her to see Derek, where she consents to removing him from life support.", "At the time of his death, Meredith was pregnant with their third child.", "She gives birth to a daughter whom she names Ellis after her mother." ], [ "How to Save a Life (Grey's Anatomy)", "How to Save a Life (Grey's Anatomy)\n\n\"How to Save a Life\" is the twenty-first episode of the eleventh season of the American television medical drama \"Grey's Anatomy\", and is the 241st episode overall.", "It aired on April 23, 2015 on ABC in the United States.", "The episode was written by showrunner Shonda Rhimes and directed by Rob Hardy, making it the first episode Rhimes has written since the season eight finale \"Flight\".", "The installment marked the death and final appearance of the series\u2019 male lead character, Derek Shepherd (Patrick Dempsey), who had starred on the series since its inception.", "In this episode, Shepherd is involved in an accident while attempting to help the victims of a car accident.", "He is later pronounced brain dead, in part due to the surgeons not providing him with a timely CT scan.", "Only six regular cast membersEllen Pompeo, Patrick Dempsey, Chandra Wilson, Kevin McKidd, Sarah Drew and Caterina Scorsone appear in the episode.", "\"How to Save a Life\" also marks the first appearance of Dr. Penelope Blake (Samantha Sloyan)." ] ], "gold": "Season 11 episode, How to Save a Life, is the episode that Derek from Grey's Anatomy gets in a car accident.", "prediction 1": "Derek Shepherd is a fictional character from Grey's Anatomy who has starred on the show since its inception. In season 11, Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington. He is able to hear and process auditory input, but unable to speak. At the time of his death, Meredith is pregnant with their third child. She gives birth to a daughter whom she names Ellis after her mother.\n", "prediction 2": "Doctor Who medical drama Grey's Anatomy character Derek Shepherd, played by Patrick Dempsey, gets into a car accident while attempting to help the victims of a car accident, which leads to his death. On April 23, 2015, episode 20, titled \"How to Save a Life,\" Derek is involved in a fatal car accident while driving to the airport for his final trip to Washington.", "prediction 3": "Derek is the lead on the American medical drama Grey's Anatomy. On the series, Derek is involved in a car accident in season 11, prior to his final trip to Washington. His head injury was not detected quickly enough by the interns on duty that night. Mayor Patel asks him to turn himself in, and he does just that, focusing on helping vulnerable victims of a car accident.", "prediction 4": "Derek is in a car accident on Grey's Anatomy, episode 293 of the season 11 episode 21, while attempting to help the victims of a car accident, which results in his going to the hospital over the speed limit, where the emergency room cannot provide proper treatment for his head injury, until a doctor arrives, and he is rushed to the hospital where he was later declared brain dead.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 295 }, { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 436 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Derek Shepherd is a fictional character from Grey's Anatomy. In \"How to Save a Life\", the twenty-first episode of \"Grey's Anatomy\" in season 11, Derek is involved in a car accident." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who won the 2018 andre the giant battle royale?", "passages": [ [ "Andr\u00e9 the Giant Memorial Battle Royal", "Big Show - a wrestler often compared to Andr\u00e9 due to his similar size and stature, and originally billed as Andr\u00e9's (storyline) son when he debuted in World Championship Wrestling in 1995 - won the match by last eliminating Damien Mizdow.", "At WrestleMania 32 on April 3, 2016, the third annual Andr\u00e9 the Giant Memorial Battle Royal was held on the main card with Baron Corbin last eliminating Kane to win the match, which was also notable for former NBA player Shaquille O'Neal entering as a surprise participant.", "The fourth annual Andr\u00e9 the Giant Memorial Battle Royal was held at WrestleMania 33 on April 2, 2017 as part of the Kickoff Show.", "The match was won by Mojo Rawley, who was assisted by his friend, NFL player Rob Gronkowski, in last eliminating Jinder Mahal to win.", "The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - as part of WrestleMania 34 on April 8, 2018.", "The match was won by Matt Hardy who eliminated Baron Corbin to win." ], [ "WrestleMania Women's Battle Royal", "WrestleMania Women's Battle Royal\n\nThe WrestleMania Women's Battle Royal is a professional wrestling battle royal held at WrestleMania by American professional wrestling promotion WWE.", "The inaugural battle royal was held during the WrestleMania 34 pre-show.", "The winner of the match receives the WrestleMania Women's Battle Royal Trophy.", "The match was originally named The Fabulous Moolah Memorial Battle Royal in honor of The Fabulous Moolah \u2013 billed as a pioneer of women's wrestling.", "However, her name was removed from the match after backlash from fans due to the controversy surrounding Moolah's past.", "This is the female counterpart to the Andr\u00e9 the Giant Memorial Battle Royal, which was introduced at WrestleMania XXX.", "On the March 12, 2018, episode of \"Raw\", WWE established The Fabulous Moolah Memorial Battle Royal in honor of Moolah, and that the first match would take place at WrestleMania 34 on April 8, with the winner receiving The Fabulous Moolah Memorial Trophy (made in the likeness of Moolah).", "After a controversy over their decision to honor Moolah, WWE changed the name to the \"WrestleMania Women's Battle Royal\".", "The trophy was subsequently renamed, and redesigned as a simple golden cup with tassels atop the trophy's base.", "The inaugural match was won by Naomi, after she last eliminated Bayley." ], [ "Andr\u00e9 the Giant Memorial Battle Royal", "Andr\u00e9 the Giant Memorial Battle Royal\n\nThe Andr\u00e9 the Giant Memorial Battle Royal is an annual namesake battle royal held at WrestleMania by the WWE promotion.", "The first memorial battle royal was held at WrestleMania XXX in 2014 and the winner was Cesaro.", "The match is named in honor of Andr\u00e9 the Giant - a WWE Hall of Fame wrestler who at over seven feet tall and weighing 500 pounds was known as \"The King of the Battle Royal\" due to winning a large majority of such matches he participated in.", "In 2018, a female counterpart to this match was established, which debuted at WrestleMania 34 - the WrestleMania Women's Battle Royal.", "On the March 10, 2014 episode of \"Raw\", WrestleMania XXX host Hulk Hogan announced that he was establishing the Andr\u00e9 the Giant Memorial Battle Royal in honor of Andr\u00e9's legacy that would take place at the event on April 6, with the winner receiving the Andr\u00e9 the Giant Memorial Trophy (made in the likeness of Andr\u00e9).", "Cesaro would win the match after eliminating Big Show using a body slam similar to the body slam Hogan used on Andr\u00e9 at WrestleMania III.", "At WrestleMania 31 on March 29, 2015, the second annual Andr\u00e9 the Giant Memorial Battle Royal took place at Levi's Stadium as part of the Kickoff Show (pre-show), establishing the match as a yearly tradition at WWE's marquee event." ] ], "gold": "In 2018 as part of the WrestleMania 34 Kickoff pre-show, Matt Hardy won the fifth annual Andr\u00e9 the Giant Memorial Battle Royal, while Naomi won the inaugural WrestleMania Women's Battle Royal. The WrestleMania Women's Battle Royal introduced at WrestleMania 34 is the female counterpart to the Andr\u00e9 the Giant Memorial Battle Royal that was introduced at WrestleMania 30.", "prediction 1": "The Andr\u00e9 the Giant Memorial Battle Royal is an annual namesake battle royal held at WrestleMania by the WWE promotion. The first memorial battle royal was held at WrestleMania XXX in 2014 and the winner was Cesaro. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - as part of WrestleMania 34 on April 8, 2018. The match was won by Matt Hardy who eliminated Baron Corbin to win. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - the match was won by Big Show by last eliminating Damien Mizdow.", "prediction 2": "The Andr\u00e9 the Giant Memorial Battle Royal is an annual namesake battle royal held at WrestleMania by the WWE promotion. The first memorial battle royal was held at WrestleMania XXX in 2014 and the winner was Cesaro. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - as part of WrestleMania 34 on April 8, 2018. The match was won by Matt Hardy, who eliminated Baron Corbin to win the match. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal was held at the venue where the original match occurred - the Superdome in New Orleans, Louisiana. The sixth annual Andr\u00e9 the Giant Memorial Battle Royal was held on April 7, 2019, with the winner being the legendary WWE Hall of Fame wrestler, who would win the match by eliminating Big Show.", "prediction 3": "The Andr\u00e9 the Giant Memorial Battle Royal is an annual namesake battle royal held at WrestleMania by the WWE promotion. The first memorial battle royal was held at WrestleMania XXX in 2014 and the winner was Cesaro. In 2018, a female counterpart to this match was established, which debuted at WrestleMania 34 - the Andr\u00e9 the Giant Memorial Battle Royal. The winner of this female counterpart to this match was Naomi. The winner of this male counterpart was Cesaro.", "prediction 4": "The 2018 Andr\u00e9 the Giant Memorial Battle Royal is an annual namesake battle royal held at WrestleMania by the WWE promotion. The first memorial battle royal was held at WrestleMania XXX in 2014 and the winner was Cesaro. The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - as part of WrestleMania 34 on April 8, 2018. The match was won by Matt Hardy who eliminated Baron Corbin to win the match.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 370 }, { "error type": "Irrelevant", "explanation": "", "start": 450, "end": 485 }, { "error type": "Redundant", "explanation": "The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana - as part of WrestleMania 34 on April 8, 2018. ", "start": 486, "end": 641 }, { "error type": "Redundant", "explanation": "The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place at the venue where the original match occurred - the Superdome in New Orleans, Louisiana. ", "start": 642, "end": 796 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 799, "end": 863 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "The fifth annual Andr\u00e9 the Giant Memorial Battle Royal took place as part of WrestleMania 34 on April 8, 2018. The match was won by Matt Hardy. In 2018, a female counterpart to this match was established, which debuted at WrestleMania 34 - the WrestleMania Women's Battle Royal. The inaugural match was won by Naomi." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "When does trivium's new album come out?", "passages": [ [ "Trivium discography", "Trivium discography\n\nThe discography of Trivium, an American heavy metal band, consists of eight studio albums, one compilation album, one extended play, two demo albums, 32 singles and 26 music videos.", "Formed in Orlando, Florida in 1999, the group's first recording lineup included vocalist and guitarist Matt Heafy, bassist Brent Young and drummer Travis Smith, who together released \"Ember to Inferno\" on Lifeforce Records in 2003.", "After the addition of guitarist Corey Beaulieu and new bassist Paolo Gregoletto in place of Young, the band signed with Roadrunner Records and released \"Ascendancy\" in 2005, which reached number 151 on the US \"Billboard\" 200.", "It also reached number 79 on the UK Albums Chart and was certified gold by the British Phonographic Industry (BPI).", "\"The Crusade\" followed in 2006, peaking at number 25 on the \"Billboard\" 200 and number 7 on the UK Albums Chart.", "The album's second single \"Anthem (We Are the Fire)\" reached number 40 on the UK Singles Chart and topped the UK Rock & Metal Singles Chart, while its third single \"The Rising\" was the band's first to register on the \"Billboard\" Hot Mainstream Rock Tracks chart, reaching number 32." ], [ "Trivium (band)", "Corey Beaulieu defended the band's decision regarding changing drummers in an interview.", "The replacement Alex Bent, formerly of Battlecross, was announced on January 23.", "In April 2017 Corey Beaulieu stated that there obviously will be a new album, but didn't mention any schedule for recording, as the band is going through a process of discussion what the game plan is.", "On July 26, 2017, the band began teasing on their web page with the message \"VIII.", "I. \", indicating the date \"August 1\".", "On August 1, 2017, the band released the new single \"The Sin and the Sentence\", accompanied with a music video for their forthcoming new album, which aimed to be released later that year.", "To promote the album, the band announced a co-headlining North American tour with Arch Enemy in fall 2017 with While She Sleeps and Fit for an Autopsy as support acts.", "On August 24, the band released the second single \"The Heart From Your Hate\" and revealed the tracklisting and release date of their new album.", "\"The Sin and the Sentence\" released on October 20, 2017, and was received positively by both fans and critics alike." ] ], "gold": "The discography of Trivium, an American heavy metal band, consists of nine studio albums, one extended play, two demo albums, 40 singles and 31 music videos. Their album \"Silence in the Snow\" came out on October 2, 2015. Their album \"Ember to Inferno: Ab Initio\" came out on December 2, 2016. Their album \"The Sin and the Sentence\" came out on October 20, 2017. ", "prediction 1": "The discography of Trivium, an American heavy metal band, consists of eight studio albums, one compilation album, one extended play, two demo albums, 32 singles and 26 music videos. Trivium's new album, VIII. I, came out on August 1, 2017.", "prediction 2": "The discography of Trivium, an American heavy metal band, consists of eight studio albums, one compilation album, one extended play, two demo albums, 32 singles and 26 music videos. Formed in Orlando, Florida in 1999, the group's first recording lineup included vocalist and guitarist Matt Heafy, bassist Brent Young and drummer Travis Smith, who together released \"Ember to Inferno\" on Lifeforce Records in 2003. In 2017, the band released the new single \"The Sin and the Sentence\", accompanied with a music video for their forthcoming new album, which aimed to be released later that year.", "prediction 3": "Trivium's new album came out on October 20, 2017, and was received positively by both fans and critics alike.", "prediction 4": "Trivium's new album came out on October 20, 2017. The band's previous two albums have come out on different dates. Trivium's first album came out on April 1, 2005. The band also released an extended play and two demo albums.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 182, "end": 239 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The discography of Trivium, an American heavy metal band, consists of eight studio albums, one compilation album, one extended play, two demo albums, 32 singles and 26 music videos. Their album \"The Sin and the Sentence\" came out on October 20, 2017." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does grey's season 14 episode 13 air?", "passages": [ [ "Grey's Anatomy (season 14)", "Grey's Anatomy (season 14)\n\nThe fourteenth season of the American television medical drama \"Grey's Anatomy\" was ordered on February 10, 2017, by American Broadcasting Company (ABC), and premiered on September 28, 2017 with a special two-hour premiere.", "The season consists of 24 episodes, with the season's seventh episode marking the 300th episode for the series overall.", "The season is produced by ABC Studios, in association with Shondaland Production Company and The Mark Gordon Company; the showrunners being Krista Vernoff and William Harper.", "The fourteenth season is the first not to feature Jerrika Hinton as Dr. Stephanie Edwards since her introduction in the ninth season, following her departure at the conclusion of the previous season.", "The season marks the last appearance of Martin Henderson, Jason George, Jessica Capshaw, and Sarah Drew as series regulars, as well as the first appearance of Jaina Lee Ortiz as Andy Herrera, the lead character of \"Grey's Anatomy\"'s second spin-off series, \"Station 19\".", "On April 20, 2018, ABC officially renewed \"Grey's Anatomy\" for a network primetime drama record-tying fifteenth season.", "The season follows the story of surgical residents, fellows, and attendings as they experience the difficulties of the competitive careers they have chosen." ], [ "Famous in Love", "Freeform renewed the series for a second season on August 3, 2017.", "The table read for the second season started on October 30, 2017.", "The second season premiered on Freeform on April 4, 2018.", "On June 26, 2018, it was reported that Freeform had decided to cancel the series after Hulu declined to contribute more money towards the production of a third season.", "Clashes between actress Bella Thorne and showrunner I. Marlene King were also cited as part of the reason for the cancellation.", "On her Twitter account, King denied the claim of a feud between her and Thorne, and Freeform stated the show had yet to be cancelled.", "On June 29, Freeform officially cancelled the series.", "Romeo Miller was cast as Pablo $$ in a recurring role for the second season.", "Sofia Carson appeared in multiple episodes of the second season as Sloane, the daughter of a movie mogul.", "The entire first season was released on digital platforms, such as OnDemand, the Freeform App and website, and Hulu, on April 18, 2017.", "The second season returned with a two-hour premiere on Freeform on April 4, 2018.", "It aired in Canada on E! on April 8, 2018, with new episodes set to air every Sunday.", "In the United Kingdom, it airs exclusively on Amazon Prime Video with new episodes every Thursday." ] ], "gold": "The medical drama show Grey's Anatomy first aired the 13th episode of its 14th season, the 306th episode overall, on ABC on Thursday, March 1, 2018 at 8:00 p.m.", "prediction 1": "Grey's Anatomy is an American television medical drama series. The fourteenth season was ordered on February 10, 2017, by American Broadcasting Company (ABC), and premiered on September 28, 2017 with a special two-hour premiere. Episode 13 of season 14 originally aired on September 13, 2017. Episode 13 of season 14 originally aired on September 15, 2017.", "prediction 2": "Grey's Anatomy is an American television medical drama series, and its fourteenth season airs an episode every Sunday in the United States, and Canada. Season 14 episode 13 originally aired on September 28, 2017, and it was re-aired in the United Kingdom on October 1, 2019.", "prediction 3": "Grey's Anatomy, an American television medical drama, is currently in its fourteenth season. Episode 13 originally aired on September 28, 2017 and aired on November 7, 2017.", "prediction 4": "Grey's Anatomy is an American television medical drama series created and produced by ABC Studios and produced by Shondaland Production Company and The Mark Gordon Company. The thirteenth episode of the fourteenth season aired on September 28, 2017 and the thirteenth episode of the fourteenth season aired on Wednesday, September 29, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 228 }, { "error type": "Unverifiable", "explanation": "", "start": 229, "end": 292 }, { "error type": "Unverifiable", "explanation": "", "start": 293, "end": 356 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 0, 2, 0, 1 ] }, { "question": "Who is the owner of first bank in nigeria?", "passages": [ [ "First Bank of Nigeria", "First Bank of Nigeria\n\nFirst Bank of Nigeria, sometimes referred to as FirstBank, is a Nigerian multinational bank and financial services company headquartered in Lagos.", "It is the biggest bank in Nigeria by total deposits and gross earnings.", "It operates a network of over 750 business locations across Africa, the United Kingdom and representative offices in Abu Dhabi, Beijing and Johannesburg set up to capture trade-related business between geographies.", "The bank specialises in retail banking and has the largest retail client base in Nigeria.", "In 2015, \"The Asian Banker\" awarded FirstBank the Best Retail Bank in Nigeria award for the fifth consecutive year.", "The Nigerian banking business operates nationally, with an active customer base of over 10 million, and employs over 7,000 staff.", "FirstBank operates along four key Strategic Business Units (SBUs) \u2013 Retail Banking, Corporate Banking, Commercial Banking and Public Sector Banking.", "It was previously structured as an operating holding company before the implementation of a non-operating Holding Company structure (FBN Holdings) in 2011/2012.", ", the Bank had assets totalling NGN3.9 trillion ($12.2B according to 2017 exchange rates).", "The Bank's profit before tax for the twelve months ending 31 December 2015 was approximately NGN10.2 billion.", "FirstBank\u2019s ownership is diversified, with over 1.3 million shareholders." ], [ "First Bank of Nigeria", "He retired effective from 31 December 2015 and was succeeded by Urum Kalu Eke Mfr (former Executive Director, South of FirstBank) as Group Managing Director of the Holding Company.", "The shares of FBNHoldings are listed on The Nigerian Stock Exchange.", "The business groups of FBNHoldings are:\n\n\nAs at 31 December 2015, the Group closed with gross earnings of N505.2 billion, total assets of N4.2 trillion and N578.8 billion in total equity.", "FirstBank commenced business in 1894 in what was then the British colony of Nigeria, as the Bank of British West Africa.", "The bank originally served British shipping and trading agencies in Nigeria.", "The founder, Alfred Lewis Jones, was a shipping magnate who originally had a monopoly on importing silver currency into West Africa through his Elder Dempster shipping company.", "According to its founder, without a bank economies were reduced to using barter and a wide variety of mediums of exchange, leading to unsound practices.", "A bank could provide a secure home for deposits and also a uniform medium of exchange.", "The bank primarily financed foreign trade, but did little lending to indigenous Nigerians, who had little to offer as collateral for loans.", "After Nigeria's independence in 1960, the Bank began to extend more credit to indigenous Nigerians." ] ], "gold": "First Bank of Nigeria is wholly owned by FBN Holdings PLC., which in itself has diversified ownership, with over 1.3 million shareholders. Originally, First Bank of Nigeria was founded by Alfred Lewis Jones, a British shipping magnate, in what was then British controlled areas such as West Africa. ", "prediction 1": "First Bank of Nigeria, sometimes referred to as FirstBank, is a Nigerian multinational bank and financial services company headquartered in Lagos. It is the biggest bank in Nigeria by total deposits and gross earnings. It operates a network of over 750 business locations across Africa, the United Kingdom and representative offices in Abu Dhabi, Beijing and Johannesburg set up to capture trade-related business between geographies.", "prediction 2": "FirstBank of Nigeria, sometimes referred to as FirstBank, is a Nigerian multinational bank and financial services company headquartered in Lagos. It is the biggest bank in Nigeria by total deposits and gross earnings. It operates a network of over 750 business locations across Africa, the United Kingdom and representative offices in Abu Dhabi, Beijing and Johannesburg set up to capture trade-related business between geographies.", "prediction 3": "FirstBank of Nigeria, sometimes referred to as FirstBank, is a multinational bank and financial services company headquartered in Lagos. The Bank is the biggest bank in Nigeria by total deposits and gross earnings. In 2011, FBN Holdings was created to be the holding company for FirstBank. In 2012, FBN Holdings was created to be the holding company for FirstBank.", "prediction 4": "FirstBank of Nigeria is a Nigerian multinational bank and financial services company headquartered in Lagos and is the biggest bank in Nigeria by total deposits and gross earnings. The bank specialises in retail banking and has the largest retail client base in Nigeria. The founder of the bank Alfred Lewis Jones founded the bank in 1894 as the Bank of British West Africa. He retired effective from 31 December 2015 and was succeeded by Urum Kalu Eke Mfr as Group Managing Director of the Holding Company.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 433 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "FirstBank\u2019s ownership is diversified, with over 1.3 million shareholders. The founder, Alfred Lewis Jones, was a shipping magnate who originally had a monopoly on importing silver currency into West Africa through his Elder Dempster shipping company." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who hosted new years eve in new orleans?", "passages": [ [ "Dick Clark's New Year's Rockin' Eve", "That year, \"New Year's Rockin' Eve\" was once again the highest rated of the New Year's Eve specials across the major networks; for the late-night portion, while overall household viewership was down by 7%, ratings in the 18-49 demographic were up by 3%.", "The 2017 edition expanded to feature coverage of New Year's Eve festivities in New Orleans hosted by Lucy Hale, with performances by Jason Derulo and Panic!", "at the Disco from the Sugar Bowl's Allstate Fan Fest concert, and Jackson Square's fleur-de-lis drop at midnight in the Central Time Zone.", "While household ratings for the late-night portion of the broadcast were down by 9% in comparison to 2016, \"New Year's Rockin' Eve\" was once again the highest-rated New Year's special across the major networks, with a 9.0 rating in metered markets, and a 6.8 rating among adults 18-49.", "Mariah Carey was one of the Times Square headliners for the 2017 edition.", "Her performance was notably marred by technical issues; when opening with \"Emotions\", Carey remarked throughout the song that she was unable to hear her backing track." ], [ "Dick Clark's New Year's Rockin' Eve", "\"New Year's Rockin' Eve\" is primarily broadcast from Times Square in New York City, providing coverage of the New Year's Eve festivities held there, culminating with the long-running ball drop leading to midnight and the New Year.", "The special also features pre-recorded segments featuring performances by popular musicians; since the 2017\u201318 edition, these concert segments (branded since the 2014-15 edition as the \"\"Billboard\" Hollywood Party\") have been presented from a studio in Los Angeles by Ciara.", "Since the 2016\u201317 edition, Lucy Hale has hosted additional coverage and performances from New Orleans.", "Since 2005, Ryan Seacrest has hosted the live show outside in Times Square (along with a celebrity correspondent, Jenny McCarthy since 2011, providing additional reports from attendees).", "From his return and until his death, Dick Clark hosted a limited number of segments from Times Square Studios approaching midnight, but still participated in the countdown and his tradition of kissing his wife, Kari Wigton, at midnight." ] ], "gold": "Lucy Hale served as a correspondent in New Orleans and co-hosted with Ryan Seacrest in Times Square for the annual New Year's Eve television special Dick Clark's New Year's Rockin' Eve (2016\u2013present), making her the first millennial actress to co-host the Times Square segments. In 2019, it was announced that Lucy Hale would serve as Times Square correspondent and that Billy Porter of the FX series \"Pose\" hosted the New Orleans segments in place of Hale.", "prediction 1": "On New Year's Eve, most television programs broadcast from Times Square in New York City, the live show covers the New Year's Eve festivities held there culminating with the long-running ball drop leading to midnight and the New Year. Since 2005, Ryan Seacrest has hosted the live show outside in Times Square. On New Year's Rockin' Eve in New Orleans, Lucy Hale hosted the live show outside in Times Square.", "prediction 2": "\"New Year's Rockin' Eve\" is primarily broadcast from Times Square in New York City, providing coverage of the New Year's Eve festivities held there, culminating with the long-running ball drop leading to midnight and the New Year. Since 2005, Ryan Seacrest has hosted the live show outside in Times Square. From 2016\u201317 edition, Lucy Hale hosted additional coverage and performances from New Orleans. Jason Derulo and Panic! at the Disco from the Sugar Bowl's Allstate Fan Fest concert.", "prediction 3": "The New Year's Rockin' Eve special is primarily broadcast from Times Square in New York City, providing coverage of the New Year's Eve festivities held there, culminating with the long-running ball drop leading to midnight and the New Year. Since 2005, Ryan Seacrest has hosted the live show outside in Times Square, with a celebrity correspondent, Jenny McCarthy since 2011.", "prediction 4": "\"New Year's Rockin' Eve\" is primarily broadcast from Times Square in New York City, providing coverage of the New Year's Eve festivities held there, culminating with the long-running ball drop leading to midnight and the New Year. Since 2005, Ryan Seacrest has hosted the live show outside in Times Square along with a celebrity correspondent, Jenny McCarthy since 2011, providing additional reports from attendees. In 2017, Lucy Hale hosted coverage of New Year's Eve festivities in New Orleans, with performances by Jason Derulo and Panic! at the Disco from the Sugar Bowl's Allstate Fan Fest concert, and Jackson Square's fleur de Lis drop at midnight in the Central Time Zone.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "On New Year's Eve, most television programs broadcast from Times Square in New York City, the live show covers the New Year's Eve festivities held there culminating with the long-running ball drop leading to midnight and the New Year. Since 2005, Ryan Seacrest has hosted the live show outside in Times Square. On New Year's Rockin' Eve in New Orleans, Lucy Hale hosted the live show outside in Times Square." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is alison's moms name in pll?", "passages": [ [ "Mary Drake", "Mary Drake\n\nMary Drake is a fictional character created by I. Marlene King and portrayed by Andrea Parker in the American television series \"Pretty Little Liars\".", "\"Pretty Little Liars\" is a television adaptation of the novel series of the same name written by Sara Shepard, in which the antagonist Alison DiLaurentis has an identical twin sister, Courtney DiLaurentis.", "It is believed that Mary is the on-screen counterpart of Courtney, though her recent characterization is more in line with Alison.", "The character makes her first official introduction during the sixth-season finale \"Hush, Hush, Sweet Liars\".", "The Liars discover that Mary is Jessica DiLaurentis' identical twin sister, a former patient at Radley Sanitarium who is Charlotte's biological mother.", "In \"The DArkest Knight\", Drake is also revealed to be Spencer Hastings' biological mother.", "During \"Till Death Do Us Part\", the elusive A.D. is revealed to be Alex Drake, Spencer's younger identical twin sister.", "Alex believed the Liars knew who was accountable for Charlotte's murder and was also set on physically replacing Spencer due to being jealous of the life that she had.", "Andrea Parker had portrayed Jessica DiLaurentis since the second season, thus placing her as the actor behind Mary Drake, as Mary is Jessica's identical twin." ], [ "Pretty Little Liars", "Pretty Little Liars\n\nPretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard.", "The series follows the lives of four girls whose clique falls apart after the disappearance of their leader.", "One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named \"A\" who threatens to expose their deepest secrets.", "The series features an ensemble cast, headed by Troian Bellisario as Spencer Hastings, Lucy Hale as Aria Montgomery, Ashley Benson as Hanna Marin, Shay Mitchell as Emily Fields, Sasha Pieterse as Alison DiLaurentis and Janel Parrish as Mona Vanderwaal.", "The series premiered on June 8, 2010 on Freeform, formerly known as ABC Family, and ended on June 27, 2017.", "After an initial order of 10 episodes, ABC Family ordered an additional 12 episodes on June 28, 2010.", "The ratings success of the first 10 episodes prompted the book series to be extended beyond the initial eight novels.", "Since its debut, the series has received mixed reviews from television critics, but remained a relative success for Freeform, garnering a large fandom, primarily on social media.", "On March 26, 2013, a spin-off series was announced, titled \"Ravenswood\", but was canceled after one season." ] ], "gold": "Pretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard. Jessica DiLaurentis (n\u00e9e Drake) is Alison, and Jason's mother and Charlotte's adoptive mother, who spearheaded a charity fashion show in Alison's memory. Jessica DiLaurentis was played by Anne Marie DeLuise and Andrea Parker. Andrea Parker had portrayed Jessica DiLaurentis since the second season.", "prediction 1": "In the American television show Pretty Little Liars, Alison DiLaurentis has an identical twin sister named Courtney DiLaurentis, who is played by Andrea Parker in the series. In the novel series Pretty Little Liars written by Sara Shepard, Alison is played by Sasha Pieterse.", "prediction 2": "Pretty Little Liars is an American teen drama mystery thriller television series in which the antagonist Alison DiLaurentis has an identical twin sister, Courtney DiLaurentis. In the show, Courtney was portrayed as Alison's mother in the first two seasons. In season 6, a flashback to the show's origins, Alison is introduced as Courtney's twin sister Jessica DiLaurentis.", "prediction 3": "Pretty Little Liars is an American teen drama mystery thriller television series that is loosely based on the novel series of the same name written by Sara Shepard. In the series, Alison's mom is Jessica DiLaurentis. In the television adaptation, Courtney DiLaurentis is played by Andrea Parker and Sarah Peet as Courtney's twin sister.", "prediction 4": "Pretty Little Liars is an American teen drama mystery television series, loosely based on the novel series of the same name written by Sara Shepard, in which the antagonist Alison DiLaurentis has an identical twin sister, Courtney DiLaurentis. In the show, Sarah Pieterse plays Courtney's mother, while Andrea Parker plays Alison's mother.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 275 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The American television show Pretty Little Liars, created by I. Marlene King, is based on the novel series Pretty Little Liars written by Sara Shepard." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When does the rockefeller tree get put up?", "passages": [ [ "Rockefeller Center Christmas Tree", "The first Christmas tree at Rockefeller Center was erected in 1931, during the Depression-era construction of Rockefeller Center, when workers decorated a smaller balsam fir with \"strings of cranberries, garlands of paper, and even a few tin cans\" on Christmas Eve.", "With the lighting of the first official tree two years later, the tree became what Rockefeller Center dubbed \"a holiday beacon for New Yorkers and visitors alike.\"", "A skating rink was opened below the tree in the plaza in 1936.", "Since then, the Rockefeller Center Christmas Tree has been a yearly tradition.", "Workers pooled their money for that unlit tree, with the garlands made by workers' families.", "According to Rockefeller Center's website, the tree was \"from the beginning ... a gathering place and reflection of what was happening in the world around it.\"", "World War II ushered in simple, patriotic decorations, including red, white and blue unlit globes and painted wooden stars.", "In 1942, instead of one large tree, three more modest trees were raised, each decorated in one of the flag's colors.", "From 1944 until the war's end in 1945, the tree went unlit due to blackout regulations." ], [ "Rockefeller Center Christmas Tree", "Rockefeller Center Christmas Tree\n\nThe Rockefeller Center Christmas Tree is a large Christmas tree placed annually in Rockefeller Center, in Midtown Manhattan.", "The tree is erected in mid November and lit in a public ceremony in late November or early December.", "Since 1997, the lighting has been broadcast live, to hundreds of millions, on NBC's \"Christmas in Rockefeller Center\" telecast on a Wednesday after Thanksgiving.", "The broadcast features live entertainment and a tree lighting ceremony, where the tree is lit by the current Mayor of New York City and special guests.", "An estimated 125 million people visit the attraction each year.", "The tree, usually a Norway spruce tall, has been a national tradition each year since 1933.", "The 2018 Christmas Tree Lighting took place on November 28, 2018; the tree will remain on display until January 7, 2019.", "Trees are traditionally donated to Rockefeller Center, which in turn donates the lumber after display.", "Until his death in 2009, the late David Murbach, Manager of the Gardens Division of Rockefeller Center, scouted for the desired tree in upstate New York and surrounding states, and even Ottawa in Ontario, Canada.", "Erik Pauz\u00e9, Head Gardener at Rockefeller Center, looks for each year's Rockefeller Center Christmas tree.", "He visits nurseries throughout the tri-state area and looks for unique backyard trees.", "Trees are also submitted for consideration through Rockefeller Center's website." ] ], "gold": "The Rockefeller Center Christmas Tree is put in place in mid November and lit in a public ceremony on the Wednesday evening following Thanksgiving, continuing a tradition that has been practiced since 1931. The lighting of the tree has been broadcast live on NBC every year since 1997. ", "prediction 1": "The Rockefeller Center Christmas Tree is a large Christmas tree placed annually in Rockefeller Center, in Midtown Manhattan. The tree is erected in mid November and lit in a public ceremony in late November or early December. The 2018 Christmas Tree Lighting took place on November 28, 2018; the tree will remain on display until January 7, 2019.", "prediction 2": "Rockefeller Center Christmas Tree is a large Christmas tree placed annually in Rockefeller Center, in Midtown Manhattan. The tree is erected in mid November and lit in a public ceremony in late November or early December. The 2018 Christmas Tree Lighting took place on November 28, 2018; the tree will remain on display until January 7, 2019.", "prediction 3": "The Rockefeller Center Christmas Tree is a large Christmas tree placed annually in Rockefeller Center, in Midtown Manhattan. The tree is erected in mid November and lit in a public ceremony in late November or early December. Since 1997, the lighting has been broadcast live, to hundreds of millions, on NBC's \"Christmas in Rockefeller Center\" telecast on a Wednesday after Thanksgiving.", "prediction 4": "The Rockefeller Center Christmas Tree is a large Christmas tree placed annually in Rockefeller Center, in Midtown Manhattan. The tree is erected in mid November and lit in a public ceremony in late November or early December. In 2018, the tree was lit on November 28, 2018. In 2019, the tree will remain on display until January 7, 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 124 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 346 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Rockefeller Center Christmas Tree is erected in mid November and lit in a public ceremony in late November or early December. Since 1997, the lighting has been broadcast live, to hundreds of millions, on NBC's \"Christmas in Rockefeller Center\" telecast on a Wednesday after Thanksgiving." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who was islands in the stream written for?", "passages": [ [ "Islands in the Stream (song)", "Islands in the Stream (song)\n\n\"Islands in the Stream\" is a song written by the Bee Gees and sung by American country music artists Kenny Rogers and Dolly Parton.", "Named after the Ernest Hemingway novel, it was originally written for Marvin Gaye in an R&B style, only later to be changed for the Kenny Rogers album.", "It was released in August 1983 as the first single from Rogers' album \"Eyes That See in the Dark\".", "The song reached number one on the \"Billboard\" Hot 100 chart in the United States, giving both Rogers and Parton their second pop number-one hit (after Rogers' \"Lady\" in 1980 and Parton's \"9 to 5\" in 1981).", "It also topped the Country and Adult Contemporary charts.", "It has been certified Platinum by the Recording Industry Association of America for selling over two million physical copies in the US.", "In 2005 the song topped CMT's poll of the best country duets of all time; Parton and Rogers reunited to perform the song on the CMT special.", "Rogers and Parton went on to record a Christmas album together, and had an additional hit with their 1985 duet \"Real Love\".", "The song is sung in C major moderate 4/4 time, with Rogers and Parton alternating lead vocals.", "Their version features a key change from C major to A-flat major." ], [ "Islands in the Stream (novel)", "While on Bimini, Gerald and Sara Murphy, good friends of Hemingway, lost their young son, Baoth, to illness.", "Hemingway's grief for the loss is captured in letters to the Murphys.", "During WW II, Hemingway hunted for U-Boats aboard his boat \"Pilar\".", "His boat was outfitted with communications gear provided by the US Embassy in Havana." ], [ "Islands in the Stream (novel)", "This second act introduces us to a more cynical and introverted Hudson who spends his days on the island drinking heavily and doing naval reconnaissance for the US military aboard Hudson's yacht, converted to an auxiliary patrol boat.", "\"At Sea\", the final act, follows Hudson and a team of irregulars aboard their boat as they track and pursue survivors of a sunken German U-boat along the Jardines del Rey archipelago on the northern coast of Cuba.", "Hudson becomes intent on finding the fleeing Germans after he finds they massacred an entire village to cover their escape.", "The novel ends with a shoot-out and the destruction of the Germans in one of the tidal channels surrounding Cayo Guillermo.", "Hudson is presumably mortally wounded in the gun battle, although the ending is slightly ambiguous.", "During the chase, Hudson stops questioning the deaths of his children.", "This chapter rings heavily with influences of Hemingway\u2019s earlier work \"For Whom the Bell Tolls\".", "Hemingway used many of his real life experiences, friends, and relatives, to form his stories and base his characters on.", "Henry Strater, an American painter, spent the summer with Hemingway fishing on Bimini in 1935.", "He is shown in the adjacent picture standing next to what was believed to be a 1,000 pound Marlin that had been half eaten by sharks while Strater landed the fish." ] ], "gold": "Islands in the Stream is a song written by the Bee Gees and sung by American country music artists Kenny Rogers and Dolly Parton. Named after the Ernest Hemingway novel, the song was originally written for Marvin Gaye in an R&B style. In the Islands in the Stream novel, Hemingway used many of his real life experiences, friends and relatives to form his stories and base his characters. The deaths in Hemingway's Islands in the Stream novel were influenced by Gerald and Sara Murphy, who were good friends of Hemingway and lost their young son, Baoth, to illness. Hemingway's grief for this loss is captured in letters to the Murphys. Additionally, in the Islands in the Stream novel, Act III was inspired by the fact that during World War II, Hemingway hunted for U-boats aboard his boat Pilar. His boat was outfitted with communications gear provided by the US Embassy in Havana. In the Islands in the Stream novel, Hemingway also based the character of Thomas Hudson on Henry \"Mike\" Strater, an American painter, who spent the summer with Hemingway fishing on Bimini in 1935.", "prediction 1": "Islands in the Stream is a song written by the Bee Gees and sung by American country music artists Kenny Rogers and Dolly Parton. Named after the Ernest Hemingway novel, it was originally written for Marvin Gaye in an R&B style, only later to be changed for the Kenny Rogers album. It was released in August 1983 as the first single from Rogers' album \"Eyes That See in the Dark\". The song reached number one on the Billboard Hot 100 chart in the United States, giving both Rogers and Parton their second pop number-one hits. It also topped the Country and Adult Contemporary charts. The song reached number one on the Billboard Hot 100 chart in the United States, giving Rogers and Parton their second pop number-one hits.", "prediction 2": "Islands in the Stream is a song written by the Bee Gees and sung by American country music artists Kenny Rogers and Dolly Parton. It was originally written for Marvin Gaye in an R&B style, only later to be changed for the Kenny Rogers album. The song reached number one on the Billboard Hot 100 chart in the United States, giving both Rogers and Parton their second pop number-one hit. During WW II, Ernest Hemingway hunted for U-Boat survivors of a sunken German U-boat along the Jardines del Rey archipelago on the northern coast of Cuba.", "prediction 3": "The 1983 song Islands in the Stream was originally written for Marvin Gaye in an R&B style, only later to be changed for the Kenny Rogers album. It was released in August 1983 as the first single from Rogers' album Eyes That See in the Dark. The novel Islands in the Stream was originally written for Ernest Hemingway and his friends Gerald and Sara Murphy, who lost their son, Baoth, to illness. The novel's second act introduces us to a more cynical and introverted Hudson who spends his days on the island drinking heavily and doing naval reconnaissance for the US military aboard Hudson and a team of irregulars aboard their boat as they track and pursue survivors of a sunken German U-boat along the Jardines del Rey archipelago on the northern coast of Cuba.", "prediction 4": "In the 1983 film Islands in the Stream, Ernest Hemingway plays Marvin Gaye and in the 1983 song, Islands in the Stream, it is sung by American country music artists Kenny Rogers and Dolly Parton. It was originally written for Marvin Gaye in an R&B style, but was changed for the Kenny Rogers album. In the 1935 novel Islands in the Stream, Hemingway is playing Marvin Gaye, and the song was originally written for him. In the novel Islands in the Stream, it is Hemingway's friend and Hemingway played by a man named after the Ernest Hemingway, it was originally written for Marvin Gaye in an R&B style, only later to be changed for the Kenny Rogers and Parton.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 229, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 381, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 583 }, { "error type": "Redundant", "explanation": "The song reached number one on the Billboard Hot 100 chart in the United States, giving both Rogers and Parton their second pop number-one hits.", "start": 584, "end": 723 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "Islands in the Stream is a song written by the Bee Gees and sung by American country music artists Kenny Rogers and Dolly Parton. Named after the Ernest Hemingway novel, it was originally written for Marvin Gaye in an R&B style. In the Islands in the Stream novel, Hemingway used many of his real life experiences, friends and relatives to form his stories and base his characters on. The deaths in the novel were influenced by Gerald and Sara Murphy, who were good friends of Hemingway and lost their young son, Baoth, to illness. Hemingway's grief for this loss is captured in letters to the Murphys. During WW II, Hemingway hunted for U-Boats aboard his boat \"Pilar\". His boat was outfitted with communications gear provided by the US Embassy in Havana. Additionally, the novel also introduces a more cynical and introverted Hudson who spends his days on the island drinking heavily and doing naval reconnaissance for the US military aboard Hudson's yacht, converted to an auxiliary patrol boat. Besides, Henry Strater, an American painter, spent the summer with Hemingway fishing on Bimini in 1935." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where did the movie amityville horror take place?", "passages": [ [ "The Amityville Horror (2005 film)", "The Amityville Horror (2005 film)\n\nThe Amityville Horror is a 2005 American horror film directed by Andrew Douglas and written by Scott Kosar.", "It is a based on the novel The Amityville Horror by Jay Anson and is a remake of the 1979 film The Amityville Horror.", "It is the ninth installment of the \"Amityville\" film series, which documents the alleged experiences of the Lutz family after they moved into a house on Long Island where Ronald DeFeo Jr. murdered six members of his family in 1974.", "In 1974, Ronald DeFeo Jr. murdered his family at their house at 112 Ocean Avenue in Amityville, New York.", "He claimed that he was persuaded to kill them by voices he heard in the house.", "One year later, married couple George and Kathy Lutz move into the house along with Kathy's three children from a previous marriage, Billy, Michael, and Chelsea.", "The family soon begins experiencing paranormal events in the house.", "Chelsea claims that she has befriended a girl named Jodie, a name belonging to one of the murdered DeFeo children.", "One night the couple decide to go out, and they hire a babysitter to watch the three kids.", "When the babysitter, Lisa, arrives, they come to find out that she had previously been hired to babysit for the DeFeos." ], [ "The Amityville Horror (2005 film)", "Although the film is set on Long Island, it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin.", "The house used is a real 1800's home that was temporarily converted to add the famous \"eye\" windows.", "The house is in Salem at 27618 Silver Lake Road.", "The movie facade cost $60,000.", "After production the movie facade remained on the house for a while and was eventually carefully removed.", "The famous \"evil eye\" windows were preserved in sections of the walls which still have the movie bedroom wallpaper on the inside and siding with old looking movie paint on the outside.", "The windows were in good shape but were \"aged\" to match the house using peeling paint.", "In 2017 an estate sale was held at the movie mansion and the famous \"eye\" windows, which had been in the attic for more than a decade, were sold.", "The buyer lives in the same neighborhood and has the windows on display.", "MGM claimed the remake was based on new information uncovered during research of the original events, but George Lutz later claimed nobody ever spoke to him or his family about the project." ], [ "The Amityville Horror (1979 film)", "The Amityville Horror (1979 film)\n\nThe Amityville Horror is a 1979 American supernatural horror film based on Jay Anson's book of the same name (1977).", "Directed by Stuart Rosenberg, it features James Brolin and Margot Kidder as a young couple who purchase a home haunted by combative supernatural forces.", "The story is based on the alleged experiences of the Lutz family who bought a new home in Amityville, New York where a mass murder had been committed the year before.", "It is the first film based on the Amityville horror.", "Upon its release in the summer of 1979, \"The Amityville Horror\" was a major commercial success for American International Pictures, grossing over $80 million in the United States and going on to become one of the highest-grossing independent films of all time.", "It received mostly negative reviews from critics, though the film has been contemporarily noted by film scholars as a classic of the horror genre.", "The film was nominated for an Academy Award for Best Original Score by composer Lalo Schifrin and Kidder also earned a Saturn Award nomination for Best Actress.", "A remake was produced in 2005.", "In the early morning hours on November 13, 1974, Ronald DeFeo Jr. murders his entire family with a shotgun at their home in Amityville, New York." ] ], "gold": "The Amityville Horror is a 1979 American supernatural horror film directed by Stuart Rosenberg and starring James Brolin and Margot Kidder as a young couple who purchase a home haunted by combative supernatural forces. It was filmed in Toms River, New Jersey and Los Angeles and takes place in Amityville, New York. The 2005 film, The Amityville Horror, is a remake of the 1979 film from the same name. It was filmed in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin.", "prediction 1": "The Amityville Horror is a 1979 American supernatural horror film based on Jay Anson's book of the same name. It's set on Long Island, but it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. Although the movie is set on Long Island, it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. The house used is a real 1800's home that was temporarily converted to add the famous \"eye\" windows.", "prediction 2": "There are several movies that are based on the Amityville Horror. The 1979 film, The Amityville Horror, is a supernatural horror film directed by Stuart Rosenberg and set in Amityville, New York. The 2005 film, The Amityville Horror, is a remake of the 1979 film. The Amityville Horror is a based on the book The Amityville Horror by Jay Anson and is a remake of the 1979 film. The Amityville Horror 2005 takes place at the home of George and Kathy Lutz. While the movie is set on Long Island, it was shot in Chicago, Antioch, Buffalo Grove, Buffalo Grove, and Fox Lake, Illinois.", "prediction 3": "The Amityville Horror is a 1979 American supernatural horror film based on Jay Anson's book of the same name, set in a house on Long Island where Ronald DeFeo Jr. murdered his family at their house at 112 Ocean Avenue in Amityville, New York. Although the film is set on Long Island, it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. In 2005, Andrew Douglas directed a remake of the 1979 film, which was set in Chicago, Antioch, Buffalo Grove, Wisconsin, and in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. The house used is a real 1800's home that was temporarily converted to add the famous \"eye\" windows.", "prediction 4": "The Amityville Horror is a 1979 American supernatural horror film directed by Stuart Rosenberg and based on Jay Anson's book of the same name. It is set in Amityville, New York, where Ronald DeFeo Jr. murdered his family in 1974. The Amityville Horror is the first film based on the Amityville horror. Although the film is set on Long Island, it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. The house used is a real 1800's home that was temporarily converted to add the famous \"eye\" windows. The house used is a real 1800's home that was temporarily converted to add the famous \"evil eye\" windows. The famous \"evil eye\" windows were preserved in sections of the house and were painted on the walls.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " It's set on Long Island, but it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. ", "start": 252, "end": 406 }, { "error type": "Irrelevant", "explanation": "", "start": 407, "end": 507 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Amityville Horror is a 1979 American supernatural horror film directed by Stuart Rosenberg and starring James Brolin and Margot Kidder as a young couple who purchase a home haunted by combative supernatural forces. The 2005 film, The Amityville Horror, is a remake of the 1979 film from the same name. It's set on Long Island, but it was shot in Chicago, Antioch, Buffalo Grove, and Fox Lake, Illinois, and in Salem and Silver Lake, Wisconsin. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who plays ben weston on days of our lives?", "passages": [ [ "Ben Weston (Days of Our Lives)", "Ben Weston (Days of Our Lives)\n\n", "Ben Weston is a fictional character from \"Days of Our Lives\", an American soap opera on the NBC network, most notably portrayed by Robert Scott Wilson.", "The role was originated by Justin Gaston in 2014 when Ben was introduced as the new love interest of Abigail Deveraux (Kate Mansi) and he is later revealed to be the estranged brother of Jordan Ridgeway (Chrishell Stause).", "Soon after, Wilson was hired as a recast and the writers began exploring the character's dark past with the introduction of his abusive criminal father Clyde Weston (James Read).", "In 2015, the romantic triangle between Ben, Abigail and Chad DiMera (Billy Flynn) culminates in Ben becoming a serial killer, known as the \"Necktie Killer,\" claiming several victims, including legacy character Will Horton (Guy Wilson).", "Wilson vacated the role in late 2015 and would reprise the role for multiple guest stints.", "In 2016, he returned to the role to help facilitate the departure of Kate Mansi as Abigail.", "Wilson returned again in 2017 when Will was reintroduced with former cast member, Chandler Massey in the role.", "Wilson made a one episode guest appearance on May 4, 2018 and returned to the show as a series regular on June 1, 2018." ] ], "gold": "Ben Weston is a fictional character from \"Days of Our Lives\", an American soap opera on the NBC network. The role was originally played by Justin Gaston in 2014 when Ben was introduced as a new love interest for the character of Abigail Deveraux. But, soon after, the character was recast and the role fell into the hands of Robert Scott Wilson.", "prediction 1": "Ben Weston is a fictional character from Days of Our Lives, an American soap opera on the NBC network, most notably portrayed by Robert Scott Wilson. The role was originated by Justin Gaston in 2014 when Ben was introduced as the new love interest of Abigail Deveraux (Kate Mansi) and he is later revealed to be the estranged brother of Jordan Ridgeway (Chrishell Stause). Soon after, Wilson was hired as a recast and the writers began exploring the character's dark past with the introduction of his abusive criminal father Clyde Weston (James Read).", "prediction 2": "Ben Weston is a fictional character from \"Days of Our Lives\", an American soap opera on the NBC network. The role was originated by Justin Gaston in 2014 when Ben was introduced as the new love interest of Abigail Deveraux (Kate Mansi). Soon after, Robert Scott Wilson was hired as a recast and the writers began exploring the character's dark past with the introduction of his abusive criminal father Clyde Weston (James Read). In 2015, the romantic triangle between Ben, Abigail DiMera (Billy Flynnnnnnnnnnnnnnnnnnnnnnnnnnnn). Wilson vacated the role in late 2015 and would reprise the role for multiple guest stints. In 2016, he returned to the role to help facilitate the departure of Kate Mansi. Wilson vacated the role in", "prediction 3": "Ben Weston is a fictional character from Days of Our Lives, an American soap opera on the NBC network, most notably portrayed by Robert Scott Wilson. The role was originated by Justin Gaston in 2014 when Ben was introduced as the new love interest of Abigail Deveraux (Kate Mansi). Soon after, Wilson was hired as a recast and the writers began exploring the character's dark past with the introduction of his abusive criminal father Clyde Weston (James Read).", "prediction 4": "Ben Weston is a fictional character from Days of Our Lives, an American soap opera on the NBC network. The role was originated by Justin Gaston in 2014. Soon after, Robert Scott Wilson was hired as a recast and the writers began exploring the character's dark past with the introduction of his abusive criminal father Clyde Weston (James Read). In 2015, the romantic triangle between Ben, Abigail and Chad DiMera culminates in Ben becoming a serial killer, known as the \"Necktie Killer,\" claiming several victims, including legacy character Will Horton (Guy Wilson). In 2016, Wilson returned to the role to help facilitate the departure of Kate Mansi as Abigail. In 2017, Wilson returned to the role to help facilitate the departure of former cast member, Chandler Massey in the role.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 372 }, { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 551 } ], "missing-info": [], "corrected-prediction": "Ben Weston is a fictional character from Days of Our Lives, an American soap opera on the NBC network, most notably portrayed by Robert Scott Wilson. The role was originated by Justin Gaston in 2014 when Ben was introduced as the new love interest of Abigail Deveraux. Soon after, Wilson was hired as a recast." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who played dumbledore in the harry potter movies?", "passages": [ [ "Albus Dumbledore", "Albus Dumbledore\n\nProfessor Albus Percival Wulfric Brian Dumbledore is a fictional character in J. K. Rowling's \"Harry Potter\" series.", "For most of the series, he is the headmaster of the wizarding school Hogwarts.", "As part of his backstory, it is revealed that he is the founder and leader of the Order of the Phoenix, an organisation dedicated to fighting Lord Voldemort.", "Dumbledore was portrayed by Richard Harris in the film adaptations of \"Harry Potter and the Philosopher's Stone\" and \"Harry Potter and the Chamber of Secrets\".", "After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining \"Harry Potter\" films.", "Jude Law portrayed Dumbledore in the prequel film \"\".", "Rowling stated she chose the name Dumbledore, which is a dialectal word for \"bumblebee\", because of Dumbledore's love of music: she imagined him walking around \"humming to himself a lot\".", "The author has stated that she enjoys writing Dumbledore because he \"is the epitome of goodness.\"", "Rowling said that Dumbledore speaks for her, as he \"knows pretty much everything\" about the \"Harry Potter\" universe." ], [ "Albus Dumbledore", "In \"Philosopher's Stone\", he mentions to Harry that the deepest desire of his heart, revealed by the Mirror of Erised, is to have a pair of woollen socks.", "In the seventh novel, Harry realises that he and Dumbledore see the same thing in the Mirror: their reunited families.", "The character of Albus Dumbledore has been compared to other archetypal \"wise old man\" characters.", "Dumbledore acts much like Merlin from \"The Sword in the Stone\", in the manner of an \"absent-minded professor\"; both Merlin and Dumbledore educate a story's main character in a castle.", "As writer Evelyn Perry notes, \"Dumbledore resembles Merlin both personally and physically; he is an avid lover of books and wisdom who wears flowing robes and a long, white beard.\"", "Dumbledore has also been compared with Gandalf from Tolkien's \"Lord of the Rings\".", "Dave Kopel draws comparisons between Rowling's writing and John Bunyan's \"The Pilgrim\u2019s Progress\" and states that, among the Christian symbols that Rowling has used in her books, Dumbledore acts like \"the bearded God the Father\" figure in which Harry puts his faith to be saved from Voldemort and his servants." ] ], "gold": "Albus Dumbledore, headmaster of the wizarding school Hogwarts in the Harry Potter film franchise, was portrayed by Richard Harris in the first two movies, \"Harry Potter and the Philosopher's Stone\" and \"Harry Potter and the Chamber of Secrets\". After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films.", "prediction 1": "Albus Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. For most of the series, he is the headmaster of the wizarding school Hogwarts. Dumbledore was portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film.\n", "prediction 2": "Professor Albus Percival Wulfric Brian Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. He was portrayed by Richard Harris in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets, and Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film to the series.", "prediction 3": "Dumbledore is a fictional character in J. K. Rowling's Harry Potter series and was both portrayed by various actors in the film adaptations of the books. Richard Harris played Dumbledore in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets, Michael Gambon portrayed Dumbledore in all of the remaining Harry Potter movies, and Jude Law portrayed Dumbledore in the prequel film.", "prediction 4": "Albus Dumbledore, is a fictional character in J. K. Rowling's Harry Potter series. Dumbledore is the headmaster of the wizarding school Hogwarts. Richard Harris played Dumbledore in the film adaptations of Harry Potter and the Philosopher's Stone and Harry Potter and the Chamber of Secrets. After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films. Jude Law portrayed Dumbledore in the prequel film Harry Potter and Potter and the prequel film. Michael Gambon portrayed Dumbledore in the prequel film Harry Potter: The Curs of Ron and the king-Furcles of Ron and the Dumbledore in all of the rest of the Harry Potter movies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 419, "end": 470 } ], "missing-info": [], "corrected-prediction": "Albus Dumbledore is a fictional character in J. K. Rowling's Harry Potter series. For most of the series, he is the headmaster of the wizarding school Hogwarts. Dumbledore was portrayed by Richard Harris in the film adaptations of \"Harry Potter and the Philosopher's Stone\" and \"Harry Potter and the Chamber of Secrets\". After Harris' death, Michael Gambon portrayed Dumbledore for all of the remaining Harry Potter films." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "The last electron acceptor of the electron transport chain (etc) in cellular respiration is?", "passages": [ [ "Electron transport chain", "Electron transport chain\n\nAn electron transport chain (ETC) is a series of complexes that transfer electrons from electron donors to electron acceptors via redox (both reduction and oxidation occurring simultaneously) reactions, and couples this electron transfer with the transfer of protons (H ions) across a membrane.", "This creates an electrochemical proton gradient that drives the synthesis of adenosine triphosphate (ATP), a molecule that stores energy chemically in the form of highly strained bonds.", "The molecules of the chain include peptides, enzymes (which are proteins or protein complexes), and others.", "The final acceptor of electrons in the electron transport chain during aerobic respiration is molecular oxygen although a variety of acceptors other than oxygen such as sulfate exist in anaerobic respiration.", "Electron transport chains are used for extracting energy via redox reactions from sunlight in photosynthesis or, such as in the case of the oxidation of sugars, cellular respiration.", "In eukaryotes, an important electron transport chain is found in the inner mitochondrial membrane where it serves as the site of oxidative phosphorylation through the action of ATP synthase.", "It is also found in the thylakoid membrane of the chloroplast in photosynthetic eukaryotes.", "In bacteria, the electron transport chain is located in their cell membrane." ], [ "Anaerobic respiration", "Anaerobic respiration\n\nAnaerobic respiration is respiration using electron acceptors other than molecular oxygen (O).", "Although oxygen is not the final electron acceptor, the process still uses a respiratory electron transport chain.", "In aerobic organisms undergoing respiration, electrons are shuttled to an electron transport chain, and the final electron acceptor is oxygen.", "Molecular oxygen is a highly oxidizing agent and, therefore, is an excellent electron acceptor.", "In anaerobes, other less-oxidizing substances such as sulfate (SO), nitrate (NO), sulphur (S), or fumarate are used.", "These terminal electron acceptors have smaller reduction potentials than O, meaning that less energy is released per oxidized molecule.", "Therefore, generally speaking, anaerobic respiration is less efficient than aerobic.", "There are two important microbial methane formation pathways, through carbonate reduction (respiration), and acetate fermentation.", "Cellular respiration (both aerobic and anaerobic) utilizes highly reduced chemical compounds such as NADH and FADH2 (for example produced during glycolysis and the citric acid cycle) to establish an electrochemical gradient (often a proton gradient) across a membrane, resulting in an electrical potential or ion concentration difference across the membrane." ] ], "gold": "The electron transport chain is a series of protein complexes that transfer electrons from electron donors to electron acceptors via redox reactions, both reduction and oxidation occurring simultaneously, and couples this electron transfer with the transfer of protons (H+ ions) across a membrane. The final acceptor of electrons in the electron transport chain during aerobic respiration is molecular oxygen although a variety of acceptors other than oxygen such as sulfate exist in anaerobic respiration. The last electron acceptor of the electron transport chain in anaerobic cellular respiration is electron acceptors other than molecular oxygen.", "prediction 1": "In cellular respiration, the final electron acceptor of the electron transport chain is oxygen. In anaerobic respiration, the final electron acceptor is sulfate.", "prediction 2": "An electron transport chain is a series of complexes that transfer electrons from electron donors to electron acceptors via redox reactions, and couples this electron transfer with the transfer of protons (H ions) across a membrane. The final acceptor of electrons in the electron transport chain during aerobic respiration is molecular oxygen; however, a variety of acceptors other than oxygen such as sulfate exist in anaerobic respiration.", "prediction 3": "An electron transport chain is a series of complexes that transfer electrons from electron donors to electron acceptors via redox reactions and couples this electron transfer with the transfer of protons (H ions) across a membrane. In aerobic respiration, the final acceptor of electrons in the electron transport chain is molecular oxygen. In anaerobic respiration, the final acceptor of electrons is sulfate.", "prediction 4": "An electron transport chain is a series of complexes that transfer electrons from electron donors to electron acceptors via redox reactions, and couples this electron transfer with the transfer of protons (H ions) across a membrane. The final acceptor of electrons in the electron transport chain during aerobic respiration is molecular oxygen although a variety of acceptors other than oxygen such as sulfate exist in anaerobic respiration.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 96, "end": 161 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The electron transport chain is a series of protein complexes that transfer electrons from electron donors to electron acceptors via redox reactions, both reduction and oxidation occurring simultaneously, and couples this electron transfer with the transfer of protons (H+ ions) across a membrane. The final acceptor of electrons in the electron transport chain during aerobic respiration is molecular oxygen although a variety of acceptors other than oxygen such as sulfate exist in anaerobic respiration. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What country's flag is orange white and green?", "passages": [ [ "Natives' Society", "This native flag consisted of three equal width vertical panels of red (at the hoist), white (in the centre ) and green ( on the fly).", "Other Natives' Society branches, notably in Carbonear and Harbour Grace, adopted this same red, white and green flag, thus establishing it as the first widely recognized unique but unofficial national flag of Newfoundland.", "It was commonly called the native flag.", "With the introduction of Responsible Government in 1855 need for the Society lessened and it ceased functioning in 1862.", "In 1871 the Catholic Church sponsored a fisherman's aid and benefit organization.", "This was the Star of the Sea Association.", "The colours on its banner were a pink cross and a white star on a green background.", "This gave rise to the commonly named pink, white and green ( green-white-pink, in fact) tricolour flag which with the demise of the Natives' Society was mistakenly referred to as the native flag by the public and even newspaper reporters.", "This green-white-pink tricolour of the Star of the Sea Association has mistakenly become known as the Newfoundland tricolour flag.", "It is not.", "The true Newfoundland tricolour flag is the Natives' Society's red-white-green tricolour flag." ], [ "Flag of Ivory Coast", "Flag of Ivory Coast\n\nThe flag of Ivory Coast () features three equal vertical bands of orange (hoist side), white, and green.", "In 1959, when the Ivorian Legislative Assembly was adopting the flag, Minister of State Jean Delafosse said:\nIn 1960, when the Legislative Assembly was drafting the constitution, Mamadou Coulibaly said:\nGabriel Rougerie wrote in 1964, \"The flag unites the colours of the three great landscapes of the Ivory Coast: green forest, white lagoon and orange savanna.\"", "The 1958 referendum which replaced the French Fourth Republic with the Fifth Republic also replaced the French Union with a French Community, under which most colonies became \"autonomous states\", including Ivory Coast on 4 December 1958.", "The new status for the first time allowed the adoption of a distinctive flag in place of the French tricolour.", "The French commissioner suggested a red-white-and-blue flag with stars, but the Ivorians wanted a greater departure from the flag of the former colonial power.", "The orange-white-and-green flag was adopted by law n\u00b059-240, passed by the Ivorian Legislative Assembly on 3 December 1959, just before the first anniversary of autonomy.", "Head of government F\u00e9lix Houphou\u00ebt-Boigny declared full independence from 7 August 1960 and the Legislative Assembly sat as a constituent assembly to draft a new constitution." ], [ "Flag of India", "Flag of India\n\nThe National Flag of India is a horizontal rectangular tricolour of India saffron, white and India green; with the ', a 24-spoke wheel, in navy blue at its centre.", "It was adopted in its present form during a meeting of the Constituent Assembly held on 22 July 1947, and it became the official flag of the Dominion of India on 15 August 1947.", "The flag was subsequently retained as that of the Republic of India.", "In India, the term \"tricolour\" () almost always refers to the Indian national flag.", "The flag is based on the ' flag, a flag of the Indian National Congress designed by Pingali Venkayya.", "By law, the flag is to be made of \"\", a special type of hand-spun cloth or silk, made popular by Mahatma Gandhi.", "The manufacturing process and specifications for the flag are laid out by the Bureau of Indian Standards.", "The right to manufacture the flag is held by the Khadi Development and Village Industries Commission, who allocates it to regional groups.", "As of 2009, the Karnataka Khadi Gramodyoga Samyukta Sangha has been the sole manufacturer of the flag.", "Usage of the flag is governed by the Flag Code of India and other laws relating to the national emblems." ] ], "gold": "Multiple countries carry the orange, white, and green colors on their flags. In Europe, Ireland has a vertical-striped tricolor flag. The Ivory Coast in Africa also has the vertical stripes, with the orange color on the hoist side. The National Flag of India in Asia is a horizontal rectangular tricolor flag with the Ashoka Chakra, a 24-spoke wheel, in navy blue at its center.", "prediction 1": "The flag of Ivory Coast features three equal vertical bands of orange (hoist side), white, and green. The flag of India is actually a horizontal rectangular tricolour of India saffron, white, and India green.", "prediction 2": "There are several countries that use orange white and green as their flag colours. The flag of Ivory Coast uses three equal vertical bands of orange (hoist side), white, and green. The flag of India uses a horizontal rectangular tricolour of India saffron, white and green. It was adopted in its present form during a meeting of the Constituent Assembly held on 22 July 1947 and it became the official flag of the Dominion of India on 15 August 1947.", "prediction 3": "The flag of the Republic of Ivory Coast is orange, white and green with a horizontal rectangular tricolour of India. The flag of the Ivory Coast was adopted in 1959 by the Legislative Assembly. The flag of the Dominion of India was a rectangular tricolour of India saffron, white and India green. The flag was subsequently retained as the flag of the Republic of India.", "prediction 4": "Orange white and green is featured on the national flag of several countries. The flag of Ivory Coast features three equal vertical bands of orange (hoist side), white, and green. The flag of India features a horizontal rectangular tricolour of India saffron, white and India green with the ', a 24-spoke wheel, in navy blue at its centre. The flag of the Republic of India was adopted in its present form during a meeting of the Constituent Assembly held on 22 July 1947, and it became the flag of the Republic of India on 15 August 1947.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The flag of Ivory Coast features three equal vertical bands of orange (hoist side), white, and green. The flag of India is actually a horizontal rectangular tricolour of India saffron, white, and India green with the Ashoka Chakra, a 24-spoke wheel, in navy blue at its center." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who broke england's ties to the catholic church?", "passages": [ [ "English Reformation", "In 1531, William Tracy was posthumously convicted of heresy for denying purgatory and affirming justification by faith, and his corpse was disinterred and burned.", "While Protestants were only a small portion of the population, the growing rift between the King and papacy gave Protestants a new sense of confidence.", "Heretical ideas were openly discussed, and militant iconoclasm was seen in Essex and Suffolk between 1531 and 1532.", "Because they tended to oppose royal supremacy, traditionalists were on the defensive, while Protestants found opportunities to form new alliances with government officials.", "In order to promote and defend the Royal Supremacy, Henry VIII embraced the language of the continental Reformation and relied on men with Protestant sympathies, such as Thomas Cromwell and Thomas Cranmer, to carry out his religious program.", "The King's personal religious views, however, remained largely traditional.", "Historian G. W. Bernard writes that Henry's religious policies were purposely ambiguous in order to foster religious compromise.", "By 1529, Henry VIII was using the language of reform openly\u2014speaking of Rome's \"vain and superfluous ceremonies\" and blaming the papacy for numerous wars and heresies." ], [ "English Reformation", "English Reformation\n\nThe English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church.", "These events were, in part, associated with the wider process of the European Protestant Reformation, a religious and political movement that affected the practice of Christianity across western and central Europe during this period.", "Many factors contributed to the process: the decline of feudalism and the rise of nationalism, the rise of the common law, the invention of the printing press and increased circulation of the Bible, and the transmission of new knowledge and ideas among scholars, the upper and middle classes and readers in general.", "However, the various phases of the English Reformation, which also covered Wales and Ireland, were largely driven by changes in government policy, to which public opinion gradually accommodated itself.", "Based on Henry VIII's desire for an annulment of his marriage (first requested of Pope Clement VII in 1527), the English Reformation was at the outset more of a political affair than a theological dispute.", "The reality of political differences between Rome and England allowed growing theological disputes to come to the fore.", "Until the break with Rome, it was the Pope and general councils of the Church that decided doctrine.", "Church law was governed by canon law with final jurisdiction in Rome.", "Church taxes were paid straight to Rome, and the Pope had the final word in the appointment of bishops." ], [ "English Reformation", "The break with Rome was effected by a series of acts of Parliament passed between 1532 and 1534, among them the 1534 Act of Supremacy, which declared that Henry was the \"Supreme Head on earth of the Church of England\".", "(This title was renounced by Mary I in 1553 in the process of restoring papal jurisdiction; when Elizabeth I reasserted the royal supremacy in 1559, her title was Supreme Governor.)", "Final authority in doctrinal and legal disputes now rested with the monarch, and the papacy was deprived of revenue and the final say on the appointment of bishops.", "The theology and liturgy of the Church of England became markedly Protestant during the reign of Henry's son Edward VI largely along lines laid down by Archbishop Thomas Cranmer.", "Under Mary, the whole process was reversed and the Church of England was again placed under papal jurisdiction.", "Soon after, Elizabeth reintroduced the Protestant faith but in a more moderate manner.", "The structure and theology of the church was a matter of fierce dispute for generations." ] ], "gold": "Henry VIII initiated the separation of England's ties to the Catholic Church when he began to break with Rome after he sought an annulment of his marriage in 1527. Under Queen Mary, the process was reversed temporarily, and the Church of England was again placed under papal jurisdiction, until Elizabeth I finished the reformation when she reintroduced the Protestant religion but in a more moderate manner.", "prediction 1": "The English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church. These events were, in part, associated with the wider process of the European Protestant Reformation, a religious and political movement that affected the practice of Christianity across western and central Europe during this period. The break with Rome was effected by a series of acts of Parliament passed between 1532 and 1534, among them the 1534 Act of Supremacy, which declared that Henry was the \"Supremise\" on earth of the Church of England.", "prediction 2": "The English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church. The break with Rome was effected by a series of acts of Parliament passed between 1532 and 1534, among them the 1534 Act of Supremacy, which declared that Henry was the \"Supreme Head on earth of the Church of England.\" This title was renounced by Mary I in 1553 in the process of restoring papal jurisdiction; soon after Elizabeth I reasserta more moderate manner.", "prediction 3": "The English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church. The break with Rome was effected by a series of acts of Parliament passed between 1532 and 1534, among them the 1534 Act of Supremacy, in which Henry was declared the \"Supreme Head on earth of the Church of England\". This title was renounced by Mary I in 1553 in the process of restoring papal jurisdiction.", "prediction 4": "The English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church. These events were, in part, associated with the wider process of the European Protestant Reformation, a religious and political movement that affected the practice of Christianity across western and central Europe during this period. In 1532, Henry VIII requested an annulment of his marriage\u2014first requested of Pope Clement VII in 1527. The break with Rome was effected by a series of acts of Parliament passed between 1533 and 1534, among them the 1534 Act of Supremacy, which declared that Henry was the \"Suprece\" Head on earth of the Church of England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 624 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The English Reformation was a series of events in 16th-century England by which the Church of England broke away from the authority of the Pope and the Roman Catholic Church. It was a part due to Henry VIII's desire for an annulment of his marriage, first in 1527. Under Mary, the whole process was reversed and the Church of England was again placed under papal jurisdiction. Soon after, Elizabeth reintroduced the Protestant faith but in a more moderate manner." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the childhood of a leader based on?", "passages": [ [ "The Childhood of a Leader (film)", "The Childhood of a Leader (film)\n\n", "The Childhood of a Leader is a 2015 historical mystery drama film, co-written, co-produced and directed by Brady Corbet, and is Corbet's feature film directorial debut.", "It is loosely based on Jean-Paul Sartre's short story \"The Childhood of a Leader\", published in 1939 in a collection entitled \"The Wall\", and John Fowles's 1965 novel \"The Magus\".", "Corbet co-wrote the screenplay with his wife Mona Fastvold, and filmed both an English and a French language version.", "The film chronicles the childhood of a fascist leader in the period immediately following World War I. Production began in early 2015, in Budapest, Hungary.", "The film had its world premiere in-competition (Horizon section) at 72nd Venice International Film Festival on 5 September 2015 and won two awards at the festival, Best Debut film and Best Director.", "In 1919, an American boy living in France with his authoritarian parents witnesses the creation of the Treaty of Versailles, which shapes his beliefs and causes him to develop a terrifying ego.", "Brady Corbet began writing the script of the film ten years before on his own but later put it down as he considered it \"too big\" for a debut film." ], [ "Jean-Paul Sartre", "He was one of the first French journalists to expose the existence of the labor camps, and vehemently opposed the invasion of Hungary, Russian anti-Semitism, and the execution of dissidents.", "About the Hungarian revolt of 1956, Sartre wrote: \"In spite of everything, the Rakosi regime stood for socialization.", "Only it did it badly and that is worse than not to do so at all\".", "Sartre came to admire the Polish leader W\u0142adys\u0142aw Gomu\u0142ka, a man who favored a \"Polish road to socialism\" and wanted more independence for Poland, but was loyal to the Soviet Union because of the Oder-Neisse line issue.", "Sartre's newspaper \"Les Temps Modernes\" devoted a number of special issues in 1957 and 1958 to Poland under Gomu\u0142ka, praising him for his reforms.", "Bondy wrote of the notable contradiction between Sarte's \"ultra Bolshevism\" as he expressed admiration for the Chinese leader Mao Zedong as the man who lead the oppressed masses of the Third World into revolution while also praising more moderate Communist leaders like Gomu\u0142ka.", "As an anti-colonialist, Sartre took a prominent role in the struggle against French rule in Algeria, and the use of torture and concentration camps by the French in Algeria." ], [ "The Wall (short story collection)", "The Wall (short story collection)\n\nThe Wall () by Jean-Paul Sartre, a collection of short stories published in 1939 containing the eponymous story \"The Wall,\" is considered one of the author's greatest existentialist works of fiction.", "Sartre dedicated the book to his companion Olga Kosakiewicz, a former student of Simone de Beauvoir.", "The eponymous story coldly depicts a situation in which prisoners are condemned to death.", "Written in 1939, the story is set in the Spanish Civil War, which began July 18, 1936, and ended April 1, 1939, when the Nationalists (known in Spanish as the \"Nacionalistas\"), led by General Francisco Franco, overcame the forces of the Spanish Republic and entered Madrid.", "The title refers to the wall used by firing squads to execute prisoners.", "The Wall itself symbolises the inevitability and unknowing of one's death.", "The protagonist, Pablo Ibbieta, along with two others in his cell, is sentenced to death.", "He is offered a way out if he reveals the location of his comrade, Ram\u00f3n Gris.", "Pablo begins thinking to himself and finds that he no longer cares about his cause or his life." ] ], "gold": "The 2015 film The Childhood of a Leader chronicles the childhood of a fascist leader in the period immediately following World War I. It is loosely based on Jean-Paul Sartre's 1939 short story The Childhood of a Leader. This work chronicles the life of Lucien Fleurier from childhood until he becomes an anti-Semitic Camelot who believes that he can become a real leader. Due to the many similar characteristics in the stories and a strong friendship between the two authors, it is believed that Simone de Beauvoir's short story Marguerite influenced Sartre's The Childhood of a Leader and vice a versa. Both authors borrowed from their own personal lives to build their protagonists, however Sartre denied the story being a biographical work.", "prediction 1": "The Childhood of a Leader is loosely based on Jean-Paul Sartre's short story \"The Childhood of a Leader\" published in 1939 in a collection entitled The Wall, and John Fowles' 1965 novel The Magus. The film chronicles the childhood of a fascist leader in the period immediately following World War I. It is Brady Corbet's feature film directorial debut. It is co-written, co-produced and directed by Brady Corbet.", "prediction 2": "The Childhood of a Leader is loosely based on Jean-Paul Sartre's short story The Childhood of a Leader, published in 1939 in a collection entitled The Wall, and John Fowles' 1965 novel The Magus. The 2015 historical mystery drama film is directed by Brady Corbet. It chronicles the childhood of a fascist leader in the period immediately following World War I.", "prediction 3": "The Childhood of a Leader is loosely based on Jean-Paul Sartre's short story \"The Childhood of a Leader\", published in 1939 in a collection entitled \"The Wall\", and John Fowles' 1965 novel The Magus. The film chronicles the childhood of a fascist leader in the period immediately following World War I. The Childhood of a Leader is a 2015 historical mystery drama film, co-written, co-produced and directed by Brady Corbet, and is Corbet's feature film directorial debut.", "prediction 4": "The Childhood of a Leader is loosely based on Jean-Paul Sartre's short story \"The Childhood of a Leader\", published in 1939 in a collection entitled \"The Wall\", and John Fowles' 1965 novel The Magus. Corbet co-wrote the screenplay with his wife Mona Fastvold, and filmed both an English and a French language version. The Childhood of a Leader is Brady Corbet's feature film directorial debut. The film chronicles the childhood of a fascist leader in the period immediately following World War I.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 123, "end": 196 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 352 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 412 } ], "missing-info": [], "corrected-prediction": "The 2015 film The Childhood of a Leader chronicles the childhood of a fascist leader in the period immediately following World War I. The Childhood of a Leader is loosely based on Jean-Paul Sartre's short story \"The Childhood of a Leader\" published in 1939. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "How many premier league teams make champions league?", "passages": [ [ "Premier League", "Because they are members of the Football Association of Wales (FAW), the question of whether clubs like Swansea should represent England or Wales in European competitions has caused long-running discussions in UEFA.", "Swansea took one of England's three available places in the Europa League in 2013\u201314 by winning the League Cup in 2012\u201313.", "The right of Welsh clubs to take up such English places was in doubt until UEFA clarified the matter in March 2012, allowing them to participate.", "Participation in the Premier League by some Scottish or Irish clubs has sometimes been discussed, but without result.", "The idea came closest to reality in 1998, when Wimbledon received Premier League approval to relocate to Dublin, Ireland, but the move was blocked by the Football Association of Ireland.", "Additionally, the media occasionally discusses the idea that Scotland's two biggest teams, Celtic and Rangers, should or will take part in the Premier League, but nothing has come of these discussions.", "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage.", "The winners of the UEFA Champions League and UEFA Europa League also qualify for the subsequent season's UEFA Champions League group stage.", "If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League, as any single nation is limited to a maximum of 5 teams." ], [ "UEFA Champions League", "They are followed by Arsenal on 19 (1998\u20132016) and Manchester United on 18 (1996\u20132013).", "Between 2003 and 2008, no differentiation was made between champions and non-champions in qualification.", "The 16 top ranked teams spread across the biggest domestic leagues qualified directly for the tournament group stage.", "Prior to this, three preliminary knockout qualifying rounds whittled down the remaining teams, with teams starting in different rounds.", "An exception to the usual European qualification system happened in 2005, after Liverpool won the Champions League the year before, but did not finish in a Champions League qualification place in the Premier League that season.", "UEFA gave special dispensation for Liverpool to enter the Champions League, giving England five qualifiers.", "UEFA subsequently ruled that the defending champions qualify for the competition the following year regardless of their domestic league placing.", "However, for those leagues with four entrants in the Champions League, this meant that, if the Champions League winner fell outside of its domestic league's top four, it would qualify at the expense of the fourth-placed team in the league.", "Until 2015\u201316, no association could have more than four entrants in the Champions League.", "In May 2012, Tottenham Hotspur finished fourth in the 2011\u201312 Premier League, two places ahead of Chelsea, but failed to qualify for the 2012\u201313 Champions League, after Chelsea won the 2012 final." ] ], "gold": "Usually, the top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage, but an exception is made if the defending champion of either the UEFA Champions League or UEFA Europa League also competes in the Premier League. Under those circumstances, a total of five teams from the league take part in the Champions League group stage, that being the limit of teams a single nation may have in a tournament.", "prediction 1": "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage. The winners of the UEFA Champions League and UEFA Europa League also qualify for the subsequent season's UEFA Champions League group stage. If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League, as any single nation is limited to a maximum of 5 teams. In the 2012\u201313 season, the number of Premier League teams in the Champions League was increased to eight. In the 2017/2018, the Champions League, the top four teams in the Premier League, the top four teams in the competition.", "prediction 2": "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage. If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League as any single nation is limited to a maximum of 5 teams.", "prediction 3": "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage, while the winners of the UEFA Champions League and UEFA Europa League also qualify for the subsequent season's UEFA Champions League group stage. If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League, as any single nation is limited to a maximum of five teams. Until 2015\u201316, no association could have more than four entrants in the Champions League.", "prediction 4": "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage. The winners of the UEFA Champions League and UEFA Europa League also qualify for the subsequent season's UEFA Champions League group stage. If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League, as any single nation is limited to a maximum of 5 teams.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 448, "end": 553 }, { "error type": "Incoherent", "explanation": "", "start": 554, "end": 674 } ], "missing-info": [], "corrected-prediction": "The top four teams in the Premier League qualify for the subsequent season's UEFA Champions League group stage. The winners of the UEFA Champions League and UEFA Europa League also qualify for the subsequent season's UEFA Champions League group stage. If this means six Premier League teams qualify, then the fourth-placed team in the Premier League instead plays in the UEFA Europa League, as any single nation is limited to a maximum of 5 teams. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where did the bristol stool chart come from?", "passages": [ [ "Bristol stool scale", "The Bristol stool scale is also very sensitive to changes in intestinal transit time caused by medications, such as antidiarrhoeal loperamide or senna, anthraquinone substance with laxative effect.", "Developed and proposed for the first time in England by Dr. Stephen Lewis and Dr. Ken Heaton at the University Department of Medicine, Bristol Royal Infirmary, it was suggested by the authors as a clinical assessment tool in 1997 in the journal \"Scandinavian Journal of Gastroenterology\" after a previous prospective study, conducted in 1992 on a sample of the population (838 men and 1,059 women), had shown an unexpected prevalence of defecation disorders related to the shape and type of stool.", "The authors of the former paper concluded that the form of the stool is a useful surrogate measure of colon transit time.", "That conclusion has since been challenged as having limited validity for Types 1 and 2; however, it remains in use as a research tool to evaluate the effectiveness of treatments for various diseases of the bowel, as well as a clinical communication aid.", "The same scale has been validated in Spanish, Brazilian Portuguese, and Polish versions.", "A version has also been designed and validated for paediatrics.", "More recently, in September 2011, a modified version of the scale was validated using a criterion of self-assessment for ages 6\u20138 years of age." ], [ "Bristol Royal Infirmary", "Bristol Royal Infirmary\n\nThe Bristol Royal Infirmary, also known as the BRI, is a large teaching hospital situated in the centre of Bristol, England.", "It has links with the nearby University of Bristol and the Faculty of Health and Social Care at the University of the West of England, also in Bristol.", "The BRI is one of eight hospitals operated by the University Hospitals Bristol NHS Foundation Trust.", "It is located next to the Bristol Royal Hospital for Children and the Bristol Heart Institute (BHI).", "The Bristol Royal Infirmary was founded by public subscription in 1735, making it one of the oldest infirmaries in the United Kingdom.", "In 1904 Sir George White, who gave Bristol its first electric tramway service and established what was to become the Bristol Aeroplane Company, saved the hospital from debts of over \u00a315,000 by increasing the number of subscribed donors and planning a fundraising carnival at Bristol Zoo.", "White was appointed president of the hospital in 1906.", "Recognising the need to modernise the hospital building to keep up with innovations in science and medicine, he established a \u00a350,000 fund for a new hospital building.", "This led to the construction of the Edward VII Memorial Wing which designed by Charles Holden and completed in 1912.", "Geoffrey Tovey, serologist and founder of the UK Transplant Service, worked at the hospital shortly before the Second World War." ], [ "Scandinavian Journal of Gastroenterology", "Scandinavian Journal of Gastroenterology\n\nThe Scandinavian Journal of Gastroenterology is a monthly peer-reviewed medical journal covering the field of gastroenterology.", "It is published by Informa and was established in 1966.", "The editor in chief is Helge Waldum.", "According to the \"Journal Citation Reports\", the journal has a 2013 impact factor of 2.329." ] ], "gold": "The Bristol Stool Chart came from doctors, an institution, and a journal. It was developed by Doctors Stephen Lewis and Ken Heaton at the institution called Bristol Royal Infirmary, a teaching hospital in Bristol, England. They suggested it as a clinical assessment tool in 1997 in the Scandinavian Journal of Gastroenterology, a medical journal covering the field of gastroenterology.", "prediction 1": "The Bristol stool chart is based on the Scandinavian Journal of Gastroenterology, a monthly peer-reviewed medical journal that is published by Informa and established in 1966. It was developed and proposed for the first time in England by Dr. Stephen Lewis and Dr. Ken Heaton at the University Department of Medicine, Bristol Royal Infirmary, and was suggested by the authors as a clinical assessment tool in 1997 in the Scandinavian Journal of Gastroenterology.", "prediction 2": "The Bristol stool scale is a scale used to evaluate the transit time of the bowel. The scale was developed and proposed for the first time in England by Dr. Stephen Lewis and Dr. Ken Heaton at the University Department of Medicine, Bristol Royal Infirmary. It was suggested by the authors as a clinical assessment tool in 1997 in the journal Scandinavian Journal of Gastroenterology after a previous prospective study, conducted in 1992 on a sample of the population, had shown an unexpected prevalence of defecation disorders related to the shape and type of the bowel transit time.", "prediction 3": "The Bristol stool scale originates from the University Department of Medicine, Bristol Royal Infirmary. It was proposed by the authors as a clinical assessment tool in 1997 in the journal Scandinavian Journal of Gastroenterology.", "prediction 4": "The Bristol stool chart is a stool chart developed and proposed for the first time in England by Dr. Stephen Lewis and Dr. Ken Heaton at the University Department of Medicine, Bristol Royal Infirmary. It was suggested by the authors as a clinical assessment tool in 1997 in the journal Scandinavian Journal of Gastroenterology after a previous prospective study, conducted in 1992 on a sample of the population, had shown an unexpected prevalence of defecation disorders related to the shape and type of stool. It remains in use as a research tool to evaluate the effectiveness of treatments for various diseases of the bowel, as well as a clinical communication aid.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 27, "end": 175 } ], "missing-info": [], "corrected-prediction": "The Bristol stool chart was developed and proposed for the first time in England by Dr. Stephen Lewis and Dr. Ken Heaton at the University Department of Medicine, Bristol Royal Infirmary, and was suggested by the authors as a clinical assessment tool in 1997 in the Scandinavian Journal of Gastroenterology." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has won more games packers or bears?", "passages": [ [ "Bears\u2013Packers rivalry", "Bears\u2013Packers rivalry\n\nThe Bears\u2013Packers rivalry is a National Football League (NFL) rivalry between the Chicago Bears and the Green Bay Packers.", "The two clubs have won a combined 22 NFL championships (13 for Green Bay and 9 for Chicago), including 5 Super Bowl championships (4 for Green Bay and 1 for Chicago) and have 65 members in the Pro Football Hall of Fame (Chicago with 34 and Green Bay with 31).", "The rivalry began in and is the league's most played, with 197 regular-season and post-season games.", "The rivalry is not the league's longest continuous rivalry, as the 1982 strike-shortened NFL season did not include a Bears\u2013Packers game.", "That title goes to the rivalry between the Lions and the Packers, who have played each other at least twice a year since 1932.", "The Packers and Bears have played in the same conference or division since the NFL went to a conference format in 1933; they played in the NFL's Western Conference from 1933 to 1970, and have been in the NFC North since 1970 (known as the NFC Central from 1970 to 2001).", "As such, they usually play each other twice every regular season.", "The Packers surpassed the Bears in the overall series in 2017 for the first time since 1932 and now lead, 97\u201395\u20136." ], [ "Bears\u2013Packers rivalry", "The Bears had previously led the series by as many as 24 games both in 1960 and in 1992.", "The Bears and Packers have made it to the playoffs in the same year only four times.", "As of November 18, 2016, there have been 194 games between the two teams\u2014most in NFL history\u2014since their first league game in 1921, of which the both teams have won 94 games and there have been 6 ties.", "The largest margin of victory was a 61\u20137 Bears win on December 7, 1980.", "The longest winning streak is held by the Packers at 10 games from 1994\u20131998.", "After beating the Bears four times in 2011, the Packers became only the second team in NFL history to defeat the same opponent four times in one calendar year (the Los Angeles Raiders defeated the Denver Broncos four times in 1994).", "As of 2016, the Bears and Packers have won a combined 22 championships in the league's history.", "The following is a list of results from all of the meetings between the Chicago Bears and Green Bay Packers, from their first meeting on November 27, 1921, to the present:\n\n\n\n\n\n\n\n\n\n\n\n \u2013 Denotes a Playoff Game\n\n\nOther rivalries involving the two teams" ], [ "2011 Green Bay Packers season", "2011 Green Bay Packers season\n\nThe Green Bay Packers season was the franchise's 93rd season overall and their 91st in the National Football League, and the sixth under head coach Mike McCarthy.", "The team not only improved on their 10\u20136 record from a season earlier, they became just the sixth team in NFL history to win 15 games during the regular season.", "As of 2017, the 15\u20131 record stands as the best in team history.", "The Packers won their first 13 games of the season to extend their winning streak from the previous season to 19, the second-longest in NFL history behind the 21-game winning streak of the New England Patriots in 2003 and 2004, and also tied the record for the best start to a season in NFC history that the New Orleans Saints had set in 2009.", "The only loss for the Packers during the regular season was a Week 15 defeat in Arrowhead Stadium against the Kansas City Chiefs.", "They also became the first NFC North team to go undefeated in the division since the 1987 Chicago Bears.", "Statistics site \"Football Outsiders\" calculated that the Packers were, play for play, the best team in the NFL in 2011 (though they received the second-lowest rating for a number-1 team since the 1993 San Francisco 49ers)." ] ], "gold": "The Bears-Packers rivalry began in 1921 and is the league's most played rivalry. The Packers surpassed the Bears in the overall series in 2017 and now lead, 101\u201395\u20136. The two teams have met twice in the NFL playoffs, with each team winning one game. In terms of all-time wins, as of the end of the 2020 season, the Chicago Bears have recorded the most wins, 777, in NFL regular season history, while the Green Bay Packers have recorded 769 wins.", "prediction 1": "The Bears\u2013Packers rivalry is a National Football League rivalry between the Chicago Bears and the Green Bay Packers. The two teams have won a combined 22 NFL championships, 13 for Green Bay and 9 for Chicago, including 5 Super Bowl championships, including 5 Super Bowls. The Packers surpassed the Bears in the overall series in 2017 for the first time since 1932 and now lead, 97\u201395\u20136. The longest winning streak is held by the Packers at 10 games from 1994\u20131998.", "prediction 2": "The Bears\u2013Packers rivalry is a National Football League rivalry between the Chicago Bears and the Green Bay Packers. The two clubs have won a combined 22 NFL championships, including 5 Super Bowl championships, including 5 Super Bowl wins. The Bears have previously led the series by as many as 24 games both in 1960 and in 1992. The Green Bay Packers have now surpassed the Bears in the overall series in 2017 for the first time since 1932 and now lead, 97\u201395\u20136.", "prediction 3": "The Bears\u2013Packers rivalry is a National Football League rivalry between the Chicago Bears and the Green Bay Packers. The two clubs have won a combined 22 NFL championships, 13 for Green Bay and 9 for Chicago, including 5 Super Bowl championships for Green Bay and 1 for Chicago. The longest winning streak is held by the Packers at 10 games in 1994\u20131998. As of November 18, 2016, there have been 194 games between the two teams\u2014most in NFL history\u2014since their first league game in 1921, of which the both teams have won 94 games and there have been 6 ties.", "prediction 4": "The Bears\u2013Packers rivalry is a National Football League rivalry between the Chicago Bears and the Green Bay Packers. The two clubs have won a combined 22 NFL championships, 13 for Green Bay and 9 for Chicago, including 5 Super Bowl championships, including 1 for Green Bay and 2 for Chicago. As of 2016, the Bears and Packers have won a combined 22 championships in the league's history. The longest winning streak is held by the Packers at 10 games from 1994-98.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 246 }, { "error type": "Redundant", "explanation": "The two teams have won a combined 22 NFL championships, 13 for Green Bay and 9 for Chicago, including 5 Super Bowl championships, ", "start": 247, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 464 }, { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 116 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Bears\u2013Packers rivalry is the league's most played rivalry. The Packers surpassed the Bears in the overall series in 2017 for the first time since 1932 and now lead, 97\u201395\u20136. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "In which episode of smallville does jonathan die?", "passages": [ [ "Reckoning (Smallville)", "Michael Ausiello from \"TV Guide\" wrote, \"Watch ['Reckoning'] because it's one of the best hours of TV this season and I'm not even a big \"Smallville\" fan.\"", "Vic Holtreman from Screenrant gave the episode a largely positive review and called it \"a great episode overall\".", "He called the scenes leading up to the funeral \"quite moving\" and noted that the loss of Jonathan Kent was a blow, not only for the series' main characters, but also for the audience itself.", "However, Holtreman mocked the \"old moon-pie eye\u2019d Clark/Lana situation\" and the fact that \"Lana didn't die\".", "Omar Gallaga from Television Without Pity gave the episode a B and wrote that the death of Jonathan Kent \"still stings\".", "Chris Carabott from TV Fanatic named the episode the second best \"Smallville\" episode (coming after ninth season entry \"Absolute Justice\"), and he wrote that \"The death of Jonathan Kent is one of the most pivotal moments of \"Smallville\".\"", "Carabott also opined that the ramifications of the episode helped to \"shape [Clark into] the man he has become\".", "Michael Duffy, in the chapter \"Sacrifice or Salvation?" ], [ "Reckoning (Smallville)", "Reckoning (Smallville)\n\n\"Reckoning\" is the twelfth episode of the fifth season of the superhero television series \"Smallville\" and the hundredth episode of the overall series.", "It originally aired on The WB in the United States on January 26, 2006, and on E4 in the United Kingdom on March 27, 2006.", "The episode was written by Kelly Souders and Brian Peterson, and directed by Greg Beeman.", "The series follows the adventures of the young Clark Kent (Tom Welling) in the town of Smallville, Kansas, before he becomes Superman.", "In this episode, Clark reveals his secret to Lana Lang (Kristin Kreuk), but there are consequences.", "Jonathan Kent (John Schneider) and Lex Luthor (Michael Rosenbaum) learn the results of the senatorial election and the life of someone Clark loves is taken from him.", "There were originally two potential plotlines for the episode before it was decided that one of the main characters would be killed.", "This concept was positively received by studio executives.", "Schneider also approved of the idea, and compared his departure to that of John Wayne in \"The Cowboys\".", "Jonathan Kent's death was used to emphasize the theme that Clark has to accept the consequences of his decisions." ], [ "Reckoning (Smallville)", "Chloe promises to keep an eye on Lana to prevent her from dying once more.", "At the election party, Lana arrives with Chloe, but she once again leaves again when Lex calls.", "This time Lex kisses her when he learns of her break up, which causes Lana to leave.", "Like before, Lex pursues Lana, but this time Clark arrives in time to stop the bus.", "Jonathan goes to the farm after receiving a mysterious call during the party, and is greeted by Lionel Luthor (John Glover).", "Lionel insinuates he knows Clark's secret and shows a picture to Jonathan, which causes Jonathan to begin punching Lionel in anger.", "Jonathan dismisses Lionel and laboriously walks away, breathing heavily.", "Martha and Clark drive up and catch him as he has a heart attack, and, after taking a final look at his family, Jonathan dies in the arms of Martha and Clark.", "At Jonathan's funeral, all of Clark's close friends attend, as well as the Luthors.", "When the funeral is over, Clark picks up a handful of dirt and sprinkles it into his father's grave.", "Originally, the writers developed two potential plotlines for the episode: one in which Clark and Lana would get married, and another in which one of Clark's parents would die.", "The producers eventually chose only to kill one of the parents." ] ], "gold": "\"Reckoning\" is the name of season 5 episode 12 of the superhero television series Smallville and the hundredth episode of the overall series. It originally aired on The WB in the United States on January 26, 2006, and on E4 in the United Kingdom on March 27, 2006. In this episode, Clark reveals his secret to Lana Lang, but there are consequences. Jonathan Kent and Lex Luthor learn the results of the senatorial election and Jonathan dies from a heart attack in the arms of Martha and Clark.", "prediction 1": "\"Reckoning\" is the twelfth episode of the fifth season of the superhero television series Smallville. Jonathan Kent dies in the episode, which was part of the plot to kill one of the show's main characters. The episode was written by Kelly Souders and Brian Peterson, and directed by Greg Beeman.", "prediction 2": "Reckoning is the twelfth episode of the fifth season of the superhero television series Smallville. Jonathan Kent dies in the episode. There are multiple times in the series that Jonathan dies, in different episodes. In the episode Reckoning, Jonathan dies in the arms of Martha and Clark.", "prediction 3": "\"Reckoning\" is the twelfth episode of the fifth season of the superhero television series Smallville. It originally aired on the WB in the United States on January 26, 2006, and on E4 in the United Kingdom on March 27, 2006. Jonathan dies in the episode, \"Reckoning,\" which is the twelfth episode of the series and the hundredth episode overall.", "prediction 4": "\"Reckoning\" is the twelfth episode of the fifth season of the superhero television series Smallville. Jonathan Kent dies in the episode, which was the hundredth episode of the overall series. The death was used to emphasize the theme that Clark has to accept the consequences of his decisions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 296 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 206 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "\"Reckoning\" is the twelfth episode of the fifth season of the superhero television series Smallville and the hundredth episode of the overall series. It originally aired on The WB in the United States on January 26, 2006, and on E4 in the United Kingdom on March 27, 2006. In this episode, Clark reveals his secret to Lana Lang, but there are consequences. Jonathan Kent and Lex Luthor learn the results of the senatorial election and Jonathan dies from a heart attack in the arms of Martha and Clark. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played the headless horseman in tim burton's sleepy hollow?", "passages": [ [ "Sleepy Hollow (film)", "\", Burton opted to use as limited an amount of digital effects as possible.", "Ray Park, who served as the Headless Horseman stunt double, wore a blue ski mask for the chroma key effect, digitally removed by ILM.", "Burton and Heinrichs applied to \"Sleepy Hollow\" many of the techniques they had used in stop motion animation on \"Vincent\"\u2014such as forced perspective sets.", "The windmill was a 60-foot-tall forced-perspective exterior (visible to highway travellers miles away), a base and rooftop set and a quarter-scale miniature.", "The interior of the mill, which was about 30-feet high and 25-feet wide, featured wooden gears equipped with mechanisms for grinding flour.", "A wider view of the windmill was rendered on a Leavesden soundstage set with a quarter-scale windmill, complete with rotating vanes, painted sky backdrop and special-effects fire.", "\"It was scary for the actors who were having burning wood explode at them,\" Heinrichs recalled.", "\"There were controls in place and people standing by with hoses, of course, but there's always a chance of something going wrong.\"", "For the final shot of the burning mill exploding, the quarter-scale windmill and painted backdrop were erected against the outside wall of the \"flight shed\", a spacious hangar on the far side of Leavesden Studios." ], [ "Sleepy Hollow (film)", "Sleepy Hollow (film)\n\nSleepy Hollow is a 1999 American gothic supernatural horror film directed by Tim Burton.", "It is a film adaptation loosely based on Washington Irving's 1820 short story \"The Legend of Sleepy Hollow\", and stars Johnny Depp and Christina Ricci, with Miranda Richardson, Michael Gambon, Casper Van Dien, and Jeffrey Jones in supporting roles.", "The plot follows police constable Ichabod Crane (Depp) sent from New York City to investigate a series of murders in the village of Sleepy Hollow by a mysterious Headless Horseman.", "Development began in 1993 at Paramount Pictures, with Kevin Yagher originally set to direct Andrew Kevin Walker's script as a low-budget slasher film.", "Disagreements with Paramount resulted in Yagher's being demoted to prosthetic makeup designer, and Burton was hired to direct in June 1998.", "Filming took place from November 1998 to May 1999.", "The film has a 67% rating on Rotten Tomatoes and grossed approximately $207 million worldwide.", "\"Sleepy Hollow\" won the Academy Award for Best Art Direction.", "In 1799, New York City police constable Ichabod Crane is dispatched to the upstate Dutch hamlet of Sleepy Hollow, which has been plagued by a series of brutal decapitations: a wealthy father and son, and a widow." ], [ "Sleepy Hollow (film)", "He did not wish to portray the character as a typical action star would have, and instead took inspiration by Angela Lansbury's performance in \"Death on the Nile\".", "\"It's good,\" Burton reasoned, \"because I'm not the greatest action director in the world, and he's not the greatest action star.\"", "Depp modeled Ichabod's detective personality from Basil Rathbone in the 1939 \"Sherlock Holmes\" film series.", "He also studied Roddy McDowall's acting for additional influence.", "Burton added that \"the idea was to try to find an elegance in action of the kind that Christopher Lee or Peter Cushing or Vincent Price had.\"", "Christina Ricci, who worked with producer Scott Rudin on \"The Addams Family\", was cast as Katrina Van Tassel.", "\"Sleepy Hollow\" also reunited Burton with Jeffrey Jones (from \"Beetlejuice\" and \"Ed Wood\") as Reverend Steenwyck, Christopher Walken (Max Shreck in \"Batman Returns\") as the Hessian Horseman, Martin Landau (\"Ed Wood\") in a cameo role, and Hammer veteran Michael Gough (Alfred in Burton's \"Batman\" films), whom Burton tempted out of retirement." ] ], "gold": "Sleepy Hollow is a 1999 American gothic supernatural horror film directed by Tim Burton. The Headless Horseman is a character in the film. The Headless Horseman was played by actor Christopher Walken except for the scenes when a stunt double, Ray Park, played the role.", "prediction 1": "There are several Headless Horseman in the 1999 American gothic supernatural horror film Sleepy Hollow. In the original 1820 short story, there was a Headless Horseman, played by Johnny Depp. In the 1999 film, Jeffrey Jones played the Headless Horseman. In the original 1999 film, Christopher Walken played the Hessian Horseman.", "prediction 2": "Sleepy Hollow is a 1999 American gothic supernatural horror film directed by Tim Burton. It is loosely based on Washington Irving's 1820 short story The Legend of Sleepy Hollow. Johnny Depp plays Ichabod Crane, a detective sent from New York City to investigate a series of murders in the village of Sleepy Hollow by a mysterious Headless Horseman. Christopher Walken plays the Hessian Horseman, Martin Landau plays the Hessian Horseman in Batman Returns, and Hammer veteran Michael Gough plays the Hessian Horseman.", "prediction 3": "Sleepy Hollow is a 1999 American gothic supernatural horror film directed by Tim Burton. It is loosely based on Washington Irving's 1820 short story The Legend of Sleepy Hollow. Johnny Depp plays Ichabod Crane, a detective sent from New York City to investigate a series of murders in the village of Sleepy Hollow by a mysterious Headless Horseman. Christopher Walken plays the Hessian Horseman, Martin Landau plays the Hessian Horseman, and Hammer veteran Michael Gough plays Alfred Wood.", "prediction 4": "The 1999 American gothic supernatural horror film Sleepy Hollow was directed by Tim Burton and stars Johnny Depp as Ichabod Crane, who is sent to investigate a series of murders in the village of Sleepy Hollow by a mysterious Headless Horseman. As the Hessian Horseman, Christopher Walken plays the character. Martin Landau plays the headless horseman in the film.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 104, "end": 191 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 192, "end": 253 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sleepy Hollow is a 1999 American gothic supernatural horror film directed by Tim Burton. In the original 1999 film, Christopher Walken played the Hessian Horseman." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who has won the most mens grand slams?", "passages": [ [ "Grand Slam (golf)", "The term also refers to a former tour tournament, the PGA Grand Slam of Golf, an annual off-season tournament (that was cancelled after the 2014 tournament) contested by the winners of the four major championships.", "In annual playing order, the modern major championships are:\n\n\n", "The term \"Grand Slam\" was first applied to Bobby Jones' achievement of winning the four major golf events of 1930:", "The Open Championship, the U.S. Open, the U.S. Amateur and the British Amateur.", "When Jones won all four, the sports world searched for ways to capture the magnitude of his accomplishment.", "Up to that time, there was no term to describe such a feat because no one had thought it possible.", "The \"Atlanta Journal\"s O. B. Keeler dubbed it the \"Grand Slam,\" borrowing a bridge term.", "George Trevor of the \"New York Sun\" wrote that Jones had \"stormed the impregnable quadrilateral of golf.\"" ], [ "Grand Slam (golf)", "This has been referred to as a \"Consecutive Grand Slam\" or, after the only player to achieve it, a \"Tiger Slam\".", "In other sports with a four-major format, it is referred as a \"Non-calendar year Grand Slam\", based on a 1982 decision.", "In fact, even before Woods accomplished this, there was much debate over the definition of \"Grand Slam.\"", "Fred Couples said, \"I don't know how I can put it more simply . . .", "if he wins all four, it's a Slam.\"", "As noted above, however, because there is no official definition, there is no definitive answer.", "Only five golfers have won all four of golf's modern majors at any time during their careers, an achievement which is often referred to as a \"Career Grand Slam\": Gene Sarazen, Ben Hogan, Gary Player, Jack Nicklaus, and Tiger Woods.", "Woods and Nicklaus have won each of the four majors at least three times.", "A number of dominant players of their eras have failed to achieve the Career Grand Slam because of their inability to win a particular major." ], [ "Grand Slam (tennis)", "However, the ATP and WTA do award ranking points based on a player's performance at a major.", "The term \"Grand Slam\", without qualification, and also originally, refers to the achievement of winning all four major championships within a single calendar year within one of the five events: men's and women's singles; men's, women's, and mixed doubles.", "In doubles, one team may accomplish a Grand Slam playing together or one player may achieve it with different partners.", "Winning the four majors in consecutive tournaments but not in the same year is known as a Non-Calendar Year Grand Slam, while winning all four majors at any point during the course of a career is known as a Career Grand Slam.", "Winning the gold medal at the Summer Olympic Games in addition to the four majors in one calendar year is known as a \"Golden Grand Slam\" or more commonly the \"Golden Slam\".", "Also, winning the Year-End Championship (known as ATP Finals for men's singles and doubles disciplines, and WTA Finals for both women's disciplines) in the same period is known as a \"Super Slam\".", "Together, all four majors in all three disciplines (singles, doubles, and mixed doubles) are called a \"boxed set\" of Grand Slam titles." ] ], "gold": "The Grand Slam is a term used in tennis and golf which refers to winning four major games, and in tennis, it also refers to the four major Grand Slam tournaments. In men's tennis, Roger Federer is the winner of the most grand slams, ever. Novak Djokovic won the most grand slams in 2015 and 2016, while Rafael Nadal and Roger Federer won the most Grand Slam tournaments in 2017. In golf, Jack Nicklaus won the most grand slams ever, and Bobby Jones won the most as an amateur.", "prediction 1": "The term \"Grand Slam\" was first applied to Bobby Jones' achievement of winning the four major golf events of 1930: The Open Championship, the U.S. Open, the U.S. Amateur and the British Amateur. This has been referred to as a \"Consecutive Grand Slam\" or, after the only player to achieve it, a \"Tiger Slam\". Only five golfers have won all four of golf's modern majors at any time during their careers, an achievement which is often referred to as a \"Career Grand Slam\".", "prediction 2": "There are several players who have won a Grand Slam. Bobby Jones has the most men's Grand Slams, followed by Tiger Woods and Jack Nicklaus. The most women's Grand Slams in history are held by Michael Schumacher and Dustin Johnson. The most men's grand slams in history are held by Phil Mickelson, who won the most women's grand slams in 2015 and 2016.", "prediction 3": "The term \"Grand Slam\" is applied to the achievement of winning all four major championships within a single calendar year within one of the five events: men's singles, men's doubles, and mixed doubles. The most men's Grand Slams in singles history is held by Bobby Jones, who won the four major golf events of 1930. The most men's Grand Slams in doubles history has been held by Jack Nicklaus, who has won the most Grand Slams in mixed doubles history. The most professional tennis Grand Slam is a player who has won the most Grand Slams in a singles discipline in the same calendar year is known as a Career Grand Slam.", "prediction 4": "The term Grand Slam, without qualification, and also originally, refers to the achievement of winning all four major championships within a single calendar year within one of the five events: men's singles, mixed doubles, and doubles mixed. The most men's slams won by a single player was Bobby Jones' victory in 1930, which was also referred to as a Grand Slam. However, only five golfers have won the four modern majors at any time during their careers, an achievement which is often referred to as a \"Tiger Slam\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 194 }, { "error type": "Irrelevant", "explanation": "", "start": 195, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 469 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The term \"Grand Slam\" was first applied to winning the four major golf events and in tennis, it also refers to the four major Grand Slam tournaments. In golf Tiger Woods and Jack Nicklaus have won each of the four majors at least three times." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who is top goalscorer in the world cup?", "passages": [ [ "Miroslav Klose", "Miroslav Klose\n\nMiroslav Josef Klose (, ; born 9 June 1978) is a German former professional footballer who last played as a striker for Italian club Lazio and the Germany national team.", "Klose is the coach of the U17 youth team at Bayern Munich.", "Klose is best known for his performances with the Germany national team.", "He was part of the German squad that won the 2014 FIFA World Cup, having previously finished second (2002) and third (2006, 2010) in the competition, and as runner-up in UEFA Euro 2008 and joint-third place in UEFA Euro 2012.", "Klose is the top goalscorer in the history of the FIFA World Cup with 16 goals, having scored five goals in his debut World Cup in 2002 and having won the Golden Boot at the 2006 World Cup in Germany by again scoring five times.", "He also scored four times in the 2010 World Cup and twice at the 2014 World Cup, the latter tournament where he overtook Ronaldo's then-record of 15 goals to top the all-time list.", "Klose is also the top scorer of all time for Germany, which never lost a game in which Klose scored, and one of the very few players ever to have won gold, silver and bronze medals in the World Cup (bronze in 2006 and 2010, silver in 2002 and gold in 2014)." ], [ "Marta (footballer)", "Marta (footballer)\n\nMarta Vieira da Silva (born 19 February 1986), commonly known as Marta, is a Brazilian footballer who plays for the Orlando Pride in the National Women's Soccer League and the Brazil national team as a forward.", "With 15 goals, she holds the record for most goals scored at FIFA Women's World Cup tournaments, ahead of Birgit Prinz and Abby Wambach, both with 14 goals.", "Marta is often regarded as the best female player of all time and was given the nickname \"Pel\u00e9 in skirts\" by Pel\u00e9 himself.", "She was named FIFA World Player of the Year six times, five of them being consecutive, from 2006 and 2010, and the latest one coming in 2018.", "She was a member of the Brazilian national teams that won the silver medal at the 2004 and 2008 Summer Olympics.", "She was also awarded the Golden Ball (MVP) at the 2004 FIFA U-19 Women's World Championship, and won both the Golden Ball award as the best player and the Golden Boot award as the top scorer in the 2007 Women's World Cup after leading Brazil to the final of the tournament.", "In January 2013 she was named as one of the six Ambassadors of the 2014 FIFA World Cup in Brazil, alongside Amarildo, Bebeto, Carlos Alberto Torres, Ronaldo and Mario Zagallo." ], [ "FIFA World Cup", "Brazil's Djalma Santos (1954\u20131962), West Germany's Franz Beckenbauer (1966\u20131974) and Germany's Philipp Lahm (2006\u20132014) are the only players to be named to three Finals All-Star Teams.", "Miroslav Klose of Germany (2002\u20132014) is the all-time top scorer at the finals, with 16 goals.", "He broke Ronaldo of Brazil's record of 15 goals (1998\u20132006) during the 2014 semi-final match against Brazil.", "West Germany's Gerd M\u00fcller (1970\u20131974) is third, with 14 goals.", "The fourth placed goalscorer, France's Just Fontaine, holds the record for the most goals scored in a single World Cup; all his 13 goals were scored in the 1958 tournament.", "In November 2007, FIFA announced that all members of World Cup-winning squads between 1930 and 1974 were to be retroactively awarded winners' medals.", "This made Brazil's Pel\u00e9 the only player to have won three World Cup winners' medals (1958, 1962, and 1970, although he did not play in the 1962 final due to injury), with 20 other players who have won two winners' medals." ] ], "gold": "There is a men's and women's FIFA world cup tournament. The the top goalscorer in the men's FIFA world cup is German player, Miroslav Klose. And in the women's division, the top goalscorer is a Brazilian player, most commonly known as Marta. ", "prediction 1": "Miroslav Klose is the top goalscorer in the history of the FIFA World Cup with 16 goals, having scored five goals in his debut World Cup in 2002 and having won the Golden Boot at the 2006 World Cup in Germany by again scoring five times. He also scored four times in the 2010 World Cup and twice at the 2014 World Cup, the latter tournament where he overtook Ronaldo's then-record of 15 goals to top the all-time list. Marta Vieira da Silva, a Brazilian footballer, holds the record for most goals scored at FIFA Women's World Cup tournaments, with 15 goals, ahead of Birgit Prinz and Abby Wambach, both with 14 goals.\n", "prediction 2": "There is more than one top goalscorer in the history of the FIFA World Cup. Miroslav Klose is the top goalscorer in the history of the competition with 16 goals. He broke Ronaldo's record of 15 goals during the 2014 semi-final match against Brazil. Marta Vieira da Silva is the top goalscorer in the Women's World Cup with 15 goals. The fourth placed goalscorer, France's Just Fontaine, holds the record for the most goals scored in a single World Cup.", "prediction 3": "In the 2003-2004 World Cup, Ronaldo set the record for most goals with 15, but Miroslav Klose and Marta Vieira da Silva now hold the record for most goals in any World Cup tournament. In the 2014 World Cup, Klose and Marta Vieira da Silva both set a record with 15 goals each. Brazil's Djalma Santos scored the most goals at the tournament, with 15 goals, and French striker Just Fontaine also scored the most goals at the World Cup, with 13 goals. In the 2015, Klose is the top goal scorers in the history of the World Cup. The all-time top goal difference is the most scored in a single World Cup.", "prediction 4": "Lloris Capello, known professionally as Miroslav Klose, is the top goalscorer in the history of the FIFA World Cup with 16 goals, 34 more than the Brazilian record holder Ronaldo, 31. In the world cup finals, Miroslav Klose is the top goalscorer with 31, having scored five goals in his debut World Cup in 2002 and having won the Golden Boot at the 2006 World Cup in Germany, again scoring five times. Also, in the time between 2002 and 2014, he is the all-time top scorer at the finals, 16 goals, broadbandiae Marta Vieira da Silva holds the record for the most goals scored at a Women's World Cup tournaments, ahead of Birgit Prinz and Abby Wambach with 14 goals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 237 }, { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 418 }, { "error type": "Irrelevant", "explanation": "", "start": 531, "end": 619 } ], "missing-info": [], "corrected-prediction": "Miroslav Klose is the top goalscorer in the history of the FIFA World Cup. Marta Vieira da Silva, a Brazilian footballer, holds the record for most goals scored at FIFA Women's World Cup tournaments.\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Most hits in an mlb game by one player?", "passages": [ [ "Rennie Stennett", "Rennie Stennett\n\nRenaldo Antonio Stennett Porte (born April 5, 1951), is a Panamanian former second baseman in Major League Baseball.", "Stennett played with the Pittsburgh Pirates (1971\u201379) and San Francisco Giants (1980\u201381).", "He batted and threw right-handed.", "A World Series champion with the Pirates in 1979, Stennett is one of three players to go 7-for-7 in a game, which he did in a 22\u20130 victory over the Chicago Cubs.", "He was also a member of the first all-black starting lineup in the major leagues.", "In an 11-season career, Stennett was a .274 batter, with 41 home runs and 432 RBIs in 1,237 games.", "He was a good contact hitter with occasional power, and an aggressive and smart runner on the basepaths.", "As a fielder, Stennett had sure hands for fielding balls up the middle, as well as a strong and accurate arm to help complete double plays.", "Early in his career, Stennett played for four minor league teams in the Pirates' farm system: the Class A Gastonia Pirates (1969), the Class A Salem Rebels (1970), the Triple-A Columbus Jets (1970), and the Triple-A Charleston Charlies (1971)." ], [ "Wilbert Robinson", "Wilbert Robinson\n\nWilbert Robinson (June 29, 1863 \u2013 August 8, 1934), nicknamed \"Uncle Robbie\", was an American catcher, coach and manager in Major League Baseball.", "He was inducted into the Baseball Hall of Fame in 1945.", "Born in Bolton, Massachusetts, Robinson was a catcher in the minor New England League in 1885 and made it to the major leagues in 1886 with the Philadelphia Athletics of the American Association, where he remained until 1890.", "He lasted in the majors until , playing much of his career with two separate Baltimore Orioles franchises \u2013 from 1890 to 1899 with the Orioles team which folded after the 1899 National League season, and in 1901\u201302 with the American League team which moved to New York City in and became the Yankees.", "He also spent one season, , with the St. Louis Cardinals.", "Over the course of his career, Robinson played 1,316\u00a0games as a catcher, which prepared him for his second baseball career as a manager.", "The star catcher of the Orioles dynasty which won three straight titles from 1894 to 1896, he compiled a career batting average of .273, with a peak of .353 in the heavy-hitting season of 1894.", "Durable behind the plate, he caught a triple-header in 1896, followed by a double-header the following day." ] ], "gold": "The players with the most hits in a single MLB game are Rennie Stennett and Wilber Robinson. Rennie Stennett was a Panamanian professional baseball second baseman, who played in Major League Baseball (MLB) for the Pittsburgh Pirates (1971\u201379) and San Francisco Giants (1980\u201381). Wilber Robinson, nicknamed \"Uncle Robbie\", was an American catcher, coach and manager in Major League Baseball (MLB). The most hits achieved in a single MLB game was 7.", "prediction 1": "The player with the most hits in an MLB game is Renaldo Antonio Stennett, who played with the Pittsburgh Pirates from 1971 to 1979. He is also one of three players to go 7-for-7 in a game, which he did in a 22\u20130 victory over the Chicago Cubs. The player with the most hits in an MLB game is Wilbert Robinson, who played for the Baltimore Orioles from 1894 to 1896.\n", "prediction 2": "The Major League most hits by one player is 518, recorded during the 1891\u20131897 season by second baseman Rennie Stennett. Also in 1891, Wilbert Robinson, another American catcher, was the player who recorded the most RBIs in an MLB game and was the player who had the most home runs in an MLB game in 1973.", "prediction 3": "Wilbert Robinson, also known as Uncle Robbie, is the player with the most hits in an MLB game. He had 694 hits in his MLB career, 4,271 hits in his MLB playoff career, and 470 RBIs in 1,000 games. Others with the most hits in an MLB game include Reggie Jackson, Chris Sale, and Rafael Soto.", "prediction 4": "Most hits in an MLB game by one player is the number 1128 by Renaldo Antonio Stennett Porte, a Panamanian former second baseman in Major League Baseball, who has gone 7-for-7 in a game. The most hits in an MLB game by a player is by Wilbert Robinson, an American catcher, coach and manager in Major League Baseball, who has gone.279 or higher in a career.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 365 }, { "error type": "Redundant", "explanation": "The player with the most hits in an MLB game ", "start": 243, "end": 287 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When will the next star wars movie be released?", "passages": [ [ "Star Wars sequel trilogy", "In September, it was reported that Gugu Mbatha-Raw, Tatiana Maslany, Gina Rodriguez, Olivia Cooke, and Bel Powley were on the shortlist for two separate parts.", "Jimmy Vee was cast as R2-D2, succeeding Kenny Baker, who would die the next year.", "Some pre-production filming took place in September 2015 on the island of Skellig Michael, Ireland to take advantage of better weather conditions.", "Abrams revealed that the film's script was completed in a November 2015 interview with \"Wired\".", "In December, Hamill, Isaac, Christie, and Boyega were confirmed to reprise their roles as Luke Skywalker, Poe Dameron, Captain Phasma, and Finn, respectively.", "Kennedy announced at the December 17 London premiere of \"The Force Awakens\" that most of its cast would return for \"Episode VIII\".", "On January 20, 2016, Lucasfilm and Disney announced that the release of the film would be delayed from May to December 2017.", "Three days later, the release date of December 15, 2017 was confirmed, as well as the title \"Star Wars: The Last Jedi\".", "Principal photography began in February 2016; additional filming took place in Dubrovnik from March 9 to March 16, as well as in Ireland in May.", "Principal photography wrapped in July 2016." ], [ "Star Wars sequel trilogy", "The \"Falcon\" is recaptured by Han and Chewbacca, smugglers again since abandoning the Resistance.", "They agree to help deliver the map inside BB-8 to the Resistance.", "\"Episode VII\" began pre-production on October 30, 2012.", "The screenplay for the film was originally set to be written by Michael Arndt, but time management and creative differences contributed to his departure from the project.", "On January 25, 2013, J.J. Abrams was officially announced as \"Episode VII\"s director and producer, along with producer Bryan Burk and Bad Robot Productions.", "John Williams was hired to compose the music for the entire sequel trilogy.", "In October, it was announced that writing duties would be taken over by Abrams and Lawrence Kasdan, co-writer of \"The Empire Strikes Back\" and \"Return of the Jedi\".", "George Lucas was set to provide Abrams with advice as a creative consultant; however, Lucas had no involvement, with his representative stating that he \"ideally would love not to see any footage until he walks into the theater next December.", "He has never been able to be surprised by a \"Star Wars\" film before and he said he was looking forward to it.\"", "Production began in April 2014; it was released on December 18, 2015." ], [ "Star Wars: The Last Jedi", "In January 2016, \"The Last Jedi\" was rescheduled for December 15, 2017 in 3D and IMAX 3D.", "On January 23, 2017, the film's title was announced as \"Star Wars: The Last Jedi\".", "Similarly to \"The Empire Strikes Back\", \"Return of the Jedi\" and \"The Force Awakens\", \"Episode VIII\" was included in the film's opening crawl, although not in its official title.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017.", "The European premiere was held at London's Royal Albert Hall on December 12, 2017, with a red carpet event.", "It was reported that Disney had placed notable conditions on U.S. cinemas screening \"The Last Jedi\", which some operators described as onerous.", "Disney required that the film be screened in a cinema's largest auditorium for a four-week period (other Disney releases have had similar clauses, but only for two weeks), and was given a 65% cut of ticket sales (a percentage higher than the 55\u201360% average of other major films, and cited as the highest split ever demanded by a Hollywood film behind the 64% split of \"The Force Awakens\").", "The agreement, which was required to be kept confidential, also contained regulations on promotions and restrictions on removing any scheduled screening." ], [ "Star Wars: The Force Awakens", "\"Star Wars: The Force Awakens\" premiered in Los Angeles at the TCL Chinese Theatre, El Capitan Theatre and Dolby Theatre on December 14, 2015.", "A white tent stretched along Hollywood Boulevard from Orange Drive to Highland Avenue, covering the \"massive\" premiere event that hosted more than five thousand guests.", "The film was released in 12 countries, including European nations (such as Italy and France, releasing it on a Wednesday), the Philippines and Thailand on December 16; 32 countries including the United Kingdom (releasing on a Thursday), Mexico and additional European, Asian, African, South American and Oceania countries on December 17; and in North America, Japan, Spain, and Venezuela on December 18, in 3D and IMAX 3D.", "It was released in India on December 25 and in China on January 9, 2016.", "In North America, it had the widest release of December across 4,134 theaters of which 3,300 were 3D locations, a record 392 IMAX screens (13 of which were 70mm), 451 premium large format screens, 146 D-Box locations, as well as releasing in the Dolby Vision format (High dynamic range, Rec. 2020 color) in Dolby Cinema.", "Worldwide, it was released across 940 IMAX theaters, a new record." ], [ "Star Wars: The Clone Wars (film)", "Star Wars: The Clone Wars (film)\n\nStar Wars:", "The Clone Wars is a 2008 American 3D animated science fiction action-adventure film set within the \"Star Wars\" universe, leading into a produced by Lucasfilm Animation.", "The film is set during the three-year time period between the films \"\" (2002) and \"\" (2005), and distributed by Warner Bros. Pictures, who also holds the home media distribution rights to this film, even after Disney's acquisition of Lucasfilm in 2012.", "The film premiered on August 10, 2008 at the Grauman's Egyptian Theatre, while screening in wide-release on August 14, 2008 across Australia, and August 15 in the United States, Canada and the United Kingdom.", "\"The Clone Wars\" served as an introduction to the television series of the same name, which debuted on October 3, 2008.", "Though critical reception was negative, the film was a box office success, and grossed $68.3 million worldwide against an $8.5 million budget.", "It is the only theatrical \"Star Wars\" film not to be distributed by either 20th Century Fox (soon to be owned by Disney) or Walt Disney Studios.", "During the Clone Wars, Jedi Knights Anakin Skywalker and Obi-Wan Kenobi lead a small Republic clone army against the Separatist droid army on the planet ." ] ], "gold": "The movie Star Wars: The Clone Wars was released on August 15, 2008. The movie The Force Awakens was released on December 18, 2015. The movie The Last Jedi was released on December 15, 2017.", "prediction 1": "The Star Wars franchise has produced several films, including the Star Wars: Episode VIII sequel trilogy, which began production in 2012 and was released on December 18, 2015. The film's world premiere was held at the TCL Chinese Theatre, El Capitan Theatre and Dolby Theatre on December 9, 2017. The European premiere was held at the Royal Albert Hall in London on December 12, 2017, with a red carpet event. The film was released in 12 countries, including European nations (such as Italy and France, releasing it on a Wednesday), the Philippines and Thailand on December 16, 2015, the United Kingdom on December 16, 2015.\n", "prediction 2": "Star Wars films from the original trilogy were released beginning with Episode VII on December 18, 2015. Production for Episode VII began on March 30, 2012, during which time the screenplay was finished. On December 17, 2012, production began on Episode VIII, which was released four months later on December 18, 2015. On December 9, 2017, Star Wars: The Last Jedi had its world premiere at the TCL Chinese Theatre in Los Angeles, while the European premiere was held at the Royal Albert Hall in London, on December 12, 2017.", "prediction 3": "The Star Wars franchise continues with the release of the Star Wars films Episode VII and Episode VIII on December 15, 2017, with the first film being released on December 18, 2015. Episode VIII was released on December 13, 2015. Episode VII had its world premiere at the TCL Chinese Theater, El Capitan Theatre and Dolby Theatre in Los Angeles on December 9, 2017, and the European premiere at the Royal Albert Hall in London on December 12, 2017, with a red carpet event.", "prediction 4": "The Star Wars franchise has produced several sequels to the original franchise. Star Wars: Episode VII began pre-production on October 30, 2012 and production for Episode VII began in February 2016. Production for Episode VII ended on December 18, 2015 and the film's release was rescheduled from May to December 2017. On January 23, 2017 the film's title was announced as \"Star Wars: The Last Jedi\". The film's world premiere was held at the TCL Chinese Theatre, El Capitan Theatre and Dolby Theatre on December 9, 2017, and its European premiere was held at the Royal Albert Hall on December 12, 2017, with a red carpet event. It was released in 12 countries, including the Philippines and Thailand on December 16.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4]}", "start": 106, "end": 175 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[1]}", "start": 279, "end": 296 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[3]}", "start": 606, "end": 625 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Star Wars franchise has produced several films. including the Star Wars: Episode VIII, \"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017. The European premiere was held at London's Royal Albert Hall on December 12, 2017, and was rescheduled for December 15, 2017 in 3D and IMAX 3D. \"Star Wars: The Force Awakens\" premiered in Los Angeles at the TCL Chinese Theatre, El Capitan Theatre and Dolby Theatre on December 14, 2015. The film was released in 12 countries, including European nations (such as Italy and France, releasing it on a Wednesday), the Philippines and Thailand on December 16; 32 countries including the United Kingdom (releasing on a Thursday), Mexico and additional European, Asian, African, South American and Oceania countries on December 17; and in North America, Japan, Spain, and Venezuela on December 18, in 3D and IMAX 3D. It was released in India on December 25 and in China on January 9, 2016. Star Wars: The Clone Wars premiered on August 10, 2008 at the Grauman's Egyptian Theatre, while screening in wide-release on August 14, 2008 across Australia, and August 15 in the United States, Canada and the United Kingdom. \n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who won the most wimbledon men's singles titles?", "passages": [ [ "1886 Wimbledon Championships \u2013 Gentlemen's Singles", "1886 Wimbledon Championships \u2013 Gentlemen's Singles\n\nHerbert Lawford defeated Ernest Lewis 6\u20132, 6\u20133, 2\u20136, 4\u20136, 6\u20134 in the All Comers' Final, but the reigning champion William Renshaw defeated Lawford 6\u20130, 5\u20137, 6\u20133, 6\u20134 in the Challenge Round to win the 1886 Wimbledon Championships for a record sixth consecutive year." ], [ "Big Four (tennis)", "ESPN commentator Chris Fowler and Patrick McEnroe even echoed this very remark during the broadcast of this match.", "The 2013 Wimbledon Gentlemen's singles final was the championship tennis match of the Men's Singles tournament at the 2013 Wimbledon Championships.", "It pitted the top two players in the world, Novak Djokovic and Andy Murray against each other for the fourth time in a Grand Slam tournament final.", "After three hours and nine minutes, second seeded Murray defeated world No. 1 Djokovic in three sets to win the match.", "By winning the 2013 Wimbledon Championships, Murray became the first British man since Fred Perry in 1936 to win the Wimbledon title, the first Scottish man since Harold Mahony in 1896 to win the title, and the first British man in the Open Era to do so.", "The 2014 Wimbledon Gentlemen's singles final was the championship match of the Men's Singles tournament at the 2014 Wimbledon Championships.", "A significant part of the Djokovic\u2013Federer rivalry, it pitted Novak Djokovic and Roger Federer against each other in a Grand Slam tournament final for the second time.", "After three hours and 56 minutes, top-seeded Djokovic defeated fourth-seeded Federer in five sets to win the match.", "By winning the 2014 Wimbledon Championships, Djokovic not only won for the second time, but also reclaimed the world number one ranking from Rafael Nadal at the conclusion of the tournament." ], [ "History of tennis", "The British and American championships continued into the Open era but devolved to the status of minor tournaments after the late 1960s.", "The Tournament of Champions was held between 1956 and 1959, the 1956 edition taking place in Los Angeles and the 1957, 1958 and 1959 editions taking place at Forest Hills.", "There was also the Wimbledon Pro tournament held in August 1967, the first tournament where professional tennis players were allowed to play at Wimbledon.", "The \"Open Era\" began in 1968 when major tournaments agreed to allow professional players to compete with amateurs.", "Before 1968, only amateurs were allowed to compete in Grand Slam tournaments and other events organized or sanctioned by the ILTF, including the Davis Cup.", "The move is made because the English are tired of the hypocrisy in the sport, the shamateurism that plagues high-class tennis.", "It is well known that amateurs bargain for \u2013 and receive \u2013 exorbitant expenses to compete at many tournaments.", "\"We must take action on our own account to make the game honest\", said Derek Penmam of the British association.", "\"For too long now we have been governed by a set of amateur rules that are quite unenforceable.\"", "During the first years of the Open Era, power struggles between the ILTF and the commercial promoters led to boycotts of Grand Slam events." ] ], "gold": "The Open era began in 1968, before that time, only amateurs were allowed to compete in Grand Slam tournaments like The Championships, Wimbledon. During the Amateur era, which was before 1968, William Renshaw won the most Wimbledon men's single titles in the challenge round, while Fred Perry won the most in the regular round. Roger Federer has won the most Wimbledon men's single titles in the Open era.", "prediction 1": "The most Wimbledon Men's Singles titles were won by Roger Federer in 2010 and Novak Djokovic in 2013. The most Wimbledon Men's Singles titles were won by Herbert Lawford in 1886, William Renshaw in 1887, and Andy Murray in 2014.", "prediction 2": "The most Wimbledon men's singles titles was held in 1886, when William Renshaw won the title for the sixth consecutive year with a total of 69. The most Wimbledon men's singles titles were held in 2013 and 2014.", "prediction 3": "There are several men's singles titles won at Wimbledon. The most titles won by a player in a single single tennis year was in 1886, when William Renshaw defeated Herbert Lawford 6\u20132, 6\u20133, 2\u20136, 4\u20136, 6\u20134 in the All Comers' Final. In 2013, Novak Djokovic won the most titles in a single tennis year, and in 2014, Roger Federer won the most.", "prediction 4": "The most Wimbledon Men's Singles titles in men's tennis history is 26. In the Open Era, major tournaments agreed to allow professional players to compete with amateurs. During the Open Era, major tournaments agreed to allow professional players to compete with amateurs. Before 1968, only amateurs were allowed to compete in Grand Slam tournaments and other events organized or sanctioned by the ILTF, including the Davis Cup.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 102, "end": 228 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The \"Open Era\" began in 1968 when major tournaments agreed to allow professional players to compete with amateurs. William Renshaw won 1886 Wimbledon Championships for a record sixth consecutive year." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Actress who played alice on the brady bunch?", "passages": [ [ "Ann B. Davis", "Ann B. Davis\n\nAnn Bradford Davis (May 3, 1926\u00a0\u2013 June 1, 2014) was an American actress.", "She achieved prominence for her role in the NBC situation comedy \"The Bob Cummings Show\" (1955\u20131959), for which she twice won the Primetime Emmy Award for Outstanding Supporting Actress in a Comedy Series, but she was best known for playing the part of Alice Nelson, the housekeeper in ABC's \"The Brady Bunch\" (1969\u20131974).", "Davis was born in Schenectady, New York, the daughter of Marguerite (n\u00e9e Stott) and Cassius Miles Davis.", "She had an identical twin, Harriet, and an older brother, Evans.", "When she was three, she and her family moved to Erie in northwestern Pennsylvania.", "She graduated from Strong Vincent High School and later from the University of Michigan in Ann Arbor.", "She originally enrolled as a pre-medical major; however, she changed her mind and went into drama after seeing her older brother's performance of \"Oklahoma!\"", "Davis graduated in 1948 with a degree in drama and speech.", "In the 1953\u20131954 season, Davis appeared as a musical judge on ABC's \"Jukebox Jury\".", "Davis's first television success was as Charmaine \"Schultzy\" Schultz in \"The Bob Cummings Show\", 1955-1959." ], [ "The Brady Bunch", "The Brady Bunch\n\nThe Brady Bunch is an American sitcom created by Sherwood Schwartz that aired from September 26, 1969, to March 8, 1974, on ABC.", "The series revolves around a large blended family with six children.", "Considered one of the last of the old-style family sitcoms, the series aired for five seasons and, after its cancellation in 1974, went into syndication in September 1975.", "While the series was never a critical success or hit series during its original run, it has since become a popular staple in syndication, especially among children and teenaged viewers.", "\"The Brady Bunch\"s success in syndication led to several television reunion films and spin-off series: \"The Brady Bunch Hour\" (1976\u201377), \"The Brady Girls Get Married\" (1981), \"The Brady Brides\" (1981), \"A Very Brady Christmas\" (1988), and \"The Bradys\" (1990).", "In 1995, the series was adapted into a satirical comedy theatrical film titled \"The Brady Bunch Movie\", followed by \"A Very Brady Sequel\" in 1996.", "A second sequel, \"The Brady Bunch in the White House\", aired on Fox in November 2002 as a made-for-television film.", "In 1997, \"Getting Davy Jones\" (season three, episode 12) was ranked number 37 on \"TV Guide\"s 100 Greatest Episodes of All-Time." ] ], "gold": "American actress Ann B. Davis played Alice on the ABC sitcom The Brady Bunch and also on the sitcom's several television reunion films and spin-off series, including The Brady Bunch Hour, The Brady Girls Get Married, The Brady Brides, A Very Brady Christmas, and The Bradys.", "prediction 1": "Ann Bradford Davis played Alice Nelson on The Brady Bunch. Davis achieved prominence for her role in the NBC situation comedy, The Bob Cummings Show, for which she twice won the Primetime Emmy Award for Outstanding Supporting Actress in a Comedy Series.", "prediction 2": "The Brady Bunch is an American sitcom created by Sherwood Schwartz that aired from September 26, 1969, to March 8, 1974, on ABC. In the series, American actress Ann B. Davis played the character of Alice Nelson.", "prediction 3": "The Brady Bunch is a sitcom created by Sherwood Schwartz that aired from September 26, 1969, to March 8, 1974, on ABC. Ann Bradford Davis played Alice Nelson, the housekeeper on the show. In the first three seasons, Davis played Alice Nelson, who was portrayed by actress Elizabeth L. Taylor.", "prediction 4": "The Brady Bunch is an American sitcom created by Sherwood Schwartz that aired from September 26, 1969, to March 8, 1974, on ABC. Ann Bradford Davis played the role of Alice Nelson, the housekeeper on the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 253 } ], "missing-info": [], "corrected-prediction": "Ann Bradford Davis played Alice Nelson on The Brady Bunch. " }, "preference": [ 2, 1, 0, 1, 1, 2 ] }, { "question": "Who was in charge of the lost colony?", "passages": [ [ "Roanoke Colony", "Roanoke Colony\n\nThe Roanoke Colony (), also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America.", "It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina.", "The colony was sponsored by Sir Walter Raleigh, although he himself never set foot in it.", "The initial settlement was established in the summer of 1585, but a lack of supplies and bad relations with the local Native Americans caused many of its members to return to England with Sir Francis Drake a year later, leaving behind a small detachment.", "These men had all disappeared by the time a second expedition led by John White, who also served as the colony's governor, arrived in July 1587.", "White, whose granddaughter Virginia Dare was born there shortly thereafter (making her the first English child born in the New World), left for England in late 1587 to request assistance from the government, but was prevented from returning to Roanoke until August 1590 due to the Anglo-Spanish War.", "Upon his arrival, the entire colony was missing with only a single clue to indicate what happened to them: the word \"CROATOAN\" carved into a tree.", "For many years, it was widely accepted that the colonists were massacred by local tribes, but no bodies were ever discovered, nor any other archaeological evidence." ], [ "Roanoke Island", "The first attempted settlement was headed by Ralph Lane in 1585.", "Sir Richard Grenville had transported the colonists to Virginia and returned to England for supplies as planned.", "The colonists were desperately in need of supplies and Grenville's return was delayed.", "While awaiting his return, the colonists relied heavily upon a local Algonquian tribe.", "In an effort to gain more food supplies, Lane led an unprovoked attack, killing the Secotan tribe's chieftain Wingina and effectively cutting off the colony's primary food source.", "As a result, when Sir Francis Drake put in at Roanoke after attacking the Spanish colony of St. Augustine, the entire population abandoned the colony and returned with Drake to England.", "Sir Richard Grenville later arrived with supplies only to see Lane's abandoned colony.", "Grenville left fifteen soldiers to guard the fort who were killed or driven away by a Roanoke raid led by Wanchese.", "Grenville returned to England taking with him the Native American Raleigh.", "In 1587, the English now led by John White tried to settle in Roanoke Island again.", "At this time the Secotan Tribe and their Roanoke dependents were totally hostile to the English but the Croatoan remained allies." ], [ "Hatteras Island", "The Croatoans were composed of two groups: the Hatterask and the Kinnakeet.", "As Indians were often named by either their main town, their language, or by what they called themselves, Kinnakeet referred to an area on Croatoan Island (modern day Avon) as did Hatterask (modern day Frisco, not modern day Hatteras village).", "The central village was called Croatoan (council town, which is modern day Buxton), which is why the Indians and the Island were referred to by the English as Croatoans from Croatoan.", "The story of the missing colony began when John White finally returned to Roanoke on a fifth voyage to the colony, a much-delayed re-supply mission arriving in 1590.", "At that time, the settlement was found abandoned.", "The only clues to the colonists' whereabouts were the letters \"CRO\" carved into the bark of a nearby tree and the word \"Croatoan\" found carved into the palisade of the fort.", "It is logical that the colonists left on Roanoke had gone back to Croatoan, as they had already lived there and had had a strong relationship with the natives, some of whom had visited England." ] ], "gold": "Sir Walter Raleigh financed and organized two attempts to found the first permanent English settlement in North America, known as the Roanoke Colony. The first colony was established by Governor Ralph Lane in 1585 on Roanoke Island in what is now Dare County, North Carolina, but it was abandoned. Then, in 1587, Governor John White led a second colony on Roanoke Island which became known as the Lost Colony due to the unexplained disappearance of its population. It is thought that the colonists may have relocated to Croatoan Island since the word, croatoan, was found carved into the palisade of the fortified settlement.", "prediction 1": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The colony, sponsored by Sir Walter Raleigh, although he himself never set foot in it. The first attempted settlement was headed by Ralph Lane in 1585. Sir Richard Grenville had transported the colonists to Virginia and returned to England for supplies, but the colonists were desperately in need of supplies and Grenville's return was delayed. The colonists were in need of supplies and Grenville later arrived with supplies only to see Lane's abandoned colony. Grenville later arrived with supplies but left fifteen soldiers to guard the fort. Grenville left fifteen soldiers to guard the fort who were killed or driven away by a Roanok", "prediction 2": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. The colony was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The initial settlement was headed by Ralph Lane in 1585. Sir Richard Grenville had transported the colonists to Virginia and returned to England for supplies as planned. The colonists were desperately in need of supplies and Grenville's return was delayed.", "prediction 3": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The initial settlement was headed by Ralph Lane in 1585. Sir Richard Grenville had transported the colonists to Virginia and returned to England for supplies as planned. The colonists were desperately in need of supplies and Grenville's return was delayed. When White returned to Roanoke Island again, the colony was found abandoned.", "prediction 4": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The colony was sponsored by Sir Walter Raleigh, although he himself never set foot in it. The colony was abandoned in 1590 after an expedition led by John White, who also served as the colony's governor, arrived in July 1587.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 313 }, { "error type": "Irrelevant", "explanation": "", "start": 379, "end": 571 }, { "error type": "Redundant", "explanation": "but the colonists were desperately in need of supplies", "start": 572, "end": 610 }, { "error type": "Irrelevant", "explanation": "", "start": 615, "end": 671 }, { "error type": "Redundant", "explanation": "Grenville later arrived with supplies only to see Lane's abandoned colony. ", "start": 690, "end": 727 }, { "error type": "Irrelevant", "explanation": "", "start": 732, "end": 772 }, { "error type": "Redundant", "explanation": "Grenville later arrived with supplies but left fifteen soldiers to guard the fort. ", "start": 773, "end": 822 }, { "error type": "Irrelevant", "explanation": "", "start": 823, "end": 865 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "The Roanoke Colony, also known as the Lost Colony, was the first attempt at founding a permanent English settlement in North America. It was established in 1585 on Roanoke Island in what is today's Dare County, North Carolina. The colony was sponsored by Sir Walter Raleigh. The first attempted settlement was headed by Ralph Lane in 1585. The colony was abandoned. A second expedition led by John White but the entire colony was missing with: the word \"CROATOAN\" carved into the palisade of the fort. It is thought that the colonists left on Roanoke had gone back to Croatoan. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Last cat 4 hurricane to hit puerto rico?", "passages": [ [ "Hurricane Maria", "Hurricane Maria\n\nHurricane Maria is regarded as the worst natural disaster on record to affect Dominica and Puerto Rico, and is also the deadliest Atlantic hurricane since Jeanne in 2004.", "The tenth-most intense Atlantic hurricane on record and the most intense tropical cyclone worldwide in 2017, Maria was the thirteenth named storm, eighth consecutive hurricane, fourth major hurricane, second Category\u00a05 hurricane, and the deadliest storm of the hyperactive 2017 Atlantic hurricane season.", "At its peak, the hurricane caused catastrophic damage and numerous fatalities across the northeastern Caribbean, compounding recovery efforts in the areas of the Leeward Islands already struck by Hurricane Irma.", "Total losses from the hurricane are estimated at upwards of $91.61 billion (2017 USD), mostly in Puerto Rico, ranking it as the third-costliest tropical cyclone on record.", "Originating from a tropical wave, Maria became a tropical storm on September 16, east of the Lesser Antilles.", "Highly favorable environmental conditions allowed the storm to undergo explosive intensification as it approached the island arc.", "The hurricane reached Category\u00a05 strength on September 18 just before making landfall on Dominica, becoming the first Category\u00a05 hurricane on record to strike the island." ], [ "1932 Atlantic hurricane season", "Further inland, heavy rains associated with the system were reported, peaking at in Vicksburg, Mississippi.", "Hurricane San Cipri\u00e1n of 1932
\n\nOn September\u00a025, ships first noted a tropical storm east of the Leeward Islands.", "The tropical storm quickly intensified as it moved towards the west due to a nearby high pressure system, reaching hurricane strength at 0600\u00a0UTC that day.", "As it approached Puerto Rico, the hurricane continued to rapidly intensify, before reaching its peak intensity as a Category\u00a04 hurricane with winds of and a minimum pressure of on September\u00a027, before making landfall near Ceiba, Puerto Rico at 0300\u00a0UTC.", "The hurricane slightly weakened over the island, and after crossing the Mona Passage, made a second landfall in southern areas of the Dominican Republic as a Category\u00a02 hurricane.", "Its passage of Hispaniola significantly weakened the hurricane, downgrading it to tropical strength.", "After brushing Jamaica to the south, the tropical storm struggled to organize, and did not strengthen up until landfall on British Honduras with winds of and an estimated minimum pressure of October\u00a01.", "There, the storm quickly weakened, and dissipated over southeastern Mexico on October\u00a03.", "The hurricane was considered the worst to affect Puerto Rico since the 1928 Okeechobee hurricane.", "Strong storm surge and winds devastated areas of the island coast.", "Winds also knocked out communications systems, hampering relief efforts." ], [ "Effects of Hurricane Georges in Puerto Rico", "Effects of Hurricane Georges in Puerto Rico\n\nThe effects of Hurricane Georges in Puerto Rico included $2\u00a0billion in damages and eight fatalities.", "Hurricane Georges was the first hurricane to cross the entire island since the San Ciprian Hurricane in 1932.", "Georges formed on September 15 as Tropical Depression Seven off the African coast.", "Georges strengthened into a Category 4-hurricane on September 19 as it made landfall in the Lesser Antilles.", "Georges made landfall on the island on September 21 as a Category 3-hurricane.", "Georges caused $2 billion (1998 USD, $2.7 billion 2010 USD) in damage to the island.", "Hurricane Georges began as a tropical wave that moved off the coast of Africa during mid-September 1998.", "Tracking westward, the wave spawned an area of low pressure two days later, which quickly strengthened into a tropical depression.", "On September\u00a016, the depression was upgraded to Tropical Storm Georges, and to Hurricane Georges the next day.", "The storm reached its peak intensity on September\u00a020 with winds of 155\u00a0mph (250\u00a0km/h), just below Category 5 status on the Saffir-Simpson Hurricane Scale.", "Over the following five days, the hurricane tracked through the Greater Antilles, causing over 600 fatalities, mainly in the Dominican Republic and Haiti.", "By September\u00a025, Georges entered the Gulf of Mexico as a Category 2 hurricane." ] ], "gold": "Puerto Rico has been hit by several hurricanes in various categories. For instance, Hurricane Maria, which was the last Category 5 hurricane to hit Puerto Rico as of 2017, devastated the island in September of that year. It was the most intense Atlantic hurricane on record and the deadliest storm of the hyperactive 2017 Atlantic hurricane season. The 1932 San Ciprian hurricane was the last Category 4 hurricane to hit Puerto Rico, with a peak intensity of a Category 4 that crossed the entire island.", "prediction 1": "Hurricane Maria is considered the worst natural disaster on record to affect Dominica and Puerto Rico, and is also the deadliest Atlantic hurricane since Jeanne in 2004. The storm reached its peak intensity as a Category 4 hurricane on September 27, before making landfall near Ceiba, Puerto Rico at 0300 UTC. The storm later weakened after crossing the Mona Passage, making a second landfall in southern areas of the Dominican Republic as a Category 2 hurricane. Hurricane Georges was the first hurricane to cross the entire island since the San Ciprian Hurricane in 1932.", "prediction 2": "Hurricane Maria is the deadliest Atlantic hurricane since 2004. In 2017, Maria was the tenth-most intense Atlantic hurricane on record and the deadliest tropical cyclone worldwide. In 1998, Hurricane Georges was the first hurricane to cross the entire island since the 1932 San Ciprian Hurricane. In 2004, Hurricane Jeanne also hit Puerto Rico. In 2017, Hurricane Irma was the deadliest Atlantic hurricane since Jeanne in 2004. In 2017, Hurricanes Harvey and Irma both hit Puerto Rico. In 2017, Hurricanes Isaac and Maria also caused $21 billion in damages and eight fatalities across the northeastern Caribbean. In 2017, Hurricane Maria became the deadliest Atlantic hurricane on record to strike Puerto Rico.", "prediction 3": "Hurricane Maria was the deadliest storm of the hyperactive 2017 Atlantic hurricane season, the tenth-most intense Atlantic hurricane on record and the deadliest Atlantic cyclone worldwide in 2017. Maria reached its peak intensity as a Category 4 hurricane on September 27, before making landfall near Ceiba, Puerto Rico at 0300 UTC. After quickly intensifying as it approached Puerto Rico, the hurricane reached its peak intensity as a Category 5 hurricane on September 18, just before making landfall on Dominica, becoming the first Category 5 hurricane on record to strike the island. Hurricane Georges was the first hurricane to cross the entire island since the San Ciprian Hurricane in 1932. Georges made landfall on the island on September 21 as a Category 3-hurricane on September 21, before making landfall on the island on September 23, 1998.", "prediction 4": "Hurricane Maria is considered the worst natural disaster on record to affect Dominica and Puerto Rico, and is also the deadliest Atlantic hurricane since Jeanne in 2004. On September 27, 2017, Maria was the fourth major hurricane, second Category 5 hurricane, and the deadliest storm of the hyperactive 2017 Atlantic hurricane season. In 1997, Hurricane Georges was the first hurricane to cross the entire island since the 1928 Okeechobee hurricane. In 1998, Hurricane Georges was the first hurricane to cross the entire island since the San Ciprian Hurricane in 1932.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 169 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 221, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 309 }, { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 463 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Hurricane Maria is the tenth-most intense Atlantic hurricane on record and the most intense tropical cyclone worldwide in 2017. The storm reached its peak intensity as a Category 5 hurricane on September 27. The storm later weakened after crossing the Mona Passage, making a second landfall in southern areas of the Dominican Republic as a Category 2 hurricane. The last Category 4 hurricane to cross the entire island was the San Ciprian Hurricane in 1932." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the beatles stop touring and why?", "passages": [ [ "Break-up of the Beatles", "Break-up of the Beatles\n\nThe Beatles' break-up was a cumulative process during the final years of their career, marked by rumours of a split and by ambiguous comments by the members themselves regarding their future as a band.", "In September 1969, John Lennon privately informed his bandmates that he was leaving the band, but there was no public acknowledgement of the break-up until 10 April 1970, when Paul McCartney announced he was also leaving the group.", "There were numerous causes for the band's break-up, including their resignation from touring in 1966 and the death of their manager Brian Epstein in 1967.", "Conflicts also arose from differences in artistic vision.", "Both George Harrison and Ringo Starr temporarily left the group at various points during 1968 and 1969; by 1970 all four members had begun working on solo projects after realising the likelihood that the band would not regroup.", "Ultimately, animosity made it impossible for the group to continue working together.", "In the ensuing years, there were sporadic collaborative recording efforts among the band members, but never with all four Beatles simultaneously collaborating as a recording or performing group again.", "After Lennon's death in 1980, the remaining three reunited for the \"Anthology\" project in 1994, using two unfinished Lennon demos \u2013 \"Free as a Bird\" and \"Real Love\" \u2013 as a basis for new songs recorded and released as the Beatles." ], [ "Early 1970", "Early 1970\n\n\"Early 1970\" is a song by English musician Ringo Starr, released in April 1971 as the B-side to his hit single \"It Don't Come Easy\".", "It was inspired by the break-up of the Beatles and documents Starr's relationship with his former bandmates, John Lennon, Paul McCartney and George Harrison.", "The lyrics to the verses comment in turn on each of the ex-Beatles' personal lives and the likelihood of each of them making music with Starr again; in the final verse, Starr acknowledges his musical limitations before expressing the hope that all the former Beatles will play together in the future.", "Commentators have variously described \"Early 1970\" as \"a rough draft of a peace treaty\" and \"a disarming open letter\" from Starr to Lennon, McCartney and Harrison.", "Starr recorded the song, under its working title \"When Four Knights Come to Town\", in London in October 1970, midway through the sessions for Lennon's \"John Lennon/Plastic Ono Band\" album.", "The recording features musical contributions from Harrison and German bass player Klaus Voormann, and some Beatles biographers suggest that Lennon might have participated also.", "Writing in 1981, \"NME\" critic Bob Woffinden described the effect of the Beatles' break-up on drummer Ringo Starr as \"shattering\"." ] ], "gold": "The Beatles were an English rock band consisting of John Lennon, Paul McCartney, George Harrison, and Ringo Starr. The band was together from August 1962 to September 1969. The Beatles stopped touring in 1966 because they had grown weary of live performances, and because George, followed by John and Ringo, began to tire of Beatlemania.", "prediction 1": "The Beatles stopped touring during the early 1970s. In September 1969, John Lennon privately informed his bandmates that he was leaving the band, but there was no public acknowledgement of the break-up until April 10, 1970, when Paul McCartney announced he was also leaving the group. In April 1971, Ringo Starr released an album called Early 1970, inspired by the break-up of the Beatles, and documents Starr's relationship with his former bandmates John Lennon, Paul McCartney and George Harrison. In October 1970, Starr recorded the song, under its working title When Four Knights Come to Town, and features contributions from Harrison and German bass player Klaus Voormann.", "prediction 2": "The Beatles' break-up was a cumulative process during the final years of their career, marked by rumours of a split and by ambiguous comments by the members themselves regarding their future as a band. There were numerous causes for the band's break-up, including their resignation from touring in 1966 and the death of their manager Brian Epstein in 1967. Ringo Starr's 1970 song Early 1970 was inspired by the break-up of the Beatles and documents Starr's relationship with his former bandmates, John Lenon, Paul McCartney and Harrison.", "prediction 3": "The Beatles' break-up was a cumulative process during the final years of their career, marked by rumours of a split and by ambiguous comments by the members themselves regarding their future as a band. There were numerous causes for the band's break-up, including their resignation from touring in 1966 and the death of their manager Brian Epstein in 1967. The song Early 1970, released in April 1971, was inspired by the break-up of the Beatles and documents Starr's relationship with his former bandmates, John Lenon, Paul McCartney and George Harrison.", "prediction 4": "The Beatles' break-up was a cumulative process during the final years of their career, marked by rumours of a split and by ambiguous comments by the members themselves regarding their future as a band. In September 1969, John Lennon privately informed his bandmates that he was leaving the band, but there was no public acknowledgement of the break-up until 10 April 1970, when Paul McCartney announced he was also leaving the group. There were numerous causes for the band's break-up, including their resignation from touring in 1966 and the death of their manager Brian Epstein in 1967. There were numerous causes for the band's break-up, including the death of their manager Brian Epstein.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 45, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 285, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 500, "end": 677 } ], "missing-info": [], "corrected-prediction": "The Beatles stopped touring in 1966. Ringo Starr released an album called Early 1970, inspired by the break-up with his former Beatles bandmates John Lennon, Paul McCartney and George Harrison." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wanted to create a railroad from cape town to cairo?", "passages": [ [ "Cape to Cairo Railway", "Cape to Cairo Railway\n\nThe Cape to Cairo Railway is an uncompleted project to cross Africa from south to north by rail.", "This plan was initiated at the end of the 19th century, during the time of Western colonial rule, largely under the vision of Cecil Rhodes, in the attempt to connect adjacent African possessions of the British Empire through a continuous line from Cape Town, South Africa to Cairo, Egypt.", "While most sections of the Cape to Cairo railway are in operation, a major part is missing between northern Sudan and Uganda.", "The original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the \"Daily Telegraph\", which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River.", "The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one.", "Imperialist and entrepreneur Cecil Rhodes was instrumental in securing the southern states of the continent for the British Empire and envisioned a continuous \"red line\" of British dominions from north to south.", "A railway would be a critical element in this scheme to unify the possessions, facilitate governance, enable the military to move quickly to hot spots or conduct war, help settlement and enable intra- and extra-continental goods trade." ], [ "Edwin Arnold", "Edwin Arnold\n\nSir Edwin Arnold KCIE CSI (10 June 183224 March 1904) was an English poet and journalist, who is most known for his work \"The Light of Asia\".", "Arnold was born at Gravesend, Kent, the second son of a Sussex magistrate, Robert Coles Arnold.", "He was educated at King's School, Rochester; King's College London; and University College, Oxford, where he won the Newdigate prize for poetry in 1852.", "He became a schoolmaster, at King Edward's School, Birmingham, and in 1856 went to India as Principal of the Government Sanskrit College at Poona, a post which he held for seven years, which includes a period during the mutiny of 1857, when he was able to render services for which he was publicly thanked by Lord Elphinstone in the Bombay Council.", "Here he received the bias towards, and gathered material for, his future works.", "Returning to England in 1861 he worked as a journalist on the staff of the \"Daily Telegraph\", a newspaper with which he continued to be associated as editor for more than forty years, and of which he later became editor-in-chief." ], [ "Cecil Rhodes", "Cecil Rhodes\n\nCecil John Rhodes PC (5 July 1853 \u2013 26 March 1902) was a British businessman, mining magnate and politician in southern Africa who served as Prime Minister of the Cape Colony from 1890 to 1896.", "An ardent believer in British imperialism, Rhodes and his British South Africa Company founded the southern African territory of Rhodesia (now Zimbabwe and Zambia), which the company named after him in 1895.", "South Africa's Rhodes University is also named after him.", "Rhodes set up the provisions of the Rhodes Scholarship, which is funded by his estate, and put much effort towards his vision of a Cape to Cairo Railway through British territory.", "The son of a vicar, Rhodes grew up in Bishop's Stortford, Hertfordshire, and was a sickly child.", "He was sent to South Africa by his family when he was 17 years old in the hope that the climate might improve his health.", "He entered the diamond trade at Kimberley in 1871, when he was 18, and over the next two decades gained near-complete domination of the world diamond market.", "His De Beers diamond company, formed in 1888, retains its prominence into the 21st century.", "Rhodes entered the Cape Parliament in 1880, and a decade later became Prime Minister." ] ], "gold": "There were several who wanted to create a railroad from Cape Town to Cairo, including English poet and journalist Edwin Arnold, who wanted to create the railroad originally and made the original proposal for a Cape to Cairo railway in 1874, and Cecil John Rhodes, a British mining magnate and politician.", "prediction 1": "The Cape to Cairo Railway is an uncompleted project to cross Africa from south to north by rail. This plan was initiated at the end of the 19th century, during the time of Western colonial rule, largely under the vision of Cecil Rhodes, in the attempt to connect adjacent African possessions of the British Empire through a continuous line from Cape Town, South Africa to Cairo, Egypt. The original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the Daily Telegraph, which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River. The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one. The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgia", "prediction 2": "The original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the Daily Telegraph, which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River. The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one. Cecil John Rhodes, a British businessman, mining magnate and politician in southern Africa, who served as Prime Minister of the Cape Colony from 1890 to 1896. The original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the Daily Telegraph, which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River. The proposed route involved a mixture of railway and river transport between Elizabethville", "prediction 3": "The 1874 original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the Daily Telegraph, which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River. The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one. Rhodes put much effort towards his vision of a Cape to Cairo Railway through British territory.", "prediction 4": "The Cape to Cairo Railway was an unfinished project to cross Africa from south to north by rail. The original proposal for a Cape to Cairo railway was made in 1874 by Edwin Arnold, then the editor of the Daily Telegraph, which was joint sponsor of the expedition by H.M. Stanley to Africa to discover the course of the Congo River. The route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 470, "end": 620 }, { "error type": "Irrelevant", "explanation": "", "start": 621, "end": 808 }, { "error type": "Redundant", "explanation": "The proposed route involved a mixture of railway and river transport between Elizabethville, now Lubumbashi in the Belgian Congo and Sennar in the Sudan rather than a completely rail one. ", "start": 809, "end": 930 }, { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 323 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The original proposal for a Cape to Cairo railway, a continuous line from Cape Town, South Africa to Cairo, Egypt, was made in 1874 by Edwin Arnold, an English poet and journalist. Cecil Rhodes, a British businessman, mining magnate and politician, also wanted a Cape to Cairo Railway through British territory." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When did they change the australian national anthem?", "passages": [ [ "Advance Australia Fair", "In January 1976 the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defence and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity.", "This was conducted as a plebiscite to choose the National Song, held as an optional additional question in the 1977 referendum on various issues.", "\"Advance Australia Fair\" received 43.29% of the vote, defeating the three alternatives, \"Waltzing Matilda\" (28.28%), \"Song of Australia\" (9.65%) and the existing national anthem, \"God Save the Queen\" (18.78%).", "\"Advance Australia Fair\", with modified lyrics from the original (see development of lyrics), was adopted as the Australian national anthem on 19 April 1984 by a proclamation by the Governor-General, Sir Ninian Stephen, on a recommendation by the Labor government of Bob Hawke.", "\"God Save the Queen\", now known as the royal anthem, continues to be played alongside the Australian national anthem at public engagements in Australia that are attended by the Queen or members of the Royal Family." ], [ "Advance Australia Fair", "The contest was held in two stages, the first seeking lyrics and the second music, each having an A$5,000 prize for the winning entry.", "On the recommendation of the Council for the Arts, none of the new entries were felt worthy enough, so the contest ended with the suggestions for \"Advance Australia Fair\", \"Waltzing Matilda\" and \"Song of Australia\".", "In 1974 the Whitlam government then performed a nationwide opinion survey to determine the song to be sung on occasions of national significance.", "Conducted through the Australian Bureau of Statistics, it polled 60,000 people nationally.", "\"Advance Australia Fair\" was chosen and was enshrined as the national song, to be used on all occasions excepting those of a specifically regal nature.", "A spokesman for the Prime Minister Gough Whitlam stated that the Government regarded the tune primarily as the national anthem.", "During the 1975 election campaign following the dismissal of Whitlam by Sir John Kerr, it was proposed by David Combe that the song be played at the start of the Labor Party's official campaign launch on 24 November 1975 at Festival Hall, Melbourne.", "Whitlam's speechwriter Graham Freudenberg rejected this idea, on two grounds, one of which was that the status of the anthem was still tentative." ], [ "Waltzing Matilda", "The song was one of four included in a national plebiscite to choose Australia's national song held on 21 May 1977 by the Fraser Government to determine which song was preferred as Australia's national anthem.", "\"Waltzing Matilda\" received 28% of the vote compared with 43% for \"Advance Australia Fair\", 19% for \"God Save the Queen\" and 10% for \"Song of Australia\".", "Australian passports issued from 2003 have had the lyrics of \"Waltzing Matilda\" hidden microscopically in the background pattern of most of the pages for visas and arrival/departure stamps.", "\"Waltzing Matilda\" was used at the 1974 FIFA World Cup and at the Montreal Olympic Games in 1976 and, as a response to the New Zealand All Blacks haka, it has gained popularity as a sporting anthem for the Australia national rugby union team.", "It is also performed, along with \"Advance Australia Fair\", at the annual AFL Grand Final.", "Matilda the Kangaroo was the mascot at the 1982 Commonwealth Games held in Brisbane, Queensland.", "Matilda was a cartoon kangaroo, who appeared as a high mechanical kangaroo at the opening ceremony, accompanied by Rolf Harris singing \"Waltzing Matilda\".", "The Australian women's national soccer team is nicknamed the Matildas after this song." ] ], "gold": "In 1974 a national survey was conducted to change the Australian National Anthem to \"Advance Australia Fair\". In January 1976 the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defense and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity. On 21 May 1977, a formal vote was conducted to make the change. And on 19 April 1984 \"Advance Australia Fair\", with modified lyrics from the original, was adopted as the Australian national anthem. ", "prediction 1": "In 1977, the federal government reintroduced \"God Save the Queen\" as the national anthem for their country. In January 1976, the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defence and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity. Advance Australia Fair, with modified lyrics from the original, was adopted as the Australian national anthem on 19 April 1984 by a proclamation by the Governor-General, Sir Ninian Stephen, on a recommendation by the Labor government of Bob Hawke.", "prediction 2": "The australian national anthem was changed in January 1976 by the Fraser government to \"Advance Australia Fair\", in which the lyrics were altered from the original. On April 19, 1984 the song was adopted as the official national anthem of Australia by a proclamation by the Governor-General, Sir Ninian Stephen, on a recommendation by the Labor government of Bob Hawke.", "prediction 3": "In January 1976 the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defence and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity. This was conducted as a plebiscite to choose the National Song, held as an optional additional question in the 1977 referendum on various issues. Then on May 21, 1977 the Fraser Government held a national plebiscite to choose Australia's national anthem, with modified lyrics from the original, was adopted as the Australian national anthem on April 19, 1984 by a proclamation by the Governor-General, Sir Ninian Stephen, on a recommendation by the Labor government of Bob Hawke.", "prediction 4": "In January 1976 the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defence and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity. This was conducted as a plebiscite to choose the National Song, held as an optional additional question in the 1977 referendum on various issues. Then, on 19 April 1984, the government changed the song to \"Advance Australia Fair\" with modified lyrics from the original. The song was then adopted as the national anthem on 19 April 1984 by a proclamation by the Governor-General, Sir Ninian Stephen, on a recommendation by the Labor government of Bob Hawke.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 521, "end": 641 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In 1974, a nationwide opinion survey to determine the song to be sung on occasions of national significance. In January 1976, the Fraser government reinstated \"God Save the Queen\" for royal, vice-regal, defence and loyal toast occasions as well as making plans to conduct a national poll to find a song for use on ceremonial occasions when it was desired to mark a separate Australian identity. A national plebiscite to choose Australia's national song held on 21 May 1977. Advance Australia Fair, with modified lyrics from the original, was adopted as the Australian national anthem on 19 April 1984." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When was guide dogs for the blind founded?", "passages": [ [ "Guide Dogs for the Blind", "Guide Dogs for the Blind\n\nGuide Dogs for the Blind (GDB) is a guide dog school located in the United States, with campuses in San Rafael, California, and Boring, Oregon.", "It was founded in 1942 by Lois Merrihew and Don Donaldson to help veterans who had been blinded in World War II.", "Guide Dogs for the Blind has about 2000 Guide Dog teams across the United States and Canada.", "Guide Dogs for the Blind was established in 1942 in response to the need for service dogs to help wounded servicemen that were coming back blind from World War II.", "The first building it operated in was a rented house in Los Gatos, California.", "The first dog to graduate through the program was a rescued German Shepherd named Blondie; she was paired with Sgt.", "Leonard Foulk.", "In 1947, the organization moved to their current location in San Rafael, California and in 1995 started a program at a second campus in Boring, Oregon.", "Today GDB is the largest guide dog school in the United States.", "This non-profit organization provides services to blind and visually impaired individuals from the United States and Canada for no cost including well trained service dogs and the veterinary care that goes with them.", "Over the years Guide Dogs for the Blind has worked with different breeds of dogs in order to find the best for training as well as being a lifelong companion." ], [ "The Guide Dogs for the Blind Association", "The Guide Dogs for the Blind Association\n\nThe Guide Dogs for the Blind Association (working name Guide Dogs) is a British charitable organisation founded in 1934.", "Guide Dogs helps blind and partially sighted people across the UK through the provision of guide dogs, mobility and other rehabilitation services.", "They also campaign for the rights of those with visual impairments and invest in eye disease research.", "The head office is near Reading in Berkshire.", "There are four Guide Dog Training Schools in the UK, located in Redbridge, Leamington, Atherton in England and Forfar in Scotland; a breeding centre near Leamington; 20 Mobility Teams and fundraising branches across the UK.", "The charity's filed accounts for the year ended December 2015 show income for the year of \u00a3103.7 million.", "In April 2017 the charity was among 11 charities fined by the Information Commissioner for breaching the Data Protection Act by misusing donors\u2019 personal data.", "It was fined \u00a315,000.", "The guide dog service provides a blind or partially sighted person with a guide dog.", "These dogs are born in the home of a volunteer brood female dog holder and then move to the home of a volunteer puppy walker when six weeks old.", "After 12 to 14 months the dogs will move to a specialist trainer, where they train for around 26 weeks to gain skills.", "This includes three to five weeks of intensive work with their new owner." ] ], "gold": "The Guide Dogs for the Blind Association, known by the working name Guide Dogs, is a British charitable organization that was founded on 30 August 1934. A guide dog school called Guide Dogs for the Blind, was established in California, USA, in 1942. In 1995, Guide Dogs for the Blind started a program at a second campus in Boring, Oregon. Guide Dogs for the Blind is the largest guide dog school in the United States.", "prediction 1": "Guide Dogs for the Blind was founded in 1942 in response to the need for service dogs to help wounded servicemen that were coming back blind from World War II. The first dog to graduate through the program was a rescued German Shepherd named Blondie. The guide dog service provides a blind or partially sighted person with a guide dog. The Guide Dogs for the Blind Association is a British charitable organisation founded in 1934 that helps blind and partially sighted people across the UK by providing guide dogs, mobility and other rehabilitation services.", "prediction 2": "Guide Dogs for the Blind was founded in 1942 by Lois Merrihew and Don Donaldson to help veterans who had been blinded in World War II. Guide Dogs for the Blind is a guide dog school located in the United States, with campuses in San Rafael, California, and Boring, Oregon. It was founded in 1942 in response to the need for service dogs to help wounded servicemen that were coming back blind from World War II. The first dog to graduate through the program was a rescued German Shepherd named Blondie. Guide Dogs for the Blind has about 2000 Guide Dogs across the United States and Canada. Guide Dogs for the Blind provides services to blind and visually impaired individuals from the United States and Canada for no cost including well trained service dogs and the veterinary care that goes with well trained service dogs and rehabilitation services.", "prediction 3": "Guide Dogs for the Blind was founded in 1942 in response to the need for service dogs to help wounded servicemen that were coming back blind from World War II. The first building it operated in was a rented house in Los Gatos, California. In 1947, the organization moved to their current location in San Rafael, California and in 1995 started a program at a second campus in Boring, Oregon. Today Guide Dogs for the Blind has about 2000 Guide Dog teams across the United States and Canada.", "prediction 4": "Guide Dogs for the Blind was founded in 1942 by Lois Merrihew and Don Donaldson to help veterans who had been blinded in World War II. Guide Dogs for the Blind has about 2000 Guide Dog teams across the United States and Canada. Guide Dogs for the Blind Association (working name Guide Dogs) is a British charitable organisation founded in 1934. The charity provides services to blind and partially sighted people across the UK through the provision of guide dogs, mobility and other rehabilitation services.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 430, "end": 558 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Guide Dogs for the Blind Association, known by the working name Guide Dogs, is a British charitable organization that was founded on 30 August 1934. A guide dog school called Guide Dogs for the Blind, was established in California, USA, in 1942. In 1995, Guide Dogs for the Blind started a program at a second campus in Boring, Oregon. Guide Dogs for the Blind is the largest guide dog school in the United States. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did drinking age changed to 21 in illinois?", "passages": [ [ "U.S. history of alcohol minimum purchase age by state", "U.S. history of alcohol minimum purchase age by state\n\nThe alcohol laws of the United States regarding minimum age for purchase have changed over time.", "This history is given in the table below.", "Unless otherwise noted, if different alcohol categories have different minimum purchase ages, the age listed below is set at the \"lowest age given\" (e.g. if the purchase age is 18 for beer and 21 for wine or spirits, as was the case in several states, the age in the table will read as \"18\", not \"21\").", "In addition, the \"purchase age\" is not necessarily the same as the minimum age for \"consumption\" of alcoholic beverages, although they have often been the same.", "As one can see in the table below, there has been much volatility in the states' drinking ages since the\nrepeal of Prohibition in 1933.", "Shortly after the ratification of the 21st amendment in December, most states set their purchase ages at 21 since that was the voting age at the time.", "Most of these limits remained constant until the early 1970s.", "From 1969 to 1976, some 30 states lowered their purchase ages, generally to 18.", "This was primarily because the voting age was lowered from 21 to 18 in 1971 with the 26th amendment.", "Many states started to lower their minimum drinking age in response, most of this occurring in 1972 or 1973." ], [ "U.S. history of alcohol minimum purchase age by state", "Twelve states kept their purchase ages at 21 since repeal of Prohibition and never changed them.", "From 1976 to 1983, several states voluntarily raised their purchase ages to 19 (or, less commonly, 20 or 21), in part to combat drunk driving fatalities.", "In 1984, Congress passed the National Minimum Drinking Age Act, which required states to raise their ages for purchase and public possession to 21 by October 1986 or lose 10% of their federal highway funds.", "By mid-1988, all 50 states and the District of Columbia had raised their purchase ages to 21 (but not Puerto Rico, Guam, or the Virgin Islands, see Additional Notes below).", "South Dakota and Wyoming were the final two states to comply with the age 21 mandate.", "The current drinking age of 21 remains a point of contention among many Americans, because of it being higher than the age of majority (18 in most states) and higher than the drinking ages of most other countries.", "The National Minimum Drinking Age Act is also seen as a congressional sidestep of the tenth amendment.", "Although debates have not been highly publicized, a few states have proposed legislation to lower their drinking age, while Guam has raised its drinking age to 21 in July 2010.", "94." ], [ "Alcohol laws of New Jersey", "Upon repeal of Prohibition and the passage of the Alcoholic Beverage Control Law, the ABC issued regulations that prohibited bars and liquor stores from selling alcohol to a person under 21, which was considered the age of majority at that time.", "In 1939, it became a criminal offense to sell alcohol to a person under 21, and for a person under 21 to purchase or consume alcohol in a licensed establishment.", "The state criminalized the underage possession of alcohol in motor vehicles and other public areas in 1957, possibly in response to young New Jerseyans traveling to New York, where the drinking age was 18, and returning home with liquor.", "For many years laws against underage drinking and the serving of alcohol to minors did not apply on private property, though an adult who supplied a substantial amount of liquor to an underage person could possibly be prosecuted for contributing to the delinquency of a minor Furthermore, arrests and criminal prosecutions for underage drinking in bars or public areas were very uncommon before the 1980s.", "New Jersey's drinking age was lowered to 18 in 1973 as part of a broader legal change which reduced New Jersey's age of majority from 21 to 18.", "Much of the impetus for lowering the drinking age to 18 was to grant returning Vietnam veterans the right to purchase alcohol." ] ], "gold": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. As one can see in the table below, there has been much volatility in the states' drinking ages since the repeal of Prohibition in 1933. Shortly after the ratification of the 21st amendment in December, most states set their purchase ages at 21 since that was the voting age at the time. Most of these limits remained constant until the early 1970s. Illinois first set their drinking age to 21 in 1961. From 1969 to 1976, some 30 states lowered their purchase ages, generally to 18. In 1984, Congress passed the National Minimum Drinking Age Act, which required states to raise their ages for purchase and public possession to 21 by October 1986. By mid-1988, all 50 states and the District of Columbia had raised their purchase ages to 21. Illinois changed their drinking age to 21 for a second time in 1980.", "prediction 1": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. In Illinois, drinking age changed to 21 in 1969, from 1972 to 1973, from 1973 to 1974, from 1976 to 1983, and in 1984, Congress passed the National Minimum Drinking Age Act, which required states to raise their ages for purchase and public possession to 21 by October 1986 or lose 10% of their federal highway funds. In California, drinking age changed to 21 in 1974, from 1973 to 1974, and from 1975 to 1976, from 1976 to 1983. In Wisconsin raised their purchase ages to 19 (or, 20 or, commonly, 20 or 21, in part to combat drunk driving fatalities). In 1984, Congress passed the National Minimum Drinking Age Control, which required states to raise their ages for purchase and public possession to 21 by October 1986 or lose 10% of their federal highway funds. In Michigan's drinking age changed to 21 in 1974.", "prediction 2": "The minimum drinking age in Illinois, formerly known as the 21st state, was lowered to 21 in 1939 and is now 21 in Illinois as of July 1, 1970. In Illinois, the drinking age was lowered to 21 in 1973 as part of a broader legal change which reduced the state's age of majority from 21 to 18. In Illinois, the drinking age was lowered to 20 by the Illinois State Legislature in 1965, but was raised to 21 by the Illinois General Assembly in 1968.", "prediction 3": "The laws of the United States regarding minimum age for purchase have changed over time. In Illinois, drinking age changed to 21 in 1963, and in New Jersey, it changed to 21 in 1965. In Illinois, drinking age changed to 21 in 1974. In New Jersey, drinking age changed to 21 in 1973. In Texas, drinking age changed to 21 in 1974.", "prediction 4": "In Illinois, the drinking age was 21 in 1940. However, in 1973, it was 18 as part of a broader legal change and the state's age of majority was lowered from 21 to 18.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 97, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 370, "end": 413 }, { "error type": "Redundant", "explanation": "in 1984, Congress passed the National Minimum Drinking Age Act, which required states to raise their ages for purchase and public possession to 21 by October 1986 or lose 10% of their federal highway funds. ", "start": 649, "end": 859 }, { "error type": "Unverifiable", "explanation": "", "start": 414, "end": 525 }, { "error type": "Unverifiable", "explanation": "", "start": 526, "end": 648 }, { "error type": "Unverifiable", "explanation": "", "start": 860, "end": 909 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. As one can see in the table below, there has been much volatility in the states' drinking ages since the repeal of Prohibition in 1933. Shortly after the ratification of the 21st amendment in December, most states set their purchase ages at 21 since that was the voting age at the time. Most of these limits remained constant until the early 1970s. From 1969 to 1976, some 30 states lowered their purchase ages, generally to 18. In 1984, Congress passed the National Minimum Drinking Age Control, which required states to raise their ages for purchase and public possession to 21 by October 1986." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is lactase found in the digestive system?", "passages": [ [ "Lactase", "Lactase\n\nLactase is an enzyme produced by many organisms.", "It is located in the brush border of the small intestine of humans and other mammals.", "Lactase is essential to the complete digestion of whole milk; it breaks down lactose, a sugar which gives milk its sweetness.", "Lacking lactase, a person consuming dairy products may experience the symptoms of lactose intolerance.", "Lactase can be purchased as a food supplement, and is added to milk to produce \"lactose-free\" milk products.", "Lactase (also known as lactase-phlorizin hydrolase, or LPH), a part of the \u03b2-galactosidase family of enzymes, is a glycoside hydrolase involved in the hydrolysis of the disaccharide lactose into constituent galactose and glucose monomers.", "Lactase is present predominantly along the brush border membrane of the differentiated enterocytes lining the villi of the small intestine.", "In humans, lactase is encoded by the LCT gene.", "Lactase is an enzyme that some people are unable to produce in their small intestine.", "Without it they can't break down the natural lactose in milk, leaving them with diarrhea, gas and bloating when drinking regular milk." ] ], "gold": "Lactase is an essential enzyme in the digestion of whole milk that is produced by many different organisms. It is located in the brush border of the small intestine of humans and other mammals.", "prediction 1": "In mammals, lactase is located in the brush border of the small intestine. It is essential to the complete digestion of whole milk. Lacking lactase, a person consuming dairy products may experience the symptoms of lactose intolerance.\n", "prediction 2": "Lactase is located in the brush border of the small intestine of mammals. It is essential to the complete digestion of whole milk; it breaks down lactose, a sugar which gives milk its sweetness. Lacking lactase, a person consuming dairy products may experience the symptoms of lactose intolerance. Lactase can be purchased as a food supplement, and is added to milk to produce \"lactose-free\" milk products.", "prediction 3": "Lactase is an enzyme produced by many organisms. It is located in the brush border of the small intestine of humans and other mammals. Lactase is essential to the complete digestion of whole milk; it breaks down lactose, a sugar which gives milk its sweetness. Lacking this enzyme, a person consuming dairy products may experience the symptoms of lactose intolerance. The nonexcessive production of lactase results in increased resistance to the enzyme.", "prediction 4": "Lactase is an enzyme produced by many organisms. It is located in the brush border of the small intestine of all mammals. It breaks down lactose, the sugar which gives milk its sweetness. Lacking lactase, a person consuming dairy products may experience the symptoms of lactose intolerance. In humans, lactase is encoded by the LCT gene.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 235 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lactase is an enzyme produced by many organisms. It is essential to the complete digestion of whole milk. It is located in the brush border of the small intestine of humans and other mammals." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "What is the location of the aztec empire?", "passages": [ [ "Aztec Empire", "Aztec Empire\n\nThe Aztec Empire, or the Triple Alliance (, ]), began as an alliance of three Nahua city-states: , , and .", "These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521.", "The Triple Alliance was formed from the victorious factions in a civil war fought between the city of and its former tributary provinces.", "Despite the initial conception of the empire as an alliance of three self-governed city-states, quickly became dominant militarily.", "By the time the Spanish arrived in 1519, the lands of the Alliance were effectively ruled from , while the other partners in the alliance had taken subsidiary roles.", "The alliance waged wars of conquest and expanded rapidly after its formation.", "At its height, the alliance controlled most of central Mexico as well as some more distant territories within Mesoamerica, such as the Xoconochco province, an Aztec exclave near the present-day Guatemalan border.", "Aztec rule has been described by scholars as \"hegemonic\" or \"indirect\".", "The Aztecs left rulers of conquered cities in power so long as they agreed to pay semi-annual tribute to the Alliance, as well as supply military forces when needed for the Aztec war efforts." ], [ "Spanish conquest of the Aztec Empire", "The Spanish campaign against the Aztec Empire had its final victory on August 13, 1521, when a coalition army of Spanish forces and native Tlaxcalan warriors led by Cort\u00e9s and Xicotencatl the Younger captured the emperor Cuauhtemoc and Tenochtitlan, the capital of the Aztec Empire.", "The fall of Tenochtitlan marks the beginning of Spanish rule in central Mexico, and they established their capital of Mexico City on the ruins of Tenochtitlan.", "Cort\u00e9s made alliances with tributaries city-states (\"altepetl\") of the Aztec Empire as well as their political rivals, particularly the Tlaxcalteca and Texcocans, a former partner in the Aztec Triple Alliance.", "Other city-states also joined, including and polities bordering Lake Texcoco, the inland lake system of the Valley of Mexico.", "Particularly important to the Spanish success was a multilingual (Nahuatl, a Maya dialect, and Spanish) indigenous slave woman, known to the Spanish conquistadors as Do\u00f1a Marina, and generally as La Malinche.", "After eight months of battles and negotiations, which overcame the diplomatic resistance of the Aztec Emperor Moctezuma II to his visit, Cort\u00e9s arrived in Tenochtitlan on November 8, 1519, where he took up residence with fellow Spaniards and their indigenous allies." ], [ "Mexicans", "Mexicans\n\nMexicans () are the people of the United Mexican States, a multiethnic country in North America.", "Mexicans can also be those who identify with the Mexican cultural or national identity.", "The Mexica founded Mexico-Tenochtitlan in 1325 as an \"altepetl\" (city-state) located on an island in Lake Texcoco, in the Valley of Mexico.", "It became the capital of the expanding Mexica Empire in the 15th century, until captured by the Spanish in 1521.", "At its peak, it was the largest city in the Pre-Columbian Americas.", "It subsequently became a \"cabecera\" of the Viceroyalty of New Spain.", "Today the ruins of Tenochtitlan are located in the central part of Mexico City.", "The modern nation of Mexico achieved independence from the Spanish Empire; this began the process of forging a national identity that fused the cultural traits of indigenous pre-Columbian origin with those of European, particularly Iberian, ancestry.", "This led to what has been termed \"a peculiar form of multi-ethnic nationalism\".", "The most spoken language by Mexicans is Mexican Spanish, but some may also speak languages from 68 different indigenous linguistic groups and other languages brought to Mexico by recent immigration or learned by Mexican immigrants residing in other nations." ] ], "gold": "The Aztec Empire is in several locations. The location of the three city-states that made up the Aztec Empire is Mexico-Tenochtitlan, Texcoco, and Tlacopan, with the empire's capital located in Mexico-Tenochtitlan. The combined Aztec Empire is located in and around the Valley of Mexico, where the three city-states ruled from 1428 to 1521.", "prediction 1": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:,, and. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. By the time the Spanish arrived in 1519, the lands of the Alliance were effectively ruled from, while the other partners in the alliance had taken subsidiary roles.", "prediction 2": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:,, and. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. The fall of Tenochtitlan marks the beginning of Spanish rule in central Mexico, and they established their capital of Mexico City on the ruins of Tenochtitlan. Today, the ruins of Tenochtitlan are located in the central part of Mexico City.", "prediction 3": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:,, and. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521.", "prediction 4": "The Aztec Empire, or the Triple Alliance, began as an alliance of three Nahua city-states:,, and. These three city-states ruled the area in and around the Valley of Mexico from 1428 until the combined forces of the Spanish and their native allies under defeated them in 1521. The fall of Tenochtitlan marks the beginning of Spanish rule in central Mexico, and they established their capital of Mexico City on the ruins of Tenochtitlan. The Aztec Empire had been described by scholars as \"hegemonic\" or \"indirect\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 440 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Aztec Empire's three city-states ruled the area in and around the Valley of Mexico from 1428 until 1521. Tenochtitlan was the capital of the Aztec Empire. By the time the Spanish arrived in 1519, the lands of the Alliance were effectively ruled from, while the other partners in the alliance had taken subsidiary roles. At its height, the alliance controlled most of central Mexico as well as some more distant territories within Mesoamerica, such as the Xoconochco province." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the girl in cry me a river video?", "passages": [ [ "Cry Me a River (Justin Timberlake song)", "Timberlake breaks into the house by throwing a rock through a window and proceeds through the woman's house, with anti-gravity jumps and slides, not causing any other visible damage, except for kicking a picture frame of the woman across the living room.", "Then he searches some drawers and finds a video camera, while the driver of the car, Timbaland, signals for his female accomplice in the back of the car, played by model Kiana Bessa, to go in.", "She enters the house and goes with Timberlake to a bedroom, where she starts to undress and kiss him while being filmed.", "They stay in the bedroom for a moment; then the accomplice exits the house but Timberlake stays.", "As the blonde woman returns, he follows her around the house and hides in a closet as she showers.", "He gets closer to her and touches the glass surrounding the shower.", "The blonde woman senses someone in the room and turns around, but Timberlake is gone.", "She leaves the bathroom and goes into her bedroom, where the video he made with his new lover plays on the television.", "Peter Robinson of \"NME\" wrote that the video shows \"what Justin looks like after he's had sex.", "Clue: he looks pretty good.\"" ], [ "Cry Me a River (Justin Timberlake song)", "Cry Me a River (Justin Timberlake song)\n\n\"Cry Me a River\" is a song recorded by American singer and songwriter Justin Timberlake for his debut studio album, \"Justified\" (2002).", "It was written by Timberlake and Scott Storch with producer Timbaland and was inspired by Timberlake's former relationship with singer Britney Spears.", "Jive Records released the song to contemporary hit and rhythmic radio in the United States on November 25, 2002, as the album's second single.", "Accompanied by an electric piano, beatbox, guitars, synthesizers, Arabian-inspired riffs and Gregorian chants, \"Cry Me a River\" is an R&B song about a brokenhearted man who moves on from his last girlfriend, who had cheated on him with another man.", "\"Cry Me a River\" received acclaim from music critics, who considered it a stand-out track on \"Justified\" and praised Timbaland's production.", "The song earned several lists of best of the year and the decade (2000s), while \"Rolling Stone\" included it on their 500 Greatest Songs of All Time at 484.", "It won a Grammy Award for Best Male Pop Vocal Performance at the 2004 ceremony.", "The song peaked at number three on the US \"Billboard\" Hot 100 and Pop Songs charts and charted in the top ten in other countries." ] ], "gold": "Cry Me a River is a song by singer-songwriter Justin Timberlake that was inspired by his former relationship with singer Britney Spears. The blonde girl character in the song's music video is allegedly a portrayal of Britney Spears. Lauren Hastings is the actress who played the part of the blonde girl. There is also a brunette girl character in the music video, which is played by Kiana Bessa.", "prediction 1": "In the cry me a river video, Justin Timberlake searches some drawers and finds a video camera, while the driver of the car, Timbaland, signals for his female accomplice in the back of the car, played by model Kiana Bessa, to go in. The blonde woman enters the house and goes with Timberlake to a bedroom, where she starts undressing and kissing him while being filmed. The accomplice exits the house but Timberlake stays. As the blonde woman returns, he follows her around the house and hides in a closet as she showers. He gets closer to her and turns around, but she is gone. She leaves the bathroom and goes into her bedroom, where the video he makes the video he made with his new lover plays on the television.", "prediction 2": "In the video for Justin Timberlake's song Cry Me A River, the blonde woman who is portrayed by model Kiana Bessa is the girl who is seen breaking into Timberlake's house, throwing a rock through a window. She then proceeds through the woman's house, with anti-gravity jumps and slides, not causing any other visible damage, except for kicking a picture frame of the woman across the living room.", "prediction 3": "Justin Timberlake recorded his song \"Cry Me a River\" for his debut studio album, \"Justified,\" which was released on November 25, 2002. The video features model Kiana Bessa as the girl who steals his camera and starts filming Timberlake as the girl undresses and kisses him while being filmed.", "prediction 4": "\"Cry Me a River\" is a song recorded by American singer and songwriter Justin Timberlake for his debut studio album, \"Justified\". It was written by Timberlake and Scott Storch with producer Timbaland and was inspired by Timberlake's former relationship with singer Britney Spears. Kiana Bessa played the girl in the video.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 231 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 368 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 421 }, { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 577 }, { "error type": "Irrelevant", "explanation": "", "start": 578, "end": 715 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Cry Me a River is a song by singer-songwriter Justin Timberlake that was inspired by his former relationship with singer Britney Spears. There is also a brunette girl character in the music video, which is played by Kiana Bessa. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the original green lantern come out?", "passages": [ [ "Green Lantern", "Green Lantern\n\nGreen Lantern is the name of several superheroes appearing in American comic books published by DC Comics.", "They fight evil with the aid of rings that grant them a variety of extraordinary powers.", "The first Green Lantern character, Alan Scott, was created in 1940 by Bill Finger based on original character designs by Martin Nodell during the initial popularity of superheroes.", "Alan Scott usually fought common criminals in New York City with the aid of his magic ring.", "The Green Lanterns are among DC Comics' longer lasting sets of characters.", "They have been adapted to television, video games, and motion pictures.", "Martin Nodell (using the name Mart Dellon) created the first Green Lantern.", "He first appeared in the Golden Age of comic books in \"All-American Comics\" #16 (July 1940), published by All-American Publications, one of three companies that would eventually merge to form DC Comics.", "This Green Lantern's real name was Alan Scott, a railroad engineer who, after a railway crash, came into possession of a magic lantern which spoke to him and said it would bring power.", "From this, he crafted a magic ring which gave him a wide variety of powers.", "The limitations of the ring were that it had to be \"charged\" every 24 hours by touching it to the lantern for a time, and that it could not directly affect objects made of wood." ], [ "Green Lantern (film)", "Green Lantern (film)\n\nGreen Lantern is a 2011 American superhero film based on the DC Comics character of the same name.", "The film stars Ryan Reynolds, Blake Lively, Peter Sarsgaard, Mark Strong, Angela Bassett and Tim Robbins, with Martin Campbell directing a script by Greg Berlanti and comic book writers Michael Green and Marc Guggenheim, which was subsequently rewritten by Michael Goldenberg.", "The film tells the story of Hal Jordan, a test pilot who is selected to become the first human member of the Green Lantern Corps.", "Hal is given a ring that grants him superpowers, and must confront Parallax, who threatens to upset the balance of power in the universe.", "The film first entered development in 1997; progress remained stalled until Greg Berlanti was hired to write and direct in October 2007.", "Martin Campbell was brought on board in February 2009 after Berlanti was forced to vacate the director's position.", "Most of the live-action actors were cast between July 2009 and February 2010, and filming took place from March to August 2010 in Louisiana.", "The film was converted to 3D during its post-production stage.", "\"Green Lantern\" was released on June 17, 2011, and received generally negative reviews; most criticized the film for its screenplay, inconsistent tone, choice and portrayal of villains, and its use of CGI, while some praised Reynolds' performance." ], [ "Green Lantern (film)", "Reynolds would later voice his dissatisfaction with the film.", "The film underperformed at the box office, grossing $219 million against a production budget of $200 million.", "Due to the film's negative reception and disappointing box office performance, Warner Bros. canceled any plans for a sequel, instead opting to reboot the character in the DC Extended Universe line with the film \"Green Lantern Corps\", set for release in 2020.", "Billions of years ago, beings called the Guardians of the Universe used the green essence of willpower to create an intergalactic police force called the Green Lantern Corps.", "They divided the universe into 3600 sectors, with one Green Lantern per sector.", "One such Green Lantern, Abin Sur of Sector 2814, defeated the malevolent being", "Parallax and imprisoned him in the Lost Sector on the desolate planet Ryut.", "In the present day, Parallax escapes from his prison after becoming strengthened by an encounter with crash survivors who had accidentally fallen into the dugout where Parallax was imprisoned on the abandoned planet.", "Parallax feeds on their fear to gain strength before pursuing and nearly killing Abin Sur, who escapes and crash-lands on Earth where he commands his power ring to find a worthy successor." ] ], "gold": "Martin Nodell created the first Green Lantern, which appeared in the Golden Age of Comic Books in All-American Comics #16 in July 1940. The American superhero film Green Lantern in 2011 was based on the DC Comics character. The world premiere of Green Lantern took place on June 15, 2011 at Grauman's Chinese Theatre in Hollywood, California and was released in North America and the UK two days later on June 17, 2011. It received generally overwhelming negative reviews and was a box office failure, grossing $219 million against a production budget of $200 million.", "prediction 1": "Green Lantern is the name of several superheroes appearing in American comic books published by DC Comics. They fight evil with the aid of rings that grant them a variety of extraordinary powers. The first Green Lantern character, Alan Scott, was created in 1940 by Bill Finger based on original character designs by Martin Nodell during the initial popularity of superheroes. Green Lantern is a 2011 American superhero film based on the DC Comics character of the same name. The film first entered development in 1997; progress remained stalled until Greg Berlanti was hired to write and direct in October 2007.", "prediction 2": "The first Green Lantern, Alan Scott, was created in 1940 by Bill Finger based on original character designs by Martin Nodell during the initial popularity of superheroes. In the 1940 comic All-American Comics #16, Martin Nodell created the first Green Lantern. The first Green Lantern film, Green Lantern: Rise of the Guardians, was released on June 17, 2011.", "prediction 3": "The first Green Lantern character, Alan Scott, was created in 1940 by Bill Finger based on original character designs by Martin Nodell during the initial popularity of superheroes. The first Green Lantern is a fictional superhero appearing in American comic books published by DC Comics. Green Lantern: The Movie, a 2011 superhero film based on the DC Comics character of the same name, premiered on July 24, 2011.", "prediction 4": "The original Green Lantern character was created in 1940 by Bill Finger based on original character designs by Martin Nodell during the initial popularity of superheroes. The Green Lantern brand has since been adapted to television, video games, and motion pictures, including the 2011 superhero film Green Lantern.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 106 }, { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 195 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 476, "end": 612 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Martin Nodell created the first Green Lantern. He first appeared in the Golden Age of comic books in \"All-American Comics\" #16 (July 1940). The American superhero film Green Lantern in 2011 was based on the DC Comics character. \"Green Lantern\" was released on June 17, 2011, and received generally negative reviews. The film underperformed at the box office, grossing $219 million against a production budget of $200 million. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What percentage of the us population has a phd?", "passages": [ [ "Doctorate", "Doctorate\n\nA doctorate (from Latin \"docere\", \"to teach\") or doctor's degree (from Latin \"doctor\", \"teacher\") or doctoral degree (from the ancient formalism \"licentia docendi\") is an academic degree awarded by universities that is, in most countries, a research degree that qualifies the holder to teach at the university level in the degree's field, or to work in a specific profession.", "There are a variety of doctoral degrees, with the most common being the Doctor of Philosophy (PhD), which is awarded in many different fields, ranging from the humanities to the scientific disciplines.", "In the United States and some other countries, there are also some types of vocational, technical, or \"professional degrees\" that are referred to as doctorates.", "Professional doctorates have historically come about to meet the needs of practitioners in a variety of disciplines.", "However, the aims and means of these degrees vary greatly across disciplines making it difficult to claim a universal understanding of professional doctorates.", "Many universities also award \"honorary doctorates\" to individuals who have been deemed worthy of special recognition, either for scholarly work or for other contributions to the university or to society.", "The term \"doctor\" derives from Latin, meaning \"teacher\" or \"instructor\"." ] ], "gold": "The percentage of the US population age 25 to 30 with a PhD, the most common doctoral degree, is 1.12%, while the percentage of the US population 25 and over with a doctorate is 2.03%.", "prediction 1": "A doctorate is an academic degree awarded by universities that is, in most countries, a research degree that qualifies the holder to teach at the university level in the degree's field, or to work in a specific profession. In the United States, where the United States has the largest population, 91% of the population has a doctorate.", "prediction 2": "A doctorate is an academic degree awarded by universities that is, in most countries, a research degree that qualifies the holder to teach at the university level in the degree's field, or to work in a specific profession. In the United States and some other countries, there are also some types of vocational, technical, or \"professional degrees\" that are referred to as doctorates. Professional doctorates have historically come about to meet the needs of practitioners in a variety of disciplines. However, the aims and means of these degrees vary greatly across disciplines, making it difficult to claim a universal understanding of professional doctorates.", "prediction 3": "A doctorate is an academic degree awarded by universities that is, in most countries, a research degree that qualifies the holder to teach at the university level in the degree's field, or to work in a specific profession. In the United States and some other countries, there are also some types of vocational, technical, or \"professional degrees\" that are referred to as doctorates. However, the aims and means of these degrees vary greatly across disciplines making it difficult to claim a universal understanding of professional doctorates.", "prediction 4": "A doctorate is an academic degree awarded by universities that is, in most countries, a research degree that qualifies the holder to teach at the university level in the degree's field, or to work in a specific profession. In the US and in some other countries, there are also some types of vocational, technical, or \"professional degrees\" that are referred to as doctorates. However, the aims and means of these degrees vary greatly across disciplines, making it difficult to claim a universal understanding of professional doctorates. In the US population, a PhD has been awarded in many different fields, ranging from the humanities to the scientific disciplines.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 222 }, { "error type": "Unverifiable", "explanation": "", "start": 223, "end": 335 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When did china become a member of the united nations?", "passages": [ [ "China and the United Nations", "The Nobel Foundation noted that UNHCR, among other contributions, was asked by UN General Assembly (Resolution 1167 and 1784), in 1957 and again in 1962, to assist Chinese refugees in Hong Kong whose numbers are estimated at over one million.", "UNHCR assistance was also given to needy refugees among the Chinese refugees in Macao, and the Tibetan refugees in India and Nepal.", "India hosted some 110,000 Tibetan refugees as of the end of 2001.", "UNHCR estimates that there are 15,000 Tibetans who arrived in Nepal prior to 1990 and were recognized by the Government as refugees.", "The Republic of China (ROC) was a charter member of the United Nations and one of five permanent members of the Security Council until 1971.", "The ROC joined the United Nations as a founding member on 24 October 1945.", "The \"Big Four\" victors of World War II (Republic of China, the Soviet Union, the United Kingdom, and the United States) were the founding members of the United Nations that drafted the United Nations Charter in 1944, which was ratified on 26 June 1945 by the representatives of 50 countries.", "China, in recognition of its long-standing fight against\naggression, was accorded the honor of being\nthe first to sign UN Charter." ], [ "China and the United Nations", "Taiwan independence supporters say that the non-assertion of the claim is mainly due to PRC's public statement that any attempts to change the ROC constitution is interpreted as declaring independence, which will lead to \"military actions\" from the PRC.", "Given the PRC's attitude, even having the General Assembly admit the ROC or \"Taiwan\" as an observer, as with Palestine, would be problematic; the case of Palestine is different from that of the ROC because of the UN's commitment to a two-state solution for the Israeli\u2013Palestinian conflict but not for the Taiwan issue.", "The People's Republic of China (PRC), commonly called China today, was admitted into the UN in 1971 on the 21st time of voting on its application.", "The PRC was admitted into the UN on a vote of 76 in favor, 35 opposed, and 17 abstentions.", "In the 1960s and early 1970s that the United States' close ally, Pakistan, especially under the presidency of Ayub Khan, was carrying out messenger diplomacy to the PRC's entry into the UN by the United States' diplomacy to People's Republic of China in the time of Sino-Soviet split.", "This involved secret visits by American officials to the PRC.", "In 1971, Henry Kissinger made a secret visit to the PRC through Pakistan." ] ], "gold": "The Republic of China joined the United Nations as a founding member on 24 October 1945. They were among the \"Big Four\" victors of World War II (Republic of China, the Soviet Union, the United Kingdom, and the United States) who were the founding members of the United Nations that drafted the United Nations Charter in 1944, which was ratified on 26 June 1945 by the representatives of 50 countries. The People's Republic of China (PRC) was admitted into the UN in 1971 on the 21st time of voting on its application.", "prediction 1": "The People's Republic of China (PRC), commonly called China today, was admitted into the United Nations in 1971 on the 21st time of voting on its application. The PRC was admitted into the UN on a vote of 76 in favor, 35 opposed, and 17 abstentions. The ROC joined the United Nations as a founding member on 24 October 1945.", "prediction 2": "The People's Republic of China, commonly called China today, was admitted into the United Nations in 1971 on the 21st time of voting on its application. The PRC was admitted into the UN on a vote of 76 in favor, 35 opposed, and 17 abstentions.", "prediction 3": "The People's Republic of China, commonly called China today, was admitted into the United Nations in 1971 on the 21st time of voting on its application. President Nixon and the United States first met in a formal capacity as a special envoy for China to the United Nations.", "prediction 4": "The People's Republic of China (PRC), commonly called China today, was admitted into the United Nations in 1971. It became a member of the United Nations in 1971 on the 21st time of voting on its application.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 66 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Republic of China joined the United Nations as a founding member on 24 October 1945.They were among the \"Big Four\" victors of World War II (Republic of China, the Soviet Union, the United Kingdom, and the United States) who were the founding members of the United Nations that drafted the United Nations Charter in 1944, which was ratified on 26 June 1945 by the representatives of 50 countries. The People's Republic of China (PRC) was admitted into the United Nations in 1971 on the 21st time of voting on its application. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did i can't get no satisfaction come out?", "passages": [ [ "I Can't Help Myself (Sugar Pie Honey Bunch)", "I Can't Help Myself (Sugar Pie Honey Bunch)\n\n\"I Can't Help Myself (Sugar Pie Honey Bunch)\" is a 1965 hit song recorded by the Four Tops for the Motown label.", "Written and produced by Motown's main production team Holland\u2013Dozier\u2013Holland, the song is one of the most well-known Motown tunes of the 1960s.", "The song reached number one on the R&B charts and was also the number-one song on the \"Billboard\" Hot 100 for two non-consecutive weeks, from June 12 to June 19 and from June 26 to July 3 in 1965.", "It replaced \"Back in My Arms Again\" by labelmates The Supremes, was first replaced by \"Mr. Tambourine Man\" by The Byrds, then regained the top spot before being replaced by \"(I Can't Get No) Satisfaction\" by The Rolling Stones.", "\"Billboard\" ranked the record as the No. 2 song of 1965.", "It was also the Four Tops first Top 40 single in the UK, reaching #23 on its original release, and a 1970 reissue peaked at #10 in the UK charts." ], [ "Peter Bennett (music promoter)", "During the summer of 1962, Bennett's efforts successfully pushed Nat King Cole's Capitol Records single \"Ramblin' Rose\" into the top 10, a return for Nat after four years.", "In 1963 Bennett began a long-standing business relationship with accountant, turned personal manager Allen Klein.", "Klein at the time held exclusive representation of soul and R&B legend Sam Cooke.", "Bennett assisted in Cooke's return to the top 10 by promoting classics such as \"Another Saturday Night\" and \"Shake\".", "In 1964 Klein and Bennett found themselves at the center of the British Invasion.", "Following the American release of the Beatles' second LP, \"With the Beatles\", and its unprecedented success, Klein arranged business deals to handle the stateside affairs of other leading UK groups, including the Rolling Stones, the Animals and Herman's Hermits.", "It fell on Bennett to persuade disc jockeys coast to coast to break songs such as \"(I Can't Get No) Satisfaction\", \"The House of the Rising Sun\" and \"I'm Henry VIII, I Am\" into nationwide number one hits.", "Bennett believed that the B-side of the Stones' \"Satisfaction\" single, \"The Under Assistant West Coast Promotion Man\", was an ode to himself." ], [ "The Spider and the Fly (song)", "The Spider and the Fly (song)\n\n\"The Spider and the Fly\" is a song by English rock band the Rolling Stones, recorded in May 1965 and first released on the US version of their 1965 album \"Out of Our Heads\".", "In the UK, it was released as the B-side to \"(I Can't Get No) Satisfaction\".", "The song was written by Mick Jagger and Keith Richards.", "The lyrics speak about what the band, especially the leader, will do after their gig is over:\n\nJagger explained in a 1995 interview with \"Rolling Stone\", \"I wasn't really that mad about it, but when you listen to it on record, it still holds up quite interestingly as a blues song.", "It's a Jimmy Reed blues with British pop-group words, which is an interesting combination: a song somewhat stuck in a time warp.\"", "In an AllMusic review, Mike DeGagne describes it as one of their earliest attempts at country music.", "It features early use of the Rolling Stones' \"ancient form of weaving\" by guitarists Richards and Brian Jones.", "Jagger performs harmonica on the recording while Jack Nitzsche provides percussion and keyboards." ] ], "gold": "The song \"I Can't Get No Satisfaction\" from the English Rock band Rolling Stones, was released in the United States as a single by London Records on 6 June 1965. The song wasn't released in the United Kingdom until 20 August 1965, since Decca Records was preparing a live EP for release. ", "prediction 1": "I Can't Get No Satisfaction is a song by the English rock band The Rolling Stones that came out on May 25, 1965. It was originally released on May 24, 1965, in the US as a single and in the UK it was released as the B-side. The song was written by Mick Jagger and Keith Richards and was released on July 2, 1965.", "prediction 2": "The hit song \"(I Can't Get No) Satisfaction\" was released on June 15, 1965. The Spider and the Fly was released on May 15, 1965. The Beatles' version of the song was released in the US on their 1965 album Out of Our Heads.", "prediction 3": "I Can't Get No Satisfaction is a hit song by the Four Tops for the Motown label in 1965. The song reached number one on the R&B charts and was also the number-one song on the Billboard Hot 100 for two non-consecutive weeks, from June 12 to June 19 and from June 26 to July 3. The Rolling Stones also released a song called The Spider and the Fly, which was released as the B-side to the original.", "prediction 4": "I Can't Get No Satisfaction is a song that was recorded in 1965 by the Four Tops for the Motown label. It was released on the US version of their 1965 album Out of Our Heads in the US, and in the UK as the B-side to the original release. The Rolling Stones also released a song entitled I Can't Get No Satisfaction in the UK in 1965, and in the US in 1966, and in the UK in 1970.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 278 }, { "error type": "Unverifiable", "explanation": "", "start": 299, "end": 306 }, { "error type": "Unverifiable", "explanation": "", "start": 99, "end": 106 }, { "error type": "Unverifiable", "explanation": "", "start": 147, "end": 150 } ], "missing-info": [], "corrected-prediction": "I Can't Get No Satisfaction is a song by the English rock band The Rolling Stones, recorded in May 1965 and first released on the US version of their 1965 album \"Out of Our Heads\". In the UK it was released as the B-side. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where did the united states get the statue of liberty?", "passages": [ [ "Statue of Liberty", "Statue of Liberty\n\nThe Statue of Liberty (Liberty Enlightening the World; ) is a colossal neoclassical sculpture on Liberty Island in New York Harbor in New York City, in the United States.", "The copper statue, a gift from the people of France to the people of the United States, was designed by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi and built by Gustave Eiffel.", "The statue was dedicated on October 28, 1886.", "The Statue of Liberty is a figure of Libertas, a robed Roman liberty goddess.", "She holds a torch above her head with her right hand, and in her left hand carries a \"tabula ansata\" inscribed in Roman numerals with \"JULY IV MDCCLXXVI\" (July 4, 1776), the date of the U.S. Declaration of Independence.", "A broken chain lies at her feet as she walks forward.", "The statue became an icon of freedom and of the United States, a national park tourism destination, and is a welcoming sight to immigrants arriving from abroad.", "Bartholdi was inspired by a French law professor and politician, \u00c9douard Ren\u00e9 de Laboulaye, who is said to have commented in 1865 that any monument raised to U.S. independence would properly be a joint project of the French and U.S. peoples." ] ], "gold": "The Statue of Liberty is a colossal neoclassical sculpture on Liberty Island in New York Harbor within New York City, in the United States. it was a gift from the people of France to the people of the United States.", "prediction 1": "The Statue of Liberty is a colossal neoclassical sculpture on Liberty Island in New York Harbor in New York City, in the United States. The copper statue, a gift from the people of France to the people of the United States, was designed by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi and built by Gustave Eiffel. The statue was dedicated on October 28, 1886.", "prediction 2": "The Statue of Liberty is a colossal neoclassical sculpture on Liberty Island in New York Harbor in New York City, in the United States. The copper statue, a gift from the people of France to the people of the United States, was designed by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi and built by Gustave Eiffel. The statue was dedicated on October 28, 1886. The statue became an icon of freedom and of the United States, a national park tourism destination, and a welcoming sight to immigrants arriving from abroad.", "prediction 3": "The copper statue, a gift from the people of France to the people of the United States, was designed by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi and built by Gustave Eiffel. It was installed on Liberty Island in New York Harbor in New York City, in the United States. The statue became an icon of freedom and of the United States, a national park tourism destination, and is a welcoming sight to immigrants arriving from abroad.", "prediction 4": "The Statue of Liberty is a colossal neoclassical sculpture on Liberty Island in New York Harbor in New York City, in the United States. The copper statue, a gift from the people of France to the people of the United States, was designed by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi and built by Gustave Eiffel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 357 } ], "missing-info": [], "corrected-prediction": "The Statue of Liberty is a colossal neoclassical sculpture on Liberty Island in New York Harbor in New York City, in the United States. The copper statue is a gift from the people of France to the people of the United States." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When will spirit riding free season 6 come out?", "passages": [ [ "Spirit Riding Free", "Spirit Riding Free\n\nSpirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\".", "The series was first released on Netflix on May 5, 2017.", "Set during the 19th century in the small frontier town of Miradero, a 12-year-old girl named Lucky, who had recently relocated from the city, encounters a wild kiger mustang named Spirit.", "Offspring of Spirit and Rain from \"\", the horse is caught by wranglers and brought to be \"broken\" in Miradero.", "Lucky gradually bonds with the stallion, and frees him.", "Lucky also meets two other girls, Pru and Abigail, who both own horses, Chica Linda, a palomino, and Boomerang, a pinto horse, respectively.", "They embark on everyday adventures across the land.", "Six episodes of the first season premiered on May 5, 2017.", "The series was renewed for a second season and it premiered on September 8, 2017.", "The series was renewed for a third season and it premiered on November 17, 2017.", "The series was renewed for a fourth season and it premiered on March 16, 2018.", "A fifth season of the show was released on Netflix on May 11, 2018.", "A sixth season of the show was released on Netflix on August 17, 2018." ], [ "Spirit Riding Free", "A seventh season premiered on November 9, 2018.", "The voice director for the first three episodes was Ginny McSwain; Katie McWane took over as voice director subsequent to that.", "<", "onlyinclude>\n\nA DVD collection of all the episodes from seasons 1\u20134, titled \"Spirit Riding Free: Season 1\u20134\" was released on DVD on June 5, 2018 by Universal Pictures Home Entertainment.", "The series is also scheduled for DVD releases in the UK, France, Italy, and Germany." ], [ "2019 Group 10 Rugby League season", "2019 Group 10 Rugby League season\n\nThe 2019 Group 10 Rugby League season will be the 62nd season of a premier rugby league competition in the Central West area of New South Wales.", "It will be run under the auspices of the Country Rugby League.", "It will be the seventh consecutive season to feature nine teams, after the re-admittance of the Blayney Bears in 2013.", "Bathurst Panthers will enter the season as defending champions, after defeating Cowra Magpies 12-10 in the 2018 Premier League decider.", "Panthers five-eighth and goal kicker Willie Wright kicked a match winning conversion with four minutes remaining in the decider played at Cowra's Sid Kallas Oval, sealing Panthers first Premier League title since 2007.", "As well in 2018, St Pat's defeated city rivals Panthers 27-14 in First Grade.", "Panthers overcame Orange CYMS 20-8 in Under 18s.", "St Pat's were too good for Orange Hawks in the Group 10 League Tag decider, winning 16-6.", "Eighteen rounds are expected to be played between April to August, which is expected to be concluded with a finals played under the top five McIntyre System.", "Teams\n\n\nRound 1\n\nRound 2\n\nRound 3\n\nRound 4\n\nRound 5\n\nRound 6\n\nRound 7\n\nRound 8\n\nRound 9\n\nRound 10\n\nRound 11\n\nRound 12\n\nRound 13\n\nRound 14\n\nRound 15\n\nRound 16\n\nRound 17\n\nRound 18" ] ], "gold": "Spirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally animated film, Spirit: Stallion of the Cimarron, and was first released on Netflix on May 5, 2017. The sixth season premiered on August 17, 2018, and it will come out on DVD on September 24, 2019. The seventh season premiered on November 9, 2018, and the eighth season premiered on April 5, 2019. The ninth season is scheduled to premiere in 2021 and a feature film based on the series, titled Spirit Untamed, was released on June 4, 2021.", "prediction 1": "Spirit Riding Free is a computer-animated series produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film \"The Greatest Showman\". Season 6 came out on Netflix on August 17, 2018, a year after the last episode of season 5.", "prediction 2": "Spirit Riding Free is an American computer-animated fantasy adventure show that premiers in the summer of 2017. Season 6 premiered on Netflix on August 17, 2018 and the sixth and final season were released on Netflix on September 11, 2018.", "prediction 3": "Spirit Riding Free is a computer-animated series produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"The Princess Diaries\". Season 6 premiered on May 5, 2017. Season 7 was released on September 8, 2018. Season 8 was released on November 9, 2018.", "prediction 4": "Spirit Riding Free is a computer-animated series produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\". Six episodes of the first season premiered on May 5, 2017. The series was renewed for a second season and it premiered on September 8, 2017. The series was renewed for a third season and it premiered on November 17, 2017. A sixth season of the show was released on Netflix on August 17, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 256, "end": 298 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Spirit Riding Free is a computer-animated series produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film \"The Greatest Showman\". The series was first released on Netflix on May 5, 2017. Season 6 came out on Netflix on August 17, 2018. A seventh season premiered on November 9, 2018." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "What type of volcano is mt. pinatubo?", "passages": [ [ "Mount Pinatubo", "Mount Pinatubo\n\nMount Pinatubo (; ; ; ; ) is an active stratovolcano in the Zambales Mountains, located on the tripoint boundary of the Philippine provinces of Zambales, Tarlac and Pampanga, all in Central Luzon on the northern island of Luzon.", "Its eruptive history was unknown to most before the pre-eruption volcanic activities of 1991, just before June.", "Pinatubo was heavily eroded, inconspicuous and obscured from view.", "It was covered with dense forests which supported a population of several thousand indigenous Aetas.", "Pinatubo is most notorious for its Volcanic Explosivity Index (VEI) 6 eruption on June 15, 1991, the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska.", "Complicating the eruption was the arrival of Typhoon Yunya, bringing a lethal mix of ash and rain to towns and cities surrounding the volcano.", "Predictions at the onset of the climactic eruption led to the evacuation of tens of thousands of people from the surrounding areas, saving many lives.", "Surrounding areas were severely damaged by pyroclastic surges, ash falls, and subsequently, by the flooding lahars caused by rainwater re-mobilizing earlier volcanic deposits." ] ], "gold": "Mount Pinatubois an active stratovolcano in the Zambales Mountains. Pinatubo is most notorious for its VEI-6 eruption on June 15, 1991, the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska. ", "prediction 1": "Mount Pinatubo is an active stratovolcano in the Zambales Mountains, located on the tripoint boundary of the Philippine provinces of Zambales, Tarlac and Pampanga, all in Central Luzon on the northern island of Luzon. Its eruptive history was unknown to most before the pre-eruption volcanic activities of 1991, just before June. Its eruption on June 15, 1991, was the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska.", "prediction 2": "Mount Pinatubo is an active stratovolcano in the Zambales Mountains, located on the tripoint boundary of the Philippine provinces of Zambales, Tarlac and Pampanga, all in Central Luzon on the northern island of Luzon. Its eruptive history was unknown to most before the pre-eruption volcanic activities of 1991, just before June. It is most notorious for its Volcanic Explosivity Index (VEI) 6 eruption on June 15, 1991, the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska.", "prediction 3": "Mount Pinatubo is an active stratovolcano in the Zambales Mountains, located on the tripoint boundary of the Philippine provinces of Zambales, Tarlac and Pampanga, all in Central Luzon on the northern island of Luzon. It is most notorious for its Volcanic Explosivity Index (VEI) 6 eruption on June 15, 1991, the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska.", "prediction 4": "Mount Pinatubo is an active stratovolcano in the Zambales Mountains. It is located on the tripoint boundary of the Philippine provinces of Zambales, Tarlac and Pampanga, all in Central Luzon on the northern island of Luzon. Its eruptive history was unknown to most before the pre-eruption volcanic activities of 1991, just before June.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 329 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Mount Pinatubo is an active stratovolcano in the Zambales Mountains. Pinatubo is most notorious for its Volcanic Explosivity Index (VEI) 6 eruption on June 15, 1991, the second-largest terrestrial eruption of the 20th century after the 1912 eruption of Novarupta in Alaska." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who played the voice of young simba in the lion king?", "passages": [ [ "Simba", "Jonathan Taylor Thomas, who was starring as Randy Taylor on the television sitcom \"Home Improvement\" at the time, was cast as the speaking voice of Young Simba.", "His appearance and personality would later serve as creative inspiration for supervising animator Mark Henn.", "Despite often singing in his work, Broderick opted not to perform his own vocals in the film.", "Toto lead singer Joseph Williams and actor Jason Weaver were hired to dub their respective singing voices.", "Williams' voice is heard on the song \"Can You Feel the Love Tonight\".", "Impressed by Weaver's performance as a young Michael Jackson in the miniseries \"\", songwriters Elton John and Tim Rice recruited him to record \"I Just Can't Wait to Be King\" and \"Hakuna Matata\" while the film was still in its early stages of production.", "As directors, Roger Allers and Rob Minkoff worked closely with the actors in order to ensure credible performances.", "As is frequently done in animated films, the filmmakers videotaped the actors while they recorded their dialogue, allowing the animators to incorporate their specific mannerisms into the designs of their characters.", "When \"The Lion King\" was green-lit, its concept and story were not well received by studio employees." ], [ "Simba", "Simba\n\nSimba is a fictional character who appears in Disney's \"The Lion King\" franchise.", "Introduced in Walt Disney Animation's 32nd animated feature film \"The Lion King\" (1994), the character subsequently appears in its sequels \"\" (1998) and \"The Lion King 1\u00bd\" (2004) as well as the upcoming 2019 remake of the original film directed by Jon Favreau.", "Simba was created by screenwriters Irene Mecchi, Jonathan Roberts and Linda Woolverton.", "While Mark Henn served as Simba's supervising animator as a cub, Ruben A. Aquino animated the character as he appears as an adult.", "Although considered an original character, Simba was inspired by the character Bambi from Disney's \"Bambi\" (1942), as well as the stories of Moses and Joseph from the Bible.", "Additionally, several similarities have been drawn between Simba and Prince Hamlet from William Shakespeare's \"Hamlet.\"", "In 1997, \"The Lion King\" was adapted into a Broadway musical, with actors Scott Irby-Ranniar and Jason Raize originating the roles of the cub and adult Simbas, respectively.", "\"Simba\" is a Swahili word for \"lion\".", "It also has other definitions, such as \"king\"." ], [ "The Lion King", "The Lion King\n\nThe Lion King is a 1994 American animated musical film produced by Walt Disney Feature Animation and released by Walt Disney Pictures.", "It is the 32nd Disney animated feature film, and the fifth animated film produced during a period known as the Disney Renaissance.", "\"The Lion King\" was directed by Roger Allers and Rob Minkoff, produced by Don Hahn, and has a screenplay credited to Irene Mecchi, Jonathan Roberts, and Linda Woolverton.", "Its original songs were written by composer Elton John and lyricist Tim Rice, with a score by Hans Zimmer.", "The film features an ensemble voice cast that includes Matthew Broderick, James Earl Jones, Jeremy Irons, Jonathan Taylor Thomas, Moira Kelly, Nathan Lane, Ernie Sabella, Rowan Atkinson, Robert Guillaume, Madge Sinclair, Whoopi Goldberg, Cheech Marin, and Jim Cummings.", "The story takes place in a kingdom of lions in Africa and was influenced by William Shakespeare's \"Hamlet\".", "\"The Lion King\" tells the story of Simba, a young lion who is to succeed his father, Mufasa, as King of the Pride Lands; however, after Simba's paternal uncle Scar murders Mufasa, Simba is manipulated into thinking he was responsible and flees into exile." ] ], "gold": "In the 1994 Disney animated musical film The Lion King, protagonist and young lion cub Simba is voiced by Johnathan Taylor Thomas, with singing by Jason Weaver. The voice of young Simba is also provided by Matt Weinberg in the 2004 spin-off film The Lion King 1\u00bd, and by JD McCrary in the 2019 remake of the original 1994 film.", "prediction 1": "The 1994 American animated musical film, The Lion King, is about Simba, a young lion who is to succeed his father, Mufasa, as King of the Pride Lands. In the original film, Matthew Broderick played the voice of Young Simba. In its sequels, Joseph Williams lent his voice to Toto singer Joseph Williams, who lent his voice to actor Jason Weaver. In the 2019 remake, Jason Raize lent his voice to characters named Simbas, the adult Simbas.", "prediction 2": "The Lion King is a 1994 American animated musical film produced by Walt Disney Feature Animation and released by Walt Disney Pictures. In the film, Jonathan Taylor Thomas, who was starring as Randy Taylor on the television sitcom Home Improvement at the time, was cast as the speaking voice of Young Simba. In the 2004 remake of the film, Scott Irby-Ranniar originated the role of the adult Simbas, while Moira Kelly originated the role of the cub.", "prediction 3": "The Lion King is the title of a 1994 American animated musical film produced by Walt Disney Feature Animation and released by Walt Disney Pictures. In the 1994 film, Jonathan Taylor Thomas was cast as the speaking voice of young Simba.", "prediction 4": "The Lion King is a 1994 American animated musical film produced by Walt Disney Feature Animation and released by Walt Disney Pictures. In the film, Jonathan Taylor Thomas plays the voice of Young Simba, while Matthew Broderick plays the voice of the adult Simba. In the 2009 remake, Matthew Broderick voices the adult Simba, while Jeremy Irons voices the role of the younger Simba.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 150 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 173, "end": 223 }, { "error type": "Incoherent", "explanation": "", "start": 224, "end": 344 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 345, "end": 437 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the 1994 Disney animated musical film The Lion King, protagonist and young lion cub Simba is voiced by Johnathan Taylor Thomas, with singing by Jason Weaver. In 1997, \"The Lion King\" was adapted into a Broadway musical, with actor Jason Raize originating the role of the adult Simbas." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who holds the record for the fastest kentucky derby?", "passages": [ [ "Sham (horse)", "At a rate of 29.97 frames per second, it translates into a 0.34 seconds gap between the two horses at the wire.", "As, by definition, Secretariat's official winning time of 1:59 is the equivalent of a time between 1:59.40 and 1:59.59 with 1/100th precision, Sham's time can be estimated between 1:59.74 and 1:59.93, making him the second fastest horse in Kentucky Derby history.", "It wasn't until 2001 that another horse won the Derby with a time under two minutes.", "Monarchos won it in 2001 in an electronically timed 1:59.97, which is by convention converted to 1:59.", "No other horse, through the 2018 running of the Kentucky Derby, has ever been below two minutes.", "Sham's individual time of :23 in the closing quarter-mile of the race puts him into company with an elite group of horses that closed under 24 seconds: Whirlaway, the 1941 Triple Crown Winner, whose closing time of :23 stood for 32 years; and Secretariat, who closed it in :23.", "With a Maryland racing record audience of 61,653 looking on, Secretariat defeated Sham for the second time in two weeks in the 98th running of the Grade 1 Preakness Stakes." ], [ "Secretariat (horse)", "Secretariat (horse)\n\nSecretariat (March 30, 1970 \u2013 October 4, 1989) was an American Thoroughbred racehorse who, in 1973, became the first Triple Crown winner in 25 years.", "His record-breaking victory in the Belmont Stakes, which he won by 31 lengths, is widely regarded as one of the greatest races of all time.", "During his racing career, he won five Eclipse Awards, including Horse of the Year honors at ages two and three.", "He was elected to the National Museum of Racing and Hall of Fame in 1974.", "In the List of the Top 100 U.S. Racehorses of the 20th Century, Secretariat is second only to Man o' War (racing career 1919\u20131920), who also was a large chestnut colt given the nickname \"Big Red\".", "At age two, Secretariat finished fourth in his 1972 debut in a maiden race, but then won seven of his remaining eight starts, including five stakes victories.", "His only loss during this period was in the Champagne Stakes, where he finished first but was disqualified to second for interference.", "He received the Eclipse Award for champion two-year-old colt, and also was the 1972 Horse of the Year, a rare honor for a horse so young.", "At age three, Secretariat not only won the Triple Crown, he set speed records in all three races." ], [ "Spokane (horse)", "Spokane (horse)\n\nSpokane, a chestnut Thoroughbred stallion foaled in 1886.", "He was owned and bred by Noah Armstrong of Montana.", "Spokane was sired by Hyder Ali and out of the mare Interpose by Intruder.", "Spokane is the only horse foaled and trained in Montana to ever win the Kentucky Derby.", "He did it in 1889, the same year Montana was admitted to the Union.", "Ridden by Tennessee native Tom Kiley and sent off at 16.4:1 odds, Spokane defeated the heavily favored colt, Proctor Knott and set a new Kentucky Derby record for 1\u00bd miles at 2:34.50.", "Spokane also won two other important races, the American Derby and the Clark Handicap.", "He finished second in the Sheridan Stakes and the Peabody Hotel Handicap, and had a third-place finish in the Pelham Bay Handicap.", "The barn in which Spokane was born, the Doncaster Round Barn, located about two miles north of Twin Bridges, Montana, has been placed on the National Register of Historic Places." ], [ "William Nack", "His investigation met a wall of silence, until one veterinarian spoke to him off the record: cortisone had become the stables' drug of choice to mask the fatigue of injured horses unfit for racing.", "Nack exposed the cortisone scandal to the public in his 1993 feature story \"The Breaking Point\", which told of a filly, So Sly, put down after breaking a leg during a race.", "Secretariat, the Big Red Horse, won the 1973 Kentucky Derby 2\u00bd lengths in front in a time of 1:59.4, breaking the track record of 2:00-flat established by Northern Dancer in 1964.", "With Ron Turcotte aboard, Secretariat ran each quarter-mile faster than the one before.", "Two weeks later, Secretariat won the Preakness.", "Three weeks after that, he won the Belmont to secure the Triple Crown.", "He ran the fastest 1\u00bd miles on dirt in history, 2:24 flat, which sliced more than two seconds off Gallant Man's stakes record.", "Nack recalls Secretariat as a \"chivalrous prince of a colt who was playful and mischievous---he once grabbed my notebook out of my hand with his teeth, when I was talking to his groom, Ed Sweat---and stayed the same as a stallion at Claiborne.", "A kid could have ridden him." ] ], "gold": "There are several records for the fastest Kentucky Derby, including fastest mile and a half and fastest mile and a quarter. Secretariat, an American thoroughbred racehorse and American Triple Crown winner, holds the record for the fastest mile and a quarter in the Kentucky Derby with 1:59.4. Spokane, a chestnut thoroughbred stallion and Kentucky Derby winner, holds the record for the fastest mile and a half in the Kentucky Derby with 2:34.5.", "prediction 1": "Secretariat holds the record for the fastest Kentucky Derby time with a time of 1:59.74. The record for the fastest Kentucky Derby time is held by Spokane. Spokane is an American Thoroughbred racehorse who won the 1973 Triple Crown and set speed records in all three races.\n", "prediction 2": "Secretariat is the horse to hold the record for the fastest Kentucky Derby, with a time of 1:59.73. Another horse to hold the record for the fastest Kentucky Derby has been Monarchos, who won it in 2001.", "prediction 3": "Secretariat holds the record for the fastest Kentucky Derby time for a horse. You can find him at 1:59.74 or 1:59.93 at the 2018 Kentucky Derby. The record for the fastest Kentucky Derby for a horse is held by American Thoroughbred horse Secretariat. Spokane, a chestnut Thoroughbred stallion owned and trained by Noah Armstrong of Montana, is the only horse foaled and trained in Montana to ever win the Kentucky Derby.", "prediction 4": "Secretariat holds the record for the fastest Kentucky Derby time. With an official winning time of 1:59.70, the time between 1:59.40 and 1:59.90 meaning that there is a 1/100th precision time difference between Sham's time and 1:59.70. Sham was the son of Big Red and dam of the Triple Crown winner Man o' War.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[3]}", "start": 80, "end": 88 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 147, "end": 155 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 202, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 178 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "Secretariat holds the record for the fastest Kentucky Derby time with a time of 1:59.4. Secretariat was an American Thoroughbred racehorse and Triple Crown winner. Spokane was a chestnut Thoroughbred stallion that has won the Kentucky Derby. He set a new Kentucky Derby record for 1\u00bd miles at 2:34.50." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When does dragon ball super episode 117 release?", "passages": [ [ "Dragon Ball Z: The History of Trunks", "Dragon Ball Z: The History of Trunks\n\nDragon Ball Z: The History of Trunks, known in Japan as is a single-episode anime special based on Akira Toriyama's \"Dragon Ball\" manga series.", "Originally airing in Japan on February 24, 1993, between , the special is based on an extra chapter of the manga series.", "It depicts an alternate version of the future in which Goku dies from the heart virus that afflicts him during the Androids Saga, and a teenage Trunks tries to defeat the androids as they ravage Earth.", "Goku dies from a viral heart disease, and six months later, all the Z-Fighters except Gohan are killed by Android #17 and Android #18.", "With the death of Piccolo, Kami dies as well and the Dragon Balls are rendered permanently useless, making it impossible for the Z Fighters to be revived.", "Thirteen years later, Gohan, now a Super Saiyan, repeatedly tries to challenge the androids, but they are too strong.", "He begins training Trunks (the son of Vegeta and Bulma), who is eager to defend the Earth.", "Gohan attempts to provoke Trunks enough to trigger his transformation into a Super Saiyan.", "Several times, Trunks comes close, but lacks enough motivation to maintain the form.", "The androids attack an amusement park." ], [ "Dragon Ball Super", "The United States premiere of \"Dragon Ball Super\" obtained 1,063,000 viewers for its 8 p.m. showing on Adult Swim.", "Toonami Africa started airing Dragon Ball Super in Fall 2017 at 15:00 CAT (Central African Time) with an edited Funimation English Dub.", "In Australia, ABC Me started airing Dragon Ball Super on November 3, 2018, with a new episode every Saturday at 2:45 pm.", "Norihito Sumitomo, the composer for \"Battle of Gods\" and \"Resurrection 'F\"', is scoring \"Dragon Ball Super\".", "An original soundtrack for the anime was released on CD by Nippon Columbia on February 24, 2016.", "The first opening theme song for episodes 1 to 76 is by Kazuya Yoshii of The Yellow Monkey.", "The lyrics were penned by Yukinojo Mori who has written numerous songs for the \"Dragon Ball\" series.", "The second opening theme song for episodes 77 to 131 is by enka singer Kiyoshi Hikawa.", "Mori wrote the lyrics for the rock song, while Takafumi Iwasaki composed the music.", "The first ending theme song for episodes 1 to 12 is by Japanese rock band Good Morning America.", "The second ending theme song for episodes 13 to 25 is by the group Key Talk.", "The singer for Funimation's English dub is Professor Shyguy." ] ], "gold": "Episode 117 of the Japanese anime series \"Dragon Ball Super\", \"Showdown of Love! Androids vs Universe 2!!\"\", aired in Japan on November 26, 2017, while airing in the United States on June 29, 2019.", "prediction 1": "Dragon Ball Super is an anime special based on Akira Toriyama's Dragon Ball manga series. The episode 117, 'The History of Trunks', released on February 24, 1993, in Japan. In Asia, ABC Me started airing Dragon Ball Super on November 3, 2018, with a new episode every Saturday at 2:45 pm.", "prediction 2": "Dragon Ball Super is an anime special based on Akira Toriyama's Dragon Ball manga series. Episode 117 released on April 11, 2019. Episode 118 released on April 12, 2020.", "prediction 3": "Dragon Ball Super is a Japanese anime special based on Akira Toriyama's Dragon Ball manga series. Episode 117 of the series originally aired on February 24, 1993. In Australia, ABC Me started airing Dragon Ball Super on November 3, 2018, with a new episode every Saturday at 2:45 pm.", "prediction 4": "Dragon Ball Super is an anime special based on Akira Toriyama's Dragon Ball manga series. Originally airing in Japan on February 24, 1993, between and, the special depicts an alternate version of the future in which Goku dies from the heart virus that afflicts him during the Androids Saga, and a teenage Trunks tries to defeat the androids as they ravage Earth. In Australia, ABC Me started airing Dragon Ball Super on November 3, 2018, with a new episode every Saturday at 2:45 pm.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 89 }, { "error type": "Unverifiable", "explanation": "", "start": 90, "end": 172 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 173, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 288 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When did shawn mendes first album come out?", "passages": [ [ "Shawn Mendes", "He released his debut major label EP in July.", "The EP debuted and peaked at number five on \"Billboard\" 200, selling 48,000 copies in its first week.", "He won a Teen Choice award in 2014 for Webstar in Music.", "On September 5, 2014, \"Oh Cecilia (Breaking My Heart)\" featuring Mendes was released as the fifth single from The Vamps' debut album, \"Meet the Vamps\".", "On November 6, 2014, \"Something Big\" was released as the second single.", "On April 14, 2015, Mendes released his full-length album \"Handwritten\", which debuted at number one on the \"Billboard\" 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum.", "Mendes then became the youngest artist to debut at number one since the release of Justin Bieber\u2019s My World 2.0.", "The third single from the album, \"Stitches\", peaked at number four on the US \"Billboard\" Hot 100, becoming his first top 10 single in the US, and became his first number one on the Adult Pop Songs and Adult Contemporary charts.", "The song later reached number one in the UK.", "Also in 2015, Mendes opened for Taylor Swift during 1989 World Tour dates for North America and recorded \"Believe\" for the soundtrack of Disney Channel Original Movie \"Descendants\"." ], [ "Shawn Mendes", "The album, Illuminate, was released on September 23, 2016 and debuted at number one on the US \"Billboard\" 200 with 145,000 equivalent album units, including 121,000 in pure album sales and was certified platinum.", "It debuted atop the charts in Canada, becoming his second number one album in his home country.", "\"Mercy\" was released as the second single on August 18, 2016, which entered the top 20 in the US and the UK and was certified double platinum.", "Mendes released the live album \"Live at Madison Square Garden\" in December 2016.", "He appeared as the musical guest on Saturday Night Live December 3, 2016.", "In April 2017, Mendes embarked on his Illuminate World Tour which sold out arenas around the world such as Los Angeles' Staples Center and London's The O2 Arena.", "He released the single \"There's Nothing Holdin' Me Back\" on April 20, 2017, included on his \"Illuminate\" deluxe edition.", "The song was Mendes' third single to reach the top 10 in the US and third single to reach number one on both the Adult Contemporary and Adult Pop Songs chart.", "In August 2017, he became the first artist under 20 years old to have three number-one songs on the \"Billboard\" Adult Pop Songs chart." ], [ "The Shawn Mendes EP", "The Shawn Mendes EP\n\nThe Shawn Mendes EP is the debut extended play by Canadian singer Shawn Mendes, released on July 28, 2014 by Island Records.", "It debuted at number 5 on the U.S. \"Billboard\" 200 chart with sales of 48,000 copies in its first week.", "The EP includes the single \"Life of the Party\", which was a moderate success.", "The extended play was later removed from the iTunes Store and \"Show You\", \"One of Those Nights\" and \"The Weight\" were released as separate promotional singles.", "\"The Weight\" was included in the deluxe edition of Mendes' debut studio album \"Handwritten\".", "As of April 2016, the EP has sold 103,000 copies in the United States." ] ], "gold": "Shawn Mendes is a Canadian singer and songwriter, who gained a following in 2013, posting song covers on the video-sharing application Vine. On April 14, 2015, Mendes released his full-length album Handwritten, which debuted at number one on the Billboard 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum. The album, Illuminate, was released on September 23, 2016 and debuted at number one on the US Billboard 200 with 145,000 equivalent album units, including 121,000 in pure album sales and was certified platinum. The Shawn Mendes EP is the debut extended play by Canadian singer Shawn Mendes, released on July 28, 2014 by Island Records and debuted at number 5 on the U.S. Billboard 200 chart with sales of 48,000 copies in its first week. ", "prediction 1": "The first album by Canadian singer Shawn Mendes was released on July 28, 2014. The album Handwritten debuted at number one on the US Billboard 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum.", "prediction 2": "The first Shawn Mendes album, Handwritten, was released on April 14, 2015. The album Illuminate was released on September 23, 2016 and debuted at number one on the US Billboard 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum. It debuted at number one on the US Billboard 200 with 145,000 equivalent album units, including 121,000 in pure album sales and was certified platinum.", "prediction 3": "Shawn Mendes was an American singer, songwriter and actor, best known for his work with The Vamps, on their debut album Meet the Vamps. In 2014, Mendes released his debut major label EP, The Shawn Mendes EP, on July 28, 2014. In 2015, Mendes released his full-length album Handwritten, which debuted at number one on the US Billboard 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum. In 2016, the album Illuminate was released on September 23, 2016, which debuted at number one on the US Billboard 200 chart with 145,000 equivalent album units, including 121,000 in pure album sales and was certified platinum.", "prediction 4": "The Canadian singer-songwriter Shawn Mendes' debut major label album came out in July, 2014. On September 23, 2016, the album, Illuminate, was released, and on April 14, 2015, the album, Handwritten, came out.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 64, "end": 78 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Shawn Mendes is a Canadian singer. On April 14, 2015, Mendes released his full-length album \"Handwritten\", which debuted at number one on the \"Billboard\" 200 chart with 119,000 equivalent album units, selling 106,000 copies in its first week and was certified platinum. The album, Illuminate, was released on September 23, 2016 and debuted at number one on the US \"Billboard\" 200 with 145,000 equivalent album units, including 121,000 in pure album sales and was certified platinum. The Shawn Mendes EP is the debut extended play by Canadian singer Shawn Mendes, released on July 28, 2014 by Island Records. It debuted at number 5 on the U.S. \"Billboard\" 200 chart with sales of 48,000 copies in its first week." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who won the masters for the last 5 years?", "passages": [ [ "Masters Tournament", "Burk planned to protest at the front gates of Augusta National during the third day of the tournament, but her application for a permit to do so was denied.", "A court appeal was dismissed.", "In 2004, Burk stated that she had no further plans to protest against the club.", "Augusta National Chairman Billy Payne himself made headlines in April 2010, however, when he commented (at the annual pre-Masters press conference) on Tiger Woods' off-the-course behavior.", "\"It's not simply the degree of his conduct that is so egregious here,\" Payne said, in his opening speech.", "\"It is the fact he disappointed all of us and more importantly our kids and grandkids.\"", "The 2003 tournament was won by Mike Weir, who became the first Canadian to win a men's major championship, and the first left-hander to win the Masters.", "The following year, another left-hander, Phil Mickelson, won his first major championship by making a birdie on the final hole to beat Ernie Els by a stroke.", "Mickelson also won the tournament in 2006 and 2010.", "In 2011, the tournament was won by South African Charl Schwartzel, who birdied the final four holes to win by two strokes.", "In 2012, Bubba Watson won the tournament on the second playoff hole." ], [ "Masters Tournament", "Masters Tournament\n\nThe Masters Tournament (usually referred to as simply The Masters, or the U.S. Masters outside of North America) is one of the four major championships in professional golf.", "Scheduled for the first full week of April, the Masters is the first major of the year, and unlike the others, it is held at the same location, Augusta National Golf Club, a private course in the southeastern United States, in the city of Augusta, Georgia.", "The Masters was started by noted amateur champion Bobby Jones and investment banker Clifford Roberts.", "After his grand slam in 1930, Jones acquired the former plant nursery and co-designed Augusta National with course architect Alister MacKenzie.", "First played in 1934, the tournament is an official money event on the PGA Tour, the European Tour, and the Japan Golf Tour.", "The field of players is smaller than those of the other major championships because it is an invitational event, held by the Augusta National Golf Club.", "The tournament has a number of traditions.", "Since 1949, a green jacket has been awarded to the champion, who must return it to the clubhouse one year after his victory, although it remains his personal property and is stored with other champions' jackets in a specially designated cloakroom.", "In most instances, only a first-time and currently reigning champion may remove his jacket from the club grounds." ], [ "1948 Masters Tournament", "1948 Masters Tournament\n\nThe 1948 Masters Tournament was the 12th Masters Tournament, held April 8\u201311 at Augusta National Golf Club in Augusta, Georgia.", "Claude Harmon shot a record-tying 279 (\u22129) and finished five strokes ahead of runner-up Cary Middlecoff, a future champion in 1955.", "The Sunday gallery in 1948 was estimated at 10,000 spectators, and the tournament purse was $10,000.", "Harmon won $2,500 and his four-round score tied the record set by Ralph Guldahl in 1939.", "Primarily a club professional, it was Harmon's only tour victory.", "This was the final appearance as a player in the Masters for host Bobby Jones, then age 46.", "It was also the last Masters that did not immediately present the iconic green jacket to the winner.", "The nine winners of the first twelve tournaments received their green jackets in 1949.", "The five-stroke victory margin was matched by Ben Hogan in 1953; the record was raised to seven in 1955 by Cary Middlecoff, nine in 1965 by Jack Nicklaus, and twelve by Tiger Woods in 1997.", "\"Thursday, April 8, 1948\"\n\n\"Friday, April 9, 1948\"\n\n\"Saturday, April 10, 1948\"\n\n\"Sunday, April 11, 1948\"\n\n\"Cumulative tournament scores, relative to par\"" ] ], "gold": "The Masters Tournament is the first of four major golf tournaments of the year. It is held the first full week of April in the same location, Augusta National Golf Club, a private course in the southeastern United States, in the city of Augusta, Georgia. Tiger Woods has won five between 1997 and 2019. The winner in 2017 was Sergio Garc\u00eda Fern\u00e1ndez. The 2016 winner was Danny Willett. The 2015 winner was Jordan Spieth. ", "prediction 1": "The Masters is one of the four major championships in professional golf. The last five years, Tiger Woods has won the Masters, while Mike Weir has won the Masters for 3 of them. In the last 5 years, Charl Schwartzel has won the Masters, while Bubba Watson won the Masters on the second playoff hole in 2012.", "prediction 2": "The Masters is one of the four major championships in professional golf. The most recent winners of the Masters were: Phil Mickelson in 2003, Mike Weir in 2003, Charl Schwartzel in 2011, Bubba Watson in 2012, and Cary Middlecoff in 1955. The previous five winners of the Masters were: Phil Mickelson in 2010, Phil Mickelson in 2006, and Tiger Woods in 1997.", "prediction 3": "The Masters Tournament is one of the four major championships in professional golf. The winner of the Masters for the last five years is Tiger Woods. In the last 5 years, Tiger Woods has won the Masters, while Mike Weir has won it in 2003. Charl Schwartzel has won the Masters in 2011 and 2012. In 2012, Bubba Watson won the Masters on the second playoff hole. The winner of the Masters for the last 5 years is Mike Weir.", "prediction 4": "The Masters, sometimes simply referred to as The Masters, or the United States Masters outside of North America, is one of the four major championships in professional golf. The last five years have seen several winners. The 2003 tournament was won by Mike Weir, who became the first Canadian to win a men's major championship, and the first left-hander to win the Masters. In 2011, the tournament was won by South African Charl Schwartzel, who birdied the final four holes to win by two strokes. In 2012, Bubba Watson won the tournament on the second playoff hole.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 73, "end": 177 }, { "error type": "Unverifiable", "explanation": "", "start": 178, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 307 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Masters is one of the four major championships in professional golf. It is held the first full week of April in the same location, Augusta National Golf Club, a private course in the southeastern United States, in the city of Augusta, Georgia. \n " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the original seasons in the sun?", "passages": [ [ "Seasons in the Sun", "Seasons in the Sun\n\n\"Seasons in the Sun\" is an English-language adaptation of the song \"Le Moribond\" by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen.", "It became a worldwide hit in 1974 for Canadian singer Terry Jacks and became a Christmas number one in the UK in 1999 for Westlife.", "Jacks's version is one of the fewer than forty all-time singles to have sold 10 million copies worldwide.", "Terry Jacks recorded \"Seasons in the Sun\" in Vancouver in 1973 with his then-wife Susan Jacks.", "They made the decision to record the song when The Beach Boys, who had recorded a version with Terry Jacks producing, decided to abandon their recording.", "Jacks released his version as a single in 1973 on his own label, Goldfish Records.", "\"Put the Bone In\", an original composition about burying a deceased pet dog, was included as the B-side.", "The single soon topped the record charts in the U.S. (where it was released on Bell Records), in Canada, and the UK, selling over 14 million copies worldwide.", "Jacks's version was released in the United States in December 1973, and made the \"Billboard\" Hot 100 a month later." ], [ "Seasons in the Sun", "On March 2, 1974, the song began a three-week run at number one atop the Hot 100, and remained in the top 40 until almost Memorial Day weekend.", "Jacks's version also spent one week on the Easy Listening charts.", "\"Billboard\" ranked it as the number two song for 1974.", "Although he released several other singles that were moderately successful in Canada, \"Seasons in the Sun\" would become Jacks's only major solo hit in the United States.", "In Canada, the single (Gold Fish GF 100) reached number one on the RPM Magazine charts January 26, 1974, and remained there four weeks.", "Though the song enjoyed contemporary success, modern criticism has tended to be more critical of Jacks's rewriting of the original song, considering it overly sentimentalized.", "Jacks's version is commonly held up as an example of bad music, having been called one of the worst pop songs ever recorded, and ranking number five in a CNN poll in 2006.", "Jacks also released a German language version in Germany with lyrics by Gerd M\u00fcller-Schwanke, \"In den G\u00e4rten der Zeit\".", "The first recording of the English-language version (lyrics by McKuen) was released on 1963 album Time to Think by the Kingston Trio." ] ], "gold": "The song, Seasons in the Sun, was adapted from a 1961 song called Le Moribond by singer-songwriter Jacques Brel. Rod McKuen translated the lyrics into English and the Kingston Trio, in 1964, recorded the first English version of the song. After hearing the Kingston Trio version, Canadian singer Terry Jacks re-wrote the lyrics. In 1973, Jacks released his rendition of the song and it became a worldwide hit.", "prediction 1": "The original seasons in the sun was sung by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen. Terry Jacks recorded the original seasons in the sun in 1973 with his then-wife Susan Jacks. Jacks's version was released as a single in 1973 on his own label, Goldfish Records.", "prediction 2": "The original Seasons in the Sun was originally sung by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen. In 1973, Canadian singer Terry Jacks sang the original song with his then-wife Susan Jacks. Jacks also sang the original German language version of the song with lyrics by Gerd M\u00fcller-Schwanke, \"In den G\u00e4rten der Zeit\".", "prediction 3": "Seasons in the Sun is an English-language adaptation of the song \"Le Moribond\" by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen. It became a worldwide hit in 1974 for Canadian singer Terry Jacks and became a Christmas number one in the UK in 1999 for Westlife.", "prediction 4": "Seasons in the Sun is an English-language adaptation of the song Le Moribond by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen. It became a worldwide hit in 1974 for Canadian singer Terry Jacks with his then-wife Susan Jacks. Their decision to record the song came when The Beach Boys, who had recorded a version with Jacks producing, decided to abandon their recording. Jacks's version is one of the fewer than forty all-time singles to have sold 10 million copies worldwide.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 318 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Seasons in the Sun\" is an English-language adaptation of the song \"Le Moribond\" by Belgian singer-songwriter Jacques Brel with lyrics rewritten by American singer-poet Rod McKuen. The first recording of the English-language version (lyrics by McKuen) was released on 1963 album Time to Think by the Kingston Trio. Terry Jacks recorded the original seasons in the sun in 1973 and it became a worldwide hit in 1974." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sang the song never on a sunday?", "passages": [ [ "Never on Sunday (song)", "Never on Sunday (song)\n\n\"Never on Sunday\", also known by its original Greek title \"Ta Pedi\u00e1 tou Pire\u00e1\" (\"\u03a4\u03b1 \u03a0\u03b1\u03b9\u03b4\u03b9\u03ac \u03c4\u03bf\u03c5 \u03a0\u03b5\u03b9\u03c1\u03b1\u03b9\u03ac\", The Children of Piraeus), is a popular song written by Manos Hatzidakis and first sung by Melina Mercouri in the film of same name, directed by Jules Dassin and starring Mercouri.", "The song won the Academy Award for Best Original Song in 1960, a first for a foreign-language picture.", "The film score to the movie was first released on October 1, 1960 by United Artists Records.", "The song has since been recorded by numerous artists, and has gained various degrees of success throughout the world.", "\"Never on Sunday\" was written by Manos Hadjidakis as \"Ta Pedia tou Pirea\" (The Children of Piraeus).", "His original Greek lyrics, along with the foreign translations in German, French and Italian, do not mention \"Never on Sunday\" (as found in the English lyrics), but rather tell the story of the main female character of the film, Illya (Mercouri)." ], [ "Here's the Answer", "The album was reissued on a compact disc in the mid 1990s and added the four additional bonus tracks Davis recorded as duets with Bobby Bare and Porter Wagoner in the 1960s; \"A Little Bitty Tear\" with Porter Wagoner, \"Have I Told You Lately That I Love You\" with Porter Wagoner, \"A Dear John Letter\" with Bobby Bare, and \"We'll Sing in the Sunshine\" with Bobby Bare.", "\"Here's the Answer\" spawned two singles in 1960.", "The first single released was Davis' response to Hank Locklin's \"Please Help Me, I'm Falling\" called, \"(I Can't Help You) I'm Falling Too\".", "The single was released in July 1960 and peaked for three weeks at #2 on the \"Billboard Magazine\" Hot Country Songs chart and became her first single to cross over to the \"Billboard\" Hot 100, reaching #39.", "The second single was released in December 1960 called, \"My Last Date (With You)\".", "The song reached #5 on the \"Billboard Magazine\" Hot Country Songs, while also reaching the Top 40 on the \"Billboard\" Hot 100 in 1961.", "The songs became her second and third Top 10 hits as a solo artist.", "\"Here's the Answer\" was officially released in January 1961, but did not chart any \"Billboard\" list." ] ], "gold": "\"Never on Sunday\" is a popular song written by Manos Hatzidakis. The song has been recorded in a number of languages since its release. In Greek, Melina Mercouri, Nana Mouskouri, and Pink Martini have all recorded the song. In English, Don Costa recorded an orchestral version which reached number 19 on the Billboard Hot 100 in 1960, then returned to the Billboard Top 40 when reissued in 1961.", "prediction 1": "\"Never on Sunday\", also known by its original Greek title \"Ta Pedi\u00e1 tou Pire\u00e1\", is a popular song written by Manos Hatzidakis and first sung by Melina Mercouri in the film of same name, directed by Jules Dassin and starring Mercouri. The song won the Academy Award for Best Original Song in 1960, a first for a foreign-language picture. His original Greek lyrics, along with the foreign translations in German, French and Italian, do not mention \"Never on Sunday\" (asung in the English lyrics), but rather tell the story of the main female character of the film, Illya (Mercouri).", "prediction 2": "The song Never on Sunday was written by Manos Hatzidakis and first sung by Melina Mercouri in the 1960 film, directed by Jules Dassin and starring Mercouri. The song won the Academy Award for Best Original Song in 1960, a first for a foreign-language picture. She also sang it on the 1960 album, Here's the Answer.", "prediction 3": "\"Never on Sunday\", also known by its original Greek title \"Ta Pedi\u00e1 tou Pire\u00e1\", is a popular song written by Manos Hatzidakis and first sung by Melina Mercouri in the film of same name, directed by Jules Dassin and starring Mercouri. The movie score to the movie was released on October 1, 1960 by United Artists Records. \"Never on Sunday\" was written by Manos Hadjidakis as \"Ta Pirea\". His original Greek lyrics, along with the foreign translations in German, French and Italian, do not mention \"Never on Sunday\" (as found in the English lyrics), but rather tell the story of the main female character of the film, Illya (Mercouri).", "prediction 4": "In 1960, the popular song Never on Sunday was sung by Melina Mercouri, who was portrayed by Mercouri in the film of the same name. The song won the Academy Award for Best Original Song in 1960, a first for a foreign-language picture.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 233 }, { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 336 }, { "error type": "Irrelevant", "explanation": "", "start": 495, "end": 580 } ], "missing-info": [], "corrected-prediction": "\"Never on Sunday\" is a popular song written by Manos Hatzidakis and first sung by Melina Mercouri. The original Greek lyrics, along with the foreign translations in German, French and Italian, do not mention \"Never on Sunday\" (as found in the English lyrics)." }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Which is bigger kansas city or st louis?", "passages": [ [ "Kansas City metropolitan area", "Kansas City metropolitan area\n\nThe Kansas City metropolitan area is a 15-county metropolitan area anchored by Kansas City, Missouri, that straddles the border between the U.S. states of Missouri and Kansas.", "With a population of 2,104,509, it ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis).", "Alongside Kansas City, the area includes a number of other cities and suburbs, the largest being Overland Park, Kansas; Kansas City, Kansas; Olathe, Kansas; and Independence, Missouri; each over 100,000 in population.", "The Mid-America Regional Council (MARC) serves as the Council of Governments and the Metropolitan Planning Organization for the area.", "The larger \"Kansas City Metropolitan Area\" as seen on a map can be visualized roughly as four quadrants:\n\nThe map's northeast quadrant is locally referred to as \"north of the river\" or \"the Northland\".", "It includes parts of Clay County, Missouri including North Kansas City, Missouri.", "North Kansas City is bounded by a bend in the Missouri River that defines a border between Wyandotte County, Kansas and Clay County, Missouri running approximately North-South and a border between North Kansas City, Missouri and Kansas City, Missouri running approximately East-West.", "The river band's sharpest part forms a peninsula containing the Kansas City Downtown Airport." ], [ "Kansas City, Missouri", "Kansas City, Missouri\n\nKansas City is the largest city in the U.S. state of Missouri.", "According to the U.S. Census Bureau, the city had an estimated population of 488,943 in 2017, making it the 37th most-populous city in the United States.", "It is the central city of the Kansas City metropolitan area, which straddles the Kansas\u2013Missouri state line.", "Kansas City was founded in the 1830s as a Missouri River port at its confluence with the Kansas River coming in from the west.", "On June 1, 1850 the town of Kansas was incorporated; shortly after came the establishment of the Kansas Territory.", "Confusion between the two ensued and the name Kansas City was assigned to distinguish them soon after.", "Sitting on Missouri's western boundary, with Downtown near the confluence of the Kansas and Missouri Rivers, the modern city encompasses some , making it the 23rd largest city by total area in the United States.", "Most of the city lies within Jackson County, but portions spill into Clay, Cass, and Platte counties.", "Along with Independence, one of its major suburbs, it serves as one of the two county seats of Jackson County.", "Other major suburbs include the Missouri cities of Blue Springs and Lee's Summit and the Kansas cities of Overland Park, Olathe, and Kansas City." ], [ "History of Chinese Americans in St. Louis", "History of Chinese Americans in St. Louis\n\nGreater St. Louis has a Chinese community.", "There are 1,931 Chinese Americans in St. Louis (0.6% of the city's population), and 14,460 living in the Greater St. Louis area (0.5% of the area's population).", "The first Chinese immigrant to St. Louis was Alla Lee, a 24-year-old from Ningbo who arrived in 1857.", "He socialized with the Irish American community and married an Irish woman.", "He sold coffee and tea in a shop on North Tenth Street.", "Around 1867, several hundred Chinese looking for work in factories and mines in and around St. Louis moved there from New York and San Francisco.", "The community they settled, Hop Alley, became St. Louis' Chinatown.", "This community disappeared in 1966 when it was demolished to make room for a parking lot for Busch Stadium.", "Many Chinese Americans moved to St. Louis's Missouri suburbs, where they founded Chinese-language schools and Chinese churches and community organizations.", "In the late 19th century and the early 20th century, the ethnic Chinese population was less than 0.1% of the city's population.", "There were 300 Chinese in St. Louis by the end of the 19th century." ] ], "gold": "Kansas City is the most populous city in Missouri with a population of 508,090 people in 2020, more than St. Louis that had 301,500 people as of 2020. The St. Louis metropolitan area has 2.8 million people as of 2020, making it the largest metropolitan area in Missouri, ahead of the Kansas City metropolitan area with 2.2 million people.", "prediction 1": "The Kansas City metropolitan area is a 15-county metropolitan area anchored by Kansas City, Missouri, that straddles the border between the states of Missouri and Kansas. With a population of 2,104,509, it ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis). The Greater St. Louis area is larger, with 13,315,419 inhabitants, and the greater Kansas City metropolitan area is larger, with 17,327,087. The larger Kansas City metropolitan area as seen on a map can be visualized roughly as four quadrants: The map's northeast quadrant is locally referred to as \"north of the river\" or the Northland, and includes parts of Clay County, Missouri, including North Kansas City, Missouri.", "prediction 2": "The Kansas City metropolitan area is a 15-county metropolitan area anchored by Kansas City, Missouri, that straddles the border between the U.S. states of Missouri and Kansas. With a population of 2,104,509, it ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis). The larger \"Kansas City Metropolitan Area\" as seen on a map can be visualized roughly as four quadrants: The map's northeast quadrant is locally referred to as \"the Northland\".", "prediction 3": "The Kansas City metropolitan area is a 15-county metropolitan area anchored by Kansas City, Missouri, that straddles the border between the U.S. states of Missouri and Kansas. With a population of 2,104,509, it ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis).", "prediction 4": "The Kansas City metropolitan area is a 15-county metropolitan area anchored by Kansas City, Missouri, that straddles the border between the states of Missouri and Kansas. With a population of 2,104,509, it ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis). However, the city of Kansas City is the largest city in the U.S. state of Missouri.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 170 }, { "error type": "Unverifiable", "explanation": "", "start": 343, "end": 371 }, { "error type": "Irrelevant", "explanation": "", "start": 372, "end": 445 }, { "error type": "Irrelevant", "explanation": "", "start": 446, "end": 548 }, { "error type": "Irrelevant", "explanation": "", "start": 549, "end": 726 } ], "missing-info": [], "corrected-prediction": "The Kansas City, with a population of 2,104,509, ranks as the second largest metropolitan area with its core in Missouri (after Greater St. Louis). The Greater St. Louis area is larger. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "First african country to play in fifa world cup?", "passages": [ [ "Egypt at the FIFA World Cup", "When they qualified again in 1990, they became the team with the longest-ever gap between two FIFA World Cup matches: 56 years and 16 days had passed.", "Group F\nGroup F, featured the Netherlands, England, the Republic of Ireland and Egypt.", "In the six group games, no team managed to score more than once in a match.", "England beat Egypt 1\u20130, thanks to a 58th-minute goal from Mark Wright \u2013 and that was enough to win the group.", "The Republic of Ireland and the Netherlands finished with identical records.", "With both teams assured of progressing, they were split by the drawing of lots to determine second and third place.", "Group A\n\n
\n\n
\n\n
\n\nDue to the long time spans between Egypt's World Cup participations, no player was able to play more than one tournament.", "22 players share the record for most World Cup appearances for Egypt: Ten players from the 1990 FIFA World Cup, among them twin brothers Hossam and Ibrahim Hassan, and twelve players from 2018.", "The team of 1934 was only able to play one match because of a different tournament format.", "An Egyptian player with a notable record is goalkeeper Essam El-Hadary." ], [ "Nigeria women's national football team", "Nigeria hosted the African women\u2019s championship finals for the third time in 2006, replacing Gabon, which was initially granted the right to host but later pulled out citing financial difficulties, and won it for the seventh time in a row.", "Nigeria\u2019s Super Falcons and Ghana\u2019s Black Queens represented Africa in China for the 2007 FIFA Women's World Cup.", "The \"Falconets\" are the country\u2019s junior team (U-20), which performed creditably in the 2006 FIFA U-20 Women's World Cup held in Russia when they beat Finland 8\u20130 before they were sent packing by Brazil in the Quarter-finals.", "They were the runner-up to Germany at the 2010 FIFA U-20 Women's World Cup.", "Nigeria also played in the 2014 FIFA U-20 Women's World Cup held in Canada and lost to Germany in the finals 0-1, Asisat Oshoala got both the golden ball and golden boot.", "The \"Flamingoes\" are the country\u2019s cadet team (U-17), which qualified for the inaugural women's U-17 World Cup New Zealand 2008.", "Squad for the 2018 Africa Women Cup of Nations" ], [ "African nations at the FIFA World Cup", "This table shows for each world cup the number of countries at the World Cup, the number of entries (#E) from around the world (including any rejections and withdrawals), the number of African entries (#A), how many of those African entries withdrew (#A-) before/during qualification or were rejected by FIFA, the African representatives at the World Cup finals, the number of World Cup Qualifiers each African representative had to play to get to the World Cup (#WCQ), the furthest stage they reached, their results, and their coaches.", "The inaugural 1930 FIFA World Cup was the only one without any qualification process.", "No African teams entered.", "The \"Pharaohs\" of Egypt were the only African team to apply to feature at the 1934 FIFA World Cup.", "As there were 32 countries competing for 16 places, FIFA organized the first qualification round.", "Egypt was placed in a group with Turkey and Palestine, then a British mandate.", "Turkey withdrew, and Egypt beat Palestine 7\u20131 in Cairo and 4\u20131 in Jerusalem to qualify for the World Cup finals.", "The 1934 FIFA World Cup finals was organized as a straight knock-out.", "Egypt lost 2\u20134 to Hungary in Naples with Abdulrahman Fawzi scoring twice to become the first African to score at the World Cup finals." ] ], "gold": "Egypt was the first African country to play in the FIFA Men's World Cup in 1934. Nigeria was the first African team to play in the FIFA Women's World Cup, having qualified for every edition of the tournament starting in 1991. ", "prediction 1": "The inaugural 1930 FIFA World Cup was the only one without any qualification process. No African teams entered. The \u201cPharaohs\u201d of Egypt were the only African team to apply to feature at the 1934 FIFA World Cup. As there were 32 countries competing for 16 places, FIFA organized the first qualification round. As there were 32 countries competing for 16 places, FIFA organized a straight knock-out tournament. Egypt lost 2\u20134 to Hungary in Naples with Abdulrahman Fawzi scoring twice to become the first African to score at the World Cup finals.", "prediction 2": "The inaugural 1930 FIFA World Cup was the only one without any qualification process. No African teams entered. The \"Pharaohs\" of Egypt were the only African team to apply to feature at the 1934 FIFA World Cup. As there were 32 countries competing for 16 places, FIFA organized the first qualification round. Egypt beat Palestine 7\u20131 in Cairo and 4\u20131 in Jerusalem to qualify for the World Cup finals. The 1934 FIFA World Cup finals was organized as a straight knock-out. Egypt lost 2\u20134 to Hungary in Naples with Abdulrahman Fawzi scoring twice to become the first African to score at the World Cup finals.", "prediction 3": "The first African country to play in the FIFA World Cup was Egypt in 1934. The first African team to play in the FIFA World Cup was the Egypt National Football Team. The first African country to play in the FIFA World Cup was Egypt in 1990. Egypt also made the first African appearance in the FIFA World Cup in 1990, when they qualified again. The first African country to play in FIFA World Cup finals was Egypt in 1934.", "prediction 4": "The inaugural 1930 FIFA World Cup was the only one without any qualification process. No African teams entered. Egypt were the only African team to apply to feature at the 1934 FIFA World Cup. The 1934 FIFA World Cup finals was organized as a straight knockout. Egypt lost 2\u20134 to Hungary in Naples with Abdulrahman Fawzi scoring twice to become the first African to score at the World Cup finals. The 1990 FIFA World Cup was hosted by the Netherlands, with England as the host.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 543 } ], "missing-info": [], "corrected-prediction": "The \u201cPharaohs\u201d of Egypt were the only African team to apply to feature at the 1934 FIFA World Cup. " }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who was the starting quarterback for the vikings?", "passages": [ [ "Matt Cassel", "On March 13, 2013, sources close to the Chiefs reported they intended to trade or release Cassel.", "On March 14, 2013, the Chiefs released Cassel.", "On the same day he was released from the Chiefs, Cassel signed with the Minnesota Vikings.", "On September 27, it was announced that Cassel would get his first start as a Viking in Week 4 against the Pittsburgh Steelers, due to a rib injury to starting quarterback Christian Ponder.", "The Vikings won the game 34\u201327.", "Due to another injury to Christian Ponder, Cassel received his third start of the season week 14 against the Baltimore Ravens.", "Despite a two touchdown, zero interception performance, the Vikings lost to the Ravens 29-26 during a heavy snow game.", "He would remain the starting quarterback the rest of the season where the Vikings finished with a 5-10-1 record and Cassel either played the whole game or came in to rally the Vikings from behind in all five victories.", "On March 7, 2014, it was reported that Cassel had signed a new two-year deal for $10 million.", "It was later announced on August 25, 2014 that Cassel would be the starting quarterback over rookie Teddy Bridgewater and Ponder.", "However, on September 21, 2014 Cassel broke his foot against the New Orleans Saints and was placed on injured reserve." ], [ "Teddy Bridgewater", "Bridgewater went 13 of 21 for 144 yards an interception and rushing for a touchdown and two point conversion against the St. Louis Rams before he sustained a blow to the head by the Rams's Lamarcus Joyner that caused Bridgewater to leave the game in the fourth quarter.", "Minnesota still managed to pull off a 21\u201318 victory in overtime against the Rams.", "At home against the Chicago Bears in week 15, Bridgewater completed 17 of 20 pass attempts, four passing touchdowns, and one rushing touchdown in a 38\u201317 win, giving him a career-best passer rating (154.4).", "In a fight for the NFC North Division Title in week 17 against the Green Bay Packers, Bridgewater connected only 52.6% of his passes for 99 yards and an interception.", "Despite his career-lowest passer rating (45.7), the Vikings pulled off a 20\u201313 victory and won their first division title since 2009.", "On January 25, 2016, he was named to his first Pro Bowl.", "On January 10, in the Wild Card Round against the Seattle Seahawks, Bridgewater was 17-of-24 for 146 yards as the Vikings fell 10\u20139.", "During a team practice on August 30, 2016, Bridgewater suffered a non-contact injury to his left leg." ], [ "Sam Bradford", "During a three-game losing streak, Bradford threw only three touchdowns and an interception with 725 yards and a 66% completion percentage, poor in comparison with the previous four games, in which he threw for 990 yards, six touchdowns, no interceptions, and had a 70% completion percentage.", "The Vikings would finish the season with an 8-8 record.", "Bradford started 15 games in 2016, completing 395 of 552 passes for 3,877 yards and 20 touchdowns with 5 interceptions.", "His 71.6 completion percentage set a single season NFL record, passing Drew Brees's 2011 mark of 71.2.", "Brees later finished the 2017 season with a 72.0 completion percentage, retaking the record.", "Bradford's 395 completions set a franchise record for completions in a season.", "In Week 1, on \"Monday Night Football\", Bradford completed 27-of-32 pass attempts for 346 yards and 3 touchdowns in a 29\u201319 win over the New Orleans Saints, earning him his first NFC Offensive Player of the Week award.", "He was inactive for the Week 2 game against the Pittsburgh Steelers due to a knee injury.", "After missing three more games, on October 10, it was revealed that Bradford was diagnosed with wear and tear on his knee after two previous ACL surgeries.", "On November 7, Bradford underwent a knee scope, putting his season in jeopardy." ] ], "gold": "The Minnesota Vikings' starting quarterback in the 2015 season was Teddy Bridgewater. However, he suffered a leg injury in the 2016 preseason and was replaced by Shaun Hill for the season's first game, and by Sam Bradford thereafter. After Bradford was injured early in the 2017 season, he was replaced by Case Keenum.", "prediction 1": "Matt Cassel started all four games for the Minnesota Vikings from 2010\u20132015, while rookie Teddy Bridgewater started all 15 games. Bridgewater started the first half of the 2015 season. Sam Bradford started all 15 games in 2016, finishing 395 of 552 passes for 3,877 yards and 20 touchdowns with 5 interceptions.", "prediction 2": "Matt Cassel started all 15 games for the Minnesota Vikings in the 2014 season, while Sam Bradford started 15 games. In 2016, Cassel was the starting quarterback over rookie quarterback Teddy Bridgewater and Christian Ponder. In 2017, Christian Ponder was the starting quarterback, while Matt Cassel started all 15 games.", "prediction 3": "Matt Cassel was the starting quarterback for the Minnesota Vikings between 2014 and 2018. Cassel started the first three games of the season, but was forced to sit out the rest of the season due to injuries to Christian Ponder and Teddy Bridgewater. However, after being sacked five times during the season, Cassel finished the season as the starting quarterback.", "prediction 4": "Matt Cassel started the first three games of the 2014 season for the Minnesota Vikings. However, after he broke his foot against the Saints, Christian Ponder started the next four games for the Vikings. Sam Bradford also started 15 games in 2016.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2,3]}", "start": 61, "end": 76 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 24, "end": 28 }, { "error type": "Unverifiable", "explanation": "", "start": 108, "end": 129 }, { "error type": "Unverifiable", "explanation": "", "start": 142, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 311 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Matt Cassel started five games for the Minnesota Vikings in 2013. Christian Ponder was the other quarterback in 2013. Bridgewater played quarterback in 2015. Sam Bradford was the quarterback in 2016." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Is tungsten a metal or nonmetal or metalloid?", "passages": [ [ "Tungsten", "Lead was found to be lethal at low levels and sodium tungstate was much less toxic, but the tungstate completely inhibited their reproductive ability.", "Tungsten has been studied as a biological copper metabolic antagonist, in a role similar to the action of molybdenum.", "It has been found that tetrathiotungstates may be used as biological copper chelation chemicals, similar to the tetrathiomolybdates.", "Tungsten is essential for some archaea.", "The following tungsten-utilizing enzymes are known:\nA \"wtp\" system is known to selectively transport tungsten in archaea:\n\nBecause tungsten is rare and its compounds are generally inert, the effects of tungsten on the environment are limited.", "It was at first believed to be relatively inert and an only slightly toxic metal, but beginning in the year 2000, the risk presented by tungsten alloys, its dusts and particulates to induce cancer and several other adverse effects in animals as well as humans has been highlighted from in vitro and in vivo experiments.", "The median lethal dose LD depends strongly on the animal and the method of administration and varies between 59\u00a0mg/kg (intravenous, rabbits) and 5000\u00a0mg/kg (tungsten metal powder, intraperitoneal, rats)." ], [ "Metalloid", "Grey tin usually has the appearance of a grey micro-crystalline powder, and can also be prepared in brittle semi-lustrous crystalline or polycrystalline forms.", "It is the stable form below 13.2\u00a0\u00b0C and has an electrical conductivity of between (2\u20135) \u00d7 10\u00a0S\u00b7cm (~1/250th that of white tin).", "Grey tin has the same crystalline structure as that of diamond.", "It behaves as a semiconductor (as if it had a band gap of 0.08\u00a0eV), but has the electronic band structure of a semimetal.", "It has been referred to as either a very poor metal, a metalloid, a nonmetal or a near metalloid.", "The diamond allotrope of carbon is clearly nonmetallic, being translucent and having a low electrical conductivity of 10 to 10\u00a0S\u00b7cm.", "Graphite has an electrical conductivity of 3 \u00d7 10\u00a0S\u00b7cm, a figure more characteristic of a metal.", "Phosphorus, sulfur, arsenic, selenium, antimony, and bismuth also have less stable allotropes that display different behaviours.", "The table gives crustal abundances of the elements commonly to rarely recognised as metalloids." ], [ "Metalloid", "Only the elements at or near the margins, lacking a sufficiently clear preponderance of either metallic or nonmetallic properties, are classified as metalloids.", "Boron, silicon, germanium, arsenic, antimony, and tellurium are commonly recognised as metalloids.", "Depending on the author, one or more from selenium, polonium, or astatine are sometimes added to the list.", "Boron sometimes is excluded, by itself, or with silicon.", "Sometimes tellurium is not regarded as a metalloid.", "The inclusion of antimony, polonium, and astatine as metalloids has been questioned.", "Other elements are occasionally classified as metalloids.", "These elements include hydrogen, beryllium, nitrogen, phosphorus, sulfur, zinc, gallium, tin, iodine, lead, bismuth, and radon.", "The term metalloid has also been used for elements that exhibit metallic lustre and electrical conductivity, and that are amphoteric, such as arsenic, antimony, vanadium, chromium, molybdenum, tungsten, tin, lead, and aluminium.", "The p-block metals, and nonmetals (such as carbon or nitrogen) that can form alloys with metals or modify their properties have also occasionally been considered as metalloids." ] ], "gold": "Tungsten is a rare metal found naturally on Earth almost exclusively as compounds with other elements. However, tungsten and other metallic elements can also be described as metalloids for their metallic luster, electrical conductivity, and amphoterism, or ability to act both as an acid and a base.", "prediction 1": "Is tungsten a metal or a nonmetal? Or is it a metalloid?", "prediction 2": "Tungsten is a chemical element that is a metalloid. It has been referred to as either a very poor metal, a metalloid, a nonmetal or a near metalloid.", "prediction 3": "Tungsten is a metalloid, and therefore a nonmetal. As such, it has been referred to as either a very poor metal, a metalloid, a nonmetal or a near metalloid. Only the elements at or near the margins, lacking a sufficiently clear preponderance of either metallic or nonmetallic properties, are classified as metalloids.", "prediction 4": "There are several different types of tungsten. It is a metalloid, a nonmetal, or a near metalloid. It has been referred to as either a very poor metal, a metalloid, a nonmetal, or a near metalloid.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 34 }, { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 56 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "Tungsten is rare. The term metalloid has also been used for elements that exhibit metallic lustre and electrical conductivity, and that are amphoteric, such as tungsten and others." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When was the chicken pox vaccine first given?", "passages": [ [ "Varicella vaccine", "It is not recommended during pregnancy; however, the few times it has been given during pregnancy no problems resulted.", "The vaccine is available either by itself or along with the MMR vaccine, in a version known as the MMRV vaccine.", "It is made from weakened virus.", "The chickenpox vaccine first became commercially available in 1984.", "It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system.", "In the United States it costs between 100 and 200 USD.", "Varicella vaccine is 70% to 90% effective for preventing varicella and more than 95% effective for preventing severe varicella.", "Follow-up evaluations have taken place in the United States of children immunized that revealed protection for at least 11 years.", "Also, studies were conducted in Japan which indicated protection for at least 20 years.", "People who do not develop enough protection when they get the vaccine may develop a mild case of the disease when in close contact with a person with chickenpox.", "In these cases, people show very little sign of illness.", "This has been the case of children who get the vaccine in their early childhood and later have contact with children with chickenpox.", "Some of these children may develop a mild chickenpox also known as breakthrough disease." ], [ "Varicella vaccine", "The virus was initially obtained from a child with natural varicella, introduced into human embryonic lung cell cultures, adapted to and propagated in embryonic guinea pig cell cultures, and finally propagated in human diploid cell cultures.", "Japan was among the first countries to vaccinate for chickenpox.", "The vaccine was first licensed in the United States in 1995.", "Routine vaccination against varicella zoster virus is also performed in the United States, and the incidence of chickenpox has been dramatically reduced there (from 4 million cases per year in the pre-vaccine era to approximately 400,000 cases per year as of 2005).", "In Europe most countries do not currently vaccinate against varicella, though the vaccine is gaining wider acceptance.", "Australia, Canada, and other countries have adopted recommendations for routine immunization of children and susceptible adults against chickenpox.", "Other countries, such as the United Kingdom, have targeted recommendations for the vaccine, e.g., for susceptible health care workers at risk of varicella exposure.", "In the UK, varicella antibodies are measured as part of the routine of prenatal care, and by 2005 all National Health Service personnel had determined their immunity and been immunized if they were non-immune and have direct patient contact." ], [ "Rubella vaccine", "Combinations include with measles (MR vaccine), measles and mumps vaccine (MMR vaccine) and measles, mumps and varicella vaccine (MMRV vaccine).", "A rubella vaccine was first licensed in 1969.", "It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system.", "As of 2009 more than 130 countries included it in their routine vaccinations.", "The wholesale cost of the MMR vaccine in the developing world is 0.24 USD per dose as of 2014.", "In the United States it costs between 50 and 100 USD.", "Rubella vaccine is on the World Health Organization's List of Essential Medicines, a list of the most important medications needed in a health system.", "There are two main ways to delivery the rubella vaccine.", "The first is initially efforts to immunize all people less than forty years old followed by providing a first dose of vaccine between 9 and 12 months of age.", "Otherwise simply women of childbearing age can be vaccinated.", "While only one dose is necessary two doses are often given as it usually comes mixed with the measles vaccine.", "It theoretically should not be given during pregnancy.", "However, more than a thousand women have been given the vaccine when they did not realize that they were pregnant and no negative outcomes occurred." ] ], "gold": "The Varicella vaccine, also known as chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines. A varicella vaccine, first developed by Maurice Hilleman, was first licensed in the United States in 1995.", "prediction 1": "The chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. Varicella vaccine is 70% to 90% effective for preventing varicella and more than 95% effective for preventing severe varicella. The varicella vaccine was first licensed in the United States in 1995. A rubella vaccine was first licensed in 1969. It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. A varicella vaccine was first licensed in 1969.\n", "prediction 2": "The chickenpox vaccine first became commercially available in 1984 and is on the World Health Organization's List of Essential Medicines. Varicella vaccine is 70% to 90% effective for preventing varicella and more than 95% effective for preventing severe varicella. Routine vaccination against varicella zoster virus is also performed in the United States in 1995. Rubella vaccine was first licensed in 1969 and is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. The chickenpox vaccine is weakened varicella vaccine and in combination with the MMR vaccine, or an individual among those who may develop an outbreak of chickenpox. The chickenpox vaccine was first commercially available in 1984. Varicella vaccine is not recommended during pregnancy but the few times it has been given during pregnancy no problems resulted.", "prediction 3": "The chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. Varicella vaccine was first licensed in the United States in 1995.", "prediction 4": "The chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. Varicella vaccine is 70% to 90% effective for preventing varicella and more than 95% effective for preventing severe varicella. A rubella vaccine was first licensed in 1969. As of 2009 more than 130 countries included it in their routine vaccinations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 202 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 330 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 447 }, { "error type": "Redundant", "explanation": "The chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines, the most effective and safe medicines needed in a health system. Varicella vaccine is 70% to 90% effective for preventing varicella and more than 95% effective for preventing severe varicella. The varicella vaccine was first licensed in the United States in 1995. A rubella vaccine was first licensed in 1969. ", "start": 448, "end": 631 } ], "missing-info": [], "corrected-prediction": "The chickenpox vaccine first became commercially available in 1984. It is on the World Health Organization's List of Essential Medicines. The varicella vaccine was first licensed in the United States in 1995." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang the song it's a thin line between love and hate?", "passages": [ [ "Thin Line Between Love and Hate", "Thin Line Between Love and Hate\n\n\"Thin Line Between Love and Hate\" is the title of a 1971 song by the New York City-based R&B vocal group The Persuaders.", "The song was written and produced by the Poindexter brothers, Robert and Richard, and was also co-written by Jackie Members.", "This was the group's biggest hit song, spending two weeks atop the \"Billboard\" R&B chart in late 1971.", "It also reached #15 on the \"Billboard\" Hot 100 chart and was a certified Gold Record by the RIAA.", "The song has been covered or sampled by many musical acts." ], [ "A Thin Line Between Love and Hate", "A Thin Line Between Love and Hate\n\nA Thin Line Between Love and Hate is a 1996 American dark comedy-romance film directed and co-written by Martin Lawrence, who also stars in the film.", "Lawrence co-wrote the screenplay alongside Kenny Buford and Bentley Kyle Evans, who has also written for Lawrence's hit television sitcom, \"Martin\", and Kim Bass.", "In addition to Lawrence, the film's cast includes Lynn Whitfield, Regina King, Bobby Brown and Della Reese.", "The film tells the story of Darnell Wright, a ladies' man who finds himself targeted by one of his obsessed lovers.", "The film was released in April 1996 and went on to gross over $30 million at the box office against a budget of $8 million.", "The film was shot on location entirely in the city of Los Angeles, California, from June 5 until August 11, 1995.", "The title for the film is taken from the 1971 song \"Thin Line Between Love and Hate\" by The Persuaders.", "R&B trio H-Town recorded a cover version of this song that was included on the film soundtrack.", "At the time of filming, Lawrence was 12 years younger than Lynn Whitfield, who was 42 at the time.", "Nightclub manager Darnell Wright is a perpetual playboy and hopeless male chauvinist." ], [ "Medusa (Annie Lennox album)", "Medusa (Annie Lennox album)\n\nMedusa is the second solo album by the Scottish singer Annie Lennox, released in March 1995, and consists entirely of cover songs.", "It entered the UK Albums Chart at number 1 and peaked in the United States at number 11, spending 60 weeks on the \"Billboard\" 200 chart.", "It has since achieved double platinum status in both the United Kingdom and the United States and sold more than 6 million copies worldwide.", "The album yielded four singles in the United Kingdom: \"No More I Love You's\" (which entered the UK Singles Chart at No. 2, Lennox's highest ever solo peak), \"A Whiter Shade of Pale\", \"Waiting in Vain\" and \"Something So Right\".", "The album was nominated for Best Pop Vocal Album at the Grammy Awards of 1996, losing to \"Turbulent Indigo\" by Joni Mitchell, however, Lennox took home the Best Female Pop Vocal Performance award for her work on the first single \"No More", "I Love You's\"." ] ], "gold": "The song Thin Line Between Love and Hate was first recorded in 1971 by R&B vocal group The Persuaders and has been recorded by several artists since then. The Pretenders recorded a version of Thin Line Between Love and Hate in 1984. Annie Lennox included a version of the single on her 1995 album Medusa. H-Town recorded a 1996 remake of the song which was included in the soundtrack of the movie, A Thin Line Between Love and Hate.", "prediction 1": "The 1971 song \"Thin Line Between Love and Hate\" was written and produced by the Poindexter brothers, Robert and Richard, and was also co-written by Jackie Members. This was the group's biggest hit song, spending two weeks atop the \"Billboard\" R&B chart in late 1971. The 1996 American dark comedy-romance film \"A Thin Line Between Love and Hate\" features Darnell Wright, a ladies' man targeted by one of his obsessed lovers. R&B trio H-Town recorded a cover version of this song that was included in the film soundtrack.", "prediction 2": "The 1971 song \"Thin Line Between Love and Hate\" was written and produced by the Poindexter brothers, Robert and Richard. The song was also co-written by Jackie Members. In 1996, American dark comedy-romance film A Thin Line Between Love and Hate was released. The title for the film is taken from the 1971 song \"Thin Line Between Love and Hate\" by The Persuaders. In 1995, R&B trio H-Town recorded a cover version of this song that was included on the film soundtrack.", "prediction 3": "\"Thin Line Between Love and Hate\" is the title of a 1971 song by the New York City-based R&B vocal group The Persuaders. The song was written and produced by the Poindexter brothers, Robert and Richard, and was also co-written by Jackie Members. This was the group's biggest hit song, spending two weeks atop the Billboard R&B chart in late 1971. R & B trio H-Town recorded a cover version of this song that was included on the film.", "prediction 4": "\"Thin Line Between Love and Hate\" is the title of a 1971 song by the New York City-based R&B vocal group The Persuaders. This was the group's biggest hit song, spending two weeks atop the Billboard R&B chart in late 1971. In 1996, R&B trio H-Town recorded a cover version of this song that was included on the film's soundtrack.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 266 }, { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 346, "end": 424 }, { "error type": "Irrelevant", "explanation": "", "start": 425, "end": 433 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The song \"Thin Line Between Love and Hate\" was first recorded in 1971 by R&B vocal group The Persuaders. H-Town recorded a 1996 cover version of this song that was included in the soundtrack of the film, \"Thin Line Between Love and Hate\"." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When was the last time south korea had the olympics?", "passages": [ [ "Winter Olympic Games", "A subsequent investigation commissioned by the World Anti-Doping Agency led by Richard McLaren concluded that a state-sponsored doping programme had operated in Russia from \"at least late 2011 to 2015\" across the \"vast majority\" of Summer and Winter Olympic sports.", "On 5 December 2017, the IOC announced that Russia would be banned from the 2018 Winter Olympics with immediate effect and by the end of 2017 the IOC Disciplinary Commission had disqualified 43 Russian athletes, stripping thirteen medals and knocking Russia from the top of the medal table, thus putting Norway in the lead.", "On 6 July 2011, Pyeongchang, South Korea, was selected to host the 2018 Winter Olympics over Munich, Germany, and Annecy, France.", "This was the first time that South Korea had been selected to host a Winter Olympics and it was the second time the Olympics were held in the country overall, after the 1988 Summer Olympics in Seoul.", "The Games took place from 9 to 25 February 2018.", "More than 2,900 athletes from 92 countries participated in 102 events.", "The Olympic Stadium and many of the sports venues were situated in the Alpensia Resort in Daegwallyeong-myeon, Pyeongchang, while a number of other sports venues were located in the Gangneung Olympic Park in Pyeongchang's neighboring city of Gangneung." ], [ "1988 Summer Olympics", "After President Park's assassination in 1979, Chun Doo-hwan, his successor, submitted Korea's bid to the IOC in September 1981, in hopes that the increased international exposure brought by the Olympics would legitimize his authoritarian regime amidst increasing political pressure for democratization, provide protection from increasing threats from North Korea, and showcase the Korean economic miracle to the world community.", "South Korea was awarded the bid on 30 September 1981, becoming the 20th host nation (16th in the Summer Olympics), as well as the second Asian nation (following Japan in the 1964 Summer Olympics).", "Copying the model of 1964 Tokyo Olympics as a rite of passage for the Japanese economy and re-integration of Japan in the family of nations in the post-war era, the South Korean government hoped to use the Olympics as a \"coming-out party\".", "The Olympics gave a powerful impetus to the development of South Korea's relations with Eastern Europe, the Soviet Union and with China.", "In utilizing media events theory, Larson and Park investigated the 1988 Seoul Olympics as a form of political communication.", "They revealed the significance of South Korea's military government throughout the period of the Olympic bid and preparation, followed by the many advantages of the Seoul Olympics: rapid economic modernization, social mobilization and the legitimization of the military dictatorship." ], [ "1988 Summer Olympics", "1988 Summer Olympics\n\nThe 1988 Summer Olympics, officially known as the Games of the XXIV Olympiad (Korean: ; ), was an international multi-sport event celebrated from 17 September to 2 October 1988 in Seoul, South Korea.", "In the Seoul Games, 159 nations were represented by a total of 8,391 athletes: 6,197 men and 2,194 women.", "237 events were held and 27,221 volunteers helped to prepare the Olympics.", "11,331 media (4,978 written press and 6,353 broadcasters) showed the Games all over the world.", "These were the last Olympic Games for the Soviet Union and East Germany, as both ceased to exist before the next Olympic Games.", "The games were boycotted by North Korea and its ally, Cuba.", "Ethiopia, Albania and the Seychelles did not respond to the invitations sent by the IOC.", "Nicaragua did not participate due to athletic and financial considerations.", "The participation of Madagascar had been expected, and their team was expected at the opening ceremony of 160 nations.", "However, the country withdrew because of financial reasons.", "Nonetheless, the much larger boycotts seen in the previous three Summer Olympics (1976, 1980 and 1984) were avoided, resulting in the largest number of participating nations during the Cold War era.", "Seoul was chosen to host the Summer Games through a vote held on 30 September 1981, finishing ahead of the Japanese city of Nagoya." ] ], "gold": "The 1988 Summer Olympics officially known as the Games of the XXIV Olympiad and commonly known as Seoul 1988, was an international multi-sport event held from 17 September to 2 October 1988 in Seoul, South Korea. On 6 July 2011, Pyeongchang, South Korea, was selected to host the 2018 Winter Olympics over Munich, Germany, and Annecy, France. This was the first time that South Korea had been selected to host a Winter Olympics and it was the second time the Olympics were held in the country overall, after the 1988 Summer Olympics in Seoul. ", "prediction 1": "The last time South Korea had the Olympic Games was in 1988 in Seoul, which was held in the city of Seoul. The Winter Olympics were held in Pyeongchang, South Korea in 2018 and the Summer Olympics were held in Seoul in 1988.", "prediction 2": "The last time South Korea had the olympics was in 1988, when they held their second Summer Olympics in a single city in Seoul, South Korea. After President Park's assassination in 1979, Chun Doo-hwan, his successor, submitted Korea's bid to the IOC in September 1981, in hopes that the increased international exposure brought by the Olympics would legitimize his authoritarian regime amidst increasing political pressure for democratization, provide protection from increasing threats from North Korea, and showcase the Korean economic miracle to the world community. On 6 July 2011, South Korea was selected to host the 2018 Winter Olympics in Pyeongchang. This was the second time the Olympics were held in the country overall, after the 1988 Seoul Games.", "prediction 3": "South Korea's last Olympic games were the 1988 Summer and 2018 Winter Olympics, held from 9 to 25 February 2018. The Winter Olympics took place in Pyeongchang from 9 to 25 February 2018.", "prediction 4": "In 1988, South Korea hosted the Summer Olympics in Seoul, South Korea. In the 1988 Summer Olympics, Korea was the 20th host nation and the 16th in the Summer Olympics, and in the 1988 Winter Olympics in Pyeongchang, South Korea, the last time the olympics were held in the country overall. In the 1988 Winter Olympics, in Pyeongchang, South Korea, the last time the olympics were held in South Korea was from 9 to 25 February 2018.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3,5]}", "start": 4, "end": 13 }, { "error type": "Redundant", "explanation": "The last time South Korea had the Olympic Games was in 1988 in Seoul, which was held in the city of Seoul. ", "start": 177, "end": 224 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1988 Summer Olympics, officially known as the Games of the XXIV Olympiad, was an international multi-sport event celebrated from 17 September to 2 October 1988 in Seoul, South Korea. On 6 July 2011, Pyeongchang, South Korea, was selected to host the 2018 Winter Olympics over Munich, Germany, and Annecy, France. This was the first time that South Korea had been selected to host a Winter Olympics and it was the second time the Olympics were held in the country overall, after the 1988 Summer Olympics in Seoul." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who has won the 2017 women's single korea open super series badminton tournament?", "passages": [ [ "2017 Korea Open Super Series", "2017 Korea Open Super Series\n\nThe 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series.", "The tournament took place at SK Handball Stadium in Seoul, South Korea from September 12 \u2013 17, 2017 and had a total purse of $600,000." ], [ "P. V. Ramana", "P. V. Ramana\n\nPusarla Venkata Ramana is a former professional volleyball player and an employee of Indian Railways in Secunderabad.", "He was a member of the India men's national volleyball team.", "In the 1986 Asian Games, he was part of the team that won a bronze medal in volleyball.", "He was awarded the Arjuna Award in 2000 for his contribution to Indian volleyball.", "Ramana was born in Nirmal.", "In an interview with Radha Krishna on the Telugu television channel ABN Andhrajyothi, he said that his father died when he was five years old and that he grew up in Hyderabad with his siblings.", "He pursued graduation (equivalent to a bachelor's degree) in Vijayawada.", "His forefathers are from West Godavari district.", "Ramana's wife Vijaya has also been a national-level volleyball player.", "Like him, she is an employee of Indian Railways.", "Their younger daughter, Sindhu, is a badminton player who won a silver medal at the 2016 Olympic Games in Rio de Janeiro.", "Their eldest daughter, Divya, is a doctor by profession and played netball at national level." ] ], "gold": "The 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. India won the women's single badminton tournament which took place at the SK Handball Stadium in Seoul, South Korea from September 12 through September 17, 2017. Pusarla Venkata Sindhu, an Indian professional badminton player, won the women's single badminton tournament.", "prediction 1": "The 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. The tournament took place at SK Handball Stadium in Seoul, South Korea from September 12 \u2013 17, 2017 and had a total purse of $600,000.", "prediction 2": "The Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. Pusarla Venkata Ramana won the women's single Korea Open Super Series badminton tournament.", "prediction 3": "The 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. The tournament took place at SK Handball Stadium in Seoul, South Korea from September 12 \u2013 17, 2017. Pusarla Venkata Ramana won the women's single Korea Open Super Series badminton tournament.", "prediction 4": "The 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. The tournament took place at SK Handball Stadium in Seoul, South Korea from September 12 \u2013 17, 2017. Pusarla Venkata Ramana is a former professional volleyball player and an employee of Indian Railways in Secunderabad.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 237 } ], "missing-info": [], "corrected-prediction": "The 2017 Korea Open Super Series was the seventh Super Series tournament of the 2017 BWF Super Series. " }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who sings in the movie walk the line?", "passages": [ [ "Walk the Line", "On February 28, 2006, a single-disc DVD and a two-disc collector edition DVD were released; these editions sold three million copies on their first day of release.", "On March 25, 2008, a two-disc 'extended cut' DVD was released for region one.", "The feature on disc one is 17 minutes longer than the theatrical release, and disc two features eight extended musical sequences with introductions and documentaries about the making of the film.", "The film has been released on Blu-ray Disc in France, Sweden and the UK in the form of its extended cut.", "The American Blu-ray features the shorter theatrical cut.", "Wind-up Records released the soundtrack in November 2005.", "It featured nine songs performed by Joaquin Phoenix, four songs by Reese Witherspoon, two songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, and Shooter Jennings.", "The album received a Grammy at the 49th Annual Grammy Awards for Best Compilation Soundtrack Album for Motion Pictures, Television or Other Visual Media." ], [ "Walk the Line", "Walk the Line\n\nWalk the Line is a 2005 American biographical drama film directed by James Mangold.", "The screenplay, written by Mangold and Gill Dennis, is based on two autobiographies authored by singer-songwriter Johnny Cash\u2014\"\" and \"\".", "The film follows Cash's early life, his romance with June Carter, and his ascent to the country music scene.", "It stars Joaquin Phoenix as Cash, Reese Witherspoon as Carter, Ginnifer Goodwin as Vivian Liberto, and Robert Patrick as Cash's father.", "\"Walk the Line\" previewed at the Telluride Film Festival on September 4, 2005, and went into wide release on November 18.", "The film was nominated for five Oscars at the 78th Academy Awards, including Best Actor (Phoenix), Best Actress (Witherspoon, which she won), and Best Costume Design (Arianne Phillips).", "The film grossed more than $186 million worldwide.", "In 1968, as an audience of inmates at Folsom State Prison cheer for Johnny Cash's band, he waits backstage near a table saw, reminding him of his early life.", "In 1944, Johnny, then known as J.R., is raised on a cotton farm in Dyess, Arkansas with his brother Jack, father Ray, and mother Carrie." ] ], "gold": "Walk the Line is a 2005 American biographical musical romantic drama based on the life of Johnny Cash. It featured nine songs performed by Joaquin Phoenix, who played Cash on the movie, four songs by Reese Witherspoon, two songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, Shooter Jennings. ", "prediction 1": "Walking the Line is a 2005 American biographical drama film directed by James Mangold. The screenplay, written by Mangold and Gill Dennis, is based on two autobiographies authored by singer-songwriter Johnny Cash\u2014\"\" and \"\". It follows Cash's early life, his romance with June Carter, and his ascent to the country music scene. It stars Joaquin Phoenix as Cash, Reese Witherspoon as Carter, Ginnifer Goodwin as Vivian Liberto, and Robert Patrick as Cash. The album features nine songs performing by Reesesesesesesese Witherspoon, four songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, Johnathan Rice, Johnathan Rice, Johnathan Rice, Johnathan Rice, and Shooter Jennings.", "prediction 2": "Walk the Line is a 2005 American biographical drama film directed by James Mangold. The screenplay, written by Mangold and Gill Dennis, is based on two autobiographies authored by singer-songwriter Johnny Cash\u2014\"\" and \"\". The soundtrack features nine songs performed by Joaquin Phoenix, four songs by Reese Witherspoon, two songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, and Shooter Jennings.", "prediction 3": "Walk the Line is a 2005 American biographical drama film directed by James Mangold. The screenplay is based on two autobiographies authored by singer-songwriter Johnny Cash\u2014\"\" and \"\". The soundtrack features nine songs performed by Joaquin Phoenix, four songs by Reese Witherspoon, two songs by Tyler Hilton, one song each by Waylon Payne, Johnathan Rice, and Shooter Jennings.", "prediction 4": "Walk the Line is a 2005 American biographical drama film directed by James Mangold. The screenplay, written by Mangold and Gill Dennis, is based on two autobiographies authored by singer-songwriter Johnny Cash, \"\" and \"\". The soundtrack features nine songs performed by Joaquin Phoenix, four songs by Reese Witherspoon, two songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, and Shooter Jennings.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 453 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 498, "end": 556 } ], "missing-info": [], "corrected-prediction": "Walking the Line is a 2005 American biographical drama film based on two autobiographies authored by singer-songwriter Johnny Cash. It featured nine songs performed by Joaquin Phoenix, four songs by Reese Witherspoon, two songs by Tyler Hilton, and one song each by Waylon Payne, Johnathan Rice, and Shooter Jennings." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who sings ain't nothing gonna break my stride?", "passages": [ [ "Break My Stride", "Though \"Break My Stride\" was Matthew Wilder's only UK hit, he also reached the US pop chart with his next two singles, \"The Kid's American\" (#33) and \"Bouncing Off the Walls\" (#52), before turning to behind-the-scenes work on other artists' recordings.", "In 1996, Austrian duo Unique II had its most successful hit by covering \"Break My Stride\".", "This dance version of the 1983 Matthew Wilder song was the first international success for the band, peaking at number 1 in Austria and New Zealand, and at number 2 in Australia.", "The single also charted in Ireland, Italy, Canada and Scandinavia.", "\"Billboard\" wrote about the song: \"Yep, this is a dance-leaning cover of the Matthew Wilder '80s pop chestnut.", "It has already saturated radio airwaves throughout Europe, with a number of programmers here already giving it positive feedback.", "Highly videogenic Viennese songbird Jade Davies chirps her way through the track's Ace Of Base-like reggae-inflected groove with engaging energy.", "She'll have little to no trouble successfully carrying this one into the hearts of folks who prefer familiarity over adventure.\"" ], [ "Break My Stride", "2002 remix\n\nIn 2004, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten." ], [ "Break My Stride", "Break My Stride\n\n\"Break My Stride\" is a song performed by American recording artist Matthew Wilder.", "It was released in 1983 as the lead single from his debut album, \"I Don't Speak the Language\", and became a major hit single for him in 1983 and 1984.", "The song has been covered by many artists throughout the years, including Unique II in 1996 and Blue Lagoon in 2004 (whose versions both charted highly in various places) and, in interpolations, Puff Daddy in 1997 and Christina Aguilera with Lil' Kim in 2003 (particularly the line, \"\"I got to keep on movin\"'\").", "The song was featured in the credits of the film \"Cedar Rapids\".", "Included on his 1983 album, \"I Don't Speak the Language\", the single went to number five on the US \"Billboard\" Hot 100 and number four in the UK in January/February 1984.", "On the US \"Cash Box\" chart, Wilder's single reached the number two position, where it remained for two weeks in early February.", "A remix version reached the top 20 on the dance chart, and the song additionally hit the \"Billboard\" Hot Black Singles chart, staying there for four weeks." ] ], "gold": "\"Break My Stride\" is a song performed by American recording artist Matthew Wilder and released in 1983 as the lead single from his debut album, \"I Don't Speak the Language.\" It became a major hit single for him, reaching number five on the Billboard Hot 100 and later being covered by various artists. In 1996, the Austrian duo Unique II had its most successful hit by covering \"Break My Stride\" in a dance version that was the first international success for the band, peaking at number-one in Austria and New Zealand and number 2 in Australia. In 2004, the song was also covered by the German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten.", "prediction 1": "\"Break My Stride\" is a song performed by American recording artist Matthew Wilder. It was released in 1983 as the lead single from his debut album, \"I Don't Speak the Language\", and became a major hit single for him in 1983 and 1984. In 1996, Austrian duo Unique II had its most successful hit by covering \"Break My Stride\". This dance version of the 1983 Matthew Wilder song was the first international success for the band, peaking at number 1 in Austria, New Zealand, and at number 2 in Australia. In 2004, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten. In 2003, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria,", "prediction 2": "\"Break My Stride\" is a song performed by American recording artist Matthew Wilder. It was released in 1983 as the lead single from his debut album, \"I Don't Speak the Language\" and became a major hit single for him in 1983 and 1984. Austrian duo Unique II had its most successful hit by covering \"Break My Stride\" in 1996. Highly videogenic Viennese songbird Jade Davies chirps her way through the track's Ace Of Base-like reggady groove with engaging energy.", "prediction 3": "\"Break My Stride\" is a song performed by American recording artist Matthew Wilder. It was released in 1983 as the lead single from his debut album, \"I Don't Speak the Language\", and became a major hit single for him in 1983 and 1984. In 1996, Austrian duo Unique II had its most successful hit by covering \"Break My Stride\". This dance version of the 1983 Matthew Wilder song was the first international success for the band, peaking at number 1 in Austria and New Zealand, and at number 2 in Australia. In 2004, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten.", "prediction 4": "Break My Stride is a song performed by American recording artist Matthew Wilder. It was released in 1983 as the lead single from his debut album, I Don't Speak the Language, and became a major hit single for him in 1983 and 1984. Austrian duo Unique II had its most successful hit by covering \"Break My Stride\" in 1996. Highly videogenic Viennese songbird Jade Davies chirps her way through the track's Ace Of Base-like reggae-inflected groove with engaging energy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 233 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 696, "end": 701 }, { "error type": "Redundant", "explanation": "In 2004, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten. ", "start": 702, "end": 825 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Break My Stride\" is a song performed by American recording artist Matthew Wilder. It was released in 1983 as the lead single from his debut album, \"I Don't Speak the Language\", and became a major hit single for him, reaching number five on the Billboard Hot 100. In 1996, Austrian duo Unique II had its most successful hit by covering \"Break My Stride\". This dance version of the 1983 Matthew Wilder song was the first international success for the band, peaking at number 1 in Austria, New Zealand, and at number 2 in Australia. In 2004, \"Break My Stride\" was covered by German band Blue Lagoon and became a hit in several European countries, including Austria, Germany, Sweden and Denmark, where it reached the top ten." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who played freda in dumb and dumber 2?", "passages": [ [ "Dumb and Dumber To", "Dumb and Dumber To\n\nDumb and Dumber To is a 2014 American comedy film co-written and directed by Bobby and Peter Farrelly.", "It is the third film in the \"Dumb and Dumber\" film series and a direct sequel to the 1994 film \"Dumb and Dumber\".", "It stars Jim Carrey and Jeff Daniels reprising their roles 20 years after the events of the first film, and also features Rob Riggle, Laurie Holden, Rachel Melvin, and Kathleen Turner.", "The film tells the story of Lloyd Christmas and Harry Dunne (played by Carrey and Daniels, respectively), two dimwitted but good-natured adults who set out on a cross-country road trip to locate Harry's daughter who has been adopted.", "First announced in October 2011, \"Dumb and Dumber To\" underwent a turbulent pre-production phase which included, at one point, Carrey withdrawing from the project, and Warner Bros. refusing to distribute the film.", "The project was eventually taken on in 2013 by Red Granite Pictures and the film was shot in the fall of the same year.", "Released on November 14, 2014, by Universal Pictures, \"Dumb and Dumber To\" received a 29% on Rotten Tomatoes.", "The film grossed $36.1 million on its opening weekend and over $169 million worldwide." ], [ "Dumb and Dumberer: When Harry Met Lloyd", "Dumb and Dumberer: When Harry Met Lloyd\n\nDumb and Dumberer: When Harry Met Lloyd is a 2003 American comedy film.", "It is the second film in the \"Dumb and Dumber\" film series and a prequel to the 1994 film \"Dumb and Dumber\".", "The film was directed by Troy Miller and based on the characters created by the Farrelly brothers from the original film.", "The film was poorly received by critics; however, it was a modest domestic box office success considering its budget, taking in just under $40 million.", "The subtitle is inspired by the film \"When Harry Met Sally...\".", "In 1986, Harry Dunne (Derek Richardson) finally gets his chance to go to regular school.", "At the same time, Lloyd Christmas (Eric Christian Olsen) has been adopted and exchanged several times until he is finally accepted by the school janitor, Ray (Luis Guzm\u00e1n).", "Harry bumps into Lloyd on the way to school, in search for a treasure his mother (Mimi Rogers) asked him to find, and as if it were destiny, the two instantly became the best of friends.", "Lloyd introduces Harry to his \"friend\", Turk (Elden Henson), the school bully whose main function in life appears to be making Lloyd's life miserable." ], [ "Dumb and Dumber (franchise)", "Dumb and Dumber (franchise)\n\nDumb and Dumber is a series of comedy films starring Jim Carrey and Jeff Daniels.", "The films have been released from 1994 to 2014.", "The first film was released on December 16, 1994.", "Despite receiving mixed reviews from critics, it was a commercial success and developed a cult following in the years since its release.", "The success of \"Dumb and Dumber\" launched the career of the Farrelly brothers and solidified Carrey's.", "The film follows the characters of Harry and Lloyd as they travel across the country to Aspen to return a briefcase.", "In 2003, a prequel was theatrically released, entitled \"Dumb and Dumberer: When Harry Met Lloyd\".", "The film featured a cast and crew different from the previous film, and the Farrelly brothers had no involvement in the film's production.", "It was panned by critics, receiving a 10% rating on Rotten Tomatoes, and was only a minor box office success, grossing approximately $39.2 million worldwide against a $19 million budget, as opposed to the original film's far greater $247 million worldwide gross against a $17 million budget.", "In October 2011, the Farrelly brothers confirmed that they would make a sequel to \"Dumb and Dumber\".", "The sequel, titled \"Dumb and Dumber To\", was shot in the fall of 2013." ] ], "gold": "Julie Costello plays Fraida Felcher in the second Dumb and Dumber movie, Dumb and Dumberer: When Harry Met Lloyd. This 2003 film is the second entry in the Dumb and Dumber film series and is a prequel to the 1994 film Dumb and Dumber. Dumb and Dumberer: When Harry Met Lloyd depicts the original film's characters during their high school years. In Dumber and Dumber To, Kathleen Turner plays Fraida Felcher. Dumber and Dumber To was released in 2014 and is the third film in the Dumb and Dumber film series and a sequel to the 1994 film Dumb and Dumber. Dumber and Dumber To tells the story of Lloyd Christmas and Harry Dunne setting out on a cross-country road trip to locate Harry's daughter who has been adopted.", "prediction 1": "Dumb and Dumber is a series of comedy films starring Jim Carrey and Jeff Daniels. The films have been released from 1994 to 2014. Dumb and Dumberer: When Harry Met Lloyd is a 2003 American comedy film. The sequel, Dumb and Dumber To, was also released in 2013.", "prediction 2": "Dumb and Dumber is a series of comedy films starring Jim Carrey and Jeff Daniels. The first Dumb and Dumber film was released on December 16, 1994. The second Dumb and Dumber film was released on December 20, 2003. In the 2003 prequel, Freda is played by Eric Christian Olsen. In 2014, Freda is played by Rachel Melvin.", "prediction 3": "Dumb and Dumber is a series of comedy films starring Jim Carrey and Jeff Daniels, with the first two films released in 1994. In 2003 and 2014, Dumb and Dumberer: When Harry Met Lloyd, respectively, was released as a prequel to the 1994 film. In 2016, the film's sequel, Dumb and Dumber 2, was released as a sequel to the 2004 film. In 2013, Dumb and Dumberer: When Harry Met Lloyd was released as a sequel to the 2004 film.", "prediction 4": "Dumb and Dumber is a series of comedy films starring Jim Carrey and Jeff Daniels. The films have been released from 1994 to 2014. Dumb and Dumberer 2: Redemption is a 2003 American comedy film. The sequel to this film was released in 2015 and stars Jennifer Garner as Freda. In the 2014 sequel, Freda is played by Jim Carrey and Jeff Daniels.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 195 }, { "error type": "Incoherent", "explanation": "", "start": 238, "end": 242 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 255, "end": 260 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Dumb and Dumberer: When Harry Met Lloyd is a 2003 film. It is the second film in the \"Dumb and Dumber\" film series and a prequel to the 1994 film \"Dumb and Dumber\". The sequel, Dumb and Dumber To, was released in 2014. It is the third film in the \"Dumb and Dumber\" film series and a direct sequel to the 1994 film \"Dumb and Dumber\". The film tells the story of Lloyd Christmas and Harry Dunne setting out on a cross-country road trip to locate Harry's daughter who has been adopted." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who played mr. carlson on wkrp in cincinnati?", "passages": [ [ "WKRP in Cincinnati", "WKRP in Cincinnati\n\nWKRP in Cincinnati is an American sitcom that featured the misadventures of the staff of a struggling fictional radio station in Cincinnati, Ohio.", "The show was created by Hugh Wilson and was based upon his experiences working in advertising sales at Top 40 radio station WQXI in Atlanta.", "Many of the characters and even some of the stories (including season 1 episode 7, \"Turkeys Away\") are based on people and events at WQXI.", "The ensemble cast consists of Gary Sandy (as Andy Travis), Howard Hesseman (Johnny Fever), Gordon Jump (Arthur Carlson), Loni Anderson (Jennifer Marlowe), Tim Reid (Venus Flytrap), Jan Smithers (Bailey Quarters), Richard Sanders (Les Nessman) and Frank Bonner (Herb Tarlek).", "The series won a Humanitas Prize and received 10 Emmy Award nominations, including three for Outstanding Comedy Series.", "Andy Ackerman won an Emmy Award for Videotape Editing in season 3.", "\"WKRP\" premiered September 18, 1978, on the CBS television network, and aired for four seasons and 90 episodes through April 21, 1982.", "Starting in the middle of the second season, CBS repeatedly moved the show around its schedule, contributing to lower ratings and its eventual cancellation." ], [ "Arthur Carlson", "Arthur Carlson\n\nArthur Carlson, aka \"The Big Guy\" is a fictional character on the television situation comedy \"WKRP in Cincinnati\" (1978\u201382), the general manager of the low-rated Cincinnati radio station WKRP.", "The character was also a regular on the \"revival\" series, \"The New WKRP in Cincinnati\" (1991\u201393), still working as general manager of WKRP.", "He was played by Gordon Jump in both shows.", "Mr. Carlson is a well-meaning, bumbling, childlike man who is completely out of touch with the changes that have occurred in the radio and music business.", "He keeps his job as general manager of WKRP only because his mother, Lillian Carlson, better known as \"Mama Carlson\", owns the station.", "Unbeknownst to him, his mother has set up WKRP as a tax write-off that is intended to lose money, and she keeps him at the station not because she wants him to succeed but because she expects him to fail.", "Flashbacks in the episode \"Bah, Humbug\" reveal that Mr. Carlson joined WKRP as sales manager in the early 1950s.", "When his mother fired the previous station manager for being too generous to the employees, Arthur got his job." ], [ "Arthur Carlson", "He is married to Carmen (Allyn Ann McLerie), a sweet-natured woman who is almost as shy as he is: though they are happily married, their main problem is that they are so anxious to avoid hurting each other's feelings that they rarely tell each other what they really think.", "They have a son, Arthur Jr., whom they sent off to military school on Mama Carlson's advice; this proved to be a mistake when it turns \"Little Arthur\" into a nasty, racist, borderline fascist.", "In the first season, Mr. Carlson takes his son out of military school, to live with his parents and go to public school, but later references suggest that Little Arthur gets worse, not better; in one episode, it is revealed that Little Arthur wants to join the American branch of the Nazi Party, and in another it's stated that he wants to join the PLO.", "During the course of the series, Carmen has a surprise pregnancy and, after she and Arthur decide they want the baby, she gives birth to a daughter, whom she and Arthur hope they can raise their own way, without the mistakes they made with their son.", "The girl's name is later revealed to be Melanie in a subsequent episode." ] ], "gold": "On WKRP in Cincinnati, Gordon Jump plays Mr. Arthur Carlson, Sr., also known as the Big Guy. This character is the general manager of the low-rated Cincinnati radio station WKRP. This character is also a regular on the revival series, The New WKRP in Cincinnati, where he is still working as general manager of WKRP. He is played by Gordon Jump on both shows. On the shows, Mr. Arthur Carlson, Sr. is married to Carmen, and they have a son, Arthur Jr., whom they sent off to military school on Mama Carlson's advice. Arthur Carlson, Jr. is played by Sparky Marcus in the original series and Lightfield Lewis in the revival series. ", "prediction 1": "Arthur Carlson is a fictional character on the television situation comedy WKRP in Cincinnati. In the original series, Arthur is played by Gordon Jump. In the reboot, Arthur is played by Tim Reid. In the original series, Arthur is played by Allyn Ann McLerie.", "prediction 2": "WKRP in Cincinnati is an American sitcom that featured the misadventures of the staff of a struggling fictional radio station in Cincinnati, Ohio. The show was created by Hugh Wilson and was based upon his experiences working in advertising sales at Top 40 radio station WQXI in Atlanta. Arthur Carlson is played by Gordon Jump on the original WKRP in Cincinnati and a regular on the revival WKRP in Cincinnati, played by Jan Smithers.", "prediction 3": "The character of Arthur Carlson on the television sitcom WKRP in Cincinnati, played by Gordon Jump, was first seen in the 1978-82 episode \"Bah, Humbug\" of the first season. In the 1991-93 series, the character was played by Richard Sanders.", "prediction 4": "The character of Arthur Carlson, aka \"The Big Guy,\" is played by Gordon Jump on the television situation comedy WKRP in Cincinnati. Jump played Mr. Carlson in the original WKRP in Cincinnati and in the New WKRP in Cincinnati, which was remade in 1991.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 187, "end": 196 }, { "error type": "Redundant", "explanation": "Arthur Carlson is a fictional character on the television situation comedy WKRP in Cincinnati. In the original series, Arthur is played by Gordon Jump. ", "start": 197, "end": 259 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Arthur Carlson, aka \"The Big Guy\", is a fictional character on the television situation comedy WKRP in Cincinnati. He is the general manager of the low-rated Cincinnati radio station WKRP In the original series, Arthur is played by Gordon Jump. The character was also a regular on the \"revival\" series, \"The New WKRP in Cincinnati\" still working as general manager of WKRP. He is married to Carmen and they have a son, Arthur Jr., whom they sent off to military school on Mama Carlson's advice" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When does captain america the first avenger take place?", "passages": [ [ "Captain America: The First Avenger", "The lawsuit was eventually settled in September 2003.", "In 2005, Marvel received a $525 million investment from Merrill Lynch, allowing them to independently produce ten films, including \"Captain America\".", "Paramount Pictures agreed to distribute the film.", "Originally, the film would stand alone; producer Kevin Feige said \"about half\" the movie would be set during World War II before moving into the modern day.", "Producer Avi Arad said, \"The biggest opportunity with Captain America is as a man 'out of time', coming back today, looking at our world through the eyes of someone who thought the perfect world was small-town United States.", "Sixty years go by, and who are we today?", "Are we better?\"", "He cited the \"Back to the Future\" trilogy as an influence, and claimed he had \"someone in mind to be the star, and definitely someone in mind to be the director\".", "In February 2006, Arad hoped to have a summer 2008 theatrical release date.", "Jon Favreau approached Arad to direct the film as a comedy, but he chose to make \"Iron Man\" instead.", "In April 2006, David Self was hired to write the script.", "He explained that Captain America was his favorite superhero as a child because \"my dad told me I could one day be Captain America\".", "Joe Johnston met with Marvel to discuss directing the film." ], [ "Captain America: The First Avenger", "Captain America: The First Avenger\n\nCaptain America: The First Avenger is a 2011 American superhero film based on the Marvel Comics character Captain America, produced by Marvel Studios and distributed by Paramount Pictures.", "It is the fifth film in the Marvel Cinematic Universe (MCU).", "The film was directed by Joe Johnston, written by the writing team of Christopher Markus and Stephen McFeely, and stars Chris Evans as Steve Rogers / Captain America, alongside Tommy Lee Jones, Hugo Weaving, Hayley Atwell, Sebastian Stan, Dominic Cooper, Neal McDonough, Derek Luke, and Stanley Tucci.", "Set predominantly during World War II, \"Captain America: The First Avenger\" tells the story of Steve Rogers, a sickly man from Brooklyn who is transformed into super-soldier Captain America and must stop the Red Skull, who intends to use an artifact called the \"Tesseract\" as an energy-source for world domination.", "\"Captain America: The First Avenger\" began as a concept in 1997 and was scheduled for distribution by Artisan Entertainment.", "However, a lawsuit, not settled until September 2003, disrupted the project.", "In 2005, Marvel Studios received a loan from Merrill Lynch, and planned to finance and release it through Paramount Pictures.", "Directors Jon Favreau and Louis Leterrier were interested in directing the project before Johnston was approached in 2008." ], [ "Betsy Ross (comics)", "Betsy Ross (comics)\n\nBetsy Ross is Captain America's early love interest and supporting character in Marvel Comics appearing in American comic books published by Marvel Comics, during the 1930-1940s period known to historians and collectors as the Golden Age of Comic Books.", "She then debuted as the superheroine Golden Girl in \"Captain America Comics\" #66.", "Marvel Comics' first Golden Girl, Elizabeth Ross, first appeared, without yet a superhero identity, as Betty Ross in \"Captain America Comics\" #1 (cover-dated March 1941).", "A supporting character who appeared in occasional stories, she assisted the U.S. Army and was a love interest for Steve Rogers, Captain America's real identity.", "She succeeded Bucky as Captain America's sidekick in issue #66 (Dec. 1947), in the 12-page story \"Golden Girl\", by an unconfirmed writer and by penciller Syd Shores.", "Later, it was retconned that this was not Steve Rogers but Jeff Mace, the superhero Patriot and the third man to be called Captain America.", "Golden Girl appeared in \"Captain America\" stories through issue #74 (Oct. 1949), except for issue #71, and also in the Captain America stories in \"Marvel Mystery Comics\" #87-88 and #92 (Aug. & Oct. 1948, June 1949)." ] ], "gold": "\"Captain America: The First Avenger\" is a 2011 American superhero film based on the Marvel Comics character Captain America. The film takes place in 1941, during World War II, when Steve Rogers, a frail man, is transformed into a super-soldier and must stop the Red Skull from using the Tesseract as an energy source for world domination.", "prediction 1": "Captain America: The First Avenger is a 2011 American superhero film. It was set predominantly during World War II. It tells the story of Steve Rogers, a sickly man from Brooklyn who is transformed into super-soldier Captain America and must stop the Red Skull, who intends to use an artifact called the \"Tesseract\" as an energy-source for world domination. The film was produced by Marvel Studios and distributed by Paramount Pictures. Captain America: The First Avenger was originally planned to be set during World War II. However, the lawsuit was eventually settled in September 2003. The lawsuit was settled in September 2003, disrupted the project. The lawsuit was ultimately settled in September 2003, but was not settled until September 2003, disrupted the project.", "prediction 2": "Captain America: The First Avenger takes place during World War II. The film is the fifth film in the Marvel Cinematic Universe (MCU). The 2011 superhero film Captain America: The First Avenger was set predominantly during World War II. It was directed by Joe Johnston, written by the writing team of Christopher Markus and Stephen McFeely, and stars Chris Evans as Steve Rogers / Captain America.", "prediction 3": "Captain America: The First Avenger is a 2011 American superhero film produced by Marvel Studios and distributed by Paramount Pictures. The film takes place predominantly during World War II, and the story of Steve Rogers, an ill sickly man from Brooklyn who is transformed into super-soldier Captain America and must stop the Red Skull, who intends to use an artifact called the \"Tesseract\" as an energy-source for world domination. The film was directed by Joe Johnston, written by the writing team of Christopher Markus and Stephen McFeeeeeeeely, and Stephen McFeeeeeeely, and Stanley Tucci, as Steve Rogers, a sickly man from Brooklyn who is transformed into super-sold man from Brooklyn, who is transformed into Captain America, who is a sickly man from Brooklyn who is transformed into Captain America and is transformed into super-", "prediction 4": "Captain America: The First Avenger is an American superhero film based on the Marvel Comics character Captain America, produced by Marvel Studios and distributed by Paramount Pictures. The film takes place during World War II, although some scenes are set in the modern day. The film was directed by Joe Johnston, written by the writing team of Christopher Markus and Stephen McFeely, and stars Chris Evans as Steve Rogers / Captain America.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 437, "end": 525 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 654 }, { "error type": "Irrelevant", "explanation": "", "start": 655, "end": 773 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Captain America: The First Avenger is a 2011 American superhero film based on the Marvel Comics character Captain America. It was set predominantly during World War II. It tells the story of Steve Rogers, a sickly man from Brooklyn who is transformed into super-soldier Captain America and must stop the Red Skull, who intends to use an artifact called the \"Tesseract\" as an energy-source for world domination. " }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "What was the first cartoon walt disney made?", "passages": [ [ "Walt Disney", "By 1926 Winkler's role in the distribution of the \"Alice\" series had been handed over to her husband, the film producer Charles Mintz, although the relationship between him and Disney was sometimes strained.", "The series ran until July 1927, by which time Disney had begun to tire of it and wanted to move away from the mixed format to all animation.", "After Mintz requested new material to distribute through Universal Pictures, Disney and Iwerks created Oswald the Lucky Rabbit, a character Disney wanted to be \"peppy, alert, saucy and venturesome, keeping him also neat and trim\".", "In February 1928, Disney hoped to negotiate a larger fee for producing the \"Oswald\" series, but found Mintz wanting to reduce the payments.", "Mintz had also persuaded many of the artists involved to work directly for him, including Harman, Ising, Carman Maxwell and Friz Freleng.", "Disney also found out that Universal owned the intellectual property rights to Oswald.", "Mintz threatened to start his own studio and produce the series himself if Disney refused to accept the reductions.", "Disney declined Mintz's ultimatum and lost most of his animation staff, except Iwerks, who chose to remain with him." ], [ "Oswald the Lucky Rabbit", "Disney, together with Iwerks, decided to create a second cartoon titled \"Trolley Troubles\" featuring a much younger, neater Oswald.", "The short, released on September 5, 1927, officially launched the series and proved to be Disney's greatest success to date.", "The storyline for Poor Papa was reused in a Mickey Mouse short six years later, in \"Mickey's Nightmare\", 1932.", "Oswald the Lucky Rabbit became Disney's first major hit in 1927, rivaling other popular cartoon characters, such as Felix the Cat and Koko the Clown.", "The success of the Oswald series allowed the Walt Disney Studio to grow to a staff of nearly twenty.", "Walt's weekly salary from the series was $100 while Roy Disney's was $65.", "The Disney brothers earned $500 per Oswald short and split the year-end profits, with Walt receiving 60% ($5,361), and Roy receiving 40% ($3,574).", "With income gained from the Oswald series, Walt and Roy purchased ten acres of land in the desert.", "They also invested in an oil-drilling venture.", "Iwerks also invested his income in several stone mills to crush paint pigment he used to make paint formulas that were utilized by animators for decades." ], [ "Alice Comedies", "Alice Comedies\n\nThe Alice Comedies are a series of animated cartoons\ncreated by Walt Disney in the 1920s, in which a live action little girl named Alice (originally played by Virginia Davis) and an animated cat named Julius have adventures in an animated landscape.", "Disney, Ub Iwerks, and their staff made the first \"Alice Comedy\", a one-reel (ten-minute) short subject titled \"Alice's Wonderland\", while still heading the failing Laugh-O-Gram Studio in Kansas City, Missouri.", "\"Alice's Wonderland\" begins with Alice entering a cartoon studio to witness cartoons being created.", "Alice is amazed by what she sees: the cartoon characters come to life and play around.", "After heading to bed that night, she dreams of being in the cartoon world, welcomed by all of the characters.", "Alice plays with them until a group of lions break free from a cage and chase her.", "Though never released, this short helped set the stage for what was to come in the later \"Alice Comedies\", as it established the world as a playful dream and also introduced the elements which would soon define the series.", "The idea of setting a real-world girl in an animated world was at this point in film history still unique.", "The design and voice of the later series were all set by this original film.", "After completing the film, the studio went bankrupt and was forced to shut down." ] ], "gold": "For years, Walt Disney worked on the Alice Comedies, a series of animated/live actions shorts of which Disney grew tired, deciding to move away from the mixed format to all animation and crating his overall first cartoon, Oswald the Lucky Rabbit, in 1927. After losing the rights to this character, Disney developed Mickey Mouse as a replacement, which debuted in the animated short Steamboat Willie on November 18th, 1928, notable for being the first cartoon made with synchronized sound. By 1934, Disney had become dissatisfied with producing formulaic cartoon shorts and believed a feature-length cartoon would be more profitable, beginning the four-year production of Snow White and the Seven Dwarfs. The film was Disney's first animated feature film, releasing in 1937 to critical and commercial success.", "prediction 1": "Walt Disney, together with Ub Iwerks, and their staff made the first \"Alice Comedy\", a one-reel (ten-minute) short subject titled \"Alice's Wonderland\", while still heading the failing Laugh-O-Gram Studio in Kansas City, Missouri. The storyline for Poor Papa was reused in a Mickey Mouse short six years later, in \"Mickey's Nightmare\", 1932.", "prediction 2": "Disney, together with Iwerks, decided to create a second cartoon titled Trolley Troubles featuring a much younger, neater Oswald. The short, released on September 5, 1927, officially launched the series and proved to be Disney's greatest success to date. The first one-reel (ten-minute) short subject titled \"Alice's Wonderland\", was made while still heading the failing Laugh-O-Gram Studio in Kansas City, Missouri. It set the stage for what would come later series as it would set the scene for what would soon define the character voice and design and voice would later characters. It was the first \"Alice Comedy\", a one-reel (reeland), which was completed and was forced to shut down after completing the film.", "prediction 3": "Walt Disney made his first cartoon in 1926 with Ub Iwerks, under the direction of Charles Mintz, named Alice's Wonderland. The short was a one reel, ten minute film, titled Alice's Comedy, which set the stage for the later Alice Comedies. The film's director, Mickey Mouse, was Walt Disney's son. Walt Disney, who had been working with Iwerks, created the first \"Alice Comedy\", a one reel, ten minute film, titled Alie's Wonderland, which was released on September 5, 1927.", "prediction 4": "Disney, together with Iwerks, decided to create a second cartoon titled \"Trolley Troubles\" featuring a much younger, neater Oswald. The short, released on September 5, 1927, officially launched the series and proved to be Disney's greatest success to date. The first two Disney cartoons were the Alice Comedy and the Alice Comedies 2. Walt Disney was a film producer at that time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 340 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Walt Disney, together with Ub Iwerks, and their staff made the first \"Alice Comedy\", which turned into a series of animated cartoons. Disney had begun to tire of it and wanted to move away from the mixed format to all animation. Oswald the Lucky Rabbit became Disney's first major hit in 1927." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the most highly decorated soldier in us history?", "passages": [ [ "Audie Murphy", "Audie Murphy\n\nAudie Leon Murphy (20 June 1925\u00a0\u2013 28 May 1971) was one of the most decorated American combat soldiers of World War II.", "He received every military combat award for valor available from the U.S. Army, as well as French and Belgian awards for heroism.", "Murphy received the Medal of Honor for valor that he demonstrated at the age of 19 for single-handedly holding off an entire company of German soldiers for an hour at the Colmar Pocket in France in January 1945, then leading a successful counterattack while wounded and out of ammunition.", "Murphy was born into a large family of sharecroppers in Hunt County, Texas.", "His father abandoned them, and his mother died when he was a teenager.", "Murphy left school in fifth grade to pick cotton and find other work to help support his family; his skill with a hunting rifle helped feed his family.", "After the attack on Pearl Harbor in 1941, Murphy's older sister helped him to falsify documentation about his birthdate in order to meet the minimum-age requirement for enlisting in the military.", "Turned down by the Navy and the Marine Corps, he enlisted in the Army.", "He first saw action in the 1943 Allied invasion of Sicily; then in 1944 he participated in the Battle of Anzio, the liberation of Rome, and the invasion of southern France." ], [ "Alvin York", "Alvin York\n\nAlvin Cullum York (December 13, 1887\u00a0\u2013 September 2, 1964), also known as Sergeant York, was one of the most decorated United States Army soldiers of World War I.", "He received the Medal of Honor for leading an attack on a German machine gun nest, taking at least one machine gun, killing at least 25 enemy soldiers and capturing 132.", "York's Medal of Honor action occurred during the United States-led portion of the Meuse-Argonne Offensive in France, which was intended to breach the Hindenburg line and force the Germans to surrender.", "He earned decorations from several allied countries during WWI, including France, Italy and Montenegro.", "York was born in rural Tennessee.", "His parents farmed, and his father worked as a blacksmith.", "The eleven York children had minimal schooling because they helped provide for the family, which included hunting, fishing, and working as laborers.", "After the death of his father, York assisted in caring for his younger siblings and found work as a logger and on construction crews.", "Despite being a regular churchgoer, York also drank heavily and was prone to fistfights.", "After a 1914 conversion experience, he vowed to improve and became even more devoted to the Church of Christ in Christian Union.", "York was drafted during World War I; he initially claimed conscientious objector status on the grounds that his religious denomination forbade violence." ], [ "Jorge Otero Barreto", "Jorge Otero Barreto\n\nSergeant First Class Jorge A. Otero Barreto (born 7 April 1937), a.k.a.", "\"the Puerto Rican Rambo\", is a retired United States Army soldier.", "He earned 38 military decorations during his career, and has been called the most decorated U.S. soldier of the Vietnam War.", "Due to his multiple awards he has received recognition from numerous organizations and has had buildings named after him.", "He is also the main subject of \"Brave Lords\", a documentary which tells the story of the Puerto Rican experience in the war in Vietnam.", "Otero Barreto was born in the town of Vega Baja, Puerto Rico, the son of Eloy Otero-Bruno and Crispina Barreto-Torres.", "His father named him \"Jorge\", Spanish for George, after George Washington whom Otero-Bruno admired.", "In Vega Baja, Otero Barreto received his primary and secondary education.", "He attended college for three years, studying biology until 1959 when he joined the U.S. Army.", "After his basic training, he attended the Army's Air Assault School, graduating in 1960.", "He was the first Puerto Rican to graduate from the U.S. Army Air Assault School.", "From 1961 to 1970, Otero Barreto served five tours in Southeast Asia, starting as an advisor who helped train Vietnamese troops." ] ], "gold": "In World War II, Audie Murphy was called the most highly decorated American combat soldier. He received every military combat award for valor available from the U.S. Army, as well as French and Belgian awards for heroism. Murphy received the Medal of Honor for valor that he demonstrated at the age of 19 for single-handedly holding off an entire company of German soldiers for an hour at the Colmar Pocket in France in January 1945. He then led a successful counterattack while wounded and out of ammunition. In World War I, Alvin York was one of the most highly decorated United States Army soldiers. He received the Medal of Honor for leading an attack on a German machine gun nest, taking at least one machine gun, killing at least 25 enemy soldiers and capturing 132. He also earned decorations from several allied countries during WWI, including France, Italy and Montenegro. In the Vietnam War, Jorge Otero Barreto earned 38 military decorations during his career and has been called the most decorated U.S. soldier of the Vietnam War. Among his many decorations are 2 Silver Stars, 5 Bronze Stars with Valor, 4 Army Commendation Medals, 5 Purple Hearts and 5 Air Medals. However, NBC News said that Robert L. Howard may have been the most highly decorated American soldier of the modern era. Robert L. Howard was the most highly decorated officer of Vietnam United States Army Special Forces and was a Medal of Honor recipient. He was wounded 14 times over 54 months of combat. Howard was awarded the Medal of Honor, 8 Purple Hearts, a Distinguished Service Cross, a Silver Star and 4 Bronze Stars.", "prediction 1": "The most highly decorated US soldier is Audie Leon Murphy, who from 1925 to 1971, received every military combat award for valor available from the U.S. Army, as well as French and Belgian awards for heroism. Another decorated US soldier is Alvin Cullum York, who served in World War I. He received the Medal of Honor for leading an attack on a German machine gun nest, taking at least one machine gun, killing at least 25 enemy soldiers and capturing 132. The most decorated US soldier in the Vietnam War is Jorge A. Otero Barreto, a retired United States Army Sergeant Second Class, who earned 38 military decorations during his career. Also, he has been called the most decorated US soldier of the Vietnam War.", "prediction 2": "The most decorated US soldier in history is Audie Leon Murphy. In addition, the most decorated US soldier in World War II was Alvin Cullum York, a sergeant in the United States Army who received the Medal of Honor for leading an attack on a German machine gun nest, taking at least one machine gun, killing at least 25 enemy soldiers and capturing 132. In the Vietnam War, Jorge A. Otero Barreto, a retired United States Army soldier, earned 38 military decorations during his career.", "prediction 3": "The most decorated US soldier in history is Audie Leon Murphy, who was one of the most decorated American combat troops of World War II. In addition, Audie Murphy is the most decorated US soldier in history to have served in World War II, the second-most decorated US soldier to have served in the Vietnam War, and the most decorated US soldier to have served in the Korean War.", "prediction 4": "The most decorated soldier in the United States is Alvin Cullum York, who earned 38 military decorations during his career. The top five most decorated soldiers in the United States are Audie Murphy, Alvin York, and Jorge Otero Barreto, all of whom have been called the most decorated soldiers of the Vietnam War.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1,2]}", "start": 63, "end": 81 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 4, "end": 15 }, { "error type": "Irrelevant", "explanation": "", "start": 533, "end": 584 }, { "error type": "Redundant", "explanation": "The most decorated US soldier in the Vietnam War is Jorge A. Otero Barreto, a retired United States Army Sergeant Second Class, who earned 38 military decorations during his career.", "start": 664, "end": 713 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "One of the most highly decorated US soldier is Audie Leon Murphy, who from 1925 to 1971, received every military combat award for valor available from the U.S. Army, as well as French and Belgian awards for heroism. Murphy received the Medal of Honor for valor that he demonstrated at the age of 19 for single-handedly holding off an entire company of German soldiers for an hour at the Colmar Pocket in France in January 1945, then leading a successful counterattack while wounded and out of ammunition. Another decorated US soldier is Alvin Cullum York, who served in World War I. He received the Medal of Honor for leading an attack on a German machine gun nest, taking at least one machine gun, killing at least 25 enemy soldiers and capturing 132. He earned decorations from several allied countries during WWI, including France, Italy and Montenegro. The most decorated US soldier in the Vietnam War is Jorge A. Otero Barreto, who earned 38 military decorations during his career. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was hershey's cookies and cream made?", "passages": [ [ "Hershey's Cookies 'n' Creme", "Hershey's Cookies 'n' Creme\n\nHershey's Cookies 'n' Creme is a Flavoring of Candy Bar manufactured by The Hershey Company.", "Hershey's Cookies 'n' Creme is a flat, white candy bar containing small, uniformly-shaped cookie bits similar in taste and texture to an Oreo.", "It was introduced in 1994.", "The king size variant of the bar shares the dimensions of the original bar but is thicker vertically.", "This is one of the few Hershey's chocolates sold in the United Kingdom.", "The standard-sized bar has 12 rectangular blocks arranged in a 3X4 grid.", "Similar Cookies \u2018n\u2019 Creme candies manufactured by Hershey were released as Hershey's Drops in 2010.", "The Hershey Company later changed the ingredients of some of its products in order to replace the relatively expensive cocoa butter with oil substitutes.", "As a result, the packaging no longer states that the bar contains white chocolate.", "1.55oz or 43g bar:\n\nOn July 5, 2013, Hershey's Cookies 'n' Creme was released as a cereal by General Mills." ] ], "gold": "The Hershey's Cookies 'n' Creme candy bar was introduced in 1994. Similar Cookies 'n' Creme candies manufactured by Hershey were released as Hershey's Drops in 2010. Hershey's Cookies 'n' Creme cereal was released in the United States by General Mills on July 5, 2013. ", "prediction 1": "Hershey's Cookies 'n' Creme is a flat, white candy bar containing small, uniformly-shaped cookie bits similar in taste and texture to an Oreo. It was introduced in 1994. Similar Cookies \u2018n\u2019 Creme candies manufactured by Hershey were released as Hershey's Drops in 2010. On July 5, 2013, Hershey's Cookies 'n' Creme was released as a cereal by General Mills.\n", "prediction 2": "Hershey's Cookies 'n' Creme is a Flavoring of Candy Bar manufactured by The Hershey Company. Hershey's Cookies 'n' Creme is a flat, white candy bar containing small, uniformly-shaped cookie bits similar in taste and texture to an Oreo. It was introduced in 1994. The king size variant of the bar shares the dimensions of the original bar but is thicker vertically. Similar Cookies \u2018n\u2019 Creme candies manufactured by Hershey were released as Hers Drops in 2010. Similar Cookies \u2018n' Creme candies manufactured by Hers were released as Hers Drops in 2010.", "prediction 3": "Hershey's Cookies 'n' Creme is a flat, white candy bar containing small, uniformly-shaped cookie bits similar in taste and texture to an Oreo. It was introduced in 1994 and a king size variant was produced in 2013.", "prediction 4": "Hershey's Cookies 'n' Creme is a flat, white candy bar containing small, uniformly-shaped cookie bits similar in taste and texture to an Oreo. It was introduced in 1994. On July 5, 2013, Hershey's Cookies 'n' Creme was released as a cereal by General Mills.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 142 } ], "missing-info": [], "corrected-prediction": "Hershey's Cookies 'n' Creme candy bar was introduced in 1994. Similar Cookies \u2018n\u2019 Creme candies manufactured by Hershey were released as Hershey's Drops in 2010. On July 5, 2013, Hershey's Cookies 'n' Creme was released as a cereal by General Mills.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the new shape audi a6 come out?", "passages": [ [ "Audi A6", "It was only available with a revised six-speed manual transmission (parts code prefix: 01E, identification code: DGU) (gear ratios \u2013 1st: 3.500, 2nd: 1.889, 3rd: 1.320, 4th: 1.034, 5th: 0.857, 6th: 0.730), with a final drive ratio of 4.111.", "Further revisions were made to the suspension, brakes and wheels.", "The front brake discs were enlarged to in diameter by thick.", "Standard wheels were 8Jx17 \"Avus\" cast aluminium alloy wheels, with an optional 7Jx16 alloy wheel for use with winter tyres was also available.", "With so much power on tap, the S6 Plus saloon could reach from a standstill in 5.6\u00a0seconds, with the Avant a tenth of a second slower at 5.7\u00a0seconds.", "In February 1997, the introduction of a new A6 (\"Typ\" 4B), based on a new design automobile platform \u2013 the Volkswagen Group C5 platform, with a new range of engines was announced and appeared in March at the 1997 Geneva Motor Show.", "This new A6 moved up a notch in quality, and was marketed in the same categories as the BMW 5 Series and the Mercedes-Benz E-Class." ], [ "Audi A6", "The five-mode air suspension can be raised by up to 60\u00a0mm (2.36\u00a0in) to provide ground clearance of 185\u00a0mm (7.28\u00a0in) which is better than the older four-mode.", "The car featured a number of off-road styling cues including larger bumpers and sills.", "In some European markets, this A6 allroad quattro was more expensive than the larger Audi Q7, but air suspension is an expensive option in the Q7.", "In its native country, Germany, it cost a few hundred Euros less than the Q7.", "In 2005, the A6 won the \"World Car of the Year\" award, and has also won the \"Practical Caravan\" \"Towcar of the Year\" awards, due to its array of towing features such as adjustable suspension height and damping, and the presence of a 123 Trailer Stability Programme.", "Audi unveiled a facelifted \"C6\" Audi A6 on 12 August 2008, at the Moscow International Motor Show.", "The refresh incorporates some modern Audi design cues to keep the A6 current with the rest of the Audi lineup." ], [ "Audi A6", "There are minor cosmetic changes to the front and rear lights which now have daytime running LEDs, the taillights extend towards the center of the trunk lid and pinch off at the license plate mount, however their shape remains rectangular compared to the more sculpted light clusters found in the 2008 Audi A5, 2008 Audi A4, and 2009 Audi Q5 (the latter three being all-new generations).", "The intakes below the headlamps are inspired by the Audi RS5.", "The A6's six (per side) front light-emitting diode (LED) daytime running lights (DRLs) are located within the main headlamp housing, similar to RS6's placement of the LEDs (ten per side), whereas on the S6 these front LEDs (five per side) are found adjacent to the fog lamps in the lower front bumper.", "The new front and rear fascias from RS6 would be used on the facelifted A6 and S6 lineup.", "Also updated for 2009 is the Quattro all-wheel drive setup, which is already found on the 2008 Audi A5 and 2008 Audi A4.", "This new system features a 40/60 front-to-rear torque split and offers a more balanced feel, reducing the understeer that comes from 50/50 AWD platforms." ] ], "gold": "In 1994, the latest generation of the Audi 100 received a facelift and was renamed as the Audi A6. Then, in February 1997, the introduction of a new A6 based on a new design automobile platform was announced and appeared in March at the 1997 Geneva Motor Show. The redesigned body of the A6 presented a modern design with a fastback styling which set the trend for the Audi lineup. Then, in 2008, Audi unveiled a facelifted C6 Audi A6 at the Moscow International Motor Show. The refresh incorporated some modern Audi design cues to keep the A6 current with the rest of the Audi lineup. These included minor cosmetic changes to the front and rear lights and having the taillights extend towards the center of the trunk lid and pinch off at the license plate mount. Then, in 2015, Audi unveiled the 2015 C7 mid-life facelift at the 2014 Paris Motor Show. This refresh included styling tweaks to the car's exterior.", "prediction 1": "The new Audi A6 was introduced in February 1997 and debuted at the 1997 Geneva Motor Show. The facelifted Audi A6 was unveiled on 12 August 2008 at the Moscow International Motor Show.", "prediction 2": "The Audi A6's shape was changed in February 1997 to a new shape, based on a new design platform, the Volkswagen Group C5 platform, with a new range of engines, which was unveiled in March 1997 at the Geneva Motor Show. The facelifted Audi A6 was unveiled on 12 August 2008 at the Moscow International Motor Show, and features an updated front and rear light configuration, which now has daytime running LEDs, and the taillights extend towards the center of the trunk lid and pinch off at the license plate mount. The shape of the taillights remains rectangular, however their shape remains rectangular compared to the more sculpted light clusters found in the 2008 Audi A5, 2008 Audi A4, and 2009 Audi Q5 (the latter three being all-new generations).", "prediction 3": "In February 1997, the introduction of a new Audi A6 (\"Typ\" 4B), based on a new design automobile platform \u2013 the Volkswagen Group C5 platform, with a new range of engines was announced and appeared in March at the 1997 Geneva Motor Show. The facelifted \"C6\" Audi A6 was unveiled on 12 August 2008, at the Moscow International Motor Show.", "prediction 4": "The new Audi A6 was introduced in February 1997 in the form of a new model called the A6 Sportback. It was unveiled in March 1997 at the Geneva Motor Show. The Audi A6 Sportback was unveiled on 12 August 2008 in the form of a facelifted C6 model, which replaced the A6 Sportback.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The new Audi A6 was introduced in February 1997 based on a new design automobile platform was debuted at the 1997 Geneva Motor Show. The facelifted Audi A6 was unveiled on 12 August 2008 at the Moscow International Motor Show. There are minor cosmetic changes to the front and rear lights which now have daytime running LEDs, the taillights extend towards the center of the trunk lid and pinch off at the license plate mount, " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where is comic con held in san diego?", "passages": [ [ "San Diego Comic-Con", "When he moved to San Diego, California, in 1970, he organized a one-day convention (Golden State Comic-Minicon) on March 21, 1970, \"as a kind of 'dry run' for the larger convention he hoped to stage.\"", "Dorf went on to be associated with the convention as president or manager, variously, for years until becoming estranged from the organization.", "Alf co-chaired the first convention with Krueger and became chairman in 1971.", "Following the initial gathering, Dorf's first three-day San Diego comics convention, the Golden State Comic-Con, drew 300 people and was held at the U.S. Grant Hotel from August\u00a01\u20133, 1970.", "Other locations in the convention's early years included the El Cortez Hotel, the University of California, San Diego, and Golden Hall, before being moved to the San Diego Convention Center in 1991.", "Richard Alf, chairman in 1971, has noted an early factor in the Con's growth was an effort \"to expand the Comic-Con [organizing] committee base by networking with other fandoms such as the Society for Creative Anachronism and the Mythopoeic Society, among others.", "(We found a lot of talent and strength through diversity).\"" ], [ "San Diego Comic-Con", "San Diego Comic-Con\n\nSan Diego Comic-Con International is a multi-genre entertainment and comic convention held annually in San Diego, California, United States.", "The name, as given on its website, is Comic-Con International: San Diego; but it is commonly known simply as Comic-Con or the San Diego Comic-Con or \"SDCC\".", "It was founded as the Golden State Comic Book Convention in 1970 by a group of San Diegans that included Shel Dorf, Richard Alf, Ken Krueger, and Mike Towry; later, it was called the \"San Diego Comic Book Convention\".", "It is a four-day event (Thursday\u2013Sunday) held during the summer (in July since 2003) at the San Diego Convention Center in San Diego.", "On the Wednesday evening prior to the official opening, professionals, exhibitors, and pre-registered guests for all four days can attend a pre-event \"Preview Night\" to give attendees the opportunity to walk the exhibit hall and see what will be available during the convention.", "Comic-Con International also produces two other conventions, WonderCon, held in Anaheim, and the Alternative Press Expo (APE), held in San Francisco." ], [ "San Diego Comic-Con", "Since 1974, Comic-Con has bestowed its annual Inkpot Award on guests and persons of interest in the popular arts industries, as well as on members of Comic-Con's board of directors and the Convention committee.", "It is also the home of the Will Eisner Awards.", "Originally showcasing primarily comic books and science fiction/fantasy related film, television, and similar popular arts, the convention has since included a larger range of pop culture and entertainment elements across virtually all genres, including horror, Western animation, anime, manga, toys, collectible card games, video games, webcomics, and fantasy novels.", "In 2010 and each year subsequently, it filled the San Diego Convention Center to capacity with more than 130,000 attendees.", "In addition to drawing huge crowds, the event holds several Guinness World Records including the largest annual comic and pop culture festival in the world.", "The convention was founded in 1970 by Shel Dorf, Richard Alf, Ken Krueger, Mike Towry, Barry Alfonso, Bob Sourk, and Greg Bear.", "Detroit, Michigan-born, comics fan Shel Dorf, had, in the mid-1960s, mounted the Detroit Triple-Fan Fairs, one of the first commercial comics-fan conventions." ] ], "gold": "The San Diego Comic-Con is a comic book convention and nonprofit multi-genre entertainment event that has been held annually in San Diego, California, since 1970. The convention was founded by Shel Dorf, Richard Alf, Ken Krueger, Mike Towry, Barry Alfonso, Bob Sourk, and Greg Bear, who organized a one-day convention, the Golden State Comic-Minicon, on March 21, 1970, as a kind of 'dry run' for the larger convention they hoped to stage. Following the initial gathering, the first three-day San Diego comics convention drew 300 people and was held at the U.S. Grant Hotel from August 1\u20133, 1970, although, during its early years, the convention would move to the El Cortez Hotel, the University of California, San Diego, and Golden Hall. Nowadays, the San Diego Comic-Con is held at the San Diego Convention Center, with various other related events also taking place in Downtown San Diego.", "prediction 1": "San Diego Comic-Con International, formerly Comic-Con San Diego, is a multi-genre entertainment and comic convention held annually in San Diego, California, United States. It was founded as the Golden State Comic Book Convention in 1970 by a group of San Diegans that included Shel Dorf, Richard Alf, Ken Krueger, and Mike Towry. Other locations in the convention's early years included the El Cortez Hotel, the University of California, San Diego, and Golden Hall, before being moved to the San Diego Convention Center in 1991.", "prediction 2": "San Diego Comic-Con International is a multi-genre entertainment and comic convention held annually in San Diego, California, United States. The name, as given on its website, is Comic-Con International: San Diego, but it is commonly known simply as Comic-Con or the San Diego Comic-Con or SDCC. It was founded as the Golden State Comic Book Convention in 1970 by a group of San Diegans that included Shel Dorf, Richard Alf, Ken Krueger, and Mike Towry. Other locations in the early years included the El Cortez Hotel, the University of California, and Golden Hall, before being moved to the San Diego Convention Center in 1991.", "prediction 3": "San Diego Comic-Con International is a multi-genre entertainment and comic convention held annually in San Diego, California, United States. It was founded as the Golden State Comic Book Convention in 1970 by a group of San Diegans that included Shel Dorf, Richard Alf, Ken Krueger, and Mike Towry. It was held at the U.S. Grant Hotel from August 1\u20133, 1970. Other locations in the convention's early years included the El Cortez Hotel, the University of California, San Diego, and Golden Hall, before being moved to the San Diego Convention Center in 1991.", "prediction 4": "San Diego Comic-Con International is a multi-genre entertainment and comic convention held annually in San Diego, California, United States. It is a four-day event (Thursday\u2013Sunday) held during the summer (in July since 2003) at the San Diego Convention Center.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 329 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "San Diego Comic-Con International, formerly Comic-Con San Diego, is a multi-genre entertainment and comic convention held annually in San Diego, California, United States. The convention was founded in 1970 by Shel Dorf, Richard Alf, Ken Krueger, Mike Towry, Barry Alfonso, Bob Sourk, and Greg Bear, who organized a one-day convention, the Golden State Comic-Minicon, on March 21, 1970, as a kind of 'dry run' for the larger convention they hoped to stage. Following the initial gathering, Dorf's first three-day San Diego comics convention, the Golden State Comic-Con, drew 300 people and was held at the U.S. Grant Hotel from August 1\u20133, 1970. Other locations in the convention's early years included the El Cortez Hotel, the University of California, San Diego, and Golden Hall, before being moved to the San Diego Convention Center in 1991." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When does the next episode of grand tour come out?", "passages": [ [ "The Grand Tour", "The Grand Tour\n\nThe Grand Tour is a British motoring television series for Amazon Video, presented by Jeremy Clarkson, Richard Hammond, and James May, and produced by Andy Wilman.", "The four agreed to produce the series following their departures from the BBC series \"Top Gear\" with an initial agreement of 36 episodes over three years.", "Episodes are released weekly to those with Amazon Prime Video accounts, repeats of the first series began airing on traditional broadcasters in late 2017.", "the show was made available to an additional 195 countries and various territories.", "Studio audience segments for the first series were filmed in the travelling tent between 17 July and 11 December 2016 in various countries, while for the second series the tent was stationed permanently in the Cotswolds.", "Series one was filmed from mid-2016 and premiered on 18 November 2016.", "Series two was filmed over the same time period the following year; however, filming was set back due to various illnesses and injuries suffered by the presenters.", "Due to this, it premiered on 8 December 2017.", "The third series is due to air on 18 January 2019.", "In the days following the launch, \"The Holy Trinity\" became Amazon Video's most watched premiere episode.", "Overall, the show has received positive reviews from critics.", "\"The Grand Tour\" is presented as a mix of pre-recorded television films and live-audience segments presented in a large tent to an audience of about 300 members." ], [ "Educating Greater Manchester", "Educating Greater Manchester\n\nEducating Greater Manchester is the fifth series of the BAFTA award-winning British documentary television programme \"Educating\" broadcast on Channel 4.", "The eight-episode fifth series began broadcast from 31 August 2017.", "The documentary follows previous installments in the \"Educating...\" series including the BAFTA Award-winning \"Educating Essex\" (2011), \"Educating Yorkshire\" (2013), \"Educating the East End\" (2014) and \"Educating Cardiff\" (2015).", "The fifth series was filmed at Harrop Fold School in Little Hulton, Salford.", "Channel 4 confirmed in January 2018 that the \"Educating\" programme was renewed for two further series, set to air in 2018 and 2019.", "For the first time, the series will return to the same school for the sixth and seventh series, in Manchester.", "\n\nAfter the fourth series of the educating series ended it was announced that the series would be shelved till 2017 to give the show a break and a rest.", "It was announced on 22 December 2016 by Channel 4 that the Educating would be returning in 2017 with a fifth series after a 2-year break.", "The series will again be filmed using fly on the wall cameras and will film the lives of teachers and students.", "The fifth series will be filmed in Salford, Greater Manchester." ] ], "gold": "The Grand Tour is a British motoring television series for Amazon Prime Video that focuses on conducting reviews of various cars, new models, and vintage classics, as well as tackling motoring-styled challenges and races, and features the use of studio segments between pre-recorded films. On 13 December 2018, Amazon announced that The Grand Tour had been renewed for a fourth series, retiring the studio and audience format in favor of films dedicated to road trips and adventure specials, similar to the feature-length specials of Top Gear. In March 2021, Jeremy Clarkson confirmed that the fourth special, recorded in the United Kingdom in early 2021, was expected to be released by the end of the year. During 2017, episodes 15, 16, and 17 of the series came out on 15 December, 22 December, and 29 December 2017, respectively.", "prediction 1": "The Grand Tour is a British motoring television series for Amazon Video, presented by Jeremy Clarkson, Richard Hammond, and James May, and produced by Andy Wilman. Episodes are released weekly to those with Amazon Prime Video accounts, repeats of the first series began airing on traditional broadcasters in late 2017. The 8-episode fifth series of the BAFTA award-winning British documentary television programme Educating Greater Manchester began broadcast from 31 August 2017.", "prediction 2": "The series The Grand Tour was first broadcast on 18 November 2016. The next episode of the series was broadcast on 22 December 2016.", "prediction 3": "The Grand Tour is a British motoring television series for Amazon Video, presented by Jeremy Clarkson, Richard Hammond, and James May, and produced by Andy Wilman. Episodes are released weekly to those with Amazon Prime Video accounts, repeats of the first series began airing on traditional broadcasters in late 2017.", "prediction 4": "The Grand Tour is a British motoring television series for Amazon Video, presented by Jeremy Clarkson, Richard Hammond, and James May, and produced by Andy Wilman. Episodes are released weekly to those with Amazon Prime Video accounts, repeats of the first series began airing on traditional broadcasters in late 2017. The eighth episode of the series, Educating Greater Manchester, was broadcast on 31 August 2017, the seventh episode was broadcast on 8 January 2019 and the eighth episode was broadcast on 31 August 2021.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 346, "end": 442 } ], "missing-info": [], "corrected-prediction": "The Grand Tour is a British motoring television series for Amazon Video. Episodes are released weekly to those with Amazon Prime Video accounts, repeats of the first series began airing on traditional broadcasters in late 2017. The 8-episode fifth series began broadcast from 31 August 2017." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who does sabrina end up with in sabrina the teenage witch?", "passages": [ [ "Sabrina the Teenage Witch", "Sabrina the Teenage Witch\n\nSabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman.", "Sabrina was created by writer George Gladir and artist Dan DeCarlo, and first appeared in \"Archie's Madhouse\" #22 (cover-dated Oct. 1962).", "Storylines of the character at elementary-school-age also appear under the title \"Sabrina -- That Cute Little Witch\" in almost all of the \"Little Archie\" comics.", "The series' premise is that Sabrina, a \"half-witch\" \u2013 her mother is an ordinary human, or \"mortal\" as witches refer to them, while her father is a witch \u2013 lives with her two aunts, Hilda and Zelda Spellman, both witches themselves, in the fictional town of Greendale, which is located somewhere near Riverdale, the home of Archie Andrews.", "Also living with the three women as the family pet is Salem Saberhagen, a witch who's been turned into a cat as punishment for world domination attempts.", "Sabrina's primary romantic interest is her mortal boyfriend Harvey Kinkle who, like nearly all the other mortals in Sabrina's world, is unaware his girlfriend is a witch." ], [ "Sabrina the Teenage Witch (1996 TV series)", "Sabrina the Teenage Witch (1996 TV series)\n\nSabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name.", "The show premiered on September 27, 1996, on ABC to over 17 million viewers in its \"T.G.I.F.\" line-up.", "The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers (a departure from the \"Archie Comics\", where she has known of her magic powers since an early age as revealed in the \"Sabrina \u2013 That Cute Little Witch\" storylines in many \"Little Archie\" comic books).", "She lives with her 500-year-old aunts, witches Hilda (played by Caroline Rhea) and Zelda (played by Beth Broderick), and their magical talking cat, Salem (voiced by Nick Bakay), at 133 Collins Road, in the fictional Boston suburb of Westbridge, Massachusetts through most of the series.", "The series' first four seasons aired on ABC from September 27, 1996, to May 5, 2000; the final three seasons ran on The WB from September 22, 2000, to April 24, 2003.", "The unofficial pilot of the series was the 1996 TV movie \"Sabrina the Teenage Witch\" in April." ] ], "gold": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. Sabrina's primary romantic interest is her mortal boyfriend Harvey Kinkle who, like nearly all the other mortals in Sabrina's world, is unaware his girlfriend is a witch. Sabrina the Teenage Witch is an American television sitcom created by Nell Scovell, based on the Archie Comics series of the same name. Like the comic book, Sabrina ends up with Harvey Kinkle.", "prediction 1": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers. Sabrina ends up with her aunts Hilda and Zelda Spellman, both witches themselves, and their magical talking cat, Salem.", "prediction 2": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers. She ends up with a witch, Salem Saberhagen, in the 1996 television series. A witch named Harvey Kinkle, who, like nearly all the other mortals in Sabrina witch, ends up with Sabrina's primary romantic interest is Sabrina's witch boyfriend Harvey Kinkle.", "prediction 3": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers. She ends up with her aunts Hilda and Zelda Spellman, and their magical talking cat, Salem, played by Nick Bakay.", "prediction 4": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. In the comic series, Sabrina's mother is an ordinary human, or \"mortal\" as witches refer to them, while her father is a witch. The American sitcom Sabrina the Teenage Witch stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 414 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Sabrina the Teenage Witch is a comic book series published by Archie Comics about the adventures of a fictional American teenager named Sabrina Spellman. Sabrina's primary romantic interest is her mortal boyfriend Harvey Kinkle who, like nearly all the other mortals in Sabrina's world, is unaware his girlfriend is a witch. Sabrina the Teenage Witch is an American television sitcom created by Nell Scovell, based on the Archie Comics series of the same name. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "What is the largest populated city in the us?", "passages": [ [ "New York City", "New York City\n\nThe City of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States.", "With an estimated 2017 population of 8,622,698 distributed over a land area of about , New York City is also the most densely populated major city in the United States.", "Located at the southern tip of the state of New York, the city is the center of the New York metropolitan area, the largest metropolitan area in the world by urban landmass and one of the world's most populous megacities, with an estimated 20,320,876 people in its 2017 Metropolitan Statistical Area and 23,876,155 residents in its Combined Statistical Area.", "A global power city, New York City has been described uniquely as the cultural, financial, and media capital of the world, and exerts a significant impact upon commerce, entertainment, research, technology, education, politics, tourism, art, fashion, and sports.", "The city's fast pace has inspired the term \"New York minute\".", "Home to the headquarters of the United Nations, New York is an important center for international diplomacy.", "Situated on one of the world's largest natural harbors, New York City consists of five boroughs, each of which is a separate county of the State of New York." ] ], "gold": "Based on 2018 estimations, the largest populated city in the US is New York. The 1990, 2000, and 2010 US censuses also show that New York City was the largest city in the country in those years. The city had a 2020 population of 8,804,190.", "prediction 1": "The City of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States. With an estimated population of 8,622,698 distributed over a land area of about, New York City is also the most densely populated major city in the United States.", "prediction 2": "The city of New York, also known as New York City (NYC) or simply New York (NY), is the most populous city in the United States. With an estimated population of 8,622,698 distributed over a land area of about, New York City is also the most densely populated major city in the United States.", "prediction 3": "The city of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States. With an estimated 2017 population of 8,622,698 distributed over a land area of about, New York City is also the most densely populated major city in the United States.", "prediction 4": "The largest populated city in the US is New York City (NYC), also known as New York City or simply New York. It has a population of 8,622,698 people, distributed over a land area of about.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 22, "end": 79 }, { "error type": "Redundant", "explanation": "The City of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States. ", "start": 209, "end": 290 }, { "error type": "Incoherent", "explanation": "", "start": 170, "end": 208 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The City of New York is the most populous city in the United States. As of 2017, the City of New York has an estimated population of 8,622,698. " }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "When is the last time the mariners made the playoffs?", "passages": [ [ "Seattle", "The team began play in 2018 and won the league's inaugural championship.", "Seattle will also host a new XFL franchise that will begin play in 2020 at CenturyLink Field.", "Seattle's professional sports history began at the start of the 20th century with the PCHA's Seattle Metropolitans, which in 1917 became the first American hockey team to win the Stanley Cup.", "Seattle was awarded a Major League Baseball franchise, the Seattle Pilots, in 1969.", "The team played at Sick's Stadium in Mount Baker for one season before relocating to Milwaukee and becoming the Milwaukee Brewers.", "The city, county, and state governments sued the league and was offered a second expansion team, the Seattle Mariners, who began play at the Kingdome in 1977.", "The Mariners struggled in the stadium and moved to a purpose-built baseball stadium, T-Mobile Park (formerly Safeco Field), in 1999.", "The Mariners have never reached a World Series and only appeared in the MLB playoffs four times, all between 1995 and 2001, despite having Hall of Fame players and candidates like Ken Griffey Jr., Randy Johnson, Ichiro, and Alex Rodriguez.", "The team tied the all-time single regular season wins record in 2001 with 116 wins.", "Since 2001, the Mariners have failed to qualify for the playoffs\u2014the longest active postseason drought in North American sports, at 17 seasons." ], [ "Seattle Mariners", "Seattle Mariners\n\nThe Seattle Mariners are an American professional baseball team based in Seattle, Washington.", "The Mariners compete in Major League Baseball (MLB) as a member club of the American League (AL) West Division.", "The team joined the American League as an expansion team in 1977.", "Since July , the Mariners' home ballpark has been T-Mobile Park, located in the SoDo neighborhood of Seattle.", "The \"Mariners\" name originates from the prominence of marine culture in the city of Seattle.", "They are nicknamed the M's, a title featured in their primary logo from 1987 to 1992.", "They adopted their current team colors \u2013 Navy blue, northwest green (teal), and silver \u2013 prior to the 1993 season, after having been royal blue and gold since the team's inception.", "Their mascot is the Mariner Moose.", "The organization did not field a winning team until 1991, and any real success eluded them until when they won their first division championship and defeated the New York Yankees in the ALDS.", "The game-winning hit in Game 5, in which Edgar Mart\u00ednez drove home Ken Griffey Jr. to win the game in the 11th inning, clinched a series win for the Mariners, served as a powerful impetus to preserve baseball in Seattle, and has since become an iconic moment in team history." ] ], "gold": "The Seattle Mariners are an American professional baseball team based in Seattle that competes in Major League Baseball as a member club of the American League West division. After the Mariners won their division and a playoff berth for the first time in 1995, they have enjoyed sporadic success, making the playoffs three more times but never advancing beyond the American League Championship Series. As of 2021, the team has not been to the playoffs since the 2001 MLB season, when they tied an MLB record, winning 116 games. They are in the longest current drought in MLB and all major league North American sports.", "prediction 1": "The Seattle Mariners are an American professional baseball team that compete in Major League Baseball as a member club of the American League West Division. The Mariners have never reached a World Series and only appeared in the MLB playoffs four times, all between 1995 and 2001, despite having Hall of Fame players and candidates like Ken Griffey Jr., Randy Johnson, Ichiro, and Alex Rodriguez. Since 2001, the Mariners have failed to qualify for the playoffs\u2014the longest active postseason drought in North American sports, at 17 seasons.", "prediction 2": "The Seattle Mariners are an American professional baseball team based in Seattle, Washington. They compete in Major League Baseball as a member club of the American League West Division. The team has not made the playoffs since 2001, when they failed to qualify for the playoffs for the 17th consecutive season.", "prediction 3": "The Seattle Mariners are an American professional baseball team based in Seattle, Washington. The Mariners compete in Major League Baseball as a member club of the American League West Division. Since 2001, the Mariners have failed to qualify for the playoffs, the longest active postseason drought in North American sports, at 17 seasons.", "prediction 4": "The Seattle Mariners have never reached a World Series and only appeared in the MLB playoffs four times, all between 1995 and 2001. Since 2001, the Mariners have failed to qualify for the playoffs\u2014the longest active postseason drought in North American sports, at 17 seasons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 396 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Seattle Mariners are an American professional baseball team that compete in Major League Baseball as a member club of the American League West Division. The Mariners have never reached a World Series and only appeared in the MLB playoffs four times, all between 1995 and 2001. The team tied the all-time single regular season wins record in 2001 with 116 wins. Since 2001, the Mariners have failed to qualify for the playoffs\u2014the longest active postseason drought in North American sports, at 17 seasons." }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "When does new season of law and order svu start?", "passages": [ [ "Law & Order: Special Victims Unit (season 17)", "Law & Order: Special Victims Unit (season 17)\n\n", "The seventeenth season of \"\" debuted on Wednesday, September 23, 2015 on NBC, and concluded on Wednesday, May 25, 2016.", "\"Law & Order: Special Victims Unit\" was renewed for a seventeenth season on February 5, 2015, by NBC.", "Mariska Hargitay (Olivia Benson) had her contract renewed for season 17, as well as Ice-T (Det.", "Fin Tutuola).", "It was announced in March 2015 that season seventeen would be show runner/executive producer Warren Leight's last season on the show; he signed a three-year deal with Sony Pictures Television, his contract allowing him to work on \"SVU\" for one final season.", "Production on season seventeen started in late May 2015 on the two-hour season premiere, afterwards the cast and crew took a hiatus and resumed filming on August 21, 2015.", "Executive producer Leight shared via Twitter that star Mariska Hargitay would be directing an episode this season as well, tweeting \"Of course Mariska will direct again this year.", "After 17 seasons, she's in a class of her own.\"", "The episode in question turned out to be \"A Misunderstanding\", which aired on January 20, 2016." ], [ "Law & Order: Special Victims Unit (season 18)", "Law & Order: Special Victims Unit (season 18)\n\n", "The eighteenth season of \"\" debuted on Wednesday, September 21, 2016, on NBC and finished on Wednesday, May 24, 2017, with a two-hour season finale.", "Rick Eid, who previously worked on \"Law & Order\" and \"\", became the executive producer and showrunner, following Warren Leight's departure from the series at the conclusion of the seventeenth season.", "Eid himself departed the series at the end of the eighteenth season and was replaced by Michael S. Chernuchin.", "\"Law & Order: Special Victims Unit\" was renewed for an eighteenth season on February 1, 2016, by NBC.", "It was announced in March 2015 that season seventeen would be show runner/executive producer Warren Leight's last season on the show; he signed a three-year deal with Sony Pictures Television, his contract allowing him to work on \"SVU\" for one final season.", "On March 10, 2016, it was announced that Rick Eid would replace Leight as showrunner on this season.", "The 400th episode of the series aired this season.", "\"Motherly Love,\" directed by Mariska Hargitay, was filmed and billed as the 400th show." ], [ "Law & Order: Special Victims Unit (season 19)", "Law & Order: Special Victims Unit (season 19)\n\n", "The nineteenth season of \"\" premiered on September 27, 2017 and finished on May 23, 2018 with a two-part season finale.", "Michael S. Chernuchin, who had previously worked on \"Law & Order\", \"\", and \"Chicago Justice\" took over from Rick Eid as showrunner.", "This is also the first season since in 2010\u20132011 where another \"Law & Order\" series\u2014\"Law & Order True Crime: The Menendez Murders\"\u2014aired alongside \"SVU\" on NBC.", "\"Law & Order: Special Victims Unit\" was renewed for a 19th season on May 12, 2017.", "Chernuchin took over from Eid as showrunner after Eid left SVU to be showrunner for the fifth season of \"Chicago P.D.\" Production on the season started on July 20, 2017.", "On January 9, 2018, NBC ordered an extra two episodes for Season 19, as confirmed in a tweet by Robert Brooks Cohen, rounding the episode count to 24.", "Chernuchin told \"The Hollywood Reporter\" that this season of \"SVU\" would involve more ripped-from-the-headlines plots focusing on current events such as the Charlottesville riots.", "\"Conflict." ] ], "gold": "Season 17 of American TV show \" Law and Order: Special Victims Unit\" started production in late May 2015 on the two-hour season premiere, afterwards the cast and crew took a hiatus and resumed filming on August 21, 2015. The season started airing on September 23, 2015 on NBC, and finished on May 25, 2016. Season 18 of the show aired from September 21, 2016 to May 24, 2017. Season 19 started production on July 20, 2017 and aired from September 27, 2017 until May 23, 2018.", "prediction 1": "New seasons of Law & Order: Special Victims Unit started in the fall of 2015 and the spring of 2016 respectively. Season 1 of Law & Order: Special Victims Unit started on September 23, 2015 and season 2 of Law & Order: Special Victims Unit started on August 21, 2015. Season 3 of Law & Order: Special Victims Unit started on August 17, 2017 and the spring of 2018 ended on March 9, 2019.", "prediction 2": "Law & Order: Special Victims Unit was renewed for a seventeenth season on February 5, 2015. Season 18 started filming on August 21, 2015. Season 19 started filming on July 20, 2017.", "prediction 3": "Season 1 of Law & Order: Special Victims Unit started on September 13, 2015 and Season 2 started on March 10, 2016. Season 3 of Law & Order: Special Victims Unit started on September 28, 2017, and Season 4 started on September 10, 2017.", "prediction 4": "Season 3 of Law & Order: Special Victims Unit started on September 23, 2015. Season 4 of Law & Order: Special Victims Unit started on September 21, 2017. Season 5 started on October 27, 2018. Season 6 started on October 19, 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 114, "end": 122 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 194, "end": 202 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 275, "end": 276 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 325, "end": 335 }, { "error type": "Unverifiable", "explanation": "", "start": 85, "end": 99 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 373, "end": 387 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "New seasons of Law & Order: Special Victims Unit started in the fall of 2015. Season 17 of Law & Order: Special Victims Unit started on September 23, 2015 and ended on Wednesday, May 25, 2016. Production on season seventeen started in late May 2015 on the two-hour season premiere, afterwards the cast and crew took a hiatus and resumed filming on August 21, 2015. The eighteenth season debuted on Wednesday, September 21, 2016 and finished on Wednesday, May 24, 2017. Season 19 started on on September 27, 2017 and finished on May 23, 2018." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who wrote the letter to jenna in awkward?", "passages": [ [ "Awkward (TV series)", "After losing her virginity to the popular Matty McKibben during summer camp, Jenna Hamilton continues a secret relationship with him that only her two best friends Tamara and Ming know about.", "Upon returning home from camp, Jenna receives a \"care-frontation\" letter from an anonymous source, brutally criticizing her for being a \"loser\".", "When Jenna attempts to get rid of the letter, she falls and breaks her arm, accidentally making it look like a suicide attempt.", "Gossip spreads fast, which makes Jenna receive unwanted attention at school, especially from nosy guidance counselor, Ms. Marks, and mean girl Sadie Saxton.", "Jenna decides to take the advice in the care-frontation letter to become bolder and more outgoing, and her popularity increases as a result.", "Jenna's growing popularity initially creates tension between her and her friends but the three eventually make up.", "Jenna begins to resent being in a secret relationship with Matty.", "Later she finds out that Matty's best friend, Jake Rosati, has been hiding a crush on her.", "Jake breaks up with his beautiful but ditzy girlfriend, Lissa, to ask Jenna to the Winter Formal.", "Jenna ends her relationship with Matty to be with Jake, with her and Matty keeping their former relationship a secret from Jake.", "After several false leads, Jenna finds out who wrote her the confrontation letter\u2014her mother, Lacey." ], [ "Nikki DeLoach", "DeLoach currently plays Lacey Hamilton, the mother of the main character Jenna Hamilton, on MTV's \"Awkward\".", "She played in the French comedy film \"Hollywoo\" with Florence Foresti.", "She occasionally co-hosts on \"The Young Turks\" livestream.", "DeLoach is working on a sociology degree from UCLA through online classes.", "She married Ryan Goodell, who was a member of the boyband Take 5 in September 2009.", "In April 2013, DeLoach announced that she was pregnant.", "Their son William Hudson Goodell was born on October 22, 2013." ] ], "gold": "In the American TV show \" Awkward\" Lacey Hamilton, Jenna's mother, writes the letter to Jenna. The character of Lacey is played by actress Nikki DeLoach.", "prediction 1": "In the MTV series Awkward, Jenna Hamilton receives a confrontation letter from an anonymous source. In the letter, Jenna is criticized for being a loser. Her mother, Lacey Hamilton, writes the confrontation letter.", "prediction 2": "Awkward is a television series that features the fictional character Jenna Hamilton. The main character Jenna Hamilton receives a confrontation letter from her mother. Her mother, Lacey, writes the letter.", "prediction 3": "In the TV show Awkward, Jenna Hamilton receives a confrontation letter from her mother, Lacey. Her mother, who is also the actress who plays Jenna's mother, is an anonymous source who brutally criticizes Jenna for being a loser.", "prediction 4": "In the television series Awkward, Jenna Hamilton gets a confrontation letter about herself from a source anonymous to her mother, named Lacey. After several false leads, Jenna finds out who wrote her the confrontation letter\u2014her mother, Nikki DeLoach.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 153 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the MTV series Awkward, Jenna Hamilton receives a confrontation letter from an anonymous source. Her mother, Lacey Hamilton, writes the confrontation letter. The character of Lacey is played by actress Nikki DeLoach." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the broncos last win the superbowl?", "passages": [ [ "Super Bowl", "Super Bowl\n\nThe Super Bowl is the annual championship game of the National Football League (NFL).", "The game is the culmination of a regular season that begins in the late summer of the previous calendar year.", "Normally, Roman numerals are used to identify each game, rather than the year in which it is held.", "For example, Super Bowl I was played on January 15, 1967, following the 1966 regular season.", "The sole exception to this naming convention tradition occurred with Super Bowl 50, which was played on February 7, 2016, following the 2015 regular season, and the following year, the nomenclature returned to Roman numerals for Super Bowl LI, following the 2016 regular season.", "The most recent Super Bowl was Super Bowl LII, on February 4, 2018, following the 2017 regular season.", "The game was created as a part of a merger agreement between the NFL and its then-rival league, the American Football League (AFL).", "It was agreed that the two leagues' champion teams would play in the AFL\u2013NFL World Championship Game until the merger was to officially begin in 1970.", "After the merger, each league was redesignated as a \"conference\", and the game has since been played between the conference champions to determine the NFL's league champion.", "Currently, the National Football Conference leads the league with 27 wins to 25 wins for the American Football Conference." ], [ "Super Bowl V", "Super Bowl V\n\nSuper Bowl V, the fifth edition of the Super Bowl and first modern-era National Football League (NFL) championship game, was an American football game between the American Football Conference (AFC) champion Baltimore Colts and the National Football Conference (NFC) champion Dallas Cowboys to decide the NFL champion for the 1970 season.", "The Colts defeated the Cowboys by the score of 16\u201313.", "The game was played on January 17, 1971, at the Orange Bowl in Miami, Florida, the first Super Bowl game played on artificial turf, on first-generation Poly-Turf.", "This was the first Super Bowl played after the completion of the AFL\u2013NFL merger.", "Beginning with this game and continuing to the present day, the Super Bowl has served as the NFL's league championship game, with the winner of the AFC Championship Game and the winner of the NFC Championship Game facing off in the culmination of the NFL playoffs.", "As per the merger agreement, all 26 AFL and NFL teams were divided into two conferences with thirteen teams in each.", "Along with the Colts, the Cleveland Browns and Pittsburgh Steelers agreed to join the ten AFL teams to form the AFC; the remaining 13 NFL teams formed the NFC.", "This explains why the Colts represented the NFL in Super Bowl III, but the AFC for Super Bowl V. Baltimore advanced to Super Bowl V after posting an regular season record." ], [ "Denver Broncos", "Denver Broncos\n\nThe Denver Broncos are a professional American football franchise based in Denver, Colorado.", "The Broncos compete as a member club of the National Football League (NFL)'s American Football Conference (AFC)", "West division.", "They began play in 1960 as a charter member of the American Football League (AFL) and joined the NFL as part of the merger in 1970.", "The Broncos are owned by the Pat Bowlen trust and currently play home games at Broncos Stadium at Mile High (formerly known as Invesco Field at Mile High from 2001\u20132010 and Sports Authority Field at Mile High from 2011\u20132017).", "Prior to that, they played at Mile High Stadium from 1960 to 2000.", "The Broncos were barely competitive during their 10-year run in the AFL and their first seven years in the NFL.", "They did not complete a winning season until 1973.", "In 1977, four years later, they qualified for the playoffs for the first time in franchise history and advanced to Super Bowl XII.", "Since 1975, the Broncos have become one of the NFL's most successful teams, having suffered only seven losing seasons.", "They have won eight AFC Championships (, , , , , , , ), and three Super Bowl championships ( (XXXII), (XXXIII), (50)).", "However, the Broncos share the NFL record for most Super Bowl losses (5) with the New England Patriots." ] ], "gold": "The Super Bowl is the annual American football game that determines the champion of the National Football League (NFL). Since January 1971, the winner of the American Football Conference (AFC) Championship Game has faced the winner of the National Football Conference (NFC) Championship Game in the culmination of the NFL playoffs. The Denver Broncos of the AFC have won the Super Bowl on January 25,1998; January 31, 1999; and February 7, 2016.", "prediction 1": "The Super Bowl is the annual championship game of the National Football League. The most recent Broncos victory at the Super Bowl was in February 2018, following the 2017 regular season. Super Bowl VI was played on December 13, 1969, following the 1967 regular season. Super Bowl XVII was won by the Miami Dolphins on December 20, 1969. Super Bowl XXXII was won by the Baltimore Colts on December 5, 1970. The most recent Broncos victory was in Super Bowl LII, on February 4, 2018, following the 2017 regular season. The most recent Super Bowl was Super Bowl LIIIII, on February 4, 2018, following the 2017 regular season.", "prediction 2": "The Super Bowl is the annual championship game of the National Football League (NFL). Normally, Roman numerals are used to identify each game, rather than the year in which it is held. The Broncos last won the Super Bowl in 2017 and the most recent victory was Super Bowl LII in 2018.", "prediction 3": "The Super Bowl is the annual championship game of the National Football League. The most recent Super Bowl was Super Bowl LII, on February 4, 2018, following the 2017 regular season. Super Bowl V, the fifth edition of the Super Bowl and first modern-era National Football League championship game, was between the American Football Conference champion Baltimore Colts and the National Football Conference champion Dallas Cowboys to decide the NFL champion for the 1970 season.", "prediction 4": "The Super Bowl is the annual championship game of the National Football League. The most recent Super Bowl was Super Bowl LII, on February 4, 2018, following the 2017 regular season. The Broncos last won the Super Bowl in 2010.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 134, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 187, "end": 268 }, { "error type": "Irrelevant", "explanation": "", "start": 269, "end": 336 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[11]}", "start": 369, "end": 405 }, { "error type": "Redundant", "explanation": "The Super Bowl is the annual championship game of the National Football League. The most recent Broncos victory at the Super Bowl was in February 2018, following the 2017 regular season. ", "start": 406, "end": 516 }, { "error type": "Redundant", "explanation": "The Super Bowl is the annual championship game of the National Football League. The most recent Broncos victory at the Super Bowl was in February 2018, following the 2017 regular season. Super Bowl VI was played on December 13, 1969, following the 1967 regular season. ", "start": 517, "end": 622 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8, 9 ] } ], "corrected-prediction": "The Super Bowl is the annual championship game of the National Football League. After the merger in 1970 each league was redesignated as a \"conference\", and the game has since been played between the conference champions to determine the NFL's league champion.The most recent Broncos victory at the Super Bowl 50. Super Bowl XXXII was won by the Broncos as well as Superbowl XXXIII." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who were the founding fathers of the declaration of independence?", "passages": [ [ "Founding Fathers of the United States", "Founding Fathers of the United States\n\nThe Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain.", "Most were descendants of colonists settled in the Thirteen Colonies in North America.", "Historian Richard B. Morris in 1973 identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington.", "Adams, Jefferson, and Franklin were members of the Committee of Five that drafted the Declaration of Independence.", "Hamilton, Madison, and Jay were authors of \"The Federalist Papers\", advocating ratification of the Constitution.", "The constitutions drafted by Jay and Adams for their respective states of New York (1777) and Massachusetts (1780) were heavily relied upon when creating language for the US Constitution.", "Jay, Adams and Franklin negotiated the Treaty of Paris (1783) that would end the American Revolutionary War.", "Washington was Commander-in-Chief of the Continental Army and was President of the Constitutional Convention.", "All held additional important roles in the early government of the United States, with Washington, Adams, Jefferson, and Madison serving as President.", "Jay was the nation's first Chief Justice, Hamilton was the first Secretary of the Treasury, and Franklin was America's most senior diplomat, and later the governmental leader of Pennsylvania." ], [ "American nationalism", "American nationalism\n\nAmerican nationalism or United States nationalism is a form of civic nationalism found in the United States.", "Essentially, it indicates the aspects that characterize and distinguish the United States as an autonomous political community.", "The term often serves to explain efforts to reinforce its national identity and self-determination within their national and international affairs.", "American scholars such as Hans Kohn state that the United States government institutionalized a civic nationalism founded upon legal and rational concepts of citizenship, being based on common language and cultural traditions.", "The Founding Fathers of the United States established the country upon classical liberal and individualist principles, although forms of ethnic nationalism were sometimes promoted until the civil rights movement.", "The United States traces its origins to the Thirteen Colonies founded by Britain in the 17th and early 18th century.", "Residents identified with Britain until the mid-18th century when the first sense of being \"American\" emerged.", "The Albany Plan proposed a union between the colonies in 1754.", "Although unsuccessful, it served as a reference for future discussions of independence.", "Soon afterward, the colonies faced several common grievances over acts passed by the British Parliament, including taxation without representation.", "Americans were in general agreement that only their own colonial legislatures\u2014and not Parliament in London\u2014could pass taxes.", "Parliament vigorously insisted otherwise and no compromise was found.", "The London government punished Boston for the Boston Tea Party and the Thirteen Colonies united and formed the Continental Congress, which lasted from 1774 to 1789." ] ], "gold": "The Founding Fathers of the United States, or simply the Founding Fathers or Founders, were a group of American revolutionary leaders who united the Thirteen Colonies, led the war for independence from Great Britain, and built a frame of government for the new United States of America upon classical liberalism and republican principles during the latter decades of the 18th century. Historian Richard B. Morris in 1973 identified the following seven figures as key Founding Fathers: John Adams, Benjamin Franklin, Alexander Hamilton, John Jay, Thomas Jefferson, James Madison, and George Washington based on the critical and substantive roles they played in the formation of our country's new government. Adams, Jefferson, and Franklin were members of the Committee of Five that drafted the Declaration of Independence.", "prediction 1": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris in 1973 identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. The original seven Founding Fathers were John Adams, John Adams, Benjamin Franklin, Benjamin Franklin, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and Washington.", "prediction 2": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris in 1973 identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. Adams, Jefferson, and Franklin were members of the Committee of Five that drafted the Declaration of Independence. Hamilton, Madison, and Jay were authors of \"The Federalist Papers\", advocating ratification of the Constitution. Adams, Jefferson, Jefferson, Jefferson, Jefferson, Jefferson, Jefferson, Thomas Jefferson, Jefferson, Jefferson, Jefferson, Jefferson, Jefferson, James Madison, and Madison, James Madison, and Washington were Commander-in-Chief of the Continental Army and President of the Constitutional Convention.", "prediction 3": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. The Committee of Five that drafted the Declaration of Independence was led by Jefferson, Adams, and Franklin.", "prediction 4": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. Hamilton, Jefferson, and Franklin were members of the Committee of Five that drafted the Declaration of Independence. Jay, Adams and Franklin negotiated the Treaty of Paris (1783) that would end the American Revolutionary War. Thomas Jefferson and Madison were also members of the Committee of Five that drafted the Declaration of Independence.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris in 1973 identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. ", "start": 388, "end": 568 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Founding Fathers of the United States were a group of philosophers, politicians, and writers who led the American Revolution against the Kingdom of Great Britain. Historian Richard B. Morris in 1973 identified the following seven figures as the key Founding Fathers: Alexander Hamilton, John Adams, Benjamin Franklin, John Jay, Thomas Jefferson, James Madison, and George Washington. Adams, Jefferson, and Franklin were members of the Committee of Five that drafted the Declaration of Independence." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Why is there a moon on the outhouse door?", "passages": [ [ "Outhouse", "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact.", "There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace (the sun and moon being popular symbols for the sexes during those times).", "Others dismiss the claim as an urban legend.", "What is certain is that the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed.", "The shelter may cover very different sorts of toilets.", "An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground.", "When properly built and maintained they can decrease the spread of disease by reducing the amount of human feces in the environment from open defecation.", "When the pit fills to the top, it should be either emptied or a new pit constructed and the shelter moved or re-built at the new location.", "The management of the fecal sludge removed from the pit is complicated.", "There are both environment and health risks if not done properly.", "As of 2013 pit latrines are used by an estimated 1.77 billion people.", "This is mostly in the developing world as well as in rural and wilderness areas." ] ], "gold": "The reason there is a moon on the outhouse door is to provide venting and light. There is also an urban legend that the moon and sun on the doors of outhouses was for \"mens\"/\"ladies\" designation for the illiterate populace, as they were popular symbols for the sexes at that time.", "prediction 1": "There are several reasons for the crescent moon on the outhouse door. The purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed. An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground. When properly built and maintained they can decrease the spread of disease by reducing the amount of human feces in the environment from open defecation.\n", "prediction 2": "There are authors who claim the practice began during the colonial period as an early \"men's\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. What is certain is that the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed. An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground. An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground.", "prediction 3": "There is a crescent moon on the outhouse door, which was popularized by cartoonists and had a questionable basis in fact. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populate. Others dismiss the claim as an urban legend. What is certain is that the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed. An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground.", "prediction 4": "An outhouse provides the shelter for a pit latrine, which collects human feces in a hole in the ground and is typically decorated with a crescent moon. It was popularized by cartoonists in 1877, but historians believe that the moon was placed there as a symbol of wealth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 293 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 448 }, { "error type": "Unverifiable", "explanation": "", "start": 10, "end": 17 }, { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 93 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The reason there is a moon on the outhouse door is to provide venting and light. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace (the sun and moon being popular symbols for the sexes during those times).\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did sports authority go out of business?", "passages": [ [ "Sports Authority", "Sports Authority\n\nSports Authority, Inc. (formerly The Sports Authority) was a sports retailer in the United States that was headquartered in Englewood, Colorado.", "At its peak, Sports Authority operated more than 460 stores in 45 U.S. states, Canada and Puerto Rico.", "The company's website was on the GSI Commerce platform and supported the retail stores as well as other multi-channel programs.", "A joint venture with \u00c6ON Co., Ltd., operates \"Sports Authority\" stores in Japan over a licensing agreement.", "On March 2, 2016, Sports Authority filed for Chapter 11 Bankruptcy, but the case was converted to Chapter 7 a few months later.", "On May 18, 2016, the company's stores were sold to a group of liquidators and on May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016.", "On June 30, 2016, Dick's Sporting Goods won the auction for Sports Authority's brand name and intellectual property.", "On July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "On July 21, 2016, the purchase of Sports Authority's intellectual property by rival Dick's Sporting Goods was approved.", "Gart Sports began in 1928, when Denver Post newspaper carrier Nathan Gart started the company with $50 in fishing rod samples." ] ], "gold": "Sports Authority, Inc. was an American sports retailer that was headquartered in Englewood, Colorado, and at its peak, Sports Authority operated more than 460 stores in 45 States and Puerto Rico. On March 2, 2016, Sports Authority filed for Chapter 11 bankruptcy and the case was converted to Chapter 7 a few months later. On May 18, 2016, the company's stores were sold to a group of liquidators and on May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016. On June 30, 2016, Dick's Sporting Goods won the auction for Sports Authority's brand name and intellectual property, and on July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "prediction 1": "Sports Authority, Inc. (formerly The Sports Authority) was a sports retailer in the United States that was based in Englewood, Colorado. Sports Authority operated more than 460 stores in 45 U.S. states, Canada and Puerto Rico. On July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "prediction 2": "Sports Authority, Inc. was a sports retailer in the United States that was headquartered in Englewood, Colorado. At its peak, Sports Authority operated more than 460 stores in 45 U.S. states, Canada and Puerto Rico. On May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016. On July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "prediction 3": "Sports Authority, Inc., formerly The Sports Authority, was a sports retailer in the United States that was headquartered in Englewood, Colorado. On March 2, 2016, Sports Authority filed for Chapter 11 Bankruptcy, but the case was converted to Chapter 7 a few months later. On May 18, 2016, the company's stores were sold to a group of liquidators and on May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016. On July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "prediction 4": "Sports Authority was a sports retailer in the United States that was headquartered in Englewood, Colorado. On March 2, 2016, Sports Authority filed for Chapter 11 Bankruptcy, but the case was converted to Chapter 7 a few months later. On May 18, 2016, the company's stores were sold to a group of liquidators and on May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016. On July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Sports Authority, Inc. was an American sports retailer that was headquartered in Englewood, Colorado, and at its peak, Sports Authority operated more than 460 stores in 45 States and Puerto Rico. On March 2, 2016, Sports Authority filed for Chapter 11 bankruptcy and the case was converted to Chapter 7 a few months later. On May 18, 2016, the company's stores were sold to a group of liquidators and on May 25, CEO Michael Foss announced that all of the stores would close by the end of August 2016. On June 30, 2016, Dick's Sporting Goods won the auction for Sports Authority's brand name and intellectual property, and on July 15, 2016, the online store closed operations, redirecting users to the Dick's Sporting Goods website." }, "preference": [ 0, 2, 2, 2, 2, 0 ] }, { "question": "When is the last time the usa missed the world cup?", "passages": [ [ "United States at the FIFA World Cup", "United States at the FIFA World Cup\n\nThe United States men's national soccer team has played in several World Cup finals, with their best result occurring during their first appearance at the 1930 World Cup, when the United States finished in third place.", "After the 1950 World Cup, in which the United States upset England in group play 1\u20130, the U.S. was absent from the finals until 1990.", "The United States has participated in every World Cup since 1990 until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017.", "The World Cup is an international football competition contested by the men's national teams of the members of \"F\u00e9d\u00e9ration Internationale de Football Association\" (FIFA), the sport's global governing body.", "The championship has been awarded every four years since the first tournament in 1930, except in 1942 and 1946, due to World War II.", "The current format of the World Cup involves 32 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup finals is the most widely viewed sporting event in the world, with an estimated 715 million people watching the 2006 tournament final." ], [ "Germany women's national football team", "The third place match saw the Germans lose their first ever match to England after 21 contests, due to a penalty kick by Fara Williams during extra time.", "Germany is one of the most successful nations at the FIFA Women's World Cup, having won the tournament twice and finishing runner-up once.", "The German team won the World Cup in 2003 and 2007.", "At the first World Cup in 1991, they finished in fourth place.", "In 1995, Germany reached the World Cup final, but were defeated by Norway.", "The team's worst results were quarter-final losses to the United States in 1999, and Japan in 2011.", "Overall, the German team has appeared in three Women's World Cup finals, and is a five-time semi-finalist.", "They have participated in every Women's World Cup and have a 26\u20135\u20138 win\u2013draw\u2013loss record.", "Women's football debuted at the 1996 Summer Olympics and Bettina Wiegmann scored the first Olympic goal in the opening game of the tournament.", "However, Germany failed to progress to the knockout stage and was eliminated after Round 1.", "Four years later the German team won the bronze medal at the 2000 Summer Olympics.", "They again finished third at both the 2004 and the 2008 Summer Olympics.", "The German team has qualified for all Women's Olympic Football Tournaments until 2008." ] ], "gold": "The United States men's national soccer team have participated in ten World Cups: their best result occurred during their first appearance at the 1930 World Cup when they finished in third place. The United States has participated in every World Cup since 1990 until 2014, but they did not qualify for the 2018 competition for the first time since 1986 after a loss to Trinidad and Tobago. The United States women's national soccer team is the most successful women's national team in the history of the Women's World Cup, having won four titles, earning second-place once and third-place finishes three times. The United States are also the only team that has played the maximum number of matches possible in every tournament and have never missed a World Cup.", "prediction 1": "The FIFA World Cup is an international football competition contested by the men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association (FIFA), the sport's global governing body. The United States has participated in every World Cup since 1990 until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017. The women's team of Germany has participated in three Women's World Cup finals, including the 2002 Women's World Cup, the 2006 Women's World Cup, and the last time they missed the Women's World Cup was in 2018.", "prediction 2": "The FIFA World Cup is an international football competition contested by the men's national teams of the members of the F\u00e9d\u00e9ration Internationale de Football Association, the sport's global governing body. The last time the USA missed the World Cup was in 1990. The United States has participated in every World Cup since 1990 until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017.", "prediction 3": "The World Cup is an international football competition contested by the national teams of the members of the \"F\u00e9d\u00e9ration Internationale de Football Association\", the sport's global governing body. The United States has participated in every World Cup since 1990, until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017. The United States has made one appearance at the FIFA Women's World Cup, in which they lost to Chile in the semi-finals of the 2006 competition. The last time the United States missed the finals was in 1990, in which they finished in third place. The last time they were absent from the finals was 1950, in which they upset England in the finals was the 1950 World Cup.", "prediction 4": "The FIFA World Cup is an international football competition contested by the men's national teams of the members of the FIFA, the sport's global governing body. The United States has participated in every World Cup since 1990 until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 377, "end": 587 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States men's national soccer team has played in several World Cup finals, with their best result occurring during their first appearance at the 1930 World Cup, when the United States finished in third place. The United States has participated in every World Cup since 1990 until they failed to qualify for the 2018 competition after a loss to Trinidad and Tobago in 2017." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "Who plays the mom in american horror story season 1?", "passages": [ [ "American Horror Story: Murder House", "American Horror Story: Murder House\n\nAmerican Horror Story: Murder House (originally titled as American Horror Story) is the first season of the FX television series \"American Horror Story\".", "It aired between October 5, and December 21, 2011.", "The season was produced by 20th Century Fox Television, and the executive producers were Dante Di Loreto and series creators Brad Falchuk and Ryan Murphy.", "It centers on the Harmon family: , and their daughter , who move from Boston to Los Angeles after Vivien has a miscarriage and Ben has an affair.", "They move into a restored mansion, unaware that the house is haunted by the ghosts of its former residents and their victims.", "The first season of \"American Horror Story\" received generally positive reviews from critics.", "The series drew consistently high ratings for the FX network, ending its first season as the biggest new cable series of the year.", "The season was nominated for various industry awards, including the Golden Globe Award for Best Television Series \u2013 Drama, and received a total of seventeen Emmy Award nominations.", "In addition, Lange won the Golden Globe for Best Supporting Actress, the Screen Actors Guild Award for Outstanding Performance by a Female Actor in a Drama Series, and the Primetime Emmy Award for Outstanding Supporting Actress in a Miniseries or a Movie." ], [ "American Horror Story", "Although reception to individual seasons has varied, \"American Horror Story\" largely has been well received by television critics, with the majority of the praise going towards the cast, particularly Jessica Lange, who won two Emmy Awards, a Golden Globe Award, and a Screen Actors Guild Award for her performances.", "Kathy Bates and James Cromwell each won an Emmy Award for their performances, while Lady Gaga won a Golden Globe Award.", "The series draws consistently high ratings for the FX network, with its first season being the most-viewed new cable series of 2011.", "Set in the year 2011, the season follows the Harmons, consisting of wife and mother Vivien (Connie Britton), her psychiatrist husband Ben (Dylan McDermott), and their teenage daughter Violet (Taissa Farmiga), as they move from Boston to Los Angeles to make a fresh start after Vivien's miscarriage led to Ben having an affair with one of his students, which almost tore their family apart.", "They move into a restored mansion and soon encounter the residence's housekeeper, Moira O'Hara (Frances Conroy and Alexandra Breckenridge), as well as their neighbors \u2013 the eccentric Langdon family consisting of Constance (Jessica Lange) and her daughter Adelaide (Jamie Brewer)." ], [ "American Horror Story: Apocalypse", "People inside include hairdresser Mr. Gallant (Evan Peters), his grandmother Evie (Joan Collins), talk show host Dinah Stevens (Adina Porter), her son Andre (Jeffrey Bowyer-Chapman), the billionaire Coco St. Pierre Vanderbilt (Leslie Grossman), her assistant Mallory (Billie Lourd), and couple Timothy Campbell (Kyle Allen) and Emily (Ash Santos), all of whom face the wrath of the two women.", "However, Michael Langdon (Cody Fern), the Antichrist, arrives and begins to throw the order into chaos as he intends to bring those worthy to a \"sanctuary\".", "Later in the season, the arrival of Cordelia Goode (Paulson), Madison Montgomery (Emma Roberts), Myrtle Snow (Frances Conroy) as well as the return of Zoe Benson (Taissa Farmiga), Queenie (Gabourey Sidibe) and Misty Day (Lily Rabe), provides background of the world before the fateful apocalypse as well as the inclusion of characters from \"Murder House\", such as Michael's grandmother, Constance Langdon (Jessica Lange).", "\n\nOn January 12, 2017, the series was renewed for an eighth season, which premiered on September 12, 2018." ] ], "gold": "American Horror Story: Murder House, originally titled American Horror Story, is the first season of the FX horror anthology television series American Horror Story. Connie Britton portrays Violet's mom, Jessica Lange portrays Tate's mom, Rebecca Wisocky portrays Margaret and Angie's mom, Lily Rabe portrays Thaddeus Montgomery's mom, and Lisa Vidal portrays Gabe's mom.", "prediction 1": "American Horror Story: Murder House is the first season of the FX television series American Horror Story which follows the Harmon family, consisting of wife and mother Vivien (Connie Britton), her psychiatrist husband Ben (Dylan McDermott), and their teenage daughter Violet (Taissa Farmiga) as they move from Boston to Los Angeles to make a fresh start after Vivien has a miscarriage led to Ben having an affair. The season follows the family as they move into a restored mansion, unaware that the house is haunted by the ghosts of its former residents and their victims.", "prediction 2": "American Horror Story: Murder House is the first season of the FX television series American Horror Story. It centers on the Harmon family of the Harmons, consisting of wife and mother Vivien (Connie Britton), her psychiatrist husband Ben (Dylan McDermott), and their teenage daughter Violet (Taissa Farmiga), who move from Boston to Los Angeles to make a fresh start after Vivien has a miscarriage led to Ben having an affair with one of his students, which almost to tear their family apart.", "prediction 3": "The first season of the FX television series American Horror Story, which is based on the book by the same name, is the first season of the television series. The season follows the Harmon family, consisting of husband and mother Vivien, played by Connie Britton, and their teenage daughter Violet played by Taissa Farmiga. The season is produced by 20th Century Fox Television and was produced by Dante Di Loreto and series creators Brad Falchuk and Ryan Murphy.", "prediction 4": "American Horror Story is an American horror television series that aired between October 5, and December 21, 2011. The first season follows the Harmon family consisting of wife and mother Vivien and their teenage daughter Violet, played by Taissa Farmiga. The season also features a guest appearance by actress Jessica Lange as Constance Langdon, Vivien's grandmother and the mother of Michael Langdon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 414 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 573 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "American Horror Story: Murder House, , originally titled American Horror Story, is the first season of the FX television series American Horror Story which follows the Harmon family, consisting of wife and mother Vivien (Connie Britton), her psychiatrist husband Ben (Dylan McDermott), and their teenage daughter Violet (Taissa Farmiga)." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When was the return of the native written?", "passages": [ [ "The Return of the Native", "The Return of the Native\n\nThe Return of the Native is Thomas Hardy's sixth published novel.", "It first appeared in the magazine \"Belgravia\", a publication known for its sensationalism, and was presented in twelve monthly installments from January to December 1878.", "Because of the novel's controversial themes, Hardy had some difficulty finding a publisher; reviews, however, though somewhat mixed, were generally positive.", "In the twentieth century, \"The Return of the Native\" became one of Hardy's most popular and highly regarded novels.", "The novel takes place entirely in the environs of Egdon Heath, and, with the exception of the epilogue, \"Aftercourses\", covers exactly a year and a day.", "The narrative begins on the evening of Guy Fawkes Night as Diggory Venn is slowly crossing the heath with his van, which is being drawn by ponies.", "In his van is a passenger.", "When darkness falls, the country folk light bonfires on the surrounding hills, emphasising\u2014not for the last time\u2014the pagan spirit of the heath and its denizens.", "Venn is a reddleman; he travels the country supplying farmers with a red mineral called reddle (dialect term for red ochre) that farmers use to mark their sheep." ] ], "gold": "The Return of the Native, by Thomas Hardy first appeared in the magazine Belgravia in twelve monthly installments from January to December 1878.", "prediction 1": "The Return of the Native is Thomas Hardy's sixth published novel. It first appeared in the magazine Belgravia, a publication known for its sensationalism, and was presented in twelve monthly installments from January to December 1878.", "prediction 2": "The Return of the Native is Thomas Hardy's sixth published novel. It first appeared in the magazine Belgravia, a publication known for its sensationalism, and was presented in twelve monthly installments from January to December 1878. Because of the novel's controversial themes, Hardy had some difficulty finding a publisher; reviews, however, though somewhat mixed, were generally positive. In the twentieth century, \"The Return of the Native\" became one of Hardy's most popular and highly regarded novels. It is set in the environs of Egdon Heath, and, with the exception of the epilogue, \"Aftercourses\", covers exactly a year and a day, with the exception of the epilogue, \"Aftercourses\".", "prediction 3": "The Return of the Native is Thomas Hardy's sixth published novel. It first appeared in the magazine Belgravia, known for its sensationalism, and was presented in twelve monthly installments from January to December 1878.", "prediction 4": "The Return of the Native is Thomas Hardy's sixth published novel. It first appeared in the magazine Belgravia, a publication known for its sensationalism, and was presented in twelve monthly installments from January to December 1878. Because of the novel's controversial themes, Hardy had some difficulty finding a publisher; reviews, however, though somewhat mixed, were generally positive. In the twentieth century, The Return of the Native became one of Hardy's most popular and highly regarded novels.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 154 } ], "missing-info": [], "corrected-prediction": "The Return of the Native is Thomas Hardy's sixth published novel. It first appeared in the magazine Belgravia and was presented in twelve monthly installments from January to December 1878." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "How many types of skin color are there?", "passages": [ [ "Von Luschan's chromatic scale", "Von Luschan's chromatic scale\n\nVon Luschan's chromatic scale (VLS) is a method of classifying skin color.", "It is also called the von Luschan scale or von Luschan's scale.", "It is named after its inventor, Felix von Luschan.", "The equipment consists of 36 opaque glass tiles which were compared to the subject's skin, ideally in a place which would not be exposed to the sun (such as under the arm).", "The von Luschan scale was used to establish racial classifications of populations according to skin color; in this respect it is in contrast to the Fitzpatrick scale intended for the classification of the skin type of individuals introduced in 1975 by Harvard dermatologist Thomas B. Fitzpatrick to describe sun tanning behavior.", "The von Luschan scale was used extensively throughout the first half of the 20th century in race studies and anthropometry.", "However, the results were inconsistent: in many instances, different investigators would give different readings of the same person.", "The von Luschan scale was largely abandoned by the early 1950s, replaced with methods utilizing reflectance spectrophotometry.", "The following table shows the 36 categories of the von Luschan scale in relation to the six categories of the Fitzpatrick scale:" ], [ "Fitzpatrick scale", "Fitzpatrick scale\n\nThe Fitzpatrick scale (also Fitzpatrick skin typing test; or Fitzpatrick phototyping scale) is a numerical classification schema for human skin color.", "It was developed in 1975 by Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to ultraviolet (UV) light.", "It was initially developed on the basis of skin and eye color, but when this proved misleading, it was altered to be based on the patient's reports of how their skin responds to the sun; it was also extended to a wider range of skin types.", "The Fitzpatrick scale remains a recognized tool for dermatological research into human skin pigmentation.", "The following list shows the six categories of the Fitzpatrick scale in relation to the 36 categories of the older von Luschan scale:\n\n\n", "The Fitzpatrick scale is also the basis of skin color in emoji, with 5 modifiers according to the Fitzpatrick scale, with types and merged.", "The following table shows both the Unicode characters and the open-source \"Twemoji\", designed by Twitter:" ], [ "Human skin color", "For practical purposes, such as exposure time for sun tanning, six skin types are distinguished following Fitzpatrick (1975), listed in order of decreasing lightness:\n\nThe following list shows the six categories of the Fitzpatrick scale in relation to the 36 categories of the older von Luschan scale:\nDark skin with large concentrations of melanin protects against ultraviolet light and skin cancers; light-skinned people have about a tenfold greater risk of dying from skin cancer, compared with dark-skinned persons, under equal sunlight exposure.", "Furthermore, UV-A rays from sunlight are believed to interact with folic acid in ways that may damage health.", "In a number of traditional societies the sun was avoided as much as possible, especially around noon when the ultraviolet radiation in sunlight is at its most intense.", "Midday was a time when people stayed in the shade and had the main meal followed by a nap, a practice similar to the modern siesta.", "Approximately 10% of the variance in skin color occurs within regions, and approximately 90% occurs between regions.", "Because skin color has been under strong selective pressure, similar skin colors can result from convergent adaptation rather than from genetic relatedness; populations with similar pigmentation may be genetically no more similar than other widely separated groups.", "Furthermore, in some parts of the world where people from different regions have mixed extensively, the connection between skin color and ancestry has substantially weakened." ] ], "gold": "American dermatologist Thomas B. Fitzpatrick developed the Fitzpatrick scale as a way to estimate the response of different types of skin to ultraviolet (UV) light. It consists of six categories. While the Fitzpatrick scale is used to \u00a0describe\u00a0sun tanning\u00a0behavior, the von Luschan scale was used to establish racial classifications. It contained 36 categories.", "prediction 1": "There are several different scales of skin color, each based on different characteristics. Von Luschan's chromatic scale is a method of classifying skin color, also called the von Luschan scale or von Luschan's scale. It is named after its inventor, Felix von Luschan. The Fitzpatrick scale is a numerical classification schema for human skin color, developed in 1975 by Harvard dermatologist Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to ultraviolet (UV) light.", "prediction 2": "There are 6 different types of human skin color. Von Luschan's chromatic scale, also called von Luschan's scale, is a method of classifying skin color. The Fitzpatrick scale, a numerical classification schema for human skin color, was developed in 1975 by Harvard dermatologist Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to UV light.", "prediction 3": "There are six types of skin color. Von Luschan's chromatic scale is a method of classifying skin color. The Fitzpatrick scale is a numerical classification schema for human skin color. It was developed in 1975 by Harvard dermatologist Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to ultraviolet (UV) light.", "prediction 4": "There are 36 types of skin color, which is known as the von Luschan scale or von Luschan's scale. The Fitzpatrick scale is a numerical classification schema for human skin color, developed in 1975 by Harvard dermatologist Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to ultraviolet (UV) light. For practical purposes, such as exposure time for sun tanning, six skin types are distinguished following Fitzpatrick (1975), listed in order of decreasing lightness.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 217 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 268 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "There are several different scales of skin color, each based on different characteristics. Von Luschan's chromatic scale is a method of classifying skin color used to establish racial classifications and has 36 categories. The Fitzpatrick scale is a numerical classification schema for human skin color, developed in 1975 by Harvard dermatologist Thomas B. Fitzpatrick as a way to estimate the response of different types of skin to ultraviolet (UV) light. It consists of six categories, used to describe sun tanning behavior." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Which is first hannibal and silence of the lambs?", "passages": [ [ "Hannibal Lecter (franchise)", "Hannibal Lecter (franchise)\n\nThe \"Hannibal Lecter\" franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels (starting with \"Red Dragon\" in 1981) by Thomas Harris.", "The series has since expanded into film and television.", "The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann.", "The next adaptation was 1991's \"The Silence of the Lambs\", which was directed by Jonathan Demme and was the first film to feature Anthony Hopkins in the role of Hannibal Lecter.", "\"Silence\" was a success, both critically and financially, and went on to become the third film in Academy Awards history to win in all top five categories (Best Actor for Hopkins, Best Actress for Jodie Foster, Best Director for Demme, Best Adapted Screenplay for Ted Tally, and Best Picture).", "Hopkins reprised the role in the next two films, 2001's \"Hannibal\", a sequel directed by Ridley Scott, and 2002's \"Red Dragon\", a prequel directed by Brett Ratner.", "In 2002, Hopkins revealed that he had written a screenplay for another sequel, ending with Clarice killing Lecter but it was not produced.", "In 2007, \"Hannibal Rising\" was released." ] ], "gold": "The Hannibal Lecter franchise is an American media franchise based around the titular character, Hannibal Lecter, a brilliant, cannibalistic serial killer whose assistance is routinely sought out by law enforcement personnel to aid in the capture of other criminals. He originally appeared in a series of novels by Thomas Harris. In both the novel and film series The Silence of the Lambs is before Hannibal. There is a prequel entitled Red Dragon before The Silence of the Lambs.", "prediction 1": "Hannibal Lecter is a fictional character who appears in a series of novels. The franchise has expanded into film and television, with the first two adaptations being 1986's Manhunter and 1991's The Silence of the Lambs, both directed by Jonathan Demme. Anthony Hopkins reprised the role in the next two films - 2001's Hannibal, a sequel directed by Ridley Scott, and 2002's Red Dragon, a prequel directed by Brett Ratner.", "prediction 2": "Hannibal Lecter is a fictional character that originally appeared in a series of novels beginning with Red Dragon in 1981. The first adaptation was the 1986 film, Manhunter, which was an adaptation of Red Dragon, directed by Michael Mann. The next adaptation was 1991's The Silence of the Lambs, which was directed by Jonathan Demme and was the first film to feature Anthony Hopkins in the role of Hannibal Lecter. Hopkins reprised the role in the next two films, 2001's Hannibal, a sequel directed by Ridley Scott, and 2002's Red Dragon, a prequel directed by Brett Ratner.", "prediction 3": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels starting with Red Dragon in 1981 by Thomas Harris. The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann. The next adaptation was 1991's \"The Silence of the Lambs\", which was directed by Jonathan Demme and was the first film to feature Anthony Hopkins in the role of Hannibal Lecter.", "prediction 4": "The \"Hannibal Lecter\" franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels. The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann. The next adaptation was 1991's \"The Silence of the Lambs\", which was directed by Jonathan Demme and was the first film to feature Anthony Hopkins in the role of Hannibal Lecter.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 337, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 396, "end": 421 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Hannibal Lecter franchise is an American media franchise based around the titular character, Hannibal Lecter, who originally appeared in a series of novels by Thomas Harris. The Silence of the Lambs in 1991 adaptation is before Hannibal sequel in 2001. There is a prequel entitled Red Dragon made in 2002. " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where was the first shot of civil war fired?", "passages": [ [ "Battle of Fort Sumter", "Following the surrender, Northerners rallied behind Lincoln's call for all states to send troops to recapture the forts and preserve the Union.", "With the scale of the rebellion apparently small so far, Lincoln called for 75,000 volunteers for 90 days.", "Some Northern states filled their quotas quickly.", "There were so many volunteers in Ohio that within 16 days they could have met the full call for 75,000 men by themselves.", "Other governors from border states were undiplomatic in their responses.", "For example, Gov. Claiborne Jackson wrote, \"Not one man will the state of Missouri furnish to carry on any such unholy crusade\", and Gov. Beriah Magoffin wrote, \"Kentucky will furnish no troops for the wicked purpose of subduing her sister Southern states.\"", "The governors of other states still in the Union were equally unsupportive.", "The call for 75,000 troops triggered four additional slave states to declare their secession from the Union and join the Confederacy.", "The ensuing war lasted four years, effectively ending in April 1865 with the surrender of General Robert E. Lee's Army of Northern Virginia at Appomatox Courthouse.", "Charleston Harbor was completely in Confederate hands for almost the entire four-year duration of the war, leaving a hole in the Union naval blockade." ], [ "Battle of Fort Sumter", "Battle of Fort Sumter\n\nThe Battle of Fort Sumter (April 12\u201313, 1861) was the bombardment of Fort Sumter near Charleston, South Carolina by the Confederate States Army, and the return gunfire and subsequent surrender by the United States Army, that started the American Civil War.", "Following the declaration of secession by South Carolina on December 20, 1860, its authorities demanded that the U.S. Army abandon its facilities in Charleston Harbor.", "On December 26, Major Robert Anderson of the U.S. Army surreptitiously moved his small command from the vulnerable Fort Moultrie on Sullivan's Island to Fort Sumter, a substantial fortress built on an island controlling the entrance of Charleston Harbor.", "An attempt by U.S. President James Buchanan to reinforce and resupply Anderson using the unarmed merchant ship \"Star of the West\" failed when it was fired upon by shore batteries on January 9, 1861.", "South Carolina authorities then seized all Federal property in the Charleston area except for Fort Sumter.", "During the early months of 1861, the situation around Fort Sumter increasingly began to resemble a siege.", "In March, Brigadier General P. G. T. Beauregard, the first general officer of the newly formed Confederate States Army, was placed in command of Confederate forces in Charleston.", "Beauregard energetically directed the strengthening of batteries around Charleston harbor aimed at Fort Sumter." ] ], "gold": "The American Civil War began with the bombardment of Fort Sumter near Charleston, South Carolina by the South Carolina militia and the return gunfire of the United States Army. The US Army eventually surrendered and the militia claimed victory at the battle of Fort Sumter, and the war it started lasted four years.", "prediction 1": "The first shot of Civil War fire was fired in Charleston Harbor while Confederate forces were bombarding Fort Sumter.", "prediction 2": "The Battle of Fort Sumter was the bombardment of Fort Sumter near Charleston, South Carolina by the Confederate States Army, and the return gunfire and subsequent surrender by the United States Army, that started the American Civil War. The first shot of Civil war was fired from Fort Sumter in Charleston Harbor on April 12, 1861.", "prediction 3": "The first shot of the Civil War was fired at Fort Sumter in Charleston Harbor, South Carolina, on April 12, 1861.", "prediction 4": "The first shot of the American Civil War was fired at Fort Sumter, in South Carolina. The Confederate States Army fought back with bombardment of the fort and the return gunfire and subsequent surrender by the United States Army.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first shot of Civil War fire was fired in Charleston Harbor, South Carolina while Confederate forces were bombarding Fort Sumter. The return gunfire and subsequent surrender by the United States Army started the American Civil War." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did the european union start and for what main reason?", "passages": [ [ "History of the European Union", "History of the European Union\n\nThe European Union is a geo-political entity covering a large portion of the European continent.", "It is founded upon numerous treaties and has undergone expansions that have taken it from 6 member states to 28, a majority of the states in Europe.", "Apart from the ideas of federation, confederation, or customs union, the original development of the European Union was based on a supranational foundation that would \"make war unthinkable and materially impossible\" and reinforce democracy amongst its members as laid out by Robert Schuman and other leaders in the Schuman Declaration (1950) and the Europe Declaration (1951).", "This principle was at the heart of the European Coal and Steel Community (ECSC) (1951), the Treaty of Paris (1951), and later the Treaty of Rome (1958) which established the European Economic Community (EEC) and the European Atomic Energy Community (EAEC).", "Both the ECSC and EEC were later incorporated into the European Union while the EAEC maintains a distinct legal identity despite sharing members and institutions.", "The Maastricht Treaty (1992) created the European Union with its pillars system, including foreign and home affairs alongside the European Community.", "This in turn led to the creation of the single European currency, the euro (launched 1999)." ], [ "History of the European Union", "Spain and Portugal joined (having applied in 1977) on 1 January 1986 in the third enlargement.", "Recently appointed Commission President Jacques Delors (Delors Commission) presided over the adoption of the European flag by the Communities in 1986.", "In the first major revision of the treaties since the Merger Treaty, leaders signed the Single European Act in February 1986.", "The text dealt with institutional reform, including extension of community powers \u2013 in particular in regarding foreign policy.", "It was a major component in completing the single market and came into force on 1 July 1987.", "In 1987 Turkey formally applied to join the Community and began the longest application process for any country.", "In Central Europe, after 1988 Polish strikes and Polish Round Table Agreement in 1989, the Berlin Wall fell, along with the Iron Curtain.", "Germany reunified and the door to enlargement to the former Eastern Bloc was opened (See also: Copenhagen Criteria).", "With a wave of new enlargements on the way, the Maastricht Treaty was signed on 7 February 1992 which established the European Union when it came into force the following year.", "On 1 November 1993, under the third Delors Commission, the Maastricht Treaty became effective, creating the European Union with its pillar system, including foreign and home affairs alongside the European Community." ], [ "History of the European Union", "The 1994 European elections were held resulting in the Socialist group maintaining their position as the largest party in Parliament.", "The Council proposed Jacques Santer as Commission President but he was seen as a second choice candidate, undermining his position.", "Parliament narrowly approved Santer but his commission gained greater support, being approved by 416 votes to 103.", "Santer had to use his new powers under Maastricht to flex greater control over his choice of Commissioners.", "They took office on 23 January 1995.", "On 30 March 1994, accession negotiations concluded with Austria, Sweden and Finland.", "Meanwhile, Norway, Iceland and Liechtenstein joined the European Economic Area (which entered into force on 1 January 1994), an organisation that allowed European Free Trade Association states to enter the Single European Market.", "The following year, the Schengen Agreement came into force between seven members, expanding to include nearly all others by the end of 1996.", "The 1990s also saw the further development of the euro.", "1 January 1994 saw the second stage of the Economic and Monetary Union of the European Union begin with the establishment of the European Monetary Institute and at the start of 1999 the euro as a currency was launched and the European Central Bank was established.", "On 1 January 2002, notes and coins were put into circulation, replacing the old currencies entirely." ] ], "gold": "Apart from the ideas of federation, confederation, or customs union such as Winston Churchill's 1946 call for a \"United States of Europe\", the original development of the European Union was based on a supranational foundation that would \"make war unthinkable and materially impossible\" and reinforce democracy amongst its members as laid out by Robert Schuman and other leaders in the Schuman Declaration and the Europe Declaration. The Maastricht Treaty,1992, created the European Union with its pillars system, including foreign and home affairs alongside the European Community. This in turn led to the creation of the single European currency, the euro, launched 1999.", "prediction 1": "The European Union is a geo-political entity covering a large portion of the European continent. It is founded upon numerous treaties and has undergone expansions that have taken it from 6 member states to 28 a majority of the states in Europe. The Maastricht Treaty, which was signed on 7 February 1992, established the European Union with its pillar system, including foreign and home affairs alongside the European Community. This in turn led to the creation of the single European currency, the euro, which came into force in 1999.", "prediction 2": "The European Union started on 7 February 1992, with the first two enlargements taking place on February 7 and February 1, 1992. Then on 1 November 1993, under the third Delors Commission, the Maastricht Treaty became effective, creating the European Union with its pillar system, including foreign and home affairs alongside the European Community. Then on 1 January 1994 saw the second stage of the Economic and Monetary Union of the European Union begin with the establishment of the European Monetary Institute and at the start of 1999 the euro as a currency was launched and the euro as a currency was launched and the euro was launched.", "prediction 3": "The European Union started in 1992 and has had several expansions. The Maastricht Treaty created the European Union with its pillar system, including foreign and home affairs alongside the European Community. The European Monetary Union began on 1 January 1994 and the European Central Bank was established on 1 January 2002.", "prediction 4": "The European Union is a geo-political entity covering a large portion of the European continent. It is founded upon numerous treaties and has undergone expansions that have taken it from 6 member states to 28. The Maastricht Treaty was signed on 7 February 1992 which established the European Union when it came into force the following year. On 1 November 1993, under the third Delors Commission, the Maastricht Treaty became effective, creating the European Union with its pillar system, including foreign and home affairs alongside the European Community. This in turn led to the creation of the single European currency, the euro, the euro, which in 1999.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 96 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Apart from the ideas of federation, confederation, or customs union, the original development of the European Union was based on a supranational foundation that would \"make war unthinkable and materially impossible\" and reinforce democracy amongst its members as laid out by Robert Schuman and other leaders in the Schuman Declaration and the Europe Declaration. The Maastricht Treaty, which was signed on 7 February 1992, established the European Union with its pillar system, including foreign and home affairs alongside the European Community. This in turn led to the creation of the single European currency, the euro, which came into force in 1999." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who won the ncaa mens basketball championship in 2016?", "passages": [ [ "2016 NCAA Division I Men's Basketball Tournament", "2016 NCAA Division I Men's Basketball Tournament\n\nThe 2016 NCAA Division I Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2015\u201316 season.", "The 78th edition of the Tournament began on March 15, 2016, and concluded with the championship game on April 4 at NRG Stadium in Houston, Texas.", "Upsets were the story of the first round of the Tournament; No. 15 seed Middle Tennessee upset No. 2 seed Michigan State in the biggest upset, just the eighth ever win for a No. 15 seed over a No. 2.", "At least one 9, 10, 11, 12, 13, 14, and 15 seed won a first-round game for the third time ever and the first time since 2013.", "Also, every seed except a 16 won at least one game in the First Round.", "In the Final Four, Villanova defeated Oklahoma, while North Carolina defeated Syracuse.", "Villanova then defeated North Carolina to win the championship on a three-point buzzer beater by Kris Jenkins.", "Pundits called the game one of the best in tournament history, going on to say this was one of the most competitive finals ever." ], [ "2016 NCAA Division II Men's Basketball Tournament", "2016 NCAA Division II Men's Basketball Tournament\n\nThe 2016 NCAA Division II Men's Basketball Tournament involved 64 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division II college basketball.", "It began in March 2016, following the 2015\u201316 season, and concluded with the championship game on March 26, 2016.", "The eight regional winners met in the Elite Eight for the quarterfinal, semifinal, and championship rounds.", "For the first time, the final rounds were held at Dr. Pepper Arena in Frisco, Texas.", "Augustana (SD) defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history.", "Lubbock Christian, Saginaw Valley State and St. Thomas Aquinas all made their first Division II tournament appearance.", "All won their first tournament game, and Saginaw Valley advanced to the Elite Eight.", "At the same time, Kentucky Wesleyan made its 38th appearance, Philadelphia its 35th, and Seattle Pacific its 26th, but all lost their opening round game.", "Location: Tex Turner Arena\nLocation: Spragins Hall\nLocation: Alma Grace McDonough Center\nLocation: Campus Center Gymnasium\nLocation: Sanford Pentagon\nLocation: D.L. Ligon Coliseum\nLocation: New P.E." ], [ "Rutgers University\u2013Camden", "As a service to students of the university, the Rutgers\u2013Camden Police Department provides \"a walking security escort for individuals to their vehicles; campus housing; the PATCO Hi-Speed Line station at Fifth and Market St.; and the Walter Rand Transportation Center on Broadway\".", "The campus also runs shuttle buses with stops throughout the campus.", "Known as the Scarlet Raptors, Rutgers\u2013Camden's athletic teams are a member of the National Collegiate Athletic Association (NCAA)\u2014in Division III\u2014and the New Jersey Athletic Conference.", "They compete in 9 men's sports and 10 women's sports:\n\nIn 2006, Rutgers\u2013Camden earned its first NCAA Division III national championship when the softball team defeated top-ranked and two-time defending champion St. Thomas (MN), 3-2.", "Rutgers\u2013Camden set program marks with a 47-5 record and a 29-game winning streak.", "In 2012 and 2013, Rutgers\u2013Camden student-athlete Tim VanLiew won back-to-back NCAA Men's Division III Outdoor Track and Field Championships in the javelin.", "He won his first title on May 26, 2012, with a throw of at Claremont-Mudd-Scripps in Claremont, California.", "Nearly a year to the day of his first title, he not only defended his national javelin title, but he did so in record-breaking fashion." ] ], "gold": "In the 2016 Division 1 NCAA Men's Basketball Championship, the Villanova Wildcats became champions by beating North Carolina in the Championship game. The Augustana Vikings won their first championship in school history when they beat Lincoln Memorial in the final game of the 2016 Division 2 NCAA Men's Basketball Championship. For the 2016 Division 3 NCAA Men's Basketball Championship, the St. Thomas Tommies defeated Benedictine University to win their second Division III national championship. ", "prediction 1": "The men's National Collegiate Athletic Association (NCAA) Division I men's basketball tournament in 2016 involved 68 teams playing in a single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2015\u201316 season. The Division II men's basketball tournament involved 64 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division II college basketball. In 2016, Augustana defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history. In the Final Four, Middle Tennessee defeated Michigan State in the biggest upset, just the eighth ever win for a No. 15 seed. Middle Tennessee in the biggest upset, just the eighth ever win for a No. 15 seed, going on a first-round game in tournament history. In the Final Four, Middle Tennessee defeated Michigan", "prediction 2": "In 2016, the NCAA Men's Basketball Tournament consisted of 68 teams playing in a single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2015\u201316 season. In the 2016 NCAA Division II Men's Basketball Tournament, the 64 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division II college basketball. Augustana (SD) defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history. In the 2016 NCAA Men's NCAA Division III Outdoor Track and Field Championships in the javelin. In 2012 and 2013 Rutgers\u2013Camden student-athlete Tim VanLiew won back-to-back NCAA Men's Division III Outdoor Track and Field Championships in the javelin. In 2012 and 2013, Rutgers\u2013C", "prediction 3": "The 2016 NCAA Division I Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2015\u201316 season. The 2016 NCAA Division II Men's Basketball Tournament involved 64 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division II college basketball. In the first round, Augustana defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history. In the third time ever and the first championship game in the school's history, Augustana defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history. The school's first national championship in the school's history, while Saginaw Valley State, St. Thomas Aquinas advanced to the Elite Eight.", "prediction 4": "The 2016 NCAA Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the men's National Collegiate Athletic Association (NCAA) Division I college basketball national champion for the 2015\u201316 season. Augustana defeated Lincoln Memorial, 90-81, to win the first national championship in the school's history. The NCAA Division II Men's Basketball Tournament involved 64 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division II college basketball.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 494 }, { "error type": "Irrelevant", "explanation": "", "start": 612, "end": 871 }, { "error type": "Redundant", "explanation": "In the Final Four, Middle Tennessee defeated Michigan State in the biggest upset, just the eighth ever win for a No. 15 seed. Middle Tennessee in the biggest upset, just the eighth ever win for a No. 15 seed, going on a first-round game in tournament history. ", "start": 872, "end": 925 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In 2016, Augustana defeated Lincoln Memorial, 90-81, to win the first national NCAA Division II championship in the school's history. Villanova then defeated North Carolina to win the 2016 NCAA Division I championships." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What is the name of the feather duster in beauty and the beast?", "passages": [ [ "Belle (Beauty and the Beast)", "Belle was also the main character in various comic books based on the film, including one set during Belle's stay at the castle published by Marvel Comics, and a prequel set several years before the film distributed by Disney Comics.", "In the former, the storylines generally have the servants trying to coax Belle into doing something with the Beast, only for it to backfire and nearly ruin their friendship before they make up.", "In the latter serial, Belle ends up locked up in a cellar by village children after reluctantly playing pirates with them, and later nearly goes down the path leading to Beast's castle.", "The latter serial also implies that she holds misandric views and refuses to associate herself with the village children, especially the males, due to their not being as well-versed in literature as she.", "Belle and the other characters from the first movie appear in the stage show, Beauty and the Beast Live on Stage at Disney's Hollywood Studios, Walt Disney World.", "Belle appears in a meet-and-greet attraction at Magic Kingdom's Fantasyland called Enchanted Tales with Belle.", "In season 18 of \"Dancing With the Stars\", Danica McKellar played Belle while performing a Quickstep on a Disney themed episode." ], [ "Beauty and the Beast (1991 film)", "Beauty and the Beast (1991 film)\n\nBeauty and the Beast is a 1991 American animated musical romantic fantasy film produced by Walt Disney Feature Animation and released by Walt Disney Pictures.", "The 30th Disney animated feature film and the third released during the Disney Renaissance period, it is based on the French fairy tale of the same name by Jeanne-Marie Leprince de Beaumont who was uncredited in the English version but credited in the French version, and ideas from the 1946 French film of the same name directed by Jean Cocteau.", "\"Beauty and the Beast\" focuses on the relationship between the Beast (voice of Robby Benson), a prince who is magically transformed into a monster and his servants into household objects as punishment for his arrogance, and Belle (voice of Paige O'Hara), a young woman whom he imprisons in his castle to become a prince again.", "To break the curse, Beast must learn to love Belle and earn her love in return before the last petal falls from an enchanted rose or else the Beast will remain a monster forever.", "The film also features the voices of Richard White, Jerry Orbach, David Ogden Stiers, and Angela Lansbury.", "Walt Disney first attempted unsuccessfully to adapt \"Beauty and the Beast\" into an animated film during the 1930s and 1950s." ], [ "Beauty and the Beast (musical)", "Beginning October 2014, Disney Theatrical Productions, NETworks and Broadway Entertainment Group launched an international tour in celebration of \"Beauty and the Beast\"s 20th anniversary on stage.", "The tour opened at the Zorlu Center in Istanbul, Turkey, and closed in January 2016 at Dubai World Trade Centre, having visited Turkey, United Arab Emirates, Greece, Italy, Philippines, Thailand, Singapore, Indonesia, China, Taiwan, Egypt, Lebanon, Romania, and Qatar.", "In December 2015, \"Beauty and the Beast\" came back to the Netherlands for a run at Circustheater in The Hague.", "In 2016, Disney and Marmelade produced an updated version for the Flemish Region of Belgium.", "The original cast included Josje Huisman as Belle, Jan Schepens as Beast, Dieter Troubleyn as Gaston, Peter Van de Velde as Lumi\u00e8re, Frank Hoelen as Maurice, Ivan Pecnik as Cogsworth (called Tickens), Eline De Munck as Babette, Peter Thyssen as LeFou, Barbara Dex as Mrs. Potts and Saskia Sch\u00e4fer as Madame de la Grande Bouche (called La Commodia).", "The show premiered on December 10, 2016, at Flanders Expo in Ghent." ] ], "gold": "In the musical as well as House of Mouse, the feather duster from \"Beauty and the Beast\" is called Babette; in the Disney Comics prequel comic serial \"The New Adventures of Beauty and the Beast\", she is named Marie; and in Belle's Magical World, she is called Fifi. Kimmy Robertson voices the character in both \"Beauty and the Beast\" and \"Belle's Magical World\". In the 2017 live action adaptation of \"Beauty and the Beast\", the feather duster's name is Plumette and she's played by Gugu Mbatha-Raw. ", "prediction 1": "The feather duster in the 1991 film Beauty and the Beast is called a \"feather\" and is a decoration used by Belle. In the 1991 film, the feather duster is called a \"feather-ditch\", also known as a \"feather-duster\" because it is a feather used by Belle in the 1991 film.", "prediction 2": "The character of the feather duster in Beauty and the Beast is Belle. In the 1991 film, Belle is the main character, and the character of the feather duster in the 1991 stage production of the musical Beauty and the Beast is named Belle.", "prediction 3": "Beauty and the Beast is a 1991 American animated film. The original French fairy-tale of the same name was called La Belle. In the 1991 film, the feather duster is called La Belle. In the 1993 musical, the feather duster is called La Belle.", "prediction 4": "Beauty and the Beast is a 1991 American animated musical romantic fantasy film produced by Walt Disney Feature Animation and released by Walt Disney Pictures. It is based on the French fairy tale of the same name by Jeanne-Marie Leprince de Beaumont, who was uncredited in the English version but credited in the French version, and ideas from the 1946 French film of the same name directed by Jean Cocteau. The feather duster in the 1991 film is called the Crown Prince's Crown.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 67, "end": 78 }, { "error type": "Unverifiable", "explanation": "", "start": 83, "end": 113 }, { "error type": "Redundant", "explanation": "The feather duster in the 1991 film Beauty and the Beast is called a \"feather\" and is a decoration used by Belle. ", "start": 114, "end": 131 }, { "error type": "Unverifiable", "explanation": "", "start": 154, "end": 179 }, { "error type": "Unverifiable", "explanation": "", "start": 180, "end": 212 }, { "error type": "Unverifiable", "explanation": "", "start": 237, "end": 250 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who wrote the music and lyrics for oliver?", "passages": [ [ "Oliver!", "Bill Sikes was later portrayed by Steven Hartley and Joe McGann, and Nancy by Sonia Swaby, Claire Moore and Ruthie Henshall.", "The show was a lavish affair and moved from its original intimate melodramatic feel to a more cinematic and symphonic feel that would accommodate an audience familiar with the 1968 motion picture.", "This production featured brand new music and lyrics written by Lionel Bart, and also additional dialogue not featured in the original script, added by Bart and Sam Mendes.", "Other updated elements include the addition of a prologue, in which the audience is witness to Oliver's harrowing birth.", "The dialogue was homage to both the 1948 and 1968 film versions of the story which were in turn based on the original novel.", "New music arrangements and dance sequences were added to various songs, most notably \"Consider Yourself\" and \"Who Will Buy?\".", "Tempos for some of the musical numbers were altered (notably \"It's a Fine Life\", \"I'd Do Anything\" and \"You've Got to Pick a Pocket or Two\"), while other incidental numbers were drastically rewritten, including the London Bridge chase sequence.", "A new intermediate scene was added just after \"You've Got to Pick a Pocket or Two\", in which Bill Sikes enters the Thieves' Kitchen and \"negotiates\" with Fagin." ], [ "Lionel Bart", "Lionel Bart\n\nLionel Bart (1 August 1930 \u2013 3 April 1999) was a writer and composer of British pop music and musicals.", "He wrote Tommy Steele's hit \"Rock with the Caveman\", which became the first British pop song to break into the American Top 40, and was the sole creator of the internationally acclaimed musical \"Oliver!\" (1960).", "With \"Oliver!\"", "and his work alongside revolutionary theatre director Joan Littlewood at Theatre Royal, Stratford East, he played an instrumental role in the 1960s birth of the British musical theatre scene after an era when American musicals had dominated the West End.", "Best known for creating the book, music and lyrics for \"Oliver!", "\", he was described by Andrew Lloyd Webber as \"the father of the modern British musical\".", "In 1963 he won the Tony Award for Best Original Score for \"Oliver!", "\", and the 1968 film version of the musical won a total of 6 Academy Awards including the Academy Award for Best Picture.", "His other notable compositions include the theme song to the James Bond film \"From Russia with Love\", and the hit songs \"Living Doll\" by Cliff Richard, \"Far Away\" by Shirley Bassey, \"Do You Mind?\"" ] ], "gold": "Oliver! is a British coming-of-age stage musical, with book, music and lyrics by Lionel Bart. Lionel Bart was a British writer and composer of pop music and musicals. Best known for creating the book, music and lyrics for Oliver!, Bart was described by Andrew Lloyd Webber as \"the father of the modern British musical\".", "prediction 1": "Lionel Bart wrote the music and lyrics for the musical Oliver!, which was based on the novel by A. B. White. He also wrote additional dialogue not featured in the original script, added by Bart and Sam Mendes. The 1968 film version of the musical won a total of 6 Academy Awards including the Academy Award for Best Picture.\n", "prediction 2": "This production featured brand new music and lyrics written by Lionel Bart, and also additional dialogue not featured in the original script, added by Bart and Sam Mendes. Bart, known to many as the father of the modern British musical, was the sole creator of the internationally acclaimed musical Oliver! (1960).", "prediction 3": "Some sources refer to different composers for the music and lyrics of Oliver. Lionel Bart wrote both the music and lyrics for the original 1960 musical. In the stage adaptation of Oliver!, Nicholas Critchlow wrote the music and lyrics for the 1973 version.", "prediction 4": "Lionel Bart is best known for creating the book, music and lyrics for Oliver! He was described by Andrew Lloyd Webber as the \"father of the modern British musical\". In 1961, Bart won the Tony Award for Best Original Score for Oliver! His 1968 film version of the musical won a total of 6 Academy Awards including the Academy Award for Best Picture. In this revival, Bart wrote original music and lyrics for the new production of Oliver! He also added additional dialogue not featured in the original script, added by Bart and Sam Mendes. There is no longer original dialogue from the novel version of the story, which is witness to Bill Sikes's harrowing birth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 64, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 325 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "Lionel Bart wrote the music and lyrics for the musical Oliver!. Bart was a writer and composer of British pop music and musicals. Best known for creating the book, music and lyrics for \"Oliver!\", he was described by Andrew Lloyd Webber as \"the father of the modern British musical\".\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Shapes with diagonals that are not equal in length?", "passages": [ [ "Quadrilateral", "In two-dimensional Euclidean space, expressing vector AC as a free vector in Cartesian space equal to (x\",\"y\") and BD as (x\",\"y\"), this can be rewritten as:\n\nIn the following table it is listed if the diagonals in some of the most basic quadrilaterals bisect each other, if their diagonals are perpendicular, and if their diagonals have equal length.", "The list applies to the most general cases, and excludes named subsets.", "\"Note 1: The most general trapezoids and isosceles trapezoids do not have perpendicular diagonals, but there are infinite numbers of (non-similar) trapezoids and isosceles trapezoids that do have perpendicular diagonals and are not any other named quadrilateral.\"", "\"Note 2: In a kite, one diagonal bisects the other.", "The most general kite has unequal diagonals, but there is an infinite number of (non-similar) kites in which the diagonals are equal in length (and the kites are not any other named quadrilateral).\"", "The lengths of the diagonals in a convex quadrilateral \"ABCD\" can be calculated using the law of cosines on each triangle formed by one diagonal and two sides of the quadrilateral." ], [ "Rectangle", "Rectangle\n\nIn Euclidean plane geometry, a rectangle is a quadrilateral with four right angles.", "It can also be defined as an equiangular quadrilateral, since equiangular means that all of its angles are equal (360\u00b0/4 = 90\u00b0).", "It can also be defined as a parallelogram containing a right angle.", "A rectangle with four sides of equal length is a square.", "The term oblong is occasionally used to refer to a non-square rectangle.", "A rectangle with vertices \"ABCD\" would be denoted as .", "The word rectangle comes from the Latin \"rectangulus\", which is a combination of \"rectus\" (as an adjective, right, proper) and \"angulus\" (angle).", "A crossed rectangle is a crossed (self-intersecting) quadrilateral which consists of two opposite sides of a rectangle along with the two diagonals.", "It is a special case of an antiparallelogram, and its angles are not right angles.", "Other geometries, such as spherical, elliptic, and hyperbolic, have so-called rectangles with opposite sides equal in length and equal angles that are not right angles.", "Rectangles are involved in many tiling problems, such as tiling the plane by rectangles or tiling a rectangle by polygons." ] ], "gold": "There are several shapes that have diagonal sides that are not equal in length. For instance, a rhomboid is a shape that has diagonal adjacent sides that are unequal in length. Another shape is the oblong, which is rectangular with diagonal adjacent sides that are not equal in length. And, the most general kite shape has diagonals that are not equal in length.", "prediction 1": "In Euclidean plane geometry, a quadrilateral is a quadrilateral with four right angles. In other geometries, such as spherical, elliptic, and hyperbolic, have so-called rectangles with opposite sides equal in length and equal angles that are not right angles.", "prediction 2": "In Euclidean plane geometry, a quadrilateral is a quadrilateral with four right angles and can also be defined as an equiangular quadrilateral, since equiangular means that all of its angles are equal. A rectangle with four sides of equal length is a square. In non-square quadrilaterals, where opposite sides of a quadrilateral are equal in length and the diagonals are perpendicular, there is a single diagonal that bisect the other.", "prediction 3": "The most basic quadrilaterals have diagonals that are not equal in length, they bisect each other, and they are called a kite, trapezoidal, isosceles trapezoidal, or a triangular. Other geometries, such as spherical, elliptic, and hyperbolic, have so-called rectangles with opposite sides equal in length and equal angles that are not right angles.", "prediction 4": "In Euclidean plane geometry, a quadrilateral is a quadrilateral with four right angles. It can also be defined as an equiangular quadrilateral, since equiangular means that all of its angles are equal. A rectangle with four sides of equal length is a square. The lengths of the diagonals in a cross quadrilateral \"ABCD\" can be calculated using the law of cosines on each triangle formed by one diagonal and two sides of the quadrilateral.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 259 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The most general kite has unequal diagonals." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who plays kuze in ghost in the shell?", "passages": [ [ "Ghost in the Shell: Stand Alone Complex", "\"2nd GIG\" was also later aired in the United States on Cartoon Network's Adult Swim block.", "Bandai Visual owns the DVD distribution rights in Japan, while Anchor Bay Entertainment and Manga Entertainment owns the distribution rights in North America and Europe.", "The show began airing daily on AnimeCentral beginning 4 November 2007 in both English (two nightly screenings) and original Japanese (one late-night screening).", "On 18 March 2015 it was announced that \"Stand Alone Complex\" would receive a full weekly rebroadcasting in Japan on BS11, starting on 1 April 2015 onward.", "On April 25, 2017, Starz announced that they would be offering episodes of the series for their Video on Demand service starting May 1, 2017.", "A feature-length OVA titled \"Ghost in the Shell: Stand Alone Complex -", "The Laughing Man\" was released in Japan on 23 September 2005, and in North America on 2 October 2007.", "The OVA retells the first season of the anime television series with minor alterations to the storyline to accommodate an abbreviated take on the Laughing Man affair.", "Some additional animation and voice work was also added.", "Although the Japanese-language version retained the voice cast from the anime series, the English version has a new cast of voice actors.", "The dialogue recording for the English version was produced by Ocean Productions." ] ], "gold": "Kuze is voiced by Rikiya Koyama in Ghost in the Shell: Stand Alone Complex as Japanese, Kirk Thornton in Ghost in the Shell: Stand Alone Complex 2nd GIG as English, Bandai Visual dub, and John Murphy in the Stand Alone Complex OVA Ocean dub as English. He is portrayed by Michael Carmen Pitt in the 2017 Ghost in the Shell film, and young Kuze was portrayed by Andrew Morris in the same film.", "prediction 1": "Ghost in the Shell: Stand Alone Complex is a Japanese anime television series based on the Japanese manga Ghost in the Shell and originally released in Japan in July 2007. Kuze is portrayed by a variety of people. The character of Kouze is first introduced in the Japanese manga Ghost in the Shell: Kuze in 1997. The character was first introduced to the public in the Japanese manga Ghost in the Shell: Kuze in 1998.", "prediction 2": "Ghost in the Shell is an anime television series that began airing daily on AnimeCentral beginning 4 November 2007. Kokusaka Kota played Kuze in the first season of the anime television series. A feature-length OVA titled Ghost in the Shell: Stand Alone Complex - The Laughing Man was released in Japan on 23 September 2005, and in North America on 2 October 2007.", "prediction 3": "Ghost in the Shell is a 2007 Japanese anime television series which originally aired on Anime Central. It was adapted into an American western titled Ghost in the Shell: Stand Alone Complex, which aired on Cartoon Network from October 2007 to May 2018. Kuze is played by Yoko Miyamoto in the Japanese version, with Miyamoto playing kuze in the English version.", "prediction 4": "Ghost in the Shell: Stand Alone Complex is a 2008 anime television series from Bandai Visual that was originally aired in Japan. Anime Central had aired the first two seasons of the series daily, and a special OVA titled Ghost in the Shell: Stand Alone Complex - The Laughing Man was released in Japan on 23 September 2005.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 171 }, { "error type": "Unverifiable", "explanation": "", "start": 214, "end": 314 }, { "error type": "Unverifiable", "explanation": "", "start": 315, "end": 420 }, { "error type": "Unverifiable", "explanation": "", "start": 172, "end": 213 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was the office of refugee resettlement established?", "passages": [ [ "Office of Refugee Resettlement", "This response set a precedent of federal involvement, with Eisenhower and Kennedy expanding efforts to assist nonprofits in settling refugees\u2014efforts which became permanent with the Migration and Refugee Assistance Act of 1962.", "The Office of Refugee Resettlement was officially established with the passage of the Refugee Act of 1980.", "It was created in \"an attempt to design a coherent and comprehensive refugee admission and resettlement policy\".", "The act (a) gave recognition to the Office of the U.S. Coordinator for Refugee Affairs, which was given authority over the development of U.S. \u201crefugee admission and resettlement policy\u201d, and (b) established the Office of Refugee Resettlement (ORR) within the U.S. Department of Health and Human Services, which was given the authority to provide grants with nonprofits for resettlement services (including training and healthcare), and reimbursed states for efforts undertaken within the first three years of a refugee\u2019s living in the United States.", "In its goal of allowing the United States to respond quickly and efficiently to the needs of refugees, the Refugee Act of 1980 also established a new appointed office, the U.S. Coordinator for Refugee Affairs, who is appointed by the President and consults with the ORR." ], [ "Office of Refugee Resettlement", "Office of Refugee Resettlement\n\nThe Office of Refugee Resettlement (ORR) is a program of the Administration for Children and Families, an office within the United States Department of Health and Human Services, created with the passing of the United States Refugee Act of 1980 (Public Law 96-212).", "The ORR offers support for refugees seeking safe haven within the United States, including victims of human trafficking, those seeking asylum from persecution, survivors of torture and war, and unaccompanied alien children.", "The mission and purpose of the ORR is to assist in the relocation process and provide needed services to individuals granted asylum within the United States.", "Since 1975, the United States has assisted in the resettlement of more than 3 million refugees.", "Annual admissions of refugees to the United States since the 1980 Refugee Act was enacted have ranged from 27,100 to as many as 207,116.", "Before World War II, nonprofit voluntary agencies called \"Volags\" were generally responsible for aiding immigrants and refugees.", "In 1946, the U.S. federal government began supporting these organizations financially with the Corporate Affidavit Program.", "However, beginning with an influx of refugees fleeing Castro\u2019s Cuba, the federal government began to take the primary financial role in assisting refugees." ] ], "gold": "The Office of Refugee Resettlement was officially established with the passing of the United States Refugee Act of 1980. The Office of Refugee Resettlement offers support for refugees seeking safe haven within the United States, including victims of human trafficking, those seeking asylum from persecution, survivors of torture and war, and unaccompanied alien children.", "prediction 1": "The Office of Refugee Resettlement was established in 1980 with the passage of the Refugee Act of 1980. It was created in \"an attempt to design a coherent and comprehensive refugee admission and resettlement policy\".", "prediction 2": "The Office of Refugee Resettlement was officially established with the passage of the Refugee Act of 1980. It was created in \"an attempt to design a coherent and comprehensive refugee admission and resettlement policy\". The act (a) gave recognition to the Office of the U.S. Coordinator for Refugee Affairs, which was given authority over the development of U.S. \u201crefugee admission and resettlement policy\u201d, and (b) established the Office of Refugee Resettlement within the U.S. Department of Health and Human Services, which was given the authority to provide grants with nonprofit organizations for resettlement services, and reimburse states for efforts undertaken within the first three years of a refugee\u2019s living in the United States.", "prediction 3": "The Office of Refugee Resettlement is a program of the Administration for Children and Families, part of the United States Department of Health and Human Services, created with the passage of the United States Refugee Act of 1980. The Office, created in \"an attempt to design a coherent and comprehensive refugee admission and resettlement policy\", was created in \"an attempt to design a coherent and comprehensive refugee admission and resettlement policy\".", "prediction 4": "The Office of Refugee Resettlement was established with the passage of the Refugee Act of 1980 in an attempt to design a coherent and comprehensive refugee admission and resettlement policy. The office was created in 1946, and officially established in 1980 with the passage of the Refugee Act of 1980. The mission and purpose of the office is to assist in the relocation process and provide needed services to individuals granted asylum within the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 216 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Office of Refugee Resettlement was established in 1980 with the passage of the Refugee Act of 1980. The ORR offers support for refugees seeking safe haven within the United States, including victims of human trafficking, those seeking asylum from persecution, survivors of torture and war, and unaccompanied alien children." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How long do you have to live in brazil to become a citizen?", "passages": [ [ "Brazilian nationality law", "Brazilian nationality law\n\nBrazilian nationality law is based on both the principles of \"jus soli\" and of \"jus sanguinis\".", "As a general rule, any person born in Brazil acquires Brazilian nationality at birth, irrespective of status of parents.", "Nationality law is regulated by Article 12 of the Brazilian Federal Constitution.", "A person born in Brazil acquires Brazilian nationality at birth.", "The only exception applies to children of persons in the service of a foreign government (such as a foreign diplomats).", "This means that parents and siblings of the Brazilian child are eligible to apply for permanent residency in Brazil, regardless of their nationality or where subsequent siblings were/are born.", "Brazilian law considers as Brazilian citizens people born abroad in two cases:\n\n\nBetween 1994 and 2007, registration with a Brazilian consular office did not confer Brazilian nationality.", "In September 2007, a constitutional amendment reinstituted consular registration as a means of acquiring Brazilian nationality.", "Foreigners may apply for Brazilian nationality if they meet the following criteria:\n\n\nThe residence requirement may be reduced in certain circumstances:\n\n\nThose who have lived in Brazil for more than 15 years and have no criminal conviction do not have to satisfy any other condition for naturalization.", "There are also lower requirements for those who moved to Brazil as minors.", "Since 10 May 2016, Brazil does not require naturalized citizens to renounce their previous nationality." ], [ "Immigration to Brazil", "Those who would benefit from the amnesty, following publication of the law in the Brazilian Official Gazette in July 2009, have up to 180 days after the time of their temporary residence permit (valid for 2 years) to apply.", "They must also aver their clean criminal record or submit a recent, official document of good conduct from the originating country.", "During these two years, they must not exceed 90 consecutive days spent abroad.", "Ninety days prior to the expiration of the temporary residence permit, they must aver their self-sufficiency in Brazil.", "If they can prove they are eligible for a permanent residence permit.", "Only ten years after receiving a permanent residence permit may be eligible for naturalization to be Brazilian.", "Immigration has been a very important demographic factor in the formation, structure and history of the population in Brazil, influencing culture, economy, education, racial issues, etc. Brazil has received the third largest number of immigrants in the Western Hemisphere, after only Argentina, Canada and The United States.", "In the 100 years from 1872\u20131972 at least 5.35 million immigrants came to Brazil, of whom 31% were Portuguese, 30% Italian, 13% Spanish, 5% Japanese, 4% German and 16% of other unspecified nationalities.", "In 1897, S\u00e3o Paulo had twice as many Italians as Brazilians in the city." ], [ "Right of foreigners to vote", "(CN member)", "Commonwealth citizens who are domiciled or have resided in the country for at least one year immediately before polling day are qualified as electors, but not for eligibility to the House of Representatives, which requires Belize citizenship.", "In 1994, the constitution was changed to allow non-citizens to vote in local elections.", "As of 2007, this has not been implemented.", "Article 12.1 of the states that \"\"The rights inherent to Brazilians \"(before 1994 Constitutional amendment, \"born Brazilians\")\" shall be attributed to Portuguese citizens permanently resident in Brazil if Brazilians are afforded reciprocal treatment, except in the events set forth in this Constitution\".", "\", article 14 that \"\"Foreigners cannot register as voters\"\", and \"\"The conditions for eligibility, according to the law, are the following: I. Brazilian nationality\" (...)\".", "A Treaty of friendship, cooperation and consultation between Brazil and Portugal was signed on April 22, 2000 and promulgated in 2001 by Decree nr. 3.927/2001.", "Practically, the Portuguese citizen regularly residing in Brazil and wishing to enjoy the \"Equality Status\" (\"Estatuto de Igualdade\") without losing his original citizenship has to apply to the Ministry of Justice." ] ], "gold": "The length of time a person has to live in Brazil in order to qualify for citizenship varies. Generally, anyone born in Brazil, anyone who has been married to a Brazilian diplomat for more than five years, or has worked for more than 10 years in a Brazilian diplomatic mission, receives citizenship after living in Brazil for 0 years. Barring any circumstances to reduce the residency requirement, a person must reside in Brazil four years to gain citizenship, but only one year if the person has a Brazilian child, or spouse, or is a national of a Portuguese-speaking country. If a person is stateless or has provided relevant services to the country, or has notable professional, scientific, or artistic ability, they must live in Brazil two years before they can become a citizen.", "prediction 1": "The residency requirement for Brazilian citizens is 15 years. The residence requirement for foreigners is longer in some circumstances, for example, if they have lived in Brazil for more than 15 years and have no criminal conviction. There are also lower requirements for those who moved to Brazil as minors.", "prediction 2": "The minimum period of residence for Brazilian citizens is a period of two years, with the maximum period of residence being 10 years. Brazilian law considers as Brazilian citizens people born abroad in two cases: Between 1994 and 2007, registration with a Brazilian consular office did not confer Brazilian nationality. In September 2007, a constitutional amendment reinstituted consular registration as a means of acquiring Brazilian nationality.", "prediction 3": "Brazilian nationality law is based on both the principles of \"jus soli\" and of \"jus sanguinis\". A person born in Brazil acquires Brazilian nationality at birth, irrespective of status of parents. The residence requirement may be reduced in certain circumstances. Those who have lived in Brazil for more than 15 years and have no criminal conviction do not have to satisfy any other condition for naturalization. There are also lower requirements for those who moved to Brazil as minors. Brazilian law considers as Brazilian citizens people born abroad in two cases. Between 1994 and 2007, registration with a Brazilian consular office did not confer Brazilian nationality.", "prediction 4": "The residency requirement for Brazilian citizens is based on both the principles of \"jus soli\" and of \"jus sanguinis\". Brazilian nationality law is regulated by Article 12 of the Brazilian Federal Constitution. A person born in Brazil acquires Brazilian nationality at birth, irrespective of status of parents. Those who have lived in Brazil for more than 15 years and have no criminal conviction do not have to satisfy any other condition for naturalization.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 52, "end": 61 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 103, "end": 112 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "As a general rule, any person born in Brazil acquires Brazilian nationality at birth. The only exception applies to children of persons in the service of a foreign government, which means that parents and siblings of the Brazilian child are eligible to apply for permanent residency in Brazil, regardless of their nationality or where subsequent siblings were/are born. The residency requirement for Brazilian citizens is 10 years. The residence requirement for foreigners is shorter in some circumstances, for example, if they have lived in Brazil for more than 15 years and have no criminal conviction. There are also lower requirements for those who moved to Brazil as minors." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who sang i'm gonna wash that man right out of my hair?", "passages": [ [ "I'm Gonna Wash That Man Right Outa My Hair", "I'm Gonna Wash That Man", "Right Outa My Hair\n\n\"I'm Gonna Wash", "That Man", "Right Outa My Hair\" is a song from the musical \"South Pacific\", sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production.", "Her character, fed up with a man (Emile De Becque) and singing energetically in the shower, claims that she will forget about him.", "The song was written by Rodgers and Hammerstein in response to Martin's request.", "She had starred on Broadway for years and Martin suggested that she wash her hair on stage during the performance.", "\"I'm Gonna Wash That Man", "Right Outa My Hair\" was adapted for a commercial jingle for Clairol hair coloring in the 1970s.", "PJ Harvey referenced the song in her 1992 single \"Sheela-Na-Gig\" with the repeated lyric \"gonna wash that man right outa my hair\".", "50 Foot Wave's song \"Bone China\" also references this song in the lyric, \"Gonna wash that man right out of my head / and soap him into my eyes\".", "The song was covered in the 2004 film Connie and Carla by the title characters (portrayed by Nia Vardalos & Toni Collette)." ], [ "South Pacific (musical)", "For the 48,000 tickets available in Cleveland, 250,000 requests were submitted, causing the box office to close for three weeks to process them.", "Jeanne Bal and Iva Withers were later Nellies on this tour.", "A scaled-down version toured military bases in Korea in 1951; by the request of Hammerstein and Rodgers, officers and enlisted soldiers sat together to view it.", "Martin left the Broadway production in 1951 to appear in the original London West End production; Martha Wright replaced her.", "Despite the departure of both original stars, the show remained a huge attraction in New York.", "Cloris Leachman also played Nellie during the New York run; George Britton was among the later Emiles.", "The London production ran from November 1, 1951 for 802 performances at the Theatre Royal, Drury Lane.", "Logan directed; Martin and Wilbur Evans starred, with Walston as Billis, Muriel Smith as Bloody Mary and Ivor Emmanuel in the small role of Sgt.", "Johnson.", "Sean Connery and Martin's son Larry Hagman, both at the start of their careers, played Seabees in the London production; Julie Wilson eventually replaced Martin.", "On January 31, 1952, King George VI attended the production with his daughter Princess Elizabeth and other members of the Royal Family.", "He died less than a week later." ] ], "gold": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. Martin left the Broadway production in 1951 and Martha Wright replaced her. Cloris Leachman also played Nellie during the New York run as a one month replacement for Wright in 1951.", "prediction 1": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, originally performed by Mary Martin in the 1949 Broadway production. Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production, sang the song.", "prediction 2": "\"I'm Gonna Wash That Man Right Outa My Hair\" is a song from the musical \"South Pacific\" sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. Martin left the Broadway production in 1951 to appear in the original London West End production. Martha Wright replaced Martin.", "prediction 3": "\"I'm Gonna Wash That Man Right Outa My Hair\" is a song from the musical \"South Pacific\", originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. Nellie Forbush, the lead singer, sang the song.", "prediction 4": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, sung by Nellie Forbush, the female lead, originally played by Mary Martin in the 1949 Broadway production. The song was written by Rodgers and Hammerstein in response to Martin's request. Martin left the Broadway production in 1951 to appear in the original London West End production; Martha Wright replaced Martin.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "originally performed by Mary Martin in the 1949 Broadway production. ", "start": 187, "end": 252 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "I'm Gonna Wash That Man Right Outa My Hair is a song from the musical South Pacific, originally performed by Mary Martin in the 1949 Broadway production. Nellie Forbush, the female lead, sang the song. Martin left the Broadway production in 1951 to appear in the original London West End production; Martha Wright replaced her. Cloris Leachman also played Nellie during the New York run." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time the sixers won a championship?", "passages": [ [ "1982\u201383 Philadelphia 76ers season", "However, the Sixers backed up Malone's boast.", "They made a mockery of the Eastern Conference playoffs, first sweeping the New York Knicks in the Semifinals and then beating the Milwaukee Bucks in five games in the Conference Finals.", "The Sixers went on to win their third NBA championship with a four-game sweep of the defending NBA champion Los Angeles Lakers, who had defeated them the season before.", "Malone was named the playoffs' MVP.", "Their 12\u20131 playoff record ranks as the third-best in league history after the 2017 Warriors, who went 16-1, and the 2001 Lakers, who went 15\u20131 en route to the NBA title coincidentally beating the 76ers in the finals.", "The Philadelphia-based group Pieces of a Dream had a minor hit in 1983 with the R&B song \"Fo-Fi-Fo\", which title was prompted by Malone's quip.", "The 76ers had a first round bye.", "(1) Philadelphia 76ers vs. (5) New York Knicks: \"76ers win series 4\u20130\"\n\n(1) Philadelphia 76ers vs. (2) Milwaukee Bucks: \"76ers win series 4\u20131\"\n\n(1) Philadelphia 76ers vs. (1) Los Angeles Lakers: \"76ers win series 4\u20130\"\n\nThe 1983 NBA Finals was the championship round of the season." ] ], "gold": "The last time the Philadelphia 76ers won an NBA Championship was May 31 1983, when they won their third NBA Championship by beating the Los Angeles Lakers in four games.", "prediction 1": "The last time the Sixers won a championship was in 1983. The 76ers did so, however, by mocking the Eastern Conference playoffs. They made a mockery of the Eastern Conference playoffs, first sweeping the New York Knicks in the Semifinals and then beating the Milwaukee Bucks in five games in the Conference Finals. They then went on to win their third NBA championship with a four-game sweep of the defending NBA champion Los Angeles Lakers, who had defeated them the season before.", "prediction 2": "The last time the Sixers won a championship was in 1983. They made a mockery of the Eastern Conference playoffs, first sweeping the New York Knicks in the Semifinals and then beating the Milwaukee Bucks in five games in the Conference Finals. The Sixers went on to win their third NBA championship with a four-game sweep of the defending NBA champion Los Angeles Lakers, who had defeated them the season before.", "prediction 3": "The last time the Philadelphia 76ers won a championship was in 1983, when they beat the Los Angeles Lakers in the Conference Finals.", "prediction 4": "The last time the Sixers won a championship was in 1983. They made a mockery of the Eastern Conference playoffs, first sweeping the New York Knicks in the Semifinals and then beating the Milwaukee Bucks in five games in the Conference Finals. They went on to win their third NBA championship with a four-game sweep of the defending NBA champion Los Angeles Lakers, who had defeated them the season before.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 56 }, { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 313 }, { "error type": "Irrelevant", "explanation": "", "start": 441, "end": 481 } ], "missing-info": [], "corrected-prediction": "The Philadelphia 76ers went on to win their third NBA championship in 1983 with a four-game sweep of the defending NBA champion Los Angeles Lakers." }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "What was the millionaires name on gilligan's island?", "passages": [ [ "Thurston Howell III", "Thurston Howell III\n\nThurston Howell III (mentioned in the opening credits as: \"The Millionaire\") is a character on the CBS television sitcom \"Gilligan's Island\", which ran from 1964 to 1967, and later in syndication.", "Howell, portrayed by veteran character actor Jim Backus, is so wealthy that he took hundreds of thousands of dollars in cash and several changes of clothing with him for what was intended to be only a three-hour boat tour in Hawaii, one of the sillier premises of the show.", "Speaking with a Locust Valley lockjaw accent, Howell is a stereotypical member of the New England Yankee elite \u2014 a resident of Newport, Rhode Island, a graduate of Harvard University and a Republican.", "He is a member of the Newport Country Club, Oyster Bay Yacht Club, and the Union League Club where he has a \"window seat\".", "His wife, Lovey, portrayed by Natalie Schafer, is conscious of social strata, yet seems to be a good-hearted woman with a deep sense of \"noblesse oblige\", allowing her to interact with the other passengers and crew, though they are all her social inferiors.", "One of the implied humorous points of the show is that Thurston continually fails to realize that all of the Howells' money is essentially useless to them on the island." ], [ "Lovey Howell", "Lovey Howell\n\n\"Lovey\" Howell (n\u00e9e Wentworth), referred to as \"Mrs. Howell\" by characters other than her husband, is a fictional character from the 1964 to 1967 television show \"Gilligan's Island\".", "Played by Natalie Schafer, the character was a rich, spoiled socialite, married to Thurston Howell III.", "While Mr. Howell always called her \"Lovey\", the other castaways always called her \"Mrs. Howell\".", "There are only two times someone besides Thurston calls her Lovey: in the pilot, when the radio is announcing the missing people, the announcer says \"Thurston Howell III and his wife, international hostess Lovey Howell\"; and in the episode in which Gilligan thinks he wins the lottery and invites all the people into the Howells' club, The Professor greets Mr. and Mrs. Howell as Thurston and Lovey.", "In episode 31 of season 2, \"Mr. and Mrs. ???", "\", in which the Howells were having marital problems, she mentioned her maiden name was Wentworth.", "If \"Lovey\" is a nickname, her actual first name was never mentioned in the series itself or its unaired pilot episode." ], [ "S. S. Minnow", "S. S. Minnow\n\nThe S. S. \"Minnow\" is a fictional charter boat on the hit 1960s television sitcom \"Gilligan's Island\".", "The ship ran aground on the shore of \"an uncharted desert isle\" (in the south Pacific Ocean), setting the stage for this popular situation comedy.", "The crew of two were the skipper Jonas Grumby and his first mate Gilligan, and the five passengers were millionaire Thurston Howell III, his wife Lovey Howell, movie star Ginger Grant, professor Roy Hinkley, and farm girl Mary Ann Summers.", "The shipwreck was first seen in the season 1 episode \"Two on a Raft\", which begins with the crew and passengers awaking on the ship.", "Several times in the course of the series they plan ways to repair the \"Minnow\" to get off the island.", "In the episode \"Goodbye Island\", Gilligan discovered glue that was believed to be waterproof and permanent.", "However, it was later revealed that the glue was temporary and before they could push the repaired ship out to sea, the entire vessel literally fell to pieces." ] ], "gold": "Thurston Howell III, mentioned in the opening credits as: \"The Millionaire\", is a character on the CBS television sitcom Gilligan's Island, which ran from 1964 to 1967, and later in syndication.Lovey Howell (n\u00e9e Wentworth), is a fictional character from the 1964 television show Gilligan's Island. Played by Natalie Schafer, the character is a rich socialite married to billionaire businessman Thurston Howell III.", "prediction 1": "The millionaire character on the hit television show Gilligan's Island was named Thurston Howell III, while his wife Lovey Howell was always called Lovey. In the opening credits of the television show the millionaire is mentioned as Thurston Howell III. In the episode Goodbye Island, the millionaire is mentioned as Lovey Howell, the wife of millionaire Thurston Howell III.", "prediction 2": "On the CBS television sitcom Gilligan's Island, the character of the millionaire, Thurston Howell III, is mentioned in the opening credits as \"The Millionaire\". \"Lovey\" Howell, referred to as \"Mrs. Howell\", is a fictional character from the 1964 to 1967 television show Gilligan's Island. While Mr. Howell always called her \"Lovey\", the other castaways always called her \"Mrs. Howell\".", "prediction 3": "The millionaire character on Gilligan's Island, played by veteran character actor Jim Backus, was named Thurston Howell III. He married Lovey Howell, n\u00e9e Wentworth, in episode 31 of season 2, Mr. and Mrs.???, in which the Howells were having marital problems, she mentioned her maiden name was Wentworth. His wife was also named Lovey, but her real name was never mentioned.", "prediction 4": "The millionaire on Gilligan's Island is named Thurston Howell III. The character is mentioned in the opening credits as: \"The Millionaire\". Lovey Howell, played by Natalie Schafer, is the wife of millionaire Thurston Howell III. While Mr. Howell always called her \"Lovey\", the other castaways always called her Mrs. Howell. In episode 31 of season 2, \"Mr. and Mrs.???\" the character mentioned her maiden name was Wentworth.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 233, "end": 253 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 134, "end": 154 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 285, "end": 375 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The millionaire character on the hit CBS television show Gilligan's Island, which ran from 1964 to 1967, and later in syndication, was named Thurston Howell III, while his wife was Lovey Howell(n\u00e9e Wentworth). She is played by Natalie Schafer, the character was a rich, spoiled socialite. In the opening credits of the television show he is mentioned as \"The Millionaire\". " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who is considered to be the founder of modern day schools of social work?", "passages": [ [ "Jane Addams", "During and after World War I the focus of the Chicago Sociology Department shifted away from social activism toward a more positivist orientation.", "Social activism was also associated with communism and a \"weaker\" woman's work orientation.", "In response to this change, women sociologists in the department \"were moved inmasse out of sociology and into social work\" in 1920 The contributions of Jane Addams and other Hull House residents were buried in history.", "Mary Jo Deegan, in her 1988 book \"Jane Addams and the Men of the Chicago School, 1892-1918\" was the first person to recover Addams influence on Sociology.", "Deegan's work has led to recognition of Addams' place in sociology.", "In a 2001 address, for example, Joe Feagin, then president of the American Sociology Association, identified Addams as a \"key founder\" and he called for sociology to again claim its activist roots and commitment to social justice.", "On December 10, 2007, Illinois celebrated the first annual Jane Addams Day.", "Jane Addams Day was initiated by a dedicated school teacher from Dongola, Illinois, assisted by the Illinois Division of the American Association of University Women (AAUW).", "Chicago activist Jan Lisa Huttner traveled throughout Illinois as Director of International Relations for AAUW-Illinois to help publicize the date, and later gave annual presentations about Jane Addams Day in costume as Jane Addams." ], [ "Octavia Hill", "She was a founder member of the Charity Organisation Society (now the charity Family Action) which organised charitable grants and pioneered a home-visiting service that formed the basis for modern social work.", "She was a member of the Royal Commission on the Poor Laws in 1905.", "Hill's legacy includes the large holdings of the modern National Trust, several housing projects still run on her lines, a tradition of training for housing managers, and the museum established by the Octavia Hill Society at her birthplace.", "Octavia Hill was the daughter of James Hill, corn merchant, follower of Owenism and banker, and his third wife, Caroline Southwood Smith.", "He had been widowed twice, and had six children (five daughters and a son) from his previous marriages.", "He had been impressed by the writings on education of Caroline Southwood Smith, the daughter of Dr Thomas Southwood Smith, a pioneer of sanitary reform.", "He had engaged Caroline as a governess for his children in 1832, and they were married in 1835, three years before Octavia was born in Wisbech, Cambridgeshire, her father's eighth daughter and ninth child.", "The family's comfortably prosperous life was disrupted by James Hill's financial problems and his mental collapse.", "In 1840 he was declared bankrupt.", "Caroline Hill's father gave the family financial support, and took on some of Hill's paternal role." ], [ "Octavia Hill", "Octavia Hill\n\nOctavia Hill (3 December 1838 \u2013 13 August 1912) was an English social reformer, whose main concern was the welfare of the inhabitants of cities, especially London, in the second half of the nineteenth century.", "Born into a family with a strong commitment to alleviating poverty, she herself grew up in straitened circumstances owing to the financial failure of her father.", "With no formal schooling, she worked from the age of 14 for the welfare of working people.", "Hill was a moving force behind the development of social housing, and her early friendship with John Ruskin enabled her to put her theories into practice with the aid of his initial investment.", "She believed in self-reliance, and made it a key part of her housing system that she and her assistants knew their tenants personally and encouraged them to better themselves.", "She was opposed to municipal provision of housing, believing it to be bureaucratic and impersonal.", "Another of Hill's concerns was the availability of open spaces for poor people.", "She campaigned against development on existing suburban woodlands, and helped to save London's Hampstead Heath and Parliament Hill Fields from being built on.", "She was one of the three founders of the National Trust, set up to preserve places of historic interest or natural beauty for the enjoyment of the British public." ] ], "gold": "There are several people considered to be founders of modern days schools of social work. Jane Addams, an American settlement activist, reformer, social worker, sociologist, public administrator and author, is considered the founder of modern day schools of social work. Jane Addams Day was initiated by a dedicated school teacher from Dongola, Illinois, assisted by the Illinois Division of the American Association of University Women (AAUW). Octavia Hill is considered to be the founder of modern day social work, and thus modern day schools of social work. Octavia Hill was an English social reformer, whose main concern was the welfare of the inhabitants of cities, especially London, in the second half of the nineteenth century.", "prediction 1": "Octavia Hill was an English social reformer, whose main concern was the welfare of the inhabitants of the cities in the second half of the nineteenth century. She was also a founder member of the Charity Organisation Society and pioneered a home-visiting service that formed the basis for modern social work.", "prediction 2": "Octavia Hill is considered to be the founder of modern-day schools of social work. Hill was an English social reformer whose main concern was the welfare of the inhabitants of cities, especially London, in the second half of the nineteenth century. She was also a founder member of the Charity Organisation Society and pioneered a home-visiting service that formed the basis for modern social work. On December 10, 2007, Illinois celebrated the first annual Jane Addams Day.", "prediction 3": "Octavia Hill was an English social reformer, whose main concern was the welfare of the inhabitants of cities, especially London, in the second half of the nineteenth century. She was a founder member of the Charity Organisation Society, which organised charitable grants and pioneered a home-visiting service that formed the basis for modern social work. She was a member of the Royal Commission on the Poor Laws in 1905. She was also a founding member of the National Trust.", "prediction 4": "Octavia Hill, an English social reformer, was a founder of the Charity Organisation Society, and is considered to be the founder of modern day schools of social work. She was born into a family with a strong commitment to alleviating poverty, and she worked from the age of 14 for the welfare of working people. She was a member of the Royal Commission on the Poor Laws in 1905 and was a founding member of the National Trust.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Octavia Hill was an English social reformer, whose main concern was the welfare of the inhabitants of the cities in the second half of the nineteenth century. She was also a founder member of the Charity Organisation Society and pioneered a home-visiting service that formed the basis for modern social work. Jane Addams Day was initiated by a dedicated school teacher from Dongola, Illinois, assisted by the Illinois Division of the American Association of University Women, in honor of Jane Addams a \"key founder\" in Social activism." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When does episode 4 rick and morty air?", "passages": [ [ "Rick and Morty", "Rick and Morty\n\nRick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim.", "The series follows the misadventures of cynical mad scientist Rick Sanchez and his good-hearted but fretful grandson Morty Smith, who split their time between domestic life and interdimensional adventures.", "The series premiered on December 2, 2013, and the third season concluded on October 1, 2017.", "In May 2018, the series was picked up for an additional 70 episodes over an unspecified number of seasons.", "Roiland voices the eponymous characters, with Chris Parnell, Spencer Grammer and Sarah Chalke voicing the rest of the family.", "The series originated from an animated short parody film of \"Back to the Future\", \"The Real Animated Adventures of Doc and Mharti,\" created by Roiland for Channel 101, a short film festival co-founded by Harmon.", "When Adult Swim approached Harmon for television show ideas, he and Roiland decided to develop a program based on the short.", "The series has received universal acclaim for its originality, creativity and humor.", "The show revolves around the adventures of the members of the Smith household, which consists of parents Jerry and Beth, their children Summer and Morty, and Beth's father, Rick Sanchez, who lives with them as a guest." ], [ "The Tom and Jerry Show (2014 TV series)", "It is the second \"Tom and Jerry\" television series produced in the 16:9 widescreen aspect ratio and the first to be animated in Adobe Flash.", "It is also the second made-for-television iteration of the cartoons to emulate the theatrical shorts, the fifth made-for-television \"Tom and Jerry\" production and the first Tom and Jerry television production to be produced without any of its original creators William Hanna and Joseph Barbera, who died in 2001 and 2006 respectively.", "\"The Tom and Jerry Show\" first premiered on March 1, 2014 on Teletoon in Canada.", "The series premiered on April 9, 2014 on Cartoon Network in the United States.", "In the United Kingdom and Ireland, it began airing on April 12, 2014 on Boomerang.", "It premiered on April 21, 2014 on Cartoon Network in India.", "In Australia, Cartoon Network premiered it on May 5, 2014.", "The series began airing on Boomerang in the United States on January 5, 2015.", "In Indonesia, it is currently broadcast on GTV since February 13, 2017 and on RCTI since August 13, 2017.", "In China, it is broadcast on China Central Television." ] ], "gold": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon, that follows Rick Sanchez, an alcoholic, nihilistic super-scientist, and his easily distressed grandson, Morty Smith to parallel dimensions and exotic planets with extraterrestrials. Season 1, episode 4 aired on January 13, 2014. Season 2, episode 4 aired on August 16, 2015. Season 3, episode 4 aired on August 13, 2017 and season 4, episode 4 aired December 8, 2019.", "prediction 1": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Episode 4 first aired on January 5, 2017. Episode 4 2nd aired on January 5, 2018. Episode 4th aired on January 5, 2019.", "prediction 2": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. It follows the misadventures of cynical mad scientist Rick Sanchez and his good-hearted but fretful grandson Morty Smith, who split their time between domestic life and interdimensional adventures. Episode 4 premiered on Cartoon Network on January 5, 2015 and on Cartoon Network on December 5, 2016.", "prediction 3": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Episode 4 aired on March 9, 2017. Episode 5 aired on March 19, 2018.", "prediction 4": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Episode 4 of the series aired on April 21, 2014 in the United States and April 12, 2014 in the United Kingdom and Ireland. The series premiered on Cartoon Network in the United States on September 9, 2014.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 172, "end": 213 }, { "error type": "Redundant", "explanation": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Episode 4 first aired on January 5, 2017. ", "start": 214, "end": 253 }, { "error type": "Redundant", "explanation": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon for Cartoon Network's late-night programming block Adult Swim. Episode 4 first aired on January 5, 2017. ", "start": 254, "end": 291 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Rick and Morty is an American adult animated science fiction sitcom created by Justin Roiland and Dan Harmon. The series follows the misadventures of cynical mad scientist Rick Sanchez and his good-hearted but fretful grandson Morty Smith, who split their time between domestic life and interdimensional adventures." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "What is the name of istanbul international airport?", "passages": [ [ "Istanbul Atat\u00fcrk Airport", "Planned as the largest airport in the world, \"Istanbul Airport\", a new third airport is under construction in order to meet Istanbul's growing domestic and international air traffic demand as a source, destination and transit point.", "A site in the European part on the coast of the Black Sea has been chosen and construction started in May 2015.", "The first phase of the new airport was completed on 2018 Republic Day, with first flights starting the following day.", "At opening, it consists of two runways and the main terminal building, with an initial annual capacity of 90 million passengers.", "Originally it was planned that Atat\u00fcrk Airport will be closed in several days to scheduled passenger air traffic.", "But both airports will be used for two months, and new airport will be used for some domestic, Azerbaijan and northern Cyprus flights.", "Ataturk's \"IST\" IATA airport code will be inherited by Istanbul New Airport and Atat\u00fcrk Airport will be assigned the code \"ISL\" once the transfer of scheduled passenger activities to the new airport is complete.", "The following airlines operate regular scheduled and charter flights to and from Istanbul Atat\u00fcrk Airport:\n\nIstanbul Atat\u00fcrk Airport shares traffic with Sabiha G\u00f6k\u00e7en International Airport, which is on the Anatolian (Asian) side of Istanbul, which had annual passenger traffic of 11.1 million in 2010 rising to 28m in 2015." ], [ "Istanbul Airport", "Istanbul Airport\n\nIstanbul Airport () is an international airport in the Arnavutk\u00f6y district on the European side of Istanbul, Turkey.", "The airport was planned as the largest in the world with a 150 million annual passenger capacity in its last planned expansion stage, while remaining upgradable to handle 200 million annual passengers if required in the future.", "It is the third international airport to be built in Istanbul after Atat\u00fcrk Airport and Sabiha G\u00f6k\u00e7en Airport, and is planned to become the main international airport serving Istanbul.", "Atat\u00fcrk Airport will be closed down for scheduled passenger flights once the new airport is fully operational, and its IATA code IST will be transferred to the new airport.", "Atat\u00fcrk Airport, Istanbul's current main airport, is located in the Ye\u015filk\u00f6y neighbourhood of the Bak\u0131rk\u00f6y district and is surrounded by urban Istanbul.", "Additionally, there is an increasing problem of air traffic congestion.", "Atat\u00fcrk Airport is one of the busiest airports in Europe.", "Since 2013, it has ranked among the five busiest airports in Europe by passenger traffic.", "There is no space to build an additional runway on the Atat\u00fcrk Airport site, as the airport is surrounded on all sides.", "Because of the limited capacity, the Turkish Airport Authority does not allow additional cargo or charter flights to the airport." ] ], "gold": "Istanbul Airport is the name of the main international airport serving Istanbul, Turkey. It is located in the Arnavutk\u00f6y district on the European side of the city. Previously, Istanbul Atat\u00fcrk Airport was the main international airport serving Istanbul, Turkey. All scheduled commercial passenger flights were transferred from Istanbul Atat\u00fcrk Airport to Istanbul Airport on 6 April 2019 following the closure of Istanbul Atat\u00fcrk Airport for scheduled passenger flights. The IATA airport code IST was also transferred to the new airport.", "prediction 1": "Istanbul Atat\u00fcrk Airport is an international airport located in Istanbul, Turkey. It is one of the busiest airports in Europe and is surrounded by urban Istanbul. Istanbul Atat\u00fcrk Airport was opened in 1999, and has been operating since 1996. It is a regional airport located in the Arnavutk\u00f6y district on the European side of Istanbul.", "prediction 2": "Istanbul Atat\u00fcrk Airport is the name of the international airport in Istanbul, Turkey. The airport is one of the busiest in Europe and is surrounded by urban Istanbul. As of 2015, the airport was the third international airport to be built in Istanbul after Atat\u00fcrk Airport and Sabiha G\u00f6k\u00e7en Airport, and is planned to become the main international airport serving Istanbul.", "prediction 3": "Istanbul Atat\u00fcrk International Airport is the name of the international airport in Istanbul that is based in the Arnavutk\u00f6y district on the European side of Istanbul. It was planned as the largest airport in the world, \"Istanbul Airport\", which is also known as Istanbul New Airport. This airport is under construction in order to meet Istanbul's growing domestic and international air traffic demand as a source, destination and transit point.", "prediction 4": "Istanbul Atat\u00fcrk Airport is the name of the main international airport serving Istanbul. It is located in the Arnavutk\u00f6y district on the European side of Istanbul, Turkey. It is the third international airport to be built in Istanbul after Atat\u00fcrk Airport and Sabiha G\u00f6k\u00e7en Airport. It is planned to become the main international airport serving Istanbul.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 243, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 242 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Istanbul Atat\u00fcrk Airport is an international airport located in Istanbul, Turkey, in the Arnavutk\u00f6y district on the European side of Istanbul. Istanbul Airport is the third international airport to be built in Istanbul after Atat\u00fcrk Airport and Sabiha G\u00f6k\u00e7en Airport, and is planned to become the main international airport serving Istanbul. Ataturk's \"IST\" IATA airport code will be inherited by Istanbul New Airport and Atat\u00fcrk Airport will be assigned the code \"ISL\" once the transfer of scheduled passenger activities to the new airport is complete." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "When was the sound barrier broken for the first time?", "passages": [ [ "Sound barrier", "Firearms made after the 19th century have generally had a supersonic muzzle velocity.", "The sound barrier may have been first breached by living beings some 150 million years ago.", "Some paleobiologists report that, based on computer models of their biomechanical capabilities, certain long-tailed dinosaurs such as \"Apatosaurus\" and \"Diplodocus\" may have been able to flick their tails at supersonic speeds, creating a cracking sound.", "This finding is theoretical and disputed by others in the field.", "Meteorites entering the Earth's atmosphere usually, if not always, descend faster than sound.", "The tip of the propeller on many early aircraft may reach supersonic speeds, producing a noticeable buzz that differentiates such aircraft.", "This is undesirable, as the transonic air movement creates disruptive shock waves and turbulence.", "It is due to these effects that propellers are known to suffer from dramatically decreased performance as they approach the speed of sound.", "It is easy to demonstrate that the power needed to improve performance is so great that the weight of the required engine grows faster than the power output of the propeller can compensate.", "This problem was one that led to early research into jet engines, notably by Frank Whittle in England and Hans von Ohain in Germany, who were led to their research specifically in order to avoid these problems in high-speed flight." ], [ "Sound barrier", "Many claims of supersonic speeds were found to be far below this speed when measured in this fashion.", "In 1942, Republic Aviation issued a press release stating that Lts.", "Harold E. Comstock and Roger Dyar had exceeded the speed of sound during test dives in the P-47 \"Thunderbolt\".", "It is widely agreed that this was due to inaccurate ASI readings.", "In similar tests, the North American P-51 Mustang, a higher performance aircraft, demonstrated limits at Mach 0.85, with every flight over M0.84 causing the aircraft to be damaged by vibration.", "One of the highest recorded instrumented Mach numbers attained for a propeller aircraft is the Mach 0.891 for a Spitfire PR XI, flown during dive tests at the Royal Aircraft Establishment, Farnborough in April 1944.", "The Spitfire, a photo-reconnaissance variant, the Mark XI, fitted with an extended 'rake type' multiple pitot system, was flown by Squadron Leader J. R. Tobin to this speed, corresponding to a corrected true airspeed (TAS) of 606\u00a0mph.", "In a subsequent flight, Squadron Leader Anthony Martindale achieved Mach 0.92, but it ended in a forced landing after over- revving damaged the engine.", "In the 1990s, Hans Guido Mutke claimed to have broken the sound barrier on 9 April 1945 in the Messerschmitt Me 262 jet aircraft." ], [ "Sound barrier", "In 1933, Soviet designers working on ramjet concepts fired phosphorus-powered engines out of artillery guns to get them to operational speeds.", "It is possible that this produced supersonic performance as high as Mach 2, but this was not due solely to the engine itself.", "In contrast, the German V-2 ballistic missile routinely broke the sound barrier in flight, for the first time on 3 October 1942.", "By September 1944, V-2s routinely achieved Mach 4 (1,200\u00a0m/s, or 3044\u00a0mph) during terminal descent.", "In 1942, the United Kingdom's Ministry of Aviation began a top-secret project with Miles Aircraft to develop the world's first aircraft capable of breaking the sound barrier.", "The project resulted in the development of the prototype Miles M.52 turbojet powered aircraft, which was designed to reach 1,000\u00a0mph (417\u00a0m/s; 1,600\u00a0km/h) (over twice the existing speed record) in level flight, and to climb to an altitude of 36,000\u00a0ft (11\u00a0km) in 1 minute 30 sec.", "A huge number of advanced features were incorporated into the resulting M.52 design, many of which hint at a detailed knowledge of supersonic aerodynamics.", "In particular, the design featured a conical nose and sharp wing leading edges, as it was known that round-nosed projectiles could not be stabilised at supersonic speeds." ], [ "Sound barrier", "John Derry has been called \"Britain's first supersonic pilot\" because of a dive he made in a DH 108 on 6 September 1948.", "The British Air Ministry signed an agreement with the United States to exchange all its high-speed research, data and designs and Bell Aircraft company was given access to the drawings and research on the M.52, but the U.S. reneged on the agreement and no data was forthcoming in return.", "Bell's supersonic design was still using a conventional tail and they were battling the problem of control.", "They utilized the information to initiate work on the Bell X-1.", "The final version of the Bell X-1 was very similar in design to the original Miles M.52 version.", "Also featuring the all-moving tail, the XS-1 was later known as the X-1.", "It was in the X-1 that Chuck Yeager was credited with being the first person to break the sound barrier in level flight on October 14, 1947, flying at an altitude of 45,000\u00a0ft (13.7\u00a0km).", "George Welch made a plausible but officially unverified claim to have broken the sound barrier on 1 October 1947, while flying an XP-86 Sabre.", "He also claimed to have repeated his supersonic flight on October 14, 1947, 30 minutes before Yeager broke the sound barrier in the Bell X-1." ] ], "gold": "It has been theorized that the sound barrier may have been broken for the first time 150 million years ago by dinosaurs that were probably able to flick their tails at supersonic speeds, but this theory is disputed. It was reported in a press release that Lieutenants Harold E. Comstock and Roger Dyar broke the sound barrier in 1942, but it is widely agreed that their speed was most likely inaccurately read. The sound barrier was broken for the first time by an unmanned missile on 3 October 1942 by the German V-2 ballistic missile. Chuck Yeager was given the credit for breaking the sound barrier for the first time in a manned level flight on October 14, 1947.", "prediction 1": "The sound barrier was broken for the first time in flight by a ballistic missile in 1942. The first aircraft to break the sound barrier was the Miles M.52, a turbojet aircraft developed by Miles Aircraft in 1942.\n", "prediction 2": "The sound barrier was broken for the first time in flight by a ballistic missile in 1942. It was first measured by a telescope and communicating with a thunderbolt.", "prediction 3": "In the 1940s, the German V-2 ballistic missile routinely broke the sound barrier in flight, for the first time on 3 October 1942. The sound barrier may have been first breached by living beings some 150 million years ago. In the 1990s, Hans Guido Mutke claimed to have broken the sound barrier on 9 April 1945 in the Messerschmitt Me 262 jet aircraft. John Derry has been called \"Britain's first supersonic pilot\" because of a dive he made in a DH 108 on 6 September 1948.", "prediction 4": "In 1942, the United Kingdom's Ministry of Aviation began a top-secret project with Miles Aircraft to develop the world's first aircraft capable of breaking the sound barrier. The prototype Miles M.52 turbojet powered aircraft was designed to reach 1,000 mph (417 m/s; 1,600 km/h) in level flight, and to climb to an altitude of 36,000 ft (11 km) in just over an hour.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 90, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 213 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 3, 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3, 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 7 ] } ], "corrected-prediction": "It has been theorized that the sound barrier may have been broken for the first time 150 million years ago by dinosaurs that were probably able to flick their tails at supersonic speeds, but this theory is disputed. It was reported in a press release that Lieutenants Harold E. Comstock and Roger Dyar broke the sound barrier in 1942, but it is widely agreed that their speed was most likely inaccurately read. The sound barrier was broken for the first time by an unmanned missile on 3 October 1942 by the German V-2 ballistic missile. Chuck Yeager was given the credit for breaking the sound barrier for the first time in a manned level flight on October 14, 1947." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who is running for attorney general in illinois?", "passages": [ [ "2018 Illinois Attorney General election", "2018 Illinois Attorney General election\n\nThe 2018 Illinois Attorney General election took place on November 6, 2018, to elect the Attorney General of Illinois.", "Incumbent Democratic Attorney General Lisa Madigan, who had served since 2003, did not seek re-election to a fifth term.", "Democrat Kwame Raoul won the election with 55 percent of the vote, while Republican Erika Harold took 43 percent of the vote." ], [ "2014 Illinois elections", "Rauner defeated Quinn in the general election by 50.3% of the vote to Quinn's 46.4%.", "Rauner won every county in Illinois except for Cook County, home to the city of Chicago and 40% of the state's residents.", "Incumbent Democratic Attorney General Lisa Madigan ran for re-election to a fourth term in office.", "Incumbent Democratic Secretary of State Jesse White ran for re-election to a fifth term in office.", "Incumbent Republican Comptroller Judy Baar Topinka ran for re-election to a second term in office.", "Topinka died on December 10, 2014.", "Governor Pat Quinn appointed Jerry Stermer to serve out the remainder of her term.", "A special election was held for the office in 2016.", "Incumbent Republican Treasurer Dan Rutherford did not run for re-election to a second term in office.", "He instead ran unsuccessfully for the Republican nomination for governor.", "Incumbent Democratic Senator and Senate Majority Whip Dick Durbin ran for re-election to a fourth term in office.", "He defeated Republican State Senator Jim Oberweis and Libertarian Sharon Hansen in the general election.", "All of Illinois' eighteen seats in the United States House of Representatives were up for election in 2014." ], [ "Illinois Attorney General", "Illinois Attorney General\n\nThe Illinois Attorney General is the highest legal officer of the state of Illinois in the United States.", "Originally an appointed office, it is now an office filled by election through universal suffrage.", "Based in Chicago and Springfield, Illinois, the Attorney General is responsible for providing legal counsel for the various state agencies including the Governor of Illinois and Illinois General Assembly, and conducting all legal affairs pertaining to the state.", "The office of the Illinois Attorney General was established on December 3, 1818 based on guidelines adopted by a state constitutional convention.", "The first person to fulfill the duties of the office was Daniel Pope Cook who only served eleven days, and was later elected to the United States Congress.", "Cook County was named in his honor.", "The current holder of the office is Lisa Madigan." ], [ "Paul Schimpf", "Paul Schimpf\n\nPaul Schimpf (born 1971) is a Republican member of the Illinois Senate from the 58th district.", "The 58th district includes all or parts of Jefferson, Perry, Randolph, St. Clair, Monroe, Jackson, Union, and Washington counties.", "Among his activities prior to his tenure as State Senator, Schimpf served in the U.S. Marine Corps, participated in the trial of Saddam Hussein, and ran for Illinois Attorney General in 2014.", "Schimpf, the son of two school teachers, was born in 1971 at Scott Air Force Base and raised in Waterloo, Illinois.", "He was the valedictorian of his high school senior class and was a National Merit Scholar.", "Schimpf attended the United States Naval Academy\u2014passing an engineering scholarship offer at the University of Illinois\u2014and Southern Illinois University School of Law.", "Schimpf served as an officer in the U.S. Marine Corps, rising to the rank of lieutenant colonel.", "He was commissioned as a second lieutenant in 1993 and retired in May 2013.", "In 2005, Schimpf was deployed to Iraq to serve as the chief American advisor to prosecutors in the trial of Saddam Hussein.", "Schimpf served as a member of the legislative staff of U.S. Representative John Kline of Minnesota.", "Schimpf was the Republican nominee for Illinois Attorney General in 2014." ] ], "gold": "The Illinois Attorney General is the highest legal officer of the state of Illinois in the United States. In 2014, Incumbent Democratic Attorney General Lisa Madigan ran for re-election to a fourth term in office and Paul Schimpf was the Republican nominee. In the November 6, 2018 election, Democrat Kwame Raoul won the election with 55 percent of the vote, against Republican Erika Harold, who was Miss Illinois 2002 and Miss America 2003. Kwame Raoul is the current Attorney General in Illinois.", "prediction 1": "The Illinois Attorney General is the highest legal officer of the state of Illinois in the United States. In 2018, Kwame Raoul won the election as the new Attorney General of Illinois while Republican Erika Harold took 43 percent of the vote. In 2014, Republican Comptroller Judy Baar Topinka ran for re-election to a second term in office. In 2016, Incumbent GOP Senator and Senate Majority Whip Dick Durbin ran for re-election to a fourth term in office.", "prediction 2": "The Illinois Attorney General is a state position in the United States. In 2014, Republican candidate Paul Schimpf ran for Illinois Attorney General, and in 2016 incumbent Republican Lisa Madigan ran for Attorney General. In 2018, Democratic candidate Kwame Raoul won the election with 55 percent of the vote, while Republican Erika Harold took 43 percent of the vote.", "prediction 3": "The office of the Illinois Attorney General was established on December 3, 1818 based on guidelines adopted by a state constitutional convention. The current holder of the office is Lisa Madigan, who served since 2003. In 2018 Kwame Raoul was the winner of the election, and in 2016 Judy Baar Topinka was the winner. Paul Schimpf was the Republican nominee for Illinois Attorney General in 2014.", "prediction 4": "The Illinois Attorney General is the highest legal officer of the state of Illinois in the United States. The office was established on December 3, 1818 based on guidelines adopted by a state constitutional convention. Originally an appointed office, it is now an office filled by election through universal suffrage. The Republican nominees for the office include Paul Schimpf in 2014, Kwame Raoul in 2018, and Erika Harold in 2019.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 340 }, { "error type": "Unverifiable", "explanation": "", "start": 341, "end": 456 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Illinois Attorney General is the highest legal officer of the state of Illinois in the United States. In 2018, Kwame Raoul won the election as the new Attorney General of Illinois while Republican Erika Harold took 43 percent of the vote. In 2014, Incumbent Democratic Attorney General Lisa Madigan ran for re-election to a fourth term in office against Paul Schimpf the Republican nominee." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who is the speaker of the lok sabha?", "passages": [ [ "Speaker of the Lok Sabha", "Speaker of the Lok Sabha\n\nThe Speaker of the Lok Sabha is the presiding officer of the Lok Sabha (House of the People), the lower house of the Parliament of India.", "The speaker is elected generally in the very first meeting of the Lok Sabha following general elections.", "Serving for a term of five years, the speaker chosen from sitting members of the Lok Sabha (House of people), and is by convention a member of the ruling party or alliance.", "The current speaker is Sumitra Mahajan of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha.", "She is the second woman to hold the office, after her immediate predecessor Meira Kumar.", "In the Lok Sabha, the lower House of the Indian Parliament, both Presiding Officers\u2014the Speaker and the Deputy Speaker are elected from among its members by a simple majority of members present and voting in the House.", "As such, no specific qualifications are prescribed for being elected the Speaker.", "The Constitution only requires that Speaker should be a member of the House.", "But an understanding of the Constitution and the laws of the country and the rules of procedure and conventions of Parliament is considered a major asset for the holder of the office of the Speaker.", "One of the first acts of a newly constituted House is to elect the Speaker.", "Once a decision on the candidate is taken, their name is normally proposed by the member to Pro tem speaker." ], [ "Somnath Chatterjee", "Somnath Chatterjee\n\nSomnath Chatterjee (25 July 1929 \u2013 13 August 2018) was an Indian politician who was associated with the Communist Party of India (Marxist) for most of his life, though he had been a non affiliated independent during his last decade.", "He was the Speaker of the Lok Sabha (House of the People) from 2004 to 2009.", "Born in Tezpur, Assam, his father, Nirmal Chandra Chatterjee, was a prominent lawyer, intellectual, and Hindu revivalist and nationalist around the time of India's independence, and his mother, Binapani Debi ran the home.", "Nirmal Chandra Chatterjee was one of the founders and one-time president of the Akhil Bharatiya Hindu Mahasabha.", "In 1948, when the Communist Party of India was banned by the Jawaharlal Nehru led Indian National Congress government in India, and its party leaders arrested, Nirmal Chandra Chatterjee formed the All India Civil Liberties Union, and agitated for their release.", "In the process, he came close to Jyoti Basu, in spite of continuing ideological political differences between the two.", "Somnath was educated at Mitra Institution School, Presidency College and then the University of Calcutta in Calcutta.", "He also attended Jesus College, Cambridge and graduating with a B.A. in 1952 and a M.A." ], [ "Meira Kumar", "Meira Kumar\n\nMeira Kumar is an Indian politician and five-time Member of Parliament who was the United Progressive Alliance nominee for President of India in the 2017 election.", "She was elected unopposed as the first woman Speaker of Lok Sabha and served from 2009 to 2014.", "Prior to being a member of the 15th Lok Sabha, she had been elected earlier to the 8th, 11th, 12th and 14th Lok Sabha.", "She served as a Cabinet Minister in the Ministry of Social Justice and Empowerment of Manmohan Singh's Congress led Government (2004\u20132009).", "Kumar was the joint presidential candidate by the leading opposition parties for 2017 presidential election and lost the election to the NDA nominee Ram Nath Kovind, but made a record for obtaining the most number of votes ever by a losing candidate (3,67,314 Electoral votes).", "She is also a lawyer and a former diplomat.", "Meira Kumar was born in Arrah district, Bihar to the former Deputy Prime Minister and prominent Dalit leader, Jagjivan Ram, and a freedom fighter, Indrani Devi.", "She attended the Welham Girls School, Dehradun and Maharani Gayatri Devi Girls' Public School in Jaipur.", "She studied at Banasthali Vidyapith for a short duration.", "She completed her M.A and L.L.B." ] ], "gold": "The Speaker of the Lok Sabha is the presiding officer and the highest authority of the Lok Sabha (House of the People), the lower house of the Parliament of India. The 14th Speaker of the Lok Sabha was Somnath Chatterjee, an Indian politician who was associated with the Communist Party of India for most of his life, though he had been a non affiliated independent during his last decade. The 15th Speaker of the Lok Sabha was Meira Kumar, an Indian politician and former diplomat. The 16th Speaker of the Lok Sabha was Indian politician Sumitra Mahajan.", "prediction 1": "The Speaker of the Lok Sabha is the presiding officer of the Lok Sabha (House of the People), the lower house of the Parliament of India. The Speaker is elected generally in the very first meeting of the Lok Sabha following general elections. The current speaker is Sumitra Mahajan, of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha.", "prediction 2": "The Speaker of the Lok Sabha is the presiding officer of the Lok Sabha (House of the People), the lower house of the Parliament of India. The speaker is elected generally in the very first meeting of the Lok Sabha following general elections. The current speaker is Sumitra Mahajan of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha.", "prediction 3": "The Speaker of the Lok Sabha is the presiding officer of the Lok Sabha (House of the People), the lower house of the Parliament of India. The speaker is elected generally in the very first meeting of the Lok Sabha following general elections. The current speaker is Sumitra Mahajan of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha and is the second woman to hold the office, after her immediate predecessor Meira Kumar.", "prediction 4": "The speaker of the Lok Sabha is the presiding officer of the Lok Sabha, the lower house of the Parliament of India. The speaker is elected generally in the very first meeting of the Lok Sabha following general elections. The current speaker is Sumitra Mahajan of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha. The current Speaker is Meira Kumar, an Indian politician and five-time Member of Parliament who was the United Progressive Alliance nominee for President of India in the 2017 election.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 242 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Speaker of the Lok Sabha is the presiding officer of the Lok Sabha (House of the People), the lower house of the Parliament of India. Somnath Chatterjee, an Indian politician who was associated with the Communist Party of India (Marxist) for most of his life, though he had been a non affiliated independent during his last decade, was the Speaker of the 14th Lok Sabha (House of the People). Meira Kumar, an Indian politician, was elected the Speaker of the 15th Lok Sabha. The current speaker is Sumitra Mahajan, of the Bharatiya Janata Party, who is presiding over the 16th Lok Sabha." }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "Who won the womens curling winter olympics 2018?", "passages": [ [ "Anna Hasselborg", "Anna Hasselborg\n\nAnna Ellinor Hasselborg (born 5 May 1989) is a Swedish curler from Stockholm.", "She is the 2018 Olympic Champion in women's curling, and a former World Junior Champion skip.", "Hasselborg made her international debut at the 2008 European Mixed Curling Championship, playing third for Niklas Edin, winning a bronze medal.", "In 2009, Hasselborg played in her first World Juniors, skipping Sweden to a 6th-place finish.", "At the 2010 World Junior Curling Championships, Hasselborg upset the Canadian rink skipped by Rachel Homan in the final by a score of 8-3.", "Hasselborg skipped Sweden at the 2013 Winter Universiade, leading her country to a 5th-place finish.", "Hasselborg has now graduated from the junior level and skips her team on the World Curling Tour.", "She has won three tour events in her career, the 2011 Glynhill Ladies International, the 2016 Oakville OCT Fall Classic, and the 2016 Stockholm Ladies Curling Cup.", "Hasselborg skipped the Swedish national women's team at the 2014 European Curling Championships, leading her team to a 5th-place finish.", "In March 2018, she skipped the Swedish national women's team at the 2018 Ford World Women's Curling Championship, falling to the Canadian team in an extra end to take home the silver medal." ] ], "gold": "Sweden won the gold medal in women's curling in the 2018 Winter Olympics. Anna Hasselborg led the Swedish team that consisted of Jennie Wahlin, Sofia Mabergs, Agnes Knochenhauer and Sara McManus. Hasselborg led her team to a 7-2 round robin record which put them in second place behind the host Korean team. In the playoffs, Sweden knocked off the British team in the semi-final before beating South Korea in the final to win the gold medal for Sweden.", "prediction 1": "Anna Hasselborg is the 2018 Olympic Champion in women's curling, and a former World Junior Champion skip. Hasselborg made her international debut at the 2008 European Mixed Curling Championship, playing third for Niklas Edin, winning a bronze medal. At the 2010 World Junior Curling Championships, Hasselborg upset the Canadian rink skipped by Rachel Homan in the final by a score of 8-3.", "prediction 2": "The 2018 Winter Olympic Champion in women's curling was Anna Hasselborg. Hasselborg, a Swedish curler from Stockholm, is also the 2018 Winter Olympic Champion in women's curling and a former World Junior Champion skip. Rachel Homan of Canada won the women's curling winter olympics, while Rachel Hasselborg of Sweden won the men's.", "prediction 3": "The women's women's curling winter olympics were held on February 8-12, 2018, in Vancouver, Canada, and in Sochi, Russia. The women's curling winter olympics were held on February 9-10, 2018, in Sochi, Russia. The women's curling winter olympics were also held in Vancouver, Canada, on February 14-16, 2018, in Sochi, Russia, and in Sochi, Russia.", "prediction 4": "The women's curling winter olympics were held in Vancouver, British Columbia, Canada on February 17\u201324, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 388 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Swedish Anna Hasselborg is the 2018 Olympic Champion in women's curling, and a former World Junior Champion skip. " }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When was national emergency declared for the first time in india?", "passages": [ [ "State of Emergency in India", "State of Emergency in India\n\nA state of emergency in India refers to a period of governance under an altered constitutional setup that can be proclaimed by the President of India, when he/she perceives grave threats to the nation from internal and external sources or from financial situations of crisis.", "Under the advice of the cabinet of ministers and using the powers vested in him/her largely by Part XVIII of the Constitution of India, the President can overrule many provisions of the constitution, which guarantee fundamental rights to the citizens of India and acts governing devolution of powers to the states which form the federation.", "In the history of independent India, there were three periods during which a state of emergency was need to have existed.", "The phrase \"Emergency period\" used loosely, when referring to the political history of India, often refers to the third and the most controversial of the three occasions.", "The President can declare three types of emergencies:\n\nNational emergency can be declared on the basis of external aggression or armed rebellion in the whole of India or a part of its territory.", "Such an emergency was declared in India in 1962 (China war), 1971 (Pakistan war), and 1975 (declared by Indira Gandhi).", "The President can declare such an emergency only on the basis of a written request by the Cabinet headed by the Prime Minister." ] ], "gold": "A state of emergency India refers to a period of governance under an altered constitutional setup that can be proclaimed by the President of India, when the consultant group perceives and warns against grave threats to the nation from internal and external sources or from financial situations of crisis. The first national emergency was declared on 26 October 1962. This first instance was between 26 October 1962 to 10 January 1968 during the India-China war, when \"the security of India\" was declared as being \"threatened by external aggression\".", "prediction 1": "The first time national emergency was declared in India was on February 26, 1962, during the China war. The Emergency was declared for the first time on February 28, 1975, during the Pak-Pak conflict, and the Emergency was declared on February 26, 1975, during the Emergency Period.", "prediction 2": "National emergency in India refers to a period of governance under an altered constitutional setup that can be proclaimed by the president of India, when he/she perceives grave threats to the nation from internal and external sources or from financial situations of crisis. The first time a state of emergency was declared in India was during the Chinese war in 1962, the Pakistan war in 1971, and the crisis in 1975 in Gujarat was declared for the first time in Gujarat during the 1975 crisis.", "prediction 3": "National emergency was declared for the first time in India in 1962, 1971 and 1975. The President can declare a national emergency on the basis of external aggression or armed rebellion in the whole of India or a part of its territory. During the history of independent India, there were three periods during which a state of emergency was need to have existed.", "prediction 4": "In the history of independent India, there were three periods during which a state of emergency was need to have existed. The President can declare an emergency on the basis of external aggression or armed rebellion in the whole of India or a part of its territory. In the history of India, there were three periods during which such an emergency was need to have existed. In the history of India, there were three periods during which an emergency was need to have existed. In 1962 (China war), 1971 (Pakistan war), and 1975 (declared by Indira Gandhi).", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 104, "end": 171 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "A state of emergency India refers to a period of governance under an altered constitutional setup that can be proclaimed by the President of India, when the consultant group perceives and warns against grave threats to the nation from internal and external sources or from financial situations of crisis. The first time national emergency was declared in India was on February 26, 1962, during the China war and then 1971 (Pakistan war), and 1975." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where is 2022 world cup going to be?", "passages": [ [ "2022 FIFA World Cup", "The issue of migrant workers' rights has also attracted attention, with an investigation by \"The Guardian\" newspaper claiming that many workers are denied food and water, have their identity papers taken away from them, and that they are not paid on time or at all, making some of them in effect slaves.", "\"The Guardian\" has estimated that up to 4,000 workers may die due to lax safety and other causes by the time the competition is held.", "These claims are based upon the fact that 522 Nepalese workers and over 700 Indian workers have died since 2010, when Qatar's bid as World Cup's host was won, about 250 Indian workers dying each year.", "Given that there are half a million Indian workers in Qatar, the Indian government says that is quite a normal number of deaths.", "In the United Kingdom, in any group of half a million 25- to 30-year-old men, an average of 300 die each year, a higher rate than among Indian workers in Qatar.", "In 2015, a crew of four journalists from the BBC were arrested and held for two days after they attempted to report on the condition of workers in the country.", "The reporters had been invited to visit the country as guests of the Government of Qatar." ], [ "2022 FIFA World Cup", "2022 FIFA World Cup\n\nThe 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA.", "It is scheduled to take place in Qatar in 2022.", "This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country.", "This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan (the 2018 competition in Russia featured one geographically Asian venue, Yekaterinburg).", "In addition the tournament will be the last to involve 32 teams, with an increase to 48 teams scheduled for the 2026 tournament.", "The reigning World Cup champions are France.", "This will also mark the first World Cup not to be held in May, June, or July; the tournament is instead scheduled for late November until mid-December.", "It is to be played in a reduced timeframe of around 28 days, with the final being held on 18 December 2022, which is also Qatar National Day.", "Accusations of corruption have been made relating to how Qatar won the right to host the event." ] ], "gold": "The 2022 FIFA World Cup is scheduled to be the 22nd running of the FIFA World Cup competition, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar from 21 November to 18 December 2022. The tournament will specifically be in Lusail, Al Khor, Al Rayyan, Al Wakrah, and Doha and in Lusail Iconic Stadium, Al Bayt Stadium, Education City Stadium, Al Rayyan Stadium, Al Janoub Stadium, Ras Abu Aboud Stadium, Al Thumama Stadium and Khalifa International Stadium.", "prediction 1": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. It will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 2": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 3": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. The 2022 World Cup is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "prediction 4": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. This will be the first World Cup ever to be held in the Arab world and the first in a Muslim-majority country. This will also be the first World Cup held entirely in geographical Asia since the 2002 tournament in South Korea and Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 257, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 368, "end": 490 } ], "missing-info": [], "corrected-prediction": "The 2022 FIFA World Cup is scheduled to be the 22nd edition of the FIFA World Cup, the quadrennial international men's football championship contested by the national teams of the member associations of FIFA. It is scheduled to take place in Qatar in 2022. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Which one is the biggest city in usa?", "passages": [ [ "Sitka, Alaska", "Sitka, Alaska\n\nThe City and Borough of Sitka (), formerly Novo-Arkhangelsk, or New Archangel under Russian rule ( or , \"\"), is a unified city-borough located on Baranof Island and the southern half of Chichagof Island in the Alexander Archipelago of the Pacific Ocean (part of the Alaska Panhandle), in the U.S. state of Alaska.", "As of the 2010 census, it had a population of 8,881.", "In terms of land area, it is the largest city-borough in the U.S., with a land area of and a total area (including water area) of .", "Urban Sitka, the part usually thought of as the \"city\" of Sitka, is on the west side of Baranof Island.", "The current name \"Sitka\" (derived from \"Sheet\u2019k\u00e1\", a contraction of the Tlingit ') means \"People on the Outside of Baranof Island,\" whose Tlingit name is ' (here contracted to \"Shee\").", "Sitka's location was originally settled by the Tlingit people over 10,000 years ago.", "The Russians settled Old Sitka in 1799, calling it Fort Saint Michael (, \"\")." ], [ "New York City", "New York City\n\nThe City of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States.", "With an estimated 2017 population of 8,622,698 distributed over a land area of about , New York City is also the most densely populated major city in the United States.", "Located at the southern tip of the state of New York, the city is the center of the New York metropolitan area, the largest metropolitan area in the world by urban landmass and one of the world's most populous megacities, with an estimated 20,320,876 people in its 2017 Metropolitan Statistical Area and 23,876,155 residents in its Combined Statistical Area.", "A global power city, New York City has been described uniquely as the cultural, financial, and media capital of the world, and exerts a significant impact upon commerce, entertainment, research, technology, education, politics, tourism, art, fashion, and sports.", "The city's fast pace has inspired the term \"New York minute\".", "Home to the headquarters of the United Nations, New York is an important center for international diplomacy.", "Situated on one of the world's largest natural harbors, New York City consists of five boroughs, each of which is a separate county of the State of New York." ], [ "Consolidated city-county", "Consolidated city-county\n\nIn United States local government, a consolidated city-county is a city and county that have been merged into one unified jurisdiction.", "As such it is simultaneously a city, which is a municipal corporation, and a county, which is an administrative division of a state.", "It has the powers and responsibilities of both types of entities.", "A consolidated city-county is different from an independent city, although the latter may result from consolidation of a city and a county and may also have the same powers as a consolidated city-county.", "An independent city is a city not deemed by its state to be located within the boundary of any county and recognized by its state as a legal territorial entity separate from surrounding or adjoining counties.", "A consolidated city-county differs from an independent city in that the city and county both nominally exist, although they have a consolidated government, whereas in an independent city, the county does not even nominally exist.", "Not considering Hawaii, which has no independent cities, the Midwest and Upper South have the highest concentration of large consolidated city-county governments in the United States, including Indianapolis, Indiana; Nashville, Tennessee; Jacksonville, Florida; Louisville, Kentucky; Kansas City, Kansas; and Lexington, Kentucky.", "Currently, the largest consolidated city-county in the United States by population is Philadelphia, Pennsylvania, while the largest by land area is Sitka, Alaska." ] ], "gold": "There are several large cities in the United States of America. With a consolidated land area of 2,870.3 square miles and total area (including water) of 4,811.4 square miles, Sitka, Alaska is the largest city-borough by total area in the U.S. With a 2020 population of 8,804,190 distributed over 302.6 square miles, New York City is also the most densely populated major city in the United States.", "prediction 1": "The United States has a total of 31 largest cities. The largest city by population is New York City. The largest city by land area is Sitka, Alaska.", "prediction 2": "The largest city by population in the United States is New York City, with an estimated population of 8,622,698 in 2017. The largest city by land area is Sitka, Alaska, with a total area of 3,699,776 square miles. The second largest city by population is Philadelphia, Pennsylvania, with an estimated population of 12,789,048 in 2017.", "prediction 3": "The largest city in the United States by population is New York City, followed by Sitka, Alaska. The City of New York, often called New York City (NYC) or simply New York (NY), is the most populous city in the United States. New York City has the most residents in the United States and is also the most densely populated major city in the United States.", "prediction 4": "The largest city in the United States by population is New York City, with a population of 8,622,698 as of 2017. The largest city by land area is Sitka, Alaska.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 51 }, { "error type": "Unverifiable", "explanation": "", "start": 52, "end": 100 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "In terms of land area, Sitka, Alaska, is the largest city-borough in the U.S., with a land area of and a total area (including water area) of 4,811.4 square miles. New York City is also the most densely populated major city in the United States." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When was the first 16 and pregnant aired?", "passages": [ [ "16 and Pregnant", "16 and Pregnant\n\n16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV.", "It followed the stories of pregnant teenage girls in high school dealing with the hardships of teenage pregnancy.", "Each episode featured a different teenage girl, with the episode typically beginning when she is \u00a0\u2013 8 months into her pregnancy.", "The episode typically ends when the baby is a few months old.", "The series is produced in a documentary format, with an animation on notebook paper showing highlights during each episode preceding the commercial breaks.", "\"16 and Pregnant\" has spawned four spin-off series: \"Teen Mom\", \"Teen Mom 2\", \"Teen Mom 3\" and \"\".", "Each series follows the lives of four girls from their respective season of \"16 and Pregnant\" as they navigate their first years of motherhood.", "The fifth season premiered on April 14, 2014.", "Based on a preview of the show's first three episodes, \"The New York Times\" called the series a \"documentary-style series about real-life Junos who are not scoring in the 99th percentile on the verbal portion of their SATs... despite its showcasing of the grim, hard work of single mothering.\"" ] ], "gold": "16 and Pregnant is an American reality television series that aired from June 11, 2009, to July 1, 2014, on MTV. It followed the stories of pregnant teenage girls in high school dealing with the hardships of teenage pregnancy. The first season aired from June 11, 2009 - July 16, 2009.", "prediction 1": "16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV. The series followed the stories of pregnant teenage girls in high school dealing with the hardships of teenage pregnancy. Each episode featured a different teenage girl, with the episode typically beginning when she is \u2013 8 months into her pregnancy. The episode typically ends when the baby is a few months old. The series has spawned four spin-off series: Teen Mom, Teen Mom 2 and Teen Mom 3.", "prediction 2": "16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV. The first season aired on June 7, 2009. The second season aired on June 7, 2012.", "prediction 3": "16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV. The first three seasons of the show aired from June 11, 2009 to July 1, 2014. There were four spin-off seasons and one original series.", "prediction 4": "16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV. The series followed the stories of pregnant teenage girls in high school dealing with the hardships of teenage pregnancy. Each episode featured a different teenage girl, with the episode typically beginning when she is \u2013 8 months into her pregnancy. The episode typically ends when the baby is a few months old. There were four spin-off series that followed the lives of four girls from their respective season of 16 and Pregnant.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 423 }, { "error type": "Irrelevant", "explanation": "", "start": 424, "end": 505 } ], "missing-info": [], "corrected-prediction": "16 and Pregnant is an American reality television series that aired from June 11, 2009 to July 1, 2014, on MTV. The series followed the stories of pregnant teenage girls in high school dealing with the hardships of teenage pregnancy. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When was the first drunk driving law passed?", "passages": [ [ "Impaired driving in Canada", "At the time, the courts interpreted intoxication to mean substantial inebriation, and more than just being under the influence of alcohol.", "The minimum penalty for the first offence was seven days in jail.", "The minimum penalty for the second offence was one month in jail.", "The minimum penalty for a third offence was three months in jail.", "In 1925, Parliament amended the \"Criminal Code\" to include a new offence of driving while intoxicated by a narcotic.", "The offences were also amended to include \"care or control\" of a motor vehicle, not just driving.", "(See below.)", "In 1930, Parliament changed the offence to a hybrid offence, giving the Crown the option to proceed with the more serious indictable offence procedure.", "Difficulties arose regarding how to prove someone was in care or control of a motor vehicle, and what the test should be.", "In 1947, Parliament amended the \"Criminal Code\" again, adding a presumption of care or control when a person was found sitting in the driver's seat of a motor vehicle.", "This did not answer all of the problems regarding the test (i.e. when a person is not found in the driver's seat of a motor vehicle).", "Many of the court's answers to those questions remain in conflict today." ], [ "Drunk driving in the United States", "Drunk driving in the United States\n\nDrunk driving is the act of operating a motor vehicle with the operator's ability to do so impaired as a result of alcohol consumption, or with a blood alcohol level in excess of the legal limit.", "For drivers 21 years or older, driving with a blood alcohol concentration (BAC) of 0.08% or higher is illegal.", "For drivers under 21 years old, the legal limit is lower, with state limits ranging from 0.00 to 0.02.", "Lower BAC limits apply when operating boats, airplanes, or commercial vehicles.", "Among other names, the criminal offense of drunk driving may be called driving under the influence (DUI), driving while intoxicated or impaired (DWI), or operating while impaired (OWI).", "According to the Bureau of Justice Statistics, approximately 1.5 million drunk driving arrests were made nationwide in 1996.", "In 2012, 29.1 million people admitted to driving under the influence of alcohol.", "In 1997 an estimated 513,200 DUI offenders were under correctional supervision, down from 593,000 in 1990 and up from 270,100 in 1986." ], [ "Drunk driving in the United States", "If anyone involved in the accident (even a passenger) has a BAC of 0.01% of greater, then the NTHSA classifies the accident as alcohol-related.", "Alcohol-related injuries were estimated at 275,000 in 2003.", "For the most part, DUI or DWI are synonymous terms that represent the criminal offense of operating (or in some jurisdictions merely being in physical control of) a motor vehicle while being under the influence of alcohol or drugs or a combination of both.", "The key inquiry focuses on whether the driver's faculties were impaired by the substance that was consumed.", "The detection and successful prosecution of drivers impaired by prescription medication or illegal drugs can therefore be difficult.", "Breathalyzers have been developed for the purpose of administering roadside or laboratory tests that can detect the actual level of a controlled substance in an individual's body.", "New Jersey enacted the first law that specifically criminalized driving an automobile while intoxicated, in 1906.", "The New Jersey statute provided that \"[n]o intoxicated person shall drive a motor vehicle.\"", "Violation of this provision was punishable by a fine of up to $500, or a term of up to 60 days in county jail.", "Early laws, such as that enacted in New Jersey, required proof of a state of intoxication with no specific definition of what level of inebriation qualified." ] ], "gold": "Drunk driving is the act of operating a motor vehicle with the operator's ability to do so impaired as a result of alcohol consumption, or with a blood alcohol level in excess of the legal limit. In the United States, the first law that specifically criminalized driving an automobile while intoxicated was established in New Jersey in 1906, with the violation of this provision being punishable by a fine of up to $500, or a term of up to 60 days in county jail. In Canada, parliament first created a summary conviction offence for drinking and driving in 1921, called \"driving while intoxicated,\" which at the time, the courts interpreted to mean substantial inebriation, and more than just being under the influence of alcohol. The minimum penalty for the first offence was seven days in jail, with the second offence being one month in jail, and a third offence was three months in jail.", "prediction 1": "In 1921, Parliament amended the Criminal Code to include a new offence of driving while intoxicated by a narcotic. The offences were also amended to include \"care or control\" of a motor vehicle, not just driving. In 1916, the first law that specifically criminalized driving an automobile while intoxicated was passed in New Jersey. In 1947, Parliament amended the Criminal Code again, adding a presumption of care or control when a person was found sitting in the driver's seat of a motor vehicle.", "prediction 2": "Drunk driving is the act of operating a motor vehicle with the operator's ability to do so impaired as a result of alcohol consumption, or with a blood alcohol level in excess of the legal limit. In New Jersey, the first state to pass a law to criminalize driving while intoxicated was in 1906. In the United States, the first law to criminalize driving while intoxicated was in 1925.", "prediction 3": "Drunk driving is the act of operating a motor vehicle with the operator's ability to do so impaired as a result of alcohol consumption, or with a blood alcohol level in excess of the legal limit. New Jersey enacted the first law that specifically criminalized driving an automobile while intoxicated, in 1906. The law provides that \"[n]o intoxicated person shall drive a motor vehicle.\" Violation of this provision was punishable by a fine of up to $500, or a term of up to 60 days in county jail. New Jersey enacted the first law that specifically criminalized driving an automobile while intoxicated, intoxicated, in 1906.", "prediction 4": "In Canada, the first drunk driving law was passed in 1912. In the United States, the first drunk driving law was passed in 1906 and in New Jersey the first was passed in 1906.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 216, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 212 }, { "error type": "Unverifiable", "explanation": "", "start": 333, "end": 498 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Drunk driving in the United States is the act of operating a motor vehicle with the operator's ability to do so impaired as a result of alcohol consumption, or with a blood alcohol level in excess of the legal limit. In 1906, the first law that specifically criminalized driving an automobile while intoxicated was passed in New Jersey. Violation of this provision was punishable by a fine of up to $500, or a term of up to 60 days in county jail. In Canada the courts interpreted intoxication to mean substantial inebriation, and more than just being under the influence of alcohol. The minimum penalty for the first offence was seven days in jail. The minimum penalty for the second offence was one month in jail and the minimum penalty for a third offence was three months in jail." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who was the first woman to hike the appalachian trail?", "passages": [ [ "Grandma Gatewood", "Grandma Gatewood\n\nEmma Rowena Gatewood, better known as Grandma Gatewood (October\u00a025, 1887\u2013June\u00a04, 1973), was an extreme hiker and ultra-light hiking pioneer who was the first woman to hike the Appalachian Trail from Mount Oglethorpe in Georgia to Mount Katahdin in Maine solo, and in one season.", "Gatewood was born to a farm family of 15 children in Guyan Township, Gallia County, Ohio.", "At the age of 19 she married 27 year-old P. C. Gatewood, a college educated primary school teacher, and later tobacco farmer, with whom she had 11 children.", "She had 24 grandchildren, 30 great-grandchildren, and one great-great-grandchild living at the time of her death at 85.", "Gatewood's husband physically beat her on a regular basis starting from the first weeks of their marriage.", "She recalled being beaten nearly to death on several occasions.", "She suffered broken ribs, broken teeth, and other injuries during the abusive marriage.", "When her husband became violent, she would, on occasion, run from the house into the woods where she found peace and solitude.", "She eventually successfully divorced P. C. Gatewood in 1940; at a time when divorce was more difficult, and after her husband had repeatedly threatened to have her committed to an insane asylum as a means of maintaining control over her." ], [ "Appalachian Trail", "Chester Dziengielewski was later to be named the first south bound thru-hiker.", "In 1998, Shaffer, nearly 80 years old, hiked the trail, making him the oldest person to claim a completed thru-hike.", "The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days.", "She repeated the achievement two years later.", "In the 1960s, the ATC made progress toward protecting the trail from development, thanks to efforts of politicians and officials.", "The National Trails System Act of 1968 designated the Pacific Crest Trail and Appalachian Trail as the first national scenic trails and paved the way for a series of National Scenic Trails within the National Park and National Forest systems.", "Trail volunteers worked with the National Park Service to map a permanent route for the trail, and by 1971 a permanent route had been marked (though minor changes continue to this day).", "By the close of the 20th century, the Park Service had completed the purchase of all but a few miles of the trail's span.", "The International Appalachian Trail is a extension running northeast from Maine into New Brunswick and Quebec's Gasp\u00e9 Peninsula, where it ends at Forillon National Park.", "It is a separate trail and not an official extension of the Appalachian Trail." ], [ "Appalachian Trail", "Appalachian Trail\n\nThe Appalachian National Scenic Trail, generally known as the Appalachian Trail or simply the A.T., is a marked hiking trail in the Eastern United States extending between Springer Mountain in Georgia and Mount Katahdin in Maine.", "The trail is about long, though the exact length changes over time as parts are modified or rerouted.", "The Appalachian Trail Conservancy describes the Appalachian Trail as the longest hiking-only trail in the world.", "More than 2 million people are said to take a hike on part of the trail at least once each year.", "The idea of the Appalachian Trail came about in 1921.", "The trail itself was completed in 1937 after more than a decade of work, although improvements and changes continue.", "It is maintained by 31 trail clubs and multiple partnerships, and managed by the National Park Service, United States Forest Service, and the nonprofit Appalachian Trail Conservancy.", "Most of the trail is in forest or wild lands, although some portions traverse towns, roads and farms.", "It passes through 14 states: Georgia, North Carolina, Tennessee, Virginia, West Virginia, Maryland, Pennsylvania, New Jersey, New York, Connecticut, Massachusetts, Vermont, New Hampshire, and Maine.", "Thru-hikers attempt to hike the trail in its entirety in a single season.", "The number of thru-hikes per year has increased steadily, with 715 northbound and 133 southbound thru-hikes reported for 2017." ] ], "gold": "The Appalachian National Scenic Trail, generally known as the Appalachian Trail or simply the A.T., is a marked hiking trail in the Eastern United States extending between Springer Mountain in Georgia and Mount Katahdin in Maine. The first woman to walk the trail in a single season was American spiritual teacher, mystic, pacifist, vegetarian activist and peace activist Mildred Lisette Norman, also known as Peace Pilgrim, who made this accomplishment in 1952. The first solo woman to complete the hike was 67-year old Emma Rowena Gatewood, also known as Grandma Gatewood, who completed the northbound trek in 1955, taking 146 days. She repeated the achievement two years later, and again in 1963, at age 75.", "prediction 1": "The Appalachian Trail is a marked hiking trail in the Eastern United States extending from Springer Mountain in Georgia to Mount Katahdin in Maine. The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days. She repeated the achievement two years later. The number of thru-hikes per year has increased steadily from 715 northbound in 2017 to the number of 2 million people are said to take a hike on part of the trail at least once each year.", "prediction 2": "The Appalachian Trail, generally known as the Appalachian Trail or simply the A.T., is a marked hiking trail in the Eastern United States extending between Springer Mountain in Georgia and Mount Katahdin in Maine. The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days. She repeated the achievement two years later. The first woman to hike the Appalachian Trail was completed in a single season was Emma Gatewood who completed the northbound hike in 1952, taking 147 days.", "prediction 3": "The Appalachian National Scenic Trail, commonly known as the A.T., is a marked hiking trail in the Eastern United States and runs between Springer Mountain in Georgia and Mount Katahdin in Maine. The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days. She repeated the achievement two years later. In 1998, Shaffer, nearly 80 years old, hiked the Appalachian Trail, making him the oldest person to claim a completed thru-hike.", "prediction 4": "The Appalachian Trail is a hiking trail in the Eastern United States extending between Springer Mountain in Georgia and Mount Katahdin in Maine. The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days. In 1998, Shaffer, nearly 80 years old, hiked the trail, making him the oldest person to claim a completed thru-hiker. The first woman to walk the trail in a single season was Emma Rowena Gatewood, an extreme hiker and ultra-light hiking pioneer who was the first woman to hike the Appalachian Trail from Mount Oglethorpe in Georgia to Mount Katahdin in one season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 412, "end": 600 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Appalachian Trail, generally known as the Appalachian Trail or simply the A.T., is a marked hiking trail in the Eastern United States extending from Springer Mountain in Georgia to Mount Katahdin in Maine. The first woman to walk the trail in a single season was Peace Pilgrim in 1952, while the first solo woman to complete the hike was 67-year old Emma Gatewood who completed the northbound trek in 1955, taking 146 days. She repeated the achievement two years later." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Last president that was not a democrat or republican?", "passages": [ [ "History of the United States Democratic Party", "History of the United States Democratic Party\n\nThe Democratic Party is the oldest voter-based political party in the world and the oldest existing political party in the United States, tracing its heritage back to the anti-Federalists and the Jeffersonian Democratic-Republican Party of the 1790s.", "During the Second Party System (from 1832 to the mid-1850s) under Presidents Andrew Jackson, Martin Van Buren and James K. Polk, the Democrats usually bested the opposition Whig Party by narrow margins.", "Both parties worked hard to build grassroots organizations and maximize the turnout of voters, which often reached 80 percent or 90 percent.", "Both parties used patronage extensively to finance their operations, which included emerging big city political machines as well as national networks of newspapers.", "The party was a proponent for slave-owners across the country, urban workers and caucasian immigrants.", "From 1860 to 1932 in the era of the American Civil War to the Great Depression, the opposing Republican Party, organized in the mid-1850s from the ruins of the Whig Party and some other smaller splinter groups, was dominant in presidential politics.", "The Democrats elected only two Presidents to four terms of office for twenty-two years, namely Grover Cleveland (in 1884 and 1892) and Woodrow Wilson (in 1912 and 1916)." ], [ "United States", "For elective offices at most levels, state-administered primary elections choose the major party nominees for subsequent general elections.", "Since the general election of 1856, the major parties have been the Democratic Party, founded in 1824, and the Republican Party, founded in 1854.", "Since the Civil War, only one third-party presidential candidate\u2014former president Theodore Roosevelt, running as a Progressive in 1912\u2014has won as much as 20% of the popular vote.", "The President and Vice-president are elected through the Electoral College system.", "Within American political culture, the center-right Republican Party is considered \"conservative\" and the center-left Democratic Party is considered \"liberal\".", "The states of the Northeast and West Coast and some of the Great Lakes states, known as \"blue states\", are relatively liberal.", "The \"red states\" of the South and parts of the Great Plains and Rocky Mountains are relatively conservative.", "Republican Donald Trump, the winner of the 2016 presidential election, is serving as the 45th President of the United States.", "Leadership in the Senate includes Republican Vice President Mike Pence, Republican President Pro Tempore Orrin Hatch, Majority Leader Mitch McConnell, and Minority Leader Chuck Schumer.", "Leadership in the House includes Speaker of the House Paul Ryan, Majority Leader Kevin McCarthy, and Minority Leader Nancy Pelosi." ], [ "National Union Party (United States)", "National Union Party (United States)\n\nThe National Union Party was the temporary name used by the Republican Party for the national ticket in the 1864 presidential election which was held during the Civil War.", "For the most part, state Republican parties did not change their name.", "The temporary name was used to attract War Democrats and border states, Unconditional Unionists and Unionist Party members who would not vote for the Republican Party.", "The party nominated incumbent President Abraham Lincoln and for Vice President Democrat Andrew Johnson, who were elected in an electoral landslide.", "The National Union Party was created prior to the General Election of November 1864, when the Civil War was still in progress.", "A faction of anti-Lincoln Radical Republicans held the belief that Lincoln was incompetent and therefore could not be reelected.", "A number of Radical Republicans formed a party called the Radical Democracy Party and a few hundred delegates met in Cleveland starting on May 31, 1864, eventually nominating John C. Fr\u00e9mont, who had also been the Republicans' first presidential standard-bearer during the 1856 presidential election.", "Republicans loyal to Lincoln created a new name for their party in convention at Baltimore, Maryland during the first week in June 1864 in order to accommodate the War Democrats who supported the war and wished to separate themselves from the Copperheads." ] ], "gold": "The United States has operated under a two-party system for most of its history. Since the general election of 1856, the major parties have been the Democratic Party, founded in 1824, and the Republican Party, founded in 1854. The National Union Party was the temporary name used by the Republican Party and elements of other parties for the national ticket in the 1864 presidential election that was held during the Civil War. Andrew Johnson was elected under the National Union Party and was the last president that was not technically a Democrat or a Republican. The Whig Party was a political party active in the middle of the 19th century in the United States. Alongside the slightly larger Democratic Party, it was one of the two major parties in the United States between the late 1830s and the early 1850s as part of the Second Party System. Millard Fillmore was the last president that was elected as a part of the Whig Party.", "prediction 1": "The last president that was not a democrat or republican was Abraham Lincoln, who was elected in an electoral landslide. The last president that was not a democrat or republican was Woodrow Wilson, who served from 1912 to 1916.", "prediction 2": "The last president that was not a democrat or republican was Abraham Lincoln. In the United States, the last president that was not a democrat or republican was Woodrow Wilson. In the United States, the last president that was not a democrat or republican was George Washington.", "prediction 3": "The last president that was not a democrat or republican was Abraham Lincoln. The Republican Party was first founded in 1854 and the Democratic Party was founded in 1824. The National Union Party was the temporary name used by the Republican Party for the national ticket in the 1864 presidential election which was held during the Civil War. For the most part, state Republican parties did not change their name. The temporary name was used to attract War Democrats and border states, Unconditional Unionists and Unionist Party members who would not vote for the Republican Party. The National Union Party was the temporary name used by the Republican Party for the national ticket in the 1864 presidential election which was held during the American Civil War.", "prediction 4": "There were several US presidents who were not a Democrat or Republican. The last one that was not a Democrat or Republican was Theodore Roosevelt, who was elected as a Progressive in 1912. The National Union Party was the temporary name used by the Republican Party for the national ticket in the 1864 presidential election which was held during the Civil War.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 0, "end": 60 }, { "error type": "Redundant", "explanation": "The last president that was not a democrat or republican was Abraham Lincoln, who was elected in an electoral landslide. ", "start": 121, "end": 227 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": " Since the general election of 1856, the major parties have been the Democratic Party, founded in 1824, and the Republican Party, founded in 1854. The National Union Party was the temporary name used by the Republican Party for the national ticket in the 1864 presidential election which was held during the Civil War. Abraham Lincoln, was elected in an electoral landslide. Since the Civil War, only one third-party presidential candidate\u2014former president Theodore Roosevelt, running as a Progressive in 1912\u2014has won." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who has been the biggest winner on jeopardy?", "passages": [ [ "Jeopardy!", "commemorated the 30th anniversary of the Trebek version with a Battle of the Decades tournament, in which 15 champions apiece from the first, second, and third decades of \"Jeopardy!", "\"s daily syndicated history competed for a grand prize of $1,000,000.", "In November 1998, \"Jeopardy!\" traveled to Boston to reassemble 12 past Teen Tournament contestants for a special Teen Reunion Tournament.", "In 2008, the 25th season began with reuniting 15 contestants from the first two Kids Weeks to compete in a special reunion tournament of their own.", "During the next season (2009\u20132010), a special edition of Celebrity \"Jeopardy! \", called the Million Dollar Celebrity Invitational, was played in which twenty-seven contestants from past celebrity episodes competed for a grand prize of $1,000,000 for charity; the grand prize was won by Michael McKean.", "The IBM Challenge aired February 14\u201316, 2011, and featured IBM's Watson computer facing off against Ken Jennings and Brad Rutter in a two-game match played over three shows.", "This was the first man-vs.-machine competition in \"Jeopardy!", "\"s history.", "Watson won both the first game and the overall match to win the grand prize of $1 million, which IBM divided between two charities (World Vision International and World Community Grid)." ], [ "Larissa Kelly", "Kelly is also the second-highest winning female contestant in any single game in \"Jeopardy!", "\"s history.", "Kelly's $45,200 performance narrowly trails Maria Wenglinsky, who won $46,600 on November 1, 2005.", "Kelly returned to participate in the \"Jeopardy!", "Battle of the Decades\" tournament in 2014, but was eliminated in the first round, winning $5,000.", "She is also scheduled to appear in the Jeopardy!", "All Star Games in February 2019, as a member of Team Brad Rutter with David Madden.", "During her time as champion, Kelly set several records which have since been surpassed:" ], [ "Roger Craig (Jeopardy! contestant)", "Roger Craig (Jeopardy! contestant)\n\nRoger Alan Craig (born 1977) is an American game show contestant who held the record for highest single-day winnings on the quiz show \"Jeopardy!", "\", set on September 14, 2010.", "In 2011, he returned to win the \"Jeopardy! Tournament of Champions\".", "In 2014, he competed in the Battle of the Decades tournament, finishing third overall behind Brad Rutter and Ken Jennings.", "Craig, who was 33 years old at the time of his initial \"Jeopardy!\" appearance in 2010, is a native of Ferndale, Pennsylvania.", "He grew up there and later in Virginia, where he graduated from Annandale High School in 1995.", "He holds a first degree in biology and biochemistry from Virginia Polytechnic Institute and State University, and a master's degree and Ph.D in computer science from the University of Delaware.", "He was working on his doctorate at the time of his first appearance on \"Jeopardy! \", and completed the degree later in 2010.", "In his scholarly career, he has published eight papers in the field of bioinformatics, specifically on topics of combinatorial protein synthesis and protein-protein prediction.", "As of November 2011 he was living in Newark, Delaware, and working as a computer scientist.", "He is the founder of Cotinga, a company which performs data analyses and creates learning applications for smartphones." ], [ "Jeopardy! Ultimate Tournament of Champions", "Jeopardy!", "Ultimate Tournament of Champions\n\nThe \"Jeopardy!\"", "Ultimate Tournament of Champions was a special 15-week single-elimination tournament that aired during the 21st season of the syndicated game show \"Jeopardy!\"", "that began airing on February 9, 2005 and concluded on May 25, 2005, covering 76 shows in total.", "The tournament involved 145 contestants, all of whom were winners of past tournaments or past five-time champions, and was designed to produce two contestants who would face off in", "a three-game, cumulative-score final against legendary \"Jeopardy!\" champion Ken Jennings, who had won the most money in \"Jeopardy!\"", "regular play history and who (entering the tournament) had set a new all-time television game show winnings record with US $2,522,700.", "Those three contestants would then play in a three-game final for the largest prize the show has ever offered: an unprecedented grand prize of U.S. $2,000,000.", "After four rounds, the tournament's field of 144 past champions was winnowed to two: Brad Rutter and Jerome Vered.", "Rutter had set the previous all-time \"Jeopardy!\"" ], [ "Jeopardy! audition process", "Jeopardy! audition process\n\nJeopardy! is an American television quiz show created by Merv Griffin, in which contestants are presented with clues in the form of answers, and must phrase their responses in the form of a question.", "Throughout its run, the show has regularly offered auditions for potential contestants, taking place in the Los Angeles area and occasionally in other locations throughout the United States.", "Unlike those of many other game shows, \"Jeopardy!", "\"'s audition process involves passing a difficult test of knowledge on a diversity of subjects, approximating the breadth of material encountered by contestants on the show.", "Since 2006, an online screener test is conducted annually.", "As with all television game shows, there are rules in place for who is allowed to appear as a contestant on \"Jeopardy!\"", "Competitors in the regular episodes must be 18 years of age or older; contestants in the College Championship must be full-time undergraduates without any previous bachelor's degree; competitors in the Teen Tournament must be between the ages of 13 and 17 years; and contestants in the Kids Week must be between the ages of 10 and 12 years.", "Those ineligible to compete on \"Jeopardy!\" include employees of Sony Pictures Entertainment and its subsidiaries (including the show's production company, Sony Pictures Television), distributor CBS Television Distribution, and television stations that broadcast \"Jeopardy!\"" ] ], "gold": "In the American television game show Jeopardy!, professional sports gambler, James Holzhauer, has won the most money in a single game. He won $110,914 during his fourth appearance on the show in April 2019. Although James has won the most in a single game, Brad Rutter is the biggest all-time money winner overall.", "prediction 1": "The record for the biggest winner on Jeopardy! is held by Michael McKean, who won the grand prize of $1,000,000 for charity in the show's 25th season, which was won by Larissa Kelly. The record for the biggest winner on Jeopardy! is held by Roger Craig, who won the tournament on September 14, 2010. The record for the biggest winner in the show's 21st season is held by Ken Jennings, who won the most money in the show's regular play history and who entered the tournament that was designed to produce two contestants who would face off in a three-game, cumulative-score final against legendary \"Jeopardy!\" champion, who had set a new all-time television game show winnings record with US $2,522,700.\n", "prediction 2": "The biggest winner on the game show Jeopardy is Larissa Kelly, who as of November 1, 2022, holds the record for the most money won in the show's two decades of daily syndicated play.", "prediction 3": "There have been several biggest winners on Jeopardy! The biggest winner though was Jeremy Kline, who won the most money in every episode from 1966 to 2009. Additionally, Larissa Kelly won the biggest money in any game in the show's history, with an estimated total of approximately $1 million. In 2010, Roger Craig won the highest single-day-winnings record on the show, setting the record a year later.", "prediction 4": "The biggest winner on Jeopardy is Ken Jennings with a prize of $1,000,000. It was won by Michael McKean on September 14, 2010. The biggest winner in the show's history was Larissa Kelly with a prize of $45,200. The biggest win in the show's history was from American game show contestant/winner Roger Craig who won the largest prize in a single day on September 14, 2010.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 73 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 150 }, { "error type": "Unverifiable", "explanation": "", "start": 151, "end": 182 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 202, "end": 216 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 359 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 702 } ], "missing-info": [], "corrected-prediction": " The record for the highest single-day winnings on Jeopardy! is held by Roger Craig, who won the tournament on September 14, 2010. The record for the biggest winner is held by Ken Jennings, who won the most money in the show's regular play history.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "King arthur legend of the sword arthur's mother?", "passages": [ [ "King Arthur: Legend of the Sword", "King Arthur:", "Legend of the Sword\n\nKing Arthur:", "Legend of the Sword is a 2017 epic fantasy film written and directed by Guy Ritchie and co-written by Joby Harold and Lionel Wigram, inspired by Arthurian legends.", "The film stars Charlie Hunnam as the title character and Jude Law as the tyrannical king Vortigern who is attempting to kill him, with \u00c0strid Berg\u00e8s-Frisbey, Djimon Hounsou, Aidan Gillen, and Eric Bana in supporting roles.", "\"King Arthur\" premiered at the TCL Chinese Theater on 8 May 2017 and was theatrically released in 2D and RealD 3D on 12 May 2017 in the United States and 19 May 2017 in the United Kingdom.", "The film grossed $148\u00a0million worldwide against its $175\u00a0million production budget, with critics \"warning audiences to stay away\".", "Originally, the film was meant to be the first in a six-film franchise, but the planned sequels were cancelled after it underperformed at the box office and lost Warner Bros. and Village Roadshow Pictures over $150 million.", "Mordred, an iron-fisted warlock, and his armies lay siege to Camelot, seeking to establish the dominance of magic-wielding mages over humankind." ], [ "Poppy Delevingne", "Poppy Delevingne\n\nPoppy Angela Delevingne (born 3 May 1986) is an English model and actress.", "Delevingne was born on 3 May 1986, in London, one of three daughters of property developer Charles Hamar Delevingne and Pandora Anne Delevingne (n\u00e9e Stevens).", "She grew up in a Belgravia mansion and attended the independent Bedales School.", "She is the elder sister of model and actress Cara Delevingne.", "Delevingne is a muse and friend of fashion designer Matthew Williamson, and previously shared a New York flat with actress Sienna Miller.", "In October 2012, Delevingne became engaged to James Cook, a former model, who works for his family's aerospace company.", "They were married in May 2014.", "Delevingne's maternal grandfather was publishing executive and English Heritage chairman Sir Jocelyn Stevens, the nephew of magazine publisher Sir Edward George Warris Hulton and the grandson of newspaper proprietor Sir Edward Hulton, 1st Baronet.", "Her maternal grandmother Janie Sheffield, a granddaughter of the 6th Baronet Sheffield, was lady-in-waiting to Princess Margaret.", "Her paternal great-grandfather was the Canadian-born British politician Hamar Greenwood, 1st Viscount Greenwood." ], [ "Igraine", "Igraine\n\nIn the Matter of Britain, Igraine () is the mother of King Arthur.", "She is also known in Latin as Igerna, in Welsh as Eigr (Middle Welsh Eigyr), in French as Ygraine (Old French Ygerne or Igerne), in Thomas Malory's \"Le Morte d'Arthur\" as Ygrayne\u2014 often modernized as Igraine or Igreine\u2014and in Wolfram von Eschenbach's \"Parzival\" as Arnive.", "She becomes the wife of Uther Pendragon, but her first husband was Gorlois; her daughters by Gorlois are Elaine, Morgause and Morgan le Fay.", "In Geoffrey of Monmouth's \"Historia Regum Britanniae\", Igerna enters the story as the wife of Gorlois, Duke of Cornwall.", "King Uther Pendragon falls in love with her and attempts to force his attentions on her at his court.", "She informs her husband, who departs with her to Cornwall without asking leave.", "This sudden departure gives Uther Pendragon an excuse to make war on Gorlois.", "Gorlois conducts the war from the castle of Dimilioc but places his wife in safety in the castle of Tintagel." ] ], "gold": "King Arthur: Legend of the Sword is a 2017 epic fantasy action adventure film directed by Guy Ritchie who co-wrote the film with Joby Harold and Lionel Wigram from a story by Harold and David Dobkin, inspired by Arthurian legends. Poppy Delevingne, an English model, socialite and actress, plays the character of Igraine, King Arthur's mother.", "prediction 1": "In the Matter of Britain, Igraine, or Igraine, is the mother of King Arthur. In the 2017 epic fantasy film King Arthur: Legend of the Sword, Igraine is the wife of King Uther Pendragon.", "prediction 2": "King Arthur: Legend of the Sword is a 2017 epic fantasy film written and directed by Guy Ritchie and co-written by Joby Harold and Lionel Wigram, inspired by Arthurian legends. In the Matter of Britain, Igraine is the mother of King Arthur. She is also known in Latin as Igerna, in Welsh as Eigr, in French as Ygerne or Igerne, in Thomas Malory's \"Le Morte d'Arthur\" as Ygrayne, in Thomas Malory's \"Le Morte d'Arthur\" as Ygrayne, in Thomas Malory's \"Le Morte d'Arthur\" as Ygerne and in Wolfram von Eschenbach's \"Parzival\" as Arnive.", "prediction 3": "King Arthur: Legend of the Sword is a 2017 epic fantasy film written and directed by Guy Ritchie and co-written by Joby Harold and Lionel Wigram, inspired by Arthurian legends. In the Matter of Britain, Igraine is the mother of King Arthur. She is also known in Latin as Igerna, in Welsh as Eigr, in French as Ygraine, in Thomas Malory's \"Le Morte d'Arthur\" as Ygrayne, in Thomas Malory's \"Le Morte d'Arthur\" as Ygraine, in Thomas Malory's \"Le Morte d'Arthur\" as Ygraine, in Wolfram von Eschenbach's \"Parzival\" as Arnive. In Geoffrey of Monmouth's \"Historia Regum Britanniae\", Igern", "prediction 4": "King Arthur: Legend of the Sword is a 2017 epic fantasy film directed by Guy Ritchie and co-written by Joby Harold and Lionel Wigram, inspired by Arthurian legends. In the Matter of Britain, Igraine is the mother of King Arthur. In the story of King Arthur, Igraine is described as the wife of King Uther Pendragon. In the film, she is also known in Latin as Igerna, in Welsh as Eigr, in French as Ygraine, in Thomas Malory's Le Morte d'Arthur as Ygraine, in Thomas Malory's \"Le Morte d'Arthur\" as Ygerne, and in Wolfram von Eschenbach's Parzival as Arnive. In the film, Igraine is played by Poppy Delevingne, and the character's", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 77, "end": 185 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "King Arthur: Legend of the Sword is a 2017 epic fantasy action adventure film directed by Guy Ritchie who co-wrote the film with Joby Harold and Lionel Wigram from a story by Harold and David Dobkin, inspired by Arthurian legends. In the Matter of Britain, Igraine, or Igraine, is the mother of King Arthur. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "The medical procedure for drawing a sample of venous blood into a vacuum tube is known as?", "passages": [ [ "Venipuncture", "Venipuncture\n\nIn medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood.", "In healthcare, this procedure is performed by medical laboratory scientists, medical practitioners, some EMTs, paramedics, phlebotomists, dialysis technicians, and other nursing staff.", "In veterinary medicine, the procedure is performed by veterinarians and veterinary technicians.", "It is essential to follow a standard procedure for the collection of blood specimen to get the accurate laboratory results.", "Any kind of error in collection of blood or filing the test tubes may lead erroneous laboratory results.", "Venipuncture is one of the most routinely performed invasive procedures and is carried out for any of five reasons: \n\nBlood analysis is an important diagnostic tool available to clinicians within healthcare.", "Blood is most commonly obtained from the superficial veins of the upper limb.", "The median cubital vein, which lies within the cubital fossa anterior to the elbow, is close to the surface of the skin without many large nerves positioned nearby.", "Minute quantities of blood may be taken by fingersticks sampling and collected from infants by means of a heel stick or from scalp veins with a winged infusion needle." ], [ "Venipuncture", "Phlebotomy (incision into a vein) is also the treatment of certain diseases such as hemochromatosis and primary and secondary polycythemia.", "There are many ways in which blood can be drawn from a vein.", "The best method varies with the age of the patient, equipment available and tests required.", "Most blood collection in the US, UK, Canada and Hong Kong is done with an evacuated tube system, (two common systems are Vacutainer (Becton, Dickinson and company) and Vacuette (Greiner Bio-One).", "The equipment consists of a plastic adapter, a.k.a. tube or needle holder/ hub, a hypodermic needle and a vacuum tube.", "Under certain circumstances, a syringe may be used, often with a butterfly needle, which is a plastic catheter attached to a short needle.", "In the developing world, the evacuated tube system is the preferred method of drawing blood\n\nGreiner Bio-One manufactured the first ever plastic evacuated blood collection tube in 1985 under the VACUETTE brand name.", "Today, many companies sell vacuum tubes as the patent for this device is now in the public domain.", "These tubes are manufactured with a specific volume of gas removed from the sealed tube." ] ], "gold": "In medicine, venipuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. A sample of venous blood is drawn into a vacuum tube. The more specific name is evacuated blood collection. Blood analysis is an important diagnostic tool available to clinicians within healthcare.", "prediction 1": "In medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. In healthcare, this procedure is performed by medical laboratory scientists, medical practitioners, some EMTs, paramedics, phlebotomists, dialysis technicians, and other nursing staff. In veterinary medicine, the procedure is performed by veterinarians and veterinary technicians.", "prediction 2": "Venipuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. In medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. In healthcare, this procedure is performed by medical laboratory scientists, medical practitioners, some EMTs, paramedics, phlebotomists, dialysis technicians, and other nursing staff. In veterinary medicine, the procedure is performed by veterinarians and veterinary technicians. In veterinary medicine, the procedure is performed by veterinarians and veterinary medicine.", "prediction 3": "In medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. In healthcare, this procedure is performed by medical laboratory scientists, medical practitioners, some EMTs, paramedics, phlebotomists, dialysis technicians, and other nursing staff. In veterinary medicine, the procedure is performed by veterinarians and veterinary technicians. In the developing world, the evacuated tube system is the preferred method of drawing blood. Greiner Bio-One manufactured the first ever plastic evacuated blood collection tube in 1985 under the VACUETTE brand name.", "prediction 4": "In medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. In healthcare, this procedure is performed by medical laboratory scientists, medical practitioners, some EMTs, paramedics, phlebotomists, dialysis technicians, and other nursing staff. In veterinary medicine, the procedure is performed by veterinarians and veterinary technicians. The equipment consists of a plastic adapter, a needle holder/ hub, a hypodermic needle and a vacuum tube.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 351 }, { "error type": "Irrelevant", "explanation": "", "start": 352, "end": 447 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "In medicine, venipuncture or venepuncture is the process of obtaining intravenous access for the purpose of intravenous therapy or for blood sampling of venous blood. Blood analysis is an important diagnostic tool available to clinicians within healthcare." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who won the rugby between sa and england?", "passages": [ [ "History of rugby union matches between England and South Africa", "History of rugby union matches between England and South Africa\n\nThe national rugby union teams of England and South Africa (the Springboks) have been playing each other in Test rugby since 1906, and, by November 2018, had met in 42 Test matches.", "South Africa lead the series by 25 wins to 15, with 2 matches drawn.", "Their first meeting was on 8 December 1906, as part of the Springboks' first tour of Europe, with the match ending in a 3\u20133 draw.", "England won the most recent meeting between the teams, on 3rd November 2018, 12\u201311." ] ], "gold": "The most recent match between South Africa and England was on November 2, 2019, in the 2019 Rugby World Cup Final. South Africa won this match 32 to 12. The national rugby union teams of England and South Africa have been playing each other in Test rugby since 1906. As of November 2019, they have met in 42 Test matches. South Africa leads the series with 25 wins to 15 for England, with 2 matches drawn. Their first meeting was on December 8, 1906, as part of South Africa's first tour of Europe. This match ended in a 3 to 3 draw. ", "prediction 1": "England won the rugby between South Africa and England on 3rd November 2018, 12\u201311. South Africa led the series by 25 wins to 15, with 2 matches drawn. The first meeting was on 8 December 1906, as part of the Springboks' first tour of Europe, with the match ending in a 3\u20133 draw. England won the rugby between the teams on 3rd November 2018, 12\u201311.", "prediction 2": "The national rugby union teams of England and South Africa have been playing each other in Test rugby since 1906. In the most recent meeting between the teams, England won the rugby, on 3rd November 2018, 12\u201311.", "prediction 3": "The national rugby union teams of England and South Africa have been playing each other in Test rugby since 1906, and, by November 2018, had met in 42 Test matches. South Africa lead the series by 25 wins to 15, with 2 matches drawn. England won the most recent meeting between the teams, on 3rd November 2018, 12\u201311.", "prediction 4": "The national rugby union teams of England and South Africa, the Springboks, have been playing each other in Test rugby since 1906. South Africa lead the series by 25 wins to 15, with 2 matches drawn. England won the most recent meeting between the teams, on 3rd November 2018, 12\u201311.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "England won the rugby between South Africa and England on 3rd November 2018, 12\u201311. ", "start": 280, "end": 348 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "History of rugby union matches between England and South Africa The national rugby union teams of England and South Africa (the Springboks) have been playing each other in Test rugby since 1906, and, by November 2018, had met in 42 Test. England won the rugby between South Africa and England on 3rd November 2018, 12\u201311. South Africa led the series by 25 wins to 15, with 2 matches drawn. The first meeting was on 8 December 1906, as part of the Springboks' first tour of Europe, with the match ending in a 3\u20133 draw. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When does the new still game series start?", "passages": [ [ "Still Game", "Still Game\n\nStill Game is a BAFTA award-winning Scottish sitcom, produced by The Comedy Unit with BBC Scotland.", "It was created by Ford Kiernan and Greg Hemphill, who play the lead characters, Jack Jarvis and Victor McDade, two Glaswegian pensioners.", "The characters first appeared in the pair's previous TV sketch show \"Chewin' the Fat\", which aired in Scotland from January 1999 until December 2005.", "Following its debut on 6 September 2002, 56 episodes of \"Still Game\" were aired, including Christmas and Hogmanay specials.", "The first three series were broadcast only on BBC One Scotland, though five episodes selected from the first two series were later broadcast throughout the UK on BBC Two from January - February 2004.", "From the fourth series, \"Still Game\" was broadcast across the UK on BBC Two.", "With the seventh series in 2016, the programme began to be broadcast on BBC One on a nationwide basis.", "An eighth series has been filmed, which started airing on 8 March 2018 on BBC One.", "It was announced on 13 July 2018 that a ninth and final series will be produced later in the year which will see the characters go into \"comedy retirement\".", "The last day of production was on 14 September, 2018, and it is set to air on 24 February 2019, debuting on a new BBC Scotland channel." ] ], "gold": "The Scottish sitcom Still Game ran for nine series from 2002 to 2019. BBC Scotland aired the series 5 premiere on 19 June 2006, the series 6 premiere on 12 July 2007, and the series 7 premiere on 7 October 2016.", "prediction 1": "The new Still Game series starts airing on 8 March 2018 on BBC One. The new Still Game series continues to air on BBC One for the next 8 seasons, which will start airing on 8 March 2019.", "prediction 2": "The new Still Game series began filming on March 18, 2019 and began airing on 8 March 2018. The new Still Game series finished filming on March 8, 2018 and began airing on March 8, 2019. The new Still Game series has a total of 58 episodes and started airing on BBC One.", "prediction 3": "The new Still Game series started airing on 8 March 2018.", "prediction 4": "The new Still Game series starts on 8 March 2018, with the eighteenth series starting on 8 March 2018.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 181, "end": 186 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 67 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "An eighth series has been filmed, which started airing on 8 March 2018 on BBC One. The ninth and final series is set to air on 24 February 2019, debuting on a new BBC Scotland channel." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What is the percentage of agriculture in gdp of india?", "passages": [ [ "Economy of India", "Industry includes various manufacturing sub-sectors.", "India's definition of services sector includes its construction, retail, software, IT, communications, hospitality, infrastructure operations, education, healthcare, banking and insurance, and many other economic activities.", "India ranks second worldwide in farm output.", "Agriculture and allied sectors like forestry, logging and fishing accounted for 17% of the GDP.The sector employed 49% of its total workforce in 2014.", "Agriculture accounted for 23% of GDP, and employed 59% of the country's total workforce in 2016.", "As the Indian economy has diversified and grown, agriculture's contribution to GDP has steadily declined from 1951 to 2011, yet it is still the country's largest employment source and a significant piece of its overall socio-economic development.", "Crop-yield-per-unit-area of all crops has grown since 1950, due to the special emphasis placed on agriculture in the five-year plans and steady improvements in irrigation, technology, application of modern agricultural practices and provision of agricultural credit and subsidies since the Green Revolution in India.", "However, international comparisons reveal the average yield in India is generally 30% to 50% of the highest average yield in the world.", "The states of Uttar Pradesh, Punjab, Haryana, Madhya Pradesh, Andhra Pradesh, Telangana, Bihar, West Bengal, Gujarat and Maharashtra are key contributors to Indian agriculture." ], [ "Agriculture in India", "Agriculture in India\n\nThe history of Agriculture in India dates back to Indus Valley Civilization Era and even before that in some parts of Southern India.", "India ranks second worldwide in farm outputs.", "Agriculture and allied sectors like forestry and fisheries accounted for 15.4% of the GDP (gross domestic product) in 2016 with about 31% of the workforce in 2014.", "India ranks first globally with highest net cropped area followed by US and China.", "The economic contribution of agriculture to India's GDP is steadily declining with the country's broad-based economic growth.", "Still, agriculture is demographically the broadest economic sector and plays a significant role in the overall socio-economic fabric of India.", "India exported $38 billion worth of agricultural products in 2013, making it the seventh largest agricultural exporter worldwide and the sixth largest net exporter.", "Most of its agriculture exports serve developing and least developed nations.", "Indian agricultural/horticultural and processed foods are exported to more than 120 countries, primarily in the Middle East, Southeast Asia, SAARC countries, the EU and the United States." ] ], "gold": "As the Indian economy has diversified and grown, agriculture's contribution to GDP has steadily declined from 1951 to 2011, yet it is still the country's largest employment source and a significant piece of its overall socio-economic development. In 2014,the percentage of agriculture in GDP was 17 percent. In 2016, it rose to 23 percent. In 2017, it fell back down to 15.4 percent.", "prediction 1": "The history of Agriculture in India dates back to Indus Valley Civilization Era and even before that in some parts of Southern India. The contribution of agriculture to India's GDP is steadily declining with the country's broad-based economic growth.", "prediction 2": "Agriculture accounted for 23% of GDP, and employed 59% of the country's total workforce in 2016. The history of Agriculture in India dates back to Indus Valley Civilization Era and even before that in some parts of Southern India. The economic contribution of agriculture to India's GDP is steadily declining with the country's broad-based economic growth.", "prediction 3": "The percentage of agriculture in gross domestic product of India is 23%, which is about the same as the percentage of GDP that is attributed to other sectors. Agriculture is the largest employer in India, and the largest sector by employment. The history of agriculture in India dates back to Indus Valley Civilization Era and even before that in some parts of Southern India.", "prediction 4": "Agriculture's contribution to India's GDP has steadily declined from 1951 to 2011, yet it is still the country's largest employment source and a significant piece of its overall socio-economic development. In 2015, agriculture accounted for 23% of GDP, and employed 59% of the country's total workforce. In 2016, agriculture accounted for 23% of GDP, and employed 59% of the country's total workforce.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 133 }, { "error type": "Irrelevant", "explanation": "", "start": 134, "end": 250 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "As the Indian economy has diversified and grown, agriculture's contribution to GDP has steadily declined from 1951 to 2011, yet it is still the country's largest employment source and a significant piece of its overall socio-economic development. Agriculture and allied sectors like forestry, logging and fishing accounted for 17% of the GDP. Agriculture accounted for 23% of GDP in 2016. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who died in harry potter half blood prince?", "passages": [ [ "Harry Potter and the Half-Blood Prince", "Rowling revealed the title of \"Half-Blood Prince\" on her website on 24 June 2004.", "This was the title she had once considered for the second book, \"Chamber of Secrets\", though she decided that the information disclosed belonged later on in the story, in book six.", "On 21 December 2004, she announced she had finished writing it, along with the release date of 16 July.", "Bloomsbury unveiled the cover on 8 March 2005.", "The record-breaking publication of \"Half-Blood Prince\" was accompanied by controversy.", "In May 2005, bookmakers in the UK suspended bets on which main character would die in the book amid fears of insider knowledge.", "A number of high value bets were made on the death of Albus Dumbledore, many coming from the town of Bungay where, it was believed, the books were being printed at the time.", "Betting was later reopened.", "Additionally, in response to Greenpeace's campaign on using forest friendly paper for big-name authors, Bloomsbury published the book on 30% recycled paper.", "In early July 2005, a Real Canadian Superstore in Coquitlam, British Columbia, Canada, accidentally sold fourteen copies of \"The Half-Blood Prince\" before the authorised release date." ], [ "Harry Potter and the Half-Blood Prince (film)", "Harry Potter and the Half-Blood Prince (film)\n\nHarry Potter and the Half-Blood Prince is a 2009 fantasy film directed by David Yates and distributed by Warner Bros. Pictures.", "It is based on J. K. Rowling's 2005 novel of the same name.", "The film, which is the sixth instalment in the \"Harry Potter\" film series, was written by Steve Kloves and produced by David Heyman and David Barron.", "The story follows Harry Potter's sixth year at Hogwarts as he receives a mysterious textbook, falls in love, and attempts to retrieve a memory that holds the key to Lord Voldemort's downfall.", "The film stars Daniel Radcliffe as Harry Potter, alongside Rupert Grint and Emma Watson as Harry's best friends Ron Weasley and Hermione Granger.", "It is the sequel to \"Harry Potter and the Order of the Phoenix\" and is followed by \"Harry Potter and the Deathly Hallows \u2013 Part 1\".", "Filming began on 24 September 2007, leading to the film's worldwide cinematic release on 15 July 2009, one day short of the fourth anniversary of the corresponding novel's release.", "The film was simultaneously released in regular cinemas and IMAX 3D everywhere except North America, where its IMAX release was delayed for two weeks." ], [ "Harry Potter and the Half-Blood Prince", "Harry Potter and the Half-Blood Prince\n\nHarry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the \"Harry Potter\" series.", "Set during protagonist Harry Potter's sixth year at Hogwarts, the novel explores the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore.", "The book was published in the United Kingdom by Bloomsbury, and in the United States by Scholastic on 16 July 2005, as well as in several other countries.", "It sold nine million copies in the first 24\u00a0hours after its release, a record at the time which was eventually broken by its sequel, \"Harry Potter and the Deathly Hallows\".", "There were many controversies before and after it was published, including the right to read the copies delivered prior to the release date in Canada.", "Reception to the novel was generally positive and it won several awards and honours, including the 2006 British Book of the Year award.", "Reviewers noted that the book took on a darker tone than its previous predecessors, though it did contain some humour.", "Some considered the main themes to be love, death, trust, and redemption.", "The considerable character development of Harry and many other teenage characters also drew attention." ] ], "gold": "Harry Potter and the Half-Blood Prince is both a fantasy novel written by British author J.K. Rowling and a 2009 fantasy film directed by David Yates. One of the main characters, Albus Dumbledore, dies in both the book and the film. There is also an enormous, sentient spider capable of speech, who made a unique clicking noise as he moved named Aragog the Acromantula, who dies.", "prediction 1": "Harry Potter and the Half-Blood Prince is a 2005 fantasy novel written by British author J. K. Rowling. It is the sixth and penultimate novel in the Harry Potter series. Albus Dumbledore dies in the novel, which was published in the United Kingdom by Bloomsbury and in the United States by Scholastic on 16 July 2005. A 2009 fantasy film based on the book was released in the United States on 15 July 2009.", "prediction 2": "Harry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling, and the sixth and penultimate novel in the Harry Potter series. The book explores the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore. In the book, several characters die, including the teacher Albus Dumbledore, who dies in the book.", "prediction 3": "Harry Potter and the Half-Blood Prince is a 2005 fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the Harry Potter series. It was written by Rowling and set during protagonist Harry Potter's sixth year at Hogwarts. In the book, several characters die, including Albus Dumbledore, Ron Weasley, Hermione Granger, and more. In the 2009 film, the death of Ron Weasley is included.", "prediction 4": "Harry Potter and the Half-Blood Prince is a fantasy novel written by British author J. K. Rowling and the sixth and penultimate novel in the Harry Potter series. The novel explores the past of Harry's nemesis, Lord Voldemort, and Harry's preparations for the final battle against Voldemort alongside his headmaster and mentor Albus Dumbledore. In the book, there is a death of Professor Snape, a professor of magical knowledge, and a few deaths of others. However, there is also a number of characters who die in the book. In the 2009, a couple dies. In the film, there is a number of high value bets were made on the death of Albus Dumbledore.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 317 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 406 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Harry Potter and the Half-Blood Prince is a 2005 fantasy novel written by British author J. K. Rowling and a 2009 fantasy film directed by David Yates. It is the sixth and penultimate novel in the Harry Potter series. The character, Albus Dumbledore, dies in the novel." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Major league baseball most wins in a season?", "passages": [ [ "Charles Radbourn", "Charles Radbourn\n\nCharles Gardner Radbourn (December 11, 1854 \u2013 February 5, 1897), nicknamed \"Old Hoss\", was an American professional baseball pitcher who played 12 seasons in Major League Baseball (MLB).", "He played for the Buffalo Bisons (1880), Providence Grays (1881\u20131885), Boston Beaneaters (1886\u20131889), Boston Reds (1890), and Cincinnati Reds (1891).", "In 1884, Radbourn became only the second National League (NL) pitcher to win a Triple Crown; in the process, he broke the single-season wins record, which still stands today.", "Radbourn was inducted into the National Baseball Hall of Fame in 1939.", "Born in New York and raised in Illinois, Radbourn played semi-professional and minor league baseball before making his major league debut for the Buffalo Bisons in 1880.", "After a one-year stint with the club, Radbourn joined the Providence Grays, leading the team to an 1884 World Series championship.", "In 1885, when the team folded, the Grays roster was transferred to NL control, where he was claimed by the Boston Beaneaters.", "Radbourn spent the next four seasons with the club, and finished his MLB career with the Cincinnati Reds after a one-year tenure with the Boston Reds." ], [ "Charles Radbourn", "When he recovered he pitched for a pick-up Bloomington team in an exhibition game against the Providence Grays.", "He impressed everyone so much that Providence signed him on the spot for a salary variously reported as $1,100 or $1,400.", "As a starting pitcher for the Providence Grays (1881\u20131885), Boston Beaneaters (1886\u20131889), Boston Reds (1890), and Cincinnati Reds (1891), Radbourn compiled a 309\u2013194 career record.", "In 1884 he won the National League's pitching Triple Crown with a 1.38 earned run average, 59 wins and 441 strikeouts.", "His 59 wins in a season is a record which is expected never to be broken because no starter has made even as many as 37 starts in a season since Greg Maddux in 1991.", "Also, his innings pitched in 1884 stands at second all-time, behind only Will White (680), for a single-season.", "It, too, is a record that will most likely never be touched.", "It was made possible by the mid-season expulsion of the Grays' other main pitcher, Charlie Sweeney.", "When Providence failed to win the pennant in 1883, the franchise was on shaky financial ground.", "Ownership brought in a new manager, Frank Bancroft, and made it plain: win the pennant or the team would be disbanded." ], [ "Seattle Mariners", "The Mariners won 116 games in , which set the American League record for most wins in a single season and tied the 1906 Chicago Cubs for the Major League record for most wins in a single season.", "Through the end of the 2018 season, the franchise has finished with a losing record in 28 of 42 seasons.", "The Mariners are one of seven Major League Baseball teams who have never won a World Series championship, and one of two (along with the Washington Nationals) never to have played in a World Series.", "With the National Football League's Buffalo Bills ending their 17-year playoff drought on December 31, 2017, the Mariners now hold the longest playoff drought in all of the four major North American professional sports, having not qualified for the playoffs since 2001.", "The Mariners were created as a result of a lawsuit.", "In , in the aftermath of the Seattle Pilots' purchase and relocation to Milwaukee as the Milwaukee Brewers by Bud Selig, the city of Seattle, King County, and the state of Washington (represented by then-state Attorney General and future U.S. Senator Slade Gorton) sued the American League for breach of contract.", "Confident that Major League Baseball would return to Seattle within a few years, King County built the multi-purpose Kingdome, which would become home to the National Football League's expansion Seattle Seahawks in 1976." ] ], "gold": "Charles Gardner Radbourn, also known as Old Hoss Radbourn, is the American pitcher with most wins in Major League Baseball in a season. His 60 wins in a season record is expected never to be broken, since no starter has made even as many as 37 starts in a season since 1991. The team with most wins in a MLB season is the Seattle Mariners, with 116 games in 2001.", "prediction 1": "The most wins in a single season in Major League Baseball history occurs in 1884. The Seattle Mariners won 116 games in 1884, the most wins in a single season in 1885, and the most wins in a single season in 1891. In 1884, Charles Radbourn become only the second National League pitcher to win a Triple Crown, breaking the single-season wins record, which still stands today.", "prediction 2": "The American League holds the record for the most wins in a single season, while the MLB holds the record for most games won in a single season. In 1884, Charles Radbourn became only the second National League pitcher to win a Triple Crown, breaking the single-season wins record, which still stands today. The 1906 Chicago Cubs hold the record for the most wins in a season, while the Seattle Mariners hold the record for most wins in a single season.", "prediction 3": "The American League has the record for most wins in a single season, the National League record is 59 wins, while the Major League record is 61 wins, which is tied to the 1906 Chicago Cubs.", "prediction 4": "In baseball, the highest-ever single-season wins record is 59 wins held by the Chicago Cubs in 1906. The Seattle Mariners held the record for most wins in a single season from 1876 to 1883.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 81 }, { "error type": "Unverifiable", "explanation": "", "start": 117, "end": 125 }, { "error type": "Unverifiable", "explanation": "", "start": 159, "end": 167 }, { "error type": "Redundant", "explanation": "The Seattle Mariners won 116 games in 1884, the most wins in a single season in 1885, and the ", "start": 176, "end": 204 }, { "error type": "Unverifiable", "explanation": "", "start": 205, "end": 213 }, { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 375 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Seattle Mariners won 116 games, which set the American League record for most wins in a single season. It is tied to the 1906 Chicago Cubs for the Major League record for most wins in a single season. Charles Gardner Radbourn, nicknamed \"Old Hoss\", was an American professional baseball pitcher who, with his 59 wins in a season, is a record which is expected never to be broken because no starter has made even as many as 37 starts in a season since 1991." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What nationality is the actress who plays wonder woman?", "passages": [ [ "Olivia Munn", "Olivia Munn\n\nLisa Olivia Munn (born July 3, 1980) is an American actress and model.", "She began her professional career in television journalism before becoming an actress.", "In 2006, Munn starred as Mily Acuna on the series \"Beyond the Break\".", "She co-hosted \"Attack of the Show!\"", "from 2006 to 2010 and was a correspondent on \"The Daily Show\" from 2010 to 2011.", "Munn has also had supporting roles in various films and television series since 2004.", "She played the character Sloan Sabbith on the television series \"The Newsroom\" from 2012 to 2014, and has appeared in the films \"Magic Mike\" (2012), the horror film \"Deliver Us from Evil\" (2014), the comedy \"Mortdecai\" (2014), and \"\" (2016) as Psylocke.", "In 2017, she provided the voice of Koko in \"The Lego Ninjago Movie\", and also had a lead role on the History Channel series \"Six\" (2017).", "Lisa Olivia Munn was born July 3, 1980 in Oklahoma City, Oklahoma.", "Her father, Winston Barrett Munn, is an American of English, Irish and German descent.", "Her mother, Kimberly Schmid, was born and raised in Vietnam and is of Chinese descent.", "Her mother was a Vietnamese refugee who fled to Oklahoma in 1975 after the Vietnam War." ], [ "Lucy Lawless", "Lawless first appeared on Broadway in September 1997 in the \"Grease\" revival, as the \"bad girl\" character, Betty Rizzo.", "She wanted to play the lead role of Sandy, and later stated her belief that the producers typecast her to play \"bad girls\" following her success as Xena.", "She said the Sandy character was very similar to her sheltered childhood, growing up in New Zealand with many protective older brothers.", "From 2005 to 2009, she had a recurring role in the television series \"Battlestar Galactica.\"", "Lawless appeared as D'Anna Biers, a reporter with the Fleet News Service who worked on a critical documentary about the crew of the \"Galactica\" and was later revealed to be a Cylon (Number Three).", "Lawless competed as one of the celebrity singers on the Fox reality TV show \"Celebrity Duets\" in 2006, finishing as the runner-up to winner Alfonso Ribeiro.", "Lawless has also performed as a voice actor in several animated features: In 2008, Lawless voiced the animated character of Diana Prince/Wonder Woman in the direct-to-video superhero animated film, \"\", adapted from the DC Comics limited series.", "In 2014, Lawless voiced the militaristic \"Queen of the Ants\" in the American animated television series \"Adventure Time\" on the Cartoon Network." ], [ "Wonder Woman in other media", "An announcement for an accompanying animated series was made during the 1993 Toy Fair, however a pilot was never produced beyond character designs and storyboards.", "A few test samples for the toy line were developed, as well as a short comic book story which would have been packaged with the figures.", "A mini comic was distributed as a breakfast cereal premium.", "Artwork has since been published in Les Daniels' 2000 book, \"Wonder Woman: The Complete History\".", "The cancelled toy designs were recycled as part of the \"Tenko and the Guardians of the Magic\" toy line.", "All the Star Riders ride winged horses, and Wonder Woman herself rides a winged unicorn named \"Nightshine\".", "\"DC Animated Universe\" (DCAU) refers to the shared universe centered on a group of animated television series based on DC Comics, produced by Warner Bros. Animation from the early 1990s to the mid-2000s; beginning with \"\" in 1992 and ending with \"Justice League Unlimited\" in 2006.", "Some parts of the associated media franchise including direct-to-video feature films and shorts, comic books, video games and other multimedia adaptations are also included in the continuity.", "\"Justice League\" was the first chance to add Wonder Woman (voiced by Susan Eisenberg) to the DCAU, as the rights had been previously tied up in possible movies and television series." ] ], "gold": "The superhero Wonder Woman has been featured in various media from radio to television and film. Both Rosario Dawson, the voice actress for Wonder Woman in the DC Animated Movie Universe 2019 film, Wonder Woman: Bloodlines, and Lynda Carter, the actress who played Wonder Woman in the 1970s TV series, are American. The actress who played Wonder Woman in the 2017 Wonder Woman movie, Gal Gadot, is Israeli.", "prediction 1": "Wonder Woman is a fictional character created by DC Comics and portrayed by various characters in a series of animated television series. The actress who plays Wonder Woman is American. The actress who voices her is American actress and model, Lisa Olivia Munn. The actress who voices Wonder Woman is American of American, British, Irish, and German descent.", "prediction 2": "Wonder Woman is a fictional superhero created by DC Comics and whose role in the DC Extended Universe was voiced by Susan Eisenberg. The American actress is Lisa Olivia Munn, and the Kiwi actress Lucy Lawless is Wonder Woman's voice actor.", "prediction 3": "The actress who plays Wonder Woman is of American nationality. American actress and model Lisa Olivia Munn was born on July 3, 1980 in Oklahoma City, Oklahoma.", "prediction 4": "Wonder Woman is a fictional superhero created by DC Comics and whose powers are enhanced by the help of a group of super heroes called the Justice League. In the 1993 animated series, the character was voiced by Susan Eisenberg. Then, in 2006, American actress and model Lisa Olivia Munn starred as Mily Acuna on the series Beyond the Break. In 2013, American actress Lucy Lawless voiced the character in the 2018 film Wonder Woman.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 138, "end": 185 }, { "error type": "Redundant", "explanation": "Wonder Woman is a fictional character created by DC Comics and portrayed by various characters in a series of animated television series. The actress who plays Wonder Woman is American. ", "start": 186, "end": 261 }, { "error type": "Redundant", "explanation": "Wonder Woman is a fictional character created by DC Comics and portrayed by various characters in a series of animated television series. The actress who plays Wonder Woman is American. ", "start": 262, "end": 358 } ], "missing-info": [], "corrected-prediction": "Wonder Woman is a fictional character created by DC Comics and portrayed by various characters in a series of animated television series. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the ti 84 plus ce come out?", "passages": [ [ "TI-84 Plus series", "The calculator has 154KB of user-accessible RAM and 3.0MB of Archive memory.", "It uses the eZ80 processor from Zilog, making all Z80 assembly programs from previous 84 Plus series calculators incompatible.", "The CE comes in multiple colors, Classic (black), Silver Linings, Radical Red, True Blue, Denim (navy blue), Lightning (light blue), Plum Pi (purple), Positively Pink (as of March 2015), Golden Ratio, and Bright White (as of June, 2016).", "Like the rest of the 84 Plus series, it is allowed on most standardized tests.", "The calculator comes programmed with seven different languages (English, French, German, Portuguese, Spanish, and Swedish).", "In 2016, the TI-84 Plus CE-T was released for the European educational market.", "The only\nsignificant difference from the CE model is the addition of an LED that blinks while the calculator is in Press-to-Test mode.", "There are three different types of programs which can be downloaded or programmed into the calculators: TI-BASIC, Z80 assembly language, and Flash applications (also written in Z80 assembly).", "The TI84+CE is different in that programs are written in TI-BASIC, eZ80 assembly language, or in the C programming language." ], [ "TI-84 Plus series", "TI-84 Plus series\n\nThe TI-84 Plus is a graphing calculator made by Texas Instruments which was released in early 2004.", "There is no original TI-84, only the TI-84 Plus and TI-84 Plus Silver Edition models.", "The TI-84 Plus is an enhanced version of the TI-83 Plus.", "The key-by-key correspondence is relatively the same, but the 84 features some improved hardware.", "The archive (ROM) is about 3 times as large, and CPU about 2.5 times as fast (over the TI-83 and TI-83 Plus).", "A USB port and built-in clock functionality were also added.", "The USB port on the TI-84 Plus series is USB On-The-Go compliant, similar to the next generation TI-Nspire calculator, which supports connecting to USB based data collection devices and probes, and supports device to device transfers over USB rather than over the serial link port..", "In 2015, Texas Instruments released the TI-84 Plus T in the Netherlands.", "This model is very similar to the original TI-84 Plus, but features an LED to indicate whether or not the calculator is in Exam Mode.", "The hardware of the TI-84 Plus T is similar to the TI-84 Plus Silver Edition, with 96 16 kB pages of archive memory, for a total of 1540 kB." ] ], "gold": "The TI-84 Plus CE is a graphing calculator made by Texas Instruments. It was publicly previewed by TI Education in January, 2015. It was released Spring, 2015. ", "prediction 1": "The TI-84 Plus is a graphing calculator made by Texas Instruments which was released in early 2004. There is no original TI-84, only the TI-84 Plus and TI-84 Plus Silver Edition models. In 2015, Texas Instruments released the TI-84 Plus CE in the Netherlands. The TI-84 Plus CE-T was released in the European educational market.", "prediction 2": "The TI-84 Plus is a graphing calculator made by Texas Instruments which was released in early 2004. In 2016, the TI-84 Plus CE-T was released for the European educational market. The only significant difference from the CE model is the addition of an LED that blinks while the calculator is in Press-to-Test mode.", "prediction 3": "The TI-84 Plus is a graphing calculator made by Texas Instruments which was released in early 2004. The TI-84 Plus is an enhanced version of the TI-83 Plus. The TI-84 Plus CE model was released in March 2015 for the American market, and in 2016 for the European educational market. The only significant difference from the CE model is the addition of an LED that blinks while the calculator is in Press-to-Test mode. In 2015, Texas Instruments released the TI-84 Plus T in the Netherlands. This model is very similar to the original TI-84 Plus, but features an LED to indicate whether or not the calculator is in Exam Mode.", "prediction 4": "The TI-84 Plus is a graphing calculator made by Texas Instruments which was released in 2004. In early 2015, the TI-84 Plus CE came out in China. In 2016, the TI-84 Plus CE-T came out in the Netherlands. The only significant difference from the CE model is the addition of an LED that blinks while the calculator is in Press-to-Test mode.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 328 } ], "missing-info": [], "corrected-prediction": "The TI-84 Plus is a graphing calculator made by Texas Instruments which was released in early 2004. In 2015, Texas Instruments released the TI-84 Plus CE in the Netherlands. " }, "preference": [ 2, 1, 2, 1, 0, 2 ] }, { "question": "When did bob dylan wrote knockin on heavens door?", "passages": [ [ "Knockin' on Heaven's Door", "Knockin' on Heaven's Door\n\n\"Knockin' on Heaven's Door\" is a song by Bob Dylan, written for the soundtrack of the 1973 film \"Pat Garrett and Billy the Kid\".", "Released as a single, it reached No. 12 on the \"Billboard\" Hot 100 singles chart.", "Described by Dylan biographer Clinton Heylin as \"an exercise in splendid simplicity\", the song, in terms of the number of other artists who have covered it, is one of Dylan's most popular post-1960s compositions.", "In 1990, the band Guns N' Roses released a cover version to chart success.", "Members of the Western Writers of America chose it as one of the Top 100 Western songs of all time.", "In January 1975 Eric Clapton played on Jamaican singer Arthur Louis' recording of \"Knockin' on Heaven's Door\" arranged in a reggae style.", "Subsequently, Clapton recorded his own reggae-style version of the song which was released in August 1975, two weeks after Louis's version was released as a single in July 1975.", "Clapton's single peaked at No. 38 in the UK Singles Chart.", "The single was less successful in the US, only reaching No. 109 in \"Cash Box\".", "Clapton's 1996 boxed set \"\" features a performance recorded in London in April 1977." ] ], "gold": "\"Knockin' on Heaven's Door\" is a song by Bob Dylan, written for the soundtrack of the 1973 film \"Pat Garrett and Billy the Kid\". Bob Dylan wrote and recorded it in February 1973. It was released on July 13, 1973.", "prediction 1": "Bob Dylan wrote the song Knockin' on Heaven's Door for the soundtrack of the 1973 film Pat Garrett and Billy the Kid. The song was released as a single in 1975 and reached No. 12 on the Billboard Hot 100 singles chart. In 1990, the band Guns N' Roses released a cover version of the song to chart success.\n", "prediction 2": "\"Knockin' on Heaven's Door\", a song by Bob Dylan, was written for the soundtrack of the 1973 film Pat Garrett and Billy the Kid. Released as a single in 1975, it reached No. 12 on the Billboard Hot 100 singles chart.", "prediction 3": "\"Knockin' on Heaven's Door\" is a song by Bob Dylan, written for the soundtrack of the 1973 film \"Pat Garrett and Billy the Kid\". Released as a single, it reached No. 12 on the \"Billboard\" Hot 100 singles chart. In January 1975 Eric Clapton played on Jamaican singer Arthur Louis' recording of \"Knockin' on Heaven's Door\" arranged in a reggae style. Subsequently, Clapton recorded his own reggae-style version of the song which was released in August 1975, two weeks after Louis' version was released as a single in July 1975.", "prediction 4": "Bob Dylan wrote the song Knockin' On Heaven's Door for the soundtrack of the 1973 film Pat Garrett and Billy the Kid.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 152, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 218 } ], "missing-info": [], "corrected-prediction": "Bob Dylan wrote the song Knockin' on Heaven's Door for the soundtrack of the 1973 film Pat Garrett and Billy the Kid. The song was released as a single." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played tibbs in the heat of the night?", "passages": [ [ "Virgil Tibbs", "During a visit to his hometown for the funeral of his mother, the politically opportunistic mayor offers Tibbs the position of Chief of Detectives because of his previous experience with Gillespie.", "Tibbs accepts the position, making him second-in-command to the reluctant Police Chief.", "Although Tibbs and Gillespie have their disagreements about police methods and use of limited local resources, they prove an effective partnership.", "Tibbs' sophisticated detective skills complement Gillespie's intimate knowledge of the area and its population.", "Tibbs is portrayed in the series by Howard Rollins, who garnered critical acclaim for his work in the film \"A Soldier's Story\" and for his Academy Award-nominated performance in the film \"Ragtime\".", "Substance abuse problems led to fewer Rollins' appearances on the series, and he eventually was fired.", "The Tibbs family was written out of the series.", "All novels were written by John Ball." ], [ "Virgil Tibbs", "Virgil Tibbs\n\nVirgil Tibbs is one of the two fictional main characters in John Ball's 1965 novel \"In the Heat of the Night\".", "He is also the protagonist in six sequels to that novel.", "On screen, Tibbs is the protagonist in the Oscar-winning 1967 film \"In the Heat of the Night\" and in its sequels, \"They Call Me Mister Tibbs!\"", "(1970) and \"The Organization\" (1971).", "He is also portrayed in the 1988-1995 television series.", "In the novels, Tibbs works for the police force of Pasadena, California.", "In the films, portrayed by Academy Award winner Sidney Poitier, he first works in Philadelphia, Pennsylvania, but in the sequels, he works for the San Francisco Police.", "The Tibbs films are mentioned in the sequel novels.", "When asked about the movies, Tibbs emphasizes that he's from Pasadena, not Philadelphia.", "He also praises Poitier's looks and acting ability.", "In a short story (see below), the film character meets his literary counterpart.", "In the novels, Tibbs returns to Pasadena as a police officer.", "In the films, Tibbs also returns to his law enforcement career, in Philadelphia and then in San Francisco." ] ], "gold": "Virgil Tibbs, a fictional police detective who later became an attorney, was introduced in John Ball's 1965 novel, In the Heat of the Night. A movie with the same title was adapted from the novel, and then a television series with the same title was adapted from the movie. Sidney Poitier played Tibbs in the Oscar-winning 1967 film In the Heat of the Night and its sequels, They Call Me Mister Tibbs! and The Organization. Actor Howard Rollins played Tibbs in the television series.", "prediction 1": "In the 1965 novel In the Heat of the Night, Virgil Tibbs is played by two different actors. Sidney Poitier plays Virgil Tibbs in the 1967 film and in its sequels, They Call Me Mister Tibbs! (1970) and The Organization (1971). Howard Rollins plays Virgil Tibbs in the 1988-1995 television series.", "prediction 2": "In the 1965 novel In the Heat of the Night, Virgil Tibbs is one of the two fictional main characters. In the 1967 film version, Virgil Tibbs is played by Sidney Poitier. In the 1988-1995 television series, Virgil Tibbs is also portrayed by Howard Rollins.", "prediction 3": "In the 1965 novel In the Heat of the Night, Virgil Tibbs is played by Sidney Poitier. In the 1967 film, Virgil Tibbs is played by director Howard Rollins. In the 1988-1995 television series, Tibbs is played by Howard Rollins. In the 1990 television series, Tibbs is played by Michael Douglas.", "prediction 4": "Virgil Tibbs is one of the two fictional main characters in John Ball's 1965 novel In the Heat of the Night. He's also the protagonist in six sequels to that novel. Tibbs is portrayed in the series by Howard Rollins, who garnered critical acclaim for his work in the film A Soldier's Story and for his Academy Award-nominated performance in the film Ragtime. The film in 1967 was directed by Sidney Poitier, and the television series was aired from 1988 to 1995.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Virgil Tibbs is one of the two fictional main characters in John Ball's 1965 novel \"In the Heat of the Night\". Virgil Tibbs is played by two different actors. Sidney Poitier plays Virgil Tibbs in the 1967 film and in its sequels, They Call Me Mister Tibbs! (1970) and The Organization (1971). Howard Rollins plays Virgil Tibbs in the 1988-1995 television series." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many gun deaths in the united states each year?", "passages": [ [ "Gun violence in the United States", "Gun violence in the United States\n\nGun violence in the United States results in tens of thousands of deaths and injuries annually.", "In 2013, there were 73,505 nonfatal firearm injuries (23.2 injuries per 100,000 persons), and 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons).", "These deaths consisted of 11,208 homicides, 21,175 suicides, 505 deaths due to accidental or negligent discharge of a firearm, and 281 deaths due to firearms use with \"undetermined intent\".", "The ownership and control of guns are among the most widely debated issues in the country.", "In 2012, there were 8,855 total firearm-related homicides in the US, with 6,371 of those attributed to handguns.", "In 2012, 64% of all gun-related deaths in the U.S. were suicides.", "In 2010, there were 19,392 firearm-related suicides, and 11,078 firearm-related homicides in the U.S.", "In 2010, 358 murders were reported involving a rifle while 6,009 were reported involving a handgun; another 1,939 were reported with an unspecified type of firearm.", "Firearms were used to kill 13,286 people in the U.S. in 2015, excluding suicide." ] ], "gold": "Gun violence in the United States results in tens of thousands of deaths and injuries annually, although the exact number varies in different years. In 2013, there were 33,636 deaths due to \"injury by firearms\", equating to 10.6 deaths per 100,000 people. In 2017, gun deaths reached their highest level since 1968 with 39,773 deaths by firearm, equating to 12 per 100,000.", "prediction 1": "In 2013, there were 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons) that resulted in 11,208 homicides, 21,175 suicides, 505 deaths due to accidental or negligent discharge of a firearm, and 281 deaths due to firearms use with \"undetermined intent\". In 2010, there were 19,392 firearm-related suicides, and 11,078 firearm-related homicides in the U.S.", "prediction 2": "Gun violence in the United States results in tens of thousands of deaths and injuries annually. In 2013, there were 73,505 nonfatal firearm injuries (23.2 injuries per 100,000 persons), and 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons).", "prediction 3": "In 2013, there were 73,505 nonfatal firearm injuries (23.2 injuries per 100,000 persons), and 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons). These deaths consisted of 11,208 homicides, 21,175 suicides, 505 deaths due to accidental or negligent discharge of a firearm, and 281 deaths due to firearms use with \"undetermined intent\".", "prediction 4": "In 2013, there were 73,505 nonfatal firearm injuries (23.2 injuries per 100,000 persons) and 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons). These deaths consisted of 11,208 homicides, 21,175 suicides, 505 deaths due to accidental or negligent discharge of a firearm, and 281 deaths due to firearms use with \"undetermined intent\". In 2010, there were 19,392 firearm-related suicides, and 11,078 firearm-related homicides in the US.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": " Gun violence in the United States results in tens of thousands of deaths and injuries annually. In 2013, there were 33,636 deaths due to \"injury by firearms\" (10.6 deaths per 100,000 persons) . In 2010, there were 19,392 firearm-related suicides, and 11,078 firearm-related homicides in the U.S." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where is the due process clause found in the constitution?", "passages": [], "gold": "There are two amendments that deal with the due process clause in the Constitution. The first one is found in the 5th Amendment, and states that no person shall be deprived of life, liberty, or property, without due process of law. The second one, found in the 14th Amendment, states that no State shall deprive any person of life, liberty, or property, without due process of law.", "prediction 1": "The due process clause is found in Article VI, Section 2.2, Paragraph 2 of the Constitution of the United States of America.", "prediction 2": "Where is the due process clause found in the constitution?", "prediction 3": "The Due Process Clause is found in the Constitution.", "prediction 4": "In the Constitution, where is the due process clause found?", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 124 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Who plays ali brother in pretty little liars?", "passages": [ [ "Pretty Little Liars (season 2)", "Annabeth Gish appears as Anne Sullivan, a therapist whom the girls' parents feel can help them on their problems.", "Andrea Parker will play Jessica DiLaurentis, Alison's mother, who returns to Rosewood to help out with a fashion show being held in Alison's honour.", "Actor Drew Van Acker also joined the cast playing Jason DiLaurentis, replacing Parker Bagley." ], [ "Spencer Hastings", "Spencer is one of four primary protagonists in all sixteen of the \"Pretty Little Liars\" novels, starting with 2006's \"Pretty Little Liars\".", "She is portrayed as a competitive girl who strives for perfection in everything she does.", "Spencer is willing to do whatever it takes to win, often to the detriment of herself and others.", "She is known to have a dark side.", "She appears to suffer from rage-induced black outs, which leads her to question whether she had anything to do with the death of her friend Alison, and also shows signs of OCD.", "Spencer also suffers from drug addiction, which she began taking to help her improve her grades at a University of Pennsylvania summer school.", "She is the half-sister of Alison and Courtney DiLaurentis, as her father had an affair with Jessica DiLaurentis around the time of Spencer's conception.", "Spencer has a permanent rivalry with her older sister, Melissa, who is also competitive.", "Throughout the series of books, the two discuss the implications of their individual successes of life, such as becoming the valedictorian of their classes and having winning essays.", "Throughout the story, the sisters make up, and in the later books they share a strong bond.", "Troian Bellisario was cast as Spencer Hastings for the \"Pretty Little Liars\" television series adaptation in November 2009." ], [ "Pretty Little Liars: The Perfectionists", "Pretty Little Liars: The Perfectionists\n\nPretty Little Liars: The Perfectionists is an upcoming American teen drama television series developed by I. Marlene King.", "The series is a sequel to \"Pretty Little Liars\" and based on the novel \"The Perfectionists\" by Sara Shepard.", "Freeform ordered the series to pilot on September 25, 2017, as the second spin-off series of \"Pretty Little Liars\" which will include some of the main characters.", "Freeform picked up the series for a 10-episode first season on May 14, 2018.", "Freeform ordered the show to pilot on September 25, 2017, as a sequel to \"Pretty Little Liars\" and the second spin-off series following \"Ravenswood\".", "On September 25, 2017, it was announced that Sasha Pieterse and Janel Parrish had been cast to reprise their roles from mother series \"Pretty Little Liars\" as Alison DiLaurentis and Mona Vanderwaal, respectively.", "On January 29, 2018, it was announced that Sofia Carson had been cast in the role of Ava, one of the series' protagonists.", "On March 9 several cast members were announced with \"Deadline Hollywood\" announcing that Kelly Rutherford best known for CW's \"Gossip Girl\" will be playing Claire Hotchkiss." ] ], "gold": "In the teen drama TV series Pretty Little Liars, the character Jason DiLaurentis, half brother of Alison DiLaurentis and Spencer and Melissa Hastings, is played by Parker Bagley in season 1 and Drew Van Acker in seasons 2-7.", "prediction 1": "Pretty Little Liars: The Perfectionists is an upcoming American teen drama television series developed by I. Marlene King and based on the 2006 novel Pretty Little Liars. Actor Drew Van Acker joined the cast playing Jason DiLaurentis, replacing Parker Bagley. On September 25, 2017, it was announced that Sasha Pieterse and Janel Parrish had been cast to reprise their roles from mother series Pretty Little Liars as Alison DiLaurentis and Mona Vanderwaal, respectively. On January 29, 2018, it was announced that Sofia Carson had been cast in the role of Ava, one of the series's protagonist. On January 29, 2018, it was announced that Kelly Rutherford will be playing Claire Hotchkiss.", "prediction 2": "Pretty Little Liars: The Perfectionists is an upcoming American teen drama television series created and produced by I. Marlene King and based on the 2006 book Pretty Little Liars. In the TV series, Drew Van Acker plays Jason DiLaurentis. In the film, Jason is played by Amos O'Hara.", "prediction 3": "Pretty Little Liars: The Perfectionists is an upcoming American teen drama television series developed by I. Marlene King. The show is a sequel to Pretty Little Liars and based on the novel The Perfectionists by Sara Shepard. Actor Drew Van Acker joined the cast as Jason DiLaurentis, replacing Parker Bagley. On September 25, 2017, it was announced that Sasha Pieterse and Janel Parrish had been cast to reprise their roles from mother series Pretty Little Liars.", "prediction 4": "Pretty Little Liars: The Perfectionists is an upcoming American teenage drama television series developed by I. Marlene King. Drew Van Acker joined the cast playing Jason DiLaurentis, replacing Parker Bagley. In the original Pretty Little Liars, Andrew J. Cain played the role of the brother Ali. In the original Pretty Little Liars, Alec Baldwin played the role of the brother Ali.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 593 }, { "error type": "Irrelevant", "explanation": "", "start": 594, "end": 687 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 470 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Andrea Parker will play Jessica DiLaurentis, Alison's mother. Actor Drew Van Acker joined the cast playing Jason DiLaurentis, replacing Parker Bagley. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did lebron james join the cleveland cavaliers?", "passages": [ [ "The Decision (TV special)", "The Decision (TV special)\n\n", "The Decision was a television special", "in which National Basketball Association (NBA) player LeBron James announced that he would be signing with the Miami Heat instead of returning to his hometown Cleveland Cavaliers.", "It was broadcast live on ESPN on July 8, 2010.", "James was an unrestricted free agent after playing seven seasons in Cleveland, where he was a two-time NBA Most Valuable Player and a six-time All-Star.", "He grew up in nearby Akron, Ohio, where he received national attention as a high school basketball star.", "James was born and raised in Akron, Ohio, where he received national attention as a high school basketball star at St. Vincent \u2013 St. Mary High School.", "He was drafted out of high school by his hometown Cleveland Cavaliers with the first overall pick of the 2003 NBA draft.", "He played the first seven seasons of his professional career in Cleveland, where he was a two-time NBA Most Valuable Player and a six-time NBA All-Star.", "James became an unrestricted free-agent at 12:01\u00a0am EDT on July 1, 2010.", "He was courted by several teams, including the New York Knicks, Chicago Bulls, New Jersey Nets, Miami Heat, Los Angeles Clippers, and the Cavaliers." ], [ "2010\u201311 Miami Heat season", "Then on July 8, 2010, LeBron James held an hour-long special to announce his decision on ESPN to commit to playing with the Heat.", "Later that evening, the Heat announced the trade of Michael Beasley to the Minnesota Timberwolves for a pair of second round picks and cash considerations.", "The three are called the SuperFriends by many sportswriters and commentators, most notably those for ESPN, because all three were taken in the top five of the 2003 NBA Draft and because they have become good friends over the years.", "On July 8, 2010, it became official that NBA superstars and gold medal winning Beijing Olympic teammates LeBron James, Dwyane Wade, and Chris Bosh would be joining Miami.", "The Heat completed sign-and-trade deals, sending a total of four future first-round and two second-round picks to the Cavaliers and Raptors for James and Bosh (both signing 6 years and $110.1 million contracts).", "Dwyane Wade re-signed with the Heat for $107.59 million for six years.", "All three stars have early termination clauses in their contracts, allowing them to become free agents again in the summer of 2014.", "The final year on all three deals, for 2015\u201316, is a player option." ], [ "LeBron James", "Throughout the year, he was one of the few staples for a Heat roster that used 20 different starting lineups due to injuries, finishing with averages of 27.1 points, 6.9 rebounds, and 6.4 assists per game on 56.7 percent shooting.", "In the second round of the playoffs, he tied a career postseason-high by scoring 49 points in Game 4 against the Brooklyn Nets.", "In the next round, Miami defeated the Pacers to earn their fourth consecutive Finals berth, becoming one of only four teams in NBA history to do so.", "In Game 1 of the Finals, James missed most of the fourth quarter because of leg cramps, helping the Spurs take an early series lead.", "In Game 2, he led the Heat to a series-tying victory with 35 points on a 64 percent shooting rate.", "San Antonio eventually eliminated the Heat in five games, ending Miami's quest for a three-peat.", "For the Finals, James averaged 28.2 points, 7.8 rebounds, and 2.0 steals per game.", "On June 25, 2014, James opted out of his contract with the Heat, and on July 1, he officially became an unrestricted free agent.", "On July 11, he revealed via a first-person essay in \"Sports Illustrated\" that he intended to return to the Cavaliers." ] ], "gold": "LeBron Jamos has played for the Cleveland Cavaliers in different occasions throughout his career. After being heavily touted by the national media as a future NBA superstar during his time as a player for St. Vincent\u2013St. Mary High School in his hometown of Akron, he first joined the Cleveland Cavaliers in 2003 as the first overall draft pick, where he soon established himself as one of the league's premier players. Years later, James became an unrestricted free agent on July 1, 2010 and later announced his decision to sign with the Miami Heat, where he would win his first two NBA Championships. On June 25, 2014, James opted out of his contract with the Heat, once again becoming an unrestricted free agent and officially signing his return to the Cavaliers on July 12 of that same year.", "prediction 1": "LeBron James joined the Cleveland Cavaliers as an unrestricted free agent on July 1, 2010. He was courted by several teams, including the New York Knicks, Chicago Bulls, New Jersey Nets, Miami Heat, Los Angeles Clippers, and the Cleveland Cavaliers. On July 8, 2010, it became official that NBA superstars and gold medal winning Beijing Olympic teammates LeBron James, Dwyane Wade, and Chris Bosh would be joining Miami.", "prediction 2": "LeBron James joined the Cleveland Cavaliers on July 1, 2010, after being drafted out of high school by his hometown Cavaliers. He then held an hour-long special to announce his decision on ESPN to commit to playing with the Miami Heat. Then on July 8, 2010, it became official that NBA superstars and gold medal winning Beijing Olympic teammates LeBron James, Dwyane Wade, and Chris Bosh would be joining Miami.", "prediction 3": "LeBron James joined the Cleveland Cavaliers in 2010 after being signed by the Miami Heat. His signing was announced in a television special on ESPN on July 8, 2010.", "prediction 4": "LeBron James was drafted out of high school by his hometown Cleveland Cavaliers with the first overall pick of the 2003 NBA draft. He played the first seven seasons of his professional career in Cleveland, where he was a two-time NBA Most Valuable Player and a six-time All-Star. On July 1, 2010, it became official that NBA superstars and gold medal winning Beijing Olympic teammates LeBron James, Dwyane Wade, and Chris Bosh would be joining the Miami Heat. On July 8, 2010, it became official that NBA superstars and gold medal winning Beijing Olympic teammates LeBron James would be joining the Miami Heat. On July 1, 2015, James revealed via a first-person essay in Sports Illustrated that he intended to return to his hometown Cleveland Cavaliers. It was broadcast live on ESPN on July 11, 2015, and he revealed via a first-person essay in Sports Illustrated that", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1,4]}", "start": 24, "end": 43 }, { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 369, "end": 396 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6, 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Lebron James grew up in nearby Akron, Ohio, where he received national attention as a high school basketball star, playing at St. Vincent \u2013 St. Mary High School. He was drafted out of high school by his hometown Cleveland Cavaliers with the first overall pick of the 2003 NBA draft. LeBron James joined the Miami Heats as an unrestricted free agent on July 1, 2010. He won two times with the Heats. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where does o brother where art thou take place?", "passages": [ [ "O Brother, Where Art Thou?", "O Brother, Where Art Thou?", "O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, and starring George Clooney, John Turturro, and Tim Blake Nelson, with John Goodman, Holly Hunter, and Charles Durning in supporting roles.", "The film is set in 1937 rural Mississippi during the Great Depression.", "Its story is a modern satire loosely based on Homer's epic poem \"The Odyssey\" that incorporates mythology from the American South.", "The title of the film is a reference to the 1941 film \"Sullivan's Travels\", in which the protagonist is a director who wants to film \"O Brother, Where Art Thou?", "\", a fictional book about the Great Depression.", "Much of the music used in the film is period folk music, including that of Virginia bluegrass singer Ralph Stanley.", "The movie was one of the first to extensively use digital color correction to give the film an autumnal, sepia-tinted look.", "The film received positive reviews, and the soundtrack won a Grammy Award for Album of the Year in 2001 using American folk music.", "The original band became popular after the film release.", "The country and folk musicians who were dubbed into the film included John Hartford, Alison Krauss, Emmylou Harris, Gillian Welch, Chris Sharp, and others." ], [ "O Brother Where Art Thou? (Supernatural)", "O Brother Where Art Thou?", "(Supernatural)\n\n\"O Brother Where Art Thou?\" is the 9th episode and midseason finale of the paranormal drama television series \"Supernatural\"s season 11, and the 227th overall.", "The episode was written by Eugenie Ross-Leming & Brad Buckner and directed by Robert Singer.", "It was first broadcast on December 9, 2015 on The CW.", "In the episode, Sam decides to go with Crowley to Hell to face Lucifer in the Cage for answers about the Darkness while Dean meets with Amara, who is unleashing her power upon the world.", "The episode received positive reviews with critics praising the shocking ending but some noted God's absence.", "Amara (Emily Swallow) kills a group of preachers in a park in an attempt to lure God.", "Sam (Jared Padalecki) is still trying to convince Dean (Jensen Ackles) to return to the Cage, stating that he can know how to kill the Darkness.", "They contact Crowley (Mark A. Sheppard) who may know how to enter.", "He decides to use a spell from the Book of the Damned as a way to neutralize Lucifer from leaving the Cage.", "He captures Rowena (Ruth Connell)", "so she can translate it with their supervision.", "Dean investigates the killings and deduces Amara is responsible.", "While walking through a park, Dean encounters Amara." ], [ "O Brother Where Art Thou? (Supernatural)", "She transports them to an isolated land where they talk and she states that she killed the preachers so God could face her.", "Sam, Crowley and Rowena go through Hell, reaching the Cage point.", "Rowena prepares a ritual and the Cage emerges from the dark, revealing Lucifer (Mark Pellegrino) inside.", "He seems to be an expert about the Darkness and knows how to stop it, but only if Sam accepts to be his vessel again.", "Meanwhile, Dean attempts to kill the Amara with the angel blade onto her but it shatters.", "Amara says he can't resist and they kiss.", "Soon, low-level angels arrive to escort Amara to Heaven for trial, otherwise, the angels in Heaven will unleash a powerful thunder.", "She kills all of them and transports Dean back to the park as the angels release the thunder onto her.", "In Hell, the Cage begins to lose the effect of the spell and Sam is immediately transported to the Cage.", "While Crowley stares in shock and confusion, Rowena tells them they need to leave.", "Lucifer reveals to Sam that he was in fact the one who gave him the visions and all the messages, not God.", "It was just a way to bring him to the Cage as the only way out is being his vessel." ] ], "gold": "The 2000 crime comedy-drama film, O Brother, Where Art Thou?, that was written, produced and co-edited by Joel and Ethan Coen, and starring George Clooney, John Turturro, and Tim Blake Nelson, is set in 1937 rural Mississippi during the Great Depression and is a modern satire loosely based on Homer's epic Greek poem The Odyssey that incorporates social features of the American South. \"O Brother Where Art Thou?\" is also the title of the 9th episode of season 11 of the paranormal drama television series Supernatural, which is first set in a park where character Amara kills a group of preachers in an attempt to lure God and she then transports her and another character, Dean, to an isolated land. The episode ends with multiple characters in hell, talking to Lucifer, who reveals he has been sending messages, not God. There is also an episode of the American animated television series The Simpsons titled \"Oh Brother, Where Art Thou?,\" which is set in Springfield, a fictional mid-sized town in an undetermined state of the United States, whose geography and surroundings are flexible, changing to whatever an episode's plot calls for.", "prediction 1": "O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, with George Clooney, John Turturro, and Tim Blake Nelson, with John Goodman, Holly Hunter, and Charles Durning in supporting roles. The episode O Brother, Where Art Thou? takes place in Hell, and in the midseason finale of the paranormal drama television series Supernatural, it takes place in an isolated land.", "prediction 2": "O Brother Where Art Thou? is a 2000 crime comedy film composed of scenes from the novel O Brother, Where Art Thou? and the film's script. The story takes place in rural Mississippi during the Great Depression. The episode takes place in Hell, a supernatural realm, and is about the journey Sam and Crowley take to face Lucifer.", "prediction 3": "O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, with George Clooney, John Turturro, and Tim Blake Nelson, with John Goodman, Holly Hunter, and Charles Durning in supporting roles. The episode O Brother Where Art Thou? is the 9th episode and midseason finale of the paranormal drama television series Supernatural's season 11, and the 227th overall. In the episode, Sam decides to go with Crowley to face Lucifer in the Cage for answers about the Darkness, while Dean meets with Amara, who is unleashing her power upon the world.", "prediction 4": "O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen. The film is set in 1937 rural Mississippi during the Great Depression. O Brother, Where Art Thou? is also the 9th episode and midseason finale of the paranormal drama television series Supernatural's season 11, and the 227th overall. The episode takes place in Hell, where Sam, Crowley and Rowena go through Hell, reaching the Cage point. There, they find Amara, who is unleashing her power upon the world.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 303, "end": 330 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "O Brother, Where Art Thou? is a 2000 crime comedy film written, produced, and directed by Joel and Ethan Coen, starring George Clooney, John Turturro, and Tim Blake Nelson. The film is set in 1937 rural Mississippi during the Great Depression. Its story is a modern satire loosely based on Homer's epic poem \"The Odyssey\" that incorporates mythology from the American South. The episode O Brother, Where Art Thou? in the paranormal drama television series Supernatural, takes place in Hell, an isolated land, and the park as the angels." }, "preference": [ 1, 2, 2, 2, 2, 0 ] }, { "question": "What teams are in the carolina panthers division?", "passages": [ [ "NFC South", "The Falcons record is 330\u2013432\u20136 with a playoff record of 9\u201313; the Falcons lost in Super Bowls XXXIII and LI, the latter in overtime.", "The Buccaneers record is 241\u2013386\u20131 with a victory in their only Super Bowl appearance, Super Bowl XXXVII, and an overall playoff record of 6\u20139.", "The Panthers have the best playoff record (9\u20138) of any team in the division with losses in Super Bowls XXXVIII and 50 and the best overall record in the division (166\u2013169\u20131).", "The NFC South is the only NFC division not to have any teams that predate the 1960 launch of the American Football League, the NFL\u2019s former rival league.", "The oldest team is the Falcons, who began play in 1966, and the Saints began play only a year later in 1967.", "Each of the other NFC divisions has 3 teams that began play earlier than 1960, while the remaining three such teams are in the American Football Conference.", "The NFC South became the second division in five years to have a champion with a losing record, as the 2014 Carolina Panthers won the division with a 7\u20138\u20131 record.", "(The 2010 Seattle Seahawks won the NFC West with a 7\u20139 record.)", "Additionally, Carolina became the first team to repeat as NFC South champions since the creation of the division." ], [ "NFC South", "NFC South\n\nThe NFC South is a division of the National Football Conference (NFC) in the National Football League (NFL).", "It was created prior to the 2002 NFL season, when the league realigned divisions after expanding to 32 teams.", "The NFC South currently has four member clubs: the Atlanta Falcons, Carolina Panthers, New Orleans Saints, and Tampa Bay Buccaneers.", "Prior to the 2002 season, the Buccaneers belonged to the AFC West () and NFC Central (\u2013), while the other three teams were part of the geographically inaccurate NFC West.", "As a matter of fact, the South has more members of the old NFC West than the current NFC West does (three to the current West\u2019s two).", "The NFC South is the only division since the 2002 realignment to have each of its teams make a conference championship game appearance as well as a Super Bowl appearance: Tampa Bay (2002), Atlanta (2004, 2012, and 2016), Carolina (2003, 2005 and 2015), and New Orleans (2006 and 2009).", "Also since 2002, each team has won at least three division titles, the only such division in the league.", "Entering 2016, the Saints have the most wins among division members.", "The Saints record is 331\u2013418\u20135; their win in Super Bowl XLIV is the highlight of an 8\u20139 playoff record." ], [ "Carolina Panthers", "The television broadcasting team consists of play-by-play commentator Mike Morgan, color analyst and former Panthers player Mike Rucker, and sideline reporter Pete Yanity.", "The network also hosts \"The Panthers Huddle\", a weekly show focusing on the Panthers' upcoming opponent.", "\"Panthers Gameday\", the Panthers' postgame show, is hosted by sports anchor Russ Owens and former Panthers lineman Kevin Donnalley on WCNC-TV.", "The Panthers also offer game broadcasts in Spanish on an eight-station network fronted by WGSP-FM in Pageland, South Carolina, as well as additional radio affiliates in Mexico.", "Jaime Moreno provides the play-by-play while his nephew, Luis Moreno Jr., is the color commentator.", "They have become popular even among English-speaking Panther fans for their high-energy, colorful announcing style.", "The Panthers have developed heated rivalries with the three fellow members of the NFC South (the Atlanta Falcons, Tampa Bay Buccaneers, and New Orleans Saints).", "The team's fiercest rivals are the Falcons and Buccaneers.", "The Falcons are a natural geographic rival for the Panthers, as Atlanta is only 230 miles (370 kilometers) south on I-85." ] ], "gold": "The National Football Conference \u2013 South Division or NFC South is one of the four divisions of the National Football Conference (NFC) in the National Football League (NFL). It was created prior to the 2002 NFL season, when the league realigned divisions after expanding to 32 teams. Along with the Carolina Panthers, the division includes the Atlanta Falcons, New Orleans Saints, and Tampa Bay Buccaneers.", "prediction 1": "The Carolina Panthers are a member of the NFC South, which is a division of the National Football Conference (NFC) in the National Football League (NFL). The division was created prior to the 2002 NFL season, when the league realigned divisions after expanding to 32 teams. The Atlanta Falcons, Tampa Bay Buccaneers, and New Orleans Saints are also members.", "prediction 2": "The Carolina Panthers are part of the NFC South division, which consists of the Atlanta Falcons, Tampa Bay Buccaneers, and New Orleans Saints. The Tampa Bay Buccaneers are also part of the NFC South.", "prediction 3": "The Carolina Panthers are a member team of the NFC South. They are part of the National Football Conference (NFC) and are part of the National Football League (NFL). The Atlanta Falcons and Tampa Bay Buccaneers are also members of the Carolina Panthers division. The Falcons began play in 1966, the Saints began play a year later in 1967. The Buccaneers and Panthers are also members of the NFC South.", "prediction 4": "The Carolina Panthers are a member team of the NFC South, which is a division of the National Football Conference (NFC) in the National Football League (NFL). The Atlanta Falcons, Tampa Bay Buccaneers, and New Orleans Saints are also members of the division.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Carolina Panthers are a member of the NFC South, which is a division of the National Football Conference (NFC) in the National Football League (NFL). The division was created prior to the 2002 NFL season, when the league realigned divisions after expanding to 32 teams. The Atlanta Falcons, Tampa Bay Buccaneers, and New Orleans Saints are also members." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays thomas forrester on bold and the beautiful?", "passages": [ [ "Thomas Forrester", "In 2010, it was announced that Bell had been dropped from the part, and that Adam Gregory was to take over the role.", "In December 2013, following Gregory's decreased screen time and removal from the opening credits, fans began to speculate that Gregory was let go from the series.", "Gregory and a rep for the series confirmed he was dropped to recurring to pursue other acting jobs.", "A rep for the series confirmed, \"Adam is recurring.", "[...]", "And, he has more scenes to tape later this week.\"", "In May 2015, it was confirmed that Gregory was no longer in the role, and a casting call seeking a \"handsome, tall, Caucasian man in his 20s with a great physique\" to play Thomas was released.", "In June 2015, it was announced that Pierson Fod\u00e9 would join the cast in the role of Thomas.", "Fod\u00e9 made his debut on July 27, 2015.", "On September 7, 2017, \"Soap Opera Digest\" announced that Fod\u00e9 would depart the role of Thomas.", "He last appeared on September 13, 2017.", "On the evening of February 16, 2018, it was announced that Fod\u00e9 would reprise his portrayal of Thomas for a short-term storyline; he'll begin making appearances on March 9 until April 5, 2018." ], [ "Genevieve Atkinson", "What I loved about Laura\u2014and what people loved about Laura\u2014is that she is a terrific memory, but it\u2019s just not there anymore.\"", "\"Soap Opera Digest\" later confirmed the character's name to be Genevieve Atkinson.", "Co-head writer of \"The Young and the Restless\", Scott Hamner, stated that the role was going to be a \"very, very different character than we've seen Genie Francis portray\".", "Bell opened up about hiring Francis, revealing: \"Genie is amazing and a real pro.", "I put pen and paper and she ran with it.", "She is really a brave, courageous actress\" and added that \"It really has been fantastic to watch, and I think she is terrific.\"", "Prior to her onscreen debut, Francis appeared on the CBS talk show \"The Talk\" and stated that she \"would not have this job without Oprah Winfrey\", saying: \"I must thank Oprah Winfrey here and now.", "I would not have this job without her.", "She made my dream come true as well.\"", "In August 2011, Francis began experiencing lack of screen-time, leading viewers to speculate she had been let go from the soap opera and possibly returning to her \"General Hospital\" role." ], [ "Thomas Forrester", "Thomas Forrester\n\nThomas Forrester is a fictional character from the CBS Daytime soap opera \"The Bold and the Beautiful\".", "He is portrayed by Pierson Fod\u00e9.", "The character was previously played by Adam Gregory from 2010 to 2014 and Drew Tyler Bell from 2004 to 2010; Bell earned a Daytime Emmy as Outstanding Younger Actor in a Drama Series.", "Thomas is the son of supercouple Ridge Forrester (Ronn Moss, later Thorsten Kaye) and Taylor Hayes (Hunter Tylo).", "He has two twin sisters, Phoebe (MacKenzie Mauzy) and Steffy (Jacqueline MacInnes Wood) and a half-brother, R. J. Forrester (Anthony Turpel) from his father's marriage to Brooke Logan (Katherine Kelly Lang).", "Between 1998 and 2001, the character of Thomas was played by various child actors.", "From January 15, 2002 to August 4, 2003 (on a recurring basis), child actor Patrick Dorn was the first non-twin child actors duo to play Thomas.", "From 2004 to 2005, Drew Tyler Bell began playing Thomas on a contract.", "He shifted to a recurring character from 2005 to 2009, and was on contract from 2009 to 2010.", "He won a Daytime Emmy Award for Outstanding Younger Actor in a Drama Series in 2008." ] ], "gold": "Thomas Forrester is a fictional character from The Bold and the Beautiful, an American soap opera on the CBS network, that has been portrayed by multiple actors as the series progressed. After being played by various child actors, Patrick Dorn went on to play the role in 2002-2003, but the character was then was rapidly aged as Drew Tyler Bell portrayed it in 2004-2010. They were followed by Adam Gregory, who was part of the show in 2010-2014, and Pierson Fod\u00e9, who replaced Gregory and played the character in 2014-2018. On February 11, 2019, it was announced that Matthew Atkinson had been cast in the role, and made his first appearance on the series on March 15, 2019.", "prediction 1": "Thomas Forrester is a fictional character on the CBS Daytime soap opera, Bold and the Beautiful. The character was previously played by Adam Gregory from 2010 to 2014 and Drew Tyler Bell from 2004 to 2010. On February 16, 2018, it was announced that Pierson Fod\u00e9 would reprise his portrayal of Thomas for a short-term storyline.", "prediction 2": "Thomas Forrester is a fictional character from the CBS Daytime soap opera \"The Bold and the Beautiful\". The character was previously played by Adam Gregory from 2010 to 2014 and Drew Tyler Bell from 2004 to 2010. In May 2015, it was confirmed that Gregory was no longer in the role, and a casting call seeking a \"handsome, tall, Caucasian man in his 20s with a great physique\" to play Thomas was released. In June 2015, it was announced that Pierson Fod\u00e9 would join the cast in the role of Thomas was played by Genie Francis. Francis made her debut on July 27, 2015. On September 7, 2017, \"Soap Opera Digest\" announced that Fod\u00e9 would depart the role of Thomas. He last appeared on September 13, 2017.", "prediction 3": "Between 1998 and 2001, the character of Thomas Forrester was played by various child actors. From 2004 to 2005, Drew Tyler Bell began playing Thomas on a contract. From 2005 to 2009, Anthony Turpel played Thomas on a contract. From 2010 to 2013, Adam Gregory played the role. In 2016, Pierson Fod\u00e9 joined the cast in the role of Thomas. Fod\u00e9 made his debut on July 27, 2015. In 2018, Pierson Fod\u00e9 reprised his portrayal of Thomas for a short-term storyline.", "prediction 4": "The character of Thomas Forrester on the CBS Daytime soap opera, The Bold and the Beautiful, is played by Pierson Fod\u00e9. Tom Forrester was played by Adam Gregory from 2010 to 2014, Drew Tyler Bell from 2004 to 2010, and Genevieve Atkinson from 2009 to 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 206, "end": 328 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Thomas Forrester is a fictional character on the CBS Daytime soap opera, Bold and the Beautiful. The character of Thomas was played by various child actors and from 2002 to 2003 on a recurring basis by child actor Patrick Dorn. The character was previously played by Adam Gregory from 2010 to 2014 and Drew Tyler Bell from 2004 to 2010. From 2015 to 2018 Pierson Fod\u00e9 played the role of Thomas." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the first time trinidad and tobago won an olympic medal?", "passages": [ [ "Trinidad and Tobago at the Olympics", "Trinidad and Tobago at the Olympics\n\nTrinidad and Tobago first participated in the Summer Olympic Games in 1948, before they attained their independence from Great Britain.", "Despite being a small nation in the Caribbean, Trinidad and Tobago has been able to place themselves firmly in international sports.", "In 1946, Sir Lennox O\u2019Reilly organized the nation\u2019s first Olympic committee.", "Trinidad and Tobago have participated in sixteen Summer Olympiads and three Winter Olympics (as well as two Summer Paralympics).", "The Games of the XIV Olympiad were held in 1948 in London, United Kingdom.", "This was the first time Trinidad & Tobago was represented in the Olympics.", "The Trinidad & Tobago Olympic Committee sent nine athletes and officials to represent the nation in three disciplines.", "Errol Knowles was the Chef de Mission\n\nThree athletes and one official represented this discipline.", "Trinidad & Tobago did not win any medals in 1948 for this discipline.", "One athlete and one official represented this discipline.", "Trinidad & Tobago did not win any medals in 1948 for this discipline.", "Compton Gonsalves placed 17th in the kilometer time trial with a time of 1 minute and 32 seconds.", "One athlete and one official represented this discipline.", "Rodney Wilkes won the first medal for Trinidad and Tobago lifting 317.5 kilograms in three lifts.", "The Games of the XV Olympiad were held in 1952 in Helsinki, Finland.", "This was the second time Trinidad & Tobago was represented in the Olympics." ], [ "Rodney Wilkes", "Rodney Wilkes\n\nRodney Adolphus Wilkes (11 March 1925 \u2013 24 March 2014) was a weightlifter from Trinidad and Tobago.", "Nicknamed \"The Mighty Midget\" he remained relatively unknown outside of local competition until he won the gold medal at the 1946 Central American and Caribbean Games in Barranquilla, Colombia.", "His performance included record lifts of in the press, in the snatch and in the clean and jerk.", "He was selected to represent his country at the 1948 Olympics in London where he competed in the featherweight division.", "At those Games he became the first athlete from Trinidad and Tobago to win an Olympic medal by taking the silver, behind Egyptian Mahmoud Fayad.", "Wilkes lifted a combined but Fayad set a new Olympic and World record of .", "In 1951 Wilkes won the featherweight gold medal at the first Pan American Games in Buenos Aires.", "The next year he was again selected for the Olympics in Helsinki.", "On this occasion he won the bronze medal behind Rafael Chimishkyan and Nikolai Saksonov, both of the Soviet Union.", "After a brief period of retirement in 1953 Wilkes returned to competition and won gold at the 1954 British Empire and Commonwealth Games in Vancouver; four years later he won bronze at Games in Cardiff.", "Wilkes final Olympic appearance came at the 1956 Melbourne Games.", "He finished in fourth position with a combined lift of , missing out on a medal by one place and 5\u00a0kg." ], [ "Trinidad and Tobago at the 1984 Summer Olympics", "Trinidad and Tobago at the 1984 Summer Olympics\n\nTrinidad and Tobago competed at the 1984 Summer Olympics in Los Angeles, United States.", "Sixteen competitors, eleven men and five women, took part in fourteen events in five sports.", "Men's 100 metres\n\nMen's 400 metres \n\n\n\nMen's 4\u00d7400 metres Relay\n\nWomen's 100 metres\n\nWomen's 200 metres\n\nWomen's 400 metres\n\nWomen's 4\u00d7100 metres Relay\n\nMen's Featherweight\n\nMen's Light-Heavyweight\n\nOne cyclist represented Trinidad and Tobago in 1984.", "Mixed One Person Dinghy\n\nMen's 100m Breaststroke\n\nMen's 200m Breaststroke" ] ], "gold": "The Games of the XIV Olympiad were held in 1948 in London, United Kingdom. This was the first time Trinidad and Tobago was represented in the Olympics. The Trinidad and Tobago Olympic Committee sent nine athletes and officials to represent the nation in three disciplines. Rodney Wilkes won the first medal for Trinidad and Tobago in an Olympic games, winning silver in weightlifting in the men's featherweight division.", "prediction 1": "The first time Trinidad and Tobago won an Olympic medal was the 1948 Summer Olympics in London, United Kingdom. Trinidad and Tobago has participated in sixteen Summer Olympics and three Winter Olympics. The Games of the XIV Olympiad were held in 1948 in London, United Kingdom. This was the first time Trinidad & Tobago was represented in the Olympics. The Games of the XV Olympiad were held in 1952 in Helsinki, Finland. This was the second time Trinidad & Tobago was represented in the Olympics.", "prediction 2": "In 1948, Trinidad & Tobago won a medal in the Summer Olympics in London, England. In 1952, Trinidad & Tobago won a medal in the XV Olympiad, in Helsinki, Finland, and in 1984, in Los Angeles, United States.", "prediction 3": "Trinidad and Tobago first participated in the Summer Olympic Games in 1948, before they attained their independence from Great Britain. The Games of the XIV Olympiad were held in 1948 in London, United Kingdom. This was the first time Trinidad & Tobago was represented in the Olympics. The Games of the XV Olympiad were held in 1952 in Helsinki, Finland. This was the second time Trinidad & Tobago was represented in the Olympics. Trinidad & Tobago competed at the 1984 Summer Olympics in Los Angeles, United States.", "prediction 4": "The first time Trinidad & Tobago won an Olympic medal was at the 1948 Olympics in London. At the Games of the XIV Olympiad, held in 1948 in London, United Kingdom, this was the first time Trinidad & Tobago was represented in the Olympics. The Games of the XV Olympiad, held in 1952 in Helsinki, Finland, was the second time Trinidad & Tobago was represented in the Olympics. The first time Trinidad & Tobago won an Olympic medal was at the 1984 Summer Olympics in Los Angeles, United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 202 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 277 }, { "error type": "Irrelevant", "explanation": "", "start": 278, "end": 352 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 421 }, { "error type": "Irrelevant", "explanation": "", "start": 422, "end": 497 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 14 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The first time Trinidad and Tobago won an Olympic medal was the 1948 Summer Olympics in London, United Kingdom. The Trinidad & Tobago Olympic Committee sent nine athletes and officials to represent the nation in three disciplines. Rodney Wilkes won the first medal for Trinidad and Tobago in an Olympic game, winning silver in weightlifting in the men's featherweight division. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did they get rid of figures in figure skating?", "passages": [ [ "Compulsory figures", "Loosemore attributed the decrease in the importance of figures to a \"lack of public accountability\" from the judges of international competitions and other discrepancies in judging, which Loosemore called \"dirty judging\".", "Loosemore also speculated that \"the relative scarcity of rinks and practice ice for figures in Europe as compared to North America\" ultimately made the difference in the removal of figures from competitions.", "Kestnbaum agreed, stating that the elimination of figures was motivated by finances, with countries with an affluent middle class or government-supported training for athletes having more of a competitive advantage over less affluent and smaller countries with fewer ice rinks and resources to spend the time necessary to train for proficiency in figures.", "By the late 1970s and into the 1980s, there were discussions about eliminating them from international competitions.", "In 1988, the ISU voted to remove compulsory figures from international single skating competitions, for both men and women, starting in the 1990\u20131991 season.", "Of 31 voting national associations, only the U.S., Canada, Britain, and New Zealand voted against the decision.", "The last two seasons compulsory figures were competed at an international competition were in 1989 and 1990; only two figures were skated and they were worth only 20 percent of the competitors' overall scores.", "Compulsory figures has not been a part of all international and most national competitions since 1990." ], [ "Compulsory figures", "Compulsory figures\n\nCompulsory figures or school figures were formerly a segment of the sport of figure skating, from which the sport derives its name.", "They are the \"circular patterns which skaters trace on the ice to demonstrate skill in placing clean turns evenly on round circles\".", "Until 1947, for approximately the first fifty years of the existence of figure skating as a sport, compulsory figures made up 60 percent of the total score at most competitions around the world.", "These figures continued to dominate the sport, although they steadily declined in importance, until the International Skating Union (ISU) voted to discontinue them as a part of competitions in 1990.", "Learning and training in compulsory figures instilled discipline and control; some in the figure skating community considered them necessary to teach skaters basic skills.", "Skaters would train for hours to learn and execute them well, and competing and judging figures would often take up to eight hours during competitions.", "Skaters traced compulsory figures, and were judged according to their smoothness and accuracy.", "The circle was the basis of all figures, and increased in difficulty.", "Other elements in compulsory figures included curves, change of foot, change of edge, and turns.", "Skaters had to trace precise circles while completing difficult turns and edges.", "The simple \"figure eight\" shape was executed by connecting two circles; other figures included the three turn, the counter turn, the rocker turn, the bracket turn, and the loop." ] ], "gold": "Compulsory figures in figure skating, which once made up 60 percent of a skater's competitive score, began to decline in importance in 1947 until they were discontinued by the International Skating Union in 1990. The last compulsory figure ever skated in an international competition was completed by Yugoslavian skater \u017deljka \u010ci\u017eme\u0161ija on March 7, 1990 at the World Championships in Halifax, Nova Scotia.", "prediction 1": "Compulsory figures, also known as school figures, were formerly a segment of the sport of figure skating, from which the sport derives its name. In 1988, the International Skating Union voted to remove compulsory figures from international single skating competitions, for both men and women, starting in the 1990\u20131991 season. The last two seasons compulsory figures were competed at an international competition were in 1989 and 1990; only two figures were skated and they were worth only 20 percent of the competitors' overall scores.", "prediction 2": "Compulsory figures or school figures were formerly a segment of the sport of figure skating, from which the sport derives its name. By the late 1970s and into the 1980s, there were discussions about eliminating them from international competitions. In 1988, the International Skating Union voted to remove compulsory figures from international single skating competitions, for both men and women, starting in the 1990\u20131991. The last two seasons compulsory figures were competed at an international competition were in 1989 and 1990; only two figures were skated and they were worth only 20 percent of the competitors' overall scores.", "prediction 3": "Compulsory figures were formerly a segment of the sport of figure skating, from which the sport derives its name. By the late 1970s and into the 1980s, there were discussions about eliminating them from international competitions. In 1988, the ISU voted to remove compulsory figures from international single skating competitions, for both men and women, starting in the 1990\u20131991 season. Only two figures were skated and they were worth only 20 percent of the competitors' overall scores.", "prediction 4": "Compulsory figures were the circular patterns which skaters trace on the ice to demonstrate skill in placing clean turns evenly on round circles. Until 1947, for approximately the first fifty years of the existence of figure skating as a sport, compulsory figures made up 60 percent of the total score at most competitions around the world. The International Skating Union (ISU) voted to discontinue them as a part of competitions in 1990.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 144 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 536 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Until 1947, for approximately the first fifty years of the existence of figure skating as a sport, compulsory figures made up 60 percent of the total score at most competitions around the world. These figures continued to dominate the sport, although they steadily declined in importance, until the International Skating Union (ISU) voted to discontinue them as a part of competitions in 1990. In 1988, the International Skating Union voted to remove compulsory figures from international single skating competitions, for both men and women, starting in the 1990\u20131991 season. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did the us drop the atomic bomb on hiroshima?", "passages": [ [ "Hiroshima Peace Memorial", "Hiroshima Peace Memorial\n\nThe , originally the Hiroshima Prefectural Industrial Promotion Hall, and now commonly called the Genbaku Dome, , is part of the Hiroshima Peace Memorial Park in Hiroshima, Japan and was designated a UNESCO World Heritage Site in 1996.", "The ruin of the hall serves as a memorial to the people who were killed in the atomic bombing of Hiroshima on 6 August 1945.", "Over 70,000 people were killed instantly, and another 70,000 suffered fatal injuries from the radiation.", "The Product Exhibition Hall building was originally designed by the Czech architect Jan Letzel.", "The design included a distinctive dome at the highest part of the building.", "It was completed in April 1915 and was named the \"Hiroshima Prefectural Commercial Exhibition\" (HMI).", "It was formally opened to the public in August that year.", "In 1921, the name was changed to the \"Hiroshima Prefectural Products Exhibition Hall\", and again, in 1933, to the \"Hiroshima Prefectural Industrial Promotion Hall\".", "The building was located in the large business district next to the Aioi Bridge and was primarily used for arts and educational exhibitions.", "At 8:15\u00a0a.m. on 6 August 1945, the first atomic bomb to be used in war was dropped by the United States Army Air Forces from the \"Enola Gay\", a B-29 bomber.", "The force of the atomic bomb effectively obliterated the city of Hiroshima, Japan." ], [ "Atomic bombings of Hiroshima and Nagasaki", "The release at 08:15 (Hiroshima time) went as planned, and the Little Boy containing about of uranium-235 took 44.4 seconds to fall from the aircraft flying at about to a detonation height of about above the city.", "\"Enola Gay\" traveled before it felt the shock waves from the blast.", "Due to crosswind, the bomb missed the aiming point, the Aioi Bridge, by approximately and detonated directly over Shima Surgical Clinic.", "It released the equivalent energy of , \u00b1 2\u00a0kt.", "The weapon was considered very inefficient, with only 1.7% of its material fissioning.", "The radius of total destruction was about , with resulting fires across .", "\"Enola Gay\" stayed over the target area for two minutes and was ten miles away when the bomb detonated.", "Only Tibbets, Parsons, and Ferebee knew of the nature of the weapon; the others on the bomber were only told to expect a blinding flash and given black goggles.", "\"It was hard to believe what we saw\", Tibbets told reporters, while Parsons said \"the whole thing was tremendous and awe-inspiring ... the men aboard with me gasped 'My God'\".", "He and Tibbets compared the shockwave to \"a close burst of ack-ack fire\"." ] ], "gold": "The date of the US dropping the atomic bomb on the city of Hiroshima was August 6, 1945, while the time of it was 08:15 (Hiroshima time).", "prediction 1": "At 8:15 a.m. on 6 August 1945, the first atomic bomb to be used in war was dropped by the United States Army Air Forces from the \"Enola Gay\", a B-29 bomber. The force of the atomic bomb effectively obliterated the city of Hiroshima, Japan.\n", "prediction 2": "US dropped the first atomic bomb on Hiroshima, Japan, at 8:15 a.m., on August 6, 1945. At the time, the bomb went off about ten miles away from the target.", "prediction 3": "At 8:15 a.m. on 6 August 1945, the first atomic bomb to be used in war was dropped by the United States Army Air Forces from the B-29 bomber Enola Gay. The bomb contained about of uranium-235 and took 44.4 seconds to fall from the aircraft flying at about to a detonation height of about above the city.", "prediction 4": "The bomb was dropped on Hiroshima from HMI building at 8:15 a.m on 6 August 1945 by the United States Army Air Forces from the B-29 bomber Enola Gay.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 156 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 240 }, { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 40 }, { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 70 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "At 8:15 a.m. (Hiroshima time), 6 August 1945, the atomic bomb was dropped by the United States onto the city of Hiroshima. " }, "preference": [ 0, 1, 1, 0, 0, 0 ] }, { "question": "He connection between a tooth and jaw bone is an example of a joint?", "passages": [ [ "Fibrous joint", "A grade III injury is a complete anteroinferior tibiofibular ligament tear including a (partial) interosseous ligament tear and deltoid ligament avulsion, meaning the joint is unstable and positive on the exorotation and squeeze tests.", "This grade requires operative stabilization.", "If the syndesmosis is torn apart as result of bone fracture, surgeons will sometimes fix the relevant bones together with a syndesmotic screw, temporarily replacing the syndesmosis, or with a tightrope fixation, which is called Syndesmosis Procedure.", "The screw inhibits normal movement of the bones and, thereby, the corresponding joint(s).", "When the natural articulation is healed, the screw may be removed.", "The tightrope fixation with elastic fiberwire suture on the other hand allows physiologic motion of the ankle and may be permanent.", "A gomphosis, also known as a dentoalveolar syndesmosis, is a joint that binds the teeth to bony teeth sockets in the maxillary bone and mandible.", "The fibrous connection between a tooth and its socket is a periodontal ligament.", "Specifically, the connection is made between the maxilla or mandible to the cementum of the tooth." ] ], "gold": "The connection between a tooth and jaw bone is an example of a gomphosis. A gomphosis, also known as a dentoalveolar syndesmosis, is a joint that binds the teeth to bony teeth sockets in the maxillary bone and mandible. The fibrous connection between a tooth and its socket is a periodontal ligament. ", "prediction 1": "The fibrous connection between a tooth and its socket is a periodontal ligament. The connection is made between the maxilla or mandible to the cementum of the tooth.\n", "prediction 2": "The fibrous connection between a tooth and its socket is a periodontal ligament. Specifically, the connection is made between the maxilla or mandible to the cementum of the tooth.", "prediction 3": "The fibrous connection between a tooth and its socket is a periodontal ligament. The syndesmosis, or tooth-jaw connection, binds the teeth to bony teeth sockets in the maxillary bone and mandible by connecting them to the periodontal ligament.", "prediction 4": "The fibrous connection between a tooth and its socket is a periodontal ligament. The syndesmosis holds the teeth to bony teeth sockets in the maxillary bone and mandible.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 166 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The fibrous connection between a tooth and its socket is a periodontal ligament. A gomphosis, also known as a dentoalveolar syndesmosis, is a joint that binds the teeth to bony teeth sockets in the maxillary bone and mandible." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What is the big letter at the beginning of a paragraph called?", "passages": [ [ "Historiated initial", "Historiated initial\n\nA historiated initial is an initial, an enlarged letter at the beginning of a paragraph or other section of text, that contains a picture.", "Strictly speaking, a historiated initial depicts an identifiable figure or a specific scene, while an inhabited initial contains figures (human or animal) that are decorative only, without forming a subject.", "Both sorts became very common and elaborate in luxury illuminated manuscripts.", "These illustrated initials were first seen in the Insular art of the early 8th century.", "The earliest known example is in the Saint Petersburg Bede, an Insular manuscript of 731-46, and the Vespasian Psalter has another.", "The size and decoration of the initial further gives clues to both its importance and location.", "Letters that began a new section of a text or a particularly noteworthy section might receive more flourishes and space.", "In luxury manuscripts an entire page might be devoted to a historiated initial.", "Both the size and the ostentatiousness of a manuscript reflect both on the status of the manuscript and on its owner.", "Manuscripts meant for everyday use, typically by friars or university students, often had little illumination, and hardly any elaborate historiated initials or flourishes.", "Manuscripts commissioned by wealthy patrons or for a wealthy monastery were often illuminated, and in gold or silver rather than pen and ink." ], [ "Initial", "Alternatively, the initial may be in the left margin, with the text indented, as shown here.", "In word processors and HTML, this may be implemented using a table with two cells, one for the initial and one for the rest of the text.", "The difference between this and a true drop cap may be seen when the text extends below the initial.", "For example:\n\nWith a drop cap, the initial sits within the margins and runs several lines deep into the paragraph, indenting some normal-sized text in these lines.", "This keeps the left and top margins of the paragraph flush.", "In modern computer browsers, this may be achieved with a combination of HTML and CSS by using the float: left; setting.", "A CSS-only solution alternatively can use the :first-letter pseudo-element.", "An example of this format is the following paragraph:\norem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.", "Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat." ], [ "Initial", "Initial\n\nIn a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text.", "The word is derived from the Latin \"initialis\", which means \"standing at the beginning\".", "An initial is often several lines in height and in older books or manuscripts, sometimes ornately decorated.", "In illuminated manuscripts, initials with images inside them, such as those illustrated here, are known as historiated initials.", "They were an invention of the Insular art of the British Isles in the eighth century.", "Initials containing, typically, plant-form spirals with small figures of animals or humans that do not represent a specific person or scene are known as \"inhabited\" initials.", "Certain important initials, such as the Beatus initial or \"B\" of \"Beatus vir...\" at the opening of Psalm 1 at the start of a vulgate Latin psalter, could occupy a whole page of a manuscript.", "These specific initials, in an illuminated manuscript, also were called Initiums.", "The classical tradition was slow to use capital letters for initials at all; in surviving Roman texts it often is difficult even to separate the words as spacing was not used either." ] ], "gold": "A historiated initial is an initial, an enlarged letter at the beginning of a paragraph or other section of text, that contains a picture. Strictly speaking, a historiated initial depicts an identifiable figure or a specific scene, while an inhabited initial contains figures that are decorative only, without forming a subject. In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text and is often several lines in height and in older books or manuscripts are known as \"inhabited\" initials. A rubricated initial is an initial in red ink, to provide emphasis, at the beginning of a paragraph in medieval text.", "prediction 1": "In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text. The big letter at the beginning of a paragraph is called a historiated initial. An illustrated historiated initial depicts an identifiable figure or a specific scene. In illuminated manuscripts, initials with large figures inside them, such as those illustrated here, are known as historiated initials.", "prediction 2": "In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text. These letters are often several lines in height and in older books or manuscripts, sometimes ornately decorated. In illuminated manuscripts, initials with images inside them, such as those illustrated here, are known as historiated initials. In an illuminated manuscript, specific initials, in an illuminated manuscript, also were called Initiums.", "prediction 3": "In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text. The word is derived from the Latin initialis, which means \"standing at the beginning\".", "prediction 4": "In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text. The word is derived from the Latin \"initialis\", which means \"standing at the beginning\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 465 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "A historiated initial is an initial, an enlarged letter at the beginning of a paragraph or other section of text, that contains a picture. Strictly speaking, a historiated initial depicts an identifiable figure or a specific scene, while an inhabited initial contains figures that are decorative only, without forming a subject. In a written or published work, an initial or drop cap is a letter at the beginning of a word, a chapter, or a paragraph that is larger than the rest of the text and is often several lines in height and in older books or manuscripts are known as \"inhabited\" initials. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who wrote the song i've just seen a face?", "passages": [ [ "I've Just Seen a Face", "I've Just Seen a Face\n\n\"I've Just Seen a Face\" is a song by the Beatles.", "It appeared on their 1965 United Kingdom album \"Help!\"", "and in the United States on the Capitol Records version of the \"Rubber Soul\" album.", "\"I've Just Seen a Face\" was written by Paul McCartney (credited to Lennon\u2013McCartney) and features McCartney on vocals.", "Before its recording, the song was briefly titled \"Auntie Gin's Theme\" after his father's youngest sister, because it was one of her favourites.", "It is one of very few Beatles songs that lacks a bass track.", "McCartney has stated, \"It was slightly country and western from my point of view...", "it was faster, though, it was a strange uptempo thing.", "I was quite pleased with it.", "The lyric works; it keeps dragging you forward, it keeps pulling you to the next line, there's an insistent quality to it that I liked.\"", "Its lyrics sound effortless and conversational, but they also contain a complex sequence of cascading rhymes (\"I have never known/", "The like of this/I've been alone/", "And I have missed\") that is responsible for the song's irresistible propulsion." ] ], "gold": "\"I've Just Seen a Face\" is the first fully acoustic song by the English rock band the Beatles. It was written by Paul McCartney, credited to Lennon\u2013McCartney, and features McCartney on vocals.", "prediction 1": "\"I've Just Seen a Face\" is a song by the Beatles. It appeared on their 1965 United Kingdom album \"Help!\" and in the United States on the Capitol Records version of the \"Rubber Soul\" album. \"I've Just Seen a Face\" was written by Paul McCartney and features McCartney on vocals.", "prediction 2": "\"I've Just Seen a Face\" is a song by the British rock band the Beatles. It appeared on their 1965 album Help! and in the United States on the Capitol Records version of the Rubber Soul album. \"I've Just Seen a Face\" was written by Paul McCartney and features McCartney on vocals.", "prediction 3": "\"I've Just Seen a Face\" is a song by the British band, The Beatles. It appeared on their 1965 United Kingdom album Help! and in the United States on the Capitol Records version of the Rubber Soul album. \"I've Just Seen a Face\" was written by Paul McCartney (credited to Lennon\u2013McCartney) and features McCartney on vocals.", "prediction 4": "\"I've Just Seen a Face\" is a song by the Beatles. It appeared on their 1965 United Kingdom album Help! and in the United States on the Capitol Records version of the Rubber Soul album. \"I've Just Seen a Face\" was written by Paul McCartney and features McCartney on vocals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 188 } ], "missing-info": [], "corrected-prediction": "\"I've Just Seen a Face\" is a song by the Beatles. \"I've Just Seen a Face\" was written by Paul McCartney and features McCartney on vocals." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who won season 13 of worst cooks in america?", "passages": [ [ "Worst Cooks in America", "Worst Cooks in America\n\nWorst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network.", "The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set.", "The recruits are trained on the various basic cooking techniques including: baking, knife skills, temperature, seasoning and preparation.", "The final challenge is to cook a restaurant quality three-course meal for three food critics.", "The show premiered on January 3, 2010.", "The show was initially hosted by chef Anne Burrell and chef Beau MacMillan in Season 1.", "MacMillan was replaced by chef Robert Irvine on Season 2, followed by chef Bobby Flay for Seasons 3\u20135.", "On November 20, 2014, a Food Network press release announced that chef Tyler Florence will be paired with chef Burrell to host Season 6, to debut on January 4, 2015.", "Burrell was the winning instructor in seasons 1, 2, 3, 6, 7 and 8 with Flay winning in Seasons 4\u20135.", "Rachael Ray and Burrell hosted the Season 7 special celebrity edition, which premiered September 23, 2015.", "During the finale of Season 7, a trailer previewing Season 8 was shown and was aired in January 2016 with the return of Tyler Florence." ], [ "La Toya Jackson", "La Toya Jackson\n\nLa Toya Yvone Jackson (born May 29, 1956) is an American singer, songwriter, actress, businesswoman and television personality.", "The fifth child of the Jackson family, Jackson first gained recognition on the family's variety television series, \"The Jacksons\", on CBS between 1976 and 1977.", "Thereafter, she saw success as a solo recording artist under multiple record labels in the 1980s and 1990s, including Polydor, Sony Music and RCA, where she released nine studio albums over the course of fifteen years.", "Her most successful releases in the United States were her self-titled debut album (1980) and the 1984 single \"Heart Don't Lie\".", "Jackson's other songs include \"If You Feel the Funk\", \"Bet'cha Gonna Need My Lovin'\", \"Hot Potato\", \"You're Gonna Get Rocked!\"", "and \"Sexbox\".", "Jackson's recording career began its decline in the 1990s as a result of her controversial marriage to her entertainment manager Jack Gordon, whom she was allegedly forced to marry against her will.", "Amid erratic behavior on Jackson's part and widely publicized claims by the Jackson family that Gordon had brainwashed her against them, her career was significantly impacted under his management." ] ], "gold": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on Food Network. Chef Instructor Tyler Florence and American soul and urban singer-songwriter, actress, businesswoman and television personality La Toya Jackson won Season 13.", "prediction 1": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. In Season 13, La Toya Jackson won the competition, and Tyler Florence won the challenge.", "prediction 2": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. Bobby Flay won Season 13 of the show. Tyler Florence won Season 13 of the show.", "prediction 3": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. In Season 13, chef Bobby Flay won the contest.", "prediction 4": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. The show takes 12 to 16 contestants (referred to as \"recruits\") with very poor cooking skills through a culinary boot camp, to earn a cash prize of $25,000 and a Food Network cooking set. In Season 13 of the show, La Toya Jackson won the instructor competition. Tyler Florence won the chef competition.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 120, "end": 208 } ], "missing-info": [], "corrected-prediction": "Worst Cooks in America is an American reality television series that premiered on January 3, 2010, on the Food Network. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sings you make me feel like dancing?", "passages": [ [ "You Make Me Feel Like Dancing (album)", "You Make Me Feel Like Dancing (album)\n\n", "You Make Me Feel Like Dancing is the 31st album released by the Australian children's music group, The Wiggles.", "Its title track features Leo Sayer, who wrote and performed the original song from 1976.", "It also features Australian country musician Troy Cassar-Daley.", "The CD was released on May 8, 2008 & won the Aria for Best Children's Album.", "The Wiggles have made their video, \"You Make Me Feel Like Dancing,\" in June 2008.", "Song list" ], [ "The Wiggles", "The Wiggles\n\nThe Wiggles are an Australian children's music group formed in Sydney, New South Wales, in 1991.", "Since 2012, the group members are Anthony Field, Lachlan Gillespie, Simon Pryce, and Emma Watkins.", "The original members were Field, Phillip Wilcher, Murray Cook, Greg Page, and Jeff Fatt.", "Wilcher left the group after their first album.", "Page retired in 2006 due to ill health and was replaced by understudy Sam Moran, but returned in 2012, replacing Moran.", "At the end of 2012, Page, Cook, and Fatt retired, and were replaced by Gillespie, Pryce, and Watkins.", "Cook and Fatt retained their shareholding in the group and all three continued to have input into its creative and production aspects.", "Field and Fatt were members of the Australian pop band The Cockroaches in the 1980s, and Cook was a member of several bands before meeting Field and Page at Macquarie University, where they were studying to become pre-school teachers.", "In 1991, Field was inspired to create an album of children's music based upon concepts of early childhood education, and enlisted Cook, Page, and Fatt to assist him.", "They began touring to promote the album, and became so successful, they quit their teaching jobs to perform full-time." ], [ "You Make Me Feel Like Dancing", "You Make Me Feel Like Dancing\n\n\"You Make Me Feel Like Dancing\" is a song by the British singer Leo Sayer, taken from his 1976 album \"Endless Flight\".", "The song reached number one on the U.S. \"Billboard\" Hot 100 chart, making it his first number-one single in the United States, and reached number 2 on the UK Singles Chart.", "\"Billboard\" ranked it as the No. 13 song of 1977.", "Songwriters Sayer and Vini Poncia won a Grammy Award for the song in 1978 in the category Best R&B Song.", "In Australia, a live performance from the TV show \"Countdown\" is frequently used in place of a music video.", "On February 13, 2012, the TV One original series \"Unsung\" aired an episode on Ray Parker Jr., in which he claimed that he was the song's original writer.", "Allegedly, he was playing the song on the piano, and an executive from Capitol Records heard it and later convinced him to make a demo tape.", "After the song came out by Sayer, Parker, Jr. could not claim copyright infringement seeing as he failed to make the tape." ] ], "gold": "\"You Make Me Feel Like Dancing\" is a song credited to British singer Leo Sayer, taken from his 1976 album Endless Flight. Clydie King, Becky Louis and Sherlie Matthews sung background vocals. In 2000, Carmen Carter and Donald McClurkin, Jr. covered the song, and in 2004 it was covered by Anne Hathaway. In 2008, the Wiggles, an Australian children's music group, sang the song as the title work of their DVD You Make Me Feel Like Dancing, with Leo Sayer guest starring. The Wiggles included Anthony Field, Phillip Wilcher, Murray Cook, Sam Moran, and Jeff Fatt.", "prediction 1": "Leo Sayer sang the song \"You Make Me Feel Like Dancing\" from his 1976 album Endless Flight. The video for the song was recorded and released in June 2008 by the Australian children's music group The Wiggles. The title track of the album features Sayer, who wrote and performed the original song from 1976.", "prediction 2": "The song \"You Make Me Feel Like Dancing\" is by the British singer Leo Sayer, taken from his 1976 album Endless Flight. Singers Sayer and Vini Poncia won a Grammy Award for the song in 1978 in the category Best R&B Song.", "prediction 3": "Leo Sayer sings \"You Make Me Feel Like Dancing\" in his 1976 song \"Endless Flight\". The song reached number one on the U.S. Billboard Hot 100 chart, making it his first number-one single in the United States. In 1978, Sayer and Vini Poncia won a Grammy Award for the song in the category Best R&B Song. A live performance from the TV show \"Countdown\" is frequently used in place of a music video.", "prediction 4": "\"You Make Me Feel Like Dancing\" is a song by the British singer Leo Sayer, taken from his 1976 album Endless Flight. The song reached number one on the U.S. Billboard Hot 100 chart, making it his first number-one single in the United States, and reached number 2 on the UK Singles Chart. Anthony Field, Lachlan Gillespie, Simon Pryce, and Emma Watkins, who are members of the Australian children's music group The Wiggles, sing the title track.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Leo Sayer sang the song \"You Make Me Feel Like Dancing\" from his 1976 album Endless Flight. The video for the song was recorded and released in June 2008 by the Australian children's music group The Wiggles. The title track of the album features Sayer, who wrote and performed the original song from 1976." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did michael jordan join the chicago bulls?", "passages": [ [ "Michael Jordan", "Michael Jordan\n\nMichael Jeffrey Jordan (born February 17, 1963), also known by his initials, MJ, is an American former professional basketball player.", "He played 15 seasons in the National Basketball Association (NBA) for the Chicago Bulls and Washington Wizards.", "His biography on the official NBA website states: \"By acclamation, Michael Jordan is the greatest basketball player of all time.\"", "Jordan was one of the most effectively marketed athletes of his generation and was considered instrumental in popularizing the NBA around the world in the 1980s and 1990s.", "He is currently the principal owner and chairman of the NBA's Charlotte Hornets.", "Jordan played three seasons for coach Dean Smith at the University of North Carolina.", "As a freshman, he was a member of the Tar Heels' national championship team in 1982.", "Jordan joined the Bulls in 1984 as the third overall draft pick.", "He quickly emerged as a league star and entertained crowds with his prolific scoring.", "His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness.", "He also gained a reputation for being one of the best defensive players in basketball.", "In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\"." ], [ "Michael Jordan", "In the 1993\u201394 season, the Bulls achieved a 55\u201327 record without Jordan in the lineup, and lost to the New York Knicks in the second round of the playoffs.", "The 1994\u201395 Bulls were a shell of the championship team of just two years earlier.", "Struggling at mid-season to ensure a spot in the playoffs, Chicago was 31\u201331 at one point in mid-March.", "The team received help, however, when Jordan decided to return to the Bulls.", "In March 1995, Jordan decided to quit baseball due to the ongoing Major League Baseball strike, as he wanted to avoid becoming a potential replacement player.", "On March 18, 1995, Jordan announced his return to the NBA through a two-word press release: \"I'm back.\"", "The next day, Jordan took to the court with the Bulls to face the Indiana Pacers in Indianapolis, scoring 19 points.", "The game had the highest Nielsen rating of a regular season NBA game since 1975.", "Although he could have opted to wear his normal number in spite of the Bulls having retired it, Jordan instead wore number 45, as he had while playing baseball.", "Although he had not played an NBA game in a year and a half, Jordan played well upon his return, making a game-winning jump shot against Atlanta in his fourth game back." ] ], "gold": "Michael Jordan joined the Bulls in 1984 as the third overall draft pick. Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls March 18, 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a record 72 regular season wins in the 1995\u201396 NBA season. ", "prediction 1": "Michael Jeffrey Jordan was an American former professional basketball player who played 15 seasons in the National Basketball Association for the Chicago Bulls and Washington Wizards. He played for the Bulls from 1984 to 1993. Jordan became a star when he joined the Bulls in 1984 as the third overall draft pick.", "prediction 2": "Michael Jeffrey Jordan, known by his initials MJ, was an American former professional basketball player. He played 15 seasons in the National Basketball Association for the Chicago Bulls and Washington Wizards. Jordan joined the Bulls in 1984 as the third overall draft pick. He quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness.", "prediction 3": "Michael Jordan, born February 17, 1963, is an American former professional basketball player. He played 15 seasons in the National Basketball Association for the Chicago Bulls and Washington Wizards. Jordan joined the Bulls in 1984 as the third overall draft pick. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness.", "prediction 4": "Michael Jordan was drafted by the Chicago Bulls in the third round of the 1984 NBA Draft. He joined the Bulls that year and played 15 seasons in the league. Jordan won his first NBA championship with the Bulls in 1991.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 226 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 12 ] } ], "corrected-prediction": "Michael Jordan became joined the Bulls in 1984 as the third overall draft pick. In March 1995, Jordan decided to quit baseball due to the ongoing Major League Baseball strike. On March 18, 1995, Jordan announced his return to the NBA with the Bulls. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\". " }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When did the boy is mine come out?", "passages": [ [ "The Boy Is Mine (song)", "The Boy Is Mine (song)\n\n", "\"The Boy Is Mine\" is a 1998 duet by American singers Brandy and Monica written and composed by LaShawn Daniels, Japhe Tejeda, Fred Jerkins III, Rodney \"Darkchild\" Jerkins, and Brandy with coproduction by Darkchild and Dallas Austin.", "It was released as the lead single from both singers' second albums from 1998, \"Never Say Never\" by Brandy and \"The Boy Is Mine\" by Monica.", "Inspired by Michael Jackson and Paul McCartney's 1982 duet \"The Girl Is Mine\", the lyrics of the mid-tempo R&B track revolve around two women fighting over a man.", "The song received generally positive reviews from music critics and was the first number-one pop hit for both artists, in the US and internationally.", "Exploiting the media's presumption of a rivalry between the two young singers, \"The Boy Is Mine\" became the best-selling song of the year in the US, selling 2.6 million copies, and spent 13 weeks at the top of the US \"Billboard\" Hot 100 during the summer of 1998." ], [ "Angel of Mine", "Angel of Mine\n\n\"Angel of Mine\" is a song performed by British R&B girl group Eternal from their \"Greatest Hits\" album (1997).", "It was written by Rhett Lawrence and Travon Potts, produced by Lawrence, and released on September 29, 1997.", "The song became Eternal's 12th top 10 hit on the UK Singles Chart, peaking at number 4; it spent a total of 13 weeks on the chart, helping their \"Greatest Hits\" album go three times platinum.", "\"Angel of Mine\" was the ensemble's final single as a three-piece as after its release K\u00e9ll\u00e9 Bryan left the group.", "In 1998, American singer Monica released a cover version which topped the US \"Billboard\" Hot 100 chart for four weeks, and peaked at number two on the US \"Billboard\" R&B chart.", "It was certified platinum by the RIAA in 1999.", "These are the formats and track listings of major single-releases of \"Angel of Mine\".", "CD: 1\n\nCD: 2\n\nAmerican R&B singer Monica's cover version of \"Angel of Mine\" was released on November 17, 1998 as the third single from her second studio album \"The Boy Is Mine\" (1998)." ], [ "The Boy Is Mine (album)", "The Boy Is Mine (album)\n\n", "The Boy Is Mine is the second studio album by American R&B recording artist Monica.", "It was released by Arista Records on July 14, 1998, in the United States.", "The album deviated from the formula of her debut \"Miss Thang\" (1995) as she had more creative control over the material she recorded; a step that she considered a \"natural progression\".", "On the record, Monica worked with a variety of producers and writers from different genres such as gospel, R&B, and hip hop, including frequent collaborators Dallas Austin, Colin Wolfe, and Daryl Simmons.", "Additional producers included David Foster, Diane Warren, Jermaine Dupri, and Rodney Jerkins and his Darkchild crew, some of which would become household names on subsequent albums.", "Upon release, \"The Boy Is Mine\" received generally positive reviews from contemporary music critics.", "The album debuted at number eight on the \"Billboard\" 200 and at number two on the Top R&B Albums in August 1998.", "It was eventually certified triple-platinum by the Recording Industry Association of America (RIAA), denoting shipments of over three million copies throughout the country, with estimated sales of 2.1 million copies in the United States as of November 2014." ] ], "gold": "The Boy Is Mine is a 1998 song by American singers Brandy and Monica that was released on May 19, 1998. This song was also part of Monica's album The Boy Is Mine, which was released on July 14, 1998.", "prediction 1": "The Boy Is Mine is a 1998 duet by American singers Brandy and Monica written and composed by LaShawn Daniels, Japhe Tejeda, Fred Jerkins III, Rodney \"Darkchild\" Jerkins, and Brandy with coproduction by Darkchild and Dallas Austin. It was released as the lead single from both singers' second albums from 1998, Never Say Never by Brandy and The Boy Is Mine by Monica. In 1997, British R&B girl group Eternal released their song entitled Angel of Mine. In 1998, American R&B recording artist Monica released a cover version of Angel of Mine which topped the US \"Billboard\" Hot 100 chart for four weeks, and peaked at number two on the US \"Billboard\" R&B Billboard Hot 100 chart. It was released on November 17, 1998 as the third single from her second studio album The Boy I", "prediction 2": "The Boy Is Mine is a 1998 duet by American singers Brandy and Monica. It was released as the lead single from both singers' second albums from 1998, Never Say Never by Brandy and The Boy Is Mine by Monica with coproduction by Darkchild and Dallas Austin. In 1997, British R&B girl group Eternal released the song Angel of Mine which topped the US Billboard Hot 100 chart for four weeks and peaked at number two on the US Billboard R&B chart. In 1998, American singer Monica released a cover version of Angel of Mine which topped the US Billboard Hot 100 chart for four weeks, and peaked at number two on the US Billboard R&Billboard Hot 100 chart. In 1998, American R&B chart and peaked at number two on the US Billboard R&B Billboard Hot 100 chart. In 1999, American R&B recording artist Monica released a cover", "prediction 3": "The Boy Is Mine is a 1998 duet by American singers Brandy and Monica written and composed by LaShawn Daniels, Japhe Tejeda, Fred Jerkins III, Rodney \"Darkchild\" Jerkins, and Brandy with coproduction by Darkchild and Dallas Austin. It was released as the lead single from both singers' second albums from 1998, \"Never Say Never\" by Brandy and \"The Boy Is Mine\" by Monica. The Boy Is Mine is also the second studio album by American R&B recording artist Monica. It was released by Arista Records on July 14, 1998, in the United States. The Boy Is Mine is Mine is the second studio album by American R&B recording artist Monica. It was released by American R&B recording artist Monica's cover version of \"Angel of Mine\" on November 17, 1998, as the third single from her", "prediction 4": "The Boy Is Mine is a 1998 duet, composed by LaShawn Daniels, Japhe Tejeda, Fred Jerkins III, Rodney \"Darkchild\" Jerkins, and Brandy, and released as the lead single from both singers' second albums from 1998, Never Say Never by Brandy and The Boy Is Mine by Monica. The Boy Is Mine is also the second studio album by American R&B recording artist Monica, released by Arista Records on July 14, 1998, in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 676 }, { "error type": "Irrelevant", "explanation": "", "start": 677, "end": 772 } ], "missing-info": [], "corrected-prediction": "The Boy Is Mine is a 1998 duet by American singers Brandy and Monica. It was released as the lead single from both singers' second albums from 1998, Never Say Never by Brandy and The Boy Is Mine by Monica. " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sings the song back in the day?", "passages": [ [ "Back in the Day (Ahmad song)", "Back in the Day (Ahmad song)\n\n\"Back in the Day\" is a 1994 single by Ahmad.", "Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective.", "\"Back in the Day\" was Ahmad's only major hit single, making it to #26 on The Billboard Hot 100, #19 on the US R&B chart on the strength of its hook - a sample of the Teddy Pendergrass song \"Love TKO\"\u2014and Ahmad's quirky vocal style, reminiscent of Fatlip of the Pharcyde fame, and #3 on the US rap chart.", "It was the first single of his 1994 self-titled album and was RIAA-certified gold.", "The TKO Remix of \"Back in the Day\" (Produced By Maurice Thompson of Barr 9 Productions) is featured as the single and on the soundtrack of \"The Wood\", a 1999 motion picture.", "Mariah Carey's 12th studio album, \"Memoirs of an Imperfect Angel\", featured an interpolation of \"Back in the Day\" on the track \"Candy Bling\".", "Travie McCoy's debut studio album \"Lazarus\" features a song titled \"Akidagain\" which interpolates \"Back in the Day\"." ], [ "Back in the Day (Puff)", "Back in the Day (Puff)\n\n\"Back in the Day (Puff)\" is a song released in 2003 by R&B singer Erykah Badu.", "It is the second single in support of Worldwide Underground album.", "The song peaked at no. 62 on the R&B Singles chart in 2004." ] ], "gold": "\"Back in the Day\" is a 1994 single by Ahmad. The song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. In 2003 R&B singer Erykah Badu released \"Back in the Day (Puff)\", which peaked at no. 62 on the R&B Singles chart in 2004.", "prediction 1": "\"Back in the Day\" is a 1994 single by Ahmad. Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. Back in the Day was Ahmad's only major hit single, making it to #26 on The Billboard Hot 100, #19 on the US R&B chart on the strength of its hook - a sample of the Teddy Pendergrass song \"Love TKO\"\u2014and Ahmad's quirky vocal style, reminiscent of Fatlip of the Pharcadia of Fatlip of the Pharcade fame, and #3 on the US rap chart. Back in the Day (Puff) was the second single in support of Worldwide Underground album. It was the second single in support of Worldwide Underground album.", "prediction 2": "Back in the Day is a song released in 1994 by Ahmad. Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. \"Back in the Day (Puff)\" is a song released in 2003 by R&B singer Erykah Badu. It is the second single in support of Worldwide Underground album.", "prediction 3": "\"Back in the Day\" is a 1994 single by Ahmad. Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. \"Back in the Day\" was Ahmad's only major hit single, making it to #26 on The Billboard Hot 100, #19 on the US R&B chart on the strength of its hook - a sample of the Teddy Pendergrass song \"Love TKO\"\u2014and Ahmad's quirky vocal style, reminiscent of Fatlip of Fatlip of the Pharcade fame, and #3 on the US rap chart. \"Back in the Day (Puff)\" was the second single in support of Worldwide Underground album. \"Back in the Day (Puff)\" was the second single in support of Worldwide Underground album.", "prediction 4": "\"Back in the Day\" is a 1994 single by Ahmad. Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. \"Back in the Day (Puff)\" is a song released in 2003 by R&B singer Erykah Badu. It is the second single in support of Worldwide Underground album.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 45, "end": 77 }, { "error type": "Irrelevant", "explanation": "", "start": 193, "end": 521 }, { "error type": "Redundant", "explanation": " Back in the Day (Puff) was the second single in support of Worldwide Underground album. ", "start": 610, "end": 677 }, { "error type": "Irrelevant", "explanation": "", "start": 522, "end": 609 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Back in the Day\" is a 1994 single by Ahmad. Released when Ahmad was only 18, the song is a nostalgic remembrance of childhood and young teenage years, from a somewhat jaded adult perspective. Back in the Day (Puff) \"Back in the Day (Puff)\" is a song released in 2003 by R&B singer Erykah Badu. The song peaked at no. 62 on the R&B Singles chart in 2004." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was the last year they made the toyota matrix?", "passages": [ [ "Toyota Matrix", "Toyota Matrix\n\nThe Toyota Matrix, officially referred to as the Toyota Corolla Matrix, is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla.", "Introduced in 2002 as a 2003 model, the Matrix is the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. (NUMMI) in Fremont, California.", "Officially sold in North America until being discontinued, the Matrix was positioned as a sporty hatchback counterpart of the North American Corolla and was counted as a variant of it in Toyota's sales figures.", "Although identical mechanically, and nearly as much internally, the Matrix and Vibe had different sheetmetal and exterior trim designed by their respective brands.", "Both vehicles are narrow, tall station wagons styled in a quasi-SUV fashion (called a crossover utility vehicle or \"CUV\" by Toyota) and marketed to a fairly youthful market segment.", "This type of car is also commonly referred to as a sport wagon.", "First sold in February 2002, the Matrix saw a minor facelift for the 2005 model year, and was redesigned completely in 2008 for the 2009 model year, following the new tenth generation Corolla.", "Sales of the Matrix were discontinued in the United States in 2013, and in Canada in 2014." ], [ "Toyota Matrix", "The Canadian market continued for the 2014 model year, with those assembled in Cambridge, Ontario by Toyota Motor Manufacturing Canada.", "The Matrix was then discontinued in Canada and was not offered for the 2015 model year.", "Toyota continued to sell a range of compact hatchbacks in North America through its Scion brand.", "On September 1, 2016, \"the Scion brand transitioned to Toyota.\"", "For the 2017 model year, the Corolla iM would be the successor of the Matrix." ] ], "gold": "The Toyota Matrix, officially referred to as the Toyota Corolla Matrix, is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Corolla. Introduced in 2002 as a 2003 model, the Matrix was the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. in Fremont, California, United States. Sales of the Matrix were discontinued in the U.S. in 2013 and in Canada in 2014.", "prediction 1": "The Toyota Matrix is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla. First sold in February 2002, the Matrix saw a minor facelift for the 2005 model year, and was redesigned completely in 2008 for the 2009 model year, following the new tenth generation Corolla. Sales of the Matrix were discontinued in the United States in 2013, and in Canada in 2014. The Canadian market continued for the 2014 model year, with those assembled in Cambridge, Ontario by Toyota Motor Manufacturing Canada. The Matrix was discontinued in Canada and was not offered for the 2015 model year.", "prediction 2": "The Toyota Matrix is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla. Introduced in 2002 as a 2003 model, the Matrix is the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. in Fremont, California. First sold in February 2002, the Matrix saw a minor facelift for the 2005 model year, and was redesigned completely in 2008 for the 2009 model year, following the new tenth generation Corolla. The Canadian market continued for the 2014 model year, with those assembled in Cambridge, Ontario by Toyota Motor Manufacturing Canada, but was not offered for the 2015 model year.", "prediction 3": "The Toyota Matrix, officially referred to as the Toyota Corolla Matrix, is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla. Introduced in February 2002 as a 2003 model, the Matrix is the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. (NUMMI) in Fremont, California. The Canadian market continued for the 2014 model year, and was not offered for the 2015 model year.", "prediction 4": "The Toyota Matrix is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla. Introduced in February 2002 as a 2003 model, the Matrix is the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. in Fremont, California. Sold in North America until being discontinued, the Matrix was positioned as a sporty hatchback counterpart of the North American Corolla and was counted as a variant of it in Toyota's sales figures. The Canadian market continued for the 2014 model year, with those assembled in Cambridge, Ontario by Toyota Motor Manufacturing Canada. Sales of the Matrix was then discontinued in Canada and was not offered for the 2015 model year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 434, "end": 569 }, { "error type": "Irrelevant", "explanation": "", "start": 570, "end": 652 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Toyota Matrix, officially referred to as the Toyota Corolla Matrix, is a compact hatchback manufactured by Toyota Motor Manufacturing Canada in Cambridge, Ontario and derived from the Toyota Corolla. Introduced in 2002 as a 2003 model, the Matrix is the result of a joint venture between Toyota and General Motors, with the GM version being the Pontiac Vibe, which was assembled by New United Motor Manufacturing, Inc. (NUMMI) in Fremont, California.Sales of the Matrix were discontinued in the United States in 2013, and in Canada in 2014. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who wrote the book a walk in the woods?", "passages": [ [ "A Walk in the Woods (book)", "A Walk in the Woods (book)\n\nA Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend \"Stephen Katz\".", "The book is written in a humorous style, interspersed with more serious discussions of matters relating to the trail's history, and the surrounding sociology, ecology, trees, plants, animals and people.", "The book starts with Bryson explaining his curiosity about the Appalachian Trail near his house.", "He and his old friend Stephen Katz start hiking the trail from Georgia in the south, and stumble in the beginning with the difficulties of getting used to their equipment; Bryson also soon realizes how difficult it is to travel with his friend, who is a crude, overweight recovering alcoholic, and even less prepared for the ordeal than he is.", "Overburdened, they soon discard much extra food and equipment to lighten their loads.", "After hiking for what seemed to him a large distance, they realize they have still barely begun while in Gatlinburg, Tennessee, and that the whole endeavor is simply too much for them.", "They skip a huge section of the trail, beginning again in Roanoke, Virginia.", "The book recounts Bryson's desire to seek easier terrain as well as \"a powerful urge not to be this far south any longer\"." ], [ "A Walk in the Woods (play)", "A Walk in the Woods (play)\n\nA Walk in the Woods is a 1988 play by Lee Blessing.", "The play depicts the developing relationship between two arms limitation negotiators, one Russian and one American, over a year of negotiations.", "\"A Walk in the Woods\" was first presented at the Yale Repertory Theater, New Haven, Connecticut, in March 1987.", "Directed by Des McAnuff the cast starred Josef Sommer as the Russian, Andrey Botvinnik and Kenneth Welsh as the American, John Honeyman.", "It was next produced at the La Jolla Playhouse, California in July 1987, directed by McAnuff and starring Lawrence Pressman (as John Honeyman) and Michael Constantine (as Andrey Botvinnik).", "\"A Walk in the Woods\" premiered on Broadway at the Booth Theatre on February 10, 1988 in previews, officially on February 28, 1988, and closed on June 26, 1988 after 21 previews and 137 performances.", "Directed by Des McAnuff, the cast starred Robert Prosky as Andrey Botvinnik and Sam Waterston as John Honeyman.", "The play was presented at the Westport Country Playhouse, Connecticut, in September 1988.", "Directed by Maureen F. Gibson, the cast starred Lawrence Pressman (as John Honeyman) and Michael Constantin] (as Andrey Botvinnik)." ], [ "A Walk in the Woods (film)", "A Walk in the Woods (film)\n\nA Walk in the Woods is a 2015 American biographical comedy-drama film directed by Ken Kwapis, based on the 1998 book/memoir of the same name by Bill Bryson.", "The film stars Robert Redford, Nick Nolte and Emma Thompson, and was released on September 2, 2015, by Broad Green Pictures.", "Author Bill Bryson (Robert Redford), after living for ten years in the UK, returned to New Hampshire.", "Now in his 60s, he had been living there peacefully for the past twenty years.", "A television interview reports that he has published several popular books and there is speculation he will be writing more.", "Bryson, however, has no such plans.", "Bryson and his wife Catherine (Emma Thompson) attend a funeral.", "Not being an outgoing person, he afterwards takes a stroll up to the nearby Appalachian Trail.", "He suddenly decides he will hike its entire length.", "Catherine objects, presenting all kinds of accounts about accidents and murders on the trail.", "She relents on condition that he not travel alone.", "He agrees and searches for a friend willing to join him.", "Everyone declines his invitation; some declare him insane.", "Finally, he is contacted by Stephen Katz (Nick Nolte), an old friend who offers to be a hiking companion.", "Despite appearances, Stephen claims to be fit enough for the challenge." ] ], "gold": "A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by travel writer Bill Bryson that describes his attempt to walk the Appalachian Trail with his friend Stephen Katz. The 2015 Walk in the Woods film starring Robert Redford is based on Bryson's book. A Walk in the Woods is also the name of a 1988 play by Lee Blessing. This play depicts the developing relationship between two arms limitation negotiators, one Russian and one American, over a year of negotiations.", "prediction 1": "A Walk in the Woods is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend Stephen Katz. The book is written in a humorous style, interspersed with more serious discussions of matters relating to the trail's history, and the surrounding sociology, ecology, trees, plants, animals and people. A Walk in the Woods: Rediscovering America on the Appalachian Trail is also a 1988 play by Lee Blessing. A Walk in the Woods: Rediscovering America on the Appalachian Trail is written by Bryson.", "prediction 2": "A Walk in the Woods is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend Stephen Katz. The book is written in a humorous style, interspersed with more serious discussions of matters relating to the trail's history, and the surrounding sociology, ecology, trees, plants, animals and people. A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1988 play by Lee Blessing. The play A Walk in the Woods: Redis is an American comedy-drama film directed by Ken Kwapis, based on the 1998 book, A Walk in the Woods: Redford, a 2015 American biographical comedy-drama film directed by Ben Harper Brothers, based on the 1998 book by Bryson.", "prediction 3": "A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend Stephen Katz. The book is written in a humorous style, interspersed with more serious discussions of matters relating to the trail's history, and the surrounding sociology, ecology, trees, plants, animals and people. A Walk in the Woods: A Journey to the Heart of the Appalachian Trail is a 1988 play by Lee Blessing. A Walk in the Woods: Redis is based on the 1998 book A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by Bill Bryson. A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998", "prediction 4": "A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend Stephen Katz. The book is written in a humorous style, interspersed with more serious discussions of matters relating to the trail's history, and the surrounding sociology, ecology, trees, plants, animals and people. A Walk in the Woods is also the title of a 2015 American biographical comedy-drama film based on the 1998 book/memoir of the Woods by Bill Bryson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 435 }, { "error type": "Redundant", "explanation": "A Walk in the Woods is a 1998 autobiographical book by travel writer Bill Bryson, ", "start": 473, "end": 562 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "A Walk in the Woods: Rediscovering America on the Appalachian Trail is a 1998 autobiographical book by travel writer Bill Bryson, describing his attempt to walk the Appalachian Trail with his friend Stephen Katz. The 2015 Walk in the Woods film starring Robert Redford is based on Bryson's book. A Walk in the Woods is also a 1988 play by Lee Blessing. The play depicts the developing relationship between two arms limitation negotiators, one Russian and one American, over a year of negotiations. A Walk in the Woods: Rediscovering America on the Appalachian Trail is written by Bryson." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who does the voice of the female chocolate m&m?", "passages": [ [ "Cree Summer", "Cree Summer\n\nCree Summer Francks (born July 7, 1969) is an American-Canadian actress, voice actress and singer.", "She is known for playing Winifred \"Freddie\" Brooks on the NBC sitcom \"A Different World\".", "In animation, Summer was the original voice of Penny in the 1983 cartoon \"Inspector Gadget\".", "She also voiced Elmyra Duff in \"Tiny Toon Adventures\" and \"Pinky, Elmyra & the Brain\", Susie Carmichael in \"Rugrats\" and \"All Grown Up!", "\", Numbuh 5 in \"\", Cleo the Poodle in \"Clifford the Big Red Dog\", Princess Kida in the franchise of \"\", Valerie Gray in \"Danny Phantom\", Rayna Cartflight in \"The Buzz on Maggie\", Beast Girl in \"Teen Titans Go!", "\", Priscilla Skunk in \"Sheriff Callie's Wild West\", Maxine \"Max\" Gibson in \"Batman Beyond\", Foxxy Love in \"Drawn Together\", Magma in \"X-Men Legends\", Yvonne and Gordon in \"Mrs. Munger's Class\", Nebula in \"Guardians of the Galaxy\" and Witch Haggar in \"\".", "She also voiced the character Mo in the Horrible Histories (2001 TV series)." ], [ "Vanessa Williams", "Vanessa Williams\n\nVanessa Lynn Williams (born March 18, 1963) is an American singer, actress, and fashion designer.", "She initially gained recognition as the first woman of African-American descent to receive the Miss America title when she was crowned Miss America 1984 in 1983.", "However, a scandal arose the following year when, a few weeks prior to the end of her reign, Williams learned that \"Penthouse\" magazine would be publishing unauthorized nude photographs of her in an upcoming issue.", "Amid growing media controversy and scrutiny, Williams resigned as Miss America in July 1984 (under pressure from the Miss America Organization), and was replaced by first runner-up Miss New Jersey Suzette Charles.", "Thirty-two years later, Miss America CEO Sam Haskell offered her a public apology (during the Miss America 2016 pageant) for the events of 1984.", "Williams rebounded from the scandal with a successful career as a singer and actress.", "In 1988, she released her debut studio album \"The Right Stuff\" whose title single saw moderate success before \"Dreamin'\" peaked at number 8 on the \"Billboard\" Hot 100 chart in the United States.", "Her second and third studio albums, \"The Comfort Zone\" (1991) and \"The Sweetest Days\" (1994), saw continued commercial success and for which she received multiple Grammy Award nominations, including for her number-one hit and signature song, \"Save the Best for Last\"." ], [ "Vanessa Williams", "In 2018, Williams returned as a spokesmodel for L'Or\u00e9al as part of their 'Age perfect' campaign alongside fellow ambassadors Helen Mirren, Julianne Moore and Jane Fonda.", "She appeared on \"Who Wants to Be a Millionaire\" in 2000 as a contestant, and once again on August 10, 2009, as a celebrity guest during the show's 10th anniversary prime-time special editions, winning $50,000 for her charity.", "In a commercial that began running during Super Bowl XLVI in 2012, Williams voiced the new character Ms. Brown, a brown M&M.", "In March 2016, Williams launched her own clothing line, \"V. by Vanessa Williams\", for EVINE Live.", "Williams and her mother Helen co-authored a memoir entitled \"You Have No Idea\", published in April 2012.", "In the book, Williams discusses her childhood, rise to fame, and personal struggles (including life with type 1 diabetes), including the fact that she was sexually molested by a woman when she was 10 years old.", "She also spoke candidly about having an abortion while she was in high school.", "Williams is a Roman Catholic, something she spoke about on the ABC News program, \"Focus On Faith\" with Father Edward L. Beck.", "Williams is also involved with a number of humanitarian causes." ] ], "gold": "Cree Summer is an American actress and singer. Summer voiced over 101 animated characters between 1983 and 2006. These have spanned video games, cartoon television series, animated films and commercials. Among her commercials, she is the voice for the female green M&M. In a commercial that began running during Super Bowl XLVI in 2012, American actress, singer, and fashion designer, Vanessa Williams voiced the new character Ms. Brown, a brown M&M.", "prediction 1": "The voice of the female chocolate M&M is provided by actress and voice actress Cree Summer Francks. In the 2013 M&M commercial, actress and voice actress Vanessa Williams voiced the character Ms. Brown.", "prediction 2": "Cree Summer Francks is an American-Canadian actress, voice actress, and singer whose credits include the role of Penny in the 1983 cartoon Inspector Gadget. In addition, Vanessa Williams voices the female chocolate m&m in a Super Bowl XLVI commercial.", "prediction 3": "Cree Summer Francks, an American-Canadian actress, voice actress, singer, and model, voices the female chocolate M&M in animated films, television shows and commercials. In the 2012 Super Bowl commercial, Vanessa Williams voices the female chocolate M&M.", "prediction 4": "Cree Summer Francks, an American-Canadian actress, voice actress, and singer, is the voice of the female chocolate M&M.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 107, "end": 111 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Cree Summer is an American-Canadian actress, voice actress and singer. In the 2012 M&M commercial, american actress, singer, and fashion designer, Vanessa Williams voiced the character Ms. Brown." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When did bud lose his leg in jag?", "passages": [ [ "Bud Roberts", "Bud Roberts\n\nCaptain Bud J. Roberts Jr., JAGC, USN is a fictional character in the \"JAG\" TV series played by Patrick Labyorteaux.", "The character has also appeared three times on \"NCIS\".", "Son of a retired Master Chief, Roberts joined the Navy, and as an Ensign was assigned to sea duty aboard the USS \"Seahawk\" as the Public Affairs officer under Captain Ross.", "It was during this role as the PAO aboard the \"Seahawk\", that he first met LT Harmon Rabb, and his partner LTJG Caitlin Pike, when they arrived to investigate a murder.", "This got him interested in a career in law, and it was later LTJG Meg Austin who recommended him for transfer to JAG prior to her own transfer from JAG staff.", "He attended law school in the evenings at George Mason University School of Law and, upon scoring top grades in his finals, was assigned extra legal responsibilities and acted as a trial counsel for special courts-martial.", "Sarah MacKenzie and his wife Harriet Sims are the only people Roberts will allow to view his law school grades.", "He, his younger brother Mikey (Michael Bellisario) and sister Winifred (Winnie) had a somewhat strained relationship with their father, who raised them himself after the death of their mother, due to his physical and sometimes abusive methods of disciplining them." ], [ "Bud Roberts", "LTJG Roberts married Ensign Harriet Sims in 1998.", "Together, they had five children: \n\nLT Roberts was assigned as Judge Advocate on the USS \"Seahawk\" during the beginning of the War on Terrorism in 2002.", "He lost a leg trying to save a boy from a field of landmines in Afghanistan that year.", "He was transferred back to JAG HQ after his operation and proving that he was still able to meet the fitness requirements of the U.S. Navy.", "After returning to JAG headquarters following the loss of his lower right leg from a landmine, Bud was assigned to working disability cases; he proved his worth to JAG when he investigated and successfully turned in a refusal of benefits when he noticed a sailor damaging his eyes with self-inflicted laser burns.", "Shortly thereafter, Bud returned to full limited duty in the court room.", "Roberts was promoted to the rank of Lieutenant Commander in 2004 in \"Hail and Farewell\" Part 1, which was the final act of command of the Judge Advocate General, Rear Admiral A.J. Chegwidden, at his dining out.", "Bud had already been passed over for promotion twice, meaning that if he were to be passed over a third time, he would have been involuntarily separated from the Navy.", "It should be noted that Admiral Chegwidden \"went to the mat\" with the Secretary of the Navy to get Bud his promotion." ], [ "JAG (season 7)", "Later, the team run a marathon (\"Jagathon\"), The CAG (Terry O'Quinn) comes out of retirement (\"Dog Robber\"), and Jennifer Coates (Zoe McLellan) is assigned Harm as legal counsel (\"Answered Prayers\"), before Harm and Mac go up against the Admiral (John M. Jackson) at a tribunal, and Bud (Patrick Labyorteaux) is injured in Afghanistan (\"Enemy Below\").", "During its seventh season, \"JAG\" began to show \" a surprising resurgence\", with the season premiere achieving \"the second-highest ratings in [the series'] seven-year history\".", "Series creator Donald P. Bellisario \"credits the national wave of patriotism for part of the show\u2019s new strength.", "\u201dPeople are tuning in to get some insight into what the military is all about,\" he says.", "\"We show the positive and the negative, but we also give respect to those officers who lay it on the line.\"", "Lead actor David James Elliott, who portrays hunky lawyer Cmdr.", "Harmon Rabb in the Navy\u2019s Judge Advocate General\u2019s office, agrees.", "\"In the past, people thought the show was all about the military and just decided that they didn\u2019t like it,\" says Elliott." ] ], "gold": "Bud J. Roberts Jr. is a fictional character in the JAG TV series, played by Patrick Labyorteaux, created by Donald P. Bellisario as a work-for-hire for Paramount Television. He lost a leg in the episode \"Enemy Below\", trying to save a boy from a field of landmines in Afghanistan that year. The episode aired on May 21, 2002.", "prediction 1": "Bud Roberts is a fictional character in the JAG TV series. He was assigned as Judge Advocate on the USS Seahawk during the beginning of the War on Terrorism in 2002. He lost a leg trying to save a boy from a field of landmines in Afghanistan that year. He was transferred back to JAG HQ after his operation and proving that he was still able to meet the fitness requirements of the U.S. Navy. Shortly thereafter, Bud returned to full limited duty in the court room.\n", "prediction 2": "In the JAG TV series, Bud Roberts, a fictional character, lost his leg while trying to save a boy from a landmine field in Afghanistan in 2002. Bud was transferred back to JAG HQ following the operation and proved that he was still able to meet the fitness requirements of the U.S. Navy.", "prediction 3": "Bud Roberts was a fictional character in the Navy soap opera JAG who lost a leg while attempting to save a boy from a field of landmines in Afghanistan. He was transferred back to JAG headquarters after his operation and proving that he was still able to meet the fitness requirements of the U.S. Navy. Additionally, Patrick Labyorteaux played the role of Bud, the midshipman who lost his leg while serving in Iraq and Afghanistan.", "prediction 4": "Bud Roberts is a fictional character in the US Navy drama TV series JAG, played by Patrick Labyorteaux. He was assigned as a Judge Advocate on the USS Seahawk during the beginning of the War on Terrorism in 2002. Roberts lost a leg trying to save a boy from a field of landmines in Afghanistan that year. He was transferred back to JAG HQ after his operation and proving that he was still able to meet the fitness requirements of the U.S. Navy. Roberts was assigned to working disability cases; and assigned to working disability cases; he was assigned to JAG after returning to JAG HQ, Shortly thereafter, Roberts returned to full limited duty in the court room.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 392 }, { "error type": "Irrelevant", "explanation": "", "start": 393, "end": 466 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Bud J. Roberts Jr. is a fictional character in the \"JAG\" TV series played by Patrick Labyorteaux. The series creator is Donald P. Bellisario. He lost a leg in the episode \"Enemy Below\" trying to save a boy from a field of landmines in Afghanistan that year. \n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did us airways and american airlines merger?", "passages": [ [ "American Airlines Group", "American Airlines Group\n\nAmerican Airlines Group Inc. is an American publicly traded airline holding company headquartered in Fort Worth, Texas.", "It was formed December 9, 2013, in the merger of AMR Corporation, the parent company of American Airlines, and US Airways Group, the parent company of US Airways.", "The airline groups together form the largest airline in the world, with more than 6,700 daily flights to 350 locations in 56 countries worldwide, about $40 billion in operating revenue, over 100,000 employees, and plans to take delivery of 607 new aircraft, including 517 narrowbody aircraft and 90 widebody international aircraft.", "The integration of American Airlines and US Airways was completed when the Federal Aviation Administration granted a single operating certificate for both carriers on April 8, 2015.", "The company ranked No. 71 in the 2018 Fortune 500 list of the largest United States corporations by total revenue.", "In January 2012, US Airways Group, the parent company of US Airways, expressed interest in taking over AMR Corporation, the parent company of American Airlines.", "In March, AMR's CEO Tom Horton said that the company was open to a merger.", "US Airways (US) told some American Airlines (AA) creditors that merging the two carriers could yield more than $1.5 billion a year in added revenue and cost savings.", "On April 20, American Airlines' three unions said they supported a proposed merger between the two airlines." ] ], "gold": "The merger between US Airways and American Airlines that form American Airlines Group began on December 9, 2013. Integration was complete by on April 8, 2015 when the Federal Aviation Administration granted a single operating certificate to both carriers. ", "prediction 1": "US Airways Group, the parent company of US Airways, expressed interest in taking over AMR Corporation, the parent company of American Airlines in March 2012. US Airways told some American Airlines (AA) creditors that merging the two carriers could yield more than $1.5 billion a year in added revenue and cost savings. On April 20, American Airlines' three unions said they supported a proposed merger between the two airlines. The US Airways and American Airlines Group Inc. was formed December 9, 2013, in the merger of AMR Corporation, the parent company of American Airlines, and US Airways Group, the parent company of US Airways. The integration of American Airlines and US Airways was completed when the Federal Aviation Administration granted a single operating certificate for both carriers on April 8, 2015.", "prediction 2": "US Airways and American Airlines merged in March, 2012. American Airlines and US Airways were both closed for business on April 8, 2015.", "prediction 3": "The integration of American Airlines and US Airways was completed when the Federal Aviation Administration granted a single operating certificate for both carriers on April 8, 2015. American Airlines and US Airways joined forces on December 9, 2013, in a merger of AMR Corporation, the parent company of American Airlines, and US Airways Group, the parent company of US Airways.", "prediction 4": "US Airways and American Airlines merger was announced on April 20, 2015. The merger was completed on April 8, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 318 }, { "error type": "Irrelevant", "explanation": "", "start": 319, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 539, "end": 635 } ], "missing-info": [], "corrected-prediction": "The US Airways and American Airlines Group Inc. was formed December 9, 2013, in the merger of AMR Corporation. The integration of American Airlines and US Airways was completed when the Federal Aviation Administration granted a single operating certificate for both carriers on April 8, 2015." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Who came to south africa in the mid 17th century?", "passages": [ [ "History of South Africa", "The initial origin of the Khoikhoi remains uncertain.", "Archaeological discoveries of livestock bones on the Cape Peninsula indicate that the Khoikhoi began to settle there by about 2000 years ago.", "In the late 15th and early 16th centuries, Portuguese mariners, who were the first Europeans at the Cape, encountered pastoral Khoikhoi with livestock.", "Later, English and Dutch seafarers in the late 16th and 17th centuries exchanged metals for cattle and sheep with the Khoikhoi.", "The conventional view is that availability of livestock was one reason why, in the mid-17th century, the Dutch East India Company established a staging post where the port city of Cape Town is today situated.", "The establishment of the staging post by the Dutch East India Company at the Cape in 1652 soon brought the Khoikhoi into conflict with Dutch settlers over land ownership.", "Cattle rustling and livestock theft ensued, with the Khoikhoi being ultimately expelled from the peninsula by force, after a succession of wars.", "The first Khoikhoi\u2013Dutch War broke out in 1659, the second in 1673, and the third 1674\u20131677.", "By the time of their defeat and expulsion from the Cape Peninsula and surrounding districts, the Khoikhoi population was decimated by a smallpox epidemic, against which the Khoikhoi had no natural resistance or indigenous medicines." ], [ "Dutch Cape Colony", "Dutch Cape Colony\n\nThe Cape Colony (Dutch: \"Kaapkolonie\") in southern Africa was between 1652 and 1691 a Commandment, and between 1691 and 1795 a Governorate of the Dutch East India Company.", "Jan van Riebeeck established the colony as a re-supply and layover port for vessels of the Dutch East India Company trading with Asia.", "The Cape came under Dutch rule from 1652 to 1795 and again from 1803 to 1806.", "Much to the dismay of the shareholders of the Dutch East India Company, who focused primarily on making profits from the Asian trade, the colony rapidly expanded into a settler colony in the years after its founding.", "As the only permanent settlement of the Dutch East India Company not serving as a trading post, it proved an ideal retirement place for employees of the company.", "After several years of service in the company, an employee could lease a piece of land in the colony as een Vryburgher (\"a free citizen\"), on which he had to cultivate crops that he had to sell to the Dutch East India Company for a fixed price.", "As these farms were labour-intensive, Vryburghers imported slaves from Madagascar, Mozambique and Asia, which rapidly increased the number of inhabitants." ], [ "History of South Africa", "The small initial group of free burghers, as these farmers were known, steadily increased in number and began to expand their farms further north and east into the territory of the Khoikhoi.", "The free burghers were ex-VOC soldiers and gardeners, who were unable to return to Holland when their contracts were completed with the VOC.", "The VOC also brought some 71,000 slaves to Cape Town from India, Indonesia, East Africa, Mauritius, and Madagascar.", "The majority of burghers had Dutch ancestry and belonged to the Dutch Reformed Church, but there were also some Germans.", "who often happened to be Lutherans.", "In 1688, the Dutch and the Germans were joined by French Huguenots, who were Calvinist Protestants fleeing religious persecution in France under its Catholic ruler, King Louis XIV.", "Van Riebeeck considered it impolitic to enslave the local Khoi and San aboriginals, so the VOC began to import large numbers of slaves, primarily from the Dutch colonies in Indonesia.", "Eventually, van Riebeeck and the VOC began to make indentured servants out of the Khoikhoi and the San.", "The offspring from miscegenation between the Dutch settlers and the Khoi-San and Malay slaves became known officially as the Cape Coloureds and the Cape Malays, respectively." ] ], "gold": "The Dutch East India Company established a trading post in Cape Town under the command of Jan van Riebeeck in 1652. European workers who settled at the Cape became known as the Free Burghers and gradually established farms in the Dutch Cape Colony. The small initial group of free burghers, as these farmers were known, steadily increased in number and began to expand their farms further north and east into the territory of the Khoikhoi. The free burghers were ex-VOC soldiers and gardeners, who were unable to return to Holland when their contracts were completed with the VOC, which also brought some 71,000 slaves to Cape Town from India, Indonesia, East Africa, Mauritius, and Madagascar.", "prediction 1": "The 16th-century Dutch East India Company established a staging post where the port city of Cape Town is today situated in South Africa. The Van Riebeeck Company imported a large number of slaves from India, Indonesia, East Africa, Mauritius, and Madagascar. The free burghers were ex-VOC soldiers and gardeners, who were unable to return to Holland when their contracts with the VOC were completed. The VOC also brought some 71,000 slaves to Cape Town from India, Indonesia, East Africa, primarily from the Dutch colonies in Indonesia.", "prediction 2": "The mid-17th century saw the arrival of Dutch East India Company seafarers to southern Africa. In the late 16th and 17th centuries, English and Dutch seafarers exchanged metals for cattle and sheep with the Khoikhoi. The arrival of the Dutch East India Company was a major event in South Africa's history.", "prediction 3": "The Dutch East India Company established a staging post at the Cape Peninsula in the mid-17th century, where the port city of Cape Town is today situated. The colony was established by Jan van Riebeeck as a re-supply and layover port for vessels of the Dutch East India Company trading with Asia. The VOC brought some 71,000 slaves to Cape Town from India, Indonesia, East Africa, Mauritius, and Madagascar. The free burghers were ex-VOC soldiers and gardeners, who were unable to return to Holland when their contracts were completed with the VOC. The VOC also brought some 71,000 slaves to Cape Town from India, Indonesia, East Africa, Mauritius, Madagascar, Mozambique, Madagascar, Mozambique, Madagascar, Mauritius, and Madagascar.", "prediction 4": "The mid-17th century saw the arrival of Dutch East India Company soldiers and settlers to South Africa. The Dutch East India Company brought 71,000 slaves to Cape Town from Indonesia. The arrival of English and Dutch seafarers to South Africa also caused the introduction of the Khoikhoi into the Dutch East India Company.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The 16th-century Dutch East India Company established a staging post where the port city of Cape Town is today situated in South Africa. The Van Riebeeck Company imported a large number of slaves from India, Indonesia, East Africa, Mauritius, and Madagascar.", "start": 400, "end": 536 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 16th-century Dutch East India Company established a staging post where the port city of Cape Town is today situated in South Africa. Jan van Riebeeck established the Dutch Cape Colony. The small initial group of free burghers, as these farmers were known, steadily increased in number and began to expand their farms further north and east into the territory of the Khoikhoi. The free burghers were ex-VOC soldiers and gardeners, who were unable to return to Holland when their contracts with the VOC were completed. The VOC also brought some 71,000 slaves to Cape Town from from India, Indonesia, East Africa, Mauritius, and Madagascar." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where is the talking donkey in the bible?", "passages": [ [ "Balaam", "Balaam\n\nBalaam /\u02c8be\u026al\u00e6m/ (, \"Bil\u02bbam\" \"Bil\u02bb\u0101m\") is a diviner in the Torah (Old Testament), his story begins in Chapter 22 in the Book of Numbers ().", "Every ancient reference to Balaam considers him a non-Israelite, a prophet, and the \"son of Beor\", though \"Beor\" is not clearly identified.", "Though some sources may only describe the positive blessings he delivers upon the Israelites, he is reviled as a \"wicked man\" in both the Torah and the New Testament ().", "Balaam refused to speak what God did not speak and would not curse the Israelites, even though King Balak of Moab offered him money to do so ().", "But Balaam's error and the source of his wickedness came from sabotaging the Israelites as they entered the Promised Land.", "According to Revelation (), Balaam told King Balak how to get the Israelites to commit sin by enticing them with sexual immorality and food sacrificed to idols.", "The Israelites fell into transgression due to these traps and God sent a deadly plague to them as a result ()." ], [ "Balaam", "God becomes angry that he went, and sends the Angel of the Lord (Numbers 22:22) to prevent him.", "At first, the angel is seen only by the donkey Balaam is riding, which tries to avoid the angel.", "After Balaam starts punishing the donkey for refusing to move, it is miraculously given the power to speak to Balaam (Numbers 22:28), and it complains about Balaam's treatment.", "At this point, Balaam is allowed to see the angel, who informs him that the donkey is the only reason the angel did not kill Balaam.", "Balaam immediately repents, but is told to go on.", "Balak meets with Balaam at Kirjat Huzoth, and they go to the \"high places of Baal\", and offer sacrifices on seven altars, leading to Balaam being given a prophecy by Yahweh, which he speaks to Balak.", "However, the prophecy blesses Israel; Balak remonstrates, but Balaam reminds him that he can only speak the words put in his mouth, so Balak takes him to another \"high place\" at Pisgah, to try again.", "Building another seven altars here, and making sacrifices on each, Balaam provides another prophecy blessing Israel." ], [ "Donkey", "In Greek myth, Silenus is pictured in Classical Antiquity and during the Renaissance (\"illustration, left\") drunken and riding a donkey, and Midas was given the ears of an ass after misjudging a musical competition.", "Donkeys (or asses) are mentioned many times in the Bible, beginning in the first book and continuing through both Old and New Testaments, so they became part of Judeo-Christian tradition.", "They are portrayed as work animals, used for agricultural purposes, transport and as beasts of burden, and terminology is used to differentiate age and gender.", "In contrast, horses were represented only in the context of war, ridden by cavalry or pulling chariots.", "Owners were protected by law from loss caused by the death or injury of a donkey, showing their value in that time period.", "Narrative turning points in the Bible (and other stories) are often marked through the use of donkeys\u00a0\u2014 for instance, leading, saddling, or mounting/dismounting a donkey are used to show a change in focus or a decision having been made.", "They are used as a measure of wealth in Genesis 30:43, and in Genesis chapter 34, the prince of Shechem (the modern Nablus) is named Hamor (\"donkey\" in Hebrew)." ] ], "gold": "In the Old Testament, in Chapter 22 of the Book of Numbers, Numbers 22:28, the donkey is miraculously given the power to speak to Balaam. At first, an angel is seen only by the donkey Balaam is riding, and the donkey tries to avoid the angel. After Balaam starts punishing the donkey for refusing to move, the donkey is miraculously given the power to speak to Balaam. The donkey complains about Balaam's treatment of him. At this point, Balaam is allowed to see the angel, who informs him that the donkey's turning away from the messenger is the only reason the angel did not kill Balaam. Balaam immediately repents. As in this verse, donkeys are mentioned many times in both the Old and New Testaments, thus becoming part of the Judeo-Christian tradition. ", "prediction 1": "In the Bible, speaking donkeys are mentioned many times, beginning in the first book and continuing through both Old and New Testaments, so they became part of Judeo-Christian tradition. The story of Balaam, a diviner in the Torah, begins in Chapter 22 in the Book of Numbers.", "prediction 2": "There are several stories in the Bible that include the talking donkey. In the Old Testament, the talking donkey is mentioned in the Torah chapter 22, while in the New Testament, the talking donkey is mentioned in the book of Numbers at chapter 28. The talking donkey is the symbol of the god Yahweh, the Creator of the universe, in the Torah chapter 22, which is called the Book of Numbers.", "prediction 3": "According to the Bible, a talking donkey is mentioned in the Torah (Old Testament), in the Book of Numbers, and in the book of Judges. The talking donkey in Numbers is seen in the story of Balaam, a diviner who speaks in the Torah (Old Testament).", "prediction 4": "The talking donkey is mentioned in the Bible several times, beginning in the first book and continuing through both Old and New Testaments, so they became part of Judeo-Christian tradition. The story of Balaam the diviner in the Torah begins in Chapter 22 in the Book of Numbers and continues through Revelation 14:12\u201320.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 231 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "In the Bible, speaking donkeys are mentioned many times, beginning in the first book and continuing through both Old and New Testaments, so they became part of Judeo-Christian tradition. The story of Balaam begins in Chapter 22 in the Book of Numbers. At first, the angel is seen only by the donkey Balaam is riding, which tries to avoid the angel. After Balaam starts punishing the donkey for refusing to move, it is miraculously given the power to speak to Balaam, and it complains about Balaam's treatment. At this point, Balaam is allowed to see the angel, who informs him that the donkey is the only reason the angel did not kill Balaam. Balaam immediately repents, but is told to go on." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When was mandalay bay hotel in las vegas built?", "passages": [ [ "Mandalay Bay", "Mandalay Bay\n\nMandalay Bay is a 43-story luxury resort and casino on the Las Vegas Strip in Paradise, Nevada.", "It is owned and operated by MGM Resorts International.", "One of the property's towers operates as the Delano; the Four Seasons Hotel is independently operated within the Mandalay Bay tower, occupying five floors (35\u201339).", "Mandalay Bay has 3,209 hotel rooms, 24 elevators and a casino of .", "Adjacent to the hotel is the Mandalay Bay Convention Center and the 12,000-seat Mandalay Bay Events Center.", "The Mandalay Bay Tram connects the resort to its sister properties, Excalibur and Luxor, all three of which were constructed by Circus Circus Enterprises before its sale to MGM.", "In 1995, Circus Circus Enterprises bought the Hacienda for $80 million and an adjacent site for $73 million.", "They closed the Hacienda on December 1, 1996, and razed it a month later on New Year's Eve.", "Plans for the tropical-themed \"Project Paradise\" were revealed the same day, with an estimated budget of $800 million to $1 billion.", "In February 1998 the project was renamed Mandalay Bay to evoke the exotic tropical romanticism of the poem \"Mandalay\"." ], [ "Mandalay Bay", "Problems arose during construction because of excessive and uneven settling of the soil beneath the building; the core of the building sank by , while one of the wings had settled by only .", "Rumors about the severity of the issues depressed Circus Circus's stock price.", "The problem was solved by installing 536 micropiles (200-foot-long metal pipes filled with grout, each capped with a hydraulic jack) below the building, at an estimated cost of $8 million to $10 million.", "The resort opened on March 2, 1999, with grand opening festivities that included the Blues Brothers (Dan Aykroyd, James Belushi, and John Goodman) leading a procession of 200 motorcycles to Mandalay Bay's front doors, and a concert by Bob Dylan at the House of Blues.", "In June 1999, Circus Circus changed its name to Mandalay Resort Group.", "Construction of a major convention center at Mandalay Bay was begun in June 2001, with its opening originally set for the summer of 2002.", "After a delay in the wake of the September 11, 2001 attacks, the Mandalay Bay Convention Center opened in January 2003.", "With of space, it was the fifth largest convention center in the nation.", "On May 23, 2002, the Mandalay Resort Group announced a second 1,122-room hotel tower, with a cost of at least $200 million.", "Construction began on the project in September 2002." ], [ "Mandalay Resort Group", "On March 20, 1995, Circus Circus Enterprises announced that it had agreed to acquire Gold Strike Resorts, a closely held budget casino owner and operator based in Jean, Nevada, in a deal valued at more than $600 million.", "At the time of the acquisition, Gold Strike Resorts owned the Gold Strike Hotel and Gambling Hall, Nevada Landing Hotel and Casino, Railroad Pass Hotel and Casino, and 50% of the under-construction Monte Carlo Resort and Casino.", "The acquisition did not include the original Gold Strike near Boulder City, because the owners wanted to pass it on to their children.", "In 1995, Circus Circus purchased the Hacienda from Archon Corporation.", "By this time, the Hacienda was dwarfed by the many new megaresorts that were being built, in particular the Luxor, which had just been recently completed.", "On December 10, 1996, the Hacienda was closed to the public after 40 years, and imploded later that month.", "This implosion was broadcast on the Fox Network as a part of their New Year's Eve 1996 telecast.", "Despite the implosion, parts of the old resort still stood, due to the building not falling into its footprint, but toppling into its parking lot.", "The next day a wrecking crew was brought in to bring down the remaining parts.", "In March 1999, it was replaced by the Mandalay Bay." ] ], "gold": "Mandalay Bay is a 43-story luxury resort and casino on the Las Vegas Strip in Paradise, Nevada that is owned by MGM Growth Properties and The Blackstone Group and operated by MGM Resorts International. In 1995, Circus Circus Enterprises bought the Hacienda, a hotel and casino strip in Paradise, Nevada, for $80 million and an adjacent 74-acre site for $73 million, which they closed the Hacienda on December 1, 1996. Plans for the tropical-themed \"Project Paradise\" were revealed the same day, and in February 1998, the project was renamed Mandalay Bay to evoke the exotic tropical romanticism of the poem \"Mandalay.\" The resort opened on March 2, 1999, with grand opening festivities that included the Blues Brothers leading a procession of 200 motorcycles to Mandalay Bay's front doors, and a concert by Bob Dylan at the House of Blues.", "prediction 1": "Mandalay Bay is a luxury resort and casino on the Las Vegas Strip in Paradise, Nevada. It is owned and operated by MGM Resorts International. The hotel opened on March 2, 1999, with grand opening festivities that included the Blues Brothers (Dan Aykroyd, James Belushi, and John Goodman) leading a procession of 200 motorcycles to Mandalay Bay's front doors, and a concert by Bob Dylan at the House of Blues. On May 23, 2002, the Mandalay Resort Group announced a second 1,122-room hotel tower, with a cost of at least $200 million. Construction began on the project in September 2002.", "prediction 2": "Mandalay Bay is a 43-story luxury resort and casino on the Las Vegas Strip in Paradise, Nevada. It's owned and operated by MGM Resorts International. The Mandalay Bay Hotel opened on March 2, 1999. Construction of a major convention center at Mandalay Bay was begun in June 2001, with its opening originally set for the summer of 2002. After a delay in the wake of the September 11, 2001 attacks, the Mandalay Bay Convention Center opened in January 2003.", "prediction 3": "Mandalay Bay is a 43-story luxury resort and casino on the Las Vegas Strip in Paradise, Nevada. It is owned and operated by MGM Resorts International. Construction of the Mandalay Bay Convention Center, which was originally set for the summer of 2002, was delayed in the wake of the September 11, 2001 attacks and was finally completed in January 2003. On May 23, 2002, the Mandalay Resort Group announced a second 1,122-room hotel tower, with a cost of at least $200 million, which was underway in September 2002. Construction began on the project in September 2002.", "prediction 4": "Mandalay Bay is a 43-story luxury resort and casino on the Las Vegas Strip in Paradise, Nevada. It is owned and operated by MGM Resorts International. The hotel opened on March 2, 1999, after plans for a tropical-themed \"Project Paradise\" were revealed the same day. Construction of a major convention center at Mandalay Bay began in June 2001, with its opening originally set for the summer of 2002.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 532 }, { "error type": "Irrelevant", "explanation": "", "start": 533, "end": 585 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Mandalay Bay is a luxury resort and casino on the Las Vegas Strip in Paradise, Nevada. It is owned and operated by MGM Resorts International. In 1995, Circus Circus Enterprises bought the Hacienda for $80 million and an adjacent site for $73 million. They closed the Hacienda on December 1, 1996. Plans for the tropical-themed \"Project Paradise\" were revealed the same day. In February 1998 the project was renamed Mandalay Bay to evoke the exotic tropical romanticism of the poem \"Mandalay\". The hotel opened on March 2, 1999, with grand opening festivities that included the Blues Brothers (Dan Aykroyd, James Belushi, and John Goodman) leading a procession of 200 motorcycles to Mandalay Bay's front doors, and a concert by Bob Dylan at the House of Blues. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the original actor who played maigret?", "passages": [ [ "Maigret (1960 TV series)", "Maigret (1960 TV series)\n\nMaigret is a British television series made by the BBC and which \u2013 following a pilot episode broadcast in 1959 \u2013 ran for 52 episodes from 1960 to 1963.", "Based on the Maigret stories of Georges Simenon, the series starred Rupert Davies in the title role.", "The series starred Rupert Davies as the S\u00fbret\u00e9 detective Commissaire Jules Maigret, who took up the role in 1960 after Basil Sydney, who had played Maigret in the pilot episode, was unable to continue.", "The main cast were:-\n\nEpisodes included such well-known faces as Stratford Johns, Leon Cortez, Terence Alexander, Roger Delgado, William Franklyn, Michael Goodliffe, and Barry Foster, among others.", "Although staying largely true to the storyline of the books, the series featured only three of Maigret's team of detectives (the \u201cfaithful four\u201d, omitting any casting for Janvier.", "The choice of Davies to play Maigret was enthusiastically approved by Simenon himself.", "Remembering the role in a 1964 interview Davies said \"When Andrew Osborn, the producer of the show, offered me the part on Good Friday in 1960, I knew very little about Maigret.", "I knew he was a famous French fictional detective, but that was all.\"" ], [ "Rupert Davies", "Rupert Davies\n\nRupert Davies FRSA (22 May 191622 November 1976) was a British actor best remembered for playing the title role in the BBC's 1960s television adaptation of \"Maigret\", based on Georges Simenon's \"Maigret\" novels.", "Davies was born in Liverpool, Lancashire.", "After service in the British Merchant Navy he was a Sub-Lieutenant Observer with the Fleet Air Arm during the Second World War.", "In 1940, the Swordfish aircraft in which he was flying ditched in the sea off the Dutch coast, following which Davies was captured and interned in the Stalag Luft III prisoner of war camp.", "He made three attempts to escape, all of which failed.", "During his captivity he began to take part in theatre performances, entertaining his fellow prisoners.", "On his release Davies resumed his career in acting almost immediately, starring in an ex-prisoner of war show, \"Back Home\", which was hosted at the Stoll Theatre, London.", "In 1959, he played the role of the Colonel in Alun Owen's \"The Rough and Ready Lot\" when it received its stage debut on 1 June 1959 in a production by the 59 Theatre Company at the Lyric Opera House, Hammersmith, as well as in the television adaptation which was broadcast that September." ], [ "Rupert Davies", "He became a staple of British television, appearing in numerous plays and series, including \"Quatermass II\", \"Ivanhoe\", \"Emergency - Ward 10\", \"Danger Man\", \"Man in a Suitcase\", \"The Champions\", \"Doctor at Large\" (1971), \"Arthur of the Britons\" and \"War and Peace\" (1972).", "He also provided the voice of Professor Ian \"Mac\" McClaine in the Gerry Anderson series \"Joe 90\".", "A pipe smoker, like Jules Maigret, in 1964, having released a 45rpm single \"Smoking My Pipe\" late the previous year that capitalised on the iconic \"Maigret\" opening sequence, he became the first person to win the Pipe Smoker of the Year award.", "He was the subject of \"This Is Your Life\" in October 1962 when he was surprised by Eamonn Andrews in central London.", "Davies also played supporting roles in many films, appearing briefly as George Smiley in \"The Spy Who Came in from the Cold\" (1965).", "He also appeared in several horror films in the late 1960s, including \"Witchfinder General\" (1968) and \"Dracula Has Risen from the Grave\" (1968), as well as such international films as \"Waterloo\" (1970) and \"Zeppelin\" (1971)." ] ], "gold": "Maigret is a British television series, which was based on the Maigret stories of Georges Simenon and following a pilot episode broadcast in 1959, ran for 51 episodes from 1960 to 1963. Basil Sydney played the starring role, Police Judiciaire detective Commissaire Jules Maigret, in the pilot episode, but was unable to continue. British actor Rupert Davies took over the role for the full run of the series. Davies became a staple of British television, appearing in numerous plays and series, including Quatermass II, Ivanhoe, Emergency - Ward 10, Danger Man, Man in a Suitcase, The Champions, Doctor at Large, Arthur of the Britons and War and Peace. ", "prediction 1": "Basil Sydney played the role of Jules Maigret in the pilot episode of the 1960 television series Maigret. In the series, however, Rupert Davies played the title role.", "prediction 2": "Basil Sydney played Maigret in the original 1960 BBC TV series Maigret. Sydney played Maigret in the pilot episode and the rest of the series. Rupert Davies played the title role in the 1960 TV series Maigret. The English actor best remembered for playing the title role in the BBC's 1960s television adaptation of \"Maigret\", based on Georges Simenon's Maigret novels.", "prediction 3": "Basil Sydney, who had played Maigret in the pilot episode of the English television series Maigret, was unable to continue and took up the role of Maigret in 1960, following a pilot episode broadcast in 1959. The series starred Rupert Davies as the S\u00fbret\u00e9 detective Commissaire Jules Maigret, who took up the role in 1960 after Sydney, who had played Maigret in the pilot episode, was unable to continue.", "prediction 4": "Maigret is a British detective television series based on the novels of Georges Simenon. Basil Sydney, who had played Maigret in the pilot episode, was unable to continue. The original actor who played Maigret was Robert Edwards, who starred in the pilot episode of the series. Rupert Davies took up the role in 1960 after Sydney, who had played Maigret in the pilot episode, was unable to continue.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Maigret is a British television series, which was based on the Maigret stories of Georges Simenon and following a pilot episode broadcast in 1959, ran for 51 episodes from 1960 to 1963. The series starred Rupert Davies as the S\u00fbret\u00e9 detective Commissaire Jules Maigret, who took up the role in 1960 after Basil Sydney, who had played Maigret in the pilot episode, was unable to continue. Davies became a staple of British television, appearing in numerous plays and series, including \"Quatermass II\", \"Ivanhoe\", \"Emergency - Ward 10\", \"Danger Man\", \"Man in a Suitcase\", \"The Champions\", \"Doctor at Large\", \"Arthur of the Britons\" and \"War and Peace\"." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who were the first immigrants that came to america?", "passages": [ [ "History of immigration to the United States", "Elsewhere internal American migration from other colonies provided nearly all of the settlers for each new colony or state.", "Populations grew by about 80% at a 3% \"natural\" annual growth rate sustained over a 20-year interval.", "Over half of all new British immigrants in the South initially arrived as indentured servants.", "They were mostly poor young people who could not find work in England and could not afford passage to America.", "In addition, about 60,000 British convicts were transported to the British colonies in the 18th century.", "Most of these so-called convicts were guilty of being very poor and out of work.", "\"Serious\" criminals were generally executed.", "Ironically, these \"convicts\" are often the only immigrants with nearly complete immigration records as other immigrants typically showed up with few or no records.", "Although Spain set up a few forts in Florida, notably San Agust\u00edn (present-day Saint Augustine) in 1565, they sent few settlers to Florida.", "Spaniards moving north from Mexico founded the San Juan on the Rio Grande in 1598, and Santa Fe in 1607\u20131608.", "The settlers were forced to leave temporarily for 12 years (1680\u20131692) by the Pueblo Revolt before returning.", "Spanish Texas lasted from 1690 to 1821 when Texas was governed as a colony which was separate from New Spain.", "In 1731, Canary Islanders (or \"Isle\u00f1os\") arrived to establish San Antonio." ], [ "Tagalog people", "The first Asian-origin people known to arrive in North America after the beginning of European colonization were a group of Filipinos known as \"Luzonians\" or Luzon Indians who were part of the crew and landing party of the Spanish galleon \"Nuestra Se\u00f1ora de la Buena Esperanza\".", "The ship set sail from Macau and landed in Morro Bay in what is now the California coast on October 17 of 1587, as part of the Galleon Trade between the Spanish East Indies (the colonial name for what would become the Philippines) and New Spain (Spain's colonies in North America).", "More Filipino sailors arrived along the California coast when both places were part of the Spanish Empire.", "By 1763, \"Manila men\" or \"Tagalas\" had established a settlement called St. Malo on the outskirts of New Orleans, Louisiana.", "The Tagalog played an active role during the 1896 Philippine Revolution and many of its leaders were either from Manila or surrounding provinces.", "The Katipunan once intended to name the Philippines as \"\"Katagalugan\"\" or the Tagalog Republic, and extended the meaning of these terms to all natives in the Philippine islands.", "Miguel de Unamuno described revolutionary leader Jos\u00e9 Rizal (1861\u20131896) as the \"Tagalog Hamlet\" and said of him \u201ca soul that dreads the revolution although deep down desires it." ], [ "History of immigration to the United States", "History of immigration to the United States\n\nThe history of immigration to the United States details the movement of people to the United States starting with the first European settlements from around 1600.", "Beginning around this time, British and other Europeans settled primarily on the east coast.", "In 1619, Africans began being imported as slaves.", "The United States experienced successive waves of immigration, particularly from Europe.", "Immigrants sometimes paid the cost of transoceanic transportation by becoming indentured servants after their arrival in the New World.", "Later, immigration rules became more restrictive; the ending of numerical restrictions occurred in 1965.", "Recently, cheap air travel has increased immigration from Asia and Latin America.", "Attitudes towards new immigrants have cycled between favorable and hostile since the 1790s.", "In 1607 the first successful English colony settled in Jamestown, Virginia.", "Once tobacco was found to be a profitable cash crop, many plantations were established along the Chesapeake Bay in Virginia and Maryland.", "Thus began the first and longest era of immigration, lasting until the American Revolution in 1775; during this time settlements grew from initial English toe-holds from the New World to British America.", "It brought Northern European immigrants, primarily of British, German, and Dutch extraction.", "The British ruled from the mid-17th century and they were by far the largest group of arrivals, remaining within the British Empire.", "Over 90% of these early immigrants became farmers." ] ], "gold": "British and other Europeans were the first immigrants that came to North America and established successful colonies. In 1607 the first successful English colony settled in Jamestown, Virginia. The first immigrants that came to America, settling in Florida and Mexico were the Spaniards. The first Asian-origin people known to arrive in North America after the beginning of the European colonization were a group of Filipinos known as \"Luzonians\" or Luzon Indians.", "prediction 1": "The history of immigration to the United States details the movement of people to the United States starting with the first European settlements around 1600. Beginning around this time, British and other Europeans settled primarily on the east coast. In 1619, Africans began being imported as slaves. The first Americans to arrive in the United States were Indians from the Philippines, who were part of the crew and landing party of the Spanish galleon Nuestra Seora de la Buena Esperanza.", "prediction 2": "The history of immigration to the United States details the movement of people to the United States starting with the first European settlements around 1600. Beginning around this time, British and other Europeans settled primarily on the east coast. In 1619, Africans began being imported as slaves. The first Asian-origin people known to arrive in North America after the beginning of European colonization were a group of Filipinos known as \"Luzonians\" or Luzon Indians who were part of the crew and landing party of the Spanish galleon \"Nuestra Seora Esperanza\", which was founded in 161587. The first Africans arrived in 161587.", "prediction 3": "The history of immigration to the United States details the movement of people to the United States starting with the first European settlements from around 1600. Beginning around this time, British and other Europeans settled primarily on the east coast. In 1619, Africans began being imported as slaves. The first immigrants from Asia known to arrive in the United States from 1607 were Filipinos known as \"Luzonians\" or Luzon Indians, part of the crew and landing party of the Spanish galleon \"Nuestra Seora de la Buena Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza Esperanza.", "prediction 4": "The history of immigration to the United States details the movement of people to the United States starting with the first European settlements around 1600. Beginning around this time, British and other Europeans settled primarily on the east coast. In 1619, Africans began being imported as slaves. The United States experienced successive waves of immigration, particularly from Europe. Immigrants sometimes paid the cost of transoceanic transportation by becoming indentured servants after their arrival in the New World. In the early 15th century, the first group of immigrants was the crew and landing party of the Spanish galleon Nuestra Seora Esperanza Esperanza. In 1620, they arrived in the US from the Philippines. However, they were a group of Filipinos known as Luzonians or Luzon Indians. By 1731, Canary Islanders arrived to establish San Antonio. They were part of the crew and landing party of", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 300 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 311, "end": 351 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 490 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10, 9 ] } ], "corrected-prediction": "The history of immigration to the United States details the movement of people to the United States starting with the first European settlements around 1600. In 1607 the first successful English colony settled in Jamestown, Virginia. In 1619, Africans began being imported as slaves. The first Asian-origin people known to arrive in North America after the beginning of European colonization were Indians from the Philippines, known as \"Luzonians\" or Luzon Indians. The first immigrants that came to America, settling in Florida and Mexico were the Spaniards." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many time brazil runner up in world cup?", "passages": [ [ "Brazil at the FIFA World Cup", "Brazil at the FIFA World Cup\n\n", "This articles summarizes the results and overall performance of Brazil at the FIFA World Cup.", "The tournament consists of two parts, the qualification phase and the final phase, officially called the World Cup Finals.", "The qualification phase, which currently takes place over the three years preceding the Finals, is used to determine which teams qualify for the Finals.", "The current format of the Finals involves 32 teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated over 1 billion people watching the 2014 tournament final.", "Brazil is the most successful national team in the history of the World Cup, having won five titles, earning second-place, third-place and fourth-place finishes twice each.", "Brazil is one of the countries besides Argentina, Spain and Germany to win a FIFA World Cup away from its continent (Sweden 1958, Mexico 1970, USA 1994 and South Korea/Japan 2002).", "Brazil is the only national team to have played in all FIFA World Cup editions without any absence or need for playoffs.", "Brazil also has the best overall performance in World Cup history in both proportional and absolute terms with a record of 73 victories in 109 matches played, 124 goal difference, 237 points and only 18 losses." ], [ "Brazil national rugby union team", "Brazil national rugby union team\n\nThe Brazil national rugby union team, nicknamed Tupis, is controlled by the Confedera\u00e7\u00e3o Brasileira de Rugby.", "Brazil is one of the founding unions of CONSUR (now Sudam\u00e9rica Rugby) and played in the inaugural South American tournament.", "Brazil has not qualified for a Rugby World Cup, but participated in the first edition of rugby 7s in the Olympics.", "Brazil currently ranks 3rd in South America (behind Argentina and Uruguay) and 5th in the Americas region.", "Rugby union in Brazil has a long history, dating back to the late 19th century when British immigrants brought the game to Brazil's urban ports.", "Despite Brazil's success in association football, Brazil has historically been one of the weaker teams of the Americas, having less success than that of Argentina, Uruguay or Chile.", "In the 21st century, efforts were made to revitalize the sport in Brazil.", "With rugby sevens being added to the Olympic calendar, Brazil was invited to the World Rugby Sevens Series, showing improvement in both the men's and women's series.", "In 2016, a meeting with the unions of Argentina, Brazil, Canada, Chile, the United States and Uruguay established the Americas Rugby Championship, meant to mirror the Six Nations and The Rugby Championship, and give consistent tests to the top teams in the region." ] ], "gold": "The FIFA World Cup consists of two parts, the qualification phase and the final phase, officially called the World Cup Finals. The qualification phase, which currently takes place over the three years preceding the Finals, is used to determine which teams qualify for the Finals. Both the men's and women's teams from Brazil have been the runner up in the World Cup 1 time each. The Brazil nation rugby union team has not qualified for a Rugby World Cup, thus has 0 times appearing as the runner up.", "prediction 1": "Brazil has finished as runner up in five FIFA World Cups. The team has finished second, third and fourth in four consecutive World Cups. Brazil has finished as runner up in five FIFA World Cups. There have been three times Brazil finished as runner up in the world cup.", "prediction 2": "Brazil finished second in the 2010 FIFA World Cup in Russia, in 2014 Brazil finished second in the 2014 FIFA World Cup, and in 2014 Brazil finished third in the 2014 FIFA World Cup. Brazil has finished second in both the 2010 and 2014 FIFA World Cups in both football and rugby.", "prediction 3": "Brazil has finished as runner up in the FIFA World Cup four times, including three times as runner up in the quarterfinals, and one time as runner up in the quarterfinals. Brazil finished as runner up in the men's and three times as the women's finalists in the 2014 edition. Brazil finished as runners up in both the FIFA World Cup and the Rugby World Cup.", "prediction 4": "Brazil has finished as runners up in the FIFA World Cup five times, and as runners up in the Rugby World Cup three times. In the men's competition in the World Cup, Brazil finished as runner up three times, and as runner up four times.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 58, "end": 136 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 0, "end": 57 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 137, "end": 194 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 195, "end": 269 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The FIFA World Cup consists of two parts, the qualification phase and the final phase, officially called the World Cup Finals. The qualification phase, which currently takes place over the three years preceding the Finals, is used to determine which teams qualify for the Finals. Brazil has finished as runner up in two FIFA World Cups. The Brazil nation rugby union team has not qualified for a Rugby World Cup." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who wrote the score for fiddler on the roof?", "passages": [ [ "Fiddler on the Roof", "Fiddler on the Roof\n\nFiddler on the Roof is a musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905.", "It is based on \"Tevye and his Daughters\" (or \"Tevye the Dairyman\") and other tales by Sholem Aleichem.", "The story centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "He must cope both with the strong-willed actions of his three older daughters, who wish to marry for love \u2013 each one's choice of a husband moves further away from the customs of their Jewish faith and heritage \u2013 and with the edict of the Tsar that evicts the Jews from their village.", "The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances.", "\"Fiddler\" held the record for the longest-running Broadway musical for almost 10 years until \"Grease\" surpassed its run.", "It remains the sixteenth longest-running show in Broadway history.", "The production was extraordinarily profitable and highly acclaimed.", "It won nine Tony Awards, including Best Musical, score, book, direction and choreography." ] ], "gold": "Fiddler on the Roof is a musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in or around 1905. It is based on Tevye and his Daughters and other tales by Sholem Aleichem. The story centers on Tevye, a milkman in the village of Anatevka, who attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon his family's lives. He must cope with the strong-willed actions of his three older daughters who wish to marry for love; their choices of husbands are successively less palatable for Tevye.", "prediction 1": "Fiddler on the Roof is a musical musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905. The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. Jerry Bock wrote the music for the show. He also wrote the lyrics for the show. Jerry Bock wrote the score for the show. Jerry Bock wrote the lyrics and choreography for the original Broadway production was extraordinarivier.", "prediction 2": "Fiddler on the Roof is a musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905. It is based on Tevye and his Daughters and other tales by Sholem Aleichem. The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. Jerry Bock wrote the score for the show.", "prediction 3": "Fiddler on the Roof is a musical musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905. The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. Jerry Bock wrote the score for the show.", "prediction 4": "Fiddler on the Roof is a musical comedy musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905. The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. Jerry Bock was the composer of the score for the original Broadway production of the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 321 }, { "error type": "Redundant", "explanation": "The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances. ", "start": 322, "end": 465 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 507, "end": 545 }, { "error type": "Unverifiable", "explanation": "", "start": 546, "end": 586 }, { "error type": "Unverifiable", "explanation": "", "start": 587, "end": 691 }, { "error type": "Redundant", "explanation": "Fiddler on the Roof is a musical musical with music by Jerry Bock", "start": 466, "end": 506 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Fiddler on the Roof is a musical musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905. It is based on \"Tevye and his Daughters\" (or \"Tevye the Dairyman\") and other tales by Sholem Aleichem. The story centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives. He must cope both with the strong-willed actions of his three older daughters, who wish to marry for love \u2013 each one's choice of a husband moves further away from the customs of their Jewish faith and heritage \u2013 and with the edict of the Tsar that evicts the Jews from their village. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Cost to make let there be light movie?", "passages": [ [ "Let There Be Light (1998 film)", "Let There Be Light (1998 film)\n\n", "Let There Be Light (original title: Que la lumi\u00e8re soit !)", "is a 1998 comedy fantasy film directed by Arthur Joff\u00e9, starring an ensemble cast." ], [ "Let There Be Light (2017 film)", "Let There Be Light (2017 film)\n\n", "Let There Be Light is a 2017 American Christian drama film directed by and starring Kevin Sorbo and written by Dan Gordon and Sam Sorbo.", "The plot follows an atheist who goes through a near-death experience in an auto accident and converts to Christianity.", "Sean Hannity executive produced and appears in the film.", "Dionne Warwick and Travis Tritt also have roles in the film.", "It was released in the United States on October 27, 2017.", "Outspoken atheist Dr. Sol Harkens is having a debate with a Christian leader.", "After Harkens is considered to have won the debate, he attends a party for his book.", "He double fists cocktails while trying to get his girlfriend to come home with him that night; she refuses.", "Disappointed, Harkens heads home in a drunken haze to sleep it off.", "On the way home, his publicist calls him to arrange more parties to increase his exposure.", "Since he was already drunk after leaving his party and continues to drink on the way home, he veers off and crashes into a construction site.", "Suddenly surrounded by a carnival-like light tunnel, he sees hallucinations of his young son David, who died a few years prior from cancer." ] ], "gold": "There are several movies with the title \"Let There Be Light\". \"Let There Be Light\" is a 1998 comedy fantasy film directed by Arthur Joff\u00e9, starring an ensemble cast, that cost FRF60,000,000 to make. \"Let There Be Light\" is a 2017 American Christian drama directed by and starring Kevin Sorbo and written by Dan Gordon and Sam Sorbo. The 2017 movie cost $3 million. The 2019 \"Let There Be Light\" movie cost EUR800,000 to make.", "prediction 1": "Let There Be Light is a 2017 American Christian drama film directed by Kevin Sorbo and written by Dan Gordon and Sam Sorbo. The plot follows an atheist who goes through a near-death experience in an auto accident and converts to Christianity. Sean Hannity executive produced and appears in the film. Dionne Warwick and Travis Tritt also have roles in the film. It was released in the United States on October 27, 2017.", "prediction 2": "Let There Be Light is a 2017 American Christian drama film directed by and starring Kevin Sorbo and written by Dan Gordon and Sam Sorbo. The plot follows an atheist who goes through a near-death experience in an auto accident and converts to Christianity. Sean Hannity executive produced and appears in the film. Dionne Warwick and Travis Tritt also have roles in the film. The film was released in the United States on October 27, 2017.", "prediction 3": "Let There Be Light is a 2017 American Christian drama film directed by and starring Kevin Sorbo and written by Dan Gordon and Sam Sorbo. The plot follows an atheist who goes through a near-death experience in an auto accident and converts to Christianity. Sean Hannity executive produced and appears in the film. Dionne Warwick and Travis Tritt also have roles in the film.", "prediction 4": "Let There Be Light is a 2017 American Christian drama film that follows an atheist who goes through a near-death experience in an auto accident and converts to Christianity. Sean Hannity executive produced and appears in the film. Dionne Warwick and Travis Tritt also have roles in the film. The film cost approximately $24 million to make.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 242 }, { "error type": "Irrelevant", "explanation": "", "start": 243, "end": 299 }, { "error type": "Irrelevant", "explanation": "", "start": 300, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 361, "end": 418 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Let There Be Light\" is a 1998 comedy fantasy film directed by Arthur Joff\u00e9, starring an ensemble cast. Let There Be Light is a 2017 American Christian drama film directed by Kevin Sorbo and written by Dan Gordon and Sam Sorbo. " }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Who talks for lotso in toy story 3?", "passages": [ [ "Ken (doll)", "Mattel defended the doll's name, saying that the puppy's name is \"Sugar\", thus making Ken \"Sugar's Daddy\".", "He was also in the 2010 Pixar film \"Toy Story 3\", voiced by Michael Keaton.", "Ken was one of the henchmen of the film's villain Lotso (Ned Beatty).", "In 2011, Mattel introduced Japan Ken, the first Ken doll to be included in the Dolls of the World collection, which was formerly a Barbie-only line.", "The Japan Ken doll features a new face sculpt.", "In Mattel's official \"\" web series, Ken's personality was greatly expounded on.", "Most notably, his love for inventing.", "Ken's personal name is Kenneth Sean Carson.", "His given name comes from Elliot Handler's son.", "In the 1960s Random House books, his surname is Carson.", "According to Mattel, his middle name is Sean." ] ], "gold": "Ned Thomas Beatty is the voice of Lotso in Toy Story 3, both the film and the video game.", "prediction 1": "Ken was one of the henchmen of the 2010 Pixar film Toy Story 3's villain Lotso. Ned Beatty talks for Lotso in toy story 3.", "prediction 2": "In the 2010 Pixar movie \"Toy Story 3\", Ned Beatty voices the evil villain Lotso. In the official Toy Story web series, Ken's personality was greatly expounded on.", "prediction 3": "Ned Beatty was the actor who spoke for Lotso in Toy Story 3.", "prediction 4": "Ken was one of the henchmen of the 2010 Pixar film Toy Story 3's villain Lotso, voiced by Michael Keaton. Ken was also in the 2011 Mattel web series, \"Toy Story 2: The Movie\", voiced by Michael Keaton.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Ken was one of the henchmen of the 2010 Pixar film Toy Story 3's villain Lotso. Ned Beatty talks for Lotso in toy story 3." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who came up with the joke why did the chicken cross the road?", "passages": [ [ "Why did the chicken cross the road?", "Why did the chicken cross the road?", "\"Why did the chicken cross the road?\" is a common riddle joke, with the answer being \"to get to the other side\".", "It is an example of anti-humor, in that the curious setup of the joke leads the listener to expect a traditional punchline, but they are instead given a simple statement of fact.", "\"Why did the chicken cross the road?\" has become iconic as an exemplary generic joke to which most people know the answer, and has been repeated and changed numerous times over the course of history.", "The riddle appeared in an 1847 edition of \"The Knickerbocker\", a New York City monthly magazine:\nThere are 'quips and quillets' which \"seem\" actual conundrums, but yet are none.", "Of such is this: 'Why does a chicken cross the street?", "['] Are you 'out of town?'", "Do you 'give it up?'", "Well, then: 'Because it wants to get on the other side!'", "In the 1890s, a pun variant version appeared in the magazine \"Potter's American Monthly\":\n\nWhy should not a chicken cross the road?", "It would be a fowl proceeding.", "The origins of this joke emerged from picket lines during labor strikes in 19th-century America." ] ], "gold": "\"Why did the chicken cross the road?\" is a common riddle joke, with the answer being \"To get to the other side\". It has become iconic as an exemplary generic joke to which most people know the answer, and has been repeated and changed numerous times over the course of history. In its history, the riddle appeared in an 1847 edition of The Knickerbocker, a New York City monthly magazine: \"There are 'quips and quillets' which seem actual conundrums, but yet are none. Of such is this: 'Why does a chicken cross the street? Are you 'out of town?' Do you 'give it up?' Well, then: 'Because it wants to get on the other side!\" In the 1890s, a pun variant version also appeared in the magazine Potter's American Monthly: Why should not a chicken cross the road? It would be a fowl proceeding.", "prediction 1": "The riddle joke \"Why did the chicken cross the road?\" originated in an 1847 edition of \"The Knickerbocker\", a New York City monthly magazine. The origins of this joke emerged from picket lines during labor strikes in 19th-century America.\n", "prediction 2": "The riddle \"Why did the chicken cross the road?\" originated in an 1847 edition of The Knickerbocker, a New York City monthly magazine. What then became a classic joke, along with other riddles, was that a chicken crossed the road to \"get to the other side\".", "prediction 3": "The riddle joke \"Why did the chicken cross the road?\" originated in an 1847 edition of \"The Knickerbocker\", a New York City monthly magazine. The chicken is said to cross the road \"to get to the other side.\" The origins of this joke emerged from picket lines during labor strikes in 19th-century America.", "prediction 4": "The riddle joke Why did the chicken cross the road emerged from picket lines during labor strikes in 19th-century America.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "\"Why did the chicken cross the road?\" is a common riddle joke, with the answer being \"to get to the other side\". It has become iconic as an exemplary generic joke to which most people know the answer, and has been repeated and changed numerous times over the course of history. The riddle appeared in an 1847 edition of \"The Knickerbocker\", a New York City monthly magazine: There are 'quips and quillets' which \"seem\" actual conundrums, but yet are none. Of such is this: 'Why does a chicken cross the street? Are you 'out of town?' Do you 'give it up?' Well, then: 'Because it wants to get on the other side! In the 1890s, a pun variant version appeared in the magazine \"Potter's American Monthly\": Why should not a chicken cross the road? It would be a fowl proceeding. The origins of this joke emerged from picket lines during labor strikes in 19th-century America.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When was the original charlie and the chocolate factory made?", "passages": [], "gold": "The original Charlie and the Chocolate Factory was published in the US on January 17, 1964, and in the UK on November 23, 1964.", "prediction 1": "The original Charlie and the Chocolate Factory was made in 1964.", "prediction 2": "The original Charlie and the Chocolate Factory was made in 1985.", "prediction 3": "The original Charlie and the Chocolate Factory was made in 1963.", "prediction 4": "The original Charlie and the Chocolate Factory was made in 1984.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 64 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who turns out to be the mother in how i met your mother?", "passages": [ [ "The Mother (How I Met Your Mother)", "The Mother (How I Met Your Mother)\n\nTracy McConnell (colloquial: \"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\".", "The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother.", "Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "The Mother is played by Cristin Milioti.", "The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment.", "Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in \"Last Forever\", the series finale.", "The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "An alternate ending was released in the ninth season DVD." ] ], "gold": "Tracy Mosby (n\u00e9e McConnell) is the title character from the CBS television sitcom How I Met Your Mother. Cristin Milioti played Tracy on the show.", "prediction 1": "In the television sitcom \"How I Met Your Mother\", the story of how Ted Mosby met The Mother is the framing device behind the show. The Mother is played by Cristin Milioti.", "prediction 2": "The Mother is the title character in the CBS television sitcom How I Met Your Mother. The show, narrated by Future Ted, tells the story of how Ted Mosby met The Mother. The Mother is played by Cristin Milioti.", "prediction 3": "The Mother of the CBS sitcom \"How I Met Your Mother\" is played by actress Cristin Milioti. In the show, the story of how Ted Mosby met The Mother is the framing device behind the series. Many facts about the character are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment. The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "prediction 4": "The mother in the sitcom How I Met Your Mother turns out to be Tracy McConnell, played by Cristin Milioti. The show tells the story of how Ted Mosby met The Mother, which is the framing device behind the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 130 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Tracy Mosby (n\u00e9e McConnell) is the title character from the CBS television sitcom How I Met Your Mother. The Mother is played by Cristin Milioti." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When was the last time notre dame won a bowl game?", "passages": [ [ "2013 Pinstripe Bowl", "2013 Pinstripe Bowl\n\nThe 2013 Pinstripe Bowl was an American college football bowl game that was played on December 28, 2013 at Yankee Stadium in the New York City borough of The Bronx.", "It was one of the 2013\u201314 bowl games that concluded the 2013 FBS football season.", "The fourth edition of the Pinstripe Bowl, it featured the Rutgers Scarlet Knights (based in nearby New Brunswick, New Jersey) of the American Athletic Conference against the Notre Dame Fighting Irish, an independent team.", "It began at 12:00 noon EST and aired on ESPN.", "The game was sponsored by the New Era Cap Company, and was officially known as the New Era Pinstripe Bowl.", "Notre Dame defeated Rutgers by a score of 29\u201316.", "Notre Dame's championship was vacated on February 13, 2018, due to an academic cheating scandal.", "Because of this the win will be taken away from Notre Dame record books.", "The Fighting Irish accepted their invitation after earning an 8\u20134 record for the season, while the Scarlet Knights accepted their invitation after earning a 6\u20136 record.", "This was the final game for Rutgers as a member of the American Athletic Conference.", "They joined the Big Ten Conference in the 2014 season, and the Pinstripe Bowl followed suit with a conference tie-in with the Big Ten starting in 2014." ], [ "2014 Music City Bowl", "2014 Music City Bowl\n\nThe 2014 Music City Bowl was an American college football bowl game played on December 30, 2014 at LP Field in Nashville, Tennessee.", "The 17th edition of the Music City Bowl began at approximately 2:00\u00a0p.m. CST and was broadcast nationally by ESPN.", "It featured the Notre Dame Fighting Irish, and the LSU Tigers from the SEC.", "It was one of the final 2014-15 bowl games of the 2014 FBS football season.", "The game was sponsored by the Franklin American Mortgage Company and is officially known as the Franklin American Mortgage Music City Bowl.", "Notre Dame defeated Louisiana State by a final score of 31\u201328.", "The game was the eleventh overall meeting between these two teams, with the series previously tied 5\u20135.", "The last time these two teams met was in 2006.", "It represented the third bowl game between these two teams; the previous bowls were the 1997 Independence Bowl and the 2007 Sugar Bowl.", "Source:" ], [ "2016 Fiesta Bowl (January)", "2016 Fiesta Bowl (January)\n\nThe 2016 Fiesta Bowl was a college football bowl game that was played on January 1, 2016 at University of Phoenix Stadium in Glendale, Arizona.", "The 44th Fiesta Bowl was one of the New Year's Bowls.", "It was one of the 2015\u201316 bowl games that concluded the 2015 FBS football season.", "The game was televised on ESPN and ESPN Deportes, and broadcast on ESPN Radio and XM Satellite Radio, with the kickoff time set for 1:00 P.M. ET (11 A.M. MT).", "Sponsored by obstacle racing series BattleFrog, it was officially known as the BattleFrog Fiesta Bowl.", "Coincidentally, it took place 10 years after the 2006 Fiesta Bowl, that was also played by Ohio State and Notre Dame.", "That was also the last time Notre Dame participated in the Fiesta Bowl.", "Ohio State wound up beating Notre Dame, 44-28.", "The two participants for the game will be determined by the College Football Playoff selection committee, and will consist of at-large selections and/or the highest ranked team from the \"Group of Five\" conferences.", "The two participants are going to be the #8 Notre Dame Fighting Irish at 10-2 VS The #7 Ohio State Buckeyes at 11-1.", "Source:" ] ], "gold": "Notre Dame has won several bowl games. The most recent bowl game victories include the pinstripe bowl game on December 28, 2013, the music city bowl game on December 30, 2014, and the fiesta bowl game on January 1, 2016.", "prediction 1": "The last time Notre Dame won a bowl game was on February 13, 2018, due to an academic cheating scandal. In 2013, the Pinstripe Bowl was played on December 28, 2013. In 2014, the Music City Bowl was played on December 30, 2014. In 2016, the Fiesta Bowl was played on January 1, 2016.", "prediction 2": "The last time Notre Dame won a bowl game was on July 9, 2012. The last time the Fighting Irish won a bowl game was on November 12, 2009.", "prediction 3": "The last time Notre Dame won a bowl game was in 2003. In 2009, the last time Notre Dame won a bowl game was in 2010. In 2010, the last time Notre Dame won a bowl game was in 2010. In 2013, the last time Notre Dame won a bowl game was in 2012. In 2016, the last time Notre Dame won a bowl game was in 2016. In 2017, the last time Notre Dame won a bowl game was in 2016.", "prediction 4": "The last time Notre Dame won a bowl game was on February 13, 2018, when its championship was vacated due to an academic cheating scandal. The 2014 Music City Bowl was an American college football bowl game played on December 30, 2014 at LP Field in Nashville, Tennessee. The 44th Fiesta Bowl was one of the New Year's Bowls, and it was one of the 2015\u201316 bowl games that concluded the 2015 FBS football season. The 2015-2016 season ended on January 1, 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 282 } ], "missing-info": [], "corrected-prediction": "Notre Dame has won several bowl games. In 2013, they won the Pinstripe Bowl that was played on December 28, 2013 and in 2014, the Music City Bowl that was played on December 30, 2014." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When did northern ireland and southern ireland separate?", "passages": [ [ "Partition of Ireland", "Partition of Ireland\n\nThe partition of Ireland () divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland.", "It took place on 3 May 1921 under the Government of Ireland Act 1920.", "Today the former is still known as Northern Ireland and forms part of the United Kingdom, while the latter is now a sovereign state also named Ireland and sometimes called the Republic of Ireland.", "The Act of 1920 was intended to create two self-governing territories within Ireland, with both remaining within the United Kingdom.", "It also contained provisions for co-operation between the two territories and for the eventual reunification of Ireland.", "However, in 1922, following the War of Independence and the Anglo-Irish Treaty, the southern part became the Irish Free State, while Northern Ireland exercised its option to remain in the United Kingdom.", "Since partition, a key aspiration of Irish nationalists has been to bring about a reunited Ireland, with the whole island forming one independent state.", "This goal conflicts with that of the unionists in Northern Ireland, who want the region to remain part of the United Kingdom.", "The Irish and British governments agreed, under the 1998 Belfast Agreement, that the status of Northern Ireland will not change without the consent of a majority of its population.", "In its white paper on Brexit, the United Kingdom government reiterated its commitment to the Belfast Agreement." ] ], "gold": "The partition of Ireland was the process by which the Government of the United Kingdom of Great Britain and Ireland divided Ireland into two self-governing polities, Northern Ireland and Southern Ireland. The act was called the Government of Ireland Act 1920, and it was passed in December, 1920. On May 3, 1921, it was enacted. ", "prediction 1": "The partition of Ireland divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland, which took place on 3 May 1921 under the Government of Ireland Act 1920. The Act of 1920 was intended to create two self-governing territories within Ireland, with both remaining within the United Kingdom, but in 1922, following the War of Independence and the Anglo-Irish Treaty, the southern part became the Irish Free State and Northern Ireland exercised its option to remain in the United Kingdom.", "prediction 2": "The Partition of Ireland divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland. It took place on 3 May 1921 under the Government of Ireland Act 1920. Today the former is still known as Northern Ireland and forms part of the United Kingdom, while the latter is now a sovereign state also named Ireland, sometimes called the Republic of Ireland.", "prediction 3": "The partition of Ireland divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland. It took place on 3 May 1921 under the Government of Ireland Act 1920. Today the former is still known as Northern Ireland and forms part of the United Kingdom, while the latter is now a sovereign state also named Ireland and sometimes called the Republic of Ireland. However, in 1922, following the War of Independence and the Anglo-Irish Treaty, the southern part became the Irish Free State, while Northern Ireland exercised its option to remain in the United Kingdom.", "prediction 4": "The partition of Ireland divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland, which took place on 3 May 1921 under the Government of Ireland Act 1920. The Act of 1920 was intended to create two self-governing territories within Ireland, with both remaining within the United Kingdom. However, in 1922, following the War of Independence and the Anglo-Irish Treaty, the southern part became the Irish Free State, while Northern Ireland exercised its option to remain in the United Kingdom.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 528 } ], "missing-info": [], "corrected-prediction": "The partition of Ireland divided the island of Ireland into two distinct jurisdictions, Northern Ireland and Southern Ireland, which took place on 3 May 1921 under the Government of Ireland Act 1920. " }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "When will the next version of ubuntu be released?", "passages": [ [ "Ubuntu version history", "On 17 October 2016, Mark Shuttleworth announced that the codename of Ubuntu 17.04, released on 13 April 2017, would be \"Zesty Zapus\".", "This release dropped support for the 32-bit PowerPC architecture, following the same move by the upstream Debian project.", "Other changes include the default DNS resolver now being \"systemd-resolved\", Linux kernel 4.10, and support for printers which allow printing without printer-specific drivers.", "Joey Sneddon of \"OMG Ubuntu\" said of this release, \"this is no normal release of Ubuntu.", "It's potentially the last version of the distribution that will come with the Unity 7 desktop by default.", "That's not a certainty, of course, but we know that Ubuntu will switch to GNOME for Ubuntu 18.04 LTS next year.", "It's reasonable to expect developers to want to kick a few tyres on that switch ahead of time, in the next interim release.", "A bittersweet release then, Ubuntu 17.04 sees the distro reach the end of the alphabet in codenames, and the end of an era in everything else.", "Sadly there's not an awful lot to say." ], [ "Ubuntu version history", "Ubuntu 16.04 LTS does not support the AMD Catalyst (fglrx) driver for AMD/ATI graphics cards and instead recommends the free software radeon and amdgpu alternatives.", "These may not provide optimal graphics performance, however.", "AMDGPU-PRO is available for Ubuntu 16.04\n\nThe first point release, 16.04.1, was released on 21 July 2016.", "Release of Ubuntu 16.04.2 was delayed a number of times, but it was eventually released on 17 February 2017.", "Ubuntu 16.04.3 was released on 3 August 2017.", "Ubuntu 16.04.4 was delayed from 15 February 2018 and released on 1 March 2018, providing the latest Linux kernel, 4.13, from Ubuntu 17.10.", "Ubuntu 16.04.5 was released on 2 August 2018.", "Mark Shuttleworth announced on 21 April 2016 that Ubuntu 16.10 would be called \"Yakkety Yak\".", "It was released on 13 October 2016.", "This release features a maintenance version of Unity\u00a07, but offers Unity\u00a08 packages included in the ISO, so that users can test them." ], [ "Ubuntu version history", "Thankfully, Yakkety makes it quicker to find, browser, search and install applications,\" but concluded, \"Ubuntu 16.10 is not a must-have upgrade\u2014not for most people.\"", "Marius Nestor of Softpedia noted, \"Ubuntu 16.10 is not an exciting release for fans of the open source operating system.", "Probably the most important feature of Yakkety Yak is Linux kernel 4.8, which brings support for the latest hardware, but other than that, you'll get some updated components that are mostly based on the old GNOME 3.20 Stack.\"", "Writing in \"Makeuseof\", Bertel King, Jr. said, \"If you're feeling underwhelmed, you probably remember the Ubuntu of yesteryear.", "Back in the days of 8.10, 9.04, and 10.04 each release brought forth a new theme or ambitious feature.", "Unity first appeared in 10.10 as a netbook interface before replacing the regular desktop in 11.04.", "By comparison, modern Ubuntu updates feel relatively stagnant.", "You would be forgiven for not being able to distinguish between 12.04 and 16.10.\"" ], [ "Ubuntu version history", "Unity is, by and large, the same as it is in the 16.04 LTS...", "Ubuntu 17.04 is an iterative update with modest appeal.", "While there is little compelling reason for anyone running Ubuntu 16.04 LTS to upgrade (especially for those who opt receive the newer hardware enablement stack) it's not an irrelevant release.", "Ubuntu 16.10 users will want to upgrade to Ubuntu 17.04 for the general around improvements, access to newer apps, and because the truncated support period of these short term releases necessitates it.\"", "Maruis Nestor of Softpedia called it, \"a powerful release, both inside and outside\" and noted, \"the default desktop environment remains Unity 7, so your beloved Ubuntu desktop environment is not going anyway at the moment.", "It will also be available in the upcoming Ubuntu 17.10 release, whose development will start next month.", "After that, starting with Ubuntu 18.04 LTS, the GNOME desktop will be used by default.\"", "The name of this release, Artful Aardvark, was announced via Launchpad on 21 April 2017, instead of on Shuttleworth's blog as has been the case in the past.", "It was released on 19 October 2017." ] ], "gold": "Version 16.10 of the operating system Ubuntu, named \"Yakkety Yak\", was released on 13 October 2016. Version 17.04 of the operating system, which was named \"Zesty Zopus\", was released on 13 April 2017. Ubuntu's version 17.10 was released on 19 October 2017 and was named \"Artful Aardvark\".", "prediction 1": "Ubuntu's final stable release was Ubuntu 17.04, which was released on 13 April 2017. The codename for the next stable release was Ubuntu 17.04. This was released on 17 October 2016, while the codename for the next interim release was Ubuntu 17.04. Artful Aardvark was announced via Launchpad on 21 April 2017. Artful Aardvark was released on 19 October 2017.", "prediction 2": "In the year 2016, Ubuntu reached the end of the alphabet in codenames, and the end of an era in everything else, with the release of Ubuntu 17.04. This release features a maintenance version of Unity 7, but offers Unity 8 packages included in the ISO, so that users can test them. On 21 April 2016, Mark Shuttleworth announced that the codename of Ubuntu 16.10 would be called \"Yakkety Yak\". It was released on 13 October 2016.", "prediction 3": "Ubuntu is an open source operating system developed by Mark Shuttleworth and released as an LTS version on November 9, 2015. The code name of Ubuntu 17.04, released on 13 April 2017, was \"Zesty Zapus\". Release of Ubuntu 16.04.2 was delayed a number of times, but it was eventually released on 17 February 2017. Ubuntu 16.04.3 was released on 3 August 2017. Ubuntu 16.04.4 was delayed from 15 February 2018 and released on 1 March 2018. Ubuntu 16.04.5 was released on 2 August 2018.", "prediction 4": "Ubuntu is an open source operating system released by the Ubuntu Software Foundation. The first version was released on 1 April 2015. The codename for the next release, Ubuntu 17.04, was released on 13 April 2017. The release of Ubuntu 16.10 was called \"Yakkety Yak\". The release of Ubuntu 16.04.5 was released on 2 August 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 9, "end": 29 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 165, "end": 181 }, { "error type": "Redundant", "explanation": "The codename for the next stable release was Ubuntu 17.04. ", "start": 188, "end": 247 }, { "error type": "Unverifiable", "explanation": "", "start": 85, "end": 143 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": "Version 16.10 of the operating system Ubuntu, named \"Yakkety Yak\", was released on 13 October 2016. Version 17.04 of the operating system, which was named \"Zesty Zopus\", was released on 13 April 2017. Ubuntu's version 17.10, Artful Aardvark, was announced via Launchpad on 21 April 2017. Artful Aardvark was released on 19 October 2017." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When is the last time the cowboys won a superbowl?", "passages": [ [ "Dallas Cowboys", "Dallas Cowboys\n\nThe Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex.", "The Cowboys compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division.", "The team is headquartered in Frisco, Texas, and plays its home games at AT&T Stadium in Arlington, Texas, which opened for the 2009 season.", "The stadium took its current name prior to the 2013 season.", "The Cowboys joined the NFL as an expansion team in .", "The team's national following might best be represented by its NFL record of consecutive sell-outs.", "The Cowboys' streak of 190 consecutive sold-out regular and post-season games (home and away) began in 2002.", "The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, just behind the New England Patriots record ten Super Bowl appearances.", "This has also corresponded to eight NFC championships, most in the NFC.", "The Cowboys have won five of those Super Bowl appearances, tying them with their NFC rivals, the San Francisco 49ers, and the AFC's Patriots; all three are second to Pittsburgh's record six Super Bowl championships." ], [ "Super Bowl XXVII", "Super Bowl XXVII\n\nSuper Bowl XXVII was an American football game between the American Football Conference (AFC) champion Buffalo Bills and the National Football Conference (NFC) champion Dallas Cowboys to decide the National Football League (NFL) champion for the 1992 season.", "The Cowboys defeated the Bills by the score of 52\u201317, winning their third Super Bowl in team history, and their first one in fifteen years.", "This game is tied with Super Bowl XXXVII as the third-highest scoring Super Bowl ever with 69 combined points.", "The Bills became the first team to lose three consecutive Super Bowls, and just the second team to play in three straight (the Miami Dolphins played in Super Bowls VI\u2013VIII, winning VII and VIII).", "The game was played on January 31, 1993 at the Rose Bowl in Pasadena, California, the seventh Super Bowl held in the Greater Los Angeles Area.", "The Bills advanced to their third consecutive Super Bowl after posting an 11\u20135 regular season record, but entered the playoffs as a wild card after losing tiebreakers.", "The Cowboys were making their sixth Super Bowl appearance after posting a 13\u20133 regular season record.", "It was the first time that the two franchises had played each other since 1984.", "Dallas forced a Super Bowl record nine turnovers\u2014four interceptions and five lost fumbles\u2014en route to their win over Buffalo." ], [ "Super Bowl XXVIII", "Super Bowl XXVIII\n\nSuper Bowl XXVIII was an American football game between the National Football Conference (NFC) champion Dallas Cowboys and the American Football Conference (AFC) champion Buffalo Bills to decide the National Football League (NFL) champion for the 1993 season.", "The Cowboys defeated the Bills by the score of 30\u201313, winning their fourth Super Bowl in team history, tying the Pittsburgh Steelers and the San Francisco 49ers for most Super Bowl wins.", "The game was played on January 30, 1994, at the Georgia Dome in Atlanta, Georgia.", "Since the 1993 regular season was conducted over 18 weeks (two byes per team), the traditional bye week between the conference championship games and the Super Bowl was not employed; the last time this happened was before Super Bowl XXV.", "This is the only time that the same two teams met in consecutive Super Bowls.", "The defending Super Bowl XXVII champion Cowboys finished with a 12\u20134 regular season record, despite key players missing games due to injuries.", "The Bills were making their fourth consecutive Super Bowl appearance, but still seeking their first title, after also finishing with a 12\u20134 regular season record, largely through the strength of their no-huddle offense.", "After trailing 13\u20136 at halftime, the Cowboys scored 24 unanswered points in the second half." ] ], "gold": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex, who compete in the National Football League as a member club of the league's National Football Conference East division. The Cowboys won their third Super Bowl in team history and their first in fifteen years on January 31, 1993, after they defeated the Bills by the score of 52\u201317 at the Rose Bowl in Pasadena, California, which is the last NFL championship game to date to be held in a non-NFL stadium. The following year, on January 30, 1994, the Cowboys defeated the Bills in the Super Bowl once again, with a score of 30\u201313, at the Georgia Dome in Atlanta, Georgia. Two years later, on January 28, 1996, the Cowboys defeated the Steelers in the Super Bowl XXX game by the score of 27\u201317 at Sun Devil Stadium in Tempe, Arizona, which the first time the Super Bowl was played in the Phoenix metropolitan area.", "prediction 1": "The Dallas Cowboys have won seven Super Bowls. Their last victory came on February 7, 1996. They defeated the Buffalo Bills in Super Bowl XXVII on January 31, 1993. Then they defeated the Buffalo Bills by the score of 30\u201313, winning their fourth Super Bowl in team history. The Cowboys have also won seven Super Bowls in their history.", "prediction 2": "The Dallas Cowboys have won a Super Bowl eight times. They have won five of those eight Super Bowls. The last time the Cowboys won a Super Bowl was in 1992.", "prediction 3": "The Dallas Cowboys have won the Super Bowl eight times. The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, just behind the New England Patriots record ten Super Bowl appearances. Super Bowl XXVII was an American football game between the American Football Conference champion Buffalo Bills and the National Football Conference champion Dallas Cowboys to decide the National Football League champion for the 1992 season. The game was played on January 31, 1993 at the Georgia Dome in Atlanta, Georgia Dome in Atlanta, Georgia. Super Bowl XVIII was an American football game between the Cowboys and the Bills to decide the National Football League champion for the 1993 season. The game was played on January 30, 1994, at the Georgia Dome in Atlanta, Georgia Dome in Atlanta, Georgia. The game was played on January 30, 1994, at the Rose", "prediction 4": "The Dallas Cowboys have won a Super Bowl eight times, including the 1992 Super Bowl and the 1993 Super Bowl. The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, just behind the New England Patriots record ten Super Bowl appearances.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 47, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 46 }, { "error type": "Irrelevant", "explanation": "", "start": 274, "end": 335 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex. The Cowboys compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division. They defeated the Buffalo Bills 52\u201317 in Super Bowl XXVII on January 31, 1993 at the Rose Bowl in Pasadena, California. Then they defeated the Buffalo Bills on January 30, 1994, at the Georgia Dome in Atlanta, Georgia, by the score of 30\u201313, winning their fourth Super Bowl in team history. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "When did britney spears release her first album?", "passages": [ [ "...Baby One More Time (album)", "...Baby One More Time (album)\n\n...", "Baby One", "More Time is the debut studio album by American pop singer Britney Spears.", "It was released on January 12, 1999 through Jive Records.", "In June 1997, while Spears negotiated with her manager at the time, Lou Pearlman, to join female pop group Innosense, her mother, Lynne Spears, asked a Spears' family friend and entertainment lawyer, Larry Rudolph, for his opinion.", "Rudolph took interest and decided to pitch her to record labels.", "Rudolph submitted a tape of Britney Spears singing over a Whitney Houston karaoke song, along with a demo tape of an unused song from Toni Braxton.", "Jive Records was interested and appointed the singer to work with producer Eric Foster White.", "After hearing the recorded material, Jive signed Spears to a multi-album deal.", "Spears traveled to Sweden to work with producers Max Martin, Denniz Pop, and Rami Yacoub, among others.", "Martin presented a track titled \"Hit Me Baby (One More Time)\" to Spears and her management, which had been rejected by girl group TLC.", "Spears later claimed that she felt excited when she heard it and knew it was going to be a hit record." ], [ "Greatest Hits: My Prerogative", "Greatest Hits: My Prerogative\n\nGreatest Hits: My Prerogative is the first greatest hits album by American singer Britney Spears.", "It was released on November 3, 2004 through Jive Records and Zomba Recording.", "The album was released in two different editions, standard and limited, with the latter containing a bonus disc with remixes.", "A video compilation , featuring twenty of Spears' music videos, was released to accompany the songs.", "The album includes three new tracks: a cover of Bobby Brown's \"My Prerogative\", \"Do Somethin'\" and \"(I've Just Begun) Having My Fun\", which was previously included on the international editions of Spears' fifth video album \"\" (2004).", "\"Greatest Hits: My Prerogative\" received mixed reviews from music critics.", "Some felt that it was an accurate portrayal of Spears as the defining figure of American pop culture, while others stated that she did not have enough material for a greatest hits album and also deemed it as premature.", "\"Greatest Hits: My Prerogative\" peaked atop the charts in France, Greece, Ireland and Japan, and within the top ten in Australia, Austria, Belgium, Canada, Czech Republic, Denmark, Finland, Hungary, Italy, the Netherlands, Norway, Portugal, Switzerland, the United Kingdom and the United States." ], [ "Britney Spears discography", "Britney Spears discography\n\nAmerican singer Britney Spears has released nine studio albums, seven compilation albums, 42 singles, nine promotional singles, and has made three guest appearances.", "In 1997, Spears signed a recording contract with American record label Jive Records in order to launch her career.", "Spears made her chart debut in November 1998 with \"...Baby One More Time\", which was followed by the release of her debut studio album, \"...", "Baby One More Time\" (1999).", "The record opened the Canadian Albums Chart and the US \"Billboard\" 200 at number one, being later certified fourteen times Platinum by the Recording Industry Association of America (RIAA).", "The singer's second studio album, \"Oops!...", "I Did It Again\", was made available for consumption on May 16, 2000, and became the fastest-selling record ever by a female act in America, bringing first-week sales of 1,319,193 units and certified diamond in United States.", "It spawned four singles\u2014\"Oops!...", "I Did It Again\", \"Lucky\", \"Stronger\", and \"Don't Let Me Be the Last to Know\".", "In November 2001, the singer's eponymous album spawned worldwide hit \"I'm a Slave 4 U\", which had been pointed out by music critics for being a musical departure from her previous material." ] ], "gold": "\"...Baby One More Time\", the first studio album of singer Britney Spears, was released on January 12, 1999. The record opened the Canadian Albums Chart and the US Billboard 200 at number one, being later certified fourteen times Platinum by the Recording Industry Association of America (RIAA). Her first compilation album, called \"Greatest Hits: My Prerogative\", was released on November 9, 2004.", "prediction 1": "Britney Spears' first album was...Baby One More Time, released on January 12, 1999. Greatest Hits: My Prerogative, the first greatest hits album by American singer Britney Spears, was released on November 3, 2004 through Jive Records and Zomba Recording.", "prediction 2": "Britney Spears' debut studio album,...Baby One More Time, was released on January 12, 1999. Greatest Hits: My Prerogative, a greatest hits album by American singer Britney Spears, was released on November 3, 2004 through Jive Records and Zomba Recording. Spears also released her second studio album,...I Did It Again, which was made available for consumption on May 16, 2000. In November 2001, the singer's eponymous album spawned a worldwide hit song, which became the fastest-selling record ever by a female act in America, becoming the fastest-selling record ever by a female act in America, leading to become the fastest-selling record ever by a female act in America, bringing first-week sales of 1,3193,0,000 units, and certified Platinum in United States.", "prediction 3": "Britney Spears has released 9 studio albums, 7 compilation albums, 42 singles, 9 promotional singles, and has made three guest appearances. Her debut album...Baby One More Time was released on January 12, 1999 through Jive Records. Her second studio album, Oops!... I Did It Again, was made available for consumption on May 16, 2000. Her third studio album,...Baby One More Time: A Live Performance was released on January 10, 2001 through Jive Records.", "prediction 4": "Britney Spears' first album was released on January 12, 1999. The singer made her chart debut in November 1998 with \"...Baby One More Time\" which was followed by the release of her first studio album, \"...Baby One More Time\". The first greatest hits album by Spears was released on November 3, 2004, through Jive Records and Zomba Recording. The album included 20 of her music videos, as well as the video compilation \"Greatest Hits: My Prerogative\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 254 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Britney Spears' first album was...Baby One More Time, released on January 12, 1999.The record opened the Canadian Albums Chart and the US \"Billboard\" 200 at number one, being later certified fourteen times Platinum by the Recording Industry Association of America (RIAA). Greatest Hits: My Prerogative, the first greatest hits album by American singer Britney Spears, was released on November 3, 2004." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "The guy who died in fast and furious 7?", "passages": [ [ "Cody Walker (actor)", "Cody Walker (actor)\n\nCody Beau Walker (born June 13, 1988) is an American actor.", "He is the brother of the late actor Paul Walker, and helped complete his final scenes in the film \"Furious 7\" (2015).", "He made his acting debut in \"Abandoned Mine\" (2013).", "He went on to appear in \"\" (2016), and went on to star in the television show \"In the Rough\".", "Walker was born in Los Angeles County, California, to Paul William Walker III and Cheryl (\"n\u00e9e\" Crabtree).", "He has three older siblings: Caleb, Ashlie, and Amie.", "He graduated from the University of California, Santa Barbara.", "Walker made his acting debut in the low-budget 2013 horror film \"Abandoned Mine\", portraying the role of Thomas; the film had mixed reviews.", "He appeared in \"Furious 7\" after his brother Paul died on November 30, 2013 in a single-vehicle accident.", "Cody and Caleb both stepped in to help finish their brother's scenes as Brian O'Conner in the movie, which was still filming at the time of Paul's death.", "After his appearance in \"Furious 7\", Cody Walker decided to pursue acting, continuing Paul's legacy.", "He appears in the World War II film \"\" (2016)." ], [ "Paul Walker", "Paul Walker\n\nPaul William Walker IV (September 12, 1973 \u2013 November 30, 2013) was an American actor best known for his role as Brian O'Conner in \"The Fast and the Furious\" franchise.", "Walker first gained prominence in 1999 with roles in the teen films \"She's All That\" and \"Varsity Blues\".", "In 2001, he gained international fame for his role in the street racing action film \"The Fast and the Furious\" (2001), a role he reprised in five of the next six installments, but died in 2013 in the middle of filming \"Furious 7\" (2015).", "Walker began his career guest-starring on TV shows such as \"The Young and the Restless\" and \"Touched by an Angel\".", "He later starred in films such as \"Joy Ride\" (2001), \"Timeline\" (2003), \"Into the Blue\" (2005), \"Eight Below\" (2006), and \"Running Scared\" (2006).", "He also appeared in the National Geographic series \"Expedition Great White\" (2010) and in ads for Davidoff Cool Water cologne.", "He founded the disaster-relief charity Reach Out Worldwide (ROWW) in response to the 2010 Haiti earthquake.", "Walker died on November 30, 2013, at the age of 40 as a passenger in a single-car crash alongside friend and driver Roger Rodas." ], [ "Paul Walker", "Walker was working on three films at the time of his death which were released posthumously: \"Hours\" (2013), \"Brick Mansions\" (2014), and \"Furious 7\" (2015).", "The Wiz Khalifa song \"See You Again\", featuring Charlie Puth, was commissioned for the \"Furious 7\" soundtrack as a tribute to Walker.", "It was nominated for the Golden Globe for Best Original Song in 2015 and was the number-one song in the United States for 12 weeks.", "Walker was born in Glendale, California, and was the son of Cheryl (n\u00e9e Crabtree), a fashion model, and Paul William Walker III, a sewer contractor and boxer who was a two-time Golden Gloves champion.", "Paul's paternal grandfather had a boxing career as \"'Irish' Billy Walker\".", "Paul's ancestry was mostly English, with some German, Swiss, and Irish.", "One of his grandfathers raced factory cars for Ford in the 1960s.", "The oldest of five siblings, Walker was raised primarily in the Sunland community of Los Angeles and attended high school in the San Fernando Valley, graduating from Sun Valley's Village Christian School in 1991.", "He was raised as a member of The Church of Jesus Christ of Latter-day Saints.", "After high school, Walker attended several community colleges in Southern California, majoring in marine biology." ] ], "gold": "Actor Paul Walker had not yet completed filming the film Furious 7 when he died from injuries sustained from a single-vehicle collision on November 30, 2013. The film was released after rewrites and stand-ins, including his brothers Cody and Caleb who filled in for Walker, while the song \"See You Again\" by Wiz Khalifa and Charlie Puth was commissioned as a tribute. In the film, character Han Lue is killed by Deckard Shaw, who is a UKSF assassin and MI6 agent.", "prediction 1": "Paul Walker, an American actor best known for his role as Brian O'Conner in The Fast and the Furious franchise, died in a single-vehicle accident on November 30, 2013. His brother Cody Walker, who is an American actor, helped complete his final scenes in the film Furious 7 (2015). Walker was an avid street racer who gained international fame for his role in the 2001 street racing action film. He died on November 30, 2013, at the age of 40 as a passenger in a single-car crash. Walker starred in the 2016 horror film Abandoned Mine and later in the TV show In the Rough.", "prediction 2": "Cody Beau Walker, an American actor, is the brother of the late actor Paul Walker, who played Brian O'Conner in Fast and Furious 7. Cody helped finish his final scenes in the film, which was filmed during the same time as Paul's death. Walker died on November 30, 2013 in a single-vehicle accident.", "prediction 3": "Paul Walker, an American actor best known for his role as Brian O'Conner in the Fast and Furious franchise, died during the filming of the 2015 movie Furious 7. Cody Beau Walker, an American actor and the brother of the late actor, helped complete his final scenes in the film Furious 7 (2015). Walker died on November 30, 2013, as a passenger in a single-car accident. He appeared in the 2015 film after his brother Paul died.", "prediction 4": "Paul William Walker IV, an American actor best known for his role as Brian O'Conner in The Fast and the Furious franchise, died on November 30, 2013. His brother, Cody Beau Walker, helped complete his final scenes in the film Furious 7 after Paul Walker died. Walker was also playing the role of Brian O'Conner in the Fast and Furious franchise.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 395 }, { "error type": "Redundant", "explanation": "died in a single-vehicle accident on November 30, 2013. ", "start": 396, "end": 480 }, { "error type": "Irrelevant", "explanation": "", "start": 481, "end": 573 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Paul Walker, an American actor best known for his role as Brian O'Conner in The Fast and the Furious franchise, died in a single-vehicle accident on November 30, 2013. His brother Cody Walker, who is an American actor, helped complete his final scenes in the film Furious 7 (2015). The Wiz Khalifa song \"See You Again\", featuring Charlie Puth, was commissioned for the \"Furious 7\" soundtrack as a tribute to Walker." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who wrote play your own kind of music?", "passages": [ [ "Make Your Own Kind of Music (song)", "Make Your Own Kind of Music (song)\n\n\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil, first recorded in 1968 by the New York City-based trio the Will-O-Bees (Janet Blossom, Steven Porter, and Robert Merchanthouse), who regularly performed Mann/Weil compositions.", "After Cass Elliot had a hit in the summer of 1969 with Mann/Weil's \"It's Getting Better\", she recorded \"Make Your Own Kind of Music\" as the follow-up single, and her album \"Bubblegum, Lemonade, and... Something for Mama\" was re-released as \"Make Your Own Kind Of Music/It's Getting Better,\" the title cut having been added to the original track listing.", "However, Elliot's \"Make Your Own Kind of Music\" single only reached No. 36.", "The similar chart impact of the follow-up single, another Mann/Weil composition entitled \"New World Coming,\" which reached No. 42, signaled Elliot's challenges in maintaining a profile as a current hitmaker, as the 1960s turned into the 1970s.", "The Cass Elliot track is in the key of E major.", "The song has also been used for \"I en annan del av K\u00f6ping\"." ], [ "Make Your Own Kind of Music (TV series)", "Make Your Own Kind of Music (TV series)\n\nMake Your Own Kind of Music was an American summer replacement television series starring The Carpenters that aired on NBC from July 20, 1971 to September 7, 1971.", "Some guest stars were Don Knotts, Herb Alpert, Al Hirt, Mark Lindsay, Patchett & Tarses, Helen Reddy, and the Doodletown Pipers.", "The key concept of the series was that each show starts off with the letter \"A\".", "The first show started off with \"A is for Alpert\", as Herb Alpert stood next to a big letter \"A\", and introduced the show.", "The cast would then go down the alphabet list, and when they got to \"Z\", the show would end." ] ], "gold": "The pop song \"Make Your Own Kind of Music\", which became a Top 40 hit for Cass Elliot in 1969, was written by Barry Mann and Cynthia Weil. The 1971 TV show \"Make Your Own Kind of Music\" was written by Gordon Farr, Ken Hecht, Arnold Kane, and Ernest Chambers. The show aired from July 20, 1971 to September 7, 1971 on NBC.", "prediction 1": "\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil, first recorded in 1968 by the New York City-based trio the Will-O-Bees.", "prediction 2": "\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil, first recorded in 1968 by the New York City-based trio the Will-O-Bees, who regularly performed Mann/Weil compositions. Make Your Own Kind of Music was an American summer replacement television series starring The Carpenters that aired on NBC from July 20, 1971 to September 7, 1971.", "prediction 3": "\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil, first recorded in 1968 by the New York City-based trio the Will-O-Bees (Janet Blossom, Steven Porter, and Robert Merchanthouse), who regularly performed Mann/Weil compositions. After Cass Elliot had a hit in the summer of 1969 with Mann/Weil's \"It's Getting Better\", she recorded \"Make Your Own Kind of Music\" as the follow-up single, and her album \"Bubblegum, Lemonade, and... Something for Mama\" was re-released as \"Make Your Own Kind Of Music/It's Getting Better.\"", "prediction 4": "\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil, first recorded in 1968 by the New York City-based trio the Will-O-Bees, who regularly performed Mann/Weil compositions. After Cass Elliot had a hit in the summer of 1969 with Mann/Weil's \"It's Getting Better\", she recorded \"Make Your Own Kind of Music\" as the follow-up single, and her album Bubblegum, Lemonade, was re-released as \"Make Your Own Kind of Music\" as the follow-up single, which reached No. 36. The similar chart impact of the follow-up single, another Mann/Weil composition entitled \"New World Coming,\" which reached No. 42, signaled Elliot's challenges in maintaining a current hitmaker", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 155 } ], "missing-info": [], "corrected-prediction": "\"Make Your Own Kind of Music\" is a pop song written by Barry Mann and Cynthia Weil." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is the tigris and euphrates river valley located?", "passages": [ [ "Mesopotamia", "The Tigris and Euphrates River valleys form the northeastern portion of the Fertile Crescent, which also included the Jordan River valley and that of the Nile.", "Although land nearer to the rivers was fertile and good for crops, portions of land farther from the water were dry and largely uninhabitable.", "This is why the development of irrigation was very important for settlers of Mesopotamia.", "Other Mesopotamian innovations include the control of water by dams and the use of aqueducts.", "Early settlers of fertile land in Mesopotamia used wooden plows to soften the soil before planting crops such as barley, onions, grapes, turnips, and apples.", "Mesopotamian settlers were some of the first people to make beer and wine.", "As a result of the skill involved in farming in the Mesopotamian, farmers did not depend on slaves to complete farm work for them, but there were some exceptions.", "There were too many risks involved to make slavery practical (i.e. the escape/mutiny of the slave).", "Although the rivers sustained life, they also destroyed it by frequent floods that ravaged entire cities.", "The unpredictable Mesopotamian weather was often hard on farmers; crops were often ruined so backup sources of food such as cows and lambs were also kept." ], [ "Fertile Crescent", "Fertile Crescent\n\nThe Fertile Crescent is a crescent-shaped region in the Middle East where agriculture and early human civilizations such as Sumer flourished.", "Technological advances in the region include the development of writing, glass, the wheel, agriculture, and the use of irrigation.", "It has been called the \"cradle of civilization\".", "The Fertile Crescent lies in all of Iraq (Mesopotamia), and parts of Israel/Palestine, Syria, Lebanon, Egypt, and Jordan as well as the southeastern fringe of Turkey and the western fringes of Iran.", "Some authors include Cyprus.", "The Fertile Crescent is an old name which was mostly only used to refer to Iraq due to having the most fertile lands in the region.", "The regions and countries east of Iraq were also included to the definition, popularized by the Fertile Crescent Plan, and other plans aimed to unify the regions of Mesopotamia and Greater Syria, not only due to their fertile lands, but the shared customs and traditions of the peoples." ], [ "Tigris\u2013Euphrates river system", "Tigris\u2013Euphrates river system\n\nThe Tigris and Euphrates, with their tributaries, form a major river system in Western Asia.", "From sources originating in eastern Turkey, they flow by/through Syria through Iraq into the Persian Gulf.", "The system is part of the Palearctic Tigris\u2013Euphrates ecoregion, which includes Iraq and parts of Turkey, Syria, Iran, Saudi Arabia, Kuwait, and Jordan.", "From their sources and upper courses in the mountains of eastern Anatolia, the rivers descend through valleys and gorges to the uplands of Syria and northern Iraq and then to the alluvial plain of central Iraq.", "The rivers flow in a south-easterly direction through the central plain and combine at Al-Qurnah to form the Shatt al-Arab and discharge into the Persian Gulf.", "The region has historical importance as part of the Fertile Crescent region, in which civilization is believed to have first emerged.", "The ecoregion is characterized by two large rivers, the Tigris and Euphrates.", "The rivers have several small tributaries which feed into the system from shallow freshwater lakes, swamps, and marshes, all surrounded by desert.", "The hydrology of these vast marshes is extremely important to the ecology of the entire upper Persian Gulf.", "Historically, the area is known as Mesopotamia." ] ], "gold": "The continent the Tigris and Euphrates River Valley is located on is Asia, while the countries its located in are Iraq and parts of Turkey, Syria, Iran, Saudi Arabia, Kuwait, and Jordan. The Tigris and Euphrates River valleys also form the northeastern portion of the Fertile Crescent, a region in the Middle East.", "prediction 1": "The Tigris and Euphrates River valleys form the northeastern portion of the Fertile Crescent, which also included the Jordan River valley and that of the Nile. Although land nearer to the rivers was fertile and good for crops, portions of land farther from the water were dry and largely uninhabitable. This is why the development of irrigation was very important for settlers of Mesopotamia.", "prediction 2": "The Tigris and Euphrates River valleys form the northeastern portion of the Fertile Crescent, which also included the Jordan River valley and that of the Nile. The system is part of the Palearctic Tigris\u2013Euphrates ecoregion, which includes Iraq and parts of Turkey, Syria, Iran, Saudi Arabia, Kuwait, and Jordan.", "prediction 3": "The Tigris and Euphrates, with their tributaries, form a major river system in Western Asia. The system is part of the Palearctic Tigris\u2013Euphrates ecoregion, which includes Iraq and parts of Turkey, Syria, Iran, Saudi Arabia, Kuwait, and Jordan. The valleys are located in Mesopotamia, in northern Iraq.", "prediction 4": "The Tigris and Euphrates River valleys form the northeastern portion of the Fertile Crescent, which also included the Jordan River valley and that of the Nile.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 159 }, { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 392 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Tigris and Euphrates, with their tributaries, form a major river system in Western Asia. The system is part of the Palearctic Tigris\u2013Euphrates ecoregion, which includes Iraq and parts of Turkey, Syria, Iran, Saudi Arabia, Kuwait, and Jordan. The Tigris and Euphrates River valleys form the northeastern portion of the Fertile Crescent, a region in the Middle East. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the latest version of adobe dreamweaver?", "passages": [ [ "Adobe Dreamweaver", "Adobe Dreamweaver\n\nAdobe Dreamweaver is a proprietary web development tool from Adobe Inc..", "It was created by Macromedia in 1997 and developed by them until Macromedia was acquired by Adobe Systems in 2005.", "Adobe Dreamweaver is available for macOS and for Windows.", "Following Adobe's acquisition of the Macromedia product suite, releases of Dreamweaver subsequent to version 8.0 have been more compliant with W3C standards.", "Recent versions have improved support for Web technologies such as CSS, JavaScript, and various server-side scripting languages and frameworks including ASP (ASP JavaScript, ASP VBScript, ASP.NET C#, ASP.NET VB), ColdFusion, Scriptlet, and PHP.", "Adobe Dreamweaver CC is a web design and development application that uses both a visual design surface known as Live View and a code editor with standard features such as syntax highlighting, code completion, and code collapsing as well as more advanced features such as real-time syntax checking and code introspection for generating code hints to assist the user in writing code.", "Combined with an array of site management tools, Dreamweaver allows for its users design, code and manage websites, as well as mobile content.", "Dreamweaver is an Integrated Development Environment (IDE) tool.", "You can live preview of changes for the frontend." ], [ "Adobe AIR", "Adobe released Adobe AIR 3.9 on October 8, 2013.", "Adobe released Adobe AIR 4.0 on January 14, 2014.", "It was released to beta on October 30, 2013, code named Jones.", "Adobe applied a new numbering scheme for the Flash products versions to synchronize them with the version numbering of the Flash Player, starting from Flash Player 13.", "Adobe released Adobe AIR 13.0 on April 8, 2014.", "It was numbered 13 to synchronize itself with the version numbering of Flash Player.", "Adobe released Adobe AIR 14.0 on June 10, 2014.", "Adobe released Adobe AIR 15.0 on September 9, 2014.", "It includes improvements to Stage3D technology, AIR Gamepad enhancements, and a new packaging engine for iOS apps that reduces compile times from minutes to seconds.", "Adobe released Adobe AIR 16.0 on January 13, 2015.", "Adobe released Adobe AIR 17.0 on March 12, 2015.", "Adobe released Adobe AIR 18.0 on June 9, 2015.", "Adobe released Adobe AIR 19.0 on September 21, 2015.", "Adobe released Adobe AIR 20.0 on December 8, 2015.", "Android SDK (API Level 21) has been upgraded in the AIR Runtime, applications built using this AIR SDK and later will only support Android OS 4.0 or greater.", "Adobe released Adobe AIR 21.0 on March 10, 2016." ] ], "gold": "Adobe Dreamweaver is a proprietary web development tool from Adobe Inc. In 2015, Adobe released CC 2016, version 16.0. In 2016, they released CC 2017, version 17.0. In 2017, they released CC 2018, version 18.0. ", "prediction 1": "Adobe Dreamweaver is a proprietary web development tool from Adobe Inc., originally created by Macromedia in 1997. It was developed by them until Macromedia was acquired by Adobe Systems in 2005. Adobe Dreamweaver CC is a web design and development application that uses both a visual design surface known as Live View and a code editor with standard features such as syntax highlighting, code completion, and code collapsing as well as more advanced features such as real-time syntax checking and code introspection for generating code hints to assist the user in writing code. Adobe released Adobe AIR 16.0 on April 8, 2014. Adobe released Adobe AIR 15.0 on June 10, 2014. Adobe released Adobe AIR 16.0 on March 12, 2015. Adobe released Adobe released Adobe AIR 20.0 on September 21, 2015.\n", "prediction 2": "Dreamweaver is a proprietary web development application from Adobe Inc.. It was created by Macromedia in 1997 and developed by them until Macromedia was acquired by Adobe Systems in 2005. The latest version of Adobe Dreamweaver is 5.1.3 released for Windows. The latest version of Adobe Dreamweaver 5.5 was released for Mac OS X on December 8, 2015. The latest version of Adobe Dreamweaver is 6.0, which was released on December 8, 2015. The latest version of Adobe Dreamweaver is 16.0.", "prediction 3": "Adobe Dreamweaver is a proprietary web development tool from Adobe Inc. that was created by Macromedia in 1997 and developed by them until Macromedia was acquired by Adobe Systems in 2005. The most recent version of Adobe Dreamweaver is version 8. For Mac OS X, the latest version of Dreamweaver is version 9.0. The latest version of Adobe Dreamweaver is version 7.8. For Windows, the latest version of Dreamweaver is version 7.9.", "prediction 4": "Adobe Dreamweaver is a proprietary web development tool from Adobe Inc., which was created by Macromedia in 1997. Adobe released a new version of Dreamweaver, the stable version of Adobe Imagine, on April 24, 2007 and on May 24, 2010. In 2014, Adobe released a new release of Adobe Dreamweaver, the CC, that is a web design and development application for Windows, MacOS, and Linux. This version fixed several bugs. The latest version of Adobe Dreamweaver was released on March 6, 2015. The server-side scripting languages, PHP and JavaScript, and various server-side languages and frameworks including ASP (ASP JavaScript, ASP). In 2015, the fresh version of Adobe Dreamweaver, was released as a new version with improved support for Web technologies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 195 }, { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 578 }, { "error type": "Irrelevant", "explanation": "", "start": 579, "end": 792 } ], "missing-info": [], "corrected-prediction": "Adobe Dreamweaver is a proprietary web development tool from Adobe Inc." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was 500 rs note introduced in india?", "passages": [ [ "Indian 500-rupee note", "Indian 500-rupee note\n\nThe Indian 500-rupee banknote (500) is a denomination of the Indian rupee.", "The current \u20b9500 banknote, in circulation since 10 November 2016, is a part of the Mahatma Gandhi New Series.", "The previous banknotes of the Mahatma Gandhi Series, in circulation between October 1997 and November 2016, were demonetised on November 8, 2016.", "On 13 June 2017, The RBI will soon introduce new Rs. 500 notes, but the old ones will continue being legal tender.", "The design is similar to the current notes in the Mahatma Gandhi (New) Series, except they will come with an inset 'A'.", "The \u20b9500 banknote denomination was first introduced by the Reserve Bank of India (RBI) in October 1997 in order to contain the increasing number of banknotes in circulation, due to inflation.", "The note prominently featured the portrait of Mahatma Gandhi instead of the Emblem of India, the Lion Capital of Sarnath.", "The popularity of this design led to the eventual redesign of the motifs of other Indian banknotes and the introduction of the first Mahatma Gandhi Series banknotes.", "On 8 November 2016, Indian prime minister Narendra Modi announced the demonetization of the \u20b9500 banknotes of the Mahatma Gandhi Series as a measure to fight corruption in India and address the issue of counterfeit banknotes." ], [ "Mahatma Gandhi New Series", "Mahatma Gandhi New Series\n\nThe Mahatma Gandhi New Series of banknotes are issued by the Reserve Bank of India (RBI) as the legal tender of the Indian rupee (), intended to replace the Mahatma Gandhi Series of banknotes.", "Announced on November 8, 2016, it followed the demonetisation of 500 and 1000 banknotes of the original Mahatma Gandhi Series.", "Similar to the preceding series of banknotes, the obverse of the Mahatma Gandhi New Series banknotes also prominently displays the portrait of Mahatma Gandhi.", "The logo of Swachh Bharat Abhiyan is also printed on the back of the banknotes of this series.", "The first banknotes issued in the New Series were the denominations of 500 and 2000, and are in circulation since November 10, 2016.", "On 13 June 2017, The RBI will soon introduce new Rs. 500 notes, but the old ones will continue being legal tender.", "The design is similar to the current notes in the Mahatma Gandhi (New) Series, except they will come with an inset 'A'.", "The RBI announced on 18 August 2017 that it would \"soon\" issue a new 50 note.", "RBI announced the specifications of new 200 rupee note in the Mahatma Gandhi New Series, bearing signature of Dr. Urjit R. Patel, Governor, Reserve Bank of India on 25 August 2017.." ] ], "gold": "There have been several 500 rs notes introduced in India, including the 500 rs Mahatma Gandhi Series note, which was introduced in India in October 1997, and the 500 rs Mahatma Gandhi New Series note, which was introduced in India on 10 November 2016. The Mahatma Gandhi New Series of banknotes are issued as the legal tender of the Indian rupee and intended to replace the Mahatma Gandhi Series of banknotes.", "prediction 1": "The 500-rupee banknote denomination was first introduced by the Reserve Bank of India in October 1997. The note prominently featured the portrait of Mahatma Gandhi instead of the Emblem of India, the Lion Capital of Sarnath. The popularity of this design led to the eventual redesign of the motifs of other Indian banknotes and the introduction of the first Mahatma Gandhi Series banknotes. The 500-rupee banknote is in circulation since 10 November 2016. On 13 June 2017, The RBI will soon introduce new Rs. 500 notes, but the old ones will continue being legal tender.", "prediction 2": "The 500-rupee note was introduced by the Reserve Bank of India (RBI) in October 1997. On 10 November 2016, The RBI will soon introduce new Rs. 500 notes, but the old ones will continue being legal tender. The design is similar to the current notes in the Mahatma Gandhi (New) Series, except they will come with an inset 'A'.", "prediction 3": "The 500 rs note was first introduced by the Reserve Bank of India in October 1997 in order to contain the increasing number of banknotes in circulation, due to inflation. The note prominently featured the portrait of Mahatma Gandhi instead of the Emblem of India, the Lion Capital of Sarnath. The popularity of this design led to the eventual redesign of the motifs of other Indian banknotes and the introduction of the first Mahatma Gandhi Series banknotes. On 13 June 2017, The RBI will soon introduce new Rs. 500 notes, but the old ones will continue being legal tender.", "prediction 4": "The 500 rupee note was first introduced by the Reserve Bank of India in October 1997 in order to contain the increasing number of banknotes in circulation, due to inflation. The note prominently featured the portrait of Mahatma Gandhi instead of the Emblem of India, the Lion Capital of Sarnath. The popularity of this design led to the eventual redesign of the motifs of other Indian banknotes and the introduction of the first Mahatma Gandhi Series banknotes. On 8 November 2016, Indian prime minister Narendra Modi announced the demonetisation of the 500 and 1000 banknotes of the original Mahatma Gandhi Series of banknotes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 390 }, { "error type": "Irrelevant", "explanation": "", "start": 456, "end": 570 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 500-rupee banknote denomination was first introduced by the Reserve Bank of India in October 1997. The 500-rupee Mahatma Gandhi New banknote is in circulation since 10 November 2016. The Mahatma Gandhi New Series of banknotes are issued as the legal tender of the Indian rupee and intended to replace the Mahatma Gandhi Series of banknotes." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who does melanie end up with in the host?", "passages": [ [ "The Host (2013 film)", "The Host (2013 film)\n\n", "The Host is a 2013 American romantic science fiction thriller film adapted from Stephenie Meyer's 2008 novel of the same name.", "It tells the story of a young woman, Melanie, who is captured after the human race has been taken over by parasitic aliens called \"Souls\".", "After Melanie is infused with a soul called \"Wanderer\", Melanie and the alien \"Soul\" vie for control of her body.", "Written and directed by Andrew Niccol, the film stars Saoirse Ronan, Max Irons, Jake Abel, William Hurt, and Diane Kruger.", "Released in theaters on March 29, 2013, the film was poorly received by critics.", "The human race has been taken over by small parasitic aliens called \"Souls\".", "They travel to planets inserting themselves into a host body of that planet's dominant species while suppressing the host's consciousness.", "They access the host's memories, and occupied hosts are identifiable by silver rings in the hosts' eyes.", "A human on the run, Melanie Stryder, is captured and infused with a Soul called \"Wanderer.\"", "Wanderer is asked by a \u201cSeeker\u201d Soul to access Melanie's memories and learn the location of a pocket of unassimilated humans." ], [ "The Host (novel)", "She hates upsetting people and so suffers endlessly trying to be as little of a burden as possible.", "Melanie Stryder \u00a0\u2013 Melanie is a human rebel who was captured and implanted with a Soul after years of evading the Seekers.", "She is Wanderer's host body.", "Melanie's consciousness survives and resists Wanderer's control as best she can.", "She likes the feeling of being physically strong and berates Wanderer for neglecting to keep her that way.", "She has a temper and is often quick to use threats of violence, much to Wanda's displeasure.", "Melanie is passionately in love with Jared and shares a strong bond with her brother, Jamie, of whom she is fiercely protective.", "Despite initial anger at Wanderer for stealing her life, their shared love of Jamie and Jared turns them into unwilling allies.", "Their relationship grows to the point where Melanie tearfully begs Wanda not to give her body back, knowing the alien plans to kill herself once removed.", "Melanie is described as having hazel eyes, dark hair and tan skin and is half Latina on her mother's side.", "Ian O'Shea\u00a0\u2013 Wanderer calls Ian \"as kind as a Soul, but strong as only a human could be\"." ] ], "gold": "The Host is a 2013 American romantic science fiction thriller film directed and adapted by Andrew Niccol from Stephenie Meyer's 2008 novel of the same name. It tells the story of a young woman, Melanie, played by Saoirse Ronan, who is captured after the human race has been taken over by parasitic aliens called \"Souls\", and ends up with Jared who is played by Maximilian Paul Diarmuid Irons. ", "prediction 1": "The Host, a 2013 American romantic science fiction thriller film adapted from Stephenie Meyer's 2008 novel of the same name, tells the story of a young woman, Melanie, who is captured after the human race has been taken over by parasitic aliens called \"Souls\". They travel to planets inserting themselves into a host body of that planet's dominant species while suppressing the host's consciousness. Melanie and the alien \"Soul\" vie for control of her body.", "prediction 2": "The Host is a 2013 American romantic science fiction thriller film adapted from Stephenie Meyer's 2008 novel of the same name. In the film, Melanie Stryder, a human rebel, is captured and implanted with a Soul called Wanderer. Wanderer is asked by a \u201cSeeker\u201d Soul to access Melanie's memories and learn the location of a pocket of unassimilated humans. Melanie is passionately in love with Wanderer and shares a strong bond with her brother, Jamie. Their relationship grows to the point where Melanie tearfully begs Wanda not to give her body back, knowing the alien plans to kill himself once removed.", "prediction 3": "Melanie Stryder, a human rebel who was captured and implanted with a Soul called Wanderer after years of evading the Seekers, is in the film The Host. In the novel of the same name, Melanie is in love with Jared and shares a strong bond with her brother, Jamie \u2013 who she fiercely protects. But the alien Wanderer, who is also a human, is willing to fight for control of Melanie's host body.", "prediction 4": "In the 2013 film The Host, Melanie Stryder, a human rebel who was captured and infused with a Soul, is paired with a human called Wanderer who is trying to access memories of her host body and learn about an unassimilated population. Wanderer is asked by a \"Seeker\" Soul to access Melanie's memories and learn about an unassimilated population. Melanie eventually falls for Ian O'Shea, a human who is a willing allie and is a loyal friend of Wanderer, but when she becomes pregnant, Wanderer, Melanie, Ian O'Shea, who ends up with Wanderer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 457 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Host, a 2013 American romantic science fiction thriller film adapted from Stephenie Meyer's 2008 novel of the same name written and directed by Andrew Niccol , tells the story of a young woman, Melanie, who is captured after the human race has been taken over by parasitic aliens called \"Souls\". " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played anne shirley in anne of green gables?", "passages": [ [ "Anne of Green Gables (1985 film)", "\"Anne of Green Gables\" is the first film in a series of four based on the titular character.", "In 1987, the film's sequel, \"Anne of Avonlea\", was released.", "(It was subsequently retitled \"Anne of Green Gables: The Sequel\" on home video.)", "The final movie, \"\", was aired on March 5, 2000 in Canada and on July 23, 2000 in the United States.", "The final film passed over \"Anne's House of Dreams\" \u2013 the corresponding Anne novel \u2013 in favor of a plot not featured in Montgomery's series, and did not receive the same critical praise as the first two films.", "In 2008, the fourth in the series, titled \"\" was completed.", "The film stars Barbara Hershey, Shirley MacLaine, and Rachel Blanchard and it introduces Hannah Endicott Douglas as the new Anne Shirley.", "The film is both a sequel and a prequel to Sullivan's trilogy.", "The first two Anne films generated a spin-off television series which aired from 1989 to 1996 and starred Sarah Polley.", "The \"Road to Avonlea\" series featured characters and episodes from several of Montgomery's books.", "Anne herself did not appear in the episodes, but Gilbert Blythe, Marilla Cuthbert, and other characters from the Anne books were included." ], [ "Anne of Green Gables (1985 film)", "Primary locations for filming the movie included Prince Edward Island, Stouffville, Ontario, Jacksons Point, Ontario, and Westfield Heritage Village in the Hamilton, Ontario neighbourhood of Rockton.", "Filming was done over a consecutive ten-week shoot.", "Sullivan used several locations as Green Gables farm and combined them to appear as one property.", "The original film and sequels (including \"Road to Avonlea\" and the animated Anne films and series covering over 130 hours of production) have been seen in almost every country around the world.", "The films have now been translated and seen in more places than even the original novels.", "During filming of the original movies an open casting call was held throughout Canada in order to find a young actress to play Anne Shirley.", "Katharine Hepburn recommended that her great niece, Schuyler Grant, play the role of Anne Shirley.", "Director Kevin Sullivan liked Grant's performance and wanted to give her the role.", "However, broadcast executives were resistant to cast an American as a Canadian icon.", "Schuyler Grant ended up playing Anne's best friend, Diana, and Anne Shirley was ultimately played by Megan Follows.", "In her first audition, Megan Follows came highly recommended.", "But, she was quickly dismissed by Kevin Sullivan.", "For her second audition, after a turbulent morning leading up to her audition, a frantic Megan made a much better impression and was given the role." ], [ "Anne of Green Gables: A New Beginning", "Anne of Green Gables: A New Beginning\n\nAnne of Green Gables: A New Beginning is a 2008 Canadian television miniseries, the fourth and final film in Sullivan Entertainment's \"Anne of Green Gables\" series.", "It was released in 2008 on CTV.", "Before the broadcast, CTV had recently acquired the rights to the entire Anne catalogue including the 1985 miniseries.", "The film stars 14-year-old Hannah Endicott-Douglas as the child and Barbara Hershey as the adult Anne Shirley.", "Shirley MacLaine plays matriarch Amelia Thomas in the film.", "Kevin Sullivan wrote a completely new screenplay for the three-hour movie based on Montgomery's characters (serving as a prequel to his early 3 miniseries movies broadcast originally on CBC) and not directly from her books.", "The story follows Anne's life before she arrives at Green Gables.", "Anne, now a middle-aged woman, is troubled by recent events in her life.", "Her husband, Gilbert, has been killed overseas as a medical doctor during World War II.", "(This did not happen in the books.)", "Her two daughters are preoccupied with their own young families and her adopted son Dominic has yet to return from the war." ] ], "gold": "Mary Miles Minter played Anne Shirley in the first filmed appearance of Anne Shirley in the 1919 silent film Anne of Green Gables. Then, Dawn Evelyn Paris starred as the character of Anne Shirley in the 1934 film adaptation of Anne of Green Gables and took that character's name as her stage name. Additionally, Canadian-American actress Megan Follows starred as Anne Shirley in the 1985 Canadian television miniseries Anne of Green Gables and its two sequels, Anne of Green Gables: The Sequel and Anne of Green Gables: The Continuing Story. Follows did not reprise this role for the fourth film, Anne of Green Gables: A New Beginning. Instead, Barbara Hershey took over the role of Anne Shirley in Anne of Green Gables: A New Beginning. Additionally, in Anne of Green Gables: A New Beginning, Hannah Endicott-Douglas played young Anne Shirley.", "prediction 1": "In 1985, the first movie in a series of four based on the titular character Anne of Green Gables was released. In 1987, the film's sequel, Anne of Avonlea, was released. In 2008, the fourth in the series, titled Anne of Green Gables: A New Beginning, was completed. In this film, 14-year-old Hannah Endicott Douglas played Anne Shirley. In the 2008 Canadian television miniseries Anne of Green Gables: A New Beginning, Megan Follows played Anne Shirley. In this miniseries, Anne of Green Gables: A New Beginning, Hannah Endicott Douglas played Anne Shirley. In the 2008 Canadian television miniseries, Anne of Green Gables: A New Beginning, Hannah Endicott Douglas plays the child.", "prediction 2": "In the 1985 film Anne of Green Gables, Katharine Hepburn recommended that her great niece, Schuyler Grant, play the role of Anne Shirley. Director Kevin Sullivan liked Grant's performance and wanted to give her the role. However, broadcast executives were resistant to cast an American as a Canadian icon. Anne Shirley was ultimately played by Megan Follows. In the 2008 Canadian television miniseries Anne of Green Gables: A New Beginning, Hannah Endicott-Douglas plays Anne as the child.", "prediction 3": "Anne of Green Gables is the first film in a series of four based on the titular character. In 1985, the film's sequel, Anne of Avonlea, was released. Megan Follows played Anne Shirley during the opening credits of Anne of Green Gables: A New Beginning.", "prediction 4": "In the 1985 movie Anne of Green Gables, a casting call was held throughout Canada in order to find a young actress to play Anne Shirley. Katharine Hepburn recommended that her great niece, Schuyler Grant, play the role of Anne Shirley. However, broadcast executives were resistant to cast an American as a Canadian icon. In 2008, the fourth in the series, titled \"\" was completed. It introduces 14-year-old Hannah Endicott-Douglas as the new Anne Shirley.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 265 }, { "error type": "Redundant", "explanation": "In this film, 14-year-old Hannah Endicott Douglas played Anne Shirley. ", "start": 337, "end": 418 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[10]}", "start": 419, "end": 432 }, { "error type": "Redundant", "explanation": "In this film, 14-year-old Hannah Endicott Douglas played Anne Shirley. ", "start": 454, "end": 557 }, { "error type": "Redundant", "explanation": "In this miniseries, Anne of Green Gables: A New Beginning, Hannah Endicott Douglas played Anne Shirley. ", "start": 558, "end": 681 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "In Anne of Green Gables: A New Beginning, 14-year-old Hannah Endicott Douglas plays as the child Anne Shirley and Barbara Hershey as the adult Anne Shirley.. Megan Follows plays as Anne Shirley in the 1985 film. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the last time cowboys went to the superbowl?", "passages": [ [ "Dallas Cowboys", "On January 17, 1993 the Cowboys went to Candlestick Park and defeated the 49ers 30\u201320 to clinch their first Super Bowl berth since 1978.", "Dallas defeated the Buffalo Bills 52\u201317 in Super Bowl XXVII, during which they forced a record nine turnovers.", "Johnson became the first coach to claim a national championship in college football and a Super Bowl victory in professional football.", "Despite starting the 1993 season 0\u20132, they again defeated the Buffalo Bills in Super Bowl XXVIII, 30\u201313 (becoming the first team in NFL history to win a Super Bowl after starting 0\u20132).", "Dallas finished the regular season 12\u20134 as the number 1 seed of the NFC.", "They defeated the Green Bay Packers 27\u201317 in the divisional round.", "In the NFC Conference Championship, Dallas beat the 49ers in Dallas, 38\u201321.", "Dallas sent a then-NFL record 11 players to the Pro Bowl in 1993:", "Aikman, safety Thomas Everett, Irvin, Johnston, Maryland, Newton, Norton, Novacek, Smith, Stepnoski and Williams.", "Only weeks after Super Bowl XXVIII, however, friction between Johnson and Jones culminated in Johnson stunning the football world by announcing his resignation.", "Jones then hired former University of Oklahoma head coach Barry Switzer to replace Johnson.", "The Cowboys finished 12\u20134 in 1994." ], [ "Dallas Cowboys", "Dallas Cowboys\n\nThe Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex.", "The Cowboys compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division.", "The team is headquartered in Frisco, Texas, and plays its home games at AT&T Stadium in Arlington, Texas, which opened for the 2009 season.", "The stadium took its current name prior to the 2013 season.", "The Cowboys joined the NFL as an expansion team in .", "The team's national following might best be represented by its NFL record of consecutive sell-outs.", "The Cowboys' streak of 190 consecutive sold-out regular and post-season games (home and away) began in 2002.", "The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, just behind the New England Patriots record ten Super Bowl appearances.", "This has also corresponded to eight NFC championships, most in the NFC.", "The Cowboys have won five of those Super Bowl appearances, tying them with their NFC rivals, the San Francisco 49ers, and the AFC's Patriots; all three are second to Pittsburgh's record six Super Bowl championships." ], [ "Super Bowl XXVIII", "Super Bowl XXVIII\n\nSuper Bowl XXVIII was an American football game between the National Football Conference (NFC) champion Dallas Cowboys and the American Football Conference (AFC) champion Buffalo Bills to decide the National Football League (NFL) champion for the 1993 season.", "The Cowboys defeated the Bills by the score of 30\u201313, winning their fourth Super Bowl in team history, tying the Pittsburgh Steelers and the San Francisco 49ers for most Super Bowl wins.", "The game was played on January 30, 1994, at the Georgia Dome in Atlanta, Georgia.", "Since the 1993 regular season was conducted over 18 weeks (two byes per team), the traditional bye week between the conference championship games and the Super Bowl was not employed; the last time this happened was before Super Bowl XXV.", "This is the only time that the same two teams met in consecutive Super Bowls.", "The defending Super Bowl XXVII champion Cowboys finished with a 12\u20134 regular season record, despite key players missing games due to injuries.", "The Bills were making their fourth consecutive Super Bowl appearance, but still seeking their first title, after also finishing with a 12\u20134 regular season record, largely through the strength of their no-huddle offense.", "After trailing 13\u20136 at halftime, the Cowboys scored 24 unanswered points in the second half." ] ], "gold": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex. The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, behind only the New England Patriots' record eleven Super Bowl appearances.The sixth time the Dallas Cowboys went to the Super Bowl was Super Bowl XXVII on January 31, 1993, where they defeated the Buffalo Bills 52\u201317. The seventh time they went to the Super Bowl was Super Bowl XXVIII on January 30, 1994, where they defeated the Bills for the second straight year by the score of 30\u201313. The eighth time they went to the Super Bowl was Super Bowl XXX on January 28, 1996, where the Cowboys defeated the Steelers by the score of 27\u201317.", "prediction 1": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex that compete in the National Football League as a member club of the league's National Football Conference East division. The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history. The last time the Cowboys went to the Super Bowl was on January 30, 1994.", "prediction 2": "The Cowboys have made it to the Super Bowl eight times. They have defeated the Buffalo Bills in Super Bowl XXVII, in which they won by a final score of 30\u201313. They also defeated the 49ers in Super Bowl XXVII on January 17, 1993. The Cowboys also defeated the New Orleans Saints in Super Bowl XXXVII on January 30, 1994, in which they won by a final score of 30\u201313.", "prediction 3": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex, and compete in the National Football League as a member club of the league's National Football Conference (NFC East division). On January 17, 1993, the Cowboys went to Candlestick Park and defeated the 49ers 30\u201320 to clinch their first Super Bowl berth since 1978. In Super Bowl XXVII, the Cowboys defeated the Buffalo Bills 52\u201317, during which they forced a record nine turnovers, becoming the first team in NFL history to win a Super Bowl after starting 0\u20132. In Super Bowl XVIII, the Cowboys defeated the Bills by the score of 30\u201313, becoming the first team in NFL history to win a Super Bowl after starting 0\u20132.", "prediction 4": "The Dallas Cowboys have made it to the Super Bowl eight times. The franchise has made it to the Super Bowl six times. The last time the Cowboys went to the Superbowl was on January 30, 1994.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 223 }, { "error type": "Unverifiable", "explanation": "", "start": 393, "end": 402 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "The Dallas Cowboys are a professional American football team based in the Dallas\u2013Fort Worth metroplex. The franchise has made it to the Super Bowl eight times, tied with the Pittsburgh Steelers and the Denver Broncos for second most Super Bowl appearances in history, just behind the New England Patriots record ten Super Bowl appearances. Dallas defeated the Buffalo Bills 52\u201317 in Super Bowl XXVII. The Cowboys defeated the Bills again, by the score of 30\u201313, on January 30, 1994 at Super Bowl XXVIII. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who said no to this is your life?", "passages": [ [ "This Is Your Life (UK TV series)", "Lynn Redgrave, in December 1996, was caught while taking her bow in her one-woman show on stage at the Haymarket Theatre, the only time the Redgrave clan was seen together on stage at the same time.", "Bob Hope and Dudley Moore have been the only subjects of two-part editions of the programme, in 1970 and 1987 respectively.", "Both were broadcast over two weeks.", "Clive Mantle's profile included a post-credits sequence where he thanked the audience for coming.", "Footballer Danny Blanchflower turned down the \"red book\" in February 1961.", "Author Richard Gordon (of \"Doctor in the House\" fame) was asked in 1974 and, like Bill Oddie (of \"The Goodies\") in 2001, he initially turned it down, but changed his mind and appeared on the show.", "Actor Richard Beckinsale was a feature on the show shortly after his 31st birthday, eight months before his death.", "Hattie Jacques appeared in 1963 and featured her husband John Le Mesurier who had helped set up the surprise.", "However, much to her extreme discomfort, she was at the time living separately from Le Mesurier with her younger lover .", "In 1996, the \"Sunday Mirror\" reported that a planned show for Cockney comedy actor Arthur Mullard was pulled after researchers contacted his eldest son." ], [ "This Is Your Life (UK TV series)", "This Is Your Life (UK TV series)\n\n", "This is Your Life is a British biographical television documentary, based on the 1952 American show of the same title.", "It was hosted by Eamonn Andrews from 1955 until 1964, and then from 1969 until his death in 1987 aged 64.", "Michael Aspel then took up the role of host until the show ended in 2003.", "It returned in 2007 as a one-off special presented by Trevor McDonald, which to date was its most recent airing.", "In the show the host surprises a special guest, before taking them through their life with the assistance of the 'big red book'.", "Both celebrities and non-celebrities have been 'victims' of the show.", "The show was originally broadcast live, and over its run it has alternated between being broadcast on the BBC and on ITV.", "The surprise element was a very important part of the show; if the guest heard about the project beforehand, it would be cancelled.", "The British version of the show was launched in 1955 on the BBC and was first presented by Ralph Edwards to the first \"victim\", Eamonn Andrews, who was the presenter from the second show.", "The scriptwriter for the first 35 episodes was Gale Pedrick.", "It ended in 1964 when Andrews moved to Associated British Corporation, but it was revived on ITV (produced by Thames Television) in 1969." ], [ "Danny Blanchflower", "Danny Blanchflower\n\nRobert Dennis \"Danny\" Blanchflower (10 February 1926 \u2013 9 December 1993) was a former Northern Ireland international footballer and football manager, and journalist who captained Tottenham Hotspur during its double-winning season of 1960\u201361.", "He was ranked as the greatest player in Spurs history by \"The Times\" in 2009.", "He played as a right half and was known for his accurate passing and ability to dictate the tempo of the game.", "He made one of the best known quotes on football: \"The great fallacy is that the game is first and last about winning.", "It is nothing of the kind.", "The game is about glory, it is about doing things in style and with a flourish, about going out and beating the lot, not waiting for them to die of boredom.\"", "Blanchflower was born on 10 February 1926 in the Bloomfield district of Belfast, the first of five children born to John and Selina Blanchflower.", "His mother had played as a centre-forward on a women's football team.", "He was educated at Ravenscroft public elementary school and was awarded a scholarship to Belfast College of Technology.", "He left early to become an apprentice electrician at Gallaher's cigarette factory in Belfast.", "He also joined the Air Raid Precautions (ARP) and in 1943 lied about his age to join the RAF." ] ], "gold": "This Is Your Life is a British biographical television documentary in which the host surprises a special guest, before taking them through their life with the assistance of the 'big red book'. Multiple people have turned down the offer to appear on the show. In February 1961, Danny Blanchflower, a Northern Irish footballer, became the first person to turn down the invitation to appear the show, simply walking away from the host. Also, both Richard Gordon, in 1974, and Bill Oddie, in 2001, initially turned down the offer but later changed their mind and appeared on the show.", "prediction 1": "This is Your Life is a British biographical television documentary, based on the 1952 American show of the same name. It was hosted by Eamonn Andrews from 1955 until 1964, and then from 1969 until his death in 1987 aged 64. Actor Richard Beckinsale was a feature on the show shortly after his 31st birthday, eight months before his death. Danny Blanchflower turned down the red book in February 1961. Richard Gordon, of \"Doctor in the House\" fame, was asked in 1974 and, initially turned it down, but changed his mind and appeared on the show.", "prediction 2": "This is Your Life is a British biographical television documentary, based on the 1952 American show of the same title. It was hosted by Eamonn Andrews from 1955 until 1964, and then from 1969 until his death in 1987 aged 64. Actor Richard Beckinsale was a feature on the show shortly after his 31st birthday, eight months before his death. Footballer Danny Blanchflower turned down the \"red book\" in February 1961. Author Richard Gordon was asked in 1974 and, like Bill Oddie (of The Goodies) in 2001, he initially turned it down, but changed his mind and appeared on the show.", "prediction 3": "This is Your Life is a British television documentary, based on the 1952 American show of the same title. It was hosted by Eamonn Andrews from 1955 until 1964, and then from 1969 until his death in 1987 aged 64. Actor Richard Beckinsale was a feature on the show shortly after his 31st birthday, eight months before his death. Former Northern Ireland international footballer Danny Blanchflower turned down the \"red book\" in February 1961. Author Richard Gordon was asked in 1974 and, like Bill Oddie in 2001, he initially turned it down, but changed his mind and appeared on the show.", "prediction 4": "This is Your Life is a British biographical television documentary, based on the 1952 American show of the same title. It was hosted by Eamonn Andrews from 1955 until 1964, and then from 1969 until his death in 1987 aged 64. Actor Richard Beckinsale was a feature on the show shortly after his 31st birthday, eight months before his death. Footballer Danny Blanchflower turned down the red book in February 1961. Author Richard Gordon was asked in 1974 and, like Bill Oddie (of \"The Goodies\") was asked in 1974 and ultimately turned it down the request. The show returned in 2007 as a one-off special presented by Trevor McDonald, which to date was its most recent airing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 338 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "This is Your Life is a British biographical television documentary. In the show the host surprises a special guest, before taking them through their life with the assistance of the 'big red book'. Danny Blanchflower, a Northern Irish footballer, turned down the red book in February 1961. Richard Gordon, of \"Doctor in the House\" fame, was asked in 1974 and, initially turned it down, but changed his mind and appeared on the show." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who was the kid that played the banjo in deliverance?", "passages": [ [ "Billy Redden", "Billy Redden\n\nBilly Redden (born 1956) is an American actor, best known for his role as a backwoods, mountain boy in the 1972 film \"Deliverance\".", "He played Lonnie, a banjo-playing teenager in north Georgia, who played the noted \"Dueling Banjos\" with Drew Ballinger (Ronny Cox).", "The film was critically acclaimed and received nominations for awards in several categories.", "Redden was born in Rabun County, Georgia.", "At the age of sixteen, he was selected for \"Deliverance\" from his school in Georgia by director John Boorman.", "He portrayed a banjo-playing \"local\" during the film's famous \"dueling banjos\" scene.", "Boorman felt that Redden's skinny frame, large head, and almond-shaped eyes made him the natural choice to play the part of an \"inbred from the back woods.\"", "Because Redden could not play a banjo, he wore a special shirt which allowed a real banjo player to hide behind him for the scene, which was shot with carefully chosen camera angles that would conceal the player, whose arms were slipped around Redden's waist to play the tune.", "After \"Deliverance\", Redden was cast in Lamberto Bava's 1984 film \"Blastfighter\"." ], [ "Deliverance", "Deliverance\n\nDeliverance is a 1972 American thriller film produced and directed by John Boorman, and starring Jon Voight, Burt Reynolds, Ned Beatty and Ronny Cox, with the latter two making their feature film debuts.", "The film is based on the 1970 novel of the same name by author James Dickey, a celebrated poet who has a small role in the film as the sheriff, and who wrote the screenplay (uncredited).", "The film was a critical success, earning three Oscar nominations and five Golden Globe Award nominations.", "Widely acclaimed as a landmark picture, the film is noted for a music scene near the beginning, with one of the city men playing \"Dueling Banjos\" on guitar with a banjo-strumming country boy, and for its visceral and notorious male rape scene.", "In 2008, \"Deliverance\" was selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant.\"", "Four Atlanta men\u2014Lewis Medlock, Ed Gentry, Bobby Trippe, and Drew Ballinger\u2014decide to canoe down a river in the remote northern Georgia wilderness, expecting to have fun and witness the area's unspoiled nature before the fictional Cahulawassee River valley is flooded by construction of a dam.", "Lewis and Ed are experienced outdoorsmen, while Bobby and Drew are novices." ] ], "gold": "Deliverance is a 1972 American survival film where four Atlanta businessmen decide to canoe down a river in the remote northern Georgia wilderness before it is dammed. In the movie, Billy Redden played Lonnie, a banjo-playing teenager who performs the song \"Dueling Banjos\".", "prediction 1": "Billy Redden was selected for the 1972 movie Deliverance at the age of 16 because he was an active member of his school's band, and because Redden could not play the banjo, he wore a special shirt which allowed a real banjo player to hide behind him for the scene, which was shot with carefully chosen camera angles that would conceal the player, whose arms were slipped around Redden's waist to play the tune.", "prediction 2": "In the 1972 film Deliverance, Billy Redden plays Lonnie, a banjo-playing teenager from north Georgia, who plays the noted \"Dueling Banjos\" with Drew Ballinger.", "prediction 3": "The 1972 American thriller film Deliverance features a banjo scene in the beginning with Drew Ballinger and Lewis Medlock playing guitar with a banjo-strumming country boy. The banjo scene was filmed in North Georgia at a rural school and was filmed with a specially designed shirt allowing a real banjo player to hide behind Redden for the scene.", "prediction 4": "Billy Redden is an American actor best known for his role as a backwoods, mountain boy in the 1972 drama film Deliverance. He played Lonnie, a banjo-playing teenager in north Georgia, who played the noted \"Dueling Banjos\" with Drew Ballinger, played by Ronny Cox. Because Redden could not play a banjo, he wore a special shirt which allowed a real banjo player to hide behind him for the scene, which was shot with carefully chosen camera angles that would conceal the player, whose arms were slipped around Redden's waist to play the tune.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 410 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Deliverance is a 1972 American thriller film where four Atlanta men decide to canoe down a river in the remote northern Georgia wilderness before it is dammed. In the movie, Billy Redden played Lonnie, a banjo-playing teenager. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does the school year start in sweden?", "passages": [ [ "School holiday", "The week before All Saint's Day (taken as a Saturday around November 2) primary and secondary school students have an autumn holiday.", "Christmas holiday starts around December 15\u201316, depending on the day of the week on which Christmas Eve occurs.", "It usually ends in the second week of January (January 6 is also a public holiday).", "In the 8th\u201310th weeks after New Year, primary and secondary school students have one week of winter vacation; the exact week varies by location.", "Easter public holidays last four days from Friday to Monday.", "Easter school holidays are either the week preceding Easter or the week immediately following, depending on location.", "Primary and secondary school summer holidays last about ten weeks, starting in the second week of June.", "School holidays in the United Kingdom follow a standard pattern, with a school year of 190 days of teaching, beginning with the Autumn Term, but the exact timing varies between countries and counties.", "Local authorities set term dates which apply to all Community, Voluntary Controlled, Community Special Schools and Maintained Nursery Schools.", "Academies, Free schools, Voluntary Aided schools and Foundation schools are able to choose their own dates but many follow the same dates as the Local Authority.", "Although these schools can set their own term dates, they are still required to open for the same length of time.", "Independent private schools tend to set longer holidays than state schools." ], [ "Academic year", "Academic year\n\nAn academic year or school year is a period of time which schools, colleges and universities use to measure a quantity of study.", "In Australia and New Zealand, academic years for primary and secondary institutions are divided into two semesters, with each semester being further divided into two terms (thus totaling four terms per year).", "Although historically the year was divided into three terms with an extended Easter break interrupting the first term, the year has been divided into four terms since the late 1980s (with the exception of the Australian state of Tasmania which did not change until 2013).", "Following southern hemisphere seasons, the main summer holiday between academic years encompasses most of December, all of January and sometimes a few days at the beginning of February, and always encompasses Christmas and New Year as well as Australia Day on 26 January.", "In year 12, however, the term ends in November; for those who go on to university, the term starts in March.", "New Zealand celebrates Waitangi Day on 6 February; the summer holidays in New Zealand may or may not extend as far as that day, depending on the year.", "There is typically a break of two weeks mid-semester (i.e. after Term 1 and after Term 3) and a break of three weeks in the middle of the year, although this can vary between jurisdictions." ] ], "gold": "There are different kinds of schools in Sweden and they don't all begin the school year, which is also known as an academic year, on the same day. In Sweden, the primary and secondary school years start in mid or late August, while the school year at the universities begins on September 1. ", "prediction 1": "The Swedish school year starts on the first day of school, which is Saturday, November 2, 1787. The Swedish school year usually ends on Monday, January 4, 2020.", "prediction 2": "The Swedish school year starts on the first day of school on the Monday after All Saint's Day, which is taking place as a Saturday around November 2. The Swedish school year ends on the second Monday in January, the last Monday in December and the second week in January.", "prediction 3": "An academic year or school year is a period of time which schools, colleges and universities use to measure a quantity of study. The school year in Sweden starts on the first Sunday in September and ends on the last Monday in December. In the United Kingdom, the school year starts on the first Monday in September and ends on the last Monday in January.", "prediction 4": "An academic year or school year is a period of time which schools, colleges and universities use to measure a quantity of study. In Sweden, the school year starts on September 1, and in the United Kingdom, it starts on August 1. Easter public holidays last four days from Friday to Monday. In the 8th\u201310th weeks after New Year, primary and secondary school students have one week of winter vacation; the exact week varies by location.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 96, "end": 160 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 95 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who created the bank of the united states?", "passages": [ [ "First Bank of the United States", "First Bank of the United States\n\nThe President, Directors and Company, of the Bank of the United States, commonly known as the First Bank of the United States, was a national bank, chartered for a term of twenty years, by the United States Congress on February 25, 1791.", "It followed the Bank of North America, the nation's first \"de facto\" central bank.", "Establishment of the Bank of the United States was part of a three-part expansion of federal fiscal and monetary power, along with a federal mint and excise taxes, championed by Alexander Hamilton, first Secretary of the Treasury.", "Hamilton believed a national bank was necessary to stabilize and improve the nation's credit, and to improve handling of the financial business of the United States government under the newly enacted Constitution.", "The First Bank building, located in Philadelphia, Pennsylvania, within Independence National Historical Park, was completed in 1797, and is a National Historic Landmark for its historic and architectural significance.", "In 1791, the Bank of the United States was one of the three major financial innovations proposed and supported by Hamilton, first Secretary of the Treasury.", "In addition to the national bank, the other measures were assumption of the state war debts by the U.S. government, establishment of a mint and imposition of a federal excise tax." ], [ "First Bank of the United States", "While Hamilton's rebuttals were many and varied, chief among them were these two:\n\n\nOn February 25, 1791, convinced that the constitution authorized the measure, Washington signed the \"bank bill\" into law.", "On March 19, 1791 Washington appointed three Commissioners for the taking of subscriptions for this new bank:", "Thomas Willing, David Rittenhouse, and Samuel Howell.", "Willing was later elected as President on October 25, 1791, until he resigned due to ill health on November 10, 1807.", "He was succeeded by David Lenox, serving until the expiration of its charter on March 4, 1811.", "After Hamilton left office in 1795, the new Secretary of the Treasury Oliver Wolcott, Jr. informed Congress that, due to the existing state of government finances, more money was needed.", "This could be achieved either by selling the government's shares of stock in the bank, or by raising taxes.", "Wolcott advised the first choice.", "Congress quickly agreed.", "Hamilton objected, believing that the dividends on that stock had been inviolably pledged for the support of the sinking fund to retire the debt.", "Hamilton tried to organize opposition to the measure, but was unsuccessful.", "In 1811, the U.S. Senate tied on a vote to renew the bank's charter.", "Vice President George Clinton broke the tie and voted against renewal." ], [ "Second Bank of the United States", "Modeled on Alexander Hamilton's First Bank of the United States, the Second Bank was chartered by President James Madison in 1816 and began operations at its main branch in Philadelphia on January 7, 1817, managing twenty-five branch offices nationwide by 1832.", "The efforts to renew the bank's charter put the institution at the center of the general election of 1832, in which the bank's president Nicholas Biddle and pro-bank National Republicans led by Henry Clay clashed with the \"hard-money\" Andrew Jackson administration and eastern banking interests in the Bank War.", "Failing to secure recharter, the Second Bank of the United States became a private corporation in 1836, and underwent liquidation in 1841.", "The political support for the revival of a national banking system was rooted in the early 19th century transformation of the country from simple Jeffersonian agrarianism towards one interdependent with industrialization and finance.", "In the aftermath of the War of 1812 the federal government suffered from the disarray of an unregulated currency and a lack of fiscal order; business interests sought security for their government bonds.", "A national alliance arose to legislate a central bank to address these needs." ] ], "gold": "There are many institutions that have been known by the name Bank of the United States throughout history. The first of these was proposed by Alexander Hamilton in 1791 and operated until 1811, year in which the bank's charter expired. The Second Bank of the United States was chartered by James Madison in 1816, but failed to secure recharter and became a private corporation in 1836 and underwent liquidation in 1841. A third bank was founded by Joseph S. Marcus and chartered in 1913, but failed in 1931 after allegedly starting the collapse of banking during the Great Depression.", "prediction 1": "The First Bank of the United States was a national bank chartered for a term of twenty years by the United States Congress on February 25, 1791. The Second Bank of the United States was chartered by President James Madison in 1816 and began operations at its main branch in Philadelphia on January 7, 1817, managing twenty-five branch offices nationwide by 1841. The First Bank of the United States building, located in Philadelphia, Pennsylvania, within Independence National Historical Park, is a National Historic Landmark for its historic and architectural significance.", "prediction 2": "The Bank of the United States was chartered for a term of twenty years on February 25, 1791 by the United States Congress. It followed the Bank of North America, the nation's first de facto central bank. Following Hamilton's idea for a national bank, the Second Bank of the United States was chartered by President James Madison in 1816.", "prediction 3": "The First Bank of the United States was one of the three major financial innovations proposed and supported by Alexander Hamilton, first Secretary of the Treasury. The Second Bank was chartered by President James Madison in 1816 and began operations at its main branch in Philadelphia on January 7, 1817, managing twenty-five branch offices nationwide by 1832. The Bank of the United States was chartered for a term of twenty years by the United States Congress on February 25, 1791.", "prediction 4": "The First Bank of the United States was chartered for a term of twenty years by the United States Congress on February 25, 1791. The Second Bank of the United States was chartered by President James Madison in 1816.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 306 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 574 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 12, 13 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The First Bank of the United States, proposed by Alexander Hamilton, was a national bank chartered for a term of twenty years by the United States Congress on February 25, 1791 that operated until the bank's charter expired. The Second Bank of the United States was chartered by President James Madison in 1816, but to secure recharter, the Second Bank of the United States became a private corporation in 1836, and underwent liquidation in 1841. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Where did the social gospel movement take place?", "passages": [ [ "Social Gospel", "In promoting a return to the doctrine of the \"Kingdom of God\", he clarified that the \"Kingdom of God\": is not subject to the pitfalls of the Church; it can test and correct the Church; is a prophetic, future-focused ideology and a revolutionary, social and political force that understands all creation to be sacred; and it can help save the problematic, sinful social order.", "Many reformers inspired by the movement opened settlement houses, most notably Hull House in Chicago operated by Jane Addams.", "They helped the poor and immigrants improve their lives.", "Settlement houses offered services such as daycare, education, and health care to needy people in slum neighbourhoods.", "The YMCA was created originally to help rural youth adjust to the city without losing their religion, but by the 1890s became a powerful instrument of the Social Gospel.", "Nearly all the denominations (including Catholics) engaged in foreign missions, which often had a social gospel component in terms especially of medical uplift.", "The Black denominations, especially the African Methodist Episcopal church (AME) and the African Methodist Episcopal Zion church (AMEZ), had active programs in support of the Social Gospel.", "Both evangelical (\"pietistic\") and liturgical (\"high church\") elements supported the Social Gospel, although only the pietists were active in promoting Prohibition." ], [ "Social Gospel", "In the United States prior to the First World War, the Social Gospel was the religious wing of the progressive movement which had the aim of combating injustice, suffering and poverty in society.", "Denver, Colorado, was a centre of Social Gospel activism.", "Thomas Uzzel led the Methodist People's Tabernacle from 1885 to 1910.", "He established a free dispensary for medical emergencies, an employment bureau for job seekers, a summer camp for children, night schools for extended learning, and English language classes.", "Myron Reed of the First Congregational Church became a spokesman, 1884 to 1894 for labour unions on issues such as worker's compensation.", "His middle-class congregation encouraged Reed to move on when he became a socialist, and he organized a nondenominational church.", "The Baptist minister Jim Goodhart set up an employment bureau, and provided food and lodging for tramps and hobos at the mission he ran.", "He became city chaplain and director of public welfare of Denver in 1918.", "Besides these Protestants, Reform Jews and Catholics helped build Denver's social welfare system in the early 20th century.", "Mark A. Matthews (1867\u20131940) of Seattle's First Presbyterian Church was a leading city reformer, who investigated red light districts and crime scenes, denouncing corrupt politicians, businessmen, and saloon keepers." ], [ "Social Gospel", "Examples of the Social Gospel's continued influence can still be found in Jim Wallis's Sojourners organization's Call to Renewal and more local organizations like the Virginia Interfaith Center.", "Another modern example can be found in the work of John Steinbruck, senior pastor of Luther Place Memorial Church in Washington, DC, from 1970 to 1997, who was an articulate and passionate preacher of the Social Gospel and a leading voice locally and nationally for the homeless, Central American refugees, and the victims of persecution and prejudice.", "Because the Social Gospel was primarily concerned with the day-to-day life of laypeople, one of the ways in which it made its message heard was through labour movements.", "Particularly, the Social Gospel had a profound effect upon the American Federation of Labor (AFL).", "The AFL began a movement called Labor Forward, which was a pro-Christian group who \"preached unionization like a revival.\"", "In Philadelphia, this movement was counteracted by bringing revivalist Billy Sunday, himself firmly anti-union, who believed \"that the organized shops destroyed individual freedom.\"", "While the Social Gospel was short-lived historically, it had a lasting impact on the policies of most of the mainline denominations in the United States.", "Most began programs for social reform, which led to ecumenical cooperation in 1910 while in the formation of the Federal Council of Churches." ] ], "gold": "The Social Gospel was a religious wing of the progressive movement which fought injustice, suffering, and poverty primarily in the United States and Canada. A Canadian political party that was founded on social gospel principles took power in Saskatchewan province in 1944. Many of the activists opened settlement houses, most notably, Hull House in Chicago. Thomas Uzzel lead a wing of the movement in Denver, Matthews' reforms took place in Seattle, and Steinbruck was a leader of social gospel in Washington, DC from 1970 to 1997.", "prediction 1": "In the United States prior to the First World War, the Social Gospel was the religious wing of the progressive movement which had the aim of combating injustice, suffering and poverty in society. Denver, Colorado, was a centre of Social Gospel activism. Thomas Uzzel led the Methodist People's Tabernacle from 1885 to 1910. He established a free dispensary for medical emergencies, an employment bureau for job seekers, a summer camp for children, night schools for extended learning, and English language classes.", "prediction 2": "Social Gospel was the religious wing of the progressive movement which had the aim of combating injustice, suffering and poverty in society. Denver, Colorado, was a centre of Social Gospel activism. One of the ways in which it made its message heard was through labour movements. Particularly, the Social Gospel had a profound effect upon the American Federation of Labor. Particularly, the Social Gospel had a profound effect upon the American Baptist Church.", "prediction 3": "In the United States prior to the First World War, the Social Gospel was the religious wing of the progressive movement, which had the aim of combating injustice, suffering and poverty in society. Denver, Colorado, was a centre of Social Gospel activism. Many reformers inspired by the movement opened settlement houses, most notably Hull House in Chicago operated by Jane Addams. Settlement houses offered services such as daycare, education, and health care to needy people in slum neighbourhoods.", "prediction 4": "The Social Gospel movement was a religious wing of the progressive movement that had the aim of combating injustice, suffering and poverty in society. Several social reformers from around the country were involved in the movement, including Thomas Uzzel, who led the Methodist People's Tabernacle from 1885 to 1910. Many reformers inspired by the movement opened settlement houses, most notably Hull House in Chicago operated by Jane Addams. Settlement houses offered services such as daycare, education, and health care to needy people in slum neighbourhoods. Social Gospel activists from around the United States were active in foreign missions, which often had a social gospel component in terms especially of medical uplift. Particularly, the American Federation of Labor (AFL) had a profound effect upon the American Federation of Labor (AFL).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 514 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the United States prior to the First World War, the Social Gospel was the religious wing of the progressive movement which had the aim of combating injustice, suffering and poverty in society. Many reformers inspired by the movement opened settlement houses, most notably Hull House in Chicago operated by Jane Addams. Thomas Uzzel led the Methodist People's Tabernacle from 1885 to 1910. Mark A. Matthews (1867\u20131940) of Seattle's First Presbyterian Church was a leading city reformer" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Dark side of the moon weeks on chart?", "passages": [ [ "The Dark Side of the Moon", "\"The Dark Side of the Moon\" produced two singles: \"Money\" and \"Us and Them\".", "The album topped the \"Billboard\" chart for a week, and remained on the chart for 741 weeks from 1973 to 1988.", "Following a change in how \"Billboard\" counts sales in 2009, it re-entered the chart and has since appeared for over 900 weeks.", "With estimated sales of over 45 million, it is Pink Floyd's bestselling album and one of the bestselling worldwide.", "It has been remastered and rereleased several times, and covered in its entirety by several acts.", "It is regarded as one of the greatest albums of all time.", "Following \"Meddle\" in 1971, Pink Floyd assembled for a tour of Britain, Japan and the United States in December of that year.", "In a band meeting at drummer Nick Mason's home in Camden, bassist Roger Waters proposed that a new album could form part of the tour.", "Waters' idea was for an album that dealt with things that \"make people mad\", focusing on the pressures faced by the band during their arduous lifestyle, and dealing with the apparent mental problems suffered by former band member Syd Barrett.", "The band had explored a similar idea with 1969's \"The Man\" and \"The Journey\"." ], [ "The Dark Side of the Moon", "Although it held the number one spot in the US for only a week, it remained in the \"Billboard\" album chart for 741\u00a0weeks from 1973 to 1988.", "The album re-appeared on the \"Billboard\" charts with the introduction of the Top Pop Catalog Albums chart in May 1991, and has been a perennial feature since then.", "In the UK, it is the seventh-best-selling album of all time and the highest selling album never to reach number one.", "In the US the LP was released before the introduction of platinum awards in 1976.", "It therefore held only a gold disc until 16 February 1990, when it was certified 11\u00d7 platinum.", "On 4 June 1998 the Recording Industry Association of America (RIAA) certified the album 15\u00d7 platinum, denoting sales of fifteen million in the United States \u2013 making it their biggest-selling work there (\"The Wall\" is 23\u00d7 platinum, but as a double album this signifies sales of 11.5\u00a0million).", "\"Money\" has sold well as a single, and as with \"Time\", remains a radio favourite; in the US, for the year ending 20 April 2005, \"Time\" was played on 13,723\u00a0occasions, and \"Money\" on 13,731\u00a0occasions.", "Industry sources suggest that worldwide sales of the album total about 45 million." ], [ "The Dark Side of the Moon", "The Dark Side of the Moon\n\nThe Dark Side of the Moon is the eighth studio album by English rock band Pink Floyd, released on 1 March 1973 by Harvest Records.", "It built on ideas explored in Pink Floyd's earlier recordings and performances, but without the extended instrumentals that characterised their earlier work.", "A concept album, its themes explore conflict, greed, time, and mental illness, the latter partly inspired by the deteriorating health of founding member Syd Barrett, who left in 1968.", "Developed during live performances, Pink Floyd premiered an early version of \"The Dark Side of the Moon\" several months before recording began.", "New material was recorded in two sessions in 1972 and 1973 at Abbey Road Studios in London.", "The group used advanced recording techniques at the time, including multitrack recording and tape loops; analogue synthesizers are prominent, and snippets from interviews with Pink Floyd's road crew and others provide philosophical quotations.", "Engineer Alan Parsons was responsible for many sonic aspects and the recruitment of singer Clare Torry, who appears on \"The Great Gig in the Sky\".", "The iconic sleeve was designed by Storm Thorgerson; following keyboardist Richard Wright's request for a \"simple and bold\" design, it depicts a prism spectrum, representing the band's lighting and the record's themes." ] ], "gold": "The Dark Side of the Moon is the eighth studio album by the English rock band Pink Floyd, released on 1 March 1973 and hailed by critics as one of the greatest albums of all time. Upon initial release, it remained in the \"billboard\" album chart for 741 weeks, from 1971 to 1988, charting over 900 weeks in total thanks to later sporadic apparitions.", "prediction 1": "The Dark Side of the Moon is the eighth studio album by English rock band Pink Floyd. It built on ideas explored in Pink Floyd's earlier recordings and performances, but without the extended instrumentals that characterised their earlier work. The album topped the Billboard chart for a week and remained on the chart for 741 weeks from 1973 to 1988. Following a change in how Billboard counts sales in 2009, it re-entered the chart and has since appeared for over 900 weeks.", "prediction 2": "The Dark Side of the Moon is the eighth studio album by English rock band Pink Floyd. It built on ideas explored in Pink Floyd's earlier recordings and performances, but without the extended instrumentals that characterised their earlier work. The album topped the Billboard chart for a week, and remained on the chart for 741 weeks from 1973 to 1988. Following a change in how Billboard counts sales in 2009, it re-entered the chart and has since appeared for over 900 weeks. With estimated sales of over 45 million, it is Pink Floyd's bestselling album and one of the bestselling worldwide.", "prediction 3": "The Dark Side of the Moon is the eighth studio album by English rock band Pink Floyd. In the US, it held the number one spot for a week, but in the UK it held the number one spot for a full 741 weeks, and in the UK it held the number one spot for a full 738 weeks. In the UK, it is the seventh-best-selling album of all time and the highest selling album never to reach number one. The album re-appeared on the Billboard charts with the introduction of the Top Pop Catalog Albums chart in May 1991, and has been a perennial feature since then.", "prediction 4": "The Dark Side of the Moon is an album by English rock band Pink Floyd. It was released on 1 March 1973 by Harvest Records and topped the Billboard album chart for a week. The album remained on the chart for 741 weeks from 1973 to 1988. Following a change in how \"Billboard\" counts sales in 2009, it re-entered the chart and has since appeared for over 900 weeks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 243 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Dark Side of the Moon is the eighth studio album by English rock band Pink Floyd, released on 1 March 1973. It is regarded as one of the greatest albums of all time. The album topped the Billboard chart for a week and remained on the chart for 741 weeks from 1973 to 1988. Following a change in how Billboard counts sales in 2009, it re-entered the chart and has since appeared for over 900 weeks." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "The lion the witch and the wardrobe first film?", "passages": [ [ "The Lion, the Witch and the Wardrobe (1979 film)", "The Lion, the Witch and the Wardrobe (1979 film)\n\nThe Lion, the Witch and the Wardrobe is an animated television film that was broadcast on CBS in 1979, based on the novel of the same name by C. S. Lewis.", "When four children Lucy, Susan, Edmund and Peter stumble into an old Wardrobe they find themselves in a magical land called Narnia with talking animals, fauns, hags, the Wicked White Witch and the great lion Aslan.", "There they meet the friendly Mr. and Mrs. Beaver, who help them on their quest to find Aslan the great lion.", "Only he can help save Lucy's friend Mr. Tumnus (the faun) from the White Witch.", "They have a fun mysterious time there, and ultimately end up ruling as kings and queens, until they end up back home.", "The rights to produce the television program were given to the Episcopal Radio TV Foundation in the mid-1950s when C.S. Lewis was recording the Episcopal Series of the Protestant Hour radio programs.", "Dr. Ted Baehr was elected President of the Episcopal Radio TV Foundation as The Lion, the Witch and the Wardrobe was preparing to be broadcast by CBS, and supervised the distribution of the subsequent video.", "The CBS program had 37 million viewers.", "It would win an Emmy Award." ], [ "The Chronicles of Narnia: The Lion, the Witch and the Wardrobe", "The Chronicles of Narnia: The Lion, the Witch and the Wardrobe\n\nThe Chronicles of Narnia: The Lion, the Witch and the Wardrobe is a 2005 British-American high fantasy film directed by Andrew Adamson and based on \"The Lion, the Witch and the Wardrobe\", the first published and second chronological novel in C. S. Lewis's children's epic fantasy series, \"The Chronicles of Narnia\".", "It was co-produced by Walden Media and Walt Disney Pictures and distributed by Buena Vista Pictures.", "William Moseley, Anna Popplewell, Skandar Keynes and Georgie Henley play Peter, Susan, Edmund, and Lucy, four British children evacuated during the Blitz to the countryside, who find a wardrobe that leads to the fantasy world of Narnia.", "There they ally with the Lion Aslan (voiced by Liam Neeson) against the forces of Jadis, the White Witch (Tilda Swinton).", "The film was released on December 9, 2005, in both Europe and North America to positive reviews and was highly successful at the box office grossing more than $745\u00a0million worldwide, making it 2005's third most successful film.", "It won the 2005 Academy Award for Best Makeup and various other awards." ] ], "gold": "There are several \"The Lion, The Witch and the Wardrobe\" films. The first TV movie of \"The Lion, the Witch and the Wardrobe\" was an animated television program that was broadcast in two parts on CBS in 1979, based on the novel \"The Lion, the Witch and the Wardrobe\" by C. S. Lewis. Likewise, \"The Chronicles of Narnia: The Lion, the Witch and the Wardrobe\" was a 2005 fantasy film co-written and directed by Andrew Adamson, based on the 1950 novel The Lion, the Witch and the Wardrobe, the first published and second chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia. The film was released on December 9, 2005, in both Europe and North America to positive reviews and was highly successful at the box office, grossing more than $745 million worldwide, making it 2005's third-most-successful film.", "prediction 1": "The Lion, the Witch and the Wardrobe is the first and only published and chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia. The animated television film that was broadcast on CBS in 1979, The Lion, the Witch and the Wardrobe, is a 1979 adaptation of the novel. The 2005 film The Chronicles of Narnia: The Lion, the Witch and the Wardrobe is a British-American high fantasy film directed by Andrew Adamson and based on The Lion, the Witch and the Wardrobe, the Wardrobe, the first published and second chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia.\n", "prediction 2": "The Lion, the Witch and the Wardrobe is the first book in The Chronicles of Narnia series written by C.S. Lewis. The 1978 animated television film, The Lion, the Witch and the Wardrobe, was broadcast on CBS in 1979. Liam Neeson voiced the chapter 7 lion. Liam Neeson voiced the chapter 8 lion.", "prediction 3": "The Lion, the Witch and the Wardrobe is a 1979 American animated television film that was broadcast on CBS. The story of four British children evacuated during the Blitz to the countryside who find a wardrobe that leads to the fantasy world of Narnia.", "prediction 4": "There are two films that are based on the book The Lion, the Witch and the Wardrobe by C. S. Lewis. In 1979 the animated television film The Lion, the Witch and the Wardrobe was broadcast on CBS. In 2005 the English-American high fantasy film Chronicles of Narnia: The Lion, the Witch and the Wardrobe was released.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 54, "end": 68 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 408 }, { "error type": "Redundant", "explanation": "The Lion, the Witch and the Wardrobe ", "start": 232, "end": 269 }, { "error type": "Redundant", "explanation": "The Lion, the Witch and the Wardrobe is the first and only published and chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia. The animated television film that was broadcast on CBS in 1979, ", "start": 275, "end": 279 }, { "error type": "Redundant", "explanation": "The Lion, the Witch and the Wardrobe is the first and only published and chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia. ", "start": 449, "end": 640 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Lion, the Witch and the Wardrobe is the first published and second chronological novel in C. S. Lewis's children's epic fantasy series, The Chronicles of Narnia. The animated television film that was broadcast on CBS in 1979, is an adaptation of the novel. The 2005 film The Chronicles of Narnia: The Lion, the Witch and the Wardrobe is a fantasy film directed by Andrew Adamson, and was released on December 9, 2005, in both Europe and North America to positive reviews and was highly successful at the box office, grossing more than $745 million worldwide, making it 2005's third-most-successful film.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did motown the musical open on broadway?", "passages": [ [ "Motown: The Musical", "Motown: The Musical\n\nMotown: The Musical is a jukebox musical that premiered on Broadway in April 2013.", "The musical is based on Berry Gordy's autobiography \"To Be Loved: The Music, the Magic, the Memories of Motown\" (1994), and on the history of his founding and running of the Motown record label, and his personal and professional relationships with Motown artists such as Diana Ross, Smokey Robinson, Marvin Gaye, and Michael Jackson.", "The production's music and lyrics are taken from selections from the Motown catalog.", "It received four nominations at the 67th Tony Awards.", "\"Motown: The Musical\" premiered on Broadway, at the Lunt-Fontanne Theatre, on April 14, 2013, after previews starting on March 11.", "The production was directed by Charles Randolph-Wright, with choreography by Patricia Wilcox, scenic design by David Korins, costumes by ESosa, lighting by Natasha Katz, sound design by Peter Hylenski, and projection design by Daniel Brodie.", "The musical finished its original Broadway run on January 18, 2015, closing after 37 previews and 738 regular performances.", "A national tour began in April 2014, featuring Clifton Oliver and Allison Semmes.", "The show returned on July 12, 2016 to Broadway for an announced 18-week run at the Nederlander Theatre." ], [ "Motown: The Musical", "The recording stars sing their popular numbers, including: Diana Ross (\"I Hear a Symphony\", \"You're Nobody till Somebody Loves You\", and \"You're All I Need to Get By\"), Stevie Wonder, The Supremes (\"Buttered Popcorn\", \"Where Did Our Love Go\"), The Miracles (\"Shop Around\"), The Marvelettes (\"Please Mr. Postman\"), Mary Wells (\"Bye Bye Baby\"/\"Two Lovers Medley\"), The Temptations, Martha and the Vandellas (\"Dancing in the Street\"), The Contours (\"Do You Love Me\"), and The Jackson 5.", "The musical contains a total of 66 songs.", "The following song list is not the order of the songs in the production:\n\nCharles Isherwood, in his review for \"The New York Times\", wrote: \"More than 50 songs...are performed in 'Motown,' usually, alas, in truncated versions.", "Most are simply presented as concert versions by the actors playing the artists who made them famous, but a few are shoehorned awkwardly into the story as 'book' songs...", "Making way for so much music means that 'Motown' breezily scrimps on storytelling." ], [ "Pops, We Love You (A Tribute to Father)", "Pops, We Love You (A Tribute to Father)\n\n\"Pops, We Love You (A Tribute to Father)\" is a 1978 single recorded and released by Motown stars Diana Ross, Marvin Gaye, Smokey Robinson and Stevie Wonder, as a tribute to the late Berry \"Pops\" Gordy, Sr., father of Motown founder Berry Gordy, who had died that year after a long battle with cancer.", "For the duration of Motown Records' tenure in its native Detroit, Berry Gordy's father, Berry Gordy, Sr., otherwise known as \"Pops\", was one of the overseers of his son's label and was one of many to guide its many artists, most of which became famous following the release of successful records.", "Among those who he helped mentor were Diana Ross, Marvin Gaye, Smokey Robinson and Stevie Wonder.", "At one point, Gaye was Gordy's son-in-law after he married his daughter Anna.", "When Gordy Sr. died that October, his son asked longtime Motown songwriters Marilyn McLeod and Pam Sawyer to compose a song in tribute to him and also began to produce a full-length album with other artists.", "For the title track, Ross, Gaye, Robinson and Wonder were called in to record the song." ] ], "gold": "\"Motown: The Musical\" premiered on Broadway at the Lunt-Fontanne Theatre on April 14, 2013, after previews starting on March 11. The show featured over 50 songs from Motown artists such as Diana Ross, Smokey Robinson, Marvin Gaye, and Michael Jackson.", "prediction 1": "Motown: The Musical, a jukebox musical based on Berry Gordy's autobiography \"To Be Loved: The Music, the Magic, the Memories of Motown\", opened on Broadway on April 14, 2013, after previews starting on March 11. The musical finished its original Broadway run on January 18, 2015, closing after 37 previews and 738 regular performances. A national tour began in April 2014, featuring Clifton Oliver and Allison Semmes, and the show returned on July 12, 2016 to Broadway for an announced 18-week run at the Nederlander Theatre.", "prediction 2": "The Motown musical premiered on Broadway on April 14, 2013 and closed on January 18, 2015. Motown: The Musical has been on Broadway since April 2013, when performances began at the Lunt Fontanne Theatre.", "prediction 3": "Motown: The Musical is a jukebox musical that premiered on Broadway in April 2013. The musical is based on Berry Gordy's autobiography To Be Loved: The Music, the Magic, the Memories of Motown, and on the history of his founding and running of the Motown record label, and his personal and professional relationships with Motown artists such as Diana Ross, Marvin Gaye, and Michael Jackson. The musical finished its original Broadway run on January 18, 2015, closing after 37 previews and 738 regular performances.", "prediction 4": "Motown the Musical is a jukebox musical that premiered on Broadway in April 2013. It's based on Berry Gordy's 1994 autobiography To Be Loved: The Music, the Magic, the Memories of Motown, and on the history of his founding and running of the Motown record label, and his personal and professional relationships with Motown artists such as Diana Ross, Marvin Gaye, Marvin Gaye, Michael Jackson. The musical finished its original Broadway run on January 18, 2015, closing after 37 previews and 738 regular performances.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 21, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 335 }, { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 525 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "\"Motown: The Musical\" premiered on Broadway at the Lunt-Fontanne Theatre on April 14, 2013, after previews starting on March 11. The show featured over 50 songs from Motown artists such as Diana Ross, Smokey Robinson and Stevie Wonder." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is the second largest country in south asia?", "passages": [ [ "South Asia", "The report mentioned that although there has been a reduction in malnutrition due to the Green Revolution in South Asia, there is concern that South Asia has \"inadequate feeding and caring practices for young children\".", "India and Pakistan are the dominant political powers in the region.", "India is by far the largest country in the area covering around three-fourths the land area of the South Asian region.", "India has the largest population of around three times the combined population of the 6 other countries in the region.", "India is also the world's largest democracy India's annual defence budget for 2013\u201314 is $39.2 billion which is equal to the whole Pakistan's Federal budget of $39.3 billion for 2014\u201315.", "Bangladesh is a unitary state and parliamentary democracy.", "Bangladesh also stands out as one of the few Muslim-majority democracies.", "\"It is a moderate and generally secular and tolerant \u2014 though sometimes this is getting stretched at the moment \u2014 alternative to violent extremism in a very troubled part of the world\", said Dan Mozena, the U.S. ambassador to Bangladesh.", "Although Bangladesh's legal code is secular, more citizens are embracing a conservative version of Islam, with some pushing for sharia law, analysts say." ], [ "Pakistan", "Pakistan\n\nPakistan (), officially the Islamic Republic of Pakistan (), is a country in South Asia.", "It is the world\u2019s sixth-most populous country with a population exceeding 212,742,631 people.", "In area, it is the 33rd-largest country, spanning .", "Pakistan has a coastline along the Arabian Sea and Gulf of Oman in the south and is bordered by India to the east, Afghanistan to the west, Iran to the southwest, and China in the far northeast.", "It is separated narrowly from Tajikistan by Afghanistan's Wakhan Corridor in the northwest, and also shares a maritime border with Oman.", "The territory that now constitutes Pakistan was the site of several ancient cultures and intertwined with the history of the broader Indian subcontinent.", "The ancient history involves the Neolithic site of Mehrgarh and the Bronze Age Indus Valley Civilisation, and was later home to kingdoms ruled by people of different faiths and cultures, including Hindus, Indo-Greeks, Muslims, Turco-Mongols, Afghans and Sikhs." ], [ "Demographics of Pakistan", "Demographics of Pakistan\n\nPakistan's latest estimated population is 207,774,520 (excluding the autonomous regions of Azad Jammu and Kashmir and Gilgit-Baltistan).", "This makes Pakistan the world's fifth-most-populous country, just behind Indonesia and slightly ahead of Brazil.", "Including Azad Kashmir, the population would be 211.819 million.", "Gilgit Baltistan region has an additional estimated population of 1.8 million.", "During 1950\u20132011, Pakistan's urban population expanded over sevenfold, while the total population increased by over fourfold.", "In the past, the country's population had a relatively high growth rate that has been changed by moderate birth rates.", "Between 1998-2017, the average population growth rate stood at 2.40%.", "Dramatic social changes have led to rapid urbanization and the emergence of megacities.", "During 1990\u20132003, Pakistan sustained its historical lead as the second-most urbanized nation in South Asia with city dwellers making up 36% of its population.", "Furthermore, 50% of Pakistanis now reside in towns of 5,000 people or more.", "Pakistan has a multicultural and multi-ethnic society and hosts one of the largest refugee populations in the world as well as a young population." ] ], "gold": "Pakistan, officially the Islamic Republic of Pakistan, is the second largest country in South Asia by both land and water and population. It is the world's fifth-most populous country, with a population exceeding 225.2 million, and has the world's second-largest Muslim population. During 1990\u20132003, Pakistan sustained its historical lead as the second-most urbanized nation in South Asia with city dwellers making up 36% of its population, and 50% of Pakistanis now reside in towns of 5,000 people or more. Pakistan is the 33rd-largest country by area, spanning 881,913 square kilometres, and it has a 1,046-kilometre coastline along the Arabian Sea and Gulf of Oman in the south, and is bordered by India to the east, Afghanistan to the west, Iran to the southwest, and China to the northeast.", "prediction 1": "The second largest country in South Asia is Bangladesh, and the second largest country in the region is India. In area, China is the 33rd largest country in South Asia, spanning.", "prediction 2": "The second largest country in South Asia is Pakistan. The country has the second largest population in the world, with a population reaching 214,742,631.", "prediction 3": "The second largest country in South Asia by area is Afghanistan, which has a population of 839,784,811. The country of Tajikistan, on the other hand, has a population of 2,735,766. The third largest country by population is Bangladesh, which is a unitary state and parliamentary democracy. The country with the second largest population is India, which covers 34% of the land area in the region.", "prediction 4": "The world's sixth-most populous country is Pakistan, which has a population exceeding 212,742,631 people. The second largest country in South Asia is Bangladesh, which has a population of 207,774,520 people. The country also has the second largest economy in the world, with a GDP of $2.6 trillion.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 110 }, { "error type": "Unverifiable", "explanation": "", "start": 111, "end": 178 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Pakistan, officially the Islamic Republic of Pakistan, is the world\u2019s sixth-most populous country with a population exceeding 212,742,631 people. In area, it is the 33rd-largest country. During 1990\u20132003, Pakistan sustained its historical lead as the second-most urbanized nation in South Asia with city dwellers making up 36% of its population. Pakistan has a coastline along the Arabian Sea and Gulf of Oman in the south and is bordered by India to the east, Afghanistan to the west, Iran to the southwest, and China in the far northeast. " }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When was the last time the yankees and the dodgers played in a world series?", "passages": [ [ "Los Angeles Dodgers", "After the move to California, the Dodgers have won five in Los Angeles, the Giants have won three in San Francisco.", "The Dodgers were founded in 1883 as the Brooklyn Atlantics, taking the name of a defunct team that had played in Brooklyn before them.", "The team joined the American Association in 1884 and won the AA championship in 1889 before joining the National League in 1890.", "They promptly won the NL Championship their first year in the League.", "The team was known alternatively as the Bridegrooms, Grooms, Superbas, Robins, and Trolley Dodgers before officially becoming the Dodgers in the 1930s.", "In Brooklyn, the Dodgers won the NL pennant several times (1890, 1899, 1900, 1916, 1920, 1941, 1947, 1949, 1952, 1953, 1955, 1956) and the World Series in 1955.", "After moving to Los Angeles, the team won National League pennants in 1959, 1963, 1965, 1966, 1974, 1977, 1978, 1981, 1988, 2017, and 2018, with World Series championships in 1959, 1963, 1965, 1981 and 1988.", "In all, the Dodgers have appeared in 20 World Series: 9 in Brooklyn and 11 in Los Angeles.", "For most of the first half of the 20th century, no Major League Baseball team employed an African American player." ], [ "Dodgers\u2013Yankees rivalry", "Tickets in both cities have become exclusive shortly after going on sale and games between the two teams have drawn sell out crowds, as evidenced during the doubleheader at the new Yankee Stadium in June 2013, the first time the Dodgers visited the Bronx since interleague play was introduced and the first time they visited the new Yankee Stadium.", "After 23 years of not facing the Yankees, LA hosted an interleague weekend series in June 2004 where they took two out of three contests.", "One ending had closer \u00c9ric Gagn\u00e9 strike out Bernie Williams for the final out.", "The third and final game was the ESPN Sunday Night game that weekend.", "The rivalry was renewed when Joe Torre, who led the Yankees to four World Series championships, accepted a three-year, $13 million contract to manage the Dodgers on November 1, 2007.", "He also brought along former Yankee first baseman Don Mattingly and Larry Bowa to his coaching staff.", "Coaches Rick Honeycutt and Mariano Duncan each played for both teams.", "Torre and left fielder Manny Ramirez, who had been a part of the fierce Yankees\u2013Red Sox rivalry before being traded to the Dodgers mid-season, led the Dodgers to the 2008 West Division Pennant.", "The Yankees failed to make the 2008 Postseason, ending their 13-year consecutive postseason appearance streak with 12 of which were under Torre's." ], [ "1996 World Series", "1996 World Series\n\nThe 1996 World Series was the championship series of Major League Baseball's (MLB) 1996 season.", "The 92nd edition of the World Series, it was a best-of-seven playoff between the National League (NL) champion (and defending World Series champion)", "Atlanta Braves and the American League (AL) champion New York Yankees.", "The Yankees defeated the Braves, four games to two, to capture their first World Series title since 1978 and their 23rd World Series championship overall.", "The series was played from October 20\u201326, 1996, and was broadcast on television on Fox.", "Yankees relief pitcher John Wetteland was named the World Series Most Valuable Player for saving all four Yankee wins.", "The Yankees advanced to the World Series by defeating the Texas Rangers in the AL Division Series, three games to one, and then the Baltimore Orioles in the AL Championship Series, four games to one.", "It was the Yankees' first appearance in a World Series since 1981.", "The Braves advanced to the Series by defeating the Los Angeles Dodgers in the NL Division Series, three games to none, and then the St. Louis Cardinals in the NL Championship Series, four games to three.", "It was the Braves' second consecutive appearance in a World Series.", "The Yankees lost the first two games at home, being outscored by the Braves, 16\u20131." ] ], "gold": "The 1981 World Series was the 78th edition of the World Series; a best-of-seven playoff played between the American League champion New York Yankees and the National League champion Los Angeles Dodgers. It marked their third Series meeting in five years and the last time the teams faced each other in a World Series. The Dodgers won the Series in six games, achieving their first title since 1965, their first victory over the Yankees since 1963, and third overall Series win over the Yankees.", "prediction 1": "The New York Yankees and the Los Angeles Dodgers have played in several World Series. In 1996, the Yankees defeated the Atlanta Braves, four games to two, to capture their first World Series title since 1978 and their 23rd World Series championship overall. The last time the Yankees and the Dodgers played in a World Series was in 1996.", "prediction 2": "The New York Yankees and the Los Angeles Dodgers have played in a total of 20 World Series. The last time the yankees and the dodgers played in a World Series was in 1996.", "prediction 3": "The New York Yankees and the Los Angeles Dodgers have played in several World Series. The New York Yankees and the Los Angeles Dodgers last played in a World Series on October 26, 1996. In all, the Dodgers have appeared in 20 World Series: 9 in Brooklyn and 11 in Los Angeles. The last time the Yankees and the Dodgers played in a World Series was in 1898.", "prediction 4": "The last time the New York Yankees and the Los Angeles Dodgers played in a World Series was in 1996.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 257 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 325, "end": 337 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The last time the Yankees and the Dodgers played in a World Series was in 1981." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the civilian conservation corps start and end?", "passages": [ [ "Civilian Conservation Corps", "It developed infrastructure for military training facilities and forest protection.", "By 1940 the CCC was no longer wholly a relief agency, was rapidly losing its non-military character, and it was becoming a system for work-training, as its ranks had become increasingly younger, with little experience.", "Although the CCC was probably the most popular New Deal program, it never was authorized as a permanent agency.", "The program was reduced in scale as the Depression waned and employment opportunities improved.", "After conscription began in 1940, fewer eligible young men were available.", "Following the attack on Pearl Harbor in December 1941, the Roosevelt administration directed all federal programs to emphasize the war effort.", "Most CCC work, except for wildland firefighting, was shifted onto U.S. military bases to help with construction.", "The CCC disbanded one year earlier than planned, as the 77th United States Congress ceased funding it.", "Operations were formally concluded at the end of the federal fiscal year on June 30, 1942.", "The end of the CCC program and closing of the camps involved arrangements to leave the incomplete work projects in the best possible state, the separation of about 1,800 appointed employees, the transfer of CCC property to the War and Navy Departments and other agencies, and the preparation of final accountability records.", "Liquidation of the CCC was ordered by Congress by the Labor-Federal Security Appropriation Act (56 Stat." ], [ "Civilian Conservation Corps", "Civilian Conservation Corps\n\nThe Civilian Conservation Corps (CCC) was a public work relief program that operated from 1933 to 1942 in the United States for unemployed, unmarried men.", "Originally for young men ages 18\u201325, it was eventually expanded to ages 17\u201328.", "Robert Fechner was the first director of the agency, succeeded by James McEntee following Fechner's death.", "The CCC was a major part of President Franklin D. Roosevelt's New Deal that provided unskilled manual labor jobs related to the conservation and development of natural resources in rural lands owned by federal, state, and local governments.", "The CCC was designed to provide jobs for young men and to relieve families who had difficulty finding jobs during the Great Depression in the United States.", "Maximum enrollment at any one time was 300,000.", "Through the course of its nine years in operation, 3 million young men participated in the CCC, which provided them with shelter, clothing, and food, together with a wage of $30 (about $570 in 2017) per month ($25 of which had to be sent home to their families).", "The American public made the CCC the most popular of all the New Deal programs.", "Sources written at the time claimed an individual's enrollment in the CCC led to improved physical condition, heightened morale, and increased employability." ], [ "Civilian Conservation Corps", "The CCC also led to a greater public awareness and appreciation of the outdoors and the nation's natural resources, and the continued need for a carefully planned, comprehensive national program for the protection and development of natural resources.", "Enrollees of the CCC planted nearly 3 billion trees to help reforest America; constructed trails, lodges, and related facilities in more than 800 parks nationwide; and upgraded most state parks, updated forest fire fighting methods, and built a network of service buildings and public roadways in remote areas.", "The CCC operated separate programs for veterans and Native Americans.", "Approximately 15,000 Native Americans participated in the program, helping them weather the Great Depression.", "Despite its popular support, the CCC was not a permanent agency.", "It depended on emergency and temporary Congressional legislation and funding to operate.", "By 1942, with World War II and the draft in operation, the need for work relief declined, and Congress voted to close the program.", "As governor of New York, Franklin Delano Roosevelt had run a similar program on a much smaller scale.", "Long interested in conservation, as president, he proposed to Congress a full-scale national program on March 21, 1933:\n", "He promised this law would provide 250,000 young men with meals, housing, workwear, and medical care for working in the national forests and other government properties." ] ], "gold": "The Civilian Conservation Corps was a voluntary public work relief program in the United States for unemployed, unmarried men ages 18\u201325 and eventually expanded to ages 17\u201328. It began operating on April 5, 1933, and became a major part of President Franklin D. Roosevelt's New Deal, providing manual labor jobs related to conserving and developing natural resources in rural lands owned by federal, state, and local governments. The CCC was designed to allow young men access to jobs and to relieve families who had difficulty finding them during the Great Depression in the United States. On June 30, 1942, with World War II raging, the draft in full effect, and the need for work relief declining, Congress voted to close the program.", "prediction 1": "The Civilian Conservation Corps (CCC) was a public work relief program that operated from 1933 to 1942 in the United States for unemployed, unmarried men. Originally for young men ages 18\u201325, it was eventually expanded to ages 17\u201328. During the nine years of operation, 3 million young men participated in the CCC, which provided them with shelter, clothing, and food, together with a wage of $30 (about $570 in 2017) per month. Eventually, the program expanded to include young men ages 17\u201328.", "prediction 2": "The Civilian Conservation Corps was a public work relief program that operated from 1933 to 1942 for unemployed, unmarried men in the United States. The program was designed to provide jobs for young men and to relieve families who had difficulty finding jobs during the Great Depression. Originally for young men ages 18\u201325, it was eventually expanded to ages 17\u201328. This program ended one year earlier than planned, as the 77th United States Congress ceased funding it. Operations were formally concluded at the end of the federal fiscal year on June 30, 1942.", "prediction 3": "The Civilian Conservation Corps (CCC) was a public work relief program that operated from 1933 to 1942 in the United States for unemployed, unmarried men. Originally for young men ages 18-25, it was eventually expanded to ages 17\u201328. Operations were formally concluded at the end of the federal fiscal year on June 30, 1942. The disbandment of the CCC and closing of the camps involved arrangements to leave the incomplete work projects in the best possible state, the separation of about 1,800 appointed employees, the transfer of CCC property to the War and Navy Departments and other agencies, and the preparation of final accountability records.", "prediction 4": "The Civilian Conservation Corps was a public work relief program that operated from 1933 to 1942 in the United States for unemployed, unmarried men. The program was designed to provide jobs for young men and to relieve families who had difficulty finding jobs during the Great Depression in the United States. Originally for young men ages 18\u201325, it was eventually expanded to ages 17\u201328. The program ended one year earlier than planned, as the 77th United States Congress ceased funding it.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 428 }, { "error type": "Redundant", "explanation": " it was eventually expanded to ages 17\u201328. ", "start": 429, "end": 494 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Civilian Conservation Corps (CCC) was a public work relief program that operated from 1933 to 1942 in the United States for unemployed, unmarried men. Originally for young men ages 18\u201325, it was eventually expanded to ages 17\u201328. The CCC was a major part of President Franklin D. Roosevelt's New Deal that provided unskilled manual labor jobs related to the conservation and development of natural resources in rural lands owned by federal, state, and local governments. The CCC was designed to provide jobs for young men and to relieve families who had difficulty finding jobs during the Great Depression in the United States. Operations were formally concluded at the end of the federal fiscal year on June 30, 1942. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who's the woman that played wonder woman?", "passages": [ [ "Wonder Woman in other media", "It's that combination of being fierce but kind at the same time that we were looking for.", "Gadot described Diana as having \"the heart of a human so she can be emotional, she's curious, she's compassionate, she loves people.", "And then she has the powers of a goddess.", "She's all for good, she fights for good.\"", "She also said that Diana has \"many strengths and powers, but at the end of the day she's a woman with a lot of emotional intelligence\".", "Gadot underwent a diet and training regimen, practiced different martial arts and gained 17 pounds of muscle for the role.", "Gadot was previously offered a different role (as a villain) in \"Man of Steel\", which she declined because she was pregnant at the time; this allowed her to later be cast as Wonder Woman in the film's follow-up.", "Gadot signed a three-picture deal.", "She was only paid a base salary of $300,000 for the movie itself.", "Gadot reprised the role in 2017's \"Wonder Woman\", the fourth installment in the DC Extended Universe and Wonder Woman's first theatrical solo film." ], [ "Wonder Woman (1974 film)", "Wonder Woman (1974 film)\n\n", "Wonder Woman is a 1974 American made-for-television superhero film based on the DC Comics character of the same name, directed by Vincent McEveety and starring Cathy Lee Crosby.", "The film was a pilot for an intended television series being considered by ABC.", "Ratings were described as \"respectable but not exactly wondrous,\" and ABC did not pick up the pilot.", "Instead, Warner Brothers and ABC developed a different Wonder Woman television concept that fit the more traditional presentation of the character as created by William Moulton Marston, turning away from the 1968\u201372 era that had influenced the pilot.", "\"\", which premiered in 1975, starred Lynda Carter and eventually led to the \"Wonder Woman\" TV series.", "Crosby would later claim that she was offered the chance to reprise the role in that series.", "Wonder Woman's first broadcast appearance in live-action television was a movie made in 1974 for ABC.", "Written by John D. F. Black, the TV movie resembles the Wonder Woman of the \"I Ching\" period.", "Wonder Woman (Cathy Lee Crosby) did not wear the comic-book uniform, demonstrated no apparent super-human powers, had a \"secret identity\" of Diana Prince that was not all that secret, and she was also depicted as blonde (differing from the black hair established in the comic books)." ] ], "gold": "Several people have played Wonder Woman. Cathy Lee Crosby portrays the titular character in the 1974 film which drew heavily from the comic character's \"I Ching\" period. \"Batman v Superman: Dawn of Justice\" is a 2016 American superhero film and the second installment of the DC Extended Universe. It is also the first live action theatrical film to feature \"Wonder Woman\" as well as her secret identity, Diana Prince. In late 2013, Zack Snyder cast Gal Gadot in the role over \u00c9lodie Yung and Olga Kurylenko.", "prediction 1": "Wonder Woman is a 1974 American made-for-television superhero film based on the DC Comics character of the same name, directed by Vincent McEveety and starring Cathy Lee Crosby. Crosby would later claim that she was offered the chance to reprise the role in the Wonder Woman TV series. Wonder Woman's first broadcast appearance in live-action television was a movie made in 1974 for ABC.", "prediction 2": "Wonder Woman is the title of a 1974 American made-for-television superhero film directed by Vincent McEveety and starring Cathy Lee Crosby. Gadot played Wonder Woman in the film for three years before being cast as Wonder Woman in the film's follow-up. Gadot reprised the role in 2017's Wonder Woman, the fourth installment in the DC Extended Universe and Wonder Woman's first theatrical solo film.", "prediction 3": "Wonder Woman is also the name of a 1974 American made-for-television superhero film directed by Vincent McEveety and starring Cathy Lee Crosby, who played Wonder Woman in the pilot of the television series Wonder Woman. In the 1975 movie, Wonder Woman wore a different uniform, demonstrated no apparent super-human powers, had a \"secret identity\" of Diana Prince that was not all that secret, and she was depicted as blonde. In the 2017 film, Gal Gadot played Wonder Woman, which was also played Wonder Woman by Lynda Carter, and ultimately led to the Wonder Woman TV series.", "prediction 4": "Wonder Woman is a 1974 American made-for-television superhero film based on the DC Comics character of the same name, directed by Vincent McEveety and starring Cathy Lee Crosby. The film was a pilot for an intended television series being considered by ABC. Ratings were described as \"respectable but not exactly wondrous,\" and ABC did not pick up the pilot. Instead, Warner Brothers and ABC developed a different Wonder Woman television concept that fit the more traditional presentation of the character as created by William Moulton Marston. Crosby would later claim that she was offered the chance to reprise the role in that series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 285 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 387 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Wonder Woman is a 1974 American made-for-television superhero film based on the DC Comics character of the same name, starring Cathy Lee Crosby. Gadot was cast as Wonder Woman as well." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was last time england won world cup?", "passages": [ [ "1966 FIFA World Cup Final", "1966 FIFA World Cup Final\n\nThe 1966 FIFA World Cup Final was the final match in the 1966 FIFA World Cup, the eighth football World Cup.", "The match was played by England and West Germany on 30 July 1966 at Wembley Stadium in London, and had an attendance of 96,924.", "The British television audience peaked at 32.3\u00a0million viewers, making it the most watched television event ever in the United Kingdom.", "England won 4\u20132 after extra time to win the Jules Rimet Trophy.", "The England team became known as the \"wingless wonders\", on account of their then-unconventional narrow attacking formation, described at the time as a 4\u20134\u20132.", "The match is remembered for England's only World Cup trophy, Geoff Hurst's hat-trick\u00a0\u2013 the first, and to date, only one ever scored in a FIFA World Cup Final\u00a0\u2013 and the controversial third goal awarded to England by referee Gottfried Dienst and linesman Tofiq Bahramov.", "Both teams were strong throughout the tournament.", "Each won two and drew one of their three matches in the group stages.", "England did not concede a goal until their semi-final against Portugal." ] ], "gold": "The 1966 FIFA World Cup Final was a football match played at Wembley Stadium, London, on 30 July 1966 to determine the winner of the 1966 FIFA World Cup, the eighth FIFA World Cup. The match was contested by England and West Germany, with England winning 4\u20132 after extra time to claim the Jules Rimet Trophy. It was the first \u2013 and to date only \u2013 occasion that England has hosted or won the World Cup.", "prediction 1": "The last time England won the FIFA World Cup was in 1966. It was in Brazil and on 23 July 1966.", "prediction 2": "The last time England won the FIFA World Cup was in 1966, on 30 July 1966, when they defeated West Germany 2-1 in extra time to win the Jules Rimet Trophy.", "prediction 3": "The last time England won the football World Cup was in 1966, when they defeated West Germany 4\u20132 after extra time to win the Jules Rimet Trophy.", "prediction 4": "The last time England won the FIFA World Cup was in 1966. The match was played between England and West Germany on 30 July 1966 at Wembley Stadium in London.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 58, "end": 95 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1966 FIFA World Cup Final was the final match in the 1966 FIFA World Cup, the eighth football World Cup. The match was played by England and West Germany on 30 July 1966 at Wembley Stadium in London. England won 4\u20132 after extra time to win the Jules Rimet Trophy. It was the first \u2013 and to date only \u2013 occasion that England has hosted or won the World Cup." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When was the first mobile phone released to the public?", "passages": [ [ "History of mobile phones", "The advances in mobile telephony can be traced in successive \"generations\" from the early \"0G\" services like MTS and its successor Improved Mobile Telephone Service, to first-generation (1G) analog cellular network, second-generation (2G) digital cellular networks, third-generation (3G) broadband data services to the state-of-the-art, fourth-generation (4G) native-IP networks.", "In 1949, AT&T commercialized Mobile Telephone Service.", "From its start in St. Louis, Missouri, in 1946, AT&T introduced Mobile Telephone Service to one hundred towns and highway corridors by 1948.", "Mobile Telephone Service was a rarity with only 5,000 customers placing about each week.", "Calls were set up manually by an operator and the user had to depress a button on the handset to talk and release the button to listen.", "The call subscriber equipment weighed about \n\nSubscriber growth and revenue generation were hampered by the constraints of the technology.", "Because only three radio channels were available, only three customers in any given city could make mobile telephone calls at one time.", "Mobile Telephone Service was expensive, costing US$15 per month, plus $0.30\u20130.40 per local call, equivalent to (in 2012 US dollars) about $176 per month and $3.50\u20134.75 per call." ], [ "History of mobile phones", "One of the first successful public commercial mobile phone networks was the ARP network in Finland, launched in 1971.", "Posthumously, ARP is sometimes viewed as a \"zero generation\" (0G) cellular network, being slightly above previous proprietary and limited coverage networks.", "Prior to 1973, mobile telephony was limited to phones installed in cars and other vehicles.", "Motorola was the first company to produce a handheld mobile phone.", "On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs, his rival.", "The prototype handheld phone used by Dr. Cooper weighed and measured .", "The prototype offered a talk time of just 30 minutes and took 10 hours to re-charge.", "John F. Mitchell, Motorola's chief of portable communication products and Cooper's boss in 1973, played a key role in advancing the development of handheld mobile telephone equipment.", "Mitchell failed to push Motorola into developing wireless communication products that would be small enough to use anywhere and participated in the design of the cellular phone.", "Newer technology has been developed and rolled out in a series of waves or generations.", "The \"generation\" terminology only became widely used when 3G was launched, but is now used retroactively when referring to the earlier systems." ], [ "History of mobile phones", "First automatic analog cellular systems deployed were NTT's system first used in Tokyo in 1979, later spreading to the whole of Japan, and NMT in the Nordic countries in 1981.", "The first analog cellular system widely deployed in North America was the Advanced Mobile Phone System (AMPS).", "It was commercially introduced in the Americas in 13 October 1983, Israel in 1986, and Australia in 1987.", "AMPS was a pioneering technology that helped drive mass market usage of cellular technology, but it had several serious issues by modern standards.", "It was unencrypted and easily vulnerable to eavesdropping via a scanner; it was susceptible to cell phone \"cloning\" and it used a Frequency-division multiple access (FDMA) scheme and required significant amounts of wireless spectrum to support.", "On 6 March 1983, the DynaTAC 8000X mobile phone launched on the first US 1G network by Ameritech.", "It cost $100M to develop, and took over a decade to reach the market.", "The phone had a talk time of just thirty-five minutes and took ten hours to charge.", "Consumer demand was strong despite the battery life, weight, and low talk time, and waiting lists were in the thousands." ] ], "gold": "The first customers had access to mobile phones from 1946 in St. Louis, when AT&T introduced the car phone. Motorola created the first handheld mobile phone in 1973, while the first analog cellular systems were used in 1979 by NTT in Japan. The first digital mobile phones, which were the second generation mobile phone systems, emerged in the 1990s.", "prediction 1": "The first real mobile phone was released to the public on April 3, 1973, by Martin Cooper, a Motorola researcher and executive. On 6 March 1983, the DynaTAC 8000X mobile phone launched on the first US 1G network by Ameritech. It cost $100M to develop, and took over a decade to reach the market. On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs, his rival. On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Engel of Bell Labs, his rival. On April 3, 1973, Martin Cooper made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Engel of Bell Labs, placing a call from handheld", "prediction 2": "The first mobile phone released to the public in the United States was the Motorola DX-1 on March 6, 1983. On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs. The first digital cellular network to be commercially deployed in North America was the Advanced Mobile Phone System (AMPS). It was commercially introduced in the Americas on October 13, 1983, Israel on 1986, and Australia in 1987. On 6 March 1983, the first US 1G network was the Motorola DynaTAC 8000X, launched on the first US 1G network by Ameritech.", "prediction 3": "On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs, his rival. DynaTAC 8000X mobile phone launched on the first US 1G network by Ameritech. It cost $100M to develop, and took over a decade to reach the market. The phone had a talk time of just thirty-five minutes and took ten hours to re-charge.", "prediction 4": "On March 6, 1983, the first mobile phone launched on the first US 1G network by Ameritech. Mobile telephony advances can be traced in successive \"generations\" from the early \"0G\" services like MTS and its successor Improved Mobile Telephone Service, to first-generation (1G) analog cellular network, second-generation (2G) digital cellular networks, and finally, fourth-generation (4G) native-IP networks. Prior to 1973, mobile telephony was limited to phones installed in cars and other vehicles.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 32, "end": 54 }, { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 225 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 295 }, { "error type": "Redundant", "explanation": "by Martin Cooper, a Motorola researcher and executive. ", "start": 296, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 499 }, { "error type": "Redundant", "explanation": "On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs, his rival. ", "start": 500, "end": 695 }, { "error type": "Redundant", "explanation": "On April 3, 1973, Martin Cooper, a Motorola researcher and executive, made the first mobile telephone call from handheld subscriber equipment, placing a call to Dr. Joel S. Engel of Bell Labs, his rival. ", "start": 696, "end": 842 }, { "error type": "Incoherent", "explanation": "", "start": 843, "end": 871 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "From its start in St. Louis, Missouri, in 1946, AT&T introduced Mobile Telephone Service. Prior to 1973, mobile telephony was limited to phones installed in cars and other vehicles. The first real mobile phone was developed on April 3, 1973, by Motorola. The first automatic analog cellular systems by NTT's system first appeared in 1979." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Who killed dennis rickman in eastenders in 2005?", "passages": [ [ "Sharon Watts", "Dennis reunites with Sharon in America and in June 2005 they return to confront Den but Chrissie claims he has left with another woman, which surprises them.", "Sharon and Dennis marry on 29 August 2005, during their reception, Sam is arrested for digging up Den's body to incriminate Chrissie; however, Sam is charged with Den's murder.", "Her brothers, Phil and Grant, return weeks later to convince Sharon of Chrissie's guilt.", "Sharon and Grant resolve their past grievances and Sam is released after Johnny Allen (Billy Murray) records Chrissie confessing to Den's murder.", "Chrissie is caught attempting to flee the country and Sharon punches her before her arrest.", "On Christmas Day 2005, Sharon is stunned to discover she is pregnant, but her idyll is shattered within days when she is throttled by Johnny for interfering in his personal affairs.", "He warns Sharon that he will kill Dennis unless they leave Walford by midnight on New Year's Eve.", "Sharon persuades Dennis to leave after confiding in Phil.", "When Phil tells Dennis about the threat, Dennis attacks Johnny.", "Although battered, Johnny contacts his henchman Danny Moon (Jake Maskall), who stabs Dennis and he dies in Sharon's arms seconds into the New Year.", "Heartbroken, Sharon breaks down and refuses to speak, apart from asking Phil to avenge Dennis's murder." ], [ "Johnny Allen (EastEnders)", "Johnny Allen (EastEnders)\n\nJohnny Allen is a fictional character from the BBC soap opera \"EastEnders\", played by Billy Murray.", "Johnny appears on the show from 4 January 2005 until 20 October 2006, when he suffers a fatal heart attack while serving his prison sentence.", "Johnny is one of the show's biggest villains, terrorising several other characters and going to extreme lengths to gain the upper hand over his rivals.", "An old East End gangster, Johnny is responsible for the deaths of Andy Hunter (Michael Higgs) and Dennis Rickman (Nigel Harman) and is also central to the \"Get Johnny Week\" storyline that concludes in his eventual departure from the show.", "Johnny makes his first appearance to support Jake Moon (Joel Beckett) and Danny Moon (Jake Maskall) from the devious crime boss Andy Hunter (Michael Higgs), who they have a feud with.", "Johnny soon begins appearing more often to sort out the Moon brothers' problems.", "After a while, he buys the nightclub \"Angie's Den\" (renaming it \"Scarlet\", after his deceased daughter) and the Ferreira family's flat, and moves in with his remaining daughter, Ruby Allen (Louisa Lytton)." ], [ "Dennis Rickman", "Dennis remains friends with Dalton's second-in-command, Andy Hunter (Michael Higgs), and is left the bookmakers in Andy's will after his death at the hands of Johnny Allen (Billy Murray).", "Dennis has a passionate fling with Den's adopted daughter Sharon Watts (Letitia Dean) on the eve of Den's return but finds himself rejected when Den replaces him.", "They resume their affair in secret but Den cannot accept a relationship between his children and plots to split them up.", "Den taunts Dennis with the insinuation that someone had sexually abused him while he was in a children's home, successfully provoking Dennis into accidentally hitting Sharon.", "A guilt-ridden Den later apologises and explains his reasons for not wanting his son and daughter together, because he wants both of them in his life and he cannot have that if they are sleeping together.", "Den then tries to explain to Dennis that his feelings for Sharon are simply misguided due to the abuse he suffered as a child, which leaves Dennis confused", "and he decides to break up with Sharon in order to have a father-son relationship.", "Despite Sharon's heartache, the Watts reform their strong bond, including the introduction of Den's new wife Chrissie Watts (Tracy-Ann Oberman)." ] ], "gold": "In the British soap opera \"Eastenders\" the character Dennis Rickman was killed by Danny Moon, played by Jake Maskall. The square's reigning crime lord Johnny Allen, played by Billy Murray, arranged for Dennis Rickman to be stabbed on New Year's Eve 2005 after threatening his adoptive sister.", "prediction 1": "Dennis Rickman was killed in the first episode of EastEnders on January 4, 2005. He was killed by Johnny Allen, an old East End gangster, who is also responsible for the deaths of Andy Hunter and Dennis Rickman. The murder was committed by Danny Moon, played by Jake Maskall.", "prediction 2": "Dennis Rickman was murdered in EastEnders in 2005 by Johnny Allen, played by Billy Murray. Dennis was killed by Danny Moon, played by Jake Maskall, after he stabbed his friend Sharon Watts during a dispute over who would be the best to kill him.", "prediction 3": "Dennis Rickman was killed in Eastenders in 2005 by actor Johnny Allen, played by Billy Murray. In the TV show EastEnders, Dennis's murder is portrayed by Sam Haines. In the movie EastEnders: The Last Man On Earth, Danny Moon plays Dennis's henchman.", "prediction 4": "Dennis Rickman was killed in Eastenders in 2005 by Johnny Allen, played by Billy Murray. While in prison, Allen's henchman, Danny Moon, stabs Dennis, leaving him with a bloody knife and wounds.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 26, "end": 80 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 98, "end": 111 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 191 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the British soap opera \"Eastenders\" the character Dennis Rickman was stabbed and killed by Danny Moon, played by Jake Maskall. Johnny Allen, played by Billy Murray, arranged for Dennis Rickman to be stabbed on New Year's Eve 2005 after threatening Sharon." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who was the first black superhero in dc?", "passages": [ [ "Portrayal of black people in comics", "There would be no black hero starring in his or her own mainstream comic title until 1972, with Marvel's \"Luke Cage, Hero for Hire\", followed in 1973 by Marvel's Black Panther title in \"Jungle Action\".", "Marvel's Black Goliath was also introduced in the 1970s, as was Marvel's first major African female character, the superhero Storm of the X-Men.", "Following Black Racer, DC in \"Green Lantern\" #87 (Jan. 1972) introduced John Stewart, an architect who becomes Hal Jordan's new backup Green Lantern.", "By resisting a suggestion to name the character Lincoln Washington (a stereotypical slave name), artist Neal Adams struck a blow for diversity at DC.", "DC Comics' first black superhero to star in his own series was Black Lightning.", "He debuted in his self-titled series in April 1977.", "He was Jefferson Pierce, an Olympic athlete turned inner-city school teacher.", "Created by Tony Isabella and artist Trevor Von Eeden, he toted a voltage-generating belt and a white mask.", "Three years later, DC would introduce Victor Stone, the superhero Cyborg, best known as a member of the Teen Titans.", "Created by writer Marv Wolfman and artist George P\u00e9rez, he first appeared in \"DC Comics Presents\" #26 (Oct. 1980)." ] ], "gold": "The first Black superhero in DC was John Stewart, an architect who became Hal Jordan's new backup Green Lantern in 1972. The first DC superhero to start in his own series was Black Lightning in April 1977. Black Lightning was Jefferson Pierce, an Olympic athlete turned inner-city school teacher.", "prediction 1": "DC Comics first black superhero to star in his own series was Black Lightning, who debuted in his self-titled series in April 1977. He was Jefferson Pierce, an Olympic athlete turned inner-city school teacher. Three years later, DC Comics would introduce Victor Stone, the superhero Cyborg, best known as a member of the Teen Titans.", "prediction 2": "Black Lightning was the first black superhero in DC Comics to feature in his own series. He debuted in his self-titled series in April 1977. A year later, DC Comics would introduce Victor Stone, the superhero Cyborg. Created by Marv Wolfman and artist George P\u00e9rez, he first appeared in \"DC Comics Presents\" #26 (Oct 1980).", "prediction 3": "DC Comics' first black superhero to star in his own series was Black Lightning. Black Lightning debuted in his self-titled series in April 1977. Three years later, DC would introduce Victor Stone, the superhero Cyborg, best known as a member of the Teen Titans.", "prediction 4": "The first black superhero to appear in DC Comics was Black Lightning. He debuted in his self-titled series in April 1977. Three years later, DC would introduce Victor Stone, the superhero Cyborg.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 333 } ], "missing-info": [], "corrected-prediction": "DC Comics first black superhero to star in his own series was Black Lightning, who debuted in his self-titled series in April 1977. He was Jefferson Pierce, an Olympic athlete turned inner-city school teacher. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When does the state fair of tx end?", "passages": [ [ "State Fair of Texas", "State Fair of Texas\n\nThe State Fair of Texas is an annual state fair held in Dallas at historic Fair Park.", "The fair has taken place every year since 1886 except for varying periods during World War I and World War II.", "It usually begins the last Friday in September and ends 24 days later.", "While an annual attendance of over 2 million, it is consistently recognized as one of the most highly attended and best state fairs in America as well as Dallas's signature event.", "The State Fair of Texas opening day ceremonies are highlighted by the annual Friday parade rolling through downtown Dallas.", "Traditionally, the centerpiece of the fair has been the annual college football game between Oklahoma and Texas, nicknamed the Red River Rivalry (historically known as both the \"OU-Texas Game\" or \"Texas-OU Game\") and played in the Cotton Bowl at Fair Park.", "Also, the State Fair Classic, featuring Grambling State University and Prairie View A&M University, is played at the Cotton Bowl during the fair.", "In 2010, Baylor and Texas Tech played their game during the fair for the first time.", "During the opening weekend of the 2013 fair, Army and Louisiana Tech played in the only Heart of Dallas Classic at the Cotton Bowl; it was abandoned thereafter.", "The new Texas State Fair Football Showdown is scheduled to take place on the third weekend of the 2018 and 2019 fair and will feature Southern and Texas Southern." ], [ "South Texas State Fair", "South Texas State Fair\n\nThe South Texas State Fair is an annual regional state fair held in Beaumont, Texas.", "The fair features a livestock show, a commercial exhibition, and a carnival Midway.", "Food concessions are a major attraction of the fair.", "Reflecting Beaumont's location in Southeast Texas, normal carnival foods can be found alongside barbecue, Tex-Mex, and Cajun foods (often including fried alligator).", ", the South Texas State Fair had an attendance of over 500,000 people, second in the state to the State Fair of Texas in Dallas.", "The fair is held annually in late March to early April.", "The South Texas State Fair traces its roots to the first confirmable fair in Beaumont, held in 1907.", "With the exception of cancellations in 2005 and 2008 because of Hurricane Rita and Hurricane Ike respectively, the fair has continued every year since.", "It was first known as the Beaumont Fair, then the Southeast Texas State Fair, and in 1921 just the South Texas State Fair.", "In 1942, operation of the fair was transferred to the YMBL (Young Men's Business League), a local non-profit civic improvement organization.", "While other state fairs, including the larger State Fair of Texas, were closed for the duration of World War II, the South Texas State Fair continued as the \"YMBL Victory Fair\"." ] ], "gold": "The state fair of TX usually begins the last Friday in September and ends 24 days later. The fair has taken place every year since 1886 except for varying periods during World War I and World War II as well as 2020, due to the COVID-19 pandemic. 18 October 2020 would have been the date the fair ended, had the pandemic not caused the first cancellation in 76 years.", "prediction 1": "The State Fair of Texas is held every year since 1886 except for varying periods during World War I and World War II. It usually begins the last Friday in September and ends 24 days later. The South Texas State Fair is held in Beaumont, Texas. The fair features a livestock show, a commercial exhibition, and a carnival Midway.", "prediction 2": "The State Fair of Texas, an annual state fair held in Dallas, Texas, usually begins the last Friday in September and ends 24 days later. The South Texas State Fair, an annual regional state fair held in Beaumont, Texas, features a livestock show, a commercial exhibition, and a carnival Midway. The fair has taken place every year since 1907, with the exception of cancellations in 2005 and 2008 because of Hurricane Rita and Hurricane Ike respectively.", "prediction 3": "The State Fair of Texas is an annual state fair held in Dallas at historic Fair Park. It usually begins the last Friday in September and ends 24 days later.", "prediction 4": "The State Fair of Texas is an annual state fair held in Dallas at historic Fair Park. The fair has taken place every year since 1886 except for varying periods during World War I and World War II. It usually begins the last Friday in September and ends 24 days later. The South Texas State Fair is an annual regional state fair held in Beaumont, Texas. The fair features a livestock show, a commercial exhibition, and a carnival Midway.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 243 }, { "error type": "Irrelevant", "explanation": "", "start": 244, "end": 327 } ], "missing-info": [], "corrected-prediction": "The State Fair of Texas is held every year since 1886 except for varying periods during World War I and World War II. It usually begins the last Friday in September and ends 24 days later. " }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "What year did assassins creed black flag come out?", "passages": [ [ "Assassin's Creed IV: Black Flag", "In early February 2013, during its quarterly financial call to investors, Ubisoft CEO Yves Guillemot confirmed that the next \"Assassin's Creed\" game, due for release some time before April 2014, would feature a new hero, time period, and development team.", "On February 28, 2013, Ubisoft posted their first promotional picture and cover for their next \"Assassin's Creed\" game, following leaked marketing material days before.", "It announced the title of the game as \"Assassin's Creed IV: Black Flag\" and featured an unnamed character holding a flintlock and a sword with a black flag in the back ground containing the Assassin's symbol with a skull.", "A reported glitch on the official \"Assassin's Creed IV\" website suggested the game will release on next-gen consoles and October 29 as the release date, which was confirmed by the first trailer for the game, released on March 4, 2013 (originally leaked on March 2, 2013, but was quickly pulled by Ubisoft).", "\"Assassin's Creed IV: Black Flag\" was announced with a cinematic trailer on March 4, 2013." ], [ "Assassin's Creed IV: Black Flag", "Assassin's Creed IV: Black Flag\n\nAssassin's Creed IV: Black Flag is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft.", "It is the sixth major installment in the \"Assassin's Creed\" series.", "Its historical timeframe precedes that of \"Assassin's Creed III\" (2012), though its modern-day sequences succeed \"III\"s own.", "\"Black Flag\" was first released for PlayStation 3, Xbox 360, and Wii U in October 2013 and a month later for PlayStation 4, Xbox One, and Microsoft Windows.", "The plot is set in a fictional history of real world events and follows the centuries-old struggle between the Assassins, who fight for peace with free will, and the Templars, who desire peace through control.", "The framing story is set in the 21st century and describes the player as an Abstergo agent.", "The main story is set in the 18th century Caribbean during the Golden Age of Piracy, and follows notorious Welsh pirate Edward Kenway, grandfather and father of \"Assassin's Creed III\" protagonist and antagonist Haytham Kenway, respectively, who stumbles upon the Assassin/Templar conflict.", "The attempted establishment of a Republic of Pirates utopia (free from either British or Spanish rule) is a significant plot element." ], [ "Assassin's Creed IV: Black Flag", "In addition, each system will have their own intricacies and feature sets, with support for the different controllers and utilizing features specific to each console.", "The PC version supports Nvidia's TXAA.", "\"Assassin's Creed IV: Black Flag (Original Game Soundtrack)\" was composed by American composer Brian Tyler, who also composed the soundtrack of the previous Ubisoft title \"Far Cry 3\".", "Additional compositions and arrangements were provided by Sarah Schachner, Omar Fadel, Steve Davis, Mike Kramer, Jeremy Lamb, Matthew Llewellyn, and Robert Lydecker.", "The soundtrack was released on Amazon MP3 and iTunes on October 14, 2013.", "Two other soundtracks have also been released:\n\n\nThe score to the \"Freedom Cry\" DLC was composed by French composer Olivier Deriviere.", "It was recorded at Avatar Studios in New York with La Troupe Makandal, a dedicated group for Haitian music, and at Galaxy Studios in Belgium with the Brussels Philharmonic.", "\"Assassin's Creed IV: Black Flag\" was released worldwide for PlayStation 3 and Xbox 360 on October 29, 2013, while the Wii U was released on October 29, 2013 in North America, November 21, 2013 in Australia, November 22, 2013 in Europe and November 28, 2013 in Japan.", "The Wii U version in Europe was delayed from its original November 1, 2013 release date." ] ], "gold": "Assassin's Creed IV: Black Flag first came out on several dates. The video game originally came out in 2013, when it was released for the PlayStation 3 and Xbox 360 on October 29, 2013. The game came out for Nintendo Switch in 2019 as part of Assassin's Creed: The Rebel Collection.", "prediction 1": "Assassin's Creed IV: Black Flag is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the sixth major installment in the Assassin's Creed series. The game was released worldwide on October 29, 2013, for PlayStation 3 and Xbox 360, while the Wii U was released on October 29, 2013 in North America, November 21, 2013 in Australia, November 22, 2013 in Europe and November 28, 2013 in Japan.\n", "prediction 2": "Assassin's Creed IV: Black Flag is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. Initially released for the PlayStation 4 on October 15, 2013, the Wii U followed a month later on October 29, 2013. The Wii U version of Black Flag was released worldwide on October 29, 2013.", "prediction 3": "Assassin's Creed IV: Black Flag is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It's the sixth major installment in the Assassin's Creed series. Black Flag came out on PlayStation 4 and Xbox One in March 2014, Xbox One in October 2013 and Microsoft Windows on November 28, 2013. Among the many ports of the game included versions for both the Xbox One and Wii U that came out in 2013.", "prediction 4": "Assassin's Creed IV: Black Flag is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft that is the sixth major installment in the Assassin's Creed series. It is the sixth major installment in the Assassin's Creed series. It was first released on PlayStation 3 and Xbox 360 on October 29, 2013, while the Wii U was released on October 29, 2013 in North America, November 21, 2013 in Australia, November 22, 2013 in Europe and November 28, 2013 in Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 187 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Assassin's Creed IV: Black Flag was released worldwide on October 29, 2013, for PlayStation 3 and Xbox 360, and a month later for PlayStation 4, Xbox One, and Microsoft Windows, while the Wii U was released on October 29, 2013 in North America, November 21, 2013 in Australia, November 22, 2013 in Europe and November 28, 2013 in Japan.\n" }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Where is the ozone layer located in the atmosphere?", "passages": [ [ "Ozone layer", "Ozone layer\n\nThe Ozone layer or ozone shield is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation.", "It contains high concentrations of ozone (O) in relation to other parts of the atmosphere, although still small in relation to other gases in the stratosphere.", "The ozone layer contains less than 10 parts per million of ozone, while the average ozone concentration in Earth's atmosphere as a whole is about 0.3 parts per million.", "The ozone layer is mainly found in the lower portion of the stratosphere, from approximately above Earth, although its thickness varies seasonally and geographically.", "The ozone layer was discovered in 1913 by the French physicists Charles Fabry and Henri Buisson.", "Measurements of the sun showed that the radiation sent out from its surface and reaching the ground on Earth is usually consistent with the spectrum of a black body with a temperature in the range of 5,500\u20136,000 K (5,227 to 5,727\u00a0\u00b0C), except that there was no radiation below a wavelength of about 310\u00a0nm at the ultraviolet end of the spectrum.", "It was deduced that the missing radiation was being absorbed by something in the atmosphere.", "Eventually the spectrum of the missing radiation was matched to only one known chemical, ozone." ] ], "gold": "The ozone layer is a region of Earth's stratosphere, located 20 to 30 kilometers above the earth. It absorbs most of the Sun's ultraviolet radiation. ", "prediction 1": "The ozone layer is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation. It contains high concentrations of ozone in relation to other parts of the atmosphere, although still small in relation to other gases in the stratosphere. The ozone layer is mainly found in the lower portion of the stratosphere, from approximately above Earth, although its thickness varies seasonally and geographically.", "prediction 2": "The ozone layer or ozone shield is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation. It contains high concentrations of ozone in relation to other parts of the atmosphere, although still small in relation to other gases in the stratosphere. The ozone layer is mainly found in the lower portion of the stratosphere, from approximately above Earth, although its thickness varies seasonally and geographically.", "prediction 3": "The ozone layer is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation. It is located in the lower portion of the stratosphere, from approximately above Earth.", "prediction 4": "The ozone layer or ozone shield is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation. The ozone layer is mainly found in the lower portion of the stratosphere, from approximately above Earth, although its thickness varies seasonally and geographically.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 261 } ], "missing-info": [], "corrected-prediction": "The ozone layer is a region of Earth's stratosphere that absorbs most of the Sun's ultraviolet radiation. The ozone layer is mainly found in the lower portion of the stratosphere, from approximately above Earth, although its thickness varies seasonally and geographically." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who was president when the iraq war started?", "passages": [ [ "2003 invasion of Iraq", "Tommy Franks, who commanded the invasion of Iraq, has since admitted that the bombing was designed to \"degrade\" Iraqi air defences in the same way as the air attacks that began the 1991 Gulf War.", "These \"spikes of activity\" were, in the words of then British Defence Secretary, Geoff Hoon, designed to 'put pressure on the Iraqi regime' or, as \"The Times\" reported, to \"provoke Saddam Hussein into giving the allies an excuse for war\".", "In this respect, as provocations designed to start a war, leaked British Foreign Office legal advice concluded that such attacks were illegal under international law.", "Another attempt at provoking the war was mentioned in a leaked memo from a meeting between George W. Bush and Tony Blair on 31 January 2003 at which Bush allegedly told Blair that \"The US was thinking of flying U2 reconnaissance aircraft with fighter cover over Iraq, painted in UN colours.", "If Saddam fired on them, he would be in breach.\"", "On 17 March 2003, U.S. President George W. Bush gave Saddam Hussein 48 hours to leave the country, along with his sons Uday and Qusay, or face war." ], [ "National Desert Storm and Desert Shield War Memorial Act", "U.S. President George H. W. Bush deployed U.S. forces into Saudi Arabia, and urged other countries to send their own forces to the scene.", "An array of nations joined the Coalition, the biggest coalition since World War II.", "The great majority of the Coalition's military forces were from the U.S., with Saudi Arabia, the United Kingdom and Egypt as leading contributors, in that order.", "Saudi Arabia paid around US$36 billion of the US$60 billion cost.", "Operation Desert Shield was the codename for a \"wholly defensive\" United States mission to prevent Iraq from invading Saudi Arabia.", "Operation Desert Shield began on 7 August 1990 when U.S. troops were sent to Saudi Arabia due also to the request of its monarch, King Fahd, who had earlier called for U.S. military assistance.", "This \"wholly defensive\" doctrine was quickly abandoned when, on 8 August, Iraq declared Kuwait to be Iraq's 19th province and Saddam named his cousin, Ali Hassan Al-Majid, as its military-governor.", "Approximately 500,000 Americans served in operations Desert Storm and Desert Shield.", "There were 382 American fatalities.", "\"This summary is based largely on the summary provided by the Congressional Research Service, a public domain source.\"" ] ], "gold": "George H W Bush was President during the First Iraq War. The operation began on 7 August 1990, after Bush quickly announced that the US would launch a wholly defensive mission to prevent Iraq from invading Saudi Arabia. Then, On 17 March 2003, U.S. President George W Bush gave Saddam Hussein 48 hours to leave the country, along with his sons Uday and Qusay, or face war. ", "prediction 1": "The Iraq war began on 7 August 1990, when U.S. troops were sent to Saudi Arabia due also to the request of its monarch, King Fahd, who had earlier called for U.S. military assistance. The codename for Operation Desert Shield was a \"wholly defensive\" United States mission to prevent Iraq from invading Saudi Arabia. George H. W. Bush was president at the time. George W. Bush was president at the time the Iraq war started on 17 March 2003, and the United States was president at the time.", "prediction 2": "In 2003, U.S. President George W. Bush gave Saddam Hussein 48 hours to leave the country, along with his sons Uday and Qusay, or face war. Then, on 17 March 2003, George H.W. Bush deployed U.S. forces into Saudi Arabia, and urged other countries to send their own forces to the scene. This was the codename for a \"wholly defensive\" United States mission to prevent Iraq from invading Saudi Arabia. This \"wholly defensive\" doctrine was quickly abandoned when, on 8 August, Iraq declared Kuwait its 19th province and Saddam named his cousin Ali Hassan Al-Majid, as its military-governor. The invasion of Iraq started on 7 August 1990 when U.S. troops were sent to Saudi Arabia due also to the request of its monarch, King Fahd. This \"wholly defensive\" United States troops were sent to", "prediction 3": "George H. W. Bush was the president of the United States when the Iraq War started in 2003. George W. Bush was the president of the United States when the Iraq war started in 2003.", "prediction 4": "The Iraq war began when George H. W. Bush was president and George W. Bush was vice president. Bush directed the invasion of Iraq in 2003.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 4, "end": 12 }, { "error type": "Irrelevant", "explanation": "", "start": 37, "end": 183 }, { "error type": "Incoherent", "explanation": "", "start": 445, "end": 476 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 415, "end": 422 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Operation Desert Shield, a \"wholly defensive\" United States mission to prevent Iraq from invading Saudi Arabia, began on 7 August 1990. The codename for Operation Desert Shield was a \"wholly defensive\" United States mission to prevent Iraq from invading Saudi Arabia. George H. W. Bush was president at the time. George W. Bush was president at the time, on 17 March 2003, when he gave Saddam Hussein 48 hours to leave the country, along with his sons Uday and Qusay, or face war." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "When did the republicans gain control of the house?", "passages": [ [ "2010 United States House of Representatives elections", "2010 United States House of Representatives elections\n\nThe 2010 United States House of Representatives elections were held November 2, 2010, as part of the 2010 midterm elections along with Senate elections, at the midpoint of President Barack Obama's first term in office.", "Voters of the 50 U.S. states chose 435 U.S. Representatives.", "Voters of the U.S. territories, commonwealths, and the District of Columbia chose their non-voting delegates.", "Republicans regained control of the chamber they had lost in the 2006 midterm elections, picking up a net total of 63 seats and erasing the gains Democrats made in 2006 and 2008.", "Although the sitting U.S. President's party usually loses seats in a midterm election, the 2010 election resulted in the highest loss of a party in a House midterm election since 1938, and the largest House swing since 1948.", "This also happened to be the Republicans' largest gain in House seats since 1938.", "Republicans gained the most in the State of New York where they picked up six seats, defeating five incumbents and winning an open Democratic district.", "The heavy Democratic Party losses were attributed to anger with President Obama, opposition to the Affordable Care Act, large budget deficits and the weak economy." ], [ "2006 United States elections", "2006 United States elections\n\nThe 2006 United States elections were held on Tuesday, November 7, 2006 in the middle of Republican President George W. Bush's second term.", "All United States House of Representatives seats and one third of the United States Senate seats were contested in this election, as well as 36 state and two territorial governorships, many state legislatures, four territorial legislatures and many state and local races.", "The election resulted in a sweeping victory for the Democratic Party which captured control of the House of Representatives, the Senate, and won a majority of governorships and state legislatures from the Republican Party.", "It was also the first election in U.S. history in which the results were so lopsided that the victorious party did not lose a single incumbent or open seat in Congress or governor's mansion.", "Reasons for the Democratic Party takeover include the decline of the public image of George W. Bush, the dissatisfaction of his administration's handling of both Hurricane Katrina and the War in Iraq, the beginning of the collapse of the United States housing bubble, Bush's legislative defeat regarding Social Security Privatization, and a series of scandals in 2006 involving Republican politicians.", "In March 2003, President George W. Bush ordered an invasion of Iraq, a state which the Bush administration claimed was linked to the September 11 attacks in 2001, and claimed was producing weapons of mass destruction." ], [ "History of the United States Republican Party", "As Haynes Johnson, one of his harshest critics admitted, \"his greatest service was in restoring the respect of Americans for themselves and their own government after the traumas of Vietnam and Watergate, the frustration of the Iran hostage crisis and a succession of seemingly failed presidencies\".", "After the election of Democratic President Bill Clinton in 1992, the Republican Party, led by House Republican Minority Whip Newt Gingrich campaigning on a \"Contract with America\", were elected to majorities to both Houses of Congress in the Republican Revolution of 1994.", "It was the first time since 1952 that the Republicans secured control of both houses of U.S. Congress, which with the exception of the Senate during 2001\u20132002 was retained through 2006.", "This capture and subsequent holding of Congress represented a major legislative turnaround, as Democrats controlled both houses of Congress for the forty years preceding 1995, with the exception of the 1981\u20131987 Congress in which Republicans controlled the Senate.", "In 1994, Republican Congressional candidates ran on a platform of major reforms of government with measures such as a balanced budget amendment and welfare reform.", "These measures and others formed the famous Contract with America, which represented the first effort to have a party platform in an off-year election.", "The Contract promised to bring all points up for a vote for the first time in history." ] ], "gold": "Since 1861 the Republicans had controlled the House until elections to the United States House of Representatives were held in 1874 and 1875, which led to the largest House loss in the history of the Republican Party. In more recent history, the 1994 United States elections have been described as the Republican Revolution because the Republican Party captured unified control of Congress for the first time since 1952. Again, Republicans regained control of the chamber they had lost in the 2006 midterm elections, during the 2010 United States House of Representatives elections.", "prediction 1": "The House of Representatives in the United States was first controlled by the Republican Party in 1952, but it was again controlled by the Republican Party in 2010. The 2006 United States elections were held on November 7, 2006, in the middle of Republican President George W. Bush's second term. The 2004-2006 congressional elections were held on November 2, 2004. The 2010 United States House of Representatives elections were held November 2, 2010, as part of the 2010 midterm elections along with Senate elections, at the midpoint of President Barack Obama's first term in office.", "prediction 2": "The House of Representatives in the United States is composed of two houses: the House of Representatives and the Senate. For the first time since 1952, the Republicans have held control of both houses of Congress. They gained majority in the House during the Republican Revolution of 1994 and then again in the 2006 midterm elections.", "prediction 3": "The House of Representatives in the United States was controlled by the Republican Party for the first time since 1952, when they gained control of both houses of Congress. In the 1994 Republican Revolution, the Republican Party, led by House Republican Minority Whip Newt Gingrich campaigning on a \"Contract with America\", were elected to majorities to both Houses of Congress.", "prediction 4": "The House of Representatives was controlled by the Republican Party for the first time since 1952 in an election that was held on November 3, 1952. It was controlled by the Republicans again in the 2006 midterm elections, when they picked up 63 seats, retaking control of the chamber they had lost. The 2004 midterm elections were held on November 5, 2004 and November 6, 2004, respectively. The 2006 midterm elections were held on November 7, 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 584 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The House of Representatives in the United States was first controlled by the Republican Party in 1952, and for the first time since then the Republicans secured control of both houses of U.S. Congress in 1994. In the 2010 United States House of Representatives elections Republicans regained control of the chamber they had lost in the 2006 midterm elections." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What was the dean's name in animal house?", "passages": [ [ "Animal House", "He directs the clean-cut, smug Omega president Greg Marmalard to find a way for him to remove the Deltas from campus.", "Various incidents, including the prank-related accidental death of a horse belonging to Omega member and Reserve Officers' Training Corps (ROTC) cadet commander Douglas Neidermeyer, and an attempt by Otter to date Marmalard's girlfriend, further increase the Dean's and the Omegas' animosity toward the Deltas.", "Bluto and D-Day steal the answers to an upcoming test from the trash, not realizing that the Omegas have planted a fake set of answers for them to find.", "The Deltas fail the exam, and their grade-point averages fall so low that Wormer tells them he needs only one more incident to revoke their charter.", "To cheer themselves up, the Deltas organize a toga party and bring in Otis Day and the Knights to provide live music.", "Wormer's wife attends at Otter's invitation and has sex with him.", "Pinto hooks up with Clorette, a girl he met at the supermarket.", "They make out, but do not have sex because she passes out drunk.", "Pinto takes her home in a shopping cart and later discovers that she is the mayor's daughter." ], [ "Animal House", "His name would have added credibility to the project, but he turned the film down to do \"Foul Play\"; Landis, who wanted to cast unknown dramatic actors such as Bacon and Allen (the first film for both) instead of famous comedians, takes credit for subtly discouraging Chase by describing the film as an \"ensemble\".", "Landis has also stated that he was not interested in directing a \"Saturday Night Live\" movie and that unknowns would be the better choice.", "The character of D-Day was based on Aykroyd, who was a motorcycle aficionado.", "Aykroyd was offered the part, but he was already committed to \"Saturday Night Live\".", "Belushi, who had worked on \"The National Lampoon Radio Hour\" before \"Saturday Night Live\", was also committed to the show, but spent Monday through Wednesday making the film and then flying back to New York to do the show on Thursday through Saturday.", "Ramis originally wrote the role of Boon for himself, but Landis felt that he looked too old for the part and Riegert was cast instead.", "Landis did offer Ramis a smaller part, but he declined.", "Landis met with Jack Webb to play Dean Wormer and Kim Novak to play his wife.", "Webb ultimately backed out due to concerns over his clean-cut image, and was replaced by John Vernon." ] ], "gold": "John Vernon played the role of Dean Wormer in the movie Animal House.", "prediction 1": "Wormer was the Dean of the Omega Institute at Columbia University in the 1980s television series Animal House. Wormer directed the clean-cut, smug Omega president Greg Marmalard to find a way for him to remove the Deltas from campus. Wormer's name would have added credibility to the project, but he turned the film down to do \"Foul Play\". Landis wanted to cast unknown dramatic actors such as Bacon and Allen instead of famous comedians, taking credit for subtly discouraging Chase by describing the project as an ensemble.", "prediction 2": "Wormer is the Dean of the Omega Alpha Phi Omega Omega University and the character has a couple of roles in the Animal House film. Wormer was the character's name when he was in the film.", "prediction 3": "Wormer's name would have added credibility to the project, but he turned the film down to do \"Foul Play\".", "prediction 4": "Wormer was the Dean of Omega High School in Animal House. He was played by Jack Webb.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 20, "end": 65 }, { "error type": "Unverifiable", "explanation": "", "start": 73, "end": 96 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 233 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 234, "end": 247 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 339 }, { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 524 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Wormer was the name of the Dean of Animal House. John Vernon was the actor of Dean Wormer." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When was the last time washington won stanley cup?", "passages": [ [ "2018 Stanley Cup Finals", "2018 Stanley Cup Finals\n\nThe 2018 Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2017\u201318 season, and the culmination of the 2018 Stanley Cup playoffs.", "The Eastern Conference champion Washington Capitals defeated the Western Conference champion Vegas Golden Knights four games to one to win their first championship in their 44th season.", "The Vegas Golden Knights made the Finals in their first season, while this was the second Finals appearance for the Capitals.", "This was the first Finals series since 2007 where neither team had previously won the Stanley Cup and the third consecutive year in which a Western Conference team made their Finals debut.", "This was the first Finals since 2014 to require less than six games.", "Washington captain Alexander Ovechkin was awarded the Conn Smythe Trophy as the most valuable player of the playoffs.", "The series began on May 28 and ended on June 7.", "The Vegas Golden Knights had home ice advantage in the series since the Golden Knights won the Pacific Division with 109 points during the regular season, while the Capitals won the Metropolitan Division with 105 points.", "This was Washington's second Finals appearance; the Capitals were swept in four games by the Detroit Red Wings in 1998.", "The Capitals did not make many major offseason transactions with the exception of signing forward Devante Smith-Pelly." ] ], "gold": "The last time Washington won the Stanley Cup was on June 7 2018 at the 2018 Stanley Cup finals.", "prediction 1": "The Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2017\u201318 season, and the culmination of the 2018 Stanley Cup playoffs. The Eastern Conference champion Washington Capitals defeated the Western Conference champion Vegas Golden Knights four games to one to win their first championship in their 44th season. This was the last time Washington won the Stanley Cup.", "prediction 2": "The Stanley Cup Finals was the championship series of the National Hockey League's (NHL) 2017\u201318 season, and the culmination of the 2018 Stanley Cup playoffs. The Eastern Conference champion Washington Capitals defeated the Western Conference champion Vegas Golden Knights four games to one to win their first championship in their 44th season. This was the last time Washington won the Stanley Cup in 1998.", "prediction 3": "There were several Stanley Cup Finals. The last time Washington won the Stanley Cup was in 1998. During the 2018 Stanley Cup Finals, the Eastern Conference champion Washington Capitals defeated the Western Conference champion Vegas Golden Knights four games to one to win their first championship in their 44th season.", "prediction 4": "The Stanley Cup is an annual professional ice hockey championship, bestowed upon a single team. The last time Washington won the Stanley Cup was on January 23, 1998. The Capitals won the Stanley Cup on January 23, 1999. The last time Washington won the Stanley Cup was on January 23, 1999.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 23, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 344 }, { "error type": "Unverifiable", "explanation": "", "start": 345, "end": 399 } ], "missing-info": [], "corrected-prediction": "Washington Capitals won the 2018 Stanley Cup by defeating the Western Conference champion Vegas Golden Knights. " }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did hunger games catching fire come out?", "passages": [ [ "The Hunger Games: Catching Fire", "\"The Hunger Games: Catching Fire\" was released on November 15, 2013, in Brazil; November 20 in Finland, Sweden, and Norway; November 21 in the United Kingdom; and November 22 in IMAX, in the United States.", "The film set records for the biggest November opening weekend and biggest three- and five-day Thanksgiving box-office totals, surpassing the first film's box office grosses.", "It ranks as the 14th-highest-grossing film at the domestic box office and the highest-grossing film at the domestic box office of 2013, becoming the first 2-D film since \"The Dark Knight\" (2008) to top the yearly box office, as well as having a lead female top the box office since \"The Exorcist\" (1973).", "The film has grossed over $865 million worldwide and is the fifth-highest-grossing film of 2013 and the highest-grossing entry in \"The Hunger Games\" series.", "The film was followed by \"The Hunger Games: Mockingjay\", a two-part sequel and finale of the franchise: \"\" was released on November 21, 2014, in the United States, and \"\" on November 20, 2015." ], [ "The Hunger Games: Catching Fire", "The film was later released on November 22, 2013, in the United States in conventional and IMAX theaters.", "The film was also shown in the 4DX format in selected international territories.", "It features motion-enhanced seating, wind, water sprays, strobe lightning, and scent-based special effects.", "The film was released in 4,165 theaters in the US alone.", "The Blu-ray/DVD release date for the film in the US was March 7, 2014.", "The entire \"Hunger Games\" series was released on 4K UHD Blu-ray on November 8, 2016.", "Actresses Lynn Cohen and Stephanie Leigh Schlund, who played Mags and Cashmere in the film, respectively, promoted the DVD and Blu-ray versions of the film with an appearance at the March 7, 2014 midnight release of the product at the Walmart in Secaucus, New Jersey.", "As of March 16, 2014, Catching Fire has sold 2,073,719 DVDs along with 2,186,430 Blu-ray discs for $35,565,263 and $43,832,928, respectively, totaling $79,398,191 of revenue within two weeks of release.", "\"The Hunger Games: Catching Fire\" received generally positive reviews from critics." ] ], "gold": "Hunger Games: Catching Fire premiered in London on November 11, 2013, and in the US on November 22, 2013.", "prediction 1": "The Hunger Games: Catching Fire was released on November 15, 2013, in Brazil; November 20 in Finland, Sweden, and Norway; November 21 in the United Kingdom; and November 22 in IMAX, in the United States. The Blu-ray/DVD release date for the film in the US was March 7, 2014. The entire Hunger Games series was released on 4K UHD Blu-ray on November 8, 2016.", "prediction 2": "The Hunger Games: Catching Fire was released on November 15, 2013, in Brazil, November 20 in Finland, Sweden, and Norway, November 21 in the United Kingdom, and November 22 in IMAX, in the United States. The Blu-ray/DVD release date for the film in the US was March 7, 2014. The entire Hunger Games series was released on 4K UHD Blu-ray on November 8, 2016.", "prediction 3": "The Hunger Games: Catching Fire was released on November 15, 2013, in Brazil, November 20 in Finland, Sweden, and Norway, November 21 in the United Kingdom, and November 22, 2013 in IMAX, in the United States. The Blu-ray/DVD release date for the film in the US was March 7, 2014. The entire Hunger Games series was released on 4K UHD Blu-ray on November 8, 2016.", "prediction 4": "The Hunger Games: Catching Fire was released on November 15, 2013 in Brazil; November 20 in Finland, Sweden, and Norway; November 21 in the United Kingdom; and November 22 in IMAX, in the United States. The film was later released on November 22, 2013, in the United States in conventional and IMAX theaters. The Blu-ray/DVD release date for the film in the US was March 7, 2014. The entire Hunger Games series was released on 4K UHD Blu-ray on November 8, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 204, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 357 } ], "missing-info": [], "corrected-prediction": "The Hunger Games: Catching Fire was released on November 15, 2013, in Brazil; November 20 in Finland, Sweden, and Norway; November 21 in the United Kingdom; and November 22 in IMAX, in the United States. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first pokemon movie come out?", "passages": [ [ "Pok\u00e9mon: The First Movie", "Pok\u00e9mon:", "The First Movie\n\nPok\u00e9mon: The First Movie: Mewtwo Strikes Back, commonly referred to as Pok\u00e9mon: The First Movie, originally released as , is a 1998 Japanese anime film directed by Kunihiko Yuyama, the chief director of the \"Pok\u00e9mon\" television series.", "It is the first theatrical release in the \"Pok\u00e9mon\" franchise.", "It was first released in Japan on July 18, 1998.", "On July 8, 1999, a Complete Version (\u5b8c\u5168\u7248 \"kanzenban\") of the film was aired in Japanese television.", "In addition to an added prologue, the updated version included new animation and CGI graphics.", "The English-language adaptation, produced by Nintendo and 4Kids Entertainment and licensed by Warner Bros., was released in North America on November 10, 1999.", "The events of the film take place during the first season of .", "The film primarily consists of three segments: \"Pikachu's Vacation\", a 21-minute feature focusing on the series mascot Pikachu; \"Origin of Mewtwo\", the 10-minute prologue added to the \"Complete Version\" of the film; and \"Mewtwo Strikes Back\", the main 75-minute film feature.", "Overseas, the prologue can only be seen as a bonus short in DVD versions of \"\"." ], [ "Pok\u00e9mon: The First Movie", "Combined, the film's global box office and US home video earnings added up to .", "The film was included in the Blu-ray compilation titled \"Pikachu Movie Premium 1998-2010\" in Japan on November 28, 2012.", "On February 9, 2016, Viz Media released a limited edition Blu-ray Steelbook containing the first three \"Pok\u00e9mon\" films (\"Pok\u00e9mon: The First Movie\", \"\" and \"\"), along with single releases on DVD.", "In accommodation with the 20th anniversary of the \"Pok\u00e9mon\" franchise, a digitally remastered version of the film was released on iTunes, Amazon and Google Play on February 27, 2016.", "On October 2, 2018, the three-film Blu-ray set was re-released as a standard edition.", "Pok\u00e9mon:", "The First Movie Music From and Inspired by the Motion Picture is the soundtrack to the first \"Pok\u00e9mon\" film in the United States, It was released on November 10, 1999, on Compact Disc and Compact Cassette.", "\"Don't Say You Love Me\" by M2M was released as a single from the album." ] ], "gold": "The first Pokemon movie came out in Japan on July 18, 1998. November 10, 1999 is when the first Pokemon movie came to the United States.", "prediction 1": "Pok\u00e9mon: The First Movie: Mewtwo Strikes Back, commonly referred to as Pok\u00e9mon: The First Movie, originally released as, is a 1998 Japanese anime film directed by Kunihiko Yuyama, the chief director of the Pok\u00e9mon television series. It is the first theatrical release in the Pok\u00e9mon franchise. The English-language adaptation, produced by Nintendo and 4Kids Entertainment and licensed by Warner Bros., was released in North America on November 10, 1999.", "prediction 2": "Pok\u00e9mon: The First Movie, originally released as Pok\u00e9mon: The First Movie, is a 1998 Japanese anime film directed by Kunihiko Yuyama, the chief director of the Pok\u00e9mon television series. The English-language adaptation, produced by Nintendo and 4Kids Entertainment and licensed by Warner Bros., was released in North America on November 10, 1999. Pok\u00e9mon: The First Movie: Mewtwo Strikes Back, commonly referred to as Pok\u00e9mon: The First Movie, originally released as, is the first theatrical release in the Pok\u00e9mon franchise.", "prediction 3": "Pok\u00e9mon: The First Movie: Mewtwo Strikes Back, originally released as Pok\u00e9mon: The Movie, is a 1998 Japanese anime film directed by Kunihiko Yuyama, the chief director of the Pok\u00e9mon television series. The English-language adaptation, produced by Nintendo and 4Kids Entertainment and licensed by Warner Bros., was released in North America on November 10, 1999. Pok\u00e9mon: The First Movie: Pikachu's Vacation is a 21-minute feature focusing on the series mascot Pikachu; Origin of Mewtwo Strikes Back is the main 75-minute film feature. Pok\u00e9mon: The First Movie: Mewtwo Strikes Back is referred to as Pok\u00e9mon: The First Movie: The First Movie: The First Movie, originally released as Pok\u00e9mon: The First Movie: The First Movie: The First Movie: The First Movie: The First Movie: Mewtwo Strikes Back, commonly referred to", "prediction 4": "Pok\u00e9mon: The First Movie is a 1998 Japanese anime film directed by Kunihiko Yuyama, the chief director of the Pok\u00e9mon television series. The Japanese version came out on July 18, 1998. The English-language adaptation of the film, produced by Nintendo and 4Kids Entertainment and licensed by Warner Bros., was released in North America on November 10, 1999.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 9, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 293 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 401 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The first Pokemon movie came out in Japan on July 18, 1998. The English-language adaptation was released in North America on November 10, 1999." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has won the most mlb games in a row?", "passages": [ [ "2017 Cleveland Indians season", "2017 Cleveland Indians season\n\nThe 2017 Cleveland Indians season was the 117th season for the franchise.", "It was the fifth season under the leadership of manager Terry Francona and second under general manager Mike Chernoff.", "The team entered as the defending American League champion and World Series runner-up.", "The Indians played all of their home games at Progressive Field in Cleveland, Ohio.", "On September 13, the Cleveland Indians won their 21st game in a row, surpassing the 2002 Oakland Athletics for the longest winning streak in American League history and tying the 1880 Chicago White Stockings and the 1935 Chicago Cubs for the second longest winning streak in Major League Baseball history.", "Their win streak reached 22 games on September 14, giving the Indians the longest winning streak in Major League Baseball since the 1916 New York Giants who own the all-time record with 26 straight without a loss.", "On September 15, the 22-game win streak ended in a 4\u20133 loss to the Kansas City Royals.", "The Indians finished the season with a record of 102\u201360, the best record in the American League.", "They won their second straight American League Central title but were upset by the New York Yankees in five games in the American League Division Series.", "The Indians opened the season by sweeping the Texas Rangers in Arlington." ], [ "New York Yankees", "Prior to that point, the Giants had been the city's icon and dominant team.", "From 1923 onward, the Yankees assumed that role, and many years later the Giants left Coogan's Bluff for San Francisco.", "In the 1927 season, the Yankees featured a lineup that became known as \"Murderers' Row\", and some consider this team to be the best in the history of baseball (though similar claims have been made for other Yankee squads, notably those of 1939, 1961 and 1998).", "The Yankees won a then-AL record 110 games with only 44 losses, and swept the Pittsburgh Pirates in the World Series.", "Ruth's home run total of 60 in 1927 set a single-season home run record that stood until it was broken by Roger Maris in 1961.", "Meanwhile, first baseman Lou Gehrig had his first big season, batting .373 with 47 home runs and 175 RBIs, beating Ruth's single-season RBI mark (171 in 1921).", "The Yankees won the World Series again in 1928.", "In 1931, Joe McCarthy was hired as manager and brought the Yankees back to the top of the AL.", "They swept the Chicago Cubs in the 1932 World Series, and brought the team's streak of consecutive World Series game wins to 12." ] ], "gold": "There are different kinds of winning streaks in Major League Baseball. The New York Giants won the most MLB regular games in a row with 26. The New York Yankees won the most postseason MLB games with 12 consecutive wins.", "prediction 1": "The MLB team with the most consecutive wins in a row is the New York Yankees. Their 22-game winning streak began on September 13, 2017. The 2002 Oakland Athletics held the record for the most consecutive wins in a row, while the 1880 Chicago White Stockings and the 1935 Chicago Cubs held the record for the second longest consecutive win streak in Major League Baseball history.", "prediction 2": "The team that has won the most games in a row in Major League Baseball history is the New York Yankees. In the history of MLB, the New York Yankees have won the most games in a row in 1927, 1931, 1932, and 1939. The 2000 Oakland Athletics have the most winning streaks in American League history.", "prediction 3": "The New York Yankees have won the most games in a row in franchise history. In American League history, the New York Yankees have won the most games in a row in a single season. In the American League, the 2002 Oakland Athletics have won the most games in a single season.", "prediction 4": "The player who has won the most consecutive games in a row in MLB history is Babe Ruth. The 1916 New York Giants own the all-time record for the longest winning streak with 26 straight without a loss. The 1918 New York Yankees have won the most consecutive games in a row with 62 and the 1977 Yankees 13 and 63 games respectively.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 78, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 135 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 209, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 379 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 60, "end": 77 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 140, "end": 162 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "The MLB team with the most consecutive wins in a row is the New York Giants with 26 straight. The New York Yankees had a 12 consecutive World Series game wins streak." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was the first episode of charmed aired?", "passages": [ [ "Charmed", "In 2001, \"Charmed\" won a Cable Guide Award in the United Kingdom for \"Favorite Sci-Fi/Fantasy Series.\"", "The series also won a \"Certificate of Merit\" at the 2003 EDGE Awards for the season four episode \"Muse to My Ears.\"", "In 2004, Alyssa Milano was nominated for a Spacey Award in Canada for \"Favorite Female TV Character\" and in 2005, she was nominated for \"Favorite Television Actress\" at the Nickelodeon Kids' Choice Awards.", "That same year, Rose McGowan won the award for \"Favorite Sister\" at the Family Television Awards.", "\"Charmed\" also received recognition for its young guest actors, having been nominated for five Young Artist Awards, with Alex Black winning once for his role in the season four episode \"Lost and Bound.\"", "In the United States, \"Charmed\" premiered on The WB on October 7, 1998 and ended on May 21, 2006.", "The first season aired on Wednesday nights at 9:00 pm.", "For its second, third and fourth seasons, \"Charmed\" moved to Thursday nights.", "For the fifth season, the series moved to Sunday nights at 8:00 pm and remained there until its eighth and final season.", "By the end of season eight, \"Charmed\" had aired a total of 178 episodes and became the longest running hour-long television series featuring all female leads." ], [ "Charmed (2018 TV series)", "In October 2018, it was announced that Nick Hargrove was cast as Parker initially in a recurring capacity and later promoted to a series regular.", "\"Charmed\" is filmed in Vancouver, British Columbia.", "The pilot episode was filmed from March 19 to April 7, 2018.", "Filming for the remainder of the first season began on August 13, 2018.", "In the United States, \"Charmed\" premiered on The CW on October 14, 2018.", "It airs on Sunday nights at 9:00 pm, with \"Supergirl\" as its lead-in at 8:00 pm.", "The pairing of \"Charmed\" and \"Supergirl\" returned the network to original programming on Sunday evenings for the first time since the 2008\u201309 television season.", "The CW president Mark Pedowitz explained, \"We wanted to have an established show on Sunday night.", "We wanted name value with \"Charmed\" on there.", "We felt that it was two shows that are empowered women.", "We were making a statement that we were not kidding, that we're not phoning it in on Sunday night, that we were going to compete.\"", "In Canada, \"Charmed\" premiered on the W Network the same day as the US broadcast, while in Greece and Spain it premiered the following day on Cosmote Cinema 4HD and HBO Espa\u00f1a, respectively." ], [ "Charmed (2018 TV series)", "Charmed (2018 TV series)\n\nCharmed is an American fantasy drama television series developed by Jennie Snyder Urman, Jessica O'Toole, and Amy Rardin.", "It is a reboot of The WB series of the same name, created by Constance M. Burge, which originally aired from 1998 to 2006.", "\"Charmed\" was ordered to pilot in January 2018 by The CW and received a series order in May 2018.", "The series, which premiered in the United States on October 14, 2018, follows the lives of three sisters\u2014Macy (Madeleine Mantock), Mel (Melonie Diaz) and Maggie (Sarah Jeffery)\u2014who, after the death of their mother, discover they are The Charmed Ones, the most powerful witches, and together they possess the \"Power of Three\".", "Each sister has a magical power, which they use to help protect innocent lives from supernatural demons.", "On November 8, 2018, The CW ordered a 22-episode full season.", "Set in the fictional college town of Hilltowne, Michigan, the series begins with sisters Mel (Melonie Diaz) and Maggie Vera (Sarah Jeffery) living with their mother Marisol (Valerie Cruz), who shortly afterward is attacked and killed by an unknown demonic force." ] ], "gold": "In the United States, \"Charmed\" premiered on The WB on October 7, 1998 and ended on May 21, 2006. A reboot of the WB series of the same name premiered on October 14, 2018.", "prediction 1": "Charmed is an American fantasy drama television series developed by Jennie Snyder Urman, Jessica O'Toole, and Amy Rardin. It is a reboot of The WB series of the same name, created by Constance M. Burge, which originally aired from 1998 to 2006. The series premiered on The WB on October 7, 1998 and ended on May 21, 2006. The pilot episode was filmed from March 19 to April 7, 2018. The pilot episode of the 2018 series aired on October 14, 2018.", "prediction 2": "Charmed is an American fantasy drama television series developed by Jennie Snyder Urman, Jessica O'Toole, and Amy Rardin that follows the lives of three sisters, Mel, Maggie and Sarah, who, after the death of their mother, discover they are The Charmed Ones, the most powerful witches and together they possess the \"Power of Three\". The first episode of the series aired on October 7, 2018 in the United States. The pilot episode of the 2018 series aired on October 14, 2018.", "prediction 3": "Charmed is an American fantasy romantic drama television series developed by Jennie Snyder Urman, Jessica O'Toole, and Amy Rardin. The series is a reboot of The WB series of the same name, created by Constance M. Burge, which originally aired from 1998 to 2006. The first episode of the 2018 season aired on October 14, 2018, while the 2018 season premiered in the United States on October 14, 2018.", "prediction 4": "Charmed is an American fantasy drama television series developed by Jennie Snyder Urman, Jessica O'Toole, and Amy Rardin. The first episode of season one aired on February 15, 2010. The first episode of season two aired on March 14, 2017. The first episode of season three aired on April 15, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 382 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 244 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The series premiered on The WB on October 7, 1998 and ended on May 21, 2006. A reboot of the WB series of the same name premiered on October 14, 2018." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "How many goals does lewandowski have for bayern?", "passages": [ [ "Robert Lewandowski", "Robert Lewandowski\n\nRobert Lewandowski (; born 21 August 1988) is a Polish professional footballer who plays as a striker for Bayern Munich and is the captain of the Poland national team.", "After being the top scorer in the third and second tiers of Polish football with Znicz Pruszk\u00f3w, he moved to top-flight Lech Pozna\u0144, and was the top scorer in the league as they won the 2009\u201310 Ekstraklasa.", "In 2010, he transferred to Borussia Dortmund for a reported \u20ac4.5\u00a0million, where he won honours including two consecutive Bundesliga titles and a season as the league's top goalscorer.", "In 2013, he earned with Borussia a spot in the 2013 UEFA Champions League Final, a tournament in which he was the second top goalscorer, behind only Cristiano Ronaldo.", "Prior to the start of the 2014\u201315 season, Lewandowski agreed to join their rivals, Bayern Munich, on a free transfer.", "In Munich, he won the Bundesliga title in each of his first four campaigns, earning a spot in the Bundesliga Team of the Year in every season.", "In 2015\u201316 and 2017\u201318, he led the league in goalscoring, and in 2016\u201317 he was named the Bundesliga Player of The Year.", "He was named to the UEFA Champions League Squad of the Season two times." ], [ "Robert Lewandowski", "On 19 May, Lewandowski scored Bayern Munich's only goal in a 3\u20131 defeat in the DFB-Pokal Final against Eintracht Frankfurt.", "Lewandowski finished the season as the Bundesliga's top goalscorer with 29 goals.", "This was the third time Lewandowski won the Bundesliga's top goalscorer award.", "Lewandowski finished the season with 41 goals in 48 matches in all competitions.", "After a summer of transfer speculation, Bayern Munich CEO Karl-Heinz Rummenigge, confirmed in an interview on 1 August that Lewandowski would not be allowed to leave Bayern Munich at any price.", "Rummenigge said \"Our door remains closed, the top quality we have at Bayern Munich will stay here.", "With Robert, we clearly want to send a signal to people within and outside the club: Bayern Munich are completely different to other clubs who get weak when certain sums are mentioned\"\n\nOn 12 August, Lewandowski recorded the first ever hat-trick in the German Super Cup against Eintracht Frankfurt in the 2018 edition as Bayern Munich went on to win the title for the record seventh time.", "He also became the all-time top scorer in the German Super Cup history.", "On 27 November, Lewandowski became the third-fastest player to score 50 goals in the Champions League when he scored two goals in a 5\u20131 win over Benfica." ], [ "Robert Lewandowski", "On 11 January 2016, he achieved fourth place at the 2015 FIFA Ballon d'Or awards.", "On 19 March 2016, Lewandowski scored the only goal in a 1\u20130 win against K\u00f6ln to bring his league total up to 25 goals; a new personal best.", "He had scored 24 goals for Borussia Dortmund during the 2012\u201313 season.", "His goal against Atl\u00e9tico de Madrid on 3 May in the second leg of Bayern's Champions League semi-final exit saw him end the season's competition with nine goals.", "On 7 May 2016, Lewandowski scored both goals for Bayern in a 2\u20131 win at FC Ingolstadt to confirm the Bavarian club as champions of Germany for the fourth consecutive season.", "A week later, he scored his 30th goal of the season in Bayern's final league match of the season at home to Hannover 96.", "This made him the first foreign player to score 30 goals in the Bundesliga, the first player since Dieter M\u00fcller in 1976\u201377, and secured him the Torj\u00e4gerkanone for the second time in three seasons.", "He finished the season with 42 goals in 51 matches.", "The 2016\u201317 season started with Bayern winning the 2016 German Super Cup on 14 August 2016." ] ], "gold": "Robert Lewandowski, who was born 21 August 1988, is a Polish professional footballer who plays as a striker for Bundesliga club Bayern Munich and is the captain of the Poland national team. Recognized for his positioning, technique and finishing, Lewandowski is considered one of the best strikers of all time, as well as one of the most successful players in Bundesliga history and has scored over 500 senior career goals for club and country. In the 2014-15 season he scored 25 goals. In the 2015-16 season he scored 42 goals and in the 2016-17 season he scored 43 goals.", "prediction 1": "Robert Lewandowski is a Polish professional footballer who plays as a striker for Bayern Munich and is the captain of the Polish national team. Lewandowski scored 30 goals in the 2014-2015 season for Bayern Munich. In 2015-16, Lewandowski scored 29 goals. In 2017-18, Lewandowski scored 29 goals.", "prediction 2": "Robert Lewandowski is a Polish professional footballer who plays as a striker for Bayern Munich and is the captain of the Polish national team. Lewandowski has scored a total of 91 goals for Bayern Munich. In total, he has scored a total of 122 goals for Bayern Munich.", "prediction 3": "Lewandowski is a Polish professional footballer who plays as a striker for Bayern Munich. Lewandowski scored 41 goals in all competitions for Bayern Munich in the 2016-2017 season. The Polish international scored a total of 57 goals in all competitions for Bayern Munich during the 2016-2017 season.", "prediction 4": "Robert Lewandowski is a Polish professional footballer who plays as a striker for Bayern Munich and is the captain of the Poland national team. Lewandowski has scored 587 goals in 144 games for Bayern Munich. On 19 May, Lewandowski scored the only goal in a 3\u20131 defeat in the DFB-Pokal Final against Eintracht Frankfurt. Lewandowski finished the season as the Bundesliga's top goalscorer with 29 goals.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[8]}", "start": 246, "end": 248 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 287, "end": 289 }, { "error type": "Unverifiable", "explanation": "", "start": 144, "end": 214 } ], "missing-info": [], "corrected-prediction": "Robert Lewandowski is a Polish professional footballer who plays as a striker for Bayern Munich and is the captain of the Polish national team. Lewandowski scored 30 goals in the 2014-2015 season for Bayern Munich. In 2015-16, Lewandowski scored 42 goals. In 2017-18, Lewandowski scored 41 goals." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "What is the white part of your nail?", "passages": [ [ "Nail (anatomy)", "This makes the capillaries in the nail bed below visible, resulting in a pink color.", "The lunula (\"small moon\") is the visible part of the matrix, the whitish crescent-shaped base of the visible nail.", "The lunula can best be seen in the thumb and may not be visible in the little finger.", "The nail bed is the skin beneath the nail plate.", "Like all skin, it is made of two types of tissues: the deeper dermis, the living tissue which includes capillaries and glands, and the epidermis, the layer just beneath the nail plate, which moves toward the finger tip with the plate.", "The epidermis is attached to the dermis by tiny longitudinal \"grooves\" called matrix crests (\"cristae matricis unguis\").", "In old age, the nail plate becomes thinner, and these grooves become more visible.", "The nail sinus (\"sinus unguis\") is where the nail root is; i.e. the base of the nail underneath the skin.", "It originates from the actively growing tissue below, the matrix.", "The nail plate (\"corpus unguis\") is the hard part of the nail, made of translucent keratin protein.", "Several layers of dead, compacted cells cause the nail to be strong but flexible." ], [ "Manicure", "Similarly, the English word \"pedicure\" comes from the Latin words \"pes (Genitive case - pedis)\", for \"foot\", and \"cura\", for \"care\".", "Manicures began 5,000 years ago.", "In the United States, the nail care industry is dominated by Vietnamese-American proprietors and nail technicians.", "In 1975, while visiting with refugees in California, actress Tippi Hedren noticed the women were interested in her Hollywood fashion and makeup.", "Hedren directed her manicurist to instruct the women in nail care and help them find jobs.", "Jeff Pink, founder of the professional nail brand Orly, is credited with creating the natural nail look later called the French manicure in 1976.", "Nails that have undergone a French manicure are characterized by a lack of artificial base color and white tips at the free edge of the nail.", "For this reason, they are sometimes referred to as \"French tips\".", "The nail tips are painted white, while the rest of the nails are polished in a pink or a suitable nude shade.", "French manicures can be achieved with artificial nails.", "However, it is also as common to perform a French manicure on natural nails.", "Another technique is to whiten the underside of the nail with white pencil and paint a sheer color over the entire nail." ], [ "Nail (anatomy)", "Nail (anatomy)\n\n", "A nail is a horn-like envelope covering the tips of the fingers and toes in most primates and a few other mammals.", "Nails are similar to claws in other animals.", "Fingernails and toenails are made of a tough protective protein called alpha-keratin.", "This protein is also found in the hooves and horns of different animals.", "The nail consists of the nail plate, the nail matrix and the nail bed below it, and the grooves surrounding it.", "The matrix, sometimes called the \"matrix unguis\", keratogenous membrane, nail matrix, or onychostroma, is the tissue (or germinal matrix) which the nail protects.", "It is the part of the nail bed that is beneath the nail and contains nerves, lymph and blood vessels.", "The matrix produces cells that become the nail plate.", "The width and thickness of the nail plate is determined by the size, length, and thickness of the matrix, while the shape of the fingertip itself shows if the nail plate is flat, arched, or hooked.", "The matrix will continue to produce cells as long as it receives nutrition and remains in a healthy condition.", "As new nail plate cells are made, they push older nail plate cells forward; and in this way older cells become compressed, flat, and translucent." ], [ "Lunula (anatomy)", "Lunula (anatomy)\n\n", "The lunula, or lunulae (pl.) (), is the crescent-shaped whitish area of the bed of a fingernail or toenail.", "The lunula is the visible part of the root of the nail.", "In humans, it appears by week 14 of gestation, and has a primary structural role in defining the free edge of the distal nail plate (the part of the nail that grows outward).", "It is located at the end of the nail (that is closest to the skin of the finger), but it still lies under the nail.", "It is not actually white but only appears so when it is seen through the nail.", "Outlining the nail matrix, the lunula is a very delicate part of the nail structure.", "If one damages the lunula, the nail will be permanently deformed.", "Even when the totality of the nail is removed, the lunula remains in place and is similar in appearance to another smaller fingernail embedded in the nail bed.", "In most cases, it is half-moon-shaped and has unique histologic features.", "Examinations concluded that the lunula was an area of loose dermis with lesser developed collagen bundles.", "It appears whitish because a thickened underlying stratum basale obscures the underlying blood vessels." ] ], "gold": "A nail is a claw-like plate at the tip of the fingers or toes, and the lunula is the crescent-shaped whitish area of the bed of a fingernail or toenail. The lunula is located at the end of the nail that is closest to the skin of the finger; however, it still lies under the nail. The lunula is not actually white but only appears so when it is seen through the nail. Outlining the nail matrix, the lunula is a very delicate part of the nail structure. The lunula can best be seen in the thumb and may not be visible in the little finger.", "prediction 1": "The white part of your nail is the matrix, the whitish crescent-shaped base of the visible nail. The lunula is the visible part of the nail plate, the hard part of the nail, and the part of the nail that is underneath the nail. The tip of the nail is the white part of the nail and is painted white.\n", "prediction 2": "The white part of your nail is the matrix, which is the firm, whitish, crescent-shaped tissue beneath the nail that keeps it strong and flexible. The lower part of the nail is the nail bed, which is the skin underneath the nail. The lunula is the visible part of the root of the nail.", "prediction 3": "The white part of your nail is the matrix or hard part, which is the part of the nail that is beneath the nail and which acts as a protective layer over the skin. For example, when you polish a white nail, you leave the edge white because the pinkish pigment in it is absorbed through the nail plate. A French manicure is when the tips of the fingernails are painted white because these tips form part of the harder part of the nail and are used to smooth out any imperfections in the nail.", "prediction 4": "The white part of your nail is the surface of the nail. Typically, the case is that the nail plate is white and the lunula is a crescent-shaped white area that is found at the base of a fingernail, but is usually not visible in the little finger. In a French manicure, the white part is painted on the tip of the nail and the rest of the nail is polished in a pink or a suitable nude shade.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[3]}", "start": 131, "end": 146 }, { "error type": "Unverifiable", "explanation": "", "start": 147, "end": 173 }, { "error type": "Unverifiable", "explanation": "", "start": 174, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 300 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "A nail is a horn-like envelope covering the tips of the fingers and toes. The lunula is the visible part of the matrix, the whitish crescent-shaped base of the visible nail and the bed of a fingernail or toenail. The lunula is located at the end of the nail (that is closest to the skin of the finger), but it still lies under the nail. It is not actually white but only appears so when it is seen through the nail. Outlining the nail matrix, the lunula is a very delicate part of the nail structure.The lunula can best be seen in the thumb and may not be visible in the little finger.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Personal assistant to colonel white in captain scarlet?", "passages": [ [ "Lieutenant Green", "Lieutenant Green\n\nLieutenant Green is a fictional character in the 1960s British Supermarionation television series \"Captain Scarlet and the Mysterons\" and its 2000s computer-animated remake, \"Gerry Anderson's New Captain Scarlet\".", "In both series, Green serves as the personal assistant to Spectrum commander-in-chief Colonel White, and is shown to be an expert in computer programming and electronics.", "In the former, he is a native of Trinidad and Tobago, and as well as being the only non-white male officer on Cloudbase, he is the only lieutenant among its personnel.", "In the latter, the character is re-imagined as an African-American woman.", "The original Green is the only black male character to be given a substantial role in a Gerry Anderson supermarionation series.", "In the original TV series, Green (born Seymour Griffiths) spends most of his time in the Cloudbase control room.", "He assists Colonel White in the execution of Spectrum assignments by accessing data and radio links from a large supercomputer, which he operates from a moveable chair.", "At White's command, Green can activate the control room's display screen or speak on the base's public address system.", "Green rarely leaves Cloudbase, although he occasionally mentions how he would relish an opportunity to meet primary Mysteron agent Captain Black \"face-to-face\"." ], [ "Lieutenant Green", "Series creator Gerry Anderson responded to accusations of political incorrectness and racial stereotyping by pointing out that Lieutenant Green \u2013 and the other non-white regulars, Melody and Harmony Angels \u2013 are heroic characters of African and Asian backgrounds.", "Green's original voice actor, Cy Grant, considered \"Captain Scarlet\" to be of positive multicultural value and commented on its possible allegorical nature.", "With regard to dualism, he suggested that \"the 'darkness' of the Mysterons is most easily seen as the psychological rift\u2014the struggle of 'good' and 'evil' \u2014 of the Western world as personified by Colonel White and his team.", "Dark and light are but aspects of each other.", "Incidentally, green is the colour of nature that can heal that rift.\"", "He also discussed the notion of Green being an African trickster hero.", "The progressiveness of Green's characterisation has been well received.", "Mike Fillis of \"Cult Times\" praises the Andersons' decision to make a black character the \"second-in-command\" onboard Cloudbase.", "Kurt Barling, author of Grant's obituary for \"The Independent\", writes that Green was \"one of the first positive black fictional characters in children's television\".", "He praises the character's vocal delivery, arguing that Grant's \" tones\" provided Green with a \"serene and heroic quality\"." ] ], "gold": "Lieutenant Green is a fictional character, who served as the personal assistant to Spectrum commander-in-chief Colonel White in the movie Captain Scarlet. Cy Grant was the original voice of the personal assistant to Colonel White in Captain Scarlet. Jules de Jongh was the voice of the personal assistant to Colonel White in new Captain Scarlet.", "prediction 1": "Lieutenant Green is a fictional character in the 1960s British Supermarionation television series \"Captain Scarlet and the Mysterons\" and its 2000s computer-animated remake, Gerry Anderson's New Captain Scarlet.\" In both series, Green serves as the personal assistant to Spectrum commander-in-chief Colonel White, and is shown to be an expert in computer programming and electronics. In the former, he is a native of Trinidad and Tobago, and as well as being the only non-white male officer on Cloudbase, he is the only lieutenant among its personnel. In the latter, the character is re-imagined as an African-American woman. In the former Green, the character is re-imagined as an African-American woman. In the 2000s computer-animated remake, Green is voiced by Cy Grant.", "prediction 2": "Captain Scarlet was a British supermarionation television series that ran from 1960 to 1969. Its 1960s television adaptation ran from 1969 to 1970. The 2000 computer-animated remake ran from 2000 to 2021. In the original TV series, Lieutenant Green served as the personal assistant to Spectrum commander-in-chief Colonel White, and was shown to be an expert in computer programming and electronics.", "prediction 3": "Captain Scarlet is a British supermarionation television series that first aired in 1960. In the 1960s and 1990s versions, Lieutenant Green served as the personal assistant to Spectrum commander-in-chief Colonel White. In the 2000s version, Lieutenant Green was voiced by Gerry Anderson.", "prediction 4": "Captain Scarlet is a 1960s British supermarionation television series and its 2000s computer-animated remake. In both series, Lieutenant Green serves as the personal assistant to Spectrum commander-in-chief Colonel White, and is shown to be an expert in computer programming and electronics.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 228 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 383 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 551 }, { "error type": "Irrelevant", "explanation": "", "start": 552, "end": 625 }, { "error type": "Redundant", "explanation": "In the latter, the character is re-imagined as an African-American woman. ", "start": 626, "end": 705 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 706, "end": 744 } ], "missing-info": [], "corrected-prediction": "Lieutenant Green is a fictional character who serves as the personal assistant to Spectrum commander-in-chief Colonel White. In the original series, Green is voiced by Cy Grant." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "How many days does it take an embryo to implant?", "passages": [ [ "Proembryo", "Proembryo\n\nProembryo, or pro-embryo, is a botanical term that has been used for centuries, to denote the series of cells that are formed after fertilization within the ovule of a flowering plant, before formation of the embryo.", "More recently, this same term has been given a more extensive meaning, with reference to a human conceptus not yet implanted into a uterus.", "This more recent meaning is synonymous with \"preembryo\" or \"pre-embryo\", and corresponds to stages with more accepted terms zygote and blastocyst.", "The word 'preembryo' sometimes is used in ethical contexts to refer a human conceptus at least between fertilization and implantation, and is known too as a proembryo although this is not term which has been adopted by the scientific community.", "A conceptus between fertilization and implantation is also frequently classified as an embryo.", "Even after implantation begins, a preembryo (and proembryo) may exist up until formation of the primitive streak.", "Implantation begins at about six days after fertilization, and lasts for about a week, during which time formation of the primitive streak occurs." ], [ "Human embryogenesis", "Human embryogenesis\n\nHuman embryogenesis refers to the development and formation of the human embryo.", "It is characterised by the process of cell division and cellular differentiation of the embryo that occurs during the early stages of development.", "In biological terms, human development entails growth from a one-celled zygote to an adult human being.", "Fertilisation occurs when the sperm cell successfully enters and fuses with an egg cell (ovum).", "The genetic material of the sperm and egg then combine to form a single cell called a zygote and the germinal stage of prenatal development commences.", "Embryogenesis covers the first eight weeks of development; at the beginning of the ninth week the embryo is termed a fetus.", "Human embryology is the study of this development during the first eight weeks after fertilisation.", "The normal period of gestation (pregnancy) is nine months or 38 weeks.", "The germinal stage refers to the time from fertilization through the development of the early embryo until implantation is completed in the uterus.", "The germinal stage takes around 10 days.", "During this stage, the zygote begins to divide, in a process called cleavage.", "A blastocyst is then formed and implanted in the uterus." ], [ "Artificial uterus", "In a normal uterus, the myometrium of the uterine wall functions to expel the fetus at the end of a pregnancy, and the endometrium plays a role in forming the placenta.", "An artificial uterus may include components of equivalent function.", "Methods have been considered to connect an artificial placenta and other \"inner\" components directly to an external circulation.", "An interface between the supplier and the embryo or fetus may be entirely artificial, e.g. by using one or more semipermeable membranes such as is used in \"extracorporeal membrane oxygenation\" (ECMO).", "There is also potential to grow a placenta using human endometrial cells.", "In 2002, it was announced that tissue samples from cultured endometrial cells removed from a human donor had successfully grown.", "The tissue sample was then engineered to form the shape of a natural uterus, and human embryos were then implanted into the tissue.", "The embryos correctly implanted into the artificial uterus' lining and started to grow.", "However, the experiments were halted after six days to stay within the permitted legal limits of in vitro fertilisation (IVF) legislation in the United States.", "A human placenta may theoretically be transplanted inside an artificial uterus, but the passage of nutrients across this artificial uterus remains an unsolved issue." ] ], "gold": "In humans, implantation is the stage of human reproduction at which the embryo adheres to the wall of the uterus. Implantation is likely to occur around nine days after ovulation; however, this can range between six and 12 days. Once this adhesion is successful, the female is considered to be pregnant and the embryo will receive oxygen and nutrients from the mother in order to grow.", "prediction 1": "Implantation begins at about 6 days after fertilization, and lasts for about a week, during which time formation of the primitive streak occurs. The germinal stage refers to the time from fertilization through the development of the early embryo until implantation is completed in the uterus. The germinal stage takes around 10 days. During this stage, the zygote begins to divide, in a process called cleavage. A blastocyst is then formed and implanted in the uterus.", "prediction 2": "Implantation of an embryo takes about 6 days, while the germinal stage of the human embryo takes around 10 days. During the germinal stage, the zygote begins to divide, in a process called cleavage, and a blastocyst is formed and implanted in the uterus. In the human embryo, the first implant occurs about six days after fertilization, while the second implant occurs about a week later, during which time the primitive streak forms. Some procedures, such as the use of a human embryo, however, are performed after fertilization.", "prediction 3": "Implantation starts at about six days after fertilization, and lasts for about a week, during which time formation of the primitive streak occurs. In the human embryo, the implanting time is from fertilization to implantation in the uterus, and the implanting time from fertilization to implantation is approximately 10 days. In the human embryo, the implanting time is around 6 days. In the human embryo, the implanting time is about a week.", "prediction 4": "Embryogenesis refers to the development and formation of the human embryo. It is characterised by the process of cell division and cellular differentiation of the embryo that occurs during the early stages of development. Implantation begins at about six days after fertilization, and lasts for about a week, during which time formation of the primitive streak occurs. The germinal stage refers to the time from fertilization through the development of the early embryo until implantation is completed in the uterus. The germinal stage takes around 10 days. During this process, the zygote begins to divide, in a process called cleavage. A blastocyst is then formed and implanted into the uterus. The germinal stage takes around 8 days.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 411 } ], "missing-info": [], "corrected-prediction": "Implantation begins at about 6 days after fertilization, and lasts for about a week, during which time formation of the primitive streak occurs. The germinal stage refers to the time from fertilization through the development of the early embryo until implantation is completed in the uterus. The germinal stage takes around 10 days. During this stage, the zygote begins to divide. A blastocyst is then formed and implanted in the uterus." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was make you feel my love written?", "passages": [ [ "Make You Feel My Love", "Make You Feel My Love\n\n\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" (1997).", "It was first released commercially by Billy Joel, under the title \"To Make You Feel My Love\", before Dylan's version appeared later that same year.", "It has since been covered by numerous performers and has proved to be a commercial success for recording artists such as Adele, Garth Brooks, Shane Filan, Bryan Ferry, Kelly Clarkson and Ane Brun.", "Two covers of the song (one by Garth Brooks and one by Trisha Yearwood) were featured on the soundtrack of the 1998 film \"Hope Floats\".", "Dylan eventually released the song as a single.", "Additional musicians\n\nBilly Joel covered the song as \"To Make You Feel My Love\" for his compilation album \"Greatest Hits Volume III\" (1997).", "It was released as the album's first single and reached number 50 on the US \"Billboard\" Hot 100.", "Joel's single pre-dated Dylan's release of the song by one month.", "Garth Brooks covered the song as \"To Make You Feel My Love\" in 1998.", "It appeared on the soundtrack of the 1998 film \"Hope Floats\", along with a cover version by Trisha Yearwood as the first and last tracks." ] ], "gold": "\"Make You Feel My Love\" is a song written by Bob Dylan for his 1997 album Time Out of Mind. It was first released commercially by Billy Joel in August 1997, under the title \"To Make You Feel My Love\". Dylan released his version on September 30, 1997. It is one of the few songs to have achieved the status of becoming a \"standard\" in the 21st century, having been covered by over 450 different performers", "prediction 1": "\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" (1997). It was first released commercially by Billy Joel, under the title \"To Make You Feel My Love\", before Dylan's version appeared later that same year. Additional musicians Billy Joel covered the song as \"To Make You Feel My Love\" for his compilation album \"Greatest Hits Volume III\" (1997). It was released as the album's first single and reached number 50 on the US Billboard Hot 100.", "prediction 2": "\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" (1997). It was first released commercially by Billy Joel, under the title \"To Make You Feel My Love\", before Dylan's version appeared later that same year. Additional musicians Billy Joel covered the song as \"To Make You Feel My Love\" for his compilation album \"Greatest Hits Volume III\" (1997). It was released as the album's first single and reached number 50 on the US Billboard Hot 100. Another cover version by Trisha Yearwood appeared on the soundtrack of the 1998 film Hope Floats.", "prediction 3": "\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" in 1997. In the same year, Billy Joel released a cover of it under the title To Make You Feel My Love, and Dylan's version of the song appeared on his album.", "prediction 4": "\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" in 1997. It was first released commercially by Billy Joel, under the title \"To Make You Feel My Love\", before Dylan's version appeared later that same year. Additionally, additional musicians Billy Joel covered the song as \"To Make You Feel My Love\" for his compilation album \"Greatest Hits Volume III\" in 1997. It was released as the album's first single and reached number 50 on the US \"Billboard\" Hot 100. Garth Brooks covered the song as \"To Make You Feel My Love\" in 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 384 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 479 } ], "missing-info": [], "corrected-prediction": "\"Make You Feel My Love\" is a song written by Bob Dylan from his album \"Time Out of Mind\" (1997). It was first released commercially by Billy Joel, under the title \"To Make You Feel My Love\", before Dylan's version appeared later that same year. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has the most points in nba finals history?", "passages": [ [ "Elgin Baylor", "Elgin Baylor\n\nElgin Gay Baylor (born September 16, 1934) is an American former basketball player, coach, and executive.", "He played 14 seasons as a small forward in the National Basketball Association (NBA) for the Minneapolis / Los Angeles Lakers, appearing in eight NBA Finals.", "Baylor was a gifted shooter, strong rebounder, and an accomplished passer.", "Renowned for his acrobatic maneuvers on the court, Baylor regularly dazzled Lakers fans with his trademark hanging jump shots.", "The No. 1 draft pick in 1958, NBA Rookie of the Year in 1959, 11-time NBA All-Star, and a 10-time member of the All-NBA first team, he is regarded as one of the game's all-time greatest players.", "In 1977, Baylor was inducted into the Naismith Memorial Basketball Hall of Fame.", "Baylor spent 22 years as general manager of the Los Angeles Clippers.", "He won the NBA Executive of the Year Award in 2006, before being relieved of his duties shortly before the 2008\u201309 season began.", "His popularity led to appearances on major network television series such as \"Rowan and Martin's Laugh In\" in 1968, The Jackson Five's first TV special in 1971 and a \"Buck Rogers in the 25th Century\" episode, \"Olympiad\", as one of the athletes.", "Elgin \"Rabbit\" Baylor had two basketball-playing brothers, Sal and Kermit." ], [ "Boston Celtics", "Boston Celtics\n\nThe Boston Celtics are an American professional basketball team based in Boston, Massachusetts.", "The Celtics compete in the National Basketball Association (NBA) as a member of the league's Eastern Conference Atlantic Division.", "Founded in 1946 as one of the original eight NBA teams to survive the league's first decade, the team is owned by Boston Basketball Partners LLC.", "The Celtics play their home games at the TD Garden, which they share with the National Hockey League (NHL)'s Boston Bruins.", "The franchise has won the most championships in NBA history with 17, accounting for 23.9 percent of all NBA championships since the league's founding.", "The Celtics have a notable rivalry with the Los Angeles Lakers, and have played the Lakers a record 12 times in the NBA Finals (including their most recent appearances in 2008 and 2010), of which the Celtics have won nine.", "Four Celtics players (Bob Cousy, Bill Russell, Dave Cowens and Larry Bird) have won the NBA Most Valuable Player Award for an NBA record total of 10 MVP awards.", "Both the nickname \"Celtics\" and their mascot \"Lucky the Leprechaun\" are a nod to Boston's historically large Irish population." ], [ "1962 NBA Finals", "1962 NBA Finals\n\nThe 1962 NBA World Championship Series was the championship round of the 1962 NBA Playoffs, which concluded the National Basketball Association (NBA)'s 1961\u201362 season.", "The best-of-seven series was played between the Western Division champion Los Angeles Lakers and Eastern Division champion Boston Celtics.", "This was the Celtics' 6th straight trip to the Finals, and they won the best-of-seven series in Game 7, 110\u2013107 in overtime.", "It was the second time in NBA history and the most recent Finals in which the series was decided by overtime in Game 7.", "The only other Finals series decided in overtime in the seventh game was the 1957 Finals.", "\"Boston Celtics defeated Los Angeles Lakers, 4 games to 3\"\n\nDuring the series, Lakers forward Elgin Baylor scored a Finals record 61 points in Game 5.", "Celtics center Bill Russell set a still-standing record for rebounds in a 7-game series with 189, and tied his own record for rebounds in a single game with 40 in Game 7.", "In the last 5 seconds of regulation in Game 7, Laker Frank Selvy missed an open 12-footer from the baseline that would have won the championship for Los Angeles and ended the Celtics dynasty.", "Instead, the game went into OT in which the Celtics then won the game and thus the title." ] ], "gold": "American professional basketball player Elgin Baylor, who played 14 seasons as a forward in the NBA for the Minneapolis/Los Angeles Lakers, and appeared in eight NBA Finals, has scored the most points in one game in NBA finals history, with 61 points on April 14, 1962. American basketball executive and former player Jerry West, who also played professionally for the Los Angeles Lakers in the NBA, scored the most total points in NBA finals history. American professional basketball team, the Boston Celtics, hold the record for most points in one game in NBS finals history.", "prediction 1": "The player with the most points in a Finals game is Elgin Baylor, who played 14 seasons in the National Basketball Association for the Los Angeles Lakers. Baylor scored a finals record 61 points in the 1962 NBA Finals against the Los Angeles Lakers.", "prediction 2": "The player with the most points in NBA Finals history is Elgin Baylor in the 1962 Finals, when the Los Angeles Lakers defeated the Boston Celtics, by a final score of 61 points. This is tied with the score of 61 points scored by Elgin Baylor in the 1962 Finals, when the Los Angeles Lakers defeated the Boston Celtics, a record 12 times in the Finals.", "prediction 3": "The Lakers have the most points in a single finals game in NBA history, with 61 in the 1962 Finals. Elgin Baylor has the most points in a single NBA Finals game.", "prediction 4": "The Lakers have the most points in a single game in NBA Finals history. In the 1961-62 season, Boston Celtics forward Elgin Baylor scored 61 points in Game 5 of the Western Division Finals. In the 1962 Finals, Boston Celtics center Bill Russell has the most points in a single game. In the 1990 NBA Finals, Chicago Bulls forward Ray Allen has the most points in a single game.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 226, "end": 249 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The player with the most points in one game in NBA finals history is American professional basketball player Elgin Baylor, who played 14 seasons as a forward in the National Basketball Association for the Minneapolis/Los Angeles Lakers, and appeared in eight NBA Finals. Baylor scored a finals record 61 points in the 1962 NBA Finals." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "West ham players in the 1966 world cup?", "passages": [ [ "West Ham United F.C. in European football", "West Ham United F.C. in European football\n\nWest Ham United Football Club is an English professional football club based in Stratford, Newham, East London.", "In 1965, they won the European Cup Winners Cup, and in 1999 the Intertoto Cup.", "They have also competed in the UEFA Cup and UEFA Europa League.", "Outside of major competitions, the club took part in the Anglo-Italian League Cup in 1975\u201376, and the Anglo-Italian Cup in 1992\u201393.", "West Ham first travelled into Europe to play football in 1921 when manager Syd King took the team to Spain where they played games against Real Madrid, Celta de Vigo, Athletic Bilbao and Deportivo de La Coru\u00f1a.", "In the early 1960s, West Ham travelled abroad to play frequently with matches in Costa Rica, Sweden, Rhodesia, Ghana, the United States, Austria and West Germany.", "After winning the previous season's FA Cup, manager Ron Greenwood led West Ham into their first European campaign.", "Two goals from Alan Sealey saw West Ham win the competition against West German side 1860 Munich before a crowd of 100,000 at Wembley on 19 May 1965.", "West Ham started the competition against La Gantoise, the first Belgian side to play in this competition." ], [ "West Ham United F.C. Under-23s and Academy", "At this time, three players who had come through the West Ham youth development system were seeing some success in the England squad; they were Bobby Moore who debuted in 1962, Geoff Hurst and Martin Peters.", "In 1966, these players played a part in England\u2019s victory in the World Cup.", "Moore was the most well-known of the three.", "He captained the England squad and was later named by Pel\u00e9 as the \"greatest\" of all the defenders he had played against.", "In the World Cup final against West Germany in which England won 4\u20132, Hurst scored the only hat-trick ever scored at a World Cup final match, and Peters scored the other goal.", "This gave rise to the West Ham supporters' partly tongue-in-cheek terrace chant:\n\n\"I remember Wembley,\"\n\"When West Ham beat West Germany.\"", "\"Peters one and Geoffrey three,\"\n\"And Bobby got his OBE!\"", "A bronze statue of these three players (and Everton defender Ray Wilson) holding the Jules Rimet Trophy aloft was erected in 2003 at the junction of Barking Road and Green Street close to Upton Park.", "During the next thirty years West Ham's youth academy produced many professional players." ], [ "1966 FIFA World Cup Final", "1966 FIFA World Cup Final\n\nThe 1966 FIFA World Cup Final was the final match in the 1966 FIFA World Cup, the eighth football World Cup.", "The match was played by England and West Germany on 30 July 1966 at Wembley Stadium in London, and had an attendance of 96,924.", "The British television audience peaked at 32.3\u00a0million viewers, making it the most watched television event ever in the United Kingdom.", "England won 4\u20132 after extra time to win the Jules Rimet Trophy.", "The England team became known as the \"wingless wonders\", on account of their then-unconventional narrow attacking formation, described at the time as a 4\u20134\u20132.", "The match is remembered for England's only World Cup trophy, Geoff Hurst's hat-trick\u00a0\u2013 the first, and to date, only one ever scored in a FIFA World Cup Final\u00a0\u2013 and the controversial third goal awarded to England by referee Gottfried Dienst and linesman Tofiq Bahramov.", "Both teams were strong throughout the tournament.", "Each won two and drew one of their three matches in the group stages.", "England did not concede a goal until their semi-final against Portugal." ] ], "gold": "West Ham United Football Club is an English professional football club based in Stratford, East London that compete in the Premier League, the top tier of English football. Three West Ham players were members of 1966 World Cup final winning England team: captain and defender Bobby Moore, forward Geoff Hurst, and mid-fielder Martin Peters. England defeated West Germany 4-2 in the final to win their first, and so far, only title.", "prediction 1": "West Ham United Football Club is an English professional football club based in Stratford, Newham, East London. In 1966, three West Ham players played a part in England's victory in the 1966 World Cup. They were Bobby Moore, Geoff Hurst and Martin Peters. Hurst scored the only hat-trick at a World Cup final match, and Peters scored the other.", "prediction 2": "The 1966 World Cup Final was the final match in the 1966 FIFA World Cup, the eighth football World Cup. England won 4\u20132 after extra time to win the Jules Rimet Trophy. West Ham players included Bobby Moore, Geoff Hurst and Martin Peters.", "prediction 3": "The 1966 World Cup Final was the final match in the 1966 FIFA World Cup, the eighth football World Cup. It was played by England and West Germany on 30 July 1966 at Wembley Stadium in London. West Ham players in the 1966 World Cup included Bobby Moore, Geoff Hurst and Martin Peters. Hurst scored the only hat-trick ever scored at a World Cup final match, and Peters scored the other.", "prediction 4": "In the 1966 FIFA World Cup Final, the final match in the 1966 FIFA World Cup, the eighth football World Cup, three West Ham players took part in the victory of England over West Germany. These players were Bobby Moore, Geoff Hurst and Martin Peters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 344 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "West Ham United Football Club is an English professional football club based in Stratford, Newham, East London. In 1966, three West Ham players played a part in England's victory in the 1966 World Cup. They were Bobby Moore, Geoff Hurst and Martin Peters. England defeated West Germany 4-2 in the final to win their first, and so far, only title." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who are democrats running for governor in michigan?", "passages": [ [ "2014 Michigan gubernatorial election", "Party Chairman Lon Johnson encouraged all other potential challengers to stay out of the race so as to avoid a costly and potentially bitter primary campaign.", "Conservative Democrat and \"birther\" Mark McFarlin had announced on November 29, 2013, that he was running for the Democratic nomination for Governor, but he switched parties on January 3, 2014, leaving Schauer as the only candidate for the Democratic nomination.", "Schauer and Snyder agreed to a town hall style debate that was held on October 12, 2014 on the campus of Wayne State University in Detroit.", "It was co-sponsored by the Detroit News, the Detroit Free Press and public TV station WTVS which televised the debate and sent the feed to other TV stations in Michigan as well as C-SPAN.", "The debate was made available for viewing online here." ], [ "2010 Michigan gubernatorial election", "2010 Michigan gubernatorial election\n\nThe Michigan gubernatorial election of 2010 was held on November 2, 2010.", "Incumbent Democratic Governor Jennifer Granholm was prohibited by the state's Constitution from seeking a third term.", "This resulted in a large pool of candidates which was whittled down, when the May 11 filing deadline passed, to two Democrats and five Republicans.", "Both the \"Cook Political Report\" and the non-partisan \"Rothenberg Political Report\" rated the election as leaning Republican.", "The Republican primary race was highly competitive; both local and national polling reported Congressman Peter Hoekstra, state Attorney General Mike Cox, and businessman Rick Snyder as being front-runners for the Republican Party nomination.", "The Democratic front-runner when the 2009 polls were conducted, Lieutenant Governor John D. Cherry, withdrew from the race in January 2010.", "The final polls just days before the primary election showed that, while Lansing mayor Virg Bernero was in the lead, over a quarter of those polled were still undecided.", "The deadline for candidates to file nominating petitions for the August 3 state primary was 4:00 PM on May 11, 2010.", "A total of 1,575,167 registered voters voted in the primaries, with 66.4% of them voting in the Republican primary.", "Analysts believe a large portion of Democrats crossed party lines to vote for Snyder, whose ad campaign targeted bipartisan and independent support." ], [ "2006 Michigan gubernatorial election", "2006 Michigan gubernatorial election\n\nThe Michigan gubernatorial election of 2006 was one of the 36 U.S. gubernatorial elections held November 7, 2006.", "Incumbent Democratic Governor of Michigan Jennifer Granholm was re-elected over Republican businessman Dick DeVos and three minor party candidates.", "Granholm was re-elected with 56% of the vote.", "Granholm had no opposition in the primary election, which was held August 8.", "She retained incumbent Lieutenant Governor John D. Cherry as her running mate.", "DeVos was originally facing two other Republicans; state Representative Jack Hoogendyk of Portage and state Senator Nancy Cassis of Novi, both dropped out by summer 2005.", "A political unknown, Louis Boven, tried to challenge him in the primary, but failed to meet Michigan election requirements to get on the ballot.", "Boven later ran an unsuccessful write-in campaign.", "DeVos selected former State Representative and Oakland County Clerk Ruth Johnson as his running mate on August 14.", "The Libertarian Party of Michigan held their convention on May 16 at the Comfort Inn in Chelsea The party nominated Gregory Creswell, with Scotty Boman as his running mate.", "The Green Party of Michigan had their convention at the Wolverine Dilworth Inn in Boyne City, Michigan.", "The Green Party's nominee was Douglas Campbell.", "His running mate was David Skrbina, a philosophy professor at the University of Michigan\u2013Dearborn." ] ], "gold": "There have been several democrats running for governor in Michigan over the years. In 2014, Schauer was the Democratic nominee for Governor of Michigan. In 2010, Virg Bernero and Andy Dillon were the Democratic candidates nominated for Governor of Michigan. In 2006, Jennifer Granholm was the Democratic nominee and was the 47th governor of Michigan from 2003 to 2011. ", "prediction 1": "There are three Democratic candidates running for governor in Michigan. In 2004, Kathy McGinty, who had been running for governor since 2010, ran against Republican Dick DeVos, who ran against Republican Ruth Johnson, who ran against Republican Mark Schauer, who ran against Republican John Schiano. In 2010, a Democratic candidate ran against Republican John C. Cherry, whom she had served as the running mate for. In 2014, a Democratic candidate ran against Republican Rick Snyder, who ran against a Republican candidate for governor.", "prediction 2": "There are several democrats running for governor in Michigan. In 2010, there was a Democratic front-runner, Jennifer Granholm, who was re-elected in favor of Republican Dick DeVos. In 2006, the party nominated Gregory Creswell with Scotty Boman as his running mate. In 2014, there was a Democratic front-runner, Tom Schauer with Republican Rick Snyder, who was re-elected to a third term.", "prediction 3": "There have been a number of Democratic candidates running for governor in Michigan, including Republican Rick Snyder, Democratic incumbent Jennifer Granholm, and Green Party nominee Douglas Campbell. The 2010 Michigan gubernatorial election was held on November 2, 2010. The 2010 Michigan gubernatorial election was held on November 2, 2010.", "prediction 4": "There are several democrats running for governor in Michigan. On November 2, 2010, Democratic Governor Jennifer Granholm was re-elected over Republican businessman Dick DeVos and three minor party candidates. In 2010, Green Party nominee Douglas Campbell was running mate of Democratic incumbent Governor John Daugaard. In 2014, former Rep. Mark Schauer was running for the Democratic nomination.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 10, "end": 15 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 81, "end": 95 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 72, "end": 80 }, { "error type": "Incoherent", "explanation": "", "start": 96, "end": 141 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[9]}", "start": 185, "end": 192 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 222, "end": 225 }, { "error type": "Unverifiable", "explanation": "", "start": 263, "end": 299 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2,5]}", "start": 344, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 371, "end": 415 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2,3]}", "start": 484, "end": 536 }, { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 176 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "There were several Democratic candidates running for governor in Michigan. In 2006, Jennifer Granholm was the Democratic nominee as well as the incumbent Democratic Governor of Michigan. In 2010, Virg Bernero was the leading choice. In 2014, Schauer was the only Democratic nominee. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many times has philly been in super bowl?", "passages": [ [ "Philadelphia Eagles", "Philadelphia Eagles\n\nThe Philadelphia Eagles are a professional American football franchise based in Philadelphia, Pennsylvania.", "The Eagles compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division.", "They are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history, and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960.", "The franchise was established in 1933 as a replacement for the bankrupt Frankford Yellow Jackets, when a group led by Bert Bell secured the rights to an NFL franchise in Philadelphia.", "Bell, Chuck Bednarik, Bob Brown, Brian Dawkins, Reggie White, Steve Van Buren, Tommy McDonald, Greasy Neale, Pete Pihos, Sonny Jurgensen, Terrell Owens, and Norm Van Brocklin have been inducted to the Pro Football Hall of Fame.", "The team has an intense rivalry with the New York Giants.", "This rivalry is the oldest in the NFC East and is among the oldest in the NFL.", "It was ranked by NFL Network as the number one rivalry of all-time and \"Sports Illustrated\" ranks it amongst the Top 10 NFL rivalries of all-time at number four, and according to ESPN, it is one of the fiercest and most well-known rivalries in the American football community." ], [ "Super Bowl LII", "However, a failed two-point conversion left the Eagles with a 38\u201333 lead.", "On the Patriots' next drive, Eagles defensive end Brandon Graham stripped the ball from Brady on the drive's second play for the only sack of the game for either team.", "Defensive end Derek Barnett of the Eagles recovered the ball, allowing the Eagles to run the clock down to 1:05 and forcing New England to use up all their remaining timeouts.", "Elliott then kicked a 46-yard field goal, putting Philadelphia ahead by eight points, with the score at 41\u201333, and New England needing a touchdown and a two-point conversion to tie the game and send it into overtime.", "After nine plays (one of them a 13-yard catch by Amendola on fourth-and-10), Brady reached the 49-yard line, and with only nine seconds remaining, he threw a Hail Mary pass to the end zone, to no avail as time expired.", "The Eagles had won their first Vince Lombardi Trophy in franchise history, and their first league championship since 1960, ending what was the third-longest active championship drought in the NFL at 57 years." ], [ "Philadelphia Eagles", "Despite this, the Eagles clinched home-field advantage after the win against Oakland in week 16.", "In the playoffs, the Eagles opened as underdogs, the first time in history that a number 1 seed has opened up the postseason as an underdog.", "Foles would lead the Eagles past the Atlanta Falcons in the Divisional Round 15\u201310.", "In the NFC Championship, the Eagles annihilated the Minnesota Vikings 38\u20137, giving the nickname \"Minneapolis Massacre\", mocking the Minneapolis Miracle from their previous playoff victory.", "Foles had his best game since week 15 and threw for 352 passing yards and three touchdowns.", "The Eagles traveled to Minneapolis to compete in Super Bowl LII, their third attempt at a title, against Tom Brady and the New England Patriots in a rematch of Super Bowl XXXIX from 2005.", "With Foles at the helm, Philadelphia started off the game strong, leading the Patriots 22\u201312 at halftime.", "New England's only lead was by one point in the fourth quarter, 33\u201332.", "The Eagles rallied back and scored an 11-yard touchdown to tight end Zach Ertz.", "The last score of the game was a 46-yard field goal by Jake Elliott to make the final score 41\u201333.", "The franchise won their first Super Bowl ever and their first championship since 1960." ] ], "gold": "The Philadelphia Eagles are a professional American football team based in Philadelphia. The Eagles compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division. They had appeared in 1 Super Bowl from their inception in 1933 up to 1981; 2 from their inception up to 2005; and 3 from their inception up to 2018. They finally won their first Super Bowl in 2017, defeating New England 41-33.", "prediction 1": "In the 2009 Super Bowl, the Philadelphia Eagles defeated the New England Patriots 41\u201333 in overtime. Philadelphia has been in Super Bowl LII three times, in 2005, and in 2016.", "prediction 2": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia. They are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history, and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960. This was the third Super Bowl in franchise history for the Philadelphia Eagles.", "prediction 3": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia. The franchise won their first Super Bowl ever and their first championship since 1960. The franchise also won the Championship Game in 1948, 1949, and 1960.", "prediction 4": "The Philadelphia Eagles have played in super bowls three times. In 1958, they were in Super Bowl XXXIX and in 1960 they were in Super Bowl LII. The Philadelphia Eagles are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history, and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 7, "end": 11 }, { "error type": "Unverifiable", "explanation": "", "start": 101, "end": 175 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia, Pennsylvania. The Eagles compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division. In the 2005 Super Bowl, the Philadelphia Eagles defeated the New England Patriots 41\u201333 in overtime. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How many passing yards did peyton manning have in his career?", "passages": [ [ "Peyton Manning", "He was named Gatorade Circle of Champions National Player-of-the-Year and Columbus (Ohio)", "Touchdown Club National Offensive Player-of-the-Year in 1993.", "While at Newman, he began wearing the #18 jersey in honor of his older brother Cooper, who was forced to give up football due to spinal stenosis.", "Younger brother Eli also wore the number when he became starting quarterback.", "Newman has since retired the #18 jersey and it can be seen hanging in the school gym.", "Manning was among the most sought after high school players in the country and was recruited by about 60 colleges, led by Florida, Florida State, LSU, Michigan, Tennessee, Texas, Texas A&M, and his father's alma mater, Ole Miss.", "Manning chose to play college football for the University of Tennessee Volunteers under head coach Phillip Fulmer.", "Many fans were surprised that he did not pick the Ole Miss Rebels, for whom his father Archie played, and Peyton's parents received several angry phone calls and letters.", "He became Tennessee's all-time leading passer with 11,201\u00a0yards and 89\u00a0touchdowns and won 39 of 45 games as a starter, breaking the Southeastern Conference (SEC) record for career wins.", "As a freshman, Manning began the season as the third-string quarterback." ], [ "Peyton Manning", "Manning holds many NFL records, including touchdown passes (539), AP MVP awards (5), Pro Bowl appearances (14), 4,000-yard passing seasons (14), single-season passing yards (5,477 in 2013) and single-season passing touchdowns (55 in 2013), and is second in career passing yards (71,940).", "A two-time Super Bowl winner and the most valuable player of Super Bowl XLI, Manning is also the only quarterback to start the Super Bowl for two franchises more than once each, with different coaches at each Super Bowl start (Dungy, Caldwell, Fox, Kubiak), and the only starting quarterback to win a Super Bowl with two franchises.", "At 39 years of age, Manning was the oldest quarterback to start in and win a Super Bowl.", "During a 2009 \"Monday Night Football\" game, Manning received the nickname \"The Sheriff\" from color commentator Jon Gruden due to his tendency to audible prior to the snap, and he was one of the most recognizable and parodied players in the NFL.", "Teams led by Manning typically utilized the hurry-up offense in place of the standard huddle.", "Manning attended Isidore Newman School in New Orleans, Louisiana, and led their football team to a 34\u20135 record during his three seasons as the starter." ] ], "gold": "Peyton Manning has had several numbers of passing yards at different stages of his career. During his college career, Manning chose to play college football for the University of Tennessee Volunteers and became Tennessee's all-time leading passer with 11,201 yards. During his NFL regular season career, he achieved a total of 71,940. During his NFL postseason career, he had a sum of 7,339 passing yards.", "prediction 1": "Peyton Manning has thrown for 7,671 passing yards in his career. The Tennessee Volunteers quarterback has thrown for 7,799 passing yards in his career. Manning has thrown for 5,477 passing yards in a single season during his career.", "prediction 2": "Peyton Manning has 71,940 passing yards in his career. He is the second-highest passer in NFL history and the second-highest passer in career points.", "prediction 3": "Peyton Manning has accumulated 71,000 passing yards in his career.", "prediction 4": "Peyton Manning has thrown for more than 70,000 passing yards in his career. In 2013, Manning threw for 5,477 passing yards, 55 passing touchdowns, and he also has thrown for a total of 93 touchdowns. Manning is the second-most-passed quarterback in NFL history with 71,940 passing yards.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 64 }, { "error type": "Unverifiable", "explanation": "", "start": 65, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 232 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Manning chose to play college football for the University of Tennessee Volunteers under head coach Phillip Fulmer. He became Tennessee's all-time leading passer with 11,201 yards. During his NFL regular season career, he achieved a total of 71,940. \n " }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When will the movie justice league be released?", "passages": [ [ "Justice League (film)", "Justice League (film)\n\nJustice League is a 2017 American superhero film based on the DC Comics superhero team of the same name, distributed by Warner Bros. Pictures.", "It is the follow-up to 2016's \"\" and the fifth installment in the DC Extended Universe (DCEU).", "The film is directed by Zack Snyder, written by Chris Terrio and Joss Whedon, and features an ensemble cast that includes Ben Affleck, Henry Cavill, Gal Gadot, Ezra Miller, Jason Momoa, and Ray Fisher as the title team, with Amy Adams, Jeremy Irons, Diane Lane, Connie Nielsen, and J. K. Simmons in supporting roles.", "In the film, Batman and Wonder Woman recruit The Flash, Aquaman, and Cyborg after Superman's death to save the world from the catastrophic threat of Steppenwolf and his army of Parademons.", "The film was announced in October 2014, with Snyder on board to direct and Terrio attached to write the script.", "Initially titled \"Justice League Part One\", with a second part to follow in 2019, the second film was indefinitely delayed to accommodate a standalone Batman film with Affleck.", "Principal photography commenced in April 2016 and ended in October 2016." ], [ "Justice League (film)", "WaterTower Music released the soundtrack album digitally on November 10, 2017, with a release of the physical format on December 8.", "The film held its world premiere in Beijing on October 26, 2017, and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017.", "Its Japan premiere took place on November 20, 2017 in Tokyo, with only Ezra Miller and Ray Fisher from the main cast attending.", "In the United States, the film opened to 4,051 theaters in its widest release.", "\"Justice League\" was shown in cinemas for 119 days (17 weeks).", "Superman was intentionally left out on all early \"Justice League\" marketing materials, including trailers, clips and posters, which actor Cavill commented as \"ridiculous\".", "Despite his character being hidden from promotional materials, Cavill still joined the rest of the cast on the film's press tour.", "Clark Kent was revealed in a final trailer before the release of the film, but edited in a way that writers felt Lois Lane was dreaming about Clark.", "Sponsorship and marketing partners of the film included AT&T, Gillette, Mercedes-Benz, and TCL." ] ], "gold": "Justice League is an American superhero movie. It was released in different countries on different days. It was released on October 26, 2017 in Beijing. It was released on November 17, 2017 in the United States and November 20, 2017 in Japan. ", "prediction 1": "Justice League is a 2017 American superhero film based on the DC Comics superhero team of the same name, distributed by Warner Bros. Pictures. The film was produced by DC Entertainment and distributed by Warner Bros. Pictures. The film held its world premiere in Beijing on October 26, 2017, and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017.", "prediction 2": "Justice League is a 2017 American superhero film based on the DC Comics superhero team of the same name, distributed by Warner Bros. Pictures. The film is directed by Zack Snyder, written by Chris Terrio and Joss Whedon, and features an ensemble cast that includes Ben Affleck, Henry Cavill, Gal Gadot, Ezra Miller, Jason Momoa, and Ray Fisher as the title team, with Amy Adams, Jeremy Irons, Diane Lane, and J. K. Simmons in supporting roles.", "prediction 3": "Justice League is a 2017 American superhero film based on the DC Comics superhero team of the same name, distributed by Warner Bros. Pictures. The film is the follow-up to 2016's Justice League and the fifth installment in the DC Extended Universe (DCEU). The film held its world premiere in Beijing on October 26, 2017, and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017. Its Japan premiere took place on November 20, 2017 in Tokyo, with only Ezra Miller and Ray Fisher from the main cast attending.", "prediction 4": "Justice League is a 2017 American superhero film based on the DC Comics superhero team of the same name, distributed by Warner Bros. Pictures. The film is directed by Zack Snyder, written by Chris Terrio and Joss Whedon, and features an ensemble cast that includes Ben Affleck, Henry Cavill, Gal Gadot, Ezra Miller, Jason Momoa, and Ray Fisher as the title team, with Amy Adams, Jeremy Irons, Diane Lane, and J. K. Simmons in supporting roles. The film's Japan premiere took place on November 20, 2017 in Tokyo, with only Ezra Miller and Ray Fisher from the main cast attending.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 132 }, { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 142 }, { "error type": "Unverifiable", "explanation": "", "start": 143, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 216 } ], "missing-info": [], "corrected-prediction": "Justice League is a 2017 American superhero film. The film held its world premiere in Beijing on October 26, 2017, and was theatrically released in North America and elsewhere around the world in standard, RealD 3D and IMAX on November 17, 2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is winner of rising star season 2?", "passages": [ [ "Rising Star India (season 2)", "Rising Star India (season 2)\n\nRising Star is the second Indian version of the international franchise series \"Rising Star\", a reality television singing competition.", "This is first time when Rising Star does not come with any present sponsor.", "This season earlier had an age limit of 4-13 years but when singers more than 13 years of age came for audition, the channel decided to change the age limit to 4 years and above.", "It is based on the Israeli singing competition \"HaKokhav HaBa\" (meaning \"The Next Star\") made by Keshet Broadcasting Ltd.", "The program format lets the viewers vote for contestants live via the television channel's mobile app.", "The show premiered on 20 January 2018 on Colors TV.", "This is the first reality television show in India which involves Live Audience Voting through Voot App.", "Popular playback singer and music director Shankar Mahadevan, playback singer and actor Monali Thakur and actor-singer Diljit Dosanjh return as the experts in the show.", "The show is hosted by TV Actor Ravi Dubey.", "The winner of Rising Star Season 2 is Hemant Brijwasi.", "In contrast to other singing competition TV shows which feature a cast of celebrity judges, \"Rising Star\" features a cast of celebrity experts and considers the viewers at home the judges." ], [ "Rising Star Indonesia (season 2)", "Rising Star Indonesia (season 2)\n\n", "The second season of Rising Star Indonesia an Indonesian reality singing television competition aired on RCTI.", "Judika, , Ariel \"\"Noah\"\" and Rossa are appointed as the experts.", "Boy William, Nirina Zubir and are appointed as hosts.", "The winner of which receives a 1 billion rupiahs recording contract with Warner Music Indonesia.", "The second season aired on 12 December 2016 and is produced by RCTI in-house production and led by Fabian Dharmawan.", "This season, the competition was won by Andmesh Kamaleng after received 80 percent in the final round.", "The open call auditions were held in the following locations:\n\n\nIn the first round, expert's vote each worth 5%\nIn the finale round, expert's vote each worth 3%.", "Both voting results from the first round and the final round will be accumulated.", "The highest score will be the winner of Rising Star Indonesia." ], [ "Rising Star (Israeli TV series)", "Rising Star (Israeli TV series)\n\n", "HaKokhav HaBa (, translated as \"The Next Star\") is an Israeli interactive reality singing competition, which was first broadcast on Channel 2 from 17 September 2013.", "It is based on the \"Rising Star\" franchise created by Keshet Broadcasting.", "The show is a continuation of the former program \"Kokhav Nolad\" (meaning \"A Star is Born\") which featured aspiring singers competing for a winning title.", "The program's format combines the internet, smartphones and television and is filmed live.", "The shows inaugurative season in 2013 was won by Evyatar Korkus.", "Since season 2, the winner is given the opportunity to represent Israel in the Eurovision Song Contest.", "2014\u20132015 winner Nadav Guedj represented Israel in 2015 with \"Golden Boy\" 2015\u20132016 winner Hovi Star represented Israel in 2016 with \"Made of Stars\", 2016\u20132017 winner Imri Ziv represented Israel in 2017 with \"I Feel Alive\", and 2017\u20132018 winner Netta Barzilai who went on to win the 2018 contest with \"Toy\".", "As the season begins, each contestant is asked to perform a well-known song in front of judges.", "After the song, a vote is taken among judges whether to transfer the applicant to the test stage facing the audience at home." ] ], "gold": "Rising Star is an Israeli interactive reality singing competition, which was first broadcast on 17 September 2013. Nadav Guedj won the second season of the show. India and Indonesia also have a version of Rising Star. The winner of Indian season 2 was Hemant Brijwasi and the winner of Indonesia season 2 was Andmesh Kamaleng.", "prediction 1": "Rising Star Indonesia is an Israeli reality singing competition. The winner of Season 2 is Hemant Brijwasi. Rising Star India is the second Indian version of the international franchise series Rising Star, a reality television singing competition. The winner of Rising Star Season 2 is Shahid Khan.", "prediction 2": "Rising Star Indonesia is an Israeli TV singing competition. The second season of the show was won by Andmesh Kamaleng. The winner of Rising Star Indonesia is Hemant Brijwasi.", "prediction 3": "Rising Star is an Indian reality singing competition with a format similar to the Israeli singing competition HaKokhav HaBa. The show is a continuation of the Israeli singing competition A Star is Born, with aspiring singers competing for a winning title. In Season 2 of Rising Star Indonesia, Andmesh Kamaleng is the winner after receiving 80 percent in the final round.", "prediction 4": "Rising Star Indonesia is a reality television singing competition that is based on the Israeli TV series HaKokhav HaBa. The first season of Rising Star Indonesia was won by Andmesh Kamaleng. The second season of Rising Star Indonesia was won by Hemant Brijwasi.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 12, "end": 21 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 205 }, { "error type": "Redundant", "explanation": "reality singing competition. ", "start": 206, "end": 247 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Rising Star is an Israeli interactive reality singing competition, which was first broadcast on 17 September 2013. Nadav Guedj was the winner of 2014\u20132015 season. The winner of Rising India Star Season 2 is Hemant Brijwasi. The winner of Rising Star Indonesia season 2 was Andmesh Kamaleng. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who did goldberg play for in the nfl?", "passages": [ [ "Marshall Goldberg", "Marshall Goldberg\n\nMarshall Goldberg (October 25, 1917 \u2013 April 3, 2006) was a National Football League (NFL) All-Pro American football player.", "He played college football as a halfback and fullback at the University of Pittsburgh.", "At Pittsburgh, Goldberg was twice recognized as a consensus All-American, and played on two national championship teams under head coach Jock Sutherland.", "Goldberg played for the Chicago Cardinals of the NFL for eight seasons between 1939 and 1948, with an interruption during World War II, and was a four-time All-Pro.", "He was inducted into the College Football Hall of Fame in 1958.", "Goldberg was born in Elkins, West Virginia, and was Jewish.", "Goldberg's father emigrated from Romania to Cumberland, Maryland, where he met and married Rebecca (Becky) Fram, daughter of a Cumberland shoemaker.", "Family lore indicated that Sol Goldberg and Becky's brother, Benjamin, were friends, who later become Marshall's mother.", "The couple settled in the small mountain community of Elkins, West Virginia, some from Pittsburgh, where they set up a ladies clothing store.", "Goldberg attended Elkins High School, where he was captain of the basketball, football, and track teams.", "He was named All-State in all three sports.", "At the University of Pittsburgh, under coach Jock Sutherland, he led the Pitt Panthers to back-to-back national championships in 1936 and 1937." ], [ "Mike Fox (American football)", "Mike Fox (American football)\n\n", "Michael James Fox (born August 5, 1967) is a former American football defensive lineman.", "He was drafted by the New York Giants in the second round (51st overall) of the 1990 NFL draft.", "He played college football at West Virginia.", "He also played for the Carolina Panthers.", "In 1989, Fox finished the year with 10 sacks while playing defensive tackle - making him the only player at the time to generate 10 sacks from any position other than defensive end or linebacker.", "Fox had three multi-sack games, including the Syracuse game in which he recorded nine tackles, two sacks, and two tackles for a loss.", "Fox also finished with 71 tackles and the Gator Bowl MVP trophy.", "At the end of the 1989 season, he played for the East team in the East-West Shrine Game.", "He was also named to the Associated Press (AP) All-East first team.", "Fox was selected in the second round (51st overall) of the 1990 NFL draft by the New York Giants.", "In 1995, Fox signed a five-year contract with the Carolina Panthers.", "In 1999, Fox was placed in the 1999 NFL expansion draft by the Panthers.", "After not being selected by the Cleveland Browns in the expansion draft, he was cut by the Panthers." ] ], "gold": "The wrestler Bill Goldberg played football for the NFL teams Los Angeles Rams, Atlanta Falcons and the CFL team Sacramento Gold Miners. After being cut from the Falcons, in 1995 he was selected by the new expansion team, the Carolina Panthers, in the 1995 NFL expansion draft, but never played a game with the team. Marshall Goldberg played for the Chicago Cardinals of the NFL from 1939 to 1943.", "prediction 1": "Marshall Goldberg was an American football player who played for the Chicago Cardinals of the NFL for eight seasons between 1939 and 1948, with an interruption during World War II. He was a four-time All-Pro. Michael James Fox was a former American football defensive lineman who was drafted by the New York Giants in the second round (51st overall) of the 1990 NFL draft.\n", "prediction 2": "When Marshall Goldberg played in the NFL, he played for the Chicago Cardinals. When Michael James Fox played in the NFL, he played for the Carolina Panthers.", "prediction 3": "Marshall Goldberg was an American football player who played for multiple teams in the NFL. Marshall Goldberg played for the Chicago Cardinals from 1939-1948, the early part of the NFL era. Michael James Fox, a former defensive lineman, played for the New York Giants years before him.", "prediction 4": "Marshall Goldberg played American football for several teams in the NFL, including the Chicago Cardinals, the Pittsburgh Steelers, and the Carolina Panthers. Marshall Goldberg also played for the Baltimore Colts in the NFL, and for the Detroit Lions in the NFL, joining the team in 1971. Marshall Goldberg was a four-time All-Pro in the NFL. Michael James Fox played defensive line for the Carolina Panthers between 1995 and 1999.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 181, "end": 208 }, { "error type": "Irrelevant", "explanation": "", "start": 209, "end": 373 } ], "missing-info": [], "corrected-prediction": "Marshall Goldberg was an American football player who played for the Chicago Cardinals of the NFL for eight seasons between 1939 and 1948, with an interruption during World War II. \n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Can't pay we'll take it away season 5 episode 7?", "passages": [ [ "Can't Pay? We'll Take It Away!", "Can't Pay?", "We'll Take It Away!", "Can't Pay?", "We'll Take It Away!", "is a factual/reality documentary series on Channel 5.", "It follows the work of High Court enforcement officers (previously known as sheriff's officers) as they execute High Court writs across England and Wales, on those who have failed to make repayments on a debt or refuse to vacate a property.", "The series was first broadcast on 24 February 2014, featuring High Court enforcement officers (HCEOs) of High Court Solutions.", "Five series of the programme have been broadcast to date.", "The series has been broadcast Channel 5 since 24 February 2014.", "Their brief of the series says; \"With exclusive access to some of the most experienced HCEOs and Repossession Teams in the country, this series is an eye-opening insight into cash-strapped Britain from the perspectives of debtors, creditors and debt collectors.", "Produced by Brinkworth Films, the series and its various spin-offs reveal what it means to be a creditor who cannot get back what they are owed, what it is like to be saddled with debt that you are simply unable to repay and what it takes to be the kind of person who can pay but refuses to do so." ], [ "Money Hungry", "Episode 6 - \"The Puzzle Master\"\n\n\"First aired September 6, 2010\"\n\nThe teams are thrown a curve when the week's challenge is not only physical, but mental as well.", "Episode 7 - \"This Means War\"\n\n\"First aired September 13, 2010\"\n\nThe joy of being at the Rose Bowl stadium is diminished by the challenge: running up and down the stairs, transporting 100 footballs.", "Alliances shift as teams claim deals were made earlier.", "Episode 8 - \"A Kitty With 9 Lives\"\n\n\"First aired September 20, 2010\"\n\nAnother puzzle throws off some of the teams.", "Phillip plays both sides to try and save his team from elimination.", "Episode 9 - \"Photo Finish\"\n\n\"First aired September 27, 2010\"\n\nOne team attempts to vote themselves into the bottom in order to eliminate another.", "Episode 10 - \"The Ultimate Weigh-In\" and Finale\n\n\"First aired October 4, 2010\"\n\nIn the final challenge, Tricia suffers an injury that puts Grading Curves out of the running.", "In a surprise gesture of team solidarity, Mission Slimpossible (after getting it back along with the Regulators) give their entry fee to Grading Curves.", "Families gather as the last two teams weigh in and the winner is decided." ] ], "gold": "Can't Pay? We'll Take it Away is a British documentary series. Season 5 Episode 7, which was titled Episode 7, aired on May 3, 2017", "prediction 1": "Can't Pay? We'll Take It Away! is a factual/reality documentary series on Channel 5. It follows the work of High Court enforcement officers as they execute High Court writs across England and Wales, on those who have failed to make repayments on a debt or refuse to vacate a property. Episode 7 of the series was titled This Means War and aired on September 13, 2010.", "prediction 2": "The factual/reality documentary series Can't Pay? We'll Take It Away! follows the work of High Court enforcement officers as they execute High Court writs across England and Wales, on those who have failed to make repayments on a debt or refuse to vacate a property. Episode 7 aired on September 13, 2010.", "prediction 3": "Can't Pay? We'll Take It Away! is a factual/reality documentary series on Channel 5. It follows the work of High Court enforcement officers as they execute High Court writs across England and Wales, on those who have failed to make repayments on a debt or refuse to vacate a property. Episode 7 of the series was \"This Means War\" which aired on September 13, 2010. Episode 8 and 9 of the series were \"A Kitty With 9 Lives\" and \"Photo Finish\".", "prediction 4": "Can't Pay? We'll Take It Away! is a factual/reality documentary series on Channel 5. It follows the work of High Court enforcement officers as they execute High Court writs across England and Wales, on those who have failed to make repayments on a debt or refuse to vacate a property. Episode 7 aired on September 13, 2010. Episode 8 aired on September 20, 2010. Episode 9 aired on September 27, 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 284 } ], "missing-info": [], "corrected-prediction": "Can't Pay? We'll Take It Away! is a factual/reality documentary series on Channel 5. Episode 7 of the series was titled This Means War and aired on September 13, 2010." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "How many ligue 1 titles does psg have?", "passages": [ [ "Paris Saint-Germain F.C.", "Paris Saint-Germain F.C.", "Paris Saint-Germain Football Club (), commonly known as Paris Saint-Germain, Paris SG, or simply PSG, is a French professional football club based in the city of Paris.", "Founded in 1970, the club has traditionally worn red and blue kits.", "PSG has played its home matches in the 47,929-capacity Parc des Princes in the 16th arrondissement of Paris since 1974.", "The club plays in the highest tier of French football, Ligue 1.", "Paris Saint-Germain established itself as a major force in France, and one of the major forces of European football in recent years.", "PSG have won a total of 38 trophies, making it the most successful French club in history by this measure.", "PSG is also the only club to have never been relegated from Ligue 1, the club with most consecutive seasons in the top-flight (they have played 45 seasons in Ligue 1 since 1974), one of only two French clubs to have won a major European title, and the most popular football club in France and one of the most widely supported teams in the world.", "Domestically, the Parisians have won seven Ligue 1 titles, a record twelve Coupe de France, a record eight Coupe de la Ligue, and a joint record eight Troph\u00e9e des Champions titles.", "The club has also won one Ligue 2 title." ] ], "gold": "Paris Saint-Germain Football Club, commonly referred to as PSG, Paris or Paris SG, is a professional football club based in Paris, France. They compete in Ligue 1, the top division of French football and are France's most successful club, they have won over 40 official honors, including nine league titles and one major European trophy. As of 2015, PSG had 5 Ligue 1 titles and as of 2016 and 2017 they have 6 Ligue 1 titles. ", "prediction 1": "Paris Saint-Germain Football Club, commonly known as Paris Saint-Germain, Paris SG, or simply PSG, is a French professional football club based in the city of Paris. Over the years, the club has won a total of 38 trophies, making it the most successful French club in history by this measure. The club has won a total of seven Ligue 1 titles in France.", "prediction 2": "Paris Saint-Germain has won seven Ligue 1 titles, a record twelve Coupe de France, a record eight Coupe de la Ligue, and a joint record eight Troph\u00e9e des Champions titles.", "prediction 3": "Paris Saint-Germain Football Club, also known as Paris Saint-Germain, Paris SG, or simply PSG, is a French professional football club based in the city of Paris. The club has won 7 Ligue 1 titles, a record twelve Coupe de France, a record eight Coupe de la Ligue, and a joint record eight Troph\u00e9e des Champions titles.", "prediction 4": "Paris Saint-Germain Football Club, also called Paris Saint-Germain, Paris SG, or simply PSG, is a French professional football club based in the city of Paris. PSG has won seven Ligue 1 titles domestically, a record twelve Coupe de France, a record eight Coupe de la Ligue, and a joint record eight Troph\u00e9e des Champions titles.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Paris Saint-Germain Football Club, commonly known as Paris Saint-Germain, Paris SG, or simply PSG, is a French professional football club based in the city of Paris. The club plays in the highest tier of French football, Ligue 1. Over the years, the club has won a total of 38 trophies, making it the most successful French club in history by this measure. The club has won a total of seven Ligue 1 titles in France." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who was a at the beginning of pretty little liars?", "passages": [ [ "A (Pretty Little Liars)", "After Alison's disappearance, \"A\" went away for a year but after the corpse of Bethany Young (believed to be Alison at the time) was found, she reemerged.", "\"A\" began sending the Liars messages about things only Alison knew about them and soon even began messing with their parents.", "Doctor Anne Sullivan had previously dealt with the person behind the hoodie and when \"A\" trashed her office she immediately recognized the person.", "She almost exposes her identity to the Liars but \"A\" kidnaps her and went as far as to threaten her son's life.", "But the Liars are still close to figuring it out and during the second half of season two they manage to get a hold of \"A's\" phone.", "They hatch a plan to catch her with this and it works.", "They find out that \"A\" had a lair at the Lost woods resort and Spencer and Mona (\"A's\" newest victim) head over there and find a room full of pictures of Alison and the girls along with a sketch of \"A's\" costume to the ball, The Black Swan.", "However, Spencer begins to notice other clues and soon realizes \"A\" is right there with her.", "She turns around to see Mona in a black hoodie, who reveals herself as \"A\"." ], [ "A (Pretty Little Liars)", "A (Pretty Little Liars)\n\n\"A\" is a fictional character created in 2006 by author Sara Shepard.", "It is a character of both \"Pretty Little Liars\"' books and television series, and primarily appears as a stalker and the main antagonist of the stories.", "\"A\" is one of the main characters of the stories, appearing anonymously in the majority of the episodes and books.", "The villain has already had many portrayals.", "Its basic occupation is to pursue and threaten the four protagonists of the stories.", "Thus, many identities have been revealed to be \"A\".", "\"A\" has a specific and unhealthy way of dealing with the protagonists; it often calls them as \"bitches\", \"dolls\" and \"liars\".", "Its handling and acts of terrorism caused great psychological and emotional damage to the protagonists, even leading them to be hospitalized.", "After the revelation of Mona Vanderwaal as the first and original \"A\", she began receiving visits from someone, known as Red Coat, who offered her a partnership and together they built up the \"A-Team\".", "The team had many members but disbanded after the season three finale and Big A began working with a single ally." ], [ "Pretty Little Liars", "Pretty Little Liars\n\nPretty Little Liars is an American teen drama mystery thriller television series developed by I. Marlene King and is loosely based on the novel series of the same name written by Sara Shepard.", "The series follows the lives of four girls whose clique falls apart after the disappearance of their leader.", "One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named \"A\" who threatens to expose their deepest secrets.", "The series features an ensemble cast, headed by Troian Bellisario as Spencer Hastings, Lucy Hale as Aria Montgomery, Ashley Benson as Hanna Marin, Shay Mitchell as Emily Fields, Sasha Pieterse as Alison DiLaurentis and Janel Parrish as Mona Vanderwaal.", "The series premiered on June 8, 2010 on Freeform, formerly known as ABC Family, and ended on June 27, 2017.", "After an initial order of 10 episodes, ABC Family ordered an additional 12 episodes on June 28, 2010.", "The ratings success of the first 10 episodes prompted the book series to be extended beyond the initial eight novels.", "Since its debut, the series has received mixed reviews from television critics, but remained a relative success for Freeform, garnering a large fandom, primarily on social media.", "On March 26, 2013, a spin-off series was announced, titled \"Ravenswood\", but was canceled after one season." ] ], "gold": "A is a fictional character in the Pretty Little Liars franchise. Created by author Sara Shepard in 2006, the character serves as the main antagonist in both the television and book series. Original A was the first A and revealed to be Mona Vanderwaal, portrayed by Janel Parrish.", "prediction 1": "Pretty Little Liars is an American teen drama mystery thriller television series. A was a character in the first episode of the series, which premiered on Freeform, formerly known as ABC Family. At the beginning of the series, Mona Vanderwaal was the original A, and she was played by Troian Bellisario.", "prediction 2": "Pretty Little Liars is an American teen drama mystery television series loosely based on the popular book series of the same name written by Sara Shepard. The series follows the lives of four girls whose clique falls apart after the disappearance of their leader, Alison DiLaurentis. One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named A. At the beginning of the series, Mona Vanderwaal is the first and original \"A\".", "prediction 3": "Pretty Little Liars is an American teen drama mystery television series developed by I. Marlene King and is loosely based on the 2010 novel series of the same name written by Sara Shepard. The series follows the lives of four girls whose clique falls apart after the disappearance of their leader. One year later, the estranged friends are reunited as they begin receiving messages from a mysterious figure named A who threatens to expose their deepest secrets. A is a fictional character created in 2006 by author Sara Shepard. It is primarily appears as a stalker and the main antagonist of the stories.", "prediction 4": "Pretty Little Liars is an American teen drama mystery television series, loosely based on the book series of the same name written by Sara Shepard. In the first season, A was revealed to be Mona Vanderwaal, with Spencer recognizing her as A when she was in a black hoodie. A is a character created in 2006 by author Sara Shepard, who is primarily a stalker and the main antagonist of the stories.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 194 }, { "error type": "Unverifiable", "explanation": "", "start": 263, "end": 303 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "A is a fictional character in the Pretty Little Liars franchise created by author Sara Shepard in 2006. It is a character of both \"Pretty Little Liars\"' books and television series, and primarily appears as a stalker and the main antagonist of the stories. The first and original \"A\" was revealed as Mona Vanderwaal, portrayed by Janel Parrish." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What was the first walt disney studios film to be released in 2017?", "passages": [ [ "March of the Penguins", "As politely as I could I told her, 'Lady, they're just birds.'\"", "Another controversy involves those who feel that the emperor penguin's behavior can be viewed as an indication of intelligent design, and those who consider it to be an example of evolution by natural selection in action.", "Steve Jones, professor of genetics at University College London, is quoted as saying, \"Supporters of intelligent design think that if they see something they don't understand, it must be God; they fail to recognise that they themselves are part of evolution.", "It appeals to ignorance, which is why there is a lot of it in American politics at the moment.\"", "Author Susan Jacoby claims in her 2008 book, \"The Age of American Unreason\" (page 26), that the distributors of the movie deliberately avoided using the word \"evolution\" in order to avoid backlash from the American religious right, and writes, \"As it happens, the emperor penguin is literally a textbook example, cited in college-level biology courses, of evolution by means of natural selection and random mutation.", "...", "The financial wisdom of avoiding any mention of evolution was borne out at the box office ...\"\n\n\"March of the Penguins 2: The Next Step\" () was released by Disneynature in France on February 15, 2017, narrated by Lambert Wilson." ], [ "Beauty and the Beast (2017 film)", "This includes $21\u00a0million from IMAX plays on 1,026 screens, a new record for an IMAX PG title.", "It surpassed the entire lifetime total of the original film in just six days.", "\"Beauty and the Beast\" was the 300th digitally remastered release in IMAX company's history, which began with the re-release of \"Apollo 13\" in 2002.", "Its robust global debut helped push the company past $6\u00a0billion for the first time, and led to analysts believing that the film had a shot of passing $1\u00a0billion worldwide from theatrical earnings.", "On April 12, it passed the $1\u00a0billion threshold, becoming the first film of 2017, the fourteenth Disney film, and the twenty-ninth film overall to pass the mark.", "It became the first film since \"Rogue One\" (also a Disney property) in December 2016 to make over a billion dollars, and did so on its 29th day of release.", "It is currently the second-highest-grossing film of 2017 (behind \"\"), the highest-grossing March release, the highest-grossing remake of all time, and the sixth-biggest Disney film.", "Even after inflation adjusted, it is still ahead of the $425\u00a0million gross ($760\u00a0million in 2017 dollars) of the original film." ], [ "Beauty and the Beast (2017 film)", "Beauty and the Beast (2017 film)\n\nBeauty and the Beast is a 2017 American musical romantic fantasy film directed by Bill Condon from a screenplay written by Stephen Chbosky and Evan Spiliotopoulos, and co-produced by Walt Disney Pictures and Mandeville Films.", "The film is a live-action reimagining of Disney's 1991 animated film of the same name, itself an adaptation of Jeanne-Marie Leprince de Beaumont's 18th-century fairy tale.", "The film features an ensemble cast that includes Emma Watson and Dan Stevens as the eponymous characters with Luke Evans, Kevin Kline, Josh Gad, Ewan McGregor, Stanley Tucci, Audra McDonald, Gugu Mbatha-Raw, Ian McKellen, and Emma Thompson in supporting roles.", "Principal photography began at Shepperton Studios in Surrey, England on May 18, 2015, and ended on August 21.", "With an estimated budget of around $255\u00a0million, it is one of the most expensive films ever made.", "\"Beauty and the Beast\" premiered at Spencer House in London on February 23, 2017, and was released in the United States in standard, Disney Digital 3-D, RealD 3D, IMAX and IMAX 3D formats, along with Dolby Cinema on March 17, 2017." ] ], "gold": "The first Walt Disney Studios film to be released in the US in 2017 was Beauty and the Beast. The 2017 version of Beauty and the Beast is a live-action adaptation of Disney's 1991 animated film of the same name, itself an adaptation of Jeanne-Marie Leprince de Beaumont's 1756 version of the fairy tale. The first Walt Disney Studios film to be released in France in 2017 was March of the Penguins 2: The Next Step. March of the Penguins 2: The Next Step was released in the United States exclusively on Hulu on March 23, 2018.", "prediction 1": "The Walt Disney Studios produced the 2017 film March of the Penguins, which premiered in London on February 23, 2017. The film was released in the United States on March 17, 2017 and was re-released in the United Kingdom on March 18, 2017.", "prediction 2": "The first Walt Disney studios film to be released in 2017 was March of the Penguins. Then, on April 12, 2017, it passed the $1 billion threshold, becoming the first film of 2017, the fourteenth Disney film, and the twenty-ninth film overall to pass the mark. The film, which was directed by Bill Condon from a screenplay written by Stephen Chbosky and Evan Spiliotopoulos, was remade into an IMAX 3D and IMAX 2D versions and released in the United States on March 17, 2017. Thena live-action remake of Disney's 1991 animated film of the same name and a live-action res of the 1991 animated film of the same name, which premiered at Spencer House in London on February 23, 2017, and was released in the United States on March 17, 2017.", "prediction 3": "The Walt Disney Studios film released in 2017 was March of the Penguins. The film was released by Disneynature in France on February 15, 2017. Then on April 12, 2017, the $1 billion threshold was crossed for the movie Beauty and the Beast.", "prediction 4": "\"March of the Penguins\" was the first Walt Disney studios film to be released in 2017, and was released by Disneynature in France on February 15, 2017. On April 12, 2017, \"Beauty and the Beast\" passed the $1 billion threshold, becoming the first film of 2017, the fourteenth Disney film, and the twenty-ninth film overall to pass the mark. \"Beauty and the Beast\" is a live-action reimagining of Disney's 1991 animated film of the same name, and co-produced by Walt Disney Pictures and Mandeville Films.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 47, "end": 69 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Walt Disney Studios produced the 2017, live-action reimagining of Disney's 1991 animated film of the same name, itself an adaptation of Jeanne-Marie Leprince de Beaumont's 18th-century fairy tale, Beauty and the Beast, which premiered in London on February 23, 2017. The film was released in the United States on March 17, 2017. \"March of the Penguins 2: The Next Step\" was released by Disneynature in France on February 15, 2017." }, "preference": [ 2, 0, 2, 1, 1, 2 ] }, { "question": "Who starred in fiddler on the roof movie?", "passages": [ [ "Fiddler on the Roof (film)", "Fiddler on the Roof (film)\n\nFiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison.", "It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem.", "Starring Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann, the film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "He must cope both with the strong-willed actions of his three older daughters, who wish to marry for love \u2013 each one's choice of a husband moves further away from the customs of his faith \u2013 and with the edict of the Tsar who evicts the Jews from the town of Anatevka.", "Throughout the film, Tevye talks to God and directly to the audience, breaking the fourth wall.", "In these monologues, Tevye ponders tradition, the difficulties of being poor, the Jewish community's constant fear of harassment from their non-Jewish neighbors, and important family decisions." ] ], "gold": "The 1971 American epic musical comedy-drama film Fiddler on the Roof stars Haym Topol as Tevye, Norma Crane as Golde, Leonard Frey as Motel Kamzoil, Molly Picon as Yente, and Paul Mann as Lazar Wolf. ", "prediction 1": "Topol is a Russian-born American actor, who plays Tevye, the father of five daughters, in the 1971 musical comedy-drama film Fiddler on the Roof. Norma Crane, played by Norma Topol, also stars as Tevye. Leonard Frey, played by Leonard Frey, plays Tevye, and Molly Picon plays Tevye.", "prediction 2": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. It is an adaptation of the 1964 Broadway musical of the same name, with music composed by Jerry Bock, lyrics by Sheldon Harnick, and screenplay by Joseph Stein and based on stories by Sholem Aleichem. Starring Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann, the film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "prediction 3": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison. The film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives. Starring Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann, the film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "prediction 4": "Fiddler on the Roof is a 1971 American musical comedy-drama film produced and directed by Norman Jewison, an adaptation of the 1964 Broadway musical of the same name. Starring Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann, the film centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 86 }, { "error type": "Unverifiable", "explanation": "", "start": 146, "end": 202 }, { "error type": "Unverifiable", "explanation": "", "start": 203, "end": 282 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 1971 American epic musical comedy-drama film Fiddler on the Roof stars Topol, Norma Crane, Leonard Frey, Molly Picon, and Paul Mann. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did boxing day become a bank holiday?", "passages": [ [ "Boxing Day", "In South Africa (a former British commonwealth realm) as recently as the 1980s, milkmen and garbage collectors, who normally had little if any interaction with those they served, were accustomed to knock on their doors asking for a \"Christmas box\", being a small cash donation, in the week or so before and after Christmas.", "The European tradition, which has long included giving money and other gifts to those who were needy and in service positions, has been dated to the Middle Ages, but the exact origin is unknown.", "It is believed to be in reference to the Alms Box placed in areas of worship to collect donations to the poor.", "Also, it may come from a custom in the late Roman/early Christian era, wherein metal boxes placed outside churches were used to collect special offerings tied to the Feast of Saint Stephen, which in the Western Church falls on the same day as Boxing Day.", "Boxing Day is a secular holiday that is traditionally celebrated on 26 December, the day after Christmas Day.", "26 December is also Saint Stephen's Day, a religious holiday.", "In the UK, Boxing Day is a bank holiday (in England, Wales and Northern Ireland since 1871).", "When 26 December falls on a Saturday, the Boxing Day public holiday is moved to the substitute day, which is the following Monday.", "If 26 December falls on a Sunday, the substitute public holiday is the following Tuesday." ], [ "Boxing Day", "As Boxing Day was traditionally the first week day (historically Monday\u2013Saturday) after Christmas, it cannot technically be on a Sunday as that is considered to be the day of worship.", "However, 26 December is nowadays generally referred to as Boxing Day, even when it falls on the Sunday.", "In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971.", "In Ireland\u00a0\u2013 when the island as a whole was part of the United Kingdom\u00a0\u2013 the Bank Holidays Act 1871 established the feast day of Saint Stephen as a non-movable public holiday on 26 December.", "Following partition in 1920, Northern Ireland reverted to the British name, Boxing Day.", "In Hong Kong, despite the transfer of sovereignty from the UK to China in 1997, Boxing Day continues to be a public holiday.", "Government offices, banks, post offices and most offices are closed on Boxing Day.", "If it falls on a Sunday, a compensation day will be given on the immediate next weekday.", "In Australia, Boxing Day is a federal public holiday.", "The Australian state of South Australia instead observes a public holiday known as Proclamation Day on the first weekday after Christmas Day or the Christmas Day holiday.", "In New Zealand, Boxing Day is a statutory holiday; on these holidays, 1.5x salary and a lieu day is provided to employees who work.", "In Canada, Boxing Day is a federal statutory holiday." ] ], "gold": "In the UK, Boxing Day has been a bank holiday since 1871. When 26 December falls on a Saturday, the associated public holiday is on the following Monday and if 26 December falls on a Sunday, the public holiday is the following Tuesday, Monday being the public holiday associated with Christmas Day. In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971.", "prediction 1": "Boxing Day is a bank holiday in England, Wales and Northern Ireland since 1871. In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971. In Northern Ireland, Boxing Day became a bank holiday when the Bank Holidays Act 1871 established the feast day of Saint Stephen as a non-movable public holiday on 26 December. In the UK, Boxing Day is a secular holiday that is traditionally celebrated on 26 December, the day after Christmas Day.", "prediction 2": "Boxing Day is a bank holiday in England, Wales and Northern Ireland since 1871, when the feast day of Saint Stephen was established as a non-movable public holiday. In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971. In Hong Kong, despite the transfer of sovereignty from the UK to China in 1997, Boxing Day continues to be a public holiday.", "prediction 3": "Boxing Day is a bank holiday in England, Wales and Northern Ireland since 1871. It was established in 1871 as the feast day of Saint Stephen as a non-movable public holiday in Northern Ireland. When 26 December falls on a Saturday, the Boxing Day public holiday is moved to the substitute day, which is the following Monday. If 26 December falls on a Sunday, the substitute public holiday is the following Tuesday.", "prediction 4": "In the UK, Boxing Day is a bank holiday (in England, Wales and Northern Ireland since 1871). In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971. In Northern Ireland, Boxing Day was first made a bank holiday by an Act introduced at the time of Partition in 1920. In Hong Kong, despite the transfer of sovereignty from the UK to China in 1997, Boxing Day continues to be a public holiday.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 241, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 414 }, { "error type": "Redundant", "explanation": "Boxing Day is a bank holiday in England, Wales and Northern Ireland since 1871. ", "start": 292, "end": 323 }, { "error type": "Irrelevant", "explanation": "", "start": 415, "end": 535 } ], "missing-info": [], "corrected-prediction": "Boxing Day is a bank holiday in England, Wales and Northern Ireland since 1871. In Scotland, Boxing Day has been specified as an additional bank holiday since 1974, by Royal Proclamation under the Banking and Financial Dealings Act 1971. When 26 December falls on a Saturday, the Boxing Day public holiday is moved to the following Monday, if 26 December falls on a Sunday, it is on the following Tuesday." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who is one of the founding fathers of symbolic interactionism?", "passages": [ [ "Symbolic interactionism", "Blumer was a social constructionist, and was influenced by John Dewey; as such, this theory is very phenomenologically-based.", "Given that Blumer was the first to use symbolic interaction as a term, he is known as the founder of symbolic interaction.", "He believed that the \"Most human and humanizing activity that people engage in is talking to each other.\"", "According to Blumer, human groups are created by people and it is only actions between them that define a society.", "He argued that with interaction and through interaction individuals are able to \"produce common symbols by approving, arranging, and redefining them.\"", "Having said that, interaction is shaped by a mutual exchange of interpretation, the ground of socialization.", "Two other theorists who have influenced symbolic interaction theory are Yrj\u00f6 Engestr\u00f6m and David Middleton.", "Engestr\u00f6m and Middleton explained the usefulness of symbolic interactionism in the communication field in a variety of work settings, including \"courts of law, health care, computer software design, scientific laboratory, telephone sales, control, repair, and maintenance of advanced manufacturing systems\".", "Other scholars credited for their contribution to the theory are Thomas, Park, James, Horton Cooley, Znaniecki, Baldwin, Redfield, and Wirth.", "Unlike other social sciences, symbolic interactionism emphasizes greatly on the ideas of action instead of culture, class and power." ], [ "Symbolic interactionism", "Symbolic interactionism\n\nSymbolic interactionism is a sociological theory that develops from practical considerations and alludes to people's particular utilization of dialect to make images and normal implications, for deduction and correspondence with others.", "In other words, it is a frame of reference to better understand how individuals interact with one another to create symbolic worlds, and in return, how these worlds shape individual behaviors.", "It is a framework that helps understand how society is preserved and created through repeated interactions between individuals.", "The interpretation process that occurs between interactions help create and recreate meaning.", "It is the shared understanding and interpretations of meaning that affect the interaction between individuals.", "Individuals act on the premise of a shared understanding of meaning within their social context.", "Thus, interaction and behavior is framed through the shared meaning that objects and concepts have attached to them.", "Symbolic interactionism comes from a sociological perspective which developed around the middle of the twentieth century and that continues to be influential in some areas of the discipline.", "It is particularly important in microsociology and social psychology.", "It is derived from the American philosophy of pragmatism and particularly from the work of George Herbert Mead, as a pragmatic method to interpret social interactions.", "Symbolic interaction was conceived by George Herbert Mead and Charles Horton Cooley." ], [ "George Herbert Mead", "George Herbert Mead\n\nGeorge Herbert Mead (February 27, 1863 \u2013 April 26, 1931) was an American philosopher, sociologist and psychologist, primarily affiliated with the University of Chicago, where he was one of several distinguished pragmatists.", "He is regarded as one of the founders of symbolic interactionism and of what has come to be referred to as the Chicago sociological tradition.", "Mead was born February 27, 1863 in South Hadley, Massachusetts.", "He was raised in a Protestant, middle-class family comprising his father, Hiram Mead, his mother, Elizabeth Storrs (Billings) Mead, and his sister Alice.", "His father was a former Congregationalist Pastor from a lineage of farmers and clergymen and who later held the chair in Sacred Rhetoric and Pastoral Theology at Oberlin College's theological seminary.", "Elizabeth Storrs Mead taught for two years at Oberlin College and subsequently, from 1890 to 1900, served as president of Mount Holyoke College in South Hadley, Massachusetts.", "In 1879, George Mead enrolled at Oberlin College, graduating in 1883 with a BA degree.", "After graduation, Mead taught grade school for about four months.", "For the following three years, he worked as a surveyor for the Wisconsin Central Railroad Company.", "In autumn 1887, Mead enrolled at Harvard University, where his main interests were philosophy and psychology." ] ], "gold": "Symbolic interactionism is a sociological theory that is a frame of reference to better understand how individuals interact with one another to create symbolic worlds, and in return, how these worlds shape individual behaviors. Symbolic interaction was conceived by George Herbert Mead, an American philosopher, sociologist, and psychologist born in Massachusetts, and Charles Horton Cooley, an American sociologist born in Michigan, and the son of Michigan Supreme Court Judge Thomas M. Cooley. Herbert George Blumer, a student and interpreter of Mead, coined the term and is known as the founder of symbolic interactionism. Blumer was a social constructionist, and was influenced by John Dewey.", "prediction 1": "Symbolic interactionism is a sociological theory that develops from practical considerations and alludes to people's particular utilization of dialect to make images and normal implications, for deduction and correspondence with others. It is a framework that helps understand how society is preserved and created through repeated interactions between individuals. George Herbert Mead is regarded as one of the founders of symbolic interactionism and of what has come to be referred to as the Chicago sociological tradition. Hiram Mead was an American philosopher, sociologist and psychologist, primarily affiliated with the University of Chicago. Mead is regarded as one of the founders of symbolic interactionism and of what has come to be referred to as the Chicago sociological tradition.", "prediction 2": "Symbolic interactionism is a sociological theory that develops from practical considerations and alludes to people's particular utilization of dialect to make images and normal implications, for deduction and correspondence with others. George Herbert Mead is regarded as one of the founders of symbolic interactionism, as well as of what has come to be referred to as the Chicago sociological tradition. George Herbert Mead was an American philosopher, sociologist and psychologist, primarily affiliated with the University of Chicago. He was one of several distinguished pragmatists.", "prediction 3": "Symbolic interactionism is a sociological theory that develops from practical considerations and alludes to people's particular utilization of dialect to make images and normal implications, for deduction and correspondence with others. It is a framework that helps understand how society is preserved and created through repeated interactions between individuals. George Herbert Mead was an American philosopher, sociologist and psychologist, primarily affiliated with the University of Chicago, where he was one of several distinguished pragmatists. He is regarded as one of the founders of symbolic interactionism and of what has come to be referred to as the Chicago sociological tradition.", "prediction 4": "Symbolic interactionism is a sociological theory that develops from practical considerations and alludes to people's particular utilization of dialect to make images and normal implications, for deduction and correspondence with others. It is a framework that helps understand how society is preserved and created through repeated interactions between individuals. George Herbert Mead, an American philosopher, sociologist and psychologist, primarily affiliated with the University of Chicago, is regarded as one of the founders of symbolic interactionism. Mead was also a member of the Chicago sociological tradition, which has come to be referred to as the Chicago sociological tradition.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 364 }, { "error type": "Irrelevant", "explanation": "", "start": 447, "end": 524 }, { "error type": "Irrelevant", "explanation": "", "start": 595, "end": 647 }, { "error type": "Redundant", "explanation": "George Herbert Mead is regarded as one of the founders of symbolic interactionism and of what has come to be referred to as the Chicago sociological tradition. ", "start": 648, "end": 792 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[4,5]}", "start": 525, "end": 535 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "Symbolic interactionism is a sociological theory that is a frame of reference to better understand how individuals interact with one another to create symbolic worlds, and in return, how these worlds shape individual behaviors.. George Herbert Mead is regarded as one of the founders of symbolic interactionism. He was an American philosopher, sociologist and psychologist born in Massachusetts. Another founder was Charles Horton Cooley. Lastly was Blumer, a social constructionist, and was influenced by John Dewey and was the first to use symbolic interaction as a term, thus he is known as the founder of symbolic interaction." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did oppositional defiant disorder become a diagnosis?", "passages": [ [ "Oppositional defiant disorder", "Some clinicians have debated whether the diagnostic criteria presented above would be clinically relevant for use with females.", "Furthermore, some have questioned whether gender-specific criteria and thresholds should be included.", "Additionally, some clinicians have questioned the preclusion of ODD when conduct disorder is present.", "According to Dickstein, the DSM-5 attempts to:" ], [ "Oppositional defiant disorder", "Oppositional defiant disorder\n\nOppositional defiant disorder (ODD) is listed in the DSM-5 under \"Disruptive, impulse-control, and conduct disorders\" and defined as \"a pattern of angry/irritable mood, argumentative/defiant behavior, or vindictiveness\" in children and adolescents.", "Unlike children with conduct disorder (CD), children with oppositional defiant disorder are not aggressive towards people or animals, do not destroy property, and do not show a pattern of theft or deceit.", "The fourth revision of the \"Diagnostic and Statistical Manual\" (DSM-IV-TR) (now replaced by DSM-5) stated that the child must exhibit four out of the eight signs and symptoms to meet the diagnostic threshold for oppositional defiant disorder.", "These symptoms include: \n\n(1) Often loses temper\n\n(2) Is often touchy or easily annoyed\n\n(3) Is often angry and resentful\n\n(4) Often argues with authority figures or for children and adolescents, with adults\n\n(5) Often actively defies or refuses to comply with requests from authority figures or with rules\n\n(6) Often deliberately annoys others\n\n(7) Often blames others for his or her mistakes or misbehavior\n\n(8) Has been spiteful or vindictive at least twice within the past 6 months." ], [ "Oppositional defiant disorder", "There are two possible explanations for this difference which are that in non-Western cultures there is a decrease prevalence of ODD in boys or an increase prevalence of ODD in girls.", "There are other factors that can influence the prevalence of the disorder.", "One of these factors is the socioeconomic status.", "Youths living in families of low socioeconomic status have a higher prevalence.", "Another factor is based on the criteria used to diagnose an individual.", "When the disorder was first included in the DSM-III, the prevalence was 25% higher than when the DSM-IV revised the criteria of diagnosis.", "The DSM-V made more changes to the criteria grouping certain characteristics together in order to demonstrate that ODD display both emotional and behavioral symptomatology.", "In addition, criteria was added to help guide clinicians in diagnosis because of the difficulty found in identifying whether the behaviors or symptoms are directly related to the disorder or simply a phase in a child's life.", "Consequently, future studies may obtain results indicating a declination in prevalence between the DSM-IV and the DSM-V due to these changes.", "Oppositional defiant disorder was first defined in the \"DSM-III\" (1980).", "Since the introduction of ODD as an independent disorder, the field trials to inform the definition of this disorder have included predominantly male subjects." ] ], "gold": "Oppositional defiant disorder. or ODD, is listed in the DSM-5 under Disruptive, impulse-control, and conduct disorders and defined as \"a pattern of angry/irritable mood, argumentative/defiant behavior, or vindictiveness.\" This behavior is usually targeted toward peers, parents, teachers, and other authority figures and has links to ADHD, where as much as one half of children with ODD will have ADHD. Unlike with conduct disorder, those with oppositional defiant disorder are not aggressive towards people or animals, do not destroy property, and do not show a pattern of theft or deceit. Oppositional defiant disorder was first defined in the DSM-III in 1980. ", "prediction 1": "Oppositional defiant disorder was first defined in the DSM-III in 1980. Since the introduction of ODD as an independent disorder, the field trials to inform the definition of this disorder have included predominantly male subjects.", "prediction 2": "Oppositional defiant disorder (ODD) is listed in the DSM-5 under the heading \"Disruptive, impulse-control, and conduct disorders\" and defined as \"a pattern of angry/irritable mood, argumentative/defiant behavior, or vindictiveness\" in children and adolescents. In the fourth revision of the \"Diagnostic and Statistical Manual\", the child must exhibit four out of the eight signs and symptoms to meet the diagnostic threshold for oppositional defiant disorder. During the final version of the DSM-IV revised the criteria of diagnosis.", "prediction 3": "Oppositional defiant disorder was first defined in the DSM-III in 1980. Since the introduction of ODD as an independent disorder, the field trials to inform the definition of this disorder have included predominantly male subjects. Oppositional defiant disorder is listed in the DSM-5 under \"Disruptive, impulse-control, and conduct disorders\" and defined as \"a pattern of angry/irritable mood, argumentative/defiant behavior, or vindictiveness\" in children and adolescents.", "prediction 4": "Oppositional defiant disorder became a diagnosis in the DSM-IV in 1980. The fourth revision of the DSM-IV-TR was in the fourth edition of the Diagnostic and Statistical Manual. The criteria used to diagnose the disorder were modified in the DSM-V in 2003.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 231 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Oppositional defiant disorder. or ODD, is listed in the DSM-5 under Disruptive, impulse-control, and conduct disorders and defined as \"a pattern of angry/irritable mood, argumentative/defiant behavior, or vindictiveness.\" Unlike children with conduct disorder (CD), children with oppositional defiant disorder are not aggressive towards people or animals, do not destroy property, and do not show a pattern of theft or deceit. Oppositional defiant disorder was first defined in the DSM-III in 1980. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who has the world's most followers on twitter?", "passages": [ [ "Justin Bieber", "We'll give it to kids, let them do the work, so that they feel like it's theirs\", recalled Braun.", "Bieber continues to upload videos to the same channel and has opened a Twitter account, from which he interacts with fans regularly; his account was reported to have more than six million followers in November 2010.", "Bieber surpassed Lady Gaga for having the most followed person on Twitter in January 2013.", "In early November 2013, Katy Perry surpassed him for having the most followers.", "As of 2017, Bieber was the second most followed user of Twitter, while his VEVO channel made him the third most subscribed user of YouTube until by 2018 where it became the second most subscribed user of YouTube.", "The music video for Bieber's song \"Baby\" is the second most disliked on YouTube, receiving over 9.93 million dislikes since its upload in 2010, being only surpassed by the 2018 YouTube Rewind in December 2018.", "\"Guinness Book of World Records\" listed \"Baby\" as the most disliked video on YouTube and on the Internet as of 2013 and six of Bieber's music videos (more than any other artist) listed in the top 40 most disliked videos on YouTube." ], [ "Barack Obama on social media", "In May 2010 Obama's Twitter account ranked as the fourth most followed account with about 4 million followers.", "By May 16, 2011, @BarackObama was followed by 7.4 million people, including twenty-eight world leaders.", "His account became the third account to reach 10 million followers in September 2011.", "@BarackObama was launched on March 5, 2007 at 16:08:25.", "It is his official account, although he also tweeted through @WhiteHouse which is usually used by the presidential administration, while @BarackObama was for his election campaign staff.", "@WhiteHouse predates the Presidency of Barack Obama, since it was created on April 21, 2007.", "Following the 2008 United States presidential election, the Democratic National Committee was believed to have taken over the account and in a speech in November 2009, Obama stated \"I have never used Twitter\", although he had over 2.6 million followers.", "The @BarackObama account is \"run by #Obama2012 campaign staff.", "Tweets from the President are signed -bo.\"" ] ], "gold": "The twitter account @BarackObama, which belong to former United States president Barack Obama, is the Twitter account with the most followers with 130 million.", "prediction 1": "In 2017, Katy Perry is the world's most followed user on Twitter, while Justin Bieber is the world's most followed user on Twitter. In 2017, Lady Gaga is the most followed person on Twitter, and in 2018 Katy Perry is the most followed person on Twitter.", "prediction 2": "In January 2013, Lady Gaga was the most followed person on Twitter, and in early November 2013, Katy Perry was the most followed person. In September 2011, @BarackObama had the most followers.", "prediction 3": "The person with the most followers on Twitter is Lady Gaga, who has 4.6 million followers. The most-followed person on Twitter is Katy Perry, who had 6.5 million followers at the end of December 2013.", "prediction 4": "The person who has the most followers on Twitter is Lady Gaga. In early November 2013, Katy Perry surpassed him for having the most followers. In May 2010, Barack Obama's Twitter account ranked as the fourth most followed account with about 4 million followers. By May 16, 2011, @BarackObama was followed by 7.4 million people, including twenty-eight world leaders. His account became the third account to reach 10 million followers in September 2011.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 132, "end": 253 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 131 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "In wifi network which acts as a base station?", "passages": [ [ "Wireless LAN", "All stations are equipped with wireless network interface controllers (WNICs).", "Wireless stations fall into two categories: wireless access points, and clients.", "Access points (APs), normally wireless routers, are base stations for the wireless network.", "They transmit and receive radio frequencies for wireless enabled devices to communicate with.", "Wireless clients can be mobile devices such as laptops, personal digital assistants, IP phones and other smartphones, or non-portable devices such as desktop computers, printers, and workstations that are equipped with a wireless network interface.", "The basic service set (BSS) is a set of all stations that can communicate with each other at PHY layer.", "Every BSS has an identification (ID) called the BSSID, which is the MAC address of the access point servicing the BSS.", "There are two types of BSS: Independent BSS (also referred to as IBSS), and infrastructure BSS.", "An independent BSS (IBSS) is an ad hoc network that contains no access points, which means they cannot connect to any other basic service set.", "An IBSS is a set of STAs configured in ad hoc (peer-to-peer)mode.", "An extended service set (ESS) is a set of connected BSSs.", "Access points in an ESS are connected by a distribution system." ] ], "gold": "Wireless access points, otherwise known as APs, are the base stations for the wireless network. The devices, which are usually wireless routers, transmit and receive radio frequencies for wireless enabled devices to communicate with.", "prediction 1": "Access points, usually wireless routers, are base stations for the wireless network. They transmit and receive radio frequencies for wireless enabled devices to communicate with. Wireless clients can be mobile devices such as laptops, personal digital assistants, IP phones and other smartphones, or non-portable devices such as desktop computers, printers, and workstations that are equipped with a wireless network interface. The basic service set (BSS) is a set of all stations that can communicate with each other at PHY layer.", "prediction 2": "Access points, normally wireless routers, are base stations for the wireless network. They transmit and receive radio frequencies for wireless enabled devices to communicate with. Wireless clients can be mobile devices such as laptops, personal digital assistants, IP phones and other smartphones, or non-portable devices such as desktop computers, printers, and workstations that are equipped with a wireless network interface.", "prediction 3": "Access points (APs), normally wireless routers, are base stations for the wireless network. They transmit and receive radio frequencies for wireless enabled devices to communicate with. Wireless clients are portable devices such as laptops, personal digital assistants, IP phones and other smartphones, or non-portable devices such as desktop computers, printers, and workstations that are equipped with a wireless network interface.", "prediction 4": "Access points (APs), normally wireless routers, are base stations for the wireless network. They transmit and receive radio frequencies for wireless enabled devices to communicate with. Wireless clients can be mobile devices such as laptops, personal digital assistants, IP phones and other smartphones, or non-portable devices such as desktop computers, printers, and workstations that are equipped with a wireless network interface.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 40 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 427 }, { "error type": "Irrelevant", "explanation": "", "start": 428, "end": 531 } ], "missing-info": [], "corrected-prediction": "Access points are base stations for the wireless network. They transmit and receive radio frequencies for wireless enabled devices to communicate with. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who took shelter under the safavid empire and why?", "passages": [ [ "Persians in the Mughal Empire", "Here Humayun went sightseeing and was amazed at the Persian artwork, military might and architecture he saw: much of this was the work of the Timurid Sultan Husayn Bayqarah and his ancestor, princess Gauhar Shad, thus he was able to admire the work of his relatives and ancestors at first hand.", "He was introduced to the work of the Persian miniaturists, and Kamaleddin Behzad had two of his pupils join Humayun in his court.", "Humayun was amazed at their work and asked if they would work for him if he were to regain the sovereignty of Hindustan and they agreed.", "Shah Tahmasp provided financial aid and a large choice of cavalry to regain his Empire.", "Persians nobles and soldiers joined Humayun in reconquest of South Asia.", "The Turkic Turani nobility tended to fade away from the political scene and the Persian nobles improved their position.", "During 1545\u20131555 A.D. a number of Persians who came in Humayun's service were appointed to important central offices, such as diwan, wazir, and mir-saman (In charge of Imperial Palace).", "\"Ma'\u00e2\u1e63er al-Omar\u00e2\" was written by Shah Nawaz Khan and his son, 'Abd al-Hayy in 1780." ], [ "Safavid dynasty", "Humayun handed over Kandahar, but Tahm\u0101sp was forced to retake it in 1558, after Humayun seized it on the death of the Safavid governor.", "Humayun was not the only royal figure to seek refuge at Tahmasp's court.", "A dispute arose in the Ottoman Empire over who was to succeed the aged Suleiman the Magnificent.", "Suleiman's favourite wife, H\u00fcrrem Sultan, was eager for her son, Selim, to become the next sultan.", "But Selim was an alcoholic and H\u00fcrrem's other son, Bayezid, had shown far greater military ability.", "The two princes quarrelled and eventually Bayezid rebelled against his father.", "His letter of remorse never reached Suleiman, and he was forced to flee abroad to avoid execution.", "In 1559 Bayezid arrived in Iran where Tahmasp gave him a warm welcome.", "Suleiman was eager to negotiate his son's return, but Tahmasp rejected his promises and threats until, in 1561, Suleiman compromised with him.", "In September of that year, Tahmasp and Bayezid were enjoying a banquet at Tabriz when Tahmasp suddenly pretended he had received news that the Ottoman prince was engaged in a plot against his life." ], [ "Humayun", "Humayun\n\nNasir-ud-Din Mu\u1e25ammad (; 6 March 1508 \u2013 27 January 1556), better known by his regnal name, Humayun (), was the second emperor of the Mughal Empire, who ruled over territory in what is now Afghanistan, Pakistan, and parts of northern India and Bangladesh from 1530\u20131540 and again from 1555\u20131556.", "Like his father, Babur, he lost his kingdom early but regained it with the aid of the Safavid dynasty of Persia, with additional territory.", "At the time of his death in 1556, the Mughal Empire spanned almost one million square kilometres.", "In December 1530, Humayun succeeded his father to the throne of Delhi as ruler of the Mughal territories in the Indian subcontinent.", "At the age of 22, Humayun was an inexperienced ruler when he came to power.", "His half-brother Kamran Mirza inherited Kabul and Lahore, the northernmost parts of their father's empire.", "Mirza was to become a bitter rival of Humayun.", "Humayun lost Mughal territories to Sher Shah Suri, but regained them 15 years later with Safavid aid.", "Humayun's return from Persia was accompanied by a large retinue of Persian noblemen and signalled an important change in Mughal court culture." ] ], "gold": "Mughal Emperor Humayun and Ottoman Prince Bayezid both took shelter under the Safavid Empire. Humayun was the second emperor of the Mughal Empire and ruled over territory in what is now Afghanistan, Pakistan, Northern India, and Bangladesh from 1530 to 1540. However, in 1540, Humayun was defeated by Sher Shah Suri and fled to shelter under the powerful Safavid Empire in Iran. Here, Shah Tahmasp and the Safavid Empire welcomed the Mughal, and treated him as a royal visitor. However, Humayun was not the only royal figure to take shelter under the Safavid Empire. A dispute arose in the Ottoman Empire over who was to succeed the aged Suleiman the Magnificent. Suleiman's favorite wife, H\u00fcrrem Sultan, was eager for her son, Selim, to become the next sultan. But Selim was an alcoholic and H\u00fcrrem's other son, Bayezid, had shown far greater military ability. The two princes quarreled and eventually Bayezid rebelled against his father. Bayezid's letter of remorse never reached his father, and Bayezid was forced to flee abroad to avoid execution. In 1559 Bayezid arrived in Iran where Tahmasp and the Safavid Empire gave him shelter.", "prediction 1": "There were several royal figures who took refuge under the Safavid Empire. Humayun Nasir-ud-Din Muammad, better known by his regnal name, Humayun, was the second emperor of the Mughal Empire, who ruled over territory in what is now Afghanistan, Pakistan, and parts of northern India and Bangladesh from 1530\u20131540 and again from 1555\u20131556. A dispute arose in the Ottoman Empire over who was to succeed the aged Suleiman the Magnificent.\n", "prediction 2": "Most notable was Humayun Nasir-ud-Din Muammad, who was the second emperor of the Mughal Empire. In 1536, Humayun handed over Kandahar, but Baha'uddin Behzad had two of his pupils join Humayun in his court. Then, in 1558, Humayun seized it after Baha'uddin Behzad and the Safavids forced the Sultan to re-Esta.", "prediction 3": "The Safavid Empire was the name given to the government of Safavid Iran by their founder, Shah Tahmasp. During the reign of the Mughal Empire in 1554\u20131566, Humayun Nasir-ud-Din Muammad, a Persian named Kahdeesh Ahmed Siraj, and son of Sher Shah Suri, took shelter under this government.", "prediction 4": "The Safavid Empire was a key player in the rise and fall of the Mughal Empire, and many royal figures sought refuge under its Protectorate. The second emperor of the Mughal Empire, Humayun Nasir-ud-Din Muammad, or Humayun the Second, ruled India and Pakistan, later winning the parts of northern India and Bangladesh. Humayun's return from Persia was accompanied by a large retinue of Persian noblemen and signalled an important change in Mughal court culture and signalled an important change in Mughal court culture.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 104 }, { "error type": "Irrelevant", "explanation": "", "start": 105, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 338 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Humayun was the second emperor of the Mughal Empire, who ruled over territory in what is now Afghanistan, Pakistan, northern India and Bangladesh from 1530\u20131540. However, he lost his kingdom, losing Mughal territories to Sher Shah Suri, and ended up taking refuge under the Safavid Empire. However, Humayun was not the only royal figure to take shelter there. Indeed, a dispute arose in the Ottoman Empire over who was to succeed the aged Suleiman the Magnificent. Suleiman's favorite wife, H\u00fcrrem Sultan, was eager for her son, Selim, to become the next sultan. But Selim was an alcoholic and H\u00fcrrem's other son, Bayezid, had shown far greater military ability. The two princes quarreled and eventually Bayezid rebelled against his father. Bayezid's letter of remorse never reached his father, and Bayezid was forced to flee abroad to avoid execution. In 1559 Bayezid arrived in Iran where Tahmasp gave him a warm welcome.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings the song i'm on my way?", "passages": [ [ "I'm on My Way (The Proclaimers song)", "I'm on My Way (The Proclaimers song)\n\n\"I'm on My Way\" is a song by Scottish folk pop duo The Proclaimers for their 1988 album \"Sunshine on Leith\".", "In 1989, it was released as a single, which made it to number 43 in the United Kingdom, and number 3 in Australia.", "The lyrics \"I'm on my way from misery to happiness today\" differ from I'm on My Way the spiritual of the same name.", "The song was used on the soundtrack of DreamWorks's 2001 comedy film \"Shrek\", and also as the theme music of the BBC Radio Four comedy series \"The Maltby Collection\".", "An instrumental version was used on \"Are We There Yet?\".", "In keeping with the groups's support of Scottish football club Hibernian, \"I'm On My Way\" was played amidst jubilant scenes at Hampden Park immediately after Hibernian's victory in the 2007 Scottish League Cup Final.", "Kikki Danielsson has covered the song with lyrics in Swedish, written by Ulf S\u00f6derberg.", "This version was named \"Jag \u00e4r p\u00e5 v\u00e4g\", and is on her 1989 album \"Canzone d'Amore\" and her 2006 compilation album \"I dag & i morgon\"." ], [ "I'm on My Way (Dean Parrish song)", "I'm on My Way (Dean Parrish song)\n\n\"I'm on My Way\" is a song and single by American soul singer, Dean Parrish.", "Written by Doug Morris and Eliot Greenberg, it was first released in the US 1967 without any chart success.", "It was released in the UK in 1975 and found chart success due to its popularity with the Northern soul scene.", "Released in the US in 1967 on the Laurie label, in the UK in the 1970s, \"I'm on My Way\" came to the attention of Russ Winstanley, a disc jockey at the Wigan Casino.", "He began playing the record and it became one of the more popular records at the venue.", "It was re-released in 1975 on the UK Records label and was the last record to be played every week at the Wigan Casino.", "The single reached number 38 in the UK Singles Chart in February 1975.", "Wigan Casino's spin-off record label Casino Classics re-released it on the \"Three Before Eight\" EP in 1978 and \"\" compilation in 1979.", "The Wigan Casino closed in 1981 and \"I'm on My Way\" was the last record ever played there.", "Parrish had remained unaware of the song's revival having stopped performing in the 1960s." ], [ "I'm on My Way (Captain & Tennille song)", "I'm on My Way (Captain & Tennille song)\n\n\"I'm on My Way\" is a 1978 song by the Captain & Tennille.", "It is a track on their LP \"Dream\".", "The single was released a month prior to the release of the LP.", "The song became a hit in the U.S. on the Pop, Country and Adult Contemporary charts.", "It did best on the Adult Contemporary charts, where it reached number six in the U.S. as well as number 13 in Canada.", "\"I'm on My Way\" was first recorded by Andrew Gold.", "It was included on his 1978 LP, \"All This and Heaven Too\", which was issued one week prior to the release of the Captain & Tennille's single." ] ], "gold": "\"I'm on My Way\" is a song and single by American soul singer, Dean Parrish. Written by Doug Morris and Eliot Greenberg, it was first released in the US 1967 without any chart success. The 1978 song \"I'm on My Way\" by Captain & Tennille is a track on their LP Dream which became a hit in the U.S. on the Pop, Country and Adult Contemporary charts. This version was first recorded by Andrew Gold and included on his 1978 LP, All This and Heaven Too, which was issued one week prior to the release of the Captain & Tennille's single. \"I'm on My Way\" is also a song by Scottish folk pop duo the Proclaimers, for their album of 1988, Sunshine on Leith and was released as a single in 1989, which made it to #43 in the United Kingdom and #3 in Australia. ", "prediction 1": "\"I'm on My Way\" is a song and a single by American soul singer, Dean Parrish, written by Doug Morris and Eliot Greenberg and first released in the US in 1967 without any chart success. In 1975, \"I'm on My Way\" came to the attention of Russ Winstanley, a disc jockey at the Wigan Casino. He began playing the record and it became one of the more popular records at the venue. The song was re-released in the UK in 1979 and was the last record ever played at the Wigan Casino. It was also covered by Swedish, written by Ulf S\u00f6derberg, called \"Jag \u00e4r p v\u00e4g \u00e4r p v\u00e4g p\u00e4\u00e4g \u00e4g \u00e4r p\u00e4\u00e4\u00e4mm\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4a\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4\u00e4", "prediction 2": "I'm on My Way is a song and single by American soul singer, Dean Parrish. Written by Doug Morris and Eliot Greenberg, it was first released in the US 1967 without any chart success. In the UK in the 1970s, I'm on My Way came to the attention of Russ Winstanley, a disc jockey at the Wigan Casino. He began playing the record and it became one of the more popular records at the venue. \"I'm on My Way\" is a 1978 song by the Captain & Tennille. It was a track on their LP, Dream. It is also a track on their LP Dream, the single was released one week prior to the release of the LP.", "prediction 3": "I'm on My Way is a song and single by American soul singer, Dean Parrish. Written by Doug Morris and Eliot Greenberg, it was first released in the US 1967 without any chart success. It was released in the UK in 1975 and found chart success due to its popularity with the Northern soul scene. \"I'm on My Way\" is also a song by Scottish folk pop duo The Proclaimers for their 1988 album \"Sunshine on Leith\". Kikki Danielsson has covered the song with lyrics in Swedish, written by Ulf S\u00f6derberg. This version is named \"Jag \u00e4r p p v\u00e4g \u00e4r p v\u00e4g p\u00e4v\u00e4g \u00e4r p\u00e4v\u00e4g p\u00e4da\" and is on her 1989 album \"Canzone d'Amore\" and her 2006 compilation album", "prediction 4": "I'm on My Way is a song and single by American soul singer, Dean Parrish. Written by Doug Morris and Eliot Greenberg, it was first released in the US 1967 without any chart success. It was released in the UK in 1975 and found chart success due to its popularity with the Northern soul scene. Several other artists have also sang the song, including The Proclaimers and Kikki Danielsson. \"I'm on My Way\" is also a 1978 song by the Captain & Tennille.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 286 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 474 }, { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 374 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 498, "end": 506 }, { "error type": "Irrelevant", "explanation": "", "start": 507, "end": 532 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 540, "end": 597 }, { "error type": "Irrelevant", "explanation": "", "start": 475, "end": 497 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 6, 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"I'm on My Way\" is a song and a single by American soul singer, Dean Parrish, written by Doug Morris and Eliot Greenberg and first released in the US in 1967 without any chart success. \"I'm on My Way\" is a 1978 song by the Captain & Tennille. It is a track on their LP \"Dream\". The song became a hit in the U.S. on the Pop, Country and Adult Contemporary charts. \"I'm on My Way\" was first recorded by Andrew Gold. It was included on his 1978 LP, \"All This and Heaven Too\", which was issued one week prior to the release of the Captain & Tennille's single. \"I'm on My Way\" is a song by Scottish folk pop duo The Proclaimers for their 1988 album \"Sunshine on Leith\". In 1989, it was released as a single, which made it to number 43 in the United Kingdom, and number 3 in Australia. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who's the host of whose line is it anyways?", "passages": [ [ "Whose Line Is It Anyway? (UK TV series)", "Reruns of \"Whose Line\" continued following its cancellation, though with episodes edited and reformatted as a result.", "The format itself was later picked up by ABC, after Stiles introduced \"Whose Line\" to Drew Carey, who subsequently pitched an American version of the same name to the TV network with great success.", "On 6 March 2011, over twelve years after the series finale, a special edition of the show was recorded for \"24 Hour Panel People\", a marathon of UK panel shows, in aid of Comic Relief.", "The recording was broadcast live on the Comic Relief website at about 9:30am, while the edited compilation shows for the event were shown between 13\u201317 March on BBC Three.", "Alongside Anderson hosting the show, the format was adjusted to feature five performers, and featured performances by Humphrey Ker, Josie Lawrence, Neil Mullarkey, Tony Slattery and David Walliams.", "In 2017, a stage-version of the show appeared at the Edinburgh Festival Fringe with some members of the original cast.", "Each typical television episode of \"Whose Line Is It Anyway?\" featured four performers (with an exception of six in a 1989 Christmas special) who sit in a line of chairs at the back of the stage.", "The host sat at a desk facing the large performance area in front of the performers." ], [ "Whose Line Is It Anyway? (U.S. TV series)", "Whose Line Is It Anyway?", "(U.S. TV series)\n\n", "Whose Line Is It Anyway?", "(often known as simply Whose Line?) is an improvisational comedy television show, an adaptation of the British show of the same name.", "It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey.", "A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "The series features Ryan Stiles, Colin Mochrie, and Wayne Brady as its regular performers with the fourth seat occupied by a guest panelist.", "The show consists of a panel of four performers who create characters, scenes, and songs on the spot, in the style of short-form improvisation games.", "Topics for the games are based on either audience suggestions or predetermined prompts from the host, who would set up a game and situation that the performers would improvise.", "The original host Drew Carey awarded arbitrary point values after each game, often citing a humorous reason for his decision.", "The points were purely decorative and served no practical purpose.", "He would reiterate this at the beginning of, and multiple times throughout, each episode by describing \"Whose Line\" as \"the show where everything's made up and the points don't matter\"." ], [ "Whose Line Is It Anyway? (U.S. TV series)", "This early incarnation of the show is notable as being the origin of its tradition of having the performers read the credits in an amusing style; as it was a radio show, it was necessary for somebody to read the credits, and it was decided that it might as well be done as part of the program, rather than being done by a traditional BBC Radio announcer.", "This approach to reading credits was pioneered by the earlier BBC radio show \"I'm Sorry, I'll Read That Again\".", "Indeed, the title of the show itself is a comedic riposte to another radio show, \"What's My Line\", merged with the title of a 1972 teleplay (and eventual theatrical play) \"Whose Life Is It Anyway?\".", "The radio series lasted for six episodes, after which Channel 4 developed the franchise for television.", "The British television version lasted for a total of 10 seasons, with 136 episodes, all of which were hosted by Clive Anderson.", "Colin Mochrie and Ryan Stiles, who would later star in the U.S. version, became regular cast members in the seventh and eighth seasons.", "The format of the American version was very similar to the British program." ] ], "gold": "Whose Line Is It Anyway? is an improvisational comedy television show in the United States. It is an adaptation of the British show of the same name, which was hosted by Clive Anderson. It aired on ABC and ABC Family from August 5, 1998, to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013.", "prediction 1": "Whose Line Is It Anyway? is an improvised comedy television show, an adaptation of the British show of the same name. It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013. The American version of the show was hosted by Dane DeVine.", "prediction 2": "Whose Line is It Anyway? is an American improv comedy television show, an adaptation of the British show of the same name. The original host was Drew Carey, who hosted the show from 1998 to 2007. However, the format was changed to feature five performers, and performances by Humphrey Ker, Josie Lawrence, Neil Mullarkey, Tony Slattery, David Walliams, and David Walliams were added to the lineup.", "prediction 3": "Who'se Line Is It Anyway? is an improvisational comedy television show, an adaptation of the British show of the same name. It was hosted by Drew Carey from 1998 to 2007. In the U.S., the show was hosted by Aisha Tyler.", "prediction 4": "Whose Line Is It Anyway? is an improv comedy television show, an adaptation of the British show of the same name. The original host of the show was Clive Anderson. In the United States, Drew Carey was the host and the host of the American version was Ryan Stiles.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 300, "end": 359 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Whose Line Is It Anyway? is an improvised comedy television show, an adaptation of the British show of the same. It aired on ABC and ABC Family from August 5, 1998 to December 15, 2007, hosted by Drew Carey. A revival of the show, hosted by Aisha Tyler, began airing on The CW on July 16, 2013. The British television version was hosted by Clive Anderson." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang rockin pneumonia and boogie woogie flu?", "passages": [ [ "Rockin' Pneumonia and the Boogie Woogie Flu", "Rockin' Pneumonia and the Boogie Woogie Flu\n\n\"Rockin' Pneumonia and the Boogie Woogie Flu\" is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song (No. 52 \"Billboard\").", "1972 saw the song as an international hit single for Johnny Rivers with instrumental backing from L.A. sessions musicians from the Wrecking Crew.", "\"Rockin' Pneumonia\" reached number six on the U.S. \"Billboard Hot 100\" during the winter of 1973.", "It was only Rivers' fifth highest charting song, but spent much longer on the chart (19 weeks) than any of his two dozen hits to that date.", "On the U.S. \"Cash Box\" Top 100 the song peaked at number five, and in Canada it reached number three.", "Rivers' cover of \"Rockin' Pneumonia\" became his third Gold record.", "His last Gold record would be five years later with the 1977 hit, \"Swayin' to the Music (Slow Dancing).\"" ] ], "gold": "\"Rockin' Pneumonia and the Boogie Woogie Flu\" is a song written and originally recorded by Huey \"Piano\" Smith in 1957, who scored a minor Billboard hit with the song peaking at No. 52 on the Top 100 chart, and a more successful, No.5 on the Most Played R&B by Jockeys chart. In 1972, the song became an international hit single for Johnny Rivers, featuring Larry Knechtel on piano as well as other L.A. sessions musicians from the Wrecking Crew. \"Rockin' Pneumonia\" reached number six on the U.S. Billboard Hot 100 during the winter of 1973. It was only Rivers' fifth highest charting song, but spent much longer on the chart than any of his two dozen hits to that date. ", "prediction 1": "\"Rockin' Pneumonia and the Boogie Woogie Flu\" is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song. In 1972, Rockin' Pneumonia became an international hit single for Johnny Rivers, with instrumental backing from L.A. sessions musicians from the Wrecking Crew.", "prediction 2": "Rockin' Pneumonia and the Boogie Woogie Flu is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song (No. 52 Billboard). 1972 saw the song as an international hit single for Johnny Rivers with instrumental backing from L.A. sessions musicians from the Wrecking Crew.", "prediction 3": "Rockin' Pneumonia and the Boogie Woogie Flu is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song (No. 52 Billboard). The song became an international hit single for Johnny Rivers in 1972, with instrumental backing from L.A. sessions musicians from the Wrecking Crew.", "prediction 4": "Rockin' Pneumonia and the Boogie Woogie Flu is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song (No. 52 Billboard). 1972 saw the song as an international hit single for Johnny Rivers with instrumental backing from L.A. sessions musicians from the Wrecking Crew. Rivers' cover of Rockin' Pneumonia became his third Gold record.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Rockin' Pneumonia and the Boogie Woogie Flu \"Rockin' Pneumonia and the Boogie Woogie Flu\" is a song written and originally recorded by Huey 'Piano' Smith in 1957, who scored a minor hit with the song (No. 52 \"Billboard\"). In 1972, Rockin' Pneumonia became an international hit single for Johnny Rivers, with instrumental backing from L.A. sessions musicians from the Wrecking Crew. \"Rockin' Pneumonia\" reached number six on the U.S. \"Billboard Hot 100\" during the winter of 1973. It was only Rivers' fifth highest charting song, but spent much longer on the chart (19 weeks) than any of his two dozen hits to that date." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where does doctor strange go to get his powers?", "passages": [ [ "Kamar-Taj", "Kamar-Taj\n\nKamar-Taj (Arabic/Persian: \u0642\u0645\u0631 \u062a\u0627\u062c \"Qamar-Taj\", meaning; \"Moon Crown\") is a fictional location appearing in American comic books published by Marvel Comics.", "It first appeared in \"Strange Tales\" #110 (July 1963) and was created by Stan Lee and Steve Ditko.", "The name \"Kamar-Taj\" does not appear in early Lee/Ditko Doctor Strange stories, but was created later as the country's backstory was fleshed out.", "Kamar-Taj is \"a hidden land high in the Himalayas\" and the homeland of Doctor Strange's mentor, the Ancient One, and of the evil sorcerer Kaluu.", "Strange's majordomo Wong also stems from a family of monks living in Kamar-Taj.", "Over 500 years ago, the man who would one day become the Ancient One was born in Kamar-Taj.", "With his friend Kaluu, he discovered the power of magic but the two friends disagreed on how to use it to protect their village.", "Kaluu sought to conquer neighboring villages and build a large empire." ], [ "Kamar-Taj", "The two cast a spell eliminating sickness, disease and age from Kamar-Taj and shortly afterwards Kaluu was crowned king by the villagers under Kaluu's mind-control spell.", "The Ancient One tried to stop Kaluu and in their battle the village of Kamar-Taj was wiped out.", "Kaluu was banished to an alternate dimension.", "The Ancient One left Kamar-Taj and traveled the Earth for centuries, battling evil creatures, gaining the Amulet of Agamotto and the Book of the Vishanti.", "He finally settled down in the Himalaya Mountains near Kamar-Taj, building a palace as his home with an order of monks to protect and assist him.", "In a tournament organized by the sorcerer Aged Genghis, the Ancient One won the title of Earth's Sorcerer Supreme.", "He took a student, who would one day become Mister Jip, but banned him from his home when he found out the student had been studying the forbidden books to increase his own power.", "Feeling himself getting older and weaker, the Ancient One set out to find a student.", "He taught such beings as Doctor Druid and Baron Mordo but found his true apprentice in Stephen Strange, claiming that this boy would become the new Sorcerer Supreme.", "Mordo began to plot against Strange, though the Ancient One kept protecting him." ], [ "Doctor Strange", "Depressed and still searching, Strange, while walking near the docks, overhears two sailors talking about a hermit called the Ancient One (who is actually the Earth's Sorcerer Supreme) in the Himalayas, who can cure any ailment.", "Strange uses the last of his funds to seek out the aged mystic.", "The Ancient One refuses to help Strange because of his arrogance, but senses a good side that he attempts to bring to the surface.", "He fails, but Strange's heroism appears when he discovers the Ancient One's disciple, Baron Mordo, attempting to kill the old man.", "After a confrontation with Mordo leads to him being shackled with restraining spells preventing him from either attacking Mordo or warning the Ancient One, Strange desperately and selflessly accepts the Ancient One's offer to become his apprentice to have some hope of helping the old man.", "The Ancient One, pleased at Strange's sincere change of heart, accepts the westerner and promptly frees him from the restraining spells while explaining he was aware of Mordo's treachery all along.", "Strange soon becomes Mordo's most enduring enemy, as the Ancient One teaches the doctor the mystic arts.", "After completing his training, Strange returns to New York City and takes up residence within the Sanctum Sanctorum, a townhouse located in Greenwich Village, and is soon assisted by his personal assistant Wong." ] ], "gold": "Kamar-Taj is a fictional location appearing in American comic books published by Marvel Comics. It first appeared in Strange Tales #110 and was created by Stan Lee and Steve Ditko. Kamar-Taj is \"a hidden land high in the Himalayas\" and the homeland of Doctor Strange's mentor, the Ancient One, from whom he gets his powers. At a time when he is broke and ostracized from his colleagues, Strange becomes a drifter and happens to overhear two sailors in a bar discussing a hermit called the Ancient One, who is actually the Earth's Sorcerer Supreme, in the Himalayas, who can heal any ailment. Despite not personally believing in magic, Strange uses the last of his money to track down the aged mystic, and, after Strange proves himself by committing a heroic act, the Ancient One accepts him as his new student and trains the doctor in the mystic arts.", "prediction 1": "Kamar-Taj is the homeland of Doctor Strange's mentor, the Ancient One, and of the evil sorcerer Kaluu. The Ancient One traveled the Earth for centuries, battling evil creatures, and gaining the Amulet of Agamotto and the Book of the Vishanti. He finally settled down in the Himalaya Mountains near Kamar-Taj, building a palace as his home with an order of monks to protect and assist him. Then, when Strange is depressed and still seeking, he overhear-Taj and overhear-Taj, the Ancient One promises that he would become his student. Strange then moves to New York City to take up residence within the Sanctorum Sanctorum Sanctorum Sanctorum Sanctorum Sanctorum Sanctorum, a townhouse located in Greenwich Village.", "prediction 2": "Doctor Strange went to the Himalayas to learn about the ancient mystic who is the Earth's Sorcerer Supreme. The Ancient One is a hermit who is in the mountains and teaches Strange the mystic arts. Strange is brought back to New York City to complete his training under the tutelage of the Ancient One.", "prediction 3": "The Doctor Strange story begins in Strange Tales #110 when Strange is walking near the docks and hears two sailors talking about a hermit called the Ancient One, the Earth's Sorcerer Supreme. The Ancient One traveled the Earth for centuries, fighting evil creatures, and gaining the Amulet of Agamotto and the Book of the Vishanti. He then settled down in the Himalaya Mountains near Kamar-Taj, building a palace as his home with an order of monks to protect him.", "prediction 4": "Doctor Strange visits the Himalayas to get his powers from a hermit called the Ancient One, who is actually the Earth's Sorcerer Supreme. The hermit also teaches the doctor the mystic arts and also gives him the ability to speak the language of the gods. Strange then returns to New York City to complete his training with the Ancient One.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 532 }, { "error type": "Irrelevant", "explanation": "", "start": 533, "end": 713 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": " Kamar-Taj is a fictional location appearing in American comic books published by Marvel Comics. It first appeared in Strange Tales #110 and was created by Stan Lee and Steve Ditko. Kamar-Taj is \"a hidden land high in the Himalayas\" and the homeland of Doctor Strange's mentor, the Ancient One, and of the evil sorcerer Kaluu. The Ancient One traveled the Earth for centuries, battling evil creatures, and gaining the Amulet of Agamotto and the Book of the Vishanti. He finally settled down in the Himalaya Mountains near Kamar-Taj, building a palace as his home with an order of monks to protect and assist him. In a tournament organized by the sorcerer Aged Genghis, the Ancient One won the title of Earth's Sorcerer Supreme." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When does the new lost in space on netflix start?", "passages": [ [ "Lost in Space (2018 TV series)", "Lost in Space (2018 TV series)\n\nLost in Space is an American science fiction television series based on a reimagining of the 1965 series of the same name (itself a reimagining of the 1812 novel \"The Swiss Family Robinson\"), following the adventures of a family of space colonists whose spaceship veers off course.", "Produced by Legendary Television, Synthesis Entertainment, Clickety-Clack Productions, and Applebox Entertainment, the show is written by Matt Sazama and Burk Sharpless, with Zack Estrin serving as showrunner.", "Netflix released the series on April 13, 2018, renewing it the following month for a second season.", "In the aftermath of an impact event that threatens the survival of humanity, the Robinson family is selected for the 24th mission of the \"Resolute\" (24th Colonist Group), an interstellar spacecraft carrying selected families to colonize the Alpha Centauri star system.", "Before they reach their destination, an alien robot breaches the \"Resolute\"s hull.", "Forced to evacuate the mothership in short-range \"Jupiter\" spacecraft, scores of colonists, among them the Robinsons, crash on a nearby habitable planet.", "There they must contend with a strange environment and battle their own personal demons as they search for a way back to the \"Resolute\"." ], [ "Long Lost Family (U.S. TV series)", "It was reported that the series would be hosted by Chris Jacobs and Lisa Joyner and produced by Shed Media.", "Season one of \"Long Lost Family\" premiered on March 6, 2016.", "On June 9, 2016, it was announced that TLC had renewed the series for a second season.", "The final six episodes of the second season began airing on November 6, 2017.", "On March 20, 2018, it was announced that the series had been renewed for a third season set to premiere on April 8, 2018.", "On September 7, 2018, it was announced that further episodes of season three were expected to premiere on October 8, 2018\n\nAlongside the initial series announcement, TLC released the first teaser trailer for the series.", "On March 20, 2018, TLC released the official trailer for season three.", "The original British program began airing in 2011 and has so far distributed 7 seasons.", "It is hosted by Davina McCall and Nicky Campbell.", "An Australian version of \"Long Lost Family\", hosted by Chrissie Swan and Anh Do, began airing around the same time as the U.S. version in 2016, but was canceled by 2017." ] ], "gold": "Lost in Space is an American science fiction television series on Netflix and is a reimagining of the 1965 series of the same name, which was a reimagining of the 1812 novel The Swiss Family Robinson. It follows the adventures of a family of space colonists whose spaceship veers off course. The series premiered on April 13, 2018 and was renewed for a second season which premiered on December 24, 2019. On March 9, 2020, the series was renewed for a third and final season, which is scheduled for a 2021 release.", "prediction 1": "Lost in Space is an American science fiction television series that follows the adventures of a family of space colonists whose spaceship veers off course. The original Lost in Space airs on Netflix. The 2018 series premiered on April 13, 2018. The original Lost in Space airs on TLC.", "prediction 2": "Lost in Space is an American science fiction television series based on a reimagining of the 1965 series of the same name, following the adventures of a family of space colonists whose spaceship veers off course. The new Lost in Space on Netflix started airing on April 10, 2018, with the second season airing on April 14, 2020. It was renewed for a second season by TLC and began airing on June 9, 2016. The third season originally began airing on April 7, 2020.", "prediction 3": "Lost in Space is an American science fiction television series based on a reimagining of the 1965 series of the same name, following the adventures of a family of space colonists whose spaceship veers off course. Netflix released the series on April 13, 2018, renewing it the following month for a second season. The first and second seasons of Lost in Space premiered in the U.S. on March 6, 2016, and in the U.K. on March 20, 2018.", "prediction 4": "Lost in Space is an American science fiction television series based on a reimagining of the 1965 series of the same name, following the adventures of a family of space colonists whose spaceship veers off course. The original Lost in Space television series began airing on March 6, 2016. The new Lost in Space on Netflix started airing on April 13, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 245, "end": 284 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Lost in Space is an American science fiction television series on Netflix based on reimagining of the 1965 series of the same name, which was a reimagining of the 1812 novel The Swiss Family Robinson. It follows the adventures of a family of space colonists whose spaceship veers off course. Netflix released the series on April 13, 2018, renewing it the following month for a second season. On March 20, 2018, it was announced that the series had been renewed for a third season set to premiere on April 8, 2018." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who plays the human beast in beauty and the beast?", "passages": [ [ "Beauty and the Beast (1991 film)", "Beauty and the Beast (1991 film)\n\nBeauty and the Beast is a 1991 American animated musical romantic fantasy film produced by Walt Disney Feature Animation and released by Walt Disney Pictures.", "The 30th Disney animated feature film and the third released during the Disney Renaissance period, it is based on the French fairy tale of the same name by Jeanne-Marie Leprince de Beaumont who was uncredited in the English version but credited in the French version, and ideas from the 1946 French film of the same name directed by Jean Cocteau.", "\"Beauty and the Beast\" focuses on the relationship between the Beast (voice of Robby Benson), a prince who is magically transformed into a monster and his servants into household objects as punishment for his arrogance, and Belle (voice of Paige O'Hara), a young woman whom he imprisons in his castle to become a prince again.", "To break the curse, Beast must learn to love Belle and earn her love in return before the last petal falls from an enchanted rose or else the Beast will remain a monster forever.", "The film also features the voices of Richard White, Jerry Orbach, David Ogden Stiers, and Angela Lansbury.", "Walt Disney first attempted unsuccessfully to adapt \"Beauty and the Beast\" into an animated film during the 1930s and 1950s." ], [ "Beauty and the Beast (2017 film)", "Before the release of the film, Bill Condon refilmed one certain sequence in the \"Days of the Sun\" number, due to confusion among test audiences caused by actress Harriet Jones, who looked similar to Hattie Morahan, who portrayed Agathe.", "In the original version of the scene, it was Jones's character, the Prince's mother, who sings the first verse of the song, with Rudi Goodman playing the young Prince and Henry Garrett playing his father; but in the reshot version of the scene, the singing part is given to the Prince (now played by Adam Mitchell).", "The King was also recast to Tom Turner, although Harriet Jones was still the Queen, albeit with dark hair.", "Both Goodman and Garrett's names were mistakenly featured in the original theatrical release's credits, but was later corrected in home releases.", "When released in 1991, \"Beauty and the Beast\", marked a turning point for Walt Disney Pictures by appealing to millions of fans with its Oscar-winning musical score by lyricist Howard Ashman and composer Alan Menken.", "In Bill Condon's opinion, that original score was the key reason he agreed to direct a live-action version of the movie.", "\"That score had more to reveal\", he says, \"You look at the songs and there's not a clunker in the group." ], [ "Beauty and the Beast (2017 film)", "What is wrong with making adults feel like kids again?\"", "In January 2015, Emma Watson announced that she would be starring as Belle, the female lead.", "She was the first choice of Walt Disney Studios chairman Alan F. Horn, as he had previously overseen Warner Bros. which released the eight \"Harry Potter\" films that co-starred Watson as Hermione Granger.", "Two months later, Luke Evans and Dan Stevens were revealed to be in talks to play Gaston and the Beast respectively, and Watson confirmed their casting the following day through tweets.", "The rest of the principal cast, including Josh Gad, Emma Thompson, Kevin Kline, Audra McDonald, Ian McKellen, Gugu Mbatha-Raw, Ewan McGregor and Stanley Tucci were announced between March and April to play LeFou, Mrs. Potts, Maurice, Madame de Garderobe, Cogsworth, Plumette, Lumi\u00e8re and Cadenza, respectively.", "Susan Egan, who originated the role of Belle on Broadway, commented on the casting of Watson as \"perfect\".", "Paige O'Hara, who voiced Belle in the original animated film and its sequels, offered to help Watson with her singing lessons." ] ], "gold": "Beauty and the Beast is a 1946 French romantic fantasy film directed by French poet and filmmaker Jean Cocteau starring Jean Marais as the Beast. It is an adaptation of the 1757 story Beauty and the Beast, written by Jeanne-Marie Leprince de Beaumont and published as part of a fairy tale anthology. In 1991, Walt Disney Pictures released an animated, musical version based on the French fairy tale and ideas from the 1946 film. Robby Benson was the voice of the Beast. A Broadway musical production of the Walt Disney film premiered in 1994 with Terrence Mann portraying the Beast. Walt Disney Studios recreated Beauty and the Beast into a live action version of the 1991 animated film which was released in 2017 with Adam Mitchell portraying the young version of the Beast and Dan Stevens portraying the adult version of the Beast.", "prediction 1": "The 1991 American animated musical romantic fantasy film Beauty and the Beast stars Robby Benson as the Beast, a prince transformed into a monster by a curse and who must learn to love Belle, the female lead. In the 2017 live-action retelling of the 1991 film, the role of the Beast is played by Adam Mitchell.", "prediction 2": "In the 1991 American animated musical romantic fantasy film, Beauty and the Beast, the Beast is voiced by Robby Benson. In the 2017 film, Beauty and the Beast, the Beast is voiced by Paige O'Hara.", "prediction 3": "The 1991 American animated musical romantic fantasy film Beauty and the Beast is voiced by Robby Benson as the Beast, a prince who is magically transformed into a monster and his servants into household objects as punishment for his arrogance. In the 2017 live-action version of the film, the Beast is voiced by Paige O'Hara as the Beast.", "prediction 4": "The 1991 American animated musical romantic fantasy film Beauty and the Beast is based on the French fairy tale of the same name by Jeanne-Marie Leprince de Beaumont. Robby Benson voices the Beast, a prince who is magically transformed into a monster and his servants into household objects as punishment for his arrogance, and Paige O'Hara voices Belle, a young woman whom he imprisons in his castle to become a prince again. The 2017 live-action version of the film stars Emma Watson as the human beast.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 208 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 273, "end": 282 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The 1991 American animated musical romantic fantasy film Beauty and the Beast, based on the French fairy tale of the same name by Jeanne-Marie Leprince de Beaumont and ideas from the 1946 French film of the same name directed by Jean Cocteau, stars Robby Benson as the Beast. In the 2017 live-action retelling of the 1991 film, the role of the young Prince is played by Adam Mitchell and the Beast is played by Dan Stevens." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did bear inthe big blue house come out?", "passages": [ [ "Bear in the Big Blue House", "After the hiatus and the spin-off \"Breakfast with Bear\", new episodes returned to the Disney Channel in April 2006, with the last episode airing on April 28, 2006.", "Repeats of the show ceased altogether in May 2007 (December 2010 in the UK).", "Thigpen was posthumously nominated for a Daytime Emmy Award for voicing Luna the moon in \"Bear in the Big Blue House\", but lost to Jeff Corwin.", "The show was shown throughout the world including in the United Kingdom on five and Playhouse Disney UK, on the Australian Broadcasting Corporation in Australia and on RT\u00c9 Two in Ireland." ], [ "Bear in the Big Blue House", "Bear in the Big Blue House\n\nBear in the Big Blue House is an American children's television series created by Mitchell Kriegman and produced by Jim Henson Television for Disney Channel's Playhouse Disney preschool television block.", "Debuting on October 20, 1997, it aired its last episode on April 28, 2006.", "Bear lives in the Big Blue House with his friends Ojo, Tutter, Treelo, Pip, Pop, and Shadow.", "He and his friends have many adventures together.", "Those normally include solving problems, sharing, cooperating with each other, and developing social/life skills.", "Each episode opens with the welcome song.", "The other characters in the show then make their appearance, and the theme and plot of the show then comes to place.", "Throughout the episode, the theme (ex; \"sleep\", \"doctors\", \"Thanksgiving\") is learned about, and a lesson is learned at the end of the episode.", "Songs and jokes accompany the episode.", "Bear acts as a caregiver towards Ojo the bear cub, Treelo the lemur, Tutter the mouse, and Pip and Pop, who are two otters.", "The character \"Shadow\" narrates a segment with shadow puppets in each episode.", "Most of the segments are in song, while some are simply a short story relating to the episode's theme." ], [ "Bear in the Big Blue House", "At the end of the program, Bear sings the goodbye song with Luna, the moon.", "Several of these characters appeared in a music video for the We Are Family Foundation.", "Bear also appeared as a celebrity in the 2002 revival of \"The Hollywood Squares\"; he notably appeared in Whoopi Goldberg's final episode.", "\"Bear in the Big Blue House\" was initially produced from 1997 to 2006.", "The voice actress for \"Luna\" the moon was played by Lynne Thigpen, who abruptly died due to a cerebral hemorrhage in 2003.", "Thigpen's death led to a three-year hiatus of \"Bear in the Big Blue House\".", "A planned film version of \"Bear\" was also put on hold.", "Two years after Thigpen's death, Tara Mooney, who voiced the character Shadow, in an interview with Ray D'Arcy on Today FM stated: \"The crew's hearts just weren't in it anymore\".", "Thigpen's friends and family established a non-profit foundation, The Lynne Thigpen - Bobo Lewis Foundation, to help young actors and actresses learn how to survive and succeed in New York theater and to mentor the next generation of Broadway stars." ] ], "gold": "The first run of the children's TV series Bear in the Big Blue House premiered October 20, 1997 and ran from 1997 to 2003. The sudden death of one of the voice actors put the show on hiatus for three years. A final run aired on the Disney channel in April 2006.", "prediction 1": "Bear in the Big Blue House is an American children's television series created by Mitchell Kriegman and produced by Jim Henson Television for Disney Channel's Playhouse Disney preschool television block. Debuting on October 20, 1997, it aired its last episode on April 28, 2006. Repeats of the show ceased altogether in May 2007 (December 2010 in the UK).", "prediction 2": "Bear in the Big Blue House is an American children's television series created by Mitchell Kriegman and produced by Jim Henson Television for Disney Channel's Playhouse Disney preschool television block. The show debuted on October 20, 1997 and the last episode aired on April 28, 2006. Repeats of the show ceased altogether in May 2007 (December 2010 in the UK).", "prediction 3": "Bear in the Big Blue House is an American children's television series created by Mitchell Kriegman and produced by Jim Henson Television for Disney Channel's Playhouse Disney preschool television block. It came out on October 20, 1997, and its last episode aired on April 28, 2006. Repeats of the show ceased altogether in May 2007 (December 2010 in the UK).", "prediction 4": "Bear in the Big Blue House is an American children's television series created by Mitchell Kriegman and produced by Jim Henson Television for Disney Channel's Playhouse Disney preschool television block. Debuting on October 20, 1997, it aired its last episode on April 28, 2006. Repeats of the show ceased altogether in May 2007 (December 2010 in the UK). The show was shown throughout the world including in the United Kingdom on five and Playhouse Disney UK, on the Australian Broadcasting Corporation in Australia, and on RT\u00c9 Two in Ireland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 30, "end": 203 }, { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 355 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Bear in the Big Blue House debuted on October 20, 1997 and ran from 1997 to 2003. The sudden death of one of the voice actors put the show on hiatus for three years. The show aired its last episode on the Disney channel on April 28, 2006. " }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sang i'm telling you i'm not going?", "passages": [ [ "And I Am Telling You I'm Not Going", "And I Am Telling You I'm Not Going\n\n\"And I Am Telling You I'm Not Going\" (also known in short as just \"And I Am Telling You\") is a torch song from the Broadway musical \"Dreamgirls\", with lyrics by Tom Eyen and music by Henry Krieger.", "In the context of the musical, \"And I Am Telling You I'm Not Going\" is sung by the character Effie White, a singer with the girl group The Dreams, to her manager, Curtis Taylor Jr., whose romantic and professional relationship with Effie is quickly ending.", "The lyrics to \"And I Am Telling You I'm Not Going\", often considered the show's signature tune, describe Effie's love for Curtis, both strongly devoted and defiant.", "She refuses to let Curtis leave her behind, and boldly proclaims to him, \"I'm staying and you ...", "you're gonna love me.\"", "In addition to its presence in the musical, \"And I Am Telling You I'm Not Going\" is also notable as the debut single of two women who portrayed Effie." ], [ "And I Am Telling You I'm Not Going", "Jennifer Holliday originated the role on Broadway in 1981 and won a Tony Award for her performance as well as the Grammy for Best R&B Performance, Female for its re-release in 1982 for which it became a number-one R&B hit for Holliday.", "Jennifer Hudson portrayed Effie in the 2006 film adaptation of \"Dreamgirls\", winning an Oscar for the role.", "Hudson's version became a Top 20 R&B single, and a number-one dance hit.", "In 1982, Jennifer Holliday, the actress who portrayed Effie in the original Broadway production, released the song as a single.", "It was her first single release and it met with great success, topping the \"Billboard\" R&B charts and attaining top forty positions on both the \"Billboard\" Hot 100 and the UK Singles Chart.", "In 1983, Holliday won the Grammy Award for Best R&B Vocal Performance, Female for the single.", "\"And I Am Telling You I'm Not Going\" was designed as the closing number of \"Dreamgirls\"' first act.", "Holliday's performance of the song, in a style owing much to gospel music singing traditions, was regularly staged to thunderous applause; it was hailed as the highlight of the show in several printed reviews of the musical." ], [ "And I Am Telling You I'm Not Going", "This version of Hudson's \"And I Am Telling You\" was a chart success, reaching the top of the \"Billboard\" Hot Dance Club Play chart in early 2007.", "A shortened edit of the full remix appeared on a Columbia Records promotional-only CD accompanying the Jones & Kupper remix of another \"Dreamgirls\" song, the Beyonc\u00e9 Knowles/Anika Noni Rose/Sharon Leal/Jennifer Hudson rendition of \"One Night Only\".", "Also included were the Freemasons remixes of Beyonc\u00e9's singles \"D\u00e9j\u00e0 Vu\" and \"Ring the Alarm\".", "Whitney Houston performed the song at the beginning of a medley with \"I Have Nothing\" at the 1994 American Music Awards.", "This performance is included on her 2014 CD/DVD release, \"\".", "Houston also performed the tune as part of the set list during her Bodyguard Tour in 1993.", "In 1994, Donna Giles scored a minor club hit in the US and UK with her rendition of the song.", "The track remained a sleeper club hit in the UK throughout 1995, prompting a spate of re-releases and remixes, including Stonebridge, culminating in a major release on Ore Records in 1996.", "This last release would finally take the track to number 27 on the UK Singles Chart in February of that year." ] ], "gold": "And I'm Telling You I'm Not Going is a song from the Broadway musical Dreamgirls and was originally performed in 1981 by Jennifer Holliday who plays the character Effie White in the original production. In 1982 she released it as a single which met with great success. In 1993 Whitney Houston performed the song on her Bodyguard tour and a 1994 performance of the song at the American Music Awards is included on a CD/DVD release that came out in 2014 after her death in 2012. In 1994 Donna Giles released her own rendition of the song. The 2006 film adaptation of Dreamgirls features Jennifer Hudson as Effie, a role for which she won an Oscar. Her version of the song became a Top 20 R&B single, and a number-one dance hit.", "prediction 1": "And I Am Telling You I'm Not Going is a torch song from the Broadway musical \"Dreamgirls\", with lyrics by Tom Eyen and music by Henry Krieger. In the context of the musical, \"And I Am Telling You I'm Not Going\" is sung by the character Effie White, a singer with the girl group The Dreams, to her manager, Curtis Taylor Jr., whose romantic and professional relationship with Effie is quickly ending. In 1982, Jennifer Holliday, the actress who portrayed Effie in the original Broadway production, released the song as a single. It was the first single release and it met with great success, topping the Billboard R&B charts and attaining top forty positions on both the Billboard Hot 100 and the UK Singles Chart. In 2007, Jennifer Hudson's version was a chart success, reaching the top of", "prediction 2": "And I Am Telling You I'm Not Going is a song from the Broadway musical Dreamgirls, with lyrics by Tom Eyen and music by Henry Krieger. The song was sung by the character Effie White, a singer with the girl group The Dreams, to her manager, Curtis Taylor Jr. and became a number-one R&B hit for Jennifer Holliday. In addition to its presence in the musical, And I Am Telling You I'm Not Going is also notable as the debut single of two women who portrayed Effie White. In the 2006 film adaptation of Dreamgirls, Jennifer Hudson portrayed Effie in the 2006 film version of the character, winning an Oscar for the role. Hudson's version became a top of the Billboard R&B chart and a number-one dance hit for Hudson.", "prediction 3": "And I Am Telling You I'm Not Going is a torch song from the Broadway musical Dreamgirls. The song is sung by the character Effie White, a singer with the girl group The Dreams, to her manager, Curtis Taylor Jr. The song was originally created by Jennifer Holliday in 1981 and released as a single in 1982. This version was performed by Jennifer Hudson in 2006, and was a Top 20 R&B single.", "prediction 4": "And I Am Telling You I'm Not Going is a torch song from the Broadway musical Dreamgirls. In the context of the musical, And I Am Telling You I'm Not Going is sung by the character Effie White, a singer with the girl group The Dreams, to her manager, Curtis Taylor Jr. In 1982, Jennifer Holliday, the actress who portrayed Effie in the original Broadway production, released the song as a single. It was her first single release and it met with great success, topping the Billboard R&B charts and attaining top forty positions on both the \"Billboard Hot 100\" and the UK Singles Chart. In 2004, Whitney Houston performed the song at the beginning of a medley with \"I Have Nothing\" at the 1994 American Music Awards. In 2007, Donna Giles scored a minor club hit in the UK with her rendition of And", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 142 }, { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 249, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 528, "end": 713 }, { "error type": "Irrelevant", "explanation": "", "start": 714, "end": 722 }, { "error type": "Incoherent", "explanation": "", "start": 787, "end": 789 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4, 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "And I Am Telling You I'm Not Going is a torch song from the Broadway musical \"Dreamgirls\". It is sung by the character Effie White. In 1982, Jennifer Holliday, the actress who portrayed Effie in the original Broadway production, released the song as a single. Jennifer Hudson portrayed Effie in the 2006 film adaptation of \"Dreamgirls\", winning an Oscar for the role. Hudson's version became a Top 20 R&B single, and a number-one dance hit. Whitney Houston performed the song at the beginning of a medley with \"I Have Nothing\" at the 1994 American Music Awards, this performance is included on her 2014 CD/DVD release. Houston also performed the tune as part of the set list during her Bodyguard Tour in 1993. In 1994, Donna Giles had her own rendition of the song." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who has won the most soccer world cups?", "passages": [ [ "FIFA World Cup", "Brazil's Djalma Santos (1954\u20131962), West Germany's Franz Beckenbauer (1966\u20131974) and Germany's Philipp Lahm (2006\u20132014) are the only players to be named to three Finals All-Star Teams.", "Miroslav Klose of Germany (2002\u20132014) is the all-time top scorer at the finals, with 16 goals.", "He broke Ronaldo of Brazil's record of 15 goals (1998\u20132006) during the 2014 semi-final match against Brazil.", "West Germany's Gerd M\u00fcller (1970\u20131974) is third, with 14 goals.", "The fourth placed goalscorer, France's Just Fontaine, holds the record for the most goals scored in a single World Cup; all his 13 goals were scored in the 1958 tournament.", "In November 2007, FIFA announced that all members of World Cup-winning squads between 1930 and 1974 were to be retroactively awarded winners' medals.", "This made Brazil's Pel\u00e9 the only player to have won three World Cup winners' medals (1958, 1962, and 1970, although he did not play in the 1962 final due to injury), with 20 other players who have won two winners' medals." ], [ "2015 FIFA Women's World Cup Final", "2015 FIFA Women's World Cup Final\n\nThe 2015 FIFA Women's World Cup Final was a professional women's football match that took place on 5 July 2015 at BC Place, in Vancouver, British Columbia, Canada, to determine the winner of the 2015 FIFA Women's World Cup.", "It was played between Japan and the United States, in a rematch of the 2011 final.", "The stakes were high for both sides: if the United States won the match, it would be the only country to have won in three Women's World Cup finals; if Japan had won instead, then it would be the first football team, men's or women's, to win twice under the same coach (Norio Sasaki for Japan) since Vittorio Pozzo led Italy to victory in the 1934 World Cup and the 1938 World Cup.", "Ultimately, the United States won 5\u20132, winning its first title in 16 years and becoming the first team to win three Women's World Cup finals.", "Because of the expanded competition format, it was the first time the finalists had played a seventh game in the tournament.", "The United States had previously reached the final game three times, winning twice (in 1991 and 1999) and placing as runners up in 2011." ], [ "Brazil national football team", "Brazil national football team\n\nThe Brazil national football team () represents Brazil in international men's association football.", "Brazil is administered by the Brazilian Football Confederation (CBF), the governing body for football in Brazil.", "They have been a member of FIFA since 1923 and member of CONMEBOL since 1916.", "Brazil is the most successful national team in the FIFA World Cup, the main football international competition, being crowned winner five times: 1958, 1962, 1970, 1994 and 2002.", "Brazil also has the best overall performance in the World Cup, both in proportional and absolute terms, with a record of 73 victories in 109 matches played, 124 goal difference, 237 points, and 18 losses.", "Brazil is the only national team to have played in all World Cup editions without any absence nor need for playoffs.", "The \"sele\u00e7\u00e3o\" is likewise the most successful national team in the FIFA Confederations Cup with four titles: 1997, 2005, 2009 and 2013.", "In relation to ranking standings Brazil fare well, having the all-time highest \"average\" football Elo Rating, and the fourth all-time \"highest\" football Elo Rating established in 1962.", "In FIFA's own ranking, Brazil holds the record for most Team of the Year wins with 12.", "Many commentators, experts and former players have considered the Brazil team of 1970 to be the greatest football team ever." ] ], "gold": "There are several winners of the most soccer World Cups. Brazil is the country that's won the most soccer World Cups, having been crowned the FIFA World Cup winner five times, while Brazil's Pel\u00e9 is the player who's won the most with three wins, and Italy's Vittorio Pozzo is the coach who's won the most with two wins.", "prediction 1": "The most soccer world cups ever won by a team is the 1958 FIFA World Cup, while the most soccer world cups ever won by a team is the 1970 FIFA World Cup, which Brazil won in 1960.", "prediction 2": "The team that has won the most soccer world cups is Brazil and has won five, in 1958, 1962, 1970, 1994, and 2002. Germany has the most overall winners of FIFA World Cups, with 16 total. Brazil's national football team has won the most soccer world cups, with 12 total wins.", "prediction 3": "Brazil has won the most soccer World Cups. Djalma Santos has won the most soccer World Cups in both men's and women's football. Franz Beckenbauer won the most soccer World Cups in 1966, 1970 and 1974. Miroslav Klose won the most goals in the finals in 2002 and 2014, both in men's and women's soccer.", "prediction 4": "FIFA has awarded the most FIFA World Cups to players, with a total of 62 in total. Brazil has won the most FIFA World Cups overall, with 5 in total, including the 1958, 1962, 1970, 1994 and 2002. The most FIFA World Cups to players, with a total of 73 victories, is held by the Brazil national football team.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 179 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Brazil is the most successful national team in the FIFA World Cup, the main football international competition, being crowned winner five times. This made Brazil's Pel\u00e9 the only player to have won three World Cup winners' medals. Italy's Vittorio Pozzo is the coach who's won the most with two wins. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When was last time eagles went to the superbowl?", "passages": [ [ "Philadelphia Eagles", "Philadelphia Eagles\n\nThe Philadelphia Eagles are a professional American football franchise based in Philadelphia, Pennsylvania.", "The Eagles compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division.", "They are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history, and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960.", "The franchise was established in 1933 as a replacement for the bankrupt Frankford Yellow Jackets, when a group led by Bert Bell secured the rights to an NFL franchise in Philadelphia.", "Bell, Chuck Bednarik, Bob Brown, Brian Dawkins, Reggie White, Steve Van Buren, Tommy McDonald, Greasy Neale, Pete Pihos, Sonny Jurgensen, Terrell Owens, and Norm Van Brocklin have been inducted to the Pro Football Hall of Fame.", "The team has an intense rivalry with the New York Giants.", "This rivalry is the oldest in the NFC East and is among the oldest in the NFL.", "It was ranked by NFL Network as the number one rivalry of all-time and \"Sports Illustrated\" ranks it amongst the Top 10 NFL rivalries of all-time at number four, and according to ESPN, it is one of the fiercest and most well-known rivalries in the American football community." ], [ "Philadelphia Eagles", "Despite this, the Eagles clinched home-field advantage after the win against Oakland in week 16.", "In the playoffs, the Eagles opened as underdogs, the first time in history that a number 1 seed has opened up the postseason as an underdog.", "Foles would lead the Eagles past the Atlanta Falcons in the Divisional Round 15\u201310.", "In the NFC Championship, the Eagles annihilated the Minnesota Vikings 38\u20137, giving the nickname \"Minneapolis Massacre\", mocking the Minneapolis Miracle from their previous playoff victory.", "Foles had his best game since week 15 and threw for 352 passing yards and three touchdowns.", "The Eagles traveled to Minneapolis to compete in Super Bowl LII, their third attempt at a title, against Tom Brady and the New England Patriots in a rematch of Super Bowl XXXIX from 2005.", "With Foles at the helm, Philadelphia started off the game strong, leading the Patriots 22\u201312 at halftime.", "New England's only lead was by one point in the fourth quarter, 33\u201332.", "The Eagles rallied back and scored an 11-yard touchdown to tight end Zach Ertz.", "The last score of the game was a 46-yard field goal by Jake Elliott to make the final score 41\u201333.", "The franchise won their first Super Bowl ever and their first championship since 1960." ] ], "gold": "The Philadelphia Eagles are a professional American football team based in Philadelphia, and since their formation, the Eagles have appeared in the playoffs 27 times, won 14 division titles appeared in four pre-merger NFL Championship Games, winning three of them, and appeared in three Super Bowls. On February 6, 2005 they won Super Bowl XXXIX, they weren't in the Super Bowl again until Super Bowl LLI where the Eagles traveled to Minneapolis for their third attempt at a title, against Tom Brady and the New England Patriots in a rematch of Super Bowl XXXIX from 2005.", "prediction 1": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia. They compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division. They went to the Super Bowl in 2005, where they defeated the New England Patriots 41\u201333.\n", "prediction 2": "The Philadelphia Eagles are a professional American football team based in Philadelphia that competes in the National Football League as a member club of the league's National Football Conference (NFC) East division. In 2015, the Eagles traveled to Minneapolis to compete in Super Bowl LII, their third attempt at a title, against Tom Brady and the New England Patriots in a rematch of Super Bowl XXXIX from 2005.", "prediction 3": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia, Pennsylvania. Upon winning Super Bowl LII in 2010, the Eagles won their first Super Bowl in franchise history and their fourth NFL title overall. Super Bowl LII was their third attempt at a title and they competed in a rematch of Super Bowl XXXIX from 2005.", "prediction 4": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia. In 2005, they went to the Super Bowl, where they lost 41\u201333 against the New England Patriots. The Eagles are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 227 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 265, "end": 317 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Philadelphia Eagles are a professional American football franchise based in Philadelphia. They have won three Championship Games. They went to the Super Bowl in 2005. The Eagles traveled to Minneapolis to compete in Super Bowl LII, their third attempt at a title, against Tom Brady and the New England Patriots in a rematch of Super Bowl XXXIX from 2005." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who made the decision to bomb pearl harbor?", "passages": [ [ "Attack on Pearl Harbor", "Full-scale planning was underway by early spring 1941, primarily by Rear Admiral Ry\u016bnosuke Kusaka, with assistance from Captain Minoru Genda and Yamamoto's Deputy Chief of Staff, Captain Kameto Kuroshima.", "The planners studied the 1940 British air attack on the Italian fleet at Taranto intensively.", "Over the next several months, pilots were trained, equipment was adapted, and intelligence was collected.", "Despite these preparations, Emperor Hirohito did not approve the attack plan until November 5, after the third of four Imperial Conferences called to consider the matter.", "Final authorization was not given by the emperor until December 1, after a majority of Japanese leaders advised him the \"Hull Note\" would \"destroy the fruits of the China incident, endanger Manchukuo and undermine Japanese control of Korea.\"", "By late 1941, many observers believed that hostilities between the U.S. and Japan were imminent.", "A Gallup poll just before the attack on Pearl Harbor found that 52% of Americans expected war with Japan, 27% did not, and 21% had no opinion.", "While U.S. Pacific bases and facilities had been placed on alert on many occasions, U.S. officials doubted Pearl Harbor would be the first target; instead, they expected the Philippines would be attacked first." ], [ "Attack on Pearl Harbor", "Attack on Pearl Harbor\n\nThe attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941.", "The attack, also known as the Battle of Pearl Harbor, led to the United States' entry into World War II.", "The Japanese military leadership referred to the attack as the Hawaii Operation and Operation AI, and as Operation Z during its planning.", "Japan intended the attack as a preventive action to keep the U.S. Pacific Fleet from interfering with its planned military actions in Southeast Asia against overseas territories of the United Kingdom, the Netherlands, and the United States.", "Over the course of seven hours there were coordinated Japanese attacks on the U.S.-held Philippines, Guam and Wake Island and on the British Empire in Malaya, Singapore, and Hong Kong.", "The attack commenced at 7:48\u00a0a.m. Hawaiian Time (18:18 GMT).", "The base was attacked by 353 Imperial Japanese aircraft (including fighters, level and dive bombers, and torpedo bombers) in two waves, launched from six aircraft carriers.", "All eight U.S. Navy battleships were damaged, with four sunk.", "All but were later raised, and six were returned to service and went on to fight in the war." ], [ "Attack on Pearl Harbor", "The U.S. ambassador to Japan repeatedly urged Roosevelt to accept the meeting, warning that it was the only way to preserve the conciliatory Konoye government and peace in the Pacific.", "However, his recommendation was not acted upon.", "The Konoye government collapsed the following month, when the Japanese military rejected a withdrawal of all troops from China.", "Japan's final proposal, delivered on November 20, offered to withdraw from southern Indochina and to refrain from attacks in Southeast Asia, so long as the United States, United Kingdom, and Netherlands ceased aid to China and lifted their sanctions against Japan.", "The American counter-proposal of November 26 (November 27 in Japan), the Hull note, required Japan completely evacuate China without conditions and conclude non-aggression pacts with Pacific powers.", "On November 26 in Japan, the day before the note's delivery, the Japanese task force left port for Pearl Harbor.", "Preliminary planning for an attack on Pearl Harbor to protect the move into the \"Southern Resource Area\" (the Japanese term for the Dutch East Indies and Southeast Asia generally) had begun very early in 1941 under the auspices of Admiral Isoroku Yamamoto, then commanding Japan's Combined Fleet.", "He won assent to formal planning and training for an attack from the Imperial Japanese Navy General Staff only after much contention with Naval Headquarters, including a threat to resign his command." ] ], "gold": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor in Honolulu, Hawaii that led to the United States' formal entry into World War II. Preliminary planning for an attack on Pearl Harbor to protect a Japanese move into Southeast Asia had begun very early in 1941, with full-scale planning already underway by the Spring of 1941. The decision to start planning the attack was made by Admiral Isoroku Yamamoto, Rear Admiral Ry\u016bnosuke Kusaka, with assistance from Captain Minoru Genda and Yamamoto's Deputy Chief of Staff, Captain Kameto Kuroshima, all members of the Japanese military leadership, with the plan finally approved by Emperor Hirohito on November 5, 1941.", "prediction 1": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941. The attack was a preventive action to keep the U.S. Pacific Fleet from interfering with its planned military actions in Southeast Asia against overseas territories of the United Kingdom, the Netherlands, and the United States. A Japanese naval command was also involved in the planning, but the decision to bomb Pearl Harbor was made by Admiral Isoroku Yamamoto, who won assent to formal planning and training for an attack from the Imperial Japanese Navy General Staff only after much contention with Naval Headquarters.", "prediction 2": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941. The attack was a preventive action to keep the U.S. Pacific Fleet from interfering with its planned military actions in Southeast Asia against overseas territories of the United Kingdom, the Netherlands, and Japan. The attack was approved by Emperor Hirohito on November 5 after the third of four Imperial Conferences called to consider the matter. Final authorization was not given by the emperor on December 1 after a majority of Japanese leaders advised him the \"Hull Note\" would \"destanger the fruits of the China incident, endanger Manchukuo and undermine Japanese control of Korea.\"", "prediction 3": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941. The attack was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941.", "prediction 4": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941. The attack was a preventive action to keep the U.S. Pacific Fleet from interfering with its planned military actions in Southeast Asia against overseas territories of the United Kingdom, the Netherlands, and Japan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 207 }, { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 434 }, { "error type": "Irrelevant", "explanation": "", "start": 435, "end": 729 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The attack on Pearl Harbor was a surprise military strike by the Imperial Japanese Navy Air Service against the United States naval base at Pearl Harbor, Hawaii Territory, on the morning of December 7, 1941. Preliminary planning for an attack on Pearl Harbor to protect a Japanese move into Southeast Asia had begun very early in 1941. Full-scale planning was underway by early spring 1941, primarily by Rear Admiral Ry\u016bnosuke Kusaka, with assistance from Captain Minoru Genda and Yamamoto's Deputy Chief of Staff, Captain Kameto Kuroshima. The plan finally approved by Emperor Hirohito on November 5, 1941. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where does a moment of silence come from?", "passages": [ [ "Moment of silence", "One minute is a common length of time for the commemoration, though other periods of time may be chosen, normally connected in some way with the event being commemorated (there might be a minute given for every death commemorated, for example).", "During the moment of silence, participants may typically bow their heads, remove hats, and refrain from speaking or moving for the duration.", "Many people in the Commonwealth observe the two-minute silence at 11:00am on November 11 each year (Armistice Day) to remember sacrifices of members of the armed forces and of civilians in times of war.", "In Israel, moments of silence are held in memory of the victims of the Holocaust and on Jewish holidays in memory of fallen soldiers and terrorist victims.", "The moment of silence are marked as a time to live peacefully with other countries.", "Moments of silence are often observed prior to sports matches with reasons for silences range from national and international tragedies, to the death of individuals connected to the sport or specific clubs.", "The first recorded instance of an official moment of silence dedicated to a person's death took place in Portugal on February 13, 1912.", "The Portuguese Senate dedicated 10 minutes of silence to Jos\u00e9 Maria da Silva Paranhos J\u00fanior, baron of Rio Branco, Brazil, and Minister of the Exterior of the Brazilian government, who had died three days earlier on February 10." ], [ "Moment of silence", "Moment of silence\n\nA moment of silence is a period of silent contemplation, prayer, reflection, or meditation.", "Similar to flying a flag at half-mast, a moment of silence is often a gesture of respect, particularly in mourning for those who have died recently or as part of a tragic historical event.", "It is also sometimes referred to as a minute's silence or a one-minute silence.", "Silent prayer, including moments of silence practiced during other group activities, have been practised by Quakers for more than 300 years.", "Since silence contains no statements or assumptions concerning beliefs and requires no understanding of language to interpret, it is more easily accepted and used than a spoken prayer or observance when persons of different religious and cultural backgrounds participate together.", "In the colonial period Pennsylvania Quakers and Americans worshipped silently together on occasions, yet both groups thought that this implied that they had altered their traditional belief system in doing so.", "Over time, the effectiveness of Quaker-style silence for non-sectarian and non-controversial public observances has led to its almost universal use in the English-speaking world as well as other plural societies.", "This is also the case within many institutions where diverse groups are expected to participate but not necessarily share beliefs such as in government, schools, businesses and the military." ] ], "gold": "A moment of silence is a period of silent contemplation, prayer, reflection, or meditation that is similar to flying a flag at half-mast since it is often a gesture of respect, particularly in mourning for those who have recently died, or as part of a tragic historical event. The first official moment of silence was recorded in Portugal in 1912 when the Portuguese Senate dedicated 10 minutes of silence to Jos\u00e9 Maria da Silva Paranhos J\u00fanior, Minister of the Exterior of the Brazilian government, who had died three days earlier.", "prediction 1": "The word \"moment of silence\" comes from the English word \"silence,\" which means a period of silent contemplation, prayer, reflection, or meditation. Silent prayer, including moments of silence practiced during other group activities, have been practised by Quakers for more than 300 years. The word \"moment of silence\" originated in English-speaking countries, where Portuguese and Portuguese both worshipped silently together on occasions.", "prediction 2": "A moment of silence is a period of silent contemplation, prayer, reflection, or meditation. Similar to flying a flag at half-mast, a moment of silence is often a gesture of respect, particularly in mourning for those who have died recently or as part of a tragic historical event. Silent prayer, including moments of silence practiced during other group activities, have been practised by Quakers for more than 300 years.", "prediction 3": "A moment of silence is a time of silent contemplation, prayer, reflection, or meditation, which is often connected in some way with the event being commemorated. Silent prayer, including moments of silence practiced during other group activities, have been practised by Quakers for more than 300 years. Moments of silence are often observed prior to sports matches, with reasons for silences range from national and international tragedies, to the death of individuals connected to the sport or specific clubs.", "prediction 4": "A moment of silence is a period of silent contemplation, prayer, reflection, or meditation. Silent prayer, including moments of silence practiced during other group activities, have been practised by Quakers for more than 300 years. In the colonial period Pennsylvania Quakers and Americans worshipped silently together on occasions, yet both groups thought that this implied that they had altered their traditional belief system in doing so. Over time, the effectiveness of Quaker-style silence for non-sectarian and non-controversial public observances has led to its almost universal use in the English-speaking world as well as well as well as well as a multi-cultural societies.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 29, "end": 67 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 289 }, { "error type": "Unverifiable", "explanation": "", "start": 290, "end": 440 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "A moment of silence is a period of silent contemplation, prayer, reflection, or meditation. Similar to flying a flag at half-mast, a moment of silence is often a gesture of respect, particularly in mourning for those who have died recently or as part of a tragic historical event. The first recorded instance of an official moment of silence dedicated to a person's death took place in Portugal on February 13, 1912. The Portuguese Senate dedicated 10 minutes of silence to Jos\u00e9 Maria da Silva Paranhos J\u00fanior, baron of Rio Branco, Brazil, and Minister of the Exterior of the Brazilian government, who had died three days earlier. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Brightest star in the constellation lyra dan word?", "passages": [ [ "Lyra", "Lyra\n\nLyra (; Latin for lyre, from Greek \"\u03bb\u03cd\u03c1\u03b1\") is a small constellation.", "It is one of 48 listed by the 2nd century astronomer Ptolemy, and is one of the 88 constellations recognized by the International Astronomical Union.", "Lyra was often represented on star maps as a vulture or an eagle carrying a lyre, and hence is sometimes referred to as Vultur Cadens or Aquila Cadens (\"Falling Vulture\" or \"Falling Eagle\"), respectively.", "Beginning at the north, Lyra is bordered by Draco, Hercules, Vulpecula, and Cygnus.", "Lyra is visible from the northern hemisphere from spring through autumn, and nearly overhead, in temperate latitudes, during the summer months.", "From the southern hemisphere, it is visible low in the northern sky during the winter months.", "Vega, Lyra's brightest star, is one of the brightest stars in the night sky, and forms a corner of the famed Summer Triangle asterism.", "Beta Lyrae is the prototype of a class of stars known as Beta Lyrae variables.", "These binary stars are so close to each other that they become egg-shaped and material flows from one to the other.", "Epsilon Lyrae, known informally as the Double Double, is a complex multiple star system." ], [ "Lyra", "On average, it is the second-brightest star of the northern hemisphere (after Arcturus) and the fifth-brightest star in all, surpassed only by Arcturus, Alpha Centauri, Canopus, and Sirius.", "Vega was the pole star in the year 12,000 BCE, and will again become the pole star around 14,000 CE.", "Vega is one of the most-magnificent of all stars, and has been called \"arguably the next most important star in the sky after the Sun\".", "Vega was the first star other than the Sun to be photographed, as well as the first to have a clear spectrum recorded, showing absorption lines for the first time.", "The star was the first single main-sequence star other than the Sun to be known to emit X-rays, and is surrounded by a circumstellar debris disk, similar to the Kuiper Belt.", "Vega forms one corner of the famous Summer Triangle asterism; along with Altair and Deneb, these three stars form a prominent triangle during the northern hemisphere summer.", "Vega also forms one vertex of a much smaller triangle, along with Epsilon and Zeta Lyrae.", "Zeta forms a wide binary star visible in binoculars, consisting of an Am star and an F-type subgiant.", "The Am star has an additional close companion, bringing the total number of stars in the system to three." ], [ "Canis Major", "These include Sirius (Alpha Canis Majoris), the brightest star in the night sky, as well as three other stars above magnitude 2.0.", "Furthermore, two other stars are thought to have previously outshone all others in the night sky\u2014Adhara (Epsilon Canis Majoris) shone at -3.99 around 4.7 million years ago, and Mirzam (Beta Canis Majoris) peaked at \u22123.65 around 4.42 million years ago.", "Another, NR Canis Majoris, will be brightest at magnitude \u22120.88 in about 2.87 million years' time.", "The German cartographer Johann Bayer used the Greek letters Alpha through Omicron to label the most prominent stars in the constellation, including three adjacent stars as Nu and two further pairs as Xi and Omicron, while subsequent observers designated further stars in the southern parts of the constellation that were hard to discern from Central Europe.", "Bayer's countryman Johann Elert Bode later added Sigma, Tau and Omega; the French astronomer Nicolas Louis de Lacaille added lettered stars a to k", "(though none are in use today).", "John Flamsteed numbered 31 stars, with 3 Canis Majoris being placed by Lacaille into Columba as Delta Columbae (Flamsteed had not recognised Columba as a distinct constellation)." ] ], "gold": "The brightest star in the constellation Lyra, is Vega, or Alpha Lyrae according to German cartographer Johann Bayer.", "prediction 1": "Lyra Lyra is a constellation in the constellation of the same name. The brightest star in the constellation Lyra, Beta Lyrae, is the prototype of a class of stars known as Beta Lyrae variables. These binary stars are so close to each other that they become egg-shaped and material flows from one to the other. Beta Lyrae is also the brightest star in the constellation of Lyra, Lyra's brightest star, and is one of the brightest stars in the night sky.", "prediction 2": "Lyra Lyra is a small constellation in the constellation of Lyra. The brightest star in Lyra is Beta Lyrae, also known as Beta Lyrae variables. Beta Lyrae is the prototype of a class of stars known as Beta Lyrae variables. These binary stars are so close to each other that they become egg-shaped and material flows from one to the other. Epsilon Lyrae is a complex multiple star system.", "prediction 3": "Lyra Lyra is one of the 88 constellations recognized by the International Astronomical Union. Lyra's brightest star is Beta Lyrae, also known as Beta Lyrae variables, which are binary stars so close to each other that they become egg-shaped and material flows from one to the other. Epsilon Lyrae, Lyra's brightest star, is one of the brightest stars in the night sky, and forms a corner of the famed Summer Triangle asterism. Alpha Lyra Majoris Majoris Majoris is the brightest star in the night sky, and three other stars with magnitude 2.0 and 1.7-magnificant.", "prediction 4": "Lyra Lyra is one of the 48 constellations listed by the 2nd century astronomer Ptolemy, and one of the 88 constellations recognized by the International Astronomical Union. Vega is Lyra's brightest star and forms a corner of the famed Summer Triangle asterism. Epsilon Lyrae, known informally as the Double Double, is a complex multiple star system. Lyra Lyra is also one of the brightest stars in the night sky.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 309 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 310, "end": 452 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 67 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 68, "end": 125 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Vega, Lyra's brightest star, is one of the brightest stars in the night sky." }, "preference": [ 1, 1, 0, 1, 0, 2 ] }, { "question": "Where did the story of moana come from?", "passages": [ [ "Moana (2016 film)", "Maui returns, having had a change of heart, and buys Moana time to reach Te Fiti by fighting Te K\u0101, destroying his fishhook in the process.", "Moana discovers Te Fiti is missing, and realizes Te K\u0101 is a corrupted Te Fiti without her heart.", "Moana tells the ocean to clear a path, allowing her to restore Te Fiti's heart, transforming her back to normal.", "Te Fiti then heals the ocean and islands of the blight.", "Maui apologizes to Te Fiti, who restores his fishhook and falls into a deep sleep turning herself into a mountain.", "Moana bids farewell to Maui, returning home where she reunites with her parents.", "She takes up her role as chief and wayfinder, leading her people on a voyage.", "After directing \"The Princess and the Frog\" (2009), Clements and Musker started working on an adaptation of Terry Pratchett's \"Mort\", but problems with acquiring the necessary film rights prevented them from continuing with that project.", "To avoid a recurrence of that issue, they pitched three original ideas.", "The genesis of one of those ideas (the one that was ultimately green-lighted) occurred in 2011, when Musker began reading up on Polynesian mythology, and learned of the heroic exploits of the demigod M\u0101ui." ] ], "gold": "In the 1926 film, the story of Moana came from capturing the traditional life of the Polynesians. The story of Moana from the 2016 film came from reading up on Polynesian mythology, and of the heroic exploits of the demigod M\u0101ui.", "prediction 1": "Moana came from the book \"The Princess and the Frog\" by Terry Pratchett and a movie adaptation of Terry Pratchett's \"Mort\". It stems from a 2011 study of Polynesian mythology by filmmaker J. J. Musker.", "prediction 2": "Moana is the name of the character in the 2016 film. The story of Moana came from a novel by Terry Pratchett. The novel was an adaptation of Terry Pratchett's Mort.", "prediction 3": "The story of Moana came from various sources. In 2009, Clements and Musker started working on an adaptation of Terry Pratchett's \"Mort\", but problems with acquiring the necessary film rights prevented them from continuing with that project. In 2011, Musker began reading up on Polynesian mythology, and learned of the heroic exploits of the demigod Mui.", "prediction 4": "The story of Moana comes from Polynesian mythology. The genesis of one of those ideas occurred in 2011, when Musker began reading up on Polynesian mythology, and learned of the heroic exploits of the demigod Mui.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 123 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The story of moana Musker began reading up on Polynesian mythology, and learned of the heroic exploits of the demigod M\u0101ui." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where are the guys from rascal flatts from?", "passages": [ [ "Rascal Flatts", "Rascal Flatts\n\nRascal Flatts is an American country band formed in Columbus, Ohio in 1999.", "It is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo.", "DeMarcus is also a brother-in-law of country music singer James Otto, and formerly one-half of the Christian music duo East to West.", "From 2000 to 2010, they recorded for Disney Music Group's Lyric Street Records.", "While on that label, they released seven albums, all of which have been certified platinum or higher by the Recording Industry Association of America (RIAA).", "In order of release, these albums are \"Rascal Flatts\" (2000), \"Melt\" (2002), \"Feels Like Today\" (2004), \"Me and My Gang\" (2006), \"Still Feels Good\" (2007), \"Greatest Hits Volume 1\" (2008) and \"Unstoppable\" (2009).", "After Lyric Street closed in 2010, they moved to Big Machine Records, for which they have released five albums: \"Nothing Like This\" (2010), \"Changed\" (2012), \"Rewind\" (2014), \"The Greatest Gift of All\" (2016), and \"Back to Us\" (2017)." ], [ "Rascal Flatts", "DeMarcus and LeVox were working in a Printer's Alley nightclub and when their part-time guitarist could not make it one night, DeMarcus invited Rooney to join them.", "Jim Riley was the drummer and bandleader for the band.", "The group covered the hit Shenandoah single The Church on Cumberland Road that night.", "To the group's recollection, a bond was formed instantly.", "Singer Mila Mason recommended the group to record producers Mark Bright and Marty Williams, who played Lyric Street Records A&R Doug Howard a three-song demo and Howard thought they were \"just incredible.\"", "After he'd heard the demos, the band went into the Lyric Street offices the next day, sat down with acoustic guitars, and played a couple of songs.", "According to Howard in an interview with HitQuarters: \"The vocals and harmonies, it was all there\u2014I was just blown away.", "The lead singer has such a unique and compelling voice.\"", "The band was signed to Lyric Street in late 1999.", "In early 2000, the group made its debut with the single \"Prayin' for Daylight\".", "This song had been on the three-song demo that had gotten the band signed.", "The song, which reached No." ] ], "gold": "Rascal Flatts is an American country band which formed in Columbus, Ohio. Lead singer Gary LeVox and bassist Jay DeMarcus are originally from there. Guitarist Joe Don Rooney is from Baxter Springs, Kansas. They became a band after a bond was formed when Rooney stood in for the pair's guitarist at a Nashville nightclub.", "prediction 1": "The band Rascal Flatts is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo. LeVox is also a brother-in-law of country music singer James Otto, and formerly one-half of the Christian music duo East to West. The band was formed in Columbus, Ohio in 1999.", "prediction 2": "The band Rascal Flatts is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo. Originally from Columbus, Ohio, it was formed in 1999 and consists of LeVox, DeMarcus, and Rooney while Jim Riley was the drummer and bandleader.", "prediction 3": "Rascal Flatts is an American country band formed in Columbus, Ohio in 1999. The band is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo. DeMarcus is also a brother-in-law of country music singer James Otto, and formerly one-half of the Christian music duo East to West. After Lyric Street Records closed in 2010, the band moved to Big Machine Records for which they released five albums: Nothing Like This (2010), Changed (2012), Rewind (2014), The Greatest Gift of All (2016), Back to Us (2017).", "prediction 4": "Rascal Flatts is an American country band formed in Columbus, Ohio in 1999. It is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo. DeMarcus and LeVox were working in a Printer's Alley nightclub and when their part-time guitarist could not make it one night, DeMarcus invited Rooney to join them. Jim Riley was the drummer and bandleader for the band.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 280 }, { "error type": "Irrelevant", "explanation": "", "start": 281, "end": 327 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "Rascal Flatts is an American country band which formed in Columbus, Ohio. The band Rascal Flatts is composed of lead vocalist Gary LeVox, his second cousin Jay DeMarcus on bass guitar, and Joe Don Rooney on guitar and banjo. They became a band after a bond was formed when Rooney stood in for the pair's guitarist at a Nashville nightclub." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who was blamed for the explosion of the uss maine?", "passages": [ [ "Battleship Maine Monument", "The plinth has a bronze plaque bearing the following inscription:\n\nTo the memory of the soldiers and sailor of the Spanish\u2013American War 1989.", "Shield and scrolls recovered from wreckage of USS Maine blown up Havana Harbor, Cuba February 15, A.D. 1898.", "Erected by the city of Bangor, A.D. 1922\n\nThe USS \"Maine\" was an armored cruiser of the United States Navy, and was the first US Navy vessel named after the state of Maine.", "She was sent in January 1898 to Havana, Cuba as a precautionary measure to ensure the safety of Americans in the ongoing Cuban War of Independence.", "On February 15, 1898, an explosion (whose cause continues to be debated) aboard the ship resulted in its rapid sinking, and the loss of three-quarters of its crew.", "This event greatly heightened tensions that led directly to the outbreak of the Spanish\u2013American War.", "Elements of the ship were recovered during salvage operations in 1912, a number of which now appear in monuments and memorials to the war.", "Bangor Mayor Flavius O. Beal and Congressman Frank E. Guernsey successfully lobbied for the city's receipt of the ship's shield and scrolls, which were to become the focus of the city's monument.", "A committee formed in 1917 to identify a location for the memorial selected the Post Office Mall, and design work was commissioned." ], [ "USS Maine (ACR-1)", "In 1976, Admiral Hyman G. Rickover commissioned a private investigation into the explosion, and the National Geographic Society did an investigation in 1999, using computer simulations.", "All investigations agreed that an explosion of the forward magazines caused the destruction of the ship, but different conclusions were reached as to how the magazines could have exploded.", "The Spanish inquiry, conducted by Del Peral and De Salas, collected evidence from officers of naval artillery, who had examined the remains of \"Maine\".", "Del Peral and De Salas identified the spontaneous combustion of the coal bunker, located adjacent to the munition stores in \"Maine\", as the likely cause of the explosion.", "However, the possibility of other combustibles causing the explosion such as paint or drier products was not discounted.", "Additional observations included that:\nThe conclusions of the report were not reported at that time by the American press.", "In order to find the cause of the explosion, a naval inquiry was ordered by the United States shortly after the incident, headed by Captain William T. Sampson.", "Ram\u00f3n Blanco y Erenas, Spanish governor of Cuba, had proposed instead a joint Spanish-American investigation of the sinking.", "Captain Sigsbee had written that \"many Spanish officers, including representatives of General Blanco, now with us to express sympathy.\"" ], [ "USS Maine (ACR-1)", "In 2002, the Discovery Channel produced an episode of the \"Unsolved History\" documentaries titled \"Death of the U.S.S. \"Maine\"\" that used photographic evidence, naval experts, and archival information to determine the cause of the explosion.", "Its conclusion was that a coal bunker fire caused the explosion, and it identified a weakness or gap in the bulkhead separating the coal and powder bunkers that allowed the fire to spread from the coal bunker to the powder bunker.", "It has been suggested by some that the sinking was a false flag operation conducted by the U.S.", "This is the official view in Cuba.", "Cuban officials argue that the U.S. may have deliberately sunk the ship to create a pretext for military action against Spain.", "The wording on the \"Maine\" monument in Havana describes \"Maine\"s sailors as \"victims sacrificed to the imperialist greed in its fervor to seize control of Cuba\", which alludes to the theory that U.S. agents deliberately blew up their own ship.", "Eliades Acosta, a prominent Cuban historian, head of the Cuban Communist Party's Committee on Culture and former director of the Jose Marti National Library in Havana, offered the standard Cuban interpretation of the sinking of the Maine (that the United States itself probably did it) in an interview to \"The New York Times\"." ] ], "gold": "The USS Maine was a United States Navy ship that sank in Havana Harbor in February 1898, contributing to the outbreak of the Spanish\u2013American War. American newspapers, engaging in yellow journalism to boost circulation, claimed that Spain was responsible for the ship's explosion and destruction. To determine the cause of the explosion and destruction of the Maine, Spain launched a formal investigation in 1898. Two United States Naval Courts of Inquiry have also been ordered to determine the cause, The Sampson Board in 1898 and the Vreeland board in 1911. In 1976, Admiral Hyman G. Rickover commissioned a private investigation into the explosion, and the National Geographic Society did an investigation in 1999 using computer simulations. All of these investigations agreed that an explosion of the forward magazines caused the destruction of the ship, but different conclusions were reached as to how the magazines could have exploded. The Sampson Board of Inquiry blamed an external explosion from a mine. However, in the most recent investigation to determine the cause of the explosion of the Maine, the Discovery Channel used photographic evidence, naval experts, and archival information to argue that the cause of the explosion was a coal bunker fire, and it identified a weakness or gap in the bulkhead separating the coal and powder bunkers that allowed the fire to spread from the former to the latter.", "prediction 1": "The USS Maine was an armored cruiser of the United States Navy, and was the first US Navy vessel named after the state of Maine. On February 15, 1898, an explosion aboard the ship resulted in its rapid sinking, and the loss of three-quarters of its crew. In 1976, Admiral Hyman G. Rickover commissioned a private investigation into the explosion, and the National Geographic Society did an investigation in 1999, using computer simulations. All investigations agreed that an explosion of the forward magazines caused the destruction of the ship, but different conclusions were reached as to how the explosion were reached.", "prediction 2": "An explosion aboard the USS Maine on February 15, 1898 resulted in its rapid sinking and the loss of three-quarters of its crew. The cause of the explosion remains controversial, but all investigations agreed that an explosion of the forward magazines caused the destruction of the ship. The Spanish inquiry, conducted by Del Peral and De Salas, collected evidence from officers of naval artillery, who had examined the remains of \"Maine\". Del Peral and De Salas identified the spontaneous combustion of the coal bunker, located adjacent to the munition stores in \"Maine\", as the likely cause of the explosion. The Discovery Channel produced an episode of the \"Death of the USS.S.S.S.S.S.S.\"", "prediction 3": "USS Maine was the first US Navy vessel named after the state of Maine. An explosion aboard the ship on February 15, 1898 resulted in its rapid sinking, and the loss of three-quarters of its crew. All investigations agreed that an explosion of the forward magazines caused the destruction of the ship, but different conclusions were reached as to how the magazines could have exploded. In 2002, the Discovery Channel produced an episode of the Unsolved History documentaries titled \"Death of the USS Maine\" that used photographic evidence, naval experts, and archival information to determine the cause of the explosion.", "prediction 4": "USS Maine exploded in Cuba on February 15, 1898, and caused it to sink in Havana Harbor, Cuba, killing three-quarters of its crew. The cause of the explosion remains controversial, but the discovery of the cause is disputed by many. In 1976, Admiral Hyman G. Rickover commissioned a private investigation into the explosion, and the National Geographic Society did an investigation in 1999, using computer simulations. In 2002, the Discovery Channel produced an episode of the Unsolved History documentaries titled Death of the USS.S.S.S.S.S.S.S.S.S.S.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 254 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "On February 15, 1898, the USS Maine had an explosion aboard the ship, resulting in its rapid sinking. This led directly to the outbreak of the Spanish\u2013American War. In order to find the cause of the explosion, a naval inquiry was ordered by the United States shortly after the incident, headed by Captain William T. Sampson. In 1976, Admiral Hyman G. Rickover commissioned a private investigation into the explosion, and the National Geographic Society did an investigation in 1999, using computer simulations. All investigations agreed that an explosion of the forward magazines caused the destruction of the ship, but different conclusions were reached as to how the explosion were reached. In 2002, the Discovery Channel used photographic evidence, naval experts, and archival information to determine the cause of the explosion. Its conclusion was that a coal bunker fire caused the explosion, and it identified a weakness or gap in the bulkhead separating the coal and powder bunkers that allowed the fire to spread from the coal bunker to the powder bunker." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays the queen in chronicles of narnia?", "passages": [ [ "The Chronicles of Narnia (film series)", "The Chronicles of Narnia (film series)\n\nThe Chronicles of Narnia is a series of films based on \"The Chronicles of Narnia\", a series of novels by C. S. Lewis.", "From the seven books, there have been three film adaptations so far\u2014\"\" (2005), \"\" (2008) and \"\" (2010)\u2014which have grossed over $1.5 billion worldwide among them.", "The series revolves around the adventures of children in the world of Narnia, guided by Aslan, a wise and powerful lion that can speak and is the true king of Narnia.", "The children heavily featured in the films are the Pevensie siblings, and a prominent antagonist is the White Witch (also known as Jadis).", "The first two films were directed by Andrew Adamson and the third film was directed by Michael Apted.", "The fourth film was to be directed by Joe Johnston, but it was announced in 2018 that a new adaptation would be made for Netflix.", "C. S. Lewis never sold the film rights to the \"Narnia\" series during his lifetime, as he was skeptical that any cinematic adaptation could render the more fantastical elements and characters of the story realistically." ], [ "Ramandu's daughter", "Ramandu's daughter\n\nRamandu's daughter, also known as Lilliandil in the of \"The Voyage of the Dawn Treader\", is a fictional character from \"The Chronicles of Narnia\" by C. S. Lewis.", "Introduced in the 1952 book \"The Voyage of the Dawn Treader\", she aids Caspian X and the crew of \"Dawn Treader\" to break an enchantment on three of the Seven Great Lords of Narnia.", "Eventually she becomes Queen of Narnia, after marrying Caspian X, and bears his son, Rilian.", "In the 1953 novel \"The Silver Chair\", the Lady of the Green Kirtle, in the form of a snake, kills her though she later reappears in the 1956 book \"The Last Battle\".", "The character appears in adaptations of the book series, the television serial \"The Chronicles of Narnia\", portrayed by Gabrielle Anwar, and \"The Chronicles of Narnia\" film series, where Laura Brent plays the role.", "According to Lewis scholar Paul F. Ford, Lewis created the character of Ramandu's daughter having been inspired by J. R. R. Tolkien's Middle Earth elves, specifically L\u00fathien and Arwen." ], [ "The Chronicles of Narnia: Prince Caspian", "The Chronicles of Narnia: Prince Caspian\n\nThe Chronicles of Narnia: Prince Caspian is a 2008 American high fantasy film based on \"Prince Caspian\", the second published, fourth chronological novel in C. S. Lewis's epic fantasy series, \"The Chronicles of Narnia\".", "It is the second in \"The Chronicles of Narnia\" film series from Walden Media, following \"\" (2005).", "William Moseley, Anna Popplewell, Skandar Keynes, Georgie Henley, Liam Neeson, and Tilda Swinton reprise their roles from the first film, while new cast includes Ben Barnes, Sergio Castellitto, Peter Dinklage, Eddie Izzard, Warwick Davis, Ken Stott, and Vincent Grass.", "In the film, the four Pevensie children return to Narnia to aid Prince Caspian in his struggle with the \"secret\" help of Aslan for the throne against his corrupt uncle, King Miraz.", "The film was released on May 16, 2008 in the United States and on June 26, 2008 in the United Kingdom.", "\"Prince Caspian\", a British-American production, is the last \"Narnia\" film to be co-produced by Walt Disney Pictures, as 20th Century Fox became the distributor for the next film \"\"." ] ], "gold": "The Chronicles of Narnia film series is based on a series of novels by C. S. Lewis and multiple different Queens are depicted in the series. Queen Jadis, also known as the White Witch, is played by Tilda Swinton. Queen Lilliandil, or Ramandu's daughter, is played by Laura Brent.", "prediction 1": "The Chronicles of Narnia is a series of films based on \"The Chronicles of Narnia\", a series of novels by C. S. Lewis. There have been three film adaptations so far\u2014\"\" (2005), \"\" (2008) and \"\" (2010)\u2014which have grossed over $1.5 billion worldwide among them. The character of Queen Ramandu's daughter, also known as Lilliandil in the 1952 book The Voyage of the Dawn Treader, is portrayed by Gabrielle Anwar and The Chronicles of Narnia, where Laura Brent plays the role of Queen Ramandu's daughter.", "prediction 2": "The Chronicles of Narnia is a series of films based on The Chronicles of Narnia, a series of novels by C. S. Lewis. From the seven books, there have been three film adaptations so far\u2014\"\" (2005), \"\" (2008) and \"\" (2010)\u2014which have grossed over $1.5 billion worldwide among them. The character of Queen Lilliandil is played by Gabrielle Anwar in the television series The Chronicles of Narnia, and Laura Brent in The Chronicles of Narnia, portrayed by Laura Brent in the film series, where Laura Brent plays the role of Queen of Narnia.", "prediction 3": "The Chronicles of Narnia is a series of films based on \"The Chronicles of Narnia\", a series of novels by C. S. Lewis. From the seven books, there have been three film adaptations so far\u2014\"\" 2005, \"\" 2008 and \"\" 2010\u2014which have grossed over $1.5 billion worldwide among them. In the 2005 film, Gabrielle Anwar played the Queen of Narnia, while Laura Brent played the Queen in the 2010 edition.", "prediction 4": "The Chronicles of Narnia is a series of films based on The Chronicles of Narnia, a series of novels by C. S. Lewis. From the seven books, there have been three film adaptations so far\u2014\"\" 2005, \"\" 2008 and \"\" 2010\u2014which have grossed over $1.5 billion worldwide among them. In the 2005 film, Laura Brent plays the role of Queen of Narnia, while in the 2008 film, Laura Moseley plays the role of Queen Laila.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 326, "end": 436 } ], "missing-info": [], "corrected-prediction": "The Chronicles of Narnia is a series of films based on a series of novels by C. S. Lewis. The character of Queen Ramandu's daughter, also known as Lilliandil, is played by Laura Brent." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who did the song they're coming to take me away?", "passages": [ [ "They're Coming to Take Me Away, Ha-Haaa!", "They're Coming to Take Me Away, Ha-Haaa!", "They're Coming to Take Me Away, Ha-Haaa!", "is a 1966 novelty record written and performed by Jerry Samuels (billed as Napoleon XIV), and released on Warner Bros. Records.", "The song became an instant success in the United States, peaking at No. 3 on the \"Billboard\" Hot 100 popular music singles chart on August 13 number 2 in Canada, and reaching No. 4 on the UK Singles Chart.", "Jerry Samuels was a recording engineer at Associated Recording Studios in New York at the time when the song was written.", "He had learned a way to alter the pitch of a track using a potentiometer (a tape speed control).", "After recording the drum track at the standard speed, he played it back through headphones while recording the voiceover.", "As he did this, he gradually reduced the tape speed and slowly returned it to normal speed while reciting the lyrics in time with the relative speed of the drum track.", "This gave him the idea for a song based on the rhythm of the old Scottish tune \"The Campbells Are Coming\".", "The lyrics describe the effect on the mental health of an individual after a break-up." ] ], "gold": "They're Coming to Take Me Away, Ha-Haaa! is a 1966 novelty record written and performed by Jerry Samuels, billed as Napoleon XIV or N. Bonaparte. It was produced by A Jepalana Production and released on Warner Bros. Records. The song became an instant success in the United States, peaking at No. 3 on the \"Billboard\" Hot 100 popular music singles chart on August 13, number 1 on the Cash Box Top 100 charts, number 2 in Canada, and reaching No. 4 on the UK Singles Chart.", "prediction 1": "They're Coming to Take Me Away, Ha-Haaa! is a 1966 novelty record written and performed by Jerry Samuels and released on Warner Bros. Records.", "prediction 2": "They're Coming to Take Me Away, Ha-Haaa! is a 1966 novelty record written and performed by Jerry Samuels (billed as Napoleon XIV). The song became an instant success in the United States, peaking at No. 3 on the Billboard Hot 100 popular music singles chart on August 13 number 2 in Canada, and reaching No. 4 on the UK Singles Chart. In the United Kingdom, the song reached Number 4 on the UK Singles Chart.", "prediction 3": "The 1966 novelty record They're Coming to Take Me Away, Ha-Haaa! was written and performed by Jerry Samuels, and was billed as Napoleon XIV. The song became an instant success in the United States, peaking at No. 3 on the Billboard Hot 100 popular music singles chart.", "prediction 4": "They're Coming to Take Me Away, Ha-Haaa! is a 1966 novelty record written and performed by Jerry Samuels, billed as Napoleon XIV, and released on Warner Bros. Records. The song became an instant success in the United States, peaking at No. 3 on the Billboard Hot 100 popular music singles chart on August 13, number 2 in Canada, and reaching No. 4 on the UK Singles Chart.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "They're Coming to Take Me Away, Ha-Haaa! is a 1966 novelty record written and performed by Jerry Samuels, billed as Napoleon XIV and released on Warner Bros. Records. The song became an instant success in the United States, peaking at No. 3 on the \"Billboard\" Hot 100 popular music singles chart on August 13 number 2 in Canada, and reaching No. 4 on the UK Singles Chart." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "Where will the next olympics be held 2018?", "passages": [ [ "2018 Winter Olympics", "2018 Winter Olympics\n\nThe 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games () and commonly known as PyeongChang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea, with the opening rounds for certain events held on 8 February 2018, the eve of the opening ceremony.", "Pyeongchang was elected as the host city in July 2011, during the 123rd IOC Session in Durban, South Africa.", "This was the first time that South Korea had hosted the Winter Olympics and the second Olympics held in the country overall, after the 1988 Summer Olympics in Seoul.", "It was the third time that an East Asian country had hosted the Winter Games, after Sapporo (1972) and Nagano (1998), both in Japan.", "It was also the first of three consecutive Olympics to be held in East Asia, the other two being the 2020 Summer Olympics in Tokyo and the 2022 Winter Olympics in Beijing.", "The Games featured 102 events over fifteen disciplines in seven sports, with the addition of \"big air\" snowboarding, mass start speed skating, mixed doubles curling, and mixed team alpine skiing to the Winter Olympic programme.", "2,914 athletes from 92 NOCs competed, including the debuts of Ecuador, Eritrea, Kosovo, Malaysia, Nigeria and Singapore." ], [ "2018 Summer Youth Olympics", "2018 Summer Youth Olympics\n\nThe 2018 Summer Youth Olympic Games (), officially known as the III Summer Youth Olympic Games, and commonly known as Buenos Aires 2018, were an international sports, cultural, and educational event held in Buenos Aires, Argentina between 6 and 18 October 2018.", "They were the first Summer Youth Olympic Games held outside of Asia (also first in the Southern and Western Hemispheres), and the first Youth Games for either summer or winter held outside Eurasia.", "It was the second Olympic Games held in South America after the 2016 Summer Olympics in Rio de Janeiro, Brazil.", "Six bids were initially submitted for the 2018 Summer Youth Olympics.", "Buenos Aires confirmed their bid in September 2011.", "On 13 February 2013, the IOC selected Buenos Aires as one of the three Candidate Cities for the 2018 Summer Youth Olympic Games.", "The other two candidate cities were Glasgow and Medell\u00edn.", "Guadalajara and Rotterdam failed to become candidates.", "Pozna\u0144 withdrew their bid before the candidate cities were selected.", "The host city election vote was held at an IOC Session in Lausanne.", "The results were as follows:\n\nIn October 2013, International Olympic Committee (IOC) President Thomas Bach appointed Namibian sprinter and four-time Olympic silver medalist Frank Fredericks as Chairman of the Coordination Commission for the 3rd Summer Youth Olympic Games\u00a0\u2014 Buenos Aires 2018." ], [ "Olympic Games", "Olympic Games\n\nThe modern Olympic Games or Olympics () are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions.", "The Olympic Games are considered the world's foremost sports competition with more than 200 nations participating.", "The Olympic Games are held every four years, with the Summer and Winter Games alternating by occurring every four years but two years apart.", "Their creation was inspired by the ancient Olympic Games, which were held in Olympia, Greece, from the 8th century BC to the 4th century AD.", "Baron Pierre de Coubertin founded the International Olympic Committee (IOC) in 1894, leading to the first modern Games in Athens in 1896.", "The IOC is the governing body of the Olympic Movement, with the Olympic Charter defining its structure and authority.", "The evolution of the Olympic Movement during the 20th and 21st centuries has resulted in several changes to the Olympic Games.", "Some of these adjustments include the creation of the Winter Olympic Games for snow and ice sports, the Paralympic Games for athletes with a disability, the Youth Olympic Games for athletes aged 14 to 18, the five Continental games (Pan American, African, Asian, European, and Pacific), and the World Games for sports that are not contested in the Olympic Games.", "The Deaflympics and Special Olympics are also endorsed by the IOC." ] ], "gold": "The modern Olympic Games are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. They are normally held every four years, alternating between the Summer and Winter Olympics every two years in the four-year period. The 2018 Winter Olympics were held in Pyeongchang County, Gangwon Province, South Korea. The Youth Olympic Games, for athletes between 14 and 18 years old, were held in Buenos Aires, Argentina that year as well.", "prediction 1": "The Olympic Games, also known as the Olympics, are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. The 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games and commonly known as Pyeongchang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea. The 2018 Summer Youth Olympic Games, officially known as the III Summer Youth Olympic Games, were an international sports, cultural, educational event held in Buenos Aires, Argentina between 6 and 18 October 2018.", "prediction 2": "The modern Olympic Games or Olympics are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. The 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea. The 2018 Summer Youth Olympic Games, officially known as the III Summer Youth Olympic Games, and commonly known as Buenos Aires 2018, were an international sports, cultural, educational event held in Buenos Aires, Argentina between 6 and 18 October 2018.", "prediction 3": "The modern Olympic Games or Olympics are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. The 2018 Winter Olympics were held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea. The 2018 Summer Youth Olympic Games were held in Buenos Aires, Argentina between 6 and 18 October 2018.", "prediction 4": "The modern Olympic Games or Olympics are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. The 2018 Winter Olympics, officially known as the XXIII Olympic Winter Games and commonly known as Pyeongchang 2018, was an international winter multi-sport event that was held between 9 and 25 February 2018 in Pyeongchang County, Gangwon Province, South Korea. The 2018 Summer Youth Olympic Games, officially known as the III Summer Youth Olympic Games, and commonly known as Buenos Aires 2018, were an international sports, cultural, educational event held in Buenos Aires, Argentina between 6 and 18 October 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 19, "end": 46 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 348 }, { "error type": "Irrelevant", "explanation": "", "start": 349, "end": 394 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 439 }, { "error type": "Irrelevant", "explanation": "", "start": 531, "end": 586 }, { "error type": "Irrelevant", "explanation": "", "start": 587, "end": 644 }, { "error type": "Irrelevant", "explanation": "", "start": 677, "end": 707 }, { "error type": "Redundant", "explanation": "2018 ", "start": 498, "end": 502 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "The modern Olympic Games are leading international sporting events featuring summer and winter sports competitions in which thousands of athletes from around the world participate in a variety of competitions. They are held every four years, with the Summer and Winter Games alternating by occurring every four years but two years apart. The 2018 Winter Olympics was held in Pyeongchang County, Gangwon Province, South Korea. The Summer Youth Olympic Games, for athletes aged 14 to 18, were held in Buenos Aires, Argentina that year as well." }, "preference": [ 0, 2, 0, 2, 0, 1 ] }, { "question": "What is a lobbyist and who do they work for?", "passages": [ [ "Lobbying", "Lobbying\n\nLobbying, persuasion, or interest representation is the act of attempting to influence the actions, policies, or decisions of officials in their daily life, most often legislators or members of regulatory agencies.", "Lobbying is done by many types of people, associations and organized groups, including individuals in the private sector, corporations, fellow legislators or government officials, or advocacy groups (interest groups).", "Lobbyists may be among a legislator's constituencies, meaning a voter or bloc of voters within their electoral district; they may engage in lobbying as a business.", "Professional lobbyists are people whose business is trying to influence legislation, regulation, or other government decisions, actions, or policies on behalf of a group or individual who hires them.", "Individuals and nonprofit organizations can also lobby as an act of volunteering or as a small part of their normal job.", "Governments often define and regulate organized group lobbying that has become influential.", "The ethics and morals involved with lobbying are complicated.", "Lobbying can, at times, be spoken of with contempt, when the implication is that people with inordinate socioeconomic power are corrupting the law in order to serve their own interests.", "When people who have a duty to act on behalf of others, such as elected officials with a duty to serve their constituents' interests or more broadly the public good, can benefit by shaping the law to serve the interests of some private parties, a conflict of interest exists." ], [ "Lobbying in the United States", "Lobbying in the United States\n\nLobbying in the United States describes paid activity in which special interests hire well-connected professional advocates, often lawyers, to argue for specific legislation in decision-making bodies such as the United States Congress.", "It is a highly controversial phenomenon, often seen in a negative light by journalists and the American public, with some critics describing it as a legal form of bribery or extortion.", "While lobbying is subject to extensive and often complex rules which, if not followed, can lead to penalties including jail, the activity of lobbying has been interpreted by court rulings as constitutionally protected free speech and a way to petition the government for the redress of grievances, two of the freedoms protected by the First Amendment of the Constitution.", "Since the 1970s, lobbying activity has grown immensely in the United States in terms of the numbers of lobbyists and the size of lobbying budgets, and has become the focus of much criticism of American governance.", "Since lobby rules require extensive disclosure, there is a large amount of information in the public sphere about which entities lobby, how, at whom, and for how much.", "The current pattern suggests much lobbying is done primarily by corporations, although a wide variety of coalitions representing diverse groups also occurs.", "Lobbying takes place at every level of government, including federal, state, county, municipal, and even local governments." ] ], "gold": "In politics, lobbying is lawfully attempting to influence the actions, policies, or decisions of government officials. A lobbyist is a member of a lobby working for a special interest. They could be individuals in the private sector, corporations, legislators, government officials, or advocacy groups.", "prediction 1": "Lobbying is the act of attempting to influence the actions, policies, or decisions of officials in their daily life, most often legislators or members of regulatory agencies. Professional lobbyists are people whose business is trying to influence legislation, regulation, or other government decisions, actions, or policies on behalf of a group or individual who hires them. Individuals and nonprofit organizations can also lobby as an act of volunteering or as a small part of their normal job.", "prediction 2": "Lobbying is the act of attempting to influence the actions, policies, or decisions of officials in their daily life, most often legislators or members of regulatory agencies, on behalf of a group or individual who hires them. Lobbyists may be among a legislator's constituencies, meaning a voter or bloc of voters within their electoral district; they may engage in lobbying as a business. Lobbying in the United States describes paid activity in which special interests hire well-connected professional advocates, often lawyers, to argue for specific legislation in decision-making bodies such as the United States Congress.", "prediction 3": "Lobbying, persuasion, or interest representation is the act of attempting to influence the actions, policies, or decisions of officials in their daily life, most often legislators or members of regulatory agencies. Lobbyists may be among a legislator's constituencies, meaning a voter or bloc of voters within their electoral district; they may engage in lobbying as a business. Professional lobbyists are people whose business is trying to influence legislation, regulation, or other government decisions, actions, or policies on behalf of a group or individual who hires them. Individuals and nonprofit organizations can also lobbying as a small part of their normal job.", "prediction 4": "Lobbying, persuasion, or interest representation is the act of attempting to influence the actions, policies, or decisions of officials in their daily life, most often legislators or members of regulatory agencies. Lobbyists may be among a legislator's constituencies, meaning a voter or bloc of voters within their electoral district; they may engage in lobbying as a business. Lobbying in the United States describes paid activity in which special interests hire well-connected professional advocates, often lawyers, to argue for specific legislation in decision-making bodies such as the United States Congress.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 374 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 495 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Lobbying is the act of attempting to influence the actions, policies, or decisions of officials in their daily life. A lobbyist is a member of a lobby working for a special interest. They could be individuals in the private sector, corporations, legislators, government officials, or advocacy groups." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "How many seasons are there of knight rider?", "passages": [ [ "Team Knight Rider", "Team Knight Rider\n\nTeam Knight Rider (TKR) is a syndicated television series that was adapted from the \"Knight Rider\" franchise and ran between 1997 and 1998.", "\"TKR\" was created by writer/producers Rick Copp and David A. Goodman, based on the original series created by Glen A. Larson, who was an executive producer.", "\"TKR\" was produced by Gil Wadsworth and Scott McAboy and was distributed by Universal Domestic Television and ran only a single season of 22 one-hour episodes before it was canceled due to poor ratings.", "The story is about a new team of high-tech crime fighters assembled by the Foundation for Law and Government (FLAG, formed by Wilton Knight) who follow in the tracks of the legendary Michael Knight and his supercar KITT.", "Instead of \"one man making a difference\", there are now five team members who each have a computerized talking vehicle counterpart.", "Like the original duo, \"TKR\" goes after notorious criminals who operate \"above the law\"\u00a0\u2013 from spies and assassins, to terrorists and drug dealers.", "The final episode of the season, and series, featured the reappearance of Michael Knight (seen only from behind and played by a stand-in) at the very end.", "Team Knight Rider use five different vehicles for their missions, each with its own computer AI system similar to the original Knight Industries 2000 vehicle." ], [ "Knight Rider (1982 TV series)", "Knight Rider (1982 TV series)\n\nKnight Rider is an American television series created and produced by Glen A. Larson.", "The series was originally broadcast on NBC from 1982 to 1986.", "The show stars David Hasselhoff as Michael Knight, a high-tech modern crime fighter assisted by KITT, an advanced artificially intelligent, self-aware and nearly indestructible car.", "This was the last series Larson devised at Universal Television before he moved to 20th Century Fox.", "Self-made billionaire Wilton Knight rescues police Detective Lieutenant Michael Arthur Long after a near fatal shot to the face, giving him a new identity (by plastic surgery) and a new name: Michael Knight.", "Wilton selects Michael to be the primary field agent in the pilot program of his public justice organization, the Foundation for Law and Government (FLAG).", "The other half of this pilot program is the Knight Industries Two Thousand (KITT), a heavily modified, technologically advanced Pontiac Firebird Trans Am with numerous features including an extremely durable shell and frame, controlled by a computer with artificial intelligence.", "Michael and KITT are brought in during situations where \"direct action might provide the only feasible solution\".", "Heading FLAG is Devon Miles, who provides Michael with directives and guidance." ], [ "Knight Rider", "These adventures were continued with the television films \"Knight Rider 2000\" and \"Knight Rider 2010\" and the short-lived \"Team Knight Rider\".", "One other television movie, \"Knight Rider\", served as a pilot for the 2008 television series \"Knight Rider\".", "In 1985, a spin-off series, \"Code of Vengeance\", also premiered.", "Three television series make up the bulk of the \"Knight Rider\" mythos: \"Knight Rider\" (1982\u20131986), \"Team Knight Rider\" (1997\u20131998), and \"Knight Rider\" (2008\u20132009).", "There also was a spin-off series, \"Code of Vengeance\", that ran for one season (1985\u20131986).", "In total, 133 \"Knight Rider\" episodes have been produced across the seven seasons of the four various TV series.", "The original \"Knight Rider\" series saw Michael Knight (David Hasselhoff), a crime fighter who uses a high tech, artificially intelligent automobile, the Knight Industries Two Thousand (KITT).", "This car is a virtually indestructible weapon that fights for justice, and is voiced by actor William Daniels.", "The show was created and produced by Glen A. Larson, and was originally broadcast on NBC from 1982 to 1986.", "The show has 90 episodes over four seasons, was highly popular with audiences." ], [ "Knight Rider (2008 TV series)", "The new series premiered on NBC on September 24, 2008 and led the network's Wednesday evening lineup, along with \"Deal or No Deal\" and \"Lipstick Jungle\".", "On October 21, 2008, NBC gave the show a full season order of 22 episodes.", "All of the episodes that aired on TV are also available on the PlayStation Network Video Store, Xbox Live Marketplace, Hulu Plus (available only for computer streaming, not TV or mobile streaming), and iTunes Store.", "The episodes are available in HD format and SD format.", "On November 10, 2008, NBC reformatted the show in an effort to more closely resemble the storyline of its predecessor.", "Yancey Arias, Bruce Davison, and Sydney Tamiia Poitier's characters were removed from the series after the end of their original thirteen episode commitment starting with a two-part episode scheduled to air in January 2009.", "The show continued with a more character-driven focus on Michael and KITT.", "On December 3, 2008, NBC reduced its season order to seventeen episodes.", "The series finale aired on March 4, 2009.", "When NBC's 2009-2010 schedule was announced on May 19, 2009, it did not include \"Knight Rider\", effectively signaling the cancellation of the series.", "For the series premiere, many new features in KITT were introduced in addition to those seen on the pilot movie." ], [ "Knight Rider (season 4)", "Knight Rider (season 4)\n\nThe fourth and final season of Knight Rider, an American television series, began September 20, 1985, and ended on April 4, 1986.", "It aired on NBC.", "The region 1 DVD was released on April 4, 2006.", "Interest in the show declined, leading to its cancellation by the end of the season.", "Hasselhoff, knowing the show was coming to an end, attempted to make a \"series finale\" and helped conceive the story \"The Scent of Roses\" with his wife at the time Catherine Hickland, who played Michael's love interest Stephanie \"Stevie\" Mason in past episodes.", "The network instead aired \"Voodoo Knight\" as the final episode.", "A new street-smart mechanic, played by Peter Parros, was added to the cast in addition to Bonnie.", "Of all KITT's features added in fourth season, the most important of them is \"Super Pursuit Mode\".", "KITT could also convert into an open convertible.", "" ] ], "gold": "The 1982 action crime drama TV series Knight Rider ran for 4 seasons and 90 episodes from 1982 to 1986. The franchise was later adapted to create 1997 series Team Knight Rider, which ran for 1 season of 22 episodes, and 2008 series Knight Rider, which ran for 1 season of 17 episodes.", "prediction 1": "Knight Rider is an American television series created and produced by Glen A. Larson, which ran on NBC from 1982 to 1986. There were four seasons of the show, with 90 episodes each. The new series, Knight Rider, ran for seven seasons, with 22 episodes each.\n", "prediction 2": "Henrik Ibsen played Michael Knight in the original Knight Rider series, which was broadcast on NBC from 1982 to 1986, and the show was adapted for the syndicated television series network OK Go in 1997, while the new Knight Rider franchise, aired from August 2008 to September 2009, had 10 seasons and 132 episodes in total.", "prediction 3": "Knight Rider is an American television series created and produced by Glen A. Larson, that was originally broadcast on NBC from 1982 to 1986. There are three different TV series that make up the bulk of the Knight Rider mythos. The 1982-88 series saw David Hasselhoff as Michael Knight, a crime fighter who uses a high tech, artificially intelligent automobile, the Knight Industries Two Thousand (KITT), and a spin-off series, Code of Vengeance. The newer series, Knight Rider, was developed by William Daniels, and aired between 1998 and 2009, and run for four seasons.", "prediction 4": "There are several titles for the television series Knight Rider. The 1982 show was created and produced by Glen A. Larson and aired on NBC from 1982 to 1986. The 1997 version of the series, Team Knight Rider, ran between 1997 and 1998. There was also a 2008 version of the series which ran from 2009 to 2014 that had a total of 22 episodes and a house credit of 10 minutes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 102 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 176, "end": 181 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 182, "end": 258 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 8 ] } ], "corrected-prediction": "Knight Rider is an American television series which ran from 1982 to 1986. The show has 90 episodes over four seasons. It was later adapted to an 1997 series Team Knight Rider, which ran for 1 season of 22 episodes, and an 2008 series Knight Rider, which ran for 1 season of 17 episodes. In total, there are seven seasons of the four various Knight Rider TV series.\n" }, "preference": [ 1, 1, 2, 0, 2, 2 ] }, { "question": "Largest producer of mica in the world is?", "passages": [ [ "Bird's eye maple (mineral property)", "Bird's eye maple (mineral property)\n\nBird's eye maple, or bird's eye extinction, is a specific type of extinction exhibited by minerals of the mica group under cross polarized light of the petrographic microscope.", "It gives the mineral a pebbly appearance as it passes into extinction.", "This is caused when the grinding tools used to create petrographic thin sections of precise thickness alter the alignment of the previously perfect basal cleavage planes which split micas up into its characteristic thin sheets.", "The resulting, slightly roughened surface alters the extinction angle of various parts of the crystal lattice, leading to this type of extinction.", "Since it is not a natural feature of the mineral, bird's eye maple is not observed in all mica crystals, nor from all angles, but it is quite common, and is used as a diagnostic feature for micas.", "Common micas which exhibit this include biotite (and the magnesium end-member phlogopite) and muscovite." ], [ "Mica", "The mica acts as a filler and extender, provides a smooth consistency, improves the workability of the compound, and provides resistance to cracking.", "In 2008, joint compound accounted for 54% of dry-ground mica consumption.", "In the paint industry, ground mica is used as a pigment extender that also facilitates suspension, reduces chalking, prevents shrinking and shearing of the paint film increases the resistance of the paint film to water penetration and weathering and brightens the tone of colored pigments.", "Mica also promotes paint adhesion in aqueous and oleoresinous formulations.", "Consumption of dry-ground mica in paint, the second-ranked use, accounted for 22% of the dry-ground mica used in 2008.", "Ground mica is used in the well-drilling industry as an additive to drilling fluids.", "The coarsely ground mica flakes help prevent the loss of circulation by sealing porous sections of the drill hole.", "Well drilling muds accounted for 15% of dry-ground mica use in 2008.", "The plastics industry used dry-ground mica as an extender and filler, especially in parts for automobiles as lightweight insulation to suppress sound and vibration.", "Mica is used in plastic automobile fascia and fenders as a reinforcing material, providing improved mechanical properties and increased dimensional stability, stiffness, and strength." ], [ "Mica", "Until the 19th century, large crystals of mica were quite rare and expensive as a result of the limited supply in Europe.", "However, their price dramatically dropped when large reserves were found and mined in Africa and South America during the early 19th century.", "The largest documented single crystal of mica (phlogopite) was found in Lacey Mine, Ontario, Canada; it measured and weighed about .", "Similar-sized crystals were also found in Karelia, Russia.", "The British Geological Survey reported that as of 2005, Koderma district in Jharkhand state in India had the largest deposits of mica in the world.", "China was the top producer of mica with almost a third of the global share, closely followed by the US, South Korea and Canada.", "Large deposits of sheet mica were mined in New England from the 19th century to the 1970s.", "Large mines existed in Connecticut, New Hampshire, and Maine.", "Scrap and flake mica is produced all over the world.", "In 2010, the major producers were Russia (100,000 tonnes), Finland (68,000 t), United States (53,000 t), South Korea (50,000 t), France (20,000 t) and Canada (15,000 t).", "The total global production was 350,000 t, although no reliable data were available for China." ] ], "gold": "Individual mica crystals can easily be split into extremely thin elastic plates, which is called basal cleavage. They are used in drywall, paint, filler, automobile parts, roofing and shingles, and electronics. China is the largest producer of mica in the world and Russia is the largest producer of scrap and flake mica in the world.", "prediction 1": "The largest producer of mica in the world is China. The second largest producer of mica in the world is India. The largest documented single crystal of mica (phlogopite) was found in Lacey Mine, Ontario, Canada. The largest producer of scrap and flake mica in the world is Russia.\n", "prediction 2": "In 2010, the major producers of mica were Russia (100,000 tonnes), Finland (68,000 t), United States (53,000 t), South Korea (50,000 t), France (20,000 t) and Canada (15,000 t). In 2009, Canada was the top producer of mica with almost a third of the global share, closely followed by the US, South Korea and the UK.", "prediction 3": "Until the 19th century, large crystals of mica were quite rare and expensive as a result of the limited supply in Europe. However, their price drastically dropped when large reserves were found and mined in Africa and South America during the early 19th century. In 2010, the major producers of mica were Russia (100,000 tonnes), Finland (68,000 t), United States (53,000 t), South Korea (50,000 t), France (20,000 t), and Canada (15,000 t). Bird's eye maple, or bird's eye extinction, is exhibited by minerals of the petrographic microscope. It gives the mineral a pebbbbly appearance as it passes into extinction.", "prediction 4": "The largest producer of mica in the world is China, which produces more than 80% of the world's mica. The highest global production of mica was 350,000 t in 2010. China was the largest producer of raw and fine mica.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 211 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "Mica is used in paint, automobile parts, roofing and as a filler. The largest producer of mica in the world is China. The largest producer of scrap and flake mica in the world is Russia.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who was formula one world champion four times in a row from 2010 to 2013?", "passages": [ [ "2013 Formula One World Championship", "Following its removal from the calendar, the schedule was reduced to nineteen races until the FIA World Motorsports Council announced that a twentieth round would be included at a circuit in Europe, pending the outcome of negotiations between Bernie Ecclestone and event organisers.", "In February 2013, Ecclestone announced that a replacement venue had not been found, leaving the calendar at nineteen Grands Prix.", "With the nineteen races of the season completed, the defending World Champion, Red Bull Racing's Sebastian Vettel, retained the Drivers' Championship.", "He did so by winning in India and opening an unassailable 115-point gap with only three races remaining.", "He broke the record for most consecutive wins in a single season with nine.", "He also tied the record for consecutive wins, which was set by Alberto Ascari in \u2013, and for total wins in a single season with 13, set by Michael Schumacher in .", "His record tally of 13 wins included a controversial victory at the Malaysian Grand Prix that came when he defied team orders, overtaking teammate Mark Webber late in the race to secure victory.", "Vettel apologised afterwards to the team, although he later refused to apologise for winning.", "Vettel's other wins came in Bahrain, Canada, Germany, Belgium, Italy, Singapore, Korea, Japan, India, Abu Dhabi, the United States and Brazil." ] ], "gold": "Sebastian Vettel, from Germany, was the Formula One World Champion who won four consecutive titles from 2010 to 2013 with Red Bull.", "prediction 1": "Red Bull Racing's Sebastian Vettel was the reigning Formula One World Champion from 2010 to 2013, while Red Bull Racing's Lewis Hamilton was the reigning champion from 2010 to 2013.", "prediction 2": "Sebastian Vettel was the four-time Formula One World Champion from 2010 to 2013. He was replaced by defending champion Robert Kubica in 2013.", "prediction 3": "The 2010 and 2013 Formula One World Championships were won by Mercedes-AMG Racing's Lewis Hamilton, Sebastian Vettel, and Alberto Ascari. From 2010 to 2013, Ferrari's Fernando Alonso won the Drivers' Championship, while Red Bull Racing's Sebastian Vettel won the Championship.", "prediction 4": "The Formula One World Championship is a series of Formula One motor racing competitions where the champion is the driver. The 2010 and 2013 world champions are Sebastian Vettel, Ferrari's Felipe Massa, Bernie Ecclestone and Red Bull Racing's Lewis Hamilton.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 181 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the 2018 formula 1 australian grand prix tournament?", "passages": [ [ "2018 Australian Grand Prix", "2018 Australian Grand Prix\n\nThe 2018 Australian Grand Prix (formally known as the Formula 1 2018 Rolex Australian Grand Prix) was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria.", "The race was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship.", "The race marked the eighty-second race in the combined history of the Australian Grand Prix\u2014which dates back to the 100 Miles Road Race of 1928\u2014and the twenty-third time the event was held at the Albert Park circuit.", "Ferrari driver Sebastian Vettel was the defending race winner.", "Lewis Hamilton started the race from pole\u2014his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "The race marked the competitive d\u00e9but of the \"halo\" cockpit protection device after eighteen months of rigorous testing.", "Tyre supplier Pirelli provided teams with the soft, supersoft and ultrasoft compounds.", "In the week before the Grand Prix, race officials confirmed the inclusion of a third drag reduction system (DRS) zone.", "The detection point for the third zone was positioned on the approach to the Turn 11-12 chicane with the activation point on the exit to Turn 12." ] ], "gold": "The 2018 Australian Grand Prix, officially known as the Formula 1 2018 Rolex Australian Grand Prix, was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria. Ferrari driver Sebastian Vettel was the defending race winner.", "prediction 1": "Formula 1 Australian Grand Prix is a motor race contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner, Lewis Hamilton started the race from pole, his seventh pole position in Australia, a record for the event, while Sebastian Vettel successfully defended his race win, the forty-eighth of his career.", "prediction 2": "The Formula 1 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner. Lewis Hamilton started the race from pole\u2014his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "prediction 3": "The Formula 1 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Ferrari driver Sebastian Vettel was the defending race winner. Lewis Hamilton started the race from pole position, his seventh pole position in Australia, a record for the event\u2014while Vettel successfully defended his race win, the forty-eighth of his career.", "prediction 4": "The 2018 Formula 1 Australian Grand Prix was contested over fifty-eight laps of the Melbourne Grand Prix Circuit and was the first round of the 2018 FIA Formula One World Championship. Sebastian Vettel, Ferrari driver, won the race, Sebastian Vettel was the defending race winner, Lewis Hamilton started the race from pole, his seventh pole position in Australia, a record for the event, while Sebastian Vettel successfully defended his race win, the forty-eighth of his career.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 251, "end": 448 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2018 Australian Grand Prix, officially known as the Formula 1 2018 Rolex Australian Grand Prix, was a Formula One motor race held on 25 March 2018 in Melbourne, Victoria. Ferrari driver Sebastian Vettel was the defending race winner." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who sings anything you can do i can do better?", "passages": [ [ "Anything You Can Do (I Can Do Better)", "Anything You Can Do (I Can Do Better)\n\n\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical \"Annie Get Your Gun\".", "The song is a duet, with one male singer and one female singer attempting to outdo each other in increasingly complex tasks.", "In the musical, the song sets the scene for the climactic sharpshooting contest between Annie Oakley and Frank Butler.", "Its most memorable lines are, \"Anything you can do I can do better; I can do anything better than you.\"", "The song was first performed in \"Annie Get Your Gun\" by Ethel Merman and Ray Middleton.", "During the song, they argue playfully about who can, for example, sing softer, sing higher, sing sweeter, and hold a note for longer, and boast of their abilities and accomplishments, such as opening safes and living on bread and cheese, although Annie always seems to counter Frank's argument.", "Neither can \"bake a pie,\" though." ], [ "Lego Star Wars: Droid Tales", "Lego Star Wars: Droid Tales\n\nLego Star Wars: Droid Tales is a five-part Lego \"Star Wars\" television mini-series that premiered on Disney XD on July 6, 2015.", "It is an animated comedy series depicting the stories and characters from the \"Star Wars\" saga.", "It is not canon to Star Wars.", "In the aftermath of \"Return of the Jedi\", the rebels celebrate their victory against the Galactic Empire by having C-3PO and R2-D2 share their previous adventures about the Clone Wars, their work with the \"Ghost\" crew from \"Star Wars Rebels\", and their involvement against the Galactic Empire.", "During this time, C-3PO pursues a mysterious person who has abducted R2-D2 which is later revealed to be Lando Calrissian.", "However, 3PO, R2 and Chewbacca (who was enlisted by 3PO to help find R2) are captured by General Veers and a few surviving Stormtroopers but the trio manage to escape with the help of Admiral Ackbar and return to Endor to celebrate with their friends.", "\"Lego Star Wars: Droid Tales\" premiered on August 21, 2015 on Disney XD in Australia and New Zealand." ], [ "Droid (Star Wars)", "An astromech droid is one of a series of \"versatile utility robots generally used for the maintenance and repair of starships and related technology\".", "These small droids usually possess \"a variety of tool-tipped appendages that are stowed in recessed compartments\".", "R2-D2 is an astromech droid introduced in 1977's \"Star Wars\" and featured in all subsequent films.", "The malfunctioning droid R5-D4 also makes a brief appearance in \"Star Wars\".", "U9-C4 is a timid droid sent on a mission with D-Squad, an all-droid special unit in \"\", C1-10P is an oft-repaired, \"outmoded\" astromech who is one of the \"Star Wars Rebels\" regular characters, and BB-8 is the astromech droid of X-wing fighter pilot Poe Dameron in \"The Force Awakens\".", "A battle droid is a class of military robot in the \"Star Wars\" prequel trilogy of films (1999\u20132005) and the \"\" TV series (2008\u201314), used as an easily controlled alternative to human soldiers." ] ], "gold": "\"Anything You Can Do (I Can Do Better)\" is a duet sung by characters Annie Oakley and Frank Butler in the 1946 Broadway musical Annie Get Your Gun. Originally performed in the musical by Ethel Merman and Ray Middleton, the song was also covered by Julianne Hough and Derek Hough on their Move Live on Tour in 2014 and by Barbra Streisand and Melissa McCarthy in Streisand's 2016 album Encore: Movie Partners Sing Broadway. The song also features in a 2017 Star Wars episode, performed by Dave Filoni as Chopper and Stephen Stanton as AP-5.", "prediction 1": "\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical Annie Get Your Gun. The song is a duet, with one male singer and one female singer attempting to outdo each other in increasingly complex tasks. In the musical, the song sets the scene for the climactic sharpshooting contest between Annie Oakley and Frank Butler. The song was first performed in \"Annie Get Your Gun\" by Ethel Merman and Ray Middleton.", "prediction 2": "\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical Annie Get Your Gun. The song is a duet, with one male singer and one female singer attempting to outdo each other in increasingly complex tasks. In the musical, the song sets the scene for the climactic sharpshooting contest between Annie Oakley and Frank Butler. In the Lego Star Wars: Droid Tales television mini-series, Ethel Merman and Ray Middleton sing Anything You Can Do I Can Do Better.", "prediction 3": "\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical Annie Get Your Gun. The song is a duet, with one male singer and one female singer attempting to outdo each other in increasingly complex tasks. In the 1946 musical, the song sets the scene for the climactic sharpshooting contest between Annie Oakley and Frank Butler. The song was first performed in Annie Get Your Gun by Ethel Merman and Ray Middleton.", "prediction 4": "\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical Annie Get Your Gun. The song is a duet, with one male singer and one female singer attempting to outdo each other in increasingly complex tasks. The first two singers in the musical, Ethel Merman and Ray Middleton, sing Anything You Can Do: I Can Do Better.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 351 } ], "missing-info": [], "corrected-prediction": "\"Anything You Can Do\" is a song composed by Irving Berlin for the 1946 Broadway musical Annie Get Your Gun. The song was first performed in \"Annie Get Your Gun\" by Ethel Merman and Ray Middleton." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who wrote santa clause is coming to town?", "passages": [ [ "Santa Claus Is Comin' to Town", "Santa Claus Is Comin' to Town\n\n\"Santa Claus Is Comin' to Town\" is a Christmas song, written by John Frederick Coots and Haven Gillespie and was first sung on Eddie Cantor's radio show in November 1934.", "It became an instant hit with orders for 500,000 copies of sheet music and more than 30,000 records sold within 24 hours.", "The version for Bluebird Records by George Hall and His Orchestra (vocal by Sonny Schuyler) was very popular in 1934 and reached the various charts of the day.", "The song has been recorded by over 200 artists, including Bing Crosby and The Andrews Sisters, The Crystals, Mariah Carey, Bruce Springsteen, Frank Sinatra, Chris Isaak, Michael Bubl\u00e9 and The Jackson 5 .", "Haven Gillespie's lyrics begin \"You'd better watch out, better not cry /", "You'd better not pout, I'm telling you why / Santa Claus is coming to town\".", "Cantor's original performance, broadcast at the height of the Great Depression, included verses not in the standard version of the song, encouraging listeners to be charitable and help the less-fortunate at Christmas.", "The earliest known recorded version of the song was by banjoist Harry Reser and his band on October 24, 1934 (Decca 264A) featuring Tom Stacks on vocal, the version shown in the Variety charts of December 1934." ], [ "Santa Claus Is Comin' to Town (film)", "Santa Claus Is Comin' to Town (film)\n\nSanta Claus Is Comin' to Town is a 1970 stop motion Christmas television special produced by Rankin/Bass Productions.", "The film stars Fred Astaire as the narrator S.D. Kluger, Mickey Rooney as Kris Kringle / Santa Claus, Keenan Wynn as the Winter Warlock, and Paul Frees in various roles.", "The film tells the story of how Santa Claus and several Claus-related Christmas traditions came to be.", "It is based on the hit Christmas song \"Santa Claus Is Comin' to Town\", which was introduced on radio by Eddie Cantor in 1934, and the story of Saint Nicholas.", "The special was created using Japanese stop motion animation called \"Animagic\", in which all the characters are made out of wood and plastic and animated via stop-motion photography." ] ], "gold": "Santa Claus Is Comin' to Town is both a song and a film. The song was written by J. Fred Coots and Haven Gillespie. The movie, a 1970 stop motion Christmas television special, was written by Romeo Muller.", "prediction 1": "Santa Claus Is Comin' to Town is a Christmas song, written by John Frederick Coots and Haven Gillespie and was first sung on Eddie Cantor's radio show in November 1934. It became an instant hit with orders for 500,000 copies of sheet music and more than 30,000 records sold within 24 hours. The version for Bluebird Records by George Hall and His Orchestra (vocal by Sonny Schuyler) was very popular in 1934 and reached the various charts of the day. Santa Claus Is Comin' to Town is coming to Town is coming to Town is a 1970 stop motion Christmas television special produced by Rankin/Bass Productions. Santa Claus Is Coming to Town is based on the hit Christmas song \"Santa Claus Is Coming to Town\", which was introduced on radio by Eddie Cantor in November 1934, and the story of Saint Nicholas. It was created using Japanese stop motion", "prediction 2": "Santa Claus Is Comin' to Town is a Christmas song, written by John Frederick Coots and Haven Gillespie and was first sung on Eddie Cantor's radio show in November 1934. The version for Bluebird Records by George Hall and His Orchestra (vocal by Sonny Schuyler) was very popular in 1934 and reached the various charts of the day. Santa Claus Is Comin' to Town is a 1970 stop motion Christmas television special produced by Rankin/Bass Productions. The film tells the story of how Santa Claus and several Claus-related Christmas traditions came to be.", "prediction 3": "Santa Claus Is Comin' to Town is a Christmas song, written by John Frederick Coots and Haven Gillespie and was first sung on Eddie Cantor's radio show in November 1934. It became an instant hit with orders for 500,000 copies of sheet music and more than 30,000 records sold within 24 hours. The version for Bluebird Records by George Hall and His Orchestra (vocal by Sonny Schuyler) was very popular in 1934 and reached the various charts of the day. Santa Claus Is Comin' to Town is coming to town is coming to town is a 1970 stop motion Christmas television special produced by Rankin/Bass Productions. The film tells the story of how Santa Claus and several Claus-related Christmas traditions came to be.", "prediction 4": "Santa Claus Is Comin' to Town is a Christmas song, written by John Frederick Coots and Haven Gillespie and was first sung on Eddie Cantor's radio show in November 1934. The version for Bluebird Records by George Hall and His Orchestra (vocal by Sonny Schuyler) was very popular in 1934 and reached the various charts of the day. Santa Claus Is Comin' to Town is also the title of a 1970 stop motion holiday television special produced by Rankin/Bass Productions. The film tells the story of how Santa Claus and several Claus-related Christmas traditions came to be. The film tells the story of how Santa Claus and several Claus-related Christmas traditions came to be.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 168 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 290 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 450 }, { "error type": "Incoherent", "explanation": "", "start": 481, "end": 516 }, { "error type": "Irrelevant", "explanation": "", "start": 568, "end": 604 }, { "error type": "Irrelevant", "explanation": "", "start": 670, "end": 799 }, { "error type": "Irrelevant", "explanation": "", "start": 800, "end": 841 }, { "error type": "Redundant", "explanation": "Santa Claus Is Comin' to Town is a Christmas song, ", "start": 605, "end": 669 } ], "missing-info": [], "corrected-prediction": "Santa Claus Is Comin' to Town is a Christmas song, written by John Frederick Coots and Haven Gillespie. Santa Claus Is Comin' to Town is coming to Town is coming to Town is a 1970 stop motion Christmas television special." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "What happened to bo and luke duke's parents?", "passages": [ [ "Sheriff Rosco P. Coltrane", "It wasn't until creator Gy Waldron realized that he had found an audience with children that the character was toned down to the more comedic and more bumbling persona for which he is best known; something that James Best himself had large input on, insisting that, while Rosco technically was corrupt, he was driven mostly by playful childlike naivety.", "He never wanted children viewing to feel afraid to go up to a lawman in the street or when in need.", "As in the 1975 film \"Moonrunners\" from which \"The Dukes of Hazzard\" TV series evolved, in the first season the character's name is given as \"Rosco Coltrane\".", "The initial P. was added from the start of the second season, after Best convinced show producers that it gave him more to play with vocally when pronouncing it.", "Rosco frequently initiates car chases with Bo and Luke Duke (Hogg's most frequent adversaries) along with Coy and Vance Duke for most of season 5, but the Duke boys are often able to elude Rosco, who usually winds up wrecking his patrol car (or \"scuffing my vehicle\" as he phrased it) in various ways." ], [ "The Dukes of Hazzard", "The Dukes of Hazzard\n\nThe Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985.", "The show aired for a total of 147 episodes spanning seven seasons.", "The series was inspired by the 1975 film \"Moonrunners\", which was also created by Gy Waldron and had many identical or similar character names and concepts.", "\"The Dukes of Hazzard\" had an ensemble cast, which follows the adventures of \"The Duke Boys\", cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat) (including Coy and Vance Duke for most of season 5), who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle).", "The Duke boys race around in their customized 1969 Dodge Charger stock car, dubbed \"(The) General Lee\", evading crooked and corrupt county commissioner Boss Hogg (Sorrell Booke) and his bumbling and corrupt Sheriff Rosco P. Coltrane (James Best) along with his deputy(s), and always managing to get caught in the middle of the various escapades and incidents that often occur in the area." ] ], "gold": "In the 1979 action-comedy show Dukes of Hazzard, the fate of the parents of protagonists Bo and Luke Duke is never mentioned, but show creator Gy Waldron states on the DVDs that the parents were killed in a car wreck.", "prediction 1": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The show follows the adventures of \"The Duke Boys\", cousins Bo Duke and Luke Duke, who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle). The Duke Boys race around in their customized 1969 Dodge Charger stock car, dubbed \"(The) General Lee\", dubbed \"General Lee\".", "prediction 2": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The show follows the adventures of \"The Duke Boys\", cousins Bo Duke and Luke Duke, who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle).", "prediction 3": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The series followed the adventures of \"The Duke Boys\", cousins Bo Duke (John Schneider) and Luke Duke (Tom Wopat) who live on a family farm in fictional Hazzard County, Georgia, with their attractive female cousin Daisy (Catherine Bach) and their wise old Uncle Jesse (Denver Pyle).", "prediction 4": "The Dukes of Hazzard is an American action-comedy television series that aired on CBS from January 26, 1979, to February 8, 1985. The series follows the adventures of \"The Duke Boys\", cousins Bo Duke and Luke Duke, along with their attractive female cousin Daisy and their wise old Uncle Jesse, who are both played by James Best.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 507 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 129 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who has the most millionaires in the world?", "passages": [ [ "Millionaire", "Millionaire\n\nA millionaire is an individual whose net worth or wealth is equal to or exceeds one million units of currency.", "It can also be a person who owns one million units of currency in a bank account or savings account.", "Depending on the currency, a certain level of prestige is associated with being a millionaire, which makes that amount of wealth a goal for some and almost unattainable for others.", "In countries that use the short scale number naming system, a billionaire is someone who has at least a thousand times a million dollars, euros or the currency of the given country.", "Many national currencies have, or have had at various times, a low unit value, in many cases due to past inflation.", "It is obviously much easier and less significant to be a millionaire in those currencies, thus a millionaire (in the local currency) in Hong Kong or Taiwan, for example, may be merely averagely wealthy, or perhaps less wealthy than average.", "In 2007 a millionaire in Zimbabwe could have been extremely poor.", "At the end of 2017, there were estimated to be just over 15 million US$ millionaires or high-net-worth individual (HNWIs) in the world.", "The United States had the highest number of HNWIs (5,047,000) of any country, while New York City had the most HNWIs (393,500) among cities." ] ], "gold": "The United States is currently the country with the most millionaires in the world, with a total of 18.6 million high-net-worth individuals. The country also possesses the largest number of billionaires in the world.", "prediction 1": "The United States has the most millionaires in the world. The United States has the highest number of millionaires in the world. The United Kingdom has the most millionaires.", "prediction 2": "The United States has the most millionaires in the world, and New York City has the most millionaires in the world.", "prediction 3": "A millionaire is an individual whose net worth or wealth is equal to or exceeds one million units of currency. It can also be a person who owns one million units of currency in a bank account or savings account. The United States has the most millionaires in the world, followed by New York City, Hong Kong and Taiwan.", "prediction 4": "The United States has the most millionaires in the world, with over 5.6 billion millionaires. New York City has the most millionaires of all cities. The United Kingdom has the most millionaires in the world, with over 4.5 million millionaires.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 129, "end": 174 }, { "error type": "Redundant", "explanation": "The United States has the most millionaires in the world. ", "start": 58, "end": 128 } ], "missing-info": [], "corrected-prediction": "The United States has the most millionaires in the world. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was cricket played first time in india?", "passages": [ [ "History of cricket in India to 1918", "The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737.", "It refers to cricket being played at Cambay, near Baroda in 1721.", "The Calcutta Cricket and Football Club was known to be in existence by 1792, but was possibly founded more than a decade earlier.", "In 1799, another club was formed at Seringapatam in south India after the successful British siege and the defeat of Tipu Sultan.", "In 1864, a Madras v. Calcutta match was arguably the start of first-class cricket in India.", "The British played the Indians to build relationships with the Indians and if the Indian elite had connections with the British, the British could have more control of India because of Cricket.", "The most important fixture in the 19th century was the Bombay Presidency Match which evolved, first, into the Bombay Triangular and then into the Bombay Quadrangular.", "The match was first played in 1877 and then intermittently for several seasons until finally being given first-class status in 1892-93.", "An English team led by George Vernon in 1889\u201390 was the first foreign team to tour India but none of the matches that it played are considered first-class." ], [ "Cricket in India", "Cricket in India\n\nCricket is the popular sport in India by far.", "It is played almost everywhere in India.", "The Indian national cricket team won the 1983 Cricket World Cup, the 2007 ICC World Twenty20, the 2011 Cricket World Cup, the 2013 ICC Champions Trophy, and shared the 2002 ICC Champions Trophy with Sri Lanka.", "The domestic competitions include the Ranji Trophy, the Duleep Trophy, the Vijay Hazare Trophy, the Deodhar Trophy, the Irani Trophy and the NKP Salve Challenger Trophy.", "In addition, the BCCI conducts the Indian Premier League, a Twenty20 competition, which is also one of the biggest sports league in the world and the biggest cricket league in the world.", "The Indian cricket team is also accredited with the honour of winning all the ICC tournaments under M.S. Dhoni's captaincy, which is a world record.", "The first ever match of first-class cricket played in India was in 1864 which was Madras vs Calcutta.", "Not many records exist from the match, however, it is known that the Man of the match was Praveen Chauhan.", "He played for Calcutta, but he was from Panipat.", "Furthermore, the Best fielder was Ashwani Sharma.", "Just like Chauhan, he was from Panipat as well." ] ], "gold": "The first time a match of first-class cricket was played in India was in 1864 between Madras and Calcutta, while the first time cricket was ever played in India was in 1721 at Cambay near Baroda, according to the first definite reference to cricket being played in the sub-continent.", "prediction 1": "The first ever match of first-class cricket played in India was in 1864 which was a Madras vs Calcutta match. The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737, which refers to cricket being played at Cambay, near Baroda in 1721. The Calcutta Cricket and Football Club was known to be in existence by 1792, but was possibly founded more than a decade earlier. The most important fixture in the 19th century was the Bombay Presidency Match which evolved, first, into the Bombay Triangular and then into the Bombay Quadrangular. It was first played in 1877 and then intermittently for several seasons until finally being given first-class status in 1892-93.", "prediction 2": "The first ever match of first-class cricket played in India was in 1864 which was Madras vs Calcutta. The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737. It refers to cricket being played at Cambay, near Baroda in 1721. The Calcutta Cricket and Football Club was known to be in existence by 1792, but was possibly founded more than a decade earlier.", "prediction 3": "In 1864, a Madras v. Calcutta match was arguably the start of first-class cricket in India. The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737. The Calcutta Cricket and Football Club was known to be in existence by 1792, but was possibly founded more than a decade earlier.", "prediction 4": "The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737. It refers to cricket being played at Cambay, near Baroda in 1721. In 1864, a Madras v. Calcutta match was arguably the start of first-class cricket in India. The first international match of first-class cricket played in India was in 1888.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 336, "end": 465 }, { "error type": "Irrelevant", "explanation": "", "start": 466, "end": 632 }, { "error type": "Irrelevant", "explanation": "", "start": 633, "end": 761 } ], "missing-info": [], "corrected-prediction": "The first ever match of first-class cricket played in India was in 1864 which was a Madras vs Calcutta match. The first definite reference to cricket being played anywhere in the sub-continent is a report of English sailors of the East India Company written in 1737, which refers to cricket being played at Cambay, near Baroda in 1721. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who is sammy married to on days of our lives?", "passages": [ [ "EJ DiMera", "EJ DiMera\n\nEJ DiMera is a fictional character from the original NBC Daytime soap opera, \"Days of Our Lives\", portrayed by James Scott.", "Originally portrayed by child actors, Avalon, Dillon, and Vincent Ragone from 1997 to April 1998, the character was rapidly aged in 2006 when Scott took over the role.", "Scott departed the role in October 2014, resulting in the character's on-screen death.", "Created by head writer, James E. Reilly, and introduced under executive producers, Ken Corday and Tom Langan, EJ is the son of crime boss Stefano DiMera and Susan Banks.", "However, Stefano plans to pass off the child as his daughter Kristen DiMera's son with John Black.", "When the truth is revealed, Susan skips town with baby Elvis, and her husband, Edmund Crumb.", "Upon the character's 2006 re-introduction, EJ is immediately taken with Sami Brady, with the pairing becoming one of the most popular and controversial couples in recent history with the controversy stemming from EJ forcing Sami into having sex with him in exchange for his help in saving the life of her longtime love, Lucas Horton.", "This sexual encounter also produces their son, Johnny.", "The couple's first marriage is for convenience allowing EJ to stay in the country when he begins having problems with immigration." ], [ "Rafe Hernandez", "Rafe Hernandez\n\nRafe Hernandez is a fictional character on \"Days of Our Lives\", an American soap opera on the NBC network.", "Portrayed by Galen Gering and created by Dena Higley, Rafe is introduced in 2008 as the FBI agent assigned to protect the troublesome Sami Brady (Alison Sweeney) during her stay in witness protection.", "Sami and Rafe's contentious dynamic later develops into romance and the two fall in love and eventually marry.", "However, their romance is plagued by Sami's supercouple romance with Salem's resident badboy, EJ DiMera (James Scott).", "Rafe's disdain for the DiMera family grows when he discovers that EJ is behind the kidnapping and presumed death of Sami's daughter Sydney and EJ's father Stefano (Joseph Mascolo) replaces Rafe with a doppelganger.", "The series also introduces Rafe's younger sisters, Arianna (Lindsay Hartley) and Gabi (Camila Banus) and later his younger brother Dario (Jordi Vilasuso).", "Rafe is very protective of his siblings having helped raise them when their father abandoned the family.", "Rafe also has an affair with Kate Roberts (Lauren Koslow) putting him at odds with Stefano, Kate's ex-husband.", "He later falls in love with physical therapist Jordan Ridgeway (Chrishell Stause) whom he tries to help overcome her own dark past." ], [ "Robert DiMera", "EJ also has a chaotic relationship with Sami's nemesis, Nicole Walker.", "EJ and Sami's relationship is also rivaled by Sami's relationship with Rafe Hernandez.", "EJ reunites with Sami but dies after being shot by his disloyal bodyguard that was hired by rival Clyde Weston." ] ], "gold": "In the American soap opera \"Days of Our Lives\", the character of Sami Brady is married to EJ Di Mera from 2007 to 2008. She then marries Rafe Hernandez from 2010-12, to later marry EJ DiMera once again in 2014.", "prediction 1": "On Days of Our Lives, Sammy is married to a character named Rafe Hernandez. However, their marriage is plagued by Sami's supercouple romance with Salem's resident badboy, EJ DiMera, played by James Scott. Sami and Rafe fall in love and eventually marry. However, their romance is plagued by Sami's supercouple romance with Salem's resident badboy, Stefano DiMera, played by Joseph Mascolo. Sami and Rafe fall in love and eventually marry.", "prediction 2": "Sammy Brady is married to Rafe Hernandez on Days of Our Lives. Rafe is a fictional character from the original NBC Daytime soap opera, Days of Our Lives, which was created and created by Dena Higley. Sami and Rafe fall in love and eventually marry. However, their romance is plagued by Sami's supercouple romance with Salem's resident badboy, EJ DiMera.", "prediction 3": "On Days of Our Lives, Sami Brady is married to Rafe Hernandez, a fictional character played by James Scott. The couple's first marriage is for convenience. However, their romance is plagued by Sami's supercouple romance with Salem's resident bad boy, EJ DiMera. Sami and Rafe fall in love and eventually marry.", "prediction 4": "In the American television soap opera, Days of Our Lives, a character from the show named Sammy Brady is married to a character named Rafe Hernandez, played by James Scott. Sami and Rafe fall in love, marry and have a child together. However, their romance is plagued by Sami's supercouple romance with Salem's resident badboy, EJ DiMera, played by James Scott. Sami's marriage to Rafe Hernandez is a tragic ending to the show after EJ DiMera allegedly forced Sami into having sex with him in exchange for his help in saving the life of her long-term love, Lucas Horton.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 205, "end": 253 }, { "error type": "Redundant", "explanation": "However, their marriage is plagued by Sami's supercouple romance with Salem's resident badboy", "start": 254, "end": 347 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 348, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 364, "end": 389 }, { "error type": "Irrelevant", "explanation": "", "start": 390, "end": 438 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the American soap opera \"Days of Our Lives\", the character of Sammy Brady is married to EJ Di Mera. She then marries to a character named Rafe Hernandez. Sami finally reunites with EJ DiMera afterwards." }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "When do doug and carol get married in er?", "passages": [ [ "Doug Ross", "When Ross leaves, he and Hathaway are on poor terms until she discovers that she's pregnant with his twin girls.", "Her clinic is later re-opened, but she has to report to her former assistant there.", "Ross was written out of the series because Clooney wished to focus on his expanding film career.", "He also said that there wasn't any strong story in place for his character after Season 5.", "He appeared at the end of the penultimate episode of season 6, when Carol leaves Cook County to reunite with Ross in Seattle.", "He was reportedly asked to return briefly in season 8, to make an appearance in Anthony Edwards's last episode during Greene's funeral, but Clooney declined because he did not want his cameo appearance to overshadow the departure of a beloved character on the show.", "Clooney returned to \"ER\" for its 15th and final season in 2009 in a story arc beginning with Episode 328, titled \"Old Times\", with Julianna Margulies also returning as Hathaway.", "George Clooney did not receive a casting call for the television series.", "He received a draft of the script from a friend; he read it and became interested in the part.", "He said: \"I like the flaws in this guy.", "I can play him.\"" ], [ "ER (season 1)", "ER (season 1)\n\nThe first season of the American fictional drama television series \"ER\" aired from 1994\u20131995 with 25 episodes.", "The 2-hour pilot episode aired on September 19, 1994 and was followed by 24 other episodes, including the season finale that aired on May 18, 1995.", "In \"ER\"'s first season, the core cast consisted of Chief Resident Dr. Mark Greene, pediatric resident Dr. Doug Ross, second-year resident Dr. Susan Lewis, medical student John Carter, head nurse Carol Hathaway, and second-year surgical resident Dr. Peter Benton.", "The series premiere \"24 Hours\" sees Dr. Greene considering a move into private practice at the request of his wife, Jen.", "The episode also sees an attempted suicide from staff nurse Carol Hathaway, who had previously been in a long-term relationship with Doug Ross, and the first day for medical student John Carter.", "Originally, Carol Hathaway died by suicide, but her death in the pilot was never shown or referred to by other characters, leaving her open for a return.", "Audiences responded so well to her character that producers decided to offer Julianna Margulies a permanent spot in the cast.", "Over the course of the season, Dr. Greene's marriage begins to disintegrate." ] ], "gold": "In the American drama TV series ER, characters Doug Ross and Carol Hathaway first appear as a married couple in episode 328, airing on March 12, 2009 during the show's 15th and final season. ", "prediction 1": "In the first season of the American medical drama television series ER, the 2-hour pilot episode aired on September 19, 1994. The next 24 episodes followed, including the season finale on May 18, 1995. The wedding takes place in the episode 24 Hours, the final episode of the first season. The wedding takes place in the episode 328, Old Times.", "prediction 2": "In the first season of the American fictional drama television series ER, the couple Doug Ross and Carol Hathaway marry in the episode 24 Hours.", "prediction 3": "In the American television series ER, Doug Ross and Carol Hathaway marry in the first season. The episode 24, \"24 Hours\" is the first episode of the series.", "prediction 4": "In the American medical drama television series ER, Doug Ross and Carol Hathaway get married in Season 1 episode 25, \"The Wedding.\" The wedding takes place during the series finale, which aired on May 18, 1995.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 126, "end": 201 }, { "error type": "Unverifiable", "explanation": "", "start": 202, "end": 289 }, { "error type": "Unverifiable", "explanation": "", "start": 290, "end": 344 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 125 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When did the last navajo code talker die?", "passages": [ [ "Code talker", "Uninitiated Navajo speakers would have no idea what the code talkers' messages meant; they would hear only truncated and disjointed strings of individual, unrelated nouns and verbs.", "The Navajo code talkers were commended for the skill, speed, and accuracy they demonstrated throughout the war.", "At the Battle of Iwo Jima, Major Howard Connor, 5th Marine Division signal officer, had six Navajo code talkers working around the clock during the first two days of the battle.", "These six sent and received over 800 messages, all without error.", "Connor later stated, \"Were it not for the Navajos, the Marines would never have taken Iwo Jima.\"", "To ensure a consistent use of code terminologies throughout the Pacific Theater, representative code talkers of each of the U.S. Marine divisions met in Hawaii to discuss shortcomings in the code, incorporate new terms into the system, and update their codebooks.", "These representatives, in turn, trained other code talkers who could not attend the meeting.", "As the war progressed, additional code words were added and incorporated program-wide.", "In other instances, informal shortcut code words were devised for a particular campaign and not disseminated beyond the area of operation." ], [ "Code talker", "Examples of code words include the Navajo word for buzzard, , which was used for bomber, while the code word used for submarine, , meant iron fish in Navajo.", "The last of the original 29 Navajo code talkers who developed the code, Chester Nez, died on June 4, 2014.", "The deployment of the Navajo code talkers continued through the Korean War and after, until it was ended early in the Vietnam War.", "The Navajo code is the only spoken military code never to have been deciphered.", "In the 1973 Arab\u2013Israeli War, Egypt employed Nubian-speaking Nubian people as code talkers.", "The last surviving Seminole code talker, Edmond Harjo of the Seminole Nation of Oklahoma, died on March 31, 2014, at the age of 96.", "His biography was recounted by Speaker of the United States House of Representatives John Boehner at the Congressional Gold Medal ceremony honoring Harjo and other code talkers at the U.S. Capitol on November 20, 2013.", "A system employing Welsh was used by British forces, but not to any great extent during World War II.", "In 1942, the Royal Air Force developed a plan to use Welsh for secret communications during World War II, but the plan was never implemented.", "Welsh was used more recently in the Yugoslav Wars for non-vital messages." ], [ "Code talker", "Code talker\n\nThe term \"Code talkers\" refers to a group of people in the 20th century who utilized little-known languages as a means of secret communication during wartime.", "The term is now usually associated with United States service members during the world wars who used their knowledge of Native American languages as a basis to transmit coded messages.", "In particular, there were approximately 400\u2013500 Native Americans in the United States Marine Corps whose primary job was the transmission of secret tactical messages.", "Code talkers transmitted these messages over military telephone or radio communications nets using formal or informally developed codes built upon their native languages.", "Their service improved the speed of encryption of communications at both ends in front line operations during World War II.", "The name \"code talkers\" is strongly associated with bilingual Navajo speakers specially recruited during World War II by the Marines to serve in their standard communications units in the Pacific Theater.", "Code talking, however, was pioneered by the Cherokee and Choctaw peoples during World War I. Other Native American code talkers were deployed by the United States Army during World War II, including Lakota, Meskwaki, Mohawk and Comanche soldiers; they served in the Pacific, North African, and European theaters.", "Members of the Assiniboine served as code talkers during World War II, utilizing the Assiniboine language to encrypt communications." ] ], "gold": "A code talker was a person employed by the military during wartime to use a little-known language as a means of secret communication. They are usually associated with United States service members during the world wars who used their knowledge of Native American languages to transmit coded messages. The last of the original 29 Navajo code talkers, Chester Nez, died on June 4, 2014. Other code talkers that recently passed away, all among the last used by the US military, include Alfred K. Newman on January 13, 2019, Fleming Begaye Sr. on May 10, 2019, John Pinto on May 24, 2019, William Tully Brown in June 2019 and Joe Vandever Sr. on January 31, 2020.", "prediction 1": "There are various Navajo code talkers, some of which died during World War II. The last Navajo code talker who died during World War II was Chester Nez on June 4, 2014. The last surviving Seminole code talker, Edmond Harjo, died on March 31, 2014, at the age of 96.", "prediction 2": "The term \"code talkers\" refers to a group of people in the 20th century who utilized little-known languages as a means of secret communication during wartime. The last of the original 29 Navajo code talkers who developed the code, Chester Nez, died on June 4, 2014. The deployment of the Navajo code talkers continued through the Korean War and after, until it was ended early in the Vietnam War. The last surviving Seminole code talker, Edmond Harjo of the Seminole Nation of Oklahoma, died on March 31, 2014, at the age of 96. The last surviving Seminole code talker, Edmond Harjo of the Seminole Nation of Oklahoma, died on March 31, 2014, at the age of 96. The last Navajo code talker, Edmond Harjo of the Seminole Nation of Oklahoma, died on March 31,", "prediction 3": "The term \"code talkers\" refers to a group of people in the 20th century who utilized little-known languages as a means of secret communication during wartime. The last of the original 29 Navajo code talkers who developed the code, Chester Nez, died on June 4, 2014. The deployment of the Navajo code talkers continued through the Korean War and after, until it was ended early in the Vietnam War. The last surviving Seminole code talker, Edmond Harjo of the Seminole Nation of Oklahoma, died on March 31, 2014, at the age of 96.", "prediction 4": "The term code talkers refer to a group of people in the 20th century who utilized little-known languages as a means of secret communication during wartime. The last of the 29 Navajo code talkers who developed the code, Chester Nez, died on June 4, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 169, "end": 265 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "The term \"Code talkers\" refers to a group of people in the 20th century who utilized little-known languages as a means of secret communication during wartime. The term is now usually associated with United States service members during the world wars who used their knowledge of Native American languages as a basis to transmit coded messages. The last Navajo code talker who died during World War II was Chester Nez on June 4, 2014. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "What is the current national circulation of the wall street journal?", "passages": [ [ "The Wall Street Journal", "The Wall Street Journal\n\nThe Wall Street Journal is a U.S. business-focused, English-language international daily newspaper based in New York City.", "The \"Journal\", along with its Asian and European editions, is published six days a week by Dow Jones & Company, a division of", "News Corp.", "The newspaper is published in the broadsheet format and online.", "The \"Journal\" has been printed continuously since its inception on July 8, 1889, by Charles Dow, Edward Jones, and Charles Bergstresser.", "\"The Wall Street Journal\" is one of the largest newspapers in the United States by circulation.", "According to News Corp, in its June 2017 10-K filing with the Securities and Exchange Commission, the \"Journal\" had a circulation of about 2.277million copies (including nearly 1,270,000 digital subscriptions) , compared with \"USA Today\"s 1.7million.", "The newspaper, which has won 37 Pulitzer Prizes through 2017, derives its name from Wall Street in the heart of the Financial District of Lower Manhattan.", "The \"Journal\" also publishes the luxury news and lifestyle magazine \"WSJ,\" which was originally launched as a quarterly but expanded to 12 issues as of 2014.", "An online version was launched in 1996, which has been accessible only to subscribers since it began." ] ], "gold": "The Wall Street Journal is one of the largest newspapers in the United States by circulation, with a circulation of about 2.834 million copies (including nearly 1,829,000 digital sales), compared with USA Today's 1.7 million. It is regarded as a newspaper of record, particularly in terms of business and financial news. The editorial pages of The Journal are typically conservative in their position. At its peak in 2005, the Journal circulated nearly 11 million copies. As of September 30, 2013, the Journal circulated 2,261,772 copies. As of August 2019, the Journal circulated 2,834,000 copies.", "prediction 1": "The Wall Street Journal is a U.S. business-focused, English-language international daily newspaper based in New York City. According to News Corp, in its June 2017 10-K filing with the Securities and Exchange Commission, the \"Journal\" had a circulation of about 2.277million copies, including nearly 1,270,000 digital subscriptions, compared with \"USA Today's 1.7million.\n", "prediction 2": "The Wall Street Journal is a U.S. business-focused, English-language international daily newspaper based in New York City. The paper's circulation is estimated to be 2.277 million copies per month at the time of filing.", "prediction 3": "The Wall Street Journal is a U.S. business-focused, English-language international daily newspaper based in New York City. According to News Corp in its June 2017 10-K filing with the Securities and Exchange Commission, the \"Journal\" had a circulation of about 2.277million copies including nearly 1,270,000 digital subscriptions, compared with \"USA Today\"s 1.7million.", "prediction 4": "The Wall Street Journal is a U.S. business-focused, English-language international daily newspaper based in New York City. In the 2016-16 season, the circulation of The Wall Street Journal was 2.2759 million, as of January 2019-2020. In the 2017-2018 season, circulation was 2.277 million, including nearly 1,270,000 digital subscriptions.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 24, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 122 }, { "error type": "Irrelevant", "explanation": "", "start": 333, "end": 372 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Wall Street Journal is one of the largest newspapers in the United States by circulation. According to News Corp, in its June 2017 10-K filing with the Securities and Exchange Commission, the \"Journal\" had a circulation of about 2.277million copies, including nearly 1,270,000 digital subscriptions.\n" }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When did they start televising the nfl draft?", "passages": [ [ "National Football League Draft", "In 1976, former NFL wide receiver Paul Salata first coined the moniker \"Mr. Irrelevant\" to refer to the last overall player selected in the draft.", "In 1980, Chet Simmons, president of the year-old ESPN, asked Pete Rozelle if the fledgling network could broadcast coverage of the draft live on ESPN.", "Although Rozelle did not believe it would be entertaining television, he agreed.", "In 1988, the NFL moved the draft from weekdays to the weekend and ESPN's ratings of the coverage improved dramatically. \n\n", "In 2006, ESPN received competition when the NFL Network, which had launched in October 2003, began to produce its own draft coverage.", "ESPN pays the NFL a rights fee for the non-exclusive rights to draft coverage, a fee that is included in its overall contract to televise games (\"ESPN Sunday Night NFL\" from 1987 to 2005, and \"Monday Night Football\" from 2006 to the present).", "In 2010, the NFL moved to a three-day draft with the first day encompassing the first round beginning at 8:00\u00a0pm EDT, the second day encompassing the second and third rounds beginning at 7:00\u00a0pm EDT, and third day concluding the process with the final four rounds beginning at 11:00\u00a0am EDT Saturday." ], [ "National Football League Draft", "If there are two or more expansion teams added, a coin toss (for two expansion teams) or a drawing of lots (for three expansion teams or more) determines which team is awarded the first selection in the regular draft.", "The loser of the coin toss (or the winner of the drawing of lots in the event there are three or more expansion teams) is awarded the first selection in the expansion draft.", "The 2010 NFL draft was the first draft to take place over three days.", "Its first round was on Thursday, April 22 at 7:30\u00a0p.m. ET, with the second and third rounds on Friday, April 23 at 6\u00a0p.m. ET, followed by the remaining rounds on Saturday, April 24 at 10\u00a0a.m. ET.", "The first overall pick generally gets the richest contract, but other contracts rely on a number of variables.", "While they generally are based on the previous year's second overall pick, third overall, etc., each player's position also is taken into account.", "Quarterbacks, for example, usually command more money than defensive linemen, which can skew those dollar figures slightly.", "Each team has its representatives attend the draft.", "During the draft, one team is always \"on the clock.\"", "In Round 1, teams have 10 minutes to make their choice (previously 15)." ], [ "National Football League Draft", "Starting with the 2018 NFL Draft, the first two evenings will air on broadcast television, with Fox and NFL Network carrying a simulcast featuring personnel from both the NFL Network and Fox Sports.", "ESPN continues to produce its own coverage of the draft, with ESPN2 simulcasting Days 1 and 2, while ABC simulcasts Day 3.", "Players who have been out of high school for at least three years are eligible for the NFL draft.", "The rules do not state that a player must attend college, but virtually all of the players selected in the NFL draft have played college football, usually in the United States but occasionally from Canadian universities as well.", "A few players are occasionally selected from other football leagues like the Arena Football League (AFL), the Canadian Football League (CFL), and the German Football League (GFL).", "A small handful of players have also been drafted from colleges who played other sports than football.", "Rules state only that a player must be three years removed from high school graduation, regardless of what the prospective draftee did during that time.", "A year as a redshirt player in college counts toward eligibility even though the player was not allowed to participate in games during that year, therefore players who have completed their redshirt sophomore year can enter the NFL draft.", "The selection order is based on each team's win-loss record in the previous season and whether the team reached the playoffs." ] ], "gold": "ESPN started broadcasting the NFL draft in 1980, and the network asked the NFL to change the draft to the weekends in 1988. The draft once again changed formats on 2010, becoming a three day event. For the 2018 NFL Draft, the first two evenings aired on broadcast television, being simulcast in Fox and NFL Network. ABC picked up the broadcast television rights for all 3 days of the draft in 2019.", "prediction 1": "ESPN started televising the National Football League draft in 1980. Then, in 2006, the NFL Network, which launched in October 2003, started producing its own draft coverage.", "prediction 2": "The National Football League draft was first televised on broadcast television in 1981, but only started being televised in 1976. ESPN's ratings of the coverage improved dramatically when the NFL moved the draft from weekdays to the weekend in 1988. ESPN received competition when the NFL Network, which had launched in October 2003, began to produce its own draft coverage. CBS, Fox Sports, and FOX Sports have also televised the NFL Draft since 2000.", "prediction 3": "On October 3, 2003, the NFL Network began producing its own draft coverage, and ESPN began televising the annual NFL Draft in October 2006. ESPN paid the NFL a rights fee for the non-exclusive rights to draft coverage, a fee that is included in its overall contract to televise games. ESPN continues to produce its own coverage of the draft, with ESPN2 simulcasting Days 1 and 2, while ABC simulcasts Day 3. Beginning with the 2018 NFL Draft, the first two evenings will air on broadcast television, with Fox and NFL Network carrying a simulcast featuring personnel from both the NFL Network and Fox Sports.", "prediction 4": "ESPN first started televising the National Football League draft in 1980. The network started televising the draft in 1988. In 2006, ESPN received competition from the NFL Network, which had launched in October 2003, and began producing its own draft coverage. In 2018, the NFL moved to a three day draft.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 173 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "ESPN started televising the National Football League draft in 1980. In 1988, the NFL moved the draft from weekdays to the weekend. In 2010, the NFL moved to a three-day draft. Starting with the 2018 NFL Draft, the first two evenings will air on broadcast television, with Fox and NFL Network." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did they stop making the saturn vue?", "passages": [ [ "Saturn Vue", "Saturn Vue\n\nThe Saturn VUE is a compact SUV that was sold and built by Saturn, and it was Saturn's best-selling model.", "It was the first vehicle to use the GM Theta platform when it was introduced in 2001 for the 2002 model year.", "The VUE was later facelifted for the 2006 model year.", "A second generation model was launched in 2007 for the 2008 model year as a rebadged Opel Antara.", "The VUE production in North America ended as GM wound down the Saturn brand during its 2009 reorganization.", "The Vue was introduced for the 2002 model year and was designed by Saturn.", "It was manufactured at the Spring Hill GM plant.", "Its unibody platform is shared with the Chevrolet Equinox, Pontiac Torrent and the European Opel Antara.", "The first generation ran from model year 2002-2007.", "Four-cylinder VUE's use the \"Ecotec\" I4.", "The \"L81\" V6 from the L-Series and five-speed Aisin AF33 automatic transmission were initially offered, but starting in 2004, all six-cylinder Vues were equipped with Honda's \"J35A3\" engine and a Honda transmission.", "The four-cylinder Vue was available with the VTi continuously variable transmission (CVT) until GM canceled it for 2005 due to dependability issues." ], [ "Saturn Vue", "A hybrid powertrain version of the 2.4-liter model was also available.", "GM badges were now added to the front doors.", "The Mexican-manufactured VUE was also retailed in Mexico and South America as the Chevrolet Captiva Sport, with only badges changed and a new grille insert fitted.", "Following the demise of the Saturn brand in 2009 for the 2010 model year, the VUE was discontinued.", "However, GM continued to produce the Chevrolet Captiva Sport, for the Mexican and South American markets.", "The Chevrolet Captiva Sport was introduced for the US commercial and fleet markets in late 2011 for the 2012 model year." ] ], "gold": "The Saturn Vue is a compact SUV that was sold and built by Saturn, and it was Saturn's best-selling model. The production of the first generation ended in 2007, followed only in North America in 2009 by the second generation as GM wound down the Saturn brand during its reorganization. Saturn definitely seized the manufacturing of the second generation of the Vue in 2010.", "prediction 1": "The first generation of the Saturn Vue was manufactured between 2002 and 2007, and the second generation was produced between 2007 and 2008. The second generation was discontinued in 2010 after GM wound down the Saturn brand during its 2009 reorganization.", "prediction 2": "The Saturn Vue is a compact SUV sold and built by Saturn that was the company's best-selling model. The first generation of the Saturn Vue ran from model year 2002-2007, manufactured by GM in Spring Hill, Indiana. Production in North America ended as GM wound down the Saturn brand during its 2009 reorganization. Following the demise of the Saturn brand in 2009 for the 2010 model year, the VUE was discontinued. However, GM continued to produce the Chevrolet Captiva Sport, for the Mexican and South American markets.", "prediction 3": "The first generation of the Saturn Vue was manufactured from 2002 to 2007. The second generation of the Saturn Vue was discontinued in September 2009 for the 2010 model year.", "prediction 4": "The 2007 second-generation Saturn Vue was manufactured at the Spring Hill GM plant in Pennsylvania. The 2010 version was discontinued following the demise of the Saturn brand.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 130 }, { "error type": "Unverifiable", "explanation": "", "start": 135, "end": 140 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Saturn Vue is a compact SUV that was sold and built by Saturn, and it was Saturn's best-selling model. The first generation of the Saturn Vue was manufactured between 2002 and 2007. The second generation was discontinued in 2010 after GM wound down the Saturn brand during its 2009 reorganization." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Where is the lost city of petra located?", "passages": [ [ "Petra", "Petra\n\nPetra (Arabic: \u0627\u0644\u0628\u062a\u0631\u0627\u0621, \"Al-Batr\u0101\u02be\"; Ancient Greek: \u03a0\u03ad\u03c4\u03c1\u03b1), originally known to its inhabitants as Raqmu, is a historical and archaeological city in southern Jordan.", "Petra lies on the slope of Jabal Al-Madbah in a basin among the mountains which form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba.", "Petra is believed to have been settled as early as 9,000\u00a0BC, and it was possibly established in the 4th century BC as the capital city of the Nabataean Kingdom.", "The Nabataeans were nomadic Arabs who invested in Petra's proximity to the trade routes by establishing it as a major regional trading hub.", "The trading business gained the Nabataeans considerable revenue and Petra became the focus of their wealth.", "The earliest historical reference to Petra was an attack to the city ordered by Antigonus I in 312\u00a0BC recorded by various Greek historians.", "The Nabataeans were, unlike their enemies, accustomed to living in the barren deserts, and were able to repel attacks by utilizing the area's mountainous terrain.", "They were particularly skillful in harvesting rainwater, agriculture and stone carving." ], [ "Petra", "Petra flourished in the 1st century AD when its famous Khazneh structure \u2013 believed to be the mausoleum of Nabataean King Aretas IV \u2013 was constructed, and its population peaked at an estimated 20,000 inhabitants.", "Although the Nabataean Kingdom became a client state for the Roman Empire in the first century BC, it was only in 106 AD that they lost their independence.", "Petra fell to the Romans, who annexed and renamed Nabataea to Arabia Petraea.", "Petra's importance declined as sea trade routes emerged, and after a 363 earthquake destroyed many structures.", "The Byzantine Era witnessed the construction of several Christian churches, but the city continued to decline, and by the early Islamic era became an abandoned place where only a handful of nomads lived.", "It remained unknown to the world until it was rediscovered in 1812 by Johann Ludwig Burckhardt.", "The city is accessed through a gorge called the Siq, which leads directly to the Khazneh.", "Famous for its rock-cut architecture and water conduit system, Petra is also called the Rose City due to the color of the stone out of which it is carved.", "It has been a UNESCO World Heritage Site since 1985.", "UNESCO has described it as \"one of the most precious cultural properties of man's cultural heritage\"." ] ], "gold": "The lost city of Petra is an ancient, abandoned city in southern Jordan, at 30\u00b019\u203243\u2033N 35\u00b026\u203231\u2033E. The area around Petra has been inhabited from as early as 7000 BC, making it historically and archaeologically significant. Because of the color of the stone from which it was carved, Petra is also called the Red Rose City. It is a UNESCO World Heritage site and has been described as one of the most precious cultural properties of man's cultural heritage.", "prediction 1": "Petra is a historical and archaeological city in southern Jordan. Located on the slope of Jabal Al-Madbah in a basin among the mountains that form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba, Petra is believed to have been settled as early as 9,000 BC, and it was possibly established in the 4th century BC as the capital city of the Nabataean Kingdom.", "prediction 2": "Petra lies on the slope of Jabal Al-Madbah in a basin among the mountains that form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba. Petra is believed to have been settled as early as 9,000 BC, and it was possibly established in the 4th century BC as the capital city of the Nabataean Kingdom.", "prediction 3": "Petra, originally known to its inhabitants as Raqmu, is a historical and archaeological city in southern Jordan. Petra lies on the slope of Jabal Al-Madbah in a basin among the mountains which form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba. The city is accessed through a gorge called the Siq, which leads directly to the Khazneh.", "prediction 4": "Petra is a historical and archaeological city in southern Jordan. It lies on the slope of Jabal Al-Madbah in a basin among the mountains that form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba. The city is accessed through a gorge called the Siq, which leads directly to the Khazneh. It remained unknown to the world until it was rediscovered in 1812 by Johann Ludwig Burckhardt.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 391 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Petra is a historical and archaeological city in southern Jordan. Located on the slope of Jabal Al-Madbah in a basin among the mountains that form the eastern flank of Arabah valley that run from the Dead Sea to the Gulf of Aqaba, Petra is believed to have been settled as early as 9,000 BC. Petra is also called the Rose City due to the color of the stone out of which it is carved. It has been a UNESCO World Heritage Site and described as \"one of the most precious cultural properties of man's cultural heritage\"." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Average height for males in the united states?", "passages": [ [ "Acceleration (human development)", "Acceleration (human development)\n\nAcceleration in human development process is the phenomenon which has been registered in many populations around the world.", "This applies equally to the growth of certain anthropometric parameters and the speed of reaching sexual maturity.", "These facts illustrate the results of secular changes in body height and appearance of the first menstruation (menarche).", "Increases in human stature are a main indicator of improvements in the average health of populations.", "The newest data set for the average height of adult male birth cohorts, from the mid-nineteenth century to 1980, in 15 European countries was studied (in the populations listed).", "During a century average height increased by 11\u00a0cm representing a dramatic improvement of this phenomenon.", "The apparent acceleration of body height occurred during the \u011c. In the mid-nineteenth century young European women's menarche occurred at the average age of 16.5 years.", "One hundred years later, this age was reduced to under 12 years." ], [ "Income inequality in the United States", "After including the effects of federal and state taxes, the U.S. Federal Reserve estimates 34 states in the USA have a Gini coefficient between 0.30 and 0.35, with the state of Maine the lowest.", "At the county and municipality levels, the pre-tax Gini index ranged from 0.21 to 0.65 in 2010 across the United States, according to Census Bureau estimates.", "Measured for all households, U.S. income inequality is comparable to other developed countries before taxes and transfers, but is among the worst after taxes and transfers, meaning the U.S. shifts relatively less income from higher income households to lower income households.", "Measured for working-age households, market income inequality is comparatively high (rather than moderate) and the level of redistribution is moderate (not low).", "These comparisons indicate Americans shift from reliance on market income to reliance on income transfers later in life and less fully than do households in other developed countries.", "The U.S. was ranked the 41st worst among 141 countries (30th percentile) on income equality measured by the Gini index.", "The UN, CIA \"World Factbook\", and OECD have used the Gini index to compare inequality between countries, and as of 2006, the United States had one of the highest levels of income inequality among similar developed or high income countries, as measured by the index." ] ], "gold": "In the United States, the average height for all males is 175.3 cm (5 ft 9 in). The average height for African American males in the United States is 175.5 cm (5 ft 9 in). The average height for Hispanic and Latin-American males in the United States is 169.5 cm (5 ft 6 1\u20442 in). The average height for Mexican-American males in the United States is 168.8 cm (5 ft 6 1\u20442 in). The average height for Asian-American males in the United States is 169.7 cm (5 ft 7 in). And the average height for Non-Hispanic white males in the United States is 177.0 cm (5 ft 9 1\u20442 in). In the 150 years since the mid-nineteenth century, the average human height in industrialized countries, such as the United States, has increased by up to 10 centimeters (3.9 in). However, these increases appear to have largely levelled off.", "prediction 1": "In the United States, average height for males is 58.7 inches, or 76 centimeters. In Europe, average height for men is 57.6 inches, or 82 centimeters.", "prediction 2": "The average height for males in the united states is 35.66 ft. (14.65 in women and 18.7 in men).", "prediction 3": "The average height of adult male birth cohorts, from the mid-nineteenth century to 1980, in 15 European countries was studied. During a century average height increased by 11 cm representing a dramatic improvement of this phenomenon. The highest rate of male height in the United States is 58 cm, which is 20.5 inches above the average height of females in the same age group.", "prediction 4": "In the United States, the average height for males is 67 inches, and in 15 European countries the average height for males was 58 inches.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 115 }, { "error type": "Unverifiable", "explanation": "", "start": 119, "end": 150 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "The outermost layer of the kidney is called the?", "passages": [ [ "Anatomical terms of location", "The terms \"intermediate\", \"ipsilateral\", \"contralateral\", \"superficial\", and \"deep\", while indicating directions, are relative terms and thus do not properly define fixed anatomical axes.", "Also, while the \"rostrocaudal\" and anteroposterior directionality are equivalent in a significant portion of the human body, they are different directions in other parts of the body.", "In anatomical terminology superior () is used to refer to what is above something, and inferior () to what is below it.", "For example, in the anatomical position the most superior part of the human body is the head, and the most inferior is the feet.", "As a second example, in humans the neck is superior to the chest but inferior to the head.", "Anterior refers to what is in front (, meaning \"before\") and posterior, what is to the back of the subject (, meaning \"after\").", "For example, in a dog the nose is anterior to the eyes and the tail is considered the most posterior part; in many fish the gill openings are posterior to the eyes, but anterior to the tail.", "Lateral () refers to the sides of an animal, as in \"left lateral\" and \"right lateral\"." ] ], "gold": "The outermost layer of the kidney has several names. The outermost layer of the kidney's anterior side, the side in the front, is called the anterior renal fascia. The outermost layer of the kidney's posterior side, the side in the back, is called the posterior renal fascia.", "prediction 1": "In anatomical terminology superior () is used to refer to what is above something and inferior () to what is below it. For example, in the anatomical position the most superior part of the human body is the head, and the most inferior is the feet.", "prediction 2": "The outermost layer of the kidney is called the superficial layer. It is the outermost layer of the kidney, and is called the anterior layer.", "prediction 3": "The outermost layer of the kidney is called the superficial layer, while the innermost layer is called the contralateral layer.", "prediction 4": "The kidney's outermost layer, the peritoneum, is called the cortex. The cortex is the outermost layer of the kidney and it is surrounded by a layer of tissue called the peritoneum.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 118 }, { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 247 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where is the new chargers stadium being built?", "passages": [ [ "Los Angeles Stadium at Hollywood Park", "Los Angeles Stadium at Hollywood Park\n\nThe Los Angeles Stadium at Hollywood Park, or LASED (short for Los Angeles Stadium and Entertainment District), is an open-air stadium and entertainment complex district under construction in Inglewood, California, United States.", "Formerly the site of Hollywood Park Racetrack, it is approximately from Los Angeles International Airport, and is located immediately south of The Forum.", "Planned to open in 2020, the stadium will serve as the home to the Los Angeles Rams and Los Angeles Chargers of the National Football League (NFL).", "It is also scheduled to host Super Bowl LVI in February 2022 and the College Football Playoff National Championship in January 2023.", "During the 2028 Summer Olympics, the stadium is expected to host the opening and closing ceremonies, as well as soccer.", "Archery will be held on the grounds outside the stadium.", "Los Angeles Stadium at Hollywood Park will be the third stadium since the AFL\u2013NFL merger to be shared by two NFL teams.", "MetLife Stadium, in East Rutherford, New Jersey, is home to the New York Giants and New York Jets, as was its predecessor, Giants Stadium." ] ], "gold": "SoFi Stadium is a stadium and entertainment complex under construction in Inglewood, California, United States and the home for the Los Angeles Rams and Los Angeles Chargers since September 2020. It is located at the former site of Hollywood Park Racetrack, approximately 3 miles from LAX, southeast of The Forum.", "prediction 1": "The Los Angeles Chargers stadium is being built in Inglewood, California. The stadium is being built on the former site of Hollywood Park Racetrack.", "prediction 2": "The Los Angeles Stadium at Hollywood Park, or LASED, is an open-air stadium and entertainment complex district under construction in Inglewood, California, United States. Formerly the site of Hollywood Park Racetrack, it is approximately from Los Angeles International Airport, and is located immediately south of The Forum. The stadium will serve as the home to the Los Angeles Rams and Los Angeles Chargers of the National Football League (NFL). The stadium is scheduled to open in 2020 and is also scheduled to host Super Bowl LVI in February 2022 and the College Football Playoff National Championship in January 2023.", "prediction 3": "The Los Angeles Stadium at Hollywood Park, or LASED, is an open-air stadium and entertainment complex district under construction in Inglewood, California, United States. Formerly the site of Hollywood Park Racetrack, it is approximately from Los Angeles International Airport, and is located immediately south of The Forum. The Los Angeles Stadium at Hollywood Park is also scheduled to host Super Bowl LVI in February 2022 and the College Football Playoff National Championship in January 2023.", "prediction 4": "The Los Angeles Chargers stadium is being built in Inglewood, California. LASED is short for Los Angeles Stadium and Entertainment District, an open-air stadium and entertainment complex district under construction in Inglewood, California. Formerly the site of Hollywood Park Racetrack, it is approximately from Los Angeles International Airport, and is located immediately south of The Forum.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "SoFi Stadium is a stadium and entertainment complex under construction in Inglewood, California, United States and the home for the Los Angeles Rams and Los Angeles Chargers since September 2020. It is located at the former site of Hollywood Park Racetrack, approximately 3 miles from LAX, southeast of The Forum." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "What is the criminal's name in the breakfast club?", "passages": [ [ "Judd Nelson", "Judd Nelson\n\nJudd Asher Nelson (born November 28, 1959) is an American actor who is best known for his roles as John Bender in \"The Breakfast Club\", Alec Newbary in \"St. Elmo's Fire\", Hot Rod and Rodimus Prime in \"\" and \"\", Joe Hunt in \"Billionaire Boys Club\", Nick Peretti in \"New Jack City\", Billy Beretti in \"Empire\", and Jack Richmond in the television series \"Suddenly Susan\".", "Nelson was born in Portland, Maine, the son of Merle (n\u00e9e Royte), a court mediator and former member of the Maine state legislature, and Leonard Nelson, a corporate lawyer.", "His family is Jewish, and his father was the first Jewish president of the Portland Symphony Orchestra.", "He has two sisters, Eve and Julie.", "He went to school at St. Paul's School in Concord, New Hampshire and Waynflete School in Portland, Maine, and studied at Haverford College in Pennsylvania, leaving during his sophomore year.", "He subsequently moved to Manhattan to study acting with Stella Adler.", "Nelson began acting in the mid-1980s, starring in \"Making the Grade\" (1984), and in \"Fandango\" (1985) opposite Kevin Costner." ], [ "The Breakfast Club", "The Breakfast Club\n\nThe Breakfast Club is a 1985 American comedy-drama film written, produced, and directed by John Hughes.", "It stars Emilio Estevez, Anthony Michael Hall, Judd Nelson, Molly Ringwald and Ally Sheedy as teenagers from different high school cliques who spend a Saturday in detention with their strict assistant principal (Paul Gleason).", "The film premiered in Los Angeles on February 7, 1985.", "Universal Pictures released it in cinemas in the United States on February 15, 1985.", "It received critical acclaim and earned $51.5 million on a $1 million budget.", "Critics consider it the greatest high school film of all time, as well as one of Hughes' most memorable and recognizable works.", "The media referred to the film's five main actors as members of a group called the \"Brat Pack\".", "In 2016, the film was selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant\".", "The film was digitally remastered and was re-screened throughout 430 theaters in celebration of its 30th anniversary in 2015.", "On a Saturday (March 24, 1984) five high school students report for all-day detention.", "Each comes from a different clique: pampered Claire Standish, state champion wrestler Andrew Clark, geek Brian Johnson, outcast Allison Reynolds, and delinquent John Bender." ] ], "gold": "In the 1985 film The Breakfast Club, John Bender was the name of the criminal's character, who was a punk and a rebel and who was played by American actor Judd Nelson.", "prediction 1": "The Breakfast Club is a 1985 American comedy-drama film written, produced, and directed by John Hughes. It stars Emilio Estevez, Anthony Michael Hall, Judd Nelson, Molly Ringwald and Ally Sheedy as teenagers from different high school cliques who spend a Saturday in detention with their strict assistant principal (Paul Gleason). The criminal's name in the film is John Bender. The Breakfast Club also stars Alec Newbary as John Bender.", "prediction 2": "The Breakfast Club is an American 1985 comedy-drama film written, produced, and directed by John Hughes. It stars Emilio Estevez, Anthony Michael Hall, Judd Nelson, Molly Ringwald and Ally Sheedy as teenagers from different high school cliques who spend a Saturday in detention with their strict assistant principal Paul Gleason. The criminal's name in the breakfast club is John Bender. The Breakfast Club also features Alec Newbary as a criminal.", "prediction 3": "The Breakfast Club is a 1985 American comedy-drama film written, produced, and directed by John Hughes. It stars Emilio Estevez, Anthony Michael Hall, Judd Nelson, Molly Ringwald and Ally Sheedy as teenagers from different high school cliques who spend a Saturday in detention with their strict assistant principal (Paul Gleason).", "prediction 4": "The Breakfast Club is a 1985 American comedy-drama film written, produced, and directed by John Hughes. It stars Emilio Estevez, Anthony Michael Hall, Judd Nelson, Molly Ringwald and Ally Sheedy as teenagers from different high school cliques who spend a Saturday in detention with their strict assistant principal (Paul Gleason). John Bender, also known as John \"Bender\", is a criminal played by Judd Nelson.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 56, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 330 }, { "error type": "Unverifiable", "explanation": "", "start": 379, "end": 437 } ], "missing-info": [], "corrected-prediction": "The Breakfast Club is a 1985 American comedy-drama film." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "Who played obi wan kenobi in star wars episode 3?", "passages": [ [ "Star Wars: Episode III \u2013 Revenge of the Sith (video game)", "All other voice actors have either before or since provided voice work in the \"Star Wars\" universe.", "James Arnold Taylor, who voices Obi-Wan Kenobi in the series, provides the voice of Obi-Wan.", "Mat Lucas provides the voice of Anakin Skywalker, having also doubled for Hayden Christensen in the video game, \"\", as well as in the 2003 \"Clone Wars\" series.", "Voice actor Corey Burton, primary talent for the animated version of Count Dooku, voices various minor characters as well as Dooku himself.", "General Grievous is voiced by Matthew Wood, who also provided his voice in the game's and the 2008 \"Clone Wars\" series.", "Terrence C. Carson voices Mace Windu and Nick Jameson voices Chancellor Palpatine/Darth Sidious.", "Scott Lawrence, best known for his role as United States Naval JAG lawyer Cmdr.", "Sturgis Turner on the CBS series \"JAG\" provides the voice for Darth Vader.", "Yoda and Cin Drallig are both voiced by Tom Kane, who also provides additional voices.", "Finally, Serra Keto is voiced by Kari Wahlgren.", "The game received average to mixed reviews upon release." ], [ "Star Wars: Episode III \u2013 Revenge of the Sith", "Star Wars: Episode III \u2013 Revenge of the Sith\n\nStar Wars: Episode III \u2013 Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas.", "It is the sixth entry in the \"Star Wars\" film series and stars Ewan McGregor, Natalie Portman, Hayden Christensen, Ian McDiarmid, Samuel L. Jackson, Christopher Lee, Anthony Daniels, Kenny Baker, and Frank Oz.", "A sequel to \"\" (1999) and \"\" (2002), it is the third and final installment in the \"Star Wars\" prequel trilogy.", "The film begins three years after the onset of the Clone Wars.", "The Jedi Knights are spread across the galaxy, leading a massive war against the Separatists.", "The Jedi Council dispatches Jedi Master Obi-Wan Kenobi to eliminate the notorious General Grievous, the leader of the Separatist Army.", "Meanwhile, Jedi Knight Anakin Skywalker grows close to Palpatine, the Supreme Chancellor of the Galactic Republic and, secretly, a Sith Lord known as Darth Sidious.", "Their deepening friendship threatens the Jedi Order, the Republic, and Anakin's best interest.", "Lucas began writing the script before production of \"Attack of the Clones\" ended." ], [ "Star Wars: Episode III \u2013 Revenge of the Sith (video game)", "Star Wars: Episode III \u2013 Revenge of the Sith (video game)\n\n", "Star Wars Episode III:", "Revenge of the Sith is an action video game based on the .", "It centers on Obi-Wan Kenobi and Anakin Skywalker as the Clone Wars come to an end.", "It was released on May 4, 2005, for the PlayStation 2, Xbox, Game Boy Advance and Nintendo DS.", "Additionally, a version was made available for mobile phones on April 2, 2005.", "As part of the PlayStation 2 classics program, the PlayStation 2 version was re-released in Europe on the PlayStation Network on February 11, 2015.", "In single player mode, the player alternates between playing as Anakin Skywalker and Obi-Wan Kenobi, reliving various scenes from the film through the game's missions.", "There are 17 levels, interlaced with over 12 minutes of footage from the movie.", "The game's combat system is heavily concentrated on lightsaber combat.", "Each of the playable characters (with the exception of the MagnaGuard) is equipped with at least one lightsaber.", "There are three basic attacks: fast attacks which do the least amount of damage, strong attacks which do more damage but are slower to execute, and the slowest but strongest critical attacks.", "These attacks can be mixed to create combination attacks." ] ], "gold": "In the 2005 film Star Wars: Episode III - Revenge of the Sith, Ewan McGregor plays Jedi Master Obi-wan Kenobi. In the Star Wars: Episode III - Revenge of the Sith action video game based on the movie of the same name, James Arnold Taylor provides the voice of Obi-wan Kenobi. ", "prediction 1": "Star Wars Episode III: Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas. It is the sixth entry in the Star Wars film series and stars Ewan McGregor, Natalie Portman, Hayden Christensen, and Ian McDiarmid. James Arnold Taylor plays Obi-Wan Kenobi in the series, while Corey Burton voices various minor characters as well as Dooku himself. Matthew Wood provides the voice of General Grievous, who also provided his voice in the video game's and the 2003 Clone Wars series, while Terrence C. Carson voices Mace Windu and Nick Jameson voices Chancellor Palpatine/Darth Sidious. Finally, Serra Keto is voiced by Kari Wahlgren. The game centers on Obi-Wan Kenobi and Anakin Skywalker as the Clone Wars come to an end.", "prediction 2": "Star Wars Episode III: Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas. It is the sixth entry in the Star Wars film series and stars Ewan McGregor, Natalie Portman, Hayden Christensen, Christopher Lee, Samuel L. Jackson, Kenny Baker, Frank Oz, and Ian McDiarmid. James Arnold Taylor, who voices Obi-Wan Kenobi in the series, provides the voice of Obi-Wan. Voice actor Corey Burton, primary talent for the animated version of Count Dooku, provides the voice of Obi-Wan Skywalker, having also double for Hayden Christensensensensensensensensensensensensensensensensensensensensensensensensensensensen", "prediction 3": "Star Wars Episode III \u2013 Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas. In the film, Ewan McGregor plays Obi-Wan Kenobi. In the video game, James Arnold Taylor plays Obi-Wan Kenobi.", "prediction 4": "Star Wars Episode III \u2013 Revenge of the Sith is a 2005 American epic space opera film written and directed by George Lucas. It is the sixth entry in the Star Wars film series and stars Ewan McGregor and Natalie Portman as Obi-Wan Kenobi, while James Arnold Taylor voices Obi-Wan in the series. In the 2005 video game, which is the sequel to the 2005 film, Obi-Wan is voiced by Terrence C. Carson, who also provided his voice for the game and the 2008 Clone Wars.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 253 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 274, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 386 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 622 }, { "error type": "Irrelevant", "explanation": "", "start": 623, "end": 670 }, { "error type": "Irrelevant", "explanation": "", "start": 671, "end": 760 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 3 ] } ], "corrected-prediction": "Star Wars Episode III: Revenge of the Sith is a 2005 film. James Arnold Taylor voices Obi-Wan Kenobi in Star Wars: Episode III \u2013 Revenge of the Sith action video game based on the movie of the same name." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Where in the us has hosted the olympics?", "passages": [ [ "2028 Summer Olympics", "This is the third time that Los Angeles will have hosted the Summer Olympics, making it the third city after London (1908, 1948, and 2012) and Paris (1900, 1924, and 2024) to host the Games three times and the first American city to do so.", "These will be the fifth Summer Olympic Games to be hosted in the United States, the previous four occasions being St. Louis 1904, Los Angeles 1932, Los Angeles 1984, and Atlanta 1996.", "These will be the ninth Olympics to be held in the U.S. (taking both summer and winter Games into account; the four winter editions being Lake Placid 1932, Squaw Valley 1960, Lake Placid 1980, and Salt Lake City 2002).", "On September 16, 2015, the International Olympic Committee announced five candidate cities for the 2024 Games: Budapest, Hamburg, Los Angeles, Paris, and Rome.", "The candidature process was announced at the same time.", "Budapest, Hamburg, and Rome eventually withdrew their bids, leaving only Los Angeles and Paris.", "A similar situation had already occurred during the bidding for the 2022 Winter Olympics when Krakow, Lviv, Oslo and Stockholm withdrew, resulting in a two-way race between Beijing, China and Almaty, Kazakhstan, where Beijing was ultimately declared the winner." ] ], "gold": "The United States has hosted a total of eight Olympic Games, more than any other country, followed by France with five editions. Lake Placid hosted the 1932 and 1980 Winter Olympics. Los Angeles has hosted the 1932, 1984 and 2028 Summer Olympics. Other US cities that have hosted the Olympics include Atlanta, St. Louis, Salt Lake City and Squaw Valley.", "prediction 1": "Los Angeles has hosted the Summer Olympics in three different cities. The city is Los Angeles. For the winter games, Salt Lake City has hosted the Winter Olympics in 2002. For the summer games, the city of St. Louis has hosted the Summer Olympics in four occasions, from 1904 to 1932, and from 1984 to 1996. These will be the fifth Summer Olympic Games to be hosted in the United States, the previous four occasions being St. Louis 1904, Los Angeles 1932, Los Angeles 1984, and Atlanta 1996.", "prediction 2": "This is the third time that Los Angeles will have hosted the Summer Olympics, making it the third city after London (1908, 1948, and 2012) and Paris (1900, 1924, and 2024) to host the Games three times. The previous four occasions being St. Louis 1904, Los Angeles 1932, Los Angeles 1984, and Atlanta 1996. These will be the ninth Olympics to be held in the United States, taking both summer and winter Games into account; the four winter editions being Lake Placid 1932, Squaw Valley 1960, Lake Placid 1980, and Salt Lake Placid 2002.", "prediction 3": "There have been several Summer Olympic Games held in the United States, the first four being in St. Louis in 1904 and Los Angeles in 1932. The last four were in Atlanta in 1996 and in Salt Lake City in 2002.", "prediction 4": "Los Angeles is the city that has hosted the Summer Olympics on three different occasions. The most recent Summer Olympics were held in 1932 in Los Angeles, the fourth in Los Angeles in 1932, and the fifth in 1984 in Los Angeles, the eighth in Atlanta, and the ninth in Salt Lake City. The most recent Summer Olympics were held in Chicago in 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 307 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 69 }, { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 171 } ], "missing-info": [], "corrected-prediction": "These will be the ninth Olympics to be held in the U.S. (taking both summer and winter Games into account; the four winter editions being Lake Placid 1932, Squaw Valley 1960, Lake Placid 1980, and Salt Lake City 2002). These will be the fifth Summer Olympic Games to be hosted in the United States, the previous four occasions being St. Louis 1904, Los Angeles 1932, Los Angeles 1984, and Atlanta 1996." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did ireland rugby last win the grand slam?", "passages": [ [ "Grand Slam (rugby union)", "Grand Slam (rugby union)\n\n", "In rugby union, a Grand Slam (Irish: \"Caithr\u00e9im Mh\u00f3r\".", "Welsh: \"Y Gamp Lawn\".", "French: \"Grand Chelem\") occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition.", "This has been achieved 39 times in total, for the first time by Wales in 1908, and most recently by Ireland in 2018.", "The team to have won the most Grand Slams is England with 13.", "In another context, a Grand Slam tour refers to a touring side \u2013 South Africa, Australia or New Zealand \u2013 which plays fixtures against all four home nations (England, Ireland, Scotland and Wales) during their tour.", "If the tourists then win all of those matches, they are said to have achieved a Grand Slam.", "This has been done nine times, first by South Africa in 1912\u201313, and most recently by New Zealand in 2010.", "In the annual Six Nations Championship (among England, Ireland, Scotland, Wales, France and Italy), and its predecessor the Five Nations Championship (before Italy joined in 2000), a Grand Slam occurs when one team beats all of the others during one year's competition." ], [ "2018 Six Nations Championship", "2018 Six Nations Championship\n\nThe 2018 Six Nations Championship was the 19th series of the Six Nations Championship, the annual northern hemisphere rugby union championship.", "The tournament continued to be sponsored by the Royal Bank of Scotland Group, via its subsidiary NatWest, so was branded the NatWest 6 Nations.", "The championship was contested by France, Ireland, Italy, Scotland, Wales and defending champions England.", "Including the competition's previous iterations as the Home Nations Championship and Five Nations Championship, it was the 124th edition of the tournament.", "As in 2017, the tournament continued to use the bonus point system common to most other professional rugby union tournaments.", "As well as the standard four points for a win and two for a draw, a team scoring four tries in a match received an additional league table point, as did a team losing by seven or fewer points.", "Additionally, to ensure that a team winning all of its five matches (a Grand Slam) would also win the Championship, three bonus points would be awarded for this achievement.", "The Championship was won by Ireland on 10 March 2018, with their four wins (three with try bonus points) from the first four matches sufficient to place them out of reach of the other participants ahead of the final round.", "This was the third tournament running where the championship and Wooden Spoon had been decided by the end of round four." ], [ "2009 Six Nations Championship", "2009 Six Nations Championship\n\nThe 2009 Six Nations Championship, known as the 2009 RBS 6 Nations because of the tournament's sponsorship by The Royal Bank of Scotland, was the 10th Six Nations Championship, and the 115th international championship, an annual rugby union competition contested by the six major Northern Hemisphere national teams.", "The tournament was held between 7 February and 21 March 2009.", "The championship was contested by England, France, Ireland, Italy, Scotland and Wales.", "Ireland won the Grand Slam and Triple Crown, their first Grand Slam since 1948 and Triple Crown since 2007.", "It was Ireland's second Grand Slam in total.", "England finished as runners-up, and they also won the Calcutta Cup.", "The 2009 tournament featured the first Friday night game in its history, played between France and Wales at the Stade de France.", "The tournament began on 7 February 2009, when England hosted Italy in the earlier of the day's two matches.", "Ireland played France later that evening, with Scotland versus Wales the following day.", "The reigning champions on entering the 2009 tournament were Wales, who won the Grand Slam and Triple Crown in 2008.", "The winners of both accolades in 2009 were Ireland, with Ronan O'Gara's dropped goal leaving the score in the final match against Wales in Cardiff on 21 March at 17\u201315." ] ], "gold": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship, or its Five Nations predecessor, beats all the others during one year's competition. Ireland rugby won its first Grand Slam on 29 March 1948. Ireland won its second on 21 March 2009. Ireland rugby won its third Grand Slam on 10 March 2018.", "prediction 1": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition. This has been achieved 39 times in total, for the first time by Wales in 1908, and most recently by Ireland in 2018. In the annual Six Nations Championship, which consists of England, Ireland, Scotland, Wales, France and Italy, and its predecessor the Five Nations Championship, a Grand Slam occurs when one team beats all of the others during one year's championship, a Grand Slam occurs when one team beats all the others during one year's competition.", "prediction 2": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition. This has been achieved 39 times in total, for the first time by Wales in 1908, and most recently by Ireland in 2018. In the annual Northern Hemisphere Six Nations Championship, Ireland won the Grand Slam and Triple Crown in the 2009 Six Nations Championship, their first Grand Slam since 1948 and Triple Crown since 2007.", "prediction 3": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition. This has been achieved 39 times in total, for the first time by Wales in 1908, and most recently by Ireland in 2018. In the annual Six Nations Championship (among England, Ireland, Scotland, Wales, France and Italy), and its predecessor the Five Nations Championship (before Italy joined in 2000), a Grand Slam occurs when one team beats all of the others during one year's competition. In the annual northern hemisphere rugby union championship, a Grand Slam occurs when one team wins all of its five matches (a Grand Chelem)", "prediction 4": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship manages to beat all the others during one year's competition. This has been achieved 39 times in total, for the first time by Wales in 1908, and most recently by Ireland in 2018. The team to have won the most Grand Slams in total is England with 13.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 256 }, { "error type": "Redundant", "explanation": "in the Six Nations Championship", "start": 295, "end": 334 }, { "error type": "Redundant", "explanation": "(or its Five Nations predecessor) ", "start": 410, "end": 456 }, { "error type": "Irrelevant", "explanation": "", "start": 335, "end": 405 }, { "error type": "Redundant", "explanation": "a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition. ", "start": 457, "end": 546 }, { "error type": "Redundant", "explanation": "a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition", "start": 547, "end": 632 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 294 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "In rugby union, a Grand Slam occurs when one team in the Six Nations Championship (or its Five Nations predecessor) manages to beat all the others during one year's competition. Ireland won its first Grand Slam on 21 March 2009, their first since 1948. Ireland rugby last won the Grand Slam on 10 March 2018." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did the ipad 1st gen come out?", "passages": [ [ "IPad Mini (1st generation)", "IPad Mini (1st generation)\n\n", "The first-generation iPad Mini (stylized and marketed as iPad mini) is a mini tablet computer designed, developed, and marketed by", "Apple Inc.", "It was announced on October 23, 2012, as the fourth major product in the iPad line and the first of the iPad Mini line, which features a reduced screen size of , in contrast to the standard .", "It features similar internal specifications to the iPad 2, including its display resolution.", "The first generation iPad Mini received positive reviews, with reviewers praising the device's size, design, and availability of applications, while criticizing its use of a proprietary power connector, its lack of expandable storage, and the lack of Retina display.", "On October 16, 2012, Apple announced a media event scheduled for October 23 at the California Theatre in San Jose, California.", "The company did not predisclose the subject of the event, but it was widely expected to be the iPad Mini.", "On the day of the event, Apple CEO Tim Cook introduced a new version of MacBook family and new generations of the MacBook Pro, Mac Mini, and the iMac before the iPad mini and the \nhigher end fourth-generation iPad.", "It was released on November 2, 2012, in nearly all of Apple's markets." ], [ "IPad (1st generation)", "The plans are activated on the iPad itself and can be cancelled at any time.", "The iPad was initially only available for purchase on Apple\u2019s online store and its retail locations; it has since become available through retailers including Amazon, Walmart, and network operators.", "The iPad was launched in countries including Australia, Canada, France, Germany, Japan and the United Kingdom on May 28.", "Online pre-orders in those countries began on May 10.", "Apple released the iPad in Hong Kong, Ireland, Mexico, New Zealand and Singapore on July 23, 2010.", "Israel briefly prohibited importation of the iPad because of concerns that its Wi-Fi might interfere with other devices.", "On September 17, 2010, the iPad was officially launched in China.", "The iPad originally shipped with iPhone OS 3.2.", "On September 1, 2010, it was announced the iPad would get iOS 4.2 by November 2010; to fulfill this, Apple released iOS 4.2.1 to the public on November 22.", "It comes with several applications, including Safari, Mail, Photos, Video, iPod, iTunes, App Store, Maps, Notes, Calendar, and Contacts.", "Several are improved versions of applications developed for the iPhone or Mac.", "The iPad syncs with iTunes on a Mac or Windows PC." ], [ "IPad (1st generation)", "IPad (1st generation)\n\n", "The first-generation iPad ( ) is a tablet computer designed and marketed by Apple Inc. as the first in the iPad line.", "The device features an Apple A4 processor, a 9.7\" touchscreen display, and, on certain variants, the capability of accessing cellular networks.", "Using the iOS operating system, the iPad can play music, send and receive email and browse the web.", "Other functions, which include the ability to play games and access references, GPS navigation software and social network services can be enabled by downloading apps.", "The device was announced and unveiled on January 27, 2010 at a media conference.", "On April 3, 2010, the Wi-Fi variant of the device was released in the United States, followed by the release of the Wi-Fi + Cellular variant on April 30.", "On May 28, it was released in Australia, Canada, France, Japan, Italy, Germany, Spain, Switzerland and the United Kingdom.", "The device received primarily positive reviews from various technology blogs and publications.", "Reviewers praised the device for its wide range of capabilities and labelled it as a competitor to laptops and netbooks.", "Some aspects were criticized, including the closed nature of the operating system and the lack of support for the Adobe Flash multimedia format.", "During the first 80 days, three million iPads were sold." ], [ "IPad", "Due to the exclusion of pornography from the App Store, YouPorn and others changed their video format from Flash to H.264 and HTML5 specifically for the iPad.", "In an e-mail exchange with Ryan Tate from Valleywag, Steve Jobs claimed that the iPad offers \"freedom from porn\", leading to many upset replies including Adbustings in Berlin by artist Johannes P. Osterhoff and in San Francisco during WWDC10.", "On May 28, 2010, the iPad was released in Australia, Canada, and Japan, as well as in several larger European countries.", "Media reaction to the launch was mixed.", "The media noted the positive response from fans of the device, with thousands of people queued on the first day of sale in a number of these countries.", "Media reaction to the iPad announcement was mixed.", "Walter Mossberg wrote, \"It's about the software, stupid\", meaning hardware features and build are less important to the iPad's success than software and user interface, his first impressions of which were largely positive.", "Mossberg also called the price \"modest\" for a device of its capabilities, and praised the ten-hour battery life.", "Others, including \"PC Advisor\" and the \"Sydney Morning Herald\", wrote that the iPad would also compete with proliferating netbooks, most of which use Microsoft Windows." ] ], "gold": "The first-generation iPad is a tablet computer designed and marketed by Apple Inc. as the first device in the iPad lineup of tablet computers. It had multiple versions released between April and September of 2010. On April 3, 2010, the Wi-Fi variant was released in the United States, and on April 30 they released the same version with cellular. On May 28, 2010, it was released in Spain, Italy, Switzerland, UK, Germany, Australia, Japan, Canada, and France. On July 23, 2010, it was released in Austria, Belgium, Hong Kong, Ireland, Luxembourg, Mexico, Netherlands, New Zealand, and Singapore. Finally, on September 17, 2010, it was made available to people in China.", "prediction 1": "The first-generation iPad is a tablet computer designed and marketed by Apple Inc. as the first in the iPad line. It was announced on October 23, 2012, as the fourth major product in the iPad line and the first of the iPad Mini line, which features a reduced screen size of 9.7 inches in contrast to the standard iPad 2. It was released on November 2, 2012, in nearly all of Apple's markets. The iPad was launched in countries including Australia, Canada, France, Germany, Japan, Italy, Germany, Spain, Switzerland and the United Kingdom on May 28, 2010.\n", "prediction 2": "The first-generation iPad is a tablet computer designed and marketed by Apple Inc. as the first in the iPad line. It was announced on October 23, 2012, as the fourth major product in the iPad line and the first of the iPad Mini line, which features a reduced screen size of 9.7 inches in contrast to the standard iPad 2. It was released on November 2, 2012, in nearly all of Apple's markets. The first-generation iPad came out in Australia, Canada, France, Germany, Japan, Italy, Germany, Spain, Switzerland, China on April 3, 2010. It was launched in the United States on May 28, 2010.", "prediction 3": "The first-generation iPad is a tablet computer designed and marketed by Apple Inc. as the first in the iPad line, featuring an Apple A4 processor, a 9.7\u201d touchscreen display, and the ability to access cellular networks. It was announced on October 23, 2012, as the fourth major product in the iPad line and the first of the iPad Mini line, which features a reduced screen size of 10.1 inches compared to the standard iPad 2. The first-generation iPad was launched in countries including Australia, Canada, France, Germany, Japan, Spain, Switzerland on May 28, 2010. It was released in China.", "prediction 4": "The first-generation iPad, officially named the iPad 1, was released in the United States on September 24, 2010. It was then released in Australia, Canada, France, Japan, Italy, Germany, Spain, Switzerland and the United Kingdom on May 28, 2010. Then, on October 23, 2012, it was released in nearly all of Apple's markets as the fourth major product in the iPad line.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 134, "end": 151 }, { "error type": "Incoherent", "explanation": "", "start": 152, "end": 233 }, { "error type": "Incoherent", "explanation": "", "start": 234, "end": 320 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[7]}", "start": 340, "end": 357 }, { "error type": "Unverifiable", "explanation": "", "start": 358, "end": 391 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 133 }, { "error type": "Redundant", "explanation": "Germany", "start": 487, "end": 495 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The first-generation iPad is a tablet computer designed and marketed by Apple Inc. as the first in the iPad line. It had multiple versions released between April and September of 2010. On April 3, 2010, the Wi-Fi variant of the device was released in the United States, followed by the release of the Wi-Fi + Cellular variant on April 30. On May 28, it was released in Australia, Canada, France, Japan, Italy, Germany, Spain, Switzerland and the United Kingdom. Apple released the iPad in Hong Kong, Ireland, Mexico, New Zealand and Singapore on July 23, 2010. Finally, on September 17, 2010, the iPad was officially launched in China." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where is the pga championship played in 2017?", "passages": [ [ "2017 PGA Championship", "2017 PGA Championship\n\nThe 2017 PGA Championship was the 99th PGA Championship, held August 10\u201313 at Quail Hollow Club in Charlotte, North Carolina.", "This was the first major at Quail Hollow, which is a regular stop on the PGA Tour.", "Early in the week of the tournament, it was announced that the championship will be held in May beginning in 2019.", "Justin Thomas, the son of a PGA professional, won his first career major title, two strokes ahead of runners-up Francesco Molinari, Louis Oosthuizen, and Patrick Reed.", "In the United States, the Championship was televised by CBS, with weekday and early weekend coverage on TNT.", "It was televised live in the United Kingdom by the BBC who secured the rights over Sky Sports who had previously screened the event since 1992.", "The course hosts the Wells Fargo Championship on the PGA Tour (2003\u2013present), though not in 2017; in 2016, it played as a par-72 at .", "It was also the home of the tour's Kemper Open (1969\u20131979) and the senior tour's PaineWebber World Seniors Invitational in the 1980s.", "Under the direction of Tom Fazio, Quail Hollow underwent an aggressive 90-day renovation in 2016 that modified four holes and added Bermuda grass.", "It commenced during the final round of the Wells Fargo Championship on Sunday, May 8." ], [ "PGA Championship", "PGA Championship\n\nThe PGA Championship (often referred to as the U.S. PGA Championship or U.S. PGA outside the United States) is an annual golf tournament conducted by the Professional Golfers' Association of America.", "It is one of the four major championships in professional golf.", "It was formerly played in mid-August on the third weekend before Labor Day weekend, serving as the fourth and final major of the golf season.", "Beginning 2019, the tournament will be played in May on the weekend before Memorial Day, as the season's second major.", "It is an official money event on the PGA Tour, European Tour, and Japan Golf Tour, with a purse of $11\u00a0million for the 100th edition in 2018.", "In line with the other majors, winning the PGA gains privileges that improve career security.", "PGA champions are automatically invited to play in the other three majors (Masters Tournament, U.S. Open, and The Open Championship) and The Players Championship for the next five years, and are eligible for the PGA Championship for life.", "They receive membership on the PGA Tour for the following five seasons and on the European Tour for the following seven seasons.", "The PGA is the only one of the four majors to be a tournament almost exclusively for professional players.", "The PGA Championship has been held at a large number of venues." ], [ "Quail Hollow Club", "Quail Hollow Club\n\nQuail Hollow Club is a country club and golf course in the southeastern United States, located in the Quail Hollow neighborhood in Charlotte, North Carolina.", "It is a private member club, founded by James J. Harris on April 13, 1959.", "The club hosted the Kemper Open on the PGA Tour from 1969 through 1979, and the senior tour's PaineWebber Invitational from 1983 through 1989.", "The PGA Tour returned to Quail Hollow in 2003 with the Wachovia Championship, now the Wells Fargo Championship.", "Quail Hollow was designed by golf course architect George Cobb who designed several golf courses, primarily in the southeastern United States.", "Opened in 1961, it underwent a series of improvements, including modifications of several holes by Arnold Palmer in 1986, and a redesign by Tom Fazio in 1997, 2003, and from 2014 to 2016 in preparation for the PGA Championship.", "South of central Charlotte, the average elevation of the course is approximately above sea level.", "The course is part of an extensive housing development.", "The club hosted the PGA Championship in 2017 in mid-August.", "Because of this, the Wells Fargo event for 2017 was moved to Wilmington and held at Eagle Point Golf Club, near the Atlantic coast.", "The Quail Hollow membership primarily comprises wealthy local business people plus the children of long-time Charlotte families.", "Quail Hollow is scheduled to host the fourteenth edition of the Presidents Cup in" ] ], "gold": "In 2017, the annual PGA Championship golf tournament was played at the Quail Hollow Club, a golf course and country club located in the Quail Hollow neighborhood of the city of Charlotte, North Carolina. This was the first major at Quail Hollow, which is a regular stop on the PGA Tour.", "prediction 1": "The PGA Championship is one of the four major championships in professional golf. It was previously played in mid-August on the third weekend before Labor Day weekend, serving as the fourth and final major of the golf season. Beginning 2019, the tournament will be played in May on the weekend before Memorial Day, as the season's second major. The 2017 PGA Championship was held at Quail Hollow Club in Charlotte, North Carolina.", "prediction 2": "The PGA Championship is an annual golf tournament conducted by the Professional Golfers' Association of America, which is one of the four major championships in professional golf. It was formerly played in mid-August on the third weekend before Labor Day weekend, serving as the fourth and final major of the golf season. Beginning 2019, the tournament will be played in May on the weekend before Memorial Day, as the season's second major.", "prediction 3": "The PGA Championship is an annual golf tournament conducted by the Professional Golfers' Association of America. It is one of the four major championships in professional golf. In 2017, the PGA Championship was played at Quail Hollow Club in Charlotte, North Carolina.", "prediction 4": "The PGA Championship is an annual golf tournament conducted by the Professional Golfers' Association of America. The 2017 PGA Championship was held in mid-August at Quail Hollow Club in Charlotte, North Carolina. Because of this, the Wells Fargo event for 2017 was moved to Wilmington and held at Eagle Point Golf Club, near the Atlantic coast.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 81 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 225 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 344 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The 2017 PGA Championship was held at Quail Hollow Club, a country club and golf course, in the Quail Hollow neighborhood of Charlotte, North Carolina. This was the first major at Quail Hollow, which is a regular stop on the PGA Tour." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who played the original robin in batman and robin?", "passages": [ [ "Johnny Duncan (actor)", "Johnny Duncan (actor)\n\n", "John Bowman Duncan (December 7, 1923 \u2013 February 8, 2016) was an American actor.", "In addition to managing several business ventures, he made appearances at comic book conventions and collectors' shows worldwide.", "Johnny Duncan learned to dance Jitterbug as a teen and by the age of 19 had his first major appearance in a dance role in the \"King of Swing\" Benny Goodman camp classic musical \"The Gang's All Here\".", "This kicked off Duncan's career as a movie swing dancer and actor and led to numerous appearances in other films, and a contract with 20th Century Fox, where he appeared in productions with Shirley Temple and Jane Withers.", "Notable roles include parts in \"The East Side Kids\", \"The Bowery Boys\", \"Mystery of the 13th Guest\" and the 1949 serial \"Batman and Robin\" as Dick Grayson/Robin, the Boy Wonder.", "He was so young looking that he was twenty-six years old when he was hired to play the Boy Wonder.", "He later appeared in bit parts in a number of films including \"Plan 9 from Outer Space\".", "He was a member of The Black Rebels Motorcycle Club in the classic Marlon Brando film \"The Wild One\" in 1952.", "His final film appearance was in the 1960 film \"Spartacus\"." ], [ "Batman & Robin (film)", "Batman & Robin (film)\n\nBatman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin.", "It is the fourth and final installment of Warner Bros.' initial \"Batman\" film series.", "The film was directed by Joel Schumacher and written by Akiva Goldsman.", "It stars Arnold Schwarzenegger, George Clooney, Chris O'Donnell, Alicia Silverstone, and Uma Thurman.", "\"Batman & Robin\" tells the story of the titular characters as they attempt to prevent Mr. Freeze and Poison Ivy from freezing all mankind to death and repopulating the earth with mutant plants, while at the same time struggling to keep their partnership together.", "It is also to date the only live-action film appearance of Batgirl, who helps the title characters fight the villains.", "Warner Bros. fast-tracked development for \"Batman & Robin\" following the box office success of the previous film, \"Batman Forever\".", "Schumacher and Goldsman conceived the storyline during pre-production on \"A Time to Kill\", while Val Kilmer decided not to reprise the role over scheduling conflicts with \"The Saint\".", "Schumacher had a strong interest in casting William Baldwin in Kilmer's place before George Clooney won the role.", "Principal photography began in September 1996 and finished in January 1997, two weeks ahead of the shooting schedule." ], [ "Chris O'Donnell", "Chris O'Donnell\n\nChristopher Eugene O'Donnell (born June 26, 1970) is an American actor and former model.", "He played Charlie Simms in \"Scent of a Woman\", D'Artagnan in \"The Three Musketeers\", Jack Foley in the drama film \"Circle of Friends\", Dick Grayson/Robin in \"Batman Forever\" and \"Batman & Robin\", Jason Brown in Robert Altman's \"Cookie's Fortune\", and Peter Garrett in \"Vertical Limit\".", "O'Donnell currently stars as special Agent G. Callen on the CBS crime drama television series \"\", a spin-off of \"NCIS\".", "Christopher O'Donnell was born in Winnetka, Illinois, the son of William Charles O'Donnell, Sr., a general manager of WBBM-AM, and Julie Ann Rohs von Brecht.", "He is the youngest of seven children, with four sisters and two brothers, and is of German and Irish descent.", "He was raised in a Roman Catholic family and attended Roman Catholic schools, including Loyola Academy in Wilmette, Illinois for high school, graduating in 1988.", "He attended Boston College and graduated with a Bachelor of Science in marketing.", "He began modeling at the age of 13, and was featured in several commercials." ] ], "gold": "There has been a Batman and Robin serial, film, and animated TV series. American actor Johnny Duncan played the original Robin in the 1949 serial Batman and Robin. Actor and former model Chris O'Donnell did in the 1997 film Batman & Robin. Voice actor Loren Lester did in The Adventures of Batman & Robin, the retitled second season of the animated TV series Batman: The Animated Series.", "prediction 1": "Batman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin. It is the fourth and final installment of Warner Bros.' initial Batman film series. American actor and former model Christopher O'Donnell plays the original robin in the 1992 film. The original Robin was played by Johnny Duncan. The original Robin was played by John Bowman Duncan in the 1949 serial Batman and Robin.", "prediction 2": "Batman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin. American actor and model Johnny Duncan played the original robin in Batman & Robin. American actor Christopher O'Donnell played the original robin in Batman & Robin.", "prediction 3": "Batman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin. American actor Johnny Duncan played the first Robin in the 1949 serial \"Batman and Robin\". Christopher O'Donnell played the second Robin.", "prediction 4": "Batman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin. The first Batman and Robin film was released on August 12, 1949. The original Robin, who was played by Johnny Duncan, was played by Christopher O'Donnell in the first two films. The third film, Batman & Robin: Beyond the Dark Knight Rises, was a remake of the 1949 serial Batman and Robin. In the 1998 film, American actor and model Robert E. Howard played the role.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Batman & Robin is a 1997 American superhero film based on the DC Comics characters Batman and Robin. It is the fourth and final installment of Warner Bros.' initial Batman film series. American actor and former model Christopher O'Donnell plays the original robin in the 1992 film. The original Robin was played by Johnny Duncan. ", "start": 330, "end": 381 }, { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 184 }, { "error type": "Unverifiable", "explanation": "", "start": 271, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 100 } ], "missing-info": [], "corrected-prediction": "Batman & Robin is a 1997 American superhero film. American actor and former model Christopher O'Donnell plays the original robin in the film. The original Robin was played by Johnny Duncan in the 1949 serial Batman and Robin." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played austin reed on days of our lives?", "passages": [ [ "Austin Reed (Days of Our Lives)", "Austin Reed (Days of Our Lives)\n\nAustin Reed is a fictional character from the soap opera \"Days of Our Lives\".", "The role was played by actor Patrick Muldoon from 1992 to 1995, and again from 2011 to 2012.", "The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017.", "According to his storyline on the series, Austin Reed's birth name is unknown.", "His father, Curtis, took the children (Austin and his sister Billie) and changed their names to prevent their mother Kate Roberts from finding them.", "All that is known is that his original surname was Brown.", "Muldoon's return in 2011 was short-lived.", "In April 2012, it was announced that Muldoon, along with \nClark and several other actors, had been let go from the series.", "Muldoon tweeted: \"#DAYS been great 2 us.", "It will always be home.", "We all feel sick\".", "On September 15, 2016, it was announced that Peck would reprise his portrayal as Austin, alongside Christie Clark's Carrie.", "The couple returned on January 11, 2017 as Carrie (a lawyer) came to assistance her mother Anna.", "After accomplishing this, Peck and Clark departed on February 16, 2017." ], [ "Scott Elrod", "Scott Elrod\n\nScott Michael Elrod (born February 10, 1975) is an American actor.", "Elrod was born into an American military family in Bitburg, Germany.", "After moving around the Philippines with his family, he was raised in Parker, Colorado.", "His father was an F-16 pilot and Elrod wanted to become a pilot himself.", "He earned his pilot license after graduation and became an air traffic controller.", "After seeing the film \"Top Gun\", Elrod decided to become an actor.", "He relocated to Los Angeles, in April 2004, to pursue a career in acting.", "Eventually, his performances in small parts in \"\" and \"Days of Our Lives\" brought him to the attention of the casting crew of \"Men in Trees\", in which he played the part of Anne Heche's friend, occasional roommate, and sometimes love interest \"Cash\".", "In 2013, he starred in the films \"Home Run\" and \"Lone Survivor\".", "In 2016 he play's Meredith new man in Grey's Anatomy.", "On August 1, 2016, he was cast as celebrity Travis Brenner in Chicago Fire.", "In December 2015, Elrod announced he and fiance\u00e9, Vanessa Vazart, were expecting a child together.", "The couple welcomed son, Easton, in June 2016." ] ], "gold": "Austin Reed is a fictional character from the soap opera \"Days of Our Lives\". The role was played by actor Patrick Muldoon from 1992 to 1995, and again from 2011 to 2012. The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017. American actor Scott Michael Elrod played Austin Reed in 2020.", "prediction 1": "On Days of Our Lives, Austin Reed is played by various actors. The role was played by actor Patrick Muldoon from 1992 to 1995, again from 2011 to 2012. The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017. Then, in 2017, it was announced that Peck would reprise his portrayal as Austin, alongside Christie Clark's Carrie. On January 11, 2017, it was announced that Peck would reprise his portrayal as Austin, alongside Christie Clark's Carrie.", "prediction 2": "Austin Reed is a fictional character from the soap opera \"Days of Our Lives\". The role was played by actor Patrick Muldoon from 1992 to 1995, and again from 2011 to 2012. The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017.", "prediction 3": "On the television soap opera \"Days of Our Lives\", Austin Reed is portrayed by a number of actors. The role of Austin Reed was first played by actor Patrick Muldoon from 1992 to 1995, and again from 2011 to 2012. Austin Reed was then played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017.", "prediction 4": "The character Austin Reed from the soap opera Days of Our Lives was played by actor Patrick Muldoon from 1992 to 1995, and again from 2011 to 2012. The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 278, "end": 393 }, { "error type": "Redundant", "explanation": " Then, in 2017, it was announced that Peck would reprise his portrayal as Austin, alongside Christie Clark's Carrie. ", "start": 394, "end": 515 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Austin Reed is a fictional character from the soap opera \"Days of Our Lives\". The role was played by actor Patrick Muldoon from 1992 to 1995, again from 2011 to 2012. The character was played for a longer duration by actor Austin Peck, from 1995 to 2002, from 2005 to 2006, and again in 2017. " }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Where did the name boaty mcboatface come from?", "passages": [ [ "Boaty McBoatface", "Boaty McBoatface\n\nBoaty McBoatface is the lead boat of the \"Autosub Long Range\"-class of autonomous underwater vehicles (AUVs) used for scientific research that will be carried on the research vessel RRS \"Sir David Attenborough\" owned by the Natural Environment Research Council (NERC) and operated by the British Antarctic Survey (BAS).", "Because of its complexity and its extended range, NERC is classing it as an autosub long range autonomous vehicle.", "Although the name \"Boaty McBoatface\" was originally proposed in a March 2016 online poll to name the ship, it was eventually named RRS \"Sir David Attenborough\".", "Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McBoatface, a name the public liked and that quickly became the most popular choice.", "The name has been described as a homage to Hooty McOwlface, an owl named through an \"Adopt-A-Bird\" programme in 2012 that became popular on the internet." ] ], "gold": "Boaty McBoatface is the British lead boat in a fleet of three robotic Autosub Long Range (ALR) class of lithium battery-powered autonomous underwater vehicles (AUVs). The name Boaty McBoatface was originally proposed in a March 2016 online poll, the #NameOurShip poll, to name the \u00a3200 million polar scientific research ship for the Natural Environment Research Council (NERC). Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McBoatface, a name the public liked and that quickly became the most popular choice.", "prediction 1": "The name Boaty McBoatface came from former BBC Radio Jersey presenter James Hand, who jokingly suggested the name to the public that he liked. The name has been described as a homage to Hooty McOwlface, an owl named through an \"Adopt-A-Bird\" programme in 2012 that became popular on the internet.", "prediction 2": "Boaty McBoatface is the lead boat of the \"Autosub Long Range\"-class of autonomous underwater vehicles (AUVs) used for scientific research that will be carried on the research vessel RRS Sir David Attenborough owned by the Natural Environment Research Council (NERC) and operated by the British Antarctic Survey (BAS). Although the name \"Boaty McBoatface\" was originally proposed in a March 2016 online poll to name the ship, it was eventually named RRS Sir David Attenborough. Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McBoatface, a name the public liked and that quickly became the most popular choice.", "prediction 3": "Boaty McBoatface is the lead boat of the \"Autosub Long Range\"-class of autonomous underwater vehicles (AUVs) used for scientific research that will be carried on the research vessel RRS Sir David Attenborough owned by the Natural Environment Research Council (NERC) and operated by the British Antarctic Survey (BAS). Although the name \"Boaty McBoatface\" was originally proposed in a March 2016 online poll to name the ship, it was ultimately named RRS Sir David Attenborough. Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McBoatface, a name the public liked and that quickly became the most popular choice.", "prediction 4": "Boaty McBoatface is the lead boat of the \"Autosub Long Range\"-class of autonomous underwater vehicles (AUVs) used for scientific research and will be carried on the research vessel RRS Sir David Attenborough, owned by the Natural Environment Research Council (NERC) and operated by the British Antarctic Survey (BAS). Although the name \"Boaty McBoatface\" was originally proposed in a March 2016 online poll to name the ship, it was eventually named RRS Sir David Attenborough. Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McOwlface, a name the public liked and that quickly became the most popular choice.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 296 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Boaty McBoatface is the British lead boat in a fleet of three robotic Autosub Long Range (ALR) class of lithium battery-powered autonomous underwater vehicles (AUVs). Although the name \"Boaty McBoatface\" was originally proposed in a March 2016 online poll to name the ship, it was eventually named RRS \"Sir David Attenborough\". Former BBC Radio Jersey presenter James Hand jokingly suggested Boaty McBoatface, a name the public liked and that quickly became the most popular choice." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Which is a type of star found on the lower end of the main sequence?", "passages": [ [ "Main sequence", "The main sequence is sometimes divided into upper and lower parts, based on the dominant process that a star uses to generate energy.", "Stars below about 1.5 times the mass of the Sun () primarily fuse hydrogen atoms together in a series of stages to form helium, a sequence called the proton\u2013proton chain.", "Above this mass, in the upper main sequence, the nuclear fusion process mainly uses atoms of carbon, nitrogen and oxygen as intermediaries in the CNO cycle that produces helium from hydrogen atoms.", "Main-sequence stars with more than two solar masses undergo convection in their core regions, which acts to stir up the newly created helium and maintain the proportion of fuel needed for fusion to occur.", "Below this mass, stars have cores that are entirely radiative with convective zones near the surface.", "With decreasing stellar mass, the proportion of the star forming a convective envelope steadily increases.", "Main-sequence stars below undergo convection throughout their mass.", "When core convection does not occur, a helium-rich core develops surrounded by an outer layer of hydrogen.", "In general, the more massive a star is, the shorter its lifespan on the main sequence.", "After the hydrogen fuel at the core has been consumed, the star evolves away from the main sequence on the HR diagram, into a supergiant, red giant, or directly to a white dwarf." ], [ "Main sequence", "Thus the star forms a self-regulating system in hydrostatic equilibrium that is stable over the course of its main sequence lifetime.", "Main-sequence stars employ two types of hydrogen fusion processes, and the rate of energy generation from each type depends on the temperature in the core region.", "Astronomers divide the main sequence into upper and lower parts, based on which of the two is the dominant fusion process.", "In the lower main sequence, energy is primarily generated as the result of the proton-proton chain, which directly fuses hydrogen together in a series of stages to produce helium.", "Stars in the upper main sequence have sufficiently high core temperatures to efficiently use the CNO cycle.", "(See the chart.)", "This process uses atoms of carbon, nitrogen and oxygen as intermediaries in the process of fusing hydrogen into helium.", "At a stellar core temperature of 18 million Kelvin, the PP process and CNO cycle are equally efficient, and each type generates half of the star's net luminosity.", "As this is the core temperature of a star with about 1.5 , the upper main sequence consists of stars above this mass.", "Thus, roughly speaking, stars of spectral class F or cooler belong to the lower main sequence, while A-type stars or hotter are upper main-sequence stars.", "The transition in primary energy production from one form to the other spans a range difference of less than a single solar mass." ] ], "gold": "Stars below about 1.5 times the mass of the Sun, based on mass, are types of stars found on the lower end of the main sequence. Based on spectral class, stars of spectral class F or cooler are found on the lower end of the main sequence.", "prediction 1": "On the lower end of the main sequence there are stars of the class F or cooler. At a stellar core temperature of 18 million Kelvin, the proton-proton chain is the dominant fusion process.", "prediction 2": "On the lower end of the main sequence, the proton\u2013proton chain is the predominant fusion process. In the lower main sequence, energy is primarily generated as the result of the proton\u2013proton chain, which directly fuses hydrogen together in a series of stages to produce helium. In the upper main sequence, the nuclear fusion process uses atoms of carbon, nitrogen and oxygen as intermediaries in the CNO cycle that produces helium from hydrogen atoms.", "prediction 3": "In the lower main sequence, energy is primarily generated as the result of the proton-proton chain, which directly fuses hydrogen together in a series of stages to produce helium. Stars below about 1.5 times the mass of the Sun are stars of spectral class F or cooler, while A-type stars or hotter are upper main-sequence stars.", "prediction 4": "The main sequence is sometimes divided into upper and lower parts, based on the dominant process that a star uses to generate energy. At the lower end of the main sequence, the proton-proton chain, or PP, is the dominant fusion process. At the upper end of the main sequence, the CNO cycle, or A-type star, is the dominant fusion process.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 187 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Stars below about 1.5 times the mass of the Sun, based on mass, are types of stars found on the lower end of the main sequence. On the lower end of the main sequence there are stars of the class F or cooler. " }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who is the villain in the little mermaid?", "passages": [ [ "Ursula (The Little Mermaid)", "When Ashman cast his second choice, Broadway actress Elaine Stritch, as Ursula, both stage veterans disagreed about the manner in which Ursula's song \"Poor Unfortunate Souls\" would be performed, and Pat Carroll was finally hired to replace Stritch after Ashman fired her.", "Deepening her own voice for the role, Carroll based her performance on a combination of Shakespearean actresses and car salespeople.", "Animated by Ruben A. Aquino, Ursula's original design was inspired by several different sea creatures, including manta rays and scorpion fish, before Clements finally decided to base the character on an octopus; her number of tentacles was reduced from eight to six for financial reasons.", "Ursula's appearance was also inspired by American actor and drag queen Divine.", "When \"The Little Mermaid\" was first released in 1989, Ursula was immediately embraced as one of Disney's best villains, and continues to be ranked highly among the studio's greatest by the media.", "Praised for being humorous and frightening, the character has garnered positive reviews from film critics, some of whom dubbed her Disney's strongest villain in decades.", "Meanwhile, Carroll's performance has garnered similar acclaim to the point that the role has eclipsed her previous body of work, ultimately becoming virtually synonymous with the character." ], [ "The Little Mermaid II: Return to the Sea", "With the trident in her power, Morgana reveals her true intentions, then reveals to Melody that she stole from her grandfather and throws her against the wall, trapping her in a cave by sealing the entrance with a thick layer of ice and informing her that her time as a mermaid is about to expire.", "Soon afterward, Morgana's spell on Melody wears off, causing her to revert into a human and nearly drown.", "Tip and Dash manage to free her and drag her to the shore.", "Morgana uses the trident's magic to lord over the ocean, rising to the surface to gloat.", "Scuttle, Triton, Sebastian, and Eric arrive, and a battle ensues against Morgana and her minions.", "Melody manages to grab the trident and throws it back to Triton, who encases Morgana in a block of ice, which sinks underwater.", "Melody reunites with her family, and Triton offers his granddaughter the choice of becoming a mermaid permanently.", "Instead, Melody uses the trident to disintegrate the wall separating her home from the sea, reuniting the humans and the merpeople.", "The film was released directly-to-video on September 19, 2000.", "On November 6, 2006, the film was released in a bundle together with the original film in the Region 2 release." ] ], "gold": "The Little Mermaid is a 1989 American animated musical fantasy film produced by Walt Disney Feature Animation and Walt Disney Pictures and released to critical and commercial success on November 17, 1989, spawning two direct-to-video sequels and a TV show. Each of them has had their own respective villains, with Ursula filling in the role for the original 1989 film. The Little Mermaid II: Return to the Sea and The Little Mermaid: Ariel's Beginning saw the characters of Morgana and Marina del Rey as their respective main antagonists. The TV series, which ran for 31 episodes, had the Lobster Monster, a red-violet lobster gangster following the style of the 1920s gangster stereotype, Da Shrimp, the Monster Lobster's sidekick, and Manta, an evil human/manta ray hybrid who repeatedly tries to take over Atlantica, as its villains.", "prediction 1": "The Little Mermaid is a 1989 animated film that tells the story of Morgana the mermaid. Ursula is the villain of the film.", "prediction 2": "Ursula is the villain of The Little Mermaid. She is played by Pat Carroll.", "prediction 3": "There are several villains in the Disney animated film, including Morgana, the mermaid, and her minions. Morgana's minions include Scuttle, Triton, Sebastian, and Eric, who encase Morgana in a block of ice, which sinks underwater.", "prediction 4": "The Little Mermaid is a Disney animated film that was released in 1989. Ursula, the villain of the film, is played by Pat Carroll.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 43, "end": 87 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 5 ] } ], "corrected-prediction": "The Little Mermaid is a 1989 animated film. Ursula is the villain of the film. The Little Mermaid II: Return to the Sea had Morgana as its villain." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Where is the lake district national park located?", "passages": [ [ "United Kingdom", "United Kingdom\n\nThe United Kingdom, officially the United Kingdom of Great Britain and Northern Ireland but more commonly known as the UK or Britain, is a sovereign country lying off the north-western coast of the European mainland.", "The United Kingdom includes the island of Great Britain, the north-eastern part of the island of Ireland and many smaller islands.", "Northern Ireland is the only part of the United Kingdom that shares a land border with another sovereign statethe Republic of Ireland.", "Apart from this land border, the United Kingdom is surrounded by the Atlantic Ocean, with the North Sea to the east, the English Channel to the south and the Celtic Sea to the south-west, giving it the 12th-longest coastline in the world.", "The Irish Sea lies between Great Britain and Ireland.", "With an area of , the United Kingdom is the 78th-largest sovereign state in the world.", "It is also the 22nd-most populous country, with an estimated 66.0 million inhabitants in 2017.", "The UK is a unitary parliamentary democracy and constitutional monarchy.", "The current monarch is Queen Elizabeth II, who has reigned since 1952, making her the longest-serving current head of state.", "The United Kingdom's capital and largest city is London, a global city and financial centre with an urban area population of 10.3 million.", "Other major urban areas in the UK include Manchester, Birmingham, Leeds, Glasgow, Liverpool, and Newcastle." ], [ "Lake District", "Lake District\n\nThe Lake District, also known as the Lakes or Lakeland, is a mountainous region in North West England.", "A popular holiday destination, it is famous for its lakes, forests and mountains (or \"fells\"), and its associations with William Wordsworth and other Lake Poets and also with Beatrix Potter and John Ruskin.", "The National Park was established in 1951 and covers an area of 2,362 square kilometres.", "It was designated a UNESCO World Heritage Site in 2017.", "The Lake District is located entirely within the county of Cumbria.", "All the land in England higher than above sea level lies within the National Park, including Scafell Pike, the highest mountain in England.", "It also contains the deepest and largest natural lakes in England, Wast Water and Windermere respectively.", "The Lake District National Park includes all of the central Lake District, though the town of Kendal, some coastal areas, and the Lakeland Peninsulas are outside the park boundary.", "The area was designated a national park on 9 May 1951 (less than a month after the first UK national park designation \u2014 the Peak District).", "It retained its original boundaries until 2016 when it was extended by 3% in the direction of the Yorkshire Dales National Park to incorporate areas such as land of high landscape value in the Lune Valley." ], [ "England", "The northern uplands include the Pennines, a chain of uplands dividing east and west, the Lake District mountains in Cumbria, and the Cheviot Hills, straddling the border between England and Scotland.", "The highest point in England, at , is Scafell Pike in the Lake District.", "The Shropshire Hills are near Wales while Dartmoor and Exmoor are two upland areas in the south-west of the country.", "The approximate dividing line between terrain types is often indicated by the Tees-Exe line.", "In geological terms, the Pennines, known as the \"backbone of England\", are the oldest range of mountains in the country, originating from the end of the Paleozoic Era around 300\u00a0million years ago.", "Their geological composition includes, among others, sandstone and limestone, and also coal.", "There are karst landscapes in calcite areas such as parts of Yorkshire and Derbyshire.", "The Pennine landscape is high moorland in upland areas, indented by fertile valleys of the region's rivers.", "They contain two national parks, the Yorkshire Dales and the Peak District.", "In the West Country, Dartmoor and Exmoor of the Southwest Peninsula include upland moorland supported by granite, and enjoy a mild climate; both are national parks." ] ], "gold": "The Lake District National Park is located in the U.K. in North West England region of Cumbria county, England.", "prediction 1": "The Lake District National Park is located in North West England, in the county of Cumbria. It was established in 1951 and covers an area of 2,362 square kilometres. The park includes all of the central Lake District, though the town of Kendal, some coastal areas, and the Lakeland Peninsulas are outside the park boundary.", "prediction 2": "The lake district national park is located in Cumbria, England, England. The park was established in 1951 and covers an area of 2,362 square kilometres. The town of Kendal, some coastal areas, and the Lakeland Peninsulas are outside the park boundary.", "prediction 3": "The Lake District National Park is located in North West England in the United Kingdom. It was established in 1951 and covers an area of 2,362 square kilometres and was designated a UNESCO World Heritage Site in 2017. The Lake District is located entirely within the county of Cumbria.", "prediction 4": "The Lake District National Park is a mountainous region in North West England in the United Kingdom. It is located entirely within the county of Cumbria and includes all of the central Lake District, though the town of Kendal, some coastal areas, and the Lakeland Peninsulas are outside the park boundary.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 323 } ], "missing-info": [], "corrected-prediction": "The Lake District National Park is located in North West England, in the county of Cumbria. " }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "When did the us go off the gold standard?", "passages": [ [ "History of the United States dollar", "At the onset of the war, U.S. corporations had large debts payable to European entities, who began liquidating their debts in gold.", "With debts looming to Europe, the dollar to British pound exchange rate reached as high as $6.75, far above the (gold) parity of $4.8665.", "This caused large gold outflows until July 31, 1914, when the New York Stock Exchange closed and the gold standard was temporarily suspended.", "In order to defend the exchange value of the dollar, the US Treasury Department authorized state and nationally chartered banks to issue emergency currency under the Aldrich-Vreeland Act, and the newly created Federal Reserve organized a fund to assure debts to foreign creditors.", "These efforts were largely successful, and the Aldrich-Vreeland notes were retired starting in November and the gold standard was restored when the New York Stock Exchange re-opened in December 1914.", "As the United States remained neutral in the war, it remained the only country to maintain its gold standard, doing so without restriction on import or export of gold from 1915 to 1917.", "During the participation of the United States as a belligerent, President Wilson banned gold export, thereby suspending the gold standard for foreign exchange.", "After the war, European countries slowly returned to their gold standards, though in somewhat altered form." ], [ "History of the United States dollar", "During the Great Depression, every major currency abandoned the gold standard.", "Among the earliest, the Bank of England abandoned the gold standard in 1931 as speculators demanded gold in exchange for currency, threatening the solvency of the British monetary system.", "This pattern repeated throughout Europe and North America.", "In the United States, the Federal Reserve was forced to raise interest rates in order to protect the gold standard for the US dollar, worsening already severe domestic economic pressures.", "After bank runs became more pronounced in early 1933, people began to hoard gold coins as distrust for banks led to distrust for paper money, worsening deflation and depleting gold reserves.", "In early 1933, in order to fight severe deflation Congress and President Roosevelt implemented a series of Acts of Congress and Executive Orders which suspended the gold standard except for foreign exchange, revoked gold as universal legal tender for debts, and banned private ownership of significant amounts of gold coin.", "These acts included Executive Order 6073, the Emergency Banking Act, Executive Order 6102, Executive Order 6111, the Agricultural Adjustment Act, 1933 Banking Act, House Joint Resolution 192, and later the Gold Reserve Act.", "These actions were upheld by the U.S. Supreme Court in the \"Gold Clause Cases\" in 1935." ], [ "Exorbitant privilege", "In France, it was called \"America's exorbitant privilege\" as it resulted in an \"asymmetric financial system\" where foreigners \"see themselves supporting American living standards and subsidizing American multinationals\".", "As American economist Barry Eichengreen summarized: \"It costs only a few cents for the Bureau of Engraving and Printing to produce a $100 bill, but other countries had to pony up $100 of actual goods in order to obtain one.\"", "In February 1965 President Charles de Gaulle announced his intention to exchange its U.S. dollar reserves for gold at the official exchange rate.", "He sent the French Navy across the Atlantic to pick up the French reserve of gold and was followed by several countries.", "As it resulted in considerably reducing U.S. gold stock and U.S. economic influence, it led U.S. President Richard Nixon to end unilaterally the convertibility of the dollar to gold on August 15, 1971 (the \"Nixon Shock\").", "This was meant to be a temporary measure but the dollar became permanently a floating fiat money and in October 1976, the U.S. government officially changed the definition of the dollar; references to gold were removed from statutes." ] ], "gold": "The US went off the gold standard for the first time on July 31, 1914. When the United States became a belligerent in the war, they were temporarily taken off the gold standard for the second time on April 6, 1917. The third temporary time being taken off the gold standard was in early 1933. Then, the US was taken permanently off the gold standard on August 15, 1971.", "prediction 1": "The United States went off the gold standard on July 31, 1914, the day the New York Stock Exchange closed and the gold standard was temporarily suspended. This was due to U.S. corporations having large debts payable to European entities, who began liquidating their debts in gold. The gold standard was restored on December 14, 1914, when the New York Stock Exchange re-opened.", "prediction 2": "In the United States, there were several times that the gold standard was abandoned. The Gold Standard Act in 1933 and the Gold Standard Act in 1971 were both passed by Congress. The United States went off the gold standard on July 15, 1971, and the Gold Standard Act in 1974.", "prediction 3": "The United States went off the gold standard in early 1933, when Congress and President Roosevelt implemented a series of Acts of Congress and Executive Orders which suspended the gold standard except for foreign exchange, revoked gold as universal legal tender for debts, and banned private ownership of significant amounts of gold coin. This was meant to be a temporary measure but the dollar became permanently a floating fiat money on August 15, 1971.", "prediction 4": "In 1913 the gold standard was suspended for all but a few months. Then in early 1933 President Roosevelt signed several Acts of Congress and Executive Orders suspending the gold standard except for foreign exchange, revoked gold as universal legal tender for debts, and banned private ownership of significant amounts of gold coin. In February 1965, President Charles de Gaulle announced his intention to exchange its U.S. dollar reserves for gold at the official exchange rate. This was meant to be a temporary measure but the dollar became permanently a floating fiat money and in October 1976, the dollar became a floating fiat money.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 280 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The United States went off the gold standard on July 31, 1914, the day the New York Stock Exchange closed and the gold standard was temporarily suspended. In early 1933, in order to fight severe deflation Congress and President Roosevelt implemented a series of Acts of Congress and Executive Orders which suspended the gold standard. The US was taken permanently off the gold standard on August 15, 1971." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does the new descendants 2 movie come out?", "passages": [ [ "Descendants 2", "On June 10, 2016, China Anne McClain, who was already voicing Freddie on the \"Descendants\" spinoff series \"\", was announced to be playing Ursula's daughter, Uma, in \"Descendants 2\".", "In July 2016 it was revealed that Thomas Doherty would play the role of Harry, the son of Captain Hook.", "In August 2016, Sarah Jeffery who portrays Audrey revealed that she would not be returning, while Brenna D'Amico revealed that she would be returning in \"Descendants 2\", as were as Dianne Doan, Jedidiah Goodacre, and Zachary Gibson.", "On July 19, 2017, it was announced on \"The View\" that Whoopi Goldberg would be providing the voice for Ursula, the Sea Witch and Uma's mother.", "\"Descendants 2\" made its debut on Disney Channel in Canada on July 21, 2017, at the same time as the United States.", "In the United States, the film premiered simultaneously across six-Disney owned networks: Disney Channel, Disney XD, Freeform, ABC, Lifetime, and Lifetime Movies.", "On Disney Channel, the film premiered alongside the world premiere of \"Raven's Home\", which premiered immediately after.", "In the UK, the film premiered on Disney Channel and Disney XD on October 20, 2017.", "In South Africa it premiered on the October 6, 2017." ], [ "Descendants 2", "Descendants 2\n\nDescendants 2 is an American musical fantasy television film.", "It premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies.", "It is the second installment in the \"Descendants\" franchise and the sequel to the 2015 film \"Descendants\".", "The film stars Dove Cameron, Cameron Boyce, Sofia Carson, Booboo Stewart, Mitchell Hope and China Anne McClain.", "A third film, \"Descendants 3\", will premiere in 2019.", "Mal struggles with her new celebrity life as the girlfriend of King Ben, putting a spell on her hair making it blonde, and maintaining a princess-like personality that she is uncomfortable with.", "She admits her issues to her friends Evie, Carlos, and Jay, but they are content with their new lives in Auradon and do not wish to return to the Isle of the Lost.", "Evie scolds Mal for relying on her mother's spell book to solve her issues.", "Carlos, wishing to ask Jane to the upcoming Cotillion dance, turns to Mal for help to be honest with her.", "Mal gives him a sweet that will make him speak the truth, but his dog Dude eats it, magically speaking the truth in English and very frankly as a result." ] ], "gold": "American musical fantasy television film Descendants 2 made its debut on Disney Channel and other Disney-owned networks in the United States and Canada on July 21, 2017. The film later premiered in South Africa on October 6, 2017, in the UK on October 20, 2017, and in India on December 23, 2018.", "prediction 1": "Descendants 2 is an American musical fantasy television film that premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies. In the United States, the film premiered simultaneously across six-Disney owned networks: Disney Channel, Disney XD, Freeform, ABC, Lifetime and Lifetime Movies. In the UK, the film premiered on Disney Channel and Disney XD on October 20, 2017 and October 6, 2017. In South Africa it premiered on October 6, 2017. In Canada, it premiered on October 6, 2017. In the United States it premiered simultaneously across six-Disney owned networks: Disney Channel Canada on July 21, 2017, and was simulcast on October 20, 2017. In Canada, it premiered on October 7, 2017.", "prediction 2": "Descendants 2 is an American musical fantasy television film that debuted as a Disney Channel Original Movie on July 21, 2017 in the United States, Canada and the UK, and premiered in South Africa on October 6, 2017.", "prediction 3": "Descendants 2 is an American musical fantasy television film. It premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime, and Lifetime Movies. Descendants 3 is an American musical fantasy television film based on the 2015 film Descendants and the sequel to the 2015 film Descendants.", "prediction 4": "Descendants 2 is an American musical fantasy television film. It premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies. It is the sequel to the 2015 film Descendants. Descendants 3 will premiere in 2019.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Descendants 2 is an American musical fantasy television film that premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies. ", "start": 246, "end": 407 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[8]}", "start": 490, "end": 510 }, { "error type": "Irrelevant", "explanation": "", "start": 438, "end": 469 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 587, "end": 603 }, { "error type": "Redundant", "explanation": "Descendants 2 is an American musical fantasy television film that premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies. ", "start": 607, "end": 765 }, { "error type": "Redundant", "explanation": "In Canada, it premiered on October 6, 2017.", "start": 766, "end": 809 } ], "missing-info": [], "corrected-prediction": "Descendants 2 is an American musical fantasy television film that premiered as a Disney Channel Original Movie on July 21, 2017 on Disney Channel, and was simulcast on Disney-owned networks ABC, Disney XD, Freeform, Lifetime and Lifetime Movies. In the UK, the film premiered on October 20, 2017. In South Africa it premiered on October 6, 2017. In Canada, it premiered on July 21, 2017." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Who played the witch in the original wizard of oz?", "passages": [ [ "The Wizard of Oz (1939 film)", "The Wizard of Oz (1939 film)\n\nThe Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer.", "Widely considered to be one of the greatest films in cinema history, it is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book \"The Wonderful Wizard of Oz.\"", "It was directed primarily by Victor Fleming (who left production to take over direction on the troubled \"Gone with the Wind\" production).", "It stars Judy Garland as Dorothy Gale, alongside Ray Bolger, Jack Haley, Bert Lahr, Frank Morgan, Billie Burke, and Margaret Hamilton, with Charley Grapewin, Pat Walshe, and Clara Blandick, Terry (billed as Toto), and Singer's Midgets as the Munchkins.", "Legendary for its use of Technicolor, fantasy storytelling, musical score and memorable characters, the film has become an icon of American popular culture.", "It was nominated for six Academy Awards, including Best Picture, but lost to \"Gone with the Wind\".", "It did win in two other categories: Best Original Song for \"Over the Rainbow\" and Best Original Score by Herbert Stothart." ], [ "Margaret Hamilton (actress)", "Margaret Hamilton (actress)\n\nMargaret Brainard Hamilton (December 9, 1902\u00a0\u2013 May 16, 1985) was an American film character actress best known for her portrayal of Miss Gulch and the Wicked Witch of the West in Metro-Goldwyn-Mayer's classic film \"The Wizard of Oz\" (1939).", "A former schoolteacher, she worked as a character actress in films for seven years before she was offered the role that defined her public image.", "In later years, Hamilton made frequent cameo appearances on television sitcoms and commercials.", "She also gained recognition for her work as an advocate of causes designed to benefit children and animals, and retained a lifelong commitment to public education.", "The Wicked Witch of the West was eventually ranked number four in the American Film Institute's 2003 list of the 50 Best Movie Villains of All Time, making her the top-ranking female villain.", "Hamilton was born to Walter J. Hamilton, and his wife, Mary Jane (n\u00e9e Adams; known by her nickname, Jennie), in Cleveland, Ohio, and was the youngest of four children.", "She later attended Hathaway Brown School, while the school was located at 1945 East 93rd Street in Cleveland.", "Drawn to the theater at an early age, Hamilton made her stage debut in 1923.", "Hamilton also practiced her craft doing children's theater while she was a Junior League of Cleveland member." ], [ "Billie Burke", "Billie Burke\n\nMary William Ethelbert Appleton Burke (August 7, 1884 \u2013 May 14, 1970) known professionally as Billie Burke, was an American actress who was famous on Broadway, on radio, early silent film, and subsequently in sound film.", "She is best known to modern audiences as Glinda the Good Witch of the North in the movie musical \"The Wizard of Oz\" (1939).", "Burke was nominated for the Academy Award for Best Supporting Actress in 1938 for her performance as Emily Kilbourne in \"Merrily We Live\" and is also remembered for her appearances in the \"Topper\" film series.", "Her high-pitched, wavering, aristocratic voice was her trademark, which made her a frequent choice to play dim-witted, spoiled society types.", "Billie Burke was the wife of Broadway producer Florenz Ziegfeld, Jr., of Ziegfeld Follies fame, from 1914 until his death in 1932.", "Billie Burke was born Mary Burke, the daughter of William \"Billy\" Burke and Blanche (n\u00e9e Beatty; 1844\u20131921), in Washington, D.C.", "She toured the United States and Europe with her father, who was a singer and clown and worked for the Barnum & Bailey Circus.", "Her family ultimately settled in London where she attended plays in the West End." ] ], "gold": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer. Margaret Hamilton was an American film actress best known for her portrayal of the Wicked Witch of the West, and her Kansas counterpart Almira Gulch, in The Wizard of Oz. Billie Burke, an American actress who was famous on Broadway and radio, and in silent and sound films, played Glinda the Good Witch.", "prediction 1": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer. Widely considered to be one of the greatest films in cinema history, it is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book The Wonderful Wizard of Oz. In the original film, Judy Garland played Dorothy Gale, while Billie Burke played the Wicked Witch of the West. In the original film, Margaret Hamilton played the Witch of the West.\n", "prediction 2": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer, and is widely considered to be one of the greatest films in cinema history. It stars Judy Garland as Dorothy Gale, alongside Ray Bolger, Jack Haley, Bert Lahr, Frank Morgan, Billie Burke, and Margaret Hamilton, with Charley Grapewin, Pat Walshe, and Clara Blandick, Terry (billed as Toto), and Singer's Midgets as the Munchkins. In the original Wizard of Oz, Billie Burke played the Wicked Witch of the West. In the movie the 1989 adaptation of the book, the character was played by Annie Bloom, when Shk Olivia Lee Blair-Marie King, who played Glinda, while Catan Taylor Young was played the Good Witch of the West.", "prediction 3": "The original Wizard of Oz was played by a number of actors. Margaret Brainard Hamilton, a member of the Wicked Witch of the West cast in the famous non-stop 1940s film The Wizard of Oz, and Billie Burke played the evil witch. Dorothy Gale is played by Judy Garland in the non-stop film version of The Wizard of Oz. Mary William Ethelbert Appleton Burke played Glinda the Good Witch of the North in the 1939 movie musical The Wizard of Oz. The actress who played Glinda in the original version of The Wonderful Wizard of Oz is played by Angie Medicare impatient and Barbara D. The role of the evil witch in the book was played by Billie Burke, a British actress.", "prediction 4": "The Wicked Witch of the West was played by Margaret Brainard Hamilton in the film The Wizard of Oz, while the part was played by actress Billie Burke.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 374, "end": 403 }, { "error type": "Redundant", "explanation": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer. Widely considered to be one of the greatest films in cinema history, it is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book The Wonderful Wizard of Oz. In the original film, ", "start": 404, "end": 425 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 451, "end": 460 }, { "error type": "Irrelevant", "explanation": "", "start": 90, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 347 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer. In the original film, Billie Burke, American actress who was famous on Broadway, on radio, early silent film, and subsequently in sound film, played Glenda the Good Witch. Margaret Hamilton, an American film actress, is best known for her portrayal of Miss Gulch and the Wicked Witch of the West.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did my hero academia season 2 end?", "passages": [ [ "Case Closed (season 2)", "Case Closed (season 2)\n\nThe second season of the \"Case Closed\" anime was directed by Kenji Kodama and produced by TMS Entertainment and Yomiuri Telecasting Corporation.", "The series is based on Gosho Aoyama's \"Case Closed\" manga series.", "In Japan, the series is titled but was changed due to legal issues with the title \"Detective Conan\".", "The episodes' plot continues Jimmy Kudo's life as a young child named Conan Edogawa.", "The episodes features a temporary return of Jimmy Kudo.", "The season initially ran from August 19, 1996 through April 14, 1997 on Nippon Television Network System in Japan.", "Episodes twenty-nine to fifty-four were later collected into seven DVD compilations by Shogakukan and were released on February 24, 2006.", "The season licensed and dubbed by Funimation Entertainment.", "\"Case Closed\" was aired on Cartoon Network's Adult Swim programming block and on Canada's YTV station.", "Case Closed aired until August 16, 2004, where it was dropped by Adult Swim due to low ratings.", "The English adaption was later collected and released on four DVD compilations.", "The English adaption of season two was later released in a DVD boxset by Funimation on September 30, 2008 containing episodes twenty-seven to fifty-two, twenty-six to fifty-one in the Japanese numbering." ] ], "gold": "My Hero Academia season 2 ended in Japan on September 30, 2017, and in English on February 24, 2019.", "prediction 1": "Season 2 of my hero academia ended on April 13, 2008, after 11 episodes.", "prediction 2": "My Hero Academia season 2 ended on August 16, 2004. The second season of the \"Case Closed\" anime was directed by Kenji Kodama and produced by TMS Entertainment and Yomiuri Telecasting Corporation.", "prediction 3": "Season 2 of my hero academia ended on May 30, 2008.", "prediction 4": "Season 2 of My Hero Academia was directed by Kenji Kodama and produced by TMS Entertainment and Yomiuri Telecasting Corporation. The anime series is based on Gosho Aoyama's Case Closed manga series. Episodes twenty-nine to fifty-four were later collected into seven DVD compilations by Shogakukan and were released on February 24, 2006.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 72 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The season initially ran from August 19, 1996 through April 14, 1997 on Nippon Television Network System in Japan." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Who sings vocals on the nights by avicii?", "passages": [ [ "The Nights", "The Nights\n\n\"The Nights\" is a song by Swedish DJ and record producer Avicii.", "It features uncredited vocals by Nicholas Furlong, who co-wrote the song with Jordan Suecof, Gabriel Benjamin, and John Feldmann.", "On 1 December 2014, it was released as a digital download by PRMD Music and Universal Island on Avicii's \"The Days / Nights EP\", then on 11 January 2015 in the United Kingdom.", "The song peaked at number six on the UK Singles Chart and number one on the UK Dance Chart.", "On 23 January 2015, Avicii released \"The Nights (Avicii by Avicii)\", his own remix of the song.", "The song appears on the UK version of Avicii's second studio album \"Stories\" (2015).", "Furlong noted that he began writing the song as an ode to his father.", "The inspiration for the \u201cpirate-y fight song\u201d sound came to him while at a bar in Ireland.", "Furlong recalled: \"I had been going back and forth with Jordan and Gabe about this song idea that merged commercially sound rock music with the signature sound of an Irish drinking song.", "When I returned to Los Angeles we all went into the studio.\"", "Furlong sent the original idea, titled \"My Father Told Me\", to Arash Pournouri, Avicii's manager." ] ], "gold": "\"The Nights\" is a song by Swedish DJ and record producer Avicii and singer/songwriter Nicholas Furlong. It was released on 1 December 2014 as a digital download by PRMD Music and Universal Island on Avicii's \"The Days / Nights\" EP. The song peaked at number six on the UK Singles Chart and number one on the UK Dance Chart. \"The Nights\" contains uncredited main vocals by Nicholas Furlong, with The Mighty Riot performing additional vocals.", "prediction 1": "The Nights is a song by Swedish DJ and record producer Avicii. It features uncredited vocals by Nicholas Furlong, who co-wrote the song with Jordan Suecof, Gabriel Benjamin, and John Feldmann.", "prediction 2": "\"The Nights\" is a song by Swedish DJ and record producer Avicii. It features uncredited vocals by Nicholas Furlong, who co-wrote the song with Jordan Suecof, Gabriel Benjamin, and John Feldmann. On 1 December 2014, it was released as a digital download by PRMD Music and Universal Island on Avicii's \"The Days / Nights EP\", then on 11 January 2015 in the United Kingdom.", "prediction 3": "\"The Nights\" is a song by Swedish DJ and record producer Avicii. It features uncredited vocals by Nicholas Furlong, who co-wrote the song with Jordan Suecof, Gabriel Benjamin, and John Feldmann.", "prediction 4": "Nicholas Furlong sings uncredited vocals on The Nights by Avicii.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 192 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Nights is a song by Swedish DJ and record producer Avicii. It features uncredited vocals by Nicholas Furlong. The cast includes Bruce Willis, Toni Collette, and child actor Haley Joel Osment. The song peaked at number six on the UK Singles Chart and number one on the UK Dance Chart." }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Which actor was the star of the movie the sixth sense?", "passages": [ [ "Haley Joel Osment", "Haley Joel Osment\n\nHaley Joel Osment (born April 10, 1988) is an American actor.", "After a series of roles in television and film during the 1990s, including a major part in \"Forrest Gump\" playing the title character's son (also named Forrest Gump), Osment rose to fame for his performance as a young unwilling medium in M. Night Shyamalan's thriller film \"The Sixth Sense\", which earned him a nomination for the Academy Award for Best Supporting Actor.", "He subsequently appeared in leading roles in several high-profile Hollywood films, including Steven Spielberg's \"A.I. Artificial Intelligence\" and Mimi Leder's \"Pay It Forward\".", "He made his Broadway debut in 2008 in a short-lived revival of David Mamet's play \"American Buffalo\", starring John Leguizamo and Cedric the Entertainer.", "Osment is also known for his voice-roles of Sora and Vanitas in the \"Kingdom Hearts\" video games, as well as his more recent roles in comedies such as \"Sex Ed\" and \"The Spoils of Babylon\".", "Osment was born in Los Angeles, California, the son of Theresa (n\u00e9e Seifert), a teacher, and Michael Eugene Osment, a theater and film actor, both natives of Birmingham, Alabama.", "Osment was raised Roman Catholic." ], [ "Haley Joel Osment", "In addition, he made numerous guest appearances on shows, including \"The Larry Sanders Show\", \"Walker, Texas Ranger\", \"Touched by an Angel\", \"Chicago Hope\", \"The Pretender\", and \"Ally McBeal\".", "He appeared in the 1996 film \"Bogus\", alongside Whoopi Goldberg and G\u00e9rard Depardieu and the 1998 made-for-TV movie \"The Lake\", as well as \"I'll Remember April\" (1999), with future \"The Sixth Sense\" co-star Trevor Morgan.", "Osment first achieved stardom in 1999, when he appeared in \"The Sixth Sense\", co-starring Bruce Willis.", "For his portrayal of Cole Sear, a psychic child, Osment won the Saturn Award for Best Performance by a Younger Actor.", "He was also nominated for the Academy Award for Best Supporting Actor, becoming the second-youngest performer ever to receive an Academy nomination for a supporting role, but lost the final Oscar vote to Michael Caine (with whom he would later work, appearing together in \"Secondhand Lions\").", "One of Osment's lines in \"The Sixth Sense\", \"I see dead people,\" became a popular catchphrase and is often repeated or parodied on television programs and in other media." ], [ "The Sixth Sense", "The Sixth Sense\n\nThe Sixth Sense is a 1999 American supernatural horror film written and directed by M. Night Shyamalan.", "The film tells the story of Cole Sear (Haley Joel Osment), a troubled, isolated boy who is able to see and talk to the dead, and an equally troubled child psychologist named Malcolm Crowe (Bruce Willis) who tries to help him.", "The film established Shyamalan as a writer and director, and introduced the cinema public to his traits, most notably his affinity for surprise endings.", "Released by Hollywood Pictures on August 6, 1999, the film was well-received by critics; praise was given to its acting performances (particularly Willis, Osment, and Toni Collette), atmosphere, and twist conclusion.", "\"The Sixth Sense\" was the second-highest-grossing film of 1999 (behind \"\"), taking about $293 million in the US and $379 million in other markets.", "This made it the highest-grossing horror film (in unadjusted dollars) until that time; it was surpassed by \"It\" in 2017.", "The film was nominated for six Academy Awards, including Best Picture, Best Director for Shyamalan, Best Original Screenplay, Best Supporting Actor for Osment, and Best Supporting Actress for Collette." ] ], "gold": "The Sixth Sense is a 1999 American supernatural psychological thriller film that was written and directed by M. Night Shyamalan. The cast includes Bruce Willis, Toni Collette, and child actor Haley Joel Osment.", "prediction 1": "The Sixth Sense is a 1999 American supernatural horror film directed by M. Night Shyamalan, which tells the story of Cole Sear, a troubled, isolated boy who is able to see and talk to the dead, and an equally troubled child psychologist named Malcolm Crowe who tries to help him. Haley Joel Osment plays the young unwilling medium in the film, which earned him a nomination for the Academy Award for Best Supporting Actor. Afterwards, Osment appeared in leading roles in several high-profile Hollywood films, including Steven Spielberg's A.I. Artificial Intelligence and Mimi Leder's Pay It Forward.", "prediction 2": "The Sixth Sense is a 1999 American supernatural horror film written and directed by M. Night Shyamalan. Haley Joel Osment stars as Cole Sear, a troubled, isolated boy who is able to see and talk to the dead, and an equally troubled child psychologist named Malcolm Crowe who tries to help him.", "prediction 3": "The Sixth Sense is a 1999 American supernatural horror film written and directed by M. Night Shyamalan. The film tells the story of Cole Sear, a troubled, isolated boy who is able to see and talk to the dead, and an equally troubled child psychologist named Malcolm Crowe who tries to help him. Haley Joel Osment plays the young unwilling medium in the movie.", "prediction 4": "Haley Joel Osment is an American actor who played the star of the 1999 supernatural horror film The Sixth Sense. Bruce Willis played the role of Malcolm Crowe. Osment was nominated for the Academy Award for Best Supporting Actor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 280, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 599 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Sixth Sense is a 1999 American supernatural horror film directed by M. Night Shyamalan. The cast includes Bruce Willis, Toni Collette, and child actor Haley Joel Osment." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "When does the evening standard go to print?", "passages": [ [ "Evening Standard", "In 1987 the \"Evening News\" was briefly revived to compete with Robert Maxwell's \"London Daily News\", but was reabsorbed into \"The Standard\" later that year, after the collapse of Maxwell's paper.", "In 1988 the \"Evening Standard\" included the by-line \"Incorporating the 'Evening News'\", which remained until the paper's sale in 2009.", "On 21 January 2009, the Russian businessman and former KGB agent Alexander Lebedev and his son Evgeny Lebedev, owners of \"The Independent\", agreed to purchase control of the newspaper at \u00a31 for 64 percent ownership.", "A few years earlier, 12 percent of the paper was sold to Justin Shaw and Geordie Greig.", "Associated News keeps the remaining 24 percent.", "In November 2009, it was announced that the \"London Evening Standard\" would drop its midday \"News Extra\" edition from 4 January 2010 with the first edition being the West End Final, available from 2\u00a0pm.", "One edition of 600,000 copies would be printed starting at 12:30\u00a0pm, ending 3\u00a0am starts for journalists and the previous deadline of 9\u00a0am for the first edition; twenty people were expected to lose their jobs as a result.", "Previously there were three editions each weekday, excluding Bank holidays." ] ], "gold": "The Evening Standard went to print at 10:00 AM, 3:00 PM, and 5:00 PM before 2009, and at 12:30 PM in 2009.", "prediction 1": "The Evening Standard goes to print on Tuesdays and Thursdays at 12:30 pm, and on Saturdays and Sundays at 9 am. The newspaper went to print on Mondays at 9 am.", "prediction 2": "It is the name of the British daily newspaper published in London since 1841. The Evening Standard went to print on 16 November 1841 and ceased to exist on 17 November 1841.", "prediction 3": "The London Evening Standard goes to print on Thursdays from 8:15 pm to 9:05 pm, Mondays from 10:15 am to 12:30 pm, and Saturdays from 10:15 am to 12:30 pm. On 21 January 2009, the Russian businessman and former KGB agent Alexander Lebedev and his son Evgeny Lebedev, owners of The Independent, agreed to purchase control of the newspaper for \u00a31 for 64 percent ownership. In November 2009, it was announced that the Evening Standard would drop its midday \"News Extra\" edition from 4 January 2010 with the first edition being the West End Final, available from 2 pm. One edition of 600,000 copies would be printed starting at 12:30 pm, ending 3 am starts for journalists and the previous deadline of 9 am for the first edition; twenty people were expected to lose their jobs as a result.", "prediction 4": "The Evening Standard goes to print starting on 12:30 pm and ending on 3 am starts for journalists and the previous deadline of 9 am for the first edition. The paper went to print on 15 November 1991 and on 16 November 1992. The paper went to print on 15 November 1992 and on 16 November 1992.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 111 }, { "error type": "Unverifiable", "explanation": "", "start": 112, "end": 159 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the book of leviticus take place?", "passages": [ [ "Book of Leviticus", "The rituals, especially the sin and guilt offerings, provide the means to gain forgiveness for sins (Leviticus 4\u20135) and purification from impurities (Leviticus 11\u201316) so that God can continue to live in the Tabernacle in the midst of the people.", "Scholars generally agree that Leviticus developed over a long time and that it reached its present form in the Persian period (538\u2013332\u00a0BC).", "The English name Leviticus comes from the Latin \"Leviticus,\" which is in turn from the Greek Greek \u039b\u03b5\u03c5\u03b9\u03c4\u03b9\u03ba\u03cc\u03bd, \"Leuitikon\", referring the priestly tribe of the Israelites, \u201cLevi.\u201d", "The Greek expression is in turn a variant of the rabbinic Hebrew \"torat kohanim\", \"law of priests.\"", "In Hebrew the book is called \"Vayikra\" (), from the opening of the book, \"va-yikra\"\"And He [God] called.\"", "\"(The outlines provided by commentaries are similar, though not identical; compare those of Wenham, Hartley, Milgrom, and Watts)\n\nI. Laws on sacrifice (1:1\u20137:38)\nII.", "Institution of the priesthood (8:1\u201310:20)\nIII." ] ], "gold": "The book of Leviticus took place during 538-332 BCE in the Persian Period.", "prediction 1": "The book of Leviticus was written during the time of David the son of Nun. It is generally agreed that Leviticus developed over a long time and that it reached its present form in the Persian period, 538\u2013332 BC. Scholars generally agree that Leviticus developed over a long time and that it reached its present form in the Persian period. The book was written between 538 and 332 BC, and was written in Latin.", "prediction 2": "The book of Leviticus is a book of laws written in Greek. The book of Leviticus dates from the 5th century BC, and was written in the style that was used during the Persian period, 538\u2013332 BC.", "prediction 3": "The book of Leviticus is a Hebrew law book that takes place in the time of the Israelites. It was written during the time of the Persians and was written in Greek. The book was written in the language of the Persians and has its beginnings in 538 BC.", "prediction 4": "The book of Leviticus was written from the law of Moses to the law of Aaron. It was written by a priest in the time of King Ahaz, 538\u2013332 BC.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": " It is generally agreed that Leviticus developed over a long time and that it reached its present form in the Persian period, 538\u2013332 BC. ", "start": 212, "end": 338 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 74 }, { "error type": "Redundant", "explanation": " It is generally agreed that Leviticus developed over a long time and that it reached its present form in the Persian period, 538\u2013332 BC. ", "start": 339, "end": 409 } ], "missing-info": [], "corrected-prediction": "The book Leviticus developed over a long time and that it reached its present form in the Persian period, 538\u2013332 BC. " }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who is the writer of the ugly duckling?", "passages": [ [ "The Ugly Duckling", "The Ugly Duckling\n\n\"The Ugly Duckling\" (Danish: \"Den grimme \u00e6lling\") is a literary fairy tale by Danish poet and author Hans Christian Andersen (1805\u20131875).", "The story tells of a homely little bird born in a barnyard who suffers abuse from the others around him until, much to his delight (and to the surprise of others), he matures into a beautiful swan, the most beautiful bird of all.", "The story is beloved around the world as a tale about personal transformation for the better.", "\u201cThe Ugly Duckling\u201d was first published 11 November 1843, with three other tales by Andersen in Copenhagen, Denmark to great critical acclaim.", "The tale has been adapted to various media including opera, musical, and animated film.", "The tale is completely Andersen's invention and owes no debt to fairy tales or folklore.", "When the story begins, a mother duck's eggs hatch.", "One of the little birds is perceived by the other birds and animals on the farm as a homely little creature and suffers much verbal and physical abuse from them.", "He wanders sadly from the barnyard and lives with wild ducks and geese until hunters slaughter the flocks.", "He finds a home with an old woman, but her cat and hen tease and taunt him mercilessly and once again he sets off alone.", "The duckling sees a flock of migrating wild swans." ], [ "The Ugly Duckling (play)", "The Ugly Duckling (play)\n\nThe Ugly Duckling is a one-act play by A.A. Milne written .", "The king and queen are worried because their daughter, Princess Camilla, is very plain, or rather appears to be plain because of a spell put on her at birth.", "The spell says that only the eyes of true love will reveal her beauty.", "Her parents come up with a plan to marry her to a prince from a far-away land who doesn't know what she looks like.", "They force Camilla to trade places with her beautiful but silly maid, Dulcibella, before the prince arrives.", "However, Prince Simon has also disguised himself as his servant Carlo, and dressed Carlo up as the prince because he felt he wasn't handsome enough.", "Both the pretend prince and princess are insanely dull-witted, which just adds to the entertainment.", "Before the marriage of the two servants dressed as royalty, the real prince meets the real princess and they reveal their identity and begin to understand each other.", "Prince Simon tells Princess Camilla that she is very beautiful, although all other princes have found her to be hideously ugly.", "Then the princess reveals that she was given a gift from her great aunt that would make everyone ignorant of her real beauty, so that she wouldn't grow up vain \u2013 until the day she met her one true love." ] ], "gold": "The Ugly Duckling is a name given to a play written in 1941 and also a name given to a particular children's book, published in 1843. The Ugly Duckling is a one-act play by A.A. Milne. It is also a Danish literary fairy tale by Danish poet and author Hans Christian Andersen.", "prediction 1": "\"The Ugly Duckling\" is a literary fairy tale by Danish poet and author Hans Christian Andersen (1805-1875). The story tells of a homely little bird born in a barnyard who suffers abuse from the others around him until, much to his delight (and to the surprise of others), he matures into a beautiful swan, the most beautiful bird of all. The tale has been adapted to various media including opera, musical, and animated film. The one-act play is written by A.A. Milne. A.A. Milne is the one-act play of The Ugly Duckling.", "prediction 2": "The Ugly Duckling is a literary fairy tale by Danish poet and author Hans Christian Andersen. The story tells of a homely little bird born in a barnyard who suffers abuse from the others around him until, much to his delight and to the surprise of others, he matures into a beautiful swan, the most beautiful bird of all. A one-act play, The Ugly Duckling by A.A. Milne, was written in 1885.", "prediction 3": "Hans Christian Andersen wrote the literary fairy tale The Ugly Duckling, a story about a homely little bird born in a barnyard who suffers abuse from the others around him until he matures into a beautiful swan, the most beautiful bird of all. The tale has also been adapted to various media including opera, musical, and animated film.", "prediction 4": "The Ugly Duckling is a literary fairy tale written by Danish poet and author Hans Christian Andersen. The story tells of a homely little bird born in a barnyard who suffers abuse from the others around him until, much to his delight and to the surprise of others, he matures into a beautiful swan, the most beautiful bird of all. A.A. Milne wrote a one-act play based on the story, which starred Emily Dickinson as Camilla, a one-act play based on a play.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 95, "end": 107 }, { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 337 }, { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 425 }, { "error type": "Redundant", "explanation": " The one-act play is written by A.A. Milne. ", "start": 469, "end": 499 } ], "missing-info": [], "corrected-prediction": "\"The Ugly Duckling\" is a literary fairy tale by Danish poet and author Hans Christian Andersen. The Ugly Duckling is a one-act play by A.A. Milne written ." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the movie baby driver come out?", "passages": [ [ "Baby Driver", "It is only through his obligation to protect Debora, Joseph, and the impending threat of his heist crew on his livelihood, that Baby is forced to confront reality, no longer able to ignore the mayhem around him.", "\"Baby Driver\" employs some of the conventions of gangster film, chiefly heroic fatalism and uncompromising villainy.", "Characteristic of Wright's films, \"Baby Driver\" is driven by strong color cues.", "Colors are used symbolically to represent the personas of the core characters.", "Baby is dressed in drab colors that reflect his black-and-white perspective of the universe.", "This muted palette clashes with the bright, vibrant colors that symbolize his peers: red is used to represent Bats, purple and pink for Darling, and blue for Buddy.", "As the film progresses, the pressures of organized crime becomes overwhelming, and Baby's wardrobe evolves by proxy.", "He is seen in faint greys and bloodstained white shirts at that point.", "Costume designer Courtney Hoffman incorporated light grey colors into Baby's wardrobe to illustrate his struggle of seeking freedom from the criminal world.", "The global premiere of \"Baby Driver\" took place on March 11, 2017, at the South by Southwest festival in Austin.", "The film was released in theaters in North America and the United Kingdom on June 28, 2017, six weeks earlier than the initial schedule." ], [ "Baby Driver", "Baby Driver\n\nBaby Driver is a 2017 action film written and directed by Edgar Wright.", "It stars Ansel Elgort as a young getaway driver, who finds catharsis in music, seeking freedom from a life of organized crime with his lover Debora (Lily James).", "Kevin Spacey, Jon Hamm, Eiza Gonz\u00e1lez, Jamie Foxx, and Jon Bernthal appear in supporting roles.", "Eric Fellner and his Working Title Films partner Tim Bevan produced \"Baby Driver\" alongside Big Talk Productions' Nira Park.", "Sony and TriStar Pictures co-financed and distributed the film.", "\"Baby Driver\" is a longtime passion project Wright had developed for over two decades.", "He devised the film's blueprint well into his youth, but the experience helming his other projects shaped his ambitions for \"Baby Driver\".", "Originally centered in Los Angeles, the film's setting was later revised to Atlanta in the script, and preserving its ethos became an important aspect of the storytelling.", "Principal photography took place in the city over four months, from February to May 2016.", "Production involved the planning of meticulously coordinated stunts, choreography, and shooting as much of the film in-camera as possible.", "\"Baby Driver\" premiered at South by Southwest on March 11, 2017, and in theaters in North America and the United Kingdom on June 28, 2017." ] ], "gold": "Baby Driver is an action movie. Baby Driver premiered at South by Southwest festival, which is called SWSX, on March 11, 2017. The movie came out in the US and UK on June 28, 2017.", "prediction 1": "The 2017 action film Baby Driver came out in theaters on June 28, 2017, six weeks earlier than the initial schedule. The film premiered at the South by Southwest festival in Austin, Texas on March 11, 2017.", "prediction 2": "The 2017 action film Baby Driver was written and directed by Edgar Wright and stars Ansel Elgort as a young getaway driver, who finds catharsis in music, seeking freedom from a life of organized crime with his lover Debora (Lily James). The global premiere of the film took place on March 11, 2017 at the South by Southwest festival in Austin. The film came out in theaters in North America and the United Kingdom on June 28, 2017, six weeks earlier than the initial schedule.", "prediction 3": "Baby Driver is a 2017 American action film written and directed by Edgar Wright. It stars Ansel Elgort as a young getaway driver, who finds catharsis in music, seeking freedom from a life of organized crime with his lover Debora (Lily James). The global premiere took place on March 11, 2017, at the South by Southwest festival in Austin. The film was released in theaters in North America and the United Kingdom on June 28, 2017, six weeks earlier than the initial schedule.", "prediction 4": "Baby Driver is a 2017 action film written and directed by Edgar Wright. It stars Ansel Elgort as a young getaway driver, who finds catharsis in music, seeking freedom from a life of organized crime with his lover Debora (Lily James). The global premiere of the movie took place on March 11, 2017, at the South by Southwest festival in Austin. The film was released on June 28, 2017 in North America and the United Kingdom, six weeks earlier than the initial schedule.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 116 } ], "missing-info": [], "corrected-prediction": "\"Baby Driver\" premiered at South by Southwest on March 11, 2017, and in theaters in North America and the United Kingdom on June 28, 2017." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who invented the process to remove impurities by blasts of cold air blown through heated iron?", "passages": [ [ "Bessemer process", "The Bessemer process was so fast (10\u201320 minutes for a heat) that it allowed little time for chemical analysis or adjustment of the alloying elements in the steel.", "Bessemer converters did not remove phosphorus efficiently from the molten steel; as low-phosphorus ores became more expensive, conversion costs increased.", "The process permitted only limited amount of scrap steel to be charged, further increasing costs, especially when scrap was inexpensive.", "Use of electric arc furnace technology competed favourably with the Bessemer process resulting in its obsolescence.", "Basic oxygen steelmaking is essentially an improved version of the Bessemer process (decarburization by blowing oxygen as gas into the heat rather than burning the excess carbon away by adding oxygen carrying substances into the heat).", "The advantages of pure oxygen blast over air blast was known to Henry Bessemer, but the 19th-century technology was not advanced enough to allow for the production of the large quantities of pure oxygen to make it economically feasible for use." ], [ "Bessemer process", "Bessemer process\n\nThe Bessemer process was the first inexpensive industrial process for the mass production of steel from molten pig iron before the development of the open hearth furnace.", "The key principle is removal of impurities from the iron by oxidation with air being blown through the molten iron.", "The oxidation also raises the temperature of the iron mass and keeps it molten.", "Related decarburizing with air processes had been used outside Europe for hundreds of years, but not on an industrial scale.", "One such process has existed since the 11th century in East Asia, where the scholar Shen Kuo of that era described its use in the Chinese iron and steel industry.", "In the 17th century, accounts by European travelers detailed its possible use by the Japanese.", "The modern process is named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856.", "The process was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back up this claim.", "The process using a basic refractory lining is known as the \"basic Bessemer process\" or Gilchrist\u2013Thomas process after the English discoverers Percy Gilchrist and Sidney Gilchrist Thomas.", "A system akin to the Bessemer process has existed since the 11th century in East Asia." ] ], "gold": "The Bessemer process was the first inexpensive industrial process for the mass production of steel from molten pig iron before the development of the open hearth furnace. The key principle is removal of impurities from the iron by oxidation with air being blown through the molten iron. It is named after its inventor, Englishman, Henry Bessemer who took out a patent on the process in 1856. The process was said to be independently discovered in 1851 by the American inventor, William Kelly, though the claim is controversial.", "prediction 1": "The Bessemer process is the first inexpensive industrial process for the mass production of steel from molten pig iron before the development of the open hearth furnace. The modern process is named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856. The process was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back up this claim.", "prediction 2": "The Bessemer process to remove impurities by blasts of cold air blown through heated iron is said to be independently discovered in 1851 by the American inventor William Kelly. The process was named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856. The process was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back up this claim.", "prediction 3": "The process to remove impurities by blasts of cold air blown through heated iron was invented by the Englishman Henry Bessemer in 1856. It was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back up this claim.", "prediction 4": "The modern process is named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856. The process was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back this claim. The modern process is named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856 and subsequently held a patent expiring in 1861 for the process.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Bessemer process is the first inexpensive industrial process for the mass production of steel from molten pig iron before the development of the open hearth furnace. The key principle is removal of impurities from the iron by oxidation with air being blown through the molten iron. The modern process is named after its inventor, the Englishman Henry Bessemer, who took out a patent on the process in 1856. The process was said to be independently discovered in 1851 by the American inventor William Kelly, though there is little to back up this claim." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who is the man with the burned face on game of thrones?", "passages": [ [ "Sandor Clegane", "Sandor Clegane\n\nSandor Clegane, nicknamed The Hound, is a fictional character in the \"A Song of Ice and Fire\" series of fantasy novels by American author George R. R. Martin, and its television adaptation \"Game of Thrones\".", "Introduced in 1996's \"A Game of Thrones\", Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard.", "He subsequently appeared in Martin's \"A Clash of Kings\" (1998), \"A Storm of Swords\" (2000) and \"A Feast for Crows\" (2005).", "Sandor is not a point of view character in the novels, so his actions are witnessed mainly through the eyes of Sansa Stark and Arya Stark, with some narrations from other characters such as Ned Stark, Tyrion Lannister, and possibly Brienne of Tarth.", "Sandor Clegane is portrayed by Scottish actor Rory McCann in the HBO television adaptation.", "Sandor Clegane, known as the Hound, is a retainer to House Lannister and the younger brother of Gregor Clegane, a.k.a.", "The Mountain.", "He is regarded as one of the most dangerous and skilled fighters in Westeros." ], [ "Game of Thrones (season 8)", "Game of Thrones (season 8)\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series and will also adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\".", "The season will be adapted for television by David Benioff and D. B. Weiss.", "Filming officially began on October 23, 2017, and concluded in July 2018.", "The season is scheduled to premiere in April 2019.", "\n\n\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series; it will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\"." ] ], "gold": "Game of Thrones is an American fantasy drama television series on HBO. It is an adaptation of A Song of Ice and Fire, a series of fantasy novels by George R. R. Martin, the first of which is A Game of Thrones. Sandor Clegane, nicknamed the Hound, is one of the fictional characters on Game of Thrones who has a burned face. Scottish actor, Rory McCann, portrays Sandor.", "prediction 1": "The man with the burned face on Game of Thrones is Sandor Clegane, a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard. Sandor is portrayed by Scottish actor Rory McCann in the HBO television adaptation.", "prediction 2": "Sandor Clegane, nicknamed The Hound, is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard. Sandor is also regarded as one of the most dangerous and skilled fighters in Westeros.", "prediction 3": "The man with the burned face on Game of Thrones is Sandor Clegane, a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation, Game of Thrones. Sandor Clegane, nicknamed The Hound, is the estranged younger brother of Ser Gregor Clegane, serving as King Joffrey Baratheon's personal bodyguard. Sandor is also known as The Mountain and is regarded as one of the most dangerous and skilled fighters in Westeros.", "prediction 4": "The man with the burned face on Game of Thrones is Sandor Clegane, a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin and its television adaptation Game of Thrones. Introduced in 1996's A Game of Thrones, Sandor is the estranged younger brother of Ser Gregor Clegane, from the fictional Seven Kingdoms of Westeros, serving as King Joffrey Baratheon's personal bodyguard.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 436 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Sandor Clegane, known as the Hound, is a fictional character in the A Song of Ice and Fire series of fantasy novels by American author George R. R. Martin, and its television adaptation Game of Thrones. Sandor is portrayed by Scottish actor Rory McCann in the HBO television adaptation." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who made the song when a man loves a woman?", "passages": [ [ "When a Man Loves a Woman (song)", "When a Man Loves a Woman (song)\n\n\"When a Man Loves a Woman\" is a song written by Calvin Lewis and Andrew Wright and first recorded by Percy Sledge in 1966 at Norala Sound Studio in Sheffield, Alabama.", "It made number one on both the \"Billboard\" Hot 100 and R&B singles charts.", "Singer and actress Bette Midler recorded the song 14 years later and had a Top 40 hit with her version in 1980.", "In 1991, Michael Bolton recorded the song and his version peaked at number one on both the \"Billboard\" Hot 100 chart and the \"Billboard\" Adult Contemporary Singles chart.", "The song was initially recorded by Percy Sledge at Rick Hall's FAME Studios at Muscle Shoals, before being re-recorded at the nearby Norala Studios owned by Quin Ivy.", "The sidemen for the recording included Spooner Oldham, Farfisa organ; Marlin Greene, guitar; Albert \"Junior\" Lowe, double bass and Roger Hawkins, drums.", "Andrew Wright and Calvin Lewis did not play on the record.", "Rick Hall arranged a distribution deal with Atlantic Records, but Jerry Wexler asked that the song be re-recorded because the horns were out of tune.", "According to musician David Hood, \"They went back in the studio and changed the horns, got different horn players to play on it." ], [ "When a Man Loves a Woman (song)", "Quin told me that if I was to write some lyrics around that melody and the expression I'd put into \"Why Did You Leave Me Baby\", he believed it would've been a hit record.", "He was one of the top disc jockeys at that time.", "Sure enough, he asked me if I had any lyrics for that.", "He said, \"That's it!", "Write a story around that title!", "What a song that would be with that feeling you had!\"", "It was a song that was meant to be.", "It wasn't just what I had done; it was the musicians, the producer, the background singers, the right time.", "\"When a Man Loves a Woman\" was recorded by singer Michael Bolton in 1991 for his album \"Time, Love & Tenderness\".", "His version of the song reached number one on the U.S. pop and adult contemporary singles charts.", "Bolton also received a Grammy Award for this song.", "This version has the distinction of being the last number one song to chart on the old \"Billboard\" Hot 100 charting system which relied on sales and airplay reports before switching over to Soundscan.", "Also, with the Percy Sledge original having reached number one previously, Bolton's version made it the seventh song in history to top the Hot 100 as recorded by multiple artists." ], [ "When a Man Loves a Woman (Jody Watley song)", "When a Man Loves a Woman (Jody Watley song)\n\n\"When a Man Loves a Woman\" is a song by Jody Watley, released as the final single from her fourth album, \"Intimacy\".", "While \"When a Man Loves a Woman\" peaked at #115 on the U.S. pop chart, it had a significantly more successful showing on the R&B chart, where it landed at number 11.", "Also, \"When a Man Loves a Woman\" peaked at #33 in the UK, making it Watley's first Top 40 hit since \"Friends\" peaked at number 21 in 1989.", "In 1994, \"When a Man Loves a Woman\" was released in the UK with alternate gay-themed mixes by progressive house/trance outfit, BBG.", "The BBG mixes substituted the gender roles in their titles, hence they were \"When a Man Loves a Man\" and \"When a Woman Loves a Woman\".", "Watley's willingness to discuss gay issues was unprecedented at the time and still remains a rarity among artists to this day." ] ], "gold": "The song, \"When a Man Loves a Woman\" was first recorded in 1966 by Percy Sledge. In 1991 it was performed by Michael Bolton and in 1993 by Jody Vanessa Watley.", "prediction 1": "When a Man Loves a Woman is a song written by Calvin Lewis and Andrew Wright and first recorded by Percy Sledge in 1966 at Norala Sound Studio in Sheffield, Alabama. Singer and actress Bette Midler recorded the song 14 years later and had a Top 40 hit with her version in 1980. In 1991, Michael Bolton recorded the song and his version peaked at number one on both the Billboard Hot 100 chart and the Billboard Adult Contemporary Singles chart. His version reached number one on the U.S.S.", "prediction 2": "\"When a Man Loves a Woman\" is a song written by Calvin Lewis and Andrew Wright and first recorded by Percy Sledge in 1966 at Norala Sound Studio in Sheffield, Alabama. Singer and actress Bette Midler recorded the song 14 years later and had a Top 40 hit with her version in 1980. In 1991, singer Michael Bolton recorded the song and his version peaked at number one on both the \"Billboard\" Hot 100 chart and the \"Billboard\" Adult Contemporary Singles chart. Also, \"When a Man Loves a Woman\" is a song by Jody Watley, released as the final single from her fourth album, Intimacy. This version of the song has the distinction of being the last number one song to chart on the old \"Billboard\" Hot 100 as recorded by multiple artists.", "prediction 3": "When a Man Loves a Woman is a song written by Calvin Lewis and Andrew Wright and first recorded by Percy Sledge in 1966 at Norala Sound Studio in Sheffield, Alabama. Singer and actress Bette Midler recorded the song 14 years later and had a Top 40 hit with her version in 1980. In 1991, Michael Bolton recorded the song and his version peaked at number one on both the Billboard Hot 100 chart and the Billboard Adult Contemporary Singles chart. Bolton also received a Grammy Award for this song.", "prediction 4": "When a Man Loves a Woman is a song written by Calvin Lewis and Andrew Wright and first recorded by Percy Sledge in 1966 at Norala Sound Studio in Sheffield, Alabama. Singer and actress Bette Midler recorded the song 14 years later and had a Top 40 hit with her version in 1980. In 1991, Michael Bolton recorded the song and his version peaked at number one on both the Billboard Hot 100 chart and the Billboard Adult Contemporary Singles chart. His version reached number one on the U.S.S.S.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 277 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 444 }, { "error type": "Irrelevant", "explanation": "", "start": 445, "end": 489 }, { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 76 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "When a Man Loves a Woman is a song first recorded by Percy Sledge in 1966. In 1991, Michael Bolton recorded the song. \"When a Man Loves a Woman\" is a song by Jody Watley." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who said what if they gave a war and nobody came?", "passages": [ [ "Gene Keyes", "Gene Keyes\n\nGene Scott Keyes (born October 24, 1941) is a former Assistant Professor of World Politics, a sometime peace activist, noted cartographer, and promoter of the international second language Esperanto.", "He achieved considerable attention for his peace activism when his mother, Charlotte E. Keyes wrote an article for McCall's, \"Suppose They Gave a War and Nobody Came\" (October 1966).", "The title phrase, based on a quote from a Carl Sandburg poem, became part of the anti-Vietnam-War lexicon.", "The slogan also went on to become the basis of the film Suppose They Gave a War and Nobody Came.", "His cartography work has won two awards.", "Gene was born October 24, 1941 to Charlotte Keyes (n\u00e9e Shachmann) and Scott Keyes.", "His father was a Quaker and his mother was Jewish.", "Both were pacifists.", "They had been anti-militarists in the 1930s though they both supported American involvement in World War II as they believed Hitler had to be stopped by force if necessary.", "After the war they became more involved with the Quaker movement.", "Young Gene absorbed his parents' pacifism even to the point of worrying about the insects his mother killed as she cleaned house.", "Keyes has two brothers and one sister." ], [ "Suppose They Gave a War and Nobody Came", "Suppose They Gave a War and Nobody Came\n\nSuppose They Gave A War and Nobody Came (also known as War Games, Old Soldiers Never) is a 1970 American drama-comedy film feature film directed by Hy Averback, produced by Fred Engel, and starring Brian Keith, Don Ameche, Tony Curtis, Ernest Borgnine, Suzanne Pleshette, Ivan Dixon, and Pamela Britton.", "The plot is a mixture of comic and dramatic elements and concerns the reactions of a number of World War II veterans to the contemporary US Army.", "The title is derived from an American antiwar slogan from the hippie subculture during the Vietnam War era, popularized by Charlotte E. Keyes in her 1966 article for \"McCall's\" magazine titled \"Suppose They Gave a War and No One Came\".", "Col. Flanders commands a U.S. Army base in the South.", "To improve relations with the locals, he decides to throw a community dance.", "He gives the assignment to Warrant Officer Michael M. Nace, sergeants Shannon Gambroni and Jones, and a captain, Myerson.", "A bigot named Billy Joe Davis is a big man in town, backed by Harve, a redneck sheriff." ] ], "gold": "Suppose They Gave a War and Nobody Came is a 1970 American drama-comedy film directed by Hy Averback, in which the plot is a mixture of comic and dramatic elements and concerns the reactions of a number of World War II veterans to the contemporary US Army. The title for the film is derived from an American antiwar slogan from the hippie subculture during the Vietnam War era, popularized by Charlotte E. Keyes in her 1966 article for McCall's magazine titled \"Suppose They Gave a War and No One Came\". The title for the article came from a quote from a Carl Sandburg poem, which became part of the anti-Vietnam-War lexicon. The slogan also went on to become the basis of the film Suppose They Gave a War and Nobody Came. His cartography work has won two awards.", "prediction 1": "Suppose They Gave a War and Nobody Came is a 1970 American drama-comedy film that is based on the phrase \"Suppose They Gave a War and Nobody Came\" which was popularized by Charlotte E. Keyes in her 1966 article for McCall's magazine. The slogan also went on to become the basis of the 1970 American drama-comedy film Suppose They Gave a War and Nobody Came.\n", "prediction 2": "The slogan \"Suppose They Gave a War and Nobody Came\" is a 1971 American drama-comedy film that is based on the phrase of American antiwar activist and noted cartographer, Gene Keyes. Charlotte E. Keyes wrote an article for McCall's magazine, \"Suppose They Gave a War and Nobody Came,\" in October 1966.", "prediction 3": "Suppose They Gave a War and Nobody Came is a 1970 American drama-comedy film based on the phrase, \"Suppose They Gave a War and Nobody Came.\" It is a phrase popularized by Charlotte E. Keyes in her 1966 article for McCall's magazine titled \"Suppose They Gave a War and No One Came\". In 1972, the phrase was recast as \"All We Need Is Love\".", "prediction 4": "Suppose They Gave a War and Nobody Came is a title for an article that Charlotte E. Keyes wrote for McCall's magazine in October 1966. The article, titled \"Suppose They Gave a War and Nobody Came\", helped bring the phrase into rightful place in the anti-Vietnam War lexicon. The phrase also went on to become the basis of the 1970 American drama-comedy film Suppose They Gave a War and Nobody Came, also known as War Games, Old Soldiers Never, and Pamela Britton.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Suppose They Gave a War and Nobody Came is a 1970 American drama-comedy film that is based on the phrase \"Suppose They Gave a War and Nobody Came\" ", "start": 234, "end": 358 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Suppose They Gave a War and Nobody Came is a 1970 American drama-comedy film directed by Hy Averback, in which the plot is a mixture of comic and dramatic elements and concerns the reactions of a number of World War II veterans to the contemporary US Army. That is based on the phrase \"Suppose They Gave a War and Nobody Came\", an American antiwar slogan from the hippie subculture during the Vietnam War era, which was popularized by Charlotte E. Keyes in her 1966 article for McCall's magazine. The title for the article came from a quote from a Carl Sandburg poem, which became part of the anti-Vietnam-War lexicon. His cartography work has won two awards.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who sings they shoot horses don't they?", "passages": [ [ "Racing Cars", "Racing Cars\n\nRacing Cars are a Welsh pop band, formed in the Rhondda Valleys, Wales in 1973.", "They were signed to one of the biggest British record labels of the time, Chrysalis Records.", "Racing Cars's debut album yielded their only hit single with \"They Shoot Horses, Don't They?\"", "It reached number fourteen in the UK Singles Chart in 1977, and was inspired by the film, \"They Shoot Horses, Don't They?\"", "Touring to promote their debut releases, Racing Cars backed Bad Company in 1976, including dates at Earls Court and the York Theatre Royal.", "Without any similar further chart appearances, Racing Cars ultimately acquired the dreaded one hit wonder label.", "However, the band was sufficiently established on the touring circuit to issue two further albums which included bit parts for the session pianist Geraint Watkins; American saxophonist Jerry Jumonville; The Bowles Brothers Band (on vocal harmonies); and Ray Ennis from Newport who had previously played with a band called Good Habit.", "(\"Note.", "Not to be confused with Ray Ennis of Swinging Blue Jeans.\")", "These never reached the same commercial heights.", "Morty and Graham Williams had played together in local bands such as Morty and the Frantics and later evolutions including Strawberry Dust for years before.", "They were very well known in the Welsh club circuit." ], [ "They Shoot Horses, Don't They? (film)", "In 1996, \"Entertainment Weekly\" observed, \"Sydney Pollack's dance-marathon movie has probably aged better than any American film of its time.\"", "The film won one Academy Award and was nominated in eight other categories.", "The film currently holds the record for being nominated for the most Academy Awards (nine) without receiving a nod for Best Picture.", "In later years, Turner Classic Movies observed, \"By popularizing the title of McCoy\u2019s novel, [the film] gave American argot a catch-phrase that's as recognizable today as when the movie first caught on.\"", "The title has been imitated in various media for topics having little relation to the plot or themes of the original film.", "The question itself has become increasingly answerable correctly with \"No\" due to advances in equine veterinary medicine, capable of reducing the need for humane destruction of critically diseased or seriously injured horses, all of which the time-frame of both the film and its source novel pre-dated.", "The Rolling Stones used the film set as a rehearsal space, prior to a pair of shows at The Forum as part of their 1969 U.S. tour.", "Welsh band Racing Cars recorded a song called \"They Shoot Horses Don't They?\" inspired by this movie." ] ], "gold": "\"They Shoot Horses, Don't They?\" was sang by several bands. \"They Shoot Horses, Don't They?\" was released in 1976 by Racing cars, which was their only hit single. \"They Shoot Horses, Don't They?\" was also sang by Quickspace in 2000.", "prediction 1": "Racing Cars are a Welsh pop band, formed in the Rhondda Valleys, Wales in 1973, and were signed to one of the biggest British record labels of the time, Chrysalis Records. Racing Cars's debut album yielded their only hit single with \"They Shoot Horses, Don't They?\" It reached number fourteen in the UK Singles Chart in 1977, and was inspired by the movie.", "prediction 2": "Racing Cars are a Welsh pop band formed in the Rhondda Valleys, Wales in 1973. Their debut album yielded their only hit single with \"They Shoot Horses, Don't They?\" It reached number fourteen in the UK Singles Chart in 1977 and was inspired by the 1969 film. The Rolling Stones used the film set as a rehearsal space, prior to a pair of shows at The Forum as part of their 1969 U.S. tour.", "prediction 3": "Racing Cars, a Welsh pop band, formed in the Rhondda Valleys, Wales in 1973, recorded a song called \"They Shoot Horses, Don't They?\" inspired by the 1969 film They Shoot Horses, Don't They?, which was directed by Sydney Pollack. The song was sung by the Welsh pop band Racing Cars, an a cappella group formed from members of various Welsh bands and was released in 1977.", "prediction 4": "Racing Cars are a Welsh pop band, formed in the Rhondda Valleys, Wales in 1973, and were signed to one of the biggest British record labels of the time, Chrysalis Records. Racing Cars recorded a song called \"They Shoot Horses, Don't They?\" inspired by the 1969 movie. It reached number fourteen in the UK Singles Chart in 1977, and was inspired by the film. American saxophonist Jerry Jumonville, session pianist Geraint Watkins, American saxophonist Jerry Jumonville, The Bowles Brothers Band (on vocal harmonies), and Ray Ennis from Newport who had previously played with a band called Good Habit.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 171 }, { "error type": "Irrelevant", "explanation": "", "start": 266, "end": 356 } ], "missing-info": [], "corrected-prediction": "RaRacing Cars's debut album yielded their only hit single with \"They Shoot Horses, Don't They?\"." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When was the last time the statue of liberty was cleaned?", "passages": [ [ "Conservation-restoration of the Statue of Liberty", "Conservation-restoration of the Statue of Liberty\n\nA centennial conservation-restoration of the Statue of Liberty (\"Liberty Enlightening the World\") occurred between 1984 and 1986.", "The Statue of Liberty, by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi, is a colossal artwork on Liberty Island in New York Harbor, and is a part of the Statue of Liberty National Monument.", "Much of the restoration effort was based on unprecedented restorative methods, as metallurgical repair work on such a large scale had never been attempted.", "Many scientists, engineers, government organizations, and professional consultants evaluated and dealt with the various problems and tasks facing the restoration effort.", "The restored statue was reopened during Liberty Weekend, its 100-year anniversary celebration held July 3\u20136, 1986.", "The preparations for the centennial celebration of the Statue of Liberty began in 1979.", "Formed by the National Park Service (NPS), the custodians of the statue since 1933, to investigate possible development alternatives[incomplete sentence].", "A report titled \"Analysis of Alternatives\", published in December 1980, proposed measures to remedy the certain conditions confronting visitors to the Statue of Liberty, such as the long lines and waiting time to enter the crown of the statue." ], [ "Effects of Hurricane Sandy in New York", "Governor Cuomo signed an executive order saying that displaced New Yorkers could vote in the 2012 United States elections at any polling place in the state.", "On November 7, Governor Cuomo fired Steven Kuhr, the head of the New York Office of Emergency Management, after Cuomo discovered that Kuhr had sent Suffolk County workers to clear a tree in his Long Island driveway as other victims needed help.", "A day later, Cuomo said that the estimated storm damage in New York state was $33 billion.", "New York City and the counties of Nassau and Suffolk imposed \"odd-even\" gasoline rationing, as New Jersey had, to ease congestion and frustration at filling stations.", "The system began on November 9 in the wake of a shortage.", "Cuomo also temporarily waived certain taxes and pollution restrictions on fuel deliveries.", "New York City schools remained closed through Friday, November 2 with classes resuming Monday for most students; but as many as 40,000 stayed home until November 7.", "Fifty-seven schools were still flooded as of that date.", "Many colleges and universities and K-12 schools in the tri-state area also cancelled classes.", "The Statue of Liberty was closed October 29, a day after its grand reopening.", "Both the statue and Ellis Island remained closed through 2012; the statue reopened July 4, 2013, while Ellis Island remained closed until 2014." ] ], "gold": "The Statue of Liberty has been cleaned on various occasions. The first was a centennial conservation-restoration of the Statue of Liberty which occurred between 1984-1986. During the Hurricane Sandy, the Statue of Liberty was closed October 29, a day after its grand reopening from a year-long renovation project. Both the statue and Ellis Island remained closed through 2012; the statue reopened July 4, 2013, thus the cleaning took place between 2012-2013.", "prediction 1": "The Statue of Liberty, by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi, is a colossal artwork on Liberty Island in New York Harbor and is a part of the Statue of Liberty National Monument. A centennial conservation-restoration of the Statue of Liberty occurred between 1984 and 1986. The restored statue was reopened during Liberty Weekend, its 100-year anniversary celebration held July 3\u20136, 1986.", "prediction 2": "The last time the statue of liberty was cleaned was on September 14, 2013. The last time the statue of liberty was cleaned was on September 25, 2012.", "prediction 3": "The Statue of Liberty, by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi, is a colossal artwork on Liberty Island in New York Harbor, and is part of the Statue of Liberty National Monument. A centennial conservation-restoration of the Statue of Liberty occurred between 1984 and 1986. The restored statue was reopened during Liberty Weekend, its 100-year anniversary celebration held July 3\u20136, 1986.", "prediction 4": "The last time the Statue of Liberty was cleaned was on July 1, 1987. In the year that followed, the statue was cleaned on July 7, 1988. In the year that followed, the statue was cleaned on July 13, 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 186 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 396 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Statue of Liberty, by French sculptor Fr\u00e9d\u00e9ric Auguste Bartholdi, is a colossal artwork on Liberty Island in New York Harbor and is a part of the Statue of Liberty National Monument. A centennial conservation-restoration of the Statue of Liberty occurred between 1984 and 1986. During the Hurricane Sandy, the Statue of Liberty was closed October 29, a day after its grand reopening. Both the statue and Ellis Island remained closed through 2012; the statue reopened July 4, 2013, while Ellis Island remained closed until 2014. " }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "Who wrote we were soldiers once and young?", "passages": [ [ "We Were Soldiers Once\u2026 and Young", "We Were Soldiers Once\u2026 and Young\n\nWe Were Soldiers Once\u2026 and Young is a 1992 book by Lt. Gen. Harold G. \"Hal\" Moore (Ret.) and war journalist Joseph L. Galloway about the Vietnam War.", "It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War; previous engagements involved small units and patrols (squad, platoon, and company sized units).", "It was adapted into the 2002 film \"We Were Soldiers\".", "The book was a \"New York Times\" best-seller.", "David Halberstam called it \"A stunning achievement\u2014paper and words with the permanence of marble.", "I read it and thought of \"The Red Badge of Courage\", the highest compliment I can think of.\"", "General H. Norman Schwarzkopf said \"\"We Were Soldiers Once...and Young\" is a great book of military history, written the way military history should be written.\"", "The book is currently on the Marine Corps Commandant's Reading List for Career Level Enlisted and has been since at least 1993." ] ], "gold": "We Were Soldiers Once\u2026 and Young is a 1992 book by Lt. Gen. Harold G. Moore (Ret.) and war journalist Joseph L. Galloway about the Vietnam War. It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film We Were Soldiers.", "prediction 1": "We Were Soldiers Once... and Young is a 1992 book by Lt. Gen. Harold G. \"Hal\" Moore and war journalist Joseph L. Galloway about the Vietnam War. It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film We Were Soldiers, and was a New York Times best-seller.", "prediction 2": "We Were Soldiers Once... and Young is a 1992 book by Lt Gen. Harold G. \"Hal\" Moore (Ret.) and war journalist Joseph L. Galloway about the Vietnam War. It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film \"We Were Soldiers\". The book was a New York Times best-seller and was a New York Times best-seller. It was adapted into the 2002 film \"We Were Soldiers\".", "prediction 3": "We Were Soldiers Once... and Young is a 1992 book by Lt. Gen. Harold G. \"Hal\" Moore (Ret.) and war journalist Joseph L. Galloway about the Vietnam War. The book focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film We Were Soldiers.", "prediction 4": "We Were Soldiers Once... and Young is a 1992 book by Lt. Gen. Harold G. \"Hal\" Moore and war journalist Joseph L. Galloway about the Vietnam War. It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film \"We Were Soldiers\". The book was a New York Times best-seller.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 421 } ], "missing-info": [], "corrected-prediction": "We Were Soldiers Once... and Young is a 1992 book by Lt. Gen. Harold G. \"Hal\" Moore and war journalist Joseph L. Galloway about the Vietnam War. It focuses on the role of the First and Second Battalions of the 7th Cavalry Regiment in the Battle of the Ia Drang Valley, the United States' first large-unit battle of the Vietnam War. It was adapted into the 2002 film We Were Soldiers." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who sang what we need is a great big melting pot?", "passages": [ [ "Melting Pot (song)", "Melting Pot (song)\n\n\"Melting Pot\" is the 1969 debut single from UK pop group Blue Mink.", "The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway.", "The song peaked at number three in the UK Singles chart in the first week of 1970, and also reached Number 11 in Ireland.", "It became the opening track on the group's 1969 debut album, also titled \"Melting Pot\".", "While the song has assimilationist undertones, it is generally considered a plea for racial harmony.", "However in 2015, BBC Three Counties DJ Iain Lee apologized for playing the song, which includes the lyric \"yellow Chinkees\".", "The song featured on episode 3 of I'm Alan Partridge season 1, entitled 'Watership Alan' , in which Alan sings the song whilst exercising in his hotel room alongside Michael, the caretaker, who is clearing out an air vent.", "Alan asks Michael whether the song is racist, but Michael says no on the basis that Chinese is both a race of people and a food.", "7\" (1969)\n7\" (1969)\n7\" (1975)\n\n", "In 1988 \"Melting Pot\" was covered by New Zealand female vocal group and covers band When the Cat's Away.", "Their version peaked at number one in the New Zealand charts, and charted for 15 weeks.", "The single was certified gold." ] ], "gold": "The 1969 song Melting Pot is performed by UK pop group Blue Mink and written by the group's lead singer Roger Cook in collaboration with longtime songwriting partner Roger Greenaway. Melting Pot was most popular in New Zealand, where it peaked at number 2 on the country's singles chart. In 1988, the song was covered by New Zealand female vocal group When the Cat's Away.", "prediction 1": "\"Melting Pot\" is the 1969 debut single from UK pop group Blue Mink. The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway. In 1988 \"Melting Pot\" was covered by New Zealand female vocal group and covers band When the Cat's Away. Their version peaked at number one in the New Zealand charts, and charted for 15 weeks. The single was certified gold.", "prediction 2": "\"What we need is a great big melting pot\" is the 1969 debut single from UK pop group Blue Mink. The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway.", "prediction 3": "Melting Pot is the 1969 debut single from UK pop group Blue Mink. The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway. It became the opening track on the group's 1969 debut album, also titled \"Melting Pot\". In 1988, \"Melting Pot\" was covered by New Zealand female vocal group and covers band When the Cat's Away. Their version peaked at number one in the New Zealand charts, and charted for 15 weeks. The single was certified gold.", "prediction 4": "Melting Pot is the 1969 debut single from UK pop group Blue Mink. The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway. In 1988 \"Melting Pot\" was covered by New Zealand female vocal group and covers band When the Cat's Away. Their version peaked at number one in the New Zealand charts, and charted for 15 weeks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 370, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 369 } ], "missing-info": [], "corrected-prediction": "\"Melting Pot\" is the 1969 debut single from UK pop group Blue Mink. The song was written by Blue Mink's lead singer Roger Cook and long-time songwriter partner Roger Greenaway. In 1988 \"Melting Pot\" was covered by New Zealand female vocal group and covers band When the Cat's Away. Their version peaked at number one in the New Zealand charts." }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "When will star wars episode 8 be released?", "passages": [ [ "Star Wars: The Last Jedi", "\"The Last Jedi\" is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012.", "It was produced by Lucasfilm President Kathleen Kennedy and Ram Bergman, with \"Force Awakens\" director J. J. Abrams as an executive producer.", "John Williams, composer for the previous films, returned to compose the score.", "A number of scenes were filmed at Skellig Michael in Ireland during pre-production in September 2015, but principal photography began at Pinewood Studios in the United Kingdom in February 2016, and ended in July 2016.", "Post-production wrapped in September 2017.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "It grossed over $1.3billion worldwide, becoming the highest-grossing film of 2017, the seventh-highest-ever grossing film in North America and the ninth-highest-grossing film of all time during its theatrical run.", "It is also the second-highest-grossing film of the \"Star Wars\" franchise, and turned a net profit of over $417\u00a0million.", "It was positively received by film critics, who praised the ensemble cast, visual effects, musical score, action sequences and emotional weight." ], [ "Star Wars: The Last Jedi", "In January 2016, \"The Last Jedi\" was rescheduled for December 15, 2017 in 3D and IMAX 3D.", "On January 23, 2017, the film's title was announced as \"Star Wars: The Last Jedi\".", "Similarly to \"The Empire Strikes Back\", \"Return of the Jedi\" and \"The Force Awakens\", \"Episode VIII\" was included in the film's opening crawl, although not in its official title.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017.", "The European premiere was held at London's Royal Albert Hall on December 12, 2017, with a red carpet event.", "It was reported that Disney had placed notable conditions on U.S. cinemas screening \"The Last Jedi\", which some operators described as onerous.", "Disney required that the film be screened in a cinema's largest auditorium for a four-week period (other Disney releases have had similar clauses, but only for two weeks), and was given a 65% cut of ticket sales (a percentage higher than the 55\u201360% average of other major films, and cited as the highest split ever demanded by a Hollywood film behind the 64% split of \"The Force Awakens\").", "The agreement, which was required to be kept confidential, also contained regulations on promotions and restrictions on removing any scheduled screening." ], [ "The Mandalorian", "The Mandalorian\n\nThe Mandalorian is an upcoming American space opera web television series that is scheduled to premiere on Disney+.", "Set in the \"Star Wars\" universe created by George Lucas, the series will take place after the events of \"Return of the Jedi\" and before \"\", and follows a lone Mandalorian gunfighter beyond the reaches of the Republic.", "Jon Favreau is expected to serve as a writer for the series and executive produce alongside Dave Filoni, Kathleen Kennedy, and Colin Wilson.", "The series stars an ensemble cast featuring Pedro Pascal, Gina Carano, Nick Nolte, Giancarlo Esposito, Emily Swallow, Carl Weathers, Omid Abtahi, and Werner Herzog.", "\"The Mandalorian\" takes place \"after the fall of the Empire and before the emergence of the First Order\" and follows \"a lone gunfighter in the outer reaches of the galaxy far from the authority of the New Republic.\"", "In February 2010, details were released about a potential live-action \"Star Wars\" television series being developed by George Lucas.", "The series was described as \"gritty and dark\" and was expected to feature both minor characters and more major ones including Boba Fett, C-3PO, and Emperor Palpatine." ] ], "gold": "Star Wars Episode VIII - The Last Jedi had its world premiere at Shrine Auditorium in Los Angeles on December 9, 2017 and its European premiere at the Royal Albert Hall in London on December 12, 2017. The film was released across the U.S. later that week, on December 15, 2017. Star Wars franchise spinoff shows The Clone Wars and The Mandalorian aired their eighth episodes on November 21, 2008 and December 27, 2019 respectively.", "prediction 1": "Star Wars Episode 8 was originally scheduled for release on December 27, 2018. After this, Star Wars Episode 8 was rescheduled for release on December 15, 2017 in the United States. The upcoming American space opera web television series Star Wars: The Mandalorian is scheduled to premiere on Disney+.", "prediction 2": "Star Wars Episode 8 was originally released on December 9, 2017. Episode 8 was rescheduled for release on December 15, 2017 in 3D and IMAX 3D. Star Wars: The Last Jedi had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "prediction 3": "Star Wars: Episode VIII was first released on December 8, 2017. Episode 8 was originally released on December 14, 2016. Episode 8 was rescheduled for release on December 15, 2017, in 3D and IMAX 3D.", "prediction 4": "Star Wars Episode 8 was originally released on December 9, 2017 in the United States. The episode was rescheduled for release on December 15, 2017 in the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 138 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 301 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017. It was released on December 15, 2017 in the United States. The European premiere was held at London's Royal Albert Hall on December 12, 2017." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is mr jones in counting crows song?", "passages": [ [ "Mr. Jones (Counting Crows song)", "Mr. Jones (Counting Crows song)\n\n\"Mr. Jones\" is a song by American alternative rock band Counting Crows.", "It was released in December 1993 as the lead single and third track from their debut album, \"August and Everything After\" (1993).", "It was the band's first radio hit and one of their most popular singles.", "\"Mr. Jones\" entered the American Top 40 on February 19, 1994, and entered the Top 10 five weeks later.", "On April 23, \"Mr. Jones\" passed R. Kelly's \"Bump n' Grind\", taking the number-one position (which it surrendered, the following week, to Prince's \"The Most Beautiful Girl in the World\").", "The band's surprise success happened to coincide with Kurt Cobain's death.", "These events took a significant toll on Adam Duritz, the lead vocalist and principal songwriter.", "Duritz said in an interview, \"We heard that, that [Kurt] had shot himself.", "And it really scared the hell out of me because I thought, these things in my life are getting so out of control.\"", "These events and feelings were the basis for \"Catapult\", the first track of \"Recovering the Satellites\"." ], [ "Mr. Jones (Counting Crows song)", "According to Duritz (who was born in 1964), the song title had a hand in the naming by Jonathan Pontell of \"Generation Jones\", the group of people born between 1954 and 1965.", "\"I feel honored that my song Mr. Jones was part of the inspiration for the name 'Generation Jones'.\"", "The primary topic of the song itself is perhaps how two struggling musicians (Duritz and bassist Marty Jones of The Himalayans) \"want to be big stars,\" believing that \"when everybody loves me, I will never be lonely.\"", "Duritz would later recant these values, and in later concert appearances, \"Mr. Jones\" was played in a subdued acoustic style, if at all.", "On the live CD Duritz changes the lyrics \"\"We all wanna be big, big stars, but we got different reasons for that\" \" to \"\"We all wanna be big, big stars, but then we get second thoughts about that,\"\" and \"\"when everybody loves you, sometimes that's just about as funky as you can be\"\" to \"\"when everybody loves you, sometimes that's just about as fucked up as you can be.\"\"" ] ], "gold": "Mr. Jones is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After (1993). It was the band's first radio hit and has been described as a \"breakout\" single. The song is about struggling musicians (Adam Duritz and Marty Jones of The Himalayans) who \"want to be big stars,\" believing that \"when everybody loves me, I will never be lonely.\"", "prediction 1": "Mr. Jones is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After. The song was the band's first radio hit and one of their most popular singles. Adam Duritz, the lead vocalist and principal songwriter, wrote the lyrics for the song.", "prediction 2": "Mr. Jones is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After. It was the band's first radio hit and one of their most popular singles. According to Adam Duritz, the lead vocalist and principal songwriter, the song title had a hand in the naming by Jonathan Pontell of \"Generation Jones\".", "prediction 3": "Mr. Jones is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After. According to Adam Duritz, the lead vocalist and principal songwriter, the song title had a hand in the naming by Jonathan Pontell of \"Generation Jones\", the group of people born between 1954 and 1965.", "prediction 4": "\"Mr. Jones\" is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After. Mr. Jones entered the American Top 40 on February 19, 1994, and entered the Top 10 five weeks later. On April 23, \"Mr. Jones\" passed R. Kelly's \"Bump n' Grind\", taking the number-one position.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 357 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Mr. Jones is a song by American alternative rock band Counting Crows. It was released in December 1993 as the lead single and third track from their debut album, August and Everything After (1993). The song was the band's first radio hit and one of their most popular singles. The primary topic of the song itself is perhaps how two struggling musicians (Duritz and bassist Marty Jones of The Himalayans) \"want to be big stars,\" believing that \"when everybody loves me, I will never be lonely.\"" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the second deepest ocean in the world?", "passages": [ [ "Ocean", "If a zone undergoes dramatic changes in temperature with depth, it contains a thermocline.", "The tropical thermocline is typically deeper than the thermocline at higher latitudes.", "Polar waters, which receive relatively little solar energy, are not stratified by temperature and generally lack a thermocline because surface water at polar latitudes are nearly as cold as water at greater depths.", "Below the thermocline, water is very cold, ranging from \u22121\u00a0\u00b0C to 3\u00a0\u00b0C.", "Because this deep and cold layer contains the bulk of ocean water, the average temperature of the world ocean is 3.9\u00a0\u00b0C.", "If a zone undergoes dramatic changes in salinity with depth, it contains a halocline.", "If a zone undergoes a strong, vertical chemistry gradient with depth, it contains a chemocline.", "The halocline often coincides with the thermocline, and the combination produces a pronounced pycnocline.", "The deepest point in the ocean is the Mariana Trench, located in the Pacific Ocean near the Northern Mariana Islands.", "Its maximum depth has been estimated to be (plus or minus 11 meters; see the Mariana Trench article for discussion of the various estimates of the maximum depth.)", "The British naval vessel \"Challenger II\" surveyed the trench in 1951 and named the deepest part of the trench the \"Challenger Deep\"." ], [ "DeepFlight Challenger", "The design draw from DeepFlight II, another Hawkes Ocean Technologies full depth submarine.", "The pressure hull is rated to withstand 20,000PSI (more than the 16,000PSI at the bottom of the Mariana Trench).", "The sub is smaller than James Cameron's Deepsea Challenger.", "Challenger represents the third generation of DeepFlight technology, one generation behind the DeepFlight Super Falcon.", "Richard Branson and Chris Welsh of Virgin Oceanic plan on using DeepFlight Challenger to reach the deepest point of each of the world's five oceans, the Mariana Trench of the Pacific Ocean (36,201\u00a0ft), the Puerto Rico Trench of the Atlantic Ocean (28,232\u00a0ft), the Diamantina Trench of the Indian Ocean (26,401\u00a0ft), South Sandwich Trench of the Southern Ocean (23,737\u00a0ft), and Molloy Deep of the Arctic Ocean (18,399\u00a0ft).", "The Cheyenne yacht will be used as the mothership for the dive efforts.", "It was planned that Branson would pilot the sub to the Puerto Rico Trench, while Chris Welsh would pilot it for the Mariana Trench dive." ] ], "gold": "Indian Ocean is the second-deepest ocean in the world by average depth, while Pacific Ocean houses the second-deepest point in the world known as the Challenger Deep in the Mariana Trench, located in the western north Pacific.", "prediction 1": "The world's second deepest ocean is the Pacific Ocean, while the Deepsea Pacific Ocean is the deepest ocean.", "prediction 2": "The second deepest ocean in the world after the Atlantic is the Pacific Ocean. The second deepest ocean after the Indian Ocean is the Pacific Ocean.", "prediction 3": "The second deepest ocean in the world is the Pacific Ocean, whose North Sandwich Trench is 36,201 feet below sea level. The Diamantina Trench is 28 miles (32 kilometers) deep in the Indian Ocean. The South Sandwich Trench is 23,737 feet below sea level, and the Molloy Deep is 18,399 feet below sea level.", "prediction 4": "The Atlantic Ocean is the second deepest ocean, after the Pacific. The Diamantina Trench is the second deepest ocean.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 108 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Atlantic Ocean houses the second-deepest point in the world known as the Puerto Rico Trench, while the deepest point is the Mariana Trench of the Pacific Ocean ." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "When did the yankees become a baseball team?", "passages": [ [ "History of the New York Yankees", "In 2009, the Yankees opened a new Yankee Stadium and won the World Series for the 27th time in team history, an MLB record.", "The furthest the Yankees have gone in the postseason since then is the ALCS, in 2010, 2012, and 2017.", "At the end of the 1900 baseball season, the Western League was positioned by its president, Ban Johnson, as a new major league that would compete with the established National League (NL).", "The league was reorganized and renamed the American League (AL), and eight cities fielded teams in the 1901 season.", "A Baltimore team had played in the NL through the 1899 season, after which the club was shut down by the league.", "Baltimore was one of three former NL cities where the AL placed teams in an effort to reach underserved fans.", "The new Orioles' first manager was John McGraw, who had held the same position for the previous Baltimore team in 1899; McGraw also held an ownership stake.", "In 1901, their first season, the Orioles had a 68\u201365 win\u2013loss record and finished in fifth place in the AL.", "During the season, there were numerous disputes between Johnson and McGraw over disciplinary issues, which continued into the following year.", "Rumors began to spread that Johnson was interested in relocating the team to New York City, in an attempt to compete directly with the NL." ], [ "New York Yankees", "New York Yankees\n\nThe New York Yankees are an American professional baseball team based in the New York City borough of the Bronx.", "The Yankees compete in Major League Baseball (MLB) as a member club of the American League (AL) East division.", "They are one of two major league clubs based in New York City, the other being the New York Mets of the National League.", "In the season, the club began play in the AL as the Baltimore Orioles (no relation to the modern Baltimore Orioles).", "Frank Farrell and Bill Devery purchased the franchise (which had ceased operations) and moved it to New York City, renaming the club the New York Highlanders.", "The Highlanders were officially renamed the Yankees in .", "The team is owned by Yankee Global Enterprises, an LLC controlled by the family of the late George Steinbrenner, who purchased the team in 1973.", "Brian Cashman is the team's general manager, and Aaron Boone is the team's field manager.", "The team's home games were played at the original Yankee Stadium from 1923 to 1973 and from 1976 to 2008.", "In 1974 and 1975, the Yankees shared Shea Stadium with the Mets, in addition to the New York Jets, and New York Giants.", "In 2009, they moved into a new ballpark of the same name after the previous facility was closed and demolished." ], [ "History of the New York Yankees", "History of the New York Yankees\n\nThe history of the New York Yankees Major League Baseball (MLB) team spans more than a century.", "Frank J. Farrell and William Stephen Devery bought the rights to an American League (AL) club in New York City after the 1902 season.", "The team, which became known as the Yankees in 1913, rarely contended for the AL championship before the acquisition of outfielder Babe Ruth after the 1919 season.", "With Ruth in the lineup, the Yankees won their first AL title in 1921, followed by their first World Series championship in 1923.", "Ruth and first baseman Lou Gehrig were part of the team's Murderers' Row lineup, which led the Yankees to a then-AL record 110 wins and a Series championship in 1927 under Miller Huggins.", "They repeated as World Series winners in 1928, and their next title came under manager Joe McCarthy in 1932.", "The Yankees won the World Series every year from 1936 to 1939 with a team that featured Gehrig and outfielder Joe DiMaggio, who recorded a record hitting streak during New York's 1941 championship season.", "New York set a major league record by winning five consecutive championships from 1949 to 1953, and appeared in the World Series nine times from 1955 to 1964.", "Mickey Mantle, Yogi Berra, and Whitey Ford were among the players fielded by the Yankees during the era." ] ], "gold": "The New York Yankees are an American professional baseball team based in the New York City borough of the Bronx. Yankees began play in the 1901 season as the Baltimore Orioles (no relation to the modern Baltimore Orioles). In 1903, Frank Farrell and Bill Devery purchased the franchise after it ceased operations and moved it to New York City, renaming the club the New York Highlanders. The Highlanders were officially renamed the New York Yankees in 1913.", "prediction 1": "The New York Yankees are an American professional baseball team based in the New York City borough of the Bronx. At the end of the 1900 baseball season, the Western League was positioned by its president, Ban Johnson, as a new major league that would compete with the established National League (NL). The league was reorganized and renamed the American League (AL), and eight cities fielded teams in the 1901 season. Frank J. Farrell and William Stephen Devery bought the rights to an American League (AL) club in New York City, renamed the team the New York Highlanders. The Highlanders were officially renamed the Yankees in 1923.", "prediction 2": "The New York Yankees became a baseball team on April 7, 1913, and they are a member of Major League Baseball. The team began play in the American League as the Baltimore Orioles, but when Frank Farrell and Bill Devery purchased the franchise, they renamed the club the New York Highlanders and they were officially renamed the Yankees on April 7, 1913. Their first World Series championship was in 1923, which was won by Babe Ruth and the Yankees.", "prediction 3": "The New York Yankees are an American professional baseball team based in the New York City borough of the Bronx. The team became known as the Yankees in 1913. The team was founded in 1913 as the Baltimore Orioles, but the team changed its name to the Yankees in 1913. In 1923, the Yankees moved into a new ballpark of the same name after the previous facility was closed and demolished.", "prediction 4": "The New York Yankees became a baseball team in 1913 and are part of the Major League Baseball (MLB) as a member club of the American League East division. They compete in MLB as a member club of the American League after being purchased by Yankee Global Enterprises in 1973.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 301 }, { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 417 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 439, "end": 461 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The New York Yankees are an American professional baseball team based in the New York City borough of the Bronx. In the 1901 season, the club began play in the AL as the Baltimore Orioles (no relation to the modern Baltimore Orioles).Frank J. Farrell and William Stephen Devery bought the rights to an American League (AL) club in New York City, renamed the team the New York Highlanders. The Highlanders were officially renamed the Yankees in 1923." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won the ncaa mens basketball tournament last year?", "passages": [ [ "North Carolina Tar Heels men's basketball", "North Carolina Tar Heels men's basketball\n\nThe North Carolina Tar Heels men's basketball program is the intercollegiate men's basketball team of the University of North Carolina at Chapel Hill.", "The Tar Heels have won seven men's college basketball national championships (1924, 1957, 1982, 1993, 2005, 2009, and 2017).", "North Carolina's six NCAA Tournament Championships are third-most all-time, behind UCLA and Kentucky.", "They have also won 18 Atlantic Coast Conference tournament titles, 31 Atlantic Coast Conference regular season titles, and an Atlantic Coast Conference record 20 outright Regular Season Championships.", "The program has produced many notable players who went on to play in the NBA, including three of the 50 Greatest Players in NBA History: Billy Cunningham, Michael Jordan and James Worthy.", "Many Tar Heel assistant coaches have gone on to become head coaches elsewhere.", "From the Tar Heels' first season in 1910\u201311 through the 2016\u201317 season, the program has amassed a .739 all-time winning percentage (second highest all-time), winning 2,206 games and losing 781 games in 107 seasons.", "The Tar Heels also have the most consecutive 20-win seasons with 31 seasons from the 1970\u201371 season through the 2000\u20132001 season.", "On March 2, 2010, North Carolina became the second college basketball program to reach 2,000 wins in its history." ], [ "Villanova Wildcats men's basketball", "Villanova Wildcats men's basketball\n\nVillanova University's men's basketball team represents Villanova University and competes in the Big East Conference of NCAA Division I College basketball.", "Their first season was the 1920\u201321 season.", "Named the \"Wildcats\", Villanova is also a member of the Philadelphia Big Five, a rivalry of Philadelphia college basketball teams.", "The Wildcats have won the National Championship three times: 1985, 2016, and 2018.", "Their 1985 NCAA championship as an 8 seed still stands as the lowest seed ever to win the title.", "The game is referred to as \"The Perfect Game\" as they shot a record 78.6% as a team for the game.", "Their 2016 NCAA Championship, is referred to as \"The Perfect Ending\" and is the only NCAA Men's Championship game to be won on a buzzer beater, as Kris Jenkins drained a shot as time expired.", "They made the Final Four in 1939, 1971, 1985, 2009, 2016 and 2018; their six Final Four appearances are 13th most all-time.", "As of 2018, they have an NCAA Tournament record of 64\u201336 ().", "Villanova has defeated six No. 1 seeds in the NCAA tournament (Michigan and Georgetown in 1985, Pittsburgh in 2009, and Kansas and North Carolina in 2016, and Kansas in 2018), which is sixth most all-time." ], [ "2015 NCAA Division I Men's Basketball Tournament", "2015 NCAA Division I Men's Basketball Tournament\n\nThe 2015 NCAA Division I Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division I college basketball.", "The 77th edition of the tournament began on March 17, 2015, and concluded with the championship game on April 6 at Lucas Oil Stadium in Indianapolis.", "Duke defeated Wisconsin in the championship game, 68\u201363.", "Tyus Jones of Duke was the tournament's Most Outstanding Player.", "The following are the sites selected to host each round of the 2015 tournament:\n\n", "First Four\n\nSecond and Third Rounds (Round of 64 and Round of 32)\n\nRegional Semifinals and Finals (Sweet Sixteen and Elite Eight)\nNational Semifinals and Championship (Final Four and Championship)\n\n", "For the second time, Lucas Oil Stadium hosted the Final Four, marking the seventh time the NCAA's home city has hosted the tournament; it is scheduled to do so again in 2021.", "The 2015 tournament marked the first time since 2005 that no new venues were used, only the third time since 1950 that this has happened.", "As of 2018, this is the most recent tournament for Cleveland, Columbus, Jacksonville, Portland, Seattle or Syracuse; of these six cities, only Syracuse has not had its next tournament games scheduled.", "Kentucky entered the tournament unbeaten." ] ], "gold": "In 2017, the North Carolina Tar Heels won the NCAA Men's Basketball Tournament, claiming their seventh Men's Basketball National Championship. In 2016, the Villanova Wildcats won the NCAA Basketball Tournament, claiming their second Men's National Basketball Championship. In 2015, the Duke Blue Devils won the NCAA Men's Basketball Tournament, claiming their fifth Men's National Basketball Championship. ", "prediction 1": "The 76th edition of the NCAA Men's Basketball Tournament started on March 17, 2015, and concluded with the championship game on April 6 at Lucas Oil Stadium in Indianapolis. The North Carolina Tar Heels men's basketball program is the intercollegiate men's basketball team of the University of North Carolina at Chapel Hill. The 2015 NCAA Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division I college basketball. The 2015 NCAA Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Men's Basketball Tournament.", "prediction 2": "There have been several NCAA Men's Basketball Tournament winners. The 77th edition of the NCAA Men's Basketball Tournament began on March 17, 2015, and concluded with the championship game on April 6 at Lucas Oil Stadium in Indianapolis. The Duke Blue Devils won the 2016 NCAA Men's Basketball Tournament, while the North Carolina Tar Heels won the 2017 NCAA Men's Basketball Tournament.", "prediction 3": "The NCAA Men's Basketball Tournament was held in the Spring of 2017 at the Indiana University Nittany Lions Arena in Indianapolis, Indiana. In this year's tournament, the Duke Blue Devils defeated the Wisconsin Badgers 68-63 in the championship game.", "prediction 4": "The 77th edition of the NCAA Men's Basketball Tournament began on March 17, 2015, and concluded with the championship game on April 6 at Lucas Oil Stadium in Indianapolis. The Duke Blue Devils defeated the Wisconsin Badgers in the championship game, 68\u201363. The North Carolina Tar Heels won the tournament in 2017 with 6 wins.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 4, "end": 8 }, { "error type": "Irrelevant", "explanation": "", "start": 9, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 324 }, { "error type": "Irrelevant", "explanation": "", "start": 325, "end": 507 }, { "error type": "Redundant", "explanation": "The 2015 NCAA Men's Basketball Tournament involved 68 teams playing in a single-elimination tournament to determine the national champion of men's NCAA Division I college basketball. ", "start": 508, "end": 688 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1, 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Duke won the 2015 NCAA Division I Men's Basketball Tournament. The Wildcats won in 2016 and 2018, 2016 was their second title. The Tar Heels won in 2017, which was their 7th title. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where is the world's largest desert located?", "passages": [ [ "Polar desert", "This \"freeze-thaw\" alternation forms patterned textures on the ground, as much as in diameter (as seen in the picture on the right).", "Most of the interior of Antarctica is polar desert, despite the thick ice cover.", "Conversely, the McMurdo Dry Valleys of Antarctica, although they have had no ice for thousands of years due to katabatic wind, are not necessarily polar desert.", "Polar deserts are relatively common during ice ages, as ice ages tend to be dry.", "Climate scientists have voiced concerns about the effects of global warming to the ice poles in these polar biomes." ], [ "Sahara", "Sahara\n\nThe Sahara (, ; , ', 'the Great Desert') is the largest hot desert and the third largest desert in the world after Antarctica and the Arctic.", "Its area of is comparable to the area of China or the United States.", "The name 'Sahara' is derived from a dialectal Arabic word for \"desert\", ' ( ).", "The desert comprises much of North Africa, excluding the fertile region on the Mediterranean Sea coast, the Atlas Mountains of the Maghreb, and the Nile Valley in Egypt and Sudan.", "It stretches from the Red Sea in the east and the Mediterranean in the north to the Atlantic Ocean in the west, where the landscape gradually changes from desert to coastal plains.", "To the south, it is bounded by the Sahel, a belt of semi-arid tropical savanna around the Niger River valley and the Sudan Region of Sub-Saharan Africa.", "The Sahara can be divided into several regions including: the western Sahara, the central Ahaggar Mountains, the Tibesti Mountains, the A\u00efr Mountains, the T\u00e9n\u00e9r\u00e9 desert, and the Libyan Desert.", "For several hundred thousand years, the Sahara has alternated between desert and savanna grassland in a 41,000 year cycle caused by changes (\"precession\") in the Earth's axis as it rotates around the sun, which change the location of the North African Monsoon." ], [ "Sahara", "After its capture by British troops in 1898, the Sudan became an Anglo-Egyptian condominium.", "Spain captured present-day Western Sahara after 1874, although Rio del Oro remained largely under Sahrawi influence.", "In 1912, Italy captured parts of what was to be named Libya from the Ottomans.", "To promote the Roman Catholic religion in the desert, Pope Pius IX appointed a delegate Apostolic of the Sahara and the Sudan in 1868; later in the 19th century his jurisdiction was reorganized into the Vicariate Apostolic of Sahara.", "Egypt became independent of Britain in 1936, although the Anglo-Egyptian treaty of 1936 allowed Britain to keep troops in Egypt and to maintain the British-Egyptian condominium in the Sudan.", "British military forces were withdrawn in 1954.", "Most of the Saharan states achieved independence after World War II: Libya in 1951; Morocco, Sudan, and Tunisia in 1956; Chad, Mali, Mauritania, and Niger in 1960; and Algeria in 1962.", "Spain withdrew from Western Sahara in 1975, and it was partitioned between Mauritania and Morocco.", "Mauritania withdrew in 1979; Morocco continues to hold the territory.", "In the post-World War II era, several mines and communities have developed to utilize the desert's natural resources.", "These include large deposits of oil and natural gas in Algeria and Libya, and large deposits of phosphates in Morocco and Western Sahara." ] ], "gold": "The world's largest desert, including polar ice and tundra, is in Antarctica. Most of the interior of Antarctica is polar desert. The world's largest desert, not including polar ice and tundra, is in Africa. The Sahara desert in Africa it is the largest hot desert in the world and the third largest desert overall, smaller only than the deserts of Antarctica and the northern Arctic. The Sahara desert covers large parts of Algeria, Egypt, Libya, Morocco, Sudan, Tunisia, Mali, Mauritania, Niger, Chad, Eritrea, and Western Sahara.", "prediction 1": "The world's largest desert is located in North Africa, specifically in North Africa. The Sahara is the world's largest hot desert and the third largest desert in the world after Antarctica and the Arctic. The Sahara stretches from the Red Sea in the east and the Mediterranean in the north to the Atlantic Ocean in the west, where the landscape gradually changes from desert to coastal plains.", "prediction 2": "The world's largest desert is located in North Africa, with the western Sahara being the largest.", "prediction 3": "The world's largest desert is the Sahara, in North Africa, and is also known as the Great Desert. The Sahara is the world's largest hot desert and the third largest desert in the world after Antarctica and the Arctic.", "prediction 4": "The world's largest desert is located in North Africa, in the Sahara. The Sahara is the largest hot desert and the third largest desert in the world after Antarctica and the Arctic. Africa's largest hot desert is the Sahara, located in North Africa.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The world's largest desert is located in North Africa, specifically in North Africa. The Sahara is the world's largest hot desert and the third largest desert in the world after Antarctica and the Arctic. The Sahara stretches from the Red Sea in the east and the Mediterranean in the north to the Atlantic Ocean in the west, where the landscape gradually changes from desert to coastal plains." }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Where did bruno live in the boy in the striped pajamas?", "passages": [ [ "The Boy in the Striped Pyjamas (film)", "In the midst of his scolding, Kotler notices Shmuel chewing the food Bruno gave him.", "When Kotler asks Shmuel where he got the food, he says Bruno offered the cake, but Bruno, fearful of Kotler, denies this.", "Believing Bruno, Kotler tells Shmuel that they will have a \"little chat\" later.", "Distraught, Bruno goes to apologise to Shmuel, but finds him gone.", "Every day, Bruno returns to the same spot by the camp but does not see Shmuel.", "Eventually, Shmuel reappears behind the fence, sporting a black eye.", "Bruno apologises and Shmuel forgives him, renewing the friendship.", "After the funeral of his grandmother who was killed in Berlin by an Allied bombing, Ralf tells Bruno and Gretel that Elsa, their mother, suggests that they go to live with a relative because it is not safe there.", "In truth, Elsa suggests this because she does not want her children living with their murderous father.", "Shmuel has problems of his own; his father has gone missing after those with whom he participated in a march did not return to the camp.", "Bruno decides to redeem himself by helping Shmuel find his father." ], [ "The Boy in the Striped Pyjamas", "After a visit by Adolf Hitler, Bruno's father is promoted to Commandant, and the family has to move to \"Out-With\" because of the orders of \"The Fury\" (Bruno's na\u00efve interpretation of the word \"\"F\u00fchrer\"\").", "Bruno is initially upset about moving to Out-With (in actuality, Auschwitz) and leaving his friends, Daniel, Karl and Martin.", "From the house at Out-With, Bruno sees a camp in which the prisoners wear striped pyjamas.", "One day, Bruno decides to explore the strange wire fence.", "As he walks along the fence, he meets a Jewish boy named Shmuel, who he learns shares his birthday.", "Shmuel says that his father, grandfather, and brother are with him on this side of the fence, but he is separated from his mother.", "Bruno and Shmuel talk and become very good friends, although Bruno still does not understand very much about Shmuel and his side of the fence.", "Nearly every day, unless it's raining, Bruno goes to see Shmuel and sneaks him food.", "As the meetings go on, and Shmuel gets more and more skinny, Bruno's na\u00efvet\u00e9 is proved, as he never realizes he is living beside a concentration camp." ], [ "The Boy in the Striped Pyjamas (film)", "The Boy in the Striped Pyjamas (film)\n\n", "The Boy in the Striped Pyjamas (released as The Boy in the Striped Pajamas in the United States) is a 2008 British American historical drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name.", "Written and Directed by Mark Herman, produced by BBC Films and Heyday Films, and distributed by Miramax, the film stars Vera Farmiga, David Thewlis, Asa Butterfield, and Jack Scanlon.", "It was released on 12 September 2008 in the United Kingdom.", "The Holocaust drama relates the horror of a World War II Nazi extermination camp through the eyes of two 8-year-old boys; Bruno (Asa Butterfield), the son of the camp's Nazi commandant, and Shmuel (Jack Scanlon), a Jewish inmate.", "The film opens with the quote \"Childhood is measured out by sounds and smells and sights, before the dark hour of reason grows\", by John Betjeman.", "A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II.", "He learns that his father Ralf has been promoted, due to which their family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" (occupied Poland)." ], [ "Occupation of Poland (1939\u20131945)", "Sexual relations between Germans and Poles were forbidden as \"Rassenschande\" (race defilement) under penalty of death.", "To keep them segregated from the German population, they were often housed in segregated barracks behind barbed wire.", "Labor shortages in the German war economy became critical especially after German defeat in the battle of Stalingrad in 1942\u20131943.", "This led to the increased use of prisoners as forced labourers in German industries.", "Following the German invasion and occupation of Polish territory, at least 1.5 million Polish citizens, including teenagers, became labourers in Germany, few by choice.", "Historian Jan Gross estimates that \"no more than 15 per cent\" of Polish workers volunteered to go to work in Germany.", "A total of 2.3 million Polish citizens, including 300,000 POWs, were deported to Germany as forced laborers.", "They tended to have to work longer hours for lower wages than their German counterparts.", "A network of Nazi concentration camps were established on German-controlled territories, many of them in occupied Poland, including one of the largest and most infamous, Auschwitz (O\u015bwi\u0119cim).", "Those camps were officially designed as labor camps, and many displayed the motto \"Arbeit macht frei\" (\"Work brings freedom\")." ] ], "gold": "In the 2006 novel, The Boy in the Striped Pyjamas written by John Boyne, tells a story of two 8-year-olds Bruno and Shmuel who become friends despite living on opposite sides on Nazi camp fence. 8 year old Bruno moves from his hometown of Berlin (Nazi Germany) and moves to Auschwitz (occupied Poland) where his father, a Nazi commander has been posted. This story is also the inspiration for the 2008 film by the same name. ", "prediction 1": "The Boy in the Striped Pyjamas is a 2008 British American historical drama film set in World War II, based on John Boyne\u2019s 2006 novel of the same name. A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II. He learns that his father Ralf has been promoted, due to which their family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" (occupied Poland).\n", "prediction 2": "Here are the origins of the film The Boy in the Striped Pyjamas. A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II. He learns that his father Ralf has been promoted, due to which their family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" in Poland.", "prediction 3": "In the 2008 British American historical drama film The Boy in the Striped Pyjamas, a young Bruno lives with his family in Berlin and learns that his father Rolf Hitler has been promoted and that the family has to move to Auschwitz. As a child, Bruno learns that sexual relations between Germans and Poles were forbidden as \"Rassenschande\", meaning \"defilement.\" Sexual relations between Germans and Poles were forbidden as \"Rassenschande\".", "prediction 4": "The Boy in the Striped Pyjamas is a 2008 British American historical drama film set in World War II, based on John Boyne's 2006 novel of the same name. A young boy named Bruno lives with his family in Berlin, in Nazi Germany during World War II when he learns that his father Ralf has been promoted, due to which his family, including Bruno's mother Elsa and sister Gretel, relocate to the \"countryside\" in occupied Poland.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 80, "end": 100 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 276 }, { "error type": "Irrelevant", "explanation": "", "start": 323, "end": 371 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Boy in the Striped Pyjamas is a 2008 film based on John Boyne\u2019s 2006 novel of the same name, tells a story of two 8-year-olds Bruno and Shmuel who become friends despite living on opposite sides on Nazi camp fence. A young boy named Bruno lives with his family in Berlin, in Nazi Germany. He learns that his father, a Nazi commander, has been promoted, due to which their family, relocates to the \"countryside\" (occupied Poland), or Out-With (in actuality, Auschwitz). \n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did the new season of suits begin?", "passages": [ [ "Suits (South Korean TV series)", "Suits (South Korean TV series)\n\nSuits () is a South Korean television series starring Jang Dong-gun and Park Hyung-sik.", "The drama is based on the American television series of the same name by Aaron Korsh.", "It aired on KBS2 starting April 25, 2018 on Wednesdays and Thursdays at 22:00 (KST) for 16 episodes.", "A capable and distinguished lawyer of the law firm \"Kang&Ham\" Choi Kang-Seok recruits a young man named Go Yeon-Woo who has a retentive memory but not a law degree.", "In the tables below, the blue numbers represent the lowest ratings and the red numbers represent the highest ratings." ], [ "Suits (U.S. TV series)", "Suits (U.S. TV series)\n\nSuits is an American legal drama television series created and written by Aaron Korsh.", "The series premiered on June 23, 2011, on the cable network USA, and is produced by Universal Cable.", "\"Suits\" is set at a fictional law firm in New York City.", "The focal point of the show follows talented college dropout Mike Ross (Patrick J. Adams), who initially works as a law associate for Harvey Specter (Gabriel Macht), despite never actually having attended law school.", "The show focuses on Harvey and Mike managing to close cases while maintaining Mike's secret.", "\"Suits\" has been nominated for several awards since 2012, with Gina Torres and Patrick J. Adams receiving individual praise for their roles as Jessica Pearson and Mike Ross, respectively.", "On top of two nominations recognizing her role as a supporting actress, Torres was awarded Outstanding Performance in a Television Series at the 2013 NHMC Impact Awards.", "Adams was nominated for Outstanding Performance by a Male Actor in a Drama Series at the 2012 Screen Actors Guild Awards, and the show itself has been nominated for two People's Choice Awards.", "On January 30, 2018, it was announced the series was renewed for an eighth season without series regulars Patrick J. Adams and Meghan Markle." ], [ "Suits (U.S. TV series)", "On Rotten Tomatoes, the series holds an 91% approval rating with the Season 3 consensus reading, \"Though it's occasionally overly wordy, \"Suits\" stimulates with drama derived from the strength of its well-developed characters' relationships.\"", "Carrie Raisler of \"The A.V. Club\" said, \"\"Suits\" has more internal forward momentum than [al]most anything else on television right now, and when it's on, like it mostly is here, it just cooks.\"", "Julie Hinds of \"The Detroit Free Press\" said, \"The combination of Gabriel Macht as slick attorney Harvey Specter and Patrick J. Adams as unlicensed legal genius Mike Ross has been a winning one.\"", "In February 2017, USA began early talks for a potential Jessica Pearson spin-off.", "Gina Torres would star in and produce the spin-off.", "In August 2017, it was revealed that the season 7 finale of \"Suits\" would serve as a backdoor pilot to the potential Jessica Pearson spin-off series.", "On March 8, 2018, it was announced the Jessica Pearson spin-off was picked up to series.", "Jang Dong-gun and Park Hyung-sik will star in a Korean remake of the series, which will be produced by Monster Union and EnterMedia Pictures and be broadcast on KBS2 in 2018." ] ], "gold": "Suits is an American legal drama television series created and written by Aaron Korsh. Season 5 of the show first aired on June 24, 2015, season 6 aired on July 13, 2016, and season 7 aired on July 12, 2017. Jang Dong-gun and Park Hyung-sik star in a Korean remake of the series, which was broadcast on KBS2 in 2018. Y\u016bji Oda and Yuto Nakajima play leading roles in a Japanese remake broadcast in 2018. The first season of the Japanese version aired on October 8, 2018 and the first season of the South Korean version aired on April 25, 2018.", "prediction 1": "Suits is an American legal drama television series created and written by Aaron Korsh. The series premiered on June 23, 2011, on the cable network USA, and is produced by Universal Cable. The Korean remake of Suits premiered on KBS2 in 2018. The Korean remake of Suits aired on April 25, 2018, on Wednesdays and Thursdays at 22:00 (KST) for 16 episodes.", "prediction 2": "Suits is an American legal drama television series created and written by Aaron Korsh. The series premiered on June 23, 2011, on the cable network USA and is produced by Universal Cable. The South Korean adaptation of Suits began airing on KBS2 on April 25, 2018.", "prediction 3": "Suits is an American legal drama television series created and written by Aaron Korsh. The series premiered on June 23, 2011, on the cable network USA. It aired on KBS2 starting April 25, 2018, on Wednesdays and Thursdays at 22:00 (KST) for 16 episodes. In August 2017, it was revealed that the season 7 finale of Suits would serve as a backdoor pilot to the potential Jessica Pearson spin-off series. On March 8, 2018, it was announced the Jessica Pearson spin-off was picked up to series.", "prediction 4": "Suits is an American legal drama television series created and written by Aaron Korsh. The series premiered on June 23, 2011, on the cable network USA, and is produced by Universal Cable. The South Korean TV series Suits has been remade to adapt the American television series of the same name. The Korean remake aired on KBS2 starting April 25, 2018 for 16 episodes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 353 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] } ], "corrected-prediction": "Suits is an American legal drama television series created and written by Aaron Korsh. The Korean remake of Suits premiered on KBS2 in 2018 staring Jang Dong-gun and Park Hyung-sik. The Korean remake of Suits aired on April 25, 2018." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the longest person who ever lived?", "passages": [ [ "Supercentenarian", "Norwegian Church records, the accuracy of which is subject to dispute, also show what appear to be several supercentenarians who lived in the south-central part of present-day Norway during the 16th and 17th centuries, including Johannes Torpe (1549\u20131664), and Knud Erlandson Etun (1659\u20131770), both residents of Valdres, Oppland, Norway.", "In 1902, Margaret Ann Neve, born in 1792, became the first verified female supercentenarian.", "Jeanne Calment of France, who died in 1997 aged 122 years, 164 days, had the longest human lifespan documented.", "The oldest man ever verified is Jiroemon Kimura of Japan, who died in 2013 aged 116 years and 54 days.", "Over 1,500 supercentenarians have been documented in history.", "It is likely that more have lived, but the majority of claims to have lived to this age do not have sufficient documentary support to be validated.", "This is slowly changing as those born after birth registration was standardized in more countries and localities attain supercentenarian age." ], [ "Methuselah", "Although the ages of Methuselah and Ubara-Tutu are different, their year of death are the same.", "Babylonian writer Berossus also claims that, prior to the events of Babylon's flood myth, kings could live for tens of thousands of years, which bears some similarity to Genesis 5.", "In \"Forever Young: A Cultural History of Longevity\", Lucian Boia says that the Bible's portrayal of Methuselah and other long lived figures features \"traces of the Mesopatamian legends\" found in the \"Epic of Gilgamesh\", where Gilgamesh rules Uruk for 126 years, and his ancestors are said to have ruled for several hundred years each.", "Boia also notes that tales of kings who lived for thousands of years can be found in both Indian and Chinese mythology, and that the Bible is comparatively \"restrained\" in depicting early humans as being able to live for hundreds of years, rather than thousands.", "Boia notes that following the Flood, the Bible depicts its character's lifespans as gradually diminishing; Noah's sons lived between 400 and 500 years, while Abraham died at 175, Moses died at 120, and David died at 70, an age that the Bible portrays as old for David's time period." ], [ "Methuselah", "Methuselah\n\nMethuselah ( \"Metushela\u1e25\" \"Man of the javelin\" or \"Man of Selah\") is a biblical patriarch and a figure in Judaism, Christianity, and Islam.", "Said to have died at the age of 969, he lived the longest of all figures mentioned in the Bible.", "According to the Book of Genesis, Methuselah was the son of Enoch, the father of Lamech, and the grandfather of Noah.", "Elsewhere in the Bible, Methuselah is mentioned in genealogies in 1st Chronicles and the Gospel of Luke.", "His life is described in further detail in extra-biblical religious texts such as the Book of Enoch, Slavonic Enoch, and the Book of Moses.", "Bible commentators have offered various explanations as to why the Book of Genesis describes him as having died at such an advanced age; some scholars believe that Methuselah's age is the result of mistranslation, while others believe that his age is used to give the impression that part of Genesis takes place in a very distant past.", "Methuselah's name has become synonymous with longevity, and he has been portrayed and referenced in film, television, and music.", "Methuselah is a biblical patriarch mentioned in , as part of the genealogy linking Adam to Noah." ] ], "gold": "The oldest person ever whose age has been independently verified is Jeanne Calment (1875\u20131997) of France, who lived to the age of 122 years, 164 days. Methuselah was a biblical patriarch and a figure in Judaism, Christianity, and Islam. His was the longest human lifespan of all those given in the Bible, 969 years.", "prediction 1": "There are several people who are the longest-living people in history. The longest person to live who is said to have died at the age of 969 is Methuselah. Jeanne Calment of France, who died in 1997 aged 122 years, 164 days, had the longest human lifespan documented. The oldest person to live who was verified to be the longest is Jiroemon Kimura of Japan, who died in 2013 aged 116 years and 54 days.", "prediction 2": "The longest person who ever lived is probably Methuselah, a biblical patriarch and a figure in Judaism, Christianity, and Islam, who lived between the ages of 969 and 972 BC. However, other figures living beyond that age have lived longer according to a number of theories, including that Methuselah lived between 400 and 500 years, that Moses lived between 120 and 120 years, and that David lived between 70 and 81 years.", "prediction 3": "There are several people who are the longest person who ever lived. According to the Bible, Methuselah lived the longest, and he is described as the \"Man of the javelin\" and the \"Man of Selah.\" The oldest person who has lived to the age of 114 years and 54 days is Jiroemon Kimura of Japan.", "prediction 4": "The longest person who ever lived is Methuselah, a biblical patriarch and figure in Judaism, Christianity, and Islam. According to the Bible, Methuselah was the son of Enoch, the father of Lamech, and the grandfather of Noah. In the 12th century, the oldest person to live beyond 720 years was Jeanne Calment of France, who died in 1997 aged 122 years, 164 days, with the longest documented human lifespan. In the 20th century, the longest documented was Jiroemon Kimura of Japan, who died in 2013.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 294, "end": 328 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several people who are the longest-living people in history. Methuselah is a biblical patriarch and a figure in Judaism, Christianity, and Islam. He is said to have died at the age of 969. Jeanne Calment of France, who died in 1997 aged 122 years, 164 days, had the longest human lifespan documented. The oldest verified man is Jiroemon Kimura of Japan, who died in 2013 aged 116 years and 54 days." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Grey's anatomy when does izzie get cancer?", "passages": [ [ "Grey's Anatomy", "Grey's Anatomy\n\nGrey's Anatomy is an American medical drama television series that premiered on March 27, 2005, on the American Broadcasting Company (ABC) as a mid-season replacement.", "The fictional series focuses on the lives of surgical interns, residents, and attending physicians, as they develop into seasoned doctors while trying to maintain personal lives and relationships.", "The title is a play on \"Gray's Anatomy\", a classic human anatomy textbook first published in 1858 in London and written by Henry Gray.", "Shonda Rhimes developed the pilot and continues to write for the series; she is also one of the executive producers, along with Betsy Beers, Mark Gordon, Krista Vernoff, Rob Corn, Mark Wilding, and Allan Heinberg.", "Although the series is set in Seattle (at the fictional Seattle Grace Hospital, later known as the Grey-Sloan Memorial Hospital), it is filmed primarily in Los Angeles, California.", "The series was designed to be racially diverse and used color-blind casting.", "It revolves around the title character, Dr. Meredith Grey, played by Ellen Pompeo, first featured as an intern.", "The original cast consisted of nine star-billed actors: Pompeo, Sandra Oh, Katherine Heigl, Justin Chambers, T. R. Knight, Chandra Wilson, James Pickens Jr., Isaiah Washington and Patrick Dempsey." ] ], "gold": "\"I Will Follow You Into the Dark\" was the episode Izzie was diagnosed with cancer on the television series Grey's Anatomy, while the season Izzie was diagnosed with breast cancer was Season 5.", "prediction 1": "Grey's Anatomy is an American medical drama television series that premiered on March 27, 2005, on the American Broadcasting Company (ABC) as a mid-season replacement for the original Grey's Anatomy. The fictional series focuses on the lives of surgical interns, residents, and attending physicians, as they develop into seasoned doctors while trying to maintain personal lives and relationships. The series revolves around the title character, Dr. Meredith Grey, played by Ellen Pompeo, first featured as an intern.", "prediction 2": "Grey's Anatomy is an American medical drama television series that premiered on March 27, 2005, on the American Broadcasting Company (ABC) as a mid-season replacement for Grey's Anatomy. The fictional series focuses on the lives of surgical interns, residents, and attending physicians, as they develop into seasoned doctors while trying to maintain personal lives and relationships. Grey's Anatomy is based on Gray's Anatomy, a classic human anatomy textbook first published in 1858 in London and written by Henry Gray.", "prediction 3": "Grey's Anatomy is an American medical drama television series that premiered on March 27, 2005, on the American Broadcasting Company as a mid-season replacement. The fictional series focuses on the lives of surgical interns, residents, and attending physicians, as they develop into seasoned doctors while trying to maintain personal lives and relationships. Grey's Anatomy's storyline focuses on the lives of surgical interns, residents, and attending physicians, as they develop into seasoned doctors while trying to maintain personal lives and relationships.", "prediction 4": "Grey's Anatomy is an American medical drama television series. In the Series, Izzie gets cancer. In the Series, Izzie gets breast cancer. In the Series, Izzie gets breast cancer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 200, "end": 396 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 516 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "What are the different types of plant reproduction?", "passages": [ [ "Plant reproduction", "Plant reproduction\n\nReproduction means producing offspring for the survival of the species.", "Plant reproduction is the production of new individuals or offspring in plants, which can be accomplished by sexual or asexual reproduction.", "Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents.", "Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur.", "In seed plants, the offspring can be packaged in a protective seed, which is used as an agent of dispersal.", "Reproduction in which male and female gametes do not fuse, as they do in sexual reproduction.", "Asexual reproduction may occur through budding, fragmentation, fission, spore formation and vegetative propagation.", "Plants have two main types of asexual reproduction in which new plants are produced that are genetically identical clones of the parent individual.", "Vegetative reproduction invoves \na vegetative piece of the original plant (budding, tillering, etc.) and is distinguished from \"apomixis\", which is a replacement for sexual reproduction, and in some cases involves seeds.", "Apomixis occurs in many plant species and also in some non-plant organisms.", "For apomixis and similar processes in non-plant organisms, see parthenogenesis." ] ], "gold": "Plant reproduction is the production of new offspring in plants, which can be accomplished by sexual or asexual reproduction. Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents. Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur. Asexual reproduction may occur through binary Fission, budding, fragmentation, spore formation, regeneration and vegetative propagation.", "prediction 1": "Plant reproduction is the production of new individuals or offspring in plants, which can be accomplished by sexual or asexual reproduction. Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents. Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur. There are many different types of plant reproduction.", "prediction 2": "Plants have two main types of asexual reproduction, in which new plants are produced that are genetically identical clones of the parent individual. Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents. Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur. Vegetative reproduction involves a vegetative piece of the original plant (budding, tillering, etc.", "prediction 3": "Plants have two main types of reproduction, sexual reproduction and asexual reproduction. Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents. Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur. Plants have two main types of asexual reproduction, asexual reproduction and vegetative reproduction.", "prediction 4": "Plants have two main types of reproduction. Asexual reproduction is when male and female gametes do not fuse, as they do in sexual reproduction. Vegetative reproduction is when a vegetative piece of the original plant is used to produce new plants that are genetically identical clones of the parent individual. Plants have two main types of asexual reproduction in which new plants are produced that are genetically identical clones of the parent individual. Apomixis is a replacement for sexual reproduction and in some cases involves seeds.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 444, "end": 497 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Plant reproduction is the production of new individuals or offspring in plants, which can be accomplished by sexual or asexual reproduction. Sexual reproduction produces offspring by the fusion of gametes, resulting in offspring genetically different from the parent or parents. Asexual reproduction produces new individuals without the fusion of gametes, genetically identical to the parent plants and each other, except when mutations occur. Asexual reproduction may occur through budding, fragmentation, fission, spore formation and vegetative propagation. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When were lord of the rings books written?", "passages": [ [ "The Lord of the Rings", "After several false starts, the story of the One Ring emerged.", "The idea for the first chapter (\"A Long-Expected Party\") arrived fully formed, although the reasons behind Bilbo's disappearance, the significance of the Ring, and the title \"The Lord of the Rings\" did not arrive until the spring of 1938.", "Originally, he planned to write a story in which Bilbo had used up all his treasure and was looking for another adventure to gain more; however, he remembered the Ring and its powers and thought that would be a better focus for the new work.", "As the story progressed, he also brought in elements from \"The Silmarillion\" mythology.", "Writing was slow, because Tolkien had a full-time academic position, and needed to earn further money as a university examiner.", "Tolkien abandoned \"The Lord of the Rings\" during most of 1943 and only restarted it in April 1944, as a serial for his son Christopher Tolkien, who was sent chapters as they were written while he was serving in South Africa with the Royal Air Force.", "Tolkien made another concerted effort in 1946, and showed the manuscript to his publishers in 1947.", "The story was effectively finished the next year, but Tolkien did not complete the revision of earlier parts of the work until 1949." ], [ "The Lord of the Rings", "However despite criticism that the book's characters \"are all either black or white\", some of the 'good' characters have darker sides that feature in the story, and likewise some of the villains have \"good impulses\".", "Therefore the categorization of characters as either 'protagonists' or 'antagonists' below indicates their \"general\" role in the story.", "\"The Lord of the Rings\" started as a sequel to J. R. R. Tolkien's work \"The Hobbit,\" published in 1937.", "The popularity of \"The Hobbit\" had led George Allen & Unwin, the publishers, to request a sequel.", "Tolkien warned them that he wrote quite slowly, and responded with several stories he had already developed.", "Having rejected his contemporary drafts for \"The Silmarillion\", putting on hold \"Roverandom\", and accepting \"Farmer Giles of Ham\", Allen & Unwin thought more stories about hobbits would be popular.", "So at the age of 45, Tolkien began writing the story that would become \"The Lord of the Rings.\"", "The story would not be finished until 12 years later, in 1949, and would not be fully published until 1955, when Tolkien was 63 years old.", "Persuaded by his publishers, he started \"a new Hobbit\" in December 1937." ], [ "The Lord of the Rings", "From quiet beginnings in the Shire, a hobbit land not unlike the English countryside, the story ranges across Middle-earth, following the course of the War of the Ring through the eyes of its characters, not only the hobbits Frodo Baggins, Samwise \"Sam\" Gamgee, Meriadoc \"Merry\" Brandybuck and Peregrin \"Pippin\" Took, but also the hobbits' chief allies and travelling companions: the Men, Aragorn, a Ranger of the North, and Boromir, a Captain of Gondor; Gimli, a Dwarf warrior; Legolas Greenleaf, an Elven prince; and Gandalf, a wizard.", "The work was initially intended by Tolkien to be one volume of a two-volume set, the other to be \"The Silmarillion\", but this idea was dismissed by his publisher.", "For economic reasons, \"The Lord of the Rings\" was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955.", "The three volumes were titled \"The Fellowship of the Ring\", \"The Two Towers\" and \"The Return of the King\".", "Structurally, the novel is divided internally into six books, two per volume, with several appendices of background material included at the end.", "Some editions combine the entire work into a single volume." ] ], "gold": "The Lord of the Rings books were started in December 1937 and finished being written in 1949, and the novel The Lord of the Rings was published in three volumes\u2014The Fellowship of the Ring, The Two Towers, and The Return of the King. The Fellowship of the Ring, The Two Towers, and The Return of the King were published on 29 July 1954, on 11 November 1954, and on 20 October 1955, respectively.", "prediction 1": "The Lord of the Rings started as a sequel to J. R. R. Tolkien's work The Hobbit, published in 1937. When Tolkien started writing the book when he was 45 years old, the story would not be finished until 12 years later, in 1949, and would not be fully published until 1955, when Tolkien was 63 years old. For economic reasons, The Lord of the Rings was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955.", "prediction 2": "The Lord of the Rings began as a sequel to J. R. R. Tolkien's work The Hobbit in 1937. In 1946 Tolkien showed the manuscript to his publishers in 1947, but would not complete the revision of earlier parts of the work until 1949. For economic reasons, The Lord of the Rings was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955.", "prediction 3": "The Lord of the Rings started as a sequel to J. R. R. Tolkien's work The Hobbit, published in 1937. This sequel was not finished until 1949, and the full book was not published until 1955, when Tolkien was 63 years old. For economic reasons, The Lord of the Rings was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955.", "prediction 4": "The Lord of the Rings started as a sequel to J. R. R. Tolkien's work The Hobbit, published in 1937. The story would not be finished until 12 years later, in 1949, and would not be fully published until 1955, when Tolkien was 63 years old. The Lord of the Rings was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955, with the final volume being completed in a single volume.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 302 }, { "error type": "Irrelevant", "explanation": "", "start": 30, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 163 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Lord of the Rings started in 1937 and the story would not be finished until 12 years later, in 1949. For economic reasons, The Lord of the Rings was published in three volumes over the course of a year from 29 July 1954 to 20 October 1955. The three volumes were titled \"The Fellowship of the Ring\", \"The Two Towers\" and \"The Return of the King\"." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When was i know why the cage bird sings written?", "passages": [ [ "I Know Why the Caged Bird Sings", "I Know Why the Caged Bird Sings\n\nI Know Why the Caged Bird Sings is a 1969 autobiography describing the early years of American writer and poet Maya Angelou.", "The first in a seven-volume series, it is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma.", "The book begins when three-year-old Maya and her older brother are sent to Stamps, Arkansas, to live with their grandmother and ends when Maya becomes a mother at the age of 16.", "In the course of \"Caged Bird\", Maya transforms from a victim of racism with an inferiority complex into a self-possessed, dignified young woman capable of responding to prejudice.", "Angelou was challenged by her friend, author James Baldwin, and her editor, Robert Loomis, to write an autobiography that was also a piece of literature.", "Reviewers often categorize \"Caged Bird\" as autobiographical fiction because Angelou uses thematic development and other techniques common to fiction, but the prevailing critical view characterizes it as an autobiography, a genre she attempts to critique, change, and expand." ], [ "I Know Why the Caged Bird Sings (film)", "I Know Why the Caged Bird Sings (film)\n\n", "I Know Why the Caged Bird Sings is an American television film based on the autobiography of the same name by Maya Angelou, first aired April 28, 1979 on CBS.", "Angelou and Leonora Thuna wrote the screenplay, and the movie was directed by Fielder Cook.", "Constance Good played the young Maya Angelou.", "Also appearing were Esther Rolle, Roger E. Mosley, Diahann Carroll, Ruby Dee, and Madge Sinclair.", "Filming took place in Vicksburg, Mississippi.", "The movie traces Maya's life from when she and her brother move in with their grandmother to the trauma of being raped as a young girl by one of her mother's boyfriends and the several years of silence that came after the attack.", "Two scenes in the movie differed from events described in the book.", "Angelou added a scene between Maya and Uncle Willie after the Joe Louis fight.", "In it, he expresses his feelings of redemption after Louis defeats a white opponent.", "Angelou also presents her eighth-grade graduation differently in the film.", "In the book, Henry Reed delivers the valedictory speech and leads the black audience in the Negro national anthem.", "In the movie, Maya conducts these activities." ] ], "gold": "I Know Why the Caged Bird Sings is a 1969 autobiography describing the early years of American writer and poet Maya Angelou. The first in a seven-volume series, it is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. On April 29, 1979, an American television film aired based on the autobiography. Angelou and Leonora Thuna wrote the screenplay, and the movie was directed by Fielder Cook. ", "prediction 1": "I Know Why the Caged Bird Sings is a 1969 autobiography about the early years of American writer and poet Maya Angelou. The book is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. It is also the title of an American television film based on the book that premiered on April 28, 1979 on CBS.", "prediction 2": "I Know Why the Caged Bird Sings is a 1969 autobiography written by American writer and poet Maya Angelou. It is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. I Know Why the Caged Bird Sings is also a television film based on the book. It first aired on April 28, 1979 on CBS.", "prediction 3": "I Know Why the Caged Bird Sings is a 1969 autobiography describing the early years of American writer and poet Maya Angelou. It is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. The 1969 book was challenged by her friend, author James Baldwin, and her editor, Robert Loomis, to write an autobiography that was also a piece of literature. I Know Why the Caged Bird Sings is also the title of I Know Why the Caged Bird Sings is an American television film, first aired April 28, 1979 on CBS.", "prediction 4": "I Know Why the Caged Bird Sings is a 1969 autobiography by American writer and poet Maya Angelou. It is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. An American television film based on the book, I Know Why the Caged Bird Sings, was produced by Leonora Thuna and Angelou. The movie made of the book was released on April 28, 1979 on CBS.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 369 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "I Know Why the Caged Bird Sings is a 1969 autobiography about the early years of American writer and poet Maya Angelou. The first in a seven-volume series, it is a coming-of-age story that illustrates how strength of character and a love of literature can help overcome racism and trauma. It is also the title of an American television film based on the book that premiered on April 28, 1979. Angelou and Leonora Thuna wrote the screenplay, and the movie was directed by Fielder Cook." }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "When does heather get voted off total drama island?", "passages": [ [ "Total Drama Island", "Total Drama Island\n\nTotal Drama Island (sometimes shortened to TDI) is a Canadian animated television series which premiered in Canada on Teletoon on July 9, 2007 and on June 5, 2008 in the U.S. on Cartoon Network.", "This is the first season of the \"Total Drama\" series and has 27 episodes, each 22 minutes in duration with a special 44 minute episode at the end.", "The season is mostly a parody of the series \"Survivor\", and features 22 campers in an elimination-based competition.", "On the Cartoon Network airing in the United States, some content has been removed from the episodes by censors in order to keep the rating open to a younger audience; for example, putting in words instead of long bleeps, and censoring of sensitive body parts, for the episodes \"That's Off the Chain\" and \"Trial by Tri-Armed Triathlon\".", "The fourth season, \"\", takes place on the same island as this season, but with an all-new cast.", "\"Total Drama Island\" was created by Tom McGillis and Jennifer Pertsch with their production studio, Fresh TV, which also created their previous animated series, \"6teen\"." ], [ "Spencer Pratt", "After the season finished airing, Pratt, Apostol, and Cesternino continued \"The Spyson Hour\", discussing Pratt's reality TV history and zany current events.", "Pratt left the show in October 2015.", "In 2017 Pratt re-entered the \"Celebrity Big Brother\" with his wife.", "On day 18 the couple were eternally nominated by James Cosmo, which they did not have a good reaction to.", "They were saved in an eight-person eviction on day 22 however, they were evicted on day 25 against Kim Woodburn, Jessica Cunningham, Bianca Gascoigne and Jedward.", "Pratt and Montag were reunited with their rival, Rylan Clark-Neal, on \"Big Brother's Bit on the Side\" that night.", "Pratt developed a widespread fanbase on Snapchat by posting stories showing his family, daily life and his passion for hummingbirds.", "His popularity led to him being nominated in January 2018 for Snapchatter of the Year at the 10th Annual Shorty Awards, eventually winning the category.", "In December 2013, Pratt completed his undergraduate degree in political science at the University of Southern California after ten years.", "Pratt had left his studies to pursue television projects and re-enrolled in 2011.", "During the fourth season of \"The Hills\", Montag and Pratt eloped in Mexico on November 20, 2008." ] ], "gold": "Total Drama Island is a Canadian animated comedy television series that pits 22 campers in an elimination-based competition. Heather gets voted off the island in Season 1 episode 25, which is called I Triple Dog Dare You! The episode aired in Canada on December 16, 2007 and in the US on November 20, 2008.", "prediction 1": "Total Drama Island is a Canadian animated television series which premiered in Canada on Teletoon on July 9, 2007 and on June 5, 2008 in the U.S. on Cartoon Network. The first season of the show has 27 episodes, each 22 minutes in duration with a special 44 minute episode at the end. Heather and Spencer Pratt get voted off Total Drama Island in season 1 episode 4 \"That's Off the Chain\", episode 74, which was aired on June 5, 2008.", "prediction 2": "On the Canadian animated television series Total Drama Island, Heather gets voted off the show for a third time. She was voted off the show for the fourth time on day 25.", "prediction 3": "Total Drama Island is a Canadian animated television series which premiered in Canada on Teletoon on July 9, 2007 and on June 5, 2008 in the U.S. on Cartoon Network. Heather gets voted off Total Drama Island on day 25 of the first season.", "prediction 4": "Total Drama Island is a Canadian animated television series, created by Tom McGillis and Jennifer Pertsch, that premiered in Canada on Teletoon on July 9, 2007 and on June 5, 2008 in the U.S. on Cartoon Network. Heather Montag gets voted off Total Drama Island in Season 1, Episode 2 on day 28. In Season 2, Episode 3, Episode 4, and Episode 5, Heather gets voted off Total Drama Island in Episode 6, Episode 7, Episode 9 on day 14.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 166, "end": 284 }, { "error type": "Unverifiable", "explanation": "", "start": 285, "end": 434 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Total Drama Island is a Canadian animated television series that features 22 campers in an elimination-based competition. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who won the 2018 mens figure skating olympics?", "passages": [ [ "Figure skating at the 2018 Winter Olympics \u2013 Men's singles", "Figure skating at the 2018 Winter Olympics \u2013 Men's singles\n\nThe men's single figure skating competition of the 2018 Winter Olympics was held on 16 and 17 February 2018 at the Gangneung Ice Arena in Gangneung, South Korea.", "The short program was held on 16 February and the free skating was held on 17 February.", "This medal event was the 1000th medal event in the history of the Winter Olympic Games.", "With his victory at the 2018 Winter Olympics, Yuzuru Hanyu became the first male figure skater to win two consecutive gold medals after Dick Button, who did so in 1952.", "Fellow countryman Shoma Uno won the silver medal, and Spain's Javier Fern\u00e1ndez won the bronze medal.", "Fern\u00e1ndez won Spain's first figure skating medal and fourth medal at the Winter Olympics.", "After the short program, Hanyu, Fern\u00e1ndez, Uno, and Jin Boyang were first, second, third, and fourth respectively.", "Nathan Chen, originally one of the favorites for the podium, skated an uncharacteristically poor short program that placed him at 17th, but fought back to win the free skating with a score of 215.08--8.91 points above the second place free skating by Hanyu.", "He ended up fifth overall." ], [ "Shoma Uno", "In his following competition at 2017 Internationaux de France, he placed second in the short program and first in the free skate to place second overall behind Javier Fernandez.", "His results qualified him for his third consecutive senior Grand Prix Final, where he won the silver medal only 0.5 points behind Nathan Chen.", "At the 2017 Japan Figure Skating Championships, Uno successfully defended his national title.", "On December 24, 2017 it was announced that Uno would represent Japan at the 2018 Four Continents Figure Skating Championships in Taipei City,\u00a0Chinese Taipei, 2018 Winter Olympics in Pyeongchang, South Korea,\u00a0and 2018 World Figure Skating Championships in Milan, Italy.", "Placing third in the short program and third in the free skate, Uno took silver at the 2018 Winter Olympics, 1.66 points ahead of bronze medallist Javier Fern\u00e1ndez of Spain.", "At the 2018 World Figure Skating Championships in Milan, Uno had to leave practice only after a few minutes on ice and was carried to a bus on a staff member's back.", "Upon examination, no serious injury was found, however his skates caused his pain.", "However, it has been decided that Uno will still compete in the competition.", "Uno scored 94.26 in the short program, and 179.51 in the free skate, with a total score of 273.77, earning him the silver medal." ] ], "gold": "The men's single figure skating competition of the 2018 Winter Olympics was held on 16 and 17 February 2018 at the Gangneung Ice Arena in Gangneung, South Korea. The short program was held on 16 February and the free skating was held on 17 February. Yuzuru Hanyu won the gold medal at the 2018 Winter Olympics and became the first male figure skater in 66 years to win two consecutive gold medals, after Dick Button did so in 1952. Fellow countryman Shoma Uno won the silver medal, and Spain's Javier Fernandez won the bronze medal, Spain's first figure skating medal.", "prediction 1": "Yuzuru Hanyu won the men's single figure skating competition of the 2018 Winter Olympics, while fellow countryman Shoma Uno won the silver medal. Spain's Javier Fern\u00e1ndez won the bronze medal.", "prediction 2": "Yuzuru Hanyu won the men's single figure skating competition of the 2018 Winter Olympics on 16 and 17 February 2018 at the Gangneung Ice Arena in Gangneung, South Korea. Fellow countryman Shoma Uno won the silver medal, and Spain's Javier Fern\u00e1ndez won the bronze medal.", "prediction 3": "Yuzuru Hanyu won the men's single figure skating competition of the 2018 Winter Olympics, which was held on 16 and 17 February 2018 at the Gangneung Ice Arena in Gangneung, South Korea. Fellow countryman Shoma Uno won the silver medal, and Spain's Javier Fern\u00e1ndez won the bronze medal.", "prediction 4": "Yuzuru Hanyu won the men's single figure skating competition at the 2018 Winter Olympics. Fellow countryman Shoma Uno won the silver medal, and Spain's Javier Fern\u00e1ndez won the bronze medal.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The men's single figure skating competition of the 2018 Winter Olympics was held on 16 and 17 February 2018 at the Gangneung Ice Arena in Gangneung, South Korea. The short program was held on 16 February and the free skating was held on 17 February. Yuzuru Hanyu won the men's single figure skating competition of the 2018 Winter Olympics, while fellow countryman Shoma Uno won the silver medal. Spain's Javier Fern\u00e1ndez won the bronze medal. With his victory at the 2018 Winter Olympics, Yuzuru Hanyu became the first male figure skater to win two consecutive gold medals after Dick Button, who did so in 1952." }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "What is the current season number of survivor?", "passages": [ [ "Survivor: Game Changers", "Survivor: Game Changers\n\nSurvivor: Game Changers \u2014 Mamanuca Islands is the 34th season of the American CBS competitive reality television series \"Survivor\", featuring 20 returning castaways.", "The season premiered on March 8, 2017 with a two-hour airing, marking the series' 500th episode, and ended on May 24, 2017, when Sarah Lacina was named the winner over Brad Culpepper and Troy \"Troyzan\" Robertson in a 7\u20133\u20130 vote.", "This season was the third to film in Fiji after \"\" and \"\".", "It was the fourth season to feature entirely returning players, following \"\", \"\", and \"\" and was the 11th season overall to feature returning players.", "This season introduced several alterations to the game format.", "The process for resolving a tied vote was changed for this season, removing the second ballot where only non-tied castaways were allowed to vote between the tied castaways and proceeding directly to the procedure to resolve a deadlocked tie: an open deliberation between non-tied voters.", "The rest of the process remained the same.", "The format of the Final Tribal Council, in which jurors individually addressed the finalists by delivering a statement or asking questions, was changed to a moderated discussion between the finalists and jurors." ], [ "Survivor (U.S. TV series)", "These changes have included tribal switches, seasons starting with more than two tribes, the ability to exile a player from a tribe for a short time, hidden immunity idols that players can use to save themselves or others at Tribal Council, special voting powers which can be used to influence the result at Tribal Council, chance to return to regular gameplay after elimination through the \"Redemption Island\" or \"The Outcast Tribe\" twists, and a final four fire-making challenge as of season 35.", "The United States version is produced by Mark Burnett and hosted by Jeff Probst.", "Each competition is called a season, has a unique name, and lasts from 13 to 16 episodes.", "The first season was broadcast as a summer replacement show in 2000.", "Starting with \"\", there have been two seasons aired during each U.S. television season.", "In the first season, there was a 75-person crew.", "By season 22, the crew had grown to 325 people.", "A total of 556 contestants have competed on \"Survivor\"s 37 seasons.", "The original idea of \"Survivor\" was developed by Charlie Parsons in 1994 under the name \"Castaway\".", "Parsons formed Planet24 with Bob Geldof to produce the show and tried to have the BBC broadcast it, but the network turned it down." ], [ "Survivor: Millennials vs. Gen X", "Survivor: Millennials vs. Gen X\n\nSurvivor: Millennials vs. Gen\u00a0X is the 33rd season of the American CBS competitive reality television series \"Survivor\".", "It featured two initial tribes of ten new castaways divided by generation: Gen\u00a0X, born between 1963 and 1982, and Millennials, born between 1984 and 1997 (no one born in 1983 was cast this season).", "It is the third season to divide the castaways into tribes by age, following \"\" and \"\", and the second season to film in Fiji, following \"\", which was filmed in a different location.", "The season premiered on September 21, 2016 with a 90-minute episode and ended on December 14, 2016 when Adam Klein was unanimously awarded the title of Sole Survivor over Ken McNickle and Hannah Shapiro by a jury vote of 10\u20130\u20130.", "This season featured the first full cast evacuation, where all contestants were removed on the second day of competition due to Severe Tropical Cyclone Zena; the castaways were returned to their camps the next morning and no additional time was needed to complete the game.", "A DVD release of the season was released by Amazon.com on November 21, 2018." ] ], "gold": "The season number of Survivor depends on when the season's episodes aired. For example, the season numbers were 35, 34, and 33 for episodes of Survivor that aired between September 27 and December 20, 2017, between March 8 and May 24, 2017, and between September 21 and December 14, 2016, respectively.", "prediction 1": "Survivor has had several seasons. The current season of Survivor is 37. The current season of Survivor: The Game Changers Tribe is season 34. The current season of Survivor: The Game Changers Tribe is season 36. The current season of Survivor: The Game Changers Tribe is season 37.", "prediction 2": "Season number of Survivor is 35. Season 33: Generations of Survivor is the number of seasons that have been aired. Season 34: Mamanuca Islands is the number of seasons that have been numbered from 16 to 35. The number of seasons that have been numbered from 16 to 35 is based on the number of episodes that have been aired.", "prediction 3": "The current season number of Survivor is 37. The current season number of Survivor: The Game Changers is 38. The current season number of Survivor: The Game Changers is 34. The current season number of Survivor: The Game Changers is 36. The current season number of Survivor: The Game Changers is 35.", "prediction 4": "Survivor has aired 36 seasons. Survivor: New York City is the 32nd season. Survivor: San Francisco is the 33rd season. Survivor: Millennials vs. Gen X is the 33rd season.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 38, "end": 45 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 76, "end": 90 }, { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 141 }, { "error type": "Redundant", "explanation": "The current season of Survivor: The Game Changers Tribe is season 34.", "start": 146, "end": 197 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 201, "end": 211 }, { "error type": "Redundant", "explanation": " The current season of Survivor: The Game Changers Tribe is season 36. ", "start": 212, "end": 267 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 271, "end": 281 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 4 ] } ], "corrected-prediction": "Survivor has had several seasons. There are at least 37 seasons. Season 34 premiered on March 8, 2017 and ended on May 24, 2017. Season 33 premiered on September 21, 2016 and ended on December 14, 2016." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Actor who plays chuck on better call saul?", "passages": [ [ "Chuck McGill", "TVLine named Michael McKean the \"Performer of the Week\" for his performance in this episode, writing it was the \"finest showcase yet for his fascinatingly layered performance as Jimmy's brother Chuck McGill.\"", "Donna Bowman of \"The A.V. Club\", who gave the episode an \"A\" rating, praised the courtroom scene, saying \"it isn\u2019t just to give us the satisfaction of a courtroom drama, the neat ending where the truth comes out.", "The brilliance of this structure is to give us a slow-motion view of the heavens falling, an outcome methodically pursued by Kim and Jimmy, which nevertheless seems to give them no satisfaction.\"", "Many critics were disappointed when McKean, who was said to have given \"one of the best performances by anyone in TV all year\", failed to secure an Emmy nomination while his co-star Jonathan Banks did.", "For his performances as Chuck McGill, Michael McKean won a Satellite Award for Best Supporting Actor in 2018 at the 22nd Satellite Awards.", "Matt Zoller Seitz of \"Vulture\" considers him to be the \"Better Call Saul\" version of \"Breaking Bad\" character Skyler White." ], [ "Better Call Saul (season 1)", "Better Call Saul (season 1)\n\n", "The first season of the American television drama series \"Better Call Saul\" premiered on February 8, 2015, and concluded on April 6, 2015.", "The ten-episode season was broadcast on Monday nights in the United States on AMC, excluding the pilot episode which aired on a Sunday.", "\"Better Call Saul\" is a spin-off of \"Breaking Bad\" created by Vince Gilligan and Peter Gould who also worked on \"Breaking Bad\".", "The first season mainly takes place in 2002, and features Bob Odenkirk reprising his role from \"Breaking Bad\" as James Morgan \"Jimmy\" McGill, a lawyer who later becomes known as Saul Goodman from the fourth season onwards.", "Jonathan Banks also reprises his role as Mike Ehrmantraut, a former Philadelphia police officer who works independently as a parking lot attendant, and later on a private investigator and \"cleaner\".", "By July 2013, the series had yet to be green-lighted.", "Netflix was one of many interested distributors, but ultimately a deal was made between AMC and \"Breaking Bad\" production company Sony Pictures Television.", "Gilligan and Gould serve as co-showrunners and Gilligan directed the pilot." ], [ "Michael McKean", "Michael McKean\n\nMichael McKean (born October 17, 1947) is an American actor, comedian, and musician, known for a variety of roles played since the 1970s.", "McKean's first big role was playing annoying neighbor Lenny Kosnowski on the sitcom \"Laverne & Shirley\".", "In the mid-1990s he was a repertory cast member on \"Saturday Night Live\".", "He has played roles in several Christopher Guest ensemble films, particularly as David St. Hubbins, lead vocalist and co-lead guitarist of the fictional rock band Spinal Tap in \"This Is Spinal Tap\".", "He co-wrote the song \"A Mighty Wind\" (from the film of the same name), which won a Grammy Award, as well as \"A Kiss at the End of the Rainbow\" from the same film, which was nominated for the Academy Award for Best Song.", "McKean portrayed Chuck McGill, brother of Saul Goodman, as a series regular on the AMC drama series \"Better Call Saul\" from 2015 to 2018.", "McKean was born October 17, 1947, in New York City, the son of Ruth, a librarian, and Gilbert McKean, one of the founders of Decca Records, and was raised in Sea Cliff, New York, on Long Island.", "McKean is of Irish, English, Scottish, and some German and Dutch, descent." ] ], "gold": "On the television series Better Call Saul, young Chuck is played by actor Gabriel Rush, while Chuck as an adult is played by Michael McKean\u2014an American actor, comedian, screenwriter, and musician who won a Satellite Award for Best Supporting Actor for his performances as Chuck McGill.", "prediction 1": "On the American television series Better Call Saul, Chuck McGill is played by Michael McKean. The character has been portrayed from 2015 to 2018.", "prediction 2": "Chuck McGill is a character on the American television drama series Better Call Saul. Actor Michael McKean played Chuck McGill from 2015 to 2018.", "prediction 3": "AMC television series called Better Call Saul has a spin-off of the hit television series Breaking Bad, which is based on the real life story of lawyer Saul Goodman. In the first season, Mike McKean portrayed Chuck McGill as a series regular. In Season 2, McKean played Chuck McGill as a guest star. In Season 3, Michael McKean played Chuck McGill as a regular guest star. In Season 6, Chuck McGill was portrayed by Jonathan Banks.", "prediction 4": "Chuck McGill is a character on the American television series Better Call Saul, a spin-off of Breaking Bad, which premiered on February 8, 2015, and concluded on April 6, 2015. Chuck McGill was played by Michael McKean from 2015 to 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 145 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "On the American television series Better Call Saul, Chuck McGill is played by Michael McKean. McKean is an American actor, comedian, and musician. He won a Satellite Award for Best Supporting Actor for playing Chuck as well." }, "preference": [ 0, 2, 2, 2, 2, 1 ] }, { "question": "What year did the black album come out?", "passages": [ [ "The Black Album (Jay-Z album)", "The Black Album (Jay-Z album)\n\nThe Black Album is the eighth studio album by American rapper Jay-Z, released on November 14, 2003, by Roc-A-Fella Records.", "It was advertised as his final album before retiring, which is also a recurring theme throughout the songs, although Jay-Z resumed his recording career in 2006.", "For the album, Jay-Z wanted to enlist a different producer for each song, working with Just Blaze, Kanye West, The Neptunes, DJ Quik, Timbaland, 9th Wonder and Rick Rubin, among others.", "When \"The Black Album\" was released, it received widespread acclaim from critics.", "In its first week, the album debuted at number one on the \"Billboard\" 200, selling 463,000 copies in the United States.", "It became Jay-Z's top selling record of the 2000s decade, and by July 2013, it had sold 3,516,000 copies in the US.", "\"The Black Album\" was promoted with a retirement tour by Jay-Z and three singles that also achieved \"Billboard\" chart success, including the top-ten hits \"Change Clothes\" and \"Dirt off Your Shoulder\".", "Jay-Z had announced that \"The Black Album\" would be his final record and went on a retirement tour after its release." ], [ "The Black Album (Prince album)", "The Black Album (Prince album)\n\nThe Black Album is the sixteenth studio album by American recording artist Prince.", "It was released on November 22, 1994, by Warner Bros. Records.", "It was originally planned for release on December 8, 1987, as the follow-up to \"Sign o' the Times\" and was to appear in an entirely black sleeve with no title or even a credit to Prince; hence it was referred to as \"The Black Album\".", "Dubbed \"The Funk Bible\" by preceding press releases, and in a hidden message within the album itself, the work seemed to be a reaction to criticism that Prince had become too pop-oriented.", "It was his attempt to regain his Black audience.", "The 1987 promo-only release had no printed title, artist name, production credits or photography printed; a simple black sleeve accompanied the disc.", "On promotional copies, only a song listing and catalog number\u201425677\u2014were printed on the disc itself.", "The commercial version was to only have the catalog number\u2014printed in pink\u2014on the spine.", "The original compact disc pressing was made by Sony DADC rather than WEA Manufacturing.", "After Prince became convinced that the album was \"evil\", he ordered it to be withdrawn a week before its release date." ], [ "Metallica discography", "The band's first release to feature the new member was \",\" and then followed by \"...", "And Justice for All\" in August 1988, which peaked at number six on the \"Billboard\" 200.", "Metallica's fifth, self-titled album, often called The Black Album, was released in 1991 and debuted at number one on the \"Billboard\" 200.", "The band embarked on a two-year tour in support of the album.", "\"Metallica\" has since been certified 16 times platinum by the RIAA.", "Metallica followed with the release of \"Load\" and \"Reload\", respectively.", "After the release of \"Garage Inc.\" and \"S&M\", Newsted (who would later join Voivod) departed from the band.", "Metallica recorded \"St. Anger\" without an official bassist (bass parts for the writing & recording during the album sessions were played by the band's long-time producer Bob Rock).", "Bassist Robert Trujillo joined Metallica in 2003.", "In 2008, the band released its ninth studio album, \"Death Magnetic\", which was produced by Rick Rubin and distributed through Warner Bros. Records.", "In April 2009, the band's catalogue was released on the iTunes Store as \"the Metallica Collection\".", "In 2013, Metallica released the movie, \"\", together with its soundtrack." ], [ "Weezer (2019 album)", "Weezer (2019 album)\n\nWeezer, also known as the Black Album, is the upcoming thirteenth studio album by American rock band Weezer.", "Produced by Dave Sitek, it is set to be released on March 1, 2019, through Crush Music and Atlantic Records.", "Weezer frontman Rivers Cuomo first hinted at the album in April 2016, shortly after the band released their tenth album \"Weezer\" (The White Album).", "\"What could stand out more against 'White' than 'Black'?", "I think it's going to maybe be like Beach Boys gone bad.", "I'm thinking of swearing, which is something I've never done in songs.\"", "While promoting the band's eleventh album \"Pacific Daydream\" in August 2017, Cuomo said \"The original plan was the Black Album but \"Pacific Daydream\" really came together.", "The Black Album is pretty much ready, it's coming.\"", "Cuomo first told Australian radio station Double J in February 2018 that the album would be released on May 25, later hinting at dates such as June 1 and June 12 on his Twitter account.", "On October 11, the first single from the album, \"Can't Knock the Hustle\", was released." ], [ "The Black Album/Come On Feel The Dandy Warhols", "The Black Album/Come On Feel The Dandy Warhols\n\nThe Black Album/Come On", "Feel The Dandy Warhols is a 2004 double album released by American alternative band, The Dandy Warhols.", "The two-disc set was released on their own Beat the World Records label.", "Initially, the album was only available to purchase through the band's website.", "It is now available to own via other sources.", "Disc one marks the first, official release of the band's 1996 demo album (\"The Black Album\") which was described as \"lost\".", "The album, recorded before \"...", "The Dandy Warhols Come Down\", was rejected by Capitol Records and dismissed by the band themselves.", "Three songs that were included on the original recording of the album are not included on this release, namely: \"Traci Lords\", \"Alien\" and \"You Get High\".", "The second disc (\"Come On Feel The Dandy Warhols\") is the first compilation album released by the band.", "It contains B-sides, covers, and previously unreleased material.", "\"Glide Magazine\" stated that the cover of Crosby, Stills, Nash and Young's \"Ohio\" used \"droning synthesizers\" to produce an \"alt/psychedelia sound.\"" ], [ "The Black Keys", "At the 2013 Grammy Awards, \"El Camino\" and \"Lonely Boy\" were nominated in five categories and were winners in three; the album won Best Rock Album, while \"Lonely Boy\" won Best Rock Performance and Best Rock Song.", "For their eighth studio album, \"Turn Blue\", the band once again collaborated with Danger Mouse, who co-produced and co-wrote the album.", "It was recorded primarily at Sunset Sound in Hollywood, California, from July\u2013August 2013, with additional recording at Key Club in Benton Harbor, Michigan, and Nashville's Easy Eye Sound in early 2014.", "The album was announced in March 2014 via Mike Tyson's Twitter account, with a link to a cryptic teaser video on YouTube featuring a hypnotist, and was released on May 13, 2014.", "The record exhibits psychedelic rock and soul influences and features a more melancholy tone, largely in part due to Auerbach dealing with the divorce from his wife during the album sessions.", "The first single, \"Fever\" was released on March 24, while a second single, \"Turn Blue\", followed on April 14.", "The album debuted at number one in the US and Australia, the band's first record to top the album charts in either country; 164,000 copies were sold in the US in its first week." ] ], "gold": "There are several artists with an album titled The Black Album. Metallica and Prince are two earlier artists who released an album under the title in the 90s, in 1991 and 1994, respectively. In the 2000s, Jay-Z released his album in 2003, and Dandy Warhol released theirs in 2004. In the 2010s, an unofficial Beatles album was released in 2014, and Weezer's album was released in 2019.", "prediction 1": "The Black Album is a series of studio albums by various artists. The eighth studio album by American rapper Jay-Z, The Black Album, was released on November 14, 2003. The sixteenth studio album by American recording artist Prince was released on November 22, 1994, by Warner Bros. Records. The Black Album was also the title of the album by Metallica's fifth studio album, often called The Black Album, which was released in 1991. The thirteenth studio album by American rock band Weezer, also known as The Black Album, was released on March 1, 2019.\n", "prediction 2": "The Black Album, or Black Album, was released 10 times. The first was in 1987 and the second in 1994. The third was released in 2015. The fourth was released in 2019. The fifth was released in 2015. The sixth was released in 2018. It came out in 2015.", "prediction 3": "The Black Album, often called The Black Album, was an album released by various artists. These include rapper Jay-Z's eighth studio album, released on November 14, 2003, and Prince's sixteenth studio album, released November 22, 1994. American rock band Weezer's 13th studio album, The Black Album, was announced in April 2016, shortly after the band released their tenth album Weezer.", "prediction 4": "The Black Album is the title of two studio albums by American musicians. The first, the eighth studio album by rapper Jay-Z, came out on November 14, 2003. The second, the sixteenth studio album by American recording artist Prince came out on November 22, 1994. The third, the new album by British rock band Weezer, came out on March 1, 2019, and was available on November 1, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 75 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 160 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 180 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 265, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 353, "end": 358 }, { "error type": "Irrelevant", "explanation": "", "start": 435, "end": 445 }, { "error type": "Irrelevant", "explanation": "", "start": 536, "end": 544 }, { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 30 }, { "error type": "Irrelevant", "explanation": "", "start": 446, "end": 452 }, { "error type": "Redundant", "explanation": "The Black Album", "start": 373, "end": 402 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] } ], "corrected-prediction": "There are several artists with an album titled The Black Album. Metallica released an album under the title in 1991. The album by American recording artist Prince was released in 1994. The album by American rapper Jay-Z was released in 2003. The Dandy Warhols released theirs in 2004. The American rock band Weezer's album was released in 2019.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When was the last time celtics won nba championship?", "passages": [ [ "Boston Celtics", "They would go on to dominate the league in the 1960s and the 1980s, facing each other six times in the 1960s, three times in the 1980s, in 2008, and in 2010.", "The rivalry had been less intense since the retirements of Magic Johnson and Larry Bird in the early 1990s, but in 2008 it was renewed as the Celtics and Lakers met in the Finals for the first time since 1987, with the Celtics winning the series in six games.", "They faced off once again in the 2010 NBA Finals which the Lakers won in seven games.", "The two teams have won the two highest numbers of championships, the Celtics 17, the Lakers 16; together, the 33 championships account for almost half of the 70 championships in NBA history.", "The rivalry between the Celtics and the New York Knicks stems from the location of the teams, both of which are in the NBA's Atlantic division.", "It is one of many rivalries between Boston and New York teams.", "Boston and New York are also the only two original NBA franchises that have remained in the same city for the duration of their existence.", "The teams have played 512 games against each other during the regular season, with the Celtics winning 276 times.", "The two teams have also faced each other 61 times during the playoffs, with the Celtics winning 34 times." ], [ "2008 NBA Finals", "2008 NBA Finals\n\nThe 2008 NBA Finals were held June 5 through June 17, 2008, to decide the winner of the 2007\u201308 NBA season, and conclude the season's playoffs.", "The Boston Celtics, top-seeded champions of the Eastern Conference, defeated the Los Angeles Lakers, top-seeded champions of the Western Conference, four games to two in a best-of-seven series.", "This was Boston's first title since 1986 during the Larry Bird era and 17th overall.", "2008 marked the first time since that the top seeds from both conferences met in the Finals and the first time since 2003 that any top seeded team played in the NBA finals.", "The Lakers appeared in the Finals for the first time since and a record 29th time overall.", "The Celtics appeared in the Finals for the first time since and second-best 20th time overall.", "Going into the series, the Celtics had won the most championships of all-time with 16, and the Lakers were second with 14.", "The two clubs, the most successful teams in NBA history, looked to renew a longstanding rivalry 21 years after their last Finals meeting in 1987.", "They narrowly missed meeting each other in 2002, when the Lakers advanced to the Finals, but the Celtics, who led 2\u20131 in the Conference Finals, eventually fell to the favored New Jersey Nets 4\u20132." ] ], "gold": "As of 2017, the last time the Celtics won the NBA Championship was in 2008. In the 2008 NBA Finals, the championship series of the 2007\u201308 NBA season, the Boston Celtics defeated the Los Angeles Lakers four games to two in a best-of-seven series.", "prediction 1": "The Boston Celtics have won the most NBA Championships, with 17 total, over the course of their 17-year history. The last time the Celtics won a championship was in 1987, when they met the Los Angeles Lakers for the first time since 1987. The last time the Celtics met the Lakers in the NBA Finals was in 2008.", "prediction 2": "The Boston Celtics have won a number of NBA championships. The last time the Celtics won a championship was in 1987, when they faced each other six times in the 1960s, three times in the 1980s, in 2008, and in 2010. The last time the Celtics won a championship was in 2007-08, when they faced each other six times and won the series.", "prediction 3": "The Celtics have won the NBA championship 17 times, the most of any team in NBA history. The last time the Celtics won a championship was in 1987. The last time the Celtics won a championship was in 1988.", "prediction 4": "The Celtics have won the NBA Championship at least 16 times, the most of all-time. The last time the Celtics won the NBA Championship was in 1987. The Celtics last won the NBA Championship in 1987 in 1988. The last time the Celtics won the NBA Championship was in 2007-08.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 71, "end": 112 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 70 }, { "error type": "Unverifiable", "explanation": "", "start": 113, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 310 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the 2008 NBA Finals, the championship series of the 2007\u201308 NBA season, the Boston Celtics defeated the Los Angeles Lakers four games to two in a best-of-seven series." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who won the last 5 mlb all star games?", "passages": [ [ "Major League Baseball All-Star Game", "Since 2017, home-field advantage has been awarded to the World Series team having the better regular season record.", "Previously, home-field advantage in the World Series alternated between the two leagues each year.", "The American League took advantage of the new rule in each of its first seven years: between 2003 and 2009, the American League won four Series and the National League won three.", "The National League champion benefited from this rule for the first time in 2010.", "Even with this rule in effect, there was no guarantee that a repeat of the 2002 situation would not occur; to avoid future ties due to lack of available players, managers have been instructed to (and have voluntarily) hold back a few select position players and pitchers.", "This has resulted in some fan dissatisfaction and controversy when these players are never actually used in the game, for example Tim Wakefield in the 2009 All-Star Game.", "Such a move has resulted in calls to allow limited re-entry of players who have been replaced during the game (in addition to catchers, which is already allowed), thereby giving the freedom to use all the players on the roster without leaving teams with the situation where no players are available, as was the case in 2002." ], [ "1998 Major League Baseball All-Star Game", "1998 Major League Baseball All-Star Game\n\nThe 1998 Major League Baseball All-Star Game was the 69th playing of the midsummer classic between the all-stars of the American League (AL) and National League (NL), the two leagues comprising Major League Baseball.", "The game was held on July 7, 1998, at Coors Field in Denver, Colorado, the home of the Colorado Rockies of the National League.", "The first All-Star contest played in the Mountain Time Zone, the game resulted in the American League defeating the National League 13-8.", "It remains the highest-scoring All-Star Game in MLB history.", "The pregame ceremony honored the United States Air Force Academy who provided the five-man color guard, flag presentations, and, at the end of country music singer Faith Hill's performance of the U.S. National Anthem, the flyover ceremonies.", "Hill's National Anthem performance was preceded by actress Gloria Reuben's performance of The Canadian National Anthem.", "Twelve-year-old Elias Kurts was given the honor of throwing out the ceremonial first pitch, the first \"non-celebrity\" so honored.", "Players in \"italics\" have since been inducted into the National Baseball Hall of Fame." ], [ "2019 Major League Baseball All-Star Game", "2019 Major League Baseball All-Star Game\n\nThe 2019 Major League Baseball All-Star Game will be the 90th Major League Baseball All-Star Game.", "The game will be hosted by the Cleveland Indians and will be played at Progressive Field on July 9, 2019.", "The decision to name Cleveland the host city was announced on January 27, 2017 by Major League Baseball Commissioner Rob Manfred.", "It will be the sixth All-Star Game in Cleveland, and the first since 1997; this will establish the Indians as the team to have hosted the most All-Star Games, breaking a four-way tie with the Pittsburgh Pirates, St. Louis Cardinals, and Cincinnati Reds, who have each hosted the game five times.", "It is also the first time since 2014 that an American League team has hosted the event.", "This All-Star Game will also coincide with the 25th anniversary of Progressive Field and make it the second All-Star Game hosted by that ballpark..", "Alex Cora of the defending World Series champion Boston Red Sox will manage the American League, and Dave Roberts of the Los Angeles Dodgers will manage the National League for the second consecutive year.", "Bidding for the 2019 All-Star Game began roughly five years before in 2014, according to Indians owner Paul Dolan.", "The selection of Cleveland to host the 2019 All-Star Game was heavily influenced by two major factors." ] ], "gold": "The American League defeated the National League by 5\u20132, 4\u20133, and 8\u20136 in the 2021, 2019, and 2018 Major League Baseball All-Star Games, respectively, while the American League was also the league whose team won the 2017, 2016, and 2015 MLB All-Star Games. The 2020 Major League Baseball All-Star Game was canceled due to the delayed start of the 2020 season due to the COVID-19 pandemic.", "prediction 1": "In the last five Major League Baseball All-Star games, the winner was the team having the better regular season record. The winning team was the American League in 2007. The winning team in the last 5 All-Star games was the National League. The winning team in the last 5 All-Star games was the Arizona Diamondbacks.", "prediction 2": "In the last five Major League Baseball All-Star games, the winning team was the National League and the winning team was the American League. The winning team in the last five All-Star games was the National League. The winning team in the last 5 All-Star games was the National League. In the last 5 All-Star games, the winning team was the American League.", "prediction 3": "The MLB All Star Game is an annual midsummer classic between the all-stars of the American League and the National League, the two leagues comprising Major League Baseball. The last 5 All-Star games have been won by the American League, the National League, the American League, and the Canadian National League. The 5th All-Star game was held on July 7, 2002, with the American League winning it. The 5th All-Star game was held in 2018, with the American League winning it.", "prediction 4": "The winner of the 5th annual MLB All-Star Game has been the team that has won the most All-Star Games. Since 1997, the Cleveland Indians have won the 5th annual MLB All-Star Game and in 2018, the Houston Astros have won the 5th annual MLB All-Star Game. The winners of the 5th annual MLB All Star Game have been the Minnesota Twins, the Colorado Rockies and the Tampa Bay Rays.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 119 }, { "error type": "Redundant", "explanation": "In the last five Major League Baseball All-Star games, the winner was the team having the better regular season record. ", "start": 120, "end": 169 }, { "error type": "Redundant", "explanation": "In the last five Major League Baseball All-Star games, the winner was the team having the better regular season record. ", "start": 170, "end": 240 }, { "error type": "Redundant", "explanation": "In the last five Major League Baseball All-Star games, the winner was the team having the better regular season record.", "start": 241, "end": 316 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Where does the full stop go with speech marks?", "passages": [ [ "Full stop", "In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense: This means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside.", "For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments.", "There is some national crossover.", "American style is common in British fiction writing.", "British style is sometimes used in American English.", "For example, the Chicago Manual of Style recommends it for fields where comma placement could affect the meaning of the quoted material, such as linguistics and textual criticism.", "Use of placement according to logical or grammatical sense, or \"logical convention\", now the more common practice in regions other than North America, was advocated in the influential book \"The King's English\" by Fowler and Fowler, published in 1906.", "Prior to the influence of this work, the typesetter's or printer's style, or \"closed convention\", now also called American style, was common throughout the world.", "There have been a number of practices relating to the spacing after a full stop." ] ], "gold": "The practice in the United States and Canada is to place full stops and commas inside quotation marks in most styles. In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense. This means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside. For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments.", "prediction 1": "Full stops go with speech marks inside the quoted material, or inside the quoted sentences.", "prediction 2": "In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense, which means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside. For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments. There is also some national crossover.", "prediction 3": "In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense. This means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside. For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments. There is some national crossover.", "prediction 4": "In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense, which means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside. For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments. There is some national crossover. Use of placement according to logical or grammatical sense, or \"logical convention\", now the more common practice in regions other than North America, was advocated in the influential book \"The King's English\" by Fowler and Fowler, published in 1906.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "In the British system, which is also called \"logical quotation\", full stops and commas are placed according to grammatical sense: This means that when they are part of the quoted material, they should be placed inside, and otherwise should be outside. For example, they are placed outside in the cases of words-as-words, titles of short-form works, and quoted sentence fragments. " }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "What is the diameter of earth in km?", "passages": [ [ "Earth radius", "Earth radius\n\nEarth radius is the distance from a selected center of Earth to a point on its surface, which is often chosen to be sea level, or more commonly, the surface of an idealized ellipsoid representing the shape of Earth.", "Because Earth is not a perfect sphere, the determination of Earth's radius can have several values, depending on how it is measured; from its equatorial radius of about to its polar radius of about .", "When only one radius is stated, the International Astronomical Union (IAU) prefers that it be Earth's equatorial radius.", "The International Union of Geodesy and Geophysics (IUGG) gives three global average radii, the arithmetic mean of the radii of the ellipsoid (R), the radius of a sphere with the same surface area as the ellipsoid or authalic radius (R), and the radius of a sphere with the same volume as the ellipsoid (R).", "All three IUGG average radii are about .", "A fourth global average radius not mentioned by the IUGG is the rectifying radius, the radius of a sphere with a circumference equal to the perimeter of the polar cross section of the ellipsoid, about ." ], [ "Equatorial bulge", "Equatorial bulge\n\nAn equatorial bulge is a difference between the equatorial and polar diameters of a planet, due to the centrifugal force exerted by the rotation about the body's axis.", "A rotating body tends to form an oblate spheroid rather than a sphere.", "The Earth has an equatorial bulge of ; that is, its diameter measured across the equatorial plane () is 42.77\u00a0km more than that measured between the poles ().", "An observer standing at sea level on either pole, therefore, is 21.36\u00a0km closer to Earth's central point than if standing at sea level on the Equator.", "The value of Earth's radius may be approximated by the average of these radii.", "As a result of Earth's equatorial bulge, the highest point on Earth, measured from the center and outwards, is the peak of Mount Chimborazo in Ecuador rather than Mount Everest.", "But since the ocean also bulges, like Earth and its atmosphere, Chimborazo is not as high above sea level as Everest is.", "The standard formula for this force is the relationship formula_1.", "However, velocity at the surface is equal to the product of radius and rotational velocity, and therefore the force is directly proportional to radius." ] ], "gold": "Earth radius is the distance from the center of Earth to a point on or near its surface. Earth's diameter is simply twice Earth's radius. The equatorial diameter of Earth is 12,756.3 km and the polar diameter of Earth is 12,714 km.", "prediction 1": "Earth's diameter is measured in km, but the diameter of Earth measured across the equatorial plane is 42.77 km more than that measured between the poles, or 63.76 in Antarctica. The diameter of Earth measured between the poles is 67.74 km, and the diameter across the poles is 62.80 km.", "prediction 2": "Earth's diameter in kilometers is 41.2 km. It is also known as the diameter of the Earth as measured across the equatorial plane. The Earth has an equatorial bulge of ; that is, its diameter measured across the equatorial plane is 42.77 km more than that measured between the poles. An observer standing at sea level on either pole, therefore, is 21.36 km closer to Earth's central point than if standing at sea level on the Equator. The diameter of Earth is 42.5 km.", "prediction 3": "Earth's diameter in kilometers is about 43.77 km, and its diameter measured across the equatorial plane is 42.77 km more than that measured between the poles. Because Earth is not a perfect sphere, the determination of Earth's radius can have several values, depending on how it is measured; from its equatorial radius of about to its polar radius of about.", "prediction 4": "Earth's diameter is measured in kilometers. The Earth has an equatorial bulge of, that is, its diameter measured across the equatorial plane is 42.77 km more than that measured between the poles (). An observer standing at sea level on either pole, therefore, is 21.36 km closer to Earth's central point than if standing at sea level on the Equator. The diameter of Earth measured across the equatorial plane is 42.77 km more than that measured between the poles.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 178, "end": 286 }, { "error type": "Incoherent", "explanation": "", "start": 0, "end": 39 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Earth radius Earth radius is the distance from a selected center of Earth to a point on its surface. The diameter of Earth measured across the equatorial plane is 42.77 km more than that measured between the poles, or 63.76 in Antarctica. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "What country has the lowest rate of homelessness?", "passages": [ [ "Homelessness", "Homelessness\n\nHomelessness is the circumstance when people are without a permanent dwelling, such as a house or apartment.", "People who are homeless are most often unable to acquire and maintain regular, safe, secure and adequate housing due to a lack of, or a steady income.", "The legal definition of \"homeless\" varies from country to country, or among different jurisdictions in the same country or region.", "The term \"homeless\" may also include people whose primary night-time residence is in a homeless shelter, a domestic violence shelter, long-term residence in a motel, a vehicle, squatting, cardboard boxes, a tent city, tarpaulins, shanty town structures made of discarded building materials or other \"ad hoc\" housing situations.", "According to the UK homelessness charity Crisis, a home is not just a physical space: it also provides roots, identity, security, a sense of belonging and a place of emotional wellbeing.", "United States government homeless enumeration studies also include people who sleep in a public or private place not designed for use as a regular sleeping accommodation for human beings.", "There are a number of organizations who provide help for the homeless.", "In 2005, an estimated 100 million (1 in 65 at the time) people worldwide were homeless and as many as 1 billion people live as squatters, refugees or in temporary shelter, all lacking adequate housing." ], [ "Programme for International Student Assessment (2000 to 2012)", "The results show distinct groups of high-performers in mathematics: the East Asian countries, with Shanghai, scoring the best result of 613, followed closely by Hong Kong, Japan, Chinese Taipei and South Korea.", "Among the Europeans, Liechtenstein and Switzerland performed best, with Netherlands, Estonia, Finland, Poland, Belgium, Germany, Austria all posting mathematics scores \"not significantly statistically different from\" one another.", "The United Kingdom, Ireland, Australia and New Zealand were similarly clustered around the OECD average of 494, with the USA trailing this group at 481.", "Qatar, Kazakhstan and Malaysia were the countries which showed the greatest improvement in mathematics.", "The USA and the United Kingdom showed no significant change.", "Sweden had the greatest fall in mathematics performance over the last ten years, with a similar falling trend also in the two other subjects, and leading politicians in Sweden expressed great worry over the results.", "On average boys scored better than girls in mathematics, girls scored better than boys in reading and the two sexes had quite similar scores in science.", "Indonesia, Albania, Peru, Thailand and Colombia were the countries where most students reported being happy at school, while students in Korea, the Czech Republic, the Slovak Republic, Estonia and Finland reported least happiness.", "The PISA 2009 cycle included results in mathematics, science and reading for all 36 OECD member countries and 37 partner countries." ], [ "Homelessness", "The United Nations, United Nations Centre for Human Settlements (UN-Habitat) wrote in its \"Global Report on Human Settlements\" in 1995: \"Homelessness is a problem in developed as well as in developing countries.", "In London, for example, life expectancy among homeless people is more than 25 years lower than the national average.\"", "Poor urban housing conditions are a global problem, but conditions are worst in developing countries.", "Habitat says that today 600 million people live in life- and health-threatening homes in Asia, Africa, and Latin America.", "For example, more than three in four young people had insufficient means of shelter and sanitation in some African countries like Malawi.", "\"The threat of mass homelessness is greatest in those regions because that is where population is growing fastest.", "By 2015, the 10 largest cities in the world will be in Asia, Latin America, and Africa.", "Nine of them will be in developing countries: Mumbai, India\u00a0\u2013 27.4 million; Lagos, Nigeria\u00a0\u2013 24.4; Shanghai, China\u00a0\u2013 23.4; Jakarta, Indonesia\u00a0\u2013 21.2; S\u00e3o Paulo, Brazil\u00a0\u2013 20.8; Karachi, Pakistan\u00a0\u2013 20.6; Beijing, China\u00a0\u2013 19.4; Dhaka, Bangladesh\u00a0\u2013 19; Mexico City, Mexico\u00a0\u2013 18.8.", "The only city in a developed country that will be in the top ten is Tokyo, Japan\u00a0\u2013 28.7 million.\"" ] ], "gold": "It is estimated that 150 million people are homeless worldwide. Habitat for Humanity estimated in 2015 that 1.6 billion people around the world live in \"inadequate shelter\". Liechtenstein is a German-speaking country that had a reported 0% homelessness rate in 2004. Jordan is an Arab country that reported a 0% homelessness rate in 2010 and 2017. Japan is the Asian country that had the lowest reported rate of homelessness over 0% in 2019.", "prediction 1": "The country with the lowest rate of homelessness is China, with an estimated 1% of its population living in slums. In 2016, China had the lowest rate of homelessness, and the United States had the lowest rate of homelessness. In 2015, China had the lowest rate of homelessness, and in 2016 China had the lowest rate of homelessness. In 2016, the United States had the lowest rate of homelessness.", "prediction 2": "In 2005, an estimated 100 million (1 in 65 at the time) people worldwide were homeless and as many as 1 billion people live as squatters, refugees or in temporary shelter, all lacking adequate housing. In 2010, the United States had the lowest rate of homelessness per 100,000 population, and by 2011, the United Kingdom had the lowest rate per 100,000 population. In 2009, the United States had the lowest rate per 100,000 people, and in 2013, the United Kingdom had the lowest rate per 100,000 people. In 2015, the United States had the lowest rate per capita, and in the US had the lowest rate of homelessness per capita in the United States. In 2015, the United States had the lowest rate of homelessness per capita in the United States had s.", "prediction 3": "In 2011, the United States had the lowest rate of homelessness, and in 2005, the United States had the lowest rate of homelessness. In 2012, the United Kingdom, China, Hong Kong, Japan, and South Korea all had the lowest rates of homelessness.", "prediction 4": "In 2015, the United States reported the lowest rate of homelessness in 2015. The United Kingdom reported the lowest rate of homelessness in 2012.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 114 }, { "error type": "Redundant", "explanation": "The country with the lowest rate of homelessness is China, ", "start": 115, "end": 225 }, { "error type": "Redundant", "explanation": "The country with the lowest rate of homelessness is China, ", "start": 226, "end": 332 }, { "error type": "Redundant", "explanation": "The country with the lowest rate of homelessness is China, ", "start": 333, "end": 396 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "An estimated 100 million (1 in 65 at the time) people worldwide were homeless and Habitat says that today 600 million people live in life- and health-threatening homes. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "First champion of the women's division of the ufc?", "passages": [ [ "UFC 157", "UFC 157\n\nUFC 157: Rousey vs. Carmouche was a mixed martial arts event held by the Ultimate Fighting Championship on February 23, 2013, at the Honda Center in Anaheim, California.", "The headline bout between Ronda Rousey and Liz Carmouche was the first-ever women's fight in UFC history.", "The two fought in the newly created 135-pound bantamweight division for the UFC Women's Bantamweight Championship.", "Rousey was the defending champion, as she was awarded the championship at a pre-event press conference on December 6, 2012, prior to which she was the Strikeforce Women's Bantamweight Champion.", "Manny Gamburyan was expected to face Chad Mendes at the event; however, Gamburyan was forced out of the bout with a thumb and elbow injury.", "Mendes was then pulled from the card as a suitable replacement could not be found on short notice.", "As a result, the bout between Court McGee and Josh Neer was promoted to the main card.", "At the weigh-ins, Nah-Shon Burrell came into his bout with Yuri Villefort heavy, weighing in at 175.8\u00a0lb.", "Villefort had already agreed in advance to a catchweight bout and received a portion of Burrell's purse." ], [ "Women's mixed martial arts", "On December 11, 2013 the UFC picked up the contracts of 11 female fighters to fill up their 115-pound division.", "The Strawweights took part in the 20th season of The Ultimate Fighter, the season winner will be the first UFC women\u2019s strawweight champion.", "Some of the fighters include Felice Herrig, Claudia Gadelha, Tecia Torres, Bec Hyatt, Joanne Calderwood, and even Invicta FC's Strawweight Champion Carla Esparza and many more.", "Carla Esparza became the first UFC strawweight champion after defeating Rose Namajunas at finale.", "Esparza lost her title to Joanna J\u0119drzejczyk at UFC 185.", "Since its inception the role of women in mixed martial arts has been a subject of debate.", "Some observers have treated women's competition as a spectacle and a taboo topic." ], [ "Bantamweight", "Bantamweight\n\nBantamweight is a weight class in combat sports.", "The name bantam is derived from bantam chickens.", "Bantamweight is usually a class in boxing for boxers who weigh above 115 pounds (52.2\u00a0kg) and up to 118 pounds (53.5\u00a0kg).", "Orlando Canizales holds the record for most consecutive title defenses in boxing at this division, with 16 defenses of the IBF title.", "The first title fight with gloves was between Chappie Moran and Ray Lewis in 1889.", "At that time, the limit for this weight class was 110 pounds.", "In 1910, however, the British settled on a limit of 118.", "Current interim champions\n\n\"Updated 02 December 2018\"\nBelow is a list of longest reigning bantamweight champions in boxing measured by the individual's longest reign.", "Career total time as champion ( for multiple time champions) does not apply.", "In kickboxing, a bantamweight fighter generally weighs between 53\u00a0kg (116\u00a0lb) and 55\u00a0kg (120\u00a0lb).", "However, some governing bodies have slightly different classes.", "For example, the International Kickboxing Federation (IKF) Bantamweight division (professional and amateur) is 117.1\u00a0lbs.\u2013122\u00a0lbs.", "or 53.22\u00a0kg\u201355.45\u00a0kg.", "In MMA, bantamweight is 126\u2013135 pounds (57.2\u201361.2\u00a0kg)." ] ], "gold": "There are several weight classes in combat sports. The women's division of the UFC's first featherweight champion was Germaine de Randamie, first bantamweight champion was Ronda Rousey, first flyweight champion was Nicco Monta\u00f1o, and first strawweight champion was Carla Esparza.", "prediction 1": "The first champion of the women's division of the UFC is Ronda Rousey. The title was first awarded to Rousey on December 6, 2012. Rousey defeated Liz Carmouche in the second round at UFC 157, which was held at the Honda Center in Anaheim, California. Carla Esparza became the first UFC strawweight champion after defeating Rose Namajunas at finale.", "prediction 2": "The first woman to be the first women's champion of the Women's Bantamweight division of the UFC was Ronda Rousey, who held the title until Liz Carmouche took the title at UFC 157, a mixed martial arts event held by the Ultimate Fighting Championship on February 23, 2013. Rousey was the defending champion, as she was awarded the championship at a pre-event press conference on December 6, 2012, prior to which she was the Strikeforce Women's Bantamweight Champion.", "prediction 3": "The first women's champion of the women's division of the UFC has been Ronda Rousey, who defeated Liz Carmouche on the main card of UFC 157. Rousey was the defending champion, as she was awarded the championship at a pre-event press conference on December 6, 2012, prior to which she was the Strikeforce Women's Bantamweight Champion. Carmouche also became the first women's champion of the women's division of the UFC, and is now the Women's bantamweight division.", "prediction 4": "There has been a number of women's mixed martial arts champions over the years. Ronda Rousey and Liz Carmouche were the first-ever champions of the women's division of the Ultimate Fighting Championship. The women fought in the newly created 135-pound bantamweight division for the UFC Women's Bantamweight Championship. Carla Esparza became the first UFC strawweight champion after defeating Rose Namajunas at finale.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 250 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 348 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 10, "end": 18 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The first defending champion of the women's division of the UFC is Ronda Rousey, who fought in the bantamweight division. Carla Esparza became the first UFC strawweight champion." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the jeep grand cherokee come out?", "passages": [ [ "Jeep Grand Cherokee", "Meanwhile, new communication systems allowed potential conflicts to be resolved faster, thus reducing costly engineering changes, because all drawings and documents were in a central database.", "The system was so effective that after Chrysler purchased AMC in 1987, it expanded the system throughout its enterprise, thus connecting everyone involved in designing and building products.", "The Grand Cherokee thus became the first Chrysler-badged Jeep product.", "Development work for the new Jeep model continued and Chrysler's employees (after the 1987 buyout of AMC) were eager for a late-1980s release date; however, CEO Lee Iacocca was pushing for redesigned Chrysler minivans, thus delaying the Grand Cherokee's release until late-1992 as an Explorer competitor.", "Unlike the Explorer, the Grand Cherokee utilized monocoque (unibody) construction, whereas the Explorer was a derivative of the Ranger pickup with a separate body-on-frame.", "The Grand Cherokee debuted in grand fashion at the 1992 North American International Auto Show in Detroit, Michigan.", "The vehicle that was driven was a Poppy Red Clear Coat 1993", "Grand Cherokee ZJ Laredo with a quartz cloth interior and high-back bucket seats.", "Then Chrysler president Robert Lutz drove Detroit mayor, Coleman Young, from the Jefferson North Assembly Plant on North Jefferson Avenue via a police escort to Cobo Hall, up the steps of Cobo Hall and through a plate glass window to show off the new vehicle." ], [ "Jeep Grand Cherokee", "This became the \"volume\" engine for the Grand Cherokee.", "Transmission choices included a four-speed automatic transmission (early production ZJs used the AW4 \u2013 the A500SE (later 42RE) replaced the AW4 during the latter half of the 1993 model year) or an Aisin AX15 manual transmission.", "Low demand for the manual transmission resulted in its discontinuation after 1994, but European-market ZJs retained it when coupled to the diesel engine (which was unavailable in North America).", "The drive train choices included rear-wheel drive or four-wheel-drive.", "In 1995, the engine dropped 5 horsepower to 185 due to new EPA regulations imposed on the 1996 model year.", "In 1997, for the 1998 model year, a variant of the top-level Grand Cherokee Limited, the \"5.9 Limited\" was introduced.", "Jeep ads claimed it to be the \"world's fastest sport utility vehicle\", verified by third-party testing.", "The primary improvements in the 5.9 Limited version included a 245-horsepower 5.9L OHV V8 engine, heavy-duty 46RE automatic transmission, functional heat-extracting hood louvers, unique wide-slot body-colored grille with mesh inserts, special rocker moldings, low-restriction exhaust with three-inch chrome tip, a low-profile roof rack, and special 16\" Ultra-Star wheels." ], [ "Jeep Grand Cherokee", "Jeep Grand Cherokee\n\nThe Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep.", "While some other SUVs were manufactured with body-on-frame construction, the Jeep Grand Cherokee has always used a unibody chassis.", "The Grand Cherokee's origins date back to 1983 when American Motors Corporation (AMC) was designing a successor to the smaller Jeep Cherokee (XJ).", "Three outside (non-AMC) designers\u2014Larry Shinoda, Alain Clenet, and Giorgetto Giugiaro\u2014were also under contract with AMC to create and build a clay model of the Cherokee XJ replacement, then known as the \"XJC\" project.", "However, the basic design for the Cherokee's replacement was well under way by AMC's in-house designers and the 1989 Jeep Concept 1 show car foretold the basic design.", "As AMC began development of the next Jeep in 1985, management created a business process that is now known as product lifecycle management (PLM).", "According to Fran\u00e7ois Castaing, Vice President for Product Engineering and Development, the smallest U.S. automaker was looking for a way to speed up its product development process to compete better against its larger competitors.", "The XJC's development was aided by computer-aided design (CAD) software systems making the engineers more productive." ] ], "gold": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. The Grand Cherokee's origins date back to 1983 when American Motors Corporation (AMC) was designing a successor to the smaller Jeep Cherokee (XJ). The Grand Cherokee debuted in grand fashion at the 1992 North American International Auto Show in Detroit, Michigan. Sales of the 1993 model year Grand Cherokee began in April 1992.", "prediction 1": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. Its origins date back to 1983 when American Motors Corporation (AMC) was designing a successor to the smaller Jeep Cherokee (XJ). American Motors Corporation's employees were eager for a late-1980s release date, however, CEO Lee Iacocca was pushing for redesigned Chrysler minivans, thus delaying the Grand Cherokee's release until late-1992 as an Explorer competitor. However, in 1993, a variant of the top-level Grand Cherokee Limited was introduced, the 5.9 Limited.", "prediction 2": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. The vehicle's origins date back to 1983, when American Motors Corporation (AMC) was designing a successor to the smaller Jeep Cherokee (XJ). Development work for the new Jeep model continued and Chrysler's employees (after the 1987 buyout of AMC) were eager for a late-1980s release date, but CEO Lee Iacocca was pushing for redesigned Chrysler minivans, thus delaying the Grand Cherokee's release until late-1992 as an Explorer competitor. In 1997, a variant of the top-level Jeep Limited was introduced, the \"5.7 Limited\".", "prediction 3": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. It debuted in grand fashion at the 1992 North American International Auto Show in Detroit, Michigan. Then, in 1997, for the 1998 model year, a variant of the top-level Grand Cherokee Limited, the \"5.9 Limited\", was introduced.", "prediction 4": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. The original Jeep Grand Cherokee was designed in 1983 and introduced to the market in 1988. Its introduction was delayed due to CEO Lee Iacocca's push for redesigned Chrysler minivans, thus delaying the product's release until late-1992 as an Explorer competitor. In 1992, a variant of the top-level Jeep Grand Cherokee Limited, the 5.9 Limited, was introduced.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 464 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 465, "end": 565 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Jeep Grand Cherokee is a range of mid-size SUVs produced by the American manufacturer Jeep. Its origins date back to 1983 when American Motors Corporation (AMC) was designing a successor to the smaller Jeep Cherokee (XJ). The Grand Cherokee debuted in grand fashion at the 1992 North American International Auto Show in Detroit, Michigan. The vehicle that was driven was a Poppy Red Clear Coat 1993. " }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "Where are most of the us oil refineries located?", "passages": [ [ "Petroleum refining in the United States", "A market developed for fuel oil as it was discovered that petroleum was superior to coal in powering the large engines of ships and railroad locomotives.", "The popularity of the automobile in the early 1900s created a mass market for gasoline, and a shortage soon developed of the lighter gasoline fractions of crude oil.", "The shortage was solved by the invention of the catalytic cracker, which broke long hydrocarbon chains into smaller molecules.", "Most large refineries are near navigable waterways, especially seaports or Great Lakes ports.", "The single largest concentration of refineries is along the Gulf Coast.", "Although there are refineries in 30 states, just three states dominate US refining: Texas (47 operating refineries), Louisiana (19), and California (18).", "As of January 2015, these three states contain 45% of all US refineries and 59% of all US refining capacity.", "The three largest-volume products of US refineries are gasoline, fuel oil (including diesel fuel and home heating oil), and aviation fuel, which together make up more than 84 percent of output.", "Petroleum refineries recover elemental sulfur as a byproduct.", "In 2012, US oil refineries recovered 7.4 million metric tons of sulfur, worth about $915 million, and amounting to 88% of the elemental sulfur produced in the US." ] ], "gold": "Most of the US oil refineries are located in various states, in respect to geographical features and along different coast. Based on geographical features, most large refineries are near navigable waterways, especially seaports or Great Lakes ports. The single largest concentration of refineries is along the Gulf Coast. There are several refineries in different states of US but three states dominate US refining, they are Texas, Louisiana, and California.", "prediction 1": "Most large refineries are near navigable waterways, especially seaports or Great Lakes ports. The single largest concentration of refineries is along the Gulf Coast. Although there are refineries in 30 states, just three states dominate US refining: Texas (47 operating refineries), Louisiana (19), and California (18). As of January 2015, these three states contain 45% of all US refineries and 59% of all US refining capacity.", "prediction 2": "The US has more than 100 oil refineries, and about 45% of them are located in Texas. The US has the most oil refineries, located in Texas, Louisiana, and California.", "prediction 3": "Most large refineries are near navigable waterways, especially seaports or Great Lakes ports. The single largest concentration of refineries is along the Gulf Coast. Although there are refineries in 30 states, just three states dominate US refining: Texas, Louisiana, and California. As of January 2015, these three states contain 45% of all US refineries and 59% of all US refining capacity.", "prediction 4": "Most large refineries in the US are near navigable waterways, especially seaports or Great Lakes ports. The single largest concentration of refineries is along the Gulf Coast. Although there are refineries in 30 states, just three states dominate US refining: Texas (47 operating refineries), Louisiana (19), and California (18). As of January 2015, these three states contain 45% of all US refineries and 59% of all US refining capacity.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 293, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 319 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 428 } ], "missing-info": [], "corrected-prediction": "Most large refineries are near navigable waterways, especially seaports or Great Lakes ports. The single largest concentration of refineries is along the Gulf Coast. Although there are refineries in 30 states, just three states dominate US refining: Texas, Louisiana , and California. " }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "When was the permanet settlement introduced in india?", "passages": [ [ "Permanent Settlement", "Permanent Settlement\n\nThe Permanent Settlement, also known as the Permanent Settlement of Bengal, was an agreement between the East India Company and Bengali landlords to fix revenues to be raised from land, with far-reaching consequences for both agricultural methods and productivity in the entire British Empire and the political realities of the Indian countryside.", "It was concluded in 1793 by the Company administration headed by Charles, Earl Cornwallis, also known as Lord Cornwallis.", "It formed one part of a larger body of legislation enacted, known as the Cornwallis Code.", "The Cornwallis Code of 1793 divided the East India Company's service personnel into three branches: revenue, judicial, and commercial.", "Revenues were collected by \"zamindars\", native Indians who were treated as the landowners.", "This division created an Indian landed class that supported British authority.", "The Permanent Settlement was introduced first in Bengal and Bihar, and then in the south district of Madras and Varanasi.", "The system eventually spread all over northern India by a series of regulations dated 1 May 1793.", "These regulations remained in place until the Charter Act of 1833.", "The other two systems prevalent in India were The Ryotwari System and The Mahalwari System." ] ], "gold": "The Permanent Settlement was first introduced in India, in Bengal and Bihar in 1793, and later on, the system eventually spread all over northern India by a series of regulations dated 1 May 1793.", "prediction 1": "The permanent settlement was introduced in Bengal and Bihar, and then in the south district of Madras and Varanasi. The system eventually spread all over northern India by a series of regulations dated 1 May 1793. These regulations remained in place until the Charter Act of 1833.", "prediction 2": "The Permanent Settlement, also known as the Permanent Settlement of Bengal, was an agreement between the East India Company and Bengali landlords to fix revenues to be raised from land, with far-reaching consequences for both agricultural methods and productivity in the entire British Empire and the political realities of the Indian countryside. It was concluded in 1793 by the Company administration headed by Charles, Earl Cornwallis, also known as Lord Cornwallis. It formed one part of a larger body of legislation enacted, known as the Cornwallis Code.", "prediction 3": "The Permanent Settlement was an agreement between the East India Company and Bengali landlords to fix revenues to be raised from land, with far-reaching consequences for both agricultural methods and productivity in the entire British Empire and the political realities of the Indian countryside. It was concluded in 1793 by the Company administration headed by Charles, Earl Cornwallis, also known as Lord Cornwallis. The system eventually spread all over northern India by a series of regulations dated 1 May 1793. These regulations remained in place until the Charter Act of 1833.", "prediction 4": "The Permanent Settlement of Bengal was an agreement between the East India Company and Bengali landlords to fix revenues to be raised from land, with far-reaching consequences for both agricultural methods and productivity in the entire British Empire and the political realities of the Indian countryside. It was concluded in 1793 by the Company administration headed by Charles, Earl Cornwallis, also known as Lord Cornwallis. It formed one part of a larger body of legislation enacted, known as the Cornwallis Code. The system eventually spread all over northern India by a series of regulations dated 1 May 1793. These regulations remained in place until the Charter Act of 1833.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 280 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 115 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The permanent settlement was introduced in Bengal and Bihar in 1793. The system eventually spread all over northern India by a series of regulations dated 1 May 1793. These regulations remained in place until the Charter Act of 1833." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When did mcdonald's start selling happy meals?", "passages": [ [ "Happy Meal", "She created what she called the \"Menu Ronald\" (Ronald menu), which offered a hamburger, small fries and a small sundae to help mothers feed their children more effectively while at McDonald's restaurants.", "The concept was eventually brought to the attention of McDonald's management in Chicago.", "The company gave the development of the product to Bob Bernstein, who then came up with the Happy Meal.", "In 1977, the McDonald's restaurant owner clients who regularly met with Bernstein were looking for ways to create a better experience for families with kids.", "Bernstein reasoned that if kids could get a packaged meal all their own instead of just picking at their parent's food, everybody would be happier.", "He had often noticed his young son at the breakfast table poring over the various items on cereal boxes and thought, \"Why not do that for McDonald's?", "The package is the key!\"", "He then called in his creative team and had them mock up some paperboard boxes fashioned to resemble lunch pails with the McDonald's Golden Arches for handles.", "They called in nationally known children's illustrators and offered them the blank slate of filling the box's sides and tops with their own colorful ideas from art to jokes to games to comic strips to stories to fantasy: whatever they thought might appeal to kids, at least 8 items per box." ], [ "Happy Meal", "Inside the box would be a burger, small fries, packet of cookies and a surprise gift.", "A small drink would accompany these items.", "Bernstein named it The Happy Meal and it was successfully introduced with television and radio spots and in-store posters in the Kansas City market in October 1977.", "Other markets followed and the national roll-out happened in 1979.", "Bernstein received #1136758 (Serial #73148046) for his idea in 1977 which he assigned to his valued client, McDonald's Corporation, on June 10, 1980.", "In 1987 at the annual McDonald's marketing meeting, he was recognized for his accomplishment with a full-size bronze replica of the Happy Meal box with the following inscription:\n\n\nMcDonald's Happy Meal 10th Anniversary 1977-1987\nTo Robert A. Bernstein, Bernstein-Rein Advertising\nThank you for bringing the Happy Meal, a bold idea, to the McDonald's System.", "Your insight and conviction truly has made McDonald's a fun place for children for the past 10 years!", "McDonald's Corporation\nSeptember, 1987\n\n\nOften, the Happy Meal is themed to promote a current family-oriented movie.", "The first such promotion was the Star Trek Meal, to promote \"\" in December 1979.", "The packaging used for the Star Trek Meal consisted of various images and games related to the film, as well as a comic-strip adaptation of the film." ], [ "Happy Meal", "Happy Meal\n\nA Happy Meal is a form of kids' meal sold at the fast food restaurant chain McDonald's since June 1979.", "A small toy is included with the food, both of which are usually contained in a red box with a yellow smiley face and the McDonald's logo.", "The packaging and toy are frequently part of a marketing tie-in to an existing television show, film, or toy brand.", "The Happy Meal contains a main item (typically a hamburger, cheeseburger, or small serving of Chicken McNuggets), a side item (french fries, apple slices, a Go-Gurt tube, or a salad in some areas), and a drink (milk, juice, or a soft drink).", "The choice of items changes from country to country, and may depend on the size of the restaurant.", "In some countries, the choices have been expanded to include items such as a grilled cheese sandwich (known as a \"Fry Kid\"), or more healthy options such as apple slices, a mini snack wrap, salads, or pasta, as one or more of the options.", "In the mid-1970s, Yolanda Fern\u00e1ndez de Cofi\u00f1o began working with her husband operating McDonald's restaurants in Guatemala." ] ], "gold": "McDonald's started selling happy meals on different dates based on the location. Happy Meal was first introduced with television and radio spots and in-store posters in the Kansas City market in October 1977 and later on, it started selling nationally in June 1979.", "prediction 1": "McDonald's started selling Happy Meals in 1977. The Happy Meal is a form of kids' meal sold at the fast food restaurant chain McDonald's since June 1979. A small toy is included with the food, both of which are usually contained in a red box with a yellow smiley face and the McDonald's logo.", "prediction 2": "A Happy Meal is a form of kids' meal sold at the fast food restaurant chain McDonald's since June 1979. A small toy is included with the food, and often, the Happy Meal is themed to promote a current family-oriented movie. The packaging and toy are frequently part of a marketing tie-in to an existing television show, film, or toy brand. In the mid-1970s, Yolanda Fern\u00e1ndez de Cofio began working with her husband operating McDonald's restaurants in Guatemala. The concept was eventually brought to the attention of McDonald's management in Chicago. In 1977, the company gave the development of the product to Bob Bernstein, who then came up with the Happy Meal.", "prediction 3": "A Happy Meal is a form of kids' meal sold at the fast food restaurant chain McDonald's since June 1979. It is a kids' meal sold at the fast food restaurant chain McDonald's that contains a main item, a side item (typically a hamburger, cheeseburger, or small serving of Chicken McNuggets), a small toy is included with the food, and a drink is included. Originally, McDonald's started selling happy meals in Guatemala in the mid-1970s. In 1977, the company gave the development of the product to Bob Bernstein, who then came up with the Happy Meal.", "prediction 4": "The Happy Meal is a form of kids' meal sold at the fast food restaurant chain McDonald's since June 1979. It was created by Yolanda Fern\u00e1ndez de Cofio in the mid-1970s and was inspired by the idea of mothers feeding their children at McDonald's. She created what she called the \"Menu Ronald\" (Ronald menu), which offered a hamburger, small fries and a small sundae to help mothers feed their children more effectively while at McDonald's.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 48, "end": 153 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 292 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Happy Meal and it was successfully introduced with television and radio spots and in-store posters in the Kansas City market in October 1977. Other markets followed and the national roll-out happened in 1979." }, "preference": [ 2, 2, 2, 0, 2, 2 ] }, { "question": "Who changed the date of the day of the dead?", "passages": [ [ "Day of the Dead", "Day of the Dead\n\nThe Day of the Dead () is a Mexican holiday celebrated throughout Mexico, in particular the Central and South regions, and by people of Mexican heritage elsewhere.", "The multi-day holiday focuses on gatherings of family and friends to pray for and remember friends and family members who have died, and help support their spiritual journey.", "In 2008, the tradition was inscribed in the Representative List of the Intangible Cultural Heritage of Humanity by UNESCO.", "The holiday is sometimes called D\u00eda de los Muertos in Anglophone countries, a back-translation of its original name, \"D\u00eda de Muertos\".", "It is particularly celebrated in Mexico where the day is a public holiday.", "Prior to Spanish colonization in the 16th century, the celebration took place at the beginning of summer.", "Gradually, it was associated with October 31, November 1, and November 2 to coincide with the Western Christianity triduum of Allhallowtide: All Saints' Eve, All Saints' Day, and All Souls' Day.", "Traditions connected with the holiday include building private altars called \"ofrendas\", honoring the deceased using calaveras, aztec marigolds, and the favorite foods and beverages of the departed, and visiting graves with these as gifts.", "Visitors also leave possessions of the deceased at the graves." ] ], "gold": "The Day of the Dead is a Mexican holiday that involves family and friends gathering to pray for and to remember friends and family members who have died. Prior to Spanish colonization of Mexico in the 16th century, the celebration took place at the beginning of summer, but it gradually became associated with the dates of October 31, November 1, and November 2.", "prediction 1": "The Day of the Dead is a Mexican holiday celebrated throughout Mexico, in particular the Central and South regions, and by people of Mexican heritage elsewhere. The multi-day holiday focuses on gatherings of family and friends to pray for and remember friends and family members who have died, and help support their spiritual journey. Prior to Spanish colonization in the 16th century, the celebration took place at the beginning of summer.", "prediction 2": "The Day of the Dead is a Mexican holiday celebrated throughout Mexico, in particular the Central and South regions, and by people of Mexican heritage elsewhere. The multi-day holiday focuses on gatherings of family and friends to pray for and remember friends and family members who have died, and help support their spiritual journey. There are several variations of the day, but for the most part, the date of the day of the dead was changed several times. Before Spanish colonization in the 16th century, the celebration took place at the beginning of summer. Gradually, it was associated with October 31, November 1, and November 2.", "prediction 3": "Prior to Spanish colonization in the 16th century, the celebration took place at the beginning of summer. Gradually, it was associated with October 31, November 1, and November 2 to coincide with the Western Christianity triduum of Allhallowtide: All Saints' Eve, All Saints' Day, and All Souls' Day. In 1581, the date was changed to November 2, 931. The date of the current Day of the Dead is November 2.", "prediction 4": "The Day of the Dead is a Mexican holiday celebrated throughout Mexico, in particular the Central and South regions, and by people of Mexican heritage elsewhere. The multi-day holiday focuses on gatherings of family and friends to pray for and remember friends and family members who have died, and help support their spiritual journey. The date of the holiday was changed from August 20, 1698, to November 2, 1698, and from 1798 to 1898.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 160 }, { "error type": "Irrelevant", "explanation": "", "start": 161, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 335 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Day of the Dead is a Mexican holiday that focuses on gatherings of family and friends to pray for and remember friends and family members who have died. Prior to Spanish colonization in the 16th century, the celebration took place at the beginning of summer, but it gradually became associated with the dates of October 31, November 1, and November 2." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where is the mountain region located in north carolina?", "passages": [ [ "Western North Carolina", "The Asheville area regional government body, the Land-of-Sky Regional Council, utilizes the nickname.", "Located east of the Tennessee state line and west of the Piedmont, Western North Carolina contains very few major urban centers.", "Asheville, North Carolina, located in the region's center, is the area's largest city and most prominent commercial hub.", "The Foothills region of the state is loosely defined as the area along Western North Carolina's eastern boundary; this region consists of a transitional terrain of hills between the Appalachians and the Piedmont Plateau of central North Carolina.", "The Eastern Band of Cherokee Indians have a reservation situated in the Western North Carolina region, adjacent to the Great Smoky Mountains National Park.", "The northern counties in Western North Carolina are commonly known as the state's High Country.", "Centered on Boone, the High Country boasts the area's most popular ski resorts, including Ski Beech, Appalachian Ski Mountain, and Sugar Mountain.", "The area also features many attractions, historical sites, and geological formations such as Linville Caverns, Grandfather Mountain, Blowing Rock, Tweetsie Railroad, Shatley Springs, and Mystery Hill.", "Education, skiing, tourism, and Christmas tree farming are among this area's most prominent industries, although agriculture and raising livestock also remain important." ], [ "Western North Carolina", "Western North Carolina\n\nWestern North Carolina (often abbreviated as WNC) is the region of North Carolina which includes the Appalachian Mountains, thus it is often known geographically as the state's Mountain Region.", "It contains the highest mountains in the Eastern United States.", "Western North Carolina is sometimes included with upstate South Carolina as the \"Western Carolinas\", which is also counted as a single media market.", "The region covers an area of about , and is roughly the size of the state of Massachusetts.", "The population of the region, as measured by the 2010 U.S. Census, is 1,473,241, which is approximately 15% of North Carolina's total population.", "The term Land of the Sky (or Land-of-Sky) is a common nickname for this mountainous region and has been more recently adopted to refer to the Asheville area.", "(Areas in the northwest portion of the region, including Boone and Blowing Rock, commonly use the nickname \"The High Country\", rather than \"Land of the Sky\")", "The term is derived from the title of the book, \"Land of the Sky\", written by Mrs. Frances Tiernan, under the pseudonym Christian Reid.", "The book often mentions the Great Smoky Mountains and Blue Ridge Mountains, the two main ranges that are found in Western North Carolina." ] ], "gold": "The Mountain region in the state of North Carolina is located in Western North Carolina. Land of the Sky and The High Country is a common nickname for this mountainous region.", "prediction 1": "The Western North Carolina region is located in North Carolina and is often known geographically as the state's Mountain Region. The Appalachian Mountains are the highest ranges in the Eastern United States, and the Foothills region of the state is located along Western North Carolina's eastern boundary. The Asheville area is the region's center and is the region's largest city and most prominent commercial hub.", "prediction 2": "The mountain region of North Carolina is located in western North Carolina, often abbreviated as WNC. It includes the Appalachian Mountains, thus it is often known geographically as the state's Mountain Region. Western North Carolina, which is also known as the \"High Country,\" is a region in North Carolina which includes the Appalachian Mountains and is frequently known geographically as the state's Mountain Region.", "prediction 3": "Western North Carolina, often abbreviated as WNC, is the region of North Carolina which includes the Appalachian Mountains, thus it is often known geographically as the state's Mountain Region. It contains the highest mountains in the Eastern United States. The northern counties in Western North Carolina are commonly known as the state's High Country.", "prediction 4": "Western North Carolina, or WNC, is the region of North Carolina which includes the Appalachian Mountains, thus it is often known geographically as the state's Mountain Region. It contains the highest mountains in the Eastern United States. The northern counties in Western North Carolina are commonly known as the state's High Country. The region covers an area of roughly and is roughly the size of the state of Massachusetts. The term Land of the Sky is a common nickname for this mountainous region and has been more recently adopted to refer to the Asheville area.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 415 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Western North Carolina region is located in North Carolina and is often known geographically as the state's Mountain Region. Land of the Sky and The High Country is a common nickname for this mountainous region." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played eliza doolittle in my fair lady on broadway?", "passages": [ [ "My Fair Lady", "My Fair Lady\n\nMy Fair Lady is a musical based on George Bernard Shaw's \"Pygmalion\", with book and lyrics by Alan Jay Lerner and music by Frederick Loewe.", "The story concerns Eliza Doolittle, a Cockney flower girl who takes speech lessons from professor Henry Higgins, a phoneticist, so that she may pass as a lady.", "The original Broadway and London shows starred Rex Harrison and Julie Andrews.", "The musical's 1956 Broadway production was a notable critical and popular success.", "It set a record for the longest run of any show on Broadway up to that time.", "It was followed by a hit London production, a popular film version, and many revivals.", "\"My Fair Lady\" has been called \"the perfect musical\".", "It is Edwardian London, the Royal Opera House, Covent Garden.", "The protagonist, Eliza Doolittle, is a Cockney with a thick, unintelligible accent.", "Professor Henry Higgins invites Colonel Pickering to stay as his houseguest.", "Soon after, Eliza Doolittle comes to Professor Higgins's house, seeking elocution lessons.", "Professor Higgins wagers Colonel Pickering, that in six months he will turn Eliza into a lady by teaching her to speak properly.", "Eliza is indentured into the Higgins household as a resident elocution student." ], [ "My Fair Lady", "A London revival opened at the Adelphi Theatre in October 1979, with Tony Britton as Higgins, Liz Robertson as Eliza, Dame Anna Neagle as Higgins' mother, Peter Bayliss, Richard Caldicot and Peter Land.", "The revival was produced by Cameron Mackintosh and directed by the author, Alan Jay Lerner.", "A national tour was directed by Robin Midgley.", "Gillian Lynne choreographed.", "Britton and Robertson were both nominated for Olivier Awards.", "Another Broadway revival of the original production opened at the Uris Theatre on August 18, 1981, and closed on November 29, 1981, after 120 performances and 4 previews.", "Rex Harrison recreated his role as Higgins, with Jack Gwillim, Milo O'Shea, and Cathleen Nesbitt, at 93 years old reprising her role as Mrs. Higgins.", "The revival co-starred Nancy Ringham as Eliza.", "The director was Patrick Garland, with choreography by Crandall Diehl, recreating the original Hanya Holm dances.", "A new revival directed by Howard Davies opened at the Virginia Theatre on December 9, 1993, and closed on May 1, 1994, after 165 performances and 16 previews.", "The cast starred Richard Chamberlain, Melissa Errico and Paxton Whitehead.", "Julian Holloway, son of Stanley Holloway, recreated his father's role of Alfred P. Doolittle." ], [ "My Fair Lady", "The West End production, in which Harrison, Andrews, Coote, and Holloway reprised their roles, opened on April 30, 1958, at the Theatre Royal, Drury Lane, where it ran for five and a half years (2,281 performances).", "Edwardian musical comedy star Zena Dare made her last appearance in the musical as Mrs. Higgins.", "Leonard Weir played Freddy.", "Harrison left the London cast in March 1959, followed by Andrews in August 1959 and Holloway in October 1959.", "The first revival opened at the St. James Theatre on Broadway on March 25, 1976, and ran there until December 5, 1976; it then transferred to the Lunt-Fontanne Theatre, running from December 9, 1976, until it closed on February 20, 1977, after a total of 377 performances and 7 previews.", "The director was Jerry Adler, with choreography by Crandall Diehl, based on the original choreography by Hanya Holm.", "Ian Richardson starred as Higgins, with Christine Andreas as Eliza, George Rose as Alfred P. Doolittle and Robert Coote recreating his role as Pickering.", "Both Richardson and Rose were nominated for the Tony Award for Best Actor in a Musical, with the award going to Rose." ] ], "gold": "My Fair Lady in the original Broadway production was premiered on Broadway March 15, 1956, and there have been several other Broadway revivals. Julie Andrews played Eliza Doolittle in the original Broadway production. The 1981 Broadway revival co-starred Nancy Ringham as Eliza. Melissa Errico played Eliza Doolittle in the 1993 Broadway revival, while Christine Andreas as Eliza in the 1976 Broadway revival. ", "prediction 1": "There are several musicals called My Fair Lady. The 1956 Broadway production of My Fair Lady was a notable critical and popular success. Liz Robertson played Eliza Doolittle in the London revival of the show in October 1979. The first Broadway revival of My Fair Lady opened at the St. James Theatre on March 25, 1976. There were also two other Broadway revivals in 1977 and 1979.", "prediction 2": "In the 1956 Broadway production of My Fair Lady, Elizabeth Doolittle plays Eliza Doolittle. In the West End production, Zena Dare plays Eliza. In the first Broadway revival, Liz Robertson plays Eliza, with Christine Andreas playing Eliza.", "prediction 3": "My Fair Lady is a musical based on George Bernard Shaw's Pygmalion. The original Broadway production of My Fair Lady was a notable critical and popular success. It set a record for the longest run of any show on Broadway up to that time. Another Broadway revival of the original production opened at the Uris Theatre on August 18, 1981, and closed on November 29, 1981, after 120 performances and 4 previews. Another Broadway revival of the original production opened at the St. James Theatre on March 25, 1976, and ran there until February 20, 1977, after 377 performances and 7 previews.", "prediction 4": "My Fair Lady is a musical based on George Bernard Shaw's Pygmalion, with book and lyrics by Alan Jay Lerner and music by Frederick Loewe. The story concerns Eliza Doolittle, a Cockney flower girl who takes speech lessons from professor Henry Higgins, a phoneticist, so that she may pass as a lady. The original Broadway and London casts starred Rex Harrison and Julie Andrews. In the 1956 Broadway production, Elizabeth Robertson played Eliza. In the 1981 revival, Liz Robertson played Eliza. In the 1979, Liz Robertson played Eliza. In the 1979 revival of the original Broadway production, Liz Robertson played Eliza Doolittle. In the 1982, Nancy Ringham played Eliza.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 312 }, { "error type": "Redundant", "explanation": "There are several musicals called My Fair Lady. The 1956 Broadway production of My Fair Lady was a notable critical and popular success. Liz Robertson played Eliza Doolittle in the London revival of the show in October 1979. The first Broadway revival of My Fair Lady opened at the St. James Theatre on March 25, 1976. ", "start": 319, "end": 380 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6, 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10, 11 ] } ], "corrected-prediction": "The 1956 Broadway and London productions of My Fair Lady starred Julie Andrews. Liz Robertson played Eliza Doolittle in the London revival of the show in October 1979. The 1981 Broadway revival co-starred Nancy Ringham as Eliza. The first Broadway revival starred Christine Andreas as Eliza in 1976. A new revival starring Melissa Errico opened in 1993." }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who sings what condition my condition is in?", "passages": [ [ "Just Dropped In (To See What Condition My Condition Was In)", "Just Dropped In (To See What Condition My Condition Was In)\n\n\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song written by Mickey Newbury and, in 1968, a chart hit for Kenny Rogers and the First Edition.", "Said to reflect the glue sniffing experience, the song was intended to be a warning about the dangers of using the drug.", "First recorded on October 10, 1967, by Teddy Hill & the Southern Soul as a single on Rice Records (Rice 5028 b/w \"Stagger Lee\") and produced by Norro Wilson, Jerry Lee Lewis covered the song on his album \"Soul My Way\" released November 1, 1967.", "\"Just Dropped In ...\" by Kenny Rogers and the First Edition (with Kenny Rogers on lead vocals) peaked at number five on the \"Billboard\" charts.", "It was Rogers' first top ten hit.", "The song captures the short-lived psychedelic era of the late 1960s, stands apart from the country folk harmonies that characterized most of the First Edition's catalog, and got the group their first national TV audience on \"The Smothers Brothers Comedy Hour\".", "It was the group's second single from their eponymous album, \"The First Edition\"." ], [ "The Great Divide (Willie Nelson album)", "The Great Divide (Willie Nelson album)\n\nThe Great Divide is the fiftieth studio album released in 2002 by American country music singer Willie Nelson.", "It contains several duets and musical collaborations with artists such as Rob Thomas of Matchbox Twenty, Lee Ann Womack, Kid Rock, Sheryl Crow, Brian McKnight, and Bonnie Raitt.", "The album produced two chart singles in \"Mendocino County Line\" and \"Maria (Shut Up and Kiss Me)\", which respectively reached #22 and #41 on the Hot Country Songs charts.", "Also included is a cover of \"Just Dropped In (To See What Condition My Condition Was In)\", previously a hit for Kenny Rogers and the First Edition.", "The songs \"Mendocino County Line,\" \"Last Stand in Open Country,\" and \"This Face\" were co-written by Bernie Taupin, the lyricist best known for his collaborations with Elton John.", "The album was panned for the excessively adult contemporary production.", "Pat Blashill of Rolling Stone said \"Nelson is a performer who uses plain, powerful lyrics and a handsome but unvarnished voice to great effect.", "Much of that gets lost in the adult-contemporary production goop and heavenly choirs\" of this release." ] ], "gold": "Just Dropped In (To See What Condition My Condition Was In) is a psychedelic rock song best known from a version by Kenny Rogers and The First Edition. With Rogers on lead vocals, this song was recorded in October 1967. Said to reflect the LSD experience, the song was intended to be a warning about the dangers of using the drug. The song was first recorded by Jerry Lee Lewis and backed by members of The Memphis Boys in May 1967. Several other artists have also recorded this song. Willie Nelson recorded the song on his 2001 album Rainbow Connection and his 2002 album The Great Divide. Additionally, Tom Jones recorded the song on the Deluxe Edition of Spirit in the Room in 2012. Sharon Jones & The Dap-Kings also recorded the song on the original motion picture soundtrack for the film Soul Men.", "prediction 1": "\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song written by Mickey Newbury and, in 1968, a chart hit for Kenny Rogers and the First Edition. First recorded on October 10, 1967, by Teddy Hill & the Southern Soul as a single on Rice Records (Rice 5028 b/w \"Stagger Lee\") and produced by Norro Wilson, Jerry Lee Lewis covered the song on his album Soul My Way, released November 1, 1967. Also included is a cover of Just Dropped In (To See What Condition My Condition My Condition Was In) on his 2002 country music singer Willie Nelson's The Great Divide, which contains several duets and musical collaborations with artists such as Rob Thomas of Matchbox Twenty, Lee Ann Womack, Kid Rock, Lee Ann Womack, Lee Ann Womack, Kid Rock, Kid Rock, Kid Rock,", "prediction 2": "\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song written by Mickey Newbury and, in 1968, a chart hit for Kenny Rogers and the First Edition. It was first recorded on October 10, 1967, by Teddy Hill & the Southern Soul as a single on Rice Records (Rice 5028 b/w \"Stagger Lee\") and produced by Norro Wilson. Jerry Lee Lewis covered the song on his album Soul My Way, released November 1, 1967. The Great Divide, released in 2002 by American country music singer Willie Nelson, includes a cover of \"Just Dropped In (To See What Condition My Condition Was In)\", previously a hit for Kenny Rogers and the First Edition.", "prediction 3": "\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song written by Mickey Newbury and, in 1968, a chart hit for Kenny Rogers and the First Edition. Said to reflect the glue sniffing experience, the song was intended to be a warning about the dangers of using the drug. Jerry Lee Lewis covered the song on his album Soul My Way released November 1, 1967. The Great Divide is the fiftieth studio album released in 2002 by American country music singer Willie Nelson.", "prediction 4": "\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song written by Mickey Newbury and, in 1968, a chart hit for Kenny Rogers and the First Edition. Said to reflect the glue sniffing experience, the song was intended to be a warning about the dangers of using the drug. Jerry Lee Lewis covered the song on his album Soul My Way released November 1, 1967.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 91, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 340 }, { "error type": "Irrelevant", "explanation": "", "start": 471, "end": 527 }, { "error type": "Irrelevant", "explanation": "", "start": 595, "end": 790 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Just Dropped In (To See What Condition My Condition Was In)\" is a counterculture era song, a chart hit for Kenny Rogers and the First Edition. Said to reflect the glue sniffing experience, the song was intended to be a warning about the dangers of using the drug. First recorded on October 10, 1967, Jerry Lee Lewis covered the song on his album Soul My Way, released November 1, 1967. Also included is a cover of Just Dropped In on his 2002 country music singer Willie Nelson's The Great Divide." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who has the power to remove the president of the united states?", "passages": [ [ "Impeachment", "Similar to the British system, Article One of the United States Constitution gives the House of Representatives the sole power of impeachment and the Senate the sole power to try impeachments of officers of the U.S. federal government.", "(Various state constitutions include similar measures, allowing the state legislature to impeach the governor or other officials of the state government.)", "In contrast to the British system, in the United States impeachment is only the first of two stages, and conviction during the second stage requires \"the concurrence of two thirds of the members present.\"", "Impeachment does not necessarily result in removal from office; it is only a legal statement of charges, parallel to an indictment in criminal law.", "An official who is impeached faces a second legislative vote (whether by the same body or another), which determines conviction, or failure to convict, on the charges embodied by the impeachment.", "Most constitutions require a supermajority to convict.", "Although the subject of the charge is criminal action, it does not constitute a criminal trial; the only question under consideration is the removal of the individual from office, and the possibility of a subsequent vote preventing the removed official from ever again holding political office in the jurisdiction where he or she was removed.", "Impeachment with respect to political office should not be confused with witness impeachment." ], [ "United States House of Representatives", "The House may approve \"articles of impeachment\" by a simple majority vote; however, a two-thirds vote is required for conviction in the Senate.", "A convicted official is automatically removed from office and may be disqualified from holding future office under the United States.", "No further punishment is permitted during the impeachment proceedings; however, the party may face criminal penalties in a normal court of law.", "In the history of the United States, the House of Representatives has impeached sixteen officials, of whom seven were convicted.", "(Another, Richard Nixon, resigned after the House Judiciary Committee passed articles of impeachment but before a formal impeachment vote by the full House.)", "Only two Presidents of the United States have ever been impeached: Andrew Johnson in 1868 and Bill Clinton in 1998.", "Both trials ended in acquittal; in Johnson's case, the Senate fell one vote short of the two-thirds majority required for conviction.", "Under the Twelfth Amendment, the House has the power to elect the President if no presidential candidate receives a majority of votes in the Electoral College.", "The Twelfth Amendment requires the House to choose from the three candidates with the highest numbers of electoral votes.", "The Constitution provides that \"the votes shall be taken by states, the representation from each state having one vote.\"", "It is rare for no presidential candidate to receive a majority of electoral votes." ] ], "gold": "The Constitution of the United States gives Congress the power to remove the president of the United States from office in two separate proceedings. The first proceeding takes place in the House of Representatives, which impeaches the president of The United States by approving articles of impeachment through a simple majority vote. The second proceeding, the impeachment trial, takes place in the Senate. There, conviction on any of the articles requires a two-thirds majority vote and would result in the removal of the president of the United States from office, if currently sitting, and possible debarment from holding future office.", "prediction 1": "The United States Constitution gives the House of Representatives the power of impeachment and the Senate the power to try impeachments of officers of the U.S. federal government. Impeachment does not necessarily result in removal from office; it is only a legal statement of charges, parallel to an indictment in criminal law. A convicted official is automatically removed from office and may be disqualified from holding future office under the United States.", "prediction 2": "The United States Constitution gives the House of Representatives the power of impeachment and the Senate the power to try impeachments of officers of the U.S. federal government.", "prediction 3": "The United States Constitution gives the House of Representatives the sole power of impeachment and the Senate the sole power to try impeachments of officers of the U.S. federal government. Similar to the British system, Article One of the United States Constitution gives the House of Representatives the sole power of impeachment and the Senate the sole power to try impeachments of officers of the U.S. federal government.", "prediction 4": "The United States Constitution gives the House of Representatives the sole power of impeachment and the Senate the sole power to try impeachments of officers of the U.S. federal government.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 327 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States Constitution gives the House of Representatives the power of impeachment and the Senate the power to try impeachments of officers of the U.S. federal government. The House may approve \"articles of impeachment\" by a simple majority vote; however, a two-thirds vote is required for conviction in the Senate. A convicted official is automatically removed from office and may be disqualified from holding future office under the United States." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "What are the final electron acceptors for the electron transport chains in light reactions?", "passages": [ [ "Light-dependent reactions", "Light-dependent reactions\n\nIn photosynthesis, the light-dependent reactions take place on the thylakoid membranes.", "The inside of the thylakoid membrane is called the lumen, and outside the thylakoid membrane is the stroma, where the light-independent reactions take place.", "The thylakoid membrane contains some integral membrane protein complexes that catalyze the light reactions.", "There are four major protein complexes in the thylakoid membrane: Photosystem II (PSII), Cytochrome b6f complex, Photosystem I (PSI), and ATP synthase.", "These four complexes work together to ultimately create the products ATP and NADPH.", "The four photosystems absorb light energy through pigments\u2014primarily the chlorophylls, which are responsible for the green color of leaves.", "The light-dependent reactions begin in photosystem II.", "When a chlorophyll \"a\" molecule within the reaction center of PSII absorbs a photon, an electron in this molecule attains a higher energy level.", "Because this state of an electron is very unstable, the electron is transferred from one to another molecule creating a chain of redox reactions, called an electron transport chain (ETC).", "The electron flow goes from PSII to cytochrome b6f to PSI.", "In PSI, the electron gets the energy from another photon." ], [ "Light-dependent reactions", "As in cyanobacteria and chloroplasts, this is a solid-state process that depends on the precise orientation of various functional groups within a complex transmembrane macromolecular structure.", "To make NADPH, purple bacteria use an external electron donor (hydrogen, hydrogen sulfide, sulfur, sulfite, or organic molecules such as succinate and lactate) to feed electrons into a reverse electron transport chain.", "Green sulfur bacteria contain a photosystem that is analogous to PS I in chloroplasts:\n\nThere are two pathways of electron transfer.", "In \"cyclic electron transfer\", electrons are removed from an excited chlorophyll molecule, passed through an electron transport chain to a proton pump, and then returned to the chlorophyll.", "The mobile electron carriers are, as usual, a lipid-soluble quinone and a water-soluble cytochrome.", "The resulting proton gradient is used to make ATP.", "In \"noncyclic electron transfer\", electrons are removed from an excited chlorophyll molecule and used to reduce NAD to NADH.", "The electrons removed from P840 must be replaced.", "This is accomplished by removing electrons from , which is oxidized to sulfur (hence the name \"green \"sulfur\" bacteria\")." ], [ "Light-dependent reactions", "The extra energy can be converted into molecular motion and lost as heat.", "Some of the extra energy can be lost as heat energy, while the rest is lost as light.", "(This re-emission of light energy is called fluorescence.)", "The energy, but not the e- itself, can be passed onto another molecule.", "(This is called resonance.)", "The energy and the e- can be transferred to another molecule.", "Plant pigments usually utilize the last two of these reactions to convert the sun's energy into their own.", "This initial charge separation occurs in less than 10 picoseconds (10 seconds).", "In their high-energy states, the special pigment and the acceptor could undergo charge recombination; that is, the electron on the acceptor could move back to neutralize the positive charge on the special pair.", "Its return to the special pair would waste a valuable high-energy electron and simply convert the absorbed light energy into heat.", "In the case of PSII, this backflow of electrons can produce reactive oxygen species leading to photoinhibition.", "Three factors in the structure of the reaction center work together to suppress charge recombination nearly completely.", "Thus, electron transfer proceeds efficiently from the first electron acceptor to the next, creating an electron transport chain that ends if it has reached NADPH." ] ], "gold": "In light reactions, the final electron acceptor in the electron transport chain is NADP. In light reactions, the electron transfer proceeds efficiently from the first electron acceptor to the next, creating an electron transport chain that ends if it has reached NADPH.", "prediction 1": "In light reactions, the light-dependent reactions take place on the thylakoid membrane. The reaction center of PSII receives light energy through the chlorophyll \"a\" molecule. The electron is transferred from one to another molecule creating a chain of redox reactions, called an electron transport chain. Cytochrome b6f, quinone, and water-soluble cytochrome are the final electron acceptors for the electron transport chains in light reactions.", "prediction 2": "In light reactions, the first electron acceptors for the electron transport chains in light reactions are called electron acceptors, or acceptors. The final acceptors for the electron transport chains in light reactions are called acceptors. The electron acceptors of the electron transport chains in light reactions are called acceptors.", "prediction 3": "In photosynthesis, the light-dependent reactions take place on thylakoid membranes. There are four major protein complexes in the thylakoid membrane, called PSI, PSII, and PSI. These four complexes work together to ultimately create the products ATP and NADPH.", "prediction 4": "In light reactions, the light-dependent reactions take place on the thylakoid membranes, where a protein complex catalyzes the light reactions. There are four major protein complexes in the thylakoid membrane, which contain the photosystems that absorb light energy through pigments, such as chlorophylls. The light-dependent reactions begin in photosystem II, where the final electron acceptor is a chlorophyll \"a\" molecule within the reaction center of PSIIIIIIIIIII. Cytochrome b6f complex, Photosystem I, and ATP synthasylated a reverse electron transport chain of redox reactions, called an electron transport chain. The electron is transferred from one to another molecule creating a chain of redox reactions, called an electron transport chain that ends if it has", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 175 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 305 }, { "error type": "Unverifiable", "explanation": "", "start": 306, "end": 446 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 13 ] } ], "corrected-prediction": "n light reactions, the final electron acceptor in the electron transport chain is NADP. The electron is transferred from one to another molecule creating a chain of redox reactions, called an electron transport chain. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Where was twilight breaking dawn part 1 filmed?", "passages": [ [ "The Twilight Saga: Breaking Dawn \u2013 Part 1", "However, he said that if the second film were to be released in 3D, he would like to shoot it with the proper equipment in \"real\" 3D as was done with \"Avatar\" (2009), not convert it into 3D in post-production as was done with \"Clash of the Titans\" (2010).", "In order to keep the budget on both parts of \"Breaking Dawn\" reasonable, even though it is substantially greater than the previous installments in the series, much of the film was shot in and around Baton Rouge, Louisiana and Celtic Studios in Baton Rouge.", "Shooting in Louisiana provided larger tax credits, which a small studio like Summit Entertainment would find favorable.", "Summit announced in a press release on July 9, 2010, that filming was to take place in Baton Rouge, Ucluelet, and Vancouver, with the wedding being shot in Squamish.", "(Also shot in near by Pemberton, British Columbia.)", "Both parts will be shot back-to-back as one project." ], [ "The Twilight Saga: Breaking Dawn \u2013 Part 1", "The film will attempt to keep its PG-13 rating, and it will not feature any of the gruesome scenes from the novel with Kristen Stewart confirming that the birth scene wasn't as grotesque as described in the book and that she didn't \"puke up blood\", though director Bill Condon said that they shot everything as \"powerful and potent as they could\".", "Though there were many reports of the cast in Whistler, British Columbia, none of the actual filming took place in Whistler itself, but to the north and south of the town in nearby Pemberton (north) & Squamish (south).", "The Stars were housed in Whistler at 4 and 5 star hotels, the crew in Squamish & Pemberton.", "Filming officially began on November 1, 2010 in Brazil, with locations in Rio de Janeiro and Paraty, Rio de Janeiro.", "The first scenes were shot in the Lapa District in Rio de Janeiro for one night.", "A long city block was rented for shooting, and Summit Entertainment paid residents 50 to 500 reais (30 to 300 U.S. dollars) to not allow paparazzi or fans to overlook filming from their windows." ] ], "gold": "Twilight Breaking Dawn part 1 was filmed in different countries: United States, Canada and Brazil. Much of the film was shot in and around Baton Rouge, Louisiana and Celtic Studios in Baton Rouge. Summit announced in a press release on July 9, 2010, that filming was to take place in Baton Rouge, Ucluelet, and Vancouver, with the wedding being shot in Squamish. Filming officially began on November 1, 2010 in Brazil, with locations in Rio de Janeiro and Paraty, Rio de Janeiro.", "prediction 1": "Twilight Breaking Dawn Part 1 was filmed in several locations. Filming officially began on November 1, 2010 in Brazil, with locations in Rio de Janeiro and Paraty, Rio de Janeiro. In order to keep the budget on both parts of \"Breaking Dawn\" reasonable, even though it is substantially greater than the previous installments in the series, much of the film was shot in and around Baton Rouge, Louisiana and Celtic Studios in Baton Rouge.", "prediction 2": "The Twilight Saga: Breaking Dawn was filmed in three locations. The first part was filmed in Rio de Janeiro, Brazil. The second part was filmed in Vancouver, British Columbia.", "prediction 3": "The filming of the first part of Twilight Breaking Dawn was filmed in Brazil, with locations in Rio de Janeiro, Paraty, Rio de Janeiro, and Baton Rouge. The filming of the second part was filmed in Vancouver, British Columbia.", "prediction 4": "There was filming for the first part of Twilight's Breaking Dawn in several locations, including Baton Rouge, Louisiana and Celtic Studios in Baton Rouge. The rest of the film was filmed in Ucluelet, Vancouver, British Columbia and Squamish, British Columbia. The wedding scene was also filmed in Squamish.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 338 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Twilight Breaking Dawn Part 1 was filmed in several locations. Much of the film was shot in and around Baton Rouge, Louisiana and Celtic Studios in Baton Rouge. Summit announced in a press release on July 9, 2010, that filming was to take place in Baton Rouge, Ucluelet, and Vancouver, with the wedding being shot in Squamish. Filming officially began on November 1, 2010 in Brazil, with locations in Rio de Janeiro and Paraty, Rio de Janeiro. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did biltmore house open to the public?", "passages": [ [ "Biltmore Estate", "Overwhelmed with running such a large estate, Edith began consolidating her interests and sold Biltmore Estate Industries in 1917 and Biltmore Village in 1921.", "Edith intermittently occupied the house, living in an apartment carved out of the former Bachelors' Wing, until the marriage of her daughter to John Francis Amherst Cecil in April 1924.", "The Cecils went on to have two sons who were born in the same room as their mother.", "In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism.", "Biltmore closed during World War II and in 1942, 62 paintings and 17 sculptures were moved to the estate by train from the National Gallery of Art in Washington, D.C. to protect them in the event of an attack on the United States.", "The Music Room on the first floor was never finished, so it was used for storage until 1944, when the possibility of an attack became more remote.", "Among the works stored were the Gilbert Stuart portrait of George Washington and works by Rembrandt, Raphael, and Anthony van Dyck.", "David Finley, the gallery director, was a friend of Edith Vanderbilt and had stayed at the estate." ], [ "Biltmore Estate", "He asked Hunt and Olmsted to design a village with architecturally compatible buildings and picturesque landscaping as a source of income through building rental, a place to help carry out philanthropic programs, and an easy point of access between the estate and the train station.", "The result was Biltmore Village.", "The village included rental cottages complete with plumbing and central heating, a post office, shops, doctor's office, school, and a church, known today as the Cathedral of All Souls.", "Intending that the estate could be self-supporting, Vanderbilt set up scientific forestry programs, poultry farms, cattle farms, hog farms, and a dairy.", "His wife, Edith, also enthusiastically supported agricultural reform and promoted the establishment of a state agricultural fair.", "In 1901, the Vanderbilts provided financial assistance to Biltmore Industries, started by Biltmore Village resident Eleanor Vance, which taught young people how to make hand-carved furniture, woven baskets, homespun wool fabric, and more.", "The estate today covers approximately and is split in half by the French Broad River, overseen by The Biltmore Company, a trust set up by the family.", "The company is a large enterprise that is one of the largest employers in the Asheville area.", "Restaurants were opened in 1979 and 1987 as well as four gifts shops in 1993.", "The former dairy barn was converted into the popular Biltmore Winery in 1985." ], [ "Biltmore Estate", "Biltmore Estate\n\nBiltmore Estate is a large (6950.4 acres or 10.86 square miles or 28.13 square kilometers)", "[also noted as 5,000 acres and 8,000 acres elsewhere on this page] private estate and tourist attraction in Asheville, North Carolina.", "Biltmore House, the main residence, is a Ch\u00e2teauesque-style mansion built by George Washington Vanderbilt II between 1889 and 1895 and is the largest privately owned house in the United States, at of floor space ( of living area).", "Still owned by George Vanderbilt's descendants, it remains one of the most prominent examples of the Gilded Age.", "In the 1880s, at the height of the Gilded Age, George Washington Vanderbilt II, youngest son of William Henry Vanderbilt, began to make regular visits with his mother, Maria Louisa Kissam Vanderbilt (1821\u20131896), to the Asheville, North Carolina, area.", "He loved the scenery and climate so much that he decided to create his own summer estate in the area, which he called his \"little mountain escape\", just as his older brothers and sisters had built opulent summer houses in places such as Newport, Rhode Island, and Hyde Park, New York." ] ], "gold": "Biltmore Estate is a historic house museum and tourist attraction in Asheville, North Carolina. In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. The 210-room Inn on Biltmore Estate opened in 2001, and in 2010, the estate opened Antler Hill Village, as well as a remodeled winery, and connected farmyard. In 2015, the Village Hotel on Biltmore Estate, a more casual option to The Inn with 209 rooms, was opened in Antler Hill Village.", "prediction 1": "The Biltmore Estate is a large (6950.4 acres or 10.86 square miles or 28.13 square kilometers) private estate and tourist attraction in Asheville, North Carolina, United States, located in the mountains of North Carolina. The main residence, Biltmore House, is a Ch\u00e2teauesque-style mansion built by George Washington Vanderbilt II between 1889 and 1895 and is the largest privately owned house in the United States, at of floor space (of living area). In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. The Village was opened to the City of Asheville, which hoped the attraction would revitalize the area with tourism.", "prediction 2": "The Biltmore Estate was a large 6950.4-acre private estate and tourist attraction in Asheville, North Carolina, that was established in 1888 by George Vanderbilt II. The main residence, Biltmore House, is a Ch\u00e2teauesque-style mansion built by George Vanderbilt II between 1889 and 1895 and is the largest privately owned house in the United States, at of floor space (of living area). The first time the house opened to the public was in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism.", "prediction 3": "In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. The property closed during World War II and in 1942, 62 paintings and 17 sculptures were moved to the estate by train from the National Gallery of Art in Washington, D.C. to protect them in the event of an attack on the United States. The Music Room on the first floor was the largest privately owned house in the United States at of floor space.", "prediction 4": "The main residence of Biltmore House, the main residence of Biltmore Estate, is a Ch\u00e2teauesque-style mansion built by George Washington Vanderbilt II between 1889 and 1895 and is the largest privately owned house in the United States, at of floor space ( of living area). In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. The Village was also opened in 1941 and in 1942, 62 paintings and 17 sculptures were moved to the estate by train to protect them in the event of an attack on the United States.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 31, "end": 94 }, { "error type": "Irrelevant", "explanation": "", "start": 178, "end": 221 }, { "error type": "Irrelevant", "explanation": "", "start": 222, "end": 451 }, { "error type": "Redundant", "explanation": "at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. ", "start": 716, "end": 831 } ], "missing-info": [], "corrected-prediction": "The Biltmore Estate is a large private estate and tourist attraction in Asheville, North Carolina, United States. In an attempt to bolster the estate's financial situation during the Great Depression, Cornelia and her husband opened Biltmore to the public in March 1930 at the request of the City of Asheville, which hoped the attraction would revitalize the area with tourism. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played thanos in gardians of the galaxy?", "passages": [ [ "Star-Lord", "Star-Lord\n\nStar-Lord (Peter Jason Quill) is a fictional superhero appearing in American comic books published by Marvel Comics.", "The character, created by Steve Englehart and Steve Gan, first appeared in \"Marvel Preview\" #4 (January 1976).", "The son of human Meredith Quill and Spartoi J'son, Peter Quill assumes the mantle of Star-Lord, an interplanetary policeman.", "The character played prominent roles in the comic book storylines \"Annihilation\" (2006) and \"\" (2007), \"War of Kings\" (2008), and \"The Thanos Imperative\" (2009).", "He became the leader of the space-based superhero team Guardians of the Galaxy in the 2008 relaunch of the comic of the same name.", "He has been featured in a variety of associated Marvel merchandise, including animated television series, toys and trading cards.", "Chris Pratt portrays the character in the Marvel Cinematic Universe beginning with the 2014 live action film \"Guardians of the Galaxy\", \"Guardians of the Galaxy Vol. 2\" and \"\".", "He will also reprise the role in \"\".", "Wyatt Oleff portrays a young Peter Quill in the first two \"Guardians of the Galaxy\" films.", "The character first appeared in the black-and-white magazine publication \"Marvel Preview\" #4 (Jan 1976)." ], [ "Guardians of the Galaxy (film)", "Guardians of the Galaxy (film)\n\nGuardians of the Galaxy (retroactively referred to as Guardians of the Galaxy Vol. 1) is a 2014 American superhero film based on the Marvel Comics superhero team of the same name, produced by Marvel Studios and distributed by Walt Disney Studios Motion Pictures.", "It is the tenth film in the Marvel Cinematic Universe (MCU).", "The film was directed by James Gunn, who wrote the screenplay with Nicole Perlman, and features an ensemble cast including Chris Pratt, Zoe Saldana, Dave Bautista, Vin Diesel, and Bradley Cooper as the titular Guardians, along with Lee Pace, Michael Rooker, Karen Gillan, Djimon Hounsou, John C. Reilly, Glenn Close, and Benicio del Toro.", "In \"Guardians of the Galaxy\", Peter Quill forms an uneasy alliance with a group of extraterrestrial criminals who are fleeing after stealing a powerful artifact.", "Perlman began working on the screenplay in 2009.", "Producer Kevin Feige first publicly mentioned \"Guardians of the Galaxy\" as a potential film in 2010 and Marvel Studios announced it was in active development at the San Diego Comic-Con International in July 2012.", "Gunn was hired to write and direct the film that September.", "In February 2013, Pratt was hired to play Peter Quill / Star-Lord, and the supporting cast members were subsequently confirmed." ], [ "Thanos", "Thanos\n\nThanos (, ) is a fictional supervillain appearing in American comic books published by Marvel Comics.", "The character, created by writer/artist Jim Starlin, first appeared in \"The Invincible Iron Man\" #55 (cover dated February 1973).", "Thanos is one of the most powerful villains in the Marvel Universe and has clashed with many heroes including the Avengers, the Guardians of the Galaxy, the Fantastic Four, and the X-Men.", "The character appears in the Marvel Cinematic Universe, portrayed by Damion Poitier in \"The Avengers\" (2012), and by Josh Brolin in \"Guardians of the Galaxy\" (2014), \"\" (2015), \"\" (2018), and \"\" (2019) through voice and motion capture.", "The character has also appeared in various comic adaptations, including animated television series, arcade, and video games.", "Writer-artist Jim Starlin originally conceived of Thanos of Titan during college psychology classes.", "As Starlin described:\n\nStarlin has admitted the character's look was influenced by Jack Kirby's Darkseid:\n\nThanos' first appearance was in \"The Invincible Iron Man\" #55 (February 1973), featuring a story by Jim Starlin that was co-scripted by Mike Friedrich." ] ], "gold": "The Guardians of the Galaxy is a fictional superhero team appearing in American comic books published by Marvel Comics, in which Thanos is a supervillain character. In the 2014 Guardians of the Galaxy film based on the Marvel Comic, Damion Poitier portrayed the character in an uncredited cameo appearance, but in May 2014, Josh Brolin signed a multi-film contract to portray the character of Thanos. Guardians of the Galaxy is also an American animated television series based on the Comic that premiered on September 26, 2015 on Disney XD, in which Isaac C. Singleton Jr. is the actor behind Thanos' character. Guardians of the Galaxy: The Telltale Series is an episodic graphic adventure video game series developed and published by Telltale Games, also based on the comic, which was released on April 18, 2017 and features Jake Hart as Thanos.", "prediction 1": "Thanos is a fictional supervillain appearing in American comic books published by Marvel Comics. The character, created by writer/artist Jim Starlin, first appeared in The Invincible Iron Man #55 (February 1973). In the 2014 live action Guardians of the Galaxy film, Chris Pratt plays Thanos, and Josh Brolin plays Thanos in subsequent live action films.", "prediction 2": "Thanos is a fictional supervillain appearing in American comic books published by Marvel Comics. The character, created by writer/artist Jim Starlin, first appeared in The Invincible Iron Man #55 (February 1973). Thanos is one of the most powerful villains in the Marvel Universe and has clashed with many heroes including the Guardians of the Galaxy, the Fantastic Four, and the X-Men. Josh Brolin played Thanos in Guardians of the Galaxy, Vol. 1 (2014), and Wille played Thanos in the first two Guardians of the Galaxy.", "prediction 3": "Thanos is a fictional supervillain appearing in American comic books published by Marvel Comics. The character, created by writer/artist Jim Starlin, first appeared in The Invincible Iron Man #55 (February 1973). Chris Pratt played Thanos in the 2014 Guardians of the Galaxy live action film. Josh Brolin portrayed Thanos in the Guardians of the Galaxy Vol. 1 live action film.", "prediction 4": "Thanos, a fictional supervillain appearing in American comic books published by Marvel Comics, is played by Wyatt Oleff in the first two Guardians of the Galaxy film. Chris Pratt plays Thanos in the 2014 live action Guardians of the Galaxy film and in the 2015 video game. Josh Brolin plays Thanos in Guardians of the Galaxy 2 and 3.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 212 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[8]}", "start": 285, "end": 292 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Thanos is a fictional supervillain appearing in American comic books published by Marvel Comics. In the 2014 live action Guardians of the Galaxy film, Josh Brolin plays Thanos, as well as later films. Damion Poitier portrayed Thanos in the 2012 film \"The Avengers\"." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When was the first pc sold to the public?", "passages": [ [ "Personal computer", "Personal computer\n\nA personal computer (PC) is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use.", "PCs are intended to be operated directly by an end user, rather than by a computer expert or technician.", "Computer time-sharing models that were typically used with larger, more expensive minicomputer and mainframe systems, to enable them be used by many people at the same time, are not used with PCs.", "Early computer owners in the 1960s, invariably institutional or corporate, had to write their own programs to do any useful work with the machines.", "In the 2010s, personal computer users have access to a wide range of commercial software, free-of-charge software (\"freeware\") and free and open-source software, which are provided in ready-to-run form.", "Software for personal computers is typically developed and distributed independently from the hardware or OS manufacturers.", "Many personal computer users no longer need to write their own programs to make any use of a personal computer, although end-user programming is still feasible.", "This contrasts with mobile systems, where software is often only available through a manufacturer-supported channel, and end-user program development may be discouraged by lack of support by the manufacturer.", "Since the early 1990s, Microsoft operating systems and Intel hardware have dominated much of the personal computer market, first with MS-DOS and then with Windows." ], [ "IBM Personal Computer", "IBM Personal Computer\n\nThe IBM Personal Computer, commonly known as the IBM PC, is the original version and progenitor of the IBM PC compatible hardware platform.", "It is IBM model number 5150, and was introduced on August 12, 1981.", "It was created by a team of engineers and designers under the direction of Don Estridge of the IBM Entry Systems Division in Boca Raton, Florida.", "The generic term \"personal computer\" (\"PC\") was in use years before 1981, applied as early as 1972 to the Xerox PARC's Alto, but because of the success of the IBM Personal Computer, the term \"PC\" came to also mean more specifically a desktop microcomputer compatible with IBM's \"Personal Computer\" branded products.", "Since the machine was based on open architecture, within a short time of its introduction, third-party suppliers of peripheral devices, expansion cards, and software proliferated; the influence of the IBM PC on the personal computer market was substantial in standardizing a platform for personal computers.", "\"IBM compatible\" became an important criterion for sales growth; after the 1980s, only the Apple Macintosh family kept a significant share of the microcomputer market without compatibility with the IBM personal computer.", "International Business Machines (IBM), one of the world's largest companies, had a 62% share of the mainframe computer market in 1982." ], [ "Altair 8800", "Altair 8800\n\nThe Altair 8800 is a microcomputer designed in 1974 by MITS and based on the Intel 8080 CPU.", "Interest grew quickly after it was featured on the cover of the January 1975 issue (published in late November 1974) of \"Popular Electronics\", and was sold by mail order through advertisements there, in \"Radio-Electronics\", and in other hobbyist magazines.", "The designers hoped to sell a few hundred build-it-yourself kits to hobbyists, and were surprised when they sold thousands in the first month.", "The Altair also appealed to individuals and businesses that just wanted a computer and purchased the assembled version.", "The Altair is widely recognized as the spark that ignited the microcomputer revolution as the first commercially successful personal computer.", "The computer bus designed for the Altair was to become a \"de facto\" standard in the form of the S-100 bus, and the first programming language for the machine was Microsoft's founding product, Altair BASIC.", "While serving at the Air Force Weapons Laboratory at Kirtland Air Force Base, Ed Roberts and Forrest M. Mims III decided to use their electronics background to produce small kits for model rocket hobbyists." ] ], "gold": "A personal computer, or PC, is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use and are intended to be operated directly by an end user, rather than by a computer expert or technician. In 1974, what is considered by many to be the first true \"personal computer\", the Altair 8800, a microcomputer based on the Intel 8080 CPU, was introduced. The Altair 8800 grew interest quickly after it was featured on the cover of the January 1975 issue of Popular Electronics and was sold by mail order through advertisements there, in Radio-Electronics, and in other hobbyist magazines. IBM's first PC was introduced on August 12, 1981.", "prediction 1": "A personal computer is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. The first personal computer, commonly known as the IBM PC, was sold to the public on August 12, 1981. The Altair 8800, a microcomputer designed in 1974 by MITS and based on the Intel 8080 CPU, was sold by mail order through advertisements there, in \"Radio-Electronics\", and in other hobbyist magazines. The IBM PC was the original version and progenitor of the IBM Personal Computer branded products. The Altair 8800 was a microcomputer designed in 1974 by MITS and based on the Intel 80808080808080808080808080808080808080808080808080808080808080808080808080808080808080808080808080808080808080808080", "prediction 2": "A personal computer (PC) is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. The first personal computer for sale was the Altair 8800 sold by mail order on January 25, 1975. The Altair was sold on November 24, 1975, and on December 14, 1975, the Xerox PARC Alto was sold on December 13, 1972.", "prediction 3": "The first personal computer was sold to the public in the United States in August 1981. The first personal computer sold to the public in the United States was the Altair 8800, designed in 1974, sold by mail order through advertisements there, in Radio-Electronics, and in other hobbyist magazines. The personal computer was first sold to the public in the United States in February 1985.", "prediction 4": "The first personal computer sold to the public was the IBM Personal Computer, which was the original version and progenitor of the IBM PC compatible hardware platform. It was introduced on August 12, 1981. The Altair 8800 was the first microcomputer sold to the public.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 424, "end": 521 }, { "error type": "Redundant", "explanation": " The Altair 8800, a microcomputer designed in 1974 by MITS and based on the Intel 8080 CPU", "start": 522, "end": 605 }, { "error type": "Incoherent", "explanation": "", "start": 606, "end": 722 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "A personal computer is a multi-purpose computer whose size, capabilities, and price make it feasible for individual use. PCs are intended to be operated directly by an end user, rather than by a computer expert or technician. The first personal computer, commonly known as the IBM PC, was sold to the public on August 12, 1981. The Altair 8800, a microcomputer designed in 1974 by MITS and based on the Intel 8080 CPU. Interest grew quickly after it was featured on the cover of the January 1975 issue (published in late November 1974) of \"Popular Electronics\", and was sold by mail order through advertisements there, in \"Radio-Electronics\", and in other hobbyist magazines." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the songs to the greatest showman?", "passages": [ [ "The Greatest Showman", "The Greatest Showman\n\nThe Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya.", "The film is inspired by the story of P. T. Barnum's creation of the Barnum & Bailey Circus and the lives of its star attractions.", "Principal photography began in New York City in November 2016.", "The film premiered on December 8, 2017, aboard the RMS \"Queen Mary 2\".", "It was released in the United States on December 20, 2017, by 20th Century Fox and grossed over $434million worldwide, making it the fifth-highest grossing live-action musical of all time.", "The film was released seven months after Ringling Bros. and Barnum & Bailey Circus's dissolution.", "\"The Greatest Showman\" received mixed reviews, with praise for the performances, music, and production values, but criticism for its artistic license, with some reviewers calling it \"faux-inspiring and shallow\".", "At the 75th Golden Globe Awards, the film received nominations for Best Motion Picture \u2013 Musical or Comedy and Best Actor \u2013 Musical or Comedy for Jackman." ], [ "The Greatest Showman: Original Motion Picture Soundtrack", "The Greatest Showman: Original Motion Picture Soundtrack\n\nThe Greatest Showman: Original Motion Picture Soundtrack is the soundtrack album to the film of the same name.", "It was released in full on December 8, 2017 by Atlantic Records.", "The first pre-order release was on October 26, 2017 with two promotional singles: \"The Greatest Show\" and \"This Is Me\" and a third on November 17, 2017 \"Rewrite the Stars\".", "\"This Is Me\" was released on December 8, 2017 as the album's official lead single.", "In Australia, \"Rewrite the Stars\" was released to radio on July 20, 2018.", "Produced by Justin Paul, Benj Pasek, Greg Wells, Kevin Weaver, and Pete Ganbarg, the album became a global success following the release of the film, topping the charts in several countries including the United States, Australia, the United Kingdom and Japan.", "The album also reached number one on iTunes in over 77 countries.", "In the United Kingdom, the album is a commercial success and is the best-selling album of 2018.", "It became only the second album in 30 years to spend 11 consecutive weeks at number 1 and in its 20th week atop the UK Albums Chart, it became the longest running soundtrack at number 1 in 50 years, and has sold over 4.5 million copies worldwide." ], [ "The Greatest Showman", "On June 15, 2016, Zac Efron began negotiations to star in the film, and in July 2016, Michelle Williams was cast.", "The film was choreographed by Ashley Wallen.", "Rehearsals on the film began in October 2016 in New York City, and principal photography began on November 22, 2016.", "In December 2017, it was reported that James Mangold, who had worked with Jackman on several projects (including 2017's \"Logan\"), had been brought in to serve as an executive producer during the film's post-production.", "In an interview, director Michael Gracey noted, \"There were eight producers on this film, and it was amazing having one of them be a filmmaker.\"", "Benj Pasek and Justin Paul wrote all the songs appearing in the film.", "The soundtrack album is produced by Justin Paul, Benj Pasek, Greg Wells, Kevin Weaver and Pete Ganbarg, featuring the eleven tracks performed by the cast.", "In the United Kingdom it became only the second album in 30 years to achieve 11 consecutive weeks at number 1.", "\"The Greatest Showman\" now draws level with Adele's \"21\" for the longest unbroken run at the UK summit in the last 30 years." ] ], "gold": "The Greatest Showman is a 2017 American musical drama film directed by Michael Gracey in his directorial debut, written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, Zendaya, and Keala Settle. The songs \"This Is Me\" and \"Rewrite the Stars\" from the film were written by Benj Pasek and Justin Paul. Benj Pasek, Justin Paul and Ryan Lewis wrote the opening track, \"The Greatest Show\".", "prediction 1": "The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut and written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya. The music for the film was written by Benj Pasek and Justin Paul. The Greatest Showman: Original Motion Picture Soundtrack is the soundtrack album to the film of the same name.", "prediction 2": "The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut and written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya. The Greatest Showman: Original Motion Picture Soundtrack is the soundtrack album to the film of the same name. Benj Pasek and Justin Paul wrote all the songs appearing in the film. The soundtrack album is produced by Justin Paul, Benj Pasek, Greg Wells, Kevin Weaver, Pete Ganbarg, featuring the eleven tracks performed by the cast.", "prediction 3": "The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut. Written by Jenny Bicks and Bill Condon, The Greatest Showman is the name of the soundtrack album to the film. Benj Pasek and Justin Paul wrote all the songs appearing in the film. The soundtrack album, The Greatest Showman: Original Motion Picture Soundtrack, was produced by Justin Paul, Benj Pasek, Greg Wells, Kevin Weaver, and Pete Ganbarg.", "prediction 4": "The songs to The Greatest Showman were written by Benj Pasek and Justin Paul. The songs were written by Jenny Bicks and Bill Condon, Jenny Bicks, and Rebecca Ferguson, respectively. The songs were also sung by Jenny Bicks and Bill Condon.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 302, "end": 412 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Greatest Showman is a 2017 American musical film directed by Michael Gracey in his directorial debut and written by Jenny Bicks and Bill Condon and starring Hugh Jackman, Zac Efron, Michelle Williams, Rebecca Ferguson, and Zendaya. The two promotional singles: \"The Greatest Show\" and \"This Is Me\" were written by Benj Pasek and Justin Paul. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who wrote the grapes of wrath about migrant workers?", "passages": [ [ "The Grapes of Wrath", "The Grapes of Wrath\n\nThe Grapes of Wrath is an American realist novel written by John Steinbeck and published in 1939.", "The book won the National Book Award\nand Pulitzer Prize for fiction, and it was cited prominently when Steinbeck was awarded the Nobel Prize in 1962.", "Set during the Great Depression, the novel focuses on the Joads, a poor family of tenant farmers driven from their Oklahoma home by drought, economic hardship, agricultural industry changes, and bank foreclosures forcing tenant farmers out of work.", "Due to their nearly hopeless situation, and in part because they are trapped in the Dust Bowl, the Joads set out for California.", "Along with thousands of other \"Okies\", they seek jobs, land, dignity, and a future.", "\"The Grapes of Wrath\" is frequently read in American high school and college literature classes due to its historical context and enduring legacy.", "A celebrated Hollywood film version, starring Henry Fonda and directed by John Ford, was released in 1940.", "The narrative begins just after Tom Joad is paroled from McAlester prison, where he had been imprisoned after being convicted of homicide.", "On his return to his home near Sallisaw, Oklahoma, Tom meets former preacher Jim Casy, whom he remembers from his childhood, and the two travel together.", "When they arrive at Tom's childhood farm home, they find it deserted." ], [ "The Grapes of Wrath (film)", "The Grapes of Wrath (film)\n\nThe Grapes of Wrath is a 1940 American drama film directed by John Ford.", "It was based on John Steinbeck's 1939 Pulitzer Prize-winning novel of the same name.", "The screenplay was written by Nunnally Johnson and the executive producer was Darryl F. Zanuck.", "The film tells the story of the Joads, an Oklahoma family, who, after losing their farm during the Great Depression in the 1930s, become migrant workers and end up in California.", "The motion picture details their arduous journey across the United States as they travel to California in search of work and opportunities for the family members.", "The film is widely considered as one of the greatest American films of all time.", "In 1989, this film was one of the first 25 films to be selected for preservation in the United States National Film Registry by the Library of Congress as being \"culturally, historically, or aesthetically significant.\"", "The film opens with Tom Joad (Henry Fonda), released from prison and hitchhiking his way back to his parents' family farm in Oklahoma.", "Tom finds an itinerant ex-preacher named Jim Casy (John Carradine) sitting under a tree by the side of the road.", "Casy was the preacher who baptized Tom, but now Casy has \"lost the spirit\" and his faith." ], [ "Nunnally Johnson", "Nunnally began his career as a journalist, writing for the \"Columbus Enquirer Sun\", the \"Savannah Press\", the \"Brooklyn Daily Eagle\", and the \"New York Herald Tribune\".", "He also wrote short stories and a collection of these, \"There Ought To Be a Law\", was published in 1930.", "His first connection with film work was the sale of screen rights to one of his stories in 1927.", "Johnson asked his editor if he could write film criticism articles in 1932.", "When this request was denied, he decided to relocate to Hollywood and work directly in the film industry.", "Quickly finding work as a scriptwriter, Johnson was hired full-time as a writer by 20th Century-Fox in 1935.", "He soon began producing films as well and co-founded International Pictures in 1943 with William Goetz.", "Johnson also directed several films in the 1950s, including two starring Gregory Peck.", "He was nominated for the Academy Award for Best Screenplay in 1940 for \"The Grapes of Wrath\" and the Directors Guild of America Best Director Award in 1956 for \"The Man in the Gray Flannel Suit\".", "In 1964, Johnson adapted his daughter Nora Johnson's novel \"The World of Henry Orient\" into a film of the same title, starring Peter Sellers." ] ], "gold": "Published in 1939, The Grapes of Wrath is an American realist novel written by John Steinbeck. The Grapes of Wrath won the National Book Award and Pulitzer Prize for fiction, and it was cited prominently when Steinbeck was awarded the Nobel Prize in 1962. The Grapes of Wrath is also a 1940 American drama film based on Steinbeck's novel. The screenplay for this film was written by Nunnally Johnson. Johnson's screenplay for The Grapes of Wrath was nominated for the Academy Award for Best Screenplay in 1940.", "prediction 1": "The Grapes of Wrath is an American realist novel written by John Steinbeck and published in 1939. The novel focuses on the Joads, a poor family of tenant farmers driven from their Oklahoma home by drought, economic hardship, agricultural industry changes, and bank foreclosures forcing tenant farmers out of work. Along with thousands of other \"Okies\", they seek jobs, land, dignity, and a future. The Grapes of Wrath is a 1940 American drama film directed by John Ford. The screenplay was written by Nunnally Johnson and the executive producer was Darryl F. Zanuck.\n", "prediction 2": "The Grapes of Wrath is an American realist novel written by John Steinbeck, which won the National Book Award and Pulitzer Prize for fiction, and it was cited prominently when Steinbeck was awarded the Nobel Prize in 1962. A celebrated Hollywood film version, starring Henry Fonda and directed by John Ford, was released in 1940. It is based on the 1936 Pulitzer Prize-winning novel of the same name. The screenplay was written by Nunnally Johnson and the executive producer was Darryl F. Zanuck.", "prediction 3": "The Grapes of Wrath is an American realist novel written by John Steinbeck and published in 1939. Set during the Great Depression, the novel focuses on the Joads, a poor family of tenant farmers driven from their Oklahoma home by drought, economic hardship, agricultural industry changes, and bank foreclosures forcing tenant farmers out of work. Along with thousands of other \"Okies\", they seek jobs, land, dignity, and a future. The Grapes of Wrath is a 1940 American drama film directed by John Ford.", "prediction 4": "The Grapes of Wrath is an American realist novel written by John Steinbeck and published in 1939. John Steinbeck's 1939 Pulitzer Prize-winning novel about migrant workers was adapted into a film in 1940. Henry Fonda starred in the 1940 version of the film, while Nunnally Johnson wrote the screenplay and his daughter Nora adapted her 1961 novel of the same name.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 313 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 397 }, { "error type": "Irrelevant", "explanation": "", "start": 448, "end": 470 }, { "error type": "Irrelevant", "explanation": "", "start": 518, "end": 567 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Grapes of Wrath is an American realist novel written by John Steinbeck and published in 1939. The book won the National Book Award and Pulitzer Prize for fiction, and it was cited prominently when Steinbeck was awarded the Nobel Prize in 1962. The Grapes of Wrath is a 1940 American drama film. The screenplay was written by Nunnally Johnson and he was nominated for the Academy Award for Best Screenplay in 1940." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Where is the tv show hell's kitchen located?", "passages": [ [ "Hell's Kitchen (U.S. TV series)", "\"Hell's Kitchen\" is a reality television show that uses a progressive elimination format to narrow down a field of 12 to 20 aspiring chefs to a single winner over the course of one season.", "The U.S. version of \"Hell's Kitchen\" follows the format of the UK version though the show is recorded and not performed live, nor is there audience participation in the elimination of chefs.", "The show is produced at Hell's Kitchen, a modified warehouse in Los Angeles that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show.", "They are also given knife sets that they get to keep, regardless of their progress.", "At the start of each season, Gordon Ramsay breaks the chefs into two teams.", "With the exception of the first and most recent seasons, this puts women on the red team and men on the blue team; each is given a chef's jacket with panels of that color on the shoulders.", "The chefs remain on these teams throughout most of the competition; Ramsay may reassign a chef to the other team if the team numbers are uneven or if he feels the chef will perform better on the other team.", "Each episode typically includes a challenge and a dinner service, followed by the elimination of a chef." ], [ "Hell's Kitchen (U.S. TV series)", "Hell's Kitchen (U.S. TV series)\n\n", "Hell's Kitchen is an American reality competition television series based on the British series of the same name.", "Broadcast on Fox, it is hosted by celebrity chef Gordon Ramsay.", "Two teams of chefs compete for a job as head chef at a restaurant.", "A typical episode begins with a challenge between the teams; the winning team gets some sort of a reward that usually involves some sort of recreational activity outside the Hell's Kitchen, while the losers are given a \"punishment\" that usually involves some sort of menial task.", "The second part is a dinner service, where each team works in their own kitchen, attempting, under close and hypercritical supervision from Chef Ramsay, to complete the service without getting kicked out before finishing for too many errors.", "The usual wrap-up involves whichever team is declared the loser of the dinner service choosing two of their own to be up for elimination.", "There are many possible variations; both teams being kicked out before the end of dinner service is an example that has occurred on several occasions.", "On September 9, 2016, Fox renewed \"Hell's Kitchen\" for seasons 17 and 18.", "The seventeenth season, titled \"All-Stars\", premiered on September 29, 2017.", "The eighteenth season, titled \"Rookies vs. Veterans\", premiered on September 28, 2018." ], [ "Hell's Kitchen (U.S. season 1)", "Hell's Kitchen (U.S. season 1)\n\n", "This article contains contestant information and episode summaries from Season 1 of the American competitive reality television series Hell's Kitchen.", "Season 1 aired starting on May 30, 2005 and concluded on August 1, 2005.", "Michael Wray from Fort Collins, Colorado, won the first season of \"Hell's Kitchen\", thus winning his own restaurant in Los Angeles named Tatou (he was offered to go to London to work under Gordon Ramsay, but later declined due to family reasons).", "This was the first season where the teams were not separated by gender at the start, which wouldn't happen again until season 18.", "The show was taped in Los Angeles at KCOP, in a converted former television broadcast facility that previously hosted shows such as \"The Joker's Wild\" and \"Tic-Tac-Dough\" in the late 1970s to mid-1980s.", "The 12 contestants were initially divided into the Blue team and the Red team, but not based on gender as in all the following seasons.", "The contestants were:\n\nEach week, the best member from the losing team during the latest service period (\"least bad\" as determined by Ramsay) is asked to nominate two of their teammates for elimination; one of these two is sent home by Gordon Ramsay." ] ], "gold": "Hell's Kitchen is an American reality competition television series hosted by celebrity chef Gordon Ramsay, who created and appeared in the London-based British series of the same name. The American version of the reality show premiered on Fox on May 20, 2005, and the first 18 seasons were produced at a modified warehouse in Los Angeles that included the restaurant, dual kitchen facilities and a dormitory where the contestants resided. In February 2019, Fox renewed the series for a nineteenth and twentieth season, with both seasons filmed at the Hell's Kitchen restaurant in Las Vegas, Nevada. ", "prediction 1": "Hell's Kitchen is an American reality competition television series based on the British series of the same name. The show is taped in Los Angeles at KCOP, in a converted former television broadcast facility that previously hosted shows such as \"The Joker's Wild\" and \"Tic-Tac-Dough\" in the late 1970s to mid-1980s. The show is produced at Hell's Kitchen, a modified warehouse in Los Angeles that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show.", "prediction 2": "Hell's Kitchen is an American reality competition television series that is based on the British series of the same name. Produced at Hell's Kitchen, a modified warehouse in Los Angeles that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show. The show was taped in Los Angeles at KCOP, in a converted former television broadcast facility that previously hosted shows such as The Joker's Wild and Tic-Tac-Dough in the late 1970s to mid-1980s to the late 1970s and Tic-Tic-Tac-Tac-Dough in the late 1970s to mid-1980s.", "prediction 3": "Hell's Kitchen is an American reality competition television series based on the British series of the same name. The show is produced at Hell's Kitchen, a modified warehouse in Los Angeles that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show.", "prediction 4": "Hell's Kitchen is an American reality competition television series based on the British series of the same name. The show is produced at Hell's Kitchen, a modified warehouse in Los Angeles that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show. The show is taped in Los Angeles at KCOP, in a converted former television broadcast facility that previously hosted shows such as \"The Joker's Wild\" and \"Tic-Tac-Dough\" in the late 1970s to mid-1980s.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 315 }, { "error type": "Redundant", "explanation": "The show is taped in Los Angeles at KCOP, ", "start": 377, "end": 391 }, { "error type": "Redundant", "explanation": "The show is taped in Los Angeles at KCOP", "start": 316, "end": 336 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Hell's Kitchen is an American reality competition television series based on the British series of the same name. It is hosted by celebrity chef Gordon Ramsay. The show is taped in Los Angeles at KCOP, in a converted former television broadcast facility. The facility, Hell's Kitchen, is a modified warehouse that includes the restaurant, dual kitchen facilities and a dormitory where the chefs reside while on the show." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who does scars voice in the lion king?", "passages": [ [ "The Lion King II: Simba's Pride", "Most of the original cast returned to their roles from the first film, apart from Rowan Atkinson, who was replaced by Edward Hibbert as the voice of Zazu for this film and its prequel/sequel, \"The Lion King 1\u00bd\" and Jeremy Irons, who was briefly replaced by Jim Cummings as the voice of Scar.", "In the Pride Lands of Africa, King Simba and Queen Nala's newborn daughter, Kiara, is presented to the assembled animals by Rafiki, a baboon who serves as shaman and advisor.", "Simba's father Mufasa proudly watches over the ceremony from the Heavens above.", "Kiara becomes annoyed with her father's overprotective parenting.", "Simba assigns Timon and Pumbaa, a meerkat and warthog, to follow her.", "After entering the forbidden \"Outlands,\" Kiara meets a young cub, Kovu, and they escape from crocodiles while befriending each other.", "When Kovu retaliates to Kiara's playing, Simba confronts the young cub just as he is confronted by Zira, Kovu's mother and the Outsiders' leader.", "Zira reminds Simba of how he exiled her and the other Outsiders, and she reveals that she selected Kovu to be Scar's successor." ], [ "The Lion King (2019 film)", "The Lion King (2019 film)\n\n", "The Lion King is an upcoming American drama film directed by Jon Favreau and produced by Walt Disney Pictures.", "It is a photorealistic computer animated remake of Disney's traditionally animated 1994 film of the same name.", "The film features the voices of Donald Glover, Seth Rogen, Chiwetel Ejiofor, Billy Eichner, John Oliver, Keegan-Michael Key, Beyonc\u00e9 Knowles-Carter, and James Earl Jones.", "Plans for a remake of \"The Lion King\" were confirmed in September 2016 following the success of Favreau's \"The Jungle Book\".", "Much of the main cast signed in early 2017 and principal photography began in mid-2017 on a blue screen stage in Los Angeles.", "The film is scheduled to be released on July 19, 2019.", "Additionally, John Kani voices Rafiki, a wise mandrill who serves as the shaman of the Pride Lands and a close friend of Mufasa's.", "Florence Kasumba and Eric Andre portray as Shenzi and Azizi, two hyenas and Scar's henchmen.", "While Shenzi is a character that featured in the original film, Azizi replaces Ed from the original film.", "Alfre Woodard voices Sarabi, queen of the Pride Lands, Mufasa's mate, and Simba's mother." ], [ "The Lion King (franchise)", "The Lion King (franchise)\n\nThe Lion King is a Disney media franchise comprising a film series and additional media.", "The success of the original 1994 American animated feature, \"The Lion King\", directed by Roger Allers and Rob Minkoff, led to two direct-to-video sequel films, a television film sequel, two spin-off television series, three educational shorts, several video games, merchandise, and the third-longest-running musical in Broadway history, which garnered six Tony Awards including Best Musical.", "The franchise as a whole has EGOT-ed, meaning it has won the four biggest awards of American show business.", "The franchise mainly revolves about a pride of lions who oversee a large swath of African savanna as their \"kingdom\" known as the Pride Lands, with their leader Simba watching over it as \"king\".", "The first three animated films are widely known for being influenced by the works of William Shakespeare, as well as other works based on his material.", "\"The Lion King\" is the original film of the franchise.", "It was directed by Roger Allers and Rob Minkoff.", "It was produced by Walt Disney Feature Animation, premiered in selected cities on June 15, 1994, and widely released to theaters on June 24, 1994 by Walt Disney Pictures.", "\"The Lion King\" is the 32nd Disney animated feature film and belongs to an era known as the Disney Renaissance." ] ], "gold": "In the 1994 Lion King American animated film produced by Walt Disney Feature Animation and released by Walt Disney Pictures Jeremy Irons lent his distinctive voice to the character of Scar. In the musical version of The Lion King which debuted on July 8, 1997 in Minneapolis, Minnesota at the Orpheum Theatre and later premiered on Broadway at the New Amsterdam Theatre on October 15, 1997, John Vickery played Scar. James Jonah Cummings played the voice of Scar in a brief nightmare sequence in The Lion King II: Simba's Pride in 1998 and he also took over for Jeremy Irons, in the 1994 Lion King film, when he developed vocal problems during recording of the song \"Be Prepared.\" In the 2019 American musical computer-animated drama film directed and produced by Jon Favreau, and Walt Disney Pictures, Chiwetel Ejiofor plays the voice of Scar.", "prediction 1": "Scar is a character that appears in multiple films of The Lion King franchise, including The Lion King and The Lion King II, in which he is voiced by Jim Cummings. Scar is also voiced by Edward Hibbert in The Lion King 112 and by Jeremy Irons in The Lion King.", "prediction 2": "Scar is a character in The Lion King, a Disney movie franchise consisting of a film series and additional media. Jim Cummings voices Scar in the upcoming 2019 film, The Lion King 2: The Rebirth of Simba, while John Kani voices Rafiki, a wise mandrill who serves as the shaman of the Pride Lands and a close friend of Mufasa's. Additionally, Florence Kasumba and Eric Andre portray Shenzi and Azizi, two hyenas and Scar's henchmen. Jim Cummings voices Scar in The Lion King 2: Simba Return of Simba's Pride Lands, and Scar is Simba's successor.", "prediction 3": "Scar is the character voiced by Jim Cummings in the Lion King film series. Jim Cummings voices Scar in the film's prequel/sequel, The Lion King 112 and The Lion King 2019. Jim Cummings voices Scar in the 2019 remake of The Lion King, a photorealistic computer animated remake of Disney's 1994 animated film of the same name. Edward Hibbert voices Scar.", "prediction 4": "Scar appears in two films in The Lion King franchise, The Lion King II: Zazu and The Lion King 112. Jim Cummings voices Scar in both films, while Jeremy Irons voices Scar's voice in The Lion King III: Simba's Pride.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 226 } ], "missing-info": [], "corrected-prediction": "Scar is a character that appears in multiple films of The Lion King franchises including The Lion King II, in which he is voiced by Jim Cummings. Scar is voiced by Jeremy Irons in The Lion King." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When did the first buc ee's open?", "passages": [ [ "Buc-ee's", "Buc-ee's\n\nBuc-ee's is a chain of convenience stores located in the Central, North, South, and Southeast regions of Texas The company is owned by Arch \"Beaver\" Aplin III and Don Wasek and has its headquarters in Lake Jackson, Texas.", "The chain is known for its very large-format stores (relative to other convenience stores) and a logo depicting a beaver.", "Co-Founders \"Beaver\" Aplin and Don Wasek opened the first store, which is still open as of 2017, in Lake Jackson, Texas in 1982.", "Aplin formed the name Buc-ee's by combining his childhood nickname; the name of his Labrador Retriever, Buck; as well as the appeal of Ipana toothpaste's animated mascot, Bucky the beaver.", "Buc-ee's expanded and opened their first travel center in Luling, Texas in 2001.", "Buc-ee's are large stores (no 18 wheelers allowed) with fuel pumps that range from 80-120 fueling positions for gas and diesel (some stores include Ethanol Free and DEF) and a huge selection of beef jerky, pastries, fresh sandwiches, tacos, Dippin' Dots and homemade fudge.", "In 2012, Buc-ee's opened its largest travel center in New Braunfels, Texas on Interstate 35." ] ], "gold": "Co-Founders Don Wasek and Arch \"Beaver\" Aplin opened their first Buc-cee's convenience store in Clute, Texas in 1982. In 2001, Buc-ee's expanded and opened its first travel center in Luling, Texas.", "prediction 1": "Buc-ee's is a convenience store chain that is based in the Central, North, South, and Southeast regions of Texas. The first Buc-ee's opened in Lake Jackson, Texas in 1982. The company is owned by Arch \"Beaver\" Aplin III and Don Wasek and has its headquarters in Lake Jackson, Texas. The company expanded and opened their first travel center in Luling, Texas in 2001. In 2012, Buc-ee's opened its largest travel center in New Braunfels, Texas on Interstate 35.", "prediction 2": "Buc-ee's is a chain of convenience stores located in the Central, North, South, and Southeast regions of Texas. The company is owned by Arch \"Beaver\" Aplin III and Don Wasek and has its headquarters in Lake Jackson, Texas. The first Buc-ee's opened in Lake Jackson, Texas in 1982. In 2001, Buc-ee's expanded and opened their first travel center in Luling, Texas.", "prediction 3": "Buc-ee's is a convenience store chain located in the Central, North, South, and Southeast regions of Texas. The first Buc-ee's opened in Lake Jackson, Texas in 1982. The company is owned by Arch \"Beaver\" Aplin III and Don Wasek and has its headquarters in Lake Jackson, Texas. Buc-ee's expanded and opened their first travel center in Luling, Texas in 2001.", "prediction 4": "Buc-ee's is a chain of convenience stores located in the Central, North, South, and Southeast regions of Texas. The company is owned by Arch \"Beaver\" Aplin III and Don Wasek and has its headquarters in Lake Jackson, Texas. The company formed the name Buc-ee's by combining his childhood nickname, the name of his Labrador Retriever, Buck, as well as the appeal of Ipana toothpaste's animated mascot, Bucky the beaver. Buc-eee's expanded and opened their first travel center in Luling, Texas in 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 172, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 459 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Co-Founders \"Beaver\" Aplin and Don Wasek opened the first Buc-cee's store in Lake Jackson, Texas in 1982. The company expanded and opened their first travel center in Luling, Texas in 2001. " }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "When was the last time minimum wage increased in ontario?", "passages": [ [ "Poverty in Canada", "Low-income Canadians are eligible for the Canada Child Tax Benefit (a federal benefit), and provincial child tax credits or benefits and Qu\u00e9bec family allowances.", "For example, Ontario pays a benefit scheduled to grow to $180 per month by 2011 for a family earnings less than $20,000 with two children.", "These credits are not taxed (see Income taxes in Canada#Income not taxed).", "Under the Constitution of Canada, the responsibility for enacting and enforcing labour laws including minimum wages in Canada rests with the ten provinces, the three territories also having been granted this power by virtue of federal legislation.", "This means that each province and territory has its own minimum wage.", "The lowest general minimum wage currently in force is that of the Nova Scotia ($10.85/hour), the highest is that of Ontario ($14.00/hour).", "Some provinces allow lower wages to be paid to liquor servers and other tip earners, and/or to inexperienced employees\n\nAlthough listed here under assistance, some theories suggest that minimum wage laws are a net detriment to low-income people as a whole, because they reduce the attractiveness of hiring low-skilled staff (\"see Minimum wage#Debate over consequences\")." ], [ "Ontario government debt", "Ontario government debt\n\nThe Ontario government debt is the net amount of money the Government of Ontario has borrowed from the general public, institutional investors and public-sector bodies.", "As of March 31, 2018, the Ontario government's total debt is projected to be CDN$348.79 billion.", "The Debt-to-GDP ratio for 2017-2018 is 37.1% and interest on the debt is CDN$11.97 billion, representing 8.0% of Ontario's revenue and its fourth-largest spending area.", "As of March 31, 2018 the breakdown of Ontario's debt is as follows:\n\n\n", "The majority of the debt (83.1%) was issued in Canadian currency.", "The government of Ontario's debt has risen under all governments since 1989.", "During the 1990s recession, the Ontario New Democratic Party (NDP) government of Premier Bob Rae increased the total debt from $35.4 billion in 1989-1990 to $90.7 billion in 1994-1995.", "The Progressive Conservative government of Premier Mike Harris increased the debt from $90.7 billion in 1994-1995 to $132.6 billion in 2002-2003, even while cutting services and downloading formerly provincially-run services onto the municipalities.", "In the same period, the Liberal federal government cut transfers to the provinces." ] ], "gold": "Under the Constitution of Canada, the responsibility for enacting and enforcing labour laws, including the minimum wage, rests primarily with the ten provinces. In Ontario, the last time a minimum wage increase went into effect was on January 1, 2018. The last time a minimum wage increase was passed in Ontario was June 7, 2018.", "prediction 1": "The last time minimum wage in Ontario was increased was in 1994.", "prediction 2": "Minimum wage in Ontario has increased periodically since 1989, with the lowest general minimum wage currently in force in Nova Scotia being $10.85/hour and the highest in Ontario being $14.00/hour.", "prediction 3": "The last time minimum wage increased in Ontario was in 2016. The last time the minimum wage was increased in Ontario was in 2015. The last time the minimum wage was increased in Ontario was in 2015.", "prediction 4": "Minimum wage in Ontario was last increased in Ontario in 1994-1995. The last time minimum wage increased in Ontario was in 2002-2003.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 64 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Under the Constitution of Canada, the responsibility for enacting and enforcing labour laws including minimum wages in Canada rests with the ten provinces. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "What can be used as proof of identity?", "passages": [ [ "ACT Proof of Identity Card", "ACT Proof of Identity Card\n\nThe Australian Capital Territory Proof of Identity Card is a voluntary identity photo card available to all residents of the Australian Capital Territory (ACT), Australia The purpose is mainly to access restricted services for people over the age of 18 or to prove identity for those without a driver's licence." ], [ "Identity documents in the United States", "Identity documents in the United States\n\nIdentity documents in the United States are typically the regional state-issued drivers license or identity card, while also the Social Security card (or just the Social Security number) and the United States Passport Card may serve as national identification.", "The United States passport itself also may serve as identification.", "However there is no official \"national identity card\" in the United States, in the sense that there is no federal agency with nationwide jurisdiction that directly issues an identity document to all US citizens for mandatory regular use.", "There have been proposals to nationalize ID cards, as currently citizens are identified by a patchwork of documents issued by both the federal government as well as individual state and local governments.", "It is both a political issue and a practical one, and the idea of federalism is cited as supporting federated (regional) identification.", "All legislative attempts to create a national identity card have failed due to tenacious opposition from liberal and conservative politicians alike, who regard the national identity card as the mark of a totalitarian society.", "At present, the only national photo identity documents are the passport and passport card, which are issued by the U.S. Department of State to U.S. nationals only upon voluntary application.", "Issuance of these documents is discretionary - that is, for various reasons, the State Department can refuse an application for a passport or passport card." ] ], "gold": "Identity documents in the United States are typically the regional state-issued driver's license or identity card, while also the Social Security card and US Passport Card may serve as national identification. The United States passport itself also may serve as identification. In Australia, the Australian Capital Territory Proof of Identity Card is a voluntary identity photo card available to all residents of the Australian Capital Territory, Australia The purpose is mainly to access restricted services for people over the age of 18 or to prove identity for those without a driver's license.", "prediction 1": "The purpose of the ACT Proof of Identity Card is mainly to access restricted services for people over the age of 18 or to prove identity for those without a driver's licence.", "prediction 2": "Identity documents in the United States are typically the regional state-issued drivers licence or identity card, while also the Social Security card and the United States Passport Card may serve as national identification. The United States passport itself also may serve as identification. However there is no official \"national identity card\" in the United States, in the sense that there is no federal agency with nationwide jurisdiction that directly issues an identity document to all US citizens for mandatory regular use.", "prediction 3": "Identity documents in the United States are typically the regional state-issued drivers license or identity card, while also the Social Security card (or just the Social Security number) and the United States Passport Card may serve as national identification. The United States passport itself also may serve as identification. However, there is no official \"national identity card\" in the United States, in the sense that there is no federal agency with nationwide jurisdiction that directly issues an identity document to all US citizens for mandatory regular use.", "prediction 4": "Identity documents in the United States are typically the regional state-issued drivers license or identity card, while also the Social Security card and the United States Passport Card may serve as national identification. The United States passport itself also may serve as identification. However there is no official \"national identity card\" in the United States, in the sense that there is no federal agency with nationwide jurisdiction that directly issues an identity document to all US citizens for mandatory regular use.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Australian Capital Territory Proof of Identity Card is a voluntary identity photo card available to all residents of the Australian Capital Territory (ACT), Australia. The purpose of the ACT Proof of Identity Card is mainly to access restricted services for people over the age of 18 or to prove identity for those without a driver's license. Identity documents in the United States are typically the regional state-issued drivers license or identity card, while also the Social Security card and the United States Passport Card may serve as national identification. The United States passport itself also may serve as identification." }, "preference": [ 2, 2, 2, 2, 0, 1 ] }, { "question": "Who plays the goddess of love in gods of egypt?", "passages": [ [ "Gods of Egypt (film)", "Gods of Egypt (film)\n\nGods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities.", "It stars Nikolaj Coster-Waldau, Gerard Butler, Brenton Thwaites, Chadwick Boseman, \u00c9lodie Yung, Courtney Eaton, Rufus Sewell and Geoffrey Rush.", "The film portrays a mortal Egyptian hero who partners with the Egyptian god Horus to save the world from Set and rescue his love.", "Filming took place in Australia under the American film production and distribution company Summit Entertainment.", "While the film's production budget was the parent company Lionsgate's financial exposure was less than $10 million due to tax incentives and pre-sales.", "The Australian government provided a tax credit for 46% of the film's budget.", "When Lionsgate began promoting the film in November 2015, it received backlash for its predominantly white cast playing Egyptian deities.", "In response, Lionsgate and director Proyas apologized for ethnically-inaccurate casting.", "Lionsgate released \"Gods of Egypt\" in theaters globally, starting on , 2016, in 2D, RealD 3D, and IMAX 3D, and in the United States, Canada, and 68 other markets on .", "The film was poorly reviewed by critics, who criticized its choice of cast, script, acting and special effects." ], [ "\u00c9lodie Yung", "\u00c9lodie Yung\n\n\u00c9lodie Yung (; born February 22, 1981) is a French actress.", "She is best known for her role as Elektra Natchios in the second season of the Marvel Cinematic Universe Netflix series \"Daredevil\" and the Netflix miniseries \"The Defenders.", "Yung was born in Paris, on February 22, 1981.", "Her father is Cambodian and her mother is French.", "She grew up in Seine-Saint-Denis.", "Her father enrolled her in karate classes at age 9, and she eventually became a black belt in her late teens.", "Yung earned a law degree at the University of Paris with the intention of becoming a judge.", "However, at the age of 29, she instead pursued acting at the London Academy of Music and Dramatic Art.", "Yung's first roles were on TV after she started receiving acting role proposals when she was 20 years old.", "Following her 2004 film debut as female lead Tsu in , she played the gang lord Tao in \"\".", "Yung returned to TV for the first three seasons of the successful police series, with .", "Yung appeared in the 2011 film \"The Girl with the Dragon Tattoo\" as Miriam Wu, a romantic interest of Lisbeth Salander.", "In 2013, she appeared on the silver screen as the ninja Jinx in \"\"." ], [ "Gods of Egypt (film)", "The other gods, who had not passed into the afterlife, are also revived leaving Horus's parents who had already passed into the afterlife.", "Horus is crowned king by Thoth and declares access to the afterlife will be paid with good deeds.", "Bek is made chief advisor, and he gives Horus back Hathor's bracelet letting him leave to rescue her from the underworld.", "\"Gods of Egypt\" is directed by Alex Proyas based on a screenplay by Matt Sazama and Burk Sharpless.", "The film was produced under Summit Entertainment.", "Proyas was contracted by Summit in May 2012, to write the screenplay with Sazama and Sharpless, and to direct the film.", "Proyas said he sought to make a big-budget film with an original premise, to contrast franchise films.", "The director cited the following films as influences on \"Gods of Egypt\": \"The Guns of Navarone\" (1961), \"Lawrence of Arabia\" (1962), \"The Man Who Would Be King\" (1975), \"Raiders of the Lost Ark\" (1981), and Sergio Leone's Western films.", "Lionsgate anticipated that \"Gods of Egypt\" would be the first film in a new franchise after it finished releasing \"The Hunger Games\" films.", "Actor Nikolaj Coster-Waldau was cast in June 2013." ] ], "gold": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities. French actress \u00c9lodie Yung plays Hathor, Goddess of Love, in the film.", "prediction 1": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities. It stars Nikolaj Coster-Waldau, Gerard Butler, Brenton Thwaites, Chadwick Boseman, \u00c9lodie Yung, Rufus Sewell, Geoffrey Rush and Chadwick Boseman. The film portrays a mortal Egyptian hero who partners with the Egyptian god Horus to save the world from Set and rescue his love.", "prediction 2": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities. The film stars Nikolaj Coster-Waldau, Gerard Butler, Brenton Thwaites, Chadwick Boseman, \u00c9lodie Yung, Rufus Sewell and Geoffrey Rush.", "prediction 3": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities. It stars Gerard Butler, Brenton Thwaites, Chadwick Boseman, \u00c9lodie Yung, Rufus Sewell, and Geoffrey Rush. Yung, who plays Elektra Natchios, plays the goddess of love in the film.", "prediction 4": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities. It stars Nikolaj Coster-Waldau, Gerard Butler, Brenton Thwaites, Chadwick Boseman, \u00c9lodie Yung, Rufus Sewell and Geoffrey Rush. In the film, the goddess of love is played by French actress Miriam Wu.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 382 } ], "missing-info": [], "corrected-prediction": "Gods of Egypt is a 2016 fantasy action film directed by Alex Proyas based on the ancient Egyptian deities." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who is the current lieutenant governor of saskatchewan?", "passages": [ [ "Lieutenant Governor of Saskatchewan", "Lieutenant Governor of Saskatchewan\n\nThe Lieutenant Governor of Saskatchewan is the viceregal representative in Saskatchewan of the , who operates distinctly within the province but is also shared equally with the ten other jurisdictions of Canada, as well as the other Commonwealth realms and any subdivisions thereof, and resides predominantly in oldest realm, the United Kingdom.", "The Lieutenant Governor of Saskatchewan is appointed in the same manner as the other provincial viceroys in Canada and is similarly tasked with carrying out most of the monarch's constitutional and ceremonial duties.", "The present, and 22nd, Lieutenant Governor of Saskatchewan is W. Thomas Molloy, who has been in the role since 21 March 2018.", "The Lieutenant Governor of Saskatchewan is vested with a number of governmental duties and is also expected to undertake various ceremonial roles.", "For instance, the lieutenant-governor acts as patron, honorary president, or an honorary member of certain Saskatchewan institutions, such as the Saskatchewan Music Festival Association, the Saskatchewan Craft Council, and the provincial poet laureate program.", "Further, Saskatchewan's lieutenant-governor acts, by law, as the visitor to both the University of Saskatchewan and the University of Regina, and under special circumstances may be called upon in this role, as happened in the University Crisis of 1919 at the University of Saskatchewan." ], [ "Vaughn Solomon Schofield", "Vaughn Solomon Schofield\n\nVaughn Solomon Schofield, (born October 25, 1943) was the 21st Lieutenant Governor of Saskatchewan, from 2012 to 2018.", "Her appointment as Lieutenant Governor was made by Governor General of Canada David Lloyd Johnston on the Constitutional advice of Prime Minister of Canada Stephen Harper on March 6, 2012, to succeed Gordon Barnhart.", "Solomon Schofield was sworn in on March 22, 2012 at the Legislative Assembly of Saskatchewan.", "She is the viceregal representative of Queen Elizabeth II of Canada in the Province of Saskatchewan.", "Solomon Schofield is a strong supporter of the Canadian Forces, and stated during her installation that the military will be her focus during her term.", "Her affection for the Forces stemmed from her time as Provincial Chair of the Canadian Forces Liaison Council, a position she was appointed to in January 2006.", "Solomon Schofield is also Honorary Colonel of 38 Service Battalion, which is part of 38 Canadian Brigade Group.", "Solomon Schofield was born in Regina, but has most recently resided in Regina Beach, Saskatchewan.", "She was educated at the University of Saskatchewan, Regina Campus and the Ray-Vogue School in Chicago, where she earned a degree in Fashion Merchandising." ] ], "gold": "The Lieutenant Governor of Saskatchewan is the viceregal representative in Saskatchewan of the Canadian monarch, Queen Elizabeth II, who operates distinctly within the province but is also shared equally with the ten other jurisdictions of Canada, as well as the other Commonwealth realms and any subdivisions thereof, and resides predominantly in her oldest realm, the United Kingdom. Gordon L. Barnhart became Lieutenant Governor of Saskatchewan on 1 August 2006. Vaughn Solomon Schofield became Lieutenant Governor of Saskatchewan on 22 March 2012. W. Thomas Molloy became Lieutenant Governor of Saskatchewan on 21 March 2018.", "prediction 1": "The current Lieutenant Governor of Saskatchewan is W. Thomas Molloy. The present, and 22nd, Lieutenant Governor of Saskatchewan is Vaughn Solomon Schofield, who was the 21st Lieutenant Governor of Saskatchewan, from 2012 to 2018. The 22nd Lieutenant Governor of Saskatchewan is Vaughn Solomon Schofield, who was sworn in on March 22, 2012, to succeed Gordon Barnhart.", "prediction 2": "The Lieutenant Governor of Saskatchewan is the viceregal representative in Saskatchewan of the Canadian monarch, who operates distinctly within the province but is also shared equally with the ten other jurisdictions of Canada, as well as the other Commonwealth realms and any subdivisions thereof, and resides predominantly in oldest realm, the United Kingdom. The present, and 22nd, Lieutenant Governor of Saskatchewan is W. Thomas Molloy, who has been in the role since 21 March 2018. Vaughn Solomon Schofield was the 21st Lieutenant Governor of Saskatchewan from 2012 to 2019. She was sworn in on March 22, 2012, to succeed Gordon Barnhart.", "prediction 3": "The present and 22nd Lieutenant Governor of Saskatchewan is W. Thomas Molloy, who has been in the role since 21 March 2018. The 21st and 22nd Lieutenant Governors of Saskatchewan were Vaughn Solomon Schofield, Vaughn Solomon Schofield, and Gordon Barnhart.", "prediction 4": "There have been several Lieutenant Governors of Saskatchewan. The 21st Lieutenant Governor was Vaughn Solomon Schofield, who served from 2012 to 2018. The 22nd was W. Thomas Molloy, who has been in the role since March 21, 2018.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 131, "end": 156 }, { "error type": "Redundant", "explanation": "The present, and 22nd, Lieutenant Governor of Saskatchewan is Vaughn Solomon Schofield,", "start": 230, "end": 303 }, { "error type": "Redundant", "explanation": "The current Lieutenant Governor of Saskatchewan is W. Thomas Molloy. ", "start": 73, "end": 127 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Lieutenant Governor of Saskatchewan is the viceregal representative in Saskatchewan, who operates distinctly within the province but is also shared equally with the ten other jurisdictions of Canada, as well as the other Commonwealth realms and any subdivisions thereof, and resides predominantly in oldest realm, the United Kingdom. The current Lieutenant Governor of Saskatchewan is W. Thomas Molloy, who has been in the role since 21 March 2018. Vaughn Solomon Schofield was the 21st Lieutenant Governor of Saskatchewan, from March 22 2012. Gordon Barnhart was the Lieutenant Governor before her." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is the airport code for abu dhabi?", "passages": [ [ "Abu Dhabi International Airport", "Abu Dhabi International Airport\n\nAbu Dhabi International Airport () is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates.", "The airport, located east of Abu Dhabi city, is the second largest in the UAE, serving around 20 million passengers in 2014.", "It has three operational passenger terminals\u2014Terminal 1 (divided into Terminals 1A and 1B), Terminal 2, Terminal 3.", "Abu Dhabi International Airport is spread over an area of .", "Its terminal spaces are dominated by Etihad Airways, which is the United Arab Emirates' national carrier and second largest in the UAE after Emirates.", "More than 30 airlines offered service to over 120 destinations in more than 60 countries.", "The airport was first conceived in 1974, in response to the government's plans to modernize the then brand new nation.", "At the time, Al Bateen Airport (then called Abu Dhabi International Airport) was the main international airport serving the city.", "Sheikh Zayed bin Sultan Al Nahyan had realized that it was hard to access the airport, as it was located on Abu Dhabi Island and that the island at the time was connected to the mainland by only one bridge.", "Also, the city was expanding at the time, making it harder for the airport to expand.", "During the late 1970s, a location for the building site was strategically located, so it could be easily accessible." ] ], "gold": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. The IATA airport code for Abu Dhabi International Airport is AUH. The IACO airport code for Abu Dhabi International Airport is OMAA.", "prediction 1": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. It is located east of Abu Dhabi city. It is the second largest in the UAE, serving around 20 million passengers in 2014.", "prediction 2": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. It is the second largest in the UAE, serving around 20 million passengers in 2014. The airport's code is ABJ, and the airport is located east of Abu Dhabi city. The airport was first conceived in 1974, in response to the government's plans to modernize the then brand new nation. At the time, Al Bateen Airport, which was then called Abu Dhabi International Airport, was the main international airport serving the city.", "prediction 3": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. It is located east of Abu Dhabi city and is the second largest in the UAE, serving around 20 million passengers in 2014. The airport has three operational passenger terminals\u2014Terminal 1 (divided into Terminals 1A and 1B), Terminal 2 and Terminal 3.", "prediction 4": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. At the time, Al Bateen Airport (then called Abu Dhabi International Airport) was the main international airport serving the city. As a result, Sheikh Zayed bin Sultan Al Nahyan decided to build a new airport for the city.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 250 } ], "missing-info": [], "corrected-prediction": "Abu Dhabi International Airport is an international airport in the Emirate of Abu Dhabi, the capital of the United Arab Emirates. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who plays the mayor in hart of dixie?", "passages": [ [ "Hart of Dixie", "Hart of Dixie\n\nHart of Dixie is an American comedy-drama television series that aired on The CW from September 26, 2011 to March 27, 2015.", "The series, created by Leila Gerstein, stars Rachel Bilson as Dr. Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama.", "The show also stars a pet alligator named Burt Reynolds.", "On September 26, 2011, \"Hart of Dixie\" premiered.", "The show was scheduled to move back to Mondays in the fall for its third season having been paired with \"Beauty & the Beast\".", "The show's third season premiered on October 7, 2013.", "On May 8, 2014, the CW renewed the show for its fourth season.", "On July 18, 2014, CW president Mark Pedowitz announced that \"Hart of Dixie\" would have ten episodes for its fourth season, which premiered on December 15, 2014.", "On March 14, 2015, Leila Gerstein revealed that season four of \"Hart of Dixie\" would be its last.", "The CW officially cancelled the show on May 7, 2015." ], [ "Alan Autry", "Alan Autry\n\nCarlos Alan Autry Jr. (also known for a period of time as Carlos Brown; born July 31, 1952), is an American actor, politician, and former National Football League player.", "During his brief football career, he was known as Carlos Brown.", "He played the role of Captain Bubba Skinner on the NBC television series, \"In the Heat of the Night\", starring Carroll O'Connor.", "He has also appeared in films and other television shows.", "In November 2000, he was elected mayor of Fresno, California, and served for two four-year terms through January 2009.", "In 2008, Autry was hosting a radio news talk show on KYNO AM 940 in Fresno, but left the station in 2011.", "Autry was born in Shreveport, Louisiana, the son of Carl and Verna (n\u00e9e Brown) Autry.", "His name was changed to Carlos Brown when he was a year old, after his parents divorced.", "Autry is a distant cousin of Gene Autry.", "He worked alongside his mother and stepfather, Joe Duty, in California's San Joaquin Valley, where they planted and harvested cotton, grapes, and other crops.", "They traveled around the valley living in migrant worker camps.", "When he was twelve, they settled in Riverdale, California.", "In high school, he was a star quarterback for the Riverdale Cowboys." ], [ "Hart of Dixie", "Her role was later confirmed by The CW in a press release.", "Soon after, Wilson Bethel joined the cast as Wade Kinsella, Zoe's \"gorgeous bad-boy\" neighbor.", "Scott Porter was later cast as good-looking lawyer George Tucker, a potential love-interest for Bilson's character.", "On May 20, 2011, it was announced that Nancy Travis would not continue with the series due to her commitments with the 20th Century Fox-produced ABC sitcom \"Last Man Standing\".", "Travis was written out after the first two episodes.", "Meredith Monroe appeared in one episode as Lemon's estranged mother.", "JoBeth Williams appeared in three episodes as Candice Hart, the mother of Bilson's character.", "On July 26, 2013, it was announced that Kaitlyn Black was upgraded to series regular status for season three.", "\"Hart of Dixie\" first season has received mixed reviews, scoring a 43 out of 100 on the review aggregator Metacritic.", "TVGuide.com described the show as \"\"Southern Exposure\"\" and, in a later review, stated that the actors are better than the \"cutesy\" material, although Bilson is not convincing as a heart surgeon.", "Both TVGuide.com and Robert Bianco of \"USA Today\" stated that the show is potentially offensive to the South." ] ], "gold": "Hart of Dixie is an American comedy-drama television series that aired on The CW from September 26, 2011, to March 27, 2015. The series, created by Leila Gerstein, stars Rachel Bilson as Dr. Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama. Cress Williams plays the mayor, and Alan Autry plays the mayor of the rival town Fillmore, AL. ", "prediction 1": "Hart of Dixie is an American comedy-drama television series created by Leila Gerstein. The show stars Rachel Bilson as Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama. American actor, politician, and former National Football League player Carlos Alan Autry plays the role of Mayor Bubba Skinner on the NBC television series, In the Heat of the Night.", "prediction 2": "Hart of Dixie is an American comedy-drama television series created by Leila Gerstein. The show stars Rachel Bilson as Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama. American actor, politician, and former National Football League player Carlos Autry plays the mayor of Fresno, California, in the first three seasons.", "prediction 3": "Hart of Dixie is an American comedy-drama television series that aired on The CW from September 26, 2011 to March 27, 2015. American actor, politician, and former National Football League player Carlos Autry played the role of Mayor John Lemon in the first two seasons, and American journalist and author JoBeth Williams played the role of Candice Hart in the third season.", "prediction 4": "Hart of Dixie is an American comedy-drama television series created by Leila Gerstein and aired on The CW from September 26, 2011 to March 27, 2015. The show stars Rachel Bilson as Dr. Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama. In November 2000, Carlos Alan Autry Jr. was elected mayor of Fresno, California, and served for two four-year terms through January 2009 and again in November 2003.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 492 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Hart of Dixie is an American comedy-drama television series created by Leila Gerstein that aired on The CW from September 26, 2011 to March 27, 2015. The show stars Rachel Bilson as Zoe Hart, a New Yorker who, after her dreams of becoming a heart surgeon fall apart, accepts an offer to work as a general practitioner in the fictional Gulf Coast town of Bluebell, Alabama. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Tourist visit the golden temple in this state?", "passages": [ [ "Golden Temple", "Golden Temple\n\nThe Golden Temple, also known as Darbar Sahib ( or Sri Harmandir Sahib (\"abode of God\"), \"exalted holy court\"), is a Gurdwara located in the city of Amritsar, Punjab, India.", "It is the holiest Gurdwara and the most important pilgrimage site of Sikhism.", "The temple is built around a man-made pool (\"sarovar\") that was completed by Guru Ram Das in 1577.", "Guru Arjan \u2013 the fifth Guru of Sikhism, requested Sai Mian Mir \u2013 a Muslim Pir of Lahore to lay its foundation stone in 1589.", "In 1604, Guru Arjan placed a copy of the Adi Granth in Harmandir Sahib, calling the site \"Ath Sath Tirath\" (lit.", "\"shrine of 68 pilgrimages\").", "The temple was repeatedly rebuilt by the Sikhs after it became a target of persecution and was destroyed several times by the Muslim armies from Afghanistan and the Mughal Empire.", "The army led by Ahmad Shah Abdali, for example, demolished it in 1757 and again in 1762, then filled the pool with garbage.", "Maharaja Ranjit Singh after founding the Sikh Empire, rebuilt it in marble and copper in 1809, overlaid the sanctum with gold foil in 1830.", "This has led to the name the Golden Temple." ], [ "Golden Temple, Sripuram", "Golden Temple, Sripuram\n\nThe golden temple complex inside the Sripuram spiritual park is situated at the foot of a small range of green hills at Thirumalaikodi (or simply Malaikodi) village, 8 km from Vellore in Tamil Nadu, India.", "It is 120 km from Tirupati, 145 km from Chennai, 160 km from Puducherry and 200 km from Bengaluru.", "The Maha Kumbhabhishekam or consecration of the temple and its chief deity, Sri Lakshmi Narayani or Maha Lakshmi, the goddess of wealth, was held on 24 August 2007, and devotees from all religions and backgrounds are welcome to visit.", "This temple is gilded with 1500 kg of pure gold, double the 750 kg gilding of the dome of the Golden Temple at Amritsar.", "The salient feature of 'Sripuram' is the Lakshmi Narayani temple whose Vimanam and Ardha Mandapam is covered with pure gold, housing the deity Sri Lakshmi Narayani (female consort of Vishnu Narayana).", "The temple is located on 100 acres of land and has been constructed by the Vellore-based charitable trust, Sri Narayani Peedam, headed by its spiritual leader Sri Sakthi Amma also known as 'Narayani Amma'." ], [ "Golden Temple Park", "Golden Temple Park\n\nThe Golden Temple Park, or Jindian Park (), is a Taoist bronze-tiled temple in Yunnan, China and has been preserved almost completely since it was first built.", "It is located on the Mingfeng Mountains, seven kilometres to the east of Kunming city, there is a fine building made of bronze.", "It is commonly known as \"Jindian\" (the \"Golden Temple\").", "The Golden Temple was first built in 1602 during the Ming dynasty.", "Yunnan was ordered to send the bronze ore from Dongchuan to central China to make coins.", "But a war blocked the road.", "The governor of Yunnan, Chen Yongbing, and Mu Changzuo, the Duke of Guizhou Province, ordered that the bronze be used to build a temple in imitation of the Taihe Palace and the Golden Temple on Tianzhu Peak in the Wudang Mountains, Hubei province.", "The temple was later moved to the Jizu Mountains in western Yunnan.", "During the reign of the Kangxi Emperor (1662-1722) in the Qing dynasty, Wu Sangui, a military general who had defected from the Ming dynasty to the Manchu-led Qing dynasty and opened Shanhai Pass for them, rebuilt the temple, keeping the original Hubei design.", "The bronze used weighed over 200 tons.", "The temple walls were made with cast panels covered with exquisite and diverse designs." ] ], "gold": "The Golden Temple, or the Darb\u0101r Sahib, 'exalted court', is a gurdwara located in the city of Amritsar, Punjab, India and is the preeminent spiritual site of Sikhism and the hare krishna golden temple is is Telangana, India. The Golden Temple Vellore complex inside the Thirupuram spiritual park is situated at the foot of a small range of green hills at Thirumalaikodi Vellore in Tamil Nadu, India and Kinkaku-ji, officially named Rokuon-ji, is a Zen Buddhist temple in Kinkakuji-ch\u014d, Kita-ku, Ky\u014dto, Kyoto Prefecture, Japan. The Golden Temple Park, or Jindian Park, is a Taoist bronze-tiled temple located on the Mingfeng Mountains in Yunnan, China, and is the largest bronze temple in the country. Dambulla cave temple also known as the Golden Temple of Dambulla is a World Heritage Site in Dambulla, Matale District, Sri Lanka, situated in the central part of the country.", "prediction 1": "The Golden Temple, also known as Darbar Sahib or Sri Harmandir Sahib (\"abode of God\"), is a Gurdwara located in the city of Amritsar, Punjab, India. It is the holiest Gurdwara and the most important pilgrimage site of Sikhism. The Golden Temple Park, a Taoist bronze-tiled temple in Yunnan, China, has been preserved almost completely since it was first built. It is located on the Mingfeng Mountains, seven kilometres to the east of Kunming city, seven kilometres to the east of Kunming city.", "prediction 2": "In India, the Golden Temple, also known as Darbar Sahib, or Sri Harmandir Sahib, is a Gurdwara located in the city of Amritsar, Punjab, India. It is the holiest Gurdwara and the most important pilgrimage site of Sikhism. The temple was repeatedly rebuilt by the Sikhs after it became a target of persecution and was destroyed several times by the Muslim armies from Afghanistan and the Mughal Empire. The Golden Temple Park, or Jindian, is a Taoist bronze-tiled temple in Yunnnnnan, China and has been preserved almost completely since it was first built.", "prediction 3": "In Tirupati, the city that is the capital of Tamil Nadu, a temple dedicated to the goddess Lakshmi Narayani is situated in the city of Vellore. In the city of Amritsar, a Gurdwara built around a man-made pool (\"sarovar\") that was completed by Guru Ram Das in 1577. In 1603, a king of Sikhism, Guru Arjan, requested Sai Mian Mir \u2013 a Muslim Pir of Lahi Mir \u2013 a Muslim Pir of Lahore to lay the foundation stone. The temple was repeatedly rebuilt by the Sikh Empire, after it became a target of persecution and was destroyed several times by the Muslim armies from Afghanistan and the Mughal Empire.", "prediction 4": "The Golden Temple, also known as Darbar Sahib or Sri Harmandir Sahib (\"abode of God\"), is a Gurdwara located in the city of Amritsar, Punjab, India. It is the holiest Gurdwara and the most important pilgrimage site of Sikhism. The temple was repeatedly rebuilt by the Sikhs after it became a target of persecution and was destroyed several times by the Muslim armies from Afghanistan and the Mughal Empire. The Golden Temple Park, or Jindian Temple, is a Taoist bronze-tiled temple in Yunnnan, China and has been preserved almost completely since it was first built. The Golden Temple was first built in 1602 during the Ming dynasty.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Golden Temple, also known as Darbar Sahib or Sri Harmandir Sahib (\"abode of God\"), is a Gurdwara located in the city of Amritsar, Punjab, India. It is the holiest Gurdwara and the most important pilgrimage site of Sikhism. The Golden Temple Park, a Taoist bronze-tiled temple in Yunnan, China, has been preserved almost completely since it was first built. It is located on the Mingfeng Mountains, seven kilometres to the east of Kunming city, ", "start": 448, "end": 493 }, { "error type": "Irrelevant", "explanation": "", "start": 298, "end": 360 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Golden Temple, also known as Darbar Sahib or Sri Harmandir Sahib (\"abode of God\"), is a Gurdwara located in the city of Amritsar, Punjab, India. It is the holiest Gurdwara and the most important pilgrimage site of Sikhism. Golden Temple, Sripuram The golden temple complex inside the Sripuram spiritual park is situated at the foot of a small range of green hills at Thirumalaikodi (or simply Malaikodi) village, 8 km from Vellore in Tamil Nadu, India. The Golden Temple Park, or Jindian Park a Taoist bronze-tiled temple in Yunnan, China, is located on the Mingfeng Mountains, seven kilometres to the east of Kunming city." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "How many uk number ones has boyzone had?", "passages": [ [ "Boyzone", "In 2012, the Official Charts Company revealed the biggest selling singles artists in British music chart history, with Boyzone currently placed at 29th and the second most successful boy band in Britain, behind Take That.", "To date, Boyzone have released four studio albums and seven compilation albums.", "Based on BPI certifications, they have sold over 13 million records in the UK alone.", "Boyzone will be going on tour in late 2018 to celebrate their 25th anniversary.", "An album to celebrate the anniversary will be released in 16 November 2018.", "On 28 April 2018, it was announced that the band would split for good after their anniversary celebrations.", "In 1993, an advertisement appeared in many Irish newspapers calling for auditions to form a new Irish \"boy band\" group.", "The advertisements were sent out by theatrical manager Walsh who was looking to make an \"Irish Take That\" following on from their success.", "The auditions were held in The Ormond Center, in Dublin, in November 1993.", "More than 300 people replied to the advertisement.", "At the auditions the applicants were asked to sing the song \"Careless Whisper\" by George Michael.", "Each audition would be taped and watched again to judge the applicant's performance.", "Out of the 300, 50 were selected for a second audition.", "For the second audition the applicants where asked to sing two songs, including one of their own choice with a backing tape." ], [ "Boyzone", "Boyzone\n\nBoyzone are an Irish boy band.", "Their most famous line-up was composed of Keith Duffy, Stephen Gately, Mikey Graham, Ronan Keating, and Shane Lynch.", "Boyzone have had 21 singles in the top 40 UK charts and 22 singles in the Irish charts.", "The group have had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2.", "Boyzone are one of the most successful bands in Ireland and the United Kingdom.", "In total, Boyzone had 19 top 5 singles on the Irish Singles Chart, 18 top 10 hits on the UK Singles Chart, nine No. 1", "Irish hit singles and six No. 1 UK hit singles and five No. 1 albums, with 25 million records sold by 2013 worldwide.", "They were put together in 1993 by Louis Walsh, who is also known for managing Johnny Logan and Westlife.", "Before even recording any material, Boyzone made an appearance on RT\u00c9's \"The Late Late Show\".", "The group split in 1999.", "Boyzone made a comeback in 2007, originally with the intention of just touring.", "The band have sold 2 million records since their return.", "Gately died on 10 October 2009 of natural causes while on holiday in the Spanish island of Majorca with his civil partner, Andrew Cowles." ] ], "gold": "Boyzone has had six UK number one singles and five UK number one albums. In 2012, the Official Charts Company revealed the biggest selling singles artists in British music chart history, and Boyzone placed as the second most successful boy band in Britain behind Take That.", "prediction 1": "Boyzone are an Irish boy band that have had 21 singles in the top 40 UK charts and 22 singles in the Irish charts. The group have had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2. In total, Boyzone had 18 top 10 hits on the UK Singles Chart, nine No. 1 Irish hit singles and six No. 1 UK hit singles and five No. 1 albums.\n", "prediction 2": "Boyzone, an Irish boy band, are a British pop and boyband. In total, Boyzone had 21 singles in the top 40 UK charts and 22 singles in the Irish charts. The group had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2. In 2012, the Official Charts Company revealed the biggest selling singles artists in British music chart history, with Boyzone currently placed at 29th and the second most successful boy band in Britain, behind Take That.", "prediction 3": "The Irish boy band Boyzone had 5 UK number one singles in 2012 and 6 in 2015.", "prediction 4": "Boyzone are an Irish boy band from Dublin. Keith Duffy, Stephen Gately, Mikey Graham, Ronan Keating, and Shane Lynch are the members of Boyzone. Boyzone had 6 UK No.1 singles and 9 No.1 singles in Ireland. Boyzone have sold over 13 million records in the UK alone based on BPI certifications.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Boyzone are an Irish boy band that have had 21 singles in the top 40 UK charts and 22 singles in the Irish charts. The group have had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2. In total, Boyzone had 18 top 10 hits on the UK Singles Chart, ", "start": 310, "end": 367 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 309 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Boyzone have had six UK No.1 singles and nine No.1 singles in Ireland with 12 of their 24 singles in the UK being in the UK Top 2 and five UK number one albums. In 2012, the Official Charts Company revealed the biggest selling singles artists in British music chart history, with Boyzone currently placed at 29th and the second most successful boy band in Britain, behind Take That." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was sound captured for the first time?", "passages": [ [ "Sound recording and reproduction", "The first device that could record actual sounds as they passed through the air (but could not play them back\u2014the purpose was only visual study) was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville.", "The earliest known recordings of the human voice are phonautograph recordings, called \"phonautograms\", made in 1857.", "They consist of sheets of paper with sound-wave-modulated white lines created by a vibrating stylus that cut through a coating of soot as the paper was passed under it.", "An 1860 phonautogram of Au Clair de la Lune, a French folk song, was played back as sound for the first time in 2008 by scanning it and using software to convert the undulating line, which graphically encoded the sound, into a corresponding digital audio file.", "On April 30, 1877, French poet, humorous writer and inventor Charles Cros submitted a sealed envelope containing a letter to the Academy of Sciences in Paris fully explaining his proposed method, called the paleophone.", "Though no trace of a working paleophone was ever found, Cros is remembered as the earliest inventor of a sound recording and reproduction machine.", "The first practical sound recording and reproduction device was the mechanical phonograph cylinder, invented by Thomas Edison in 1877 and patented in 1878." ], [ "History of sound recording", "Rather than using rough 19th century technology to create playable versions, they were scanned into a computer and software was used to convert their sound-modulated traces into digital audio files.", "Brief excerpts from two French songs and a recitation in Italian, all recorded in 1860, are the most substantial results.", "The phonograph, invented by Thomas Edison in 1877, could both record sound and play it back.", "The earliest type of phonograph sold recorded on a thin sheet of tinfoil wrapped around a grooved metal cylinder.", "A stylus connected to a sound-vibrated diaphragm indented the foil into the groove as the cylinder rotated.", "The stylus vibration was at a right angle to the recording surface, so the depth of the indentation varied with the audio-frequency changes in air pressure that carried the sound.", "This arrangement is known as vertical or \"hill-and-dale\" recording.", "The sound could be played back by tracing the stylus along the recorded groove and acoustically coupling its resulting vibrations to the surrounding air through the diaphragm and a so-called \"amplifying\" horn.", "The crude tinfoil phonograph proved to be of little use except as a novelty.", "It was not until the late 1880s that an improved and much more useful form of phonograph was marketed." ] ], "gold": "The first device that could record actual sounds as they passed through the air, but could not play them back, was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. The phonograph, invented by Thomas Edison in 1877, could both record sound and play it back.", "prediction 1": "The first device that could record actual sounds as they passed through the air, but could not play them back, was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. The first sound recorded for the first time was a 1860 phonautogram called Au Clair de la Lune, a French folk song, played back for the first time in 2008 by scanning it and using software to convert the undulating line, which graphically encoded the sound into corresponding digital audio file. The first practical sound recording and reproduction device was the mechanical phonograph cylinder, invented by Thomas Edison in 1877, could both record sound and play it back. The first sound was recorded on a thin sheet of tinfoil wrapped around a grooved metal cylinder. The sound could be played back by tracing the stylus along the recorded groove and a", "prediction 2": "The first device that could record actual sounds as they passed through the air (but could not play them back\u2014the purpose was only visual study) was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. The first practical sound recording and reproduction device was the mechanical phonograph cylinder, invented by Thomas Edison in 1877, which could both record sound and play it back. In 1858, a phonautogram of Au Clair de la Lune, a French folk song, was played back as sound for the first time in 2008 by scanning it and using software to convert the undulating line, which graphically encoded the sound, into a corresponding digital audio file.", "prediction 3": "The first device that could record actual sounds as they passed through the air was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. The first known recordings of the human voice are phonautogram recordings, called phonautograms, made in 1857. An 1860 phonautogram of Au Clair de la Lune, a French folk song, was played back as sound for the first time in 2008 by scanning it and using software to convert the undulating line, which graphically encoded the sound, into corresponding digital audio file.", "prediction 4": "The first device that could record actual sounds as they passed through the air, but could not play them back\u2014the purpose was only visual study, was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. An 1860 phonautogram of Au Clair de la Lune, a French folk song, was played back as sound for the first time in 2008 by scanning it and using software to convert the undulating line, which graphically encoded the sound, into corresponding digital audio files. The first practical sound recording and reproduction device was the mechanical phonograph cylinder, invented by Thomas Edison in 1877, could both record sound and play it back.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 502 }, { "error type": "Irrelevant", "explanation": "", "start": 680, "end": 776 }, { "error type": "Irrelevant", "explanation": "", "start": 777, "end": 859 } ], "missing-info": [], "corrected-prediction": "The first device that could record actual sounds as they passed through the air, but could not play them back, was the phonautograph, patented in 1857 by Parisian inventor \u00c9douard-L\u00e9on Scott de Martinville. The first practical sound recording and reproduction device was the mechanical phonograph cylinder, invented by Thomas Edison in 1877, could both record sound and play it back. " }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Where did alfred go in dark knight rises?", "passages": [ [ "The Dark Knight Rises", "With Wayne presumed dead as well, Wayne Manor becomes an orphanage, and his remaining estate is left to Alfred.", "Gordon finds the previously destroyed Bat Signal repaired, while Lucius Fox discovers that Wayne had fixed the previously malfunctioning auto-pilot on the Bat.", "While visiting Florence, Alfred discovers that Wayne is alive, and in a relationship with Kyle.", "Blake resigns from the police force and, in accordance with Wayne's will, inherits the Batcave.", "Matthew Modine appears as Peter Foley, Gordon's second-in-command that disdains Batman.", "Ben Mendelsohn portrays John Daggett, a rival billionaire socialite who employs Bane in his plan to take control of Wayne Enterprises, and Burn Gorman appears as Daggett's assistant and Senior Executive Vice President Philip Stryver.", "Alon Abutbul portrays Leonid Pavel, a Russian nuclear physicist who is kidnapped from Uzbekistan by Bane and forced to convert the new Wayne Enterprises reactor core into a bomb.", "Juno Temple plays Jen, Kyle's friend and accomplice, and Daniel Sunjata portrays Mark Jones, a U.S. Special Ops officer who leads a task force into Gotham to assist Gordon and the GCPD in freeing the city from Bane's rule.", "Chris Ellis appears as Father Reilly, a priest at the orphanage that Blake grew up in." ], [ "The Dark Knight Rises", "The Dark Knight Rises\n\nThe Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer.", "Featuring the DC Comics character Batman, the film is the final installment in Nolan's \"The Dark Knight Trilogy\", and the sequel to \"The Dark Knight\" (2008).", "Christian Bale reprises the lead role of Bruce Wayne/Batman, with a returning cast of allies: Michael Caine as Alfred Pennyworth, Gary Oldman as James Gordon, and Morgan Freeman as Lucius Fox.", "The film introduces Selina Kyle (Anne Hathaway) and Bane (Tom Hardy).", "Eight years after the events of \"The Dark Knight\", merciless revolutionary Bane forces an older Bruce Wayne to resume his role as Batman and save Gotham City from nuclear destruction.", "Christopher Nolan was hesitant about returning to the series for a second time, but agreed after developing a story with his brother and Goyer that he felt would conclude the series on a satisfactory note.", "Nolan drew inspiration from Bane's comic book debut in the 1993 \"\" storyline, the 1986 series \"The Dark Knight Returns\", and the 1999 storyline \"\"." ], [ "Michael Caine", "Michael Caine\n\nSir Michael Caine, (; born Maurice Joseph Micklewhite, 14 March 1933) is an English actor, producer and author.", "He has appeared in more than 125 films in a career spanning 50 years and is considered a British film icon.", "Known for his cockney accent, Caine was born in South London, where during his early childhood, he and his parents lived in a rented flat on Urlwin Street, in Camberwell.", "He made his breakthrough in the 1960s with starring roles in British films, including \"Zulu\" (1964), \"The Ipcress File\" (1965), \"Alfie\" (1966), for which he was nominated for an Academy Award, \"The Italian Job\" (1969), and \"Battle of Britain\" (1969).", "His roles in the 1970s included \"Get Carter\" (1971), \"The\" \"Last\" \"Valley\" (1971), \"Sleuth\" (1972), for which he earned his second Academy Award nomination, \"The Man Who Would Be King\" (1975), and \"A Bridge Too Far\" (1977).", "He achieved some of his greatest critical success in the 1980s, with \"Educating Rita\" (1983), earning him the BAFTA and Golden Globe Award for Best Actor." ] ], "gold": "In the 2012 film The Dark Knight Rises, Alfred Pennyworth, played by English actor Michael Caine, goes because he is resigning from his position. Alfred is unconvinced that Wayne is strong enough to fight Bane and resigns in the hope to save him. At the end of the film, the third in The Dark Knight Trilogy, we see Alfred vacationing in Florence, Italy.", "prediction 1": "In The Dark Knight Rises, Alfred Pennyworth goes to Florence, Italy to find a new relationship with Wayne. In the film, Alfred discovers that Wayne is alive, and in a relationship with Kyle.", "prediction 2": "Alfred Pennyworth is a fictional character in the DC Comics superhero film series Batman. Alfred is a thief and a spy, and is the main character in the 2012 superhero film The Dark Knight Rises.", "prediction 3": "The Dark Knight Rises is a 2012 American-British superhero film directed by Christopher Nolan, who co-wrote the screenplay with his brother Jonathan Nolan, and the story with David S. Goyer. The film's premise is: Alfred Pennyworth visits Florence, Italy, where he discovers that Wayne is alive and in a relationship with Kyle. In the film, Alfred meets Gordon in a bar, the Batcave. In the 2009 film, Alfred meets Bane in a bar, and Alfred goes to save Gotham City from nuclear destruction.", "prediction 4": "Alfred Pennyworth is a fictional character in the DC Comics film series Batman. In The Dark Knight Rises, Alfred goes to Florence, Italy to investigate the death of Wayne. Alfred is rescued by Gordon and finds himself in an orphanage.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 106 }, { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 190 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In The Dark Knight Rises, Alfred Pennyworth, played by English actor Michael Caine, goes to Florence, Italy." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who are the democrats running for governor of texas?", "passages": [ [ "2006 Texas gubernatorial election", "2006 Texas gubernatorial election\n\nThe 2006 Texas gubernatorial election was held on November 7, 2006 to elect the Governor of Texas.", "The election was a rare five-way race, with incumbent Republican Governor Rick Perry running for re-election against Democrat Chris Bell and Independents Carole Keeton Strayhorn and Kinky Friedman, as well as Libertarian nominee James Werner.", "Perry was re-elected to a second full term in office, winning 39% of the vote to Bell's 30%, Strayhorn's 18% and Friedman's 12%.", "Perry carried 209 out of the state's 254 counties, while Bell carried 39 and Strayhorn carried 6.", "Exit polls revealed that Perry won the Anglo vote with 46%, while Bell got 22%, Strayhorn got 16% and Friedman got 15%.", "Bell won 63% of African Americans, while Perry got 16%, Strayhorn got 15% and Friedman got 4%.", "Bell also won the Latino vote with 41%, while Perry got 31%, Strayhorn got 18% and Friedman got 4%.", "Perry was inaugurated for a second full four-year term on January 16, 2007.", "The ceremony was held inside the House of Representatives chamber at the Texas Capitol after thunderstorms cancelled the planned outdoor ceremony.", "It is difficult for an independent gubernatorial candidate to gain ballot access in the state of Texas." ], [ "2014 Texas elections", "2014 Texas elections\n\nThe 2014 general election was held in the U.S. state of Texas on November 4, 2014.", "All of Texas' executive officers were up for election as well as a United States Senate seat, and all of Texas' thirty-six seats in the United States House of Representatives.", "Primary elections were held on March 4, 2014.", "Primary runoffs, required if no candidate wins a majority of the vote, were held on May 27, 2014.", "Elections were also held for the Texas legislature and proposition 1, seeking funds for Texas highways (which passed).", "A combination of retirements, incumbents seeking other offices and a primary defeat means that after the election, for the first time since 1874, all of Texas' executive offices were held by new officeholders.", "The Tea Party made large gains in the 2014 elections, with Tea Party-backed candidates being elected into offices such as lieutenant governor and attorney general, among other offices.", "Incumbent Republican Governor Rick Perry, who has served in the office since December 21, 2000, when George W. Bush resigned ahead of being sworn-in as President of the United States, has announced that he will not run for a fourth full term as governor.", "This will be the first open election for governor since 1990, when Ann Richards was elected.", "Greg Abbott won the Republican primary, Wendy Davis won the Democratic primary." ], [ "2010 United States gubernatorial elections", "Democratic primary candidates included activist and mediator Keith G. Allred, and Franklin County laborer Lon Chaney, who unsuccessfully contested the Democratic nomination in 2006.", "Allred easily defeated Chaney for the Democratic nomination.", "Former Republican state representative Jana Kemp was an announced independent candidate.", "Otter won re-election.", "Governor Dave Heineman succeeded Mike Johanns upon Johanns's confirmation as United States Secretary of Agriculture.", "Heineman won election in 2006 against David Hahn with 73% of the vote and sought a second term in 2010.", "Heineman won re-election.", "Texas Governor Rick Perry won the GOP gubernatorial primary with 51% of the vote on March 2, 2010.", "Perry sought a third full term, as the longest-serving governor in the history of Texas.", "U.S. Senator Kay Bailey Hutchison challenged Perry in the Republican primary.", "On December 4, 2008, Hutchison filed papers to set up an exploratory committee and confirmed in July 2009 that she would be making her official entry into the race in August.", "Perry led in primary and general election match-ups, according to aggregate polling.", "Dedra Medina also challenged Perry and Hutchison for Republican nomination.", "Former Houston Mayor Bill White won the Texas Democratic primary, beating Houston businessman Farouk Shami.", "Perry defeated White in the election." ] ], "gold": "There have been several Democrats to run for Governor of Texas. In 2006, Bob Gammage, Rashad Jafer, and Chris Bell ran for Governor. In 2010, Democrats running for Governor included Clement E. Glenn, Bill Dear, Bill White, Star Locke, Alma Aguado, Felix Alvarado, and Farouk Shami. In 2014, Democrats Wendy Davis and Ray Madrigal ran for Governor. ", "prediction 1": "The 2010 United States gubernatorial election was held in the state of Texas on November 2, 2010. Democratic primary candidates in Texas included activist and mediator Keith G. Allred, Franklin County laborer Lon Chaney, who unsuccessfully contested the Democratic nomination in 2006. Former Houston Mayor Bill White won the Texas Democratic primary, beating Houston businessman Farouk Shami. Former Republican state representative Jana Kemp was an announced independent candidate.", "prediction 2": "The 2010 Democratic governorship election was held on March 2, 2010 and the 2016 Democratic governorship election was held on November 4, 2016. The 2016 Democratic governorship election was held on November 7, 2016 and the 2017 Democratic governorship election was held on November 8, 2017. Several democrats were running for governor of Texas in 2016.", "prediction 3": "The 2006 Texas gubernatorial election was held on November 7, 2006 to elect the Governor of Texas. The election was a rare five-way race, with incumbent Republican Governor Rick Perry running for re-election against Democrat Chris Bell and Independents Carole Keeton Strayhorn and Kinky Friedman, as well as Libertarian nominee James Werner. In 2014, the Democratic primary was held on March 4, 2014.", "prediction 4": "The Democratic primary in Texas is for the office of Governor. The Republican primary was won by Greg Abbott on March 2, 2010, the Democratic primary was won by Bill White, and the Democratic primary was won by Chris Bell.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 45 }, { "error type": "Unverifiable", "explanation": "", "start": 50, "end": 97 }, { "error type": "Unverifiable", "explanation": "", "start": 128, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 351, "end": 392 }, { "error type": "Irrelevant", "explanation": "", "start": 393, "end": 481 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "There were several Democrats, depending on the year of the Governor elections. Former Houston Mayor Bill White won the Texas Democratic primary and ran in 2010. Wendy Davis won the Democratic primary and ran for the 2014 Governor elections. Democrat Chris Bell ran for governor in 2006." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who wrote the lyrics to all you need is love?", "passages": [ [ "Baby, You're a Rich Man", "Baby, You're a Rich Man\n\n\"Baby, You're a Rich Man\" is a song by the English rock band the Beatles that was released in July 1967 as the B-side of their \"All You Need Is Love\" single.", "It originated from an unfinished song by John Lennon, titled \"One of the Beautiful People\", to which Paul McCartney added a chorus.", "The song was recorded and mixed at Olympic Sound Studios in London, making it the first of the Beatles' EMI recordings to be entirely created outside EMI Studios.", "The track features a monophonic keyboard instrument known as a clavioline, which Lennon played on its oboe setting, creating a sound that suggests an Indian shehnai.", "The lyrics address the \"beautiful people\" of the 1960s hippie movement.", "The song has also invited interpretation as a message to the Beatles' manager, Brian Epstein, and alternatively as a comment on fame.", "\"Baby, You're a Rich Man\" peaked at number 34 on America's \"Billboard\" Hot 100 chart.", "A month after its release, George Harrison performed the song during his visit to Haight-Ashbury in San Francisco, during the height of the Summer of Love.", "The track also appeared on the Beatles' \"Magical Mystery Tour\" album and in a sequence in their 1968 animated film \"Yellow Submarine\"." ], [ "The Beatles' Christmas records", "\"Ob-La-Di, Ob-La-Da\", \"Yer Blues\" and \"Birthday\" are also heard in the background for part of the message.", "The dialogue and songs for the flexi-disc were organised and edited together by DJ and friend of the Beatles, Kenny Everett.", "Finally, the US fans got a flexi-disc for Christmas in 1968, but it came in a modified version of the 1967 UK sleeve.", "The final Beatles Christmas offering was also recorded separately, as the band had effectively split by this point.", "It features an extensive visit with Lennon and his wife Yoko at their Tittenhurst Park estate, where they play \"what will Santa bring me?\" games.", "Harrison and Ringo Starr appear only briefly, the latter to publicise his recent film, \"The Magic Christian\".", "McCartney sings his original ad-lib, \"This is to Wish You a Merry, Merry Christmas.\"", "Starting at 1:30, at the tail-end of Starr's song, the guitar solos from \"The End\" are heard, followed by Ono interviewing Lennon.", "For the only time, the American and British jackets were identical.", "The US version of the flexi-disc had an elaborate drawing of the Beatles' faces on it.", "Drawings were credited to Richard Starkey (Starr's real name) and Zak Starkey (his son)." ] ], "gold": "\"All You Need Is Love\" is a song by the English rock band the Beatles that was released as a non-album single in July 1967. It was written by John Lennon and credited to the Lennon\u2013McCartney partnership. Lennon's lyrics, which were deliberately simplistic to allow for the show's international audience, captured the utopian sentiments of the Summer of Love era. In McCartney's recollection, the song was entirely Lennon's, with Harrison, Starr and his own contributions confined to ad-libs at the end of the recording.", "prediction 1": "\"Baby, You're a Rich Man\" is a song by the English rock band the Beatles that was released in July 1967 as the B-side of their \"All You Need Is Love\" single. It originated from an unfinished song by John Lennon, titled \"One of the Beautiful People\", to which Paul McCartney added a chorus. The song was recorded and mixed at Olympic Sound Studios in London, making it the first of the Beatles' EMI recordings to be entirely created outside EMI Studios. It also invited interpretation as a message to the Beatles' manager Brian Epstein, and alternatively as a comment on fame.", "prediction 2": "The lyrics to \"All You Need Is Love\" originated from an unfinished song by John Lennon, titled \"One of the Beautiful People\", to which Paul McCartney added a chorus. The song was recorded and mixed at Olympic Sound Studios in London, making it the first of the Beatles' EMI recordings to be entirely created outside EMI Studios.", "prediction 3": "\"Baby, You're a Rich Man\" is a song by the English rock band the Beatles that was released in July 1967 as the B-side of their All You Need Is Love single. It originated from an unfinished song by John Lennon, titled \"One of the Beautiful People\", to which Paul McCartney added a chorus. The song was recorded and mixed at Olympic Sound Studios in London, making it the first of the Beatles' EMI recordings to be entirely created outside EMI Studios. McCartney added a chorus.", "prediction 4": "\"Baby, You're a Rich Man\" is a song by the English rock band the Beatles that was released in July 1967 as the B-side of their \"All You Need Is Love\" single. The lyrics originated from an unfinished song by John Lennon, titled \"One of the Beautiful People\", to which Paul McCartney added a chorus. The song was recorded and mixed at Olympic Sound Studios in London, making it the first of the Beatles' EMI recordings to be entirely created outside EMI Studios.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 25 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 158, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 452 }, { "error type": "Irrelevant", "explanation": "", "start": 453, "end": 575 } ], "missing-info": [], "corrected-prediction": "\"All You Need Is Love\" is a song by the English rock band the Beatles that was released in July 1967, it was a single. " }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who won the last hot dog eating contest?", "passages": [ [ "Nathan's Hot Dog Eating Contest", "Nathan's Hot Dog Eating Contest\n\nThe Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition.", "It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City.", "The contest has gained public attention in recent years due to the stardom of Takeru Kobayashi and Joey Chestnut.", "The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest.", "The defending women's champion is Miki Sudo, who ate 37 hot dogs in the 2018 contest.", "Major League Eating (MLE), formerly known as the International Federation of Competitive Eating (IFOCE), has sanctioned the event since 1997.", "Today, only entrants currently under contract by MLE can compete in the contest.", "The field of about 20 contestants typically includes the following:\n\n\nThe competitors stand on a raised platform behind a long table with drinks and Nathan's Famous hot dogs in buns.", "Most contestants have water on hand, but other kinds of drinks can and have been used.", "Condiments are allowed, but usually are not used.", "The hot dogs are allowed to cool slightly after grilling to prevent possible mouth burns." ], [ "Matt Stonie", "Matt Stonie\n\nMatthew \"Megatoad\" Kai Stonie (born May 24, 1992) is an American competitive eater.", "He is the number four ranked competitive eater in Major League Eating.", "Stonie won the 2015 Nathan's Hot Dog Eating Contest, dethroning 8-time defending champion Joey Chestnut, but lost the title in 2016.", "He has gained fame from his YouTube channel, where he uploads many eating challenges.", "Stonie was born on May 24, 1992, in San Francisco, California.", "He is of Japanese, Czechoslovakian, and Lithuanian ancestry.", "Stonie has a younger brother named Morgan Stonie.", "He graduated from Evergreen Valley High School in San Jose, California.", "He weighs and is tall.", "His nickname, \"Megatoad,\" is from the character Toad from the video game \"Super Mario Bros.\"\n\nStonie's Major League Eating debut was at the Stockton Deep Fried Asparagus Championship in Stockton, California in 2011.", "He is currently the youngest member of the Major League Eating organization.", "His first win came in 2010 in a lobster roll eating contest in Hampton Beach, New Hampshire.", "On July 4, 2015, Stonie defeated 8-time defending Nathan's Hot Dog Eating Contest champion Joey Chestnut by eating 62 hot dogs to Chestnut's 60." ] ], "gold": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. The contest has gained public attention in recent years due to the stardom of Takeru Kobayashi and Joey Chestnut. The defending men's champion is Joey Chestnut, who ate 71 hot dogs in the 2019 contest. He also won the 2016, 2017 and 2018 contests. Matt Stonie won in 2015. The defending women's champion is Miki Sudo, who ate 31 hot dogs in the 2019 contest. She also won the 2015, 2016, 2017 and 2018 contests.", "prediction 1": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant in Coney Island, a neighborhood of Brooklyn, New York City. Takeru Kobayashi won the last hot dog eating contest in 2015. On July 4, 2015, Stonie defeated 8-time defending champion Joey Chestnut by eating 62 hot dogs to Chestnut's 60.", "prediction 2": "Matt Stonie, known by his nickname Megatoad, won the 2015 Nathan's Hot Dog Eating Contest, dethroning 8-time defending champion Joey Chestnut, but lost the title in 2016.", "prediction 3": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant at the corner of Surf and Stillwell Avenues in Coney Island, a neighborhood of Brooklyn, New York City. American competitive eater Matt Stonie, who is the number four ranked competitive eater in Major League Eating, won the 2015 contest, dethroning 8-time defending champion Joey Chestnut, but lost the title in 2016.", "prediction 4": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. It is held each year on Independence Day at Nathan's Famous Corporation's original, and best-known restaurant in Coney Island, a neighborhood of Brooklyn, New York City. Matt Stonie won the 2015 Nathan's Hot Dog Eating Contest, dethroning 8-time defending champion Joey Chestnut, but lost the title in 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 267 }, { "error type": "Unverifiable", "explanation": "", "start": 268, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 442 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Nathan's Hot Dog Eating Contest is an annual American hot dog competitive eating competition. The contest has gained public attention in recent years due to the stardom of Takeru Kobayashi and Joey Chestnut. The defending men's champion is Joey Chestnut, who ate 74 hot dogs in the 2018 contest. Matt Stonie won in 2015. The defending women's champion is Miki Sudo, who ate 37 hot dogs in the 2018 contest. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "What is the capacity of st james park?", "passages": [ [ "St James' Park", "St James' Park\n\nSt James' Park is a football stadium in Newcastle upon Tyne, England.", "It is the home of Premier League club Newcastle United F.C.", "With a seating capacity of 52,388, it is the seventh largest football stadium in England.", "St James' Park has been the home ground of Newcastle United since 1892 and has been used for football since 1880.", "Throughout its history, the desire for expansion has caused conflict with local residents and the local council.", "This has led to proposals to move at least twice in the late 1960s, and a controversial 1995 proposed move to nearby Leazes Park.", "Reluctance to move has led to the distinctive lop-sided appearance of the present-day stadium's asymmetrical stands.", "Besides club football, St James' Park has also been used for international football: it was used as a football venue for the 2012 Olympics, and also as a Rugby league venue for the 2015, 2016, 2017 & 2018 Super League Magic Weekend and a Rugby Union venue for the 2015 Rugby World Cup, occasional Premiership matches and an England Test match.", "In addition to professional football, the stadium has hosted charity football events and rock concerts, and been used as a set for film and reality television." ], [ "St James Park (Exeter)", "St James Park (Exeter)\n\n", "St James Park is a football stadium in Exeter and is the home of Exeter City F.C.", "The stadium is served by the St James Park railway station which is right next to the ground (the line runs behind the Grandstand).", "It has been adopted by the club who contribute to its upkeep, under the community rail scheme, and its railings have been painted in the red and white of Exeter's strip.", "The new capacity of St James Park following completion of a \u00a33.4million redevelopment project is 8,696.", "The record attendance is 20,984, who watched Exeter lose 4\u20132 to Sunderland in an FA Cup Sixth Round Replay in 1931.", "The Stagecoach Stand and the away terrace will be closed for the 2017/18 season due to redevelopment work at the stadium, with away fans set to be only allocated around 200-1,000 tickets in the seated stand.", "This reduced the capacity to around 6,000.", "In 1654 the land was owned by Lady Anne Clifford who rented it out for fattening pigs.", "The proceeds went to a charity set up to pay for the apprenticeship of a poor child from the parish of St Stephen, an arrangement that was supposed to be renewed \"yearly to the world's end.\"" ] ], "gold": "There are multiple locations named St. James Park. St James' Park is a football stadium in Newcastle upon Tyne, England. With a seating capacity of 52,388, it is the eighth largest football stadium in England. There is also another football stadium in Exeter which is the home of Exeter City FC and is named St James Park, with a capacity of 8,696.", "prediction 1": "St James' Park is a football stadium in Newcastle upon Tyne, England. It is the home ground of Premier League club Newcastle United F.C. St James' Park has a seating capacity of 52,388, it is the seventh largest football stadium in England. It is also the home ground of Exeter City F.C. The new capacity following completion of a \u00a33.4million redevelopment project is 8,696.", "prediction 2": "St James' Park in Newcastle, England has a seating capacity of 52,388, making it the seventh largest football stadium in England. The new capacity of St James Park following completion of a \u00a33.4million redevelopment project is 8,696. The record attendance for a match at St James Park in 1931 was 20,984.", "prediction 3": "The capacity of the stadium in 2018 was 8,696, which is a redevelopment of the previous capacity, which was 8,683. The capacity for the stadium in 2013 was 10,446. The capacity of the stadium in 2017 was 8,696.", "prediction 4": "The old capacity of St James Park was 6,768. The new capacity following completion of a \u00a33.4million redevelopment project is 8,696. The capacity of St James Park following completion of a \u00a33.4million redevelopment project was 8,696. The capacity of St James Park following completion of a \u00a33.4million redevelopment project was 9,746.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 136 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 364 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "St James' Park is a football stadium in Newcastle upon Tyne, England. St James' Park has a seating capacity of 52,388, it is the seventh largest football stadium in England. St James Park is a football stadium in Exeter and is the home of Exeter City F.C with a capacity of 8696. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who played little ricky on the lucille ball show?", "passages": [ [ "Ricky Ricardo Jr.", "Ricky Ricardo Jr.\n\nEnrique Alberto Ricardo IV, \"Little Ricky,\" is a fictional character from the American television series \"I Love Lucy\" (1951\u201357, with Ricky Jr. becoming a part of the show as of his birth in 1953) and \"The Lucy-Desi Comedy Hour\" (1957\u201360).", "Little Ricky was played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky.", "Although the \"I Love Lucy\" announcer and the opening credits of \"The Lucy-Desi Comedy Hour\" gave his stage name as \"Little Ricky\", in his post-\"Lucy\" acting career, particularly his four-year irregular stint on \"The Andy Griffith Show\", he was billed as Richard Keith.", "In the show, Little Ricky is the son of Lucy Ricardo and Ricky Ricardo.", "Little Ricky lives with his parents in a New York Brownstone apartment building, which is owned and run by his godparents; the family later moves to a large suburban house in Westport, Connecticut.", "Lucy finds out she was expecting Little Ricky on the Season 2 episode \"Lucy is Enceinte.\"" ], [ "Richard Keith (actor)", "Richard Keith (actor)\n\nKeith Thibodeaux (born December 1, 1950) is a former American child actor and musician, best known for playing Little Ricky on the television sitcoms \"I Love Lucy\" and \"The Lucy-Desi Comedy Hour\".", "His last name, which was Cajun French, was changed by producer Desi Arnaz to \"Keith\" because \"Thibodeaux\" was too difficult to pronounce.", "He is the last living regular appearing cast member from \"I Love Lucy\".", "Thibodeaux showed skill on the drums at a young age, and was making $500 a week at the age of 3 while touring with the Horace Heidt Orchestra.", "His father took him to audition for the part of Little Ricky in 1955, \"I walked on the set and there was Lucy, she was standing there and she was looking at me,\" he said.", "\"She said 'OK he's cute, but what does he do?'", "My dad said, 'Well he plays the drums' and she said, 'Oh, come on--I can't believe that.'", "Then, she says 'Look, we have a drum set over there, go ahead and let him play.'" ] ], "gold": "Enrique Alberto Ricardo IV or \"Little Ricky,\" is a fictional character from the American television series I Love Lucy, which aired from 1951\u201357, and The Lucy-Desi Comedy Hour, which aired from 1957\u201360. In the show, Little Ricky is the son of Lucy Ricardo and Ricky Ricardo and lives with his parents in a New York Brownstone apartment building and then the family later moves to a large suburban house in Westport, Connecticut. Little Ricky was played by a number of actors, including James John Ganzer, who played Little Ricky in season 2, episode 16, twins Richard and Ronald Lee Simmons who played him season 2, episodes 22 and 24, and twins Joseph and Michael Mayer played the character in season 5. In season 6, Keith Thibodeaux played the character, with his stage name in the credits being shown as \"Little Ricky\", although in his post-Lucy acting career he was known as Richard Keith. ", "prediction 1": "\"Little Ricky\" is a fictional character from the American television series \"I Love Lucy\" and \"The Lucy-Desi Comedy Hour\". The character was played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky. Although the \"I Love Lucy\" announcer and the opening credits of \"The Lucy-Desi Comedy Hour\" gave his stage name as \"Little Ricky\", in his post-Lucy acting career, particularly his four-year irregular stint on The Andy Griffith Show, he was billed as Richard Keith.", "prediction 2": "There were many actors playing the character Little Ricky on the Lucille Ball show. A former child actor and musician, Keith Thibodeaux, billed as Little Ricky on the television sitcoms I Love Lucy and The Lucy-Desi Comedy Hour, played the character.", "prediction 3": "Ricky, the fictional character, was played by several actors on the Lucille Ball show, including James John Ganzer, Richard Keith Thibodeaux, Ronald Lee Simmons, Michael Mayer, and Joseph Mayer. Despite his stage name being Little Ricky, his professional career began with a four-year odd stint on The Andy Griffith Show.", "prediction 4": "Ricky Ricardo IV, \"Little Ricky,\" is a fictional character from the American television show \"I Love Lucy\" and \"The Lucy-Desi Comedy Hour\". Ricky was played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 493, "end": 562 }, { "error type": "Irrelevant", "explanation": "", "start": 339, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 391, "end": 421 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Enrique Alberto Ricardo IV, \"Little Ricky\", is a fictional character from the American television series \"I Love Lucy\" ((1951\u201357) and \"The Lucy-Desi Comedy Hour\" (1957\u201360). Little Ricky lives with his parents in a New York Brownstone apartment building, the family later moves to a large suburban house in Westport, Connecticut. The character was played by a number of actors, including James John Ganzer, twins Richard and Ronald Lee Simmons, twins Michael and Joseph Mayer and, most notably, Keith Thibodeaux, billed as Little Ricky. Although the opening credits gave his stage name as \"Little Ricky\", in his post-Lucy acting career, he was billed as Richard Keith." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is playing the first day of the world cup?", "passages": [ [ "1970 FIFA World Cup", "The draw was staged in Mexico City, Mexico on 10 January 1970 in the Maria Isabel Hotel, which served as FIFA's headquarters during the competition.", "The teams were drawn into the four groups, which had their locations defined in advance: Group 1 being staged in Mexico City, Group 2 in Puebla and Toluca, Group 3 in Guadalajara and Group 4 in Le\u00f3n.", "It was predetermined that the hosts Mexico would be in Group 1 and so based in the capital city, and that England as holders would be based in Guadalajara, the tournament's second largest stadium.", "The 10-year-old daughter of Guillermo Ca\u00f1edo, President of the Mexican Football Federation and the Local Organising Committee, drew out the teams from four silver cups.", "For a list of all squads that appeared in the final tournament, see \"1970 FIFA World Cup squads\".", "Following the opening ceremony host nation Mexico faced the Soviet Union; this was the last time until the 2006 World Cup that the host nation's first match rather than the World Cup holders' began the tournament.", "Both this opening match of Group 1 and many others during the competition kicked off at noon for the benefit of European television schedules, meaning play under the midday sun.", "The match produced a goalless draw, prompting some media to predict the entire tournament would be played at the slow tempo that featured in this game given the conditions involved." ], [ "Sweden national football team", "As Sweden had won the first match 1\u20130, this resulted in a Swedish win on aggregate, making their return to the World Cup for the first time in 12 years.", "At the 2018 World Cup, Sweden started its campaign by a 1\u20130 win over South Korea in the first match on 18 June, through a penalty goal decided by the new VAR technology.", "In their second match on 23 June they continued with a loss against Germany, after Sweden attained 1\u20130 in the first half Germany got 1\u20131 early on in the second half and won with a goal in the last 15 seconds in the 95th minute.", "Despite this loss, Sweden advanced to the knockout stage top of the group with a 3\u20130 win over Mexico, while Germany were knocked out bottom of the group with a 2\u20130 loss to South Korea.", "On 3 July 2018, Sweden played Switzerland in the round of 16, beating them 1-0, and advancing to the quarter finals for the first time since 1994.", "In the quarter-finals, Sweden suffered a 2\u20130 defeat to England and was thus knocked out.", "Sweden were drawn with Turkey and Russia in the League B. Sweden started their campaign on 10 September with a 2\u20133 defeat against Turkey in Solna.", "A month later, Sweden earned a point in a 0\u20130 draw against Russia in Kaliningrad." ], [ "2018 FIFA World Cup", "The full schedule was announced by FIFA on 24 July 2015 (without kick-off times, which were confirmed later).", "On 1 December 2017, following the final draw, six kick-off times were adjusted by FIFA.", "Russia was placed in position A1 in the group stage and played in the opening match at the Luzhniki Stadium in Moscow on 14 June against Saudi Arabia, the two lowest-ranked teams of the tournament at the time of the final draw.", "The Luzhniki Stadium also hosted the second semi-final on 11 July and the final on 15 July.", "The Krestovsky Stadium in Saint Petersburg hosted the first semi-final on 10 July and the third place play-off on 14 July.", "The opening ceremony took place on Thursday, 14 June 2018, at the Luzhniki Stadium in Moscow, preceding the opening match of the tournament between hosts Russia and Saudi Arabia.", "At the start of the ceremony, Russian president Vladimir Putin gave a speech, welcoming the countries of the world to Russia and calling football a uniting force.", "Brazilian World Cup-winning striker Ronaldo entered the stadium with a child in a Russia shirt.", "Pop singer Robbie Williams then sang two of his songs solo before he and Russian soprano Aida Garifullina performed a duet.", "Dancers dressed in the flags of the 32 competing teams appeared carrying a sign with the name of each nation." ] ], "gold": "The World Cup opening match is the first of the competition, opening match regulations changed many times. The opening match of the 2006 World Cup was between Germany and Costa Rica. The opening match of the 2010 World Cup was between South Africa and Mexico. The opening match of the 2014 World Cup was between Brazil and Croatia.", "prediction 1": "The opening match of the 1970 FIFA World Cup was played between South Korea and Germany. The opening match of the 2018 FIFA World Cup was played between Sweden and Russia.", "prediction 2": "The opening match of the 1970 FIFA World Cup was played between the hosts Mexico and the Soviet Union. This was the last time until the 2006 World Cup that the hosts nation's first match was against the holders, and was played against the Soviet Union. The opening match of the 2018 FIFA World Cup was played between Sweden and Russia.", "prediction 3": "The opening match of the 1970 FIFA World Cup was played between Mexico and the Soviet Union. As Sweden had won the first match 1\u20130, this resulted in a Swedish win on aggregate, making their return to the World Cup for the first time in 12 years. At the 2018 World Cup, Sweden started its campaign by a 1\u20130 win over South Korea in the first match on 18 June, through a penalty goal decided by the new VAR technology. At the 2019 FIFA World Cup, Russia was placed in position A1 in the group stage and played in the opening match at the Luzhniki Stadium in Moscow on 14 June against Saudi Arabia, the two lowest-ranked teams of the tournament at the time of the final.", "prediction 4": "The first match of Group 1 of the 1970 FIFA World Cup was played between Mexico and the Soviet Union. The teams were then placed into four groups, each with a different location, with Mexico playing the Soviet Union and England playing the English. The opening match of Group 1 on the first day of the 2018 FIFA World Cup was played between Russia and Saudi Arabia.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 153, "end": 159 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 64, "end": 88 } ], "missing-info": [], "corrected-prediction": "The opening match of the 1970 FIFA World Cup was played between Mexico and the Soviet Union. The opening match of the 2018 FIFA World Cup was played between Saudi Arabia and Russia." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who played drums on everybody wants to rule the world?", "passages": [ [ "Everybody Wants to Rule the World", "It shows the group's lead singer, Curt Smith riding an antique Austin-Healey 3000 sports car around various locations in Southern California intercut with shots of the band performing the song in a studio.", "In 1986, the song won \"Best Single\" at the Brit Awards.", "The group re-recorded the song as a charity single for the Sport Aid campaign.", "New Zealand singer Lorde recorded a cover of the song which was included in the for \"\" (2013).", "\"Everybody Wants to Rule the World\" was written by Roland Orzabal, Ian Stanley and Chris Hughes with production handled by the latter.", "It was revealed that the song was a \"last-minute\" addition during recording sessions of \"Songs from the Big Chair\" (1985).", "The decision to include the song in the album came after Orzabal played two chords on his acoustic guitar for Hughes.", "It was recorded in two weeks and later added as the final track on the album.", "According to Orzabal, he initially regarded the song as a lightweight that would not fit with the rest of the album.", "In an interview with \"Mix\" magazine, Hughes admitted that \"as a piece of recording history,", "[the song is] bland as hell.\"", "The lyrics of the song were originally \"everybody wants to go to war\", which Orzabal felt was lackluster." ], [ "Everybody Wants to Rule the World", "Everybody Wants to Rule the World\n\n\"Everybody Wants to Rule the World\" is a song recorded by English band Tears for Fears.", "It was written by Roland Orzabal, Ian Stanley, and Chris Hughes with production handled by Hughes.", "The song was released in 1985 by Phonogram, Mercury and Vertigo Records as the third single from their second album, \"Songs from the Big Chair\" (1985).", "\"Everybody Wants to Rule the World\" is a new wave song.", "Its lyrics detail the desire humans have for control and power and centers on themes of corruption.", "Music critics praised \"Everybody Wants to Rule the World\" in their retrospective reviews, with some including the song in their respective decade lists.", "It is regarded as the group's signature song, along with \"Shout\" (1984).", "Commercially, the song garnered success on charts internationally, peaking at number two in Ireland and the United Kingdom and at number one in Canada, New Zealand and on the \"Billboard\" Hot 100.", "\"Everybody Wants to Rule the World\" was certified gold by both Music Canada (MC) and the British Phonographic Industry (BPI).", "Nigel Dick directed the song's accompanying music video which received promotion from MTV." ], [ "Tears for Fears", "Also during the tour, Orzabal and Smith discovered an American female singer/pianist, Oleta Adams, who was performing in a Kansas City hotel bar, and whom they invited to collaborate on their next album.", "Towards the end of the year, the band released a video collection/documentary entitled \"Scenes from the Big Chair\".", "In February 1986, having completed the lengthy and exhausting Big Chair world tour, Tears for Fears were honoured at the 1986 Brit Awards in London where they won the Best British Single award for \"Everybody Wants To Rule The World\".", "The band was also nominated for Best British Group and Best British Album, and Chris Hughes was nominated for Best Producer.", "The band performed the song at the ceremony, which became the final public performance of drummer Manny Elias who left the group shortly afterwards.", "The same year, Orzabal and Stanley worked together on a side project named Mancrab and released a single, \"Fish for Life\", which was written for the soundtrack of the film \"The Karate Kid, Part II\".", "The track was written and produced by Orzabal and Stanley, and featured vocals by US singer/dancer Eddie Thomas, who was one of the dancers in the video for \"Everybody Wants To Rule The World\".", "On 13 July 1985, Tears for Fears were scheduled to perform at JFK Stadium in Philadelphia for the Live Aid charity event." ] ], "gold": "\"Everybody Wants to Rule the World\" is a song by English pop rock band Tears for Fears. Manny Elias played the drums for the song and Ian Stanley played the drum machine.", "prediction 1": "Everybody Wants to Rule the World is a song recorded by English band Tears for Fears. It was written by Roland Orzabal, Ian Stanley and Chris Hughes with production handled by Hughes. The song was released in 1985 by Phonogram, Mercury and Vertigo Records as the third single from their second album, Songs from the Big Chair. It was the final public performance of drummer Manny Elias, who left the group shortly afterwards.", "prediction 2": "On the 1985 song \"Everybody Wants to Rule the World\", the drummer was Manny Elias, and the song became the final public performance of the band before Elias left the band shortly afterwards.", "prediction 3": "Everybody Wants to Rule the World is a song recorded by English band Tears for Fears. It was written by Roland Orzabal, Ian Stanley, and Chris Hughes with production handled by Hughes. Manny Elias played the drums on the song.", "prediction 4": "The song \"Everybody Wants to Rule the World\" is by English rock band Tears for Fears. It was written by Roland Orzabal, Ian Stanley, and Chris Hughes with production handled by Hughes. Manny Elias played the drums on the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 425 } ], "missing-info": [], "corrected-prediction": "Everybody Wants to Rule the World is a song recorded by English band Tears for Fears. It was the final public performance of drummer Manny Elias." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "What network is a place to call home on?", "passages": [ [ "A Place to Call Home (TV series)", "The timeline of season 5 skips ahead from 1954 to the year 1958.", "Production of \"A Place to Call Home\" resumed in February 2017 with principal photography continuing through July 2017.", "Season 5 premiered on Foxtel's Showcase Channel in Australia starting on 8 October 2017.", "A sixth and final season was announced by Foxtel on 6 December 2017, which was noted to be the last in March 2018.", "The final season began airing on 19 August 2018 and the final episode aired 21 October 2018.", "When Seven Network revealed its new television series lineup for 2012, \"A Place to Call Home\" was mentioned alongside other titles.", "Seven Network's Angus Ross said that it would potentially premiere in late 2012, but would not be rushed to air by a certain date unless \"casting and other elements\" were right.", "The first season of \"A Place to Call Home\" consisted of thirteen episodes.", "The pilot episode was originally broadcast on 28 April 2013, in the 8:30\u00a0pm time slot (previously occupied by \"Downton Abbey\").", "Shortly after airing in Australia \"A Place to Call Home\" started broadcasting on TV One in New Zealand.", "Series one and two began airing on BBC2 in the United Kingdom on 17 November 2014, series three on 25 February 2016, and series four on 13 February 2017." ], [ "A Place to Call Home (TV series)", "Abby Earl told McWhirter, \"We're locked in pre-production in August and then we start filming in September, so there's plenty of time for me to get back in Anna's shoes.\"", "The second season started on 11 May 2014 and concluded on 13 July 2014.", "\"TV Week\" confirmed that a third season had been commissioned.", "In June 2014, however, the magazine reported that Channel Seven had declined the option to renew the series, and that the cast and crew had been told that they would not be required for a third season.", "On 15 October 2014, it was announced that Foxtel had finalised a deal with Channel Seven that would see a third season written by Bevan Lee, produced by Seven Productions, but aired on Foxtel.", "On 25 October 2014, \"The Daily Telegraph\" announced that \"A Place to Call Home\" was renewed for another two seasons and would return in late 2015, airing on Foxtel channel, SoHo.", "It was also announced that all the original cast and crew members would return.", "On 16 August 2015 it was announced via the official Facebook page that season 3 would premiere on 27 September 2015 on SoHo.", "Season 4 premiered on Foxtel's Showcase channel on 11 September 2016.", "Season 5 was announced by Foxtel on 16 November 2016." ], [ "Bevan Lee", "Bevan Lee\n\nBevan Lee is an Australian writer and executive best known for creating the TV dramas \"Sons and Daughters\", \"All Saints\", \"Packed to the Rafters\", \"Winners & Losers\" and \"A Place to Call Home\".", "Lee was an actor before turning to writing, working his way up to be script producer of the TV serial \"Sons and Daughters\".", "He also rewrote the first episode of \"Home and Away\", a show which he has script produced at various stages over the years.", "Lee was network script executive at Channel Nine for eight years in the 1990s before returning to Channel Seven, where he took part in the creation and development of such series as \"All Saints\", \"Always Greener\", \"Marshall Law\" and \"headLand\", forming a notable creative partnership with Seven's head of network drama John Holmes.", "He created a new drama for Seven filmed in 2012, \"A Place to Call Home\".", "Lee is openly gay and in 2007 he was nominated as one of the 25 most influential lesbian and gay people in Australia by online digital media site SameSame." ] ], "gold": "A Place to Call Home is an Australian television drama series created by Bevan Lee for the Seven Network. It premiered on 28 April 2013. On 16 August 2015 it was announced via the official Facebook page that season 3 would premiere on 27 September 2015 on SoHo. Season 4 premiered on Foxtel's Showcase channel on 11 September 2016.", "prediction 1": "A Place to Call Home is an Australian television series produced by Australian writer and executive Bevan Lee. The show is aired on the Seven Network. The first two seasons were broadcast on Seven Network and Foxtel. The fourth season was broadcast on Foxtel.", "prediction 2": "The television series A Place to Call Home premiered on Foxtel's Showcase channel in Australia starting on 8 October 2017. The fifth and final season of A Place to Call Home premiered on Seven Network in October 2016. The series aired on Seven in Australia and New Zealand from September 2016 to March 2018.", "prediction 3": "A Place to Call Home is a drama television series filmed in 2012 for Seven Network. Production of A Place to Call Home resumed in February 2017 with principal photography continuing through July 2017. Season 5 premiered on Foxtel's Showcase Channel in Australia starting on 8 October 2017. The sixth and final season was announced by Foxtel on 6 December 2017 which was noted to be the last in March 2018.", "prediction 4": "A Place to Call Home is an American television series that ran from 2012 to 2019. It was first broadcast on Seven Network. The series ran for five seasons. Season 5 ran for six seasons on Foxtel's Showcase Channel in Australia starting on 8 October 2017.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "A Place to Call Home is an Australian television series produced by Australian writer and executive Bevan Lee. The show is aired on the Seven Network. ", "start": 151, "end": 216 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "A Place to Call Home is an Australian television series produced by Australian writer and executive Bevan Lee. The show is aired the pilot episode on 28 April 2013 on the Seven Network. Shortly after airing in Australia \"A Place to Call Home\" started broadcasting on TV One in New Zealand. Series one and two began airing on BBC2 in the United Kingdom on 17 November 2014, series three on 25 February 2016, and series four on 13 February 2017. On 16 August 2015 it was announced via the official Facebook page that season 3 would premiere on 27 September 2015 on SoHo. Season 4 premiered on Foxtel's Showcase channel." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who plays elizabeth swann in pirates of the caribbean?", "passages": [ [ "Elizabeth Swann", "Elizabeth Swann\n\nElizabeth Swann (later Elizabeth Turner) is a fictional character in the \"Pirates of the Caribbean\" film series.", "She appears in \"\" (2003) and three of its sequels, \"\" (2006), \"\" (2007) and \"\" (2017).", "She is portrayed by Keira Knightley (and as a child by Lucinda Dryzek in the prologue of \"The Curse of the Black Pearl\").", "She is known to use the alias \"Elizabeth Turner\", but this later becomes her married name when she weds the character Will Turner (played by Orlando Bloom).", "Elizabeth is a spirited, intelligent, and independent-minded character whose beauty attracted Will Turner, James Norrington, Sao Feng, and Captain Jack Sparrow.", "Only Will Turner's affections were reciprocated, although she struggled with a subtle attraction and kiss with Sparrow, and a compassionate friendship with Norrington.", "Throughout the three films, she transforms from a young girl to a proper lady and finally into a courageous pirate.", "Elizabeth has always been fascinated by piracy, but she is often revolted by pirates' aggressive, wild nature.", "Even after becoming a pirate, Elizabeth retains her refined ways, as well as her loyalty and compassion for loved ones (including Will Turner, her father, and later, Jack Sparrow and James Norrington)." ], [ "Elizabeth Swann", "Elizabeth Swann appears in the \"Pirates of the Caribbean\" world, Port Royal, of the Disney/Square Enix game \"Kingdom Hearts II\", voiced by Eliza Schneider in the English version (like the other original actors, Keira Knightley was unavailable due to filming \"Dead Man's Chest\" and \"At World's End\") and by Saori Yumiba in the Japanese version.", "She is set to return in Kingdom Hearts III.", "Elizabeth Swann also appears in the video game \"\" as well as \"\" as a playable character in both video games.", "Schneider also performs the voice of Elizabeth Swann again in the video game \"\" and in the video game adaptation of \"\".", "The character also appeared in \"Pirates of the Caribbean Online\"." ] ], "gold": "Elizabeth Swann (later Elizabeth Turner) is a fictional character in the \"Pirates of the Caribbean\" film series. She appears in Pirates of the Caribbean: The Curse of the Black Pearl (2003) and three of its sequels, Dead Man's Chest (2006), At World's End (2007) and Dead Men Tell No Tales (2017) in which she's portrayed by Keira Knightley. She is portrayed as a child by Lucinda Dryzek in the prologue of \"The Curse of the Black Pearl\".", "prediction 1": "Elizabeth Swann is a fictional character in the Pirates of the Caribbean film series. She is portrayed by Keira Knightley and as a child by Lucinda Dryzek in the prologue of The Curse of the Black Pearl. She is also voiced by Eliza Schneider in the English version of the Pirates of the Caribbean video game Kingdom Hearts II. She is also voiced by Saori Yumiba in the Japanese version of the game.\n", "prediction 2": "Elizabeth Swann is a fictional character from the Pirates of the Caribbean film series. She is portrayed by Keira Knightley in the 2003 film and as a child by Lucinda Dryzek in The Curse of the Black Pearl. She is voiced by Eliza Schneider in the English version of the video game Kingdom Hearts II in the Disney/Square Enix game, and by Saori Yumiba in the Japanese version. Elizabeth Swann also appears in the Pirates of the Caribbean Online promo materials.", "prediction 3": "Elizabeth Swann is a fictional character in the Pirates of the Caribbean film series. In the 2003 film, Elizabeth was played by Keira Knightley. In the games Kingdom Hearts II and Pirates of the Caribbean Online, Elizabeth was played by Eliza Schneider. In Pirates of the Caribbean Online, Andrew McGruder plays Elizabeth.", "prediction 4": "Elizabeth Swann is a fictional character in the Pirates of the Caribbean film series. She is portrayed by Keira Knightley (and as a child by Lucinda Dryzek in the prologue of \"The Curse of the Black Pearl) and by Saori Yumiba in the Japanese version. Near the end of 2001, Elizabeth is played by Oneg Ghale, portrayed by Kylie Minogue, and by Kiera Knightley. She is the main antagonist in all of the films and videos in the Caribbean Online.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Elizabeth Swann (later Elizabeth Turner) is a fictional character in the Pirates of the Caribbean film series. She is portrayed by Keira Knightley and as a child by Lucinda Dryzek in the prologue of The Curse of the Black Pearl. She is also voiced by Eliza Schneider in the English version of the Pirates of the Caribbean video game Kingdom Hearts II. She is also voiced by Saori Yumiba in the Japanese version of the game." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What are the three parts of large intestine?", "passages": [ [ "Large intestine", "Large intestine\n\nThe large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates.", "Water is absorbed here and the remaining waste material is stored as feces before being removed by defecation.", "The colon is the largest portion of the large intestine, so many mentions of the large intestine and colon overlap in meaning whenever anatomic precision is not the focus.", "Most sources define the large intestine as the combination of the cecum, colon, rectum, and anal canal.", "Some other sources exclude the anal canal.", "In humans, the large intestine begins in the right iliac region of the pelvis, just at or below the waist, where it is joined to the end of the small intestine at the cecum, via the ileocecal valve.", "It then continues as the colon ascending the abdomen, across the width of the abdominal cavity as the transverse colon, and then descending to the rectum and its endpoint at the anal canal.", "Overall, in humans, the large intestine is about long, which is about one-fifth of the whole length of the gastrointestinal tract.", "The colon is the last part of the digestive system." ], [ "Large intestine", "Gut flora are very dense in this region.", "The sigmoid colon is the part of the large intestine after the descending colon and before the rectum.", "The name \"sigmoid\" means S-shaped (see sigmoid; cf. sigmoid sinus).", "The walls of the sigmoid colon are muscular, and contract to increase the pressure inside the colon, causing the stool to move into the rectum.", "The sigmoid colon is supplied with blood from several branches (usually between 2 and 6) of the sigmoid arteries, a branch of the IMA.", "The IMA terminates as the superior rectal artery.", "Sigmoidoscopy is a common diagnostic technique used to examine the sigmoid colon.", "The rectum is the last section of the large intestine.", "It holds the formed feces awaiting elimination via defecation.", "The cecum \u2013 the first part of the large intestine \n\nThe taenia coli run the length of the large intestine.", "Because the taenia coli are shorter than the large bowel itself, the colon becomes \"sacculated\", forming the haustra of the colon which are the shelf-like intraluminal projections." ] ], "gold": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. The first three largest parts of the large intestine are the ascending colon, transverse colon, and descending colon. Along with these three parts, the rectum and the sigmoid colon make up the five parts of the large intestine.", "prediction 1": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. Water is absorbed here and the remaining waste material is stored as feces before being removed by defecation. The colon is the largest portion of the large intestine, so many mentions of the large intestine and colon overlap in meaning whenever anatomic precision is not the focus. The cecum is the first part of the large intestine. The descending colon is the last part of the digestive system.\n", "prediction 2": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. The cecum is the first part, followed by the colon, then the rectum and the anal canal. The latter part of the large intestine is the largest portion, and the location of this portion is in the right iliac region of the pelvis. These are the following anatomy terms used to define the large intestine: the cecum, colon, rectum, and anal canal.", "prediction 3": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. The cecum is the first part of the large intestine. The taenia coli run the length of the large intestine and are responsible for most of the water intake. The large intestine begins in the right iliac region of the pelvis, just at or below the waist, where it is joined to the end of the small intestine at the cecum. The cecum is the first part of the large intestine. The rectum is the last section of the large intestine.", "prediction 4": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. The water is absorbed here and the remaining waste material is stored as feces before being removed by defecation. The large intestine begins in the right iliac region of the pelvis, just at or below the waist, where it is joined to the end of the small intestine at the cecum, via the ileocecal valve. The sigmoid colon is the part of the large intestine after the descending colon and before the rectum. The rectum is the last section of the large intestine.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 311, "end": 425 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 478, "end": 498 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The large intestine, also known as the large bowel, is the last part of the gastrointestinal tract and of the digestive system in vertebrates. The colon is the largest portion of the large intestine, which continues as the colon ascending the abdomen, across the width of the abdominal cavity as the transverse colon, and then descending to the rectum and its endpoint at the anal canal. The cecum is the first part of the large intestine. The sigmoid colon is the part of the large intestine after the descending colon and before the rectum. The rectum is the last section of the large intestine." }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "When does tokyo ghoul re ep 3 come out?", "passages": [ [ "Tokyo Ghoul", "Tokyo Ghoul\n\nA 12-episode anime television series adaptation by studio Pierrot aired on Tokyo MX between July 4, 2014, and September 19, 2014.", "A 12-episode second season, \"Tokyo Ghoul \u221aA\" (pronounced \"Tokyo Ghoul Root A\"), which follows an original story, began airing on January 9, 2015, and concluded on March 27, 2015.", "In North America, Viz Media is publishing the manga while Funimation has licensed the anime series for streaming and home video distribution.", "A live-action film based on the manga was released in Japan on July 29, 2017.", "An anime adaptation based on the sequel manga \"Tokyo Ghoul:re\" began airing on April 3, 2018, with the series being split into two seasons.", "\"Tokyo Ghoul\" is set in an alternate reality where ghouls, cannibalistic 'monsters' who look exactly like normal people but can only survive by eating human flesh, live among the human population in secret, hiding their true nature in order to evade pursuit from the authorities.", "Including enhanced speed, senses, and regenerative ability, a regular ghoul is several times stronger than a normal human, has a skin resistant to ordinary piercing weapons and has at least one special predatory organ called a , which it can manifest and use as a weapon during combat." ], [ "The Last Rocket", "The Last Rocket\n\nThe Last Rocket is the debut studio album by American rapper Takeoff.", "It was released on November 2, 2018, by Capitol Records, Motown and Quality Control Music.", "\"The Last Rocket\" was first announced through a private party in Los Angeles, California on October 23, 2018.", "The album's release makes Takeoff the second member of Migos to release a solo album, following Quavo's \"Quavo Huncho\" in October 2018.", "Throughout 2018, all three members of Migos began pursuing solo careers, with Quavo being the first member to release a solo album, releasing \"Quavo Huncho\" in October.", "In the previous year, Offset released a collaborative album with 21 Savage and Metro Boomin titled \"Without Warning\".", "Takeoff became the second member to announce a solo album on October 23, at a private listening party held in Los Angeles.", "The title of the album was announced to be \"The Last Rocket\", and Takeoff confirmed it would include production from longtime Migos collaborator DJ Durel.", "A track named \"Infatuation\" was announced to be on the album.", "Two days later, he released his first single off the album, \"Last Memory\", along with the music video." ] ], "gold": "Tokyo Ghoul is an anime television series by Pierrot which aired on Tokyo MX between July 4, 2014 and September 19, 2014, with a second season titled Tokyo Ghoul \u221aA that aired January 9, 2015, to March 27, 2015 and a third season titled Tokyo Ghoul re, a split cour, whose first part aired from April 3, 2018, to June 19, 2018. Episode 3 of season 1 came out on April 17, 2018. Episode 3 of season 2 came out on October 23, 2018. ", "prediction 1": "Tokyo Ghoul A is a manga that started airing in Japan on January 9, 2015. The second version, Tokyo Ghoul:re, began airing on April 3, 2018, with the series being split into two seasons.", "prediction 2": "Tokyo Ghoul Re is a Japanese manga series that began airing on April 3 2018 and is based on the manga Tokyo Ghoul. Episode 3 of the anime series, Tokyo Ghoul A, came out on August 31, 2018. Episode 3 of the anime television series Tokyo Ghoul Re began airing on April 3, 2018 and the Japanese television series Tokyo Ghoul:re began airing on August 24, 2019.", "prediction 3": "Tokyo Ghoul A is a Japanese manga series that is set in an alternate reality where ghouls, cannibalistic'monsters' who look exactly like normal people but can only survive by eating human flesh, live among the human population in secret, hiding their true nature in order to evade pursuit from the authorities. Episode 3 of the anime TV series came out on March 19, 2018. Episode 3 of the sequel manga Tokyo Ghoul re came out on April 3, 2018.", "prediction 4": "Tokyo Ghoul Re is a Japanese manga series from Funimation. The manga was published by Viz Media in North America, and the anime adaptation, Tokyo Ghoul:Re, was published by studio Pierrot in Japan. Episode 3 of the anime series aired on April 3, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 188 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 75, "end": 94 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Tokyo Ghoul is an anime television series by Pierrot which aired on Tokyo MX between July 4, 2014 and September 19, 2014. A second season titled Tokyo Ghoul \u221aA that aired January 9, 2015, to March 27, 2015. An anime adaptation based on the sequel manga \"Tokyo Ghoul:re\" began airing on April 3, 2018." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who played lina in singing in the rain?", "passages": [ [ "Singin' in the Rain (musical)", "\"Singin' in the Rain \" opened on Broadway at the Gershwin Theatre on July 2, 1985 and closed on May 18, 1986 after 367 performances and 38 previews.", "Directed and choreographed by Twyla Tharp, the scenic design was by Santo Loquasto, costume design by Ann Roth, and lighting design by Jennifer Tipton.", "The cast included Don Correia as Don, Mary D'Arcy as Kathy, Peter Slutsker as Cosmo, and Faye Grant as Lina.", "The musical was dramatically revamped.", "The 1983 London Palladium production was remounted in 1994 for an extensive tour of the United Kingdom, which ran until December 1995.", "The new production, again directed by Steele, starred Paul Nicholas as Don, Shona Lindsay as Kathy, Tony Howes as Cosmo with Sarah Payne reprising her role as Lina from the original cast.", "Supporting cast included Matt Zimmerman and Mark Donovan.", "A new production of the musical was staged at the Olivier Theatre (Royal National Theatre), from June 2, 2000 to July 20, 2000 and again from December 18, 2000 to January 27, 2001.", "This production was a transfer from the West Yorkshire production, which ran from December 1999 to February 2000.", "The cast featured Zoe Hart as Kathy, Rebecca Thornhill as Lina, and Paul Robinson as Don." ], [ "Singin' in the Rain", "The film is recognized by the American Film Institute in these lists:\n\nThe 40th Anniversary Edition VHS version released in 1992 includes a documentary, the original trailer, and Reynolds' solo rendition of \"You Are My Lucky Star,\" which had been cut from the final film.", "According to the audio commentary on the 2002 Special Edition DVD, the original negative was destroyed in a fire.", "Despite this, the film was digitally restored for its DVD release.", "A Blu-ray Ultimate Collector's Edition was released in July 2012.", "Comic book adaptation\n\nStage adaptation
\nThe Broadway musical \"Singin' in the Rain\" was adapted from the motion picture, and the plot of the stage version closely adheres to the original.", "Directed and choreographed by post-modern choreographer Twyla Tharp, the opening night cast starred Don Correia as Don Lockwood, Mary D'Arcy as Kathy Selden, Richard Fancy as Roscoe Dexter, Faye Grant as Lina Lamont, and Peter Slutsker as Cosmo Brown.", "The musical opened on July 2, 1985 at the Gershwin Theatre after 39 previews, and ran for 367 performances, closing on May 18, 1986.", "Informational notes\nCitations\nFurther reading" ], [ "Singin' in the Rain", "Singin' in the Rain\n\nSingin' in the Rain is a 1952 American musical-romantic comedy film directed and choreographed by Gene Kelly and Stanley Donen, starring Kelly, Donald O'Connor, and Debbie Reynolds.", "It offers a lighthearted depiction of Hollywood in the late 1920s, with the three stars portraying performers caught up in the transition from silent films to \"talkies\".", "The film was only a modest hit when first released.", "Donald O'Connor won the Golden Globe Award for Best Actor \u2013 Motion Picture Musical or Comedy, and Betty Comden and Adolph Green won the Writers Guild of America Award for their screenplay, while Jean Hagen was nominated for the Academy Award for Best Supporting Actress.", "However, it has since been accorded legendary status by contemporary critics, and is frequently regarded as the best film musical ever made, and the best film ever made in the \"Freed Unit\" at Metro-Goldwyn-Mayer.", "It topped the AFI's Greatest Movie Musicals list and is ranked as the fifth-greatest American motion picture of all time in its updated list of the greatest American films in 2007.", "In 1989, the United States Library of Congress selected the film for preservation in the National Film Registry.", "In 2005 the British Film Institute included it in their list of the 50 films you should see by the age of 14." ] ], "gold": "In the 1952 American musical romantic comedy film Singin' in the Rain, that was directed and choreographed by Gene Kelly and Stanley Donen, Jean Hagen plays Lina. In the dramatically revamped Broadway musical version of Singin' in the Rain that opened at the Gershwin Theatre on July 2, 1985, Faye Grant played the character of Lina. In the 1994 Singin' in the Rain musical tour of the United Kingdom, which ran until December 1995, Sarah Payne, who had previously played the role in 1983 and 1989 productions of the musical, reprised her role as Lina. In the production of the musical that was staged at the Olivier Theatre, from June 22 to July 20, 2000 and again from December 18, 2000 to January 27, 2001, Rebecca Thornhill was featured as Lina. ", "prediction 1": "Singin' in the Rain is a 1952 American musical-romantic comedy film directed and choreographed by Gene Kelly and Stanley Donen, starring Kelly, Donald O'Connor, and Debbie Reynolds. The film was only a modest hit when first released. Faye Grant played Lina Lamont in the film. Rebecca Thornhill played Lina in the stage production.", "prediction 2": "Singin' in the Rain is a 1952 American musical comedy film directed and choreographed by Gene Kelly and Stanley Donen, starring Kelly, Donald O'Connor, and Debbie Reynolds. The film offers a lighthearted depiction of Hollywood in the late 1920s, with the three stars portraying performers caught up in the transition from silent films to talkies. The opening night cast starred Don Correia as Don Lockwood, Mary D'Arcy as Kathy Selden, Richard Fancy as Roscoe Dexter, Faye Grant as Lina Lamont, and Rebecca Thornhill as Lina.", "prediction 3": "Singin' in the Rain is a 1952 American musical film directed and choreographed by Gene Kelly and Stanley Donen, starring Kelly, Donald O'Connor, and Debbie Reynolds. The 1952 film, which was a lighthearted portrayal of Hollywood in the late 1920s, was best known for its lighthearted depiction of Hollywood in the transition from silent films to talkies. The opening night cast starred Faye Grant as Lina Lamont, and the final performance was on May 18, 1986. The 1983 London Palladium production was remounted in 1994 for an extensive tour of the United Kingdom, which ran until December 1995.", "prediction 4": "Singin' in the Rain is a 1952 American film. The opening night cast starred Don Correia as Don Lockwood, Mary D'Arcy as Kathy Selden, Richard Fancy as Roscoe Dexter, Faye Grant as Lina Lamont, and Peter Slutsker as Cosmo Brown. Lina was played by Rebecca Thornhill in the Broadway production. A new production of the Broadway musical was staged at the Olivier Theatre (Royal National Theatre), from December 18, 2000, and January 27, 2001.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 233 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 271, "end": 276 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Singin' in the Rain is a 1952 American musical-romantic comedy film directed and choreographed by Gene Kelly and Stanley Donen. \"Singin' in the Rain \" opened on Broadway at the Gershwin Theatre on July 2, 1985. Faye Grant played Lina Lamont in the Broadway musical. The musical was dramatically revamped. 1994 had an extensive tour in the United Kingdom. Sarah Payne reprising her role as Lina. A new production of the musical was staged at the Olivier Theatre (Royal National Theatre), from June 2, 2000 to July 20, 2000 and again from December 18, 2000 to January 27, 2001. Rebecca Thornhill played Lina in this production." }, "preference": [ 2, 2, 2, 2, 1, 1 ] }, { "question": "Who sings the song what does the fox say?", "passages": [ [ "The Fox (What Does the Fox Say?)", "The brothers Vegard and B\u00e5rd Ylvis\u00e5ker, members of the Norwegian comedy group Ylvis, produced the song and music video \"The Fox\" to promote their upcoming third season of \"I kveld med Ylvis\" on TVNorge.", "In an interview with Norwegian newspaper \"Aftenposten\", the brothers stated that the idea of a song about a fox was originally conceived in 2012, but then shelved.", "Half a year later, in 2013, B\u00e5rd and lyricist Christian L\u00f8chst\u00f8er began to play with the idea once again.", "Vegard was initially skeptical about making a song about a fox, but soon relented.", "In an interview on the Norwegian-Swedish talk show \"Skavlan\", the brothers mentioned that given the opportunity to collaborate with Stargate, they originally wanted to make a dance song about men who cannot dance or dread dancing and named it \"The Dancing Stick\", but felt that the idea was \"too clever\", and that they would appear to be trying to make a hit.", "The idea was therefore scrapped and \"The Fox\" got produced instead.", "B\u00e5rd described the writing process for \"The Fox\" in an interview with \"Billboard\" in the United States: \"The way we work is we just sit around and talk about things and get ideas and take some notes." ] ], "gold": "The brothers Vegard and B\u00e5rd Ylvis\u00e5ker, members of the Norwegian comedy group Ylvis, produced the song and music video \"The Fox\" to promote their upcoming third season of \"I kveld med Ylvis\" on TVNorge.", "prediction 1": "The song \"What the Fox Say\" was produced by the Norwegian comedy group Ylvis, which includes the singers Vegard and Brd Ylvisker, and lyricist Christian Lchster.", "prediction 2": "The song what does the fox say was produced by the Norwegian comedy group Ylvis, the brothers Vegard and Brd Ylvisker, and the music video was created by lyricist Christian Lchster.", "prediction 3": "The Norwegian comedy group Ylvis sings the song \"What the Fox Says\". The song was originally conceived in 2012, but was shelved. In 2013, the brothers Vegard and Brd Ylvisker and lyricist Christian Lchster began to play with the idea once again.", "prediction 4": "The song \"What Does the Fox Say\" was originally written by Vegard and Brd Ylvisker, members of the Norwegian comedy group Ylvis. In the music video, Vegard sang the lead vocals and lyricist Christian Lchster sang the backing vocals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 161 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The brothers Vegard and B\u00e5rd Ylvis\u00e5ker, members of the Norwegian comedy group Ylvis, produced the song and music video \"The Fox\" to promote their upcoming third season of \"I kveld med Ylvis\" on TVNorge." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What percentage is the black population in the united states?", "passages": [ [ "Race and ethnicity in the United States", "Race and ethnicity in the United States\n\nThe United States of America has a racially and ethnically diverse population.", "The United States Census officially recognizes six racial categories: White or European American, Black or African American, American Indian and Alaska Native, Asian American, Native Hawaiian and Other Pacific Islander, and people of two or more races; a category called \"some other race\" is also used in the census and other surveys, but is not official.", "The United States Census Bureau also classifies Americans as \"Hispanic or Latino\" and \"Not Hispanic or Latino\", which identifies Hispanic and Latino Americans as an \"ethnicity\" (not a \"race\") distinct from others, and comprising the largest minority group in the nation.", "The United States Supreme Court unanimously held that \"race\" is not limited to Census designations on the \"race question\" but extends to all ethnicities, and thus can include Jewish and Arab as well as Polish or Italian or Irish, etc.", "In fact, the Census asks an \"Ancestry Question\" which covers the broader notion of ethnicity initially in the 2000 Census long form and now in the American Community Survey.", "The ancestry question will return in the 2020 Census.", ", White Americans are the racial majority.", "African Americans are the largest racial minority, amounting to an estimated 12.7% of the population." ], [ "United States", "In 2010, the U.S. population included an estimated 5.2 million people with some American Indian or Alaska Native ancestry (2.9 million exclusively of such ancestry) and 1.2 million with some native Hawaiian or Pacific island ancestry (0.5 million exclusively).", "The census counted more than 19 million people of \"Some Other Race\" who were \"unable to identify with any\" of its five official race categories in 2010, over 18.5 million (97%) of whom are of Hispanic ethnicity.", "The population growth of Hispanic and Latino Americans (the terms are officially interchangeable) is a major demographic trend.", "The 50.5 million Americans of Hispanic descent are identified as sharing a distinct \"ethnicity\" by the Census Bureau; 64% of Hispanic Americans are of Mexican descent.", "Between 2000 and 2010, the country's Hispanic population increased 43% while the non-Hispanic population rose just 4.9%.", "Much of this growth is from immigration; in 2007, 12.6% of the U.S. population was foreign-born, with 54% of that figure born in Latin America.", "Minorities (as defined by the Census Bureau as all those beside non-Hispanic, non-multiracial whites) constituted 37.2% of the population in 2012 and over 50% of children under age one, and are projected to constitute the majority by 2044." ] ], "gold": "The United States has a racially and ethnically diverse population. According to the 2010 Census, 12.6% of the population of the United States is black. As of July 2016, that percentage is 12.7%.", "prediction 1": "The United States of America has a racially and ethnically diverse population. The census recognizes six racial categories, Black or African American, White or European American, American Indian and Alaska Native, Asian American, Native Hawaiian and Other Pacific Islander, and people of two or more races. African Americans are the largest racial minority, amounting to an estimated 12.7% of the population.", "prediction 2": "As of 2010 the black population in the United States was 12.7%, with some 1.2 million people of some American Indian or Alaska Native ancestry and 1.2 million with some native Hawaiian or Pacific island ancestry. In 2017, the black population was 6.7% in the United States, and in 2020 it would be 7.4%.", "prediction 3": "The United States has a racially and ethnically diverse population. Black Americans are the largest racial minority, amounting to an estimated 12.7% of the population. The 2011 census reported a population of 62,046 (or 6,249,776 in 2010).", "prediction 4": "The United States has a racially and ethnically diverse population. The Census recognizes six racial categories, including White or European American, Black or African American, American Indian and Alaska Native, Asian American, Native Hawaiian and Other Pacific Islander, and people of two or more races. The population growth of Hispanic and Latino Americans, the term officially interchangeable, is a major demographic trend. Approximately 12% of the population is black, and a minority of the population is African American.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 306 } ], "missing-info": [], "corrected-prediction": "The United States of America has a racially and ethnically diverse population. African Americans are the largest racial minority, amounting to an estimated 12.7% of the population." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "When did color tv come out in us?", "passages": [ [ "Color television", "Color television\n\nColor television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set.", "It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray (grayscale).", "Television broadcasting stations and networks in most parts of the world upgraded from black and white to color transmission in the 1970s and 1980s.", "The invention of color television standards is an important part of the history of television, and it is described in the technology of television article.", "Transmission of color images using mechanical scanners had been conceived as early as the 1880s.", "A practical demonstration of mechanically-scanned color television was given by John Logie Baird in 1928, but the limitations of a mechanical system were apparent even then.", "Development of electronic scanning and display made an all-electronic system possible.", "Early monochrome transmission standards were developed prior to the Second World War, but civilian electronics developments were frozen during much of the war.", "In August 1950, Baird gave the world's first demonstration of a practical fully electronic color television display.", "In the United States, commercially competing color standards were developed, finally resulting in the NTSC standard for color that retained compatibility with the prior monochrome system." ], [ "History of television", "Although all-electronic color was introduced in the U.S. in 1953, high prices and the scarcity of color programming greatly slowed its acceptance in the marketplace.", "The first national color broadcast (the 1954 Tournament of Roses Parade) occurred on January 1, 1954, but during the following ten years most network broadcasts, and nearly all local programming, continued to be in black-and-white.", "It was not until the mid-1960s that color sets started selling in large numbers, due in part to the color transition of 1965 in which it was announced that over half of all network prime-time programming would be broadcast in color that fall.", "The first all-color prime-time season came just one year later.", "In 1972, the last holdout among daytime network programs converted to color, resulting in the first completely all-color network season.", "Early color sets were either floor-standing console models or tabletop versions nearly as bulky and heavy, so in practice they remained firmly anchored in one place.", "The introduction of GE's relatively compact and lightweight Porta-Color set in the spring of 1966 made watching color television a more flexible and convenient proposition.", "In 1972, sales of color sets finally surpassed sales of black-and-white sets.", "Color broadcasting in Europe was also not standardized on the PAL format until the 1960s." ] ], "gold": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the TV set. The invention of color television is considered an improvement on the earliest technology which displayed images in shades of gray, and an important part of the history of television. Color TV first came out in the US in 1953, but was not in widespread use until the mid-1960s.", "prediction 1": "A television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray. Television broadcasting stations and networks in most parts of the world upgraded from black and white to color transmission in the 1970s and 1980s. The first national color broadcast occurred on January 1, 1954, but high prices and the scarcity of color programming greatly slowed its acceptance in the marketplace. It was not until the mid-1960s that color sets started selling in large numbers, due in part to the color transition of 1965 in which it was announced that over half of all network prime-time programming would be broadcast in color that fall. The first all-color prime-time season came just one year later. Color broadcasting in 1972, the last holdout among daytime network programs converted", "prediction 2": "Color television is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray. Television broadcasting stations and networks in most parts of the world upgraded from black and white to color transmission in the 1970s and 1980s. The first national color broadcast occurred on January 1, 1954, but it was not until the mid-1960s that color sets started selling in large numbers, due in part to the color transition of 1965 in which it was announced that over half of all network prime-time programming would be broadcast in color that fall. The first all-color prime-time season came just one year later. The first all-color prime-time season came just one year later.", "prediction 3": "Although all-electronic color was introduced in the U.S. in 1953, high prices and the scarcity of color programming greatly slowed its acceptance in the marketplace. It was not until the mid-1960s that color sets started selling in large numbers, due in part to the color transition of 1965, in which it was announced that over half of all network prime-time programming would be broadcast in color that fall. The first all-color prime-time season came just one year later. In 1972, the last holdout among daytime network programs converted to color, resulting in the first completely all-color network season.", "prediction 4": "Color television comes out in the United States in 1973 and in Canada in 1984. It is a television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray. The invention of color television standards is an important part of the history of television, and it is described in the technology of television article.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 526, "end": 629 }, { "error type": "Irrelevant", "explanation": "", "start": 711, "end": 872 }, { "error type": "Irrelevant", "explanation": "", "start": 873, "end": 936 }, { "error type": "Irrelevant", "explanation": "", "start": 937, "end": 1022 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "A television transmission technology that includes information on the color of the picture, so the video image can be displayed in color on the television set. It is an improvement on the earliest television technology, monochrome or black and white television, in which the image is displayed in shades of gray. In August 1950, Baird gave the world's first demonstration of a practical fully electronic color television display. Although all-electronic color was introduced in the U.S. in 1953 and the first national color broadcast occurred on January 1, 1954, it was not until the mid-1960s that color sets started selling in large numbers." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sold the louisiana purchase to the us?", "passages": [ [ "Louisiana Purchase", "Without sufficient revenues from sugar colonies in the Caribbean, Louisiana had little value to him.", "Spain had not yet completed the transfer of Louisiana to France, and war between France and the UK was imminent.", "Out of anger towards Spain and the unique opportunity to sell something that was useless and not truly his yet, Napoleon decided to sell the entire territory.", "Although the foreign minister Talleyrand opposed the plan, on April 10, 1803, Napoleon told the Treasury Minister Fran\u00e7ois Barb\u00e9-Marbois that he was considering selling the entire Louisiana Territory to the United States.", "On April 11, 1803, just days before Monroe's arrival, Barb\u00e9-Marbois offered Livingston all of Louisiana for $15 million, which averages to less than three cents per acre (7\u00a2/ha).", "The American representatives were prepared to pay up to $10 million for New Orleans and its environs, but were dumbfounded when the vastly larger territory was offered for $15 million.", "Jefferson had authorized Livingston only to purchase New Orleans.", "However, Livingston was certain that the United States would accept the offer.", "The Americans thought that Napoleon might withdraw the offer at any time, preventing the United States from acquiring New Orleans, so they agreed and signed the Louisiana Purchase Treaty on April 30, 1803.", "On July 4, 1803, the treaty was announced, but the documents did not arrive in Washington, D.C. until July 14." ], [ "Louisiana Purchase", "However, France's failure to put down the revolt in Saint-Domingue, coupled with the prospect of renewed warfare with the United Kingdom, prompted Napoleon to sell Louisiana to the United States to fund his military.", "The Americans originally sought to purchase only the port city of New Orleans and its adjacent coastal lands, but quickly accepted the bargain.", "The Louisiana Purchase occurred during the term of the third President of the United States, Thomas Jefferson.", "Before the purchase was finalized, the decision faced Federalist Party opposition; they argued that it was unconstitutional to acquire any territory.", "Jefferson agreed that the U.S. Constitution did not contain explicit provisions for acquiring territory, but he asserted that his constitutional power to negotiate treaties was sufficient.", "Throughout the second half of the 18th century, Louisiana was a pawn on the chessboard of European politics.", "It was controlled by the French, who had a few small settlements along the Mississippi and other main rivers.", "France ceded the territory to Spain in the secret Treaty of Fontainebleau (1762).", "Following French defeat in the Seven Years' War, Spain gained control of the territory west of the Mississippi and the British the territory to the east of the river.", "Following the establishment of the United States, the Americans controlled the area east of the Mississippi and north of New Orleans.", "The main issue for the Americans was free transit of the Mississippi to the sea." ], [ "Louisiana Purchase", "Louisiana Purchase\n\nThe Louisiana Purchase ( \"Sale of Louisiana\") was the acquisition of the Louisiana territory () by the United States from France in 1803.", "The U.S. paid fifty million francs ($11,250,000) and a cancellation of debts worth eighteen million francs ($3,750,000) for a total of sixty-eight million francs ($15 million, equivalent to about $600 billion given the GDP of 2017.", "The Louisiana territory included land from fifteen present U.S. states and two Canadian provinces.", "The territory contained land that forms Arkansas, Missouri, Iowa, Oklahoma, Kansas, and Nebraska; the portion of Minnesota west of the Mississippi River; a large portion of North Dakota; a large portion of South Dakota; the northeastern section of New Mexico; the northern portion of Texas; the area of Montana, Wyoming, and Colorado east of the Continental Divide; Louisiana west of the Mississippi River (plus New Orleans); and small portions of land within the present Canadian provinces of Alberta and Saskatchewan.", "Its non-native population was around 60,000 inhabitants, of whom half were African slaves.", "The Kingdom of France controlled the Louisiana territory from 1699 until it was ceded to Spain in 1762.", "In 1800, Napoleon, then the First Consul of the French Republic, hoping to re-establish an empire in North America, regained ownership of Louisiana." ] ], "gold": "The Louisiana Purchase was the acquisition of the territory of Louisiana by the United States from France in 1803. Fran\u00e7ois Barb\u00e9-Marbois, who was acting on behalf of Napoleon, negotiated with American representatives.", "prediction 1": "The Louisiana Purchase was the acquisition of the Louisiana territory by the United States from France in 1803. The purchase occurred during the term of the third president of the United States, Thomas Jefferson. On April 11, 1803, just days before Monroe's arrival, Fran\u00e7ois Barb\u00e9-Marbois offered Livingston all of Louisiana for $15 million, which averages to less than three cents per acre (7/ha). The Americans were dumbfounded when the vastly larger territory was offered for $15 million. The Americans thought that Napoleon might withdraw the offer at any time, so they agreed and signed the Louisiana Purchase Treaty on July 4, 1803.", "prediction 2": "The Louisiana Purchase was the acquisition of the Louisiana territory by the United States from France in 1803. The US paid fifty million francs ($11,250,000) and a cancellation of debts worth eighteen million francs ($3,750,000) for a total of sixty-eight million francs ($15 million, equivalent to about $600 billion given the GDP of 2017).", "prediction 3": "The Louisiana Purchase was the acquisition of the Louisiana territory by the United States from France in 1803. The US paid fifty million francs ($11,250,000) and a cancellation of debts worth eighteen million francs ($3,750,000) for a total of sixty-eight million francs ($15 million), equivalent to about $600 billion given the GDP of 2017.", "prediction 4": "The Louisiana Purchase was the acquisition of the Louisiana territory by the United States from France in 1803. The treaty was signed on April 30, 1803, by President Thomas Jefferson and Treasury Minister Fran\u00e7ois Barb\u00e9-Marbois. Jefferson authorized Livingston to purchase New Orleans, but was dumbfounded when the vastly larger territory was offered for $15 million.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 492 }, { "error type": "Irrelevant", "explanation": "", "start": 493, "end": 639 }, { "error type": "Irrelevant", "explanation": "", "start": 213, "end": 399 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Louisiana Purchase was the acquisition of the Louisiana territory by the United States from France in 1803. On April 10, 1803, Napoleon told the Treasury Minister Fran\u00e7ois Barb\u00e9-Marbois that he was considering selling the entire Louisiana Territory to the United States." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who sings want to get lost in your rock and roll?", "passages": [ [ "Drift Away", "Drift Away\n\n\"Drift Away\" is a song by Mentor Williams and originally recorded by John Henry Kurtz on his 1972 album \"Reunion\".", "Mentor Williams was a country songwriter, and John Henry Kurtz was an actor and swamp rock singer.", "In 1973 the song became Dobie Gray's biggest hit, peaking at number five on the \"Billboard\" Hot 100 and certified gold by the RIAA.", "It was the final pop hit for Decca Records in the United States.", "A new version by Uncle Kracker, with Gray, became a major hit in 2003.", "\"Drift Away\" has been covered by many bands and vocalists around the world.", "Versions include those of Allan Clarke, Roy Orbison, Ike & Tina Turner, Humble Pie, Mud, Rod Stewart, Waylon Jennings, Ray Charles, The Doobie Brothers, the Neville Brothers, Jon Bon Jovi, Michael Bolton, Copperhead, Christian Kane, the Rolling Stones, the Nylons, Ringo Starr, Bruce Springsteen, Judson Spence, Billy Joe Royal, Steve Young and John Kay.", "Folk singer Tom Rush recorded the song on his album What I Know, released in 2009.", "There is an unreleased 1974 recording of this song by the Rolling Stones.", "This version features all of the members of the then-current lineup of the Stones.", "The Heptones recorded a reggae version which is included on many compilation CDs." ], [ "Drift Away", "8 on the \"Billboard\"' Hot Country Singles chart in mid-August 1973, about three months after Gray's version reached its popularity peak.", "This song marked Narvel's first success in the country scene, as he was known from the late 1950s as a rockabilly singer.", "A cover version was released by Uncle Kracker in 2003 from his album \"No Stranger To Shame\".", "This version, which featured Dobie Gray singing the bridge and joining Uncle Kracker on the final verse, reached number nine on the Hot 100.", "It spent a record-setting 28 weeks atop the adult contemporary chart in the U.S. It also peaked at number 25 on the New Zealand Singles chart.", "The music video was directed by Bronston Jones." ] ], "gold": "\"Want to get lost in your rock and roll\" has been sung a number of times. Its original version was sung by John Henry Kurtz, who recorded the song Drift Away in 1972, and Narvel Felts sang a country version of it. Uncle Kracker had a hit in 2003 with it, and Dobie Gray had an international hit with it. Michael Bolton sang the 1992 version of it, with his rendition of Drift Away becoming the only hit version of the song in the United Kingdom.", "prediction 1": "\"Drift Away\" is a song by Mentor Williams and originally recorded by John Henry Kurtz on his 1972 album \"Reunion\". In 1973 the song became Dobie Gray's biggest hit, peaking at number five on the Billboard Hot 100 and certified gold by the RIAA. A new version by Uncle Kracker, with Gray, became a major hit in 2003.", "prediction 2": "\"Drift Away\" is a song by Mentor Williams and originally recorded by John Henry Kurtz on his 1972 album \"Reunion\". It became Dobie Gray's biggest hit, peaking at number five on the Billboard Hot 100 and certified gold by the RIAA. A new version by Uncle Kracker, with Gray, became a major hit in 2003. It was also the final pop hit for Decca Records in the United States.", "prediction 3": "\"Drift Away\" is a song by Mentor Williams and originally recorded by John Henry Kurtz on his 1972 album Reunion. In 1973 the song became Dobie Gray's biggest hit, peaking at number five on the Billboard Hot 100 and certified gold by the RIAA. A new version by Uncle Kracker, with Gray, became a major hit in 2003. A cover version was released by Uncle Kracker in 2003 from his album No Stranger To Shame. This version, which featured Dobie Gray singing the bridge and joining Uncle Kracker on the final verse, reached number nine on the Hot 100. This version, which featured Uncle Kracker singing the final verse.", "prediction 4": "\"Drift Away\" is a song by Mentor Williams and originally recorded by John Henry Kurtz on his 1972 album Reunion. The song became Dobie Gray's biggest hit, peaking at number five on the Billboard Hot 100 and certified gold by the RIAA. Uncle Kracker, with Gray, made a cover version of the song in 2003, which included Dobie Gray singing the bridge and joining Uncle Kracker on the final verse.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 23, "end": 45 }, { "error type": "Irrelevant", "explanation": "", "start": 98, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 244 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8, 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "\"Drift Away\" is a song originally recorded by John Henry Kurtz in 1972. In 1973 the song became Dobie Gray's biggest hit. A new version by Uncle Kracker, with Gray, became a major hit in 2003. Many others have versions such as those of Allan Clarke, Roy Orbison, Ike & Tina Turner, Humble Pie, Mud, Rod Stewart, Waylon Jennings, Ray Charles, The Doobie Brothers, the Neville Brothers, Jon Bon Jovi, Michael Bolton, Copperhead, Christian Kane, the Rolling Stones, the Nylons, Ringo Starr, Bruce Springsteen, Judson Spence, Billy Joe Royal, Steve Young and John Kay. Narvel had a country version. Folk singer Tom Rush and the Rolling Stones had versions as well. The Heptones recorded a reggae version." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Why is there a moon cut out on outhouses?", "passages": [ [ "Outhouse", "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact.", "There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace (the sun and moon being popular symbols for the sexes during those times).", "Others dismiss the claim as an urban legend.", "What is certain is that the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed.", "The shelter may cover very different sorts of toilets.", "An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground.", "When properly built and maintained they can decrease the spread of disease by reducing the amount of human feces in the environment from open defecation.", "When the pit fills to the top, it should be either emptied or a new pit constructed and the shelter moved or re-built at the new location.", "The management of the fecal sludge removed from the pit is complicated.", "There are both environment and health risks if not done properly.", "As of 2013 pit latrines are used by an estimated 1.77 billion people.", "This is mostly in the developing world as well as in rural and wilderness areas." ], [ "Outhouse", "The outhouse also has the secondary role of protecting the toilet hole from sudden influxes of rainwater, which would flood the hole and flush untreated wastes into the underlying soils before they can decompose.", "Outhouses are commonly humble and utilitarian, made of lumber or plywood.", "This is especially so they can easily be moved when the earthen pit fills up.", "Depending on the size of the pit and the amount of use, this can be fairly frequent, sometimes yearly.", "As pundit \"Jackpine\" Bob Cary wrote: \"Anyone can build an outhouse, but not everyone can build a good outhouse.\"", "Floor plans typically are rectangular or square, but hexagonal outhouses have been built.", "The arrangements inside the outhouse vary by culture.", "In Western societies, many, though not all, have at least one seat with a hole in it, above a small pit.", "Others, often in more rural, older areas in European countries, simply have a hole with two indents on either side for your feet.", "In Eastern societies, there is a hole in the floor, over which the user crouches.", "A roll of toilet paper is usually available.", "Old corn cobs, leaves, or other types of paper may instead be used.", "The decoration on the outhouse door has no standard." ] ], "gold": "The decoration on the outhouse door has no standard. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace, but others dismiss the claim as an urban legend. In reality, the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed.", "prediction 1": "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. An outhouse often provides the shelter for a pit latrine, which collects human feces in a hole in the ground. When properly built and maintained they can decrease the spread of disease by reducing the spread of disease by reducing the amount of human feces in the environment from open defecation. When the pit fills to the top, it should be either emptied or a new pit constructed and the shelter moved or re-built at the new location.", "prediction 2": "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. The purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed.", "prediction 3": "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact. Some authors claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. The purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed. The shelter may cover very different sorts of toilets.", "prediction 4": "The well-known crescent moon on American outhouses was popularized by cartoonists and had a questionable basis in fact. Some authors claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. The purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 307, "end": 416 }, { "error type": "Irrelevant", "explanation": "", "start": 417, "end": 604 }, { "error type": "Irrelevant", "explanation": "", "start": 605, "end": 743 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 13 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": " The decoration on the outhouse door has no standard. There are authors who claim the practice began during the colonial period as an early \"mens\"/\"ladies\" designation for an illiterate populace. Others dismiss the claim as an urban legend. What is certain is that the purpose of the hole is for venting and light and there were a wide variety of shapes and placements employed." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "When did michael jordan come to the nba?", "passages": [ [ "Michael Jordan", "Michael Jordan\n\nMichael Jeffrey Jordan (born February 17, 1963), also known by his initials, MJ, is an American former professional basketball player.", "He played 15 seasons in the National Basketball Association (NBA) for the Chicago Bulls and Washington Wizards.", "His biography on the official NBA website states: \"By acclamation, Michael Jordan is the greatest basketball player of all time.\"", "Jordan was one of the most effectively marketed athletes of his generation and was considered instrumental in popularizing the NBA around the world in the 1980s and 1990s.", "He is currently the principal owner and chairman of the NBA's Charlotte Hornets.", "Jordan played three seasons for coach Dean Smith at the University of North Carolina.", "As a freshman, he was a member of the Tar Heels' national championship team in 1982.", "Jordan joined the Bulls in 1984 as the third overall draft pick.", "He quickly emerged as a league star and entertained crowds with his prolific scoring.", "His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness.", "He also gained a reputation for being one of the best defensive players in basketball.", "In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\"." ] ], "gold": "Michael Jordan, also known by his initials MJ, is an American former professional basketball player. Jordan joined the Bulls in 1984 as the third overall draft pick. He quickly emerged as a league star and entertained crowds with his prolific scoring. Although Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Washington Wizards.", "prediction 1": "Michael Jeffrey Jordan was drafted in the third round of the 1984 NBA Draft by the Chicago Bulls. He quickly emerged as a league star and entertained crowds with his prolific scoring. He later joined the Washington Wizards as a free agent. Michael Jordan played 15 seasons in the National Basketball Association (NBA) for the Chicago Bulls and the Washington Wizards.", "prediction 2": "Michael Jordan was drafted in the third round of the 1984 NBA Draft by the Chicago Bulls. He quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness. His reputation for being one of the best defensive players in basketball earned him the nicknames Air Jordan and His Airness. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\".", "prediction 3": "Michael Jeffrey Jordan was an American former professional basketball player. He played 15 seasons in the National Basketball Association for the Chicago Bulls and Washington Wizards. Jordan quickly emerged as a league star and entertained crowds with his prolific scoring. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\".", "prediction 4": "Michael Jordan came to the NBA in 1984 as the third overall draft pick of the Chicago Bulls. Jordan quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness. His reputation for being one of the best defensive players in basketball earned him the nicknames Air Jordan and His Airness.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 367 }, { "error type": "Unverifiable", "explanation": "", "start": 184, "end": 239 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Michael Jordan, also known by his initials MJ, is an American former professional basketball player. Michael Jeffrey Jordan was drafted in the third round of the 1984 NBA Draft by the Chicago Bulls. He quickly emerged as a league star and entertained crowds with his prolific scoring. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who got the powers in wizards of waverly place?", "passages": [ [ "Wizards of Waverly Place", "Excluding the crossover programming special, it was the franchise's most-watched episode.", "The closer also set series best among kids 6\u201311 (4.2 million) and teens 9\u201314 (3.8 million).", "It also obtained a solid 1.9 rating with adults 18\u201349.", "Notably, the finale is the current TV season's most-watched cable telecast among scripted programs.", "The show ended with Alex becoming the family wizard, Justin being declared new Headmaster of WizTech (also keeping his wizard powers), and Max getting to run the sub shop.", "On September 27, 2012, Disney Channel announced that \"Wizards of Waverly Place\" would return for an hour-long special, that began production on October 22, 2012, and ended production on November 10, 2012, for a premiere telecast on the cable channel in early 2013.", "The special, executive-produced by Selena Gomez, alongside series executive producers Vince Cheung and Ben Montanio (who also co-wrote the special with Dan Berendsen), centers on the Russos', Mason, and Harper's visit to Italy to meet long-lost relatives from Jerry's side of the family." ], [ "Wizards of Waverly Place", "The Russos live on Waverly Place in Manhattan's Greenwich Village, above a sandwich shop which they own and run.", "The family consists of siblings Alex (Selena Gomez), Justin (David Henrie), and Max (Jake T. Austin).", "The three teenagers are wizards and live with their Italian father, Jerry (David DeLuise), a former family wizard, and their mortal Mexican mother, Theresa (Maria Canals Barrera).", "When the Russo siblings complete their wizard training, they have to participate in a competition to decide who will become the Family Wizard (the one to keep his/her magical powers forever) of their generation, while the others lose their powers and become mortals.", "Because of this, Jerry tries to teach his children to not become dependent on magic.", "Since one of them gets to keep their powers, though, Jerry also gives his children wizard lessons (the lessons end mid Season four).", "The storage room of the Russo family's sub station is a wizard's lair.", "In the lair is a Portal which allows them to visit the wizard world, and other creatures to visit them.", "The headmaster of the wizard council, Professor Crumbs (Ian Abercrombie), regularly pays visits to the Russo home." ] ], "gold": "On Wizards of Waverly Place, three siblings, Alex, Justin, and Max Russo, received daily lessons from their father, Jerry Russo, to use their wizard magic correctly. Once they completed their training, the Russo children competed to determine which sibling would retain their powers permanently and become the sole wizard of the family. Alex Russo got the family wizard powers, and Justin Russo got to keep his powers after being declared Headmaster at the end of Waverly Place. Max Russo got the powers but lost them and went on to run the family's sub shop.", "prediction 1": "The show Wizards of Waverly Place begins with Alex, Justin, and Max Russo, all of whom are wizards, living with their Italian father, Jerry, a former family wizard, and their mortal Mexican mother, Theresa. When the Russo siblings finish their wizard training, they have to participate in a competition to decide who will become the Family Wizard of their generation, the one to keep his/her magical powers forever. Justin gets the powers in the final episode, and Alex gets the powers in the final episode.", "prediction 2": "The show Wizards of Waverly Place is a reality TV series that centers on the Russo family, who are wizards living with their Italian father, Jerry (David DeLuise), a former family wizard, and their mortal Mexican mother, Theresa (Maria Canals Barrera). Alex, Justin, and Jake T. Austin, played by Selena Gomez, become the family wizard after completing their wizard training, and are competing to be the one to keep their powers forever. Since one of them gets to keep their powers, though, Jerry also gives his children wizard lessons.", "prediction 3": "The show Wizards of Waverly Place is an American fantasy television series that centers on the Russo family, a group of three teenagers who are wizards living with their Italian father, Jerry (David DeLuise), a former family wizard, and their mortal Mexican mother, Theresa (Maria Canals Barrera). When the Russo siblings complete their wizard training, they have to participate in a competition to decide who will become the Family Wizard (the one to keep his/her magical powers forever) of their generation, while the others lose their powers and become mortals. Since one of them gets to keep their powers, though, Jerry also gives his children wizard lessons.", "prediction 4": "Wizard of Waverly Place focuses on the Russo family, a wizard family that lives with their Mexican mother, Theresa (Maria Canals Barrera). In Season 4, Alex, Justin, and Max get the powers, while Justin gets them from their Uncle Jim, the Headmaster of WizTech.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 206 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The show Wizards of Waverly Place begins with Alex, Justin, and Max Russo, all of whom are wizards, living with their Italian father, Jerry, a former family wizard. Jerry also gives his children wizard lessons. When the Russo siblings finish their wizard training, they have to participate in a competition to decide who will become the Family Wizard of their generation, the one to keep his/her magical powers forever. The show ended with Alex becoming the family wizard, Justin being declared new Headmaster of WizTech (also keeping his wizard powers), and Max getting to run the sub shop." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the legal age for drinking in italy?", "passages": [ [ "LGBT rights in Azerbaijan", "LGBT rights in Azerbaijan\n\nLesbian, gay, bisexual and transgender (LGBT) people in Azerbaijan may face legal challenges not experienced by non-LGBT residents.", "Same-sex sexual activity has been legal in Azerbaijan since 1 September 2000.", "Nonetheless, discrimination on the basis of both sexual orientation and gender identity is not banned in the country and same-sex marriage is outlawed.", "In 2016, the ILGA ranked Azerbaijan as the worst place (49 out of 49) in Europe to be LGBT, citing \"a near total absence of legal protection\" for LGBT individuals.", "In 2017, ILGA-Europe again declared Azerbaijan the worst country in all of Europe for LGBT rights, with the country receiving a final score of 5%.", "In September 2017, reports emerged that at least 100 members of Baku's LGBT community were arrested, ostensibly as part of a crackdown on prostitution.", "Activists reported that these detainees were subject to beatings, interrogation, forced medical examinations and blackmail.", "LGBT people face high rates of violence, harassment and discrimination.", "After declaring independence from Russia in 1918, the Azerbaijan Democratic Republic did not have laws against homosexuality.", "When Azerbaijan became a part of the Soviet Union in 1920, it was subject to rarely enforced Soviet laws criminalizing the practice of sex between men." ] ], "gold": "Prior to 2012 the legal age to purchase alcohol in Italy was 16. In 2012 the law changed and required someone to be 18 to purchase alcohol in Italy. None of the laws in Italy require a legal drinking in either private or in public.", "prediction 1": "In Italy, the legal age to drink is 21. The legal age to purchase alcohol in Italy is 21.\n", "prediction 2": "In Italy, 21 is the legal age to drink. However, discrimination on the basis of both sexual orientation and gender identity is not banned in the country and same-sex marriage is outlawed.", "prediction 3": "In Italy, it is legal for minors to drink alcohol under the age of 21.", "prediction 4": "In Italy, 18 years old is the minimum age to drink alcohol. However, since 2015, the absolute limit for drinking age was 21 in new laws.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 90 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "When's the last time the angels won the world series?", "passages": [ [ "History of the Los Angeles Angels", "History of the Los Angeles Angels\n\nThe Los Angeles Angels are a professional baseball team is based in Anaheim, California.", "The Angels compete in Major League Baseball (MLB) as a member club of the American League (AL) West division.", "The \"Angels\" name originates from the city that was their original home, Los Angeles, and was inspired by a minor league club of the same name.", "The Angels have played home games at Angel Stadium since 1966.", "For many years, there had been talk of an existing American League team relocating to Los Angeles.", "In 1940, the St. Louis Browns asked AL owners for permission to move to Los Angeles, but were turned down.", "They planned another move for the 1942 season, and this time got permission from the league.", "A schedule was even drawn up including Los Angeles, but the bombing of Pearl Harbor in December 1941 made major-league sports of any sort on the West Coast unviable.", "In 1953, there was again talk of the Browns moving to L.A. for the 1954 season, but the team was sold and moved to Baltimore instead as the Orioles.", "There were on-again, off-again discussions between city officials and the Washington Senators regarding a possible move.", "There were also rumors that the Philadelphia Athletics' move to Kansas City in 1955 was a temporary stop on the way to Los Angeles." ], [ "John Lackey", "John Lackey\n\nJohn Derran Lackey (born October 23, 1978) is an American professional baseball starting pitcher who played in Major League Baseball from 2002 through 2017 for the Los Angeles Angels of Anaheim, Boston Red Sox, St. Louis Cardinals and Chicago Cubs.", "A three-time World Series champion, Lackey is regarded as a key figure in his clubs' postseason success, winning the title-clinching games of two out of the three Series.", "Selected to the MLB All-Star Game in 2007, he won that year's American League (AL) earned run average (ERA) title.", "After missing the 2012 season due to ulnar collateral ligament reconstruction surgery in his pitching elbow, and helping the Red Sox win the 2013 World Series, Lackey was named the winner of the Tony Conigliaro Award.", "A right-handed pitcher and batter, the Anaheim Angels selected Lackey from Grayson County College in Texas in the 1999 amateur draft.", "He made his MLB debut with the Angels in 2002 and helped the franchise win its first World Series title that year.", "After winning more than 100 games with the Angels, Lackey signed with Boston in free agency prior to the 2010 season.", "Declining performance and elbow injuries in 2011 led him to allow the most earned runs in the American League before missing the next season due to elbow surgery.", "Lackey rebounded in 2013 to win his second championship." ], [ "Angel Stadium", "Angel Stadium again hosted All-Star Games in 1989 and 2010.", "It hosted seven American League Division Series (2002, 2004, 2005, 2007, 2008, 2009, and 2014) and six American League Championship Series (1979, 1982, 1986, 2002, 2005, and 2009).", "Most notably, it hosted the 2002 World Series, which the Angels won in dramatic fashion over the San Francisco Giants, finally winning one for their late and long-time owner, \"Singing Cowboy\" Gene Autry (and for his widow and business partner Jackie, who is also honorary president of the American League).", "Angel Stadium hosted several games during Round 2 of the 2006 World Baseball Classic.", "Famous individual baseball milestones attained here include Mickey Mantle's last game-winning home run, Nolan Ryan's striking out of nine straight Boston Red Sox, Reggie Jackson's 500th career home run, Rod Carew's 3,000th career base hit, Vladimir Guerrero's 400th career home run, George Brett's 3,000th career base hit, and Albert Pujols' 600th career home run.", "On Saturday, August 9, 2014, the stadium hosted its longest game ever: a 6-hour, 31-minute contest between the Angels and the Boston Red Sox." ] ], "gold": "The Los Angeles Angels are an American professional baseball team based in the Los Angeles metropolitan area. The Angels compete in Major League Baseball (MLB) as a member club of the American League (AL) West division. Since 1966, the team has played its home games at Angel Stadium in Anaheim. The Angels won the 98th edition of the World Series in October 27,2002, their first and only championship appearance. They are one of three MLB franchises to win their sole appearance in the World Series.", "prediction 1": "The Los Angeles Angels compete in Major League Baseball as a member club of the American League West division. In the past, the Angels have won the World Series three times, most notably in 2002 and 2013. In 2017, the Angels won the World Series in 2018 and again in 2019. In 2018, the Angels won the World Series in 2019.", "prediction 2": "The Los Angeles Angels are a professional baseball team based in Anaheim, California. They compete in Major League Baseball as a member club of the American League West division. The last time the Angels won the World Series was in 2003. They also won the World Series in 2008, 2009, and 2017.", "prediction 3": "The Los Angeles Angels have played home games at Angel Stadium since 1966. In 2018, the Angels won the World Series for the first time in a postseason since 2003. In 2015, the Angels won the World Series for the second time in 2017.", "prediction 4": "The Los Angeles Angels are a professional baseball team based in Anaheim, California. The team competes in Major League Baseball as a member club of the American League West division. The last time the Angels won the World Series was in 2002.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 161, "end": 173 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 199, "end": 204 }, { "error type": "Redundant", "explanation": "The Los Angeles Angels compete in Major League Baseball as a member club of the American League West division. In the past, the Angels have won the World Series three times, most notably in 2002 and 2013. ", "start": 205, "end": 272 }, { "error type": "Redundant", "explanation": "The Los Angeles Angels compete in Major League Baseball as a member club of the American League West division. In the past, the Angels have won the World Series three times, most notably in 2002 and 2013. ", "start": 273, "end": 322 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Los Angeles Angels, based in Anaheim, California, compete in Major League Baseball as a member club of the American League West division. The Angels have played home games at Angel Stadium since 1966. The Angels hosted the World Series in 2002 and won its first World Series title. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings get it on bang a gong?", "passages": [ [ "Get It On (T. Rex song)", "Get It On (T. Rex song)\n\n\"Get It On\" is a song by the British glam rock group T. Rex, featured on their 1971 album \"Electric Warrior\".", "Written by frontman Marc Bolan, \"Get It On\" was the second chart-topper for T. Rex on the UK Singles Chart.", "In the United States, it was retitled \"Bang a Gong (Get It On)\" to avoid confusion with a song of the same name by the group Chase.", "Bolan claimed to have written the song out of his desire to record Chuck Berry's \"Little Queenie\", and said that the riff is taken from the Berry tune.", "In fact, a line (\"And meanwhile, I'm still thinking\") of \"Little Queenie\" is said at the fade of \"Get It On\".", "This was the song that virtually ended the once-solid friendship between Bolan and John Peel, after Peel made clear his lack of enthusiasm for it on air after playing his advance white label copy.", "Bolan and Peel only spoke once more before the former's death in 1977.", "During a December 1971 \"Top of the Pops\" performance, Elton John mimed a piano on the song.", "This performance is usually the video clip for the song which has aired on various music-video outlets such as VH1 Classic." ], [ "Get It On (T. Rex song)", "The track was recorded at Trident Studios, London and the piano on the record was performed by either Rick Wakeman or Blue Weaver.", "Mark Paytress notes that both pianists may have played separate parts on the song, with Wakeman contributing only the piano glissandos that feature several times throughout the song.", "Wakeman, who was desperate for work at the time to pay his rent, had bumped into Bolan in Oxford Street, who offered him the session.", "Wakeman pointed out to Tony Visconti that the record did not actually need a piano player.", "Visconti suggested that he could add a gliss; Wakeman said that Visconti could do that, to which Bolan replied, \"you want your rent, don't you?\"", "Wakeman did and earned \u00a39 for his efforts.", "Saxophones were played by Ian McDonald of King Crimson.", "Producer Visconti later recalled: \"He played all the saxes, one baritone and two altos.", "I kept the baritone separate but bounced the altos to one track.", "I bounced the backup vocals to two tracks, making an interesting stereo image.\"", "Mark Volman and Howard Kaylan (formerly The Turtles) provided back up vocals." ] ], "gold": "The group that sang \"Bang a Gong (Get It On)\" is the English glam rock group, T. Rex. Marc Bolan was the lead vocals and one of the guitarists of the group. The other individuals who sang the song include Bill Legend, Mickey Finn, Marc Bolan, and Steve Currie. ", "prediction 1": "\"Get It On\" is a song by the British glam rock group T. Rex, featured on their 1971 album Electric Warrior. Written by frontman Marc Bolan, \"Get It On\" was the second chart-topper for T. Rex on the UK Singles Chart. In the United States, it was retitled \"Bang a Gong (Get It On)\" to avoid confusion with a song of the same name by the group Chase.", "prediction 2": "\"Get It On\" is a song by the British glam rock group T. Rex, featured on their 1971 album \"Electric Warrior\". Written by frontman Marc Bolan, \"Get It On\" was the second chart-topper for T. Rex on the UK Singles Chart. In the United States, it was retitled \"Bang a Gong (Get It On)\" to avoid confusion with a song of the same name by the group Chase.", "prediction 3": "\"Get It On\" is a song by the British glam rock group T. Rex, featuring on their 1971 album \"Electric Warrior\". Written by frontman Marc Bolan, \"Get It On\" was the second chart-topper for T. Rex on the UK Singles Chart. In the United States, it was retitled \"Bang a Gong (Get It On)\" to avoid confusion with a song of the same name by the group Chase. During a December 1971 Top of the Pops, Elton John mimed a piano on the song.", "prediction 4": "\"Bang a Gong (Get It On)\" is a song by the British glam rock group T. Rex, featured on their 1971 album Electric Warrior. Written by frontman Marc Bolan, \"Get It On\" was the second chart-topper for T. Rex on the UK Singles Chart. In the United States, it was retitled \"Bang a Gong (Get It On)\" to avoid confusion with a song of the same name by the group Chase. On a December 1971 Top of the Pops performance, Elton John mimed a piano on the song. This performance is usually the video clip for the song, which has aired on various music-video outlets such as VH1 Classic.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 215 }, { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 347 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 107 } ], "missing-info": [], "corrected-prediction": "\"Get It On\" is a song by the British glam rock group T. Rex written by frontman Marc Bolan." }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Which is the most powerful god in hinduism?", "passages": [ [ "Hindu mythological wars", "Both a Supreme Being and an energy that is considered to be the source of all works of creation, preservation and destruction, Adi Parashakti is the mother of Trimurti, the universe and all of creation.", "She took many incarnations to fight with demons, including Parvati, wife of Shiva, the complete avatar of Shakti herself, according to the Devi Gita and Durga Saptashati, the main scriptures for Shakti worshipers.", "As the goddess Parvati, she is considered to be the most powerful of all deities.", "Sometimes, the gods worship Parvati, who came before them in different \"avatars\":\n\nApart from Parvati, there are some demons who were killed by Laksmi's incarnation.", "One example is Muru.", "Shakti is usually depicted as having the weapons of all the gods, even the Trimurti.", "She holds the trident of Shiva, the \"Chakra\" of Vishnu, the \"Vajra\" of Indra, the \"Gada\" of Yamaraaj.", "It indicates that she is the one who actually having all kinds of powers.", "It is she from whom strength arose.", "It is she from whom all powers of nondimensional formless GOD (Not talking about Brahma, Vishnu or Shiva) is vested.", "She is all powerful.", "All in one and one in all too." ], [ "Shiva", "How the persona of Shiva converged as a composite deity is not understood, a challenge to trace and has attracted much speculation.", "According to Vijay Nath, for example: \nAn example of assimilation took place in Maharashtra, where a regional deity named Khandoba is a patron deity of farming and herding castes.", "The foremost center of worship of Khandoba in Maharashtra is in Jejuri.", "Khandoba has been assimilated as a form of Shiva himself, in which case he is worshipped in the form of a lingam.", "Khandoba's varied associations also include an identification with Surya and Karttikeya.", "Shaivism is one of the four major sects of Hinduism, the others being Vaishnavism, Shaktism and the Smarta Tradition.", "Followers of Shaivism, called \"Shaivas\", revere Shiva as the Supreme Being.", "Shaivas believe that Shiva is All and in all, the creator, preserver, destroyer, revealer and concealer of all that is.", "He is not only the creator in Shaivism, he is the creation that results from him, he is everything and everywhere.", "Shiva is the primal soul, the pure consciousness and Absolute Reality in the Shaiva traditions." ], [ "Hinduism", "Hinduism\n\nHinduism is an Indian religion and \"dharma\", or way of life, widely practised in the Indian subcontinent and parts of Southeast Asia.", "Hinduism has been called the oldest religion in the world, and some practitioners and scholars refer to it as \"San\u0101tana Dharma\", \"the eternal tradition\", or the \"eternal way\", beyond human history.", "Scholars regard Hinduism as a fusion or synthesis of various Indian cultures and traditions, with diverse roots and no founder.", "This \"Hindu synthesis\" started to develop between 500 BCE and 300 CE, after the end of the Vedic period (1500 BCE to 500 BCE), and flourished in the medieval period, with the decline of Buddhism in India.", "Although Hinduism contains a broad range of philosophies, it is linked by shared concepts, recognisable rituals, cosmology, shared textual resources, and pilgrimage to sacred sites.", "Hindu texts are classified into \u015aruti (\"heard\") and Sm\u1e5bti (\"remembered\").", "These texts discuss theology, philosophy, mythology, Vedic yajna, Yoga, agamic rituals, and temple building, among other topics.", "Major scriptures include the Vedas and Upanishads, the \"Bhagavad Gita\", and the \u0100gamas." ] ], "gold": "Hinduism is an Indian religion and way of life with many deities that have different degrees of power. In the Shaktism sect, one of the four major sects of Hinduism, the goddess Parvati, who is both a Supreme Being and an energy, is the most powerful deity. In terms of physical strength, Hanuman is the most powerful god in Hinduism. His strength was given to him by his father and by gifts he received from various gods.", "prediction 1": "Shiva is considered to be the most powerful god in Hinduism. Shiva is worshipped by Shaivas, followers of Vaishnavism, Shaktism and the Smarta Tradition. Parvati is considered to be the most powerful goddess in Hinduism.", "prediction 2": "Shiva has been considered the most powerful god in Hinduism. Shiva is revered as the Supreme Being. Parvati is considered the most powerful god in Hinduism. Shiva is also considered to be the most powerful god in Buddhism and some Hinduisms.", "prediction 3": "Shiva is the most powerful god in Hinduism. According to Hindu mythology, Parvati is the most powerful goddess. Shiva is considered the most powerful god in Hinduism.", "prediction 4": "Shiva is considered the most powerful god in Hinduism. Adi Parashakti, sister of Shiva, is considered to be the most powerful god in Hinduism. Shiva is worshipped as a form of Shakti, the goddess of the worlds. Shakti is also considered to be the most powerful god in Hinduism.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 0, "end": 60 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 61, "end": 153 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 154, "end": 220 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Shiva is considered to be the Supreme Being and is worshipped by Shaivas, followers of Shaivism one of the four major sects of Hinduism. The goddess Parvati, who is both a Supreme Being and an energy, is considered to be the most powerful of all deities by Shakti worshipers, followers of the Shaktism sect." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who sang hello mother hello father here i am at camp granada?", "passages": [ [ "Hello Muddah, Hello Fadduh (A Letter from Camp)", "Hello Muddah, Hello Fadduh (A Letter from Camp)\n\n\"Hello Muddah, Hello Fadduh (A Letter from Camp)\" is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York.", "The song is a parody that complains about the fictional \"Camp Granada\" and is set to the tune of Amilcare Ponchielli's \"Dance of the Hours\".", "The name derives from the first lines:\n\nThe lyrics go on to describe unpleasant, dangerous, and tragic developments, such as fellow campers going missing or contracting deadly illnesses.", "He asks how his \"precious little brother\" is doing, and begs to be taken home, afraid of being left out in the forest and fearing getting eaten by a bear, promising to behave, and even letting his aunt Bertha hug and kiss him.", "At the end, he notes that the rain has stopped and fun activities have begun (such as swimming, sailing, and baseball), and asks his parents to \"kindly disregard this letter\".", "After the song scored #2 on the \"Billboard\" Hot 100 list for three weeks beginning on August 24, 1963." ], [ "Hello Muddah, Hello Fadduh (A Letter from Camp)", "The Swedish version notably does not revolve around the camper hating the camp, but is about the kids running roughshod over it and having run off all the counselors, one of whom has committed suicide after they let a snake into the mess hall, and the organizer of the camp being arrested by police after the kids start a forest fire.", "The song begins with the boy writing the letter asking his parents to send more money, because he has lost all his pocket money playing dice with the other campers.", "The song then ends with the boy having to wrap up the letter as he is about to join the others in burning down the neighboring camp lodge.", "The Dutch version \"Brief uit la Courtine\" sung bij Rijk de Gooyer is not about a children's summer camp, but about a soldier in the Dutch army camp at La Courtine, France." ], [ "Hello Muddah, Hello Fadduh (A Letter from Camp)", "It was kept from #1 by both: Fingertips by \"Little\" Stevie Wonder and My Boyfriend's Back by The Angels.", "Sherman wrote a new 'back at Camp Granada' version, \"Hello Mudduh, Hello Fadduh!", "\", for a May 27, 1964, performance on \"The Tonight Show Starring Johnny Carson\".", "Sherman wrote a third version for, and acted in, a 1965 TV commercial for a board game about Camp Granada, a \"real rotten camp\".", "The original version also reached #9 on the Pop-Standard Singles chart.", "The song won a 1964 Grammy Award for comedy.", "The song was played often on the \"Dr. Demento Show\" and is featured on the Rhino Records compilation album, \"Dr. Demento 20th Anniversary Collection\".", "Variations of the song include adaptations in Swedish (\"Brev fr\u00e5n kolonien\" by Cornelis Vreeswijk), Finnish (\"Terve mutsi, terve fatsi, t\u00e4ss\u00e4 teid\u00e4n ihmelapsi\") and Norwegian (\"Brev fra leier'n\" by Birgit Str\u00f8m).", "The Finnish version is included in the Finnish Boy Scouts' songbook." ] ], "gold": "\"Hello Muddah, Hello Fadduh (A Letter from Camp)\" is a novelty song sang by Allan Sherman. There have been several variations of the song, including a Dutch version sang by Rijk de Gooyer and a German interpretation sang by Paul Pizzera.", "prediction 1": "Hello Muddah, Hello Fadduh (A Letter from Camp) is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional Camp Granada and is set to the tune of Amilcare Ponchielli's \"Dance of the Hours\". The Swedish version of the song is titled \"Brief uit la Courtine\" and was sung by Rijk de Gooyer. The Dutch version of the song is sung by the Dutch singers Van Aan van der Gooyer is not about a children's, but rather about a soldier in the Dutch army camp at La Courtine, France. The Dutch version of the song is sung by Birgit Strm. The", "prediction 2": "Hello Muddah, Hello Fadduh (A Letter from Camp) is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional Camp Granada and is set to the tune of Amilcare Ponchielli's Dance of the Hours. The Swedish version notably does not revolve around the camper hating it, but is about the kids running roughshodshod over it and having run off all the counselors, one who has committed suicide after they let a snake into the mess hall, and the organizer is arrested by police after the kids start a forest fire. The Dutch version \"Brief uit la Courtine\" s about a soldier in the Dutch army camp at La Courtine, France,", "prediction 3": "Hello Mother Hello Father Here I Am At Camp Granada is a novelty song based on letters of complaint Allan Sherman received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional camp, Camp Granada. The Swedish version notably does not revolve around the camper hating it, but is about the kids running roughshod over it and having run off all the counselors, one of whom has committed suicide after they let a snake into the mess hall. The Dutch version \"Brief uit la Courtine\" sung bij Rijk de Gooyer is not about a children's summer camp, but about a soldier in the Dutch army camp at La Courtine, France.", "prediction 4": "\"Hello Muddah, Hello Fadduh (A Letter from Camp)\" is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional Camp Granada and is set to the tune of Amilcare Ponchielli's \"Dance of the Hours\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 222 }, { "error type": "Irrelevant", "explanation": "", "start": 223, "end": 361 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 366, "end": 373 }, { "error type": "Redundant", "explanation": "Hello Muddah, Hello Fadduh (A Letter from Camp) is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional Camp Granada and is set to the tune of Amilcare Ponchielli's \"Dance of the Hours\". The Swedish version of the song is titled \"Brief uit la Courtine\" and was sung by Rijk de Gooyer. ", "start": 460, "end": 541 }, { "error type": "Irrelevant", "explanation": "", "start": 542, "end": 642 }, { "error type": "Redundant", "explanation": "Hello Muddah, Hello Fadduh (A Letter from Camp) is a novelty song by Allan Sherman and Lou Busch, based on letters of complaint Allan received from his son Robert while Robert attended Camp Champlain in Westport, New York. The song is a parody that complains about the fictional Camp Granada and is set to the tune of Amilcare Ponchielli's \"Dance of the Hours\". The Swedish version of the song is titled \"Brief uit la Courtine\" and was sung by Rijk de Gooyer.", "start": 643, "end": 700 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "Hello Muddah, Hello Fadduh (A Letter from Camp) is a novelty song sung by Allan Sherman. The Dutch version of the song is titled \"Brief uit la Courtine\" and was sung by Rijk de Gooyer. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who is the leading run scorer in cricket?", "passages": [ [ "One Day International", "One Day International\n\nA One Day International (ODI) is a form of limited overs cricket, played between two teams with international status, in which each team faces a fixed number of overs, usually 50.", "The Cricket World Cup is played in this format, which is generally held every four years.", "One Day International matches are also called Limited Overs Internationals (LOI), although this generic term may also refer to Twenty20 International matches.", "They are major matches and considered the highest standard of List A, limited overs competition.", "The international one-day game is a late-twentieth-century development.", "The first ODI was played on 5 January 1971 between Australia and England at the Melbourne Cricket Ground.", "When the first three days of the third Test were washed out officials decided to abandon the match and, instead, play a one-off one-day game consisting of 40 eight-ball overs per side.", "Australia won the game by 5 wickets.", "ODIs were played in white kits with a red ball.", "In the late 1970s, Kerry Packer established the rival World Series Cricket competition, and it introduced many of the features of One Day International cricket that are now commonplace, including coloured uniforms, matches played at night under floodlights with a white ball and dark sight screens, and, for television broadcasts, multiple camera angles, effects microphones to capture sounds from the players on the pitch, and on-screen graphics." ], [ "First-class cricket", "First-class cricket\n\nFirst-class cricket is an official classification of the highest-standard international or domestic matches in the sport of cricket.", "A first-class match is of three or more days' scheduled duration between two sides of eleven players each and is officially adjudged to be worthy of the status by virtue of the standard of the competing teams.", "Matches must allow for the teams to play two innings each although, in practice, a team might play only one innings or none at all.", "First-class cricket (which for this purpose includes all \"important matches\" played before 1895), along with historical single-wicket and the modern limited-overs forms of List A and Twenty20, is one of the highest-standard forms of cricket.", "The origin of the term \"first-class cricket\" is unknown but it was used loosely before it acquired an official status, effective in 1895, following a meeting of leading English clubs in May 1894.", "Subsequently, at a meeting of the Imperial Cricket Conference (ICC) in May 1947, it was formally defined on a global basis.", "A significant omission of the ICC ruling was any attempt to define first-class cricket retrospectively.", "This has left historians, and especially statisticians, with the problem of how to categorise earlier matches, especially those played before 1895 in Great Britain." ], [ "List A cricket", "List A cricket\n\nList A cricket is a classification of the limited-overs (one-day) form of the sport of cricket.", "List A cricket includes One Day International (ODI) matches and various domestic competitions in which the number of overs in an innings per team ranges from forty to sixty, as well as some international matches involving nations who have not achieved official ODI status.", "Together with first-class and Twenty20 cricket, List A is one of the three major forms of cricket recognised by the International Cricket Council (ICC).", "Most Test cricketing nations have some form of domestic List A competition.", "The scheduled number of overs in List A cricket ranges from forty to sixty overs per side.", "The categorisation of cricket matches as \"List A\" was not officially endorsed by the International Cricket Council until 2006, when the ICC announced that it and its member associations would be determining this classification in a manner similar to that done for first-class matches.", "The Association of Cricket Statisticians and Historians created this category for the purpose of providing an equivalent to first-class cricket, to allow the generation of career records and statistics for comparable one-day matches.", "Only the more important one-day competitions in each country, plus matches against a touring Test team, are included.", "The list was the work of Philip Bailey and the name is derived simply from there being a list A and a list B." ] ], "gold": "The leading run-scorer in cricket is dependent on the tournament and the time limits. ODI (One Day International) is a form of limited-overs cricket that can last up to 9 hours, and the leading run-scorer is Sachin Tendulkar, who is also the leading run-scorer in Test cricket. List A cricket games is also a form of limited-overs with games lasting up to eight hours, and the leading run-scorer is Graham Alan Gooch. First-class cricket is the highest-standard international or domestic matches in cricket, and Jack Hobbs is the leading run-scorer.", "prediction 1": "The top run scorer in international cricket is the captain of the winning team. The top run scorer in international cricket is the captain of the losing team. The top run scorer in a One Day International is the captain of the losing team. The top run scorer for England in a One Day International is the captain of the losing team.", "prediction 2": "The leading run scorer in international cricket is Virat Kohli. In the sport of cricket, the leading run scorer is a Test player. The leading run scorer is a Test player.", "prediction 3": "The leading run scorer in cricket is Aaron Finch. In the world of cricket, the leading run scorer is an individual player, and the leading run scorer is a team. The leading run scorer in international cricket is David Warner.", "prediction 4": "The leading run scorer in cricket is not a player's position, but a ranking by the highest run scorer in a team's history. In the sport of cricket, the leading run scorer is the player with the most runs scored. The leading run scorer is the man with the most runs scored in a match. The leading run scorer in a Match is the player with the most runs scored. The leading run scorer in a Match is the bowler with the most runs scored.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 79 }, { "error type": "Redundant", "explanation": "The top run scorer in international cricket is the captain of the winning team. ", "start": 80, "end": 158 }, { "error type": "Redundant", "explanation": "The top run scorer in international cricket is the captain of the winning team. ", "start": 159, "end": 239 }, { "error type": "Redundant", "explanation": "The top run scorer in international cricket is the captain of the winning team. ", "start": 240, "end": 332 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "One Day International (ODI) is a form of limited overs cricket. First-class cricket is an official classification of the highest-standard international or domestic matches in the sport of cricket. List A cricket is a classification of the limited-overs (one-day) form of the sport of cricket." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "What are the names of the three hobbit movies?", "passages": [ [ "The Hobbit (film series)", "The Hobbit (film series)\n\n", "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson.", "They are based on the 1937 novel \"The Hobbit\" by J. R. R. Tolkien, with large portions of the trilogy inspired by the appendices to \"The Return of the King\", which expand on the story told in \"The Hobbit\", as well as new material and characters written especially for the films.", "Together they act as a prequel to Jackson's \"The Lord of the Rings\" film trilogy.", "The films are subtitled \"\" (2012), \"\" (2013), and \"\" (2014).", "The screenplay was written by Fran Walsh, Philippa Boyens, Jackson, and Guillermo del Toro, who was originally chosen to direct before his departure from the project.", "The films take place in the fictional world of Middle-earth sixty years before the beginning of \"The Lord of the Rings\", and follow hobbit Bilbo Baggins (Martin Freeman), who is convinced by the wizard Gandalf the Grey (Ian McKellen) to accompany thirteen dwarves, led by Thorin Oakenshield (Richard Armitage), on a quest to reclaim the Lonely Mountain from the dragon Smaug (voiced by Benedict Cumberbatch)." ] ], "gold": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. The three films are An Unexpected Journey, The Desolation of Smaug, and The Battle of the Five Armies. Together they act as a prequel to Jackson's The Lord of the Rings film trilogy which include The Fellowship of the Ring, The Two Towers, and The Return of the King.", "prediction 1": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. They are based on the 1937 novel The Hobbit by J. R. R. Tolkien, with large portions of the trilogy inspired by the appendices to \"The Return of the King\", which expand on the story told in \"The Hobbit\", as well as new material and characters written especially for the films. Together they act as a prequel to Jackson's \"The Lord of the Rings\" film trilogy.", "prediction 2": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. They are based on the 1937 novel \"The Hobbit\" by J. R. R. Tolkien, with large portions of the trilogy inspired by the appendices to \"The Return of the King\", which expand on the story told in \"The Hobbit\", as well as new material and characters written especially for the films. Together they act as a prequel to Jackson's \"The Lord of the Rings\" film trilogy.", "prediction 3": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. They are based on the 1937 novel The Hobbit by J. R. R. Tolkien, with large portions of the trilogy inspired by the appendices to \"The Return of the King\", which expand on the story told in \"The Hobbit\", as well as new material and characters written especially for the films. Together they act as a prequel to Jackson's \"The Lord of the Rings\" film trilogy. The films are subtitled \"\" (2012), \"\" (2013), and \"\" (2014).", "prediction 4": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. They are based on the 1937 novel The Hobbit by J. R. R. Tolkien, with large portions of the trilogy inspired by the appendices to \"The Return of the King\", which expand on the story told in \"The Hobbit\", as well as new material and characters written especially for the films. The films are subtitled \"\" (2012), \"\" (2013), and \"\" (2014).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 380 } ], "missing-info": [], "corrected-prediction": "The Hobbit is a film series consisting of three high fantasy adventure films directed by Peter Jackson. Together they act as a prequel to Jackson's \"The Lord of the Rings\" film trilogy." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who was the voice of jessica in who framed roger rabbit?", "passages": [ [ "Who Framed Roger Rabbit", "Richard Williams was eventually hired to direct the animation.", "Zemeckis wanted the film to imbue \"Disney's high quality of animation, Warner Bros.' characterization, and Tex Avery humor\".", "Harrison Ford was Spielberg's original choice to play Eddie Valiant, but Ford's price was too high.", "Bill Murray was also considered for the part, but due to his idiosyncratic method of receiving offers for roles, Murray missed out on it.", "Eddie Murphy reportedly turned down the role of Eddie, which he later came to regret.", "Several other actors were also considered for the role of Eddie Valiant, including Chevy Chase, Robert Redford, Jack Nicholson, Sylvester Stallone, Wallace Shawn, Ed Harris, Charles Grodin, and Don Lane.", "To facilitate Hoskins' performance, Charles Fleischer dressed in a Roger bunny suit and \"stood in\" behind camera for most scenes.", "Animation director Williams explained Roger Rabbit was a combination of \"Tex Avery's cashew nut-shaped head, the swatch of red hair...like Droopy's, Goofy's overalls, Porky Pig's bow tie, Mickey Mouse's gloves, and Bugs Bunny-like cheeks and ears.\"", "Kathleen Turner provided the uncredited voice of Jessica Rabbit, Roger Rabbit's Toon wife." ], [ "Kathleen Turner", "Her uncredited, sultry performance was acclaimed as \"the kind of sexpot ball-breaker she was made for.\"", "(Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie.)", "That same year Turner also appeared in \"Switching Channels,\" which was a loose remake of the 1940 hit film \"His Girl Friday;\" this, in turn, was a loose remake of the Ben Hecht-Charles MacArthur comedy \"The Front Page\".", "Turner appeared in the 1986 song \"The Kiss of Kathleen Turner\" by Austrian techno-pop singer Falco.", "In 1989, Turner teamed with Douglas and DeVito for a third time, in \"The War of the Roses,\" but this time as Douglas's disillusioned wife, with DeVito in the role of a divorce attorney who told their shared story.", "\"The New York Times\" praised the trio, saying that \"Mr. Douglas and Ms. Turner have never been more comfortable a team ... each of them is at his or her comic best when being as awful as both are required to be here ...", "[Kathleen Turner is] evilly enchanting.\"", "In that film, Turner played a former gymnast and, as in other roles, did many of her own stunts.", "(She broke her nose two years after filming 1991's \"V.I." ], [ "Kathleen Turner", "The first two, \"Deadlock\" and \"Killing Orders,\" featured Turner reprising her 1991 movie role, which had been based on Paretsky's novel \"Deadlock;\" however, the third, \"Bitter Medicine\", saw Sharon Gless take over the part.", "Turner also provided the voice of Jessica Rabbit in the 1988 live action/animated film \"Who Framed Roger Rabbit,\" and again in the Disneyland attraction spinoff, \"Roger Rabbit's Car Toon Spin\".", "After 1990s roles in Broadway productions of \"Indiscretions\" and \"Cat on a Hot Tin Roof\" (for which she earned a Tony Award nomination for Best Actress), Turner moved to London in 2000 to star in a stage version of \"The Graduate.\"", "The BBC reported that initially mediocre ticket sales for \"The Graduate\" \"went through the roof when it was announced that Turner, then aged 45, would appear naked on stage.\"", "While her performance as the infamous Mrs. Robinson was popular with audiences, with sustained high box office for the duration of Turner's run, she received mixed reviews from critics.", "The play transferred to Broadway in 2002 to similar critical reaction." ] ], "gold": "Though uncredited, Kathleen Turner was the voice of Jessica Rabbit, Roger Rabbit's wife, in the 1988 live action/animated film Who Framed Roger Rabbit. However, Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie. Turner also voices Jessica Rabbit in the film's three animated short film spinoffs and in the Disneyland attraction spinoff, Roger Rabbit's Car Toon Spin.", "prediction 1": "Kathleen Turner provided the uncredited voice of Jessica Rabbit, Roger Rabbit's Toon wife in the 1988 live action/animated film Who Framed Roger Rabbit. Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie. Turner also provided the voice of Jessica Rabbit in the 1992 live action/animated film, Roger Rabbit: The Adventures of a Toon Princess.", "prediction 2": "Kathleen Turner provided the uncredited voice of Jessica Rabbit in the 1988 live action/animated film \"Who Framed Roger Rabbit\" and again in the Disneyland attraction spinoff, \"Roger Rabbit's Car Toon Spin\". Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie. Turner also provided the voice of Jessica Rabbit in the 1991 movie \"The War of the Roses.\"", "prediction 3": "Kathleen Turner also provided the voice of Jessica Rabbit in the 1988 live action/animated film Who Framed Roger Rabbit. Amy Irving also provided the voice of Jessica Rabbit in the Disneyland attraction spinoff, Roger Rabbit's Car Toon Spin. In the 1991 movie, Kathleen Turner provided the uncredited voice of Jessica Rabbit. In the 1997 film, Richard Williams directed the animation.", "prediction 4": "Kathleen Turner provided the uncredited voice of Jessica Rabbit in the 1988 live action/animated film Who Framed Roger Rabbit, and again in the Disneyland attraction spinoff, Roger Rabbit's Car Toon Spin. In the 1991 movie, Kathleen Turner provided the uncredited voice of Jessica Rabbit, Roger Rabbit's Toon wife. Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 317, "end": 404 } ], "missing-info": [], "corrected-prediction": "Kathleen Turner provided the uncredited voice of Jessica Rabbit, Roger Rabbit's Toon wife in the 1988 live action/animated film Who Framed Roger Rabbit. Amy Irving provided Jessica Rabbit's singing voice in the scene in which the character first appears in the movie. Turner also provided the voice of Jessica Rabbit in the Disneyland attraction spinoff, \"Roger Rabbit's Car Toon Spin\"." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where is the world cup going to be at?", "passages": [ [ "FIFA World Cup hosts", "For the 2022 World Cup bidding process, this meant that bids from South America and Europe were not allowed.", "Also, FIFA formally allowed joint bids once more (after they were banned in 2002), because there was only one organizing committee per joint bid, unlike Korea\u2013Japan, which had two different organizing committees.", "Countries that announced their interest included Australia, England, Indonesia, Japan, Qatar, Russia, South Korea, United States, the joint bid of Spain and Portugal and the joint bid of Belgium and Netherlands.", "The hosts for both World Cups were announced by the FIFA Executive Committee on 2 December 2010.", "Russia was selected to host the 2018 FIFA World Cup, making it the first time that the World Cup will be hosted in Eastern Europe and making it the biggest country geographically to host the World Cup.", "Qatar was selected to host the 2022 FIFA World Cup, making it the first time a World Cup will be held in the Arab World and the second time in Asia since the 2002 tournament in South Korea and Japan.", "Also, the decision made it the smallest country geographically to host the World Cup." ], [ "FIFA World Cup hosts", "FIFA initially indicated that it might back out of the rotation concept, but later decided to continue it through the 2014 host decision, after which it was dropped.", "Colombia had expressed interest in hosting the 2014 World Cup, but withdrew undertaking the 2011 FIFA U-20 World Cup.", "Brazil also expressed interest in hosting the World Cup.", "CONMEBOL, the South American Football Federation, indicated their preference for Brazil as a host.", "Brazil was the only nation to submit a formal bid when the official bidding procedure for CONMEBOL member associations was opened in December 2006, as by that time, Colombia, Chile and Argentina had already withdrawn, and Venezuela was not allowed to bid.", "Brazil made the first unopposed bid since the initial selection of the 1986 FIFA World Cup (when Colombia was selected as host, but later withdrew for financial problems).", "The FIFA Executive Committee confirmed it as the host country on 30 October 2007 by a unanimous decision.", "Result:\n\n2018 Bids:\n\n2022 Bids:\n\nFIFA announced on 29 October 2007 that it will no longer continue with its continental rotation policy, implemented after the 2006 World Cup host selection.", "The newest host selection policy is that any country may bid for a World Cup, provided that their continental confederation has not hosted either of the past two World Cups.", "For the 2018 World Cup bidding process, this meant that bids from Africa and South America were not allowed." ], [ "FIFA World Cup hosts", "After it was confirmed by FIFA that joint bidding would not be allowed in the future, Libya and Tunisia withdrew both of their bids on 8 May 2004.", "On 15 May 2004 in Z\u00fcrich (the seventh consecutive time that a host selection has been made there), South Africa, after a narrow loss in the 2006 bidding, defeated perennial candidate Morocco to host, 14 votes to 10.", "Egypt received no votes.", "On 28 May 2015, media covering the 2015 FIFA corruption case reported that high-ranking officials from the South African bid committee had secured the right to host the World Cup by paying US$10\u00a0million in bribes to then-FIFA Vice President Jack Warner and to other FIFA Executive Committee members.", "On 4 June 2015, FIFA executive Chuck Blazer, having co-operated with the FBI and the Swiss authorities, confirmed that he and the other members of FIFA's executive committee were bribed in order to promote the South African 1998 and 2010 World Cups.", "Blazer stated, \"I and others on the FIFA executive committee agreed to accept bribes in conjunction with the selection of South Africa as the host nation for the 2010 World Cup.\"", "On 6 June 2015, \"The Daily Telegraph\" reported that Morocco had received the most votes, but South Africa was awarded the tournament instead.", "Bids:\nFIFA continued its continental rotation procedure by earmarking the 2014 World Cup for South America." ] ], "gold": "Qatar is hosting the 2022 World Cup, making this the first World Cup ever to be held in the Arab world. The 2026 World Cup will be jointly hosted by Canada, the United States and Mexico, which will give Mexico the distinction of being the first country to host games in three World Cups. In previous years, the 2018 World Cup was held in Russia, marking the first time the World Cup was held in Eastern Europe. The 2014 World Cup was held in Brazil. This was the second time Brazil has hosted the competition. The 2010 World Cup was held in South Africa, making South Africa the first African nation to host the World Cup. For the FIFA Women's World Cup, Australia and New Zealand will host the FIFA Women's World Cup in 2023, marking the first time Australia and New Zealand will host the tournament. In previous years, six countries have hosted the FIFA Women's World Cup. China and the United States have each hosted the tournament twice, while Canada, France, Germany and Sweden have each hosted it once.", "prediction 1": "The 2022 and 2024 FIFA World Cups were hosted in Russia, Qatar, South Korea, and the U.S., respectively. In both cases, the 2019 and 2018 World Cups were hosted in South Africa, with the 2018 World Cup being hosted in Russia. The 2019 World Cup was held in Russia, with the 2018 World Cup being hosted in Russia. Russia was selected to host the 2018 FIFA World Cup, making it the first time that the World Cup will be hosted in Eastern Europe and making it the biggest country geographically to host the World Cup.", "prediction 2": "The 2022 FIFA World Cup will be held in Qatar, making it the first time that the World Cup will be hosted in Eastern Europe and making it the biggest country geographically to host the World Cup. The 2026 and 2027 FIFA World Cup will be held in Qatar, making it the third time that the World Cup will be held in Eastern Europe.", "prediction 3": "FIFA has announced the 2018 and 2022 World Cups as the countries hosting the tournament. Russia was selected to host the 2018 FIFA World Cup, making it the first time that the World Cup will be hosted in Eastern Europe and making it the biggest country geographically to host the World Cup. Qatar was selected to host the 2022 FIFA World Cup, making it the first time that the World Cup will be hosted in the Arab World and the second time in Asia since the 2002 tournament in South Korea and Japan. Brazil was the only nation that submitted a formal bid, after it was dropped. Russia was selected to host the 2022 FIFA World Cup, making it the first time a World Cup will be held in the Arab World and the second time a World Cup will be held in the second time a World Cup will be held in the Arab World and the second time in Asia since the 2002 tournament in South Korea and the 2002 tournament in South Korea and Japan.", "prediction 4": "The 2022 FIFA World Cup is being held in Qatar, the Gulf State of Qatar and the 2022 FIFA World Cup will be held in Qatar. The 2018 FIFA World Cup was held in Russia, making it the first time that the World Cup will be hosted in Eastern Europe and making it the biggest country geographically to host the World Cup. The 2022 FIFA World Cup will be held in Qatar, making it the first time that a World Cup will be held in the Arab World and the second time in Asia since the 2002 tournament in South Korea and Japan. The 2018 World Cup was going to be held in South Korea and the joint bid of Spain and the joint bid of Belgium and Netherlands.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 13, "end": 17 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 49, "end": 90 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[5]}", "start": 105, "end": 137 }, { "error type": "Redundant", "explanation": "The 2022 and 2024 FIFA World Cups were hosted in Russia, ", "start": 178, "end": 225 }, { "error type": "Redundant", "explanation": "The 2022 and 2024 FIFA World Cups were hosted in Russia,", "start": 226, "end": 264 }, { "error type": "Redundant", "explanation": "The 2022 and 2024 FIFA World Cups were hosted in Russia,", "start": 265, "end": 312 }, { "error type": "Redundant", "explanation": "The 2022 and 2024 FIFA World Cups were hosted in Russia", "start": 313, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 514 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2, 6, 7 ] } ], "corrected-prediction": "The 2022 FIFA World Cups were hosted in Qatar, making it the first time a World Cup will be held in the Arab World. Russia was selected to host the 2018 FIFA World Cup, making it the first time that the World Cup will be hosted in Eastern Europe. The 2014 World Cup was held in Brazil, who also hosted the 1986 games. The 2010 World Cups were hosted in South Africa, who had previously hosted in 1998. The 2002 tournament was hosted jointly by South Korea and Japan." }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Chief justice of panjab and haryana high court?", "passages": [ [ "Navdeep Asija", "His advocacy tool helped city municipal council to decongest the major commercial hub, i.e. Clock tower market area of the city Fazilka into pedestrian paradise by establishing India's first car free zone there.", "Later the same concept is being taken up by the Punjab and Haryana High Court in the form of Sua sponte, Public Interest Litigation (PIL), and asked the authorities to identify and establish vehicle free areas in each town and city of Punjab including Sector 17 of Union Territory of Chandigarh Punjab.", "Chandigarh is a capital city for the state of Punjab and Haryana of India.", "
\nIn his recent Public Interest Litigation he sought directions from Honorable Punjab and Haryana High Court for enforcement of \"right to walk\" while claiming that it was part of \"Right to life\" under Article 21 of Constitution of India." ], [ "Arjan Kumar Sikri", "Arjan Kumar Sikri\n\nSikri has an excellent academic record.", "He stood third in the merit list in Higher Secondary from CBSE, Delhi.", "He completed his B.Com(Hons.)", "from Shri Ram College of Commerce, Delhi in 1974.", "He completed his LL.B. from Faculty of Law, University of Delhi in 1977 and won a gold medal for attaining first position in LL.B. in Delhi University.", "He completed his LLM from Delhi University and stood first in the three-year course.", "Sikri was enrolled as an advocate in 1977 and he started practising in Delhi.", "He had specialization in Constitutional cases, Labour - Service Matters and Arbitration matters.", "He was counsel for numerous Public Sector Undertakings, Educational Institutions, Banks & Financial Institutions and various Private Sector Corporations.", "He was also a part-time lecturer in Campus Law Centre, Delhi University during 1984-89.", "He was vice-President, Delhi High Court Bar Association during 1994-95.", "He was designated as a Senior Advocate by Delhi High Court in 1997.", "Sikri was appointed as Judge of the High Court of Delhi in July, 1999 and has also served as the Acting Chief Justice of Delhi High Court from 10 October 2011 before being elevated as the Chief Justice of Punjab and Haryana High Court in September 2012.", "in 2013 he was elevated to the Supreme Court of India." ], [ "Sanjay Kishan Kaul", "Sanjay Kishan Kaul\n\nSanjay Kishan Kaul is a judge of the Supreme Court of India.", "He assumed charge as the Chief Justice of Madras High Court on 26 July 2014.", "He was the Chief Justice of Punjab and Haryana High Court before and also worked as judge at Delhi High Court.", "A native of Srinagar, Justice Sanjay Kishan Kaul was born on 26 December 1958.", "Kaul hails from the family of the Dattatreya Kauls of Srinagar.", "His great-great-grandfather, Raja Suraj Kishan Kaul, was the Revenue minister in the Regency council of the princely state of Jammu and Kashmir.", "His great-grandfather, Sir Daya Kishan Kaul, was a statesman and diplomat who served as the finance minister of Jammu & Kashmir state.", "His grandfather, Raja Upinder Kishen Kaul, had a distinguished career in public service.", "Justice Kaul's brother, Neeraj Kishan Kaul, was also a judge of the Delhi High court, having been appointed in the summer of 2009.", "After schooling in Modern School, New Delhi, Sanjay Kishan Kaul graduated in Economics (Hons.)", "from Delhi University, studying in St. Stephen's College, Delhi.", "He then took a degree in law, studying at the Faculty of Law, University of Delhi, taking the LLB in 1982." ] ], "gold": "Punjab and Haryana High Court is the common High Court for the Indian states of Punjab and Haryana and the Union Territory of Chandigarh based in Chandigarh, India. The 31st Chief Justice of the Panjab and Haryana High Court was A. K. Sikri, an eminent jurist and a former judge of the Supreme Court of India. The 32nd Chief Justice of the Panjab and Haryana High Court was Sanjay Kishan Kaul, a Judge of Supreme Court of India. The 33rd Chief Justice of the Panjab and Haryana High Court was Shiavax Jal Vazifdar.", "prediction 1": "The Chief Justice of Punjab and Haryana High Court is Sanjay Kishan Kaul. The Chief Justice of Madras High Court is Navdeep Asija. Asija helped the city municipal council to decongest the major commercial hub, i.e. Clock tower market area of the city Fazilka into pedestrian paradise by establishing India's first car free zone there. The Chief Justice of Punjab and Haryana High Court is Arjan Kumar Sikri with an excellent academic record. Sikri was appointed as Judge of the High Court of Delhi on October 2011, before being elevated as the Chief Justice of Punjab and Haryana High Court in September 2012.", "prediction 2": "Punjab and Haryana High Court is a court in Punjab and Haryana, India. The Chief Justice of Punjab and Haryana High Court is Arjan Kumar Sikri with specialization in Constitutional cases, Labour - Service Matters and Arbitration matters. Sanjay Kishan Kaul was the Chief Justice of Punjab and Haryana High Court before and also worked as judge at Delhi High Court. He assumed charge as the Chief Justice of Madras High Court on 26 July 2014.", "prediction 3": "The Punjab and Haryana High Court is the highest court in the state of Punjab in India. The Chief Justice of Punjab and Haryana High Court is Sanjay Kishan Kaul. He was the Chief Justice of Punjab and Haryana High Court before and also worked as judge at Delhi High Court.", "prediction 4": "A native of Srinagar, Justice Sanjay Kishan Kaul, born 26 December 1958, was the Chief Justice of Punjab and Haryana High Court before and also worked as judge at Delhi High Court. In September 2012, he was elevated to the position of the Chief Justice of the state of Punjab and Haryana.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 51, "end": 53 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[2]}", "start": 116, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 115 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 334 }, { "error type": "Irrelevant", "explanation": "", "start": 407, "end": 441 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[13,14]}", "start": 386, "end": 388 }, { "error type": "Irrelevant", "explanation": "", "start": 442, "end": 514 }, { "error type": "Redundant", "explanation": "The Chief Justice of Punjab and Haryana High Court is Arjan Kumar Sikri", "start": 515, "end": 590 }, { "error type": "Irrelevant", "explanation": "", "start": 591, "end": 609 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 14 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Chief Justice of Punjab and Haryana High Court was Sanjay Kishan Kaul. Another Chief Justice of Punjab and Haryana High Court was Arjan Kumar Sikri. He was elevated to the Supreme Court of India. Sanjay Kishan Kaul is also a judge on the Supreme Court of India. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who sings the song the way you look tonight?", "passages": [ [ "The Way You Look Tonight", "Bing Crosby and his wife Dixie Lee recorded it as a duet on August 19, 1936.", "The Lettermen found their first hit when their version reached No. 14 on the \"Billboard\" magazine Hot 100 singles chart and No. 36 on the UK Singles Chart.", "Sonny Rollins and Thelonious Monk recorded it in 1954." ], [ "The Way You Look Tonight", "The Way You Look Tonight\n\n\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern.", "It won the Academy Award for Best Original Song in 1936.", "Fields remarked, \"The first time Jerry played that melody for me I went out and started to cry.", "The release absolutely killed me.", "I couldn't stop, it was so beautiful.\"", "In the movie, Astaire sang \"The Way You Look Tonight\" to Ginger Rogers while she was washing her hair in an adjacent room.", "His recording reached the top of the charts in 1936.", "Other versions that year were by Guy Lombardo and by Teddy Wilson with Billie Holiday.", "To take advantage of the success of the song, pianist Teddy Wilson brought Billie Holiday into a studio ten weeks after the movie was released.", "Holiday was twenty-one when she recorded \"The Way You Look Tonight\" as a duet with Wilson in October 1936.", "Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste.", "The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964.", "Versions were also recorded by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker." ] ], "gold": "The song, The Way You Look Tonight, was performed by Fred Astaire in the movie Swing Time. It won the Academy Award for Best Original Song in 1936, and Fred Astaire's recording of it reached the top of the charts for six weeks. It has been remade many times since then by various artists. The Lettermen recorded a version of The Way You Look Tonight in 1961 which was their first hit single.", "prediction 1": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. In the movie, Astaire sang \"The Way You Look Tonight\" to Ginger Rogers while she was washing her hair in an adjacent room. His recording reached the top of the charts in 1936. Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste. The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964.\n", "prediction 2": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964. Other versions of the song were made by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker.", "prediction 3": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire. It won the Academy Award for Best Original Song in 1936. Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste.", "prediction 4": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire and written by Dorothy Fields and Jerome Kern. It won the Academy Award for Best Original Song in 1936. Other versions that year were by Guy Lombardo and by Teddy Wilson with Billie Holiday.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 145 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 325 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 13 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"The Way You Look Tonight\" is a song from the film \"Swing Time\" that was performed by Fred Astaire. It won the Academy Award for Best Original Song in 1936. His recording reached the top of the charts in 1936. Other versions that year were by Guy Lombardo and by Teddy Wilson with Billie Holiday. Six years passed before the song appeared on the charts again, this time in a version by Benny Goodman with Peggy Lee on vocals and Mel Powell on celeste. The most popular and imitated version was recorded by Frank Sinatra with the Nelson Riddle orchestra in 1964. Versions were also recorded by Clifford Brown, Tina Brooks, Johnny Griffin (with John Coltrane), and Charlie Parker. Bing Crosby and his wife Dixie Lee recorded it as a duet on August 19, 1936. The Lettermen found their first hit when their version reached No. 14 on the \"Billboard\" magazine Hot 100 singles chart and No. 36 on the UK Singles Chart. Sonny Rollins and Thelonious Monk recorded it in 1954.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Where does the rose bowl game take place?", "passages": [ [ "Rose Bowl Game", "The award was created in 1953 and awarded retroactively for players all the way back to the 1902 Rose Bowl.", "Occasionally, the award has been shared by two players.", "Beginning with the 2005 Rose Bowl Game, the Rose Bowl MVP Award has been given to both an offensive and defensive player.", "Four players have been named the MVP of more than one Rose Bowl: Bob Schloredt, Washington (1960, 1961), Charles White, USC (1979, 1980), Ron Dayne, Wisconsin (1999, 2000), and Vince Young, Texas (2005, 2006).", "\"Note: When there is a tie, the most recent one will be listed.\"", "Top No. 1 ranked teams at the end of the season that have played in the Rose Bowl games are listed below:\n\n\n\nFive times in Rose Bowl Game history, the two participants had played during the regular season.", "In three of those instances, the same team won both the regular season game and the Rose Bowl Game.", "UCLA won three of those five Rose Bowl games, including both instances in which a different team lost the regular season game but won the Rose Bowl Game.", "Inductees (by year):\n\nThe Rose Bowl Game All-Century Class was announced by Rose Bowl Hall of Fame member Keith Jackson, on Sunday, December 8, 2013 at 4:00\u00a0p.m. at Tournament House." ], [ "Rose Bowl Game", "Rose Bowl Game\n\nThe Rose Bowl Game, also frequently known as simply the Rose Bowl, is an annual American college football bowl game, usually played on January 1 (New Year's Day) at the Rose Bowl stadium in Pasadena, California.", "When New Year's Day falls on a Sunday, the game is played on Monday, January 2 (15 times now).", "The Rose Bowl Game is nicknamed \"The Granddaddy of Them All\" because it is the oldest bowl game.", "It was first played in 1902 as the Tournament East\u2013West football game, and has been played annually since 1916.", "Since 1945, it has been the highest attended college football bowl game.", "It is a part of the Pasadena Tournament of Roses Association's \"America's New Year Celebration\", which also includes the historic Rose Parade.", "Since 2015, the game has been sponsored by Northwestern Mutual and officially known as the \"Rose Bowl Game presented by Northwestern Mutual\".", "In 2015 and 2018, the game was also officially known as the \"College Football Playoff semifinal at the Rose Bowl Game presented by Northwestern Mutual\"." ], [ "1942 Rose Bowl", "With the United States' entry into World War II, by the December 7, 1941 Attack on Pearl Harbor, there was concern about a Japanese attack on the West Coast of the United States.", "Much discussion focused on the possibility of an attack where any crowds might gather.", "The Rose Parade and its estimated one million spectators, as well as the Rose Bowl with 90,000 spectators, were presumed to be ideal targets for the Japanese.", "On December 14, 1941, Lieutenant General John L. DeWitt, commander of the Western Defense Command, recommended that the Rose Parade and Rose Bowl festivities be canceled.", "By December 15, the Tournament of Roses committee decided to cancel the parade and game.", "Soon afterward, the government banned all large gatherings on the West Coast.", "This ruled out Bell Field, Oregon State's on-campus venue, as an alternative site for the game.", "On December 16, 1941, Duke University invited the game and Oregon State to Duke's home stadium in Durham, North Carolina.", "At the time, Duke Stadium was the second-largest in the South but still could only hold 35,000 people.", "In order to accommodate the larger crowd expected for the Rose Bowl, bleachers were brought in from the University of North Carolina at Chapel Hill's Kenan Stadium and North Carolina State University's Riddick Stadium to seat an additional 20,000 people." ] ], "gold": "The Rose Bowl Game is an annual American college football bowl game, usually played on January 1, New Year's Day, at the Rose Bowl in Pasadena, California. In 1902 and 1916-1922, the Rose Bowl game was held at Tournament Park. On December 16, Duke University invited the game and Oregon State to Duke Stadium in Durham, North Carolina. After the 1942 Allied victory in the Battle of Midway and the end of the Japanese offensives in the Pacific Theater during 1942, it was deemed that a large portion of the West Coast was no longer vulnerable to attack, and the Rose Bowl game continued on in the Rose Bowl Stadium.", "prediction 1": "The Rose Bowl Game, also commonly referred to as simply the Rose Bowl, is an annual American college football bowl game, usually played on January 1 (New Year's Day) at the Rose Bowl stadium in Pasadena, California. When New Year's Day falls on a Sunday, the game is played on Monday, January 2 (15 times now).", "prediction 2": "The Rose Bowl Game, also commonly known as simply the Rose Bowl, is an annual American college football bowl game, usually played on January 1 (New Year's Day) at the Rose Bowl stadium in Pasadena, California. When New Year's Day falls on a Sunday, the game is played on Monday, January 2 (15 times now).", "prediction 3": "The Rose Bowl Game, also commonly known as the Rose Bowl, is an annual college football bowl game, usually played on January 1 (New Year's Day) at the Rose Bowl stadium in Pasadena, California. When New Year's Day falls on a Sunday, the game is played on Monday, January 2 (15 times now).", "prediction 4": "The Rose Bowl Game, also commonly known as the Rose Bowl, is an annual college football bowl game usually played on January 1 at the Rose Bowl stadium in Pasadena, California. When New Year's Day falls on a Sunday, the game is played on Monday, January 2 (15 times now). In 1942, the game was first played at Duke University's home stadium in Durham, North Carolina.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 216, "end": 310 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Rose Bowl Game, also commonly referred to as simply the Rose Bowl, is an annual American college football bowl game, usually played on January 1 (New Year's Day) at the Rose Bowl stadium in Pasadena, California. On December 16, 1941, Duke University invited the game and Oregon State to Duke's home stadium in Durham, North Carolina, due to the concern about a Japanese attack on the West Coast of the United States." }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "Who is running for attorney general in wi?", "passages": [ [ "Josh Kaul", "Josh Kaul\n\nJoshua Lautenschlager \"Josh\" Kaul is an American lawyer and politician who is the Attorney General-elect of Wisconsin.", "Kaul is the son of Peg Lautenschlager and Raj Kaul.", "His stepfather, Bill Rippl, worked as a police officer.", "He was raised in Oshkosh and Fond du Lac.", "Kaul graduated from Yale University as a double major in history and economics.", "He earned his Juris Doctor from Stanford Law School.", "He had a clerkship for Michael Boudin in the United States Court of Appeals for the First Circuit.", "From 2007 through 2010, he worked for the law firm Jenner & Block, and worked as a federal prosecutor in the U.S. Attorney's office Baltimore through 2014.", "He moved back to Wisconsin and joined the law firm Perkins Coie's Madison office.", "In the 2018 elections, Kaul ran for Attorney General of Wisconsin against incumbent Republican Brad Schimel.", "Kaul won by a small margin of just over 17,000 votes, but Schimel decided not to seek a recount and conceded defeat on Nov. 19.", "Kaul will be the state's first Democratic Attorney General since his mother served.", "Kaul met his wife, Lindsey, at Yale.", "They have two sons." ], [ "Brad Schimel", "Brad Schimel\n\nBrad Schimel (born February 18, 1965) is an American prosecutor and current Wisconsin Attorney General, serving since January 5, 2015.", "The former District Attorney of Waukesha County, Wisconsin and a Republican, Schimel was elected Attorney General on November 4, 2014 and took office on January 5, 2015, succeeding fellow Republican J. B. Van Hollen.", "On November 20, 2018, Schimel was appointed by Scott Walker to be a Judge on the Waukesha County Circuit Court, replacing Patrick Haughney.", "Schimel is a graduate of Mukwonago High School and holds a B.A. in political science from the University of Wisconsin\u2013Milwaukee (1987).", "He earned his Juris Doctor at the University of Wisconsin Law School in 1990.", "He began his career as a prosecutor in 1990 when he joined the Waukesha County District Attorney's office.", "In, 2006 Schimel was elected Waukesha County District Attorney.", "In 2011, Schimel was appointed to serve on the Wisconsin Judicial Council and the Wisconsin Crime Victim Council.", "He is a founding member of the Waukesha County Victim Impact Panel for intoxicated drivers and president of the Preventing Alcohol-Related Crashes (PARC)", "Task Force, 2004-11." ], [ "2010 Wisconsin elections", "In the Court of Appeals for District 4, Brian Blanchard was elected with 63% of the vote over Edward E. Leineweber after incumbent Charles P. Dykman decided not to run again.", "Incumbent Democratic Senator Russ Feingold was challenged by Republican businessman Ron Johnson and Rob Taylor of the Constitution Party.", "Johnson defeated Feingold in the general election with 51.86% of the vote to Feingold's 47.02% and Taylor's 1.08%.", "All 8 of Wisconsin's seats in the United States House of Representatives were up for election in 2010.", "The Republican Party gained 2 seats, taking a 5-3 majority in the Wisconsin House delegation.", "Incumbent Governor Jim Doyle did not run for re-election.", "Democrat Tom Barrett and Republican Scott Walker, along with several third-party candidates, contested the seat.", "Walker defeated Barrett in the general election with 52.25% of the vote to Barrett's 46.48%.", "Incumbent Republican J.B. Van Hollen defeated Democrat Scott Hassett in the race for Wisconsin Attorney General, winning 57.79% of the vote to Hassett's 42.13%.", "Incumbent Democrat Doug La Follette defeated Republican David King in the race for Wisconsin Secretary of State, winning 51.61% to King's 48.3%." ] ], "gold": "In 2006, J. B. Van Hollen won the Republican nomination for Attorney General over then-Waukesha County District Attorney Paul Bucher and in the general election, he narrowly defeated Dane County Executive Kathleen Falk. In 2010, Van Hollen than defeated Democrat Scott Hassett in the race for Wisconsin Attorney General, winning 57.79% of the vote to Hassett's 42.13%. In 2014, Van Hollen did not seek re-election and Waukesha County District Attorney Brad Schimel defeated Jefferson County District Attorney Susan Happ in the November general election.", "prediction 1": "In the 2018 elections, American lawyer and politician Josh Kaul ran for Attorney General of Wisconsin against incumbent Republican Brad Schimel. Kaul won by a small margin of just over 17,000 votes, but Schimel decided not to seek a recount and conceded defeat on Nov. 19. Kaul will be the state's first Democratic Attorney General since his mother served. In 2010, Republican J. B. Van Hollen defeated Democrat Scott Hassett in the race for Wisconsin Attorney General.", "prediction 2": "In 2016, Josh Kaul ran for Attorney General of Wisconsin against incumbent Republican Brad Schimel. In 2018, Brad Schimel ran for Attorney General of Wisconsin against incumbent Republican J. B. Van Hollen. In 2019, Josh Kaul ran for Attorney General-elect of Wisconsin against incumbent Republican Scott Hassett. In 2019, Josh Kaul won by a small margin of just over 17,000 votes, but Schimel decided not to seek a recount and conceded defeat on Nov. 19.", "prediction 3": "Brad Schimel is a Wisconsin Republican and former district attorney of Waukesha County, Wisconsin. He was elected Attorney General of Wisconsin on November 4, 2014 and took office on January 5, 2015. Brad Schimel defeated Josh Kaul in the 2018 elections by a small margin of just over 17,000 votes.", "prediction 4": "In the 2018 elections, Joshua Kaul ran for Attorney General of Wisconsin against incumbent Republican Brad Schimel. Kaul won by a small margin of just over 17,000 votes, but Schimel decided not to seek a recount and conceded defeat on Nov. 19. Kaul will be the state's first Democratic Attorney General since his mother served. In 2010, Republican J.B. Van Hollen defeated Democrat Scott Hassett in the race for Wisconsin Attorney General. In 2016, Democrat Jill Steinberg was elected Attorney General of Wisconsin and ran for the Republican Brad Schimel. Brad Schimel was elected on November 4, 2014 and took office on January 5, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 272 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 356 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "In the 2018 elections, American lawyer and politician Josh Kaul ran for Attorney General of Wisconsin against incumbent Republican Brad Schimel. In 2010, Republican J. B. Van Hollen defeated Democrat Scott Hassett in the race for Wisconsin Attorney General, winning 57.79% of the vote to Hassett's 42.13%." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What type of game is assassin's creed?", "passages": [ [ "Assassin's Creed (video game)", "Assassin's Creed (video game)\n\nAssassin's Creed is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft.", "It is the first installment in the \"Assassin's Creed\" series.", "The game was released for PlayStation 3 and Xbox 360 in November 2007 and was made available on Microsoft Windows in April 2008.", "Also, the game can be played on Xbox One consoles via backward compatibility.", "The plot is set in a fictional history of real-world events and follows the centuries-old struggle between the Assassins, who fight for peace with free will, and the Templars, who desire peace through control.", "The game primarily takes place during the Third Crusade in the Holy Land in 1191, with the plot revolving around the Secret Order of Assassins, based upon the Hashshashin sect.", "The player is, in reality, playing as a modern-day man named Desmond Miles, who, through the use of a machine named the \"Animus\", is allowed the viewing and controlling of the protagonist's genetic memories of his ancestors, in this case, Alta\u00efr Ibn-La'Ahad, a member of the Assassins.", "Through this plot device, details emerge of a struggle between two factions: the Knights Templar and the Assassins, over an artifact known as the \"Apple of Eden\", an ancient artifact used to control minds." ], [ "Assassin's Creed (video game)", "The game received generally positive reviews, with critics praising its storytelling, visuals, art design, and originality, although the game was also criticized for the repetitive nature of its gameplay.", "\"Assassin's Creed\" won several awards at E3 in 2006, as well as several end-year awards after its release.", "The game spawned a sequel, \"Assassin's Creed II\", which was released in November 2009.", "Since the release and success of \"Assassin's Creed II\", subsequent games have been released, with various other Assassins and time periods.", "\"Assassin's Creed\" is an action-adventure game set in an open world environment and played from a third-person perspective in which the player primarily assumes the role of Alta\u00efr, as experienced by protagonist Desmond Miles.", "The primary goal of the game is to carry out a series of assassinations ordered by Al Mualim, the leader of the Assassins.", "To achieve this goal, the player must travel from the Brotherhood's headquarters in Masyaf, across the terrain of the Holy Land known as the Kingdom to one of three cities\u2014Jerusalem, Acre, or Damascus\u2014to find the Brotherhood agent in that city.", "There, the agent, in addition to providing a safe house, gives the player minimal knowledge about the target and requires them to perform additional reconnaissance missions before attempting the assassination." ], [ "Assassin's Creed Unity", "Assassin's Creed Unity\n\nAssassin's Creed Unity is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft.", "It was released in November 2014 for Microsoft Windows, PlayStation 4 and Xbox One.", "It is the eighth major installment in the \"Assassin's Creed\" series, and the successor to 2013's \"\".", "It also has ties to \"Assassin's Creed Rogue\" which was released for the previous generation consoles, the PlayStation 3 and Xbox 360 on the same date.", "The plot is set in a fictional history of real world events and follows the centuries-old struggle between the Assassins, who fight for peace with free will, and the Templars, who desire peace through control.", "The story is set in Paris during the French Revolution; the single-player story follows Arno Victor Dorian in his efforts to expose the true powers behind the Revolution.", "The game retains the series' third-person open world exploration as well as introducing a revamped combat, parkour and stealth system.", "The game also introduces cooperative multiplayer to the \"Assassin's Creed\" series, letting up to four players engage in narrative-driven missions and explore the open world map.", "\"Assassin's Creed Unity\" received mixed reviews upon its release." ] ], "gold": "Assassin's Creed is a single-player action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series. The game was released for PlayStation 3 and Xbox 360 in November 2007 and was made available on Microsoft Windows in April 2008. It is set in an open world environment and played from a third-person perspective.", "prediction 1": "Assassin's Creed is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series. Assassin's Creed is also known as Assassin's Creed Unity, an action-adventure video game developed by Ubisoft and released by Ubisoft in November 2014 for Microsoft Windows, PlayStation 4, and Xbox One.", "prediction 2": "Assassin's Creed is an action-adventure video game that was developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series and was released for PlayStation 3 and Xbox 360 in November 2007 and made available on Microsoft Windows in April 2008. Assassin's Creed Unity is an action-adventure video game that was released in November 2014 for Microsoft Windows, PlayStation 4 and Xbox One. It is the eighth major installment in the Assassin's Creed series, the successor to 2013's \"Assassin's Creed Unity\" which was released in November 2014 for Microsoft Windows, PlayStation 4, PlayStation 4 and Xbox One.", "prediction 3": "Assassin's Creed is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series. Assassin's Creed: Unity is an action-adventure video game developed by Ubisoft and released by Ubisoft. The game is set in an open world environment and played from a third-person perspective in which the player primarily assumes the role of Altar, Assassin's Creed: Origins: Origin is a free to kill the Assassins.", "prediction 4": "Assassin's Creed is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series. Assassin's Creed Unity is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It was released in November 2014 for Microsoft Windows, PlayStation 4 and Xbox One.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "Assassin's Creed is an action-adventure video game developed by Ubisoft ", "start": 167, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 369 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Assassin's Creed is an action-adventure video game developed by Ubisoft Montreal and published by Ubisoft. It is the first installment in the Assassin's Creed series. The game was released for PlayStation 3 and Xbox 360 in November 2007 and was made available on Microsoft Windows in April 2008. It is set in an open world environment and played from a third-person perspective." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "What percent of gdp is spent on education in india?", "passages": [ [ "Education in India", "Education in India\n\nEducation in India is provided by the public sector as well as the private sector, with control and funding coming from three levels: central, state and local.", "Under various articles of the Indian Constitution, free and compulsory education is provided as a fundamental right to children between the ages of 6 and 14.", "The ratio of public schools to private schools in India is 7:5.", "India has made progress in terms of increasing the primary education attendance rate and expanding literacy to approximately three-quarters of the population in the 7\u201310 age group, by 2011.", "India's improved education system is often cited as one of the main contributors to its economic development.", "Much of the progress, especially in higher education and scientific research, has been credited to various public institutions.", "While enrollment in higher education has increased steadily over the past decade, reaching a Gross Enrollment Ratio of 24% in 2013, there still remains a significant distance to catch up with tertiary education enrollment levels of developed nations, a challenge that will be necessary to overcome in order to continue to reap a demographic dividend from India's comparatively young population.", "Indian At the primary and secondary level, India has a large private school system complementing the government run schools, with 29% of students receiving private education in the 6 to 14 age group.", "Certain post-secondary technical schools are also private." ] ], "gold": "Education in India is primarily managed by state-run public education system, which fall under the command of the government at three levels: Central, state and local. In 1951-1952, the percent of GDP spent on education was 0.64%. In 1970-1971, the percent of GDP spent on education was 2.31%. In 2000-2001, the percent of GDP spent on education was 4.26%.", "prediction 1": "In India, education is provided by both the public and private sector, with control and funding coming from three levels: central, state and local. In India, education is provided by both the public sector and the private sector. The ratio of public schools to private schools in India is 7:5.", "prediction 2": "Education in India is provided by the public sector as well as the private sector, with control and funding coming from three levels: central, state and local. The ratio of public schools to private schools in India is 7:5.", "prediction 3": "In India, education is provided by the public sector as well as the private sector, with control and funding coming from three levels: central, state and local. Indian government spends a total of 2% of gross domestic product on education.", "prediction 4": "In India, public and private sector education are provided by the public sector as well as the private sector with control and funding coming from three levels: central, state and local. In 2013, 4% of the gross domestic product was spent on education, and in 2015, 3% was spent on education.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "In India, education is provided by both the public and private sector", "start": 148, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 293 } ], "missing-info": [], "corrected-prediction": "In India, education is provided by both the public and private sector, with control and funding coming from three levels: central, state and local. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who said et tu brute in julius caesar?", "passages": [ [ "Et tu, Brute?", "Caesar initially resisted his attackers, but when he saw Brutus, he reportedly responded as he died.", "The historical Caesar's last words are not known with certainty.", "The Roman historian Suetonius, a century and a half after the incident, claims Caesar said nothing as he died, but that others reported that Caesar's last words were the Greek phrase \"\", which means \"You too, child?\" or \"You too, young man?\".", "Plutarch also reports that Caesar said nothing, but merely pulled his toga over his head when he saw Brutus among the conspirators.", "In Shakespeare's play \"Julius Caesar\" (1599), when Caesar says \"Et tu, Brute?", "\", the phrase had already been in use; Edmond Malone claimed that it appeared in a work that has since been lost\u2014Richard Eedes's Latin play \"Caesar Interfectus\" of 1582.", "The phrase had also occurred in another play by Shakespeare, \"The True Tragedie of Richard Duke of Yorke, and the death of good King Henrie the Sixth, with the Whole Contention betweene the two Houses Lancaster and Yorke\" of 1595, which is the earliest printed version of \"Henry VI, Part 3\".", "It has been argued that the phrase can be interpreted as a curse or warning." ], [ "Julius Caesar (1953 film)", "Julius Caesar (1953 film)\n\nJulius Caesar is a 1953 epic Metro-Goldwyn-Mayer film adaptation of the play by Shakespeare, directed by Joseph L. Mankiewicz, who also wrote the uncredited screenplay, and produced by John Houseman.", "The original music score is by Mikl\u00f3s R\u00f3zsa.", "The film stars Marlon Brando as Mark Antony, James Mason as Brutus, John Gielgud as Cassius, Louis Calhern as Julius Caesar, Edmond O'Brien as Casca, Greer Garson as Calpurnia, and Deborah Kerr as Portia.", "Many of the actors connected with this film had previous experience with the play.", "John Gielgud had played Mark Antony at the Old Vic Theatre in 1930 and Cassius at the Shakespeare Memorial Theatre in Stratford-upon-Avon in 1950, James Mason had played Brutus at the Abbey Theatre in Dublin in the 1940s, and John Hoyt, who plays Decius Brutus, also played him in the Mercury Theatre's 1937 stage version.", "Gielgud later played the title role in the 1970 film with Charlton Heston, Jason Robards and Richard Johnson (as Cassius) and in a stage production directed by John Schlesinger at the Royal National Theatre." ], [ "Julius Caesar (1953 film)", "Brando's nomination was his third consecutive for Best Actor, following 1951's \"A Streetcar Named Desire\" and 1952's \"Viva Zapata!\".", "He would win the following year for \"On the Waterfront\".", "\"Julius Caesar\" won BAFTA awards for Best British Actor (John Gielgud) and Best Foreign Actor (Marlon Brando), and was also nominated for Best Film.", "It was Brando's second of three consecutive BAFTA Best Actor awards, for \"Viva Zapata!\"", "(1952), \"Julius Caesar\" (1953), and \"On the Waterfront\" (1954).", "The National Board of Review awarded \"Julius Caesar\" Best Film and Best Actor (James Mason), and it also won the Golden Leopard at the Locarno International Film Festival." ], [ "Julius Caesar (1914 film)", "Julius Caesar (1914 film)\n\nJulius Caesar (Italian:Giulio Cesare) is a 1914 Italian silent historical film directed by Enrico Guazzoni and starring Amleto Novelli, Bruto Castellani and Pina Menichelli.", "Taking its inspiration from William Shakespeare's 1599 play of the same title, the film portrays the events leading up to the assassination of Julius Caesar.", "In the wake of Guazzoni's internationally successful \"Quo Vadis\" it was produced on an epic scale, including vast sets recreating Ancient Rome and more than 20,000 extras." ] ], "gold": "The Latin phrase literally meaning, and you, Brutus?, et tu brute, was spoken by Julius Caesar. In the 1914 Italian silent historical film, et tu brute was said by Amleto Novelli as Julius Caesar. In the 1950 film adaptation of the Shakespeare play, Harold Tasker played the role. The 1953 epic Metro-Goldwyn-Mayer film adaptation of the play casted Louis Calhern for the role of Julius Caesar, who spoke the phrase. And, in the 1970 Julius Caesar film, John Gielgud played the role of Caesar and said the phrase, et tu brute.", "prediction 1": "In Shakespeare's play \"Julius Caesar\" (1599), when Caesar says \"Et tu, Brute? \", the phrase had already been in use; Edmond Malone claimed that it appeared in a work that has since been lost\u2014Richard Eedes's Latin play \"Caesar Interfectus\" of 1582. The phrase also occurred in another play by Shakespeare, The True Tragedie of Richard Duke of Yorke, and the death of good King Henrie the Sixth, with the Whole Contention betweene the two Houses of Lancaster and Yorke.\"", "prediction 2": "Julius Caesar is a play by Shakespeare that was written in 1599 and was first performed in 1599. The film version, which was directed by Enrico Guazzoni, has a different character saying Et tu, brute. The 1953 film adaption of the play includes John Gielgud as Cassius, James Mason as Brutus, and John Hoyt as Decius Brutus.", "prediction 3": "In Shakespeare's play \"Julius Caesar\" 1599, when Caesar says \"Et tu, Brute? \", the phrase had already been in use; Edmond Malone claimed that it appeared in a work that has since been lost\u2014Richard Eedes's Latin play Caesar Interfectus\" of 1582. In the 1914 silent production of Julius Caesar, Brutus is played by James Mason, while Cassius is played by John Gielgud.", "prediction 4": "In Shakespeare's play \"Julius Caesar\" (1599), when Caesar says \"Et tu, Brute? \", the phrase had already been in use; Edmond Malone claimed that it appeared in a work that has since been lost\u2014Richard Eedes's Latin play \"Caesar Interfectus\" of 1582. John Gielgud played Cassius in the 1953 film, James Mason played Brutus in the 1914 silent film Julius Caesar, John Hoyt played Decius Brutus, who also played Decius Brutus in the 1937 stage version of Julius Caesar.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 247 }, { "error type": "Irrelevant", "explanation": "", "start": 248, "end": 468 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "In Shakespeare's play \"Julius Caesar\" (1599), Caesar says, the Greek phrase, \"Et tu, Brute? \", which means \"You too, child?\". Julius Caesar is a 1914 Italian silent historical film starring Amleto Novelli. Julius Caesar is a 1953 epic Metro-Goldwyn-Mayer film adaptation of the play by Shakespeare starring Louis Calhern as Julius Caesar. In the 1970 Julius Caesar film, John Gielgud played the role of Caesar. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who plays poussey orange is the new black?", "passages": [ [ "Samira Wiley", "When the Netflix television series \"Orange Is the New Black\" \u2014based on Piper Kerman's \u2014 came into development, Wiley was told about the auditions by a friend from Juilliard, Marco Ramirez, who was a writer for the show.", "After discovering that another Juilliard friend, Danielle Brooks, had won a role in the show, Wiley asked Brooks to rehearse lines with her to prepare for her audition for the role of Poussey Washington, the on-screen best friend of Brooks' character.", "Wiley's audition was ultimately successful; she appeared in all twelve episodes of the series' first season and was featured prominently throughout the second season.", "The darker and more violent plot of the second season allowed for the growth of Wiley's character, whose evolved story lines led to Wiley's prolonged screen exposure and ultimate development as a \"fan-favorite.\"", "She was promoted to series regular for the third season.", "The fourth season revolves heavily around her character, leading up to the reactions within the prison upon Poussey's death at the hands of a prison officer.", "Wiley's wife, Lauren Morelli, is a writer on the show.", "In between seasons of \"Orange Is the New Black\", Wiley filmed \"Rob the Mob\" (2014), an independent crime film directed by Raymond De Felitta." ], [ "Orange Is the New Black", "Orange Is the New Black\n\nOrange Is the New Black (sometimes abbreviated to OITNB) is an American comedy-drama web television series created by Jenji Kohan for Netflix.", "The series is based on Piper Kerman's memoir, \"\" (2010), about her experiences at FCI Danbury, a minimum-security federal prison.", "Produced by Tilted Productions in association with Lionsgate Television, \"Orange Is the New Black\" premiered on Netflix on July 11, 2013.", "In February 2016, the series was renewed for a fifth, sixth, and seventh season.", "The sixth season was released on July 27, 2018.", "On October 17, 2018, it was confirmed that the seventh season would be its last and would be released in 2019.", "\"Orange Is the New Black\" has become Netflix's most-watched original series.", "It has received critical acclaim and many accolades.", "For its first season, the series garnered 12 Primetime Emmy Award nominations, including Outstanding Comedy Series, Outstanding Writing for a Comedy Series, and Outstanding Directing for a Comedy Series, winning three.", "A new Emmy rule in 2015 forced the series to change categories from comedy to drama.", "For its second season, the series received four Emmy nominations, including Outstanding Drama Series, and Uzo Aduba won for Outstanding Supporting Actress in a Drama Series." ] ], "gold": "Poussey Washington is a fictional character played by Samira Wiley on the Netflix series Orange Is the New Black. She is a recurring character in the first two seasons and a main character during the third and fourth seasons. The character is portrayed by Jade Tuck in flashback scenes. Orange Is the New Black was created by Jenji Kohan, and based on Piper Kerman's memoir, Orange Is the New Black: My Year in a Women's Prison (2010), about her experiences at FCI Danbury, a minimum-security federal prison.", "prediction 1": "Orange Is the New Black (sometimes abbreviated to OITNB) is an American comedy-drama web television series created by Jenji Kohan for Netflix. In the first season, Samira Wiley played Poussey Washington while Danielle Brooks played Poussey in the second season. In the third season, Samira Wiley played Poussey Washington and Uzo Aduba played Poussey in the sixth season. In the seventh season, Uzo Aduba played Poussey in the seventh and finally, Uzo Aduba played Poussey Washington.", "prediction 2": "Orange Is the New Black is an American web television series created by Jenji Kohan for Netflix. The series is based on Piper Kerman's memoir, \"\" (2010), about her experiences at FCI Danbury, a minimum-security federal prison. Uzo Aduba plays Poussey in the second and third seasons. In the fourth and fifth seasons, Brooks plays Poussey Washington.", "prediction 3": "Orange Is the New Black is an American comedy-drama web television series created by Jenji Kohan for Netflix. It is based on Piper Kerman's memoir, \"\" (2010), about her experiences at FCI Danbury, a minimum-security federal prison. The series is produced by Tilted Productions in association with Lionsgate Television. Uzo Aduba played Poussey in its second season.", "prediction 4": "Orange Is the New Black is an American comedy-drama web television series created by Jenji Kohan for Netflix. The series is based on Piper Kerman's memoir, \"\" (2010), about her experiences at FCI Danbury, a minimum-security federal prison. Uzo Aduba played Poussey Washington in the first five seasons.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 203, "end": 261 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[6]}", "start": 326, "end": 371 }, { "error type": "Redundant", "explanation": "Orange Is the New Black (sometimes abbreviated to OITNB) is an American comedy-drama web television series created by Jenji Kohan for Netflix. In the first season, Samira Wiley played Poussey Washington while Danielle Brooks played Poussey in the second season. In the third season, Samira Wiley played Poussey Washington and Uzo Aduba played Poussey in the sixth season. ", "start": 372, "end": 447 }, { "error type": "Redundant", "explanation": "Orange Is the New Black (sometimes abbreviated to OITNB) is an American comedy-drama web television series created by Jenji Kohan for Netflix. In the first season, Samira Wiley played Poussey Washington while Danielle Brooks played Poussey in the second season. In the third season, Samira Wiley played Poussey Washington and Uzo Aduba played Poussey in the sixth season. ", "start": 448, "end": 484 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Orange Is the New Black (sometimes abbreviated to OITNB) is an American comedy-drama web television series created by Jenji Kohan for Netflix. In the first season, Samira Wiley played Poussey Washington. The character is featured prominently throughout the second season and was promoted to series regular for the third season. The fourth season revolves heavily around her character, based on Piper Kerman's 2010 memoir, about her experiences at FCI Danbury, a minimum-security federal prison." }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who should be called the father of radio?", "passages": [ [ "Invention of radio", "Marconi used this device as a radio detector.", "The Supreme Court of the United States would eventually invalidate the US patent because of an improper disclaimer and, additionally, maintained the technology in the patent was known art when filed.", "This invention was the first vacuum tube.", "Fleming's diode was used in radio receivers for many decades afterward, until it was superseded by improved solid state electronic technology more than 50 years later.", "Lee De Forest had an interest in wireless telegraphy and he invented the Audion in 1906.", "He was president and secretary of the De Forest Radio Telephone and Telegraph Company (1913).", "The De Forest System was adopted by the United States Government, and had been demonstrated to other Governments including those of Great Britain, Denmark, Germany, Russia, and British Indies, all of which purchased De Forest apparatus previous to the Great War.", "De Forest is one of the fathers of the \"electronic age\", as the Audion helped to usher in the widespread use of electronics.", "De Forest made the \"Audion tube\" from a vacuum tube.", "He also made the \"\"Oscillion\"\", an undamped wave transmitter.", "He developed the De Forest method of wireless telegraphy and founded the American De Forest Wireless Telegraph Company.", "De Forest was a distinguished electrical engineer and the foremost American contributor to the development of wireless telegraphy and telephony." ], [ "Invention of radio", "On 1 June 1894, at a meeting of the British Association for the Advancement of Science at Oxford University, Lodge gave a memorial lecture on the work of Hertz (recently deceased) and the German physicist's proof of the existence of electromagnetic waves 6 years earlier.", "Lodge set up a demonstration on the quasi-optical nature of \"Hertzian waves\" (radio waves) and demonstrated their similarity to light and vision including reflection and transmission.", "Later in June and on 14 August 1894 he did similar experiments, increasing the distance of transmission up to 55 meters.", "In these lectures Lodge demonstrated a detector that would become standard in radio work, an improved version of Branly's detector which Lodge dubbed the \"coherer\".", "It consisted of a glass tube containing metal filings between two electrodes.", "When the small electrical charge from waves from an antenna were applied to the electrodes, the metal particles would cling together or \"cohere\" causing the device to become conductive allowing the current from a battery to pass through it.", "In Lodge's setup the slight impulses from the coherer were picked up by a mirror galvanometer which would deflect a beam of light being projected on it, giving a visual signal that the impulse was received." ], [ "Lee de Forest", "In April 1923, the De Forest Radio Telephone & Telegraph Company, which manufactured de Forest's Audions for commercial use, was sold to a group headed by Edward Jewett of Jewett-Paige Motors, which expanded the company's factory to cope with rising demand for radios.", "The sale also bought the services of de Forest, who was focusing his attention on newer innovations.", "De Forest's finances were badly hurt by the stock market crash of 1929, and research in mechanical television proved unprofitable.", "In 1934, he established a small shop to produce diathermy machines, and, in a 1942 interview, still hoped \"to make at least one more great invention\".", "De Forest was a vocal critic of many of the developments in the entertainment side of the radio industry.", "In 1940 he sent an open letter to the National Association of Broadcasters in which he demanded: \"What have you done with my child, the radio broadcast?", "You have debased this child, dressed him in rags of ragtime, tatters of jive and boogie-woogie.\"", "That same year, de Forest and early TV engineer Ulises Armand Sanabria presented the concept of a primitive unmanned combat air vehicle using a television camera and a jam-resistant radio control in a \"Popular Mechanics\" issue.", "In 1950 his autobiography, \"Father of Radio\", was published, although it sold poorly." ] ], "gold": "American electrical engineer and inventor Edwin Howard Armstrong should be called the father of radio because he developed FM radio and the superheterodyne receiver system. David Sarnoff, who led the Radio Corporation of America in various capacities, and Reginald Fessenden, who acheived the first transmission of speech by radio and the first two-way radiotelegraphic communication across the Atlantic Ocean, should be called the father of radio based on radio broadcasting. Lee de Forest titled his 1950 autobiography \"Father of Radio,\" self pro-claiming himself with the title. Guglielmo Marconi and Jagdish Chandra Bose should be called the father of radio based on their research pioneering the invention of the radio.", "prediction 1": "Lee De Forest is often referred to as the father of radio, as he invented the Audion in 1906 and was president and secretary of the De Forest Radio Telephone and Telegraph Company when the system was first demonstrated to other governments. In 1950, his autobiography, entitled \"Father of Radio\", was published, although it sold poorly. In 1904, Marconi invented the first radio detector, using a vacuum tube. In 1906, Marconi invented the first radio detector, the \"coherer\" detector, which consisted of a glass tube containing metal filings between two electrodes.", "prediction 2": "Lee De Forest is considered to be the father of radio. He invented the Audion. In 1906, Lodge gave a memorial lecture on the work of Hertz and the German physicist's proof of the existence of electromagnetic waves. In 1950, his autobiography, Father of Radio, was published, although it sold poorly.", "prediction 3": "Lee De Forest is considered one of the fathers of the electronic age, as he invented the Audion in 1906. He was a distinguished electrical engineer and the foremost American contributor to the development of wireless telegraphy and telephony. His autobiography, \"Father of Radio\", was published in 1950.", "prediction 4": "Lee De Forest was an American electrical engineer and the foremost American contributor to the development of wireless telegraphy and telephony. He invented the Audion in 1906. On 1 June 1894, at a meeting of the British Association for the Advancement of Science at Oxford University, William Lodge gave a memorial lecture on the work of Hertz and the German physicist's proof of the existence of electromagnetic waves 6 years earlier. In 1950, his autobiography, \"Father of Radio\", was published, although it sold poorly.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 240 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[6]}", "start": 14, "end": 58 }, { "error type": "Irrelevant", "explanation": "", "start": 312, "end": 336 }, { "error type": "Unverifiable", "explanation": "", "start": 337, "end": 345 }, { "error type": "Unverifiable", "explanation": "", "start": 410, "end": 566 } ], "missing-info": [], "corrected-prediction": "Lee De Forest referred to himself as the father of radio. In 1950, his autobiography, entitled \"Father of Radio\", was published. Marconi invented the first radio detector, using a vacuum tube." }, "preference": [ 2, 2, 2, 2, 2, 1 ] }, { "question": "Where is area code 213 located in california?", "passages": [ [ "Area codes 213 and 323", "Area codes 213 and 323\n\nArea codes 213 and 323 are California telephone area codes in the North American Numbering Plan.", "They contain, roughly, the area of central Los Angeles.", "213/323 also includes several gateway cities of the region, including Bell and Huntington Park.", "Before being reunited in an overlay in 2017, they had been separate area codes since 1998, with 213 containing downtown Los Angeles and its immediately adjoining neighborhoods, with 323 containing the rest of the area.", "Area code 213 was one of the three original area codes assigned to California in 1947.", "It initially covered the southern third of the state from the Central Coast to the Mexican border.", "The numbering plan area was extended to the north in 1950, requiring the southern portion of the Central Valley, including Bakersfield, to change over from area code 415.", "As a result of southern California's rapid expansion during the second half of the 20th century, 213 has been split on numerous occasions.", "The first area split became necessary in 1951, when most of the southern and eastern portion, including Orange County and San Diego, was assigned area code 714.", "In 1957, 213 was restricted to Los Angeles County, with most of the old 213's northern and western portion becoming area code 805." ], [ "Area codes 213 and 323", "In 1984, the San Fernando Valley and the San Gabriel Valley became area code 818, thus making Los Angeles one of the first major cities in the US to be split between two area codes (New York City was split between 212 and 718 the same year).", "In 1991, West Los Angeles and the South Bay became area code 310.", "The 323 area code was created in 1998 as yet another split of 213.", "When 213 was divided, it kept Los Angeles exchanges 1, 7 and 10, while exchanges 2 through 6, 8, 9, and 11 through 14 went to 323.", "This split made 213 one of the smallest area codes in the nation, covering only Downtown Los Angeles and its immediately adjoining neighborhoods, such as Chinatown.", "Completely surrounding 213, 323 covered most of the remainder of central Los Angeles, including Hollywood, as well as several neighboring cities, including Bell, Huntington Park and Montebello.", "Despite Southern California's continued rapid growth and the proliferation of cell phones and pagers, 213 was not projected to exhaust until 2050.", "In contrast, 323 was projected to exhaust in 2017." ] ], "gold": "Area codes 213 and 323 are telephone area codes in the North American Numbering Plan for the state of California. They are assigned to a numbering plan area that comprises, roughly, the area of central Los Angeles, and includes several Southeast LA communities, such as Bell and Huntington Park. In 1947, the state of California was divided into three numbering plan areas, with 213 used for the southern parts of the state, and extending from the Central Coast to the Mexican border. In 1998, the Los Angeles NPA was divided once more, to create area code 323, where Area code 213 was kept by Los Angeles exchanges 1, which is Downtown/Echo Park, 7, which is South Park/Exposition Park, and 10, which is Westlake/Koreatown.", "prediction 1": "There are several area codes in California that correspond to each other and are known as area codes. Area code 213 is located in Los Angeles County, which is the largest county in the state. Area code 323 is located in the city of Pasadena, which is the second largest city in the state.", "prediction 2": "Area code 213 was one of the three original area codes assigned to California in 1947. It initially covered the southern third of the state from the Central Coast to the Mexican border. The numbering plan area was extended to the north in 1950, requiring the southern portion of the Central Valley, including Bakersfield, to change over from area code 415. As a result of southern California's rapid expansion during the second half of the 20th century, 213 has been split on numerous occasions. The first area split became necessary in 1951, when most of the southern and eastern portion, including Orange County and San Diego, became area code 818. In 1991, West Los Angeles became area code 310 and the South Bay became area code 310. The 323 area code was created in 1998 as yet another split of 213", "prediction 3": "There are several area codes in California. Area code 213 was one of the three original area codes assigned to California in 1947. It initially covered the southern third of the state from the Central Coast to the Mexican border. Before being reunited in an overlay in 2017, they had been separate area codes since 1998, with 213 containing downtown Los Angeles and its immediately adjoining neighborhoods, with 323 containing the rest of the area.", "prediction 4": "Area code 213 was one of the three original area codes assigned to California in 1947. It initially covered the southern third of the state from the Central Coast to the Mexican border. The numbering plan area was extended to the north in 1950, requiring the southern portion of the Central Valley, including Bakersfield, to change over from area code 415. However, as a result of Southern California's rapid expansion during the second half of the 20th century, 213 has been split on numerous occasions. Prior to being reunited in an overlay in 2017, the two area codes were separated by 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 101 }, { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 288 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5, 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": " Area code 213 and 323 are California telephone area codes in the North American Numbering Plan. They contain, roughly, the area of central Los Angeles. 213/323 also includes several gateway cities of the region, including Bell and Huntington Park. In 1947 213 initially covered the southern third of the state from the Central Coast to the Mexican border. In 1957, 213 was restricted to Los Angeles County." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did the black death start in the uk?", "passages": [ [ "Black Death in England", "Black Death in England\n\nThe Black Death was a bubonic plague pandemic, which reached England in June 1348.", "It was the first and most severe manifestation of the Second Pandemic, caused by \"Yersinia pestis\" bacteria.", "The term \"Black Death\" was not used until the late 17th century.", "Originating in China, it spread west along the trade routes across Europe and arrived on the British Isles from the English province of Gascony.", "The plague seems to have been spread by flea-infected rats, as well as individuals who had been infected on the continent.", "Rats were the reservoir hosts of the \"Y. pestis\" bacteria and the Oriental rat flea was the primary vector.", "The first known case in England was a seaman who arrived at Weymouth, Dorset, from Gascony in June 1348.", "By autumn, the plague had reached London, and by summer 1349 it covered the entire country, before dying down by December.", "Low estimates of mortality in the early twentieth century have been revised upwards due to re-examination of data and new information, and a figure of 40\u201360 percent of the population is widely accepted.", "The English government handled the crisis well, and the country did not experience the extreme reactions that were seen elsewhere in Europe.", "The most immediate consequence was a halt to the campaigns of the Hundred Years' War." ], [ "Great Plague of London", "Great Plague of London\n\nThe Great Plague, lasting from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England.", "It happened within the centuries-long time period of the Second Pandemic, an extended period of intermittent bubonic plague epidemics which began in China in 1331, the first year of the Black Death, an outbreak which included other forms such as pneumonic plague, and lasted until 1750.", "The Great Plague killed an estimated 100,000 people\u2014almost a quarter of London's population\u2014in 18 months.", "The plague was caused by the \"Yersinia pestis\" bacterium, which is usually transmitted through the bite of an infected rat flea.", "The 1665\u201366 epidemic was on a far smaller scale than the earlier Black Death pandemic; it was remembered afterwards as the \"great\" plague mainly because it was the last widespread outbreak of bubonic plague in England during the 400-year timespan of the Second Pandemic.", "As in other European cities of the period, the plague was endemic in 17th century London.", "The disease periodically erupted into massive epidemics.", "There were 30,000 deaths due to the plague in 1603, 35,000 in 1625, and 10,000 in 1636, as well as smaller numbers in other years." ] ], "gold": "The Black Death was a bubonic plague pandemic, which reached England in June 1348. The Great Plague, lasting from 1665 to 1666, was the last major epidemic of the bubonic plague to occur in England. The term \"Black Death\" was not used until the late 17th century.", "prediction 1": "The Black Death was a bubonic plague pandemic, which reached England in June 1348. It was the first and most severe manifestation of the Second Pandemic, caused by Yersinia pestis bacteria. Originating in China, the plague spread west along the trade routes across Europe and arrived on the British Isles from the English province of Gascony. The plague seemed to have been spread by flea-infected rats, as well as individuals who had been infected on the continent. The plague then reached London, and lasted from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England. It happened within the centuries-long time period of the Second Pandemic, an extended period of intermittent bubonic plague epidemics which began in China in 1331, the first year of the Black Death, an outbreak which included other forms such as pneumonic plague, and", "prediction 2": "The Black Death was a bubonic plague pandemic which reached England in June 1348. It was the first and most severe manifestation of the Second Pandemic, caused by Yersinia pestis bacteria. The term \"Black Death\" was not used until the late 17th century. Originating in China, it spread west along the trade routes across Europe and arrived on the British Isles from the English province of Gascony. The Great Plague, lasting from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England.", "prediction 3": "The Black Death was a bubonic plague pandemic, which reached England in June 1348. It was the first and most severe manifestation of the Second Pandemic, caused by Yersinia pestis bacteria. The term \"Black Death\" was not used until the late 17th century. Originating in China, it spread west along the trade routes across Europe and arrived on the British Isles from the English province of Gascony. The plague seemed to have been spread by flea-infected rats, as well. The Great Plague, lasting from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England. It happened within the centuries-long time period of the Second Pandemic, an extended period of intermittent bubonic plague epidemics which began in China in 1331, the first year of the Black Death, an outbreak which included other forms of the plague and lasted until", "prediction 4": "The Black Death was a bubonic plague pandemic, which reached England in June 1348. It was the first and most severe manifestation of the Second Pandemic, caused by Yersinia pestis bacteria. The term \"Black Death\" was not used until the late 17th century. Originating in China, it spread west along the trade routes across Europe and arrived on the British Isles from the English province of Gascony. The plague seems to have been spread by flea-infected rats, as well. The Great Plague, lasting from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 342 }, { "error type": "Irrelevant", "explanation": "", "start": 343, "end": 466 }, { "error type": "Irrelevant", "explanation": "", "start": 597, "end": 864 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Black Death was a bubonic plague pandemic, which reached England in June 1348. The plague then reached London, and lasted from 1665\u20131666, was the last major epidemic of the bubonic plague to occur in England. The term \"Black Death\" was not used until the late 17th century." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "What is the name of nigeria president wife?", "passages": [ [ "President of Nigeria", "President of Nigeria\n\nThe President of the Federal Republic of Nigeria is the head of state and head of the national executive of Nigeria.", "The President of Nigeria is also the commander-in-chief of the Nigerian Armed Forces.", "The President is elected in national elections which take place every four years.", "The first President of Nigeria was Nnamdi Azikiwe, who took office on October 1, 1963.", "The current President, Muhammadu Buhari took office on May 29, 2015 as the 15th President of the Federal Republic of Nigeria.", "As of September of 2018, multiple Nigerian leaders had claimed Muhammadu Buhari died in a London hospital in June of 2018, sparking controversy whether Muhammadu Buhari was cloned, or could even an imposter from Sudan.", "Little evidence supports such claims other than diminishing health and old age before being hospitalized.", "On October 1, 1960, Nigeria gained independence from Britain.", "An all-Nigerian Executive Council was headed by a Prime Minister, Alhaji Sir Abubakar Tafawa Balewa.", "On November 16, 1960, Dr. Nnamdi Azikiwe, became the first Governor-General of a Federation of three Regions of the North, East and West, with Lagos as the Federal Capital.", "Each of the Regions was headed by a Premier with a Governor as Ceremonial Head." ], [ "President of Nigeria", "In May 1999, Major General Abdulsalami Abubakar stepped down, and the former military head of state, Olusegun Obasanjo, became the newly elected civilian president.", "Obasanjo served two terms in office.", "In May 2007, Alhaji Umaru Yar'Adua was sworn in as President of the Federal Republic of Nigeria, the 13th head of state of Nigeria.", "Yar'Adua died on 5 May 2010 in the Presidential villa, in Abuja, Nigeria.", "On 6 May 2010, the Vice President Goodluck Jonathan was sworn in as President of the Federal Republic of Nigeria and the 14th head of state.", "On 29 May 2015, Muhammadu Buhari was sworn in as President of the Federal Republic of Nigeria and the 15th head of state after winning the general election.", "The President has the powers entrusted by the Constitution and legislation, including those necessary to perform the functions of Head of State and Head of the national executive.", "The President is responsible for:\n\n\nChapter VI, Part I, Section 131 of the constitution states that a person may be qualified for election of the office of the President if:\n\nA person who meets the above qualifications is still disqualified from holding the office of the President if:\n\nThe Constitution of Nigeria specifies an oath of office for the President of the federation." ], [ "Patience Jonathan", "Patience Jonathan\n\nPatience Faka Jonathan (nee Oba) was born on 25th October 1957.", "She is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan.", "She served as a permanent secretary in her native Bayelsa State.", "Born in Port Harcourt, she earned her school certificate in 1976, and passed the West African School Certificate Examination (WASCE) in 1980.", "In 1989, she obtained the National Certificate of Education (NCE) in Mathematics and Biology from the Rivers State College of Arts and Science, Port Harcourt.", "She then proceeded to the University of Port Harcourt and studied for a B.Ed in Biology and Psychology.", "She was awarded an honorary doctorate from the University of Port Harcourt.", "Jonathan started her career as a teacher at the Stella Maris College, Port Harcourt and at the Sports Institute Isaka.", "She then moved to the banking sector in 1997.", "She served as Marketing Manager of Imiete Community Bank.", "After which she established the first community bank in Port Harcourt called the Akpo Community Bank.", "She returned to the classroom briefly again as a teacher.", "Eventually she was transferred to the Bayelsa State Ministry of Education, where she served until 29 May 1999 when her husband became the Deputy Governor of the state." ] ], "gold": "The current Nigerian president since 2015, Muhammadu Buhari's, wife's name is Aisha Halilu. Preceeding Buhari was Dr. Goodluck Jonathan, and his wife's name is Dame Patience Faka Jonathan. And, prior to Dr. Jonathan's reign, Alhaji Umaru Musa Yar'Adua was president of Nigeria. His wife is Hajiya Turai Umar Musa Yar'Adua.", "prediction 1": "Patience Jonathan is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan. She was born on 25th October 1957. She is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan.", "prediction 2": "The President of Nigeria is the head of state and head of the national executive of Nigeria. The first President of Nigeria was Nnamdi Azikiwe, who took office on October 1, 1963. The current President, Muhammadu Buhari, took office on May 29, 2015 as the 15th President of the Federal Republic of Nigeria. The former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan, is Patience Faka Jonathan.", "prediction 3": "The first President of Nigeria was Nnamdi Azikiwe, who took office on October 1, 1963. The current President, Muhammadu Buhari, took office on May 29, 2015 as the 15th President of the Federal Republic of Nigeria. Patience Faka Jonathan is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan.", "prediction 4": "President of Nigeria is the head of state of Nigeria and the head of the national executive of Nigeria. The first Nigerian President was Nnamdi Azikiwe, who took office on October 1, 1963. The President of Nigeria, Muhammadu Buhari, took office on May 29, 2015 as the 15th President of the Federal Republic of Nigeria. Patience Faka Jonathan was born on 25th October 1957. She is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 150 }, { "error type": "Redundant", "explanation": "Patience Jonathan is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan.", "start": 151, "end": 252 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 5 ] } ], "corrected-prediction": "Patience Jonathan is a former First Lady of Nigeria and the wife of former President of Nigeria, Goodluck Jonathan. Following his presidency, in May 2015, Muhammadu Buhari was sworn in as President of the Federal Republic of Nigeria. Prior to Jonathan's reign, Alhaji Umaru Musa Yar'Adua was president of Nigeria." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "When was married at first sight season 6 filmed?", "passages": [ [ "Married at First Sight (U.S. TV series)", "The fourth season of the Married at First Sight TV show on Fyi premiered on Tuesday, July 26, 2016 at 9:00pm", "Et/Pt.", "The setting was South Florida (particularly Miami) and in this season, two new specialists joined sociologist Dr. Pepper Schwartz: communication and relationship expert, Rachel DeAlto, and marriage counselor, Pastor Calvin Roberson.", "Dr.'s Joseph Cilona and Logan Levkoff exited the series after season three.", "The couples were:\nAll three were divorced.", "Heather and Derek decided to end their relationship after two weeks of marriage.", "After fourteen months of marriage, Lillian and Tom announced on May 31, 2017 that they have filed for divorce but still remain close friends and a part of each other's lives.", "The fifth season of Married at First Sight was renewed on October 25, 2016.", "For this season, the show moved to the Lifetime channel.", "The episodes aired in 2017 and featured couples in Chicago.", "The couples were:\n\nDanielle and Cody announced their divorce on August 22, 2017.", "On November 19th, Nate posted a status update on Facebook that he and Sheila filed for divorce.", "Ashley and Anthony are still married.", "They have announced they are expecting their first child.", "The sixth season of Married at First Sight was renewed on the Lifetime channel.", "The first of the episodes aired on January 2, 2018 and featured couples in Boston." ], [ "Married at First Sight (U.S. TV series)", "Married at First Sight (U.S. TV series)\n\nMarried at First Sight is an American reality television series based on a Danish series of the same name titled \"Gift Ved F\u00f8rste Blik\".", "The series first aired in the United States on FYI.", "Beginning with season two, it aired in simulcast on sister network A&E.", "The series features three couples, paired up by relationship experts, who agree to marry when they first meet.", "For the first three seasons, the experts were clinical psychologist Dr. Joseph Cilona, sexologist Dr. Logan Levkoff, sociologist Dr. Pepper Schwartz, and humanist chaplain Greg Epstein.", "Starting with the fourth season, the experts are Schwartz, pastor and marriage counselor Calvin Roberson, and communication and relationship expert Rachel DeAlto.", "The couples spend their wedding night in a hotel before leaving for a honeymoon.", "Upon returning home, they live together as a married couple for eight weeks.", "Thereafter they choose to divorce or stay married.", "On October 25, 2016 FYI renewed the show for a fifth season.", "In 2017, for the fifth season, the show moved to the Lifetime channel.", "The following year, two spinoffs were announced to premiere that October, \"Married at First Sight: Honeymoon Island\" and \"Married at First Sight: Happily Ever After\"." ], [ "Married at First Sight (Australian TV series)", "Married at First Sight (Australian TV series)\n\nMarried at First Sight is an Australian reality television series based on the Danish program of the same name on the Nine Network.", "The show features four couples, matched by three experts, who agree to marry when they first meet.", "However, unlike other versions of the show around the world, the couples do not partake in a legally binding marriage due to legal restrictions, but instead meet as strangers at the altar of a commitment ceremony.", "The couples spend their wedding night in a hotel, then leave for a honeymoon.", "Upon returning they live together for a month, whereafter they choose whether they will continue their relationship.", "The first season premiered on 18 May 2015 on the Nine Network.", "A second season began on 4 April 2016 with the third season premiering later in the same year on 29 August 2016.", "A fourth season premiered on Monday 30 January 2017.", "The fifth season premiered on Monday 29 January 2018.", "During the first season, four female contestants were matched with their \u2018perfect\u2019 male partner by a panel of experts.", "In the first episode, two couples (Michael & Roni, Clare & Lachlan) met and wed.", "In the second episode, another two couples (Zoe & Alex, Michelle & James) did the same.", "The couples embarked on married life for the rest of the season." ] ], "gold": "Several countries have produced their own version of Married at First Sight, which is a reality television based on the original Danish series titled Gift Ved Forste Blik. The individual countries air episodes according to their own schedule. For instance, the American version of Married at First Sight aired the season 6 premiere show on January 2, 2018. While the Australian version of the show aired the season 6 premiere on 28 January 2019.", "prediction 1": "Married at First Sight is an American reality television series based on a Danish series of the same name titled \"Gift Ved Frste Blik\". The first season premiered on 18 May 2015 on the Nine Network. The second season began on 4 April 2016 with the third season premiering later in the same year on 29 August 2016. The fourth season premiered on Tuesday, July 26, 2016 at 9:00pm Et/Pt. The setting was South Florida (particularly Miami). The sixth season of the Married at First Sight was renewed on October 25, 2016. The first of the episodes aired on January 2, 2018 and featured couples in Chicago.\n", "prediction 2": "Married at First Sight is an American reality television series based on a Danish series of the same name starting with season three. The couples are paired up by relationship experts who agree to marry when they first meet. However, unlike other versions of the show around the world, the couples do not partake in a legally binding marriage due to legal restrictions, but instead meet as strangers at the altar of a commitment ceremony. The television show features four couples, matched by three experts, who agree to marry when they first meet when they first meet. The first season of the Australian reality television series premiered on the nine network on the 22 November 24, 2015.", "prediction 3": "The American reality television series Married At First Sight first aired in the United States in 2015, then moved to the Nine Network and the Lifetime channel in 2016 and 2017. The Season 6 finale aired on January 2, 2018. The Australian reality television series Married at First Sight features four couples, matched by three experts, who agree to marry when they first meet.", "prediction 4": "Married at First Sight is an American reality television series based on a Danish series of the same name titled \"Gift Ved Frste Blik\". The first season premiered on 18 May 2015. Season 2 premiered on 4 April 2016, season 3 premiered on 30 January 2017, and season 4 premiered on 29 January 2018. Season 6 of the American series aired in 2017-08-09.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 37 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 313 }, { "error type": "Irrelevant", "explanation": "", "start": 314, "end": 384 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 488, "end": 516 }, { "error type": "Irrelevant", "explanation": "", "start": 568, "end": 601 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Married at First Sight is a reality television series based on a Danish series of the same name titled \"Gift Ved Frste Blik\". The sixth season of the American version of Married at First Sight had its first episodes aired on January 2, 2018. There is also an Australian version. \n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Where do historians believe the black death originated?", "passages": [ [ "Black Death", "The plague disease, caused by \"Yersinia pestis\", is enzootic (commonly present) in populations of fleas carried by ground rodents, including marmots, in various areas including Central Asia, Kurdistan, Western Asia, North India and Uganda.", "Due to climate change in Asia, rodents began to flee the dried out grasslands to more populated areas, spreading the disease.", "Nestorian graves dating to 1338\u20131339 near Issyk-Kul in Kyrgyzstan have inscriptions referring to plague and are thought by many epidemiologists to mark the outbreak of the epidemic, from which it could easily have spread to China and India.", "In October 2010, medical geneticists suggested that all three of the great waves of the plague originated in China.", "The 13th-century Mongol conquest of China caused a decline in farming and trading.", "However, economic recovery had been observed at the beginning of the fourteenth\u00a0century.", "In the 1330s, a large number of natural disasters and plagues led to widespread famine, starting in 1331, with a deadly plague arriving soon after.", "Epidemics that may have included plague killed an estimated 25\u00a0million Chinese and other Asians during the fifteen\u00a0years before it reached Constantinople in 1347.", "The disease may have travelled along the Silk Road with Mongol armies and traders or it could have come via ship." ], [ "Black Death", "By the end of 1346, reports of plague had reached the seaports of Europe: \"India was depopulated, Tartary, Mesopotamia, Syria, Armenia were covered with dead bodies\".", "Plague was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347.", "After a protracted siege, during which the Mongol army under Jani Beg was suffering from the disease, the army catapulted infected corpses over the city walls of Kaffa to infect the inhabitants.", "The Genoese traders fled, taking the plague by ship into Sicily and the south of Europe, whence it spread north.", "Whether or not this hypothesis is accurate, it is clear that several existing conditions such as war, famine, and weather contributed to the severity of the Black Death.", "There appear to have been several introductions into Europe.", "The plague reached Sicily in October 1347, carried by twelve Genoese galleys, and rapidly spread all over the island.", "Galleys from Kaffa reached Genoa and Venice in January 1348, but it was the outbreak in Pisa a few weeks later that was the entry point to northern Italy.", "Towards the end of January, one of the galleys expelled from Italy arrived in Marseille." ] ], "gold": "The black death, caused by the bacterium Yersinia pestis, is enzootic, commonly present, in populations of fleas carried by ground rodents, including marmots. Nestorian graves dating to 1338\u20131339 near Issyk-Kul in Kyrgyzstan have inscriptions referring to plague, which has led some historians and epidemiologists to think they mark the outbreak of the epidemic. Others favour an origin in China. The black death was reportedly first introduced to Europe via Genoese traders from their port city of Kaffa in the Crimea in 1347.", "prediction 1": "The Black Death was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. The disease would have travelled along the Silk Road with Mongol armies and traders or it could have come via ship. Medical geneticists suggested that all three of the great waves of the plague originated in China. Plague was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347.", "prediction 2": "In October 2010, medical geneticists suggested that all three of the great waves of the Black Death originated in China. The disease was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. Plague was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. The plague reached Sicily in October 1347, carried by twelve Genoese galleys, and rapidly spread all over the island.", "prediction 3": "The Black Death was first reportedly introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347.", "prediction 4": "The Black Death was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. The plague reached Sicily in October 1347, carried by twelve Genoese galleys, and rapidly spread all over the island. The outbreak in Pisa a few weeks later was the entry point to northern Italy.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Black Death was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. ", "start": 342, "end": 459 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 242 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The plague disease, caused by \"Yersinia pestis\", is enzootic (commonly present) in populations of fleas carried by ground rodents, including marmots. Nestorian graves dating to 1338\u20131339 near Issyk-Kul in Kyrgyzstan have inscriptions referring to plague and are thought by many epidemiologists to mark the outbreak of the epidemic. The Black Death was reportedly first introduced to Europe via Genoese traders at the port city of Kaffa in the Crimea in 1347. Medical geneticists suggested that all three of the great waves of the plague originated in China. " }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did lead stop being used in paint uk?", "passages": [ [ "Lead-based paint in the United Kingdom", "Lead (lead naphthenate) was added as a drying agent to some types of paint to ensure the paint surface hardened.", "In the 1960s this practice was phased out for ordinary paint available to the general public, however its use has not (so far) been banned by legislation.", "The Lead Paint Safety Association (LiPSA) is a not-for-profit UK organisation that aims to promote awareness and best practice in lead paint safety and compliance.", "LiPSA's objective is to prevent and ultimately to eliminate childhood and occupational lead poisoning.", "LiPSA was founded by Tristan Olivier.", "LiPSA's members include individuals and organisations, especially those in the area of lead paint testing and removal and offers web-based, email and telephone advice in relation to lead paint, including testing strategies.", "LiPSA also offers an emergency telephone support line for child lead poisoning and/or occupational exposure concerns." ], [ "Lead-based paint in the United Kingdom", "Lead-based paint in the United Kingdom\n\nMost lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses.", "Prior to this lead compounds had been used as the pigment and drying agent in different types of paint, for example brick and some tile paints\n\nUntil the early 1960s white lead (lead carbonate/lead sulphate) was added in substantial quantities as the main white pigment in some paint products intended for use as a primer or top coat over metal and wood, both internally and externally.", "Examples of where this type of paint may have been used are skirting boards, doors, door frames, stairs, banisters, window frames and sills, wooden flooring, radiators, and pipes, though it could also have been applied to any other surface at this time e.g. plaster walls.", "Prior to this the concentration of white lead in paint rose to its highest levels between the years 1930 and 1955, as much as half the volume in some paints, meaning many post-war UK houses have significant amounts of lead in original paint layers.", "In the 1950s, alternative white pigments, such as titanium dioxide, were introduced." ], [ "Lead-based paint in the United Kingdom", "Similar red lead-based compounds were also widely used as a jointing compound in engineering, to form steam- or oil-tight flanged joints in pipework.", "Red lead in paint was not banned by the 1992 legislation or by more recent EU REACH regulations and the SPAB confirm it is technically available in the UK without special licence.", "In practice however it has been replaced by safer alternatives (such as red oxide) by most UK/EU paint suppliers; and indeed of those that still supply it, some mistakenly assume it is covered by the 1992 regulations and request approval from a 'competent body' before purchase.", "Until the early 1970s red, yellow, orange and green lead-based pigments (lead chromate) were added to a limited number of decorative coloured gloss and wall paints.", "Following this non-lead alternatives were used as pigments.", "However lead chromate continued to be used in yellow road markings up to the present day.", "Its use was supposed to cease on 21 May 2015, the sunset date set by EU REACH regulations.", "However a last minute request for authorization by the Canadian pigment producer \"Dominion Colour Corporation (DCC)\" has had preliminary support by the European Chemicals Agency, which if approved could see its use continue in road markings until 2022 or later." ] ], "gold": "Various types of lead have been used as the pigment and drying agent in different kinds of paint in the UK which have been a significant cause of lead poisoning. The practice of adding lead nephthenate as a drying agent to some types of paint to ensure the paint surface hardened, was voluntarily phased out for ordinary paint available to the general public in the 1960s. Until the early 1970s, red, yellow, orange, and green lead-based pigments were added to a limited number of decorative colored glass and wall paints. Except for specialist uses, most lead-based paint was banned for sale to the general public in the UK in 1992.", "prediction 1": "Most lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses. This was followed by the introduction of red lead-based pigments, which were widely used as a jointing compound in engineering, to form steam- or oil-tight flanged joints in pipework. Lead chromate was added to a limited number of decorative coloured gloss and wall paints. Its use was supposed to cease on 21 May 2015, the sunset date set by EU REACH regulations. However, a last minute request for authorization by the Canadian pigment producer, saw its use continue in yellow road markings up to the present day.", "prediction 2": "Most lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses. However, red lead in paint was not banned by the 1992 legislation or by more recent EU REACH regulations and the SPAB confirm it is technically available in the UK without special licence. However, red lead chromate continued to be used in yellow road markings up to the present day. Its use was supposed to cease on 21 May 2015, the sunset date set by EU REACH regulations. A last minute request for authorization by the Canadian pigment producer DCC has seen its use continue in road markings up to the present day.", "prediction 3": "Most lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses. Until the early 1960s white lead (lead carbonate/lead sulphate) was added in substantial quantities as the main white pigment in some paint products intended for use as a primer or top coat over metal and wood, both internally and externally. Red lead in paint was not banned by the 1992 legislation or by more recent EU REACH regulations and the SPAB confirm it is technically available in the UK/EU paint suppliers.", "prediction 4": "Most lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses. Until the early 1960s, white lead was added in substantial quantities as the main white pigment in some paint products intended for use as a primer or top coat over metal and wood, both internally and externally. Until the early 1970s red, yellow, orange and green lead-based pigments were added to a limited number of decorative coloured gloss and wall paints. Following this non-lead alternatives were used as pigments. Lead chromate was supposed to cease on 21 May 2015, the sunset date set by EU REACH regulations.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 643 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "Lead (lead naphthenate) was added as a drying agent to some types of paint to ensure the paint surface hardened, in the UK which have been a significant cause of lead poisoning. In the 1960s this practice was phased out for ordinary paint available to the general public. Most lead-based paint in the United Kingdom was banned from sale to the general public in 1992, apart from for specialist uses. Until the early 1970s red, yellow, orange and green lead-based pigments, lead chromate, was added to a limited number of decorative coloured gloss and wall paints. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who named the seven wonders of the world?", "passages": [ [ "Seven Wonders of the Ancient World", "Instead of \"wonders\", the ancient Greeks spoke of \"\"theamata\"\" (\u03b8\u03b5\u03ac\u03bc\u03b1\u03c4\u03b1), which means \"sights\", in other words \"things to be seen\" (\u03a4\u1f70 \u1f11\u03c0\u03c4\u1f70 \u03b8\u03b5\u03ac\u03bc\u03b1\u03c4\u03b1 \u03c4\u1fc6\u03c2 \u03bf\u1f30\u03ba\u03bf\u03c5\u03bc\u03ad\u03bd\u03b7\u03c2 [\u03b3\u1fc6\u03c2] \"\").", "Later, the word for \"wonder\" (\"\"thaumata\"\" \u03b8\u03b1\u03cd\u03bc\u03b1\u03c4\u03b1, \"wonders\") was used.", "Hence, the list was meant to be the Ancient World's counterpart of a travel guidebook.", "The first reference to a list of seven such monuments was given by Diodorus Siculus.", "The epigrammist Antipater of Sidon who lived around or before 100 BC, gave a list of seven such monuments, including six of the present list (substituting the walls of Babylon for the lighthouse):\n\nAnother 2nd century BC observer, who claimed to be the mathematician Philo of Byzantium, wrote a short account entitled \"The Seven Sights of the World\".", "However, the incomplete surviving manuscript only covered six of the supposedly seven places, which agreed with Antipater's list.", "Earlier and later lists by the historian Herodotus (484 BC\u2013ca." ], [ "Wonders of the World", "Wonders of the World\n\nVarious lists of the Wonders of the World have been compiled from antiquity to the present day, to catalogue the world's most spectacular natural wonders and manmade structures.", "The Seven Wonders of the Ancient World is the first known list of the most remarkable creations of classical antiquity; it was based on guidebooks popular among Hellenic sightseers and only includes works located around the Mediterranean rim and in Mesopotamia.", "The number seven was chosen because the Greeks believed it represented perfection and plenty, and because it was the number of the five planets known anciently, plus the sun and moon.", "Many similar lists have been made.", "The historian Herodotus (484 \u2013 ca. 425 BC) and the scholar Callimachus of Cyrene (ca. 305\u2013240 BC), at the Museum of Alexandria, made early lists of seven wonders.", "Their writings have not survived, except as references.", "The classic seven wonders were:\n\n\nThe only ancient world wonder that still exists is the Great Pyramid of Giza.", "In the 19th and early 20th centuries, some writers wrote their own lists with names such as Wonders of the Middle Ages, Seven Wonders of the Middle Ages, Seven Wonders of the Medieval Mind, and Architectural Wonders of the Middle Ages." ], [ "Seven Wonders of the Ancient World", "Seven Wonders of the Ancient World\n\nThe Seven Wonders of the World or the Seven Wonders of the Ancient World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists.", "Although the list, in its current form, did not stabilise until the Renaissance, the first such lists of seven wonders date from the 1st-2nd century BC.", "The original list inspired innumerable versions through the ages, often listing seven entries.", "Of the original Seven Wonders, only one\u2014the Great Pyramid of Giza (also called the Pyramid of Khufu, after the pharaoh who built it), the oldest of the ancient wonders\u2014remains relatively intact.", "The Colossus of Rhodes, the Lighthouse of Alexandria, the Mausoleum at Halicarnassus, the Temple of Artemis and the Statue of Zeus were all destroyed.", "The location and ultimate fate of the Hanging Gardens are unknown, and there is speculation that they may not have existed at all.", "The Greek conquest of much of the known western world in the 4th century BC gave Hellenistic travellers access to the civilizations of the Egyptians, Persians, and Babylonians.", "Impressed and captivated by the landmarks and marvels of the various lands, these travellers began to list what they saw to remember them." ] ], "gold": "The Seven Wonders of the World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems. The first reference to a list of seven such monuments was given by Diodorus Siculus. Antipater of Sidon gave a list including six of the present list. Another 2nd century BC writer, Philo of Byzantium, wrote a short account entitled The Seven Sights of the World. Earlier and later lists by the historian Herodotus and the poet Callimachus of Cyrene, housed at the Museum of Alexandria, survive only as references.", "prediction 1": "The Seven Wonders of the World, also known as the Seven Wonders of the Ancient World, are a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The ancient Greeks believed seven represented perfection and plenty, and because it was the number of the five planets known anciently, plus the sun and moon. Antipater of Sidon gave a list of seven such monuments, including six of the present list. In the 2nd century BC, another observer, who claimed to be the mathematician Philo of Byzantium, wrote a short account entitled The Seven Sights of the World. In the 19th and early 20th century, some writers wrote their own lists with names such as Wonders of the Middle Ages, Seven Wonders of the Middle Ages, Seven Wonders of the Medieval Mind, and Architectural Wonder", "prediction 2": "The Seven Wonders of the World are a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The epigrammist Antipater of Sidon gave a list of seven such monuments, including six of the present list. Another 2nd century BC observer, who claimed to be the mathematician Philo of Byzantium, wrote a short account entitled The Seven Sights of the World.", "prediction 3": "The Seven Wonders of the World, also known as the Seven Wonders of the Ancient World, is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The original list inspired innumerable versions through the ages, often listing seven entries. The epigrammist Antipater of Sidon, who lived around or before 100 BC, gave a list of seven such monuments, including six of the present list. A more recent version, which dates back to around 400 BC, was named the Seven Wonders of the Ancient World by Herodotus, and the scholar Callimachus of Cyrene.", "prediction 4": "The Seven Wonders of the World is a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. Herodotus, Callimachus, and Philo compiled the first known list of seven such monuments, and later lists of seven wonders by Antipater, Herodotus and others.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 236 }, { "error type": "Irrelevant", "explanation": "", "start": 237, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 646, "end": 858 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Seven Wonders of the World, also known as the Seven Wonders of the Ancient World, are a list of remarkable constructions of classical antiquity given by various authors in guidebooks or poems popular among ancient Hellenic tourists. The first reference to a list of seven such monuments was given by Diodorus Siculus. Antipater of Sidon gave a list of seven such monuments, including six of the present list. In the 2nd century BC, another observer, who claimed to be the mathematician Philo of Byzantium, wrote a short account entitled The Seven Sights of the World. The historian Herodotus and the scholar Callimachus of Cyrene, at the Museum of Alexandria, made early lists of seven wonders." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who turned the hagia sophia into a mosque?", "passages": [ [ "Conversion of non-Islamic places of worship into mosques", "Zoroastrian temples converted into mosques in such a manner could be found in Bukhara, as well as in and near Istakhr and other Iranian cities, such as: Tarikhaneh Temple, Jameh Mosque of Qazvin, Heidarieh Mosque of Qazvin, Jameh Mosque of Isfahan, Jameh Mosque of Kashan, Jameh Mosque of Ardestan, Jameh Mosque of Yazd, Jameh Mosque of Borujerd, Great Mosque of Herat.", "Hagia Sophia (from the , \"Holy Wisdom\"; or \"Sancta Sapientia\"; ) is a former Orthodox patriarchal basilica, later a mosque, and now a museum in Istanbul, Turkey.", "From the date of its dedication in 360 until 1453, it served as the Greek Patriarchal cathedral of Constantinople, except between 1204 and 1261, when it was converted to a Roman Catholic cathedral under the Latin Patriarch of Constantinople of the Western Crusader established Latin Empire.", "In 1453, Constantinople was conquered by the Ottoman Turks under Sultan Mehmed II, who subsequently ordered the building converted into a mosque.", "The bells, altar, iconostasis, and sacrificial vessels were removed and many of the mosaics were plastered over." ], [ "Hagia Sophia", "The focal point of the Eastern Orthodox Church for nearly one thousand years, the building witnessed the excommunication of Patriarch Michael I Cerularius officially communicated by Humbert of Silva Candida, the papal envoy of Pope Leo IX in 1054, an act that is commonly considered the start of the East\u2013West Schism.", "In 1453, Constantinople was conquered by the Ottoman Empire under Mehmed the Conqueror, who ordered this main church of Orthodox Christianity converted into a mosque.", "Although some parts of the city of Constantinople were falling into disrepair, the cathedral was maintained with an amount of money set aside for this purpose.", "Nevertheless, the Christian cathedral made a strong impression on the new Ottoman rulers and they decided to convert it into a mosque..\"", "LiveScience. The bells, altar, iconostasis, and other relics were destroyed and the mosaics depicting Jesus, his Mother Mary, Christian saints, and angels were also destroyed or plastered over.", "Islamic features\u2014such as the mihrab (a niche in the wall indicating the direction toward Mecca, for prayer), minbar (pulpit), and four minarets\u2014were added." ] ], "gold": "Hagia Sophia is a former Orthodox patriarchal basilica, later a mosque, and now a museum in Istanbul, Turkey. From the date of its dedication in 360 until 1453, it served as the Greek Patriarchal cathedral of Constantinople, except between 1204 and 1261, when it was converted to a Roman Catholic cathedral under the Latin Patriarch of Constantinople of the Western Crusader established Latin Empire. In 1453, Constantinople was conquered by the Ottoman Empire under Sultan Mehmed II, who subsequently ordered the building converted into a mosque.", "prediction 1": "In 1453, Constantinople was conquered by the Ottoman Empire under Mehmed the Conqueror, who ordered this main church of Orthodox Christianity converted into a mosque. Although some parts of the city of Constantinople were falling into disrepair, the cathedral was maintained with an amount of money set aside for this purpose. Nevertheless, the Christian cathedral made a strong impression on the new Ottoman rulers and they decided to convert it into a mosque.", "prediction 2": "In 1453, Constantinople was conquered by the Ottoman Empire under Sultan Mehmed II, who subsequently ordered the building converted into a mosque. Although some parts of the city of Constantinople were falling into disrepair, the cathedral was maintained with an amount of money set aside for this purpose. Nevertheless, the Christian cathedral made a strong impression on the new Ottoman rulers and they decided to convert it into a mosque.", "prediction 3": "The Hagia Sophia was converted into a mosque in 1453 by Sultan Mehmed the Conqueror, the Sultan of Ottoman Empire. However, the building had been in a state of disrepair when it was converted to a Roman Catholic cathedral under the Latin Patriarch of Constantinople of the Western Crusader established Latin Empire.", "prediction 4": "In 1453, Constantinople was conquered by the Ottoman Empire under Sultan Mehmed II, who subsequently ordered the building converted into a mosque. Although some parts of the city of Constantinople were falling into disrepair, the cathedral was maintained with an amount of money set aside for this purpose.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 461 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Hagia Sophia is a former Orthodox patriarchal basilica, later a mosque, and now a museum in Istanbul, Turkey. From the date of its dedication in 360 until 1453, it served as the Greek Patriarchal cathedral of Constantinople, except between 1204 and 1261, when it was converted to a Roman Catholic cathedral under the Latin Patriarch of Constantinople of the Western Crusader established Latin Empire. In 1453, Constantinople was conquered by the Ottoman Empire under Mehmed the Conqueror, who ordered this main church of Orthodox Christianity converted into a mosque. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "What is the rat's name in ratatouille?", "passages": [ [ "Ratatouille (film)", "Ratatouille (film)\n\nRatatouille ( , ) is a 2007 American computer-animated comedy film produced by Pixar and released by Walt Disney Pictures.", "It is the eighth film produced by Pixar and was co-written and directed by Brad Bird, who took over from Jan Pinkava in 2005.", "The title refers to a French dish, \"ratatouille\", which is served at the end of the film and is also a play on words about the species of the main character.", "The film stars the voices of Patton Oswalt as Remy, an anthropomorphic rat who is interested in cooking; Lou Romano as Linguini, a young garbage boy who befriends Remy; Ian Holm as Skinner, the head chef of Auguste Gusteau's restaurant; Janeane Garofalo as Colette, a r\u00f4tisseur at Gusteau's restaurant; Peter O'Toole as Anton Ego, a restaurant critic; Brian Dennehy as Django, Remy's father and leader of his clan; Peter Sohn as Emile, Remy's older brother; and Brad Garrett as Auguste Gusteau, a recently deceased chef.", "The plot follows a rat named Remy, who dreams of becoming a chef and tries to achieve his goal by forming an alliance with a Parisian restaurant's garbage boy." ], [ "Ratatouille (film)", "Development of \"Ratatouille\" began in 2000 when Pinkava wrote the original concepts of the film.", "In 2005, Bird was approached to direct the film and revise the story.", "Bird and some of the film's crew members also visited Paris for inspiration.", "To create the food animation used in the film, the crew consulted chefs from both France and the United States.", "Bird also interned at Thomas Keller's The French Laundry restaurant, where Keller developed the confit byaldi, a dish used in the film.", "\"Ratatouille\" premiered on June 22, 2007, at the Kodak Theatre in Los Angeles, California, with its general release June 29, 2007, in the United States.", "The film grossed $620.7\u00a0million at the box office and received critical acclaim.", "The film won the Academy Award for Best Animated Feature, and was later voted one of the 100 greatest motion pictures of the 21st century by a 2016 poll of international critics conducted by BBC.", "Remy is an idealistic and ambitious young rat with highly developed senses of taste and smell who dreams of becoming a chef like his idol, the recently deceased Auguste Gusteau.", "When his family are forced to flee their home he becomes separated from them and eventually finds himself at a skylight overlooking the kitchen of Gusteau's restaurant." ], [ "Patton Oswalt", "Patton Oswalt\n\nPatton Peter Oswalt (born January 27, 1969) is an American stand-up comedian, actor, voice actor and writer.", "He is known for roles as Spencer Olchin in the sitcom \"The King of Queens\" (1998\u20132007), voicing Remy in the Pixar film \"Ratatouille\" (2007), co-starring alongside Charlize Theron in \"Young Adult\" (2011) and the Koenigs on \"Agents of S.H.I.E.L.D.\" (2014\u20132017).", "Oswalt has appeared in six stand-up specials and won a Primetime Emmy Award for Outstanding Writing for a Variety Special and a Grammy Award for Best Comedy Album for his Netflix special \"Patton Oswalt: Talking for Clapping\" (2016).", "Oswalt made his acting debut in the \"Seinfeld\" episode \"The Couch\", appeared in the superhero film \"\" (2004), starred in the comedy-drama film \"Big Fan\" (2009) and the series \"The Heart, She Holler\" (2011\u20132014)." ] ], "gold": "There were several rats in the 2007 film Ratatouille. The rat who was the main protagonist was Remy, who was voiced by stand-up comedian, actor, and screenwriter Patton Oswalt. The rat who was Remy and Emile's father was Django, while the rat who was Remy's gluttonous older brother was Emile. Git was the rat who was a former lab rat and member of Django's colony.", "prediction 1": "Ratatouille is a 2007 American computer-animated comedy film produced by Pixar and released by Walt Disney Pictures. The plot follows a rat named Remy, who dreams of becoming a chef and tries to achieve his goal by forming an alliance with a Parisian restaurant's garbage boy. The film stars the voices of Patton Oswalt as Remy, an anthropomorphic rat who is interested in cooking. Lou Romano as Linguini, a young garbage boy who befriends Remy, who is also a play on words about the species of the main character.", "prediction 2": "Ratatouille is a 2007 American computer-animated comedy film produced by Pixar and released by Walt Disney Pictures. The title refers to a French dish, \"ratatouille\", which is served at the end of the film and is also a play on words about the species of the main character, known as Remy. The film stars the voices of Patton Oswalt as Remy, an anthropomorphic rat who dreams of becoming a chef and tries to achieve his goal by forming an alliance with a Parisian restaurant's garbage boy who befriends Remy. Lou Romano as Linguini, a young garbage boy who befriends Remy.", "prediction 3": "Ratatouille is a 2007 American computer-animated comedy film produced by Pixar and released by Walt Disney Pictures. The plot follows a rat named Remy, an anthropomorphic rat with highly developed senses of taste and smell who dreams of becoming a chef like his idol, the recently deceased Auguste Gusteau. The film stars the voices of Patton Oswalt as Remy, an idealistic and ambitious young rat who dreams of becoming a chef by forming an alliance with a Parisian restaurant's garbage boy who befriends Remy. Lou Romano as Linguini, a young garbage boy who befriends Remy, a garbage boy who befriends Remy.", "prediction 4": "Ratatouille is a 2007 American computer-animated comedy film produced by Pixar and released by Walt Disney Pictures. The plot follows a rat named Remy, an anthropomorphic rat, who dreams of becoming a chef. The film stars the voices of Patton Oswalt as Remy, an anthropomorphic rat who is interested in cooking. Lou Romano as Linguini, a young garbage boy who befriends Remy, Ian Holm as Skinner, the head chef of Auguste Gusteau's restaurant.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 116 }, { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 276 }, { "error type": "Irrelevant", "explanation": "", "start": 382, "end": 514 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several rats in the movie. The film stars the voices of Patton Oswalt, an American stand-up comedian, actor, voice actor and writer, as Remy, an anthropomorphic rat who is interested in cooking. Brian Dennehy plays Django, Remy's father. Peter Sohn plays as Emile, Remy's older brother." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who developed a method of printing that greatly stimulated the growth of literacy?", "passages": [ [ "Printing press", "Printing press\n\nA printing press is a device for applying pressure to an inked surface resting upon a print medium (such as paper or cloth), thereby transferring the ink.", "It marked a dramatic improvement on earlier printing methods in which the cloth, paper or other medium was brushed or rubbed repeatedly to achieve the transfer of ink, and accelerated the process.", "Typically used for texts, the invention and global spread of the printing press was one of the most influential events in the second millennium.", "Johannes Gutenberg, a goldsmith by profession, developed, circa 1439, a printing system by adapting existing technologies to printing purposes, as well as making inventions of his own.", "Printing in East Asia had been prevalent since the Tang dynasty, and in Europe, woodblock printing based on existing screw presses was common by the 14th century.", "Gutenberg's most important innovation was the development of hand-molded metal printing matrices, thus producing a movable type based printing press system.", "His newly devised hand mould made possible the precise and rapid creation of metal movable type in large quantities.", "Movable type had been hitherto unknown in Europe.", "In Europe, the two inventions, the hand mould and the printing press, together drastically reduced the cost of printing books and other documents, particularly in short print runs.", "The printing press spread within several decades to over two hundred cities in a dozen European countries." ], [ "Bi Sheng", "Bi Sheng\n\nB\u00ec Sh\u0113ng (990\u20131051 AD) was a Chinese artisan and inventor of the world's first movable type technology, one of the Four Great Inventions of Ancient China.", "Bi Sheng's system was made of Chinese porcelain and was invented between 1041 and 1048 during the medieval Song dynasty.", "Bisheng Community (\u6bd5\u5347\u793e\u533a) in Wenquan, Huanggang, Hubei is named for Bi Sheng.", "The Bi Sheng crater located in the LAC-7 quadrant near the northern pole on the far side of the Moon was named after Bi Sheng by the IAU in August, 2010.", "Bi Sheng was born in Yingshan County, Hubei a commoner, and his ancestry and details were not recorded.", "He was recorded only in the \"Dream Pool Essays\" by Chinese scholar-official and polymath Shen Kuo (1031\u20131095).", "The book records detailed description on the technical details of Bi Sheng's invention of movable type:\n\n", "The government official Wang Zhen (fl. 1290\u20131333) improved Bi Sheng's clay types by innovation through wood, as his process increased the speed of typesetting as well.", "Later in China by 1490 bronze movable type was developed by the wealthy printer Hua Sui (1439\u20131513).", "Shelton A. Gunaratne (2001)." ] ], "gold": "There were several methods of printing that greatly stimulated the growth of literacy. One was called the printing press, which was invented by goldsmith Johannes Gutenberg in Germany around 1440. Another was called movable type, which was invented by Chinese artisan, engineer, and inventor Bi Sheng between 1039 and 1048.", "prediction 1": "The printing press is a device for applying pressure to an inked surface resting upon a print medium, thereby transferring the ink. It marked a dramatic improvement on earlier printing methods in which the cloth, paper or other medium was brushed or rubbed repeatedly to achieve the transfer of ink, and accelerated the process. Johannes Gutenberg, a goldsmith by profession, developed, circa 1439, a printing system by adapting existing technologies to printing purposes, as well as making inventions of his own. The printing press spread within several decades to over two hundred cities in a dozen European countries. He died in 1051, his invention was made possible by the development of hand-molded metal printing matrices, thus producing movable type based printing press system. His newly devised hand mould made possible the precise and rapid creation of metal movable type hitherto unknown in Europe.", "prediction 2": "There are several people who have developed a method of printing that greatly stimulated the growth of literacy. Among them are: Johannes Gutenberg, a goldsmith by profession, developed, circa 1439, a printing system by adapting existing technologies to printing purposes, as well as making inventions of his own. Johannes Gutenberg's most important innovation was the development of hand-molded metal printing matrices, thus producing a movable type based printing press system. His newly devised hand mould made possible the precise and rapid creation of metal movable type in large quantities.", "prediction 3": "The printing press was developed by several people. Johannes Gutenberg, a goldsmith by profession, developed, circa 1439, a printing system by adapting existing technologies to printing purposes, as well as introducing inventions of his own. Bi Sheng, a Chinese artisan and inventor of the world's first movable type technology, was one of the Four Great Inventions of Ancient China. Hua Sui, a wealthy printer from China, developed bronze movable type by 1439.", "prediction 4": "A printing press is a device for applying pressure to an inked surface resting upon a print medium, thereby transferring the ink. It marked a dramatic improvement on earlier printing methods in which the cloth, paper or other medium was brushed or rubbed repeatedly to achieve the transfer of ink, and accelerated the process. Johannes Gutenberg, a goldsmith by profession, developed a printing system by adapting existing technologies to printing purposes, as well as making inventions of his own, circa 1439. His most important innovation was the development of hand-molded metal printing matrices, thus producing a movable type based printing press system. His newly devised hand mould made possible the precise and rapid creation of metal movable type hitherto unknown in Europe.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 131 }, { "error type": "Irrelevant", "explanation": "", "start": 132, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 514, "end": 620 }, { "error type": "Irrelevant", "explanation": "", "start": 621, "end": 785 }, { "error type": "Irrelevant", "explanation": "", "start": 786, "end": 909 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Johannes Gutenberg, a goldsmith by profession, developed, circa 1439, a printing system by adapting existing technologies to printing purposes, as well as making inventions of his own. Bi Sheng was a Chinese artisan and inventor of the world's first movable type technology between 1041 and 1048." }, "preference": [ 2, 2, 0, 2, 1, 1 ] }, { "question": "What's the release date for the punisher on netflix?", "passages": [ [ "Lucifer (TV series)", "On May 11, 2018, Fox cancelled \"Lucifer\" after three seasons.", "A month later, Netflix picked up the series for a fourth season of ten episodes, which is set to be released in 2019.", "The series focuses on Lucifer Morningstar, the Devil, who is bored and unhappy as the Lord of Hell.", "He resigns his throne and abandons his kingdom for Los Angeles, where he ends up running his nightclub \"Lux\".", "He becomes involved in a murder case with Detective Chloe Decker, and is subsequently invited to be a consultant to the LAPD.", "In April 2016, Fox renewed the series for a second season, which premiered on September 19, 2016.", "On October 31, 2016, the series received a 22-episode full second season pickup by Fox.", "On February 13, 2017, Fox renewed the series for a third season initially of 22 episodes, which premiered on October 2, 2017.", "However, in March 2017, it was revealed that the final four episodes of the second season would be removed and placed in the third season to air, meaning that the second season would consist of 18 episodes and the third season would consist of 26.", "On January 22, 2018, writer Chris Rafferty indicated that the third season would instead contain 24 episodes.", "On May 11, 2018, Fox canceled the series after three seasons, stating it was a \"ratings-based decision\"." ], [ "The Punisher (TV series)", "The Punisher (TV series)\n\nMarvel's The Punisher, or simply The Punisher, is an American web television series created for Netflix by Steve Lightfoot, based on the Marvel Comics character of the same name.", "It is set in the Marvel Cinematic Universe (MCU), sharing continuity with the films and other television series of the franchise, and is a spin-off of \"Marvel's Daredevil\".", "The series is produced by Marvel Television in association with ABC Studios and Bohemian Risk Productions, with Lightfoot serving as showrunner.", "The series revolves around Frank Castle, who uses lethal methods to fight crime as the vigilante \"the Punisher\", with Jon Bernthal reprising the role from \"Daredevil\".", "Ben Barnes, Amber Rose Revah, and Jason R. Moore also star.", "They are joined by Ebon Moss-Bachrach, Daniel Webber, Paul Schulze, Michael Nathanson, Jaime Ray Newman, and Deborah Ann Woll in the first season, with Josh Stewart, Floriana Lima, Giorgia Whigham, Corbin Bernsen, and Annette O'Toole joining for the second season.", "A television series centered on the Punisher received a put pilot commitment at Fox in 2011, but that project fell through." ] ], "gold": "Marvel's The Punisher, or simply The Punisher, is an American television series created by Steve Lightfoot for the streaming service Netflix, based on the Marvel Comics character of the same name. All episodes of the first season were released on November 17, 2017. A month later, the series was renewed for a second season, which was released on January 18, 2019. On February 18, 2019, Netflix canceled the series after two seasons.", "prediction 1": "Marvel's The Punisher, or simply the Punisher, is an American web television series created for Netflix by Steve Lightfoot, based on the Marvel Comics character of the same name, and set in the Marvel Cinematic Universe. The series' first season was released on Netflix on June 29, 2016. The second season was released on Netflix on September 19, 2016. The third season was released on Netflix on October 2, 2017.", "prediction 2": "The Punisher is an American web television series created for Netflix by Steve Lightfoot based on the Marvel Comics character of the same name. Season 1 of the series was released on May 9, 2019, and season 2 was released on October 2, 2019. Season 3 was released on Netflix on October 2, 2019, and season 4 was released on Netflix on January 22, 2020.", "prediction 3": "Marvel's The Punisher, or simply The Punisher, is an American web television series created for Netflix by Steve Lightfoot, based on the Marvel Comics character The Punisher. The series' fourth season is set to be released in 2019.", "prediction 4": "Marvel's The Punisher, or simply The Punisher, is an American web television series created for Netflix by Steve Lightfoot, based on the Marvel Comics character of the same name. The first two seasons released on Netflix on September 19, 2016, October 31, 2016, and October 2, 2017. The third season released on Netflix on October 2, 2017, October 2, 2017, and October 3, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 220 }, { "error type": "Unverifiable", "explanation": "", "start": 221, "end": 287 }, { "error type": "Unverifiable", "explanation": "", "start": 288, "end": 352 }, { "error type": "Unverifiable", "explanation": "", "start": 353, "end": 413 } ], "missing-info": [], "corrected-prediction": "Marvel's The Punisher, or simply the Punisher, is an American web television series created for Netflix by Steve Lightfoot, based on the Marvel Comics character of the same name." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When was the first mobile phone text message sent?", "passages": [ [ "Text messaging", "The GSM in the US had to use a frequency allocated for private communication services (PCS) \u2013 what the ITU frequency r\u00e9gime had blocked for DECT \u2013 Digital Enhanced Cordless Telecommunications \u2013 1000-feet range picocell, but survived.", "American Personal Communications (APC), the first GSM carrier in America, provided the first text-messaging service in the United States.", "Sprint Telecommunications Venture, a partnership of Sprint Corp. and three large cable-TV companies, owned 49 percent of APC.", "The Sprint venture was the largest single buyer at a government-run spectrum auction that raised $7.7 billion in 2005 for PCS licenses.", "APC operated under the brand name of Sprint Spectrum and launched its service on November 15, 1995 in Washington, D.C. and in Baltimore, Maryland.", "Vice President Al Gore in Washington, D.C. made the initial phone-call to launch the network, calling Mayor Kurt Schmoke in Baltimore.", "Initial growth of text messaging was slow, with customers in 1995 sending on average only 0.4 message per GSM customer per month.", "One factor in the slow take-up of SMS was that operators were slow to set up charging systems, especially for prepaid subscribers, and to eliminate billing fraud, which was possible by changing SMSC settings on individual handsets to use the SMSCs of other operators." ], [ "History of mobile phones", "The first machine-generated SMS message was sent in the UK on 3 December 1992 followed in 1993 by the first person-to-person SMS sent in Finland.", "The advent of prepaid services in the late 1990s soon made SMS the communication method of choice among the young, a trend which spread across all ages.", "2G also introduced the ability to access media content on mobile phones.", "In 1998 the first downloadable content sold to mobile phones was the ring tone, launched by Finland's Radiolinja (now Elisa).", "Advertising on the mobile phone first appeared in Finland when a free daily SMS news headline service was launched in 2000, sponsored by advertising.", "Mobile payments were trialed in 1998 in Finland and Sweden where a mobile phone was used to pay for a Coca-Cola vending machine and car parking.", "Commercial launches followed in 1999 in Norway.", "The first commercial payment system to mimic banks and credit cards was launched in the Philippines in 1999 simultaneously by mobile operators Globe and Smart.", "The first full internet service on mobile phones was introduced by NTT DoCoMo in Japan in 1999.", "As the use of 2G phones became more widespread and people began to use mobile phones in their daily lives, it became clear that demand for data (such as access to browse the internet) was growing.", "Further, experience from fixed broadband services showed there would also be an ever-increasing demand for greater data speeds." ] ], "gold": "SMS messaging was used for the first time on 3 December 1992, when Neil Papworth, a 22-year-old test engineer for Sema Group in the UK used a personal computer to send the text message \"Merry Christmas\" to the phone of Richard Jarvis, who was at a party in Newbury, Berkshire. Later, in 1993 in Finland, the first mobile phone text message was sent from phone to phone.", "prediction 1": "The first machine-generated SMS message was sent in the UK on 3 December 1992 followed in 1993 by the first person-to-person SMS sent in Finland. The first full internet service on mobile phones was introduced by NTT DoCoMo in Japan in 1999.", "prediction 2": "The first machine-generated SMS message was sent in the UK on 3 December 1992 followed in 1993 by the first person-to-person SMS sent in Finland. The first commercial mobile internet service was introduced by NTT DoCoMo in Japan in 1999.", "prediction 3": "In the US, the first GSM text message was sent on November 15, 1995 in Washington, D.C. and in Baltimore, Maryland by American Personal Communications, the first GSM carrier in America. In the UK, the first machine-generated text message was sent on December 3, 1992, and in Finland, the first person-to-person text message was sent on January 3, 1993.", "prediction 4": "The first machine-generated SMS message was sent in the UK on 3 December 1992. The first person-to-person SMS was sent in Finland on April 1, 1993. The first full Internet service on mobile phones was introduced by NTT DoCoMo in Japan in 1999. The first prepaid mobile service was launched in the United States on November 15, 1995.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 241 } ], "missing-info": [], "corrected-prediction": "The first machine-generated SMS message was sent in the UK on 3 December 1992 followed in 1993 by the first person-to-person SMS sent in Finland. " }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When is the last time the redskins won a superbowl?", "passages": [ [ "Washington Redskins", "With 24 postseason appearances, the Redskins have an overall postseason record of Their three Super Bowl wins are tied with the Oakland Raiders and Denver Broncos, behind the Pittsburgh Steelers (six), San Francisco 49ers, Dallas Cowboys, and New England Patriots (five each), and the Green Bay Packers and New York Giants (four each).", "All of the Redskins' league titles were attained during two 10-year spans.", "From 1936 to 1945, the Redskins went to the NFL Championship six times, winning two of them.", "The second period lasted between 1982 and 1991 where the Redskins appeared in the postseason seven times, captured four Conference titles, and won three Super Bowls out of four appearances.", "The Redskins have also experienced failure in their history.", "The most notable period of general failure was from 1946 to 1970, during which the Redskins posted only four winning seasons and did not have a single postseason appearance.", "During this period, the Redskins went without a single winning season during the years 1956\u20131968.", "In 1961, the franchise posted their worst regular season record with a 1\u201312\u20131 showing.", "Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record." ], [ "D.C. Armor", "D.C. Armor\n\nThe D.C. Armor was a professional indoor football team that began play in the American Indoor Football Association (AIFA) in the 2009 season.", "The team was based in Washington, D.C., with home games at the under-renovation D.C. Armory.", "The Armor were the first professional football team to play within the District of Columbia since the Washington Redskins left for FedExField in 1997.", "The Armor was also the area's first indoor football team since the Washington Commandos played in the Arena Football League in 1990, and the only arena/indoor football team to play within the district (the Commandos played in the Capital Centre and the Patriot Center) until the formation of the Washington Valor who play their home games at Capital One Arena.", "After one, poorly attended season, the Armor folded." ], [ "Washington Redskins", "Washington Redskins\n\nThe Washington Redskins are a professional American football team based in the Washington metropolitan area.", "The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division.", "The team plays its home games at FedExField in Landover, Maryland; its headquarters and training facility are at Inova Sports Performance Center at Redskins Park in Ashburn, Virginia and the Redskins Complex in Richmond, Virginia, respectively.", "The Redskins have played more than one thousand games since their founding in , and are one of only five franchises in the NFL to record over six hundred regular season and postseason wins, reaching that mark in 2015.", "The Redskins have won five NFL Championships (the latter three in Super Bowls), and have captured fourteen divisional titles and six conference championships.", "It was the first NFL franchise with an official marching band and the first with a fight song, \"Hail to the Redskins\".", "The team began play in Boston as the Braves in 1932, and became the \"Redskins\" the following year.", "In 1937, the team relocated to Washington, D.C.", "The Redskins won the 1937 and 1942 NFL championship games, as well as Super Bowls XVII, XXII, and XXVI.", "They have been league runner-up six times, losing the 1936, 1940, 1943, and 1945 title games, and Super Bowls VII and XVIII." ] ], "gold": "The Washington Football Team is a professional American football team based in the Washington metropolitan area. Formerly known as the Washington Redskins, the team competes in the National Football League (NFL) as a member club of the NFC East division. Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times with just nine seasons with a winning record. Super Bowl XXVI was a game between the Washington Redskins and the the Buffalo Bills which was held on January 26, 1992.", "prediction 1": "The Washington Redskins are a professional American football team based in the Washington metropolitan area. They are the only NFL team to have won three Super Bowls. Their last Super Bowl victory came in 1992. The last time the Redskins won a Super Bowl was in 1999.", "prediction 2": "The Washington Redskins are a professional American football team based in the Washington metropolitan area and compete in the National Football League as a member of the National Football Conference East division. The Redskins have won five NFL Championships and have captured fourteen divisional titles and six conference championships. Since their last Super Bowl victory following the end of the 1991 season, the Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record.", "prediction 3": "The Washington Redskins have won two Super Bowls in recent memory. In 1946, when the Redskins went without a single winning season, they had four winning seasons and did not have a single postseason appearance. In 1981, the Redskins won their first Super Bowl. In 1992, the Redskins won their second Super Bowl.", "prediction 4": "The Washington Redskins have won Super Bowls five times, including the 1987, 1991, and 1992 Super Bowls. The Redskins have also experienced failure in their history. From 1936 to 1945, the Redskins went to the NFL Championship six times, winning two of them. The second period lasted between 1982 and 1991 where the Redskins appeared in the postseason seven times, captured four Conference titles, and won three Super Bowls out of four appearances. Since their last Super Bowl victory following the end of the 1991 season, the Washington Redskins have only won the NFC East three times, made five postseason appearances, and had nine seasons with a winning record.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 122, "end": 126 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 262, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 166 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Washington Redskins are a professional American football team based in the Washington metropolitan area. The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division. Their last Super Bowl victory came in the end of the 1991 season. The Redskins have only won the NFC East three times, and had nine seasons with a winning record." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "Who sang you never give me your money?", "passages": [ [ "You Never Give Me Your Money", "You Never Give Me Your Money\n\n\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album \"Abbey Road\".", "It was written by Paul McCartney (though credited to Lennon\u2013McCartney) and documented the financial and personal difficulties facing the band.", "The song is the first part of the medley on side two of \"Abbey Road\" and was recorded in stages between May and August 1969.", "The song was the first one to be recorded for the medley, which was conceived by McCartney and producer George Martin as a finale for the Beatles' career.", "The backing track was recorded at Olympic Sound Studios in Barnes, London, but the remainder of overdubs occurred at Abbey Road Studios.", "Musically, the song is made up of a suite of various segments, ranging from a piano ballad at the beginning through to guitar arpeggios at the end.", "The song was written by McCartney when he was staying with new wife Linda in New York in March 1969, shortly after the \"Get Back\" sessions that ultimately resulted in \"Let It Be\".", "John Lennon and McCartney were at risk of losing overall control of Northern Songs, the company that published their songs, after ATV Music bought a majority share." ], [ "You Never Give Me Your Money", "In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now!", "\", a CD of \"Abbey Road\" covers accompanying the October 2009 issue of \"Mojo\" magazine." ], [ "Tenacious D (album)", "The song is described by the band, and others as a rock opera.", "Some critics have lamented that songs performed live and featured on the TV series were not included on the album.", "These include \"Jesus Ranch\" and \"Cosmic Shame\".", "Black accounted for the band's decision not to include \"Jesus Ranch\" saying \"it just didn't cut the mustard\".", "A demo recording of \"Jesus Ranch\" was later released on the \"D Fun Pak\".", "In support of the album, the band embarked on a national tour.", "All the songs were performed acoustically.", "The band covered Queen's \"Flash\" and The Beatles \"You Never Give Me Your Money\".", "Tenacious D shows featured \"City Hall\" in the encore, a song about rioting against the government, and it played at shows until the events of September 11 attacks.", "The band initially removed the song from the set, but would eventually return it in the spring of 2002.", "Tenacious D's first album garnered critical acclaim.", "\"Entertainment Weekly\" described the release as being \"hilarious,\" and \"no mere comedy record.\"", "Allmusic said it \"rocks so damn hard\" but it reflects on the lack of some of the songs from the HBO episodes." ] ], "gold": "You Never Give Me Your Money is a song by the English rock band the Beatles with lead vocals by Paul McCartney. The song is the first part of the medley on side two of their 1969 album Abbey Road. In 2009, Nine Below Zero with Glenn Tilbrook covered You Never Give Me Your Money on Abbey Road Now!, a CD of Abbey Road covers. Additionally, comedy rock duo Tenacious D covered You Never Give Me Your Money in medley with The End as a single released on 2 July 2021.", "prediction 1": "\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album Abbey Road. It was written by Paul McCartney and documented the financial and personal difficulties facing the band. In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now! \", a CD of \"Abbey Road\" covers accompanying the October 2009 issue of \"Mojo\" magazine. In support of the album, the band Tenacious D covered Queen's \"Flash\" and the Beatles \"You Never Give Me Your Money.\"", "prediction 2": "\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album Abbey Road. It was written by Paul McCartney, though credited to John Lennon\u2013McCartney, and documented the financial and personal difficulties facing the band. In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now! \", a CD of Abbey Road covers accompanying the October 2009 issue of \"Mojo\".", "prediction 3": "\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album Abbey Road. It was written by Paul McCartney (though credited to Lennon\u2013McCartney) and documented the financial and personal difficulties facing the band. In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now! \", a CD of \"Abbey Road\" covers accompanying the October 2009 issue of \"Mojo\".", "prediction 4": "\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album Abbey Road. It was written by Paul McCartney, though credited to Lennon\u2013McCartney, and documented the financial and personal difficulties facing the band. In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now! \", a CD of Abbey Road covers accompanying the October 2009 issue of \"Mojo\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 414 } ], "missing-info": [], "corrected-prediction": "\"You Never Give Me Your Money\" is a song by the Beatles, appearing as the first element in the B-side medley of their 1969 album Abbey Road. It was written by Paul McCartney. In 2009, Nine Below Zero with Glenn Tilbrook covered the song on \"Abbey Road Now! \", a CD of \"Abbey Road\" covers. In support of the album, the band Tenacious D covered Queen's \"Flash\" and the Beatles \"You Never Give Me Your Money.\"" }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who wrote the song if i were a rich man?", "passages": [ [ "Fiddler on the Roof", "Fiddler on the Roof\n\nFiddler on the Roof is a musical with music by Jerry Bock, lyrics by Sheldon Harnick, and book by Joseph Stein, set in the Pale of Settlement of Imperial Russia in 1905.", "It is based on \"Tevye and his Daughters\" (or \"Tevye the Dairyman\") and other tales by Sholem Aleichem.", "The story centers on Tevye, the father of five daughters, and his attempts to maintain his Jewish religious and cultural traditions as outside influences encroach upon the family's lives.", "He must cope both with the strong-willed actions of his three older daughters, who wish to marry for love \u2013 each one's choice of a husband moves further away from the customs of their Jewish faith and heritage \u2013 and with the edict of the Tsar that evicts the Jews from their village.", "The original Broadway production of the show, which opened in 1964, had the first musical theatre run in history to surpass 3,000 performances.", "\"Fiddler\" held the record for the longest-running Broadway musical for almost 10 years until \"Grease\" surpassed its run.", "It remains the sixteenth longest-running show in Broadway history.", "The production was extraordinarily profitable and highly acclaimed.", "It won nine Tony Awards, including Best Musical, score, book, direction and choreography." ], [ "If I Were a Rich Man (song)", "If I Were a Rich Man (song)\n\n\"If I Were a Rich Man\" is a show tune from the 1964 musical \"Fiddler on the Roof\".", "It was written by Sheldon Harnick and Jerry Bock.", "The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory.", "The title is inspired by a 1902 monologue by Sholem Aleichem in Yiddish, \"Ven ikh bin Rothschild\" (If I were a Rothschild), a reference to the wealth of the Rothschild family, although the content is quite different.", "The lyric is based in part on passages from Sholem Aleichem\u2019s 1899 short story \"The Bubble Bursts.\"", "Both stories appeared in English in the 1949 collection of stories \"Tevye's Daughters.\"", "\"The Oxford Companion to the American Musical\" wrote that the song has \"cantor-like chanting\", and is \"the most revealing of the many character numbers\"." ] ], "gold": "\"If I Were a Rich Man\" is a show tune from the 1964 musical Fiddler on the Roof. The lyrics were written by Sheldon Harnick and the music was composed by Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory.", "prediction 1": "\"If I Were a Rich Man\" is a show tune from the 1964 musical Fiddler on the Roof. It was written by Sheldon Harnick and Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory. The title is inspired by a 1902 monologue by Sholem Aleichem in Yiddish, \"Ven ikh bin Rothschild\", a reference to the wealth of the Rothschild family, although the content is quite different.\n", "prediction 2": "\"If I Were a Rich Man\" is a show tune from the 1964 musical \"Fiddler on the Roof\". It was written by Sheldon Harnick and Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory. The title is inspired by a 1902 monologue by Sholem Aleichem in Yiddish, \"Ven ikh bin Rothschild\", a reference to the wealth of the Rothschild family, although the content is quite different.", "prediction 3": "\"If I Were a Rich Man\" is a show tune from the 1964 musical Fiddler on the Roof. It was written by Sheldon Harnick and Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory.", "prediction 4": "If I Were a Rich Man is a show tune from the 1964 musical Fiddler on the Roof. It was written by Sheldon Harnick and Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory. It's inspired by a 1902 monologue by Sholem Aleichem in Yiddish, \"Ven ikh bin Rothschild,\" a reference to the wealth of the Rothschild family, although the content is quite different.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 424 } ], "missing-info": [], "corrected-prediction": "\"If I Were a Rich Man\" is a show tune from the 1964 musical Fiddler on the Roof. It was written by Sheldon Harnick and Jerry Bock. The song is performed by Tevye, the main character in the musical, and reflects his dreams of glory. " }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Who played the clown in the orginal it?", "passages": [ [ "Tim Curry", "Bill Skarsg\u00e5rd replaced him and while being interviewed at Fan Expo Canada Curry gave his approval, saying that \"I like [Bill] Skarsg\u00e5rd.", "I think he's very clever.", "It'll be interesting to see what sort of clown face he puts on.", "because it's not an obvious clown face at all.", "[..]", "So I'm fascinated to see it.\"", "Curry voiced Taurus Bullba in \"Darkwing Duck\" for 3 episodes.", "He has also appeared in a large number of animated television series and films, starting with the performance of the Serpent in \"\".", "Curry also portrayed Captain Hook in the Fox animated series \"Peter Pan and the Pirates\".", "Curry won a Daytime Emmy Award for his performance.", "Another animated television role was in \"The Wild Thornberrys\", where he played Nigel Thornberry.", "He had small roles in \"The Little Mermaid\" and the 2014 Cartoon Network mini-series \"Over the Garden Wall\", as Auntie Whispers.", "In 1988 Curry recorded the lead voice as the castaway mouse Abelard Hassan DiChirico Flint in Michael Sporn's Emmy Nominated adaptation of William Steig's novel for children, \"Abel's Island\" for Italtoons, now distributed by Random House." ], [ "Tim Curry", "Tim Curry\n\nTimothy James Curry (born 19 April 1946) is an English actor and singer.", "He is best known for working in a diverse range of theatre, film, and television, most often portraying villainous characters.", "Curry rose to prominence with his portrayal of Dr. Frank-N-Furter in \"The Rocky Horror Picture Show\" (1975), reprising the role he had originated in the 1973 London and 1974 Los Angeles stage productions of \"The Rocky Horror Show\".", "His other stage work includes various roles in the original West End production of \"Hair\", Wolfgang Amadeus Mozart in the 1980 Broadway production of \"Amadeus\", the Pirate King in the 1982 West End production of \"The Pirates of Penzance\", Alan Swann in the Broadway production of \"My Favourite Year\", and King Arthur in Broadway and West End productions of \"Spamalot\" from 2005 to 2007.", "Curry received further acclaim for his film and television roles, including as Rooster Hannigan in the film adaptation of \"Annie\" (1982), as Darkness in the fantasy film \"Legend\" (1985), as Wadsworth in the mystery comedy film \"Clue\" (1985), as Pennywise the Dancing Clown in the horror miniseries \"It\" (1990) and Long John Silver in \"Muppet Treasure Island\" (1996).", "Curry has also gained acclaim as a voice actor." ], [ "Bill Skarsg\u00e5rd", "Bill Skarsg\u00e5rd\n\nBill Istvan G\u00fcnther Skarsg\u00e5rd (; born 9 August 1990) is a Swedish actor.", "He starred in the dystopian thriller \"\" (2016), the espionage thriller \"Atomic Blonde\" (2017), the Netflix horror series \"Hemlock Grove\" (2013\u20132015), and appeared in two Stephen King adaptations, as \"The Kid\" in the Hulu series \"Castle Rock\" (2018\u2013present) and Pennywise the Dancing Clown in the two-part adaptation of \"It\", \"It: Chapter One\" and the upcoming \"It: Chapter Two\".", "Skarsg\u00e5rd was born in V\u00e4llingby, Sweden, the son of actor Stellan Skarsg\u00e5rd and My Skarsg\u00e5rd.", "He has seven siblings: Alexander, Gustaf, Valter (all actors), as well as Sam, Ossian, Kolbj\u00f6rn, and Eija.", "Ossian, and Kolbj\u00f6rn are half-brothers from the later marriage between Stellan Skarsg\u00e5rd and Megan Everett.", "In 2011, Skarsg\u00e5rd was nominated for a Guldbagge Award for his leading role as Simon in \"Simple Simon\".", "At the age of 21, he won the European Film Academy's Shooting Stars Award in 2012." ] ], "gold": "Pennywise the Dancing Clown was in the 1990 ABC It miniseries and the films 2017's It and 2019's It Chapter Two. English actor and singer Tim Curry played the clown in the It miniseries. Swedish actor Bill Skarsg\u00e5rd played the clown in the It film series.", "prediction 1": "In the original It, Pennywise the Dancing Clown was played by a number of different actors, including Tim Curry, Bill Skarsgrd, and Michael Sporn. However, in the original It, the role was originally played by a character named Wadsworth.", "prediction 2": "In the original version of It, Pennywise was played by actor Tim Curry. In the original version, Bill Skarsgrd played it with an English accent.", "prediction 3": "In the original It, Pennywise the Dancing Clown was played by William Steig. The role was recast to Bill Skarsgrd and he played Pennywise until Skarsgrd played him in the two-part adaptation.", "prediction 4": "The original It featured Pennywise the Dancing Clown played by Timothy James Curry. In the remade, Pennywise was replaced by Swedish actor Bill Skarsgrd.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[5]}", "start": 62, "end": 101 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the original 1990 It, Pennywise the Dancing Clown was played by Tim Curry. Swedish actor Bill Skarsgrd plays Pennywise in the two-part adaptation of \"It\" \"It: Chapter One\" and the upcoming \"It: Chapter Two\"." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was i'll be there for you released?", "passages": [ [ "I'll Be There for You (The Rembrandts song)", "I'll Be There for You (The Rembrandts song)\n\n", "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts.", "It is best known as the theme song to the American sitcom \"Friends\", which premiered in September 1994 and ended in May 2004.", "The song was also released as the first single from the group's third studio album \"LP\", reaching the top 10 in Australia, New Zealand, and Norway, as well as in Ireland and the United Kingdom in both 1995 and 1997.", "In Canada, the song reached number one for five weeks and was the highest-selling single of 1995, while in the United States, the song reached number 17 on the \"Billboard\" Hot 100 and topped the \"Billboard\" Hot 100 Airplay chart for eight weeks.", "\"I'll Be There for You\" was co-written by \"Friends\" producers David Crane and Marta Kauffman, Kauffman's husband, composer Michael Skloff, and songwriter Allee Willis, along with Phil S\u014dlem and Danny Wilde, both of the Rembrandts.", "It is strongly influenced by The Beatles, especially reminiscent of the \"I Feel Fine\" guitar riff, closely followed by a snatch echoing the beginning of The Monkees' \"Pleasant Valley Sunday.\"" ] ], "gold": "There are multiple songs titled \"I'll Be There For You\", beginning with Bon Jovi releasing one on April 4, 1989. In 1995, the Backstreet Boys released a song by the same title. On April 25, 1995, Method Man and Mary J Blige released a song titled \"I'll Be There For You/You're All I Need to Get By\", and later that year on May 1, 1995, The Rembrandts released \"I'll Be There For You\", best known as the Friends theme song. The Moffatts released a song titled \"I'll Be There For You\" on April 8, 1998.", "prediction 1": "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts. It is best known as the theme song to the American sitcom Friends, which premiered in September 1994 and ended in May 2004. The song was also released as the first single from the group's third studio album \"LP\", reaching the top 10 in Australia, New Zealand, and Norway, as well as in Ireland and the United Kingdom in both 1995 and 1997. In Canada, the song reached number one for five weeks and was the highest-selling single of 1995, while in the United States, the song reached number 17 on the \"Billboard\" Hot 100 and topped the \"Billboard\" Hot 100 Airplay chart for eight weeks.", "prediction 2": "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts. It is best known as the theme song to the American sitcom Friends, which premiered in September 1994 and ended in May 2004. The song was also released as the first single from the group's third studio album \"LP\", reaching the top 10 in Australia, New Zealand, and Norway, as well as in Ireland and the United Kingdom in both 1995 and 1997.", "prediction 3": "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts. It is best known as the theme song to the American sitcom Friends, which premiered in September 1994 and ended in May 2004. It was also released as the first single from the group's third studio album \"LP\", reaching the top 10 in Australia, New Zealand, and Norway, as well as in Ireland and the United Kingdom in both 1995 and 1997. In Canada, the song reached number one for five weeks and was the highest-selling single of 1995. In the United States, the song reached number 17 on the \"Billboard\" Hot 100 and topped the \"Billboard\" Hot 100 Airplay chart for eight weeks.", "prediction 4": "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts. It is best known as the theme song to the American sitcom Friends, which premiered in September 1994 and ended in May 2004. It was also released as the first single from the group's third studio album LP, reaching the top 10 in Australia, New Zealand, and Norway, as well as in Ireland and the United Kingdom in both 1995 and 1997. In Canada, the song reached number one for five weeks and was the highest-selling single of 1995. In the United States, it reached number 17 on the Billboard Hot 100 and topped the Billboard Hot 100 Airplay chart for eight weeks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 419, "end": 664 }, { "error type": "Irrelevant", "explanation": "", "start": 203, "end": 418 }, { "error type": "Irrelevant", "explanation": "", "start": 79, "end": 145 } ], "missing-info": [], "corrected-prediction": "\"I'll Be There for You\" is a song recorded by the American duo The Rembrandts which premiered in September 1994 and ended in May 2004. " }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who is james talking to in the book of james?", "passages": [ [ "Epistle of James", "Epistle of James\n\nThe Epistle of James (), the Book of James, or simply James, is one of the 21 epistles (didactic letters) in the New Testament.", "The author identifies himself as \"James, a servant of God and of the Lord Jesus Christ,\" who is writing to \"the twelve tribes scattered abroad\" (James 1:1).", "The epistle is traditionally attributed to James the brother of Jesus (James the Just), and the audience is generally considered to be Jewish Christians, who were dispersed outside Palestine.", "Framed within an overall theme of patient perseverance during trials and temptations, James writes to encourage believers to live consistently with what they have learned in Christ.", "He wants his readers to mature in their faith in Christ by living what they say they believe.", "He condemns various sins, including pride, hypocrisy, favouritism, and slander.", "He encourages and implores believers to humbly live by godly, rather than worldly wisdom and to pray in all situations.", "Within the New Testament canon, the Epistle of James is noteworthy because it makes no explicit reference to the death, resurrection, or divine sonship of Jesus.", "It refers to Jesus twice, as \"the Lord Jesus Christ\" and as \"our glorious Lord Jesus Christ\" (James 1:1, 2:1)." ], [ "Epistle of James", "Furthermore, the salutation of his letter concludes with the term \u201cgreetings\" (Greek \u03c7\u03b1\u03af\u03c1\u03b5\u03b9\u03bd), much like the letter on circumcision that was sent to the congregations.", "In the latter instance it was apparently Jesus's brother, James, who spoke prominently in the assembly of \"the apostles and the older men\" at Jerusalem.", "Some have said the authorship of this epistle points to James, the brother of Jesus, to whom Jesus evidently had made a special appearance after his resurrection described in the New Testament as this James was prominent among the disciples.", "From the middle of the 3rd century, patristic authors cited the \"Epistle\" as written by James, the brother of Jesus and a leader of the Jerusalem church.", "Not numbered among the Twelve Apostles unless he is identified as James the Less, James was nonetheless a very important figure: Paul described him as \"the brother of the Lord\" in Galatians 1:19 and as one of the three \"pillars of the Church\" in 2:9.", "Pseudonymous authorship (3 above) implies that the person named \"James\" is respected and doubtless well known.", "Moreover, this James, brother of Jesus, is honored by the epistle written and distributed after the lifetime of James, the brother of Jesus." ], [ "Perpetual virginity of Mary", "10:3) by explaining that Cleophas and Alphaeus are simply different renderings of the same name in the Jewish and Greek languages, like Saul and Paul.", "Pseudepigraphic (i.e., bearing the name of an author who did not actually compose the text) second century gospels such as Protoevangelium of James, the Gospel of Peter, and the Infancy Gospel of Thomas identify the brothers of Jesus as his stepbrothers from a previous marriage of Joseph.", "Origen (184-254) wrote that \"according to the apocryphal Gospel of Peter the brethren of Jesus were sons of Joseph by a former wife, whom he married before Mary\".", "The apocryphal History of Joseph the Carpenter describes how Joseph had with his first wife four sons and two daughters.", "Years after his first wife died he took Mary.", "The Protoevangelium of James explicitly claims that Joseph was a widower, with children, at the time that Mary is entrusted to his care.", "The Gospel of Pseudo-Matthew, which was probably written in the seventh century, states that the brothers of Jesus were his cousins.", "Protestant historian Paul L. Maier accepts the view that \"James the brother of the Lord\" was not the biological son of Mary but instead her stepson." ] ], "gold": "The authorship of the Epistle of James and of the Gospel of James is traditionally attributed to James, brother of the Lord, but in fact, the author's identity is unknown. The audience is generally considered to be Jewish Christians, who were dispersed outside Israel. In the Epistle, the author identifies himself as a servant of God and of the Lord Jesus Christ writing to the twelve tribes scattered abroad. ", "prediction 1": "The Book of James, or James, is one of the 21 epistles in the New Testament. James, the brother of Jesus, is talking to the twelve tribes scattered abroad. In the Book of James, he identifies himself as \"James, a servant of God and of the Lord Jesus Christ,\" who is writing to \"the twelve tribes scattered abroad\".", "prediction 2": "The Book of James is one of the 21 epistles in the New Testament. The author identifies himself as \"James, a servant of God and of the Lord Jesus Christ,\" who is writing to \"the twelve tribes scattered abroad\" (James 1:1). The audience is generally considered to be Jewish Christians, who were dispersed outside Palestine.", "prediction 3": "The Epistle of James is one of the 21 epistles in the New Testament. James is described as a servant of God and of the Lord Jesus Christ, who is writing to the twelve tribes scattered abroad. Within the New Testament canon, the Epistle of James is noteworthy because it makes no explicit reference to the death, resurrection, or divine sonship of Jesus. James is also referred to as the Lord Jesus Christ, and as \"our glorious Lord Jesus Christ\".", "prediction 4": "The Epistle of James, also known as the Book of James, is one of the 21 epistles (didactic letters) in the New Testament, and is traditionally attributed to James the brother of Jesus, and the audience is generally considered to be Jewish Christians, who were dispersed abroad. The author identifies himself as James, a servant of God and of the Lord Jesus Christ, who is writing to \"the twelve tribes scattered abroad\" (James 1:1).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 76 }, { "error type": "Redundant", "explanation": "The Book of James, or James, is one of the 21 epistles in the New Testament. James, the brother of Jesus, is talking to the twelve tribes scattered abroad. ", "start": 156, "end": 314 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " In the Book of James, he identifies himself as \"James, a servant of God and of the Lord Jesus Christ,\" who is writing to \"the twelve tribes scattered abroad\". The epistle is traditionally attributed to James the brother of Jesus (James the Just), and the audience is generally considered to be Jewish Christians, who were dispersed outside Palestine." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who is the current prime minister of england?", "passages": [ [ "Boris Johnson", "Boris Johnson\n\nAlexander Boris de Pfeffel Johnson (born 19 June 1964), better known as Boris Johnson, is a British politician, popular historian, and journalist.", "He has been the Member of Parliament (MP) for Uxbridge and South Ruislip since 2015.", "He had previously been the MP for Henley from 2001 to 2008.", "He was Mayor of London from 2008 to 2016, and from 2016 to 2018 he served as Secretary of State for Foreign and Commonwealth Affairs.", "A member of the Conservative Party, Johnson identifies as a one-nation conservative and has been associated with both economically and socially liberal policies.", "Born in New York City to wealthy upper-middle class English parents, Johnson was educated at the European School of Brussels, Ashdown House School, and Eton College.", "He studied Classics at Balliol College, Oxford, where he was elected president of the Oxford Union in 1986.", "He began his career in journalism at \"The Times\" but was sacked for falsifying a quotation.", "He later became \"The Daily Telegraph\"s Brussels correspondent, with his articles exerting a strong influence on growing Eurosceptic sentiment among the British right-wing.", "He was assistant editor from 1994 to 1999 before taking the editorship of \"The Spectator\" from 1999 to 2005." ], [ "Government of the United Kingdom", "Under the uncodified British constitution, executive authority lies with the monarch, although this authority is exercised only by, or on the advice of, the prime minister and the cabinet.", "The Cabinet members advise the monarch as members of the Privy Council.", "In most cases they also exercise power directly as leaders of the Government Departments, though some Cabinet positions are sinecures to a greater or lesser degree (for instance Chancellor of the Duchy of Lancaster or Lord Privy Seal).", "The current prime minister is Theresa May, who took office on 13 July 2016.", "She is the leader of the Conservative Party, which won a majority of seats in the House of Commons in the general election on 7 May 2015, when David Cameron was the party leader; although at the last general election she failed to secure a majority government.", "Prior to this, Cameron and the Conservatives led a coalition from 2010 to 2015 with the Liberal Democrats, in which Cameron was prime minister.", "The Government is occasionally referred to with the metonym Westminster, due to that being where many of the offices of the government are situated, especially by members in the Government of Scotland, the Welsh Government and the Northern Ireland Executive in order to differentiate it from their own.", "A key principle of the British Constitution is that the government is responsible to Parliament.", "This is called responsible government." ], [ "House of Commons of the United Kingdom", "When a Government has lost the confidence of the House of Commons, the prime minister is obliged either to resign, making way for another MP who can command confidence, or to request the monarch to dissolve Parliament, thereby precipitating a general election.", "Parliament normally sits for a maximum term of five years.", "Subject to that limit, the prime minister could formerly choose the timing of the dissolution of parliament, with the permission of the Monarch.", "However, since the Fixed-Term Parliaments Act 2011, terms are now a fixed five years, and an early general election can only be brought about either by a two-thirds majority in favour of a motion for a dissolution, or by a vote of no confidence that is not followed within fourteen days by a vote of confidence (which may be for confidence in the same government or a different one).", "By this second mechanism, the government of the United Kingdom can change without an intervening general election.", "Only four of the eight last Prime Ministers have attained office as the immediate result of a general election; the others have gained office upon the resignation of a Prime Minister of their own party.", "The latter four were Jim Callaghan, John Major, Gordon Brown and the current Prime Minister Theresa May; these four inherited the office from Harold Wilson, Margaret Thatcher, Tony Blair and David Cameron respectively." ] ], "gold": "Boris Johnson is the current Prime Minister of the United Kingdom. He assumed this role in July 2019, succeeding Theresa May. David Cameron and Gordon Brown also previously served as the Prime Minister of the United Kingdom.", "prediction 1": "Theresa May, currently the prime minister of the United Kingdom, took office on 13 July 2016, following a general election on 7 May 2015. She is the leader of the Conservative Party, which won a majority of seats in the House of Commons in the general election on 7 May 2015. The current prime minister is Boris Johnson, who took office on 7 June 2015.", "prediction 2": "Theresa May was elected to be the prime minister of England on 13 July 2016 and took office on 1 August 2017. Boris Johnson was the prime minister of England from 2000 to 2014, and David Cameron was the prime minister from 2010 to 2015.", "prediction 3": "Theresa May, the current prime minister of England, took office on 13 July 2016. She replaced David Cameron as prime minister on 7 May 2015.", "prediction 4": "Theresa May, currently the prime minister of the United Kingdom, has held the position since 13 July 2016. She is the leader of the Conservative Party and was elected to office on 13 July 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 137 }, { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 275 }, { "error type": "Unverifiable", "explanation": "", "start": 276, "end": 352 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "Theresa May, currently the prime minister of the United Kingdom, took office on 13 July 2016. David Cameron and Gordon Brown also previously served as the Prime Minister of the United Kingdom." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where do most of our english words come from?", "passages": [ [ "Foreign language influences in English", "Foreign language influences in English\n\nThe core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s.", "The bulk of the language in spoken and written texts is from this source.", "As a statistical rule, around 70 percent of words in any text are Anglo-Saxon.", "Moreover, the grammar is largely Anglo-Saxon.", "A significant portion of the English vocabulary comes from Romance and Latinate sources.", "Estimates of native words (derived from Old English) range from 20%\u201333%, with the rest made up of outside borrowings.", "A portion of these borrowings come directly from Latin, or through one of the Romance languages, particularly Anglo-Norman and French, but some also from Italian, Portuguese, and Spanish; or from other languages (such as Gothic, Frankish or Greek) into Latin and then into English.", "The influence of Latin in English, therefore, is primarily lexical in nature, being confined mainly to words derived from Latin roots.", "While some new words enter English as slang, most do not.", "Some words are adopted from other languages; some are mixtures of existing words (portmanteau words), and some are new creations made of roots from dead languages: e.g., thanatopsis." ] ], "gold": "The core of the English language descends from the Old English language, brought from the 500s with the Anglo Saxon and Jutish settlers to what would be called England. Estimates of native words, derived from Old English, range from 20% to 33%, with the rest made up of outside borrowings. A portion of these borrowings come directly from Latin, or through one of the Romance languages, particularly Anglo-Norman and French.", "prediction 1": "The core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s. As a statistical rule, around 70 percent of words in any text are Anglo-Saxon. Moreover, the grammar is largely Anglo-Saxon. A significant portion of the English vocabulary comes from Romance and Latinate sources. Estimates of native words (derived from Old English) range from 20%\u201333%, with the rest made up of outside borrowings.", "prediction 2": "The core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s. As a statistical rule, around 70 percent of words in any text are Anglo-Saxon. Furthermore, the grammar is largely Anglo-Saxon. A significant portion of the English vocabulary comes from Romance and Latinate sources. Estimates of native words (derived from Old English) range from 20%\u201333%, with the rest made up of outside borrowings.", "prediction 3": "The core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s. The bulk of the language in spoken and written texts is from this source. A significant portion of the English vocabulary comes from Romance and Latinate sources. Estimates of native words (derived from Old English) range from 20%\u201333%, with the rest made up of outside borrowings.", "prediction 4": "The core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s. As a statistical rule, around 70 percent of words in any text are Anglo-Saxon. Moreover, the grammar is largely Anglo-Saxon. A significant portion of the English vocabulary comes from Romance and Latinate sources.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 177, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 301 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 382, "end": 390 }, { "error type": "Unverifiable", "explanation": "", "start": 304, "end": 315 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The core of English language descends from Old English, the language brought with the Angles, Saxon, and Jutish settlers to what was to be called England in and after the 500s. A portion of the English vocabulary comes from Romance and Latinate languages, particularly Anglo-Norman and French. Estimates of native words (derived from Old English) range from 20%\u201333%, with the rest made up of outside borrowings." }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who sang the song tequila makes her clothes fall off?", "passages": [ [ "Tequila Makes Her Clothes Fall Off", "Tequila Makes Her Clothes Fall Off\n\n\"Tequila Makes Her Clothes Fall Off\" is a song written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols.", "It was released in August 2005 as the first single from Nichols' album \"III\".", "The song became Nichols' second number one hit on the U.S. \"Billboard\" Hot Country Songs chart in late 2005.", "One of the song's co-writers, John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "The song's narrator discusses how his grandmother carelessly misplaces her clothes when she drinks tequila.", "Kevin John Coyne of Country Universe gave the song a negative rating, saying that it was \"mind-numbingly inane.\"", "In his review of the album, Stephen Thomas Erlewine of Allmusic discussed the song favorably, saying that while it has a \"silly name and would seem like a throwaway novelty, it is genuinely funny\".", "He also said that Nichols \"delivers it with sly humor and a low-key swagger that shows more character, as a vocalist, than he did on his previous albums.\"", "The song debuted at number 59 on the U.S. \"Billboard\" Hot Country Songs chart on the week ending August 6, 2005." ] ], "gold": "Tequila Makes Her Clothes Fall Off is a song written by Gary Hannan and John Wiggins, and recorded by American country music artist Joe Nichols. Although it was released in August 2005 as the first single from Nichols' album \"III\", it was first performed by John Wiggins and his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "prediction 1": "\"Tequila Makes Her Clothes Fall Off\" is a song written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols. One of the song's co-writers, John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "prediction 2": "\"Tequila Makes Her Clothes Fall Off\" is a song written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols. The song was released in August 2005 as the first single from Nichols' album III. One of the song's co-writers, John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "prediction 3": "Joe Nichols sang the song \"Tequila Makes Her Clothes Fall Off\". It was written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols. One of the song's co-writers, John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "prediction 4": "The song Tequila Makes Her Clothes Fall Off was written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols. John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "\"Tequila Makes Her Clothes Fall Off\" is a song written by Gary Hannan and John Wiggins and recorded by American country music artist Joe Nichols. It was released in August 2005 as the first single from Nichols' album \"III\". One of the song's co-writers, John Wiggins performed with his sister Audrey in the mid-1990s as the country duo John & Audrey Wiggins." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Where to get a gun carry permit in tn?", "passages": [ [ "Gun laws in Tennessee", "Such permits are issued through the Department of Safety to qualified residents 21 years or 18 years old if the applicant is active duty, reservist, guardsman, or honorably discharged from their branch of service, DD-214 must mention 'pistol qualification' in order to be exempt from 8 hour safety course must have a valid military ID.", "The length of the term for the initial license is determined by the age of the applicant.", "If renewed properly and on time, the license is renewed every 8 years.", "Tennessee recognizes any valid, out-of-state permit for carrying a handgun as long as the permittee is not a resident of Tennessee.", "Nonresidents are not issued permits unless they are regularly\nemployed in the state.", "Such persons are then required to obtain Tennessee permits even if they have home state permits unless their home state has entered into a reciprocity agreement with Tennessee.", "Permittees may carry handguns in most areas except civic centers,\npublic recreation buildings and colleges.", "Businesses or landowners posting \"no carry\" signs may prohibit gun carry on any portion of their\nproperties.", "Tennessee requires a permit to carry a firearm, whether openly or concealed.", "Additionally, per Tenn. Code Ann." ], [ "Tennessee Department of Safety and Homeland Security", "The Office of Homeland Security was created in April 2003 by an executive order by then-Governor Phil Bredesen in the aftermath of September 11, 2001.", "The Driver License Services division issues various kinds of identification cards, including hardship licenses for minors, graduated drivers licenses, regular driver licenses, commercial driver licenses, and state identification cards.", "In addition to the above functions, the DOS has issued handgun permits through the THP since October 1996, assuming the role previously taken by local sheriffs' offices." ] ], "gold": "The permits to carry a loaded gun in Tennessee are issued by the Tennessee Department of Safety and Homeland Security. The length of the term for the initial license is determined by the age of the applicant. The Department of Safety has issued handgun permits through the Tennessee Highway Patrol since October 1996, assuming the role previously taken by local sheriffs' offices.", "prediction 1": "The State of Tennessee requires a permit to carry a firearm, whether openly or concealed. Such permits are issued through the Department of Safety to qualified residents 21 years or 18 years old if the applicant is active duty, reservist, guardsman, or honorably discharged from their branch of service, DD-214 must mention 'pistol qualification' in order to be exempt from 8 hour safety course must have a valid military ID. Nonresidents are not issued permits unless they are regularly employed in the state.", "prediction 2": "Permittees may carry handguns in most areas except civic centers, public recreation buildings and colleges. Businesses or landowners posting \"no carry\" signs may prohibit gun carry on any portion of their properties. Per Tennessee law, a permit to carry a firearm, whether openly or concealed, must be obtained from the Department of Safety. The THP issues handgun permits, which can be obtained through the Department of Safety.", "prediction 3": "There is no state-required permit to carry a firearm in Tennessee. Permittees may carry handguns in most areas except civic centers, public recreation buildings and colleges. Businesses or landowners posting \"no carry\" signs may prohibit gun carry on any portion of their properties.", "prediction 4": "The Tennessee Department of Safety issues permit to carry a handgun, openly or concealed. If you are not a resident of Tennessee, you can get a permit through the Tennessee Highway Patrol (THP).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 510 }, { "error type": "Irrelevant", "explanation": "", "start": 147, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 89 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Permits are issued through the Department of Safety. The length of the term for the initial license is determined by the age of the applicant. DOS has issued handgun permits through the THP since October 1996, assuming the role previously taken by local sheriffs' offices." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What is the holy book of jewish called?", "passages": [ [ "Hebrew Bible", "Hebrew Bible\n\nThe Hebrew Bible, also called the Tanakh (; , or ; also \"Tenakh\", \"Tenak\", \"Tanach\") or Mikra, is the canonical collection of Jewish texts, which is also the textual source for the Christian Old Testament.", "These texts are composed mainly in Biblical Hebrew, with some passages in Biblical Aramaic (in the books of Daniel, Ezra and a few others).", "The form of this text that is authoritative for Rabbinic Judaism is known as the Masoretic Text (MT), and is divided into 24 books, while the Protestant Bible translations divide the same material into 39 books.", "Modern scholars seeking to understand the history of the Hebrew Bible use a range of sources, in addition to the Masoretic Text.", "These sources include early Greek (Septuagint) and Syriac (Peshitta) translations, the Samaritan Pentateuch, the Dead Sea Scrolls and quotations from rabbinic manuscripts.", "Many of these sources may be older than the Masoretic Text and often differ from it.", "These differences have given rise to the theory that yet another text, an Urtext of the Hebrew Bible, once existed and is the source of the versions extant today." ], [ "Torah", "Torah\n\nTorah (; , \"Instruction\", \"Teaching\" or \"Law\") has a range of meanings.", "It can most specifically mean the first five books (\"Pentateuch\") of the 24 books of the Tanakh, and is usually printed with the rabbinic commentaries (').", "It can mean the continued narrative from the Book of Genesis to the end of the Tanakh (Malachi), and it can even mean the totality of Jewish teaching, culture and practice, whether derived from biblical texts or later rabbinic writings.", "Common to all these meanings, Torah consists of the origin of Jewish peoplehood: their call into being by God, their trials and tribulations, and their covenant with their God, which involves following a way of life embodied in a set of moral and religious obligations and civil laws (').", "In rabbinic literature the word \"Torah\" denotes both the five books ( \"Torah that is written\") and the Oral Torah (, \"Torah that is spoken\").", "The Oral Torah consists of interpretations and amplifications which according to rabbinic tradition have been handed down from generation to generation and are now embodied in the Talmud and Midrash." ] ], "gold": "The basis of Jewish law and tradition is attributed to the Torah, one of the 24 books of the Hebrew Bible, the canonical collection of Hebrew scriptures. The Hebrew Bible, also called Tanakh or Mikra, is the textual source for the Christian Old Testament. ", "prediction 1": "The Holy Book of Jews is titled the Tanakh. The Hebrew Bible is also known as the Torah, also called the Tenakh, and also referred to as the Tanak or Tana.", "prediction 2": "The Hebrew Bible, also referred to as the Tanakh or Mikra, is the canonical collection of Jewish texts, which is also the textual source for the Christian Old Testament. The form of this text that is authoritative for Rabbinic Judaism is known as the Masoretic Text (MT). The Torah is the holy book of Jewish peoplehood and includes the five books known as the Pentateuch, the Pentateuch that is written, and the Oral Torah that is spoken.", "prediction 3": "The Hebrew Bible, also called the Tanakh or Mikra, is the canonical collection of Jewish texts that is also the textual source for the Christian Old Testament. The form of this text that is authoritative for Rabbinic Judaism is known as the Masoretic Text (MT), and is divided into 24 books, while the Protestant Bible translations divide the same material into 39 books. The word \"Torah\" denotes both the five books ( \"Torah that is written\") and the Oral Torah that is spoken.", "prediction 4": "The Hebrew Bible is the canonical collection of Jewish texts, which is also the textual source for the Christian Old Testament. The form of this text that is authoritative for Rabbinic Judaism is known as the Masoretic Text, and is divided into 24 books, while the Protestant Bible translations divide the same material into 39 books. The Torah denotes both the five books (Torah that is written) and the Oral Torah (Torah that is spoken).", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The Holy Book of Jews is titled the Tanakh. ", "start": 89, "end": 112 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 0, "end": 43 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 44, "end": 88 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Holy Book of Jews, the basis of Jewish law and tradition, is attributed to the Torah, the first five of the 24 books is the the Tanakh. The Hebrew Bible, also called the Tanakh or Mikra is the canonical collection of Jewish texts, which is also the textual source for the Christian Old Testament." }, "preference": [ 2, 2, 2, 2, 2, 0 ] }, { "question": "Where was the newhart show filmed in vermont?", "passages": [ [ "Newhart", "Newhart\n\nNewhart is an American sitcom that aired on CBS from October 25, 1982 to May 21, 1990 with a total of 184 half-hour episodes spanning over eight seasons.", "The series stars Bob Newhart and Mary Frann as an author and his wife who own and operate an inn in a small, rural Vermont town that is home to many eccentric characters.", "\"TV Guide\", TV Land, and A&E named the \"Newhart\" series finale as one of the most memorable in television history.", "\"Newhart\" was recorded on videotape for Season 1, with the remaining seasons shot on film.", "The theme music for \"Newhart\" was composed by Henry Mancini.", "Bob Newhart plays Dick Loudon, an author of do-it-yourself and travel books.", "He and his wife Joanna move from New York City to a small town in rural Vermont to operate the 200-year-old Stratford Inn.", "(Although the town's name was never specified in the show, some media sources identified it as Norwich.)", "Dick is a sane, mild-mannered everyman surrounded by a community of oddballs in a town that exists in an illogical world governed by rules that elude him.", "Near the end of the second season, Dick began hosting a low-rated talk show on the town's local television station." ], [ "Waybury Inn", "Waybury Inn\n\nThe Waybury Inn is an inn at 457 East Main Street in Middlebury, Vermont, United States.", "The inn was built in 1810, and is one of the oldest operating traveler's accommodations in the state.", "It was listed on the National Register of Historic Places in 1983.", "It is well known for its use in exterior shots of the \"Newhart\" television series.", "The Waybury Inn is located on the north side of East Main Street (Vermont Route 125), near the eastern end of East Middlebury village.", "It is set near the westernmost end of one of the major routes across the Green Mountains in central Vermont.", "It consists of a 2-1/2 story gable-roofed main block, from which a two-story block extends to the rear.", "A single-story porch, covered by a hip roof, extends across the front and around to one side.", "The interior is arranged in a central hall plan, with large rooms, extending the full depth of the main block, on either side of the main staircase.", "The inn was built in 1810 by John Foot (or Foote).", "The pass to the east had opened as a toll road (turnpike) in 1808, and Foot sought to capitalize on the traffic it would bring." ] ], "gold": "Newhart, an American sitcom television series that aired from 1982 to 1990, was filmed in Vermont. Outside shots of the show's house are the Waybury Inn, in East Middlebury, one of the oldest operating traveler's accommodations in the state.", "prediction 1": "The Newhart show was filmed in Middlebury, Vermont, where the waybury inn is located, and the town of Middlebury where the show was filmed.", "prediction 2": "The Newhart show, an American sitcom that aired on CBS from October 25, 1982 to May 21, 1990, had eight seasons and was filmed in Vermont. The series was originally recorded on videotape for Season 1 and the remaining seasons were filmed on film. The Waybury Inn, an inn at 457 East Main Street in Middlebury, Vermont, is well known for its use in exterior shots of the Newhart show.", "prediction 3": "The Newhart show is an American sitcom that aired on CBS from October 25, 1982 to May 21, 1990 with a total of 184 half-hour episodes spanning over eight seasons. The series stars Bob Newhart and Mary Frann as an author and his wife who own and operate an inn in a small, rural Vermont town that is home to many eccentric characters. The show was recorded on videotape for Season 1, with the remaining seasons shot on film. The Waybury Inn is an inn at 457 East Main Street in Middlebury, Vermont.", "prediction 4": "The Newhart show was filmed in a small town in rural Vermont. The show aired on CBS from October 25, 1982 to May 21, 1990. The show was filmed at the Waybury Inn, an inn on the east side of East Main Street in Middlebury, Vermont.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Newhart, an American sitcom television series that aired from 1982 to 1990, was filmed in Vermont. Outside shots of the show's house are the Waybury Inn, in East Middlebury, one of the oldest operating traveler's accommodations in the state." }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "When did the first scion frs come out?", "passages": [ [ "Toyota 86", "At the same show, Subaru unveiled a transparent silhouette of the car showing the new D-4S boxer engine and displayed the \"Boxer Sports Car Architecture\".", "Scion followed in April 2011 at the New York Motor Show with the FR-S Sports Coup\u00e9 Concept, co-developed with aftermarket tuner Five Axis.", "Another semi-transparent Subaru concept, known as the BRZ Prologue, was shown at the Frankfurt Motor Show that September, followed in November at the Los Angeles Motor Show by the BRZ Concept STi, the first full mock-up of Subaru's version of the 86 with input from Subaru Tecnica International (STI).", "The production Toyota 86 debuted at the 2011 Tokyo Motor Show.", "All variants are built at Subaru's Gunma Main Plant, with the first cars assembled on 2 February before sales began in March and deliveries in April.", "7,000 orders were placed for the Toyota 86 in the first month of production, while Subaru took in 3,500 orders.", "In the United States, Scion were allocated 10,000 units of the 2013 model year (MY13) production, while Subaru was limited to only 6,000 units." ], [ "Toyota 86", "Toyota 86\n\nThe Toyota 86 is a 2+2 sports car jointly developed by Toyota and Subaru, manufactured at Subaru's Gunma assembly plant \u2014 along with a badge engineered variant, marketed as the Subaru BRZ.", "The 2+2 fastback coup\u00e9 is noted for its naturally-aspirated boxer engine, front-engined, rear-wheel-drive configuration, 50/50 front/rear weight balance and low center of gravity \u2014 and for drawing inspiration from Toyota's earlier AE86, a small, light, front-engine/rear-drive Corolla variant widely popular for Showroom Stock, Group A, and Group N, Rally, Club and drift racing.", "Toyota markets the sports car as the 86 in Asia, Australia, North America (from August 2016), South Africa, and South America; as the Toyota GT86 in Europe; as the 86 and GT86 in New Zealand; as the Toyota FT86 in Nicaragua and Jamaica and as the Scion FR-S (2012-2016) in the United States and Canada." ], [ "Hyundai Eon", "Hyundai Eon\n\nThe Hyundai Eon, or Hyundai Atos Eon, is a city car produced by the South Korean manufacturer Hyundai.", "It was launched on 13 October 2011 in India, March 2012 in the Philippines, June 2012 in Vietnam, and June 2014 in Sri Lanka.", "It is also sold in El Salvador, Nicaragua, Chile, Panama, and Colombia.", "The Eon is not officially sold in its home market, South Korea.", "The Eon is produced in India at Hyundai's Chennai plant for the domestic and export markets as the company's entry level city car (positioned below the Hyundai i10 and Hyundai Atos).", "The Eon was designed jointly between the Hyundai R&D centers in Namyang, South Korea, and Hyderabad, India.", "It is offered with an 814cc three-cylinder petrol engine that generates and torque.", "According to Hyundai's Philippine distributor, the Eon has a fuel economy rating of .", "The car is equipped with 13-inch wheels fitted with 155/70R13 tyres.", "In January 2012, Hyundai India announced LPG models of Eon as well.", "These models have a 34L toroidal tank with an additional cost of approximately INR 27000 to the available models." ] ], "gold": "In Asia, the production of the Scion FR-S, marketed as the Toyota 86, debuted at the December 2011 Tokyo Motor Show with sales beginning in March 2012. In the United States, the first Scion FR-S Sports Coupe Concept was unveiled in April 2011 at the New York International Auto Show with the first Scion FR-S being sold in the United States in June 2013. In Australia, the first Scion F-RS came out under the Toyota GT86 name in June 2012. ", "prediction 1": "The Scion FR-S Sports Coup\u00e9 Concept was unveiled in April 2011 at the New York Motor Show. The production Scion FR-S debuted at the 2011 Tokyo Motor Show. The sports car is a 2+2 fastback coup\u00e9 produced by Japanese automaker Toyota and Subaru that is noted for its naturally-aspirated boxer engine, front-engined, rear-wheel-drive configuration, 50/50 front/rear weight balance and low center of gravity.", "prediction 2": "The first scion frs came out in April 2011 at the New York Motor Show. The first production FR-S came out in April 2012 in New York, April 2012 in New York, and April 2016 in the United States and Canada. The Toyota 86 is a 2+2 sports car jointly developed by Toyota and Subaru, manufactured at Subaru's Gunma assembly plant. The car is noted for its naturally-aspirated boxer engine, front-engined, rear-wheel-drive configuration, 50/50 front/rear weight balance and low center of gravity.", "prediction 3": "The first Scion FR-S sports coupe concept came out in April 2011 at the New York Motor Show, where it was co-developed with aftermarket tuner Five Axis. The production Toyota 86 sports car debuted at the 2011 Tokyo Motor Show. The Hyundai Atos Eon, or Hyundai Atos Eon, is a city car produced by the South Korean manufacturer Hyundai. It was launched on 13 October 2011 in India and was launched in March 2012 in the Philippines, June 2012 in Vietnam, and June 2014 in Sri Lanka. The production Scion FR-S was introduced in the United States and Canada in 2016.", "prediction 4": "The first Scion FR-S sports coupe came out on April 11, 2011, at the New York Motor Show. The production Toyota 86 sports car debuted at the 2011 Tokyo Motor Show. Scion followed in April 2011 at the New York Motor Show with the FR-S Sports Coup\u00e9 Concept, co-developed with aftermarket tuner Five Axis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 404 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Scion FR-S Sports Coup\u00e9 Concept was unveiled in April 2011 at the New York Motor Show. The production Scion FR-S, marketed as the Toyota 86, debuted at the 2011 Tokyo Motor Show. Sales began in March with deliveries in April." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How many congressional districts are there in michigan?", "passages": [ [ "Pete Hoekstra", "This nomination was confirmed by the U.S. Senate on November 9, 2017, and Hoekstra was sworn in as U.S. Ambassador on December 11, 2017.", "He took office on January 10, 2018.", "Hoekstra was born Piet Cornelis Hoekstra in Groningen, Netherlands.", "He moved to the U.S. with his parents at the age of three.", "He received a Bachelor of Arts in political science from Hope College in 1975 and an MBA from the University of Michigan's Ross School of Business in 1977.", "He then joined office furniture maker Herman Miller and remained there for 15 years, eventually becoming vice president of marketing.", "In 1992, Hoekstra made his first bid for public office in the 2nd District.", "The district, previously the 9th, had been represented for 26 years by Guy Vander Jagt, longtime chairman of the National Republican Congressional Committee.", "Hoekstra rode his bicycle across the district, charging that Vander Jagt had served in Congress for too long.", "He scored a monumental upset, winning by almost six percent.", "This primary win was tantamount to election with the 2nd district seen as the \"most Republican\" district in Michigan, as Republicans have held the district for all but four years since it was created in 1873." ], [ "2018 United States House of Representatives elections in Michigan", "2018 United States House of Representatives elections in Michigan\n\nThe 2018 United States House of Representatives elections in Michigan was held on November 6, 2018, to elect the 14 U.S. Representatives from the state of Michigan, one from each of the state's 14 congressional districts.", "The elections coincided with the gubernatorial election, as well as other elections to the House of Representatives, elections to the United States Senate in 33 other states and various state and local elections.", "The filing deadline for candidates filing for the August 7 primary was April 24, 2018.", "Unless otherwise indicated, the Cook Political Report has rated the congressional races as safe for the party of the incumbent.", "Two seats shifted from Republican to Democratic control.", "In the 8th Congressional District, Elissa Slotkin defeated incumbent Mike Bishop and in an open seat for the 11th Congressional District, Haley Stevens defeated Lena Epstein.", "This leaves Michigan's U.S. House delegation in the 116th United States Congress with seven Democrats and seven Republicans.", "Results of the 2018 United States House of Representatives elections in Michigan by district:\n\nThe 1st district consists of the entire Upper Peninsula of Michigan and the northern part of the Lower Peninsula including Alpena, Marquette, and Traverse City.", "This district has a PVI of R+9." ], [ "Michigan's congressional districts", "Michigan's congressional districts\n\nMichigan is divided into 14 congressional districts, each represented by a member of the United States House of Representatives.", "The districts are currently represented in the 115th United States Congress by 5 Democrats and 9 Republicans.", "List of members of the Michigan United States House delegation, their time in office, district maps, and the districts' political ratings according to the CPVI.", "The delegation has a total of 14 members, although one of those seats is vacant.", "Of the remaining members, there are 9 Republicans and 4 Democrats.", "\"Time in office\" reflects each member's time since becoming a U.S. Representative, not the member's time since becoming a representative for his current district; redistricting commonly results in a district being moved elsewhere in the state and its representative beginning to represent a different district in the same location.", "Below is a table of United States congressional district boundary maps for the State of Michigan, presented chronologically forward.", "All redistricting events that took place in Michigan in the decades between 1973 and 2013 are shown." ] ], "gold": "Throughout its history, and due to considerable demographic and population changes within the state, Michigan's congressional districts have changed in both geographic area and number. For instance, in the years 1993-2002 there were a total of 16 congressional districts in the state, a number that was lowered to 15 in 2003-2013 and later to 14 since 2013.", "prediction 1": "Michigan is divided into 14 congressional districts, each represented by a member of the United States House of Representatives. The districts are currently represented in the 115th United States Congress by 5 Democrats and 9 Republicans. Michigan's congressional districts are shown below.\n", "prediction 2": "Michigan is divided into 14 congressional districts, each represented by a member of the United States House of Representatives and currently has 12 Democrats and 5 Republicans in the House of Representatives. The list below describes Michigan's congressional districts, along with a brief description of the process of redistricting, redistricting, and legislative committees for each of them.", "prediction 3": "Michigan is divided into 14 congressional districts, each represented by a member of the United States House of Representatives. The districts are currently represented in the 115th United States Congress by 5 Democrats and 9 Republicans. Results of the 2018 United States House of Representatives elections in Michigan was held on November 6, 2018, to elect the 14 U.S. Representatives from the state of Michigan, one from each of the state's 14 congressional districts. Democrats hold 13 of Michigan's 14 congressional districts, while Republicans hold 8 of them.", "prediction 4": "There are 14 congressional districts in Michigan. Each one is represented by a United States Representative. In 2018, Michigan held the 2018 United States House of Representatives elections in Michigan, to elect the 14 U.S. Representatives from the state of Michigan, one from each of the state's congressional districts.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 53, "end": 128 }, { "error type": "Irrelevant", "explanation": "", "start": 129, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 291 } ], "missing-info": [], "corrected-prediction": "Michigan is divided into 14 congressional districts.\n" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Where does it say in the bible do unto others as you would have them do unto you?", "passages": [ [ "Matthew 7:12", "Matthew 7:12\n\nMatthew 7:12 is the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount.", "This well known verse presents what has become known as the Golden Rule.", "In the King James Version of the Bible the text reads:\n\nThe World English Bible translates the passage as:\n\nFor a collection of other versions see BibleGateway Matthew 7:12\n\n", "This verse is considered to be a summation of the entire sermon.", "Some editions append it to the end of -, and the rule does seem to be an expansion on the teaching about prayer in that section.", "However, the word therefore and the mention of the law and the prophets implies that this is a more far reaching teaching.", "Davies and Allison note that this is indicated by the mention of the law and the prophets, which links the verse back to Matthew 5:17, the start of the teaching on ethics.", "The verse is most closely linked with the teaching to \"love thy enemies\" in .", "In the Rule is present just after the teaching about enemies, making the link even more explicit.", "Luz notes that as well as summarizing the sermon, this rule also adapts it to normal life.", "While verses like seem incompatible with reality, the teachings in this verse can reasonably be attempted by all." ], [ "Golden Rule", "The \"Golden Rule\" was given by Jesus of Nazareth (Matthew 7:12 NCV, see also ).", "The common English phrasing is \"Do unto others as you would have them do unto you\".", "A similar form of the phrase appeared in a Catholic catechism around 1567 (certainly in the reprint of 1583).", "The Golden Rule is stated positively numerous times in the Old Testament: (\"Thou shalt not avenge, nor bear any grudge against the children of thy people, but thou shalt love thy neighbour as thyself: I am the LORD.", "\"; see also Great Commandment) and (\"But treat them just as you treat your own citizens.", "Love foreigners as you love yourselves, because you were foreigners one time in Egypt.", "I am the Lord your God.\").", "The Old Testament Deuterocanonical books of Tobit and Sirach, accepted as part of the Scriptural canon by Catholic Church, Eastern Orthodoxy, and the Non-Chalcedonian Churches, express a negative form of the golden rule:\n\nTwo passages in the New Testament quote Jesus of Nazareth espousing the positive form of the Golden rule:\n\nA similar passage, a parallel to the Great Commandment, is \n\nThe passage in the book of Luke then continues with Jesus answering the question, \"Who is my neighbor?" ], [ "Golden Rule", "Golden Rule\n\nThe Golden Rule is the principle of treating others as one's self would wish to be treated.", "It is a maxim that is found in many religions and cultures.", "The Golden Rule can be considered an ethic of reciprocity in some religions, although other religions treat it differently.", "The maxim may appear as either a positive or negative injunction governing conduct:\n\n\nThe idea dates at least to the early Confucian times (551\u2013479 BC) according to Rushworth Kidder, who identifies that this concept appears prominently in Buddhism, Christianity, Hinduism, Judaism, Taoism, Zoroastrianism, and \"the rest of the world's major religions\".", "The concept of the Rule is codified in the Code of Hammurabi stele and tablets, 1754-1790 BC.", "143 leaders encompassing the world's major faiths endorsed the Golden Rule as part of the 1993 \"Declaration Toward a Global Ethic\", including the Baha'i Faith, Brahmanism, Brahma Kumaris, Buddhism, Christianity, Hinduism, Indigenous, Interfaith, Islam, Jainism, Judaism, Native American, Neo-Pagan, Sikhism, Taoism, Theosophist, Unitarian Universalist and Zoroastrian." ] ], "gold": "The Golden Rule is the principle of treating others as one wants to be treated. Two passages in the New Testament quote Jesus of Nazareth espousing this maxim. While Matthew 7:12 is the best-known verse for saying do unto others as you would have them do unto you, this is also said in Luke 6:31.", "prediction 1": "The Golden Rule is the principle of treating others as one's self would wish to be treated. It is a maxim that is found in many religions and cultures. The Golden Rule is stated positively numerous times in the Old Testament: (\"Thou shalt not avenge, nor bear any grudge against the children of thy people, but thou shalt love thy neighbour as thyself: I am the LORD. \"; see also Great Commandment). The Common English phrasing is found in Matthew 7:12.", "prediction 2": "The Golden Rule is the principle of treating others as one's self would wish to be treated. It is found in many religions and cultures and can be considered an ethic of reciprocity in some religions. Matthew 7:12 is the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament, and is part of the Sermon on the Mount. Matthew 7:12 is also the title of a passage in the Bible that is part of the New Testament.", "prediction 3": "The Golden Rule is the principle of treating others as one's self would wish to be treated. It is a maxim that is found in many religions and cultures. The common English phrasing is \"Do unto others as you would have them do unto you\". It appears in Matthew 7:12 in the King James Version of the Bible.", "prediction 4": "The common English phrasing is \"Do unto others as you would have them do unto you\". Matthew 7:12 is the twelfth verse of the seventh chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 92, "end": 151 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Golden Rule is the principle of treating others as one's self would wish to be treated. The Golden Rule is stated positively numerous times in the Old Testament. The Old Testament Deuterocanonical books of Tobit and Sirach express a negative form of the golden rule. Two passages in the New Testament quote Jesus of Nazareth espousing the positive form of The Golden Rule. The Common English phrasing, \"Do unto others as you would have them do unto you\", is found in Matthew 7:12 and there is a similar passage in the Book of Luke." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Where was three billboards outside ebbing missouri film?", "passages": [ [ "Three Billboards Outside Ebbing, Missouri", "McDormand initially felt that she was older than the character as it was written, and suggested that Mildred instead be Angela's grandmother; McDonagh disagreed, feeling that it would change the story too much.", "McDormand's husband Joel Coen persuaded her to take the part regardless.", "McDormand took inspiration for her character from John Wayne; and Rockwell, wanting to make his character \"the exact opposite\" of Mildred, took inspiration for his character in part from Wayne's co-star in \"The Man Who Shot Liberty Valance\", Lee Marvin.", "Principal photography began on May 2, 2016, in Sylva, North Carolina, and ran for 33 days.", "Allison Outdoor Advertising of Sylva built the actual billboards, which were put in a pasture near Black Mountain, North Carolina because that location was better.", "Most of the time the billboards were covered because people in the area found them upsetting.", "David Penix of Arden, North Carolina bought the billboards and used the wood for a roof in Douglas Lake in Tennessee, though the messages are no longer in order.", "Town Pump Tavern in Black Mountain, which had appeared in \"The World Made Straight\", was used as a set and was closed for three days during filming.", "A pool table and booths were added.", "The bar's actual sign appeared in the film." ] ], "gold": "Principal filming for Three Billboards Outside Ebbing, Missouri was in Sylva, North Carolina. The actual billboards for the film were put in a pasture near Black Mountain, North Carolina, and the billboard scenes were filmed there because that location was better.", "prediction 1": "Three Billboards Outside Ebbing, Missouri was shot at several locations. It was filmed in Sylva, North Carolina. The actual billboards were put in a pasture near Black Mountain, North Carolina because that location was better. Town Pump Tavern in Black Mountain, which had appeared in The World Made Straight, was used as a set and was closed for three days during filming.", "prediction 2": "Three Billboards Outside Ebbing Missouri was filmed in Sylva, North Carolina, USA. The actual billboards were put in a pasture near Black Mountain, North Carolina because that location was better. Town Pump Tavern in Black Mountain, which had appeared in \"The World Made Straight\", was used as a set and was closed for three days during filming.", "prediction 3": "Three Billboards Outside Ebbing, Missouri was filmed in Sylva, North Carolina. The actual billboards were put in a pasture near Black Mountain, North Carolina because that location was better. Town Pump Tavern in Black Mountain, which had appeared in \"The World Made Straight\", was used as a set and was closed for three days during filming.", "prediction 4": "Principal photography for Three Billboards Outside Ebbing, Missouri began on May 2, 2016, in Sylva, North Carolina, and ran for 33 days. Allison Outdoor Advertising of Sylva built the actual billboards, which were put in a pasture near Black Mountain, North Carolina because that location was better. Town Pump Tavern in Black Mountain, which had appeared in \"The World Made Straight\", was used as a set and was closed for three days during filming.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 373 } ], "missing-info": [], "corrected-prediction": "Principal filming for Three Billboards Outside Ebbing, Missouri was shot at several locations. It was filmed in Sylva, North Carolina. The actual billboards were put in a pasture near Black Mountain, North Carolina because that location was better. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who did voice of baloo in jungle book?", "passages": [ [ "Baloo", "In a later tussle against soldiers working for Captain William Boone, the main villain, Baloo is shot and left for dead, but Mowgli finds him and locates Dr. Julius Plumford to save his life.", "In the final scene, after Boone's defeat, Dr. Plumford is shown to have successfully saved Baloo, and is seen standing with Baloo beside a waterfall.", "In the 1996 Disney animated TV series \"Jungle Cubs\", Baloo (voiced by Pamela Adlon) is a kind-hearted and genial cub.", "He likes to play with his friends (including his best friend Louie) and sometimes plays tricks on Bagheera in order to snap the latter out of his serious attitude.", "Disney's 2013 stage adaptation of \"The Jungle Book\", directed by Mary Zimmerman, features Kevin Carolan as Baloo.", "In the 2016 Disney live-action film version of \"The Jungle Book\", Baloo is voiced by Bill Murray.", "Baloo first appears when Kaa is about to devour Mowgli, and rescues him from the python before she can eat him.", "Baloo then takes Mowgli back to his cave and tells him to help him gather honey in exchange for saving his life.", "Eventually, Baloo and Mowgli form a strong attachment with Mowgli deciding that he wants to stay with Baloo until the winter season arrives." ], [ "Baloo", "Baloo is initially opposed to bringing Mowgli to the Man Village, wanting to raise him as a son.", "However, when Bagheera explains that Mowgli is easy prey for Shere Khan the tiger and that he's not safe in the jungle, even with Baloo's diligent protection, Baloo realizes he has a point and agrees to tell Mowgli the difficult truth.", "Mowgli turns on Baloo and runs away, prompting him and Bagheera to split up and search for the boy.", "Baloo isn't seen again until the climax of the film, when he sees Mowgli preparing to battle Shere Khan.", "Baloo attempts to stop the tiger, but almost gets killed in the process.", "After Mowgli follows a girl named Shanti into the village and decides to stay there, Baloo is slightly disappointed, but is ultimately relieved that Mowgli is safe at last.", "He and Bagheera then return to the jungle as they sing a reprise of \"The Bare Necessities\" together.", "Baloo returns in the 2003 animated sequel \"The Jungle Book 2\" in which he is voiced by John Goodman." ], [ "Baloo", "He is eager to reunite with Mowgli, in spite of Bagheera's exasperation and the return of a vindictive Shere Khan, humiliated by his previous defeat at Mowgli's hands.", "He sneaks into the Man Village at night after eluding Bagheera and Colonel Hathi's herd to visit Mowgli and takes him off into the jungle after being caught by Shanti, who felt bad for getting Mowgli in trouble, and unknowingly saves him from Shere Khan, who also came to the village.", "This leads Shanti, Ranjan, and some of the other villagers to go into the jungle to search for him.", "Mowgli tells Baloo all about the negative aspects of the village while hiding the positive feelings he also has about the place.", "When Baloo makes fun of Mowgli's life in the village and scares Shanti like Mowgli asked him to, he unintentionally hurts Mowgli's feelings and annoys him.", "Baloo and Shanti continue to hate each other until they both say they're trying to save Mowgli from Shere Khan (who ambushed Mowgli when he went after Shanti and Ranjan to apologize) during an argument.", "From then on, they acknowledge one another as friends." ] ], "gold": "Baloo, appearing in various productions, series, and games, has been voiced by multiple actors. Starting with Disney's productions, Baloo was voiced by Phil Harris in the 1967 animated film adaptation, by John Goodman in 2003\u2019s The Jungle Book 2, and by Bill Murray in the 2016 live-action film version. Disney's 2013 stage adaptation of The Jungle Book features Kevin Carolan as Baloo. In The Jungle Book Groove Party, a music rhythm video game published by Ubi Soft, Baloo is voiced by Steven Curtis Chapman.", "prediction 1": "In the 1996 Disney animated TV series Jungle Cubs, Baloo was voiced by Pamela Adlon. In the 2016 Disney live-action film version of The Jungle Book, Baloo is voiced by Bill Murray. In the 2003 animated sequel to The Jungle Book, Baloo is voiced by John Goodman.", "prediction 2": "Baloo is a character in the 1966 Disney animated film series Jungle Cubs and is voiced by Pamela Adlon when saving the young boy from a tiger called Shere Khan. In Disney's 2013 stage adaptation of The Jungle Book, directed by Mary Zimmerman, Baloo is voiced by Kevin Carolan. In the 2016 Disney live-action film version of The Jungle Book, Baloo is voiced by Bill Murray. In the 2003 animated sequel, The Jungle Book 2, Baloo is voiced by John Goodman. The Jungle Book 2 is voiced by John Goodman. In the 2016 film version of The Jungle Book, Baloo is voiced by Bill Murray. In the 2016 Disney live-action version of The Jungle Book, Baloo is voiced by Bill Murray. In the 2016 Disney live-action film, Baloo is voiced by Bill Murray.", "prediction 3": "In The Jungle Book, Baloo is voiced by Kevin Carolan, while in the 2016 Disney live-action film version of The Jungle Book, Baloo is voiced by Bill Murray. In the 1996 Disney animated TV series Jungle Cubs, Baloo is voiced by Pamela Adlon, while in the 2003 animated sequel to The Jungle Book 2 he is voiced by John Goodman. In the 2016 Disney animated film, Baloo is voiced by Bill Murray.", "prediction 4": "The character Baloo is voiced by Bill Murray in both The Jungle Book and The Jungle Book 2 and by John Goodman in The Jungle Book 3.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "In the 1996 Disney animated TV series Jungle Cubs, Baloo was voiced by Pamela Adlon. In the 2016 Disney live-action film version of The Jungle Book, Baloo is voiced by Bill Murray. Disney's 2013 stage adaptation of \"The Jungle Book\", features Kevin Carolan as Baloo. In the 2003 animated sequel to The Jungle Book, Baloo is voiced by John Goodman." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the hubble space telescope launched by space shuttle discovery?", "passages": [ [ "Hubble Space Telescope", "Furthermore, the ground software needed to control Hubble was not ready in 1986, and was barely ready by the 1990 launch.", "Eventually, following the resumption of shuttle flights in 1988, the launch of the telescope was scheduled for 1990.", "On April 24, 1990, successfully launched the telescope into its planned orbit during the STS-31 mission.", "From its original total cost estimate of about , the telescope cost about by the time of its launch.", "Hubble's cumulative costs were estimated to be about in 2010, twenty years after launch.", "Hubble accommodates five science instruments at a given time, plus the Fine Guidance Sensors, which are mainly used for aiming the telescope but are occasionally used for science (astrometry).", "Early instruments were replaced with more advanced ones during the Shuttle servicing missions.", "COSTAR was strictly a corrective optics device rather than a true science instrument, but occupied one of the five instrument bays.", "Since the final servicing mission in 2009, the four active instruments have been ACS, COS, STIS and WFC3.", "NICMOS is kept in hibernation, but may be revived if WFC3 were to fail in the future.", "Of the former instruments, three (COSTAR, FOS and WFPC2) are displayed in the Smithsonian National Air and Space Museum.", "The FOC is in the Dornier museum, Germany." ], [ "Hubble Space Telescope", "Hubble Space Telescope\n\nThe Hubble Space Telescope (HST) is a space telescope that was launched into low Earth orbit in 1990 and remains in operation.", "Although not the first space telescope, Hubble is one of the largest and most versatile and is well known as both a vital research tool and a public relations boon for astronomy.", "The HST is named after the astronomer Edwin Hubble and is one of NASA's Great Observatories, along with the Compton Gamma Ray Observatory, the Chandra X-ray Observatory and the Spitzer Space Telescope.", "With a mirror, Hubble's four main instruments observe in the near ultraviolet, visible, and near infrared spectra.", "Hubble's orbit outside the distortion of Earth's atmosphere allows it to take extremely high-resolution images, with substantially lower background light than ground-based telescopes.", "Hubble has recorded some of the most detailed visible light images ever, allowing a deep view into space and time.", "Many Hubble observations have led to breakthroughs in astrophysics, such as accurately determining the rate of expansion of the universe.", "The HST was built by the United States space agency NASA, with contributions from the European Space Agency.", "The Space Telescope Science Institute (STScI) selects Hubble's targets and processes the resulting data, while the Goddard Space Flight Center controls the spacecraft.", "Space telescopes were proposed as early as 1923." ] ], "gold": "The Hubble Space Telescope, often referred to as HST or Hubble, is a space telescope that was launched into low Earth orbit on April 24, 1990 at 12:33:51 UTC, and remains in operation. It was not the first space telescope, but it is one of the largest and most versatile, renowned both as a vital research tool and as a public relations boon for astronomy. On April 24, 1990, successfully launched it during the STS-31 mission.", "prediction 1": "The Hubble Space Telescope is a space telescope that was launched into low Earth orbit in 1990 and remains in operation. On April 24, 1990, successfully launched the telescope into its planned orbit during the STS-31 mission.\n", "prediction 2": "The Hubble Space Telescope is an orbiting miniscule astronomical observatory built by the United States and NASA that was launched into low Earth orbit by the Space Shuttle Discovery on April 24, 1990. Although not the first space telescope, Hubble is one of the largest and most versatile and is well known as both a vital research tool and a public relations boon for astronomy.", "prediction 3": "The Hubble Space Telescope is a space telescope that was launched into low Earth orbit in 1990 and remains in operation. It was launched on April 24, 1990 during the STS-31 mission of the Space Shuttle Discovery.", "prediction 4": "The Hubble Space Telescope is a space telescope that was launched into low Earth orbit in 1990 and remains in operation. It was launched on April 24, 1990, during the crewed STS-31 exploration mission and successfully launched on June 14, 1990.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Hubble Space Telescope is a space telescope that was launched into low Earth orbit in 1990 and remains in operation. Although it was not the first space telescope, Hubble is one of the largest and most versatile and is well known as both a vital research tool and a public relations boon for astronomy. On April 24, 1990, successfully launched the telescope into its planned orbit during the STS-31 mission.\n" }, "preference": [ 2, 1, 0, 1, 1, 0 ] }, { "question": "Who played the phantom of the opera in 1986?", "passages": [ [ "The Phantom of the Opera (1986 musical)", "The Phantom of the Opera (1986 musical)\n\nThe Phantom of the Opera is a musical with music by Andrew Lloyd Webber and lyrics by Charles Hart.", "Richard Stilgoe and Lloyd Webber wrote the musical's book together.", "Stilgoe also provided additional lyrics.", "Based on the eponymous French novel by Gaston Leroux, its central plot revolves around a beautiful soprano, Christine Daa\u00e9, who becomes the obsession of a mysterious, disfigured musical genius living in the subterranean labyrinth beneath the Paris Op\u00e9ra House.", "The musical opened in London's West End in 1986, and on Broadway in 1988.", "It won the 1986 Olivier Award and the 1988 Tony Award for Best Musical, and Michael Crawford (in the title role) won the Olivier and Tony Awards for Best Actor in a Musical.", "It is the longest running show in Broadway history by a wide margin, and celebrated its 10,000th Broadway performance on 11 February 2012, the first production ever to do so.", "It is the second longest-running West End musical, after \"Les Mis\u00e9rables\", and the third longest-running West End show overall, after \"The Mousetrap\".", "With total estimated worldwide gross receipts of over $5.6\u00a0billion and total Broadway gross of $845\u00a0million, \"Phantom\" was the most financially successful entertainment event until \"The Lion King\" surpassed it in 2014." ], [ "The Phantom of the Opera (1986 musical)", "The cast included Ramin Karimloo as the Phantom, Sierra Boggess as Christine, Hadley Fraser as Raoul, Wynne Evans as Piangi, Wendy Ferguson as Carlotta, Barry James as Monsieur Firmin, Gareth Snook as Monsieur Andre, Liz Robertson as Madame Giry, and Daisy Maywood as Meg Giry.", "Lloyd Webber and several original cast members, including Crawford and Brightman, were in attendance.", "A DVD and Blu-ray of the performance was released in February 2012, and it began airing in March 2012 on PBS's \"Great Performances\" television series.", "In March 2012, a new production directed by Laurence Connor began a UK and Ireland tour to commemorate the 25th anniversary of the show, beginning at the Theatre Royal Plymouth and travelled to Manchester, Bristol, Dublin, Leeds, Edinburgh, Milton Keynes, Cardiff, and Southampton.", "John Owen-Jones and Earl Carpenter alternated as the Phantom with Katie Hall and Olivia Brereton as Christine and Simon Bailey as Raoul.", "\"Phantom\" began Broadway previews at the Majestic Theatre on 9 January 1988 and opened on 26 January.", "Crawford, Brightman, and Barton reprised their respective roles from the West End.", "The production continues to play at the Majestic, where it became the first Broadway musical in history to surpass 10,000 performances on 11 February 2012." ], [ "The Phantom of the Opera (Andrew Lloyd Webber song)", "The Phantom of the Opera (Andrew Lloyd Webber song)\n\n\"The Phantom of the Opera\" is a song from the stage musical of the same name.", "It was composed by Andrew Lloyd Webber, with lyrics written by Charles Hart and Richard Stilgoe, and additional lyrics by Mike Batt.", "The song was originally recorded by Sarah Brightman and Steve Harley, which became a UK hit single in 1986, prior to the musical.", "In its theatrical debut, it was sung by Brightman and Michael Crawford in their roles as Christine Daa\u00e9 and the Phantom.", "The song is performed in Act I after the song \"Angel of Music\" (The Mirror) and before \"The Music of the Night\" (and is reprised in Act Two at the end of the song \"Notes/Twisted Every Way\").", "It takes place as the Phantom escorts Christine by boat to his lair beneath the Opera Garnier.", "It is sung as a duet by Christine and the Phantom.", "At the end of the song, Christine sings her highest note in the show, an E6.", "In different shows, Sarah Brightman sings this song in different duets with other performers, Antonio Banderas, Chris Thompson, Alessandro Safina, Mario Frangoulis, Colm Wilkinson, Anthony Warlow, John Owen-Jones, Peter J\u00f6back and Erkan Aki." ] ], "gold": "The Phantom of the Opera opened in London's West End in 1986 and on Broadway in 1988. Michael Patrick Smith, known professionally as Michael Crawford, starred as the phantom in the West End version and the Broadway version. Anthony Warlow played the phantom in the 1986 Australian version. Brent Barrett and Anthony Crivello played the phantom in the 1986 Las Vegas version.", "prediction 1": "The Phantom of the Opera is a musical with music by Andrew Lloyd Webber and lyrics by Charles Hart. Richard Stilgoe and Lloyd Webber wrote the musical's book together. Michael Crawford played the Phantom in the 1986 production. In the 1989 production, Michael Crawford played the Phantom.\n", "prediction 2": "The Phantom of the Opera is a musical with music by Andrew Lloyd Webber and lyrics by Charles Hart. Michael Crawford appeared as the Phantom in the 1986 production, which opened in London's West End in 1986 and on Broadway in 1988. In 1989, Frank Kuperman played the role of the Phantom for the first time, creating an 18-month theatrical hiatus in the show.", "prediction 3": "The Phantom of the Opera is a musical with music by Andrew Lloyd Webber and lyrics by Charles Hart and Richard Stilgoe. The cast included Ramin Karimloo as the Phantom, Sierra Boggess as Christine, Hadley Fraser as Raoul, Wendy Ferguson as Carlotta, Barry James as Monsieur Firmin, Gareth Snook as Monsieur Andre, Liz Robertson as Madame Giry, and Daisy Maywood as Meg Giry. Each of these actors played a part in several productions.", "prediction 4": "The musical The Phantom of the Opera premiered in London's West End on 23 August 1986, and on Broadway in 1988. Michael Crawford played the Phantom in the 1986 production.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 25, "end": 99 }, { "error type": "Irrelevant", "explanation": "", "start": 228, "end": 289 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Phantom of the Opera opened in London's West End in 1986 and on Broadway in 1988. Michael Crawford played the Phantom in the 1986 production.\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who was in charge of russia during the cold war?", "passages": [ [ "Cold War (1953\u20131962)", "Whilst a thorough rethinking of foreign policy was launched (known as \"Project Solarium\"), the majority of emerging ideas (such as a \"rollback of Communism\" and the liberation of Eastern Europe) were quickly regarded as unworkable.", "An underlying focus on the containment of Soviet communism remained to inform the broad approach of U.S. foreign policy.", "While the transition from the Truman to the Eisenhower presidencies was a mild transition in character (from conservative to moderate), the change in the Soviet Union was immense.", "With the death of Joseph Stalin (who led the Soviet Union from 1928 and through the Great Patriotic War) in 1953, Georgy Malenkov was named leader of the Soviet Union.", "This was short lived however, as Nikita Khrushchev soon undercut all of Malenkov's authority as leader and took control of the Soviet Union himself.", "Malenkov joined a failed coup against Khrushchev in 1957, after which he was sent to Kazakhstan.", "During a subsequent period of collective leadership, Khrushchev gradually consolidated his hold on power.", "At a speech to the closed session of the Twentieth Party Congress of the Communist Party of the Soviet Union, February 25, 1956, Nikita Khrushchev shocked his listeners by denouncing Stalin's personality cult and the many crimes that occurred under Stalin's leadership." ], [ "Communist Party of the Soviet Union", "Because the Central Committee met twice a year, most day-to-day duties and responsibilities were vested in the Politburo, (previously the Presidium), the Secretariat and the Orgburo (until 1952).", "The party leader was the head of government and held the office of either General Secretary, Premier or head of state, or some of the three offices concurrentlybut never all three at the same time.", "The party leader was the \"de facto\" chairman of the CPSU Politburo and chief executive of the Soviet Union.", "The tension between the party and the state (Council of Ministers of the Soviet Union) for the shifting focus of power was never formally resolved, but in reality the party dominated and a paramount leader always existed (first Lenin and thereafter the General Secretary).", "After the founding of the Soviet Union in 1922, Lenin had introduced a mixed economy, commonly referred to as the New Economic Policy, which allowed for capitalist practices to resume under the Communist Party dictation in order to develop the necessary conditions for socialism to become a practical pursuit in the economically undeveloped country.", "In 1929, as Joseph Stalin became the leader of the party, Marxism\u2013Leninism, a fusion of the original ideas of German philosopher and economic theorist Karl Marx, and Lenin, became formalized as the party's guiding ideology and would remain so throughout the rest of its existence." ], [ "General Secretary of the Communist Party of the Soviet Union", "General Secretary of the Communist Party of the Soviet Union\n\nGeneral Secretary of the Central Committee of the Communist Party of the Soviet Union was an office of the Communist Party of the Soviet Union (CPSU) that by the late 1920s had evolved into the most powerful of the Central Committee's various secretaries.", "With a few exceptions, from 1929 until the union's dissolution the holder of the office was the \"de facto\" leader of the Soviet Union, because the post controlled both the CPSU and the Soviet government.", "Joseph Stalin elevated the office to overall command of the Communist Party and by extension the whole Soviet Union.", "Nikita Khrushchev renamed the post First Secretary in 1953; the change was reverted in 1966.", "The office grew out of less powerful secretarial positions within the party: Technical Secretary (1917\u20131918), Chairman of the Secretariat (1918\u20131919), Responsible Secretary (1919\u20131922) (when Lenin was leader of the party of Bolsheviks).", "In its first two incarnations the office performed mostly secretarial work.", "The post of Responsible Secretary was then established in 1919 to perform administrative work.", "In 1922, the office of General Secretary followed as a purely administrative and disciplinary position, whose role was to do no more than determine party membership composition." ], [ "Cold War (1979\u20131985)", "This period of the Cold War would continue through U.S. President Reagan's first term (1981\u20131985), through the death of Soviet leader Leonid Brezhnev in 1982, the brief interim period of Soviet leadership consisting of Yuri Andropov (1982\u20131984) and Konstantin Chernenko (1984\u20131985).", "This phase in the Cold War concluded in 1985 with the ascension of reform-minded Soviet leader Mikhail Gorbachev who brought a commitment to reduce tensions between the East and the West and bring about major reforms in Soviet society.", "During the 1970s, the United States and the Soviet Union had pursued a policy of d\u00e9tente, whereby both sides trying to improve their geopolitical situation while minimizing the risk of direct war between the superpowers.", "Extensive trade ties were established between nations of both blocs, to the point that approximately 70 percent of the Soviet Union's grain came from the United States.", "In 1975, steps to expand political ties between NATO and Soviet-bloc nations (i.e. Ostpolitik) culminated in the signing of the Helsinki Accords.", "Additionally, several major arms control agreements were signed, such as SALT I & II.", "Additionally, efforts were taken by the United States to secure a peace treaty to end its participation in the Vietnam War." ] ], "gold": "During its sixty-nine-year history, the Soviet Union usually had a de facto leader who would not necessarily be head of state but would lead while holding an office such as premier or general secretary. Following Joseph Stalin's consolidation of power in the 1920s, the post of the general secretary of the Central Committee of the Communist Party became synonymous with leader of the Soviet Union. Joseph Stalin was in charge of Russia at the beginning of the Cold War. Nikita Khrushchev was in charge of Russia from September 14, 1953 to October 14, 1964. Leonid Brezhnev was in charge of Russia from October 14, 1964 - November 10, 1982. Yuri Andropov was in charge of Russia from November 10, 1982 - February 9, 1984. Konstantin Chernenko was in charge of Russia from February 9, 1984 - March 10, 1985. After the Cold War, Mikhail Gorbachev was in charge of Russia.", "prediction 1": "During the Cold War, the Soviet Union was led by a number of different leaders. With the death of Joseph Stalin, who led the Soviet Union from 1928 and through the Great Patriotic War, in 1953, Georgy Malenkov was named leader of the Soviet Union. This was short lived however, as Nikita Khrushchev soon undercut all of Malenkov's authority as leader and took control of the Soviet Union himself. The party leader was the \"de facto\" chairman of the CPSU Politburo and chief executive of the Soviet Union.\n", "prediction 2": "During the Cold War between the USA and the Soviet Union, the Soviet Union's leadership changed numerous times. From 1929 to 1953, Joseph Stalin was the leader of the Soviet Union and since 1935 the post of general secretary has been held by different people. Under Nikita Khrushchev, former Soviet leader, the leader of Russia from 1953 to 1982 was Yuri Andropov, who was the Soviet leader for five months from 1982 to 2000.", "prediction 3": "When the Cold War started, the leader of the Soviet Union was Nikita Khrushchev, also known as the First Secretary of the Communist Party of the Soviet Union, who served as the party's leader from 1933 to 1952. Karl Marx held the position of First Secretary until April 30, 1953, when he was replaced by Boris Berezovsky.", "prediction 4": "Throughout the Cold War, the leadership of the Soviet Union was primarily held by the party leader. In 1952, Georgy Malenkov was named Russian president after the death of Stalin, but this was short-lived, as Nikita Khrushchev soon undercut all of Malenkov's authority as leader and took control of the Soviet Union himself. Khrushchev later renamed the post First Secretary before the death of Stalin, as the party leader was the de facto candidate to be the party's first elected leadership of the Soviet Union.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 184 }, { "error type": "Irrelevant", "explanation": "", "start": 397, "end": 505 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "General Secretary of the Central Committee of the Communist Party of the Soviet Union was an office of the Communist Party of the Soviet Union (CPSU) that by the late 1920s had evolved into the most powerful of the Central Committee's various secretaries. With a few exceptions, from 1929 until the union's dissolution the holder of the office was the \"de facto\" leader of the Soviet Union. During the Cold War, the Soviet Union was led by a number of different leaders. With the death of Joseph Stalin, in 1953, Georgy Malenkov was named leader of the Soviet Union. This was short lived however, as Nikita Khrushchev soon undercut all of Malenkov's authority as leader and took control of the Soviet Union himself. Leonid Brezhnev was in charge until 1982. Afterwards was a brief interim period of Soviet leadership consisting of Yuri Andropov (1982\u20131984) and Konstantin Chernenko (1984\u20131985). The Cold War phase was over with Soviet leader Mikhail Gorbachev." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the ussr agree to a unified germany inside of nato?", "passages": [ [ "German reunification", "The United States increased its support of Kohl's policies, as it feared that otherwise Oskar Lafontaine, a critic of NATO, might become Chancellor.", "Horst Teltschik, Kohl's foreign policy advisor, later recalled that Germany would have paid \"100 billion deutschmarks\" if the Soviets demanded it.", "The USSR did not make such great demands, however, with Gorbachev stating in February 1990 that \"The Germans must decide for themselves what path they choose to follow\".", "In May 1990 he repeated his remark in the context of NATO membership while meeting Bush, amazing both the Americans and Germans.", "This removed the last significant roadblock to Germany being free to choose its international alignments, though Kohl made no secret that he intended for the reunified Germany to inherit West Germany's seats in NATO and the EC.", "During a NATO\u2013Warsaw Pact conference in Ottawa, Ontario, Canada, Genscher persuaded the four powers to treat the two Germanys as equals instead of defeated junior partners, and for the six nations to negotiate alone.", "Although the Dutch, Italians, Spanish, and other NATO powers opposed such a structure, which meant that the alliance's boundaries would change without their participation, the six nations began negotiations in March 1990." ], [ "German reunification", "German reunification\n\nThe German reunification () was the process in 1990 in which the German Democratic Republic (GDR, colloquially East Germany; German: ) became part of the Federal Republic of Germany (FRG, colloquially West Germany; German: ) to form the reunited nation of Germany, and when Berlin reunited into a single city, as provided by its then (constitution) Article 23.", "The end of the unification process is officially referred to as German unity (), celebrated on 3 October (German Unity Day) ().", "Following German reunification, Berlin was once again designated as the capital of united Germany.", "The East German government started to falter in May 1989, when the removal of Hungary's border fence with Austria opened a hole in the Iron Curtain.", "It caused an exodus of thousands of East Germans fleeing to West Germany and Austria via Hungary.", "The Peaceful Revolution, a series of protests by East Germans, led to the GDR's first free elections on 18 March 1990, and to the negotiations between the GDR and FRG that culminated in a Unification Treaty.", "Other negotiations between the GDR and FRG and the four occupying powers produced the so-called \"Two Plus Four Treaty\" (Treaty on the Final Settlement with Respect to Germany) granting full sovereignty to a unified German state, whose two parts were previously bound by a number of limitations stemming from their post-World War II status as occupied regions." ], [ "Treaty on the Final Settlement with Respect to Germany", "Treaty on the Final Settlement with Respect to Germany\n\nThe Treaty on the Final Settlement with Respect to Germany (), or the Two Plus Four Agreement (; short: German Treaty), was negotiated in 1990 between the Federal Republic of Germany and the German Democratic Republic (the eponymous \"Two\"), and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States.", "In the treaty the Four Powers renounced all rights they held in Germany, allowing a united Germany to become fully sovereign the following year.", "On 2 August 1945, the Potsdam Agreement, promulgated at the end of the Potsdam Conference, among other things agreed on the initial terms under which the Allies of World War II would govern Germany.", "A provisional German\u2013Polish border known as the Oder\u2013Neisse line awarded, in theory within the context of that \"provisional border\", most of Germany's eastern provinces to Poland and the Soviet Union.", "Those agreements reached were provisional and the agreement stipulated that the situation would be finalised by \"a peace settlement for Germany to be accepted by the Government of Germany when a government adequate for the purpose is established\" (Potsdam Agreement 1.3.1)." ], [ "Treaty on the Final Settlement with Respect to Germany", "Parts of those above-mentioned agreements were burdened with controversy from several sources e.g., Churchill's comment about \"stuffing the Polish goose too full\" (of German lands).", "The overall \"German Question\" became one of the salient and crucial issues of the long-running Cold War, and until it ended in the late 1980s, little progress had been made in the establishment of a single government of Germany adequate for the purpose of agreeing to a final settlement.", "This meant that in some respects (largely, but not only, technical), Germany did not have full national sovereignty.", "Several developments in 1989 and 1990, collectively termed Die Wende and the Peaceful Revolution, led to the fall of the Berlin Wall and the collapse of the SED in the German Democratic Republic (GDR or East Germany).", "In the 18 March 1990 national election in the GDR an electoral alliance of parties that favored German reunification via article 23 of the Basic Law for the Federal Republic of Germany won a plurality.", "To achieve unity and full sovereignty, both German states were willing to accept the terms of the Potsdam Agreement that affected Germany.", "It was then possible for all international parties to negotiate a final settlement.", "The Treaty on the Final Settlement with Respect to Germany was signed in Moscow, Soviet Union, on 12 September 1990, and paved the way for German reunification on 3 October 1990." ] ], "gold": "German reunification was the process in 1990 in which the German Democratic Republic became part of the Federal Republic of Germany to form the reunited nation of Germany. In May 1990, Gorbachev expressed agreement with a unified Germany inside of NATO and removed the last significant roadblock to Germany being free to choose its international alignments. The USSR formally agreed to a unified Germany inside of NATO on 12 September 1990, when they signed the Treaty of the Final Settlement with Respect to Germany. The Treaty on the Final Settlement with Respect to Germany, or the Two Plus Four Agreement, was negotiated between the Federal Republic of Germany and the German Democratic Republic, and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States and it renounced all rights the Four Powers held in Germany, allowing a reunited Germany to become fully sovereign the following year.", "prediction 1": "The United States agreed to a unified Germany inside of NATO in May 1990. This was during a NATO\u2013Warsaw Pact conference in Ottawa, Ontario, Canada, where Genscher persuaded the four powers to treat the two Germanys as equals instead of defeated junior partners, and for the six nations to negotiate alone. Other negotiations between the Federal Republic of Germany and the German Democratic Republic (the eponymous \"Two\"), and the Four Powers which occupied Germany at the end of World War II in Europe, culminated in a Unification Treaty.\n", "prediction 2": "The Treaty on the Final Settlement with Respect to Germany, or the Two Plus Four Agreement, was negotiated in 1990 between the Federal Republic of Germany and the German Democratic Republic (the eponymous \"Two\"), and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States. In the treaty the Four Powers renounced all rights they held in Germany, allowing a united Germany to become fully sovereign the following year.", "prediction 3": "The United States agreed to a unified Germany inside of NATO in March 1990, during a NATO\u2013Warsaw Pact conference in Ottawa, Ontario, Canada. The Treaty on the Final Settlement with Respect to Germany, or the Two Plus Four Agreement, was negotiated in 1990 between the Federal Republic of Germany and the German Democratic Republic, or the eponymous Two, and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States.", "prediction 4": "The Treaty on the Final Settlement with Respect to Germany, or the Two Plus Four Agreement, was negotiated in 1990 between the Federal Republic of Germany and the German Democratic Republic, which was the eponymous \"Two\", and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States. In the treaty the Four Powers renounced all rights they held in Germany, allowing a united Germany to become fully sovereign the following year.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 4, "end": 17 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 147 }, { "error type": "Irrelevant", "explanation": "", "start": 148, "end": 261 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 305 }, { "error type": "Irrelevant", "explanation": "", "start": 306, "end": 311 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 504, "end": 540 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "German reunification was the process in 1990 in which the German Democratic Republic became part of the Federal Republic of Germany to form the reunited nation of Germany. Gorbachev expressed agreement to a unified Germany inside of NATO in May 1990 and removed the last significant roadblock to Germany being free to choose its international alignments. The Treaty on the Final Settlement with Respect to Germany was signed in Moscow, Soviet Union, on 12 September 1990. The Treaty on the Final Settlement with Respect to Germany, or the Two Plus Four Agreement, was negotiated between the Federal Republic of Germany and the German Democratic Republic and the Four Powers which occupied Germany at the end of World War II in Europe: France, the Soviet Union, the United Kingdom, and the United States and it renounced all rights the Four Powers held in Germany, allowing a reunited Germany to become fully sovereign the following year." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who was the captain of the cornelia marie?", "passages": [ [ "FV Cornelia Marie", "Jim Wilson skippered the \"Cornelia Marie\" for their 2010 spring and summer tendering contracts.", "He was among those being considered to run the boat for the rest of the 2010 opilio crab season before Derrick Ray was selected.", "The FV \"Cornelia Marie\" participated in the 2010 king crab season with the same crew from the latter half of the 2010 opilio season.", "Before the king crab season started, the crew of the Cornelia Marie spread Phil Harris's ashes in the Bering Sea.", "The ship had a crew change for the 2011 opilio season, including the replacement of skipper Derrick Ray with Tony Lara.", "The \"Cornelia Marie\" returned for Season 7 of \"Deadliest Catch\".", "The FV \"Cornelia Marie\" returned to Kodiak, Alaska, in late October 2011, under the command of Capt. Tony Lara, following a spell in dry dock to undergo maintenance and to be repainted.", "The \"Cornelia Marie\", while still fishing under the classification of a \"Trawler\", was not featured on Season 8 of Deadliest Catch.", "Josh Harris was featured as a crew member on the FV Time Bandit and Jake Harris was featured as a crew member on the FV \"Northwestern\"." ], [ "FV Cornelia Marie", "FV Cornelia Marie\n\nThe FV \"Cornelia Marie\" is one of the commercial crab fishing boats featured on the Discovery Channel series \"Deadliest Catch\".", "The boat was formerly owned by Cornelia Marie Devlin (formerly Collins) and prior to his death, Phil Harris (who served as captain).", "Phil's son, Josh Harris, recently purchased the boat and began fishing with it during the 2014 Opilio Crab season.", "The FV \"Cornelia Marie\" returned to the Discovery Channel's program \"Deadliest Catch\" in the 8th episode of the 10th season.", "Her current home port is Kodiak, Alaska.", "In early 2015, the Cornelia Marie had a 50% stake sold to two new owners, who repowered the boat with new diesels and repaired her structure.", "The \"Cornelia Marie\" was built in 1989 in Bayou La Batre, Alabama, on commission from original owner Ralph Collins; she was one of the last boats built by Horton Boats.", "Named after Ralph's wife, co-owner Cornelia Marie Collins, the boat is 128 feet (39\u00a0m) long, 28 feet (8.5\u00a0m) wide, and carries of fuel and of fresh water.", "The \"Cornelia Marie\" fishes for King, and opilio crab (also called snow crab), and also does salmon and herring tendering." ], [ "FV Cornelia Marie", "It features an aquamarine and white paint scheme with yellow banners bearing the ship's name.", "Ralph and Cornelia Marie divorced; she took ownership of the boat.", "She eventually sold a partial share to captain Phil Harris.", "His share is currently in possession of his estate.", "The ship was seen (but not named) in background footage for the two pilots of the Discovery Channel series \"Deadliest Catch\".", "It was selected for a camera crew for Season 1, in the 2004 opilio crab season, as partner vessel of featured vessel \"Maverick\".", "The ship took part in the rescue efforts for the \"Big Valley\", which sunk on the first day of the opilio crab season off Saint Paul Island, losing all but one crewmember.", "It became a featured vessel beginning in the second season, joining \"Maverick\", \"Northwestern\" and \"Time Bandit\", and later \"Wizard\".", "Captain Phil Harris suffered a stroke on January 29, 2010, while in port off-loading at Saint Paul Island, Alaska and subsequently died on February 9 from a pulmonary embolism.", "Alaskan songwriter Britt Arnesen wrote a eulogy-in-song for Capt. Harris, released on the \"Cornelia Marie\" website.", "Derrick Ray finished the remaining opilio season after the death of Phil Harris." ] ], "gold": "The FV Cornelia Marie is one of the commercial crab fishing boats featured on the Discovery Channel series Deadliest Catch. The boat was formerly owned by Cornelia Marie Devlin (formerly Collins) and prior to his death, Phil Harris (who served as captain). Captain Phil Harris suffered a stroke on January 29, 2010, while in port off-loading at Saint Paul Island, Alaska and subsequently died on February 9 from a pulmonary embolism. Derrick Ray finished the remaining opilio season after the death of Phil Harris. The ship had a crew change for the 2011 opilio season, including the replacement of skipper Derrick Ray with Tony Lara. Jim Wilson skippered the \"Cornelia Marie\" for their 2010 spring and summer tendering contracts. He was among those being considered to run the boat for the rest of the 2010 opilio crab season before Derrick Ray was selected.", "prediction 1": "The FV Cornelia Marie is one of the commercial crab fishing boats featured on the Discovery Channel series Deadliest Catch. The boat was formerly owned by Cornelia Marie Devlin (formerly Collins) and prior to his death, Phil Harris, who served as captain. Phil's son, Josh Harris, recently purchased the boat and began fishing with it during the 2014 Opilio Crab season. Captain Phil Harris suffered a stroke on January 29, 2010, while in port off-loading at Saint Paul Island, Alaska and subsequently died on February 9 from a pulmonary embolism. Derrick Ray finished the remaining opilio season after the death of Phil Harris.\n", "prediction 2": "The FV Cornelia Marie is one of the commercial crab fishing boats featured on the Discovery Channel series Deadliest Catch. The boat was formerly owned by Cornelia Marie Devlin (formerly Collins) and prior to his death, Phil Harris, who served as captain. Derrick Ray skippered the Cornelia Marie for their 2010 spring and summer tendering contracts. He was among those being considered to run the boat for the rest of the 2010 opilio season before Derrick Ray was selected. The crew change for the 2011 opilio season included the replacement of Captain Derrick Ray with Tony Lara. Josh Harris recently purchased the boat and began fishing with it during the 2014 Opilio Crab season.", "prediction 3": "The Cornelia Marie Crab Fishing Boat was skippered by Phil Harris until his death in 2010. He had a string of good fishing seasons with him, including the 2014 Opilio crab season, during which time the crew spread Phil Harris' ashes in the Bering Sea.", "prediction 4": "The FV Cornelia Marie is one of the commercial crab fishing boats featured on the Discovery Channel series Deadliest Catch. Prior to his death, Captain Phil Harris ran the ship during the 2010 opilio season and 2011 opilio season. Jim Wilson was skipper of the Cornelia Marie for their 2010 spring and summer tendering contracts, Derrick Ray was skipper during the 2011 opilio season and Tony Lara was skipper during the 2014 Opilio Crab season. Josh Harris was the current skipper of the Cornelia Marie and later sold a partial share of the ship to George Wolf. Ulrich Vickers In June 1, 2011, the ship returned to Kodiak, Alaska, where she had a crew change, with Derrick Ray following the death of Harris.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 370 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The FV Cornelia Marie is one of the commercial crab fishing boats featured on the Discovery Channel series Deadliest Catch. The boat was formerly owned by Cornelia Marie Devlin (formerly Collins) and prior to his death, Phil Harris, (who served as captain). Captain Phil Harris suffered a stroke on January 29, 2010, while in port off-loading at Saint Paul Island, Alaska and subsequently died on February 9 from a pulmonary embolism. Derrick Ray finished the remaining opilio season after the death of Phil Harris. Jim Wilson skippered the \"Cornelia Marie\" for their 2010 spring and summer tendering contracts. He was among those being considered to run the boat for the rest of the 2010 opilio crab season before Derrick Ray was selected. The ship had a crew change for the 2011 opilio season, including the replacement of skipper Derrick Ray with Tony Lara.\n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is the current pope of the world?", "passages": [ [ "Papal name", "Papal name\n\nA papal name or pontificial name is the regnal name taken by a pope.", "Both the head of the Catholic Church, usually known as \"the\" Pope, and the Pope of the Coptic Orthodox Church of Alexandria (Coptic Pope) choose papal names.", ", Pope Francis is the Catholic Pope, and Tawadros II or Theodoros II is the Coptic Pope.", "This article discusses and lists the names of Catholic Popes; another article has a list of Coptic Orthodox Popes of Alexandria.", "While popes in the early centuries retained their birth names after their accession to the papacy, later on popes began to adopt a new name upon their accession.", "This first started in the sixth century and became customary in the 10th century.", "Since 1555, every pope has taken a papal name.", "The pontificial name is given in Latin by virtue of the Pope's status as Bishop of the Holy See of Rome.", "The Pope is also given an Italian name by virtue of his Vatican citizenship.", "However, it's customary when referring to popes to translate the regnal name into all local languages.", "Thus, for example, Papa Franciscus (Latin, the official language of the Holy See), is Papa Francesco in Italian (the language of the Vatican), Papa Francisco in his native Spanish, and Pope Francis in English." ], [ "Pope Francis", "Pope Francis\n\nPope Francis (; ; ; born Jorge Mario Bergoglio; 17 December 1936) is the Pope of the Catholic Church and sovereign of the Vatican City State.", "Francis is the first Jesuit pope, the first from the Americas, the first from the Southern Hemisphere, and the first pope from outside Europe since the Syrian Gregory III, who reigned in the 8th century.", "Born in Buenos Aires, Argentina, Bergoglio was ordained a Catholic priest in 1969, and from 1973 to 1979 was Argentina's provincial superior of the Society of Jesus (Jesuits).", "He became the Archbishop of Buenos Aires in 1998 and was created a cardinal in 2001 by Pope John Paul II.", "He led the Argentine Church during the December 2001 riots in Argentina.", "The administrations of N\u00e9stor Kirchner and Cristina Fern\u00e1ndez de Kirchner considered him a political rival.", "Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Bergoglio as his successor on 13 March.", "He chose Francis as his papal name in honor of Saint Francis of Assisi.", "Throughout his public life, Pope Francis has been noted for his humility, emphasis on God's mercy, international visibility as Pope, concern for the poor and commitment to interfaith dialogue." ] ], "gold": "The term pope is used in several churches to denote their high spiritual leaders. From 16 October to 2 April 2005, Karol J\u00f3zef Wojty\u0142a was chosen to be the Pope. 19 April 2005 through 28 February 2013, Joseph Joseph Aloisius Ratzinger as Pope Benedict XVI, and from 13 March 2013 to the present, Jorge Mario Bergoglio, S.J. as Pope Francis. ", "prediction 1": "Pope Francis is the current head of the Catholic Church and sovereign of the Vatican City State. He is the first Jesuit pope, the first from the Americas, the first from the Southern Hemisphere, and the first pope from outside Europe since the Syrian Gregory III, who reigned in the 8th century. Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Jorge Mario Bergoglio as his successor on 13 March.\n", "prediction 2": "A papal name or pontificial name is the regnal name taken by a pope. Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Jorge Mario Bergoglio as his successor on 13 March. Pope Francis is the current head of the Catholic Church in the papacy and sovereign of the Vatican City State. Peter and Paul both had their Pope's names set at Peter the Great. Most recently, as of 18 August 2017, the pontiff Albert II has been the archbishop of Argentina.", "prediction 3": "Pope Francis is the current head of the Catholic Church and a sovereign of the Vatican City State. Pope Francis has been in office since 13 March 2013 and is the first ever pope to hail from a country outside of Europe. Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Jorge Mario Bergoglio as his successor. Pope Tawadros II or Theodoros II was the first Coptic Pope and followed by the current pope of the Coptic Orthodox Church of Alexandria, Tawadros II.", "prediction 4": "Pope Francis is the current head of the Catholic Church and sovereign of the Vatican City State and the current pope of the world. Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Jorge Mario Bergoglio as his successor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 295 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Both the head of the Catholic Church, usually known as \"the\" Pope, and the Pope of the Coptic Orthodox Church of Alexandria (Coptic Pope) choose papal names. Pope Francis is the Catholic Pope, and Tawadros II or Theodoros II is the Coptic Pope. Pope Francis is the current head of the Catholic Church and sovereign of the Vatican City State. Following the resignation of Pope Benedict XVI on 28 February 2013, a papal conclave elected Jorge Mario Bergoglio as his successor on 13 March.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Number of movies released in india every year?", "passages": [ [ "Cinema of India", "Cinema of India\n\nThe Cinema of India consists of films produced in the nation of India.", "Cinema is immensely popular in India, with as many as 1,600 films produced in various languages every year.", "Indian cinema produces more films watched by more people than any other country; in 2011, over 3.5 billion tickets were sold across the globe, 900,000 more than Hollywood.", "Indian cinema is sometimes colloquially known as Indywood.", "As of 2013 India ranked first in terms of annual film output, followed by Nigeria, Hollywood and China.", "In 2012, India produced 1,602 feature films.", "The Indian film industry reached overall revenues of $1.86 billion (93 billion) in 2011.", "In 2015, India had a total box office gross of , third largest in the world.", "Indian cinema is a global enterprise.", "Its films have a following throughout Southern Asia, and across Asia, Europe, the Greater Middle East, North America, Eastern Africa, China and elsewhere, reaching in over 90 countries.", "Biopics including \"Dangal\" became transnational blockbusters grossing over $300 million worldwide." ] ], "gold": "As of 2013, India ranked first in regards to annual movie output, with 1,602 movies released in 2012. The maximum amount of movies released in India every year is 2,000.", "prediction 1": "The Cinema of India consists of films produced in the nation of India. Cinema is immensely popular in India, with as many as 1,600 films produced in various languages every year. Indian cinema produces more films watched by more people than any other country. As of 2013, India ranked first in terms of annual film output, followed by Nigeria, Hollywood and China. In 2012, India produced 1,602 feature films.\n", "prediction 2": "As of 2013 India ranked first in terms of annual film output, followed by Nigeria, Hollywood and China. In 2012, India produced 1,602 feature films. The Indian film industry reached overall revenues of $1.86 billion (93 billion) in 2011. Indian cinema is a global enterprise.", "prediction 3": "Since 2001, the number of feature films released in India has been decreasing steadily as a result of the Great Indian Bharoah. Ten years later, the number of feature films released in the country fell to 791.", "prediction 4": "The Cinema of India consists of films produced in the nation of India. Cinema is immensely popular in India, with as many as 1,600 films produced in various languages every year. Indian cinema produces more films watched by more people than any other country. In 2011, over 3.5 billion tickets were sold across the globe, 900,000 more than Hollywood. India was the biggest producer of English-language feature films in the world with 1,646 films issued in 2012.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 178 }, { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 259 } ], "missing-info": [], "corrected-prediction": "As of 2013, India ranked first in terms of annual film output, followed by Nigeria, Hollywood and China. In 2012, India produced 1,602 feature films.\n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is the headmaster of hogwarts after dumbledore died?", "passages": [ [ "Hogwarts staff", "McGonagall is played by Dame Maggie Smith in the film adaptations.", "Smith has described her role as \"Miss Jean Brodie in a wizard's hat\".", "Given that her role becomes progressively smaller as the series goes on, she notes that \"Harry Potter and the Philosopher's Stone\" is her favourite.", "Smith appeared in all the films of the series except for \"Harry Potter and the Deathly Hallows \u2013 Part 1\", which does not take place in Hogwarts.", "Rowling has stated that she always pictured Smith portraying McGonagall, and claimed the actress to be at the top of her list.", "She is portrayed by Fiona Glascott in \"\".", "Rowling named the character after the poet (and tragedian)", "William McGonagall, whose name she liked.", "Her first name, Minerva, comes from the Roman goddess of wisdom.", "Madam Poppy Pomfrey is the sole magical Healer of the Hogwarts hospital wing.", "She is loyal, highly skilled, non-inquisitive and tight-lipped about her patients, and very strict regarding the rules of her infirmary.", "Harry ends up under her care quite often.", "In \"Philosopher's Stone\", he spends three days unconscious in the hospital wing after the confrontation with Professor Quirrell." ], [ "Order of the Phoenix (fictional organisation)", "During the climax of the book, most of the Order, aided by Dumbledore's Army, the Hogwarts staff and the older students, Slytherin house members included, fought against the Death Eaters in the Battle of Hogwarts, in which several Order members and other allies lost their lives.", "The following characters were members of the Order of the Phoenix during Lord Voldemort's initial rise to power and several years prior to the main events of the \"Harry Potter\" series.", "Many of these characters later served as members of the revived Order.", "These characters joined the Order when Dumbledore reactivated it after Lord Voldemort's return at the end of \"Harry Potter and the Goblet of Fire\".", "This is a list of notable members of the Order of the Phoenix.", "Albus Dumbledore, Severus Snape and Rubeus Hagrid have their own pages.", "Minerva McGonagall is listed under Hogwarts staff, Fred and George are listed under Dumbledore's Army, and Peter Pettigrew is listed under Death Eater.", "Sirius Black, nicknamed Padfoot (because his Animagus form takes the shape of a dog), is the last heir to the House of Black, a once notable pure-blood Wizarding family." ], [ "Harry Potter (film series)", "My favourite character is Hermione.'", "And I think for some weird reason, from that moment on, she sort of trusted me.\"", "Aside from the three lead actors, other notable cast members include Robbie Coltrane as Rubeus Hagrid, Tom Felton as Draco Malfoy, Alan Rickman as Severus Snape, and Dame Maggie Smith as Minerva McGonagall.", "Richard Harris, who played the role of Professor Albus Dumbledore, died on 25 October 2002 causing the role to be re-cast for the third instalment, \"Harry Potter and the Prisoner of Azkaban\".", "David Heyman and director Alfonso Cuar\u00f3n chose Michael Gambon to portray the character of Dumbledore, which he did for all succeeding films." ] ], "gold": "In the Harry Potter series, after Dumbledore died, Professor Minerva McGonagall became the Acting Headmistress and Severus Snape became the Headmaster of Hogwarts School for Witchcraft and Wizardry. Then, after the death of Severus Snape, Professor McGonagall took over the position of Headmistress. Professor McGonagall was played by actress Maggie Smith in the film adaptation of the books. Alan Rickman played the part of Severus Snape.", "prediction 1": "Richard Harris, who played the role of Professor Albus Dumbledore, died on 25 October 2002 causing the role to be re-cast for the third instalment, Harry Potter and the Prisoner of Azkaban. Michael Gambon was chosen to portray the character of Dumbledore, which he did for all succeeding films. Madam Pomfrey is the sole magical Healer of the Hogwarts hospital wing. She is loyal, highly skilled, non-inquisitive and tight-minded about her patients, and very strict regarding the rules of her infirmary. She is loyal, highly skilled, non-inquisitive and tight-ipped about her patients, and very strict regarding the rules of her infirmary. She is the only magical Healer of the Hogwarts hospital wing.\n", "prediction 2": "In the films that follow the Harry Potter books, the headmaster at Hogwarts is assumed by Professor Minerva McGonagall, a character created by J. K. Rowling and played by Dame Maggie Smith. In the third film, Harry Potter and the Prisoner of Azkaban, the headmaster is also portrayed by Michael Gambon.", "prediction 3": "Professor Albus Dumbledore is the headmaster of Hogwarts in the Harry Potter film series. He was first introduced in the book and then, in the film adaptations, he is portrayed by Dame Maggie Smith. His deputy, Madam Pomfrey, was the headmaster until Dumbledore died, and she has since been replaced by Madam Pomfrey, who is loyal, highly skilled, non-inquisitive and tight-lipped about her patients, and strict regarding the rules of Hogwarts hospital wing. McHorva is Madam Pomfrey, who is loyal, highly skilled, non-inquisitive and tight-lipped about her patients, and very strict regarding the rules of her infirmary. Harry spends three days unconscious in the hospital wing after the confrontation with Professor Quirrell.", "prediction 4": "College Principal John Hopkins served as headmaster of Hogwarts during the filming of the film of the book and series. He was succeeded by his second wife, Minerva McGonagall, in 2005.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 294 }, { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 366 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 503 }, { "error type": "Redundant", "explanation": "She is loyal, highly skilled, non-inquisitive and tight-minded about her patients, and very strict regarding the rules of her infirmary. ", "start": 504, "end": 639 }, { "error type": "Redundant", "explanation": "Madam Pomfrey is the sole magical Healer of the Hogwarts hospital wing. ", "start": 640, "end": 702 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played the wicked witch on the wizard of oz?", "passages": [ [ "The Wizard of Oz (2011 musical)", "The Wizard of Oz (2011 musical)\n\nThe Wizard of Oz is a musical based on the 1939 film \"The Wizard of Oz\", with a book adapted by Andrew Lloyd Webber and Jeremy Sams.", "The musical uses the Harold Arlen and E. Y. Harburg songs from the film and includes some new songs and additional music by Andrew Lloyd Webber and additional lyrics by Tim Rice.", "After previews in the West End from 7 February, the musical opened on 1 March 2011, directed by Jeremy Sams, and closed on 2 September 2012.", "The original cast included Danielle Hope as Dorothy Gale, Michael Crawford as the Wizard and Hannah Waddingham as the Wicked Witch of the West.", "Sophie Evans played Dorothy on Tuesday evenings and took over the role full-time in February 2012.", "The role of Dorothy was cast through the 2010 reality television show \"Over the Rainbow\", in which Hope won and", "Evans was the runner-up.", "After a similar Canadian reality TV search show, a Toronto production began in December 2012 and closed in August 2013, and was followed by a North American tour.", "In April 2017 an Australian tour was announced including season at the Lyric Theatre, Queensland Performing Arts Centre,the Capitol Theatre in Sydney, and at the Adelaide Festival Theatre." ], [ "The Wizard of Oz (1939 film)", "The Wizard of Oz (1939 film)\n\nThe Wizard of Oz is a 1939 American musical fantasy film produced by Metro-Goldwyn-Mayer.", "Widely considered to be one of the greatest films in cinema history, it is the best-known and most commercially successful adaptation of L. Frank Baum's 1900 children's book \"The Wonderful Wizard of Oz.\"", "It was directed primarily by Victor Fleming (who left production to take over direction on the troubled \"Gone with the Wind\" production).", "It stars Judy Garland as Dorothy Gale, alongside Ray Bolger, Jack Haley, Bert Lahr, Frank Morgan, Billie Burke, and Margaret Hamilton, with Charley Grapewin, Pat Walshe, and Clara Blandick, Terry (billed as Toto), and Singer's Midgets as the Munchkins.", "Legendary for its use of Technicolor, fantasy storytelling, musical score and memorable characters, the film has become an icon of American popular culture.", "It was nominated for six Academy Awards, including Best Picture, but lost to \"Gone with the Wind\".", "It did win in two other categories: Best Original Song for \"Over the Rainbow\" and Best Original Score by Herbert Stothart." ] ], "gold": "Margaret Hamilton was the Wicked Witch in the 1939 film of The Wizard of Oz that starred Judy Garland. In the 2011 musical, that was based on the 1939 film of the same name, Hannah Waddingham played as the Wicked Witch of the West.", "prediction 1": "The Wicked Witch of the West is a character in the 1939 film The Wizard of Oz. In the original film, Hannah Waddingham played the part of the Wicked Witch of the West. In the 2011 musical The Wizard of Oz, Sophie Evans played the part of the Wicked Witch of the West. In the 2011 musical The Wizard of Oz, Hannah Waddingham played the part of the Wicked Witch of the West.\n", "prediction 2": "There are several The Wizard of Oz musicals. The 2011 musical, The Wizard of Oz, was performed by Sophie Evans. Hannah Waddingham played the Wicked Witch of the West in this musical. This musical is a musical based on the 1939 film The Wizard of Oz that was adapted from the book by Andrew Lloyd Webber and Jeremy Sams. Sophie Evans played the Wicked Witch of the West on Tuesday evenings and took over the role full-time in February 2012. The role of The Wicked Witch of the West is played by Susan Barbra Talbot in the play. In the 2011 musical, Eunice Glady. Amanda Michie's performance as the Wicked Witch of the West in this movie.", "prediction 3": "In The Wizard of Oz (1939) the wicked witch is played by Hannah Waddingham in the film and Danielle Hope in the musical The Wizard of Oz. In The Wizard of Oz (2011 musical), Sophie Evans plays the role of Dorothy. The Wicked Witch of the West was played by Hannah Waddingham in the film.", "prediction 4": "The Wicked Witch of the West was Hannah Waddingham in the 1939 film The Wizard of Oz. Sophie Evans played the wicked witch in the 2011 musical The Wizard of Oz.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 168, "end": 267 }, { "error type": "Redundant", "explanation": "The Wicked Witch of the West is a character in the 1939 film The Wizard of Oz. In the original film, Hannah Waddingham played the part of the Wicked Witch of the West. In the 2011 musical The Wizard of Oz, Sophie Evans played the part of the Wicked Witch of the West. ", "start": 268, "end": 373 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 78 } ], "missing-info": [], "corrected-prediction": "In the 2011 musical, Hannah Waddingham played the part of the Wicked Witch of the West. " }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the smoking ban come into ireland?", "passages": [ [ "Smoking in Ireland", "Smoking in Ireland\n\nSmoking in Ireland is banned fully in the general workplace, enclosed public places, restaurants, bars, education facilities, healthcare facilities and public transport.", "However, it is permitted in designated hotel rooms and there is no ban in residential care, prisons and in outdoor areas.", "Public opinion is in favour of the bans on smoking imposed in Ireland.", "Currently, the Irish law prohibits smoking fully in the general workplace, enclosed public places, restaurants, bars, education facilities, healthcare facilities and public transport.", "Smoking rooms are permitted in hotels.", "As of July 2009, it is prohibited to advertise cigarettes and sell 10-packs of cigarettes in retail outlets.", "Additionally, as of February 2013, any tobacco product placed on the market must have graphic warnings.", "There is legislation being made to introduce plain tobacco packaging and make Ireland the second country to do so, after Australia.", "Smoking in workplaces in Ireland was banned on 29 March 2004, making Ireland the first country in the world to institute an outright ban on smoking in workplaces.", "From that date onwards, under the \"Public Health (Tobacco) Acts\", it has been illegal to smoke in all enclosed workplaces.", "The ban is strictly enforced and includes bars, restaurants, clubs, offices, public buildings, company cars, trucks, taxis and vans." ], [ "Smoking in Ireland", "As of 1 February 2013, any tobacco product placed on the market must have graphic warnings.", "The Minister for Health, Dr. James Reilly's proposal to introduce plain tobacco packaging was approved by the Cabinet and expected legislation will be in place by early 2014.", "As of September 2017 all cigarettes must remove all logos and feature plain packaging.", "The public, according to a Flash Eurobarometer poll conducted by the Gallup Organisation in 2008 for the European Commission, is in favour of a full ban on smoking in restaurants, bars, pubs, clubs, offices and other indoor workplaces.", "According to the above poll there is a majority of people who support the ban on smoking introduced in 2004.", "Since 2009, Irish anti-smoking campaigners and scientists had been urging the government to introduce such a ban.", "In July 2011 the Minister for Health said that he was considering a ban where children are present in the car.", "On January 1st 2016, regulations make it an offence for a person to smoke in a private vehicle when there is more than one person present and there is a person under the age of 18 present.", "The offence would fall on the person smoking regardless of their age.", "The senator and oncologist John Crown put a bill before parliament in 2012 to ban smoking in a car with children.", "This bill was passed into law in December 2014 with an expectation that enforcement by Garda\u00ed would commence in 2015." ] ], "gold": "Smoking in workplaces in Ireland was banned on 29 March 2004, under the \"Public Health Acts\" making Ireland the first country in the world to institute an outright ban on smoking in workplaces. On January 1st 2016, regulations made it an offence for a person to smoke in a private vehicle when there is more than one person present, including someone under the age of 18. The offence will fall on the person smoking regardless of their age.", "prediction 1": "Smoking in workplaces in Ireland was banned on 29 March 2004, making Ireland the first country in the world to institute an outright ban on smoking in workplaces. The ban is strictly enforced and includes bars, restaurants, clubs, offices, public buildings, company cars, trucks, taxis and vans. Smoking in designated hotel rooms is permitted in hotels. However, there is no ban in residential care, prisons or in outdoor areas.\n", "prediction 2": "Smoking in Ireland is banned in the general workplace, enclosed public places, restaurants, bars, education facilities, healthcare facilities and public transport. However, it is permitted in designated hotel rooms and there is no ban in residential care, prisons and in outdoor areas. Smoking in public places was first banned in Ireland on March 29, 2004, making it the first country in the world to institute an outright ban on smoking in workplaces.", "prediction 3": "Smoking in workplaces in Ireland was banned on 29 March 2004, making Ireland the first country in the world to institute an outright ban on smoking in workplaces. The ban was strictly enforced and includes bars, restaurants, clubs, offices, public buildings, company cars, trucks, taxis and vans. Smoking in designated hotel rooms is permitted in all hotels except those with smoking rooms. No smoking ban in residential care, prisons, or in outdoor areas.", "prediction 4": "Smoking ban came into effect in Ireland on 29 March 2004. Smoking is banned in the general workplace, enclosed public places, restaurants, bars, education facilities, healthcare facilities and public transport. Smoking is permitted in designated hotel rooms but is not banned in residential care, prisons or in outdoor areas. Smoking in the general workplace, enclosed public places, restaurants, bars, education facilities, healthcare facilities and public transport is prohibited. Since February 2013, any tobacco product placed on the market must have graphic warnings.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 295 }, { "error type": "Irrelevant", "explanation": "", "start": 296, "end": 353 }, { "error type": "Irrelevant", "explanation": "", "start": 354, "end": 429 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Smoking in workplaces in Ireland was banned on 29 March 2004, making Ireland the first country in the world to institute an outright ban on smoking in workplaces. On January 1st 2016, regulations made it an offence for a person to smoke in a private vehicle when there is more than one person present, including someone under the age of 18. The offence will fall on the person smoking regardless of their age.\n" }, "preference": [ 1, 0, 1, 0, 1, 1 ] }, { "question": "Which two planets of our solar system have the most eccentric orbits?", "passages": [ [ "Orbital eccentricity", "Mercury has the greatest orbital eccentricity of any planet in the Solar System (\"e\" = 0.2056).", "Such eccentricity is sufficient for Mercury to receive twice as much solar irradiation at perihelion compared to aphelion.", "Before its demotion from planet status in 2006, Pluto was considered to be the planet with the most eccentric orbit (\"e\" = 0.248).", "Other Trans-Neptunian objects have significant eccentricity, notably the dwarf planet Eris (0.44).", "Even further out, Sedna, has an extremely high eccentricity of due to its estimated aphelion of 937\u00a0AU and perihelion of about 76\u00a0AU.", "Most of the Solar System's asteroids have orbital eccentricities between 0 and 0.35 with an average value of 0.17.", "Their comparatively high eccentricities are probably due to the influence of Jupiter and to past collisions.", "The Moon's value is 0.0549, the most eccentric of the large moons of the Solar System.", "The four Galilean moons have eccentricity < 0.01.", "Neptune's largest moon Triton has an eccentricity of (), the smallest eccentricity of any known moon in the Solar System; its orbit is as close to a perfect circle as can be currently measured." ] ], "gold": "There are several planets with eccentric orbits in our solar system, which includes major planets and minor planets. The two minor planets with the most eccentric orbits are Sedna and Eris. The two major planets with the most eccentric orbits are Mercury and Mars.", "prediction 1": "Mercury and Pluto have the most eccentric orbits in the Solar System. Before their demotion from planet status in 2006, Pluto was considered to have the most eccentric orbit. The Moon has the most eccentric orbit of any moon in the Solar System.\n", "prediction 2": "The Sun and Moon have the most eccentric orbits in the Solar System. The Earth has the largest orbital eccentricity (E) of any known planet in the Solar System. Before its demotion from planet status in 2006, Pluto was considered to be the planet with the most eccentric orbit.", "prediction 3": "Space rocks are classified according to their eccentricity. Mercury has the greatest orbital eccentricity of any planet in the Solar System. Even further out, Sedna, has an extremely high eccentricity of due to its estimated aphelion of 937 AU and perihelion of about 76 AU. Plus, Pluto was considered to have the most eccentric orbits before its demotion from planet status in 2006.", "prediction 4": "Mercury has the greatest orbital eccentricity of any planet in the Solar System, and Pluto, before its demotion from planet status in 2006, was considered to be the planet with the most eccentric orbit. These object are the ice giant Planets Jupiter and Saturn, and the gas giant planets Venus and Mars. Other Trans-Neptunian objects have significant eccentricity, notably the dwarf planet Eris.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 8, "end": 17 }, { "error type": "Irrelevant", "explanation": "", "start": 70, "end": 119 }, { "error type": "Irrelevant", "explanation": "", "start": 120, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 246 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Mercury and the dwarf planet Eris have the most eccentric orbits in the Solar System. " }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "When's the last time dodgers won a world series?", "passages": [ [ "Los Angeles Dodgers", "Unlike many other historic baseball match-ups in which one team remains dominant for most of their history, the Dodgers\u2013Giants rivalry has exhibited a persistent balance in the respective successes of the two teams.", "While the Giants have more wins in franchise history, the Dodgers and Giants are tied for most National League Pennants at 23, though the Giants have won eight World Series titles, while the Dodgers have won six.", "The 2010 World Series was the Giants' first championship since moving to California, while the Dodgers had won five World Series titles since their move, their last title coming in the 1988 World Series.", "This rivalry refers to a series of games played with the Los Angeles Angels.", "The Freeway Series takes its name from the massive freeway system in the greater Los Angeles metropolitan area, the home of both teams; one could travel from one team's stadium to the other simply by traveling along Interstate 5.", "The term is akin to \"Subway Series\" which refers to meetings between New York City baseball teams.", "The term \"\"Freeway Series\"\" also inspired the official name of the regions' NHL rivalry: the \"Freeway Face-Off\"\n\nThe Dodgers\u2013Yankees rivalry is one of the most well-known rivalries in Major League Baseball.", "The two teams have met eleven times in the World Series, more times than any other pair from the American and National Leagues." ], [ "Los Angeles Dodgers", "Los Angeles Dodgers\n\nThe Los Angeles Dodgers are an American professional baseball team based in Los Angeles, California.", "The Dodgers compete in Major League Baseball (MLB) as a member club of the National League (NL) West division.", "Established in 1883 in Brooklyn, New York, the team moved to Los Angeles before the 1958 season.", "They played for four seasons at the Los Angeles Memorial Coliseum before moving to their current home of Dodger Stadium in .", "The Dodgers as a franchise have won six World Series titles and 23 National League pennants.", "11 NL MVP award winners have played for the Dodgers, winning a total of 13 MVP Awards; eight Cy Young Award winners have pitched for the Dodgers, winning a total of twelve Cy Young Awards.", "The team has also produced 18 Rookie of the Year Award winners, twice as many as the next closest team, including four consecutive from 1979 to 1982 and five consecutive from 1992 to 1996.", "In the early 20th century, the team, then known as the Robins, won league pennants in 1916 and 1920, losing the World Series both times, first to Boston and then Cleveland.", "In the 1930s, the team changed its name to the Dodgers, named after the Brooklyn pedestrians who dodged the streetcars in the city.", "In 1941, the Dodgers captured their third National League pennant, only to lose to the New York Yankees." ], [ "Los Angeles Dodgers", "In 1988, another pitching hero, Orel Hershiser, again led them to a World Series victory, aided by one of the most memorable home runs of all time, by their injured star outfielder Kirk Gibson coming off the bench to pinch hit with two outs in the bottom of the ninth inning of game 1, in his only appearance of the series.", "The Dodgers won the pennant in 2017 and 2018, but lost the World Series to the Houston Astros and Boston Red Sox respectively.", "The Dodgers share a fierce rivalry with the San Francisco Giants, the oldest rivalry in baseball, dating back to when the two franchises played in New York City.", "Both teams moved west for the 1958 season.", "The Brooklyn Dodgers and Los Angeles Dodgers have collectively appeared in the World Series 20 times, while the New York Giants and San Francisco Giants have also collectively appeared 20 times.", "The Giants have won two more World Series (8); the Dodgers and Giants share the record of 23 National League Pennants.", "Although the two franchises have enjoyed near equal success, the city rivalries are rather lopsided and in both cases, a team's championships have predated to the other's first one in that particular location.", "When the two teams were based in New York, the Giants won five World Series championships, and the Dodgers one." ] ], "gold": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles, a team that competes in Major League Baseball, and is a member club of the National League West division. Established in 1883 in the city of Brooklyn, which later became a borough of New York City, the team joined the NL in 1890 as the Brooklyn Bridegrooms and assumed several different monikers thereafter before finally settling on the name Dodgers in 1932. They are one of the most successful and storied franchises in MLB, the Dodgers have won seven World Series championships and a record 24 National League pennants. Their last World Series win was on October 20, 1988.", "prediction 1": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles, California. Established in 1883 in Brooklyn, New York, the team moved to Los Angeles before the 1958 season and played for four seasons at the Los Angeles Memorial Coliseum before moving to their current home of Dodger Stadium. In 1988, another pitching hero, Orel Hershiser, again led them to a World Series victory, aided by one of the most memorable home runs of all time, by their injured star outfielder Kirk Gibson coming off the bench to pinch hit with two out in his only appearance of the series.\n", "prediction 2": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles, California. Established in 1883 in Brooklyn, New York, the team moved to Los Angeles before the 1958 season, and moved to their current home at Dodger Stadium on September 28, 1988. In the 1988 World Series, another pitching hero Orel Hershiser led the Dodgers to a World Series victory, aided by one of the most memorable home runs of all time, by their injured star outfielder Kirk Gibson coming off the bench to pinch-hit with two out in his only appearance of the game 1. The Dodgers and Giants do not win any other NL Pennants.", "prediction 3": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles. Founded in 1883 in Brooklyn, New York, the team moved to Los Angeles before the 1958 season, winning their first of six postseason World Series titles. Meanwhile, the Los Angeles Angels have won nearly as many postseason titles as the Dodgers, dashing the Giants for most postseason titles since moving to the state of California in 2008. A total of 2 front office people have left the Dodgers since the team moved to Los Angeles in 2017.", "prediction 4": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles, which compete in Major League Baseball as a member club of the National League West division. The majority of their World Series wins have come in the past 20 years. The Dodgers as a franchise have won six World Series titles. The Dodgers as a franchise have won 23 National League Pennants, making them the most recent winners. The last time the Dodgers won a World Series was in 1988.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 89, "end": 100 }, { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 326, "end": 382 }, { "error type": "Irrelevant", "explanation": "", "start": 407, "end": 595 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Los Angeles Dodgers are an American professional baseball team based in Los Angeles, a team that competes in Major League Baseball, and is a member club of the National League West division. Established in 1883 in Brooklyn, New York, the team was known as the Robbins before changing its name to the Dodgers in the 1930s. The Dodgers as a franchise have won six World Series titles and 23 National League pennants, their last, a 1988 World Series victory.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How often does it rain in forks washington?", "passages": [ [ "Forks, Washington", "In the city, the age distribution of the population shows 30.4% under the age of 18, 11.1% from 18 to 24, 27.2% from 25 to 44, 22.1% from 45 to 64, and 9.1% who were 65 years of age or older.", "The median age was 31 years.", "For every 100 females, there were 111.7 males.", "For every 100 females age 18 and over, there were 108.9 males.", "The median income for a household in the city was $34,280, and the median income for a family was $38,844.", "Males had a median income of $35,718 versus $23,690 for females.", "The per capita income for the city was $13,686.", "About 14.6% of families and 20.5% of the population were below the poverty line, including 25.7% of those under age 18 and 12.4% of those age 65 or over.", "Forks has an oceanic climate in a temperate rainforest with very high rainfall.", "Although there is a drying trend in summer, rain is still abundant, just not as wet as the rest of the year.", "Forks averages 212 days per year with measurable precipitation.", "The Olympic rainforest surrounds the town.", "According to the United States Census Bureau, the city has a total area of , all of it land." ], [ "Forks, Washington", "All five of these bus routes serve Forks six days a week, with no service on Sundays.", "KFKB 1490 and KBDB-FM 96.7 are the two local commercial stations serving the area.", "Both are owned by Forks Broadcasting.", "KNWU 91.5 is the public radio station serving the area.", "It is a satellite station of Washington State University's statewide Northwest Public Radio network.", "Forks is a part of the Quillayute Valley School District, with Forks High School being the community's high school.", "Forks is home to the University of Washington's Olympic Natural Resources Center.", "On the south end of town is the .", "Constructed in 1989 by the Forks High School carpentry class, the building provides a look into the local history of the timber industry, loggers of the past, and their tools of the trade.", "The museum has exhibits depicting local history dating to the 1870s.", "Forks serves as the hub for numerous day excursions to the Hoh Rainforest, the Pacific Beaches, and various wilderness trails.", "Another source of tourism is Stephenie Meyer's \"Twilight\" series, which is set in the town.", "Tours are available of locations that resemble the places described in Meyer's books.", "The films were not shot in Forks." ] ], "gold": "Forks, Washington has very high rainfall, above 100 inches per year. Although there is a drying trend in summer, rain is still abundant. Forks averages 212 days per year with measurable precipitation. Forks averages 18.2 days of precipitation in October and 10.1 days of precipitation in July. A source of tourism in Folks is Stephenie Meyer's Twilight series, which she set in the town after searching Google for rainy settings.", "prediction 1": "Forks, Washington has an oceanic climate in a temperate rainforest with very high rainfall. Although there is a drying trend in summer, rain is still abundant, just not as wet as the rest of the year. Forks averages 212 days per year with measurable precipitation.\n", "prediction 2": "Forks has an oceanic climate in a temperate rainforest with very high rainfall. Although there is a drying trend in summer, rain is still abundant, just not as wet as the rest of the year. Although there is a drying trend in summer, rain is still abundant, just not as wet as the rest of the year. Forks averages 212 days per year with measurable precipitation.", "prediction 3": "Forks has an oceanic climate in a temperate rainforest with very high rainfall. Although there is a drying trend in summer, rain is still abundant, just not as wet as the rest of the year. According to the United States Census Bureau, the city has a total area of 3,306 square miles and a total population of 73,550. Forks averages 212 days per year with measurable precipitation.", "prediction 4": "Forks is a town in the Olympic Province of Washington with an oceanic climate and very high rainfall. It rains an average of 212 days per year in Forks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 200 } ], "missing-info": [], "corrected-prediction": "Forks, Washington has an oceanic climate in a temperate rainforest with very high rainfall. Although there is a drying trend in summer, rain is still abundant. Forks averages 212 days per year with measurable precipitation.\n" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did adelaide crows win there last premiership?", "passages": [], "gold": "Adelaide Crows has a men's team and also a women's team. The men's team of the Adelaide Crows won their last premiership on September 26, 1998 while their women's team won their last premiership on March 31, 2019.", "prediction 1": "The Adelaide Crows won there last premiership on March 31, 2019.\n", "prediction 2": "The Adelaide Crows last premiership was on February 4,2017.", "prediction 3": "The National Football League leaderboard has ranked the Adelaide Crows in the top 30 finals most often in the 2000s. As of 2015 they have scored 73 points (8 rds) and 54 rds while leading the overall league in goals (22 rds) since the start of the season. The AFL Cup winning team for the 2013-14 season was the Melbourne Storm.", "prediction 4": "In 1988 when the Adelaide Crows won there only premiership for a fourth time it was the 1999 season.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 65 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "What were the two sides of the revolutionary war called?", "passages": [ [ "Loyalists fighting in the American Revolution", "Loyalists fighting in the American Revolution\n\nColonists who supported the British cause in the American Revolution were Loyalists, often called Tories, or, occasionally, Royalists or King's Men.", "George Washington's winning side in the war called themselves \"Patriots\", and in this article Americans on the revolutionary side are called Patriots.", "For a detailed analysis of the psychology and social origins of the Loyalists, see Loyalist (American Revolution).", "This article is an overview of some of the prominent Loyalist military units of the Revolution, and of the fighting they did for the British Crown.", "The number of Americans who adhered to the British side after fighting commenced is still debated.", "An American historian has estimated that about 450,000 Americans remained loyal to Britain during the Revolution.", "This would be about sixteen percent of the total population, or about 20 percent of Americans of European origin (there were 2.25 million white settlers in 1780 in a population of 2.8 million).", "The Loyalists were as socially diverse as their Patriot opponents but some groups produced more Loyalists.", "Thus they included many Anglicans (Episcopalians) in the North East, many tenant farmers in New York and people of Dutch origin in New York and New Jersey, many of the German population of Pennsylvania, some Quakers, most of the Highland Scots in the South, and many Iroquois Indians." ], [ "American Revolutionary War", "American Revolutionary War\n\nThe American Revolutionary War (17751783), also known as the American War of Independence, was an 18th-century war between Great Britain and its Thirteen Colonies (allied with France) which declared independence as the United States of America.", "After 1765, growing philosophical and political differences strained the relationship between Great Britain and its colonies.", "Patriot protests against taxation without representation followed the Stamp Act and escalated into boycotts, which culminated in 1773 with the Sons of Liberty destroying a shipment of tea in Boston Harbor.", "Britain responded by closing Boston Harbor and passing a series of punitive measures against Massachusetts Bay Colony.", "Massachusetts colonists responded with the Suffolk Resolves, and they established a shadow government which wrested control of the countryside from the Crown.", "Twelve colonies formed a Continental Congress to coordinate their resistance, establishing committees and conventions that effectively seized power.", "British attempts to disarm the Massachusetts militia in Concord led to open combat on April 19, 1775.", "Militia forces then besieged Boston, forcing a British evacuation in March 1776, and Congress appointed George Washington to command the Continental Army.", "Concurrently, the Americans failed decisively in an attempt to invade Quebec and raise insurrection against the British.", "On July 2, 1776, the Second Continental Congress voted for independence, issuing its declaration on July\u00a04.", "Sir William Howe launched a British counter-offensive, capturing New York City and leaving American morale at a low ebb." ], [ "American Revolution", "American Revolution\n\nThe American Revolution was a colonial revolt that took place between 1765 and 1783.", "The American Patriots in the Thirteen Colonies won independence from Great Britain, becoming the United States of America.", "They defeated the British in the American Revolutionary War (1775\u20131783) in alliance with France and others.", "Members of American colonial society argued the position of \"no taxation without representation\", starting with the Stamp Act Congress in 1765.", "They rejected the authority of the British Parliament to tax them because they lacked members in that governing body.", "Protests steadily escalated to the Boston Massacre in 1770 and the burning of the \"Gaspee\" in Rhode Island in 1772, followed by the Boston Tea Party in December 1773, during which Patriots destroyed a consignment of taxed tea.", "The British responded by closing Boston Harbor, then followed with a series of legislative acts which effectively rescinded Massachusetts Bay Colony's rights of self-government and caused the other colonies to rally behind Massachusetts.", "In late 1774, the Patriots set up their own alternative government to better coordinate their resistance efforts against Great Britain; other colonists preferred to remain aligned to the Crown and were known as \"Loyalists\" or \"Tories\".", "Tensions erupted into battle between Patriot militia and British regulars when the king's army attempted to capture and destroy Colonial military supplies at Lexington and Concord on April 19, 1775." ] ], "gold": "The American Revolutionary War (April 19, 1775 \u2013 September 3, 1783), also known as the Revolutionary War or the American War of Independence, was fought between the Kingdom of Great Britain and her Thirteen colonies in America. Colonists who supported the British cause in the American Revolution were Loyalists, often called Tories, or, occasionally, Royalists or King's Men. George Washington's winning side in the war called themselves Patriots.", "prediction 1": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The two sides of the revolutionary war were called Loyalists and Patriots. The winning side of the war was George Washington's Patriots.\n", "prediction 2": "First of all, the two sides of the American Revolution were Loyalists, also known as Tories, or, occasionally, Royalists or King's Men. The other side, the American Patriots, was considered a fundamentally different force. In the British arms, the Patriots fought against the British government and many of them died in the conflict.", "prediction 3": "The two sides of the Revolutionary war were called Loyalists and Patriots. However, the side that fought the most was the side that George Washington's winning side in the war called themselves Patriots.", "prediction 4": "The American Revolution was a colonial revolt that took place between 1765 and 1783. The two sides of the revolutionary war were called Loyalists and Patriots. The winning side of the American Revolution was designated Patriots.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 84 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "The American Revolutionary War (1775-1783), also known as the American War of Independence was a war between Great Britain and its Thirteen Colonies. The two sides of the revolutionary war were called Loyalists and Patriots. Loyalists supporting the British cause in the American Revolution were Loyalists, often called Tories, or, occasionally, Royalists or King's Men. The winning side of the war was George Washington's Patriots." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did michigan state basketball win a national championship?", "passages": [ [ "Michigan State Spartans men's basketball", "Michigan State Spartans men's basketball\n\nThe Michigan State Spartans men's basketball team represents Michigan State University (MSU) and competes in the Big Ten Conference of NCAA Division I College basketball.", "Their home games are played at the Breslin Student Events Center.", "Tom Izzo has been the head coach since 1995.", "The Spartans have won two NCAA championships and 14 Big Ten Conference Championships.", "Their two National Championships came in the 1979 NCAA Tournament and the 2000 NCAA Tournament.", "The 1979 National Championship Game was the most watched college basketball game in history, with 35.11 million television viewers.", "The 1979 National Championship team was coached by Jud Heathcote and included tournament MVP Magic Johnson, Greg Kelser and Jay Vincent.", "The Spartans defeated the previously unbeaten Indiana State Sycamores, led by future Hall of Famer Larry Bird.", "The 2000 National Championship team defeated the Florida Gators in the final.", "The team was coached by Tom Izzo and led by players Morris Peterson, Charlie Bell, Jason Richardson and tournament MVP Mateen Cleaves.", "The Spartans have participated in 32 NCAA tournaments and in 21 consecutive NCAA tournaments (1998\u20132018), the fifth-longest streak ever and third-longest active streak in college basketball, behind Kansas (28) and Duke (22)." ] ], "gold": "The Michigan State Spartans men's basketball team has won two NCAA National Championship titles, in the 1979 NCAA Tournament against the Indiana State Sycamores and the 2000 NCAA Tournament against the Florida Gators.", "prediction 1": "The Michigan State Spartans men's basketball team represents Michigan State University and competes in the Big Ten Conference of NCAA Division I College basketball. Their two National Championships came in the 1979 NCAA Tournament and the 2000 NCAA Tournament.\n", "prediction 2": "The Michigan State Spartans Men's Basketball team represents Michigan State University and competes in the Big Ten Conference of NCAA Division I College basketball. Their two National Championships came in the 1979 NCAA Tournament and the 2000 NCAA Tournament. Their team also won 14 Big Ten Conference Championships.", "prediction 3": "The Michigan State Spartans men's basketball team represents Michigan State University and competes in the Big Ten Conference of NCAA Division I College basketball. They won a National Championship in the 1979 NCAA Tournament and a National Championship in the 2000 NCAA Tournament.", "prediction 4": "The Michigan State Spartans men's basketball team represents Michigan State University and competes in the Big Ten Conference of NCAA Division I College basketball. They have won 14 Big Ten Conference Championships and two NCAA Championships. Their two National Championships came in the 1979 NCAA Tournament and the 2000 NCAA Tournament.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 164 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The Michigan State Spartans men's basketball team has won two NCAA championships . Their two National Championships came in the 1979 NCAA Tournament against the Indiana State Sycamores and the 2000 NCAA Tournament against the Florida Gators.\n" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When is the tv show yellowstone coming on?", "passages": [ [ "Yellowstone (U.S. TV series)", "Yellowstone (U.S. TV series)\n\nYellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network.", "It stars Kevin Costner, Wes Bentley, Kelly Reilly, Luke Grimes, Cole Hauser and Gil Birmingham.", "The series follows the conflicts along the shared borders of a large cattle ranch, an Indian reservation, land developers and Yellowstone National Park.", "On July 24, 2018, it was announced that Paramount Network had renewed the series for a second season to air in 2019.", "\"Yellowstone\" follows \"the Dutton family, led by John Dutton, who controls the largest contiguous ranch in the United States, under constant attack by those it borders\u2014land developers, an Indian reservation, and America's first National Park.", "It is an intense study of a violent world far from media scrutiny\u2014where land grabs make developers billions, and politicians are bought and sold by the world's largest oil and lumber corporations.", "Where drinking water poisoned by fracking wells and unsolved murders are not news: they are a consequence of living in the new frontier.", "It is the best and worst of America seen through the eyes of a family that represents both.\"", "In 2013, Taylor Sheridan began work on the series, having recently grown tired of acting and begun writing screenplays." ] ], "gold": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018, on the Paramount Network and stars Kevin Costner, Wes Bentley, Kelly Reilly, Luke Grimes, Cole Hauser, and Gil Birmingham. The second season of the show premiered on June 19, 2019. This led Paramount Network to renew the series for a third season, which premiered on June 21, 2020. In February 2020 and ahead of the premiere of its third season, Paramount Network renewed the series for a fourth season, which is scheduled to premiere on November 7, 2021.", "prediction 1": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network. The first season of the series aired on June 24, 2018-June 27, 2018. The second season aired on June 24, 2019-June 30, 2019.\n", "prediction 2": "The American drama TV series Yellowstone premiered on June 20, 2018 on Paramount Network, a network owned by Paramount Pictures Entertainment. It was renewed for a second season in June 2019 by Paramount.", "prediction 3": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network. The first season aired on February 21, 2019, the second season aired on January 26, 2020, and the third season aired on February 20, 2021.", "prediction 4": "The American drama television series Yellowstone premiered on Paramount Channel on June 20, 2018 and was renewed by Paramount Network for a second season. Entitled \"Watersheds: The Last Frontier,\" it follows the conflicts along the shared borders of a large cattle ranch, an Indian reservation, land developers, and Yellowstone National Park. It launched on January 2, 2019 and concluded on April 20, 2019.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 148, "end": 216 }, { "error type": "Unverifiable", "explanation": "", "start": 217, "end": 273 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Yellowstone is an American drama television series created by Taylor Sheridan and John Linson that premiered on June 20, 2018 on Paramount Network. On July 24, 2018, it was announced that Paramount Network had renewed the series for a second season to air in 2019." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who has scored the most goals in la liga in one season?", "passages": [ [ "Lionel Messi", "During the second half of the 2013\u201314 season, doubts persisted over Messi's form, leading to a perception among the \"cul\u00e9s\" that he was reserving himself for the 2014 FIFA World Cup.", "Statistically, his contribution of goals, shots, and passes had dropped significantly compared to previous seasons.", "He still managed to break two longstanding records in a span of seven days: a hat-trick on 16 March against Osasuna saw him overtake Paulino Alc\u00e1ntara's 369 goals to become Barcelona's top goalscorer in all competitions including friendlies, while another hat-trick against Real Madrid on 23 March made him the all-time top scorer in \"El Cl\u00e1sico\", ahead of the 18 goals scored by former Real Madrid player Alfredo Di St\u00e9fano.", "Messi finished the campaign with his worst output in five seasons, though he still managed to score 41 goals in all competitions.", "For the first time in five years, Barcelona ended the season without a major trophy; they were defeated in the Copa del Rey final by Real Madrid and lost the league in the last game to Atl\u00e9tico Madrid, causing Messi to be booed by sections of fans at the Camp Nou." ], [ "2015\u201316 La Liga", "2015\u201316", "La Liga\n\nThe 2015\u201316 La Liga football season (known as the \"Liga BBVA\" for sponsorship reasons) was the 85th since its establishment.", "Barcelona were the defending champions.", "It started on 21 August 2015 and concluded on 15 May 2016.", "Barcelona retained the title (their 24th Liga title) after beating Granada 3\u20130 on the final matchday.", "Luis Su\u00e1rez finished as top scorer, being the first player apart from Lionel Messi and Cristiano Ronaldo to do so since the 2008\u201309 season.", "A total of 20 teams contested the league, including 17 sides from the 2014\u201315 season and three promoted from the 2014\u201315", "Segunda Divisi\u00f3n.", "This included the two top teams from the Segunda Divisi\u00f3n (Real Betis and Sporting de Gij\u00f3n), and the winners of the play-offs (Las Palmas).", "Almer\u00eda and C\u00f3rdoba were relegated to 2015\u201316", "Segunda Divisi\u00f3n in the last season, after being two and one years, respectively in La Liga.", "Elche was administratively relegated despite finishing 13th.", "Following the competition rules, Eibar, who finished 18th, remained in the league.", "Real Betis was the first team from Segunda to achieve promotion, after a one-year absence from La Liga, on 24 May 2015 after winning 3\u20130 over Alcorc\u00f3n." ] ], "gold": "La Liga's all-time top goalscorer is Argentine Lionel Messi, who also holds the record for most goals scored in a season with 50 goals in the 2011\u201312 season. Cristiano Ronaldo held it prior to Messi from 2010-2011 and from 1989-90 Hugo S\u00e1nchez scored the most in one season of La Liga. ", "prediction 1": "Lionel Messi has scored the most goals in La Liga in a single season, with 369 goals in all competitions. In the 2013\u201314 season, Messi broke two longstanding records in a span of seven days, scoring a hat-trick against Osasuna on March 16, 2014, which made him the top goalscorer in all competitions including friendlies. In the 2015\u201316 season, Luis Su\u00e1rez finished as top scorer, being the first player apart from Lionel Messi to do so since the 2008\u201309 season.\n", "prediction 2": "In the 2013\u201314 and 2015\u201316 seasons, Lionel Messi has scored the most goals in La Liga. Messi scored 368 goals in all competitions including friendlies. Furthermore, during the 2015\u201316 season, Luis Su\u00e1rez scored 41 goals in all competitions.", "prediction 3": "Also, the player with the most La Liga goals in a season is Lionel Messi, with 375 in all competitions with the club leading the pack. He also holds the record for most La Liga goals in a single season with 37 in All Competitions, using a hat trick against Osasuna, and Alfredo Di St\u00e9fano owns the record for most La Liga goals in a single game with the club.", "prediction 4": "Lionel Messi has scored the most goals in La Liga in one season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 321 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 70, "end": 105 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Lionel Messi has scored the most goals in La Liga in a single season. Another scorer, in the 2015\u201316 season, was Luis Su\u00e1rez finished as top scorer, being the first player apart from Lionel Messi and Cristiano Ronaldo to do so since the 2008\u201309 season. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the original toy story come out?", "passages": [ [ "Toy Story (franchise)", "Also, \"\" and \"Disney's Activity Center: Toy Story\" were released for Windows and Mac.", "\"Disney's Animated Storybook:", "Toy Story\" was the best selling software title of 1996, selling over 500,000 copies.", "Totally Toy Story was an instant theme park and a promotional event for the \"Toy Story\" movie premiere held at El Capitan Theatre and Masonic Convention Hall.", "For the November 18, 1995 \"Toy Story\" premiere at El Capitan Theatre, Disney rented the Masonic Convention Hall, the next door building, for Totally Toy Story, an instant theme park and a promotional event for the movie.", "Movie goers paid an additional fee for the pop up park.", "The promotional event had pre-sales over $1 million", "and remained opened until January 1, 1996.", "The Toy Story Funhouse part was moved to Disneyland's Tomorrowland and opened there on January 27, 1996 and closed on May 27, 1996.", "Totally Toy Story, while in Hollywood, consisted of \"Toy Story Art of Animation\" exhibit in El Capitan's basement and the Toy Story Funhouse at the convention hall.", "The fun house consisted of 30,000-square-foot of various attractions.", "These attractions continue the story of the movie with the toys life-size.", "Toy Story Funhouse attractions\n\n\"Toy Story\"'s innovative computer animation had a large impact on the film industry." ], [ "Toy Story", "Pixar, which had produced short animated films to promote their computers, was approached by Disney to produce a computer-animated feature film after the success of their short film \"Tin Toy\" (1988), which is told from a small toy's perspective.", "Lasseter, Stanton, and Docter wrote early story treatments which were rejected by Disney, who wanted the film's tone to be \"edgier\".", "After several disastrous story reels, production was halted and the script was re-written, better reflecting the tone and theme Pixar desired: that \"toys deeply want children to play with them, and that this desire drives their hopes, fears, and actions\".", "The studio, then consisting of a relatively small number of employees, produced the film under minor financial constraints.", "\"Toy Story\" was released in theaters on November 22, 1995, and was the highest-grossing film on its opening weekend, eventually earning over $373 million at the worldwide box office.", "It was positively reviewed by critics and audiences, who praised the animation's technical innovation, the wit and thematic sophistication of the screenplay, and the performances of Hanks and Allen; it is considered by many to be one of the best animated films ever made." ], [ "Toy Story (franchise)", "It was the highest-grossing domestic film in 1995, and the third highest-grossing animated film at the time.", "\"Toy Story 2\" opened at #1 over the Thanksgiving Day weekend, with a three-day tally of $57,388,839 from 3,236 theaters.", "It averaged $17,734 per theater over three days during that weekend, and stayed at #1 for the next two weekends.", "It was the third highest-grossing film of 1999.", "\"Toy Story 3\" had a strong debut, opening in 4,028 theaters and grossing $41,148,961 at the box office on its opening day.", "In addition, \"Toy Story 3\" had the highest opening day gross for an animated film on record.", "During its opening weekend, the film grossed $110,307,189, making it #1 for the weekend; it was the biggest opening weekend ever for any Pixar film.", "\"Toy Story 3\" stayed at the #1 spot for the next weekend.", "The film had the second highest opening ever for an animated film.", "It was the highest-grossing film of 2010, both domestically and worldwide.", "\"Toy Story 3\" grossed over $1 billion, making it the seventh film in history, the second Disney film in 2010, the third Disney film overall, and the first animated film to do so." ] ], "gold": "The 1995 American animated film \"Toy Story\" premiered at the El Capitan Theatre in Los Angeles, California on November 19, 1995. The film was widely released in the rest of North America on November 22, 1995. It was the highest-grossing film during its opening weekend, eventually grossing over $373 million worldwide.", "prediction 1": "The original Toy Story came out in theaters on November 22, 1995. It was the highest-grossing film on its opening weekend, eventually earning over $373 million at the worldwide box office. The Toy Story Funhouse part was moved to Disneyland's Tomorrowland and opened there on January 27, 1996. The Toy Story 3 had a strong debut, opening in 4,028 theaters and grossing $41,148,961 at the box office on its opening day.\n", "prediction 2": "Toy Story, the original animated movie by Disney Studios, first came out on November 22, 1995. It was the highest-grossing film at the worldwide box office, eventually earning over $373 million worldwide. The film had a great artistic impact on the industry and brought home multiple Oscars. The original film had a strong debut, opening in 4,028 theaters and grossing $110,307,189 during its opening weekend; it was the biggest opening weekend ever for any Pixar film. The Toy Story Funhouse part was moved to Disneyland's Tomorrowland and opened there on January 27, 1996. It was the third highest-grossing animated film at the worldwide box office on record. The world's highest-grosing animated film in 1995 was released in theaters on November 22, 1995. It's second sequel Toy Story came out on November 25, 1999.", "prediction 3": "The Toy Story franchise directed by Walt Disney started in 1994 with Toy Story, the first movie based on Pixar's Tin Toy character from the 1940s. Toy Story came out in theaters on November 22, 1995. On November 19, 1996, Disney released a sequel to Toy Story, Toy Story 2 which was the third highest grossing animated film of all time. On November 22, 1999, Disney released a reboot of Toy Story that was the fifth highest grossing animated film of all time. Disney's Animated Story 2 followed in 1999 and was the highest opening day gross for any Pixar film on record. Disney's Animated Story 3 had a strong debut, opening in 4,028 theaters and grossing $41,148,181,148,159,600, making it the second highest opening ever for an animated film.", "prediction 4": "The original Toy Story came out in theaters on November 22, 1995. The movie was the highest-grossing film of all time on its opening weekend, earning over $373 million worldwide. The film was followed by the animated film, Toy Story II, in November 1999. The sequel, Toy Story 3, came out on December 2, 2009, and released on October 27, 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 293 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 419 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The \"Toy Story\" movie premiere held at El Capitan Theatre on November 22, 1995. It was the highest-grossing film on its opening weekend, eventually earning over $373 million at the worldwide box office. \n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who is the oldest senator currently serving in congress?", "passages": [ [ "Dianne Feinstein", "Feinstein has been re-elected five times since then, and in the 2012 election, she received 7.75 million votes--the most popular votes in any U.S. Senate election in history.", "Feinstein was the author of the 1994 Federal Assault Weapons Ban which expired in 2004.", "In 2013, she introduced a new assault weapons bill which failed to pass.", "Feinstein is the first and only woman to have chaired the Senate Rules Committee (2007\u20132009) and the Select Committee on Intelligence (2009-2015).", "To date, she is also the only woman to have presided over a U.S. presidential inauguration.", "At the age of , Feinstein is the oldest sitting U.S. Senator.", "Upon the retirement of Barbara Mikulski in January 2017, Feinstein became the longest-tenured female U.S. Senator currently serving in the Senate.", "Feinstein was born Dianne Emiel Goldman in San Francisco, to Betty (n\u00e9e Rosenburg), a former model, and Leon Goldman, a surgeon.", "Feinstein's paternal grandparents were Jewish immigrants from Poland.", "Her maternal grandparents, the Rosenburg family, were from Saint Petersburg, Russia.", "While they were of German-Jewish ancestry, they practiced the Russian Orthodox faith, as was required for Jews residing in Saint Petersburg." ], [ "United States Senate", "United States Senate\n\nThe United States Senate is the upper chamber of the United States Congress, which along with the United States House of Representatives\u2014the lower chamber\u2014comprises the legislature of the United States.", "The composition and powers of the Senate are established by Article One of the United States Constitution.", "The Senate is composed of senators, each of whom represents a single state in its entirety, with each state being equally represented by two senators, regardless of its population, serving staggered terms of six years; with 50 states currently in the Union, there are 100 U.S. Senators.", "From 1789 until 1913, Senators were appointed by legislatures of the states they represented; following the ratification of the Seventeenth Amendment in 1913, they are now popularly elected.", "The Senate chamber is located in the north wing of the Capitol, in Washington, D.C.\n\nAs the upper house, the Senate has several powers of advice and consent which are unique to it; these include the approval of treaties and the confirmation of Cabinet secretaries, Supreme Court justices, federal judges, other federal executive officials, flag officers, regulatory officials, ambassadors, and other federal uniformed officers.", "In addition to these, in cases wherein no candidate receives a majority of electors for Vice President, the duty falls to the Senate to elect one of the top two recipients of electors for that office.", "It further has the responsibility of conducting trials of those impeached by the House." ], [ "Paul Sarbanes", "Paul Sarbanes\n\nPaul Spyros Sarbanes (born February 3, 1933) is an American former politician and attorney.", "A member of the Democratic Party from Maryland he served as a member of the United States House of Representatives from 1971 to 1977 and as a United States Senator from 1977 to 2007.", "Sarbanes was the longest-serving senator in Maryland history until he was surpassed by Barbara Mikulski by a single day when her term ended on January 3, 2017.", "Born in Salisbury, Maryland, Sarbanes is a graduate of Princeton University, Balliol College, Oxford, and Harvard Law School.", "Elected to the Maryland House of Delegates in 1966, he went on to serve two terms in the Maryland House from 1967 to 1971.", "In 1970, he won a seat in the United States House of Representatives, representing Maryland's 4th and later Maryland's 3rd congressional district from 1971 to 1977.", "In 1976, he ran for the United States Senate, defeating Republican incumbent John Glenn Beall, Jr. with 59% of the vote.", "Sarbanes was re-elected four times, each time with receiving no less than 59% of the vote.", "He did not seek re-election in 2006, when he was succeeded by fellow Democrat Ben Cardin.", "Sarbanes was known for his low-key style, often shunning the limelight over his 30-year Senate career." ], [ "Members of the 111th United States Congress", "He and his successor, Arthur W. Mitchell, spent their tenure as the only African Americans in Congress while representing a majority-black House district in Chicago.", "Not until the election of Adam Clayton Powell, Jr. of New York City's Harlem did Congress feature two African Americans serving at the same time in the modern era.", "The Voting Rights Act of 1965, which strengthened black voting rights, increased the position of black office-seekers.", "Shirley Chisholm became the first African American female member of Congress when she won a 1968 election in New York, while Andrew Young of Georgia became the first modern African American congressman from the South after he won election in 1972.", "In 1970, a year that saw the election of four black freshman congressman, black membership in the House reached double-digits.", "Only eight African Americans have served in the U.S. Senate.", "Hiram Revels and Blanche Bruce both served during Reconstruction in then majority-black Mississippi.", "Popularly elected black senators are Edward Brooke (served 1967\u201379), Carol Moseley Braun (served 1993\u201399 as the first black female senator), Barack Obama (served 2005\u201308), and Cory Booker (2013-)." ] ], "gold": "At 88, Dianne Feinstein, born in 1933, is the oldest sitting U.S. senator in the Senate of the United States Congress. Previously, the oldest senator serving in Congress was John Glenn from January 3, 2015, to December 8, 2016, Edward Brooke from July 30, 2013, to January 3, 2015, and Harry F. Byrd Jr. from October 20, 2009, to July 30, 2013.", "prediction 1": "The oldest sitting U.S. senator is Dianne Feinstein, who served from 2007 to 2017. She is also the longest-tenured female U.S. Senator currently serving in the Senate. Paul Sarbanes, an American former politician and attorney, was the oldest serving senator in Maryland history until he was surpassed by Barbara Mikulski by a single day when her term ended on January 3, 2017.\n", "prediction 2": "At the age of 94, Dianne Feinstein is the oldest sitting U.S. Senator, and the longest-tenured female U.S. Senator currently serving in the Senate. Traditionally, older senators are John Glenn Beall, Paul Sarbanes, and Arthur W. Mitchell. Delegate Paul Sarbanes was Maryland's oldest sitting senator but was surpassed by former Maryland Senator Barbara Mikulski on January 3, 2017.", "prediction 3": "Paul Sarbanes, an American politician and attorney, is the oldest serving Senator in the US Senate. Former Representative Arthur W. Mitchell is the oldest-serving Senator currently serving in the US Senate. Upon the retirement of Barbara Mikulski in January 2017, Feinstein became the longest-tenured female U.S. Senator currently serving in the Senate.", "prediction 4": "Unofficially, the oldest sitting American senators are Dianne Feinstein in California and Paul Sarbanes in Maryland, who served as a United States Senator from 1977 to 2007. The oldest sitting Republican senator currently serving in Congress is Barbara Mikulski of Wisconsin, who has served since 2017 and served until 2021.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 53, "end": 82 }, { "error type": "Redundant", "explanation": "The oldest sitting U.S. senator is Dianne Feinstein", "start": 90, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 168, "end": 377 } ], "missing-info": [], "corrected-prediction": "The current oldest sitting U.S. senator is Dianne Feinstein. \n" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When did here comes the hotstepper come out?", "passages": [ [ "Here Comes the Hotstepper (album)", "Here Comes the Hotstepper (album)\n\n", "Here Comes the Hotstepper is a 1995 album by Jamaican reggae and dancehall artist Ini Kamoze.", "It was produced by Sly Dunbar and Robbie Shakespeare.", "It contains as title track the international hit \"Here Comes the Hotstepper\" that charted in the United States, UK and many European charts.", "The remainder of the album's tracks are re-recordings of songs that had appeared on Kamoze's first four albums: \"Ini Kamoze\" (1984), \"Statement\" (also 1984), and \"Pirate\" (1986)." ], [ "Ini Kamoze", "Kamoze founded his own label, releasing a compilation album \"Selekta Showcase\" which featured a popular Kamoze single titled \"Stress\".", "Four years later he released his next album, \"16 Vibes of Ini Kamoze\", which sold well.", "In 1994, Kamoze released the song which would become his signature, \"Here Comes the Hotstepper\".", "Adopting another nickname from the song title, Kamoze would become known as the \"Hotstepper\", from the patois for a man on the run from the law.", "The song was originally recorded with Philip \"Fatis\" Burrell and later remixed by Salaam Remi, and initially featured on a reggae music compilation \"Stir It Up\", released on the Epic label.", "\"Here Comes the Hotstepper\" was not an entirely new composition, having roots in the song \"Land of 1000 Dances\", which was a number one R&B hit for Wilson Pickett in 1966 and was first recorded by Chris Kenner in 1962 and reprised in 1963 by Fats Domino.", "The remixed version of the track also incorporates the bass line from Taana Gardner's 1981 single \"Heartbeat\".", "The song appeared on the soundtrack to the fashion-industry satire feature film \"Pr\u00eat-\u00e0-Porter\"." ], [ "Here Comes the Hotstepper", "Here Comes the Hotstepper\n\n\"Here Comes the Hotstepper\" is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze.", "It was released as the lead single from his 1995 album \"Here Comes the Hotstepper\" as well as the soundtrack to the film \"Pr\u00eat-\u00e0-Porter\".", "It is best known for its \"na na na na na...\" chorus sampled from the Cannibal & the Headhunters cover of \"Land of a Thousand Dances\".", "The song was Kamoze's only song to reach the \"Billboard\" Hot 100 top 40 in the United States, reaching the number one position on December 17, 1994 and remaining there for two weeks; it was also a number one hit in Denmark and New Zealand, and a top ten hit in twelve other countries.", "\"Here Comes the Hotstepper\" contains several samples, including vocals from \"The Champ\" by The Mohawks, \"Hot Pants\" by Bobby Byrd, and \"La Di Da Di\" by Doug E. Fresh and Slick Rick.", "The song's instrumental samples the drums and bass from \"Heartbeat\" by Taana Gardner and guitar notes from \"Hung Up on My Baby\" by Isaac Hayes." ] ], "gold": "\"Here Comes the Hotstepper\" is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze. It was released in August 18, 1994 and would later get into the top 40 on the US Billboard Hot 100, peaking atop the chart on December 17, 1994, and remaining there for two weeks. The song was also the main single of an album of the same name that Kamoze released on January 17, 1995.", "prediction 1": "Here Comes the Hotstepper is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze. It was released as the lead single from his 1995 album Here Comes the Hotstepper as well as the soundtrack to the fashion-industry satire feature film Pr\u00eat-\u00e0-Porter. The song was Kamoze's only song to reach the Billboard Hot 100 top 40 in the United States, reaching the number one position on December 17, 1994.\n", "prediction 2": "Here Comes the Hotstepper is the lead single from Jamaican reggae artist Ini Kamoze's 1995 album, Here Comes the Hotstepper, as well as the soundtrack to the 1992 film Pr\u00eat-\u00e0-Porter. Here Comes the Hotstepper had its first charting chart in the US on June 4, 1992, and in the UK on September 4, 1994.", "prediction 3": "\"Here Comes the Hotstepper\" is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze. It was released as the lead single from his 1995 album \"Here Comes the Hotstepper\" as well as the soundtrack to the fashion-industry satire feature film \"Pr\u00eat-\u00e0-Porter.\"", "prediction 4": "\"Here Comes the Hotstepper\" is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze. It was released as the lead single from his 1995 album Here Comes the Hotstepper as well as the soundtrack to the fashion-industry satire feature film Pr\u00eat-\u00e0-Porter. The song was Kamoze's only song to reach the \"Billboard\" Hot 100 top 40 in the United States, reaching the number one position on December 17, 1994 and remaining there for two weeks. Kamoze eventually to the number one position on the Hotstepper chart in France.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 266 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Here Comes the Hotstepper is a song co-written and recorded by Jamaican dancehall artist Ini Kamoze. In 1994, Kamoze released the song. It was released as the lead single from his 1995 album Here Comes the Hotstepper. The song was Kamoze's only song to reach the Billboard Hot 100 top 40 in the United States, reaching the number one position on December 17, 1994 and remaining there for two weeks.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the boy in the striped pajamas take place?", "passages": [ [ "The Boy in the Striped Pyjamas", "The Boy in the Striped Pyjamas\n\nThe Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne.", "Unlike the months of planning Boyne devoted to his other books, he said that he wrote the entire first draft of\" The Boy in the Striped Pyjamas\" in two and a half days, barely sleeping until he got to the end.", "He did, however, commit to nearly 20 years of research, reading and researching about the Holocaust as a teenager before the idea for the novel even came to him.", "As of March 2010, the novel had sold more than five million copies around the world.", "In both 2007 and 2008, it was the best selling book of the year in Spain, and it has also reached number one on the \"New York Times\" bestseller list, as well as in the UK, Ireland, and Australia.", "The book was adapted in 2008 as a film of the same name.", "Bruno is a 9-year-old boy growing up during World War II in Berlin.", "He lives with his parents, his 12-year-old sister Gretel and maids, one of whom is called Maria." ], [ "The Boy from Stalingrad", "The Boy from Stalingrad\n\nThe Boy from Stalingrad is a 1943 American film.", "The plot centers on Russian youths in the path of the German army's assault on Stalingrad, who are forced to band together and rely on themselves to survive.", "They set fire to the grain harvest, rescue and care for other abandoned children, sabotage a tank, and fight back against the Nazis as best they can.", "The actual Battle of Stalingrad ended at the beginning of February 1943.", "This pro-Soviet film belongs in the same class as the better-known 1943 \"Mission to Moscow\" from Warners', RKO's 1943 \"The North Star\", and MGM's 1944 \"Song of Russia\".", "They were all pieces of wartime propaganda, officially approved and encouraged by the U.S. government, which wanted to keep the alliance with the Soviets strong.", "The films would prove painfully embarrassing to their producers just a few years later, when the U.S. went back to treating the Soviet Union as an adversary." ] ], "gold": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The story is about a boy growing up during World War II in Berlin in 1944.", "prediction 1": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The plot centers on Russian youths in the path of the German army's assault on Stalingrad, who are forced to band together and rely on themselves to survive. The actual Battle of Stalingrad ended at the beginning of February 1943. The Boy in the Striped Pyjamas is a 2008 American film.\n", "prediction 2": "Writing of the 2006 book The Boy in the Striped Pyjamas, John Boyne spent two and a half days writing the first draft of The Boy in the Striped Pyjamas. Writing of the 2006 film, the same name, was done as early as 1940. Writing of the 2006 book, the same name was used in the film version in 2008.", "prediction 3": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. It is about a 9-year-old boy growing up during World War II in Berlin. The novel was adapted in 2008 as a film of the same name. The Boy from Stalingrad is a 1943 American wartime film. The actual Battle of Stalingrad ended at the beginning of February 1943.", "prediction 4": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. The novel centers on a 9-year-old boy living in Berlin during World War II. The actual Battle of Stalingrad ended at the beginning of February 1943. The movie of the same name, The Boy from Stalingrad, is a 1943 American film.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 374 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Boy in the Striped Pyjamas is a 2006 Holocaust novel by Irish novelist John Boyne. It is about a boy growing up during World War II in Berlin.\n" }, "preference": [ 1, 1, 1, 2, 2, 0 ] }, { "question": "Who came up with the idea of mother's day?", "passages": [ [ "Anna Jarvis", "Jarvis valued the symbolism of such tangible items as the white carnation emblem, which she described as: \n\nJarvis frequently referred to her mother\u2019s memory during her efforts to maintain the sentimental heart of the day while also maintaining her own role as the founder of the holiday.", "In addition to her efforts to maintain her position and recognition as the holiday\u2019s founder, Jarvis struggled against forces of commercialization that overwhelmed her original message.", "Among some of these forces were the confection, floral and greeting card industry.", "The symbols that she had valued for their sentimentality, such as the white carnation, easily became commodified and commercialized.", "By the 1920s, as the floral industry continued increasing prices of white carnations and then introduced red carnations to meet the demand for the flower, Anna Jarvis' original symbols began to become re-appropriated, such as the red carnation representing living mothers and the white carnation honoring deceased mothers.", "She attempted to counter these commercial forces, creating a badge with a Mother\u2019s Day emblem as a less ephemeral alternative to the white carnation.", "Her negative opinion of these commercial forces was evident in her contemporary commentary, saying:\n\nHowever, her efforts to hold on to the original meaning of the day led to her own economic hardship." ], [ "Mothering Sunday", "Mothering Sunday\n\nMothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world.", "It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia.", "It falls on the fourth Sunday in Lent, exactly three weeks before Easter Day.", "Once observed as a day on which people would visit their \"mother\" church, it has become an occasion for honouring the mothers of children and giving them presents.", "It is increasingly being called Mother's Day, although that name properly belongs to the American holiday which is quite distinct from the original Mothering Sunday.", "In the UK and the Republic of Ireland, Mothering Sunday is celebrated in a similar way as Mother's Day is celebrated in the USA.", "During the 16th century, people returned to their mother church for a service to be held on Laetare Sunday; in this context, one's 'mother church' was either the church where one was baptised, or the local parish church, or the nearest cathedral (the latter being the mother church of all the parish churches in a diocese).", "Anyone who did this was commonly said to have gone \"a-mothering\", although whether this term preceded the observance of Mothering Sunday is unclear." ], [ "Mother's Day (United States)", "Mother's Day (United States)\n\nMother's Day in the United States is an annual holiday celebrated on the second Sunday in May.", "Mother's Day recognizes mothers, motherhood and maternal bonds in general, as well as the positive contributions that they make to society.", "It was established by Anna Jarvis, with the first official Mother's Day celebrated at St. Andrew's Methodist Church in Grafton, West Virginia, on May 10, 1908.", "In the United States, Mother's Day complements similar celebrations honoring family members, such as Father's Day, Siblings Day and Grandparents Day.", "Internationally, there are a large variety of Mother's Day celebrations with different origins and traditions, some now also having been influenced by this more recent American tradition.", "During the 19th century, women's peace groups in the United States tried to establish holidays and regular activities in favor of peace and against war.", "A common early activity was the meeting of groups of mothers whose sons had fought or died on opposite sides of the American Civil War.", "In 1868, Ann Jarvis, Anna Jarvis's mother, organised a committee to establish a \"Mother's Friendship Day\", the purpose of which was \"to reunite families that had been divided during the Civil War.\"" ], [ "Mother's Day (United States)", "[The] Holy Church recognizes this, as does Notre Dame especially, and Our Lady who watches over our great institution.\"", "In its present form, Mother's Day was established by Anna Jarvis with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 9, 1905.", "Jarvis never mentioned Howe or Mothering Sunday, and she never mentioned any connection to the Protestant school celebrations, always claiming that the creation of Mother's Day was hers alone.", "A small service was held on May 12, 1907 in the Andrew's Methodist Episcopal Church in Grafton, West Virginia, where Anna's mother had been teaching Sunday school.", "The first \"official\" service was on May 10, 1908, in the same church, accompanied by a larger ceremony in the Wanamaker Auditorium in the Wanamaker's store in Philadelphia.", "The next year the day was reported to be widely celebrated in New York.", "Jarvis then campaigned to establish Mother's Day first as a U.S. national holiday and then later as an international holiday.", "The holiday was declared officially by the state of West Virginia in 1910, and the rest of the states followed quickly." ] ], "gold": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. It was established by Anna Jarvis with the first official celebration on May 10, 1908. By the early 1920's Hallmark Cards and other companies had started selling Mother's Day cards. In Antwerp, Belgium, Frans Van Kuyck, a painter and alderman, is credited with establishing Mother's Day as a result of a campaign. Antwerp celebrates Mother's Day on 15 August, Assumption, but the country of Belgium celebrates it on the second Sunday in May.", "prediction 1": "Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world. It is generally observed in parishes of the Church of England, as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia. It falls on the fourth Sunday in Lent, exactly three weeks before Easter Day. Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. It was established by Anna Jarvis, with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 9, 1905.\n", "prediction 2": "Some human beings have been known to celebrate Mother's Day since at least two different times. The first Mother's Day was established by Anna Jarvis with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 9, 1905. Although several other people also believed in Mother's Day, Anna Jarvis had the more formal idea of it and started celebrations on May 2, 1908.", "prediction 3": "In its present form, Mother's Day was established by Anna Jarvis with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 9, 1905. The holiday began in 1908 as a day on which people would visit their mother church, but changed over the years into a day for honouring the mothers of children and giving them presents. Today, Mothering Sunday is observed in the UK and the Republic of Ireland in a similar way to Mothering Sunday, the day the United States began its founding mother's Day in 1908.", "prediction 4": "In the UK, Mothering Sunday is a holiday celebrated by Catholic and Protestant Christians in the UK and some other parts of the world. It is generally observed in parishes of the Church of England as well as in the rest of the UK and many Anglican parishes throughout the world, especially in Canada and Australia. In 1905, Anna Jarvis, with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 9, 1905. In 1908, the first official Mother's Day was established by Ann Jarvis, with the help of Philadelphia merchant John Wanamaker following the death of her mother, Ann Jarvis, on May 10, 1908, Anna Jarvis never mentioned Howe or Mother's Day and she never mentioned any connection to the Protestant school celebrations, always claiming that the creation of the holiday was hers alone.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 567, "end": 630 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 305, "end": 382 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 5 ] } ], "corrected-prediction": "Mother's Day in the United States is an annual holiday celebrated on the second Sunday in May. It was established by Anna Jarvis, with the help of Philadelphia merchant John Wanamaker. The first \"official\" service was on May 10, 1908.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played the beaver in leave it to beaver?", "passages": [ [ "Beaver Cleaver", "Beaver Cleaver\n\nTheodore \"the Beaver\" Cleaver is the fictional title character in the American television series \"Leave It to Beaver\".", "Originally played by Jerry Mathers, seven-year-old (\"almost eight\") Beaver is the son of June and Ward Cleaver (Barbara Billingsley and Hugh Beaumont) and the brother of 13-year-old Wally Cleaver (Tony Dow).", "The Beaver prefers \"messin' around\" with his pals and reading comic books to attending church or taking dance lessons.", "Most episodes in the series feature the Beaver getting into trouble at home, in school, or around the neighborhood and then receiving timely and appropriate moral instruction from his father regarding his misbehavior.", "\"Leave It to Beaver\" was created by the writers Joe Connelly and Bob Mosher, who found inspiration for dialogue and plot lines among their own children.", "The Beaver was based on Connelly's son Ricky.", "Theodore \"Beaver\" Cleaver was portrayed by Jerry Mathers in the pilot, \"It's a Small World\"; the original series; the spinoff telemovie, \"Still the Beaver\"; and the sequel series, \"The New Leave It to Beaver\"." ], [ "Leave It to Beaver", "Leave It to Beaver\n\nLeave It to Beaver is an American television sitcom about an inquisitive and often na\u00efve boy, Theodore \"The Beaver\" Cleaver (portrayed by Jerry Mathers), and his adventures at home, in school, and around his suburban neighborhood.", "The show also starred Barbara Billingsley and Hugh Beaumont as Beaver's parents, June and Ward Cleaver, and Tony Dow as Beaver's brother Wally.", "The show has attained an iconic status in the United States, with the Cleavers exemplifying the idealized suburban family of the mid-20th century.", "The show was created by the writers Joe Connelly and Bob Mosher.", "These veterans of radio and early television found inspiration for the show's characters, plots and dialogue in the lives, experiences and conversations of their own children.", "\"Leave It to Beaver\" is one of the first primetime sitcom series written from a child's point of view.", "Like several television dramas and sitcoms of the late 1950s and early 1960s (\"Lassie\" and \"My Three Sons\"), \"Leave It to Beaver\" is a glimpse of middle-class American boyhood.", "In a typical episode, Beaver gets into some sort of boyish scrape, then faces his parents for reprimand and correction." ], [ "Leave It to Beaver (film)", "Leave It to Beaver (film)\n\nLeave It to Beaver is a 1997 comedy film adapted from the television series of the same name.", "Many in-jokes related to the series pepper the film.", "It features all the original regular characters, all played by new actors.", "Universal Pictures released the film on August 22, 1997.", "Beaver has his heart set on a bicycle in a store window, but does not think his parents will buy it for him.", "Eddie Haskell tells him if he signs up for football, he will get it on his birthday.", "He joins the football team and endures the practices, despite his disadvantage of being smaller than his teammates.", "Ward is glad Beaver signed up for football, but the first game ends poorly when he passes the ball to a kid on the opposing team, whom he remembered as a friend from summer camp.", "On the first day of school five days later, Ward and June tell Wally to drop Beaver off and pick him up for a few days because he has never ridden his bike there before.", "He has a kind teacher named Miss Landers.", "After school, Eddie asks Wally to come to the soda shop to see him flirt with Karen.", "Eddie does not want the Beaver to follow them, so Wally leaves him alone at the bike rack, telling him he will be back for him." ], [ "Cameron Finley", "Cameron Finley\n\nJoseph Cameron Finley (born August 30, 1987) is an American former child actor.", "While receiving accolades for his work in \"Hope Floats\", \"Baywatch\", \"One True Love\", and \"Perfect Game\", he is most known for his role as Theodore 'Beaver' Cleaver in the 1997 film \"Leave It to Beaver\" based upon the television series by the same name.", "Finley was born in Garland, Texas, the son of Lexa Iann (n\u00e9e Aulgur), a spiritual healer, and Charles David \"Chuck\" Finley, a software developer.", "He has two siblings, Taz and Stopher.", "When he was three, he was taken by his parents to an acting seminar near his home.", "He continued acting until the age of 12, at which time he chose to quit acting so he could go to school full-time and \"be a normal kid\".", "Finley attended Moorpark High School.", "He graduated in 2010 from UC San Diego with a degree in molecular biology.", "He currently resides in Brooklyn, NY.", "Finley starred in his first national commercial, for Shell Oil, \nwhen he was three years old and living with his family in the Dallas suburb of Garland, Texas.", "He also featured in commercials for such companies as Taco Bell, Shout, and Brink's Security." ] ], "gold": "Leave It to Beaver was both a television series between 1957 and 1963 and a film in 1997. The character of Beaver was played by Jerry Mathers in the television series and Cameron Finley in the later film.", "prediction 1": "Theodore \"The Beaver\" Cleaver is the fictional title character in the American television series Leave It to Beaver. Originally played by Jerry Mathers, seven-year-old Beaver is the son of June and Ward Cleaver (Barbara Billingsley and Hugh Beaumont) and the brother of 13-year-old Wally Cleaver (Tony Dow). Leave It to Beaver is a 1997 comedy film adapted from the television series of the same name. Many in-jokes related to the film pepper the film.\n", "prediction 2": "Theodore \"Beaver\" Cleaver is the fictional title character in the American television series Leave It to Beaver. In the original series, Jerry Mathers portrayed Theodore, then seven years old. In the 1997 film, Leave It to Beaver, adapted from the same television series, another actor played Theodore and is called \"Beaver\". It was in this film that American Ex-Child Actor Joseph Cameron Finley played Theodore and is called \"Beaver Heights\".", "prediction 3": "Theodore \"the Beaver\" Cleaver is the fictional title character in the American television series Leave It to Beaver. Originally played by Jerry Mathers, seven-year-old, \"almost eight\" Beaver is the son of June and Ward Cleaver and the brother of 13-year-old Wally Cleaver. Leave It to Beaver is based on Joe Connelly's son Ricky. Leave It to Beaver is also a 1997 comedy film adapted from the television series of the same name.", "prediction 4": "Leave It to Beaver is an American television sitcom about an inquisitive and often nave boy, Theodore \"The Beaver\" Cleaver, and his adventures at home, in school, and around his suburban Manhattan neighborhood. Mainly the character was played by Jerry Mathers for the first four seasons of the show. The 1998 film adaptation of the television show was directed by Dave Thomas and produced by Joe Connelly and Bob Mosher. In the 1997 film, Cameron Finley played the character.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 32 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 453 }, { "error type": "Redundant", "explanation": "Theodore \"The Beaver\" Cleaver is the fictional title character in the American television series Leave It to Beaver. ", "start": 308, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 349, "end": 401 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "The fictional title character in the American television series Leave It to Beaver was originally played by Jerry Mathers and Cameron Finley in the 1997 comedy film. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang you got a hold on me?", "passages": [ [ "You've Really Got a Hold on Me", "It was also chosen for the soundtrack of the award-winning 1964 Ivan Dixon film, \"Nothing But a Man\", and many others (see below).", "Smokey Robinson himself also performed a rewritten version of it on \"Sesame Street\" alongside a grabby, feminine-looking Muppet letter \"U\", who wouldn't stop trying to grab Smokey, with such lyrics as \"U stands for uptight/That's how I'm feelin'/Bein' grabbed by a letter is/Unappealin'\".", "The Miracles performed the song on a 1964 telecast of the ABC television series \"Shindig!", "\", and in 1983, the group also performed it, 21 years after they originally recorded it, on the Emmy-winning NBC Television special, \"\".", "Reference: IMDb\n\nThe Miracles\n\n\"You Really Got a Hold on Me\" was the first track recorded for the Beatles' second United Kingdom LP, \"With the Beatles\", and features John Lennon and George Harrison on lead vocals with Paul McCartney on harmony vocals.", "The Beatles acquired an imported copy by the Miracles and included it in their repertoire early in 1963.", "In a 1968 interview, Smokey Robinson reported that he liked their cover.", "The Beatles recorded the song on July 18, 1963." ], [ "You've Really Got a Hold on Me", "You've Really Got a Hold on Me\n\n\"You've Really Got a Hold on Me\" is a song written by Smokey Robinson which became a 1962 Top 10 hit single for The Miracles on Motown's Tamla label.", "One of the Miracles' most covered tunes, this million-selling song received a 1998 Grammy Hall of Fame Award.", "It has also been selected as one of The Rock and Roll Hall of Fame's 500 Songs that Shaped Rock and Roll.", "It was covered by English rock group the Beatles on their second album, \"With the Beatles\" and many other musicians.", "\"You've Really Got a Hold On Me\" was written by Smokey Robinson while in New York in 1962 on business for Motown; he heard Sam Cooke's \"Bring It On Home to Me\", which was in the charts at the time, and \u2014 influenced by it \u2014 wrote the song in his hotel room.", "The song was recorded in Motown's Studio A on October 16, 1962 with Robinson on lead vocals, and Miracles' second tenor Bobby Rogers on harmony co-lead.", "Robinson was the producer, and he had Eddie Willis and Miracle Marv Tarplin share the guitar parts.", "The song was released on the Tamla label on November 9, 1962 as the B side to \"Happy Landing\"." ] ], "gold": "\"You've Really Got a Hold on Me\" is a song written by Smokey Robinson, which became a 1962 Top 10 hit single for the Miracles. The song was recorded in Motown's Studio A on October 16, 1962 with Robinson on lead vocals, and Miracles' second tenor Bobby Rogers on harmony co-lead. It was covered by English rock group the Beatles on their second album, \"With the Beatles\", in 1963.", "prediction 1": "\"You've Really Got a Hold on Me\" is a song written by Smokey Robinson which became a 1962 Top 10 hit single for The Miracles on Motown's Tamla label. It was covered by English rock group the Beatles on their second album, \"With the Beatles\", and many other musicians.", "prediction 2": "You've Really Got a Hold on Me is a song written by Smokey Robinson which became a 1962 Top 10 hit single for The Miracles on Motown's Tamla label. The song was covered by English rock group the Beatles on their second album, With the Beatles, and many other musicians. John Mayer penned a song called You've Gotta Get It On Me for the movie Nothing But a Man, which was released in 1964. The Miracles performed the song on a 1964 telecast of the ABC television series Shindig!", "prediction 3": "\"You've Really Got a Hold on Me\" is a song written and recorded by Smokey Robinson and released by Motown in 1962. It was a 1962 Top 10 hit single for The Miracles on the Motown's Tamla label. It was covered by English rock group the Beatles on their second album, \"With the Beatles\" and many other musicians. In 1963, the show Searching for Sugar Man aired a version of the song that Robinson wrote for his show. In 1984, the show also aired the Century.", "prediction 4": "\"You've Really Got a Hold On Me\" is a song written by Smokey Robinson, which became a 1962 Top 10 hit single for The Miracles on Motown's Tamla label. The group performed the song on a 1964 telecast of the ABC television series Shindig!, and in 1983, the group also performed it, 21 years after they originally recorded it, on the Emmy-winning NBC Television special, \"The Magicians.\" The song was covered by English rock group the Beatles on their second album, With the Beatles, and many other musicians.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 242, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 149 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "\"You've Really Got a Hold on Me\" is a song written by Smokey Robinson which became a 1962 Top 10 hit single for The Miracles. The song was recorded in Motown's Studio A on October 16, 1962 with Robinson on lead vocals, and Miracles' second tenor Bobby Rogers on harmony co-lead. It was covered by English rock group the Beatles on their second album, \"With the Beatles\", in 1963." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "What are the hannibal lecter movies in order?", "passages": [ [ "Hannibal Lecter (franchise)", "Hannibal Lecter (franchise)\n\n", "The \"Hannibal Lecter\" franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels (starting with \"Red Dragon\" in 1981) by Thomas Harris.", "The series has since expanded into film and television.", "The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann.", "The next adaptation was 1991's \"The Silence of the Lambs\", which was directed by Jonathan Demme and was the first film to feature Anthony Hopkins in the role of Hannibal Lecter.", "\"Silence\" was a success, both critically and financially, and went on to become the third film in Academy Awards history to win in all top five categories (Best Actor for Hopkins, Best Actress for Jodie Foster, Best Director for Demme, Best Adapted Screenplay for Ted Tally, and Best Picture).", "Hopkins reprised the role in the next two films, 2001's \"Hannibal\", a sequel directed by Ridley Scott, and 2002's \"Red Dragon\", a prequel directed by Brett Ratner.", "In 2002, Hopkins revealed that he had written a screenplay for another sequel, ending with Clarice killing Lecter but it was not produced.", "In 2007, \"Hannibal Rising\" was released." ] ], "gold": "The Hannibal Lecter is an American media franchise based around the titular character, Hannibal Lecter, a brilliant, cannibalistic serial killer whose assistance is routinely sought out by law enforcement personnel to aid in the capture of other criminals. He originally appeared in a series of novels, starting with Red Dragon in 1981, by Thomas Harris. The series has since expanded into film and television. There are five films, Manhunter, The Silence of the Lambs, Hannibal, Red Dragon, and Hannibal Rising. ", "prediction 1": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels, starting with \"Red Dragon\" in 1981, by Thomas Harris. The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann. The next adaptation was 1991's \"The Silence of the Lambs\", which was the first film to feature Anthony Hopkins in the role of Hannibal Lecter. The next two films were 2001's \"Hannibal\", a sequel directed by Ridley Scott, and 2002's \"Red Dragon\", a prequel directed by Brett Ratner. In 2007, \"Hannibal Rising\" was released.\n", "prediction 2": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels, starting with \"Red Dragon\" in 1981, by Thomas Harris. The films' chronological order is: 1986's Manhunter, 1991's The Silence of the Lambs, 2001's Hannibal, a sequel directed by Ridley Scott, and 2002's Red Dragon, a prequel directed by Brett Ratner. In 2007, \"Hannibal Rising\" was released.", "prediction 3": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels, starting with Red Dragon in 1981, by Thomas Harris. Of those, 2001's films are Hannibal 2, 2001's Hannibal 3, and 2002's Hannibal 5. In 2008, Hannibal Rising was released.", "prediction 4": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of books, starting with \"Red Dragon\" in 1981 by Thomas Harris. The first adaptation was the 1986 film \"Manhunter\", which was an adaptation of \"Red Dragon\", directed by Michael Mann. The next adaptation was 1991's \"The Silence of the Lambs\", which was the first film to feature Anthony Hopkins in the role of Hannibal Lecter. Anthony Hopkins reprised the role in the next two films, 2001's \"Hannibal\", a sequel directed by Ridley Scott, and 2002's \"Red Dragon\", a prequel directed by Brett Ratner. In 2007, \"Hannibal Rising\" was released.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 309, "end": 334 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 477 }, { "error type": "Irrelevant", "explanation": "", "start": 502, "end": 508 }, { "error type": "Irrelevant", "explanation": "", "start": 521, "end": 555 }, { "error type": "Irrelevant", "explanation": "", "start": 560, "end": 566 }, { "error type": "Irrelevant", "explanation": "", "start": 581, "end": 616 }, { "error type": "Irrelevant", "explanation": "", "start": 617, "end": 625 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 365 } ], "missing-info": [], "corrected-prediction": "The Hannibal Lecter franchise is an American media franchise that features the titular character, Hannibal Lecter, who originally appeared in a series of novels, starting with \"Red Dragon\" in 1981, by Thomas Harris. The first film \"Manhunter\". The next \"The Silence of the Lambs\". The next two films were \"Hannibal\", and \"Red Dragon\". Last \"Hannibal Rising\" was released.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When was the last time world cup was in us?", "passages": [ [ "1994 FIFA World Cup", "1994 FIFA World Cup\n\nThe 1994 FIFA World Cup was the 15th FIFA World Cup, held in nine cities across the United States from 17 June to 17 July 1994.", "The United States was chosen as the host by FIFA on 4 July 1988.", "Despite the host nation's lack of football tradition, the tournament was the most financially successful in World Cup history; aided by the high-capacity stadia in the United States, it broke the World Cup average attendance record with nearly 69,000 spectators per game, a mark that still stands.", "The total attendance of nearly 3.6\u00a0million for the final tournament remains the highest in World Cup history, despite the expansion of the competition from 24 to 32 teams (and from 52 to 64 games), which was first introduced at the 1998 World Cup and is the current format.", "Brazil won the tournament after beating Italy 3\u20132 in a penalty shoot-out at the Rose Bowl in Pasadena, California near Los Angeles, after the game had ended 0\u20130 after extra time.", "It was the first World Cup final to be decided on penalties.", "The victory made Brazil the first nation to win four World Cup titles." ], [ "2003 FIFA Women's World Cup", "2003 FIFA Women's World Cup\n\nThe 2003 FIFA Women's World Cup, the fourth edition of the FIFA Women's World Cup, was held in the United States and won by Germany.", "They won their first women's world title and became the first country to win both men's and women's World Cup.", "The men's team had won the World Cup three times at the time.", "The tournament was originally scheduled for China from 23 September to 11 October.", "On 3 May 2003, FIFA announced that they would move the tournament to an alternate host country because of the 2003 SARS outbreak in China.", "At the same time the FIFA announced that the 2007 FIFA Women's World Cup would be awarded to China in its place.", "On 26 May 2003, FIFA announced the United States would host the tournament.", "Because the United States had hosted the 1999 World Cup, it was thought the United States could best organize the tournament in the little time remaining before the October scheduled start.", "In addition, women's soccer boosters in the United States hoped that interest generated by the tournament would save the U.S. women's professional league, the Women's United Soccer Association, from folding.", "In compensation for losing the tournament, China retained its automatic qualification as host, and was named as host for the 2007 event." ] ], "gold": "The 1994 FIFA World Cup was the last Men's World Cup hosted by the United States. It was held from June 17 to July 17, 1994. The 2003 FIFA Women's World Cup was the last Women's World Cup held in the United States. It was played from 20 September to 12 October 2003.", "prediction 1": "The United States hosted the FIFA Women's World Cup in 2003, and the Men's World Cup in 2004. The United States was chosen as the host nation by FIFA on 4 July 1988.\n", "prediction 2": "The United States has hosted several World Cup tournaments, including the 1994 FIFA World Cup, the 2003 FIFA Women's World Cup, and the 2007 FIFA Women's World Cup. The last time the United States hosted a World Cup was in 2003.", "prediction 3": "The history of the World Cup can be seen in the pages of the FIFA website and in the pages of local newspapers from 1927 to 1998. The last time a World Cup was in the United States was 2002, when Mexico won the tournament. The last time a World Cup was in the U.S. in 2003 was when Germany won their first women's world title and was the first country to win both men's and women's World Cups.", "prediction 4": "The 1994 FIFA World Cup was the 15th FIFA World Cup, held in 9 cities across the United States from 17 June to 17 July 1994. The United States was chosen as the host by FIFA on 4 July 1988. The following year the United States hosted the FIFA Women's World Cup for the second time, in 2003, where Germany won their first women's world title and became the first country to win both men's and women's World Cups.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 94, "end": 166 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 88, "end": 93 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States hosted the FIFA Women's World Cup in 2003, and the Men's World Cup in 1994. The Men's World Cup was held from 17 June to 17 July, 1994.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sang if i had a hammer first?", "passages": [ [ "If I Had a Hammer", "If I Had a Hammer\n\n\"If I Had a Hammer (The Hammer Song)\" is a song written by Pete Seeger and Lee Hays.", "It was written in 1949 in support of the progressive movement, and was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman.", "It was a number 10 hit for Peter, Paul and Mary in 1962 and then went to number three a year later when recorded by Trini Lopez.", "The Weavers released the song under the title \"The Hammer Song\" as a 78 single in March 1950 on Hootenanny Records, 101-A, backed with \"Banks of Marble\".", "The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating the overthrow of the U.S. government.", "It was not particularly successful in commercial terms when it was first released.", "It was part of the three songs Seeger played as the warm-up act for Paul Robeson's September 4 concert near Peekskill, New York, which subsequently erupted into a riot." ] ], "gold": "If I Had a Hammer was first recorded by The Weavers, a folk music quartet composed of Peter Seeger, Lee Hays, Ronnie Gilbert and Fred Hellerman. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949 at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating for the overthrow of the U.S. government.", "prediction 1": "If I Had a Hammer is a song written by Pete Seeger and Lee Hays. It was written in 1949 in support of the progressive movement, and was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman. It was a number 10 hit for Peter, Paul and Mary in 1962 and then went to number three a year later when recorded by Trini Lopez. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating the overthrow of the U.S.\n", "prediction 2": "\"If I Had a Hammer\" is a song written by Pete Seeger and Lee Hays. It was written in 1949 in support of the progressive movement, and was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman. It was a number 10 hit for Peter, Paul and Mary in 1962 and then went to number three a year later when recorded by Trini Lopez. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating the overthrow of the U.S. government.", "prediction 3": "\"If I Had a Hammer (The Hammer Song)\" is a song written by Pete Seeger and Lee Hays. It was written in 1949 in support of the progressive movement. It was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman, and was a number 10 hit for Peter, Paul and Mary in 1962. It went to number three in 1963 when recorded by Trini Lopez. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of United States, who were then on trial in federal court, charged with violating the Smith Act by advocating for the overthrow of U.S.", "prediction 4": "\"If I Had a Hammer (The Hammer Song)\" is a song written by Pete Seeger and Lee Hays. It was written in 1949 in support of the progressive movement, and was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman. It was a number 10 hit for Peter, Paul and Mary in 1962 and then went to number three a year later when recorded by Trini Lopez. It was not particularly successful in commercial terms when it was first released. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating the overthrow of the U.S. government.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 65, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 378 } ], "missing-info": [], "corrected-prediction": "If I Had a Hammer was first recorded by The Weavers, a folk music quartet composed of Seeger, Hays, Ronnie Gilbert, and Fred Hellerman. The song was first performed publicly by Pete Seeger and Lee Hays on June 3, 1949, at St. Nicholas Arena in New York City at a testimonial dinner for the leaders of the Communist Party of the United States, who were then on trial in federal court, charged with violating the Smith Act by advocating the overthrow of the U.S government.\n" }, "preference": [ 0, 1, 0, 1, 0, 2 ] }, { "question": "Where is superoxide dismutase found in the body?", "passages": [ [ "Superoxide dismutase", "Mn-SOD is present in mitochondria and peroxisomes.", "Fe-SOD has been found mainly in chloroplasts but has also been detected in peroxisomes, and CuZn-SOD has been localized in cytosol, chloroplasts, peroxisomes, and apoplast.", "Three forms of superoxide dismutase are present in humans, in all other mammals, and most chordates.", "SOD1 is located in the cytoplasm, SOD2 in the mitochondria, and SOD3 is extracellular.", "The first is a dimer (consists of two units), whereas the others are tetramers (four subunits).", "SOD1 and SOD3 contain copper and zinc, whereas SOD2, the mitochondrial enzyme, has manganese in its reactive centre.", "The genes are located on chromosomes 21, 6, and 4, respectively (21q22.1, 6q25.3 and 4p15.3-p15.1).", "In higher plants, superoxide dismutase enzymes (SODs) act as antioxidants and protect cellular components from being oxidized by reactive oxygen species (ROS)." ], [ "Superoxide dismutase", "Diminished SOD3 activity has been linked to lung diseases such as Acute Respiratory Distress Syndrome (ARDS) or Chronic obstructive pulmonary disease (COPD).", "Superoxide dismutase is also not expressed in neural crest cells in the developing fetus.", "Hence, high levels of free radicals can cause damage to them and induce dysraphic anomalies (neural tube defects).", "A cross-sectional study in humans suggests that serum SOD could be a marker of cardiovascular alterations in hypertensive and diabetic patients, since changes in its serum levels are correlated with alterations in vascular structure and function.", "SOD has powerful antinflammatory activity.", "For example, SOD is a highly effective experimental treatment of chronic inflammation in colitis.", "Treatment with SOD decreases reactive oxygen species generation and oxidative stress and, thus, inhibits endothelial activation.", "Therefore, such antioxidants may be important new therapies for the treatment of inflammatory bowel disease.", "Likewise, SOD has multiple pharmacological activities.", "E.g., it ameliorates cis-platinum-induced nephrotoxicity in rodents." ], [ "Cytoplasm", "Cytoplasm\n\nIn cell biology, the cytoplasm is all of the material within a cell, enclosed by the cell membrane, except for the cell nucleus.", "The material inside the nucleus and contained within the nuclear membrane is termed the nucleoplasm.", "The main components of the cytoplasm are cytosol \u2013 a gel-like substance, the organelles \u2013 the cell's internal sub-structures, and various cytoplasmic inclusions.", "The cytoplasm is about 80% water and usually colorless.", "The submicroscopic ground cell substance, or cytoplasmatic matrix which remains after exclusion the cell organelles and particles is groundplasm.", "It is the hyaloplasm of light microscopy, and high complex, polyphasic system in which all of resolvable cytoplasmic elements of are suspended, including the larger organelles such as the ribosomes, mitochondria, the plant plastids, lipid droplets, and vacuoles.", "Most cellular activities take place within the cytoplasm, such as many metabolic pathways including glycolysis, and processes such as cell division.", "The concentrated inner area is called the endoplasm and the outer layer is called the cell cortex or the ectoplasm." ], [ "Mitochondrion", "Mitochondrion\n\nThe mitochondrion (plural mitochondria) is a double-membrane-bound organelle found in most eukaryotic organisms.", "Some cells in some multicellular organisms may, however, lack them (for example, mature mammalian red blood cells).", "A number of unicellular organisms, such as microsporidia, parabasalids, and diplomonads, have also reduced or transformed their mitochondria into other structures.", "To date, only one eukaryote, \"Monocercomonoides\", is known to have completely lost its mitochondria.", "The word mitochondrion comes from the Greek , , \"thread\", and , , \"granule\" or \"grain-like\".", "Mitochondria generate most of the cell's supply of adenosine triphosphate (ATP), used as a source of chemical energy.", "Mitochondria are commonly between 0.75 and 3\u00a0\u03bcm in diameter but vary considerably in size and structure.", "Unless specifically stained, they are not visible.", "In addition to supplying cellular energy, mitochondria are involved in other tasks, such as signaling, cellular differentiation, and cell death, as well as maintaining control of the cell cycle and cell growth.", "Mitochondrial biogenesis is in turn temporally coordinated with these cellular processes." ], [ "Extracellular", "Extracellular\n\nIn cell biology, molecular biology and related fields, the word extracellular (or sometimes extracellular space) means \"outside the cell\".", "This space is usually taken to be outside the plasma membranes, and occupied by fluid (see extracellular matrix).", "The term is used in contrast to intracellular (inside the cell).", "According to the Gene Ontology, the extracellular space is a cellular component defined as: \"That part of a multicellular organism outside the cells proper, usually taken to be outside the plasma membranes, and occupied by fluid.", "For multicellular organisms, the extracellular space refers to everything outside a cell, but still within the organism (excluding the extracellular matrix).", "Gene products from a multi-cellular organism that are secreted from a cell into the interstitial fluid or blood can therefore be annotated to this term\".", "The composition of the extracellular space includes metabolites, ions, various proteins and non-protein substances (e.g. DNA, RNA, lipids, microbial products etc.) that might affect cellular function.", "For example, hormones, growth factors, cytokines and chemokines act by travelling the extracellular space towards biochemical receptors on cells." ], [ "SOD1", "SOD1\n\nSuperoxide dismutase [Cu-Zn] also known as superoxide dismutase 1 or SOD1 is an enzyme that in humans is encoded by the \"SOD1\" gene, located on chromosome 21.", "SOD1 is one of three human superoxide dismutases.", "It is implicated in apoptosis and amyotrophic lateral sclerosis.", "SOD1 is a 32 kDa homodimer which forms a \u03b2-barrel and contains an intramolecular disulfide bond and a binuclear Cu/Zn site in each subunit.", "This Cu/Zn site holds the copper and a zinc ion and is responsible for catalyzing the disproportionation of superoxide to hydrogen peroxide and dioxygen.", "The maturation process of this protein is complex and not fully understood, involving the selective binding of copper and zinc ions, formation of the intra-subunit disulfide bond between Cys-57 and Cys-146, and dimerization of the two subunits.", "The copper chaperone for Sod1 (CCS) facilitates copper insertion and disulfide oxidation." ] ], "gold": "Three forms of superoxide dismutase are present in humans, in all other mammals, and in most chordates, SOD1, SOD2, and SOD3, each located in a different part of the body. Superoxide dismutase 1, or SOD1, is located in the cytoplasm, the material within a eukaryotic cell enclosed by the cell membrane except for the cell nucleus. SOD2 is found in the mitochondria, an organelle found in most eukaryotic organisms. Finally, SOD3 is extracellular, meaning it occurs in the space outside the plasma membrane of a cell.", "prediction 1": "Superoxide dismutase is found in the cytoplasm, mitochondria, and apoplast. In higher plants, superoxide dismutase enzymes (SODs) act as antioxidants and protect cellular components from being oxidized by reactive oxygen species.\n", "prediction 2": "Superoxide dismutase is found in all cells, except those with mitochondria. It is also found in chloroplasts, peroxisomes, and the apoplast. Three forms of superoxide dismutase are present in humans, in all other mammals, and most chordates. SOD1 is located in the cytoplasm, SOD2 in the mitochondria, and SOD3 is extracellular.", "prediction 3": "SOD is found in the cytoplasm, mitochondria, and peroxisomes, while SOD3 is found extracellularly. In plant cells, SODs act as antioxidants and protect cellular components from being oxidized by reactive oxygen species. And, in chordates, SOD is not expressed in neural crest cells in the developing fetus.", "prediction 4": "In the body, superoxide dismutase is found in the cytoplasm, where it acts as an antioxidant and protects cellular components from being oxidized by reactive oxygen species. It also exists in the mitochondria where it acts as an enzyme.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 76, "end": 230 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 62, "end": 75 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 4 ] } ], "corrected-prediction": "Three forms of superoxide dismutase are present in humans, in all other mammals, and in most chordates. Superoxide dismutase 1 or SOD1 is found in the cytoplasm, the material within a cell, enclosed by the cell membrane, except for the cell nucleus. SOD2 is found in the mitochondria, organelle found in most eukaryotic organisms. SOD3 is extracellular, meaning it occurs in the space outside the plasma membrane of a cell." }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who sang the original song if tomorrow never comes?", "passages": [ [ "If Tomorrow Never Comes", "If Tomorrow Never Comes\n\n\"If Tomorrow Never Comes\" is a song recorded by American country music artist Garth Brooks.", "Written by Brooks and Kent Blazy, it was released in August 1989 as the second single from his album \"Garth Brooks\" and also appears on \"The Hits\", \"The Limited Series\" and \"Double Live\".", "This was his first #1 single on the Billboard Country Singles chart.", "It is also sometimes referred to as his signature song.", "\"If Tomorrow Never Comes\" was named Favorite Country Single in the American Music Awards of 1991.", "It has subsequently become one of Brooks' most popular songs for other artists to perform.", "The song has been covered by several artists, including Ronan Keating, who took it to Number 1 in the UK Singles Chart in May 2002.", "This is the first country love song released by Brooks.", "A man lies awake at night, thinking what would happen in his love's mind if he were to die the next day.", "The first line in the chorus reads: \"\"If tomorrow never comes, will she know how much I love her?\"\" He goes on to compare this situation with his own lost loved ones, and how he made a promise to say each day how much she means to him.", "The song begins with a soft guitar solo and gradually builds up to a more orchestrated accompaniment.", "Brooks has written many love songs since." ], [ "I Don't Care (If Tomorrow Never Comes)", "I Don't Care (If Tomorrow Never Comes)\n\n\"I Don't Care (If Tomorrow Never Comes)\" is a song written and originally recorded by Hank Williams.", "It was the B-side of the single release, \"My Love for You (Has Turned to Hate)\", on Sterling Records.", "\"I Don't Care (If Tomorrow Never Comes)\" was one of four Hank Williams songs recorded by singer Molly O'Day in 1946 and 1947 that appeared in Williams' self-published song folios in 1945 and 1946.", "The song, a lament about a lost love, was recorded at Williams' second and final Sterling recording session on February 13, 1947 with Tommy Jackson (fiddle), Dale \"Smokey\" Lohman (steel guitar), Zeke Turner (electric guitar), and Louis Innis (bass).", "As Colin Escott observes, Hank and producer Fred Rose were beginning to hone the sound that would make Hank a country superstar:\n\nBonnie Owens recorded the song in 1969.", "In 1981, Hank Williams, Jr. released the song as a duet with George Jones on his album \"The Pressure Is On\"." ], [ "If Tomorrow Never Comes", "This song is about The love of a father to his daughter.", "Not to his lover.", "Garth said that on stage at Belmont University to Britt Todd and in his music video he has his daughter playing next to him while he sings.", "Garth provided the following background information on the song in the CD booklet liner notes from \"The Hits\": \n\n\"\"'If Tomorrow Never Comes\" will probably always be my signature song.", "I ran the idea for this song by what seemed like a thousand writers and no one really seemed to understand what I was looking for.", "On the day that Bob Doyle, my co-manager, introduced me to Kent Blazy, I passed this idea by Kent and he had the first verse down within fifteen seconds.", "I could tell he just felt it.", "Kent Blazy is a wonderful man, full of love and energy, and if we never write again, I hope that we are always friends first.", "Thank you Ireland for this moment.\"\"", "Throughout the music video for the song, Brooks is seen playing his guitar in a dim room.", "Next to him is a table with an antique oil lamp on it.", "The video constantly cuts to a small child, played by the daughter of Steve Gatlin, brother of Larry Gatlin.", "She is the subject of the song in this case." ] ], "gold": "Hank Williams wrote and originally recorded the song I Don't Care (If Tomorrow Never Comes) in 1947, which is about a lost love. Another Country music artist, Garth Brooks, originally recorded the song If Tomorrow Never Comes, which was released in 1989. Garth Brook's song is about the love of a father for his daughter. Although the songs have similar titles, they are not the same song.", "prediction 1": "If Tomorrow Never Comes is a song written and originally recorded by Hank Williams. It was the B-side of the single release, My Love for You (Has Turned to Hate), on Sterling Records. The song, a lament about a lost love, was recorded at Williams' second and final Sterling recording session on February 13, 1947 with Tommy Jackson, Molly O'Day, Zeke Turner, and Louis Innis. In 1981, Hank Williams, Jr. released the song as a duet with George Jones on his album The Pressure Is On.\n", "prediction 2": "There is more than one \"If Tomorrow Never Comes\" song: one by Hank Williams, one by Keith Richards, and one by Garth Brooks. American country music artist Garth Brooks sang the original \"If Tomorrow Never Comes\", the song written by Brooks and Kent Blazy. The song began with a simple guitar solo and gradually built up to a more orchestrated accompaniment. Another \"If Tomorrow Never Comes\" is a song written and originally recorded by Hank Williams. It was the B-side of the single release, \"My Love for You (Has Turned to Hate). It was the a lament about a lost love that was recorded at Williams' second and final Sterling recording session on February 13, 1947 that appeared in Williams' self-published song folios in 1946.", "prediction 3": "There are several if tomorrow never comes. The song, If tomorrow never comes, is a lament about a lost love and was originally performed by Hank Williams. The song, a lament about a lost love, was originally performed by Gerard Butler & The Monsters. Garth Brooks sang the original if tomorrow never comes. It was sung by Brooks and Kent Blazy and released in August 1989.", "prediction 4": "If Tomorrow Never Comes is a 1945 song written and originally recorded by Hank Williams. The song, a lament about a lost love, was recorded by Hank Williams, Jr. and was also performed by his fellow country music artist Molly O'Day. Hank Williams, Jr. sang the original song If Tomorrow Never Comes, and in 1981, Hank Williams, Jr. released the song as a duet with George Jones on his album The Pressure Is On. American country music artist Garth Brooks sang the original song If Tomorrow Never Comes. This song was written by Garth Brooks and Kent Blazy.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 183 }, { "error type": "Irrelevant", "explanation": "", "start": 235, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 375 }, { "error type": "Irrelevant", "explanation": "", "start": 376, "end": 483 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "If Tomorrow Never Comes is a song written and originally recorded by Hank Williams. The song a lament about a lost love, was recorded 1947. Country music artist, Garth Brooks, originally recorded the song If Tomorrow Never Comes, which was released in 1989. This song is about The love of a father to his daughter." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who won the great food truck race in 2017?", "passages": [ [ "The Great Food Truck Race", "The Great Food Truck Race\n\nThe Great Food Truck Race is a reality television and cooking series that originally aired on August 15, 2010, on Food Network, with Tyler Florence as the host.", "Billed as a cross between Cannonball Run and Top Chef, this late summer show features several competing teams of three who drive across the United States in their food trucks and make stops every week to sell food in different cities.", "Every season, between six and eight food truck teams compete in a race where they must cook, sell, and adapt to different challenges in the hopes of winning $50,000 (and in some cases, their very own food truck).", "Starting off on the west coast and driving east, every week the food truck that makes the least profit is eliminated and sent home, while the rest of the food trucks continue on to the next city.", "They're usually given \"seed money\" at the beginning of each episode that goes towards grocery shopping.", "The teams are assigned different challenges every week for a chance to earn more money (usually in the form of selling the most of a special dish or making a version of a local delicacy for Tyler and a guest judge).", "They're also thrown obstacles that hinder their ability to make normal sales (for example, switching their menu to vegan food or being unable to restock supplies for the day)." ], [ "Food Network Star (season 9)", "Food Network Star (season 9)\n\n", "The ninth season of the American reality television series \"Food Network Star\" premiered Sunday, June 2, 2013.", "Season 9 continued the season 8 concept of having Bobby Flay, Giada De Laurentiis, and Alton Brown mentor the contestants, but dropped the specific assignments of teams to mentors, and the final elimination challenge between the bottom contestants.", "Season 9 also featured 12 contestants, down from 15 in season 8.", "\"(In order of elimination)\"\n\nAt least six competitors have appeared on other Food Network programs.", "Pham defeated Bobby Flay on Iron Chef America and also competed on Extreme Chef.", "Lysek and Henry appeared on \"Chopped\"; both were eliminated before the final round.", "Henry also appeared on Throwdown with Bobby Flay, while Lysek also won during an appearance on 24 Hour Restaurant Battle.", "Poon-Kinney appeared on \"Restaurant Impossible\", where Robert Irvine gave her family's restaurant a makeover.", "Hodgson competed on \"The Great Food Truck Race\"; his truck, Hodge Podge, was a runner-up on season 2.", "Prior to the announcement of the Mentors Challenge, Robert Irvine announced the winner of the Star Salvation was Lovely, who returned to the competition." ] ], "gold": "The Great Food Truck Race is a reality television and cooking series in which food truck teams compete in a race where they must cook, sell, and adapt to challenges. Season eight took place in 2017 and was billed as a Battle for the South. Braised in the South was the season winning truck. The winning chefs were Nick, Steven, and Brandon. ", "prediction 1": "The Great Food Truck Race is a reality television and cooking series that originally aired on August 15, 2010, on Food Network, with Tyler Florence as the host. In 2017, Lovely won the competition. In 2016, Tyler Florence won the competition. In 2017, Tyler Florence won the competition.\n", "prediction 2": "The Great Food Truck Race is a reality television and cooking series that originally aired on August 15, 2010, on Food Network, with Tyler Florence as the host. In 2017, Lovely, the owner of Merciful's will win the 66th installment of the Great Food Truck Race.", "prediction 3": "The Great Food Truck Race is a reality television and cooking series that originally aired on August 15, 2010, on Food Network, with Tyler Florence as the host. In 2017, David Perry won the Great Food Truck Race for the sixth time, while Lovely won the 2017 Great Food Truck Race for the eighth time.", "prediction 4": "The Great Food Truck Race is a reality television and cooking series that originally aired on August 15, 2010, on Food Network, with Tyler Florence as the host. In season 19, Lovely won the mentors challenge, while Raynor Hodgson won the truck challenge.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 160 }, { "error type": "Unverifiable", "explanation": "", "start": 161, "end": 197 }, { "error type": "Unverifiable", "explanation": "", "start": 198, "end": 242 }, { "error type": "Unverifiable", "explanation": "", "start": 243, "end": 288 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Great Food Truck Race is a reality television and cooking series. The food truck teams compete in a race where they must cook, sell, and adapt to different challenges.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What was the last year jeep liberty was made?", "passages": [ [ "Jeep Liberty", "Jeep Liberty\n\nThe Jeep Liberty, or Jeep Cherokee (KJ/KK) outside North America, is a compact SUV that was produced by Jeep for the model years 2002\u20132012.", "Introduced as a replacement for the Cherokee (XJ), the Liberty was priced between the Wrangler and Grand Cherokee.", "It was the smallest of the 4-door Jeep SUVs until the car based 4-door Compass and Patriot arrived for 2007.", "Like the XJ Cherokee, the Liberty featured unibody-construction.", "It was assembled at the Toledo North Assembly Plant in the United States, as well as in other countries including Egypt and Venezuela.", "The Liberty ceased production on August 16, 2012.", "The next generation restored the previous nameplate of Jeep Cherokee that was always used outside of North America.", "Inspired by styling from the \"Dakar\" and \"Jeepster\" concept vehicles, the Liberty was intended as a replacement for the discontinued Jeep Cherokee.", "The Liberty also marked a few firsts for Jeep.", "It was the first Jeep vehicle to use rack and pinion steering.", "It's also the first Jeep to use the two then-new \"PowerTech\" engines; the 2.4 L straight-4, which was discontinued in 2006, and the 3.7 L V6, as well as a 2.8 L VM Motori turbo diesel (2005-2006 only) for the CRD versions." ], [ "Chrysler", "On June 10, 2009, Chrysler emerged from the bankruptcy proceedings with the United Auto Workers pension fund, Fiat S.p.A., and the U.S. and Canadian governments as principal owners.", "The bankruptcy resulted in Chrysler defaulting on over $4 billion in debts.", "By May 24, 2011, Chrysler finished repaying its obligations to the U.S. government five years early, although the cost to the American taxpayer was $1.3 billion.", "Over the next few years, Fiat gradually acquired the other parties' shares while removing much of the weight of the loans (which carried a 21% interest rate) in a short period.", "On January 1, 2014, Fiat S.p.A announced a deal to purchase the rest of Chrysler from the United Auto Workers retiree health trust.", "The deal was completed on January 21, 2014, making Chrysler Group a subsidiary of Fiat S.p.A.", "In May 2014, Fiat Chrysler Automobiles, NV was established by merging Fiat S.p.A. into the company.", "This was completed in August 2014.", "Chrysler Group LLC remained a subsidiary until December 15, 2014, when it was renamed FCA US LLC, to reflect the Fiat-Chrysler merger.", "The Chrysler company was founded by Walter Chrysler on June 6, 1925, when the Maxwell Motor Company (est. 1904) was re-organized into the Chrysler Corporation." ] ], "gold": "The Jeep Liberty, or Jeep Cherokee outside North America, is a compact SUV that was produced by Jeep for the model years 2002-2012 for US consumers. The vehicle was made by DaimlerChrysler from 2002-2007. It was made by Chrysler LLC 2007-2009. Chrysler Group LLC then made the vehicle from 2009-2012.", "prediction 1": "The Jeep Liberty, or Jeep Cherokee (KJ/KK) outside North America, is a compact SUV that was produced by Jeep for the model years 2002\u20132012. Introduced as a replacement for the Cherokee (XJ), the Liberty was priced between the Wrangler and Grand Cherokee. The Liberty ceased production on August 16, 2012. The next generation restored the previous nameplate of Jeep Cherokee that was always used outside of North America.\n", "prediction 2": "The Jeep Liberty, or Jeep Cherokee (KJ/KK) outside North America, is a compact SUV that was produced by Jeep for the model years 2002\u20132012. Introduced as a replacement for the Cherokee (XJ), the Liberty was priced between the Wrangler and Grand Cherokee. The Liberty ceased production on August 16, 2012; however, production of the 2013 model year Liberty ceased on November 14, 2015.", "prediction 3": "In 2002, the Jeep Liberty, or Jeep Cherokee (KJ/KK) outside North America, was introduced as a replacement for the discontinued Jeep Cherokee. It was the smallest of the 4-door Jeep SUVs until the car based 4-door Compass and Patriot arrived for 2007 and 2008. It ceased production on August 16, 2012.", "prediction 4": "The Jeep Liberty is a compact SUV that was produced by Jeep for the model years 2002-2012. Introduced as a replacement for the Cherokee (XJ), the Liberty was priced between the Wrangler and Grand Cherokee. The last year that the Liberty was produced was 2012. The next generation brought the same design sensibility and style as the previous generation Liberty.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 42 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 421 } ], "missing-info": [], "corrected-prediction": "The Jeep Liberty, or Jeep Cherokee outside North America, is a compact SUV that was produced by Jeep for the model years 2002\u20132012. \n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who governed the kingdom of naples and sicily 1815?", "passages": [ [ "Joachim Murat", "Joachim Murat\n\nJoachim-Napol\u00e9on Murat (; born Joachim Murat; ; ; 25 March 1767 \u2013 13 October 1815) was a Marshal of France and Admiral of France under the reign of Napoleon.", "He was also the 1st Prince Murat, Grand Duke of Berg from 1806 to 1808, and King of Naples from 1808 to 1815.", "Murat received his titles in part by being Napoleon's brother-in-law through marriage to his younger sister, Caroline Bonaparte, as well as personal merit.", "He was noted as a daring, brave, and charismatic cavalry officer as well as a flamboyant dresser, for which he was known as \"the Dandy King\".", "Joachim Murat was born on 25 March 1767 in La Bastide-Fortuni\u00e8re, (renamed Labastide-Murat after its renowned citizen), in Guyenne (present-day Lot department of France) to Pierre Murat-Jordy, (d. 27 July 1799), an affluent farmer and an innkeeper, and his wife Jeanne Loubi\u00e8res (La Bastide Fortuni\u00e8re, b. 1722 \u2013 La Bastide Fortuni\u00e8re, d. 11 March 1806), daughter of Pierre Loubi\u00e8res and of his wife Jeanne Viellescazes." ], [ "Kingdom of Naples", "After Napoleon's defeat in 1814, Murat reached an agreement with Austria and was allowed to retain the throne of Naples, despite the lobbying efforts of Ferdinand and his supporters.", "However, with most of the other powers, particularly Britain, hostile towards him and dependent on the uncertain support of Austria, Murat's position became less and less secure.", "Therefore, when Napoleon returned to France for the Hundred Days in 1815, Murat once again sided with him.", "Realising the Austrians would soon attempt to remove him, Murat gave the Rimini Proclamation in a hope to save his kingdom by allying himself with Italian nationalists.", "The ensuing Neapolitan War between Murat and the Austrians was short, ending with a decisive victory for the Austrian forces at the Battle of Tolentino.", "Murat was forced to flee, and Ferdinand IV of Sicily was restored to the throne of Naples.", "Murat would attempt to regain his throne but was quickly captured and executed by firing squad in Pizzo, Calabria.", "The next year, 1816, finally saw the formal union of the Kingdom of Naples with the Kingdom of Sicily into the new Kingdom of the Two Sicilies." ], [ "Kingdom of Naples", "Kingdom of Naples\n\nThe Kingdom of Naples (; ; ; ; ) comprised that part of the Italian Peninsula south of the Papal States between 1282 and 1816.", "It was created as a result of the War of the Sicilian Vespers (1282\u20131302), when the island of Sicily revolted and was conquered by the Crown of Aragon, becoming a separate Kingdom of Sicily.", "Naples continued to be officially known as the Kingdom of Sicily, the name of the formerly unified kingdom.", "For much of its existence, the realm was contested between French and Spanish dynasties.", "In 1816, it was reunified with the island kingdom of Sicily once again to form the Kingdom of the Two Sicilies.", "The name \"Kingdom of Naples\" was not used officially.", "Officially, under the Angevins it was still the Kingdom of Sicily (\"regnum Siciliae\").", "The Peace of Caltabellotta (1302) that ended the War of the Vespers provided that the name of the island kingdom would be Trinacria (\"regnum Trinacriae\").", "This usage did not become established.", "In the late Middle Ages, it was common to distinguish the two kingdoms named Sicily as being on this or that side of the Punta del Faro, i.e., the Strait of Messina." ] ], "gold": "The Kingdom of Naples, officially known as the Kingdom of Sicily, comprised the part of the Italian Peninsula south of the Papal States between 1282 and 1816. At the beginning of 1815, the ruler of the Kingdom was Joachim-Napol\u00e9on Murat, who had retained the throne through a series of agreements with Austria, with most of the other powers, particularly Britain, hostile towards him, meaning he was dependent on Austrian support. Due to this, he decided to side with Napoleon once he returned to France for the Hundred Days, ensuing a war between Murat and the Austrians that ended with a decisive Austrian victory. Murat was then forced to flee, and Ferdinand IV of Sicily was restored to the throne of Naples by the end of 1815.", "prediction 1": "The Kingdom of Naples was a part of the Italian Peninsula south of the Papal States between 1282 and 1816. It was created as a result of the War of the Sicilian Vespers, when the island of Sicily revolted and was conquered by the Crown of Aragon, becoming a separate Kingdom of Sicily. The next year, 1816, finally saw the formal union of the Kingdom of Naples with the Kingdom of Sicily into the new Kingdom of the Two Sicilies. Joachim-Napol\u00e9on Murat was a Marshal of France and Admiral of France under the reign of Napoleon.\n", "prediction 2": "The Kingdom of Naples was a French colony in Italy that existed mainly in the south of the Papal States between 1282 and 1815. The most recent occupant of the throne was Joachim-Napol\u00e9on Murat, who was Marshal of France and Admiral of France under Napoleon I. Murat's successor, Ferdinand IV, was King of Naples from 1808 until 1815.", "prediction 3": "Joachim-Napol\u00e9on Murat ruled the Kingdom of Naples and Sicily from 1808 to 1815. He was Marshal of France and Admiral of France under the reign of Napoleon I. Thus, Murat ruled from 1815 to 1822 and was also Grand Duke of Berg from 1806 to 1808.", "prediction 4": "The Kingdom of Naples was a part of the Italian Peninsula south of the Papal States from 1282 to 1816, when it was formed as a result of the war of the Sicilian Vespers (1282\u20131302). The first free king of Naples was Joachim Murat, a Marshal of France and Admiral of France under the reign of Napoleon. Joachim Murat was the first King of Naples.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 285 }, { "error type": "Irrelevant", "explanation": "", "start": 286, "end": 429 }, { "error type": "Irrelevant", "explanation": "", "start": 457, "end": 528 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3, 5, 6 ] } ], "corrected-prediction": "The Kingdom of Naples was a part of the Italian Peninsula south of the Papal States between 1282 and 1816. It was officially known as the Kingdom of Sicily. Joachim-Napol\u00e9on Murat was the King of Naples from 1808 to 1815. Murat reached an agreement with Austria and was allowed to retain the throne of Naples. However, most of the other powers, particularly Britain, were hostile towards him, making him dependent on Austria's support. When Napoleon returned to France for the Hundred Days in 1815, Murat once again sided with him. The ensuing Neapolitan War between Murat and the Austrians was short, ending with a decisive victory for the Austrian forces. Murat was forced to flee, and Ferdinand IV of Sicily was restored to the throne of Naples.\n" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who played the leprechaun in the leprechaun movies?", "passages": [ [ "Leprechaun (film)", "Leprechaun (film)\n\nLeprechaun is a 1993 American comedy horror film written and directed by Mark Jones.", "It stars Warwick Davis in the title role and Jennifer Aniston in her film debut.", "Davis plays a vengeful leprechaun who believes a family has stolen his pot of gold.", "As he hunts them, they attempt to locate his gold to vanquish him.", "The film was originally meant to be more of a straight horror film, but Davis injected humor into his role.", "Re-shoots also added increased gore to appeal to older audiences.", "It was the first film produced in-house by Trimark to be theatrically released and grossed $8.6 million in North America against a budget of less than $1 million.", "Reviews on release were negative and focused on the film's acting, humor, and directing, all of which were criticized; it has also been called Aniston's worst film.", "It is the first entry in the \"Leprechaun\" horror film series and was followed by six sequels and a remake.", "\"Leprechaun\" is often broadcast on Saint Patrick's Day.", "In 1983, Dan O'Grady returns to his home in North Dakota from a trip to his native Ireland, where he stole the pot of gold from a leprechaun." ], [ "Leprechaun (film)", "The film is often broadcast on cable channels such as Syfy on Saint Patrick's Day.", "\"Leprechaun\" was followed by five sequels: \"Leprechaun 2\" (1994), \"Leprechaun 3\" (1995), \"\" (1997), \"Leprechaun in the Hood\" (2000), and \"\" (2003).", "In 2014, a reboot, \"\" was released.", "After \"Leprechaun 2\"s theatrical gross disappointed Trimark, \"Leprechaun 3\" was released direct-to-video.", "\"Origins\" was theatrically released.", "\"Leprechaun Returns\" will be released on DVD on December 11, 2018, \"Leprechaun Returns\" serves as a direct sequel to the original film, ignoring the subsequent installments.", "The film stars Linden Porco as the Leprechaun and Mark Holton as Ozzie Jones, who reprise his role from the first film and directed by Steven Kostanski.", "On release, critical reception for the film was negative.", "Writing for \"The Deseret News\", Chris Hicks said that the film should have been released direct-to-video." ], [ "Leprechaun (film series)", "Leprechaun (film series)\n\nLeprechaun is a series of horror comedy films consisting of eight films.", "Beginning with 1993's \"Leprechaun\" (filmed in 1991) the series centers on a malevolent and murderous leprechaun named \"Lubdan\" (although he never reveals his name), who, when his gold is taken from him, resorts to any means necessary to reclaim it.", "None of the series are in chronological order.", "English actor Warwick Davis plays the title role in every film except for the reboot, \"\", and the TV movie, \"Leprechaun Returns\".", "In the reboot, Dylan \"Hornswoggle\" Postl, of WWE fame, portrays the creature and in the TV movie, the creature is played by Linden Porco.", "The first two films were theatrically released.", "After a disappointing gross from \"Leprechaun 2\", Vidmark released \"Leprechaun 3\" direct-to-video.", "The following sequels were all direct-to-video.", "In the original \"Leprechaun\" (1993), Daniel O'Grady (Shay Duffin) captures the Leprechaun (Warwick Davis) while in Ireland, takes his gold and smuggles it back to his home in North Dakota, unaware the Leprechaun has followed him." ], [ "Leprechaun: Origins", "On March 17, 2014, WWE Studio's official YouTube channel premiered a clip from the film with an introduction by Dylan Postl, in the light of Saint Patrick's Day.", "Critical reception for \"Leprechaun: Origins\" has been predominantly negative.", "On Rotten Tomatoes the film has a rating of 0% based on reviews from 7 critics.", "Common complaints consist of clich\u00e9 scripting and poor directing.", "Cliff Wheatley of \"IGN\" panned the film, writing \"Slasher movies of this ilk come with a certain expectation of quality.", "But even the cheapest, most shoddy productions can manage some thrills, kills, and laughs with memorable characters and a cohesive plot when skilled filmmakers are at the helm.\"", "Leprechaun: Origins\", unfortunately, offers none of these things.\"", "\"We Got This Covered\" criticized the movie for being overly clich\u00e9d, stating \"Honestly, the scariest bit of Lipovski\u2019s vision is how blatantly stolen most scenes feel, be it the 'long grass' scene from \"\" or detailed costume rips from \"Red Clover\", but what else do you expect from an unintelligible cash-in short on reveals, lacking on death scenes, and heavy on infuriating redundancy?\"" ] ], "gold": "Leprechaun is a 1993 American comedy horror film written and directed by Mark Jones. It stars Warwick Davis in the title role and he appeared in various sequels until 2003. In 2014 a reboot, Leprechaun: Origins was released. Dylan Postl played the title character. Leprechaun Returns, starring Linden Porco as the title character, was released on DVD in 2018 serving as a direct sequel to the original film. ", "prediction 1": "Leprechaun is a series of horror comedy films consisting of eight entries. Beginning with 1993's Leprechaun, actor Warwick Davis plays the title role in every film except for the reboot, \"\", and the TV movie, \"Leprechaun Returns\". In the reboot, Dylan \"Hornswoggle\" Postl, of WWE fame, portrays the creature and in the TV movie, the creature is played by Linden Porco.\n", "prediction 2": "English actor Warwick Davis plays the title role in every film except for the reboot, \"\", and the TV movie, \"Leprechaun Returns\". In the reboot, Dylan \"Hornswoggle\" Postl, of WWE fame, portrays the creature and in the TV movie, the creature is played by Linden Porco. In all of the films in the Leprechaun series, the title character is played by Mark Holton.", "prediction 3": "English actor Warwick Davis plays the title role in every film except for the reboot, \"\", and the TV movie, \"Leprechaun Returns\". In the reboot, Dylan \"Hornswoggle\" Postl, of WWE fame, portrays the creature and in the TV movie, the creature is played by Linden Porco. Both movies were adapted from theatrical specials and supporting roles were provided by the producers. Dramatically, the 1989 movie \"Labdan the Undead\" was adapted from a live-action adaptation of the character. The 1993 film stars Warwick Davis in the title role. The 1993 comedy horror comedy horror film series began with the 1995 horror film \"Leprechaun\". The reboot was released on theatrically and the TV movie, \"Leprechaun Returns\", but only, which was.", "prediction 4": "English actor Warwick Davis plays the title role in every film except for the reboot, Leprechaun 3, which was released on DVD on December 4, 1994, and the TV movie Leprechaun Returns, which was released on December 4, 2003. In the TV movie Leprechaun Returns, the leprechaun was played by Linden Porco. In the 1993 film Leprechaun, a comedy horror film featuring Actor Warwick Davis as the evil Leprechaun, Dan O'Grady plays the role of a man who has never reveals his true identity. Halfway plays the leprechaun as a leprechaun, and half of the role in the films. The characters in these films were played by various actors. In the 2014 a reboot, and a TV movie, the role is played by Lawrence O's Kinston.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 16, "end": 25 }, { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 89 }, { "error type": "Redundant", "explanation": "Leprechaun ", "start": 97, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 252, "end": 265 }, { "error type": "Irrelevant", "explanation": "", "start": 273, "end": 285 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Leorechaun is a 1993 horror comedy film written and directed by Mark Jones. Actor Warwick Davis plays the title role in every sequel occurring until 2003. In the subsequent 2014 reboot, Dylan Postl portrays the creature. Additionally, Linden Porco plays the creature in the TV movie, Leprechaun Returns, which was released on DVD in 2018 and serves as a direct sequel to the original film. \n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where did they film the movie the patriot?", "passages": [ [ "The Patriot (1998 film)", "The Patriot (1998 film)\n\n", "The Patriot is a 1998 American action drama film loosely based on the novel \"The Last Canadian\" by William C. Heine.", "The film stars Steven Seagal and is directed by Dean Semler.", "The plot involves an American patriot who has to foil the plot of a militia to release a deadly virus.", "It is Seagal's first direct-to-video film.", "Near the town of Ennis, Montana, local doctor and former government research immunologist Wesley McClaren (Steven Seagal) who has an interest in herbal medicine and is also a weapons and self-defense expert, is called to a hospital when people start dying from an unknown but very deadly disease.", "He determines that the cause is a highly dangerous airborne virus and calls in a Biological Response team, who seal off the town while doctors start treating sufferers with a vaccine.", "Unfortunately for them, several have already died.", "The source of the virus is traced to a local self-styled rebel militia leader, Floyd Chisholm (Gailard Sartain), who has given himself up after a long siege and has been arrested on weapons charges.", "In court, having ingested the virus himself (believing that he also possesses the vaccine) he spits at the judge, and starts the rapid spread of the disease." ], [ "The Patriot (1998 film)", "As soon as the biological protection team learn of the cure, they go out and pick all the flowers they can find and drop them by helicopter over the town, telling the people to boil them and drink the liquid.", "The film, directed by academy-award-winning cinematographer Dean Semler, was reportedly originally intended as a theatrical release, but was ultimately released direct-to-video, the first Seagal film to skip theaters entirely.", "It was shot over eight weeks in Ennis and Virginia City, Montana, and for three days on the campus of Montana State University.", "Filming was briefly halted to remove snow from the ground during shooting in Virginia City, to maintain continuity.", "The screenplay is credited to M. Sussman and John Kingswell, assumed to be pseudonyms due to the complete lack of information on either writer (neither has any other film credit of any kind).", "Several writers, including David Ayer and Paul Mones were rumored to be working on the script prior to its release; Mones was ultimately credited as a producer.", "Though the movie is credited as an adaptation of William C. Heine's novel \"The Last Canadian\", it shares virtually no similarities with the novel except the idea of a deadly virus.", "No character names, events, or even locations appear in both the book and the film." ], [ "The Patriot (2000 film)", "The Patriot (2000 film)\n\n", "The Patriot is a 2000 American epic historical fiction war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs.", "The film mainly takes place in rural Berkeley County, South Carolina, and depicts the story of an American Colonist, nominally loyal to the British Crown, who is swept into the American Revolutionary War when his family is threatened.", "Benjamin Martin is a composite figure the scriptwriter claims is based on four factual figures from the American Revolutionary War: Andrew Pickens, Francis Marion, Daniel Morgan, and Thomas Sumter.", "The film takes place during the events of the Southern theater of the American Revolutionary War but attracted controversy over its fictional portrayal of historical British figures and atrocities.", "Professor Mark Glancy, teacher of film history at Queen Mary, University of London has said: \"It's horrendously inaccurate and attributes crimes committed by the Nazis in the 1940s to the British in the 1770s.\"", "While it is clear that the actions of then-Colonel Banastre Tarleton were certainly despicable, they were nowhere near the atrocities in the film, especially with the infamous \"Burning church\" scene, of which there is no historical or written record." ], [ "The Patriot (2000 film)", "The film's German director Emmerich said \"these were characters I could relate to, and they were engaged in a conflict that had a significant outcome\u2014the creation of the first modern democratic government.\"", "The film was shot entirely on location in South Carolina, including Charleston, Rock Hill\u2014for many of the battle scenes, and Lowrys\u2014for the farm of Benjamin Martin, as well as nearby Fort Lawn.", "Other scenes were filmed at Mansfield Plantation, an antebellum rice plantation in Georgetown, Middleton Place in Charleston, South Carolina, at the Cistern Yard on the campus of College of Charleston, and Hightower Hall and Homestead House at Brattonsville, South Carolina, along with the grounds of the Brattonsville Plantation in McConnells, South Carolina.", "Producer Mark Gordon said the production team \"tried their best to be as authentic as possible\" because \"the backdrop was serious history,\" giving attention to details in period dress.", "Producer Dean Devlin and the film's costume designers examined actual Revolutionary War uniforms at the Smithsonian Institution prior to shooting.", "The musical score for \"The Patriot\" was composed by John Williams and was nominated for an Academy Award.", "David Arnold, who composed the scores to Emmerich's \"Stargate\", \"Independence Day\", and \"Godzilla\", created a demo for \"The Patriot\" that was ultimately rejected." ] ], "gold": "There are several movies titled \"The Patriot\". \"The Patriot\" is a 1998 American action thriller film directed by Dean Semler. It was shot over eight weeks in Ennis and Virginia City, Montana, and for three days on the campus of Montana State University. Another \"The Patriot\" is a 2000 American epic historical revisionist war film written by Robert Rodat, directed by Roland Emmerich and starring Mel Gibson, Chris Cooper, Heath Ledger and Jason Isaacs. The film was shot entirely on location in South Carolina, including Charleston, Rock Hill, for many of the battle scenes, and Lowrys, for the farm of Benjamin Martin, as well as nearby Fort Lawn. Other scenes were filmed at Mansfield Plantation, an antebellum rice plantation in Georgetown, Middleton Place in Charleston, South Carolina, at the Cistern Yard on the campus of College of Charleston, and Hightower Hall and Homestead House at Brattonsville, South Carolina, along with the grounds of the Brattonsville Plantation in McConnells, South Carolina.", "prediction 1": "The Patriot is a 1998 American action drama film loosely based on the novel The Last Canadian by William C. Heine. The film stars Steven Seagal and is directed by Dean Semler. The film was shot over eight weeks in Ennis and Virginia City, Montana, and for three days on the campus of Montana State University. The 2000 American epic historical fiction war film The Patriot mainly takes place in rural Berkeley County, South Carolina, and depicts the story of an American Colonist nominally loyal to the British Crown, who is swept into the American Revolutionary War when his family is threatened.\n", "prediction 2": "The Patriot is a 1998 American action drama film loosely based on the novel The Last Canadian by William C. Heine. Steven Seagal star as American patriot Wesley McClaren, who has an interest in herbal medicine and is also a weapons and self-defense expert, and is called to a hospital when people start dying from an unknown but very deadly disease. Dr. Wesley McClaren discovers that the cause is a highly dangerous airborne virus and calls in a Biological Response team, who seal off the town while doctors start treating sufferers with a vaccine.", "prediction 3": "The Patriot is a 2000 American epic war film directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs, which takes place mainly in rural Berkeley County, South Carolina. Filming was briefly halted to remove snow from the ground during shooting in Virginia City, to maintain continuity.", "prediction 4": "The Patriot is a 2000 American epic historical fiction war film that took place exclusively on location in South Carolina. It was shot in Ennis, Montana, near the town of Ennis, Montana, and for three days on the campus of Montana State University, where filming was briefly halted to remove snow from the ground during shooting in Virginia City, to maintain continuity.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 114 }, { "error type": "Irrelevant", "explanation": "", "start": 115, "end": 143 }, { "error type": "Irrelevant", "explanation": "", "start": 373, "end": 598 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Patriot is a 1998 American action drama film loosely based on the novel The Last Canadian by William C. Heine. The film is directed by Dean Semler. The film was shot over eight weeks in Ennis and Virginia City, Montana, and for three days on the campus of Montana State University. The 2000 American epic historical fiction war film \"The Patriot\" is directed by Roland Emmerich, written by Robert Rodat, and starring Mel Gibson, Chris Cooper, Heath Ledger, and Jason Isaacs. The film was shot entirely on location in South Carolina, including Charleston, Rock Hill\u2014for many of the battle scenes, and Lowrys\u2014for the farm of Benjamin Martin, as well as nearby Fort Lawn. Other scenes were filmed at Mansfield Plantation, an antebellum rice plantation in Georgetown, Middleton Place in Charleston, South Carolina, at the Cistern Yard on the campus of College of Charleston, and Hightower Hall and Homestead House at Brattonsville, South Carolina, along with the grounds of the Brattonsville Plantation in McConnells, South Carolina.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was high hopes released panic at the disco?", "passages": [ [ "High Hopes (Panic! at the Disco song)", "High Hopes (Panic!", "at the Disco song)\n\n\"High Hopes\" is a song by Panic!", "at the Disco released on May 23, 2018 as the second single from their sixth studio album, \"Pray for the Wicked\", through Fueled by Ramen and DCD2 Records.", "The song was written and produced by Jake Sinclair and Jonas Jeberg, and co-written by Brendon Urie, Jenny Owen Youngs, Lauren Pritchard, Sam Hollander, William Lobban-Bean, Taylor Parks, and Ilsey Juber; with additional production by Jonny Coffer.", "It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day.", "The music video was also released on August 27.", "The song has reached number five on the \"Billboard\" Hot 100, becoming the band's highest-charting song on the chart.", "It has also reached the top ten in Australia and Germany and the top twenty in Ireland, New Zealand, and the United Kingdom, becoming their highest charting single worldwide.", "This song is also included on the \"NHL 19\" video game, by EA Sports.", "The song has also reached 2nd position on the iTunes chart." ] ], "gold": "\"High Hopes\" is a song by American\u00a0pop rock\u00a0band\u00a0Panic! at the Disco. The song was released through\u00a0Fueled by Ramen\u00a0and\u00a0DCD2 Records\u00a0on May 23, 2018, as the second single from the band's sixth studio album,\u00a0Pray for the Wicked. It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on\u00a0August 27, 2018, and US pop radio the following day. The music video was also released on\u00a0August 27, 2018.", "prediction 1": "High Hopes is a song by Panic! at the Disco released on May 23, 2018 as the second single from their sixth studio album, Pray for the Wicked, through Fueled by Ramen and DCD2 Records. It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day. The music video was also released on August 27, 2018.\n", "prediction 2": "High Hopes is a song by Panic! at the Disco released on May 23, 2018 as the second single from their sixth studio album, Pray for the Wicked, through Fueled by Ramen and DCD2 Records. It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day. The song has reached number five on the Billboard Hot 100, becoming the band's highest-charting song on the chart.", "prediction 3": "\"High Hopes\" is a song by Panic! at the Disco released on May 23, 2018 as the second single from their sixth studio album, \"Pray for the Wicked\". The song was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day.", "prediction 4": "\"High Hopes\" is a song by Panic! at the Disco released on May 23, 2018 as the second single from their sixth studio album, Pray for the Wicked. It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day. The music video was also released on August 27.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 24, "end": 52 } ], "missing-info": [], "corrected-prediction": "High Hopes is a song by Panic! at the Disco that was released on May 23, 2018 as the second single from their sixth studio album, Pray for the Wicked, through Fueled by Ramen and DCD2 Records. It was serviced to alternative radio on July 31, 2018, and impacted hot adult contemporary radio on August 27, 2018, and US pop radio the following day. The music video was also released on August 27, 2018.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who came second in tour de france 2018?", "passages": [ [ "2018 Tour de France", "2018 Tour de France\n\nThe 2018 Tour de France was the 105th edition of the Tour de France, one of cycling's three Grand Tours.", "The race started from Noirmoutier-en-l'\u00cele, in the Vend\u00e9e department, on 7 July and concluded with the Champs-\u00c9lys\u00e9es stage in Paris, on 29 July.", "A total of 176 riders across 22 teams were participating in the 21-stage race.", "The Tour was the shortest of the millennium and was the fifth time a tour had set out from Vend\u00e9e.", "The race was won for the first time by Geraint Thomas of .", "Tom Dumoulin () placed second, with Thomas' teammate and four-time Tour champion Chris Froome coming third.", "The opening stage was won by Fernando Gaviria of , who became the Tour's first rider to wear the general classification leader's yellow jersey.", "Peter Sagan () then took the race lead the following stage.", "won stage three's team time trial, putting their rider Greg Van Avermaet in yellow.", "He held the jersey for eight days until the second high mountain stage, where stage winner Thomas took the lead.", "He held it for the rest of the race to become the first Welshman to win the overall race." ], [ "2018 Tour de France", "New rules by the cycling's governing body, the Union Cycliste Internationale (UCI) reduced the number of riders per team for Grand Tours from 9 to 8, resulting in a start list total of 176, instead of the usual 198.", "Of these, 35 competed in their first Tour de France.", "The total number of riders that finished the race was 145.", "The riders came from 30 countries.", "Seven countries had more than 10 riders in the race: France (35), Belgium (19), the Netherlands (13), Italy (13), Australia (11), Germany (11) and Spain (11).", "The average age of riders in the race was 29.37 years, ranging from the 21-year-old Egan Bernal () to the 40-year-old Franco Pellizotti ().", "had the youngest average age while had the oldest.", "The teams entering the race were:\n\nUCI WorldTeams\nUCI Professional Continental teams\n\nDefending champion Chris Froome () had generally been considered the main favourite for the general classification.", "He had won four out of the last five editions, and was also the current defending champion at both other Grand Tours, the Vuelta a Espa\u00f1a and the Giro d'Italia." ] ], "gold": "The 2018 Tour de France was the 105th edition of the Tour de France, one of cycling's three Grand Tours, and included a total of 176 riders from 22 teams. The 3,351 km-long race consisted of 21 stages, starting on July 7th in western France, and concluding on July 29th with the Champs-\u00c9lys\u00e9es stage in Paris. The overall general classification was won by Geraint Thomas of Team Sky. Tom Dumoulin of Team Sunweb from the Netherlands placed second, with Thomas's teammate and four-time Tour winner Chris Froome coming third.", "prediction 1": "The 2018 Tour de France was the 105th edition of the race, one of cycling's three Grand Tours. The race started from Noirmoutier-en-l'\u00cele, in the Vend\u00e9e department, on 7 July and concluded with the Champs-\u00c9lys\u00e9es stage in Paris, on 29 July. The race was won for the first time by Geraint Thomas of. Tom Dumoulin () placed second, with Thomas' teammate and four-time Tour champion Chris Froome coming third.\n", "prediction 2": "The 2018 Tour de France was the 105th edition of the race, one of cycling's three Grand Tours. Tom Dumoulin came second in the race and teammate Chris Froome came third.", "prediction 3": "The 2018 Tour de France was the 105th edition of the race, one of cycling's three Grand Tours. The race started from Noirmoutier-en-l'\u00cele, in the Vend\u00e9e department, on 7 July and concluded with the Champs-\u00c9lys\u00e9es stage in Paris, on 29 July. The men's second place went to Tom Dumoulin followed by four-time Tour champion Chris Froome.", "prediction 4": "The 2018 Tour de France was the 105th edition of the race, one of cycling's three Grand Tours. The race started from Noirmoutier-en-l'\u00cele, in the Vend\u00e9e department, on 7 July and concluded with the Champs-\u00c9lys\u00e9es stage in Paris, on 29 July. A total of 176 riders across 22 teams were participating in the 21-stage race. Tom Dumoulin placed second, with Chris Froome coming third. The two remaining riders to come second in the race were Matt Evans of The American team Hadley and Christian Hein and Chris Froome. Froome was fifth in the Tour.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 164 }, { "error type": "Incoherent", "explanation": "", "start": 254, "end": 298 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2018 Tour de France was the 105th edition of the race, one of cycling's three Grand Tours. A total of 176 riders across 22 teams were participating. The race started on 7 July and concluded with the Champs-\u00c9lys\u00e9es stage in Paris, on 29 July. The race was won by Geraint Thomas, Tom Dumoulin placed second, with Thomas' teammate and four-time Tour champion Chris Froome coming third.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When does total war warhammer 2 take place?", "passages": [ [ "Total War: Warhammer II", "Total War: Warhammer II\n\nTotal War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega.", "It is part of the \"Total War\" series and the sequel to 2016's \"\".", "The game is set in Games Workshop's \"Warhammer Fantasy\" fictional universe.", "The game was released for Microsoft Windows-based PCs on 28 September 2017.", "Feral Interactive released the game on macOS and Linux on 20 November 2018.", "The game requires a Steam account to play.", "\"Total War: Warhammer II\" features turn-based strategy and real-time tactics gameplay similar to other games in the \"Total War\" series.", "In the campaign, players move armies around the map and manage settlements in a turn-based manner.", "Players engage in diplomacy with, and fight against, AI-controlled factions.", "When armies meet, a real-time battle happens.", "The game also has a custom battles mode where players can create customised real-time battles, as well as online multiplayer battles.", "Those who own races from the first game will have the same races unlocked for multiplayer in the second game.", "The game's announced races in the campaign include the Lizardmen, High Elves, Dark Elves and Skaven.", "The Tomb Kings and Vampire Coast (a faction of undead pirates) debuted later as paid downloadable content factions." ] ], "gold": "Total War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega. The game was released for Microsoft Windows-based PCs on 28 September 2017. Feral Interactive released the game on macOS and Linux on 20 November 2018. ", "prediction 1": "Total War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega. It is part of the Total War series and the sequel to 2016's Total War: Warhammer. The game was released for Microsoft Windows-based PCs on 28 September 2017. Feral Interactive released the game on macOS and Linux on 20 November 2018.\n", "prediction 2": "Total War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega, and the sequel to 2016's Total War. The game was released for Microsoft Windows-based PCs on 28 September 2017. Feral Interactive released the game on macOS and Linux on 20 November 2018.", "prediction 3": "Total War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega. The game was released for Microsoft Windows-based PCs on 28 September 2017. The game was released on macOS and Linux on 20 November 2018.", "prediction 4": "Total War: Warhammer II (sometimes referred to as \"Total War: Whammer II\") is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega. The game is set in Games Workshop's Warhammer Fantasy fictional universe and was released for Microsoft Windows-based PCs on 28 September 2017. Feral Interactive released the game on macOS and Linux on 20 November 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 217 } ], "missing-info": [], "corrected-prediction": "Total War: Warhammer II is a turn-based strategy and real-time tactics video game developed by Creative Assembly and published by Sega. The game was released for Microsoft Windows-based PCs on 28 September 2017. Feral Interactive released the game on macOS and Linux on 20 November 2018.\n" }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Where was the last jurassic park movie filmed?", "passages": [ [ "Jurassic World: Fallen Kingdom", "Filming in the United Kingdom concluded on June 10, 2017.", "Up to that point, Trevorrow was present as an on-set writer for each day of production so he could aid Bayona with any possible script changes.", "Goldblum shot his scenes in a single day at Pinewood Studios, during the last day of filming in the United Kingdom.", "Jones also filmed his scenes on large sets at Pinewood Studios.", "Filming in Hawaii was underway as of June 13, 2017, and lasted more than 25 days, with locations that included Dillingham Airfield and Pua'ena Point.", "On June 21, 2017, filming began at He\u02bbeia Kea Small Boat Harbor, which served as Isla Nublar's shipping dock.", "More than half the harbor was closed for filming, which required the use of smoke machines.", "Scenes were scheduled to be shot there until the end of the month.", "Filming also took place in a nearby He\u02bbeia jungle for scenes where Owen searches for and locates Blue.", "As a reference to the first \"Jurassic Park\" film, the scene between Owen and Blue includes an overturned Ford Explorer, previously featured in the original film as a Jurassic Park tour vehicle.", "Trevorrow had initially considered including the vehicle in a scene in \"Jurassic World\", before settling on the original Jurassic Park visitor center instead." ], [ "Jurassic World: Fallen Kingdom", "Jurassic World: Fallen Kingdom\n\nJurassic World:", "Fallen Kingdom is a 2018 American science fiction adventure film and the sequel to \"Jurassic World\" (2015).", "Directed by J. A. Bayona, it is the fifth installment of the \"Jurassic Park\" film series, as well as the second installment of a planned \"Jurassic World\" trilogy.", "Derek Connolly and \"Jurassic World\" director Colin Trevorrow both returned as writers, with Trevorrow and the original \"Jurassic Park\" director Steven Spielberg as executive producers.", "Set on the fictional Central American island of Isla Nublar, off the Pacific coast of Costa Rica, it follows Owen Grady and Claire Dearing as they rescue the remaining dinosaurs before a volcanic eruption destroys it.", "Chris Pratt, Bryce Dallas Howard, B. D. Wong, and Jeff Goldblum reprise their roles from previous films in the series, with Rafe Spall, Justice Smith, Daniella Pineda, James Cromwell, Toby Jones, Ted Levine, Isabella Sermon, and Geraldine Chaplin joining the cast.", "Filming took place from February to July 2017 in the United Kingdom and Hawaii.", "Produced and distributed by Universal Pictures, \"Fallen Kingdom\" premiered in Madrid on May 21, 2018, and was released internationally in early June 2018 and in the United States on June 22, 2018." ], [ "Jurassic World: Fallen Kingdom", "After filming concluded in England, production moved to Hawaii, which was used as a primary filming location.", "Scenes shot in Hawaii were set on Isla Nublar, the fictional island featured in the first and fourth films.", "Scenes were also expected to be shot at Brecon Beacons National Park in Wales.", "The film was shot in CinemaScope, and is the first entry in the \"Jurassic Park\" series presented in a 2.40:1 aspect ratio.", "The film crew used Arri Alexa 65 exclusively.", "Several scenes were shot to reference various films including \"From Here to Eternity\" (1953) and \"Dracula\" (1979), as well as Spielberg's films \"Raiders of the Lost Ark\" (1981) and \"E.T. the Extra-Terrestrial\" (1982).", "Spielberg was shown scenes from the film during production and offered Bayona his opinions.", "During filming, and in between takes, Bayona used an iPod to play different types of music on set to inspire the actors, as he had done with his previous films.", "He also played sound effects from other films in the series, including a \"T. rex\" roar that he sometimes used to get a natural reaction from the actors.", "In particular, Bayona played unexpected sounds and loud music to scare Smith for certain scenes, as his character is portrayed as easily frightened." ] ], "gold": "Jurassic World: Fallen Kingdom is a 2018 American science fiction action film and the sequel to Jurassic World (2015). It is the second installment of the Jurassic World trilogy, and the fifth overall installment of the Jurassic Park franchise. The movie was filmed in the United Kingdom and Hawaii. Most of the filming in England took place at Pinewood Studios. After filming concluded in England, production moved to Hawaii, which was used as a primary filming location.", "prediction 1": "The last Jurassic World movie was filmed in the United Kingdom. After filming concluded in the United Kingdom, production moved to Hawaii, which was used as a primary filming location. Scenes shot in Hawaii were set on Isla Nublar, the fictional island featured in the first and fourth Jurassic Park films.\n", "prediction 2": "Setting the scene for the second installment of the Jurassic World trilogy, Fallen Kingdom takes place in Central America. Cast members in the film reprise their roles from the previous Jurassic World films, while Chris Pratt, Bryce Dallas Howard, B. D. Wong, and Jeff Goldblum reprise their roles from the 2015 film. After filming concluded in England, production moved to Hawaii, which was used as a primary filming location. Scenes shot in Hawaii were set on Isla Nublar, the fictional island featured in the films. The second installment in the Jurassic World trilogy. Fallen Kingdom premiered in Madrid, on May 21, 2018 and was released in the United States on June 22, 2018.", "prediction 3": "Before filming in the United Kingdom ended in June 2017, production moved to Hawaii, which was used as a primary filming location. Scenes shot in Hawaii were set on Isla Nublar, the fictional island featured in the first and fourth Jurassic Park films. Before filming in England, production moved to Norway, which was the backdrop for scenes shot in Norway, Norway, Iceland, Norway, Iceland, Norway, Poland, and Iceland.", "prediction 4": "In April 2015, Steven Spielberg directed the fifth installment of the Jurassic World film series, and 2005 movie, Jurassic World: The Lost World, which followed Owen Grady as he tries to save the remaining dinosaurs before a volcano destroys the island. Filming for the film began in the United Kingdom in February 2017 and concluded on June 10, 2017. On June 21, 2017, filming began at Heeia Kea Small Boat Harbor, which served as Isla Nublar's shipping dock. However, scenes were delayed because of Hurricane Maria. Due to scheduling works during critical reviews, countries, the filming in buendo reality series sequel to Jurassic World: Fallen Kingdom in October 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 185, "end": 307 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Jurassic World: Fallen Kingdom is a 2018 American science fiction action film and the sequel to Jurassic World (2015). Filming first took place in the United Kingdom. Afterwards, production moved to Hawaii, which was used as a primary filming location.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who won the popular vote in 2017 presidential election?", "passages": [ [ "2017 French presidential election", "2017 French presidential election\n\nThe 2017 French presidential election was held on 23 April and 7 May 2017.", "As no candidate won a majority in the first round on 23 April, a run-off was held between the top two candidates, Emmanuel Macron of En Marche!", "and Marine Le Pen of the National Front (FN), which Macron won by a decisive margin on 7 May.", "The presidential election was followed by legislative elections to elect members of the National Assembly on 11 and 18 June.", "Incumbent president Fran\u00e7ois Hollande of the Socialist Party (PS) was eligible to run for a second term, but declared on 1 December 2016 that he would not seek reelection in light of low approval ratings, making him the first incumbent president of the Fifth Republic not to seek re-election.", "Fran\u00e7ois Fillon of The Republicans (LR), after winning the party's first open primary, and Marine Le Pen of the National Front led first-round opinion polls in November 2016 and mid-January 2017.", "Polls tightened considerably by late January, and after the publication of revelations that Fillon employed family members in possibly fictitious jobs in a series of politico-financial affairs that came to be colloquially known as \"Penelopegate\", Macron overtook Fillon to place consistently second in first-round polling.", "At the same time, Beno\u00eet Hamon won the Socialist primary, entering fourth place in the polls." ], [ "2017 Iranian presidential election", "2017 Iranian presidential election\n\nPresidential elections were held in Iran on 19 May 2017, the twelfth such election in Iran.", "Local elections were held simultaneously.", "Candidates' registration took place from 11 to 15 April 2017.", "Incumbent president Hassan Rouhani was eligible to run for re-election.", "His rivals were the conservatives' top candidate Ebrahim Raisi, the Islamic Coalition Party's Mostafa Mir-Salim and Mostafa Hashemitaba who ran with no partisan support.", "Rouhani was re", "-elected for a second term.", "According to results announced by the Interior Ministry, Rouhani received 23.5 of 41 million votes counted.", "His closest rival, Ebrahim Raisi, received 15.7 million votes.", "Rouhani was inaugurated on 5 August 2017 taking oath of office for the second time at the Parliament of Iran.", "Any Iranian citizen above 18 years of age was able to register as a presidential candidate.", "An institution called the Election Monitoring Agency (EMA) and managed by the Guardian Council vets registered candidates and approves a handful to run in the election.", "The Guardian Council does not publicly announce the reason a particular candidate is rejected, although those reasons are explained to each candidate.", "Women who register as candidates have invariably been excluded from standing for election by the Council." ], [ "Supreme Court of Kenya", "At the end of the petition, the Supreme Court declined to nullify the election and affirmed the victory of Uhuru Kenyatta.", "The 2017 presidential election took place on August 8, 2017, with the IEBC declaring Uhuru Kenyatta as the winner.", "Although Raila Odinga and his NASA coalition leaders challenged the declaration, they indicated that they would not file a petition in the Supreme Court given their experience at the Court when they filed a similar petition after the 2013 general election.", "However, the coalition announced three days later that they would file a case following the government's decision to shut down two leading civil society organizations that had been expected to file a petition at the Court.", "Raila Odinga's petition was based on several grounds, including the discrepancy in the presidential vote tally compared to the tally of other elections (the presidential vote tally exceeded the total tally of votes cast for county governors across the country by over half a million), and allegations that the electoral commission's electronic vote transmission system was hacked and a formula introduced which kept Uhuru Kenyatta's vote tally at a consistent 11% ahead of Odinga even as the vote tallies supposedly came in from different parts of the country in which the candidates enjoyed varied support." ], [ "2017 Indian presidential election", "Both the governing NDA coalition and the opposition UPA coalition put forward candidates from their dominant parties, the Bharatiya Janata Party and the Indian National Congress respectively.", "Ram Nath Kovind was declared the winner after the counting of votes which was held on 20 July 2017.", "He was administered oath by the Chief Justice of India Jagdish Singh Khehar, to take office as the 14th President of India on 25 July 2017 at the Central Hall located in The Parliament House, New Delhi.", "Immediately after the results were announced, Prime Minister Narendra Modi tweeted, \"Congratulations to Shri Ram Nath Kovind Ji on being elected the President of India!", "Best wishes for a fruitful & inspiring tenure\".", "In another tweet he added \"Gladdened by the extensive support for Shri Ram Nath Kovind Ji among MPs & across various parties.", "I thank members of the electoral college\"." ] ], "gold": "In 2017 there were many Presidential Elections. Paul Kagame of Rwanda won the popular vote, Uhuru Kenyatta won the Kenya's, Ram Nath Kovind won India's, Hassan Rouhani won Iran's, Emmanuel Macron won France's, and Borut Pahor won Slovenia. ", "prediction 1": "The 2017 French presidential election was held on 23 April and 7 May 2017, with Emmanuel Macron winning the popular vote. The 2017 Iranian presidential election was held on 19 May 2017, the twelfth such election in Iran. Any Iranian citizen above 18 years of age was able to register as a presidential candidate. The 2017 Kenyan presidential election took place on August 8, 2017, with the IEBC declaring Uhuru Kenyatta as the winner. Ram Nath Kovind was declared the winner after the counting of votes which was held on 20 July 2017.\n", "prediction 2": "The 2017 presidential election took place on 8 August 2017, with the IEBC declaring Uhuru Kenyatta as the winner. Ram Nath Kovind was declared the winner after the counting of votes which was held on 20 July 2017. He was administered oath of office by the Chief Justice of India Jagdish Singh Khehar to take office as the 2021 President of India.", "prediction 3": "In 2017, the popular vote in the North African country of Lesotho went to independent candidates Mohamed Morsi (Morsi) and Sanaa Rashid (Rahman Reza Rahman), but in South Africa, Umar Farouk Mahammad (Rahman Alvi) and Abdallah Rahman (Rahman Shaikh) won the popular vote. The 2017 Indian presidential election was held on August 8, 2017, with the IEBC declaring Uhuru Kenyatta as the winner. In India, Ram Nath Kovind was declared the winner after the counting of votes which was held on 20 July 2017.", "prediction 4": "The 2017 French presidential election was held on 23 April and 7 May 2017. As no candidate won a majority in the first round on 23 April, a run-off was held between the top two candidates, Emmanuel Macron of En Marche! and Marine Le Pen of the National Front, which Macron won by a decisive margin on 7 May. The presidential election was followed by legislative elections to elect members of the National Assembly on 11 and 18 June. The 2017 US presidential election took place on August 8, 2017, with the IEBC declaring President Donald Trump as the winner. In India's high school board members declared President Ram Nath Kovind the winning popular vote.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 79 }, { "error type": "Irrelevant", "explanation": "", "start": 122, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 380 }, { "error type": "Irrelevant", "explanation": "", "start": 386, "end": 404 }, { "error type": "Irrelevant", "explanation": "", "start": 475, "end": 535 }, { "error type": "Redundant", "explanation": "The 2017", "start": 317, "end": 321 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6, 7 ] } ], "corrected-prediction": "Emmanuel Macron won the popular vote in the 2017 French presidential election. The Kenyan presidential election took place with Uhuru Kenyatta as the winner. Ram Nath Kovind was declared the winner in India. Rouhani was re-elected in 2017 Iranian presidential election." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the singer of ae dil hai mushkil?", "passages": [ [ "Ae Dil Hai Mushkil (song)", "Ae Dil Hai Mushkil (song)\n\n\"Ae Dil Hai Mushkil\" (English: \"This Heart is Complicated\") is a Hindi song from the soundtrack of the Indian film \"of the same name\".", "It is written by Amitabh Bhattacharya, composed by Pritam, and sung by Arijit Singh.", "The music video features actor Ranbir Kapoor.", "This song officially used in Mahesh Bhatt's Naamkarann, which is\nbroadcast on Star Plus.", "The song was released by Sony Music India on 30 August 2016.", "\"The Times of India\" wrote, \"Pritam and Amitabh Bhattacharya, who have delivered several memorable compositions in the past, live up to their reputations and give yet another hit album.\"" ], [ "Ae Dil Hai Mushkil", "Ae Dil Hai Mushkil\n\nAe Dil Hai Mushkil () is a 2016 Indian romantic drama film written and directed by Karan Johar.", "It stars Aishwarya Rai Bachchan, Ranbir Kapoor,Anushka Sharma and Fawad Khan tells the story of unrequited love.", "It was released on 28 October 2016 during the Diwali festival.", "The film earned worldwide against a budget of .", "At the 62nd Filmfare Awards, \"Ae Dil Hai Mushkil\" received nine nominations, including Best Director for Johar, and won four awards for its soundtrack.", "The movie begins with the interview of Ayan Sanger, a singer who has newly acquired fame with his non-filmy songs.", "He tells story of his experience of love in flash back.", "In London, a chance meeting in a disco between Ayan Sanger (Ranbir Kapoor) (a novice in terms of sex-related matters), and Alizeh Khan (Anushka Sharma) (knowing a little more) ends up with them trying to make out, and it turning into a comedy.", "They do not make love, just spend the night together, get to know about each other, and become friends." ], [ "Ae Dil Hai Mushkil", "Moreover, the film now ranks as the highest-earner for Aishwarya, beating \"Dhoom 2\"s 82.30 crore ($12.3 million) in 2006; the fourth biggest for Anushka as well as for Ranbir.", "In the United Kingdom, it recorded the biggest Bollywood opening of the year with \u20b94.88 crore ($772,891), debuting at eighth place at the U.K. box office.", "However, this is inclusive of previews.", "Including previews, \"Sultan\" would be the clear winner with a $1.3 million debut in July.", "But excluding previews, \"Ae Dil Hai Mushkil\" is ahead of the former.", "In the United States and Canada, the film received a limited release across 302 theaters and grossed 14 crore ($2.13 million) in its opening weekend finishing in tenth place.", "By the end of its theatrical run, the film grossed 160.69 crore in India and 237.56 crore worldwide.", "Rotten Tomatoes gives the film a 58% score based on twelve critic reviews, with an average rating of 5.4/10.", "On Metacritic, which assigns a normalized rating, the film has a score of 40 out of 100, based on four critics, indicating \"mixed or average reviews\"." ] ], "gold": "Ae Dil Hai Mushkil is a 2016 India Hindi-language musical romantic drama film featuring a commercially and critically successful soundtrack performed largely by the film's cast, including Ranbir Kapoor, Aishwarya Rai Bachchan, and Anushka Sharma. The title track is performed by Aijit Singh.", "prediction 1": "Ae Dil Hai Mushkil is a song from the soundtrack of the 2016 Indian romantic drama film of the same name. The song is written by Amitabh Bhattacharya, composed by Pritam, and sung by Arijit Singh. The music video features actor Ranbir Kapoor.\n", "prediction 2": "Arijit Singh is the singer of Ae Dil Hai Mushkil, a song from the soundtrack of the 2016 Indian romantic drama film of the same name. It is written by Amitabh Bhattacharya, composed by Pritam, and sung by Arijit Singh. This song officially used in Mahesh Bhatt's Naamkarann, which is broadcast on Star Plus. The movie begins with the interview of Ayan Sanger, a singer who has newly acquired fame with his non-filmy songs. In London, a chance meeting in a disco between Ayan Sanger (Ranbir Kapoor) and Alizeh Khan (Anushka Sharma) ends up with them trying to make out, and it turning into a comedy.", "prediction 3": "Arijit Singh is the singer of the song Ae Dil Hai Mushkil from the soundtrack of the 2016 Indian romantic drama film of the same name. The song is written by Amitabh Bhattacharya, composed by Pritam, and sung by Arijit Singh. The music video features actor Ranbir Kapoor. Ae Dil Hai Mushkil was released on 28 October 2016 during the Diwali festival in India.", "prediction 4": "Ae Dil Hai Mushkil is a 2016 Indian romantic drama film written and directed by Karan Johar, which stars Aishwarya Rai Bachchan, Ranbir Kapoor, Anushka Sharma and Fawad Khan tells the story of unrequited love. The song, Ae Dil Hai Mushkil, is sung by Arijit Singh.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 106, "end": 170 } ], "missing-info": [], "corrected-prediction": "Ae Dil Hai Mushkil is a song from the soundtrack of the 2016 Indian romantic drama film of the same name. The song is sung by Arijit Singh. The music video features actor Ranbir Kapoor.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "How many time zones across the united states?", "passages": [ [ "Time in the United States", "Time in the United States\n\nTime in the United States, by law, is divided into nine standard time zones covering the states and its possessions, with most of the United States observing daylight saving time (DST) for approximately the spring, summer, and fall months.", "The time zone boundaries and DST observance are regulated by the Department of Transportation.", "Official and highly precise timekeeping services (clocks) are provided by two federal agencies: the National Institute of Standards and Technology (NIST) (an agency of the Department of Commerce); and its military counterpart, the United States Naval Observatory (USNO).", "The clocks run by these services are kept synchronized with each other as well as with those of other international timekeeping organizations.", "It is the combination of the time zone and daylight saving rules, along with the timekeeping services, which determines the legal civil time for any U.S. location at any moment.", "Prior to the adoption of four standard time zones for the continental United States, many towns and cities set their clocks to noon when the sun passed their local meridian, pre-corrected for the equation of time on the date of observation, to form local mean solar time.", "Noon occurred at different times but time differences between distant locations were barely noticeable prior to the 19th century because of long travel times and the lack of long-distance instant communications prior to the development of the telegraph." ], [ "Time in the United States", "The use of local solar time became increasingly awkward as railways and telecommunications improved.", "American railroads maintained many different time zones during the late 1800s.", "Each train station set its own clock making it difficult to coordinate train schedules and confusing passengers.", "Time calculation became a serious problem for people travelling by train (sometimes hundreds of miles in a day), according to the Library of Congress.", "Every city in the United States used a different time standard so there were more than 300 local sun times to choose from.", "Time zones were therefore a compromise, relaxing the complex geographic dependence while still allowing local time to be approximate with mean solar time.", "Railroad managers tried to address the problem by establishing 100 railroad time zones, but this was only a partial solution to the problem.", "Operators of the new railroad lines needed a new time plan that would offer a uniform train schedule for departures and arrivals.", "Four standard time zones for the continental United States were introduced at noon on November 18, 1883, when the telegraph lines transmitted time signals to all major cities.", "In October 1884, the International Meridian Conference at Washington DC adopted a proposal which stated that the prime meridian for longitude and timekeeping should be one that passes through the centre of the transit instrument at the Greenwich Observatory in the United Kingdom (UK).", "The conference therefore established the Greenwich Meridian as the prime meridian and Greenwich Mean Time (GMT) as the world's time standard." ], [ "Eastern Time Zone", "Eastern Time Zone\n\nThe Eastern Time Zone (ET) is a time zone encompassing part or all of 22 states in the eastern part of the contiguous United States, parts of eastern Canada, the state of Quintana Roo in Mexico, Panama in Central America, and the Caribbean Islands.", "Places that use Eastern Standard Time (EST) when observing standard time (autumn/winter) are 5 hours behind Coordinated Universal Time ().", "Eastern Daylight Time (EDT), when observing daylight saving time DST (spring/summer) is 4 hours behind Coordinated Universal Time ().", "In the northern parts of the time zone, on the second Sunday in March, at 2:00\u00a0a.m. EST, clocks are advanced to 3:00\u00a0a.m. EDT leaving a one-hour \"gap\".", "On the first Sunday in November, at 2:00\u00a0a.m. EDT, clocks are moved back to 1:00\u00a0a.m. EST, thus \"duplicating\" one hour.", "Southern parts of the zone (Panama and the Caribbean) do not observe daylight saving time.", "The boundaries of the Eastern Time Zone have moved westward since the Interstate Commerce Commission took over time-zone management from railroads in 1938.", "For example, the easternmost and northernmost counties in Kentucky were added to the zone in the 1940s, and in 1961 most of the state went Eastern." ] ], "gold": "Time in the United States, by law, is divided into 9 standard time zones covering the states, territories and other US possessions, with most of the United States observing daylight saving time for approximately the spring, summer, and fall months. 4 standard time zones for the continental United States were introduced at noon on November 18, 1883, in Chicago, IL. Across all 50 United States there are 6 time zones.", "prediction 1": "Time in the United States, by law, is divided into nine standard time zones covering the states and its possessions, with most of the United States observing daylight saving time for approximately the spring, summer, and fall months. Prior to the adoption of four standard time zones for the continental United States, many towns and cities set their clocks to noon when the sun passed their local meridian, pre-corrected for the equation of time on the date of observation, to form local mean solar time. The use of local solar time became increasingly awkward as railways and telecommunications improved.\n", "prediction 2": "Time in the United States, by law, is divided into 9 standard time zones covering the states and its possessions, with most of the United States observing daylight saving time for approximately the spring, summer, and fall months. Prior to the adoption of four standard time zones for the continental United States, many towns and cities set their clocks to noon when the sun passed their local meridian. These time zones allowed residents of all 50 states to have a uniform time zone covering their entire state, with the exception of Alaska, where there are seven different time zones for the continental United States, which was originally made up of 10 in 1883, and 12 standard time zones. Until 1956, the Interstate Commerce Commission took over time-zone management from railroads.", "prediction 3": "The United States has nine standard time zones. The Eastern Time Zone was created in 1901 and covers part or all of 22 states in the eastern part of the contiguous United States, parts of eastern Canada, the state of Quintana Roo in Mexico, Panama in Central America, and the Caribbean Islands. The time zones were first established in 1883, when the telegraph lines transmitted time signals to all major cities.", "prediction 4": "The United States is divided into nine time zones. The Eastern Time Zone covers parts or all of 22 states in the eastern part of the contiguous United States, and portions of eastern Canada. Most of the United States observes daylight saving time.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 234, "end": 505 }, { "error type": "Irrelevant", "explanation": "", "start": 506, "end": 607 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Time in the United States, by law, is divided into nine standard time zones covering the states and its possessions, with most of the United States observing daylight saving time for approximately the spring, summer, and fall months. Four standard time zones for the continental United States were introduced at noon on November 18, 1883." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who played the kid in a bronx tale?", "passages": [ [ "A Bronx Tale (play)", "A Bronx Tale (play)\n\nA Bronx Tale is an autobiographical one-man show written and performed by Chazz Palminteri.", "It tells the coming-of-age story of Calogero Anello, a young New Yorker torn between the temptations of organised crime and the values of his hardworking father.", "It originally premiered in Los Angeles in the 1980s, before moving Off-Broadway.", "After a film version involving Palminteri and Robert DeNiro was released in 1993, in 2007 Palminteri performed his one-man show on Broadway and on tour.", "A musical version, \"A Bronx Tale\" directed by Robert DeNiro remained onstage into 2018, at the Longacre Theatre on Broadway.", "\"A Bronx Tale\" tells the story of Calogero Anello, a young boy from a working class family who gets involved in the world of organized crime.", "Calogero's father is a bus driver who tries to instill working-class family values in his son.", "As Calogero gets older, the aura and mystique of the Mafia, and the charms of Sonny, the local mob boss who befriends Calogero (and ends up becoming a father figure to him), become difficult to resist." ], [ "A Bronx Tale", "In 1960, Lorenzo Anello (Robert De Niro) lives in Belmont, an Italian-American neighborhood in The Bronx, with his wife Rosina and his 9-year-old son Calogero (Francis Capra), who is fascinated by the local mobsters led by Sonny LoSpecchio (Chazz Palminteri).", "One day, Calogero witnesses a murder committed by Sonny in defense of an assaulted friend in his neighborhood.", "When Calogero chooses to keep quiet when questioned by NYPD detectives, Sonny takes a liking to him and gives him the nickname \"C\".", "Sonny's men offer Lorenzo a better paying job, but Lorenzo, preferring a law-abiding life as an MTA bus driver, politely declines.", "Sonny befriends Calogero and introduces him to his crew.", "Calogero earns tips amounting to $600 working in the Mafia bar and throwing dice, and is admonished harshly by Lorenzo when he discovers it.", "Lorenzo speaks severely to Sonny, returns the money, and angrily warns him to keep away from Calogero.", "Eight years later, Calogero (Lillo Brancato) has grown into a young man who has been visiting Sonny regularly without his father's knowledge." ], [ "The Kid (2019 film)", "The Kid (2019 film)\n\n", "The Kid is an upcoming 2019 indie biographical western drama film directed by Vincent D'Onofrio, from a screenplay by Andrew Lanham, and is executive produced by Carl Stubner, through Suretone Pictures.", "The film stars Chris Pratt, Ethan Hawke, Dane DeHaan, Vincent D'Onofrio, Adam Baldwin, Jake Schur, and Keith Jardine.", "The story of a young boy (Jake Schur) who witnesses Billy the Kid (Dane DeHaan) encounter with Sheriff Pat Garrett (Ethan Hawke).", "In April 2017, Vincent D'Onofrio was announced to be directing and starring in the film as Sheriff Romero.", "Later that same month, Chris Pratt signed on as Grant Cutler.", "In July 2017, Dane DeHaan was cast as Billy the Kid, with the rest of the cast filled up by September.", "In October 2017, filming began in the Santa Fe, New Mexico area, and is currently in post-production." ] ], "gold": "A Bronx Tale is a 1993 American coming-of-age crime drama film adapted from Chazz Palminteri's 1989 play of the same name. It tells the coming of age story of an Italian-American boy, Calogero, who, after encountering a local Mafia boss, is torn between the temptations of organized crime and the values of his honest, hardworking father, as well as racial tensions in his community. Lillo Brancato, Jr. played the 9-year-old version of Calogero and Francis Capra played the 17-year-old version of Calogero in the film. Joe D'Onofrio played the 17-year-old Slick.", "prediction 1": "A Bronx Tale is an autobiographical one-man show written and performed by Chazz Palminteri. It tells the coming-of-age story of Calogero Anello, a young New Yorker torn between the temptations of organized crime and the values of his hardworking father. In 1960, Lorenzo Anello lives in Belmont, an Italian-American neighborhood in The Bronx, with his wife Rosina and his 9-year-old son Calogero, who is fascinated by the local mobsters led by Sonny LoSpecchio. As Calogero gets older, the aura and mystique of the local mob boss who becomes a father figure to him. As Calogero gets older, the charms of Sonny, and ends up becoming a father figure to him.\n", "prediction 2": "The character of Billy the Kid was played by Joe DiMaggio in the 1980s show A Bronx Tale. In the 1983 show, Johnny Swift played the character, while the 2006 version was played by Nicholas Nichols. In the 2009 show, Chloe Sevigny played the character. A Bronx Tale was made into a movie starring Vincent D'Onofrio, Matt Damon, Ethan Hawke, and Dane DeHaan. Then, in the 2019 indie Western drama film, the character was played by academy panel.", "prediction 3": "The character Billy the Kid is a fictionalized version of the character in the 1930s class warfare thriller A Bronx Tale. In A Bronx Tale, a young boy from a working-class family gets involved in organized crime and confronts the temptations that come with crime. The kid is played by Francis Capra in the 1985 Broadway production, and Dane DeHaan in the 2019 film The Kid.", "prediction 4": "The original A Bronx Tale play, \"A Bronx Tale\", was written and performed by Chazz Palminteri in 1980. In the 1989 production, James Delany played the role of Billy the Kid. In the 1990 film adaptation of \"A Bronx Tale\", Vincent D'Onofrio plays the role of Billy the Kid. The role of Billy the Kid is reinterpreted in the 2019 western drama film \"The Kid\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 163 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 462, "end": 565 }, { "error type": "Redundant", "explanation": "As Calogero gets older, the aura and mystique of the local mob boss who becomes a father figure to him. ", "start": 566, "end": 656 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 70 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "A Bronx Tale is an autobiographical one-man show by Chazz Palminteri. There is also a film version released in 1993. It tells the coming-of-age story of Calogero Anello, who is torn between the temptations of organized crime and the values of his hardworking father. Francis Capra played the 9-year-old Calogero. Lillo Brancato plays 17-year-old Calogero." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did the first large winter carnival take place in quebec city?", "passages": [ [ "Quebec Winter Carnival", "Quebec Winter Carnival\n\nThe Quebec Winter Carnival (), commonly known in both English and French as Carnaval, is a pre-Lenten festival held in Quebec City.", "After being held intermittently since 1894, the \"Carnaval de Qu\u00e9bec\" has been celebrated annually since 1955.", "That year \"Bonhomme Carnaval\", the mascot of the festival, made his first appearance.", "Up to one million people attended the \"Carnaval de Qu\u00e9bec\" in 2006 making it, at the time, the largest winter festival in the world (since overtaken by the Harbin Festival).", "The most famous attractions of this winter festival are the night-time and daytime parades led by mascot Bonhomme Carnaval.", "The parades wind through the upper city, decorated for the occasion with lights and ice sculptures.", "Numerous public and private parties, shows and balls are held across the city, some of them outside in the bitter cold, testimony to the Qu\u00e9b\u00e9cois' fabled joie de vivre.", "Other major events include:\n\nOutdoor dance parties are held at the Ice Palaces.", "Also not part of the official program but worth a visit or a stay, the Quebec City Ice Hotel is open every year from early January to late March with its bar, nightclub, exhibition galleries and ceremonial chapel." ] ], "gold": "The Quebec Winter Carnival is a pre-Lenten festival held in Quebec City. After being held intermittently since 1894, it has been celebrated annually since 1955. That year, Bonhomme Carnaval, the mascot of the festival, made his first appearance. Up to one million people attended the Carnaval de Qu\u00e9bec in 2006 making it, at the time, the largest winter festival in the world and it is currently the largest winter festival in the Western Hemisphere.", "prediction 1": "The Quebec Winter Carnival, commonly known in both English and French as Carnaval, is a pre-Lenten festival held in Quebec City. After being held intermittently since 1894, the \"Carnaval de Qu\u00e9bec\" has been celebrated annually since 1955. That year \"Bonhomme Carnaval\", the mascot of the festival, made his first appearance. Up to one million people attended the \"Carnaval de Qu\u00e9bec\" in 2006 making it, at the time, the largest winter festival in the world.\n", "prediction 2": "The first large winter carnival in Quebec City took place on January 11, 1955.", "prediction 3": "The Quebec Winter Carnival, commonly known in both English and French as Carnaval, is a pre-Lenten festival held in Quebec City. After being held intermittently since 1894, the \"Carnaval de Qu\u00e9bec\" has been celebrated annually since 1955. That year \"Bonhomme Carnaval\", the mascot of the festival, made his first appearance. Up to one million people attended the \"Carnaval de Qu\u00e9bec\" in 2006 making it, at the time, the largest winter festival in the world!", "prediction 4": "The Quebec Winter Carnival, commonly known in both English and French as Carnaval, is a pre-Lenten festival held in Quebec City. After being held intermittently since 1894, the \"Carnaval de Qu\u00e9bec\" has been celebrated annually since 1955. That year \"Bonhomme Carnaval\", the mascot of the festival, made his first appearance.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 28, "end": 82 } ], "missing-info": [], "corrected-prediction": "The Quebec Winter Carnival is a pre-Lenten festival held in Quebec City. After being held intermittently since 1894, the \"Carnaval de Qu\u00e9bec\" has been celebrated annually since 1955. That year \"Bonhomme Carnaval\", the mascot of the festival, made his first appearance. Up to one million people attended the \"Carnaval de Qu\u00e9bec\" in 2006 making it, at the time, the largest winter festival in the world.\n" }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who died in til death do us part?", "passages": [ [ "Death Do Us Part", "Death Do Us Part\n\nDeath Do Us Part is a 2014 horror film directed by Nicholas Humphries, and written by Julia Benson, Ryan Copple, and Peter Benson.", "A disheveled woman in a bridal gown is found stumbling along a highway, and is brought to a ranger station.", "As they wait for the sheriff, the only on-duty ranger asks the woman her name, and what happened to her.", "The bride refers to herself as Kennedy, and the film flashes back to the previous day, to when Kennedy, her fianc\u00e9 Ryan, Kennedy's half-sister Hannah, their friend Emily, Ryan's cousin Derrick, and Ryan's friend Chet travelled to a secluded cabin for a Stag and doe party.", "As the characters set up at the cabin, it is revealed that almost all of them have a dark secret; Kennedy's unspecified mental illness is flaring up due to wedding-related stress, Ryan is having an affair with Hannah, Derrick intends to extort Kennedy through Ryan in order to get the money he owes a drug dealer, and the caretaker, Bo, is the prime suspect in the disappearance of his wife, Susan.", "That night, while everyone else is participating in a scavenger hunt, Derrick is murdered with an axe." ], [ "Death Do Us Part", "Kennedy confronts Emily, who asserts that she slew Derrick and Hannah, and had intended to murder Ryan, to protect her, with Chet and Bo being collateral damage.", "Kennedy snaps, and strangles Emily.", "The film returns to the intro, and the bride lifts her veil to reveal that she is Emily, who had recovered, bludgeoned Kennedy, and taken her gown.", "The ranger offers his condolences for all that \"Kennedy\" has gone through, and when he gives Emily a pen to write down who he should contact for her, she stabs him in the neck with it, and walks out into the woods, leaving her fate unknown.", "Nav Qateel of \"1nflux Magazine\" said that, while \"Death Do Us Part\" had its shortcomings, it was still something \"I wouldn't hesitate recommending to anyone into horror\".", "A lukewarn review was given was by Christian Bates-Hardy of Rock!", "Shock!", "Pop!, who concluded, \"\"Death Do Us Part\" does a fairly good job of building tension up between the characters and establishing subplots and drama between them, but once it becomes a horror film the whole thing unravels and quickly becomes a directionless mess." ], [ "'Til Death Do Us Part (film)", "'Til Death Do Us Part (film)\n\n'Til Death Do Us Part is a 2017 American psychological thriller film written and directed by Christopher B. Stokes.", "The film stars Annie Ilonzeh, Stephen Bishop and Taye Diggs, who is also one of the film's producers.", "The film was released on September 29, 2017.", "Michael and Madison Roland have a seemingly perfect marriage, and are celebrating their first wedding anniversary.", "Madison brings up that she wants to start a family together but Michael becomes irritated as he does not want to start a family.", "Michael visits his mother\u2019s grave and talks to her headstone, it is revealed his mother and his father died the same year, and later it becomes known that they died in a murder-suicide.", "Michael is happy when Madison quits her job to become a full time wife.", "Madison finds a vial of steroidal testosterone which Michael has been taking in order not to get her pregnant.", "She confronts him, they argue, and he slaps her, knocking her to the ground.", "Later, Madison excitedly shows her friend, Chelsea a positive pregnancy test.", "Four months later, Madison secretly gets a job working with Chelsea, and confides in her that Michael has questioned the paternity of the baby, and has been abusive." ] ], "gold": "'Til Death do us Part' is a same title for movies that came out in different years. In the 2017 film, Michael Roland died in the movie. In the 2014 film, by the same name, Derrick Harris died in early in the movie while the ranger died at the end.", "prediction 1": "Death Do Us Part is a 2014 horror film that was written by Julia Benson, Ryan Copple, and Peter Benson. A disheveled woman in a bridal gown is found stumbling along a highway, and is brought to a ranger station. As they wait for the sheriff, the only on-duty ranger asks the woman her name, and what happened to her. The film then flashes back to the previous day, to when Kennedy, her fianc\u00e9 Ryan, Kennedy's half-s sister Hannah, their friend Emily, Ryan's cousin Derrick, and Ryan's friend Chet, Ryan's friend Chet, and Ryan's friend Chet are the prime suspect in the disappearance of his wife, Susan.\n", "prediction 2": "The 2014 stand-alone horror film Death Do Us Part mentions multiple deaths. In the 2017 movie, Til Death Do Us Part, the actors who died include Ryan Urban, Emily Loop, Hannah Lansbury, Paul Michelle Strahovski, and Kara Collins.", "prediction 3": "Death Do Us Part is a 2014 horror film starring Julianne Benson, Ryan Sprague, and the character of Kennedy. She, Ryan's half-sister Hannah, their friend Emily, her fianc\u00e9 Ryan, Ryan's cousin Derrick, and Ryan's friend Chet travelled to a secluded cabin for a Stag and doe party. That night, while everyone else is participating in a scavenger hunt, Derrick is murdered with an axe. That night, while everyone else is participating in a scavenger hunt, Ryan's cousin Derrick is murdered with an axe.", "prediction 4": "Death Do Us Part is a 2014 American horror film that was released in the year 2014. The film's protagonist is named Kennedy, and the film flashes to the previous day when Kennedy, her fianc\u00e9 Ryan, her half-sister Hannah, their friend Emily, Ryan's cousin Derrick, and Ryan's friend Chet travelled to a secluded cabin for a Stag and Doe party. In the film, Michael Roland meets his mother in the year 2015, his father dies in the same year.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 604 }, { "error type": "Irrelevant", "explanation": "", "start": 27, "end": 33 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1, 3, 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "Films with 'Til Death Do Us Part' is the title for a couple of movies. Death Do Us Part is a 2014 film where the character Derrick is murdered as well as Hannah. Kennedy, and the ranger. 'Til Death Do Us Part is also a 2017 film.\n" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was tge great wall of china built?", "passages": [ [ "Great Wall of China", "Great Wall of China\n\nThe Great Wall of China is a series of fortifications made of stone, brick, tamped earth, wood, and other materials, generally built along an east-to-west line across the historical northern borders of China to protect the Chinese states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion.", "Several walls were being built as early as the 7th century\u00a0BC; these, later joined together and made bigger and stronger, are collectively referred to as the Great Wall.", "Especially famous is the wall built in 220\u2013206\u00a0BC by Qin Shi Huang, the first Emperor of China.", "Little of that wall remains.", "The Great Wall has been rebuilt, maintained, and enhanced over various dynasties; the majority of the existing wall is from the Ming Dynasty (1368\u20131644).", "Apart from defense, other purposes of the Great Wall have included border controls, allowing the imposition of duties on goods transported along the Silk Road, regulation or encouragement of trade and the control of immigration and emigration.", "Furthermore, the defensive characteristics of the Great Wall were enhanced by the construction of watch towers, troop barracks, garrison stations, signaling capabilities through the means of smoke or fire, and the fact that the path of the Great Wall also served as a transportation corridor.", "The frontier walls built by different dynasties have multiple courses." ], [ "Women in China", "However, as Kathryn Bernhardt, a scholar of Chinese history points out, nearly one in three women during the Song dynasty (960-1279 C.E.) would either have no brothers or no sons, leaving them with some agency over family property.", "In these cases, unmarried daughters would receive their fathers\u2019 property in the absence of direct male descendants, or an unmarried widow would choose the family heir.", "A new law enacted during the Ming dynasty (1368-1644 C.E.) required that in the absence of a direct male descendant, a man's property was to go to his nephews.", "With this change in law, women's access to private property was restricted.", "At that point, only if none of a man's sons and none of his brothers' sons were alive to inherit property would a daughter receive the inheritance.", "In most cases, the most control over family property that a widow would receive was maintenance, or the agency to control the property while an heir came of age.", "In some cases after some reforms in the Qing Dynasty (1644-1912), some women could retain maintenance over undivided property even after their sons came of age.", "Law during the Republican era interpreted this to mean that widows held complete power over sons in control of family property." ] ], "gold": "The Great Wall of China is the collective name of a series of fortification systems generally built across the historical northern borders of China to protect and consolidate territories of Chinese states and empires against various nomadic groups of the steppe and their polities. Several walls were being built from as early as the 7th century BC by ancient Chinese states. The most well-known sections of the wall were built by the Ming dynasty (1368-1644).", "prediction 1": "The Great Wall of China is a series of fortifications made of stone, brick, tamped earth, wood, and other materials, generally built along an east-west line across the historical northern borders of China to protect the Chinese states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion. Several walls were being built as early as the 7th century BC; these, later joined together and made bigger and stronger, are collectively referred to as the Great Wall.\n", "prediction 2": "The Great Wall of China is a series of fortifications, generally built along an east-west line across the historical northern borders of China to protect the Chinese states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion. Several walls were being built as early as the 7th century BC, while it was later joined together and made bigger and stronger.", "prediction 3": "There are multiple Great Walls of China, built over thousands of years, each of which was used to protect various states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion. The Great Wall was originally built in 776 BC, but it has been rebuilt, maintained, and enhanced over various dynasties and even during times of political turmoil. The first Great Wall of China was built during the Ai Shi Huang, the 3rd Emperor of China, in a new law enacted during the Ming Dynasty, a book making it possible that all descendants of the 2 800 C.E.", "prediction 4": "Great Wall of China is a series of fortifications made of stone, brick, tamped earth, wood, and other materials, generally built along an east-west line across the historical northern borders of China to protect the Chinese states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion. Several walls were being built as early as the 7th century BC, and some were even being built as early as 209 BC by Emperor Qin Shi Huang, the first Emperor of China, while the Great Wall was built during the Ming Dynasty between 1368-1644 C.E. The Great Wall has been rebuilt, strengthened, and remodeled after the Ming the Ming Dynasty, but its current state government has rarely much of the WRC, and men's ownership of this Wall.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 421, "end": 528 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Great Wall of China is a series of fortifications made of stone, brick, tamped earth, wood, and other materials, generally built along an east-west line across the historical northern borders of China to protect the Chinese states and empires against the raids and invasions of the various nomadic groups of the Eurasian Steppe with an eye to expansion. Several walls were being built as early as the 7th century BC. The majority of the existing wall is from the Ming Dynasty (1368\u20131644).\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Everybody loves raymond robert dates 22 year old?", "passages": [ [ "Everybody Loves Raymond", "Everybody Loves Raymond\n\nEverybody Loves Raymond is an American sitcom television series created by Philip Rosenthal that aired on CBS from September 13, 1996, to May 16, 2005, with a total of 210 episodes spanning over nine seasons.", "It was produced by Where's Lunch and Worldwide Pants, in association with HBO Independent Productions.", "The cast members are Ray Romano, Patricia Heaton, Brad Garrett, Doris Roberts, Peter Boyle, Madylin Sweeten, and Monica Horan.", "Most episodes of the nine season series were filmed in front of a live studio audience, with a few exceptions.", "The show is centered on the life of an Italian-American everyman named Raymond Barone, a sportswriter for \"Newsday\" living with his family in Long Island.", "Beleaguered, diffident and dryly sarcastic, Raymond takes few things seriously, making jokes in nearly every situation, no matter how troubling or serious.", "He often avoids responsibilities around the house and with his kids, leaving this to wife Debra.", "Raymond and Debra have a daughter Ally (Alexandra) and twin sons Michael and Geoffrey (originally Matthew and Gregory in the pilot).", "The Barone children are regular characters but not a major focus.", "Raymond's parents, Marie and Frank, live across the street with older son Robert (who, later in the series, has his own apartment)." ], [ "Bob cut", "Bob cut\n\nA bob cut or bob is a short- to medium-length haircut for women (and occasionally men) in which the hair is typically cut straight around the head at about jaw-level, often with a fringe (or \"bangs\") at the front.", "The bob is cut at the level of ears, below the ears or above shoulders.", "Historically, women in the West have usually worn their hair long.", "Although young girls, actresses and a few \"advanced\" or fashionable women had worn short hair even before World War I\u2014for example in 1910 the French actress Polaire is described as having \"a shock of short, dark hair\", a cut she adopted in the early 1890s\u2014the style was not considered generally respectable until given impetus by the inconvenience of long hair to girls engaged in war work.", "English society beauty Lady Diana Cooper, who had had bobbed hair as a child, kept the style through her teenage years and continued in 1914 as an adult.", "Renowned dancer and fashion trendsetter Irene Castle introduced her \"Castle bob\" to a receptive American audience in 1915, and by 1920 the style was rapidly becoming fashionable." ] ], "gold": "In the CBS sitcom Everybody Loves Raymond, Robert dates a 22-year-old in the episode named Young Girl, which was Season 5 Episode 8, episode number 105 overall, and dated November 13, 2000.", "prediction 1": "Everybody Loves Raymond is an American sitcom television series created by Philip Rosenthal that aired on CBS from September 13, 1996, to May 16, 2005, with a total of 210 episodes spanning over nine seasons. In the show, Raymond dates 22 year old Robert, who is played by Robert's older brother, Michael.\n", "prediction 2": "Everybody Loves Raymond is an American comedy television series and movie that focuses on the life of an Italian American family in Long Island. A 22 year old actor plays the character of Robert on the show. Onscreen, a 22 year old is Robert's younger brother. Onscreen, the character of Robert is named Walter.", "prediction 3": "Everybody Loves Raymond is an American sitcom television series that aired on CBS from September 13, 1996, to May 16, 2005, with a total of 210 episodes spanning over nine seasons. In the episode \"A Remembrance of Mother Goose,\" Raymond's little brother Robert, played by Robert Ludlum, was shown with 22-year-old girlfriend Julia.", "prediction 4": "Everybody Loves Raymond is an American sitcom television series created by Philip Rosenthal that aired on CBS from September 13, 1996, to May 16, 2005, with a total of 210 episodes spanning over nine seasons. Robert is 29 years old and the oldest character, portraying a man with short, curly hair. Robert and his mother live with the author's parents at 36 Second Avenue in Brooklyn, New York. The character's younger sister Ally is 22 years old, while younger brother Michael is 22 years old.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 30, "end": 38 }, { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 91 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 208 }, { "error type": "Unverifiable", "explanation": "", "start": 209, "end": 306 } ], "missing-info": [], "corrected-prediction": "Everybody Loves Raymond is a sitcom that aired on CBS.\n" }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Where is the major league baseball draft held?", "passages": [ [ "Major League Baseball draft", "Major League Baseball draft\n\nThe first-year player draft is Major League Baseball's primary mechanism for assigning amateur baseball players from high schools, colleges, and other amateur baseball clubs to its teams.", "The draft order is determined based on the previous season's standings, with the team possessing the worst record receiving the first pick.", "The most recent draft was held on June 4\u20136, 2018.", "The first amateur draft was held in 1965.", "Unlike most sports drafts, the first-year player draft is held mid-season, in June.", "Another distinguishing feature of this draft in comparison with those of other North American major professional sports leagues is its sheer size: under the current collective bargaining agreement the draft lasts 40 rounds, plus compensatory picks.", "In contrast, the NFL draft lasts for seven rounds (a maximum of 256 selections), the NHL entry draft lasts seven rounds and roughly 215 picks, and the NBA draft lasts for only two rounds (60 selections).", "Major League Baseball has used a draft to assign minor league players to teams since 1921.", "In 1936, the National Football League held the first amateur draft in professional sports.", "A decade later, the National Basketball Association instituted a similar method of player distribution.", "However, the player draft was controversial.", "Congressman Emanuel Celler questioned the legality of drafts during a series of hearings on the business practice of professional sports leagues in the 1950s." ], [ "Secaucus, New Jersey", "Panasonic's North American headquarters, with of offices and of warehouse space, had been located in Secaucus since 1973.", "After considering new locations in New York, California and Georgia, the company announced it would relocate to Newark and would receive an Urban Transit Hub Tax Credit of $102 million from the State of New Jersey for the relocation from its Secaucus location.", "The company also cited the environmental benefits possible by reducing the need of 1,000 employees to drive to work.", "As of the 2014\u201315 NBA season, Secaucus became the official review headquarters of the National Basketball Association.", "All reviews of controversial calls and plays take place in the replay center.", "Referees consult the headquarters for guidance on the correct call.", "The high-tech center features over 94 HD televisions, with multiple feeds of every live NBA game.", "Sports companies headquartered in Secaucus include Red Bull New York, Major League Baseball's MLB Network, ", "National Hockey League's NHL Network,\nand NBA Entertainment/NBA TV (whose studios are also the site of the NBA Draft Lottery).", "It is also home to men's soccer team Secaucus FC, which is part of the Garden State Soccer League, and was founded in 2003 by Nick Farinola.", "Secaucus was the headquarters of Major League Lacrosse for the first four seasons of the league." ] ], "gold": "Major League Baseball has used a draft to assign minor league players to teams since 1921. The 2015, 2016 and 2017 Major League Baseball drafts have been held in Secaucus, New Jersey, the headquarters of Major League Baseball's MLB Network.", "prediction 1": "The first-year player draft is Major League Baseball's primary mechanism for assigning amateur baseball players from high schools, colleges, and other amateur baseball clubs to its teams. The draft order is determined based on the previous season's standings, with the team possessing the worst record receiving the first pick. The most recent draft was held on June 4\u20136, 2018.\n", "prediction 2": "The first-year player draft is Major League Baseball's primary mechanism for assigning amateur baseball players from high schools, colleges, and other amateur baseball clubs to its teams. The draft order is determined based on the previous season's standings, with the team possessing the worst record receiving the first pick. Like most sports drafts, the first-year player draft is held mid-season, in June. Since 1965, Major League Baseball has used a draft to assign minor league players to teams. From 1973 to 2018, the major league baseball draft was held in Secaucus, New Jersey.", "prediction 3": "The Major League baseball draft is Major League Baseball's primary mechanism for assigning amateur baseball players from high schools, colleges, and other amateur baseball clubs to its teams. The league's second annual amateur draft is held in Sacramento, California on June 24, 2020. The second annual amateur draft is held in Newark, New Jersey on June 22, 2021.", "prediction 4": "The major league baseball draft is held mid-season in June. It is the primary mechanism for assigning amateur baseball players from high schools, colleges, and other amateur baseball clubs to Major League Baseball teams. The most recent draft was held on June 4\u20136, 2018. The most recent amateur draft was held on June 2\u20133, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 187 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 378 }, { "error type": "Irrelevant", "explanation": "", "start": 188, "end": 327 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": " Major League Baseball has used a draft to assign minor league players to teams since 1921. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings i wanna be a billionaire?", "passages": [ [ "Billionaire (song)", "Billionaire (song)\n\n\"Billionaire\" is the debut single by American recording artist Travie McCoy, featuring guest vocals from Bruno Mars.", "It is the lead single from McCoy's debut studio album, \"Lazarus\".", "The song was produced by The Smeezingtons, which consists of Mars, Philip Lawrence and Ari Levine.", "Lyrically, McCoy imagines what would happen if he became a billionaire, referencing all the good he would do to others with the money along with his desire to be on the cover of \"Forbes\" magazine, \"smiling next to Oprah and The Queen\".", "As of July 2011, the song has sold 3 million digital downloads, making it Mars' third single to do so.", "The song was also included in Mars' performance in Super Bowl XLVIII halftime show in 2014.", "It was released in the UK via digital download on July 26, 2010.", "It became McCoy's most successful single to date.", "Bruno Mars came up with the lyrical concept for \"Billionaire\" during a trip to London in which he was given \u00a3240 ($350) by his record label to live on for 11 days.", "He found the amount of money to be insufficient, and explained \"We were like, 'Is this the biggest mistake we've ever made?", "We thought we were broke in California; what are we going to do here?'" ], [ "Billionaire (song)", "McCoy later joined The Smeezingtons in the studio to complete the full song.", "The radio edit of the song replaces the word \"Fucking\" with \"freaking\" and is 3:06 long instead of 3:30.", "The radio edit is available for download on iTunes.", "The music video appeared in MTV animated series \"Beavis and Butthead\" in the episode \"Whorehouse\".", "The song features a \"reggae backbeat\" and acoustic guitar.", "\"Billionaire\" is \"acoustic pop-reggae\" and presages Mars' \"Doo-Wops & Hooligans\", as \"laid-back soft rock, with gentle reggae inflections, hang-loose sentiments and all.\"", "In January 2014, Bruno Mars and Travie McCoy were sued by Demetrius Orlandus Procter regarding copyright infringement allegations made by Procter relating to \"Billionaire\"; Procter accused the song's authors of stealing the song from him, despite the fact that Procter didn't put any dollar amount on what he was owed.", "In the lawsuit, McCoy and Mars were requested to take charge to \"destroy all copies of Plaintiffs' Recording that Defendants have downloaded onto any computer hard drive or server without Plaintiffs' authorization and shall destroy all copies of that downloaded recording transferred onto any physical medium or device.\"" ] ], "gold": "2010 reggae and pop-rap song \"Billionaire\" is performed by Travie McCoy featuring Bruno Mars. The song was co-written by Travie McCoy, Bruno Mars, Philip Lawrence, and Ari Levine and showcases lead vocalists Mars and McCoy singing lyrics written by Mars and Levine.", "prediction 1": "\"Billionaire\" is the debut single by American recording artist Travie McCoy, featuring guest vocals from Bruno Mars. It is the lead single from McCoy's debut studio album, Lazarus. As of July 2011, the song has sold 3 million digital downloads, making it Mars' third single to do so. The song was also included in Mars' performance in Super Bowl XLVIII halftime show in 2014.\n", "prediction 2": "\"Billionaire\" is the debut single by American recording artist Travie McCoy, featuring guest vocals from Bruno Mars. Lyrically, McCoy imagines what would happen if he became a billionaire, referencing all the good he would do to others with the money together with his desire to be on the cover of Forbes magazine, smiling next to Oprah and The Queen. It was also included in Mars' performance in Super Bowl XLVIII halftime show in 2014.", "prediction 3": "Several artists have sang i wanna be a billionaire. In fact, many artists have recorded a version of the song, while others have also performed it. Travie McCoy sings the lead vocals for the song and Bruno Mars provides a background vocal. There are several other songs with the title \"Billionaire\".", "prediction 4": "\"Billionaire\" is the debut single by American recording artist Travie McCoy, featuring guest vocals from Bruno Mars. The song is the lead single from McCoy's debut studio album, Lazarus. As of July 2011, the song has sold 3 million digital downloads, making it Mars' third single to do so. Mars and McCoy were also sued by Demetrius Orlandus Procter regarding copyright infringement allegations made by Procter relating to the song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 376 } ], "missing-info": [], "corrected-prediction": "\"Billionaire\" is the debut single by American recording artist Travie McCoy, featuring guest vocals from Bruno Mars." }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "When will the man who killed don quixote be released?", "passages": [ [ "The Man Who Killed Don Quixote", "Gilliam made repeated attempts to relaunch production between 2003 and 2016, which included Depp, Ewan McGregor and Jack O'Connell as Toby Grisoni and Robert Duvall, Michael Palin, and John Hurt as Quixote.", "However, all ended up being cancelled for various reasons, such as failing to secure funds, Depp's busy schedule and eventual loss of interest in the project, and Hurt being diagnosed with the cancer that would eventually result in his death.", "After yet another failed attempt", ", it was unexpectedly reported in March 2017 that filming had finally started, with Driver, who was confirmed in 2016 and helped secure funding as Grisoni, and Jonathan Pryce as Quixote.", "On 4 June Gilliam announced that the shooting of the film was complete, 17 years after it originally started.", "The film premiered on 19 May 2018, simultaneously acting as the closing film at the 2018 Cannes Film Festival and being released in French theaters.", "Gilliam has struggled to release \"The Man Who Killed Don Quixote\" worldwide since then, partially due to a lengthy legal dispute with former producer Paulo Branco, and the film was only released in a few other countries.", "On 17 December 2018, the film was confirmed for a US release in March 2019." ], [ "Lost in La Mancha", "Lost in La Mancha\n\nLost in La Mancha is a 2002 documentary film about the making of Terry Gilliam's unfinished film \"The Man Who Killed Don Quixote\".", "His effort was a film adaptation of the novel \"Don Quixote\" by Miguel de Cervantes.", "The documentary was shot in 2000 during Gilliam's first attempt to make the film, as an intended work of the genre known as the \"making-of\".", "But Gilliam's failure to complete his movie resulted in the documentary filmmakers retitling their work as \"Lost in la Mancha\" and releasing it independently.", "Written and directed by Keith Fulton and Louis Pepe, \"Lost in La Mancha\" presents Gilliam's effort to make \"Don Quixote\" as a parallel to Quixote's quest to become a hero.", "It co-stars Johnny Depp, Jean Rochefort, and Vanessa Paradis, who were cast as stars for \"The Man Who Killed Don Quixote\".", "It is narrated by Jeff Bridges.", "Gilliam ultimately succeeded in making \"The Man Who Killed Don Quixote\", which was released in 2018.", "Fulton and Pepe have made a follow-up documentary, titled \"He Dreamed of Giants\", which will cover Gilliam's entire scope of work on the Quixote project.", "It is in production." ], [ "The Man Who Killed Don Quixote", "On 17 December 2018, Screen Media Films acquired the North American rights to the film and set a March 2019 release.", "Critical response for the film at the Cannes Film Festival was mostly positive.", "On review aggregator Rotten Tomatoes, the film holds an approval rating of 63%, based on 25 reviews with an average rating of 5.7/10.", "Metacritic gives the film a weighted average rating of 54 out of 100, based on 10 critics, indicating \"mixed or average reviews\".", "Peter Dubruge with \"Variety\" magazine called the film \"a loud, belligerent, barely coherent mess\", stating \"the result feels like evidence of someone [Gilliam] who spent too long obsessing over Don Quixote, losing sight somewhere along the way of whatever attracted him in the first place.\"", "Gregory Ellwood at \"Collider\" felt that the film \"simply doesn\u2019t live up to its storied legacy in the annals of Hollywood film development\", giving it a C rating.", "Ben Croll writing for \"TheWrap\" called \"The Man Who Killed Don Quixote\" \"an awful lot of fun.", "Of course, the fun can be far from perfect." ], [ "They Shall Not Grow Old", "The simulcast included a special post-screening Q&A with Jackson, hosted by film critic Mark Kermode.", "The film was broadcast on BBC Two on 11 November 2018, the one-hundredth anniversary of the Armistice of 11 November 1918.", "To accompany the film, a special episode of the documentary series \"What Do Artists Do All Day?\" which followed Peter Jackson making the film aired the following day on BBC Four.", "The film received a limited US release through Fathom Events in 2D and 3D, on 17 and 27 December 2018.", "On review aggregator Rotten Tomatoes, the film holds an approval rating of 98% based on 57 reviews, with an average rating of 8.7/10.", "The website's critical consensus reads, \"An impressive technical achievement with a walloping emotional impact, \"They Shall Not Grow Old\" pays brilliant cinematic tribute to the sacrifice of a generation.\"", "On Metacritic, which assigns a normalized rating based on reviews, the film has a weighted average score of 91 out of 100, based on 10 critics, indicating \"universal acclaim\".", "In a very positive review for \"The Guardian\", Peter Bradshaw called the film \"a visually staggering thought experiment\", saying \"The effect is electrifying.", "The soldiers are returned to an eerie, hyperreal kind of life in front of our eyes, like ghosts or figures summoned up in a seance." ] ], "gold": "The Man Who Killed Don Quixote premiered on 19 May 2018, simultaneously acting as the closing film at the 2018 Cannes Film Festival and being released in French theaters. The film's director Gilliam faced difficulties in the process of releasing the film worldwide, partially due to a lengthy legal dispute with former producer Paulo Branco. Subsequently, the film was only released in a few other countries, including Spain on 1 June 2018, Belgium on 25 July 2018 and Portugal on 27 December 2018. The film was released in the United States and Canada on 10 April 2019 and in the United Kingdom and Ireland on 31 January 2020.", "prediction 1": "The Man Who Killed Don Quixote is a 2018 American epic adventure film directed by Terry Gilliam and written by Keith Fulton and Louis Pepe. The film is a sequel to Lost in La Mancha, a 2002 documentary film about Gilliam's unfinished film The Man Who Killed Don Quixote. The film premiered at the 2018 Cannes Film Festival and was released in French theaters. The film was broadcast on BBC Two on 11 November 2018, the one-hundredth anniversary of the Armistice of 11 November 1918.\n", "prediction 2": "The documentary film Lost in La Mancha was a 2002 attempt by Terry Gilliam to make a film adaptation of the novel Don Quixote. However, Gilliam's failure to complete his movie resulted in the documentary filmmakers retitling their work as Lost in La Mancha and releasing it independently. On 17 December 2018, Screen Media Films acquired the North American rights to the film and set a March 2019 release date. The Man Who Killed Don Quixote was first shown at the 2016 Cannes Film Festival and premiered at the 2018 Festival.", "prediction 3": "In 1983, Terry Gilliam planned to make a film about the adventures of Don Quixote and his compassion for those less fortunate, based on the novel published by Miguel de Cervantes, which was titled The Man Who Killed Don Quixote. However, his failed attempts to relaunch production between 2003 and 2016 were cancelled for various reasons, such as failing to secure funds, Depp's busy schedule and eventual loss of interest in the project, and Hurt being diagnosed with the cancer that would eventually result of the project. The Man Who Killed Don Quixote premiered on 19 May 2018, simultaneously acting as the closing film at the 2018 Cannes Film Festival and being released independently. On 17 December 2018, Screen Media Films acquired the North American rights to the film and set a March 2019 release.", "prediction 4": "Warner Bros bought the rights to the Peter Jackson documentary, The Man Who Killed Don Quixote, to screen in the US in March 2019. On 17 December 2018, the film was confirmed for a US release in March 2019. Gilliam has struggled to release The Man Who Killed Don Quixote worldwide since then, partially due to a lengthy legal dispute with former producer Paulo Branco.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 41, "end": 64 }, { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 139 }, { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 270 }, { "error type": "Redundant", "explanation": "The Man Who Killed Don Quixote is a 2018 American epic adventure film ", "start": 271, "end": 279 }, { "error type": "Redundant", "explanation": "The Man Who Killed Don Quixote is a 2018", "start": 297, "end": 301 }, { "error type": "Irrelevant", "explanation": "", "start": 360, "end": 483 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Man Who Killed Don Quixote, a 2018 film directed by Gilliam, premiered on 19 May at the Cannes Film Festival and was simultaneously released in French theaters. It has struggled to release worldwide since then, partially due to a lengthy legal dispute with former producer Paulo Branco, and was only released in a few other countries, but was confirmed for a US release in March 2019.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many episodes of ncis have there been?", "passages": [ [ "NCIS: New Orleans", "NCIS: New Orleans\n\nNCIS:", "New Orleans is an American television series combining elements of the military drama and police procedural genres that premiered on Tuesday, September 23, 2014, following its parent series \"NCIS\".", "The pilot was written by Gary Glasberg.", "The series stars Scott Bakula and CCH Pounder, and is executively produced by Glasberg, Mark Harmon, James Hayman and Chris Silber.", "The series is set and filmed in New Orleans.", "It is the third series of the \"NCIS\" franchise.", "On April 18, 2018, CBS renewed the series for a fifth season.", "The season premiered on September 25, 2018.", "\"NCIS: New Orleans\" follows a fictional team of Naval Criminal Investigative Service (NCIS) agents stationed out of New Orleans, Louisiana and led by Special Agent Dwayne Cassius Pride (Scott Bakula).", "The team focuses on crimes that involve personnel in the United States Navy and Marine Corps, and their territory ranges from the Mississippi River to the Texas Panhandle." ] ], "gold": "NCIS is an American police procedural television series, revolving around a fictional team of special agents from the Naval Criminal Investigative Service combining elements of the military drama and police procedural genres. By the end of Season 13, there were a total of 306 episodes. By the end of Season 14, there were 330 episodes. By the end of 2017, there were 340 episodes.", "prediction 1": "NCIS: New Orleans is an American television series combining elements of the military drama and police procedural genres that premiered on Tuesday, September 23, 2014, following its parent series NCIS. There have been 5 seasons of NCIS.\n", "prediction 2": "NCIS: New Orleans, an American military drama television series developed by Gary Glasberg, plus elements of the military drama and police procedural genres, was released in April 2014 and had 53 episodes as of September 25, 2018. NCIS: New Orleans: Season 4 was the third season of the NCIS franchise, and had fifty-one episodes as of September 24, 2018. NCIS: New Orleans: Season 5 was the fifth season, and had fifty episodes as of September 25, 2018.", "prediction 3": "NCIS: New Orleans is an American television series combining elements of the military drama and police procedural genres that premiered on Tuesday, September 23, 2014, following its parent series NCIS. Each episode consists of 5 episodes and a total of 87 minutes.", "prediction 4": "NCIS: New Orleans is an American television series combining elements of the military drama and police procedural genres that premiered on September 23, 2014, following its parent series NCIS. There have been 5 seasons of NCIS. Season 5 aired on September 25, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 201 } ], "missing-info": [], "corrected-prediction": "NCIS: New Orleans is an American television series combining elements of the military drama and police procedural genres. There have been 5 seasons of NCIS.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "How many books are there in the new testament of the bible?", "passages": [ [ "New Testament", "Other early Christian gospels such as the so-called \"Jewish-Christian Gospels\" or the Gospel of Thomas, also offer both a window into the context of early Christianity and may provide some assistance in the reconstruction of the historical Jesus.", "The Acts of the Apostles is a narrative of the apostles' ministry and activity after Christ's death and resurrection, from which point it resumes and functions as a sequel to the Gospel of Luke.", "Examining style, phraseology, and other evidence, modern scholarship generally concludes that Acts and the Gospel of Luke share the same author, referred to as Luke\u2013Acts.", "Luke-Acts does not name its author.", "Church tradition identified him as Luke the Evangelist, the companion of Paul, but the majority of scholars reject this due to the many contradictions between Acts and the authentic Pauline letters.", "The most probable date of composition is around 80\u2013100 AD, and there is evidence that it was still being substantially revised well into the 2nd century.", "The epistles of the New Testament are considered by Christians to be divinely inspired and holy letters, written by the apostles and disciples of Christ, to either local congregations with specific needs, or to New Covenant Christians in general, scattered about; or \"Catholic Epistles.\"", "The Pauline epistles are the thirteen New Testament books that present Paul the Apostle as their author.", "Six of the letters are disputed." ], [ "New Testament", "Four are thought by most modern scholars to be pseudepigraphic, i.e., not actually written by Paul even if attributed to him within the letters themselves.", "Opinion is more divided on the other two disputed letters (2 Thessalonians and Colossians).", "These letters were written to Christian communities in specific cities or geographical regions, often to address issues faced by that particular community.", "Prominent themes include the relationship both to broader \"pagan\" society, to Judaism, and to other Christians.", "[Disputed letters are marked with an asterisk (*).]", "The last four Pauline letters in the New Testament are addressed to individual persons.", "They include the following:\n[Disputed letters are marked with an asterisk (*).", "] All of the above except for Philemon are known as the Pastoral epistles.", "They are addressed to individuals charged with pastoral oversight of churches and discuss issues of Christian living, doctrine and leadership.", "They often address different concerns to those of the preceding epistles.", "These letters are believed by many to be pseudepigraphic.", "Some scholars (e.g., Bill Mounce, Ben Witherington) will argue that the letters are genuinely Pauline, or at least written under Paul's supervision." ], [ "Development of the New Testament canon", "Many Evangelical Christian groups (which have their origin in c. 1730 England) do not accept the theory that the Christian Bible was not known until various local and Ecumenical Councils, which they deem to be \"Roman-dominated\", made their official declarations.", "These groups believe that the New Testament supports that Paul (2 Timothy 4:11\u201313), Peter (2 Peter 3:15\u201316), and ultimately John (Revelation 22:18\u201319) finalized the canon of the New Testament.", "Some note that Peter, John, and Paul wrote 20 (or 21) of the 27-books of the NT and personally knew all the other NT writers.", "(Books not attributed to these three are: Matthew, Mark, Luke, Acts, James, and Jude.", "The authorship of Hebrews has long been disputed.)", "Many modern Protestants point to four \"Criteria for Canonicity\" to justify the books that have been included in the Old and New Testament, which are judged to have satisfied the following:\n\nThe basic factor for recognizing a book's canonicity for the New Testament was divine inspiration, and the chief test for this was apostolicity.", "The term \"apostolic\" as used for the test of canonicity does not necessarily mean apostolic authorship or derivation, but rather \"apostolic authority\".", "\"Apostolic authority\" is never detached from the authority of the Lord." ], [ "Books of the Bible", "Books of the Bible\n\nDifferent religious groups include different books in their biblical canons, in varying orders, and sometimes divide or combine books.", "Christian Bibles range from the 73 books of the Catholic Church canon, the 66 books of the canon of some denominations or the 80 books of the canon of other denominations of the Protestant Church, to the 81 books of the Ethiopian Orthodox Tewahedo Church canon.", "The Tanakh (sometimes called the Hebrew Bible) contains 24 books divided into three parts: the five books of the \"Torah\" (\"teaching\"); the \"Nevi'im\" (\"prophets\"); and the \"Ketuvim\" (\"writings\").", "The first part of Christian Bibles is called the Old Testament, which contains, at minimum, the above 24 books but divided into 39 books and ordered differently.", "The Catholic Church and Eastern Christian churches also hold that certain deuterocanonical books and passages are part of the Old Testament canon.", "The second part is the New Testament, containing 27 books; the four Canonical gospels, Acts of the Apostles, 21 Epistles or letters and the Book of Revelation." ] ], "gold": "The New Testament is the second division of the Christian biblical canon. The Pauline letters to churches are the thirteen New Testament books that present Paul the Apostle as their author. The last four Pauline letters in the New Testament are addressed to individual persons. These four gospels that were eventually included in the New Testament were only a few among many other early Christian gospels. There are 27 books total in the New Testament.", "prediction 1": "The New Testament is the Bible that contains all of the books of the New Testament. The Acts of the Apostles is a narrative of the apostles' ministry and activity after Christ's death and resurrection, from which point it resumes and functions as a sequel to the Gospel of Luke. The Pauline epistles are the thirteen New Testament books that present Paul the Apostle as their author. Six of the letters are disputed. The last four Pauline letters in the New Testament are addressed to individual persons.\n", "prediction 2": "There are 27 books in the New Testament of the biblical Bible. Additional books in the New Testament are the Pauline epistles and the Hebrew Bible.", "prediction 3": "The New Testament includes 27 books, the majority of which are disputed. Nearly all of the majority of the books in the New Testament are found in the New Testament, the majority of which are considered by some religious groups to be part of the Old Testament, and other groups generally regard the whole of the New Testament as one text. The Pauline epistles are 13 books that present Paul the Apostle as their author.", "prediction 4": "The New Testament is the complete and uniquely inspired Bible of the Bible. Its total number of books contains the words, phrases, and ideas of all the major apostles not just Paul, but also of those who preceded and followed them. The apostles wrote 11 of the 26 books of the New Testament. Paul wrote 13 of the 26 books. The Pauline epistles are the thirteen New Testament books that present Paul the Apostle as their author. The 16 books of the New Testament present Paul as their author.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 4, "end": 61 }, { "error type": "Redundant", "explanation": "The New Testament is the Bible that contains all of the books ", "start": 62, "end": 83 }, { "error type": "Irrelevant", "explanation": "", "start": 84, "end": 278 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 416 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 4, 6 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": "The New Testament is the second part of the Christian Bibles. The Pauline epistles are the thirteen New Testament books that present Paul the Apostle as their author. The last four Pauline letters in the New Testament are addressed to individual persons. There were other early Christian gospels as well. The New Testament contains 27 books.\n" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many episodes of season 5 hell on wheels?", "passages": [ [ "Hell on Wheels (TV series)", "Hell on Wheels (TV series)\n\n", "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States.", "The series, which featured Anson Mount, Colm Meaney, Common, and Dominique McElligott, chronicled the Union Pacific Railroad and its laborers, mercenaries, prostitutes, surveyors, and others who lived, worked, and died in the mobile encampment, called \"Hell on Wheels\", that followed the railhead west across the Great Plains.", "In particular, the story focused on Cullen Bohannon (Mount), a former Confederate soldier who, while working as foreman and chief engineer on the railroad, initially attempted to track down the Union soldiers who murdered his wife and young son during the American Civil War.", "The series, which broadcast in the United States and Canada on the cable channel AMC, aired from November 6, 2011 to July 23, 2016.", "The series was created and produced by Joe and Tony Gayton, and developed by Endemol USA, under the stewardship of senior vice-president of scripted programming Jeremy Gold, and it is produced by Entertainment One and Nomadic Pictures.", "In 2012, AMC announced creators Joe and Tony Gayton were no longer involved in the day-to-day production of the series." ], [ "Hell on Wheels (season 5)", "Hell on Wheels (season 5)\n\n", "The fifth and final season of the AMC television series \"Hell on Wheels\" premiered on July 18, 2015 and comprised 14 episodes.", "The season was evenly split; the first half aired in late 2015, and the second half aired in mid-2016.", "This season, set in California and Laramie, Wyoming, focused on the race to complete America's First Transcontinental Railroad, as Cullen Bohannon switched from working with the Union Pacific to the Central Pacific Railroad, upon the CP developer's promise to help find Cullen's family.", "The fifth season features 13 series regulars; with Tim Guinee, Byron Mann, Reg Rogers, Angela Zhou, and Chelah Horsdal added to the main cast.", "On November 7, 2014, AMC renewed \"Hell On Wheels\" for a fifth and final season, consisting of 14 episodes, which premiered July 18, 2015.", "AMC also announced the season would be split into two parts, with half the episodes to air in 2015 and the other half beginning July 2016.", "About the season, showrunner John Wirth stated: \"The end of the story is written down in history, so we know how the story would end for the railroad.\"", "He added: \"What we didn't know is how the story would end for each of our characters, especially the ones that we created." ] ], "gold": "Hell on Wheels is an American/Canadian Western television series about the construction of the First Transcontinental Railroad across the United States, which broadcast on the cable channel AMC, from November 6, 2011 to July 23, 2016. The fifth and final season of the AMC television series Hell on Wheels premiered on July 18, 2015 and comprised 14 episodes. The season was evenly split. Season 5 part 1 consisted of 7 episodes that aired in late 2015, and season 5 part 2 consisted of 7 episodes that aired in mid-2016.", "prediction 1": "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States. The series, which featured Anson Mount, Colm Meaney, Common, and Dominique McElligott, chronicled the Union Pacific Railroad and its laborers, mercenaries, prostitutes, surveyors, and others who lived, worked, and died in the mobile encampment, called \"Hell on Wheels\", that followed the railhead west across the Great Plains.\n", "prediction 2": "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States. Season 5 of Hell on Wheels consisted of 14 episodes. This season focused on the race to complete America's First Transcontinental Railroad, as Cullen Bohannon switched from working with the Union Pacific Railroad to the Central Pacific Railroad, upon the Central Pacific Railroad developer's promise to help find Cullen's family.", "prediction 3": "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States. The series, which featured Anson Mount, Colm Meaney, Common, and Dominique McElligott, chronicled the Union Pacific Railroad and its laborers, mercenaries, prostitutes, surveyors, and others who lived, worked, and died in the mobile encampment, called \"Hell on Wheels\", that followed the railhead west across the Great Plains, in the United States. On November 7, 2014, AMC renewed \"Hell on Wheels\" for a fifth and final season which consisted of 14 episodes and consisted of 13 series regulars. The fifth and final season was evenly split into two parts, with half of episodes to air in 2015 and the other half aired in 2016.", "prediction 4": "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States. The series, which featured Anson Mount, Colm Meaney, Common, and Dominique McElligott, chronicled the Union Pacific Railroad and its laborers, mercenaries, prostitutes, surveyors, and others who lived, worked, and died in the mobile encampment, called \"Hell on Wheels\", that followed the railhead west across the Great Plains. Season 5 premiered on July 18, 2015, comprised of 14 episodes. Season 5 consisted of 12 episodes. In 2016, Hell on Wheels was split into two.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 144, "end": 230 }, { "error type": "Irrelevant", "explanation": "", "start": 231, "end": 471 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Hell on Wheels is an American Western television series about the construction of the First Transcontinental Railroad across the United States, which broadcast on the cable channel AMC, from November 6, 2011 to July 23, 2016. A fifth and final season, consisting of 14 episodes, which premiered July 18, 2015, would be split into two parts, with half the episodes to air in 2015 and the other half beginning July 2016.\n" }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who has the most super bowls as a player?", "passages": [ [ "Mike Lodish", "Mike Lodish\n\nMichael Timothy \"Mike\" Lodish (born August 11, 1967) is a former professional American football player who was selected by the Buffalo Bills in the tenth round of the 1990 NFL Draft.", "A 6'3\", 270-lb. defensive tackle and nose tackle from UCLA, Lodish played in 11 NFL seasons from 1990-2000 for the Bills and Denver Broncos.", "Lodish is tied with Don Beebe for second in all-time Super Bowl appearances with six.", "This is only behind Tom Brady, who played in his eighth Super Bowl on February 4, 2018 at Super Bowl LII in Minneapolis, Minnesota.", "(It is worth noting that Lodish \"played\" in the Super Bowl six times, while Beebe only played in three of the six Super Bowls he was on the team for).", "Lodish made four consecutive appearances with the Buffalo Bills in Super Bowls XXV, XXVI, XXVII & XXVIII and two appearances with the Denver Broncos in Super Bowls XXXII & XXXIII.", "The Buffalo Bills would lose all four consecutive Super Bowls, while the Denver Broncos would win their back-to-back appearances.", "Lodish has worked as an NFL player agent at Ethos Sports Management from 2004-2009 and was a sales rep for a Michigan-based communications company, TVS Communication Solutions from 2009-2011." ] ], "gold": "Tom Brady holds the record for most Super Bowl wins as a player. He also holds the record for most Super Bowl starts and appearances.", "prediction 1": "Mike Lodish is a former professional American football player who played in 11 NFL seasons from 1990-2000 for the Bills and Denver Broncos. He is tied with Don Beebe for second in all-time Super Bowl appearances with six. This is only behind Tom Brady, who played in his eighth Super Bowl on February 4, 2018 at Super Bowl LII in Minneapolis, Minnesota.\n", "prediction 2": "Tom Brady has played in the most Super Bowls as a professional American football player. Don Beebe has played in the most Super Bowls as a player with five and Manning has the most Super Bowls as a player with six.", "prediction 3": "There are several former professional American football players, but only one with the most Super Bowl appearances. For instance, Tom Brady has appeared in at least one Super Bowl as an individual. Don Beebe has played in the most Super Bowls as a player with six.", "prediction 4": "Mike Lodish has played in the most Super Bowls in the NFL. Tom Brady currently holds the record for the most Super Bowl appearances in the NFL with seven. Additionally, Don Beebe is the player with the most Super Bowl appearances in the NFL.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 241 }, { "error type": "Irrelevant", "explanation": "", "start": 253, "end": 354 } ], "missing-info": [], "corrected-prediction": "Tom Brady has the record for the most Superbowl appearances.\n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "One who is converted from one religion to another?", "passages": [ [ "Religious conversion", "\"Proselytism\" is the act of attempting to convert by persuasion another individual from a different religion or belief system.", "(See proselyte).", "Apostate is a term used by members of a religion or denomination to refer to someone who has left that religion or denomination.", "In sharing their faith with others, Bah\u00e1'\u00eds are cautioned to \"obtain a hearing\" \u2013 meaning to make sure the person they are proposing to teach is open to hearing what they have to say.", "\"Bah\u00e1'\u00ed pioneers\", rather than attempting to supplant the cultural underpinnings of the people in their adopted communities, are encouraged to integrate into the society and apply Bah\u00e1'\u00ed principles in living and working with their neighbors.", "Bah\u00e1'\u00eds recognize the divine origins of all revealed religion, and believe that these religions occurred sequentially as part of a divine plan (see Progressive revelation), with each new revelation superseding and fulfilling that of its predecessors.", "Bah\u00e1'\u00eds regard their own faith as the most recent (but not the last), and believe its teachings \u2013 which are centered around the principle of the oneness of humanity \u2013 are most suited to meeting the needs of a global community.", "In most countries conversion is a simple matter of filling out a card stating a declaration of belief." ], [ "Religious conversion", "\"No one shall be subject to coercion which would impair his freedom to have or to adopt a religion or belief of his choice\" (Article 18.2).", "The UNCHR issued a General Comment on this Article in 1993:", "\"The Committee observes that the freedom to 'have or to adopt' a religion or belief necessarily entails the freedom to choose a religion or belief, \"including the right to replace one's current religion or belief with another\" or to adopt atheistic views", "[...] Article 18.2 bars coercion that would impair the right to have or adopt a religion or belief, including the use of threat of physical force or penal sanctions to compel believers or non-believers to adhere to their religious beliefs and congregations, to recant their religion or belief \"or to convert\".\"", "(CCPR/C/21/Rev.1/Add.4, General Comment No. 22.; emphasis added)\n\n", "Some countries distinguish voluntary, motivated conversion from organized proselytism, attempting to restrict the latter.", "The boundary between them is not easily defined: what one person considers legitimate evangelizing, or witness-bearing, another may consider intrusive and improper." ], [ "Religious conversion", "Religious conversion\n\nReligious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others.", "Thus \"religious conversion\" would describe the abandoning of adherence to one denomination and affiliating with another.", "This might be from one to another denomination within the same religion, for example, from Baptist to Catholic Christianity or from Shi\u2019a to Sunni Islam.", "In some cases, religious conversion \"marks a transformation of religious identity and is symbolized by special rituals\".", "People convert to a different religion for various reasons, including active conversion by free choice due to a change in beliefs, secondary conversion, deathbed conversion, conversion for convenience, marital conversion, and forced conversion.", "Conversion or reaffiliation for convenience is an insincere act, sometimes for relatively trivial reasons such as a parent converting to enable a child to be admitted to a good school associated with a religion, or a person adopting a religion more in keeping with the social class they aspire to.", "When people marry, one spouse may convert to the religion of the other.", "Forced conversion is adoption of a different religion under duress.", "The convert may secretly retain the previous beliefs and continue, covertly, with the practices of the original religion, while outwardly maintaining the forms of the new religion.", "Over generations a family forced against their will to convert may wholeheartedly adopt the new religion." ], [ "Forced conversion", "After the end of the Islamic control of Spain, Jews were expelled from Spain in 1492.", "In Portugal, following an order for their expulsion in 1496, only a handful were allowed to leave and the rest were forced to convert.", "Muslims were expelled from Portugal in 1497, and they were gradually forced to convert in the constituent kingdoms of Spain.", "The forced conversion of Muslims was implemented in the Crown of Castile from 1500\u201302 and in the Crown of Aragon in the 1520s.", "After the conversions, the so-called \"New Christians\" were those inhabitants (Sephardic Jews or Mud\u00e9jar Muslims) who were baptized under coercion and in the face of execution, becoming forced converts from Islam (Moriscos, Conversos and \"secret Moors\") or from Judaism (Conversos, Crypto-Jews and Marranos).", "After the forced conversion, when all former Muslims and Jews had ostensibly become Catholic, the Spanish Inquisition targeted primarily forced converts from Judaism, who came under suspicion of either continuing to adhere to their old religion or having fallen back into it.", "Jewish conversos still resided in Spain and often practised Judaism secretly and were suspected by the \"Old Christians\" of being Crypto-Jews.", "The Spanish Inquisition generated much wealth and income for the church and individual inquisitors by confiscating the property of the persecuted." ] ], "gold": "Religious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others. Proselytism is the act of attempting to convert by persuasion another individual from a different religion or belief system. Apostate is a term used by members of a religion or denomination to refer to someone who has left that religion or denomination. For some it is a forced convert, where one is forced under duress, some have a deathbed conversion, where they convert on their deathbeds, and others do a secondary convert, that is they convert because of a relationship. ", "prediction 1": "Religious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others. Thus, \"religious conversion\" would describe the abandoning of adherence to one particular religious denomination and affiliating with another. This might be from one to another denomination within the same religion, for example, from Baptist to Catholic Christianity or from Shi\u2019a to Sunni Islam. Apostate is a term used by members of a religion or denomination to refer to someone who has left that religion or denomination.\n", "prediction 2": "Religious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others. Thus, a religious convert will abandon adherence to one religion and affiliate with another. There are several different forms of religious conversion, which include active conversion due to a change in beliefs, secondary conversion, deathbed conversion, conversion for convenience, marital conversion, and forced conversion, in which the person is forced under duress to adopt another religion.", "prediction 3": "In many countries, the act of converting a person to another religion is done with the only expectation that the person will abandon their previous religion.", "prediction 4": "Religious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others. Thus, \"religious conversion\" would describe the abandoning of adherence to one denomination and affiliating with another, or one who is converted from one religion to another under duress. It may be voluntary, as in most countries, but some distinguish voluntary, motivated conversion from organized proselytism, attempting to restrict the former. For example, a Jew may be converted from Judaism to Christianity. Another person may be a Jewlands or 1130, Iraq by international treaty.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 139, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 435 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "Religious conversion is the adoption of a set of beliefs identified with one particular religious denomination to the exclusion of others. \"Proselytism\" is the act of attempting to convert by persuasion another individual from a different religion or belief system. Apostate is a term used by members of a religion or denomination to refer to someone who has left that religion or denomination. For some it is a forced convert, where one is forced under duress, some have a deathbed conversion, they convert because of a relationship, and others do a secondary convert.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the first car made what year?", "passages": [ [ "History of the automobile", "History of the automobile\n\nThe early history of the automobile can be divided into a number of eras, based on the prevalent means of propulsion.", "Later periods were defined by trends in exterior styling, size, and utility preferences.", "In 1769 the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot.", "In 1808, Fran\u00e7ois Isaac de Rivaz designed the first car powered by an internal combustion engine fueled by hydrogen.", "In 1870 Siegfried Marcus built the first gasoline powered combustion engine, which he placed on a pushcart, building four progressively sophisticated combustion-engine cars over a 10-to-15-year span that influenced later cars.", "Marcus created the two-cycle combustion engine.", "The car's second incarnation in 1880 introduced a four-cycle, gasoline-powered engine, an ingenious carburetor design and magneto ignition.", "He created an additional two models further refining his design with steering, a clutch and a brake.", "The four-stroke petrol (gasoline) internal combustion engine that still constitutes the most prevalent form of modern automotive propulsion was patented by Nikolaus Otto.", "The similar four-stroke diesel engine was invented by Rudolf Diesel.", "The hydrogen fuel cell, one of the technologies hailed as a replacement for gasoline as an energy source for cars, was discovered in principle by Christian Friedrich Sch\u00f6nbein in 1838." ], [ "History of the automobile", "The battery electric car owes its beginnings to \u00c1nyos Jedlik, one of the inventors of the electric motor, and Gaston Plant\u00e9, who invented the lead\u2013acid battery in 1859.", "In 1885, Karl Benz developed a petrol or gasoline powered automobile.", "This is also considered to be the first \"production\" vehicle as Benz made several other identical copies.", "The automobile was powered by a single cylinder four-stroke engine.", "In 1913, the Ford Model T, created by the Ford Motor Company five years prior, became the first automobile to be mass-produced on a moving assembly line.", "By 1927, Ford had produced over 15,000,000 Model T automobiles.", "At the turn of the 20th century electrically powered automobiles became a popular alternative method of automobile propulsion although they still only comprise a small percentage of automobiles on the road today with about 3 million in use across the globe.", "The early history of the automobile was concentrated on the search for a reliable portable power unit to propel the vehicle.", "Ferdinand Verbiest, a member of a Jesuit mission in China, built a steam-powered vehicle around 1672 as a toy for the Chinese Emperor.", "It was small scale and could not carry a driver but it was, quite possibly, the first working steam-powered vehicle ('auto-mobile')." ], [ "History of the automobile", "Steam-powered self-propelled vehicles large enough to transport people and cargo were first devised in the late 18th century.", "Nicolas-Joseph Cugnot demonstrated his \"fardier \u00e0 vapeur\" (\"steam dray\"), an experimental steam-driven artillery tractor, in 1770 and 1771.", "As Cugnot's design proved to be impractical, his invention was not developed in his native France.", "The center of innovation shifted to Great Britain.", "By 1784, William Murdoch had built a working model of a steam carriage in Redruth and in 1801 Richard Trevithick was running a full-sized vehicle on the roads in Camborne.", "The first automobile patent in the United States was granted to Oliver Evans in 1789.", "During the 19th century attempts were made to introduce practical steam powered vehicles.", "Innovations such as hand brakes, multi-speed transmissions and better steering developed.", "Some commercially successful vehicles provided mass transit until a backlash against these large vehicles resulted in the passage of legislation such as the United Kingdom Locomotive Act (1865), which required many self-propelled vehicles on public roads to be preceded by a man on foot waving a red flag and blowing a horn.", "This effectively halted road auto development in the UK for most of the rest of the 19th century; inventors and engineers shifted their efforts to improvements in railway locomotives." ], [ "History of the automobile", "His second car is on display at the Technical Museum in Vienna.", "During his lifetime he was honored as the originator of the motorcar but his place in history was all but erased by the Nazis during World War II.", "Because Marcus was of Jewish descent, the Nazi propaganda office ordered his work to be destroyed, his name expunged from future textbooks, and his public memorials removed, giving credit instead to Karl Benz.", "It is generally acknowledged that the first really practical automobiles with petrol/gasoline-powered internal combustion engines were completed almost simultaneously by several German inventors working independently: Karl Benz built his first automobile in 1885 in Mannheim.", "Benz was granted a patent for his automobile on 29 January 1886, and began the first production of automobiles in 1888, after Bertha Benz, his wife, had proved \u2013 with the first long-distance trip in August 1888, from Mannheim to Pforzheim and back \u2013 that the horseless coach was absolutely suitable for daily use.", "Since 2008 a Bertha Benz Memorial Route commemorates this event.", "Soon after, Gottlieb Daimler and Wilhelm Maybach in Stuttgart in 1889 designed a vehicle from scratch to be an automobile, rather than a horse-drawn carriage fitted with an engine." ] ], "gold": "In 1769 the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot. The first hydrogen-powered car was made in 1808. Development was hindered in the mid-19th century by a backlash against large vehicles, yet progress continued on some internal combustion engines. The first diesel-powered car was made in 1870. The first gasoline-powered car was made in 1885. In 1913, the Ford Model T, created by the Ford Motor Company five years prior, became the first automobile to be mass-produced on a moving assembly line. By 1927, Ford had produced over 15,000,000 Model T automobiles.", "prediction 1": "The early history of the automobile can be divided into a number of eras, based on the prevalent means of propulsion. Later periods were defined by trends in exterior styling, size, and utility preferences. In 1769 the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot. In 1808, Fran\u00e7ois Isaac de Rivaz designed the first car powered by an internal combustion engine fueled by hydrogen. In 1870 Siegfried Marcus built the first gasoline powered combustion engine, which he placed on a pushcar, building four progressively sophisticated combustion-engine cars over a 10-to-15-year span that influenced later cars. In 1885, Karl Benz developed a petrol or gasoline powered automobile. This is also considered to be the first \"production\" vehicle as Benz made several other identical copies.", "prediction 2": "The early history of the automobile can be divided into a number of eras, based on the prevalent means of propulsion. Later periods were defined by trends in exterior styling, size, and utility preferences. In 1769 the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot. In 1808, Fran\u00e7ois Isaac de Rivaz designed the first car powered by an internal combustion engine fueled by hydrogen. In 1870 Siegfried Marcus built the first gasoline powered combustion engine, which he placed on a pushcar.", "prediction 3": "The first automobile was built in 1769 by Nicolas-Joseph Cugnot, as a steam-powered vehicle capable of human transportation. In 1808, Fran\u00e7ois Isaac de Rivaz designed the first car powered by an internal combustion engine fueled by hydrogen. In 1870 Siegfried Marcus built the first gasoline-powered car. In 1913, the Ford Model T, created by the Ford Motor Company five years prior, became the first automobile to be mass-produced on a moving assembly line.", "prediction 4": "The early history of the automobile can be divided into various eras, based on the prevalent means of propulsion. The era of steam was when the first automobile was built, and the era of internal combustion was when the first car was designed. In 1769, the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot, and in 1808, Fran\u00e7ois Isaac de Rivaz designed the first car powered by an internal combustion engine fueled by hydrogen. In 1870, Siegfried Marcus built the first gasoline powered combustion engine, he placed on a pushcar, building four progressively sophisticated combustion-engine cars over a 10-to-15-year span that influenced later cars. Karl Benz developed a petrol or gasoline powered automobile, which is also considered to be the first \"production\" vehicle as Benz made several other identical copies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Irrelevant", "explanation": "", "start": 118, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 359 }, { "error type": "Irrelevant", "explanation": "", "start": 443, "end": 459 }, { "error type": "Irrelevant", "explanation": "", "start": 512, "end": 541 }, { "error type": "Irrelevant", "explanation": "", "start": 542, "end": 660 }, { "error type": "Irrelevant", "explanation": "", "start": 731, "end": 836 }, { "error type": "Irrelevant", "explanation": "", "start": 670, "end": 679 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 10 ] } ], "corrected-prediction": "In 1769 the first steam-powered automobile capable of human transportation was built by Nicolas-Joseph Cugnot. In 1808, the first car powered by an internal combustion engine fueled by hydrogen was made. Development was hindered in the mid-19th century by a backlash against large vehicles. In 1870 the first gasoline powered combustion engine was built. In 1885, a petrol or gasoline powered automobile was made. In 1913, the Ford Model T, created by the Ford Motor Company five years prior, became the first automobile to be mass-produced on a moving assembly line. By 1927, Ford had produced over 15,000,000 Model T automobiles." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Whos the person with the most followers on instagram?", "passages": [ [ "Cristiano Ronaldo", "He topped the list for the second straight year with earnings of $93\u00a0million in 2016\u201317.", "Ronaldo is one of the world's most marketable athletes: \"SportsPro\" rated him the fifth most marketable athlete in 2012, and eighth most marketable athlete in 2013, with Brazilian footballer Neymar topping both lists.", "Sports market research company Repucom named Ronaldo the most marketable and most recognised football player in the world in May 2014.", "He was additionally named in the 2014 Time 100, \"Time\"s annual list of the most influential people in the world.", "ESPN named Ronaldo the world's most famous athlete in 2016, 2017 and 2018.", "Ronaldo has established a strong online presence; the most popular sportsperson on social media, he counted 158\u00a0million total followers across Facebook, Twitter and Instagram by June 2015.", ", he has the world's biggest Facebook fanbase with 103\u00a0million followers: he became the first sportsperson to reach 50\u00a0million followers in August 2010, and in October 2014, he became the first sportsperson, and the second person after Shakira, to reach 100\u00a0million followers.", "By June 2017, Ronaldo had 277\u00a0million followers across social media.", "His sponsors earned $936\u00a0million in media value across his social media accounts between June 2016 to June 2017." ], [ "Celebrity branding", "Companies can simply tag the username for the businesses Instagram page to allow other potential consumers to browse through that Instagram account in just one click.", "The culture of advertising on Instagram came naturally when businesses realized that celebrities have a direct means of communication to their target demographic.", "According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers.", "By partnering with one of these celebrities, businesses are already reaching an engaged and targeted audience of 30 million people.", "Many of America's top-earning celebrities Instagram accounts are continually promoting products such as health supplements, vitamins and detox teas.", "These aren't spontaneous proclamations, but rather posts paid for by brands to advertise products to the celebrities' sizable following.", "On Instagram alone a profile with three-to-seven million followers can charge as much as $75,000 per endorsement, even a profile with 50,000 to 500,000 followers might make $1000 for a post on Instagram.", "At the top end of the digital celebrity pay scale some posts can earn around $300,000, especially when Instagram pictures can be easily linked to other social media platforms such as Facebook or Twitter.", "One of the celebrities that is most well known for promoting brands on her Instagram page is Kim Kardashian." ] ], "gold": "The most followed man on Instagram is Portuguese footballer Cristiano Ronaldo with over 340 million followers. The most followed woman is Ariana Grande. The brand Instagram has an account with 420 million followers, making it the most followed account overall.", "prediction 1": "The person with the most followers on Instagram is Portuguese footballer Cristiano Ronaldo.\n", "prediction 2": "In 2014, Rui Patricio became the person with the most followers on Instagram. According to the Telegraph (2015), the ten most popular Instagram accounts are all celebrities who all have around 30 million followers. In 2016, Wally West had 260 million followers while Kanye West had 276 million followers.", "prediction 3": "A number of professional athletes have become the most followed person on Instagram. Just like Twitter, Instagram draws in a large community of fans and advertisers because it is a fast-growing social media platform. The person with the most followers on Instagram is Portuguese footballer Cristiano Ronaldo.", "prediction 4": "The person with the most followers on Instagram is Brazilian footballer Cristiano Ronaldo.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 92 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Which is the capital city of andhra pradesh?", "passages": [ [ "Andhra Pradesh", "Andhra Pradesh\n\nAndhra Pradesh () () is one of the 29 states of India.", "Situated in the south-east of the country, it is the eighth-largest state in India, covering an area of .", "As per the 2011 census, it is the tenth most populous state, with 49,386,799 inhabitants.", "The largest city in Andhra Pradesh is Visakhapatnam.", "Telugu, one of the Classical Languages of India, is the majority and official language of Andhra Pradesh.", "On 2 June 2014, the north-western portion of Andhra Pradesh was separated to form the new state of Telangana; the longtime capital of Andhra Pradesh, Hyderabad, was transferred to Telangana as part of the division.", "However, in accordance with the Andhra Pradesh Reorganisation Act, 2014, Hyderabad was to remain as the \"de jure\" capital of both Andhra Pradesh and Telangana states for a period of time not exceeding ten years.", "The new riverfront \"de facto\" capital, Amaravati, is under the jurisdiction of the Andhra Pradesh Capital Region Development Authority (APCRDA).", "Andhra Pradesh has a coastline of \u2013 the second longest coastline among the states of India, after Gujarat \u2013 with jurisdiction over almost 15,000\u00a0km of territorial waters." ], [ "Coastal Andhra", "Coastal Andhra\n\nCoastal Andhra (Telugu: \u0c24\u0c40\u0c30 \u0c06\u0c02\u0c27\u0c4d\u0c30 \"\"), is a region in the state of Andhra Pradesh, India.", "This region was part of Madras State before 1953 and Andhra State from 1953 to 1956.", "According to the 2011 census, it has an area of which is 57.99% of the total state area and a population of 34,193,868 which is 69.20% of Andhra Pradesh state population.", "This area includes the coastal districts of Andhra Pradesh between the Eastern Ghats and the Bay of Bengal, from the northern border with Odisha to Pulicat lake of South.", "Coastal Andhra has rich agricultural land, owing to the delta of the Godavari Krishna river and Penna.", "The prosperity of Coastal Andhra can be attributed to its rich agricultural land and an abundant water supply from these three rivers.", "Rice grown in paddy fields is the main crop, with pulses and coconuts also being important.", "The fishing industry is also important to the region.", "The state of Andhra emerged to a political power during the reign of Maurya Dynasty.", "Megasthenes mentioned that Andhra was a flourishing empire of the Satavahanas' since even before the common era.", "Coastal Andhra was also ruled by the famous Chalukyas in between the period of the 7th Century and the 10th century CE." ] ], "gold": "Andhra Pradesh, a state in India, has several capital cities. The city recognized as its de jure capital city after 2014 is Hyderabad. Its joint capital city is Amaravati, the new riverfront de facto capital founded in 2014. Hyderabad, the state's longtime capital, was transferred to the state of Telangana in 2014 but was to remain the acting capital of both states for a period of time not exceeding ten years.", "prediction 1": "The capital of Andhra Pradesh, or Andhra Pradesh, is Hyderabad. The new riverfront \"de facto\" capital, Amaravati, is under the jurisdiction of the Andhra Pradesh Capital Region Development Authority (APCRDA).\n", "prediction 2": "The capital of Andhra Pradesh, Hyderabad, is located in the south-east of India, in the taluk of Telangana. The state's capital is in the remote region of Coastal Andhra. The tehsil of Amaravati is located 16 km to the south of Hyderabad.", "prediction 3": "The capital of Andhra Pradesh, Hyderabad, is located in the south-east of India, and is also the largest city in the south-east. Hyderabad was the capital of Andhra Pradesh from 1956 to 2014 until the newly formed state of Telangana was created. In April 2016, the state's new capital, Amaravati, was chosen, but the title was later temporarily taken by Telangana.", "prediction 4": "Andhra Pradesh, a state in India, is the eighth-largest and tenth most populous state with a total area of 83.568 sq km. According to the 2011 census it is the tenth most populous state in India, with 49,386,799 inhabitants. The capital city of Andhra Pradesh is Visakhapatnam. Amaravati, the new riverfront \"de facto\" capital, has replaced Hyderabad as the capital.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The capital of Andhra Pradesh, ", "start": 31, "end": 49 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 209 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The capital of Andhra Pradesh, is Hyderabad, which was transferred to Telangana in 2014, but was to remain the acting capital of both states for a period of time not exceeding ten years. The new riverfront \"de facto\" capital is Amaravati." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did live like you were dying come out?", "passages": [ [ "Live Like You Were Dying", "Live Like You Were Dying\n\nLive Like You Were Dying is the eighth studio album by American country music artist Tim McGraw.", "It was released on August 24, 2004, by Curb Records and was recorded in a mountaintop studio in upstate New York.", "It entered the \"Billboard\" 200 chart at number one, with sales of 766,000 copies in its first week.", "The album was certified 4 x Platinum by the RIAA for shipping four million copies, and was nominated for two Grammies in 2005 for Best Country Vocal Performance Male and Best Country Album, winning for Best Country Vocal Performance.", "Five singles were released from the album, all were top 15 hits on the Hot Country Songs chart, two of which hit #1.", "The title track was the first single from the album.", "The song peaked at number 1 on the \"Billboard\" Hot Country Songs chart, held it for seven weeks, and peaked at number 29 on the \"Billboard\" Hot 100.", "The song won a Grammy Award for Best Male Country Vocal Performance.", "The music video for the title track prominently featured McGraw's father, former baseball player Tug McGraw, who had died of brain cancer.", "This song was also the number one country song of 2004 according to Billboard Year-End.", "The next single from this album is \"Back When\", which also reached #1 on \"Billboard\" Hot Country Songs chart." ], [ "Live Like We're Dying", "Live Like We're Dying\n\n\"Live Like We're Dying\" is a song written by Danny O'Donoghue, Andrew Frampton, Mark Sheehan, and Steve Kipner.", "It appeared as a bonus track on The Script's self-titled debut studio album, and a B-side for some of the album's singles.", "It is better known for being performed by American recording artist Kris Allen.", "The song serves as the lead single from his self-titled major label debut album.", "It was released for digital download on September 21, 2009.", "The song received positive reviews, peaking at eighteen in the United States, and charting on other U.S. charts, including the top ten of the Pop Songs.", "It also charted abroad in Canada and New Zealand.", "The song's accompanying music video, which takes place in a desert and features a countdown clock in conjunction with the song's meaning, was received warmly, and according to critics, was an end to the low-budget, storyline-centered, debut music videos from previous \"American Idol\" alumni.", "The song had been recorded by Irish band The Script as a bonus track for the Japanese release of their self-titled debut album and a B-side track for their debut single \"We Cry\" in Australia, Finland, Great Britain, Ireland, New Zealand, Sweden, and Switzerland." ] ], "gold": "The song Live Like You Were Dying was released on June 7, 2004. It was part of Tim McGraw's album with the same name, that was released on August 24, 2004. A song with a similar title, Live Like We're Dying, written by Danny O'Donoghue, Andrew Frampton, Mark Sheehan and Steve Kipner, was released on September 21, 2009.", "prediction 1": "Live Like You Were Dying is a song by American country music artist Tim McGraw. It was released on August 24, 2004, by Curb Records. The song served as the lead single from American recording artist Kris Allen's self-titled major label debut album.\n", "prediction 2": "\"Live Like You Were Dying\" is a song by American country music artist Tim McGraw. It was released on August 24, 2004, by Curb Records. It was the lead single from McGraw's self-titled major label debut album, which was released for digital download on September 21, 2009.", "prediction 3": "\"Live Like You Were Dying\" is a song by American country music artist Tim McGraw that was released as the title track for his eighth studio album on August 24, 2004. It also served as the lead single from his self-titled major label debut album, which was released for digital download on September 21, 2009.", "prediction 4": "Live Like You Were Dying is a song by American country music artist Tim McGraw. It was released on August 24, 2004, by Curb Records. The song served as a bonus track on Irish band The Script's self-titled debut studio album, and a B-side for some of the album's singles. All of the songs on this album reached number one on the Billboard Hot Country Songs chart. The song won a Grammy Award for Best Male Country Vocal Performance in 2005.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 116, "end": 132 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1, 6 ] } ], "corrected-prediction": "Live Like You Were Dying is a song on the Tim McGraw album of the same name which was released on August 24, 2004. A song with a similar title, Live Like We're Dying, written by Danny O'Donoghue, Andrew Frampton, Mark Sheehan and Steve Kipner, was released on September 21, 2009." }, "preference": [ 0, 1, 2, 1, 2, 2 ] }, { "question": "Who is the head of state of morocco?", "passages": [ [ "Prime Minister of Morocco", "Prime Minister of Morocco\n\nThe Prime Minister of Morocco (officially Head of Government) is the head of government of the Kingdom of Morocco and serves in a position akin to a prime minister in other constitutional monarchies.", "The Prime Minister is chosen by the king of Morocco from the largest party elected to parliament.", "The Constitution of Morocco grants executive powers to the government and allows the head of government to propose and dismiss cabinet members, provincial governors, and ambassadors, to oversee government programs and the delivery of public services, and to dissolve the lower house of parliament with the king's approval.", "A newly appointed Prime Minister is responsible for forming the government it will head by leading negotiations between the king and parliament to fill ministry positions.", "Until the new government is approved by the king and formally takes office, parliament approves and oversees government programs and public service.", "There are no constitutional limits on a president's term, and several have served multiple non-consecutive terms.", "Unlike typical presidential systems where the president is the highest ranking leader of the executive branch and is considered both head of government and head of state, the Moroccan head of state is the king who holds substantial discretionary power over the executive branch and has exclusive authority over the military, religion, and the judiciary." ], [ "Abdelilah Benkirane", "Abdelilah Benkirane\n\nAbdelilah Benkirane (Arabic: \u0639\u0628\u062f \u0627\u0644\u0625\u0644\u0647 \u0628\u0646\u0643\u064a\u0631\u0627\u0646, born 2 April 1954) is a Moroccan politician who was Prime Minister of Morocco from November 2011 to March 2017.", "After having won a plurality of seats in the 2011 parliamentary election, his party, the moderate Islamist Justice and Development Party formed a coalition with three parties that had been part of previous governments.", "During the 1970s, Benkirane was a leftist political activist.", "He has represented Sal\u00e9 in the Moroccan parliament since 14 November 1997.", "He was elected leader of the Justice and Development Party in July 2008, taking over from Saadeddine Othmani.", "Benkirane's politics are democratic and Islamist.", "In a 2011 interview he said: \"If I get into government, it won't be so I can tell young women how many centimeters of skirt they should wear to cover their legs.", "That's none of my business.", "It is not possible, in any case, for anyone to threaten the cause of civil liberties in Morocco\".", "However, he has in the past described secularism as \"a dangerous concept for Morocco\", and in 2010 he campaigned, unsuccessfully, to ban a performance in Rabat by Elton John because it \"promoted homosexuality\".", "Benkirane became Prime Minister on 29 November 2011." ], [ "2016 Moroccan general election", "2016 Moroccan general election\n\nGeneral elections were held in Morocco on 7 October 2016.", "The ruling Justice and Development Party remained the largest party, winning 125 of the 395 seats in the House of Representatives, a gain of 18 seats compared to the 2011 elections.", "Saadeddine Othmani was appointed as Prime Minister by King Mohammed VI and formed his cabinet on 5 April 2017, including the PJD, the National Rally of Independents (RNI), the Popular Movement (MP), the Constitutional Union (UC), the Party of Progress and Socialism (PPS) and the Socialist Union of Popular Forces (USFP).", "The elections were announced by the Moroccan government in late January 2016.", "They were the second elections after the constitutional reforms introduced in 2011 by King Mohammed VI in response to the Arab Spring.", "Despite the reforms, most executive powers still lie with the king.", "The 2011 elections were won by the Justice and Development Party (PJD), which has led the government since then.", "The party is described as \"moderate Islamist\", but its government coalition included parties with differing ideologies.", "The incumbent Prime Minister going into the 2016 elections was Abdelilah Benkirane.", "The largest opposition party was the pro-monarchy Party of Authenticity and Modernity (PAM).", "PJD and PAM ran an \"unusually hostile\" campaign." ] ], "gold": "The Prime Minister of Morocco is the head of government for the Kingdom of Morocco. The current Prime Minster of Morocco is Saadeddine Othmani. He succeeded Abdelilah Benkirane in this position. Benkirane served as Prime Minister of Morocco from November 2011 to March 2017.", "prediction 1": "The head of state of Morocco is the monarch of Morocco. The king of Morocco is the head of state. The Prime Minister of Morocco is the head of government of the Kingdom of Morocco and serves in a position akin to a prime minister in other constitutional monarchies. The current head of state is Saadeddine Othmani, who was appointed as the new head of state by King Mohammed VI in March 2017.\n", "prediction 2": "The Head of State is the head of government of the Kingdom of Morocco. The Prime Minister of Morocco is chosen by the king of Morocco from the largest party elected to parliament. The term for the current head of state has lapsed on 31 December 2018. The current head of state was Abdelilah Benkirane from November 2011 to March 2017.", "prediction 3": "The head of state of Morocco is the king. The constitution grants executive powers to the government and allows the head of government to propose and dismiss cabinet members, provincial governors, and ambassadors, to oversee government programs and the delivery of public services, and to dissolve the lower house of parliament with the king's approval. The current head of state from January 1, 2018 to March 31, 2019, is Mohammed VI, who is the current head of state. The first African Union head of state was Mohamed VI in 2015. The most recent head of state since the 1995 was Abdelilah Benkirane. From November 2011 to March 2017, the current president is King Mohammed VI, who has been since then, who has held substantial discretionary power over the executive branch and has exclusive authority over the military, religion, and the judiciary. Unlike typical presidential systems, the current head of the executive branch of the king of Morocco.", "prediction 4": "The head of state in Morocco is the King Mohammed VI, the 17th President of Morocco and The 34th Sultan of Morocco. The head of state is defined by the Constitution and is said to be the highest ranking member of the executive branch of the executive branch. According to the 1995 Constitution, the king is head of state and the head of government of the Republic of Morocco, whereas the head of state in Islamist-majority countries is Sayeddine Othmani, who was elected in October 2011. The current head of state Ars is Mohammed VI, and has exclusive authority over the military, religion, and the judiciary. The current head of the government from November 2016 to March 2017.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The head of state of Morocco is the monarch of Morocco. ", "start": 56, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 265 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 266, "end": 291 }, { "error type": "Irrelevant", "explanation": "", "start": 315, "end": 393 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The head of state of Morocco is the monarch of Morocco. The Prime Minister of Morocco is the head of government of the Kingdom of Morocco. Prime Minister Saadeddine Othmani succeeded Abdelilah Benkirane, who was Prime Minister of Morocco from November 2011 to March 2017\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did the movie small soldiers come out?", "passages": [ [ "Kirsten Dunst", "Kirsten Dunst\n\nKirsten Caroline Dunst (; born April 30, 1982) is an American actress.", "She made her debut in the 1989 anthology film \"New York Stories\", appearing in the segment \"Oedipus Wrecks\" directed by Woody Allen.", "At the age of twelve, Dunst gained widespread recognition as Claudia in \"Interview with the Vampire\" (1994), for which she was nominated for a Golden Globe for Best Supporting Actress.", "She appeared in \"Little Women\" the same year and in \"Jumanji\" the following year.", "After a recurring role on the third season of \"ER\" (1996\u201397), and appearances in films such as \"Wag the Dog\" (1997), \"Small Soldiers\" (1998), and \"The Virgin Suicides\" (1999), Dunst starred in a string of comedies, including \"Drop Dead Gorgeous\", \"Dick\" (both 1999), \"Bring It On\" (2000), \"Get Over It\" and \"Crazy/Beautiful\" (both 2001).", "Dunst achieved fame for her portrayal of Mary Jane Watson in Sam Raimi's \"Spider-Man\" trilogy (2002\u20132007)." ], [ "Soldier (1998 American film)", "Soldier (1998 American film)\n\nSoldier is a 1998 American science fiction action film directed by Paul W. S. Anderson, written by David Webb Peoples, and starring Kurt Russell, Jason Scott Lee, Jason Isaacs, Connie Nielsen, Sean Pertwee and Gary Busey.", "The film tells the story of a highly skilled soldier defying his commanders and facing a relentless and brutal genetically-enhanced rival soldier.", "The film was released worldwide on October 23, 1998.", "Upon its release, \"Soldier\" received generally negative reviews but many praised the action sequences and Russell's performance.", "The film was a commercial failure, grossing $14 million worldwide against a production budget of $60 million.", "In 1996, as part of a new military training program, orphaned infants are selected at birth and raised as highly disciplined soldiers dedicated to a wholly military routine.", "They are trained to be ruthless obedient killers without any moral code of conduct, and any deemed physically or mentally unworthy are executed.", "Survivors of the training program are turned into impassive, dedicated fighting machines with no exposure to or understanding of the outside world.", "In 2036, at the age of 40, Sgt.", "Todd 3465 is a battle-hardened veteran and the best soldier of the original 1996 infants." ] ], "gold": "Small Soldiers is a 1998 American science fiction action film that stars Kirsten Dunst and Gregory Smith. The film was released in the United Kingdom on June 4, 1998 and in the United States on July 10, 1998. Small Soldiers marks the last on-screen film role of Phil Hartman, who was murdered two months before the film's American premiere. This film is dedicated in his memory.", "prediction 1": "Small Soldiers is an American science fiction action film that was released worldwide on October 23, 1998. It was directed by Paul W. S. Anderson and stars Kurt Russell, Jason Scott Lee, Jason Isaacs, Connie Nielsen, Sean Pertwee and Gary Busey. The film tells the story of a highly skilled soldier defying his commanders and facing a relentless and brutal genetically-enhanced rival soldier.\n", "prediction 2": "Small Soldiers is an American 1998 science fiction action film that tells the story of a highly skilled soldier defying his commanders and facing a relentless and brutal genetically-enhanced rival soldier. The film was released worldwide on October 23, 1998.", "prediction 3": "Small Soldiers is an American science fiction action film that tells the story of a highly skilled soldier defying his commanders and facing a relentless and brutal genetically-enhanced rival soldier. It was released worldwide on October 23, 1998. It was considered a commercial failure and was withdrawn due to numerous issues at the time of release.", "prediction 4": "Small Soldiers, a 1998 American science fiction action film starring Kurt Russell, was released worldwide on October 23, 1998.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 107, "end": 393 }, { "error type": "Unverifiable", "explanation": "", "start": 58, "end": 106 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 57 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When does series 2 of handmaid's tale?", "passages": [ [ "The Handmaid's Tale (TV series)", "Joseph Fiennes, Madeline Brewer, and Yvonne Strahovski were cast in August 2016, followed by O. T. Fagbenle and Amanda Brugel in September 2016.", "In October 2016, Ever Carradine joined the cast, and Alexis Bledel was added in January 2017.", "Filming on the series took place in Toronto, Mississauga, Hamilton, Burlington, Oakville, and Cambridge, Ontario, from September 2016 to February 2017.", "The first full trailer of the TV series was released by Hulu on YouTube on March 23, 2017.", "The series premiered on April 26, 2017.", "On May 3, 2017, \"The Handmaid's Tale\" was renewed for a second season to premiere in 2018.", "Moss told the news media that the subsequent episodes would cover further developments in the story, filling in some of the unanswered questions and continuing the narrative already \"finished\" in the book.", "The second season consists of 13 episodes and began filming in fall 2017.", "Alexis Bledel returned as a series regular.", "Showrunner Bruce Miller stated that he envisioned 10 seasons of the show, stating, \"Well, you know, honestly, when I started, I tried to game out in my head what would ten seasons be like?" ], [ "Master Volume", "Master Volume\n\nMaster Volume is the second studio album by Canadian punk rock band, The Dirty Nil.", "The album was released on September 14, 2018 through Dine Alone Records.", "The album's first single, \"Bathed in Light\", was released ahead of the album in June 2018.", "On June 7, 2018, the band announced their sophomore album.", "On June 7, 2018, the band announced their sophomore album and released their first single for the album, \"Bathed In Light\".", "Geoff Parent, writing for \"Dominionated\", praised the track calling it \"[The Dirty Nil] at their very best.\"", "Parent described the composition of the song as \"infectious, efficient, and massive\", and wrote that the track \"burns white-hot before riding headstrong into the black.\"", "On July 11, 2018, the second single ahead of the album, \"Pain of Infinity\" was released.", "In a mixed review of the track, Jason Pettigrew, writing for Alternative Press called the band and the track \"Too noisy and attitude-laden for music directors at radio and graybeards praying for one more Aerosmith tour, and way too coarse for devotees of sterile Pro Tooled pop punk, the Dirty Nil are the bastard sons emerging from a beer-fueled Petri dish teeming with Seattle grunge and drunken Midwest alt-rock.\"" ], [ "Margaret Atwood", "Activists, dressed in red cloaks and white hats as described in \"The Handmaid's Tale\", lobby and protest in order to bring awareness to politicians and laws that discriminate against women and women's rights.", "The novel \"Surfacing\" (1972) was adapted into an eponymous 1981 film, written by Bernard Gordon and directed by Claude Jutra.", "The film received poor reviews and suffers from making \"little attempt to find cinematic equivalents for the admittedly difficult subjective and poetic dimensions of the novel.\"", "The novel \"The Handmaid's Tale\" (1985) has been adapted into several eponymous works.", "A 1990 film, directed by Volker Schl\u00f6ndorff, with a screenplay by Harold Pinter, received mixed reviews.", "A musical adaptation resulted in the 2000 opera, written by Poul Ruders, with a libretto by Paul Bentley.", "It premiered at the Royal Danish Opera in 2000, and was staged in 2003 at London's English National Opera and the Minnesota Opera.", "A television series by Bruce Miller began airing on the streaming service Hulu in 2017.", "The first season of the show earned eight Emmy's in 2017, including Outstanding Drama Series.", "Season two premiered on April 25, 2018, and it was announced on May 2, 2018 that Hulu had renewed the series for a third season." ] ], "gold": "Season 2 of The Handmaid's Tale premiered on April 25, 2018 and concluded on July 11, 2018. This season consisted of 13 episodes, and Alexis Bledel returned as a series regular. ", "prediction 1": "The Handmaid's Tale is a Canadian drama television series created by Bruce Miller and produced by David Ayer that premiered on Hulu on April 26, 2017, and ran for 13 episodes over two seasons. The second season premiered on April 25, 2018, and was followed by a third season that premiered on May 2, 2019.\n", "prediction 2": "There are numerous the television series The Handmaid's Tale. Bruce Miller created and produced the original screenplay in 2015, and the show started airing on streaming service Hulu in 2017. The first season premiered on April 26, 2017, and the second season began filming during the week ending April 25, 2018.", "prediction 3": "The Canadian punk rock band The Dirty Nil has released a new album entitled Master Volume. The Handmaid's Tale is a 1989 novel that was adapted into a 1981 film directed by Claude Jutra. On May 3, 2017, \"The Handmaid's Tale\" was renewed for a second season to premiere in 2018. Series 2 of the show premiered on April 25, 2018 andseason 3 premiered on May 1, 2019.", "prediction 4": "The Handmaid's Tale is a Canadian psychological thriller television series created by Bruce Miller and produced by Andrew McAdams, which premiered on Hulu on April 27, 2017, and concluded on June 2, 2017. Season 2 premiered on April 25, 2018, with 13 episodes total. The series is currently in its 9th season with 13 episodes total.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 154 }, { "error type": "Unverifiable", "explanation": "", "start": 155, "end": 192 }, { "error type": "Irrelevant", "explanation": "", "start": 240, "end": 306 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "The second season of The Handmaid's Tale had 13 episodes. It premiered on April 25, 2018." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "What's the population of gallup new mexico?", "passages": [ [ "McKinley County, New Mexico", "McKinley County, New Mexico\n\nMcKinley County is a county in the northwestern section of the U.S. state of New Mexico.", "As of the 2010 census, the population was 71,492.", "Its county seat is Gallup.", "The county was created in 1901 and named for President William McKinley.", "McKinley County is Gallup's micropolitan statistical area.", "According to the U.S. Census Bureau, the county has a total area of , of which is land and (0.1%) is water.", "As of the 2000 census, there were 74,798 people, 21,476 households, and 16,686 families residing in the county.", "The population density was 14 people per square mile (5/km\u00b2).", "There were 26,718 housing units at an average density of 5 per square\u00a0mile (2/km\u00b2).", "The racial makeup of the county was 74.72% Native American, 16.39% White, 0.46% Asian, 0.40% Black or African American, 0.04% Pacific Islander, 5.47% from other races, and 2.52% from two or more races.", "12.40% of the population were Hispanic or Latino of any race." ], [ "Brunswick, Georgia", "As of the 2010 United States Census, there were 15,383 people residing in the city.", "The racial makeup of the city was 59.23% Black, 33.21% White, 0.1% Native American, 0.5% Asian, 0.1% Pacific Islander, 0.2% from some other race and 1.5% from two or more races.", "11.3% were Hispanic or Latino of any race.", "As of the census of 2000, there were 15,600 people, 6,085 households, and 3,681 families residing in the city.", "The population density was 906 people per square mile (349.8/km\u00b2).", "There were 6,952 housing units at an average density of 403.8 per square mile (155.9/km\u00b2).", "The racial makeup of the city was 59.8% African American, 33.1% White (non-Hispanic), 0.3% Native American, 0.4% Asian, <0.1% Pacific Islander, 1.7% from other races, and 1.4% from two or more races.", "Hispanic or Latino of any race were 5.8% of the population." ] ], "gold": "Gallup is a city in McKinley County, New Mexico, United States, with a population of 21,605 as of the 2020 census. The population has ranged from 19,154 in 1990 to 20,209 in 2000. In 2010 the population was 21,678. Gallup is the county seat of McKinley County.", "prediction 1": "As of the 2000 census, there were 15,600 people, 6,085 households, and 3,681 families residing in the city of Gallup, New Mexico. The population of Gallup, New Mexico was 74,798 people, 21,476 households, and 16,686 families. The population of McKinley County was 71,492 people as of the 2010 census.\n", "prediction 2": "As of the 2000 census, the population of Gallup, New Mexico was 74,798. As of the 2010 census, the population of Gallup, New Mexico was 71,492.", "prediction 3": "As of the 2000 census, there were 74,798 people, 21,476 households, and 16,686 families residing in the county. The population of Gallup had a racial makeup of 59.23% Black, 33.21% White, 0.1% Native American, 0.5% Asian, 0.1% Pacific Islander, 0.2% from some other race and 1.5% from two or more races. Also in 2000, there were 15,600 people, 6,085 households, and 3,681 families residing in the city.", "prediction 4": "As of the 2000 census, there were 74,798 people, 21,476 households, and 16,686 families residing in McKinley County. The population of Gallup in McKinley County was 75,174. As of the 2010 census, there were 15,383 people residing in the city.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 34, "end": 48 }, { "error type": "Irrelevant", "explanation": "", "start": 49, "end": 85 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 110, "end": 129 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 148, "end": 155 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 225 }, { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 301 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " McKinley County, New Mexico's county seat is Gallup. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who sings monday monday so good to me?", "passages": [ [ "Monday, Monday", "Monday, Monday\n\n\"Monday, Monday\" is a 1966 song written by John Phillips and recorded by the Mamas & the Papas using background instruments played by members of The Wrecking Crew for their 1966 album \"If You Can Believe Your Eyes and Ears\".", "It was the group's only #1 hit on the U.S. \"Billboard\" Hot 100.", "Phillips said that he wrote the song quickly, in about 20 minutes.", "The song includes a false ending, when there is a pause before the coda of the song, and goes up a half note for the bridges and refrains of the song.", "On March 2, 1967, The Mamas & the Papas won a Grammy Award for Best Pop Performance by a Duo or Group with Vocal for this song.", "The song was performed at the Monterey Pop Festival (California) in 1967.", "The performance was filmed for the movie of the festival but not included in the final print.", "The song appears on the soundtrack of Michael Apted's film \"Stardust\"." ], [ "The Mamas & the Papas", "The Mamas & the Papas\n\nThe Mamas & the Papas were an American folk rock vocal group who recorded and performed from 1965 to 1968.", "The group was a defining force in the music scene of the counterculture of the 1960s.", "The group was composed of John Phillips, Denny Doherty, Cass Elliot, and Michelle Phillips \"n\u00e9e\" Gilliam.", "Their sound was based on vocal harmonies arranged by John Phillips, the songwriter, musician, and leader of the group who adapted folk to the new beat style of the early sixties.", "The Mamas & the Papas released a total of five studio albums and seventeen singles over a four-year period, six of which made the Billboard top ten, and have sold close to 40 million records worldwide.", "The band was inducted into the Rock and Roll Hall of Fame in 1998 for their contributions to the music industry.", "The band reunited briefly to record the album \"People Like Us\" in 1971, but had ceased touring and performing by that time.", "The group was formed by husband and wife John and Michelle Phillips, formerly of the New Journeymen, and Denny Doherty, formerly of the Mugwumps.", "Both of these earlier acts were folk groups active from 1964 to 1965." ], [ "Wendy Wilson", "Wendy Wilson\n\nWendy Wilson (born October 16, 1969) is an American singer and television personality and member of the pop singing trio Wilson Phillips.", "She is the daughter of Beach Boys founder Brian Wilson and his first wife Marilyn, who was a member of girl group The Honeys, and she is the younger sister of Carnie Wilson.", "Wilson was born in Los Angeles.", "She co-founded Wilson Phillips with Carnie and childhood friend Chynna Phillips when they were in their teens.", "Wilson Phillips released two albums in 1990 and 1992 before splitting up.", "Wendy and Carnie released a Christmas album together in 1993, and an album called \"The Wilsons\" in 1997, with their formerly estranged father, Brian.", "In 2004, Wendy reunited with Carnie and Phillips for a third Wilson Phillips album entitled \"California\".", "In 2012, the reunited Wilson Phillips released the album, \"Dedicated\", which comprised covers of songs by The Beach Boys and The Mamas & the Papas.", "In June 2012, Wendy joined her sister Carnie and other members of The Beach Boys' families to form the vocal group, California Saga, which performed at the intermission during the homecoming Hollywood Bowl show of The Beach Boys' 50th anniversary tour.", "Wilson married record producer/sound engineer Daniel Knutson on May 24, 2002, in the rose garden of The Ritz-Carlton in Marina Del Rey." ], [ "Under the Covers, Vol. 1", "Under the Covers, Vol. 1\n\nUnder the Covers, Vol. 1 is the first collaboration between alternative rock artist Matthew Sweet and Bangles singer/guitarist Susanna Hoffs.", "Released by Shout!", "Factory in 2006, the album contains 15 cover versions of songs from the 1960s and 1970s.", "The album was a result of their mutual love for songwriting from the 1960s.", "Matthew Sweet and Susanna Hoffs decided to record an album together in dedication of that era consisting of only cover versions.", "The album was released April 2006, and they appeared July 18 on \"Late Night with Conan O'Brien\" to promote the album and tour.", "In July 2009, Shout!", "Factory released their second album, \"Under the Covers, Vol. 2\", covering songs from the 1970s.", "\"Under the Covers, Vol. 3\" followed in 2013." ] ], "gold": "There are multiple versions of the song \"Monday, Monday\". In 1966, the original version of the song was sang by the Mamas and the papas, an American folk rock vocal group formed in Los Angeles, California. Three different versions of the song was later released by Wilson Phillips, an American pop group also formed in Los Angeles. Matthew Sweet and Susanna Hoffs also sang the song in their first collaboration, the album \"Under the Covers, Vol. 1\".", "prediction 1": "There are several songs entitled Monday, Monday so good to me. The 1966 song, Monday, Monday, was sung by the Mamas & the Papas, an American folk rock vocal group that formed in 1965 and was a defining force in the music scene of the counterculture of the 1960s. In 2006, Matthew Sweet and Susanna Hoffs released an album together called Under the Covers, Vol. 1. In 2009, the song was sung by the Beach Boys' Carnie Wilson.\n", "prediction 2": "There are many singers of the song Monday, Monday so good to me. Jason Isbell sang lead vocals in 1966 for Bob Dylan's song Monday, Monday and Brian Wilson sang lead vocals from 1967-68 for Pink Floyd's \"Jump Around Town\". American singer Wendy Wilson is the second member of the pop singing trio Wilson Phillips. She is the daughter of Beach Boys founder Brian Wilson and his first wife Marilyn and was a member of girl group The Honeys. In 1999, Sheryl Crow's group 21 Reasons released a self-titled Tracks to celebrates 50th anniversary tour. In 2012, the band reunited Wilson Phillips released the album, \"Dedicated\", which comprised covers of other songs by The Baby Boom Boom! Lights.", "prediction 3": "There have been several holidays with the song Monday, Monday so good to me. On March 2, 1967, The Mamas & the Papas won a Grammy Award for Best Pop Performance by a Duo or Group with Vocal for this song. On June 19, 2011, Billie Holiday sang Saturday Night Fever, a song written by John Phillips for The Mamas & the Papas in 1966. On June 7, 2016, Lalah Sanders sang December 19, 2016 version of the song. Also on July 5, 2017, Kornan Price sang Monday, Monday, Monday, Monday, Monday, Monday, Monday, playing guitar, and Bassist Tullan performed the band, Marilyn Phillips.", "prediction 4": "Thomas Young Singer Matthew Sweet sings the 1966 song Monday, Monday so good to me. There are a variety of artists that sing the song Monday, Monday. The Beatles' Thursday Night Fever sings an acoustic cover of the 1966 song Monday, Monday. The title of the song coined by Young is a favorite of very few people.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 62 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 262 }, { "error type": "Irrelevant", "explanation": "", "start": 263, "end": 363 }, { "error type": "Unverifiable", "explanation": "", "start": 364, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 182 } ], "missing-info": [], "corrected-prediction": "The 1966 song, Monday, Monday, was sung by the Mamas & the Papas, an American folk rock vocal group.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How long does it take to cycle from lands end to john o'groats?", "passages": [ [ "Land's End to John o' Groats", "Land's End to John o' Groats\n\nLand's End to John o' Groats is the traversal of the whole length of the island of Great Britain between two extremities, in the southwest and northeast.", "The traditional distance by road is and takes most cyclists 10 to 14 days; the record for running the route is nine days.", "Off-road walkers typically walk about and take two or three months for the expedition.", "Two much-photographed signposts indicate the traditional distance at each end.", "The straight-line distance from Land's End to John o' Groats is as determined from O.S. Grid References, but such a route passes over a series of stretches of water in the Irish Sea.", "Google Earth reports a distance of 602.70 miles between the two iconic marker points.", "According to a 1964 road atlas, the shortest route using classified roads was but in a 2008 road atlas, the shortest route using classified roads was ." ], [ "Land's End to John o' Groats", "Overnight accommodation is provided in large, tented base camps, and all aspects of the ride are fully supported.", "Previous celebrity participants include GB rower and Olympic gold medallist James Cracknell and former England Rugby captain Lewis Moody.", "The official Road Records Association record for a rider on a conventional bicycle is 43 hours, 25 minutes and 13 seconds, set by 40 year old Michael Broadwith on 17 June 2018.", "Michael is a maths teacher who lives in the south of England.", "He studied mathematics at St Edmund Hall, Oxford University, representing the university in the reserve\u2019s boat race in 2000.", "He won the UK national 24 hour cycling road race (Mersey roads) in 2015, 2016 and 2017 in the lead up to his record breaking ride.", "The record for cycling from Land's End to John o' Groats is held by Andy Wilkinson, who completed the journey in 41 hours, 4 minutes and 22 seconds on a Windcheetah recumbent tricycle.", "A typical cycling time when not attempting shortest time is 10 to 14 days.", "James MacDonald set a record in September 2017 for cycling from John o' Groats to Land's End and back again in five days, 18 hours and 3 minutes." ] ], "gold": "Land's End to John o' Groats is the traversal of the whole length of the island of Great Britain between two extremities, in the southwest and northeast. The traditional distance by road is 874 miles and takes most cyclists 10 to 14 days. The record for cycling the route, held by Andy Wilkinson, is nine days.", "prediction 1": "The traditional distance by road is and takes most cyclists 10 to 14 days; the record for running the route is nine days. The record for cycling from Land's End to John o' Groats is held by Andy Wilkinson, who completed the journey in 41 hours, 4 minutes and 22 seconds on a Windcheetah recumbent tricycle.\n", "prediction 2": "The traditional distance by road from Land's End to John o' Groats is and takes most cyclists 10 to 14 days. The record for running the route is nine days. My time of 1 hour and 34 minutes is the record for cycling the same distance.", "prediction 3": "The traditional distance by road is and takes most cyclists 10 to 14 days; the record for running the route is nine days. The official Road Records Association record for a rider on a conventional bicycle is 43 hours, 25 minutes and 13 seconds, set by 40 year old Michael Broadwith on 17 June 2018. A typical cycling time when not attempting shortest time is 10 to 14 days.", "prediction 4": "Land's End to John o' Groats is the traversal of the whole length of the island of Great Britain between two extremities, in the southwest and northeast. The traditional distance by road is and takes most cyclists 10 to 14 days; the record for running the route is nine days. The record for cycling from Land's End to John o' Groats is held by Andy Wilkinson, who completed the journey in 41 hours, 4 minutes and 22 seconds on a Windcheetah recumbent tricycle. A typical cycling time when not attempting the shortest is 10 to 14 days. In September 2017, James MacDonald set a record for cycling from John o' Groats to Land's End and back again in five days, 18 hours and 3 minutes.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Land's End to John o' Groats is the traversal of the whole length of the island of Great Britain between two extremities, in the southwest and northeast. The traditional distance by road is and takes most cyclists 10 to 14 days; the record for running the route is nine days. The record for cycling from Land's End to John o' Groats is held by Andy Wilkinson, who completed the journey in 41 hours, 4 minutes and 22 seconds on a Windcheetah recumbent tricycle.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What was the average life expectancy in the roman empire?", "passages": [ [ "Demography of the Roman Empire", "When the high infant mortality rate is factored in (life expectancy at birth) inhabitants of the Roman Empire had a life expectancy at birth of about 25 years.", "However, when infant mortality is factored out, life expectancy is doubled to the late-50s.", "If a Roman survived infancy to their mid-teens, they could, on average, expect near six decades of life, although of course many lived much longer or shorter lives for varied reasons.", "Although this figure relies more on conjecture than ancient evidence, which is sparse and of dubious quality, it is a point of general consensus among historians of the period.", "It originates in cross-country comparison: given the known social and economic conditions of the Roman Empire, we should expect a life expectancy near the lower bound of known pre-modern populations.", "Roman demography bears comparison to available data for India and rural China in the early 20th century, where life expectancies at birth were also in the low 20s.", "About 300 census returns filed in Egypt in the first three centuries CE survive.", "R. Bagnall and B. Frier have used them to build female and male age distributions, which show life expectancies at birth of between 22 and 25 years, results broadly consistent with model life tables." ], [ "Children of ancient Rome", "Children of ancient Rome\n\nThis article is about children in ancient Rome.", "In ancient Rome, childbirth brought upon high risk to both mother and child due to a greater chance of complications, which included infection, uterine hemorrhage, and the young age of the mothers.", "Women relied mainly on the religious and superstitious practices associated with medicine at this time.", "After conception, women would rest in bed to \u201cpreserve the seed.\u201d", "To treat pregnancy symptoms they would eat a bland diet of eggs or rice and would be massaged with olive oil.", "Plants and herbs such as dittany leaves, scordotis in hydromel and the root of vervain were used for relief during labor.", "Also, methodologies such as a drink powdered with sow\u2019s dung to relieve labor pains and fumes from hyena loin fat or placing the right foot of a hyena on the woman to induce an easy delivery were of use.", "The development of midwives greatly improved the birthing process for Roman women.", "Midwives assisted births in the home and prepared the mothers with oil for lubrication, warm water, sponges, and provided bandages for the newborn.", "During difficult births tools with sharp hooks would be used to extract the baby." ] ], "gold": "Childbirth in ancient Rome was dangerous for the child. When this high infant mortality rate is factored in, inhabitants of the Roman Empire had a life expectancy at birth of about 25 years. However, when infant mortality is factored out, life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens, they could, on average, expect to live for close to six decades. Of course, many Romans lived much longer or shorter lives for varied reasons.", "prediction 1": "In the Roman Empire, life expectancy at birth was between 22 and 25 years. However, when infant mortality is factored out, life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens, they could, on average, expect near six decades of life, although of course many lived much longer or shorter lives for varied reasons.\n", "prediction 2": "When the high infant mortality rate is factored in (life expectancy at birth), inhabitants of the Roman Empire had a life expectancy at birth of about 25 years. However, when infant mortality is factored out, life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens they could, on average, expect near six decades of life, although of course many lived much longer or shorter lives for varied reasons.", "prediction 3": "When the high infant mortality rate is factored in (life expectancy at birth), inhabitants of the Roman Empire had a life expectancy at birth of about 25 years. However, when infant mortality is factored out, life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens, they could, on average, expect near six decades of life, although of course many lived much longer or shorter lives for varied reasons.", "prediction 4": "In the Roman Empire, inhabitants lived an average of between 22 and 25 years when the high infant mortality rate was factored in. However, when infant mortality is factored out, the life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens, they could, on average, expect near six decades of life.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 246, "end": 250 } ], "missing-info": [], "corrected-prediction": "In the Roman Empire, life expectancy at birth was between 22 and 25 years. However, when infant mortality is factored out, life expectancy is doubled to the late-50s. If a Roman survived infancy to their mid-teens, they could, on average, expect nearly six decades of life, although of course many lived much longer or shorter lives for varied reasons.\n" }, "preference": [ 1, 1, 0, 0, 0, 0 ] }, { "question": "Where are oranges mostly grown in the world?", "passages": [ [ "Citrus production", "This trend was projected to change from 2000 to 2010 since the high production levels have slowed the rate of new plantings.", "Citrus fruits are produced all over the world; according to UNCTAD, as of 2004 there were 140 citrus-producing countries.", "Around 70% of the world's total citrus production is grown in the Northern Hemisphere, in particular countries around the Mediterranean and the United States, although Brazil is the largest citrus producer.", "In the United States, most orange juice and grapefruit is produced in Florida, while citrus fruits for consumption as fresh fruit are mainly grown in California, Arizona, and Texas.", "Smaller markets for citrus growth in the United States originate in South Carolina, Georgia, Oklahoma, Tennessee, and the gulf coastal states, including Louisiana, Alabama, Mississippi, and Georgia, as well as North Carolina.", "Independent cultivars are found in Kentucky, Virginia, and even Missouri, Southern Illinois, and far Southern Kansas.", "The farther north the range, the more seasonal the cultivation.", "Florida produces approximately 100 million boxes annually (each box is 90 lbs).", "China could be a major player in the orange juice and processed citrus markets, except for high tariffs on citrus that make domestic sale more profitable.", "Though citrus originated in southeast Asia, current citrus production is low due to lower-than-average yields, high production and marketing costs, and disease." ], [ "Citrus production", "Citrus production in Europe continues to decline, although the clementines produced by Spain are increasing in popularity among consumers.", "About a third of citrus fruit production goes for processing: more than 80% of this is for orange juice production.", "Demand for fresh and processed oranges continues to rise in excess of production, especially in developed countries.", "The two main players are Florida in the United States and S\u00e3o Paulo in Brazil.", "Production of orange juice between these two makes up roughly 85% of the world market.", "Brazil exports 99 percent of its production, while 90 percent of Florida\u2019s production is consumed in the United States.", "Orange juice is traded internationally in the form of frozen concentrated orange juice to reduce the volume used, so that storage and transportation costs are lower.", "Citrus production is often cut short in many areas by outbreaks of bacteria known as \"Xanthomonas axonopodis\", or Citrus canker, which cause unsightly lesions on all parts of the plant, affecting tree vitality and early drop of fruit.", "While not harmful to human consumption, the fruit becomes too unsightly to be sold, and entire orchards are often destroyed to protect the outbreak from spreading.", "Citrus canker affects all varieties of citrus trees, and recent outbreaks in Australia, Brazil, and the United States have slowed citrus production in parts of those countries." ] ], "gold": "Citrus fruits are produced all over the world; according to UNCTAD, as of 2004 there were 140 citrus-producing countries. Around 70% of the world's total citrus production is grown in the Northern Hemisphere, in particular countries around the Mediterranean and the United States, although Brazil is the largest citrus producer. The two main players are Florida in the United States and S\u00e3o Paulo in Brazil. Production of orange juice between these two makes up roughly 85% of the world market. Brazil exports 99 percent of its production, while 90 percent of Florida\u2019s production is consumed in the United States.", "prediction 1": "Around 70% of the world's total citrus production is grown in the Northern Hemisphere, in particular countries around the Mediterranean and the United States, although Brazil is the largest citrus producer. In the United States, most orange juice and grapefruit is produced in Florida, while citrus fruits for consumption as fresh fruit are mainly grown in California, Arizona, and Texas. Demand for fresh and processed oranges continues to rise in excess of production, especially in developed countries.\n", "prediction 2": "Citrus fruits are produced all over the world, but mainly in the United States, where they are mostly grown as for juice production. How many boxes of orange juice is enough to feed a full household?", "prediction 3": "Around 70% of the world's total citrus production is grown in the Northern Hemisphere, in particular countries around the Mediterranean and in the United States, although Brazil is the largest citrus producer. In the United States, most orange juice and grapefruit is produced in Florida, while citrus fruits for consumption as fresh fruit are mainly grown in California, Arizona, and Texas. Around 80 percent of this is for orange juice production. Production of orange juice between these two makes up roughly 85% of the world market.", "prediction 4": "In the Western Hemisphere oranges are mostly grown, with the majority with a specific variety, in South Africa, while in the tropical regions, such as the far east and the Americas, they are mainly grown in countries around the Mediterranean, while in the Northern Hemisphere, they are mainly grown in countries around the Mediterranean and the United States,.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 389, "end": 506 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5, 6 ] } ], "corrected-prediction": "Citrus fruits are produced all over the world; according to UNCTAD, as of 2004 there were 140 citrus-producing countries. Around 70% of the world's total citrus production is grown in the Northern Hemisphere, in particular countries around the Mediterranean and the United States, although Brazil is the largest citrus producer. Production of orange juice between these two makes up roughly 85% of the world market. Brazil exports 99 percent of its production, while 90 percent of Florida\u2019s production is consumed in the United States. In the United States, most orange juice and grapefruit is produced in Florida, while citrus fruits for consumption as fresh fruit are mainly grown in California, Arizona, and Texas. Smaller markets for citrus growth in the United States originate in South Carolina, Georgia, Oklahoma, Tennessee, and the gulf coastal states, including Louisiana, Alabama, Mississippi, and Georgia, as well as North Carolina." }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Where does the optic nerve enter the eye?", "passages": [ [ "Blind spot (vision)", "Blind spot (vision)\n\n", "A blind spot, scotoma, is an obscuration of the visual field.", "A particular blind spot known as the \"physiological blind spot\", \"blind point\", or \"punctum caecum\" in medical literature, is the place in the visual field that corresponds to the lack of light-detecting photoreceptor cells on the optic disc of the retina where the optic nerve passes through the optic disc.", "Because there are no cells to detect light on the optic disc, the corresponding part of the field of vision is invisible.", "Some process in our brains interpolates the blind spot based on surrounding detail and information from the other eye, so we do not normally perceive the blind spot.", "Although all vertebrates have this blind spot, cephalopod eyes, which are only superficially similar, do not.", "In them, the optic nerve approaches the receptors from behind, so it does not create a break in the retina.", "The first documented observation of the phenomenon was in the 1660s by Edme Mariotte in France.", "At the time it was generally thought that the point at which the optic nerve entered the eye should actually be the most sensitive portion of the retina; however, Mariotte's discovery disproved this theory." ], [ "Optic nerve", "Optic nerve\n\nThe optic nerve, also known as cranial nerve II, or simply as CN II, is a paired nerve that transmits visual information from the retina to the brain.", "In humans, the optic nerve is derived from optic stalks during the seventh week of development and is composed of retinal ganglion cell axons and glial cells; it extends from the optic disc to the optic chiasma and continues as the optic tract to the lateral geniculate nucleus, pretectal nuclei, and superior colliculus.", "The optic nerve is the second of twelve paired cranial nerves and is technically part of the central nervous system, rather than the peripheral nervous system because it is derived from an out-pouching of the diencephalon (optic stalks) during embryonic development.", "As a consequence, the fibers of the optic nerve are covered with myelin produced by oligodendrocytes, rather than Schwann cells of the peripheral nervous system, and are encased within the meninges.", "Peripheral neuropathies like Guillain\u2013Barr\u00e9 syndrome do not affect the optic nerve.", "However, most typically the optic nerve is grouped with the other eleven cranial nerves and considered to be part of the peripheral nervous system." ], [ "Optic nerve", "The optic nerve is ensheathed in all three meningeal layers (dura, arachnoid, and pia mater) rather than the epineurium, perineurium, and endoneurium found in peripheral nerves.", "Fiber tracts of the mammalian central nervous system (as opposed to the peripheral nervous system) are incapable of regeneration, and, hence, optic nerve damage produces irreversible blindness.", "The fibres from the retina run along the optic nerve to nine primary visual nuclei in the brain, from which a major relay inputs into the primary visual cortex.", "The optic nerve is composed of retinal ganglion cell axons and glial cells.", "Each human optic nerve contains between 770,000 and 1.7 million nerve fibers, which are axons of the retinal ganglion cells of one retina.", "In the fovea, which has high acuity, these ganglion cells connect to as few as 5 photoreceptor cells; in other areas of retina, they connect to many thousand photoreceptors.", "The optic nerve leaves the orbit (eye socket) via the optic canal, running postero-medially towards the optic chiasm, where there is a partial decussation (crossing) of fibres from the temporal visual fields (the nasal hemi-retina) of both eyes." ], [ "Optic disc", "Optic disc\n\nThe optic disc or optic nerve head is the point of exit for ganglion cell axons leaving the eye.", "Because there are no rods or cones overlying the optic disc, it corresponds to a small blind spot in each eye.", "The ganglion cell axons form the optic nerve after they leave the eye.", "The optic disc represents the beginning of the optic nerve and is the point where the axons of retinal ganglion cells come together.", "The optic disc is also the entry point for the major blood vessels that supply the retina.", "The optic disc in a normal human eye carries 1\u20131.2 million afferent nerve fibers from the eye towards the brain.", "The optic disc is placed 3 to 4\u00a0mm to the nasal side of the fovea.", "It is a vertical oval, with average dimensions of 1.76mm horizontally by 1.92mm vertically.", "There is a central depression, of variable size, called the optic cup.", "This depression can be a variety of shapes from a shallow indentation to a bean pot\u2014this shape can be significant for diagnosis of some retinal disease.", "The optic disc or optic nerve head is the point of exit for ganglion cell axons leaving the eye.", "Because there are no rods or cones overlying the optic disc, it corresponds to a small blind spot in each eye." ] ], "gold": "The optic nerve, also known as cranial nerve II, is a paired cranial nerve that transmits visual information from the retina to the brain. The optic nerve leaves the orbit, or eye socket, via the optic canal, running postero-medially towards the optic chiasm, where there is a partial decussation of fibers from the temporal visual fields of both eyes. The optic nerve passes through the optic disc to enter the eye. The optic disc or optic nerve head is the point of exit for ganglion cell axons leaving the eye.", "prediction 1": "The optic nerve enters the eye through the optic canal, which runs from the orbit to the optic disc. The optic disc is the point where the ganglion cell axons of the retina exit the eye and the optic nerve head is the point where they cross the optic tract to the lateral geniculate nucleus, pretectal nuclei, and superior colliculus.\n", "prediction 2": "The optic nerve is a paired nerve that transmits visual information from the retina to the brain. The optic nerve leaves the orbit (eye socket) via the optic canal, running postero-medially towards the optic chiasm, where there is a partial decussation (crossing) of fibres from the temporal visual fields (the nasal hemi-retina) of both eyes. The optic disc represents the beginning of the optic nerve and is the point where the axons of retinalcts of the eye. The optic nerve leaves the orbit (eye socket) via the optic canal, running postero-medially towards the optic chiasm, where there is axons of retinal ganglion cell axons leaving the eye.", "prediction 3": "The optic nerve enters the eye through the optic canal. The optic nerve exits the eye through the optic disc or optic nerve head. The optic nerve travels along the optic tract from the optic tract to the lateral geniculate nuclei, pretectal nuclei, and superior colliculus, transposing image information from the retina to the brain.", "prediction 4": "The optic nerve enters the eye through the optic canal, which runs from the optic disc to the optic chiasma and continues as the optic tract to the lateral geniculate nuclei, pretectal nuclei and superior colliculus. Normally, the optic nerve enters the eye through the vestibular canal via the optic canal, passing through the eyeball through the ms-trabecula and subsequently into the optic nerve head. Artificial retinal pigment epithelium is surrounding the optic disc, and at the beginning of the optic nerve head, which corresponds to a small blind spot in each eye.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[1]}", "start": 186, "end": 335 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 100 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The optic nerve, also known as cranial nerve II, is a paired nerve that transmits visual information from the retina to the brain. The optic nerve leaves the orbit (eye socket) via the optic canal, running postero-medially towards the optic chiasm, where there is a partial decussation of fibres from the temporal visual fields of both eyes. The optic disc or optic nerve head is the point where the ganglion cell axons. \n" }, "preference": [ 2, 0, 1, 1, 1, 1 ] }, { "question": "Where was the first mardi gras parade held?", "passages": [ [ "Mardi Gras in Mobile, Alabama", "Mardi Gras in Mobile, Alabama\n\nMardi Gras is the annual Carnival celebration in Mobile, Alabama.", "It is the oldest annual Carnival celebration in the United States, started by Frenchman Nicholas Langlois in 1703 when Mobile was the capital of Louisiana.", "This was fifteen years before New Orleans was founded, although today their celebrations are much more widely known for all the current traditions such as masked balls, parades, floats and throws were first created there.", "From Mobile being the first capital of French Louisiana (1702), the festival began as a French Catholic tradition.", "Mardi Gras in Mobile has now evolved into a mainstream multi-week celebration across the spectrum of cultures in Mobile, becoming school holidays for the final Monday and Tuesday (some include Wednesday), regardless of religious affiliation.", "Although Mobile has traditions of exclusive societies, with formal masked balls and elegant costumes, the celebration has evolved over the past three centuries to become typified by public parades where members of societies, often masked, on floats or horseback, toss gifts (known as throws) to the general public.", "Throws include necklaces of plastic beads, doubloon coins, decorated plastic cups, candy, wrapped cakes known as Moonpies or snacks, stuffed animals, and small toys, footballs, frisbees, or whistles." ], [ "Mardi Gras", "In 1703 French settlers in Mobile established the first organised Mardi Gras celebration tradition in what was to become the United States.", "The first informal mystic society, or krewe, was formed in Mobile in 1711, the \"Boeuf Gras Society\".", "By 1720, Biloxi had been made capital of Louisiana.", "The French Mardi Gras customs had accompanied the colonists who settled there.", "In 1723, the capital of Louisiana was moved to New Orleans, founded in 1718.", "The first Mardi Gras parade held in New Orleans is recorded to have taken place in 1837.", "The tradition in New Orleans expanded to the point that it became synonymous with the city in popular perception, and embraced by residents of New Orleans beyond those of French or Catholic heritage.", "Mardi Gras celebrations are part of the basis of the slogan \"Laissez les bons temps rouler\" (\"Let the good times roll\").", "On Mardi Gras Day, the Tuesday before Ash Wednesday, the last parades of the season wrap up and the celebrations come to a close with the Meeting of the Courts (known locally as the Rex Ball).", "Other cities along the Gulf Coast with early French colonial heritage, from Pensacola, Florida; Galveston, Texas; to Lake Charles and Lafayette, Louisiana; and north to Natchez, Mississippi, have active Mardi Gras celebrations." ], [ "Mardi Gras in the United States", "Bienville went on to found Mobile, Alabama in 1702 as the first capital of French Louisiana.", "In 1703 French settlers in that city began to celebrate the Mardi Gras tradition.", "By 1720, Biloxi was made capital of Louisiana.", "While it had French settlers, Mardi Gras and other customs were celebrated with more fanfare given its new status.", "In 1723, the capital of French Louisiana was moved to New Orleans, founded in 1718.", "With the growth of New Orleans as a city and the creolization of different cultures, the varied celebration of Mardi Gras became the event most strongly associated with the city.", "In more recent times, several U.S. cities without a French Catholic heritage have instituted the celebration of Mardi Gras, which sometimes emerged as grassroots movements to help accompany single people to celebrate something in late Winter which is often dominated by the commercialized and couple-centric Valentine's Day, and as a result it has been co-opted as the single people's late Winter holiday.", "Mardi Gras is an official state holiday in Mobile and Baldwin counties.", "Other counties in the state grant employees a day of personal leave in lieu of Mardi Gras.", "Mobile, founded by Bienville in 1702, is known for having the oldest organized Mardi Gras celebrations in the United States, beginning in 1703." ] ], "gold": "Mardi Gras is the annual Carnival celebration in Mobile, Alabama. It is the oldest annual Carnival celebration in the United States, started by Frenchman Nicholas Langlois in 1703 when Mobile was the capital of Louisiana. This was fifteen years before New Orleans was founded. However, today the New Orleans Mardi Gras celebrations are much more widely known for traditions such as masked balls, parades, and floats that were first started there. The first Mardi Gras parade held in New Orleans is recorded to have taken place in 1837. ", "prediction 1": "In 1703 French settlers in Mobile established the first organised Mardi Gras celebration tradition in what was to become the United States. The first Mardi Gras parade held in New Orleans is recorded to have taken place in 1837.\n", "prediction 2": "Mardi Gras is the annual Carnival celebration in Mobile, Alabama. It is the oldest annual Carnival celebration in the United States, started by Frenchman Nicholas Langlois in 1703 when Mobile was the capital of Louisiana. This was fifteen years before New Orleans was founded, although today their celebrations are much more widely known for all the current traditions such as masked balls, parades, floats and throws were first created there. From Mobile being the first capital of French Louisiana (1702), the festival began as a French Catholic tradition.", "prediction 3": "Mardi Gras is the annual Carnival celebration in Mobile, Alabama. It is the oldest annual Carnival celebration in the United States, started by Frenchman Nicholas Langlois in 1703 when Mobile was the capital of French Louisiana. This was fifteen years before New Orleans was founded, although today their celebrations are much more widely known for all the current traditions such as masked balls, parades, floats and throws were first created there. Mardi Gras in Mobile has now evolved into a mainstream multi-week celebration across the spectrum of cultures in Mobile, becoming school holidays for the final Monday and Tuesday, regardless of religion. With the growth of French colonial heritage, the celebration has expanded to the point that it became synonymous with the city in popular perception, and become synonymous with the slogan \"Les bons temps rouler\".", "prediction 4": "In 1703 French settlers in Mobile established the first organised Mardi Gras celebration tradition in what was to become the United States. The first Mardi Gras parade held in New Orleans is recorded to have taken place in 1837. This was fifteen years before New Orleans was founded.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 107, "end": 139 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Mardi Gras is the annual Carnival celebration in Mobile, Alabama. It is the oldest annual Carnival celebration in the United States, started by Frenchman Nicholas Langlois in 1703 when Mobile was the capital of Louisiana. This was fifteen years before New Orleans was founded, although today their celebrations are much more widely known for all the current traditions such as masked balls, parades, floats and throws were first created there. The first Mardi Gras parade held in New Orleans is recorded to have taken place in 1837.\n" }, "preference": [ 2, 1, 2, 1, 2, 2 ] }, { "question": "American horror story freak show guy with little arms?", "passages": [ [ "Mat Fraser", "Mat Fraser\n\nMat Fraser is an English rock musician, actor, writer and performance artist.", "He has thalidomide-induced Phocomelia.", "In 2017, he was cast to play Shakespeare\u2019s Richard III at the Hull Truck Theatre as part of Hull City of Culture 2017.", "Between 1980 and 1995 Fraser was a drummer with several rock bands including \"Fear of Sex,\" \"The Reasonable Strollers,\" \"Joyride,\" \"The Grateful Dub,\" and \"Living in Texas,\" who had a number one single in Italy.", "Fraser played the drums with Graeae Theatre Company's \"Reasons to be Cheerful\" at the 2012 Paralympics opening ceremony, where he also hosted the pre-televised section, and with Coldplay during the closing ceremony.", "Fraser left drumming to join Graeae Theatre Company, Europe's leading disabled theatre company after their production of Ubu inspired him to change careers.", "He worked in forum theatre for Graeae for several months, then landed the part of Dr Prentice in Joe Orton's \"What the Butler Saw\".", "He is now a patron of Graeae.", "Subsequent theatre roles in the '90s included the Group K production of \"Marisol\" and the title role in \"Johnny Sol\" at the Croydon Warehouse.", "He wrote 2005's \"Thalidomide!!" ], [ "American Horror Story: Freak Show", "When the sisters arrive, they were welcomed by their fellow freaks; Elsa's subordinate and confidante Ethel Darling (Kathy Bates) the bearded lady, her lobster-handed son Jimmy Darling (Evan Peters), Paul the Illustrated Seal (Mat Fraser), the giantess Amazon Eve (Erika Ervin), the legless Suzi (Rose Siggins), pinheads Salty and Pepper (Christopher Neiman and Naomi Grossman), the youngest Meep (Ben Woolf), and the dwarf performers: ex-convict Toulouse (Drew Rin Varick) and Elsa's most significant companion Ma Petite (Jyoti Amge) who is the smallest of the group.", "During the troupe's first performance with the twins, the only spectators in the audience were wealthy socialite widow Gloria Mott (Frances Conroy) and her spoiled, mentally unstable son Dandy (Finn Wittrock), who displayed an unhealthy fascination for the freaks.", "Other new members of the troupe include Dell Toledo (Michael Chiklis), a strongman who was Ethel's ex-husband and Jimmy\u2019s biological father; and his three-breasted wife Desiree Dupree (Angela Bassett).", "Elsa\u2019s jealousy and cruelty towards everyone in the troupe leads her to make selfish decisions to achieve her personal desires." ], [ "Sealo", "Sealo\n\nStanislaus Berent (November 24, 1901 1980) was an American freak who performed at many freak shows, including the World Circus Sideshow in 1941 under the stage name of Sealo the Seal Boy (often stylized to just Sealo).", "He was known for his seal-like arms, which were caused by a congenital medical condition known as phocomelia.", "In 2001, Mat Fraser's play inspired by Sealo called \"Sealboy: Freak\" debuted.", "Berent was born November 24, 1901 in Pittsburgh, Pennsylvania.", "He was brought up as a Polish Catholic and suffered from an extremely rare congenital disorder known as phocomelia, which caused his \"seal arms\".", "He had no arms; his hands grew from his shoulders.", "Sealo started off his career as a newspaper seller, then was discovered by freak scouters.", "He was a regular feature at Coney Island's freak show from circa 1920 to 1970 and was exaggerated as a human with a seal body on some promotional sideshow posters.", "Despite his genetic disability, Sealo was still able to carry out feats like sawing a crate in half and shaving with a straight razor on his own, as well as moulding animal figurines out of clay.", "His partner on-stage was Toby, a chimpanzee." ], [ "American Horror Story", "American Horror Story\n\nAmerican Horror Story (sometimes abbreviated as AHS) is an American anthology horror television series created by Ryan Murphy and Brad Falchuk.", "Each season is conceived as a self-contained miniseries, following a different set of characters and settings, and a storyline with its own \"beginning, middle, and end.\"", "Some plot elements of each season are loosely inspired by true events.", "The only actors to be present in all iterations are Evan Peters and Sarah Paulson with Lily Rabe and Frances Conroy appearing in all but one of the seasons each.", "The first season, retroactively subtitled \"\", takes place in Los Angeles, California, during the year 2011, and centers on a family that moves into a house haunted by its deceased former occupants.", "The second season, subtitled \"\", takes place in Massachusetts during the year 1964, and follows the stories of the patients and staff of an institution for the criminally insane.", "The third season, subtitled \"\", takes place in New Orleans, Louisiana, during the year 2013, and follows a coven of witches who face off against those who wish to destroy them.", "The fourth season, subtitled \"\", takes place in Jupiter, Florida, during the year 1952, and centers around one of the last remaining American freak shows and their struggle for survival." ] ], "gold": "Paul the Illustrated Seal is a recurring character in American Horror Story: Freak Show, the fourth season of American Horror Story. Played by Mat Fraser, Paul is a performer in the freak show, who was born with phocomelia of both arms.", "prediction 1": "American Horror Story is an American anthology horror television series created by Ryan Murphy and Brad Falchuk. In the show, the guy with little arms is named Sealo. Sealo was a regular feature at Coney Island's freak show from circa 1920 to 1970.\n", "prediction 2": "American Horror Story is an American supernatural fiction television series that focuses on the lives and experiences of a group of sick freaks and tries to prevent them from falling victims to crime. There are several recurring characters who appear on the show including Sealo Berent, who was an American freak who performed at many freak shows, including the World Circus Sideshow in 1941 under the stage name of Sealo the Seal Boy. His only significant arm was missing and his hands grew from his shoulders.", "prediction 3": "American horror story is an American anthology horror television series created by Ryan Murphy and Brad Falchuk. In 1941, Sealo Berent starred as a freak who performed at many freak shows, including the World Circus Sideshow in 1941 under the stage name of Sealo the Seal Boy (often stylized to just Sealo).", "prediction 4": "AHS is an American horror anthology television series created by Ryan Murphy and Brad Falchuk. In the series, Freak Show, the freak with little arms was portrayed by actor Mat Fraser.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 112 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 160, "end": 166 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 249 } ], "missing-info": [], "corrected-prediction": "In American Horror Story: Freak Show, the guy with little arms is Paul the Illustrated Seal, played by Mat Fraser." }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "Who won the first ever nrl grand final?", "passages": [ [ "NRL Grand Final", "2008 - Manly Warringah Sea Eagles secure a record 40-0 win over Melbourne Storm.", "2014 - South Sydney Rabbitohs win their first premiership in 43 years, beating Canterbury-Bankstown Bulldogs 30-6. 2015 - The North Queensland Cowboys' first premiership after 21 seasons in the NRL and widely regarded as one of the all-time best (along with the Raiders' '89 win).", "The first all-Queensland NRL grand final sparked talk of future deciders being held in Queensland.", "It was also notable as Brisbane Broncos ended their biggest drought from a grand final since entering the competition (in 1988) and it was Bennett's first season back in Brisbane after leaving in 2008.", "North Queensland Cowboys winger Kyle Feldt scored a try from a Michael Morgan try-assist after the full-time siren to level the game at 16-all.", "After Jonathan Thurston missed the sideline conversion, hitting the right post, the match went to golden point extra time, the first grand final to do so.", "The Kyle Feldt kick-off to begin golden point was dropped by the Broncos' Ben Hunt.", "From the ensuing set of six, Thurston kicked the winning field goal, and was subsequently awarded the Clive Churchill Medal.", "It also ended Brisbane's undefeated streak in grand finals, having won all six previous deciders." ], [ "1998 NRL season", "1998 NRL season\n\n", "The 1998 NRL season was the 91st season of professional rugby league football in Australia, and the inaugural season of the newly formed National Rugby League (NRL).", "After the 1997 season, in which the Australian Rugby League and Super League organisations ran separate competitions parallel to each other, they joined to create a reunited competition in the NRL.", "The first professional rugby league club to be based in Victoria, the Melbourne Storm was introduced into the League, and with the closure of the Hunter Mariners, Western Reds and South Queensland Crushers, twenty teams competed for the premiership, which culminated in the 1998 NRL grand final between the Brisbane Broncos and Canterbury Bulldogs.", "The National Rugby League was formed after an agreement was reached between the two rivaling competitions from 1997, the Australian Rugby League and the Super League.", "In December 1997, the two parties formed a joint board to run the new Australian rugby league club competition.", "The vast majority of the 22 clubs that contested in 1997 across the split competitions also contested the first season of the National Rugby League, with the exception of the Hunter Mariners, the Western Reds and South Queensland.", "The National Rugby League imposed a $3M salary cap on each of the clubs.", "Super League's ad agency VCD in Sydney successfully kept the account post-reunification." ], [ "1998 NRL Grand Final", "1998 NRL Grand Final\n\n", "The 1998 NRL grand final was the conclusive and premiership-deciding game of the 1998 NRL season.", "It was the first grand final of the re-unified National Rugby League and featured minor premiers and the previous year's Super League premiers, the Brisbane Broncos against the Canterbury Bulldogs, who had finished the regular season 9th (out of 20) to make a top-ten play-off grouping.", "It was to be the first grand final under the National Rugby League partnership's administration and the last to be played at the Sydney Football Stadium.", "It was also the first time these two sides had met in a grand final.", "Brisbane scored first but by half time trailed the Bulldogs 10\u201312.", "However, the Broncos scored 28 unanswered points in the second half, winning 12\u201338 and equaling the second highest score for a team in grand final history.", "The 1998 NRL season was the 91st season of professional rugby league football in Australia, and the inaugural season of the newly formed National Rugby League (NRL).", "The 1998 Grand final's teams had played each other twice during the regular season, the Broncos winning both times.", "Also having won three of the past six grand finals compared with Canterbury's one meant Brisbane went into the match as unbackable favourites.", "The 1998 Brisbane Broncos season was the eleventh in the club's history." ], [ "1998 Canterbury Bulldogs season", "1998 Canterbury Bulldogs season\n\nThe 1998 Canterbury Bulldogs season was the 64th in the club's history.", "Coached by Steve Folkes and captained by Simon Gillies then Darren Britt, they competed in the 1998 NRL season's, finishing the regular season 9th (out of 20) to make a top-ten play-off grouping before reaching the grand final which they lost to the Brisbane Broncos.", "The 1998 NRL grand final was the conclusive and premiership-deciding game of the 1998 NRL season.", "It was the first grand final of the re-unified National Rugby League and featured minor premiers and the previous year's Super League premiers, the Brisbane Broncos against the Canterbury Bulldogs.", "It was to be the first grand final under the National Rugby League partnership's administration and the last to be played at the Sydney Football Stadium.", "It was also the first time these two sides had met in a grand final.", "Brisbane scored first but by half time trailed the Bulldogs 10\u201312.", "However, the Broncos scored 28 unanswered points in the second half, winning 12\u201338 and equaling the second highest score for a team in grand final history.", "List of Canterbury-Bankstown Bulldogs seasons" ], [ "National Rugby League", "In addition, the NRL premiers also play in the World Club Challenge, a pre-season match against the champions of the European Super League competition.", "The reigning premiers are the Sydney Roosters winning their fourteenth official premiership.", "The New South Wales Rugby League (NSWRL) ran the major rugby league competition of New South Wales from its inception in 1908 until 1994.", "Following the introduction of a new format for interstate rugby league, the State of Origin series in 1980, the decade of the 1980s brought about expansion of the NSWRL premiership, with the introduction of commercial sponsorship, the Winfield Cup, and the addition of non-Sydney-based teams, Canberra and Illawarra in 1982.", "Although this move brought more interest in the competition statewide in New South Wales, it would spell the beginning of the demise of some of the traditional Sydney-based clubs as well as having a negative effect on the Brisbane Rugby League premiership.", "Following the 1983 season, Sydney foundation club Newtown Jets were ultimately forced to withdraw from the competition because of financial difficulties.", "Further expansion of the league followed in 1988, with another three teams based outside Sydney introduced to the competition; the Newcastle Knights and the first two Queensland teams, the Brisbane Broncos and Gold Coast-Tweed Giants.", "The Brisbane and Newcastle sides proved to be successful and popular and paved the way towards a push for a truly national competition." ], [ "South Sydney Rabbitohs", "The club is based in Redfern, where the club's administration and training facilities are located, however they have long held a wide supporter base spread all over New South Wales.", "The team's home ground is currently Stadium Australia in Sydney Olympic Park.", "In the New South Wales Rugby League (1908\u20131994), Australian Rugby League (1995\u20131997), and National Rugby League (1998-1999, 2002\u2013present) competitions South Sydney are the most successful professional team in the history of Australian rugby league in terms of total championships won, having claimed 21 first grade premierships.", "In addition to winning the most premierships, the Rabbitohs also hold the distinction of being the only club to win a premiership in their inaugural season.", "The South Sydney District Rugby League Football Club was formed at a meeting on 17 January 1908 at Redfern Town Hall when administrator J J Giltinan, cricketer Victor Trumper and politician Henry Clement Hoyle gathered together in front of a large crowd of supporters.", "The club played in the first round of the newly formed New South Wales Rugby League, defeating North Sydney 11\u20137 at Birchgrove Oval on 20 April 1908.", "The team went on to win the inaugural premiership then successfully defended their title in the 1909 season, winning the Grand Final by default." ], [ "National Rugby League", "The 2007 finals series saw the South Sydney Rabbitohs return to finals football for the first time in decades.", "The season culminated on 30 September 2007, with the Grand Final contested between Manly and Melbourne.", "Melbourne won the title 34\u20138 and the Grand Final achieved the honour of being the most watched television show in Australia in 2007.", "Throughout 2008, the NRL celebrated 100 years since rugby league was introduced into Australia, with several initiatives to recognise the important milestone, including an extensive marketing campaign called the 'Centenary of Rugby League'.", "The competition began in March, with a special Heritage round held in mid-April, coinciding with the first round of competition played in 1908.", "At a Gala event on 17 April 2008 the Team of the Century was announced, being:\n\n\nFor the second year in a row, the Grand Final was played between the Melbourne Storm and the Manly Warringah Sea Eagles, in the NRL's first ever twilight decider.", "The Sea Eagles took out the premiership game 40\u20130, setting the record for the highest winning margin in a Grand Final match (although the club formerly known as St. George Dragons were beaten 38\u20130 in 1975 and using the modern point scale of 4-point tries, this would amount to 46\u20130.)", "Furthermore, it was the first time a team had been kept scoreless in a Grand Final since 1978." ] ], "gold": "The 1998 NRL season was the inaugural season of the newly formed National Rugby League or NRL. The 1998 NRL grand final was the first ever grand final under the National Rugby League, and the Brisbane Broncos emerged victorious. In this1998 grand final, the Brisbane Broncos scored 28 unanswered points in the second half to defeat the Canterbury Bulldogs 38 to 12. Prior to this from 1908 until 1994, the New South Wales Rugby League ran the major league rugby competition in New South Wales. The South Sydney Rabbitohs won the inaugural New South Wales Rugby League premiership by winning the grand final in 1908 and then successfully defended their title in the 1909 season, winning the grand final by default.", "prediction 1": "The first ever NRL grand final was held in 1998 between the Brisbane Broncos and the Canterbury Bulldogs. The Broncos won the grand final 12\u201338, equaling the second highest score for a team in grand final history. The first ever NRL grand final was held in 2014 between the South Sydney Rabbitohs and Manly Warringah Sea Eagles. The first ever NRL grand final was held in 2015 between the North Queensland Cowboys and the Sydney Rabbitohs.\n", "prediction 2": "The first ever NRL grand final was the conclusive game of the 1998 NRL season and was between the Brisbane Broncos and the Canterbury Bulldogs. Both teams won the game 3-2, but it was the first time these two teams had met in a grand final.", "prediction 3": "The first ever NRL grand final was played in 1998, between the Brisbane Broncos and Canterbury Bulldogs and was the conclusive and premiership-deciding game of the 1998 NRL season. The game was the first grand final of the re-unified National Rugby League and featured minor premiers and the previous year's Super League premiers, the Brisbane Broncos and the Canterbury Bulldogs. Additionally, the 2014 South Sydney Rabbitohs won their first premiership in 43 years, beating the Darwin Rebels 29-15.", "prediction 4": "There were several firsts in professional rugby league, including the Manly Warringah Sea Eagles winning the first ever NRL grand final in 2008 against the Melbourne Storm and the South Sydney Rabbitohs winning the first ever NRL grand final in 2014. The first ever NRL grand final was held between the Brisbane Broncos in 1998 and the Canterbury Bulldogs in 1998. Prior to that, the premiership deciding game between those two teams was the 1998 NRL grand final between the Broncos and the Bulldogs, with the only seven teams participating in the NRL.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 214, "end": 328 }, { "error type": "Irrelevant", "explanation": "", "start": 329, "end": 440 }, { "error type": "Irrelevant", "explanation": "", "start": 145, "end": 213 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 6, "sentence_id": [ 6 ] } ], "corrected-prediction": "The 1998 NRL season was the inaugural season of the newly formed National Rugby League or NRL. The first ever NRL grand final was held in 1998 between the Brisbane Broncos and the Canterbury Bulldogs. The Broncos won the grand final 12\u201338. Prior to this the South Sydney Rabbitohs won the inaugural New South Wales Rugby League premiership by winning the grand final in 1908.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is minister of magic after voldemort dies?", "passages": [ [ "Ministry of Magic", "Later, Dawlish is sent to arrest Augusta Longbottom.", "After a struggle, her defence places Dawlish in St Mungo's Hospital.", "Dawlish's first name is not revealed in the books or films.", "However, Rowling said in an interview with the podcast \"PotterCast\" that she named him John, owing to host John Noe's appreciation of the character.", "Dawlish was portrayed by Richard Leaf in the film adaptation of \"Harry Potter and the Order of the Phoenix\".", "Cornelius Oswald Fudge is first mentioned in \"Harry Potter and the Philosopher's Stone\" as the Minister for Magic of the United Kingdom.", "He makes his first appearance in \"Harry Potter and the Chamber of Secrets\" when he arrives at the school to take Hagrid to Azkaban, even though he does not firmly believe that Hagrid is guilty.", "He also removes Dumbledore as Headmaster when pressured by Lucius Malfoy who insisted that all the school governors had voted on it.", "However, it is not until \"Harry Potter and the Prisoner of Azkaban\" that Fudge meets Harry for the first time.", "Fudge does not press charges against Harry for accidentally inflating Aunt Marge, and advises him to be careful because an escaped convict is at large." ], [ "Ministry of Magic", "At times, the Ministry can also seem uninterested in solving serious problems, choosing instead to ignore or cover up bad news.", "In \"Harry Potter and the Chamber of Secrets\", Fudge takes a long time to respond to the attacks on Hogwarts.", "In the fourth and fifth instalments, Fudge refuses to believe that Lord Voldemort has returned, despite mounting evidence.", "The Ministry even mounts a campaign to damage Harry Potter's credibility, an effort fuelled in part by Fudge's fear that Albus Dumbledore wants to forcibly remove him from his position.", "Eventually, the Ministry is forced to acknowledge the emergency and act on it.", "Fudge is subsequently removed from office for incompetence and replaced by Rufus Scrimgeour.", "When interviewed, Rowling stated that when Harry, Ron and Hermione work for the Ministry, they change it drastically, making it less corrupt.", "The Department of Magical Law Enforcement is a combination of police and justice facilities.", "It is located on the second level of the Ministry of Magic.", "At the beginning of the series, it is headed by Amelia Bones, who is replaced by Pius Thicknesse after Voldemort murders her.", "Thicknesse is replaced by Yaxley in \"Harry Potter and the Deathly Hallows\" after Voldemort has Thicknesse appointed the puppet Minister for his regime." ], [ "Ministry of Magic", "Thicknesse is described as a man with long hair and a beard, which are mostly black but tinged with some grey, along with a great overhanging forehead and glinting eyes.", "Harry's immediate impression is of \"a crab looking out from beneath a rock.\"", "After the coup in which Scrimgeour is killed, the Ministry comes under the de facto control of Voldemort, who appoints Thicknesse as his puppet Minister.", "Thicknesse joins the ranks of the Death Eaters for the rest of the book and fights with them at the Battle of Hogwarts, where he duels against Percy Weasley (who Transfigures him into a sea urchin).", "Following the end of the battle, the Imperius Curse that was placed upon him is broken.", "Kingsley Shacklebolt replaces him as interim (later permanent) Minister for Magic.", "Not much is known about the \"real\" nature of Thicknesse, as he has been under the control of Yaxley for nearly the entire book.", "Guy Henry plays Thicknesse in \"Harry Potter and the Deathly Hallows \u2013 Part 1\" and \"Part 2\", in which he is portrayed as being a Death Eater even before Scrimgeour's death; there is no mention of the Imperius Curse being used to secure his support." ], [ "Ministry of Magic", "Ministry of Magic\n\nThe Ministry of Magic is the government of the Magical community of Britain in \"J. K. Rowling's Wizarding World\".", "The magical government in Britain is \nfirst mentioned in \"Harry Potter and the Philosopher's Stone\"; the Ministry makes its first proper appearance in \"Harry Potter and the Order of the Phoenix\".", "Throughout the books, it is generally depicted as either corrupt, incompetent, or both, with its high officials blind to actual events and dangers.", "It reaches a zenith of corruption before being effectively taken over by Lord Voldemort.", "At the end of the final book, following Voldemort's death, Kingsley Shacklebolt takes over the ministry, changing it for the better.", "By the time of \"Harry Potter and the Cursed Child\", Hermione Granger is the Minister for Magic.", "Each new Muggle Prime Minister receives a visit from the Minister for Magic, who informs him or her that the wizarding world exists.", "He explains that he will contact the Prime Minister only in circumstances in which the events of the wizard world may affect Muggles.", "For example, the Minister has to inform the Prime Minister if dangerous magical artefacts or animals are to be brought into Britain.", "The Ministry keeps in touch with the British Prime Minister via a wizard's portrait in the Prime Minister's office at 10 Downing Street." ], [ "Ministry of Magic", "Voldemort irreparably damaged her mentally and physically while breaking the Memory Charm, through which he gained information about the Triwizard Tournament and Crouch Jr..", "During the duel between Harry and Voldemort in the graveyard at Little Hangleton, Bertha is one of the shadows that spills out from Voldemort's wand and helps Harry escape.", "She appears to be wiser after her death, and supports Harry during \"The Goblet of Fire\" so he can defeat Voldemort, her murderer.", "Bertha Jorkins' character was written out of the film adaptation of \"Goblet of Fire\" due to time constraints.", "Rufus Scrimgeour serves as the Minister for Magic of the United Kingdom, succeeding Cornelius Fudge who was ousted by the wizarding community for his failure to announce the return of Voldemort, discrediting Harry Potter and Albus Dumbledore, and allowing Dolores Umbridge to become Headmistress of Hogwarts, from \"Harry Potter and the Half-Blood Prince\" until his death in the following book.", "He is described as looking like an old lion with tawny hair and bushy eyebrows, yellow eyes and wire-rimmed spectacles." ], [ "Ministry of Magic", "Scrimgeour makes a short appearance, looking tired and grim due to the pressures of his position, in \"Harry Potter and the Deathly Hallows\" at The Burrow with Dumbledore's will; a final argument promptly breaks out between Harry and him.", "Scrimgeour is assassinated shortly after the visit when Death Eaters take over the Ministry.", "He is rumoured to have been tortured for Harry's whereabouts by Ministry officials, under the control of the Imperius Curse, before he is killed.", "Harry felt a \"rush of gratitude\" to hear that Scrimgeour, in his final act, attempted to protect Harry by refusing to disclose his location.", "With the Ministry in Death Eaters' hands, the official line for Scrimgeour's death is that he resigned.", "Bill Nighy played Scrimgeour in \"Harry Potter and the Deathly Hallows \u2013 Part 1\", in which he is played as being Welsh.", "Pius Thicknesse is first introduced in \"Harry Potter and the Deathly Hallows\".", "He is the Head of the Department of Magical Law Enforcement at the start of the book, when he is placed under the Imperius Curse by Corban Yaxley, who uses his position to infiltrate the senior ranks of the Ministry." ], [ "Order of the Phoenix (fictional organisation)", "Firstly in \"Philosopher's Stone,\" Harry sees James and Lily in the Mirror of Erised.", "Secondly during Harry's struggle with Voldemort in \"Goblet of Fire,\" they appear momentarily, along with other victims killed by Voldemort's wand.", "They appear in Snape's memories in both \"Order of the Phoenix\" and \"Deathly Hallows\", and finally in \"Deathly Hallows\" when Harry makes his self-sacrificing walk into the Forbidden Forest, determined to let Voldemort kill him without offering resistance, Harry's parents walk at his side and Lily tells him how proud they are of him.", "In an interview conducted by Daniel Radcliffe, Rowling revealed that Lily Potter's maiden name, Evans, was based on the real name of the author George Eliot, Mary Anne Evans.", "Lily is portrayed by Geraldine Somerville as an adult in the film series, and by Susie Shinner as a teenager and Ellie Darcey-Alden as a child.", "Kingsley Shacklebolt is a senior Auror who acts as informer for the Order within the Ministry of Magic." ], [ "Ministry of Magic", "Before his resignation, he makes several attempts to have Dumbledore arrange a meeting between himself and Harry so that Harry can lie on Fudge's behalf and make it look as though the Ministry is winning the war, but Dumbledore refuses, knowing how ridiculous Harry would find the idea.", "Fudge is last mentioned in the series as one of the attendees at Dumbledore's funeral; his fate during Voldemort's takeover of the Ministry during the following year is unknown.", "In the film series, Fudge was portrayed by Robert Hardy.", "Bertha Jorkins was a student at Hogwarts at the same time as James Potter and company.", "She was known as nosy, with a good head for gossip.", "She became a Ministry of Magic employee after leaving Hogwarts.", "In the summer before the events of \"Harry Potter and the Goblet of Fire\", she was killed by Voldemort.", "Rowling later revealed that her death was used to turn Nagini, Voldemort's snake, into a Horcrux.", "Some months before her murder, she accidentally discovered that Barty Crouch Jr., who supposedly died in Azkaban prison, was still alive and being hidden by his father.", "Barty Crouch Sr. silenced her with a powerful Memory Charm, which made her a little befuddled." ] ], "gold": "At the end of Harry Potter and the Deathly Hallows, following Voldemort's death, Kingsley Shacklebolt takes over as the Minster for Magic, changing the ministry for the better. George Harris is the actor who plays Kingsley in the Harry Potter movies Order of the Phoenix and Deathly Hallows Part 1 and Part 2. By the time of Harry Potter and the Cursed Child, Hermione Granger is the Minister for Magic. However, in the beginning of the Harry Potter series, Cornelius Oswald Fudge is first mentioned in Harry Potter and the Philosopher's Stone as the Minister for Magic of the United Kingdom. Fudge was portrayed by Robert Hardy in the film series. Then, Rufus Scrimgeour serves as the Minister for Magic of the United Kingdom from Harry Potter and the Half-Blood Prince until his death, succeeding Cornelius Fudge who was ousted by the wizarding community for his failure to announce the return of Voldemort. Bill Nighy is the actor who plays Scrimgeour in Harry Potter and the Deathly Hallows \u2013 Part 1. Pius Thicknesse is first introduced in Harry Potter and the Deathly Hallows. He is the Head of the Department of Magical Law Enforcement at the start of the book. After the coup in which Scrimgeour is killed, the Ministry comes under the de facto control of Voldemort, who appoints Thicknesse as his puppet Minister. Guy Henry plays Thicknesse in Harry Potter and the Deathly Hallows \u2013 Part 1 and Part 2, in which he is depicted as a Death Eater even before Scrimgeour's death. In Part 2, Thicknesse is killed by Voldemort.", "prediction 1": "The Ministry of Magic is the government of the Magical community of Britain in J. K. Rowling's Wizarding World. The Ministry of Magic is the government of the Magical community of Britain in J. K. Rowling's Wizarding World. The Minister of Magic is Cornelius Oswald Fudge, who is first mentioned in Harry Potter and the Philosopher's Stone as the Minister for Magic of the United Kingdom. Fudge is later removed from office for incompetence and replaced by Rufus Scrimgeour.\n", "prediction 2": "The Ministry of Magic is the government of the Magical community of Britain in J. K. Rowling's Wizarding World. Following the death of Lord Voldemort, Cornelius Oswald Fudge becomes Minister of Magic for the United Kingdom. However, after Fudge's death, Rufus Scrimgeour becomes Minister of Magic until Kingsley Shacklebolt comes in.", "prediction 3": "The Minister of Magic, for the most part, is Cornelius Oswald Fudge. But when Voldemort dies, Thicknesse becomes the puppet minister. The puppet minister position is ended when Yaxley is killed. Along with Thicknesse, Rufus Scrimgeour takes over the ministry when Scrimgeour is killed in a coup and has Thicknesse appointed his temporary minister.", "prediction 4": "The Ministry of Magic, officially the Government of the Magical Community of Britain, is the government of the Magical community of Britain. In Harry Potter and the Deathly Hallows, Rufus Scrimgeour is the Minister of Magic of the United Kingdom, Foyles & Associates, and Cornelius Oswald Fudge is the Minister for Magic. In the movies, Cornelius Oswald Fudge is also the Minister of Magic.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 111 }, { "error type": "Redundant", "explanation": "The Ministry of Magic is the government of the Magical community of Britain in J. K. Rowling's Wizarding World. ", "start": 112, "end": 223 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 5, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 8, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Minister of Magic is Cornelius Oswald Fudge, who is first mentioned in Harry Potter and the Philosopher's Stone as the Minister for Magic of the United Kingdom. Fudge is later removed from office for incompetence and replaced by Rufus Scrimgeour. His incompetence was his failure to announce the return of Voldemort. Fudge was portrayed by Robert Hardy in the film series. Scrimgeour was Prime Minister in \"Harry Potter and the Half-Blood Prince\" until his death. Bill Nighy played Scrimgeour in \"Harry Potter and the Deathly Hallows \u2013 Part 1\". After the coup in which Scrimgeour is killed, the Ministry comes under the de facto control of Voldemort, who appoints Thicknesse as his puppet Minister. Guy Henry plays Thicknesse in \"Harry Potter and the Deathly Hallows \u2013 Part 1\" and \"Part 2\", in which he is portrayed as being a Death Eater even before Scrimgeour's death. Thicknesse is first introduced in \"Harry Potter and the Deathly Hallows\". He is the Head of the Department of Magical Law Enforcement at the start of the book. At the end of the final book, following Voldemort's death, Kingsley Shacklebolt takes over the ministry, changing it for the better. By the time of \"Harry Potter and the Cursed Child\", Hermione Granger is the Minister for Magic." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Naina real name in yeh un dino ki baat hai?", "passages": [ [ "Yeh Un Dinon Ki Baat Hai", "Yeh Un Dinon Ki Baat Hai\n\nYeh Un Dinon Ki Baat Hai (English: \"It\u2019s A Story About Those Days\") is an Indian Hindi-language coming of age romantic drama television series produced by Shashi Sumeet Productions which premiered on Sony TV on September 5, 2017.", "Ashi Singh and Randeep Rai play the roles of Naina and Sameer respectively.", "The show is based on the youngsters' love story and is set in the 1990s.", "It is inspired from the life of the producers Shashi and Sumeet Mittal.", "The show has been critically acclaimed for its performances and script.", "Critics have also praised its setting that correctly show the viewers how the 1990s were.", "It has a particularly good fan following and TRP on Sony LIV and is immensely popular on social media like Facebook.", "This show has also been dubbed in Tamil known as \"Ninaithale Inikkum\".", "The story is narrated by the adult versions of the main characters, Naina and Sameer.", "The story starts in 1990, in Ahmedabad, India." ] ], "gold": "The coming of age romantic period drama television series, Yeh Un Dino Ki Baat Hai, is inspired by the real-life love story of producers Shashi Mittal and Sumeet Mittal. Actress Ashi Singh played the character Naina in the series.", "prediction 1": "Yeh Un Dinon Ki Baat Hai is an Indian Hindi-language coming of age romantic drama television series produced by Shashi Sumeet Productions which premiered on Sony TV on September 5, 2017. Ashi Singh plays the character of Naina.\n", "prediction 2": "Yeh Un Dino Ki Baat Hai is an Indian Hindi-language coming of age romantic drama television series where characters are teenager and young adult alike. The character of Naina, who is the protagonist of the story, is Ashi Singh.", "prediction 3": "Yeh Un Dinon Ki Baat Hai is the name of an actress appearing in the Indian Hindi language coming of age romantic drama television series which premiered on Sony TV on September 5, 2017. The character of Naina was played by Ashi Singh.", "prediction 4": "The character of Naina in Yeh Un Dinon Ki Baat Hai is Ashi Singh, and the show is based on their coming of age love story from the 1990s and is set in Ahmedabad, India. Ashi Singh played Naina's mother while Randeep Rai played Naina's father.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 100, "end": 186 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Yeh Un Dinon Ki Baat Hai is an Indian Hindi-language coming of age romantic drama television series, inspired by the real-life love story of producers Shashi Mittal and Sumeet Mittal. Ashi Singh plays the character of Naina.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When did the north korean nuclear program start?", "passages": [ [ "North Korea and weapons of mass destruction", "North Korea and weapons of mass destruction\n\nNorth Korea has a military nuclear weapons program and also has a significant quantity of chemical and biological weapons.", "As of 2003, North Korea is no longer a party to the Treaty on the Non-Proliferation of Nuclear Weapons (NPT).", "The country has come under sanctions after conducting a number of nuclear tests, beginning in 2006.", "The nuclear program can be traced back to about 1962, when North Korea committed itself to what it called \"all-fortressization\", which was the beginning of the hyper-militarized North Korea of today.", "In 1963, North Korea asked the Soviet Union for help in developing nuclear weapons, but was refused.", "The Soviet Union agreed to help North Korea develop a peaceful nuclear energy program, including the training of nuclear scientists.", "Later, China, after its nuclear tests, similarly rejected North Korean requests for help with developing nuclear weapons.", "Soviet engineers took part in the construction of the Yongbyon Nuclear Scientific Research Center and began construction of an IRT-2000 research reactor in 1963, which became operational in 1965 and was upgraded to 8 MW in 1974.", "In 1979, North Korea began to build a second research reactor in Yongbyon, as well as an ore processing plant and a fuel rod fabrication plant.", "North Korea's nuclear weapons program dates back to the 1980s." ], [ "North Korea and weapons of mass destruction", "On October 9, 2006, North Korea demonstrated its nuclear capabilities with its first underground nuclear test, detonating a plutonium based device with an estimated yield of 0.2\u20131 kilotons.", "The test was conducted at Punggye-ri Nuclear Test Site in North Hamgyong Province, and U.S. intelligence officials later announced that analysis of radioactive debris in air samples collected a few days after the test confirmed that the blast had taken place.", "The UN Security Council condemned the test and announced the imposition of Resolution 1874.", "On January 6, 2007, the North Korean government further confirmed that it had nuclear weapons.", "In February 2007, following the six-party talks disarmament process, Pyongyang agreed to shut down its main nuclear reactor.", "On October 8, 2008, IAEA inspectors were forbidden by the North Korean government to conduct further inspections of the site.", "On April 25, 2009, the North Korean government announced the country's nuclear facilities had been reactivated, and that spent fuel reprocessing for arms-grade plutonium has been restored.", "On May 25, 2009, North Korea conducted its second underground nuclear test.", "The U.S. Geological Survey calculated its origin in proximity of the site of the first nuclear test.", "The test was more powerful than the previous test, estimated at 2 to 7 kilotons." ], [ "Timeline of the North Korean nuclear program", "Timeline of the North Korean nuclear program\n\nThis chronology of the North Korean nuclear program has its roots in the 1950s and begins in earnest in 1989 with the end of the Cold War and the collapse of the Soviet Union, the main economic ally of North Korea.", "The Chronology mainly addresses the conflict between the United States and North Korea, while including the influences of the other members of the six-party talks: China, Russia, South Korea, and Japan.", "The North Korean nuclear program can roughly be divided into four phases.", "Phase I (1956\u201380) dealt primarily with training and gaining basic knowledge.", "Phase II (1980\u201394) covers the growth and eventual suspension of North Korea's domestic plutonium production program.", "Phase III (1994\u20132002) covers the period of the \"freeze\" on North Korea's plutonium program (though North Korea pursued uranium enrichment in secret) and Phase IV (2002\u2013present) covers the current period of renewed nuclear activities.", "Nuclear weapon warhead designs fall into various categories.", "Compared to fission weapons, thermonuclear designs are exceedingly complex, and staged weapons in particular are so complex that only five countries (USA, Russia, France, UK, China) have created them in more than 70 years of research.", "The fuels for an H-bomb are also far more difficult to create." ], [ "North Korea and weapons of mass destruction", "Based on evidence from Pakistan, Libya, and multiple confessions from North Korea itself, the United States accused North Korea of noncompliance and halted oil shipments; North Korea later claimed its public confession of guilt had been deliberately misconstrued.", "By the end of 2002, the Agreed Framework was officially abandoned.", "In 2003, North Korea again announced its withdrawal from the Nuclear Proliferation Treaty.", "In 2005, it admitted to having nuclear weapons but vowed to close the nuclear program.", "On October 9, 2006, North Korea announced it had successfully conducted its first nuclear test.", "An underground nuclear explosion was detected, its yield was estimated as less than a kiloton, and some radioactive output was detected.", "On January 6, 2007, the North Korean government further confirmed that it had nuclear weapons.", "On March 17, 2007, North Korea told delegates at international nuclear talks that it was preparing to shut down its main nuclear facility.", "The agreement was reached following a series of six-party talks, involving North Korea, South Korea, China, Russia, Japan, and the United States begun in 2003.", "According to the agreement, a list of its nuclear programs would be submitted and the nuclear facility would be disabled in exchange for fuel aid and normalization talks with the United States and Japan." ] ], "gold": "The North Korean nuclear program can roughly be divided into four phases. The Phase I of the North Korean nuclear program, in which North Korean nuclear program started getting training for scientists began in 1956. The nuclear program can be traced back to about 1962, when North Korea committed itself to what it called \"all-fortressization\". North Korean began construction of an IRT-2000 research reactor in 1963 and on October 9, 2006, North Korea announced it had successfully conducted its first nuclear test.", "prediction 1": "The North Korean nuclear program can be traced back to about 1962, when North Korea committed itself to what it called \"all-fortressization\", which was the beginning of the hyper-militarized North Korea of today. The nuclear program can be divided into four phases. Phase I began in 1956 and ends in 1989, when the Cold War ended and the Soviet Union collapsed. Phase II began in 1980 and covers the growth and eventual suspension of North Korea's domestic plutonium production program. Phase IV began in 2002 and covers the current period of renewed nuclear activities.\n", "prediction 2": "The North Korean nuclear program started in 1989 at the end of the Cold War, when the Soviet Union and North Korea assumed full international recognition of their nuclear weapons powers. It began increasing production and preparing for war. As of December 31, 2015, North Korea has been following the Armistice Deployment and Threatened Deterrence Plans, which set an American embargo on North Korea and increased its nuclear weapons program if it so chooses.", "prediction 3": "The North Korean nuclear program started in 1989 with the end of the Cold War and the collapse of the Soviet Union, which was the main economic ally of North Korea. It has a military nuclear weapons program and also has a significant quantity of chemical and biological weapons. As of 2003, North Korea is no longer a party to the Treaty on the Non-Proliferation of Nuclear Weapons, which it signed in 2002.", "prediction 4": "The North Korean nuclear program began in 1989, just after the end of the Cold War. The beginning of the program was marked by the onset of nuclear testing, which prompted the country to conduct a number of nuclear tests, beginning in 2006. North Korea has a military nuclear weapons program and also has a significant quantity of chemical and biological weapons.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 212 }, { "error type": "Irrelevant", "explanation": "", "start": 292, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 486 }, { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 571 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 5 ] } ], "corrected-prediction": "The North Korean nuclear program can be traced back to about 1962, when North Korea committed itself to what it called \"all-fortressization\". The nuclear program can be divided into four phases. Phase I began in 1956 and dealt primarily with training and gaining basic knowledge. Construction of an IRT-2000 research reactor began in 1963 and on October 9, 2006, North Korea announced it had successfully conducted its first nuclear test.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did michigan raise drinking age to 21?", "passages": [ [ "U.S. history of alcohol minimum purchase age by state", "U.S. history of alcohol minimum purchase age by state\n\nThe alcohol laws of the United States regarding minimum age for purchase have changed over time.", "This history is given in the table below.", "Unless otherwise noted, if different alcohol categories have different minimum purchase ages, the age listed below is set at the \"lowest age given\" (e.g. if the purchase age is 18 for beer and 21 for wine or spirits, as was the case in several states, the age in the table will read as \"18\", not \"21\").", "In addition, the \"purchase age\" is not necessarily the same as the minimum age for \"consumption\" of alcoholic beverages, although they have often been the same.", "As one can see in the table below, there has been much volatility in the states' drinking ages since the\nrepeal of Prohibition in 1933.", "Shortly after the ratification of the 21st amendment in December, most states set their purchase ages at 21 since that was the voting age at the time.", "Most of these limits remained constant until the early 1970s.", "From 1969 to 1976, some 30 states lowered their purchase ages, generally to 18.", "This was primarily because the voting age was lowered from 21 to 18 in 1971 with the 26th amendment.", "Many states started to lower their minimum drinking age in response, most of this occurring in 1972 or 1973." ] ], "gold": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. The first time Michigan raised the drinking age to 21 was in 1933. The 2nd time it was raised to 21 was on December 21, 1978.", "prediction 1": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. In Michigan, the drinking age was raised to 21 on January 1, 1920. In New Jersey, the drinking age was raised to 21 on January 1, 1920. In Rhode Island, the drinking age was raised to 21 on January 1, 1920. In Massachusetts, the drinking age was raised to 21 on January 1, 1920.\n", "prediction 2": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. This history is given in the table below. Michigan raised drinking age to 21 on October 1, 1918 and again on November 5, 1919. Michigan restated drinking age to 21 on December 2, 1920 and on January 1, 1975. On January 1, 1971, Michigan raised drinking age to 21 on February 19, 1975. On March 26, 1981, Michigan raised drinking age to 21 on January 1.", "prediction 3": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. For example, if the purchase age is 18 for beer and 21 for wine or spirits, as was the case in several states, the age in the table will read as \"18\", not \"21\".", "prediction 4": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. As one can see in the table below, there has been much volatility in the states' drinking ages since the repeal of Prohibition in 1933. Shortly after the ratification of the 21st amendment in December, most states set their purchase ages at 21 since that was the voting age at the time. Most of these limits remained constant until the early 1970s. From 1969 to 1976, some 30 states lowered their purchase ages, generally to 18.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 232 }, { "error type": "Irrelevant", "explanation": "", "start": 233, "end": 303 }, { "error type": "Irrelevant", "explanation": "", "start": 304, "end": 376 }, { "error type": "Unverifiable", "explanation": "", "start": 97, "end": 163 } ], "missing-info": [], "corrected-prediction": "The alcohol laws of the United States regarding minimum age for purchase have changed over time. " }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who did vince carter play for last year?", "passages": [ [ "Vince Carter", "Vince Carter\n\nVincent Lamar Carter (born January 26, 1977) is an American professional basketball player for the Atlanta Hawks of the National Basketball Association (NBA).", "He is tall and plays both shooting guard and small forward.", "Carter is the fourth player in the NBA ever to play 21 seasons, the most in NBA history.", "A high school McDonald's All-American, Carter played three years at the University of North Carolina.", "While there, he twice reached the Final Four of the NCAA Tournament before being selected as the fifth overall pick in the 1998 NBA draft by the Golden State Warriors, who traded him to the Toronto Raptors.", "He won the 1999 NBA Rookie of the Year Award and won the Slam Dunk Contest at the 2000 NBA All-Star Weekend.", "That summer, he represented the United States in the Summer Olympics, winning a gold medal.", "Carter emerged as a star in Toronto, entertaining crowds with his leaping ability and slam dunks, earning him nicknames such as \"Vinsanity\", \"Air Canada\", and \"Half-Man, Half-Amazing\".", "In December 2004, he was traded to the New Jersey Nets, where he continued to put up big numbers.", "In June 2009, Carter was traded to the Orlando Magic.", "In his first season with the Magic, he appeared in his first", "and so far only Conference Finals series.", "In December 2010, he was traded to the Phoenix Suns." ], [ "Vince Carter", "He joined the defending champion Dallas Mavericks in 2011 and the Memphis Grizzlies in 2014.", "In 2017, he signed with the Sacramento Kings.", "In 2018, he signed with the Hawks.", "Carter is an eight-time NBA All-Star.", "He is one of six players in NBA history to average at least 20 points, 4 rebounds and 3 assists per game in 10 straight seasons.", "He is also one of six players in league history to record 24,000 points, 6,000 rebounds, 2,500 assists, 1,000 steals and 1,000 3-point field goals.", "Off the court, Carter established his Embassy of Hope Foundation, assisting children and their families in Florida, New Jersey and Toronto.", "He was recognized in 2000 as Child Advocate of the Year by the Children's Home Society, and received the Florida Governor's Points of Light award in 2007 for his philanthropy in his home state.", "Born in Daytona Beach, Florida, Carter attended Mainland High School in Daytona Beach.", "He led Mainland's basketball team to its first Class 6A state title in 56 years and was a 1995 McDonald's All-American.", "Carter attended the University of North Carolina at Chapel Hill, spending three seasons playing college basketball for the North Carolina Tar Heels under Dean Smith and later, Bill Guthridge." ] ], "gold": "Vincent Lamar Carter Jr. is an American former professional basketball player and current basketball analyst for ESPN. He has been ranked as the greatest dunker of all time by numerous players, journalists, and by the National Basketball Association. Carter played for the Sacramento Kings in the 2017-2018 season. He played for the Memphis Grizzlies in the 2015-2016 and 2016-2017 seasons.", "prediction 1": "Vince Carter is an American professional basketball player for the Atlanta Hawks of the National Basketball Association. He played for the Sacramento Kings in 2016-17 and the Sacramento Kings in 2017-18. In 2018, Vince Carter signed with the Hawks.\n", "prediction 2": "Vince Carter is an American professional basketball player for the Atlanta Hawks. In 2017, he signed with the Sacramento Kings and, in 2018, the Atlanta Hawks.", "prediction 3": "Vince Carter played for the Atlanta Hawks in 2018-19. In 2018, Vince Carter signed with the Sacramento Kings. In 2017, Vince Carter signed with the Hawks.", "prediction 4": "Vince Lamar Carter is an American professional basketball player for the Atlanta Hawks of the National Basketball Association (NBA). He played two seasons for the Raptors in the 2017-18 season and for the Kings in 2018-19. Prior to joining the Hawks, Vince played for the Dallas Mavericks in 2001-2002 and the Memphis Grizzlies in 2014-15.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 120 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 121, "end": 166 }, { "error type": "Redundant", "explanation": "Vince Carter is an American professional basketball player for the Atlanta Hawks of the National Basketball Association. He played for the Sacramento Kings in 2016-17 ", "start": 171, "end": 203 }, { "error type": "Redundant", "explanation": "Vince Carter is an American professional basketball player for the Atlanta Hawks ", "start": 204, "end": 249 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 13 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "Vince Carter is an American professional basketball player for the Atlanta Hawks. He signed with the Sacramento Kings in 2017. He joined the Dallas Mavericks in 2011 and the Memphis Grizzlies in 2014, the Phoenix Suns in 2010, the Orlando Magic in 2009, the New Jersey Nets in 2004, he represented the United States in the Summer Olympics, the fifth overall pick in the 1998 NBA draft by the Golden State Warriors, who traded him to the Toronto Raptors, three years at the University of North Carolina, and Mainland High School in 1995.\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did the original game boy come out?", "passages": [ [ "Game Boy", "Game Boy\n\nThe Game Boy is an 8-bit handheld game console which was developed and manufactured by Nintendo and first released on , in North America on and in Europe on .", "It is the first handheld console in the Game Boy line and was created and published by Satoru Okada and Nintendo Research & Development 1.", "This same team, led by Gunpei Yokoi at the time, is credited with designing the Game & Watch series as well as several popular games for the Nintendo Entertainment System.", "Redesigned versions were released in 1996 and 1998 in the form of Game Boy Pocket and Game Boy Light (Japan only), respectively.", "The Game Boy is Nintendo's first handheld game console and it combined features from both the Nintendo Entertainment System and Game & Watch.", "It was sold either as a standalone unit or bundled with the puzzle game \"Tetris\".", "During its early lifetime, the Game Boy mainly competed with Sega's Game Gear, Atari's Lynx, and NEC's TurboExpress.", "The Game Boy outsold its rivals and became a significant success.", "The Game Boy and its successor, the Game Boy Color, have sold over 118 million units worldwide.", "Upon the Game Boy's release in the United States, its entire shipment of one million units was sold within a few weeks." ], [ "Game Boy", "A clear 'skeleton' \"Famitsu\" edition appeared in 1997, which had only 5,000 units released, and a clear yellow edition.", "The Game Boy Light was released on April 14, 1998, for \u00a56,800 and was only available in Japan.", "The Game Boy Light is only slightly bigger than the Game Boy Pocket and features an electroluminescent backlight for low-light conditions.", "It uses 2 AA batteries, which gave it approximately 20 hours with the light off and 12 with it on.", "It was available in two standard colors, gold and silver.", "It also received numerous special editions, including an Astro Boy edition with a clear case and a picture of Astro Boy on it, an Osamu Tezuka World edition with a clear red case and a picture of his characters, and a solid yellow Pok\u00e9mon Center Tokyo version.", "Though it was less technically advanced than the Lynx and other competitors, the Game Boy's excellent battery life and rugged hardware and the popularity of the bundled \"Tetris\" and other games made it much more successful.", "In its first two weeks in Japan, from its release on April 21, 1989, the entire stock consisting of 300,000 units was sold; a few months later, the Game Boy's release in the United States on July 31, 1989, saw 40,000 units sold on its first day." ], [ "Game Boy family", "And what we just told the reporter was that in thinking about the current situation where we are enjoying great sales with the DS and that we are now trying to launch the Wii, it's unthinkable for us to launch any new platform for the handheld system, including the new version of the GBA...", "Perhaps they misunderstood a part of this story, but as far as the handheld market is concerned [right now] we really want to focus on more sales of the DS; that's all.\"", "The original gray Game Boy was first released in Japan on April 21, 1989.", "Based on a Z80 processor, it has a black and green reflective LCD screen, an eight-way directional pad, two action buttons (A and B), and Start and Select buttons with the controls being identical to the NES controller.", "It plays games from ROM-based media contained in cartridges (sometimes called carts or Game Paks).", "Its graphics are 8-bit (similar to the NES).", "The game that pushed the Game Boy into the upper reaches of success was \"Tetris\".", "Tetris was widely popular, and on the handheld format could be played anywhere.", "It came packaged with the Game Boy, and broadened its reach; adults and children alike were buying Game Boys in order to play \"Tetris\"." ] ], "gold": "The Game Boy is an 8-bit handheld game console developed and manufactured by Nintendo. The system combines features from both the NES home system and Game & Watch hardware, featuring a dull green dot-matrix screen with adjustable contrast dial, five control buttons and a single speaker with adjustable volume dial. It was first released in Japan on April 21, 1989, followed soon by it launch in North America on July 31, 1989. It arrived to Europe more than a year later, on September 28, 1990.", "prediction 1": "The Game Boy is an 8-bit handheld game console developed and manufactured by Nintendo and first released in Japan on April 21, 1989. It was released in North America on July 31, 1989, and in Europe on October 20, 1989. It is the first handheld console in the Game Boy line and was created and published by Satoru Okada and Nintendo Research & Development 1. Redesigned versions were released in 1996 and 1998 in the form of Game Boy Pocket and Game Boy Light (Japan only).\n", "prediction 2": "The Game Boy is a series of 8-bit video game handhelds developed by Nintendo Corporation. The Gray Game Boy was released in Japan on April 21, 1989. In North America, it was released on July 31, 1989. The Game Boy's First Day in Stores was April 14, 1998.", "prediction 3": "The Game Boy is an 8-bit gaming console developed and manufactured by Nintendo and first released in Japan on April 21, 1989. It was later released in North America and Europe on April 11, 1989. The Game Boy is Nintendo's first handheld game console and combined features from the Nintendo Entertainment System and Game & Watch.", "prediction 4": "The Game Boy is a handheld game console released by Nintendo that was developed and produced by Nintendo and first came out in Japan on April 21, 1989. It was released in Europe on February 13, 1992, and in North America on March 13, 1992.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 201, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 473 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Game Boy is an 8-bit handheld game console developed and manufactured by Nintendo and first released in Japan on April 21, 1989. It was released in North America on July 31, 1989, and then in Europe. The system combined features from both the Nintendo Entertainment System and Game & Watch." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did they stop making silver kennedy half dollars?", "passages": [ [ "Kennedy half dollar", "U.S. Assistant Secretary of State for African Affairs G. Mennen Williams distributed plastic-encased specimens to presidents and foreign ministers of African nations and to the U.S. ambassadors serving there \"to win friends for the United States in Africa\".", "Shortly after the coin's release, the Denver Mint began receiving complaints that the new coin depicted a hammer and sickle on the bottom of Kennedy's truncated bust.", "In response, Roberts stated that the portion of the design in question was actually his monogram, a stylized \"\".", "The Mint struck Kennedy half dollars in large numbers in an attempt to meet the overwhelming demand.", "The Treasury had initially planned to issue 91\u00a0million half dollars for 1964, but raised the number to 141\u00a0million.", "However, a public announcement of the increase failed to cause more coins to actually circulate or to decrease the prices on the secondary market.", "By late November, the Mint had struck approximately 160\u00a0million pieces, yet the coin was almost never seen in circulation.", "Silver prices were rising, and the majority of the coins were being hoarded.", "Hopeful that issuing more 1964-dated coins would counter the speculation in them, the Treasury requested and received Congressional authorization to continue striking 1964-dated coins into 1965.", "Eventually, almost 430\u00a0million half dollars dated 1964 were struck, a sum greater than the total struck for circulation in the sixteen years of the Franklin half dollar series." ], [ "Kennedy half dollar", "In addition to business strikes, special collector coins were struck for the Bicentennial in silver clad; silver proof sets in which the dime, quarter and half dollar were struck in 90%\u00a0silver were first minted in 1992.", "In 2014 a special edition of the Kennedy half dollar was also struck in 99.99% gold.", "Even though ample supplies of circulating half dollars are readily available from most banks, their circulation is still limited.", "Since 2002, Kennedy half dollars have only been struck to satisfy the demand from collectors, and are available at a premium through the Mint.", "Within hours of the assassination of John F. Kennedy on November 22, 1963, Mint Director Eva Adams called Chief Engraver Gilroy Roberts, informing him that serious consideration was already being given to depicting Kennedy on one of the larger silver coins: either the silver dollar, half dollar, or quarter dollar.", "Adams called Roberts again on November 27 and authorized the project, stating that the late president's widow, Jacqueline Kennedy preferred that he be depicted on the half dollar, replacing the previous design of Benjamin Franklin.", "Mrs. Kennedy's reasoning was that she did not want to replace George Washington on the quarter." ], [ "Kennedy half dollar", "Kennedy half dollar\n\nThe Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint.", "Intended as a memorial to the assassinated President John F. Kennedy, it was authorized by Congress just over a month after his death.", "Use of existing works by Mint sculptors Gilroy Roberts and Frank Gasparro allowed dies to be prepared quickly, and striking of the new coins began in January 1964.", "The silver coins were hoarded upon their release in March 1964 by collectors and those interested in a memento of the late president.", "Although the Mint greatly increased production, the denomination was seldom seen in circulation.", "Continued rises in the price of silver increased the hoarding\u2014many early Kennedy half dollars have been melted for their silver content.", "Starting with 1965-dated pieces, the percentage of fine silver was reduced from 90% to 40% (silver clad), but even with this change the coin saw little circulation.", "In 1971, when silver was eliminated entirely from the coins and production increased, the series began to see improved, but still limited circulation.", "A special design for the reverse of the half dollar was issued for the United States Bicentennial and was struck in 1975 and 1976." ] ], "gold": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. Starting with 1965-dated pieces, the percentage of fine silver was reduced from 90% to 40% (silver clad), but even with this change the coin saw little circulation. In 1971, silver was eliminated entirely from the coins and production increased, but the half dollar still saw only a minimal increase in usage.", "prediction 1": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. Intended as a memorial to the assassinated President John F. Kennedy, it was authorized by Congress just over a month after his death. The silver coins were hoarded upon their release in March 1964 by collectors and those interested in a memento of the late president. In 1971, when silver was eliminated entirely from the coins and production increased, the series began to see improved, but still limited circulation.\n", "prediction 2": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. Originally authorized by Congress just over a month after his death, the coin was also produced until 1971 when the proportion of fine silver was reduced dramatically.", "prediction 3": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. It was first issued in silver due to a shortage in silver clad coins, which collectors hoarded like treasures until 1971, when the Mint stopped producing silver Kennedy half dollars.", "prediction 4": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. It is intended as a memorial to the assassinated President John F. Kennedy, and was authorized by Congress just over a month after his death. Initially, silver Kennedy half dollars were minted in large quantities, but the Mint gradually stopped producing them in 1964 and 1961.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 246 }, { "error type": "Irrelevant", "explanation": "", "start": 247, "end": 380 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Kennedy half dollar, first minted in 1964, is a fifty-cent coin currently issued by the United States Mint. Starting with 1965-dated pieces, the percentage of fine silver was reduced from 90% to 40% (silver clad), but even with this change the coin saw little circulation. In 1971, when silver was eliminated entirely from the coins and production increased, the series began to see improved, but still limited circulation.\n" }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "What does foo stand for in foo fighters?", "passages": [ [ "Foo Fighters", "Foo Fighters\n\nFoo Fighters is an American rock band, formed in Seattle, Washington, in 1994.", "It was founded by Nirvana drummer Dave Grohl as a one-man project following the dissolution of Nirvana after the suicide of Kurt Cobain.", "The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots in World War II, which were known collectively as \"foo fighters\".", "Prior to the release of Foo Fighters' 1995 debut album \"Foo Fighters\", which featured Grohl as the only official member, Grohl recruited bassist Nate Mendel and drummer William Goldsmith, both formerly of Sunny Day Real Estate, as well as Nirvana touring guitarist Pat Smear to complete the lineup.", "The band began with performances in Portland, Oregon.", "Goldsmith quit during the recording of the group's second album, \"The Colour and the Shape\" (1997), when most of the drum parts were re-recorded by Grohl himself.", "Smear's departure followed soon afterward, though he would rejoin them in 2006.", "They were replaced by Taylor Hawkins and Franz Stahl, respectively, although Stahl was fired before the recording of the group's third album, \"There Is Nothing Left to Lose\" (1999)." ], [ "Smokey Stover", "Holman states that he used the word due to having seen it on bottom of a jade Chinese figurine in Chinatown, San Francisco, meaning \"good luck\".", "This is presumably as a transliteration of the fu character (f\u00fa, \u798f), which is a common character for fortune, and figurines of the trio of eponymous male \"star gods\" \"F\u00fa, L\u00f9, Sh\u00f2u\" are common in Chinese communities.", "See Etymology of \"foobar\" for further discussion.", "During World War II, images of Smokey Stover and Spooky were painted as nose art on several American bomber aircraft.", "The term \"foo\" was borrowed directly from \"Smokey Stover\" by a radar operator in the U.S. 415th Night Fighter Squadron, Donald J. Meiers, who it is agreed by most 415th members gave the \"foo fighters\" their name.", "The phrase foo fighter, also taken from Holman's strip, was used by Allied aircraft pilots in World War II to describe various unidentified flying objects or mysterious aerial phenomena seen in the skies over both the European and Pacific Theaters of Operations.", "Though foo fighter initially described a type of UFO reported and named by the 415th Squadron, the term was also commonly used to mean any UFO sighting from that period.", "Foo Fighters is also the name of a rock band, first heard in 1995." ], [ "Foo fighter", "Foo fighter\n\n", "The term foo fighter was used by Allied aircraft pilots in World War II to describe various UFOs or mysterious aerial phenomena seen in the skies over both the European and Pacific theaters of operations.", "Though \"foo fighter\" initially described a type of UFO reported and named by the U.S. 415th Night Fighter Squadron, the term was also commonly used to mean any UFO sighting from that period.", "Formally reported from November 1944 onwards, witnesses often assumed that the foo fighters were secret weapons employed by the enemy.", "The Robertson Panel explored possible explanations, for instance that they were electrostatic phenomena similar to St. Elmo's fire, electromagnetic phenomena, or simply reflections of light from ice crystals.", "The nonsense word \"foo\" emerged in popular culture during the early 1930s, first being used by cartoonist Bill Holman, who peppered his \"Smokey Stover\" fireman cartoon strips with \"foo\" signs and puns.", "The term \"foo\" was borrowed from Bill Holman's \"Smokey Stover\" by a radar operator in the 415th Night Fighter Squadron, Donald J. Meiers, who (it is agreed by most 415th members) gave the foo fighters their name.", "Meiers was from Chicago and was an avid reader of Bill Holman's strip, which was run daily in the \"Chicago Tribune\"." ] ], "gold": "Foo Fighters are an American rock band formed in Seattle, Washington, in 1994. The band was founded by former Nirvana drummer Dave Grohl as a one-man project following the dissolution of Nirvana after the suicide of Kurt Cobain. The group took its name from \"foo fighter\", a nickname coined by Allied aircraft pilots for UFOs and other aerial phenomena. According to Smokey Stover's catch-phrase, the word \"foo\" in \"foo fighters\" stands for \"fire\". According to Bill Holman, the word \"foo\" in \"foo fighters\" stands for \"good luck\".", "prediction 1": "Foo Fighters is an American rock band formed in Seattle, Washington, in 1994. The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots in World War II, which were known collectively as \"foo fighters\". The term foo fighter was initially used by Allied aircraft pilots in World War II to describe various unidentified flying objects or mysterious aerial phenomena seen in the skies over both the European and Pacific Theaters of Operations. The term foo fighter was also commonly used to mean any UFO sighting from that period.\n", "prediction 2": "Foo Fighters is an American rock band formed in Seattle, Washington, in 1994. The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots in World War II, which were known collectively as \"foo fighters\". The term foo fighter was originally used to describe a type of UFO reported by the U.S. 415th Night Fighter Squadron, but it was also commonly used to mean any UFO sighting from that period. Initially, foo fighter was borrowed directly from \"Smokey Stover\" by a radar operator in the 415th Night Fighter Squadron, Donald J. Meiers, who (it is agreed by most 415th members gave the fooooooooo fighters their name.", "prediction 3": "Foo Fighters is an American rock band, formed in Seattle, Washington, in 1994. The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots in World War II, which were known collectively as foo fighters. The term foo fighter was initially used by Allied aircraft pilots in World War II to describe various unidentified flying objects or mysterious aerial phenomena seen in the skies over both the European and Pacific Theaters of Operations. The term foo fighter was also commonly used to mean any UFO sighting from that period. Foo Fighters spread quickly spread into the popular American rock band's career.", "prediction 4": "Foo Fighters is an American rock band founded by Nirvana drummer Dave Grohl as a one-man project following the dissolution of Nirvana after the suicide of Kurt Cobain. Foo Fighters got its name from the reported UFOs and various aerial phenomena by Allied aircraft pilots in World War II, which were known collectively as \"foo fighters. The phrase foo fighter was used by Allied aircraft pilots in World War II to describe various unidentified flying objects or mysterious aerial phenomena seen in the skies over both the European and the Pacific Theaters of Operations. Though foo fighter initially described a type of UFO reported and named by the 415th Night Fighter Squadron, the term was also commonly used to mean any UFO sighting from that period.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 205 }, { "error type": "Redundant", "explanation": "Foo Fighters is an American rock band formed in Seattle, Washington, in 1994. The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots ", "start": 255, "end": 320 }, { "error type": "Irrelevant", "explanation": "", "start": 321, "end": 336 }, { "error type": "Redundant", "explanation": "Foo Fighters is an American rock band formed in Seattle, Washington, in 1994. The group got its name from the UFOs and various aerial phenomena ", "start": 337, "end": 415 }, { "error type": "Irrelevant", "explanation": "", "start": 416, "end": 492 }, { "error type": "Irrelevant", "explanation": "", "start": 493, "end": 580 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Foo Fighters is an American rock band formed in Seattle, Washington, in 1994. It was founded by Nirvana drummer Dave Grohl as a one-man project following the dissolution of Nirvana after the suicide of Kurt Cobain. The group got its name from the UFOs and various aerial phenomena that were reported by Allied aircraft pilots which were known collectively as \"foo fighters\". Holman states that the meaning is \"good luck\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who voiced kaa in the original jungle book?", "passages": [ [ "Kaa", "Boone starts gathering as much treasure as he can, but notices that the monkeys have gone silent; Kaa suddenly appears, then scares the injured Boone into the moat, where the heavy load of treasure he is carrying weighs him straight to the bottom.", "Desperately trying to struggle free, Boone sees the skeletal remains of Kaa's past victims just seconds before the villain finally meets his death by the python.", "Kaa appeared in Walt Disney Pictures' live-action adaptation of the animated film, directed by Jon Favreau.", "This version of Kaa is female and is voiced by Scarlett Johansson.", "This film's Kaa (like the previous Disney incarnations voiced by Sterling Holloway, Hal Smith, and Jim Cummings) desires to eat Mowgli.", "Luring him in by promising to keep him safe, she hypnotizes him and reveals that the boy came to live in the jungle when Shere Khan killed his father as they were travelling between villages and Bagheera found him.", "She also reveals to him the power of the \"Red Flower\" (fire) and its dangers in her vision.", "During her storytelling, she attempts to devour him, but Baloo spots and rescues Mowgli, denying her of her meal.", "She is not seen again for the rest of the film, though during the end credits, she is heard singing \"Trust in Me\"." ], [ "Kaa", "Kaa\n\nKaa is a fictional character from \"The Jungle Book\" stories written by Rudyard Kipling.", "Kaa is one of Mowgli's trusted mentors and friends.", "First introduced in the story \"Kaa's Hunting\" in \"The Jungle Book\", Kaa is a huge and powerful snake, more than 100 years old and still in his prime.", "In \"Kaa's Hunting\", Bagheera and Baloo enlist Kaa's help to rescue Mowgli when the man-cub is kidnapped by Bandar-log (monkeys) and taken to an abandoned human city called the Cold Lairs.", "Kaa breaks down the wall of the building in which Mowgli is imprisoned in and uses his serpentine hypnosis to draw the monkeys toward his waiting jaws.", "Bagheera and Baloo are also hypnotized, but Mowgli is immune because he is human and breaks the spell on his friends.", "In \"The Second Jungle Book\", Kaa appears in the first half of the story \"The King's Ankus\".", "After Kaa and Mowgli spend some time relaxing, bathing and wrestling, Kaa persuades Mowgli to visit a treasure chamber guarded by an old cobra beneath the same Cold Lairs.", "The cobra tries to kill Mowgli but its poison has dried up." ], [ "Trust in Me (The Python's Song)", "Trust in Me (The Python's Song)\n\n\"Trust in Me (The Python's Song)\" is a song in the widely popular Walt Disney film, \"The Jungle Book\", from 1967.", "The song was sung by Sterling Holloway playing the part of \"Kaa, the snake\".", "The song was written by Disney staff songwriters, Robert and Richard Sherman.", "In the song, Kaa hypnotizes Mowgli, into a calm, soothing, relaxing trance, sending Mowgli walking along his body until he finally coils himself around Mowgli just like he did before.", "As the song concludes, Kaa readies himself to devour the boy, only to be stopped by Shere Khan the tiger in his search for Mowgli.", "The Shermans were brought onto the film by Walt Disney due to Disney's feeling that the interpretation was keeping too true to the Rudyard Kipling book.", "In a deliberate effort to keep the score \"light\", this song as well as the Sherman Brothers' other contributions generally concern darker subject matter than the accompanying music would suggest." ] ], "gold": "Kaa is a fictional character from The Jungle Book stories written by Rudyard Kipling. He is a giant snake. Kaa appears in the 1967 animated adaptation by Walt Disney Productions and is voiced by Sterling Holloway. Kaa appears in the 2016 remake of the 1967 film. This version of Kaa is female and voiced by Scarlett Johansson.", "prediction 1": "In the original Jungle Book, Kaa is a fictional character and one of Mowgli's trusted mentors and friends. In the 1967 Walt Disney film The Jungle Book, Sterling Holloway voices Kaa. In the live-action film, Scarlett Johansson voices Kaa.\n", "prediction 2": "In the original Jungle Book, Kaa is the title character, a mysterious serpent that has taken over normal human experiences. In the 1967 Disney film The Jungle Book, Sterling Holloway, Jasper Johns, and Hal Smith voiced Kaa. In the 2000 movie A Bugs Life, Katie Holmes voiced the character, Madam Butterfly. In the 2006 movie The Jungle Book 2, Scarlett Johansson voices the character.", "prediction 3": "The characters Kaa and Gromit are a part of the original The Jungle Book and were first introduced in Chapter 1 of the book. Sterling Holloway plays the role of Kaa. He was voiced by Alan Menken, Bob Eastin, and Jack Kirby. Sterling Holloway then played the part of Kaa in Disney's 1967 The Jungle Book film. However, in Disney's 2009 version of The Jungle Book, Kaa is sung by Joanna Lumley.", "prediction 4": "In the tales of Rudyard Kipling's The Jungle Book, Kaa is an instructor, mentor, and friend to the boy Mowgli. In the 1967 Walt Disney movie The Jungle Book, Sterling Holloway plays the part of Kaa. In the film, Miranda Priestley and Scarlett Johansson also voice Kaa. In the 1994 film adaptation of the story, Kaa is the female version of the python that tricks the boy into agreeing to eat her.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 58, "end": 106 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "In the original Jungle Book, Kaa is a fictional character. Kaa is a huge snake. In the 1967 Walt Disney film The Jungle Book, Sterling Holloway voices Kaa. In the live-action film, Scarlett Johansson voices Kaa, who is female in this version. Hal Smith and Jim Cummings have also voiced Kaa." }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Total number of steps in the eiffel tower?", "passages": [ [ "Eiffel Tower", "Eiffel Tower\n\nThe Eiffel Tower ( ; ) is a wrought-iron lattice tower on the Champ de Mars in Paris, France.", "It is named after the engineer Gustave Eiffel, whose company designed and built the tower.", "Constructed from 1887\u20131889 as the entrance to the 1889 World's Fair, it was initially criticized by some of France's leading artists and intellectuals for its design, but it has become a global cultural icon of France and one of the most recognisable structures in the world.", "The Eiffel Tower is the most-visited paid monument in the world; 6.91\u00a0million people ascended it in 2015.", "The tower is tall, about the same height as an 81- building, and the tallest structure in Paris.", "Its base is square, measuring on each side.", "During its construction, the Eiffel Tower surpassed the Washington Monument to become the tallest man-made structure in the world, a title it held for 41 years until the Chrysler Building in New York City was finished in 1930.", "Due to the addition of a broadcasting aerial at the top of the tower in 1957, it is now taller than the Chrysler Building by .", "Excluding transmitters, the Eiffel Tower is the second tallest free-standing structure in France after the Millau Viaduct.", "The tower has three levels for visitors, with restaurants on the first and second levels." ], [ "Eiffel Tower", "Because the lifts were not yet in operation, the ascent was made by foot, and took over an hour, with Eiffel stopping frequently to explain various features.", "Most of the party chose to stop at the lower levels, but a few, including the structural engineer, \u00c9mile Nouguier, the head of construction, Jean Compagnon, the President of the City Council, and reporters from \"Le Figaro\" and \"Le Monde Illustr\u00e9\", completed the ascent.", "At 2:35\u00a0pm, Eiffel hoisted a large Tricolour to the accompaniment of a 25-gun salute fired at the first level.", "There was still work to be done, particularly on the lifts and facilities, and the tower was not opened to the public until nine days after the opening of the exposition on 6 May; even then, the lifts had not been completed.", "The tower was an instant success with the public, and nearly 30,000 visitors made the 1,710-step climb to the top before the lifts entered service on 26 May.", "Tickets cost 2 francs for the first level, 3 for the second, and 5 for the top, with half-price admission on Sundays, and by the end of the exhibition there had been 1,896,987 visitors." ] ], "gold": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. It is named after the engineer Gustave Eiffel, whose company designed and built the tower. The tower is the tallest structure in Paris at 1,063 ft tall, and has 1,710 steps that visitors can climb to the top before the lift was entered into service. There are various scale models of the tower in the United States, a scale model at Kings Island, located in Mason, Ohio, has 410 steps. ", "prediction 1": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. It is named after the engineer Gustave Eiffel, whose company designed and built the tower. The tower is the most-visited paid monument in the world, with 6.91 million people ascended it in 2015.\n", "prediction 2": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. Constructed from 1887\u20131889 as the entrance to the 1889 World's Fair, it has become a global cultural icon of France and one of the most recognisable structures in the world. The four floors of the tower have 1,710-stepped steps, on each level.", "prediction 3": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. Built as the entrance to the 1889 World's Fair, it has become a global cultural icon of France and one of the most recognisable structures in the world. In January 1900, the climb up to the top of the 1,710-step tower was completed, but the number of steps stopped being recorded until 2009. In December 2004, the number of steps added to the tower increased to 3,340.", "prediction 4": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. During its construction, the Eiffel Tower surpassed the Washington Monument to become the tallest man-made structure in the world, a title it held for 41 years until the Chrysler Building in New York City was finished in 1930.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 179, "end": 283 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. It is named after the engineer Gustave Eiffel, whose company designed and built the tower. The tower is the tallest structure in Paris, and has 1,710 steps that visitors can climb to the top before the lift was entered into service.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Sajan re phir jhooth mat bolo jaya real name?", "passages": [ [ "Sajan Re Phir Jhooth Mat Bolo", "Sajan Re Phir Jhooth Mat Bolo\n\nSajan Re Phir Jhoot Mat Bolo (SRPJMB) (English: \"Do not lie again, honey\") is an Indian sitcom which is being broadcast on SAB TV from 23 May 2017 to 14 September 2018.", "It is the sequel series of the show \"Sajan Re Jhoot Mat Bolo\".", "This show stars Hussain Kuwajerwala, Parvati Vaze, Tiku Talsania and Sharad Ponkshe.", "Rerun of the show started on Sony Pal on 18 June 2018.", "The show is actor Hussain Kuwajerwala's return to the small screen.", "Jaiveer Paramveer Chopra (Hussain Kuwajerwala), a wealthy man, son of Paramveer Chopra (Tiku Talsania) who is a multimillionaire and the owner of Chopra industries, who is studying in college falls in love with a girl named Jaya (Parvati Vaze).", "He, however, has lied to Jaya that he is poor (because when his father was in college he had also lied to a girl (Jai's mother) whom he loved and after marriage revealed that he is not poor but rich).", "After college both decide to get married and go to their parents." ] ], "gold": "Sajan Re Phir Jhoot Mat Bolo (English: Honey do not lie again) is an Indian sitcom. One of the main characters is Jaya Lalitrao Lokhande/Jaya Jaiveer Chopra. She is the wife of the lead character, Jaiveer Chopra/Jay Paramveer Chopra/Jai. Sheis played by Parvati Vaze. ", "prediction 1": "Sajan Re Phir Jhooth Mat Bolo is an Indian sitcom which is being broadcast on SAB TV from 23 May 2017 to 14 September 2018. It is the sequel series of the show Sajan Re Jhooth Mat Bolo. The character of Jaya is Jaiveer Paramveer Chopra, son of Paramveer Chopra, who is a multimillionaire and the owner of Chopra industries. He, however, has lied to Jaya that he is poor.\n", "prediction 2": "Sajan Re Phir Jhooth Mat Bolo Jaya is a fictional character in the Indian sitcom Indian sitcom Sajan Re Phir Jhooth Mat Bolo. She is played by Parvati Vaze.", "prediction 3": "Rajveer Paramveer Chopra is played by Hussain Kuwajerwala and is the lead in the hit Indian sitcom Sajan Re Phir Jhooth Mat Bolo, Jaya Paramveer Chopra. The character, Kay Jai has been called Jaya by several names including Dev Thomas, Anushka Sheth, Girl Preeti, Smita Shourya, Satish Lata, Sarai Shastri and Parvati Vaze. In the show, the character is played by Parvati Vaze.", "prediction 4": "Sajan Re Phir Jhooth Mat Bolo (SRPJMB) is an Indian sitcom which is being broadcast on SAB TV from 23 May 2017 to 14 September 2018. It is the sequel series of the show Sajan Re Jhooth Mat Bolo. Jaya is played by Parvati Vaze.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 123 }, { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 323 }, { "error type": "Irrelevant", "explanation": "", "start": 324, "end": 371 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "Sajan Re Phir Jhooth Mat Bolo (English: \"Do not lie again, honey\") is an Indian sitcom. One of the main characters is Jaya, played by Parvati Vaze." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When does the next godzilla anime come out?", "passages": [ [ "Godzilla: Planet of the Monsters", "In March 2017, it was announced that the film will be streamed in 190 countries via Netflix following the film's Japanese theatrical release.", "Greg Peters, President of Netflix Japan stated, \"Working with the best creators such as Toho in bringing Godzilla to Netflix users in over 190 countries marks a major milestone for us\".", "In January 2018, Netflix announced that the film will be released worldwide on their platform on January 17, 2018.", "\"Godzilla: Planet of the Monsters\" reached #3 at the box office on its opening weekend, earning \u00a5103 million from 71,200 admissions within two days and is projected to earn an additional \u00a5500 million.", "On review aggregator website Rotten Tomatoes, the film received an approval rating of 80% based on 5 reviews, with an average rating of 5.7/10.", "Brian Ashcraft of the \"Kotaku\" website felt that the characters \"aren\u2019t all that interesting\" but did state that the \"anime version of Godzilla is surprisingly effective and frightening\" and that despite his complaints, the \"overall experience was good\" and \"It\u2019s not a perfect picture, but it was a powerful proof of concept: Godzilla works as an anime.\"" ], [ "Godzilla: City on the Edge of Battle", "The film's Japanese title was revealed as \"Gojira: Kessen Kid\u014d Z\u014dshoku Toshi\" (translations varied from \"Godzilla: Battle Mobile Breeding City\" to \"Godzilla: The City Mechanized for the Final Battle\"), while the English title was later revealed as \"Godzilla: City on the Edge of Battle\".", "In March 2018, the film's official website revealed a new poster, plot details, and that singer XAI would return to perform the film's theme song \"The Sky Falls\".", "The English dub was produced by Post Haste Digital.", "Takayuki Hattori returned to compose the soundtrack, marking it his fourth \"Godzilla\" film score.", "XAI also returned to perform the film's theme song \"The Sky Falls\".", "On his work on the film, Hattori stated:\n\n\"Godzilla: City on the Edge of Battle\" was given a theatrical release in Japan on May 18, 2018, and released worldwide on Netflix on July 18, 2018.", "\"Godzilla: City on the Edge of Battle\" was released in 158 theaters in Japan and reached eighth place at the box office.", "The film earned \u00a5100 million on its first week." ], [ "Godzilla: City on the Edge of Battle", "Jeff Pawlak from Geekiverse awarded the film 5.5 out of 10, feeling that the film had \"great ideas\" with an \"interesting setting\" but felt the CG animation was \"ugly as ever\", felt the film lacked complex characters and action, stating \"City on the Edge of Battle completely mishandles the pass from Planet of the Monsters, failing to adequately explore the worthwhile worldbuilding it introduces, or that its predecessor introduced.\"", "In May 2018, a teaser poster was released for the third and final film in the anime trilogy, titled \"\".", "The poster also hints at the appearance of King Ghidorah, whose name is spoken within the movie, and revealed the film is scheduled for a release on November 9, 2018." ], [ "Godzilla: The Planet Eater", "Haruo discovers that scientists found how to use Mechagodzilla's Nanometal in Yuko's body, as a weapon, and realizes that Humanity will destroy itself sooner or later.", "So, taking Yuko with him, flies the newly reconstructed ship towards Godzilla, who vaporizes him.", "In a post credits scene, some time in the future, children of the natives and survivors conduct a ritual at a shrine honoring Haruo.", "Takayuki Hattori returned to compose the soundtrack, marking it his fifth Godzilla film score.", "XAI also returned to perform the film's theme song \"Live and Die\".", "In May 2018, a teaser poster revealed the film's title, release date, and potential appearance of King Ghidorah.", "In July 2018, the film's first teaser trailer was released.", "In September 2018, the film's theatrical poster was released.", "In October 2018, the full trailer was released.", "\"Godzilla: The Planet Eater\" premiered as the closing film at the Tokyo International Film Festival on November 3, 2018, was given a theatrical release in Japan on November 9, 2018, and will be released worldwide by Netflix on January 9, 2019." ], [ "Godzilla (franchise)", "In August 2016, Toho announced plans for a trilogy of anime \"Godzilla\" films with Polygon Pictures animating the films and Netflix distributing the trilogy worldwide, except in Japan where each film will be given a theatrical release by Toho.", "The first film, titled \"\", was released on November 17, 2017.", "The second film, titled \"\", was released on May 18, 2018.", "The third and final film in the trilogy, titled \"\", was released on November 9, 2018.", "In January 2018, Toho announced its plans to invest 15 billion yen ($135 million) for the next three years beginning in 2019 to co-produce content with Hollywood and Chinese studios who have licensed Toho's properties, such as \"Godzilla\", \"Your Name\" and \"Pok\u00e9mon\".", "Toho will invest 25% in production costs and will earn a higher share in revenue and manage creators rights so their creative input will be shown in each work.", "In May 2018, Toho\u2019s Chief Godzilla Officer Keiji Ota revealed that a sequel to \"Shin Godzilla\" will not happen but revealed plans for a \"World of Godzilla\", a shared cinematic universe between Godzilla and other Toho monsters after 2021.", "Ota cited the Marvel Cinematic Universe as an influence, with plans to release a new film every one to two years." ] ], "gold": "In August 2016, Toho announced plans for a trilogy of anime Godzilla films with Polygon Pictures animating the films and Netflix distributing the trilogy worldwide, except in Japan where each film was given a theatrical release by Toho. The first film, titled Godzilla: Planet of the Monsters, was released on November 17, 2017. The second film, titled Godzilla: City on the Edge of Battle, was released on May 18, 2018.The third and final film in the trilogy, titled Godzilla: The Planet Eater, was released on November 9, 2018 after premiering at the Tokyo International Film Festival on November 3, 2018.", "prediction 1": "Godzilla: City on the Edge of Battle, the third and final film in the Godzilla anime trilogy, was released in Japan on May 18, 2018. It was released worldwide on Netflix on July 18, 2018. Godzilla: The Planet Eater, the third and final film in the Godzilla anime trilogy, was released in Japan on November 9, 2018.\n", "prediction 2": "Godzilla: City on the Edge of Battle was released on May 18, 2018 in Japan and on July 18, 2018 on Netflix worldwide. The third film in Godzilla's 3D-Film Trilogy, Godzilla: The Planet Eater, premiered as the closing film at the Tokyo International Film Festival on November 3, 2018. It will be released worldwide on Netflix on January 9, 2019 as the third installment of Godzilla's 3D-Anime Trilogy.", "prediction 3": "Godzilla: City on the Edge of Battle came out in Japan in May 2018, while it came out globally in July 2018, with a release date of January 9, 2019. Godzilla: The Planet Eater, the third installment in the Godzilla anime trilogy, came out in Japan in November 2018, while it came out worldwide on January 9, 2019.", "prediction 4": "Godzilla: Planet of the Monsters came out as a movie in Japan late in 2017 and was titled Godzilla: City on the Edge of Battle. Godzilla: The Planet Eater, the third film in the Godzilla anime trilogy, was released in Japan late in 2018 and was released on January 9, 2019. In Japan late in 2018, Godzilla: The Living Earth came out as a movie, while in English late in 2018, Godzilla: City on the Edge of Battle came out as an anime.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 187 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[3]}", "start": 38, "end": 62 }, { "error type": "Redundant", "explanation": " in the Godzilla anime trilogy, was released in Japan ", "start": 241, "end": 293 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 5, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] } ], "corrected-prediction": "In August 2016, Toho announced plans for a trilogy of anime \"Godzilla\" films with Polygon Pictures animating the films and Netflix distributing the trilogy worldwide, except in Japan where each film will be given a theatrical release by Toho. The first film, titled was released on November 17, 2017. Godzilla: City on the Edge of Battle, the second film in the Godzilla anime trilogy, was released in Japan on May 18, 2018. Godzilla: The Planet Eater, the third and final film was released on November 9, 2018.\n" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "How many electrons fit in the 3rd energy level?", "passages": [ [ "Energy level", "Energy level\n\nA quantum mechanical system or particle that is bound\u2014that is, confined spatially\u2014can only take on certain discrete values of energy.", "This contrasts with classical particles, which can have any energy.", "These discrete values are called energy levels.", "The term is commonly used for the energy levels of electrons in atoms, ions, or molecules, which are bound by the electric field of the nucleus, but can also refer to energy levels of nuclei or vibrational or rotational energy levels in molecules.", "The energy spectrum of a system with such discrete energy levels is said to be quantized.", "In chemistry and atomic physics, an electron shell, or a principal energy level, may be thought of as an orbit followed by electrons around an atom's nucleus.", "The closest shell to the nucleus is called the \" shell\" (also called \"K shell\"), followed by the \" shell\" (or \"L shell\"), then the \" shell\" (or \"M shell\"), and so on farther and farther from the nucleus.", "The shells correspond with the principal quantum numbers (\"n\" = 1, 2, 3, 4\u00a0...) or are labeled alphabetically with letters used in the X-ray notation (K, L, M,\u00a0\u2026)." ], [ "Electron configuration", "This gives two electrons in an s\u00a0subshell, six electrons in a p\u00a0subshell, ten electrons in a d\u00a0subshell and fourteen electrons in an f\u00a0subshell.", "The numbers of electrons that can occupy each shell and each subshell arise from the equations of quantum mechanics, in particular the Pauli exclusion principle, which states that no two electrons in the same atom can have the same values of the four quantum numbers.", "Physicists and chemists use a standard notation to indicate the electron configurations of atoms and molecules.", "For atoms, the notation consists of a sequence of atomic subshell labels (e.g. for phosphorus the sequence 1s, 2s, 2p, 3s, 3p) with the number of electrons assigned to each subshell placed as a superscript.", "For example, hydrogen has one electron in the s-orbital of the first shell, so its configuration is written 1s.", "Lithium has two electrons in the 1s-subshell and one in the (higher-energy) 2s-subshell, so its configuration is written 1s\u00a02s (pronounced \"one-s-two, two-s-one\").", "Phosphorus (atomic number 15) is as follows: 1s\u00a02s\u00a02p\u00a03s\u00a03p.", "For atoms with many electrons, this notation can become lengthy and so an abbreviated notation is used." ], [ "Energy level", "Each shell can contain only a fixed number of electrons: The first shell can hold up to two electrons, the second shell can hold up to eight (2 + 6) electrons, the third shell can hold up to 18 (2 + 6 + 10) and so on.", "The general formula is that the \"n\"th shell can in principle hold up to 2(\"n\") electrons.", "Since electrons are electrically attracted to the nucleus, an atom's electrons will generally occupy outer shells only if the more inner shells have already been completely filled by other electrons.", "However, this is not a strict requirement: atoms may have two or even three incomplete outer shells.", "(See Madelung rule for more details.)", "For an explanation of why electrons exist in these shells see electron configuration.", "If the potential energy is set to zero at infinite distance from the atomic nucleus or molecule, the usual convention, then bound electron states have negative potential energy.", "If an atom, ion, or molecule is at the lowest possible energy level, it and its electrons are said to be in the \"ground state\".", "If it is at a higher energy level, it is said to be \"excited\", or any electrons that have higher energy than the ground state are \"excited\".", "If more than one quantum mechanical state is at the same energy, the energy levels are \"degenerate\"." ] ], "gold": "In chemistry and atomic physics, an electron shell, or principal energy level, can be thought of as the orbit of one or more electrons around an atom's nucleus. Each shell is composed of one or more subshells, which are themselves composed of atomic orbitals. For example, the first shell known as K shell, has one subshell, called 1s and can hold 2 electrons, second shell called L, has two subshells 2s and 2p, these can hold 6, the third shell has 3s, 3p, and 3d can hold 10. With this formula a total of 18 electrons can fit inside the 3rd energy level. ", "prediction 1": "In quantum mechanics, a quantum mechanical system or particle that is bound can only take on certain discrete values of energy. This contrasts with classical particles, which can have any energy. The term is commonly used for the energy levels of electrons in atoms, ions, or molecules, which are bound by the electric field of the nucleus, but can also refer to energy levels of nuclei or vibrational or rotational energy levels in molecules. The number of electrons that fit in the 3rd energy level is known as the atom.\n", "prediction 2": "A quantum mechanical system or particle that is bound, that is, confined spatially, can only take on certain discrete values of energy. The term is commonly used for the energy levels of electrons in atoms, ions, or molecules, which are bound by the electric field of the nucleus, but can also refer to energy levels of nuclei or vibrational or rotational energy levels in molecules. The number of electrons in the third energy level is 18.", "prediction 3": "In quantum mechanics, a quantum mechanical system or particle that is bound\u2014that is, confined spatially\u2014can only take on certain discrete values of energy. This contrasts with classical particles, which can have any energy. In the electron shell of an atom, there are n electrons in it, with the number 3 being the final energy level. On average, such an atom can contain 18 electrons, and on average, 2 electrons in its upper energy level.", "prediction 4": "In quantum mechanics, a quantum mechanical system may take on certain discrete energy levels. This contrasts with classical particles, which can have any energy. In the case of electrons, there are four energy levels. There are also elementary energy levels in Lithium and Curiosity. For example, the electron in phosphorus, atomic number 15, is 1, 2, 3, and 4. The electron in Lithium, atomic number 15, has two electrons in the 1s subshell and one in the higher-energy 2s subshell. However, the outside of the third energy level, there is only 1 electrons in the paramnes.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 444, "end": 523 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 127 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 195 }, { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 443 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "In chemistry and atomic physics, an electron shell, or principal energy level, can be thought of as the orbit of one or more electrons around an atom's nucleus. Each shell is composed of one or more subshells, which are themselves composed of atomic orbitals. For example, the first shell known as K shell, has one subshell, called 1s and can hold 2 electrons, second shell called L, has two subshells 2s and 2p, these can hold 6, the third shell has 3s, 3p, and 3d can hold 10. With this formula a total of 18 electrons can fit inside the 3rd energy level." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did the soviet union change to russia?", "passages": [ [ "Dissolution of the Soviet Union", "The Baltic republics, Armenia, Georgia, and Moldova boycotted the referendum as well as Checheno-Ingushetia (an autonomous republic within Russia that had a strong desire for independence, and by now referred to itself as Ichkeria).", "In each of the other nine republics, a majority of the voters supported the retention of a reformed Soviet Union.", "On June 12, 1991, Boris Yeltsin won 57 percent of the popular vote in the democratic elections, defeating Gorbachev's preferred candidate, Nikolai Ryzhkov, who won 16 percent of the vote.", "Following Yeltsin's election as president, Russia declared itself independent.", "In his election campaign, Yeltsin criticized the \"dictatorship of the center\", but did not yet suggest that he would introduce a market economy.", "On January 13, 1991, Soviet troops, along with the KGB Spetsnaz Alpha Group, stormed the Vilnius TV Tower in Lithuania to suppress the independence movement.", "Fourteen unarmed civilians were killed and hundreds more injured.", "On the night of July 31, 1991, Russian OMON from Riga, the Soviet military headquarters in the Baltics, assaulted the Lithuanian border post in Medininkai and killed seven Lithuanian servicemen.", "This event further weakened the Soviet Union's position internationally and domestically, and stiffened Lithuanian resistance." ], [ "Dissolution of the Soviet Union", "Dissolution of the Soviet Union\n\nThe dissolution of the Soviet Union occurred on 26 December 1991, officially granting self-governing independence to the Republics of the Union of Soviet Socialist Republics (USSR).", "It was a result of the declaration number 142-\u041d of the Supreme Soviet of the Soviet Union.", "The declaration acknowledged the independence of the former Soviet republics and created the Commonwealth of Independent States (CIS), although five of the signatories ratified it much later or did not do so at all.", "On the previous day, 25 December, Soviet President Mikhail Gorbachev, the eighth and final leader of the USSR, resigned, declared his office extinct and handed over its powers\u2014including control of the Soviet nuclear missile launching codes\u2014to Russian President Boris Yeltsin.", "That evening at 7:32 p.m., the Soviet flag was lowered from the Kremlin for the last time and replaced with the pre-revolutionary Russian flag.", "Previously, from August to December all the individual republics, including Russia itself, had either seceded from the union or at the very least denounced the Treaty on the Creation of the USSR.", "The week before formal dissolution, eleven republics signed the Alma-Ata Protocol formally establishing the CIS and declaring that the USSR had ceased to exist.", "Both the Revolutions of 1989 and the dissolution of the USSR also marked the end of the Cold War." ] ], "gold": "The dissolution of the Soviet Union was the process of internal disintegration within the USSR. It began in the second half of the 1980s with growing unrest in the national republics. On June 12, 1991, Boris Yeltsin won 57 percent of the popular vote in the democratic elections and Russia declared itself independent. The Soviet Union dissolved on 26 December 1991 when the USSR itself was voted out of existence by the Supreme Soviet, following the Belavezha Accords.", "prediction 1": "The dissolution of the Soviet Union occurred on 26 December 1991, officially granting self-governing independence to the Republics of the Union of Soviet Socialist Republics (USSR). It was a result of the declaration number 142- of the Supreme Soviet of the Soviet Union. That evening at 7:32 p.m., the Soviet flag was lowered from the Kremlin for the last time and replaced with the pre-revolutionary Russian flag.\n", "prediction 2": "The dissolution of the Soviet Union occurred on 26 December 1991, officially granting self-governing independence to the Republics of the Union of Soviet Socialist Republics (USSR). On June 12, 1991, Boris Yeltsin won 57 percent of the popular vote in the democratic elections, defeating Gorbachev's preferred candidate, Nikolai Ryzhkov, who won 16 percent of the vote. Following Yeltsin's election as president, Russia declared itself independent. On December 26, 1991, Soviet troops, along with the KGB Spetsnaz Alpha Group, stormed the Vilnius TV Tower in Lithuania to suppress the independence movement.", "prediction 3": "The dissolution of the Soviet Union occurred on 26 December 1991, officially granting self-governing independence to the Republics of the Union of Soviet Socialist Republics (USSR). It was a result of the declaration number 142- of the Supreme Soviet of the Soviet Union, which acknowledged the independence of the former Soviet republics and created the Commonwealth of Independent States (CIS), although five of the signatories ratified it much later or did not do so at all. That evening at 7:32 p.m., the Soviet flag was lowered from the Kremin for the last time and replaced with the pre-revolutionary Russian flag.", "prediction 4": "The dissolution of the Soviet Union occurred on 26 December 1991, officially granting self-governing independence to the Republics of the Union of Soviet Socialist Republics (USSR). On June 12, 1991, Boris Yeltsin won 57 percent of the popular vote in the democratic elections, defeating Gorbachev's preferred candidate, Nikolai Ryzhkov, who won 16 percent of the vote. Following Yeltsin's election as president, Russia declared itself independent.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 66, "end": 181 }, { "error type": "Irrelevant", "explanation": "", "start": 217, "end": 228 }, { "error type": "Redundant", "explanation": "The dissolution of the Soviet Union ", "start": 251, "end": 271 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 416 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "On June 12, 1991, Boris Yeltsin won 57 percent of the popular vote in the democratic elections and Russia declared itself independent. The dissolution of the Soviet Union occurred on 26 December 1991. It was a result of the declaration of the Supreme Soviet. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When was the last time the us hosted a world cup?", "passages": [ [ "2003 FIFA Women's World Cup", "2003 FIFA Women's World Cup\n\nThe 2003 FIFA Women's World Cup, the fourth edition of the FIFA Women's World Cup, was held in the United States and won by Germany.", "They won their first women's world title and became the first country to win both men's and women's World Cup.", "The men's team had won the World Cup three times at the time.", "The tournament was originally scheduled for China from 23 September to 11 October.", "On 3 May 2003, FIFA announced that they would move the tournament to an alternate host country because of the 2003 SARS outbreak in China.", "At the same time the FIFA announced that the 2007 FIFA Women's World Cup would be awarded to China in its place.", "On 26 May 2003, FIFA announced the United States would host the tournament.", "Because the United States had hosted the 1999 World Cup, it was thought the United States could best organize the tournament in the little time remaining before the October scheduled start.", "In addition, women's soccer boosters in the United States hoped that interest generated by the tournament would save the U.S. women's professional league, the Women's United Soccer Association, from folding.", "In compensation for losing the tournament, China retained its automatic qualification as host, and was named as host for the 2007 event." ], [ "1994 FIFA World Cup", "1994 FIFA World Cup\n\nThe 1994 FIFA World Cup was the 15th FIFA World Cup, held in nine cities across the United States from 17 June to 17 July 1994.", "The United States was chosen as the host by FIFA on 4 July 1988.", "Despite the host nation's lack of football tradition, the tournament was the most financially successful in World Cup history; aided by the high-capacity stadia in the United States, it broke the World Cup average attendance record with nearly 69,000 spectators per game, a mark that still stands.", "The total attendance of nearly 3.6\u00a0million for the final tournament remains the highest in World Cup history, despite the expansion of the competition from 24 to 32 teams (and from 52 to 64 games), which was first introduced at the 1998 World Cup and is the current format.", "Brazil won the tournament after beating Italy 3\u20132 in a penalty shoot-out at the Rose Bowl in Pasadena, California near Los Angeles, after the game had ended 0\u20130 after extra time.", "It was the first World Cup final to be decided on penalties.", "The victory made Brazil the first nation to win four World Cup titles." ] ], "gold": "The last time the U.S. hosted a World Cup was in 2003, when they hosted the FIFA Women's World Cup. It was the fourth edition of the FIFA Women's World Cup, and was held in the United States from 20 September \u2013 12 October 2003 at six venues across the country. The last time the U.S. hosted a men's World Cup was the 15th edition of the FIFA World Cup in 1994. It took place from June 17 \u2013 July 17 1994 in nine venues across the country.", "prediction 1": "The United States has hosted several World Cup tournaments. The last time the US hosted a World Cup was in 1994. The last time the US hosted a World Cup was in 2003.\n", "prediction 2": "The United States had previously hosted the 1999 FIFA World Cup, which was held in New York City, but was moved to an alternate host country because of the 2003 SARS outbreak in China. On 26 May 2003, FIFA announced the United States would host the tournament, and it was held in August 2003.", "prediction 3": "The United States has hosted several world cups. The United States hosted the 1999 World Cup and the 1994 FIFA World Cup. The United States hosted the 1998 World Cup and the 2002 World Cup. The US also hosted the FIFA Women's World Cup in 2003 and they won it.", "prediction 4": "The US hosted the 1994 FIFA World Cup, the 15th FIFA World Cup, held in nine cities across the United States from 17 June to 17 July 1994. The United States was chosen as the host by FIFA on 4 July 1988. In 1996, the US hosted the 2010 FIFA Women's World Cup, they hosted the 2009 FIFA Women's World Cup and they won.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 60, "end": 73 }, { "error type": "Unverifiable", "explanation": "", "start": 113, "end": 126 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The United States has hosted several World Cup tournaments. The 2003 FIFA Women's World Cup, the fourth edition of the FIFA Women's World Cup, was held in the United States and won by Germany. The 1994 FIFA World Cup was the 15th FIFA World Cup, held in nine cities across the United States from 17 June to 17 July 1994.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "How many games have the rabbitohs won this season?", "passages": [ [ "2008 South Sydney Rabbitohs season", "2008 South Sydney Rabbitohs season\n\nThe 2008 South Sydney Rabbitohs season was the 99th in the club's history.", "Coached by Jason Taylor and captained by David Kidwell & Roy Asotasi, the team competed in the National Rugby League's 2008 Telstra Premiership, finishing the regular season in 14th place out of 16 teams and so failing to reach the finals.", "The club also competed in the 2008 Under-20s competition.", "On 26 January 2008, the Rabbitohs played the Leeds Rhinos at the Hodges Stadium at University of North Florida in Jacksonville, Florida, the first time first-grade professional rugby league teams from Australia and England played each other in the United States.", "A crowd of about 12,000 attended with Russell Crowe, Greg Norman, and the stars of television show American Chopper among the audience.", "Leeds Rhinos won the game 26-24(after having been behind 26-0 at half-time South Sydney staged an unlikely comeback that fell agonisingly short).", "South Sydney equalled the second-biggest comeback in premiership history in Round 16 against the North Queensland Cowboys.", "After trailing 28\u20134 after fifty minutes, the Rabbitohs won the match 29\u201328." ] ], "gold": "The Rabbitohs won 9 games in the 2017 season, and 16 games in both the 2018 and 2019 seasons.", "prediction 1": "The 2008 South Sydney Rabbitohs season was the 99th in the club's history. The team competed in the National Rugby League's 2008 Telstra Premiership, finishing the regular season in 14th place out of 16 teams and so failing to reach the finals. On 26 January 2008, the Rabbitohs played the Leeds Rhinos at the Hodges Stadium at University of North Florida in Jacksonville, Florida, the first time first-grade professional rugby league teams from Australia and England played each other in the United States. South Sydney equalled the second-biggest comeback in premiership history in Round 16 against the North Queensland Cowboys.\n", "prediction 2": "South Sydney Rabbitohs have won 14 games in their 99th season. On 26 January 2008, the Rabbitohs played the Leeds Rhinos at the Hodges Stadium at University of North Florida in Jacksonville, Florida, the first time first-grade professional rugby league teams from Australia and England played each other in the United States. On 14 December 2008, the Rabbitohs won 14 games.", "prediction 3": "The 2008 South Sydney Rabbitohs season was the 99th in the club's history. Coached by Jason Taylor and captained by David Kidwell & Roy Asotasi, the team competed in the National Rugby League's 2008 Telstra Premiership, finishing the regular season in 14th place out of 16 teams and failing to reach the finals. On 26 January 2008 the Rabbitohs played the Leeds Rhinos at the Hodges Stadium at University of North Florida in Jacksonville, Florida, the first time first-grade professional rugby league teams from Australia and England played each other in the United States. On 28 December 2006 the South Sydney Rabbitohs won the game 24.", "prediction 4": "As of 2018, the South Sydney Rabbitohs have won 7 out of the 8 matches played.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 244 }, { "error type": "Irrelevant", "explanation": "", "start": 245, "end": 507 }, { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 74 }, { "error type": "Irrelevant", "explanation": "", "start": 508, "end": 631 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The 2008 South Sydney Rabbitohs won at least one game.\n" }, "preference": [ 0, 0, 1, 1, 1, 1 ] }, { "question": "Where did the rangers play before ballpark in arlington?", "passages": [ [ "History of the Texas Rangers (baseball)", "While his own equity in the team was a small one (approximately 1%), he was named Managing General Partner of the new ownership group.", "He increased his investment the following year.", "During his tenure, the Rangers and the City of Arlington decided to replace the aging Arlington Stadium with a new publicly funded stadium, at a cost of $193 million, financed by Arlington residents, through a sales tax increase.", "Ground was broken on October 30, 1991 on what would become The Ballpark in Arlington (now named Globe Life Park in Arlington).", "The city, through the Arlington Sports Facilities Development Authority, also controversially authorized the seizure of of land through eminent domain for the Rangers future development.", "Landowners filed lawsuits over the acquisition and eventually won settlements of $22.2 million which the Rangers failed to pay.", "Bush left his position with the Rangers when he was elected Governor of Texas in 1994, and was elected the 43rd President of the United States in 2000.", "Although Bush no longer has any ownership stake in the Rangers, he remains a fan of the team to this day and regularly attends the team's home games.", "In 1993, Kevin Kennedy took over managerial duties, presiding over the team for two seasons, keeping the 1993 Rangers in the hunt for a playoff berth into mid-September.", "Kennedy was let go in 1994, although the team led the A.L." ], [ "Texas Rangers (baseball)", "Only minor excavations would be necessary to expand the park to accommodate major league crowds as it had been built to major league specifications.", "Vandergriff's offer of a multimillion-dollar down payment prompted Short to make the move to Arlington.", "On September 21, 1971, by a vote of 10 to 2, American League owners granted approval to move the franchise to Arlington for the season.", "Senators fans were livid.", "Enmity came to a head at the club's last game in Washington.", "Thousands of fans simply walked in without paying after the security guards left early, swelling the paid attendance of 14,460 to around 25,000, while fans unfurled a banner reading \"SHORT STINKS\".", "With the Senators leading 7\u20135 and two outs in the top of the ninth inning, several hundred youths stormed the field, raiding it for souvenirs.", "One man grabbed first base and ran off with it.", "With no security in sight and only three bases, umpire crew chief Jim Honochick forfeited the game to the New York Yankees.", "The nation's capital went with out Major League Baseball for 33\u00a0years until the relocation of the National League's Montreal Expos who became the Washington Nationals.", "Prior to the 1972 season, improvements were made to Turnpike Stadium, which reopened as Arlington Stadium, in preparation for the inaugural season of the Texas Rangers." ], [ "History of the Texas Rangers (baseball)", "History of the Texas Rangers (baseball)\n\n", "The History of the Texas Rangers started when the old Washington Senators team of the American League in Major League Baseball (MLB) left Washington, D.C. in 1960.", "A new expansion team was formed with the same name and stayed in the same town until its last season in 1971.", "The next year, the franchise renamed itself as the Texas Rangers and started its first season in Arlington, Texas, as part of the American League West Division, where it remains today.", "When the original Washington Senators moved to Minnesota in 1960 as the Twins, Major League Baseball decided to expand a year earlier than planned to stave off threats of losing its exemption from the Sherman Antitrust Act.", "At the winter meetings that year, it awarded a new team to Los Angeles (the Angels, now the Los Angeles Angels of Anaheim) as well as a new team in the nation's capital.", "This new team adopted the old Senators name, but was (and still is) considered an expansion team since the Twins retained the old Senators' records and history.", "The Senators and Angels began to fill their rosters with American League players in an expansion draft.", "The team played the season at old Griffith Stadium before moving to District of Columbia Stadium (now the Robert F. Kennedy Memorial Stadium)." ], [ "1971 Washington Senators season", "1971 Washington Senators season\n\nThe 1971 Washington Senators season involved the Senators finishing fifth in the American League East with a record of 63 wins and 96 losses.", "This was the Senators' 11th and last season in Washington, D.C., as they moved to Arlington, Texas the following season, becoming the Texas Rangers.", "The move would leave Washington without a Major League Baseball team until the Montreal Expos of the National League relocated there in 2005, becoming the current Washington Nationals.", "The acquisition of former Cy Young Award winner Denny McLain would not pay dividends for the franchise.", "Amid constant run-ins with no-nonsense Washington manager Ted Williams, Denny McLain lost 22 games in 1971.", "By the end of the 1970 season, Senators owner Bob Short had issued an ultimatum: unless someone was willing to buy the Senators for $12 million, he would not renew his lease at RFK Stadium and move elsewhere.", "Several parties offered to buy the team, but all fell short of Short's asking price.", "Short was especially receptive to an offer from Arlington mayor Tom Vandergriff, who had been trying to get a major league team to play in the Metroplex for over a decade.", "Years earlier, Charlie Finley, the owner of the Kansas City Athletics, sought to move his team to Dallas, but the idea was rebuffed by the other AL team owners." ] ], "gold": "The Texan Rangers played home games at several stadiums before Arlington ballpark. In 1961 they played at Griffith Stadium. From 1962 through 1971 it was RFK Stadium. Then, Arlington Stadium was where their home games were played from 1972 through 1993. And, finally, from 1994 through 2019 they played at Globe Life Park in Arlington.", "prediction 1": "The Texas Rangers started when the old Washington Senators team of the American League in Major League Baseball (MLB) left Washington, D.C. in 1960. A new expansion team was formed with the same name and stayed in the same town until its last season in 1971. The team played the season at old Griffith Stadium before moving to District of Columbia Stadium (now the Robert F. Kennedy Memorial Stadium). Ground was broken on October 30, 1991 on what would become The Ballpark in Arlington.\n", "prediction 2": "The Texas Rangers started when the old Washington Senators team of the American League in Major League Baseball (MLB) left Washington, D.C. in 1960. A new expansion team was formed with the same name and stayed in the same town until its last season in 1971. The next year, the franchise renamed itself as the Texas Rangers and started its first season in Arlington, Texas, as part of the American League West Division, where it remains today. In 70 the team played at Griffith Stadium before moving to District of Columbia Stadium.", "prediction 3": "The Texas Rangers started when the old Washington Senators team of the American League in Major League Baseball (MLB) left Washington, D.C. in 1960. A new expansion team was formed with the same name and stayed in the same town until its last season in 1971. The A.L. team, the Texas Rangers, started its first season in Arlington, Texas, as part of the American League West Division, where it remains today. Ground was broken on October 30, 1991, for what would become The Ballpark in Arlington.", "prediction 4": "The History of the Texas Rangers started when the old Washington Senators team of the American League in Major League Baseball (MLB) left Washington, D.C. in 1960. A new expansion team was formed with the same name and stayed in the same town until its last season in 1971. The team played the season at old Griffith Stadium before moving to District of Columbia Stadium (now the Robert F. Kennedy Memorial Stadium). Ground was broken on October 30, 1991 on what would become The Ballpark in Arlington, which is still known as Globe Life Park in Arlington.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 18, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 149, "end": 258 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 360 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 488 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 11 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Texas Rangers played a season at old Griffith Stadium before moving to the Robert F. Kennedy Memorial Stadium, where they played until 1971. Then, Arlington Stadium was where their home games were played from 1972 until the opening of The Ballpark in Arlington (now named Globe Life Park in Arlington)." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who has the largest twitter following in the world?", "passages": [ [ "Barack Obama on social media", "Barack Obama on social media\n\nThe topic of Barack Obama's usage of social media in his political campaigns, including podcasting, Twitter, Myspace, Facebook, and YouTube has been compared to the adoption of radio, television, MTV, and the Internet in slingshotting his presidential campaign to success and as thus has elicited much scholarly inquiry.", "In the 2008 presidential campaign, Obama had more \"friends\" on Facebook and Myspace and more \"followers\" on Twitter than his opponent John McCain.", "Obama's usage of the wider Internet has often since been compared to Franklin D. Roosevelt and John F. Kennedy's adaption of the radio and television mediums respectively in the history of communication between the White House and the American Public.", "Barack Obama's Twitter account (@BarackObama) is the official account on social networking site Twitter for former President of the United States Barack Obama, and has been used for his election efforts.", "Obama also used the White House's Twitter account (@WhiteHouse) for his presidential activities.", ", Obama's account had 103,083,062 followers, followed 617,962 accounts, and had posted 15,548 tweets.", "Well into 2011, it was following the most people of any account on the network and was the third to achieve ten million followers." ] ], "gold": "Barack Obama, with his twitter account, @BarackObama, has the largest twitter following in the world.", "prediction 1": "The Twitter account @BarackObama, which is owned by former United States President Barack Obama, has the largest following in the world.\n", "prediction 2": "Several people share the largest twitter following, with the most being former US President Barack Obama's account at 103,083,062 followers and the most followers being former US President George W. Bush's account at 32 million followers.", "prediction 3": "The twitter account @BarackObama, installed on the server of Twitter, is the most followed account in the world by approximately 229 million people.", "prediction 4": "The Twitter account @BarackObama, owned by former United States President Barack Obama, has the largest following in the world.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 97, "end": 137 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Twitter account @BarackObama, which is owned by former United States President Barack Obama, has 103,083,062 followers.\n" }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who voices spider man in the animated series?", "passages": [ [ "Spider-Man (1994 TV series)", "Spider-Man (1994 TV series)\n\nSpider-Man, also known as Spider-Man: The Animated Series and Marvel Comics Spider-Man, is an American animated television series based on the Marvel Comics superhero of the same name.", "The show ran on Fox Kids from November 19, 1994, to January 31, 1998, and ran reruns on the Jetix block on Toon Disney and on Disney XD.", "The producer/story editor was John Semper Jr. and the production company was Marvel Films Animation.", "The series focuses on Spider-Man and his alter ego Peter Parker during his college years at Empire State University.", "As the story begins, Peter has already gained his superpowers and is a part-time freelance photographer for the Daily Bugle.", "The show features most of Spider-Man's classic villains, including the Kingpin, the Green Goblin, the Lizard, the Shocker, Doctor Octopus, Mysterio, the Scorpion, Rhino, the Vulture and Venom.", "Over the course of the series the single Peter contends with the romantic love interests of Mary Jane Watson, Felicia Hardy and her alter ego, the Black Cat.", "The show also features appearances from various other Marvel superheroes; including the X-Men, the Fantastic Four, Iron Man, Daredevil, Blade, Doctor Strange, the Punisher and Captain America." ], [ "Spider-Man in television", "To garner the attention of the major networks, Marvel first created a new syndicated Spider-Man cartoon that was partially based on the old 1960s show.", "The strategy worked, and NBC became interested in having their own Spider-Man cartoon.", "Spider-Man was voiced by Ted Schwartz\n\nTowards this end the cartoon series \"Spider-Man and His Amazing Friends\" was created for NBC featuring Spider-Man, Iceman of the X-Men, and a new character, Firestar.", "Actor Dan Gilvezan gave voice to this incarnation of the wall-crawler.", "This series also featured a number of Marvel guest stars, and shared many of its character designs with the solo Spider-Man show produced just before it.", "The 1994 Spider-Man animated series was made for the Fox Network (to accompany their X-Men series) with Christopher Daniel Barnes providing the webslinger's voice (in one episode Peter Mark Richman voiced old Peter, partially replacing Barnes).", "This series had a bigger budget and used a novel system of one large story arc per season, developed by John Semper.", "As a result, each of the individual 65 episodes (starting with season 2) were called \"chapters\".", "This series more closely reflected the comic book as it focused on the personal conflict Peter Parker felt as Spider-Man, instead of following the action-oriented shows that preceded it." ], [ "Spider-Man in television", "This was the longest Spider-Man series, with 65 episodes in five seasons, until 2012's \"Ultimate Spider-Man\" surpassed it.", "Several episodes were consolidated into direct-to-video DVD films, such as \"Daredevil vs. Spider-Man\".", "In 1999, an animated series named \"Spider-Man Unlimited\" was developed for Fox (intended to be an Expanded Universe final season of the 1994 show) in which Spider-Man is transported to an animated Counter-Earth inspired by the one created by the High Evolutionary in early 1970s comics.", "This series was cancelled after one season.", "Here Spider-Man was voiced by Rino Romano.", "In 2003, another television series adaptation, \"Spider-Man: The New Animated Series\" this time using computer animation was produced by Mainframe Entertainment for Sony Pictures Television and broadcast on MTV; it featured characters and continuity from the 2002 \"Spider-Man\" film, as well as Michael Clarke Duncan voicing the Kingpin, depicted in reprising his role from the 2003 live action \"Daredevil film adaptation\".", "The show lasted only one season, which contained 13 episodes.", "Spider-Man was voiced by Neil Patrick Harris.", "This television series is heavily inspired by both the early Lee/Ditko and Romita \"The Amazing Spider-Man\" stories and the Bendis/Bagley \"Ultimate Spider-Man\"." ], [ "Spider-Man in television", "His sense of humor is less refined and more puerile, laughing at simple rhymes and toilet humor, and is shown to be able to break the fourth wall.", "He is less experienced, less responsible, and much more of a goofball than his comic or previous media (animated or occasionally live action) counterparts, but can still show a fair degree of competence when the situation calls for it and learns from his mistakes.", "The series ended in a two part series finale on January 7, 2017, bringing the episode count to 104 and making it the longest running Marvel cartoon to date.", "\"Spider-Man\", a new Spider-Man animated series was announced to replace \"Ultimate Spider-Man\".", "The series will also feature Spider-Man (Voiced by Robbie Daymond) teaming up with Miles Morales as Spider-Man and Spider-Gwen.", "Spider-Man was an occasional character in the 1970s children's educational show \"The Electric Company\" which presented brief tales using a combination of animation and live action called the \"Spidey Super Stories\".", "In the educational spirit of the series, Spider-Man (portrayed by Danny Seagren) communicates only in speech balloons for the viewer to read.", "The theme song was written by composer Gary William Friedman." ], [ "Spider-Man (1967 TV series)", "Spider-Man (1967 TV series)\n\nSpider-Man is an animated television series in the superhero fiction genre.", "It was the original animated TV series based on the Spider-Man comic book series created by writer Stan Lee and designed by artist Steve Ditko, and was jointly produced in Canada (voice acting) and the United States (animation).", "The first two seasons aired on the ABC television network, and the third was distributed in syndication.", "Grantray-Lawrence Animation produced the first season, and seasons two and three were produced by Krantz Films in New York City.", "The show starred the voice of Paul Soles as Peter Parker (Spider-Man).", "The series ran from September 9, 1967, to June 14, 1970.", "The series revolved around teenager Peter Parker, a high school student who develops extraordinary strength and spider-like powers after being bitten by a radioactive spider.", "Parker decides to become a crime-fighting, costumed superhero, but must deal with family tragedies, personal problems and the insecurity of youth.", "As Spider-Man, Parker risks his life to fight super-powered criminals such as Doctor Octopus, Mysterio and the Green Goblin.", "Peter is also a freelance photographer for the \"Daily Bugle\", but editor J. Jonah Jameson considers Spider-Man a criminal and writes front-page headlines critical of his activities." ] ], "gold": "Several different voice actors have supplied Spider Man's voice in the many animated series that have been created over the years. Spider Man was voiced by Shinji Todo in the Japanese TV series, and by Neil Patrick Harris in Spider Man: The New Animated Series. Other actors who voiced the superhero in a Spider Man television series include Paul Soles in 1967, Ted Schwartz in 1981, Chris Barnes in 1994, and Robbie Daymond 2017.", "prediction 1": "The American animated television series Spider-Man, also known as Spider-Man: The Animated Series and Marvel Comics Spider-Man, is an American animated television series based on the Marvel Comics superhero of the same name. The show ran on Fox Kids from November 19, 1994, to January 31, 1998, and ran reruns on the Jetix block on Toon Disney and on Disney XD. In 1994, Peter Mark Richman voiced the character of Peter Parker, while in 1999, Rino Romano voiced the character.\n", "prediction 2": "The Marvel Comics superhero Spider-Man first aired in Cartoon Network's animated series, \"Spider-Man: The Animated Series\", on November 26, 1986. Then, in 1994, the Marvel Television Productions production company began producing an animated version of the show for Fox Television which began airing on December 17, 1994. Neil Patrick Harris voiced Spider-Man in the Netflix version.", "prediction 3": "The superhero Spider-Man has been voiced in several television prior series. The X-Men version of the character was voiced by Christopher Daniel Barnes in the 1994 show, and Dan Gilvezan in the 1999 and 2003 TV series adaptations. In 2003, Spider-Man: The New Animated Series was voiced by Rino Romano, and the Spider-Man cartoon series was voiced by Ted Schwartz.", "prediction 4": "In 1994, Spider-Man: The Animated Series was released on Fox Kids, and in 1998, a new TV series was created for the Fox Network. In these series, there was a recurring character voiced by Jason Momoa called Peter Parker, who was voiced by Ted Schwartz. In the 2006 version of the animated series, Spider-Man: The New Animated Series, the voice of Peter Parker was done by Rino Romano, who also voiced Peter Parker in the 2006 version of the show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 4, "end": 12 }, { "error type": "Irrelevant", "explanation": "", "start": 22, "end": 32 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 224 }, { "error type": "Irrelevant", "explanation": "", "start": 225, "end": 361 }, { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 427 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 1 ] } ], "corrected-prediction": "The animated series Spider-Man has had several voices for Spiderman, Paul Soles in 1967, Ted Schwartz, Actor Dan Gilvezan, Christopher Daniel Barnes in 1994, Neil Patrick Harris, and Robbie Daymond while in 1999 Rino Romano voiced the character.\n" }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What is the most current season of supernatural?", "passages": [ [ "Supernatural (1977 TV series)", "Supernatural (1977 TV series)\n\nSupernatural is a British anthology television series that was produced by the BBC in 1977.", "The series consisted of eight episodes and was broadcast on BBC1.", "In each episode, a prospective member of the \"Club of the Damned\" was required to tell a horror story, and their application for membership would be judged on how frightening the story was.", "Applicants who failed to tell a sufficiently frightening story would be killed.", "Series creator Robert Muller, who also wrote seven of the eight screenplays, said: \"The idea was to tell the kind of Gothic tale that we don't have on television, something akin to the old horror films of the 1920s and 1930s.", "What we get now are thrillers set in modern times with lots of blood and violence.", "There is no blood and no violence in this series.", "They are tales about ghosts, vampires, werewolves, that sort of thing.", "Highly romantic and highly charged with fear and menace.\"", "Although each episode was a stand-alone story, episodes 2 and 3 shared a cast and linked plot.", "These two episodes starred English actress Billie Whitelaw, who was married to Muller.", "She said: \"Robert wrote the story with me in mind, but I said I would not read it until it was sent to me by a producer or director.", "I wanted the thing kept on a professional footing." ], [ "Supernatural (season 11)", "Supernatural (season 11)\n\n", "The eleventh season of \"Supernatural\", an American dark fantasy television series created by Eric Kripke, premiered on October 7, 2015, on The CW and concluded on May 25, 2016.", "The season consisted of 23 episodes and aired on Wednesdays at 9:00 pm (ET).", "This is the fourth and final season with Jeremy Carver as showrunner.", "The season was released on DVD and Blu-ray in region 1 on September 6, 2016.", "The eleventh season had an average viewership of 1.78 million U.S. viewers.", "\n\n\"Supernatural\" was renewed by The CW for an eleventh season on January 11, 2015.", "Jensen Ackles directed the first-produced episode of the season, titled \"The Bad Seed\", which was the third-aired episode.", "Emily Swallow was cast in a recurring role in July 2015, portraying Amara, a femme fatale.", "The season features a bottle episode, titled \"Baby\", in which the entire episode takes place inside the Impala.", "Richard Speight, Jr., who has a recurring role on the series as the Archangel Gabriel, directed the eighth episode of the season." ], [ "Supernatural (season 12)", "Supernatural (season 12)\n\n", "The twelfth season of \"Supernatural\", an American dark fantasy television series created by Eric Kripke, premiered on October 13, 2016, on The CW and concluded on May 18, 2017.", "The season consisted of 23 episodes and aired on Thursdays at 9:00 pm (ET) for the first 8 episodes before moving to 8:00 pm (ET) in January 2017.", "This is the first season with Andrew Dabb and Robert Singer as showrunners.", "\n\n\"Supernatural\" was renewed for a twelfth season by The CW on March 11, 2016.", "The twelfth season is the final season to feature Mark A. Sheppard as Crowley as the actor announced in May 2017 he would not be returning for season 13.", "The review aggregator website Rotten Tomatoes currently reports a 86% approval rating for \"Supernatural\"'s twelfth season, with an average rating of 8/10 based on 7 reviews." ], [ "Supernatural (season 13)", "Supernatural (season 13)\n\n", "The thirteenth season of \"Supernatural\", an American dark fantasy television series created by Eric Kripke, premiered on October 12, 2017, on The CW and concluded on May 17, 2018.", "The season consists of 23 episodes and aired on Thursdays at 8:00 pm (ET).", "This is the second season with Andrew Dabb and Robert Singer as showrunners.", "This season featured a backdoor pilot to a possible spin-off series called \"Wayward Sisters\", starring Kim Rhodes as Sheriff Jody Mills, Briana Buckmaster as Sheriff Donna Hanscum, Kathryn Newton as Claire Novak, Katherine Ramdeen as Alex Jones, Clark Backo as Patience Turner and Yadira Guevara-Prip as Kaia Nieves.", "The spin-off was ultimately not chosen to move forward as a series.", "The season also featured an animated crossover episode with \"Scooby-Doo\".", "\n\n\"Supernatural\" was renewed for a thirteenth season by The CW on January 8, 2017.", "This season is the first season not to feature Mark A. Sheppard as Crowley since his introduction in the fifth season, as the actor announced in May 2017 he would not be returning after his character was killed off for the last time." ] ], "gold": "The British anthology television series \"Supernatural\" was produced by the BBC in 1977 and had only 1 season. Season 11 of the American TV Show \"Supernatural\" debuted on October 7, 2015 and concluded on May 25, 2016. Season 12 of the show premiered on premiered on October 13, 2016, on The CW and concluded on May 18, 2017. season 13 of \"Supernatural\" premiered on October 12, 2017, on The CW and concluded on May 17, 2018.", "prediction 1": "The most recent season of the British supernatural drama television series Supernatural aired from October 2017 to May 2018. The most recent season of the American supernatural drama television series Supernatural aired from October 2017 to May 2018. The most recent season of the British supernatural drama television series Supernatural aired from October 2017 to May 2018.\n", "prediction 2": "The most recent season of the supernatural television series ran from 2018 to 2019. In 2017, it consist of 13 episodes with a backdoor pilot for a possible spin-off series called Wayward Sisters. Season 12 aired from January 12, 2017 to March 11, 2016, and season 13 aired from May 17, 2018.", "prediction 3": "Modern seasons of Supernatural aired on Tuesday evenings (EST) from 9:00 pm to 11:00 pm ET and concluded on May 25, 2020. Season 10 was released on October 4, 2005 and season 11 went on October 7, 2015. Season 12 was released on October 13, 2016, and season 13 was released on May 18, 2017.", "prediction 4": "The second season of Supernatural premiered during the summer of 2015. Later, the series' eleventh season ended in mid-2016. The thirteenth season of Supernatural, an American dark fantasy television series created by Eric Kripke, premiered during the fall of 2017.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 0, "end": 124 }, { "error type": "Redundant", "explanation": "The most recent season of the American supernatural drama television series Supernatural aired from October 2017 to May 2018. ", "start": 251, "end": 376 }, { "error type": "Unverifiable", "explanation": "", "start": 125, "end": 147 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] } ], "corrected-prediction": "The British anthology television series Supernatural was produced by the BBC in 1977 and consisted of eight episodes. The thirteenth season of the American supernatural drama television series Supernatural aired from October 12, 2017, on the CW and concluded on May 17, 2018. Season 12 premiered on October 13, 2016 and concluded on May 18, 2017. Season 11 debuted on October 7, 2015 and concluded on May 25, 2016. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who holds the record for games played in the vfl/afl?", "passages": [ [ "Michael Tuck", "In the last four years of his career Tuck was moved from the ball to the less demanding role of a running half-back flanker, but he still averaged over 17 possessions per game in the final years of his career.", "Tuck was the natural successor to the Hawthorn captaincy in 1986 after Leigh Matthews' retirement.", "He captained them from that year until his retirement in 1991 at the age of 38.", "He won a total of seven VFL/AFL premierships with Hawthorn, captaining the club in four of them.", "Tuck never won Hawthorn's best-and-fairest, but was runner-up on six occasions, and there was a good deal of controversy in 1982 and 1983 when he failed to poll a single vote in the Brownlow Medal, which led to votes for each match being made publicly available for the first time ever in 1984.", "His last game was in Hawthorn's premiership win in the Grand Final over West Coast.", "Tuck holds a number of VFL/AFL games records.", "These are:\n\nHe retired as the tenth-oldest player ever; he was 38 years and 95 days old when he retired.", "In 2016, Brent Harvey broke Tuck's record of 426 VFL/AFL games, playing 432 senior games. !", "scope=\"row\" style=\"text-align:center\" | 1972\n! scope=\"row\" style=\"text-align:center\" | 1973\n!" ], [ "Michael Tuck Medal", "Michael Tuck Medal\n\nThe Michael Tuck Medal was awarded to the best-and-fairest player in the AFL Pre-season Cup Final.", "The award was presented annually between 1992 and 2013; since 2014, the award has not been presented due to the preseason being structured without a final.", "It is named after Michael Tuck, who was the VFL-AFL games record holder, until round 19 2016 when Brent Harvey played his 427th game, who played 426 senior matches for between 1972 and 1991.", "\"Italics\" - denotes winner from losing team of that Grand Final." ], [ "Kevin Sheedy (Australian footballer)", "Kevin Sheedy (Australian footballer)\n\n", "Kevin John Sheedy AM (born 24 December 1947) is a former Australian rules football coach and player in the Australian Football League.", "He played and coached in a combined total of 929 games over 47 years from 1967 until 2013, which is a VFL/AFL record.", "Sheedy was inducted into the Australian Football Hall of Fame in 2008 and on the 29th of May 2018 was elevated to legend status.", "On the field, Sheedy represented in the Victorian Football League during the 1960s and 1970s, captaining the side in 1978 and winning three premierships.", "He then coached in the VFL/AFL for nearly three decades from 1981 until 2007, winning four premierships and earning acclaim for his unusual and creative approaches to promoting the club and the game.", "Sheedy conceived the first Anzac Day game in 1995 involving Collingwood and the club he coached at the time, Essendon.", "In 2009, Sheedy joined the newly formed as its inaugural AFL coach, and coached there from 2012 until 2013.", "Sheedy was born in Melbourne to devout Catholic parents.", "He played junior football with the local Try Boys society team whilst attending De La Salle College, Malvern, where future teammate Kevin Bartlett also spent a brief time.", "In 1963, he joined Prahran in the Victorian Football Association (VFA) and spent a year with the Under 19s." ], [ "Paul Williams (Australian rules footballer)", "Paul Williams (Australian rules footballer)\n\nPaul Williams (born 3 April 1973) is a former Australian rules footballer with both Collingwood and Sydney in the Australian Football League.", "He is also a former assistant coach in the AFL, which most notably included a brief period as caretaker coach of the Western Bulldogs towards the end of the 2011 season.", "Williams began his AFL career with Collingwood, joining them from Tasmanian club North Hobart.", "Playing in a number of positions ranging from half back to half forward, the tough-tackling Williams was a regular in the mostly unsuccessful Collingwood side of the late 1990s, racking up 189 games and kicking 223 goals (his best being 6 against Carlton in 1996).", "However, at the end of the 2000 season, he was traded to Sydney for two draft picks.", "There, he immediately made an impact, winning two consecutive Bob Skilton Medals in 2001 and 2002, as well as being selected in the All-Australian team of 2003.", "In 2005, Williams played in the Swans' premiership side.", "In doing so, he established an AFL record for most matches played by a player before being in a premiership side, with the Grand Final having been his 294th game.", "Shane Crawford surpassed this record in 2008.", "On 13 May 2006 against Richmond at Etihad Stadium, Williams became the 45th player to play 300 VFL/AFL games." ] ], "gold": "Currently, the team that played the most games in the VFL/AFL is Collingwood. Alternatively, Kevin Sheedy is the person who coached the most games in the league., and Brent Harvey holds the record for most career games played in the VFL/AFL, with a total of 432 matches.", "prediction 1": "Michael Tuck holds the record for the most games played in the VFL/AFL, with 426. In 2016, Brent Harvey broke the record for the most games played in the VFL/AFL, with 427.\n", "prediction 2": "In the 1972-73 season, Michael Tuck held the record for most games played in the VFL/AFL. In 2016, Brent Harvey broke this record, when he played his 427th game in the league. Furthermore, Kevin Sheedy, a retired Australian rules football coach, still holds the record for most games played in the league, with a total of 929 games played from 1967-2013.", "prediction 3": "Michael Tuck holds the record for the most VFL/AFL games played. He was represented in the Victorian Football League from 1962 to 1971, while Kevin Sheedy held the record from 1981 to 2013. Prior to Sheedy, the record was held by Paul Williams from 1991 until 2012.", "prediction 4": "Several people hold the record of claiming to have played more games in the vfl/afl than any other. Michael Tuck holds the record of having played the most games in the vfl/afl, with 426. In 2016, Brent Harvey broke these records, recording 432 senior games. In the AFL, Kevin Sheedy holds the record as the best player in the AFL Pre-season Cup Final. Paul Williams holds the record as an Australian rules footballer and assistant coach.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 38, "end": 48 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 168, "end": 173 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 8, 9 ] } ], "corrected-prediction": "Michael Tuck used to hold the record for the most games played in the VFL/AFL, with 426. In 2016, Brent Harvey broke that record with 432 senior games. Kevin Sheedy played and coached in a combined total of 929 games over 47 years from 1967 until 2013, which is a VFL/AFL record. Paul Williams established an AFL record for most matches played by a player before being in a premiership side, with the Grand Final having been his 294th game but this was broken by Shane Crawford in 2008. \n" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did the boston celtics win their first championship?", "passages": [ [ "1956\u201357 NBA season", "1956\u201357 NBA season\n\nThe 1956\u201357 NBA season was the 11th season of the National Basketball Association.", "The season ended with the Boston Celtics winning the NBA Championship (which would be the first of their 17 NBA titles), beating the St. Louis Hawks 4 games to 3 in the NBA Finals.", "x \u2013 clinched playoff spot\n\nNote: Prior to the 1969\u201370 season, league leaders in points, rebounds, and assists were determined by totals rather than averages." ], [ "Boston Celtics", "Boston Celtics\n\nThe Boston Celtics are an American professional basketball team based in Boston, Massachusetts.", "The Celtics compete in the National Basketball Association (NBA) as a member of the league's Eastern Conference Atlantic Division.", "Founded in 1946 as one of the original eight NBA teams to survive the league's first decade, the team is owned by Boston Basketball Partners LLC.", "The Celtics play their home games at the TD Garden, which they share with the National Hockey League (NHL)'s Boston Bruins.", "The franchise has won the most championships in NBA history with 17, accounting for 23.9 percent of all NBA championships since the league's founding.", "The Celtics have a notable rivalry with the Los Angeles Lakers, and have played the Lakers a record 12 times in the NBA Finals (including their most recent appearances in 2008 and 2010), of which the Celtics have won nine.", "Four Celtics players (Bob Cousy, Bill Russell, Dave Cowens and Larry Bird) have won the NBA Most Valuable Player Award for an NBA record total of 10 MVP awards.", "Both the nickname \"Celtics\" and their mascot \"Lucky the Leprechaun\" are a nod to Boston's historically large Irish population." ] ], "gold": "The Boston Celtics are an American professional basketball team based in Boston, that compete in the National Basketball Association as a member of the league's Eastern Conference Atlantic Division. They were founded in 1946 as one of the league's original eight teams. The Boston Celtics won their first championship of their 17 NBA titles during the 1956\u201357 NBA season. In the championship game, on April 13 1957, they beat the St. Louis Hawks 4 games to 3 in the NBA Finals.", "prediction 1": "The Boston Celtics are an American professional basketball team based in Boston, Massachusetts. Founded in 1946 as one of the original eight NBA teams to survive the league's first decade, the team has won the most championships in NBA history with 17. The team has won the NBA Championship 17 times, accounting for 23.9 percent of all NBA championships since the league's founding.\n", "prediction 2": "The Boston Celtics are an American professional basketball team based in Boston, Massachusetts. Founded in 1946 as one of the original eight NBA teams to survive the league's first decade, the team competes in the NBA as a member of the league's Eastern Conference Atlantic Division. The 1956\u201357 NBA season was the 11th season of the National Basketball Association. The season ended with the Boston Celtics winning the NBA Championship (which would be the first of their 17 NBA titles), beating the St. Louis Hawks 4 games to 3 in the NBA Finals.", "prediction 3": "The Boston Celtics are an American professional basketball team based in Boston that compete in the National Basketball Association as a member of the Eastern Conference Atlantic Division. In the 1956\u201357 NBA season the team won their first championship, beating the St. Louis Hawks 4 games to 3 in the NBA Finals.", "prediction 4": "The Boston Celtics are an American professional basketball team based in Boston that competes in the National Basketball Association as a member of the league's Eastern Conference Atlantic Division. The 1956-57 NBA season ended with the Boston Celtics winning the NBA Championship, which would be the first of their 17 NBA titles, defeating the St. Louis Hawks 4 games to 3 in the NBA Finals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 188 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 301, "end": 383 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1, 2 ] } ], "corrected-prediction": "The Boston Celtics are an American professional basketball team based in Boston, that compete in the National Basketball Association as a member of the league's Eastern Conference Atlantic Division. Founded in 1946 as one of the original eight NBA teams, they won the first of their 17 championships during the 1956\u201357 season, beating the St. Louis Hawks 4 games to 3 in the NBA Finals." }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "Who led investigation into the legality of apple\u2019s accounting practices during the 2000s?", "passages": [ [ "Criticism of Apple Inc.", "On August 30, 2016, after two-year \"EU illegal State aid case against Apple in Ireland\", the EU's competition commissioner, Margrethe Vestager, concluded that Apple had received \"illegal state aid\" from Ireland during 2004\u20132014 via its use of a hybrid \"Double Irish\" tax scheme on which it received private rulings by the Irish Revenue Commissioners.", "The Commission ordered Apple to pay 13 billion euros ($14.5 billion), plus interest, in unpaid taxes, the largest corporate tax fine in history.", "The Irish government \"unanimously\" agreed to appeal the ruling, claiming there was no departure from the applicable Irish taxation law and that the Commission's action was an intrusion into Irish sovereignty (since national taxation policy is excluded from Union treaties).", "Apple have also announced that they will appeal the Commission's findings.", "On 5 November 2017, the Paradise Papers, a set of confidential electronic documents relating to offshore investment, revealed that Apple is among the corporations that \"avoided billions of dollars in tax\" using offshore companies.", "In 2014, Appleby, an offshore legal service provider referred to in the papers, worked with Apple in a function similar to a general contractor to provide offshore offices on the island of Jersey in co-operation with the law firm Baker McKenzie." ], [ "Apple Inc.", "Apple has created subsidiaries in low-tax places such as Ireland, the Netherlands, Luxembourg and the British Virgin Islands to cut the taxes it pays around the world.", "According to \"The New York Times,\" in the 1980s Apple was among the first tech companies to designate overseas salespeople in high-tax countries in a manner that allowed the company to sell on behalf of low-tax subsidiaries on other continents, sidestepping income taxes.", "In the late 1980s, Apple was a pioneer of an accounting technique known as the \"Double Irish with a Dutch sandwich,\" which reduces taxes by routing profits through Irish subsidiaries and the Netherlands and then to the Caribbean.", "British Conservative Party Member of Parliament Charlie Elphicke published research on October 30, 2012, which showed that some multinational companies, including Apple Inc., were making billions of pounds of profit in the UK, but were paying an effective tax rate to the UK Treasury of only 3 percent, well below standard corporation tax.", "He followed this research by calling on the Chancellor of the Exchequer George Osborne to force these multinationals, which also included Google and The Coca-Cola Company, to state the effective rate of tax they pay on their UK revenues.", "Elphicke also said that government contracts should be withheld from multinationals who do not pay their fair share of UK tax." ], [ "EU illegal State aid case against Apple in Ireland", "But ASI also did all the functions of IRL1, making circa \u20ac110.8 billion of profits from Non\u2013U.S. sales.", "The EU Commission contest IRL1's actions made ASI Irish, and the functions of IRL1 over-rode the Bermuda Board meetings in deciding the \"managed and controlled\" test.", "The Commission had not brought any cases against U.S. multinationals using the standard double \"two separate companies\" Irish BEPS tool.", "Apple's unique ASI structure, is believed to be the reason why Apple never had an Apple retail store in the Republic of Ireland (it even has one in smaller Belfast).", "In May 2013, Apple\u2019s tax practices were examined by a U.S. bipartisan investigation of the Senate Permanent Subcommittee on Investigation.", "The investigation aimed to examine whether Apple used offshore structures, in conjunction with arrangements, to shift profits from the U.S. to Ireland.", "Senators Carl Levin and John McCain drew light on what they referred to as a special tax arrangement between Apple and Ireland which allowed Apple to pay a corporate tax rate of less than 2%.", "In June 2014, an investigation was opened by the European Commissioner for Competition on behalf of the EU Commission (SA 38373)." ] ], "gold": "In the late 1980s Apple was a pioneer of an accounting technique, \"Double Irish With a Dutch Sandwich\", which reduces taxes by routing profits through Irish subsidiaries and the Netherlands and then to the Caribbean. On August 30, 2016, after two-year \"EU illegal State aid case against Apple in Ireland\", the EU's competition commissioner, Margrethe Vestager, concluded that Apple had received \"illegal state aid\" from Ireland during 2004\u20132014 via its use of a hybrid \"Double Irish\" tax scheme on which it received private rulings by the Irish Revenue Commissioners. The Commission ordered Apple to pay 13 billion euros or $14.5 billion, plus interest, in unpaid taxes, the largest corporate tax fine in history. During the 2000's in the United States, Senators Carl Levin and John McCain led an investigation into Apple's accounting practices, as well.", "prediction 1": "In the 2000s, Apple's tax practices were examined by a U.S. bipartisan investigation of the Senate Permanent Subcommittee on Investigation, which examined whether Apple used offshore structures, in conjunction with arrangements, to shift profits from the U.S. to Ireland. In June 2014, an investigation was opened by the European Commissioner for Competition on behalf of the EU Commission, which concluded that Apple had received illegal state aid from Ireland during 2004\u20132014 via its use of a hybrid \"Double Irish\" tax scheme on which it received private rulings by the Irish Revenue Commissioners.\n", "prediction 2": "There have been several investigations into the legality of apple's accounting practices during the 2000s. An investigation led by Thomas Cowan concluded in May 2012 that Apple received \"illegal state aid\" from Ireland during 2004-2014 via its use of a hybrid Irish tax scheme. In June 2014, an investigation was opened by the European Commissioner for Competition on behalf of the EU Commission.", "prediction 3": "During the 2000s,, the legality of apple's accounting practices was investigated by a number of different agencies. The EU Commission, the European Union Commission, the US Senate Subcommittee on Investigation, and the European Commissioner for Competition opened investigations into the legality of apple's tax practices during the 2000s.", "prediction 4": "In 2009, Apple was investigated by a U.S. congressional committee, but the investigation was led by an independent United States federal grand jury. In 2008, the U.S. Senate Permanent Subcommittee on Investigation conducted a western european investigation into Apple's tax practices from 2009 to 2011, and in 2013, an investigation was led by the Australian Department of Taxation on behalf of the Australian Taxation Office.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 140, "end": 271 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the late 1980s Apple was a pioneer of an accounting technique, \"Double Irish With a Dutch Sandwich\", which reduces taxes by routing profits through Irish subsidiaries and the Netherlands and then to the Caribbean. In June 2014, an investigation was opened by the European Commissioner for Competition on behalf of the EU Commission, and on August 30, 2016, upon the conclusion of the two-year \"EU illegal State aid case against Apple in Ireland\", the EU's competition commissioner, Margrethe Vestager, concluded that Apple had received \"illegal state aid\" from Ireland during 2004\u20132014 via its use of a hybrid \"Double Irish\" tax scheme on which it received private rulings by the Irish Revenue Commissioners. The Commission thus ordered Apple to pay 13 billion euros or $14.5 billion, plus interest, in unpaid taxes, the largest corporate tax fine in history. In the 2000s, Apple's tax practices were also examined by a Senators Carl Levin and John McCain as part of the U.S. bipartisan investigation of the Senate Permanent Subcommittee on Investigation, \n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When did the us leave the vietnam war?", "passages": [ [ "Vietnam War", "These two sides would see significant, rapid changes throughout its lifetime from their original post-colonial armies, and by mid-1970s the ARVN became the fourth largest army with the PAVN became the fifth largest army in the world in two countries with a population of roughly 20 million each.", "Despite the Paris Peace Accord, which was signed by all parties in January 1973, the fighting continued as both Saigon and Hanoi attempted to take territory before and after the accord; the ceasefire was broken just days after its signing.", "In the U.S. and the Western world, a large anti-Vietnam War movement developed as part of a larger counterculture, the largest such anti-war movement up to that point in history.", "The war changed the dynamics between the Eastern and Western Blocs, altered North\u2013South relations, and significantly influenced the political landscape in the United States.", "Across much of Western Europe and the U.S., ground-force intervention spurred the rise of transnational political movements and campaigning.", "Direct U.S. military involvement ended on 15 August 1973 as a result of the Case\u2013Church Amendment passed by the U.S. Congress.", "The capture of Saigon by the North Vietnamese Army in April 1975 marked the end of the war, and North and South Vietnam were reunified the following year.", "The war exacted a huge human cost in terms of fatalities (see Vietnam War casualties)." ], [ "Vietnam", "The US also engaged in a sustained aerial bombing campaign.", "Meanwhile, China and the Soviet Union provided North Vietnam with significant material aid and 15,000 combat advisers.", "Communist forces supplying the Vi\u1ec7t C\u1ed9ng carried supplies along the H\u1ed3 Ch\u00ed Minh trail, which passed through the Kingdom of Laos.", "The communists attacked South Vietnamese targets during the 1968 T\u1ebft Offensive.", "Although the campaign failed militarily, it shocked the American establishment, and turned US public opinion against the war.", "During the offensive, communist troops massacred over 3,000 civilians at Hu\u1ebf.", "Facing an increasing casualty count, rising domestic opposition to the war, and growing international condemnation, the US began withdrawing from ground combat roles in the early 1970s.", "This process also entailed an unsuccessful effort to strengthen and stabilise South Vietnam.", "Following the Paris Peace Accords of 27 January 1973, all American combat troops were withdrawn by 29 March 1973.", "In December 1974, North Vietnam captured the province of Ph\u01b0\u1edbc Long and started a full-scale offensive, culminating in the fall of Saigon on 30 April 1975.", "South Vietnam was briefly ruled by a provisional government for almost eight years while under military occupation by North Vietnam.", "On 2 July 1976, North and South Vietnam were merged to form the Socialist Republic of Vietnam.", "The war left Vietnam devastated, with the total death toll standing at between 966,000 and 3.8 million." ] ], "gold": "The US troop presence in Vietnam peaked in 1968. Due to the Paris Peace Accords, US forces started to withdraw from the Vietnam war on January 27, 1973, with all direct US military involvement ending on 15 August 1973.", "prediction 1": "Direct U.S. military involvement ended on 15 August 1973 as a result of the Case\u2013Church Amendment passed by the U.S. Congress. The capture of Saigon by the North Vietnamese Army in April 1975 marked the end of the war, and North and South Vietnam were reunified the following year.\n", "prediction 2": "Direct US military involvement ended on 15 August 1973 as a result of the Case\u2013Church Amendment passed by the U.S. Congress. The capture of Saigon by the North Vietnamese Army in April 1975 marked the end of the war, and North and South Vietnam were reunified the following year. The pact came into effect on 29 March 1973 and all American combat troops were withdrawn on 30 March 1973.", "prediction 3": "The US ended its involvement in the Vietnam war on 15 August 1973 as a result of the Case\u2013Church Amendment passed by the U.S. Congress. The US began withdrawing from combat roles in the early 1970s, following the Paris Peace Accords of January 1973, all American combat troops were withdrawn by 29 March 1973. The capture of Saigon by the North Vietnamese Army in April 1975 marked the end of the war, and North and South Vietnam were reunified the following year.", "prediction 4": "In the early 1970s, the US began withdrawing from all combat roles in Vietnam and began withdrawing by March 1973 from all combat troops stationed in Vietnam. Nonetheless, the Vietnam War did not end with the US withdrawing from all combat operations after the Paris Peace Accords, which were signed by all parties in January 1973.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 57, "end": 126 }, { "error type": "Irrelevant", "explanation": "", "start": 127, "end": 282 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] } ], "corrected-prediction": "Paris Peace Accord was signed in January 27, 1973. All American combat troops were withdrawn by 29 March 1973. Direct U.S. military involvement ended on 15 August 1973. \n" }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "Who won last year's college football championship?", "passages": [ [ "2017 NCAA Division I FBS football season", "2017 NCAA Division I FBS football season\n\n", "The 2017 NCAA Division I FBS football season was the highest level of college football competition in the United States organized by the National Collegiate Athletic Association (NCAA).", "The regular season began on August 26, 2017 and ended on December 9, 2017.", "The Alabama Crimson Tide and Georgia Bulldogs played in the 2018 College Football Playoff National Championship.", "Alabama defeated Georgia in overtime by a score of 26\u201323 on a game-winning touchdown pass from Tua Tagovailoa to Devonta Smith.", "Alabama claimed its 17th national title in school history, the most of any current FBS team.", "The University of Central Florida Knights finished the season undefeated and beat the Auburn Tigers.", "Auburn defeated College Football Playoff national champion Alabama and split two games with runner-up Georgia during the season.", "Because of this, the UCF Knights also claimed a national title this season.", "The following rule changes were recommended by the NCAA Football Rules Committee for the 2017 season:\n\n\nThe committee left the current targeting rules unchanged for the 2017 season, despite discussions to modify the rule to eject a player for targeting only if the call is confirmed, not if the call stands due to lack of \"indisputable video evidence\" to overturn the ruling on the field.", "Points of emphasis this season include speeding up games by:\n\n\nCoastal Carolina was in the second year of its FBS transition." ], [ "2014 Ohio State Buckeyes football team", "For their performances, Ezekiel Elliott was named the game's offensive MVP, and Tyvis Powell was named the game's defensive MVP.", "Ohio State improved their all-time record against Oregon to 9\u20130, won the first ever College Football Playoff national championship, and the program's first national championship since 2002.", "It was Ohio State's eighth claimed national championship, and sixth national championship by vote of the AP and Coaches' polls.", "The fourteen season victories tied the 2002 season for the most in program history.", "Entering the 2014 season, the Buckeyes were ranked No. 5 in the AP and No. 6 in the Coaches' Preseason Polls.", "After a 35\u201321 loss to Virginia Tech on September 6, Ohio State dropped to No. 22 in the AP and No. 18 in the Coaches' Polls.", "When the first College Football Playoff rankings came out on October 28, the Buckeyes were No. 16.", "After Ohio State defeated No. 7 Michigan State 49\u201337 on November 8, they moved up to No. 8 in the AP and No. 7 in the Coaches' Poll, as well as moving up to No. 8 in the CFP rankings.", "Entering the Big Ten Championship Game, the Buckeyes were ranked No. 6 in both the AP and Coaches' Polls, and No. 5 in the CFP rankings." ], [ "2015 College Football Playoff National Championship", "2015 College Football Playoff National Championship\n\nThe 2015 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football for the 2014 season, which took place at AT&T Stadium in Arlington, Texas on January 12, 2015.", "It was the culminating game of the 2014\u201315 bowl season as the inaugural College Football Playoff National Championship, replacing the BCS National Championship Game.", "The national title was contested through a four-team bracket system, the College Football Playoff, which replaced the previous Bowl Championship Series.", "The game was played between the winners of two designated semi-final bowl games played on January 1, 2015: the No. 4 Ohio State Buckeyes, who upset No. 1 Alabama 42\u201335 in the 2015 Sugar Bowl, and the No. 2 Oregon Ducks, who defeated previously unbeaten No. 3 Florida State 59\u201320 in the 2015 Rose Bowl.", "This was the first championship game since 2006 that did not feature at least one SEC team, and the teams' first meeting since the 2010 Rose Bowl, which the Buckeyes won 26\u201317.", "The Ohio State Buckeyes won the game, 42\u201320, marking the first national championship awarded under the CFP system." ], [ "2016 College Football Playoff National Championship", "2016 College Football Playoff National Championship\n\nThe 2016 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football for the 2015 season.", "It was played at University of Phoenix Stadium in Glendale, Arizona on January 11, 2016, and was the culminating game of the 2015\u201316 bowl season.", "The game was played between the winners of two pre-designated semifinal bowls played on December 31, 2015: the No. 1 Clemson Tigers, who beat the No. 4 Oklahoma Sooners 37\u201317 at the Orange Bowl, coached by Dabo Swinney in his 8th season, and the No. 2 Alabama Crimson Tide, who shut out the No. 3 Michigan State Spartans 38\u20130 at the Cotton Bowl Classic, coached by Nick Saban.", "The 13\u20131 Alabama Crimson Tide won the game, holding off the undefeated Clemson Tigers 45\u201340 in the fourth quarter.", "Accompanied by a talented receiving corps, Clemson's Heisman Finalist quarterback Deshaun Watson had a historic performance, setting the record for most total yards in national championship game history, with 478 yards (405 passing / 73 rushing) against the nation's third-ranked defense in Alabama, breaking the record previously set by Vince Young in the 2006 Rose Bowl." ], [ "2018 College Football Playoff National Championship", "2018 College Football Playoff National Championship\n\nThe 2018 College Football Playoff National Championship was a college football bowl game that determined a national champion in the NCAA Division I Football Bowl Subdivision for the 2017 season.", "The Alabama Crimson Tide defeated the Georgia Bulldogs 26\u201323, coming back from a 13\u20130 deficit at halftime to secure the win in overtime.", "True freshman quarterback Tua Tagovailoa and defensive tackle Daron Payne were respectively named the offensive and defensive players of the game.", "The College Football Playoff selection committee chose the semifinalists following the conclusion of the 2017 regular season.", "Alabama and Georgia advanced to the national championship after winning the semifinal games hosted by the Sugar Bowl and Rose Bowl Game respectively in January 2018.", "The championship game was played at Mercedes-Benz Stadium in Atlanta, Georgia on January 8, 2018.", "The Mercedes-Benz Stadium in Atlanta, Georgia was announced as the host site for the fourth College Football National Championship on November 4, 2015.", "The College Football Playoff (CFP) selection committee selected four teams to advance to the playoff: the Clemson Tigers, Oklahoma Sooners, Georgia Bulldogs, and Alabama Crimson Tide.", "The Alabama Crimson Tide defeated the Clemson Tigers in the 2018 Sugar Bowl by a score of 24\u20136 to reach the championship game.", "The Tide had a 12\u20131 season, becoming the SEC West Division co-champions with the Auburn Tigers." ] ], "gold": "The Ohio State Buckeyes beat the Oregon Ducks, 42-20, in the 2015 College Football Championship game, marking the first national championship awarded under the CFP system. The Alabama Crimson Tide beat the Clemson Tigers, 45-40, to win the 2016 College Football Championship game. The Aabama Crimson Tide beat the Georgia Bulldogs, 26-23, to win the 2018 College Football Championship game, that decided the winner of the 2017 season.", "prediction 1": "The College Football Playoff is a four-team bracket system used to determine college football championship winners. The Ohio State Buckeyes won the 2015 College Football Playoff National Championship, while the Clemson Tigers won the 2016 College Football Playoff National Championship.\n", "prediction 2": "The 2017 College Football Playoff National Championship included Alabama who won the championship with a score of 26\u201323 at Arrowhead Stadium in Atlanta, Georgia. The 2015 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football for the 2014 season, which took place at AT&T Stadium in Arlington, Texas on January 12, 2015. The 2016 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football for the 2015 season, which was played at University of Phoenix Stadium in Glendale, Arizona on January 11, 2016.", "prediction 3": "The College Football Playoff National Championship was the highest level of college football competition in the United States organized by the National Collegiate Athletic Association (NCAA). The winner of the 2014 College Football Playoff National Championship was the Ohio State Buckeyes. The winner of the 2015 College Football Playoff National Championship was the Clemson Tigers.", "prediction 4": "The 2017 NCAA Division I FBS football season was the highest level of college football competition in the United States organized by the National Collegiate Athletic Association (NCAA). Alabama won its 17th national title in school history, the most of any current FBS team. Ohio State won the first ever College Football Playoff national championship, and the program's first national championship since 2002. The 2015 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football for the 2014 season. The 2016 College Football Playoff National Championship was a bowl game that determined a national champion of NCAA Division I FBS college football season.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 115 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[4]}", "start": 201, "end": 287 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4, 6 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Ohio State Buckeyes won the 2015 College Football Playoff National Championship, beating the Oregon Ducks with a score of 42-20, while the Alabama Crimson Tide beat the Clemson Tigers, 45-40, to win the 2016 College Football Championship game. The Alabama Crimson Tide also beat the Georgia Bulldogs, 26-23, to win the 2018 College Football Championship game.\n" }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Who sang walk hand in hand with me?", "passages": [ [ "Walk Hand in Hand", "Walk Hand in Hand\n\n\"Walk Hand in Hand\" is a popular song by Johnny Cowell, published in 1956.", "The biggest-selling version recorded of the song was sung by Tony Martin, reaching #2 in the UK and #10 on the United States \"Billboard\" chart in 1956.", "The same year, it was recorded by Andy Williams, whose version hit #54 on the chart, and by Ronnie Carroll, whose version reached No. 13 on the UK singles chart.", "A later recording by Gerry & The Pacemakers reached No.29 on the UK chart, No. 10 in Canada, and \"bubbled under\" at No.103 on the Billboard chart at the end of 1965." ] ], "gold": "\"Walk Hand in Hand\" is a popular song by Johnny Cowell, published in 1956. The biggest selling version of the song was sung by Tony Martin reaching #2 in the UK and #10 in the United States \"Billboard\" chart in 1956. The same year, it was recorded by Andy Williams, whose version hit #54 on the chart, and by Ronnie Carroll, whose version reached #13 on the UK singles chart. A later recording by Gerry & The Pacemakers reached #29 on the UK chart, #10 in Canada, and #103 on the Billboard chart at the end of 1965.", "prediction 1": "\"Walk Hand in Hand\" is a popular song by Johnny Cowell, published in 1956. The biggest-selling version recorded of the song was sung by Tony Martin, reaching #2 in the UK and #10 on the United States \"Billboard\" chart in 1956. The same year, it was recorded by Andy Williams, whose version hit #54 on the chart, and by Ronnie Carroll, whose version reached No. 13 on the UK singles chart. A later recording by Gerry & The Pacemakers reached No. 29 on the UK chart, No. 10 in Canada, and \"bubbled under\" at No.103 on the Billboard chart at the end of 1965.\n", "prediction 2": "\"Walk Hand in Hand\" is a popular song by Johnny Cowell, published in 1956. The biggest-selling version recorded of the song was sung by Tony Martin, reaching #2 in the UK and #10 on the United States \"Billboard\" chart in 1956. James Dio overtook Tony Martin at his highest sales position in the singles chart, reaching No. 23 on the UK singles chart.", "prediction 3": "Walk Hand in Hand with Me is a 1960 song published by Johnny Cowell that was recorded and released in 1956. The biggest-selling version recorded of the song was sung by Tony Martin, reaching #2 in the UK and #10 on the United States \"Billboard\" chart in 1956. The same year, it was recorded by Andy Williams, whose version hit #54 on the chart, and by Ronnie Carroll, whose version reached No. 13 on the UK singles chart. A later recording by Gerry & The Pacemakers reached No.89 on the UK chart, No. 49 on the United States \"Billboard\" chart at the end of 1965.", "prediction 4": "For example, when Johnny Cowell, with the words \"Walk Hand in Hand,\" published the song in 1956, wrote, \"Walk Hand in Hand with Me\", the band Grande Prairie and singer Tony Martin sung it. In 1956, Andy Williams sang a version of the song that reached number 54 on the Billboard chart. Then, in 1965, Gerry &The Pacemakers and Ronnie Carroll sang it.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 487, "end": 505 } ], "missing-info": [], "corrected-prediction": "\"Walk Hand in Hand\" is a popular song by Johnny Cowell, published in 1956. The biggest-selling version recorded of the song was sung by Tony Martin, reaching #2 in the UK and #10 on the United States \"Billboard\" chart in 1956. The same year, it was recorded by Andy Williams, whose version hit #54 on the chart, and by Ronnie Carroll, whose version reached No. 13 on the UK singles chart. A later recording by Gerry & The Pacemakers reached No. 29 on the UK chart, No. 10 in Canada, and No.103 on the Billboard chart at the end of 1965.\n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "Where is the chick fil a peach bowl being played?", "passages": [ [ "Peach Bowl", "Peach Bowl\n\n", "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968.", "Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl.", "From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl.", "The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta.", "Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game.", "Between 1993 and 2016, the Georgia Dome played host.", "The bowl then moved to Mercedes-Benz Stadium starting in 2017.", "Since the 2014 season, the Peach Bowl has featured College Football Playoff matchups, with the 2016, 2019, 2022, and 2025 games hosting a national semifinal.", "Seven of the first ten meetings (all but the 1968, 1971, and 1974 games) pitted an Atlantic Coast Conference team against an at-large opponent.", "The bowl had no automatic berths prior to 1993, but usually featured an ACC team or a team from the Southeastern Conference.", "From 1993 until 2013, the game matched a SEC team against one from the ACC.", "From 1993 to 2005, this matchup was the third selection from the ACC against the fourth from the SEC.", "In 2005, the bowl hosted its first-ever matchup of top 10 ranked teams." ] ], "gold": "The Peach Bowl, officially known since 1997 as the Chick-fil-A Peach Bowl, is an annual college football bowl game played in Atlanta, Georgia since December 1968. The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta. Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game. Between 1993 and 2016, the Georgia Dome played host. The bowl then moved to Mercedes-Benz Stadium starting in 2017. ", "prediction 1": "The Chick-fil-A Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl. The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta. Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game. Between 1993 and 2016, the Georgia Dome played host.\n", "prediction 2": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl. In 1971, the game was held at Grant Field on the Georgia Tech campus before the game moved to Atlanta\u2013Fulton County Stadium between 1991 and 1992 and then to the Georgia Dome in 1993 and 2016. Last year, the bowl moved to Mercedes-Benz Stadium starting in 2017.", "prediction 3": "The Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl.", "prediction 4": "The Chick-fil-A Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been sponsored by Chick-fil-A and officially known as the Chick-fil-A Peach Bowl. From 2006 to 2013, it was officially referred to as simply the Chick-fil-A Bowl. The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta. Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game. Between 1993 and 2016, the Georgia Dome played host. The bowl then moved to Mercedes-Benz Stadium starting in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 287 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 158 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The Chick-fil-A Peach Bowl is an annual college football bowl game played in Atlanta since December 1968. Since 1997, it has been officially known as the Chick-fil-A Peach Bowl. The first three Peach Bowls were played at Grant Field on the Georgia Tech campus in Atlanta. Between 1971 and 1992, Atlanta\u2013Fulton County Stadium hosted the game. Between 1993 and 2016, the Georgia Dome played host. The bowl then moved to Mercedes-Benz Stadium starting in 2017.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who says i late i late for a very important date?", "passages": [ [ "White Rabbit", "White Rabbit\n\nThe White Rabbit is a fictional character in Lewis Carroll's book \"Alice's Adventures in Wonderland\".", "He appears at the very beginning of the book, in chapter one, wearing a waistcoat, and muttering \"Oh dear!", "Oh dear!", "I shall be too late!\"", "Alice follows him down the rabbit hole into Wonderland.", "Alice encounters him again when he mistakes her for his housemaid Mary Ann and she becomes trapped in his house after growing too large.", "The Rabbit shows up again in the last few chapters, as a herald-like servant of the King and Queen of Hearts.", "In his article \"Alice on the Stage\" Carroll wrote \"And the White Rabbit, what of him?", "Was \"he\" framed on the \"Alice\" lines, \"or\" meant as a contrast?", "As a contrast, distinctly.", "For \"her\" 'youth', 'audacity', 'vigour', and 'swift directness of purpose', read 'elderly', 'timid', 'feeble', and 'nervously shilly-shallying', and you will get something of what I meant him to be.", "I think the White Rabbit should wear spectacles.", "I'm sure his voice should quaver, and his knees quiver, and his whole air suggest a total inability to say 'Boo' to a goose!\"" ], [ "White Rabbit", "No time to say hello, goodbye!", "I'm late!", "I'm late!", "I'm late!\"", "The Rabbit was voiced by Bill Thompson.", "Some believe the rabbit was late for the announcement of the Queen to the royal garden.", "The panic the rabbit showed was his fear of losing his head.", "Upon her arrival (where Alice has been helping to paint the roses red) the cards finish their song and the rabbit blows his trumpet (which he had been carrying for most of his lines) royally introducing the king and queen.", "The White Rabbit made a few appearances on the Disney Channel original show, \"House of Mouse\".", "His most notable appearance was in the episode \"Clarabelle's Big Secret\", when he confessed to Clarabelle Cow that \"I'm not really late, and I don't really have a date.", "I'm a fraud!\".", "He is seen being grabbed by the reservation clerk Daisy Duck in the show's intro.", "He was voiced by Corey Burton, who has voiced the Rabbit in all English speaking roles for the character since then.", "In Aladdin and the King of Thieves, the genie was transformed into him.", "The White Rabbit also appears at the Walt Disney Parks and Resorts as a meetable character." ], [ "White Rabbit", "In the PlayStation 2 action-RPG game, \"Kingdom Hearts\" and its Game Boy Advance follow-up, \"\", the White Rabbit leads Sora, Donald Duck and Goofy to the Queen's palace, worried about being late.", "His Japanese voice actor was Shigeru Ushiyama.", "The White Rabbit works for the Red Queen, but is also a secret member of the Underland Underground Resistance, and was sent by the Hatter to search for Alice.", "Actor Michael Sheen stated, \"The White Rabbit is such an iconic character that I didn't feel like I should break the mould too much.\"", "In this film adaption, the White Rabbit is given the name Nivens McTwisp.", "McTwisp appears in the video game adaptation of Tim Burton's \"Alice in Wonderland\" as a playable character.", "He attacks using his watch, and can manipulate time.", "The 1988 Czechoslovak film \"Alice\", noted for its disturbing interpretation of Carroll's story, shows a dark stop-motion version of the character.", "At the beginning of the film, the White Rabbit starts out as a stuffed rabbit that comes alive in Alice's bedroom and breaks out of his glass case; he leaks sawdust through a hole in his chest." ], [ "Jonathan King", "\"Me Me Me\" (2011) was described at the Cannes Film Festival as \"a re-telling of \"Romeo and Juliet\"\", and \"The Pink Marble Egg\" (2013) is a spy story.", "For publicity King drove down the Promenade de la Croisette in Cannes with a pink papier-m\u00e2ch\u00e9 egg on top of his Rolls Royce during the Cannes Film Festival.", "King has complained about his media coverage since his 2001 conviction.", "In 2005 he went to the Press Complaints Commission about an article in the \"News of the World\" that said he had gone to a park to \"ogle\" boys.", "In fact he had gone there at the request of a documentary maker.", "The complaint was not upheld, but Roy Greenslade argued that King had a good case.", "In October 2011 then BBC Director-General Mark Thompson apologised to King for the removal of King's performance of \"It Only Takes a Minute\" from a repeat, on BBC Four, of a 1976 episode of \"Top of the Pops\".", "King described the cut as a \"Stalinist revision approach to history\".", "When asked by a newspaper in 2012 if he believed he had anything to apologise for, to anybody from his past, King replied, \"The only apology I have is to say that I was good at seduction." ] ], "gold": "\"I'm late I'm late for a very important date\" is a phrase used by the White Rabbit in Disney's animated 1951 Alice in Wonderland Film, voiced by William H. Thompson. The phrase is derived from the 1865 book Alice's Adventures in Wonderland, where the White Rabbit mutters, \"Oh dear! Oh dear! I shall be too late!\". In the 2010 film adaption, the White Rabbit is given the name Nivens McTwisp and is played by Michael Christopher Sheen.", "prediction 1": "The White Rabbit is a fictional character in Lewis Carroll's book Alice's Adventures in Wonderland. He appears at the very beginning of the book, in chapter one, wearing a waistcoat, and muttering \"Oh dear! Oh dear! I shall be too late!\" Alice follows him down the rabbit hole into Wonderland. He is seen being grabbed by the reservation clerk Daisy Duck in the show's intro. The White Rabbit also made a few appearances on the Disney Channel original show, House of Mouse. He was voiced by Corey Burton, who has voiced the character in all English speaking roles since then.\n", "prediction 2": "The White Rabbit tells Alice regarding her proposed date that \"I'm late!\" Some believe the White Rabbit was late for the announcement of the Queen to the royal garden. In Lewis Carroll's Three Little Pigs book, and Tim Burton's 1996 film version, \u201cAlice in Wonderland\u201d, the White Rabbit is a fictional character who appears at the very beginning of the book, in chapter one, wearing a waistcoat, and muttering \"Oh dear! Oh dear! I shall be too late!\". In the 1995 film adaptation produced by Jane Austen, the White Rabbit, \"White Rabbit\" character is also seen being grabbed by the reservation clerk Daisy Duck in the show's intro. In the video game, \"Kingdom Hearts\", this is a playable character who attacks using his watch, and can manipulate time.", "prediction 3": "There are numerous examples of the White Rabbit saying \"I am late!\" especially in Lewis Carroll's 1842 book, Alice's Adventures in Wonderland. The character first pops up in the book in chapter 1, when Alice first meets him. This passage is narrated by Bill Thompson in the 1940 movie version of the book. Playable White Rabbit appears in various video game adaptations, including the 2011 video game adaptation of Tim Burton's Alice in Wonderland which includes attacks using his watch, and can manipulate time.", "prediction 4": "In Thomas Hardy's Life Enchanted, Alice says, \"I'm late!\" in the London Underground and to the British Council for their televised version of the story. The White Rabbit is a fictional character in Lewis Carroll's book Alice's Adventures in Wonderland. He appears at the very beginning of the book, in chapter one, wearing a waistcoat, and muttering \"Oh dear! Oh dear! I shall be too late!\" Alice follows him down the rabbit hole into Wonderland. In this television show, Corey Burton has voiced the character since then.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 238, "end": 473 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] } ], "corrected-prediction": "The White Rabbit is a fictional character in Lewis Carroll's book Alice's Adventures in Wonderland. He appears at the very beginning of the book, in chapter one, wearing a waistcoat, and muttering \"Oh dear! Oh dear! I shall be too late!\" He was voiced by Corey Burton, who has voiced the character in all English speaking roles since then. In this film adaption, the White Rabbit is given the name Nivens McTwisp.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sings it must have been love but it's over now?", "passages": [ [ "It Must Have Been Love", "It Must Have Been Love\n\n\"It Must Have Been Love\" is a song written by Per Gessle and performed by the Swedish pop duo Roxette.", "The power ballad became the duo's third number one hit in the United States, and is one of their best selling releases, being certified gold or platinum in a number of countries.", "Four different versions of the song have been officially released.", "The original 1987 track was followed by the most successful incarnation of the song, a slightly edited version \u2013 omitting the Christmas references \u2013 which was created for the soundtrack to the 1990 movie \"Pretty Woman\".", "During the \"Join the Joyride!", "World Tour\" in 1991, the band recorded a country music version of the track in Los Angeles, which was included on their 1992 album \"Tourism\".", "A Spanish-language version of the \"Pretty Woman\" recording was released on their 1996 compilation \"Baladas en espa\u00f1ol\".", "Finally, an orchestral live performance from the band's 2009 concert at Night of the Proms was included on their 2012 studio album, \"Travelling\".", "The song was first released as \"It Must Have Been Love (Christmas for the Broken Hearted)\" in December 1987.", "It was composed after EMI Germany asked the duo to \"come up with an intelligent Christmas single\".", "It became a top five hit in Sweden, but was not released internationally." ], [ "Megan McKenna", "She has also appeared in \"The Only Way Is Essex\" in 2010 where she auditioned to be part of the girl-group LOLA, and auditioned for \"The X Factor\" as a country singer.", "On 13 March 2016, she joined \"The Only Way Is Essex\" full-time.", "In August 2018, McKenna took part in the first series of \"Celebs on the Farm\".", "She was eliminated second, finishing in seventh place.", "On 15 December 2018, McKenna guest starred on \"Happy Hour with Olly Murs\", on ITV.", "In November 2018, McKenna was confirmed to be participating in the sixth series of \"Celebs Go Dating\", set to air in 2019 on E4.", "In 2017, McKenna launched her music career, releasing her debut EP featuring \"High Heeled Shoes\" and \"Far Cry from Love\".", "The EP was released shortly after the third episode of her accompanying reality show, \"There\u2019s Something About Megan\".", "The two songs topped the UK iTunes chart, just 24 hours after their release.", "On 7 December 2018, McKenna\u2019s debut album, \"Story of Me\" was released.", "It debuted at number one on the UK iTunes country chart, and rose to number ten on the mainstream UK iTunes chart.", "\"Story of Me\" debuted at number 6 on the official UK country chart." ], [ "Estadio San Carlos de Apoquindo", "The stadium has hosted concerts by famous artists, spanning many different genres.", "Part of Pearl Jam's \"World Wide Suicide\" clip was filmed in the dresser rooms of the stadium.", "Roxette's hit \"It Must Have Been Love\" (Live In San Carlos de Apoquindo) was included in their \"Tourism\" album (1992).", "In the booklet it reads: Vocals: Marie Fredriksson / Backing vocals: 45.000 Chilean fans." ] ], "gold": "It Must Have Been Love is a song by the Swedish pop duo Roxette with Marie Fredriksson as the lead vocalist. The original song was released in 1987, which was followed by the most successful incarnation, a slightly edited version, omitting the Christmas references, created for the soundtrack to the 1990 film Pretty Woman. In 2019, English singer Megan McKenna covered It Must Have Been Love as the first winner of The X Factor: Celebrity. Following the announcement that she had won, her version of the song was released on 30 November 2019.", "prediction 1": "\"It Must Have Been Love\" is a song written by Per Gessle and performed by the Swedish pop duo Roxette. The power ballad became the duo's third number one hit in the United States, and is one of their best selling releases, being certified gold or platinum in a number of countries. In 2018, Megan McKenna's debut album, \"Story of Me\", was released. It debuted at number one on the UK iTunes country chart, and rose to number ten on the mainstream UK iTunes chart. In 2019, McKennnnnnnnnnnnnnnnnnnnnnn McKennnnnnnna's debut album, \"Story of Me\", was released.\n", "prediction 2": "It Must Have Been Love is a song written by Per Gessle and performed by the Swedish pop duo Roxette. The power ballad became the duo's third number one hit in the United States, and is one of their best selling releases, being certified gold or platinum in a number of countries. It must have been love is also a song the singer Megan McKenna sings on her solo debut album, Story of Me. She has also appeared in The Only Way Is Essex in 2010 where she auditioned to be part of LOLA, and The X Factor as a member of this song, that remixed version of the 1987 release of Roxette, It must have been love but it's over now.", "prediction 3": "\"It Must Have Been Love\" is a song written by Per Gessle and performed by the Swedish pop duo Roxette. The power ballad became the duo's third number one hit in the United States, and is one of their best selling releases, being certified gold or platinum in a number of countries. In 2017, Megan McKenna launched her music career, releasing her debut EP featuring \"High Heeled Shoes\" and \"Far Cry from Love\". She has also appeared in \"The Only Way Is Essex\" in 2010 where she auditioned to be part of the girl-group LOLA, and auditioned for The X Factor as a country singer. In 2018, McKenna's debut album, \"Story of Me\", was released. It debuted at number one on the UK iTunes country chart, and rose to number 13 on the mainstream UK iTunes chart.", "prediction 4": "\"It Must Have Been Love\" is a song written by Per Gessle and performed by Swedish pop duo Roxette. The power ballad became the duo's third number one hit in the United States, and is one of their best selling releases, being certified gold or platinum in a number of countries. On November 30, 2008, Ryan Tedder and Rob Page re-released the song on their second studio album - The Chase. On 4 January 2012, a Country version was released for the soundtrack to the movie Pretty Woman. The final release came in July 15, 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 70 }, { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 281 }, { "error type": "Irrelevant", "explanation": "", "start": 282, "end": 348 }, { "error type": "Irrelevant", "explanation": "", "start": 349, "end": 472 }, { "error type": "Irrelevant", "explanation": "", "start": 473, "end": 559 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"It Must Have Been Love\" is a song by the Swedish pop duo Roxette with Marie Fredriksson as the lead vocalist. The original song was released in 1987, which was followed by the most successful incarnation, a slightly edited version, omitting the Christmas references, created for the soundtrack to the 1990 film Pretty Woman.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Psychologists who study human behavior in the workplace are called?", "passages": [ [ "Industrial and organizational psychology", "Similarly, the area of team leadership draws heavily from the research in teams and team effectiveness in I/O psychology.", "Because organizational employees are frequently structured in the form of teams, leaders need to be aware of the potential benefits and pitfalls of working in teams, how teams develop, how to satisfy team members' needs, and ultimately how to bring about team effectiveness and performance.", "An emerging area of I/O research in the area of team leadership is in leading virtual teams, where people in the team are geographically-distributed across various distances and sometimes even countries.", "While technological advances have enabled the leadership process to take place in such virtual contexts, they present new challenges for leaders as well, such as the need to use technology to build relationships with followers, and influencing followers when faced with limited (or no) face-to-face interaction.", "I/", "O psychologists are also concerned with organizational change.", "This effort, called organizational development (OD).", "Tools used to advance organization development include the survey feedback technique.", "The technique involves the periodic assessment (with surveys) of employee attitudes and feelings.", "The results are conveyed to organizational stakeholders, who may want to take the organization in a particular direction.", "Another tool is the team building technique.", "Because many if not most tasks within the organization are completed by small groups and/or teams, team building is important to organizational success." ], [ "Industrial and organizational psychology", "Industrial and organizational psychology\n\nIndustrial and organizational psychology (I/O psychology), which is also known as occupational psychology, organizational psychology, and work and organizational psychology, is an applied discipline within psychology.", "I/", "O psychology is the science of human behaviour relating to work and applies psychological theories and principles to organizations and individuals in their places of work as well as the individual's work-life more generally.", "I/O psychologists are trained in the scientist\u2013practitioner model.", "They contribute to an organization's success by improving the performance, motivation, job satisfaction, and occupational safety and health as well as the overall health and well-being of its employees.", "An I/O psychologist conducts research on employee behaviours and attitudes, and how these can be improved through hiring practices, training programs, feedback, and management systems.", "As of 2018, I/O psychology is one of the 16 recognized specialties by the American Psychological Association (APA) in the United States.", "It is represented by Division 14 of the APA, and was formally known as the Society for Industrial and Organizational Psychology (SIOP).", "In the United Kingdom, industrial and organizational psychologists are referred to as occupational psychologists.", "Occupational psychology in the UK is one of nine 'protected titles' within the profession \"practitioner psychologist\" regulated by the Health and Care Professions Council." ] ], "gold": "In order to enhance a team's morale and problem-solving skills, I/O psychologists help groups to build their self-confidence, group cohesiveness, and working effectiveness. In the United Kingdom, industrial and organizational psychologists are referred to as occupational psychologists. Work and organizational psychologists are also alternative names that are used. ", "prediction 1": "Industrial and organizational psychology, also known as occupational psychology, organizational psychology, and work and organizational psychology, is an applied discipline within psychology. I/ O psychology is the science of human behaviour relating to work and applies psychological theories and principles to organizations and individuals in their places of work as well as the individual's work-life more generally. In the United Kingdom, industrial and organizational psychologists are referred to as occupational psychologists.\n", "prediction 2": "Industrial and organizational psychology, or I/O psychology, is a discipline within psychology that studies human behavior in the workplace. I/O psychologists conduct research on employee behaviours and attitudes, and how these can be improved through hiring practices, training programs, feedback, and management systems. A workplace psychologist is a clinical psychologist who conducts managerial or organizational research. A workplace psychologist's job is to study human behaviour in the workplace.", "prediction 3": "Industrial and organizational psychology, also known as occupational psychology, organizational psychology, and work and organizational psychology, is an applied discipline within psychology. As of 2018, I/O psychology is one of the 16 recognized specialities by the American Psychological Association (APA) in the United States. I/O psychologists conduct research on employee behaviours and attitudes, and how these can be improved through hiring practices, training programs, feedback, and management systems.", "prediction 4": "Industrial and organizational psychology (I/O psychology), which is also known as occupational psychology, organizational psychology, and work and organizational psychology, is an applied discipline within psychology. I/ O psychology applies psychological theories and principles to organizations and individuals in their places of work as well as the individual's work-life more generally. For example, in the United Kingdom, industrial and organizational psychologists are referred to as occupational psychologists.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 192, "end": 419 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Industrial and organizational psychology, also known as occupational psychology, organizational psychology and work, is an applied discipline within psychology. An I/O psychologist conducts research on employee behaviours and attitudes, and how these can be improved through hiring practices, training programs, feedback, and management systems. In the United Kingdom, industrial and organizational psychologists are referred to as occupational psychologists.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is erin reagan's boss on blue bloods?", "passages": [ [ "Kelly Kapoor", "Later, in \"The Duel,\" after Angela remarks of her delight that two men are fighting over her, Kelly responds, \"I guess people have fewer choices as they get older.\"", "In \"Lecture Circuit Part 1\" Dwight finds out from her personal record that she was in juvenile hall for almost two years, the reason being that she stole her boyfriend's dad's boat after he broke up with her.", "In Blood Drive, when she notices how upset Michael is, she sits with him, until it is closing time.", "When Michael quits his job, Kelly shows interest in her new boss, Charles, as does Angela.", "Kelly quickly befriends the new receptionist, Erin.", "As of the beginning of season six, she is once again dating Ryan.", "In the season 7 premiere \"Nepotism,\" Kelly is encouraged by Dwight to attend the minority executive training program from Yale.", "Dwight originally encouraged her in hopes to become her svengali but later regrets his decision.", "In \"Counseling,\" Kelly is the one who comes up with the idea that Dwight should Pretty Woman the Steamtown Mall, but when Jim says that it is a good idea, she does not remember what she said.", "In a talking-head interview, she admits to the camera that she knows she talks a lot, so she's learned to tune herself out." ], [ "Bobby Cannavale", "Bobby Cannavale\n\nRobert Cannavale (; born May 3, 1970) is an American actor known for various film, television, and stage roles, including starring roles in \"Third Watch\", \"Boardwalk Empire\", \"Vinyl\", \"Will & Grace\", and \"Mr. Robot\".", "Cannavale had a recurring role on the NBC comedy series \"Will & Grace\" as Will Truman's long-term boyfriend Officer Vincent \"Vince\" D'Angelo, for which he won the 2005 Primetime Emmy Award for Outstanding Guest Actor in a Comedy Series; and portrayed Gyp Rosetti during the third season of the HBO drama series \"Boardwalk Empire\", for which he won the 2013 Primetime Emmy Award for Outstanding Supporting Actor in a Drama Series.", "In 2016, he starred in the HBO drama series \"Vinyl\", produced by Martin Scorsese and Mick Jagger.", "In 2017, he joined the cast of the USA Network drama series \"Mr. Robot\" during its third season.", "For his roles in \"Mauritius\" and \"The Motherfucker with the Hat\", Cannavale was nominated for the Tony Award for Best Featured Actor in a Play and the Tony Award for Best Actor in a Play, respectively.", "He has appeared in \"The Station Agent\" (2003), \"Shall We Dance?\"" ], [ "Blue Bloods (TV series)", "Blue Bloods (TV series)\n\nBlue Bloods is an American police procedural fictional drama series that airs on CBS.", "The series is filmed on location in New York City with occasional references to nearby suburbs.", "The series debuted on September 24, 2010, with episodes airing on Fridays following \"\" before being moved to Wednesdays at 10:00\u00a0p.m. Eastern and Pacific time and 9:00\u00a0p.m.", "Central and Mountain time for a four-week tryout.", "After four weeks, it returned to its original Friday 10:00\u00a0p.m.", "Eastern time slot, where it has remained since.", "On April 18, 2018, CBS renewed the series for a ninth season, which premiered on September 28, 2018.", "The series follows the Reagan family of police officers with the New York City Police Department (NYPD).", "Francis Xavier \"Frank\" Reagan is the Police Commissioner.", "Frank's oldest son Danny is an NYPD detective, his youngest son Jamie is an NYPD police officer (later sergeant), and his daughter Erin is an assistant district attorney.", "Frank's second-oldest son Joe was murdered by a crooked cop in the line of duty in events that pre-date the series, when he was involved with the Federal Bureau of Investigation (FBI) investigating a group of corrupt NYPD cops known as the Blue Templar." ] ], "gold": "The character who is Erin Reagan's boss on the CBS television series Blue Bloods is District Attorney Charles Rosselini, who is played by American actor Robert Michael Cannavale.", "prediction 1": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. The character of Erin Reagan's boss is Charles Reagan, played by Bobby Cannavale.\n", "prediction 2": "Blue Bloods is an American police procedural romantic drama series that airs on CBS. When Gina is a fugitive from the NYPD, her boss is Deputy District Attorney Arcen Ross, played by Nick Hand.", "prediction 3": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. As of season six, her boss is officer Charles Norman, who is a harried and abusive ex-cop who loses his job in the no-name case. Robert Cannavale played Charles as a teen with a disability whose parents later end up committing suicide because they believed their ex-husband was there to help him.", "prediction 4": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. The character of Erin Reagan was previously bossed by Robin Klein, but her role as a recurring character changed when her old boss, Richard Carter, left the job. Dickie Allen played the role of Kelly's father Della Reagan until his death in 2010. Robert Kanavale played the role of Peter Kennedy's wife, Amy. Cyrus J. Gallagher played Charles Kennedy's father. Kelly is Erin's aunt. Robert Cannavale played her new boss.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 86, "end": 168 } ], "missing-info": [], "corrected-prediction": "Blue Bloods is an American police procedural fictional drama series that airs on CBS. \n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What is the most northerly town in the world?", "passages": [ [ "Svalbard", "Svalbard\n\nSvalbard (; ; prior to 1925 known by its Dutch name Spitsbergen) is a Norwegian archipelago in the Arctic Ocean.", "Situated north of mainland Europe, it is about midway between continental Norway and the North Pole.", "The islands of the group range from 74\u00b0 to 81\u00b0 north latitude, and from 10\u00b0 to 35\u00b0 east longitude.", "The largest island is Spitsbergen, followed by Nordaustlandet and Edge\u00f8ya.", "Administratively, the archipelago is not part of any Norwegian county, but forms an unincorporated area administered by a governor appointed by the Norwegian government.", "Since 2002, Svalbard's main settlement, Longyearbyen, has had an elected local government, somewhat similar to mainland municipalities.", "Other settlements include the Russian mining community of Barentsburg, the research station of Ny-\u00c5lesund, and the mining outpost of Sveagruva.", "Ny-\u00c5lesund is the northernmost settlement in the world with a permanent civilian population.", "Other settlements are farther north, but are populated only by rotating groups of researchers.", "The islands were first taken into use as a whaling base in the 17th and 18th centuries, after which they were abandoned.", "Coal mining started at the beginning of the 20th century, and several permanent communities were established." ] ], "gold": "There are a few most northernmost places in the world. The northernmost inhabited place in the world is Camp Barneo, Arctic Ocean Ice Sheet. The most northerly place with a permanent population is in Alert, Ellesmere Island, Nunavut. The most northerly functional civilian settlement is in Ny-\u00c5lesund, Svalbard. ", "prediction 1": "The most northerly town in the world is Ny-lesund, located in the Swedish archipelago of Svalbard in the Arctic Ocean.\n", "prediction 2": "Polar town in the Arctic Ocean, the most northerly town in the world, has a population of 15,602 and is situated in the Norwegian archipelago of Svalbard, about midway between continental Norway and the North Pole.", "prediction 3": "The most northerly town in the world is lesund, located in country Norway.", "prediction 4": "The most northerly town in the world with a permanent civilian population is Ny-lesund, located in Norway's Arctic Archipelago. Needles is the northernmost permanent civilian settlement in the world with a permanent civilian population.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 119 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Ny-\u00c5lesund is the northernmost settlement in the world with a permanent civilian population.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who owns the biltmore estate in north carolina?", "passages": [ [ "Biltmore Estate", "Biltmore Estate\n\nBiltmore Estate is a large (6950.4 acres or 10.86 square miles or 28.13 square kilometers)", "[also noted as 5,000 acres and 8,000 acres elsewhere on this page] private estate and tourist attraction in Asheville, North Carolina.", "Biltmore House, the main residence, is a Ch\u00e2teauesque-style mansion built by George Washington Vanderbilt II between 1889 and 1895 and is the largest privately owned house in the United States, at of floor space ( of living area).", "Still owned by George Vanderbilt's descendants, it remains one of the most prominent examples of the Gilded Age.", "In the 1880s, at the height of the Gilded Age, George Washington Vanderbilt II, youngest son of William Henry Vanderbilt, began to make regular visits with his mother, Maria Louisa Kissam Vanderbilt (1821\u20131896), to the Asheville, North Carolina, area.", "He loved the scenery and climate so much that he decided to create his own summer estate in the area, which he called his \"little mountain escape\", just as his older brothers and sisters had built opulent summer houses in places such as Newport, Rhode Island, and Hyde Park, New York." ], [ "William Amherst Vanderbilt Cecil", "Cecil\u2019s widow, Mary Lee Ryan, was a first cousin of First Lady of the United States Jacqueline Kennedy Onassis, as their mothers, Janet Norton Lee and Marion Merritt Lee, were sisters.", "Cecil\u2019s son, Bill Cecil Jr., serves as President and CEO of The Biltmore Company today.", "His daughter-in-law, Virginia Cecil, oversees the equestrian center at the estate and is on the Biltmore board of directors.", "Cecil died at home in his native Asheville, North Carolina, on October 31, 2017, aged 89, just 2 weeks before his wife died.", "He is survived by his two children: William A.V. Cecil Jr. and Diana (n\u00e9e Cecil) Pickering." ] ], "gold": "Biltmore Estate in Asheville, North Carolina, was originally owned by George Washington Vanderbilt II from 1889 to 1895. The Gilded Age mansion on the property is the largest privately owned house in the United States and remains a tourist attraction today. The estate is currently owned by descendants of George Vanderbilt in the form of the Biltmore Company, run by siblings Dini Pickering and Bill Cecil Jr.", "prediction 1": "Biltmore Estate is a large private estate and tourist attraction in Asheville, North Carolina, that is still owned by George Vanderbilt's descendants. It is the largest privately owned house in the United States, at of floor space ( of living area). It is also one of the most prominent examples of the Gilded Age.\n", "prediction 2": "Biltmore Estate is a large private estate and tourist attraction in Asheville, North Carolina, that was once owned by William Henry Vanderbilt III and his family. It is currently owned by his descendents, George Washington Vanderbilt II, whose widow, Mary Lee Ryan, was a first cousin of First Lady of the United States Jacqueline Kennedy Onassis. William Amherst Vanderbilt Cecil III is the fourth generation owner of Biltmore Estate.", "prediction 3": "Biltmore Estate is a private estate and tourist attraction in Asheville, North Carolina, and is owned by the line of Vanderbilt family descendants of William Henry Vanderbilt, Jr. and Percy \"Chuck\" Vanderbilt.", "prediction 4": "Biltmore Estate, part of the Biltmore Company, is the largest privately owned house in the United States, at of floor space. It is owned by George Washington Vanderbilt II, the youngest son of William Henry Vanderbilt, who built the estate in Asheville, North Carolina. His widow, Mary Lee Ryan, was a first cousin of First Lady Jacqueline Kennedy Onassis, as their mothers, Janet Norton Lee and Marion Merritt Lee, were sisters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 205, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 286 } ], "missing-info": [], "corrected-prediction": "Biltmore Estate is a large private estate and tourist attraction in Asheville, North Carolina, that is still owned by George Vanderbilt's descendants. It is the largest privately owned house in the United States. It is also one of the examples of the Gilded Age.\n" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who sings the song never tear us apart?", "passages": [ [ "Never Tear Us Apart", "Never Tear Us Apart\n\n\"Never Tear Us Apart\" is a single released by Australian rock group INXS in August 1988.", "It was included on the band's sixth studio album, \"Kick\".", "The music was written by keyboardist Andrew Farriss, who recorded a blues-style demo; vocalist Michael Hutchence wrote the lyrics.", "\"Never Tear Us Apart\" is a sensuous ballad, written in the tempo of a modern Viennese waltz, layered with synthesizers and containing dramatic pauses before the instrumental breaks.", "Kirk Pengilly lends a cathartic saxophone solo near the end.", "According to the liner notes of \"\", the song was composed on piano as a bluesy number in the style of Fats Domino.", "Producer Chris Thomas suggested a synth-based arrangement instead.", "The video for the song, featuring an extended intro, was filmed in various locations in Prague along with \"Guns in the Sky\" and \"New Sensation\", all directed by Richard Lowenstein.", "The single reached #24 in the UK, and stayed on the charts for seven weeks.", "In the U.S., it reached #7 on the \"Billboard\" Hot 100." ], [ "Never Tear Us Apart", "She commented \"I have always loved this song and I feel honoured to sing it.\"", "\"Never Tear Us Apart\" was released as the first single from the reissued version of Faith's second studio album \"Fall to Grace\" and serves as the third single overall.", "The artwork for the song shows the singer saluting, while wearing a metallic gold dress, with \"a honeycomb-like bottom half\".", "Faith's version of the song can be heard on the opening scene of \"\" fifteenth season episode \"Beast's Obsession.\"", "Digital Spy's Lewis Corner gave Faith's version of the song four out of five stars.", "He stated \"It's a brave task to reinterpret a much-loved hit, but Faith's soulful tones immediately thwart any doubts that she can't do the song justice.\"", "He added that while it was always going to be tough topping the original, Faith comes \"admirably close.\"" ], [ "Never Tear Us Apart", "After his death in 1997, Michael Hutchence's coffin was carried out of St. Andrews Cathedral by the remaining members of INXS and younger brother Rhett as \"Never Tear Us Apart\" was played in the background.", "In February 2014, after the Channel 7 screening of \"\" mini-series, \"Never Tear Us Apart\" charted again in Australia via download sales.", "It peaked at #11 on the ARIA Singles Chart, surpassing its original peak position of #14 back in 1988.", "The song was covered by Tom Jones for his 1999 album \"Reload\" featuring the Australian singer Natalie Imbruglia.", "The cover version also includes a music video.", "CD single\n\nIn 2001, a remix called \"Precious Heart\" was released as a single, and credited as Tall Paul vs. INXS.", "Australian CD single\n\nUK CD single\n\n\n\"Never Tear Us Apart\" was re", "-recorded by INXS with Ben Harper for their twelfth studio album, \"Original Sin\".", "The song has been released on iTunes and as a promotional single to radio stations prior to the release of the new album.", "Ben Harper has been known to perform \"Never Tear Us Apart\" at his concerts since 2009, especially when in Australia.", "He revealed in an interview on Australia's Nova FM on 2 August 2010, \"At this point, I've lived that song." ], [ "Never Tear Us Apart", "I've lived enough years and gone through enough in my life to have earned the right to sing that song.\"", "On Sydney's Triple M, he stated \"covering 'Never Tear Us Apart' is like covering 'Dock of the Bay'.", "I'm not here to make grandiose over-statements - it's just a fuckin' fact.", "That's one of the greatest soul songs ever written.\"", "On 1 August 2010, the song was made available on INXS.com (a playable version only, not available for download).", "The audio version was accompanied by a YouTube video of Ben Harper performing the song with Jon Farriss at the \"Splendour in the Grass\" festival at Woodford, Queensland, Australia, filmed on 30 July 2010.", "The song was released on iTunes on 12 August 2010.", "INXS re-recorded \"Never Tear Us Apart\" with Ben Harper and French singer Myl\u00e8ne Farmer who wrote new French lyrics for this new version.", "The song was to be the first single from the 2010 INXS album in November in France and Belgium.", "\"Never Tear Us Apart\" was recorded by British singer Paloma Faith for a television advertisement campaign for John Lewis.", "The advert began airing in the UK from 15 September 2012.", "Faith later confirmed that the song would be released as her next single on 23 September 2012." ] ], "gold": "Never Tear Us Apart is a single released by Australian rock group INXS in August 1988. It was included on the band's sixth studio album, Kick. Never Tear Us Apart was re-recorded by INXS with Ben Harper for their twelfth studio album, Original Sin. The song has been released on iTunes in 2010 prior to the release of the new album. Never Tear Us Apart was recorded by British singer Paloma Faith for a television advertisement campaign for John Lewis. The advert began airing in the UK from 15 September 2012.", "prediction 1": "\"Never Tear Us Apart\" is a song by Australian rock group INXS, released in August 1988. The song was included on the band's sixth studio album, Kick. In August 2010, the song was made available on INXS.com, a playable version only, not available for download. In February 2014, after the Channel 7 screening of \"Beast's Obsession,\" \"Never Tear Us Apart\" charted again in Australia via download sales. The song was covered by Tom Jones for his 1999 album Reload, featuring the Australian singer Natalie Imbruglia. In January 2015, a remix called \"Precious Heart\" was released as a single.\n", "prediction 2": "\"Never Tear Us Apart\" is a song by Australian rock band INXS, featuring songs by Michael Hutchence, Kris Kristofferson, and Tom Jones. The song was originally recorded with Michael Hutchence in 1988 and was initially released as a single by the band on their sixth studio album, Kick. In 2010, the song was made available on the website, with a playable version available only. In 2011, the song became an international sensation and was covered by Paul Simon and Chaka Khan for their self-titled Original Sin. In 2012, the song was recorded by INXS with Ben Harper, who has been accompanied by a YouTube video of Jon Farris performing the song with Jon Farris at the \"Splendour in theGras\" celebration of their 12th studio album, One. Major Love, Hierdecator Stylish Lady in Performance.", "prediction 3": "Various artists have sang the song, Never Tear Us Apart, including INXS with Jon Farriss, David LeVine, Ahn Ah Ahn, Lee Pleasant, and opened for Vince Gill. In 2002, the song was released as a single by Widespread Panic, and in 2007, the pop group Mother Love. Anthology series Your Biography first released in 2010 featured Breathe Fire, Boys & Girls, Lost Highway, Riverdance, and more.", "prediction 4": "\"Never Tear Us Apart\" is a song by Australian rock band INXS, which was released on August 8, 1988. The song was covered by Tom Jones for his 1999 album Reload, featuring the Australian singer Natalie Imbruglia. In 2010, the stoner trio INXS, who had previously released a song as a single in 1988, included a cover of the song during their tour in support of its 12th studio album, Original Sin. In 2019, the group released a remix of Never Tear Us Apart called \"Precious Heart,\" a single.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 150, "end": 259 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 400 }, { "error type": "Irrelevant", "explanation": "", "start": 513, "end": 588 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 10 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 11 ] } ], "corrected-prediction": "\"Never Tear Us Apart\" is a song by Australian rock group INXS, released in August 1988. It was included on the band's sixth studio album, Kick. The song was covered by Tom Jones for his 1999 album Reload, featuring the Australian singer Natalie Imbruglia. \"Never Tear Us Apart\" was re-recorded by INXS with Ben Harper for their twelfth studio album, \"Original Sin\". The song has been released on iTunes prior to the release of the new album. \"Never Tear Us Apart\" was recorded by British singer Paloma Faith for a television advertisement campaign for John Lewis. The advert began airing in the UK from 15 September 2012." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When did the cross become a symbol of christianity?", "passages": [ [ "Christian cross", "John Pearson, Bishop of Chester (c. 1660) wrote in his commentary on the Apostles' Creed that the Greek word \"stauros\" originally signified \"a straight standing Stake, Pale, or Palisador\", but that, \"when other transverse or prominent parts were added in a perfect Cross, it retained still the Original Name\", and he declared: \"The Form then of the Cross on which our Saviour suffered was not a simple, but a compounded, Figure, according to the Custom of the \"Romans\", by whose Procurator he was condemned to die.", "In which there was not only a straight and erected piece of Wood fixed in the Earth, but also a transverse Beam fastned unto that towards the top thereof\".", "There are few extant examples of the cross in 2nd century Christian iconography.", "It has been argued that Christians were reluctant to use it as it depicts a purposely painful and gruesome method of public execution.", "A symbol similar to the cross, the staurogram, was used to abbreviate the Greek word for \"cross\" in very early New Testament manuscripts such as P66, P45 and P75, almost like a \"nomen sacrum\" (nomina sacra).", "The extensive adoption of the cross as Christian iconographic symbol arose from the 4th century." ], [ "Early Christian descriptions of the execution cross", "The oldest extant depiction of the execution of Jesus in any medium seems to be the second-century or early third-century relief on a jasper gemstone meant for use as an amulet, which is now in the British Museum in London.", "It portrays a naked bearded man whose arms are tied at the wrists by short strips to the transom of a T-shaped cross.", "An inscription in Greek on the obverse contains an invocation of the redeeming crucified Christ.", "On the reverse a later inscription by a different hand combines magical formulae with Christian terms.", "The catalogue of a 2007 exhibition says: \"The appearance of the Crucifixion on a gem of such an early date suggests that pictures of the subject (now lost) may have been widespread even in the late second or early third century, most likely in conventional Christian contexts\".", "Better known is the Alexamenos graffito, discovered during excavation of the Paedagogium on Rome's Palatine Hill in 1857.", "Dated to the start of the third century, it portrays a humanoid with the head of a donkey (Christ or Anubis?) on a cross and includes an inscription in Greek.", "Another graffito, known as the Pozzuoli graffito, discovered in 1959, and dated by some to the first century, by others to the beginning of the second." ], [ "Christian symbolism", "Christian symbolism\n\nChristian symbolism is the use of symbols, including archetypes, acts, artwork or events, by Christianity.", "It invests objects or actions with an inner meaning expressing Christian ideas.", "The symbolism of the early Church was characterized by being understood by initiates only, while after the legalization of Christianity in the 4th-century more recognizable symbols entered in use.", "Christianity has borrowed from the common stock of significant symbols known to most periods and to all regions of the world.", "Christianity has not generally practiced Aniconism, or the avoidance or prohibition of types of images, even if the early Jewish Christians sects, as well as some modern denominations, preferred to some extent not to use figures in their symbols, by invoking the Decalogue's prohibition of idolatry.", "The shape of the cross, as represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity by the 2nd century.", "At the end of the 2nd century, it is mentioned in the \"Octavius\" of Minucius Felix, rejecting the claim by detractors that Christians worship the cross." ] ], "gold": "The extensive adoption of the cross as a Christian iconographic symbol started in the 4th century. However, the shape of the cross, as represented by the letter T, came to be used as a symbol of Early Christianity by the 2nd century. In the 2nd century, however, there are few extant examples of the cross in Christian iconography. It has been argued that Christians were reluctant to use the cross as it depicts a purposely painful and gruesome method of public execution. The oldest extant depiction of the execution of Jesus in any medium seems to be the second-century or early third-century relief on a jasper gemstone meant for use as an amulet, which is now in the British Museum in London.", "prediction 1": "The shape of the cross, as represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity by the 2nd century. The extensive adoption of the cross as Christian iconographic symbol arose from the 4th century.\n", "prediction 2": "The cross, as represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity from the second century. The extensive adoption of the cross as a Christian iconographic symbol arose from the fourth century.", "prediction 3": "The cross became a symbol of Christianity as early as the second century. The extensive adoption of the cross as Christian iconographic symbol arose from the 4th century. The shape of the cross, as represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity by the second century.", "prediction 4": "The shape of the cross, represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity by the 2nd century. The extensive adoption of the cross as Christian iconographic symbol arose from the 4th century.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The shape of the cross, as represented by the letter T, came to be used as a \"seal\" or symbol of Early Christianity by the 2nd century. The extensive adoption of the cross as Christian iconographic symbol arose from the 4th century. In the 2nd century, however, there are few extant examples of the cross in Christian iconography. It has been argued that Christians were reluctant to use the cross as it depicts a purposely painful and gruesome method of public execution. The oldest extant depiction of the execution of Jesus in any medium seems to be the second-century or early third-century relief on a jasper gemstone meant for use as an amulet, which is now in the British Museum in London.\n" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Who won wimbledon in the women's division?", "passages": [ [ "Williams sisters", "Williams sisters\n\nThe Williams sisters are two professional American tennis players: Venus Williams (b. 1980), a seven-time Grand Slam title winner (singles), and Serena Williams (b. 1981), twenty-three-time Grand Slam title winner (singles), both of whom were coached from an early age by their parents Richard Williams and Oracene Price.", "There is a noted professional rivalry between them\u2014between the 2001 US Open and the 2017 Australian Open tournaments\u2014they met in nine Grand Slam singles finals.", "They became the first two players, female or male, to play in four consecutive Grand Slam singles finals from the 2002 French Open to the 2003 Australian Open; Serena famously won all four to complete the first of two \"Serena Slams\".", "Between 2000 and 2016, a 17-year span, they collectively won 12 Wimbledon singles titles (Venus won five, and Serena won seven).", "By winning the 2001 Australian Open women's doubles title, they became the fifth pair to complete the Career Doubles Grand Slam and the only pair to complete the Career Doubles Golden Slam.", "At the time, Venus and Serena were only 20 and 19 years old, respectively.", "Since then, they have gone on to add another two Olympic gold medals in the 2008 Beijing Olympics and the 2012 London Olympics." ], [ "Williams sisters", "But I don't care if they fine me a million dollars, I will not play there again.", "However, on February 3, 2015, Serena Williams wrote an exclusive column for TIME magazine stating her intentions to return to Indian Wells for a tournament on March 9, 2015.", "She did indeed return and won her opening match.", "Williams withdrew before her semi-final match with Simona Halep because of a knee injury.", "The WTA announced on January 27, 2016 that Venus would return to Indian Wells for the first time in 15 years." ], [ "Sania Mirza career statistics", "Sania Mirza career statistics\n\nThis is a list of the main career statistics of Indian professional tennis player Sania Mirza.", "\"To prevent confusion and double counting, information in this table is updated only once a tournament or the player's participation in the tournament has concluded.", "Sania Mirza and Martina Hingis joined forces during March 2015.", "They saw immediate success winning first three tournaments together.", "Sania Mirza and Martina Hingis were chasing the longest winning streak since 1990 at 44 match wins set by Jana Novotna and Helena Sukova but fell 3 matches short.", "Sania Mirza had changed lot of partnerships before stopping singles play but once becoming a doubles specialist she became cautious and kept long partnerships in both Women's and Mixed doubles.", "Martina Hingis is the 70th women's doubles partner of Sania's career.", "Sania has also teamed with 14 players in Grandslam Mixed Doubles.", "She's currently playing Mixed Doubles with Ivan Dodig of Croatia." ], [ "Martina Navratilova", "She reached the Wimbledon singles final 12 times, including for nine consecutive years from 1982 through 1990, and won the women's singles title at Wimbledon a record nine times (surpassing Helen Wills Moody's eight Wimbledon titles), including a run of six consecutive titles, widely regarded as the best performance by any professional player at a major event.", "She and Billie Jean King each won 20 combined Wimbledon titles, an all-time record.", "Navratilova is also one of just three women ever to have accomplished a Career Grand Slam in women's singles and doubles, and mixed doubles (called the Grand Slam \"boxed set\"), a distinction she shares only with Margaret Court and Doris Hart.", "Navratilova holds the records for most singles (167) and doubles titles (177) in the Open Era.", "Her record as No. 1 in singles (1982\u201386) remains the most dominant in professional tennis to date.", "Over five consecutive seasons, she won 428 out of 442 singles matches, averaging fewer than three losses per year to 87 wins, for a sustained winning percentage of 96.8%.", "She holds the best season win-loss record in the open era, 86-1 (98.9%) in 1983, and four out of the top six open era seasons." ], [ "Elizabeth Ryan", "Elizabeth Ryan\n\nElizabeth Montague Ryan (February 5, 1892 \u2013 July 6, 1979) was an American tennis player who was born in Anaheim, California but lived most of her life in the United Kingdom.", "Ryan won 26 Grand Slam titles.", "Nineteen of those titles were in women's doubles and mixed doubles at Wimbledon, an all-time record for those two events.", "Twelve of her Wimbledon titles were in women's doubles and seven were in mixed doubles.", "Ryan also won four women's doubles titles at the French Championships, as well as one women's doubles title and two mixed doubles titles at the U.S. Championships.", "Although she reached the Wimbledon singles finals twice, Ryan never won the title.", "Eight of her losses at Wimbledon were to players generally considered to be among the best ever.", "Ryan had to play Dorothea Lambert Chambers in the all-comers final of 1920; Suzanne Lenglen in the 1919 semifinals (losing 6\u20134, 7\u20135), 1921 final, 1922 quarterfinals, 1924 quarterfinals (losing 6\u20132, 6\u20138, 6\u20134), and 1925 second round; and Helen Wills Moody in the 1928 semifinals and 1930 final." ], [ "2015 Wimbledon Championships \u2013 Women's Doubles", "2015 Wimbledon Championships \u2013 Women's Doubles\n\nSara Errani and Roberta Vinci were the defending champions, but Errani chose not to participate this year.", "Vinci played alongside Karin Knapp, but lost in the third round to Casey Dellacqua and Yaroslava Shvedova.", "Top seeds Martina Hingis and Sania Mirza won the title, defeating Ekaterina Makarova and Elena Vesnina 5\u20137, 7\u20136, 7\u20135 in the final.", "Mirza became the first ever Indian to win a women's doubles major; while Hingis won her 10th title in the category and her first since the 2002 Australian Open." ], [ "2017 Wimbledon Championships \u2013 Women's Singles", "2017 Wimbledon Championships \u2013 Women's Singles\n\nSerena Williams was the two-time defending champion, but did not participate this year due to .", "Garbi\u00f1e Muguruza won her second Grand Slam singles title, defeating Venus Williams in the final, 7\u20135, 6\u20130.", "Muguruza became the second Spanish woman to win Wimbledon after Conchita Mart\u00ednez in 1994.", "Muguruza also became the first player to defeat both Williams sisters in Grand Slam singles finals.", "Williams was the oldest player to reach the final since Martina Navratilova, also in 1994, and played her 100th singles match at Wimbledon when she defeated reigning French Open champion Je\u013cena Ostapenko in the quarterfinals; it was Williams\u2019 first Grand Slam final at Wimbledon since 2009, her first Grand Slam final against a player other than her sister since defeating Marion Bartoli in the 2007 Wimbledon final, and (by virtue of her run to the Australian Open final in January)", "marked the first time Venus reached multiple Grand Slam finals in a calendar year since 2003.", "Johanna Konta became the first British woman to reach the semifinals since Virginia Wade in 1978, and Magdal\u00e9na Ryb\u00e1rikov\u00e1 became the first Slovak woman to reach the semifinals at Wimbledon.", "The tournament was the seventeenth consecutive women's singles Grand Slam event to feature a first-time semifinalist (Ryb\u00e1rikov\u00e1)." ] ], "gold": "In 2017, Garbi\u00f1e Muguruza won the Women's Singles division at Wimbledon while Ekaterina Makarova and Elena Vesnina won the Women's Doubles division. In 2016, Serena Williams won the Women's Singles division at Wimbledon while the Williams sisters won the Women's Doubles division. In 2015, Serena Williams won the Women's Singles division at Wimbledon while Sania Mirza and Martina Hingis won the Women's Doubles division. Martina Navratilova holds the record for the most career Women's Singles division titles won at Wimbledon with nine. Elizabeth Ryan holds the record for the most career Women's Doubles division titles won at Wimbledon with twelve. ", "prediction 1": "There are several women who have won Wimbledon in the women's division. In the women's singles division, Caroline Wozniacki won Wimbledon in the women's division, Martina Navratilova won Wimbledon in the women's division, and Elizabeth Ryan won Wimbledon in the women's division. In the women's doubles division, Sania Mirza won Wimbledon in the women's division, and Venus Williams won Wimbledon in the women's division.\n", "prediction 2": "The women's division at Wimbledon has had several successful women's champions, including Venus Williams in 2000, and Serena Williams in 2015. Before that, both Venus and Serena were published in the New England Journal of Medicine, and Venus won the Wimbledon Women's Singles title in Wimbledon in 2000.Venus Williams was also the first woman to win Wimbledon in the women's division at Wimbledon. Martina Navratilova recorded her first major title at Wimbledon in 2013, and Elizabeth Ryan won the Wimbledon Women's Doubles title in 2014.", "prediction 3": "The Olympic gold medal winning tennis players that won Wimbledon in the women's division are Venus Williams, who won the tournament in 2000, and Serena Williams in 2016, who won the tournament in 2017, and Martina Navratilova who led the tournament in 2018. The American tennis player who won Wimbledon in the mixed doubles division is Elizabeth Ryan, who won the mixed doubles event in 2018.", "prediction 4": "In 2011, Susana Hantuchova won Wimbledon in the women's division. In 2012, Martina Navratilova won Wimbledon in the women's division. In 2013, Maria Sharapova won Wimbledon in the women's division.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "There are several women who have won Wimbledon in the women's division.", "start": 124, "end": 162 }, { "error type": "Redundant", "explanation": "There are several women who have won Wimbledon in the women's division. ", "start": 183, "end": 221 }, { "error type": "Redundant", "explanation": "There are several women who have won Wimbledon in the women's division. ", "start": 325, "end": 363 }, { "error type": "Redundant", "explanation": "There are several women who have won Wimbledon in the women's division. ", "start": 383, "end": 422 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[3,6]}", "start": 226, "end": 279 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 7, "sentence_id": [ 1, 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 6, "sentence_id": [ 1, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 6, "sentence_id": [ 1 ] } ], "corrected-prediction": "There are several women who have won Wimbledon in the women's division. In the women's singles division winners include: Caroline Wozniacki, Martina Navratilova, Sania Mirza, Venus Williams, Garbi\u00f1e Muguruza in 2017, Serena Williams, Helen Wills Moody, and Billie Jean King. Martina Navratilova holds the record for the most career Women's Singles division titles won at Wimbledon with nine. In the women's doubles division winners include: Sania Mirza and Martina Hingis, Elizabeth Ryan, and Sara Errani and Roberta Vinci.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the first episode of dragon ball air?", "passages": [ [ "Dragon Ball", "Dragon Ball\n\n, sometimes styled as \"Dragonball\", is a Japanese media franchise created by Akira Toriyama in 1984.", "The initial manga, written and illustrated by Toriyama, was serialized in \"Weekly Sh\u014dnen Jump\" from 1984 to 1995, with the 519 individual chapters collected into 42 \"tank\u014dbon\" volumes by its publisher Shueisha.", "\"Dragon Ball\" was initially inspired by the classical Chinese novel \"Journey to the West\".", "The series follows the adventures of the protagonist, Son Goku, from his childhood through adulthood as he trains in martial arts and explores the world in search of the seven orbs known as the Dragon Balls, which summon a wish-granting dragon when gathered.", "Along his journey, Goku makes several friends and battles a wide variety of villains, many of whom also seek the Dragon Balls.", "Toriyama's manga was adapted and divided into two anime series produced by Toei Animation: \"Dragon Ball\" and \"Dragon Ball Z\", which together were broadcast in Japan from 1986 to 1996.", "Additionally, the studio has developed 19 animated feature films and three television specials, as well as two anime sequel series titled \"Dragon Ball GT\" (1996\u20131997) and \"Dragon Ball Super\" (2015\u20132018)." ], [ "Dragon Ball", "\"Dragon Ball GT\" and \"Dragon Ball Heroes\" are not originated from any direct source material from Toriyama, being fully created by their respective animation studios.", "\"Dragon Ball Super\" was released parallel to (and many times ahead of) the manga of the same name, due to the fact that they were both based on the same outline by Toriyama for the story of \"Super\".", "Toei Animation produced an anime television series based on the first 194 manga chapters, also titled \"Dragon Ball\".", "The series premiered in Japan on Fuji Television on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes.", "Instead of continuing the anime as \"Dragon Ball\", Toei Animation decided to carry on with their adaptation under a new name and asked Akira Toriyama to come up with the title.", "picks up five years after the first series left off and adapts the final 325 chapters of the manga.", "It premiered in Japan on Fuji Television on April 26, 1989, taking over its predecessor's time slot, and ran for 291 episodes until its conclusion on January 31, 1996.", "Two television specials based on the \"Z\" series were aired on Fuji TV in Japan.", "The first, \"The One True Final Battle ~The Z Warrior Who Challenged Freeza -- Son Goku's Father~\", renamed \"\" by Funimation, was shown on October 17, 1990." ] ], "gold": "Dragon Ball is a Japanese anime television series produced by Toei Animation. It is an adaptation of the first 194 chapters of the manga of the same name created by Akira Toriyama, which were published in Weekly Sh\u014dnen Jump from 1984 to 1995. The first episode aired in Japanese on February 26, 1986 and in English on September 9, 1995.", "prediction 1": "The Japanese manga series Dragon Ball was created by Akira Toriyama in 1984. The first episode of the series aired in Japan on April 26, 1989. The first episode of the series aired in the United States on April 19, 1989.\n", "prediction 2": "The Japanese manga series Dragon Ball, written and illustrated by Akira Toriyama, was serialized in the monthly Shnen Jump magazine from 1984 to 1995. The first television special of the series was aired on Fuji TV on March 24, 1992, and in English it was titled \"The First Power of the Dragon Ball\". The first episode of the 152nd special and of the third special, \"The First Power of the Dragon Ball\", aired on March 16, 2003.", "prediction 3": "The series Dragon Ball is a Japanese manga written and illustrated by Akira Toriyama. The series was serialized in Weekly Shnen Jump from 1984 to 1995, with the 519 individual chapters collected into 42 \"tankbon\" volumes by its publisher Shueisha. Toei Animation produced an anime television series based on the first 194 manga chapters, also titled Dragon Ball. The series premiered in Japan on February 26, 1986 and ran until April 19, 1989, lasting 153 episodes. The first episode of the series aired in Japan on April 26, 1989, taking over its predecessor's time slot. The first TV special based on the \"Z\" series premiered on November 11, 1990 and ended on January 31, 1996.", "prediction 4": "There are several television series called Dragon Ball. The first episode of the Japanese series Dragon Ball aired on April 19, 1986 while the first episode of the English series Dragon Ball aired on January 3, 1987. The second series, Dragon Ball Z, premiered in Japan on April 26, 1989.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 76 }, { "error type": "Unverifiable", "explanation": "", "start": 143, "end": 221 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 127, "end": 142 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "Dragon Ball is a Japanese anime television series produced by Toei Animation. It is an adaptation of the first 194 chapters of the Japanese manga series of the same name created by Akira Toriyama, which were published in Weekly Sh\u014dnen Jump from 1984 to 1995. The first episode of the series aired in Japan on February 26, 1986.\n" }, "preference": [ 2, 2, 2, 1, 1, 2 ] }, { "question": "When did health care workers first use chlorine solution to decontaminate hands?", "passages": [ [ "Chlorine", "They were successful in hospitals, lazarets, prisons, infirmaries (both on land and at sea), magnaneries, stables, cattle-sheds, etc. ; and they were beneficial during exhumations, embalming, outbreaks of epidemic disease, fever, and blackleg in cattle.", "Labarraque's chlorinated lime and soda solutions have been advocated since 1828 to prevent infection (called \"contagious infection\", presumed to be transmitted by \"miasmas\"), and to treat putrefaction of existing wounds, including septic wounds.", "In his 1828 work, Labarraque recommended that doctors breathe chlorine, wash their hands in chlorinated lime, and even sprinkle chlorinated lime about the patients' beds in cases of \"contagious infection\".", "In 1828, the contagion of infections was well known, even though the agency of the microbe was not discovered until more than half a century later.", "During the Paris cholera outbreak of 1832, large quantities of so-called \"chloride of lime\" were used to disinfect the capital.", "This was not simply modern calcium chloride, but chlorine gas dissolved in lime-water (dilute calcium hydroxide) to form calcium hypochlorite (chlorinated lime)." ], [ "Antoine Germain Labarraque", "Perhaps the most famous application of Labarraque's chlorine and chemical base solutions was in 1847, when Ignaz Semmelweis used (first) chlorine-water, then cheaper chlorinated lime solutions, to deodorize the hands of Austrian doctors that Semmelweis noticed still carried the stench of decomposition from the dissection rooms to the patient examination rooms.", "Semmelweis, still long before the germ theory of disease, had theorized that \"cadaveric particles\" were somehow transmitting decay from fresh cadavers to living patients, and he used the well-known Labarraque's solutions as the only known method to remove the smell of decay and tissue decomposition (which he found that soap did not).", "Coincidentally the solutions proved to be far more effective germicides and antiseptics than soap (Semmelweis only knew that soap was less effective, but not why), and the success of these chlorinated agents resulted in Semmelweis's (later) celebrated success in stopping the transmission of childbed fever." ] ], "gold": "Labarraque recommended health care workers breathe chlorine, wash their hands in chlorinated lime and even sprinkle chlorinated lime around the patients beds in case of \"contagious infection\" since 1828. In 1847, Ignaz Semmelweis began using chlorine-water for disinfection purposes, which proved to be more effective and cheaper than chlorinated lime.", "prediction 1": "Health care workers first used chlorine solution to decontaminate hands in 1828. Perhaps the most famous application of Labarraque's chlorine and chemical base solutions was in 1847, when Ignaz Semmelweis used (first) chlorine-water, then cheaper chlorinated lime solutions, to deodorize the hands of Austrian doctors that Semmelweis noticed still carried the stench of decomposition from the dissection rooms to the patient examination rooms.\n", "prediction 2": "Health care workers first started using chlorine solution to decontaminate hands in 1828, when Antoine Germain Labarraque first advocated that doctors breathe chlorine, wash their hands in chlorinated lime, and even sprinkle chlorinated lime about the patients' beds in cases of \"contagious infection\". Perhaps the most famous application of Labarraque's chemical base solutions was in 1847, when Ignaz Semmelweis used (first) chlorine-water, then cheaper chlorinated lime solutions, to deodorize the hands of Austrian doctors that Semmelweis noticed still carried the stench of decomposition from the dissection rooms to the patient examination rooms.", "prediction 3": "Health care workers first used chlorine solution to decontaminate hands in 1828, while Austrian doctors first started using it in 1847.", "prediction 4": "Health care workers first used chlorine solution to decontaminate hands in 1828. Perhaps the most famous application of Labarraque's chlorine and chemical base solutions was in 1847, when Ignaz Semmelweis used (first) chlorine-water, then cheaper chlorinated lime solutions, to deodorize the hands of Austrian doctors.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 81, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 318, "end": 444 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "In 1828, Labarraque recommended that doctors breathe chlorine, wash their hands in chlorinated lime, and even sprinkle chlorinated lime about the patients' beds in cases of \"contagious infection\". In 1847, Ignaz Semmelweis first used chlorine-water, then cheaper chlorinated lime solutions, to deodorize the hands of Austrian doctors. The solutions proved to be far more effective germicides and antiseptics than soap. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When did smoking in the workplace stop uk?", "passages": [ [ "Smoking in the United Kingdom", "Until 31 August 2008, the minimum age to purchase and consume tobacco products in public was 16 years of age.", "From 1 September 2008 the Children and Young Persons (Sale of Tobacco etc.) Regulations (Northern Ireland) 2008 became effective, raising the minimum purchase, consumption and possession age to 18 years of age.", "Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England, \n\nOn 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England.", "With the ban coming into effect in small retailers three years later on 6 April 2015.", "In March 2011, the Conservative-Lib Dem coalition government committed itself to holding a public consultation on the introduction of plain tobacco packaging.", "Influenced by the introduction of plain packaging in Australia, the House of Commons voted 367\u2013113 in March 2015 to pass the Children and Families Act 2014 which would give the government the power to require plain packaging for tobacco products.", "This came into force on 20 May 2016, but tobacco companies were given one year to sell off remaining stock; in which afterwards, all tobacco products sold in the UK must follow plain packaging laws.", "On October 1, 2015 a law was passed which banned smoking in vehicles with anyone under eighteen years of age present." ] ], "gold": "In the United Kingdom, smoking in the workplace was banned through laws that were enacted separately in England, Wales, Scotland, and Northern Ireland. First, Scotland made smoking in the workplace illegal on 26 March 2006. Then it was made illegal in Wales on 2 April 2007, and in Northern Ireland on 30 April 2007. Smoking in the workplace in England became illegal on 1 July 2007.", "prediction 1": "Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England. On 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England. With the ban coming into effect in small retailers three years later on 6 April 2015.\n", "prediction 2": "Smoking in the workplace has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England. On 6 April 2012, the display of tobacco products was banned in retailers larger than 280 square metres in England. With the ban coming into effect in small retailers three years later on 6 April 2015.", "prediction 3": "Smoking in public places has been illegal since 7 October 2005 in England and Wales. On 26 June 2006, smoking in enclosed public spaces entered into a new ban on 1 July 2007 for both adult and child smokers. Until 28 July 2013, smoking in public spaces entered into a new ban on 6 April 2015.", "prediction 4": "Smoking in office spaces, and enclosed public spaces, has been illegal since the Children and Young Persons Act 2006 in Scotland and has been banned in England since July 2007. Smoking in workplaces and enclosed public spaces stopped in the UK from 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland, and 1 July 2007 in England. In the workplace, and in all covered public spaces except Gas, Electricity and Water, was banned from 12 April 2007.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 298 }, { "error type": "Irrelevant", "explanation": "", "start": 299, "end": 385 } ], "missing-info": [], "corrected-prediction": "Smoking in workplaces and enclosed public spaces has been illegal since 26 March 2006 in Scotland, 2 April 2007 in Wales, 30 April 2007 in Northern Ireland and 1 July 2007 in England.\n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When is the nba first regular season game?", "passages": [ [ "2016\u201317 NBA season", "This was the first time since the 1963\u201364 NBA season that there was no in-season coaching changes, the fourth time this happened in league history.", "The preseason began on October 1, 2016 and ended on October 21, 2016.", "The regular season began on Tuesday, October 25, 2016.", "Christmas Day games were played on Sunday, December 25, 2016.", "The regular season ended on Wednesday, April 12, 2017.", "The schedule was released at 6:00\u00a0p.m. ET on August 11, 2016.", "Notes\n\n\n\nThe 2017 NBA Playoffs began on April 15, 2017.", "In May 2017, ESPN aired the Western Conference Finals and TNT aired the Eastern Conference Finals.", "The season ended with the 2017 NBA Finals which began on June 1, 2017 and ended on June 12, 2017 on ABC.", "Awards were presented at the NBA Awards ceremony, which were held on June 26.", "Finalists for voted awards were announced during the playoffs and winners were presented at the award ceremony.", "The All-NBA Team was announced in advance in order for teams to have all the necessary information to make offseason preparations.", "The following players were named the Eastern and Western Conference Players of the Week.", "The following players were named the Eastern and Western Conference Players of the Month.", "The following players were named the Eastern and Western Conference Rookies of the Month.", "The following coaches were named the Eastern and Western Conference Coaches of the Month." ], [ "2015\u201316 Cleveland Cavaliers season", "However, despite having the best record in their conference, the team fired head coach David Blatt on January 22, 2016.", "Assistant coach Tyronn Lue took over for the remainder of the season.", "The Cavaliers finished the regular season with a 57\u201325 record and obtained the number one seed in the Eastern Conference for the first time since 2010.", "In the first two rounds of the 2016 NBA playoffs, the Cavaliers swept the Detroit Pistons and the Atlanta Hawks, respectively.", "In the Eastern Conference Finals, the Cavaliers beat the Toronto Raptors in six games.", "The Cavaliers lost three of the first four games of the 2016 NBA Finals to the Golden State Warriors, who had defeated Cleveland in the finals the year before.", "In turn, the Cavaliers won Games 5 and 6 of the series to bring about a climactic Game 7 at Oracle Arena.", "With Game 7 tied at 89\u201389, LeBron James chased down and blocked Andre Iguodala's attempted lay-up in a play that became known as \"The Block.\"", "The Cavaliers ultimately won Game 7, 93\u201389, for the first NBA championship in franchise history.", "No team had ever before recovered from a 3\u20131 deficit in an NBA Finals series.", "James was named the unanimous NBA Finals MVP, receiving the award for the third time in his career." ], [ "National Basketball Association", "National Basketball Association\n\nThe National Basketball Association (NBA) is a men's professional basketball league in North America; composed of 30 teams (29 in the United States and 1 in Canada).", "It is widely considered to be the premier men's professional basketball league in the world.", "The NBA is an active member of USA Basketball (USAB), which is recognized by FIBA (also known as the International Basketball Federation) as the national governing body for basketball in the United States.", "The NBA is one of the four major professional sports leagues in the United States and Canada.", "NBA players are the world's best paid athletes by average annual salary per player.", "The league was founded in New York City on June 6, 1946, as the Basketball Association of America (BAA).", "The league adopted the name National Basketball Association on August 3, 1949, after merging with the competing National Basketball League (NBL).", "The league's several international as well as individual team offices are directed out of its head offices located in the Olympic Tower at 645 Fifth Avenue in Manhattan.", "NBA Entertainment and NBA TV studios are directed out of offices located in Secaucus, New Jersey.", "The Basketball Association of America was founded in 1946 by owners of the major ice hockey arenas in the Northeastern and Midwestern United States and Canada." ], [ "2016\u201317 NBA season", "2016\u201317 NBA season\n\nThe 2016\u201317 NBA season was the 71st season of the National Basketball Association.", "The regular season began on October 25, 2016, with the 2016 NBA champion Cleveland Cavaliers hosting a game against the New York Knicks.", "The 2017 NBA All-Star Game was played at the Smoothie King Center in New Orleans, Louisiana, on February 19, 2017, with the West defeating the East 192\u2013182.", "Anthony Davis of the New Orleans Pelicans was named the All Star Game MVP after breaking Wilt Chamberlain's record by scoring 52 points in the All Star Game.", "The original host of the game, Charlotte's Spectrum Center, was removed as the host on July 21, 2016 due to the league's opposition against North Carolina's Public Facilities Privacy & Security Act.", "The regular season ended on April 12, 2017, and the playoffs began on April 15, 2017 and ended on June 12, 2017, with the Golden State Warriors going 16-1 in the playoffs and beating the Cleveland Cavaliers in five games during their third consecutive matchup in the NBA Finals.", "Free agency negotiations began on Friday, July 1, 2016 at 12:01\u00a0a.m.", "e.t.", "Players can sign starting on July 6, after the July moratorium ended.", "There were no head coaching changes during the regular season." ], [ "2015\u201316 NBA season", "2015\u201316 NBA season\n\nThe 2015\u201316 NBA season was the 70th season of the National Basketball Association.", "The regular season began on Tuesday, October 27, 2015 at the United Center, home of the Chicago Bulls, with their game against the Cleveland Cavaliers.", "The 2016 NBA All-Star Game was played at the Air Canada Centre in Toronto, Ontario, Canada on February 14, 2016.", "The regular season ended on April 13, 2016.", "The playoffs started on April 16, 2016 and ended with the 2016 NBA Finals on June 19, 2016, with the Cleveland Cavaliers becoming NBA Champions for the first time in franchise history after defeating the Golden State Warriors in seven games.", "Free agency negotiations began on Friday, July 1, 2015 while players will begin to sign starting on July 7, after the July moratorium ended.", "The preseason began on Friday, October 2, 2015 and ended on Friday, October 23, 2015.", "The regular season began on Tuesday, October 27, 2015 at the United Center, home of the Chicago Bulls, who hosted a game against the Cleveland Cavaliers at 8:00\u00a0p.m. EDT, then the Atlanta Hawks hosted the Detroit Pistons at 8:00\u00a0p.m. EDT.", "Finally, the defending NBA champion Golden State Warriors hosted the New Orleans Pelicans at 10:30\u00a0p.m. EDT at the Oracle Arena." ] ], "gold": "Usually, the first regular game of the each NBA season has been played in the month of October, with the exception of the 2020-21 edition, which, due to COVID-19 restrictions, began in December. For the 2015-16 Season, the opening game was on October 27, 2015. The event was held on October 25, 2016 for the 2016-17 Season and on October 17, 2017 for the 2017-18 edition.", "prediction 1": "The National Basketball Association (NBA) is a men's professional basketball league in North America, composed of 30 teams, with 30 members, based in the United States and Canada. The league began its 71st season on August 3, 1949, when the NBA champion Cleveland Cavaliers hosted a game against the New York Knicks. The NBA regular season began on Tuesday, October 25, 2016, with the 2016 NBA champion Cleveland Cavaliers hosting a game against the New York Knicks. Christmas Day games were played on Sunday, December 25, 2016. The NBA first regular season began on Wednesday, April 12, 2017.\n", "prediction 2": "The National Basketball Association is a men's professional basketball league in North America, composed of 30 teams, with 30 teams in the United States and one team in Canada. The league's first regular season game was on October 25, 2016 against the New York Knicks. The NBA is widely considered to be the premier men's professional basketball league in the world, with more than 10,000 players, with a total population of over 30 million. It was founded on June 6, 1946, as the Basketball Association of America and adopted the name National Basketball Association on August 3, 1949. The first regular season game began on October 25, 2016, with the Cleveland Cavaliers hosting a game against the New Orleans Pelicans. The league's first regular season game was held on February 19, 2017, with the New Orleans Pelicans hosting a game against the New York Knicks.", "prediction 3": "The National Basketball Association (NBA) is a men's professional basketball league in North America. The league began its 71st season on August 3, 1949, and played its first regular season game on October 25, 2016. The first regular season game was played February 19, 1917, against the Philadelphia 76ers.", "prediction 4": "The NBA, officially the National Basketball Association, is a men's professional basketball league in North America composed of 30 teams and is widely considered the premier men's professional basketball league in the world. The league began in 1946 as the Basketball Association of America, before adopting the name National Basketball Association on August 3, 1949, after merging with the competing National Basketball League (NBL). The NBA regular season began on October 25, 2016, with the 2015\u201316 Cleveland Cavaliers hosting a game against the New York Knicks. Christmas Day games were played on Sunday, December 25, 2016. The NBA began its 2017 NBA playoffs ended on April 12, 2017. A few years later on January 15, 2018, the Houston Rockets had played against the Chicago Bulls.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 179 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[2]}", "start": 216, "end": 231 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 316 }, { "error type": "Redundant", "explanation": " The league began its 71st season on August 3, 1949, when the NBA champion Cleveland Cavaliers hosted a game against the New York Knicks. ", "start": 317, "end": 466 }, { "error type": "Irrelevant", "explanation": "", "start": 467, "end": 528 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[2]}", "start": 578, "end": 594 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 5, "sentence_id": [ 1 ] } ], "corrected-prediction": "The league began its 71st (2016-2017) season on October 25, 2016. For the 2015-16 Season, the opening game was on October 27, 2015. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who makes the hosts for the catholic church?", "passages": [ [ "Sacramental bread", "The Code of Canon Law, Canon 924 requires that the hosts be made from wheat flour and water only and recently made so that there is no danger of spoiling.", "Hosts are often made by nuns as a means of supporting their religious communities.", "However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.", "The General Instruction of the Roman Missal \u00a7321 recommends that \"the eucharistic bread ... be made in such a way that the priest at Mass with a congregation is able in practice to break it into parts for distribution to at least some of the faithful. ...", "The action of the fraction or breaking of bread, which gave its name to the Eucharist in apostolic times, will bring out more clearly the force and importance of the sign of unity of all in the one bread, and of the sign of charity by the fact that the one bread is distributed among the brothers and sisters.\"" ] ], "gold": "Hosts are often made by nuns as a means of supporting their religious communities. However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out, and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.", "prediction 1": "Hosts are often made by nuns as a means of supporting their religious communities. However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.\n", "prediction 2": "The Code of Canon Law, Canon 924 requires that the hosts be made from wheat flour and water only. Hosts are often made by nuns as a means of supporting their religious communities. However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.", "prediction 3": "Hosts are often made by nuns as a means of supporting their religious communities. In the US, a person makes the hosts for the church because it requires heavy duty equipment, such as a bread machine and large quantities of wheat flour. In New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.", "prediction 4": "Hosts are often made by nuns as a means of supporting their religious communities. However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise. The Code of Canon Law, Canon 924 requires that the hosts be made from wheat flour and water only and recently made so that there is no danger of spoiling.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "Hosts are often made by nuns as a means of supporting their religious communities. However, in New Zealand, the St Vincent de Paul Society hires individuals with intellectual disabilities to bake, cut out and sort the bread, thereby offering paid employment to those who wouldn't have that option otherwise.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "What's the name of the cat with no hair?", "passages": [ [ "Cornish Rex", "Cornish Rex\n\nA Cornish Rex is a breed of domestic cat.", "The Cornish Rex has no hair except for down.", "Most breeds of cat have three different types of hair in their coats: the outer fur or \"guard hairs\", a middle layer called the \"awn hair\"; and the down hair or undercoat, which is very fine and about 1\u00a0cm long.", "Cornish Rexes only have the undercoat.", "Cornish Rex are prone to hair loss and many will develop a very thin coat or even go bald over large parts of their body.", "The curl in Cornish Rex fur is caused by a different mutation and gene than that of the Devon Rex.", "The breed originated in Cornwall, Great Britain.", "The coat of a Cornish Rex is extremely fine and sometimes curly.", "Their light coat means that they are best suited for indoor living in warm and dry conditions, as they are sensitive to low temperatures.", "Cornish Rexes like to stay near warm places such as computer monitors, light bulbs, laps and shoulders.", "The breed is sometimes referred to as the Greyhound of the cats, because of the sleek appearance and the galloping run characteristic of the breed.", "These cats tend to stay playful and kittenish throughout their long lives.", "Some Cornish Rexes like to play fetch, race other pets, or do acrobatic jumps.", "The Cornish Rex is an adventurous cat and is very intelligent." ], [ "Sphynx cat", "Two different sets of hairless felines discovered in North America in the 1970s provided the foundation cats for what was shaped into the existing Sphynx breed.", "The contemporary breed of Sphynx cat, also known as the Canadian Sphynx, is distinct from the Russian hairless cat breeds like Peterbald and Donskoy.", "The current American and European Sphynx breed is descended from two lines of natural mutations:\n\n\nThe Canadian Sphynx breed was started in 1966 in Toronto when a hairless kitten named Prune was born to a black and white domestic shorthair queen (Elizabeth).", "The kitten was mated with its mother (something called backcrossing), which produced one more naked kitten.", "Together with a few naked kittens found later, the cat Prune marked the first attempt to create a hairless breed.", "After purchasing these cats in 1966 and initially referring to them as \"Moonstones\" and \"Canadian Hairless,\" Ridyadh Bawa, a science graduate of the University of Toronto, combined efforts with his mother Yania, a long time Siamese breeder, and Kees and Rita Tenhoves to develop a breed of cats which was subsequently renamed as \"Sphynx\"." ], [ "Sphynx cat", "Sphynx cat\n\nThe Sphynx cat is a breed of cat known for its lack of coat (fur).", "It was developed through selective breeding, starting in the 1960s.", "The skin should have the texture of chamois, as it has fine hairs, or they may be completely hairless.", "Whiskers may be present, either whole or broken, or may be totally absent.", "They also have a narrow, long head, and webbed feet.", "Their skin is the color that their fur would be, and all the usual cat markings (solid, point, van, tabby, tortie, etc.) may be found on the Sphynx cat's skin.", "Because they have no coat, they lose more body heat than coated cats.", "This makes them warm to the touch as well as heat-seeking.", "These breed standards are defined by The International Cat Association (TICA):\n\n\nSphynxes are known for their extroverted behavior.", "They display a high level of energy, intelligence, curiosity, and affection for their owners.", "They are one of the more dog-like breeds of cats, frequently greeting their owners at the door and friendly when meeting strangers.", "Although hairless cats have been reported throughout history, breeders in Europe have been working on the Sphynx breed since the early 1960s." ] ], "gold": "The cat with no hair that originated in Ontario, Canada is a breed of Sphynx cat started in 1966. The breed of cat that has no hair except for down is the Cornish Rex.", "prediction 1": "The Cornish Rex is a breed of domestic cat that has no hair except for the undercoat. The coat of a Cornish Rex is extremely fine and sometimes curly. The contemporary breed of Sphynx cat, also known as the Canadian Sphynx, is distinct from the Russian hairless cat breeds like Peterbald and Donskoy.\n", "prediction 2": "The Cornish Rex is a breed of domestic cat that has no hair except for the undercoat. Most breeds of cat have three different types of hair in their coats. Cornish Rex are prone to hair loss and many will develop a very thin coat or even go bald over large parts of their body. The contemporary breed of Sphynx cat, also known as the Canadian Sphynx, is distinct from the Russian hairless cat breeds like Peterbald and Donskoy.", "prediction 3": "The Cornish Rex, or Cornish Wagtail, is a breed of domestic cat that has very little or no fur. They are prone to hair loss and many will develop a very thin, wavy coat or even go bald over large parts of their body. The contemporary breed of Sphynx cat, also known as the Canadian Sphynx, is distinct from the Russian hairless cat breeds like Peterbald and Donskoy. This small, non-coated cat was developed through selective breeding, starting in the 1960s.", "prediction 4": "The Cornish Rex is a breed of domestic cat that has no fur, except for very fine oily down that is contained under the skin. They cannot be groomed properly with a brush or towel.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 30, "end": 38 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 150 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 240 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Cornish Rex is a breed of cat that has no hair except for the undercoat. There is also a breed of Sphynx cat known for its lack of fur which originated in Toronto, Canada in 1966. There are also Russian hairless cat breeds like Peterbald and Donskoy.\n" }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Model of the solar system that places earth in the center?", "passages": [ [ "History of the center of the Universe", "History of the center of the Universe\n\nThe center of the Universe is a concept that lacks a coherent definition in modern astronomy; according to standard cosmological theories on the shape of the universe, it has no center.", "Historically, the center of the Universe had been believed to be a number of locations.", "Many mythological cosmologies included an \"axis mundi\", the central axis of a flat Earth that connects the Earth, heavens, and other realms together.", "In the 4th century BCE Greece, the geocentric model was developed based on astronomical observation, proposing that the center of the Universe lies at the center of a spherical, stationary Earth, around which the sun, moon, planets, and stars rotate.", "With the development of the heliocentric model by Nicolaus Copernicus in the 16th century, the sun was believed to be the center of the Universe, with the planets (including Earth) and stars orbiting it.", "In the early 20th century, the discovery of other galaxies and the development of the Big Bang theory led to the development of cosmological models of a homogeneous, isotropic Universe (which lacks a central point) that is expanding at all points." ], [ "Geocentric model", "Geocentric model\n\nIn astronomy, the geocentric model (also known as geocentrism, or the Ptolemaic system) is a superseded description of the Universe with Earth at the center.", "Under the geocentric model, the Sun, Moon, stars, and planets all orbited Earth.", "The geocentric model served as the predominant description of the cosmos in many ancient civilizations, such as those of Aristotle and Ptolemy.", "Two observations supported the idea that Earth was the center of the Universe.", "First, from anywhere on Earth, the Sun appears to revolve around Earth once per day.", "While the Moon and the planets have their own motions, they also appear to revolve around Earth about once per day.", "The stars appeared to be fixed on a celestial sphere rotating once each day about an axis through the geographic poles of Earth.", "Second, Earth seems to be unmoving from the perspective of an earthbound observer; it feels solid, stable, and stationary.", "Ancient Greek, ancient Roman, and medieval philosophers usually combined the geocentric model with a spherical Earth, in contrast to the older flat Earth model implied in some mythology.", "The ancient Jewish Babylonian uranography pictured a flat Earth with a dome-shaped, rigid canopy called the firmament placed over it (\u05e8\u05e7\u05d9\u05e2- r\u0101q\u00eea')." ], [ "History of the center of the Universe", "Aristotle (384\u2013322\u00a0BCE) provided observational arguments supporting the idea of a spherical Earth, namely that different stars are visible in different locations, travelers going south see southern constellations rise higher above the horizon, and the shadow of Earth on the Moon during a lunar eclipse is round, and spheres cast circular shadows while discs generally do not.", "This understanding was accompanied by models of the Universe that depicted the Sun, Moon, stars, and naked eye planets circling the spherical Earth, including the noteworthy models of Aristotle (see Aristotelian physics) and Ptolemy.", "This geocentric model was the dominant model from the 4th century BCE until the 17th century CE.", "Heliocentrism, or heliocentricism, is the astronomical model in which the Earth and planets revolve around a relatively stationary Sun at the center of our Solar System.", "The word comes from the Greek ( \"helios\" \"sun\" and \"kentron\" \"center\").", "The notion that the Earth revolves around the Sun had been proposed as early as the 3rd century BCE by Aristarchus of Samos, but had received no support from most other ancient astronomers." ], [ "Ptolemy", "Ptolemy\n\nClaudius Ptolemy (; , \"Kla\u00fadios Ptolema\u00eeos\" ; ; ) was a Greco-Roman mathematician, astronomer, geographer and astrologer.", "He lived in the city of Alexandria in the Roman province of Egypt, wrote in Koine Greek, and held Roman citizenship.", "The 14th-century astronomer Theodore Meliteniotes gave his birthplace as the prominent Greek city Ptolemais Hermiou () in the Thebaid ().", "This attestation is quite late, however, and, according to Gerald Toomer, the translator of his \"Almagest\" into English, there is no reason to suppose he ever lived anywhere other than Alexandria.", "He died there around AD\u00a0168.", "Ptolemy wrote several scientific treatises, three of which were of importance to later Byzantine, Islamic and European science.", "The first is the astronomical treatise now known as the \"Almagest\", although it was originally entitled the \"Mathematical Treatise\" (, \"Math\u0113matik\u0113 Syntaxis\") and then known as the \"Great Treatise\" (, \"H\u0113 Meg\u00e1l\u0113 Syntaxis\").", "The second is the \"Geography\", which is a thorough discussion of the geographic knowledge of the Greco-Roman world.", "The third is the astrological treatise in which he attempted to adapt horoscopic astrology to the Aristotelian natural philosophy of his day." ] ], "gold": "In astronomy, the geocentric model is a description of the Universe with Earth at the center, and the other planets and the sun revolving around it. The geocentric model was the dominant model from the 4th century BC until the 17th century AD. This understanding was accompanied by Claudius Ptolemy's model. Claudius Ptolemy was a mathematician, astronomer, geographer, and astrologer who wrote about a dozen scientific treatises, three of which were of importance to later Byzantine, Islamic, and Western European science. ", "prediction 1": "In astronomy, the geocentric model, also known as geocentrism, or the Ptolemaic system, is a superseded description of the Universe with Earth at the center. Under the geocentric model, the Sun, Moon, planets, and stars all orbited Earth. The geocentric model served as the predominant description of the cosmos in many ancient civilizations, such as those of Aristotle and Ptolemy. The heliocentric model is the astronomical model in which the Earth and planets revolve around a relatively stationary Sun at the center of our Solar System.\n", "prediction 2": "The center of the Universe, a concept that lacks a coherent definition in modern astronomy, is a number of places. The axis mundi, or central axis of the universe, was first observed in ancient Babylonia and is nearer to the Earth today than at any time since the creation of the cosmos (about 6,000 years ago). During the 4th century BCE, Greece developed the geocentric model, also known as geocentrism, which is a superseded description of the solar system with Earth in the center.", "prediction 3": "The center of the Universe is a concept that lacks a coherent definition in modern astronomy and physics. The center of the Universe is a number of places. The geocentric model, also known as geocentrism, or the Ptolemaic system, is a superseded description of the Universe with Earth at the center, with the Sun, Moon, planets, and stars orbiting Earth. Under the geocentric model, the Earth, stars, and planets all orbited Earth, the center of the Universe. The geocentric model served as the predominant description of the cosmos in many ancient civilizations, such as those of Aristotle and Ptolem and Aristotle. Heliocentricism spread throughout the history of the human world, creating a rotating Earth around a fairly stationary Sun, though.", "prediction 4": "The center of the Universe is a concept that lacks a coherent definition in modern astronomy. According to standard cosmological theories on the shape of the universe, it has no center. Many mythological cosmologies included an axis mundi, the central axis of a flat Earth that connects the Earth, heavens, and other realms together. The geocentric model was developed in Greece in the 4th century BC, proposing that the center of the Universe lies at the center of a spherical, stationary Earth.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 36, "end": 87 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 103 }, { "error type": "Irrelevant", "explanation": "", "start": 383, "end": 541 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1, 6 ] } ], "corrected-prediction": "In astronomy, the geocentric model, is a description of the Universe with Earth at the center. Under the geocentric model, the Sun, Moon, planets, and stars all orbited Earth. The geocentric model served as the predominant description of the cosmos in many civilizations from the ancient 4th century BC, such as those of both Aristotle and Ptolemy whose models both reflected this concept, until the 17th century AD. Claudius Ptolemy was a mathematician, astronomer, geographer, and astrologer who wrote several scientific treatises, three of which were of importance to later Byzantine, Islamic, and Western European science.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When was the last time someone was put to death in california?", "passages": [ [ "Clarence Ray Allen", "To the surprise of everyone present, the warden indicated that he needed an additional injection of the lethal potassium in order to stop his surprisingly healthy heart.", "Allen wrote in his final statement, which was read immediately following the execution, \"My last words will be 'Hoka", "hey, it's a good day to die.", "Thank you very much.", "I love you all.", "Goodbye.'\" Allen died with an eagle feather on his chest.", "He was wearing a medicine bag around his neck, and a beaded headband.", "He was visited shortly before the execution by two Native American spiritual advisers.", "Allen died at 12:38\u00a0a.m.", "Approximately 250 death penalty opponents gathered for a candlelight vigil outside the walls of San Quentin.", "His last meal consisted of Buffalo steak and frybread (both are traditional Native American dishes) as well as a bucket of KFC white-meat-only chicken, sugar-free pecan pie, sugar-free walnut ice cream, and whole milk.", "The ice-cream was left out to thaw for one hour, which Allen turned into a milkshake by hand.", "Correctional Officers familiar with Clarence Ray Allen stated that he often walked without assistance and was also able to read his mail." ], [ "Capital punishment in California", "A Field Poll in September 2014 showed that 56% support the death penalty, down from 69% three years ago.", "Support for the death penalty in California had not been at this low a level since the mid-1960s.", "The following 13 people convicted of murder have been executed in California following the 1976 U.S. Supreme Court decision of \"Gregg v. Georgia\".", "The first two executions were by gas inhalation; all subsequent executions were by lethal injection, following a 1996 federal court (9th Circuit) ruling that the use of the gas chamber in California was unconstitutional." ], [ "Clarence Ray Allen", "Schwarzenegger also cited a poem in which Allen glorified his actions, where Allen wrote, \"We rob and steal and for those who squeal are usually found dying or dead.\"", "On January 15, 2006, the Ninth Circuit Court of Appeals denied Allen's claim that executing an aged or infirm person was cruel and unusual punishment, observing that his mental acuity was unimpaired and that he had been fifty years of age when he arranged the murders from prison.", "Judge Kim Wardlaw writing for the panel of judges Susan Graber, Richard Clifton, and herself: \n\nThe United States Supreme Court declined to hear the case, albeit over the dissent of Justice Stephen Breyer, who stated: \"I believe that in the circumstances he raises a significant question as to whether his execution would constitute 'cruel and unusual punishment.'\"", "Allen was executed by lethal injection on January 17, 2006, the day after his 76th birthday, at California's San Quentin State Prison.", "He became the second-oldest inmate to be executed in the United States since 1976 (John B. Nixon of Mississippi was executed in 2005 at age 77) and, as of 2018, the last inmate executed in California.", "Allen was assisted in the death chamber by four correctional officers, though a media observer stated that he was clearly moving under his own power." ] ], "gold": "Since the 1976 U.S. Supreme Court decision of Gregg v. Georgia, 13 people convicted of murder have been executed by the state of California. The first 2 executions were by gas inhalation, and all subsequent executions were by lethal injection following a 1996 federal court ruling that the use of the gas chamber in California was unconstitutional. The last time a gas chamber was used was on August 24, 1993. The last time someone was put to death in California by any method was January 17, 2006 by lethal injection.", "prediction 1": "Clarence Ray Allen was executed by lethal injection on January 17, 2006, the day after his 76th birthday, at California's San Quentin State Prison. He became the second-oldest inmate to be executed in the United States since 1976, and, as of 2018, the last inmate executed in California.\n", "prediction 2": "In the State of California, the last person to be executed was Clarence Ray Allen, who was put to death on January 17, 2006, the day after his 76th birthday. In 2016, Robert F. Rebelo was executed by lethal injection, on January 17, 2016, and in 2017, Russ Senor was executed by lethal injection.", "prediction 3": "Clarence Ray Allen was put to death by lethal injection on January 17, 2006, the day after his 76th birthday, at California's San Quentin State Prison. Allen is thought to have been 52 at the time of his execution. Since 1976, 13 people convicted of murder have been executed in California, previously being John B. Nixon in 1976 and Richard E. O'Toole in 2002.", "prediction 4": "The last person to be executed in California was Clarence Ray Allen, who was put to death on January 17, 2006, the day after his 76th birthday at California's San Quentin State Prison. As of 2018, he was the last inmate executed in California.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 73, "end": 105 }, { "error type": "Irrelevant", "explanation": "", "start": 151, "end": 230 } ], "missing-info": [], "corrected-prediction": "Clarence Ray Allen was executed by lethal injection on January 17, 2006 at California's San Quentin State Prison. He was, as of 2018, the last inmate executed in California.\n" }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "When is the wwe 2k 18 coming out?", "passages": [ [ "WWE 2K18", "WWE 2K18\n\nWWE 2K18 is a professional wrestling video game developed by Yuke's and Visual Concepts, and published by 2K Sports.", "It is the nineteenth installment in the WWE game series (fifth under the \"WWE 2K\" banner) and a follow-up to \"WWE 2K17\".", "It was released worldwide on October 17, 2017 for PlayStation 4, Xbox One and Microsoft Windows and Android.", "With its release, \"WWE 2K18\" became the first in the series to be exclusively released on eighth generation hardware and also the first in the series to be released for PC and consoles simultaneously.", "A Nintendo Switch version followed on December 6, 2017, the inaugural release of the series for the Switch and the first WWE game to be released for a Nintendo platform since \"WWE '13\".", "Among the features 2K promoted were enhanced graphics and the return of Kurt Angle to the series as a playable character.", "Critical response to the game was mixed, with particular criticism levied at the Switch version and its various technical issues.", "A sequel, \"WWE 2K19\", was released in October 2018.", "On May 23, 2017, 2K Sports announced \"WWE 2K18\" would be released in 2017.", "On June 19, 2017, 2K released a trailer, revealing that Seth Rollins will be featured as the game's cover star." ], [ "Nintendo Switch", "The Nintendo Switch competes on the console gaming market with contemporaries being Microsoft's Xbox One and Sony's PlayStation 4.", "Known in development by its codename NX, the concept of the Switch came about as Nintendo's reaction to several quarters of financial losses into 2014, attributed to poor sales of its previous console, the Wii U, and market competition from mobile gaming.", "Nintendo's then-president Satoru Iwata pushed the company towards mobile gaming and novel hardware.", "The Nintendo Switch's design is aimed at a wide demographic of video game players through the multiple modes of use.", "Nintendo opted to use more standard electronic components, such as a chipset based on Nvidia's Tegra line, to make development for the console easier for programmers and more compatible with existing game engines.", "As the Wii U had struggled to gain external support, leaving it with a weak software library, Nintendo preemptively sought the support of many third-party developers and publishers to help build out the Switch's game library alongside Nintendo's own first-party titles, including many independent video game studios.", "While Nintendo initially anticipated around 100 titles for its first year, over 320 titles from first-party, third-party, and independent developers were released by the end of 2017.", "The Nintendo Switch was unveiled in October 2016 and was released in most areas worldwide on March 3, 2017." ], [ "WWE 2K18", "On August 16, 2K and IGN announced the first 47 playable characters, with a roster reveal special hosted by Corey Graves, Renee Young, and Goldust.", "Two days later, 2K announced that the soundtrack for the game would be curated by The Rock and will feature a mix of classic rock, modern rock, and hip hop.", "On September 26, 2K announced that for the first time, the PC version of the game will release alongside its console counterparts on October 17.", "Season pass details were unveiled on September 27, featuring the Accelerator, MyPlayer kick start, New Moves pack, NXT Generation pack, and the Enduring Icons pack.", "The NXT Generation pack was released on November 21, 2017, while the pre-order and deluxe edition bonus content was available as a separate purchase a week earlier.", "The New Moves pack was released on December 12, 2017, and the Enduring Icons pack was released on January 16, 2018.", "On March 23, 2018, a WrestleMania-themed edition of \"WWE 2K18\" was released internationally, which contained all of the characters and downloadable content in addition to exclusive items prior to WrestleMania 34.", "On June 29, 2017, it was announced that Kurt Angle would be the pre-order bonus character for \"WWE 2K18\", making his first WWE video game appearance since \"WWE SmackDown vs. Raw 2007\"." ] ], "gold": "The video game WWE 2K18 came out on several dates. The game's standard edition came out on October 17, 2017, while its deluxe edition came out on October 13, 2017, and its WrestleMania edition came out on March 23, 2018. The game came out for the Nintendo Switch console on December 6, 2017.", "prediction 1": "WWE 2K18 is a professional wrestling video game developed by Yuke's and Visual Concepts, and published by 2K Sports. It is the nineteenth installment in the WWE game series and a follow-up to WWE 2K17. It was released worldwide on October 17, 2017 for PlayStation 4, Xbox One and Microsoft Windows and Android. A Nintendo Switch version followed on December 6, 2017, the inaugural release of the series for the Switch and the first WWE game to be released for a Nintendo platform since WWE '13. On March 23, 2018, a WrestleMania-themed edition of WWE 2K18 was released internationally, which contained all of the characters and downloadable content in addition to exclusive items prior to WrestleMania-themed edition of the game.\n", "prediction 2": "WWE 2K18 is a professional wrestling video game developed by Yuke's and Visual Concepts, and published by 2K Sports. It is the nineteenth installment in the WWE game series and a follow-up to WWE 2K17. A PC version of the game was released on October 17, 2017, and a Switch version on December 6, 2017, marking the inaugural release of the series for the Switch and the first WWE game to be released for a Nintendo platform since Wwe '13.", "prediction 3": "The professional wrestling video game WWE 2K18 was released worldwide on October 17, 2017. A Nintendo Switch version of the game was released on December 6, 2017, and a WrestleMania-themed edition was released internationally on March 23, 2018.", "prediction 4": "WWE 2K18 is a professional wrestling video game for the PlayStation 4, Xbox One, and Microsoft Windows and Android consoles. It is the nineteenth installment in the WWE video game series, and a follow-up to WWE 2K17. The PC version of the game was released on September 26, 2017 and the Switch version was released on December 6, 2017. A WrestleMania-themed edition of WWE 2K18 was released internationally on March 23, 2018, which contained all of the characters and downloadable content in addition to exclusive items prior to WrestleMania-themed edition of \"WWE 2K18\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 201 }, { "error type": "Irrelevant", "explanation": "", "start": 586, "end": 730 }, { "error type": "Irrelevant", "explanation": "", "start": 367, "end": 494 } ], "missing-info": [], "corrected-prediction": "It was released worldwide on October 17, 2017 for PlayStation 4, Xbox One and Microsoft Windows and Android. A Nintendo Switch version followed on December 6, 2017. On March 23, 2018, a WrestleMania-themed edition of WWE 2K18 was released internationally." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is the speaker of the house nz?", "passages": [ [ "Chairman of Committees (New Zealand House of Representatives)", "Chairman of Committees (New Zealand House of Representatives)\n\nThe Chairman of Committees was an elected position of the New Zealand House of Representatives.", "The role existed between 1854 and 1992.", "The roles of the Chairman of Committees were to deputise for the Speaker, and to chair the House when it was in committee.", "The role is now carried out by the Deputy Speaker.", "The role of Chairman of Committees also existed for the Legislative Council.", "The position was established during the first session of the 1st New Zealand Parliament.", "Parliament first convened on 24 May 1854, and on 21 June of that year, Auckland lawyer Frederick Merriman was elected as its first Chairman of Committees.", "The role also existed for the Legislative Council, was established in 1865 and first held by Mathew Richmond.", "The chief role of the Chairman of Committees was to chair the House when it was in committee (i.e., considering a bill at committee stage) or preside in the absence of the Speaker or when the Speaker so requested.", "These arrangements were based on those of the House of Commons of the United Kingdom.", "The Chairman of Committees ceased to hold office on the dissolution of Parliament, but was remunerated until the next Parliament first met, when it then had a chance to elect a new Chairman.", "Until 1992, the Chairman of Committees was known as the Deputy Speaker only when presiding over the House." ], [ "50th New Zealand Parliament", "50th New Zealand Parliament\n\nThe 50th New Zealand Parliament was elected at the 2011 general election.", "It had 121 members (120 seats plus one overhang seat), and was in place from December 2011 until September 2014, followed by the 2014 general election.", "The first sitting of the 50th Parliament was held on 20 December 2011, where members were sworn in and Lockwood Smith was elected Speaker of the House.", "This was followed by the speech from the throne on 21 December.", "John Key continued to lead the Fifth National Government.", "Following the resignation of Smith, David Carter was elected Speaker.", "The Parliament was elected using the mixed-member proportional representation (MMP) voting system.", "Members of Parliament (MPs) represent 70 geographical electorates: 16 in the South Island, 47 in the North Island and 7 M\u0101ori electorates.", "The remaining 51 members were elected from party lists using the Sainte-Lagu\u00eb method to realise proportionality.", "The Representation Commission is tasked with reviewing electorate boundaries every five years following each New Zealand census.", "The last review was undertaken in 2007 following the 2006 census, and the electorate boundaries determined then were used in both the and 2011 general elections.", "The next census was scheduled for 8 March 2011, but it was postponed due to the disruption caused by the 22 February 2011 Christchurch earthquake." ] ], "gold": "In New Zealand, the Speaker of the House of Representatives is the individual who chairs the country's elected legislative body, the New Zealand House of Representatives. The 30th Speaker of the House, who is the current Speaker, is Trevor Mallard, who was initially elected on 7 November 2017. The 29th Speaker of the House was David Carter. The 28th Speaker of the House was Lockwood Smith.", "prediction 1": "The Speaker of the New Zealand House of Representatives was Lockwood Smith from 1854 to 1992. David Carter was elected Speaker in 1992.\n", "prediction 2": "The speaker of the New Zealand House of Representatives was David Carter from 2000-2015. He succeeds Lockwood Smith, who was elected in 2011. Previously, Frederick Merriman held the office of Speaker of the New Zealand House of Representatives, but was succeeded by David Carter in 2012.", "prediction 3": "The speaker of the New Zealand House of Representatives in New Zealand is David Carter. Previously, Lockwood Smith was the speaker of the New Zealand House of Representatives. However, David Carter was elected speaker in 2014 after John Key resigned as Speaker in November 2014. Since 1994, the role of Speaker has been carried out by the Deputy Speaker.", "prediction 4": "The Speaker of the New Zealand House of Representatives was David Carter from 1986 to 2012. The speakerships of the New Zealand House of Representatives were Lockwood Smith from 1946 to 1961 and David Carter from 1992 to 2011.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 75, "end": 93 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 130, "end": 136 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "In New Zealand, the Speaker of the House of Representatives presides in the New Zealand House of Representatives. Lockwood Smith was elected the Speaker of the House on 20 December 2011. Following the resignation of Smith, David Carter was elected Speaker.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang i think i want to marry you?", "passages": [ [ "Marry You", "Marry You\n\n\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, \"Doo-Wops & Hooligans\" (2010).", "Written and produced by The Smeezingtons, the track serves as the record's sixth track and was released as a single outside of the United States.", "\"Marry You\" is a pop song featuring strong influences of doo-wop and soul music.", "The recording focuses on spontaneous marriage and therefore, since its release, has frequently been used as a proposal song.", "\"Marry You\" received generally positive reviews from music critics, with some complimenting its production and its reminiscence of 60's pop style.", "Some criticized a perceived lack of creativity.", "Despite not being released as a single in the US, the song charted at number 85 on the \"Billboard\" Hot 100 and has since sold 2.2 million copies there.", "It charted on most international markets within the top fifteen, reaching number 10 on the Canadian Hot 100, number 8 in Australia, the top five in New Zealand, and charting at number 11 in the United Kingdom.", "The single was certified three times platinum by Music Canada and two times platinum by the Australian Recording Industry Association." ], [ "Marry You", "The song has been covered several times, first on the \"Furt\" episode of the television show \"Glee\" , which aired on November 23, 2010.", "The show's cover version achieved moderate success by peaking at number 27 in Australia, number 19 in Canada, number 31 in Ireland and number 32 in the United States.", "On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation's Romantic Fantasy.", "Rapper and actor Donald Glover sang a cover of the song in the film \"Magic Mike XXL\".", "The cover appeared on the movie's soundtrack album, which was released on June 30, 2015.", "Credits adapted from the liner notes of \"Doo-Wops & Hooligans\", Elektra Records:\n\n!scope=\"col\" colspan=\"3\"| Streaming\n\nOn August 22, 2011, \"Marry You\" was released in the United Kingdom via digital download.", "It was announced on September 13, 2011 that the song would be released in Germany." ] ], "gold": "\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, Doo-Wops & Hooligans (2010). On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation's Romantic Fantasy. Rapper and actor Donald Glover sang a cover of the song in the film \"Magic Mike XXL\". ", "prediction 1": "\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, Doo-Wops & Hooligans (2010). Written and produced by The Smeezingtons, the track serves as the record's sixth track and was released as a single outside of the United States. The song has been covered several times, first on the \"Furt\" episode of the television show \"Glee\", which aired on November 23, 2010. The show's cover version achieved moderate success by peaking at number 27 in Australia, number 19 in Canada, number 31 in Ireland and number 32 in the United States. On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation' Romantic Fantasy.", "prediction 2": "\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, Doo-Wops & Hooligans (2010). Written and produced by The Smeezingtons, the track serves as the record's sixth track and was released as a single outside of the United States. On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation's Romantic Fantasy.", "prediction 3": "\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, Doo-Wops & Hooligans. Written and produced by The Smeezingtons, the track serves as the record's sixth track and was released as a single outside of the United States. Despite not being released as a single in the US, the song charted at number 85 on the \"Billboard\" Hot 100 and has since sold 2.2 million copies there. On January 1, 2013, the song was covered by South Korean girl group Girls' Generation for their comeback special, Girls' Generation' Romantic Fantasy. On January 1, 2013, the song was covered by Sunny, Sooyoung, Yoona of Korean girl group Girls' Generation for their comeback special, Girls' Generation' Romantic Fantasy.", "prediction 4": "Bruno Mars recorded and released the song \"I Think I Want to Marry You\" as a single from his debut studio album Doo-Wops & Hooligans in 2010. On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation's Romantic Fantasy. Rapper and actor Donald Glover sang a cover of the song in the film \"Magic Mike XXL\". On August 22, 2011, \"Marry You\" was released in the United Kingdom via digital download.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 270 }, { "error type": "Irrelevant", "explanation": "", "start": 271, "end": 404 }, { "error type": "Irrelevant", "explanation": "", "start": 405, "end": 571 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Marry You\" is a song by American singer and songwriter Bruno Mars from his debut studio album, Doo-Wops & Hooligans (2010). On January 1, 2013, the song was covered by Sunny, Sooyoung, and Yoona of South Korean girl group Girls' Generation for their comeback special, Girls' Generation' Romantic Fantasy. Rapper and actor Donald Glover sang a cover of the song in the film \"Magic Mike XXL\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where are the hard and soft palate located?", "passages": [ [ "Palatine bone", "Palatine bone\n\nThe palatine bones () are two irregular bones of the facial skeleton in many animal species.", "Together with the maxillae they comprise the hard palate.", "(\"Palate\" is derived from the Latin \"palatum\".)", "The palatine bones are situated at the back of the nasal cavity between the maxilla and the pterygoid process of the spenoid bone.", "They contribute to the walls of three cavities: the floor and lateral walls of the nasal cavity, the roof of the mouth, and the floor of the orbits.", "They help to form the pterygopalatine and pterygoid fossae, and the inferior orbital fissures.", "Each palatine bone somewhat resembles the letter L, and consists of a horizontal plate, a perpendicular plate, and three projecting processes \u2014 the pyramidal process, which is directed backward and lateral from the junction of the two parts, and the orbital and sphenoidal processes, which surmount the vertical part, and are separated by a deep notch, the sphenopalatine notch.", "The two plates form the posterior part of the hard palate and the floor of the nasal cavity; anteriorly, they join with the maxillae." ], [ "Soft palate", "Soft palate\n\nThe soft palate (also known as the velum, palatal velum, or muscular palate) is, in mammals, the soft tissue constituting the back of the roof of the mouth.", "The soft palate is part of the palate of the mouth; the other part is the hard palate.", "The soft palate is distinguished from the hard palate at the front of the mouth in that it does not contain bone.", "The five muscles of the soft palate play important roles in swallowing and breathing.", "The muscles are: \n\nThese muscles are innervated by the pharyngeal plexus via the vagus nerve, with the exception of the tensor veli palatini.", "The tensor veli palatini is innervated by the mandibular division of the trigeminal nerve (V).", "The soft palate is moveable, consisting of muscle fibers sheathed in mucous membrane.", "It is responsible for closing off the nasal passages during the act of swallowing, and also for closing off the airway.", "During sneezing, it protects the nasal passage by diverting a portion of the excreted substance to the mouth.", "In humans, the uvula hangs from the end of the soft palate.", "Touching the uvula or the end of the soft palate evokes a strong gag reflex in most people." ] ], "gold": "The hard palate is a thin horizontal bony plate made up of two bones of the facial skeleton, located in the roof of the mouth. It is in the front of the mouth. The soft palate is, in mammals, the soft tissue constituting the back of the roof of the mouth.", "prediction 1": "The hard and soft palate are located in the same place in the mouth. The hard palate is situated at the front of the mouth. The soft palate is located at the back of the mouth.\n", "prediction 2": "The hard and soft palate are located at different places on the same skeleton. The hard palate is situated in the maxilla, the pectoral fossa, and the pterygoid process; it is part of the palate of the mouth. The soft palate is situated behind the roof of the mouth and does not contain any bones.", "prediction 3": "In mammals, the hard and soft palate are located at the rear of the roof of the mouth. Together, the maxillae and the palatine bones form the hard palate. The soft palate is located at the back of the roof of the mouth.", "prediction 4": "The hard palate is located in the forehead place between the maxilla and the pterygoid process of the spenoid bone. The soft palate is located at the back of the roof of the mouth between the lip and the palate. The soft palate is distinguished from the hard palate at the front of the mouth in that it does not contain bone.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 29, "end": 57 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[1]}", "start": 140, "end": 177 } ], "missing-info": [], "corrected-prediction": "The hard and soft palate are part of the mouth. The hard palate is situated at the front of the mouth. The soft palate is, in mammals, the soft tissue constituting the back of the roof of the mouth.\n" }, "preference": [ 2, 2, 2, 1, 1, 1 ] }, { "question": "Who played richie in from dusk till dawn?", "passages": [ [ "From Dusk till Dawn (franchise)", "From Dusk till Dawn (franchise)\n\nFrom Dusk till Dawn is a media franchise including three films, a video game and a TV series.", "\"From Dusk till Dawn\", is an American horror franchise.", "Concocted from the pairing of the talents of Quentin Tarantino, and Robert Rodriguez.", "It has spawned, so far: a motion picture, two direct-to-video sequels, a video game, a comic book, collectable statues, as well as a TV series.", "Danny Trejo is the only actor to appear in all the original three films and the series; although Michael Parks appears in both \"From Dusk till Dawn\", and \"The Hangman's Daughter\".", "Rodriguez, Tarantino and Lawrence Bender served as producers on all of the three movies.", "\"From Dusk Till Dawn\" is a 1996 horror crime action thriller film written by Quentin Tarantino and directed by Robert Rodriguez.", "The movie stars Harvey Keitel, George Clooney, Quentin Tarantino and Juliette Lewis.", "\"From Dusk till Dawn 2: Texas Blood Money\" is an American horror crime action thriller released on March 16, 1999.", "The film was an early test release by Dimension Films for the direct-to-video market.", "It was co", "-written and directed by Scott Spiegel, the co-writer of \"Evil Dead II\" and director of \"Intruder\"." ], [ "From Dusk till Dawn (franchise)", "The Gecko brothers briefly appear in a photo cameo in the black comedy \"Curdled\".", "In additional, Katie Houge, news reporter from the first film, appears, again portrayed by Kelly Preston.", "In late 2013, it was reported that a parallel universe had begun production.", "This incarnation of Richie will be played by Zane Holtz.", "Mixing ideas from the original first and third films, the show pits the humans, led by Seth, who will be played by D.J. Cotrona against the vampires, led by the wicked Santanico Pandemonium, played by Eiza Gonzalez and Sheriff McGraw, played by Don Johnson.", "This series stars Robert Patrick, as Jacob Fuller.", "Santanico Pandemonium, formerly Esmeralda or Kisa, is a fictional character from the \"From Dusk till Dawn\" media franchise.", "She is the primary Queen Vampire of the \"Titty Twister\", a strip club in the middle of a desolate part of Mexico.", "In the film series, she is portrayed by Salma Hayek and Ara Celi.", "She is played by Eiza Gonz\u00e1lez in \"\".", "The name of Santanico is based on the Mexican Nunsploitation film \"Sat\u00e1nico pandemonium\".", "Although the original film was not very successful at the box office, the film has achieved a cult status." ], [ "From Dusk till Dawn (franchise)", "He is a nerdy, short-fused, rapist psychopath that only his brother, Seth Gecko (a cool, suave, short-fused, sociopathic anti-hero), could stand.", "He was portrayed by Quentin Tarantino on film, and an alternate version of the character is portrayed by Zane Holtz on TV.", "There is not much information regarding Richie's back story, although a news report about the robbery that is seen during the film states that he holds prior convictions for robbery and sex crimes.", "\"From Dusk till Dawn\" tells the story of the Gecko Brothers right after their latest botched bank-robbery/kidnapping attempt.", "He rapes and murders their hostage, a bank teller, for which Seth scolds him.", "After fleeing to Mexico, they unexpectedly cross paths with a sect of vampires using a strip club as a feeding ground.", "Richie has a chance to bond with his brother, before his insane antics catch up with him and results in an untimely \"death\".", "Richie returns to life as an undead zombie-like blood sucker.", "Seth is then left with the task of putting his brother's evil-possessed carcass out of its misery.", "The Gecko brothers are mentioned in \"\".", "Bo Hopkins references Edgar McGraw's cold demeanor and distracted nature: \"Oh, them Gecko brothers killed his daddy.\"" ] ], "gold": "From Dusk till Dawn is an American media franchise created by Robert Kurtzman, including three films, a video game and a TV series. Richie Gecko, played by Quentin Tarantino in the movie, is a deranged rapist and murderer who, along with his brother Seth, kidnaps a preacher and his two kids and flees for the safety of a remote nightclub in Mexico. In the television series Richie is played by Zane Holtz.", "prediction 1": "From Dusk till Dawn is an American horror franchise that has spawned three films, a video game, a comic book, collectable statues, as well as a TV series. Harvey Keitel played Richie in the 1996 film From Dusk till Dawn. In the 1999 film From Dusk till Dawn 2: Texas Blood Money, Quentin Tarantino played Richie. In the 2013 TV show, From Dusk till Dawn: The Twisted Tales, Zane Holtz played Richie.\n", "prediction 2": "In From Dusk till Dawn, the main character, Richie, is played by multiple actors. In the 1996 original film, Harvey Keitel plays Richie. In From Dusk till Dawn II: Texas Blood Money, an American horror crime action thriller released on March 16, 1999, Quentin Tarantino plays Richie on film. Or, in the 2013 version of the film, David Bowie plays Richie.", "prediction 3": "From Dusk till Dawn is an American horror franchise which has spawned three films, a video game, a comic book, collectable statues, as well as a TV series. In 1996, Harvey Keitel played Richie in the film. In 1999, the character is played by Eiza Gonzalez, who is the Queen Vampire of the Titty Twister, a strip club in the middle of a desolate part of Mexico. In 2013, it was reported that a parallel universe had begun production. This incarnation of Richie will be played by Zane Holtz. In this incarnation of the character will be played by Zane Holtz.", "prediction 4": "From Dusk Till Dawn is an American horror franchise, consisting of three films, a video game and a television series. Harvey Keitel played Richie in the 1996 film From Dusk Till Dawn. In the 1999 movie From Dusk Till Dawn: Texas Blood Money, Simon E. Richards played Richie. Richie is a nerdy, short-fused, rapist psychopath that only his brother, Seth Gecko (a cool, suave, short-fused anti-hero), could stand. Quentin Tarantino played Richie in the movie. In the 2013 TV series, he was played by Zane Holtz.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 130 }, { "error type": "Unverifiable", "explanation": "", "start": 155, "end": 220 }, { "error type": "Irrelevant", "explanation": "", "start": 221, "end": 279 }, { "error type": "Irrelevant", "explanation": "", "start": 320, "end": 324 }, { "error type": "Irrelevant", "explanation": "", "start": 334, "end": 373 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "From Dusk till Dawn is an American horror franchise created by Quentin Tarantino and Robert Rodriguez. It has spawned three films, a video game, as well as a TV series. In the films, Quentin Tarantino played Richie. In the TV show, Zane Holtz played Richie.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Who sang you dropped a bomb on me?", "passages": [ [ "You Dropped a Bomb on Me", "You Dropped a Bomb on Me\n\n\"You Dropped a Bomb on Me\" is an electrofunk song performed by The Gap Band, released in 1982 on producer Lonnie Simmons' label, Total Experience Records.", "It reached #2 on the \"Billboard\" R&B charts, #39 on the dance charts and #31 on the \"Billboard\" Hot 100.", "In addition to the single release, the song was featured on the band's 1982 album \"Gap Band IV\".", "A notable feature of the song is its use of a synthesizer to imitate the whistling sound of a bomb being dropped.", "This is first heard immediately before the first verse, and throughout the song from the fourth chorus onward.", "The song also features timpani drum rolls.", "In the aftermath of the September 11 attacks, the song was one of those named on the 2001 Clear Channel memorandum of \"lyrically questionable\" songs.", "The song is featured in a Walmart Christmas holiday television commercial which started airing in October 2017.", "The song is frequently played at sporting events.", "For example, it is played at both San Francisco Giants and Houston Astros home games when a player from the home team hits a home run." ] ], "gold": "\"You Dropped a Bomb on Me\" is a song performed by the Gap Band, released in 1982 on producer Lonnie Simmons' label, Total Experience Records. Charlie Wilson sang lead vocals on the song. It reached No.2 on the \"Billboard\" R&B charts, No. 39 on the dance charts, and No. 31 on the \"Billboard\" Hot 100.", "prediction 1": "\"You Dropped a Bomb on Me\" is an electrofunk song performed by The Gap Band, released in 1982 on producer Lonnie Simmons' label, Total Experience Records. It reached #2 on the \"Billboard\" R&B charts, #39 on the dance charts and #31 on the \"Billboard\" Hot 100. The song is featured in a Walmart Christmas holiday television commercial which started airing in October 2017.\n", "prediction 2": "\"You Dropped a Bomb on Me\" is an electrofunk song performed by The Gap Band, released in 1982 on producer Lonnie Simmons' label, Total Experience Records. It reached #2 on the Billboard R&B charts, #39 on the dance charts and #31 on the Billboard Hot 100. The song is also featured in a Walmart Christmas holiday television commercial which started airing in October 2017.", "prediction 3": "You Dropped a Bomb on Me is an electrofunk song performed by The Gap Band. This song was released in 1982 on producer Lonnie Simmons' label, Total Experience Records. It reached #2 on the Billboard R&B charts, #39 on the dance charts and #31 on the Billboard Hot 100.", "prediction 4": "There are several songs called, \"You Dropped a Bomb on Me\". One of them, \"You Dropped a Bomb on Me\", was sung by The Gap Band. Another, \"Money\" Was Sung by Latin King, This is What You Get\", was sung by Guru, and Another, \"Love Never Fades From Love And All That Jazz...\" was sung by The Gap Band.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 372 } ], "missing-info": [], "corrected-prediction": "\"You Dropped a Bomb on Me\" is an electrofunk song performed by The Gap Band, released in 1982 on producer Lonnie Simmons' label, Total Experience Records. It reached #2 on the \"Billboard\" R&B charts, #39 on the dance charts and #31 on the \"Billboard\" Hot 100." }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What are the products that result from the light reactions of photosynthesis?", "passages": [], "gold": "02, NADPH and ATP are the products that result from the light reactions of oxygenic photosynthesis. Sulfur, NADH, and ATP result from the light reactions of photosynthesis by green sulfur bacteria.", "prediction 1": "The products that result from the light reactions of photosynthesis are phosphorus, methane, and ethane.\n", "prediction 2": "The products that result from the light reactions of photosynthesis are dimethicone, ethylene, and benzo[amid]; dimethyl acetate [methyl n-acetyl sulfide], and dimethyl diphenyl sulfide.", "prediction 3": "There are several chemical reactions that can result in the products that result from the light reactions of photosynthesis. For instance, carbon, hydrogen and oxygen.", "prediction 4": "The manufacture of a variety of products from photosynthesis using sunlight.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 105 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is the release date for flash season 4?", "passages": [ [ "The Flash (season 4)", "Collider's Allison Keene also noted Iris \"getting an actual storyline\" with Barry gone, and similarly presumed that he \"[would] be back in the fold by the end of the first episode\" alike to Flashpoint in the third season.", "She added, \"There are some new foes, lots of action, plenty of tech\u00a0\u2014 it's great!\"", "The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired.", "It will be released on Blu-ray on August 28, 2018.", "The review aggregator website Rotten Tomatoes reported a 76% approval rating with an average rating of 6.65/10 based on 17 reviews.", "The website's consensus reads, \"After an unsteady turn in season three, \"The Flash\" returns to its roots with a fourth season packed with humor, spectacle, and a whole lot of heart.\"", "Reviewing the first two episodes of the season, Allison Keene writing for Collider.com, felt the premiere \"wipes the slate clean, fixing a lot of the issues that plagued the end of the last season, and setting up a much more toned-down storyline.", "Most importantly, it's brought back some fun.\"", "She added that with a \"streamlined team,\" the core characters now have time to interact and have meaningful plot lines." ], [ "The Flash (2014 TV series)", "The Flash (2014 TV series)\n\nThe Flash is an American superhero television series developed by Greg Berlanti, Andrew Kreisberg, and Geoff Johns, airing on The CW.", "It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds.", "It is a spin-off from \"Arrow\", existing in the same fictional universe.", "The series follows Allen, portrayed by Grant Gustin, a crime scene investigator who gains super-human speed, which he uses to fight criminals, including others who have also gained superhuman abilities.", "Initially envisioned as a backdoor pilot, the positive reception Gustin received during two appearances as Barry on \"Arrow\" led to executives choosing to develop a full pilot to make use of a larger budget and help flesh out Barry's world in more detail.", "Colleen Atwood, costume designer for \"Arrow\", was brought in to design the Flash's suit.", "The creative team wanted to make sure that the Flash would resemble his comic book counterpart, and not simply be a poor imitation.", "The series is primarily filmed in Vancouver, British Columbia, Canada.", "\"The Flash\" premiered in North America on October 7, 2014, where the pilot became the second-most watched premiere in the history of The CW, after \"The Vampire Diaries\" in 2009." ], [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ], [ "The Flash (season 4)", "The Flash (season 4)\n\n", "The fourth season of the American television series \"The Flash\", which is based on the DC Comics character Barry Allen / Flash, premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018.", "The season follows a crime scene investigator with superhuman speed who fights criminals, including others who have also gained superhuman abilities.", "It is set in the Arrowverse, sharing continuity with the other television series of the universe, and is a spin-off of \"Arrow\".", "The season is produced by Berlanti Productions, Warner Bros. Television, and DC Entertainment, with Andrew Kreisberg and Todd Helbing serving as showrunners.", "The season was ordered in January 2017, and filming began that July.", "Grant Gustin stars as Barry, with principal cast members Candice Patton, Danielle Panabaker, Carlos Valdes, Keiynan Lonsdale, Tom Cavanagh, and Jesse L. Martin also returning from previous seasons, and are joined by Neil Sandilands.", "\n\nThe series was renewed for a fourth season on January 8, 2017, earlier than usual for the series." ] ], "gold": "The Flash is an American superhero television drama series airing on The CW. It is based on the Barry Allen incarnation of DC Comics character the Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. In January 2020, The CW renewed the series for a seventh season, which premiered on March 2, 2021. The series was renewed for an eighth season in February 2021 and it is set to premiere on November 16, 2021. Season 4 premiered on The CW on October 10, 2017. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It was released on Blu-ray on August 28, 2018.", "prediction 1": "The Flash is an American superhero television series developed by Greg Berlanti, Andrew Kreisberg, and Geoff Johns, airing on The CW. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. The fourth season of the American television series premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It will be released on Blu-ray on August 28, 2018.\n", "prediction 2": "The Flash is an American superhero television series, developed by Greg Berlanti, Andrew Kreisberg, and Geoff Johns, airing on The CW. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. The fourth season of the American television series premiered on October 10, 2017, and ran for 23 episodes until May 22, 2018. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It will be released on Blu-ray on August 28, 2019. Season 4 will be released on Blu-ray on August 28, 2019.", "prediction 3": "In the 2015-2016 TV series The Flash, the protagonist is Grant Gustin, portrayed as a crime scene investigator who gains super-human speed, which he uses to fight criminals, including others who have also gained superhuman abilities. Season 4 of The Flash was released on October 10, 2017. Season 3 of The Flash was released on June 30, 2014.", "prediction 4": "The Flash is an American superhero television series developed by Greg Berlanti, Andrew Kreisberg, and Geoff Johns, airing on The CW. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. The series is a spin-off from the Arrowverse, existing in the same fictional universe. Season 4 premiered on October 10, 2017 on the CW and ran for 23 episodes until May 22, 2018.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Flash is an American superhero television series developed by Greg Berlanti, Andrew Kreisberg, and Geoff Johns, airing on The CW. It is based on the DC Comics character Barry Allen / Flash, a costumed superhero crime-fighter with the power to move at superhuman speeds. The fourth season of the American television series premiered on The CW on October 10, 2017, and ran for 23 episodes until May 22, 2018. The season was made available for streaming on Netflix in late May 2018, soon after the season finale aired. It will be released on Blu-ray on August 28, 2018.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "What two japanese cities were bombed in ww2?", "passages": [ [ "Atomic bombings of Hiroshima and Nagasaki", "The 2006 documentary \"Twice Survived: The Doubly Atomic Bombed of Hiroshima and Nagasaki\" documented 165 \"nij\u016b hibakusha (lit.", "double explosion-affected people)\", nine of whom claimed to be in the blast zone in both cities.", "On March 24, 2009, the Japanese government officially recognized Tsutomu Yamaguchi as a double \"hibakusha\".", "He was confirmed to be from ground zero in Hiroshima on a business trip when the bomb was detonated.", "He was seriously burnt on his left side and spent the night in Hiroshima.", "He arrived at his home city of Nagasaki on August 8, the day before the bombing, and he was exposed to residual radiation while searching for his relatives.", "He was the first officially recognized survivor of both bombings.", "He died on January 4, 2010, at the age of 93, after a battle with stomach cancer.", "During the war, Japan brought as many as 670,000 Korean conscripts to Japan to work as forced labor.", "About 5,000\u20138,000 Koreans were killed in Hiroshima and another 1,500\u20132,000 died in Nagasaki.", "For many years, Korean survivors had a difficult time fighting for the same recognition as \"Hibakusha\" as afforded to all Japanese survivors, a situation which resulted in the denial of the free health benefits to them in Japan." ], [ "Atomic bombings of Hiroshima and Nagasaki", "Atomic bombings of Hiroshima and Nagasaki\n\nDuring the final stage of World War II, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively.", "The United States dropped the bombs after obtaining the consent of the United Kingdom, as required by the Quebec Agreement.", "The two bombings killed 129,000\u2013226,000 people, most of whom were civilians.", "They remain the only use of nuclear weapons in the history of warfare.", "In the final year of the war, the Allies prepared for what was anticipated to be a very costly invasion of the Japanese mainland.", "This undertaking was preceded by a conventional and firebombing campaign that destroyed 67 Japanese cities.", "The war in Europe had concluded when Germany signed its instrument of surrender on May 8, 1945.", "As the Allies turned their full attention to the Pacific War, the Japanese faced the same fate.", "The Allies called for the unconditional surrender of the Imperial Japanese armed forces in the Potsdam Declaration on July 26, 1945\u2014the alternative being \"prompt and utter destruction\".", "The Japanese rejected the ultimatum and the war continued." ], [ "Atomic bombings of Hiroshima and Nagasaki", "By August 1945, the Allies' Manhattan Project had produced two types of atomic bombs, and the 509th Composite Group of the United States Army Air Forces (USAAF) was equipped with the specialized Silverplate version of the Boeing B-29 Superfortress that could deliver them from Tinian in the Mariana Islands.", "Orders for atomic bombs to be used on four Japanese cities were issued on July 25.", "On August 6, one of its B-29s dropped a Little Boy uranium gun-type bomb on Hiroshima.", "Three days later, on August 9, a Fat Man plutonium implosion-type bomb was dropped by another B-29 on Nagasaki.", "The bombs immediately devastated their targets.", "Over the next two to four months, the acute effects of the atomic bombings killed 90,000\u2013146,000 people in Hiroshima and 39,000\u201380,000 people in Nagasaki; roughly half of the deaths in each city occurred on the first day.", "Large numbers of people continued to die from the effects of burns, radiation sickness, and other injuries, compounded by illness and malnutrition, for many months afterward.", "In both cities, most of the dead were civilians, although Hiroshima had a sizable military garrison.", "Japan announced its surrender to the Allies on August 15, six days after the bombing of Nagasaki and the Soviet Union's declaration of war." ] ], "gold": "The United States detonated two nuclear weapons in World War II over the Japanese cities of Hiroshima and Nagasaki on August 6, 1945, and August 9,1945, respectively. The two nuclear bombings killed between 129,000 and 226,000 people, most of whom were civilians. Japan surrendered to the Allies on August 15,1945, six days after the bombing of Nagasaki. To this day, these bombings are the only use of nuclear weapons in armed conflict. ", "prediction 1": "During the final year of World War II, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The bombings killed 129,000\u2013226,000 people, most of whom were civilians. They remain the only use of nuclear weapons in the history of warfare.\n", "prediction 2": "During the final year of World War II, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The two bombings killed 129,000\u2013226,000 people, most of whom were civilians. They remain the only use of nuclear weapons in the history of warfare. Japanese newspapers reported the bombing of Hiroshima and Nagasaki while other Japanese residents claimed the bombing had only occurred in 1944.", "prediction 3": "During the final year of World War II, the United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The two bombings killed 129,000\u2013226,000 people, most of whom were civilians. They remain the only use of nuclear weapons in the history of warfare. Japan announced its surrender to the Allies on August 15, six days after the bombing of Nagasaki and the Soviet Union's declaration of war.", "prediction 4": "On August 6, 1945, the United States detonated the first of two nuclear bombs over the Japanese cities of Hiroshima and Nagasaki, killing a combined number of 129,000 people and force-feeding a total of 226,000 civilians. These bombings remain the only use of nuclear weapons in the history of warfare. On August 9, 1945, the United States dropped the first of two Fat Man plutonium implosion-type bombs on Nagasaki.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 38 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 9 ] } ], "corrected-prediction": "The United States detonated two nuclear weapons over the Japanese cities of Hiroshima and Nagasaki on August 6 and 9, 1945, respectively. The bombings killed 129,000\u2013226,000 people, most of whom were civilians. They remain the only use of nuclear weapons in the history of warfare. Japan announced its surrender to the Allies on August 15, six days after the bombing of Nagasaki.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When does episode 19 of steven universe come out?", "passages": [ [ "Legs from Here to Homeworld", "Legs from Here to Homeworld\n\n\"Legs from Here to Homeworld\" is the 25th episode of the fifth season of the American animated television series \"Steven Universe\", and the 153rd episode of the series overall.", "It was directed by Kat Morris and Liz Artinian and written and storyboarded by Amber Cragg, Hilary Florido, and Tom Herpich, from a story by Morris, Matt Burnett, Ben Levin, Joe Johnston, and series creator and executive producer Rebecca Sugar.", "It premiered at the \"Steven Universe\" panel at San Diego Comic-Con on July 21, 2018, before being released on the Cartoon Network app and website the following day; it was broadcast on television on December 17, 2018.", "Following up on the events of the previous episode \"Reunited\", \"Legs from Here to Homeworld\" sees the Diamonds take Steven and the Crystal Gems back to Homeworld to seek help to cure all corrupted Gems on Earth.", "The episode ends with the introduction of White Diamond, a character theorized about for years by the fans; although she had been hinted at since early in the show's run, and her hand could briefly be seen in a flashback in \"Your Mother and Mine\" earlier in season five, her existence and name had never been officially confirmed prior to the episode, and she was regarded as one of the biggest mysteries of the series." ], [ "Steven Universe (character)", "Steven Universe (character)\n\n", "Steven Quartz Universe is a fictional character and the titular character of the animated series \"Steven Universe\", created by Rebecca Sugar.", "Steven is a hybrid between a \"Gem\", a fictional alien being that exists as a magical gemstone projecting a body of light, and a normal human being.", "Voiced by Zach Callison, he made his debut in the pilot episode of the series and made his main series debut in the first episode, \"Gem Glow\".", "He appears in almost every episode of the series, with the notable exception of Jungle Moon, where he stays fused with Connie as Stevonnie throughout the entire episode.", "The plot is developed from Steven's perspective: the audience learns about the plot and backstory as Steven does.", "Steven was created by Rebecca Sugar.", "In terms of appearance and name, Steven is based on Rebecca Sugar's brother, Steven Sugar, who is a background artist for the show.", "In the pilot, Steven had a gold ring around his gem and appeared significantly older, compared to his design in the series.", "The 14-year-old youngest member of the Crystal Gems.", "A unique being, Steven is the first and only known Gem\u2013human hybrid, the product of the union between the Crystal Gems' original leader, Rose Quartz, and Greg Universe, a human musician and car-wash owner." ], [ "Steven Universe", "In common with other Cartoon Network series, several browser-based games\u2014including \"Heap of Trouble\", \"Goat Guardian\" and \"Gem Bound\"\u2014are available on the channel's website.", "BOOM!", "Studios has published several limited comics series based on \"Steven Universe\":\n\n\nIn October 2015, Cartoon Network announced a line of toys based on \"Steven Universe\", which would be sold by specialty retailers.", "For the 2015 holiday season, Funko made \"Pop!\"", "vinyl figures and Just Toys offered \"blind bag\" novelty products.", "PhatMojo sold plush figures and foam weapons, and Zag Toys released collectible bobbleheads and other mini-figures in early 2016.", "The following year, Toy Factory planned to sell a line of plush and novelty items.", "Cartoon Network sells a variety of products, including mugs, blankets and clothing, based on the show's episodes and characters.", "A film based on the series, \"Steven Universe: The Movie\", is under development as of July 2018.", "It is to be made available on Cartoon Network at an unspecified date.", "\"Steven Universe\" has received critical acclaim, and praise for its art, music, voice performances, storytelling and characterization." ], [ "Sony Crackle", "Among the new programs announced was Crackle's first animated series, \"SuperMansion\"; their first hour long scripted drama, \"The Art of More\"; and \"\", a sequel to 2001's \"Joe Dirt\" being touted as the first ever \"made-for-digital\" movie sequel.", "On June 4, 2015, Crackle announced a new collaboration between Moat and Freewheel in the industry's first-ever comprehensive system to track viewable ad measurement across connected TV.", "On October 8, 2015, Crackle premiered \"SuperMansion\", a stop-motion animated comedy television series created by Matthew Senreich and Zeb Wells.", "The series stars Bryan Cranston, Heidi Gardner, Tucker Gilmore, Keegan-Michael Key, Tom Root, Yvette Nicole Brown, Zeb Wells, and Jillian Bell.", "Emmy-nominated Season 2 premiered February 16, 2017, followed by an original Halloween special, \"SuperMansion:", "Drag Me to Halloween\", that premiered October 5.", "Season 3 is expected in 2018.", "On April 20, 2016, Crackle announced an innovative advertising solution that replaces convention at their upfront presentation called \"BreakFree\" advertising.", "The BreakFree experience promotes binge viewing of Crackle's original shows while creating a story narrative for advertisers." ], [ "Crazy Ex-Girlfriend", "A few of the songs on the show are shot twice, one clean version and an explicit version.", "The explicit versions are posted on Bloom's YouTube channel.", "\"\"Crazy Ex-Girlfriend: Original Television Soundtrack (Season 1 \u2013 Volume 1)\"\" was released on February 19, 2016 in both explicit and clean versions.", "It includes all the songs from the first eight episodes of season one, alongside Bloom's a cappella rough demos of \"Feeling Kinda Naughty\", \"I Have Friends\", \"Settle for Me,\" and \"Sex with a Stranger\" as well as Adam Schlesinger's demo version of \"What'll It Be\".", "\"\"Crazy Ex-Girlfriend: Original Television Soundtrack (Season 1 \u2013 Vol. 2)\"\" was released on May 20, 2016.", "It includes all the songs from the last 10 episodes of season one, as well as demos of \"JAP Battle\", \"I Could If I Wanted To\", \"Women Gotta Stick Together\", \"Group Hang\", and \"You Stupid Bitch\".", "For season two, the songs were released as singles the day of their original airing.", "The full season two soundtrack came out on March 3, 2017." ] ], "gold": "Episode 19 of season 1 of Steven Universe came out on Cartoon Network on May 14, 2014. Episode 19 of season 2 of Steven Universe came out on Cartoon Network on October 8, 2015. Episode 19 of season 3 of Steven Universe came out on Cartoon Network on August 3, 2016. Episode 19 of season 4 of Steven Universe came out on Cartoon Network on March 3, 2017. According to the show's creator, Rebecca Sugar, she was notified in 2016 that the series would be cancelled at the end of the fifth season. She prevailed upon Cartoon Network to extend the fifth season to 32 episodes, in order to have room to complete the story, as well as a follow-up television film, Steven Universe: The Movie. Along with the film, Cartoon Network also greenlighted an additional season of 20 episodes, which would become the sequel series Steven Universe Future, taking place after the events of the film.", "prediction 1": "Episode 19 of the American animated television series Steven Universe came out on Cartoon Network on December 17, 2018. It premiered at the \"Steven Universe\" panel at San Diego Comic-Con on July 21, 2018, before being released on the Cartoon Network app and website the following day; it was broadcast on television on December 17, 2018.\n", "prediction 2": "episode 19 of the American animated television series Steven Universe came out on Cartoon Network on December 17, 2018. It premiered at the Steven Universe panel at San Diego Comic-Con on July 21, 2018, before being released on the network's app and website the following day, and on the television screen on December 17, 2018.", "prediction 3": "How much does Episode 19 of Steven Universe cost to watch? Episode 19 of the fifth season of the American animated television series \"Steven Universe\", the fifteenth episode of the series overall, cost $4.99.", "prediction 4": "\"Steven Universe\" is an American comedy-drama television series based on the comic-book character Steven Universe. Steven Universe is a fictional character, a hybrid between a Gem, a fictional alien being that exists as a magical gemstone projecting a body of light, and a normal human being. Season 5 episode 19 of Steven Universe came out on Cartoon Network on December 17, 2018. The episode 22 of Steven Universe came out on November 29, 2016.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 53 }, { "error type": "Unverifiable", "explanation": "", "start": 101, "end": 119 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 120, "end": 122 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who sang you are my one and only?", "passages": [ [ "(You're My One and Only) True Love", "(You're My One and Only)", "True Love\n\n\"(You're My One and Only)", "True Love\" was a hit single by Seduction.", "It peaked at #23 on the \"Billboard\" Hot 100 chart, #56 on the R&B chart, and #3 on the Hot Dance Club Play chart.", "It was an unexpected success, achieving Gold certification in the United States.", "This result ultimately opened the door for producers Robert Clivill\u00e9s and David Cole of the C+C Music Factory to release Seduction's first album, \"Nothing Matters Without Love\".", "Lead vocals were performed by an uncredited Martha Wash.\n\n[ Seduction Chart History at Billboard.com]" ], [ "You're My One and Only Love", "You're My One and Only Love\n\n\"You're My One and Only Love\" is a song written by Barney Kessel and Jack Marshall and performed by Ricky Nelson.", "The song reached #14 on the \"Billboard\" Hot 100 in 1957.", "The song's B-side is \"Honey Rock\" by Barney Kessel." ] ], "gold": "You're My One and Only Love is a song written by Barney Kessel and Jack Marshall, and originally performed by Ricky Nelson. The song reached number 14 on the Billboard Hot 100 in 1957. (You're My One and Only) True Love was a single by Seduction. Although uncredited, the lead vocals and background vocals were actually performed by Martha Wash, with additional background vocals by Seduction.", "prediction 1": "\"You're My One and Only Love\" is a song written by Barney Kessel and Jack Marshall and performed by Ricky Nelson. The song reached #14 on the \"Billboard\" Hot 100 in 1957. The song's B-side is \"Honey Rock\" by Barney Kessel.\n", "prediction 2": "\"You're My One and Only Love\" is a song written by Barney Kessel and Jack Marshall and performed by Ricky Nelson. The song reached #14 on the \"Billboard\" Hot 100 in 1957. Ricky Nelson also performed a cover of You're My One and Only Love on his 1957 album Nothing Matters Without Love.", "prediction 3": "\"You're My One and Only Love\" is a song written by Barney Kessel and Jack Marshall and performed by Ricky Nelson. It's B-side is \"Honey Rock\" by Barney Kessel. Lead vocals were performed by an uncredited Martha Wash.", "prediction 4": "You're My One and Only True Love was a hit single by Seduction, peaked at #23 on the Billboard Hot 100 chart, #56 on the R&B chart, and #3 on the Hot Dance Club Play chart. For Ricky Nelson, You're My One and Only Love was performed by his brother, Allan Nelson. Lead vocals were performed by an uncredited Martha Wash.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 223 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"You're My One and Only Love\" is a song written by Barney Kessel and Jack Marshall and performed by Ricky Nelson. The song reached #14 on the \"Billboard\" Hot 100 in 1957. True Love \"(You're My One and Only) was a hit single by Seduction. Lead vocals were performed by an uncredited Martha Wash.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "What did the sea dogs have that led to their defeat of the spanish armada?", "passages": [ [ "Sea Dogs", "A favorite of the queen, he received a title that allowed him to claim any land he discovered in the name of England.", "During an expedition to the New World, he founded the colony of Roanoke.", "This colony however ended up disappearing mysteriously.", "Raleigh became infatuated with the idea of a \u201ccity of gold\u201d hidden somewhere in South America and set out on an expedition to find it.", "On his second expedition to find \u201cEl Dorado\u201d he ended up in a bit of a predicament after men under his subordinate Lawrence Keymis looted a Spanish Outpost.", "After this outrage Raleigh went back to England and the Spanish were not very happy with what Raleigh's men did in violation of the extant peace treaties.", "In order to make things right to the Spaniards, Raleigh was executed in the reign of King James I. King Phillip II of Spain had a very large and powerful navy that he claimed to be \u201cinvincible\u201d.", "However, after years of picking off and looting by English Sea Dogs he decided he had had enough.", "Phillip took his whole armada of 130 ships into the English Channel and decided to attempt to end English Piracy for good.", "The Spanish ships were bigger and more heavily armed but the English ships were smaller, faster, and more maneuverable.", "Concurrently, there was a huge storm that came in while the Spaniards were on their way and the Spanish suffered terrible losses." ], [ "Sea Dogs", "Sea Dogs\n\nThe Sea Dogs were a group of sea-raiders, (privateers, \"Elizabethan Pirates\"), who were authorised by Queen Elizabeth I of England, and also engaged in slave trading.", "The Sea Dogs were essentially a military branch that were authorised by the Queen to attack the Spanish fleet and loot their ships in order to bring back riches and treasure.", "They carried \"Letters of Marque\" which made their plundering of Spanish ships legal under English Law despite not being at war.", "The Sea Dogs were started in 1560 as a way to bridge the gap between the Spanish Navy and the English Navy.", "By having a small fleet of ships that would sail around and pick off Spanish ships, risking their lives and own ships in the process, they were able to reduce the funds and size of the Spanish navy significantly.", "The Sea Dogs continued carrying out raids against the Spanish until 1604 when England and Spain made peace.", "After that, many of the Sea Dogs continued as pirates employed by the Barbary States, in what would become the Anglo-Turkish piracy in the Caribbean.", "Sir Francis Drake, El Draque (The Dragon), was one of the most profitable and successful sea dogs of all time.", "The captain of \"Golden Hind\", he served in the English Navy from 1563\u20131596 and achieved the rank of Vice Admiral." ] ], "gold": "The Sea Dogs were a group of sea-raiders and privateers who were authorized by Elizabeth I of England and active from 1560-1605. They also engaged in slave trading, and committed piracy in the Caribbean, Spanish colonies as well as in European waters. After years of picking off and looting by English Sea Dogs, Philip II of Spain decided that he had had enough and mobilized an armada of 130 ships to sail into the English Channel and decided to attempt to end English sea-raiding for good. The sea dogs were able to defeat the Spanish armada in a huge storm because their ships were smaller, faster, and more man\u0153uvrable. ", "prediction 1": "The Sea Dogs were a group of sea-raiders, (privateers, \"Elizabethan Pirates\"), who were authorised by Queen Elizabeth I of England, and also engaged in slave trading. They carried \"Letters of Marque\" which made their plundering of Spanish ships legal under English Law despite not being at war.\n", "prediction 2": "The Sea Dogs were a group of sea-raiders, (privateers, Elizabethan Pirates), who were authorised by Queen Elizabeth I of England, who were also engaged in slave trading. They carried Letters of Marque which made their plundering of Spanish ships legal under English Law despite not being at war.", "prediction 3": "The Sea Dogs were a group of sea-raiders who were authorised by Queen Elizabeth I of England and also engaged in slave trading. They had a small fleet of ships that would sail around and pick off Spanish ships, risking their lives and own ships in the process, they were able to reduce the funds and size of the Spanish navy significantly.", "prediction 4": "The Sea Dogs were a group of sea-raiders, who were authorised by Queen Elizabeth I of England, who also engaged in slave trading. They were started in 1560 as a way to bridge the gap between the Spanish Navy and the English Navy. By having a small fleet of ships that would sail around and pick off Spanish ships, risking their lives and own ships in the process, they were able to reduce the funds and size of the Spanish navy significantly. They defeated the Spanish armada in a huge storm that came in while the Spanish suffered terrible losses.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 78 }, { "error type": "Irrelevant", "explanation": "", "start": 167, "end": 295 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8, 9 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 11 ] } ], "corrected-prediction": "The Sea Dogs were a group of sea-raiders and privateers who were authorized by Queen Elizabeth I of England. They also engaged in slave trading. After years of picking off and looting by English Sea Dogs, Philip II of Spain decided that he had had enough and mobilized an armada of 130 ships to sail into the English Channel and decided to attempt to end English sea-raiding for good. However, the English ships were smaller, faster, and more maneuverable. Concurrently, there was a huge storm that came in while the Spaniards were on their way causing them to suffer terrible losses.\n" }, "preference": [ 0, 1, 1, 1, 1, 2 ] }, { "question": "Doc martin how many episodes in season 7?", "passages": [ [ "Doc Martin", "Doc Martin\n\nDoc Martin is a British television medical comedy drama series starring Martin Clunes in the title role.", "It was created by Dominic Minghella after the character of Dr Martin Bamford in the 2000 comedy film \"Saving Grace\".", "The programme is set in the fictional seaside village of Portwenn and filmed on location in the village of Port Isaac, Cornwall, England, with most interior scenes shot in a converted local barn.", "Seven series aired between 2004 and 2015, and a television film aired on Christmas Day 2006.", "The eighth and most recent series began airing on ITV on 20 September 2017, and streams in the United States and Canada on Acorn TV.", "An American TV remake of the series is also being planned.", "While it was initially reported that the series would end after Series 9 in 2019, Martin Clunes clarified that it had only been commissioned as far as the next year, thereby not ruling out future plans by the broadcaster.", "Dr Martin Ellingham (Martin Clunes), a brilliant and successful vascular surgeon at Imperial College London, develops haemophobia (a fear of blood), forcing him to stop practising surgery.", "He obtains a post as the sole general practitioner (GP) in the sleepy Cornish village of Portwenn, where he had spent childhood holidays with his Aunt Joan (Stephanie Cole), who owns a local farm." ], [ "Doc Martin", "Series 6 of Doc Martin was released in Region 1 in December 2013 and in the UK (Region 2) on 24 March 2014.", "Series 7 of Doc Martin was released on DVD/Blu-ray in Region 1 on December 8, 2015 and in the UK (Region 2) on 16 November 2015.", "In Region 4, Series 1, 2, 4, and \"On the Edge\" were released separately and in a nine-disc boxset entitled \"Doc Martin: Comedy Cure\", as well as an earlier seven-disc boxset not including Series 4.", "The two Sky Pictures telefilms were individually released in Region 4 (as 'Doc Martin: volume 1' and 'Doc Martin: volume 2, the Legend of the Cloutie') on the Magna Pacific label, but are now out-of-print.", "Series 1-8 are streaming on Acorn TV in the U.S. and Canada.", "The programme is available on Netflix.", "Series 1-6 are currently available on Amazon Prime Video.", "Two novels were released to coincide with the sixth series." ] ], "gold": "Doc Martin is a British television medical comedy drama series starring Martin Clunes as Doctor Martin Ellingham. Nine series aired between 2004 and 2019, with a television film airing on Christmas Day in 2006. There were 6 episodes in series 1, 7 episodes in series 3, and 8 episodes in series 7.", "prediction 1": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. There are 8 episodes in season 7 of the show.\n", "prediction 2": "Doc Martin is a British television medical comedy drama starring Martin Clunes in the title role. There are 7 episodes in season 7 of the series.", "prediction 3": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. There were 7 episodes in season 7 of Doc Martin.", "prediction 4": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. There are 11 episodes in season 7 of the series, totaling 11. Episode 9 was added in May 18th, 2017. Episode 7 was added in April 23rd, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 105, "end": 151 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. Seven series aired between 2004 and 2015, and a television film aired on Christmas Day 2006.\n" }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "What is the second largest city in the usa?", "passages": [ [ "Los Angeles", "Los Angeles\n\nLos Angeles (; ), officially the City of Los Angeles and known colloquially by its initials L.A., is the most-populous city in California.", "It is the second-most populous city in the United States, after New York City, and the largest and most populous city in the Western United States.", "With an estimated population of four million, Los Angeles is the cultural, financial, and commercial center of Southern California.", "Nicknamed the \"City of Angels\" partly because of its name's Spanish meaning, Los Angeles is known for its Mediterranean climate, ethnic diversity, Hollywood and the entertainment industry, and sprawling metropolis.", "Los Angeles is located in a large basin bounded by the Pacific Ocean on one side and by mountains as high as on the others.", "The city proper, which covers about , is the seat of Los Angeles County, the most populated county in the country.", "Los Angeles is the principal city of the Los Angeles metropolitan area; with a population of 13.1 million residents it is the second largest in the United States after that of New York City.", "It is part of the Los Angeles-Long Beach combined statistical area, also the second most populous in the nation with a 2015 estimated population of 18.7 million.", "Los Angeles is one of the most substantial economic engines within the United States, with a diverse economy in a broad range of professional and cultural fields." ], [ "Juneau, Alaska", "Juneau, Alaska\n\nThe City and Borough of Juneau ( ; Tlingit: ), commonly known as Juneau, is the capital city of Alaska.", "It is a unified municipality on Gastineau Channel in the Alaskan panhandle, and it is the second largest city in the United States by area.", "Juneau has been the capital of Alaska since 1906, when the government of what was the District of Alaska was moved from Sitka as dictated by the U.S. Congress in 1900.", "The municipality unified on July 1, 1970, when the city of Juneau merged with the city of Douglas and the surrounding Greater Juneau Borough to form the current municipality, which is larger by area than both Rhode Island and Delaware.", "Downtown Juneau () is nestled at the base of Mount Juneau and across the channel from Douglas Island.", "As of the 2010 census, the City and Borough had a population of 31,276.", "In 2014, the population estimate from the United States Census Bureau was 32,406, making it the second most populous city in Alaska after Anchorage.", "Fairbanks, however, is the state's second most populous metropolitan area, with roughly 100,000 residents.", "Juneau's daily population can increase by roughly 6,000 people from visiting cruise ships between the months of May and September." ] ], "gold": "The second largest city in the USA by population is Los Angeles, California, with a 2020 population of 3,898,747. Alternatively, the second largest city in the country by area is Juneau, Alaska, with an area larger than both Rhode Island and Delaware.", "prediction 1": "The second largest city in the United States by population is Los Angeles, California. It is the largest and most populous city in the Western United States. The second largest city in the Western United States by population is Juneau, Alaska.\n", "prediction 2": "The second largest city by area in the United States by population is Juneau, Alaska. The city is bigger by population by 7.8 square miles and larger by area than Fairbanks, Alaska.", "prediction 3": "The second largest city in the United States geographically is Juneau, Alaska. By population, Juneau is larger by surface area than both Rhode Island and Delaware.", "prediction 4": "The second-largest city in the United States based on population statistics is Los Angeles with an estimated population of four million.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 157 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[2]}", "start": 214, "end": 224 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The second largest city in the United States by population is Los Angeles, California. It has an estimated population of four million. The second largest city in the United States by area is Juneau, Alaska. It is larger by area than both Rhode Island and Delaware.\n" }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who wrote the song where have all the flowers gone?", "passages": [ [ "Where Have All the Flowers Gone?", "Where Have All the Flowers Gone?", "\"Where Have All the Flowers Gone?\" is a modern folk-style song.", "The melody and the first three verses were written by Pete Seeger in 1955 and published in \"Sing Out!\" magazine.", "Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song.", "Its rhetorical \"where?\" and meditation on death place the song in the \"ubi sunt\" tradition.", "In 2010, the \"New Statesman\" listed it as one of the \"Top 20 Political Songs\".", "The 1964 release of the song as a Columbia Records Hall of Fame series 45 single, 13-33088, by Pete Seeger was inducted into the Grammy Hall of Fame in 2002 in the Folk category.", "Seeger found inspiration for the song in October 1955 while he was on a plane bound for a concert at Oberlin College, one of the few venues which would hire him during the McCarthy era.", "Leafing through his notebook he saw the passage, \"Where are the flowers, the girls have plucked them.", "Where are the girls, they've all taken husbands.", "Where are the men, they're all in the army.\"" ] ], "gold": "The melody and the first three verses for Where Have All the Flowers Gone were written by Pete Seeger in 1955 and published in Sing Out magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song. Seeger found inspiration for the song in October 1955 while he was on a plane bound for a concert at Oberlin College, one of the few venues which would hire him during the McCarthy era.", "prediction 1": "\"Where Have All the Flowers Gone?\" is a modern folk-style song. The melody and the first three verses were written by Pete Seeger in 1955 and published in \"Sing Out!\" magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song. Its rhetorical \"where?\" and meditation on death place the song in the \"ubi sunt\" tradition. The 1964 release of the song as a Columbia Records Hall of Fame series 45 single, 13-33088, by Pete Seeger was inducted into the Grammy Hall of Fame in 2002 in the Folk category.\n", "prediction 2": "Where Have All the Flowers Gone? is a modern folk-style song. The melody and the first three verses were written by Pete Seeger in 1955 and published in Sing Out! magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song. Retrieved in 2013.", "prediction 3": "The melody and the first three verses of Where Have All the Flowers Gone were written by Pete Seeger in 1955 and published in Sing Out! magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song.", "prediction 4": "The melody and the first three verses were written by Pete Seeger in 1955 and published in \"Sing Out!\" magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song. Where Have All the Flowers Gone? is a modern folk-style song. The melody and the first three verses were written by Sloan Bowers in 1962 and published in American Folklore Magazine. The song was released in 1964 as a Columbia Records Hall of Fame series 45 single, 13-33088, which was inducted into the Grammy Hall of Fame in 2002 in the Folk category.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 272, "end": 363 }, { "error type": "Irrelevant", "explanation": "", "start": 364, "end": 543 }, { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 63 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The melody and the first three verses for Where Have All the Flowers Gone were written by Pete Seeger in 1955 and published in \"Sing Out!\" magazine. Additional verses were added in May 1960 by Joe Hickerson, who turned it into a circular song. Seeger found inspiration for the song in October 1955 while he was on a plane bound for a concert at Oberlin College, one of the few venues which would hire him during the McCarthy era." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who won the smackdown tag team champions at money in the bank?", "passages": [ [ "Money in the Bank (2017)", "Three days later, the two were scheduled to face The Col\u00f3ns (Primo and Epico) on the Money in the Bank pre-show.", "During the pre-show, The Hype Bros (Mojo Rawley and Zack Ryder) faced The Col\u00f3ns (Primo Col\u00f3n and Epico Col\u00f3n).", "Ryder and Rawley executed the \"Hype Ryder\" on Epico to win the match.", "The actual pay per-view opened with the first Women's Money in the Bank ladder match.", "In the climax, as Becky Lynch attempted to retrieve the briefcase, Carmella's manager James Ellsworth pushed the ladder over.", "Ellsworth retrieved the briefcase for Carmella and dropped it to her, thus Carmella won the match.", "Two of the three referees did not agree with the decision and General Manager Daniel Bryan said that the controversy would be dealt with on the following episode of \"SmackDown Live\".", "Next, The Usos defended the SmackDown Tag Team Championship against The New Day's Big E and Kofi Kingston.", "In the end, Big E and Kingston performed the \"Midnight Hour\" on Jey.", "Kingston pinned Jey, only for Jimmy to pull Jey out of the ring to void the pinfall and the two were intentionally counted out.", "Thus, The New Day won, but The Usos retained the titles." ], [ "Money in the Bank (2018)", "On June 2, another match between the two was made for Money in the Bank.", "On the May 15 episode of \"SmackDown\", SmackDown Women's Champion Carmella celebrated her championship reign.", "SmackDown General Manager Paige interrupted Carmella and scheduled a title match between her and Asuka for Money in the Bank.", "On the May 22 episode of \"SmackDown\", Luke Gallows and Karl Anderson defeated The Usos (Jey and Jimmy Uso) to become the number one contenders to face The Bludgeon Brothers (Harper and Rowan) for the SmackDown Tag Team Championship at Money in the Bank.", "The match was scheduled for the Money in the Bank pre-show.", "During the pre-show, The Bludgeon Brothers (Harper and Rowan) defended the SmackDown Tag Team Championship against Luke Gallows and Karl Anderson.", "Harper and Rowan performed \"The Reckoning\" on Gallows to retain the title.", "The actual pay-per-view opened with Daniel Bryan facing Big Cass.", "In the climax, Bryan performed a running high knee on Cass and forced him to submit with a heel hook.", "Next, Bobby Lashley faced Sami Zayn.", "In the climax, Lashley performed three delayed vertical suplexes on Zayn for the pinfall.", "After that, Seth Rollins defended the Intercontinental Championship against Elias." ], [ "Survivor Series (2013)", "In the first match, WWE Tag Team Champions Cody Rhodes and Goldust, The Usos and Rey Mysterio faced The Shield and The Real Americans in a traditional Survivor Series elimination match.", "Ambrose was eliminated by Rhodes with a roll up.", "Swagger was eliminated by Jey after a 619 by Mysterio, a Superkick by Jimmy and a Samoan Splash by Jey.", "Cesaro was eliminated by Rhodes with a roll up.", "Jimmy was eliminated by Reigns after a Spear.", "Rhodes was eliminated by Reigns after a Spear.", "Jey was eliminated by Rollins after a Curb Stomp.", "Rollins was eliminated by Mysterio with a Roll Up.", "Goldust was eliminated by Reigns after a Spear.", "Mysterio was eliminated by Reigns after a Spear, leaving Reigns as the sole survivor.", "Next, Big E Langston defended the WWE Intercontinental Championship against Curtis Axel.", "Big E pinned Axel after a \"Big Ending\" to retain the title.", "After that, Team Total Divas (Natalya, The Bella Twins, The Funkadactyls, JoJo and Eva Marie faced Team True Divas (Divas Champion AJ Lee, Tamina Snuka, Kaitlyn, Alicia Fox, Aksana, Rosa Mendes and Summer Rae in a traditional Survivor Series elimination match.", "Fox was eliminated by Naomi after a Split-Legged Moonsault." ], [ "Clash of Champions (2017)", "Gable and Benjamin received their SmackDown Tag Team Championship match on the November 7 episode of \"SmackDown\" and defeated champions The Usos (Jey and Jimmy Uso), but by count-out, and as a result, The Usos retained the titles.", "A few weeks later, it was announced that The Usos would defend the SmackDown Tag Team Championship against The New Day and Gable and Benjamin in a triple threat tag team match at Clash of Champions.", "On the December 5 episode, Rusev and Aiden English were added to the match after defeating The New Day's Big E and Kingston, making it a fatal four-way tag team match.", "Throughout the summer of 2017, Kevin Owens had issues with Commissioner Shane McMahon, which lead to a Hell in a Cell match at Hell in a Cell where Sami Zayn appeared and helped Owens defeat Shane.", "On the following episode of \"SmackDown\", Zayn explained that during the Superstar Shake-up, he was glad that he was brought to SmackDown, which had been called the \"land of opportunity\", but he never got an opportunity, and after Shane ignored his warning about facing Owens, he realized that Shane did not actually care about him and Shane only cared about himself and that was why he saved Owens." ] ], "gold": "At Money in the Bank in 2021, Rey Mysterio and Dominik Mysterio defended the SmackDown Tag Team Championship against The Usos, Jey and Jimmy. During the match, Jey caught Rey with a Superkick in mid-air and then performed the Uso Splash on Rey for a nearfall. In the end, as Rey attempted a 619 on Jey, Jimmy protected Jey with Jimmy receiving the 619 instead. Jey then performed a roll-up on Rey with an assist from Jimmy to win the title for the fifth time. This was also their seventh overall tag team championship in WWE. At Money in the Bank in 2020, The New Day's Big E defeated Jey Uso, representing The Usos, and defending co-champion The Miz, representing himself and John Morrison, in a triple threat match to win the SmackDown Tag Team Championship for The New Day. At Money in the Bank in 2019, The Usos faced SmackDown Tag Team Champions Daniel Bryan and Rowan in a non-title match. In the end, The Usos performed a double \"Uso Splash\" on Bryan to win the match. At Money in the Bank in 2018, during the Money in the Bank Kickoff pre-show, The Bludgeon Brothers, Harper and Rowan, defended the SmackDown Tag Team Championship against Luke Gallows and Karl Anderson. In the climax, both Gallows and Anderson proceeded to apply the \"magic killer\" on Harper when Rowan speared Anderson and isolated Gallows. Harper and Rowan then performed \"the reckoning\" on Gallows to retain the title.", "prediction 1": "The SmackDown Tag Team Championship was won by The Usos against The New Day's Big E and Kofi Kingston at Money in the Bank. The Bludgeon Brothers won the SmackDown Tag Team Championship at Money in the Bank. The Bludgeon Brothers defeated Luke Gallows and Karl Anderson at Money in the Bank. The Bludgeon Brothers performed The Reckoning on Gallows to retain the title.\n", "prediction 2": "At Money in the Bank in March 2018, The Usos won the SmackDown Tag Team Championship while The New Day's Big E won the SmackDown Tag Team Championship. Later in the year, on the Money in the Bank pre-show, The Bludgeon Brothers won the SmackDown Tag Team Championship. During this same pre-show, the Bludgeon Brothers successfully defended the SmackDown Tag Team Championship against Luke Gallows and Karl Anderson, while Hart and Rowan successfully defended the SmackDown Soulmate Tag Team Championship.", "prediction 3": "There are several smackdown tag team champions. Cody Rhodes won the smackdown tag team championship at Money in the Bank. Cody Rhodes and Goldust won the smackdown tag team championship at Money in the Bank. The Bludgeon Brothers won the smackdown tag team championship at Money in the Bank. During the Money in the Bank pre-show, The Hype Bros (Mojo Rawley and Zack Ryder) faced The Col\u00f3ns (Primo Col\u00f3n and Epico Col\u00f3n). Ryder and Rawley executed the \"Hype Ryder\" on Epico Col\u00f3n to win the match. Ryder and Rawley executed the \"Hype Ryder\" on Epico to win the match. Ryder and Rawley executed the \"Hype Bros\" on Epico Col\u00f3n to win the match.", "prediction 4": "At Money in the Bank 2018, the SmackDown Tag Team Championship was won by The Usos and Rey Mysterio. On the May 22 episode of SmackDown, Luke Gallows and Karl Anderson defeated The Usos and Jimmy Uso to become the number one contenders to face The Bludgeon Brothers (Harper and Rowan) for the SmackDown Tag Team Championship. The Bludgeon Brothers performed The Reckoning on Gallows to retain the title. The actual pay-per-view opened with Daniel Bryan facing Big Casssss.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[11]}", "start": 47, "end": 101 }, { "error type": "Redundant", "explanation": "The SmackDown Tag Team Championship was won by The Usos against The New Day's Big E and Kofi Kingston at Money in the Bank.", "start": 146, "end": 207 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "The SmackDown Tag Team Championship was won by The New Day, but The Usos retained the titles at Money in the Bank(2017). The Bludgeon Brothers (Harper and Rowan) defeated Luke Gallows and Karl Anderson when they performed The Reckoning on Gallows to retain the title, during the 2018 pre-show.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who sang if i could save time in a bottle?", "passages": [ [ "Time in a Bottle", "Time in a Bottle\n\n\"Time in a Bottle\" is a hit single by singer-songwriter Jim Croce.", "Croce wrote the lyrics after his wife Ingrid told him she was pregnant, in December 1970.", "It appeared on his 1972 ABC debut album \"You Don't Mess Around with Jim\".", "ABC originally did not intend to release the song as a single; but when Croce was killed in a plane crash in September 1973, the song's lyrics, dealing with mortality and the wish to have more time, had additional resonance.", "The song subsequently received a large amount of airplay as an album track and demand for a single release built.", "When it was eventually issued as a 7\", it became his second and final No. 1 hit.", "After the single had finished its two-week run at the top in early January 1974, the album \"You Don't Mess Around with Jim\" became No. 1 for five weeks.", "In 1977, \"Time in a Bottle\" was used as the title for a of Croce's love songs." ], [ "The Hangover Part II", "The Hangover Part II\n\nThe Hangover Part II is a 2011 American comedy film produced by Legendary Pictures and distributed by Warner Bros. Pictures.", "It is the sequel to the 2009 film \"The Hangover\" and the second installment in \"The Hangover\" trilogy.", "Directed by Todd Phillips, who co-wrote the script with Craig Mazin and Scot Armstrong, the film stars Bradley Cooper, Ed Helms, Zach Galifianakis, Ken Jeong, Jeffrey Tambor, Justin Bartha, and Paul Giamatti.", "It tells the story of Phil, Stu, Alan, and Doug as they travel to Thailand for Stu's wedding.", "After the bachelor party in Las Vegas, Stu takes no chances and opts for a safe, subdued pre-wedding brunch.", "Things do not go as planned, resulting in another bad hangover with no memories of the previous night.", "Development began in April 2009, two months before \"The Hangover\" was released.", "The principal actors were cast in March 2010 to reprise their roles from the first film.", "Production began in October 2010, in Ontario, California, before moving on location in Thailand.", "The film was released on May 26, 2011 and became the highest-grossing R-rated comedy during its theatrical run.", "A third and final installment, \"The Hangover Part III\", was released on May 23, 2013." ], [ "The Brady Bunch Hour", "The Brady Bunch Hour\n\nThe Brady Bunch Hour is an American variety show featuring skits and songs produced by Sid & Marty Krofft Productions in association with Paramount Television that aired on ABC from November 28, 1976 to May 25, 1977.", "The series starred the original cast members of \"The Brady Bunch\", with the exception of Eve Plumb, who was replaced by Geri Reischl (a.k.a.", "\"Fake Jan\").", "The show began as a 60-minute special titled The Brady Bunch Variety Hour on November 28, 1976.", "The special garnered high ratings and led to eight additional 60-minute episodes which were produced and aired sporadically under the shortened title \"The Brady Bunch Hour\" from January 23 to May 25, 1977.", "The show's events are not included or mentioned in the later \"Brady Bunch\" revival series and TV reunion movies.", "When the family is chosen to star in a new variety series for ABC, Mike Brady gives up his architectural career and moves his family into a beach-side home somewhere in Southern California.", "In addition to the Brady clan, next-door-neighbor Jack Merrill (Rip Taylor) frequently finds his way into the act and is a love interest for the Bradys' maid, Alice (her former boyfriend, Sam the Butcher, was never mentioned)." ], [ "Ken Jeong", "Ken Jeong\n\nKendrick Kang-Joh Jeong (born July 13, 1969) is an American comedian, actor and former physician.", "He is best known for playing Ben Chang on the sitcom \"Community\" and the gangster Leslie Chow in \"The Hangover\" film series.", "He was the lead in the ABC sitcom \"Dr. Ken,\" in which he was also the creator, writer, and executive producer.", "Jeong is a licensed physician, but has stopped practicing in favor of his acting career.", "Jeong was born in Detroit to South Korean immigrants.", "Jeong was raised in Greensboro, North Carolina, and attended Walter Hines Page High School, where he took part in the Quiz Bowl team, played violin in the orchestra, and was elected to student council.", "He graduated at 16 and his achievements earned him Greensboro's Youth of the Month award.", "Jeong graduated from Duke University in 1990 and obtained his M.D. at the University of North Carolina at Chapel Hill School of Medicine in 1995.", "Jeong completed his internal medicine residency at Ochsner Medical Center in New Orleans while developing his stand-up comedy.", "Jeong is a licensed physician in California, but no longer practices medicine, having given it up in favor of his acting career." ], [ "Yungblud", "Yungblud\n\nDominic Harrison, who performs as YUNGBLUD, is an English alternative rock musician from Doncaster.", "Yungblud has expressed himself through his music as a \"socially conscious artist unafraid of delivering genre-bending protest songs.\"", "His song \"I Love You, Will You Marry Me\" describes the true story of a man named Jason who proposed to a woman named Clare Middleton through graffiti on Park Hill that ended up being heavily commercialized and profited by apartment owners, but the woman died, and the man is homeless.", "His grandfather performed with T. Rex in the 1970s.", "Yungblud studied theatre in lowercase at Arts Educational Schools, London before beginning his music career.", "His singles began attracting popularity in 2017, when his style was described as \"the spitfire suburban poetry of younger Arctic Monkeys and Jamie T, fused with a healthy touch of ska and hip-hop spirit\".", "Yungblud collaborated with Charlotte Lawrence for the song \"Falling Skies\", which is featured on the season two soundtrack of \"13 Reasons Why\".", "His debut album was released on 6 July 2018.", "Harrison has stated that his biggest influences for his music are the Beatles, Bob Dylan and the Clash." ], [ "Love to Love You Bradys", "Love to Love You Bradys\n\nLove to Love You Bradys: The Bizarre Story of The Brady Bunch Variety Hour is a 2009 coffee table book written by \"The Brady Bunch\" actress Susan Olsen with co-authors Ted Nichelson and Lisa Sutton, about the 1976\u201377 spin-off TV variety show \"The Brady Bunch Hour\".", "The book's release also coincided with the 40th anniversary of the debut of \"The Brady Bunch\".", "The book asserts that the spin-off is noteworthy in television history for being, in Olsen's words, \"spectacularly bad\"; in 2002, it was ranked in the top five worst shows of all time by \"TV Guide.\"", "Olsen details how \"The Brady Bunch\" franchise was taken over by the ABC network in 1976 and the rights were awarded to \"Donny & Marie\" producers Sid and Marty Krofft (without the knowledge or permission of creator Sherwood Schwartz) to produce an all-new variety show starring The Brady Bunch.", "Olsen also reveals behind-the-scenes accounts of the actors' private lives during this period of time, including Maureen McCormick's drug abuse and her failure to show up for taping of the show.", "The book's title is based on the title of the 1975 disco song \"Love to Love You Baby\".", "The variety series was cancelled after nine episodes." ], [ "Maureen McCormick", "Maureen McCormick\n\nMaureen Denise McCormick (born August 5, 1956) is an American actress, singer and author.", "She portrayed Marcia Brady on the ABC television sitcom \"The Brady Bunch\", which ran from 1969 to 1974 and reprised the role in several of the numerous \"Brady Bunch\" spin-offs and films, including \"The Brady Kids\", \"The Brady Bunch Hour\", \"The Brady Brides\" and \"A Very Brady Christmas\" (1988).", "McCormick also appeared in \"The Idolmaker\" (1980) as well as a wide range of other supporting film roles.", "In the 1980s and 1990s, she ventured into stage acting, appearing in a variety of different roles and productions such as Wendy Darling in \"Peter Pan\" and Betty Rizzo in \"Grease\".", "McCormick also had a brief career as a recording artist, releasing four studio albums with the \"Brady Bunch\" cast as well as touring with them.", "Her only release as a solo artist to date is a country music album, \"When You Get a Little Lonely\" (1995).", "Despite professional success on \"The Brady Bunch\" and its spin-offs, McCormick struggled largely in her personal life in the years following the original series' end.", "Addictions to cocaine and quaaludes, as well as bouts of depression and bulimia, all contributed to McCormick losing her reputation for reliability as an actress." ] ], "gold": "Time in a Bottle was originally sung by singer-songwriter Jim Croce but has been sung by others in both film and shows. The song first appeared on Croce's 1972 ABC debut album You Don't Mess Around with Jim, after which actress Maureen McCormick performed it in 1977 on the variety show The Brady Bunch Hour. In the 2011 comedy film The Hangover Part II, the song was sung by actor Ken Jeong. In the 2019 film Hobbes and Shaw, English singer Yungblud sang it.", "prediction 1": "Time in a Bottle is a hit single by singer-songwriter Jim Croce. It appeared on his 1972 ABC debut album You Don't Mess Around with Jim. In 1977, Time in a Bottle was used as the title for a number of Croce's love songs. The song was covered by several artists, including The Brady Bunch Hour, The Hangover Part II, Ken Jeong, and the late, great Tom Hanks.\n", "prediction 2": "While many people sang \"If I Could Save Time in a Bottle\", most sang \"If I Could Save Time in a Bottle\" when Jim Croce sang it. On the show The Brady Bunch Hour, which aired on ABC from November 28, 1976, and in the movie The Hangover Part II, which debuted on May 26, 2011, the comedian Ken Jeong sang it. On the show We Are Family (which debuted on September 6, 2012) and The Hangover Part III, played by Paul Giamatti, the song was heard on the television series. Tim Croce sang \"If I Could Save Time in a Bottle\" when he sang the original lyrics while recording he sang it for Ut Mess Around with Jim Croce in 1970. On his 1972 ABC debut album You Don't Mess Around with Jim, who wrote the lyrics after his wife Ingrid told him she was pregnant.", "prediction 3": "Time in a Bottle is a hit single by singer-songwriter Jim Croce. It appeared on his 1972 ABC debut album You Don't Mess Around with Jim. It was later covered by Croce on his other albums, including his Amplified album \"Stay\" which received US No. 1 radio airplay and the hit single \"Time in a Bottle\". In 2011, American comedy film The Hangover Part II, which was based on the famous 1975 song, made its way to the top of the Billboard Hot 100 Rounder, Tom Ferry recited the song as being the third installment in The Hangover trier von der Kuchen bakerytman in \"Seiem\u00e4rte\" and was also covered by British singer-songwriter Ian O's tune \"Stafard\" in which the song \"I Goffins\" and Volkswagen.", "prediction 4": "Time in a Bottle is the title song to several songs and television specials, including the 1972 ABC debut album You Don't Mess Around with Jim by Jim Croce, the 2011 American comedy film The Hangover Part II by Ken Jeong, and the 2013 TV reunion series The Brady Bunch Hour by Ken Jeong, who was also the lead in that show.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 146, "end": 220 }, { "error type": "Unverifiable", "explanation": "", "start": 221, "end": 326 }, { "error type": "Irrelevant", "explanation": "", "start": 327, "end": 358 } ], "missing-info": [], "corrected-prediction": "Time in a Bottle is a hit single by singer-songwriter Jim Croce. It appeared on his 1972 ABC debut album You Don't Mess Around with Jim. In 1977." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When does pokemon the movie i choose you come out?", "passages": [ [ "Pok\u00e9mon the Movie: I Choose You!", "Pok\u00e9mon the Movie: I Choose You!", "Pok\u00e9mon the Movie: I Choose You!", "is a 2017 Japanese animated adventure film directed by Kunihiko Yuyama, written by Sh\u014dji Yonemura, and produced by OLM.", "Released as the twentieth \"Pok\u00e9mon\" movie, the first film in the \"Sun and Moon\" generation and the first reboot film in the anime film series.", "It sets up an alternate continuity to the main series and acts as a loose retelling of the original \"Kanto League\" saga of the series/show, released to commemorate the anime's twentieth anniversary.", "It premiered at Japan Expo in France on July 6, 2017 and was released in Japan on July 15, 2017.", "The Pok\u00e9mon Company International and Fathom Events released the film on a limited theatrical run in the rest of the world on November 5, 2017, and this was followed by television airings on Disney XD in the United States on November 25, 2017, on CITV in the UK on December 8, 2017, 9Go!", "in Australia on December 10, 2017 and on Gulli in France on December 25, 2017.", "Ash Ketchum wakes up late one morning after having broken his alarm clock in his sleep." ], [ "Pok\u00e9mon the Movie: I Choose You!", "With the film confirmed to be initially released at the French Japan Expo 2017, Western fans requested for the film to be released in theaters in the United States.", "This was eventually confirmed to be released by Fathom Events as a limited release across November 4 and 5, 2017.", "In Australia, the film was also confirmed to be released by Event Cinemas across November 11 and 12, 2017.", "Some fans also requested that voice actress Veronica Taylor should reprise her role as the English voice of Ash Ketchum for the film, but it was later confirmed that the current set of voice actors would stay on.", "The title of the film is also a reference to the first episode of the anime, \"Pok\u00e9mon, I Choose You!\".", "Regular series composer Shinji Miyazaki wrote the film's score for its original release.", "The film's opening song is titled by Rica Matsumoto while the ending is titled by Asuca Hayashi.", "Ed Goldfarb, the composer for the North American adaptations of the anime beginning with \"Pok\u00e9mon: XY\", along with frequent collaborators Akhil Gopal and Kc Daugirdas, composed a new background score for the film's North American release.", "The movie premiered at Japan Expo in France on July 6, 2017, and officially released in Japanese theaters on July 15, 2017." ] ], "gold": "\"I Choose You!\" premiered at Japan Expo in France on July 6, 2017 and was then released in Japan on July 15, 2017. The Pok\u00e9mon Company International and Fathom Events released the film, including its English version, on a limited theatrical run outside of Japan on November 5, 2017, and this was followed by television airings on Disney XD in the United States on November 25, on CITV in the United Kingdom on December 8, and on 9Go! in Australia on December 10.", "prediction 1": "The Pok\u00e9mon Company International and Fathom Events released the 2017 Japanese animated adventure film on a limited theatrical run in the rest of the world on November 5, 2017. This was followed by television airings on Disney XD in the United States on November 25, 2017, on CITV in the UK on December 8, 2017, 9Go! in Australia on December 10, 2017 and on Gulli in France on December 25, 2017. The movie premiered at Japan Expo in France on July 6, 2017, and was officially released in Japanese theaters on July 15, 2017.\n", "prediction 2": "Pok\u00e9mon the Movie: I Choose You! is a 2017 Japanese animated adventure film that was released as the twentieth Pok\u00e9mon movie. The movie premiered at France's Expo de France on July 6, 2017. The film was then released in Japanese theaters on July 15, 2017.", "prediction 3": "Many have seen Pok\u00e9mon the Movie: I Choose You!, a 2017 Japanese animated adventure film that is the 20th movie in the Pok\u00e9mon anime series. It was released as a limited theatrical run in the rest of the world on November 5, 2017. The Pok\u00e9mon Company International and Fathom Events released the movie on a limited theatrical run in the rest of the world on November 5, 2017. This was followed by television airings on Disney XD in the United States on November 25, 2017, on CITV in the UK on December 8, 2017, 9Go! in Australia on December 10, 2017, and on Gulli in France on December 25, 2017.", "prediction 4": "Pok\u00e9mon the Movie: I Choose You! is a 2017 Japanese animated adventure film, released as the twentieth \"Pok\u00e9mon\" movie, the first film in the \"Sun and Moon\" generation and the first reboot film in the anime film series. It premiered at Japan Expo in France on July 6, 2017, and was released in Japanese theaters on July 15, 2017. It was released in Japan on July 15, 2017.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Pok\u00e9mon Company International and Fathom Events released the 2017 Japanese animated adventure film, Pok\u00e9mon the Movie: I Choose You!, on a limited theatrical run in the rest of the world on November 5, 2017. This was followed by television airings on Disney XD in the United States on November 25, 2017, on CITV in the UK on December 8, 2017, 9Go! in Australia on December 10, 2017 and on Gulli in France on December 25, 2017. The movie premiered at Japan Expo in France on July 6, 2017, and was released in Japanese theaters on July 15, 2017.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who used to present the late late show?", "passages": [ [ "The Late Late Show (U.S. talk show)", "The Late Late Show (U.S. talk show)\n\n", "The Late Late Show is an American late-night television talk and variety show on CBS.", "It first aired in January 1995, with host Tom Snyder, followed by Craig Kilborn and Craig Ferguson.", "It is currently hosted by James Corden.", "The show originates from CBS Television City in Los Angeles.", "The show differed from most of the other extant late-night talk shows during its first two decades on air in that it did not use a house band or an in-studio announcer.", "The traditional opening monologue also tended to be different from that of other late night shows tending to avoid jokes with punch lines during Snyder and Ferguson's tenures in favour of a short conversational introduction when Snyder was host and a cold opening featuring either a musical parody, audience interaction, a short sketch or interaction between Ferguson and Geoff Peterson followed by an anecdotal stream of consciousness introduction during most of Ferguson's years.", "While Craig Kilborn opened with a monologue it tended to be shorter than that used by other late shows.", "Corden's approach to the monologue has been a hybrid of topical punchline jokes and a stream of consciousness, although it is usually very short, as the show tends to favor longer recorded sections." ], [ "The Late Late Show (U.S. talk show)", "When Kilborn was on the show, it began with an image of a full moon wavering behind gray stratus clouds, to the tuning of an orchestra, while the announcer\u2014the recorded, modulated voice of Kilborn himself\u2014blurted out, \"\"From the gorgeous, gorgeous Hollywood Hills in sunny California, it's your \"Late Late Show\" with Craig Kilborn.", "Tonight,\"\" and then the guests were announced, backed by the show's theme song, composed by Neil Finn.", "Then Kilborn was presented, \"\"Ladies and gentlemen, *pause*", "Mister Craig Kilborn\"\", with the 1970s disco band Wild Cherry song \"Play That Funky Music\".", "After Kilborn's stand-up monologue, he walked to his \"Bavarian oak desk\" while Finn's theme song continued playing with the chorus \"\"The Late Late Show is starting.", "The Late Late Show is starting now.\"", "\" The \"Desk Chat\" was said to be Craig's favorite part of the show.", "During later seasons, the opening consisted of shots of various Los Angeles hotspots accompanied by a new theme song performed and written by Chris Isaak." ], [ "The Late Late Show with Craig Ferguson", "The Late Late Show with Craig Ferguson\n\n", "The Late Late Show with Craig Ferguson is an American late-night talk show hosted by Scottish American comedian Craig Ferguson.", "It was the third iteration of the \"Late Late Show\" franchise, airing from 2005 to 2014.", "It followed the \"Late Show with David Letterman\" in the CBS late-night lineup, airing weekdays in the U.S. at 12:37\u00a0a.m.", "Taped in front of a live studio audience from Monday to Friday at CBS Television City in Los Angeles, California, directly above the Bob Barker Studio (Studio 33), it was produced by David Letterman's production company Worldwide Pants Incorporated and CBS Television Studios.", "The \"Late Late Show\" franchise had previously aired as \"The Late Late Show with Tom Snyder\", then as \"The Late Late Show with Craig Kilborn\".", "During the late 2004 transition of guest hosts following Craig Kilborn's departure, Craig Ferguson hosted a series of shows in October and November, culminating in being announced on December 7 as the pick for new host.", "After launching \"The Late Late Show with Craig Ferguson\" on January 3, 2005, Ferguson achieved the highest ratings since the show's inception in 1995." ], [ "James Corden", "On 23 March 2015 Corden succeeded Craig Ferguson as host of the American late-night talk show \"The Late Late Show\".", "Corden's Carpool Karaoke through the streets of London with pop singer Adele, a sketch which featured on his talk show in January 2016, was the biggest YouTube viral video of 2016.", "Corden has said that his comedy influences are Graham Norton, Chris Evans, Jonathan Ross, Conan O'Brien, David Letterman, and Stephen Colbert.", "Corden shared a flat with his \"The History Boys\" co-star Dominic Cooper for several years.", "Cooper introduced Corden to his future wife Julia Carey, whom Cooper had known for years.", "Corden married Carey on 15 September 2012.", "The Cordens have three children: son Max (born 22 March 2011), and daughters Carey (born 27 October 2014) and Charlotte (born 12 December 2017).", "Cooper is Max's godfather.", "Corden is a supporter of Premier League football club West Ham United.", "Corden was appointed Officer of the Order of the British Empire (OBE) in the 2015 New Year Honours for services to drama.", "He received the honour from Princess Anne during a ceremony at Buckingham Palace on 25 June 2015." ], [ "Craig Kilborn", "Craig Kilborn\n\nCraig Kilborn (born August 24, 1962) is an American comedian, sports and political commentator, actor, and television host.", "He was the first host of \"The Daily Show\", a former anchor on ESPN's \"SportsCenter\", and Tom Snyder's successor on CBS' \"The Late Late Show\".", "On June 28, 2010, he launched \"The Kilborn File\" after a six-year absence from television.", "\"The Kilborn File\" aired on some Fox stations during a six-week trial run.", "In comedy, he is known for his deadpan delivery.", "The son of Shirley, a school teacher, and Hiram Kilborn, an insurance executive, Craig Kilborn was born in Kansas City and moved to Hastings, Minnesota, where he was raised, at four years of age.", "Kilborn was taller than his peers from an early age, standing out on the playground and then the basketball court as he got older, eventually growing to 6\u00a0ft 5 in (1.96 m).", "In the 9th grade, Kilborn was recruited by the Northside Magicians, an all-star basketball team in Minneapolis.", "He excelled with the Magicians and with the team at Hastings High School as well, earning three letters and multiple all-conference and all-state honors." ] ], "gold": "The Late Late Show, an American late-night television talk and variety comedy show on CBS, has been presented by several people in the past. Before James Corden, who has been the host of the Late Late Show since March 23, 2015, the show was presented by Craig Ferguson, who hosted his first show as the regular host on January 3, 2005. Before Craig Ferguson, the show was presented by Craig Kilborn, who hosted the show from 1999 to 2004. The show's first host was Tom Snyder, who hosted the show when it first aired in January 1995.", "prediction 1": "The Late Late Show is an American late-night television talk and variety show on CBS. It first aired in January 1995, with host Tom Snyder, followed by Craig Kilborn and Craig Ferguson. It is currently hosted by James Corden. The show differed from most of the other extant late-night talk shows during its first two decades on air in that it did not use a house band or an in-studio announcer. Craig Ferguson hosted the show from 2005 to 2014.\n", "prediction 2": "The Late Late Show was an American late-night television talk and variety show hosted by Tom Snyder on CBS, followed by Craig Kilborn on ABC and Craig Ferguson on CBS starting January 3, 2005. On March 23, 2015, James Corden succeeded Craig Ferguson as host of the American late-night talk show The Late Late Show.", "prediction 3": "Tom Snyder presented the first Late Late Show on CBS in January 1995. Craig Kilborn presented another Late Late Show on CBS from 2005-2014. James Corden presented the third Late Late Show on CBS from March 2015 to March 2017.", "prediction 4": "The Late Late Show is an American late-night television talk and variety show on CBS that first aired in January 1995, with host Tom Snyder, followed by Craig Kilborn and Craig Ferguson. On November 22, 2003, Scottish American comedian Craig Ferguson joined the show as its third host. Since then, Corden has presented the show, presenting its first episode since April 25, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 226, "end": 394 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Late Late Show is an American late-night television talk and variety show on CBS. It first aired in January 1995, with host Tom Snyder, followed by Craig Kilborn and Craig Ferguson. It is currently hosted by James Corden, who succeeded Ferguson on 23 March 2015. Craig Ferguson hosted the show from 2005 to 2014.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Who is running for attorney general in florida 2018?", "passages": [ [ "Sean Shaw", "Sean Shaw\n\nSean Shaw (born March 17, 1978) is an American politician, lawyer and former insurance consumer advocate.", "A member of the Democratic party, he represented Florida House of Representatives District 61, which includes portions of Hillsborough County in and around Tampa, including Ybor City and Tampa Heights, for one term from 2016 to 2018.", "He was the Democratic nominee for Florida Attorney General in the 2018 election.", "Prior to his run for the Florida House of Representatives in 2016, he served as Florida's Insurance Consumer Advocate and as an attorney-at-law.", "Shaw assumed his seat when he defeated businesswoman Dianne Hart and radio host Walter Lee Smith II in the Democratic primary; there was no Republican contender.", "Shaw was the Democratic nominee for the office of Florida Attorney General in the 2018 elections.", "According to the \"Tallahassee Democrat\", Shaw's issues included \"gun safety reforms, public corruption, defending civil and equal rights, serving as a check on a Republican Legislature\".", "As Florida Attorney General, Shaw said that he would withdraw Florida from a lawsuit (by the incumbent Republican Attorney General Pam Bondi) that challenged the constitutionality of the Affordable Care Act (Obamacare).", "He lost in the general election to Republican nominee and former judge Ashley Moody on November 6, 2018." ], [ "Ashley Moody", "Ashley Moody\n\nAshley Brooke Moody (born March 1975) is an American attorney and politician from the state of Florida.", "She is the Florida Attorney General-elect.", "Moody graduated from Plant City High School, and the University of Florida with a bachelor's degree and master's degree in accounting.", "She then attended the University of Florida School of Law, graduating with a Juris Doctor.", "She interned for Martha Barnett, the president of the American Bar Association.", "Moody earned a Master of Laws in international law from Stetson University College of Law.", "She joined the law firm Holland & Knight, working in civil litigation.", "Through 1998, Moody was a member of the Democratic Party, when she joined the Republican Party.", "In 2006, Moody was elected to the Thirteenth Judicial Circuit Court of Florida.", "At 31, she was the youngest judge elected in Florida.", "She resigned on April 28, 2017, in order to run for Attorney General of Florida in the 2018 elections.", "She won the Republican Party nomination, defeating Frank White in the primary election.", "She was elected Attorney General, defeating state representative Sean Shaw.", "Moody is from Plant City, Florida.", "She is the oldest of three children born to Carol and", "James S. Moody Jr.", "She and her husband, Justin Duralia, a Drug Enforcement Administration special agent, have two children." ], [ "Shooting of Markeis McGlockton", "Putnam continued to support SYG but was open to making technical changes to help direct law enforcement officials when deciding on a relevant case.", "Ron DeSantis, a supporter of SYG, initially remained silent about the case.", "In a statement published by \"Politico\" on August 6, DeSantis defended the law but criticized Sheriff Gualtieri, stating he believed Gualtieri did not analyze it properly.", "Putnam then expressed his support for Sheriff Gualtieri, noting that DeSantis had no endorsements from Florida sheriffs and accused DeSantis of siding with Sharpton and liberal Democrats.", "In an opinion piece published the day before the primary election, Peter Schorsch of Orlando Rising listed the McGlockton shooting as one of the twenty-five defining moments of the gubernatorial primary.", "In a \"Rolling Stone\" profile about Andrew Gillum published six days before the general election, Jamil Smith wrote that Gillum made Markeis McGlockton \"a staple of his stump speech.\"", "During the primary race for Florida Attorney General, Democrats Sean Shaw and Ryan Torrens both stated they planned to work towards their goal of repealing SYG.", "Shaw met with the McGlockton family and provided his thoughts and prayers to them." ] ], "gold": "The 2018 Florida Attorney General election took place on November 6, 2018. The Republican Primary was an Ashley Moody, Frank White face-off, with a Moody victory. The Democratic primary, was a Sean Shaw, Ryan Torrens battle, where Shaw attempted to sue Torrens off the ballot, claiming he had improperly transferred money into his campaign account, and the judge ruled in Shaw's favor, but the appellate court appealed and Torrens ended up being able to run. Shaw still beat him receiving 73% to Torrens' 27%, making the 2018 Florida Attorney General election an Ashley Moody, Sean Shaw race that Moody won by about six points. ", "prediction 1": "Sean Shaw, an American politician, lawyer and former insurance consumer advocate, was the Democratic nominee for Florida Attorney General in the 2018 elections. Shaw lost in the general election to Republican nominee and former judge Ashley Moody on November 6, 2018. Moody resigned on April 28, 2017, in order to run for Attorney General of Florida in the 2018 elections.\n", "prediction 2": "Republicans Frank White and Keith Darby were the opponents in the 2018 Florida attorney general primary election. Sean Shaw was the Democratic nominee for the office. Ryan Torrens was the Democratic nominee. Republican candidate Ashley Moody was the opponent in the 2018 election.", "prediction 3": "Republican Attorney General-elect Ashley Moody defeated Democratic Party nominee Sean Shaw during the 2018 Florida state election. It was the 72nd year of a 16 person bipartisan primary race for Florida's Attorney General.", "prediction 4": "State Representative Sean Shaw was the Democratic nominee for Florida Attorney General in the upcoming 2018 election. He lost to Republican nominee, attorney and politician, former judge Ashley Moody, in the November 6th general election.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 11, "end": 81 } ], "missing-info": [], "corrected-prediction": "Sean Shaw was the Democratic nominee for Florida Attorney General in the 2018 elections. Shaw lost in the general election to Republican nominee and former judge Ashley Moody on November 6, 2018. Moody resigned on April 28, 2017, in order to run for Attorney General of Florida in the 2018 elections.\n" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "What is the name of the five pillars?", "passages": [ [ "Shahada", "While the first part is seen as a cosmic truth, the second is specific to Islam, as it is understood that members of the older Abrahamic religions do not view Muhammad as one of their prophets.", "The \"Shahada\" is a statement of both ritual and worship.", "In a well-known hadith, Muhammad defines Islam as witnessing that there is no god but God and that Muhammad is God's messenger, giving of alms (\"zakat\"), performing the ritual prayer, fasting during the month of Ramadan and making a pilgrimage to the Kaaba: the \"five pillars\" of Islam are inherent in this declaration of faith.", "Recitation of the \"Shah\u0101dah\" is the most common statement of faith for Muslims.", "In Sunni Islam, it is counted as the first of the Five Pillars of Islam, while the Shi'i Twelvers and Isma'ilis also have the \"Shahada\" as among their pillars of faith.", "It is whispered by the father into the ear of a newborn child, and it is whispered into the ear of a dying person.", "The five canonical daily prayers each include a recitation of the \"Shahada\".", "Recitation of the \"Shahada\" in front of witnesses is also the first and only formal step in conversion to Islam." ], [ "Five Pillars of Islam", "\"Salah\" consists of five daily prayers according to the Sunna; the names are according to the prayer times: \"Fajr\" (dawn), \"Dhuhr\" (noon), \"\u02bfA\u1e63r\" (afternoon), \"Maghrib\" (evening), and \"\u02bfIsh\u0101\u02be\" (night).", "The Fajr prayer is performed before sunrise, Dhuhr is performed in the midday after the sun has surpassed its highest point, Asr is the evening prayer before sunset, Maghrib is the evening prayer after sunset and Isha is the night prayer.", "All of these prayers are recited while facing in the direction of the Kaaba in Mecca and form an important aspect of the Muslim Ummah.", "Muslims must wash before prayer; this washing is called \"wudu\" (\"purification\").", "The prayer is accompanied by a series of set positions including; bowing with hands on knees, standing, prostrating and sitting in a special position (not on the heels, nor on the buttocks).", "A Muslim may perform their prayer anywhere, such as in offices, universities, and fields.", "However, the mosque is the more preferable place for prayers because the mosque allows for fellowship.", "\"Zak\u0101t\" or alms-giving is the practice of charitable giving based on accumulated wealth." ], [ "Five Pillars of Islam", "The word zak\u0101t can be defined as purification and growth because it allows an individual to achieve balance and encourages new growth.", "The principle of knowing that all things belong to God is essential to purification and growth.", "Zak\u0101t is obligatory for all Muslims who are able to do so.", "It is the personal responsibility of each Muslim to ease the economic hardship of others and to strive towards eliminating inequality.", "Zak\u0101t consists of spending a portion of one's wealth for the benefit of the poor or needy, like debtors or travelers.", "A Muslim may also donate more as an act of voluntary charity (\"sadaqah\"), rather than to achieve additional divine reward.", "There are five principles that should be followed when giving the zak\u0101t:\n\nThree types of fasting (\"Siyam\") are recognized by the Quran:", "Ritual fasting, fasting as compensation for repentance (both from sura Al-Baqara), and ascetic fasting (from Al-Ahzab).", "Ritual fasting is an obligatory act during the month of Ramadan.", "Muslims must abstain from food and drink from dawn to dusk during this month, and are to be especially mindful of other sins.", "Fasting is necessary for every Muslim that has reached puberty (unless he/she suffers from a medical condition which prevents him/her from doing so)." ], [ "Ramadan (calendar month)", "Ramadan (calendar month)\n\nRamadan (Arabic: ) or Ramadhan is the ninth month of the Islamic calendar, and the month in which the Quran was revealed to the Islamic prophet Muhammad.", "Fasting during the month of Ramadan is one of the Five Pillars of Islam.", "The month is spent by Muslims fasting during the daylight hours from dawn to sunset.", "According to Islam, the Quran was sent down to the lowest heaven during this month, thus being prepared for gradual revelation by Jibreel (Gabriel) to Muhammad.", "Therefore, Muhammad told his followers that the gates of Heaven would be open for the entire month and the gates of Hell (Jahannam) would be closed.", "The first day of the next month, Shawwal, is spent in celebration and is observed as the \"Festival of Breaking Fast\" or Eid al-Fitr.", "The calendar is a lunar calendar, and months begin when the first crescent of a new moon is sighted.", "Since the Islamic lunar calendar year is 10 to 11 days shorter than the solar year and contains no intercalation, Ramadan migrates throughout the seasons.", "The Islamic day starts after sunset." ], [ "Five Pillars of Islam", "Five Pillars of Islam\n\nThe Five Pillars of Islam (' ; also ' \"pillars of the religion\") are five basic acts in Islam, considered mandatory by believers and are the foundation of Muslim life.", "They are summarized in the famous hadith of Gabriel.", "The Shia, Ahmadiyya, and Sunni agree on the essential details for the performance and practice of these acts, but the Shia do not refer to them by the same name (see Ancillaries of the Faith, for the Twelvers, and Seven pillars of Ismailism).", "They make up Muslim life, prayer, concern for the needy, self-purification, and the pilgrimage, if one is able.", "\"Shahada\" is a declaration of faith and trust that professes that there is only one God \"(Allah)\" and that Muhammad is God's messenger.", "It is a set statement normally recited in Arabic: \"l\u0101 \u02beil\u0101ha \u02beill\u0101-ll\u0101hu mu\u1e25ammadun ras\u016blu-ll\u0101h\" ()", "\"There is no god but God (and) Muhammad is the messenger of God.\"", "It is essential to utter it to become a Muslim and to convert to Islam.", "\"Salah\" (\"\u1e63al\u0101h\") is the Islamic prayer." ] ], "gold": "The Shahada, or profession of faith, is said five times a day during prayer, and it's the first thing said to a newborn, and the last thing to a person on their death-bed, and it shows how the Muslim prayer and the pillars are instrumental from the day a person is born until the day they die. The Second Pillar of Islam is Salat, or prayer, a very specific type of prayer and a very physical type of prayer called prostrations, third Pillar is Zak\u0101t, or almsgiving or charity, the fourth is Swam or fasting, and the fifth is Pilgrimage. The five pillars of Shia Islam are Tawhid, Adl, Nubuwwah, Imamah, and Mi'ad.", "prediction 1": "The five pillars of Islam are: witnessing that there is no god but God and that Muhammad is God's messenger, performing the ritual prayer, fasting during the month of Ramadan and making a pilgrimage to the Kaaba. The five canonical daily prayers each include a recitation of the \"Shahada\". The five pillars of Islam are: performing the ritual prayer, giving alms (zakat), performing the ritual prayer, and making a pilgrimage to the Kaaba.\n", "prediction 2": "Recitation of the \"Shahdah\" is the most common statement of faith for Muslims. The five canonical daily prayers each include a recitation of the \"Shahada.\" The five pillars of Islam are: fasting, worshipping while in the presence of God, performing the ritual prayer, performing the ritual prayer during the month of Ramadan, and making a pilgrimage to the Kaaba.", "prediction 3": "The five pillars of Islam, officially known in Arabic as the Quran as Sura Al-Baqara, are prayer, fasting, alms-giving, and pilgrimage. The five pillars of Islam, which lie at the heart of Islam, are named by its author, Prophet Muhammad. The first pillar, the shahada, is a statement of both ritual and worship. The second pillar, the salah, is the fourth pillar.", "prediction 4": "There are five pillars to Islam. In Islam, it is defined as witnessing that there is no god but God and that Muhammad is God's messenger, giving alms (\"zakat\"), performing the ritual prayer, fasting during the month of Ramadan, and making a pilgrimage to the Kaaba. The five pillars are recited during each one of the daily prayers referred to in the Quran.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The five pillars of Islam are:", "start": 290, "end": 320 }, { "error type": "Redundant", "explanation": "performing the ritual prayer", "start": 321, "end": 350 }, { "error type": "Redundant", "explanation": "performing the ritual prayer", "start": 372, "end": 401 }, { "error type": "Redundant", "explanation": "making a pilgrimage to the Kaaba", "start": 406, "end": 440 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The five pillars of Islam are: witnessing that there is no god but God and that Muhammad is God's messenger, giving of alms (\"zakat\"), performing the ritual prayer, fasting during the month of Ramadan and making a pilgrimage to the Kaaba. The five canonical daily prayers each include a recitation of the \"Shahada\", which is whispered by the father into the ear of a newborn child, and is whispered into the ear of a dying person." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "This organism is found inside the egg of a chicken?", "passages": [ [ "Salmonella enterica", "Salmonella enterica\n\nSalmonella enterica (formerly Salmonella choleraesuis) is a rod-shaped, flagellate, facultative aerobic, Gram-negative bacterium and a species of the genus \"Salmonella\".", "A number of its serovars are serious human pathogens.", "Most cases of salmonellosis are caused by food infected with \"S. enterica\", which often infects cattle and poultry, though other animals such as domestic cats and hamsters have also been shown to be sources of infection in humans.", "Investigations of vacuum cleaner bags have shown that households can act as a reservoir of the bacterium; this is more likely if the household has contact with an infection source (i.e., members working with cattle or in a veterinary clinic).", "Raw chicken eggs and goose eggs can harbor \"S. enterica\", initially in the egg whites, although most eggs are not infected.", "As the egg ages at room temperature, the yolk membrane begins to break down and \"S. enterica\" can spread into the yolk.", "Refrigeration and freezing do not kill all the bacteria, but substantially slow or halt their growth.", "Pasteurizing and food irradiation are used to kill \"Salmonella\" for commercially produced foodstuffs containing raw eggs such as ice cream." ] ], "gold": "Salmonella enterica, formerly Salmonella choleraesuis, is a rod-headed, flagellate, facultative anaerobic, Gram-negative bacterium and a species of the genus Salmonella. Raw chicken eggs and goose eggs can harbor S. enterica, initially in the egg whites, although most eggs are not infected, and as the egg ages at room temperature, the yolk membrane begins to break down and S. enterica can spread into the yolk. Refrigeration and freezing do not kill all the bacteria, but substantially slow or halt their growth, and pasteurizing and food irradiation are used to kill Salmonella for commercially produced foodstuffs containing raw eggs such as ice cream. Foods prepared in the home from raw eggs, such as mayonnaise, cakes, and cookies, can spread salmonellae if not properly cooked before consumption.", "prediction 1": "Salmonella enterica is found inside the egg of a chicken.\n", "prediction 2": "Raw chicken eggs and goose eggs can harbor Salmonella enterica, initially in the egg whites, although most eggs are not infected. As the egg ages at room temperature, the yolk membrane begins to break down and \"Salmonella enterica\" can spread into the yolk.", "prediction 3": "Salmonella enterica is present in the egg of a chicken. It is mainly found in raw chicken eggs and in some raw goose eggs.", "prediction 4": "Salmonella enterica is found within the egg of a chicken. It is one of several harmful pathogens which are present in the egg of poultry and other animals. While raw chicken eggs are typically not infected, eggs from susceptible chickens can have salmonella within.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 58 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Salmonella enterica Salmonella enterica (formerly Salmonella choleraesuis) is a rod-shaped, flagellate, facultative aerobic, Gram-negative bacterium and a species of the genus \"Salmonella\". Raw chicken eggs and goose eggs can harbor \"S. enterica\", initially in the egg whites, although most eggs are not infected. As the egg ages at room temperature, the yolk membrane begins to break down and \"S. enterica\" can spread into the yolk. Refrigeration and freezing do not kill all the bacteria, but substantially slow or halt their growth. Pasteurizing and food irradiation are used to kill \"Salmonella\" for commercially produced foodstuffs containing raw eggs such as ice cream.\n" }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "Who did the mycenaeans fight in the trojan war?", "passages": [ [ "Trojan War", "The glorious and rich city Homer describes was believed to be Troy VI by many twentieth century authors, destroyed in \n1275 BC, probably by an earthquake.", "Its follower Troy VIIa, destroyed by fire at some point during the 1180s BC, was long considered a poorer city, but since the excavation campaign of 1988 it has risen to the most likely candidate.", "The historicity of the Trojan War is still subject to debate.", "Most classical Greeks thought that the war was a historical event, but many believed that the Homeric poems had exaggerated the events to suit the demands of poetry.", "For instance, the historian Thucydides, who is known for being critical, considers it a true event but doubts that 1,186 ships were sent to Troy.", "Euripides started changing Greek myths at will, including those of the Trojan War.", "Near year 100, Dio Chrysostom argued that while the war was historical, it ended with the Trojans winning, and the Greeks attempted to hide that fact.", "Around 1870 it was generally agreed in Western Europe that the Trojan War had never happened and Troy never existed.", "Then Heinrich Schliemann popularized his excavations at Hisarlik, which he and others believed to be Troy, and of the Mycenaean cities of Greece." ], [ "Trojan War", "Trojan War\n\nIn Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans (Greeks) after Paris of Troy took Helen from her husband Menelaus, king of Sparta.", "The war is one of the most important events in Greek mythology and has been narrated through many works of Greek literature, most notably Homer's \"Iliad\".", "The core of the \"Iliad\" (Books II \u2013 XXIII) describes a period of four days and two nights in the tenth year of the decade-long siege of Troy; the \"Odyssey\" describes the journey home of Odysseus, one of the war's heroes.", "Other parts of the war are described in a cycle of epic poems, which have survived through fragments.", "Episodes from the war provided material for Greek tragedy and other works of Greek literature, and for Roman poets including Virgil and Ovid.", "The war originated from a quarrel between the goddesses Hera, Athena, and Aphrodite, after Eris, the goddess of strife and discord, gave them a golden apple, sometimes known as the Apple of Discord, marked \"for the fairest\".", "Zeus sent the goddesses to Paris, who judged that Aphrodite, as the \"fairest\", should receive the apple." ], [ "Achaeans (Homer)", "Achaeans (Homer)\n\nThe Achaeans (; \"Akhaio\u00ed,\" \"the Achaeans\" or \"of Achaea\") constitute one of the collective names for the Greeks in Homer's \"Iliad\" (used 598 times) and \"Odyssey\".", "The other common names are Danaans (; \"Danaoi\"; used 138 times in the \"Iliad\") and Argives (; ; used 182 times in the \"Iliad\") while Panhellenes ( \"Panhellenes,\" \"All of the Greeks\") and Hellenes (; \"Hellenes\") both appear only once; all of the aforementioned terms were used synonymously to denote a common Greek civilizational identity.", "In the historical period, the Achaeans were the inhabitants of the region of Achaea, a region in the north-central part of the Peloponnese.", "The city-states of this region later formed a confederation known as the Achaean League, which was influential during the 3rd and 2nd centuries BC.", "The Homeric \"long-haired Achaeans\" would have been a part of the Mycenaean civilization that dominated Greece from circa 1600 BC until 1100 BC." ], [ "Trojan War", "In 1868, however, the German archaeologist Heinrich Schliemann met Frank Calvert, who convinced Schliemann that Troy was a real city at what is now Hissarlik in Turkey.", "On the basis of excavations conducted by Schliemann and others, this claim is now accepted by most scholars.", "Whether there is any historical reality behind the Trojan War remains an open question.", "Many scholars believe that there is a historical core to the tale, though this may simply mean that the Homeric stories are a fusion of various tales of sieges and expeditions by Mycenaean Greeks during the Bronze Age.", "Those who believe that the stories of the Trojan War are derived from a specific historical conflict usually date it to the 12th or 11th century BC, often preferring the dates given by Eratosthenes, 1194\u20131184 BC, which roughly corresponds with archaeological evidence of a catastrophic burning of Troy VII.", "The events of the Trojan War are found in many works of Greek literature and depicted in numerous works of Greek art.", "There is no single, authoritative text which tells the entire events of the war.", "Instead, the story is assembled from a variety of sources, some of which report contradictory versions of the events.", "The most important literary sources are the two epic poems traditionally credited to Homer, the \"Iliad\" and the \"Odyssey\", composed sometime between the 9th and 6th centuries BC." ], [ "Military of Mycenaean Greece", "The invading force finally succeeded in controlling the island and overthrowing the local Hittite authorities.", "The campaigns of Attarsiya represent the earliest recorded Mycenaean Greek military activity against the Hittites.", "The Hittite-Ahhiyawan confrontation in Wilusa, the Hittite name for Troy, in the 13th century BC may have provided the historical foundation for the Trojan War tradition.", "In circa 1250 BC, the first wave of destruction has been witnessed in various centers of mainland Greece for reasons that cannot be identified by archaeologists.", "These incidents appear to have triggered the massive strengthening and expansion of the fortifications in various sites.", "In some cases, arrangements were also made for the creation of subterranean passages which led to underground cisterns.", "Nevertheless, none of these measures appear to have prevented the final destruction of the Mycenaean palace centers in the 12th century BC.", "The reasons that lead to the collapse of the Mycenaean culture have been hotly debated among scholars.", "The two most common theories are population movement and internal conflict.", "Due to the information offered by the Greek epics and especially by Homer's epics, the \"Iliad\" and \"Odyssey\", this time period of Greek history was regarded as a period of warrior-heroes who led various military campaigns in Greece and adjacent areas." ], [ "Mycenaean Greece", "Mycenaean Greece\n\nMycenaean Greece (or the Mycenaean civilization) was the last phase of the Bronze Age in Ancient Greece, spanning the period from approximately 1600\u20131100 BCE.", "It represents the first advanced civilization in mainland Greece, with its palatial states, urban organization, works of art, and writing system.", "Among the centers of power that emerged, the most notable were those of Pylos, Tiryns, Midea in the Peloponnese, Orchomenos, Thebes, Athens in Central Greece and Iolcos in Thessaly.", "The most prominent site was Mycenae, in the Argolid, after which the culture of this era is named.", "Mycenaean and Mycenaean-influenced settlements also appeared in Epirus, Macedonia, on islands in the Aegean Sea, on the coast of Asia Minor, the Levant, Cyprus and Italy.", "The Mycenaean Greeks introduced several innovations in the fields of engineering, architecture and military infrastructure, while trade over vast areas of the Mediterranean was essential for the Mycenaean economy.", "Their syllabic script, the Linear B, offers the first written records of the Greek language and their religion already included several deities that can also be found in the Olympic Pantheon." ] ], "gold": "In Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans, one of the collective names for the Greeks in Homer's Iliad. The war was waged after Paris of Troy took Helen from her husband Menelaus, king of Sparta. The war is one of the most important events in Greek mythology and has been narrated through many works of Greek literature, most notably Homer's Iliad. Whether there is any historical reality behind the Trojan War remains an open question. Many scholars believe that there is a historical core to the tale. However, this may simply mean that the Homeric stories are a fusion of various tales of sieges and expeditions by Mycenaean Greeks during the Bronze Age. In Mycenaean Greece, the Hittite-Ahhiyawan confrontation in Wilusa, the Hittite name for Troy, in the 13th century BC may have provided the historical foundation for the Trojan War tradition. ", "prediction 1": "In Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans after Paris of Troy took Helen from her husband Menelaus, king of Sparta. The Greeks were part of the Mycenaean civilization that dominated Greece from circa 1600 BC until 1100 BC.\n", "prediction 2": "In Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans after Paris of Troy took Helen from her husband Menelaus, king of Sparta. The Achaeans constitute one of the collective names for the Greeks in Homer's Iliad and Odyssey. The Homeric \"long-haired Achaeans\" would have been a part of the Mycenaean civilization that dominated Greece from circa 1600 BC until 1100 BC.", "prediction 3": "The Mycenaean civilization that dominated Greece from circa 1600 BC until 1100 BC, was the one that fought in the Trojan War. The Achaeans who were known collectively as the Achaeans were of the Mycenaean race. They were represented by Paris of Troy, the daughter of Menelaus, who was a member of the Mycenaean race, and the son of Athena, the daughter of Menelaus.", "prediction 4": "In Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans after Paris of Troy took Helen from her husband Menelaus, king of Sparta. The Greek side that engaged in the war was the Mycenaean civilization.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 160, "end": 267 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 5, "sentence_id": [ 3 ] } ], "corrected-prediction": "In Greek mythology, the Trojan War was waged against the city of Troy by the Achaeans after Paris of Troy took Helen from her husband Menelaus, king of Sparta. The campaigns of Attarsiya represent the earliest recorded Mycenaean Greek military activity against the Hittites. .The Hittite-Ahhiyawan confrontation in Wilusa, the Hittite name for Troy, in the 13th century BC may have provided the historical foundation for the Trojan War tradition." }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where did let them eat cake come from?", "passages": [ [ "Let them eat cake", "Upon being told that the people were suffering due to widespread bread shortages, the Queen is said to have replied, \"Then let them eat brioche.\"", "Although this anecdote was never cited by opponents of the monarchy at the time of the French Revolution, it did acquire great symbolic importance in subsequent histories, when pro-revolutionary historians sought to demonstrate the obliviousness and selfishness of the French upper classes at that time.", "As one biographer of the Queen notes, it was a particularly useful phrase to cite because \"the staple food of the French peasantry and the working class was bread, absorbing 50 percent of their income, as opposed to 5 percent on fuel; the whole topic of bread was therefore the result of obsessional national interest.\"", "However, there is no evidence that Queen Marie Antoinette ever uttered this phrase.", "It was first attributed to her by Alphonse Karr in \"Les Gu\u00eapes\" of March 1843.", "Other objections to the legend of Marie Antoinette and the cake/brioche comment centre on arguments concerning the queen's personality, internal evidence from members of the French royal family and the date of the saying's origin.", "For example, the Queen's English-language biographer wrote in 2002:\n\nThe attribution also has little credibility." ], [ "Let them eat cake", "Let them eat cake\n\n\"Let them eat cake\" is the traditional translation of the French phrase \"\"Qu'ils mangent de la brioche\"\", supposedly spoken by \"a great princess\" upon learning that the peasants had no bread.", "Since brioche was a luxury bread enriched with butter and eggs, the quotation would reflect the princess's disregard for the peasants, or her poor understanding of their situation.", "While the phrase is commonly attributed to Queen Marie Antoinette, there is no record of her having said it.", "It appears in book six of Jean-Jacques Rousseau's \"Confessions\", his autobiography (whose first six books were written in 1765, when Marie Antoinette was nine years of age, and published in 1782).", "The context of Rousseau's account was his desire to have some bread to accompany some wine he had stolen; however, feeling he was too elegantly dressed to go into an ordinary bakery, he recalled the words of a \"great princess\":\n\nRousseau does not name the \"great princess\" and he may have invented the anecdote, as \"Confessions\" cannot be read as strictly factual.", "The quotation, first attributed to Marie Antoinette in 1843, was claimed to have been uttered during one of the famines that occurred in France during the reign of her husband, Louis XVI." ] ], "gold": "\"Let them eat cake\" originated in France and is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\". This phrase is attributed to Marie Aintoinette, prior to the French Revolution, although she did not originate it, and she probably never said it. ", "prediction 1": "\"Let them eat cake\" is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\", supposedly spoken by \"a great princess\" upon learning that the peasants had no bread. Since brioche was a luxury bread enriched with butter and eggs, the quotation would reflect the princess's disregard for the peasants, or her poor understanding of their situation. The quotation, first attributed to Marie Antoinette in 1843, was claimed to have been uttered during one of the famines that occurred in France during the reign of her husband, Louis XVI.\n", "prediction 2": "\"Let them eat cake\" is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\", supposedly spoken by \"a great princess\" upon learning that the peasants had no bread. Since brioche was a luxury bread enriched with butter and eggs, the quotation would reflect the princess's disregard for the peasants, or her poor understanding of their situation. The quotation, first attributed to Marie Antoinette in 1843, was claimed to have been uttered during one of the famines that occurred in France during the reign of her husband Louis XVI.", "prediction 3": "\"Let them eat cake\" is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\", supposedly spoken by \"a great princess\" upon learning that the peasants had no bread. Since brioche was a luxury bread enriched with butter and eggs, the quotation would reflect the princess's disregard for the peasants, or her poor understanding of their situation. The phrase, first attributed to Marie Antoinette in 1843, was claimed to have been uttered during one of the famines that occurred in France during the reign of her husband, Louis XVI.", "prediction 4": "\"Let them eat cake\" is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\", supposedly spoken by \"a great princess\" upon learning that the peasants had no bread. The saying was first attributed to Marie Antoinette in 1843, but there is no evidence that she ever uttered it. It appears in book six of Jean-Jacques Rousseau's \"Confessions\", his autobiography.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 189 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 253 }, { "error type": "Irrelevant", "explanation": "", "start": 254, "end": 370 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "\"Let them eat cake\" originated in France and is the traditional translation of the French phrase \"Qu'ils mangent de la brioche\". The quotation, first attributed to Marie Antoinette in 1843, was claimed to have been uttered during one of the famines that occurred in France during the reign of her husband, Louis XVI. While the phrase is commonly attributed to Queen Marie Antoinette, there is no record of her having said it.\n" }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "What part of new york is albany located?", "passages": [ [ "Albany, New York", "Albany, New York\n\nAlbany ( ) is the capital of the U.S. state of New York and the seat of Albany County.", "Albany is located on the west bank of the Hudson River approximately south of its confluence with the Mohawk River and approximately north of New York City.", "Albany is known for its rich history, commerce, culture, architecture, and institutions of higher education.", "Albany constitutes the economic and cultural core of the Capital District of New York State, which comprises the Albany-Schenectady-Troy, NY Metropolitan Statistical Area, including the nearby cities and suburbs of Troy, Schenectady, and Saratoga Springs.", "With a 2013 Census-estimated population of 1.1 million the Capital District is the third-most populous metropolitan region in the state.", "As of the 2010 census, the population of Albany was 97,856.", "The area that later became Albany was settled by Dutch colonists who in 1614, built Fort Nassau for fur trading and, in 1624, built Fort Orange.", "In 1664, the English took over the Dutch settlements, renaming the city as Albany, in honor of the then Duke of Albany, the future James II of England and James VII of Scotland.", "The city was officially chartered in 1686 under English rule.", "It became the capital of New York in 1797 following formation of the United States." ] ], "gold": "Albany is the capital of New York state and is the largest city in Albany County. It is located approximately 135 miles (220 km) north of New York City. The area was settled by Dutch colonists in 1614. Then, in 1664 the English took over the area and named the city Albany in honor of the Duke of Albany.", "prediction 1": "Albany is located in the state of New York. It is located on the west bank of the Hudson River approximately south of its confluence with the Mohawk River and approximately north of New York City. It is in the Capital District, which comprises the Albany-Schenectady-Troy, NY Metropolitan Statistical Area, including the nearby cities and suburbs of Troy, Schenectady, and Saratoga Springs.\n", "prediction 2": "Albany is the capital city of the state of New York and the seat of Albany County. The city is located on the west bank of the Hudson River approximately south of its confluence with the Mohawk River and approximately north of New York City. It is known for its rich history, commerce, culture, architecture, and institutions of higher education.", "prediction 3": "Elmsford County, New York, and Albany are both located in the state's Capital District, which includes the Albany-Schenectady-Troy, NY Metropolitan Statistical Area, as well as the nearby cities and suburbs of Troy, Schenectady, and Saratoga Springs.", "prediction 4": "Albany is located on the west bank of the Hudson River approximately south of its confluence with the Mohawk River and approximately north of New York City. Albany is known for its rich history, commerce, culture, architecture, and institutions of higher education. Albany forms part of the Capital District of New York State, which comprises the Albany-Schenectady-Troy, NY Metropolitan Statistical Area, including the surrounding cities and suburbs of Troy, Schenectady, and Saratoga Springs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 197, "end": 391 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "Albany is the capital of the U.S. state of New York and the seat of Albany County. It is located on the west bank of the Hudson River approximately south of its confluence with the Mohawk River and approximately north of New York City. The area was settled by Dutch colonists in 1614. In 1664, the English took over the Dutch settlements, renaming the city as Albany, in honor of the then Duke of Albany.\n" }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is the author of the story pandora's box?", "passages": [ [ "Pandora's box", "From this story has grown the idiom \"to open (a) Pandora's box\", meaning to do or start something that will cause many unforeseen problems.", "Its modern, more colloquial equivalent is \"to open a can of worms\".", "The word translated as \"box\" was actually a large jar (\u03c0\u03af\u03b8\u03bf\u03c2 \"pithos\") in Greek.", "It was used for storage of wine, oil, grain or other provisions, or, ritually, as a container for a human body for burying, from which it was believed souls escaped and necessarily returned.", "Many scholars see a close analogy between Pandora herself, who was made from clay, and the clay jar which dispenses evils.", "The mistranslation of \"pithos\" is usually attributed to the 16th century humanist Erasmus who, in his Latin account of the story of Pandora, changed the Greek \"pithos\" to \"pyxis\", meaning \"box\".", "The context in which the story appeared was Erasmus' collection of proverbs, the \"Adagia\" (1508), in illustration of the Latin saying \"Malo accepto stultus sapit\" (from experiencing trouble a fool is made wise)." ], [ "Pandora's Box (play)", "Pandora's Box (play)\n\nPandora's Box () is a 1904 play by the German dramatist Frank Wedekind.", "It forms the second part of his pairing of 'Lulu' plays, the first being \"Earth Spirit\" (1895), both of which depict a society \"riven by the demands of lust and greed\".", "G. W. Pabst directed a silent film version \"Pandora's Box\" (1929), which was loosely based on the play.", "Both plays together also formed the basis for the opera \"Lulu\" by Alban Berg in 1935 (premiered posthumously in 1937).", "In the original manuscript, dating from 1894, the 'Lulu' drama was in five acts and subtitled 'A Monster Tragedy'.", "Wedekind subsequently divided the work into two plays: \"Earth Spirit\" (German: \"Erdgeist\", first printed in 1895) and \"Pandora's Box\" (German: \"Die B\u00fcchse der Pandora\").", "It is now customary in theatre performances to run the two plays together, in abridged form, under the title \"Lulu\"." ], [ "Pandora's box", "Pandora's box\n\nPandora's box is an artifact in Greek mythology connected with the myth of Pandora in Hesiod's \"Works and Days\".", "The container mentioned in the original story was actually a large storage jar but the word was later mistranslated as \"box.\"", "In modern times an idiom has grown from it meaning \"Any source of great and unexpected troubles\", or alternatively \"A present which seems valuable but which in reality is a curse\".", "Later depictions of the fatal container have been varied, while some literary and artistic treatments have focused more on the contents of the idiomatic box than on Pandora herself.", "There is also an alternative tradition in which the divine gift of a jar was opened by a curious male.", "According to Hesiod, when Prometheus stole fire from heaven, Zeus, the king of the gods, took vengeance by presenting Pandora to Prometheus' brother Epimetheus.", "Pandora opened a jar left in his care containing sickness, death and many other unspecified evils which were then released into the world.", "Though she hastened to close the container, only one thing was left behind \u2013 usually translated as Hope, though it could also have the pessimistic meaning of \"deceptive expectation\"." ] ], "gold": "Pandora's box is an artifact in Greek mythology connected with the myth of Pandora in Hesiod's Works and Days. He reported that curiosity led her to open a container left in care of her husband, thus releasing physical and emotional curses upon mankind. Later depictions of the story have been varied, while some literary and artistic treatments have focused more on the contents than on Pandora herself. In 1904, the play Pandora's Box was written by Frank Wedekind and depicts a society \"driven by the demands of lust and greed\".", "prediction 1": "Pandora's box is an artifact in Greek mythology connected with the myth of Pandora in Hesiod's \"Works and Days\". The container mentioned in the original story was actually a large storage jar but the word was later mistranslated as \"box.\" In modern times an idiom has grown from it meaning \"Any source of great and unexpected troubles\", or alternatively \"A present which seems valuable but which in reality is a curse\". The 16th century humanist Erasmus is credited with the mistranslation of \"pithos\" to \"pyxis\", meaning \"pyxis\", meaning \"box\".\n", "prediction 2": "Pandora's Box is an artifact in Greek mythology connected with the myth of Pandora in Hesiod's \"Works and Days\". The container mentioned in the original story was actually a large storage jar but the word was later mistranslated as \"box.\" It is recorded that the literary works of Aristotle and Homer are the primary authors of the story, while Erasmus is the main compiler of the Latin manuscript. Under the pseudonym Veronas de Senna, the story was told by Hes words and box.", "prediction 3": "The story of Pandora is based on the Septuagint and was actually told in the 16th century by Erasmus, a humanist. This translated the ancient Greek word for \"box\" to English, meaning \"any source of great and unexpected troubles\". The word \"box\" has been interpreted as a metaphor for beginning, or starting, something that will cause many unforeseen problems, such as burying a body, or naturalizing tissue. The 1904 play on the same topic is Pandora's Box, which is loosely based on the 1904 adaptation of the German dramatist Frank Wedekind.", "prediction 4": "The story of Pandora in Hesiod's Works and Days dates back to 4,000 BC. Erasmus, a 16th century humanist, gave another account of the story. In his Latin account of the story of Pandora, Erasmus changed the Greek phrase \"pithos\" to the modern phrase \"pyxis\". The German dramatist Frank Wedekind wrote a 1904 play about Pandora's box which forms part of his pairing of 'Lulu' plays. The first play was English called \"Earth Spirit\" and the second part of his pairing of his Lulu' plays.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 238 }, { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 419 }, { "error type": "Irrelevant", "explanation": "", "start": 420, "end": 546 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "Pandora's box is an artifact in Greek mythology connected with the myth of Pandora in Hesiod's \"Works and Days\". Later depictions of the fatal container have been varied, while some literary and artistic treatments have focused more on the contents of the idiomatic box than on Pandora herself. Pandora's Box is a 1904 play by the German dramatist Frank Wedekind, that depict a society \"riven by the demands of lust and greed\".\n" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who is the current mayor of el paso texas?", "passages": [ [ "Dee Margo", "Dee Margo\n\nDonald \"Dee\" Margo (born February 4, 1952) is an American businessman who is the 54th and current mayor of the city of El Paso, Texas.", "On June 10, 2017, he became the mayor-elect of El Paso after winning the runoff part of the city's mayoral election of 2017 against David Saucedo.", "Margo served a term in the Texas House of Representatives from 2011 to 2013, representing the 78th district, which covers parts of El Paso County, having defeated current Democratic Party member and Texas state representative Joe Moody.", "Moody defeated Margo in a rematch in 2012.", "Donald Margo accepted a football scholarship to Vanderbilt University in 1970 and graduated in 1974; afterwards Margo moved to El Paso in 1977 from Nashville, Tennessee to join his father-in-law at John D. Williams Company (JDW).", "In February 1981, six days after Margo\u2019s 29th birthday, his father-in-law suffered a fatal heart attack.", "Margo had purchased JDW from the estate, and expanded the company from six employees to 70 in the span of 30 years.", "Margo has been a resident of El Paso for over 40 years.", "He and his wife Adair married on August 21, 1976 and moved to El Paso in March 1977, where they raised their sons.", "Their granddaughters are fifth-generation El Pasoans." ], [ "Oscar Leeser", "Oscar Leeser\n\nOscar Leeser (born May 7, 1958) is an American politician and businessman who served as the 53rd Mayor of El Paso, Texas from 2013 to 2017.", "He is a member of the Democratic Party.", "Leeser was born in Mexico and immigrated to the United States with his family at the age of 9, living in Sun City and then afterwards settling in El Paso, Texas.", "He started his first job at 16.", "Following graduation from Coronado High School, Leeser began his career in the auto industry, working with several dealerships in El Paso.", "Leeser was given a career opportunity in 2001, when he became president and dealer operator of Hyundai of El Paso.", "He had turned a local store that was only selling 15 cars a month into today\u2019s number one overall dealer in El Paso.", "His store is also the number one Hyundai dealer in the South Central Region and ninth in the nation for Hyundai dealers.", "He amassed over three decades of experience in business, culminating in his service as Owner and President of Hyundai of El Paso prior to becoming Mayor.", "Leeser serves as a member of the UMC El Paso Children\u2019s Hospital Foundation Board and also holds several professional positions as well.", "He is the President of the Hyundai South Central Region, a member of the National Dealer Council, serves on the National Parts and Service Committee, and the Hyundai Advertising Committee." ], [ "Oscar Leeser", "In addition, he has also been active in supporting many local charities and youth organizations.", "Leeser was elected mayor on May 14, 2013 after defeating city council member Steve Ortega.", "Both Leeser and Ortega ran as nonpartisan candidates as the city of El Paso only holds nonpartisan elections.", "Ortega had placed first and second with 47% and 21% of the vote, respectively, and because no candidate received a majority, a runoff election was held on June 15 which Leeser won.", "He took office on June 24, 2013.", "Mayor Oscar Leeser is eligible to run for a second term in office, but announced in July 2016 that he would not seek another term.", "Many had thought it was due to the fact that Leeser had a cancer related surgery in 2016, but states that his decision is not because of his health.", "Instead, it is because he \"ran to do things I thought were really important for our community and I did that.\"", "Leeser was succeeded by Republican Dee Margo, whom he endorsed in the runoff election.", "Leeser is married to his childhood sweetheart Lisa; he is a father of four and a grandfather of five." ], [ "John Cook (Texas politician)", "John Cook (Texas politician)\n\nJohn F. Cook (born February 27, 1946) is an American businessman, veteran, civic leader, and member of the Paso Del Norte Group.", "Cook was Mayor of El Paso, Texas since defeating incumbent Joe Wardy in June 2005, and was reelected in 2009 to a second four-year term.", "Due to the City Charter's term limits clause Cook was not eligible for a third term in 2013.", "Cook graduated from New York City's Immaculata High School in 1964.", "He attended the University of Texas at El Paso and earned a degree in business in 1977.", "In 1970, Cook married his wife Tram Cook, with whom he has six children, nine grandchildren and two great-grandchildren.", "Mayor Cook has lived for most of his life in Northeast El Paso, where his family has owned and operated several businesses.", "He served in the United States Army from 1967 to 1970, seeing service as a special agent in military intelligence.", "He served as the City Council Representative of the 4th District of El Paso from 1999 to June 2005 prior to being elected Mayor.", "He has been deeply involved in El Paso's community affairs, as a businessman, a teacher, coach, founder and member of the board of many civic and veterans' organizations.", "Since becoming Mayor of El Paso, Cook has overseen the adoption of the Paso Del Norte Group's Downtown Redevelopment Plan." ] ], "gold": "The current mayor of El Paso, Texas is Oscar Leeser. He has served as the 50th and 52nd mayor of the city, from 2013 to 2017 and from 2021 to date. Donald \"Dee\" Margo was in office from 2017 to 2021 but was defeated by Leeser in the December 2020 runoff election. Prior to that, John F. Cook was the mayor from 2005 to 2013.", "prediction 1": "Oscar Leeser, an American politician and businessman, served as the 53rd mayor of El Paso, Texas from 2013 to 2017. He was succeeded by Republican Dee Margo, who won the runoff part of the city's mayoral election of 2017. John F. Cook, an American businessman, veteran, civic leader, and member of the Paso Del Norte Group, was elected mayor of El Paso, Texas from 2005 to 2009.\n", "prediction 2": "Oscar Leeser served as El Paso's mayor from 2013 to 2017. He succeeded Democratic incumbent Steve Ortega. John E. Cook served as El Paso's mayor since 2005 and was re-elected in 2009 and 2013. Mayor-elect Dee Margo finished ahead of Democratic incumbent David Saucedo.", "prediction 3": "In 2017, Dee Margo was elected mayor of El Paso, Texas. He succeeded Oscar Leeser in office who has already served one term as mayor. Republicans John Cook, Steve Ortega, and Dee Margo have also held office as mayors, each serving a two-year term.", "prediction 4": "Oscar Leeser was elected Mayor of El Paso, Texas from May 14, 2013, until June 24, 2013. Dee Margo was elected Mayor in the 2017 elections. The mayor-elect was David Saucedo.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 14, "end": 53 }, { "error type": "Irrelevant", "explanation": "", "start": 136, "end": 146 }, { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 323 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 4, "sentence_id": [ 2, 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Oscar Leeser served as the 53rd mayor of El Paso, Texas from 2013 to 2017. He was succeeded by Donald \"Dee\" Margo, who won the runoff part of the city's mayoral election of 2017 and is the current mayor. John F. Cook was elected mayor of El Paso, Texas from 2005 to 2009 and reelected in 2009 till 2013. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Whi was the first captain of indian cricket team?", "passages": [ [ "Indian cricket team in England in 1936", "Indian cricket team in England in 1936\n\nThe India cricket team toured England in the 1936 season and played 28 first-class fixtures, winning only four whilst losing 12 and drawing 12.", "They played three Test matches against England and lost the series 2\u20130 with one match drawn.", "England won the First Test by 9 wickets at Lord's; the Second Test at Old Trafford was drawn; England won the Third Test at The Oval by 9 wickets.", "The India team was captained by the Maharajkumar of Vizianagram, who was neither the greatest player nor the greatest captain of all time.", "But the team did include several top-class players such as Vijay Merchant, Mushtaq Ali and C. K. Nayudu.", "The India squad for the tour was suggested by the Selection Committee consisting of the Nawab of Bhopal Hamidullah Khan, the Nawab of Pataudi and Maharajkumar of Vizianagram to the Board of Cricket Control on 16 February 1936.", "The Maharajkumar was named the captain.", "The Yuvraj of Patiala Yadavindra Singh declined to be a part owing to personal reasons.", "Syed Mohammad Hadi was named the treasurer of the squad for the tour." ], [ "Shantha Rangaswamy", "Shantha Rangaswamy\n\nShantha Rangaswamy, also known as Shanta Rangaswamy, (born 1 January 1954 in Madras) is an Indian cricketer.", "She played Women's Test cricket for India in 16 matches from 1976 to 1991, captaining the side in 8 matches in 1976-7 and four in 1983-4.", "India recorded its first-ever Test win in November 1976 against West Indies under Shantha's captaincy at the Moin-ul-Haq Stadium in Patna.", "She also played in 19 Women's One-day Internationals from 1981\u20132 to 1986, captaining the side in 16 matches from 1981\u20132 to 1983\u20134.", "A right-handed batter, she scored 750 runs at a batting average of 32.6 in her 16 Test matches, with one century (108), which was the first century by Indian Women Cricketer against New Zealand on 08.01.1977 at Carisbrook, Dunedin.", "She also took 21 wickets bowling right arm medium pace at a bowling average of 31.61, including a best analysis of 4\u201342 against England.", "In 19 ODIs, she scored 287 runs at 15.1, and took 12 wickets at 29.41." ], [ "Sarfraz Ahmed", "Sarfraz Ahmed\n\nSarfraz Ahmed (; born 22 May 1987) is a wicketkeeper-batsman who plays international cricket for Pakistan and is also the current captain of the Pakistan cricket team in all 3 formats of the game.", "Sarfraz was named as Pakistan's Twenty20 International captain following the 2016 ICC World Twenty20 in India, while he was named Pakistan's ODI Captain on 9 February 2017 after Azhar Ali stepped down.", "He took up the Test captaincy mantle for his team following the retirement of Misbah-ul-Haq and hence became the 32nd Test captain of the Pakistan Cricket Team in doing so.", "Under his captaincy, Pakistan won the Champions Trophy in June 2017.", "In March 2018, on Pakistan Day, Sarfraz became the youngest cricketer to be awarded with the Sitara-i-Imtiaz.", "In August 2018, he was one of thirty-three players to be awarded a central contract for the 2018\u201319 season by the Pakistan Cricket Board (PCB).", "Sarfraz's notable achievement during the early days of his career was winning the ICC U-19 World Cup in 2006 where he led the Pakistani team and defeated India in the final in a low-scoring encounter,\n\nSarfraz was called up by Pakistan as a cover for Kamran Akmal who had a finger injury in the one-day series between India and Pakistan in November 2007." ], [ "India national cricket team", "\"Updated on 25 June 2018\" \n\nThirty-two men have captained the Indian cricket team in at least one Test match, although only six have led the team in more than 25 matches, and six have captained the team in ODIs but not Tests.", "India's first captain was CK Nayudu, who led the team in four matches against England: one in England in 1932 and a series of three matches at home in 1933\u201334.", "Lala Amarnath, India's fourth captain, led the team in its first Test match after Indian independence.", "He also captained the side to its first Test victory and first series win, both in a three-match series at home against Pakistan in 1952\u201353.", "From 1952 until 1961\u201362, India had a number of captains such as Vijay Hazare, Polly Umrigar and Nari Contractor.", "The Nawab of Pataudi, Mansoor Ali Khan Pataudi, was the team's captain for 36 Test matches from 1961\u201362 to 1969\u201370, returning for another four matches against West Indies in 1974\u201375.", "In the early years of his captaincy tenure, the team was whitewashed in the West Indies, England and Australia.", "However, in 1967\u201368, Pataudi led India on its maiden New Zealand tour, which ended in India winning the Test series 3\u20131." ], [ "India national cricket team", "In 1970\u201371, Ajit Wadekar took over the captaincy from Pataudi.", "Under Wadekar's captaincy, India registered its first Test series win in the West Indies and England.", "India played its first ODI in 1974, also under his captaincy.", "India won its first ODI under the captaincy of Srinivasaraghavan Venkataraghavan in the 1975 Cricket World Cup, against East Africa.", "Between 1975\u201376 and 1978\u201379, Bishen Singh Bedi captained the team in 22 Tests and 4 ODIs, winning 6 Tests and one ODI.", "Sunil Gavaskar took over as Test and ODI captain in 1978\u201379, leading India in 47 Test matches and 37 ODIs, winning 9 Tests and 14 ODIs.", "He was succeeded by Kapil Dev in the 1980s, who captained for 34 Test matches, including 4 victories.", "Kapil Dev led India to victory in 39 of his 74 ODIs in charge, including the 1983 Cricket World Cup.", "Kapil Dev also captained India's 2\u20130 Test series victory in England in 1986.", "Between 1987\u201388 and 1989\u201390, India had three captains in Dilip Vengsarkar, Ravi Shastri and Krishnamachari Srikkanth.", "Vengsarkar took over the captaincy from Kapil Dev after the 1987 Cricket World Cup." ] ], "gold": "The Indian team was first led by Colonel CK Nayudu against England at the Lord's. They played only seven tests, which were all against England, before the Second World War, losing five matches & drawing twice. Shantha Rangaswamy led the women's team in their first test match in 1976 against West Indies at M.Chinnaswamy Stadium. Krishnamachari Srikkanth became the first Test captain for the U-19 team in 1978\u201379 against Pakistan, while Ravi Shastri was the first One Day International captain for the U-19 team in 1981.", "prediction 1": "The first captain of the Indian cricket team was CK Nayudu, who led the team in four matches against England: one in England in 1932 and a series of three matches at home in 1933\u201334. The India team was captained by the Maharajkumar of Vizianagram, who was neither the greatest player nor the greatest captain of all time. The current captain of the Pakistan cricket team is Sarfraz Ahmed, a wicketkeeper-batsman who plays international cricket for Pakistan and is also the current captain of the Pakistan cricket team in all 3 formats of the game.\n", "prediction 2": "The first ever women's cricket captain of an India team was Shanta Rangaswamy, who played Women's Test cricket for India in 16 matches from 1976 to 1991, and Sarfraz Ahmed, who plays international cricket for Pakistan, took up the Test captaincy mantle in 2016, while the third-year-old Sarfraz Ahmed, who played as the Test Captain in 2017, and Lala Amarnath, who\u2019d captain India for five ODI\u2019s, was the first ever Test captain of an ODI.", "prediction 3": "The first captain of the Indian cricket team to play Test matches was CK Nayudu. CK Nayudu led India in four matches against England: one in England in 1932 and a series of three matches at home in 1933\u201334. Shantha Rangaswamy, a former Indian cricketer, was then appointed as the team's captain in 1936. Sarfraz Ahmed is also the current captain of the Pakistan cricket team in all 3 formats of the game. Vinod Kumar lead India in 22 May 1987. Lala Amarnath became the country's first woman captain in 1934.", "prediction 4": "Indian cricket team toured England in the 1936 season and played 28 first-class fixtures, winning only 4 whilst losing 12 and drawing 12. They played three Test matches against England and lost the series 2\u20130 with one match drawn. The India team was captained by the Maharajkumar of Vizianagram, who was neither the greatest player nor the greatest captain of all time. Syed Mohammad Hadi was named the treasurer of the squad for the tour. Sarfraz Ahmed, an Indian wicketkeeper-batsman, was the first Test captain of the Pakistan cricket team following the retirement of Misbah-ul-Haq and took over the Test captaincy mantle for his team in doing so. Under his captaincy, Pakistan won the Champions Trophy in June 2017.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "The first captain of the Indian cricket team was CK Nayudu, who led the team in four matches against England: ", "start": 110, "end": 124 }, { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 183, "end": 321 }, { "error type": "Irrelevant", "explanation": "", "start": 322, "end": 548 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The first captain of the Indian cricket team was CK Nayudu, who led the team in four matches against England in 1932. India played its first ODI in 1974, under Ajit Wadekar. \nIndia recorded its first-ever Test win in 1976 under womans captain Shantha Rangaswamy." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "When is the next episode of george gently being shown?", "passages": [ [ "Inspector George Gently", "Inspector George Gently\n\nInspector George Gently (also known as George Gently for the pilot and first series) is a British television crime drama series produced by Company Pictures for BBC One, set in the 1960s and loosely based on some of the Inspector Gently novels written by Alan Hunter.", "The series stars Martin Shaw as the eponymous Inspector and Lee Ingleby as Detective Sergeant John Bacchus, with Simon Hubbard and Lisa McGrillis in supporting roles as police constables in the fictitious North East Constabulary.", "The series moved the setting of the stories to North East England, centring on Newcastle upon Tyne, Northumberland and County Durham, as opposed to the Norfolk setting in the books.", "The death penalty is still in effect in Britain as the series begins, and it is used as a plot feature in some early episodes.", "The abolition of the death penalty in 1965 is noted in the series.", "The earliest episodes are set in 1964 with the eighth series taking place in 1970.", "After fair ratings for the first three series, the BBC secured funding from the North East Content Fund to produce further episodes.", "The fourth series was filmed between January and June 2011, and was broadcast that autumn.", "On 26 March 2012 the BBC announced that four new feature-length episodes were being produced to be shown later the same year.", "The fifth series ended on a dramatic cliffhanger, with the fate of both leading characters uncertain." ] ], "gold": "Inspector George Gently, which is also called George Gently, is a British television crime drama series. Episode 23 was shown on 20 May 2015. The next episode, number 24, was shown about two years later, on 21 May 2017. The airing date for episode 25 is TBA, or To Be Announced.", "prediction 1": "Inspector George Gently is a British television crime drama series produced by Company Pictures for BBC One, set in the 1960s and loosely based on some of the Inspector Gently novels written by Alan Hunter. The next episode of the series aired on 26 March 2019.\n", "prediction 2": "Inspector George Gently is a British television crime drama series produced by Company Pictures for BBC One, set in the 1960s and loosely based on some of the Inspector Gently novels written by Alan Hunter. The earliest episodes are set in 1964 with the eighth series taking place in 1970. The series moved the setting of the stories to North East England, centring on Newcastle upon Tyne, Northumberland and County Durham, rather than the Norfolk setting in the books. The series also centred around the legal system of the North East Constabulary, the setting of the crime scene were seen in 2011, the show rerunning through to 2021.", "prediction 3": "The British television crime drama series Inspector George Gently aired on BBC One from 1970 to 1984. Episode 42 of the fourth series was shown on 22 May 2012. On 28 August 2013 the series wrapped up.", "prediction 4": "In the British television crime drama series Inspector George Gently, which was produced by Company Pictures for BBC One in 2014-15, the next episode will be shown in 2015. It will be the eighth series and play out in 1970.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 108 }, { "error type": "Irrelevant", "explanation": "", "start": 109, "end": 206 }, { "error type": "Unverifiable", "explanation": "", "start": 247, "end": 262 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "Inspector George Gently, which is also called George Gently, is a British television crime drama series. On 26 March 2012 the BBC announced that four new feature-length episodes were being produced to be shown later the same year.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "Who was the mom in how i met your mother?", "passages": [ [ "The Mother (How I Met Your Mother)", "The Mother (How I Met Your Mother)\n\nTracy McConnell (colloquial: \"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\".", "The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother.", "Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character; she was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "The Mother is played by Cristin Milioti.", "The story of how Ted met The Mother is the framing device behind the series; many facts about her are revealed throughout the series, including the fact that Ted once unwittingly owned her umbrella before accidentally leaving it behind in her apartment.", "Ted and The Mother meet at the Farhampton train station following Barney Stinson (Neil Patrick Harris) and Robin Scherbatsky's (Cobie Smulders) wedding; this scene is shown in \"Last Forever\", the series finale.", "The Mother's death from an unspecified terminal illness in 2024, also revealed in the series finale, received a mixed reaction from fans.", "An alternate ending was released in the ninth season DVD." ], [ "Cristin Milioti", "Cristin Milioti\n\nCristin Milioti (born August 16, 1985) is an American actress and vocalist.", "She has worked in Broadway theatre productions such as \"That Face\", \"Stunning\", and the Tony Award-winning musical \"Once\".", "She also played the titular Mother on the sitcom \"How I Met Your Mother\" from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film \"The Wolf of Wall Street\", and Betsy Solverson in the second season of \"Fargo\" (2015).", "She has won a Grammy Award and has been nominated for a Tony Award.", "Milioti was born on August 16, 1985 in Cherry Hill, New Jersey.", "She is of Italian descent, and calls her family \"Olive Garden Italian\".", "In middle school, she found her love of acting at Long Lake Camp for the Arts in New York state.", "She graduated in 2003 from Cherry Hill High School East, where she began performing in school plays.", "She took acting classes at New York University, but dropped out during her freshman year.", "However, she is listed in the university's advertising.", "Milioti's first acting roles were bit parts in national advertising campaign ads, notably one for the Ford Edge.", "She also appeared in television programs such as \"30 Rock\" and films such as \"Greetings from the Shore\"." ] ], "gold": "In the CBS television sitcom \"How I Met Your Mother\", the title character \"The Mother\" who's otherwise known as Tracy McConnell on the show is portrayed by American actress Cristin Milioti. The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met his children's mother.", "prediction 1": "Tracy McConnell is the title character from the CBS television sitcom How I Met Your Mother. The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother. Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character. She was first seen fully in \"Something New\" and was promoted to a main character in season 9.", "prediction 2": "Tracy McConnell, commonly known as Mother, is the title character from the CBS television sitcom How I Met Your Mother. She is played by Cristin Milioti, who served as mom from season 10 to season 12.", "prediction 3": "The title character from the CBS television sitcom How I Met Your Mother is Tracy McConnell, played by American actress and vocalist Cristin Milioti. The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother. Tracy McConnell appears in eight episodes, from \"Lucky Penny\" to \"The Time Travelers\", as an unseen character. She was first seen fully in \"Something New\" and was promoted to a main character in season 9. Cristin Miliotiotiotiotiotioti also played the title character in the show from 2013 to 2014, Teresa Petrillo Belfort in the 2013 film The Wolf of Wall Street and Betsy Solverson in the second season of Frags (19).", "prediction 4": "Tracy McConnell, the title character from the TV sitcom How I Met Your Mother, was played by Cristin Milioti on the show from 2013 to 2014. Also, Teresa Petrillo Belfort played the Mother in The Wolf of Wall Street (2013) and Betsy Solverson in Fargo (2015).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 202, "end": 312 }, { "error type": "Irrelevant", "explanation": "", "start": 313, "end": 406 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Tracy McConnell (\"The Mother\") is the title character from the CBS television sitcom \"How I Met Your Mother\". The Mother is played by Cristin Milioti who is an American actress. The show, narrated by Future Ted (Bob Saget), tells the story of how Ted Mosby (Josh Radnor) met The Mother. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Who plays batman in the new justice league?", "passages": [ [ "Justice League (TV series)", "Batman's costume was redesigned, but this time, his costume was a combination of his last three costumes.", "The same costume from \"The New Batman Adventures\" is retained, but with the blue highlights from the \"Batman: The Animated Series\" costume and the long-ears from the \"Batman Beyond\" costume are added to the costume.", "Tim Daly, who voiced Superman in \"\" (1996\u20132000) was initially involved but was unable to continue his role due to involvement with \"The Fugitive\" (a short-lived remake of the original 1963 TV series), and was replaced by George Newbern.", "Superman was initially redesigned to have a bit of a squint to his eyes and slight wrinkles that was also meant to make him look older, in addition to having a noticeable shining streak to his hair; he was redesigned to appear larger in physical girth than in the previous series.", "Fans did not like the older appearance and in the second season the streak was toned down to the point of almost disappearing and the squint was removed, in essence reverting Superman to his earlier animated look.", "As an in-joke, Superman's season one facial designs are used for an older Jor-El in the \"Justice League Unlimited\" episode \"For the Man Who Has Everything\"." ], [ "Justice League (film)", "Goyer stated that should Green Lantern appear in a future installment, it would be a rebooted version of the character, unconnected to the 2011 film.", "With the release of \"Man of Steel\" in June 2013, Goyer was hired to write a sequel, as well as a new \"Justice League\", with the Beall draft being scrapped.", "The sequel was later revealed to be \"\", a team-up film featuring Henry Cavill as Superman, Ben Affleck as Batman, Gal Gadot as Wonder Woman, Ezra Miller as The Flash, Jason Momoa as Aquaman, and Ray Fisher as Victor Stone / Cyborg, the latter three in minor roles that became more significant in the \"Justice League\" film.", "The universe is separate from Nolan and Goyer's work on \"The Dark Knight\" trilogy, although Nolan was still involved as an executive producer for \"Batman v Superman\".", "In April 2014, it was announced that Zack Snyder would also direct Goyer's \"Justice League\" script.", "Warner Bros. was reportedly courting Chris Terrio to rewrite \"Justice League\" the following July, after having been impressed with his rewrite of \"Batman v Superman: Dawn of Justice\"." ], [ "Kevin Conroy", "Kevin Conroy\n\nKevin Conroy (born November 30, 1955) is an American actor and voice actor best known for his voice role as the DC Comics character Batman on the 1990s Warner Bros. television series \"\", as well as various other TV series and feature films in the DC animated universe.", "Due to the popularity of his performance as Batman, Conroy went on to voice the character for multiple films under the DC Universe Animated Original Movies banner and various video games, including the acclaimed \"\" series.", "Born in Westbury, New York to an Irish Catholic family, Conroy moved to Westport, Connecticut when he was about 11 years old.", "He moved to New York City in 1973 when he earned a full scholarship to attend Juilliard's drama division, studying under actor John Houseman.", "While there, he roomed with Robin Williams, who was in the same group as both Conroy and Kelsey Grammer.", "After graduating from Juilliard in 1978, he toured with Houseman's acting group The Acting Company, and the following year he went on the national tour of Ira Levin's \"Deathtrap\".", "Filmreference.com lists Conroy as having been married, and having a child, though an interview with \"The New York Times\" in 2016 stated that he is gay.", "In 1980, Conroy decided to try his hand in television and moved out to California." ], [ "Ben Affleck", "Ben Affleck\n\nBenjamin G\u00e9za Affleck-Boldt (born August 15, 1972) is an American actor and filmmaker.", "His accolades include two Academy Awards, three Golden Globe Awards, two BAFTA Awards, and two Screen Actors Guild Awards.", "He began his career as a child and starred in the PBS educational series \"The Voyage of the Mimi\" in 1984, before a second run in 1988.", "He later appeared in the independent coming-of-age comedy \"Dazed and Confused\" (1993) and various Kevin Smith films, including \"Chasing Amy\" (1997) and \"Dogma\" (1999).", "Affleck gained wider recognition when he and childhood friend Matt Damon won the Golden Globe and Academy Award for Best Original Screenplay for writing \"Good Will Hunting\" (1997), which they also starred in.", "He then established himself as a leading man in studio films, including the disaster drama \"Armageddon\" (1998), the romantic comedy \"Forces of Nature\" (1999), the war drama \"Pearl Harbor\" (2001), and the spy thriller \"The Sum of All Fears\" (2002).", "After a career downturn, during which he appeared in \"Daredevil\" and \"Gigli\" (both 2003), Affleck received a Golden Globe nomination for his performance in the noir biopic \"Hollywoodland\" (2006)." ], [ "Batman v Superman: Dawn of Justice", "Batman v Superman: Dawn of Justice\n\nBatman v Superman: Dawn of Justice is a 2016 American superhero film featuring the DC Comics characters Batman and Superman.", "Directed by Zack Snyder, the film is the second installment in the DC Extended Universe (DCEU), following 2013's \"Man of Steel\".", "It was written by Chris Terrio and David S. Goyer, and features an ensemble cast that includes Ben Affleck, Henry Cavill, Amy Adams, Jesse Eisenberg, Diane Lane, Laurence Fishburne, Jeremy Irons, Holly Hunter, and Gal Gadot.", "\"Batman v Superman: Dawn of Justice\" is the first live-action film to feature Batman and Superman together, as well as the first live-action cinematic portrayal of Wonder Woman.", "In the film, criminal mastermind Lex Luthor (Eisenberg) manipulates Batman (Affleck) into a preemptive battle with Superman (Cavill), who Luthor is obsessed with defeating.", "The film was announced at the 2013 San Diego Comic-Con after the release of \"Man of Steel\".", "Snyder stated that the film would take inspiration from the \"Batman\" comic book series \"The Dark Knight Returns\" by Frank Miller, but clarified that it would follow an original premise." ] ], "gold": "Ben Affleck plays Batman in the new Justice League film, while Kevin Conroy plays Batman in the new Justice League TV series. Conroy is an American film, television and voice actor. Affleck is an an American actor, film director, producer, and screenwriter who played Batman in 2016's Batman v Superman: Dawn of Justice and 2017's Justice League.", "prediction 1": "In the 2011 film Justice League, Ben Affleck plays Batman. In the 2015 film Justice League: Dawn of Justice, Kevin Conroy plays Batman. In the 2016 film Justice League: Dawn of Justice, George Newbern plays Batman.\n", "prediction 2": "Kevin Conroy, an American actor and voice actor best known for his voice role as the DC Comics character Batman on the 1990s Warner Bros. television series \",\" as well as various other TV series and feature films in the DC animated universe, reprises his role as Batman in the 2011 film adaptation. In the film, Ben Affleck plays Batman.", "prediction 3": "Actor Kevin Conroy played Batman in several different comic-book adaptations and cartoon adaptations. The current version of Batman is named Ben Affleck.", "prediction 4": "American actor Kevin Conroy plays Batman in the Justice League film. He was previously known for his roles as Batman on the 1990s Warner Bros. television series Batman, as well as various other TV series and feature films in the DC animated universe. In the 2016 video game The Lego Movie: Arkham Asylum, Ben Affleck plays Batman.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 59, "end": 135 }, { "error type": "Unverifiable", "explanation": "", "start": 136, "end": 215 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[1]}", "start": 7, "end": 11 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "In the 2016 film Justice League, Ben Affleck plays Batman. Affleck is an an American actor, film director, and screenwriter. Kevin Conroy, American actor and voice actor, plays Batman on the 1990s Warner Bros. television series." }, "preference": [ 2, 1, 1, 1, 1, 0 ] }, { "question": "Who does archie end up with in the comic books?", "passages": [ [ "Archie Andrews", "Despite the efforts of both Cheryl and Veronica, he surprisingly chose Betty, much to her delight.", "On May 15, 2009, Archie Comics announced that Archie would finally pick one of the girls to marry, in a story arc in \"Archie\" #600\u2013606 (Aug. 2009 \u2013 Feb. 2010).", "However, Archie Comics publicly revealed this to be a dream sequence to show two possible futures: one where Archie marries Veronica (issues 600\u2013602), and the other Betty (603\u2013605).", "In both, he has twins: a boy also named Archie who looks like him, and a girl named after and resembling whichever girl he married.", "Issue 606 was an epilogue to \"Archie Marries Veronica/Archie Marries Betty\" that returns to the comics' old format.", "In \"Archie\" # 608 (May 2010), Archie began a relationship with Valerie Brown, making her Archie's first girlfriend of African descent.", "The Archies and Josie and the Pussycats were touring together and, while rehearsing, Archie and Valerie secretly fell in love as they co-wrote the song \"More Than Words\" that described their feelings.", "Issue #609 revealed that this relationship had seeped into common knowledge by the end of the tour.", "Archie and Valerie were forced apart when the Pussycats were touring Europe without the Archies, but hoped to keep their relationship going." ], [ "Archie Marries Veronica/Archie Marries Betty", "Archie decides to apologize to both of them and take control of his own future.", "When talking about the future, Archie asks Jughead if he ever thought about buying Pop's place after he retires.", "However, Jughead denies this, saying he will have to think about the future and prefers to live in the present.", "The success of the Archie Marries Veronica/Archie Marries Betty storyline led to the comic series, \"Life with Archie: The Married Life\", and a similar storyline called \"Archie Marries Valerie\", depicting Archie marrying Valerie from Josie and the Pussycats, shown in \"Archie\" #631-634.", "\"Life with Archie: The Married Life\" was based on the \"Archie Marries Veronica/Archie Marries Betty\" storyline, but was not a direct continuation on it.", "The series lasted from 2010 to 2014, ending with 37 issues.", "Issues 1-35 contained two stories each, the first story was \"Archie Marries Veronica\" and the second one was \"Archie Marries Betty\".", "The last two issues, on the other hand, were structured differently.", "Instead of having two stories both issues had one, but were twice as long as the others.", "Also, neither issue made it clear whether Archie was married to Betty or Veronica.", "Together both issues make up \"The Death of Archie\" storyline." ], [ "Archie Marries Veronica/Archie Marries Betty", "The \"Archie Marries Valerie\" storyline was similar to the \"Archie Marries Veronica/Archie Marries Betty\" storyline, but had some major differences.", "For instance, Valerie was the one who walked up Memory Lane instead of Archie", "and she could see the future in portals rather than actually experiencing it.", "She sees a future in where she marries Archie, then they both quit their respective bands due to their touring schedules keeping them apart, and later have a little girl named Star who is gifted with her parents' musical talent.", "However, she decides to stop watching it after she sees that they cannot get a moment's peace due to Star becoming an object of attention for the media.", "Then she witness glimpses of other futures and in each one Archie is married to a different woman.", "Some of these futures had Archie being married to Cheryl Blossom, Sabrina Spellman, and even Josie.", "Seeing these futures Valerie runs out of Memory Lane and happily reunites with Archie." ], [ "Josie and the Pussycats (comics)", "Valerie's surname may be the most definite of the three.", "Archie Comics have occasionally used the name \"Brown\" from the movie on their website and in promotional material, but in the comics, she is always called Valerie Smith.", "But recently, the \"Brown\" surname has been used again in comics and the \"Riverdale\" TV series.", "The return of the Brown surname happens due to the return of the Pepper Smith character in the New Riverdale and Archie Horror universe.", "In the comics, Valerie is more tomboyish than her two bandmates.", "Besides being good at science and a skilled auto mechanic, she occasionally shows a quick temper as well as being physically stronger than she might appear.", "She is also less concerned about her appearance or her love life than Josie, Melody or Alexandra, and had rarely been seen in a romantic relationship, though in the cartoons she seems attracted to Alexander.", "In 2010, she began an on-again, off-again romantic relationship with Archie Andrews, although her band's touring schedule often keeps her out of Riverdale and away from Archie (much to the relief of Veronica Lodge and Betty Cooper, Archie's other girlfriends)." ], [ "Archie Marries Veronica/Archie Marries Betty", "Archie Marries Veronica/Archie Marries Betty\n\n\"Archie Marries Veronica/Archie Marries Betty\" is an American comic book story by writer Michael Uslan and artists Stan Goldberg and Bob Smith that was originally presented in \"Archie\" # 600\u2013606.", "In issues # 600\u2013602, the story features a futuristic look into the life of Riverdale teen Archie Andrews in the years that follow his college graduation when Archie makes his ultimate decision to marry Veronica Lodge instead of Betty Cooper.", "In Issues # 603\u2013605, the story switches and Archie proposes marriage to Betty instead of to Veronica.", "Issue #606 serves as the epilogue to the story and ties the previous six issues together.", "In May 2009, Archie Comics released plans for what they would call \"The Archie Story Of The Century\" and announced that Archie Andrews would ask Veronica Lodge to marry him in Archie Comics # 600, the first issue of a six-part story arc detailing their engagement, marriage and life together.", "The publishers of Archie Comics did not expect the response they would get from readers and longtime fans telling them they made a mistake in Archie's choice.", "\"The New York Times\" would later reveal that the whole story is simply a fantasy and that the first half of the story would show Archie's life with Veronica, and the second half would show his life with Betty." ] ], "gold": "On May 15, 2009, Archie Comics announced that Archie would finally pick one of the girls to marry, in a story arc in Archie numbers 600 to 606. However, Archie Comics publicly revealed this to be a dream sequence to show two possible futures, one where Archie marries Veronica and the other where he marries Betty. The success of the Archie Marries Veronica/Archie Marries Betty storyline led to a similar storyline called Archie Marries Valerie, depicting Archie marrying Valerie Brown from Josie and the Pussycats, shown in Archie episodes 631 to 634. However, in these episodes, Valerie has the future dream sequence instead of Archie. As of 2018, Archie does not end up marrying anyone in the comics in anything other than a dream sequence.", "prediction 1": "Archie Comics announced on May 15, 2009, that Archie would finally pick one of the girls to marry, in a story arc in Archie #600\u2013606 (Aug. 2009 \u2013 Feb. 2010). However, Archie Comics publicly revealed this to be a dream sequence to show two possible futures: one where Archie marries Veronica (issues 600\u2013602), and the other Betty (603\u2013605). In both, he has twins: a boy also named Archie who looks like him, and a girl named after and resembling whichever girl he married.\n", "prediction 2": "Archie Comics announced that Archie would finally pick one of the girls to marry, in a story arc in Archie #600-#606 from August 2009 \u2013 Feb. 2010. However, Archie Comics publicly revealed this to be a dream sequence to show two possible futures: one where Archie marries Veronica (issues 600-602) and the other Betty (issues 603-#605). In both, he has twins: a boy, who looks like him, and a girl named after and resembling whichever girl he married.", "prediction 3": "Archie comics announce that in Archie #606 (Aug. 2009 \u2013 Feb. 2010), he will finally pick one of the girls to marry, and appearances in Archie #600\u2013606 (Aug. 2009 \u2013 Feb. 2010) confirm this. There, he marries Betty, who is an adult adult in both stories. The two stories then proceed to show two possible futures with Archie, showing one only being with Betty.", "prediction 4": "Archie Comics announced that from issues 600\u2013606 in August 2009 \u2013 February 2010 he would finally pick one of the five girls to marry. In this story arc, Archie marries Judy Blum, but in issues 603\u2013605, he marries Betty Brown.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 133, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 291, "end": 308 }, { "error type": "Irrelevant", "explanation": "", "start": 329, "end": 339 }, { "error type": "Irrelevant", "explanation": "", "start": 340, "end": 472 } ], "missing-info": [], "corrected-prediction": "Archie Comics announced on May 15, 2009, that Archie would finally pick one of the girls to marry, in a story arc in Archie #600\u2013606. However, Archie Comics publicly revealed this to be a dream sequence to show two possible futures: one where Archie marries Veronica, and the other Betty.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who is the highest paid person on tv?", "passages": [ [ "Jennifer Aniston", "Jennifer Aniston\n\nJennifer Joanna Aniston (born February 11, 1969) is an American actress, film producer, and businessperson.", "The daughter of actors John Aniston and Nancy Dow, she began her acting career at an early age making her acting debut with an uncredited role in the 1987 film \"Mac and Me\".", "Aniston rose to fame portraying Rachel Green on the television sitcom \"Friends\" (1994\u20132004), for which she earned a Primetime Emmy Award, a Golden Globe Award, and a Screen Actors Guild Award (SAG).", "The character was widely popular during the airing of the series and was later recognized as one of the greatest female characters in American television.", "Aniston has since played lead roles in numerous comedies and romantic comedies.", "Her box office hits include \"Bruce Almighty\" (2003), \"The Break-Up\" (2006), \"Marley & Me\" (2008), \"Just Go with It\" (2011), \"Horrible Bosses\" (2011), and \"We're the Millers\" (2013), each of which have grossed over 200\u00a0million in worldwide receipts." ], [ "Ray Romano", "Ray Romano\n\nRaymond Albert Romano (born December 21, 1957) is an American stand-up comedian, actor and screenwriter.", "He is best known for his role on the sitcom \"Everybody Loves Raymond\", for which he received an Emmy Award, and as the voice of Manny in the \"Ice Age\" film series.", "He created and starred in the TNT comedy-drama \"Men of a Certain Age\" (2009\u201311).", "From 2012 to 2015, Romano had a recurring role as Hank Rizzoli, a love interest of Sarah Braverman in \"Parenthood\", and co-starred in the romantic comedy \"The Big Sick\" (2017).", "Romano was born in Queens, New York, the son of Lucie (n\u00e9e Fortini), a piano teacher, and Albert Romano (November 7, 1925 \u2013 March 11, 2010), a real estate agent and engineer.", "He is of Italian descent.", "He grew up in the Forest Hills neighborhood of Queens.", "He has an older brother, Richard (born in 1956), a sergeant with the NYPD, and a younger brother, Robert, a second grade teacher in New York City.", "Romano married his wife, Anna Scarpulla, in 1987.", "They met while working at a bank together.", "They have four children.", "Romano's character's daughter on \"Everybody Loves Raymond\" was named after his real-life daughter." ], [ "Simon Cowell", "Simon Cowell\n\nSimon Phillip Cowell (; born 7 October 1959) is an English television music and talent competition judge, A&R executive, television producer, entrepreneur, and television personality.", "He has judged on the British TV talent competition series \"Pop Idol\", \"The X Factor\" and \"Britain's Got Talent\", and the American TV talent competition shows \"American Idol\", \"The X Factor\" and \"America's Got Talent\".", "Cowell is the principal founder and chief executive of the British entertainment company Syco.", "Cowell often makes blunt and controversial comments as a television show judge, including insults and wisecracks about contestants and their singing abilities.", "He combines activities in both the television and music industries.", "Cowell has produced and promoted singles and albums for various singers whom he has taken under his wing.", "He is popularly known for signing successful boybands such as Westlife, One Direction and CNCO.", "In 2004 and 2010, \"Time\" named Cowell one of the 100 most influential people in the world.", "In 2008, \"The Daily Telegraph\" ranked him sixth in their list of the \"100 most powerful people in British culture\".", "Simon Phillip Cowell was born on 7 October 1959 in Lambeth, London, and raised in Elstree, Hertfordshire." ], [ "Ellen DeGeneres", "Ellen DeGeneres\n\nEllen Lee DeGeneres ( ; born January 26, 1958) is an American comedian, television host, actress, writer, producer, and LGBT activist.", "She starred in the popular sitcom \"Ellen\" from 1994 to 1998 and has hosted her syndicated TV talk show, \"The Ellen DeGeneres Show,\" since 2003.", "Her stand-up career started in the early 1980s, and included a 1986 appearance on \"The Tonight Show Starring Johnny Carson\".", "As a film actress, DeGeneres starred in \"Mr. Wrong\" (1996), \"EDtv\" (1999), and \"The Love Letter\" (1999), and provided the voice of Dory in the Pixar animated films \"Finding Nemo\" (2003) and \"Finding Dory\" (2016); for \"Nemo\", she was awarded the Saturn Award for Best Supporting Actress, the first time an actress won a Saturn Award for a voice performance.", "In 2010, she was a judge on \"American Idol\" for its ninth season.", "She starred in two television sitcoms, \"Ellen\" from 1994 to 1998, and \"The Ellen Show\" from 2001 to 2002.", "During the fourth season of \"Ellen\" in 1997, she came out as a lesbian in an appearance on \"The Oprah Winfrey Show\"." ], [ "Howard Stern", "Stern was inducted into the National Radio Hall of Fame in 2012.", "He has been openly critical of the organization.", "In August 2013, Stern and Simon Cowell shared first place on \"Forbes\" list of America's highest-paid television personalities with $95 million earned between June 2012\u201313.", "Stern and Cowell tied first place in the following year's poll with the same amount earned from June 2013\u201314.", "In 2015, \"Forbes\" placed Stern as the world's highest paid media personality and the fifth highest earning celebrity worldwide, at $95 million.", "In February 2015, Whalerock Industries announced its partnership with Stern to set up a future direct-to-consumer digital \"media hub\" service, with a potential mix of free and subscription-based programming.", "On December 15, Stern announced his new deal with SiriusXM to continue his radio show for an additional five years.", "The agreement also gives Sirius the rights to his radio and video archives for an upcoming on-demand streaming application until 2027.", "In April 2018, Stern inducted Bon Jovi into the Rock and Roll Hall of Fame.", "Between 1990 and 2004, the Federal Communications Commission (FCC) fined owners of radio station licensees that carried \"The Howard Stern Show\" a total of $2.5 million for content it considered to be indecent." ] ], "gold": "Jennifer Aniston and Reese Witherspoon, who co-star on Apple TV+'s The Morning Show, are the highest paid actresses per episode on TV, without adjusting for inflation. Ray Romano, who is best known for his role on Everybody Loves Raymond, is the highest paid person per episode on TV, when adjusting for inflation. Simon Cowell, who is known for his work on The X Factor, American Idol, and America's Got Talent and is the principal, founder and chief executive of the British entertainment company Syco, is the highest paid person per season on TV. Ellen DeGeneres, who starred in the sitcom Ellen from 1994 to 1998 and has hosted her syndicated television talk show, The Ellen DeGeneres Show, since 2003, is the highest paid person per year on TV. ", "prediction 1": "The highest paid person on television is the host of the sitcom \"Ellen\", the highest paid person on the American television show \"American Idol\", and the highest paid person on the comedy series \"The X Factor\". The highest paid person on the sitcom \"Ellen\" is Jennifer Aniston, who is an American actress, film producer, and businessperson. The highest paid person on the American television show \"America's Got Talent\" is Simon Cowell, an English television music and talent competition judge, A&R executive, television producer, and television personality.\n", "prediction 2": "Leading individual in tv history is also the highest paid actress and producer on television. American actress Jennifer Aniston has topped the list for most highly paid actress in TV history. American comedians Adam Levine and Simon Cowell are also among the highest paid television personalities.", "prediction 3": "There are many people who are the highest paid on television. The highest paid TV personality according to Forbes is Simon Cowell. He is also the highest paid television host, who earns $200,000 per episode. The highest paid television newsreader according to USA Today earns $327,000 per episode. The highest paid single person on television who has never received more than $350,000 for their entire career is Scooter Braun, who is the highest paid single TV newsreader in the industry. The highest paid TV newsreader on radio, which earnss, is the largest-164th in the history of television.", "prediction 4": "Jennifer Joanna Aniston is the highest paid female television star (2,191,656). She rose to fame portraying Rachel Green on the television sitcom Friends (1994\u20132004), for which she earned a Primetime Emmy Award, a Golden Globe Award, and a Screen Actors Guild Award (SAG). Also in the top 5 highest paid television personalities are: Simon Cowell, The Voice, Craig Ferguson, Sarah Perry, Ellen DeGeneres, Jim Tuck, Matt Stone, Rachel Hamilton, Ryan Seagulftit, Whoopi lamenter, Dominia Hopper, Shen Tyson. With the highest paid TV Agent Richard and GayTurgent.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[5]}", "start": 0, "end": 210 }, { "error type": "Irrelevant", "explanation": "", "start": 211, "end": 340 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":5,\"sentence_id\":[3]}", "start": 341, "end": 559 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "In 2015, \"Forbes\" placed Howard Stern as the world's highest paid media personality. In 2013 and 2014 he shared first place on \"Forbes\" list of America's highest-paid television personalities with Simon Cowell, who is known for his work on The X Factor, American Idol, and America's Got Talent and is the principal, founder and chief executive of the British entertainment company Syco." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where was the movie birth of a nation filmed?", "passages": [ [ "The Birth of a Nation (2016 film)", "The Birth of a Nation (2016 film)\n\nThe Birth of a Nation is a 2016 American-Canadian period drama film based on the story of Nat Turner, the enslaved man who led a slave rebellion in Southampton County, Virginia, in 1831.", "Co-written, co-produced and directed by Nate Parker (in his directorial debut), the film stars Parker as Turner, with Armie Hammer, Mark Boone Junior, Colman Domingo, Aunjanue Ellis, Aja Naomi King, Dwight Henry, Jackie Earle Haley, Esther Scott, Penelope Ann Miller, Roger Guenveur Smith, and Gabrielle Union in supporting roles.", "Parker also petitioned financiers to invest in the film, ultimately getting an $8.5 million production budget, and started filming in May 2015 in Georgia.", "The film premiered in competition at the 2016 Sundance Film Festival on January 25, 2016.", "Fox Searchlight Pictures bought worldwide rights to the film in a $17.5 million deal, the largest deal at the film festival to date.", "At the end of the festival, the film won the Audience Award and Grand Jury Prize in the U.S. Dramatic Competition and was highly praised for its directing, acting, soundtrack and cinematography.", "The film was theatrically released in the United States on October 7, 2016 by Fox Searchlight Pictures and grossed $16 million." ], [ "Forest Lawn Memorial Park (Hollywood Hills)", "He envisioned Forest Lawn to be \"a great park devoid of misshapen monuments and other signs of earthly death, but filled with towering trees, sweeping lawns, splashing fountains, beautiful statuary, and... memorial architecture\".", "Before it was a cemetery, Forest Lawn was a filming location used by directors such as Carl Laemmle and Cecil B. DeMille.", "The climactic battle scenes for D. W. Griffith's \"The Birth of a Nation\" were filmed there.", "The alternate names of the filming site are Providencia Flats, Nestor Ranch, Oak Ranch, Oak Crest Ranch, Universal Ranch/Universal City, Lasky Ranch, and Paramount Ranch until November 1927.", "When Eaton (self-proclaimed as \"The Builder\") made known his desire to open a second Forest Lawn location in the Hollywood Hills, the local residents protested vehemently.", "To circumvent the protesters, Mr. Eaton sent his staff to the county morgue to claim 6 \"John Does\" and buried them at the corners of the property in the dark of night.", "In the morning, the protesters had no power because, by law, the property was now a cemetery." ], [ "Birth of a Nation (1983 film)", "Birth of a Nation (1983 film)\n\nBirth of a Nation is a 1983 television play starring Jim Broadbent as teacher Geoff Figg.", "It was written by David Leland and directed by Mike Newell.", "It was originally broadcast on ITV on 19 June 1983 as the first in an untitled series of works by Leland (including \"Made in Britain\"), all loosely concerned with the British educational system, which subsequently acquired the overall title of \"Tales Out of School\"." ], [ "The Birth of a Nation (2016 film)", "In subsequent months, Penelope Ann Miller, Jackie Earle Haley, and Mark Boone Junior also joined.", "Filming took place in Georgia in May 2015 and lasted 27 days.", "Parker used the a cappella choir from Wiley College on the soundtrack.", "Parker had previously been part of a cast that portrayed historical figures from Wiley, in \"The Great Debaters\".", "\"The Birth of a Nation\" premiered in competition at the 2016 Sundance Film Festival on , 2016.", "Before it screened, the audience gave a standing ovation to the introduction of Nate Parker.", "After it premiered, \"Variety\" said it \"received the most enthusiastic standing ovation at this year's Sundance Film Festival so far\".", "Following \"The Birth of a Nation\"s Sundance premiere, Fox Searchlight Pictures bought worldwide rights to the film in a deal.", "Competing deals also came from The Weinstein Company, Sony Pictures Entertainment, and Netflix.", "\"Variety\" said Fox Searchlight's deal was \"the richest in Sundance history\".", "A teaser trailer for the film was released in April 2016, followed by an official trailer on June 21, 2016.", "On July 6, the UK release date of January 20, 2017, was announced.", "It was actually released in the UK on December 9, 2016.", "A film poster with Parker in a noose made from an American flag was released on July 15." ], [ "Simon Bowles", "Simon Bowles worked with Amma Asante again on \"A United Kingdom\" which tells the true story of the relationship between Seretse Khama, the chief to be of the Bamangwato tribe in the British colony of Bechuanaland in the late 1940s, and a white, middle-class Englishwoman, Ruth Williams.", "It stars David Oyelowo and Rosamund Pike directed by Amma Asante produced by Rick McCallum.", "It was released in the UK in October 2016, US release in February 2017.", "Bowles next project to be released is Universal Pictures Johnny English Strikes Again starring Rowan Atkinson, released in October 2018." ] ], "gold": "The 1915 film \"The Birth of a Nation\" was filmed on Forest Lawn Memorial Park, in Griffith Ranch in San Fernando Valley, Whittier and Ojai Valley. The 1983 television play \"Birth of a Nation\", starting Jim Broadbent as teacher Geoff Figg, is from the United Kingdom. The 2016 film \"Birth of a Nation\" was filmed in Georgia in 27 days.", "prediction 1": "Birth of a Nation is a 1983 television play written by David Leland and directed by Mike Newell. Filming for the 1983 film took place in London, England, and in Georgia, USA. The 2016 film was based on the story of Nat Turner, the enslaved man who led a slave rebellion in Southampton County, Virginia, in 1831.\n", "prediction 2": "Birth of a Nation is a 1993 television play based on the true story of Nat Turner, an enslaved man who led a slave rebellion in Southampton County, Virginia, in 1831. The filming for the 1983 film was in Georgia, while it was filmed in Tennessee. In 2016, Nate Parker directed a period drama film based on the story of Nat Turner, the enslaved man who led a slave rebellion in Southampton County, Virginia.", "prediction 3": "Birth of a Nation is a 2016 American-Canadian period drama film based on the story of Nat Turner, the enslaved man who led a slave rebellion in Southampton County, Virginia, in 1831. D. W. Griffith's 1983 film The Birth of a Nation was filmed at Forest Lawn Memorial Park in Hollywood Hills, California, while Nate Parker directed his directorial debut.", "prediction 4": "Birth of a Nation is a 1983 television show that was also a film. Filming for the 1983 TV show took place at Forest Lawn Memorial Park in the Hollywood Hills. Filming for the 2016 film took place in Georgia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 44, "end": 96 }, { "error type": "Unverifiable", "explanation": "", "start": 137, "end": 144 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[3]}", "start": 154, "end": 174 }, { "error type": "Irrelevant", "explanation": "", "start": 193, "end": 312 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 4, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The climactic battle scenes for D. W. Griffith's \"The Birth of a Nation\" were filmed in Forest Lawn Memorial Park. Filming for the 1983 television play \"Birth of a Nation\", starring Jim Broadbent as teacher Geoff Figg, took place in England. The 2016 film \"Birth of a Nation\" was filmed in Georgia and lasted 27 days. " }, "preference": [ 2, 2, 1, 1, 1, 1 ] }, { "question": "When was the last time the dodgers and the yankees played in the world series?", "passages": [ [ "Dodgers\u2013Yankees rivalry", "Dodgers\u2013Yankees rivalry\n\nThe Dodgers\u2013Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees.", "The Dodgers are a member club of the National League (NL) West division, and the Yankees are a member club of the American League (AL) East division.", "The rivalry between the Dodgers and Yankees is one of the most well-known rivalries in Major League Baseball.", "The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues.", "The initial significance was embodied in the two teams' proximity in New York City, when the Dodgers initially played in Brooklyn while the Yankees played in the Bronx.", "After the Dodgers moved to Los Angeles in , the rivalry retained its significance as the two teams represented the dominant cities on each coast of the United States, and since the 1980s, the two largest cities in the United States.", "The Dodgers currently lead the regular season series 7-6.", "Although the rivalry's significance arose from the two teams' numerous World Series meetings, the Yankees and Dodgers have not met in the World Series since .", "They would not play each other in a non-exhibition game until 2004, when they played a 3-game interleague series.", "Nevertheless, games between the two teams have become quite popular and draw sellout crowds." ], [ "Dodgers\u2013Yankees rivalry", "The Yankee owner was criticized heartily by players and press alike for doing so, as most people felt losing in the World Series was not something that needed to be apologized for.", "Lasorda said of the revenge for what Jackson did to the Dodgers in 1977 and 1978:", "\"We were suffering and the guy was making a fool out of us.", "I was hoping and praying we would get another shot at him.\"", "This led to the Yankees not winning a World Series in the 1980s, the only decade they would not have won a championship since moving to the Bronx.", "In contrast, the Dodgers were able to defeat the Oakland Athletics in the 1988 World Series.", "It would be their last post-season meeting to date, the last time ever the Dodgers visited the old Yankee Stadium, and the last meeting between teams from New York City and Los Angeles for a major professional sports championship until the Rangers and the Kings squared off in the 2014 Stanley Cup Finals.", "Although the Yankees and the Dodgers have not met in the playoffs since the 1981 World Series, interleague matchups between the two teams, whether in New York or Los Angeles, have become quite popular." ] ], "gold": "The Dodgers\u2013Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The rivalry between the Dodgers and Yankees is one of the most well-known rivalries in Major League Baseball. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National leagues. The last game where the Dodgers and Yankees played in the World Series was held on October 28, 1981.", "prediction 1": "The Dodgers\u2013Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues. Although the rivalry's significance arose from the two teams' numerous World Series meetings, the Yankees and Dodgers have not met in the World Series since. They would not play each other in a non-exhibition game until 2004, when they played a 3-game interleague series.\n", "prediction 2": "The Dodgers\u2013Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues. The last time they met in the World Series was on August 13, 1981.", "prediction 3": "The Dodgers-Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues combined. The last time the Dodgers and Yankees played in the World Series was in 1981.", "prediction 4": "The Dodgers-Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues combined. These eleven World Series meetings count for 34 of the 35 World Series meetings. But, the two teams have not met in the World Series since. Nevertheless, interleague matchups between the two teams, whether in Los Angeles or in New York, Los Angeles, have become quite popular and draw sellout crowds.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 418, "end": 532 }, { "error type": "Irrelevant", "explanation": "", "start": 260, "end": 353 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Dodgers\u2013Yankees rivalry is a Major League Baseball (MLB) rivalry between the Los Angeles Dodgers and the New York Yankees. The rivalry between the Dodgers and Yankees is one of the most well-known rivalries in Major League Baseball. The two teams have met 11 times in the World Series, more times than any other pair of teams from the American and National Leagues. The last game where the Dodgers and Yankees played in the World Series was held in 1981.\n\n" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "Who did aaron judge play for last year?", "passages": [ [ "Aaron Judge", "Aaron Judge\n\nAaron James Judge (born April 26, 1992) is an American professional baseball outfielder for the New York Yankees of Major League Baseball (MLB).", "Judge was unanimously selected as the American League (AL) Rookie of the Year in 2017 and finished second, behind Jos\u00e9 Altuve, for AL Most Valuable Player.", "Judge, who played college baseball at California State University, Fresno, was selected by the Yankees in the first round of the 2013 MLB draft.", "After making his major league baseball debut in 2016 and hitting a home run in his first career at bat, Judge went on to have a record-breaking rookie season in 2017.", "He was named an All-Star and won the Home Run Derby, becoming the first rookie to do so.", "Judge ended the season with 52 home runs, breaking Mark McGwire's MLB rookie record of 49 and the Yankees' full-season rookie record of 29 (previously held by Joe DiMaggio).", "He won the American League (AL) Rookie of the Month Awards for April, May, June and September, as well as the AL's Player of the Month Award for June and September.", "Judge stands tall and weighs , which makes him one of the biggest players in the major leagues.", "Judge was born and raised in Linden, California and was adopted the day after he was born by Patty and Wayne Judge, who both worked as teachers." ] ], "gold": "Aaron Judge played for the New York Yankees last year.", "prediction 1": "Aaron Judge is an American professional baseball outfielder for the New York Yankees of Major League Baseball. He was named the American League Rookie of the Year in 2017 and finished second, behind Jos\u00e9 Altuve, for AL Most Valuable Player.\n", "prediction 2": "Aaron Judge is an American professional baseball outfielder who played for the New York Yankees of Major League Baseball last year. Judge was unanimously selected as the American League (AL) Rookie of the Year in 2017 and finished second, behind Jos\u00e9 Altuve, for AL Most Valuable Player.", "prediction 3": "Aaron Judge is an American professional baseball outfielder for the New York Yankees. He was selected by the Associated Press as the American League (AL) Rookie of the Year in 2017, and finished second behind Jose Altuve, for AL Most Valuable Player. Aaron Judge made his major league baseball debut in 2016 and hit a home run in his first career at bat. He went on to have a record-breaking rookie season in 2017 where he was named an All-Star and won the Home Run Derby, becoming the first rookie to do so.", "prediction 4": "Aaron Judge is an American professional baseball outfielder for the New York Yankees of Major League Baseball. He was named the American League Rookie of the Year for his rookie season in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 111, "end": 241 }, { "error type": "Irrelevant", "explanation": "", "start": 15, "end": 63 } ], "missing-info": [], "corrected-prediction": "Aaron Judge is on the New York Yankees of Major League Baseball. " }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When was steph curry drafted to the nba?", "passages": [ [ "2009 NBA draft", "Stephen Curry was named NBA MVP for 2 consecutive years (2015\u20132016), and won his first NBA championship in 2015.", "Of the 60 players drafted, four were freshmen, nine were sophomores, 12 were juniors, 22 were seniors, and 13 were international players without U.S. college basketball experience.", "The University of North Carolina's Tar Heels had the most players selected in the draft; three players were selected in the first round and one was selected in the second round.", "This marked the second time ever that four Tar Heels players were selected in the first two rounds of an NBA draft.", "The Minnesota Timberwolves had the league-high four first-round draft picks and the first time in team history that the team held two top-10 draft picks.", "The Timberwolves also had two second-round draft picks and became the team with the most draft picks in the 2009 draft with a total of six.", "The Houston Rockets and the Orlando Magic were the only NBA teams who did not have a draft pick this year, although Houston acquired three drafted players' rights after the draft.", "These players were not selected in the 2009 NBA draft but have played at least one game in the NBA." ], [ "Splash Brothers", "Splash Brothers\n\nThe Splash Brothers are a duo of American basketball players consisting of Stephen Curry and Klay Thompson.", "The two guards play professionally for the Golden State Warriors in the National Basketball Association (NBA).", "Excellent long-range shooters, they have combined to set various NBA records for three-point field goals by a pair of teammates, and each has won the Three-Point Contest.", "The two NBA All-Stars have won three NBA championships with the Warriors.", "The sons of former NBA players, Curry and Thompson were not highly recruited out of high school, but enjoyed relatively successful college basketball careers before being selected in the first round of the NBA draft by the Warriors.", "Curry was chosen with the seventh overall pick in 2009, while Thompson was the eleventh overall selection in 2011.", "In 2014\u201315, they became the first teammates in the league to be the starting guards in the same All-Star Game since 1975, and they were the Warriors' first pair of All-Stars since 1993.", "They also became the first guard combo to be named to the All-NBA Team in the same season since 1979\u201380.", "The two also enjoyed team success, helping the Warriors win the 2015 NBA Finals for the team's first title in 40 years.", "They would later replicate the feat in 2017 and 2018, for three championships." ] ], "gold": "In 2009, Steph Curry was drafted by the Warriors in Round 1 with the seventh overall pick.", "prediction 1": "Stephen Curry was drafted to the NBA in the first round of the 2009 NBA draft by the Golden State Warriors. He was named NBA MVP for 2 consecutive years in 2015 and 2016. Curry and Klay Thompson are a duo of American basketball players who play professionally for the Golden State Warriors in the National Basketball Association (NBA).\n", "prediction 2": "Steven Curry was drafted to the NBA in the first round of the 2009 NBA draft by the Golden State Warriors. In the 2017 NBA draft, Curry was selected with the sixth overall pick while Klay Thompson was selected with the seventh overall pick.", "prediction 3": "Stephen Curry was drafted to the NBA as a seventh round pick in the 2009 NBA draft by the Golden State Warriors. He then went on to play in the 2017 NBA Finals. Stephen Curry, Klay Thompson, and Gordon Hayward were picked as first round draft picks in 2001-2002, 2004, and 2011.", "prediction 4": "Stephen Curry was selected to the NBA in the first round of the 2009 NBA draft by the Golden State Warriors. Curry and Klay Thompson were not highly recruited out of high school but enjoyed relatively successful college basketball careers before being selected with the seventh overall pick in 2009.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 170 }, { "error type": "Irrelevant", "explanation": "", "start": 171, "end": 336 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] } ], "corrected-prediction": "Stephen Curry was drafted to the NBA in the first round of the 2009 NBA draft by the Golden State Warriors, with the seventh overall pick." }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "How many episodes of season 8 blue bloods?", "passages": [ [ "Blue Bloods (season 8)", "Blue Bloods (season 8)\n\nThe eighth season of \"Blue Bloods\", a police procedural drama series created by Robin Green and Mitchell Burgess, premiered on CBS on September 29, 2017.", "The season contained 22 episodes and concluded on May 11, 2018.", "Donnie Wahlberg (Danny Reagan), Bridget Moynahan (Erin Reagan), Will Estes (Jamie Reagan), and Len Cariou (Henry Reagan) are first credited.", "Sami Gayle (Nicky Reagan-Boyle) is credited next, marking the fourth season she has been included in the opening credits.", "Tom Selleck (Frank Reagan) receives an \"and\" billing at the close of the main title sequence.", "Amy Carlson (Linda Reagan) left between Seasons 7 and 8.", "Marisa Ramirez, as Danny's partner Detective Maria Baez, and Vanessa Ray, as Jamie's partner Eddie Janko, continue to receive \"also starring\" billing for season 8.", "Appearing regularly and receiving \"special guest star\" billing are Gregory Jbara as Deputy Commissioner of Public Information Garrett Moore, Robert Clohessy as Lt. Sidney Gormley, and Abigail Hawk as Detective Abigail Baker, Frank's primary aide.", "" ], [ "Law & Order: Special Victims Unit (season 7)", "Law & Order: Special Victims Unit (season 7)\n\n", "The seventh season of the television series, \"\" premiered September 20, 2005 and ended May 16, 2006 on NBC.", "It aired on Tuesday nights at 10pm/9c.", "Critically the show's most successful season, both lead actors received nominations at the 2006 Emmy Awards with a win by Mariska Hargitay.", "Repeating a pattern established by other \"SVU\" seasons, the Season 7 premiere was filmed before the airing of the Season 6 finale.", "Long-time \"SVU\" co-executive producers, , , and departed the series at the end of Season 7.", "Additionally, long-time \"Law & Order\" franchise director Constantine Makris departed until his return in the .", "Mariska Hargitay won the Primetime Emmy Award for Outstanding Lead Actress in a Drama Series for her performance in the episode \"911\".", "This made her the first regular cast member of any \"Law & Order\" series to win an Emmy.", "Christopher Meloni was nominated for the Primetime Emmy Award for Outstanding Lead Actor in a Drama Series, his first Emmy nomination.", "Meloni was water skiing when the 2006 Emmy nominations were announced.", "He received a congratulatory call from showrunner Neal Baer and responded with \"Cool!", "I'm going back to ski.\"" ], [ "NCIS (season 10)", "Parsons pressures Gibbs to admit that he and his team have broken the law on countless occasions and to come forward and admit everything that he has done.", "After a long feud, Gibbs is freed of his charges and sent on a top-priority mission, while Ziva, DiNozzo, and McGee resign from the agency.", "The season ends with a cut to four months later, showing Gibbs aiming a sniper rifle at FBI agent Tobias Fornell.", "The season finale aired on May 14, 2013.", "On January 15, 2013, the episode \"Shiva\" delivered the biggest audience ever so far for an \"NCIS\" episode.", "22.86 million people watched the episode, which surpassed the season eight episode \"Freedom\" by 10,000 viewers.", "Season ten also got \"NCIS\" to deliver its first 1st-place ratings achievement for the 2012\u201313 season.", "\"NCIS\" beat out NBC's \"Sunday Night Football\" to become the overall most watched program nationally.", "On March 14, 2012, CBS renewed \"NCIS\" for a tenth season which premiered on September 25, 2012.", "The season 10 production began in July 2012, a week after Michael Weatherly, Sean Murray and Pauley Perrette had signed their new contracts on the show.", "David McCallum signed his contract back in April 2012, while the rest of the cast was under contract for season 10." ], [ "True Blood", "The second-season premiere of the series (June 14, 2009) was viewed by 3.7 million, making it the most watched program on HBO since the series finale of \"The Sopranos\".", "The total number of viewers for the season premiere, including the late night replay, was 5.1 million.", "The tenth episode of the second season (August 23, 2009) was seen by 5.3 million viewers, a new record for the series.", "The second season's finale (September 13, 2009) was seen by 5.1 million viewers.", "An average of 12.4 million a week watched the second season.", "The ninth episode of the fourth season (August 21, 2011) set a new record with 5.53 million viewers, making it the most viewed episode to date.", "\"True Blood\" is HBO's most watched series since \"The Sopranos\".", "The show was declared the eighth highest rated show for the first ten years of IMDb.com Pro (2002\u20132012).", "The show won an Outstanding Casting for a Drama at the 61st Primetime Emmy Awards; the two lead actors have both been recognized for their performances:\n\nThe show received an American Film Institute Award in 2009 as \"One of the 10 Best TV Programs\" and was chosen as \"Favorite TV Obsession\" at the 36th People's Choice Awards." ] ], "gold": "The eighth season of Blue Bloods, a police procedural drama series, premiered on CBS on September 29, 2017. The season contained 22 episodes and concluded on May 11, 2018. Of the 22 episodes, 10 aired in 2017 and 12 aired in 2018. Also, 21 of the 22 episodes had more than 10 million total viewers.", "prediction 1": "The eighth season of Blue Bloods, a police procedural drama series created by Robin Green and Mitchell Burgess, premiered on CBS on September 29, 2017. The season contained 22 episodes and concluded on May 11, 2018.\n", "prediction 2": "Blue Bloods is an American police procedural drama television series produced by Robin Green and Mitchell Burgess that aired on CBS for seven seasons from September 20, 2005 to May 16, 2006, with 38 episodes in total. There were 22 episodes of the season 8 Blue Bloods as of September 29, 2017.", "prediction 3": "The eighth season of the American police procedural crime drama Blue Bloods aired on CBS and included 22 episodes.", "prediction 4": "Blue Bloods, a police procedural drama television series created by Robin Green and Mitchell Burgess, premiered on CBS on September 29, 2017. There were 22 episodes in season 8 of Blue Bloods.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 67, "end": 111 } ], "missing-info": [], "corrected-prediction": "The eighth season of Blue Bloods, a police procedural drama series, premiered on CBS on September 29, 2017. The season contained 22 episodes and concluded on May 11, 2018.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who is the minister of agriculture in south africa?", "passages": [ [ "Senzeni Zokwana", "Senzeni Zokwana\n\nSenzeni Zokwana is a South African politician.", "He is a Member of Parliament and currently serving as the Minister of Agriculture, Forestry and Fisheries, having been appointed by President Jacob Zuma in May 2014.", "He previously served as the President of the National Union of Mineworkers (NUM).", "He became involved in trade union activism in 1980 during the apartheid-era in South Africa at the President Steyn gold mine in the Free State.", "He joined the ranks of NUM in 1983, became a shaft steward in 1984 and was elected to the branch executive committee in the President Steyn Mine in 1985.", "He subsequently moved up the ranks to become branch chairperson in 1987, vice regional chairperson in 1992 and regional chairperson from 1993 to 1994.", "He was first a shift overseer on safety matters and in 1995, he joined the NUM staff as a safety officer, after proving himself a dedicated advocate of modern mine safety techniques.", "Mr Zokwana was elected as vice president in 1994, a position he held until 2000 when he was elected president.", "He was subsequently re-elected for the role and held the position until 2014.", "In 2005 Zokwana was elected as President of the International Federation of Chemical, Energy, Mine and General Workers' Unions in 2005 and was subsequently re-elected in November 2011." ], [ "Minister of Agriculture, Forestry and Fisheries (South Africa)", "Minister of Agriculture, Forestry and Fisheries (South Africa)\n\nThe Minister of Agriculture, Forestry and Fisheries is a Minister of the Cabinet of South Africa, with political executive responsibility for the Department of Agriculture, Forestry and Fisheries, and for the Agricultural Research Council (South Africa)|Agricultural Research Council, the National Agricultural Marketing Council, Onderstepoort Biological Products, the Perishable Products Export Control Board, and Ncera Farms.", "The Agriculture, Forestry and Fisheries portfolio was created in the 2009 cabinet reorganization after the election of President Jacob Zuma; the Minister inherited the responsibility for agriculture from the Minister of Agriculture and Land Affairs, the responsibility for fisheries from the Minister of Environmental Affairs and Tourism, and the responsibility for forestry from the Minister of Water Affairs and Forestry.", "The first Minister of Agriculture, Forestry and Fisheries was Tina Joemat-Peterson and her deputy was Pieter Mulder.", "The current Minister of Agriculture, Forestry and Fisheries is Senzeni Zokwana with Sfiso Buthelezi as his deputy." ], [ "Minister of Agriculture and Land Affairs", "Minister of Agriculture and Land Affairs\n\nThe Minister of Agriculture and Land Affairs was, from 1996 to 2009, a Minister of the Cabinet of South Africa, with responsibility for the Departments of Agriculture and Land Affairs.", "The portfolio was created in 1996 when the positions of Minister of Agriculture and Minister of Land Affairs were merged.", "In the 2009 cabinet reorganization after the election of President Jacob Zuma, the portfolio's responsibilities were divided and transferred to the Minister of Agriculture, Forestry and Fisheries and the Minister of Rural Development and Land Reform." ], [ "Lulama Xingwana", "Lulama Xingwana\n\nLulama \"Lulu\" Marytheresa Xingwana (born 23 September 1955) is a South African politician who served as Minister for Women, Children and People with Disabilities from November 2010 - May 2014.", "Previously she held the position of Deputy Minister of Minerals and Energy from 2004 to 2006 and was Minister of Agriculture and Land Affairs from 2006 to 2009, succeeding Thoko Didiza.", "Xingwana obtained a Bachelor of Science degree from University of Witwatersrand in 1985 and three postgraduate diplomas, one in Economic Principles from the University of Limpopo in 2002, and the other two in Development and Leadership Studies, and Rural Development from the University of Zimbabwe in Zimbabwe.", "Xingwana became a Member of Parliament after the 1994 South African elections.", "She is currently also chairperson of the Southern African Development Community's Regional Women's Caucus and director of the South African Council of Churches' Women's Development Programmes (1987).", "She has chaired the Joint Monitoring Committee for the Improvement of Quality of Life and Status of Women (2002\u20132004), the Parliamentary Women's Caucus (1999\u20132004), the Malibongwe Rural Development Project for Women (1998\u20132000) and the National Assembly Portfolio Committee for Sports and Recreation (1994\u20131999)." ], [ "Thoko Didiza", "Thoko Didiza\n\nAngela Thoko Didiza (born 2 June 1965) is a South African politician.", "She held the post of Minister of Agriculture and Land Affairs from 17 June 1999 to 22 May 2006 and later Minister of Public Works from 22 May 2006 to 25 September 2008.", "Didiza was born in the city of Durban and holds a BA (Hons) degree in politics.", "She is married and has five children.", "Following the resignation of President Thabo Mbeki in September 2008, Didiza was one of ten ministers who submitted their resignations on 23 September, although it was subsequently announced that she might be willing to remain in her post.", "On 20 June 2016 the ANC announced that Didiza will be their mayoral candidate for the City of Tshwane in the upcoming municipal elections of 2016.", "This announcement sparked a wave of rioting in the City of Tshwane against her appointment leading to the deaths of 5 people and the arrest of 40 more." ], [ "Dirk du Toit", "Dirk du Toit\n\nDirk Cornelis du Toit (19 September 1943 \u2014 1 June 2009) was the Deputy Minister of Agriculture and Land Affairs of the Republic of South Africa from 1999 to 2009.", "Du Toit became a Supreme Court Advocate in 1970 and Professor of Law at the University of the Free State from 1975 to 1994.", "He joined the Progressive Federal Party, the anti-apartheid parliamentary opposition, and secretly joined the banned African National Congress.", "He was also legal adviser to the National Education, Health and Allied Workers' Union (Nehawu).", "Following the end of apartheid, Du Toit became a Member of Parliament for the African National Congress in 1994.", "He helped to draft the Constitution of South Africa in 1996.", "His interest in human rights and land affairs led him to become Deputy Minister of Agriculture under Lulu Xingwana in the governments of Thabo Mbeki and Kgalema Motlanthe from 1999 until his retirement following the 2009 election.", "During his tenure, he supported land reform and worked to end the exploitation and unfair eviction of farm workers." ] ], "gold": "The Minister of Agriculture, Forestry and Fisheries was a Minister of the Cabinet of South Africa created from the Minister of Agriculture and Land Affairs in the 2009 cabinet reorganization after the election of President Jacob Zuma and later reorganized and divided between the Minister of Agriculture, Land Reform and Rural Development and the Minister of Environment, Forestry and Fisheries in May 2019. The last Minister of Agriculture and Land Affairs was Lulama Xingwana, who held the position from 2006 and was succeeded into the reorganization of 2009 by Tina Joemat-Peterson. In 2014, Senzeni Zokwana got hold of the position until the latest cabinet rearrangement. Currently, the Ministry of Agriculture, Land Reform and Rural Development is headed by Angela Thoko Didiza.", "prediction 1": "The current Minister of Agriculture, Forestry and Fisheries is Senzeni Zokwana. He was appointed by President Jacob Zuma in May 2014. Prior to this, Thoko Didiza was the Minister of Agriculture and Land Affairs. Lulama \"Lulu\" Xingwana served as the Minister of Agriculture and Land Affairs from 2006 to 2009. Thoko Didiza was the Minister of Agriculture and Land Affairs from 2006 to 2009.\n", "prediction 2": "The current Minister of Agriculture, Forestry and Fisheries in South Africa is Senzeni Zokwana, who has been in the office since May 2014. He succeeds Thoko Didiza, the previous Minister of Agriculture and Land Affairs. There has also been a Minister of Agriculture and Forestry and Fisheries since 2009, who was Thoko Didiza's deputy.", "prediction 3": "The Minister of Agriculture in South Africa is Thoko Didiza. Thoko Didiza served as South Africa's Minister of Agriculture and Land Affairs from 2006 to 2009. Minister of Agriculture, Forestry and Fisheries is a Minister of the Cabinet of South Africa, with political executive responsibility for the Department of Agriculture, Forestry and Fisheries, as well as for the Agricultural Research Council, the National Agricultural Marketing Council, Onderstepoort Biological Products, the Perishable Products Export Control Board, and Ncera Farms. Senzeni Zokwana has served as the role since 2014.", "prediction 4": "The Minister of Agriculture in South Africa is Thoko Didiza, who served from 2006 to 2009. Lulama Xingwana also served from 2011 to 2014 as the Minister of Agriculture and Land Affairs, succeeding Thoko Didiza.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 97, "end": 120 }, { "error type": "Redundant", "explanation": "Thoko Didiza was the Minister of Agriculture and Land Affairs. ", "start": 309, "end": 375 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1, 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 6, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Minister of Agriculture and Land Affairs was a Minister of the Cabinet of South Africa. In the 2009 cabinet reorganization after the election of President Jacob Zuma, the portfolio's responsibilities were divided and transferred to the Minister of Agriculture, Forestry and Fisheries and the Minister of Rural Development and Land Reform. The first Minister of Agriculture, Forestry and Fisheries was Tina Joemat-Peterson. The current Minister of Agriculture, Forestry and Fisheries is Senzeni Zokwana. He was appointed in May 2014. Thoko Didiza was the Minister of Agriculture and Land Affairs. Lulama \"Lulu\" Xingwana served as the Minister of Agriculture and Land Affairs from 2006 to 2009. Dirk du Toit Dirk Cornelis du Toit was the Deputy Minister of Agriculture and Land Affairs of the Republic of South Africa from 1999 to 2009." }, "preference": [ 2, 2, 2, 1, 2, 2 ] }, { "question": "Who plays sophie's fiance in mamma mia?", "passages": [ [ "Mamma Mia! (film)", "Mamma Mia!", "(film)\n\nMamma Mia! (promoted as Mamma Mia!", "The Movie) is a 2008 jukebox musical romantic comedy film directed by Phyllida Lloyd and written by Catherine Johnson based on the 1999 musical of the same name, also written by Johnson, which itself is based on the songs of pop group ABBA, including the title song, with additional music composed by ABBA member Benny Andersson.", "The film features an ensemble cast, including Christine Baranski, Pierce Brosnan, Dominic Cooper, Colin Firth, Amanda Seyfried, Stellan Skarsg\u00e5rd, Meryl Streep and Julie Walters.", "The plot follows a young bride-to-be who invites three men to her upcoming wedding, each one with the possibility of being her father.", "The film was an international co-production between Germany, the United Kingdom, and the United States, and was co-produced by Relativity Media, Playtone and Littlestar Productions.", "Principal photography primarily took place on the island of Skopelos, Greece from August to September 2007.", "The film was distributed by Universal Pictures.", "\"Mamma Mia!\"" ], [ "Mamma Mia! Here We Go Again", "Mamma Mia!", "Here We Go Again\n\nMamma Mia!", "Here We Go Again is a 2018 jukebox musical romantic comedy film written and directed by Ol Parker, from a story by Parker, Catherine Johnson, and Richard Curtis.", "It is a follow-up to the 2008 film \"Mamma Mia!", "\", which in turn is based on the musical of the same name using the music of ABBA.", "The film features an ensemble cast, including Lily James, Amanda Seyfried, Christine Baranski, Julie Walters, Pierce Brosnan, Andy Garc\u00eda, Dominic Cooper, Colin Firth, Stellan Skarsg\u00e5rd, Jessica Keenan Wynn, Alexa Davies, Jeremy Irvine, Josh Dylan, Hugh Skinner, Cher, and Meryl Streep.", "Both a prequel and a sequel, the plot is set after the events of the first film, and also features flashbacks to 1979, telling the story of Donna Sheridan's arrival on the island of Kalokairi and her first meetings with her daughter Sophie's three possible fathers.", "Due to the financial success of the first film, Universal Pictures had long been interested in a sequel.", "The film was officially announced in May 2017, with Parker hired to write and direct.", "In June 2017, many of the original cast confirmed their involvement, with James being cast in the role of Young Donna that July." ], [ "Mamma Mia! Here We Go Again", "Due to \"Mamma Mia!\" financial success, Hollywood studio chief David Linde, co-chairman of Universal Pictures, told the \"Daily Mail\" that it would take a while, but there could be a sequel.", "He stated that he would be delighted if Judy Craymer, Catherine Johnson, Phyllida Lloyd, Benny Andersson and Bj\u00f6rn Ulvaeus agreed to the project, noting that there are still many ABBA songs to make use of.", "\"Mamma Mia!", "Here We Go Again\" was announced on May 19, 2017, with a release date of July 20, 2018.", "It was written and directed by Ol Parker.", "On September 27, 2017, Benny Andersson confirmed 3 ABBA songs that would be featured in the film: \"When I Kissed the Teacher,\" \"I Wonder (Departure),\" and \"Angeleyes.\"", "\"I Wonder (Departure)\" was cut from the film, but is included on the soundtrack album.", "On June 1, 2017, it was announced that Seyfried would return as Sophie.", "Later that month, Dominic Cooper confirmed that he would return for the sequel, along with Streep, Firth and Brosnan as Sky, Donna, Harry, and Sam, respectively.", "In July 2017, Baranski was also confirmed to return as Tanya." ], [ "Dominic Cooper", "Dominic Cooper\n\nDominic Edward Cooper (born 2 June 1978) is an English actor.", "He has worked in television, film, theatre, and radio, including \"Mamma Mia!\" and its sequel \"Mamma Mia!", "Here We Go Again\".", "He stars as Jesse Custer on the AMC show \"Preacher\" (2016\u2013present).", "Cooper has also appeared as the young Howard Stark in the Marvel Cinematic Universe, including \"\" and \"Agent Carter\".", "Cooper was born and brought up in Greenwich, London, the son of Julie (n\u00e9e Heron), a nursery school teacher, and Brian Cooper, an auctioneer.", "He has two brothers, Simon and Nathan, a musician in the band The Modern, a half-brother, James, and a half-sister, Emma.", "His maternal great-grandfather was film-enthusiast E. T. Heron, who published \"The Kinematograph Weekly\".", "Dominic attended John Ball Primary School in Blackheath, London, followed by Thomas Tallis School in nearby Kidbrooke, then trained at the London Academy of Music and Dramatic Art (LAMDA) in acting and film editing, graduating in 2000." ] ], "gold": "Mamma Mia! is a 2008 American jukebox musical romantic comedy film directed by Phyllida Lloyd and written by Catherine Johnson based on her book of the 1999 musical of the same name. The film is based on the songs of pop group ABBA, with additional music composed by ABBA member Benny Andersson. A sequel to the film was released in 2018. English actor Dominic Cooper plays the role Sky Rymand in both films.", "prediction 1": "In the 2008 film Mamma Mia!, Amanda Seyfried plays Sophie's fiance. In the 2018 film Mamma Mia! Here We Go Again, Dominic Cooper plays Sophie's fiance.\n", "prediction 2": "In the movie Mamma Mia! Both a prequel and a sequel, the plot is set after the events of the first film, and also features flashbacks to 1979, telling the story of Donna Sheridan's arrival on the island of Kalokairi and her first meetings with her daughter Sophie's three possible fathers. In the sequel, which was released in 2018, Dominic Cooper plays Sophie's fiance. In the show's original season, he played Clarence Cyr as The Devil's Father.", "prediction 3": "There is more than one film called Mamma Mia. The 2008 film is a jukebox musical romantic comedy film directed by Phyllida Lloyd, based on the 1999 musical of the same name, written by Johnson. The film features an ensemble cast, including Lily James, Amanda Seyfried, Christine Baranski, Julie Walters, Pierce Brosnan, Justin Lin, Dominic Cooper, Colin Firth, Stellan Skarsgrd, Jessica Keenan Wynn, Alexa Davies, Josh Dylan, Cher, Cher, and Meryl Streep. Dominic Cooper is an English actor.", "prediction 4": "In the 2008 film Mamma Mia! The Movie, Lily James plays young Donna, but the role of Sophie's fiance is played by Amanda Seyfried. In the 2018 film Mamma Mia! Here We Go Again, Dominic Cooper plays young Donna, and the role of young Sam is played by Oliver Parker. In the 1999 musical of the same name, which itself is based on the songs of pop group ABBA, including the title song, with additional music composed by ABBA member Benny Andersson. The film itself is a prequel and a sequel, when the role of young Donna was played by Lily James was changed from James.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 67 }, { "error type": "Unverifiable", "explanation": "", "start": 68, "end": 152 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "Mamma Mia! is a 2008 American jukebox musical romantic comedy film directed by Phyllida Lloyd and written by Catherine Johnson based on her book of the 1999 musical of the same name, which itself is based on the songs of pop group ABBA, including the title song, with additional music composed by ABBA member Benny Andersson. Here We Go Again\" was announced on May 19, 2017, with a release date of July 20, 2018." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who is the guy in the take on me video?", "passages": [ [ "Take On Me", "It was filmed in 1985 at Kim's Caf\u00e9 (now called Savoy Caf\u00e9) (on Wandsworth Road, London SW8), and on a sound stage in London.", "The video used a pencil-sketch animation / live-action combination called rotoscoping, in which the live-action footage is traced over frame by frame to give the characters realistic movements.", "Approximately 3,000 frames were rotoscoped, which took 16 weeks to complete.", "The video's main theme is a romantic fantasy narrative.", "It begins with a montage of pencil drawings in a comic-book style representing motorcycle sidecar racing, in which the hero, played by Morten Harket, is pursued by two opponents, one of whom is played by English actor Philip Jackson.", "It then cuts to a scene in a cafe, in which a young woman, played by Bunty Bailey (Harket's girlfriend at the time), is seen drinking coffee and reading the comic book in a coffee shop.", "As the woman reads, the waitress brings her the bill.", "The comic's hero, after winning the race, seemingly winks at the woman from the page.", "His pencil-drawn hand reaches out of the comic book, inviting the woman into it." ], [ "Synth-pop", "Pursuing a more dance-orientated sound were Bronski Beat whose album \"The Age of Consent\" (1984), dealing with issues of homophobia and alienation, reached the top 20 in the UK and top 40 in the US. and Thompson Twins, whose popularity peaked in 1984 with the album \"Into The Gap\", which reached No.1 in the UK and the US top ten and spawned several top ten singles.", "Initially dismissed in the music press as a \"teeny bop sensation\" were Norwegian band a-ha, whose use of guitars and real drums produced an accessible form of synth-pop, which, along with an MTV friendly video, took their 1985 single \"Take On Me\" to number two in the UK and number one in the US.", "Synth-pop continued into the late 1980s, with a format that moved closer to dance music, including the work of acts such as British duos Pet Shop Boys, Erasure and the Communards.", "The Communards' major hits were covers of disco classics \"Don't Leave Me This Way\" (1986) and \"Never Can Say Goodbye\" (1987).", "After adding other elements to their sound, and with the help of a gay audience, several synth-pop acts had success on the US dance charts." ], [ "Steve Barron", "Steve Barron\n\nSteven Barron (born 4 May 1956) is an Irish film director, film producer, writer, and music video director.", "He is best known for directing the films \"Teenage Mutant Ninja Turtles\" (1990), \"Coneheads\" (1993) and the innovative music videos for a-ha's \"Take on Me\" and Michael Jackson's \"Billie Jean\".", "Barron was born in Dublin, Ireland, the younger child of jewish filmmaker Zelda Ruth (n\u00e9e Solomons) Barron (1929\u20132006) and actor Ron Barron, who met in London.", "Zelda and Ron married in 1953; the marriage was later dissolved.", "His mother was a Manchester-born filmmaker.", "He has an older sister, Siobhan.", "He attended St Marylebone Grammar School in London.", "Barron made his music video directorial debut in 1979 with \"Time for Action\" by Secret Affair and their following hit singles \"My World\" and \"Sound of Confusion\" and directed, and occasionally wrote additional treatment, various music videos, including \"Billie Jean\" by Michael Jackson, \"Money for Nothing\" by Dire Straits, and \"Take on Me\" by a-ha.", "He founded the production company Limelight with his sister Siobhan and Adam Whitaker." ], [ "Breaking Out Is Hard to Do", "Lois pulls Joe to safety, and in gratitude, Joe manages to get Lois' sentence cancelled, and life returns to normal for the family.", "\"Breaking Out Is Hard to Do\" is the first \"Family Guy\" episode to be written by Tom Devanney.", "When Stewie attempts to asphyxiate himself in the supermarket, he was originally meant to state \"Either I was a C-section or you're Stretch Vagstrong\", which would have been a reference to the Stretch Armstrong action figure, but broadcasting standards prohibited them from showing it.", "During the \"Take On Me\" sequence, \"Family Guy\" had obtained full rights to use the \"Take On Me\" music video completely, but animators re-produced the video to make it easier for production.", "Originally, a joke had been drafted showing Brian standing next to a tabloid newspaper with a picture of Kirstie Alley and commenting on her weight, only for her to enter the grocery shop in Godzilla-like size and throw items from the shelves, but the sketch was removed to save time during the episode.", "The Matisse painting shown in the Griffins' dining room is only animated similar to an actual Matisse painting due to a legal issue with the paintings.", "The episode production staff spent a lot of time deciding what would be Lois' motivation for stealing en masse." ], [ "Call on Me (Eric Prydz song)", "The music video for \"Call on Me\", directed by Huse Monfaradi, features an aerobics class of women wearing 1980s styled aerobics outfits performing sexually suggestive gym routines led by dancer and choreographer Deanne Berry, who is wearing a thong leotard \u2013 much to the enjoyment of the sole man in the group, played by Juan Pablo Di Pace.", "The video was filmed in the Laban Dance Centre in Deptford, England and spoofs a scene in the 1985 film \"Perfect\" starring John Travolta and Jamie Lee Curtis.", "In late 2004, while being interviewed by Chris Evans for UK Radio Aid, a 12-hour fundraising broadcast for tsunami victims, the then Prime Minister of the United Kingdom Tony Blair said: \"The first time it came on, I nearly fell off my rowing machine.\"", "Vice Media via their Thump website would go on to call the video the \"Sexiest Music Video of All Time\" There are two videos\u2014an edited one shown in daylight hours and a late night version which is uncut and features the dancers rubbing their breasts and one dancer slapping her buttocks.", "The video was the highest-downloaded music video of all time in Australia, downloaded over 35,000 times through 3 Mobile mobile phones with 3G technology in association with the \"Rage\" music television show." ] ], "gold": "In the second and far more widely-recognized music video for the A-ha song \"Take On Me\", the hero of the video's romantic fantasy narrative is played by Morten Harket, whose character is pursued by two opponents, played by Philip Jackson and Alife Curtis. When Family Guy reproduced the video for its episode \"Breaking Out Is Hard to Do\", the hero is portrayed by Seth Green as Chris Griffin.", "prediction 1": "The 1985 synth-pop music video \"Take On Me\" starred English actor Philip Jackson as the hero. The video's main theme is a romantic fantasy narrative. The hero in the video is Morten Harket, who is seen riding a motorcycle and winning a sidecar race. The music video was directed by Steve Barron, an Irish film director, film producer, writer, and music video director.\n", "prediction 2": "The 1985 synth-pop music video for a-ha's \"Take on Me\" features an ensemble cast of multi-talented characters in dialogue and dramatic moments of intense physical combat, with the main character played by Norwegian actor Morten Harket. The episode Star Trek: The Next Generation premier premiered on April 1, 1985 and produced by Sony Music Video.", "prediction 3": "The guy in the 1985 video, Take On Me, is English actor Philip Jackson.", "prediction 4": "The 1985 music video by English synth-pop band a-ha, titled \"Take On Me,\" features live action stunts with performers like American cyclist Ne Neeson, who plays the character of Ricky Lee Jones, Morven Harket, and George Clooney as Ringo Starr.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 30 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 84, "end": 93 }, { "error type": "Irrelevant", "explanation": "", "start": 190, "end": 249 }, { "error type": "Irrelevant", "explanation": "", "start": 250, "end": 369 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 2, 4 ] } ], "corrected-prediction": "A-ha's \"Take On Me\" main theme is a romantic fantasy narrative. The hero in the video is Morten Harket, is pursued by two opponents, one of whom is played by English actor Philip Jackson. Family Guy had a \"Take on Me\" sequence in their episode, \"Breaking Out Is Hard to Do\"." }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "The oldest museum in america the pennsylvania academy of fine arts was founded in?", "passages": [ [ "Pennsylvania Academy of the Fine Arts", "Pennsylvania Academy of the Fine Arts\n\nThe Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania.", "It was founded in 1805 and is the first and oldest art museum and art school in the United States.", "The academy's museum is internationally known for its collections of 19th- and 20th-century American paintings, sculptures, and works on paper.", "Its archives house important materials for the study of American art history, museums, and art training.", "The Pennsylvania Academy of the Fine Arts (PAFA) was founded in 1805 by painter and scientist Charles Willson Peale, sculptor William Rush, and other artists and business leaders.", "The growth of the Academy of Fine Arts was slow.", "For many years it held its exhibitions in an 1806 building, designed by John Dorsey with pillars of the Ionic order.", "It stood on the site of the later American Theater at Chestnut and 10th streets.", "The academy opened as a museum in 1807 and held its first exhibition in 1811, where more than 500 paintings and statues were displayed.", "The first school classes held in the building were with the \"Society of Artists\" in 1810.", "The Academy had to be reconstructed after the fire of 1845.", "Some 23 years later, leaders of the academy raised funds to construct a building more worthy of its treasures.", "They commissioned the current Furness-Hewitt building, which was constructed from 1871." ] ], "gold": "The Pennsylvania Academy of the Fine Arts is a museum and private art school in Philadelphia, Pennsylvania. It was founded in 1805 and is the first and oldest art museum and art school in the United States. The academy's museum is internationally known for its collections of 19th- and 20th-century American paintings, sculptures, and works on paper. Its archives house important materials for the study of American art history, museums, and art training and it offers a Bachelor of Fine Arts, Master of Fine Arts, certificate programs, and continuing education.", "prediction 1": "The Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania. It was founded in 1805 and is the first and oldest art museum and art school in the United States. The academy's museum is internationally known for its collections of 19th- and 20th-century American paintings, sculptures, and works on paper. Its archives house important materials for the study of American art history, museums, and art training.\n", "prediction 2": "The Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania. It was founded in 1805 and is the first and oldest art museum and art school in the United States. The academy's museum is internationally known for its collections of 17th- and 18th-century American paintings, sculptures, and works on paper. Its archives house important materials for the study of American art history, museums, and art training.", "prediction 3": "The Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania. It was founded in 1805 and is the first and oldest art museum and art school in the United States. Its museum is internationally known for its collections of 19th- and 20th-century American paintings, sculptures, and works on paper. The academy's archives house important materials for the study of American art history, museums, and art training.", "prediction 4": "The Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania. It was founded in 1805. It is the oldest art museum and art school in the United States.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Pennsylvania Academy of the Fine Arts is a museum and art school in Philadelphia, Pennsylvania. It was founded in 1805 and is the first and oldest art museum and art school in the United States. The academy's museum is internationally known for its collections of 19th- and 20th-century American paintings, sculptures, and works on paper. Its archives house important materials for the study of American art history, museums, and art training.\n" }, "preference": [ 1, 0, 1, 2, 2, 1 ] }, { "question": "What is the total number of fundamental duties mentioned in the constitution of india?", "passages": [ [ "Fundamental Rights, Directive Principles and Fundamental Duties of India", "The other Fundamental Duties obligate all citizens to respect the national symbols of India, including the Constitution, to cherish its heritage, preserve its composite culture and assist in its defence.", "They also obligate all Indians to promote the spirit of common brotherhood, protect the environment and public property, develop scientific temper, abjure violence, and strive towards excellence in all spheres of life.", "In case of violation of fundamental duties enshrined in the constitution by a citizen, it amounts to contempt of the constitution which is punishable under Prevention of Insults to National Honour Act, 1971.", "Supreme court has ruled that these fundamental duties can also help the court to decide the constitutionality of a law passed by the legislature.", "There is reference to such duties in international instruments such as the Universal Declaration of Human Rights and International Covenant on Civil and Political Rights, and Article 51A brings the Indian Constitution into conformity with these treaties.", "The Fundamental Duties noted in the constitution are as follows:\n\nIt shall be the duty of every citizen of India \u2014\n\n\nFewer children are now employed in hazardous environments, but their employment in non-hazardous jobs, prevalently as domestic help, violates the spirit of the constitution in the eyes of many critics and human rights advocates.", "More than 16.5\u00a0million children are in employment." ], [ "Fundamental Rights, Directive Principles and Fundamental Duties of India", "Fundamental Rights, Directive Principles and Fundamental Duties of India\n\nThe Fundamental Rights, Directive Principles of State Policy and Fundamental Duties are sections of the Constitution of India that prescribe the fundamental obligations of the states to its citizens and the duties and the rights of the citizens to the State.", "These sections comprise a constitutional bill of rights for government policy-making and the behaviour and conduct of citizens.", "These sections are considered vital elements of the constitution, which was developed between 1947 and 1949 by the Constituent assembly of India.", "The \"Fundamental Rights\" are defined as the basic human rights of all citizens.", "These rights, defined in Part III of the Constitution, applied irrespective of race, place of birth, religion, caste, creed, or gender.", "They are enforceable by the courts, subject to specific restrictions.", "The \"Directive Principles of State Policy\" are guidelines for the framing of laws by the government.", "These provisions, set out in Part IV of the Constitution, are not enforceable by the courts, but the principles on which they are based are fundamental guidelines for governance that the State is expected to apply in framing policies and passing laws.", "The \"Fundamental Duties\" are defined as the moral obligations of all citizens to help promote a spirit of patriotism and to uphold the unity of India." ], [ "Fundamental Rights, Directive Principles and Fundamental Duties of India", "As a consequence, partial or total prohibition has been introduced in several states, but financial constraints have prevented its full-fledged application.", "The State is also mandated by Article 48 to organise agriculture and animal husbandry on modern and scientific lines by improving breeds and prohibiting slaughter of cattle.", "Article 48A mandates the State to protect the environment and safeguard the forests and wildlife of the country, while Article 49 places an obligation upon the State to ensure the preservation of monuments and objects of national importance.", "Article 50 requires the State to ensure the separation of judiciary from executive in public services, in order to ensure judicial independence, and federal legislation has been enacted to achieve this objective.", "The State, according to Article 51, must also strive for the promotion of international peace and security, and Parliament has been empowered under Article 253 to make laws giving effect to international treaties.", "The Fundamental Duties of citizens were added to the Constitution by the 42nd Amendment in 1976, upon the recommendations of the Swaran Singh Committee that was constituted by the government earlier that year.", "Originally ten in number, the Fundamental Duties were increased to eleven by the 86th Amendment in 2002, which added a duty on every parent or guardian to ensure that their child or ward was provided opportunities for education between the ages of six and fourteen years." ] ], "gold": "The Fundamental Rights, Directive Principles of State Policy and Fundamental Duties' are sections of the Constitution of India that prescribe the fundamental obligations of the states to its citizens and the duties and the rights of the citizens to the State. These sections are considered vital elements of the constitution, which was developed between 1947 and 1949 by the Constituent Assembly of India. Originally ten duties were mentioned in the constitution in 1976. The fundamental duties were increased to eleven by the 86th Amendment in 2002, which added a duty on every parent or guardian to ensure that their child or ward was provided opportunities for education between the ages of six and fourteen years.", "prediction 1": "The Fundamental Rights, Directive Principles of State Policy and Fundamental Duties are sections of the Constitution of India that prescribe the fundamental obligations of the states to its citizens and the duties and the rights of the citizens to the State. These sections comprise a constitutional bill of rights for government policy-making and the behaviour and conduct of citizens. The Fundamental Duties of citizens were added to the Constitution by the 42nd Amendment in 1976, upon the recommendations of the Swaran Singh Committee that was constituted by the government earlier that year. Originally ten in number, the Fundamental Duties were increased to eleven by the 86th Amendment in 2002, which added a duty on every parent or guardian to ensure that their child or ward was provided opportunities for education between the ages of six and fourteen years.\n", "prediction 2": "There are four Fundamental Duties that are included in the Constitution of India. These duties include the moral obligations to promote a spirit of patriotism and to uphold the unity of India. Each of these duties are also listed in the Constitution according to the order that they were added to the Constitution.", "prediction 3": "The total number of Fundamental Duties mentioned in the Constitution of India is 11. The number of Fundamental Duties added to the Constitution was increased from ten in 1976 to eleven by the 86th Amendment in 2002.", "prediction 4": "Fundamental Rights, Directive Principles of State Policy and Fundamental Duties are sections of the Constitution of India that prescribe the fundamental obligations of the states to its citizens and the duties and the rights of the citizens to the State. The fundamental duties of citizens were added to the constitution by the 42nd Amendment in 1976, upon the recommendations of the Swaran Singh Committee that was constituted by the government earlier that year. Originally ten in number, the Fundamental Duties were increased to eleven by the 86th Amendment in 2002, which added a duty on every parent or guardian to ensure that their child or ward was provided opportunities for education between the ages of six and fourteen years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 259, "end": 386 }, { "error type": "Irrelevant", "explanation": "", "start": 387, "end": 596 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Fundamental Rights, Directive Principles of State Policy and Fundamental Duties are sections of the Constitution of India that prescribe the fundamental obligations of the states to its citizens and the duties and the rights of the citizens to the State. These sections are considered vital elements of the constitution, which was developed between 1947 and 1949 by the Constituent assembly of India. Originally ten in number, the Fundamental Duties were increased to eleven by the 86th Amendment in 2002, which added a duty on every parent or guardian to ensure that their child or ward was provided opportunities for education between the ages of six and fourteen years.\n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Who sings the song don't turn around?", "passages": [ [ "Don't Turn Around", "Don't Turn Around\n\n\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren.", "It was originally recorded by Tina Turner as the B-side to the single \"Typical Male\" in 1986.", "Warren is said to have been disappointed that Turner's record company treated the song as a B-side and never included it on one of her albums.", "However it has since been included on the rarities disc of the 1994 compilation \"The Collected Recordings \u2013 Sixties to Nineties\".", "As well as featuring in the Tina (musical) in 2018.", "It has been covered by a number of artists, most notably Aswad in 1988, Ace of Base in 1994 and Milow in 2017.", "This song was also recorded by Soul Artist Luther Ingram and released in 1987 as a 45 on the Profile Label in the US.", "British reggae group Aswad heard Luther Ingram's version and made a cover of it.", "It was released on February 10, 1988 and went to number one on the UK Singles Chart in March 1988.", "It also reached number 45 on the \"Billboard\" Hot R&B/Hip-Hop Songs in the US that same year.", "In 1993, Swedish pop group Ace of Base recorded a minor key version of \"Don't Turn Around\" for their US debut album, \"The Sign\"." ], [ "Don't Turn Around", "In 1992, Neil Diamond recorded a version of \"Don't Turn Around\", which made the Top 20 on the Adult Contemporary chart.", "Also in 1992, Swedish pop singer Tone Norum recorded a version, which is included on her album, \"Don't Turn Around\".", "In 1998, the Argentinean dance-pop group El Simbolo recorded a Spanish language cover titled \"No Llores M\u00e1s\" from their album \"No Pares\".", "In 2005, the Utah-based rock with horns band Side Dish recorded and released a version of \"Don't Turn Around\" which was included on their EP \"Age of Intent\".", "In 2010, Albert Hammond, co-writer of the song, recorded the song for his album \"Legend\"." ] ], "gold": "\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren. It was originally recorded by Tina Turner in 1986. In 1993, Swedish pop group Ace of Base recorded a minor key version of \"Don't Turn Around\" for their US debut album, \"The Sign\". The song has also been covered by Luther Ingram, Bonnie Tyler and Neil Diamond.", "prediction 1": "\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren. It was originally recorded by Tina Turner as the B-side to the single \"Typical Male\" in 1986. However, it has since been included on the rarities disc of the 1994 compilation The Collected Recordings \u2013 Sixties to Nineties. This song was also recorded by Soul Artist Luther Ingram and released in 1987 as a 45 on the Profile Label in the US. British reggae group Aswad heard Luther Ingram's version and made a cover of it. In 1993, Swedish pop group Ace of Base recorded a minor key version of \"Don't Turn Around\" for their US debut album, The Sign.\n", "prediction 2": "\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren. It was originally recorded by Tina Turner as the B-side to the single \"Typical Male\" in 1986. This song was also recorded by Soul Artist Luther Ingram and released in 1987 as a 45 on the Profile Label in the US. British reggae group Aswad heard Luther Ingram's version and made a cover of it. In 1993, Swedish pop group Ace of Base recorded a minor key version of \"Don't Turn Around\" for their US debut album, The Sign.", "prediction 3": "\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren. It was originally recorded by Tina Turner as the B-side to the single \"Typical Male\" in 1986. The song has since been included on the rarities disc of the 1994 compilation The Collected Recordings \u2013 Sixties to Nineties. This song was also recorded by Soul Artist Luther Ingram and released in 1987 as a 45 on the Profile Label in the US. British reggae group Aswad heard Luther Ingram's version and made a cover of it. Along with Andrew Temple, the song was also covered by certified by Artie Gollissmis Musikal for the TV show Tina Turner in 2018 and Tina Turner.", "prediction 4": "There are several songs with the title \"Don't Turn Around\". Tina Turner originally recorded the song as the B-side to her single \"Typical Male\" in 1986. The song was released in the US on the Profile Label. The song has since been included on the rarities disc of the 1994 compilation The Collected Recordings \u2013 Sixties to Nineties.. There was also a version by Swedish pop group Ace of Base in 1993 with the title \"Don't Turn Around\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 124, "end": 166 }, { "error type": "Irrelevant", "explanation": "", "start": 176, "end": 304 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 422 }, { "error type": "Irrelevant", "explanation": "", "start": 423, "end": 503 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Don't Turn Around\" is a popular song written by Albert Hammond and Diane Warren. It was originally recorded by Tina Turner in 1986. In 1993, Swedish pop group Ace of Base recorded a minor key version of \"Don't Turn Around\" for their US debut album, The Sign. This song was also recorded by Luther Ingram, Neil Diamond, Tone Norum, Side Dish and Albert Hammond. El Simbolo recorded a Spanish language cover titled \"No Llores M\u00e1s\".\n" }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Where was the first season of love island filmed?", "passages": [ [ "Love Island (2005 TV series)", "Love Island (2005 TV series)\n\nLove Island (originally Celebrity Love Island) is a British reality television programme that was aired on ITV.", "In the show, twelve single celebrities spent five weeks on an island in Fiji.", "It was originally presented by Patrick Kielty and Kelly Brook, with Fearne Cotton taking over as female host in the second series.", "The first series aired in the summer of 2005, and it was won by Jayne Middlemiss and Fran Cosgrave.", "The second series began in July 2006, dropping \"Celebrity\" from its name.", "It was won by Bianca Gascoigne and Calum Best.", "The theme tune for the first series was \"Wish I\", performed by Jem.", "A specially-composed summer theme by Daniel Pemberton (later released under the title \"From Fiji with Love\") was used for the second series.", "The show was axed in November 2006.", "On 13 February 2015, it was announced that \"Love Island\" would return on ITV2 in 2015.", "It was later announced that Caroline Flack would host the revived series, starting on 7 June 2015.", "Viewers would vote for the couple they would like to see in the \"love shack\" where the two would get to know one another better.", "In the first series, each week viewers voted celebrities off the island, but in the second, the inhabitants had the final say." ], [ "Love Island (series 1)", "Love Island (series 1)\n\n", "The first series of \"Love Island\" began on 7 June 2015 with a live special of the show hosted by Caroline Flack on ITV2, and ended on 15 July 2015.", "It is the first from the revived series, but third overall.", "The series was narrated by Iain Stirling.", "The series aired every night of the week except Friday, however the Saturday episode was used as a weekly catch-up entitled \u201c\"Love Island: The Weekly Hot List\"\u201d rather than a nightly highlights episode.", "The average viewers for this series was 570,000.", "On 15 July 2015 the series was won by Jess Hayes and Max Morley, with Hannah Elizabeth and Jon Clark as runners-up.", "Islander Jon Clark later went onto appear as a cast member in \"The Only Way Is Essex\", whilst both Josh Ritchie and Max Morley made appearances in \"Ex on the Beach\".", "After finishing in fourth place, Cally and Luis became the first couple to have a baby as they welcomed their first child in May 2017.", "The first one-minute trailer for the series aired on 12 May 2015, confirming that the series would begin in June.", "Pictures of the villa were unveiled on 5 June 2015.", "The villa is located in Mallorca with 69 cameras watching the Islander's every move." ], [ "Love Island Australia", "Love Island Australia\n\nLove Island Australia is an Australian dating reality show based on the British series \"Love Island\".", "The series is presented by Sophie Monk and narrated by Eoghan McDermott.", "The series began airing on 9Go!", "and 9Now on 27 May 2018.", "The final aired on 5 July 2018, with Grant Crapp and Tayla Damir winning and sharing the $50,000 prize money.", "Eden Dally and Erin Barnett finished as runners up.", "The series also airs in the United Kingdom on ITVBe and in the Republic of Ireland on 3e, and is available in New Zealand on TVNZ OnDemand.", "Love Island Australia will return for a second season in 2019, and will seek contestants with tap dancing skills.", "The new season will air on Nine's primary channel, with the series expected to move from Spain and to a new location.", "\"Love Island\" involves a group of contestants, referred to as Islanders, living in isolation from the outside world in a villa in Mallorca, Spain, constantly under video surveillance.", "To survive in the villa the Islanders must be coupled up with another Islander, whether it be for love, friendship or money, as the overall winning couple receives $50,000." ] ], "gold": "The first season of the 2005 British reality show Love Island was filmed in Fiji. The first season of the show's 2015 revival and the first season of the 2018 Australian version of the franchise were both filmed in Mallorca, Spain.", "prediction 1": "The first season of Love Island was filmed in Mallorca, Spain. The second series was filmed in London, England. The third series was filmed in Australia.\n", "prediction 2": "In the 2005 UK television series, Love Island, 12 single celebrities lived en masse for five weeks on an island in Fiji. The first half of the series aired in Mexico while the final part aired in Spain. LOVE ISLAND AUS is an Australian television dating reality show that debuted on 8 June 2018. The first half of the show was also filmed in Mallorca with 69 cameras watching the contestants every move.", "prediction 3": "Love Island is a British reality television show which aired from 2005 to 2015. Its first season was filmed in Fiji. The series 1 finale was filmed in Mallorca, Spain. The first season of Love Island Australia was filmed in Melbourne, Australia.", "prediction 4": "Love Island is a British reality television show that was aired on ITV between 2005 and 2015. Season 1 was filmed in Mallorca, Spain, and season 2 was filmed in Sydney, Australia.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 46, "end": 62 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[12]}", "start": 95, "end": 111 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[10]}", "start": 143, "end": 154 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[1]}", "start": 112, "end": 128 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] } ], "corrected-prediction": "The first season of the 2005 British reality show Love Island was filmed in Fiji. The second series was filmed in 2015 in a villa in Mallorca. The 2018 Love Island Australia series was also filmed in Spain.\n" }, "preference": [ 2, 2, 0, 2, 0, 1 ] }, { "question": "Where is the mekong river delta located in vietnam?", "passages": [ [ "Mekong Delta", "Mekong Delta\n\n", "The Mekong Delta (, \"Nine Dragon river delta\" or simply , \"Mekong river delta\"), also known as the Western Region () or the South-western region () is the region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries.", "The Mekong delta region encompasses a large portion of southwestern Vietnam of over .", "The size of the area covered by water depends on the season.", "The region comprises 12 provinces: Long An, \u0110\u1ed3ng Th\u00e1p, Ti\u1ec1n Giang, An Giang, B\u1ebfn Tre, V\u0129nh Long, Tr\u00e0 Vinh, H\u1eadu Giang, Ki\u00ean Giang, S\u00f3c Tr\u0103ng, B\u1ea1c Li\u00eau, and C\u00e0 Mau, along with the province-level municipality of C\u1ea7n Th\u01a1.", "The Mekong Delta has been dubbed as a \"biological treasure trove\".", "Over 1,000 animal species were recorded between 1997 and 2007 and new species of plants, fish, lizards, and mammals have been discovered in previously unexplored areas, including the Laotian rock rat, thought to be extinct.", "The Mekong Delta was likely inhabited long since prehistory; the empires of Funan and Chenla maintained a presence in the Mekong Delta for centuries." ] ], "gold": "The Mekong Delta, literally \"Nine Dragon river delta\" or simply \"Mekong river delta\", also known as the Western Region or the South-western region is the region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries. The coordinates of the Mekong River Delta is 10\u00b002\u2032N 105\u00b047\u2032E.", "prediction 1": "The Mekong Delta is a region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries.", "prediction 2": "The Mekong river delta is a region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries. The region comprises 12 provinces: Long An, ng Th\u00e1p, Tin Giang, An Giang, Bn Tre, Vnh Long, Tr\u00e0 Vinh, Hu Giang, Ki\u00ean Giang, S\u00f3c Tr\u0103ng, Bc Li\u00eau, and C\u00e0 Mau, along with the province-level municipality of C\u00e0 Mau, along with the province-level municipality of C\u00e0 Mau. The region comprises a large portion of southwestern Vietnam.", "prediction 3": "The Mekong Delta is located in southwestern Vietnam, in the area that comprises the 10 provinces of southwestern Vietnam and the 4 autonomous regions that make up the country. The region encompasses a large portion of the country and is sometimes referred to as the Soudan Delta. The Mekong river enters the country from the Soudan river in Laos.", "prediction 4": "The Mekong Delta, also known as the Western Region or the South-western region, is the region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries. The region comprises 12 provinces: Long An, ng Th\u00e1p, Tin Giang, An Giang, Bn Tre, Vnh Long, Tr\u00e0 Vinh, Hu Giang, Ki\u00ean Giang, S\u00f3c Tr\u0103ng, Bc Li\u00eau, and C\u00e0 Mau, along with the province-level municipality of C\u00e0 Mau.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Mekong Delta (\"Nine Dragon river delta\" or simply , \"Mekong river delta\"), also known as the Western Region or the South-western region, is a region in southwestern Vietnam where the Mekong River approaches and empties into the sea through a network of distributaries. It encompasses a large portion of southwestern Vietnam and comprises 12 provinces: Long An, \u0110\u1ed3ng Th\u00e1p, Ti\u1ec1n Giang, An Giang, B\u1ebfn Tre, V\u0129nh Long, Tr\u00e0 Vinh, H\u1eadu Giang, Ki\u00ean Giang, S\u00f3c Tr\u0103ng, B\u1ea1c Li\u00eau, and C\u00e0 Mau, along with the province-level municipality of C\u1ea7n Th\u01a1." }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who has made it to the nba finals the most?", "passages": [ [ "Bill Russell", "In that season, Russell's Celtics won a record 59 regular season games (including a then-record tying 17 game win streak) and met Chamberlain's Warriors in the Eastern Division Finals.", "Chamberlain outscored Russell by 81 points in the series, but the Celtics walked off with a 4\u20132 series win.", "In the 1960 Finals, the Celtics outlasted the Hawks 4\u20133 and won their third championship in four years.", "Russell grabbed an NBA Finals-record 40 rebounds in Game 2, and added 22 points and 35 rebounds in the deciding Game 7, a 122\u2013103 victory for Boston.", "In the 1960\u201361 season, Russell averaged 16.9 points and 23.9 rebounds per game, leading his team to a regular season mark of 57\u201322.", "The Celtics earned another post-season appearance, where they defeated the Syracuse Nationals 4\u20131 in the Eastern Division Finals.", "The Celtics made good use of the fact that the Los Angeles Lakers had exhausted St. Louis in a long seven-game Western Conference Finals, and the Celtics convincingly won in five games.", "The following season, Russell scored a career-high 18.9 points per game, accompanied by 23.6 rebounds per game." ], [ "Bill Russell", "On May 20, 2007, Russell was awarded an honorary doctorate by Suffolk University, where he served as its commencement speaker, and Russell received an honorary degree from Harvard University on June 7, 2007.", "On June 18, 2007, Russell was inducted as a member of the founding class of the FIBA Hall of Fame.", "Russell was also honored during the 2009 NBA All-Star Weekend in Phoenix.", "On February 14, 2009, NBA Commissioner David Stern announced that the NBA Finals Most Valuable Player Award would be renamed the \"Bill Russell NBA Finals Most Valuable Player Award\" in honor of the 11-time NBA champion.", "The following day, during halftime of the All-Star game, Celtics captains Paul Pierce, Kevin Garnett, and Ray Allen presented Russell a surprise birthday cake for his 75th birthday.", "Russell attended the final game of the Finals that year to present his newly christened namesake award to its winner, Kobe Bryant.", "Russell was awarded the Presidential Medal of Freedom in 2011.", "Russell is one of the most successful and decorated athletes in North American sports history.", "His awards and achievements include 11 NBA championships as a player with the Boston Celtics in 13 seasons (including two NBA championships as player/head coach), and he is credited with having raised defensive play in the NBA to a new level." ], [ "NBA Finals", "NBA Finals\n\nThe NBA Finals is the championship series of the National Basketball Association (NBA).", "The Eastern and Western conference champions play a best-of-seven game series to determine the league champion.", "The winners of the Finals are awarded the Larry O'Brien Championship Trophy, which replaced the Walter A. Brown Trophy in 1983.", "Prior to the 1949\u201350 season, the series was named the BAA Finals, before seeing alteration following the merger between the Basketball Association of America (BAA) and the National Basketball League (NBL) which created the modern NBA.", "The competition oversaw further name changes to NBA World Championship Series from 1950 to 1982, as well as a brief stint as the Showdown, before settling on NBA Finals in 1986.", "The NBA Finals was initially structured to harbor a 2-2-1-1-1 format.", "In 1985, it was changed to a 2\u20133\u20132 format to ease the amount of cross country travel until 2013, where the first two and last two games of the series were played at the arena of the team who earned home-court advantage by having the better record during the regular season.", "In 2014, the 2\u20132\u20131\u20131\u20131 format was restored.", "The first two are played at home for the higher-seeded team, and the following two at the home of the lower-seeded team." ], [ "NBA Finals", "The following three are played at each team's home arena alternately.", "A total of 19 franchises have won the NBA Finals, with the Golden State Warriors the current champion.", "The Boston Celtics hold the record for the most victories, having won the competition 17 times, as well as winning the competition the most times in a row, winning it eight times from 1959 to 1966.", "The Los Angeles Lakers have contested the NBA Finals the most times, with 31 appearances.", "The Eastern Conference has provided the most champions, with 38 wins from ten franchises; the Western Conference has 32, from nine franchises.", "The Boston Celtics went 11\u20131 in the NBA Finals during 13 seasons (1956\u201357 to 1968\u201369).", "They won eight straight NBA championships from 1959 through 1966.", "This period marks the largest stretch of seasons that a single team made up over 65% of Finals appearances, and also includes the only ever time the NBA Finals was decided in double overtime.", "With the establishment of the Celtics dynasty in 1957 spearheaded by center Bill Russell, the team saw great success, only ever encountering difficulty when up against teams led by Wilt Chamberlain.", "However, for most of the late 1950s and 1960s, the Celtics and Russell managed to have an upper hand on Chamberlain's teams." ] ], "gold": "The NBA Finals is the annual championship series of the National Basketball Association (NBA). The Eastern and Western conference champions play a best-of-seven game series to determine the league champion. The team that wins the series is awarded the Larry O'Brien Championship Trophy, which replaced the Walter A. Brown Trophy in 1983. The Los Angeles Lakers has made it to the NBA finals the most with 32 appearances. The Boston Celtics won the most consecutive titles, winning eight in a row from 1959 to 1966. Bill Russell is the player that who has made it to the NBA finals the most times in a row.", "prediction 1": "The NBA Finals is the championship series of the National Basketball Association. The Eastern and Western conference champions play a best-of-seven game series to determine the league champion. The winners of the Finals are awarded the Larry O'Brien Championship Trophy, which replaced the Walter A. Brown Trophy in 1983. The Boston Celtics hold the record for the most appearances to the NBA Finals, having made it to the Finals 17 times. The Los Angeles Lakers have made it to the NBA Finals the most times, with 31 appearances.\n", "prediction 2": "The NBA Finals is the championship series of the National Basketball Association, which consists of a best-of-seven game series between the Eastern and Western Conference champions to determine the league champion. The winner of the series is awarded the Larry O'Brien Championship Trophy, which replaced the Walter A. Brown Trophy in 1983. The Los Angeles Lakers have made it to the NBA Finals the most times, with 31 appearances. Bill Russell has played in the NBA Finals 11 times, as well as making it to the NBA Finals for the most times in a row, making it 17 times in 36 wins from 10 out of 59 Regular Season games.", "prediction 3": "The NBA Finals is the championship series of the National Basketball Association, in which the Eastern and Western conference champions play a best-of-seven game series to determine the league champion. The champion of this series is deemed the best player from each conference and is normally named Bill Russell. The team to make it to the finals the most often is the Los Angeles Lakers, with 31 appearances.", "prediction 4": "The NBA Finals are the championship series of the National Basketball Association, the Eastern and Western conference champions play a best-of-seven game series to determine the league champion. The Boston Celtics have made it to the NBA Finals the most times with 17, the Los Angeles Lakers the most and Michael Jordan the player with the most appearances.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[3]}", "start": 370, "end": 429 } ], "missing-info": [], "corrected-prediction": "The NBA Finals is the championship series of the National Basketball Association. The Eastern and Western conference champions play a best-of-seven game series to determine the league champion. The winners of the Finals are awarded the Larry O'Brien Championship Trophy, which replaced the Walter A. Brown Trophy in 1983. The Boston Celtics hold the record for the most victories to the NBA Finals, having won the competition 17 times. The Los Angeles Lakers have made it to the NBA Finals the most times, with 31 appearances. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "Which prime minister of india born in gujarat?", "passages": [ [ "Narendra Modi", "Narendra Modi\n\nNarendra Damodardas Modi (; born 17 September 1950) is an Indian politician serving as the 14th and current Prime Minister of India since 2014.", "He was the Chief Minister of Gujarat from 2001 to 2014, and is the Member of Parliament for Varanasi.", "Modi is a member of the Bharatiya Janata Party (BJP) and the Rashtriya Swayamsevak Sangh (RSS).", "Born to a Gujarati family in Vadnagar, Modi helped his father sell tea as a child and later ran his own stall.", "He was introduced to the RSS at the age of eight, beginning a long association with the organisation.", "He left home after graduating from school, partly because of an arranged marriage which he rejected.", "Modi travelled around India for two years and visited a number of religious centres.", "He returned to Gujarat and moved to Ahmedabad in 1969 or 1970.", "In 1971 he became a full-time worker for the RSS.", "During the state of emergency imposed across the country in 1975, Modi was forced to go into hiding.", "The RSS assigned him to the BJP in 1985, and he held several positions within the party hierarchy until 2001, rising to the rank of General Secretary." ], [ "Morarji Desai", "Morarji Desai\n\nMorarji Ranchhodji Desai (29 February 1896 \u2013 10 April 1995) was an Indian independence activist and served between 1977 and 1979 as the 4th Prime Minister of India and led the government formed by the Janata Party.", "During his long career in politics, he held many important posts in government such as: Chief Minister of Bombay State, Home Minister, Finance Minister and 2nd Deputy Prime Minister of India.", "On the international scene, Desai holds international fame for his peace activism and created efforts to initiate peace between two rival South Asian states, Pakistan and India.", "After India's first nuclear test in 1974, Desai helped restore friendly relations with China and Pakistan, and vowed to avoid armed conflict such as Indo-Pakistani war of 1971.", "He was also accused of scaling down the Indian covert operations agency, the R&AW.", "He is the oldest person to become prime minister, aged 81, in the history of Indian politics.", "Morarji Desai was of Gujarati origin.", "He was born in Bhadeli village, Bulsar district, Bombay Presidency (now in Gujarat) on 29 February 1896, the oldest of eight children.", "His father was a school teacher.", "Desai underwent his primary schooling in Saurashtra The Kundla School, Savarkundla now called J.V." ], [ "Gujarat", "Gujarat\n\nGujarat ( \"\"\u00a0 ) is a state in Western India and Northwest India, a coastline of \u2013 most of which lies on the Kathiawar peninsula \u2013 and a population in excess of 60 million.", "It is the sixth largest Indian state by area and the ninth largest state by population.", "Gujarat is bordered by Rajasthan to the northeast, Daman and Diu to the south, Dadra and Nagar Haveli and Maharashtra to the southeast, Madhya Pradesh to the east, and the Arabian Sea and the Pakistani province of Sindh to the west.", "Its capital city is Gandhinagar, while its largest city is Ahmedabad.", "The Gujarati-speaking people of India are indigenous to the state.", "The economy of Gujarat is the third-largest state economy in India with in gross domestic product and a per capita GDP of .", "The state encompasses some sites of the ancient Indus Valley Civilisation, such as Lothal, Dholavira, and Gola Dhoro.", "Lothal is believed to be one of the world's first seaports.", "Gujarat's coastal cities, chiefly Bharuch and Khambhat, served as ports and trading centers in the Maurya and Gupta empires, and during the succession of royal Saka dynasties from the Western Satraps era.", "Along with Bihar and Nagaland, Gujarat is one of the three Indian states to prohibit the sale of alcohol." ] ], "gold": "Narendra Damodardas Modi is an Indian politician serving as India's 14th and current prime minister since 2014. Modi was born in Gujarat, a state on the western coast of India that is the fifth-largest Indian state by area and the ninth-largest state by population. Morarji Ranchhodji Desai, who served as the 4th Prime Minister of India between 1977 and 1979, was also born in Gujarat.", "prediction 1": "Narendra Modi is the 14th Prime Minister of India and the current Chief Minister of Gujarat. He was the Chief Minister of Gujarat from 2001 to 2014 and is the Member of Parliament for Varanasi. Morarji Desai was an Indian independence activist and served between 1977 and 1979 as the 4th Prime Minister of India and led the government formed by the Janata Party.\n", "prediction 2": "Eleven Prime Ministers of India are born in Gujarat. Morarji Desai, an Indian independence activist, was born in Gujarat on February 29, 1896. Narendra Modi, a member of India's ruling Bharatiya Janata Party, was born in Gujarat in 1950. Desai was also the youngest Prime Minister of India and was minister from 1979 to 1981.", "prediction 3": "Narendra Modi, who was the 14th Prime Minister of India from 2014 to 2015, is an Indian politician born in Gujarat. Morarji Desai, an Indian independence activist, was the 4th Prime Minister of India from 1977-1979.", "prediction 4": "Narendra Modi is an Indian politician serving as the 14th and current Prime Minister of India since 2014. He was the Chief Minister of Gujarat from 2001-2014, and a member of the Bharatiya Janata Party. Morarji Desai is an Indian independence activist and former prime minister from 1977-79, who served between 1977-79. Desai is the oldest person to have become prime minister in Indian political history.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 54, "end": 92 }, { "error type": "Irrelevant", "explanation": "", "start": 93, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 247 }, { "error type": "Irrelevant", "explanation": "", "start": 312, "end": 363 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "Narendra Damodardas Modi is an Indian politician and the 14th Prime Minister of India and has been since 2014. He was born in Gujarat. Morarji Desai, between 1977 and 1979, served as the 4th Prime Minister of India. Desai was born in Gujarat as well. Gujarat is the sixth largest Indian state by area and the ninth largest state by population.\n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "How many episodes are there in season 7 of doc martin?", "passages": [ [ "Doc Martin", "Doc Martin\n\nDoc Martin is a British television medical comedy drama series starring Martin Clunes in the title role.", "It was created by Dominic Minghella after the character of Dr Martin Bamford in the 2000 comedy film \"Saving Grace\".", "The programme is set in the fictional seaside village of Portwenn and filmed on location in the village of Port Isaac, Cornwall, England, with most interior scenes shot in a converted local barn.", "Seven series aired between 2004 and 2015, and a television film aired on Christmas Day 2006.", "The eighth and most recent series began airing on ITV on 20 September 2017, and streams in the United States and Canada on Acorn TV.", "An American TV remake of the series is also being planned.", "While it was initially reported that the series would end after Series 9 in 2019, Martin Clunes clarified that it had only been commissioned as far as the next year, thereby not ruling out future plans by the broadcaster.", "Dr Martin Ellingham (Martin Clunes), a brilliant and successful vascular surgeon at Imperial College London, develops haemophobia (a fear of blood), forcing him to stop practising surgery.", "He obtains a post as the sole general practitioner (GP) in the sleepy Cornish village of Portwenn, where he had spent childhood holidays with his Aunt Joan (Stephanie Cole), who owns a local farm." ], [ "Doc Martin", "Series 6 of Doc Martin was released in Region 1 in December 2013 and in the UK (Region 2) on 24 March 2014.", "Series 7 of Doc Martin was released on DVD/Blu-ray in Region 1 on December 8, 2015 and in the UK (Region 2) on 16 November 2015.", "In Region 4, Series 1, 2, 4, and \"On the Edge\" were released separately and in a nine-disc boxset entitled \"Doc Martin: Comedy Cure\", as well as an earlier seven-disc boxset not including Series 4.", "The two Sky Pictures telefilms were individually released in Region 4 (as 'Doc Martin: volume 1' and 'Doc Martin: volume 2, the Legend of the Cloutie') on the Magna Pacific label, but are now out-of-print.", "Series 1-8 are streaming on Acorn TV in the U.S. and Canada.", "The programme is available on Netflix.", "Series 1-6 are currently available on Amazon Prime Video.", "Two novels were released to coincide with the sixth series." ] ], "gold": "Doc Martin is a British television medical comedy drama series set in the fictional seaside village of Portwenn and filmed on location in the village of Port Isaac, Cornwall, United Kingdom, with most interior scenes shot in a converted local barn. Nine series aired between 2004 and 2019, with a television film airing on Christmas Day in 2006. Season 7 aired 8 episodes starting 7 September through 2 November 2015, with episode 6 airing 19 October, and the 7th episode on 26 October. ", "prediction 1": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. There are 8 episodes in season 7 of Doc Martin.\n", "prediction 2": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. Originally broadcast on ITV on 20 September 2004, it ran for seven series and a television movie between 2004 and 2015. There were 7 episodes in the current series 7, but there are 12 episodes in the 16th season. The 18th season aired for 10 episodes, but it would take another 19 episodes to finish. The 17th season aired for 11 episodes and was finished on 20 January 2017.", "prediction 3": "Doctor Martin is a British television medical comedy drama series starring Martin Clunes in the title role. Series 6 consisted of two episodes each, while the seventh episode consisted of seven. Season 7 of Doc Martin was released as a nine-disc boxset on December 8, 2015.", "prediction 4": "Doc Martin is a British television medical comedy drama series starring Martin Clunes in the title role. It was created by Dominic Minghella after the character of Dr. Martin Bamford in the 2000 comedy film Saving Grace. The series ran for 7 seasons between 2004 and 2015, and a television film aired on Christmas Day 2006. The series was released separately on DVD/Blu-ray in Region 1 on December 8, 2015, and in the UK (Region 2) on 16 November 2015. There were 23 episodes in season 7 of Doc Martin.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 63, "end": 104 }, { "error type": "Unverifiable", "explanation": "", "start": 105, "end": 153 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Doc Martin is a British television medical comedy drama series. It is set in the fictional seaside village of Portwenn and filmed on location in the village of Port Isaac, Cornwall, England, with most interior scenes shot in a converted local barn. Seven series aired between 2004 and 2015, and a television film aired on Christmas Day 2006. " }, "preference": [ 0, 0, 2, 0, 2, 2 ] }, { "question": "How many championships do new york knicks have?", "passages": [ [ "New York Knicks", "New York Knicks\n\nThe New York Knickerbockers, more commonly referred to as the Knicks, are an American professional basketball team based in the borough of Manhattan, in New York City.", "The Knicks compete in the National Basketball Association (NBA) as a member of the Atlantic Division of the Eastern Conference.", "The team plays its home games at Madison Square Garden.", "They are one of two NBA teams located in New York City; the other is the Brooklyn Nets.", "The team, established by Ned Irish in 1946, was one of the founding members of the Basketball Association of America (BAA), which became the NBA after merging with the rival National Basketball League (NBL) in 1949.", "Along with the Boston Celtics, the Knicks are one of only two original NBA teams still located in its original city.", "The Knicks were successful during their early years and were constant playoff contenders under the franchise's first head coach Joe Lapchick.", "Beginning in 1950, the Knicks made three consecutive appearances in the NBA Finals, all of which were losing efforts.", "Lapchick resigned in 1956 and the team subsequently began to falter.", "It was not until the late 1960s when Red Holzman became head coach that the Knicks began to regain their former dominance.", "Holzman successfully guided the Knicks to two NBA championships, in 1970 and 1973." ], [ "1969\u201370 NBA season", "1969\u201370 NBA season\n\nThe 1969\u201370 NBA Season was the 24th season of the National Basketball Association.", "The season ended with the New York Knicks winning the NBA Championship, beating the Los Angeles Lakers 4 games to 3 in the NBA Finals.", "The 1969\u201370 season saw the NBA into a new decade as well as a new era.", "The retirement of Bill Russell from the Boston Celtics at the end of the 1968\u201369 season effectively signaled the end of the Celtics dynasty that had dominated the NBA for the past decade.", "The New York Knicks were the top club in the league.", "They had a solid team of players led by star center Willis Reed and rising star guard Walt Frazier.", "Dave DeBusschere, who had been acquired from the Detroit Pistons the previous year, combined with Frazier and Reed to anchor the league's best defense.", "Coach Red Holzman led the club to wins in 60 of its 82 regular season games to pace the league.", "In just their second season in the league, the Milwaukee Bucks totaled 56 wins behind rookie superstar Lew Alcindor.", "The 7'2\", 230-pound center had caused controversy by boycotting the 1968 Summer Olympics and urging Elvin Hayes, Wes Unseld, and Bob Lanier to do the same.", "The Bucks, however, were happy to sign him after a bidding war with the ABA." ], [ "1972\u201373 NBA season", "1972\u201373 NBA season\n\n", "The 1972\u201373 NBA season was the 27th season of the National Basketball Association.", "The season ended with the New York Knicks winning the NBA Championship, beating the Los Angeles Lakers 4 games to 1 in the NBA Finals.", "This season began in the wake of the remarkable victory of the Los Angeles Lakers, who ended an agonizing decade of runner-up finishes with their first NBA title on the West Coast.", "It was also the first Laker title since George Mikan over fifteen years previous.", "The '71-'72 title had come after a tremendous Western Conference Finals with Milwaukee and their superstar center, Kareem Abdul-Jabbar, the former title-winning Lew Alcindor.", "A Laker and Bucks rematch in the playoffs figured to decide the next championship just as it had the last two.", "The East, clearly the dominant half of the league for so long, looked to be the weaker half again at the start of this season as they had the last two years.", "It was the East that provided the season's top record.", "The Boston Celtics won 68 of 82 NBA games, one of the greatest records in history, two more than Milwaukee two years ago, and just one less than Los Angeles last year.", "The new Celtics were a year older and bolder with young star Dave Cowens at center and Jo Jo White as point guard." ], [ "New York Knicks", "Despite that, they set the NBA single season record for three-pointers.", "On May 3, the Knicks defeated the Boston Celtics in the first round of the NBA playoffs, 4\u20132, their first playoff victory since 2000.", "On May 18, the Knicks were eliminated in the second round of the playoffs, losing the series to the Indiana Pacers 4\u20132.", "Point guard Jason Kidd retired following the end of the season\u2014he was named head coach of the Brooklyn Nets a few days later.", "In the 2013 NBA draft, the Knicks selected Tim Hardaway Jr. as the 24th pick in the first-round.", "During the 2013 off-season, The Knicks claimed Los Angeles Lakers F Metta World Peace off of waivers.", "They re-signed J. R. Smith to a 3-year, $18 million deal and traded Quentin Richardson, Steve Novak, Marcus Camby, and three draft picks to acquire Andrea Bargnani from the Toronto Raptors.", "The Knicks also saw changes to business operations in late 2013, replacing general manager Glen Grunwald with former MSG president Steve Mills.", "The Knicks also purchased an NBA D-League team located White Plains, which began operations at the start of the 2014\u201315 NBDL season." ] ], "gold": "The New York Knicks basketball team has several championships, including 2 NBA championships, having won the NBA Championship by beating the Los Angeles Lakers in the 1969-70 NBA Season and the 1972-72 NBA Season, and 8 Eastern Conference/Division championships.", "prediction 1": "The New York Knicks are an American professional basketball team based in the borough of Manhattan, in New York City. The team won two NBA Championships, one in 1969 and one in 1973.\n", "prediction 2": "The New York Knicks are an American professional basketball team based in the borough of Manhattan, in New York City. The team did not win a championship in 1969 for the 24th season of the National Basketball Association, but in 1972 for the 27th season of the National Basketball Association and in 1973 for the 2nd season.", "prediction 3": "In the National Basketball Association (NBA), the New York Knicks have won two NBA Championships. The Knicks won the NBA Championship during the 1969-70 season and in the 1972-73 season.", "prediction 4": "The New York Knicks are an American professional basketball team based in the borough of Manhattan, in New York City. Throughout the league's history, the team has won three NBA Championships, but they have only one postseason championship, the 1973 NBA Finals. In the 1969\u201370 season, the Knicks won the NBA Championship, beating the Los Angeles Lakers 4 games to 3 in the finals. The 1972\u201373 season ended with the Knicks winning the NBA Championship, beating the Los Angeles Lakers 4 games to 1 in the NBA Finals.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 117 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[11]}", "start": 161, "end": 165 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The team won two NBA Championships, one in 1970 and one in 1973. They beat the Los Angeles Lakers in the 1969-1970 season's NBA Finals as well as the 1972\u201373 season.\n" }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When does spirit riding free season 2 come out?", "passages": [ [ "Spirit Riding Free", "Spirit Riding Free\n\nSpirit", "Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\".", "The series was first released on Netflix on May 5, 2017.", "Set during the 19th century in the small frontier town of Miradero, a 12-year-old girl named Lucky, who had recently relocated from the city, encounters a wild kiger mustang named Spirit.", "Offspring of Spirit and Rain from \"\", the horse is caught by wranglers and brought to be \"broken\" in Miradero.", "Lucky gradually bonds with the stallion, and frees him.", "Lucky also meets two other girls, Pru and Abigail, who both own horses, Chica Linda, a palomino, and Boomerang, a pinto horse, respectively.", "They embark on everyday adventures across the land.", "Six episodes of the first season premiered on May 5, 2017.", "The series was renewed for a second season and it premiered on September 8, 2017.", "The series was renewed for a third season and it premiered on November 17, 2017.", "The series was renewed for a fourth season and it premiered on March 16, 2018.", "A fifth season of the show was released on Netflix on May 11, 2018.", "A sixth season of the show was released on Netflix on August 17, 2018." ] ], "gold": "Spirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally animated film, Spirit: Stallion of the Cimarron, and the first series in the Spirit franchise. Season 2 of Spirit Riding Free came out on September 8, 2017. Season 2 of Spirit Riding Free: Pony Tales came out on October 18, 2019.", "prediction 1": "Spirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\". The series was first released on Netflix on May 5, 2017. The series was renewed for a second season and it premiered on September 8, 2017. The series was renewed for a third season and it premiered on November 17, 2017. The series was renewed for a fourth season and it premiered on March 16, 2018. A sixth season of the show was released on Netflix on August 17, 2018.\n", "prediction 2": "Spirit Riding Free is an American computer-animated fantasy adventure series developed by DreamWorks Animation Television and released by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, Spirit Riding Free. Season 2 of the show came out on May 16, 2018. Season 3 of the show came out on June 11, 2017. Season 4 of the show came out on August 12, 2017.", "prediction 3": "Spirit Riding Free is an American computer-animated comedy-drama series produced by DreamWorks Animation Television and distributed by Netflix. Spirit Riding Free season 2 was released on September 8, 2017, season 1 came out on January 20, 2018, season 2 came out on March 16, 2019, and season 5 came out on August 17, 2019.", "prediction 4": "Spirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\". Spirit Riding Free season 2 premiered on August 17, 2018. Season 1 premiered on June 4, 2010. Season 2 premiered August 17, 2017. Season 3 premiered August 11, 2017. Season 4 premiered March 16, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 245 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 268 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 408 }, { "error type": "Irrelevant", "explanation": "", "start": 409, "end": 487 }, { "error type": "Irrelevant", "explanation": "", "start": 488, "end": 559 } ], "missing-info": [], "corrected-prediction": "Spirit Riding Free is a computer-animated series, produced by DreamWorks Animation Television and distributed by Netflix, based on the 2002 Oscar-nominated traditionally-animated film, \"\". The series' second season premiered on September 8, 2017." }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "A larger sexually dimorphic nucleus of the medial preoptic area is the result of?", "passages": [ [ "Sexually dimorphic nucleus", "Sexually dimorphic nucleus\n\n", "The sexually dimorphic nucleus (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area (POA) of the hypothalamus which is believed to be related to sexual behavior in animals.", "Thus far, for all species of mammals investigated, the SDN has been repeatedly found to be considerably larger in males than in females.", "In humans, the volume of the SDN has been found to be 2.2 times as large in males than in females and to contain 2.1 times as many cells.", "The human SDN is elongated in females and more spherical in males.", "No sex differences have been observed in the human SDN in either cell density or mean diameter of the cell nuclei.", "The volume and cell number of the human SDN considerably decreases with age; although, the decrease in cell number is both sex and age-specific.", "In males, a substantial decrease in the cell number of the human SDN was observed between the age of 50\u201360 years.", "Cell death was more common in females than males, especially among those older than 70 years of age.", "The SDN cell number in females can drop to 10-15% that found in early childhood." ] ], "gold": "The sexually dimorphic nucleus (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area (POA) of the hypothalamus which is believed to be related to sexual behavior in animals. A larger sexually dimorphic nucleus of the medial preoptic area is the general result of being male. A larger sexually dimorphic nucleus of the medial preoptic area is the specific result of being a heterosexual male.", "prediction 1": "The sexually dimorphic nucleus (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area (POA) of the hypothalamus which is believed to be related to sexual behavior in animals. Thus far, for all species of mammals investigated, the SDN has been repeatedly found to be considerably larger in males than in females. In humans, the volume of the SDN has been found to be 2.2 times as large in males than in females and to contain 2.1 times as many cells.\n", "prediction 2": "In humans, the volume of the sexually dimorphic nucleus has been found to be 2.2 times as large in males than in females and to contain 2.1 times as many cells. The SDN is elongated in females and more spherical in males. In males, a substantial decrease in the cell number of the human SDN was observed between the ages of 50\u201360 years, while cell death was more common in females than males especially among those older than 70 years of age.", "prediction 3": "The sexually dimorphic nucleus (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area of the hypothalamus which is believed to be related to sexual behavior in animals. Thus far, for all species of mammals investigated, the SDN has been repeatedly found to be considerably larger in males than in females. In humans, the volume of the SDN has been found to be 2.2 times as large in males than in females and to contain 2.1 times as many cells. The human SDN is elongated in females and more spherical in males.", "prediction 4": "The sexually dimorphic node (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area of the hypothalamus, which is believed to be related to sexual behavior in animals. Thus far, for all species of mammals investigated, the SDN has been repeatedly found to be considerably larger in males than in females. The human SDN is elongated in females and more spherical in males.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 350, "end": 488 } ], "missing-info": [], "corrected-prediction": "The sexually dimorphic nucleus (SDN) is an ovoid, densely packed cluster of large cells located in the medial preoptic area (POA) of the hypothalamus which is believed to be related to sexual behavior in animals. Thus far, for all species of mammals investigated, the SDN has been repeatedly found to be considerably larger in males than in females. " }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When did the concept of sustainable development come into existence?", "passages": [ [ "Sustainable development", "Sustainable development\n\nSustainable development is the organizing principle for meeting human development goals while at the same time sustaining the ability of natural systems to provide the natural resources and ecosystem services upon which the economy and society depend.", "The desired result is a state of society where living conditions and resource use continue to meet human needs without undermining the integrity and stability of the natural system.", "Sustainable development can be classified as development that meets the needs of the present without compromising the ability of future generations.", "While the modern concept of sustainable development is derived mostly from the 1987 Brundtland Report, it is also rooted in earlier ideas about sustainable forest management and twentieth century environmental concerns.", "As the concept developed, it has shifted to focus more on economic development, social development and environmental protection for future generations.", "It has been suggested that \"the term 'sustainability' should be viewed as humanity's target goal of human-ecosystem equilibrium (homeostasis), while 'sustainable development' refers to the holistic approach and temporal processes that lead us to the end point of sustainability\".", "The modern economies are endeavouring to reconcile ambitious economic development and obligations of preserving the natural resources and ecosystem, the two are traditionally seen as of conflicting nature.", "Instead of holding climate change commitments and other sustainability measures as a drug to economic development, turning and leveraging them into market opportunities will do greater good." ], [ "Sustainable development", "Two years later, the United Nations World Charter for Nature raised five principles of conservation by which human conduct affecting nature is to be guided and judged.", "In 1987 the United Nations World Commission on Environment and Development released the report \"Our Common Future\", commonly called the Brundtland Report.", "The report included what is now one of the most widely recognised definitions of sustainable development.", "Since the Brundtland Report, the concept of sustainable development has developed beyond the initial intergenerational framework to focus more on the goal of \"socially inclusive and environmentally sustainable economic growth\".", "In 1992, the UN Conference on Environment and Development published the Earth Charter, which outlines the building of a just, sustainable, and peaceful global society in the 21st century.", "The action plan Agenda 21 for sustainable development identified information, integration, and participation as key building blocks to help countries achieve development that recognises these interdependent pillars.", "It emphasises that in sustainable development everyone is a user and provider of information.", "It stresses the need to change from old sector-centered ways of doing business to new approaches that involve cross-sectoral co-ordination and the integration of environmental and social concerns into all development processes.", "Furthermore, Agenda 21 emphasises that broad public participation in decision making is a fundamental prerequisite for achieving sustainable development." ], [ "Sustainable development", "Kenneth E. Boulding in his influential 1966 essay \"The Economics of the Coming Spaceship Earth\" identified the need for the economic system to fit itself to the ecological system with its limited pools of resources.", "One of the first uses of the term sustainable in the contemporary sense was by the Club of Rome in 1972 in its classic report on the \"Limits to Growth\", written by a group of scientists led by Dennis and Donella Meadows of the Massachusetts Institute of Technology.", "Describing the desirable \"state of global equilibrium\", the authors wrote: \"We are searching for a model output that represents a world system that is sustainable without sudden and uncontrolled collapse and capable of satisfying the basic material requirements of all of its people.\"", "Following the Club of Rome report, an MIT research group prepared ten days of hearings on \"Growth and Its Implication for the Future\" (Roundtable Press, 1973) for the US Congress, the first hearings ever held on sustainable development.", "William Flynn Martin, David Dodson Gray, and Elizabeth Gray prepared the hearings under the Chairmanship of Congressman John Dingell.", "In 1980 the International Union for the Conservation of Nature published a world conservation strategy that included one of the first references to sustainable development as a global priority and introduced the term \"sustainable development\"." ] ], "gold": "The modern concept of sustainable development is derived mostly from the 1987 Brundtland Report, but it is also rooted in earlier ideas about sustainable forest management and twentieth-century environmental concerns. One of the first uses of the term \"sustainable\" in the contemporary sense was in a 1972 report on the Limits to Growth, written by a group of MIT-led scientists, which led to MIT researchers presenting before the US Congress in 1973 in the first hearings ever held on sustainable development. In 1980, the International Union for the Conservation of Nature published a world conservation strategy that included one of the first references to sustainable development as a global priority.", "prediction 1": "Sustainable development is the organizing principle for meeting human development goals while at the same time sustaining the ability of natural systems to provide the natural resources and ecosystem services upon which the economy and society depend. The modern concept of sustainable development is derived mostly from the 1987 Brundtland Report, but it is also rooted in earlier ideas about sustainable forest management and twentieth century environmental concerns. In 1992, the UN Conference on Environment and Development published the Earth Charter, which outlines the building of a just, sustainable, and peaceful global society in the 21st century. One of the term sustainable in the contemporary sense was by the Club of Rome in its classic report on the \"Limits to Growth\", written by a group of scientists led by Dennis and Donella Meadows of the Massachusetts Institute of Technology.", "prediction 2": "Sustainable development is the organizing principle for meeting human development goals while at the same time sustaining the ability of natural systems to provide the natural resources and ecosystem services upon which the economy and society depend. Sustainable development can be classified as development that meets the needs of the present and does not compromise the ability of future generations. It is also rooted in concepts of environmental justice, space exploration, resource conservation and biodiversity conservation. The concept of sustainable development was first used in the contemporary sense by the Club of Rome in 1972. In 1980 the International Union for the Conservation of Nature published a world conservation strategy that included one of the first references to sustainable development as a global priority and introduced the term.", "prediction 3": "The term sustainable development came into existence with the publication of a report by the UN Commission on Environment and Development in 1987, entitled Our Common Future, as well as the United Nations World Charter for Nature in 1992, which raised five principles of conservation by which human conduct affecting nature is to be guided and judged.", "prediction 4": "The term sustainable development came into existence in 1972, when the Club of Rome produced a classic report on Limits to Growth. It was later used in a way as a global term by the United Nations in 1990.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 251 }, { "error type": "Irrelevant", "explanation": "", "start": 470, "end": 657 }, { "error type": "Irrelevant", "explanation": "", "start": 719, "end": 735 }, { "error type": "Irrelevant", "explanation": "", "start": 818, "end": 851 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 4 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 6 ] } ], "corrected-prediction": "The modern concept of sustainable development is derived mostly from the 1987 Brundtland Report, but it is also rooted in earlier ideas about sustainable forest management and twentieth century environmental concerns. One of the first uses of the term sustainable in the contemporary sense was in the \"Limits to Growth\" by a group of scientists from the Massachusetts Institute of Technology. An MIT research group prepared hearings for the US Congress, the first hearings ever held on sustainable development. In 1980 the International Union for the Conservation of Nature published a world conservation strategy that included one of the first references to sustainable development as a global priority and introduced the term \"sustainable development\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When does the bachelor season 22 finale air?", "passages": [ [ "The Bachelor (season 22)", "The Bachelor (season 22)\n\n", "The 22nd season of \"The Bachelor\" premiered on January 1, 2018.", "This season features 36-year-old Arie Luyendyk Jr., a real estate agent and race car driver from Scottsdale, Arizona.", "Luyendyk was the runner-up on the eighth season of \"The Bachelorette\" featuring Emily Maynard.", "The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner.", "During the finale, Luyendyk subsequently ended his engagement with Kufrin while admitted that he was still in love with runner-up Lauren Burnham to give another chance on their relationship, in which Luyendyk proposed to Burnham in the \"After the Final Rose\" special.", "On September 7, 2017, during \"Good Morning America\", Luyendyk was announced as the next Bachelor over \"The Bachelorette\" season 13 runner-up Peter Kraus, who was the fan favorite choice for the role.", "Many fans were in disbelief in response to Kraus' decision and the producers selected Luyendyk as a last minute direct replacement.", "This season traveled to Lake Tahoe; Fort Lauderdale, Florida; Paris, France; Tuscany, Italy and Peru." ], [ "The Bachelorette (season 14)", "The Bachelorette (season 14)\n\n", "The 14th season of \"The Bachelorette\" premiered on May 28, 2018.", "This season features Becca Kufrin, a 28-year-old publicist from Prior Lake, Minnesota.", "Kufrin was the winner of the 22nd season of \"The Bachelor\" featuring Arie Luyendyk Jr.; however, Luyendyk broke off his engagement with Kufrin to resume a relationship with runner-up Lauren Burnham prior to the After the Final Rose special.", "On the season finale, Kufrin picked medical sales representative Garrett Yrigoyen to be her fianc\u00e9.", "Casting began during season thirteen of \"The Bachelorette\".", "Kufrin was named as the bachelorette during the After the Final Rose special of Season 22 of The Bachelor on March 6, 2018.", "This season's cast includes Philadelphia Eagles tight end Clay Harbor and undrafted free agent Colton Underwood.", "Filming was reported in Richmond, Virginia during April 6 \u2013 9 at Lombardy Street, Virginia State Capitol, Edgar Allan Poe Museum, Veil Brewing Company, and Carpenter Theatre.", "The season began with 28 contestants." ] ], "gold": "The 22nd season of The Bachelor premiered on January 1, 2018. The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner. The last episode aired on March 6, 2018.", "prediction 1": "The 22nd season of The Bachelor premiered on January 1, 2018 in Scottsdale, Arizona. The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner. During the finale, Luyendyk subsequently ended his engagement with Kufrin while admitted that he was still in love with runner-up Lauren Burnham to give another chance on their relationship, in which Luyendyk proposed to Burnham in the \"After the Final Rose\" special.\n", "prediction 2": "The 22nd season of \"The Bachelor\" premiered on January 1, 2018. The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner. During the finale, Luyendyk subsequently ended his engagement with Kufrin while admitted that he was still in love with runner-up Lauren Burnham to give another chance on their relationship, in which Luyendyk proposed to Burnham in the \"After the Final Rose special.\" The 14th season of \"The Bachelor\" premiered on May 28, 2018. The Bachelor final episode concluded on April 25, 2020.", "prediction 3": "The 22nd season of \"The Bachelor\" premiered on January 1, 2018, in Scottsdale, Arizona. The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner. During the finale, Luyendyk subsequently ended his engagement with Kufrin while admitted that he was still in love with runner-up Lauren Burnham to give another chance on their relationship, in which Luyendyk proposed to Burnham in the \"After the Final Rose special.\" The 14th season of \"The Bachelorette\" premiered on May 28, 2018.", "prediction 4": "The 22nd season of The Bachelor premiered on January 1, 2018 in Scottsdale, Arizona. The season concluded on March 5, 2018, when 27-year-old publicist Becca Kufrin was named the winner. Luyendyk subsequently ended his engagement with Kufrin while admitted that he was still in love with runner-up Lauren Burnham to give another chance on their relationship. The season finale was televised on March 6, 2018.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 61, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 189, "end": 457 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The 22nd season of The Bachelor premiered on January 1, 2018. The season concluded on March 5, 2018 in which 27-year-old publicist Becca Kufrin was named the winner. The After Final Rose special of Season 22 of The Bachelor aired on March 6, 2018." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Who is the grand marshall of the rose parade?", "passages": [ [ "Grand Marshals of the Rose Parade", "Former child actress Shirley Temple Black holds the runner-up position, having been grand marshal three times in 1939, 1989 and 1999, the latter year where she shared this honor with astronaut Buzz Aldrin, baseball player Jackie Robinson (who was also the first ever posthumous grand marshal) and film producer David L. Wolper.", "On May 9, 2014, Louis Zamperini was selected as the Grand Marshal for the 2015 Tournament of Roses Parade, though he would die of pneumonia two months later, and six months before the parade was set to begin.", "Rather than select a new Grand Marshal, the Tournament announced that it was \"committed to honoring him as the Grand Marshal of the 2015 Rose Parade,\" making him the first posthumous grand marshal since Jackie Robinson in 1999.", "On November 3, 2016, the 2017 Grand Marshals were revealed to be three Olympic athletes:", "Greg Louganis, Janet Evans and Allyson Felix.", "The Olympians were deliberately chosen to reflect on Los Angeles' bid for the 2024 Summer Olympics.", "This was the first year with multiple Grand Marshals since 2003, when Bill Cosby, Art Linkletter and Fred Rogers all shared this duty." ], [ "Rose Parade", "From the neighboring town of Arcadia, the Arcadia High School Apache Marching Band and Colorgaurd has appeared for 15 years, returning about every four years.", "The Allen Eagle Escadrille from Allen, Texas had a record breaking 780 members in the 2016 Rose Parade.", "In addition to the parade, the bands participate in a two-day, three-show Bandfest at Pasadena City College's Jackie and Mack Robinson Stadium, usually on December 29 and 30 (December 30 and 31 when the parade is on January 2).", "Twenty bands participated in the 2016 parade.", "Shortly after the parade in January, the newly elected President of the Tournament of Roses has the duty of picking a theme for the forthcoming festivities.", "Most of the floral floats in the parade are inspired by this theme.", "On January 18, 2018, Gerald Freeny was confirmed as President of the Pasadena Tournament of Roses Association.", "He announced that the theme for the 130th Rose Parade and 105th Rose Bowl Game is \"The Melody of Life\".", "The parade and bowl game will be held on January 1, 2019.", "The Tournament of Roses President will lead the 14-member Executive Committee and the organization of 935 volunteer members for the upcoming year.", "The Grand Marshal of the parade is an honorary position selected by the president of the Tournament.", "Many are picked for a relationship to the theme that is also picked by the president." ], [ "Rose Parade", "The 2018 Grand Marshal was Academy Awards nominee and distinguished humanitarian Gary Sinise.", "For the 2017 parade, Greg Louganis, Janet Evans and Allyson Felix served as marshals.", "Documentary filmmaker Ken Burns was selected as the 2016 Grand Marshal.", "The 2015 parade Grand Marshal was to be Louis Zamperini.", "After his death on July 2, 2014, the Tournament announced that it was \"committed to honoring him as the Grand Marshal of the 2015 Rose Parade.\"", "During the parade, USC mascot Traveler walked in his place, riderless to honor Zamperini.", "Vin Scully was chosen as the Grand Marshal of the 2014 parade and Rose Bowl Game.", "Previously, President Sally Bixby named Jane Goodall as the Grand Marshal for the 2013 parade, succeeding J. R. Martinez, the 2012 grand marshal.", "Food Network star Paula Deen was the Grand Marshal of the 2011 parade.", "Captain Chesley Sullenberger was the 2010 Grand Marshal and actress Cloris Leachman served as the 2009 Grand Marshal, the 10th female grand marshal in the history of the parade.", "Mary Pickford was the first female Grand Marshal.", "Other Hollywood celebrities who appeared as Grand Marshal are Leo Carrillo, Harold Lloyd, Walt Disney, John Wayne, and Bob Hope." ] ], "gold": "The Grand Marshal of the Rose Parade is an honorary position selected by the president of the Tournament. Many are picked for a relationship to the theme that is also picked by the president. Louis Zamperini was selected as the Grand Marshal for the 2015 Tournament of Roses Parade, though he would die of pneumonia two months later, and six months before the parade was set to begin. Rather than select a new Grand Marshal, the Tournament announced that it was \"committed to honoring him as the Grand Marshal of the 2015 Rose Parade,\" making him the first posthumous grand marshal since Jackie Robinson in 1999. Ken Burns was selected as the Grand Marshal for the 2016 Rose Parade. The 2017 Grand Marshals were three Olympic athletes: diver Greg Louganis, sprinter Janet Evans, and swimmer Allyson Felix. The Olympians were deliberately chosen to reflect on Los Angeles' bid for the 2024 Summer Olympics.", "prediction 1": "The Grand Marshal of the Rose Parade is an honorary position selected by the president of the Tournament. Many are picked for a relationship to the theme that is also picked by the president. In 2015, Louis Zamperini was selected as the Grand Marshal of the Rose Parade, though he would die of pneumonia two months later, and six months before the parade was set to begin. In 2016, the Grand Marshals were revealed to be three Olympic athletes: Greg Louganis, Janet Evans and Allyson Felix. In 2017, the Grand Marshal was Gary Sinise. In 2018, Gary Sinise was selected as the Grand Marshal. In 2016, the Grand Marshal was revealed to be three Olympic athletes: Greg Louganis, Janet Evans and Allyson Felix.\n", "prediction 2": "The grand marshal of the Pasadena Rose Parade is an honorary position selected by the President of the Tournament of Roses. There are numerous grand marshals over the years. For the 2015 parade Louis Zamperini was selected as the Grand Marshal, though he would die of pneumonia two months later, and six months before the parade was set to begin. Documentary filmmaker Ken Burns was selected as the 2016 Grand Marshal. Gary Sinise was the Grand Marshal for the 2018 Rose Parade. For the 2017 parade, Gregory Louganis, Janet Evans and Allyson Felix served as the Grand Marshall.", "prediction 3": "The Grand Marshal of the Rose Parade is an honorary position selected by the president of the Tournament of Roses and many are picked for a relationship to the theme that is also picked by the president. For example, Vince Lombardo was sworn in as Grand Marshal in 2012. In 2013, Captain Chesley Sullenberger was named Grand Marshal and in 2009, actress Cloris Leachman was named Grand Marshal, the 10th female grand marshal in the history of the parade. In 2014, Louis Zamperini was chosen as the Grand Marshal of the 2015 Rose Parade. In 2014, Eddie Golden Boys star Gary Sinise was named Grand Marshal of the parade. For the 2017 parade, Gary Sinise was declared the first posthumous grand marshal as the Grand Marshal.", "prediction 4": "There are several Grand Marshals of the Pasadena Tournament of Roses Annual Rose Parade. For the 2015 parade, Vin Scully was chosen as the Grand Marshal. For the 2017 parade, Greg Louganis, Janet Evans and Allyson Felix served as marshals. Food Network star Paula Deen was the Grand Marshal of the 2011 parade. In 2012 Captain Chesley Sullenberger served as the Grand Marshal for the 2013 parade, succeeding J. R. Martinez, the 2012 grand marshal.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[4]}", "start": 491, "end": 534 }, { "error type": "Redundant", "explanation": "In 2016, the Grand Marshals were revealed to be three Olympic athletes: Greg Louganis, Janet Evans and Allyson Felix.", "start": 591, "end": 707 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 11 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 12 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Grand Marshal of the Rose Parade is an honorary position selected by the president of the Tournament. Many are picked for a relationship to the theme that is also picked by the president. In 2015, Louis Zamperini was selected as the Grand Marshal of the Rose Parade, though he would die of pneumonia two months later, and six months before the parade was set to begin. Rather than select a new Grand Marshal, the Tournament announced that it was \"committed to honoring him as the Grand Marshal of the 2015 Rose Parade,\" making him the first posthumous grand marshal since Jackie Robinson in 1999. The 2017 Grand Marshals were revealed to be three Olympic athletes: Greg Louganis, Janet Evans and Allyson Felix. The Olympians were deliberately chosen to reflect on Los Angeles' bid for the 2024 Summer Olympics. In 2018, Gary Sinise was selected as the Grand Marshal. Others include Ken Burns (2016), Vin Scully (2014), Jane Goodall (2013), J. R. Martinez (2012), Paula Deen (2011), Captain Chesley Sullenberger (2010), Cloris Leachman (2009), Mary Pickford, Leo Carrillo, Harold Lloyd, Walt Disney, John Wayne, and Bob Hope. In 1999 it was Shirley Temple Black, Buzz Aldrin, and David L. Wolper. In 2003 Bill Cosby, Art Linkletter and Fred Rogers all shared this duty." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "Who is buried at the tennessee state capitol?", "passages": [ [ "Tennessee State Capitol", "Samuel Dold Morgan (1798\u20131880), chairman of the State Building Commission overseeing the construction of the Tennessee State Capitol, is entombed in the southeast corner near the south entrance.", "Monuments on the Capitol grounds include statues of two of the three Tennessee residents who served as President of the United States: Andrew Jackson by Clark Mills and Andrew Johnson by Jim Gray.", "The second President from Tennessee, James K. Polk, is buried in a tomb on the grounds, together with his wife, Sarah Childress Polk.", "Other monuments on the grounds include the Sgt. Alvin C. York Memorial by Felix de Weldon, the Tennessee Holocaust Commission Memorial, the Sam Davis Memorial at the southwest corner of the Capitol grounds, the Sen. Edward Ward Carmack Memorial located above the Motlow Tunnel near the south entrance, and the Memorial to Africans during the Middle Passage at the southwest corner of Capitol grounds.", "The Charles Warterfield Reliquary is a group of broken limestone columns and fragments removed and saved from the State Capitol during the mid-1950s restoration, located near the northern belvedere on Capitol Drive.", "The building has housed a bust of Nathan Bedford Forrest thanks to Democratic state senator Douglas Henry since 1978.", "The presence of the bust has been controversial since its dedication.", "Legislation was proposed in 2017 towards moving it to the Tennessee State Museum." ], [ "James K. Polk", "By the time the legislature adjourned its session in September 1822, Polk was determined to be a candidate for the Tennessee House of Representatives.", "The election was in August 1823, almost a year away, allowing him ample time for campaigning.", "Already involved locally as a member of the Masons, he was commissioned in the Tennessee militia as a captain in the cavalry regiment of the 5th Brigade.", "He was later appointed a colonel on the staff of Governor William Carroll, and was afterwards often referred to as \"Colonel\".", "Although many of the voters were members of the Polk clan, the young politician campaigned energetically.", "People liked Polk's oratory, which earned him the nickname \"Napoleon of the Stump.\"", "At the polls, where Polk provided alcoholic refreshments for his voters, he defeated incumbent William Yancey.", "Beginning in early 1822, Polk courted Sarah Childress\u2014they were engaged the following year and married on January 1, 1824 in Murfreesboro.", "Educated far better than most women of her time, especially in frontier Tennessee, Sarah Polk was from one of the state's most prominent families.", "During James's political career Sarah assisted her husband with his speeches, gave him advice on policy matters, and played an active role in his campaigns.", "Rawley noted that Sarah Polk's grace, intelligence and charming conversation helped compensate for her husband's often austere manner." ], [ "Tennessee State Capitol", "Tennessee State Capitol\n\nThe Tennessee State Capitol, located in Nashville, Tennessee, is the seat of government for the U.S. state of Tennessee, serving as home of the Tennessee General Assembly and the location of the governor's office.", "Designed by architect William Strickland (1788\u20131854) of Philadelphia and Nashville, it was built between 1845 and 1859 and is one of Nashville's most prominent examples of Greek Revival architecture.", "The building, one of 12 state capitols that does not have a dome, was added to the National Register of Historic Places in 1970 and named a National Historic Landmark in 1971.", "The prominent Nashville hilltop site of what is now the Tennessee State Capitol was formerly occupied by the Holy Rosary Cathedral (no longer extant), the first Roman Catholic cathedral church in Nashville (with the Diocese of Nashville at that time once comprising the entire territory of the State of Tennessee).", "The State Capitol was designed by renowned Philadelphia architect William Strickland, who modeled it after a Greek Ionic temple.", "The prominent lantern structure located above the roof line of the Tennessee state capitol is a design based upon the Choragic Monument of Lysicrates in Athens that honors the Greek god", "Dionysus doing battle with Tyrrhenian pirates.", "The cornerstone of the Tennessee state capitol was itself laid on July 4, 1845 and the building was completed fourteen years later in 1859." ] ], "gold": "The Tennessee State Capitol, located in Nashville, Tennessee, is the seat of government for the U.S. state of Tennessee, serving as home of the Tennessee General Assembly and the location of the governor's office. The building was designed by renowned Philadelphia architect William Strickland, who modeled it after a Greek Ionic temple, and includes a series of monuments on its grounds. Two tombs can be found among them, the ones of the second President from Tennessee, James K. Polk, and his wife, Sarah Childress Polk, who were buried together.", "prediction 1": "The Tennessee State Capitol, located in Nashville, Tennessee, is the seat of government for the U.S. state of Tennessee, serving as home of the Tennessee General Assembly and the location of the governor's office. The second president from Tennessee, James K. Polk, is buried in a tomb on the grounds, together with his wife, Sarah Childress Polk.\n", "prediction 2": "Samuel Dold Morgan, chairman of the State Building Commission oversighting the construction of the Tennessee State Capitol, is entombed in the southeast corner near the south entrance at the Tennessee State Capitol. James K. Polk, second president of the US from Tennessee, is buried at the Tennessee State Capitol alongside his wife, Sarah Childress Polk.", "prediction 3": "There are two graves at the Tennessee State Capitol - Samuel Dold Morgan and James Kidd Polk. James Kidd Polk was the first president of Tennessee and is buried in the southeast corner of the Capitol grounds near the south entrance. Sarah Childress Polk was the second president of Tennessee and was buried together with her husband, James Kidd Polk, in the southwest corner of the Capitol grounds.", "prediction 4": "The Tennessee State Capitol in Nashville, Tennessee, is the seat of government for the U.S. state of Tennessee, serving as home of the Tennessee General Assembly and the location of the governor's office. Two of the three presidents of the United States are buried at the Capitol, including William Henry Harrison, Peter Henry Jr., Samuel Dold Morgan, and James K. Polk, Jr.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 3, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Tennessee State Capitol, located in Nashville, Tennessee, is the seat of government for the U.S. state of Tennessee, serving as home of the Tennessee General Assembly and the location of the governor's office. The State Capitol was designed by renowned Philadelphia architect William Strickland, who modeled it after a Greek Ionic temple. The second president from Tennessee, James K. Polk, is buried in a tomb on the grounds, together with his wife, Sarah Childress Polk. Samuel Dold Morgan (1798\u20131880), chairman of the State Building Commission overseeing the construction of the Tennessee State Capitol, is entombed in the southeast corner near the south entrance.\n " }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "When did michael jackson rock with you come out?", "passages": [ [ "Rock with You", "Rock with You\n\n\"Rock with You\" is a song recorded by American singer Michael Jackson.", "It was written by Rod Temperton and produced by Quincy Jones.", "It was first offered to Karen Carpenter, while she was working on her first solo album, but she turned it down.", "It was released on November 3, 1979, by Epic Records as the second single from Jackson's fifth solo studio album \"Off the Wall\" (1979).", "It was also the third number-one hit of the 1980s, a decade whose pop singles chart would soon be dominated by Jackson.", "It reached number one on both the US \"Billboard\" pop and R&B charts.", "On the former, \"Rock with You\" spent four consecutive weeks at number one starting January 19, 1980.", "According to \"Billboard\", the song was the fourth biggest single of 1980.", "It is also considered one of the last hits of the disco era.", "It was re", "-released as a single on February 27, 2006, as part of the \"\" box set.", "This song is written in the key of Eb minor.", "Meter is 4/4 at 114 bpm.", "AllMusic highlighted the song on the album itself.", "Robert Christgau called it a \"smooth ballad\".", "A music video was released for the song, using the shorter single version." ], [ "Visionary: The Video Singles", "Visionary: The Video Singles\n\nVisionary:", "The Video Singles is a series of 20 hit singles by American recording artist Michael Jackson.", "It was released in Europe between February 20, 2006 and June 26, 2006, and then released in North America as a box set on November 14, 2006 by Epic Records and Legacy Recordings.", "The limited edition cover artwork for the box set is a photomosaic using images from Jackson's career.", "Each single contains two different audio versions of the title song, and its originally released video clip.", "Audio for the video, and for the enhanced resolution music on the DVD side of the DualDisc, is PCM at 48 kHz.", "Released on February 21, 2006, Visionary Remixes \u2013 EP is only available from the iTunes Store." ], [ "Attention (Charlie Puth song)", "Two days later, \"Attention\" was officially released as the lead single of Puth's second studio album.", "\"Attention\" is a midtempo pop rock song that features elements of '80s soft-soul and funk.", "Throughout the song, the singer realizes that his partner only wants to be around him for attention and other ulterior motives instead of loving him for who he is.", "It is performed in the key of E\u266d minor with a tempo of 100 beats per minute.", "Puth's vocal span from E\u266d3 to B\u266d4.", "Writing for \"Idolator\", Mike Wass suggested that \"Attention\" is a \"Song of Summer contender\".", "He added that Charlie \"is still the boy next door, just a little more jaded and a lot more willing to speak his mind.\"", "Praising the song's production, he said that \"That boldness also comes through on the production, which Charlie handled himself, chugging along with chunky bass and faint traces of disco.\"", "Lars Brandle of \"Billboard\" described it as \"polished\" and \"groove-injected.\"", "The official music video was released on April 24, 2017, on YouTube.", "It was filmed in Los Angeles and directed by Emil Nava.", "Cameras capture Puth brooding at the club while scoping out a blond girl, played by Samara Weaving." ] ], "gold": "Michael Jackson's disco and funk song \"Rock with You\" was released on November 3, 1979 as the second single from Jackson's fifth solo studio album \"Off the Wall\". It was also the third number-one hit of the 1980s, and was re-released as a single on February 27, 2006 as part of the Visionary: The Video Singles box set.", "prediction 1": "\"Rock with You\" is a song recorded by American singer Michael Jackson. It was first offered to Karen Carpenter, while she was working on her first solo album, but she turned it down. It was released on November 3, 1979, by Epic Records as the second single from Jackson's fifth solo studio album Off the Wall (1979). It was re -released as a single on February 27, 2006, as part of the \"\" box set. Visionary: The Video Singles is a series of 20 hit singles by American recording artist Michael Jackson. It was released in Europe between February 20, 2006, and June 26, 2006. It was released in North America as a box set on November 14, 2006.\n", "prediction 2": "Michael Jackson's song \"Rock with You\" came out on November 3, 1979, as the second single from his fifth solo studio album Off the Wall. The song became a Top 40 hit and was even the third biggest hit in the 1980s. It was then re-released on February 27, 2006, as part of the \"Visionary: The Video Singles\" box set. The song was released in America on November 14, 2006 as a box set.", "prediction 3": "\"Rock with You\" is a song recorded by American singer Michael Jackson. It was first offered to Karen Carpenter, while she was working on her first solo album, but she turned it down. It was released on November 3, 1979, by Epic Records as the second single from Jackson's fifth solo studio album Off the Wall. It was also the third number-one hit of the 1980s, according to Billboard. In 2006, Michael Jackson released two hit singles, \"Visionary: The Video Singles\", and \"Attention\".", "prediction 4": "\"Rock with You\" is a song recorded by American singer Michael Jackson, originally released on October 17, 1979, as the second single from his fifth solo studio album Off the Wall. The song was first offered to Karen Carpenter, while she was working on her first solo album, but she turned it down. It was released on November 3, 1979 when it was released by Epic Records. It was re -released as a single on February 27, 2006, as part of the \"\" box set.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 182 }, { "error type": "Irrelevant", "explanation": "", "start": 398, "end": 502 }, { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 574 }, { "error type": "Irrelevant", "explanation": "", "start": 575, "end": 643 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 235 }, { "error type": "Redundant", "explanation": "\"Rock with You\" is a song recorded by American singer Michael Jackson. It was first offered to Karen Carpenter, while she was working on her first solo album, but she turned it down. It was released on November 3, 1979,", "start": 309, "end": 316 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "\"Rock with You\" is a song recorded by American singer Michael Jackson. It was released on November 3, 1979, as the second single from Jackson's fifth solo studio album Off the Wall. It was re -released as a single on February 27, 2006, as part of the \"\" box set. It was also the third number-one hit of the 1980s.\n" }, "preference": [ 2, 1, 2, 1, 1, 2 ] }, { "question": "When did the rolling stones play in hyde park?", "passages": [ [ "The Stones in the Park", "The Stones in the Park\n\nThe Stones in the Park was a free outdoor festival held in Hyde Park on 5 July 1969, headlined by The Rolling Stones and featuring Third Ear Band, King Crimson, Screw, Alexis Korner's New Church, Family and The Battered Ornaments, in front of a crowd estimated at between 250,000 and 500,000 fans.", "It was the Stones' first public concert in over two years, and was planned as an introduction of new guitarist, Mick Taylor, though circumstances inevitably changed following the death of former member Brian Jones two days earlier.", "The band rehearsed at the Beatles' studio in the basement of Savile Row, and Jagger and Richards came up with a 14-song set; the Hyde Park concert would be the first time many of the songs had been played before a public audience.", "The PA system was supplied by Watkins Electric Music, who had already handled amplification at previous Hyde Park shows.", "Fans started to arrive at the park with candles on 4 July in tribute to Jones, and by the morning of 5 July, 7,000 people had already gathered.", "Mick Jagger read a short eulogy on stage before the Stones' set began, reading two stanzas of Percy Bysshe Shelley's poem on John Keats's death, \"Adona\u00efs\", from a calf-bound book." ], [ "50 & Counting", "50 & Counting\n\n50 & Counting was a concert tour by The Rolling Stones to celebrate the 50th anniversary of the band, which started in October 2012 (with two secret club gigs in Paris) and ended in July 2013 (with two major shows at Hyde Park).", "In late April / early May 2012, the band met up at a studio in Weehawken, NJ for some secretive, preliminary rehearsals (their 1st time playing together since 2007).", "On 19 May 2012, Mick Jagger hosted and performed on the season finale of \"Saturday Night Live\".", "The Rolling Stones then made their first public appearance in over four years on 12 July 2012 at the Marquee Club in London to commemorate the 50th anniversary of their first ever concert.", "They also published a book entitled \"The Rolling Stones: 50\" as well as a documentary, Crossfire Hurricane, released on 15 November 2012 on HBO.", "The documentary included interviews from all six of the living band members.", "In August 2012, the Stones gathered at a studio in Paris to record their first new material since \"A Bigger Bang\", over seven years ago.", "In October and November 2012, they conducted rehearsals for their 50th anniversary concerts.", "The rehearsals for the 2012 tour took place in Bondy near Paris, France (in a rehearsal studio named Planet Live) and in London, England at the Wembley Arena for the 2012 shows." ], [ "Hyde Park Live", "Hyde Park Live\n\n", "Hyde Park Live is a live album by The Rolling Stones, released in 2013.", "It was recorded at Hyde Park, London on 6 and 13 July 2013 during the band's 50 and Counting Tour.", "The album was released exclusively as a digital download through iTunes on 22 July 2013 for a limited time of four weeks.", "The album debuted at #16 in the UK and #19 in the US.", "The same concert was later issued on DVD as Sweet Summer Sun: Live in Hyde Park.", "In 1969, The Rolling Stones performed a free concert in Hyde Park just two days after the death of founding member Brian Jones, with the gig also serving as the introduction to new guitarist Mick Taylor.", "As part of the 50 & Counting tour that celebrated The Rolling Stones' 50th anniversary celebrations, a new Hyde Park concert was scheduled in 2013, supported by The Vaccines, The Temper Trap, and", "Gary Clark Jr.", "The 65,000 tickets were sold out in three minutes.", "Taylor, who left the band in 1974, appears on two tracks: \"Midnight Rambler\" and show closer \"(I Can't Get No) Satisfaction\".", "A video recording of the concert, \"Sweet Summer Sun \u2013 Hyde Park Live\", was issued on 11 November 2013 on DVD and Blu-ray, along with CDs and LPs." ] ], "gold": "The Rolling Stones played at The Stones in the Park which was a free outdoor festival held in Hyde Park on 5 July 1969. The Rolling Stones returned to Hyde Park during their 50 & Counting concert tour on July 6 and 13, 2013.", "prediction 1": "The Rolling Stones have played in Hyde Park several times. In 1969, The Rolling Stones performed a free concert in Hyde Park just two days after the death of founding member Brian Jones, with the gig also serving as the introduction to new guitarist Mick Taylor. The band then went on to perform at the Hyde Park Festival in 1969, which was a free outdoor festival held in Hyde Park on 5 July 1969. The Rolling Stones then went on to perform at the Hyde Park Festival in 2012 and the Hyde Park Festival in 2013. In 2013, The Rolling Stones played at the Hyde Park, London, on 6 and 13 July 2013.\n", "prediction 2": "The Rolling Stones have performed in Hyde Park at least three times. The band first played the venue on 5 July 1969. How many other times have they performed the venue? In 1969, The Rolling Stones performed a free concert in Hyde Park just two days after the death of founding member Brian Jones, with the gig also serving as the introduction to new guitarist Mick Taylor. The band then led a 14-song set at the Hyde Park concert on 6 July 2013. The band then led a 50 & Counting tour which finished in July 2013 with two major shows at the venue.", "prediction 3": "In 1969, The Rolling Stones performed a free concert in Hyde Park just two days after the death of founding member Brian Jones, with the gig also serving as the introduction to new guitarist Mick Taylor. In 2012, The Rolling Stones made their first public appearance in over four years on 12 July 2012 at the Marquee Club in London to commemorate the 50th anniversary of their first ever concert. The band then released a live album Hyde Park Live, which was recorded at Hyde Park, London on 6 and 13 July 2013, with two major shows at Hyde Park.", "prediction 4": "In 1969, The Rolling Stones performed a free concert at Hyde Park, London, just two days after the death of founding member Brian Jones. In 2012, The Rolling Stones traveled to Paris for two secret club gigs to celebrate the 50th anniversary of the band. The band then performed two major shows at Hyde Park.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 125, "end": 262 }, { "error type": "Redundant", "explanation": "In 1969, The Rolling Stones performed a free concert in Hyde Park ", "start": 288, "end": 330 }, { "error type": "Redundant", "explanation": "The band then went on to perform at the Hyde Park Festival in 1969, ", "start": 331, "end": 398 }, { "error type": "Unverifiable", "explanation": "", "start": 449, "end": 475 }, { "error type": "Unverifiable", "explanation": "", "start": 484, "end": 511 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Rolling Stones have played in Hyde Park several times. On 5 July, 1969, The Rolling Stones held The Stones in the Park, a free outdoor festival in Hyde Park. The Rolling Stones returned to play at Hyde Park, on 6 and 13 July 2013, for the band's 50 and Counting Tour.\n" }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many players are on the field in the cfl?", "passages": [ [ "Canadian football", "Canadian football\n\nCanadian football () is a sport played in Canada in which two teams of 12 players each compete for territorial control of a field of play long and wide attempting to advance a pointed oval-shaped ball into the opposing team's scoring area (end zone).", "In Canada, the term \"football\" may refer to Canadian football and American football collectively, or to either sport specifically, depending on context.", "The two sports have shared origins and are closely related but have some key differences.", "Rugby football in Canada originated in the early 1860s, and over time, the game known as Canadian football developed.", "Both the Canadian Football League (CFL), the sport's top professional league, and Football Canada, the governing body for amateur play, trace their roots to 1880 and the founding of the Canadian Rugby Football Union.", "The CFL is the most popular and only major professional Canadian football league.", "Its championship game, the Grey Cup, is one of Canada's largest sporting events, attracting a broad television audience.", "In 2009, about 40% of Canada's population watched part of the game; in 2014, it was closer to 33%, peaking at 5.1 million viewers in the fourth quarter." ], [ "Comparison of American and Canadian football", "American teams use eleven players, while Canadian teams have twelve players on the field per side.", "Both games have the same number of offensive players required at the line of scrimmage, so the twelfth player in the Canadian game plays a backfield position on offence, whereas this is usually a defensive back on defence.", "Because of this, position designations of the various offensive and defensive lines vary.", "For example, there is no tight end in most formations in Canadian football (this position was phased out in 1980 in the Canadian game).", "The typical offensive arrangement in Canadian football is for there to be two slotbacks instead of the American tight end, while on the defensive end of the ball, two defensive halfbacks are used instead of one strong safety in the American game.", "The sizes of individual American and Canadian footballs can vary within specified size limitations.", "Because the ball size specifications for the CFL and NFL are nearly identical, the same ball can fall within the requirements of both.", "Historically the CFL ball was slightly larger, both because of slightly bigger specifications, but also because CFL manufacturers tended to make balls at the larger end of the allowed tolerances as opposed to NFL manufacturers who built balls to the smaller end.", "However, the CFL updated its specifications in 1985." ], [ "Cheshire Association Football League", "Cheshire Association Football League\n\nThe Cheshire Association Football League is a football competition based in Cheshire, England, which until 2007 was known as the Mid-Cheshire Association Football League.", "From season 2017\u201318, the league operates four divisions: the Premier Division, Divisions One and Two, and a Reserve Division.", "Founded in 1948, only one club (Knutsford) have maintained continuous membership since the formation of the league.", "Two other founder members have only recently left the league \u2013 Whitchurch Alport in 2012 and Barnton in the summer of 2014 .", "The Premier Division sits at step 7 of the National League Pyramid, level 11 in the English Football Pyramid.", "The constitution for season 2017\u201318 was announced at the league's AGM on 1 July 2017.", "It is:\n\n\n\n\"(The league ran only a single division from 1983 to 1987)\"" ], [ "Calcutta Football League", "Calcutta Football League\n\nThe Calcutta Football League (CFL) is a men's professional football league in Bengal.", "For sponsorship reasons, the league is officially known as the Officer's Choice Blue Calcutta Premier League.", "One of the top football leagues in the state.", "League system where several football clubs of the Indian city of Kolkata (Calcutta) participate.", "It currently consists of seven-tier pyramid system.", "Indian Football Association (IFA) conducts the CFL with 157 mostly Kolkata based clubs and units.", "Started in 1898, this league is the oldest league in Asia and regarded as one of the oldest football competitions in the world.", "There are about 8,500 directly registered players of IFA who participate in CFL.", "With the season starting 2015, the clubs were redistributed in to these six divisions:\n\nUsually in each division, the 10-team league plays a single leg, in which all teams played against each other.", "Then in the second leg, the league is divided into a top and bottom half.", "The top 5 teams played for the title while the bottom 5 played against each other to avoid relegation to a lower division.", "The most successful clubs participating in the top-tier of the league includes East Bengal Club, Mohun Bagan and Mohammedan Sporting Club.", "However, since 1982, the league has been won by either East Bengal or Mohun Bagan." ], [ "Association football", "Association football\n\nAssociation football, more commonly known as football or soccer, is a team sport played with a spherical ball between two teams of eleven players.", "It is played by 250 million players in over 200 countries and dependencies, making it the world's most popular sport.", "The game is played on a rectangular field called a pitch with a goal at each end.", "The object of the game is to score by moving the ball beyond the goal line into the opposing goal.", "Association football is one of a family of football codes, which emerged from various ball games played worldwide since antiquity.", "The modern game traces its origins to 1863 when the Laws of the Game were originally codified in England by The Football Association.", "Players are not allowed to touch the ball with hands or arms while it is in play, except for the goalkeepers within the penalty area.", "Other players mainly use their feet to strike or pass the ball, but may also use any other part of their body except the hands and the arms.", "The team that scores most goals by the end of the match wins.", "If the score is level at the end of the game, either a draw is declared or the game goes into extra time or a penalty shootout depending on the format of the competition.", "Association football is governed internationally by the International Federation of Association Football (FIFA; ), which organises World Cups for both men and women every four years." ] ], "gold": "Canadian football games, such as those played in the CFL, or Canadian Football League, involve two teams of 12 players each on the field during play. This is different to American football, which features two teams of 11 players instead. Football leagues outside of North America, such as the Calcutta Football League and the Cheshire Association Football League, also play with two teams of 11 players. However, they are playing a different sport, referred to in North America as soccer.", "prediction 1": "The Canadian Football League is a professional football league in Canada in which two teams of 12 players each compete for territorial control of a field of play long and wide attempting to advance a pointed oval-shaped ball into the opposing team's scoring area (end zone). Both games have the same number of offensive players required at the line of scrimmage, so the twelfth player in the Canadian game plays a backfield position on offence, whereas this is usually a defensive back on defence. The Calcutta Football League is a men's professional football league in Bengal.\n", "prediction 2": "The Canadian Football League is a major professional American football league in which two teams of 12 players each compete for territorial control of a field of play long and wide attempting to advance a pointed oval-shaped ball into the opposing team's scoring area (end zone). Similar to the American Football league, the CFL has no minimum player size restriction as most joints are wireless.", "prediction 3": "Canadian Football League is a professional football league in Canada that features two teams of 12 players, each competing to advance a pointed oval-shaped ball into the opposing team's scoring area, known as the end zone. While American football teams use 11 players on the field, Canadian teams have 12 players on the field per side.", "prediction 4": "In Canadian football, teams of two players each compete for territorial control of a field of play long and wide attempting to advance a pointed oval-shaped ball into the opposing team's scoring area. The number of players on the field in the Canadian Football League is 12. The twelfth player often plays a backfield position on offense, whereas in American football there is one strong safety, and in the Canadian game there are two slotbacks.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 119, "end": 145 }, { "error type": "Irrelevant", "explanation": "", "start": 162, "end": 274 }, { "error type": "Irrelevant", "explanation": "", "start": 275, "end": 497 }, { "error type": "Irrelevant", "explanation": "", "start": 527, "end": 578 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] } ], "corrected-prediction": "The Canadian Football League is a professional football league in Canada in which two teams of 12 players each compete on a field of play. American football features two teams of 11 players instead. Other leagues by the same name, the Calcutta Football League and the Cheshire Association Football League, also play with two teams of 11 players. " }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Where was the man with the withered hand healed?", "passages": [ [ "Luke 6", "Evangelical writer Jeremy Myers suggests this could have been the day of Shavuot (Festival of Weeks), which would give the action of Jesus an added significance.", "Only the priests were allowed to collect wheat and process it on the Sabbath to bake the showbread (which they could eat).", "Jesus extends this privilege to his disciples: in essence, in his teaching, priesthood is open to all.", "This action represents a radical departure from traditional ways and structures, and undermines the special status of the priests.", "The story is told in the synoptic gospels (, , ).", "In the synagogue, Jesus calls forward a man with a withered hand on a Sabbath.", "Healing him by the verbal command: \"Stretch forth thy hand\", he challenges the priestly authorities.", "They do not argue with him directly, but are \"in anger\" (New Life Version, NLV).", "On the Sabbath they begin to plot against Jesus, ignoring his question: \"I will ask you one thing.", "Does the Law say to do good on the Day of Rest or to do bad?", "To save life or to kill?\" (NLV)." ], [ "Healing the man with a withered hand", "Healing the man with a withered hand\n\nHealing the man with a withered hand is one of the miracles of Jesus in the Gospels, namely in Matthew 12:9-13, Mark 3:1-6, and Luke 6:6-11.", "On a Sabbath when Jesus went into the synagogue, the Pharisees and the teachers of the law were looking for a reason to accuse him, so they watched him closely to see if he would heal on the Sabbath and they asked him: \"Is it lawful to heal on the Sabbath?\"", "According to the Gospel of Matthew:\nHe said to them, \"If any of you has a sheep and it falls into a pit on the Sabbath, will you not take hold of it and lift it out?", "How much more valuable is a man than a sheep!", "Therefore it is lawful to do good on the Sabbath.\"", "Then he said to the man, \"Stretch out your hand.\"", "So he stretched it out and it was completely restored, just as sound as the other.", "According to the Gospel of Mark, the Pharisees then went out and began to plot with the Herodians how they might kill Jesus.", "This miracle is the subject of the spoken sermon portion of composer John Adams' \"Christian Zeal and Activity\"." ], [ "Miracles of Jesus", "In this miracle, Jesus cured a man with dropsy at the house of a prominent Pharisee on the Sabbath.", "Jesus justified the cure by asking: \"If one of you has a child or an ox that falls into a well on the Sabbath day, will you not immediately pull it out?\"", "In the Healing of the man with a withered hand miracle, the Synoptics state that Jesus entered a synagogue on Sabbath, and found a man with a \"withered\" hand there, whom Jesus healed, having first challenged the people present to decide what was lawful for Sabbath\u2014\"to do good or to do evil, to save life or to kill\".", "The Gospel of Mark adds that this angered the Pharisees so much that they started to contemplate killing Jesus.", "The Healing the deaf mute of Decapolis miracle only appears in the Gospel of Mark.", "The Gospel states that Jesus went to the Decapolis and met a man there who was deaf and mute, and cured him.", "Specifically, Jesus first touched the man's ears, and touched his tongue after spitting, and then said Ephphatha!, an Aramaic word meaning \"Be opened.\"", "The Healing of Malchus was Christ's final miracle before his resurrection." ] ], "gold": "The story of the healing of the man with the withered hand is told in the synoptic gospels of Matthew 12:9-13, Mark 3:1-6, and Luke 6:6-11. In a synagogue, Jesus calls forward a man with a withered hand on the Sabbath. Healing him by the verbal command, \"Stretch forth thy hand,\" he challenges the priestly authorities. The priestly authorities do not argue with him directly, but they are \"in anger.\"", "prediction 1": "Healing the man with a withered hand is one of the miracles of Jesus in the Gospels. In Matthew 12:9-13, Mark 3:1-6, and Luke 6:6-11, the Synoptics state that Jesus entered a synagogue on Sabbath, and found a man with a \"withered\" hand there, whom Jesus healed, having first challenged the people present to decide what was lawful for Sabbath\u2014\"to do good or to do evil, to save life or to kill.\" The Gospel of Mark states that Jesus went to the Decapolis and met a man there who was deaf and mute, and cured him.\n", "prediction 2": "Healing the man with a withered hand is one of the miracles of Jesus in the Gospels, namely in Matthew 12:9-13, Mark 3:1-6, and Luke 6:6-11. In the synagogue, Jesus calls forward a man with a withered hand on a Sabbath. Healing him by the verbal command: \"Stretch forth thy hand\", he challenges the priestly authorities, and they do not argue with him directly, but are \"in anger\" (NLV).", "prediction 3": "In the synagogue, Jesus calls forward a man with a withered hand on a Sabbath. Healing him by the verbal command: \"Stretch forth thy hand\", he challenges the priestly authorities. They do not argue with him directly, but are \"in anger\". Then he said to the man, \"Stretch out your hand.\" So he stretched it out and it was completely restored, just as sound as the other.", "prediction 4": "The healing of a \"wounded out\" man is described in the book of Mark as \"being done in the name of the Lord, and done by his own hand\". This miracle is central to the teachings of Jesus that he was a Messiah, and he served as the Head of the Jewish religious establishment from 5:10 to 21. Jesus was the first to heal a \"wounded out\" man, and he was left with a \"wounded out\" hand.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 84 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 395 }, { "error type": "Irrelevant", "explanation": "", "start": 396, "end": 513 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "In Matthew 12:9-13, Mark 3:1-6, and Luke 6:6-11, the Synoptics state that Jesus entered a synagogue on Sabbath, and found a man with a \"withered\" hand there, whom Jesus healed. Healing him by the verbal command: \"Stretch forth thy hand\", he challenges the priestly authorities. The priests do not argue with Jesus directly, but are \"in anger\"." }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "What is it when you see faces in everything?", "passages": [ [ "Apophenia", "Apophenia\n\nApophenia () is the tendency to mistakenly perceive connections and meaning between unrelated things.", "The term (German: \"\") was coined by psychiatrist Klaus Conrad in his 1958 publication on the beginning stages of schizophrenia.", "He defined it as \"unmotivated seeing of connections [accompanied by] a specific feeling of abnormal meaningfulness\".", "He described the early stages of delusional thought as self-referential, over-interpretations of actual sensory perceptions, as opposed to hallucinations.", "Apophenia has come to imply a universal human tendency to seek patterns in random information, such as gambling.", "Pareidolia is a type of apophenia involving the perception of images or sounds in random stimuli.", "A common example is the perception of a face within an inanimate object\u2014the headlights and grill of an automobile may appear to be \"grinning\".", "People around the world see the \"Man in the Moon\".", "People sometimes see the face of a religious figure in a piece of toast or in the grain of a piece of wood.", "Pareidolia usually occurs as a result of the fusiform face area, which is the part of the human brain that is responsible in seeing faces, mistakenly interpreting an object, shape or configuration with some kind of perceived \"face-like\" features as being a face." ] ], "gold": "Apophenia is the tendency to perceive meaningful connections between unrelated things. Pareidolia is a type of apophenia involving the perception of images or sounds in random stimuli. A common example is the perception of a face within an inanimate object\u2014the headlights and grill of an automobile may appear to be \"grinning.\" ", "prediction 1": "Apophenia is the tendency to mistakenly perceive connections and meaning between unrelated things. Apophenia has come to imply a universal human tendency to seek patterns in random information, such as gambling. Pareidolia is a type of apophenia involving the perception of images or sounds in random stimuli. A common example is the perception of a face within an inanimate object\u2014the headlights and grill of an automobile may appear to be \"grinning\". People sometimes see the face of a religious figure in a piece of toast or in the grain of a piece of wood.\n", "prediction 2": "Pareidolia, a type of apophenia, is the tendency to mistakenly perceive connections and meaning between unrelated things. It is a kind of hallucination that results from the conscious perception of faces within entities, such as creatures, people, or objects. Pareidolia occurs when the brain misunderstands an object, shape or configuration with some kind of perceived \"face-like\" features as being a face.", "prediction 3": "Pareidolia, a form of apophenia, is the tendency to mistakenly perceive connections and meaning between unrelated things. It has come to imply a universal human tendency to seek patterns in random information, such as gambling. People sometimes see the face of a religious figure in a piece of toast or in the grain of a piece of wood.", "prediction 4": "Apophenia () is the tendency to mistakenly perceive connections and meaning between unrelated things. Pareidolia is a type of apophenia involving the perception of images or sounds in random stimuli. A common example is the perception of a face within an inanimate object\u2014the headlights and grill of an automobile may appear to be \"grinning\". Pareidolia usually occurs as a result of the fusiform face area, which is the part of the human brain that is responsible in seeing faces, mistakenly interpreting an object, shape or configuration with some sort of perceived \"face-like\" features as being a face.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 99, "end": 211 }, { "error type": "Irrelevant", "explanation": "", "start": 453, "end": 561 } ], "missing-info": [], "corrected-prediction": "Apophenia is the tendency to mistakenly perceive connections and meaning between unrelated things. Pareidolia is a type of apophenia involving the perception of images or sounds in random stimuli. A common example is the perception of a face within an inanimate object\u2014the headlights and grill of an automobile may appear to be \"grinning\"." }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "Who played jenny wolek on one life to live?", "passages": [ [ "Jenny Wolek", "Jenny Wolek\n\nJenny Wolek is a fictional character from the American soap opera \"One Life to Live\".", "The distant cousin of original characters Larry, Anna, and Vince Wolek, Jenny debuted June 1975, appearing continually until May 1986.", "Jenny Wolek was originated by actress Katherine Glass in June 1975 and introduced as a novitiate nun preparing to take her final vows.", "Instead, she falls in love with Jewish, blue-collar Tim Siegel (Tom Berenger).", "When Jenny announces she is leaving the Order to marry Tim, her cousin Vince \"Vinny\" Wolek (Jordan Charney) heatedly objects, complaining of how Tim is \"stealing Jenny from the church\".", "A fist fight ensues, leading Vinny to aggravate in Tim a latent brain injury, which results in his being taken to the hospital in critical condition.", "Jenny marries Tim on his deathbed April 5, 1976, and she remains resentful toward Vinny for the duration of his appearance on the serial.", "No longer planning to become a nun, Jenny takes a secretarial job with Dr. Will Vernon (Farley Granger) in 1976.", "Jenny grows enamored with Dr. Vernon but begins dating his son Brad (Jameson Parker) in 1977.", "The two marry on the episode aired January 3, 1978." ], [ "Brynn Thayer", "Brynn Thayer\n\nBrynn Thayer (born October 4, 1949) is an American actress, known for her roles on television.", "Thayer is best known for her work on television.", "From 1978-86, she played Jenny Wolek in the ABC daytime soap opera, \"One Life to Live\".", "Thayer assumed the role in August 1978 amid a contract dispute between Katherine Glass and ABC Daytime.", "For her role on the show, she was nominated for a Daytime Emmy Award for Outstanding Supporting Actress in a Drama Series in 1983, and Soap Opera Digest Award for Outstanding Lead Actress in a Daytime Drama in 1986.", "In 1986, Thayer left \"One Life to Live\" and began a career on primetime television.", "She starred in two short-lived dramas for CBS: \"TV 101\" from 1988 to 1989, and \"Island Son\" (1989-1990).", "In 1992, she joined the cast of the ABC legal series, \"Matlock\" portraying Matlock's daughter, Leanne MacIntyre, and was a regular cast member; she was previously a guest star in the 1991 episode \"The Suspect.\"", "From 1997-98, she had regular role in the \"\".", "In film, Thayer co-starred in \"Hero and the Terror\" (1988) and \"\" (2015)." ] ], "gold": "Jenny Wolek is a fictional character from the American soap opera One Life to Live. The distant cousin of original characters Larry, Anna, and Vince Wolek, Jenny debuted June 1975, appearing continually until May 1986. The character was originally played by Katherine Glass from 1975 through 1978. She was then played by Brynn Thayer from 1978 to 1986.", "prediction 1": "Jenny Wolek is a fictional character from the American soap opera One Life to Live. The distant cousin of original characters Larry, Anna, and Vince Wolek, Jenny debuted June 1975 and was played by several actors from 1978 to 1986. American actress Brynn Thayer played Jenny Wolek from 1978 to 1986.\n", "prediction 2": "Jenny Wolek is a fictional character from the American soap opera, One Life to Live. From 1978-1986, Brynn Thayer starred as Jenny in the ABC soap opera.", "prediction 3": "From 1978-86, Brynn Thayer played Jenny Wolek in the ABC daytime soap opera, One Life to Live. Thayer, born October 4, 1949, is an American actress, best known for her work on television. She was named an Emmy Award nominee for Outstanding Supporting Actress in a Drama Series in 1983 and won an Soap Opera Digest Award for Outstanding Lead Actress in a Daytime Drama in 1986. Thayer had one episode in 1971 where she addressed the audience.", "prediction 4": "Sasha Farber and Art Vanmaast played the character of Jenny Wolek on the ABC soap opera One Life to Live. Below are clips from various episodes, from 1968-67, from 1979-82, and from 1985-1986. A close cousin of original characters Larry, Anna, and Vince Wolek originated this character.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 248 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 198, "end": 205 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "Jenny Wolek is a fictional character from the American soap opera One Life to Live. The distant cousin of original characters Larry, Anna, and Vince Wolek, Jenny debuted June 1975, appearing continually until May 1986. The character was originally played by Katherine Glass from 1975 through 1978. Brynn Thayer then played Jenny Wolek from 1978 to 1986.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang the theme song in the movie alfie?", "passages": [ [ "Cilla Black", "Black recognised that to achieve popular status in the USA she would need to devote much time to touring there.", "But she was plagued by homesickness and a sense of loneliness and returned to the UK.", "During 1966 Black recorded the Bacharach-David song \"Alfie\", written as the signature song to the 1966 feature film of the same name.", "While Cher sang \"Alfie\" on the closing credits of the American release of the film and Black on the UK version, Black was the first and only artist to have a hit with the song in the UK (No. 9).", "\"Alfie\" went on to become a success for both Cher (in 1966) and Dionne Warwick (in 1967) in the US.", "Black's version of \"Alfie\" was arranged and conducted by Bacharach himself at the recording session at Abbey Road.", "Bacharach insisted on 31 separate takes, and Black cited the session as one of the most demanding of her recording career.", "For Bacharach's part, he said \"\u2026\u00a0there weren't too many white singers around, who could convey the emotion that I felt in many of the songs I wrote but that changed with people like Cilla Black\".", "By the end of 1966, Black had been a guest on Peter Cook and Dudley Moore's show \"Not Only..." ], [ "Alfie Darling", "Alfie Darling\n\nAlfie Darling is a 1975 British comedy drama film directed by Ken Hughes.", "The film premiered at the Universal Cinema in London on 6 March 1975.", "It is the sequel to the 1966 film \"Alfie\", with Alan Price taking over Michael Caine's role of Alfie.", "Price also penned the movie title song, performed and released as a single by Cilla Black who was also the first to record the title song based on the original movie, penned by Burt Bacharach and Hal David.", "It is based on the novel of the same name by Bill Naughton (who wrote the play upon which the first film was based).", "After experiencing a failure in the ending of the earlier film, Alfie - now working as a London to France HGV driver alongside Bakey (Paul Copley) - decides to get back to his old self.", "And his new occupation provides new opportunities to do so.", "The film starts as Bakey drives the truck through customs in France, while Alfie has sex with an English hitchhiker (Vicki Michelle) in the back until the customs' officer catches her topless.", "When arriving at their destination, he spots a woman (Jill Townsend) in a sports car.", "They start racing until the police break it up." ] ], "gold": "More than one person has recorded the title song to the movie Alfie, a 1966 British romantic comedy-drama starring Michael Caine. The theme song, or title song, is also called Alfie. For the US release of the film, Cher sung the theme song over the film's closing credits. Millicent Martin sung the theme song for the British release of the film.", "prediction 1": "Alfie Darling is a 1975 British comedy drama film directed by Ken Hughes. In the movie, Alfie, the theme song was sung by Cilla Black.\n", "prediction 2": "Alfie is a 1975 British comedy drama film written by Burt Bacharach and Hal David. The movie features Michael Caine as Alfie in a new life as a London to France HGV driver. However, in the movie Alfie Darling, Alfie is sung by Cilla Black as the theme song.", "prediction 3": "In the 1976 movie Alfie, Michael Caine played the role of Alfie, but Alan Price penned the lyrics. While Cher sang Alfie on the closing credits of the American release of the film, Cilla Black sang the UK version. Alfie Darling is a 1975 British comedy drama film directed by Ken Hughes. It is the sequel to the 1966 film of the same name and is based on the play of the same name. It stars Alan Price and Cilla Black on the lead roles.", "prediction 4": "Alfie Darling is a British 1975 comedy drama film which is the sequel to the 1966 movie. In the 1975 film, Alfie, Michael Caine reprises his role as Alfie but with the role taken over by Alan Price. The 1978 song was sung by Burt Bacharach and Hal David and performed and released as a single by Cilla Black. Price also penned the movie title song, performed and released as a single by Cilla Black.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 73 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "More than one person has recorded the title song to the movie Alfie, a 1966 British comedy drama film starring Michael Caine. Cilla Black recorded the song \"Alfie\", written as the signature song to the 1966 feature film of the same name. While Cher sang \"Alfie\" on the closing credits of the American release of the film, Black sang on the UK version." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "When did star wars the last jedi cone out?", "passages": [ [ "Star Wars: The Last Jedi", "\"The Last Jedi\" is part of a new trilogy of films announced after Disney's acquisition of Lucasfilm in October 2012.", "It was produced by Lucasfilm President Kathleen Kennedy and Ram Bergman, with \"Force Awakens\" director J. J. Abrams as an executive producer.", "John Williams, composer for the previous films, returned to compose the score.", "A number of scenes were filmed at Skellig Michael in Ireland during pre-production in September 2015, but principal photography began at Pinewood Studios in the United Kingdom in February 2016, and ended in July 2016.", "Post-production wrapped in September 2017.", "\"The Last Jedi\" had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "It grossed over $1.3billion worldwide, becoming the highest-grossing film of 2017, the seventh-highest-ever grossing film in North America and the ninth-highest-grossing film of all time during its theatrical run.", "It is also the second-highest-grossing film of the \"Star Wars\" franchise, and turned a net profit of over $417\u00a0million.", "It was positively received by film critics, who praised the ensemble cast, visual effects, musical score, action sequences and emotional weight." ] ], "gold": "Star Wars the Last Jedi had an early premiere viewing at the Shrine Auditorium in Los Angeles on December 9, 2017. It was later released across the United States on December 15, 2017, becoming the seventh-highest-ever grossing film in North America. ", "prediction 1": "The Last Jedi had its world premiere at the Dolby Theatre in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "prediction 2": "The Last Jedi had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017. It grossed over $1.3billion worldwide.", "prediction 3": "Star wars The Last Jedi had its world premiere at the Shrine Auditorium in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "prediction 4": "The Last Jedi had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 44, "end": 57 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] } ], "corrected-prediction": "Star Wars: The Last Jedi had its world premiere in Los Angeles on December 9, 2017, and was released in the United States on December 15, 2017, becoming the seventh-highest-ever grossing film in North America." }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "When was the last time usa declared war?", "passages": [ [ "Declaration of war by the United States", "Declaration of war by the United States\n\nA declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another.", "The document Declarations of War and Authorizations for the Use of Military Force: Historical Background and Legal Implications gives an extensive\nlisting and summary of statutes which are automatically engaged upon the US declaring war.", "For the United States, of the Constitution says \"Congress shall have power to ... declare War.\"", "However, that passage provides no specific format for what form legislation must have in order to be considered a \"declaration of war\" nor does the Constitution itself use this term.", "In the courts, the United States Court of Appeals for the First Circuit, in \"Doe v. Bush\", said: \"[T]he text of the October Resolution itself spells out justifications for a war and frames itself as an 'authorization' of such a war.\"", "in effect saying an authorization suffices for declaration and what some may view as a formal Congressional \"Declaration of War\" was not required by the Constitution.", "The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania, because President Franklin Roosevelt thought it was improper to engage in hostilities against a country without a formal declaration of war." ], [ "Declaration of war", "63, the King, with prior authorization by the Parliament, has the power to declare war and make peace.", "According to 2010:1408 15 kap.", "14 \u00a7 entitled \"Krigsf\u00f6rklaring\" (declaration of war) the Swedish cabinet (regeringen) may not declare Sweden to be at war without the parliaments (riksdagen) consent unless Sweden is first attacked.", "In the United States, Congress, which makes the rules for the military, has the power under the constitution to \"declare war\".", "However neither the U.S. Constitution nor any Act of Congress stipulate what format a declaration of war must take.", "War declarations have the force of law and are intended to be executed by the President as \"commander in chief\" of the armed forces.", "The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "Since then, the US has used the term \"authorization to use military force\", as in the case against Iraq in 2003.", "Sometimes decisions for military engagements were made by US presidents, without formal approval by Congress, based on UN Security Council resolutions that do not expressly declare the UN or its members to be at war." ], [ "Declaration of war by the United States", "After Congress repealed the Gulf of Tonkin Resolution in January 1971 and President Richard Nixon continued to wage war in Vietnam, Congress passed the War Powers Resolution () over the veto of Nixon in an attempt to rein in some of the president's claimed powers.", "The War Powers Resolution proscribes the only power of the president to wage war which is recognized by Congress.", "The table below lists the five wars in which the United States has formally declared war against eleven foreign nations.", "The only country against which the United States has declared war more than once is Germany, against which the United States has declared war twice (though a case could be made for Hungary as a successor state to Austria-Hungary).", "In World War II, the Japanese attacked Pearl Harbor on December 7, 1941.", "Germany and Italy, led respectively by Adolf Hitler and Benito Mussolini, declared war on the United States, and the U.S. Congress responded in kind.", "In other instances, the United States has engaged in extended military combat that was authorized by Congress.", "In many instances, the United States has engaged in extended military engagements that were authorized by United Nations Security Council Resolutions and funded by appropriations from Congress.", "On at least 125 occasions, the President has acted without prior express military authorization from Congress." ] ], "gold": "The last time the United States formally declared war was on June 5, 1942, against the Axis, in World War II. ", "prediction 1": "The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania, because President Franklin Roosevelt thought it was improper to engage in hostilities against a country without a formal declaration of war. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.\n", "prediction 2": "In the United States, Congress, which makes the rules for the military, has the power under the constitution to \"declare war\". However neither the U.S. Constitution nor any Act of Congress stipulate what format a declaration of war must take. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania. A declaration of war is a formal declaration issued by a national government indicating that a state of war exists between that nation and another. The last time the United States formally declared war, using specific terminology, was in 1942.", "prediction 3": "The last time the United States formally declared war, using specific terminology, on any nation was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania. The last time Congress passed joint resolutions saying that a \"state of war\" existed was on June 5, 1942, when the U.S. declared war on Bulgaria, Hungary, and Romania.", "prediction 4": "The last time the United States formally declared war, using specific terminology, on any nation was on June 5, 1942, when the US declared war against Axis-allied Hungary, Bulgaria and Romania. This was because President Franklin Roosevelt thought it was improper to engage in hostilities against a country without a formal declaration of war.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 55, "end": 82 }, { "error type": "Irrelevant", "explanation": "", "start": 184, "end": 324 }, { "error type": "Redundant", "explanation": "The last time the United States formally declared war, using specific terminology, on any nation was ", "start": 325, "end": 413 }, { "error type": "Redundant", "explanation": "when war was declared against Axis-allied Hungary, Bulgaria, and Romania,", "start": 431, "end": 493 }, { "error type": "Irrelevant", "explanation": "", "start": 83, "end": 96 }, { "error type": "Redundant", "explanation": "in 1942", "start": 414, "end": 430 } ], "missing-info": [], "corrected-prediction": "The last time the United States formally declared war was in 1942, when war was declared against Axis-allied Hungary, Bulgaria, and Romania." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did the consumer rights act come into force?", "passages": [ [ "Consumer Rights Act 2015", "Consumer Rights Act 2015\n\nThe Consumer Rights Act 2015 is an Act of Parliament of the United Kingdom that consolidates existing consumer protection law legislation and also gives consumers a number of new rights and remedies.", "Provisions for secondary ticketing and lettings came into force on 27 May 2015 and provisions for alternative dispute resolution (ADR) came into force on 9 July 2015 as per the EU Directive on consumer ADR.", "Most other provisions came into force on 1 October 2015.", "The Act replaces the Sale of Goods Act, Unfair Terms in Consumer Contracts Regulations 1999 and the Supply of Goods and Services Act 1982, making some changes to rights to return faulty goods for refund, replacement or repair, and adding new rights on the purchase of digital content.", "The Act is split into three parts:\n\nThe Act was introduced to parliament by Jo Swinson MP, then parliamentary under-Secretary in the Department of Business, Innovation and Skills, on 23 January 2014 with the aim of consolidating and updating consumer protection law and to therefore provide a \"modern framework of consumer rights.\"" ], [ "Dodd\u2013Frank Wall Street Reform and Consumer Protection Act", "Dodd\u2013Frank Wall Street Reform and Consumer Protection Act\n\nThe Dodd\u2013Frank Wall Street Reform and Consumer Protection Act (, , commonly referred to as Dodd\u2013Frank) was signed into United States federal law by US President Barack Obama on July 21, 2010.", "Passed in response to the 2008 global financial crisis, the Act brought the most significant changes to financial regulation in the nation since the regulatory reform that came following the Great Recession.", "It made changes in the American financial regulatory environment affecting all federal financial regulatory agencies and almost every part of the nation's financial services industry.", "The law was initially proposed by the Obama administration in June 2009, when the White House sent several proposed bills to Congress.", "The legislation was introduced in the House in July 2009.", "On December 2, 2009, revised versions of the bill were introduced in the House of Representatives by then\u2013financial services committee chairman Barney Frank, and in the Senate Banking Committee by former chairman Chris Dodd.", "Dodd and Frank were both involved with the bill; the conference committee that reported on June 25, 2010, voted to name the bill after both men.", "Studies have found the Dodd\u2013Frank Act has improved financial stability and consumer protection, although there has been debate regarding its economic effects." ] ], "gold": "Several countries have consumer rights acts in place to protect consumers. The Dodd-Frank Wall Street Reform and Consumer Protection Act came into force on July 21, 2010. It is a law of the United States that was enacted to overhaul the current financial regulations in the aftermath of the financial crisis of 2007-2008. The Consumer Rights Act 2015 came into force on 27 May 2015, which is a law of the United Kingdom that gives consumers more rights and remedies.", "prediction 1": "The Consumer Rights Act 2015 is an Act of Parliament of the United Kingdom that consolidates existing consumer protection law legislation and also gives consumers a number of new rights and remedies. Provisions for secondary ticketing and lettings came into force on 27 May 2015 and provisions for alternative dispute resolution (ADR) came into force on 9 July 2015 as per the EU Directive on consumer ADR. Most other provisions came into force on 1 October 2015. The Dodd\u2013Frank Wall Street Reform and Consumer Protection Act was signed into United States federal law by US President Barack Obama on July 21, 2010.\n", "prediction 2": "The Consumer Rights Act 2015 was first introduced into the UK Parliament on 23 January 2014. It replaced the Sale of Goods Act, Unfair Terms in Consumer Contracts Regulations 1999 and the Supply of Goods and Services Act 1982, taking effect on 7 March 2015. On 21 July 2010, the Dodd-Frank Wall Street Reform and Consumer Protection Act, commonly referred to as Dodd\u2013Frank, was signed into United States federal law by US President Barack Obama. Provisions for secondary ticketing and lettings came into force on 27 May 2015 and provisions for alternative dispute resolution (ADR) came into force on 9 July 2015, as per the EU Directive on consumer ADR. Most other provisions came into force on 1 October 2015.", "prediction 3": "The Consumer Rights Act 2015 was introduced to parliament on 23 January 2014, with the aim of consolidating existing consumer protection law and to therefore provide a \"modern framework of consumer rights\". The Act was then passed by the House of Commons on 3 September 2014. The Dodd\u2013Frank Wall Street Reform and Consumer Protection Act was signed into US federal law by US President Barack Obama on July 21, 2010.", "prediction 4": "The Consumer Rights Act 2015 was officially passed by Parliament on 2 April 2015. Provisions for secondary ticketing and lettings came into force on 27 May 2015, and provisions for alternative dispute resolution (ADR) came into force on 9 July 2015, as per the EU Directive on consumer ADR. Most other provisions came into force on 1 October 2015.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 199 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 406 } ], "missing-info": [], "corrected-prediction": "The Consumer Rights Act 2015 is an Act of Parliament of the United Kingdom. Provisions for secondary ticketing and lettings came into force on 27 May 2015 and provisions for alternative dispute resolution (ADR) came into force on 9 July 2015. Most other provisions came into force on 1 October 2015. The Dodd\u2013Frank Wall Street Reform and Consumer Protection Act was signed into United States federal law by US President Barack Obama on July 21, 2010.\n" }, "preference": [ 1, 1, 1, 2, 1, 1 ] }, { "question": "Who played the professor in gilligan's island?", "passages": [ [ "The Professor (Gilligan's Island)", "The Professor (Gilligan's Island)\n\nRoy Hinkley, referred to as the Professor, is one of the seven castaways from the television series \"Gilligan's Island\" (1964\u201367); he was played by Russell Johnson.", "The character was originally played by John Gabriel in the pilot episode, but the network thought he looked too young to have all the degrees attributed to the Professor.", "The Professor's backstory identifies him as Roy Hinkley (though his actual name is rarely mentioned during the series), a high-school science teacher who was born in Cleveland, Ohio.", "His principal expertise was as a botanist, whose purpose in joining the ill-fated voyage that stranded the castaways was to write a book to be titled \"Fun With Ferns\".", "His main function on the show was to devise many ways for the castaways to live more comfortably on the island.", "Many of his inventions (including a method for recharging the batteries in the ubiquitous radio) used coconuts and bamboo, both of which were in plentiful supply.", "Aside from his proficiency in science, he was also adept and well-versed in law, literature, social sciences, and the arts." ], [ "Gilligan's Island", "Gilligan's Island\n\nGilligan's Island is an American sitcom created and produced by Sherwood Schwartz.", "The show had an ensemble cast that featured Bob Denver, Alan Hale Jr., Jim Backus, Natalie Schafer, Russell Johnson, Tina Louise, and Dawn Wells.", "It aired for three seasons on the CBS network from September 26, 1964, to April 17, 1967.", "The series followed the comic adventures of seven castaways as they attempted to survive the island on which they had been shipwrecked.", "Most episodes revolve around the dissimilar castaways' conflicts and their unsuccessful attempts, for whose failure Gilligan was frequently responsible, to escape their plight.", "\"Gilligan's Island\" ran for a total of 98 episodes.", "The first season, consisting of 36 episodes, was filmed in black and white.", "These episodes were later colorized for syndication.", "The show's second and third seasons (62 episodes) and the three television movie sequels (aired between 1978 and 1982) were filmed in color.", "The show received solid ratings during its original run, then grew in popularity during decades of syndication, especially in the 1970s and 1980s when many markets ran the show in the late afternoon.", "Today, the title character of Gilligan is widely recognized as an American cultural icon." ] ], "gold": "The Gilligan's Island character Ron Hinkley, referred to as the Professor, was played by John Gabriel in the show's 1963 pilot episode. However, CBS thought he looked too young to have all the degrees attributed to the Professor. He was replaced by Russell Johnson, who played the Professor from 1964 until 1983.", "prediction 1": "The character of the Professor in the television series Gilligan's Island was played by several actors. John Gabriel played the character in the pilot episode, but the network thought he looked too young to have all the degrees attributed to the Professor. Russell Johnson played the character in the second and third seasons of the show.\n", "prediction 2": "The character of Professor Roy Hinkley in Gilligan's Island was played by several actors. John Gabriel played the role of the scientist Professor in the pilot episode. Russell Johnson played the role during the second and third seasons of the show.", "prediction 3": "The character of Professor Gilligan in the television sitcom Gilligan's Island is played by a number of actors. The first person to play the character was John Gabriel, who played the character for two seasons in an episode of the pilot. Russell Johnson played the character for three seasons and a total of 118 episodes.", "prediction 4": "Roy Hinkley, referred to as the Professor, is one of the seven castaways from the television series Gilligan's Island (1964\u201367) and was played by Russell Johnson. The character was originally played by John Gabriel in the pilot episode, but the network thought he looked too young to have all the degrees attributed to the Professor. The Professor's backstory identifies him as Roy Hinkley, a high-school science teacher, born in Cleveland, Ohio. His principal expertise was as a botanist, whose purpose in joining the ill-fated voyage that stranded the castaway was to write a book to be titled \"Fun With Ferns\". His main function on the show was to devise many ways for the castaways to live more comfortably on the Island.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 294, "end": 325 } ], "missing-info": [], "corrected-prediction": "The character of the Professor, in the television series Gilligan's Island, was played by two actors. John Gabriel played the character in the pilot episode, but the network thought he looked too young to have all the degrees attributed to the Professor. Russell Johnson played the character afterwards from 1964 to 1967.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "Top 5 leadership positions in the house of representatives?", "passages": [ [ "Party leaders of the United States House of Representatives", "Party leaders of the United States House of Representatives\n\nParty leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot.", "With the Republicans holding a majority of seats and the Democrats holding a minority, the current leaders are: Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "Unlike in Westminster style legislatures or as with the Senate Majority Leader, the House Majority Leader's duties and prominence vary depending upon the style and power of the Speaker of the House.", "Typically, the Speaker does not participate in debate and rarely votes on the floor.", "In some cases, Majority Leaders have been more influential than the Speaker; notably, Tom DeLay was more prominent than Speaker Dennis Hastert.", "In addition, Speaker Newt Gingrich delegated to Dick Armey an unprecedented level of authority over scheduling legislation on the House floor.", "The current Minority Leader Nancy Pelosi serves as floor leader of the opposition party, and is the counterpart to the Majority Leader.", "Unlike the Majority Leader, the Minority Leader is on the ballot for Speaker of the House during the convening of the Congress." ] ], "gold": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. The top 5 leadership positions for the majority party in the House of Representative are the Speaker, Majority Leader, Majority Whip, Asst. Speaker, and Caucus Chairman. The top 5 leadership positions for the minority party on the House of Representatives are the Minority Leader, Minority Whip, Conference Chairperson, Committee Chairman, and Conference Secretary.", "prediction 1": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. With the Republicans holding a majority of seats and the Democrats holding a minority, the current leaders are: Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.\n", "prediction 2": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. With the Democrats holding a majority of the seats in the House of Representatives, the current leaders are Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi and Minority Whip Steny Hoyer.", "prediction 3": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. Currently, there are 5 leadership positions in the United States House of Representatives. Majority Leader Kevin McCarthy is the current leader, Majority Whip Steve Scalise is the current leader, Minority Leader Nancy Pelosi is the current leader, and Minority Whip Steny Hoyer is the current leader.", "prediction 4": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. With the Democrats holding a majority of the seats in the House, the current leadership positions are Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 182, "end": 268 } ], "missing-info": [], "corrected-prediction": "Party leaders and whips of the United States House of Representatives, also known as floor leaders, are elected by their respective parties in a closed-door caucus by secret ballot. The current leaders are: Majority Leader Kevin McCarthy, Majority Whip Steve Scalise, Minority Leader Nancy Pelosi, and Minority Whip Steny Hoyer.\n" }, "preference": [ 1, 1, 1, 1, 0, 2 ] }, { "question": "Who is seated at the right hand of god?", "passages": [ [ "Right hand of God", "Right hand of God\n\nThe right hand of God (\"Dextera Domini\" \"right hand of the Lord\" in Latin) or God's right hand may refer to the Bible and common speech as a metaphor for the omnipotence of God and as a motif in art.", "In the Bible, to be at the right side \"is to be identified as being in the special place of honor\".", "In Jesus' The Sheep and the Goats, the sheep and goats are separated with the sheep on the right hand of God and the goats on the left hand.", "It is also a placement next to God in Heaven, in the traditional place of honor, mentioned in the New Testament as the place of Christ at Mark 16:19, Luke 22:69, Matthew 22:44 and 26:64, Acts 2:34 and 7:55, 1 Peter 3:22 and elsewhere.", "These uses reflect use of the phrase in the Old Testament, for example in Psalms 63:8 and 110:1.", "The implications of this anthropomorphic phrasing have been discussed at length by theologians, including Saint Thomas Aquinas." ], [ "Session of Christ", "Session of Christ\n\nThe Christian doctrine of the Session of Christ or heavenly session says that Jesus Christ is seated at the right hand of God the Father in Heaven\u2014the word \"session\" is an archaic noun meaning \"sitting.\"", "Although the word formerly meant \"the act of sitting down,\" its meaning is somewhat broader in current English usage, and is used to refer to a sitting for various reasons, such as a teaching session, or a court or council being in session.", "The New Testament also depicts Jesus as standing and walking in Heaven, but the Session of Christ has special theological significance because of its connection to the role of Christ as King.", "The Session of Christ is one of the doctrines specifically mentioned in the Apostles' Creed, where \"\"sitteth on the right hand of God the Father Almighty\"\" immediately follows the statement of the Ascension.", "According to the Book of Acts, , after Jesus' resurrection and ascension, he was \"exalted to the right hand of God.\"", "Preaching on the Day of Pentecost, Peter saw Jesus' exaltation as a fulfilment of Psalm 110:1, \"The LORD says to my Lord: \"Sit at my right hand until I make your enemies a footstool for your feet.\"", "\" In the Bible, the \"right hand\" is the special place of honour." ] ], "gold": "In the Bible, to be at the right side \"is to be identified as being in the special place of honor\". In Jesus' The Sheep and the Goats, the sheep and goats are separated with the sheep on the right hand of God and the goats on the left hand. The right hand of God also refers to a placement next to God in Heaven, in the traditional place of honor, mentioned in the New Testament as the place of Christ.", "prediction 1": "The right hand of God, or God's right hand, may refer to the Bible and common speech as a metaphor for the omnipotence of God and as a motif in art. In the Bible, to be at the right side \"is to be identified as being in the special place of honor\". The Christian doctrine of the Session of Christ or heavenly session says that Jesus Christ is seated at the right hand of God the Father in Heaven\u2014the word \"session\" is an archaic noun meaning \"sitting.", "prediction 2": "The right hand of God, also called Deuteronomy 8, is a metaphor for God's omnipotence, or a place of honor. Jesus Christ is the one who is seated at the right hand of God the Father in Heaven according to the doctrine of the Session of Christ.", "prediction 3": "The Christian doctrine of the Session of Christ, or heavenly session, says that Jesus Christ is seated at the right hand of God the Father in Heaven. Christians believe that Jesus is seated at the right hand of God the Father in Heaven. The word \"session\" is an archaic noun meaning \"sitting.\"", "prediction 4": "The right hand of God in the Bible is a metaphor for the omnipotence and a motif in art. The Session of Christ is the Christian doctrine that says Jesus Christ is seated at the right hand of God the Father in Heaven, in the traditional place of honor.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 148 }, { "error type": "Irrelevant", "explanation": "", "start": 375, "end": 451 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "In the Bible, to be at the right side \"is to be identified as being in the special place of honor\". In Jesus' The Sheep and the Goats, the sheep and goats are separated with the sheep on the right hand of God and the goats on the left hand. It is also a placement next to God in Heaven, in the traditional place of honor, mentioned in the New Testament as the place of Christ. The Christian doctrine of the Session of Christ or heavenly session says that Jesus Christ is seated at the right hand of God the Father in Heaven." }, "preference": [ 1, 2, 2, 2, 2, 1 ] }, { "question": "When did the first indian expedition to antarctica take place?", "passages": [ [ "Indian Antarctic Program", "The 'ice cores' retrieved by drilling holes in Antarctic's vast ice-sheets yield information 'on the palaeoclimate and eco-history of the earth as records of wind-blown dust, volcanic ash or radioactivity are preserved in the ice as it gets accumulated over time'.", "The NCAOR developed a polar research & development laboratory with a 'low-temperature laboratory complex at \u221220\u00a0\u00b0C for preservation and analysis of ice core and snow samples' according to S.D. Gad (2008).", "The 'ice core' samples are held, processed, and analyzed in containment units designed by such technology.", "Storage cases made of poly propylene also ensure that the samples do not alter characteristics and are preserved for analysis in the form that they were recovered.", "In 1981 the Indian flag unfurled for the first time in Antarctica, marking the start of Southern Ocean expeditions under the environmental protocol of the Antarctic Treaty (1959).", "The first permanent settlement was built in 1983 and named Dakshin Gangotri.", "In 1989 it was excavated and is being used again as supply base and transit camp.", "The second permanent settlement, Maitri, was put up in 1989 on the Schirmacher Oasis and has been conducting experiments in geology, geography and medicine.", "India built a freshwater lake around Maitri known as Lake Priyadarshini." ], [ "Giri Raj Singh Sirohi", "Giri Raj Singh Sirohi\n\nGiri", "Raj Singh Sirohi was the first Indian to set foot on Antarctica.", "Sirohi is a scientist who carried out research at the South Pole in Antarctica in 1960 for around 100 days in sub-zero temperatures.", "Sirohi received the lifetime award from the Indian Society for Plant Physiology in 2003.", "To honour his breakthrough contribution to the Science of Plant Physiology, the US Government instructed the United States Board on Geographic Names to name a place in Antarctica after him as \"Sirohi Point\" in 1961.", "The objective of the experiments was to collect data on the Biological Clock at the South Pole, since it represented a place where the rotational activity of the Earth could be negated.", "The plant material (soybeans, etc.) and animal material (hamsters, etc.) were studied at the South Pole.", "Project work took almost 12 months, out of which 4 months were spent at the South Pole in Antarctica.", "He co-authored a book on plant-physiology." ], [ "Narendra Kumar (mountaineer)", "In 1970 he led the first recognised ascent of 23,997\u00a0ft Jomolhari(Chomo Lhari), the highest mountain in Bhutan.", "Kumar successfully climbed the Kangchenjunga from the toughest north-east spur in 1976.", "Kumar followed up his 1981 Siachen feats with the challenge, as Antarctica Task Force member, of acclimatising the First Indian Expedition there, led by Dr. S. Z. Qasim in 1982.", "Training was carried out at Dras, where temperatures touch minus 56 degrees Celsius.", "In 1983, Kumar conquered Kamet (25,595\u00a0ft) and Abi Gamin (24,272\u00a0ft).", "He superannuated on 1 January 1984 but that did not slow him down.", "Later,Kumar was put in \"permanent category C\" by the Indian Army, which meant no postings above 7,000\u00a0ft.", "Every time he was in the mountains, he had to give the government a non-liability certificate saying that he absolve them of all responsibilities should anything happen to him.", "He has entered the oxygen-depleted death zone above 8,000 m, twenty times.", "He spent 35 years in the Indian Army.", "Lieutenant General V. R. Raghavan, commanding officer of Operation Meghdoot, called Colonel Kumar 'a mountain of information'." ] ], "gold": "The first Indian expedition led by an Indian to Antarctica began in 1960 and ended in 1961. The first Indian expedition to Antarctica led by a group of Indians began in 1981 and ended in 1982.", "prediction 1": "Giri Raj Singh Sirohi was the first Indian to set foot on Antarctica. Giri Raj Singh Sirohi carried out research at the South Pole in Antarctica in 1960 for around 100 days in sub-zero temperatures. The first permanent settlement was built in 1983 and named Dakshin Gangotri. In 1989 it was excavated and is being used again as supply base and transit camp. The first permanent settlement, Maitri, was put up in 1989 on the Schirmacher Oasis and has been conducting experiments in geology, geography and medicine.\n", "prediction 2": "First Indian Expedition to Antarctica took place in 1981 under the auspices of the Antarctic Treaty. Giri Raj Singh Sirohi was the first Indian to set foot on Antarctica. Himachal Pradesh Chief Minister Narendra Modi took over the Indian Antarctic program in 1984. Bhujendra Singh Choudhury, a trekker, led the first real expedition to Antarctica since the Treaty.", "prediction 3": "In 1980 the first Indian expedition to Antarctica was led by Dr. S. Z. Qasim. Giri Raj Singh Sirohi was the first Indian to set foot on Antarctica. In 1981 the Indian flag unfurled for the first time in Antarctica, marking the start of Southern Ocean expeditions under the environmental protocol of the Antarctic Treaty (1959). Giri Raj Singh Sirohi is a scientist who carried out research at the South Pole in Antarctica in 1960 for around 100 days in sub-zero temperatures. India later built a permanent settlement named Dakshin Gangotri and is being used again as supply base and transit camp.", "prediction 4": "First Indian Expedition to Antarctica took place in 1981 when the Indian flag unfurled for the first time, marking the start of Southern Ocean expeditions under the environmental protocol of the Antarctic Treaty (1959). The expedition was led by Giri Raj Singh Sirohi, who carried out research at the South Pole in Antarctica in 1960 for around 100 days in sub-zero temperatures. The first permanent settlement was built in 1983 and named Dakshin Gangotri and was excavated in 1989. The second permanent settlement still exists, Maitri, which is being used again as supply base and transit camp.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 113, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 198 }, { "error type": "Irrelevant", "explanation": "", "start": 199, "end": 275 }, { "error type": "Irrelevant", "explanation": "", "start": 276, "end": 357 }, { "error type": "Irrelevant", "explanation": "", "start": 358, "end": 514 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "In 1981, the Indian flag unfurled for the first time in Antarctica. That being said, Raj Singh Sirohi was the first Indian to set foot on Antarctica, having carried out research there in 1960.\n" }, "preference": [ 1, 2, 2, 2, 2, 2 ] }, { "question": "Who did the voice of salem on sabrina?", "passages": [ [ "Salem Saberhagen", "Salem was a recurring character in \"\" and its follow-up series \"Sabrina: Friends Forever\" and \"Sabrina's Secret Life.\"", "Salem here retains his backstory from the live-action sitcom, including his last name being \"Saberhagen,\" being black colored, and having been a former witch turned into a cat as punishment by the Witch's Council.", "Unlike the live-action sitcom, but similar to the previous Filmation series, Salem possesses a limited range of magical powers.", "Nick Bakay reprised Salem for \"Sabrina, the Animated Series\".", "Louis Chirillo provided Salem's voice in \"Sabrina: Friends Forever\", while Maurice LaMarche took over for \"Sabrina's Secret Life\".", "Salem appeared in the \"Sabrina the Teenage Witch\" live-action TV movie.", "Salem appeared in the 2013 series \"\".", "Ian James Corlett voices Salem.", "His voice in the 2013 series was an imitation of actor Paul Lynde.", "Unlike in previous incarnations, he's a spy for Enchantra the head witch, and the Spellman family isn't aware he's really a witch.", "Currently, Salem appears in the Netflix television series, which is based on an adaptation of the \"Chilling Adventures of Sabrina\" comics." ], [ "Salem Saberhagen", "Salem Saberhagen\n\nSalem Saberhagen is a fictional character from the American Archie Comics comic series \"Sabrina the Teenage Witch\".", "Salem is an American Shorthair cat who lives with Sabrina Spellman, Hilda Spellman and Zelda Spellman in the fictional town of Greendale, located near Riverdale.", "A former witch, Salem was sentenced by the Witch's Council to spend 100 years as a cat, as punishment for trying to take over the world; the sitcom establishes this time frame to be a century.", "Salem first appeared alongside Sabrina in \"Archie's Mad House\" #22 in 1962, and was created by George Gladir and Dan DeCarlo.", "Earlier comics portray Salem as an ordinary orange-colored feline who does not speak.", "With the debut and success of the 1990s live-action \"Sabrina the Teenage Witch\" sitcom, Salem's backstory and character underwent several retcons to bring it more in line with the sitcom's version.", "A late 1990s story initially revealed Salem was turned into a cat for standing up Enchantra, the Head Witch, at the altar.", "A similar version of events was presented in a 1990s live-action TV movie, where he was imprisoned in the form of a cat for attempting to use his magic to make a mortal love him." ], [ "Salem Saberhagen", "In a few instances where his human form is shown in flashbacks, he is portrayed with his face in shadows, but with a body type and militaristic uniform similar to Fidel Castro (Castro himself is depicted as being a friend of Salem).", "In the sitcom and \"Sabrina: The Animated Series\", Salem was voiced by actor Nick Bakay", "In one sitcom episode titled \"Jealousy\", Salem says he needs to make a phone call to Bakay, saying, \"I need to call in to Nick Bakay's sports show on ESPN radio.", "All he ever talks about is the Buffalo Bills, and his voice?", "LORD, is it annoying!\"", "The sitcom version of Salem also made a guest appearance on the Disney-ABC owned shows \"Boy Meets World\", \"You Wish\", and \"Teen Angel\" on November 7, 1997 and Disney's One Saturday Morning on Friday Night with Valarie Rae Miller on September 11, 1998\n\nIn the Filmation series, Salem (similar to the comics) was portrayed as an ordinary orange-colored cat who could only meow.", "Salem's meows were provided by Dallas McKennon.", "In these appearances, Salem possessed limited magical abilities, including the ability to teleport himself.", "A running gag in this series was Salem's recurring feud with Jughead's dog Hot Dog." ] ], "gold": "Salem, formerly a human turned into a short haired cat by witches, is a character that has been in several different versions of Sabrina the Teenage Witch, starting off as an Archie's comic series making it's way to television and film. Over the years Salem has had different voices. In 1970 Dallas McKennon, and in 1996 Nick Bakay, did the voice for the Sabrina TV Series. In 2003 Maurice LaMarche was the voice for Sabrina's Secret Life, and in the 2013 series Sabrina: Secrets of a Teenage Witch. Ian James Corlett is the voice for Salem.", "prediction 1": "Salem Saberhagen is a fictional character from the American Archie Comics comic series Sabrina the Teenage Witch. Salem was a recurring character in the 1990s sitcom and its follow-up series Sabrina: Friends Forever and Sabrina's Secret Life. In the sitcom and Sabrina: The Animated Series, Salem was voiced by Nick Bakay. Louis Chirillo provided Salem's voice in Sabrina: Friends Forever. Maurice LaMarche took over for Sabrina's Secret Life. Salem was a's voice in the 2013 series.\n", "prediction 2": "Salem Saberhagen is a fictional character from the Archie Comics comic series Sabrina the Teenage Witch. In the 1990s, Salem was voiced by Billy Dyer, and in the 1997-98 sitcom, Nick Bakay. Following Abby's death, Salem was voiced by Louis Chirillo.", "prediction 3": "Salem Saberhagen is a fictional character from the American Archie Comics comic series Sabrina the Teenage Witch. Saberhagen is a black-eyed cat who apparently served a mission of redemption to a hurting world of people and animals by turning him into a creature of habit. He was voiced by actor Nick Bakay, in the 1990s live-action sitcom Sabrina, as well as on the animated series Sabrina: The Animated Series and its films. In the animated series Sabrina, a the Filmation series Saberhagen, Salem was voiced by Louis Chirillo.", "prediction 4": "Salem Saberhagen is a fictional character from the American Archie Comics comic series Sabrina the Teenage Witch. A former witch, Salem Saberhagen was sentenced by the Witch's Council to spend 100 years as a cat, as punishment for trying to take over the world, while in the sitcom and in the Animated Series, Salem was voiced by Nick Bakay. Louis Chirillo provided the voice of Salem in Sabrina: Friends Forever. Maurice LaMarche took over for the secret life. Salem was voiced by Ian James Corlett. A 2017 episode titled \"Jealousy\". Ian James Corlett voices Salem. His in the 2013 series was an imitation of Paul Lynde.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 113 }, { "error type": "Irrelevant", "explanation": "", "start": 114, "end": 242 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7,8]}", "start": 444, "end": 463 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 7 ] } ], "corrected-prediction": "In the sitcom and Sabrina: The Animated Series, Salem was voiced by Nick Bakay. In the sitcom, Salem's meows were provided by Dallas McKennon. Louis Chirillo provided Salem's voice in \"Sabrina: Friends Forever\". Maurice LaMarche took over for \"Sabrina's Secret Life\". Ian James Corlett voiced Salem in the 2013 series.\n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "This is gonna be the best day of my life singer?", "passages": [ [ "Believer (American Authors song)", "Believer (American Authors song)\n\n\"Believer\" is the debut single by American indie rock band American Authors.", "The song was written by band members Zac Barnett, Dave Rublin, Matt Sanchez, and James Adam Shelley, along with producers Aaron Accetta and Shep Goodman.", "\"Believer\" first appeared on their 2013 \"American Authors\" EP and was released as the band's debut single on March 19, 2013; it was later included on their debut studio album, \"Oh, What a Life\" (2014).", "\"Believer\" initially garnered airplay on United States modern rock radio in early 2013, and was later re-released to modern rock, triple A, hot adult contemporary and mainstream radio following the success of the band's second single \"Best Day of My Life\".", "A remix of the song by Dutch DJ Ti\u00ebsto was issued as a digital single on July 22, 2014.", "There is an accompanying music video that shows two boys working together to build a time machine\n\n\n\nAdapted from \"Oh, What a Life\" liner notes." ], [ "Zac Brown Band", "Zac Brown Band\n\nZac Brown Band is an American country band based in Atlanta, Georgia.", "The lineup consists of Zachary Alexander \"Zac\" Brown (born July 31, 1978) (lead vocals, guitar), Jimmy De Martini (born August 3, 1976) (fiddle, vocals), John Driskell Hopkins (born May 3, 1971) (bass guitar, guitar, baritone guitar, banjo, ukulele, upright bass, vocals), Coy Bowles (born February 20, 1979) (guitar, keyboards), Chris Fryar (born November 22, 1970) (drums), Clay Cook (born April 20, 1978) (guitar, keyboards, mandolin, steel guitar, vocals), Matt Mangano (born May 12, 1976) (bass guitar), and Daniel de los Reyes (born July 18, 1962) (percussion).", "The band has released six studio albums along with two live albums, one greatest-hits album, and two extended plays." ] ], "gold": "Released in 2013, Best Day of My Life is a song by pop rock band American Authors with Zac Barnett as the lead singer.", "prediction 1": "American indie rock band American Authors released the song \"Believer\" as their debut single on March 19, 2013. The song was later included on their debut studio album, Oh, What a Life. The song was covered by American country band Zac Brown Band and Dutch DJ Tisto.\n", "prediction 2": "Singers Bob Dylan, James Taylor and Zac Brown have all been known to sing \"There Goes My Life\". American indie rock band American Authors released the song Believer as their debut single on March 19, 2013. Other songs released during the year include The Band's 2012 album Maybe That's The Day, 2014's What a Wonderful World, and 2013's Say Anything.", "prediction 3": "The song \"When I wake up everyday is gonna be the best day of my life\" was released as the debut single by American indie rock band American Authors on March 19, 2013. The band also released an equally successful single as a single on July 20, 2014, entitled \"What a Life\".", "prediction 4": "The song \"This is gonna be the best day of my life\" by American indie rock band American Authors was released on March 19, 2013. A remix of the song by Dutch DJ Tisto was issued as a digital single on July 22, 2014.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 186, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 185 }, { "error type": "Irrelevant", "explanation": "", "start": 42, "end": 111 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "American indie rock band American Authors released the song \"Best Day of My Life\" as their second single.\n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Landform that separates vietnam from cambodia and laos?", "passages": [ [ "Annamite Range", "Annamite Range\n\nThe Annamite Range or the Annamese Mountains (; ; ) is a mountain range of eastern Indochina.", "It extends approximately through Laos, Vietnam, and a small area in northeast Cambodia.", "The mountain range is also referred to variously as Annamese Range, Annamese Mountains, Annamese Cordillera, Annamite Mountains and Annamite Cordillera.", "The highest points of the range are 2,819 m high Phou Bia, 2,720 m high Phu Xai Lai Leng and Ng\u1ecdc Linh (Ngoc Pan), .", "The latter is located at the northwestern edge of the Triassic Kontum Massif, in central Vietnam.", "Important passes are the Nape Pass and the M\u1ee5 Gi\u1ea1 Pass.", "The Annamite Range runs parallel to the Vietnamese coast, in a gentle curve which divides the basin of the Mekong River from Vietnam's narrow coastal plain along the South China Sea.", "Most of the crests are on the Laotian side.", "The eastern slope of the range rises steeply from the plain, drained by numerous short rivers.", "The western slope is more gentle, forming significant plateaus before descending to the banks of the Mekong.", "The range itself has three main plateaus, from north to south: Phouane Plateau, Nakai Plateau and Bolaven Plateau." ] ], "gold": "Mountains separate Vietnam from Cambodia and Laos. Specifically, the Annamite Cordillera, or the Annamite Range or the Annamese Mountains, separates Vietnam from Cambodia and Laos, as they are a major mountain range in eastern Indochina.", "prediction 1": "The Annamite Range or the Annamese Mountains is a mountain range of eastern Indochina. It extends approximately through Laos, Vietnam, and a small area in northeast Cambodia. The Annamite Range runs parallel to the Vietnamese coast, in a gentle curve which divides the basin of the Mekong River from Vietnam's narrow coastal plain along the South China Sea.\n", "prediction 2": "The Annamite Range is a mountain range in eastern Indochina that runs parallel to the Vietnamese coast and is a gentle curve that divides the basin of the Mekong River from Vietnam's narrow coastal plain along the South China Sea. The landform that divides Vietnam from Cambodia and Laos is a landform called the Hoi An Plateau.", "prediction 3": "The Annamite Range is a mountain range in eastern Indochina. It extends approximately through Laos, Vietnam, and a small area in northeast Cambodia. The range itself is formed of three main landforms, from north to south: the region's coastal plain, mountain ranges, ocean floor and soil.", "prediction 4": "The Annamite Range, or the Annamese Mountains, is a mountain range in eastern Indochina. It extends approximately through Laos, Vietnam, and a small area in northeast Cambodia. The landform that separates Vietnam from Cambodia is the plain that runs parallel to the Vietnamese coast. The Annamite Range runs parallel to the Vietnamese coast, in a gentle curve which divides the basin of the Mekong River from Vietnam's narrow coastal plain along the South China Sea.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 358 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Annamite Range, the Annamese Mountains or the Annamite Cordillera is a mountain range of eastern Indochina. It extends approximately through Laos, Vietnam, and a small area in northeast Cambodia. \n" }, "preference": [ 1, 1, 1, 0, 2, 2 ] }, { "question": "When was season 7 of game of thrones released?", "passages": [ [ "Beauty and the Beast (2017 film)", "The move was an awards push as awards season heats up.", "Disney spent around $140\u00a0million to market the film worldwide.", "Following an announcement on May 22, 2016, Disney premiered the first official teaser trailer on \"Good Morning America\" the next day.", "In its first 24 hours, the teaser trailer reached 91.8\u00a0million views, which was the largest number ever seen for a trailer in that amount of time.", "This record has since been broken by \"\", \"It\" and \"\".", "The first official teaser poster was released on July 7, 2016.", "On November 2, 2016, \"Entertainment Weekly\" debuted the first official image on the cover of their magazine, along with nine new photos.", "One week later, Emma Watson and Disney debuted a new poster.", "On November 14, 2016, the first theatrical trailer was released, again on \"Good Morning America\".", "This reached 127.6\u00a0million views in its first 24 hours, setting a new record for the most views in one day, beating \"Fifty Shades Darker\"; this record has since been broken by \"The Fate of the Furious\".", "A TV spot with Watson singing was shown during the 74th Golden Globe Awards.", "Disney released the final trailer on January 30, 2017.", "\"Beauty and the Beast\" was released on Blu-ray, DVD and Digital HD on June 6, 2017.", "The film debuted at No." ], [ "Game of Thrones (season 8)", "Game of Thrones (season 8)\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Unlike the first six seasons that each had ten episodes and the seventh that had seven episodes, the eighth season will have only six episodes.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series and will also adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\".", "The season will be adapted for television by David Benioff and D. B. Weiss.", "Filming officially began on October 23, 2017, and concluded in July 2018.", "The season is scheduled to premiere in April 2019.", "\n\n\n\nThe eighth and final season of the fantasy drama television series \"Game of Thrones\" was announced by HBO in July 2016.", "Like the previous season, it will largely consist of original content not found currently in George R. R. Martin's \"A Song of Ice and Fire\" series; it will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series, \"The Winds of Winter\" and \"A Dream of Spring\"." ] ], "gold": "The seventh and penultimate season of the fantasy drama television series Game of Thrones premiered on HBO on July 16, 2017, and concluded on August 27, 2017. Like the previous season, it largely consisted of original content not found in George R. R. Martin's A Song of Ice and Fire series, while also incorporating material that Martin revealed to showrunners about the upcoming novels in the series. The season premiere was screened at the Walt Disney Concert Hall in Los Angeles on July 12, 2017.", "prediction 1": "The seventh season of the fantasy drama television series Game of Thrones was announced by HBO in July 2016. Like the previous season, it will largely consist of original content not found in George R. R. Martin's A Song of Ice and Fire series and will instead adapt material Martin has revealed to showrunners about the upcoming novels in the series. Season 7 was released on May 22, 2015. Season 7 was released on July 7, 2016.\n", "prediction 2": "The seventh season of TV fantasy drama, Game of Thrones, premiered on HBO on July 14, 2015. The teaser poster for season 7 was released on July 7, 2016. Season 7 was released on July 11, 2015. Season 7 of Game of Thrones was released on January 30, 2017.", "prediction 3": "Season 7 of American fantasy drama television series Game of Thrones premiered in March 2015. Season 7 was released in the U.S. on July 7, 2016, and on Netflix on January 30, 2017. Season 7 was released on March 9, 2015. Season 7 was released in the U.K. on December 14, 2016.", "prediction 4": "Season 7 of the fantasy drama television series Game of Thrones was released on July 7, 2016. It was followed by the first official teaser poster, which was released on July 7, 2016. The final theatrical trailer for season 7 was released on January 30, 2017. In addition to the final themes of the season 7 trailer, Jennifer Lawrence hosted a Q&A session with the cast and crew on Sept. 19, 2016.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 109, "end": 351 }, { "error type": "Unverifiable", "explanation": "", "start": 352, "end": 390 }, { "error type": "Redundant", "explanation": "Season 7 was released on May 22, 2015. ", "start": 391, "end": 430 }, { "error type": "Irrelevant", "explanation": "", "start": 74, "end": 108 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Who won the ncaa women's softball championship this year?", "passages": [ [ "2018 NCAA Division I Softball Tournament", "2018 NCAA Division I Softball Tournament\n\nThe 2018 NCAA Division I Softball Tournament is being held from May 18 through June 6, 2018 as the final part of the 2018 NCAA Division I softball season.", "Thirty-two teams were awarded automatic bids as champions of their conferences, and the remaining 32 were selected at-large by the NCAA Division I softball selection committee.", "The tournament culminates with eight teams playing in the 2018 Women's College World Series at ASA Hall of Fame Stadium in Oklahoma City.", "This is the first year since the 2010 Women's College World Series that neither the Florida Gators nor the Oklahoma Sooners made the Championship Series.", "The Florida State Seminoles will play in their first Women's College World Series Championship Series and became the first ACC team to make the Championship Series.", "The Washington Huskies are making their 4th Appearance in the Championship Series.", "The Big West, Mountain West, Pac-12, and West Coast Conference bids were awarded to the regular-season champion.", "All other conferences have the automatic bid go to the conference tournament winner.", "16 National Seeds were announced on the Selection Show Sunday, May 13 at 10 p.m. EDT on ESPN2.", "The 16 national seeds host the Regionals.", "Teams in italics advanced to Super Regionals.", "Teams in bold advance to Women's College World Series.", "1. Oregon (47\u20137)\n
\n2." ], [ "Women's College World Series", "Women's College World Series\n\nThe Women's College World Series (WCWS) is the final portion of the NCAA Division I Softball Championship for college softball in the United States.", "The tournament format consists of two four-team double-elimination brackets.", "The winners of each bracket then compete in a best-of-three series to determine the Division I WCWS National Champion.", "The WCWS takes place at ASA Hall of Fame Stadium in Oklahoma City.", "From 1969 to 1981, the women's collegiate softball championship was also known as the Women's College World Series and was promoted as such.", "During 1969\u20131979, the series was played in Omaha, and in 1980\u20131982 in Norman, Oklahoma.", "The NCAA held its first six Division I tournaments in Omaha in 1982\u20131987, followed by Sunnyvale, California in 1988\u20131989.", "The event has been held in Oklahoma City every year since then, except for 1996 in Columbus, Georgia.", "Softball was one of twelve women's sports added to the NCAA championship program for the 1981\u201382 school year, as the NCAA engaged in battle with the AIAW for sole governance of women's collegiate sports.", "The AIAW continued to conduct its established championship program in the same twelve (and other) sports.", "The 1982 softball championship tournaments of both the AIAW and the NCAA were called \"Women's College World Series.\"" ] ], "gold": "The Women's College World Series (WCWS) is the final portion of the NCAA Division I Softball Championship for college softball in the United States. Florida won the Women's College World Series in 2015. Oklahoma won in 2016 and 2017.", "prediction 1": "The Women's College World Series is the final portion of the NCAA Division I Softball Championship for college softball in the United States. From 1969 to 1981, the women's collegiate softball championship was also known as the Women's College World Series and was promoted as such. The 2018 Women's College World Series is being held from May 18 through June 6, 2018 as the final part of the 2018 NCAA Division I softball season. Thirty-two teams were awarded automatic bids as champions of their conferences, and the remaining 32 were selected at-large by the NCAA Softball selection committee.\n", "prediction 2": "The Women's College World Series, or WCS, is the final portion of the NCAA Division I Softball Championship for college softball in the United States. The teams that won the previous WCWS were Washington, Kansas and Oklahoma.", "prediction 3": "The Women's College World Series (WCWS) is the final portion of the NCAA Division I Softball Championship for college softball in the United States. From 1969 to 1981, the women's collegiate softball championship was also known as the Women's College World Series and was promoted as such. In 2005, Michigan beat Florida State, 46\u201312, in 2016, Massachusetts defeated Miami, 26\u201314, and in 2017, North Carolina beat Oklahoma.", "prediction 4": "The Women's College World Series (WCWS) is the final portion of the NCAA Division I Softball Championship for college softball in the United States. Beginning in 1981, the WCWS was also known as the Women's College World Series and was promoted as such. The national championship for women's collegiate softball was won by Portland State, where they finished in second place and beat the Florida Gators in third place.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 142, "end": 282 }, { "error type": "Irrelevant", "explanation": "", "start": 283, "end": 430 }, { "error type": "Irrelevant", "explanation": "", "start": 431, "end": 597 } ], "missing-info": [], "corrected-prediction": "The Women's College World Series is the final portion of the NCAA Division I Softball Championship for college softball in the United States. " }, "preference": [ 2, 1, 1, 1, 1, 1 ] }, { "question": "When did pirates of the caribbean 2 come out?", "passages": [ [ "Pirates of the Caribbean: Dead Man's Chest", "Animators studied every frame of Nighy's performance: the actor himself had blessed them by making his performance more quirky than expected, providing endless fun for them.", "His performance also meant new controls had to be stored.", "Finally, Jones' tentacles are mostly a simulation, though at times they were hand-animated when they act as limbs for the character.", "The Kraken was difficult to animate as it had no real-life reference, until animation director Hal Hickel instructed the crew to watch \"King Kong vs. Godzilla\" which had a real octopus crawling over miniatures.", "On the set, two pipes filled with 30,000 pounds of cement were used to crash and split the \"Edinburgh Trader\":", "Completing the illusion are miniature masts and falling stuntmen shot on a bluescreen stage.", "The scene where the Kraken spits at Jack Sparrow does not use computer-generated spit: it was real gunge thrown at Johnny Depp.", "\"Pirates of the Caribbean: Dead Man's Chest\" premiered at Disneyland in California on June 24, 2006.", "It was the first Disney film to use the new computer-generated Walt Disney Pictures production logo, which took a year for the studio to design." ], [ "Pirates of the Caribbean: Dead Man's Chest", "Pirates of the Caribbean: Dead Man's Chest\n\nPirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy swashbuckler film, the second installment of the \"Pirates of the Caribbean\" film series and the sequel to \"\" (2003).", "It was directed by Gore Verbinski, written by Ted Elliott and Terry Rossio, and produced by Jerry Bruckheimer.", "In the film, the wedding of Will Turner (Orlando Bloom) and Elizabeth Swann (Keira Knightley) is interrupted by Lord Cutler Beckett (Tom Hollander), who wants Turner to acquire the compass of Captain Jack Sparrow (Johnny Depp) in a bid to find the Dead Man's Chest.", "Sparrow discovers his debt to Davy Jones (Bill Nighy) is due.", "Two sequels to \"Pirates of the Caribbean: The Curse of the Black Pearl\" were conceived in 2004, with Elliott and Rossio developing a story arc that would span both films.", "Filming took place from February to September 2005 in Palos Verdes, Saint Vincent and the Grenadines, Dominica, and The Bahamas, as well as on sets constructed at Walt Disney Studios.", "It was shot back-to-back with the third film of the series, \"\"." ], [ "Pirates of the Caribbean: Dead Man's Chest", "Weta Digital was responsible for the logo's final animated rendering and Mark Mancina was hired to score a new composition of \"When You Wish Upon a Star\".", "The main people responsible for the logo's rendering are Cyrese Parrish and Cameron Smith.", "The first trailer was attached to \"\".", "Disney produced a comic book adaption in their Junior Graphic Novels: \"Pirates of the Caribbean: Dead Man's Chest\" (2007) Disney sponsored a racing yacht in the 2005 edition of the Volvo Ocean Race.", "The boat, aptly named \"Black Pearl\", raced under the team name \"Pirates of the Caribbean\" for the United States.", "The boat itself was a Volvo Open 70 class yacht designed by Farr Yacht Design.", "She was skippered to a 2nd-place finish by American Paul Cayard after 31,000 nm (57,000\u00a0km), divided into 9 legs, taking 8 months to complete.", "The film became available on DVD on November 20, 2006 in the UK and December 5, 2006 in the US.", "It sold 9,498,304 units in its first week of sales (equivalent to $174,039,324).", "In total it sold 16,694,937 units, earning $320,871,909." ], [ "Pirates of the Caribbean: Dead Man's Chest (video game)", "Pirates of the Caribbean: Dead Man's Chest (video game)\n\nPirates of the Caribbean: Dead Man's Chest is an action-adventure game based on the developed by Griptonite Games and Amaze Entertainment for the Game Boy Advance, Nintendo DS and PSP.", "The game incorporates role playing elements where Jack Sparrow and the Black Pearl can be customized.", "\"Dead Man's Chest\" is played on land and sea, on land the player must defeat enemies, search for treasure or for comrades, items, rumors and boat enhancements can be bought from towns.", "When on sea the player must travel from one island to another to play through the story or to explore the world.", "Sea battles can take place when the Black Pearl is steered towards other boats, during these battles the cannons are fired to damage the opposing ship and once when it has been sufficiently damaged, it's possible to board the burning ship and plunder it for food, grog and even treasures.", "The GBA version's gameplay is similar to the \"Castlevania\" game engine.", "The game was met with average to very mixed reception upon release." ], [ "Pirates of the Caribbean: Dead Man's Chest", "\"Dead Man's Chest\" was released in the United States on July 7, 2006, and received mixed reviews, with praise for its special effects, action sequences, Hans Zimmer's musical score, humor, and performances, particularly those of Depp and Nighy, but criticism for its convoluted plot and running time.", "The film set several records in its first three days, with an opening weekend of $136 million in the United States, and it was, at the time, the fastest film ever to gross over $1 billion in the worldwide box office, and became the highest-grossing film of 2006.", "It currently ranks as the 26th highest-grossing film of all time worldwide and held the record as the highest-grossing film released by the Walt Disney Studios for nearly four years until it was surpassed by \"Toy Story 3\" (2010).", "The film received Academy Award nominations for Best Art Direction, Sound Editing, Sound Mixing, and won the Academy Award for Best Visual Effects.", "Its sequel, \"At World's End\", was released the following year.", "The wedding of Will Turner and Elizabeth Swann is halted when Lord Cutler Beckett, chairman of the East India Trading Company, arrives with arrest warrants for them, and also for Commodore James Norrington, who allowed Captain Jack Sparrow to escape." ] ], "gold": "Pirates of the Caribbean: Dead Man's Chest, the second movie in the Pirates of the Caribbean film series, premiered at Disneyland in California on June 24, 2006. Pirates of the Caribbean: Dead Man's Chest was then released throughout the United States on July 7, 2006. This film then came out on DVD on November 20, 2006 in the United Kingdom and on December 5, 2006 in the United States. Pirates of the Caribbean: Dead Man's Chest is also an action-adventure videogame based on the film of the same name. The Pirates of the Caribbean: Dead Man's Chest videogame was developed by Griptonite Games and Amaze Entertainment for the Game Boy Advance, Nintendo DS and PSP. This game was released in the United States and North America on June 27, 2006, in the United Kingdom and Europe on July 7, 2006 and in Japan on August 24, 2006. ", "prediction 1": "Pirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy swashbuckler film, the second installment of the Pirates of the Caribbean film series and the sequel to Pirates of the Caribbean: The Curse of the Black Pearl. It was the first Disney film to use the new computer-generated Walt Disney Pictures production logo, which took a year for the studio to design. Pirates of the Caribbean: Dead Man's Chest became available on DVD on November 20, 2006 in the UK and December 5, 2006 in the US.\n", "prediction 2": "Pirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy fantasy swashbuckler film and the sequel to Pirates of the Caribbean: The Curse of the Black Pearl. It is the second installment of the Pirates of the Caribbean film series and the sequel to Pirates of the Caribbean: The Last Ship in the Atlantic (2004). Pirates of the Caribbean: Dead Man's Chest became available on DVD on November 20, 2006 in the UK and December 5, 2006 in the US.", "prediction 3": "Pirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy swashbuckler film, the second installment of the Pirates of the Caribbean film series and the sequel to Pirates of the Caribbean: The Curse of the Black Pearl. Mission accomplished as part of the shipbuilding sequence in the film, the player controls Captain Jack Sparrow in search of the Dead Man's Chest, discovering that Sparrow has a debt to Davy Jones. The video game Pirates of the Caribbean: Dead Man's Chest is a 2005 version of the sequel to Pirates of the Caribbean: Dead Man's Chest in a 2008, and released on November 20, 2006 in the UK and December 5, 2008 in the US.", "prediction 4": "Pirates of the Caribbean: Dead Man's Chest is a 2006 American fantasy swashbuckler film. It premiered at Disneyland in California on June 24, 2006. It was the first Disney film to use the new computer-generated Walt Disney Pictures production logo, which took a year for the studio to design. The film became available on DVD on November 20, 2006 in the UK and December 5, 2006 in the US.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 156, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 230, "end": 374 }, { "error type": "Irrelevant", "explanation": "", "start": 46, "end": 88 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 1 ] } ], "corrected-prediction": "Pirates of the Caribbean: Dead Man's Chest is the second installment of the Pirates of the Caribbean film series. It premiered at Disneyland in California on June 24, 2006. It released throughout the United States on July 7, 2006. The movie became available on DVD on November 20, 2006 in the UK and December 5, 2006 in the US. Pirates of the Caribbean: Dead Man's Chest is also an action-adventure game based on the movie, developed by Griptonite Games and Amaze Entertainment for the Game Boy Advance, Nintendo DS and PSP.\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "When did the springbok tour start and end?", "passages": [ [ "South Africa national rugby union team", "South Africa national rugby union team\n\nThe South Africa national rugby union team, commonly known as the Springboks, is governed by the South African Rugby Union.", "The Springboks play in green and gold jerseys with white shorts, and their emblems are the Springbok and the King Protea.", "The team has been representing South Africa in international rugby union since 30 July 1891, when they played their first test match against a British Isles touring team.", "Although South Africa was instrumental in the creation of the Rugby World Cup competition, the Springboks did not compete in the first two World Cups in 1987 and 1991 because of anti-apartheid sporting boycotts of South Africa.", "The team made its World Cup debut in 1995, when the newly democratic South Africa hosted the tournament.", "The Springboks defeated the All Blacks 15\u201312 in the final, which is now remembered as one of the greatest moments in South Africa's sporting history, and a watershed moment in the post-Apartheid nation-building process.", "South Africa regained their title as champions 12 years later, when they defeated England 15\u20136 in the 2007 final.", "As a result of the 2007 World Cup tournament the Springboks were promoted to first place in the IRB World Rankings, a position they held until July the following year when New Zealand regained the top spot." ] ], "gold": "The Springboks, the South Africa national rugby union team, arrived in New Zealand on July 19th, 1981, while the first game of the Springbok Tour was on July 22nd, 1981, and the Springbok Tour ended on September 13, 1981.", "prediction 1": "The Springboks, a South African national rugby union team, have been playing international rugby union since July 1891, when they played their first test match against a British Isles touring team. The Springboks made their Rugby World Cup debut in 1995, when the newly democratic South Africa hosted the tournament. The Springboks defeated the All Blacks 15\u201312 in the final, which is now remembered as one of the greatest moments in South Africa's sporting history, and a watershed moment in the post-Apartheid nation-building process.\n", "prediction 2": "The Springboks are the South African national rugby union team and have been representing South Africa in international rugby union since 1891, when they played their first test match against a British Isles touring team. The Springboks made their Rugby World Cup debut in 1995, when the newly democratic South Africa hosted the tournament.", "prediction 3": "The Springboks is the South African national rugby union team and has been representing South Africa in international rugby union since 30 July 1891. The Springbok tour started and ended on 16 February 2011, 27 April 2013 and 28 May 2014.", "prediction 4": "The South Africa national rugby union team, commonly known as the Springboks, has been representing South Africa in international rugby union since 30 July 1891, when they played their first test match against a British Isles touring team. It opened on 5 September 2006, using an international schedule that began on 1 October 2006.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 59, "end": 197 }, { "error type": "Irrelevant", "explanation": "", "start": 198, "end": 316 }, { "error type": "Irrelevant", "explanation": "", "start": 317, "end": 537 } ], "missing-info": [], "corrected-prediction": "The Springboks are a South African national rugby union team.\n" }, "preference": [ 2, 1, 0, 1, 0, 2 ] }, { "question": "Who plays rebeccas boyfriend in the a word?", "passages": [ [ "The A Word", "The A Word\n\nThe A Word is a BBC drama television series based on Israeli series \"Yellow Peppers\" (\u05e4\u05dc\u05e4\u05dc\u05d9\u05dd \u05e6\u05d4\u05d5\u05d1\u05d9\u05dd) by Keren Margalit.", "The series follows a five-year-old boy and how his family cope with the revelation that he has autism.", "Following filming in the Lake District from October 2015, a six-part series began airing on 22 March 2016.", "On 26 May 2016, the BBC announced that a second series of \"The A Word\" had been commissioned.", "It premiered in the UK on 7 November 2017.", "Five-year-old Joe Hughes displays clear signs of communication problems and consistently isolates himself by listening to pop music through large blue and black headphones.", "He has encyclopaedic knowledge of the songs he listens to and accurately sings along with the lyrics.", "His parents, Alison and Paul, seem oblivious to the disorder and wonder why Joe is ostracised by other children of the same age.", "However, it is later discovered by Joe's grandfather, Maurice, that Alison and Paul have been taking him to hospital for his communication problems.", "Other family members know there is a problem, however, their attempts to intervene are met with obstruction from Joe's parents." ] ], "gold": "The A Word is a BBC drama television series, based on the Israeli series Yellow Peppers. The series follows a young boy and how his family cope with the revelation that he has autism spectrum disorder. Rebecca is one of the characters on the show. Thomas Gregory plays Rebecca's former boyfriend, and Aaron Pierre plays her current one. ", "prediction 1": "The A Word is a BBC drama television series based on Israeli series \"Yellow Peppers\" by Keren Margalit. The series follows a five-year-old boy and how his family cope with the revelation that he has autism. Rebecca's boyfriend is played by actress Sara McManus.\n", "prediction 2": "The A Word is a BBC drama television series based on Israeli series \"Yellow Peppers\" by Keren Margalit. The character Rebecca's boyfriend is played by Anil Seth.", "prediction 3": "The A Word is a BBC drama television series based on Israeli series \"Yellow Peppers\" ( ) by Keren Margalit. The series follows a five-year-old boy and how his family cope with the revelation that he has autism. Rebecca's boyfriend in the A Word is played by sons Dylan, 36, and Dominic, 36.", "prediction 4": "In the BBC drama television series The A Word, Rebecca's boyfriend is played by Feargal Smith.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 85, "end": 103 }, { "error type": "Unverifiable", "explanation": "", "start": 207, "end": 262 } ], "missing-info": [], "corrected-prediction": "The A Word is a BBC drama television series based on Israeli series \"Yellow Peppers\". The series follows a five-year-old boy and how his family cope with the revelation that he has autism. \n" }, "preference": [ 0, 1, 1, 1, 1, 1 ] }, { "question": "Where did the term saved by the bell originate?", "passages": [ [ "Safety coffin", "Despite the fear of burial while still alive, there are no documented cases of anybody being saved by a safety coffin.", "It is worth noting that the practice of modern day embalming has, for the most part, eliminated the fear of \"premature burial\", as no one has ever survived that process once completed.", "Folk etymology has suggested that perhaps the phrases \"saved by the bell\", \"dead ringer\" and \"graveyard shift\" come from the use of safety coffins in the Victorian era; however, these have been dispelled as urban myth, attributed to a linguistic e-mail hoax \"Life in the 1500s\".", "The \"saved by the bell\" expression is actually well established to have come from boxing, where a boxer who is still on their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round.", "The 2009 song \"The Tale of Solomon Snell\" by Duncan Sheik from his album \"Whisper House\" tells the story of a man who for his burial gives instructions to be buried in a safety coffin with a bell mechanism attached but ultimately fails to be saved due to the person in charge of listening to the bell getting drunk." ], [ "Safety coffin", "Most consisted of some type of device for communication to the outside world such as a cord attached to a bell that the interred person could ring should they revive after the burial.", "A safety coffin of this type appears in the 1979 film \"The First Great Train Robbery\".", "Other variations on the bell included flags and pyrotechnics.", "Some designs included ladders, escape hatches, and even feeding tubes, but many forgot a method for providing air.", "Robert Robinson died in Manchester in 1791.", "A movable glass pane was inserted in his coffin, and the mausoleum had a door for purposes of inspection by a watchman, who was to see if he breathed on the glass.", "He instructed his relatives to visit his grave periodically to check that he was still dead.", "The first recorded safety coffin was constructed on the orders of Duke Ferdinand of Brunswick before his death in 1792.", "He had a window installed to allow light in, an air tube to provide a supply of fresh air, and instead of having the lid nailed down he had a lock fitted.", "In a special pocket of his shroud he had two keys, one for the coffin lid and a second for the tomb door.", "P.G. Pessler, a German priest, suggested in 1798 that all coffins have a tube inserted from which a cord would run to the church bells." ] ], "gold": "Folk etymology has suggested that perhaps the phrase saved by the bell came from the use of safety coffins in the Victorian era. In the Victorian era, the general fear of premature burial led to the invention of many safety devices which could be incorporated into coffins. Most of these safety devices consisted of some type of device for communication to the outside world such as a cord attached to a bell that the interred person could ring should they revive after the burial. However, the origins of the saved by the bell expression in regards to safety coffins in the Victorian Era has been dispelled as urban myth. The saved by the bell expression is actually well established to have come from boxing, where a boxer who is still on their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round.", "prediction 1": "Folk etymology has suggested that perhaps the phrases \"saved by the bell\", \"dead ringer\" and \"graveyard shift\" come from the use of safety coffins in the Victorian era. However, these have been dispelled as urban myth, attributed to a linguistic e-mail hoax \"Life in the 1500s\". The expression \"saved by the bell\" expression is actually well established to have come from boxing, where a boxer who is still their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round.\n", "prediction 2": "Folk etymology has suggested that perhaps the phrases \"saved by the bell\", \"dead ringer\" and \"graveyard shift\" come from the use of safety coffins in the Victorian era. However, these have been dispelled as urban myth, attributed to a linguistic e-mail hoax \"Life in the 1500s\". The expression \"saved by the bell\" expression is actually well established to have come from boxing, where a boxer who is still their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round. And also comes from boxing, where a boxer who is still their feet but close to being knocked out can be saved from losing by the bell ringing to indicate the end of the round.", "prediction 3": "Folk etymology has suggested that perhaps the phrases \"saved by the bell\", \"dead ringer\" and \"graveyard shift\" come from the use of safety coffins in the Victorian era. However, these have been dispelled as urban myth, attributed to a linguistic e-mail hoax \"Life in the 1500s\". The words \"saved by the bell\", \"dead ringer\", and \"graveyard shift\" originate from boxing, where a boxer who is still on their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round.", "prediction 4": "Folk etymology has suggested that perhaps the phrases \"saved by the bell\", \"dead ringer\" and \"graveyard shift\" come from the use of safety coffins in the Victorian era. A German clergyman, P.G. Pessler, suggested that all coffins have a tube inserted from which a cord would run to the church bells. Below are a few examples of the different phrases that have been proposed over the years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 75, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 278 }, { "error type": "Redundant", "explanation": "expression ", "start": 314, "end": 324 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Folk etymology has suggested that perhaps the phrase \"saved by the bell\" came from the use of safety coffins in the Victorian era, where there was a fear of burial while still alive. Most of these consisted of some type of device for communication to the outside world, such as a cord attached to a bell that the interred person could ring should they revive after the burial. However, this origin for the phrase has been dispelled as urban myth. The expression s actually well established to have come from boxing, where a boxer who is still their feet but close to being knocked down can be saved from losing by the bell ringing to indicate the end of the round.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "What three groups composed french society in the late 1700s?", "passages": [ [ "Estates of the realm", "The new lords of the land identified themselves primarily as warriors, but because new technologies of warfare were expensive, and the fighting men required substantial material resources and considerable leisure to train, these needs had to be filled.", "The economic and political transformation of the countryside in the period were filled by a large growth in population, agricultural production, technological innovations and urban centers; movements of reform and renewal attempted to sharpen the distinction between clerical and lay status, and power, recognized by the Church also had their effect.", "In his book \"The Three Orders: Feudal Society Imagined\", the French medievalist Georges Duby has shown that in the period 1023-1025 the first theorist who justified the division of European society into the three estates of the realm was Gerard of Florennes, the bishop of Cambrai.", "As a result of the Investiture Controversy of the late 11th and early 12th centuries, the powerful office of Holy Roman Emperor lost much of its religious character and retained a more nominal universal preeminence over other rulers, though it varied.", "The struggle over investiture and the reform movement also legitimized all secular authorities, partly on the grounds of their obligation to enforce discipline.", "In the 11th and 12th centuries thinkers argued that human society consisted of three orders: those who pray, those who fight, and those who labour." ], [ "Estates of the realm", "Estates of the realm\n\nThe estates of the realm, or three estates, were the broad orders of social hierarchy used in Christendom (Christian Europe) from the medieval period to early modern Europe.", "Different systems for dividing society members into estates developed and evolved over time.", "The best known system is the French \"Ancien R\u00e9gime\" (Old Regime), a three-estate system used until the French Revolution (1789\u20131799).", "Monarchy was for the king and the queen and this system was made up of clergy (the First Estate), nobles (the Second Estate), and peasants and bourgeoisie (the Third Estate).", "In some regions, notably Scandinavia and Russia, burghers (the urban merchant class) and rural commoners were split into separate estates, creating a four-estate system with rural commoners ranking the lowest as the Fourth Estate.", "Furthermore, the non-landowning poor could be left outside the estates, leaving them without political rights.", "In England, a two-estate system evolved that combined nobility and clergy into one lordly estate with \"commons\" as the second estate.", "This system produced the two houses of parliament, the House of Commons and the House of Lords.", "In southern Germany, a three-estate system of nobility (princes and high clergy), \"ritters\" (knights), and burghers was used." ] ], "gold": "During late 1700s, French society was composed by three different social groups, also known as Estates of the Realm. The Third State was composed by peasants and bourgeoisie. Nobles, Clergy made the Second and First States respectively. This system was used until the advent of the French Revolution.", "prediction 1": "The estates of the realm, or three estates, were the broad orders of social hierarchy used in Christendom (Christian Europe) from the medieval period to early modern Europe. Monarchy was for the king and the queen and this system was made up of clergy (the First Estate), nobles (the Second Estate), and peasants and bourgeoisie (the Third Estate). In France, the three-estate system of nobility, burghers, and knights was used.\n", "prediction 2": "Ancien r\u00e9gime, or Old Regime, was an order of social hierarchy used in Christendom from the medieval period to early modern Europe and it was the system that was used until the French Revolution. It was a three-estate system that was administered by the king and the queen. It consisted of nobility, nobles, and peasants.", "prediction 3": "The estates of the realm, or three estates, were the broad orders of social hierarchy used in Christendom (Christian Europe) from the medieval period to early modern Europe and led to different systems for dividing society members into estates. The best known system for dividing society into estates is the French Ancien R\u00e9gime, a three-estate system used until the French Revolution (1789\u20131799). Monarchy was for the king and the queen and this system was made up of clergy, and this concept was retained its religious character.", "prediction 4": "The estates of the realm, or three estates, were the broad orders of social hierarchy used in Christendom (Christian Europe) from the medieval period to early modern Europe. Monarchy was for the king and the queen and this system was made up of clergy (the First Estate), nobles (the Second Estate), and peasants and bourgeoisie (the Third Estate). In France in the late 1700s, nobility (princes and high clergy), ritters (knights), and burghers was used, while in southern Germany a three-estate system of nobility (burghers) and bourgeois was used.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 173 }, { "error type": "Irrelevant", "explanation": "", "start": 174, "end": 213 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[9]}", "start": 349, "end": 359 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The estates of the realm, or three estates, were the broad orders of social hierarchy. This system was made up of clergy (the First Estate), nobles (the Second Estate), and peasants and bourgeoisie (the Third Estate). This system was used until the French Revolution.\n" }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Whose diary describes the great plague of london?", "passages": [ [ "John Evelyn", "John Evelyn\n\nJohn Evelyn, FRS (31 October 1620 \u2013 27 February 1706) was an English writer, gardener and diarist.", "John Evelyn's diary, or memoir, spanned the period of his adult life from 1640, when he was a student, to 1706, the year he died.", "He did not write daily at all times.", "The many volumes provide insight into life and events at a time before regular magazines or newspapers were published, making diaries of greater interest to modern historians than such works might have been at later periods.", "Evelyn's work covers art, culture and politics, including the execution of Charles I, Oliver Cromwell's rise and eventual natural death, the last Great Plague of London, and the Great Fire of London in 1666.", "Evelyn's posthumously \"rival\" diarist, Samuel Pepys, wrote a different kind of diary, covering a much shorter period, 1660\u20131669, but in much greater depth, within the same era.", "Over the years, Evelyn's Diary has been overshadowed by Pepys's chronicles of 17th-century life.", "Born into a family whose wealth was largely founded on gunpowder production, John Evelyn was born in Wotton, Surrey and grew up in Lewes, Sussex.", "While living in Lewes, in Southover Grange, he was educated at Lewes Old Grammar School." ], [ "Samuel Pepys", "Samuel Pepys\n\nSamuel Pepys ( ; 23 February 1633 \u2013 26 May 1703) was an administrator of the navy of England and Member of Parliament who is most famous for the diary he kept for a decade while still a relatively young man.", "Pepys had no maritime experience, but he rose to be the Chief Secretary to the Admiralty under both King Charles II and King James II through patronage, hard work, and his talent for administration.", "His influence and reforms at the Admiralty were important in the early professionalisation of the Royal Navy.", "The detailed private diary that Pepys kept from 1660 until 1669 was first published in the 19th\u00a0century and is one of the most important primary sources for the English Restoration period.", "It provides a combination of personal revelation and eyewitness accounts of great events, such as the Great Plague of London, the Second Dutch War, and the Great Fire of London.", "Pepys was born in Salisbury Court, Fleet Street, London on 23 February 1633, the son of John Pepys (1601\u20131680), a tailor, and Margaret Pepys (\"n\u00e9e\" Kite; died 1667), daughter of a Whitechapel butcher.", "His great uncle Talbot Pepys was Recorder and briefly Member of Parliament (MP) for Cambridge in 1625." ], [ "A Journal of the Plague Year", "A Journal of the Plague Year\n\nA Journal of the Plague Year is a novel by Daniel Defoe, first published in March 1722.", "This novel is an account of one man's experiences of the year 1665, in which the Great Plague or the bubonic plague struck the city of London.", "The book is told somewhat chronologically, though without sections or chapter headings.", "Presented as an eyewitness account of the events at the time, it was written in the years just prior to the book's first publication in March 1722.", "Defoe was only five years old in 1665, and the book itself was published under the initials \"H. F.\" and is probably based on the journals of Defoe's uncle, Henry Foe.", "In the book, Defoe goes to great pains to achieve an effect of verisimilitude, identifying specific neighborhoods, streets, and even houses in which events took place.", "Additionally, it provides tables of casualty figures and discusses the credibility of various accounts and anecdotes received by the narrator.", "The novel is often compared to the actual, contemporary accounts of the plague in the diary of Samuel Pepys.", "Defoe's account, which appears to include much research, is far more systematic and detailed than Pepys's first-person account.", "Whether the \"Journal\" can properly be regarded as a novel has been disputed." ] ], "gold": "Multiple diarists described the great plague of London in their works. Samuel Pepys was an administrator of the navy of England and Member of Parliament who is most famous for the diary he kept for a decade while still a relatively young man. John Evelyn, an English writer, gardener, and diarist, also kept a diary from his experiences during the great plague of London. Daniel Defoe wrote, A Journal of the Plague Year of his experiences of the year 1665, in which the bubonic plague struck the city of London.", "prediction 1": "John Evelyn's diary, or memoir, spanned the period of his adult life from 1640, when he was a student, to 1706, the year he died. The many volumes provide insight into life and events at a time before regular magazines or newspapers were published, making diaries of greater interest to modern historians than such works might have been at later periods. Samuel Pepys's diary, which he kept for a decade while still a relatively young man, is the most famous for the diary that was first published in the 19th century and is one of the most important primary sources for the English Restoration period.\n", "prediction 2": "The first diary to describe the Great Plague of London is that of John Evelyn, who was an English writer, gardener, and diarist. His piece, The Plague's Journey through London, was published in October 1665. The second, A Journal of the Plague Year, is a novel by Daniel Defoe, first published in March 1722. It's a combination of personal revelation and eyewitness accounts, detailing events such as the Plague of London, the Second Dutch War, and the Great Plague of London. Samuel Pepys's's's diary, or memoir, was published in the year he died.", "prediction 3": "Some diaries of the Great Plague of London are written by different authors. John Evelyn's diary describes the Great Plague of London, while Samuel Pepys'\u2019s diary details the plague during 1665. A Journal of the Plague Year, a novel by Daniel Defoe, describes the great plague in London five years before it occurred, and is a progressivistic account of the events that led to its outbreak.", "prediction 4": "John Evelyn's diary, or memoir, was written from 1640 when he was a student and continued into 1706. Samuel Pepys's is a journal written from 1660 until 1669 chronicling the events of 1665 that would lead to the Great Plague of London. The diary was written when Pepys was 18 years old, but it is posthumously \"rivalled\" to Evelyn's. Insight into life at the time, he was more famous for his chronicle that was written by Daniel Defoe in his book A Journal of the Plague Year is a novel that describes the plague in 1665 Great Plague in London.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 32, "end": 129 }, { "error type": "Irrelevant", "explanation": "", "start": 130, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 459, "end": 603 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 2 ] } ], "corrected-prediction": "There are John Evelyn, who was an English writer, gardener, and diarist, and Samuel Pepys, was an administrator of the navy of England and Member of Parliament who is most famous for the diary he kept for a decade while still a relatively young man. In addition, Daniel Defoe wrote, A Journal of the Plague Year of his experiences of the year 1665, in which the bubonic plague struck the city of London." }, "preference": [ 1, 1, 0, 1, 0, 2 ] }, { "question": "What was the first full length indian feature film ever made?", "passages": [ [ "Raja Harishchandra", "Raja Harishchandra\n\nRaja Harishchandra () is a 1913 Indian silent film, directed and produced by Dadasaheb Phalke.", "It is often considered the first full-length Indian feature film.", "\"Raja Harishchandra\" features Dattatraya Damodar Dabke, Anna Salunke, Bhalchandra Phalke, and Gajanan Vasudev Sane and is based on the legend of Harishchandra, recounted in the \"Ramayana\" and \"Mahabharata\".", "The film, being silent, had English, Marathi, and Hindi language intertitles.", "Phalke decided to make a feature film after watching \"The Life of Christ\" (1906) at a theatre in Mumbai, formerly known as Bombay.", "He went to London for two weeks to learn filmmaking techniques and founded Phalke Films.", "He imported the hardware required for the filmmaking and exhibition from England, France, Germany, and the United States.", "Phalke shot a short film \"Ankurachi Wadh\" (\"Growth of a Pea Plant\") to attract investors for his venture.", "He published advertisements in various newspapers calling for the cast and crew.", "As no women were available to play female leads, male actors performed the female roles." ], [ "Alam Ara", "Alam Ara\n\nAlam Ara (translation: \"The Ornament of the World\") was a 1931 Indian film directed by Ardeshir Irani.", "It was the first Indian sound film.", "Irani recognised the importance that sound would have on the cinema, and raced to complete \"Alam Ara\" before several contemporary sound films.", "\"Alam Ara\" debuted at the Majestic Cinema in Mumbai (then Bombay) on 14 March 1931.", "The first Indian talkie was so popular that \"police aid had to be summoned to control the crowds.\"", "The film was houseful for the next 8 weeks of its release.", "It was advertised with the tagline \"All living.", "Breathing.", "100 per cent talking\".", "The film has long been lost and was not available as far back as 1967 according to the National Film Archive of India, Pune.", "The film is a love story between a prince and a gypsy girl, based on a Parsi play written by Joseph David.", "David later served as a writer at Irani's film company.", "The story centres on an imaginary, historical royal family in the kingdom of Kumarpur.", "The main characters are the king, Sultan Saleem Khan, and his two warring wives, Dilbahar Begum and Naubahar Begum.", "Their rivalry escalates when a \"fakir\" predicts that Navbahar will bear the king's heir." ], [ "Bollywood", "Credit for the term has been claimed by several different people, including the lyricist, filmmaker and scholar Amit Khanna, and the journalist Bevinda Collaco.", "Bollywood does not exist as a physical place.", "Some deplore the name, arguing that it makes the industry look like a poor cousin to Hollywood.", "\"Raja Harishchandra\" (1913), by Dadasaheb Phalke, is known as the first silent feature film made in India.", "By the 1930s, the industry was producing over 200 films per annum.", "The first Indian sound film, Ardeshir Irani's \"Alam Ara\" (1931), was a major commercial success.", "There was clearly a huge market for talkies and musicals; Bollywood and all the regional film industries quickly switched to sound filming.", "The 1930s and 1940s were tumultuous times: India was buffeted by the Great Depression, World War II, the Indian independence movement, and the violence of the Partition.", "Most Bollywood films were unabashedly escapist, but there were also a number of filmmakers who tackled tough social issues, or used the struggle for Indian independence as a backdrop for their plots.", "In 1937, Ardeshir Irani, of \"Alam Ara\" fame, made the first colour film in Hindi, \"Kisan Kanya\"." ] ], "gold": "Raja Harishchandra is a 1913 Indian silent film directed and produced by Dadasaheb Phalke. It is often considered the first full-length Indian feature film. Alam Ara is a 1931 Indian Hindustani-language historical fantasy film directed and produced by Ardeshir Irani. The film was considered a major breakthrough for the Indian film industry and Ardeshir Irani's career with its status as the country's first sound film.", "prediction 1": "The first full length Indian feature film was Alam Ara, a 1931 film directed by Ardeshir Irani. Raja Harishchandra is a 1913 Indian silent film, directed and produced by Dadasaheb Phalke. It is often considered the first full-length Indian feature film.\n", "prediction 2": "Bollywood is the largest and oldest film industry in the world. Dadasaheb Phalke made The Raja Harish Chandra in 1913 which is often considered the first full-length Indian feature film. Ardeshir Irani made The Alam Ara in 1931, the first Indian sound film. Sanjay Dutt made the most experimental Hindi-language movie in 1937. With the advent of colour film, Bhakta Sahib, and Mango in 1938, Bollywood was able to produce almost all of these films. Raja Harishchandra was the first full-length Indian feature film produced in India, and was considered the first full-length Indian silent film.", "prediction 3": "In India, Raja Harishchandra, a 1913 Indian silent film, was the first full-length Indian feature film. Bollywood frequently refers to this film as the first full length Indian feature film. The first Indian sound film, Ardeshir Irani's Alam Ara, was the first Indian sound film.", "prediction 4": "The first full length indian feature film was Raja Harishchandra, which debuted at the Majestic Cinema in Mumbai on March 14, 1913. The first Indian sound film, Ardeshir Irani's Alam Ara, was released in the year 1931.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[2]}", "start": 0, "end": 95 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The first full length Indian feature film was Raja Harishchandra, a 1913 film directed and produced by Dadasaheb Phalke. Additionally, Alma Ara is a 1931 film, directed by Ardeshir Irani. it was the country's first sound film.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "Who is the best selling latin artist of all time?", "passages": [ [ "Selena albums discography", "With \"Amor Prohibido\", Selena was considered \"bigger than Tejano itself\", and broke barriers in the Latin music world.", "This prompted EMI to begin marketing Selena as an American pop artist, believing she had reached her peak in the Latin music market.", "The singer recorded four tracks slated for what would have been her English-language crossover album by March 1995.", "On March 31, 1995 Selena was shot dead by Yolanda Sald\u00edvar, her friend and a former employee of her Selena Etc. boutiques over disputed embezzlement claims.", "EMI Records and EMI Latin jointly released \"Dreaming of You\" in July 1995.", "It sold 175,000 copies its first day of release, a then-record for a female vocalist.", "\"Dreaming of You\" debuted on top the \"Billboard\" 200 chart with 331,000 units sold its first week, the second largest first-week sales for a female musician.", "\"Dreaming of You\" became the first and to date the only predominantly Spanish-language album to debut and peak at number one on the \"Billboard\" 200 chart.", "\"Dreaming of You\" was among the top ten best-selling debuts for a musician, best-selling debut by a female act, and was the fastest-selling U.S. album in 1995." ], [ "RIAA certification", "Rules may or may not apply depending on most recent staff within the Distributions position.", "Since 2000, the RIAA also awards \"Los Premios de Oro y De Platino\" (Gold and Platinum Awards in Spanish) to Latin albums which are defined by the RIAA as a type of product that features at least 51% of content in Spanish.", "As of December 20, 2013, the award levels for Latin certifications are:\n\n\nFor certifications made before December 20, 2013, the award levels are:\n\nNote: The number of sales required to qualify for Oro and Platino awards was higher prior to January 1, 2008.", "The thresholds were 100,000 units (Oro) and 200,000 units (Platino).", "All Spanish-language albums certified prior to 2008 were updated to match the current certification at the time.", "\"La Bomba\" by Bolivian group Azul Azul is the only single to receive a Latin certification based on shipments before the creation of the Latin digital singles awards in 2013.", "The \"Disco de Diamante\" award was introduced after the RIAA updated the thresholds for Latin certifications in December 20, 2013.", "The \"Disco de Diamante\" is awarded to Latin albums that have been certified 10\u00d7 Platinum.", "Standard singles are certified:\n\nNote: The number of sales required to qualify for Gold and Platinum discs was higher prior to January 1, 1989." ], [ "Julio Iglesias discography", "Julio Iglesias discography\n\nJulio Iglesias is the best selling international artist in Brazil with over 12.4 million records sold and also one of the best-selling artists worldwide, with 100 million records sold in 14 languages and released 80 albums, and more than 2,600 gold and platinum records certified.", "This list contains all studio and live albums of original materials of Spanish singer Julio Iglesias.", "Notes" ], [ "Murder of Selena", "\"Dreaming of You\" joined five of Selena's studio albums on the \"Billboard\" 200 chart simultaneously, making her the first female artist in \"Billboard\" history to accomplish this feat.", "The Recording Industry Association of America (RIAA) certified it 59x platinum for sales of 3.54 million album-equivalent units in the U.S. , it has sold over 2.942 million copies in the United States, becoming the best-selling Latin album of all-time in the country according to Nielsen SoundScan.", "As of 2015, the recording has sold five million copies worldwide.", "Five of Selena's albums generated $4 million in sales within five years.", "Selena was inducted into the \"Billboard\" Latin Music Hall of Fame, the Hard Rock Cafe's Hall of Fame in 1995, the South Texas Music Hall of Fame, and the Tejano Music Hall of Fame in 2001.", "In December 1999, she was named the \"top Latin artist of the '90s\" and \"best-selling Latin artist of the decade\" by \"Billboard\" for her fourteen top-ten singles\u2014including seven number-one hits\u2014in the Top Latin Songs chart.", "On the day Selena was killed, vigils and memorials were held throughout Texas and California." ], [ "Despacito", "In 2018, it was the best-selling and most-streamed Latin song of the first half of the year, with 246,000 downloads sold and 308,980,000 audio and video streams from December 29, 2017 to June 28, 2018, as well as the best-performing single on Hot Latin Songs for the second year in a row.", "In the United States, the single sold 2,938,000 downloads as of June 28, 2018 and received a diamond certification by the Recording Industry Association of America (RIAA) on January 27, 2018, for units of over 10 million sales plus track-equivalent streams.", "It became the first Latin and 18th overall single to receive a diamond certification by the RIAA.", "In August 2018, \"Billboard\" ranked it the 33rd best-performing single of all-time on the Hot 100.", "The following month, \"Despacito\" was ranked the best-performing track of all-time on Hot Latin Songs since the list's inception in 1986." ], [ "Despacito", "Despacito\n\n\"Despacito\" (; English: \"Slowly\") is a song by Puerto Rican singer Luis Fonsi featuring Puerto Rican reggaeton rapper Daddy Yankee from Fonsi's upcoming studio album.", "On January 12, 2017, Universal Music Latin released \"Despacito\" and its music video, which shows both artists performing the song in La Perla neighborhood of Old San Juan, Puerto Rico and the local bar La Factor\u00eda.", "The song was written by Fonsi, Erika Ender, and Daddy Yankee, and was produced by Mauricio Rengifo and Andr\u00e9s Torres.", "A remix version featuring Canadian singer Justin Bieber was released on April 17, 2017, which helped to improve the song's chart performance in numerous countries, including various number-one positions.", "\"Despacito\" has been widely credited by music journalists as being instrumental in popularizing Spanish-language pop music in the mainstream market again.", "It is a reggaeton and Latin pop song composed in common time with lyrics about having a sexual relationship, performed in a smooth and romantic way.", "Commercially, the song topped the charts of 47 countries and reached the top 10 of six others, making it both Fonsi's and Daddy Yankee's most successful single to date." ], [ "Julio Iglesias", "Julio Iglesias\n\nJulio Jos\u00e9 Iglesias de la Cueva (born 23 September 1943) () is a Spanish singer and songwriter.", "In 1983, he was celebrated as having recorded songs in the most languages in the world, and in 2013 for being the Latin artist with the most records sold in history.", "Iglesias is recognized as the most commercially successful Continental European singer in the world and one of the top ten record sellers in music history, having sold more than 250 million records worldwide in 14 languages.", "It is estimated that during his career he has offered more than 5000 concerts, having performed for over 60 million people on five continents.", "In April 2013 he was awarded in Beijing as the most popular international artist in China.", "In Brazil, France, Romania, Italy, and others, Iglesias is the most successful foreign record seller, while in his home country, Spain, he has sold the most records in history, with 23 million records.", "During his career, Iglesias has won many awards in the music industry, including the Grammy, Latin Grammy, World Music Award, Billboard Music Award, American Music Award and Lo Nuestro Award.", "He has been awarded the Gold Medal for Merit in the Fine Arts of Spain and the Legion of Honour of France.", "UNICEF named him Special Ambassador for the Performing Arts in 1989.", "He has been a star on the Hollywood Walk of Fame since 1985." ] ], "gold": "Julio Iglesias is the overall best selling Latin artist of all time. He has sold more than 100 million records worldwide in 14 languages. The Latin artist with the best selling album of all time is Selena. Selena's Dreaming of You, her fifth and final studio album which was posthumously released in 1995, has sold over 2.942 million copies in the United States, making it the best-selling Latin album of all-time in the country. Luis Fonsi, Daddy Yankee and Justin Bieber have the best selling Latin single of all time with Despacito. This song was originally released on January 12, 2017; however, a remix version featuring Canadian singer Justin Bieber was released on April 17, 2017, and this helped improve the song's chart performance in numerous countries. The song received a 13 times platinum certification by the Recording Industry Association of America on January 6, 2020 for units of over 13 million sales. It became the first Latin single to receive a diamond certification by the Recording Industry Association of America.", "prediction 1": "The best-selling Latin artist of all time is Selena Gomez, with over 2.942 million copies sold in the United States. The best-selling Latin artist of all time is Julio Iglesias, with over 100 million records sold worldwide.\n", "prediction 2": "Selena Gomez is the best-selling Latin artist of all time with her fourth studio album, Memoria de Hermandad (1995). She also has the distinction of being the most expensive Latin artist of all time according to Nielsen SoundScan. Julio Iglesias' Second Life is the best-selling Latin album of all time according to Nielsen SoundScan.", "prediction 3": "The best selling Latin artist of all time is Selena Gomez with several top-ten hits, including \"Amor Prohibido\". Iglesias also holds the title of best selling Latin album of all-time with 2.942 million unit sales in the United States and 2.397 million units worldwide.", "prediction 4": "There are several Latin artists with best selling records. Opera singers Andre Guzman and Selena Gomez have the most sold records. In 2015, the best-selling Latin album of all time was Julio Iglesias' album Calle 16 de Luna. Spanish singer Julio Iglesias has the best-selling Latin record of all time in the United States.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":4,\"sentence_id\":[2]}", "start": 0, "end": 58 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 5 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 6, "sentence_id": [ 4 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 5, "sentence_id": [ 3 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 6, "sentence_id": [ 1 ] } ], "corrected-prediction": "The artist Selena has the best-selling Latin album of all time, with over 2.942 million copies sold in the United States. The best-selling Latin artist of all time is Julio Iglesias, with over 100 million records sold worldwide. \"Despacito\", by Luis Fonsi featuring Daddy Yankee, was ranked the best-performing track of all-time on Hot Latin Songs since the list's inception in 1986. A remix version featuring Canadian singer Justin Bieber was released on April 17, 2017, which helped to improve the song's chart performance in numerous countries. It became the first Latin single to receive a diamond certification by the RIAA.\n\n" }, "preference": [ 1, 1, 1, 2, 0, 0 ] }, { "question": "When did the united states and britain become allies?", "passages": [ [ "United Kingdom\u2013United States relations", "When the Second Continental Congress convened in Philadelphia in May 1775, deliberations conducted by notable figures such as Benjamin Franklin, Thomas Jefferson, John Hancock, Samuel Adams, and John Adams eventually resulted in seeking full independence from the mother country.", "Thus, the Declaration of Independence, unanimously ratified on 4 July 1776, was a radical and decisive break.", "The United States of America became the first colony in the world to successfully achieve independence in the modern era.", "In early 1775 the Patriots forced all the British officials and soldiers out of the new nation.", "The British returned in force in August 1776, and captured New York City, which became their base until the war ended in 1783.", "The British, using their powerful navy, could capture major ports, but 90% of the Americans lived in rural areas where they had full control.", "After the Patriots captured a British invasion force moving down from Canada in the Saratoga campaign of 1777, France entered the war as an ally of the US, and added the Netherlands and Spain as French allies.", "Britain lost naval superiority and had no major allies and few friends in Europe.", "The British strategy was then refocused on the South, where they expected large numbers of Loyalists would fight alongside the redcoats.", "Far fewer Loyalists took up arms than Britain needed; royal efforts to control the countryside in the South failed." ], [ "United Kingdom\u2013United States relations", "The issue went to arbitration and the Alaska boundary dispute was finally resolved by an arbitration in 1903.", "The decision favoured the US when the British judge sided with the three American judges against the two Canadian judges on the arbitration panel.", "Canadian public opinion was outraged that their interests were sacrificed by London for the benefit of British-American harmony.", "The Great Rapprochement is a term used to describe the convergence of social and political objectives between the United Kingdom and the United States from 1895 until World War I began in 1914.", "The large Irish Catholic element in the US provided a major base for demands for Irish independence, and occasioned anti-British rhetoric, especially at election time.", "The most notable sign of improving relations during the Great Rapprochement was Britain's actions during the Spanish\u2013American War (started 1898).", "Initially Britain supported the Spanish Empire and its colonial rule over Cuba, since the perceived threat of American occupation and a territorial acquisition of Cuba by the United States might harm British trade and commercial interests within its own imperial possessions in the West Indies.", "However, after the United States made genuine assurances that it would grant Cuba's independence (which eventually occurred in 1902 under the terms dictated in the Platt Amendment), the British abandoned this policy and ultimately sided with the United States, unlike most other European powers who supported Spain." ], [ "United Kingdom", "The Jacobites were finally defeated at the Battle of Culloden in 1746, after which the Scottish Highlanders were brutally suppressed.", "The British colonies in North America that broke away from Britain in the American War of Independence became the United States of America, recognised by Britain in 1783.", "British imperial ambition turned towards Asia, particularly to India.", "During the 18th century, Britain was involved in the Atlantic slave trade.", "British ships transported an estimated two million slaves from Africa to the West Indies.", "Parliament banned the trade in 1807, banned slavery in the British Empire in 1833, and Britain took a leading role in the movement to abolish slavery worldwide through the blockade of Africa and pressing other nations to end their trade with a series of treaties.", "The world's oldest international human rights organisation, Anti-Slavery International, was formed in London in 1839.", "The term \"United Kingdom\" became official in 1801 when the parliaments of Britain and Ireland each passed an Act of Union, uniting the two kingdoms and creating the United Kingdom of Great Britain and Ireland.", "In the early 19th century, the British-led Industrial Revolution began to transform the country.", "Gradually political power shifted away from the old Tory and Whig landowning classes towards the new industrialists.", "An alliance of merchants and industrialists with the Whigs would lead to a new party, the Liberals, with an ideology of free trade and \"laissez-faire\"." ] ], "gold": "The United States and Britain became trade allies in 1783, as trade resumed between the two nations when the war ended. The United States and Britain became political allies in 1895, which is known as the The Great Rapprochement. The Great Rapprochement is the convergence of social and political objectives between the United Kingdom and the United States from 1895 until World War I began in 1914.", "prediction 1": "The United States and the United Kingdom became allies in the American Revolution, which began in 1776. The United States and the United Kingdom became allies during the Spanish-American War, which started in 1898.\n", "prediction 2": "The United States and the United Kingdom became allies in the American Revolution, which began on September 19, 1837, and ended in the American Revolution. During the Great Rapprochement, which began in 1895, the two countries became closer and a stronger political alliance was formed between the two countries. The United States and the United Kingdom became closer and closer allies after the Second Continental Congress convened in Philadelphia in May 1775, over-arching goals of which include independence for the United States of America and ownership of the territories newly granted to the US Congress in 1776. The Declaration of Independence was unanimously ratified on 4 July 1776, which was a radical and decisive break for the first colony in the world to successfully achieve independence in the modern era.", "prediction 3": "The United States and the United Kingdom became allies with each other during the American Revolutionary War, which began in 1776. The Great Rapprochement is a term used to describe the convergence of social and political objectives between the United Kingdom and the United States from 1895 until World War I began in 1914.", "prediction 4": "The United States and Great Britain became allies during the American Revolution and World War I. They sided with the United States under the terms of the Platt Amendment in 1902. The terms of the Great Rapprochement are a term used to describe the convergence of social and political objectives between the United Kingdom and the United States from 1895 until World War I began in 1914. The term \"United Kingdom\" became official in 1801 when the parliaments of Britain and Ireland each passed an Act of Union, uniting the two kingdoms and creating the United Kingdom.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 0, "end": 103 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[4]}", "start": 104, "end": 215 } ], "missing-info": [], "corrected-prediction": "The United States and the United Kingdom during The Great Rapprochement beginning in 1895. The Great Rapprochement is a term used to describe the convergence of social and political objectives between the United Kingdom and the United States from 1895 until World War I began in 1914.\n" }, "preference": [ 2, 2, 2, 1, 0, 0 ] }, { "question": "When did the new season of if loving you is wrong start?", "passages": [ [ "If Loving You Is Wrong", "On February 27, 2015, the series was renewed for a second season with 22 more episodes.", "The second season premiered on September 22, 2015.", "The second half premiered on March 15, 2016.", "OWN renewed the series for a third season.", "The third season of the series premiered on September 13, 2016.", "The second half of season 3 premiered on March 21, 2017.", "On August 29, 2017, OWN announced the show's return for the fourth season, which premiered on September 19, 2017.", "The second half of season 4 premiered on January 10, 2018 and ended with the season finale on March 7, 2018.", "On November 28, 2018, OWN announced that the series would return with the fifth season set to premiere in January 2019." ], [ "If Loving You Is Wrong", "If Loving You Is Wrong\n\nIf Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry.", "The series premiered on September 9, 2014.", "It focuses on the lives and relationships of a group of five husbands and wives who live on the same street (Castillo Lane) in the fictional community of Maxine.", "The show stars Amanda Clayton, Edwina Findley, Heather Hemmens, Zulay Henao, and April Parker Jones as the five female leads Alex, Kelly, Marcie, Esperanza and Natalie on \"their quest to find love in the midst of managing very complex lives.\"", "\"If Loving You Is Wrong\" is loosely based on Perry's 2014 film \"The Single Moms Club\".", "Actress Zulay Henao reprised her movie role of Esperanza, although her character and storyline was rebooted for the TV series.", "It was officially ordered straight-to-series on January 9, 2014.", "It premiered on September 9, 2014, on the Oprah Winfrey Network (OWN), and the first half of the first season finale aired on November 4, 2014.", "The series premiere was the highest-rated in OWN history, setting a new record over \"The Haves and the Have Nots\".", "The second half of the first season aired on March 24, 2015." ], [ "Wentworth (TV series)", "On 5 June 2013, it was confirmed that \"Wentworth\" had been renewed for a second season.", "A reporter for the Australian Associated Press said production would begin later in the year, and the season would air in 2014.", "Porter stated: \"We have assembled an extraordinary team of writers who can't wait to get started on series two.", "We have so many more stories to tell.\"", "In January 2014, it was announced that a third season of \"Wentworth\" had been ordered, before the second had aired.", "In a similar manner, a 12-episode fourth season was announced before the airing of the third season on 27 February 2015.", "It began airing from 10 May 2016.", "Cormack confirmed a fifth season had been commissioned on 19 July.", "The twelve-part series premiered on 4 April 2017.", "On 9 May 2017, Showcase announced that the series has been renewed for a sixth season, which premiered on 19 June 2018.", "A seventh season was commissioned in April 2018, before the sixth-season premiere, with filming commencing the following week and a premiere set for 2019.", "On 5 December 2018, it was confirmed that a further 20 episodes had been commissioned, with production beginning in September 2019, and the episodes set to be broadcast through 2020 and 2021." ] ], "gold": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. It premiered on September 9, 2014, on the Oprah Winfrey Network. The second season began on September 13, 2016 and the third season premiered on September 19, 2017. The show ran for five seasons and ended on June 16, 2020.", "prediction 1": "If Loving You Is Wrong is an American prime time television soap opera that focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. The series focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. The first half of the first season aired on March 24, 2015. The second half of the first season aired on March 24, 2015. The series was renewed for a sixth season on June 2018. The series was renewed for a sixth season, which premiered on June 2018. The series was renewed for a seventh season, which premiered on June 2018. The series was renewed for a seventh season, which premiered on May 2019. The series was renewed for a seventh season, which premiered on June 2018.", "prediction 2": "If Loving You Is Wrong is an American prime time television soap opera that focuses on the lives and relationships of a group of five husbands and wives who live on the same street in the fictional community of Maxine. The series is loosely based on Perry\u2019s 2014 film The Single Moms Club. On January 9, 2014, it was announced that a third season of If Loving You Is Wrong had been ordered, before the second had aired. A 12-episode fourth season was announced before the airing of the first half of season 4, 2017, while production began on September 23, 2018.", "prediction 3": "If Loving You Is Wrong is an American prime time television soap opera developed by Tyler Perry that focuses on the lives and relationships of a group of five husbands and wives who live on the same street (Castillo Lane) in the fictional community of Maxine. The first half of the first season, which spanned five seasons, aired from March 23, 2014 to September 9, 2014. On February 27, 2015 the show was renewed for a second season and production for its third season began on September 13, 2016. On August 29, 2017 OWN announced the series's return for a fourth season, which started airing from September 19, 2017. On May 7, 2016 OWN announced the series would return with the fifth season, which continued with production beginning in April 2017 and the fifth season premiered on April 2017. On November 28, 2018, OWN announced the show's return for its sixth season, which finished airing from May 31 October 2019.", "prediction 4": "If Loving You Is Wrong is an American prime time television soap opera that focuses on the lives and relationships of a group of five husbands and wives who live on a street in the fictional community of Maxine. The first half of the first season aired from March 24, 2015 to September 9, 2014. After production finished for a second season of the show, it was renewed for a sixth season, beginning on June 19, 2017. The series returns for a seventh season on September 24, 2019 at 8 p.m. ET. In February 27, 2015, the first episode 23 of the series renewed for a fourth season, which aired on September 5, 2017. On September 19, 2017, show was renewed for a sixth season, starting with new episodes beginning in September 2019. On September 5, 2016, it was announced that the series has been renewed for a sixth season, which will begin filming the following week and premiere set for September 22, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 218 }, { "error type": "Irrelevant", "explanation": "", "start": 219, "end": 372 }, { "error type": "Irrelevant", "explanation": "", "start": 373, "end": 432 }, { "error type": "Irrelevant", "explanation": "", "start": 433, "end": 493 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[9]}", "start": 494, "end": 549 }, { "error type": "Redundant", "explanation": "The series was renewed for a sixth season on June 2018. ", "start": 550, "end": 622 }, { "error type": "Redundant", "explanation": "The series was renewed for a sixth season on June 2018. ", "start": 623, "end": 697 }, { "error type": "Redundant", "explanation": "The series was renewed for a sixth season on June 2018. ", "start": 698, "end": 771 }, { "error type": "Redundant", "explanation": "The series was renewed for a sixth season on June 2018. ", "start": 772, "end": 846 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 9 ] } ], "corrected-prediction": "If Loving You Is Wrong is an American prime time television soap opera created, executive produced, written, and directed by Tyler Perry. It premiered on September 9, 2014, on the Oprah Winfrey Network. The second season premiered on September 22, 2015 and the third season premiered on September 13, 2016. The fourth season premiered on September 19, 2017. It was announced that the series would return with the fifth season set to premiere in January 2019." }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "When was the television introduced to the public?", "passages": [ [ "History of television", "Programming is broadcast by television stations, sometimes called \"channels\", as stations are licensed by their governments to broadcast only over assigned channels in the television band.", "At first, terrestrial broadcasting was the only way television could be widely distributed, and because bandwidth was limited, i.e., there were only a small number of channels available, government regulation was the norm.", "In the U.S., the Federal Communications Commission (FCC) allowed stations to broadcast advertisements beginning in July 1941, but required public service programming commitments as a requirement for a license.", "By contrast, the United Kingdom chose a different route, imposing a television license fee on owners of television reception equipment to fund the British Broadcasting Corporation (BBC), which had public service as part of its Royal Charter.", "WRGB claims to be the world's oldest television station, tracing its roots to an experimental station founded on January 13, 1928, broadcasting from the General Electric factory in Schenectady, NY, under the call letters W2XB.", "It was popularly known as \"WGY Television\" after its sister radio station.", "Later in 1928, General Electric started a second facility, this one in New York City, which had the call letters W2XBS and which today is known as WNBC.", "The two stations were experimental in nature and had no regular programming, as receivers were operated by engineers within the company." ], [ "History of television", "A remote truck could cover outdoor events from up to away from the transmitter, which was located atop the Empire State Building.", "Coaxial cable was used to cover events at Madison Square Garden.", "The coverage area for reliable reception was a radius of 40 to from the Empire State Building, an area populated by more than 10,000,000 people (Lohr, 1940).", "The FCC adopted NTSC television engineering standards on May 2, 1941, calling for 525 lines of vertical resolution, 30 frames per second with interlaced scanning, 60 fields per second, and sound carried by frequency modulation.", "Sets sold since 1939 that were built for slightly lower resolution could still be adjusted to receive the new standard.", "(Dunlap, p31).", "The FCC saw television ready for commercial licensing, and the first such licenses were issued to NBC- and CBS-owned stations in New York on July 1, 1941, followed by Philco's station WPTZ in Philadelphia.", "The first official, paid advertising to appear on American commercial television occurred on the afternoon of July 1, 1941, over New York \nstation WNBT (now WNBC) before a baseball game between the Brooklyn Dodgers and Philadelphia Phillies." ] ], "gold": "WRGB claims to be the world's oldest television station, tracing its roots to an experimental station founded on January 13, 1928, broadcasting from the General Electric factory in Schenectady, NY, under the call letters W2XB. In the U.S., the Federal Communications Commission (FCC) allowed stations to broadcast advertisements beginning in July 1941, but required public service programming commitments as a requirement for a license.", "prediction 1": "The first televisions were introduced to the public on January 13, 1928, when an experimental station founded by General Electric in Schenectady, New York, broadcast from the factory under the call letters W2XB. Later in 1928, General Electric started a second facility, this one in New York City, which had the call letters W2XBS and which today is known as WNBC. The first commercial television licenses were issued to NBC- and CBS-owned stations in New York on July 1, 1941, followed by Philco's station WPTZ in Philadelphia.\n", "prediction 2": "In the United States, television became commercially available on July 1, 1941 when the Federal Communications Commission approved the first commercial television licenses.", "prediction 3": "The first television was officially introduced to the public on January 13, 1928, when an experimental station founded by General Electric broadcast from its Schenectady, New York, factory was formed and the first commercial licenses for commercial broadcasting were issued to NBC-owned, CBS-owned stations in New York on July 1, 1941.", "prediction 4": "The first television set was officially introduced to the public on January 13, 1928, when an experimental station was founded at the General Electric factory in Schenectady, New York & later, in 1929, a facility in New York City named W2XBS or just WNBC. Television was first licensed to broadcast commercially on July 1, 1941, the day the first official, paid advertising to appear on American commercial television occurred - on the afternoon of July 1, 1941, over New York station WNBT before a baseball game between the Brooklyn Dodgers and Philadelphia Philco's station WPTZ in Philadelphia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 212, "end": 364 }, { "error type": "Irrelevant", "explanation": "", "start": 365, "end": 529 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[5]}", "start": 0, "end": 51 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Worlds oldest television station was introduced to the public on January 13, 1928, when an experimental station founded by General Electric in Schenectady, New York, broadcast from the factory under the call letters W2XB. In the U.S., the Federal Communications Commission (FCC) allowed stations to broadcast advertisements beginning in July 1941, but required public service programming commitments as a requirement for a license." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When was nanda devi national park added to the unesco list of world heritage?", "passages": [ [ "Nanda Devi and Valley of Flowers National Parks", "Nanda Devi and Valley of Flowers National Parks\n\nThe Nanda Devi National Park and Valley of Flowers National Parks is an UNESCO World Heritage Site in Uttarakhand, India.", "It possesses of two core areas about 20km apart, made up by the Nanda Devi National Park and the Valley of Flowers National Park, plus an encompassing Combined Buffer Zone.", "In 1988 the site was inscribed as \"Nanda Devi National Park (India)\".", "In 2005 it was expanded to encompass the Valley of Flowers National Park and a larger buffer zone and it was renamed to \"Nanda Devi and Valley of Flowers National Parks\".", "The areas of the site are" ] ], "gold": "The Nanda Devi National Park was inscribed a World Heritage Site by UNESCO in 1988. It was expanded and renamed to Nanda Devi and Valley of Flowers National Parks in 2005.", "prediction 1": "The Nanda Devi National Park and Valley of Flowers National Parks is an UNESCO World Heritage Site in Uttarakhand, India. In 1988 the site was inscribed as \"Nanda Devi National Park (India). In 2005 it was expanded to encompass the Valley of Flowers National Park and a larger buffer zone and it was renamed to \"Nanda Devi and Valley of Flowers National Parks\".\n", "prediction 2": "Nanda Devi National Park and Valley of Flowers National Parks is an UNESCO World Heritage Site in Uttarakhand, India. In 1988 the site was inscribed as \"Nanda Devi National Park (India). In 2005 it was expanded to encompass the Valley of Flowers National Park and a larger buffer zone and it was renamed to \"Nanda Devi and Valley of Flowers National Parks\".", "prediction 3": "The Nanda Devi National Park and Valley of Flowers National Parks is an UNESCO World Heritage Site in Uttarakhand, India. In 1988 the site was inscribed as \"Nanda Devi National Park (India).\"", "prediction 4": "The Nanda Devi National Park and Valley of Flowers National Parks is an UNESCO World Heritage Site in Uttarakhand, India. It possesses of two core areas about 20km apart, made up by the Nanda Devi National Park and the Valley of Flowers National Park, plus an encompassing Combined Buffer Zone. In 1988 the site was inscribed as \"Nanda Devi National Park (India). In 2005 it was expanded to encompass the Valley of Flowers National Park and a larger buffer zone and it was renamed to \"Nanda Devi National Park and Valley of Flowers National Park and Valley of Flowers National Parks\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 121 }, { "error type": "Irrelevant", "explanation": "", "start": 153, "end": 190 }, { "error type": "Irrelevant", "explanation": "", "start": 215, "end": 288 } ], "missing-info": [], "corrected-prediction": "In 1988 the site was inscribed. In 2005 it was expanded and renamed to \"Nanda Devi and Valley of Flowers National Parks\".\n" }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "How many rick and morty episodes are out in season 3?", "passages": [ [ "Rick and Morty (season 2)", "Wes Archer, Dominic Polcino, Bryan Newton and Juan Meza-Le\u00f3n served as directors, while series co-creators Justin Roiland and Dan Harmon, Matt Roller, David Phillips, Ryan Ridley, Mike McMahan, Tom Kauffman, Dan Guterman and Alex Rubens served as writers.", "All episodes in the first season originally aired in the United States on Adult Swim.", "All episodes are rated TV-14, with the exception of \"Interdimensional Cable 2: Tempting Fate\", which was rated TV-MA.", "The second season was released on DVD (Region 1) and Blu-ray on June 7, 2016." ] ], "gold": "Season 3 of Rick and Morty, 2017, contained 10 episodes. Episode 1 was released in April. Episode 2 was released in July. Episodes 3, 4, 5, and 6 were released in August. Episodes 7, 8, and 9 were released in September, and episode 10 was released in October.", "prediction 1": "There are 3 seasons of Rick and Morty. Season 3 episodes are out in the United States and Canada.\n", "prediction 2": "There are 4 seasons of Rick and Morty. 7) There are 10 episodes in season 3 (8) And there are 17 episodes in season 3 (3). 8 episodes are out in season 3 (3).", "prediction 3": "How many episodes were in Season 3?", "prediction 4": "There are 7 episodes in season 3 of Rick and Morty. They air on Adult Swim and are rated TV-14. Season 3 finale aired on January 25, 2020.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 38 }, { "error type": "Irrelevant", "explanation": "", "start": 39, "end": 98 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 0, 1, 1, 1, 0, 2 ] }, { "question": "Who was the last british female to win wimbledon?", "passages": [ [ "Virginia Wade", "Virginia Wade\n\nSarah Virginia Wade, (born 10 July 1945) is a former professional tennis player from Great Britain.", "She won three Grand Slam singles championships and four Grand Slam doubles championships, and is the only British woman in history to have won titles at all four Grand Slam tournaments.", "She was ranked as high as No. 2 in the world in singles, and No. 1 in the world in doubles.", "Three times a Grand Slam singles champion, her most famous success was winning Wimbledon on 1 July 1977, the tournament's centenary year, and the year of the Silver Jubilee of Queen Elizabeth II (the Queen attended Wimbledon for the first time since 1962 to watch the final).", "Wade was the last British tennis player to have won a Grand Slam singles tournament until Andy Murray won the US Open in 2012.", "She remains the most recent British woman to have won a Grand Slam singles title.", "After retiring from competitive tennis, she coached for four years and has also worked as a tennis commentator and game analyst for the BBC and Eurosport.", "On 10 July 1945, Wade was born in Bournemouth, England.", "Her father was the Archdeacon of Durban.", "At age one, Wade moved to South Africa with her parents.", "In South Africa, Wade learned to play tennis.", "When Wade was 15, the family moved back to England and she went to Tunbridge Wells Girls' Grammar School and Talbot Heath School, Bournemouth." ], [ "Heather Watson", "Heather Watson\n\nHeather Miriam Watson (born 19 May 1992) is a British professional tennis player and a Wimbledon mixed doubles champion.", "She is a former British No. 1 and current British No. 2 behind Johanna Konta \n\nShe won the Mixed Doubles title at the 2016 Wimbledon Championships with Henri Kontinen.", "In October 2012, Watson won her first WTA singles title at the Japan Open, becoming the first British female to win a WTA singles title since Sara Gomer in 1988.", "In her junior career, Watson won the US Open and gold at the 2008 Commonwealth Youth Games.", "She reached No. 3 in the world on the ITF Junior Circuit.", "Heather Watson was born on Guernsey to Michelle and Ian Watson.", "Her mother is from Papua New Guinea and her father is British, the managing director of Guernsey Electricity from 1995 until retirement in 2010.", "She has one brother and two sisters.", "Heather Watson started playing tennis at the age of seven, and at age twelve she went to the Nick Bollettieri Tennis Academy in Florida.", "In 2006, Watson won the British Under-14 Championship.", "The following year she won the British Under-16 Championship, and reached the semifinals of the British Under-18 Championship.", "She lost in the Under-18 semifinals again in 2008 to eventual winner Tara Moore.", "In October, Watson travelled to Pune in India to compete at the 2008 Commonwealth Youth Games." ], [ "All England Lawn Tennis and Croquet Club", "In December 2016, it was announced that the Duchess of Cambridge would succeed The Queen as Patron of The AELTC and The Championships, effective January 2017.", "Black players were not allowed to play at the Club until 1951, and Jews were not admitted until 1952.", "According to Angela Buxton, the Jewish former British Wimbledon doubles champion, it also has led to her exclusion.", "Buxton said in 2004, reflecting on the fact that the All England Club, almost 50 years after Buxton's 1956 Wimbledon triumph with Althea Gibson, had still not invited Buxton to join: \"I think the anti-Semitism is still there.", "The mere fact that I'm not a member is a full sentence that speaks for itself.\"", "Buxton told \"New York Post\" reporter Marc Berman that she had been on the \"waiting list\" since she applied in the 1950s.", "\"I wish it still wasn't such an elite sport,\" Buxton told Berman.", "\"I wish we could bring it down to a common baseline.", "It's going that way.", "It's still not there.\"" ] ], "gold": "The last British female to win at Wimbledon in women's singles was Virginia Wade. Angela Buxton was the last British female to win as part of the women's doubles, and Heather Watson was the last British female to win as part of the mixed doubles at Wimbeldon.", "prediction 1": "There are several British women who have won Wimbledon. The last British woman to win Wimbledon was Virginia Wade in 1977. Heather Watson won the Mixed Doubles title at the 2016 Wimbledon Championships with Henri Kontinen.\n", "prediction 2": "Twenty years after Virginia Wade won Wimbledon, Heather Watson has won the tournament as a member of the WTA. She is the current British No. 2 in the WTA Singles Rankings, one place ahead of Johanna Konta.", "prediction 3": "Virginia Wade is a former professional tennis player from Great Britain. She won three Grand Slam singles championships and four Grand Slam doubles championships. She is the only British woman in history to have won titles at all four Grand Slam tournaments. Heather Watson is a British professional tennis player and a Wimbledon mixed doubles champion. She won the Mixed Doubles title at the 2016 Wimbledon Championships with Henri Kontinen.", "prediction 4": "The last British women to win Wimbledon was Virginia Wade in 1977. Heather Watson last won the tournament in November 2016 as the first British female to win a Grand Slam singles title since Sara Gomer in 1988. The previous British female to win Wimbledon was Heather Watson in 2016.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 3 ] } ], "corrected-prediction": "There are several British women who have won Wimbledon. The last British woman to win Wimbledon was Virginia Wade in 1977. Heather Watson won the Mixed Doubles title at the 2016 Wimbledon Championships with Henri Kontinen. Angela Buxton is the former British Wimbledon doubles champion.\n" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "When did the old pound coin come into circulation?", "passages": [ [ "One pound (British coin)", "One pound (British coin)\n\n", "The British one pound (\u00a31) coin is a denomination of the pound sterling.", "Its obverse bears the Latin engraving ELIZABETH II D G REG \u201cDei Gratia Regina\u201d meaning, \u201cElizabeth II, by the grace of God, Queen\u201d and F D meaning \"Fidei defensor\", Defender of the Faith.", "It has featured the profile of Queen Elizabeth II since the original coin's introduction on 21 April 1983.", "Four different portraits of the Queen have been used, with the latest design by Jody Clark being introduced in 2015.", "The design on the reverse side of the current, 12-sided coin features four emblems to represent each of the nations of the United Kingdom \u2013 the English rose, the leek for Wales, the Scottish thistle, and the shamrock for Northern Ireland \u2013 emerging from a single stem within a crown.", "The original, round \u00a31 coin replaced the Bank of England \u00a31 note, which ceased to be issued at the end of 1984 and was removed from circulation on 11 March 1988, though still redeemable at the Bank's offices, like all English banknotes.", "One-pound notes continue to be issued in Jersey, Guernsey and the Isle of Man, and by the Royal Bank of Scotland, but the pound coin is much more widely used." ], [ "Fifty pence (British coin)", "As with all new decimal currency, until 1984 the portrait of Queen Elizabeth II by Arnold Machin appeared on the obverse, in which the Queen wears the 'Girls of Great Britain and Ireland' Tiara.", "Between 1985 and 1997 the portrait by Raphael Maklouf was used, in which the Queen wears the George IV State Diadem.", "In 1997 the 50p coin was reduced in both diameter and thickness and the older coins were removed from circulation.", "The design remained unchanged.", "From 1998 to 2015 the portrait by Ian Rank-Broadley has been used, again featuring the tiara, with a signature-mark below the portrait.", "In 2008 the obverse design was rotated slightly, to match the new reverse design which is displayed with the heptagon point down rather than point up.", "As of June 2015, coins bearing the portrait by Jody Clark have been seen in circulation.", "In August 2005 the Royal Mint launched a competition to find new reverse designs for all circulating coins apart from the \u00a32 coin.", "The winner, announced in April 2008, was Matthew Dent, whose designs were gradually introduced into the circulating British coinage from mid-2008.", "The designs for the 1p, 2p, 5p, 10p, 20p and 50p coins depict sections of the Royal Shield that form the whole shield when placed together.", "The shield in its entirety is featured on the \u00a31 coin." ], [ "Ten pence (British coin)", "As of March 2014 there were an estimated 1,631 million 10p coins in circulation with an estimated face value of \u00a3163.080 million.", "To date, four different obverses have been used.", "In all cases, the inscription until 2015 was , where 2013 is replaced by the year of minting.", "In the original design both sides of the coin are encircled by dots, a common feature on coins, known as beading.", "As with all new decimal currency, until 1984 the portrait of Queen Elizabeth II by Arnold Machin appeared on the obverse, in which the Queen wears the 'Girls of Great Britain and Ireland' Tiara.", "Between 1985 and 1997 the portrait by Raphael Maklouf was used, in which the Queen wears the George IV State Diadem.", "On 30th September 1992 a reduced size version of the 10 pence coin was introduced.", "The older and larger version of the coin was withdrawn from circulation on 30th June 1993.", "The design remained unchanged.", "From 1998 to 2015 the portrait by Ian Rank-Broadley was used, again featuring the tiara, with a signature-mark below the portrait.", "As of June 2015, coins bearing the portrait by Jody Clark have been seen in circulation." ] ], "gold": "The British one pound (\u00a31) coin is a denomination of the pound sterling. It has featured the profile of Queen Elizabeth II since the original coin's introduction on 21 April 1983. Between 1985 and 1997 the portrait by Raphael Maklouf was used, in which the Queen wears the George IV State Diadem. Between 1998 and 2015 the portrait by Ian Rank-Broadley was used, again featuring the tiara, with a signature-mark IRB below the portrait.", "prediction 1": "The British one pound coin is a denomination of the pound sterling. Its obverse bears the Latin engraving ELIZABETH II D G REG \u201cDei Gratia Regina\u201d meaning, \u201cElizabeth II, by the grace of God, Queen\u201d and F D meaning \"Fidei defensor\", Defender of the Faith. The design on the reverse side of the current, 12-sided coin features four emblems to represent each of the nations of the United Kingdom \u2013 the English rose, the leek for Wales, the Scottish thistle, and the shamrock for Northern Ireland.\n", "prediction 2": "On 21 April 1983, the British one pound coin was introduced. The old pound coin had come into circulation from June 1993 to October 2005. From 2005 to 2015, four different portraits of the Queen have been used. The current design on the reverse side of the pound coin features four emblems to represent each of the nations of the United Kingdom emerging from a single stem within a crown. The design on the obverse of the current, 12-sided coin features four emblems to represent the English rose, the leek for Wales, the Scottish thistle, and the shamrock for Northern Ireland.", "prediction 3": "The British one pound coin is a denomination of the pound sterling. Its obverse bears the Latin engraving ELIZABETH II D G REG \u201cDei Gratia Regina\u201d meaning, \u201cElizabeth II, by the grace of God, Queen\u201d and F D meaning, Defender of the Faith. They were first issued on 21 April 1983. In January 1988 the Bank of England stopped issuing the round one pound coin. The current one pound coin replaced the Bank of England's \u00a31 note, which was removed from circulation on 11 March 1988.", "prediction 4": "The British one pound coin is a denomination of the pound sterling. Its obverse bears the Latin engraving ELIZABETH II D G REG meaning, \u201cElizabeth II, by the grace of God, Queen\u201d and F D meaning, Defender of the Faith. The portrait of Queen Elizabeth II on the obverse of the original coin was created by Arnold Machin in 1984. The portrait was later replaced by the portrait of Raphael Maklouf in 1997, and the old 50p coin was reduced in both diameter and thickness and removed from circulation.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 68, "end": 255 }, { "error type": "Irrelevant", "explanation": "", "start": 256, "end": 495 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The British one pound coin is a denomination of the pound sterling. It has featured the profile of Queen Elizabeth II since the original coin's introduction on 21 April 1983. " }, "preference": [ 2, 2, 1, 2, 1, 1 ] }, { "question": "How many episodes is there in the handmaid's tale?", "passages": [ [ "The Handmaid's Tale (TV series)", "The Handmaid's Tale (TV series)\n\n", "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood.", "It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016.", "The plot features a dystopian future following a Second American Civil War wherein a totalitarian society subjects fertile women, called \"Handmaids\", into child-bearing servitude.", "The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday.", "In May 2017, the series was renewed for a second season which premiered on April 25, 2018.", "\"The Handmaid's Tale\" has received widespread critical acclaim and its first season won eight Primetime Emmy Awards from thirteen nominations, including Outstanding Drama Series.", "It is the first show produced by Hulu to win a major award as well as the first series on a streaming service to win an Emmy for Outstanding Series.", "It also became the first streaming series to win the Golden Globe Award for Best Television Series \u2013 Drama.", "Elisabeth Moss was also awarded the Golden Globe for Best Actress.", "In May 2018, Hulu announced that the series had been renewed for a third season." ], [ "The Handmaid's Tale (TV series)", "Joseph Fiennes, Madeline Brewer, and Yvonne Strahovski were cast in August 2016, followed by O. T. Fagbenle and Amanda Brugel in September 2016.", "In October 2016, Ever Carradine joined the cast, and Alexis Bledel was added in January 2017.", "Filming on the series took place in Toronto, Mississauga, Hamilton, Burlington, Oakville, and Cambridge, Ontario, from September 2016 to February 2017.", "The first full trailer of the TV series was released by Hulu on YouTube on March 23, 2017.", "The series premiered on April 26, 2017.", "On May 3, 2017, \"The Handmaid's Tale\" was renewed for a second season to premiere in 2018.", "Moss told the news media that the subsequent episodes would cover further developments in the story, filling in some of the unanswered questions and continuing the narrative already \"finished\" in the book.", "The second season consists of 13 episodes and began filming in fall 2017.", "Alexis Bledel returned as a series regular.", "Showrunner Bruce Miller stated that he envisioned 10 seasons of the show, stating, \"Well, you know, honestly, when I started, I tried to game out in my head what would ten seasons be like?" ] ], "gold": "The are several seasons of the television series The Handmaid's Tale. Seasons 1 and 4 of the series each have 10 episodes, while Seasons 2 and 3 of the series each have 13 episodes.", "prediction 1": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018.\n", "prediction 2": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on a 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The series premiered on April 26, 2017 and ran for three seasons, from 2017 to 2018. It was renewed in 2017 for season 2, which aired for seven additional episodes, but didn't run for longer than seven hours, and ran for three at first three episodes. Both seasons of Handmaid's Tale found their first and second seasons 3 seasons, which ran from April 25, 2017. In May 2017, the series was renewed for another season with a third season; season 2 consisted of 3 episodes. The first season 128 episodes consisted of 14 episodes, and the third season.", "prediction 3": "The fourth season of the American dystopian crime drama series The Handmaid's Tale ran for 7 episodes from April 2017 to May 2018. It consisted of 24 episodes total, airing on a weekly basis every Wednesday for seven weeks, and three weeks for three.", "prediction 4": "The Handmaid's Tale is an American dystopian drama television series created by Bruce Miller, based on the 1985 novel of the same name by Margaret Atwood. It was ordered by the streaming service Hulu as a straight-to-series order of 10 episodes, for which production began in late 2016. The first three episodes of the series premiered on April 26, 2017; the subsequent seven episodes aired on a weekly basis every Wednesday. In May 2017, the series was renewed for a second season which premiered on April 25, 2018. The second season consists of 13 episodes and began filming in fall 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 287, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 482, "end": 517 }, { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 461 }, { "error type": "Irrelevant", "explanation": "", "start": 20, "end": 50 }, { "error type": "Irrelevant", "explanation": "", "start": 69, "end": 154 }, { "error type": "Irrelevant", "explanation": "", "start": 155, "end": 229 }, { "error type": "Irrelevant", "explanation": "", "start": 246, "end": 286 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "The are two seasons of the television series The Handmaid's Tale. Season 1 of the series have 10 episodes, while Season 2 of the series have 13 episodes.\n\n \n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "When was the first battle royale game made?", "passages": [ [ "Battle royale game", "Battle royale game\n\n", "A battle royale game, also spelled battle royal, is a video game genre that blends the survival, exploration and scavenging elements of a survival game with last-man-standing gameplay.", "Battle royale games challenge a large number of players, starting with minimal equipment, to search for weapons and armor and eliminate all other opponents while avoiding being trapped outside of a shrinking \"safe area\", with the winner being the last competitor in the game.", "The name for the genre is taken from the 2000 Japanese film \"Battle Royale\", which presents a similar theme of a last-man-standing competition in a shrinking play zone.", "The genre's origins arose from mods for large-scale online survival games like \"Minecraft\" and \"ARMA 2\", before becoming popularized with standalone games such as \"PlayerUnknown's Battlegrounds\", which had sold over 50 million copies by June 2018.", "The same year, the free-to-play \"Fortnite Battle Royale\" rapidly became a cultural phenomenon, overtaking \"Battlegrounds\" in terms of player numbers and revenue.", "Battle royale games are played between a large number of individual players, or a number of small squads (typically up to four or five players).", "In each match, the goal is to be the last player or team standing by eliminating all other opponents." ], [ "Battle royale game", "Gameplay modes featuring last man standing rules has been a frequent staple of multiplayer online action games though generally with fewer total players as early as 1990's \"Bomberman\" which introduced multiplayer game modes, with players, all starting with the same minimal abilities, collected powerups and fought until the last players was left standing.", "The elements of scavenging and surviving on a large open-world map were popularized through survival games.", "Shortly after the release of the film \"The Hunger Games\" in 2012, a server plug-in named Hunger Games (later changed to Survival Games) was developed for Minecraft.", "Survival Games takes inspiration from the film, initially placing players at the center of the map near a set of equipment chests.", "When the game commences, players can compete over the central resources or spread out to find items stored in chests scattered around the play area.", "Players killed are eliminated and the last surviving player wins the match.", "In \"DayZ\", a mod for \"ARMA 2\", players struggle alongside or against each other to obtain basic necessities to continue living in a persistent sandbox filled with various dangers.", "These games were designed to include player versus player encounters, but generally these events were infrequent due to the size of the game's map and the persistence of the game world." ] ], "gold": "A battle royale game is an online multiplayer video game genre that blends last-man-standing gameplay with the survival, exploration, and scavenging elements of a survival game. Gameplay modes featuring last-man-standing rules has been a frequent staple of multiplayer online action games, though generally with fewer total players, as early as Bomberman in 1990. Shortly after the release of the 2012 film The Hunger Games, which had a similar premise to the earlier film Battle Royale, a server plug-in named Hunger Games, later changed to Survival Games, was developed for Minecraft. This was was the first game considered to be in the battle royale genre.", "prediction 1": "A battle royale game is a video game genre that blends the survival, exploration and scavenging elements of a survival game with last-man-standing gameplay. The genre's origins arose from mods for large-scale online survival games like \"Minecraft\" and \"ARMA 2\", before becoming popularized with standalone games such as \"PlayerUnknown's Battlegrounds\", which had sold over 50 million copies by June 2018. The first battle royale game was made in 2010 and was based on the 2000 Japanese film Battle Royale, which presents a similar theme of a last-man-standing competition in a shrinking play zone, with the winner being the last competitor in the game.\n", "prediction 2": "The battle royale genre is a video game genre that blends the survival, exploration, and scavenging elements of a survival game with last-man-standing gameplay. The genre's origins arose from mods for large-scale online survival games like \"Minecraft\" and \"ARMA 2\", before becoming popularized with standalone games such as \"PlayerUnknown's Battlegrounds\", which had sold over 50 million copies by June 2018. The first battle royale game was made in 2003 and is mainly on small squads up to four or five players. As of 2002, Battle Royale is a mod for online survival games for the Oorangers in Japan.", "prediction 3": "The first battle royale game was made in 2015 and was branded as Major Nelson's Last Stand. Battle royale games blend the survival, exploration and scavenging elements of a survival game with last-man-standing gameplay. Battle royale games challenge a large number of players, starting with minimal equipment, to search for weapons and armor and eliminate all other opponents while avoiding being trapped outside of a shrinking \"safe area\", with the winner being the last competitor in the game.", "prediction 4": "A battle royale game is a video game genre that blends the survival, exploration and scavenging elements of a survival game with last-man-standing gameplay. Originally, battle royale games were made in 2016 in online multiplayer games such as Survival Wars. In the 2014-2020 timeframe, the genre became more prominent among standalone survival games such as PlayerUnknown's Battlegrounds. In 2018, the free-to-play Battle Royale game Fornite Battle Royale rapidly became a cultural phenomenon, with the winner being the last competitor in the game.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 506, "end": 653 }, { "error type": "Unverifiable", "explanation": "", "start": 405, "end": 450 }, { "error type": "Irrelevant", "explanation": "", "start": 262, "end": 404 }, { "error type": "Irrelevant", "explanation": "", "start": 451, "end": 505 }, { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 261 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "A battle royale game is a video game genre that blends the survival, exploration and scavenging elements of a survival game with last-man-standing gameplay. For example, the former of those two had a server plug in named Hunger Games, later changed in name to Survival Games, developed for it shortly after the release of the film \"The Hunger Games\" in 2012. Indeed, gameplay modes featuring last-man-standing rules have been a frequent staple of multiplayer online action games, though generally with fewer total players, since as early as 1990's Bomberman. \n" }, "preference": [ 1, 1, 1, 2, 2, 2 ] }, { "question": "Where does the flow of energy in an ecosystem begin?", "passages": [ [ "Solar energy", "The latent heat of water condensation amplifies convection, producing atmospheric phenomena such as wind, cyclones and anti-cyclones.", "Sunlight absorbed by the oceans and land masses keeps the surface at an average temperature of 14\u00a0\u00b0C.", "By photosynthesis, green plants convert solar energy into chemically stored energy, which produces food, wood and the biomass from which fossil fuels are derived.", "The total solar energy absorbed by Earth's atmosphere, oceans and land masses is approximately 3,850,000\u00a0exajoules (EJ) per year.", "In 2002, this was more energy in one hour than the world used in one year.", "Photosynthesis captures approximately 3,000\u00a0EJ per year in biomass.", "The amount of solar energy reaching the surface of the planet is so vast that in one year it is about twice as much as will ever be obtained from all of the Earth's non-renewable resources of coal, oil, natural gas, and mined uranium combined,\n\nThe potential solar energy that could be used by humans differs from the amount of solar energy present near the surface of the planet because factors such as geography, time variation, cloud cover, and the land available to humans limit the amount of solar energy that we can acquire.", "Geography affects solar energy potential because areas that are closer to the equator have a greater amount of solar radiation." ], [ "Solar energy", "Solar energy\n\nSolar energy is radiant light and heat from the Sun that is harnessed using a range of ever-evolving technologies such as solar heating, photovoltaics, solar thermal energy, solar architecture, molten salt power plants and artificial photosynthesis.", "It is an important source of renewable energy and its technologies are broadly characterized as either passive solar or active solar depending on how they capture and distribute solar energy or convert it into solar power.", "Active solar techniques include the use of photovoltaic systems, concentrated solar power and solar water heating to harness the energy.", "Passive solar techniques include orienting a building to the Sun, selecting materials with favorable thermal mass or light-dispersing properties, and designing spaces that naturally circulate air.", "The large magnitude of solar energy available makes it a highly appealing source of electricity.", "The United Nations Development Programme in its 2000 World Energy Assessment found that the annual potential of solar energy was 1,575\u201349,837 exajoules (EJ).", "This is several times larger than the total world energy consumption, which was 559.8\u00a0EJ in 2012.", "In 2011, the International Energy Agency said that \"the development of affordable, inexhaustible and clean solar energy technologies will have huge longer-term benefits." ], [ "Photosynthesis", "Photosynthesis\n\nPhotosynthesis is a process used by plants and other organisms to convert light energy into chemical energy that can later be released to fuel the organisms' activities.", "This chemical energy is stored in carbohydrate molecules, such as sugars, which are synthesized from carbon dioxide and water \u2013 hence the name \"photosynthesis\", from the Greek \u03c6\u1ff6\u03c2, \"ph\u014ds\", \"light\", and \u03c3\u03cd\u03bd\u03b8\u03b5\u03c3\u03b9\u03c2, \"synthesis\", \"putting together\".", "In most cases, oxygen is also released as a waste product.", "Most plants, most algae, and cyanobacteria perform photosynthesis; such organisms are called photoautotrophs.", "Photosynthesis is largely responsible for producing and maintaining the oxygen content of the Earth's atmosphere, and supplies all of the organic compounds and most of the energy necessary for life on Earth.", "Although photosynthesis is performed differently by different species, the process always begins when energy from light is absorbed by proteins called reaction centres that contain green chlorophyll pigments.", "In plants, these proteins are held inside organelles called chloroplasts, which are most abundant in leaf cells, while in bacteria they are embedded in the plasma membrane.", "In these light-dependent reactions, some energy is used to strip electrons from suitable substances, such as water, producing oxygen gas." ] ], "gold": "The flow of energy in an ecosystem originates from solar energy, which is radiant light and heat from the Sun, and the first step in the flow of energy in an ecosystem when it reaches Earth is photosynthesis, a process used by plants and other organisms to convert light energy into chemical energy.", "prediction 1": "The process of photosynthesis, a process used by plants to convert light energy into chemical energy that can later be released to fuel the organisms' activities, begins when energy from light is absorbed by proteins called reaction centres that contain green chlorophyll pigments.\n", "prediction 2": "In an ecosystem, the energy flow begins when light is absorbed by proteins called reaction centres that contain green chlorophyll pigments, which are found in leaf cells, soil and by the latent heat of water condensation. The whole process of photosynthesis begins when energy from light is absorbed by chloroplasts, which are enzymes found in green plants and bacteria, and ends when energy is released by chemical reactions that begin in the plasma membrane.", "prediction 3": "In an ecosystem, the flow of energy begins in the water cycle and branches into the atmosphere and oceans. In total, the oceans absorb more than 5% of the energy absorbed by the Earth's atmosphere, while its surface absorbs less than 1%. In plants, photosynthesis begins in the chloroplasts, where green pigments, typically chlorophyll, are incorporated.", "prediction 4": "Contact with the Sun, watervapor, and dissolved oxygen create water vapour that flows through biology as organic compounds and energy. An ecosystem's energy flow begins midway through the plant life cycle, when water evaporates and enters the atmosphere.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 101, "end": 162 }, { "error type": "Irrelevant", "explanation": "", "start": 170, "end": 282 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The process of photosynthesis, a process used by plants and other organisms to convert light energy into chemical energy, with radiant light and heat coming from the Sun. \n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the gold standard end in the us?", "passages": [ [ "History of the United States dollar", "During the Great Depression, every major currency abandoned the gold standard.", "Among the earliest, the Bank of England abandoned the gold standard in 1931 as speculators demanded gold in exchange for currency, threatening the solvency of the British monetary system.", "This pattern repeated throughout Europe and North America.", "In the United States, the Federal Reserve was forced to raise interest rates in order to protect the gold standard for the US dollar, worsening already severe domestic economic pressures.", "After bank runs became more pronounced in early 1933, people began to hoard gold coins as distrust for banks led to distrust for paper money, worsening deflation and depleting gold reserves.", "In early 1933, in order to fight severe deflation Congress and President Roosevelt implemented a series of Acts of Congress and Executive Orders which suspended the gold standard except for foreign exchange, revoked gold as universal legal tender for debts, and banned private ownership of significant amounts of gold coin.", "These acts included Executive Order 6073, the Emergency Banking Act, Executive Order 6102, Executive Order 6111, the Agricultural Adjustment Act, 1933 Banking Act, House Joint Resolution 192, and later the Gold Reserve Act.", "These actions were upheld by the U.S. Supreme Court in the \"Gold Clause Cases\" in 1935." ], [ "History of the United States dollar", "At the onset of the war, U.S. corporations had large debts payable to European entities, who began liquidating their debts in gold.", "With debts looming to Europe, the dollar to British pound exchange rate reached as high as $6.75, far above the (gold) parity of $4.8665.", "This caused large gold outflows until July 31, 1914, when the New York Stock Exchange closed and the gold standard was temporarily suspended.", "In order to defend the exchange value of the dollar, the US Treasury Department authorized state and nationally chartered banks to issue emergency currency under the Aldrich-Vreeland Act, and the newly created Federal Reserve organized a fund to assure debts to foreign creditors.", "These efforts were largely successful, and the Aldrich-Vreeland notes were retired starting in November and the gold standard was restored when the New York Stock Exchange re-opened in December 1914.", "As the United States remained neutral in the war, it remained the only country to maintain its gold standard, doing so without restriction on import or export of gold from 1915 to 1917.", "During the participation of the United States as a belligerent, President Wilson banned gold export, thereby suspending the gold standard for foreign exchange.", "After the war, European countries slowly returned to their gold standards, though in somewhat altered form." ], [ "History of the United States dollar", "This issue split the Democratic Party in 1896.", "It led to the famous \"cross of gold\" speech given by William Jennings Bryan, and may have inspired many of the themes in \"The Wizard of Oz\".", "Despite the controversy, the status of silver was slowly diminished through a series of legislative changes from 1873 to 1900, when a gold standard was formally adopted.", "The gold standard survived, with several modifications, until 1971.", "Bimetallism persisted until March 14, 1900, with the passage of the Gold Standard Act, which provided that:\n\n...", "the dollar consisting of twenty-five and eight-tenths grains (1.67 g) of gold nine-tenths fine, as established by section thirty-five hundred and eleven of the Revised Statutes of the United States, shall be the standard unit of value, and all forms of money issued or coined by the United States shall be maintained at a parity of value with this standard ...", "Thus the United States moved to a gold standard, making both gold and silver the legal-tender coinage of the United States, and guaranteed the dollar as convertible to 1.5 g (23.22 grains) of gold.", "The gold standard was suspended twice during World War I, once fully and then for foreign exchange." ], [ "History of the United States dollar", "For foreign exchange purposes, the set $20.67 per ounce value of the dollar was lifted, allowing the dollar to float freely in foreign exchange markets with no set value in gold.", "This was terminated after one year.", "Roosevelt attempted first to restabilize falling prices with the Agricultural Adjustment Act; however, this did not prove popular, so instead the next politically popular option was to devalue the dollar on foreign exchange markets.", "Under the Gold Reserve Act the value of gold was fixed at $35 per ounce, making the dollar more attractive for foreign buyers (and making foreign currencies more expensive for those holding dollars).", "This change led to more conversion of gold into dollars, allowing the U.S. to effectively corner the world gold market.", "The suspension of the gold standard was considered temporary by many in markets and in the government at the time, but restoring the standard was considered a low priority to dealing with other issues.", "Under the post-World War II Bretton Woods system, all other currencies were valued in terms of U.S. dollars and were thus indirectly linked to the gold standard.", "The need for the U.S. government to maintain both a $35 per troy ounce (112.53 \u00a2/g) market price of gold and also the conversion to foreign currencies caused economic and trade pressures." ], [ "Nixon shock", "On August 9, 1971, as the dollar dropped in value against European currencies, Switzerland left the Bretton Woods system.", "The pressure began to intensify on the United States to leave Bretton Woods.", "At the time, the U.S. also had an unemployment rate of 6.1% (August 1971)\n\nTo combat these problems, President Nixon consulted Federal Reserve chairman Arthur Burns, incoming Treasury Secretary John Connally, and then Undersecretary for International Monetary Affairs and future Fed Chairman Paul Volcker.", "On the afternoon of Friday, August 13, 1971, these officials along with twelve other high-ranking White House and Treasury advisors met secretly with Nixon at Camp David.", "There was great debate about what Nixon should do, but ultimately Nixon, relying heavily on the advice of the self-confident Connally, decided to break up Bretton Woods by suspending the convertibility of the dollar into gold; freezing wages and prices for 90 days to combat potential inflationary effects; and impose an import surcharge of 10 percent, to prevent a run on the dollar, stabilize the US economy, and decrease US unemployment and inflation rates, on August 15, 1971:\n\n\nSpeaking on television on August 15, the Sunday before the markets opened, Nixon said the following:\n\nThe American public felt the government was rescuing them from price gougers and from a foreign-caused exchange crisis." ] ], "gold": "The United States formally adopted the gold standard in 1900. The gold standard was suspended twice during World War I and then during the Great Depression when every major currency abandoned the gold standard. In early 1933, in order to fight severe deflation, Congress and President Roosevelt implemented a series of Acts of Congress and Executive Orders which suspended the gold standard except for foreign exchange, and while the suspension of the gold standard was considered temporary by many in markets and in the government at the time, restoring the standard was considered a low priority to dealing with other issues. The United States finally eliminated all links to gold on August 15, 1971, when President Richard Nixon directed Treasury Secretary Connally to suspend, with certain exceptions, the convertibility of the dollar into gold or other reserve assets, ordering the gold window to be closed such that foreign governments could no longer exchange their dollars for gold .", "prediction 1": "The gold standard in the United States ended on July 31, 1914, when the New York Stock Exchange closed and the gold standard was temporarily suspended. The gold standard was suspended twice during World War I, once fully and then for foreign exchange.\n", "prediction 2": "The gold standard in the United States began on July 31, 1914, with the closing of the New York Stock Exchange, but was reinstated when the New York Stock Exchange re-opened in December 1914.", "prediction 3": "The gold standard was suspended twice in the United States during World War I, one time for exchange and for a year for foreign money. However, the gold standard in the US resumed on December 31, 1914, and was finally terminated after one year on July 31, 1918.", "prediction 4": "During the Great Depression, every major currency abandoned the gold standard. In the US, the Federal Reserve was forced to raise interest rates in order to protect the gold standard for the US dollar, worsening already severe domestic economic pressures. On July 31, 1914, the New York Stock Exchange closed and the gold standard was temporarily suspended. The gold standard ended in the US on December 31, 1918, once fully.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[3]}", "start": 39, "end": 44 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 5 ] } ], "corrected-prediction": "The gold standard in the United States was temporarily suspended on July 31, 1914, when the New York Stock Exchange closed and the gold standard was temporarily suspended. The gold standard was suspended twice during World War I, once fully and then for foreign exchange. In early 1933, in order to fight severe deflation Congress and President Roosevelt suspended the gold standard except for foreign exchange. And finally, Nixon suspended the convertibility of the dollar into gold on August 15, 1971." }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "What grade does high school start in japan?", "passages": [ [ "Secondary education in Japan", "Secondary education in Japan\n\nSecondary education in Japan is split into junior high schools (\u4e2d\u5b66\u6821 \"ch\u016bgakk\u014d\"), which cover the seventh through ninth grade, and senior high schools (\u9ad8\u7b49\u5b66\u6821 \"k\u014dt\u014dgakk\u014d\", abbreviated to \u9ad8\u6821 \"k\u014dk\u014d\"), which mostly cover grades ten through twelve.", "Lower-secondary schools cover grades seven, eight, and nine.", "Ages are roughly 12-15 with increased focus on academic studies.", "Although it is possible to leave the formal education system after completing lower secondary school and find employment, fewer than 4% did so by the late 1980s.", "Most junior high schools in the 1980s were government-funded public schools; 5% were private schools.", "At \u00a5552,592 ($3,989 USD) per pupil, private schools had a per-student cost that was four times higher than public schools, at \u00a5130,828 ($934 USD).", "The minimum number of school days in a year is 210 in Japan, compared to 180 in the United States.", "However, students will typically attend school for 240 to 250 days a year.", "A significant part of the school calendar is taken up by non-academic events such as sports days and school trips.", "Teachers often majored in the subjects they taught.", "Each class is assigned a homeroom teacher who doubles as counselor." ], [ "Japan", "According to the UNHCR, in 2012 Japan accepted just 18 refugees for resettlement, while the United States took in 76,000.", "Japan suffers from a high suicide rate.", "In 2009, the number of suicides exceeded 30,000 for the twelfth successive year.", "Suicide is the leading cause of death for people under 30.", "Primary schools, secondary schools and universities were introduced in 1872 as a result of the Meiji Restoration.", "Since 1947, compulsory education in Japan comprises elementary and junior high school, which together last for nine years (from age 6 to age 15).", "Almost all children continue their education at a three-year senior high school.", "Japan's education system played a central part in the country's recovery and rapid economic growth in the decades following the end of World War II.", "After World War II, the Fundamental Law of Education and the School Education Law were enacted.", "The latter law defined the school system that would be in effect for many decades: six years of elementary school, three years of junior high school, three years of high school, and two or four years of university.", "Starting in April 2016, various schools began the academic year with elementary school and junior high school integrated into one nine-year compulsory schooling program, in hopes to mitigate bullying and truancy; MEXT plans for this approach to be adopted nationwide in the coming years." ], [ "Tenth grade", "Earlier, 10th grade was mostly for people who had a hard time in primary school and needed an extra year to prepare for high school (or another secondary education of some sort), but nowadays, it is widely popular amongst challenged and gifted students alike and usual attended at a special kind of boarding school called an \"Efterskole\".", "10th can also be attended at a regular school, though.", "This year is usually taken as a way to get a break from the school system and relax and try something different before moving on to high school.", "But, more commonly, people attend the \"gymnasium\" (can be compared to high school) where you go from 10th-12th grade (as such, some people attend 10th grade twice).", "People don't usually call the steps of the Danish gymnasium for 10th, 11th or 12th grade, but usually refer to them as 1st G, 2nd G, and", "3rd G.", "Here, G is simply the letter \"G\", and it refers to the three different steps of the education.", "In Finland tenth grade is usually known as the first year of High School (\"Lukio\" in Finnish and \"Gymnasiet\" in Swedish).", "The tenth grade may also refer to an extra year of primary school (\"kymppiluokka\" in Finnish which literally translates to \"tenth grade\")." ] ], "gold": "Since the 1947 Fundamental Law of Education, compulsory education in Japan comprises elementary and junior high school, which together last for nine years. Almost all children continue their education at a three-year senior high school. Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover grades ten through twelve.", "prediction 1": "Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover grades ten through twelve. The minimum number of school days in a year is 210 in Japan, compared to 180 in the United States. However, students will typically attend school for 240 to 250 days a year.\n", "prediction 2": "Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover grades ten through 12. In Finland, high school starts in 10th grade, while in the Nordic countries it starts in 11th grade.", "prediction 3": "Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover grades ten through twelve. In Japan, it is possible to leave the formal education system after completing lower secondary school and find employment, but fewer than 4% of students did so by the late 1980s. Japanese high schools run from maui to senpai soreba in the prefectures of Chugoku and Ishigaki.", "prediction 4": "Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover the ten through twelve grades. In tropical Japan, children typically attend junior high schools from age seven through age nine. In temperate Japan, children typically attend senior high schools from age thirteen through age 17.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 279, "end": 354 }, { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 278 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "Secondary education in Japan is split into junior high schools, which cover the seventh through ninth grade, and senior high schools, which mostly cover grades ten through twelve. Almost all children continue their education into high school, and education in both elementary and junior high school, nine years in total, has been compulsory since 1947.\n" }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Where is the scandinavian coastal conifer located on a map?", "passages": [ [ "Scandinavian coastal conifer forests", "Scandinavian coastal conifer forests\n\nThe Scandinavian coastal conifer forest ecoregion or the Norwegian coastal conifer forest ecoregion, a Palearctic ecoregion in the temperate coniferous forests biome, is located in along the coast of Norway.", "Within it are a number of small areas with botanical features and a local climate consistent with a temperate rainforest.", "The Scandinavian coastal conifer forest PA0520 is a terrestrial ecoregion as defined by WWF. and National Geographic.", "The broad definition is based on climatic parameters and includes a long area along the western Norwegian coast from Lindesnes and north to approximately Senja (further north summers are too cool for pine to grow in coastal areas); in essence areas along the Norwegian coast where precipitation is high and winters are fairly mild.", "It might include areas lacking naturally occurring conifer forests (as in Lofoten, where the pine forest was cleared by man many centuries ago) and even islands and rocky headlands with little or no woodland and forest.", "At somewhat higher elevations near the treeline in the Scandinavian mountains is the Scandinavian montane birch forest and grasslands ecoregion.", "In some areas along valleys, this ecoregion meet the taiga of the inland belonging to the Scandinavian and russian taiga ecoregion without mountain barriers." ] ], "gold": "The Scandinavian coastal conifer forest ecoregion includes a long area along the western Norwegian coast from Lindesnes and north to approximately Senja, and is best described on a map by coordinates 60\u00b033\u2032N 05\u00b032\u2032E. The region is characterized by high precipitation and mild winters, and is prevented from extending further north by summers that are too cool for coastal pine growth.", "prediction 1": "The Scandinavian coastal conifer forest ecoregion or the Norwegian coastal conifer forest ecoregion, a Palearctic ecoregion in the temperate coniferous forests biome, is located in along the coast of Norway. Within it are a number of small areas with botanical features and a local climate consistent with a temperate rainforest. The scandinavian coastal conifer forest is located in along the western Norwegian coast from Lindesnes and north to approximately Senja.\n", "prediction 2": "The scandinavian coastal conifer forest ecoregion or the Norwegian coastal conifer forest ecoregion is located in along the coast of Norway. It is a Palearctic ecoregion in the temperate coniferous forests biome. The broad definition is based on climatic parameters and includes a long area along the western Norwegian coast from Lindesnes and north to approximately Senja. The scandinavian coastal conifer forest PA0520 is classified as a terrestrial ecoregion as defined by WWF. and National Geographic.", "prediction 3": "The Scandinavian coastal conifer forest (or the Norwegian coastal conifer forest) is a Palearctic ecoregion in the temperate coniferous forests biome located in along the coast of Norway. On a map, it is located closer to Iceland than any other Palearctic, Arctic or sub-Antarctic ecoregion.", "prediction 4": "The Scandinavian coastal conifer forest or the Norwegian coastal conifer forest ecoregion, a Palearctic ecoregion in the temperate coniferous forests biome, is located in along the coast of Norway. The broad definition of this ecological region is that it includes a long area along the western Norwegian coast from Lindesnes and north to approximately Senja.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 208, "end": 329 }, { "error type": "Irrelevant", "explanation": "", "start": 330, "end": 467 }, { "error type": "Irrelevant", "explanation": "", "start": 50, "end": 166 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "The Scandinavian coastal conifer forest ecoregion is located in along the coast of Norway, it includes a long area along the western Norwegian coast from Lindesnes and north to approximately Senja (further north summers are too cool for pine to grow in coastal areas)." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "What percentage of the uk population say they have no religion?", "passages": [], "gold": "The percentage of the population of the UK that affirm that they have no religion has increased since the turn of the last millennium. According to the 2001 census, 23.2% of the people identified that they have no religion, with a not so distant 25.7% that was obtained 10 years later, during the 2011 census. Nonetheless, in a 2018 BSA survey, 52% of the people questioned answered that they have no religion, a significant increase from previous years.", "prediction 1": "What percentage of the uk population say they have no religion?\n", "prediction 2": "During the last visit to the UK and Cardiff held in March 2019 in partnership with Asda, a charity organisation that promotes openness towards other faiths, I was told about the sector's efforts to promote openness to all faiths.", "prediction 3": "Approximately what percentage of the UK population say they have no religion?", "prediction 4": "Approximately 46.9% of the British population identify as Muslim.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 64 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 2, 0, 0, 2 ] }, { "question": "How many episodes are there in happy valley?", "passages": [ [ "Ripper Street", "Ripper Street\n\nRipper Street is a British TV series set in Whitechapel in the East End of London and starring Matthew Macfadyen, Jerome Flynn, and Adam Rothenberg.", "It begins in 1889, six months after the infamous Jack the Ripper murders.", "The first episode was broadcast on 30 December 2012 during BBC One's Christmas schedule and was first broadcast in the United States on BBC America on 19 January 2013.", "\"Ripper Street\" returned for a second eight-part series on 28 October 2013.", "On 4 December 2013, it was reported that a third series would not be made due to low viewing figures for series two.", "Then on 11 December 2013, \"Variety\" reported negotiations between the show's producer Tiger Aspect and LoveFilm to fund future episodes, similar to Netflix funding episodes of \"Arrested Development\".", "On 26 February 2014, it was confirmed that Amazon Video would resurrect the show.", "Filming began in May 2014.", "Series three began streaming on Amazon UK Prime Instant Video on 14 November 2014 but was not immediately made available on Amazon's US site.", "The third series began airing on BBC America on 29 April 2015, and on BBC One on 31 July 2015.", "In June 2015, the series was renewed for a fourth and fifth series.", "In 2016, it was announced that the show would end with the fifth series." ], [ "Silicon Valley (TV series)", "The third season was released on DVD and Blu-ray on April 11, 2017; bonus features include deleted scenes.", "The fourth season was released on DVD and Blu-ray on September 12, 2017; bonus features include deleted scenes.", "In Australia, the series premiered on April 9, 2014, and aired on The Comedy Channel.", "In the United Kingdom, it premiered on July 16, 2014, airing on Sky Atlantic, while also being available on internet view-on-demand services such as Blinkbox.", "In New Zealand, the series airs on on the SoHo channel.", "In India, the series is available for streaming on Hotstar." ] ], "gold": "The first series of six episodes started airing on BBC One in the United Kingdom on 29 April 2014. A second series of six episodes started airing on BBC One on 9 February 2016, with a total of 12 episodes so far. ", "prediction 1": "Happy Valley is a British comedy television series that premiered on BBC One on December 30, 2012, and ended on January 31, 2019. There were 8 episodes in Happy Valley.\n", "prediction 2": "Happy Valley is a British TV series set in Whitechapel, East London. The first episode of Happy Valley was broadcast on 30 December 2012. The show ran for 8 series, each with 8 episodes each. In 2016, the series ran for 5 series, each with 8 episodes each.", "prediction 3": "Happy Valley aired for 9 episodes total over three seasons on BBC America, BBC Two, and BBC One. It had 18 episode total over three seasons and 10 episodes total over four seasons. There were 12 episodes total in the fourth series. It had 32 episodes total over four seasons.", "prediction 4": "Happy Valley has 6 seasons, three of which were released in 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 103, "end": 129 }, { "error type": "Unverifiable", "explanation": "", "start": 18, "end": 98 }, { "error type": "Unverifiable", "explanation": "", "start": 141, "end": 151 } ], "missing-info": [], "corrected-prediction": "\n" }, "preference": [ 1, 1, 2, 1, 2, 2 ] }, { "question": "Where are most volcanoes above sea level located?", "passages": [ [ "Ring of Fire", "Ring of Fire\n\nThe Ring of Fire is a major area in the basin of the Pacific Ocean where many earthquakes and volcanic eruptions occur.", "In a large horseshoe shape, it is associated with a nearly continuous series of oceanic trenches, volcanic arcs, and volcanic belts and plate movements.", "It has 452 volcanoes (more than 75% of the world's active and dormant volcanoes).", "The Ring of Fire is sometimes called the circum-Pacific belt.", "About 90% of the world's earthquakes and 81% of the world's largest earthquakes occur along the Ring of Fire.", "All but three of the world's 25 largest volcanic eruptions of the last 11,700 years occurred at volcanoes in the Ring of Fire.", "The Ring of Fire is a direct result of plate tectonics: the movement and collisions of lithospheric plates, especially subduction in the northern portion.", "The southern portion is more complex, with a number of smaller tectonic plates in collision with the Pacific plate from the Mariana Islands, the Philippines, Bougainville, Tonga, and New Zealand.", "The presence of a belt of volcanic activity surrounding the Pacific Ocean was observed in the 19th century.", "\"They [the Japanese Islands] are in the line of that immense circle of volcanic development which surrounds the shores of the Pacific from Tierra del Fuego around to the Moluccas.\"" ] ], "gold": "The Ring of Fire is a region around much of the rim of the Pacific Ocean where many volcanic eruptions and earthquakes occur. The Ring of Fire is a direct result of plate tectonics: specifically the movement, collision and destruction of lithospheric plates under and around the Pacific Ocean.", "prediction 1": "The Ring of Fire is a major area in the basin of the Pacific Ocean where many earthquakes and volcanic eruptions occur. It has 452 volcanoes, or more than 75% of the world's active and dormant volcanoes.\n", "prediction 2": "There are more than 75% of the world's active and dormant volcanoes located above sea level in the Pacific Ocean.", "prediction 3": "There are 452 volcanoes in the Pacific Ocean's Ring of Fire, which is a major area in the basin of the Pacific Ocean where many earthquakes and volcanic eruptions occur. Of the 405 volcanoes in the area, 315 are located above sea level and 2.5 are in the East China Sea.", "prediction 4": "The Pacific Ocean has the greatest number of volcanoes above sea level. The US Atlantic Coast has the most active volcanoes.", "feedback": { "errors": [], "missing-info": [], "corrected-prediction": "The Ring of Fire is a major area in the basin of the Pacific Ocean where many earthquakes and volcanic eruptions occur. It has 452 volcanoes, or more than 75% of the world's active and dormant volcanoes.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "How many episodes of tenjou tenge are there?", "passages": [ [ "Tenjho Tenge", "Tenjho Tenge\n\n, also written as Tenjo Tenge, is a Japanese manga series written and illustrated by Ito \"Oh! Great\" \u014cgure.", "The story primarily focuses on the members of the Juken Club and their opposition, the Executive Council, which is the ruling student body of a high school that educates its students in the art of combat.", "As the story unfolds, both groups become increasingly involved with an ongoing battle that has been left unresolved for four hundred years.", "\"Tenjho Tenge\" was serialized in the magazine \"Ultra Jump\" from 1997 to 2010, and collected into 22 volumes by Sh\u016beisha.", "It was adapted into a twenty-four episode anime series and aired on TV Asahi between April 1, 2004 to September 16, 2004.", "A two-episode original video animation was also made and aired on March 16, 2005.", "Both versions of the series have been licensed for release in the English language by two different companies.", "The manga was licensed and released by CMX beginning in 2005, which came under criticism by fans for editing its sexual content.", "When CMX closed down in 2010, after releasing 18 volumes, Viz Media picked up the rights and completed their own uncut release of the series in 2013.", "The anime was licensed and released by Geneon Entertainment, also beginning in 2005, however, it is now licensed by Discotek Media." ], [ "Tenjho Tenge", "In November 2010, Viz Media acquired the rights to the \"Tenjho Tenge\" manga, stating that their version would be 100% uncut and faithful to the original Japanese.", "From June 21, 2011 to February 5, 2013, they released the series bi-monthly in eleven 2-in-1 volumes, which collects two individual volumes into a single large one.", "Viz's releases also includes omake, color pages from the series's original run in \"Ultra Jump\", and since each release will cover two volumes, the second cover will be printed in as a color page.", "The manga is also published in many other countries, such as in Taiwan by Sharp Point Press, in Italy, France and Germany by Panini Comics, in Mexico by Grupo Editorial Vid, in Brazil by Editora JBC, and in Spain by Norma Editorial.", "The \"Tenjho Tenge\" anime was directed by Toshifumi Kawase, animated by Madhouse, and produced by TV Asahi and Avex Mode, the animation division of the Avex group of companies.", "The twenty-four episodes were originally aired weekly on TV Asahi in Japan on Thursdays from April 1, 2004 to September 16, 2004.", "These episodes were made into eight-volume DVD box sets." ], [ "Urusei Yatsura", "The series was adapted by Kitty Films into an animated TV series that aired from October 14, 1981 to March 19, 1986 on Fuji Television.", "Initial episodes of the series contained two stories which has led to episode totals of both 195 and 218 episodes.", "Episode 10 was the first episode to only contain one story.", "The first 106 episodes were directed by Mamoru Oshii and the remainder by Kazuo Yamazaki.", "Six opening theme songs and nine closing themes were used during the series.", "On December 10, 1983, the first VHS release of the series was made available in Japan.", "The series was also released on fifty Laserdiscs.", "Another VHS release across fifty cassettes began on March 17, 1998 and concluded on April 19, 2000.", "Two DVD boxed sets of the series were released between December 8, 2000 and March 9, 2001.", "These were followed by fifty individual volumes between August 24, 2001 and August 23, 2002.", "To celebrate the 35th anniversary of the anime a new HD transfer was created and released on Blu-ray in Japan.", "The first Blu-ray boxed set of the series was released on March 27, 2013, with the fourth box set scheduled for release on March 23, 2014.", "To promote the Blu-ray, the anime was rebroadcast in high definition on Kids Station." ] ], "gold": "Tenjho Tenge is a Japanese manga series that follows the members of the Juken Club and their opposition, the Executive Council, as both groups become increasingly involved with an ongoing battle that has been left unresolved for four hundred years. It was adapted into a 24 episode anime series that aired between April to September 2004. In 2005, 2 additional episodes were broadcast and released in the form of an original video animation named Tenjho Tenge: Ultimate Fight. ", "prediction 1": "Tenjou Tenge is a Japanese manga series written and illustrated by Ito \"Oh! Great\" gure. It was adapted into a twenty-four episode anime series and aired on TV Asahi between April 1, 2004 and September 16, 2004. A two-episode original video animation was also made and aired on March 16, 2005. The anime was directed by Toshifumi Kawase, animated by Madhouse, and produced by TV Asahi and Avex Mode, the remainder by Kazuo Yamazaki. Episode 10 was the first episode to only contain one story.\n", "prediction 2": "Many Japanese manga, anime and video game franchises have Tenjou Tenge. The manga, Tenjou Tenge!, was serialized in the magazine Ultra Jump from 1997 to 2010, and collected into 22 volumes by Sheisha. The manga was adapted into a twenty-four episode anime series and aired on TV Asahi between April 1, 2004 and September 16, 2004. A two episode original video animation was also made and aired on March 16, 2005. The anime was directed by Toshifumi Kawase, animated TV series that was produced by TV Asahi and produced by Vatech Pictures Animations.", "prediction 3": "Japanese manga series Tenjou Tenge was originally serialized in the magazine Ultra Jump from 1997 to 2010, and collected into 22 volumes by Sheisha. It was adapted into a twenty-four episode anime series and aired on TV Asahi between April 1, 2004 and September 16, 2004. The original video animation production for Tenjou Tenge was produced by TV Asahi and Avex Mode, and had two episodes aired simultaneously on March 16, 2005.", "prediction 4": "Tenjou Tenge, also written as Tenjo Tenge, is a Japanese manga series written and illustrated by Ito gure. It was adapted into a twenty-four episode anime series that aired on TV Asahi between April 1, 2004 and September 16, 2004. The fifteen-episode original video animation was also made and aired on March 16, 2005. As of May 2017, the Japanese subtitle for the anime has changed, and the English subtitle will no longer appear. The manga version of the series is in the English language.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 88 }, { "error type": "Irrelevant", "explanation": "", "start": 154, "end": 165 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 399 }, { "error type": "Irrelevant", "explanation": "", "start": 400, "end": 432 }, { "error type": "Irrelevant", "explanation": "", "start": 433, "end": 493 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2, 3 ] } ], "corrected-prediction": "Tenjho Tenge is a Japanese manga series that focuses on the members of the Juken Club and their opposition, the Executive Council, as both groups become increasingly involved with an ongoing battle that has been left unresolved for four hundred years. It was adapted into a twenty-four episode anime series between April 1, 2004 and September 16, 2004. A two-episode original video animation was also made and aired on March 16, 2005." }, "preference": [ 1, 2, 1, 2, 1, 1 ] }, { "question": "Number of oil refineries in the united states?", "passages": [ [ "Petroleum refining in the United States", "Petroleum refining in the United States\n\nPetroleum refining in the United States in 2013 produced 18.9 million barrels per day of refined petroleum products, more than any other country.", "Although the US was the world's largest net importer of refined petroleum products as recently as 2008, the US became a net exporter in 2010, and in 2014 was the largest exporter and the largest net exporter of refined petroleum.", "As of January 2015, there were 137 operating refineries in the US, distributed among 30 states.", "Largest petroleum refining companies in the United States\nLargest petroleum refineries in the United States\nThe first known US petroleum refiner was Samuel Kier of Pittsburgh, who in the 1850s produced an illuminating oil for miners' lamps.", "American petroleum refining largely grew out of oil shale refining.", "When the Drake Well started producing in 1859, the oil shale industry was growing rapidly, and establishing refineries near cannel coal deposits along the Ohio River Valley.", "As oil production increased, the oil shale refiners discovered that their refining process worked just as well with petroleum, and that petroleum was a cheaper raw material than shale oil.", "In 1861, the existing oil shale refiners switched to petroleum feedstock, and the oil shale mines shut down.", "In the 1800s, the principal refined product was kerosene for illuminating oil.", "The heaviest fraction was used as lubricating oil." ] ], "gold": "As of January 2019, there were 135 operating oil refineries in the United States, distributed among 30 states. Though the number of American refineries has decreased from 137 in January 2015, the country remains both the largest exporter and the largest net exporter of refined petroleum in the world.", "prediction 1": "Petroleum refining in the United States in 2013 produced 18.9 million barrels per day of refined petroleum products, more than any other country. As of January 2015, there were 137 operating refineries in the US, distributed among 30 states.\n", "prediction 2": "Petroleum refining in the United States in 2013 produced 18.9 million barrels per day of refined petroleum products, more than any other country. Goldwyn-Mayer first opened a refinery in Niagara Falls, New Jersey, in 1859, and smelt the first refined petroleum in the US in 1871. 137 operating refineries in the US, distributed among 30 states.", "prediction 3": "Petroleum refining in the United States in 2013 produced 18.9 million barrels per day of refined petroleum products, more than any other country. As of January 2015, there were 137 operating refineries in the US, distributed among 30 states. The first known US petroleum refiner was Samuel Kier of Pittsburgh, who in the 1850s produced an illuminating oil for miners' lamps.", "prediction 4": "As of January 2015, there were 137 operating refineries in the US, distributed among 30 states.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 145 } ], "missing-info": [], "corrected-prediction": "As of January 2015, there were 137 operating refineries in the US, distributed among 30 states.\n" }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Who gets super bowl rings when a team wins?", "passages": [ [ "Super Bowl ring", "Teams can distribute any number of rings.", "A recent trend over the last 15\u201320 years has been lesser rings awarded to front office staff.", "These are commonly called \"B\" and \"C\" level rings and are smaller and contain fewer diamonds or contain faux diamonds.", "The first instance of this was the Redskins Super Bowl XVII ring when many in the front office received rings that were not solid gold and contained cubic zirconia stones (which resemble diamonds).", "When Tampa Bay won Super Bowl XXXVII, the players and coaches received rings with a diamond-centered Lombardi trophy.", "Some staff received rings with a metal Lombardi trophy and real diamonds surrounding the trophy and the \"C\" level ring did not contain any diamonds.", "Many rings feature diamonds in the shape of the Vince Lombardi Trophy or a football.", "Some feature diamonds or gold in the shape of a team logo.", "Others illustrate the number of Super Bowls that franchise has won.", "Also, the rings are customized with the player's name and uniform number.", "The Green Bay Packers Super Bowl XLV ring contained more than 100 diamonds.", "The Packer logo, in the center of the ring, made up 13 diamonds, one for each title the team has won, dating back to 1929.", "In a break from tradition, this is the first Super Bowl ring to be made of platinum, not gold." ], [ "Super Bowl ring", "Super Bowl ring\n\nThe Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl.", "Since only one Vince Lombardi Trophy is awarded to the team (ownership) itself, the Super Bowl ring offers a collectable memento for the actual players and team members to keep for themselves to symbolise their victory.", "These rings are typically made of yellow or white gold with diamonds.", "They usually include the team name, team logo, and Super Bowl number (usually indicated in Roman numerals).", "The NFL contributes up to $5,000 per ring for up to 150 rings for the winning team; any additional costs are borne by the team.", "Most rings are manufactured by memorabilia company Jostens.", "In 2015, the rings for the New England Patriots reportedly cost $36,500 each, making them the most expensive rings Jostens has ever produced.", "The winning team can typically present rings to whomever they choose, including usually, but not limited to: players (active roster or injured), coaches, trainers, executives, personnel, and general staff.", "Some teams have given rings to former players and coaches that were on the team at some point during the season, despite not having been on the winning roster for the Super Bowl itself.", "Sometimes a team will give rings to fans as part of a charity raffle." ] ], "gold": "In the NFL, the Super Bowl ring is an award given to the team members of the winning team of championship game, and there are also rings provided to the runners-up team of the Super Bowl. The winning team can typically present any number of rings to whomever they choose, including usually, but not limited to: players and coaches, trainers, executives, personnel, and general staff. Sometimes they will give rings to former players and coaches that were on the team at some point during the season, despite not having been on the winning roster for the Super Bowl itself, and sometimes a team will make rings available to fans as part of a charity raffle. Another recent trend over the last 15\u201320 years has been lesser rings awarded to front office staff. ", "prediction 1": "The Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl. Since only one Vince Lombardi Trophy is awarded to the team itself, the Super Bowl ring offers a collectable memento for the actual players and team members to keep for themselves to symbolise their victory. The winning team can typically present rings to whomever they choose, including usually, but not limited to: players (active roster or injured), coaches, trainers, executives, personnel, and general staff.\n", "prediction 2": "The Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl. Since only one Vince Lombardi Trophy is awarded to the owner of the team, the Super Bowl ring offers a collectable memento for the actual players and team members to keep for themselves as a reminder of their victory. The winning team can typically present rings to whomever they choose. The majority of these rings are given to players, who win the game, but some have also been given to coaches, trainers, personnel, and their manager. In the NFL, several teams also give rings to executives, and general staff.", "prediction 3": "The Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl. It is an award for the team and is a collectible memento that the actual players and team members can keep as a memento of their victory. Since only one Vince Lombardi Trophy is awarded to the team, the Super Bowl ring offers a collectable memento for the players and team members to keep for themselves to symbolise their victory. The winning team can typically present rings to whomever they choose, including usually, but not limited to: players and injured, coaches, trainers, personnel, and general staff.", "prediction 4": "The Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl. Since only one Vince Lombardi Trophy is awarded to a team, the Super Bowl ring offers a collectable memento for the actual players and team members to keep for themselves to symbolise their victory. Since coaches and teammates don't get rings when their team wins a Super Bowl, the winning team can typically present rings to whomever they choose, including usually, but not limited to: players (active roster or injured), coaches, personnel, trainers, executives, personnel, and players, seniors, and their spouse.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 143, "end": 350 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 10 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Super Bowl ring is an award in the National Football League given to the winners of the league's annual championship game, the Super Bowl. The winning team can typically present rings to whomever they choose, including usually, but not limited to: players (active roster or injured), coaches, trainers, executives, personnel, and general staff. In addition, sometimes former players and coaches have been given rings as being a part of the team during some point of the season, even if not on the winning roster of the Super Bowl itself. The fans have a chance as well when the team makes them available through a charity raffle. Lastly, the front office staff of the winning team may get lesser rings as well." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Sydney is on the bank of which river?", "passages": [ [ "Sydney", "Most of Sydney's water storages can be found on tributaries of the Nepean River.", "The Parramatta River is mostly industrial and drains a large area of Sydney's western suburbs into Port Jackson.", "The southern parts of the city are drained by the Georges River and the Cooks River into Botany Bay.", "Sydney is made up of mostly Triassic rock with some recent igneous dykes and volcanic necks.", "The Sydney Basin was formed when the Earth's crust expanded, subsided, and filled with sediment in the early Triassic period.", "The sand that was to become the sandstone of today was washed there by rivers from the south and northwest, and laid down between 360 and 200 million years ago.", "The sandstone has shale lenses and fossil riverbeds.", "The Sydney Basin bioregion includes coastal features of cliffs, beaches, and estuaries.", "Deep river valleys known as rias were carved during the Triassic period in the Hawkesbury sandstone of the coastal region where Sydney now lies.", "The rising sea level between 18,000 and 6,000 years ago flooded the rias to form estuaries and deep harbours.", "Port Jackson, better known as Sydney Harbour, is one such ria." ], [ "Sydney", "The 2000 Summer Olympics were held in Sydney and became known as the \"best Olympic Games ever\" by the President of the International Olympic Committee.", "Sydney has maintained extensive political, economic and cultural influence over Australia as well as international renown in recent decades.", "Following the Olympics, the city hosted the 2003 Rugby World Cup, the APEC Australia 2007 and Catholic World Youth Day 2008, led by Pope Benedict XVI.", "Sydney is a coastal basin with the Tasman Sea to the east, the Blue Mountains to the west, the Hawkesbury River to the north, and the Woronora Plateau to the south.", "The inner city measures , the Greater Sydney region covers , and the city's urban area is in size.", "Sydney spans two geographic regions.", "The Cumberland Plain lies to the south and west of the Harbour and is relatively flat.", "The Hornsby Plateau is located to the north and is dissected by steep valleys.", "The flat areas of the south were the first to be developed as the city grew.", "It was not until the construction of the Sydney Harbour Bridge that the northern reaches of the coast became more heavily populated.", "Seventy beaches can be found along its coastline with Bondi Beach being one of the most famous.", "The Nepean River wraps around the western edge of the city and becomes the Hawkesbury River before reaching Broken Bay." ], [ "Geography of Sydney", "Slow erosion of the overlying layers of sedimentary rock by the flow of rainwater have eventually laid bare the edges of the volcanic and metamorphic rocks of the intrusion.", "The Gap, an ocean cliff on the South Head peninsula in Watsons Bay, was laid as sediment more than 200 million years ago in the Triassic period.", "During the Jurassic era, a cataclysmic event resulted in an enormous crack forming within the strata.", "The Gap itself forms a sequence that continues offshore to the edge of the Sahul Shelf.", "The Nepean River rises to the south in the Woronora Plateau, and wraps around the western edge of the city.", "Swamps and lagoons are existent on the floodplain of the Nepean River, one being Bents Basin, which is also a recreational area.", "Where the Nepean turns east it becomes the Hawkesbury River, which winds through the Hornsby Plateau before emptying into Broken Bay.", "Broken Bay and the lower Hawkesbury form the commonly accepted boundary between Sydney and the Central Coast to the north.", "The remaining section of Warragamba River flows north-east from the Warragamba Dam spillway to its confluence with the Nepean River.", "The south and southwest of Sydney is drained by the Georges River, flowing north from its source near Appin, towards Liverpool and then turning east towards Botany Bay." ] ], "gold": "Sydney is a coastal basin with the Hawkesbury River on the north. The Nepean River wraps around the western edge of the city and becomes the Hawkesbury River before reaching Broken Bay. ", "prediction 1": "The city of Sydney is on the bank of the Nepean River. The Parramatta River is mostly industrial and drains a large area of Sydney's western suburbs into Port Jackson. The southern parts of the city are drained by the Georges River and the Cooks River into Botany Bay. The Sydney Basin is a coastal basin with the Tasman Sea to the east, the Blue Mountains to the west, the Hawkesbury River to the north, and the Woronora Plateau to the south.\n", "prediction 2": "The Sydney Basin formed when the Earth's crust expanded, subsided, and filled with sediment in the early Triassic period. The Nepean River rises to the south in the Woronora Plateau, and wraps around the western edge of the city. The Georges River drains the southern parts of the city into the Cooks River into Botany Bay. Deep river valleys were carved during the Triassic period in the Hawkesbury sandstone of the coastal region where Sydney lies.", "prediction 3": "The Nepean River rises in the Woronora Plateau, wraps around the western edge of the city, and then becomes the Hawkesbury River before reaching Broken Bay. The majority of the water storages in Sydney can be found on tributaries of the Nepean. The Parramatta River is mostly industrial and drains a large area of Sydney's western suburbs into Port Jackson. The southern parts of the city are drained by the Georges River and Cooks River into Botany Bay.", "prediction 4": "The Nepean River rises to the south in the Woronora Plateau, and wraps around the western edge of the city. The Sydney Basin was formed when the Earth's crust expanded, subsided, and filled with sediment in the Early Triassic period, and includes coastal features such as cliffs, beaches, and estuaries. The rias, or river valleys, were carved during the Triassic period in the Hawkesbury sandstone of the coastal region where Sydney lies.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 310, "end": 369 }, { "error type": "Irrelevant", "explanation": "", "start": 405, "end": 444 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 12 ] } ], "corrected-prediction": "The city of Sydney is on the bank of the Nepean River. The Parramatta River is mostly industrial and drains a large area of Sydney's western suburbs into Port Jackson. The southern parts of the city are drained by the Georges River and the Cooks River into Botany Bay. The Sydney Basin is a coastal basin with the Hawkesbury River to the north. The Nepean River wraps around the western edge of the city and becomes the Hawkesbury River before reaching Broken Bay.\n" }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who composed the pirates of the caribbean theme song?", "passages": [ [ "Pirates of the Caribbean: The Curse of the Black Pearl (soundtrack)", "Pirates of the Caribbean: The Curse of the Black Pearl (soundtrack)\n\nPirates of the Caribbean: The Curse of the Black Pearl is the official soundtrack album from the .", "The album was released on July 22 2003, by Walt Disney Records, and contains selections of music from the film score.", "The music of the film and this album are credited to composer Klaus Badelt and producer Hans Zimmer.", "Composer Alan Silvestri was originally hired to write the score for \"The Curse of the Black Pearl\".", "However, due to creative differences between the producer Jerry Bruckheimer and him, Silvestri left the project and Gore Verbinski asked Hans Zimmer, with whom he had worked on \"The Ring\", to step in.", "Zimmer declined to do the bulk of the composing, as he was busy scoring \"The Last Samurai\", a project during which he claimed he had promised not to take any other assignments.", "As a result, he referred Verbinski to Klaus Badelt, a relatively new composer who had been a part of Remote Control Productions (known as Media Ventures at the time) for three years.", "Zimmer however ended up collaborating with Badelt to write most of the score's primary themes." ], [ "Pirates of the Caribbean: Dead Men Tell No Tales (soundtrack)", "Pirates of the Caribbean: Dead Men Tell No Tales (soundtrack)\n\nPirates of the Caribbean: Dead Men Tell No Tales\u2014Original Motion Picture Soundtrack is the film score album for the 2017 .", "The music is arranged, composed and written by Geoff Zanelli.", "The album was released on May 26, 2017 by Walt Disney Records.", "For the first time in the series since \"\" (2003) (which he co-wrote with Klaus Badelt), Hans Zimmer is not composing the music for the film.", "Instead, Geoff Zanelli, who worked on all previous four installments in the franchise, is the main composer for the film.", "Zanelli said of taking over from Zimmer as composer for the series, \"What Hans did for the \"Pirates\" movies redefined the sound of the entire genre, it has been very fulfilling to work alongside him and [producer] Jerry [Bruckheimer] on the past four films.", "\"Dead Men Tell No Tales\" enlarges the \"Pirates\" universe with many new, unique elements, and I'm building a distinctive sound for this film that springboards off of many years of collaborating in the \"Pirates\" world.\"", "The recording locations were Air Studios (London, UK), Henson Recording Studios (Los Angeles, CA), and Sony Scoring Stage (Culver City, CA)." ] ], "gold": "Pirates of the Caribbean: The Curse of the Black Pearl soundtrack was released in 2003, by Walt Disney Records and contains selections of music from the movie's score.. Hans Zimmer composed Pirates of the Caribbean: Dead Man's Chest theme song, and Pirates of the Caribbean: At World's End theme song and Pirates of the Caribbean: On Stranger Tides theme song was composed as a Hans Zimmer, Rodrigo y Gabriela team. Klaus Badelt composed Pirates of the Caribbean: Curse of the Black Pearl Theme Song. Geoff Zanelli composed Pirates of the Caribbean: Dead Men Tell No Tales theme song.", "prediction 1": "The music for the Pirates of the Caribbean films is credited to composer Klaus Badelt and producer Hans Zimmer. Alan Silvestri was originally hired to write the score for Pirates of the Caribbean: The Curse of the Black Pearl. However, due to creative differences between the producer Jerry Bruckheimer and him, Silvestri left the project and Gore Verbinski asked Hans Zimmer, with whom he had worked on The Ring, to step in. Zimmer declined to do the bulk of the composing, as he was busy scoring The Last Samurai. Instead, Geoff Zanelli, who worked on all previous four installments in the franchise, is the main composer for the film.\n", "prediction 2": "The Pirates of the Caribbean theme song was composed by Alan Silvestri. In 2003, Hans Zimmer composed the music for the Pirates of the Caribbean: The Curse of the Black Pearl. In 2015, Hans Zimmer re-wrote the music for Pirates of the Caribbean: Dead Men Tell No Tales\u2014Original Motion Picture Soundtrack. In 2017, the music for Pirates of the Caribbean: Dead Men Tell No Tales\u2014Original Motion Picture Soundtrack is composed by Geoff Zanelli.", "prediction 3": "The Pirates of the Caribbean theme song was composed by Alan Silvestri, Gary Gilchrist, Rudy Rodriguez, and Klaus Badelt. For the first time in the Pirates films, Hans Zimmer is not composing the music for the film. Instead, Geoff Zanelli is the composer.", "prediction 4": "Pirates of the Caribbean's theme song, Dead Men Tell No Tales, was composed by Klaus Badelt. Badelt co-wrote the score with Alan Silvestri. Hans Zimmer co-wrote the Pirates of the Caribbean's Theme Song.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 112, "end": 226 }, { "error type": "Irrelevant", "explanation": "", "start": 227, "end": 425 }, { "error type": "Irrelevant", "explanation": "", "start": 426, "end": 515 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 43, "end": 48 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The music for the Pirates of the Caribbean: The Curse of the Black Pearl is credited to composer Klaus Badelt and producer Hans Zimmer. Hans would work on the next three films as well. For Pirates of the Caribbean: Dead Men Tell No Tales, instead of Hans Zimmer was Geoff Zanelli, who worked on all previous four installments in the franchise, and is the main composer for the film.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "Who sang tik tok and we r who we r?", "passages": [ [ "We R Who We R", "Lipshutz commented on the song's similarity to \"Tik Tok\", writing, \"Instead of straying from the 'TiK ToK' formula, 'We R Who We R,' ...", "smartly maximizes [Kesha's] most appealing qualities.\"", "The review concluded that the song \"demonstrates that [Kesha] still has mileage left in her electro-pop sound as she gears up for her next album.\"", "Leah Greenblatt of \"Entertainment Weekly\" called the song a \"companion piece\" to Pink's \"Raise Your Glass\" citing their similar subject matter and close releases.", "Nitsuh Abebe from NY Magazine complimented the song's chorus and trance pop elements.", "Abebe wrote that the song embodied a \"hollowed-out, free-of-yourself feeling\", commenting that almost all electronic dance music imbues feelings \"that are almost spiritual, that sense of being subsumed and out-of-body\".", "Melinda Newman of HitFix called the song \"incredibly stupid, but it has the main ingredients to make it a global hit: an insistent beat and positive lyrics that promise to suspend time and keep us 'forever young,' or better yet, transport us back to a time when we felt like we were.\"" ], [ "Kesha", "Kesha\n\nKesha Rose Sebert ( ; born March 1, 1987; formerly stylized as Ke$ha) is an American singer, songwriter, rapper, and actress.", "In 2005, at age 18, Kesha was signed to Kemosabe Records.", "Her first major success came in early 2009 after she was featured on American rapper Flo Rida's number-one single \"Right Round\".", "Kesha's music and image propelled her to immediate success, with her debut album \"Animal\" debuting at the top of the charts in several countries in 2009 and 2010.", "She achieved 3 more number-one singles, \"Tik Tok\" and \"We R Who We R\" as a solo artist, and \"Timber\" as a featured artist.", "At the same time, she continued to write songs for other artists, including \"Till the World Ends\" for Britney Spears.", "\"Warrior\", her second studio album, was released in 2012, and spawned her eighth consecutive top-ten single \"Die Young\".", "\"Tik Tok\", at one point, was the best-selling digital single in history, selling over 16.5 million units internationally.", "Since 2014, Kesha has been in a legal dispute with her former producer Dr. Luke, in which a series of lawsuits, known collectively as \"Kesha v. Dr. Luke,\" were exchanged between the two parties." ] ], "gold": "Musical artist Kesha, formerly stylized as Ke$ha, sang both Tik Tok and We R Who We R.", "prediction 1": "American singer, songwriter, rapper, and actress Kesha performed the song We R Who We R and the video for it. Kesha is the lead vocals and the lyricist of the song. She has also released a studio album titled \"Warrior\" in which she released songs titled \"Tik Tok\" and \"We R Who We R\".\n", "prediction 2": "American singer, songwriter, rapper, and actress Kesha performed the 2013 song tik tok and the video for it. In the video for tik tok and the video for we r who we r, many people sang along with different versions. This includes songs by Kelcey Musgraves and Aaliyah, babe Ruth, Kendra Spears, and Cali Lily.", "prediction 3": "Kesha Rose Sebert is an American singer, songwriter, rapper, and actress. Her version of the song, We R Who We R, is closer to the original version of the song.", "prediction 4": "We R Who We R is the sequel to Taylor Swift's 2012 hit song We R Who We R. The original song was originally released on Sept. 3, 2013. Then, on December 1, 2011, the song was released on November 13, 2011.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 88, "end": 109 }, { "error type": "Irrelevant", "explanation": "", "start": 110, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 218 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "Singer, songwriter and rapper Kesha, formerly stylized as Ke$ha, performed the song Tik Tok and We R Who We R.\n" }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "What is the population of the des moines area?", "passages": [ [ "Des Moines metropolitan area", "Des Moines metropolitan area\n\nThe Des Moines metropolitan area, officially known as the Des Moines\u2013West Des Moines, IA Metropolitan Statistical Area (MSA), consists of six counties in central Iowa, United States: Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper.", "The 2010 census population of these counties was 606,475, and the 2017 estimated population was 682,877.", "Two additional counties, Boone and Story, are part of the Des Moines\u2013Ames\u2013West Des Moines Combined Statistical Area (CSA).", "The area encompasses the separate metropolitan area of Ames (Story County), and the separate micropolitan area of Boone (Boone County).", "The total population of the CSA was 722,323 in the 2010 census and 806,863 based on 2017 estimates.", "The lowest geographical point in the metropolitan area is the Des Moines River, where it passes the northeast corner of Warren County, and the southeast corner of Polk County.", "Polk County was originally the only county in the Des Moines metropolitan area when the United States Bureau of the Budget (now the United States Office of Management and Budget) began defining metropolitan areas in 1950.", "Warren County was added in 1973 and Dallas County was added in 1983.", "Guthrie and Madison counties were added in 2003 after metropolitan areas were redefined." ] ], "gold": "The Des Moines metropolitan area, which consists of six counties in Iowa; Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper, has a population of 682,877 as of the 2018 census. And according to the 2010 census, the Des Moines metropolitan area, had a population of 606,475. ", "prediction 1": "The Des Moines metropolitan area, officially known as the Des Moines\u2013West Des Moines, IA Metropolitan Statistical Area (MSA), consists of six counties in central Iowa, United States: Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper. The 2010 census population of these counties was 606,475, and the 2017 estimated population was 682,877. Two additional counties, Boone and Story, are part of the Des Moines\u2013Ames\u2013West Des Moines Combined Statistical Area (CSA).\n", "prediction 2": "The population of the Des Moines area in Iowa, United States, was 633,134 as of the 2010 census. The estimation for 2018 is 634,619 and for 2019 it is 715,616.", "prediction 3": "The Des Moines area, officially known as the Des Moines\u2013West Des Moines, IA Metropolitan Statistical Area or MSSA, consists of six counties in central Iowa, United States: Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper. The 2010 census population of these counties was 606,475, and the 2017 estimated population was 682,877. Two additional counties, Boone and Story, are part of the Des Moines\u2013Ames\u2013West Des Moines Combined Statistical Area (CSA).", "prediction 4": "The Des Moines metropolitan area, officially known as the Des Moines\u2013West Des Moines, US Metropolitan Statistical Area, consists of six counties in central Iowa, United States: Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper. The 2010 census population of these counties was 606,475, and the 2017 estimated population was 682,877. Two additional counties, Boone and Story, are part of the Des Moines\u2013Ames\u2013West Des Moines Combined Statistical Area (CSA), which includes the separate metropolitan area of Ames and the separate micropolitan area of Boone and the separate micropolitan area of Ames and the separate metropolitan area of Ames, and the separate metropolitan area of Ames. The population of the CSA was 8906,863 in the 2010 census and 362,323 in the 2010 census.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 362, "end": 485 } ], "missing-info": [], "corrected-prediction": "The Des Moines metropolitan area, officially known as the Des Moines\u2013West Des Moines, IA Metropolitan Statistical Area (MSA), consists of six counties in central Iowa, United States: Polk, Dallas, Warren, Madison, Guthrie, and as of September 2018, Jasper. The 2010 census population of these counties was 606,475, and the 2017 estimated population was 682,877. \n" }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "How long does it take for vicryl sutures to dissolve?", "passages": [ [ "Vicryl", "Vicryl\n\nVicryl (polyglactin 910) is an absorbable, synthetic, usually braided suture, manufactured by Ethicon Inc., a subsidiary of Johnson and Johnson.", "A monofilament version is also made for use in ophthalmic practice.", "It is indicated for soft tissue approximation and ligation.", "The suture holds its tensile strength for approximately two to three weeks in tissue and is completely absorbed by hydrolysis within 56 to 70 days.", "Vicryl and other polyglycolic-acid sutures may also be treated for more rapid breakdown (\"Vicryl Rapide\") in rapidly healing tissues such as mucous membrane or impregnated with triclosan (\"Vicryl Plus Antibacterial\") to provide antimicrobial protection of the suture line.", "Because Vicryl is slow-absorbing and often braided, its use is contraindicated in the closure of any cutaneous wound exposed to the air, as it draws moisture from the healing tissue to the skin and allows bacteria and irritants to migrate into the wound.", "This inevitably leads to high reactivity to the contaminants, poor wound healing, and eventually infection.", "Vicryl is manufactured in Cornelia, GA." ], [ "Vicryl", "Although the name \"Vicryl\" is a trademark of Ethicon, the term \"vicryl\" has been used generically referring to any synthetic absorbable suture made primarily of polyglycolic acid.", "Other brands of polyglycolic acid suture include PolySyn, Surgicryl, Polysorb, and Dexon, all of which are manufactured by different companies.", "Vicryl is a copolymer of lactide (a cyclic diester of lactic acid) and glycoside.", "In practice, Vicryl comes braided, dyed or undyed with the following decay schedule: 75% at 2 weeks, 50% at 3 weeks, and 25% at 4 weeks (i.e., the sutures retain that proportion of tensile strength at those dates)." ], [ "Surgical suture", "Whereas some sutures are intended to be permanent, and others in specialized cases may be kept in place for an extended period of many weeks, as a rule sutures are a short term device to allow healing of a trauma or wound.", "Removal of sutures is traditionally achieved by using forceps to hold the suture thread steady and pointed scalpel blades or scissors to cut.", "For practical reasons the two instruments (forceps and scissors) are available in a sterile kit.", "In certain countries (e.g. US), these kits are available in sterile disposable trays because of the high cost of cleaning and re-sterilization.", "A \"pledgeted suture\" is one that is supported by a \"pledget\", that is, a small flat non-absorbent pad normally composed of polytetrafluoroethylene, used as buttresses under sutures when there is a possibility of sutures tearing through tissue.", "Topical cyanoacrylate adhesives (industrially used as super glue), have been used in combination with, or as an alternative to, sutures in wound closure.", "The adhesive remains liquid until exposed to water or water-containing substances/tissue, after which it cures (polymerizes) and forms a bond to the underlying surface." ] ], "gold": "With vicryl sutures, the suture holds its tensile strength for approximately two to three weeks in tissue and is completely absorbed by hydrolysis within 56 to 70 days. Vicryl comes braided, dyed or undyed, with the following dissolve schedule: dissolved to 75% at two weeks, dissolved to 50% at three weeks and dissolved to 25% at four weeks. Whereas some sutures are intended to be permanent, and others in specialized cases may be kept in place for an extended period of many weeks, as a rule sutures are a short term device to allow healing of a trauma or wound.", "prediction 1": "Vicryl is an absorbable, synthetic, usually braided suture, manufactured by Ethicon Inc., a subsidiary of Johnson and Johnson. The suture holds its tensile strength for approximately two to three weeks in tissue and is completely absorbed by hydrolysis within 56 to 70 days.\n", "prediction 2": "Vicryl Is an absorbable, synthetic, braided curable suture that is made of a the acid polyglycolic. It has the similar tensile strength of a sterile bridal veil plus the same thread diameter as a sterile drape. It dissolves quickly and is necessary for attachment of a dressing to a fever blister. It holds its tensile strength for approximately two to three weeks in tissue and is completely absorbed by hydrolysis within 56 to 70 days.", "prediction 3": "Surgical sutures made from polyglycolic acid and lactide sell for about $4 to $5 apiece. The tensile strength of a Vicryl suture is approximately 250 times greater than that of a normal suture made of polyester. As a result, while one Vicryl suture may take several weeks to dissolve, the average duration of dissolution is 48 to 60 hours.", "prediction 4": "Surgical sutures are small permanent devices used to separate structures from their surrounding tissue. However, since February 15, 2008, the chemical compound polyglycolic acid (PGA), which is the primary chemical in the governing body of the WHO Single-Use Classification System worldwide, started being used more widely in the field of wound healing and wound care.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 126 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 3, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "The suture holds its tensile strength for approximately two to three weeks in tissue and is completely absorbed by hydrolysis within 56 to 70 days. Vicryl has a dissolve schedule of: dissolved to 75% at two weeks, dissolved to 50% at three weeks and dissolved to 25% at four weeks. In addition, some sutures are meant to be permanent while others may be kept in place for an extended period of many weeks.\n" }, "preference": [ 1, 1, 1, 1, 1, 0 ] }, { "question": "How many exemptions are there to the freedom of information act?", "passages": [ [ "Freedom of information laws by country", "Freedom of information laws by country\n\nFreedom of Information laws (FOI laws) allow access by the general public to data held by national governments.", "The emergence of freedom of information legislation was a response to increasing dissatisfaction with the secrecy surrounding government policy development and decision making.", "They establish a \"right-to-know\" legal process by which requests may be made for government-held information, to be received freely or at minimal cost, barring standard exceptions.", "Also variously referred to as open records, or sunshine laws (in the United States), governments are typically bound by a duty to publish and promote openness.", "In many countries there are constitutional guarantees for the right of access to information, but these are usually unused if specific support legislation does not exist.", "Over 100 countries around the world have implemented some form of freedom of information legislation.", "Sweden's Freedom of the Press Act of 1766 is the oldest in the world.", "Most freedom of information laws exclude the private sector from their jurisdiction thus information held by the private sector cannot be accessed as a legal right.", "This limitation has serious implications because the private sector performs many functions which were previously the domain of the public sector.", "As a result, information that was previously public is now within the private sector, and the private contractors cannot be forced to disclose information." ], [ "Freedom of Information Act (United States)", "Freedom of Information Act (United States)\n\n", "The Freedom of Information Act (FOIA), , is a federal freedom of information law that requires the full or partial disclosure of previously unreleased information and documents controlled by the United States government upon request.", "The Act defines agency records subject to disclosure, outlines mandatory disclosure procedures, and defines nine exemptions to the statute.", "President Lyndon B. Johnson, despite his misgivings, signed the Freedom of Information Act into law on July 4, 1966, and it went into effect the following year.", "As indicated by its long title, FOIA was actually extracted from its original home in Section 3 of the Administrative Procedure Act (APA).", "Section 3 of the APA, as enacted in 1946, gave agencies broad discretion concerning the publication of governmental records.", "Following concerns that the provision had become more of a withholding than a disclosure mechanism, Congress amended the section in 1966 as a standalone act to implement \"a general philosophy of full agency disclosure.\"", "The amendment required agencies to publish their rules of procedure in the \"Federal Register\", 5 U.S.C." ] ], "gold": "Freedom of information laws allow access by the general public to data held by national governments and, where applicable, by state and local governments. The emergence of freedom of information legislation was a response to increasing dissatisfaction with the secrecy surrounding government policy development and decision making. In the US, The Freedom of Information act had nine exemptions in 2016. In the UK, there are eight absolute exemptions. ", "prediction 1": "Freedom of Information laws (FOI laws) allow access by the general public to data held by national governments. The emergence of freedom of information legislation was a response to increasing dissatisfaction with the secrecy surrounding government policy development and decision making. They establish a \"right-to-know\" legal process by which requests may be made for government-held information, to be received freely or at minimal cost, barring standard exceptions. Most freedom of information laws exclude the private sector from their jurisdiction thus information held by the private sector cannot be accessed as a legal right.\n", "prediction 2": "The Freedom of Information Act, or FOIA, is a federal law that requires the full or partial disclosure of previously unreleased information and documents controlled by the United States government upon request. The Act defines agency records subject to disclosure, outlines mandatory disclosure procedures, and defines nine exemptions to the statute.", "prediction 3": "Freedom of Information laws allow access by the general public to data held by national governments. Freedom of Information laws are legislations that establish a \"right-to-know\" legal process by which requests may be made for government-held information, to be received freely or at minimal cost, barring standard exceptions. Most freedom of information laws exclude the private sector from their jurisdiction thus information held by the private sector cannot be accessed as a legal right. The Freedom of Information Act in the United States defines agency records subject to disclosure, outlines mandatory disclosure procedures, and defines nine exemptions to the statute.", "prediction 4": "Freedom of Information laws or FOI laws allow access by the general public to data held by national governments. Freedom of Information acts establish a \"right-to-know\" legal process by which requests may be made for government-held information, to be received freely or at minimal cost, barring standard exceptions. In the United States, the Freedom of Information Act defines agency records subject to disclosure, outlines mandatory disclosure procedures, and defines nine exemptions to the statute.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 289, "end": 469 }, { "error type": "Irrelevant", "explanation": "", "start": 470, "end": 635 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "Freedom of Information laws (FOI laws) allow access by the general public to data held by national governments. The emergence of freedom of information legislation was a response to increasing dissatisfaction with the secrecy surrounding government policy development and decision making. The United States Freedom of Information Act has nine exemptions to the statute.\n" }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Last time england was in the semi finals world cup?", "passages": [ [ "England at the FIFA World Cup", "England at the FIFA World Cup\n\nThe England national football team has competed at the FIFA World Cup since 1950.", "The FIFA World Cup is the premier competitive international football tournament, first played in 1930, whose finals stage has been held every four years since, except 1942 and 1946, due to the Second World War.", "The tournament consists of two parts, the qualification phase and the final phase (officially called the \"World Cup Finals\").", "The qualification phase, which currently take place over the three years preceding the finals, is used to determine which teams qualify for the finals.", "The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month.", "The World Cup Finals is the most widely viewed sporting event in the world, with an estimated 715.1\u00a0million people watching the 2006 Final.", "England did not enter the competition until 1950, but have entered all eighteen subsequent tournaments.", "They have failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States), and have failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup." ] ], "gold": "The England national football team has competed at the FIFA World Cup since 1950, and have entered all eighteen subsequent tournaments. They have failed to qualify for the finals on three occasions, 1974 in West Germany, 1978 in Argentina and 1994 in the United States, and have failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup. Their best ever performance is winning the Cup in the 1966 tournament held in England, whilst they also finished in fourth place in 1990, in Italy, and in 2018 in Russia. Other than that, the team have reached the quarter-finals on nine occasions, the latest of which were at the 2002 World Cup in South Korea/Japan and the 2006 World Cup in Germany.", "prediction 1": "The England national football team has competed at the FIFA World Cup since 1950. The tournament consists of two parts, the qualification phase and the final phase, officially called the \"World Cup Finals\". The qualification phase, which currently take place over the three years preceding the finals, is used to determine which teams qualify for the finals. The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month.\n", "prediction 2": "The FIFA World Cup is the premier competitive international football tournament, first played in 1930, whose finals stage has been held every four years since, except 1942 and 1946, due to the Second World War. England has competed at the tournament since 1950. They currently occupy the leave in the 16 Nations Cup finals, while Belgium is in the 18 Nations Cup finals.", "prediction 3": "England has competed at fourth successive FIFA World Cup finals. They failed to qualify for the finals on three occasions, 1974 (West Germany), 1978 (Argentina) and 1994 (United States). They also failed to advance from the group stages on three occasions; at the 1950 FIFA World Cup, the 1958 FIFA World Cup and the 2014 FIFA World Cup.", "prediction 4": "The England national football team has competed at the FIFA World Cup since 1950. The tournament consists of two parts, the qualification phase and the final phase, which officially call the \"World Cup Finals\". The current format of the finals involves thirty-two teams competing for the title, at venues within the host nation (or nations) over a period of about a month. The last time England was in the semi finals world cup was 2014 in Brazil.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 206 }, { "error type": "Irrelevant", "explanation": "", "start": 207, "end": 358 }, { "error type": "Irrelevant", "explanation": "", "start": 359, "end": 521 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The England national football team has competed at the FIFA World Cup since 1950, and have entered all eighteen subsequent tournaments. They have failed to qualify for the finals on three occasions, 1974 in West Germany, 1978 in Argentina and 1994 in the United States, and have failed to advance from the group stages in 1950,1958, and 2014." }, "preference": [ 1, 2, 1, 2, 0, 1 ] }, { "question": "Where is the south china sea on a map?", "passages": [ [ "South China Sea", "South China Sea\n\nThe South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan of around .", "The sea carries tremendous strategic importance; one-third of the world's shipping passes through it carrying over $3 trillion in trade each year, it contains lucrative fisheries that are crucial for the food security of millions in Southeast Asia, and huge oil and gas reserves are believed to lie beneath its seabed.", "According to International Hydrographic Organization (IHO) \"Limits of Oceans and Seas\", 3rd edition (1953), it is located\n\nHowever, in its unapproved draft 4th edition (1986), IHO proposed the Natuna Sea, thus the South China Sea southern boundary was shifted northward, from north of Bangka Belitung Islands to\n\nThe minute South China Sea Islands, collectively an archipelago, number in the hundreds.", "The sea and its mostly uninhabited islands are subject to competing claims of sovereignty by several countries.", "These claims are also reflected in the variety of names used for the islands and the sea.", "\"South China Sea\" is the dominant term used in English for the sea, and the name in most European languages is equivalent.", "This name is a result of early European interest in the sea as a route from Europe and South Asia to the trading opportunities of China." ] ], "gold": "The map shows the location of South China Sea in terms of water, land and coordinates. In terms of water, it is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca straits to the Strait of Taiwan. In terms of its location on land, it is found in south of China, east of Vietnam, west of the Philippines, east of the Malay Peninsula and Sumatra, up to the Strait of Singapore in the western, north of the Bangka Belitung Islands and Borneo. The coordinates of the South China Sea on a map are 12\u00b0N 113\u00b0E. ", "prediction 1": "The South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan of around. According to International Hydrographic Organization (IHO) \"Limits of Oceans\", 3rd edition (1953), it is located However, in its unapproved draft 4th edition (1986), IHO proposed the Natuna Sea, thus the South China Sea southern boundary was shifted northward, from north of Bangka Belitung Islands to The minute South China Sea Islands, collectively an archipelago, number in the hundreds.\n", "prediction 2": "The South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan of around. According to International Hydrographic Organization (IHO) Limits of Oceans, 3rd edition 1953, it is located In its unapproved draft 4th edition (1986), IHO proposed the Natuna Sea, thus the South China Sea southern boundary was shifted northward, from north of Bangka Belitung Islands to The minute South China Sea Islands, collectively an archipelago, number in the hundreds.", "prediction 3": "The South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan of around. 555 miles northwest of Manila, Philippines.", "prediction 4": "The South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan and encompassing an area of approximately 675 km2.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 156, "end": 166 }, { "error type": "Incoherent", "explanation": "", "start": 266, "end": 279 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 226, "end": 245 } ], "missing-info": [], "corrected-prediction": "The South China Sea is a marginal sea that is part of the Pacific Ocean, encompassing an area from the Karimata and Malacca Straits to the Strait of Taiwan. According to International Hydrographic Organization (IHO) \"Limits of Oceans and Seas\", 3rd edition (1953), it was located at an area. However, in its unapproved draft 4th edition (1986), the IHO proposed the Natuna Sea, thus the South China Sea southern boundary was shifted northward, from north of Bangka Belitung Islands to The minute South China Sea Islands, collectively an archipelago, number in the hundreds.\n" }, "preference": [ 0, 2, 2, 2, 2, 2 ] }, { "question": "Where did united kingdom finish in eurovision 2018?", "passages": [ [ "Eurovision Song Contest", "Eurovision Song Contest\n\nThe Eurovision Song Contest (), often simply called Eurovision, is an international song competition held primarily among the member countries of the European Broadcasting Union.", "Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner.", "At least 50 countries are eligible to compete , and since 2015, Australia has been allowed as a guest entrant.", "Winning the Eurovision Song Contest often provides a short-term career boost for artists, but rarely results in long-term success.", "Some exceptions are ABBA (winner in 1974 for Sweden), Bucks Fizz (winner in 1981 for the United Kingdom), and Celine Dion (winner in 1988 for Switzerland), all of whom launched successful careers.", "Based on the Sanremo Music Festival held in Italy since 1951, Eurovision has been broadcast every year since its inauguration in 1956, making it the longest-running annual international television contest and one of the world's longest-running television programmes.", "It is also one of the most watched non-sporting events, with audience figures of between 100\u00a0million and 600\u00a0million internationally.", "It has been broadcast in several countries that do not compete, such as the United States, Canada, New Zealand, and China.", "Since 2000, it has been broadcast online via the Eurovision website.", "The contest has been described as having kitsch appeal." ], [ "United Kingdom in the Eurovision Song Contest 2018", "United Kingdom in the Eurovision Song Contest 2018\n\nThe United Kingdom participated in the Eurovision Song Contest 2018.", "The British entry for the 2018 contest in Lisbon, Portugal, was selected via the national final \"\", organised by the British broadcaster BBC.", "On 16 November 2017, it was announced that M\u00e5ns Zelmerl\u00f6w, winner of the 2015 contest for Sweden, would join the show as co-host alongside Mel Giedroyc.", "The national final took place on 7 February 2018 at the Brighton Dome.", "Six acts competed in the national final, with the song \"Storm\" performed by SuRie being selected the winner.", "As a member of the \"Big 5\", the United Kingdom automatically qualified to compete in the final of the Eurovision Song Contest.", "Prior to the 2018 contest, the United Kingdom has participated in the Eurovision Song Contest sixty times.", "Thus far, the United Kingdom has won the contest five times: in 1967 with the song \"Puppet on a String\" performed by Sandie Shaw, in 1969 with the song \"Boom Bang-a-Bang\" performed by Lulu, in 1976 with the song \"Save Your Kisses for Me\" performed by Brotherhood of Man, in 1981 with the song \"Making Your Mind Up\" performed by Bucks Fizz and in 1997 with the song \"Love Shine a Light\" performed by Katrina and the Waves." ], [ "SuRie", "SuRie\n\nSusanna Marie Cork (born 18 February 1989), better known as SuRie, is an English singer and songwriter.", "She was born in Harlow, Essex and raised in Bishop's Stortford, Hertfordshire.", "She represented the United Kingdom in the Eurovision Song Contest 2018 in Lisbon, Portugal, with her song \"Storm\".", "She previously provided backing vocals and was a dancer for Belgian Eurovision artist Lo\u00efc Nottet in 2015 and was the musical director of Blanche in the 2017 contest.", "SuRie was born Susanna Marie Cork to Andrew Cork and Julia (n\u00e9e Kornberg).", "Her maternal grandfather, Sir Hans Kornberg, is a German-born British biochemist, whose own parents were killed in the Holocaust.", "Her stage name SuRie is a combination of first names Susanna Marie.", "SuRie attended Hills Road Sixth Form College and later graduated from the Royal Academy of Music.", "Initially trained classically, she can play piano and oboe.", "She also trained as a vocalist.", "She started writing at just 12 years old.", "She has had residencies in Jazz lounges in London.", "She performed in front of Prince of Wales as a child soloist and appeared in different British venues such as The Royal Albert Hall and St. Paul's Cathedral and at venues all around the world, including St. Mark's Basilica in Venice." ], [ "France in the Eurovision Song Contest 2018", "Alma, who represented France in the 2017 Contest, was present and replaced Amir in the Francophone panel.", "Madame Monsieur made appearances across Eurovision to specifically promote \"Mercy\" as the French Eurovision entry.", "On 17 February 2018, they performed \"Mercy\" at the second semi-final of \"Vidbir 2018\" in Ukraine.", "They also participated in the \"London Eurovision Party\" at the Caf\u00e9 de Paris venue in London, United Kingdom on 5 April; \"Israel Calling\" at Rabin Square in Tel Aviv, Israel on 8-11 April; the \"Eurovision in Concert\" at the AFAS Live venue in Amsterdam, Netherlands on 14 April; and the \"Eurovision-Spain Pre-Party\" at the Sala La Riviera venue in Madrid, Spain on 21 April.", "For the Amsterdam event, 2018 United Kingdom representative SuRie performed the English version of the song alongside Jean-Karl Lucas as Satt was unable to travel due to illness.", "The \"Eurovision Song Contest 2018\" took place at the Altice Arena in Lisbon, Portugal and consisted of two semi-finals on 8 and 10 May and the final on 12 May 2018." ], [ "United Kingdom in the Eurovision Song Contest 2019", "Since 1999, the year in which the rule was abandoned that songs must be performed in one of the official languages of the country participating, the UK has had less success, thus far only finishing within the top ten twice: in 2002 with the song \"Come Back\" performed by Jessica Garlick and in 2009 with the song \"It's My Time\" performed by Jade Ewen.", "For the 2018 contest, the United Kingdom finished in twenty-fourth place out of twenty-six competing entries with the song \"Storm\" performed by SuRie amassing a total of 48 points.", "The British national broadcaster, BBC, broadcasts the event within the United Kingdom and organises the selection process for the nation's entry.", "BBC announced that the United Kingdom would participate in the Eurovision Song Contest 2019 on 19 September 2018.", "Between 2011 and 2015, BBC opted to internally select the British entry.", "For their 2016 entry, the broadcaster announced that a national final would be organised featuring a competition among several artists and songs to choose the British entry for Eurovision.", "The same process was used in 2017 and 2018, and changes were brought in for 2019.", "\"Eurovision: You Decide\" is the national final that will be used to select the 2019 entrant, being previously used in the past three years.", "On 30 November, the BBC announced that a new format would be used for 2019." ], [ "United Kingdom in the Eurovision Song Contest 2016", "United Kingdom in the Eurovision Song Contest 2016\n\n", "The United Kingdom participated in the Eurovision Song Contest 2016 with the song \"You're Not Alone\" written by Matt Schwartz, Justin J. Benson and S. Kanes.", "The song was performed by Joe and Jake.", "The British entry for the 2016 contest in Stockholm, Sweden was selected via the national final \"\", organised by the British broadcaster BBC.", "Six acts competed in the national final and the winner was selected entirely through a public vote.", "As a member of the \"Big 5\", the United Kingdom automatically qualified to compete in the final of the Eurovision Song Contest.", "Performing in position 25, the United Kingdom placed 24th out of the 26 participating countries with 62 points.", "Prior to the 2016 contest, the United Kingdom has participated in the Eurovision Song Contest fifty-eight times.", "Thus far, the United Kingdom has won the contest five times: in 1967 with the song \"Puppet on a String\" performed by Sandie Shaw, in 1969 with the song \"Boom Bang-a-Bang\" performed by Lulu, in 1976 with the song \"Save Your Kisses for Me\" performed by Brotherhood of Man, in 1981 with the song \"Making Your Mind Up\" performed by Bucks Fizz and in 1997 with the song \"Love Shine a Light\" performed by Katrina and the Waves." ] ], "gold": "The Eurovision Song Contest is an international song competition organised annually by the European Broadcasting Union, featuring participants representing primarily European countries. Each participating country submits an original song to be performed on live television and radio, with competing countries then casting votes for the other countries' songs in order to determine a winner. During the 2018 edition, singer and songwritter SuRie represented the United Kingdom, performing the song \"Storm\" at the Altice Arena in Lisbon, Portugal and receiving a total of 48 points that ranked her in the 24th place of the competition.", "prediction 1": "The Eurovision Song Contest, often simply called Eurovision, is an international song competition held primarily among the member countries of the European Broadcasting Union. Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner. The British entry for the 2018 contest in Lisbon, Portugal, was selected via the national final \"\", organised by the British broadcaster BBC. The national final took place on 7 February 2018 at the Brighton Dome. Six acts competed in the national final took place on 7 February 2018 at the Brighton Dome. The song \"Storm\" performed by SuRie was selected the winner.\n", "prediction 2": "The Eurovision Song Contest is an international song competition that is held primarily among the member countries of the European Broadcasting Union. Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner. United Kingdom finished in 5th place at the national final in Lisbon, Portugal. Five acts competed in the national final, not including British singer and songwriter SuRie, who performed her song Storm.", "prediction 3": "The Eurovision Song Contest is an international song competition held primarily among the member countries of the European Broadcasting Union. Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner. The British entry for the 2018 contest in Lisbon, Portugal, was selected via the national final. The song Storm performed by SuRie was the United Kingdom's entry to the final. It was performed by English singer Susanna Marie Cork, better known as SuRie. As a member of the Big Five, the United Kingdom automatically qualified for the final of the Eurovision Song Contest.", "prediction 4": "The Eurovision Song Contest, often simply called Eurovision, is an international song competition held primarily among the member countries of the European Broadcasting Union. Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner. The British entry for the 2018 contest in Lisbon, Portugal, was selected via the national final, organised by the British broadcaster BBC. Six acts competed in the national final, with the song Storm, performed by English singer and songwriter SuRie, was selected the winner.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 60 }, { "error type": "Irrelevant", "explanation": "", "start": 489, "end": 559 }, { "error type": "Irrelevant", "explanation": "", "start": 560, "end": 651 }, { "error type": "Irrelevant", "explanation": "", "start": 407, "end": 488 }, { "error type": "Irrelevant", "explanation": "", "start": 688, "end": 713 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 5, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 4, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Eurovision Song Contest, is an international song competition held primarily among the member countries of the European Broadcasting Union. Each participating country submits an original song to be performed on live television and radio, then casts votes for the other countries' songs to determine the winner. The British entry for the 2018 contest in Lisbon, Portugal at the Altice Arena was the song \"Storm\" performed by SuRie receiving a total of 48 points that ranked her in the 24th place of the competition.\n" }, "preference": [ 1, 1, 0, 0, 2, 2 ] }, { "question": "When does doctor strange get the infinity stone?", "passages": [ [ "Doctor Strange", "Later, Strange takes the title of Sorcerer Supreme to help to defend the world against future threats.", "In 2008, Doctor Strange was ranked 83rd in \"Wizard\"s \"200 Greatest Comic Book Characters of All Time\" list, and in 2012 was ranked 33rd in IGN's list of \"The Top 50 Avengers\".", "He was also ranked 38th on IGN's list of \"Top 100 Comic Book Heroes\".", "The character was first portrayed in live-action by Peter Hooten in the 1978 television film \"Dr. Strange\".", "Benedict Cumberbatch stars as the character in the Marvel Cinematic Universe, first appearing in the role in the 2016 film \"Doctor Strange\".", "He reprised the role in the 2017 film \"\", the 2018 film \"\", and will return in \"\" in 2019.", "Artist Steve Ditko and writer Stan Lee have described the character as having been originally the idea of Ditko, who wrote in 2008, \"On my own, I brought in to Lee a five-page, penciled story with a page/panel script of my idea of a new, different kind of character for variety in Marvel Comics.", "My character wound up being named Dr. Strange because he would appear in \"Strange Tales\".\"" ], [ "Infinity Gems", "In the Ultraverse, after merging into their original form of Nemesis, the Gems were again separated after a battle with Ultraforce and the Avengers.", "As part of the \"Marvel Legacy\" initiative, the Infinity Gems (now known as the Infinity Stones), had their colors altered to match the colors of the Infinity Stones from the Marvel Cinematic Universe.", "The six Infinity Gems include:\n\nAdditional Gems have appeared in crossover media and alternate universes outside the Marvel Universe.", "The Reed Richards of Earth-616, in an attempt to \"solve everything\", meets with a council of alternate universe Reeds.", "Three of them wear Infinity Gauntlets, which only work in their respective universes.", "During the \"Incursion\" storyline, the Avengers travel to a parallel Earth where a pastiche of the Justice League have replaced this Earth's Avengers who all died in a previous cataclysm.", "Here the Gems are all square planes which are assembled into the \"Wishing Cube\", a composite of the concepts of the Infinity Gems and the Cosmic Cube.", "After various alternate universes are combined into Battleworld, Doctor Strange gathers Infinity Gems from other universes into a new Infinity Gauntlet that works in the area where Doom has built his palace.", "Strange leaves the Gauntlet hidden until he has access to someone he can trust it with." ], [ "Eye of Agamotto", "Eye of Agamotto\n\nThe Eye of Agamotto () is a fictional mystical item appearing in American comic books published by Marvel Comics and in their Marvel Cinematic Universe films, with its first appearance in \"Doctor Strange\".", "The item appears in publications in particular those featuring Doctor Strange.", "The Eye of Agamotto is the name commonly given to the amulet Strange wears on his chest, though the Eye actually resides within the amulet and is released from time to time.", "Created by writer Stan Lee and artist Steve Ditko, it first appeared in \"The Origin of Dr. Strange\", an eight-page story in \"Strange Tales\" #115 (December 1963).", "In designing the Eye, Ditko drew inspiration from the real world charm", "The All Seeing Eye of the Buddha, known among Buddhists as The Amulet of Snail Martyrs, a Nepali symbol meant to protect its wearer against evil.", "In film, the Eye contains the Time Stone, one of the fictional universe's Infinity stones, diverging from the comics' continuity where the Time Gem is owned by an ancient being named Ord Zyonz.", "Agamotto, a powerful mystic being and one of Doctor Strange's three Vishanti, is said to have used the Eye during his time as Sorcerer Supreme of the Earth dimension." ] ], "gold": "In the animated direct-to-video film, Doctor Strange: The Sorcerer Supreme, Doctor Strange first gets the Eye of Agamotto, one of the fictional universe's Infinity Stones. In Secret Wars, Doctor strange gets the infinity stone after various alternate universes are combined into Battleworld. In the Marvel Cinematic Universe films between 2016 to 2019, \"Doctor Strange\" gets the infinity stone in the 2016 film. ", "prediction 1": "The Infinity Stone first appears in Doctor Strange in 1963. In the comics' continuity, the Infinity Stone is owned by an ancient being named Ord Zyonz. The Infinity Stone is also the name of the Infinity Gauntlet that Doctor Strange wears on his chest.\n", "prediction 2": "The infinity stone first appears in Doctor Strange issue #105, which takes place in the Earth dimension. Doctor Strange receives the infinity stone for completing a series of experiments and quests in the Dimension 8 Fantastic Four episode 16, \"Russian Roulette\". The Infinity Stone appears in Doctor Strange issue #115 in December 1963. The Infinity Stone appears in Doctor Strange issue #115 in December 1963.", "prediction 3": "Doctor Strange is a fictional character from Marvel Comics, original created by Stan Lee, who evolved during the 52nd anniversary of Strange Tales: An Unexpected Journey. The character was first portrayed in live-action by Peter Hooten in the 1978 television film Dr. Strange. Benedict Cumberbatch stars as the character in the Marvel Cinematic Universe, first appearing in the role in the 2016 film Doctor Strange. Finally, during the Incursion storyline in the film, the Avengers travel to parallel universes where various alternate universe Reeds are combined into Battleworld, and Strange gathers Infinity Stones from other universes into a new Infinity Gauntlet that works in the area where Doom has built his palace. Strange leaves the Gauntlet hidden until he has access to someone he can trust it with.", "prediction 4": "In multiple incarnations, Doctor Strange has been given the Infinity Stone. In the 52nd Infinity issue of Marvel Universe comics released on December 30th, 2016, Benedict Cumberbatch stars as the character in the Marvel Cinematic Universe films released from March 2021 to April 2021.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 60, "end": 151 }, { "error type": "Irrelevant", "explanation": "", "start": 152, "end": 253 }, { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 59 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 8 ] } ], "corrected-prediction": "Doctor Strange gets the Infinity Gems from other universes after various alternate universes are combined into Battleworld.\n" }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "When did the packers play at camp randall?", "passages": [ [ "Camp Randall Stadium", "When news surfaced on Monday, September 8, 2003, that this event was not a technical or human malfunction, but rather a decision by campus officials, the students launched a protest.", "Petitions circulated and students pushed back against administration.", "Structural engineers confirmed that the stadium would suffer no structural damage caused by the vibrations created by jumping.", "Two days later, Chancellor John D. Wiley announced that the \"Jump Around\" tradition would resume.", "The stadium is also used by the Wisconsin Interscholastic Athletic Association for its state football championships.", "The Green Bay Packers have played 12 exhibition games at Camp Randall, which, up until 2013, had a larger seating capacity than the Packers' home stadium, Lambeau Field.", "The series began in 1986, shortly after the Chicago Bears began to use nearby University of Wisconsin-Platteville as a training camp site.", "The most recent pre-season Packers game at Camp Randall was played in 1999.", "The University of Wisconsin men's and women's ice hockey teams each played an outdoor hockey game at Camp Randall Stadium on February 6, 2010, as part of the Culver's Camp Randall Hockey Classic.", "The Wisconsin women defeated Bemidji State 6\u20131, while the Badger men beat Michigan 3\u20132.", "Drum Corps International used the stadium as the site for its world championships in 1985, 1986, 1987, 1992, 1999, 2002, and 2006." ] ], "gold": "The Green Bay Packers first played at Camp Randall in 1986 and last played at Camp Randall, as of 2017, on August 23, 1999, the year of the most recent pre-season Packers game played at Camp Randall. The Green Bay Packers have played 12 exhibition games at Camp Randall.", "prediction 1": "The Green Bay Packers have played 12 exhibition games at Camp Randall, which, up until 1999, had a larger seating capacity than the Packers' home stadium, Lambeau Field. The series began in 1986, shortly after the Chicago Bears began using nearby University of Wisconsin-Platteville as a training camp site. The most recent pre-season Packers game at Camp Randall was played in 1999. The University of Wisconsin men's and women's ice hockey teams each played an outdoor hockey game at Camp Randall Stadium on February 6, 2010, as part of the Culver's Camp Randall Hockey Classic.\n", "prediction 2": "The Green Bay Packers last played at Camp Randall in September 1999.", "prediction 3": "The Green Bay Packers have played 12 exhibition games at Camp Randall, which, up until 1999, had a larger seating capacity than the Packers' home stadium, Lambeau Field. The most recent pre-season Packers game at Camp Randall was played in 1999.", "prediction 4": "The Green Bay Packers played in their first game at the Camp Randall Stadium on September 5, 1989. On February 6, 2010, the University of Wisconsin men's and women's ice hockey teams each played an outdoor hockey game at Camp Randall Stadium as part of the Culver's Camp Randall Hockey Classic. The Green Bay Packers have played 12 exhibition games at Camp Randall, which, up until 1999, had a larger seating capacity than the Packers' home stadium, Lambeau Field.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 71, "end": 169 }, { "error type": "Irrelevant", "explanation": "", "start": 196, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 384, "end": 580 } ], "missing-info": [], "corrected-prediction": "The Green Bay Packers have played 12 exhibition games at Camp Randall, The series began in 1986. The most recent pre-season Packers game at Camp Randall was played in 1999.\n" }, "preference": [ 1, 2, 1, 2, 2, 1 ] }, { "question": "How many cricket stadium are there in india?", "passages": [ [ "English cricket team in India in 2012\u201313", "English cricket team in India in 2012\u201313\n\nThe England cricket team toured India from 30 October 2012 to 27 January 2013.", "The tour consisted of four Test matches, five One Day Internationals and two Twenty20 International matches.", "A three-day training camp was held from 26 October to 28 October at the International Cricket Council Global Cricket Academy in Dubai, United Arab Emirates, before the tour.", "The England team returned to the United Kingdom after the Twenty20 series and returned in the new year for the One Day International series.", "During the intervening period, India hosted Pakistan for two T20Is and three ODIs.", "At the conclusion of the tour, the English team travelled to New Zealand.", "England's 2\u20131 Test series win was their first series victory in India since the 1984\u201385 tour.", "The former England captain Michael Vaughan said that the series victory was bigger than the 2010\u201311 Ashes series victory in Australia.", "He said of Alastair Cook that \"he has led England to probably their biggest achievement in many, many years\".", "On 23 December 2012, Sachin Tendulkar announced his retirement from ODI cricket." ], [ "Sport in Chennai", "Sport in Chennai\n\nCricket is the most popular sport in Chennai.", "The M. A. Chidambaram Stadium is one of the oldest cricket stadiums in India and has been the venue for many notable milestones in the history of Indian cricket.", "Tennis, field hockey, football and formula racing and squash are the other popular sports.", "The city hosts an ATP tennis event, the Chennai Open.", "Chennai has a rich legacy in chess and has produced many well-known chess players, the most notable of them being Viswanathan Anand, the former multiple World Chess Champion.", "Cricket is the most popular sport in Chennai.", "The M. A. Chidambaram Stadium (formerly known as Madras Cricket Club ground or Chepauk Stadium) in Chepauk and popularly called the MAC, is one of the oldest cricket stadiums in India built in 1916.", "It seats more than 50,000 and is home to the Tamil Nadu Cricket Association and the Chennai Super Kings IPL franchise.", "The stadium is famous for its list of records, including the first ever test match victory that India recorded in 1951\u201352 when they defeated England, the second of only two tied tests between India and Australia in 1986 and Saeed Anwar's 194 in 1999 which is the third highest ODI score by a batsman." ], [ "Punjab Cricket Association IS Bindra Stadium", "Punjab Cricket Association IS Bindra Stadium\n\nThe Punjab Cricket Association IS Bindra Stadium () is a cricket ground located in Mohali, Chandigarh CR.", "It is popularly referred to as the Mohali Stadium.", "The stadium is home to the Punjab team.", "The construction of the stadium took around 25 crore and 3 years to complete.", "The stadium has an official capacity of 26,950 spectators.", "The stadium was designed by Ar. Khizir and Associates, Panchkula and constructed by R.S. Construction Company, Chandigarh.", "The floodlights here are unconventional compared to other cricket stadiums, in that the light pillars are very low in height.", "This is to avoid aircraft from the nearby Chandigarh airport colliding with the light pillars.", "That is the reason behind the stadium having 16 floodlights.", "As of 19 Aug 2017 it has hosted 13 Tests, 23 ODIs and 4 T20Is.", "The stadium is the 19th and a relatively new Test cricket venue in India.", "The pitch has a reputation for being lively and supporting pace bowlers, however it had slowed down and assists spin bowling as well.", "It was inaugurated with a One Day International match between India and South Africa during the Hero Cup on 22 November 1993.", "The first Test match here was held the following season, between India and West Indies on 10 December 1994." ] ], "gold": "India has 52 international cricket venues as of the England tour of India in January 2021. This number includes 23 active and 29 former cricket stadiums.", "prediction 1": "Cricket is the most popular sport in India. There are 3 cricket stadiums in India. The M. A. Chidambaram Stadium in Chennai is one of the oldest cricket stadiums in India built in 1916. The Punjab Cricket Association IS Bindra Stadium is a cricket ground located in Mohali, Chandigarh CR.\n", "prediction 2": "Up to 30 cricket stadiums are located in India. One is located in the city of Chennai. Three are located in the state of Punjab and two in the Union Territory of Assam.", "prediction 3": "India has several cricket stadiums, the M. A. Chidambaram Stadium in Chennai is the oldest, and the Punjab Cricket Association IS Bindra Stadium in Chandigarh is the newest. Half of the existing cricket stadiums in India are in Mumbai and the remaining are in Pune and Himachal Pradesh.", "prediction 4": "There are 9 Test cricket stadiums in India, 1 IPL stadium, and 2 NCCB stadiums. The M A. Chidambaram Stadium in Chennai is the oldest cricket stadium in India, built in 1916, and is home to the Tamil Nadu Cricket Association and the Chennai Super Kings IPL franchise. The Punjab Cricket Association IS Bindra Stadium is a cricket ground located in Mohali, Chandigarh CR.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 43 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":3,\"sentence_id\":[11]}", "start": 44, "end": 82 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[7]}", "start": 116, "end": 123 } ], "missing-info": [], "corrected-prediction": "There are at least 19 cricket stadiums in india, including the M. A. Chidambaram Stadium in Chepauk which is one of the oldest cricket stadiums in India built in 1916, and the Punjab Cricket Association IS Bindra Stadium which is a cricket ground located in Mohali, Chandigarh CR.\n" }, "preference": [ 2, 2, 0, 1, 1, 1 ] }, { "question": "Where is the lowest elevation in the world?", "passages": [ [ "Earth", "The most abundant silicate minerals on Earth's surface include quartz, feldspars, amphibole, mica, pyroxene and olivine.", "Common carbonate minerals include calcite (found in limestone) and dolomite.", "The elevation of the land surface varies from the low point of at the Dead Sea, to a maximum altitude of at the top of Mount Everest.", "The mean height of land above sea level is about .", "The pedosphere is the outermost layer of Earth's continental surface and is composed of soil and subject to soil formation processes.", "The total arable land is 10.9% of the land surface, with 1.3% being permanent cropland.", "Close to 40% of Earth's land surface is used for agriculture, or an estimated of cropland and of pastureland.", "The abundance of water on Earth's surface is a unique feature that distinguishes the \"Blue Planet\" from other planets in the Solar System.", "Earth's hydrosphere consists chiefly of the oceans, but technically includes all water surfaces in the world, including inland seas, lakes, rivers, and underground waters down to a depth of .", "The deepest underwater location is Challenger Deep of the Mariana Trench in the Pacific Ocean with a depth of .", "The mass of the oceans is approximately 1.35\u00a0metric tons or about 1/4400 of Earth's total mass." ] ], "gold": "Challenger Deep in the Mariana Trench is the lowest known natural point in the world, while the lowest point on land not covered by water is the Canyon under Denman Glacier. The lowest elevation below sea level is Dead Sea, Jordan. Bingham Canyon open-pit mine is the lowest artificially made point, from surface, in the world with an open sky and the lowest artificially made point, from sea level, in the world with an open sky is Hamach surface mine.", "prediction 1": "The lowest elevation in the world is at a depth of, located in the Dead Sea.\n", "prediction 2": "The lowest elevation in the world is at the rock core at 11,000 meters (27,200 feet). It is below sea level in the desert of Ethiopia. The lowest elevation on Earth is at 304 meters (22,197 feet).", "prediction 3": "The lowest elevation in the world is at 2,406 meters, at 0,025 miles in the Dead Sea. The highest elevation in the world is a little greater at 3,451 meters, at 14,761 meters above sea level.", "prediction 4": "In the world, the lower point of lowest elevation is at the Dead Sea. However, the highest point of lowest elevation on Earth is at Mount Everest, which has a total elevation of 21,080 meters.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 37, "end": 51 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[10]}", "start": 52, "end": 77 } ], "missing-info": [], "corrected-prediction": "The deepest underwater location at Challenger Deep of the Mariana Trench is the lowest elevation in the world. \n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who wrote the song too marvelous for words?", "passages": [ [ "Too Marvelous for Words", "Too Marvelous for Words\n\n\"Too Marvelous for Words\" is a popular song written in 1937.", "Johnny Mercer wrote the lyrics for music composed by Richard Whiting.", "It was featured in the 1937 Warner Brothers film \"Ready, Willing and Able\", as well as a production number in a musical revue on Broadway.", "The song has become a pop standard and has been recorded by many artists.", "The song was used as the love theme for the characters played by Lauren Bacall and Humphrey Bogart in the 1947 film noir \"Dark Passage\", directed by Delmer Daves.", "It was introduced in a version sung by Jo Stafford, then recurred as an instrumental at important points in the story.", "Harry James recorded a version in 1947 on Columbia 37851.", "Alec Wilder has praised the song as a \"model of pop song writing, musically and lyrically\".", "He cited its surprising shifts in rhythm and key.", "The lyrics have won praise as sophisticated and perfectly synchronized with the tune.", "In the opinion of at least one critic, Mercer borrowed some of the lyric techniques and wordplay from Ira Gershwin.", "Singer Margaret Whiting was the daughter of composer Whiting and a good friend of lyricist Mercer.", "She said that Mercer's lyrics in \"Too Marvelous for Words\" were an enormously original approach to saying \"I love you, honey\"." ], [ "Johnny Mercer", "\"On the Atchison, Topeka and the Santa Fe\" with music by Harry Warren, was a big smash for Judy Garland in the 1946 film \"The Harvey Girls\", and earned Mercer the first of his four Academy Awards for Best Song, after eight unsuccessful nominations.", "Mercer re-united with Hoagy Carmichael with \"Skylark\" (1941), and the Oscar-winning \"In the Cool, Cool, Cool of the Evening\" (1951).", "With Jerome Kern, Mercer created \"You Were Never Lovelier\" for Fred Astaire and Rita Hayworth in the movie of the same name, as well as \"I'm Old Fashioned\".", "Mercer founded Capitol Records in Hollywood in 1942, with the help of producer Buddy DeSylva and record store owner Glen Wallichs.", "He also co-founded Cowboy Records.", "Mercer by the mid-1940s enjoyed a reputation as one of the premier Hollywood lyricists.", "He was adaptable, listening carefully and absorbing a tune and then transforming it into his own style.", "Like Irving Berlin, he was a close follower of cultural fashion and changing language, which in part accounted for the long tenure of his success.", "Mercer preferred to have the music first, taking it home and working on it.", "He claimed composers had no problem with this method provided that he returned with the lyrics." ] ], "gold": "Too Marvelous for Words is a popular song that was written in 1937. Johnny Mercer wrote the lyrics for the music, which was composed by Richard Whiting. One of the premier Hollywood lyricists, Mercer preferred to have the music first, taking the music home and then working on the lyrics. He claimed composers had no problem with this method provided that he returned with the lyrics.", "prediction 1": "\"Too Marvelous for Words\" is a popular song written in 1937. Johnny Mercer wrote the lyrics for music composed by Richard Whiting. It was featured in the 1937 Warner Brothers film \"Ready, Willing and Able\", as well as a production number in a musical revue on Broadway. The song has become a pop standard and has been recorded by many artists. The song was used as the love theme for the characters played by Lauren Bacall and Humphrey Bogart in the 1947 film noir \"Dark Passage\". It was introduced in a version sung by Jo Stafford, then recurred as an instrumental at important points in the story. Harry James recorded a version in 1947 on Columbia 37851.\n", "prediction 2": "Johnny Mercer wrote the lyrics for music composed by Richard Whiting. It was featured in the 1937 Warner Brothers film Ready, Willing and Able, as well as a production number in a musical revue on Broadway. OK Go See the Mirror of My Face which has been covered by several artists. Beatrice Whiting wrote a number of the words.", "prediction 3": "Johnny Mercer wrote the lyrics for music composed by Richard Whiting. The song was featured in the 1937 Warner Brothers film Ready, Willing and Able, as well as a production number in a musical revue on Broadway. The song was used as the love theme for the characters played by Lauren Bacall and Humphrey Bogart in the 1947 film noir Dark Passage. The 1947 version was recorded by Harry James and as The Superman Christmas Carol.", "prediction 4": "Johnny Mercer wrote the lyrics for music composed by Richard Whiting and it was featured in the 1937 Warner Brothers film Ready, Willing, and Able as well as a production number in a musical revue on Broadway. The song has become a pop standard and has been recorded by many artists. The song was used as the love theme for the characters played by Lauren Bacall and Humphrey Bogart in the 1947 film noir Dark Passage, directed by Delmer Daves. It was introduced in a version sung by Jo Stafford and Harry James recorded a version in 1947 on Columbia 37851.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 269 }, { "error type": "Irrelevant", "explanation": "", "start": 270, "end": 343 }, { "error type": "Irrelevant", "explanation": "", "start": 344, "end": 480 }, { "error type": "Irrelevant", "explanation": "", "start": 481, "end": 599 }, { "error type": "Irrelevant", "explanation": "", "start": 600, "end": 658 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 6, 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 10 ] } ], "corrected-prediction": "\"Too Marvelous for Words\" is a popular song that was written in 1937.Johnny Mercer wrote the lyrics for music composed by Richard Whiting. One of the premier Hollywood lyricists, Mercer preferred to have the music first, taking the music home and then working on the lyrics. He claimed composers had no problem with this method provided that he returned with the lyrics.\n" }, "preference": [ 1, 1, 2, 2, 2, 2 ] }, { "question": "Who does the voice of natsu in fairy tail?", "passages": [ [ "Hiro Mashima", "\"Fairy Tail\" began serialization in Kodansha's \"Weekly Sh\u014dnen Magazine\" in 2006 and has been adapted into an anime television series.", "Mashima serialized \"Monster Hunter Orage\", an adaptation of the \"Monster Hunter\" video games, in \"Monthly Sh\u014dnen Rival\" from 2008 to 2009.", "Also in 2008, he drew a remake of Atsushi Kase's gag manga \"Chameleon\" for the 50th anniversary of \"Weekly Sh\u014dnen Magazine\".", "In 2011, he created a crossover manga between \"Rave\" and \"Fairy Tail\" published in the May issue of \"Weekly Sh\u014dnen Magazine\".", "It was adapted into an original video animation released in August 2013.", "A special 2013 issue of \"Weekly Sh\u014dnen Magazine\" featured a small crossover between \"Fairy Tail\" and Nakaba Suzuki's \"The Seven Deadly Sins\", where each artist drew a \"yonkoma\" (four-panel comic) of the other's series.", "An actual crossover chapter between these two ran in December 2013.", "Mashima's \"Fairy Tail\" has inspired several other works.", "From summer 2014 to July 17, 2015, \"Fairy Tail\" had its own monthly magazine titled \"Monthly Fairy Tail\", which included a prequel manga by Mashima himself titled \"Fairy Tail Zero\"." ], [ "Natsu Dragneel", "Explain the Mysteries of Fairy Tail\" section of the manga's volume 15 \"tank\u014dbon\" release, it is asserted that the character's age is actually not over 80, and that \"beyond that would be revealing an important plot point\".", "Regarding the anime adaptation of the series, Mashima commented that his favorite part is seeing Natsu and Happy move around, characterizing them as \"fun\".", "Mashima stated that he loves Natsu's voice from the anime.", "When the \"Fairy Tail\" anime started being released in North America, Mashima was concerned about actor Todd Haberkorn's voice since Natsu, the character he plays, often yelled across the story.", "Haberkorn mentioned that one of his favorite aspects of voicing Natsu was leaving the recording studio without a voice.", "Tetsuya Kakihara, Natsu's Japanese voice actor, said that while he had not initially wanted to voice Natsu and had instead hoped to voice the character Gray Fullbuster, he had come to love playing Natsu and thought he was meant to voice him.", "He further mentioned that Natsu is his favorite character and considered him \"fantastic\".", "He also described Natsu's character as difficult because he has exceptional gifts compared to his friends." ], [ "Mako (voice actress)", "Mako (voice actress)\n\n, better known by her mononym name Mako (sometimes stylised MAKO), is a Japanese voice actress, singer and a member of the band Bon-Bon Blanco, in which her prominent role is as the maraca player.", "She has also performed in a Japanese television drama called \"Meido in Akihabara\".", "She is affiliated with I'm Enterprise.", "Her anime voice acting debut was in \"Kamichu!\"", "where, in the ending theme song, her character also plays the maracas.", "As Hinako Hiiragi in anime \"Chitose Get You!!\"", "she plays maracas again, in the ending theme (episodes 1-13)." ], [ "Luci Christian", "Luci Christian\n\nLouisa Michelle \"Luci\" Christian (born March 18, 1973) is an American voice actress and ADR script writer at Funimation and Seraphim Digital/Sentai Filmworks.", "She has provided many voices for English versions of Japanese anime series and films.", "Christian grew up in Texas, where her parents, Mike and Barbara, were high school teachers.", "From age 3 to 9, she participated in some local beauty pageants, and later got involved in theater programs in high school.", "In college, she originally pursued journalism, but changed to theatre when she was offered a scholarship.", "She got her bachelor's degree in Theatre from Angelo State University and her Master of Fine Arts in Theatre at Louisiana State University.", "Her involvement in anime starts in ADV Films in Houston where she had some bit parts in \"Those Who Hunt Elves\" that involved about three hours of studio time.", "She did not hear back for some time until she got cast in \"Neo Ranga\".", "A few weeks later, she auditioned and got her first starring role as Kaname Chidori in \"Full Metal Panic!\".", "In \"Super Gals!", "Ran Kotobuki\", she voices the title character who is a fun-loving teenage gal in a family of police officers." ] ], "gold": "The Fairy Tail manga and anime series features an extensive cast of characters created by Hiro Mashima. The character Natsu is voiced by Tetsuya Kakihara in Japanese, while Todd Haberkorn voices him in the English dub. Voice actress Mako Sakurai, who is a singer and a member of the band Bon-Bon Blanco, voices the child character of Natsu in Japanese. In English, the child character of Natsu is voice by Luci Christian, who has provided many voices for English versions of Japanese anime series and films.", "prediction 1": "There are several voices for the character of Natsu in the Japanese anime series Fairy Tail. American actress Luci Christian provided the voice of Natsu in the 2006 anime. In the 2013 anime, Natsu was voiced by Japanese voice actress Tetsuya Kakihara.\n", "prediction 2": "Todd Haberkorn does the voice of Japanese version of Natsu in the anime television series Fairy Tail. Nova Yuki Rino does the voice of the Japanese version of Natsu in the manga. And, to Luisa Cristian, who provides the English language voice for the animated television series Fairy Tail, Lauren Butera provides the English language voice of Natsu.", "prediction 3": "In Japanese and English, different people have voiced Natsu in Fairy Tail. Deanna Suiko, Elizabeth Kyle, Travis Bateman, Luci Christian, Tetsuya Kakihara, Bryan Bleeker, and Todd Haberkorn have all voiced the character. Hiro Mashima has produced an English television series adapted from a Japanese manga written by Hiro Mashima, and an animated television series adapted from a Japanese manga written by Hiro Mashima.", "prediction 4": "Since 2006, Hiro Mashima has composed the original manga, \"Fairy Tail\", and adapted it into a television series. As of 2013, Todd Haberkorn has done the English voice of Natsu in the anime. A Japanese voice actress named Tetsuya Kakihara has also been credited with producing the animation.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 93, "end": 171 }, { "error type": "Unverifiable", "explanation": "", "start": 172, "end": 190 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":2,\"sentence_id\":[6]}", "start": 226, "end": 233 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 4 ] } ], "corrected-prediction": "There are several voices for the character of Natsu in the Japanese anime series Fairy Tail. Natsu was voiced by Japanese voice actor Tetsuya Kakihara. In North America's release, Natsu was voiced by Todd Haberkorn.\n" }, "preference": [ 2, 0, 2, 0, 1, 0 ] }, { "question": "What is the capital of andhra pradesh and telangana?", "passages": [ [ "Andhra Pradesh", "Andhra Pradesh\n\nAndhra Pradesh () () is one of the 29 states of India.", "Situated in the south-east of the country, it is the eighth-largest state in India, covering an area of .", "As per the 2011 census, it is the tenth most populous state, with 49,386,799 inhabitants.", "The largest city in Andhra Pradesh is Visakhapatnam.", "Telugu, one of the Classical Languages of India, is the majority and official language of Andhra Pradesh.", "On 2 June 2014, the north-western portion of Andhra Pradesh was separated to form the new state of Telangana; the longtime capital of Andhra Pradesh, Hyderabad, was transferred to Telangana as part of the division.", "However, in accordance with the Andhra Pradesh Reorganisation Act, 2014, Hyderabad was to remain as the \"de jure\" capital of both Andhra Pradesh and Telangana states for a period of time not exceeding ten years.", "The new riverfront \"de facto\" capital, Amaravati, is under the jurisdiction of the Andhra Pradesh Capital Region Development Authority (APCRDA).", "Andhra Pradesh has a coastline of \u2013 the second longest coastline among the states of India, after Gujarat \u2013 with jurisdiction over almost 15,000\u00a0km of territorial waters." ], [ "Guntur district", "Guntur district\n\nGuntur district is an administrative district in the Coastal Andhra region of the Indian state of Andhra Pradesh.", "The administrative seat of the district is located at Guntur, the largest city of the district in terms of area and population.", "It has a coastline of approximately 100\u00a0km and is situated on the right bank of Krishna River, that separates it from Krishna district and extends till it empties into the Bay of Bengal.", "It is bounded on the south by Prakasam district and on the west by the state of Telangana.", "It has an area of and is the 2nd most populous district in the state, with a population of 4,889,230 as per 2011 census of India.", "The district is often referred to as the \"Land of Chillies\".", "It is also a major centre for agriculture, education and learning.", "It exports large quantities of chillies and tobacco.", "Amaravati, the proposed capital of Andhra Pradesh is situated in Guntur district, on the banks of River Krishna.", "The district derives its name from its district headquarters, Guntur.", "The original Sanskrit name (ancient Vedic culture) for Guntur was Garthapuri.", "The 'Agasthyeswara Sivalayam' in the old city of Guntur is an ancient temple for Siva.", "It has inscriptions on two stones in 'Naga Lipi' (ancient script)." ], [ "Coastal Andhra", "Coastal Andhra\n\nCoastal Andhra (Telugu: \u0c24\u0c40\u0c30 \u0c06\u0c02\u0c27\u0c4d\u0c30 \"\"), is a region in the state of Andhra Pradesh, India.", "This region was part of Madras State before 1953 and Andhra State from 1953 to 1956.", "According to the 2011 census, it has an area of which is 57.99% of the total state area and a population of 34,193,868 which is 69.20% of Andhra Pradesh state population.", "This area includes the coastal districts of Andhra Pradesh between the Eastern Ghats and the Bay of Bengal, from the northern border with Odisha to Pulicat lake of South.", "Coastal Andhra has rich agricultural land, owing to the delta of the Godavari Krishna river and Penna.", "The prosperity of Coastal Andhra can be attributed to its rich agricultural land and an abundant water supply from these three rivers.", "Rice grown in paddy fields is the main crop, with pulses and coconuts also being important.", "The fishing industry is also important to the region.", "The state of Andhra emerged to a political power during the reign of Maurya Dynasty.", "Megasthenes mentioned that Andhra was a flourishing empire of the Satavahanas' since even before the common era.", "Coastal Andhra was also ruled by the famous Chalukyas in between the period of the 7th Century and the 10th century CE." ], [ "Telangana", "Telangana\n\nTelangana () is a state in the south of India.", "It is situated on the centre-south stretch of the Indian peninsula on the high Deccan Plateau.", "It is the twelfth largest state and the twelfth-most populated state in India with a geographical area of and 35,193,978 residents as per 2011 census.", "On 2 June 2014, the area was separated from the northwestern part of Andhra Pradesh as the newly formed 29th state with Hyderabad as its historic permanent capital.", "Its other major cities include Warangal, Nizamabad, Khammam and Karimnagar.", "Telangana is bordered by the states of Maharashtra to the north, Chhattisgarh to the east, Karnataka to the west, and Andhra Pradesh to the east and south.", "The terrain of Telangana region consists mostly of hills, mountain ranges, and thick dense forests distribution of 27,292 sq. km.", "As of 2018, the state of\u00a0Telangana is divided into 31 districts.", "Throughout antiquity and the Middle Ages, the region now known as Telangana was ruled by multiple major Indian powers such as the Mauryans, Satavahanas, Chalukyas, Kakatiyas, Delhi Sultanate, Bahmani Sultanate, Golconda Sultanate.", "During the 16th and 17th centuries, the region was ruled by the Mughals.", "The region is known for its \"Ganga-Jamuni Tehzeeb\"." ] ], "gold": "On June 2, 2014, Telangana was separated from the northwestern part of Andhra Pradesh in India, as the newly formed state, with Hyderabad as its capital. Prior to this, Hyderabad was the capital of both Telangana and Andhra Pradesh. Amaravati, which is located on the banks of river Krishna in Guntur District, is the current de facto seat of government of Andhra Pradesh and the city has been proposed to be made the legislative capital of the state.", "prediction 1": "The capital of both Andhra Pradesh and Telangana is Amaravati in Guntur district, located in the Coastal Andhra region of the state of Andhra Pradesh.\n", "prediction 2": "The capital of Andhra Pradesh and the state of Telangana is Amaravati in Guntur, in the southern state of Andhra Pradesh.", "prediction 3": "The capital of Andhra Pradesh and Telangana is Hyderabad. Telangana is a state in the south of India. On 2 June 2014, the north-western portion of Andhra Pradesh was separated to form the new state of Telangana, with Hyderabad becoming the capital of both states. The proposed capital of both states, Amaravati formerly known as Guntur, is located in Guntur district, the largest city in the region.", "prediction 4": "Coastal Andhra, which is also known as Andhra Pradesh, is a region in the Indian state of Andhra Pradesh. According to the 2011 census, it has a population of 34,193,868 which is 69.20% of Andhra Pradesh state population. While both Andhra Pradesh and Telangana have had capitals in their respective regions since the 1980s, the former capital city of Telangana, located in the south of the state, was Amaravati until 2014 to become the former capital of both states.", "feedback": { "errors": [ { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[7]}", "start": 52, "end": 61 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 9 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "The capital of both Andhra Pradesh and Telangana is Hyderabad. On June 2, 2014, Telangana was separated from the northwestern part of Andhra Pradesh, forming a new state, with Hyderabad as its capital. Accordingly, Hyderabad was to remain as the \"de jure\" capital of both states in accordance with the Andhra Pradesh Reorganization Act for a period of time not exceeding ten years. That being said, Amaravati, on the banks of river Krishna in Guntur district and located in the Coastal Andhra region of Andhra Pradesh, is the current de facto seat of government of Andhra Pradesh, and the city has been proposed to be made the legislative capital of the state. " }, "preference": [ 0, 2, 1, 2, 1, 1 ] }, { "question": "Who publishes a song of ice and fire?", "passages": [ [ "A Song of Ice and Fire", "A Song of Ice and Fire\n\nA Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin.", "He began the first volume of the series, \"A Game of Thrones,\" in 1991, and it was published in 1996.", "Martin, who initially envisioned the series as a trilogy, has published five out of a planned seven volumes.", "The fifth and most recent volume of the series published in 2011, \"A Dance with Dragons\", took Martin six years to write.", "He is currently writing the sixth novel, \"The Winds of Winter\".", "\"A Song of Ice and Fire\" takes place on the fictional continents Westeros and Essos.", "The point of view of each chapter in the story is a limited perspective of a range of characters growing from nine, in the first novel, to 31 characters by the fifth novel.", "Three main stories interweave: a dynastic war among several families for control of Westeros, the rising threat of the supernatural Others in the northernmost reaches of Westeros, and the ambition of Daenerys Targaryen, the deposed king's exiled daughter, to assume the Iron Throne.", "Martin's inspirations included the Wars of the Roses and the French historical novels \"The Accursed Kings\" by Maurice Druon." ], [ "Bantam Books", "Bantam Books\n\nBantam Books is an American publishing house owned entirely by parent company Random House, a subsidiary of Penguin Random House; it is an imprint of the Random House Publishing Group.", "It was formed in 1945 by Walter B. Pitkin, Jr., Sidney B. Kramer, and Ian and Betty Ballantine.", "It has since been purchased several times by companies including National General, Carl Lindner's American Financial and, most recently, Bertelsmann; it became part of Random House in 1998, when Bertelsmann purchased it to form Bantam Doubleday Dell.", "It began as a mass market publisher, mostly of reprints of hardcover books, with some original paperbacks as well.", "It expanded into both trade paperback and hardcover books, including original works, often reprinted in house as mass-market editions.", "The company was failing when Oscar Dystel, who had previously worked at Esquire and as editor on Coronet magazine was hired in 1954 to manage it.", "By the end of the next year the company was profitable.", "Dystel retired as chairman in 1980.", "By that time Bantam was the largest publisher of paperbacks, had over 15% of the market, and exceeded 100 million in sales." ] ], "gold": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. He began the first volume of the series, A Game of Thrones, in 1991, and it was published in 1996. In US and Canada, the series is published by Bantam Books, an American publishing house owned entirely by parent company Random House, a subsidiary of Penguin Random House. In UK and Australia the series is published by Voyager Books.", "prediction 1": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. He began the first volume of the series, A Game of Thrones, in 1991, and it was published in 1996. The series has been published by five out of a planned seven volumes. Bantam Books is an American publishing house owned entirely by parent company Random House, a subsidiary of Penguin Random House; it is an imprint of the Random House Publishing Group.\n", "prediction 2": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. He began the first volume of the series, A Game of Thrones, in 1991, and it was published in 1996. The series has been published in five out of a planned seven volumes. Bantam Books is an American publishing house owned entirely by parent company Random House, a subsidiary of Penguin Random House; it is an imprint of the Random House Publishing Group. In 1997, Random House acquired the imprint of the Random House.", "prediction 3": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. The series began with the first volume of A Game of Thrones in 1991 and was published in 1996. The fifth and most recent volume of the series, A Dance with Dragons, was published in 2011, and Martin is currently writing the sixth novel, The Winds of Winter. Series publisher Bantam Books is owned entirely by parent company Random House, a subsidiary of Penguin Random House; it is an imprint of the Random House Publishing Group.", "prediction 4": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. He began the first volume of the series, A Game of Thrones, in 1991, and it was published in 1996. Bantam Books is an American publishing house owned entirely by parent company Random House, a subsidiary of Penguin Random House, and it is an imprint of the Random House Publishing Group. In 2016, it was published by House of Hanover.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 420, "end": 475 }, { "error type": "Irrelevant", "explanation": "", "start": 220, "end": 289 }, { "error type": "Irrelevant", "explanation": "", "start": 290, "end": 419 } ], "missing-info": [], "corrected-prediction": "A Song of Ice and Fire is a series of epic fantasy novels by the American novelist and screenwriter George R. R. Martin. He began the first volume of the series, A Game of Thrones, in 1991, and it was published in 1996. \n" }, "preference": [ 1, 1, 1, 1, 1, 2 ] }, { "question": "When is the sims mobile supposed to come out?", "passages": [ [ "The Sims Mobile", "The Sims Mobile\n\nThe Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices.", "It was announced on May 9, 2017 in a launch trailer.", "The game was released on March 6, 2018.", "It features a multiplayer component and includes story elements.", "In \"The Sims Mobile\", players are able to create unique Sims with the in-game character creator (Create-a-Sim), build houses, start families and control the lives of their Sims.", "The game introduces multiplayer elements, as players can interact with other players' Sims by attending their parties or rating their Sims as \"Cute, Hot or Fabulous\" through a sticker system.", "Similarly to previous mobile games in \"The Sims\" franchise, energy is used when players take actions with their Sims.", "Energy can be restored through SimCash, which is earned through in-game quests and micro-transactions.", "SimCash can also be used to purchase certain premium clothing and furniture options in the game.", "Unlike its predecessor \"The Sims FreePlay\", \"The Sims Mobile\" offers a closer experience to the PC series of games.", "There is a focus on telling stories through Sim's actions, chosen by the player as their Sims go through their career or make relationships.", "As Sims play through these stories, they are able to level up and unlock new cutscenes." ], [ "Chrome Web Store", "Chrome Web Store\n\nThe Chrome Web Store is Google's online store for web applications for Google Chrome or Google Apps.", "It was announced at the Google I/O conference on May 19, 2010 by Vic Gundotra and released on December 6, 2010.", "The software allows users to install and run web applications for the Google Chrome browser.", "The Chrome Web Store user experience and design was created by Fi. Applications, browser themes and extensions in the store are written in HTML, CSS, JavaScript, and Google Apps Script and, from Chrome 14, can use Google Native Client.", "The store hosts free and paid applications.", "An example of applications available in the store includes the game \"Plants vs. Zombies\".", "The Store has been described as being like Google Play, but for \"apps on the web\".", "A visual and UI overhaul of the store was announced on October 25, 2011.", "Some commentators have questioned the need for an online app store, indicating that what is installed within the system ought to be freely available rather than give the illusion it has been \"imported\" from somewhere.", "Ryan Paul of Ars Technica said on December 9, 2010: \"The way that users consume applications in the desktop and mobile world is fundamentally different than the way that they do it on the Web\u2014where paywalls are often reviled and there is little distinction between content and software." ] ], "gold": "The Sims Mobile is a life simulation game based on The Sims 4 and The Sims FreePlay for Android and iOS devices. The game was released worldwide on March 6, 2018, but was available for testing on the App Store and Google Play in Brazil on May 9, 2017. It features a multiplayer component and includes story elements.", "prediction 1": "The Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices. It was announced on May 9, 2017 in a launch trailer. The game was released on March 6, 2018. The game features a multiplayer component and includes story elements.", "prediction 2": "The Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices. It was announced on May 9, 2017 in a launch trailer. The game was released on March 6, 2018.", "prediction 3": "The Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices. It was announced on May 9, 2017 in a launch trailer. The game was released on March 6, 2018.", "prediction 4": "The Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices. It was announced on May 9, 2017 in a launch trailer. The game was released on March 6, 2018.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 117, "end": 169 } ], "missing-info": [], "corrected-prediction": "The Sims Mobile is a life simulation game based on \"The Sims 4\" and \"The Sims FreePlay\" for Android and iOS devices. The game was released on March 6, 2018. The game features a multiplayer component and includes story elements." }, "preference": [ 1, 1, 1, 0, 0, 0 ] }, { "question": "Where are white blood cells located in your body?", "passages": [ [ "White blood cell", "White blood cell\n\nWhite blood cells (also called leukocytes or leucocytes and abbreviated as WBCs) are the cells of the immune system that are involved in protecting the body against both infectious disease and foreign invaders.", "All white blood cells are produced and derived from multipotent cells in the bone marrow known as hematopoietic stem cells.", "Leukocytes are found throughout the body, including the blood and lymphatic system.", "All white blood cells have nuclei, which distinguishes them from the other blood cells, the anucleated red blood cells (RBCs) and platelets.", "Types of white blood cells can be classified in standard ways.", "Two pairs of broadest categories classify them either by structure (granulocytes or agranulocytes) or by cell lineage (myeloid cells or lymphoid cells).", "These broadest categories can be further divided into the five main types: neutrophils, eosinophils (acidophiles), basophils, lymphocytes, and monocytes.", "These types are distinguished by their physical and functional characteristics.", "Monocytes and neutrophils are phagocytic.", "Further subtypes can be classified; for example, among lymphocytes, there are B cells, T cells, and NK cells." ] ], "gold": "All white blood cells are produced and made from multipotent cells in the bone marrow known as hematopoietic stem cells. They are found throughout the body and stored in the blood and lymphatic system. ", "prediction 1": "White blood cells are the cells of the immune system that are involved in protecting the body against both infectious disease and foreign invaders. Leukocytes are found throughout the body, including the blood and lymphatic system.", "prediction 2": "White blood cells are the cells of the immune system that are involved in protecting the body against both infectious disease and foreign invaders. Leukocytes are found throughout the body, including the blood and lymphatic system. White blood cells are also called leukocytes or leucocytes and abbreviated as WBCs.", "prediction 3": "White blood cells are the cells of the immune system that are involved in protecting the body against both infectious disease and foreign invaders. They are produced and derived from multipotent cells in the bone marrow known as hematopoietic stem cells. Leukocytes are found throughout the body, including the blood and lymphatic system.", "prediction 4": "Leukocytes are found throughout the body, including the blood and lymphatic system. All white blood cells are produced and derived from multipotent cells in the bone marrow known as hematopoietic stem cells.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 147 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "All white blood cells are produced and derived from multipotent cells in the bone marrow known as hematopoietic stem cells. Leukocytes are found throughout the body, including the blood and lymphatic system." }, "preference": [ 1, 1, 1, 1, 1, 1 ] }, { "question": "How long is the staton island ferry ride?", "passages": [ [ "Staten Island Ferry", "Staten Island Ferry\n\nThe Staten Island Ferry is a passenger ferry route operated by the New York City Department of Transportation.", "The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes.", "The ferry operates 24 hours a day, 7 days a week, with boats leaving every 15 to 20 minutes during peak hours and every 30 minutes at other times.", "It is the only direct mass-transit connection between the two boroughs.", "Historically, the Staten Island Ferry has charged a relatively low fare compared to other modes of transit in the area; and since 1997 the route has been fare-free.", "The Staten Island Ferry is one of several ferry systems in the New York City area and is operated separately from systems such as NYC Ferry and NY Waterway.", "The Staten Island Ferry route terminates at Whitehall Terminal, on Whitehall Street in Lower Manhattan, and at St. George Terminal, in St. George, Staten Island.", "At Whitehall, connections are available to the New York City Subway and several local New York City Bus routes.", "At St. George, there are transfers to the Staten Island Railway and to the St. George Bus Terminal's many bus routes." ] ], "gold": "The Staten Island Ferry's single route runs 5.2 miles (8.4 km) through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes.", "prediction 1": "The Staten Island Ferry is a passenger ferry route operated by the New York City Department of Transportation. The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes. Historically, the Staten Island Ferry has charged a relatively low fare compared to other modes of transit in the area; and since 1997 the route has been fare-free.", "prediction 2": "The Staten Island Ferry is a passenger ferry route operated by the New York City Department of Transportation. The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes. The ferry operates 24 hours a day, 7 days a week, with boats leaving every 15 to 20 minutes during peak hours and every 30 minutes at other times. The ferry operates 24 hours a day, 7 days a week, with boats leaving every 15 to 20 minutes during peak hours and every 30 minutes at other times.", "prediction 3": "The Staten Island Ferry is a passenger ferry route operated by the New York City Department of Transportation. The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes. The ferry operates 24 hours a day, 7 days a week, with boats leaving every 15 to 20 minutes during peak hours and every 30 minutes at other times. The trip takes approximately 25 minutes.", "prediction 4": "The Staten Island Ferry is a passenger ferry route operated by the New York City Department of Transportation. The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes. It is the only direct mass-transit connection between the two boroughs.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 110 }, { "error type": "Irrelevant", "explanation": "", "start": 294, "end": 458 } ], "missing-info": [], "corrected-prediction": "The ferry's single route runs through New York Harbor between the New York City boroughs of Manhattan and Staten Island, with ferry boats making the trip in approximately 25 minutes. " }, "preference": [ 1, 1, 1, 2, 2, 1 ] }, { "question": "Who appoints the member of state human rights commission in india?", "passages": [ [ "P. J. Thomas (Indian administrative officer)", "The basis for the request for the review petition, according to Thomas's lawyer, Wills Mathews, was that the three judges' judgement on the CVC is not legally valid because Article 145 (3) says that the minimum number of judges required for interpretation of Constitution is five, which in effect makes the Supreme Court judgement null and void.", "Mathews also questioned whether the court had exercised jurisdiction on an issue in which it was not having the jurisdiction.", "He claimed that the Supreme Court has the power to initiate the proceeding for the removal of the CVC, only on a reference made by the President, and as such there was no reference of the President of India in the present matter.", "Thomas submitted that quashing the appointment resulted in miscarriage of justice not only for Thomas but to all civil servants of the country 'because the mere lodging of an FIR is sufficient to stop an honest officer from taking charge of the coveted post and shall spoil his career prospects'.", "The President of India however refused to consider Thomas's request for the review petition and Pradeep Kumar was appointed as the new CVC." ] ], "gold": "The Prime Minister, Home minister, Leaders of the Opposition, Speaker of the Lok Sabha, and Deputy Chairman of the Rajya Sabha recommend appointments for the members of state human rights commission in India, and the President of India actually appoints the members of state human rights commission in India.", "prediction 1": "The President of India appoints the member of state human rights commission in India. P. J. Thomas was appointed as the CVC in 2012.", "prediction 2": "The President of India appointed P. J. Thomas as the new CVC.", "prediction 3": "The President of India appoints the member of state human rights commission in India.", "prediction 4": "The President of India appoints the member of state human rights commission in India. Pradeep Kumar was appointed as the new CVC.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 85 }, { "error type": "Irrelevant", "explanation": "", "start": 86, "end": 123 }, { "error type": "Unverifiable", "explanation": "", "start": 127, "end": 132 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Bible verse if your hand causes you sin cut off?", "passages": [ [ "Matthew 5:30", "Matthew 5:30\n\nMatthew 5:30 is the thirtieth verse of the fifth chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount.", "Part of the section on adultery, it is very similar to the previous verse, but with the hand mentioned instead of the eye.", "For a discussion of the radicalism of these verses see .", "Jesus had stated that looking at a woman in lust is equal to the act of adultery itself and in this verse he recommends cutting off one's hand to prevent sinning.", "In the King James Version of the Bible the text reads:\n\nThe World English Bible translates the passage as:\n\nFor a collection of other versions see BibRef Matthew 5:30\n\n", "The link between the right hand and the discussion of adultery is somewhat unclear.", "In Jewish writings of the time it was common to have a foot, hand, eye triple structure.", "This full triple structure is seen in the similar discussions at -, and a version much closer to that in Mark appears at -.", "Jesus here uses two thirds of the structure, the first reference to the eye is clearly linked to his previous statement that looking at a woman lustfully is sinful, but it is uncertain why he continues to the hand when he specifically stated that action and touching is not required for sin.", "Hill feels that this might be related to theft." ] ], "gold": "There are several Bible verses that mention cutting off your hand if it causes you to sin. In Jewish writings of the time it was common to have a foot, hand, eye triple structure. This full triple structure is seen in the similar discussions at Mark 9:43\u201347, and a version much closer to that in Mark appears at Matthew 18:8-9, which is talking about 'drastic corrective action', not 'literal mutilation', but nonetheless underscores the seriousness of the sin. In Matthew 5:30, Jesus stated that looking at a woman in lust is equal to the act of adultery itself and in this verse he recommends cutting off one's hand to prevent sinning.", "prediction 1": "Jesus had stated that looking at a woman in lust is equal to the act of adultery itself and in this verse he recommends cutting off one's hand to prevent sinning. In the King James Version of the Bible the text reads: The World English Bible translates the passage as: For a collection of other versions see BibRef Matthew 5:30 The link between the right hand and the discussion of adultery is somewhat unclear.", "prediction 2": "Jesus previously stated that looking at a woman in lust is equal to the act of adultery itself and in this verse he recommends cutting off one's hand to prevent sinning. In the King James Version of the Bible the text reads: The World English Bible translates the passage as:", "prediction 3": "When Jesus said looking at a woman in lust is equal to the act of adultery itself, he recommended that one cut off one's hand to prevent sinning.", "prediction 4": "Matthew 5:30 is the thirtieth verse of the fifth chapter of the Gospel of Matthew in the New Testament and is part of the Sermon on the Mount. In it, Jesus reiterates his previous statement that looking at a woman in lust is equal to the act of adultery itself and recommends cutting off one's hand to prevent sinning.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 163, "end": 327 }, { "error type": "Irrelevant", "explanation": "", "start": 328, "end": 411 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 7 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 8 ] } ], "corrected-prediction": "In Jewish writings of the time it was common to have a foot, hand, eye triple structure. This full triple structure is seen in the similar discussions at Mark 9:43\u201347, and a version much closer to that in Mark appears at Matthew 18:8-9. Jesus had stated that looking at a woman in lust is equal to the act of adultery itself and in this verse he recommends cutting off one's hand to prevent sinning. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Where does the novel call me by your name take place?", "passages": [ [ "Call Me by Your Name (novel)", "Call Me by Your Name (novel)\n\nCall Me by Your Name is a 2007 novel by American writer Andr\u00e9 Aciman that centers on a blossoming romantic relationship between an intellectually precocious and curious 17-year-old American-Italian Jewish boy named Elio Perlman and a visiting 24-year-old American Jewish scholar named Oliver in 1980s Italy.", "The novel chronicles their summer romance and the 20 years that follow.", "The narrator, Elio Perlman, recalls the events of the summer of about 1983, when he was seventeen and living with his parents in Italy.", "Each summer, his parents would take in a doctoral student as a house guest for six weeks, who would revise a book manuscript while assisting his father with academic paperwork.", "Elio resents the tradition, as it requires him to vacate his bedroom so the guest can use it for the duration of their stay.", "Oliver, the guest for the summer, is carefree and detached\u2014a stark contrast to Elio\u2019s introversion.", "Elio selected Oliver as a guest in the hopes of \"instant affinities\" between them and acts as his tour guide, though Elio's attempts to impress Oliver are met with indifference.", "When Oliver grabs Elio's arm after a tennis match, Elio retracts in fear." ], [ "Call Me by Your Name (novel)", "Elio visits Marzia\u2019s house, and the two have sex; in the afternoon he masturbates with a cut peach, and ejaculates inside of it.", "Oliver later visits Elio\u2019s room, eats the peach and its contents, and again has sex with Elio.", "Before returning to the United States, Oliver decides to spend three days in Rome, where he is accompanied by Elio.", "Upon returning from the trip, Elio is saddened to find that his belongings have already been returned to his original bedroom, and that all traces of Oliver\u2019s visit have vanished.", "Elio has a discussion with his father, who says that he approves of the friendship (and relationship) between Elio and Oliver.", "That Christmas, Oliver again visits the Perlman family, and announces that he intends to marry next summer.", "Oliver and Elio fall out of touch, and do not communicate with each other for many years.", "Fifteen years later, Elio visits Oliver in the United States, where Oliver is now a professor.", "Elio is unwilling to meet Oliver\u2019s wife and children, admitting that he still feels attraction towards Oliver and jealousy towards his new family.", "Oliver admits that he has followed Elio\u2019s academic career, and shows him a postcard that he brought with him when he left Italy and has kept over the years." ], [ "Italy", "The election was characterized by a strong showing of the Five Star Movement and the League and the university professor Giuseppe Conte became the Prime Minister at the head of a populist coalition.", "Italy is located in Southern Europe, between latitudes 35\u00b0 and 47\u00b0 N, and longitudes 6\u00b0 and 19\u00b0 E. To the north, Italy borders France, Switzerland, Austria and Slovenia, and is roughly delimited by the Alpine watershed, enclosing the Po Valley and the Venetian Plain.", "To the south, it consists of the entirety of the Italian Peninsula and the two Mediterranean islands of Sicily and Sardinia, in addition to many smaller islands.", "The sovereign states of San Marino and the Vatican City are enclaves within Italy, while Campione d'Italia is an Italian exclave in Switzerland.", "The country's total area is , of which is land and is water.", "Including the islands, Italy has a coastline and border of on the Adriatic, Ionian, Tyrrhenian seas (), and borders shared with France (), Austria (), Slovenia () and Switzerland ().", "San Marino () and Vatican City (), both enclaves, account for the remainder.", "The Apennine Mountains form the peninsula's backbone and the Alps form most of its northern boundary, where Italy's highest point is located on Monte Bianco ()." ] ], "gold": "The 2007 Andr\u00e9 Aciman novel Call Me by Your Name takes place in several countries, including Italy and the United States. The early part of the novel takes place in Italy in Southern Europe, where the narrator recalls the events of the summer of 1987. Also, Oliver, with whom the narrator has a romantic relationship, returns to the United States in North America in the novel.", "prediction 1": "Call Me by Your Name is a 2007 novel by American writer Andr\u00e9 Aciman that centers on a blossoming romantic relationship between an intellectually precocious and curious 17-year-old American-Italian Jewish boy named Elio Perlman and a visiting 24-year-old American Jewish scholar named Oliver in 1980s Italy. The novel chronicles their summer romance and the 20 years that follow. The narrator, Elio Perlman, recalls the events of the summer of 1983, when he was seventeen and living with his parents in Italy.", "prediction 2": "Call Me by Your Name is a 2007 novel by American writer Andr\u00e9 Aciman that centers on a blossoming romantic relationship between an intellectually precocious and curious 17-year-old American-Italian Jewish boy named Elio Perlman and a visiting 24-year-old American Jewish scholar named Oliver in 1980s Italy. The novel chronicles their summer romance and the 20 years that follow.", "prediction 3": "Call Me by Your Name is a 2007 novel written by American writer Andr\u00e9 Aciman that centers on a blossoming romantic relationship between an intellectually precocious and curious 17-year-old American-Italian Jewish boy named Elio Perlman and a visiting 24-year-old American Jewish scholar named Oliver in 1980s Italy. The novel chronicles their summer romance and the 20 years that follow. The narrator, Elio Perlman, recalls the events of the summer of about 1983, when he was seventeen and living with his parents in Italy. The narrator, Elio Perlman, recalls the events of the summer romance between them.", "prediction 4": "Call Me by Your Name is a 2007 novel by American writer Andr\u00e9 Aciman that centers on a blossoming romantic relationship between an intellectually precocious and curious 17-year-old American-Italian Jewish boy named Elio Perlman and a visiting 24-year-old American Jewish scholar named Oliver in 1980s Italy. The narrator, Elio Perlman, recalls the events of the summer of about 1983, when he was seventeen and living with his parents in Italy. The novel chronicles their summer romance and the 20 years that follow.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 40, "end": 55 }, { "error type": "Irrelevant", "explanation": "", "start": 87, "end": 97 }, { "error type": "Irrelevant", "explanation": "", "start": 128, "end": 227 }, { "error type": "Irrelevant", "explanation": "", "start": 232, "end": 284 }, { "error type": "Irrelevant", "explanation": "", "start": 295, "end": 300 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 379 }, { "error type": "Irrelevant", "explanation": "", "start": 394, "end": 407 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[3]}", "start": 444, "end": 449 }, { "error type": "Irrelevant", "explanation": "", "start": 450, "end": 509 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 3 ] } ], "corrected-prediction": "The 2007 Andr\u00e9 Aciman novel Call Me by Your Name takes place in Italy and the United States. The early part of the novel takes place in Italy in Southern Europe, where the narrator recalls the events of the summer of about 1983. Additionally, Oliver, with whom the narrator has a romantic relationship, returns to the United States in the novel after spending three days in Rome." }, "preference": [ 2, 1, 1, 1, 1, 2 ] }, { "question": "When did they stop building on the winchester house?", "passages": [ [ "Winchester Mystery House", "Winchester Mystery House\n\nThe Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester.", "Located at 525 South Winchester Blvd.", "in San Jose, the Queen Anne Style Victorian mansion is renowned for its size, its architectural curiosities, and its lack of any master building plan.", "It is a designated California historical landmark and is listed on the National Register of Historic Places.", "It is privately owned and serves as a tourist attraction.", "Since its construction in 1884, the property and mansion were claimed by many to be haunted by the ghosts of those killed with Winchester rifles.", "Under Winchester's day-to-day guidance, its \"from-the-ground-up\" construction proceeded around the clock, by some accounts, without interruption, until her death on September 5, 1922, at which time work immediately ceased.", "Sarah Winchester's biographer, however, says that Winchester \"routinely dismissed workers for months at a time 'to take such rest as I might'\" and notes that \"this flies in the face of claims by today's Mystery House proprietors that work at the ranch was ceaseless for thirty-eight years.\"", "After her husband's death from tuberculosis in 1881, Sarah Winchester inherited more than $20.5 million (equivalent to $ million in )." ] ], "gold": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearms magnate William Wirt Winchester. Since its construction in 1884, the property and mansion were claimed by many to be haunted by the ghosts of those killed with Winchester rifles. Under Winchester's day-to-day guidance, its \"from-the-ground-up\" construction proceeded around the clock, by some accounts, without interruption, until her death on September 5, 1922, at which time work immediately ceased.", "prediction 1": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester. It was the home of Sarah Winchester. Under Winchester's day-to-day guidance, its \"from-the-ground-up\" construction proceeded around the clock, by some accounts, without interruption, until her death on September 5, 1922, at which time work immediately ceased.", "prediction 2": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester. The Queen Anne Style Victorian mansion is renowned for its size, its architectural curiosities, and its lack of any master building plan. The mansion is listed on the National Register of Historic Places.", "prediction 3": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester. Under Winchester's day-to-day guidance, its \"from-the-ground-up\" construction proceeded around the clock, by some accounts, without interruption, until her death on September 5, 1922, at which time work immediately ceased.", "prediction 4": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester. The Queen Anne Style Victorian mansion is renowned for its size, its architectural curiosities, and its lack of any master building plan. It is a designated California historical landmark and is listed on the National Register of Historic Places.", "feedback": { "errors": [ { "error type": "Redundant", "explanation": "that was once the personal residence of Sarah Winchester, ", "start": 179, "end": 215 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 6 ] } ], "corrected-prediction": "The Winchester Mystery House is a mansion in San Jose, California, that was once the personal residence of Sarah Winchester, the widow of firearm magnate William Wirt Winchester. Since its construction in 1884, the property and mansion were claimed by many to be haunted by the ghosts of those killed with Winchester rifles. Under Winchester's day-to-day guidance, its \"from-the-ground-up\" construction proceeded around the clock, by some accounts, without interruption, until her death on September 5, 1922, at which time work immediately ceased." }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "When do new episodes of star vs the forces of evil air?", "passages": [], "gold": "The new episodes of Star Vs. The Forces of Evil came out November 16, 2017 and December 2, 2017.", "prediction 1": "When do new episodes of Star vs the forces of evil air?", "prediction 2": "When do new episodes of Star vs the forces of evil air?", "prediction 3": "Whenever do new episodes of Star vs the forces of evil air?", "prediction 4": "When do new episodes of Star vs the forces of evil air?", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 55 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who presides over the joint sitting of the two houses of parliament?", "passages": [ [ "Joint Session of Indian Parliament", "Joint Session of Indian Parliament\n\nThe Parliament of India is bicameral.", "Concurrence of both houses are required to pass any bill.", "However, the makers of the Constitution of India visualised situations of deadlock between the upper house i.e. Rajya Sabha and the lower house i.e. Lok Sabha.", "Therefore, the Constitution of India provides for Joint sittings of both the Houses to break this deadlock.", "The joint sitting of the Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha.", "The Chairman doesn't preside over the joint session at any mens/cost.", "If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House.", "As per Article 108 of Constitution, a Joint session of Parliament can be summoned in the following situations." ] ], "gold": "The Speaker of the Lok Sabha presides over the joint sitting of the two houses of parliament. If the speaker is absent, the Deputy Speaker of the Lok Sabha presides. And, if both the Speaker and Deputy Speaker are absent, the Deputy-Chairman of the Rajya Sabha presides over the joint sitting of the two houses of parliament.", "prediction 1": "The Parliament of India is bicameral. Concurrence of both houses are required to pass any bill. However, the makers of the Constitution of India visualised situations of deadlock between the upper house, i.e. Rajya Sabha and the lower house, i.e. Lok Sabha. Therefore, the Constitution of India provides for Joint sittings of both the Houses to break this deadlock. Therefore, the joint sitting of the Parliament is called by the President, Article 108. The Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajy Sabha.", "prediction 2": "The joint sitting of the Parliament is called by the President and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House. Article 108 of Constitution of India provides for a Joint session of Parliament in the following situations.", "prediction 3": "The joint sitting of the Parliament is called by the President (Article 108 of the Constitution) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the House. Article 109 of Constitution states that the Speaker can preside over the joint sitting of both the Houses of Parliament.", "prediction 4": "The joint sitting of the Parliament is called by the President (Article 108) and is presided over by the Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajya Sabha. If any of the above officers are not present then any other member of the Parliament can preside by consensus of both the Houses.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 37 }, { "error type": "Irrelevant", "explanation": "", "start": 38, "end": 95 }, { "error type": "Irrelevant", "explanation": "", "start": 96, "end": 257 }, { "error type": "Irrelevant", "explanation": "", "start": 258, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 365 }, { "error type": "Irrelevant", "explanation": "", "start": 366, "end": 453 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": " The joint sittings of both houses of the Parliament is presided over by The Speaker or, in his absence, by the Deputy Speaker of the Lok Sabha or in his absence, the Deputy-Chairman of the Rajy Sabha." }, "preference": [ 2, 2, 2, 0, 1, 1 ] }, { "question": "Who made the song play that funky music white boy?", "passages": [ [ "Play That Funky Music", "Play That Funky Music\n\n\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry.", "The single was the first released by the Cleveland-based Sweet City record label in April 1976 and distributed by Epic Records.", "The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses.", "The single hit number one on the \"Billboard\" Hot 100 on September 18, 1976; it was also number one on the Hot Soul Singles chart.", "The single was certified platinum by the Recording Industry Association of America for shipments of over 2 million records and eventually sold 2.5 million in the United States alone.", "The song was listed at No. 93 on \"Billboard\" magazine's \"All-Time Top 100 Songs\" in 2018.", "It was also the group's only U.S. Top 40 song. !", "scope=\"row\"|United Kingdom (BPI)\n!", "scope=\"row\"|United States (RIAA) \n!", "scope=\"row\"|United States (RIAA) \n\n", "American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\"." ], [ "Rob Parissi", "Rob Parissi\n\nRobert \"Rob\" Parissi is an American singer, songwriter and guitarist, perhaps best known as frontman for the American funk group Wild Cherry.", "He also wrote the group's only hit, the 1976 chart-topping \"Play That Funky Music\".", "He was born in 1950 and raised in the steel mill town of Mingo Junction, Ohio.", "He graduated from Mingo High School in 1968.", "Rob formed the band Wild Cherry in 1970 in Steubenville, Ohio, one mile north of Mingo Junction along the Ohio River.", "The band played the Ohio Valley region, Wheeling, West Virginia and the rest of the Northern West Virginia panhandle, and Pittsburgh, Pennsylvania.", "After Wild Cherry disbanded in 1979 without another major hit, Parissi became a producer and dedicated himself to adult contemporary music.", "He writes and records smooth jazz and has collaborated with Steve Oliver and Will Donato." ] ], "gold": "The song \"Play That Funky Music\" was originally written and produced by Rob Parissi and recorded by his funk band Wild Cherry, in which Parissi performed lead vocals. The song was originally released in 1976 and went on to sell over 2.5 million records in the United States alone.", "prediction 1": "The song \"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "prediction 2": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "prediction 3": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "prediction 4": "\"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi, electric guitarist Bryan Bassett, bassist Allen Wentz, and drummer Ron Beitle, with session players Chuck Berginc, Jack Brndiar (trumpets), and Joe Eckert and Rick Singer (saxes) on the horn riff that runs throughout the song's verses. American rapper Vanilla Ice later released a song featuring an interpretation of \"Play That Funky Music\".", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 157, "end": 401 }, { "error type": "Irrelevant", "explanation": "", "start": 402, "end": 507 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The song \"Play That Funky Music\" is a song written by Rob Parissi and recorded by the band Wild Cherry. The performers on the recording included lead singer Parissi. The song was originally released in 1976 and went on to sell over 2.5 million records in the United States alone." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where does the bible talk about jesus brothers?", "passages": [ [ "Brothers of Jesus", "The extract refers to the period from the reign of Domitian (81\u201396) to that of Trajan (98\u2013117), and includes the statement that two Desposyni brought before Domitian later became leaders of the churches:\nThe New Testament names James the Just, Joses, Simon, and Jude as the brothers (Greek \"adelphoi\") of Jesus (, , , , )\n\n", "The etymology of the word \"brother\" (\"adelphos\") originally comes from \"of the same womb\" (\"a-delphys\"), although in New Testament usage, the Christian and Jewish meaning of \"brothers\" is wider, and is applied even to members of the same religious community.", "In the Bible, the Greek words \"adelphos\" and \"adelphe\" were not restricted to their literal meaning of a full brother or sister nor were their plurals.", "There are several views from an early date over whether the Greek term \"adelphos\", applied in these accounts to people described as \"adelphoi\" of Jesus, means that they were full brothers, half brothers, stepbrothers, or cousins." ] ], "gold": "The New Testament describes James, Joseph (Joses), Judas (Jude), and Simon as brothers of Jesus. The Bible talks about Joseph, Judas and Simon in Mark 6:3, Matthew 13:55-56, John 7:3, and Acts 1:13. The Bible talks about James also in Mark 6:3, Matthew 13:55-56, John 7:3, Acts 1:13, and Galatians 1:19.", "prediction 1": "The New Testament names James the Just, Joses, Simon, and Jude as the brothers (Greek \"adelphoi\") of Jesus (,,,,, ). In the Old and New Testaments, the brothers are James the Just, Joses the Just, Joses, Simon, and Jude.", "prediction 2": "In the New Testament, the Greek words \"adelphos\" and \"adelphe\" were not restricted to their literal meaning of a full brother or sister nor were their plurals. In the Old Testament, the New Testament names James the Just, Joses, Simon, and Jude as the brothers (Greek \"adelphoi\") of Jesus (,,,,,, ).", "prediction 3": "In the New Testament, the Greek words \"adelphos\" and \"adelphe\" were not restricted to their literal meaning of a full brother or sister nor were their plurals. In the Old Testament, the New Testament talks about James the Just, Joses, Simon, and Jude as the brothers of Jesus.", "prediction 4": "In the bible, the Greek words \"adelphos\" and \"adelphe\" were not restricted to their literal meaning of a full brother or sister nor were their plurals. There are several views from an early date over whether the Greek term \"adelphos\", applied in these accounts to people described as \"adelphoi\" of Jesus, means that they were full brothers, half brothers, stepbrothers, or cousins. The New Testament names James the Just, Joses, Simon, and Jude as the brothers (Greek \"adelphoi) of Jesus (,,,,,, and Jude as the brothers (Greek \"adelphoi\") of Jesus (,, and the New Testament).", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 117, "end": 220 } ], "missing-info": [], "corrected-prediction": "The New Testament names James the Just, Joses, Simon, and Jude as the brothers (Greek \"adelphoi\") of Jesus (,,,,, )." }, "preference": [ 1, 1, 1, 0, 1, 1 ] }, { "question": "Who was involved in the gold rush in australia?", "passages": [ [ "Australian gold rushes", "Australian gold rushes\n\nDuring the Australian gold rushes, significant numbers of workers (both from other areas within Australia and from overseas) relocated to areas in which gold had been discovered.", "A number of gold finds occurred in Australia prior to 1851, but only the gold found from 1851 onwards created gold rushes.", "This is mainly because, prior to 1851, the colonial government of New South Wales (Victoria did not become a separate colony until 1 July 1851) had suppressed news of gold finds which it believed would reduce the workforce and destabilise the economy.", "After the California Gold Rush began in 1848, which caused many people to leave Australia for California to look for gold there, the New South Wales government rethought its position, and sought approval from the Colonial Office in England to allow the exploitation of the mineral resources and also offered rewards for the finding of payable gold.", "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir.", "Hargraves had been to the Californian goldfields and had learned new gold prospecting techniques such as panning and cradling.", "Hargraves was offered rewards by the Colony of New South Wales and the Colony of Victoria." ] ], "gold": "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange. Large amounts of people moved to Australia to take part in the gold rushes, with the majority of them being from Britain.", "prediction 1": "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir. Hargraves was offered rewards by the Colony of New South Wales and the Colony of Victoria.", "prediction 2": "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir. The first gold rush in Australia began in July 1851 after prospector John S. Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir.", "prediction 3": "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir. Hargraves was offered rewards by the Colony of New South Wales and the Colony of Victoria.", "prediction 4": "The first gold rush in Australia began in May 1851 when prospector Edward Hargraves claimed to have discovered payable gold near Orange, at a site he called Ophir. Hargraves was offered rewards by the Colony of New South Wales and the Colony of Victoria. During the Australian gold rushes, significant numbers of workers (both from other areas within Australia and from overseas) relocated to areas in which gold had been discovered.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 138, "end": 164 }, { "error type": "Irrelevant", "explanation": "", "start": 165, "end": 255 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The first gold rush in Australia began in May 1851 after prospector Edward Hargraves claimed to have discovered payable gold near Orange. A significant numbers of workers (both from other areas within Australia and from overseas) relocated to areas in which gold had been discovered." }, "preference": [ 1, 0, 1, 2, 1, 1 ] }, { "question": "When did the great storm of 1987 happen?", "passages": [ [ "Great Storm of 1987", "Great Storm of 1987\n\nThe Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands as a severe depression in the Bay of Biscay moved northeast.", "Among the most damaged areas were Greater London, the East Anglian coast, the Home Counties, the west of Brittany and the Cotentin Peninsula of Normandy which weathered gusts typically with a return period of 1 in 200 years.", "Forests, parks, roads and railways were strewn with fallen trees as well as schools being closed.", "The British National Grid suffered heavy damage, leaving thousands without power.", "At least 22 people were killed in England and France.", "The highest measured gust of was recorded at Pointe Du Roc, Granville, France and the highest gust in the UK of was recorded at Shoreham-by-Sea.", "That day's weather reports had failed to indicate a storm of such severity, an earlier, correct forecast having been negated by later projections.", "The apparent suggestion by the BBC's Michael Fish of a false alarm is celebrated as a classic gaffe, though he claims he was misquoted.", "The storm has been termed a weather bomb due to its rapid development.", "Major improvements were later implemented in atmospheric observation, relevant computer models, and the training of forecasters." ] ], "gold": "The great storm of 1987 was a violent extratropical cyclone that occurred on the night of October 15-16 with hurricane-force winds causing casualties in the United Kingdom, France, and the Channel Islands as a severe depression in the Bay of Biscay moved northeast. ", "prediction 1": "The Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands as a severe depression in the Bay of Biscay moved northeast. Among the most damaged areas were Greater London, the East Anglian coast, the Home Counties, the west of Brittany and the Cotentin Peninsula of Normandy which weathered gusts typically with a return period of 1 in 200 years.", "prediction 2": "The Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands as a severe depression in the Bay of Biscay moved northeast. At least 22 people were killed in England and France.", "prediction 3": "The Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands as a severe depression in the Bay of Biscay moved northeast. At least 22 people were killed in England and France as a result.", "prediction 4": "The Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands. Among the most damaged areas were Greater London, the East Anglian coast, the Home Counties, the west of Brittany and the Cotentin Peninsula of Normandy which weathered gusts typically with a return period of 1 in 200 years.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 479 } ], "missing-info": [], "corrected-prediction": "The Great Storm of 1987 was a violent extratropical cyclone that occurred on the night of 15\u201316 October, with hurricane-force winds causing casualties in England, France and the Channel Islands as a severe depression in the Bay of Biscay moved northeast. " }, "preference": [ 2, 2, 0, 0, 1, 1 ] }, { "question": "Who sings i can go the distance in hercules?", "passages": [ [ "Go the Distance", "Go the Distance\n\n\"Go the Distance\" is a song from Disney's 1997 animated feature film, \"Hercules\".", "It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules.", "American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits.", "In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits; this version is included on Martin's album \"Vuelve\".", "Both the song and its reprise featured in a stage production of \"Hercules\", performed upon the Disney Wonder during 2007/2008.", "\"Go the Distance\" was one of two songs written for Hercules in the film, the second being \"Shooting Star\", which failed to make the final cut.", "However, \"Shooting Star\" is included on the \"Hercules\" soundtrack CD, sung by Boyzone.", "The score for the original version of the song can be found in the Alan Menken Songbook.", "\"Ways of Being Male\" felt that the phrase \"go the distance\" is a prime example of the way themes are \"couched in the language of sport and competition\" throughout the film." ] ], "gold": "Go the Distance is a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits; this version is included on Martin's album Vuelve.", "prediction 1": "\"Go the Distance\" is a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits.", "prediction 2": "\"Go the Distance\" is the title of a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits. This version is included on Martin's album \"Vuelve\".", "prediction 3": "\"Go the Distance\" is a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits.", "prediction 4": "\"Go the Distance\" is a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 4 ] } ], "corrected-prediction": "\"Go the Distance\" is a song from Disney's 1997 animated feature film, Hercules. It was written by composer Alan Menken and lyricist David Zippel, and originally recorded by American actor Roger Bart in his film role as the singing voice of Hercules. American singer-songwriter Michael Bolton recorded a pop version of the song for the film's end credits. In the Spanish version, the song is performed by Hercules voice actor Ricky Martin, both in the movie and in the credits. This version is included on Martin's album \"Vuelve\"." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who won the seven day battle civil war?", "passages": [ [ "Seven Days Battles", "Seven Days Battles\n\nThe Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War.", "Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Maj. Gen. George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula.", "The series of battles is sometimes known erroneously as the Seven Days Campaign, but it was actually the culmination of the Peninsula Campaign, not a separate campaign in its own right.", "The Seven Days began on Wednesday, June 25, 1862, with a Union attack in the minor Battle of Oak Grove, but McClellan quickly lost the initiative as Lee began a series of attacks at Beaver Dam Creek (Mechanicsville) on June 26, Gaines's Mill on June 27, the minor actions at Garnett's and Golding's Farm on June 27 and 28, and the attack on the Union rear guard at Savage's Station on June 29.", "McClellan's Army of the Potomac continued its retreat toward the safety of Harrison's Landing on the James River.", "Lee's final opportunity to intercept the Union Army was at the Battle of Glendale on June 30, but poorly executed orders and the delay of Stonewall Jackson's troops allowed his enemy to escape to a strong defensive position on Malvern Hill." ], [ "American Civil War", "The Confederates assumed that European countries were so dependent on \"King Cotton\" that they would intervene, but none did, and none recognized the new Confederate States of America.", "Hostilities began on April 12, 1861, when Confederate forces fired upon Fort Sumter.", "While in the Western Theater the Union made significant permanent gains, in the Eastern Theater, the battle was inconclusive from 1861\u20131862.", "Later, in 1863, Lincoln issued the Emancipation Proclamation, which made ending slavery a war goal.", "To the west, by summer 1862 the Union destroyed the Confederate river navy, then much of their western armies, and seized New Orleans.", "The 1863 Union Siege of Vicksburg split the Confederacy in two at the Mississippi River.", "In 1863, Robert E. Lee's Confederate incursion north ended at the Battle of Gettysburg.", "Western successes led to Ulysses S. Grant's command of all Union armies in 1864.", "Inflicting an ever-tightening naval blockade of Confederate ports, the Union marshaled the resources and manpower to attack the Confederacy from all directions, leading to the fall of Atlanta to William T. Sherman and his march to the sea.", "The last significant battles raged around the Siege of Petersburg.", "Lee's escape attempt ended with his surrender at Appomattox Court House, on April 9, 1865." ] ], "gold": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Major General George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. The Confederate States of America led by Robert E. Lee were the victors of the battle.", "prediction 1": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Major General George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. The series of battles is sometimes known erroneously as the Seven Days Campaign, but it was actually the culmination of the Peninsula Campaign, not a separate campaign in its own right.", "prediction 2": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Maj. Gen. George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. The series of battles is sometimes known erroneously as the Seven Days Campaign, but it was actually the culmination of the Peninsula Campaign, not a separate campaign in its own right.", "prediction 3": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Maj. Gen. George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. The series of battles is sometimes known erroneously as the Seven Days Campaign, but it was actually the culmination of the Peninsula Campaign, not a separate campaign in its own right.", "prediction 4": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Maj. Gen. George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. The series of battles is sometimes known erroneously as the Seven Days Campaign, but it was actually the culmination of the Peninsula Campaign, not a separate campaign in its own right.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 351, "end": 536 } ], "missing-info": [], "corrected-prediction": "The Seven Days Battles were a series of seven battles over seven days from June 25 to July 1, 1862, near Richmond, Virginia, during the American Civil War. Confederate General Robert E. Lee drove the invading Union Army of the Potomac, commanded by Major General George B. McClellan, away from Richmond and into a retreat down the Virginia Peninsula. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who did the land ordinance of 1785 benefit?", "passages": [ [ "Land Ordinance of 1785", "Land Ordinance of 1785\n\nThe Land Ordinance of 1785 was adopted by the United States Congress of the Confederation on May 20, 1785.", "It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west.", "Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream.", "The Ordinance set up a survey system that eventually covered over 3/4 of the area of the continental United States.", "The earlier Ordinance of 1784 was a resolution written by Thomas Jefferson calling for Congress to take action.", "The land west of the Appalachian Mountains, north of the Ohio River and east of the Mississippi River was to be divided into ten separate states.", "However, the 1784 resolution did not define the mechanism by which the land would become states, or how the territories would be governed or settled before they became states.", "The Ordinance of 1785 put the 1784 resolution in operation by providing a mechanism for selling and settling the land, while the Northwest Ordinance of 1787 addressed political needs.", "The 1785 ordinance laid the foundations of land policy until passage of the Homestead Act in 1862.", "The Land Ordinance established the basis for the Public Land Survey System.", "The initial surveying was performed by Thomas Hutchins.", "After he died in 1789, responsibility for surveying was transferred to the Surveyor General." ] ], "gold": "The Land Ordinance of 1785 was adopted by the United States Congress of the Confederation on May 20, 1785. It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream. The 1785 ordinance laid the foundations of land policy until passage of the Homestead Act of 1862 and established the basis for the Public Land Survey System.", "prediction 1": "The 1785 Land Ordinance was adopted by the United States Congress of the Confederation on May 20, 1785. It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream.", "prediction 2": "The 1785 land ordinance was adopted by the United States Congress of the Confederation on May 20, 1785. It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream. The Land Ordinance set up a survey system that eventually covered over 3/4 of the area of the continental United States.", "prediction 3": "The 1785 Land Ordinance was adopted by the United States Congress of the Confederation on May 20, 1785. It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream. The survey system eventually covered over 3/4 of the area of the continental United States.", "prediction 4": "The Land Ordinance of 1785 was adopted by the United States Congress of the Confederation on May 20, 1785 and set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 10 ] } ], "corrected-prediction": "The 1785 Land Ordinance was adopted by the United States Congress of the Confederation on May 20, 1785. It set up a standardized system whereby settlers could purchase title to farmland in the undeveloped west. Congress at the time did not have the power to raise revenue by direct taxation, so land sales provided an important revenue stream. The 1785 ordinance laid the foundations of land policy until passage of the Homestead Act in 1862. The Land Ordinance established the basis for the Public Land Survey System. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When is clan of the cave bear set?", "passages": [ [ "The Clan of the Cave Bear", "The Clan of the Cave Bear\n\nThe Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times.", "It is the first book in the \"Earth's Children\" book series which speculates on the possibilities of interactions between Neanderthal and modern Cro-Magnon humans.", "The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present (BP) or 19,950 years BCE, when the farthest southern encroachment of the last glacial period of the current ice age occurred.", "Auel's time-frame, somewhere between 28,000 and 25,000 years BP or 29,950 and 26,950 BCE, corresponds generally with archaeological estimates of the Neanderthal branch of mankind disappearing.", "A five-year-old girl, Ayla, whom readers come to understand is Cro-Magnon, is orphaned and left homeless by an earthquake that destroys her family's camp.", "She wanders aimlessly, naked and unable to feed herself, for several days.", "Having been attacked and nearly killed by a cave lion and suffering from starvation, exhaustion, and infection of her wounds, she collapses, on the verge of death." ] ], "gold": "Jean M. Auel's 1980 prehistoric fiction novel Clan of the Cave Bear discusses the possibilities of interactions between Neanderthal and modern Cro-Magnon humans around 19,950 years ago, or 18,800 years BCE.", "prediction 1": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. It is the first book in the Earth's Children book series that speculates on the possibilities of interactions between Neanderthal and modern Cro-Magnon humans. The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present (BP) or 19,950 years BCE, when the farthest southern encroachment of the last glacial period of the current ice age occurred. Auel's time-frame, somewhere between 28,000 and 25,000 years BP or 29,950 and 26,950 and 26,950 BCE, corresponds generally with archaeological estimates of the Neanderthal branch of mankind disappearing. The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times.", "prediction 2": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present (BP) or 19,950 years BCE, when the farthest southern encroachment of the last glacial period of the current ice age occurred. Auel's time-frame, somewhere between 28,000 and 25,000 years BP or 29,950 and 26,950 BCE, corresponds generally with archaeological estimates of the Neanderthal branch of mankind disappearing.", "prediction 3": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present (BP) or 19,950 years BCE, when the farthest southern encroachment of the last glacial period of the current ice age occurred. Auel's time-frame, somewhere between 28,000 and 25,000 years BP or 29,950 and 26,950 BCE, corresponds generally with archaeological estimates of the Neanderthal branch of mankind disappearing.", "prediction 4": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present or 19,950 years BCE, when the farthest southern encroachment of the last glacial period of the current ice age occurred. The time-frame of the novel, somewhere between 28,000 and 25,000 years BP or 29,950 and 26,950 BCE, corresponds generally with archaeological estimates of the Neanderthal branch of mankind disappearing.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 503, "end": 706 }, { "error type": "Redundant", "explanation": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. ", "start": 707, "end": 812 }, { "error type": "Irrelevant", "explanation": "", "start": 403, "end": 502 } ], "missing-info": [], "corrected-prediction": "The Clan of the Cave Bear is an epic work of prehistoric fiction by Jean M. Auel about prehistoric times. It is the first book in the Earth's Children book series that speculates on the possibilities of interactions between Neanderthal and modern Cro-Magnon humans. The novel references the advance of the polar ice sheets, setting the story before 18,000 years Before Present (BP) or 19,950 years BCE." }, "preference": [ 2, 2, 2, 0, 0, 0 ] }, { "question": "Who has the most little league world series championships?", "passages": [ [ "Little League World Series", "Little League World Series\n\nThe Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old.", "Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball.", "The Series was first held in 1947 and is held every August in South Williamsport, Pennsylvania.", "(Although the postal address of the organization is in Williamsport, the Series itself is played at Howard J. Lamade Stadium and Volunteer Stadium at the Little League headquarters complex in South Williamsport.)", "Initially, only teams from the United States competed in the Series, but it has since become a worldwide tournament.", "The tournament has gained popular renown, especially in the United States, where games from the Series and even from regional tournaments are broadcast on ESPN.", "The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years.", "Taiwan's dominance during those years has been attributed to a national effort to combat its perceived diplomatic isolation around the world.", "From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups." ], [ "Chinese Taipei", "In a rare reversal of this tendency, the PRC's state news agency, Xinhua, in July 2017 issued a style guide prohibiting the use of \"Taiwan Province\" in favor of the preferred name \"Taiwan\" or \"Taiwan Area\".", "Its reason for doing so was ostensibly to \"[take] into account the psychological feelings of Taiwanese.\"", "Some non-governmental organizations which the PRC does not participate in continue to use \"China\" or the \"Republic of China\".", "The World Organization of the Scout Movement is one of few international organizations that continue to use the name of \"Republic of China\", and the ROC affiliate as the Scouts of China.", "This is because such Scouting in Mainland China is very limited or not really active.", "Likewise, Freemasonry is outlawed in the PRC and thus the Grand Lodge of China is based in Taiwan.", "Countries that maintain diplomatic relations with Taiwan, especially the ROC's older diplomatic affiliates, also refer to the ROC as \"China\" on occasion; for example, during the funeral of Pope John Paul II, the President of the Republic of China, Chen Shui-bian, was seated as part of the French alphabetical seating arrangement as the head of state of \"\" between the first lady of Brazil, and the president of Cameroon.", "Taiwan is categorized in the United Nations population projections as \"Other non-specified areas\" within East Asia." ] ], "gold": "The United States is the country that's won the most Little League world series championships, but when all of the states are considered separately the geographic location that's won the most Little League world series championships is the country of Taiwan. Teams from Taiwan dominated the series from 1969 to 1991, winning in 15 out of those 23 years.", "prediction 1": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old held every August in South Williamsport, Pennsylvania. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years. From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups.", "prediction 2": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. Originally called the National Little League Tournament, it was later renamed for the World Series in Major League Baseball. From 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years. From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups.", "prediction 3": "The Little League World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years. From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups. The most Little League World Series championships in a single year are held in Washington, D.C.", "prediction 4": "The Little League Baseball World Series is an annual baseball tournament in the eastern United States for children aged 10 to 12 years old. The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years. From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 193 }, { "error type": "Irrelevant", "explanation": "", "start": 194, "end": 318 } ], "missing-info": [], "corrected-prediction": "The United States collectively as a country has won majority of the series, although from 1969 to 1991 teams from Taiwan dominated the series, winning in 15 out of those 23 years. From 2010 to the present, teams from Tokyo, Japan, have similarly dominated the series, winning five of the last nine matchups." }, "preference": [ 2, 2, 2, 1, 0, 2 ] }, { "question": "What is the name of the samaritan woman at the well?", "passages": [ [ "Samaritan woman at the well", "Samaritan woman at the well\n\nThe Samaritan woman at the well is a figure from the Gospel of John, in .", "In Eastern Orthodox and Eastern Catholic traditions, she is venerated as a saint with the name Photine (also Photini, Photina, meaning \"the luminous one\" from \u03c6\u03c9\u03c2, \"light\").", "The woman appears in John 4:4\u201342:\n\n", "This episode takes place before the return of Jesus to Galilee.", "Some Jews regarded the Samaritans as foreigners and their attitude was often hostile, although they shared most beliefs, while many other Jews accepted Samaritans as either fellow Jews or as Samaritan Israelites.", "The two communities seem to have drifted apart in the post-exilic period.", "Both communities share the Pentateuch, although crucially the Samaritan Pentateuch locates the holy mountain at Mount Gerizim rather than at Mount Zion, as this incident acknowledges at John 4:20.", "The Gospel of John, like the Gospel of Luke, is favourable to the Samaritans throughout, and, while the Matthaean Gospel quotes Jesus at one early phase in his ministry telling his followers to not at that time evangelize any of the cities of the Samaritans, this restriction had clearly been reversed later by the time of Matthew 28:19." ], [ "Samaritan woman at the well", "As further recounted in and , she was quick to spread the news of her meeting with Jesus, and through this many came to believe in him.", "Her continuing witness is said to have brought so many to the Christian faith that she is described as \"equal to the apostles\".", "Eventually, having drawn the attention of Emperor Nero, she was brought before him to answer for her faith, suffering many tortures and dying a martyr after being thrown down a dry well.", "She is remembered on the Sunday four weeks after Pascha, which is known as \"the Sunday of the Samaritan Woman\".", "In Oaxaca, Oaxaca, Mexico, a celebration of the Samaritan woman takes place on the fourth Friday of Lent.", "The custom of the day involves churches, schools, and businesses giving away fruit drinks to passers-by." ], [ "Samaritan woman at the well", "Scholars differ as to whether the Samaritan references in the New Testament are historical.", "One view is that the historical Jesus had no contact with Samaritans; another is that the accounts go back to Jesus himself.", "Note that in Acts 1:8, Jesus promises the apostles that they will be witnesses to the Samaritans.", "Scholars have noted that this story appears to be modelled on a standard betrothal scene from Hebrew scripture, particularly that of Jacob in Genesis 29.", "This convention, which would have been familiar to Jewish readers, following on from an earlier scene in which John the Baptist compares his relationship to Jesus with that of the friend of a bridegroom.", "This Gospel episode is referred to as \"a paradigm for our engagement with truth\", in the Roman Curia book \"A Christian reflection on the New Age\", as the dialogue says: \"You worship what you do not know; we worship what we know\" and offers an example of \"Jesus Christ the bearer of the water of life\".", "The passages that comprise are sometimes referred to as the Water of Life Discourse, which forms a complement to the Bread of Life Discourse.", "In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later christened \"Photina\".", "She is celebrated as a saint of renown." ] ], "gold": "The name of the Samaritan woman at the well is Photine meaning \"the luminous one\". In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later baptized \"Photine\".", "prediction 1": "The Samaritan woman at the well is a figure from the Gospel of John, in. In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later christened \"Photina\". She is celebrated as a saint of renown.", "prediction 2": "The Samaritan woman at the well is a figure from the Gospel of John, in. In Eastern Orthodox and Eastern Catholic traditions, she is venerated as a saint with the name Photine (also Photini, Photina, meaning \"the luminous one\" from, \"light\"). The Gospel of John, like the Gospel of Luke, is favourable to the Samaritans throughout, and, while some scholars disagree as to whether the Samaritan references in the New Testament are historical, another view is that the story appears to be modelled on a standard betrothal scene from Hebrew scripture, particularly that of Jacob in Genesis 29.", "prediction 3": "The Samaritan woman at the well is a figure from the Gospel of John, in. In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later christened \"Photina\". She is celebrated as a saint of renown.", "prediction 4": "The Samaritan woman at the well is a figure from the Gospel of John, in. In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later christened \"Photina\". She is celebrated as a saint of renown.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 35, "end": 68 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 249 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Samaritan woman at the well is called Photine meaning \"the luminous one\" . In Eastern Christian tradition, the woman's name at the time of her meeting Jesus is unknown, though she was later christened \"Photina\"." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "Who brought a fresh water supply to western australia?", "passages": [ [ "Goldfields Water Supply Scheme", "Goldfields Water Supply Scheme\n\nThe Goldfields Water Supply Scheme is a pipeline and dam project that delivers potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie.", "The project was commissioned in 1896 and was completed in 1903.", "The pipeline continues to operate today, supplying water to over 100,000 people in over 33,000 households as well as mines, farms and other enterprises.", "During the early 1890s, thousands of settlers had travelled into the barren and dry desert centre of Western Australia in search of gold, but the existing infrastructure for the supply of water was non-existent and an urgent need arose.", "Prior to the scheme, water condensers, irregular rain, and water trains were part of the range of sources.", "Railway dams were essential for water to supply locomotives to travel to the goldfields.", "Throughout the 1890s, water availability issues in Coolgardie and in the Kalgoorlie \u2013 Boulder region were causing concern to the population.", "On 16 July 1896, the Premier of Western Australia, Sir John Forrest introduced to Western Australian Parliament a bill to authorise the raising of a loan of \u00a32.5 million to construct the scheme: the pipeline would cart of water per day to the Goldfields from a dam on the Helena River near Mundaring in Perth." ], [ "Goldfields Water Supply Scheme", "The scheme consisted of three key elements \u2013 the Mundaring Weir, which dammed the Helena River in the Darling Scarp creating the Helena River Reservoir; a diameter steel pipe which ran from the dam to Kalgoorlie away; and a series of eight pumping stations and two small holding dams to control pressures and to lift the water over the Darling Scarp ridge.", "The scheme was devised by C. Y. O'Connor who oversaw its design and most of the construction project.", "Although supported by Premier Forrest, O'Connor had to deal with widespread criticism and derision from members of the Western Australian Parliament as well as the local press based on a belief that the scope of the engineering task was too great and that it would never work.", "There was also a concern that the gold discoveries would soon dry up and the state would be left with a significant debt to repay but little or no commerce to support it.", "\"Sunday Times\" editor Frederick Vosper \u2013 who was also a politician, ran a personal attack on O'Connor's integrity and ability through the paper.", "Timing was critical, Forrest as a supporter had moved into Federal politics, and the new Premier George Leake had long been an opponent of the scheme.", "O'Connor committed suicide in March 1902 less than 12 months before the final commissioning of the pipeline." ], [ "Water supply and sanitation in Australia", "In Perth in Western Australia, the Western Australia Water Corporation operated a three-year demonstration project investigating the feasibility of reclaiming water from the Beenyup wastewater treatment plant using MF, RO and UV disinfection prior to injection into the Leederville aquifer (production of 5,000 m per day).", "The demonstration concluded in 2012, and in 2013 the Western Australian Government agreed to a full-scale groundwater recharge scheme, which commenced construction in 2014.", "When complete, the full-scale facility will provide 14,000,000 m per annum to the aquifers supplying Perth's drinking water, with the option to expand to 28,000,000 m per annum in the future.", "While there are currently no full-scale direct potable reuse schemes operating in Australia, the Australian Antarctic Division is investigating the option of installing a potable reuse scheme at its Davis research base in Antarctica.", "To enhance the quality of the marine discharge from the Davis wastewater treatment plant, a number of different, proven technologies have been selected to be used in the future, such as ozonation, UV disinfection, chlorine, as well as UF, activated carbon filtration and RO." ] ], "gold": "Western Australia received its first reliable potable water delivery system via the Goldfields Water Supply Scheme, a pipeline and dam project that brought water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields. The Water Scheme was commissioned in 1896 by the Premier of Western Australia, Sir John Forrest, and implemented by designer C. Y. O'Connor and the Water Corporation. The pipeline continues to operate today, supplying water to over 100,000 people.", "prediction 1": "The Goldfields Water Supply Scheme is a pipeline and dam project that delivers potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie. The project was commissioned in 1896 and was completed in 1903. The pipeline continues to operate today, supplying water to over 100,000 people in over 33,000 households as well as mines, farms and other enterprises.", "prediction 2": "The Western Australian Government brought a fresh water supply to Western Australia in the early 1900s through a pipeline and dam project. The Goldfields Water Supply Scheme delivers potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie. The project was commissioned in 1896 and completed in 1903. The pipeline continues to operate today, supplying water to over 100,000 people in over 33,000 households as well as mines, farms and other enterprises.", "prediction 3": "The Goldfields Water Supply Scheme was commissioned in 1896 and completed in 1903. The scheme delivered potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie. It was devised by C. Y. O'Connor who oversaw its design and most of the construction project. The Western Australia Water Corporation operated a three-year demonstration project investigating the feasibility of reclaiming water from the Beenyup wastewater treatment plant using MF, RO and UV disinfection prior to injection into the Leederville aquifer. The demonstration concluded in 2012, and in 2013 the Western Australia Government agreed to a full-scale groundwater recharge scheme which commenced construction in 2014.", "prediction 4": "The Goldfields Water Supply Scheme is a pipeline and dam project that delivers potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie. The project was commissioned in 1896 and was completed in 1903. The pipeline continues to operate today, supplying water to over 100,000 people in over 33,000 households as well as mines, farms and other enterprises.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 180, "end": 219 }, { "error type": "Irrelevant", "explanation": "", "start": 261, "end": 283 }, { "error type": "Irrelevant", "explanation": "", "start": 364, "end": 436 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 8 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] } ], "corrected-prediction": "The Goldfields Water Supply Scheme is a pipeline and dam project that delivers potable water from Mundaring Weir in Perth to communities in Western Australia's Eastern Goldfields, particularly Coolgardie and Kalgoorlie. The project was commissioned in 1896 by by the Premier of Western Australia, Sir John Forrest, and implemented by designer C. Y. O'Connor and the Water Corporation. The pipeline continues to operate today, supplying water to over 100,000 people." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "When did the jaguar e pace come out?", "passages": [ [ "Jaguar E-Pace", "Jaguar E-Pace\n\nThe Jaguar E-Pace (codename X540) is a subcompact luxury crossover SUV produced by the British car manufacturer Jaguar Land Rover (JLR).", "It was officially revealed on 13 July 2017 and was the 2nd production Jaguar SUV.", "The car is built in Graz, Austria, by Magna Steyr and from 2018 is also scheduled to be built by Chery Jaguar Land Rover, JLR\u2019s joint venture with partner Chery, in Changshu, China.", "Designed under the direction of Jaguar chief designer Ian Callum, the car is based on a modified version of the JLR D8 platform as used by the Range Rover Evoque and the Land Rover Discovery Sport.", "The car dimensions are: length , width (mirrors folded) , width (mirrors unfolded) , height and wheelbase .", "The car has a transverse front engine and is available in both front-wheel drive and all-wheel drive versions.", "Stunt driver Terry Grant performed a world record barrel roll jump in the car for the reveal which took place at the London ExCel centre.", "The car did a 270 degree barrel roll and travelled 50 feet (15.3 metres) through the air.", "North American models receive two variants of the 2.0-L Ingenium engine that produces either or , all of which are mated to a 9\u2013speed ZF 9-HP automatic." ] ], "gold": "The Jaguar E-Pace luxury crossover SUV was officially revealed on 13 July 2017 as the 2nd production Jaguar SUV. The car has been in production by Magna Steyr in Graz, Austria since 2017, and by Chery Jaguar Land Rover in Changshu, China since 2018.", "prediction 1": "The Jaguar E-Pace is a subcompact luxury crossover SUV produced by the British car manufacturer Jaguar Land Rover (JLR). It was officially revealed on 13 July 2017 and was the 2nd production Jaguar SUV.", "prediction 2": "The Jaguar E-Pace, codenamed X540, is a subcompact luxury crossover SUV produced by the British car manufacturer Jaguar Land Rover (JLR). It was officially revealed on 13 July 2017 and was the 2nd production Jaguar SUV. Designed under the direction of Jaguar chief designer Ian Callum, the car is based on a modified version of the JLR D8 platform as used by the Range Rover Evoque and the Land Rover Discovery Sport.", "prediction 3": "The Jaguar E-Pace is a subcompact luxury crossover SUV produced by the British car manufacturer Jaguar Land Rover (JLR). It was officially revealed on 13 July 2017 and was the 2nd production Jaguar SUV.", "prediction 4": "The Jaguar E-Pace is a subcompact luxury crossover SUV produced by the British car manufacturer Jaguar Land Rover (JLR). It was officially revealed on 13 July 2017 and was the 2nd production Jaguar SUV.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 23, "end": 120 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "The Jaguar E-Pace luxury crossover SUV was officially revealed on 13 July 2017 as the 2nd production Jaguar SUV. The car is built in Graz, Austria, by Magna Steyr and from 2018 is also scheduled to be built by Chery Jaguar Land Rover, JLR\u2019s joint venture with partner Chery, in Changshu, China." }, "preference": [ 1, 0, 0, 2, 2, 0 ] }, { "question": "What are the products of helium burning in a star?", "passages": [ [ "Triple-alpha process", "Triple-alpha process\n\nThe triple-alpha process is a set of nuclear fusion reactions by which three helium-4 nuclei (alpha particles) are transformed into carbon.", "Helium accumulates in the core of stars as a result of the proton\u2013proton chain reaction and the carbon\u2013nitrogen\u2013oxygen cycle.", "Further nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively.", "Both products are highly unstable and decay, almost instantly, back into smaller nuclei, unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus.", "When a star runs out of hydrogen to fuse in its core, it begins to collapse until the central temperature rises to 10 K, six times hotter than the sun's core.", "At this temperature and density, alpha particles can fuse fast enough (the half-life of Li is and that of Be is ) to produce significant amounts of carbon and restore thermodynamic equilibrium in the core\n\n", "The net energy release of the process is 7.275 MeV.", "As a side effect of the process, some carbon nuclei fuse with additional helium to produce a stable isotope of oxygen and energy:\n\n", "See alpha process for more details about this reaction and further steps in the chain of stellar nucleosynthesis." ] ], "gold": "Helium burning in a star produces both stable and unstable products. Nuclear fusion reaction of two helium-4 nuclei produces beryllium-8, which is highly unstable. The stable products are carbon-12 and Oxygen.", "prediction 1": "These are the products of helium burning in a star. The triple-alpha process is a set of nuclear fusion reactions by which three helium-4 nuclei (alpha particles) are transformed into carbon. Further nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively. Both products are highly unstable and decay almost instantly, back into smaller nuclei, unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus.", "prediction 2": "The triple-alpha process is a set of nuclear fusion reactions by which three helium-4 nuclei (alpha particles) are transformed into carbon. Further nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively. Both products are highly unstable and decay, almost instantly, back into smaller nuclei, unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus. As a side effect, some carbon nuclei fuse with additional helium to produce a stable isotope of oxygen and energy.", "prediction 3": "The triple-alpha process is a set of nuclear fusion reactions by which three helium-4 nuclei (alpha particles) are transformed into carbon. Further nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively. Both products are highly unstable and decay, almost instantly, back into smaller nuclei, unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus.", "prediction 4": "The triple-alpha process is a set of nuclear fusion reactions by which three helium-4 nuclei (alpha particles) are transformed into carbon. Further nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively. Both products are highly unstable and decay, almost instantly, back into smaller nuclei, unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus. As a side effect, some carbon nuclei fuse with additional helium to produce a stable isotope of oxygen and energy.", "feedback": { "errors": [ { "error type": "Incoherent", "explanation": "", "start": 0, "end": 51 }, { "error type": "Irrelevant", "explanation": "", "start": 52, "end": 191 }, { "error type": "Irrelevant", "explanation": "", "start": 385, "end": 410 } ], "missing-info": [], "corrected-prediction": "Nuclear fusion reactions of helium with hydrogen or another alpha particle produce lithium-5 and beryllium-8 respectively. Both products are highly unstable and decay almost instantly unless a third alpha particle fuses with a beryllium before that time to produce a stable carbon-12 nucleus." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "The most holy name of mary feast day?", "passages": [ [ "The Most Holy Name of the Blessed Virgin Mary", "The Most Holy Name of the Blessed Virgin Mary\n\nThe Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September.", "It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683.", "It was removed from the Church calendar in the liturgical reform following Vatican II but restored by Pope Saint John Paul II in 2002, along with the Feast of the Holy Name of Jesus.", "In Hebrew, the name Mary is \"Miryam\".", "In Aramaic the language spoken in her own time, the form of the name was \"Mariam\".", "Based on the root \"merur\", the name signifies \"bitterness\".", "This is reflected in the words of Naomi, who, after losing a husband and two sons lamented, \" \u201cDo not call me Naomi (\u2018Sweet\u2019).", "Call me Mara (\u2018Bitter\u2019), for the Almighty has made my life very bitter.\"", "Meanings ascribed to Mary's name by the early Christian writers and perpetuated by the Greek Fathers include: \"Bitter Sea,\" \"Myrrh of the Sea\", \"The Enlightened One,\" \"The Light Giver,\" and especially \"Star of the Sea.\"" ] ], "gold": "The Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683. The first Feast Day was observed on 12 September 1684.", "prediction 1": "The Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683. It was removed from the Church calendar in the liturgical reform following Vatican II but restored by Pope Saint John Paul II in 2002, along with the Feast of the Holy Name of Jesus.", "prediction 2": "The Most Holy Name of Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683. It was removed from the Church calendar in the liturgical reform following Vatican II but restored by Pope Saint John Paul II in 2002, along with the Feast of the Holy Name of Jesus.", "prediction 3": "The Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683. It was removed from the Church calendar in the liturgical reform following Vatican II but restored by Pope Saint John Paul II in 2002, along with the Feast of the Holy Name of Jesus.", "prediction 4": "The Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683. It was removed from the Church calendar in the liturgical reform following Vatican II but restored by Pope Saint John Paul II in 2002, along with the Feast of the Holy Name of Jesus.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 338, "end": 520 } ], "missing-info": [], "corrected-prediction": "The Feast of the Most Holy Name of the Blessed Virgin Mary is an optional memorial celebrated in the liturgical calendar of the Catholic Church on 12 September. It has been a universal Roman Rite feast since 1684, when Pope Innocent XI included it in the General Roman Calendar to commemorate the victory at the Battle of Vienna in 1683." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where is the billboard music awards 2017 held?", "passages": [ [ "2017 Billboard Music Awards", "2017 Billboard Music Awards\n\nThe 2017 \"Billboard\" Music Awards ceremony was held at the T-Mobile Arena in Las Vegas on May 21, 2017.", "The list of nominees was announced on April 10, 2017.", "Non-televised awards were announced on \"Billboard\" website the same day as the main ceremony.", "This was the last ceremony to air on ABC as they moved to NBC the following year.", "Notes\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nWinners are listed first." ], [ "Las Vegas", "Las Vegas\n\nLas Vegas (, Spanish for \"The Meadows\"; ), officially the City of Las Vegas and often known simply as Vegas, is the 28th-most populated city in the United States, the most populated city in the state of Nevada, and the county seat of Clark County.", "The city anchors the Las Vegas Valley metropolitan area and is the largest city within the greater Mojave Desert.", "Las Vegas is an internationally renowned major resort city, known primarily for its gambling, shopping, fine dining, entertainment, and nightlife.", "The Las Vegas Valley as a whole serves as the leading financial, commercial, and cultural center for Nevada.", "The city bills itself as The Entertainment Capital of the World, and is famous for its mega casino\u2013hotels and associated activities.", "It is a top three destination in the United States for business conventions and a global leader in the hospitality industry, claiming more AAA Five Diamond hotels than any other city in the world.", "Today, Las Vegas annually ranks as one of the world's most visited tourist destinations.", "The city's tolerance for numerous forms of adult entertainment earned it the title of Sin City, and has made Las Vegas a popular setting for literature, films, television programs, and music videos.", "Las Vegas was settled in 1905 and officially incorporated in 1911." ] ], "gold": "The venue the 2017 Billboard Music Awards was held at was the T-Mobile Arena in Las Vegas, the most populous city in the state of Nevada and the county seat of Clark County. The awards ceremony was held on May 21, 2017.", "prediction 1": "The 2017 Billboard Music Awards ceremony was held at the T-Mobile Arena in Las Vegas on May 21, 2017. The list of nominees was announced on April 10, 2017.", "prediction 2": "The 2017 Billboard Music Awards were held at the T-Mobile Arena in Las Vegas on May 21, 2017.", "prediction 3": "The 2017 Billboard Music Awards ceremony was held at the T-Mobile Arena in Las Vegas on May 21, 2017.", "prediction 4": "The 2017 Billboard Music Awards ceremony was held at the T-Mobile Arena in Las Vegas on May 21, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 102, "end": 155 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] } ], "corrected-prediction": "The 2017 Billboard Music Awards ceremony was held at the T-Mobile Arena in Las Vegas, the most populous city in the state of Nevada and the county seat of Clark County, on May 21, 2017. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where did they film the movie chernobyl diaries?", "passages": [ [ "Chernobyl Diaries", "Chernobyl Diaries\n\nChernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and produced by Oren Peli, who also wrote the story.", "The film stars Jonathan Sadowski, Jesse McCartney, Devin Kelley, Olivia Taylor Dudley, Ingrid Bols\u00f8 Berdal, Nathan Phillips, and Dimitri Diatchenko, and was shot on locations in Pripyat, Hungary, and Serbia.", "Chris (Jesse McCartney), his girlfriend Natalie (Olivia Taylor Dudley), and their mutual friend Amanda (Devin Kelley), are traveling across Europe.", "They stop in Kiev, Ukraine, to visit Chris's brother, Paul (Jonathan Sadowski), before heading on to Moscow, Russia, where Chris intends to propose to Natalie.", "Paul suggests they go for an \"extreme tour\" of Pripyat, an abandoned town which sits in the shadow of the Chernobyl Nuclear Power Plant.", "Chris is against going on the tour because of the potential danger and would rather stay on the original plan of going to Moscow.", "They meet tour guide Yuri (Dimitri Diatchenko) and are joined by a backpacking couple, Norwegian Zoe (Ingrid Bols\u00f8 Berdal) and Australian Michael (Nathan Phillips).", "Yuri drives them through Ukraine, before they arrive at a Chernobyl Exclusion Zone checkpoint, where they are refused entry by the Ukrainian military." ], [ "Belarus\u2013Ukraine border", "Belarus\u2013Ukraine border\n\nBelarusian-Ukrainian border is the state border between Belarus and Ukraine with a length of about .", "It starts from the triple junction with Poland to the west and stretches to the triple junction with Russia to the east.", "The tripoint border at the triple border junction of Belarus, Russia and Ukraine is marked in the form of a monument, while at the other border junction there is a river Western Bug that coincides with the border of Poland.", "The border is situated in a geographic region of Polesia (Polesian Lowland) that stretches approximately from Western Bug to Dnieper along Prypiat River (just to the south of it).", "It is part of bigger East European Plain and known for its Pripet Marshes (or Pinsk Marshes).", "The west end of the border starts at Western Bug around the area of lakes of Shatsk and runs eastward across the Pinsk Marshes.", "Further it stretches parallel to Pripyat River some distance south from it passing densely wooded areas that were contaminated after the Chernobyl disaster.", "The border passes Pripyat just to the north of Pripyat city and then also turns southeast as the river and continues to run parallel to it.", "As the border reaches Dnieper, it turns north towards Homiel and runs along the river." ] ], "gold": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker. Some of the film was shot in Pripyat which is an abandoned town in Ukraine near the Chernobyl Nuclear Power Plant, the site of a nuclear disaster in 1986. Scenes were also shot in Hungary and Serbia.", "prediction 1": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and produced by Oren Peli, who also wrote the story. It stars Jonathan Sadowski, Jesse McCartney, Devin Kelley, Olivia Taylor Dudley, Dimitri Diatchenko, and was shot on locations in Pripyat, Hungary, and Serbia.", "prediction 2": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and produced by Oren Peli, who also wrote the story. The movie stars Jonathan Sadowski, Jesse McCartney, Devin Kelley, Olivia Taylor Dudley, Dimitri Diatchenko, and was shot on locations in Pripyat, Hungary, and Serbia.", "prediction 3": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and produced by Oren Peli, who also wrote the story. The film stars Jonathan Sadowski, Jesse McCartney, Devin Kelley, Olivia Taylor Dudley, Dimitri Diatchenko, and was shot on locations in Pripyat, Hungary, and Serbia.", "prediction 4": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and produced by Oren Peli, who also wrote the story. The film stars Jonathan Sadowski, Jesse McCartney, Devin Kelley, Olivia Taylor Dudley, Dimitri Diatchenko, and was shot on locations in Pripyat, Hungary, and Serbia.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 82, "end": 134 }, { "error type": "Irrelevant", "explanation": "", "start": 135, "end": 235 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "Chernobyl Diaries is a 2012 American disaster horror film directed by Brad Parker and shot on locations in Pripyat, an abandoned town in Ukraine which sits in the shadow of the Chernobyl Nuclear Power Plant, the site of a nuclear disaster, Hungary, and Serbia." }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "What is a black spider with yellow stripes?", "passages": [ [ "Argiope aurantia", "Argiope aurantia\n\nThe spider species Argiope aurantia is commonly known as the yellow garden spider, black and yellow garden spider, golden garden spider, writing spider, zigzag spider, corn spider, or McKinley spider.", "It is common to the contiguous United States, Hawaii, southern Canada, Mexico, and Central America.", "It has distinctive yellow and black markings on the abdomen and a mostly white cephalothorax.", "Its scientific Latin name translates to \"gilded silver-face\" (the genus name \"Argiope\" meaning \"silver-face\", while the specific epithet \"aurantia\" means \"gilded\").", "Males range from ; females range from .", "These spiders may bite if disturbed or harassed, but the venom is harmless to non-allergic humans, roughly equivalent to a bumblebee sting in intensity.", "Yellow garden spiders often build webs in areas adjacent to open sunny fields where they stay concealed and protected from the wind.", "The spider can also be found along the eaves of houses and outbuildings or in any tall vegetation where they can securely stretch a web.", "Female \"Argiope aurantia\" spiders tend to be somewhat local, often staying in one place throughout much of their lifetime." ] ], "gold": "The common name for a black spider with yellow stripes is yellow garden spider, while the scientific name is called Agriope aurantia. ", "prediction 1": "The spider species Argiope aurantia is commonly known as the yellow garden spider, black and yellow garden spider, golden garden spider, writing spider, zigzag spider, corn spider, or McKinley spider. It has distinctive yellow and black markings on the abdomen and a mostly white cephalothorax.", "prediction 2": "The spider species Argiope aurantia is commonly known as the yellow garden spider, black and yellow garden spider, golden garden spider, writing spider, zigzag spider, corn spider, or McKinley spider. These spiders often build webs in areas adjacent to open sunny fields where they stay concealed and protected from the wind. The venom of these spiders is harmless to non-allergic humans, roughly equivalent to a bumblebee sting in intensity.", "prediction 3": "The spider species Argiope aurantia is commonly known as the yellow garden spider, black and yellow garden spider, golden garden spider, writing spider, zigzag spider, corn spider, or McKinley spider. It has distinctive yellow and black markings on the abdomen and a mostly white cephalothorax. These spiders often build webs in areas adjacent to open sunny fields where they stay concealed and protected from the wind.", "prediction 4": "Black spider with yellow stripes is also known as a golden garden spider, a black and yellow garden spider, or a yellow garden spider. Argiope aurantia is a spider species found in the United States, Hawaii, southern Canada, Mexico, and Central America. It has distinctive yellow and black markings on the abdomen and a mostly white cephalothorax.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 137, "end": 200 }, { "error type": "Irrelevant", "explanation": "", "start": 201, "end": 294 } ], "missing-info": [], "corrected-prediction": "The spider species Argiope aurantia is commonly known as the yellow garden spider, black and yellow garden spider, or golden garden spider." }, "preference": [ 1, 1, 0, 2, 2, 2 ] }, { "question": "Who operates and controls a corporation in its day-to-day activities?", "passages": [ [ "Corporation", "In a joint-stock company the members are known as shareholders and each of their shares in the ownership, control, and profits of the corporation is determined by the portion of shares in the company that they own.", "Thus a person who owns a quarter of the shares of a joint-stock company owns a quarter of the company, is entitled to a quarter of the profit (or at least a quarter of the profit given to shareholders as dividends) and has a quarter of the votes capable of being cast at general meetings.", "In another kind of corporation, the legal document which established the corporation or which contains its current rules will determine who the corporation's members are.", "Who a member is depends on what kind of corporation is involved.", "In a worker cooperative, the members are people who work for the cooperative.", "In a credit union, the members are people who have accounts with the credit union.", "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members.", "In some cases, this will be a single individual but more commonly corporations are controlled by a committee or by committees.", "Broadly speaking, there are two kinds of committee structure.", "Historically, corporations were created by a charter granted by government.", "Today, corporations are usually registered with the state, province, or national government and regulated by the laws enacted by that government." ], [ "Co-determination", "Co-determination\n\nCodetermination (also \"copartnership\" or \"worker participation\") is the practice of workers of an enterprise having the right to vote for representatives on the board of directors in a company.", "It also refers to staff having binding rights in work councils on issues in their workplace.", "The practice of board level representation is widespread in developed democracies.", "The first laws requiring worker voting rights include the Oxford University Act 1854 and the Port of London Act 1908 in the United Kingdom, a voluntary Act on Manufacturing Companies of 1919 in Massachusetts in the United States, and the Supervisory Board Act 1922 (\"Aufsichtsratgesetz 1922\") in Germany, which codified collective agreement from 1918.", "Most countries with codetermination laws have single-tier board of directors in their corporate law (such as Sweden, France or the Netherlands), while a number in central Europe (particularly Germany and Austria) have two-tier boards.", "Most laws apply to companies over a certain size, from Denmark at 20 employees, to Germany over 500 (for one-third representation) and 2000 (for just under one half), to France over 5000 employees.", "Sweden has had a law of codetermination since 1980.", "In economies with codetermination, workers in large companies may form special bodies known as works councils." ], [ "Corporate governance", "Stock analysts and debt holders may also conduct such external monitoring.", "An ideal monitoring and control system should regulate both motivation and ability, while providing incentive alignment toward corporate goals and objectives.", "Care should be taken that incentives are not so strong that some individuals are tempted to cross lines of ethical behavior, for example by manipulating revenue and profit figures to drive the share price of the company up.", "Internal corporate governance controls monitor activities and then take corrective actions to accomplish organisational goals.", "Examples include:\n\nIn publicly traded U.S. corporations, boards of directors are largely \"chosen\" by the President/CEO and the President/CEO often takes the Chair of the Board position for him/herself (which makes it much more difficult for the institutional owners to \"fire\" him/her).", "The practice of the CEO also being the Chair of the Board is fairly common in large American corporations.", "While this practice is common in the U.S., it is relatively rare elsewhere.", "In the U.K., successive codes of best practice have recommended against duality.", "External corporate governance controls the external stakeholders' exercise over the organization.", "Examples include:\n\nThe board of directors has primary responsibility for the corporation's internal and external financial reporting functions.", "The chief executive officer and chief financial officer are crucial participants, and boards usually have a high degree of reliance on them for the integrity and supply of accounting information." ] ], "gold": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members. In some cases, this will be a single individual but more commonly corporations are controlled by a committee or by committees. There are two kinds of committee structure. A single committee known as a board of directors is the method favored in most common law countries. A two-tiered committee structure with a supervisory board and a managing board is common in civil law countries. And, in countries with co-determination, such as Germany and Sweden, workers elect a fixed fraction of the corporation's board.", "prediction 1": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members. In some cases, this will be a single individual but more commonly corporations are controlled by a committee or by committees. Internal corporate governance controls monitor activities and then take corrective actions to accomplish organisational goals. External corporate governance controls the external stakeholders' exercise over the organization.", "prediction 2": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members. In some cases, this will be a single individual but more commonly corporations are controlled by a committee or by committees. External corporate governance controls the external stakeholders' exercise over the organization. In a joint-stock company, the members are known as shareholders and each of their shares in the ownership, control, and profits of the corporation is determined by the portion of shares in the company that they own.", "prediction 3": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members, but more commonly corporations are controlled by a committee or by committees. In some cases, this will be a single individual, but more commonly corporations are controlled by a committee or by committees. In a joint-stock company the members are known as shareholders and each of their shares in the ownership, control, and profits of the corporation are determined by the portion of shares in the company that they own.", "prediction 4": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members. In some cases, this will be a single individual, but more commonly corporations are controlled by a committee or by committees. In addition, in some countries, such as Sweden, there is a single-tier board of directors. In other countries, such as the United States, Europe has two-tier boards.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 236, "end": 362 }, { "error type": "Irrelevant", "explanation": "", "start": 363, "end": 460 } ], "missing-info": [ { "error type": "Missing-Minor-Auxiliary", "passage_id": 1, "sentence_id": [ 9 ] }, { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "The day-to-day activities of a corporation are typically controlled by individuals appointed by the members. In some cases, this will be a single individual but more commonly corporations are controlled by a committee or by committees. Broadly speaking, there are two kinds of committee structure. Codetermination (also \"copartnership\" or \"worker participation\") is the practice of workers of an enterprise having the right to vote for representatives on the board of directors in a company. Most countries with codetermination laws have single-tier board of directors in their corporate law (such as Sweden, France or the Netherlands), while a number in central Europe (particularly Germany and Austria) have two-tier boards." }, "preference": [ 2, 2, 1, 0, 1, 1 ] }, { "question": "Where is peristalsis found in the digestive system?", "passages": [ [ "Peristalsis", "Peristalsis\n\nPeristalsis is a radially symmetrical contraction and relaxation of muscles that propagates in a wave down a tube, in an anterograde direction.", "In much of a digestive tract such as the human gastrointestinal tract, smooth muscle tissue contracts in sequence to produce a peristaltic wave, which propels a ball of food (called a bolus while in the esophagus and upper gastrointestinal tract and chyme in the stomach) along the tract.", "Peristaltic movement comprises relaxation of circular smooth muscles, then their contraction behind the chewed material to keep it from moving backward, then longitudinal contraction to push it forward.", "Earthworms use a similar mechanism to drive their locomotion, and some modern machinery imitates this design.", "The word comes from New Latin and is derived from the Greek \"peristellein\", \"to wrap around,\" from \"peri\"-, \"around\" + \"stellein\", \"draw in, bring together; set in order\".", "After food is chewed into a bolus, it is swallowed and moved through the esophagus.", "Smooth muscles contract behind the bolus to prevent it from being squeezed back into the mouth.", "Then rhythmic, unidirectional waves of contractions work to rapidly force the food into the stomach." ] ], "gold": "In much of a digestive tract such as the human gastrointestinal tract, smooth muscle tissue contracts in sequence to produce a peristaltic wave, which propels a ball of food, called a bolus while in the esophagus and upper gastrointestinal tract and chyme in the stomach, along the tract. Peristaltic movement comprises relaxation of circular smooth muscles, then their contraction behind the chewed material to keep it from moving backward, then longitudinal contraction to push it forward.", "prediction 1": "Peristalsis is a radially symmetrical contraction and relaxation of muscles that propagates in a wave down a tube, in an anterograde direction. In much of a digestive tract such as the human gastrointestinal tract, smooth muscle tissue contracts in sequence to produce a peristaltic wave, which propels a ball of food (called a bolus while in the esophagus and upper gastrointestinal tract and chyme in the stomach) along the tract.", "prediction 2": "Peristalsis is a radially symmetrical contraction and relaxation of muscles that propagates in a wave down a tube, in an anterograde direction. Peristalsis is found in the human digestive system in the esophagus and upper gastrointestinal tract and in the stomach.", "prediction 3": "Peristalsis is a radially symmetrical contraction and relaxation of muscles that propagates in a wave down a tube, in an anterograde direction. Peristalsis is found in the esophagus, upper gastrointestinal tract, and the stomach.", "prediction 4": "Peristalsis is a radially symmetrical contraction and relaxation of muscles that propagates in a wave down a tube, in an anterograde direction. In much of a digestive tract such as the human gastrointestinal tract, smooth muscle tissue contracts in sequence to produce a peristaltic wave, which propels a ball of food (called a bolus while in the esophagus and upper gastrointestinal tract and chyme in the stomach) along the tract.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 143 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": " In much of a digestive tract such as the human gastrointestinal tract, smooth muscle tissue contracts in sequence to produce a peristaltic wave, which propels a ball of food (called a bolus while in the esophagus and upper gastrointestinal tract and chyme in the stomach) along the tract. Peristaltic movement comprises relaxation of circular smooth muscles, then their contraction behind the chewed material to keep it from moving backward, then longitudinal contraction to push it forward." }, "preference": [ 1, 1, 0, 1, 2, 2 ] }, { "question": "Mr keen tracer of lost persons theme song?", "passages": [ [ "Mr. Keen, Tracer of Lost Persons", "Keen\" programs are known to survive.", "Richard Leonard directed scripts by Barbara Bates, Stedman Coles, Frank Hummert, Lawrence Klee and Bob Shaw.", "James Fleming and Larry Elliott were the announcers.", "Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"", "The cliches, stereotypes and simplistic dialogue provided much fodder for Bob and Ray's parody, \"Mr. Trace, Keener Than Most Persons\", broadcast in numerous variations.", "It was also combined with rival detective show \"Martin Kane, Private Eye\" and satirized by Harvey Kurtzman and Jack Davis in \"Mad\" magazine's fifth issue (June-July 1953), as \"Kane Keen!", "Private Eye\".", "The character of Mr. Keen was referenced by Alfred Hitchcock in one of his television shows, according to \"The Alfred Hitchcock Presents Companion\" by Patrik Wikstrom and Martin Grams, Jr.", "Mr. Keen is also mentioned in the stage version of \"Bye Bye Birdie\" by the character Mr. Harry MacAfee, who was played by Paul Lynde.", "In the \"Honeymooners\" sketch, , appearing on the October 12, 1951 episode of Cavalcade of Stars, Ralph Kramden cannot find his razor blades." ], [ "Mr. Keen, Tracer of Lost Persons", "Mr. Keen, Tracer of Lost Persons\n\nMr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era.", "It was produced by Frank and Anne Hummert, who based it upon Robert W. Chambers' 1906 novel \"The Tracer of Lost Persons\".", "The sponsors included Whitehall Pharmacal (as in Anacin, Kolynos Toothpaste, BiSoDol antacid mints, Hill's cold tablets and Heet liniment), Dentyne, Aerowax, RCA Victor and Chesterfield cigarettes.", "It aired on the NBC Blue network until 1947, when it switched to CBS.", "Bennett Kilpack began as Mr. Keen in 1937 with Arthur Hughes and then Phil Clarke stepping into the role later in the series.", "The kindly Keen and his faithful assistant, Mike Clancy (Jim Kelly), entertained listeners for 18 years.", "With 1690 nationwide broadcasts, \"Mr. Keen\" was the most resilient private detective in a namesake role.", "The nearest competitors were \"Nick Carter, Master Detective\" (726 broadcasts), \"The Adventures of Sherlock Holmes\" (657) and \"The Adventures of the Falcon\" (473).", "Only 59 of the 1690 \"Mr." ] ], "gold": "Mr. Keen, Tracer of Lost Persons, was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. Bennett Kilpack began as Mr. Keen in 1937 with Arthur Hughes and then Phil Clarke stepping into the role later in the series. Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"", "prediction 1": "Mr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"", "prediction 2": "Mr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"", "prediction 3": "Mr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"", "prediction 4": "Mr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. The show was also the basis for Bob and Ray's parody, Mr. Trace, Keener Than Most Persons, which was broadcast in numerous variations. Mr. Keen is also mentioned in the stage version of Bye Bye Birdie by the character Mr. Harry MacAfee, played by Paul Lynde.", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "Mr. Keen, Tracer of Lost Persons was one of radio's longest running shows, airing October 12, 1937 to April 19, 1955, continuing well into the television era. Bennett Kilpack began as Mr. Keen in 1937 with Arthur Hughes and then Phil Clarke stepping into the role later in the series. Al Rickey's band provided the background music, including the program's theme, \"Someday I'll Find You.\"" }, "preference": [ 0, 0, 1, 0, 1, 1 ] }, { "question": "Who owns the four queens in las vegas?", "passages": [ [ "Four Queens", "Four Queens\n\nThe Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience.", "The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003.", "Construction began on November 16, 1964.", "The $5.5 million project was planned to include an 18-story hotel.", "Four Queens opened on June 2, 1966.", "The casino is named after the builder Ben Goffstein's four daughters, Faith, Hope, Benita, and Michele.", "It originally contained only 120 rooms and a casino.", "The 18-story hotel building was eventually added.", "From 1972 to 2003 the hotel/casino was owned by Elsinore Corporation, a wholly owned subsidiary of the Hyatt Corporation until 1979, when it became an independent company.", "In 1995, Elsinore filed for Chapter 11 bankruptcy and the investment firm Morgens, Waterfall, Vintiadis & Company obtained 99 percent ownership of the company.", "In 1976 the casino expanded to and changed decor to be warmer.", "A second 18-story hotel building was completed in 1981.", "Today the casino occupies the entire block bordered by Fremont Street, Casino Center, Third Street and Carson Avenue.", "The Four Queens was also a partner in renovating the downtown area and creating the Fremont Street Experience." ], [ "Four Queens", "In December 2003 the Four Queens casino was the first Las Vegas casino to offer Geoff Hall's Blackjack variant Blackjack Switch, which is now widely available throughout Las Vegas.", "In April 2007 the Canyon Club opened at the Four Queens, providing the first downtown casino club.", "The hotel contains 690 rooms as of 2017." ] ], "gold": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and 27,269 sq ft. casino is owned and operated by TLC Casino Enterprises, a holding company owned and controlled by Terry L. Caudill who acquired the property from the Elsinore Corporation in 2003.", "prediction 1": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003. Elsinore Corporation owned the hotel/casino from 1972 to 2003, until 1995, when Morgens, Waterfall, Vintiadis & Company obtained 99 percent ownership of the company.", "prediction 2": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003. From 1972 to 2003 the hotel/casino was owned by Elsinore Corporation, a wholly owned subsidiary of the Hyatt Corporation until 1979, when it became an independent company. In 1995, Elsinore filed for Chapter 11 bankruptcy and the investment firm Morgens, Waterfall, Vintiadis & Company obtained 99 percent ownership of the company.", "prediction 3": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003. From 1972 to 2003 the hotel/casino was owned by Elsinore Corporation, a wholly owned subsidiary of the Hyatt Corporation until 1979, when it became an independent company. In 1995, Elsinore filed for Chapter 11 bankruptcy and the investment firm Morgens, Waterfall, Vintiadis & Company obtained 99 percent ownership of the company. In April 2007 the Canyon Club opened at the Four Queens, providing the first downtown casino club.", "prediction 4": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003. From 1972 to 2003 the hotel/casino was owned by Elsinore Corporation, a wholly owned subsidiary of the Hyatt Corporation until 1979, when it became an independent company. Morgens, Waterfall, Vintiadis & Company obtained 99 percent ownership of the company.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 239, "end": 404 } ], "missing-info": [], "corrected-prediction": "The Four Queens Hotel and Casino is located in downtown Las Vegas on the Fremont Street Experience. The 690-room hotel and casino is owned and operated by TLC Enterprises, which acquired the property from the Elsinore Corporation in 2003. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "Who said these are times that try men's souls?", "passages": [ [ "The American Crisis", "The American Crisis\n\nThe American Crisis is a pamphlet series by eighteenth century Enlightenment philosopher and author, Thomas Paine, originally published from 1776 to 1783 during the American Revolution.", "Often known as, \"The American Crisis\", or simply, \"The Crisis\", there are 16 pamphlets in total.", "Thirteen numbered pamphlets were published between 1776 and 1777, with three additional pamphlets released between 1777 and 1783.", "The first of the pamphlets was published in \"Pennsylvania Journal\" on December 19, 1776.", "Paine signed the pamphlets with the pseudonym, \"Common Sense\".", "The pamphlets were contemporaneous with early parts of the American Revolution, during a time when colonists needed inspiring works.", "Paine, like many other politicians and scholars, knew that the colonists weren't going to support the American Revolutionary War without proper reason to do so.", "They were written in a language that the common person could understand, and represented Paine's liberal philosophy.", "Paine also used references to God, saying that a war against Kingdom of Great Britain would be a war with the support of God.", "Paine's writings bolstered the morale of the American colonists, appealed to the English people's consideration of the war, clarified the issues at stake in the war, and denounced the advocates of a negotiated peace.", "The first volume begins with the famous words, \"These are the times that try men's souls.\"" ] ], "gold": "The American Crisis is a pamphlet series by eighteenth-century Enlightenment philosopher and author Thomas Paine, originally published from 1776 to 1783 during the American Revolution. Paine signed the pamphlets with the pseudonym, \"Common Sense\". The first volume begins with the sentence: \"These are the times that try men's souls.\"", "prediction 1": "The American Crisis is a pamphlet series by eighteenth century Enlightenment philosopher and author, Thomas Paine, originally published from 1776 to 1783 during the American Revolution. The first volume begins with the famous words, \"These are the times that try men's souls.\"", "prediction 2": "Thomas Paine, an eighteenth century Enlightenment philosopher and author, said these are the times that try men's souls in his pamphlet series. Paine said these are the times that try men's souls.", "prediction 3": "The American Crisis is a pamphlet series by eighteenth century Enlightenment philosopher and author, Thomas Paine, originally published from 1776 to 1783 during the American Revolution. The first volume begins with the famous words, \"These are the times that try men's souls.\"", "prediction 4": "Thomas Paine, the eighteenth century Enlightenment philosopher and author of The American Crisis, said in a series of 16 pamphlets that were published during the American Revolution, \"These are the times that try men's souls.\"", "feedback": { "errors": [], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 5 ] } ], "corrected-prediction": "The American Crisis is a pamphlet series by eighteenth century Enlightenment philosopher and author, Thomas Paine, originally published from 1776 to 1783 during the American Revolution. Paine signed the pamphlets with the pseudonym, \"Common Sense\". The first volume begins with the famous words, \"These are the times that try men's souls.\"" }, "preference": [ 1, 0, 1, 2, 0, 1 ] }, { "question": "When did we break the speed of sound?", "passages": [], "gold": "The first creature to have ever breached the sound barrier was a dinosaur's tail 150 million years ago. Humans first broke the speed of sound on Oct. 14, 1947, in an aircraft.", "prediction 1": "We did break the speed of sound in the year 1990.", "prediction 2": "The speed of sound was broken in 1988.", "prediction 3": "When did we break the speed of sound?", "prediction 4": "The speed of sound has been governed for thousands of years.", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 49 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Who plays bart millard and i can only imagine?", "passages": [ [ "I Can Only Imagine (film)", "I Can Only Imagine (film)\n\nI Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time.", "The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid).", "Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "\"I Can Only Imagine\" was released in the United States on March 16, 2018.", "It was a massive box office success, grossing $85 million worldwide against a production budget of $7 million, becoming the fourth highest-grossing music biopic of all-time in the United States.", "Some critics praised it as inspiring and noted it as an improvement compared to other faith-based films, while others called it flat and by-the-numbers.", "At the 2018 Dove Awards, the film won \"Inspirational Film of the Year\".", "10-year-old Bart Millard lives with his mother and abusive father Arthur in Texas.", "One day his mother drops him off at a Christian camp where he meets Shannon.", "Upon his return from camp, Bart finds his mother has left and movers are removing her belongings." ] ], "gold": "In the American Christian biographical film \"I Can Only Imagine\", the role of Bart Millard is played by Brody Rose as a child and J. Michael Finley as an adult. The film is based on the story behind the group MercyMe's song of the same name.", "prediction 1": "I Can Only Imagine is a 2018 American Christian drama film, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "prediction 2": "I Can Only Imagine is a 2018 American Christian drama film. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins, and Brody Rose also star.", "prediction 3": "I Can Only Imagine is a 2018 American Christian drama film based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star.", "prediction 4": "I Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Brody Rose also stars.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 121, "end": 167 }, { "error type": "Irrelevant", "explanation": "", "start": 218, "end": 307 }, { "error type": "Irrelevant", "explanation": "", "start": 308, "end": 373 } ], "missing-info": [], "corrected-prediction": "I Can Only Imagine is a 2018 American Christian drama film, based on the story behind the MercyMe song of the same name. The film stars J. Michael Finley as Bart Millard, and Brody Rose also stars in the film." }, "preference": [ 2, 0, 0, 1, 1, 0 ] }, { "question": "Who did the british execute during the american revolution for being an american spy?", "passages": [ [ "Intelligence in the American Revolutionary War", "There he came into the open in the role for which he is best known, as an important financier of the Revolution.", "Less than a year after Nathan Hale was executed, another American agent went to the gallows in New York.", "On June 13, 1777, General Washington wrote the President of Congress: \"You will observe by the New York paper, the execution of Abm.", "(Abraham) Patten.", "His family deserves the generous Notice of Congress.", "He conducted himself with great fidelity to our Cause rendering Services and has fallen a Sacrifice in promoting her interest.", "Perhaps a public act of generosity, considering the character he was in, might not be so eligible as a private donation.\"", "\"Most accurate and explicit intelligence\" resulted from the work of Abraham Woodhull on Long Island and Robert Townsend in British-occupied New York City.", "Their operation, known as the Culper Ring from the operational names used by Woodhull (Culper Sr.) and Townsend (Culper Jr.), effectively used such intelligence tradecraft as codes, ciphers and secret ink for communications; a series of couriers and whaleboats to transmit reporting; at least one secret safe house, and numerous sources.", "The network was particularly effective in picking up valuable information from careless conversation wherever the British and their sympathizers gathered." ], [ "Nathan Hale", "Nathan Hale\n\nNathan Hale (June 6, 1755 \u2013 September 22, 1776) was an American soldier and spy for the Continental Army during the American Revolutionary War.", "He volunteered for an intelligence-gathering mission in New York City but was captured by the British and executed.", "Hale has long been considered an American hero and, in 1985, he was officially designated the state hero of Connecticut.", "Nathan Hale was born in Coventry, Connecticut, in 1755 to Richard Hale and Elizabeth Strong.", "In 1769, when he was fourteen years old, he was sent with his brother Enoch, who was sixteen, to Yale College.", "Nathan was a classmate of fellow patriot spy Benjamin Tallmadge.", "The Hale brothers belonged to the Linonian Society of Yale, which debated topics in astronomy, mathematics, literature, and the ethics of slavery.", "Nathan graduated with first-class honors in 1773 at age 18 and became a teacher, first in East Haddam and later in New London.", "After the Revolutionary War began in 1775, he joined a Connecticut militia and was elected first lieutenant within five months.", "His militia unit participated in the Siege of Boston, but Hale remained behind.", "It has been suggested that he was unsure as to whether he wanted to fight, or whether he was hindered because his teaching contract in New London did not expire until several months later, in July 1775." ] ], "gold": "During the American Revolution, the British executed several people for being American spies, including Nathan Hale in 1776 and Abraham Patten in 1777. Hale was an American Patriot, soldier, and spy for the Continental Army during the American Revolutionary War.", "prediction 1": "Nathan Hale was an American soldier and spy for the Continental Army during the American Revolutionary War. He volunteered for an intelligence-gathering mission in New York City but was captured by the British and executed. Hale has long been considered an American hero and, in 1985, he was officially designated the state hero of Connecticut.", "prediction 2": "Nathan Hale was an American soldier and spy for the Continental Army during the American Revolutionary War. He volunteered for an intelligence-gathering mission in New York City but was captured by the British and executed. Hale has long been considered an American hero and, in 1985, he was officially designated the state hero of Connecticut.", "prediction 3": "Nathan Hale, an American soldier and spy for the Continental Army during the American Revolutionary War, was captured by the British and executed. Hale volunteered for an intelligence-gathering mission in New York City but was captured by the British and executed. Hale has long been considered an American hero and, in 1985, he was officially designated the state hero of Connecticut.", "prediction 4": "Nathan Hale was an American soldier and spy for the Continental Army during the American Revolutionary War. He volunteered for an intelligence-gathering mission in New York City but was captured by the British and executed. Hale has long been considered an American hero and, in 1985, he was officially designated the state hero of Connecticut.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 108, "end": 223 }, { "error type": "Irrelevant", "explanation": "", "start": 224, "end": 344 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 3 ] } ], "corrected-prediction": "Nathan Hale was an American soldier and spy for the Continental Army during the American Revolutionary War. In 1777, Abraham Patten was executed as being American spy. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "Where did the invasion of italy take place?", "passages": [ [ "Allied invasion of Italy", "Allied invasion of Italy\n\nThe Allied invasion of Italy was the Allied amphibious landing on mainland Italy that took place on 3 September 1943 during the early stages of the Italian Campaign of World War II.", "The operation was undertaken by General Sir Harold Alexander's 15th Army Group (comprising General Mark W. Clark's Fifth Army and General Bernard Montgomery's British Eighth Army) and followed the successful invasion of Sicily.", "The main invasion force landed around Salerno on 9 September on the western coast in Operation Avalanche, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick).", "Following the defeat of the Axis Powers in North Africa in May 1943, there was disagreement between the Allies as to what the next step should be.", "The British Prime Minister, Winston Churchill, in particular wanted to invade Italy, which in November 1942 he called \"the soft underbelly of the axis\" (and General Mark W. Clark, in contrast, later called \"one tough gut\").", "Popular support in Italy for the war was declining, and he believed an invasion would remove Italy, and thus the influence of Axis forces in the Mediterranean Sea, opening it to Allied traffic." ], [ "Allied invasion of Italy", "Cover for the task force was provided by Force H, a group of four British battleships and two fleet carriers with destroyers in support, which was directly subordinate to the C\u2013in\u2013C Mediterranean Admiral of the Fleet Sir Andrew Cunningham.", "In the original planning, the great attraction of capturing the important port of Taranto in the \"heel\" of Italy had been evident and an assault had been considered but rejected because of the very strong defenses there.", "However, with the signing of the armistice with the Italians on 3 September the picture changed.", "It was decided to carry the British 1st Airborne Division (Major-General George F. Hopkinson) to Taranto using British warships, seize the port and several nearby airfields and follow up by shipping in Lieutenant-General Charles Allfrey's British V Corps and a number of fighter squadrons.", "The airborne division, which was undergoing training exercises in two locations apart, was ordered on 4 September to embark on 8 September.", "With such short notice to create plans, Operation Slapstick was soon nicknamed Operation Bedlam.", "The Avalanche plan using less than half the troops landed during Operation Husky was daring, considering possible resistance by six German divisions." ], [ "Italian imperialism under Fascism", "In 1942, with the Italian occupation of Corsica and Tunisia, the territories of the \"Imperial Italy\" dreamed of by the fascist De Vecchi were fully in Italian hands, with the exception of Malta, but the project was not politically implemented because the war was turning against the Axis powers.", "De Vecchi effected the first step towards an \"Italia Imperiale\" (or \"Grande Italia\") when in 1936, as Italian Governor of the Dodecanese islands, he imposed official use of the Italian language and created a colony of 7,000 Italians in Rhodes and surrounding islands.", "In 1940 he was appointed to the Grand Council of Fascism where later, during the Italian occupation of Greece, he proposed that the Kingdom of Italy annex the Dodecanese and Ionian islands, with the island of Chios, which had once belonged to the Republic of Genoa.", "Another fascist leader, Italo Balbo, promoted actively the development of Italian communities in coastal Libya, after the country was pacified from an Arab guerrilla war.", "Balbo called Tripolitania and Cyrenaica the \"Quarta Sponda\" (Fourth Shore) of Italy in reference to the other three shores (the western, the Adriatic and the southern) of the Italian peninsula.", "One of the initial Italian objectives in Libya, indeed, had been the relief of overpopulation and unemployment in Italy through emigration to the undeveloped colony." ] ], "gold": "There have been a number of invasions of Italy over the centuries in various parts of the country. In the Allied invasion in World War II, the main invasion force landed around Salerno while two supporting operations, Operation Baytown and Operation Slapstick, took place in Calabria and Taranto, respectively. The Lombardic invasion and the invasion of the First Italian War, also called the Italian War of 1494, both took place in northern Italy and the Italian peninsula. In the Ottoman invasion in the 1480s, the Ottoman Empire invaded the Italian city of Otranto in southern Italy.", "prediction 1": "The Allied invasion of Italy was the amphibious landing on mainland Italy that took place on 3 September 1943 during the early stages of the Italian Campaign of World War II. The operation was undertaken by General Sir Harold Alexander's 15th Army Group, which included General Mark W. Clark's Fifth Army and General Bernard Montgomery's British Eighth Army. The main invasion force landed around Salerno on 9 September on the western coast in Operation Avalanche, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick).", "prediction 2": "The Allied invasion of Italy was the Allied amphibious landing on mainland Italy that took place on 3 September 1943 during the early stages of the Italian Campaign of World War II. The main invasion force landed around Salerno on 9 September on the western coast in Operation Avalanche, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick).", "prediction 3": "The Allied invasion of Italy was the amphibious landing on mainland Italy that took place on 3 September 1943 during the early stages of the Italian Campaign of World War II. The main invasion force landed around Salerno on 9 September on the western coast in Operation Avalanche, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick). The operation was undertaken by General Sir Harold Alexander's 15th Army Group and followed the successful invasion of Sicily.", "prediction 4": "The Allied invasion of Italy was the amphibious landing on mainland Italy that took place on 3 September 1943 during the early stages of the Italian Campaign of World War II. The main invasion force landed around Salerno on 9 September on the western coast in Operation Avalanche, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick).", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 29, "end": 157 }, { "error type": "Irrelevant", "explanation": "", "start": 175, "end": 254 }, { "error type": "Irrelevant", "explanation": "", "start": 255, "end": 358 }, { "error type": "Irrelevant", "explanation": "", "start": 405, "end": 464 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 1, "sentence_id": [ 2 ] } ], "corrected-prediction": "There have been a number of invasions of Italy over the centuries in various parts of the country. The Allied invasion of Italy in World War II followed the successful invasion of Sicily. The main invasion force landed around Salerno, while two supporting operations took place in Calabria (Operation Baytown) and Taranto (Operation Slapstick)." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who was the first person voted off big brother?", "passages": [], "gold": "There are several series of \"Big Brother\". On the first season of American Big Brother, William Collins was the first person voted off. The first person voted off the first series of British Big Brother was Sada Walkington. The first person voted off the first season of American Celebrity Big Brother was Chuck Liddell and the first person voted off Celebrity Big Brother British series 1 was Chris Eubank. The first person voted off Big Brother Canada season 1 was Kat Yee.", "prediction 1": "The first person voted off Big Brother was Alexa.", "prediction 2": "Who was the first person voted off Big Brother?", "prediction 3": "Who was the first person voted off Big Brother?", "prediction 4": "Who was the first person voted off Big Brother?", "feedback": { "errors": [ { "error type": "Unverifiable", "explanation": "", "start": 0, "end": 49 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When do babies start breathing on their own?", "passages": [], "gold": "Babies start taking practice breaths at 10-12 weeks gestation. They take their first real breath within 10 seconds of birth.", "prediction 1": "When do babies start breathing on their own?", "prediction 2": "When do babies start breathing on their own?", "prediction 3": "When do babies start breathing on their own?", "prediction 4": "When do babies start breathing on their own?", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 44 } ], "missing-info": [], "corrected-prediction": "" }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When did the one plus 5 come out?", "passages": [ [ "OnePlus 5", "OnePlus 5\n\nThe OnePlus 5 (also abbreviated as OP5) is a smartphone made by OnePlus.", "It is the successor to the OnePlus 3T released in 2016.", "The OnePlus 5 was officially unveiled during a keynote on 20 June 2017.", "It was succeeded by the OnePlus 5T five months later on November 21, 2017.", "\"The Verge\" announced in May 2017 that the upcoming device would be known as the OnePlus 5.", "It was said that this decision was due to the number four being considered unlucky (tetraphobia) in China.", "OnePlus confirmed that the handset would feature a Snapdragon 835 processor prior to the launch.", "OnePlus also noted its work with the image processing firm DxO to improve the camera on the device.", "The OnePlus 5 has an anodized metal back like its predecessors, the OnePlus 3 and 3T. The handset is currently available in Slate Gray (black/gray) and Soft Gold (white/gold) colors.", "The limited edition Soft Gold color was released on 7 August 2017.", "A Midnight Black (black/matte black) color was also manufactured, but later removed from their website.", "Another special edition version made in association with \"Castelbajac\" is exclusively available in Europe." ] ], "gold": "The OnePlus 5, also abbreviated as OP5, is a smartphone made by OnePlus. It released in the United States, Canada, United Kingdom, Germany and France on June 20,2017. In the Netherlands, Finland, and Denmark, it released June 21, 2017, in India and China on June 22, 2017, and internationally it came out on June 27, 2017.", "prediction 1": "The OnePlus 5 was officially unveiled during a keynote on 20 June 2017. It was succeeded by the OnePlus 5T five months later on November 21, 2017.", "prediction 2": "The OnePlus 5 was officially unveiled during a keynote on 20 June 2017 and was succeeded by the OnePlus 5T five months later on November 21, 2017.", "prediction 3": "The OnePlus 5 was officially unveiled during a keynote on 20 June 2017. It was succeeded by the OnePlus 5T five months later on November 21, 2017.", "prediction 4": "The OnePlus 5 was officially unveiled during a keynote on 20 June 2017. It was succeeded by the OnePlus 5T five months later on November 21, 2017.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 72, "end": 146 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "The OnePlus 5, also abbreviated as OP5, is a smartphone made by OnePlus. The OnePlus 5 was officially unveiled during a keynote on 20 June 2017. " }, "preference": [ 0, 0, 0, 0, 0, 0 ] }, { "question": "When is thanksgiving what day is thanksgiving on?", "passages": [ [ "Thanksgiving (United States)", "Thanksgiving (United States)\n\n", "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November.", "It originated as a harvest festival.", "Thanksgiving has been celebrated nationally on and off since 1789, with a proclamation by George Washington after a request by Congress.", "Thomas Jefferson chose not to observe the holiday, and its celebration was intermittent until the presidency of Abraham Lincoln, when Thanksgiving became a federal holiday in 1863, during the American Civil War.", "Lincoln proclaimed a national day of \"Thanksgiving and Praise to our beneficent Father who dwelleth in the Heavens,\" to be celebrated on the last Thursday in November.", "Under President Franklin D. Roosevelt, the date was changed to the fourth Thursday in November, an innovation that endures to this day.", "Together with Christmas and the New Year, Thanksgiving is a part of the broader fall\u2013winter holiday season in the U.S.", "The event that Americans commonly call the \"First Thanksgiving\" was celebrated by the Pilgrims after their first harvest in the New World in October 1621.", "This feast lasted three days, and\u2014as accounted by attendee Edward Winslow\u2014it was attended by 90 Native Americans and 53 Pilgrims.", "The New England colonists were accustomed to regularly celebrating \"thanksgivings\"\u2014days of prayer thanking God for blessings such as military victory or the end of a drought." ], [ "Thanksgiving", "As President of the United States, George Washington proclaimed the first nationwide thanksgiving celebration in America marking November 26, 1789, \"as a day of public thanksgiving and prayer, to be observed by acknowledging with grateful hearts the many and signal favours of Almighty God\".", "The question of where the first Thanksgiving was held in the United States has been a subject of debate, primarily between New England and Virginia, complicated by the concept of Thanksgiving as a holiday celebration versus a religious service.", "James Baker maintains, \"The American holiday's true origin was the New England Calvinist Thanksgiving.", "Never coupled with a Sabbath meeting, the Puritan observances were special days set aside during the week for thanksgiving and praise in response to God's providence.\"", "Baker calls the debate a \"tempest in a beanpot\" and \"marvelous nonsense\" based on regional claims.", "However, the day for Thanksgiving services specifically codified in the founding charter of Berkeley Hundred in 1619 was instrumental in President John F. Kennedy's attempt to strike a compromise between the regional claims, by issuing Proclamation 3560 on November 5, 1963, stating, \"Over three centuries ago, our forefathers in Virginia and in Massachusetts, far from home in a lonely wilderness, set aside a time of thanksgiving." ], [ "Small Business Saturday", "Small Business Saturday\n\nSmall Business Saturday is an American shopping holiday held during the Saturday after US Thanksgiving during one of the busiest shopping periods of the year.", "This Saturday is always the last one in November, so falls between November 24 and November 30.", "First observed in the United States on November 27, 2010, it is a counterpart to Black Friday and Cyber Monday, which feature big box retail and e-commerce stores respectively.", "By contrast, Small Business Saturday encourages holiday shoppers to patronize brick and mortar businesses that are small and local.", "\"Small Business Saturday\" is a registered trademark of American Express.", "The first event was sponsored by American Express, in partnership with the non-profit National Trust for Historic Preservation, Boston Mayor Thomas M. Menino, and Roslindale Village Main Street.", "In 2010, the holiday was promoted by American Express via a nationwide radio and television advertising campaign.", "That year Amex bought advertising inventory on Facebook, which it in turn gave to its small merchant account holders, and also gave rebates to new customers to promote the event.", "American Express publicized the initiative using social media, advertising, and public relations." ] ], "gold": "Thanksgiving is a federal holiday in the United States and is celebrated on the fourth Thursday of November each year instead of on a specific date. The fourth Thursday of November doesn't fall on the same date each year. In 2015, Thanksgiving fell on November 26, the next year it fell on November 24, and in 2017 Thanksgiving was celebrated on November 23.", "prediction 1": "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November. It originated as a harvest festival. It has been celebrated nationally on and off since 1789, with a proclamation by George Washington after a request by Congress. Thomas Jefferson chose not to observe the holiday, and its celebration was intermittent until the presidency of Abraham Lincoln, when Thanksgiving became a federal holiday in 1863, during the American Civil War. Lincoln proclaimed a national day of \"Thanksgiving and Praise to our beneficent Father who dwelleth in the Heavens,\" to be celebrated on the last Thursday in November. Under President Franklin D. Roosevelt, the date was changed to the fourth Thursday in November, an innovation that endures to this day.", "prediction 2": "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November. It originated as a harvest festival. The first Thanksgiving in the United States was on November 26, 1789, and has been celebrated nationally on and off since then.", "prediction 3": "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November. It originated as a harvest festival. The date of the first thanksgiving has been debated in the United States, primarily between New England and Virginia, complicated by the concept of thanksgiving as a holiday celebration versus a religious service. The first thanksgiving was celebrated in America on November 26, 1789, with a proclamation by George Washington after a request by Congress.", "prediction 4": "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November. It originated as a harvest festival. The first nationwide thanksgiving celebration was held on November 26, 1789, and has been celebrated on and off since. The first thanksgiving celebration in America was held on November 27, 2010.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 104, "end": 140 }, { "error type": "Irrelevant", "explanation": "", "start": 141, "end": 267 }, { "error type": "Irrelevant", "explanation": "", "start": 268, "end": 479 }, { "error type": "Irrelevant", "explanation": "", "start": 480, "end": 647 }, { "error type": "Irrelevant", "explanation": "", "start": 648, "end": 783 } ], "missing-info": [], "corrected-prediction": "Thanksgiving is a national holiday in the United States, celebrated on the fourth Thursday of November. " }, "preference": [ 2, 2, 2, 2, 2, 2 ] }, { "question": "Who was defeated in the battle of yorktown?", "passages": [ [ "Siege of Yorktown", "Siege of Yorktown\n\nThe Siege of Yorktown, also known as the Battle of Yorktown, the Surrender at Yorktown, German Battle or the Siege of Little York, ending on October 19, 1781, at Yorktown, Virginia, was a decisive victory by a combined force of American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis.", "The culmination of the Yorktown campaign, the siege proved to be the last major land battle of the American Revolutionary War in the North American theater, as the surrender by Cornwallis, and the capture of both him and his army, prompted the British government to negotiate an end to the conflict.", "The battle boosted faltering American morale and revived French enthusiasm for the war, as well as undermining popular support for the conflict in Great Britain.", "In 1780, about 5,500 French soldiers landed in Rhode Island to help their American allies fight the British troops who controlled New York City.", "Following the arrival of dispatches from France that included the possibility of support from the French West Indies fleet of the Comte de Grasse, Washington and Rochambeau decided to ask de Grasse for assistance either in besieging New York, or in military operations against a British army operating in Virginia." ], [ "Siege of Yorktown (1862)", "This lost opportunity held up McClellan for two additional weeks while he tried to convince the U.S. Navy to bypass the Confederates' big guns at Yorktown and Gloucester Point and ascend the York River to West Point and outflank the Warwick Line.", "McClellan planned a massive bombardment for dawn on May 5, but the Confederate army slipped away during the night of May 3 toward Williamsburg.", "The battle took place near the site of the 1781 Siege of Yorktown.", "McClellan had chosen to approach the Confederate capital of Richmond, Virginia, with an amphibious operation that landed troops on the tip of the Virginia Peninsula at Fort Monroe.", "His Army of the Potomac numbered 121,500 men, transported starting on March 17 by 389 vessels.", "McClellan planned to use U.S. Navy forces to envelop Yorktown, but the emergence of the Confederate ironclad CSS \"Virginia\" and the Battle of Hampton Roads (March 8\u20139, 1862) disrupted this plan.", "The threat of the \"Virginia\" on the James River and the heavy Confederate batteries at the mouth of the York River prevented the Navy from assuring McClellan that they could control either the York or the James, so he settled on a purely land approach toward Yorktown." ] ], "gold": "There was a Battle of Yorktown during the American Revolutionary War in 1781 and during the American Civil War in 1862. The 1781 was between the American Continental Army troops led by General George Washington and Gilbert du Motier, Marquis de Lafayette, and French Army troops led by Comte de Rochambeau over a British army commanded by British peer and Lieutenant General Charles Cornwallis. The British Army was defeated. The 1862 battle was between Union Maj. Gen. George B. McClellan's Army of the Potomac and Maj. Gen. John B. Magruder's small Confederate force at Yorktown behind the Warwick Line. It is inconclusive who won this battle since McClellan planned a massive bombardment for dawn on May 5, but the Confederate army slipped away during the night of May 3 toward Williamsburg.", "prediction 1": "The Siege of Yorktown, also known as the Battle of Yorktown, the Surrender at Yorktown, German Battle or the Siege of Little York, ending on October 19, 1781, at Yorktown, Virginia, was a decisive victory by a combined force of American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis. The British surrendered, and the capture of both him and his army, prompted the British government to negotiate an end to the conflict. The battle proved to be the last major land battle of the American Revolutionary War in the North American theater. The siege proved to be the last major land battle of the American Revolutionary War in the North American theater, as the surrender by Cornwallis, and the capture of both him and his army, prompted the British government to negotiate an", "prediction 2": "The 1781 Siege of Yorktown, also known as the Battle of Yorktown, the Surrender at Yorktown, the German Battle or the Siege of Little York, ending on October 19, 1781, at Yorktown, Virginia, was a decisive victory by a combined force of American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis.", "prediction 3": "The Siege of Yorktown, also known as the Battle of Yorktown, the Surrender at Yorktown, German Battle or the Siege of Little York, ending on October 19, 1781, at Yorktown, Virginia, was a decisive victory by a combined force of American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis. The siege proved to be the last major land battle of the American Revolutionary War in the North American theater, as the surrender by Cornwallis, and the capture of both him and his army, prompted the British government to negotiate an end to the conflict.", "prediction 4": "The Siege of Yorktown, also known as the Battle of Yorktown, the Surrender at Yorktown, German Battle or the Siege of Little York, ending on October 19, 1781, at Yorktown, Virginia, was a decisive victory by a combined force of American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 573, "end": 688 }, { "error type": "Redundant", "explanation": "The battle proved to be the last major land battle of the American Revolutionary War in the North American theater. ", "start": 689, "end": 803 }, { "error type": "Irrelevant", "explanation": "", "start": 804, "end": 925 }, { "error type": "Irrelevant", "explanation": "", "start": 0, "end": 22 }, { "error type": "Irrelevant", "explanation": "", "start": 61, "end": 130 }, { "error type": "Irrelevant", "explanation": "", "start": 131, "end": 152 }, { "error type": "Irrelevant", "explanation": "", "start": 159, "end": 204 }, { "error type": "Irrelevant", "explanation": "", "start": 462, "end": 572 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 0 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 1 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 2 ] }, { "error type": "Missing-Minor-Auxiliary", "passage_id": 2, "sentence_id": [ 5 ] } ], "corrected-prediction": "There was a Battle of Yorktown during the American Revolutionary War in 1781 and during 1862. The 1781 battle was between the American Continental Army troops led by General George Washington and French Army troops led by the Comte de Rochambeau over a British Army commanded by British peer and Lieutenant General Charles Cornwallis. The British Army was defeated. In the 1862 battle, McClellan's Army of the Potomac was held up while he tried to convince the U.S. Navy to bypass the Confederates' big guns at Yorktown and Gloucester Point and ascend the York River to West Point and outflank the Warwick Line. It is inconclusive who won this battle since McClellan planned a massive bombardment for dawn on May 5, but the Confederate army slipped away during the night of May 3 toward Williamsburg." }, "preference": [ 1, 1, 1, 2, 0, 1 ] }, { "question": "Who plays kate pearson's mom on this is us?", "passages": [ [ "This Is Us (season 3)", "Main cast members Milo Ventimiglia, Mandy Moore, Sterling K. Brown, Chrissy Metz, Justin Hartley, Susan Kelechi Watson, Chris Sullivan, Jon Huertas and Ron Cephas Jones return from the second season as Jack Pearson, Rebecca Pearson, Randall Pearson, Kate Pearson, Kevin Pearson, Beth Pearson, Toby Damon, Miguel Rivas, and William H. Hill, respectively.", "Lyric Ross, who recurred as D\u00e9j\u00e0 throughout the second season, was subsequently promoted to the principal cast in the third season.", "In August 2018, Michael Angarano was cast to recur as Nick Pearson, Jack Pearson's brother; the character was first mentioned in the second season, and previously was depicted only briefly as a child.", "Melanie Liburd was promoted to series regular after guest starring in the second season as Zoe, Beth Pearson's cousin and Kevin Pearson's new love interest.", "Production on the season officially began on July 10, 2018, in Los Angeles.", "General references" ], [ "This Is Us (season 1)", "This Is Us (season 1)\n\nThe first season of the American television series \"This Is Us\" follows the family lives and connections of several people who all share the same birthday and the ways in which they are similar and different.", "The season is produced by Rhode Island Ave.", "Productions, Zaftig Films, and 20th Century Fox Television, with Fogelman and Don Todd serving as showrunners.", "The season stars an ensemble cast featuring Milo Ventimiglia, Mandy Moore, Sterling K. Brown, Chrissy Metz, Justin Hartley, Susan Kelechi Watson, Chris Sullivan, and Ron Cephas Jones.", "The season, which premiered on NBC on September 20, 2016, and ran until March 14, 2017, over 18 episodes, received generally positive reviews from critics.", "It was chosen by the American Film Institute as one of the top ten television programs of 2016, and received ten nominations for the 69th Primetime Emmy Awards, including Outstanding Drama Series with Brown winning for Outstanding Lead Actor in a Drama Series, as well as receiving nominations for the Golden Globe Award for Best Television Series \u2013 Drama and the Critics' Choice Television Award for Best Drama Series.", "The series was renewed for a second and third season on January 18, 2017.", "\n\nDan Fogelman and Don Todd served as the season's showrunners." ] ], "gold": "Rebecca Pearson is a character from the American drama television series This is Us. She is Jack Pearson's widow and the mother of Kevin, Kate, and Randall Pearson. Throughout the show, she is shown at different stages of her life, portrayed by different actresses. Early-childhood Kate is played by Kya Kruse, mid-childhood by Ava Castro and Mandy Moore takes on the role for the scenes where she's an adult.", "prediction 1": "This Is Us follows the family lives and connections of several people who all share the same birthday and the ways they are similar and different. The first season stars Milo Ventimiglia as Kate Pearson's mom, Sterling K. Brown as Randall Pearson's mom and Susan Kelechi Watson as her mom. Jon Huertas plays Randall Pearson's dad on the show, while Susan Kelechi Watson plays Kate Pearson's mom.", "prediction 2": "Kate Pearson is the main character on the American television show This Is Us and the mother of Kevin and Beth Pearson. Kate's mother is played by Sterling K. Brown.", "prediction 3": "This Is Us has been in the news a lot lately. The character Kate Pearson's mom has been a character on the show since season 2 and she is played by Elizabeth Banks.", "prediction 4": "This Is Us is an American television series about the lives and connections of several people who all share the same birthday and the ways they are similar and different. Kate Pearson's mother is played by Sterling K. Brown. Randall Pearson is played by Sterling K. Brown. Sterling K. Brown plays Randall Pearson's father on the series.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 11, "end": 146 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 190, "end": 209 }, { "error type": "Irrelevant", "explanation": "", "start": 164, "end": 186 }, { "error type": "Wrong-Grounding", "explanation": "{\"passage_id\":1,\"sentence_id\":[1]}", "start": 249, "end": 252 }, { "error type": "Irrelevant", "explanation": "", "start": 210, "end": 227 }, { "error type": "Unverifiable", "explanation": "", "start": 278, "end": 289 }, { "error type": "Unverifiable", "explanation": "", "start": 308, "end": 342 }, { "error type": "Redundant", "explanation": "and Susan Kelechi Watson as her mom. ", "start": 349, "end": 395 } ], "missing-info": [ { "error type": "Missing-Major-Auxiliary", "passage_id": 1, "sentence_id": [ 1 ] } ], "corrected-prediction": "Rebecca Pearson is a character on the This is Us show. She is played by Mandy Moore. " }, "preference": [ 1, 1, 1, 1, 2, 2 ] }, { "question": "When did scotland become part of the union?", "passages": [ [ "Acts of Union 1707", "Acts of Union 1707\n\nThe Acts of Union were two Acts of Parliament: the Union with Scotland Act 1706 passed by the Parliament of England, and the Union with England Act passed in 1707 by the Parliament of Scotland.", "They put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706, following negotiation between commissioners representing the parliaments of the two countries.", "By the two Acts, the Kingdom of England and the Kingdom of Scotlandwhich at the time were separate states with separate legislatures, but with the same monarchwere, in the words of the Treaty, \"United into One Kingdom by the Name of Great Britain\".", "The two countries had shared a monarch since the Union of the Crowns in 1603, when King James VI of Scotland inherited the English throne from his double first cousin twice removed, Queen Elizabeth I.", "Although described as a Union of Crowns, until 1707 there were in fact two separate Crowns resting on the same head (as opposed to the implied creation of a single Crown and a single Kingdom, exemplified by the later Kingdom of Great Britain).", "Prior to the Acts of Union there had been three previous attempts (in 1606, 1667, and 1689) to unite the two countries by Acts of Parliament, but it was not until the early 18th century that both political establishments came to support the idea, albeit for different reasons." ], [ "History of England", "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were a pair of Parliamentary Acts passed by both parliaments in 1707, which dissolved them in order to form a Kingdom of Great Britain governed by a unified Parliament of Great Britain according to the Treaty of Union.", "The Acts joined the Kingdom of England and the Kingdom of Scotland (previously separate states, with separate legislatures but with the same monarch) into a single Kingdom of Great Britain.", "The two countries had shared a monarch since the Union of the Crowns in 1603, when King James VI of Scotland inherited the English throne from his double first cousin twice removed, Queen Elizabeth I.", "Although described as a Union of Crowns, until 1707 there were in fact two separate Crowns resting on the same head.", "There had been three attempts in 1606, 1667, and 1689 to unite the two countries by Acts of Parliament, but it was not until the early 18th century that the idea had the will of both political establishments behind them, albeit for rather different reasons.", "The Acts took effect on 1 May 1707.", "On this date, the Scots Parliament and the English Parliament united to form the Parliament of Great Britain, based in the Palace of Westminster in London, the home of the English Parliament.", "Hence, the Acts are referred to as the Union of the Parliaments." ] ], "gold": "The Acts of Union were two Acts of Parliament: the Union with Scotland Act 1706 passed by the Parliament of England, and the Union with England Act passed in 1707 by the Parliament of Scotland. They put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706. The Acts took effect on 1 May 1707. Then, the Scottish Parliament and the English Parliament united to form the Parliament of Great Britain.", "prediction 1": "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament, the Union with Scotland Act 1706 passed by the Parliament of England, and the Union with England Act 1707 passed by the Parliament of Scotland. They put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706, following negotiation between commissioners representing the parliaments of the two countries. The two countries had shared a monarch since the Union of the Crowns in 1603, when King James VI of Scotland inherited the English throne from his double first cousin twice removed, Queen Elizabeth I. Although described as a Union of Crowns, until 1707 there were in fact two separate Crowns resting on the same head.", "prediction 2": "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament that put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706, following negotiation between commissioners representing the parliaments of the two countries. The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament that took effect on 1 May 1707. They joined the Kingdom of England and the Kingdom of Scotland, previously separate states, with separate legislatures but with the same monarch, into a single Kingdom of Great Britain governed by a unified Parliament of Great Britain governed by a unified Parliament of Great Britain and a unified Parliament of Great Britain according to the Treaty of Union.", "prediction 3": "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament passed by both parliaments in 1707, which dissolved them in order to form a Kingdom of Great Britain governed by a unified Parliament of Great Britain according to the Treaty of Union. They joined the Kingdom of England and the Kingdom of Scotland (previously separate states, with separate legislatures but with the same monarch) into a single Kingdom of Great Britain. The Acts took effect on 1 May 1707.", "prediction 4": "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament: the Union with Scotland Act 1706 passed by the Parliament of England, and the Union with England Act 1707 passed by the Parliament of Scotland. They put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706, following negotiation between commissioners representing the parliaments of the two countries. The two countries had shared a monarch since the Union of the Crowns in 1603, when King James VI of Scotland inherited the English throne from his double first cousin twice removed, Queen Elizabeth I. Although described as a Union of Crowns, until 1707 there were in fact two separate Crowns resting on the same head. The Acts joined the Kingdom of Great Britain governed by a unified Parliament of Great Britain governed by a unified Parliament of Great Britain according to the Treaty of Union.", "feedback": { "errors": [ { "error type": "Irrelevant", "explanation": "", "start": 342, "end": 436 }, { "error type": "Irrelevant", "explanation": "", "start": 437, "end": 637 }, { "error type": "Irrelevant", "explanation": "", "start": 638, "end": 754 } ], "missing-info": [ { "error type": "Missing-Answer", "passage_id": 2, "sentence_id": [ 6 ] }, { "error type": "Missing-Major-Auxiliary", "passage_id": 2, "sentence_id": [ 7 ] } ], "corrected-prediction": "The Acts of Union between the Kingdom of England and the Kingdom of Scotland were two Acts of Parliament, the Union with Scotland Act 1706 passed by the Parliament of England, and the Union with England Act 1707 passed by the Parliament of Scotland. They put into effect the terms of the Treaty of Union that had been agreed on 22 July 1706. The Acts took effect on 1 May 1707. Then, the Scottish Parliament and the English Parliament united to form the Parliament of Great Britain. " }, "preference": [ 1, 1, 1, 2, 0, 1 ] } ]